2024-09-12T00:17:49.609 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T00:17:49.632 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T00:17:49.727 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901864 branch: wip-cls-rgw-busy-resharding description: rgw/verify/{0-install accounts$/{main} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} email: null first_in_suite: false job_id: '7901864' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-cls-rgw-busy-resharding ceph: conf: client: debug rgw: 20 debug rgw notification: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw max chunk size: 4194304 rgw obj stripe size: 6291456 rgw reshard progress judge interval: 10 rgw s3 auth use sts: true rgw sts key: abcdefghijklmnop rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd heartbeat grace: 40 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 rgw override bucket index max shards: 1 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon osd crush smoke test: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug objclass: 20 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f openssl_keys: rgw.client.0: ca: root client: client.0 embed-key: true root: client: client.0 cn: teuthology install: - client.0 key-type: rsa:4096 rgw: client.0: ssl certificate: rgw.client.0 valgrind: - --tool=memcheck - --max-threads=1024 compression type: random ec-data-pool: false frontend: beast inline data: false storage classes: LUKEWARM, FROZEN s3tests: accounts: iam alt root: RGW99999999999999999 iam root: RGW88888888888888888 s3 main: RGW11111111111111111 force-branch: ceph-master storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-67986 sha1: 6a169fc940965ab446a63954fde870aa497efde7 owner: scheduled_cbodley@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 2206 sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f sleep_before_teardown: 0 suite: rgw suite_branch: wip-67986 suite_path: /home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa suite_relpath: qa suite_repo: https://github.com/cbodley/ceph.git suite_sha1: 6a169fc940965ab446a63954fde870aa497efde7 targets: smithi073.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEb8ri1JP2kCtFtNvYymNdRYFkeVsX9IVWIyxPzaT4aWIzUgBo49sh9dWVoBBQPvhUXjLsZJdjyZ9dI2GCLHdXc= smithi117.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMq1eEhnterC40EScosx0v3fMTYmPoiPQS+GNY/pEOxFvA47H6j3xp3v9o0q6dCnEc+NkJXfrhINIAb3c3d1l3E= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - cls/test_cls_user.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: force-branch: wip-67986 rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_23:33:24 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T00:17:49.727 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa; will attempt to use it 2024-09-12T00:17:49.728 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa/tasks 2024-09-12T00:17:49.728 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T00:17:49.729 INFO:teuthology.task.internal:Checking packages... 2024-09-12T00:17:49.750 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd011c522bb171e70fc5782f1e7a71ce5f37e573f' 2024-09-12T00:17:49.750 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T00:17:49.750 INFO:teuthology.packaging:ref: None 2024-09-12T00:17:49.750 INFO:teuthology.packaging:tag: None 2024-09-12T00:17:49.750 INFO:teuthology.packaging:branch: wip-cls-rgw-busy-resharding 2024-09-12T00:17:49.750 INFO:teuthology.packaging:sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:17:49.750 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-cls-rgw-busy-resharding 2024-09-12T00:17:49.915 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4753.gd011c522 2024-09-12T00:17:49.917 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T00:17:49.923 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T00:17:49.924 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T00:17:49.989 INFO:teuthology.task.internal:Saving configuration 2024-09-12T00:17:50.005 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T00:17:50.032 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T00:17:50.059 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901864', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 00:12:51.193355', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEb8ri1JP2kCtFtNvYymNdRYFkeVsX9IVWIyxPzaT4aWIzUgBo49sh9dWVoBBQPvhUXjLsZJdjyZ9dI2GCLHdXc='} 2024-09-12T00:17:50.089 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi117.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901864', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 00:12:51.191686', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMq1eEhnterC40EScosx0v3fMTYmPoiPQS+GNY/pEOxFvA47H6j3xp3v9o0q6dCnEc+NkJXfrhINIAb3c3d1l3E='} 2024-09-12T00:17:50.089 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T00:17:50.100 INFO:teuthology.task.internal:roles: ubuntu@smithi073.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-12T00:17:50.100 INFO:teuthology.task.internal:roles: ubuntu@smithi117.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-12T00:17:50.100 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T00:17:50.223 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3d9af7b490>, signals=[15]) 2024-09-12T00:17:50.223 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T00:17:50.233 INFO:teuthology.task.internal:Opening connections... 2024-09-12T00:17:50.233 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi073.front.sepia.ceph.com 2024-09-12T00:17:50.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:17:50.320 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi117.front.sepia.ceph.com 2024-09-12T00:17:50.321 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:17:50.421 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T00:17:50.429 DEBUG:teuthology.orchestra.run.smithi073:> uname -m 2024-09-12T00:17:50.448 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64 2024-09-12T00:17:50.448 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2024-09-12T00:17:50.505 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="CentOS Stream" 2024-09-12T00:17:50.505 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="9" 2024-09-12T00:17:50.505 INFO:teuthology.orchestra.run.smithi073.stdout:ID="centos" 2024-09-12T00:17:50.506 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="rhel fedora" 2024-09-12T00:17:50.506 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="9" 2024-09-12T00:17:50.506 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el9" 2024-09-12T00:17:50.506 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T00:17:50.506 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31" 2024-09-12T00:17:50.506 INFO:teuthology.orchestra.run.smithi073.stdout:LOGO="fedora-logo-icon" 2024-09-12T00:17:50.506 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T00:17:50.506 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://centos.org/" 2024-09-12T00:17:50.506 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T00:17:50.506 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T00:17:50.506 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T00:17:50.507 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2024-09-12T00:17:50.549 DEBUG:teuthology.orchestra.run.smithi117:> uname -m 2024-09-12T00:17:50.568 INFO:teuthology.orchestra.run.smithi117.stdout:x86_64 2024-09-12T00:17:50.569 DEBUG:teuthology.orchestra.run.smithi117:> cat /etc/os-release 2024-09-12T00:17:50.626 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="CentOS Stream" 2024-09-12T00:17:50.626 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="9" 2024-09-12T00:17:50.626 INFO:teuthology.orchestra.run.smithi117.stdout:ID="centos" 2024-09-12T00:17:50.626 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE="rhel fedora" 2024-09-12T00:17:50.627 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="9" 2024-09-12T00:17:50.627 INFO:teuthology.orchestra.run.smithi117.stdout:PLATFORM_ID="platform:el9" 2024-09-12T00:17:50.627 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T00:17:50.627 INFO:teuthology.orchestra.run.smithi117.stdout:ANSI_COLOR="0;31" 2024-09-12T00:17:50.627 INFO:teuthology.orchestra.run.smithi117.stdout:LOGO="fedora-logo-icon" 2024-09-12T00:17:50.627 INFO:teuthology.orchestra.run.smithi117.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T00:17:50.627 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://centos.org/" 2024-09-12T00:17:50.627 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T00:17:50.627 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T00:17:50.627 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T00:17:50.628 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server 2024-09-12T00:17:50.666 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T00:17:50.679 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T00:17:50.744 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T00:17:50.744 DEBUG:teuthology.orchestra.run.smithi073:> test '!' -e /home/ubuntu/cephtest 2024-09-12T00:17:50.746 DEBUG:teuthology.orchestra.run.smithi117:> test '!' -e /home/ubuntu/cephtest 2024-09-12T00:17:50.763 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T00:17:50.835 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T00:17:50.835 DEBUG:teuthology.orchestra.run.smithi073:> test -z $(ls -A /var/lib/ceph) 2024-09-12T00:17:50.837 DEBUG:teuthology.orchestra.run.smithi117:> test -z $(ls -A /var/lib/ceph) 2024-09-12T00:17:50.922 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T00:17:50.989 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T00:17:51.017 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-12T00:17:51.017 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-12T00:17:51.018 DEBUG:teuthology.orchestra.run.smithi073:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T00:17:51.018 DEBUG:teuthology.orchestra.run.smithi117:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T00:17:51.035 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:17:51.035 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2024-09-12T00:17:51.036 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:17:51.036 DEBUG:teuthology.orchestra.run.smithi117:> uname -r 2024-09-12T00:17:51.094 INFO:teuthology.orchestra.run.smithi073.stdout:5.14.0-503.el9.x86_64 2024-09-12T00:17:51.094 INFO:teuthology.task.kernel:Running kernel on smithi073: 5.14.0-503.el9.x86_64 2024-09-12T00:17:51.094 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum install -y kernel 2024-09-12T00:17:51.095 INFO:teuthology.orchestra.run.smithi117.stdout:5.14.0-503.el9.x86_64 2024-09-12T00:17:51.095 INFO:teuthology.task.kernel:Running kernel on smithi117: 5.14.0-503.el9.x86_64 2024-09-12T00:17:51.095 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum install -y kernel 2024-09-12T00:17:53.394 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.2 MB 00:00 2024-09-12T00:17:54.439 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - BaseOS 5.2 MB/s | 8.2 MB 00:01 2024-09-12T00:17:56.574 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - AppStream 19 MB/s | 20 MB 00:01 2024-09-12T00:17:56.620 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - AppStream 9.6 MB/s | 20 MB 00:02 2024-09-12T00:18:01.903 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - CRB 4.3 MB/s | 6.5 MB 00:01 2024-09-12T00:18:02.216 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - CRB 3.5 MB/s | 6.5 MB 00:01 2024-09-12T00:18:03.636 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 19 kB 00:00 2024-09-12T00:18:03.683 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - Extras packages 71 kB/s | 19 kB 00:00 2024-09-12T00:18:04.449 INFO:teuthology.orchestra.run.smithi117.stdout:Extra Packages for Enterprise Linux 33 MB/s | 23 MB 00:00 2024-09-12T00:18:04.629 INFO:teuthology.orchestra.run.smithi073.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-12T00:18:09.879 INFO:teuthology.orchestra.run.smithi117.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-12T00:18:10.034 INFO:teuthology.orchestra.run.smithi073.stdout:lab-extras 40 kB/s | 1.7 kB 00:00 2024-09-12T00:18:11.894 INFO:teuthology.orchestra.run.smithi117.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T00:18:11.894 INFO:teuthology.orchestra.run.smithi117.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T00:18:11.986 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-12T00:18:11.997 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-12T00:18:11.997 INFO:teuthology.orchestra.run.smithi117.stdout: Package Architecture Version Repository Size 2024-09-12T00:18:11.997 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-12T00:18:11.997 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-09-12T00:18:11.997 INFO:teuthology.orchestra.run.smithi117.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T00:18:11.997 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2024-09-12T00:18:11.997 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T00:18:11.998 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T00:18:11.998 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T00:18:11.998 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T00:18:11.998 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-09-12T00:18:11.998 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-12T00:18:11.998 INFO:teuthology.orchestra.run.smithi117.stdout:Install 4 Packages 2024-09-12T00:18:11.998 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T00:18:11.998 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 79 M 2024-09-12T00:18:11.998 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 126 M 2024-09-12T00:18:11.998 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-09-12T00:18:12.032 INFO:teuthology.orchestra.run.smithi073.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T00:18:12.033 INFO:teuthology.orchestra.run.smithi073.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T00:18:12.122 INFO:teuthology.orchestra.run.smithi117.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 219 kB/s | 23 kB 00:00 2024-09-12T00:18:12.128 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-12T00:18:12.138 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-12T00:18:12.138 INFO:teuthology.orchestra.run.smithi073.stdout: Package Architecture Version Repository Size 2024-09-12T00:18:12.138 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-12T00:18:12.138 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-12T00:18:12.138 INFO:teuthology.orchestra.run.smithi073.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T00:18:12.138 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-09-12T00:18:12.139 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T00:18:12.139 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T00:18:12.139 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T00:18:12.139 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:18:12.139 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-12T00:18:12.139 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-12T00:18:12.139 INFO:teuthology.orchestra.run.smithi073.stdout:Install 4 Packages 2024-09-12T00:18:12.139 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:18:12.140 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 79 M 2024-09-12T00:18:12.140 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 126 M 2024-09-12T00:18:12.140 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-12T00:18:12.377 INFO:teuthology.orchestra.run.smithi073.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 234 kB/s | 23 kB 00:00 2024-09-12T00:18:14.864 INFO:teuthology.orchestra.run.smithi117.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 5.5 MB/s | 16 MB 00:02 2024-09-12T00:18:15.028 INFO:teuthology.orchestra.run.smithi073.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 5.7 MB/s | 16 MB 00:02 2024-09-12T00:18:16.538 INFO:teuthology.orchestra.run.smithi117.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 6.5 MB/s | 29 MB 00:04 2024-09-12T00:18:17.577 INFO:teuthology.orchestra.run.smithi073.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 5.5 MB/s | 29 MB 00:05 2024-09-12T00:18:19.580 INFO:teuthology.orchestra.run.smithi117.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 4.6 MB/s | 35 MB 00:07 2024-09-12T00:18:19.580 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-09-12T00:18:19.580 INFO:teuthology.orchestra.run.smithi117.stdout:Total 10 MB/s | 79 MB 00:07 2024-09-12T00:18:20.262 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-09-12T00:18:20.613 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-09-12T00:18:20.614 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-09-12T00:18:21.069 INFO:teuthology.orchestra.run.smithi073.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 3.9 MB/s | 35 MB 00:08 2024-09-12T00:18:21.069 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-12T00:18:21.069 INFO:teuthology.orchestra.run.smithi073.stdout:Total 8.8 MB/s | 79 MB 00:08 2024-09-12T00:18:21.589 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-09-12T00:18:21.589 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-09-12T00:18:21.748 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-12T00:18:22.125 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-12T00:18:22.125 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-12T00:18:23.093 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-12T00:18:23.093 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-12T00:18:24.029 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-09-12T00:18:24.713 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T00:18:24.798 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T00:18:25.579 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-12T00:18:26.453 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T00:18:26.544 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T00:18:27.575 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T00:18:27.708 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T00:18:29.339 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T00:18:29.479 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T00:18:32.512 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T00:18:32.624 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:18:34.328 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T00:18:34.363 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:18:37.455 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:18:39.200 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:19:15.760 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:19:15.799 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:19:16.148 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:19:16.148 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T00:19:16.148 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T00:19:16.148 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T00:19:17.055 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:19:17.055 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T00:19:17.056 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-09-12T00:19:17.056 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T00:19:17.056 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T00:19:17.056 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T00:19:17.056 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T00:19:17.056 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T00:19:17.056 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-12T00:19:17.384 DEBUG:teuthology.orchestra.run.smithi117:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T00:19:17.472 INFO:teuthology.orchestra.run.smithi117.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T00:19:17.473 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T00:19:17.473 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T00:19:17.473 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T00:19:17.473 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T00:19:17.474 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-12T00:19:17.474 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi117.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T00:19:17.474 DEBUG:teuthology.orchestra.run.smithi117:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T00:19:17.504 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:19:17.533 INFO:teuthology.orchestra.run.smithi117.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T00:19:17.533 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T00:19:17.533 DEBUG:teuthology.orchestra.run.smithi117:> sudo rpm -qi grub2-tools 2024-09-12T00:19:17.543 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:19:17.565 INFO:teuthology.orchestra.run.smithi117.stdout:Name : grub2-tools 2024-09-12T00:19:17.565 INFO:teuthology.orchestra.run.smithi117.stdout:Epoch : 1 2024-09-12T00:19:17.565 INFO:teuthology.orchestra.run.smithi117.stdout:Version : 2.06 2024-09-12T00:19:17.565 INFO:teuthology.orchestra.run.smithi117.stdout:Release : 82.el9 2024-09-12T00:19:17.565 INFO:teuthology.orchestra.run.smithi117.stdout:Architecture: x86_64 2024-09-12T00:19:17.565 INFO:teuthology.orchestra.run.smithi117.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T00:19:17.565 INFO:teuthology.orchestra.run.smithi117.stdout:Group : Unspecified 2024-09-12T00:19:17.566 INFO:teuthology.orchestra.run.smithi117.stdout:Size : 8274670 2024-09-12T00:19:17.566 INFO:teuthology.orchestra.run.smithi117.stdout:License : GPLv3+ 2024-09-12T00:19:17.566 INFO:teuthology.orchestra.run.smithi117.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T00:19:17.566 INFO:teuthology.orchestra.run.smithi117.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T00:19:17.566 INFO:teuthology.orchestra.run.smithi117.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T00:19:17.566 INFO:teuthology.orchestra.run.smithi117.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T00:19:17.566 INFO:teuthology.orchestra.run.smithi117.stdout:Packager : builder@centos.org 2024-09-12T00:19:17.566 INFO:teuthology.orchestra.run.smithi117.stdout:Vendor : CentOS 2024-09-12T00:19:17.566 INFO:teuthology.orchestra.run.smithi117.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T00:19:17.566 INFO:teuthology.orchestra.run.smithi117.stdout:Summary : Support tools for GRUB. 2024-09-12T00:19:17.566 INFO:teuthology.orchestra.run.smithi117.stdout:Description : 2024-09-12T00:19:17.566 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T00:19:17.566 INFO:teuthology.orchestra.run.smithi117.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T00:19:17.566 INFO:teuthology.orchestra.run.smithi117.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T00:19:17.567 INFO:teuthology.orchestra.run.smithi117.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T00:19:17.567 INFO:teuthology.orchestra.run.smithi117.stdout:hardware devices. 2024-09-12T00:19:17.567 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T00:19:17.567 INFO:teuthology.orchestra.run.smithi117.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T00:19:17.568 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T00:19:17.568 INFO:teuthology.task.kernel:Updating grub on smithi117 to boot 5.14.0-505.el9.x86_64 2024-09-12T00:19:17.568 DEBUG:teuthology.orchestra.run.smithi117:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T00:19:17.884 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:19:17.884 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T00:19:17.884 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T00:19:17.884 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T00:19:18.253 INFO:teuthology.orchestra.run.smithi117.stderr:Generating grub configuration file ... 2024-09-12T00:19:18.722 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:19:18.722 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:19:18.722 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-12T00:19:18.722 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T00:19:18.722 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T00:19:18.723 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T00:19:18.723 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T00:19:18.723 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:19:18.723 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-12T00:19:19.084 DEBUG:teuthology.orchestra.run.smithi073:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T00:19:19.200 INFO:teuthology.orchestra.run.smithi073.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T00:19:19.201 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T00:19:19.201 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T00:19:19.201 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T00:19:19.201 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T00:19:19.201 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-12T00:19:19.201 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi073.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T00:19:19.201 DEBUG:teuthology.orchestra.run.smithi073:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T00:19:19.259 INFO:teuthology.orchestra.run.smithi073.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T00:19:19.259 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T00:19:19.260 DEBUG:teuthology.orchestra.run.smithi073:> sudo rpm -qi grub2-tools 2024-09-12T00:19:19.291 INFO:teuthology.orchestra.run.smithi073.stdout:Name : grub2-tools 2024-09-12T00:19:19.291 INFO:teuthology.orchestra.run.smithi073.stdout:Epoch : 1 2024-09-12T00:19:19.291 INFO:teuthology.orchestra.run.smithi073.stdout:Version : 2.06 2024-09-12T00:19:19.291 INFO:teuthology.orchestra.run.smithi073.stdout:Release : 82.el9 2024-09-12T00:19:19.291 INFO:teuthology.orchestra.run.smithi073.stdout:Architecture: x86_64 2024-09-12T00:19:19.291 INFO:teuthology.orchestra.run.smithi073.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T00:19:19.292 INFO:teuthology.orchestra.run.smithi073.stdout:Group : Unspecified 2024-09-12T00:19:19.292 INFO:teuthology.orchestra.run.smithi073.stdout:Size : 8274670 2024-09-12T00:19:19.292 INFO:teuthology.orchestra.run.smithi073.stdout:License : GPLv3+ 2024-09-12T00:19:19.292 INFO:teuthology.orchestra.run.smithi073.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T00:19:19.292 INFO:teuthology.orchestra.run.smithi073.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T00:19:19.292 INFO:teuthology.orchestra.run.smithi073.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T00:19:19.292 INFO:teuthology.orchestra.run.smithi073.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T00:19:19.292 INFO:teuthology.orchestra.run.smithi073.stdout:Packager : builder@centos.org 2024-09-12T00:19:19.292 INFO:teuthology.orchestra.run.smithi073.stdout:Vendor : CentOS 2024-09-12T00:19:19.292 INFO:teuthology.orchestra.run.smithi073.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T00:19:19.292 INFO:teuthology.orchestra.run.smithi073.stdout:Summary : Support tools for GRUB. 2024-09-12T00:19:19.292 INFO:teuthology.orchestra.run.smithi073.stdout:Description : 2024-09-12T00:19:19.292 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:19:19.293 INFO:teuthology.orchestra.run.smithi073.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T00:19:19.293 INFO:teuthology.orchestra.run.smithi073.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T00:19:19.293 INFO:teuthology.orchestra.run.smithi073.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T00:19:19.293 INFO:teuthology.orchestra.run.smithi073.stdout:hardware devices. 2024-09-12T00:19:19.293 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:19:19.293 INFO:teuthology.orchestra.run.smithi073.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T00:19:19.294 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T00:19:19.294 INFO:teuthology.task.kernel:Updating grub on smithi073 to boot 5.14.0-505.el9.x86_64 2024-09-12T00:19:19.294 DEBUG:teuthology.orchestra.run.smithi073:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T00:19:19.617 INFO:teuthology.orchestra.run.smithi117.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T00:19:19.642 INFO:teuthology.orchestra.run.smithi117.stderr:done 2024-09-12T00:19:19.645 DEBUG:teuthology.orchestra.run.smithi117:> mktemp 2024-09-12T00:19:19.660 INFO:teuthology.orchestra.run.smithi117.stdout:/tmp/tmp.tLft1ZwIm5 2024-09-12T00:19:19.660 DEBUG:teuthology.orchestra.run.smithi117:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.tLft1ZwIm5 2024-09-12T00:19:19.727 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0666 /tmp/tmp.tLft1ZwIm5 2024-09-12T00:19:19.873 DEBUG:teuthology.orchestra.remote:smithi117:/tmp/tmp.tLft1ZwIm5 is 6KB 2024-09-12T00:19:19.894 DEBUG:teuthology.orchestra.run.smithi117:> rm -fr /tmp/tmp.tLft1ZwIm5 2024-09-12T00:19:19.908 DEBUG:teuthology.orchestra.run.smithi117:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T00:19:19.971 INFO:teuthology.orchestra.run.smithi117.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T00:19:19.971 INFO:teuthology.orchestra.run.smithi117.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T00:19:19.971 INFO:teuthology.orchestra.run.smithi117.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T00:19:19.971 INFO:teuthology.orchestra.run.smithi117.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T00:19:19.973 DEBUG:teuthology.orchestra.run.smithi117:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T00:19:19.996 INFO:teuthology.orchestra.run.smithi073.stderr:Generating grub configuration file ... 2024-09-12T00:19:20.121 DEBUG:teuthology.orchestra.run.smithi117:> sudo shutdown -r now 2024-09-12T00:19:21.405 INFO:teuthology.orchestra.run.smithi073.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T00:19:21.444 INFO:teuthology.orchestra.run.smithi073.stderr:done 2024-09-12T00:19:21.446 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2024-09-12T00:19:21.503 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.dto3xVCroJ 2024-09-12T00:19:21.503 DEBUG:teuthology.orchestra.run.smithi073:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.dto3xVCroJ 2024-09-12T00:19:21.576 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.dto3xVCroJ 2024-09-12T00:19:21.721 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.dto3xVCroJ is 6KB 2024-09-12T00:19:21.770 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.dto3xVCroJ 2024-09-12T00:19:21.785 DEBUG:teuthology.orchestra.run.smithi073:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T00:19:21.848 INFO:teuthology.orchestra.run.smithi073.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T00:19:21.848 INFO:teuthology.orchestra.run.smithi073.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T00:19:21.848 INFO:teuthology.orchestra.run.smithi073.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T00:19:21.848 INFO:teuthology.orchestra.run.smithi073.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T00:19:21.849 DEBUG:teuthology.orchestra.run.smithi073:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T00:19:22.009 DEBUG:teuthology.orchestra.run.smithi073:> sudo shutdown -r now 2024-09-12T00:19:50.149 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-12T00:19:50.149 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-12T00:19:50.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:19:52.013 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-12T00:19:52.013 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-12T00:19:52.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:20:08.637 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-09-12T00:20:10.433 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2024-09-12T00:20:17.642 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-12T00:20:17.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:20:19.434 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-12T00:20:19.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:20:20.733 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-09-12T00:20:22.525 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2024-09-12T00:20:32.741 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-12T00:20:32.741 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:20:34.528 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-12T00:20:34.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:20:51.133 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-09-12T00:21:06.134 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-12T00:21:06.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:21:06.352 DEBUG:teuthology.orchestra.run.smithi073:> true 2024-09-12T00:21:06.473 DEBUG:teuthology.orchestra.run.smithi117:> true 2024-09-12T00:21:06.782 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-12T00:21:06.782 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-12T00:21:06.782 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2024-09-12T00:21:06.797 INFO:teuthology.orchestra.run.smithi073.stdout:5.14.0-505.el9.x86_64 2024-09-12T00:21:06.797 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T00:21:06.797 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T00:21:06.797 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T00:21:06.850 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-12T00:21:06.851 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-505.el9.x86_64"... 2024-09-12T00:21:06.851 DEBUG:teuthology.orchestra.run.smithi117:> uname -r 2024-09-12T00:21:06.865 INFO:teuthology.orchestra.run.smithi117.stdout:5.14.0-505.el9.x86_64 2024-09-12T00:21:06.866 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T00:21:06.866 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T00:21:06.866 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T00:21:07.798 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-12T00:21:07.799 DEBUG:teuthology.orchestra.run.smithi073:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T00:21:07.867 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-12T00:21:07.867 DEBUG:teuthology.orchestra.run.smithi117:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T00:21:07.933 INFO:teuthology.orchestra.run.smithi073.stdout:ttyS1 2024-09-12T00:21:07.952 DEBUG:teuthology.parallel:result is None 2024-09-12T00:21:08.038 INFO:teuthology.orchestra.run.smithi117.stdout:ttyS1 2024-09-12T00:21:08.064 DEBUG:teuthology.parallel:result is None 2024-09-12T00:21:08.064 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T00:21:08.075 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T00:21:08.075 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T00:21:08.077 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T00:21:08.128 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T00:21:08.253 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T00:21:08.375 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T00:21:08.375 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T00:21:08.380 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T00:21:08.438 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T00:21:08.497 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T00:21:08.497 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T00:21:08.500 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T00:21:08.574 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T00:21:08.576 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T00:21:08.587 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T00:21:08.599 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T00:21:08.601 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T00:21:08.607 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T00:21:08.608 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T00:21:08.610 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T00:21:08.661 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T00:21:08.705 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T00:21:08.705 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T00:21:08.707 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T00:21:08.749 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T00:21:08.807 DEBUG:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T00:21:08.862 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T00:21:08.912 DEBUG:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T00:21:08.940 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T00:21:08.940 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T00:21:09.003 DEBUG:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T00:21:09.088 DEBUG:teuthology.orchestra.run.smithi117:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T00:21:09.123 DEBUG:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T00:21:09.211 DEBUG:teuthology.orchestra.run.smithi117:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T00:21:09.240 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-12T00:21:09.240 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T00:21:09.301 DEBUG:teuthology.orchestra.run.smithi073:> sudo service rsyslog restart 2024-09-12T00:21:09.304 DEBUG:teuthology.orchestra.run.smithi117:> sudo service rsyslog restart 2024-09-12T00:21:09.420 INFO:teuthology.orchestra.run.smithi073.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T00:21:09.585 INFO:teuthology.orchestra.run.smithi117.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T00:21:10.168 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T00:21:10.176 INFO:teuthology.task.internal:Starting timer... 2024-09-12T00:21:10.176 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T00:21:10.230 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T00:21:10.288 DEBUG:teuthology.orchestra.run.smithi073:> sudo service auditd rotate 2024-09-12T00:21:10.350 INFO:teuthology.orchestra.run.smithi073.stdout:Rotating logs: 2024-09-12T00:21:10.352 DEBUG:teuthology.orchestra.run.smithi117:> sudo service auditd rotate 2024-09-12T00:21:10.395 INFO:teuthology.orchestra.run.smithi117.stdout:Rotating logs: 2024-09-12T00:21:10.397 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T00:21:10.397 DEBUG:teuthology.orchestra.run.smithi073:> /usr/sbin/getenforce 2024-09-12T00:21:10.425 INFO:teuthology.orchestra.run.smithi073.stdout:Permissive 2024-09-12T00:21:10.425 DEBUG:teuthology.orchestra.run.smithi117:> /usr/sbin/getenforce 2024-09-12T00:21:10.461 INFO:teuthology.orchestra.run.smithi117.stdout:Permissive 2024-09-12T00:21:10.462 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi073.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi117.front.sepia.ceph.com': 'permissive'} 2024-09-12T00:21:10.462 DEBUG:teuthology.orchestra.run.smithi073:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T00:21:10.488 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:21:10.488 DEBUG:teuthology.orchestra.run.smithi117:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T00:21:10.524 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:21:10.524 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T00:21:10.524 DEBUG:teuthology.orchestra.run.smithi073:> sudo /usr/sbin/setenforce permissive 2024-09-12T00:21:10.567 DEBUG:teuthology.orchestra.run.smithi117:> sudo /usr/sbin/setenforce permissive 2024-09-12T00:21:10.609 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T00:21:10.618 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-12T00:21:10.621 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-12T00:21:10.740 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T00:21:10.750 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T00:21:10.751 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi073.front.sepia.ceph.com,smithi117.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T00:24:56.073 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi073.front.sepia.ceph.com'), Remote(name='ubuntu@smithi117.front.sepia.ceph.com')] 2024-09-12T00:24:56.075 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-12T00:24:56.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:24:56.162 DEBUG:teuthology.orchestra.run.smithi073:> true 2024-09-12T00:24:56.209 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-12T00:24:56.209 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-12T00:24:56.210 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:24:56.294 DEBUG:teuthology.orchestra.run.smithi117:> true 2024-09-12T00:24:56.368 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-12T00:24:56.368 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T00:24:56.379 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T00:24:56.380 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T00:24:56.380 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T00:24:56.383 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T00:24:56.384 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T00:24:56.412 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T00:24:56.427 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T00:24:56.437 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T00:24:56.451 INFO:teuthology.orchestra.run.smithi073.stderr:sudo: ntpd: command not found 2024-09-12T00:24:56.452 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T00:24:56.462 INFO:teuthology.orchestra.run.smithi073.stdout:506 Cannot talk to daemon 2024-09-12T00:24:56.476 INFO:teuthology.orchestra.run.smithi117.stderr:sudo: ntpd: command not found 2024-09-12T00:24:56.476 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T00:24:56.487 INFO:teuthology.orchestra.run.smithi117.stdout:506 Cannot talk to daemon 2024-09-12T00:24:56.490 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T00:24:56.501 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T00:24:56.515 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T00:24:56.552 INFO:teuthology.orchestra.run.smithi073.stderr:bash: line 1: ntpq: command not found 2024-09-12T00:24:56.555 INFO:teuthology.orchestra.run.smithi073.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T00:24:56.556 INFO:teuthology.orchestra.run.smithi073.stdout:=============================================================================== 2024-09-12T00:24:56.556 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:24:56.556 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:24:56.556 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:24:56.556 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:24:56.569 INFO:teuthology.orchestra.run.smithi117.stderr:bash: line 1: ntpq: command not found 2024-09-12T00:24:56.573 INFO:teuthology.orchestra.run.smithi117.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T00:24:56.573 INFO:teuthology.orchestra.run.smithi117.stdout:=============================================================================== 2024-09-12T00:24:56.574 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:24:56.574 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:24:56.574 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:24:56.574 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:24:56.574 INFO:teuthology.run_tasks:Running task install... 2024-09-12T00:24:56.585 DEBUG:teuthology.task.install:project ceph 2024-09-12T00:24:56.585 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}} 2024-09-12T00:24:56.585 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'} 2024-09-12T00:24:56.585 INFO:teuthology.task.install:Using flavor: default 2024-09-12T00:24:56.590 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T00:24:56.590 INFO:teuthology.task.install:extra packages: [] 2024-09-12T00:24:56.591 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f', 'tag': None, 'wait_for_package': False} 2024-09-12T00:24:56.591 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:24:56.593 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f', 'tag': None, 'wait_for_package': False} 2024-09-12T00:24:56.594 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:24:56.768 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/ 2024-09-12T00:24:56.768 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4753.gd011c522 2024-09-12T00:24:56.782 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/ 2024-09-12T00:24:56.782 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4753.gd011c522 2024-09-12T00:24:56.889 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T00:24:56.890 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T00:24:56.890 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T00:24:56.903 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T00:24:56.904 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-12T00:24:56.904 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T00:24:56.918 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-09-12T00:24:56.918 DEBUG:teuthology.orchestra.run.smithi073:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d011c522bb171e70fc5782f1e7a71ce5f37e573f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T00:24:56.929 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-09-12T00:24:56.930 DEBUG:teuthology.orchestra.run.smithi117:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d011c522bb171e70fc5782f1e7a71ce5f37e573f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T00:24:56.984 DEBUG:teuthology.orchestra.run.smithi073:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T00:24:56.996 DEBUG:teuthology.orchestra.run.smithi117:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T00:24:57.059 DEBUG:teuthology.orchestra.run.smithi073:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T00:24:57.071 DEBUG:teuthology.orchestra.run.smithi117:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T00:24:57.123 INFO:teuthology.orchestra.run.smithi073.stdout:check_obsoletes = 1 2024-09-12T00:24:57.125 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum clean all 2024-09-12T00:24:57.135 INFO:teuthology.orchestra.run.smithi117.stdout:check_obsoletes = 1 2024-09-12T00:24:57.136 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum clean all 2024-09-12T00:24:57.359 INFO:teuthology.orchestra.run.smithi073.stdout:45 files removed 2024-09-12T00:24:57.375 INFO:teuthology.orchestra.run.smithi117.stdout:45 files removed 2024-09-12T00:24:57.387 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-09-12T00:24:57.401 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-09-12T00:24:57.945 INFO:teuthology.orchestra.run.smithi117.stdout:ceph packages for x86_64 325 kB/s | 84 kB 00:00 2024-09-12T00:24:57.977 INFO:teuthology.orchestra.run.smithi073.stdout:ceph packages for x86_64 275 kB/s | 84 kB 00:00 2024-09-12T00:24:58.229 INFO:teuthology.orchestra.run.smithi117.stdout:ceph noarch packages 100 kB/s | 24 kB 00:00 2024-09-12T00:24:58.278 INFO:teuthology.orchestra.run.smithi073.stdout:ceph noarch packages 94 kB/s | 24 kB 00:00 2024-09-12T00:24:58.488 INFO:teuthology.orchestra.run.smithi117.stdout:ceph source packages 8.7 kB/s | 1.9 kB 00:00 2024-09-12T00:24:58.553 INFO:teuthology.orchestra.run.smithi073.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-12T00:24:59.221 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-09-12T00:25:00.220 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - BaseOS 5.1 MB/s | 8.2 MB 00:01 2024-09-12T00:25:03.056 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - AppStream 7.5 MB/s | 20 MB 00:02 2024-09-12T00:25:03.497 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - AppStream 9.4 MB/s | 20 MB 00:02 2024-09-12T00:25:07.514 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-12T00:25:08.106 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - CRB 7.9 MB/s | 6.5 MB 00:00 2024-09-12T00:25:09.681 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - Extras packages 78 kB/s | 19 kB 00:00 2024-09-12T00:25:10.106 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - Extras packages 15 kB/s | 19 kB 00:01 2024-09-12T00:25:10.686 INFO:teuthology.orchestra.run.smithi073.stdout:Extra Packages for Enterprise Linux 26 MB/s | 23 MB 00:00 2024-09-12T00:25:10.902 INFO:teuthology.orchestra.run.smithi117.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-12T00:25:16.117 INFO:teuthology.orchestra.run.smithi073.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-12T00:25:16.382 INFO:teuthology.orchestra.run.smithi117.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-12T00:25:18.460 INFO:teuthology.orchestra.run.smithi073.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T00:25:18.461 INFO:teuthology.orchestra.run.smithi073.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T00:25:18.550 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-12T00:25:18.588 INFO:teuthology.orchestra.run.smithi073.stdout:====================================================================================================== 2024-09-12T00:25:18.589 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-09-12T00:25:18.589 INFO:teuthology.orchestra.run.smithi073.stdout:====================================================================================================== 2024-09-12T00:25:18.589 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-12T00:25:18.589 INFO:teuthology.orchestra.run.smithi073.stdout: ceph x86_64 2:19.3.0-4753.gd011c522.el9 ceph 6.6 k 2024-09-12T00:25:18.590 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base x86_64 2:19.3.0-4753.gd011c522.el9 ceph 5.5 M 2024-09-12T00:25:18.590 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-fuse x86_64 2:19.3.0-4753.gd011c522.el9 ceph 899 k 2024-09-12T00:25:18.590 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4753.gd011c522.el9 ceph 145 k 2024-09-12T00:25:18.590 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr x86_64 2:19.3.0-4753.gd011c522.el9 ceph 1.5 M 2024-09-12T00:25:18.590 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 154 k 2024-09-12T00:25:18.590 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 14 M 2024-09-12T00:25:18.590 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 7.4 M 2024-09-12T00:25:18.590 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-rook noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 49 k 2024-09-12T00:25:18.591 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-radosgw x86_64 2:19.3.0-4753.gd011c522.el9 ceph 11 M 2024-09-12T00:25:18.591 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-test x86_64 2:19.3.0-4753.gd011c522.el9 ceph 50 M 2024-09-12T00:25:18.591 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-volume noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 285 k 2024-09-12T00:25:18.591 INFO:teuthology.orchestra.run.smithi073.stdout: cephadm noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 782 k 2024-09-12T00:25:18.591 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs-devel x86_64 2:19.3.0-4753.gd011c522.el9 ceph 32 k 2024-09-12T00:25:18.591 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 755 k 2024-09-12T00:25:18.591 INFO:teuthology.orchestra.run.smithi073.stdout: librados-devel x86_64 2:19.3.0-4753.gd011c522.el9 ceph 126 k 2024-09-12T00:25:18.591 INFO:teuthology.orchestra.run.smithi073.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-09-12T00:25:18.591 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cephfs x86_64 2:19.3.0-4753.gd011c522.el9 ceph 161 k 2024-09-12T00:25:18.591 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados x86_64 2:19.3.0-4753.gd011c522.el9 ceph 322 k 2024-09-12T00:25:18.592 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rbd x86_64 2:19.3.0-4753.gd011c522.el9 ceph 306 k 2024-09-12T00:25:18.592 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rgw x86_64 2:19.3.0-4753.gd011c522.el9 ceph 99 k 2024-09-12T00:25:18.592 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-fuse x86_64 2:19.3.0-4753.gd011c522.el9 ceph 85 k 2024-09-12T00:25:18.592 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-mirror x86_64 2:19.3.0-4753.gd011c522.el9 ceph 3.2 M 2024-09-12T00:25:18.592 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-nbd x86_64 2:19.3.0-4753.gd011c522.el9 ceph 170 k 2024-09-12T00:25:18.592 INFO:teuthology.orchestra.run.smithi073.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-09-12T00:25:18.592 INFO:teuthology.orchestra.run.smithi073.stdout:Upgrading: 2024-09-12T00:25:18.592 INFO:teuthology.orchestra.run.smithi073.stdout: librados2 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 3.5 M 2024-09-12T00:25:18.592 INFO:teuthology.orchestra.run.smithi073.stdout: librbd1 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 3.2 M 2024-09-12T00:25:18.593 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-09-12T00:25:18.593 INFO:teuthology.orchestra.run.smithi073.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-09-12T00:25:18.593 INFO:teuthology.orchestra.run.smithi073.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T00:25:18.593 INFO:teuthology.orchestra.run.smithi073.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-09-12T00:25:18.593 INFO:teuthology.orchestra.run.smithi073.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-09-12T00:25:18.593 INFO:teuthology.orchestra.run.smithi073.stdout: alsa-lib x86_64 1.2.12-1.el9 appstream 523 k 2024-09-12T00:25:18.593 INFO:teuthology.orchestra.run.smithi073.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-09-12T00:25:18.593 INFO:teuthology.orchestra.run.smithi073.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-09-12T00:25:18.594 INFO:teuthology.orchestra.run.smithi073.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-09-12T00:25:18.594 INFO:teuthology.orchestra.run.smithi073.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-09-12T00:25:18.594 INFO:teuthology.orchestra.run.smithi073.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-09-12T00:25:18.594 INFO:teuthology.orchestra.run.smithi073.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-09-12T00:25:18.594 INFO:teuthology.orchestra.run.smithi073.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-09-12T00:25:18.594 INFO:teuthology.orchestra.run.smithi073.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-09-12T00:25:18.595 INFO:teuthology.orchestra.run.smithi073.stdout: avahi-glib x86_64 0.8-21.el9 appstream 15 k 2024-09-12T00:25:18.595 INFO:teuthology.orchestra.run.smithi073.stdout: bluez-libs x86_64 5.56-6.el9 baseos 85 k 2024-09-12T00:25:18.595 INFO:teuthology.orchestra.run.smithi073.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T00:25:18.595 INFO:teuthology.orchestra.run.smithi073.stdout: bubblewrap x86_64 0.4.1-7.el9 baseos 49 k 2024-09-12T00:25:18.595 INFO:teuthology.orchestra.run.smithi073.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-09-12T00:25:18.595 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-common x86_64 2:19.3.0-4753.gd011c522.el9 ceph 22 M 2024-09-12T00:25:18.595 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 34 k 2024-09-12T00:25:18.595 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mds x86_64 2:19.3.0-4753.gd011c522.el9 ceph 2.4 M 2024-09-12T00:25:18.595 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 291 k 2024-09-12T00:25:18.595 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mon x86_64 2:19.3.0-4753.gd011c522.el9 ceph 4.8 M 2024-09-12T00:25:18.595 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-osd x86_64 2:19.3.0-4753.gd011c522.el9 ceph 17 M 2024-09-12T00:25:18.595 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 16 k 2024-09-12T00:25:18.596 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-selinux x86_64 2:19.3.0-4753.gd011c522.el9 ceph 25 k 2024-09-12T00:25:18.596 INFO:teuthology.orchestra.run.smithi073.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-09-12T00:25:18.596 INFO:teuthology.orchestra.run.smithi073.stdout: composefs-libs x86_64 1.0.5-1.el9 appstream 61 k 2024-09-12T00:25:18.596 INFO:teuthology.orchestra.run.smithi073.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-09-12T00:25:18.596 INFO:teuthology.orchestra.run.smithi073.stdout: cups-libs x86_64 1:2.3.3op2-30.el9 baseos 262 k 2024-09-12T00:25:18.596 INFO:teuthology.orchestra.run.smithi073.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-09-12T00:25:18.596 INFO:teuthology.orchestra.run.smithi073.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-09-12T00:25:18.596 INFO:teuthology.orchestra.run.smithi073.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-09-12T00:25:18.596 INFO:teuthology.orchestra.run.smithi073.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-09-12T00:25:18.596 INFO:teuthology.orchestra.run.smithi073.stdout: flatpak-selinux noarch 1.12.9-1.el9 appstream 22 k 2024-09-12T00:25:18.596 INFO:teuthology.orchestra.run.smithi073.stdout: flatpak-session-helper x86_64 1.12.9-1.el9 appstream 73 k 2024-09-12T00:25:18.596 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T00:25:18.597 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T00:25:18.597 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T00:25:18.597 INFO:teuthology.orchestra.run.smithi073.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T00:25:18.597 INFO:teuthology.orchestra.run.smithi073.stdout: gdk-pixbuf2-modules x86_64 2.42.6-4.el9 appstream 89 k 2024-09-12T00:25:18.597 INFO:teuthology.orchestra.run.smithi073.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-09-12T00:25:18.597 INFO:teuthology.orchestra.run.smithi073.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-09-12T00:25:18.597 INFO:teuthology.orchestra.run.smithi073.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-09-12T00:25:18.597 INFO:teuthology.orchestra.run.smithi073.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T00:25:18.597 INFO:teuthology.orchestra.run.smithi073.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-09-12T00:25:18.597 INFO:teuthology.orchestra.run.smithi073.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T00:25:18.597 INFO:teuthology.orchestra.run.smithi073.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-09-12T00:25:18.597 INFO:teuthology.orchestra.run.smithi073.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-09-12T00:25:18.597 INFO:teuthology.orchestra.run.smithi073.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-09-12T00:25:18.598 INFO:teuthology.orchestra.run.smithi073.stdout: gtk-update-icon-cache x86_64 3.24.31-5.el9 appstream 33 k 2024-09-12T00:25:18.598 INFO:teuthology.orchestra.run.smithi073.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-09-12T00:25:18.598 INFO:teuthology.orchestra.run.smithi073.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-09-12T00:25:18.598 INFO:teuthology.orchestra.run.smithi073.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-09-12T00:25:18.598 INFO:teuthology.orchestra.run.smithi073.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-09-12T00:25:18.598 INFO:teuthology.orchestra.run.smithi073.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-09-12T00:25:18.598 INFO:teuthology.orchestra.run.smithi073.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-09-12T00:25:18.598 INFO:teuthology.orchestra.run.smithi073.stdout: jansi x86_64 2.3.3-6.el9 appstream 110 k 2024-09-12T00:25:18.598 INFO:teuthology.orchestra.run.smithi073.stdout: java-11-openjdk x86_64 1:11.0.20.1.1-2.el9 appstream 413 k 2024-09-12T00:25:18.598 INFO:teuthology.orchestra.run.smithi073.stdout: java-11-openjdk-headless x86_64 1:11.0.20.1.1-2.el9 appstream 39 M 2024-09-12T00:25:18.598 INFO:teuthology.orchestra.run.smithi073.stdout: javapackages-filesystem noarch 6.0.0-4.el9 appstream 13 k 2024-09-12T00:25:18.599 INFO:teuthology.orchestra.run.smithi073.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-09-12T00:25:18.599 INFO:teuthology.orchestra.run.smithi073.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-09-12T00:25:18.599 INFO:teuthology.orchestra.run.smithi073.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-09-12T00:25:18.599 INFO:teuthology.orchestra.run.smithi073.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-09-12T00:25:18.599 INFO:teuthology.orchestra.run.smithi073.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-09-12T00:25:18.599 INFO:teuthology.orchestra.run.smithi073.stdout: libX11-xcb x86_64 1.7.0-9.el9 appstream 11 k 2024-09-12T00:25:18.599 INFO:teuthology.orchestra.run.smithi073.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-09-12T00:25:18.599 INFO:teuthology.orchestra.run.smithi073.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-09-12T00:25:18.599 INFO:teuthology.orchestra.run.smithi073.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-09-12T00:25:18.599 INFO:teuthology.orchestra.run.smithi073.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-09-12T00:25:18.599 INFO:teuthology.orchestra.run.smithi073.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-09-12T00:25:18.599 INFO:teuthology.orchestra.run.smithi073.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-09-12T00:25:18.599 INFO:teuthology.orchestra.run.smithi073.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-09-12T00:25:18.600 INFO:teuthology.orchestra.run.smithi073.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-09-12T00:25:18.600 INFO:teuthology.orchestra.run.smithi073.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-09-12T00:25:18.600 INFO:teuthology.orchestra.run.smithi073.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-09-12T00:25:18.600 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T00:25:18.600 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T00:25:18.600 INFO:teuthology.orchestra.run.smithi073.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-09-12T00:25:18.600 INFO:teuthology.orchestra.run.smithi073.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-09-12T00:25:18.600 INFO:teuthology.orchestra.run.smithi073.stdout: libcephsqlite x86_64 2:19.3.0-4753.gd011c522.el9 ceph 161 k 2024-09-12T00:25:18.601 INFO:teuthology.orchestra.run.smithi073.stdout: libdrm x86_64 2.4.121-1.el9 appstream 161 k 2024-09-12T00:25:18.601 INFO:teuthology.orchestra.run.smithi073.stdout: libepoxy x86_64 1.5.5-4.el9 appstream 241 k 2024-09-12T00:25:18.601 INFO:teuthology.orchestra.run.smithi073.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-09-12T00:25:18.601 INFO:teuthology.orchestra.run.smithi073.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-09-12T00:25:18.601 INFO:teuthology.orchestra.run.smithi073.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-09-12T00:25:18.601 INFO:teuthology.orchestra.run.smithi073.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T00:25:18.601 INFO:teuthology.orchestra.run.smithi073.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-09-12T00:25:18.601 INFO:teuthology.orchestra.run.smithi073.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-09-12T00:25:18.601 INFO:teuthology.orchestra.run.smithi073.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-09-12T00:25:18.601 INFO:teuthology.orchestra.run.smithi073.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-09-12T00:25:18.601 INFO:teuthology.orchestra.run.smithi073.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-09-12T00:25:18.602 INFO:teuthology.orchestra.run.smithi073.stdout: libiptcdata x86_64 1.0.5-10.el9 appstream 61 k 2024-09-12T00:25:18.602 INFO:teuthology.orchestra.run.smithi073.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-09-12T00:25:18.602 INFO:teuthology.orchestra.run.smithi073.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-09-12T00:25:18.602 INFO:teuthology.orchestra.run.smithi073.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T00:25:18.602 INFO:teuthology.orchestra.run.smithi073.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-09-12T00:25:18.602 INFO:teuthology.orchestra.run.smithi073.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-09-12T00:25:18.602 INFO:teuthology.orchestra.run.smithi073.stdout: libpciaccess x86_64 0.16-7.el9 baseos 27 k 2024-09-12T00:25:18.602 INFO:teuthology.orchestra.run.smithi073.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T00:25:18.602 INFO:teuthology.orchestra.run.smithi073.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T00:25:18.602 INFO:teuthology.orchestra.run.smithi073.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T00:25:18.602 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 508 k 2024-09-12T00:25:18.602 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T00:25:18.602 INFO:teuthology.orchestra.run.smithi073.stdout: librgw2 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 5.5 M 2024-09-12T00:25:18.603 INFO:teuthology.orchestra.run.smithi073.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-09-12T00:25:18.603 INFO:teuthology.orchestra.run.smithi073.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-09-12T00:25:18.603 INFO:teuthology.orchestra.run.smithi073.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-09-12T00:25:18.603 INFO:teuthology.orchestra.run.smithi073.stdout: libtiff x86_64 4.4.0-13.el9 appstream 198 k 2024-09-12T00:25:18.603 INFO:teuthology.orchestra.run.smithi073.stdout: libtool-ltdl x86_64 2.4.6-46.el9 appstream 36 k 2024-09-12T00:25:18.603 INFO:teuthology.orchestra.run.smithi073.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-09-12T00:25:18.603 INFO:teuthology.orchestra.run.smithi073.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T00:25:18.603 INFO:teuthology.orchestra.run.smithi073.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-09-12T00:25:18.603 INFO:teuthology.orchestra.run.smithi073.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-09-12T00:25:18.604 INFO:teuthology.orchestra.run.smithi073.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-09-12T00:25:18.604 INFO:teuthology.orchestra.run.smithi073.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-09-12T00:25:18.604 INFO:teuthology.orchestra.run.smithi073.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-09-12T00:25:18.604 INFO:teuthology.orchestra.run.smithi073.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-09-12T00:25:18.604 INFO:teuthology.orchestra.run.smithi073.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-09-12T00:25:18.604 INFO:teuthology.orchestra.run.smithi073.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-09-12T00:25:18.604 INFO:teuthology.orchestra.run.smithi073.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-09-12T00:25:18.604 INFO:teuthology.orchestra.run.smithi073.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-12T00:25:18.604 INFO:teuthology.orchestra.run.smithi073.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-09-12T00:25:18.604 INFO:teuthology.orchestra.run.smithi073.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T00:25:18.604 INFO:teuthology.orchestra.run.smithi073.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T00:25:18.605 INFO:teuthology.orchestra.run.smithi073.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T00:25:18.605 INFO:teuthology.orchestra.run.smithi073.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-09-12T00:25:18.605 INFO:teuthology.orchestra.run.smithi073.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T00:25:18.605 INFO:teuthology.orchestra.run.smithi073.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-09-12T00:25:18.605 INFO:teuthology.orchestra.run.smithi073.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-09-12T00:25:18.605 INFO:teuthology.orchestra.run.smithi073.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-09-12T00:25:18.605 INFO:teuthology.orchestra.run.smithi073.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-09-12T00:25:18.605 INFO:teuthology.orchestra.run.smithi073.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-09-12T00:25:18.605 INFO:teuthology.orchestra.run.smithi073.stdout: mesa-filesystem x86_64 24.1.2-3.el9 appstream 11 k 2024-09-12T00:25:18.605 INFO:teuthology.orchestra.run.smithi073.stdout: mesa-libEGL x86_64 24.1.2-3.el9 appstream 139 k 2024-09-12T00:25:18.605 INFO:teuthology.orchestra.run.smithi073.stdout: mesa-libGL x86_64 24.1.2-3.el9 appstream 171 k 2024-09-12T00:25:18.605 INFO:teuthology.orchestra.run.smithi073.stdout: mesa-libgbm x86_64 24.1.2-3.el9 appstream 36 k 2024-09-12T00:25:18.606 INFO:teuthology.orchestra.run.smithi073.stdout: mesa-libglapi x86_64 24.1.2-3.el9 appstream 46 k 2024-09-12T00:25:18.606 INFO:teuthology.orchestra.run.smithi073.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-09-12T00:25:18.606 INFO:teuthology.orchestra.run.smithi073.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T00:25:18.606 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T00:25:18.606 INFO:teuthology.orchestra.run.smithi073.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-09-12T00:25:18.606 INFO:teuthology.orchestra.run.smithi073.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-09-12T00:25:18.606 INFO:teuthology.orchestra.run.smithi073.stdout: orc x86_64 0.4.31-8.el9 appstream 183 k 2024-09-12T00:25:18.606 INFO:teuthology.orchestra.run.smithi073.stdout: osinfo-db noarch 20240701-2.el9 appstream 531 k 2024-09-12T00:25:18.606 INFO:teuthology.orchestra.run.smithi073.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-09-12T00:25:18.606 INFO:teuthology.orchestra.run.smithi073.stdout: ostree-libs x86_64 2024.7-2.el9 appstream 468 k 2024-09-12T00:25:18.607 INFO:teuthology.orchestra.run.smithi073.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T00:25:18.607 INFO:teuthology.orchestra.run.smithi073.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-09-12T00:25:18.607 INFO:teuthology.orchestra.run.smithi073.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-09-12T00:25:18.607 INFO:teuthology.orchestra.run.smithi073.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-09-12T00:25:18.607 INFO:teuthology.orchestra.run.smithi073.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-09-12T00:25:18.607 INFO:teuthology.orchestra.run.smithi073.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-09-12T00:25:18.607 INFO:teuthology.orchestra.run.smithi073.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-09-12T00:25:18.607 INFO:teuthology.orchestra.run.smithi073.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-09-12T00:25:18.607 INFO:teuthology.orchestra.run.smithi073.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-09-12T00:25:18.607 INFO:teuthology.orchestra.run.smithi073.stdout: poppler x86_64 21.01.0-21.el9 appstream 1.1 M 2024-09-12T00:25:18.607 INFO:teuthology.orchestra.run.smithi073.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-09-12T00:25:18.607 INFO:teuthology.orchestra.run.smithi073.stdout: poppler-glib x86_64 21.01.0-21.el9 appstream 152 k 2024-09-12T00:25:18.608 INFO:teuthology.orchestra.run.smithi073.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T00:25:18.608 INFO:teuthology.orchestra.run.smithi073.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T00:25:18.608 INFO:teuthology.orchestra.run.smithi073.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-09-12T00:25:18.608 INFO:teuthology.orchestra.run.smithi073.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-09-12T00:25:18.608 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T00:25:18.608 INFO:teuthology.orchestra.run.smithi073.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T00:25:18.608 INFO:teuthology.orchestra.run.smithi073.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T00:25:18.608 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T00:25:18.608 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse x86_64 2:19.3.0-4753.gd011c522.el9 ceph 45 k 2024-09-12T00:25:18.608 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-common x86_64 2:19.3.0-4753.gd011c522.el9 ceph 143 k 2024-09-12T00:25:18.608 INFO:teuthology.orchestra.run.smithi073.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T00:25:18.608 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T00:25:18.609 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T00:25:18.609 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T00:25:18.609 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T00:25:18.609 INFO:teuthology.orchestra.run.smithi073.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T00:25:18.609 INFO:teuthology.orchestra.run.smithi073.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T00:25:18.609 INFO:teuthology.orchestra.run.smithi073.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T00:25:18.609 INFO:teuthology.orchestra.run.smithi073.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T00:25:18.609 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T00:25:18.609 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T00:25:18.609 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T00:25:18.609 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T00:25:18.609 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T00:25:18.610 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T00:25:18.610 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T00:25:18.610 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T00:25:18.610 INFO:teuthology.orchestra.run.smithi073.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T00:25:18.610 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T00:25:18.610 INFO:teuthology.orchestra.run.smithi073.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T00:25:18.610 INFO:teuthology.orchestra.run.smithi073.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T00:25:18.610 INFO:teuthology.orchestra.run.smithi073.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T00:25:18.610 INFO:teuthology.orchestra.run.smithi073.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T00:25:18.610 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T00:25:18.610 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T00:25:18.610 INFO:teuthology.orchestra.run.smithi073.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T00:25:18.611 INFO:teuthology.orchestra.run.smithi073.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T00:25:18.611 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T00:25:18.611 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T00:25:18.611 INFO:teuthology.orchestra.run.smithi073.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T00:25:18.611 INFO:teuthology.orchestra.run.smithi073.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T00:25:18.611 INFO:teuthology.orchestra.run.smithi073.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T00:25:18.611 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T00:25:18.611 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T00:25:18.611 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T00:25:18.612 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T00:25:18.612 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T00:25:18.612 INFO:teuthology.orchestra.run.smithi073.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T00:25:18.612 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T00:25:18.612 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T00:25:18.612 INFO:teuthology.orchestra.run.smithi073.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T00:25:18.612 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T00:25:18.612 INFO:teuthology.orchestra.run.smithi073.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T00:25:18.612 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T00:25:18.612 INFO:teuthology.orchestra.run.smithi073.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T00:25:18.613 INFO:teuthology.orchestra.run.smithi073.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T00:25:18.613 INFO:teuthology.orchestra.run.smithi073.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T00:25:18.613 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T00:25:18.613 INFO:teuthology.orchestra.run.smithi073.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T00:25:18.613 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T00:25:18.613 INFO:teuthology.orchestra.run.smithi073.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T00:25:18.613 INFO:teuthology.orchestra.run.smithi073.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T00:25:18.613 INFO:teuthology.orchestra.run.smithi073.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T00:25:18.613 INFO:teuthology.orchestra.run.smithi073.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T00:25:18.613 INFO:teuthology.orchestra.run.smithi073.stdout: rtkit x86_64 0.11-29.el9 appstream 56 k 2024-09-12T00:25:18.613 INFO:teuthology.orchestra.run.smithi073.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-09-12T00:25:18.613 INFO:teuthology.orchestra.run.smithi073.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-09-12T00:25:18.613 INFO:teuthology.orchestra.run.smithi073.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T00:25:18.614 INFO:teuthology.orchestra.run.smithi073.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-09-12T00:25:18.614 INFO:teuthology.orchestra.run.smithi073.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T00:25:18.614 INFO:teuthology.orchestra.run.smithi073.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-09-12T00:25:18.614 INFO:teuthology.orchestra.run.smithi073.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-09-12T00:25:18.614 INFO:teuthology.orchestra.run.smithi073.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-09-12T00:25:18.614 INFO:teuthology.orchestra.run.smithi073.stdout: tzdata-java noarch 2024a-2.el9 appstream 230 k 2024-09-12T00:25:18.614 INFO:teuthology.orchestra.run.smithi073.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-09-12T00:25:18.614 INFO:teuthology.orchestra.run.smithi073.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-09-12T00:25:18.614 INFO:teuthology.orchestra.run.smithi073.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-09-12T00:25:18.614 INFO:teuthology.orchestra.run.smithi073.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-09-12T00:25:18.615 INFO:teuthology.orchestra.run.smithi073.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-09-12T00:25:18.615 INFO:teuthology.orchestra.run.smithi073.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-09-12T00:25:18.615 INFO:teuthology.orchestra.run.smithi073.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-09-12T00:25:18.615 INFO:teuthology.orchestra.run.smithi073.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T00:25:18.615 INFO:teuthology.orchestra.run.smithi073.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-09-12T00:25:18.615 INFO:teuthology.orchestra.run.smithi073.stdout:Installing weak dependencies: 2024-09-12T00:25:18.615 INFO:teuthology.orchestra.run.smithi073.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-09-12T00:25:18.615 INFO:teuthology.orchestra.run.smithi073.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-09-12T00:25:18.615 INFO:teuthology.orchestra.run.smithi073.stdout: flatpak x86_64 1.12.9-1.el9 appstream 1.7 M 2024-09-12T00:25:18.615 INFO:teuthology.orchestra.run.smithi073.stdout: gtk3 x86_64 3.24.31-5.el9 appstream 4.9 M 2024-09-12T00:25:18.615 INFO:teuthology.orchestra.run.smithi073.stdout: java-11-openjdk-devel x86_64 1:11.0.20.1.1-2.el9 appstream 3.3 M 2024-09-12T00:25:18.615 INFO:teuthology.orchestra.run.smithi073.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-09-12T00:25:18.615 INFO:teuthology.orchestra.run.smithi073.stdout: mesa-dri-drivers x86_64 24.1.2-3.el9 appstream 8.8 M 2024-09-12T00:25:18.616 INFO:teuthology.orchestra.run.smithi073.stdout: p11-kit-server x86_64 0.25.3-2.el9 appstream 246 k 2024-09-12T00:25:18.616 INFO:teuthology.orchestra.run.smithi073.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-09-12T00:25:18.616 INFO:teuthology.orchestra.run.smithi073.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-09-12T00:25:18.616 INFO:teuthology.orchestra.run.smithi073.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-09-12T00:25:18.616 INFO:teuthology.orchestra.run.smithi073.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-09-12T00:25:18.616 INFO:teuthology.orchestra.run.smithi073.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T00:25:18.616 INFO:teuthology.orchestra.run.smithi073.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-09-12T00:25:18.616 INFO:teuthology.orchestra.run.smithi073.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-09-12T00:25:18.616 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:25:18.616 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-12T00:25:18.616 INFO:teuthology.orchestra.run.smithi073.stdout:====================================================================================================== 2024-09-12T00:25:18.616 INFO:teuthology.orchestra.run.smithi073.stdout:Install 283 Packages 2024-09-12T00:25:18.617 INFO:teuthology.orchestra.run.smithi073.stdout:Upgrade 2 Packages 2024-09-12T00:25:18.617 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:25:18.617 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 327 M 2024-09-12T00:25:18.617 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-12T00:25:18.692 INFO:teuthology.orchestra.run.smithi117.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T00:25:18.693 INFO:teuthology.orchestra.run.smithi117.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T00:25:18.784 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-12T00:25:18.806 INFO:teuthology.orchestra.run.smithi117.stdout:====================================================================================================== 2024-09-12T00:25:18.807 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2024-09-12T00:25:18.807 INFO:teuthology.orchestra.run.smithi117.stdout:====================================================================================================== 2024-09-12T00:25:18.807 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-09-12T00:25:18.807 INFO:teuthology.orchestra.run.smithi117.stdout: ceph x86_64 2:19.3.0-4753.gd011c522.el9 ceph 6.6 k 2024-09-12T00:25:18.807 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-base x86_64 2:19.3.0-4753.gd011c522.el9 ceph 5.5 M 2024-09-12T00:25:18.807 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-fuse x86_64 2:19.3.0-4753.gd011c522.el9 ceph 899 k 2024-09-12T00:25:18.807 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4753.gd011c522.el9 ceph 145 k 2024-09-12T00:25:18.807 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr x86_64 2:19.3.0-4753.gd011c522.el9 ceph 1.5 M 2024-09-12T00:25:18.808 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 154 k 2024-09-12T00:25:18.808 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 14 M 2024-09-12T00:25:18.808 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 7.4 M 2024-09-12T00:25:18.808 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-rook noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 49 k 2024-09-12T00:25:18.808 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-radosgw x86_64 2:19.3.0-4753.gd011c522.el9 ceph 11 M 2024-09-12T00:25:18.808 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-test x86_64 2:19.3.0-4753.gd011c522.el9 ceph 50 M 2024-09-12T00:25:18.808 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-volume noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 285 k 2024-09-12T00:25:18.808 INFO:teuthology.orchestra.run.smithi117.stdout: cephadm noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 782 k 2024-09-12T00:25:18.808 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs-devel x86_64 2:19.3.0-4753.gd011c522.el9 ceph 32 k 2024-09-12T00:25:18.808 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs2 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 755 k 2024-09-12T00:25:18.808 INFO:teuthology.orchestra.run.smithi117.stdout: librados-devel x86_64 2:19.3.0-4753.gd011c522.el9 ceph 126 k 2024-09-12T00:25:18.808 INFO:teuthology.orchestra.run.smithi117.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-09-12T00:25:18.809 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cephfs x86_64 2:19.3.0-4753.gd011c522.el9 ceph 161 k 2024-09-12T00:25:18.809 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rados x86_64 2:19.3.0-4753.gd011c522.el9 ceph 322 k 2024-09-12T00:25:18.809 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rbd x86_64 2:19.3.0-4753.gd011c522.el9 ceph 306 k 2024-09-12T00:25:18.809 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rgw x86_64 2:19.3.0-4753.gd011c522.el9 ceph 99 k 2024-09-12T00:25:18.809 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-fuse x86_64 2:19.3.0-4753.gd011c522.el9 ceph 85 k 2024-09-12T00:25:18.809 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-mirror x86_64 2:19.3.0-4753.gd011c522.el9 ceph 3.2 M 2024-09-12T00:25:18.809 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-nbd x86_64 2:19.3.0-4753.gd011c522.el9 ceph 170 k 2024-09-12T00:25:18.809 INFO:teuthology.orchestra.run.smithi117.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-09-12T00:25:18.809 INFO:teuthology.orchestra.run.smithi117.stdout:Upgrading: 2024-09-12T00:25:18.809 INFO:teuthology.orchestra.run.smithi117.stdout: librados2 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 3.5 M 2024-09-12T00:25:18.809 INFO:teuthology.orchestra.run.smithi117.stdout: librbd1 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 3.2 M 2024-09-12T00:25:18.809 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2024-09-12T00:25:18.810 INFO:teuthology.orchestra.run.smithi117.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-09-12T00:25:18.810 INFO:teuthology.orchestra.run.smithi117.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T00:25:18.810 INFO:teuthology.orchestra.run.smithi117.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-09-12T00:25:18.810 INFO:teuthology.orchestra.run.smithi117.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-09-12T00:25:18.810 INFO:teuthology.orchestra.run.smithi117.stdout: alsa-lib x86_64 1.2.12-1.el9 appstream 523 k 2024-09-12T00:25:18.810 INFO:teuthology.orchestra.run.smithi117.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-09-12T00:25:18.810 INFO:teuthology.orchestra.run.smithi117.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-09-12T00:25:18.810 INFO:teuthology.orchestra.run.smithi117.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-09-12T00:25:18.810 INFO:teuthology.orchestra.run.smithi117.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-09-12T00:25:18.810 INFO:teuthology.orchestra.run.smithi117.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-09-12T00:25:18.810 INFO:teuthology.orchestra.run.smithi117.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-09-12T00:25:18.810 INFO:teuthology.orchestra.run.smithi117.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-09-12T00:25:18.810 INFO:teuthology.orchestra.run.smithi117.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-09-12T00:25:18.810 INFO:teuthology.orchestra.run.smithi117.stdout: avahi-glib x86_64 0.8-21.el9 appstream 15 k 2024-09-12T00:25:18.811 INFO:teuthology.orchestra.run.smithi117.stdout: bluez-libs x86_64 5.56-6.el9 baseos 85 k 2024-09-12T00:25:18.811 INFO:teuthology.orchestra.run.smithi117.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T00:25:18.811 INFO:teuthology.orchestra.run.smithi117.stdout: bubblewrap x86_64 0.4.1-7.el9 baseos 49 k 2024-09-12T00:25:18.811 INFO:teuthology.orchestra.run.smithi117.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-09-12T00:25:18.811 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-common x86_64 2:19.3.0-4753.gd011c522.el9 ceph 22 M 2024-09-12T00:25:18.811 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 34 k 2024-09-12T00:25:18.811 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mds x86_64 2:19.3.0-4753.gd011c522.el9 ceph 2.4 M 2024-09-12T00:25:18.811 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 291 k 2024-09-12T00:25:18.811 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mon x86_64 2:19.3.0-4753.gd011c522.el9 ceph 4.8 M 2024-09-12T00:25:18.811 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-osd x86_64 2:19.3.0-4753.gd011c522.el9 ceph 17 M 2024-09-12T00:25:18.811 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 16 k 2024-09-12T00:25:18.812 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-selinux x86_64 2:19.3.0-4753.gd011c522.el9 ceph 25 k 2024-09-12T00:25:18.812 INFO:teuthology.orchestra.run.smithi117.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-09-12T00:25:18.812 INFO:teuthology.orchestra.run.smithi117.stdout: composefs-libs x86_64 1.0.5-1.el9 appstream 61 k 2024-09-12T00:25:18.812 INFO:teuthology.orchestra.run.smithi117.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-09-12T00:25:18.812 INFO:teuthology.orchestra.run.smithi117.stdout: cups-libs x86_64 1:2.3.3op2-30.el9 baseos 262 k 2024-09-12T00:25:18.812 INFO:teuthology.orchestra.run.smithi117.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-09-12T00:25:18.812 INFO:teuthology.orchestra.run.smithi117.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-09-12T00:25:18.812 INFO:teuthology.orchestra.run.smithi117.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-09-12T00:25:18.812 INFO:teuthology.orchestra.run.smithi117.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-09-12T00:25:18.812 INFO:teuthology.orchestra.run.smithi117.stdout: flatpak-selinux noarch 1.12.9-1.el9 appstream 22 k 2024-09-12T00:25:18.812 INFO:teuthology.orchestra.run.smithi117.stdout: flatpak-session-helper x86_64 1.12.9-1.el9 appstream 73 k 2024-09-12T00:25:18.812 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T00:25:18.813 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T00:25:18.813 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T00:25:18.813 INFO:teuthology.orchestra.run.smithi117.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T00:25:18.813 INFO:teuthology.orchestra.run.smithi117.stdout: gdk-pixbuf2-modules x86_64 2.42.6-4.el9 appstream 89 k 2024-09-12T00:25:18.813 INFO:teuthology.orchestra.run.smithi117.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-09-12T00:25:18.813 INFO:teuthology.orchestra.run.smithi117.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-09-12T00:25:18.813 INFO:teuthology.orchestra.run.smithi117.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-09-12T00:25:18.813 INFO:teuthology.orchestra.run.smithi117.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T00:25:18.813 INFO:teuthology.orchestra.run.smithi117.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-09-12T00:25:18.813 INFO:teuthology.orchestra.run.smithi117.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T00:25:18.814 INFO:teuthology.orchestra.run.smithi117.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-09-12T00:25:18.814 INFO:teuthology.orchestra.run.smithi117.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-09-12T00:25:18.814 INFO:teuthology.orchestra.run.smithi117.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-09-12T00:25:18.814 INFO:teuthology.orchestra.run.smithi117.stdout: gtk-update-icon-cache x86_64 3.24.31-5.el9 appstream 33 k 2024-09-12T00:25:18.814 INFO:teuthology.orchestra.run.smithi117.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-09-12T00:25:18.814 INFO:teuthology.orchestra.run.smithi117.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-09-12T00:25:18.814 INFO:teuthology.orchestra.run.smithi117.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-09-12T00:25:18.814 INFO:teuthology.orchestra.run.smithi117.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-09-12T00:25:18.814 INFO:teuthology.orchestra.run.smithi117.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-09-12T00:25:18.814 INFO:teuthology.orchestra.run.smithi117.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-09-12T00:25:18.814 INFO:teuthology.orchestra.run.smithi117.stdout: jansi x86_64 2.3.3-6.el9 appstream 110 k 2024-09-12T00:25:18.814 INFO:teuthology.orchestra.run.smithi117.stdout: java-11-openjdk x86_64 1:11.0.20.1.1-2.el9 appstream 413 k 2024-09-12T00:25:18.814 INFO:teuthology.orchestra.run.smithi117.stdout: java-11-openjdk-headless x86_64 1:11.0.20.1.1-2.el9 appstream 39 M 2024-09-12T00:25:18.814 INFO:teuthology.orchestra.run.smithi117.stdout: javapackages-filesystem noarch 6.0.0-4.el9 appstream 13 k 2024-09-12T00:25:18.815 INFO:teuthology.orchestra.run.smithi117.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-09-12T00:25:18.815 INFO:teuthology.orchestra.run.smithi117.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-09-12T00:25:18.815 INFO:teuthology.orchestra.run.smithi117.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-09-12T00:25:18.815 INFO:teuthology.orchestra.run.smithi117.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-09-12T00:25:18.815 INFO:teuthology.orchestra.run.smithi117.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-09-12T00:25:18.815 INFO:teuthology.orchestra.run.smithi117.stdout: libX11-xcb x86_64 1.7.0-9.el9 appstream 11 k 2024-09-12T00:25:18.815 INFO:teuthology.orchestra.run.smithi117.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-09-12T00:25:18.815 INFO:teuthology.orchestra.run.smithi117.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-09-12T00:25:18.815 INFO:teuthology.orchestra.run.smithi117.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-09-12T00:25:18.815 INFO:teuthology.orchestra.run.smithi117.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-09-12T00:25:18.815 INFO:teuthology.orchestra.run.smithi117.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-09-12T00:25:18.815 INFO:teuthology.orchestra.run.smithi117.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-09-12T00:25:18.815 INFO:teuthology.orchestra.run.smithi117.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-09-12T00:25:18.816 INFO:teuthology.orchestra.run.smithi117.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-09-12T00:25:18.816 INFO:teuthology.orchestra.run.smithi117.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-09-12T00:25:18.816 INFO:teuthology.orchestra.run.smithi117.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-09-12T00:25:18.816 INFO:teuthology.orchestra.run.smithi117.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T00:25:18.816 INFO:teuthology.orchestra.run.smithi117.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T00:25:18.816 INFO:teuthology.orchestra.run.smithi117.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-09-12T00:25:18.816 INFO:teuthology.orchestra.run.smithi117.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-09-12T00:25:18.816 INFO:teuthology.orchestra.run.smithi117.stdout: libcephsqlite x86_64 2:19.3.0-4753.gd011c522.el9 ceph 161 k 2024-09-12T00:25:18.816 INFO:teuthology.orchestra.run.smithi117.stdout: libdrm x86_64 2.4.121-1.el9 appstream 161 k 2024-09-12T00:25:18.816 INFO:teuthology.orchestra.run.smithi117.stdout: libepoxy x86_64 1.5.5-4.el9 appstream 241 k 2024-09-12T00:25:18.816 INFO:teuthology.orchestra.run.smithi117.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-09-12T00:25:18.816 INFO:teuthology.orchestra.run.smithi117.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-09-12T00:25:18.816 INFO:teuthology.orchestra.run.smithi117.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-09-12T00:25:18.817 INFO:teuthology.orchestra.run.smithi117.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T00:25:18.817 INFO:teuthology.orchestra.run.smithi117.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-09-12T00:25:18.817 INFO:teuthology.orchestra.run.smithi117.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-09-12T00:25:18.817 INFO:teuthology.orchestra.run.smithi117.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-09-12T00:25:18.817 INFO:teuthology.orchestra.run.smithi117.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-09-12T00:25:18.817 INFO:teuthology.orchestra.run.smithi117.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-09-12T00:25:18.817 INFO:teuthology.orchestra.run.smithi117.stdout: libiptcdata x86_64 1.0.5-10.el9 appstream 61 k 2024-09-12T00:25:18.817 INFO:teuthology.orchestra.run.smithi117.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-09-12T00:25:18.817 INFO:teuthology.orchestra.run.smithi117.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-09-12T00:25:18.817 INFO:teuthology.orchestra.run.smithi117.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T00:25:18.817 INFO:teuthology.orchestra.run.smithi117.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-09-12T00:25:18.817 INFO:teuthology.orchestra.run.smithi117.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-09-12T00:25:18.817 INFO:teuthology.orchestra.run.smithi117.stdout: libpciaccess x86_64 0.16-7.el9 baseos 27 k 2024-09-12T00:25:18.818 INFO:teuthology.orchestra.run.smithi117.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T00:25:18.818 INFO:teuthology.orchestra.run.smithi117.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T00:25:18.818 INFO:teuthology.orchestra.run.smithi117.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T00:25:18.818 INFO:teuthology.orchestra.run.smithi117.stdout: libradosstriper1 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 508 k 2024-09-12T00:25:18.818 INFO:teuthology.orchestra.run.smithi117.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T00:25:18.818 INFO:teuthology.orchestra.run.smithi117.stdout: librgw2 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 5.5 M 2024-09-12T00:25:18.818 INFO:teuthology.orchestra.run.smithi117.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-09-12T00:25:18.818 INFO:teuthology.orchestra.run.smithi117.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-09-12T00:25:18.818 INFO:teuthology.orchestra.run.smithi117.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-09-12T00:25:18.818 INFO:teuthology.orchestra.run.smithi117.stdout: libtiff x86_64 4.4.0-13.el9 appstream 198 k 2024-09-12T00:25:18.818 INFO:teuthology.orchestra.run.smithi117.stdout: libtool-ltdl x86_64 2.4.6-46.el9 appstream 36 k 2024-09-12T00:25:18.818 INFO:teuthology.orchestra.run.smithi117.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-09-12T00:25:18.818 INFO:teuthology.orchestra.run.smithi117.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T00:25:18.819 INFO:teuthology.orchestra.run.smithi117.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-09-12T00:25:18.819 INFO:teuthology.orchestra.run.smithi117.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-09-12T00:25:18.819 INFO:teuthology.orchestra.run.smithi117.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-09-12T00:25:18.819 INFO:teuthology.orchestra.run.smithi117.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-09-12T00:25:18.819 INFO:teuthology.orchestra.run.smithi117.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-09-12T00:25:18.819 INFO:teuthology.orchestra.run.smithi117.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-09-12T00:25:18.819 INFO:teuthology.orchestra.run.smithi117.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-09-12T00:25:18.819 INFO:teuthology.orchestra.run.smithi117.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-09-12T00:25:18.819 INFO:teuthology.orchestra.run.smithi117.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-09-12T00:25:18.819 INFO:teuthology.orchestra.run.smithi117.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-12T00:25:18.819 INFO:teuthology.orchestra.run.smithi117.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-09-12T00:25:18.819 INFO:teuthology.orchestra.run.smithi117.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T00:25:18.819 INFO:teuthology.orchestra.run.smithi117.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T00:25:18.819 INFO:teuthology.orchestra.run.smithi117.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T00:25:18.820 INFO:teuthology.orchestra.run.smithi117.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-09-12T00:25:18.820 INFO:teuthology.orchestra.run.smithi117.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T00:25:18.820 INFO:teuthology.orchestra.run.smithi117.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-09-12T00:25:18.820 INFO:teuthology.orchestra.run.smithi117.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-09-12T00:25:18.820 INFO:teuthology.orchestra.run.smithi117.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-09-12T00:25:18.820 INFO:teuthology.orchestra.run.smithi117.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-09-12T00:25:18.820 INFO:teuthology.orchestra.run.smithi117.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-09-12T00:25:18.820 INFO:teuthology.orchestra.run.smithi117.stdout: mesa-filesystem x86_64 24.1.2-3.el9 appstream 11 k 2024-09-12T00:25:18.820 INFO:teuthology.orchestra.run.smithi117.stdout: mesa-libEGL x86_64 24.1.2-3.el9 appstream 139 k 2024-09-12T00:25:18.820 INFO:teuthology.orchestra.run.smithi117.stdout: mesa-libGL x86_64 24.1.2-3.el9 appstream 171 k 2024-09-12T00:25:18.820 INFO:teuthology.orchestra.run.smithi117.stdout: mesa-libgbm x86_64 24.1.2-3.el9 appstream 36 k 2024-09-12T00:25:18.820 INFO:teuthology.orchestra.run.smithi117.stdout: mesa-libglapi x86_64 24.1.2-3.el9 appstream 46 k 2024-09-12T00:25:18.820 INFO:teuthology.orchestra.run.smithi117.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-09-12T00:25:18.821 INFO:teuthology.orchestra.run.smithi117.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T00:25:18.821 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T00:25:18.821 INFO:teuthology.orchestra.run.smithi117.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-09-12T00:25:18.821 INFO:teuthology.orchestra.run.smithi117.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-09-12T00:25:18.821 INFO:teuthology.orchestra.run.smithi117.stdout: orc x86_64 0.4.31-8.el9 appstream 183 k 2024-09-12T00:25:18.821 INFO:teuthology.orchestra.run.smithi117.stdout: osinfo-db noarch 20240701-2.el9 appstream 531 k 2024-09-12T00:25:18.821 INFO:teuthology.orchestra.run.smithi117.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-09-12T00:25:18.821 INFO:teuthology.orchestra.run.smithi117.stdout: ostree-libs x86_64 2024.7-2.el9 appstream 468 k 2024-09-12T00:25:18.821 INFO:teuthology.orchestra.run.smithi117.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T00:25:18.821 INFO:teuthology.orchestra.run.smithi117.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-09-12T00:25:18.822 INFO:teuthology.orchestra.run.smithi117.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-09-12T00:25:18.822 INFO:teuthology.orchestra.run.smithi117.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-09-12T00:25:18.822 INFO:teuthology.orchestra.run.smithi117.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-09-12T00:25:18.822 INFO:teuthology.orchestra.run.smithi117.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-09-12T00:25:18.822 INFO:teuthology.orchestra.run.smithi117.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-09-12T00:25:18.822 INFO:teuthology.orchestra.run.smithi117.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-09-12T00:25:18.822 INFO:teuthology.orchestra.run.smithi117.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-09-12T00:25:18.822 INFO:teuthology.orchestra.run.smithi117.stdout: poppler x86_64 21.01.0-21.el9 appstream 1.1 M 2024-09-12T00:25:18.822 INFO:teuthology.orchestra.run.smithi117.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-09-12T00:25:18.822 INFO:teuthology.orchestra.run.smithi117.stdout: poppler-glib x86_64 21.01.0-21.el9 appstream 152 k 2024-09-12T00:25:18.822 INFO:teuthology.orchestra.run.smithi117.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T00:25:18.822 INFO:teuthology.orchestra.run.smithi117.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T00:25:18.822 INFO:teuthology.orchestra.run.smithi117.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-09-12T00:25:18.823 INFO:teuthology.orchestra.run.smithi117.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-09-12T00:25:18.823 INFO:teuthology.orchestra.run.smithi117.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T00:25:18.823 INFO:teuthology.orchestra.run.smithi117.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T00:25:18.823 INFO:teuthology.orchestra.run.smithi117.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T00:25:18.823 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T00:25:18.823 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-argparse x86_64 2:19.3.0-4753.gd011c522.el9 ceph 45 k 2024-09-12T00:25:18.823 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-common x86_64 2:19.3.0-4753.gd011c522.el9 ceph 143 k 2024-09-12T00:25:18.823 INFO:teuthology.orchestra.run.smithi117.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T00:25:18.823 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T00:25:18.823 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T00:25:18.823 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T00:25:18.823 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T00:25:18.823 INFO:teuthology.orchestra.run.smithi117.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T00:25:18.823 INFO:teuthology.orchestra.run.smithi117.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T00:25:18.824 INFO:teuthology.orchestra.run.smithi117.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T00:25:18.824 INFO:teuthology.orchestra.run.smithi117.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T00:25:18.824 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T00:25:18.824 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T00:25:18.824 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T00:25:18.824 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T00:25:18.824 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T00:25:18.824 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T00:25:18.824 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T00:25:18.824 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T00:25:18.824 INFO:teuthology.orchestra.run.smithi117.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T00:25:18.824 INFO:teuthology.orchestra.run.smithi117.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T00:25:18.824 INFO:teuthology.orchestra.run.smithi117.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T00:25:18.825 INFO:teuthology.orchestra.run.smithi117.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T00:25:18.825 INFO:teuthology.orchestra.run.smithi117.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T00:25:18.825 INFO:teuthology.orchestra.run.smithi117.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T00:25:18.825 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T00:25:18.825 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T00:25:18.825 INFO:teuthology.orchestra.run.smithi117.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T00:25:18.825 INFO:teuthology.orchestra.run.smithi117.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T00:25:18.825 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T00:25:18.825 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T00:25:18.825 INFO:teuthology.orchestra.run.smithi117.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T00:25:18.825 INFO:teuthology.orchestra.run.smithi117.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T00:25:18.825 INFO:teuthology.orchestra.run.smithi117.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T00:25:18.825 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T00:25:18.825 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T00:25:18.826 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T00:25:18.826 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T00:25:18.826 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T00:25:18.826 INFO:teuthology.orchestra.run.smithi117.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T00:25:18.826 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T00:25:18.826 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T00:25:18.826 INFO:teuthology.orchestra.run.smithi117.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T00:25:18.826 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T00:25:18.826 INFO:teuthology.orchestra.run.smithi117.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T00:25:18.826 INFO:teuthology.orchestra.run.smithi117.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T00:25:18.826 INFO:teuthology.orchestra.run.smithi117.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T00:25:18.826 INFO:teuthology.orchestra.run.smithi117.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T00:25:18.826 INFO:teuthology.orchestra.run.smithi117.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T00:25:18.826 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T00:25:18.827 INFO:teuthology.orchestra.run.smithi117.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T00:25:18.827 INFO:teuthology.orchestra.run.smithi117.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T00:25:18.827 INFO:teuthology.orchestra.run.smithi117.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T00:25:18.827 INFO:teuthology.orchestra.run.smithi117.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T00:25:18.827 INFO:teuthology.orchestra.run.smithi117.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T00:25:18.827 INFO:teuthology.orchestra.run.smithi117.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T00:25:18.827 INFO:teuthology.orchestra.run.smithi117.stdout: rtkit x86_64 0.11-29.el9 appstream 56 k 2024-09-12T00:25:18.827 INFO:teuthology.orchestra.run.smithi117.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-09-12T00:25:18.827 INFO:teuthology.orchestra.run.smithi117.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-09-12T00:25:18.827 INFO:teuthology.orchestra.run.smithi117.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T00:25:18.827 INFO:teuthology.orchestra.run.smithi117.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-09-12T00:25:18.827 INFO:teuthology.orchestra.run.smithi117.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T00:25:18.827 INFO:teuthology.orchestra.run.smithi117.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-09-12T00:25:18.827 INFO:teuthology.orchestra.run.smithi117.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-09-12T00:25:18.828 INFO:teuthology.orchestra.run.smithi117.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-09-12T00:25:18.828 INFO:teuthology.orchestra.run.smithi117.stdout: tzdata-java noarch 2024a-2.el9 appstream 230 k 2024-09-12T00:25:18.828 INFO:teuthology.orchestra.run.smithi117.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-09-12T00:25:18.828 INFO:teuthology.orchestra.run.smithi117.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-09-12T00:25:18.828 INFO:teuthology.orchestra.run.smithi117.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-09-12T00:25:18.828 INFO:teuthology.orchestra.run.smithi117.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-09-12T00:25:18.828 INFO:teuthology.orchestra.run.smithi117.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-09-12T00:25:18.828 INFO:teuthology.orchestra.run.smithi117.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-09-12T00:25:18.828 INFO:teuthology.orchestra.run.smithi117.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-09-12T00:25:18.828 INFO:teuthology.orchestra.run.smithi117.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T00:25:18.828 INFO:teuthology.orchestra.run.smithi117.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-09-12T00:25:18.828 INFO:teuthology.orchestra.run.smithi117.stdout:Installing weak dependencies: 2024-09-12T00:25:18.828 INFO:teuthology.orchestra.run.smithi117.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-09-12T00:25:18.829 INFO:teuthology.orchestra.run.smithi117.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-09-12T00:25:18.829 INFO:teuthology.orchestra.run.smithi117.stdout: flatpak x86_64 1.12.9-1.el9 appstream 1.7 M 2024-09-12T00:25:18.829 INFO:teuthology.orchestra.run.smithi117.stdout: gtk3 x86_64 3.24.31-5.el9 appstream 4.9 M 2024-09-12T00:25:18.829 INFO:teuthology.orchestra.run.smithi117.stdout: java-11-openjdk-devel x86_64 1:11.0.20.1.1-2.el9 appstream 3.3 M 2024-09-12T00:25:18.829 INFO:teuthology.orchestra.run.smithi117.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-09-12T00:25:18.829 INFO:teuthology.orchestra.run.smithi117.stdout: mesa-dri-drivers x86_64 24.1.2-3.el9 appstream 8.8 M 2024-09-12T00:25:18.829 INFO:teuthology.orchestra.run.smithi117.stdout: p11-kit-server x86_64 0.25.3-2.el9 appstream 246 k 2024-09-12T00:25:18.829 INFO:teuthology.orchestra.run.smithi117.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-09-12T00:25:18.829 INFO:teuthology.orchestra.run.smithi117.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-09-12T00:25:18.829 INFO:teuthology.orchestra.run.smithi117.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-09-12T00:25:18.829 INFO:teuthology.orchestra.run.smithi117.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-09-12T00:25:18.829 INFO:teuthology.orchestra.run.smithi117.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T00:25:18.829 INFO:teuthology.orchestra.run.smithi117.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-09-12T00:25:18.829 INFO:teuthology.orchestra.run.smithi117.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-09-12T00:25:18.829 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T00:25:18.830 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-09-12T00:25:18.830 INFO:teuthology.orchestra.run.smithi117.stdout:====================================================================================================== 2024-09-12T00:25:18.830 INFO:teuthology.orchestra.run.smithi117.stdout:Install 283 Packages 2024-09-12T00:25:18.830 INFO:teuthology.orchestra.run.smithi117.stdout:Upgrade 2 Packages 2024-09-12T00:25:18.830 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T00:25:18.830 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 327 M 2024-09-12T00:25:18.831 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-09-12T00:25:19.177 INFO:teuthology.orchestra.run.smithi073.stdout:(1/285): ceph-19.3.0-4753.gd011c522.el9.x86_64. 53 kB/s | 6.6 kB 00:00 2024-09-12T00:25:19.385 INFO:teuthology.orchestra.run.smithi073.stdout:(2/285): ceph-fuse-19.3.0-4753.gd011c522.el9.x8 4.2 MB/s | 899 kB 00:00 2024-09-12T00:25:19.469 INFO:teuthology.orchestra.run.smithi073.stdout:(3/285): ceph-immutable-object-cache-19.3.0-475 1.7 MB/s | 145 kB 00:00 2024-09-12T00:25:19.500 INFO:teuthology.orchestra.run.smithi117.stdout:(1/285): ceph-19.3.0-4753.gd011c522.el9.x86_64. 28 kB/s | 6.6 kB 00:00 2024-09-12T00:25:19.553 INFO:teuthology.orchestra.run.smithi073.stdout:(4/285): ceph-base-19.3.0-4753.gd011c522.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-12T00:25:19.645 INFO:teuthology.orchestra.run.smithi073.stdout:(5/285): ceph-mgr-19.3.0-4753.gd011c522.el9.x86 17 MB/s | 1.5 MB 00:00 2024-09-12T00:25:19.745 INFO:teuthology.orchestra.run.smithi073.stdout:(6/285): ceph-mds-19.3.0-4753.gd011c522.el9.x86 8.6 MB/s | 2.4 MB 00:00 2024-09-12T00:25:19.954 INFO:teuthology.orchestra.run.smithi073.stdout:(7/285): ceph-mon-19.3.0-4753.gd011c522.el9.x86 16 MB/s | 4.8 MB 00:00 2024-09-12T00:25:20.134 INFO:teuthology.orchestra.run.smithi117.stdout:(2/285): ceph-fuse-19.3.0-4753.gd011c522.el9.x8 1.4 MB/s | 899 kB 00:00 2024-09-12T00:25:20.276 INFO:teuthology.orchestra.run.smithi117.stdout:(3/285): ceph-immutable-object-cache-19.3.0-475 1.0 MB/s | 145 kB 00:00 2024-09-12T00:25:20.396 INFO:teuthology.orchestra.run.smithi073.stdout:(8/285): ceph-common-19.3.0-4753.gd011c522.el9. 16 MB/s | 22 MB 00:01 2024-09-12T00:25:20.445 INFO:teuthology.orchestra.run.smithi073.stdout:(9/285): ceph-selinux-19.3.0-4753.gd011c522.el9 507 kB/s | 25 kB 00:00 2024-09-12T00:25:20.613 INFO:teuthology.orchestra.run.smithi073.stdout:(10/285): ceph-radosgw-19.3.0-4753.gd011c522.el 17 MB/s | 11 MB 00:00 2024-09-12T00:25:20.680 INFO:teuthology.orchestra.run.smithi073.stdout:(11/285): libcephfs-devel-19.3.0-4753.gd011c522 476 kB/s | 32 kB 00:00 2024-09-12T00:25:20.826 INFO:teuthology.orchestra.run.smithi117.stdout:(4/285): ceph-mds-19.3.0-4753.gd011c522.el9.x86 4.3 MB/s | 2.4 MB 00:00 2024-09-12T00:25:20.888 INFO:teuthology.orchestra.run.smithi073.stdout:(12/285): ceph-osd-19.3.0-4753.gd011c522.el9.x8 15 MB/s | 17 MB 00:01 2024-09-12T00:25:20.922 INFO:teuthology.orchestra.run.smithi073.stdout:(13/285): libcephfs2-19.3.0-4753.gd011c522.el9. 3.0 MB/s | 755 kB 00:00 2024-09-12T00:25:20.947 INFO:teuthology.orchestra.run.smithi073.stdout:(14/285): libcephsqlite-19.3.0-4753.gd011c522.e 2.7 MB/s | 161 kB 00:00 2024-09-12T00:25:20.972 INFO:teuthology.orchestra.run.smithi073.stdout:(15/285): librados-devel-19.3.0-4753.gd011c522. 2.5 MB/s | 126 kB 00:00 2024-09-12T00:25:20.998 INFO:teuthology.orchestra.run.smithi073.stdout:(16/285): libradosstriper1-19.3.0-4753.gd011c52 9.9 MB/s | 508 kB 00:00 2024-09-12T00:25:21.018 INFO:teuthology.orchestra.run.smithi117.stdout:(5/285): ceph-base-19.3.0-4753.gd011c522.el9.x8 3.1 MB/s | 5.5 MB 00:01 2024-09-12T00:25:21.041 INFO:teuthology.orchestra.run.smithi073.stdout:(17/285): python3-ceph-argparse-19.3.0-4753.gd0 1.1 MB/s | 45 kB 00:00 2024-09-12T00:25:21.059 INFO:teuthology.orchestra.run.smithi117.stdout:(6/285): ceph-mgr-19.3.0-4753.gd011c522.el9.x86 6.5 MB/s | 1.5 MB 00:00 2024-09-12T00:25:21.115 INFO:teuthology.orchestra.run.smithi073.stdout:(18/285): python3-ceph-common-19.3.0-4753.gd011 1.9 MB/s | 143 kB 00:00 2024-09-12T00:25:21.199 INFO:teuthology.orchestra.run.smithi073.stdout:(19/285): python3-cephfs-19.3.0-4753.gd011c522. 1.9 MB/s | 161 kB 00:00 2024-09-12T00:25:21.291 INFO:teuthology.orchestra.run.smithi073.stdout:(20/285): librgw2-19.3.0-4753.gd011c522.el9.x86 17 MB/s | 5.5 MB 00:00 2024-09-12T00:25:21.316 INFO:teuthology.orchestra.run.smithi073.stdout:(21/285): python3-rados-19.3.0-4753.gd011c522.e 2.7 MB/s | 322 kB 00:00 2024-09-12T00:25:21.350 INFO:teuthology.orchestra.run.smithi073.stdout:(22/285): python3-rbd-19.3.0-4753.gd011c522.el9 5.1 MB/s | 306 kB 00:00 2024-09-12T00:25:21.375 INFO:teuthology.orchestra.run.smithi073.stdout:(23/285): python3-rgw-19.3.0-4753.gd011c522.el9 1.7 MB/s | 99 kB 00:00 2024-09-12T00:25:21.409 INFO:teuthology.orchestra.run.smithi073.stdout:(24/285): rbd-fuse-19.3.0-4753.gd011c522.el9.x8 1.4 MB/s | 85 kB 00:00 2024-09-12T00:25:21.501 INFO:teuthology.orchestra.run.smithi073.stdout:(25/285): rbd-nbd-19.3.0-4753.gd011c522.el9.x86 1.8 MB/s | 170 kB 00:00 2024-09-12T00:25:21.593 INFO:teuthology.orchestra.run.smithi073.stdout:(26/285): rbd-mirror-19.3.0-4753.gd011c522.el9. 15 MB/s | 3.2 MB 00:00 2024-09-12T00:25:21.618 INFO:teuthology.orchestra.run.smithi073.stdout:(27/285): ceph-grafana-dashboards-19.3.0-4753.g 293 kB/s | 34 kB 00:00 2024-09-12T00:25:21.660 INFO:teuthology.orchestra.run.smithi073.stdout:(28/285): ceph-mgr-cephadm-19.3.0-4753.gd011c52 2.3 MB/s | 154 kB 00:00 2024-09-12T00:25:22.279 INFO:teuthology.orchestra.run.smithi073.stdout:(29/285): ceph-mgr-diskprediction-local-19.3.0- 12 MB/s | 7.4 MB 00:00 2024-09-12T00:25:22.363 INFO:teuthology.orchestra.run.smithi073.stdout:(30/285): ceph-mgr-modules-core-19.3.0-4753.gd0 3.4 MB/s | 291 kB 00:00 2024-09-12T00:25:22.446 INFO:teuthology.orchestra.run.smithi073.stdout:(31/285): ceph-mgr-rook-19.3.0-4753.gd011c522.e 592 kB/s | 49 kB 00:00 2024-09-12T00:25:22.468 INFO:teuthology.orchestra.run.smithi117.stdout:(7/285): ceph-mon-19.3.0-4753.gd011c522.el9.x86 3.3 MB/s | 4.8 MB 00:01 2024-09-12T00:25:22.613 INFO:teuthology.orchestra.run.smithi073.stdout:(32/285): ceph-mgr-dashboard-19.3.0-4753.gd011c 14 MB/s | 14 MB 00:00 2024-09-12T00:25:22.638 INFO:teuthology.orchestra.run.smithi073.stdout:(33/285): ceph-prometheus-alerts-19.3.0-4753.gd 86 kB/s | 16 kB 00:00 2024-09-12T00:25:22.664 INFO:teuthology.orchestra.run.smithi073.stdout:(34/285): ceph-volume-19.3.0-4753.gd011c522.el9 5.6 MB/s | 285 kB 00:00 2024-09-12T00:25:22.697 INFO:teuthology.orchestra.run.smithi073.stdout:(35/285): cephadm-19.3.0-4753.gd011c522.el9.noa 13 MB/s | 782 kB 00:00 2024-09-12T00:25:22.776 INFO:teuthology.orchestra.run.smithi117.stdout:(8/285): ceph-osd-19.3.0-4753.gd011c522.el9.x86 10 MB/s | 17 MB 00:01 2024-09-12T00:25:22.848 INFO:teuthology.orchestra.run.smithi073.stdout:(36/285): bluez-libs-5.56-6.el9.x86_64.rpm 565 kB/s | 85 kB 00:00 2024-09-12T00:25:22.873 INFO:teuthology.orchestra.run.smithi073.stdout:(37/285): ModemManager-glib-1.20.2-1.el9.x86_64 1.6 MB/s | 335 kB 00:00 2024-09-12T00:25:22.915 INFO:teuthology.orchestra.run.smithi073.stdout:(38/285): bubblewrap-0.4.1-7.el9.x86_64.rpm 738 kB/s | 49 kB 00:00 2024-09-12T00:25:22.948 INFO:teuthology.orchestra.run.smithi073.stdout:(39/285): cups-libs-2.3.3op2-30.el9.x86_64.rpm 3.4 MB/s | 262 kB 00:00 2024-09-12T00:25:22.974 INFO:teuthology.orchestra.run.smithi073.stdout:(40/285): fuse-2.9.9-16.el9.x86_64.rpm 1.3 MB/s | 80 kB 00:00 2024-09-12T00:25:23.002 INFO:teuthology.orchestra.run.smithi117.stdout:(9/285): ceph-common-19.3.0-4753.gd011c522.el9. 5.8 MB/s | 22 MB 00:03 2024-09-12T00:25:23.027 INFO:teuthology.orchestra.run.smithi117.stdout:(10/285): ceph-selinux-19.3.0-4753.gd011c522.el 101 kB/s | 25 kB 00:00 2024-09-12T00:25:23.041 INFO:teuthology.orchestra.run.smithi073.stdout:(41/285): libpciaccess-0.16-7.el9.x86_64.rpm 403 kB/s | 27 kB 00:00 2024-09-12T00:25:23.066 INFO:teuthology.orchestra.run.smithi073.stdout:(42/285): libgfortran-11.5.0-2.el9.x86_64.rpm 6.7 MB/s | 801 kB 00:00 2024-09-12T00:25:23.077 INFO:teuthology.orchestra.run.smithi117.stdout:(11/285): libcephfs-devel-19.3.0-4753.gd011c522 640 kB/s | 32 kB 00:00 2024-09-12T00:25:23.202 INFO:teuthology.orchestra.run.smithi117.stdout:(12/285): libcephfs2-19.3.0-4753.gd011c522.el9. 5.9 MB/s | 755 kB 00:00 2024-09-12T00:25:23.252 INFO:teuthology.orchestra.run.smithi117.stdout:(13/285): libcephsqlite-19.3.0-4753.gd011c522.e 3.2 MB/s | 161 kB 00:00 2024-09-12T00:25:23.303 INFO:teuthology.orchestra.run.smithi117.stdout:(14/285): librados-devel-19.3.0-4753.gd011c522. 2.5 MB/s | 126 kB 00:00 2024-09-12T00:25:23.378 INFO:teuthology.orchestra.run.smithi117.stdout:(15/285): libradosstriper1-19.3.0-4753.gd011c52 6.6 MB/s | 508 kB 00:00 2024-09-12T00:25:23.525 INFO:teuthology.orchestra.run.smithi073.stdout:(43/285): ceph-test-19.3.0-4753.gd011c522.el9.x 16 MB/s | 50 MB 00:03 2024-09-12T00:25:23.550 INFO:teuthology.orchestra.run.smithi073.stdout:(44/285): lksctp-tools-1.0.19-2.el9.x86_64.rpm 194 kB/s | 94 kB 00:00 2024-09-12T00:25:23.575 INFO:teuthology.orchestra.run.smithi073.stdout:(45/285): libquadmath-11.5.0-2.el9.x86_64.rpm 358 kB/s | 191 kB 00:00 2024-09-12T00:25:23.676 INFO:teuthology.orchestra.run.smithi073.stdout:(46/285): python3-ply-3.11-14.el9.noarch.rpm 1.0 MB/s | 106 kB 00:00 2024-09-12T00:25:23.734 INFO:teuthology.orchestra.run.smithi073.stdout:(47/285): python3-cryptography-36.0.1-4.el9.x86 6.7 MB/s | 1.2 MB 00:00 2024-09-12T00:25:23.792 INFO:teuthology.orchestra.run.smithi073.stdout:(48/285): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-12T00:25:23.818 INFO:teuthology.orchestra.run.smithi073.stdout:(49/285): python3-cffi-1.14.5-5.el9.x86_64.rpm 865 kB/s | 253 kB 00:00 2024-09-12T00:25:23.843 INFO:teuthology.orchestra.run.smithi073.stdout:(50/285): python3-pycparser-2.20-6.el9.noarch.r 808 kB/s | 135 kB 00:00 2024-09-12T00:25:23.845 INFO:teuthology.orchestra.run.smithi117.stdout:(16/285): librgw2-19.3.0-4753.gd011c522.el9.x86 12 MB/s | 5.5 MB 00:00 2024-09-12T00:25:23.868 INFO:teuthology.orchestra.run.smithi073.stdout:(51/285): python3-urllib3-1.26.5-6.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-09-12T00:25:23.887 INFO:teuthology.orchestra.run.smithi117.stdout:(17/285): python3-ceph-argparse-19.3.0-4753.gd0 1.1 MB/s | 45 kB 00:00 2024-09-12T00:25:23.937 INFO:teuthology.orchestra.run.smithi117.stdout:(18/285): python3-ceph-common-19.3.0-4753.gd011 2.8 MB/s | 143 kB 00:00 2024-09-12T00:25:23.988 INFO:teuthology.orchestra.run.smithi117.stdout:(19/285): python3-cephfs-19.3.0-4753.gd011c522. 3.2 MB/s | 161 kB 00:00 2024-09-12T00:25:24.046 INFO:teuthology.orchestra.run.smithi117.stdout:(20/285): python3-rados-19.3.0-4753.gd011c522.e 5.4 MB/s | 322 kB 00:00 2024-09-12T00:25:24.122 INFO:teuthology.orchestra.run.smithi117.stdout:(21/285): python3-rbd-19.3.0-4753.gd011c522.el9 4.0 MB/s | 306 kB 00:00 2024-09-12T00:25:24.172 INFO:teuthology.orchestra.run.smithi117.stdout:(22/285): python3-rgw-19.3.0-4753.gd011c522.el9 2.0 MB/s | 99 kB 00:00 2024-09-12T00:25:24.222 INFO:teuthology.orchestra.run.smithi117.stdout:(23/285): rbd-fuse-19.3.0-4753.gd011c522.el9.x8 1.7 MB/s | 85 kB 00:00 2024-09-12T00:25:24.331 INFO:teuthology.orchestra.run.smithi117.stdout:(24/285): ceph-radosgw-19.3.0-4753.gd011c522.el 5.9 MB/s | 11 MB 00:01 2024-09-12T00:25:24.381 INFO:teuthology.orchestra.run.smithi117.stdout:(25/285): rbd-nbd-19.3.0-4753.gd011c522.el9.x86 3.4 MB/s | 170 kB 00:00 2024-09-12T00:25:24.431 INFO:teuthology.orchestra.run.smithi117.stdout:(26/285): ceph-grafana-dashboards-19.3.0-4753.g 687 kB/s | 34 kB 00:00 2024-09-12T00:25:24.469 INFO:teuthology.orchestra.run.smithi073.stdout:(52/285): adwaita-cursor-theme-40.1.1-3.el9.noa 1.0 MB/s | 650 kB 00:00 2024-09-12T00:25:24.482 INFO:teuthology.orchestra.run.smithi117.stdout:(27/285): ceph-mgr-cephadm-19.3.0-4753.gd011c52 3.0 MB/s | 154 kB 00:00 2024-09-12T00:25:24.502 INFO:teuthology.orchestra.run.smithi073.stdout:(53/285): alsa-lib-1.2.12-1.el9.x86_64.rpm 826 kB/s | 523 kB 00:00 2024-09-12T00:25:24.582 INFO:teuthology.orchestra.run.smithi117.stdout:(28/285): rbd-mirror-19.3.0-4753.gd011c522.el9. 8.8 MB/s | 3.2 MB 00:00 2024-09-12T00:25:24.586 INFO:teuthology.orchestra.run.smithi073.stdout:(54/285): apache-commons-cli-1.4-17.el9.noarch. 606 kB/s | 71 kB 00:00 2024-09-12T00:25:24.703 INFO:teuthology.orchestra.run.smithi073.stdout:(55/285): apache-commons-io-2.8.0-8.el9.noarch. 2.4 MB/s | 283 kB 00:00 2024-09-12T00:25:24.728 INFO:teuthology.orchestra.run.smithi073.stdout:(56/285): apache-commons-codec-1.15-7.el9.noarc 1.3 MB/s | 302 kB 00:00 2024-09-12T00:25:24.862 INFO:teuthology.orchestra.run.smithi073.stdout:(57/285): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 650 kB/s | 87 kB 00:00 2024-09-12T00:25:24.887 INFO:teuthology.orchestra.run.smithi073.stdout:(58/285): apache-commons-lang3-3.12.0-6.el9.noa 3.0 MB/s | 559 kB 00:00 2024-09-12T00:25:25.012 INFO:teuthology.orchestra.run.smithi073.stdout:(59/285): atinject-1.0.3-6.el9.noarch.rpm 186 kB/s | 23 kB 00:00 2024-09-12T00:25:25.138 INFO:teuthology.orchestra.run.smithi073.stdout:(60/285): adwaita-icon-theme-40.1.1-3.el9.noarc 9.2 MB/s | 12 MB 00:01 2024-09-12T00:25:25.163 INFO:teuthology.orchestra.run.smithi073.stdout:(61/285): at-spi2-core-2.40.3-1.el9.x86_64.rpm 648 kB/s | 195 kB 00:00 2024-09-12T00:25:25.174 INFO:teuthology.orchestra.run.smithi117.stdout:(29/285): ceph-mgr-diskprediction-local-19.3.0- 13 MB/s | 7.4 MB 00:00 2024-09-12T00:25:25.188 INFO:teuthology.orchestra.run.smithi073.stdout:(62/285): atk-2.36.0-5.el9.x86_64.rpm 1.6 MB/s | 292 kB 00:00 2024-09-12T00:25:25.224 INFO:teuthology.orchestra.run.smithi117.stdout:(30/285): ceph-mgr-modules-core-19.3.0-4753.gd0 5.7 MB/s | 291 kB 00:00 2024-09-12T00:25:25.247 INFO:teuthology.orchestra.run.smithi073.stdout:(63/285): avahi-glib-0.8-21.el9.x86_64.rpm 137 kB/s | 15 kB 00:00 2024-09-12T00:25:25.272 INFO:teuthology.orchestra.run.smithi073.stdout:(64/285): boost-program-options-1.75.0-8.el9.x8 982 kB/s | 107 kB 00:00 2024-09-12T00:25:25.297 INFO:teuthology.orchestra.run.smithi073.stdout:(65/285): cdi-api-2.0.2-6.el9.noarch.rpm 489 kB/s | 53 kB 00:00 2024-09-12T00:25:25.364 INFO:teuthology.orchestra.run.smithi073.stdout:(66/285): colord-libs-1.4.5-4.el9.x86_64.rpm 1.9 MB/s | 229 kB 00:00 2024-09-12T00:25:25.390 INFO:teuthology.orchestra.run.smithi073.stdout:(67/285): composefs-libs-1.0.5-1.el9.x86_64.rpm 520 kB/s | 61 kB 00:00 2024-09-12T00:25:25.415 INFO:teuthology.orchestra.run.smithi073.stdout:(68/285): copy-jdk-configs-4.0-3.el9.noarch.rpm 241 kB/s | 28 kB 00:00 2024-09-12T00:25:25.473 INFO:teuthology.orchestra.run.smithi073.stdout:(69/285): dconf-0.40.0-6.el9.x86_64.rpm 1.0 MB/s | 113 kB 00:00 2024-09-12T00:25:25.599 INFO:teuthology.orchestra.run.smithi073.stdout:(70/285): exiv2-libs-0.27.5-2.el9.x86_64.rpm 6.1 MB/s | 781 kB 00:00 2024-09-12T00:25:25.632 INFO:teuthology.orchestra.run.smithi073.stdout:(71/285): exiv2-0.27.5-2.el9.x86_64.rpm 4.4 MB/s | 980 kB 00:00 2024-09-12T00:25:25.649 INFO:teuthology.orchestra.run.smithi117.stdout:(31/285): ceph-test-19.3.0-4753.gd011c522.el9.x 19 MB/s | 50 MB 00:02 2024-09-12T00:25:25.675 INFO:teuthology.orchestra.run.smithi117.stdout:(32/285): ceph-mgr-rook-19.3.0-4753.gd011c522.e 109 kB/s | 49 kB 00:00 2024-09-12T00:25:25.700 INFO:teuthology.orchestra.run.smithi117.stdout:(33/285): ceph-prometheus-alerts-19.3.0-4753.gd 330 kB/s | 16 kB 00:00 2024-09-12T00:25:25.716 INFO:teuthology.orchestra.run.smithi073.stdout:(72/285): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 2.7 MB/s | 325 kB 00:00 2024-09-12T00:25:25.742 INFO:teuthology.orchestra.run.smithi117.stdout:(34/285): ceph-volume-19.3.0-4753.gd011c522.el9 4.2 MB/s | 285 kB 00:00 2024-09-12T00:25:25.749 INFO:teuthology.orchestra.run.smithi073.stdout:(73/285): flac-libs-1.3.3-12.el9.x86_64.rpm 1.8 MB/s | 218 kB 00:00 2024-09-12T00:25:25.800 INFO:teuthology.orchestra.run.smithi073.stdout:(74/285): exempi-2.6.0-0.2.20211007gite23c213.e 1.3 MB/s | 525 kB 00:00 2024-09-12T00:25:25.825 INFO:teuthology.orchestra.run.smithi117.stdout:(35/285): cephadm-19.3.0-4753.gd011c522.el9.noa 6.1 MB/s | 782 kB 00:00 2024-09-12T00:25:25.858 INFO:teuthology.orchestra.run.smithi073.stdout:(75/285): flatpak-1.12.9-1.el9.x86_64.rpm 12 MB/s | 1.7 MB 00:00 2024-09-12T00:25:25.876 INFO:teuthology.orchestra.run.smithi073.stdout:(76/285): flatpak-selinux-1.12.9-1.el9.noarch.r 172 kB/s | 22 kB 00:00 2024-09-12T00:25:25.909 INFO:teuthology.orchestra.run.smithi073.stdout:(77/285): flatpak-session-helper-1.12.9-1.el9.x 672 kB/s | 73 kB 00:00 2024-09-12T00:25:25.917 INFO:teuthology.orchestra.run.smithi117.stdout:(36/285): ModemManager-glib-1.20.2-1.el9.x86_64 1.9 MB/s | 335 kB 00:00 2024-09-12T00:25:25.943 INFO:teuthology.orchestra.run.smithi117.stdout:(37/285): bluez-libs-5.56-6.el9.x86_64.rpm 725 kB/s | 85 kB 00:00 2024-09-12T00:25:25.959 INFO:teuthology.orchestra.run.smithi073.stdout:(78/285): flexiblas-3.0.4-8.el9.x86_64.rpm 325 kB/s | 33 kB 00:00 2024-09-12T00:25:25.968 INFO:teuthology.orchestra.run.smithi117.stdout:(38/285): bubblewrap-0.4.1-7.el9.x86_64.rpm 984 kB/s | 49 kB 00:00 2024-09-12T00:25:26.010 INFO:teuthology.orchestra.run.smithi073.stdout:(79/285): flexiblas-openblas-openmp-3.0.4-8.el9 181 kB/s | 18 kB 00:00 2024-09-12T00:25:26.010 INFO:teuthology.orchestra.run.smithi117.stdout:(39/285): fuse-2.9.9-16.el9.x86_64.rpm 1.9 MB/s | 80 kB 00:00 2024-09-12T00:25:26.035 INFO:teuthology.orchestra.run.smithi117.stdout:(40/285): cups-libs-2.3.3op2-30.el9.x86_64.rpm 2.8 MB/s | 262 kB 00:00 2024-09-12T00:25:26.068 INFO:teuthology.orchestra.run.smithi073.stdout:(80/285): gdk-pixbuf2-modules-2.42.6-4.el9.x86_ 819 kB/s | 89 kB 00:00 2024-09-12T00:25:26.077 INFO:teuthology.orchestra.run.smithi117.stdout:(41/285): libpciaccess-0.16-7.el9.x86_64.rpm 647 kB/s | 27 kB 00:00 2024-09-12T00:25:26.102 INFO:teuthology.orchestra.run.smithi117.stdout:(42/285): libgfortran-11.5.0-2.el9.x86_64.rpm 8.5 MB/s | 801 kB 00:00 2024-09-12T00:25:26.118 INFO:teuthology.orchestra.run.smithi073.stdout:(81/285): geoclue2-2.6.0-7.el9.x86_64.rpm 1.1 MB/s | 124 kB 00:00 2024-09-12T00:25:26.128 INFO:teuthology.orchestra.run.smithi117.stdout:(43/285): libquadmath-11.5.0-2.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-12T00:25:26.153 INFO:teuthology.orchestra.run.smithi117.stdout:(44/285): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.8 MB/s | 94 kB 00:00 2024-09-12T00:25:26.178 INFO:teuthology.orchestra.run.smithi117.stdout:(45/285): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.0 MB/s | 253 kB 00:00 2024-09-12T00:25:26.185 INFO:teuthology.orchestra.run.smithi073.stdout:(82/285): giflib-5.2.1-9.el9.x86_64.rpm 416 kB/s | 49 kB 00:00 2024-09-12T00:25:26.229 INFO:teuthology.orchestra.run.smithi117.stdout:(46/285): python3-cryptography-36.0.1-4.el9.x86 16 MB/s | 1.2 MB 00:00 2024-09-12T00:25:26.254 INFO:teuthology.orchestra.run.smithi117.stdout:(47/285): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-12T00:25:26.279 INFO:teuthology.orchestra.run.smithi117.stdout:(48/285): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-12T00:25:26.305 INFO:teuthology.orchestra.run.smithi117.stdout:(49/285): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-12T00:25:26.319 INFO:teuthology.orchestra.run.smithi073.stdout:(83/285): flexiblas-netlib-3.0.4-8.el9.x86_64.r 6.7 MB/s | 3.0 MB 00:00 2024-09-12T00:25:26.330 INFO:teuthology.orchestra.run.smithi117.stdout:(50/285): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-12T00:25:26.336 INFO:teuthology.orchestra.run.smithi073.stdout:(84/285): graphene-1.10.6-2.el9.x86_64.rpm 428 kB/s | 64 kB 00:00 2024-09-12T00:25:26.436 INFO:teuthology.orchestra.run.smithi073.stdout:(85/285): google-guice-4.2.3-9.el9.noarch.rpm 1.5 MB/s | 473 kB 00:00 2024-09-12T00:25:26.461 INFO:teuthology.orchestra.run.smithi073.stdout:(86/285): gsm-1.0.19-6.el9.x86_64.rpm 239 kB/s | 34 kB 00:00 2024-09-12T00:25:26.503 INFO:teuthology.orchestra.run.smithi073.stdout:(87/285): gstreamer1-1.22.1-2.el9.x86_64.rpm 8.5 MB/s | 1.4 MB 00:00 2024-09-12T00:25:26.530 INFO:teuthology.orchestra.run.smithi117.stdout:(51/285): ceph-mgr-dashboard-19.3.0-4753.gd011c 6.9 MB/s | 14 MB 00:02 2024-09-12T00:25:26.570 INFO:teuthology.orchestra.run.smithi073.stdout:(88/285): gtk-update-icon-cache-3.24.31-5.el9.x 303 kB/s | 33 kB 00:00 2024-09-12T00:25:26.722 INFO:teuthology.orchestra.run.smithi117.stdout:(52/285): alsa-lib-1.2.12-1.el9.x86_64.rpm 2.7 MB/s | 523 kB 00:00 2024-09-12T00:25:26.746 INFO:teuthology.orchestra.run.smithi073.stdout:(89/285): gtk3-3.24.31-5.el9.x86_64.rpm 20 MB/s | 4.9 MB 00:00 2024-09-12T00:25:26.773 INFO:teuthology.orchestra.run.smithi117.stdout:(53/285): apache-commons-cli-1.4-17.el9.noarch. 1.4 MB/s | 71 kB 00:00 2024-09-12T00:25:26.797 INFO:teuthology.orchestra.run.smithi117.stdout:(54/285): adwaita-cursor-theme-40.1.1-3.el9.noa 1.3 MB/s | 650 kB 00:00 2024-09-12T00:25:26.848 INFO:teuthology.orchestra.run.smithi117.stdout:(55/285): apache-commons-io-2.8.0-8.el9.noarch. 5.5 MB/s | 283 kB 00:00 2024-09-12T00:25:26.862 INFO:teuthology.orchestra.run.smithi073.stdout:(90/285): hicolor-icon-theme-0.17-13.el9.noarch 1.8 MB/s | 219 kB 00:00 2024-09-12T00:25:26.898 INFO:teuthology.orchestra.run.smithi117.stdout:(56/285): apache-commons-codec-1.15-7.el9.noarc 2.4 MB/s | 302 kB 00:00 2024-09-12T00:25:26.913 INFO:teuthology.orchestra.run.smithi073.stdout:(91/285): guava-30.1-6.el9.noarch.rpm 6.8 MB/s | 2.3 MB 00:00 2024-09-12T00:25:26.923 INFO:teuthology.orchestra.run.smithi117.stdout:(57/285): apache-commons-lang3-3.12.0-6.el9.noa 7.3 MB/s | 559 kB 00:00 2024-09-12T00:25:26.965 INFO:teuthology.orchestra.run.smithi117.stdout:(58/285): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 1.3 MB/s | 87 kB 00:00 2024-09-12T00:25:26.988 INFO:teuthology.orchestra.run.smithi073.stdout:(92/285): httpcomponents-client-4.5.13-3.el9.no 5.1 MB/s | 657 kB 00:00 2024-09-12T00:25:26.990 INFO:teuthology.orchestra.run.smithi117.stdout:(59/285): at-spi2-core-2.40.3-1.el9.x86_64.rpm 2.8 MB/s | 195 kB 00:00 2024-09-12T00:25:27.016 INFO:teuthology.orchestra.run.smithi117.stdout:(60/285): atinject-1.0.3-6.el9.noarch.rpm 465 kB/s | 23 kB 00:00 2024-09-12T00:25:27.030 INFO:teuthology.orchestra.run.smithi073.stdout:(93/285): httpcomponents-core-4.4.13-7.el9.noar 5.3 MB/s | 632 kB 00:00 2024-09-12T00:25:27.041 INFO:teuthology.orchestra.run.smithi117.stdout:(61/285): atk-2.36.0-5.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-12T00:25:27.066 INFO:teuthology.orchestra.run.smithi117.stdout:(62/285): avahi-glib-0.8-21.el9.x86_64.rpm 298 kB/s | 15 kB 00:00 2024-09-12T00:25:27.108 INFO:teuthology.orchestra.run.smithi117.stdout:(63/285): cdi-api-2.0.2-6.el9.noarch.rpm 1.2 MB/s | 53 kB 00:00 2024-09-12T00:25:27.133 INFO:teuthology.orchestra.run.smithi117.stdout:(64/285): boost-program-options-1.75.0-8.el9.x8 1.1 MB/s | 107 kB 00:00 2024-09-12T00:25:27.155 INFO:teuthology.orchestra.run.smithi073.stdout:(94/285): iso-codes-4.6.0-3.el9.noarch.rpm 21 MB/s | 3.5 MB 00:00 2024-09-12T00:25:27.175 INFO:teuthology.orchestra.run.smithi117.stdout:(65/285): composefs-libs-1.0.5-1.el9.x86_64.rpm 1.4 MB/s | 61 kB 00:00 2024-09-12T00:25:27.180 INFO:teuthology.orchestra.run.smithi073.stdout:(95/285): jakarta-annotations-1.3.5-13.el9.noar 300 kB/s | 45 kB 00:00 2024-09-12T00:25:27.209 INFO:teuthology.orchestra.run.smithi117.stdout:(66/285): colord-libs-1.4.5-4.el9.x86_64.rpm 2.2 MB/s | 229 kB 00:00 2024-09-12T00:25:27.234 INFO:teuthology.orchestra.run.smithi117.stdout:(67/285): copy-jdk-configs-4.0-3.el9.noarch.rpm 483 kB/s | 28 kB 00:00 2024-09-12T00:25:27.272 INFO:teuthology.orchestra.run.smithi073.stdout:(96/285): jansi-2.3.3-6.el9.x86_64.rpm 938 kB/s | 110 kB 00:00 2024-09-12T00:25:27.276 INFO:teuthology.orchestra.run.smithi117.stdout:(68/285): dconf-0.40.0-6.el9.x86_64.rpm 1.6 MB/s | 113 kB 00:00 2024-09-12T00:25:27.298 INFO:teuthology.orchestra.run.smithi073.stdout:(97/285): java-11-openjdk-11.0.20.1.1-2.el9.x86 3.4 MB/s | 413 kB 00:00 2024-09-12T00:25:27.310 INFO:teuthology.orchestra.run.smithi117.stdout:(69/285): exempi-2.6.0-0.2.20211007gite23c213.e 6.8 MB/s | 525 kB 00:00 2024-09-12T00:25:27.377 INFO:teuthology.orchestra.run.smithi117.stdout:(70/285): exiv2-libs-0.27.5-2.el9.x86_64.rpm 11 MB/s | 781 kB 00:00 2024-09-12T00:25:27.427 INFO:teuthology.orchestra.run.smithi117.stdout:(71/285): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 6.4 MB/s | 325 kB 00:00 2024-09-12T00:25:27.448 INFO:teuthology.orchestra.run.smithi073.stdout:(98/285): java-11-openjdk-devel-11.0.20.1.1-2.e 19 MB/s | 3.3 MB 00:00 2024-09-12T00:25:27.477 INFO:teuthology.orchestra.run.smithi117.stdout:(72/285): flac-libs-1.3.3-12.el9.x86_64.rpm 4.3 MB/s | 218 kB 00:00 2024-09-12T00:25:27.519 INFO:teuthology.orchestra.run.smithi117.stdout:(73/285): exiv2-0.27.5-2.el9.x86_64.rpm 3.9 MB/s | 980 kB 00:00 2024-09-12T00:25:27.565 INFO:teuthology.orchestra.run.smithi073.stdout:(99/285): javapackages-filesystem-6.0.0-4.el9.n 112 kB/s | 13 kB 00:00 2024-09-12T00:25:27.569 INFO:teuthology.orchestra.run.smithi117.stdout:(74/285): flatpak-selinux-1.12.9-1.el9.noarch.r 432 kB/s | 22 kB 00:00 2024-09-12T00:25:27.603 INFO:teuthology.orchestra.run.smithi117.stdout:(75/285): flatpak-1.12.9-1.el9.x86_64.rpm 14 MB/s | 1.7 MB 00:00 2024-09-12T00:25:27.620 INFO:teuthology.orchestra.run.smithi117.stdout:(76/285): flatpak-session-helper-1.12.9-1.el9.x 1.4 MB/s | 73 kB 00:00 2024-09-12T00:25:27.649 INFO:teuthology.orchestra.run.smithi073.stdout:(100/285): gstreamer1-plugins-base-1.22.1-2.el9 1.9 MB/s | 2.2 MB 00:01 2024-09-12T00:25:27.654 INFO:teuthology.orchestra.run.smithi117.stdout:(77/285): flexiblas-3.0.4-8.el9.x86_64.rpm 646 kB/s | 33 kB 00:00 2024-09-12T00:25:27.674 INFO:teuthology.orchestra.run.smithi073.stdout:(101/285): jbigkit-libs-2.1-23.el9.x86_64.rpm 487 kB/s | 53 kB 00:00 2024-09-12T00:25:27.696 INFO:teuthology.orchestra.run.smithi117.stdout:(78/285): flexiblas-openblas-openmp-3.0.4-8.el9 439 kB/s | 18 kB 00:00 2024-09-12T00:25:27.738 INFO:teuthology.orchestra.run.smithi117.stdout:(79/285): gdk-pixbuf2-modules-2.42.6-4.el9.x86_ 2.1 MB/s | 89 kB 00:00 2024-09-12T00:25:27.774 INFO:teuthology.orchestra.run.smithi073.stdout:(102/285): jcl-over-slf4j-1.7.30-13.el9.noarch. 192 kB/s | 24 kB 00:00 2024-09-12T00:25:27.788 INFO:teuthology.orchestra.run.smithi117.stdout:(80/285): geoclue2-2.6.0-7.el9.x86_64.rpm 2.4 MB/s | 124 kB 00:00 2024-09-12T00:25:27.808 INFO:teuthology.orchestra.run.smithi073.stdout:(103/285): jsoup-1.13.1-10.el9.noarch.rpm 2.8 MB/s | 377 kB 00:00 2024-09-12T00:25:27.830 INFO:teuthology.orchestra.run.smithi117.stdout:(81/285): giflib-5.2.1-9.el9.x86_64.rpm 1.1 MB/s | 49 kB 00:00 2024-09-12T00:25:27.881 INFO:teuthology.orchestra.run.smithi117.stdout:(82/285): google-guice-4.2.3-9.el9.noarch.rpm 9.3 MB/s | 473 kB 00:00 2024-09-12T00:25:27.883 INFO:teuthology.orchestra.run.smithi073.stdout:(104/285): jsr-305-3.0.2-6.el9.noarch.rpm 327 kB/s | 35 kB 00:00 2024-09-12T00:25:27.917 INFO:teuthology.orchestra.run.smithi073.stdout:(105/285): lcms2-2.12-3.el9.x86_64.rpm 1.5 MB/s | 168 kB 00:00 2024-09-12T00:25:27.922 INFO:teuthology.orchestra.run.smithi117.stdout:(83/285): graphene-1.10.6-2.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-12T00:25:27.956 INFO:teuthology.orchestra.run.smithi117.stdout:(84/285): gsm-1.0.19-6.el9.x86_64.rpm 1.0 MB/s | 34 kB 00:00 2024-09-12T00:25:28.000 INFO:teuthology.orchestra.run.smithi073.stdout:(106/285): libX11-xcb-1.7.0-9.el9.x86_64.rpm 95 kB/s | 11 kB 00:00 2024-09-12T00:25:28.026 INFO:teuthology.orchestra.run.smithi073.stdout:(107/285): libXcomposite-0.4.5-7.el9.x86_64.rpm 222 kB/s | 24 kB 00:00 2024-09-12T00:25:28.031 INFO:teuthology.orchestra.run.smithi117.stdout:(85/285): gstreamer1-1.22.1-2.el9.x86_64.rpm 19 MB/s | 1.4 MB 00:00 2024-09-12T00:25:28.109 INFO:teuthology.orchestra.run.smithi073.stdout:(108/285): libXcursor-1.2.0-7.el9.x86_64.rpm 283 kB/s | 31 kB 00:00 2024-09-12T00:25:28.151 INFO:teuthology.orchestra.run.smithi073.stdout:(109/285): libXdamage-1.1.5-7.el9.x86_64.rpm 182 kB/s | 23 kB 00:00 2024-09-12T00:25:28.157 INFO:teuthology.orchestra.run.smithi117.stdout:(86/285): adwaita-icon-theme-40.1.1-3.el9.noarc 6.5 MB/s | 12 MB 00:01 2024-09-12T00:25:28.207 INFO:teuthology.orchestra.run.smithi117.stdout:(87/285): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.1 MB/s | 3.0 MB 00:00 2024-09-12T00:25:28.226 INFO:teuthology.orchestra.run.smithi073.stdout:(110/285): libXfixes-5.0.3-16.el9.x86_64.rpm 169 kB/s | 20 kB 00:00 2024-09-12T00:25:28.232 INFO:teuthology.orchestra.run.smithi117.stdout:(88/285): gtk-update-icon-cache-3.24.31-5.el9.x 441 kB/s | 33 kB 00:00 2024-09-12T00:25:28.268 INFO:teuthology.orchestra.run.smithi073.stdout:(111/285): libXi-1.7.10-8.el9.x86_64.rpm 339 kB/s | 40 kB 00:00 2024-09-12T00:25:28.282 INFO:teuthology.orchestra.run.smithi117.stdout:(89/285): gstreamer1-plugins-base-1.22.1-2.el9. 9.0 MB/s | 2.2 MB 00:00 2024-09-12T00:25:28.324 INFO:teuthology.orchestra.run.smithi117.stdout:(90/285): hicolor-icon-theme-0.17-13.el9.noarch 5.1 MB/s | 219 kB 00:00 2024-09-12T00:25:28.335 INFO:teuthology.orchestra.run.smithi073.stdout:(112/285): libXinerama-1.1.4-10.el9.x86_64.rpm 138 kB/s | 15 kB 00:00 2024-09-12T00:25:28.369 INFO:teuthology.orchestra.run.smithi073.stdout:(113/285): libXrandr-1.5.2-8.el9.x86_64.rpm 284 kB/s | 28 kB 00:00 2024-09-12T00:25:28.383 INFO:teuthology.orchestra.run.smithi117.stdout:(91/285): httpcomponents-client-4.5.13-3.el9.no 11 MB/s | 657 kB 00:00 2024-09-12T00:25:28.425 INFO:teuthology.orchestra.run.smithi117.stdout:(92/285): guava-30.1-6.el9.noarch.rpm 12 MB/s | 2.3 MB 00:00 2024-09-12T00:25:28.444 INFO:teuthology.orchestra.run.smithi073.stdout:(114/285): libXtst-1.2.3-16.el9.x86_64.rpm 198 kB/s | 21 kB 00:00 2024-09-12T00:25:28.458 INFO:teuthology.orchestra.run.smithi117.stdout:(93/285): httpcomponents-core-4.4.13-7.el9.noar 8.2 MB/s | 632 kB 00:00 2024-09-12T00:25:28.469 INFO:teuthology.orchestra.run.smithi073.stdout:(115/285): libXv-1.0.11-16.el9.x86_64.rpm 190 kB/s | 19 kB 00:00 2024-09-12T00:25:28.500 INFO:teuthology.orchestra.run.smithi117.stdout:(94/285): jakarta-annotations-1.3.5-13.el9.noar 1.1 MB/s | 45 kB 00:00 2024-09-12T00:25:28.542 INFO:teuthology.orchestra.run.smithi117.stdout:(95/285): jansi-2.3.3-6.el9.x86_64.rpm 2.6 MB/s | 110 kB 00:00 2024-09-12T00:25:28.553 INFO:teuthology.orchestra.run.smithi073.stdout:(116/285): libXxf86vm-1.1.4-18.el9.x86_64.rpm 173 kB/s | 19 kB 00:00 2024-09-12T00:25:28.570 INFO:teuthology.orchestra.run.smithi073.stdout:(117/285): libasyncns-0.8-22.el9.x86_64.rpm 302 kB/s | 30 kB 00:00 2024-09-12T00:25:28.592 INFO:teuthology.orchestra.run.smithi117.stdout:(96/285): java-11-openjdk-11.0.20.1.1-2.el9.x86 8.1 MB/s | 413 kB 00:00 2024-09-12T00:25:28.662 INFO:teuthology.orchestra.run.smithi073.stdout:(118/285): libcanberra-0.30-27.el9.x86_64.rpm 794 kB/s | 86 kB 00:00 2024-09-12T00:25:28.676 INFO:teuthology.orchestra.run.smithi117.stdout:(97/285): iso-codes-4.6.0-3.el9.noarch.rpm 14 MB/s | 3.5 MB 00:00 2024-09-12T00:25:28.679 INFO:teuthology.orchestra.run.smithi073.stdout:(119/285): libcanberra-gtk3-0.30-27.el9.x86_64. 293 kB/s | 32 kB 00:00 2024-09-12T00:25:28.743 INFO:teuthology.orchestra.run.smithi117.stdout:(98/285): gtk3-3.24.31-5.el9.x86_64.rpm 9.1 MB/s | 4.9 MB 00:00 2024-09-12T00:25:28.779 INFO:teuthology.orchestra.run.smithi073.stdout:(120/285): libdrm-2.4.121-1.el9.x86_64.rpm 1.3 MB/s | 161 kB 00:00 2024-09-12T00:25:28.793 INFO:teuthology.orchestra.run.smithi117.stdout:(99/285): java-11-openjdk-devel-11.0.20.1.1-2.e 17 MB/s | 3.3 MB 00:00 2024-09-12T00:25:28.805 INFO:teuthology.orchestra.run.smithi073.stdout:(121/285): libepoxy-1.5.5-4.el9.x86_64.rpm 1.9 MB/s | 241 kB 00:00 2024-09-12T00:25:28.819 INFO:teuthology.orchestra.run.smithi117.stdout:(100/285): javapackages-filesystem-6.0.0-4.el9. 173 kB/s | 13 kB 00:00 2024-09-12T00:25:28.844 INFO:teuthology.orchestra.run.smithi117.stdout:(101/285): jbigkit-libs-2.1-23.el9.x86_64.rpm 1.0 MB/s | 53 kB 00:00 2024-09-12T00:25:28.869 INFO:teuthology.orchestra.run.smithi117.stdout:(102/285): jcl-over-slf4j-1.7.30-13.el9.noarch. 479 kB/s | 24 kB 00:00 2024-09-12T00:25:28.911 INFO:teuthology.orchestra.run.smithi117.stdout:(103/285): jsr-305-3.0.2-6.el9.noarch.rpm 854 kB/s | 35 kB 00:00 2024-09-12T00:25:28.913 INFO:teuthology.orchestra.run.smithi073.stdout:(122/285): libfontenc-1.1.3-17.el9.x86_64.rpm 286 kB/s | 31 kB 00:00 2024-09-12T00:25:28.936 INFO:teuthology.orchestra.run.smithi117.stdout:(104/285): jsoup-1.13.1-10.el9.noarch.rpm 4.0 MB/s | 377 kB 00:00 2024-09-12T00:25:28.962 INFO:teuthology.orchestra.run.smithi117.stdout:(105/285): lcms2-2.12-3.el9.x86_64.rpm 3.3 MB/s | 168 kB 00:00 2024-09-12T00:25:28.987 INFO:teuthology.orchestra.run.smithi117.stdout:(106/285): libX11-xcb-1.7.0-9.el9.x86_64.rpm 219 kB/s | 11 kB 00:00 2024-09-12T00:25:28.988 INFO:teuthology.orchestra.run.smithi073.stdout:(123/285): libexif-0.6.22-6.el9.x86_64.rpm 2.0 MB/s | 435 kB 00:00 2024-09-12T00:25:29.012 INFO:teuthology.orchestra.run.smithi117.stdout:(107/285): libXcomposite-0.4.5-7.el9.x86_64.rpm 480 kB/s | 24 kB 00:00 2024-09-12T00:25:29.022 INFO:teuthology.orchestra.run.smithi073.stdout:(124/285): libgexiv2-0.12.3-1.el9.x86_64.rpm 761 kB/s | 83 kB 00:00 2024-09-12T00:25:29.037 INFO:teuthology.orchestra.run.smithi117.stdout:(108/285): libXcursor-1.2.0-7.el9.x86_64.rpm 612 kB/s | 31 kB 00:00 2024-09-12T00:25:29.063 INFO:teuthology.orchestra.run.smithi117.stdout:(109/285): libXdamage-1.1.5-7.el9.x86_64.rpm 455 kB/s | 23 kB 00:00 2024-09-12T00:25:29.088 INFO:teuthology.orchestra.run.smithi117.stdout:(110/285): libXfixes-5.0.3-16.el9.x86_64.rpm 395 kB/s | 20 kB 00:00 2024-09-12T00:25:29.105 INFO:teuthology.orchestra.run.smithi073.stdout:(125/285): libglvnd-1.3.4-1.el9.x86_64.rpm 1.1 MB/s | 135 kB 00:00 2024-09-12T00:25:29.113 INFO:teuthology.orchestra.run.smithi117.stdout:(111/285): libXi-1.7.10-8.el9.x86_64.rpm 791 kB/s | 40 kB 00:00 2024-09-12T00:25:29.138 INFO:teuthology.orchestra.run.smithi117.stdout:(112/285): libXinerama-1.1.4-10.el9.x86_64.rpm 301 kB/s | 15 kB 00:00 2024-09-12T00:25:29.139 INFO:teuthology.orchestra.run.smithi073.stdout:(126/285): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 314 kB/s | 37 kB 00:00 2024-09-12T00:25:29.164 INFO:teuthology.orchestra.run.smithi117.stdout:(113/285): libXrandr-1.5.2-8.el9.x86_64.rpm 567 kB/s | 28 kB 00:00 2024-09-12T00:25:29.189 INFO:teuthology.orchestra.run.smithi117.stdout:(114/285): libXtst-1.2.3-16.el9.x86_64.rpm 427 kB/s | 21 kB 00:00 2024-09-12T00:25:29.215 INFO:teuthology.orchestra.run.smithi073.stdout:(127/285): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 1.3 MB/s | 142 kB 00:00 2024-09-12T00:25:29.223 INFO:teuthology.orchestra.run.smithi117.stdout:(115/285): libXv-1.0.11-16.el9.x86_64.rpm 327 kB/s | 19 kB 00:00 2024-09-12T00:25:29.248 INFO:teuthology.orchestra.run.smithi117.stdout:(116/285): libXxf86vm-1.1.4-18.el9.x86_64.rpm 321 kB/s | 19 kB 00:00 2024-09-12T00:25:29.256 INFO:teuthology.orchestra.run.smithi073.stdout:(128/285): libgsf-1.14.47-5.el9.x86_64.rpm 2.1 MB/s | 256 kB 00:00 2024-09-12T00:25:29.273 INFO:teuthology.orchestra.run.smithi117.stdout:(117/285): libasyncns-0.8-22.el9.x86_64.rpm 606 kB/s | 30 kB 00:00 2024-09-12T00:25:29.299 INFO:teuthology.orchestra.run.smithi117.stdout:(118/285): libcanberra-0.30-27.el9.x86_64.rpm 1.7 MB/s | 86 kB 00:00 2024-09-12T00:25:29.324 INFO:teuthology.orchestra.run.smithi117.stdout:(119/285): libcanberra-gtk3-0.30-27.el9.x86_64. 633 kB/s | 32 kB 00:00 2024-09-12T00:25:29.332 INFO:teuthology.orchestra.run.smithi073.stdout:(129/285): libgxps-0.3.2-3.el9.x86_64.rpm 675 kB/s | 79 kB 00:00 2024-09-12T00:25:29.341 INFO:teuthology.orchestra.run.smithi117.stdout:(120/285): libdrm-2.4.121-1.el9.x86_64.rpm 3.7 MB/s | 161 kB 00:00 2024-09-12T00:25:29.374 INFO:teuthology.orchestra.run.smithi073.stdout:(130/285): libiptcdata-1.0.5-10.el9.x86_64.rpm 524 kB/s | 61 kB 00:00 2024-09-12T00:25:29.391 INFO:teuthology.orchestra.run.smithi117.stdout:(121/285): libepoxy-1.5.5-4.el9.x86_64.rpm 3.5 MB/s | 241 kB 00:00 2024-09-12T00:25:29.416 INFO:teuthology.orchestra.run.smithi117.stdout:(122/285): libexif-0.6.22-6.el9.x86_64.rpm 5.7 MB/s | 435 kB 00:00 2024-09-12T00:25:29.442 INFO:teuthology.orchestra.run.smithi117.stdout:(123/285): libfontenc-1.1.3-17.el9.x86_64.rpm 619 kB/s | 31 kB 00:00 2024-09-12T00:25:29.449 INFO:teuthology.orchestra.run.smithi073.stdout:(131/285): libldac-2.0.2.3-10.el9.x86_64.rpm 353 kB/s | 41 kB 00:00 2024-09-12T00:25:29.467 INFO:teuthology.orchestra.run.smithi117.stdout:(124/285): libgexiv2-0.12.3-1.el9.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2024-09-12T00:25:29.483 INFO:teuthology.orchestra.run.smithi073.stdout:(132/285): libnotify-0.7.9-8.el9.x86_64.rpm 401 kB/s | 44 kB 00:00 2024-09-12T00:25:29.501 INFO:teuthology.orchestra.run.smithi117.stdout:(125/285): libglvnd-1.3.4-1.el9.x86_64.rpm 2.3 MB/s | 135 kB 00:00 2024-09-12T00:25:29.518 INFO:teuthology.orchestra.run.smithi117.stdout:(126/285): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 731 kB/s | 37 kB 00:00 2024-09-12T00:25:29.551 INFO:teuthology.orchestra.run.smithi117.stdout:(127/285): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 2.8 MB/s | 142 kB 00:00 2024-09-12T00:25:29.566 INFO:teuthology.orchestra.run.smithi073.stdout:(133/285): libogg-1.3.4-6.el9.x86_64.rpm 287 kB/s | 34 kB 00:00 2024-09-12T00:25:29.576 INFO:teuthology.orchestra.run.smithi117.stdout:(128/285): libgsf-1.14.47-5.el9.x86_64.rpm 4.3 MB/s | 256 kB 00:00 2024-09-12T00:25:29.600 INFO:teuthology.orchestra.run.smithi073.stdout:(134/285): libosinfo-1.10.0-1.el9.x86_64.rpm 2.7 MB/s | 319 kB 00:00 2024-09-12T00:25:29.602 INFO:teuthology.orchestra.run.smithi117.stdout:(129/285): libgxps-0.3.2-3.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2024-09-12T00:25:29.619 INFO:teuthology.orchestra.run.smithi117.stdout:(130/285): libiptcdata-1.0.5-10.el9.x86_64.rpm 1.4 MB/s | 61 kB 00:00 2024-09-12T00:25:29.645 INFO:teuthology.orchestra.run.smithi117.stdout:(131/285): libldac-2.0.2.3-10.el9.x86_64.rpm 991 kB/s | 41 kB 00:00 2024-09-12T00:25:29.661 INFO:teuthology.orchestra.run.smithi117.stdout:(132/285): libnotify-0.7.9-8.el9.x86_64.rpm 1.0 MB/s | 44 kB 00:00 2024-09-12T00:25:29.683 INFO:teuthology.orchestra.run.smithi073.stdout:(135/285): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-09-12T00:25:29.686 INFO:teuthology.orchestra.run.smithi117.stdout:(133/285): libogg-1.3.4-6.el9.x86_64.rpm 802 kB/s | 34 kB 00:00 2024-09-12T00:25:29.717 INFO:teuthology.orchestra.run.smithi073.stdout:(136/285): librabbitmq-0.11.0-7.el9.x86_64.rpm 387 kB/s | 45 kB 00:00 2024-09-12T00:25:29.741 INFO:teuthology.orchestra.run.smithi117.stdout:(134/285): libosinfo-1.10.0-1.el9.x86_64.rpm 3.9 MB/s | 319 kB 00:00 2024-09-12T00:25:29.762 INFO:teuthology.orchestra.run.smithi117.stdout:(135/285): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-09-12T00:25:29.787 INFO:teuthology.orchestra.run.smithi117.stdout:(136/285): librabbitmq-0.11.0-7.el9.x86_64.rpm 987 kB/s | 45 kB 00:00 2024-09-12T00:25:29.829 INFO:teuthology.orchestra.run.smithi117.stdout:(137/285): libsbc-1.4-9.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-12T00:25:29.834 INFO:teuthology.orchestra.run.smithi073.stdout:(137/285): libsbc-1.4-9.el9.x86_64.rpm 384 kB/s | 45 kB 00:00 2024-09-12T00:25:29.854 INFO:teuthology.orchestra.run.smithi117.stdout:(138/285): librdkafka-1.6.1-102.el9.x86_64.rpm 7.0 MB/s | 662 kB 00:00 2024-09-12T00:25:29.879 INFO:teuthology.orchestra.run.smithi117.stdout:(139/285): libsndfile-1.0.31-8.el9.x86_64.rpm 4.0 MB/s | 206 kB 00:00 2024-09-12T00:25:29.914 INFO:teuthology.orchestra.run.smithi117.stdout:(140/285): libtheora-1.1.1-31.el9.x86_64.rpm 2.7 MB/s | 164 kB 00:00 2024-09-12T00:25:29.939 INFO:teuthology.orchestra.run.smithi117.stdout:(141/285): libtiff-4.4.0-13.el9.x86_64.rpm 3.3 MB/s | 198 kB 00:00 2024-09-12T00:25:29.951 INFO:teuthology.orchestra.run.smithi073.stdout:(138/285): libsndfile-1.0.31-8.el9.x86_64.rpm 1.7 MB/s | 206 kB 00:00 2024-09-12T00:25:29.964 INFO:teuthology.orchestra.run.smithi117.stdout:(142/285): libtool-ltdl-2.4.6-46.el9.x86_64.rpm 711 kB/s | 36 kB 00:00 2024-09-12T00:25:29.984 INFO:teuthology.orchestra.run.smithi073.stdout:(139/285): librdkafka-1.6.1-102.el9.x86_64.rpm 2.2 MB/s | 662 kB 00:00 2024-09-12T00:25:29.989 INFO:teuthology.orchestra.run.smithi117.stdout:(143/285): libtracker-sparql-3.1.2-3.el9.x86_64 6.3 MB/s | 324 kB 00:00 2024-09-12T00:25:30.007 INFO:teuthology.orchestra.run.smithi117.stdout:(144/285): libvisual-0.4.0-34.el9.x86_64.rpm 3.4 MB/s | 144 kB 00:00 2024-09-12T00:25:30.040 INFO:teuthology.orchestra.run.smithi117.stdout:(145/285): libvorbis-1.3.7-5.el9.x86_64.rpm 3.8 MB/s | 193 kB 00:00 2024-09-12T00:25:30.065 INFO:teuthology.orchestra.run.smithi117.stdout:(146/285): libwayland-client-1.21.0-1.el9.x86_6 568 kB/s | 33 kB 00:00 2024-09-12T00:25:30.068 INFO:teuthology.orchestra.run.smithi073.stdout:(140/285): libtheora-1.1.1-31.el9.x86_64.rpm 1.4 MB/s | 164 kB 00:00 2024-09-12T00:25:30.090 INFO:teuthology.orchestra.run.smithi117.stdout:(147/285): libwayland-cursor-1.21.0-1.el9.x86_6 387 kB/s | 19 kB 00:00 2024-09-12T00:25:30.102 INFO:teuthology.orchestra.run.smithi073.stdout:(141/285): libtiff-4.4.0-13.el9.x86_64.rpm 1.7 MB/s | 198 kB 00:00 2024-09-12T00:25:30.116 INFO:teuthology.orchestra.run.smithi117.stdout:(148/285): libwayland-egl-1.21.0-1.el9.x86_64.r 256 kB/s | 13 kB 00:00 2024-09-12T00:25:30.141 INFO:teuthology.orchestra.run.smithi117.stdout:(149/285): libwayland-server-1.21.0-1.el9.x86_6 833 kB/s | 42 kB 00:00 2024-09-12T00:25:30.167 INFO:teuthology.orchestra.run.smithi117.stdout:(150/285): libwebp-1.2.0-8.el9.x86_64.rpm 5.4 MB/s | 277 kB 00:00 2024-09-12T00:25:30.177 INFO:teuthology.orchestra.run.smithi073.stdout:(142/285): libtool-ltdl-2.4.6-46.el9.x86_64.rpm 327 kB/s | 36 kB 00:00 2024-09-12T00:25:30.192 INFO:teuthology.orchestra.run.smithi117.stdout:(151/285): libxkbcommon-1.0.3-4.el9.x86_64.rpm 2.6 MB/s | 133 kB 00:00 2024-09-12T00:25:30.217 INFO:teuthology.orchestra.run.smithi117.stdout:(152/285): libxshmfence-1.3-10.el9.x86_64.rpm 252 kB/s | 13 kB 00:00 2024-09-12T00:25:30.227 INFO:teuthology.orchestra.run.smithi073.stdout:(143/285): libtracker-sparql-3.1.2-3.el9.x86_64 2.5 MB/s | 324 kB 00:00 2024-09-12T00:25:30.242 INFO:teuthology.orchestra.run.smithi117.stdout:(153/285): low-memory-monitor-2.1-4.el9.x86_64. 716 kB/s | 36 kB 00:00 2024-09-12T00:25:30.286 INFO:teuthology.orchestra.run.smithi073.stdout:(144/285): libvisual-0.4.0-34.el9.x86_64.rpm 1.3 MB/s | 144 kB 00:00 2024-09-12T00:25:30.301 INFO:teuthology.orchestra.run.smithi117.stdout:(154/285): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-09-12T00:25:30.326 INFO:teuthology.orchestra.run.smithi117.stdout:(155/285): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-09-12T00:25:30.345 INFO:teuthology.orchestra.run.smithi073.stdout:(145/285): libvorbis-1.3.7-5.el9.x86_64.rpm 1.6 MB/s | 193 kB 00:00 2024-09-12T00:25:30.359 INFO:teuthology.orchestra.run.smithi117.stdout:(156/285): lua-posix-35.0-8.el9.x86_64.rpm 2.5 MB/s | 151 kB 00:00 2024-09-12T00:25:30.385 INFO:teuthology.orchestra.run.smithi117.stdout:(157/285): maven-3.6.3-15.el9.noarch.rpm 303 kB/s | 18 kB 00:00 2024-09-12T00:25:30.395 INFO:teuthology.orchestra.run.smithi073.stdout:(146/285): libwayland-client-1.21.0-1.el9.x86_6 306 kB/s | 33 kB 00:00 2024-09-12T00:25:30.427 INFO:teuthology.orchestra.run.smithi117.stdout:(158/285): maven-openjdk11-3.6.3-15.el9.noarch. 217 kB/s | 9.0 kB 00:00 2024-09-12T00:25:30.445 INFO:teuthology.orchestra.run.smithi073.stdout:(147/285): libwayland-cursor-1.21.0-1.el9.x86_6 193 kB/s | 19 kB 00:00 2024-09-12T00:25:30.504 INFO:teuthology.orchestra.run.smithi073.stdout:(148/285): libwayland-egl-1.21.0-1.el9.x86_64.r 118 kB/s | 13 kB 00:00 2024-09-12T00:25:30.581 INFO:teuthology.orchestra.run.smithi073.stdout:(149/285): libwayland-server-1.21.0-1.el9.x86_6 309 kB/s | 42 kB 00:00 2024-09-12T00:25:30.623 INFO:teuthology.orchestra.run.smithi073.stdout:(150/285): libwebp-1.2.0-8.el9.x86_64.rpm 2.3 MB/s | 277 kB 00:00 2024-09-12T00:25:30.698 INFO:teuthology.orchestra.run.smithi073.stdout:(151/285): libxkbcommon-1.0.3-4.el9.x86_64.rpm 1.1 MB/s | 133 kB 00:00 2024-09-12T00:25:30.732 INFO:teuthology.orchestra.run.smithi073.stdout:(152/285): libxshmfence-1.3-10.el9.x86_64.rpm 116 kB/s | 13 kB 00:00 2024-09-12T00:25:30.769 INFO:teuthology.orchestra.run.smithi117.stdout:(159/285): java-11-openjdk-headless-11.0.20.1.1 19 MB/s | 39 MB 00:02 2024-09-12T00:25:30.802 INFO:teuthology.orchestra.run.smithi117.stdout:(160/285): maven-resolver-1.6.1-10.el9.noarch.r 1.3 MB/s | 517 kB 00:00 2024-09-12T00:25:30.815 INFO:teuthology.orchestra.run.smithi073.stdout:(153/285): low-memory-monitor-2.1-4.el9.x86_64. 306 kB/s | 36 kB 00:00 2024-09-12T00:25:30.827 INFO:teuthology.orchestra.run.smithi117.stdout:(161/285): maven-shared-utils-3.3.4-3.el9.noarc 2.5 MB/s | 151 kB 00:00 2024-09-12T00:25:30.849 INFO:teuthology.orchestra.run.smithi073.stdout:(154/285): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-12T00:25:30.869 INFO:teuthology.orchestra.run.smithi117.stdout:(162/285): maven-lib-3.6.3-15.el9.noarch.rpm 2.9 MB/s | 1.5 MB 00:00 2024-09-12T00:25:30.895 INFO:teuthology.orchestra.run.smithi117.stdout:(163/285): maven-wagon-3.4.2-7.el9.noarch.rpm 1.2 MB/s | 112 kB 00:00 2024-09-12T00:25:30.920 INFO:teuthology.orchestra.run.smithi117.stdout:(164/285): mesa-filesystem-24.1.2-3.el9.x86_64. 225 kB/s | 11 kB 00:00 2024-09-12T00:25:30.933 INFO:teuthology.orchestra.run.smithi073.stdout:(155/285): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-12T00:25:30.955 INFO:teuthology.orchestra.run.smithi117.stdout:(165/285): mesa-libEGL-24.1.2-3.el9.x86_64.rpm 2.3 MB/s | 139 kB 00:00 2024-09-12T00:25:30.966 INFO:teuthology.orchestra.run.smithi073.stdout:(156/285): lua-posix-35.0-8.el9.x86_64.rpm 1.3 MB/s | 151 kB 00:00 2024-09-12T00:25:30.980 INFO:teuthology.orchestra.run.smithi117.stdout:(166/285): mesa-libGL-24.1.2-3.el9.x86_64.rpm 2.8 MB/s | 171 kB 00:00 2024-09-12T00:25:31.009 INFO:teuthology.orchestra.run.smithi117.stdout:(167/285): mesa-libgbm-24.1.2-3.el9.x86_64.rpm 721 kB/s | 36 kB 00:00 2024-09-12T00:25:31.031 INFO:teuthology.orchestra.run.smithi117.stdout:(168/285): mesa-libglapi-24.1.2-3.el9.x86_64.rp 915 kB/s | 46 kB 00:00 2024-09-12T00:25:31.056 INFO:teuthology.orchestra.run.smithi117.stdout:(169/285): mkfontscale-1.2.1-3.el9.x86_64.rpm 644 kB/s | 32 kB 00:00 2024-09-12T00:25:31.081 INFO:teuthology.orchestra.run.smithi117.stdout:(170/285): openblas-0.3.26-2.el9.x86_64.rpm 766 kB/s | 38 kB 00:00 2024-09-12T00:25:31.132 INFO:teuthology.orchestra.run.smithi117.stdout:(171/285): openjpeg2-2.4.0-7.el9.x86_64.rpm 3.2 MB/s | 163 kB 00:00 2024-09-12T00:25:31.249 INFO:teuthology.orchestra.run.smithi117.stdout:(172/285): mesa-dri-drivers-24.1.2-3.el9.x86_64 21 MB/s | 8.8 MB 00:00 2024-09-12T00:25:31.274 INFO:teuthology.orchestra.run.smithi117.stdout:(173/285): opus-1.3.1-10.el9.x86_64.rpm 1.4 MB/s | 200 kB 00:00 2024-09-12T00:25:31.299 INFO:teuthology.orchestra.run.smithi117.stdout:(174/285): orc-0.4.31-8.el9.x86_64.rpm 3.6 MB/s | 183 kB 00:00 2024-09-12T00:25:31.333 INFO:teuthology.orchestra.run.smithi117.stdout:(175/285): osinfo-db-20240701-2.el9.noarch.rpm 8.9 MB/s | 531 kB 00:00 2024-09-12T00:25:31.333 INFO:teuthology.orchestra.run.smithi073.stdout:(157/285): java-11-openjdk-headless-11.0.20.1.1 9.7 MB/s | 39 MB 00:04 2024-09-12T00:25:31.358 INFO:teuthology.orchestra.run.smithi117.stdout:(176/285): osinfo-db-tools-1.10.0-1.el9.x86_64. 1.2 MB/s | 74 kB 00:00 2024-09-12T00:25:31.358 INFO:teuthology.orchestra.run.smithi073.stdout:(158/285): maven-3.6.3-15.el9.noarch.rpm 41 kB/s | 18 kB 00:00 2024-09-12T00:25:31.383 INFO:teuthology.orchestra.run.smithi117.stdout:(177/285): ostree-libs-2024.7-2.el9.x86_64.rpm 9.1 MB/s | 468 kB 00:00 2024-09-12T00:25:31.400 INFO:teuthology.orchestra.run.smithi073.stdout:(159/285): maven-lib-3.6.3-15.el9.noarch.rpm 3.4 MB/s | 1.5 MB 00:00 2024-09-12T00:25:31.408 INFO:teuthology.orchestra.run.smithi117.stdout:(178/285): p11-kit-server-0.25.3-2.el9.x86_64.r 4.8 MB/s | 246 kB 00:00 2024-09-12T00:25:31.434 INFO:teuthology.orchestra.run.smithi117.stdout:(179/285): pipewire-1.0.1-1.el9.x86_64.rpm 2.1 MB/s | 107 kB 00:00 2024-09-12T00:25:31.442 INFO:teuthology.orchestra.run.smithi073.stdout:(160/285): maven-openjdk11-3.6.3-15.el9.noarch. 83 kB/s | 9.0 kB 00:00 2024-09-12T00:25:31.459 INFO:teuthology.orchestra.run.smithi117.stdout:(180/285): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 1.1 MB/s | 57 kB 00:00 2024-09-12T00:25:31.485 INFO:teuthology.orchestra.run.smithi117.stdout:(181/285): pipewire-jack-audio-connection-kit-1 182 kB/s | 9.1 kB 00:00 2024-09-12T00:25:31.509 INFO:teuthology.orchestra.run.smithi117.stdout:(182/285): pipewire-jack-audio-connection-kit-l 2.6 MB/s | 135 kB 00:00 2024-09-12T00:25:31.517 INFO:teuthology.orchestra.run.smithi073.stdout:(161/285): maven-shared-utils-3.3.4-3.el9.noarc 1.3 MB/s | 151 kB 00:00 2024-09-12T00:25:31.551 INFO:teuthology.orchestra.run.smithi073.stdout:(162/285): maven-wagon-3.4.2-7.el9.noarch.rpm 1.0 MB/s | 112 kB 00:00 2024-09-12T00:25:31.585 INFO:teuthology.orchestra.run.smithi117.stdout:(183/285): openblas-openmp-0.3.26-2.el9.x86_64. 9.3 MB/s | 4.9 MB 00:00 2024-09-12T00:25:31.610 INFO:teuthology.orchestra.run.smithi117.stdout:(184/285): pipewire-pulseaudio-1.0.1-1.el9.x86_ 1.9 MB/s | 192 kB 00:00 2024-09-12T00:25:31.635 INFO:teuthology.orchestra.run.smithi117.stdout:(185/285): plexus-cipher-1.7-27.el9.noarch.rpm 516 kB/s | 26 kB 00:00 2024-09-12T00:25:31.660 INFO:teuthology.orchestra.run.smithi117.stdout:(186/285): plexus-classworlds-2.6.0-11.el9.noar 1.2 MB/s | 60 kB 00:00 2024-09-12T00:25:31.676 INFO:teuthology.orchestra.run.smithi073.stdout:(163/285): maven-resolver-1.6.1-10.el9.noarch.r 1.6 MB/s | 517 kB 00:00 2024-09-12T00:25:31.686 INFO:teuthology.orchestra.run.smithi117.stdout:(187/285): plexus-containers-component-annotati 367 kB/s | 18 kB 00:00 2024-09-12T00:25:31.701 INFO:teuthology.orchestra.run.smithi073.stdout:(164/285): mesa-filesystem-24.1.2-3.el9.x86_64. 75 kB/s | 11 kB 00:00 2024-09-12T00:25:31.711 INFO:teuthology.orchestra.run.smithi117.stdout:(188/285): plexus-interpolation-1.26-11.el9.noa 1.6 MB/s | 80 kB 00:00 2024-09-12T00:25:31.753 INFO:teuthology.orchestra.run.smithi117.stdout:(189/285): pipewire-libs-1.0.1-1.el9.x86_64.rpm 7.2 MB/s | 1.9 MB 00:00 2024-09-12T00:25:31.778 INFO:teuthology.orchestra.run.smithi117.stdout:(190/285): plexus-sec-dispatcher-1.4-37.el9.noa 365 kB/s | 34 kB 00:00 2024-09-12T00:25:31.803 INFO:teuthology.orchestra.run.smithi117.stdout:(191/285): plexus-utils-3.3.0-10.el9.noarch.rpm 2.7 MB/s | 254 kB 00:00 2024-09-12T00:25:31.827 INFO:teuthology.orchestra.run.smithi073.stdout:(165/285): mesa-libEGL-24.1.2-3.el9.x86_64.rpm 1.1 MB/s | 139 kB 00:00 2024-09-12T00:25:31.852 INFO:teuthology.orchestra.run.smithi073.stdout:(166/285): mesa-libGL-24.1.2-3.el9.x86_64.rpm 1.1 MB/s | 171 kB 00:00 2024-09-12T00:25:31.862 INFO:teuthology.orchestra.run.smithi117.stdout:(192/285): poppler-data-0.4.9-9.el9.noarch.rpm 23 MB/s | 1.9 MB 00:00 2024-09-12T00:25:31.898 INFO:teuthology.orchestra.run.smithi117.stdout:(193/285): poppler-21.01.0-21.el9.x86_64.rpm 7.5 MB/s | 1.1 MB 00:00 2024-09-12T00:25:31.921 INFO:teuthology.orchestra.run.smithi117.stdout:(194/285): poppler-glib-21.01.0-21.el9.x86_64.r 1.3 MB/s | 152 kB 00:00 2024-09-12T00:25:31.946 INFO:teuthology.orchestra.run.smithi117.stdout:(195/285): publicsuffix-list-20210518-3.el9.noa 1.6 MB/s | 83 kB 00:00 2024-09-12T00:25:31.952 INFO:teuthology.orchestra.run.smithi073.stdout:(167/285): mesa-dri-drivers-24.1.2-3.el9.x86_64 20 MB/s | 8.8 MB 00:00 2024-09-12T00:25:31.978 INFO:teuthology.orchestra.run.smithi073.stdout:(168/285): mesa-libgbm-24.1.2-3.el9.x86_64.rpm 241 kB/s | 36 kB 00:00 2024-09-12T00:25:31.980 INFO:teuthology.orchestra.run.smithi117.stdout:(196/285): pulseaudio-libs-15.0-2.el9.x86_64.rp 11 MB/s | 679 kB 00:00 2024-09-12T00:25:32.003 INFO:teuthology.orchestra.run.smithi073.stdout:(169/285): mesa-libglapi-24.1.2-3.el9.x86_64.rp 305 kB/s | 46 kB 00:00 2024-09-12T00:25:32.014 INFO:teuthology.orchestra.run.smithi117.stdout:(197/285): protobuf-3.14.0-13.el9.x86_64.rpm 6.7 MB/s | 1.0 MB 00:00 2024-09-12T00:25:32.039 INFO:teuthology.orchestra.run.smithi117.stdout:(198/285): python3-devel-3.9.19-8.el9.x86_64.rp 4.1 MB/s | 245 kB 00:00 2024-09-12T00:25:32.061 INFO:teuthology.orchestra.run.smithi073.stdout:(170/285): mkfontscale-1.2.1-3.el9.x86_64.rpm 297 kB/s | 32 kB 00:00 2024-09-12T00:25:32.064 INFO:teuthology.orchestra.run.smithi117.stdout:(199/285): python3-jinja2-2.11.3-6.el9.noarch.r 4.8 MB/s | 248 kB 00:00 2024-09-12T00:25:32.081 INFO:teuthology.orchestra.run.smithi117.stdout:(200/285): python3-jsonpatch-1.21-16.el9.noarch 616 kB/s | 26 kB 00:00 2024-09-12T00:25:32.101 INFO:teuthology.orchestra.run.smithi117.stdout:(201/285): python3-jsonpointer-2.0-4.el9.noarch 575 kB/s | 19 kB 00:00 2024-09-12T00:25:32.112 INFO:teuthology.orchestra.run.smithi073.stdout:(171/285): openblas-0.3.26-2.el9.x86_64.rpm 355 kB/s | 38 kB 00:00 2024-09-12T00:25:32.132 INFO:teuthology.orchestra.run.smithi117.stdout:(202/285): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-09-12T00:25:32.149 INFO:teuthology.orchestra.run.smithi117.stdout:(203/285): python3-markupsafe-1.1.1-12.el9.x86_ 692 kB/s | 35 kB 00:00 2024-09-12T00:25:32.187 INFO:teuthology.orchestra.run.smithi073.stdout:(172/285): openjpeg2-2.4.0-7.el9.x86_64.rpm 1.3 MB/s | 163 kB 00:00 2024-09-12T00:25:32.199 INFO:teuthology.orchestra.run.smithi117.stdout:(204/285): python3-numpy-f2py-1.20.1-5.el9.x86_ 4.9 MB/s | 250 kB 00:00 2024-09-12T00:25:32.255 INFO:teuthology.orchestra.run.smithi073.stdout:(173/285): opus-1.3.1-10.el9.x86_64.rpm 1.4 MB/s | 200 kB 00:00 2024-09-12T00:25:32.266 INFO:teuthology.orchestra.run.smithi117.stdout:(205/285): python3-babel-2.9.1-2.el9.noarch.rpm 19 MB/s | 6.0 MB 00:00 2024-09-12T00:25:32.291 INFO:teuthology.orchestra.run.smithi117.stdout:(206/285): python3-oauthlib-3.1.1-5.el9.noarch. 2.4 MB/s | 222 kB 00:00 2024-09-12T00:25:32.316 INFO:teuthology.orchestra.run.smithi117.stdout:(207/285): python3-packaging-20.9-5.el9.noarch. 1.5 MB/s | 77 kB 00:00 2024-09-12T00:25:32.341 INFO:teuthology.orchestra.run.smithi117.stdout:(208/285): python3-prettytable-0.7.2-27.el9.noa 842 kB/s | 42 kB 00:00 2024-09-12T00:25:32.375 INFO:teuthology.orchestra.run.smithi117.stdout:(209/285): python3-protobuf-3.14.0-13.el9.noarc 4.5 MB/s | 269 kB 00:00 2024-09-12T00:25:32.401 INFO:teuthology.orchestra.run.smithi117.stdout:(210/285): python3-pyasn1-0.4.8-6.el9.noarch.rp 2.7 MB/s | 159 kB 00:00 2024-09-12T00:25:32.421 INFO:teuthology.orchestra.run.smithi073.stdout:(174/285): orc-0.4.31-8.el9.x86_64.rpm 786 kB/s | 183 kB 00:00 2024-09-12T00:25:32.434 INFO:teuthology.orchestra.run.smithi117.stdout:(211/285): python3-pyasn1-modules-0.4.8-6.el9.n 4.7 MB/s | 279 kB 00:00 2024-09-12T00:25:32.454 INFO:teuthology.orchestra.run.smithi073.stdout:(175/285): osinfo-db-20240701-2.el9.noarch.rpm 2.6 MB/s | 531 kB 00:00 2024-09-12T00:25:32.459 INFO:teuthology.orchestra.run.smithi117.stdout:(212/285): python3-pytz-2021.1-5.el9.noarch.rpm 870 kB/s | 51 kB 00:00 2024-09-12T00:25:32.485 INFO:teuthology.orchestra.run.smithi117.stdout:(213/285): python3-requests-oauthlib-1.3.0-12.e 1.0 MB/s | 54 kB 00:00 2024-09-12T00:25:32.538 INFO:teuthology.orchestra.run.smithi073.stdout:(176/285): osinfo-db-tools-1.10.0-1.el9.x86_64. 629 kB/s | 74 kB 00:00 2024-09-12T00:25:32.551 INFO:teuthology.orchestra.run.smithi117.stdout:(214/285): python3-numpy-1.20.1-5.el9.x86_64.rp 12 MB/s | 5.1 MB 00:00 2024-09-12T00:25:32.572 INFO:teuthology.orchestra.run.smithi073.stdout:(177/285): ostree-libs-2024.7-2.el9.x86_64.rpm 3.9 MB/s | 468 kB 00:00 2024-09-12T00:25:32.577 INFO:teuthology.orchestra.run.smithi117.stdout:(215/285): python3-toml-0.10.2-6.el9.noarch.rpm 453 kB/s | 42 kB 00:00 2024-09-12T00:25:32.602 INFO:teuthology.orchestra.run.smithi117.stdout:(216/285): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-12T00:25:32.627 INFO:teuthology.orchestra.run.smithi117.stdout:(217/285): qatlib-service-24.02.0-1.el9.x86_64. 716 kB/s | 36 kB 00:00 2024-09-12T00:25:32.653 INFO:teuthology.orchestra.run.smithi117.stdout:(218/285): qatzip-libs-1.2.0-1.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-09-12T00:25:32.655 INFO:teuthology.orchestra.run.smithi073.stdout:(178/285): p11-kit-server-0.25.3-2.el9.x86_64.r 2.1 MB/s | 246 kB 00:00 2024-09-12T00:25:32.678 INFO:teuthology.orchestra.run.smithi117.stdout:(219/285): rtkit-0.11-29.el9.x86_64.rpm 1.1 MB/s | 56 kB 00:00 2024-09-12T00:25:32.681 INFO:teuthology.orchestra.run.smithi073.stdout:(179/285): pipewire-1.0.1-1.el9.x86_64.rpm 981 kB/s | 107 kB 00:00 2024-09-12T00:25:32.703 INFO:teuthology.orchestra.run.smithi117.stdout:(220/285): sisu-0.3.4-10.el9.noarch.rpm 10 MB/s | 510 kB 00:00 2024-09-12T00:25:32.728 INFO:teuthology.orchestra.run.smithi117.stdout:(221/285): slf4j-1.7.30-13.el9.noarch.rpm 1.3 MB/s | 69 kB 00:00 2024-09-12T00:25:32.762 INFO:teuthology.orchestra.run.smithi117.stdout:(222/285): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-12T00:25:32.806 INFO:teuthology.orchestra.run.smithi073.stdout:(180/285): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 380 kB/s | 57 kB 00:00 2024-09-12T00:25:32.831 INFO:teuthology.orchestra.run.smithi073.stdout:(181/285): pipewire-jack-audio-connection-kit-1 61 kB/s | 9.1 kB 00:00 2024-09-12T00:25:32.862 INFO:teuthology.orchestra.run.smithi117.stdout:(223/285): sound-theme-freedesktop-0.8-17.el9.n 2.8 MB/s | 383 kB 00:00 2024-09-12T00:25:32.896 INFO:teuthology.orchestra.run.smithi117.stdout:(224/285): totem-pl-parser-3.26.6-2.el9.x86_64. 1.1 MB/s | 152 kB 00:00 2024-09-12T00:25:32.915 INFO:teuthology.orchestra.run.smithi073.stdout:(182/285): pipewire-jack-audio-connection-kit-l 1.2 MB/s | 135 kB 00:00 2024-09-12T00:25:32.930 INFO:teuthology.orchestra.run.smithi117.stdout:(225/285): tracker-3.1.2-3.el9.x86_64.rpm 8.1 MB/s | 555 kB 00:00 2024-09-12T00:25:32.964 INFO:teuthology.orchestra.run.smithi117.stdout:(226/285): tracker-miners-3.1.2-4.el9.x86_64.rp 14 MB/s | 944 kB 00:00 2024-09-12T00:25:32.974 INFO:teuthology.orchestra.run.smithi073.stdout:(183/285): pipewire-libs-1.0.1-1.el9.x86_64.rpm 14 MB/s | 1.9 MB 00:00 2024-09-12T00:25:32.989 INFO:teuthology.orchestra.run.smithi117.stdout:(227/285): ttmkfdir-3.0.9-65.el9.x86_64.rpm 903 kB/s | 53 kB 00:00 2024-09-12T00:25:33.014 INFO:teuthology.orchestra.run.smithi117.stdout:(228/285): tzdata-java-2024a-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-12T00:25:33.024 INFO:teuthology.orchestra.run.smithi073.stdout:(184/285): pipewire-pulseaudio-1.0.1-1.el9.x86_ 1.7 MB/s | 192 kB 00:00 2024-09-12T00:25:33.039 INFO:teuthology.orchestra.run.smithi117.stdout:(229/285): upower-0.99.11-11.el9.x86_64.rpm 3.4 MB/s | 173 kB 00:00 2024-09-12T00:25:33.065 INFO:teuthology.orchestra.run.smithi117.stdout:(230/285): webrtc-audio-processing-0.3.1-8.el9. 6.0 MB/s | 306 kB 00:00 2024-09-12T00:25:33.083 INFO:teuthology.orchestra.run.smithi073.stdout:(185/285): plexus-cipher-1.7-27.el9.noarch.rpm 238 kB/s | 26 kB 00:00 2024-09-12T00:25:33.090 INFO:teuthology.orchestra.run.smithi117.stdout:(231/285): wireplumber-0.4.14-1.el9.x86_64.rpm 1.9 MB/s | 96 kB 00:00 2024-09-12T00:25:33.115 INFO:teuthology.orchestra.run.smithi117.stdout:(232/285): wireplumber-libs-0.4.14-1.el9.x86_64 7.0 MB/s | 358 kB 00:00 2024-09-12T00:25:33.133 INFO:teuthology.orchestra.run.smithi073.stdout:(186/285): plexus-classworlds-2.6.0-11.el9.noar 553 kB/s | 60 kB 00:00 2024-09-12T00:25:33.140 INFO:teuthology.orchestra.run.smithi117.stdout:(233/285): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 848 kB/s | 42 kB 00:00 2024-09-12T00:25:33.166 INFO:teuthology.orchestra.run.smithi117.stdout:(234/285): xdg-desktop-portal-1.12.6-1.el9.x86_ 7.5 MB/s | 385 kB 00:00 2024-09-12T00:25:33.191 INFO:teuthology.orchestra.run.smithi117.stdout:(235/285): xdg-desktop-portal-gtk-1.12.0-3.el9. 2.6 MB/s | 134 kB 00:00 2024-09-12T00:25:33.191 INFO:teuthology.orchestra.run.smithi073.stdout:(187/285): plexus-containers-component-annotati 169 kB/s | 18 kB 00:00 2024-09-12T00:25:33.233 INFO:teuthology.orchestra.run.smithi117.stdout:(236/285): xkeyboard-config-2.33-2.el9.noarch.r 13 MB/s | 859 kB 00:00 2024-09-12T00:25:33.242 INFO:teuthology.orchestra.run.smithi073.stdout:(188/285): plexus-interpolation-1.26-11.el9.noa 733 kB/s | 80 kB 00:00 2024-09-12T00:25:33.258 INFO:teuthology.orchestra.run.smithi117.stdout:(237/285): xmlstarlet-1.6.1-20.el9.x86_64.rpm 955 kB/s | 64 kB 00:00 2024-09-12T00:25:33.284 INFO:teuthology.orchestra.run.smithi117.stdout:(238/285): xorg-x11-fonts-Type1-7.5-33.el9.noar 9.8 MB/s | 505 kB 00:00 2024-09-12T00:25:33.300 INFO:teuthology.orchestra.run.smithi073.stdout:(189/285): plexus-sec-dispatcher-1.4-37.el9.noa 310 kB/s | 34 kB 00:00 2024-09-12T00:25:33.337 INFO:teuthology.orchestra.run.smithi117.stdout:(239/285): lua-devel-5.4.4-4.el9.x86_64.rpm 297 kB/s | 22 kB 00:00 2024-09-12T00:25:33.367 INFO:teuthology.orchestra.run.smithi073.stdout:(190/285): plexus-utils-3.3.0-10.el9.noarch.rpm 2.0 MB/s | 254 kB 00:00 2024-09-12T00:25:33.384 INFO:teuthology.orchestra.run.smithi117.stdout:(240/285): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-12T00:25:33.418 INFO:teuthology.orchestra.run.smithi117.stdout:(241/285): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-09-12T00:25:33.434 INFO:teuthology.orchestra.run.smithi073.stdout:(191/285): poppler-21.01.0-21.el9.x86_64.rpm 8.0 MB/s | 1.1 MB 00:00 2024-09-12T00:25:33.435 INFO:teuthology.orchestra.run.smithi117.stdout:(242/285): grpc-data-1.46.7-10.el9.noarch.rpm 1.2 MB/s | 19 kB 00:00 2024-09-12T00:25:33.501 INFO:teuthology.orchestra.run.smithi073.stdout:(192/285): openblas-openmp-0.3.26-2.el9.x86_64. 3.3 MB/s | 4.9 MB 00:01 2024-09-12T00:25:33.502 INFO:teuthology.orchestra.run.smithi117.stdout:(243/285): protobuf-compiler-3.14.0-13.el9.x86_ 3.9 MB/s | 863 kB 00:00 2024-09-12T00:25:33.543 INFO:teuthology.orchestra.run.smithi073.stdout:(193/285): poppler-glib-21.01.0-21.el9.x86_64.r 1.4 MB/s | 152 kB 00:00 2024-09-12T00:25:33.627 INFO:teuthology.orchestra.run.smithi073.stdout:(194/285): poppler-data-0.4.9-9.el9.noarch.rpm 7.2 MB/s | 1.9 MB 00:00 2024-09-12T00:25:33.660 INFO:teuthology.orchestra.run.smithi073.stdout:(195/285): publicsuffix-list-20210518-3.el9.noa 707 kB/s | 83 kB 00:00 2024-09-12T00:25:33.668 INFO:teuthology.orchestra.run.smithi117.stdout:(244/285): python3-scipy-1.6.2-8.el9.x86_64.rpm 13 MB/s | 16 MB 00:01 2024-09-12T00:25:33.702 INFO:teuthology.orchestra.run.smithi117.stdout:(245/285): libarrow-doc-9.0.0-11.el9.noarch.rpm 130 kB/s | 26 kB 00:00 2024-09-12T00:25:33.727 INFO:teuthology.orchestra.run.smithi117.stdout:(246/285): libunwind-1.6.2-1.el9.x86_64.rpm 2.8 MB/s | 67 kB 00:00 2024-09-12T00:25:33.753 INFO:teuthology.orchestra.run.smithi117.stdout:(247/285): liboath-2.6.7-2.el9.x86_64.rpm 596 kB/s | 49 kB 00:00 2024-09-12T00:25:33.760 INFO:teuthology.orchestra.run.smithi073.stdout:(196/285): pulseaudio-libs-15.0-2.el9.x86_64.rp 5.0 MB/s | 679 kB 00:00 2024-09-12T00:25:33.778 INFO:teuthology.orchestra.run.smithi117.stdout:(248/285): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-09-12T00:25:33.836 INFO:teuthology.orchestra.run.smithi073.stdout:(197/285): protobuf-3.14.0-13.el9.x86_64.rpm 3.0 MB/s | 1.0 MB 00:00 2024-09-12T00:25:33.845 INFO:teuthology.orchestra.run.smithi117.stdout:(249/285): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-12T00:25:33.870 INFO:teuthology.orchestra.run.smithi117.stdout:(250/285): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-12T00:25:33.878 INFO:teuthology.orchestra.run.smithi073.stdout:(198/285): python3-devel-3.9.19-8.el9.x86_64.rp 2.0 MB/s | 245 kB 00:00 2024-09-12T00:25:33.895 INFO:teuthology.orchestra.run.smithi117.stdout:(251/285): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-12T00:25:33.921 INFO:teuthology.orchestra.run.smithi117.stdout:(252/285): python3-certifi-2023.05.07-4.el9.noa 567 kB/s | 14 kB 00:00 2024-09-12T00:25:33.961 INFO:teuthology.orchestra.run.smithi073.stdout:(199/285): python3-babel-2.9.1-2.el9.noarch.rpm 20 MB/s | 6.0 MB 00:00 2024-09-12T00:25:33.962 INFO:teuthology.orchestra.run.smithi117.stdout:(253/285): python3-asyncssh-2.13.2-5.el9.noarch 2.9 MB/s | 548 kB 00:00 2024-09-12T00:25:33.987 INFO:teuthology.orchestra.run.smithi073.stdout:(200/285): python3-jinja2-2.11.3-6.el9.noarch.r 1.6 MB/s | 248 kB 00:00 2024-09-12T00:25:33.988 INFO:teuthology.orchestra.run.smithi117.stdout:(254/285): python3-cheroot-8.6.0-4.el9.noarch.r 2.5 MB/s | 172 kB 00:00 2024-09-12T00:25:34.012 INFO:teuthology.orchestra.run.smithi073.stdout:(201/285): python3-jsonpatch-1.21-16.el9.noarch 191 kB/s | 26 kB 00:00 2024-09-12T00:25:34.021 INFO:teuthology.orchestra.run.smithi117.stdout:(255/285): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.1 MB/s | 839 kB 00:00 2024-09-12T00:25:34.047 INFO:teuthology.orchestra.run.smithi117.stdout:(256/285): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-09-12T00:25:34.070 INFO:teuthology.orchestra.run.smithi073.stdout:(202/285): python3-jsonpointer-2.0-4.el9.noarch 176 kB/s | 19 kB 00:00 2024-09-12T00:25:34.080 INFO:teuthology.orchestra.run.smithi117.stdout:(257/285): python3-google-auth-2.34.0-1.el9.noa 2.3 MB/s | 220 kB 00:00 2024-09-12T00:25:34.096 INFO:teuthology.orchestra.run.smithi073.stdout:(203/285): python3-mako-1.1.4-6.el9.noarch.rpm 1.5 MB/s | 172 kB 00:00 2024-09-12T00:25:34.106 INFO:teuthology.orchestra.run.smithi117.stdout:(258/285): python3-jaraco-8.2.1-3.el9.noarch.rp 428 kB/s | 11 kB 00:00 2024-09-12T00:25:34.121 INFO:teuthology.orchestra.run.smithi073.stdout:(204/285): python3-markupsafe-1.1.1-12.el9.x86_ 320 kB/s | 35 kB 00:00 2024-09-12T00:25:34.131 INFO:teuthology.orchestra.run.smithi117.stdout:(259/285): python3-grpcio-tools-1.46.7-10.el9.x 1.7 MB/s | 144 kB 00:00 2024-09-12T00:25:34.157 INFO:teuthology.orchestra.run.smithi117.stdout:(260/285): python3-jaraco-classes-3.2.1-5.el9.n 353 kB/s | 18 kB 00:00 2024-09-12T00:25:34.182 INFO:teuthology.orchestra.run.smithi117.stdout:(261/285): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-09-12T00:25:34.207 INFO:teuthology.orchestra.run.smithi117.stdout:(262/285): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-12T00:25:34.230 INFO:teuthology.orchestra.run.smithi073.stdout:(205/285): python3-numpy-f2py-1.20.1-5.el9.x86_ 1.8 MB/s | 250 kB 00:00 2024-09-12T00:25:34.232 INFO:teuthology.orchestra.run.smithi117.stdout:(263/285): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-09-12T00:25:34.255 INFO:teuthology.orchestra.run.smithi073.stdout:(206/285): python3-oauthlib-3.1.1-5.el9.noarch. 1.6 MB/s | 222 kB 00:00 2024-09-12T00:25:34.257 INFO:teuthology.orchestra.run.smithi117.stdout:(264/285): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T00:25:34.291 INFO:teuthology.orchestra.run.smithi117.stdout:(265/285): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-12T00:25:34.317 INFO:teuthology.orchestra.run.smithi117.stdout:(266/285): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-12T00:25:34.330 INFO:teuthology.orchestra.run.smithi073.stdout:(207/285): python3-numpy-1.20.1-5.el9.x86_64.rp 20 MB/s | 5.1 MB 00:00 2024-09-12T00:25:34.356 INFO:teuthology.orchestra.run.smithi073.stdout:(208/285): python3-packaging-20.9-5.el9.noarch. 616 kB/s | 77 kB 00:00 2024-09-12T00:25:34.367 INFO:teuthology.orchestra.run.smithi117.stdout:(267/285): python3-kubernetes-26.1.0-2.el9.noar 6.4 MB/s | 1.0 MB 00:00 2024-09-12T00:25:34.381 INFO:teuthology.orchestra.run.smithi073.stdout:(209/285): python3-prettytable-0.7.2-27.el9.noa 337 kB/s | 42 kB 00:00 2024-09-12T00:25:34.392 INFO:teuthology.orchestra.run.smithi117.stdout:(268/285): python3-portend-3.1.0-2.el9.noarch.r 659 kB/s | 16 kB 00:00 2024-09-12T00:25:34.417 INFO:teuthology.orchestra.run.smithi117.stdout:(269/285): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-12T00:25:34.442 INFO:teuthology.orchestra.run.smithi117.stdout:(270/285): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-09-12T00:25:34.448 INFO:teuthology.orchestra.run.smithi073.stdout:(210/285): python3-protobuf-3.14.0-13.el9.noarc 2.2 MB/s | 269 kB 00:00 2024-09-12T00:25:34.468 INFO:teuthology.orchestra.run.smithi117.stdout:(271/285): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-12T00:25:34.473 INFO:teuthology.orchestra.run.smithi073.stdout:(211/285): python3-pyasn1-0.4.8-6.el9.noarch.rp 1.3 MB/s | 159 kB 00:00 2024-09-12T00:25:34.493 INFO:teuthology.orchestra.run.smithi117.stdout:(272/285): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-12T00:25:34.498 INFO:teuthology.orchestra.run.smithi073.stdout:(212/285): python3-pyasn1-modules-0.4.8-6.el9.n 2.3 MB/s | 279 kB 00:00 2024-09-12T00:25:34.518 INFO:teuthology.orchestra.run.smithi117.stdout:(273/285): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-12T00:25:34.543 INFO:teuthology.orchestra.run.smithi117.stdout:(274/285): python3-tempora-5.0.0-2.el9.noarch.r 715 kB/s | 36 kB 00:00 2024-09-12T00:25:34.548 INFO:teuthology.orchestra.run.smithi073.stdout:(213/285): python3-pytz-2021.1-5.el9.noarch.rpm 508 kB/s | 51 kB 00:00 2024-09-12T00:25:34.574 INFO:teuthology.orchestra.run.smithi073.stdout:(214/285): python3-requests-oauthlib-1.3.0-12.e 533 kB/s | 54 kB 00:00 2024-09-12T00:25:34.585 INFO:teuthology.orchestra.run.smithi117.stdout:(275/285): python3-grpcio-1.46.7-10.el9.x86_64. 3.6 MB/s | 2.0 MB 00:00 2024-09-12T00:25:34.611 INFO:teuthology.orchestra.run.smithi117.stdout:(276/285): python3-typing-extensions-4.12.2-2.e 1.1 MB/s | 74 kB 00:00 2024-09-12T00:25:34.636 INFO:teuthology.orchestra.run.smithi117.stdout:(277/285): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-12T00:25:34.661 INFO:teuthology.orchestra.run.smithi117.stdout:(278/285): python3-webob-1.8.8-2.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-09-12T00:25:34.674 INFO:teuthology.orchestra.run.smithi073.stdout:(215/285): python3-toml-0.10.2-6.el9.noarch.rpm 332 kB/s | 42 kB 00:00 2024-09-12T00:25:34.686 INFO:teuthology.orchestra.run.smithi117.stdout:(279/285): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-12T00:25:34.699 INFO:teuthology.orchestra.run.smithi073.stdout:(216/285): qatlib-24.02.0-1.el9.x86_64.rpm 1.7 MB/s | 221 kB 00:00 2024-09-12T00:25:34.712 INFO:teuthology.orchestra.run.smithi117.stdout:(280/285): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-12T00:25:34.737 INFO:teuthology.orchestra.run.smithi117.stdout:(281/285): s3cmd-2.4.0-1.el9.noarch.rpm 4.0 MB/s | 206 kB 00:00 2024-09-12T00:25:34.762 INFO:teuthology.orchestra.run.smithi117.stdout:(282/285): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2024-09-12T00:25:34.783 INFO:teuthology.orchestra.run.smithi073.stdout:(217/285): qatlib-service-24.02.0-1.el9.x86_64. 330 kB/s | 36 kB 00:00 2024-09-12T00:25:34.808 INFO:teuthology.orchestra.run.smithi073.stdout:(218/285): qatzip-libs-1.2.0-1.el9.x86_64.rpm 437 kB/s | 47 kB 00:00 2024-09-12T00:25:34.812 INFO:teuthology.orchestra.run.smithi117.stdout:(283/285): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-12T00:25:34.884 INFO:teuthology.orchestra.run.smithi073.stdout:(219/285): rtkit-0.11-29.el9.x86_64.rpm 558 kB/s | 56 kB 00:00 2024-09-12T00:25:34.934 INFO:teuthology.orchestra.run.smithi073.stdout:(220/285): sisu-0.3.4-10.el9.noarch.rpm 4.0 MB/s | 510 kB 00:00 2024-09-12T00:25:35.001 INFO:teuthology.orchestra.run.smithi073.stdout:(221/285): slf4j-1.7.30-13.el9.noarch.rpm 591 kB/s | 69 kB 00:00 2024-09-12T00:25:35.029 INFO:teuthology.orchestra.run.smithi117.stdout:(284/285): librados2-19.3.0-4753.gd011c522.el9. 12 MB/s | 3.5 MB 00:00 2024-09-12T00:25:35.051 INFO:teuthology.orchestra.run.smithi073.stdout:(222/285): socat-1.7.4.1-6.el9.x86_64.rpm 2.5 MB/s | 304 kB 00:00 2024-09-12T00:25:35.118 INFO:teuthology.orchestra.run.smithi073.stdout:(223/285): sound-theme-freedesktop-0.8-17.el9.n 3.2 MB/s | 383 kB 00:00 2024-09-12T00:25:35.160 INFO:teuthology.orchestra.run.smithi073.stdout:(224/285): totem-pl-parser-3.26.6-2.el9.x86_64. 1.4 MB/s | 152 kB 00:00 2024-09-12T00:25:35.204 INFO:teuthology.orchestra.run.smithi117.stdout:(285/285): librbd1-19.3.0-4753.gd011c522.el9.x8 7.3 MB/s | 3.2 MB 00:00 2024-09-12T00:25:35.212 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-09-12T00:25:35.212 INFO:teuthology.orchestra.run.smithi117.stdout:Total 20 MB/s | 327 MB 00:16 2024-09-12T00:25:35.244 INFO:teuthology.orchestra.run.smithi073.stdout:(225/285): tracker-3.1.2-3.el9.x86_64.rpm 4.3 MB/s | 555 kB 00:00 2024-09-12T00:25:35.352 INFO:teuthology.orchestra.run.smithi073.stdout:(226/285): ttmkfdir-3.0.9-65.el9.x86_64.rpm 491 kB/s | 53 kB 00:00 2024-09-12T00:25:35.394 INFO:teuthology.orchestra.run.smithi073.stdout:(227/285): tracker-miners-3.1.2-4.el9.x86_64.rp 3.9 MB/s | 944 kB 00:00 2024-09-12T00:25:35.469 INFO:teuthology.orchestra.run.smithi073.stdout:(228/285): tzdata-java-2024a-2.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-09-12T00:25:35.511 INFO:teuthology.orchestra.run.smithi073.stdout:(229/285): upower-0.99.11-11.el9.x86_64.rpm 1.4 MB/s | 173 kB 00:00 2024-09-12T00:25:35.587 INFO:teuthology.orchestra.run.smithi073.stdout:(230/285): webrtc-audio-processing-0.3.1-8.el9. 2.6 MB/s | 306 kB 00:00 2024-09-12T00:25:35.629 INFO:teuthology.orchestra.run.smithi073.stdout:(231/285): wireplumber-0.4.14-1.el9.x86_64.rpm 826 kB/s | 96 kB 00:00 2024-09-12T00:25:35.704 INFO:teuthology.orchestra.run.smithi073.stdout:(232/285): wireplumber-libs-0.4.14-1.el9.x86_64 3.0 MB/s | 358 kB 00:00 2024-09-12T00:25:35.746 INFO:teuthology.orchestra.run.smithi073.stdout:(233/285): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 363 kB/s | 42 kB 00:00 2024-09-12T00:25:35.829 INFO:teuthology.orchestra.run.smithi073.stdout:(234/285): xdg-desktop-portal-1.12.6-1.el9.x86_ 3.0 MB/s | 385 kB 00:00 2024-09-12T00:25:35.872 INFO:teuthology.orchestra.run.smithi073.stdout:(235/285): xdg-desktop-portal-gtk-1.12.0-3.el9. 1.0 MB/s | 134 kB 00:00 2024-09-12T00:25:36.072 INFO:teuthology.orchestra.run.smithi073.stdout:(236/285): python3-scipy-1.6.2-8.el9.x86_64.rpm 10 MB/s | 16 MB 00:01 2024-09-12T00:25:36.097 INFO:teuthology.orchestra.run.smithi073.stdout:(237/285): xmlstarlet-1.6.1-20.el9.x86_64.rpm 283 kB/s | 64 kB 00:00 2024-09-12T00:25:36.131 INFO:teuthology.orchestra.run.smithi073.stdout:(238/285): xkeyboard-config-2.33-2.el9.noarch.r 2.8 MB/s | 859 kB 00:00 2024-09-12T00:25:36.181 INFO:teuthology.orchestra.run.smithi073.stdout:(239/285): lua-devel-5.4.4-4.el9.x86_64.rpm 267 kB/s | 22 kB 00:00 2024-09-12T00:25:36.206 INFO:teuthology.orchestra.run.smithi073.stdout:(240/285): xorg-x11-fonts-Type1-7.5-33.el9.noar 3.7 MB/s | 505 kB 00:00 2024-09-12T00:25:36.257 INFO:teuthology.orchestra.run.smithi073.stdout:(241/285): abseil-cpp-20211102.0-3.el9.x86_64.r 7.1 MB/s | 548 kB 00:00 2024-09-12T00:25:36.282 INFO:teuthology.orchestra.run.smithi073.stdout:(242/285): grpc-data-1.46.7-10.el9.noarch.rpm 780 kB/s | 19 kB 00:00 2024-09-12T00:25:36.307 INFO:teuthology.orchestra.run.smithi073.stdout:(243/285): gperftools-libs-2.9.1-2.el9.x86_64.r 3.2 MB/s | 309 kB 00:00 2024-09-12T00:25:36.332 INFO:teuthology.orchestra.run.smithi073.stdout:(244/285): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-12T00:25:36.357 INFO:teuthology.orchestra.run.smithi073.stdout:(245/285): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-12T00:25:36.391 INFO:teuthology.orchestra.run.smithi073.stdout:(246/285): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-12T00:25:36.433 INFO:teuthology.orchestra.run.smithi073.stdout:(247/285): protobuf-compiler-3.14.0-13.el9.x86_ 2.8 MB/s | 863 kB 00:00 2024-09-12T00:25:36.459 INFO:teuthology.orchestra.run.smithi073.stdout:(248/285): luarocks-3.9.2-5.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-09-12T00:25:36.509 INFO:teuthology.orchestra.run.smithi073.stdout:(249/285): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-12T00:25:36.534 INFO:teuthology.orchestra.run.smithi073.stdout:(250/285): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-12T00:25:36.559 INFO:teuthology.orchestra.run.smithi073.stdout:(251/285): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-12T00:25:36.585 INFO:teuthology.orchestra.run.smithi073.stdout:(252/285): python3-certifi-2023.05.07-4.el9.noa 563 kB/s | 14 kB 00:00 2024-09-12T00:25:36.643 INFO:teuthology.orchestra.run.smithi073.stdout:(253/285): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-12T00:25:36.668 INFO:teuthology.orchestra.run.smithi073.stdout:(254/285): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-09-12T00:25:36.702 INFO:teuthology.orchestra.run.smithi073.stdout:(255/285): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.1 MB/s | 839 kB 00:00 2024-09-12T00:25:36.727 INFO:teuthology.orchestra.run.smithi073.stdout:(256/285): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-12T00:25:36.761 INFO:teuthology.orchestra.run.smithi073.stdout:(257/285): python3-cherrypy-18.6.1-2.el9.noarch 3.0 MB/s | 358 kB 00:00 2024-09-12T00:25:36.786 INFO:teuthology.orchestra.run.smithi073.stdout:(258/285): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-09-12T00:25:36.803 INFO:teuthology.orchestra.run.smithi073.stdout:(259/285): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-09-12T00:25:36.828 INFO:teuthology.orchestra.run.smithi073.stdout:(260/285): python3-jaraco-classes-3.2.1-5.el9.n 421 kB/s | 18 kB 00:00 2024-09-12T00:25:36.854 INFO:teuthology.orchestra.run.smithi073.stdout:(261/285): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-09-12T00:25:36.879 INFO:teuthology.orchestra.run.smithi073.stdout:(262/285): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-09-12T00:25:36.904 INFO:teuthology.orchestra.run.smithi073.stdout:(263/285): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-09-12T00:25:36.929 INFO:teuthology.orchestra.run.smithi073.stdout:(264/285): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T00:25:36.963 INFO:teuthology.orchestra.run.smithi073.stdout:(265/285): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-12T00:25:36.989 INFO:teuthology.orchestra.run.smithi073.stdout:(266/285): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-12T00:25:37.022 INFO:teuthology.orchestra.run.smithi073.stdout:(267/285): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-12T00:25:37.047 INFO:teuthology.orchestra.run.smithi073.stdout:(268/285): python3-portend-3.1.0-2.el9.noarch.r 662 kB/s | 16 kB 00:00 2024-09-12T00:25:37.081 INFO:teuthology.orchestra.run.smithi073.stdout:(269/285): python3-kubernetes-26.1.0-2.el9.noar 5.1 MB/s | 1.0 MB 00:00 2024-09-12T00:25:37.106 INFO:teuthology.orchestra.run.smithi073.stdout:(270/285): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-09-12T00:25:37.131 INFO:teuthology.orchestra.run.smithi073.stdout:(271/285): python3-repoze-lru-0.7-16.el9.noarch 618 kB/s | 31 kB 00:00 2024-09-12T00:25:37.157 INFO:teuthology.orchestra.run.smithi073.stdout:(272/285): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-12T00:25:37.182 INFO:teuthology.orchestra.run.smithi073.stdout:(273/285): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-12T00:25:37.207 INFO:teuthology.orchestra.run.smithi073.stdout:(274/285): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-12T00:25:37.232 INFO:teuthology.orchestra.run.smithi073.stdout:(275/285): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-12T00:25:37.250 INFO:teuthology.orchestra.run.smithi073.stdout:(276/285): python3-websocket-client-1.2.3-2.el9 5.3 MB/s | 90 kB 00:00 2024-09-12T00:25:37.275 INFO:teuthology.orchestra.run.smithi073.stdout:(277/285): python3-webob-1.8.8-2.el9.noarch.rpm 3.4 MB/s | 230 kB 00:00 2024-09-12T00:25:37.325 INFO:teuthology.orchestra.run.smithi073.stdout:(278/285): python3-grpcio-1.46.7-10.el9.x86_64. 3.3 MB/s | 2.0 MB 00:00 2024-09-12T00:25:37.359 INFO:teuthology.orchestra.run.smithi073.stdout:(279/285): python3-zc-lockfile-2.0-10.el9.noarc 239 kB/s | 20 kB 00:00 2024-09-12T00:25:37.384 INFO:teuthology.orchestra.run.smithi073.stdout:(280/285): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-12T00:25:37.409 INFO:teuthology.orchestra.run.smithi073.stdout:(281/285): s3cmd-2.4.0-1.el9.noarch.rpm 4.0 MB/s | 206 kB 00:00 2024-09-12T00:25:37.434 INFO:teuthology.orchestra.run.smithi073.stdout:(282/285): python3-werkzeug-2.0.3-3.el9.1.noarc 2.3 MB/s | 427 kB 00:00 2024-09-12T00:25:37.477 INFO:teuthology.orchestra.run.smithi073.stdout:(283/285): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-12T00:25:37.685 INFO:teuthology.orchestra.run.smithi073.stdout:(284/285): librados2-19.3.0-4753.gd011c522.el9. 13 MB/s | 3.5 MB 00:00 2024-09-12T00:25:37.827 INFO:teuthology.orchestra.run.smithi073.stdout:(285/285): librbd1-19.3.0-4753.gd011c522.el9.x8 8.3 MB/s | 3.2 MB 00:00 2024-09-12T00:25:37.833 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-12T00:25:37.834 INFO:teuthology.orchestra.run.smithi073.stdout:Total 17 MB/s | 327 MB 00:19 2024-09-12T00:25:38.413 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-09-12T00:25:38.594 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-09-12T00:25:38.594 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-09-12T00:25:41.004 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-12T00:25:41.185 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-12T00:25:41.185 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-12T00:25:41.770 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-09-12T00:25:41.770 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-09-12T00:25:44.372 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-12T00:25:44.373 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-12T00:25:51.957 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-09-12T00:25:52.119 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 1/1 2024-09-12T00:25:52.272 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-09-12T00:25:52.359 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/287 2024-09-12T00:25:52.390 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/287 2024-09-12T00:25:52.465 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/287 2024-09-12T00:25:52.513 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : alsa-lib-1.2.12-1.el9.x86_64 4/287 2024-09-12T00:25:52.567 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/287 2024-09-12T00:25:52.609 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/287 2024-09-12T00:25:52.689 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/287 2024-09-12T00:25:52.815 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/287 2024-09-12T00:25:53.157 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/287 2024-09-12T00:25:53.269 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : librados2-2:19.3.0-4753.gd011c522.el9.x86_64 10/287 2024-09-12T00:25:53.400 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librados2-2:19.3.0-4753.gd011c522.el9.x86_64 10/287 2024-09-12T00:25:53.445 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 11/287 2024-09-12T00:25:53.538 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 11/287 2024-09-12T00:25:53.565 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rados-2:19.3.0-4753.gd011c522.el9.x86_64 12/287 2024-09-12T00:25:53.613 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/287 2024-09-12T00:25:53.642 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/287 2024-09-12T00:25:53.668 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/287 2024-09-12T00:25:53.694 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/287 2024-09-12T00:25:53.725 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/287 2024-09-12T00:25:53.751 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/287 2024-09-12T00:25:53.779 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libX11-xcb-1.7.0-9.el9.x86_64 19/287 2024-09-12T00:25:53.922 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : lcms2-2.12-3.el9.x86_64 20/287 2024-09-12T00:25:54.057 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 21/287 2024-09-12T00:25:54.093 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : atk-2.36.0-5.el9.x86_64 22/287 2024-09-12T00:25:54.129 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 23/287 2024-09-12T00:25:54.157 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 24/287 2024-09-12T00:25:54.261 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 24/287 2024-09-12T00:25:54.284 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86 25/287 2024-09-12T00:25:54.339 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86 25/287 2024-09-12T00:25:54.371 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 26/287 2024-09-12T00:25:54.394 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 27/287 2024-09-12T00:25:54.416 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 27/287 2024-09-12T00:25:54.588 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 28/287 2024-09-12T00:25:54.597 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-09-12T00:25:54.622 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 28/287 2024-09-12T00:25:54.732 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : re2-1:20211101-20.el9.x86_64 29/287 2024-09-12T00:25:54.752 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 1/1 2024-09-12T00:25:54.770 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 30/287 2024-09-12T00:25:54.805 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : liboath-2.6.7-2.el9.x86_64 31/287 2024-09-12T00:25:54.870 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 32/287 2024-09-12T00:25:54.907 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-12T00:25:54.933 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 33/287 2024-09-12T00:25:54.972 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-packaging-20.9-5.el9.noarch 34/287 2024-09-12T00:25:54.997 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/287 2024-09-12T00:25:55.015 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/287 2024-09-12T00:25:55.039 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/287 2024-09-12T00:25:55.056 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/287 2024-09-12T00:25:55.066 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 37/287 2024-09-12T00:25:55.092 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 38/287 2024-09-12T00:25:55.117 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 39/287 2024-09-12T00:25:55.132 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/287 2024-09-12T00:25:55.146 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libtool-ltdl-2.4.6-46.el9.x86_64 40/287 2024-09-12T00:25:55.176 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : alsa-lib-1.2.12-1.el9.x86_64 4/287 2024-09-12T00:25:55.178 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 41/287 2024-09-12T00:25:55.202 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 42/287 2024-09-12T00:25:55.232 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/287 2024-09-12T00:25:55.253 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 43/287 2024-09-12T00:25:55.274 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/287 2024-09-12T00:25:55.292 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : dconf-0.40.0-6.el9.x86_64 44/287 2024-09-12T00:25:55.300 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/287 2024-09-12T00:25:55.346 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/287 2024-09-12T00:25:55.361 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 44/287 2024-09-12T00:25:55.420 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 45/287 2024-09-12T00:25:55.449 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 46/287 2024-09-12T00:25:55.501 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 47/287 2024-09-12T00:25:55.537 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 48/287 2024-09-12T00:25:55.569 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : fuse-2.9.9-16.el9.x86_64 49/287 2024-09-12T00:25:55.647 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cups-libs-1:2.3.3op2-30.el9.x86_64 50/287 2024-09-12T00:25:55.680 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-ceph-common-2:19.3.0-4753.gd011c522.el9. 51/287 2024-09-12T00:25:55.686 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/287 2024-09-12T00:25:55.723 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-ceph-argparse-2:19.3.0-4753.gd011c522.el 52/287 2024-09-12T00:25:55.765 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cephfs-2:19.3.0-4753.gd011c522.el9.x86_6 53/287 2024-09-12T00:25:55.809 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : librados2-2:19.3.0-4753.gd011c522.el9.x86_64 10/287 2024-09-12T00:25:55.849 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 54/287 2024-09-12T00:25:55.935 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados2-2:19.3.0-4753.gd011c522.el9.x86_64 10/287 2024-09-12T00:25:55.960 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 11/287 2024-09-12T00:25:55.993 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 55/287 2024-09-12T00:25:56.043 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 56/287 2024-09-12T00:25:56.054 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 11/287 2024-09-12T00:25:56.082 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rados-2:19.3.0-4753.gd011c522.el9.x86_64 12/287 2024-09-12T00:25:56.135 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/287 2024-09-12T00:25:56.175 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/287 2024-09-12T00:25:56.201 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/287 2024-09-12T00:25:56.226 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/287 2024-09-12T00:25:56.267 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/287 2024-09-12T00:25:56.292 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/287 2024-09-12T00:25:56.320 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libX11-xcb-1.7.0-9.el9.x86_64 19/287 2024-09-12T00:25:56.466 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lcms2-2.12-3.el9.x86_64 20/287 2024-09-12T00:25:56.587 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rsa-4.9-2.el9.noarch 57/287 2024-09-12T00:25:56.595 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 21/287 2024-09-12T00:25:56.634 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : atk-2.36.0-5.el9.x86_64 22/287 2024-09-12T00:25:56.681 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 58/287 2024-09-12T00:25:56.690 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 23/287 2024-09-12T00:25:56.717 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 59/287 2024-09-12T00:25:56.718 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 24/287 2024-09-12T00:25:56.787 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 60/287 2024-09-12T00:25:56.824 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 24/287 2024-09-12T00:25:56.831 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 61/287 2024-09-12T00:25:56.853 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86 25/287 2024-09-12T00:25:56.867 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 62/287 2024-09-12T00:25:56.897 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 63/287 2024-09-12T00:25:56.916 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86 25/287 2024-09-12T00:25:56.941 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 26/287 2024-09-12T00:25:56.963 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 27/287 2024-09-12T00:25:56.967 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 64/287 2024-09-12T00:25:56.989 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 27/287 2024-09-12T00:25:56.999 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : luarocks-3.9.2-5.el9.noarch 65/287 2024-09-12T00:25:57.024 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 66/287 2024-09-12T00:25:57.060 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 67/287 2024-09-12T00:25:57.097 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librados-devel-2:19.3.0-4753.gd011c522.el9.x86_6 68/287 2024-09-12T00:25:57.130 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 69/287 2024-09-12T00:25:57.162 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 70/287 2024-09-12T00:25:57.183 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 28/287 2024-09-12T00:25:57.204 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 71/287 2024-09-12T00:25:57.222 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 28/287 2024-09-12T00:25:57.262 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 72/287 2024-09-12T00:25:57.297 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 73/287 2024-09-12T00:25:57.332 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : re2-1:20211101-20.el9.x86_64 29/287 2024-09-12T00:25:57.334 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 74/287 2024-09-12T00:25:57.361 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 30/287 2024-09-12T00:25:57.396 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : liboath-2.6.7-2.el9.x86_64 31/287 2024-09-12T00:25:57.427 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 75/287 2024-09-12T00:25:57.469 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 32/287 2024-09-12T00:25:57.491 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 76/287 2024-09-12T00:25:57.514 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 33/287 2024-09-12T00:25:57.555 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-packaging-20.9-5.el9.noarch 34/287 2024-09-12T00:25:57.563 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 77/287 2024-09-12T00:25:57.596 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 78/287 2024-09-12T00:25:57.597 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/287 2024-09-12T00:25:57.631 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/287 2024-09-12T00:25:57.632 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 79/287 2024-09-12T00:25:57.658 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 37/287 2024-09-12T00:25:57.679 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 80/287 2024-09-12T00:25:57.683 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 38/287 2024-09-12T00:25:57.708 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 39/287 2024-09-12T00:25:57.725 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 81/287 2024-09-12T00:25:57.737 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libtool-ltdl-2.4.6-46.el9.x86_64 40/287 2024-09-12T00:25:57.766 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 82/287 2024-09-12T00:25:57.769 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 41/287 2024-09-12T00:25:57.794 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 42/287 2024-09-12T00:25:57.836 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 43/287 2024-09-12T00:25:57.867 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : dconf-0.40.0-6.el9.x86_64 44/287 2024-09-12T00:25:57.906 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 83/287 2024-09-12T00:25:57.936 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 44/287 2024-09-12T00:25:57.960 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 84/287 2024-09-12T00:25:57.993 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 45/287 2024-09-12T00:25:58.001 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 85/287 2024-09-12T00:25:58.032 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 46/287 2024-09-12T00:25:58.092 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 47/287 2024-09-12T00:25:58.106 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 86/287 2024-09-12T00:25:58.136 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 48/287 2024-09-12T00:25:58.143 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 87/287 2024-09-12T00:25:58.178 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : fuse-2.9.9-16.el9.x86_64 49/287 2024-09-12T00:25:58.184 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 88/287 2024-09-12T00:25:58.217 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 89/287 2024-09-12T00:25:58.241 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 90/287 2024-09-12T00:25:58.255 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cups-libs-1:2.3.3op2-30.el9.x86_64 50/287 2024-09-12T00:25:58.289 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ceph-common-2:19.3.0-4753.gd011c522.el9. 51/287 2024-09-12T00:25:58.325 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 91/287 2024-09-12T00:25:58.332 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ceph-argparse-2:19.3.0-4753.gd011c522.el 52/287 2024-09-12T00:25:58.374 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cephfs-2:19.3.0-4753.gd011c522.el9.x86_6 53/287 2024-09-12T00:25:58.453 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 92/287 2024-09-12T00:25:58.475 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 54/287 2024-09-12T00:25:58.502 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 93/287 2024-09-12T00:25:58.608 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 55/287 2024-09-12T00:25:58.660 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 56/287 2024-09-12T00:25:58.705 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 94/287 2024-09-12T00:25:58.745 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 95/287 2024-09-12T00:25:58.776 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 96/287 2024-09-12T00:25:58.806 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 97/287 2024-09-12T00:25:58.848 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 98/287 2024-09-12T00:25:58.876 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : upower-0.99.11-11.el9.x86_64 99/287 2024-09-12T00:25:58.890 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 99/287 2024-09-12T00:25:58.890 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-09-12T00:25:58.890 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T00:25:59.089 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : tzdata-java-2024a-2.el9.noarch 100/287 2024-09-12T00:25:59.170 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 101/287 2024-09-12T00:25:59.197 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rsa-4.9-2.el9.noarch 57/287 2024-09-12T00:25:59.233 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 102/287 2024-09-12T00:25:59.258 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 103/287 2024-09-12T00:25:59.283 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 103/287 2024-09-12T00:25:59.298 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 58/287 2024-09-12T00:25:59.309 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 104/287 2024-09-12T00:25:59.335 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 59/287 2024-09-12T00:25:59.405 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 60/287 2024-09-12T00:25:59.449 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 61/287 2024-09-12T00:25:59.485 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 62/287 2024-09-12T00:25:59.514 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 63/287 2024-09-12T00:25:59.585 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 64/287 2024-09-12T00:25:59.626 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : luarocks-3.9.2-5.el9.noarch 65/287 2024-09-12T00:25:59.667 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 66/287 2024-09-12T00:25:59.702 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 67/287 2024-09-12T00:25:59.740 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librados-devel-2:19.3.0-4753.gd011c522.el9.x86_6 68/287 2024-09-12T00:25:59.752 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T00:25:59.773 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 69/287 2024-09-12T00:25:59.779 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T00:25:59.794 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T00:25:59.794 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-09-12T00:25:59.794 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T00:25:59.806 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 70/287 2024-09-12T00:25:59.835 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 106/287 2024-09-12T00:25:59.847 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 71/287 2024-09-12T00:25:59.869 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 107/287 2024-09-12T00:25:59.905 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 72/287 2024-09-12T00:25:59.912 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 108/287 2024-09-12T00:25:59.940 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 73/287 2024-09-12T00:25:59.965 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 109/287 2024-09-12T00:25:59.977 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 74/287 2024-09-12T00:25:59.996 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 110/287 2024-09-12T00:26:00.070 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 75/287 2024-09-12T00:26:00.085 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 111/287 2024-09-12T00:26:00.141 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 76/287 2024-09-12T00:26:00.144 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 112/287 2024-09-12T00:26:00.183 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 113/287 2024-09-12T00:26:00.214 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 77/287 2024-09-12T00:26:00.246 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 78/287 2024-09-12T00:26:00.282 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 79/287 2024-09-12T00:26:00.289 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 114/287 2024-09-12T00:26:00.329 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 80/287 2024-09-12T00:26:00.351 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 115/287 2024-09-12T00:26:00.374 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 81/287 2024-09-12T00:26:00.416 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 82/287 2024-09-12T00:26:00.564 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 83/287 2024-09-12T00:26:00.609 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 84/287 2024-09-12T00:26:00.651 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 85/287 2024-09-12T00:26:00.754 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 86/287 2024-09-12T00:26:00.793 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 87/287 2024-09-12T00:26:00.834 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 88/287 2024-09-12T00:26:00.875 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 89/287 2024-09-12T00:26:00.928 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 90/287 2024-09-12T00:26:01.020 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 91/287 2024-09-12T00:26:01.107 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 116/287 2024-09-12T00:26:01.152 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 92/287 2024-09-12T00:26:01.164 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 117/287 2024-09-12T00:26:01.194 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 93/287 2024-09-12T00:26:01.197 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 118/287 2024-09-12T00:26:01.299 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 119/287 2024-09-12T00:26:01.338 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 120/287 2024-09-12T00:26:01.403 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 94/287 2024-09-12T00:26:01.454 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 95/287 2024-09-12T00:26:01.485 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 96/287 2024-09-12T00:26:01.515 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 97/287 2024-09-12T00:26:01.525 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 121/287 2024-09-12T00:26:01.564 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 98/287 2024-09-12T00:26:01.570 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 122/287 2024-09-12T00:26:01.601 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : upower-0.99.11-11.el9.x86_64 99/287 2024-09-12T00:26:01.615 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 99/287 2024-09-12T00:26:01.615 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-09-12T00:26:01.615 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:26:01.619 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : p11-kit-server-0.25.3-2.el9.x86_64 123/287 2024-09-12T00:26:01.824 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : tzdata-java-2024a-2.el9.noarch 100/287 2024-09-12T00:26:01.907 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 101/287 2024-09-12T00:26:01.958 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 102/287 2024-09-12T00:26:01.991 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 103/287 2024-09-12T00:26:02.017 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 103/287 2024-09-12T00:26:02.043 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 104/287 2024-09-12T00:26:02.124 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 124/287 2024-09-12T00:26:02.187 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : osinfo-db-20240701-2.el9.noarch 125/287 2024-09-12T00:26:02.224 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 126/287 2024-09-12T00:26:02.258 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : orc-0.4.31-8.el9.x86_64 127/287 2024-09-12T00:26:02.291 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 128/287 2024-09-12T00:26:02.475 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : openblas-0.3.26-2.el9.x86_64 129/287 2024-09-12T00:26:02.501 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T00:26:02.505 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 130/287 2024-09-12T00:26:02.530 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T00:26:02.544 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T00:26:02.544 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-09-12T00:26:02.544 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:26:02.583 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 131/287 2024-09-12T00:26:02.588 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 106/287 2024-09-12T00:26:02.623 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 107/287 2024-09-12T00:26:02.656 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 108/287 2024-09-12T00:26:02.697 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 109/287 2024-09-12T00:26:02.732 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 110/287 2024-09-12T00:26:02.821 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 111/287 2024-09-12T00:26:02.871 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 112/287 2024-09-12T00:26:02.910 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 113/287 2024-09-12T00:26:03.017 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 114/287 2024-09-12T00:26:03.071 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 115/287 2024-09-12T00:26:03.255 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 132/287 2024-09-12T00:26:03.380 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 133/287 2024-09-12T00:26:03.811 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 116/287 2024-09-12T00:26:03.867 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 117/287 2024-09-12T00:26:03.901 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 118/287 2024-09-12T00:26:04.003 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 119/287 2024-09-12T00:26:04.056 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 120/287 2024-09-12T00:26:04.243 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 121/287 2024-09-12T00:26:04.316 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 122/287 2024-09-12T00:26:04.365 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : p11-kit-server-0.25.3-2.el9.x86_64 123/287 2024-09-12T00:26:04.648 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 134/287 2024-09-12T00:26:04.724 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 135/287 2024-09-12T00:26:04.780 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : mesa-filesystem-24.1.2-3.el9.x86_64 136/287 2024-09-12T00:26:04.818 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : lua-posix-35.0-8.el9.x86_64 137/287 2024-09-12T00:26:04.846 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 138/287 2024-09-12T00:26:04.875 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 139/287 2024-09-12T00:26:04.880 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 124/287 2024-09-12T00:26:04.888 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 139/287 2024-09-12T00:26:04.888 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-09-12T00:26:04.888 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T00:26:04.942 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 140/287 2024-09-12T00:26:04.951 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : osinfo-db-20240701-2.el9.noarch 125/287 2024-09-12T00:26:04.971 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 141/287 2024-09-12T00:26:04.986 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 126/287 2024-09-12T00:26:04.999 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libsbc-1.4-9.el9.x86_64 142/287 2024-09-12T00:26:05.028 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : orc-0.4.31-8.el9.x86_64 127/287 2024-09-12T00:26:05.069 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 128/287 2024-09-12T00:26:05.254 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openblas-0.3.26-2.el9.x86_64 129/287 2024-09-12T00:26:05.292 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 130/287 2024-09-12T00:26:05.325 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 143/287 2024-09-12T00:26:05.370 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 144/287 2024-09-12T00:26:05.379 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 131/287 2024-09-12T00:26:05.470 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 144/287 2024-09-12T00:26:05.502 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rbd-2:19.3.0-4753.gd011c522.el9.x86_64 145/287 2024-09-12T00:26:05.534 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 146/287 2024-09-12T00:26:05.564 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 147/287 2024-09-12T00:26:05.626 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libiptcdata-1.0.5-10.el9.x86_64 148/287 2024-09-12T00:26:05.663 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 149/287 2024-09-12T00:26:05.688 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 150/287 2024-09-12T00:26:05.733 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 151/287 2024-09-12T00:26:05.761 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/287 2024-09-12T00:26:06.022 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/287 2024-09-12T00:26:06.053 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 132/287 2024-09-12T00:26:06.063 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libexif-0.6.22-6.el9.x86_64 153/287 2024-09-12T00:26:06.091 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 154/287 2024-09-12T00:26:06.125 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libasyncns-0.8-22.el9.x86_64 155/287 2024-09-12T00:26:06.151 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 156/287 2024-09-12T00:26:06.168 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 133/287 2024-09-12T00:26:06.176 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libXv-1.0.11-16.el9.x86_64 157/287 2024-09-12T00:26:06.201 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 158/287 2024-09-12T00:26:06.229 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 159/287 2024-09-12T00:26:06.257 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 160/287 2024-09-12T00:26:06.301 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libtiff-4.4.0-13.el9.x86_64 161/287 2024-09-12T00:26:06.332 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 162/287 2024-09-12T00:26:06.380 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 163/287 2024-09-12T00:26:06.407 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : poppler-21.01.0-21.el9.x86_64 164/287 2024-09-12T00:26:06.873 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : poppler-glib-21.01.0-21.el9.x86_64 165/287 2024-09-12T00:26:07.008 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 166/287 2024-09-12T00:26:07.056 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 167/287 2024-09-12T00:26:07.081 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : gtk-update-icon-cache-3.24.31-5.el9.x86_64 168/287 2024-09-12T00:26:07.109 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : gsm-1.0.19-6.el9.x86_64 169/287 2024-09-12T00:26:07.185 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 170/287 2024-09-12T00:26:07.242 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 171/287 2024-09-12T00:26:07.274 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcanberra-0.30-27.el9.x86_64 172/287 2024-09-12T00:26:07.296 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 172/287 2024-09-12T00:26:07.328 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : graphene-1.10.6-2.el9.x86_64 173/287 2024-09-12T00:26:07.354 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : giflib-5.2.1-9.el9.x86_64 174/287 2024-09-12T00:26:07.393 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flatpak-session-helper-1.12.9-1.el9.x86_64 175/287 2024-09-12T00:26:07.418 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flatpak-selinux-1.12.9-1.el9.noarch 176/287 2024-09-12T00:26:07.461 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 134/287 2024-09-12T00:26:07.554 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 135/287 2024-09-12T00:26:07.611 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : mesa-filesystem-24.1.2-3.el9.x86_64 136/287 2024-09-12T00:26:07.647 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lua-posix-35.0-8.el9.x86_64 137/287 2024-09-12T00:26:07.674 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 138/287 2024-09-12T00:26:07.713 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 139/287 2024-09-12T00:26:07.725 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 139/287 2024-09-12T00:26:07.725 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-09-12T00:26:07.725 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:26:07.798 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 140/287 2024-09-12T00:26:07.825 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 141/287 2024-09-12T00:26:07.853 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libsbc-1.4-9.el9.x86_64 142/287 2024-09-12T00:26:08.177 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 143/287 2024-09-12T00:26:08.224 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 144/287 2024-09-12T00:26:08.325 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 144/287 2024-09-12T00:26:08.357 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rbd-2:19.3.0-4753.gd011c522.el9.x86_64 145/287 2024-09-12T00:26:08.389 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 146/287 2024-09-12T00:26:08.418 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 147/287 2024-09-12T00:26:08.478 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libiptcdata-1.0.5-10.el9.x86_64 148/287 2024-09-12T00:26:08.509 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 149/287 2024-09-12T00:26:08.568 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 150/287 2024-09-12T00:26:08.610 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 151/287 2024-09-12T00:26:08.632 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/287 2024-09-12T00:26:08.891 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/287 2024-09-12T00:26:08.951 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libexif-0.6.22-6.el9.x86_64 153/287 2024-09-12T00:26:08.980 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 154/287 2024-09-12T00:26:09.004 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libasyncns-0.8-22.el9.x86_64 155/287 2024-09-12T00:26:09.039 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 156/287 2024-09-12T00:26:09.064 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libXv-1.0.11-16.el9.x86_64 157/287 2024-09-12T00:26:09.089 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 158/287 2024-09-12T00:26:09.117 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 159/287 2024-09-12T00:26:09.153 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 160/287 2024-09-12T00:26:09.198 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libtiff-4.4.0-13.el9.x86_64 161/287 2024-09-12T00:26:09.229 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 162/287 2024-09-12T00:26:09.276 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 163/287 2024-09-12T00:26:09.303 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : poppler-21.01.0-21.el9.x86_64 164/287 2024-09-12T00:26:09.761 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : poppler-glib-21.01.0-21.el9.x86_64 165/287 2024-09-12T00:26:09.897 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 166/287 2024-09-12T00:26:09.953 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 167/287 2024-09-12T00:26:09.978 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : gtk-update-icon-cache-3.24.31-5.el9.x86_64 168/287 2024-09-12T00:26:10.006 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : gsm-1.0.19-6.el9.x86_64 169/287 2024-09-12T00:26:10.074 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 170/287 2024-09-12T00:26:10.123 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 171/287 2024-09-12T00:26:10.154 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcanberra-0.30-27.el9.x86_64 172/287 2024-09-12T00:26:10.174 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 172/287 2024-09-12T00:26:10.200 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : graphene-1.10.6-2.el9.x86_64 173/287 2024-09-12T00:26:10.226 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : giflib-5.2.1-9.el9.x86_64 174/287 2024-09-12T00:26:10.262 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flatpak-session-helper-1.12.9-1.el9.x86_64 175/287 2024-09-12T00:26:10.290 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flatpak-selinux-1.12.9-1.el9.noarch 176/287 2024-09-12T00:26:19.190 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: flatpak-selinux-1.12.9-1.el9.noarch 176/287 2024-09-12T00:26:19.233 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 177/287 2024-09-12T00:26:19.262 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 178/287 2024-09-12T00:26:19.302 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : composefs-libs-1.0.5-1.el9.x86_64 179/287 2024-09-12T00:26:19.336 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ostree-libs-2024.7-2.el9.x86_64 180/287 2024-09-12T00:26:19.372 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 181/287 2024-09-12T00:26:19.868 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 182/287 2024-09-12T00:26:19.893 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 183/287 2024-09-12T00:26:19.973 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 183/287 2024-09-12T00:26:20.011 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rgw-2:19.3.0-4753.gd011c522.el9.x86_64 184/287 2024-09-12T00:26:22.077 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: flatpak-selinux-1.12.9-1.el9.noarch 176/287 2024-09-12T00:26:22.149 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 177/287 2024-09-12T00:26:22.186 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 178/287 2024-09-12T00:26:22.225 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : composefs-libs-1.0.5-1.el9.x86_64 179/287 2024-09-12T00:26:22.260 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ostree-libs-2024.7-2.el9.x86_64 180/287 2024-09-12T00:26:22.296 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 181/287 2024-09-12T00:26:22.406 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 185/287 2024-09-12T00:26:22.444 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 185/287 2024-09-12T00:26:22.825 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 182/287 2024-09-12T00:26:22.851 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 183/287 2024-09-12T00:26:22.939 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 183/287 2024-09-12T00:26:22.970 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rgw-2:19.3.0-4753.gd011c522.el9.x86_64 184/287 2024-09-12T00:26:23.013 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 185/287 2024-09-12T00:26:23.048 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 186/287 2024-09-12T00:26:23.139 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 186/287 2024-09-12T00:26:23.140 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T00:26:23.140 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T00:26:23.140 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T00:26:23.174 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 187/287 2024-09-12T00:26:25.347 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 185/287 2024-09-12T00:26:25.386 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 185/287 2024-09-12T00:26:25.943 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 185/287 2024-09-12T00:26:25.989 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 186/287 2024-09-12T00:26:26.081 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 186/287 2024-09-12T00:26:26.081 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T00:26:26.081 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T00:26:26.081 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:26:26.115 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 187/287 2024-09-12T00:26:32.374 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 187/287 2024-09-12T00:26:32.374 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /sys 2024-09-12T00:26:32.375 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /proc 2024-09-12T00:26:32.375 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /mnt 2024-09-12T00:26:32.375 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /var/tmp 2024-09-12T00:26:32.375 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /home 2024-09-12T00:26:32.375 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /root 2024-09-12T00:26:32.375 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /tmp 2024-09-12T00:26:32.375 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T00:26:32.548 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 188/287 2024-09-12T00:26:32.564 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 188/287 2024-09-12T00:26:32.564 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:26:32.564 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T00:26:32.564 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T00:26:34.015 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 189/287 2024-09-12T00:26:34.043 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 189/287 2024-09-12T00:26:34.043 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:26:34.043 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T00:26:34.043 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T00:26:34.043 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T00:26:34.043 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T00:26:34.266 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 190/287 2024-09-12T00:26:34.290 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 190/287 2024-09-12T00:26:34.290 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:26:34.290 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T00:26:34.291 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T00:26:34.291 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T00:26:34.291 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T00:26:34.750 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 191/287 2024-09-12T00:26:34.773 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 191/287 2024-09-12T00:26:34.774 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:26:34.774 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T00:26:34.774 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T00:26:34.774 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T00:26:34.774 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T00:26:34.876 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : avahi-glib-0.8-21.el9.x86_64 192/287 2024-09-12T00:26:35.345 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 187/287 2024-09-12T00:26:35.345 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /sys 2024-09-12T00:26:35.345 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /proc 2024-09-12T00:26:35.345 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /mnt 2024-09-12T00:26:35.345 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /var/tmp 2024-09-12T00:26:35.345 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /home 2024-09-12T00:26:35.345 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /root 2024-09-12T00:26:35.345 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /tmp 2024-09-12T00:26:35.345 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:26:35.515 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 188/287 2024-09-12T00:26:35.530 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 188/287 2024-09-12T00:26:35.530 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:26:35.531 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T00:26:35.531 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:26:36.982 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 189/287 2024-09-12T00:26:37.009 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 189/287 2024-09-12T00:26:37.009 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:26:37.009 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T00:26:37.009 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T00:26:37.009 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T00:26:37.009 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:26:37.233 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 190/287 2024-09-12T00:26:37.257 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 190/287 2024-09-12T00:26:37.257 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:26:37.257 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T00:26:37.257 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T00:26:37.257 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T00:26:37.257 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:26:37.723 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 193/287 2024-09-12T00:26:37.742 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 191/287 2024-09-12T00:26:37.765 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 191/287 2024-09-12T00:26:37.765 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:26:37.765 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T00:26:37.765 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T00:26:37.765 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T00:26:37.765 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:26:37.826 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 194/287 2024-09-12T00:26:37.869 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : avahi-glib-0.8-21.el9.x86_64 192/287 2024-09-12T00:26:37.882 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-ply-3.11-14.el9.noarch 195/287 2024-09-12T00:26:37.939 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 196/287 2024-09-12T00:26:38.134 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 197/287 2024-09-12T00:26:38.179 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 198/287 2024-09-12T00:26:38.257 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 199/287 2024-09-12T00:26:38.347 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 200/287 2024-09-12T00:26:38.487 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 201/287 2024-09-12T00:26:38.529 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 202/287 2024-09-12T00:26:38.563 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 203/287 2024-09-12T00:26:39.423 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 204/287 2024-09-12T00:26:39.469 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/287 2024-09-12T00:26:39.823 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/287 2024-09-12T00:26:39.858 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 206/287 2024-09-12T00:26:39.890 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : slf4j-1.7.30-13.el9.noarch 207/287 2024-09-12T00:26:39.917 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : atinject-1.0.3-6.el9.noarch 208/287 2024-09-12T00:26:39.952 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 209/287 2024-09-12T00:26:39.980 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 210/287 2024-09-12T00:26:40.008 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 211/287 2024-09-12T00:26:40.034 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 212/287 2024-09-12T00:26:40.060 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 213/287 2024-09-12T00:26:40.087 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 214/287 2024-09-12T00:26:40.110 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 215/287 2024-09-12T00:26:40.136 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 216/287 2024-09-12T00:26:40.163 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 217/287 2024-09-12T00:26:40.193 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 218/287 2024-09-12T00:26:40.221 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 219/287 2024-09-12T00:26:40.256 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 220/287 2024-09-12T00:26:40.291 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 221/287 2024-09-12T00:26:40.322 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 222/287 2024-09-12T00:26:40.356 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 223/287 2024-09-12T00:26:40.391 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : jansi-2.3.3-6.el9.x86_64 224/287 2024-09-12T00:26:40.427 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : jsoup-1.13.1-10.el9.noarch 225/287 2024-09-12T00:26:40.466 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 226/287 2024-09-12T00:26:40.508 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 227/287 2024-09-12T00:26:40.552 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 228/287 2024-09-12T00:26:40.585 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : guava-30.1-6.el9.noarch 229/287 2024-09-12T00:26:40.608 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : google-guice-4.2.3-9.el9.noarch 230/287 2024-09-12T00:26:40.660 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 231/287 2024-09-12T00:26:40.693 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 232/287 2024-09-12T00:26:40.723 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 193/287 2024-09-12T00:26:40.723 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libpciaccess-0.16-7.el9.x86_64 233/287 2024-09-12T00:26:40.752 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libdrm-2.4.121-1.el9.x86_64 234/287 2024-09-12T00:26:40.786 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 235/287 2024-09-12T00:26:40.826 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 194/287 2024-09-12T00:26:40.883 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ply-3.11-14.el9.noarch 195/287 2024-09-12T00:26:40.940 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 196/287 2024-09-12T00:26:40.955 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : mesa-libglapi-24.1.2-3.el9.x86_64 236/287 2024-09-12T00:26:40.987 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : mesa-dri-drivers-24.1.2-3.el9.x86_64 237/287 2024-09-12T00:26:41.013 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : mesa-libgbm-24.1.2-3.el9.x86_64 238/287 2024-09-12T00:26:41.041 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : mesa-libEGL-24.1.2-3.el9.x86_64 239/287 2024-09-12T00:26:41.073 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 240/287 2024-09-12T00:26:41.133 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 197/287 2024-09-12T00:26:41.188 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 198/287 2024-09-12T00:26:41.198 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : mesa-libGL-24.1.2-3.el9.x86_64 241/287 2024-09-12T00:26:41.263 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 242/287 2024-09-12T00:26:41.267 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 199/287 2024-09-12T00:26:41.347 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 243/287 2024-09-12T00:26:41.355 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 200/287 2024-09-12T00:26:41.386 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : tracker-3.1.2-3.el9.x86_64 244/287 2024-09-12T00:26:41.494 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 244/287 2024-09-12T00:26:41.505 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 201/287 2024-09-12T00:26:41.535 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 245/287 2024-09-12T00:26:41.550 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 245/287 2024-09-12T00:26:41.551 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 202/287 2024-09-12T00:26:41.580 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : bubblewrap-0.4.1-7.el9.x86_64 246/287 2024-09-12T00:26:41.589 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 203/287 2024-09-12T00:26:41.603 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : bluez-libs-5.56-6.el9.x86_64 247/287 2024-09-12T00:26:42.016 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T00:26:42.044 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T00:26:42.063 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T00:26:42.064 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-09-12T00:26:42.064 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T00:26:42.291 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 249/287 2024-09-12T00:26:42.361 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 250/287 2024-09-12T00:26:42.407 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 251/287 2024-09-12T00:26:42.443 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 252/287 2024-09-12T00:26:42.452 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 204/287 2024-09-12T00:26:42.469 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 253/287 2024-09-12T00:26:42.495 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/287 2024-09-12T00:26:42.844 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/287 2024-09-12T00:26:42.885 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 206/287 2024-09-12T00:26:42.893 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T00:26:42.916 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : slf4j-1.7.30-13.el9.noarch 207/287 2024-09-12T00:26:42.923 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T00:26:42.939 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T00:26:42.943 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : atinject-1.0.3-6.el9.noarch 208/287 2024-09-12T00:26:42.979 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 209/287 2024-09-12T00:26:43.015 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 210/287 2024-09-12T00:26:43.051 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 211/287 2024-09-12T00:26:43.086 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 212/287 2024-09-12T00:26:43.111 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 213/287 2024-09-12T00:26:43.145 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 214/287 2024-09-12T00:26:43.171 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 215/287 2024-09-12T00:26:43.197 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 216/287 2024-09-12T00:26:43.223 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 217/287 2024-09-12T00:26:43.254 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 218/287 2024-09-12T00:26:43.282 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 219/287 2024-09-12T00:26:43.317 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 220/287 2024-09-12T00:26:43.353 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 221/287 2024-09-12T00:26:43.383 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 222/287 2024-09-12T00:26:43.420 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 223/287 2024-09-12T00:26:43.434 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: flatpak-1.12.9-1.el9.x86_64 255/287 2024-09-12T00:26:43.452 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : jansi-2.3.3-6.el9.x86_64 224/287 2024-09-12T00:26:43.489 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : jsoup-1.13.1-10.el9.noarch 225/287 2024-09-12T00:26:43.527 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 226/287 2024-09-12T00:26:43.535 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flatpak-1.12.9-1.el9.x86_64 255/287 2024-09-12T00:26:43.572 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 256/287 2024-09-12T00:26:43.578 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 227/287 2024-09-12T00:26:43.600 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 256/287 2024-09-12T00:26:43.631 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 228/287 2024-09-12T00:26:43.663 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : guava-30.1-6.el9.noarch 229/287 2024-09-12T00:26:43.686 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : google-guice-4.2.3-9.el9.noarch 230/287 2024-09-12T00:26:43.739 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 231/287 2024-09-12T00:26:43.772 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 232/287 2024-09-12T00:26:43.802 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libpciaccess-0.16-7.el9.x86_64 233/287 2024-09-12T00:26:43.804 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 257/287 2024-09-12T00:26:43.831 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libdrm-2.4.121-1.el9.x86_64 234/287 2024-09-12T00:26:43.856 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 235/287 2024-09-12T00:26:43.861 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : gtk3-3.24.31-5.el9.x86_64 258/287 2024-09-12T00:26:43.888 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/287 2024-09-12T00:26:43.910 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/287 2024-09-12T00:26:43.939 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 260/287 2024-09-12T00:26:44.003 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 260/287 2024-09-12T00:26:44.025 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : mesa-libglapi-24.1.2-3.el9.x86_64 236/287 2024-09-12T00:26:44.036 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 261/287 2024-09-12T00:26:44.044 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 261/287 2024-09-12T00:26:44.049 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : mesa-dri-drivers-24.1.2-3.el9.x86_64 237/287 2024-09-12T00:26:44.075 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : maven-1:3.6.3-15.el9.noarch 262/287 2024-09-12T00:26:44.084 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : mesa-libgbm-24.1.2-3.el9.x86_64 238/287 2024-09-12T00:26:44.089 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 262/287 2024-09-12T00:26:44.111 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : mesa-libEGL-24.1.2-3.el9.x86_64 239/287 2024-09-12T00:26:44.118 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 263/287 2024-09-12T00:26:44.143 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 240/287 2024-09-12T00:26:44.278 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : mesa-libGL-24.1.2-3.el9.x86_64 241/287 2024-09-12T00:26:44.343 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 242/287 2024-09-12T00:26:44.411 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 243/287 2024-09-12T00:26:44.440 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : tracker-3.1.2-3.el9.x86_64 244/287 2024-09-12T00:26:44.559 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 244/287 2024-09-12T00:26:44.560 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: cephadm-2:19.3.0-4753.gd011c522.el9.noarch 264/287 2024-09-12T00:26:44.590 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cephadm-2:19.3.0-4753.gd011c522.el9.noarch 264/287 2024-09-12T00:26:44.603 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 245/287 2024-09-12T00:26:44.623 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4753.gd011c522.e 265/287 2024-09-12T00:26:44.625 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 245/287 2024-09-12T00:26:44.665 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : bubblewrap-0.4.1-7.el9.x86_64 246/287 2024-09-12T00:26:44.688 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : bluez-libs-5.56-6.el9.x86_64 247/287 2024-09-12T00:26:44.690 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4753.gd011c522. 266/287 2024-09-12T00:26:44.714 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noa 267/287 2024-09-12T00:26:45.062 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T00:26:45.093 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T00:26:45.109 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T00:26:45.109 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-09-12T00:26:45.109 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:26:45.334 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 249/287 2024-09-12T00:26:45.404 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 250/287 2024-09-12T00:26:45.445 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 251/287 2024-09-12T00:26:45.490 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 252/287 2024-09-12T00:26:45.515 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 253/287 2024-09-12T00:26:45.873 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T00:26:45.911 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T00:26:45.928 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T00:26:46.396 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: flatpak-1.12.9-1.el9.x86_64 255/287 2024-09-12T00:26:46.473 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flatpak-1.12.9-1.el9.x86_64 255/287 2024-09-12T00:26:46.511 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 256/287 2024-09-12T00:26:46.541 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 256/287 2024-09-12T00:26:46.750 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 257/287 2024-09-12T00:26:46.809 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : gtk3-3.24.31-5.el9.x86_64 258/287 2024-09-12T00:26:46.844 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/287 2024-09-12T00:26:46.866 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/287 2024-09-12T00:26:46.895 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 260/287 2024-09-12T00:26:46.962 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 260/287 2024-09-12T00:26:46.998 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 261/287 2024-09-12T00:26:47.010 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 261/287 2024-09-12T00:26:47.040 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : maven-1:3.6.3-15.el9.noarch 262/287 2024-09-12T00:26:47.066 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 262/287 2024-09-12T00:26:47.100 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 263/287 2024-09-12T00:26:47.560 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: cephadm-2:19.3.0-4753.gd011c522.el9.noarch 264/287 2024-09-12T00:26:47.598 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cephadm-2:19.3.0-4753.gd011c522.el9.noarch 264/287 2024-09-12T00:26:47.631 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4753.gd011c522.e 265/287 2024-09-12T00:26:47.697 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4753.gd011c522. 266/287 2024-09-12T00:26:47.722 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noa 267/287 2024-09-12T00:26:47.897 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noa 267/287 2024-09-12T00:26:47.962 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.n 268/287 2024-09-12T00:26:48.917 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.n 268/287 2024-09-12T00:26:48.945 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4753.gd01 269/287 2024-09-12T00:26:49.060 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4753.gd01 269/287 2024-09-12T00:26:49.215 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4753.gd011c522.el 270/287 2024-09-12T00:26:49.247 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 271/287 2024-09-12T00:26:49.271 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 271/287 2024-09-12T00:26:49.272 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:26:49.272 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T00:26:49.272 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T00:26:49.272 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T00:26:49.272 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T00:26:49.323 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 272/287 2024-09-12T00:26:49.335 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 272/287 2024-09-12T00:26:49.357 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-2:19.3.0-4753.gd011c522.el9.x86_64 273/287 2024-09-12T00:26:49.386 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 274/287 2024-09-12T00:26:49.435 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 275/287 2024-09-12T00:26:49.458 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 276/287 2024-09-12T00:26:49.474 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 276/287 2024-09-12T00:26:49.474 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-09-12T00:26:49.474 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T00:26:50.426 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 277/287 2024-09-12T00:26:50.449 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 277/287 2024-09-12T00:26:50.449 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:26:50.449 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T00:26:50.449 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:26:50.449 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:26:50.449 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T00:26:50.501 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4753.gd011c 278/287 2024-09-12T00:26:50.525 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4753.gd011c 278/287 2024-09-12T00:26:50.525 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:26:50.525 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T00:26:50.526 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T00:26:50.835 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 279/287 2024-09-12T00:26:50.859 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 279/287 2024-09-12T00:26:50.859 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:26:50.859 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T00:26:50.859 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T00:26:50.860 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T00:26:50.860 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T00:26:50.938 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noa 267/287 2024-09-12T00:26:50.995 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.n 268/287 2024-09-12T00:26:51.963 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.n 268/287 2024-09-12T00:26:51.995 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4753.gd01 269/287 2024-09-12T00:26:52.111 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4753.gd01 269/287 2024-09-12T00:26:52.274 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4753.gd011c522.el 270/287 2024-09-12T00:26:52.314 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 271/287 2024-09-12T00:26:52.338 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 271/287 2024-09-12T00:26:52.338 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:26:52.338 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T00:26:52.338 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T00:26:52.338 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T00:26:52.338 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:26:52.398 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 272/287 2024-09-12T00:26:52.410 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 272/287 2024-09-12T00:26:52.450 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-2:19.3.0-4753.gd011c522.el9.x86_64 273/287 2024-09-12T00:26:52.479 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 274/287 2024-09-12T00:26:52.527 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 275/287 2024-09-12T00:26:52.559 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 276/287 2024-09-12T00:26:52.575 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 276/287 2024-09-12T00:26:52.575 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-09-12T00:26:52.575 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:26:53.535 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 277/287 2024-09-12T00:26:53.559 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 277/287 2024-09-12T00:26:53.559 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:26:53.559 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T00:26:53.559 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:26:53.559 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:26:53.559 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:26:53.602 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4753.gd011c 278/287 2024-09-12T00:26:53.625 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4753.gd011c 278/287 2024-09-12T00:26:53.625 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:26:53.625 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T00:26:53.625 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:26:53.936 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 279/287 2024-09-12T00:26:53.960 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 279/287 2024-09-12T00:26:53.960 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:26:53.960 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T00:26:53.960 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T00:26:53.960 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T00:26:53.961 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:26:55.539 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-test-2:19.3.0-4753.gd011c522.el9.x86_64 280/287 2024-09-12T00:26:55.580 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 281/287 2024-09-12T00:26:55.611 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-nbd-2:19.3.0-4753.gd011c522.el9.x86_64 282/287 2024-09-12T00:26:55.715 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephfs-devel-2:19.3.0-4753.gd011c522.el9.x86_ 283/287 2024-09-12T00:26:55.771 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 284/287 2024-09-12T00:26:55.802 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 285/287 2024-09-12T00:26:55.803 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 286/287 2024-09-12T00:26:55.886 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 286/287 2024-09-12T00:26:55.886 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:26:55.986 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:26:56.006 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 287/287 2024-09-12T00:26:56.013 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 287/287 2024-09-12T00:26:56.022 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 287/287 2024-09-12T00:26:56.033 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 287/287 2024-09-12T00:26:56.033 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-12T00:26:56.033 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-12T00:26:56.033 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T00:26:56.093 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 287/287 2024-09-12T00:26:56.161 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 287/287 2024-09-12T00:26:58.640 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-test-2:19.3.0-4753.gd011c522.el9.x86_64 280/287 2024-09-12T00:26:58.681 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 281/287 2024-09-12T00:26:58.713 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-nbd-2:19.3.0-4753.gd011c522.el9.x86_64 282/287 2024-09-12T00:26:58.818 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephfs-devel-2:19.3.0-4753.gd011c522.el9.x86_ 283/287 2024-09-12T00:26:58.873 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 284/287 2024-09-12T00:26:58.904 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 285/287 2024-09-12T00:26:58.904 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 286/287 2024-09-12T00:26:58.997 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 286/287 2024-09-12T00:26:59.000 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:26:59.088 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:26:59.114 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 287/287 2024-09-12T00:26:59.121 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 287/287 2024-09-12T00:26:59.129 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 287/287 2024-09-12T00:26:59.139 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 287/287 2024-09-12T00:26:59.140 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-12T00:26:59.140 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-12T00:26:59.140 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:26:59.195 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 287/287 2024-09-12T00:26:59.266 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 287/287 2024-09-12T00:27:06.271 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:27:06.271 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-2:19.3.0-4753.gd011c522.el9.x86_64 1/287 2024-09-12T00:27:06.271 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 2/287 2024-09-12T00:27:06.271 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 3/287 2024-09-12T00:27:06.272 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 4/287 2024-09-12T00:27:06.272 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4753.gd011c 5/287 2024-09-12T00:27:06.272 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 6/287 2024-09-12T00:27:06.272 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 7/287 2024-09-12T00:27:06.272 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 8/287 2024-09-12T00:27:06.272 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 9/287 2024-09-12T00:27:06.272 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 10/287 2024-09-12T00:27:06.272 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 11/287 2024-09-12T00:27:06.272 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-test-2:19.3.0-4753.gd011c522.el9.x86_64 12/287 2024-09-12T00:27:06.272 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephfs-devel-2:19.3.0-4753.gd011c522.el9.x86_ 13/287 2024-09-12T00:27:06.272 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 14/287 2024-09-12T00:27:06.273 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 15/287 2024-09-12T00:27:06.273 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados-devel-2:19.3.0-4753.gd011c522.el9.x86_6 16/287 2024-09-12T00:27:06.273 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86 17/287 2024-09-12T00:27:06.273 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 18/287 2024-09-12T00:27:06.273 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4753.gd011c522.el 19/287 2024-09-12T00:27:06.273 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-ceph-common-2:19.3.0-4753.gd011c522.el9. 20/287 2024-09-12T00:27:06.273 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cephfs-2:19.3.0-4753.gd011c522.el9.x86_6 21/287 2024-09-12T00:27:06.273 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rados-2:19.3.0-4753.gd011c522.el9.x86_64 22/287 2024-09-12T00:27:06.273 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rbd-2:19.3.0-4753.gd011c522.el9.x86_64 23/287 2024-09-12T00:27:06.273 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rgw-2:19.3.0-4753.gd011c522.el9.x86_64 24/287 2024-09-12T00:27:06.273 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 25/287 2024-09-12T00:27:06.273 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 26/287 2024-09-12T00:27:06.273 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-nbd-2:19.3.0-4753.gd011c522.el9.x86_64 27/287 2024-09-12T00:27:06.296 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4753.gd011c522. 28/287 2024-09-12T00:27:06.297 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noa 29/287 2024-09-12T00:27:06.297 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.n 30/287 2024-09-12T00:27:06.297 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4753.gd01 31/287 2024-09-12T00:27:06.297 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4753.gd011c522.el 32/287 2024-09-12T00:27:06.297 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 33/287 2024-09-12T00:27:06.297 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4753.gd011c522.e 34/287 2024-09-12T00:27:06.297 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 35/287 2024-09-12T00:27:06.297 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cephadm-2:19.3.0-4753.gd011c522.el9.noarch 36/287 2024-09-12T00:27:06.297 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 37/287 2024-09-12T00:27:06.297 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : bluez-libs-5.56-6.el9.x86_64 38/287 2024-09-12T00:27:06.297 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : bubblewrap-0.4.1-7.el9.x86_64 39/287 2024-09-12T00:27:06.297 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cups-libs-1:2.3.3op2-30.el9.x86_64 40/287 2024-09-12T00:27:06.298 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 41/287 2024-09-12T00:27:06.298 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 42/287 2024-09-12T00:27:06.298 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libpciaccess-0.16-7.el9.x86_64 43/287 2024-09-12T00:27:06.298 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 44/287 2024-09-12T00:27:06.298 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 45/287 2024-09-12T00:27:06.298 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/287 2024-09-12T00:27:06.298 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/287 2024-09-12T00:27:06.298 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/287 2024-09-12T00:27:06.298 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/287 2024-09-12T00:27:06.298 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/287 2024-09-12T00:27:06.298 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 51/287 2024-09-12T00:27:06.298 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 52/287 2024-09-12T00:27:06.298 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 53/287 2024-09-12T00:27:06.299 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : alsa-lib-1.2.12-1.el9.x86_64 54/287 2024-09-12T00:27:06.299 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 55/287 2024-09-12T00:27:06.299 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 56/287 2024-09-12T00:27:06.299 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 57/287 2024-09-12T00:27:06.299 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 58/287 2024-09-12T00:27:06.299 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 59/287 2024-09-12T00:27:06.299 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 60/287 2024-09-12T00:27:06.299 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : atinject-1.0.3-6.el9.noarch 61/287 2024-09-12T00:27:06.299 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : atk-2.36.0-5.el9.x86_64 62/287 2024-09-12T00:27:06.299 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : avahi-glib-0.8-21.el9.x86_64 63/287 2024-09-12T00:27:06.299 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/287 2024-09-12T00:27:06.299 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 65/287 2024-09-12T00:27:06.300 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 66/287 2024-09-12T00:27:06.300 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : composefs-libs-1.0.5-1.el9.x86_64 67/287 2024-09-12T00:27:06.300 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 68/287 2024-09-12T00:27:06.300 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 69/287 2024-09-12T00:27:06.300 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 70/287 2024-09-12T00:27:06.300 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 71/287 2024-09-12T00:27:06.300 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 72/287 2024-09-12T00:27:06.300 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 73/287 2024-09-12T00:27:06.300 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 74/287 2024-09-12T00:27:06.300 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flatpak-1.12.9-1.el9.x86_64 75/287 2024-09-12T00:27:06.300 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flatpak-selinux-1.12.9-1.el9.noarch 76/287 2024-09-12T00:27:06.300 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flatpak-session-helper-1.12.9-1.el9.x86_64 77/287 2024-09-12T00:27:06.300 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 78/287 2024-09-12T00:27:06.301 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 79/287 2024-09-12T00:27:06.301 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/287 2024-09-12T00:27:06.301 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 81/287 2024-09-12T00:27:06.301 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 82/287 2024-09-12T00:27:06.301 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 83/287 2024-09-12T00:27:06.301 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 84/287 2024-09-12T00:27:06.301 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 85/287 2024-09-12T00:27:06.301 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 86/287 2024-09-12T00:27:06.301 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 87/287 2024-09-12T00:27:06.301 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 88/287 2024-09-12T00:27:06.301 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : gtk-update-icon-cache-3.24.31-5.el9.x86_64 89/287 2024-09-12T00:27:06.301 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : gtk3-3.24.31-5.el9.x86_64 90/287 2024-09-12T00:27:06.301 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : guava-30.1-6.el9.noarch 91/287 2024-09-12T00:27:06.302 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 92/287 2024-09-12T00:27:06.302 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 93/287 2024-09-12T00:27:06.302 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 94/287 2024-09-12T00:27:06.302 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 95/287 2024-09-12T00:27:06.302 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 96/287 2024-09-12T00:27:06.302 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 97/287 2024-09-12T00:27:06.302 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 98/287 2024-09-12T00:27:06.302 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 99/287 2024-09-12T00:27:06.302 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 100/287 2024-09-12T00:27:06.302 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 101/287 2024-09-12T00:27:06.302 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 102/287 2024-09-12T00:27:06.302 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 103/287 2024-09-12T00:27:06.303 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 104/287 2024-09-12T00:27:06.303 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 105/287 2024-09-12T00:27:06.303 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : lcms2-2.12-3.el9.x86_64 106/287 2024-09-12T00:27:06.303 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libX11-xcb-1.7.0-9.el9.x86_64 107/287 2024-09-12T00:27:06.303 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 108/287 2024-09-12T00:27:06.303 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 109/287 2024-09-12T00:27:06.303 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 110/287 2024-09-12T00:27:06.303 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 111/287 2024-09-12T00:27:06.303 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 112/287 2024-09-12T00:27:06.303 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 113/287 2024-09-12T00:27:06.303 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 114/287 2024-09-12T00:27:06.303 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 115/287 2024-09-12T00:27:06.303 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 116/287 2024-09-12T00:27:06.303 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 117/287 2024-09-12T00:27:06.304 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 118/287 2024-09-12T00:27:06.304 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 119/287 2024-09-12T00:27:06.304 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 120/287 2024-09-12T00:27:06.304 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libdrm-2.4.121-1.el9.x86_64 121/287 2024-09-12T00:27:06.304 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 122/287 2024-09-12T00:27:06.304 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 123/287 2024-09-12T00:27:06.304 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 124/287 2024-09-12T00:27:06.304 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 125/287 2024-09-12T00:27:06.304 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 126/287 2024-09-12T00:27:06.304 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 127/287 2024-09-12T00:27:06.304 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 128/287 2024-09-12T00:27:06.304 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 129/287 2024-09-12T00:27:06.304 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 130/287 2024-09-12T00:27:06.305 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libiptcdata-1.0.5-10.el9.x86_64 131/287 2024-09-12T00:27:06.305 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 132/287 2024-09-12T00:27:06.305 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 133/287 2024-09-12T00:27:06.305 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 134/287 2024-09-12T00:27:06.305 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 135/287 2024-09-12T00:27:06.305 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 136/287 2024-09-12T00:27:06.305 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 137/287 2024-09-12T00:27:06.305 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 138/287 2024-09-12T00:27:06.305 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libsbc-1.4-9.el9.x86_64 139/287 2024-09-12T00:27:06.305 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 140/287 2024-09-12T00:27:06.305 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 141/287 2024-09-12T00:27:06.305 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libtiff-4.4.0-13.el9.x86_64 142/287 2024-09-12T00:27:06.305 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libtool-ltdl-2.4.6-46.el9.x86_64 143/287 2024-09-12T00:27:06.306 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 144/287 2024-09-12T00:27:06.306 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 145/287 2024-09-12T00:27:06.306 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 146/287 2024-09-12T00:27:06.306 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 147/287 2024-09-12T00:27:06.306 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 148/287 2024-09-12T00:27:06.306 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 149/287 2024-09-12T00:27:06.306 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 150/287 2024-09-12T00:27:06.306 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 151/287 2024-09-12T00:27:06.306 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 152/287 2024-09-12T00:27:06.306 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 153/287 2024-09-12T00:27:06.306 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 154/287 2024-09-12T00:27:06.306 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 155/287 2024-09-12T00:27:06.306 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : lua-5.4.4-4.el9.x86_64 156/287 2024-09-12T00:27:06.307 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 157/287 2024-09-12T00:27:06.307 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 158/287 2024-09-12T00:27:06.307 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 159/287 2024-09-12T00:27:06.307 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 160/287 2024-09-12T00:27:06.307 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 161/287 2024-09-12T00:27:06.307 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 162/287 2024-09-12T00:27:06.307 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 163/287 2024-09-12T00:27:06.307 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : mesa-dri-drivers-24.1.2-3.el9.x86_64 164/287 2024-09-12T00:27:06.307 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : mesa-filesystem-24.1.2-3.el9.x86_64 165/287 2024-09-12T00:27:06.307 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : mesa-libEGL-24.1.2-3.el9.x86_64 166/287 2024-09-12T00:27:06.307 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : mesa-libGL-24.1.2-3.el9.x86_64 167/287 2024-09-12T00:27:06.307 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : mesa-libgbm-24.1.2-3.el9.x86_64 168/287 2024-09-12T00:27:06.307 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : mesa-libglapi-24.1.2-3.el9.x86_64 169/287 2024-09-12T00:27:06.307 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 170/287 2024-09-12T00:27:06.308 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 171/287 2024-09-12T00:27:06.308 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 172/287 2024-09-12T00:27:06.308 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 173/287 2024-09-12T00:27:06.308 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : opus-1.3.1-10.el9.x86_64 174/287 2024-09-12T00:27:06.308 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : orc-0.4.31-8.el9.x86_64 175/287 2024-09-12T00:27:06.308 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : osinfo-db-20240701-2.el9.noarch 176/287 2024-09-12T00:27:06.308 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 177/287 2024-09-12T00:27:06.308 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ostree-libs-2024.7-2.el9.x86_64 178/287 2024-09-12T00:27:06.308 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : p11-kit-server-0.25.3-2.el9.x86_64 179/287 2024-09-12T00:27:06.308 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 180/287 2024-09-12T00:27:06.308 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 181/287 2024-09-12T00:27:06.308 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 182/287 2024-09-12T00:27:06.308 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 183/287 2024-09-12T00:27:06.309 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 184/287 2024-09-12T00:27:06.309 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 185/287 2024-09-12T00:27:06.309 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 186/287 2024-09-12T00:27:06.309 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 187/287 2024-09-12T00:27:06.309 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 188/287 2024-09-12T00:27:06.309 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 189/287 2024-09-12T00:27:06.309 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 190/287 2024-09-12T00:27:06.309 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 191/287 2024-09-12T00:27:06.309 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : poppler-21.01.0-21.el9.x86_64 192/287 2024-09-12T00:27:06.309 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 193/287 2024-09-12T00:27:06.309 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : poppler-glib-21.01.0-21.el9.x86_64 194/287 2024-09-12T00:27:06.309 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 195/287 2024-09-12T00:27:06.309 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 196/287 2024-09-12T00:27:06.309 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 197/287 2024-09-12T00:27:06.310 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 198/287 2024-09-12T00:27:06.310 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 199/287 2024-09-12T00:27:06.310 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 200/287 2024-09-12T00:27:06.310 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 201/287 2024-09-12T00:27:06.310 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 202/287 2024-09-12T00:27:06.310 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 203/287 2024-09-12T00:27:06.310 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 204/287 2024-09-12T00:27:06.310 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 205/287 2024-09-12T00:27:06.310 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 206/287 2024-09-12T00:27:06.310 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 207/287 2024-09-12T00:27:06.310 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 208/287 2024-09-12T00:27:06.310 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 209/287 2024-09-12T00:27:06.310 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 210/287 2024-09-12T00:27:06.311 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 211/287 2024-09-12T00:27:06.311 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 212/287 2024-09-12T00:27:06.311 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 213/287 2024-09-12T00:27:06.311 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 214/287 2024-09-12T00:27:06.311 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 215/287 2024-09-12T00:27:06.311 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 216/287 2024-09-12T00:27:06.311 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 217/287 2024-09-12T00:27:06.311 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 218/287 2024-09-12T00:27:06.311 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 219/287 2024-09-12T00:27:06.311 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rtkit-0.11-29.el9.x86_64 220/287 2024-09-12T00:27:06.311 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 221/287 2024-09-12T00:27:06.311 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 222/287 2024-09-12T00:27:06.311 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 223/287 2024-09-12T00:27:06.311 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 224/287 2024-09-12T00:27:06.311 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 225/287 2024-09-12T00:27:06.312 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 226/287 2024-09-12T00:27:06.312 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 227/287 2024-09-12T00:27:06.312 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 228/287 2024-09-12T00:27:06.312 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : tzdata-java-2024a-2.el9.noarch 229/287 2024-09-12T00:27:06.312 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : upower-0.99.11-11.el9.x86_64 230/287 2024-09-12T00:27:06.312 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 231/287 2024-09-12T00:27:06.312 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 232/287 2024-09-12T00:27:06.312 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 233/287 2024-09-12T00:27:06.312 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 234/287 2024-09-12T00:27:06.312 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 235/287 2024-09-12T00:27:06.312 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 236/287 2024-09-12T00:27:06.312 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 237/287 2024-09-12T00:27:06.312 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 238/287 2024-09-12T00:27:06.313 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 239/287 2024-09-12T00:27:06.313 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 240/287 2024-09-12T00:27:06.313 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 241/287 2024-09-12T00:27:06.313 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 242/287 2024-09-12T00:27:06.313 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 243/287 2024-09-12T00:27:06.313 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 244/287 2024-09-12T00:27:06.313 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 245/287 2024-09-12T00:27:06.313 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 246/287 2024-09-12T00:27:06.313 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 247/287 2024-09-12T00:27:06.313 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 248/287 2024-09-12T00:27:06.313 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 249/287 2024-09-12T00:27:06.313 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 250/287 2024-09-12T00:27:06.314 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 251/287 2024-09-12T00:27:06.314 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 252/287 2024-09-12T00:27:06.314 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 253/287 2024-09-12T00:27:06.314 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 254/287 2024-09-12T00:27:06.314 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 255/287 2024-09-12T00:27:06.314 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 256/287 2024-09-12T00:27:06.314 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 257/287 2024-09-12T00:27:06.314 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 258/287 2024-09-12T00:27:06.314 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 259/287 2024-09-12T00:27:06.314 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 260/287 2024-09-12T00:27:06.315 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 261/287 2024-09-12T00:27:06.315 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 262/287 2024-09-12T00:27:06.315 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 263/287 2024-09-12T00:27:06.315 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 264/287 2024-09-12T00:27:06.315 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 265/287 2024-09-12T00:27:06.315 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 266/287 2024-09-12T00:27:06.315 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 267/287 2024-09-12T00:27:06.315 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 268/287 2024-09-12T00:27:06.315 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 269/287 2024-09-12T00:27:06.315 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 270/287 2024-09-12T00:27:06.315 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 271/287 2024-09-12T00:27:06.315 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 272/287 2024-09-12T00:27:06.316 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 273/287 2024-09-12T00:27:06.316 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 274/287 2024-09-12T00:27:06.316 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 275/287 2024-09-12T00:27:06.316 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 276/287 2024-09-12T00:27:06.316 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 277/287 2024-09-12T00:27:06.316 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 278/287 2024-09-12T00:27:06.316 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 279/287 2024-09-12T00:27:06.316 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 280/287 2024-09-12T00:27:06.316 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : re2-1:20211101-20.el9.x86_64 281/287 2024-09-12T00:27:06.316 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 282/287 2024-09-12T00:27:06.316 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 283/287 2024-09-12T00:27:06.316 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados2-2:19.3.0-4753.gd011c522.el9.x86_64 284/287 2024-09-12T00:27:06.316 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 285/287 2024-09-12T00:27:06.317 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 286/287 2024-09-12T00:27:09.321 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:27:09.322 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-2:19.3.0-4753.gd011c522.el9.x86_64 1/287 2024-09-12T00:27:09.322 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 2/287 2024-09-12T00:27:09.322 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 3/287 2024-09-12T00:27:09.322 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 4/287 2024-09-12T00:27:09.322 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4753.gd011c 5/287 2024-09-12T00:27:09.322 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 6/287 2024-09-12T00:27:09.322 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 7/287 2024-09-12T00:27:09.322 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 8/287 2024-09-12T00:27:09.322 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 9/287 2024-09-12T00:27:09.322 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 10/287 2024-09-12T00:27:09.322 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 11/287 2024-09-12T00:27:09.322 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-test-2:19.3.0-4753.gd011c522.el9.x86_64 12/287 2024-09-12T00:27:09.322 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephfs-devel-2:19.3.0-4753.gd011c522.el9.x86_ 13/287 2024-09-12T00:27:09.322 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 14/287 2024-09-12T00:27:09.323 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 15/287 2024-09-12T00:27:09.323 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados-devel-2:19.3.0-4753.gd011c522.el9.x86_6 16/287 2024-09-12T00:27:09.323 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86 17/287 2024-09-12T00:27:09.323 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 18/287 2024-09-12T00:27:09.323 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4753.gd011c522.el 19/287 2024-09-12T00:27:09.323 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ceph-common-2:19.3.0-4753.gd011c522.el9. 20/287 2024-09-12T00:27:09.323 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cephfs-2:19.3.0-4753.gd011c522.el9.x86_6 21/287 2024-09-12T00:27:09.323 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rados-2:19.3.0-4753.gd011c522.el9.x86_64 22/287 2024-09-12T00:27:09.323 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rbd-2:19.3.0-4753.gd011c522.el9.x86_64 23/287 2024-09-12T00:27:09.323 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rgw-2:19.3.0-4753.gd011c522.el9.x86_64 24/287 2024-09-12T00:27:09.323 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 25/287 2024-09-12T00:27:09.323 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 26/287 2024-09-12T00:27:09.323 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-nbd-2:19.3.0-4753.gd011c522.el9.x86_64 27/287 2024-09-12T00:27:09.324 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4753.gd011c522. 28/287 2024-09-12T00:27:09.324 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noa 29/287 2024-09-12T00:27:09.324 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.n 30/287 2024-09-12T00:27:09.345 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4753.gd01 31/287 2024-09-12T00:27:09.346 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4753.gd011c522.el 32/287 2024-09-12T00:27:09.346 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 33/287 2024-09-12T00:27:09.346 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4753.gd011c522.e 34/287 2024-09-12T00:27:09.346 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 35/287 2024-09-12T00:27:09.346 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cephadm-2:19.3.0-4753.gd011c522.el9.noarch 36/287 2024-09-12T00:27:09.346 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 37/287 2024-09-12T00:27:09.346 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : bluez-libs-5.56-6.el9.x86_64 38/287 2024-09-12T00:27:09.346 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : bubblewrap-0.4.1-7.el9.x86_64 39/287 2024-09-12T00:27:09.346 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cups-libs-1:2.3.3op2-30.el9.x86_64 40/287 2024-09-12T00:27:09.346 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 41/287 2024-09-12T00:27:09.346 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 42/287 2024-09-12T00:27:09.346 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libpciaccess-0.16-7.el9.x86_64 43/287 2024-09-12T00:27:09.347 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 44/287 2024-09-12T00:27:09.347 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 45/287 2024-09-12T00:27:09.347 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/287 2024-09-12T00:27:09.347 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/287 2024-09-12T00:27:09.347 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/287 2024-09-12T00:27:09.347 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/287 2024-09-12T00:27:09.347 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/287 2024-09-12T00:27:09.347 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 51/287 2024-09-12T00:27:09.347 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 52/287 2024-09-12T00:27:09.347 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 53/287 2024-09-12T00:27:09.347 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : alsa-lib-1.2.12-1.el9.x86_64 54/287 2024-09-12T00:27:09.347 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 55/287 2024-09-12T00:27:09.347 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 56/287 2024-09-12T00:27:09.347 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 57/287 2024-09-12T00:27:09.348 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 58/287 2024-09-12T00:27:09.348 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 59/287 2024-09-12T00:27:09.348 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 60/287 2024-09-12T00:27:09.348 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : atinject-1.0.3-6.el9.noarch 61/287 2024-09-12T00:27:09.348 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : atk-2.36.0-5.el9.x86_64 62/287 2024-09-12T00:27:09.348 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : avahi-glib-0.8-21.el9.x86_64 63/287 2024-09-12T00:27:09.348 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/287 2024-09-12T00:27:09.348 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 65/287 2024-09-12T00:27:09.348 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 66/287 2024-09-12T00:27:09.348 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : composefs-libs-1.0.5-1.el9.x86_64 67/287 2024-09-12T00:27:09.348 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 68/287 2024-09-12T00:27:09.348 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 69/287 2024-09-12T00:27:09.348 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 70/287 2024-09-12T00:27:09.349 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 71/287 2024-09-12T00:27:09.349 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 72/287 2024-09-12T00:27:09.349 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 73/287 2024-09-12T00:27:09.349 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 74/287 2024-09-12T00:27:09.349 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flatpak-1.12.9-1.el9.x86_64 75/287 2024-09-12T00:27:09.349 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flatpak-selinux-1.12.9-1.el9.noarch 76/287 2024-09-12T00:27:09.349 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flatpak-session-helper-1.12.9-1.el9.x86_64 77/287 2024-09-12T00:27:09.349 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 78/287 2024-09-12T00:27:09.349 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 79/287 2024-09-12T00:27:09.349 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/287 2024-09-12T00:27:09.349 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 81/287 2024-09-12T00:27:09.349 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 82/287 2024-09-12T00:27:09.349 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 83/287 2024-09-12T00:27:09.350 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 84/287 2024-09-12T00:27:09.350 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 85/287 2024-09-12T00:27:09.350 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 86/287 2024-09-12T00:27:09.350 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 87/287 2024-09-12T00:27:09.350 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 88/287 2024-09-12T00:27:09.350 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : gtk-update-icon-cache-3.24.31-5.el9.x86_64 89/287 2024-09-12T00:27:09.350 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : gtk3-3.24.31-5.el9.x86_64 90/287 2024-09-12T00:27:09.350 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : guava-30.1-6.el9.noarch 91/287 2024-09-12T00:27:09.350 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 92/287 2024-09-12T00:27:09.350 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 93/287 2024-09-12T00:27:09.351 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 94/287 2024-09-12T00:27:09.351 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 95/287 2024-09-12T00:27:09.351 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 96/287 2024-09-12T00:27:09.351 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 97/287 2024-09-12T00:27:09.351 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 98/287 2024-09-12T00:27:09.351 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 99/287 2024-09-12T00:27:09.351 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 100/287 2024-09-12T00:27:09.351 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 101/287 2024-09-12T00:27:09.351 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 102/287 2024-09-12T00:27:09.351 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 103/287 2024-09-12T00:27:09.351 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 104/287 2024-09-12T00:27:09.351 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 105/287 2024-09-12T00:27:09.351 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lcms2-2.12-3.el9.x86_64 106/287 2024-09-12T00:27:09.351 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libX11-xcb-1.7.0-9.el9.x86_64 107/287 2024-09-12T00:27:09.352 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 108/287 2024-09-12T00:27:09.352 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 109/287 2024-09-12T00:27:09.352 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 110/287 2024-09-12T00:27:09.352 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 111/287 2024-09-12T00:27:09.352 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 112/287 2024-09-12T00:27:09.352 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 113/287 2024-09-12T00:27:09.352 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 114/287 2024-09-12T00:27:09.352 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 115/287 2024-09-12T00:27:09.352 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 116/287 2024-09-12T00:27:09.352 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 117/287 2024-09-12T00:27:09.352 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 118/287 2024-09-12T00:27:09.352 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 119/287 2024-09-12T00:27:09.352 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 120/287 2024-09-12T00:27:09.353 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libdrm-2.4.121-1.el9.x86_64 121/287 2024-09-12T00:27:09.353 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 122/287 2024-09-12T00:27:09.353 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 123/287 2024-09-12T00:27:09.353 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 124/287 2024-09-12T00:27:09.353 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 125/287 2024-09-12T00:27:09.353 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 126/287 2024-09-12T00:27:09.353 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 127/287 2024-09-12T00:27:09.353 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 128/287 2024-09-12T00:27:09.353 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 129/287 2024-09-12T00:27:09.353 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 130/287 2024-09-12T00:27:09.353 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libiptcdata-1.0.5-10.el9.x86_64 131/287 2024-09-12T00:27:09.353 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 132/287 2024-09-12T00:27:09.353 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 133/287 2024-09-12T00:27:09.354 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 134/287 2024-09-12T00:27:09.354 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 135/287 2024-09-12T00:27:09.354 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 136/287 2024-09-12T00:27:09.354 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 137/287 2024-09-12T00:27:09.354 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 138/287 2024-09-12T00:27:09.354 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libsbc-1.4-9.el9.x86_64 139/287 2024-09-12T00:27:09.354 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 140/287 2024-09-12T00:27:09.354 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 141/287 2024-09-12T00:27:09.354 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libtiff-4.4.0-13.el9.x86_64 142/287 2024-09-12T00:27:09.354 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libtool-ltdl-2.4.6-46.el9.x86_64 143/287 2024-09-12T00:27:09.354 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 144/287 2024-09-12T00:27:09.354 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 145/287 2024-09-12T00:27:09.354 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 146/287 2024-09-12T00:27:09.354 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 147/287 2024-09-12T00:27:09.355 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 148/287 2024-09-12T00:27:09.355 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 149/287 2024-09-12T00:27:09.355 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 150/287 2024-09-12T00:27:09.355 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 151/287 2024-09-12T00:27:09.355 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 152/287 2024-09-12T00:27:09.355 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 153/287 2024-09-12T00:27:09.355 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 154/287 2024-09-12T00:27:09.355 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 155/287 2024-09-12T00:27:09.355 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lua-5.4.4-4.el9.x86_64 156/287 2024-09-12T00:27:09.355 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 157/287 2024-09-12T00:27:09.355 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 158/287 2024-09-12T00:27:09.355 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 159/287 2024-09-12T00:27:09.355 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 160/287 2024-09-12T00:27:09.356 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 161/287 2024-09-12T00:27:09.356 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 162/287 2024-09-12T00:27:09.356 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 163/287 2024-09-12T00:27:09.356 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : mesa-dri-drivers-24.1.2-3.el9.x86_64 164/287 2024-09-12T00:27:09.356 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : mesa-filesystem-24.1.2-3.el9.x86_64 165/287 2024-09-12T00:27:09.356 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : mesa-libEGL-24.1.2-3.el9.x86_64 166/287 2024-09-12T00:27:09.356 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : mesa-libGL-24.1.2-3.el9.x86_64 167/287 2024-09-12T00:27:09.356 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : mesa-libgbm-24.1.2-3.el9.x86_64 168/287 2024-09-12T00:27:09.356 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : mesa-libglapi-24.1.2-3.el9.x86_64 169/287 2024-09-12T00:27:09.356 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 170/287 2024-09-12T00:27:09.356 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 171/287 2024-09-12T00:27:09.356 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 172/287 2024-09-12T00:27:09.356 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 173/287 2024-09-12T00:27:09.356 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : opus-1.3.1-10.el9.x86_64 174/287 2024-09-12T00:27:09.357 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : orc-0.4.31-8.el9.x86_64 175/287 2024-09-12T00:27:09.357 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : osinfo-db-20240701-2.el9.noarch 176/287 2024-09-12T00:27:09.357 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 177/287 2024-09-12T00:27:09.357 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ostree-libs-2024.7-2.el9.x86_64 178/287 2024-09-12T00:27:09.357 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : p11-kit-server-0.25.3-2.el9.x86_64 179/287 2024-09-12T00:27:09.357 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 180/287 2024-09-12T00:27:09.357 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 181/287 2024-09-12T00:27:09.357 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 182/287 2024-09-12T00:27:09.357 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 183/287 2024-09-12T00:27:09.357 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 184/287 2024-09-12T00:27:09.357 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 185/287 2024-09-12T00:27:09.357 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 186/287 2024-09-12T00:27:09.357 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 187/287 2024-09-12T00:27:09.357 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 188/287 2024-09-12T00:27:09.358 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 189/287 2024-09-12T00:27:09.358 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 190/287 2024-09-12T00:27:09.358 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 191/287 2024-09-12T00:27:09.358 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : poppler-21.01.0-21.el9.x86_64 192/287 2024-09-12T00:27:09.358 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 193/287 2024-09-12T00:27:09.358 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : poppler-glib-21.01.0-21.el9.x86_64 194/287 2024-09-12T00:27:09.358 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 195/287 2024-09-12T00:27:09.358 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 196/287 2024-09-12T00:27:09.358 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 197/287 2024-09-12T00:27:09.358 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 198/287 2024-09-12T00:27:09.358 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 199/287 2024-09-12T00:27:09.358 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 200/287 2024-09-12T00:27:09.358 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 201/287 2024-09-12T00:27:09.358 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 202/287 2024-09-12T00:27:09.359 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 203/287 2024-09-12T00:27:09.359 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 204/287 2024-09-12T00:27:09.359 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 205/287 2024-09-12T00:27:09.359 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 206/287 2024-09-12T00:27:09.359 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 207/287 2024-09-12T00:27:09.359 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 208/287 2024-09-12T00:27:09.359 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 209/287 2024-09-12T00:27:09.359 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 210/287 2024-09-12T00:27:09.359 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 211/287 2024-09-12T00:27:09.359 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 212/287 2024-09-12T00:27:09.359 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 213/287 2024-09-12T00:27:09.359 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 214/287 2024-09-12T00:27:09.359 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 215/287 2024-09-12T00:27:09.359 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 216/287 2024-09-12T00:27:09.360 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 217/287 2024-09-12T00:27:09.360 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 218/287 2024-09-12T00:27:09.360 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 219/287 2024-09-12T00:27:09.360 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rtkit-0.11-29.el9.x86_64 220/287 2024-09-12T00:27:09.360 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 221/287 2024-09-12T00:27:09.360 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 222/287 2024-09-12T00:27:09.360 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 223/287 2024-09-12T00:27:09.360 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 224/287 2024-09-12T00:27:09.360 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 225/287 2024-09-12T00:27:09.360 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 226/287 2024-09-12T00:27:09.360 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 227/287 2024-09-12T00:27:09.360 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 228/287 2024-09-12T00:27:09.360 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : tzdata-java-2024a-2.el9.noarch 229/287 2024-09-12T00:27:09.360 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : upower-0.99.11-11.el9.x86_64 230/287 2024-09-12T00:27:09.361 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 231/287 2024-09-12T00:27:09.361 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 232/287 2024-09-12T00:27:09.361 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 233/287 2024-09-12T00:27:09.361 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 234/287 2024-09-12T00:27:09.361 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 235/287 2024-09-12T00:27:09.361 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 236/287 2024-09-12T00:27:09.361 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 237/287 2024-09-12T00:27:09.361 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 238/287 2024-09-12T00:27:09.361 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 239/287 2024-09-12T00:27:09.361 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 240/287 2024-09-12T00:27:09.361 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 241/287 2024-09-12T00:27:09.361 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 242/287 2024-09-12T00:27:09.362 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 243/287 2024-09-12T00:27:09.362 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 244/287 2024-09-12T00:27:09.362 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 245/287 2024-09-12T00:27:09.362 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 246/287 2024-09-12T00:27:09.362 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 247/287 2024-09-12T00:27:09.362 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 248/287 2024-09-12T00:27:09.362 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 249/287 2024-09-12T00:27:09.362 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 250/287 2024-09-12T00:27:09.362 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 251/287 2024-09-12T00:27:09.362 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 252/287 2024-09-12T00:27:09.362 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 253/287 2024-09-12T00:27:09.362 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 254/287 2024-09-12T00:27:09.362 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 255/287 2024-09-12T00:27:09.362 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 256/287 2024-09-12T00:27:09.363 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 257/287 2024-09-12T00:27:09.363 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 258/287 2024-09-12T00:27:09.363 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 259/287 2024-09-12T00:27:09.363 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 260/287 2024-09-12T00:27:09.363 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 261/287 2024-09-12T00:27:09.363 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 262/287 2024-09-12T00:27:09.363 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 263/287 2024-09-12T00:27:09.363 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 264/287 2024-09-12T00:27:09.363 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 265/287 2024-09-12T00:27:09.363 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 266/287 2024-09-12T00:27:09.363 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 267/287 2024-09-12T00:27:09.363 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 268/287 2024-09-12T00:27:09.363 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 269/287 2024-09-12T00:27:09.363 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 270/287 2024-09-12T00:27:09.364 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 271/287 2024-09-12T00:27:09.364 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 272/287 2024-09-12T00:27:09.364 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 273/287 2024-09-12T00:27:09.364 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 274/287 2024-09-12T00:27:09.364 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 275/287 2024-09-12T00:27:09.364 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 276/287 2024-09-12T00:27:09.364 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 277/287 2024-09-12T00:27:09.364 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 278/287 2024-09-12T00:27:09.364 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 279/287 2024-09-12T00:27:09.364 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 280/287 2024-09-12T00:27:09.364 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : re2-1:20211101-20.el9.x86_64 281/287 2024-09-12T00:27:09.364 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 282/287 2024-09-12T00:27:09.364 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 283/287 2024-09-12T00:27:09.365 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados2-2:19.3.0-4753.gd011c522.el9.x86_64 284/287 2024-09-12T00:27:09.365 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 285/287 2024-09-12T00:27:09.365 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 286/287 2024-09-12T00:27:09.779 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:27:09.780 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T00:27:09.780 INFO:teuthology.orchestra.run.smithi117.stdout:Upgraded: 2024-09-12T00:27:09.780 INFO:teuthology.orchestra.run.smithi117.stdout: librados2-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:09.780 INFO:teuthology.orchestra.run.smithi117.stdout: librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:09.780 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-09-12T00:27:09.780 INFO:teuthology.orchestra.run.smithi117.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-09-12T00:27:09.780 INFO:teuthology.orchestra.run.smithi117.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T00:27:09.780 INFO:teuthology.orchestra.run.smithi117.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-09-12T00:27:09.780 INFO:teuthology.orchestra.run.smithi117.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-09-12T00:27:09.780 INFO:teuthology.orchestra.run.smithi117.stdout: alsa-lib-1.2.12-1.el9.x86_64 2024-09-12T00:27:09.780 INFO:teuthology.orchestra.run.smithi117.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-09-12T00:27:09.780 INFO:teuthology.orchestra.run.smithi117.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-09-12T00:27:09.780 INFO:teuthology.orchestra.run.smithi117.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-09-12T00:27:09.781 INFO:teuthology.orchestra.run.smithi117.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-09-12T00:27:09.781 INFO:teuthology.orchestra.run.smithi117.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-09-12T00:27:09.781 INFO:teuthology.orchestra.run.smithi117.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-09-12T00:27:09.781 INFO:teuthology.orchestra.run.smithi117.stdout: atinject-1.0.3-6.el9.noarch 2024-09-12T00:27:09.781 INFO:teuthology.orchestra.run.smithi117.stdout: atk-2.36.0-5.el9.x86_64 2024-09-12T00:27:09.781 INFO:teuthology.orchestra.run.smithi117.stdout: avahi-glib-0.8-21.el9.x86_64 2024-09-12T00:27:09.781 INFO:teuthology.orchestra.run.smithi117.stdout: bluez-libs-5.56-6.el9.x86_64 2024-09-12T00:27:09.781 INFO:teuthology.orchestra.run.smithi117.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T00:27:09.781 INFO:teuthology.orchestra.run.smithi117.stdout: bubblewrap-0.4.1-7.el9.x86_64 2024-09-12T00:27:09.781 INFO:teuthology.orchestra.run.smithi117.stdout: cdi-api-2.0.2-6.el9.noarch 2024-09-12T00:27:09.781 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:09.781 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:09.782 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:09.782 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:09.782 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-grafana-dashboards-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:27:09.782 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-immutable-object-cache-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:09.782 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:09.782 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:09.782 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:27:09.782 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:27:09.782 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:27:09.782 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-modules-core-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:27:09.782 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:27:09.782 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:09.782 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:09.783 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-prometheus-alerts-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:27:09.783 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:09.783 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:09.783 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-test-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:09.783 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:27:09.783 INFO:teuthology.orchestra.run.smithi117.stdout: cephadm-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:27:09.783 INFO:teuthology.orchestra.run.smithi117.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-09-12T00:27:09.783 INFO:teuthology.orchestra.run.smithi117.stdout: composefs-libs-1.0.5-1.el9.x86_64 2024-09-12T00:27:09.783 INFO:teuthology.orchestra.run.smithi117.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-09-12T00:27:09.783 INFO:teuthology.orchestra.run.smithi117.stdout: cups-libs-1:2.3.3op2-30.el9.x86_64 2024-09-12T00:27:09.783 INFO:teuthology.orchestra.run.smithi117.stdout: dconf-0.40.0-6.el9.x86_64 2024-09-12T00:27:09.783 INFO:teuthology.orchestra.run.smithi117.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-09-12T00:27:09.783 INFO:teuthology.orchestra.run.smithi117.stdout: exiv2-0.27.5-2.el9.x86_64 2024-09-12T00:27:09.783 INFO:teuthology.orchestra.run.smithi117.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-09-12T00:27:09.783 INFO:teuthology.orchestra.run.smithi117.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-09-12T00:27:09.784 INFO:teuthology.orchestra.run.smithi117.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-09-12T00:27:09.784 INFO:teuthology.orchestra.run.smithi117.stdout: flatpak-1.12.9-1.el9.x86_64 2024-09-12T00:27:09.784 INFO:teuthology.orchestra.run.smithi117.stdout: flatpak-selinux-1.12.9-1.el9.noarch 2024-09-12T00:27:09.784 INFO:teuthology.orchestra.run.smithi117.stdout: flatpak-session-helper-1.12.9-1.el9.x86_64 2024-09-12T00:27:09.784 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T00:27:09.784 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T00:27:09.784 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T00:27:09.784 INFO:teuthology.orchestra.run.smithi117.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T00:27:09.784 INFO:teuthology.orchestra.run.smithi117.stdout: gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 2024-09-12T00:27:09.784 INFO:teuthology.orchestra.run.smithi117.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-09-12T00:27:09.784 INFO:teuthology.orchestra.run.smithi117.stdout: giflib-5.2.1-9.el9.x86_64 2024-09-12T00:27:09.784 INFO:teuthology.orchestra.run.smithi117.stdout: google-guice-4.2.3-9.el9.noarch 2024-09-12T00:27:09.785 INFO:teuthology.orchestra.run.smithi117.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T00:27:09.785 INFO:teuthology.orchestra.run.smithi117.stdout: graphene-1.10.6-2.el9.x86_64 2024-09-12T00:27:09.785 INFO:teuthology.orchestra.run.smithi117.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T00:27:09.785 INFO:teuthology.orchestra.run.smithi117.stdout: gsm-1.0.19-6.el9.x86_64 2024-09-12T00:27:09.785 INFO:teuthology.orchestra.run.smithi117.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-09-12T00:27:09.785 INFO:teuthology.orchestra.run.smithi117.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-09-12T00:27:09.785 INFO:teuthology.orchestra.run.smithi117.stdout: gtk-update-icon-cache-3.24.31-5.el9.x86_64 2024-09-12T00:27:09.785 INFO:teuthology.orchestra.run.smithi117.stdout: gtk3-3.24.31-5.el9.x86_64 2024-09-12T00:27:09.785 INFO:teuthology.orchestra.run.smithi117.stdout: guava-30.1-6.el9.noarch 2024-09-12T00:27:09.785 INFO:teuthology.orchestra.run.smithi117.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-09-12T00:27:09.785 INFO:teuthology.orchestra.run.smithi117.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-09-12T00:27:09.785 INFO:teuthology.orchestra.run.smithi117.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-09-12T00:27:09.785 INFO:teuthology.orchestra.run.smithi117.stdout: iso-codes-4.6.0-3.el9.noarch 2024-09-12T00:27:09.785 INFO:teuthology.orchestra.run.smithi117.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-09-12T00:27:09.785 INFO:teuthology.orchestra.run.smithi117.stdout: jansi-2.3.3-6.el9.x86_64 2024-09-12T00:27:09.786 INFO:teuthology.orchestra.run.smithi117.stdout: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T00:27:09.786 INFO:teuthology.orchestra.run.smithi117.stdout: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T00:27:09.786 INFO:teuthology.orchestra.run.smithi117.stdout: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T00:27:09.786 INFO:teuthology.orchestra.run.smithi117.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-09-12T00:27:09.786 INFO:teuthology.orchestra.run.smithi117.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-09-12T00:27:09.786 INFO:teuthology.orchestra.run.smithi117.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-09-12T00:27:09.787 INFO:teuthology.orchestra.run.smithi117.stdout: jsoup-1.13.1-10.el9.noarch 2024-09-12T00:27:09.787 INFO:teuthology.orchestra.run.smithi117.stdout: jsr-305-3.0.2-6.el9.noarch 2024-09-12T00:27:09.787 INFO:teuthology.orchestra.run.smithi117.stdout: lcms2-2.12-3.el9.x86_64 2024-09-12T00:27:09.787 INFO:teuthology.orchestra.run.smithi117.stdout: libX11-xcb-1.7.0-9.el9.x86_64 2024-09-12T00:27:09.788 INFO:teuthology.orchestra.run.smithi117.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-09-12T00:27:09.788 INFO:teuthology.orchestra.run.smithi117.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-09-12T00:27:09.788 INFO:teuthology.orchestra.run.smithi117.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-09-12T00:27:09.788 INFO:teuthology.orchestra.run.smithi117.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-09-12T00:27:09.788 INFO:teuthology.orchestra.run.smithi117.stdout: libXi-1.7.10-8.el9.x86_64 2024-09-12T00:27:09.788 INFO:teuthology.orchestra.run.smithi117.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-09-12T00:27:09.788 INFO:teuthology.orchestra.run.smithi117.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-09-12T00:27:09.788 INFO:teuthology.orchestra.run.smithi117.stdout: libXtst-1.2.3-16.el9.x86_64 2024-09-12T00:27:09.788 INFO:teuthology.orchestra.run.smithi117.stdout: libXv-1.0.11-16.el9.x86_64 2024-09-12T00:27:09.788 INFO:teuthology.orchestra.run.smithi117.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-09-12T00:27:09.789 INFO:teuthology.orchestra.run.smithi117.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T00:27:09.789 INFO:teuthology.orchestra.run.smithi117.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T00:27:09.789 INFO:teuthology.orchestra.run.smithi117.stdout: libasyncns-0.8-22.el9.x86_64 2024-09-12T00:27:09.789 INFO:teuthology.orchestra.run.smithi117.stdout: libcanberra-0.30-27.el9.x86_64 2024-09-12T00:27:09.789 INFO:teuthology.orchestra.run.smithi117.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-09-12T00:27:09.790 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs-devel-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:09.790 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:09.790 INFO:teuthology.orchestra.run.smithi117.stdout: libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:09.790 INFO:teuthology.orchestra.run.smithi117.stdout: libdrm-2.4.121-1.el9.x86_64 2024-09-12T00:27:09.790 INFO:teuthology.orchestra.run.smithi117.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-09-12T00:27:09.790 INFO:teuthology.orchestra.run.smithi117.stdout: libexif-0.6.22-6.el9.x86_64 2024-09-12T00:27:09.793 INFO:teuthology.orchestra.run.smithi117.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-09-12T00:27:09.793 INFO:teuthology.orchestra.run.smithi117.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-09-12T00:27:09.793 INFO:teuthology.orchestra.run.smithi117.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T00:27:09.793 INFO:teuthology.orchestra.run.smithi117.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-09-12T00:27:09.793 INFO:teuthology.orchestra.run.smithi117.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-09-12T00:27:09.793 INFO:teuthology.orchestra.run.smithi117.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-09-12T00:27:09.793 INFO:teuthology.orchestra.run.smithi117.stdout: libgsf-1.14.47-5.el9.x86_64 2024-09-12T00:27:09.793 INFO:teuthology.orchestra.run.smithi117.stdout: libgxps-0.3.2-3.el9.x86_64 2024-09-12T00:27:09.793 INFO:teuthology.orchestra.run.smithi117.stdout: libiptcdata-1.0.5-10.el9.x86_64 2024-09-12T00:27:09.793 INFO:teuthology.orchestra.run.smithi117.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-09-12T00:27:09.793 INFO:teuthology.orchestra.run.smithi117.stdout: libnotify-0.7.9-8.el9.x86_64 2024-09-12T00:27:09.793 INFO:teuthology.orchestra.run.smithi117.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T00:27:09.793 INFO:teuthology.orchestra.run.smithi117.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-09-12T00:27:09.794 INFO:teuthology.orchestra.run.smithi117.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-09-12T00:27:09.794 INFO:teuthology.orchestra.run.smithi117.stdout: libpciaccess-0.16-7.el9.x86_64 2024-09-12T00:27:09.794 INFO:teuthology.orchestra.run.smithi117.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T00:27:09.794 INFO:teuthology.orchestra.run.smithi117.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T00:27:09.794 INFO:teuthology.orchestra.run.smithi117.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T00:27:09.794 INFO:teuthology.orchestra.run.smithi117.stdout: librados-devel-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:09.794 INFO:teuthology.orchestra.run.smithi117.stdout: libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:09.794 INFO:teuthology.orchestra.run.smithi117.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T00:27:09.794 INFO:teuthology.orchestra.run.smithi117.stdout: librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:09.794 INFO:teuthology.orchestra.run.smithi117.stdout: libsbc-1.4-9.el9.x86_64 2024-09-12T00:27:09.794 INFO:teuthology.orchestra.run.smithi117.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-09-12T00:27:09.794 INFO:teuthology.orchestra.run.smithi117.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-09-12T00:27:09.794 INFO:teuthology.orchestra.run.smithi117.stdout: libtiff-4.4.0-13.el9.x86_64 2024-09-12T00:27:09.794 INFO:teuthology.orchestra.run.smithi117.stdout: libtool-ltdl-2.4.6-46.el9.x86_64 2024-09-12T00:27:09.795 INFO:teuthology.orchestra.run.smithi117.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-09-12T00:27:09.795 INFO:teuthology.orchestra.run.smithi117.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T00:27:09.795 INFO:teuthology.orchestra.run.smithi117.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-09-12T00:27:09.795 INFO:teuthology.orchestra.run.smithi117.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-09-12T00:27:09.795 INFO:teuthology.orchestra.run.smithi117.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-09-12T00:27:09.795 INFO:teuthology.orchestra.run.smithi117.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-09-12T00:27:09.795 INFO:teuthology.orchestra.run.smithi117.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-09-12T00:27:09.795 INFO:teuthology.orchestra.run.smithi117.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-09-12T00:27:09.795 INFO:teuthology.orchestra.run.smithi117.stdout: libwebp-1.2.0-8.el9.x86_64 2024-09-12T00:27:09.795 INFO:teuthology.orchestra.run.smithi117.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-09-12T00:27:09.795 INFO:teuthology.orchestra.run.smithi117.stdout: libxshmfence-1.3-10.el9.x86_64 2024-09-12T00:27:09.795 INFO:teuthology.orchestra.run.smithi117.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-12T00:27:09.795 INFO:teuthology.orchestra.run.smithi117.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-09-12T00:27:09.795 INFO:teuthology.orchestra.run.smithi117.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T00:27:09.796 INFO:teuthology.orchestra.run.smithi117.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T00:27:09.796 INFO:teuthology.orchestra.run.smithi117.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T00:27:09.796 INFO:teuthology.orchestra.run.smithi117.stdout: lua-posix-35.0-8.el9.x86_64 2024-09-12T00:27:09.796 INFO:teuthology.orchestra.run.smithi117.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T00:27:09.796 INFO:teuthology.orchestra.run.smithi117.stdout: maven-1:3.6.3-15.el9.noarch 2024-09-12T00:27:09.796 INFO:teuthology.orchestra.run.smithi117.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-09-12T00:27:09.796 INFO:teuthology.orchestra.run.smithi117.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-09-12T00:27:09.796 INFO:teuthology.orchestra.run.smithi117.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-09-12T00:27:09.796 INFO:teuthology.orchestra.run.smithi117.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-09-12T00:27:09.796 INFO:teuthology.orchestra.run.smithi117.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-09-12T00:27:09.796 INFO:teuthology.orchestra.run.smithi117.stdout: mesa-dri-drivers-24.1.2-3.el9.x86_64 2024-09-12T00:27:09.796 INFO:teuthology.orchestra.run.smithi117.stdout: mesa-filesystem-24.1.2-3.el9.x86_64 2024-09-12T00:27:09.796 INFO:teuthology.orchestra.run.smithi117.stdout: mesa-libEGL-24.1.2-3.el9.x86_64 2024-09-12T00:27:09.796 INFO:teuthology.orchestra.run.smithi117.stdout: mesa-libGL-24.1.2-3.el9.x86_64 2024-09-12T00:27:09.797 INFO:teuthology.orchestra.run.smithi117.stdout: mesa-libgbm-24.1.2-3.el9.x86_64 2024-09-12T00:27:09.797 INFO:teuthology.orchestra.run.smithi117.stdout: mesa-libglapi-24.1.2-3.el9.x86_64 2024-09-12T00:27:09.797 INFO:teuthology.orchestra.run.smithi117.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-09-12T00:27:09.797 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T00:27:09.797 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T00:27:09.797 INFO:teuthology.orchestra.run.smithi117.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-09-12T00:27:09.797 INFO:teuthology.orchestra.run.smithi117.stdout: opus-1.3.1-10.el9.x86_64 2024-09-12T00:27:09.797 INFO:teuthology.orchestra.run.smithi117.stdout: orc-0.4.31-8.el9.x86_64 2024-09-12T00:27:09.797 INFO:teuthology.orchestra.run.smithi117.stdout: osinfo-db-20240701-2.el9.noarch 2024-09-12T00:27:09.798 INFO:teuthology.orchestra.run.smithi117.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-09-12T00:27:09.798 INFO:teuthology.orchestra.run.smithi117.stdout: ostree-libs-2024.7-2.el9.x86_64 2024-09-12T00:27:09.798 INFO:teuthology.orchestra.run.smithi117.stdout: p11-kit-server-0.25.3-2.el9.x86_64 2024-09-12T00:27:09.798 INFO:teuthology.orchestra.run.smithi117.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T00:27:09.798 INFO:teuthology.orchestra.run.smithi117.stdout: pipewire-1.0.1-1.el9.x86_64 2024-09-12T00:27:09.798 INFO:teuthology.orchestra.run.smithi117.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-09-12T00:27:09.798 INFO:teuthology.orchestra.run.smithi117.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-09-12T00:27:09.798 INFO:teuthology.orchestra.run.smithi117.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-09-12T00:27:09.798 INFO:teuthology.orchestra.run.smithi117.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-09-12T00:27:09.798 INFO:teuthology.orchestra.run.smithi117.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-09-12T00:27:09.798 INFO:teuthology.orchestra.run.smithi117.stdout: plexus-cipher-1.7-27.el9.noarch 2024-09-12T00:27:09.798 INFO:teuthology.orchestra.run.smithi117.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-09-12T00:27:09.798 INFO:teuthology.orchestra.run.smithi117.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-09-12T00:27:09.798 INFO:teuthology.orchestra.run.smithi117.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-09-12T00:27:09.799 INFO:teuthology.orchestra.run.smithi117.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-09-12T00:27:09.799 INFO:teuthology.orchestra.run.smithi117.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-09-12T00:27:09.799 INFO:teuthology.orchestra.run.smithi117.stdout: poppler-21.01.0-21.el9.x86_64 2024-09-12T00:27:09.799 INFO:teuthology.orchestra.run.smithi117.stdout: poppler-data-0.4.9-9.el9.noarch 2024-09-12T00:27:09.799 INFO:teuthology.orchestra.run.smithi117.stdout: poppler-glib-21.01.0-21.el9.x86_64 2024-09-12T00:27:09.799 INFO:teuthology.orchestra.run.smithi117.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T00:27:09.799 INFO:teuthology.orchestra.run.smithi117.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T00:27:09.799 INFO:teuthology.orchestra.run.smithi117.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-09-12T00:27:09.799 INFO:teuthology.orchestra.run.smithi117.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-09-12T00:27:09.799 INFO:teuthology.orchestra.run.smithi117.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T00:27:09.799 INFO:teuthology.orchestra.run.smithi117.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T00:27:09.799 INFO:teuthology.orchestra.run.smithi117.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T00:27:09.799 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T00:27:09.799 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-argparse-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:09.800 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:09.800 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cephfs-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:09.800 INFO:teuthology.orchestra.run.smithi117.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T00:27:09.800 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T00:27:09.800 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T00:27:09.800 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T00:27:09.800 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T00:27:09.800 INFO:teuthology.orchestra.run.smithi117.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T00:27:09.800 INFO:teuthology.orchestra.run.smithi117.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T00:27:09.800 INFO:teuthology.orchestra.run.smithi117.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T00:27:09.800 INFO:teuthology.orchestra.run.smithi117.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T00:27:09.800 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T00:27:09.800 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T00:27:09.800 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T00:27:09.801 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T00:27:09.801 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T00:27:09.801 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T00:27:09.801 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T00:27:09.801 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T00:27:09.801 INFO:teuthology.orchestra.run.smithi117.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T00:27:09.801 INFO:teuthology.orchestra.run.smithi117.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T00:27:09.801 INFO:teuthology.orchestra.run.smithi117.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T00:27:09.801 INFO:teuthology.orchestra.run.smithi117.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T00:27:09.801 INFO:teuthology.orchestra.run.smithi117.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T00:27:09.801 INFO:teuthology.orchestra.run.smithi117.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T00:27:09.802 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T00:27:09.802 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T00:27:09.802 INFO:teuthology.orchestra.run.smithi117.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T00:27:09.802 INFO:teuthology.orchestra.run.smithi117.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T00:27:09.802 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T00:27:09.802 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T00:27:09.802 INFO:teuthology.orchestra.run.smithi117.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T00:27:09.802 INFO:teuthology.orchestra.run.smithi117.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T00:27:09.802 INFO:teuthology.orchestra.run.smithi117.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T00:27:09.802 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T00:27:09.802 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T00:27:09.803 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T00:27:09.803 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T00:27:09.803 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T00:27:09.803 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rados-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:09.803 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rbd-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:09.803 INFO:teuthology.orchestra.run.smithi117.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T00:27:09.803 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T00:27:09.803 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T00:27:09.803 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rgw-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:09.803 INFO:teuthology.orchestra.run.smithi117.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T00:27:09.803 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T00:27:09.803 INFO:teuthology.orchestra.run.smithi117.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T00:27:09.803 INFO:teuthology.orchestra.run.smithi117.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T00:27:09.804 INFO:teuthology.orchestra.run.smithi117.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T00:27:09.804 INFO:teuthology.orchestra.run.smithi117.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T00:27:09.804 INFO:teuthology.orchestra.run.smithi117.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T00:27:09.804 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T00:27:09.804 INFO:teuthology.orchestra.run.smithi117.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T00:27:09.804 INFO:teuthology.orchestra.run.smithi117.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T00:27:09.804 INFO:teuthology.orchestra.run.smithi117.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T00:27:09.804 INFO:teuthology.orchestra.run.smithi117.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T00:27:09.804 INFO:teuthology.orchestra.run.smithi117.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T00:27:09.804 INFO:teuthology.orchestra.run.smithi117.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T00:27:09.804 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:09.805 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:09.805 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-nbd-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:09.805 INFO:teuthology.orchestra.run.smithi117.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T00:27:09.805 INFO:teuthology.orchestra.run.smithi117.stdout: rtkit-0.11-29.el9.x86_64 2024-09-12T00:27:09.805 INFO:teuthology.orchestra.run.smithi117.stdout: s3cmd-2.4.0-1.el9.noarch 2024-09-12T00:27:09.805 INFO:teuthology.orchestra.run.smithi117.stdout: sisu-1:0.3.4-10.el9.noarch 2024-09-12T00:27:09.805 INFO:teuthology.orchestra.run.smithi117.stdout: slf4j-1.7.30-13.el9.noarch 2024-09-12T00:27:09.805 INFO:teuthology.orchestra.run.smithi117.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T00:27:09.805 INFO:teuthology.orchestra.run.smithi117.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-09-12T00:27:09.805 INFO:teuthology.orchestra.run.smithi117.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T00:27:09.805 INFO:teuthology.orchestra.run.smithi117.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-09-12T00:27:09.805 INFO:teuthology.orchestra.run.smithi117.stdout: tracker-3.1.2-3.el9.x86_64 2024-09-12T00:27:09.805 INFO:teuthology.orchestra.run.smithi117.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-09-12T00:27:09.806 INFO:teuthology.orchestra.run.smithi117.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-09-12T00:27:09.806 INFO:teuthology.orchestra.run.smithi117.stdout: tzdata-java-2024a-2.el9.noarch 2024-09-12T00:27:09.806 INFO:teuthology.orchestra.run.smithi117.stdout: upower-0.99.11-11.el9.x86_64 2024-09-12T00:27:09.806 INFO:teuthology.orchestra.run.smithi117.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-09-12T00:27:09.806 INFO:teuthology.orchestra.run.smithi117.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-09-12T00:27:09.806 INFO:teuthology.orchestra.run.smithi117.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-09-12T00:27:09.806 INFO:teuthology.orchestra.run.smithi117.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-09-12T00:27:09.806 INFO:teuthology.orchestra.run.smithi117.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-09-12T00:27:09.806 INFO:teuthology.orchestra.run.smithi117.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-09-12T00:27:09.807 INFO:teuthology.orchestra.run.smithi117.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-09-12T00:27:09.807 INFO:teuthology.orchestra.run.smithi117.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T00:27:09.807 INFO:teuthology.orchestra.run.smithi117.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-09-12T00:27:09.807 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T00:27:09.807 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-12T00:27:10.188 DEBUG:teuthology.parallel:result is None 2024-09-12T00:27:12.792 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:27:12.792 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:27:12.792 INFO:teuthology.orchestra.run.smithi073.stdout:Upgraded: 2024-09-12T00:27:12.792 INFO:teuthology.orchestra.run.smithi073.stdout: librados2-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:12.792 INFO:teuthology.orchestra.run.smithi073.stdout: librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:12.792 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-12T00:27:12.792 INFO:teuthology.orchestra.run.smithi073.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-09-12T00:27:12.792 INFO:teuthology.orchestra.run.smithi073.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T00:27:12.793 INFO:teuthology.orchestra.run.smithi073.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-09-12T00:27:12.793 INFO:teuthology.orchestra.run.smithi073.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-09-12T00:27:12.793 INFO:teuthology.orchestra.run.smithi073.stdout: alsa-lib-1.2.12-1.el9.x86_64 2024-09-12T00:27:12.793 INFO:teuthology.orchestra.run.smithi073.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-09-12T00:27:12.793 INFO:teuthology.orchestra.run.smithi073.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-09-12T00:27:12.793 INFO:teuthology.orchestra.run.smithi073.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-09-12T00:27:12.793 INFO:teuthology.orchestra.run.smithi073.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-09-12T00:27:12.793 INFO:teuthology.orchestra.run.smithi073.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-09-12T00:27:12.793 INFO:teuthology.orchestra.run.smithi073.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-09-12T00:27:12.793 INFO:teuthology.orchestra.run.smithi073.stdout: atinject-1.0.3-6.el9.noarch 2024-09-12T00:27:12.793 INFO:teuthology.orchestra.run.smithi073.stdout: atk-2.36.0-5.el9.x86_64 2024-09-12T00:27:12.793 INFO:teuthology.orchestra.run.smithi073.stdout: avahi-glib-0.8-21.el9.x86_64 2024-09-12T00:27:12.793 INFO:teuthology.orchestra.run.smithi073.stdout: bluez-libs-5.56-6.el9.x86_64 2024-09-12T00:27:12.794 INFO:teuthology.orchestra.run.smithi073.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T00:27:12.794 INFO:teuthology.orchestra.run.smithi073.stdout: bubblewrap-0.4.1-7.el9.x86_64 2024-09-12T00:27:12.794 INFO:teuthology.orchestra.run.smithi073.stdout: cdi-api-2.0.2-6.el9.noarch 2024-09-12T00:27:12.794 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:12.794 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:12.794 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:12.794 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:12.794 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-grafana-dashboards-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:27:12.794 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-immutable-object-cache-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:12.794 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:12.794 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:12.794 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:27:12.794 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:27:12.795 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:27:12.795 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:27:12.795 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:27:12.795 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:12.795 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:12.795 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-prometheus-alerts-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:27:12.795 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:12.795 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:12.795 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-test-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:12.795 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:27:12.795 INFO:teuthology.orchestra.run.smithi073.stdout: cephadm-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:27:12.795 INFO:teuthology.orchestra.run.smithi073.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-09-12T00:27:12.795 INFO:teuthology.orchestra.run.smithi073.stdout: composefs-libs-1.0.5-1.el9.x86_64 2024-09-12T00:27:12.796 INFO:teuthology.orchestra.run.smithi073.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-09-12T00:27:12.796 INFO:teuthology.orchestra.run.smithi073.stdout: cups-libs-1:2.3.3op2-30.el9.x86_64 2024-09-12T00:27:12.796 INFO:teuthology.orchestra.run.smithi073.stdout: dconf-0.40.0-6.el9.x86_64 2024-09-12T00:27:12.796 INFO:teuthology.orchestra.run.smithi073.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-09-12T00:27:12.796 INFO:teuthology.orchestra.run.smithi073.stdout: exiv2-0.27.5-2.el9.x86_64 2024-09-12T00:27:12.796 INFO:teuthology.orchestra.run.smithi073.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-09-12T00:27:12.796 INFO:teuthology.orchestra.run.smithi073.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-09-12T00:27:12.796 INFO:teuthology.orchestra.run.smithi073.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-09-12T00:27:12.796 INFO:teuthology.orchestra.run.smithi073.stdout: flatpak-1.12.9-1.el9.x86_64 2024-09-12T00:27:12.796 INFO:teuthology.orchestra.run.smithi073.stdout: flatpak-selinux-1.12.9-1.el9.noarch 2024-09-12T00:27:12.796 INFO:teuthology.orchestra.run.smithi073.stdout: flatpak-session-helper-1.12.9-1.el9.x86_64 2024-09-12T00:27:12.796 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T00:27:12.796 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T00:27:12.796 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T00:27:12.797 INFO:teuthology.orchestra.run.smithi073.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T00:27:12.797 INFO:teuthology.orchestra.run.smithi073.stdout: gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 2024-09-12T00:27:12.797 INFO:teuthology.orchestra.run.smithi073.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-09-12T00:27:12.797 INFO:teuthology.orchestra.run.smithi073.stdout: giflib-5.2.1-9.el9.x86_64 2024-09-12T00:27:12.797 INFO:teuthology.orchestra.run.smithi073.stdout: google-guice-4.2.3-9.el9.noarch 2024-09-12T00:27:12.797 INFO:teuthology.orchestra.run.smithi073.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T00:27:12.797 INFO:teuthology.orchestra.run.smithi073.stdout: graphene-1.10.6-2.el9.x86_64 2024-09-12T00:27:12.797 INFO:teuthology.orchestra.run.smithi073.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T00:27:12.797 INFO:teuthology.orchestra.run.smithi073.stdout: gsm-1.0.19-6.el9.x86_64 2024-09-12T00:27:12.797 INFO:teuthology.orchestra.run.smithi073.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-09-12T00:27:12.797 INFO:teuthology.orchestra.run.smithi073.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-09-12T00:27:12.797 INFO:teuthology.orchestra.run.smithi073.stdout: gtk-update-icon-cache-3.24.31-5.el9.x86_64 2024-09-12T00:27:12.797 INFO:teuthology.orchestra.run.smithi073.stdout: gtk3-3.24.31-5.el9.x86_64 2024-09-12T00:27:12.798 INFO:teuthology.orchestra.run.smithi073.stdout: guava-30.1-6.el9.noarch 2024-09-12T00:27:12.798 INFO:teuthology.orchestra.run.smithi073.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-09-12T00:27:12.798 INFO:teuthology.orchestra.run.smithi073.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-09-12T00:27:12.798 INFO:teuthology.orchestra.run.smithi073.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-09-12T00:27:12.798 INFO:teuthology.orchestra.run.smithi073.stdout: iso-codes-4.6.0-3.el9.noarch 2024-09-12T00:27:12.798 INFO:teuthology.orchestra.run.smithi073.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-09-12T00:27:12.798 INFO:teuthology.orchestra.run.smithi073.stdout: jansi-2.3.3-6.el9.x86_64 2024-09-12T00:27:12.798 INFO:teuthology.orchestra.run.smithi073.stdout: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T00:27:12.798 INFO:teuthology.orchestra.run.smithi073.stdout: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T00:27:12.798 INFO:teuthology.orchestra.run.smithi073.stdout: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T00:27:12.798 INFO:teuthology.orchestra.run.smithi073.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-09-12T00:27:12.798 INFO:teuthology.orchestra.run.smithi073.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-09-12T00:27:12.798 INFO:teuthology.orchestra.run.smithi073.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-09-12T00:27:12.799 INFO:teuthology.orchestra.run.smithi073.stdout: jsoup-1.13.1-10.el9.noarch 2024-09-12T00:27:12.799 INFO:teuthology.orchestra.run.smithi073.stdout: jsr-305-3.0.2-6.el9.noarch 2024-09-12T00:27:12.799 INFO:teuthology.orchestra.run.smithi073.stdout: lcms2-2.12-3.el9.x86_64 2024-09-12T00:27:12.799 INFO:teuthology.orchestra.run.smithi073.stdout: libX11-xcb-1.7.0-9.el9.x86_64 2024-09-12T00:27:12.799 INFO:teuthology.orchestra.run.smithi073.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-09-12T00:27:12.799 INFO:teuthology.orchestra.run.smithi073.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-09-12T00:27:12.799 INFO:teuthology.orchestra.run.smithi073.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-09-12T00:27:12.799 INFO:teuthology.orchestra.run.smithi073.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-09-12T00:27:12.799 INFO:teuthology.orchestra.run.smithi073.stdout: libXi-1.7.10-8.el9.x86_64 2024-09-12T00:27:12.799 INFO:teuthology.orchestra.run.smithi073.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-09-12T00:27:12.799 INFO:teuthology.orchestra.run.smithi073.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-09-12T00:27:12.799 INFO:teuthology.orchestra.run.smithi073.stdout: libXtst-1.2.3-16.el9.x86_64 2024-09-12T00:27:12.799 INFO:teuthology.orchestra.run.smithi073.stdout: libXv-1.0.11-16.el9.x86_64 2024-09-12T00:27:12.799 INFO:teuthology.orchestra.run.smithi073.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-09-12T00:27:12.800 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T00:27:12.800 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T00:27:12.800 INFO:teuthology.orchestra.run.smithi073.stdout: libasyncns-0.8-22.el9.x86_64 2024-09-12T00:27:12.800 INFO:teuthology.orchestra.run.smithi073.stdout: libcanberra-0.30-27.el9.x86_64 2024-09-12T00:27:12.800 INFO:teuthology.orchestra.run.smithi073.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-09-12T00:27:12.800 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs-devel-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:12.800 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:12.800 INFO:teuthology.orchestra.run.smithi073.stdout: libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:12.800 INFO:teuthology.orchestra.run.smithi073.stdout: libdrm-2.4.121-1.el9.x86_64 2024-09-12T00:27:12.800 INFO:teuthology.orchestra.run.smithi073.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-09-12T00:27:12.800 INFO:teuthology.orchestra.run.smithi073.stdout: libexif-0.6.22-6.el9.x86_64 2024-09-12T00:27:12.800 INFO:teuthology.orchestra.run.smithi073.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-09-12T00:27:12.800 INFO:teuthology.orchestra.run.smithi073.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-09-12T00:27:12.801 INFO:teuthology.orchestra.run.smithi073.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T00:27:12.801 INFO:teuthology.orchestra.run.smithi073.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-09-12T00:27:12.801 INFO:teuthology.orchestra.run.smithi073.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-09-12T00:27:12.801 INFO:teuthology.orchestra.run.smithi073.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-09-12T00:27:12.801 INFO:teuthology.orchestra.run.smithi073.stdout: libgsf-1.14.47-5.el9.x86_64 2024-09-12T00:27:12.801 INFO:teuthology.orchestra.run.smithi073.stdout: libgxps-0.3.2-3.el9.x86_64 2024-09-12T00:27:12.801 INFO:teuthology.orchestra.run.smithi073.stdout: libiptcdata-1.0.5-10.el9.x86_64 2024-09-12T00:27:12.801 INFO:teuthology.orchestra.run.smithi073.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-09-12T00:27:12.801 INFO:teuthology.orchestra.run.smithi073.stdout: libnotify-0.7.9-8.el9.x86_64 2024-09-12T00:27:12.801 INFO:teuthology.orchestra.run.smithi073.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T00:27:12.801 INFO:teuthology.orchestra.run.smithi073.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-09-12T00:27:12.801 INFO:teuthology.orchestra.run.smithi073.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-09-12T00:27:12.801 INFO:teuthology.orchestra.run.smithi073.stdout: libpciaccess-0.16-7.el9.x86_64 2024-09-12T00:27:12.801 INFO:teuthology.orchestra.run.smithi073.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T00:27:12.802 INFO:teuthology.orchestra.run.smithi073.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T00:27:12.802 INFO:teuthology.orchestra.run.smithi073.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T00:27:12.802 INFO:teuthology.orchestra.run.smithi073.stdout: librados-devel-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:12.802 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:12.802 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T00:27:12.802 INFO:teuthology.orchestra.run.smithi073.stdout: librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:12.802 INFO:teuthology.orchestra.run.smithi073.stdout: libsbc-1.4-9.el9.x86_64 2024-09-12T00:27:12.802 INFO:teuthology.orchestra.run.smithi073.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-09-12T00:27:12.802 INFO:teuthology.orchestra.run.smithi073.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-09-12T00:27:12.802 INFO:teuthology.orchestra.run.smithi073.stdout: libtiff-4.4.0-13.el9.x86_64 2024-09-12T00:27:12.802 INFO:teuthology.orchestra.run.smithi073.stdout: libtool-ltdl-2.4.6-46.el9.x86_64 2024-09-12T00:27:12.802 INFO:teuthology.orchestra.run.smithi073.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-09-12T00:27:12.802 INFO:teuthology.orchestra.run.smithi073.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T00:27:12.803 INFO:teuthology.orchestra.run.smithi073.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-09-12T00:27:12.803 INFO:teuthology.orchestra.run.smithi073.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-09-12T00:27:12.803 INFO:teuthology.orchestra.run.smithi073.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-09-12T00:27:12.803 INFO:teuthology.orchestra.run.smithi073.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-09-12T00:27:12.803 INFO:teuthology.orchestra.run.smithi073.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-09-12T00:27:12.803 INFO:teuthology.orchestra.run.smithi073.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-09-12T00:27:12.803 INFO:teuthology.orchestra.run.smithi073.stdout: libwebp-1.2.0-8.el9.x86_64 2024-09-12T00:27:12.803 INFO:teuthology.orchestra.run.smithi073.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-09-12T00:27:12.803 INFO:teuthology.orchestra.run.smithi073.stdout: libxshmfence-1.3-10.el9.x86_64 2024-09-12T00:27:12.803 INFO:teuthology.orchestra.run.smithi073.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-12T00:27:12.803 INFO:teuthology.orchestra.run.smithi073.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-09-12T00:27:12.803 INFO:teuthology.orchestra.run.smithi073.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T00:27:12.803 INFO:teuthology.orchestra.run.smithi073.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T00:27:12.803 INFO:teuthology.orchestra.run.smithi073.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T00:27:12.804 INFO:teuthology.orchestra.run.smithi073.stdout: lua-posix-35.0-8.el9.x86_64 2024-09-12T00:27:12.804 INFO:teuthology.orchestra.run.smithi073.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T00:27:12.804 INFO:teuthology.orchestra.run.smithi073.stdout: maven-1:3.6.3-15.el9.noarch 2024-09-12T00:27:12.804 INFO:teuthology.orchestra.run.smithi073.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-09-12T00:27:12.804 INFO:teuthology.orchestra.run.smithi073.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-09-12T00:27:12.804 INFO:teuthology.orchestra.run.smithi073.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-09-12T00:27:12.804 INFO:teuthology.orchestra.run.smithi073.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-09-12T00:27:12.804 INFO:teuthology.orchestra.run.smithi073.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-09-12T00:27:12.804 INFO:teuthology.orchestra.run.smithi073.stdout: mesa-dri-drivers-24.1.2-3.el9.x86_64 2024-09-12T00:27:12.804 INFO:teuthology.orchestra.run.smithi073.stdout: mesa-filesystem-24.1.2-3.el9.x86_64 2024-09-12T00:27:12.804 INFO:teuthology.orchestra.run.smithi073.stdout: mesa-libEGL-24.1.2-3.el9.x86_64 2024-09-12T00:27:12.804 INFO:teuthology.orchestra.run.smithi073.stdout: mesa-libGL-24.1.2-3.el9.x86_64 2024-09-12T00:27:12.804 INFO:teuthology.orchestra.run.smithi073.stdout: mesa-libgbm-24.1.2-3.el9.x86_64 2024-09-12T00:27:12.805 INFO:teuthology.orchestra.run.smithi073.stdout: mesa-libglapi-24.1.2-3.el9.x86_64 2024-09-12T00:27:12.805 INFO:teuthology.orchestra.run.smithi073.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-09-12T00:27:12.805 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T00:27:12.805 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T00:27:12.805 INFO:teuthology.orchestra.run.smithi073.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-09-12T00:27:12.805 INFO:teuthology.orchestra.run.smithi073.stdout: opus-1.3.1-10.el9.x86_64 2024-09-12T00:27:12.805 INFO:teuthology.orchestra.run.smithi073.stdout: orc-0.4.31-8.el9.x86_64 2024-09-12T00:27:12.805 INFO:teuthology.orchestra.run.smithi073.stdout: osinfo-db-20240701-2.el9.noarch 2024-09-12T00:27:12.805 INFO:teuthology.orchestra.run.smithi073.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-09-12T00:27:12.805 INFO:teuthology.orchestra.run.smithi073.stdout: ostree-libs-2024.7-2.el9.x86_64 2024-09-12T00:27:12.805 INFO:teuthology.orchestra.run.smithi073.stdout: p11-kit-server-0.25.3-2.el9.x86_64 2024-09-12T00:27:12.805 INFO:teuthology.orchestra.run.smithi073.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T00:27:12.805 INFO:teuthology.orchestra.run.smithi073.stdout: pipewire-1.0.1-1.el9.x86_64 2024-09-12T00:27:12.805 INFO:teuthology.orchestra.run.smithi073.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-09-12T00:27:12.806 INFO:teuthology.orchestra.run.smithi073.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-09-12T00:27:12.806 INFO:teuthology.orchestra.run.smithi073.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-09-12T00:27:12.806 INFO:teuthology.orchestra.run.smithi073.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-09-12T00:27:12.806 INFO:teuthology.orchestra.run.smithi073.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-09-12T00:27:12.806 INFO:teuthology.orchestra.run.smithi073.stdout: plexus-cipher-1.7-27.el9.noarch 2024-09-12T00:27:12.806 INFO:teuthology.orchestra.run.smithi073.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-09-12T00:27:12.806 INFO:teuthology.orchestra.run.smithi073.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-09-12T00:27:12.806 INFO:teuthology.orchestra.run.smithi073.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-09-12T00:27:12.806 INFO:teuthology.orchestra.run.smithi073.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-09-12T00:27:12.806 INFO:teuthology.orchestra.run.smithi073.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-09-12T00:27:12.806 INFO:teuthology.orchestra.run.smithi073.stdout: poppler-21.01.0-21.el9.x86_64 2024-09-12T00:27:12.806 INFO:teuthology.orchestra.run.smithi073.stdout: poppler-data-0.4.9-9.el9.noarch 2024-09-12T00:27:12.806 INFO:teuthology.orchestra.run.smithi073.stdout: poppler-glib-21.01.0-21.el9.x86_64 2024-09-12T00:27:12.806 INFO:teuthology.orchestra.run.smithi073.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T00:27:12.807 INFO:teuthology.orchestra.run.smithi073.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T00:27:12.807 INFO:teuthology.orchestra.run.smithi073.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-09-12T00:27:12.807 INFO:teuthology.orchestra.run.smithi073.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-09-12T00:27:12.807 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T00:27:12.807 INFO:teuthology.orchestra.run.smithi073.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T00:27:12.807 INFO:teuthology.orchestra.run.smithi073.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T00:27:12.807 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T00:27:12.807 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:12.807 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:12.807 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cephfs-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:12.807 INFO:teuthology.orchestra.run.smithi073.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T00:27:12.807 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T00:27:12.807 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T00:27:12.808 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T00:27:12.808 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T00:27:12.808 INFO:teuthology.orchestra.run.smithi073.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T00:27:12.808 INFO:teuthology.orchestra.run.smithi073.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T00:27:12.808 INFO:teuthology.orchestra.run.smithi073.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T00:27:12.808 INFO:teuthology.orchestra.run.smithi073.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T00:27:12.808 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T00:27:12.808 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T00:27:12.808 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T00:27:12.808 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T00:27:12.808 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T00:27:12.808 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T00:27:12.808 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T00:27:12.808 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T00:27:12.809 INFO:teuthology.orchestra.run.smithi073.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T00:27:12.809 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T00:27:12.809 INFO:teuthology.orchestra.run.smithi073.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T00:27:12.809 INFO:teuthology.orchestra.run.smithi073.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T00:27:12.809 INFO:teuthology.orchestra.run.smithi073.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T00:27:12.809 INFO:teuthology.orchestra.run.smithi073.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T00:27:12.809 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T00:27:12.809 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T00:27:12.809 INFO:teuthology.orchestra.run.smithi073.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T00:27:12.809 INFO:teuthology.orchestra.run.smithi073.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T00:27:12.809 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T00:27:12.809 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T00:27:12.810 INFO:teuthology.orchestra.run.smithi073.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T00:27:12.810 INFO:teuthology.orchestra.run.smithi073.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T00:27:12.810 INFO:teuthology.orchestra.run.smithi073.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T00:27:12.810 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T00:27:12.810 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T00:27:12.810 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T00:27:12.810 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T00:27:12.810 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T00:27:12.810 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:12.811 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rbd-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:12.811 INFO:teuthology.orchestra.run.smithi073.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T00:27:12.811 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T00:27:12.811 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T00:27:12.811 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rgw-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:12.811 INFO:teuthology.orchestra.run.smithi073.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T00:27:12.811 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T00:27:12.811 INFO:teuthology.orchestra.run.smithi073.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T00:27:12.811 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T00:27:12.812 INFO:teuthology.orchestra.run.smithi073.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T00:27:12.812 INFO:teuthology.orchestra.run.smithi073.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T00:27:12.812 INFO:teuthology.orchestra.run.smithi073.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T00:27:12.812 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T00:27:12.812 INFO:teuthology.orchestra.run.smithi073.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T00:27:12.812 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T00:27:12.812 INFO:teuthology.orchestra.run.smithi073.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T00:27:12.812 INFO:teuthology.orchestra.run.smithi073.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T00:27:12.812 INFO:teuthology.orchestra.run.smithi073.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T00:27:12.812 INFO:teuthology.orchestra.run.smithi073.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T00:27:12.812 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:12.812 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:12.813 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-nbd-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:27:12.813 INFO:teuthology.orchestra.run.smithi073.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T00:27:12.813 INFO:teuthology.orchestra.run.smithi073.stdout: rtkit-0.11-29.el9.x86_64 2024-09-12T00:27:12.813 INFO:teuthology.orchestra.run.smithi073.stdout: s3cmd-2.4.0-1.el9.noarch 2024-09-12T00:27:12.813 INFO:teuthology.orchestra.run.smithi073.stdout: sisu-1:0.3.4-10.el9.noarch 2024-09-12T00:27:12.813 INFO:teuthology.orchestra.run.smithi073.stdout: slf4j-1.7.30-13.el9.noarch 2024-09-12T00:27:12.813 INFO:teuthology.orchestra.run.smithi073.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T00:27:12.813 INFO:teuthology.orchestra.run.smithi073.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-09-12T00:27:12.813 INFO:teuthology.orchestra.run.smithi073.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T00:27:12.813 INFO:teuthology.orchestra.run.smithi073.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-09-12T00:27:12.813 INFO:teuthology.orchestra.run.smithi073.stdout: tracker-3.1.2-3.el9.x86_64 2024-09-12T00:27:12.813 INFO:teuthology.orchestra.run.smithi073.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-09-12T00:27:12.813 INFO:teuthology.orchestra.run.smithi073.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-09-12T00:27:12.814 INFO:teuthology.orchestra.run.smithi073.stdout: tzdata-java-2024a-2.el9.noarch 2024-09-12T00:27:12.814 INFO:teuthology.orchestra.run.smithi073.stdout: upower-0.99.11-11.el9.x86_64 2024-09-12T00:27:12.814 INFO:teuthology.orchestra.run.smithi073.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-09-12T00:27:12.814 INFO:teuthology.orchestra.run.smithi073.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-09-12T00:27:12.814 INFO:teuthology.orchestra.run.smithi073.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-09-12T00:27:12.814 INFO:teuthology.orchestra.run.smithi073.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-09-12T00:27:12.814 INFO:teuthology.orchestra.run.smithi073.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-09-12T00:27:12.814 INFO:teuthology.orchestra.run.smithi073.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-09-12T00:27:12.814 INFO:teuthology.orchestra.run.smithi073.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-09-12T00:27:12.814 INFO:teuthology.orchestra.run.smithi073.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T00:27:12.815 INFO:teuthology.orchestra.run.smithi073.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-09-12T00:27:12.815 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:27:12.815 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-12T00:27:13.265 DEBUG:teuthology.parallel:result is None 2024-09-12T00:27:13.266 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:27:13.420 DEBUG:teuthology.orchestra.run.smithi073:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T00:27:13.478 INFO:teuthology.orchestra.run.smithi073.stdout:19.3.0-4753.gd011c522.el9 2024-09-12T00:27:13.479 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4753.gd011c522.el9 2024-09-12T00:27:13.479 INFO:teuthology.task.install:The correct ceph version 19.3.0-4753.gd011c522 is installed. 2024-09-12T00:27:13.480 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:27:13.633 DEBUG:teuthology.orchestra.run.smithi117:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T00:27:13.697 INFO:teuthology.orchestra.run.smithi117.stdout:19.3.0-4753.gd011c522.el9 2024-09-12T00:27:13.697 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4753.gd011c522.el9 2024-09-12T00:27:13.697 INFO:teuthology.task.install:The correct ceph version 19.3.0-4753.gd011c522 is installed. 2024-09-12T00:27:13.699 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T00:27:13.699 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T00:27:13.699 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T00:27:13.744 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-12T00:27:13.744 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T00:27:13.791 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T00:27:13.791 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T00:27:13.791 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T00:27:13.832 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T00:27:13.913 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-12T00:27:13.913 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T00:27:13.956 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T00:27:14.038 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T00:27:14.039 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T00:27:14.039 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T00:27:14.078 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T00:27:14.157 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-12T00:27:14.157 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T00:27:14.197 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T00:27:14.278 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T00:27:14.278 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T00:27:14.278 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T00:27:14.317 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T00:27:14.396 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-12T00:27:14.396 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T00:27:14.436 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T00:27:14.515 INFO:teuthology.run_tasks:Running task ceph... 2024-09-12T00:27:14.638 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-12T00:27:14.638 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 777 /var/log/ceph 2024-09-12T00:27:14.640 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 777 /var/log/ceph 2024-09-12T00:27:14.680 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-12T00:27:14.680 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T00:27:14.719 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T00:27:14.757 INFO:tasks.ceph:Creating extra log directories... 2024-09-12T00:27:14.758 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T00:27:14.799 DEBUG:teuthology.orchestra.run.smithi117:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T00:27:14.873 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-12T00:27:14.873 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-12T00:27:14.874 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901864', 'branch': 'wip-cls-rgw-busy-resharding', 'description': 'rgw/verify/{0-install accounts$/{main} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind}', 'email': None, 'first_in_suite': False, 'job_id': '7901864', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-cls-rgw-busy-resharding'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}}, 'openssl_keys': {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}}, 'rgw': {'client.0': {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']}, 'compression type': 'random', 'ec-data-pool': False, 'frontend': 'beast', 'inline data': False, 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 main': 'RGW11111111111111111'}, 'force-branch': 'ceph-master', 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-67986', 'sha1': '6a169fc940965ab446a63954fde870aa497efde7'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 2206, 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-67986', 'suite_path': '/home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/cbodley/ceph.git', 'suite_sha1': '6a169fc940965ab446a63954fde870aa497efde7', 'targets': {'smithi073.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEb8ri1JP2kCtFtNvYymNdRYFkeVsX9IVWIyxPzaT4aWIzUgBo49sh9dWVoBBQPvhUXjLsZJdjyZ9dI2GCLHdXc=', 'smithi117.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMq1eEhnterC40EScosx0v3fMTYmPoiPQS+GNY/pEOxFvA47H6j3xp3v9o0q6dCnEc+NkJXfrhINIAb3c3d1l3E='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'force-branch': 'wip-67986', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-11_23:33:24', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-12T00:27:14.874 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T00:27:14.878 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T00:27:14.907 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T00:27:14.947 DEBUG:teuthology.orchestra.run.smithi117:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T00:27:14.986 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T00:27:14.986 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T00:27:15.051 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T00:27:15.051 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_1 2024-09-12T00:27:15.121 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T00:27:15.122 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:27:15.122 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-12T00:27:15.122 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:27:15.122 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:27:15.122 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-09-12 00:27:00.304617783 +0000 2024-09-12T00:27:15.123 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-09-12 00:24:35.045076311 +0000 2024-09-12T00:27:15.123 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-09-12 00:24:35.045076311 +0000 2024-09-12T00:27:15.123 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-09-12 00:24:35.045076311 +0000 2024-09-12T00:27:15.123 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T00:27:15.198 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-09-12T00:27:15.199 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-09-12T00:27:15.199 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.00020638 s, 2.5 MB/s 2024-09-12T00:27:15.200 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T00:27:15.271 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_2 2024-09-12T00:27:15.340 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T00:27:15.340 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:27:15.340 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-12T00:27:15.340 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:27:15.340 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:27:15.340 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-09-12 00:27:00.304617783 +0000 2024-09-12T00:27:15.340 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-09-12 00:24:35.378068834 +0000 2024-09-12T00:27:15.341 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-09-12 00:24:35.378068834 +0000 2024-09-12T00:27:15.341 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-09-12 00:24:35.378068834 +0000 2024-09-12T00:27:15.341 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T00:27:15.417 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-09-12T00:27:15.417 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-09-12T00:27:15.417 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000178788 s, 2.9 MB/s 2024-09-12T00:27:15.418 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T00:27:15.489 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_3 2024-09-12T00:27:15.559 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T00:27:15.559 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:27:15.559 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-12T00:27:15.559 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:27:15.559 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:27:15.559 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-09-12 00:27:00.305617761 +0000 2024-09-12T00:27:15.559 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-09-12 00:24:35.703061535 +0000 2024-09-12T00:27:15.559 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-09-12 00:24:35.703061535 +0000 2024-09-12T00:27:15.559 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-09-12 00:24:35.703061535 +0000 2024-09-12T00:27:15.559 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T00:27:15.637 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-09-12T00:27:15.637 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-09-12T00:27:15.638 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000208376 s, 2.5 MB/s 2024-09-12T00:27:15.639 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T00:27:15.709 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_4 2024-09-12T00:27:15.778 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T00:27:15.778 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:27:15.779 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-12T00:27:15.779 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:27:15.779 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:27:15.779 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-09-12 00:27:00.305617761 +0000 2024-09-12T00:27:15.779 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-09-12 00:24:36.037054035 +0000 2024-09-12T00:27:15.780 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-09-12 00:24:36.037054035 +0000 2024-09-12T00:27:15.780 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-09-12 00:24:36.037054035 +0000 2024-09-12T00:27:15.780 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T00:27:15.856 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-09-12T00:27:15.856 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-09-12T00:27:15.856 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000193167 s, 2.7 MB/s 2024-09-12T00:27:15.857 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T00:27:15.926 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:27:15.926 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-12T00:27:15.926 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T00:27:15.960 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T00:27:15.960 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_1 2024-09-12T00:27:16.033 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T00:27:16.033 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:27:16.033 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-12T00:27:16.033 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:27:16.033 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:27:16.033 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-09-12 00:26:57.213629581 +0000 2024-09-12T00:27:16.033 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-09-12 00:24:35.034692706 +0000 2024-09-12T00:27:16.034 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-09-12 00:24:35.034692706 +0000 2024-09-12T00:27:16.034 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-09-12 00:24:35.034692706 +0000 2024-09-12T00:27:16.034 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T00:27:16.113 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-09-12T00:27:16.113 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-09-12T00:27:16.113 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000213159 s, 2.4 MB/s 2024-09-12T00:27:16.114 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T00:27:16.186 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_2 2024-09-12T00:27:16.256 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T00:27:16.257 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:27:16.257 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-12T00:27:16.257 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:27:16.257 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:27:16.257 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-09-12 00:26:57.214629561 +0000 2024-09-12T00:27:16.258 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-09-12 00:24:35.363686225 +0000 2024-09-12T00:27:16.258 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-09-12 00:24:35.363686225 +0000 2024-09-12T00:27:16.258 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-09-12 00:24:35.363686225 +0000 2024-09-12T00:27:16.259 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T00:27:16.333 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-09-12T00:27:16.333 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-09-12T00:27:16.333 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000192923 s, 2.7 MB/s 2024-09-12T00:27:16.334 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T00:27:16.404 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_3 2024-09-12T00:27:16.474 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T00:27:16.474 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:27:16.474 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-12T00:27:16.474 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:27:16.474 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:27:16.474 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-09-12 00:26:57.214629561 +0000 2024-09-12T00:27:16.474 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-09-12 00:24:35.692679744 +0000 2024-09-12T00:27:16.475 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-09-12 00:24:35.692679744 +0000 2024-09-12T00:27:16.475 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-09-12 00:24:35.692679744 +0000 2024-09-12T00:27:16.475 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T00:27:16.550 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-09-12T00:27:16.551 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-09-12T00:27:16.551 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.00020778 s, 2.5 MB/s 2024-09-12T00:27:16.552 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T00:27:16.621 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_4 2024-09-12T00:27:16.689 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T00:27:16.690 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:27:16.690 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-12T00:27:16.690 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:27:16.690 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:27:16.690 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-09-12 00:26:57.214629561 +0000 2024-09-12T00:27:16.690 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-09-12 00:24:36.027673145 +0000 2024-09-12T00:27:16.690 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-09-12 00:24:36.027673145 +0000 2024-09-12T00:27:16.690 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-09-12 00:24:36.027673145 +0000 2024-09-12T00:27:16.690 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T00:27:16.767 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-09-12T00:27:16.767 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-09-12T00:27:16.767 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000212558 s, 2.4 MB/s 2024-09-12T00:27:16.769 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T00:27:16.839 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:27:16.839 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi073.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi117.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T00:27:16.839 INFO:tasks.ceph:Generating config... 2024-09-12T00:27:16.840 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-12T00:27:16.841 INFO:tasks.ceph:[client] debug rgw notification = 20 2024-09-12T00:27:16.841 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2024-09-12T00:27:16.841 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-09-12T00:27:16.841 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-09-12T00:27:16.841 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T00:27:16.841 INFO:tasks.ceph:[client] rgw max chunk size = 4194304 2024-09-12T00:27:16.841 INFO:tasks.ceph:[client] rgw obj stripe size = 6291456 2024-09-12T00:27:16.841 INFO:tasks.ceph:[client] rgw reshard progress judge interval = 10 2024-09-12T00:27:16.841 INFO:tasks.ceph:[client] rgw s3 auth use sts = True 2024-09-12T00:27:16.841 INFO:tasks.ceph:[client] rgw sts key = abcdefghijklmnop 2024-09-12T00:27:16.841 INFO:tasks.ceph:[client] rgw torrent flag = True 2024-09-12T00:27:16.841 INFO:tasks.ceph:[client] rgw user counters cache = True 2024-09-12T00:27:16.841 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-12T00:27:16.842 INFO:tasks.ceph:[client] setuser = ceph 2024-09-12T00:27:16.842 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-12T00:27:16.842 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-12T00:27:16.842 INFO:tasks.ceph:[global] osd heartbeat grace = 40 2024-09-12T00:27:16.842 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-09-12T00:27:16.842 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-09-12T00:27:16.842 INFO:tasks.ceph:[global] rgw override bucket index max shards = 1 2024-09-12T00:27:16.842 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-12T00:27:16.842 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-12T00:27:16.842 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-12T00:27:16.842 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-12T00:27:16.842 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-12T00:27:16.842 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2024-09-12T00:27:16.842 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-12T00:27:16.843 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-12T00:27:16.843 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-12T00:27:16.843 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-12T00:27:16.843 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-12T00:27:16.843 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-12T00:27:16.843 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-12T00:27:16.843 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-12T00:27:16.843 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-12T00:27:16.843 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-12T00:27:16.843 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-12T00:27:16.843 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-12T00:27:16.843 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-12T00:27:16.843 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-12T00:27:16.844 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-12T00:27:16.844 INFO:tasks.ceph:[osd] osd fast shutdown = False 2024-09-12T00:27:16.844 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-12T00:27:16.844 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-12T00:27:16.844 INFO:tasks.ceph:Setting up mon.a... 2024-09-12T00:27:16.844 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-12T00:27:16.921 INFO:teuthology.orchestra.run.smithi073.stdout:creating /etc/ceph/ceph.keyring 2024-09-12T00:27:16.925 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-12T00:27:16.990 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T00:27:17.031 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.73'), ('mon.c', '[v2:172.21.15.73:3301,v1:172.21.15.73:6790]'), ('mon.b', '172.21.15.117')] 2024-09-12T00:27:17.031 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790],172.21.15.117', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-12T00:27:17.032 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T00:27:17.032 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T00:27:17.101 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.73 --addv c '[v2:172.21.15.73:3301,v1:172.21.15.73:6790]' --add b 172.21.15.117 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:27:17.202 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:27:17.202 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:27:17.203 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:27:17.203 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: generated fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:27:17.203 INFO:teuthology.orchestra.run.smithi073.stdout:setting min_mon_release = quincy 2024-09-12T00:27:17.203 INFO:teuthology.orchestra.run.smithi073.stdout:epoch 0 2024-09-12T00:27:17.203 INFO:teuthology.orchestra.run.smithi073.stdout:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:27:17.203 INFO:teuthology.orchestra.run.smithi073.stdout:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:27:17.203 INFO:teuthology.orchestra.run.smithi073.stdout:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:27:17.203 INFO:teuthology.orchestra.run.smithi073.stdout:min_mon_release 17 (quincy) 2024-09-12T00:27:17.203 INFO:teuthology.orchestra.run.smithi073.stdout:election_strategy: 1 2024-09-12T00:27:17.203 INFO:teuthology.orchestra.run.smithi073.stdout:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:27:17.203 INFO:teuthology.orchestra.run.smithi073.stdout:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:27:17.203 INFO:teuthology.orchestra.run.smithi073.stdout:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:27:17.204 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-12T00:27:17.205 DEBUG:teuthology.orchestra.run.smithi073:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T00:27:17.232 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID f020195c-ad88-4fe3-a760-71957da35598... 2024-09-12T00:27:17.233 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T00:27:17.275 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T00:27:17.329 INFO:teuthology.orchestra.run.smithi073.stdout:[global] 2024-09-12T00:27:17.329 INFO:teuthology.orchestra.run.smithi073.stdout: chdir = "" 2024-09-12T00:27:17.329 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T00:27:17.329 INFO:teuthology.orchestra.run.smithi073.stdout: auth supported = cephx 2024-09-12T00:27:17.329 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:27:17.329 INFO:teuthology.orchestra.run.smithi073.stdout: filestore xattr use omap = true 2024-09-12T00:27:17.329 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:27:17.329 INFO:teuthology.orchestra.run.smithi073.stdout: mon clock drift allowed = 1.000 2024-09-12T00:27:17.329 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:27:17.329 INFO:teuthology.orchestra.run.smithi073.stdout: osd crush chooseleaf type = 0 2024-09-12T00:27:17.329 INFO:teuthology.orchestra.run.smithi073.stdout: auth debug = true 2024-09-12T00:27:17.329 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:27:17.330 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on old message = true 2024-09-12T00:27:17.330 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on bug = true 2024-09-12T00:27:17.330 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:27:17.330 INFO:teuthology.orchestra.run.smithi073.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T00:27:17.330 INFO:teuthology.orchestra.run.smithi073.stdout: mon pg warn max object skew = 0 2024-09-12T00:27:17.330 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:27:17.330 INFO:teuthology.orchestra.run.smithi073.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T00:27:17.330 INFO:teuthology.orchestra.run.smithi073.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T00:27:17.330 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:27:17.330 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default size = 2 2024-09-12T00:27:17.330 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:27:17.330 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow primary affinity = true 2024-09-12T00:27:17.330 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow pg remap = true 2024-09-12T00:27:17.330 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on legacy crush tunables = false 2024-09-12T00:27:17.331 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on crush straw calc version zero = false 2024-09-12T00:27:17.331 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on no sortbitwise = false 2024-09-12T00:27:17.331 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on osd down out interval zero = false 2024-09-12T00:27:17.331 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on too few osds = false 2024-09-12T00:27:17.331 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T00:27:17.331 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T00:27:17.331 INFO:teuthology.orchestra.run.smithi073.stdout: mon_allow_pool_size_one = true 2024-09-12T00:27:17.331 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:27:17.331 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T00:27:17.331 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:27:17.331 INFO:teuthology.orchestra.run.smithi073.stdout: osd default data pool replay window = 5 2024-09-12T00:27:17.331 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:27:17.331 INFO:teuthology.orchestra.run.smithi073.stdout: mon allow pool delete = true 2024-09-12T00:27:17.331 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:27:17.332 INFO:teuthology.orchestra.run.smithi073.stdout: mon cluster log file level = debug 2024-09-12T00:27:17.332 INFO:teuthology.orchestra.run.smithi073.stdout: debug asserts on shutdown = true 2024-09-12T00:27:17.332 INFO:teuthology.orchestra.run.smithi073.stdout: mon health detail to clog = false 2024-09-12T00:27:17.332 INFO:teuthology.orchestra.run.smithi073.stdout: mon host = "172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790],172.21.15.117" 2024-09-12T00:27:17.332 INFO:teuthology.orchestra.run.smithi073.stdout: mon client directed command retry = 5 2024-09-12T00:27:17.333 INFO:teuthology.orchestra.run.smithi073.stdout: ms inject socket failures = 5000 2024-09-12T00:27:17.333 INFO:teuthology.orchestra.run.smithi073.stdout: osd heartbeat grace = 40 2024-09-12T00:27:17.333 INFO:teuthology.orchestra.run.smithi073.stdout: osd_max_pg_log_entries = 10 2024-09-12T00:27:17.333 INFO:teuthology.orchestra.run.smithi073.stdout: osd_min_pg_log_entries = 10 2024-09-12T00:27:17.333 INFO:teuthology.orchestra.run.smithi073.stdout: rgw override bucket index max shards = 1 2024-09-12T00:27:17.333 INFO:teuthology.orchestra.run.smithi073.stdout: fsid = f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:27:17.333 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:27:17.333 INFO:teuthology.orchestra.run.smithi073.stdout:[osd] 2024-09-12T00:27:17.333 INFO:teuthology.orchestra.run.smithi073.stdout: osd journal size = 100 2024-09-12T00:27:17.333 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:27:17.333 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub load threshold = 5.0 2024-09-12T00:27:17.334 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub max interval = 600 2024-09-12T00:27:17.334 INFO:teuthology.orchestra.run.smithi073.stdout: osd mclock profile = high_recovery_ops 2024-09-12T00:27:17.334 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:27:17.334 INFO:teuthology.orchestra.run.smithi073.stdout: osd recover clone overlap = true 2024-09-12T00:27:17.334 INFO:teuthology.orchestra.run.smithi073.stdout: osd recovery max chunk = 1048576 2024-09-12T00:27:17.334 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:27:17.334 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug shutdown = true 2024-09-12T00:27:17.334 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug op order = true 2024-09-12T00:27:17.334 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug verify stray on activate = true 2024-09-12T00:27:17.334 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug trim objects = true 2024-09-12T00:27:17.334 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:27:17.334 INFO:teuthology.orchestra.run.smithi073.stdout: osd open classes on start = true 2024-09-12T00:27:17.334 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug pg log writeout = true 2024-09-12T00:27:17.334 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:27:17.335 INFO:teuthology.orchestra.run.smithi073.stdout: osd deep scrub update digest min age = 30 2024-09-12T00:27:17.335 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:27:17.335 INFO:teuthology.orchestra.run.smithi073.stdout: osd map max advance = 10 2024-09-12T00:27:17.335 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:27:17.335 INFO:teuthology.orchestra.run.smithi073.stdout: journal zero on create = true 2024-09-12T00:27:17.335 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:27:17.335 INFO:teuthology.orchestra.run.smithi073.stdout: filestore ondisk finisher threads = 3 2024-09-12T00:27:17.335 INFO:teuthology.orchestra.run.smithi073.stdout: filestore apply finisher threads = 3 2024-09-12T00:27:17.335 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:27:17.335 INFO:teuthology.orchestra.run.smithi073.stdout: bdev debug aio = true 2024-09-12T00:27:17.335 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug misdirected ops = true 2024-09-12T00:27:17.335 INFO:teuthology.orchestra.run.smithi073.stdout: bdev async discard = True 2024-09-12T00:27:17.335 INFO:teuthology.orchestra.run.smithi073.stdout: bdev enable discard = True 2024-09-12T00:27:17.336 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore allocator = bitmap 2024-09-12T00:27:17.336 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore block size = 96636764160 2024-09-12T00:27:17.336 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore fsck on mount = True 2024-09-12T00:27:17.336 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluefs = 1/20 2024-09-12T00:27:17.336 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluestore = 1/20 2024-09-12T00:27:17.336 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-09-12T00:27:17.336 INFO:teuthology.orchestra.run.smithi073.stdout: debug objclass = 20 2024-09-12T00:27:17.336 INFO:teuthology.orchestra.run.smithi073.stdout: debug osd = 20 2024-09-12T00:27:17.336 INFO:teuthology.orchestra.run.smithi073.stdout: debug rocksdb = 4/10 2024-09-12T00:27:17.336 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T00:27:17.336 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd full ratio = 0.9 2024-09-12T00:27:17.336 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd nearfull ratio = 0.8 2024-09-12T00:27:17.336 INFO:teuthology.orchestra.run.smithi073.stdout: osd failsafe full ratio = 0.95 2024-09-12T00:27:17.337 INFO:teuthology.orchestra.run.smithi073.stdout: osd fast shutdown = False 2024-09-12T00:27:17.337 INFO:teuthology.orchestra.run.smithi073.stdout: osd objectstore = bluestore 2024-09-12T00:27:17.337 INFO:teuthology.orchestra.run.smithi073.stdout: osd shutdown pgref assert = True 2024-09-12T00:27:17.337 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:27:17.337 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr] 2024-09-12T00:27:17.337 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-09-12T00:27:17.337 INFO:teuthology.orchestra.run.smithi073.stdout: debug mgr = 20 2024-09-12T00:27:17.337 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2024-09-12T00:27:17.337 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2024-09-12T00:27:17.337 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:27:17.337 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:27:17.337 INFO:teuthology.orchestra.run.smithi073.stdout: mgr/telemetry/nag = false 2024-09-12T00:27:17.337 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:27:17.337 INFO:teuthology.orchestra.run.smithi073.stdout:[mon] 2024-09-12T00:27:17.338 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-09-12T00:27:17.338 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2024-09-12T00:27:17.338 INFO:teuthology.orchestra.run.smithi073.stdout: debug paxos = 20 2024-09-12T00:27:17.338 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2024-09-12T00:27:17.338 INFO:teuthology.orchestra.run.smithi073.stdout: mon data avail warn = 5 2024-09-12T00:27:17.338 INFO:teuthology.orchestra.run.smithi073.stdout: mon mgr mkfs grace = 240 2024-09-12T00:27:17.338 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:27:17.338 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd reporter subtree level = osd 2024-09-12T00:27:17.338 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd prime pg temp = true 2024-09-12T00:27:17.338 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:27:17.338 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:27:17.338 INFO:teuthology.orchestra.run.smithi073.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T00:27:17.338 INFO:teuthology.orchestra.run.smithi073.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T00:27:17.338 INFO:teuthology.orchestra.run.smithi073.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T00:27:17.338 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:27:17.339 INFO:teuthology.orchestra.run.smithi073.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T00:27:17.339 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T00:27:17.339 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T00:27:17.339 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:27:17.339 INFO:teuthology.orchestra.run.smithi073.stdout: # 1m isn't quite enough 2024-09-12T00:27:17.339 INFO:teuthology.orchestra.run.smithi073.stdout: mon_down_mkfs_grace = 2m 2024-09-12T00:27:17.339 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:27:17.339 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_filestore_osds = false 2024-09-12T00:27:17.339 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd crush smoke test = False 2024-09-12T00:27:17.339 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:27:17.339 INFO:teuthology.orchestra.run.smithi073.stdout:[client] 2024-09-12T00:27:17.339 INFO:teuthology.orchestra.run.smithi073.stdout: rgw cache enabled = true 2024-09-12T00:27:17.339 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable ops log = true 2024-09-12T00:27:17.339 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable usage log = true 2024-09-12T00:27:17.340 INFO:teuthology.orchestra.run.smithi073.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T00:27:17.340 INFO:teuthology.orchestra.run.smithi073.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T00:27:17.340 INFO:teuthology.orchestra.run.smithi073.stdout: debug rgw = 20 2024-09-12T00:27:17.340 INFO:teuthology.orchestra.run.smithi073.stdout: debug rgw notification = 20 2024-09-12T00:27:17.340 INFO:teuthology.orchestra.run.smithi073.stdout: rgw bucket counters cache = True 2024-09-12T00:27:17.340 INFO:teuthology.orchestra.run.smithi073.stdout: rgw crypt require ssl = False 2024-09-12T00:27:17.340 INFO:teuthology.orchestra.run.smithi073.stdout: rgw crypt s3 kms backend = testing 2024-09-12T00:27:17.340 INFO:teuthology.orchestra.run.smithi073.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T00:27:17.340 INFO:teuthology.orchestra.run.smithi073.stdout: rgw max chunk size = 4194304 2024-09-12T00:27:17.340 INFO:teuthology.orchestra.run.smithi073.stdout: rgw obj stripe size = 6291456 2024-09-12T00:27:17.340 INFO:teuthology.orchestra.run.smithi073.stdout: rgw reshard progress judge interval = 10 2024-09-12T00:27:17.340 INFO:teuthology.orchestra.run.smithi073.stdout: rgw s3 auth use sts = True 2024-09-12T00:27:17.341 INFO:teuthology.orchestra.run.smithi073.stdout: rgw sts key = abcdefghijklmnop 2024-09-12T00:27:17.341 INFO:teuthology.orchestra.run.smithi073.stdout: rgw torrent flag = True 2024-09-12T00:27:17.341 INFO:teuthology.orchestra.run.smithi073.stdout: rgw user counters cache = True 2024-09-12T00:27:17.341 INFO:teuthology.orchestra.run.smithi073.stdout: setgroup = ceph 2024-09-12T00:27:17.341 INFO:teuthology.orchestra.run.smithi073.stdout: setuser = ceph 2024-09-12T00:27:17.341 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.a] 2024-09-12T00:27:17.341 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.c] 2024-09-12T00:27:17.341 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.b] 2024-09-12T00:27:17.342 INFO:teuthology.orchestra.run.smithi117.stdout:[global] 2024-09-12T00:27:17.342 INFO:teuthology.orchestra.run.smithi117.stdout: chdir = "" 2024-09-12T00:27:17.342 INFO:teuthology.orchestra.run.smithi117.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T00:27:17.342 INFO:teuthology.orchestra.run.smithi117.stdout: auth supported = cephx 2024-09-12T00:27:17.342 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T00:27:17.342 INFO:teuthology.orchestra.run.smithi117.stdout: filestore xattr use omap = true 2024-09-12T00:27:17.342 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T00:27:17.342 INFO:teuthology.orchestra.run.smithi117.stdout: mon clock drift allowed = 1.000 2024-09-12T00:27:17.342 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T00:27:17.342 INFO:teuthology.orchestra.run.smithi117.stdout: osd crush chooseleaf type = 0 2024-09-12T00:27:17.342 INFO:teuthology.orchestra.run.smithi117.stdout: auth debug = true 2024-09-12T00:27:17.343 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T00:27:17.343 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on old message = true 2024-09-12T00:27:17.343 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on bug = true 2024-09-12T00:27:17.343 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T00:27:17.343 INFO:teuthology.orchestra.run.smithi117.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T00:27:17.343 INFO:teuthology.orchestra.run.smithi117.stdout: mon pg warn max object skew = 0 2024-09-12T00:27:17.343 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T00:27:17.343 INFO:teuthology.orchestra.run.smithi117.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T00:27:17.343 INFO:teuthology.orchestra.run.smithi117.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T00:27:17.343 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T00:27:17.343 INFO:teuthology.orchestra.run.smithi117.stdout: osd pool default size = 2 2024-09-12T00:27:17.343 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T00:27:17.343 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd allow primary affinity = true 2024-09-12T00:27:17.343 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd allow pg remap = true 2024-09-12T00:27:17.344 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on legacy crush tunables = false 2024-09-12T00:27:17.344 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on crush straw calc version zero = false 2024-09-12T00:27:17.344 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on no sortbitwise = false 2024-09-12T00:27:17.344 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on osd down out interval zero = false 2024-09-12T00:27:17.344 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on too few osds = false 2024-09-12T00:27:17.344 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T00:27:17.344 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T00:27:17.344 INFO:teuthology.orchestra.run.smithi117.stdout: mon_allow_pool_size_one = true 2024-09-12T00:27:17.344 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T00:27:17.344 INFO:teuthology.orchestra.run.smithi117.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T00:27:17.344 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T00:27:17.344 INFO:teuthology.orchestra.run.smithi117.stdout: osd default data pool replay window = 5 2024-09-12T00:27:17.344 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T00:27:17.345 INFO:teuthology.orchestra.run.smithi117.stdout: mon allow pool delete = true 2024-09-12T00:27:17.345 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T00:27:17.345 INFO:teuthology.orchestra.run.smithi117.stdout: mon cluster log file level = debug 2024-09-12T00:27:17.345 INFO:teuthology.orchestra.run.smithi117.stdout: debug asserts on shutdown = true 2024-09-12T00:27:17.345 INFO:teuthology.orchestra.run.smithi117.stdout: mon health detail to clog = false 2024-09-12T00:27:17.345 INFO:teuthology.orchestra.run.smithi117.stdout: mon host = "172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790],172.21.15.117" 2024-09-12T00:27:17.345 INFO:teuthology.orchestra.run.smithi117.stdout: mon client directed command retry = 5 2024-09-12T00:27:17.345 INFO:teuthology.orchestra.run.smithi117.stdout: ms inject socket failures = 5000 2024-09-12T00:27:17.345 INFO:teuthology.orchestra.run.smithi117.stdout: osd heartbeat grace = 40 2024-09-12T00:27:17.345 INFO:teuthology.orchestra.run.smithi117.stdout: osd_max_pg_log_entries = 10 2024-09-12T00:27:17.345 INFO:teuthology.orchestra.run.smithi117.stdout: osd_min_pg_log_entries = 10 2024-09-12T00:27:17.345 INFO:teuthology.orchestra.run.smithi117.stdout: rgw override bucket index max shards = 1 2024-09-12T00:27:17.345 INFO:teuthology.orchestra.run.smithi117.stdout: fsid = f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:27:17.345 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T00:27:17.345 INFO:teuthology.orchestra.run.smithi117.stdout:[osd] 2024-09-12T00:27:17.346 INFO:teuthology.orchestra.run.smithi117.stdout: osd journal size = 100 2024-09-12T00:27:17.346 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T00:27:17.346 INFO:teuthology.orchestra.run.smithi117.stdout: osd scrub load threshold = 5.0 2024-09-12T00:27:17.346 INFO:teuthology.orchestra.run.smithi117.stdout: osd scrub max interval = 600 2024-09-12T00:27:17.346 INFO:teuthology.orchestra.run.smithi117.stdout: osd mclock profile = high_recovery_ops 2024-09-12T00:27:17.346 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T00:27:17.346 INFO:teuthology.orchestra.run.smithi117.stdout: osd recover clone overlap = true 2024-09-12T00:27:17.346 INFO:teuthology.orchestra.run.smithi117.stdout: osd recovery max chunk = 1048576 2024-09-12T00:27:17.346 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T00:27:17.346 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug shutdown = true 2024-09-12T00:27:17.346 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug op order = true 2024-09-12T00:27:17.346 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug verify stray on activate = true 2024-09-12T00:27:17.346 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug trim objects = true 2024-09-12T00:27:17.346 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T00:27:17.347 INFO:teuthology.orchestra.run.smithi117.stdout: osd open classes on start = true 2024-09-12T00:27:17.347 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug pg log writeout = true 2024-09-12T00:27:17.347 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T00:27:17.347 INFO:teuthology.orchestra.run.smithi117.stdout: osd deep scrub update digest min age = 30 2024-09-12T00:27:17.347 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T00:27:17.347 INFO:teuthology.orchestra.run.smithi117.stdout: osd map max advance = 10 2024-09-12T00:27:17.347 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T00:27:17.347 INFO:teuthology.orchestra.run.smithi117.stdout: journal zero on create = true 2024-09-12T00:27:17.347 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T00:27:17.347 INFO:teuthology.orchestra.run.smithi117.stdout: filestore ondisk finisher threads = 3 2024-09-12T00:27:17.347 INFO:teuthology.orchestra.run.smithi117.stdout: filestore apply finisher threads = 3 2024-09-12T00:27:17.347 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T00:27:17.347 INFO:teuthology.orchestra.run.smithi117.stdout: bdev debug aio = true 2024-09-12T00:27:17.348 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug misdirected ops = true 2024-09-12T00:27:17.348 INFO:teuthology.orchestra.run.smithi117.stdout: bdev async discard = True 2024-09-12T00:27:17.348 INFO:teuthology.orchestra.run.smithi117.stdout: bdev enable discard = True 2024-09-12T00:27:17.348 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore allocator = bitmap 2024-09-12T00:27:17.348 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore block size = 96636764160 2024-09-12T00:27:17.348 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore fsck on mount = True 2024-09-12T00:27:17.349 INFO:teuthology.orchestra.run.smithi117.stdout: debug bluefs = 1/20 2024-09-12T00:27:17.349 INFO:teuthology.orchestra.run.smithi117.stdout: debug bluestore = 1/20 2024-09-12T00:27:17.349 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-09-12T00:27:17.349 INFO:teuthology.orchestra.run.smithi117.stdout: debug objclass = 20 2024-09-12T00:27:17.349 INFO:teuthology.orchestra.run.smithi117.stdout: debug osd = 20 2024-09-12T00:27:17.349 INFO:teuthology.orchestra.run.smithi117.stdout: debug rocksdb = 4/10 2024-09-12T00:27:17.349 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T00:27:17.349 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd full ratio = 0.9 2024-09-12T00:27:17.349 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd nearfull ratio = 0.8 2024-09-12T00:27:17.350 INFO:teuthology.orchestra.run.smithi117.stdout: osd failsafe full ratio = 0.95 2024-09-12T00:27:17.350 INFO:teuthology.orchestra.run.smithi117.stdout: osd fast shutdown = False 2024-09-12T00:27:17.350 INFO:teuthology.orchestra.run.smithi117.stdout: osd objectstore = bluestore 2024-09-12T00:27:17.350 INFO:teuthology.orchestra.run.smithi117.stdout: osd shutdown pgref assert = True 2024-09-12T00:27:17.350 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T00:27:17.350 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr] 2024-09-12T00:27:17.350 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-09-12T00:27:17.350 INFO:teuthology.orchestra.run.smithi117.stdout: debug mgr = 20 2024-09-12T00:27:17.350 INFO:teuthology.orchestra.run.smithi117.stdout: debug mon = 20 2024-09-12T00:27:17.350 INFO:teuthology.orchestra.run.smithi117.stdout: debug auth = 20 2024-09-12T00:27:17.350 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:27:17.351 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:27:17.351 INFO:teuthology.orchestra.run.smithi117.stdout: mgr/telemetry/nag = false 2024-09-12T00:27:17.351 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T00:27:17.351 INFO:teuthology.orchestra.run.smithi117.stdout:[mon] 2024-09-12T00:27:17.351 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-09-12T00:27:17.351 INFO:teuthology.orchestra.run.smithi117.stdout: debug mon = 20 2024-09-12T00:27:17.351 INFO:teuthology.orchestra.run.smithi117.stdout: debug paxos = 20 2024-09-12T00:27:17.351 INFO:teuthology.orchestra.run.smithi117.stdout: debug auth = 20 2024-09-12T00:27:17.351 INFO:teuthology.orchestra.run.smithi117.stdout: mon data avail warn = 5 2024-09-12T00:27:17.351 INFO:teuthology.orchestra.run.smithi117.stdout: mon mgr mkfs grace = 240 2024-09-12T00:27:17.351 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:27:17.352 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd reporter subtree level = osd 2024-09-12T00:27:17.352 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd prime pg temp = true 2024-09-12T00:27:17.352 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:27:17.352 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T00:27:17.352 INFO:teuthology.orchestra.run.smithi117.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T00:27:17.352 INFO:teuthology.orchestra.run.smithi117.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T00:27:17.352 INFO:teuthology.orchestra.run.smithi117.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T00:27:17.352 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T00:27:17.352 INFO:teuthology.orchestra.run.smithi117.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T00:27:17.352 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T00:27:17.352 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T00:27:17.352 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T00:27:17.352 INFO:teuthology.orchestra.run.smithi117.stdout: # 1m isn't quite enough 2024-09-12T00:27:17.353 INFO:teuthology.orchestra.run.smithi117.stdout: mon_down_mkfs_grace = 2m 2024-09-12T00:27:17.353 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T00:27:17.353 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_filestore_osds = false 2024-09-12T00:27:17.353 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd crush smoke test = False 2024-09-12T00:27:17.353 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T00:27:17.353 INFO:teuthology.orchestra.run.smithi117.stdout:[client] 2024-09-12T00:27:17.353 INFO:teuthology.orchestra.run.smithi117.stdout: rgw cache enabled = true 2024-09-12T00:27:17.353 INFO:teuthology.orchestra.run.smithi117.stdout: rgw enable ops log = true 2024-09-12T00:27:17.353 INFO:teuthology.orchestra.run.smithi117.stdout: rgw enable usage log = true 2024-09-12T00:27:17.353 INFO:teuthology.orchestra.run.smithi117.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T00:27:17.353 INFO:teuthology.orchestra.run.smithi117.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T00:27:17.353 INFO:teuthology.orchestra.run.smithi117.stdout: debug rgw = 20 2024-09-12T00:27:17.353 INFO:teuthology.orchestra.run.smithi117.stdout: debug rgw notification = 20 2024-09-12T00:27:17.353 INFO:teuthology.orchestra.run.smithi117.stdout: rgw bucket counters cache = True 2024-09-12T00:27:17.354 INFO:teuthology.orchestra.run.smithi117.stdout: rgw crypt require ssl = False 2024-09-12T00:27:17.354 INFO:teuthology.orchestra.run.smithi117.stdout: rgw crypt s3 kms backend = testing 2024-09-12T00:27:17.354 INFO:teuthology.orchestra.run.smithi117.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T00:27:17.354 INFO:teuthology.orchestra.run.smithi117.stdout: rgw max chunk size = 4194304 2024-09-12T00:27:17.354 INFO:teuthology.orchestra.run.smithi117.stdout: rgw obj stripe size = 6291456 2024-09-12T00:27:17.354 INFO:teuthology.orchestra.run.smithi117.stdout: rgw reshard progress judge interval = 10 2024-09-12T00:27:17.354 INFO:teuthology.orchestra.run.smithi117.stdout: rgw s3 auth use sts = True 2024-09-12T00:27:17.354 INFO:teuthology.orchestra.run.smithi117.stdout: rgw sts key = abcdefghijklmnop 2024-09-12T00:27:17.354 INFO:teuthology.orchestra.run.smithi117.stdout: rgw torrent flag = True 2024-09-12T00:27:17.354 INFO:teuthology.orchestra.run.smithi117.stdout: rgw user counters cache = True 2024-09-12T00:27:17.354 INFO:teuthology.orchestra.run.smithi117.stdout: setgroup = ceph 2024-09-12T00:27:17.354 INFO:teuthology.orchestra.run.smithi117.stdout: setuser = ceph 2024-09-12T00:27:17.354 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.a] 2024-09-12T00:27:17.354 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.c] 2024-09-12T00:27:17.355 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.b] 2024-09-12T00:27:17.356 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-12T00:27:17.356 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-12T00:27:17.465 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-12T00:27:17.465 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T00:27:17.465 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-12T00:27:17.495 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T00:27:17.495 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-12T00:27:17.564 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi073.front.sepia.ceph.com 2024-09-12T00:27:17.565 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T00:27:17.565 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T00:27:17.565 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T00:27:17.653 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T00:27:17.653 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:27:17.721 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi117.front.sepia.ceph.com 2024-09-12T00:27:17.722 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-12T00:27:17.722 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T00:27:17.722 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T00:27:17.771 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-12T00:27:17.771 DEBUG:teuthology.orchestra.run.smithi117:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:27:17.839 INFO:tasks.ceph:Setting up mon nodes... 2024-09-12T00:27:17.839 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-12T00:27:17.840 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T00:27:17.906 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T00:27:17.909 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T00:27:17.985 INFO:teuthology.orchestra.run.smithi117.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T00:27:17.987 INFO:tasks.ceph:Setting up mds nodes... 2024-09-12T00:27:17.987 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-12T00:27:17.988 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T00:27:18.042 INFO:teuthology.orchestra.run.smithi073.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-12T00:27:18.057 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-12T00:27:18.112 INFO:teuthology.orchestra.run.smithi117.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-12T00:27:18.126 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-12T00:27:18.126 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi073.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi117.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T00:27:18.126 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-12T00:27:18.164 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:27:18.164 INFO:tasks.ceph:role: osd.0 2024-09-12T00:27:18.164 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi073.front.sepia.ceph.com 2024-09-12T00:27:18.164 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T00:27:18.250 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:27:18.250 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:27:18.250 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:27:18.250 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:27:18.250 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:27:18.251 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:27:18.251 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:27:18.251 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:27:18.251 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:27:18.251 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:27:18.774 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2024-09-12T00:27:18.776 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-09-12T00:27:18.776 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-12T00:27:18.913 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-12T00:27:18.959 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-12T00:27:18.997 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:27:18.997 INFO:tasks.ceph:role: osd.1 2024-09-12T00:27:18.997 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi073.front.sepia.ceph.com 2024-09-12T00:27:18.997 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T00:27:19.084 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:27:19.085 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:27:19.085 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:27:19.085 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:27:19.085 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:27:19.085 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:27:19.085 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:27:19.085 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:27:19.085 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:27:19.085 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:27:19.539 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2024-09-12T00:27:19.541 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-09-12T00:27:19.541 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-12T00:27:19.603 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-12T00:27:19.645 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-12T00:27:19.726 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:27:19.726 INFO:tasks.ceph:role: osd.2 2024-09-12T00:27:19.726 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi073.front.sepia.ceph.com 2024-09-12T00:27:19.727 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T00:27:19.814 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:27:19.814 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:27:19.814 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:27:19.814 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:27:19.814 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:27:19.814 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:27:19.814 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:27:19.815 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:27:19.815 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:27:19.815 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:27:20.305 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2024-09-12T00:27:20.307 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-09-12T00:27:20.307 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-12T00:27:20.393 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-12T00:27:20.435 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-12T00:27:20.513 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:27:20.513 INFO:tasks.ceph:role: osd.3 2024-09-12T00:27:20.513 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi073.front.sepia.ceph.com 2024-09-12T00:27:20.513 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T00:27:20.599 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:27:20.600 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:27:20.600 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:27:20.600 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:27:20.600 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:27:20.600 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:27:20.600 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:27:20.600 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:27:20.600 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:27:20.600 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:27:21.145 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2024-09-12T00:27:21.147 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-09-12T00:27:21.147 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-12T00:27:21.260 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-12T00:27:21.304 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:27:21.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:27:21.416+0000 7fc4e4bae640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-12T00:27:21.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:27:21.416+0000 7fc4e4bae640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-12T00:27:21.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:27:21.416+0000 7fc4e4bae640 -1 bdev(0x55e808151800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-12T00:27:21.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:27:21.416+0000 7fc4e4bae640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-12T00:27:24.318 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-12T00:27:24.364 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:27:24.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:27:24.429+0000 7fd4fa816640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-12T00:27:24.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:27:24.429+0000 7fd4fa816640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-12T00:27:24.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:27:24.429+0000 7fd4fa816640 -1 bdev(0x5586cece9800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-12T00:27:24.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:27:24.429+0000 7fd4fa816640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-12T00:27:27.833 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-12T00:27:27.875 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:27:27.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:27:27.978+0000 7f4dffe16640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-12T00:27:27.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:27:27.979+0000 7f4dffe16640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-12T00:27:27.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:27:27.979+0000 7f4dffe16640 -1 bdev(0x55a35845d800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-12T00:27:27.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:27:27.979+0000 7f4dffe16640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-12T00:27:30.900 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-12T00:27:30.941 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:27:31.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:27:31.042+0000 7f5f2060c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-12T00:27:31.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:27:31.042+0000 7f5f2060c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-12T00:27:31.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:27:31.042+0000 7f5f2060c640 -1 bdev(0x55f0a3659800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-12T00:27:31.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:27:31.042+0000 7f5f2060c640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-12T00:27:34.217 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-12T00:27:34.262 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-12T00:27:34.308 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:27:34.308 INFO:tasks.ceph:role: osd.4 2024-09-12T00:27:34.308 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi117.front.sepia.ceph.com 2024-09-12T00:27:34.309 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T00:27:34.357 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:27:34.357 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:27:34.358 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:27:34.358 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:27:34.358 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:27:34.358 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:27:34.358 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:27:34.358 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:27:34.358 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:27:34.358 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:27:34.860 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2024-09-12T00:27:34.862 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2024-09-12T00:27:34.862 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-12T00:27:34.947 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-12T00:27:34.995 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-12T00:27:35.034 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:27:35.034 INFO:tasks.ceph:role: osd.5 2024-09-12T00:27:35.034 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi117.front.sepia.ceph.com 2024-09-12T00:27:35.034 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T00:27:35.120 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:27:35.121 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:27:35.121 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:27:35.121 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:27:35.121 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:27:35.121 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:27:35.121 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:27:35.121 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:27:35.121 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:27:35.121 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:27:35.574 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2024-09-12T00:27:35.576 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2024-09-12T00:27:35.577 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-12T00:27:35.622 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-12T00:27:35.663 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-12T00:27:35.743 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:27:35.743 INFO:tasks.ceph:role: osd.6 2024-09-12T00:27:35.743 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi117.front.sepia.ceph.com 2024-09-12T00:27:35.743 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T00:27:35.828 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:27:35.829 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:27:35.829 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:27:35.829 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:27:35.829 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:27:35.829 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:27:35.829 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:27:35.829 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:27:35.829 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:27:35.829 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:27:36.309 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2024-09-12T00:27:36.311 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2024-09-12T00:27:36.311 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-12T00:27:36.373 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-12T00:27:36.416 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-12T00:27:36.495 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:27:36.495 INFO:tasks.ceph:role: osd.7 2024-09-12T00:27:36.495 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi117.front.sepia.ceph.com 2024-09-12T00:27:36.495 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T00:27:36.581 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:27:36.581 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:27:36.582 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:27:36.582 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:27:36.582 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:27:36.582 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:27:36.582 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:27:36.582 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:27:36.582 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:27:36.582 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:27:37.105 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2024-09-12T00:27:37.105 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2024-09-12T00:27:37.105 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-12T00:27:37.225 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-12T00:27:37.269 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:27:37.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T00:27:37.407+0000 7fa7c89c3640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-12T00:27:37.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T00:27:37.411+0000 7fa7c89c3640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-12T00:27:37.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T00:27:37.411+0000 7fa7c89c3640 -1 bdev(0x5653a51b5800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-12T00:27:37.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T00:27:37.411+0000 7fa7c89c3640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-12T00:27:40.320 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-12T00:27:40.365 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:27:40.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T00:27:40.468+0000 7f01f021e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-12T00:27:40.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T00:27:40.468+0000 7f01f021e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-12T00:27:40.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T00:27:40.468+0000 7f01f021e640 -1 bdev(0x562d88c89800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-12T00:27:40.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T00:27:40.468+0000 7f01f021e640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-12T00:27:43.867 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-12T00:27:43.911 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:27:44.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T00:27:44.016+0000 7f93d4824640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-12T00:27:44.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T00:27:44.016+0000 7f93d4824640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-12T00:27:44.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T00:27:44.016+0000 7f93d4824640 -1 bdev(0x559493caf800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-12T00:27:44.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T00:27:44.016+0000 7f93d4824640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-12T00:27:47.423 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-12T00:27:47.467 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:27:47.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T00:27:47.529+0000 7f2f0a545640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-12T00:27:47.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T00:27:47.530+0000 7f2f0a545640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-12T00:27:47.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T00:27:47.530+0000 7f2f0a545640 -1 bdev(0x556bae203800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-12T00:27:47.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T00:27:47.530+0000 7f2f0a545640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-12T00:27:50.464 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-12T00:27:50.509 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-12T00:27:50.509 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T00:27:50.510 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-12T00:27:50.556 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T00:27:50.556 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-12T00:27:50.640 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T00:27:50.641 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-12T00:27:50.721 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T00:27:50.721 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-12T00:27:50.802 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T00:27:50.802 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-12T00:27:50.881 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-12T00:27:50.881 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-12T00:27:50.927 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-12T00:27:50.927 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-12T00:27:51.009 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-12T00:27:51.009 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-12T00:27:51.088 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-12T00:27:51.089 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-12T00:27:51.169 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-12T00:27:51.169 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-12T00:27:51.247 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T00:27:51.247 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-12T00:27:51.278 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-12T00:27:51.278 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-12T00:27:51.316 INFO:tasks.ceph:Adding keys to all mons... 2024-09-12T00:27:51.317 DEBUG:teuthology.orchestra.run.smithi073:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T00:27:51.320 DEBUG:teuthology.orchestra.run.smithi117:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T00:27:51.360 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr.y] 2024-09-12T00:27:51.360 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBlNeJm+MguNhAAJeOiN8ubNAU91IomJjKqSQ== 2024-09-12T00:27:51.361 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.0] 2024-09-12T00:27:51.361 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBpNeJm5rPfGBAAysmbyiy3tkB6TAPBWb1GRw== 2024-09-12T00:27:51.361 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.1] 2024-09-12T00:27:51.361 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBsNeJmCPShGRAAJyRMY0OykSQDoOFp2xCefg== 2024-09-12T00:27:51.361 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.2] 2024-09-12T00:27:51.361 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBvNeJmr0d0OhAAFPjJ0PMrJ7LZwaE97q6Ysg== 2024-09-12T00:27:51.361 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.3] 2024-09-12T00:27:51.361 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBzNeJmXZydAhAAj8V0nHUaazHEG03dNyTvAg== 2024-09-12T00:27:51.361 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr.x] 2024-09-12T00:27:51.361 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBlNeJmlHPZOhAAlEOCBi5zFeOWOsclF5MkCg== 2024-09-12T00:27:51.361 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.4] 2024-09-12T00:27:51.361 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQB5NeJm6HddGBAAC3Pz+fO32zQfX3sHlTvNvw== 2024-09-12T00:27:51.362 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.5] 2024-09-12T00:27:51.362 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQB8NeJmovD+GxAA1rOoOz52BZudwnLNLmveDw== 2024-09-12T00:27:51.362 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.6] 2024-09-12T00:27:51.362 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCANeJmGCELARAAvNFjT+3ncAFr4cB2eP9KLA== 2024-09-12T00:27:51.362 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.7] 2024-09-12T00:27:51.362 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCDNeJm+riqHxAAubriL1Az2XGNZA7f4ZnV1w== 2024-09-12T00:27:51.362 INFO:teuthology.orchestra.run.smithi073.stdout:[client.0] 2024-09-12T00:27:51.362 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBmNeJmQHGpAhAAy8cOuYQ0inl8knE7GoQ67A== 2024-09-12T00:27:51.362 INFO:teuthology.orchestra.run.smithi073.stdout:[client.1] 2024-09-12T00:27:51.362 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBmNeJmTqjeBhAAcN9j3Iv2L4m5WzLqzivWEg== 2024-09-12T00:27:51.393 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr.y] 2024-09-12T00:27:51.393 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBlNeJm+MguNhAAJeOiN8ubNAU91IomJjKqSQ== 2024-09-12T00:27:51.393 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.0] 2024-09-12T00:27:51.393 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBpNeJm5rPfGBAAysmbyiy3tkB6TAPBWb1GRw== 2024-09-12T00:27:51.394 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.1] 2024-09-12T00:27:51.394 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBsNeJmCPShGRAAJyRMY0OykSQDoOFp2xCefg== 2024-09-12T00:27:51.394 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.2] 2024-09-12T00:27:51.394 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBvNeJmr0d0OhAAFPjJ0PMrJ7LZwaE97q6Ysg== 2024-09-12T00:27:51.394 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.3] 2024-09-12T00:27:51.394 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBzNeJmXZydAhAAj8V0nHUaazHEG03dNyTvAg== 2024-09-12T00:27:51.394 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr.x] 2024-09-12T00:27:51.394 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBlNeJmlHPZOhAAlEOCBi5zFeOWOsclF5MkCg== 2024-09-12T00:27:51.394 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.4] 2024-09-12T00:27:51.394 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQB5NeJm6HddGBAAC3Pz+fO32zQfX3sHlTvNvw== 2024-09-12T00:27:51.394 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.5] 2024-09-12T00:27:51.394 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQB8NeJmovD+GxAA1rOoOz52BZudwnLNLmveDw== 2024-09-12T00:27:51.394 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.6] 2024-09-12T00:27:51.395 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQCANeJmGCELARAAvNFjT+3ncAFr4cB2eP9KLA== 2024-09-12T00:27:51.395 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.7] 2024-09-12T00:27:51.395 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQCDNeJm+riqHxAAubriL1Az2XGNZA7f4ZnV1w== 2024-09-12T00:27:51.395 INFO:teuthology.orchestra.run.smithi117.stdout:[client.0] 2024-09-12T00:27:51.395 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBmNeJmQHGpAhAAy8cOuYQ0inl8knE7GoQ67A== 2024-09-12T00:27:51.395 INFO:teuthology.orchestra.run.smithi117.stdout:[client.1] 2024-09-12T00:27:51.395 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBmNeJmTqjeBhAAcN9j3Iv2L4m5WzLqzivWEg== 2024-09-12T00:27:51.396 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:27:51.405 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:27:51.501 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:27:51.503 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:27:51.567 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:27:51.570 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:27:51.634 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:27:51.636 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:27:51.700 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:27:51.702 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:27:51.766 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:27:51.769 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:27:51.833 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:27:51.835 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:27:51.899 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:27:51.901 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:27:51.965 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:27:51.967 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:27:52.031 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:27:52.034 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:27:52.097 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:27:52.099 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:27:52.166 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:27:52.168 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:27:52.235 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-12T00:27:52.235 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-12T00:27:52.273 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T00:27:52.383 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-12T00:27:52.422 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-12T00:27:52.500 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T00:27:52.612 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-12T00:27:52.650 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-12T00:27:52.690 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T00:27:52.800 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-12T00:27:52.838 DEBUG:teuthology.orchestra.run.smithi073:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:27:52.840 DEBUG:teuthology.orchestra.run.smithi117:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:27:52.905 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-12T00:27:52.906 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T00:27:52.906 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T00:27:52.908 INFO:tasks.ceph.mon.a:Started 2024-09-12T00:27:52.908 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-12T00:27:52.909 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-12T00:27:52.910 INFO:tasks.ceph.mon.c:Started 2024-09-12T00:27:52.911 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-12T00:27:52.911 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-12T00:27:52.948 INFO:tasks.ceph.mon.b:Started 2024-09-12T00:27:52.949 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-12T00:27:52.949 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-12T00:27:52.949 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-12T00:27:52.951 INFO:tasks.ceph.mgr.y:Started 2024-09-12T00:27:52.951 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-12T00:27:52.951 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-12T00:27:52.953 INFO:tasks.ceph.mgr.x:Started 2024-09-12T00:27:52.954 DEBUG:tasks.ceph:set 0 configs 2024-09-12T00:27:52.954 INFO:tasks.ceph:Setting crush tunables to default 2024-09-12T00:27:52.954 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd crush tunables default 2024-09-12T00:27:59.145 INFO:teuthology.orchestra.run.smithi073.stderr:adjusted tunables profile to default 2024-09-12T00:27:59.157 INFO:tasks.ceph:check_enable_crimson: False 2024-09-12T00:27:59.157 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-12T00:27:59.158 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T00:27:59.158 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-12T00:27:59.196 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T00:27:59.196 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-12T00:27:59.275 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T00:27:59.275 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-12T00:27:59.353 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T00:27:59.354 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-12T00:27:59.432 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-12T00:27:59.432 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-12T00:27:59.471 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-12T00:27:59.471 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-12T00:27:59.550 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-12T00:27:59.550 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-12T00:27:59.629 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-12T00:27:59.629 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-12T00:27:59.706 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new eb34ba71-824c-4899-8325-e5683677cde7 0 2024-09-12T00:27:59.944 INFO:teuthology.orchestra.run.smithi117.stdout:0 2024-09-12T00:27:59.955 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new c5a02013-ada7-406c-9a62-4a683000d243 1 2024-09-12T00:28:00.147 INFO:teuthology.orchestra.run.smithi117.stdout:1 2024-09-12T00:28:00.158 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new f0720950-c9f6-4f48-882d-ca95299711e2 2 2024-09-12T00:28:00.356 INFO:teuthology.orchestra.run.smithi117.stdout:2 2024-09-12T00:28:00.367 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 986d4757-211f-4814-aeb4-9567f819b765 3 2024-09-12T00:28:00.565 INFO:teuthology.orchestra.run.smithi117.stdout:3 2024-09-12T00:28:00.577 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new f04f1a37-5e86-4527-9c26-8ca21ccdd082 4 2024-09-12T00:28:00.775 INFO:teuthology.orchestra.run.smithi117.stdout:4 2024-09-12T00:28:00.786 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 53aa7cf0-1f78-411c-bb5e-e5f5789dc4cc 5 2024-09-12T00:28:00.985 INFO:teuthology.orchestra.run.smithi117.stdout:5 2024-09-12T00:28:00.996 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 47cdfa3e-cd16-404c-bb76-1524ac454b51 6 2024-09-12T00:28:01.192 INFO:teuthology.orchestra.run.smithi117.stdout:6 2024-09-12T00:28:01.203 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 3caf8dd6-f629-41af-94f2-e636d1aa2536 7 2024-09-12T00:28:01.397 INFO:teuthology.orchestra.run.smithi117.stdout:7 2024-09-12T00:28:01.409 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T00:28:01.409 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T00:28:01.411 INFO:tasks.ceph.osd.0:Started 2024-09-12T00:28:01.411 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-12T00:28:01.411 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-12T00:28:01.413 INFO:tasks.ceph.osd.1:Started 2024-09-12T00:28:01.413 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-12T00:28:01.414 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-12T00:28:01.416 INFO:tasks.ceph.osd.2:Started 2024-09-12T00:28:01.416 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-12T00:28:01.416 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-12T00:28:01.418 INFO:tasks.ceph.osd.3:Started 2024-09-12T00:28:01.418 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-12T00:28:01.418 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-12T00:28:01.420 INFO:tasks.ceph.osd.4:Started 2024-09-12T00:28:01.421 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-12T00:28:01.421 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-12T00:28:01.422 INFO:tasks.ceph.osd.5:Started 2024-09-12T00:28:01.423 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-12T00:28:01.423 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-12T00:28:01.425 INFO:tasks.ceph.osd.6:Started 2024-09-12T00:28:01.425 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-12T00:28:01.425 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-12T00:28:01.427 INFO:tasks.ceph.osd.7:Started 2024-09-12T00:28:01.428 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:28:01.632 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:28:01.632 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":10,"fsid":"f020195c-ad88-4fe3-a760-71957da35598","created":"2024-09-12T00:27:58.232371+0000","modified":"2024-09-12T00:28:01.397414+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T00:28:01.397414+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"eb34ba71-824c-4899-8325-e5683677cde7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c5a02013-ada7-406c-9a62-4a683000d243","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f0720950-c9f6-4f48-882d-ca95299711e2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"986d4757-211f-4814-aeb4-9567f819b765","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f04f1a37-5e86-4527-9c26-8ca21ccdd082","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"53aa7cf0-1f78-411c-bb5e-e5f5789dc4cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"47cdfa3e-cd16-404c-bb76-1524ac454b51","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"3caf8dd6-f629-41af-94f2-e636d1aa2536","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:28:01.643 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-12T00:28:01.644 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-12T00:28:02.399 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-12T00:28:02.400+0000 7f09f79a4640 -1 Falling back to public interface 2024-09-12T00:28:02.450 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T00:28:02.625 INFO:teuthology.misc.health.smithi073.stdout: 2024-09-12T00:28:02.625 INFO:teuthology.misc.health.smithi073.stdout:{"epoch":10,"fsid":"f020195c-ad88-4fe3-a760-71957da35598","created":"2024-09-12T00:27:58.232371+0000","modified":"2024-09-12T00:28:01.397414+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T00:28:01.397414+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"eb34ba71-824c-4899-8325-e5683677cde7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c5a02013-ada7-406c-9a62-4a683000d243","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f0720950-c9f6-4f48-882d-ca95299711e2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"986d4757-211f-4814-aeb4-9567f819b765","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f04f1a37-5e86-4527-9c26-8ca21ccdd082","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"53aa7cf0-1f78-411c-bb5e-e5f5789dc4cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"47cdfa3e-cd16-404c-bb76-1524ac454b51","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"3caf8dd6-f629-41af-94f2-e636d1aa2536","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:28:02.634 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T00:28:02.910 INFO:tasks.ceph.osd.6.smithi117.stderr:2024-09-12T00:28:02.911+0000 7f248ec85640 -1 Falling back to public interface 2024-09-12T00:28:03.151 INFO:tasks.ceph.osd.4.smithi117.stderr:2024-09-12T00:28:03.152+0000 7fa820529640 -1 Falling back to public interface 2024-09-12T00:28:03.156 INFO:tasks.ceph.osd.0.smithi073.stderr:2024-09-12T00:28:03.157+0000 7fc75a0b6640 -1 Falling back to public interface 2024-09-12T00:28:03.160 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-12T00:28:03.162+0000 7f4354a11640 -1 Falling back to public interface 2024-09-12T00:28:03.379 INFO:tasks.ceph.osd.2.smithi073.stderr:2024-09-12T00:28:03.380+0000 7fd2fb2f1640 -1 Falling back to public interface 2024-09-12T00:28:03.410 INFO:tasks.ceph.osd.7.smithi117.stderr:2024-09-12T00:28:03.412+0000 7f70e1c0b640 -1 Falling back to public interface 2024-09-12T00:28:03.433 INFO:tasks.ceph.osd.5.smithi117.stderr:2024-09-12T00:28:03.435+0000 7ff6ef89c640 -1 Falling back to public interface 2024-09-12T00:28:03.456 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-09-12T00:28:03.457+0000 7f9d3c209640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-12T00:28:03.456 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-09-12T00:28:03.458+0000 7f9d3c209640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-12T00:28:06.198 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-12T00:28:06.199+0000 7f09f79a4640 -1 osd.3 0 log_to_monitors true 2024-09-12T00:28:06.472 INFO:tasks.ceph.osd.6.smithi117.stderr:2024-09-12T00:28:06.474+0000 7f248ec85640 -1 osd.6 0 log_to_monitors true 2024-09-12T00:28:06.717 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-12T00:28:06.718+0000 7f4354a11640 -1 osd.1 0 log_to_monitors true 2024-09-12T00:28:06.981 INFO:tasks.ceph.osd.5.smithi117.stderr:2024-09-12T00:28:06.982+0000 7ff6ef89c640 -1 osd.5 0 log_to_monitors true 2024-09-12T00:28:07.138 INFO:tasks.ceph.osd.2.smithi073.stderr:2024-09-12T00:28:07.140+0000 7fd2fb2f1640 -1 osd.2 0 log_to_monitors true 2024-09-12T00:28:07.177 INFO:tasks.ceph.osd.4.smithi117.stderr:2024-09-12T00:28:07.179+0000 7fa820529640 -1 osd.4 0 log_to_monitors true 2024-09-12T00:28:07.643 INFO:tasks.ceph.osd.7.smithi117.stderr:2024-09-12T00:28:07.645+0000 7f70e1c0b640 -1 osd.7 0 log_to_monitors true 2024-09-12T00:28:07.753 INFO:tasks.ceph.osd.0.smithi073.stderr:2024-09-12T00:28:07.754+0000 7fc75a0b6640 -1 osd.0 0 log_to_monitors true 2024-09-12T00:28:08.309 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-12T00:28:08.310+0000 7f09f3938640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T00:28:08.322 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-12T00:28:08.324+0000 7f09eb757640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:28:09.441 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T00:28:09.873 INFO:teuthology.misc.health.smithi073.stdout: 2024-09-12T00:28:09.873 INFO:teuthology.misc.health.smithi073.stdout:{"epoch":14,"fsid":"f020195c-ad88-4fe3-a760-71957da35598","created":"2024-09-12T00:27:58.232371+0000","modified":"2024-09-12T00:28:09.477405+0000","last_up_change":"2024-09-12T00:28:08.471890+0000","last_in_change":"2024-09-12T00:28:01.397414+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"eb34ba71-824c-4899-8325-e5683677cde7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c5a02013-ada7-406c-9a62-4a683000d243","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f0720950-c9f6-4f48-882d-ca95299711e2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"986d4757-211f-4814-aeb4-9567f819b765","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2864081714},{"type":"v1","addr":"172.21.15.73:6801","nonce":2864081714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2864081714},{"type":"v1","addr":"172.21.15.73:6803","nonce":2864081714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2864081714},{"type":"v1","addr":"172.21.15.73:6807","nonce":2864081714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2864081714},{"type":"v1","addr":"172.21.15.73:6805","nonce":2864081714}]},"public_addr":"172.21.15.73:6801/2864081714","cluster_addr":"172.21.15.73:6803/2864081714","heartbeat_back_addr":"172.21.15.73:6807/2864081714","heartbeat_front_addr":"172.21.15.73:6805/2864081714","state":["exists","up"]},{"osd":4,"uuid":"f04f1a37-5e86-4527-9c26-8ca21ccdd082","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"53aa7cf0-1f78-411c-bb5e-e5f5789dc4cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"47cdfa3e-cd16-404c-bb76-1524ac454b51","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"3caf8dd6-f629-41af-94f2-e636d1aa2536","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:28:07.206891+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:28:09.888 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-09-12T00:28:10.099 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-12T00:28:10.101+0000 7f4350a9f640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T00:28:10.112 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-12T00:28:10.114+0000 7f43480aa640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:28:10.123 INFO:tasks.ceph.osd.2.smithi073.stderr:2024-09-12T00:28:10.124+0000 7fd2f7285640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T00:28:10.135 INFO:tasks.ceph.osd.2.smithi073.stderr:2024-09-12T00:28:10.137+0000 7fd2ef0a4640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:28:10.271 INFO:tasks.ceph.osd.6.smithi117.stderr:2024-09-12T00:28:10.273+0000 7f248ac19640 -1 osd.6 0 waiting for initial osdmap 2024-09-12T00:28:10.286 INFO:tasks.ceph.osd.6.smithi117.stderr:2024-09-12T00:28:10.287+0000 7f2482a38640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:28:10.310 INFO:tasks.ceph.osd.5.smithi117.stderr:2024-09-12T00:28:10.311+0000 7ff6eb830640 -1 osd.5 0 waiting for initial osdmap 2024-09-12T00:28:10.322 INFO:tasks.ceph.osd.5.smithi117.stderr:2024-09-12T00:28:10.324+0000 7ff6e364f640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:28:10.351 INFO:tasks.ceph.osd.4.smithi117.stderr:2024-09-12T00:28:10.353+0000 7fa81c4bd640 -1 osd.4 0 waiting for initial osdmap 2024-09-12T00:28:10.368 INFO:tasks.ceph.osd.4.smithi117.stderr:2024-09-12T00:28:10.370+0000 7fa8142dc640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:28:10.476 INFO:tasks.ceph.osd.0.smithi073.stderr:2024-09-12T00:28:10.477+0000 7fc75604a640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T00:28:10.488 INFO:tasks.ceph.osd.0.smithi073.stderr:2024-09-12T00:28:10.490+0000 7fc74de69640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:28:10.607 INFO:tasks.ceph.osd.7.smithi117.stderr:2024-09-12T00:28:10.609+0000 7f70dd5de640 -1 osd.7 0 waiting for initial osdmap 2024-09-12T00:28:10.618 INFO:tasks.ceph.osd.7.smithi117.stderr:2024-09-12T00:28:10.620+0000 7f70d53fd640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:28:16.696 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T00:28:17.002 INFO:teuthology.misc.health.smithi073.stdout: 2024-09-12T00:28:17.003 INFO:teuthology.misc.health.smithi073.stdout:{"epoch":19,"fsid":"f020195c-ad88-4fe3-a760-71957da35598","created":"2024-09-12T00:27:58.232371+0000","modified":"2024-09-12T00:28:15.124673+0000","last_up_change":"2024-09-12T00:28:11.103864+0000","last_in_change":"2024-09-12T00:28:01.397414+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:28:12.470055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eb34ba71-824c-4899-8325-e5683677cde7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1807760270},{"type":"v1","addr":"172.21.15.73:6811","nonce":1807760270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1807760270},{"type":"v1","addr":"172.21.15.73:6813","nonce":1807760270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1807760270},{"type":"v1","addr":"172.21.15.73:6817","nonce":1807760270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1807760270},{"type":"v1","addr":"172.21.15.73:6815","nonce":1807760270}]},"public_addr":"172.21.15.73:6811/1807760270","cluster_addr":"172.21.15.73:6813/1807760270","heartbeat_back_addr":"172.21.15.73:6817/1807760270","heartbeat_front_addr":"172.21.15.73:6815/1807760270","state":["exists","up"]},{"osd":1,"uuid":"c5a02013-ada7-406c-9a62-4a683000d243","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":153097326},{"type":"v1","addr":"172.21.15.73:6819","nonce":153097326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":153097326},{"type":"v1","addr":"172.21.15.73:6821","nonce":153097326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":153097326},{"type":"v1","addr":"172.21.15.73:6825","nonce":153097326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":153097326},{"type":"v1","addr":"172.21.15.73:6823","nonce":153097326}]},"public_addr":"172.21.15.73:6819/153097326","cluster_addr":"172.21.15.73:6821/153097326","heartbeat_back_addr":"172.21.15.73:6825/153097326","heartbeat_front_addr":"172.21.15.73:6823/153097326","state":["exists","up"]},{"osd":2,"uuid":"f0720950-c9f6-4f48-882d-ca95299711e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":269690776},{"type":"v1","addr":"172.21.15.73:6827","nonce":269690776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":269690776},{"type":"v1","addr":"172.21.15.73:6829","nonce":269690776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":269690776},{"type":"v1","addr":"172.21.15.73:6833","nonce":269690776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":269690776},{"type":"v1","addr":"172.21.15.73:6831","nonce":269690776}]},"public_addr":"172.21.15.73:6827/269690776","cluster_addr":"172.21.15.73:6829/269690776","heartbeat_back_addr":"172.21.15.73:6833/269690776","heartbeat_front_addr":"172.21.15.73:6831/269690776","state":["exists","up"]},{"osd":3,"uuid":"986d4757-211f-4814-aeb4-9567f819b765","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2864081714},{"type":"v1","addr":"172.21.15.73:6801","nonce":2864081714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2864081714},{"type":"v1","addr":"172.21.15.73:6803","nonce":2864081714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2864081714},{"type":"v1","addr":"172.21.15.73:6807","nonce":2864081714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2864081714},{"type":"v1","addr":"172.21.15.73:6805","nonce":2864081714}]},"public_addr":"172.21.15.73:6801/2864081714","cluster_addr":"172.21.15.73:6803/2864081714","heartbeat_back_addr":"172.21.15.73:6807/2864081714","heartbeat_front_addr":"172.21.15.73:6805/2864081714","state":["exists","up"]},{"osd":4,"uuid":"f04f1a37-5e86-4527-9c26-8ca21ccdd082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":87909260},{"type":"v1","addr":"172.21.15.117:6809","nonce":87909260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":87909260},{"type":"v1","addr":"172.21.15.117:6811","nonce":87909260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":87909260},{"type":"v1","addr":"172.21.15.117:6815","nonce":87909260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":87909260},{"type":"v1","addr":"172.21.15.117:6813","nonce":87909260}]},"public_addr":"172.21.15.117:6809/87909260","cluster_addr":"172.21.15.117:6811/87909260","heartbeat_back_addr":"172.21.15.117:6815/87909260","heartbeat_front_addr":"172.21.15.117:6813/87909260","state":["exists","up"]},{"osd":5,"uuid":"53aa7cf0-1f78-411c-bb5e-e5f5789dc4cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":197320478},{"type":"v1","addr":"172.21.15.117:6825","nonce":197320478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":197320478},{"type":"v1","addr":"172.21.15.117:6827","nonce":197320478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":197320478},{"type":"v1","addr":"172.21.15.117:6831","nonce":197320478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":197320478},{"type":"v1","addr":"172.21.15.117:6829","nonce":197320478}]},"public_addr":"172.21.15.117:6825/197320478","cluster_addr":"172.21.15.117:6827/197320478","heartbeat_back_addr":"172.21.15.117:6831/197320478","heartbeat_front_addr":"172.21.15.117:6829/197320478","state":["exists","up"]},{"osd":6,"uuid":"47cdfa3e-cd16-404c-bb76-1524ac454b51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":110688882},{"type":"v1","addr":"172.21.15.117:6801","nonce":110688882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":110688882},{"type":"v1","addr":"172.21.15.117:6803","nonce":110688882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":110688882},{"type":"v1","addr":"172.21.15.117:6807","nonce":110688882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":110688882},{"type":"v1","addr":"172.21.15.117:6805","nonce":110688882}]},"public_addr":"172.21.15.117:6801/110688882","cluster_addr":"172.21.15.117:6803/110688882","heartbeat_back_addr":"172.21.15.117:6807/110688882","heartbeat_front_addr":"172.21.15.117:6805/110688882","state":["exists","up"]},{"osd":7,"uuid":"3caf8dd6-f629-41af-94f2-e636d1aa2536","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":1460498570},{"type":"v1","addr":"172.21.15.117:6817","nonce":1460498570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":1460498570},{"type":"v1","addr":"172.21.15.117:6819","nonce":1460498570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":1460498570},{"type":"v1","addr":"172.21.15.117:6823","nonce":1460498570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":1460498570},{"type":"v1","addr":"172.21.15.117:6821","nonce":1460498570}]},"public_addr":"172.21.15.117:6817/1460498570","cluster_addr":"172.21.15.117:6819/1460498570","heartbeat_back_addr":"172.21.15.117:6823/1460498570","heartbeat_front_addr":"172.21.15.117:6821/1460498570","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:28:08.764438+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:28:07.752079+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:28:08.096171+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:28:07.206891+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:28:08.219743+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:28:07.997017+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:28:07.448575+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:28:08.645429+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:28:17.018 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-12T00:28:17.018 INFO:tasks.ceph:Creating RBD pool 2024-09-12T00:28:17.018 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-12T00:28:18.152 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'rbd' created 2024-09-12T00:28:18.167 DEBUG:teuthology.orchestra.run.smithi073:> rbd --cluster ceph pool init rbd 2024-09-12T00:28:18.233 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:28:18.233 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:28:21.173 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-12T00:28:21.174 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-12T00:28:21.175 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-12T00:28:21.487 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:28:21.500 INFO:teuthology.orchestra.run.smithi073.stdout:[{"version":9,"timestamp":"2024-09-12T00:28:10.611001+0000","name":"","changes":[{"name":"osd.7/osd_mclock_max_capacity_iops_ssd","new_value":"6650.687090"}]}] 2024-09-12T00:28:21.500 INFO:tasks.ceph_manager:config epoch is 9 2024-09-12T00:28:21.501 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T00:28:21.501 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-12T00:28:21.501 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-12T00:28:21.848 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:28:21.859 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":351833213},{"type":"v1","addr":"172.21.15.73:6809","nonce":351833213}]},"active_addr":"172.21.15.73:6809/351833213","active_change":"2024-09-12T00:28:02.446352+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4101,"name":"x","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":3527908497}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":3735480787}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":818935988}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":3268131144}]}]} 2024-09-12T00:28:21.863 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-12T00:28:21.863 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T00:28:21.863 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:28:22.165 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:28:22.165 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":23,"fsid":"f020195c-ad88-4fe3-a760-71957da35598","created":"2024-09-12T00:27:58.232371+0000","modified":"2024-09-12T00:28:21.156600+0000","last_up_change":"2024-09-12T00:28:11.103864+0000","last_in_change":"2024-09-12T00:28:01.397414+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:28:12.470055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T00:28:17.330363+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":23,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eb34ba71-824c-4899-8325-e5683677cde7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1807760270},{"type":"v1","addr":"172.21.15.73:6811","nonce":1807760270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1807760270},{"type":"v1","addr":"172.21.15.73:6813","nonce":1807760270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1807760270},{"type":"v1","addr":"172.21.15.73:6817","nonce":1807760270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1807760270},{"type":"v1","addr":"172.21.15.73:6815","nonce":1807760270}]},"public_addr":"172.21.15.73:6811/1807760270","cluster_addr":"172.21.15.73:6813/1807760270","heartbeat_back_addr":"172.21.15.73:6817/1807760270","heartbeat_front_addr":"172.21.15.73:6815/1807760270","state":["exists","up"]},{"osd":1,"uuid":"c5a02013-ada7-406c-9a62-4a683000d243","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":153097326},{"type":"v1","addr":"172.21.15.73:6819","nonce":153097326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":153097326},{"type":"v1","addr":"172.21.15.73:6821","nonce":153097326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":153097326},{"type":"v1","addr":"172.21.15.73:6825","nonce":153097326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":153097326},{"type":"v1","addr":"172.21.15.73:6823","nonce":153097326}]},"public_addr":"172.21.15.73:6819/153097326","cluster_addr":"172.21.15.73:6821/153097326","heartbeat_back_addr":"172.21.15.73:6825/153097326","heartbeat_front_addr":"172.21.15.73:6823/153097326","state":["exists","up"]},{"osd":2,"uuid":"f0720950-c9f6-4f48-882d-ca95299711e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":269690776},{"type":"v1","addr":"172.21.15.73:6827","nonce":269690776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":269690776},{"type":"v1","addr":"172.21.15.73:6829","nonce":269690776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":269690776},{"type":"v1","addr":"172.21.15.73:6833","nonce":269690776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":269690776},{"type":"v1","addr":"172.21.15.73:6831","nonce":269690776}]},"public_addr":"172.21.15.73:6827/269690776","cluster_addr":"172.21.15.73:6829/269690776","heartbeat_back_addr":"172.21.15.73:6833/269690776","heartbeat_front_addr":"172.21.15.73:6831/269690776","state":["exists","up"]},{"osd":3,"uuid":"986d4757-211f-4814-aeb4-9567f819b765","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2864081714},{"type":"v1","addr":"172.21.15.73:6801","nonce":2864081714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2864081714},{"type":"v1","addr":"172.21.15.73:6803","nonce":2864081714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2864081714},{"type":"v1","addr":"172.21.15.73:6807","nonce":2864081714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2864081714},{"type":"v1","addr":"172.21.15.73:6805","nonce":2864081714}]},"public_addr":"172.21.15.73:6801/2864081714","cluster_addr":"172.21.15.73:6803/2864081714","heartbeat_back_addr":"172.21.15.73:6807/2864081714","heartbeat_front_addr":"172.21.15.73:6805/2864081714","state":["exists","up"]},{"osd":4,"uuid":"f04f1a37-5e86-4527-9c26-8ca21ccdd082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":87909260},{"type":"v1","addr":"172.21.15.117:6809","nonce":87909260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":87909260},{"type":"v1","addr":"172.21.15.117:6811","nonce":87909260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":87909260},{"type":"v1","addr":"172.21.15.117:6815","nonce":87909260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":87909260},{"type":"v1","addr":"172.21.15.117:6813","nonce":87909260}]},"public_addr":"172.21.15.117:6809/87909260","cluster_addr":"172.21.15.117:6811/87909260","heartbeat_back_addr":"172.21.15.117:6815/87909260","heartbeat_front_addr":"172.21.15.117:6813/87909260","state":["exists","up"]},{"osd":5,"uuid":"53aa7cf0-1f78-411c-bb5e-e5f5789dc4cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":197320478},{"type":"v1","addr":"172.21.15.117:6825","nonce":197320478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":197320478},{"type":"v1","addr":"172.21.15.117:6827","nonce":197320478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":197320478},{"type":"v1","addr":"172.21.15.117:6831","nonce":197320478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":197320478},{"type":"v1","addr":"172.21.15.117:6829","nonce":197320478}]},"public_addr":"172.21.15.117:6825/197320478","cluster_addr":"172.21.15.117:6827/197320478","heartbeat_back_addr":"172.21.15.117:6831/197320478","heartbeat_front_addr":"172.21.15.117:6829/197320478","state":["exists","up"]},{"osd":6,"uuid":"47cdfa3e-cd16-404c-bb76-1524ac454b51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":110688882},{"type":"v1","addr":"172.21.15.117:6801","nonce":110688882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":110688882},{"type":"v1","addr":"172.21.15.117:6803","nonce":110688882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":110688882},{"type":"v1","addr":"172.21.15.117:6807","nonce":110688882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":110688882},{"type":"v1","addr":"172.21.15.117:6805","nonce":110688882}]},"public_addr":"172.21.15.117:6801/110688882","cluster_addr":"172.21.15.117:6803/110688882","heartbeat_back_addr":"172.21.15.117:6807/110688882","heartbeat_front_addr":"172.21.15.117:6805/110688882","state":["exists","up"]},{"osd":7,"uuid":"3caf8dd6-f629-41af-94f2-e636d1aa2536","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":1460498570},{"type":"v1","addr":"172.21.15.117:6817","nonce":1460498570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":1460498570},{"type":"v1","addr":"172.21.15.117:6819","nonce":1460498570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":1460498570},{"type":"v1","addr":"172.21.15.117:6823","nonce":1460498570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":1460498570},{"type":"v1","addr":"172.21.15.117:6821","nonce":1460498570}]},"public_addr":"172.21.15.117:6817/1460498570","cluster_addr":"172.21.15.117:6819/1460498570","heartbeat_back_addr":"172.21.15.117:6823/1460498570","heartbeat_front_addr":"172.21.15.117:6821/1460498570","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:28:08.764438+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:28:07.752079+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:28:08.096171+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:28:07.206891+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:28:08.219743+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:28:07.997017+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:28:07.448575+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:28:08.645429+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:28:22.178 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T00:28:22.178 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:28:22.476 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:28:22.477 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":23,"fsid":"f020195c-ad88-4fe3-a760-71957da35598","created":"2024-09-12T00:27:58.232371+0000","modified":"2024-09-12T00:28:21.156600+0000","last_up_change":"2024-09-12T00:28:11.103864+0000","last_in_change":"2024-09-12T00:28:01.397414+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:28:12.470055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T00:28:17.330363+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":23,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eb34ba71-824c-4899-8325-e5683677cde7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1807760270},{"type":"v1","addr":"172.21.15.73:6811","nonce":1807760270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1807760270},{"type":"v1","addr":"172.21.15.73:6813","nonce":1807760270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1807760270},{"type":"v1","addr":"172.21.15.73:6817","nonce":1807760270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1807760270},{"type":"v1","addr":"172.21.15.73:6815","nonce":1807760270}]},"public_addr":"172.21.15.73:6811/1807760270","cluster_addr":"172.21.15.73:6813/1807760270","heartbeat_back_addr":"172.21.15.73:6817/1807760270","heartbeat_front_addr":"172.21.15.73:6815/1807760270","state":["exists","up"]},{"osd":1,"uuid":"c5a02013-ada7-406c-9a62-4a683000d243","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":153097326},{"type":"v1","addr":"172.21.15.73:6819","nonce":153097326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":153097326},{"type":"v1","addr":"172.21.15.73:6821","nonce":153097326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":153097326},{"type":"v1","addr":"172.21.15.73:6825","nonce":153097326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":153097326},{"type":"v1","addr":"172.21.15.73:6823","nonce":153097326}]},"public_addr":"172.21.15.73:6819/153097326","cluster_addr":"172.21.15.73:6821/153097326","heartbeat_back_addr":"172.21.15.73:6825/153097326","heartbeat_front_addr":"172.21.15.73:6823/153097326","state":["exists","up"]},{"osd":2,"uuid":"f0720950-c9f6-4f48-882d-ca95299711e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":269690776},{"type":"v1","addr":"172.21.15.73:6827","nonce":269690776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":269690776},{"type":"v1","addr":"172.21.15.73:6829","nonce":269690776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":269690776},{"type":"v1","addr":"172.21.15.73:6833","nonce":269690776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":269690776},{"type":"v1","addr":"172.21.15.73:6831","nonce":269690776}]},"public_addr":"172.21.15.73:6827/269690776","cluster_addr":"172.21.15.73:6829/269690776","heartbeat_back_addr":"172.21.15.73:6833/269690776","heartbeat_front_addr":"172.21.15.73:6831/269690776","state":["exists","up"]},{"osd":3,"uuid":"986d4757-211f-4814-aeb4-9567f819b765","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2864081714},{"type":"v1","addr":"172.21.15.73:6801","nonce":2864081714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2864081714},{"type":"v1","addr":"172.21.15.73:6803","nonce":2864081714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2864081714},{"type":"v1","addr":"172.21.15.73:6807","nonce":2864081714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2864081714},{"type":"v1","addr":"172.21.15.73:6805","nonce":2864081714}]},"public_addr":"172.21.15.73:6801/2864081714","cluster_addr":"172.21.15.73:6803/2864081714","heartbeat_back_addr":"172.21.15.73:6807/2864081714","heartbeat_front_addr":"172.21.15.73:6805/2864081714","state":["exists","up"]},{"osd":4,"uuid":"f04f1a37-5e86-4527-9c26-8ca21ccdd082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":87909260},{"type":"v1","addr":"172.21.15.117:6809","nonce":87909260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":87909260},{"type":"v1","addr":"172.21.15.117:6811","nonce":87909260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":87909260},{"type":"v1","addr":"172.21.15.117:6815","nonce":87909260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":87909260},{"type":"v1","addr":"172.21.15.117:6813","nonce":87909260}]},"public_addr":"172.21.15.117:6809/87909260","cluster_addr":"172.21.15.117:6811/87909260","heartbeat_back_addr":"172.21.15.117:6815/87909260","heartbeat_front_addr":"172.21.15.117:6813/87909260","state":["exists","up"]},{"osd":5,"uuid":"53aa7cf0-1f78-411c-bb5e-e5f5789dc4cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":197320478},{"type":"v1","addr":"172.21.15.117:6825","nonce":197320478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":197320478},{"type":"v1","addr":"172.21.15.117:6827","nonce":197320478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":197320478},{"type":"v1","addr":"172.21.15.117:6831","nonce":197320478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":197320478},{"type":"v1","addr":"172.21.15.117:6829","nonce":197320478}]},"public_addr":"172.21.15.117:6825/197320478","cluster_addr":"172.21.15.117:6827/197320478","heartbeat_back_addr":"172.21.15.117:6831/197320478","heartbeat_front_addr":"172.21.15.117:6829/197320478","state":["exists","up"]},{"osd":6,"uuid":"47cdfa3e-cd16-404c-bb76-1524ac454b51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":110688882},{"type":"v1","addr":"172.21.15.117:6801","nonce":110688882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":110688882},{"type":"v1","addr":"172.21.15.117:6803","nonce":110688882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":110688882},{"type":"v1","addr":"172.21.15.117:6807","nonce":110688882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":110688882},{"type":"v1","addr":"172.21.15.117:6805","nonce":110688882}]},"public_addr":"172.21.15.117:6801/110688882","cluster_addr":"172.21.15.117:6803/110688882","heartbeat_back_addr":"172.21.15.117:6807/110688882","heartbeat_front_addr":"172.21.15.117:6805/110688882","state":["exists","up"]},{"osd":7,"uuid":"3caf8dd6-f629-41af-94f2-e636d1aa2536","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":1460498570},{"type":"v1","addr":"172.21.15.117:6817","nonce":1460498570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":1460498570},{"type":"v1","addr":"172.21.15.117:6819","nonce":1460498570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":1460498570},{"type":"v1","addr":"172.21.15.117:6823","nonce":1460498570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":1460498570},{"type":"v1","addr":"172.21.15.117:6821","nonce":1460498570}]},"public_addr":"172.21.15.117:6817/1460498570","cluster_addr":"172.21.15.117:6819/1460498570","heartbeat_back_addr":"172.21.15.117:6823/1460498570","heartbeat_front_addr":"172.21.15.117:6821/1460498570","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:28:08.764438+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:28:07.752079+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:28:08.096171+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:28:07.206891+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:28:08.219743+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:28:07.997017+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:28:07.448575+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:28:08.645429+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:28:22.490 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T00:28:22.490 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T00:28:22.491 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T00:28:22.491 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-12T00:28:22.491 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-12T00:28:22.492 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-12T00:28:22.492 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-12T00:28:22.492 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-12T00:28:22.745 INFO:teuthology.orchestra.run.smithi073.stdout:64424509446 2024-09-12T00:28:22.746 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T00:28:22.752 INFO:teuthology.orchestra.run.smithi073.stdout:64424509445 2024-09-12T00:28:22.752 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T00:28:22.755 INFO:teuthology.orchestra.run.smithi073.stdout:64424509445 2024-09-12T00:28:22.755 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T00:28:22.756 INFO:teuthology.orchestra.run.smithi073.stdout:64424509445 2024-09-12T00:28:22.756 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T00:28:22.757 INFO:teuthology.orchestra.run.smithi073.stdout:64424509446 2024-09-12T00:28:22.758 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T00:28:22.760 INFO:teuthology.orchestra.run.smithi073.stdout:64424509447 2024-09-12T00:28:22.760 INFO:teuthology.orchestra.run.smithi073.stdout:55834574853 2024-09-12T00:28:22.761 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T00:28:22.761 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T00:28:22.765 INFO:teuthology.orchestra.run.smithi073.stdout:64424509446 2024-09-12T00:28:22.765 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T00:28:23.373 INFO:teuthology.orchestra.run.smithi073.stdout:64424509445 2024-09-12T00:28:23.389 INFO:teuthology.orchestra.run.smithi073.stdout:64424509444 2024-09-12T00:28:23.390 INFO:teuthology.orchestra.run.smithi073.stdout:55834574852 2024-09-12T00:28:23.391 INFO:teuthology.orchestra.run.smithi073.stdout:64424509444 2024-09-12T00:28:23.392 INFO:teuthology.orchestra.run.smithi073.stdout:64424509444 2024-09-12T00:28:23.394 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.0 2024-09-12T00:28:23.403 INFO:teuthology.orchestra.run.smithi073.stdout:64424509446 2024-09-12T00:28:23.406 INFO:teuthology.orchestra.run.smithi073.stdout:64424509445 2024-09-12T00:28:23.410 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.3 2024-09-12T00:28:23.412 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.4 2024-09-12T00:28:23.415 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.5 2024-09-12T00:28:23.415 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.6 2024-09-12T00:28:23.420 INFO:teuthology.orchestra.run.smithi073.stdout:64424509445 2024-09-12T00:28:23.422 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.2 2024-09-12T00:28:23.423 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.7 2024-09-12T00:28:23.434 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.1 2024-09-12T00:28:24.395 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T00:28:24.410 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T00:28:24.413 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T00:28:24.416 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T00:28:24.416 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T00:28:24.423 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T00:28:24.423 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T00:28:24.435 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T00:28:25.000 INFO:teuthology.orchestra.run.smithi073.stdout:64424509445 2024-09-12T00:28:25.020 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.0 2024-09-12T00:28:25.041 INFO:teuthology.orchestra.run.smithi073.stdout:64424509445 2024-09-12T00:28:25.053 INFO:teuthology.orchestra.run.smithi073.stdout:64424509444 2024-09-12T00:28:25.055 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.7 2024-09-12T00:28:25.069 INFO:teuthology.orchestra.run.smithi073.stdout:64424509444 2024-09-12T00:28:25.071 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.5 2024-09-12T00:28:25.079 INFO:teuthology.orchestra.run.smithi073.stdout:55834574852 2024-09-12T00:28:25.083 INFO:teuthology.orchestra.run.smithi073.stdout:64424509445 2024-09-12T00:28:25.083 INFO:teuthology.orchestra.run.smithi073.stdout:64424509446 2024-09-12T00:28:25.086 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.4 2024-09-12T00:28:25.092 INFO:teuthology.orchestra.run.smithi073.stdout:64424509444 2024-09-12T00:28:25.097 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.3 2024-09-12T00:28:25.099 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.1 2024-09-12T00:28:25.104 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.2 2024-09-12T00:28:25.108 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.6 2024-09-12T00:28:26.021 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T00:28:26.056 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T00:28:26.071 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T00:28:26.087 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T00:28:26.097 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T00:28:26.100 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T00:28:26.104 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T00:28:26.109 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T00:28:26.612 INFO:teuthology.orchestra.run.smithi073.stdout:64424509446 2024-09-12T00:28:26.632 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.0 2024-09-12T00:28:26.632 DEBUG:teuthology.parallel:result is None 2024-09-12T00:28:26.671 INFO:teuthology.orchestra.run.smithi073.stdout:64424509446 2024-09-12T00:28:26.681 INFO:teuthology.orchestra.run.smithi073.stdout:55834574853 2024-09-12T00:28:26.691 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.7 2024-09-12T00:28:26.691 DEBUG:teuthology.parallel:result is None 2024-09-12T00:28:26.696 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.3 2024-09-12T00:28:26.696 DEBUG:teuthology.parallel:result is None 2024-09-12T00:28:26.712 INFO:teuthology.orchestra.run.smithi073.stdout:64424509445 2024-09-12T00:28:26.725 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.6 2024-09-12T00:28:26.726 DEBUG:teuthology.parallel:result is None 2024-09-12T00:28:26.744 INFO:teuthology.orchestra.run.smithi073.stdout:64424509445 2024-09-12T00:28:26.749 INFO:teuthology.orchestra.run.smithi073.stdout:64424509447 2024-09-12T00:28:26.754 INFO:teuthology.orchestra.run.smithi073.stdout:64424509445 2024-09-12T00:28:26.757 INFO:teuthology.orchestra.run.smithi073.stdout:64424509446 2024-09-12T00:28:26.764 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.5 2024-09-12T00:28:26.765 DEBUG:teuthology.parallel:result is None 2024-09-12T00:28:26.769 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.2 2024-09-12T00:28:26.770 DEBUG:teuthology.parallel:result is None 2024-09-12T00:28:26.770 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.4 2024-09-12T00:28:26.770 DEBUG:teuthology.parallel:result is None 2024-09-12T00:28:26.772 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.1 2024-09-12T00:28:26.772 DEBUG:teuthology.parallel:result is None 2024-09-12T00:28:26.772 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T00:28:26.772 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:28:27.106 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:28:27.106 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T00:28:27.118 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-12T00:28:26.455158+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219244,"kb_used_data":2992,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755476,"statfs":{"total":773094113280,"available":772869607424,"internally_reserved":0,"allocated":3063808,"data_stored":1820734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.301692"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T00:28:21.324169+0000","last_change":"2024-09-12T00:28:21.324169+0000","last_active":"2024-09-12T00:28:21.324169+0000","last_peered":"2024-09-12T00:28:21.324169+0000","last_clean":"2024-09-12T00:28:21.324169+0000","last_became_active":"2024-09-12T00:28:19.162886+0000","last_became_peered":"2024-09-12T00:28:19.162886+0000","last_unstale":"2024-09-12T00:28:21.324169+0000","last_undegraded":"2024-09-12T00:28:21.324169+0000","last_fullsized":"2024-09-12T00:28:21.324169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_clean_scrub_stamp":"2024-09-12T00:28:18.139537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:37.883634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044054899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T00:28:21.163585+0000","last_change":"2024-09-12T00:28:21.163585+0000","last_active":"2024-09-12T00:28:21.163585+0000","last_peered":"2024-09-12T00:28:21.163585+0000","last_clean":"2024-09-12T00:28:21.163585+0000","last_became_active":"2024-09-12T00:28:19.160344+0000","last_became_peered":"2024-09-12T00:28:19.160344+0000","last_unstale":"2024-09-12T00:28:21.163585+0000","last_undegraded":"2024-09-12T00:28:21.163585+0000","last_fullsized":"2024-09-12T00:28:21.163585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_clean_scrub_stamp":"2024-09-12T00:28:18.139537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:57.842057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000483707,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T00:28:21.165802+0000","last_change":"2024-09-12T00:28:21.165802+0000","last_active":"2024-09-12T00:28:21.165802+0000","last_peered":"2024-09-12T00:28:21.165802+0000","last_clean":"2024-09-12T00:28:21.165802+0000","last_became_active":"2024-09-12T00:28:19.384222+0000","last_became_peered":"2024-09-12T00:28:19.384222+0000","last_unstale":"2024-09-12T00:28:21.165802+0000","last_undegraded":"2024-09-12T00:28:21.165802+0000","last_fullsized":"2024-09-12T00:28:21.165802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_clean_scrub_stamp":"2024-09-12T00:28:18.139537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:40.635892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060999899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T00:28:21.163542+0000","last_change":"2024-09-12T00:28:21.163542+0000","last_active":"2024-09-12T00:28:21.163542+0000","last_peered":"2024-09-12T00:28:21.163542+0000","last_clean":"2024-09-12T00:28:21.163542+0000","last_became_active":"2024-09-12T00:28:19.383394+0000","last_became_peered":"2024-09-12T00:28:19.383394+0000","last_unstale":"2024-09-12T00:28:21.163542+0000","last_undegraded":"2024-09-12T00:28:21.163542+0000","last_fullsized":"2024-09-12T00:28:21.163542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_clean_scrub_stamp":"2024-09-12T00:28:18.139537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:28.230151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046548800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"23'2","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T00:28:21.170771+0000","last_change":"2024-09-12T00:28:21.170135+0000","last_active":"2024-09-12T00:28:21.170771+0000","last_peered":"2024-09-12T00:28:21.170771+0000","last_clean":"2024-09-12T00:28:21.170771+0000","last_became_active":"2024-09-12T00:28:19.162307+0000","last_became_peered":"2024-09-12T00:28:19.162307+0000","last_unstale":"2024-09-12T00:28:21.170771+0000","last_undegraded":"2024-09-12T00:28:21.170771+0000","last_fullsized":"2024-09-12T00:28:21.170771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_clean_scrub_stamp":"2024-09-12T00:28:18.139537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:21.559693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089189499999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T00:28:21.323944+0000","last_change":"2024-09-12T00:28:21.323944+0000","last_active":"2024-09-12T00:28:21.323944+0000","last_peered":"2024-09-12T00:28:21.323944+0000","last_clean":"2024-09-12T00:28:21.323944+0000","last_became_active":"2024-09-12T00:28:19.225901+0000","last_became_peered":"2024-09-12T00:28:19.225901+0000","last_unstale":"2024-09-12T00:28:21.323944+0000","last_undegraded":"2024-09-12T00:28:21.323944+0000","last_fullsized":"2024-09-12T00:28:21.323944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_clean_scrub_stamp":"2024-09-12T00:28:18.139537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:52.557475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032319500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T00:28:21.165739+0000","last_change":"2024-09-12T00:28:21.165739+0000","last_active":"2024-09-12T00:28:21.165739+0000","last_peered":"2024-09-12T00:28:21.165739+0000","last_clean":"2024-09-12T00:28:21.165739+0000","last_became_active":"2024-09-12T00:28:19.164970+0000","last_became_peered":"2024-09-12T00:28:19.164970+0000","last_unstale":"2024-09-12T00:28:21.165739+0000","last_undegraded":"2024-09-12T00:28:21.165739+0000","last_fullsized":"2024-09-12T00:28:21.165739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_clean_scrub_stamp":"2024-09-12T00:28:18.139537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:32.778181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055291100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"21'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T00:28:21.169710+0000","last_change":"2024-09-12T00:28:21.169710+0000","last_active":"2024-09-12T00:28:21.169710+0000","last_peered":"2024-09-12T00:28:21.169710+0000","last_clean":"2024-09-12T00:28:21.169710+0000","last_became_active":"2024-09-12T00:28:19.162328+0000","last_became_peered":"2024-09-12T00:28:19.162328+0000","last_unstale":"2024-09-12T00:28:21.169710+0000","last_undegraded":"2024-09-12T00:28:21.169710+0000","last_fullsized":"2024-09-12T00:28:21.169710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_clean_scrub_stamp":"2024-09-12T00:28:18.139537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:10.146909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046717800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"19'72","reported_seq":111,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T00:28:21.165119+0000","last_change":"2024-09-12T00:28:14.748208+0000","last_active":"2024-09-12T00:28:21.165119+0000","last_peered":"2024-09-12T00:28:21.165119+0000","last_clean":"2024-09-12T00:28:21.165119+0000","last_became_active":"2024-09-12T00:28:14.744766+0000","last_became_peered":"2024-09-12T00:28:14.744766+0000","last_unstale":"2024-09-12T00:28:21.165119+0000","last_undegraded":"2024-09-12T00:28:21.165119+0000","last_fullsized":"2024-09-12T00:28:21.165119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:13.107271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:13.107271+0000","last_clean_scrub_stamp":"2024-09-12T00:28:13.107271+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:46.810948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":827392,"data_stored":670363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":233472,"data_stored":79995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":80014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":79995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":79995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":80014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":827392,"data_stored":670363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":233472,"data_stored":79995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:28:27.119 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:28:27.415 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:28:27.416 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T00:28:27.428 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-12T00:28:26.455158+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219244,"kb_used_data":2992,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755476,"statfs":{"total":773094113280,"available":772869607424,"internally_reserved":0,"allocated":3063808,"data_stored":1820734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.301692"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T00:28:21.324169+0000","last_change":"2024-09-12T00:28:21.324169+0000","last_active":"2024-09-12T00:28:21.324169+0000","last_peered":"2024-09-12T00:28:21.324169+0000","last_clean":"2024-09-12T00:28:21.324169+0000","last_became_active":"2024-09-12T00:28:19.162886+0000","last_became_peered":"2024-09-12T00:28:19.162886+0000","last_unstale":"2024-09-12T00:28:21.324169+0000","last_undegraded":"2024-09-12T00:28:21.324169+0000","last_fullsized":"2024-09-12T00:28:21.324169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_clean_scrub_stamp":"2024-09-12T00:28:18.139537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:37.883634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044054899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T00:28:21.163585+0000","last_change":"2024-09-12T00:28:21.163585+0000","last_active":"2024-09-12T00:28:21.163585+0000","last_peered":"2024-09-12T00:28:21.163585+0000","last_clean":"2024-09-12T00:28:21.163585+0000","last_became_active":"2024-09-12T00:28:19.160344+0000","last_became_peered":"2024-09-12T00:28:19.160344+0000","last_unstale":"2024-09-12T00:28:21.163585+0000","last_undegraded":"2024-09-12T00:28:21.163585+0000","last_fullsized":"2024-09-12T00:28:21.163585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_clean_scrub_stamp":"2024-09-12T00:28:18.139537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:57.842057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000483707,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T00:28:21.165802+0000","last_change":"2024-09-12T00:28:21.165802+0000","last_active":"2024-09-12T00:28:21.165802+0000","last_peered":"2024-09-12T00:28:21.165802+0000","last_clean":"2024-09-12T00:28:21.165802+0000","last_became_active":"2024-09-12T00:28:19.384222+0000","last_became_peered":"2024-09-12T00:28:19.384222+0000","last_unstale":"2024-09-12T00:28:21.165802+0000","last_undegraded":"2024-09-12T00:28:21.165802+0000","last_fullsized":"2024-09-12T00:28:21.165802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_clean_scrub_stamp":"2024-09-12T00:28:18.139537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:40.635892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060999899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T00:28:21.163542+0000","last_change":"2024-09-12T00:28:21.163542+0000","last_active":"2024-09-12T00:28:21.163542+0000","last_peered":"2024-09-12T00:28:21.163542+0000","last_clean":"2024-09-12T00:28:21.163542+0000","last_became_active":"2024-09-12T00:28:19.383394+0000","last_became_peered":"2024-09-12T00:28:19.383394+0000","last_unstale":"2024-09-12T00:28:21.163542+0000","last_undegraded":"2024-09-12T00:28:21.163542+0000","last_fullsized":"2024-09-12T00:28:21.163542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_clean_scrub_stamp":"2024-09-12T00:28:18.139537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:28.230151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046548800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"23'2","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T00:28:21.170771+0000","last_change":"2024-09-12T00:28:21.170135+0000","last_active":"2024-09-12T00:28:21.170771+0000","last_peered":"2024-09-12T00:28:21.170771+0000","last_clean":"2024-09-12T00:28:21.170771+0000","last_became_active":"2024-09-12T00:28:19.162307+0000","last_became_peered":"2024-09-12T00:28:19.162307+0000","last_unstale":"2024-09-12T00:28:21.170771+0000","last_undegraded":"2024-09-12T00:28:21.170771+0000","last_fullsized":"2024-09-12T00:28:21.170771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_clean_scrub_stamp":"2024-09-12T00:28:18.139537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:21.559693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089189499999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T00:28:21.323944+0000","last_change":"2024-09-12T00:28:21.323944+0000","last_active":"2024-09-12T00:28:21.323944+0000","last_peered":"2024-09-12T00:28:21.323944+0000","last_clean":"2024-09-12T00:28:21.323944+0000","last_became_active":"2024-09-12T00:28:19.225901+0000","last_became_peered":"2024-09-12T00:28:19.225901+0000","last_unstale":"2024-09-12T00:28:21.323944+0000","last_undegraded":"2024-09-12T00:28:21.323944+0000","last_fullsized":"2024-09-12T00:28:21.323944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_clean_scrub_stamp":"2024-09-12T00:28:18.139537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:52.557475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032319500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T00:28:21.165739+0000","last_change":"2024-09-12T00:28:21.165739+0000","last_active":"2024-09-12T00:28:21.165739+0000","last_peered":"2024-09-12T00:28:21.165739+0000","last_clean":"2024-09-12T00:28:21.165739+0000","last_became_active":"2024-09-12T00:28:19.164970+0000","last_became_peered":"2024-09-12T00:28:19.164970+0000","last_unstale":"2024-09-12T00:28:21.165739+0000","last_undegraded":"2024-09-12T00:28:21.165739+0000","last_fullsized":"2024-09-12T00:28:21.165739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_clean_scrub_stamp":"2024-09-12T00:28:18.139537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:32.778181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055291100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"21'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T00:28:21.169710+0000","last_change":"2024-09-12T00:28:21.169710+0000","last_active":"2024-09-12T00:28:21.169710+0000","last_peered":"2024-09-12T00:28:21.169710+0000","last_clean":"2024-09-12T00:28:21.169710+0000","last_became_active":"2024-09-12T00:28:19.162328+0000","last_became_peered":"2024-09-12T00:28:19.162328+0000","last_unstale":"2024-09-12T00:28:21.169710+0000","last_undegraded":"2024-09-12T00:28:21.169710+0000","last_fullsized":"2024-09-12T00:28:21.169710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_clean_scrub_stamp":"2024-09-12T00:28:18.139537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:10.146909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046717800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"19'72","reported_seq":111,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T00:28:21.165119+0000","last_change":"2024-09-12T00:28:14.748208+0000","last_active":"2024-09-12T00:28:21.165119+0000","last_peered":"2024-09-12T00:28:21.165119+0000","last_clean":"2024-09-12T00:28:21.165119+0000","last_became_active":"2024-09-12T00:28:14.744766+0000","last_became_peered":"2024-09-12T00:28:14.744766+0000","last_unstale":"2024-09-12T00:28:21.165119+0000","last_undegraded":"2024-09-12T00:28:21.165119+0000","last_fullsized":"2024-09-12T00:28:21.165119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:13.107271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:13.107271+0000","last_clean_scrub_stamp":"2024-09-12T00:28:13.107271+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:46.810948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":827392,"data_stored":670363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":233472,"data_stored":79995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":80014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":79995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":79995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":80014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":827392,"data_stored":670363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":233472,"data_stored":79995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:28:27.429 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T00:28:27.429 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T00:28:27.429 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-12T00:28:27.429 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T00:28:27.760 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:28:27.760 INFO:teuthology.orchestra.run.smithi073.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T00:28:27.772 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-12T00:28:27.772 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-09-12T00:28:27.786 DEBUG:teuthology.task:Applying overrides for task openssl_keys: {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}} 2024-09-12T00:28:27.786 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p /home/ubuntu/cephtest/ca 2024-09-12T00:28:27.815 DEBUG:teuthology.orchestra.run.smithi073:> openssl req -x509 -nodes -newkey rsa:4096 -keyout /home/ubuntu/cephtest/ca/root.key -days 365 -out /home/ubuntu/cephtest/ca/root.crt -subj /CN=teuthology 2024-09-12T00:28:27.977 INFO:teuthology.orchestra.run.smithi073.stderr:......+.......+..+++++++++++++++++++++++++++++++++++++++++++++*..+.......+........+.+.........+.....+...+....+........+......+.+......+..+...............+...+..........+.....+..........+...+..+.......+..+...+.............+........+.+.....................+..+..........+...+..+......+......+.............+..+....+..+++++++++++++++++++++++++++++++++++++++++++++*.....+...+....+..+....+.....+...................+......+.........+...+..............+....+............+..+.....................+.+.....+..............................+......+...+++++ 2024-09-12T00:28:28.000 INFO:teuthology.orchestra.run.smithi073.stderr:.......+...+...............+.+.........+...........+.+.....+....+..............+......+.+............+......+...............+......+......+..+...+............+.+......+.........+..+++++++++++++++++++++++++++++++++++++++++++++*.....+.+++++++++++++++++++++++++++++++++++++++++++++*...................+......+..............+..........+..+............+.............+...+.....+.+...+...+.....+.........+.........................+++++ 2024-09-12T00:28:28.016 INFO:teuthology.orchestra.run.smithi073.stderr:----- 2024-09-12T00:28:28.022 DEBUG:teuthology.orchestra.run.smithi073:> sudo cp /home/ubuntu/cephtest/ca/root.crt /usr/share/pki/ca-trust-source/anchors/root.crt 2024-09-12T00:28:28.062 DEBUG:teuthology.orchestra.run.smithi073:> sudo update-ca-trust 2024-09-12T00:28:29.175 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p /home/ubuntu/cephtest/ca 2024-09-12T00:28:29.204 DEBUG:teuthology.orchestra.run.smithi073:> openssl req -nodes -newkey rsa:2048 -keyout /home/ubuntu/cephtest/ca/rgw.client.0.key -out /home/ubuntu/cephtest/ca/rgw.client.0.csr -subj /CN=smithi073.front.sepia.ceph.com 2024-09-12T00:28:29.358 INFO:teuthology.orchestra.run.smithi073.stderr:...+...+....+.....+......+.............+..+...+.........+.......+...+.....+.+.....+++++++++++++++++++++++++++++++++++++++*.............+++++++++++++++++++++++++++++++++++++++*.......+.....+............+...+.+............+...+..+.......+..+.........+.+...+..+......+.......+.....+.......+........+.+..+....+......+.....+...................+........+...+.......+.....+......+....+........+...+......+.............+........+...+.+.........+..+.......+...+..+.......+.....+................+.....+....+...........+.......+...+...+..+............+.+..+.......+.....+.............+..+.+............+............+..+......+.........+....+..+...+..........+..+.......+..+......+...+....+...+.........+...+...+..+.+.....+.+......+............+.....+...+.......+.................+.+..+...+....+.....+......+.......+.....+.+..+...+....+..+................+.........+.....+...+...+...+.+......+...+.........+.....+................+.....+.+......+..+.+.....+...............+.+........+.+.....................+.........+.....+......+....+..+............++++++ 2024-09-12T00:28:29.358 INFO:teuthology.orchestra.run.smithi073.stderr:...+.........+.+...+...........+....+.........+...+.................+.......+......+..+...+...+....+.....+...+....+.....+.+...+..+...+......+.+.................+.......+...+...+.....+.......+..+.+........+.+..............+.......+............+...+...+..+...+......+.+++++++++++++++++++++++++++++++++++++++*..+......+....+...........+.+.....+.+........+++++++++++++++++++++++++++++++++++++++*........+.........+...+...+..+............+.+..+...+....+...+.....................+.....+.......+..+.+.........+..+....+...............+..+....+......+..+.+.....+.+.....+......+...+.......+..+.......++++++ 2024-09-12T00:28:29.358 INFO:teuthology.orchestra.run.smithi073.stderr:----- 2024-09-12T00:28:29.358 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T00:28:29.358 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-12T00:28:29.427 DEBUG:teuthology.orchestra.run.smithi073:> openssl x509 -req -in /home/ubuntu/cephtest/ca/rgw.client.0.csr -CA /home/ubuntu/cephtest/ca/root.crt -CAkey /home/ubuntu/cephtest/ca/root.key -CAcreateserial -out /home/ubuntu/cephtest/ca/rgw.client.0.crt -days 365 -sha256 -extfile /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-12T00:28:29.504 INFO:teuthology.orchestra.run.smithi073.stderr:Certificate request self-signature ok 2024-09-12T00:28:29.504 INFO:teuthology.orchestra.run.smithi073.stderr:subject=CN=smithi073.front.sepia.ceph.com 2024-09-12T00:28:29.511 DEBUG:teuthology.orchestra.run.smithi073:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.csr /home/ubuntu/cephtest/ca/root.srl /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-12T00:28:29.579 DEBUG:teuthology.orchestra.run.smithi073:> openssl verify -CAfile /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-09-12T00:28:29.651 INFO:teuthology.orchestra.run.smithi073.stdout:/home/ubuntu/cephtest/ca/rgw.client.0.crt: OK 2024-09-12T00:28:29.651 DEBUG:teuthology.orchestra.run.smithi073:> cat /home/ubuntu/cephtest/ca/rgw.client.0.key >> /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-09-12T00:28:29.720 INFO:teuthology.run_tasks:Running task rgw... 2024-09-12T00:28:29.738 DEBUG:tasks.rgw:config is {'client.0': {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']}} 2024-09-12T00:28:29.738 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-12T00:28:29.739 INFO:tasks.rgw:Creating data pools 2024-09-12T00:28:29.739 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-12T00:28:29.739 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2024-09-12T00:28:30.192 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'default.rgw.buckets.data' created 2024-09-12T00:28:30.208 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-12T00:28:31.191 INFO:teuthology.orchestra.run.smithi073.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-12T00:28:31.218 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-12T00:28:32.194 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'default.rgw.buckets.index' created 2024-09-12T00:28:32.214 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-12T00:28:33.196 INFO:teuthology.orchestra.run.smithi073.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-12T00:28:33.232 DEBUG:tasks.rgw:Pools created 2024-09-12T00:28:33.232 INFO:tasks.rgw:Configuring compression type = random 2024-09-12T00:28:33.232 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T00:28:33.232 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T00:28:33.233 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T00:28:33.437 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:28:33.437 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:28:35.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:35.243+0000 7fdde1322640 0 -- 172.21.15.73:0/2137398717 >> [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] conn(0x7fdcb4076380 msgr2=0x7fdcb4078840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:35.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:35.247+0000 7fdde5c11800 20 rados->read ofs=0 len=0 2024-09-12T00:28:35.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:35.249+0000 7fdde1b23640 0 -- 172.21.15.73:0/3206587694 >> [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] conn(0x7fdca8076470 msgr2=0x7fdca8078930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:35.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:35.249+0000 7fdde5c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:35.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:35.249+0000 7fdde5c11800 20 realm 2024-09-12T00:28:35.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:35.249+0000 7fdde5c11800 20 rados->read ofs=0 len=0 2024-09-12T00:28:35.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:35.250+0000 7fdde5c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:35.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:35.250+0000 7fdde5c11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:28:35.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:35.250+0000 7fdde5c11800 20 rados->read ofs=0 len=0 2024-09-12T00:28:35.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:35.250+0000 7fdde5c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:35.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:35.250+0000 7fdde5c11800 20 rados->read ofs=0 len=0 2024-09-12T00:28:35.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:35.251+0000 7fdde5c11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:35.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:35.251+0000 7fdde5c11800 20 rados->read ofs=0 len=0 2024-09-12T00:28:35.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:35.252+0000 7fdde5c11800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:28:35.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:35.252+0000 7fdde5c11800 20 searching for the correct realm 2024-09-12T00:28:35.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:35.263+0000 7fdde5c11800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:28:35.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:35.263+0000 7fdde5c11800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:28:35.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:35.263+0000 7fdde5c11800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:28:35.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:35.263+0000 7fdde5c11800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:28:35.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:35.263+0000 7fdde5c11800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:28:35.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:35.263+0000 7fdde5c11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:28:35.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:35.263+0000 7fdde5c11800 20 rados->read ofs=0 len=0 2024-09-12T00:28:35.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:35.263+0000 7fdde5c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:35.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:35.263+0000 7fdde5c11800 20 rados->read ofs=0 len=0 2024-09-12T00:28:35.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:35.263+0000 7fdde5c11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:35.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:35.263+0000 7fdde5c11800 20 rados->read ofs=0 len=0 2024-09-12T00:28:35.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:35.264+0000 7fdde5c11800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:28:35.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:35.264+0000 7fdde5c11800 20 zone default found 2024-09-12T00:28:35.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:35.264+0000 7fdde5c11800 4 Realm: () 2024-09-12T00:28:35.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:35.264+0000 7fdde5c11800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:28:35.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:35.264+0000 7fdde5c11800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:28:35.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:35.264+0000 7fdde5c11800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:28:35.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:35.264+0000 7fdde5c11800 20 zonegroup default 2024-09-12T00:28:35.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:35.264+0000 7fdde5c11800 20 rados->read ofs=0 len=0 2024-09-12T00:28:35.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:35.264+0000 7fdde5c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:35.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:35.264+0000 7fdde5c11800 20 rados->read ofs=0 len=0 2024-09-12T00:28:37.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:37.219+0000 7fdde5c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:37.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:37.219+0000 7fdde5c11800 20 rados->read ofs=0 len=0 2024-09-12T00:28:37.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:37.220+0000 7fdde5c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:37.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:37.220+0000 7fdde5c11800 20 started sync module instance, tier type = 2024-09-12T00:28:37.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:37.220+0000 7fdde5c11800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:28:39.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.235+0000 7fdde5c11800 20 add_watcher() i=0 2024-09-12T00:28:39.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.235+0000 7fdde5c11800 20 add_watcher() i=1 2024-09-12T00:28:39.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.235+0000 7fdde5c11800 20 add_watcher() i=2 2024-09-12T00:28:39.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.235+0000 7fdde5c11800 20 add_watcher() i=3 2024-09-12T00:28:39.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.235+0000 7fdde5c11800 20 add_watcher() i=4 2024-09-12T00:28:39.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.235+0000 7fdde5c11800 20 add_watcher() i=5 2024-09-12T00:28:39.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.235+0000 7fdde5c11800 20 add_watcher() i=6 2024-09-12T00:28:39.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.236+0000 7fdde5c11800 20 add_watcher() i=7 2024-09-12T00:28:39.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.236+0000 7fdde5c11800 2 all 8 watchers are set, enabling cache 2024-09-12T00:28:39.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.236+0000 7fdde5c11800 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-09-12T00:28:39.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.236+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-09-12T00:28:39.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.236+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.237+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-09-12T00:28:39.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.237+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-09-12T00:28:39.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.237+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.237+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-09-12T00:28:39.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.237+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-09-12T00:28:39.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.237+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.237+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-09-12T00:28:39.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.237+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-09-12T00:28:39.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.237+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.238+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-09-12T00:28:39.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.238+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-09-12T00:28:39.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.238+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.238+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-09-12T00:28:39.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.238+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-09-12T00:28:39.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.238+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.238+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-09-12T00:28:39.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.238+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-09-12T00:28:39.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.238+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.238+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-09-12T00:28:39.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.238+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-09-12T00:28:39.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.238+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.239+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-09-12T00:28:39.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.239+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-09-12T00:28:39.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.239+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.239+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-09-12T00:28:39.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.239+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-09-12T00:28:39.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.239+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.239+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-09-12T00:28:39.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.239+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-09-12T00:28:39.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.239+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.239+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-09-12T00:28:39.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.239+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-09-12T00:28:39.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.239+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.240+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-09-12T00:28:39.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.240+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-09-12T00:28:39.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.240+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.240+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-09-12T00:28:39.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.240+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-09-12T00:28:39.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.240+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.240+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-09-12T00:28:39.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.240+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-09-12T00:28:39.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.240+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.240+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-09-12T00:28:39.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.240+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-09-12T00:28:39.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.240+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.241+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-09-12T00:28:39.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.241+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-09-12T00:28:39.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.241+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.241+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-09-12T00:28:39.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.241+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-09-12T00:28:39.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.241+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.241+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-09-12T00:28:39.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.241+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-09-12T00:28:39.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.241+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.242+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-09-12T00:28:39.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.242+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-09-12T00:28:39.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.242+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.242+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-09-12T00:28:39.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.242+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-09-12T00:28:39.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.242+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.242+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-09-12T00:28:39.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.242+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-09-12T00:28:39.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.242+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.243+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-09-12T00:28:39.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.243+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-09-12T00:28:39.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.243+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.243+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-09-12T00:28:39.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.243+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-09-12T00:28:39.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.243+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.243+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-09-12T00:28:39.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.243+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-09-12T00:28:39.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.243+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.243+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-09-12T00:28:39.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.243+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-09-12T00:28:39.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.243+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.244+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-09-12T00:28:39.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.244+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-09-12T00:28:39.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.244+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.244+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-09-12T00:28:39.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.244+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-09-12T00:28:39.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.244+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.244+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-09-12T00:28:39.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.244+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-09-12T00:28:39.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.244+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.245+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-09-12T00:28:39.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.245+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-09-12T00:28:39.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.245+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.245+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-09-12T00:28:39.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.245+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-09-12T00:28:39.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.245+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.245+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-09-12T00:28:39.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.245+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-09-12T00:28:39.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.245+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.245+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-09-12T00:28:39.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.245+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-09-12T00:28:39.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.245+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.246+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-09-12T00:28:39.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.246+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-09-12T00:28:39.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.246+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.246+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-09-12T00:28:39.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.246+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-09-12T00:28:39.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.246+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.246+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-09-12T00:28:39.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.246+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-09-12T00:28:39.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.246+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.246+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-09-12T00:28:39.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.246+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-09-12T00:28:39.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.246+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.247+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-09-12T00:28:39.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.247+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-09-12T00:28:39.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.247+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.247+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-09-12T00:28:39.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.247+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-09-12T00:28:39.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.247+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.247+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-09-12T00:28:39.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.247+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-09-12T00:28:39.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.247+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.247+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-09-12T00:28:39.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.247+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-09-12T00:28:39.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.247+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.248+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-09-12T00:28:39.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.248+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-09-12T00:28:39.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.248+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.248+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-09-12T00:28:39.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.248+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-09-12T00:28:39.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.248+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.248+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-09-12T00:28:39.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.248+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-09-12T00:28:39.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.248+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.249+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-09-12T00:28:39.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.249+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-09-12T00:28:39.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.249+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.249+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-09-12T00:28:39.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.249+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-09-12T00:28:39.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.249+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.249+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-09-12T00:28:39.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.249+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-09-12T00:28:39.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.249+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.249+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-09-12T00:28:39.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.249+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-09-12T00:28:39.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.249+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.250+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-09-12T00:28:39.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.250+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-09-12T00:28:39.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.250+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.250+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-09-12T00:28:39.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.250+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-09-12T00:28:39.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.250+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.250+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-09-12T00:28:39.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.250+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-09-12T00:28:39.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.250+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.250+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-09-12T00:28:39.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.250+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-09-12T00:28:39.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.250+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.251+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-09-12T00:28:39.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.251+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-09-12T00:28:39.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.251+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.251+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-09-12T00:28:39.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.251+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-09-12T00:28:39.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.251+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.251+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-09-12T00:28:39.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.251+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-09-12T00:28:39.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.251+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.251+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-09-12T00:28:39.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.251+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-09-12T00:28:39.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.251+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.252+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-09-12T00:28:39.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.252+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-09-12T00:28:39.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.252+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.252+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-09-12T00:28:39.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.252+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-09-12T00:28:39.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.252+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.252+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-09-12T00:28:39.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.252+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-09-12T00:28:39.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.252+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.253+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-09-12T00:28:39.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.253+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-09-12T00:28:39.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.253+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.253+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-09-12T00:28:39.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.253+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-09-12T00:28:39.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.253+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.253+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-09-12T00:28:39.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.253+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-09-12T00:28:39.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.253+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.254+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-09-12T00:28:39.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.254+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-09-12T00:28:39.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.254+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.254+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-09-12T00:28:39.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.254+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-09-12T00:28:39.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.254+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.254+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-09-12T00:28:39.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.254+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-09-12T00:28:39.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.254+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.254+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-09-12T00:28:39.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.254+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-09-12T00:28:39.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.254+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.255+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-09-12T00:28:39.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.255+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-09-12T00:28:39.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.255+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.255+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-09-12T00:28:39.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.255+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-09-12T00:28:39.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.255+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.255+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-09-12T00:28:39.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.255+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-09-12T00:28:39.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.255+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.255+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-09-12T00:28:39.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.255+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-09-12T00:28:39.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.255+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.256+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-09-12T00:28:39.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.256+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-09-12T00:28:39.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.256+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.256+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-09-12T00:28:39.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.256+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-09-12T00:28:39.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.256+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.256+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-09-12T00:28:39.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.256+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-09-12T00:28:39.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.256+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.256+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-09-12T00:28:39.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.256+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-09-12T00:28:39.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.256+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.257+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-09-12T00:28:39.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.257+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-09-12T00:28:39.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.257+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.257+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-09-12T00:28:39.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.257+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-09-12T00:28:39.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.257+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.257+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-09-12T00:28:39.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.257+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-09-12T00:28:39.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.257+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.257+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-09-12T00:28:39.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.257+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-09-12T00:28:39.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.257+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.258+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-09-12T00:28:39.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.258+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-09-12T00:28:39.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.258+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.258+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-09-12T00:28:39.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.258+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-09-12T00:28:39.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.258+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.258+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-09-12T00:28:39.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.258+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-09-12T00:28:39.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.258+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.258+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-09-12T00:28:39.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.258+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-09-12T00:28:39.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.258+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.259+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-09-12T00:28:39.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.259+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-09-12T00:28:39.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.259+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.259+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-09-12T00:28:39.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.259+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-09-12T00:28:39.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.259+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.259+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-09-12T00:28:39.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.259+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-09-12T00:28:39.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.259+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.259+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-09-12T00:28:39.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.259+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-09-12T00:28:39.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.259+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.260+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-09-12T00:28:39.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.260+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-09-12T00:28:39.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.260+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.260+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-09-12T00:28:39.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.260+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-09-12T00:28:39.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.260+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.260+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-09-12T00:28:39.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.260+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-09-12T00:28:39.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.260+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.260+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-09-12T00:28:39.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.260+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-09-12T00:28:39.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.260+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.261+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-09-12T00:28:39.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.261+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-09-12T00:28:39.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.261+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.261+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-09-12T00:28:39.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.261+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-09-12T00:28:39.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.261+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.261+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-09-12T00:28:39.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.261+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-09-12T00:28:39.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.261+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.261+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-09-12T00:28:39.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.261+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-09-12T00:28:39.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.261+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.262+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-09-12T00:28:39.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.262+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-09-12T00:28:39.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.262+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.262+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-09-12T00:28:39.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.262+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-09-12T00:28:39.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.262+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.262+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-09-12T00:28:39.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.262+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-09-12T00:28:39.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.262+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.262+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-09-12T00:28:39.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.262+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-09-12T00:28:39.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.262+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.263+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-09-12T00:28:39.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.263+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-09-12T00:28:39.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.263+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.263+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-09-12T00:28:39.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.263+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-09-12T00:28:39.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.263+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.263+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-09-12T00:28:39.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.263+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-09-12T00:28:39.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.263+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.263+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-09-12T00:28:39.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.263+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-09-12T00:28:39.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.263+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.264+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-09-12T00:28:39.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.264+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-09-12T00:28:39.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.264+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.264+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-09-12T00:28:39.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.264+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-09-12T00:28:39.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.264+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.264+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-09-12T00:28:39.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.264+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-09-12T00:28:39.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.264+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.264+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-09-12T00:28:39.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.264+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-09-12T00:28:39.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.264+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.265+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-09-12T00:28:39.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.265+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-09-12T00:28:39.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.265+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.265+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-09-12T00:28:39.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.265+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-09-12T00:28:39.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.265+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.265+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-09-12T00:28:39.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.265+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-09-12T00:28:39.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.265+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.265+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-09-12T00:28:39.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.265+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-09-12T00:28:39.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.265+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.266+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-09-12T00:28:39.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.266+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-09-12T00:28:39.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.266+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.266+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-09-12T00:28:39.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.266+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-09-12T00:28:39.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.266+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.266+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-09-12T00:28:39.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.266+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-09-12T00:28:39.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.266+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.266+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-09-12T00:28:39.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.266+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-09-12T00:28:39.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.266+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.267+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-09-12T00:28:39.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.267+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-09-12T00:28:39.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.267+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.267+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-09-12T00:28:39.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.267+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-09-12T00:28:39.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.267+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.267+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-09-12T00:28:39.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.267+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-09-12T00:28:39.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.267+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.267+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-09-12T00:28:39.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.267+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-09-12T00:28:39.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.267+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.268+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-09-12T00:28:39.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.268+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-09-12T00:28:39.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.268+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.268+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-09-12T00:28:39.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.268+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-09-12T00:28:39.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.268+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.268+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-09-12T00:28:39.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.268+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-09-12T00:28:39.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.268+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.268+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-09-12T00:28:39.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.268+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-09-12T00:28:39.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.268+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.268+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-09-12T00:28:39.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.268+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-09-12T00:28:39.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.268+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.269+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-09-12T00:28:39.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.269+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-09-12T00:28:39.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.269+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.269+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-09-12T00:28:39.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.269+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-09-12T00:28:39.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.269+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.269+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-09-12T00:28:39.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.269+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-09-12T00:28:39.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.269+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.269+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-09-12T00:28:39.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.269+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-09-12T00:28:39.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.269+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.269+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-09-12T00:28:39.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.269+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-09-12T00:28:39.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.269+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.270+0000 7fdde5c11800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-09-12T00:28:39.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.270+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-09-12T00:28:39.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.271+0000 7fdde5c11800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:28:39.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.275+0000 7fdc93fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:39.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.276+0000 7fdde5c11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:28:39.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:39.276+0000 7fdde5c11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:28:42.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.219+0000 7fdde5c11800 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-09-12T00:28:42.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.219+0000 7fdde5c11800 5 note: GC not initialized 2024-09-12T00:28:42.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.219+0000 7fdc92fe5640 20 reqs_thread_entry: start 2024-09-12T00:28:42.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.219+0000 7fdde5c11800 20 init_complete bucket index max shards: 1 2024-09-12T00:28:42.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.220+0000 7fdde5c11800 20 Filter name: none 2024-09-12T00:28:42.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.220+0000 7fdc90fe1640 20 reqs_thread_entry: start 2024-09-12T00:28:42.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.243+0000 7fdc93fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:42.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.246+0000 7fdde5c11800 20 remove_watcher() i=0 2024-09-12T00:28:42.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.246+0000 7fdde5c11800 2 removed watcher, disabling cache 2024-09-12T00:28:42.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.248+0000 7fdde5c11800 20 remove_watcher() i=1 2024-09-12T00:28:42.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.251+0000 7fdde5c11800 20 remove_watcher() i=2 2024-09-12T00:28:42.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.255+0000 7fdde5c11800 20 remove_watcher() i=3 2024-09-12T00:28:42.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.256+0000 7fdde5c11800 20 remove_watcher() i=4 2024-09-12T00:28:42.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.260+0000 7fdde5c11800 20 remove_watcher() i=5 2024-09-12T00:28:42.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.261+0000 7fdde5c11800 20 remove_watcher() i=6 2024-09-12T00:28:42.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.263+0000 7fdde5c11800 20 remove_watcher() i=7 2024-09-12T00:28:42.518 INFO:teuthology.orchestra.run.smithi073.stdout:[] 2024-09-12T00:28:42.518 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T00:28:42.519 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-12T00:28:42.519 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-12T00:28:42.519 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-09-12T00:28:42.584 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:28:42.584 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:28:42.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.611+0000 7ff6eae0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:28:42.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.611+0000 7ff6eae0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:28:42.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.615+0000 7ff53effd640 20 reqs_thread_entry: start 2024-09-12T00:28:42.630 INFO:teuthology.orchestra.run.smithi073.stdout:{"id":"f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-12T00:28:42.630 DEBUG:tasks.util.rgw: json result: {'id': 'f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-12T00:28:42.630 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T00:28:42.630 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T00:28:42.630 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T00:28:42.687 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:28:42.687 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:28:42.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.721+0000 7fef3e814800 20 rados->read ofs=0 len=0 2024-09-12T00:28:42.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.723+0000 7fef3e814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:42.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.723+0000 7fef3e814800 20 realm 2024-09-12T00:28:42.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.723+0000 7fef3e814800 20 rados->read ofs=0 len=0 2024-09-12T00:28:42.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.723+0000 7fef3e814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:42.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.723+0000 7fef3e814800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:28:42.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.723+0000 7fef3e814800 20 rados->read ofs=0 len=0 2024-09-12T00:28:42.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.724+0000 7fef3e814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:42.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.724+0000 7fef3e814800 20 rados->read ofs=0 len=0 2024-09-12T00:28:42.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.725+0000 7fef3e814800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:42.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.725+0000 7fef3e814800 20 rados->read ofs=0 len=0 2024-09-12T00:28:42.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.726+0000 7fef3e814800 20 rados_obj.operate() r=0 bl.length=1009 2024-09-12T00:28:42.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.726+0000 7fef3e814800 20 searching for the correct realm 2024-09-12T00:28:42.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.728+0000 7fef3a7e1640 0 -- 172.21.15.73:0/3047187287 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fef3006bde0 msgr2=0x7fef3008da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:42.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.934+0000 7fef3a7e1640 0 -- 172.21.15.73:0/3047187287 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fef3006bde0 msgr2=0x7fef3008da50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:42.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.939+0000 7fef3e814800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:28:42.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.939+0000 7fef3e814800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:28:42.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.939+0000 7fef3e814800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:28:42.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.939+0000 7fef3e814800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:28:42.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.939+0000 7fef3e814800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:28:42.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.939+0000 7fef3e814800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:28:42.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.939+0000 7fef3e814800 20 rados->read ofs=0 len=0 2024-09-12T00:28:42.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.939+0000 7fef3e814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:42.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.939+0000 7fef3e814800 20 rados->read ofs=0 len=0 2024-09-12T00:28:42.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.939+0000 7fef3e814800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:42.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.939+0000 7fef3e814800 20 rados->read ofs=0 len=0 2024-09-12T00:28:42.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.940+0000 7fef3e814800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:28:42.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.940+0000 7fef3e814800 20 zone default found 2024-09-12T00:28:42.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.940+0000 7fef3e814800 4 Realm: () 2024-09-12T00:28:42.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.940+0000 7fef3e814800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:28:42.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.940+0000 7fef3e814800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:28:42.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.940+0000 7fef3e814800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:28:42.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.940+0000 7fef3e814800 20 zonegroup default 2024-09-12T00:28:42.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.940+0000 7fef3e814800 20 rados->read ofs=0 len=0 2024-09-12T00:28:42.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.940+0000 7fef3e814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:42.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.940+0000 7fef3e814800 20 rados->read ofs=0 len=0 2024-09-12T00:28:42.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.940+0000 7fef3e814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:42.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.940+0000 7fef3e814800 20 rados->read ofs=0 len=0 2024-09-12T00:28:42.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.941+0000 7fef3e814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:42.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.941+0000 7fef3e814800 20 started sync module instance, tier type = 2024-09-12T00:28:42.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.941+0000 7fef3e814800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:28:42.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.960+0000 7fef3e814800 20 add_watcher() i=0 2024-09-12T00:28:42.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.960+0000 7fef3e814800 20 add_watcher() i=1 2024-09-12T00:28:42.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.960+0000 7fef3e814800 20 add_watcher() i=2 2024-09-12T00:28:42.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.960+0000 7fef3e814800 20 add_watcher() i=3 2024-09-12T00:28:42.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.960+0000 7fef3e814800 20 add_watcher() i=4 2024-09-12T00:28:42.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.960+0000 7fef3e814800 20 add_watcher() i=5 2024-09-12T00:28:42.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.960+0000 7fef3e814800 20 add_watcher() i=6 2024-09-12T00:28:42.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.962+0000 7fef3e814800 20 add_watcher() i=7 2024-09-12T00:28:42.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.962+0000 7fef3e814800 2 all 8 watchers are set, enabling cache 2024-09-12T00:28:42.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.965+0000 7fedeb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:42.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.965+0000 7fef3e814800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:28:42.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.965+0000 7fef3e814800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:28:42.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.965+0000 7fef3e814800 5 note: GC not initialized 2024-09-12T00:28:42.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.966+0000 7fedea7fc640 20 reqs_thread_entry: start 2024-09-12T00:28:42.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.966+0000 7fef3e814800 20 init_complete bucket index max shards: 1 2024-09-12T00:28:42.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.966+0000 7fef3e814800 20 Filter name: none 2024-09-12T00:28:42.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.966+0000 7fed5bfff640 20 reqs_thread_entry: start 2024-09-12T00:28:42.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.976+0000 7fedeb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:42.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.978+0000 7fef3e814800 20 remove_watcher() i=0 2024-09-12T00:28:42.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.978+0000 7fef3e814800 2 removed watcher, disabling cache 2024-09-12T00:28:42.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.980+0000 7fef3e814800 20 remove_watcher() i=1 2024-09-12T00:28:42.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.980+0000 7fef3e814800 20 remove_watcher() i=2 2024-09-12T00:28:42.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.982+0000 7fef3e814800 20 remove_watcher() i=3 2024-09-12T00:28:42.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.983+0000 7fef3e814800 20 remove_watcher() i=4 2024-09-12T00:28:42.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.984+0000 7fef3e814800 20 remove_watcher() i=5 2024-09-12T00:28:42.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.986+0000 7fef3e814800 20 remove_watcher() i=6 2024-09-12T00:28:42.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:42.987+0000 7fef3e814800 20 remove_watcher() i=7 2024-09-12T00:28:42.995 INFO:teuthology.orchestra.run.smithi073.stdout:[] 2024-09-12T00:28:42.995 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T00:28:42.996 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-12T00:28:42.996 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-12T00:28:42.996 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --placement-inline-data false 2024-09-12T00:28:43.062 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:28:43.063 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:28:43.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:43.088+0000 7f6eb3e15800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:28:43.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:43.088+0000 7f6eb3e15800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:28:43.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:43.092+0000 7f6d2dffb640 20 reqs_thread_entry: start 2024-09-12T00:28:43.106 INFO:teuthology.orchestra.run.smithi073.stdout:{"id":"f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T00:28:43.107 DEBUG:tasks.util.rgw: json result: {'id': 'f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T00:28:43.107 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T00:28:43.107 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T00:28:43.108 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T00:28:43.163 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:28:43.163 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:28:43.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:43.198+0000 7f5231925800 20 rados->read ofs=0 len=0 2024-09-12T00:28:43.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:43.199+0000 7f5231925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:43.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:43.199+0000 7f5231925800 20 realm 2024-09-12T00:28:43.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:43.199+0000 7f5231925800 20 rados->read ofs=0 len=0 2024-09-12T00:28:43.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:43.200+0000 7f5231925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:43.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:43.200+0000 7f5231925800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:28:43.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:43.200+0000 7f5231925800 20 rados->read ofs=0 len=0 2024-09-12T00:28:43.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:43.200+0000 7f5231925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:43.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:43.200+0000 7f5231925800 20 rados->read ofs=0 len=0 2024-09-12T00:28:43.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:43.201+0000 7f5231925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:43.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:43.201+0000 7f5231925800 20 rados->read ofs=0 len=0 2024-09-12T00:28:43.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:43.202+0000 7f5231925800 20 rados_obj.operate() r=0 bl.length=1009 2024-09-12T00:28:43.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:43.202+0000 7f5231925800 20 searching for the correct realm 2024-09-12T00:28:43.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:43.204+0000 7f522dd34640 0 -- 172.21.15.73:0/4238637564 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f5218036070 msgr2=0x7f5218041430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:43.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:43.611+0000 7f522d533640 0 -- 172.21.15.73:0/4238637564 >> [v2:172.21.15.73:6810/1807760270,v1:172.21.15.73:6811/1807760270] conn(0x7f52280b1870 msgr2=0x7f52280d7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:44.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.018+0000 7f5231925800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:28:44.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.018+0000 7f5231925800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:28:44.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.018+0000 7f5231925800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:28:44.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.018+0000 7f5231925800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:28:44.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.018+0000 7f5231925800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:28:44.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.018+0000 7f5231925800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:28:44.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.018+0000 7f5231925800 20 rados->read ofs=0 len=0 2024-09-12T00:28:44.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.018+0000 7f5231925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:44.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.018+0000 7f5231925800 20 rados->read ofs=0 len=0 2024-09-12T00:28:44.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.019+0000 7f5231925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:44.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.019+0000 7f5231925800 20 rados->read ofs=0 len=0 2024-09-12T00:28:44.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.019+0000 7f5231925800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:28:44.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.019+0000 7f5231925800 20 zone default found 2024-09-12T00:28:44.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.019+0000 7f5231925800 4 Realm: () 2024-09-12T00:28:44.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.019+0000 7f5231925800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:28:44.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.019+0000 7f5231925800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:28:44.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.019+0000 7f5231925800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:28:44.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.019+0000 7f5231925800 20 zonegroup default 2024-09-12T00:28:44.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.019+0000 7f5231925800 20 rados->read ofs=0 len=0 2024-09-12T00:28:44.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.019+0000 7f5231925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:44.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.019+0000 7f5231925800 20 rados->read ofs=0 len=0 2024-09-12T00:28:44.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.020+0000 7f5231925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:44.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.020+0000 7f5231925800 20 rados->read ofs=0 len=0 2024-09-12T00:28:44.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.020+0000 7f5231925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:44.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.020+0000 7f5231925800 20 started sync module instance, tier type = 2024-09-12T00:28:44.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.020+0000 7f5231925800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:28:44.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.030+0000 7f5231925800 20 add_watcher() i=0 2024-09-12T00:28:44.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.030+0000 7f5231925800 20 add_watcher() i=1 2024-09-12T00:28:44.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.030+0000 7f5231925800 20 add_watcher() i=2 2024-09-12T00:28:44.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.030+0000 7f5231925800 20 add_watcher() i=3 2024-09-12T00:28:44.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.030+0000 7f5231925800 20 add_watcher() i=4 2024-09-12T00:28:44.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.030+0000 7f5231925800 20 add_watcher() i=5 2024-09-12T00:28:44.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.030+0000 7f5231925800 20 add_watcher() i=6 2024-09-12T00:28:44.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.031+0000 7f5231925800 20 add_watcher() i=7 2024-09-12T00:28:44.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.031+0000 7f5231925800 2 all 8 watchers are set, enabling cache 2024-09-12T00:28:44.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.033+0000 7f50e3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:44.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.033+0000 7f5231925800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:28:44.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.033+0000 7f5231925800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:28:44.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.033+0000 7f5231925800 5 note: GC not initialized 2024-09-12T00:28:44.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.033+0000 7f50e2fe5640 20 reqs_thread_entry: start 2024-09-12T00:28:44.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.033+0000 7f5231925800 20 init_complete bucket index max shards: 1 2024-09-12T00:28:44.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.033+0000 7f5231925800 20 Filter name: none 2024-09-12T00:28:44.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.033+0000 7f50e0fe1640 20 reqs_thread_entry: start 2024-09-12T00:28:44.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.043+0000 7f50e3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:44.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.046+0000 7f5231925800 20 remove_watcher() i=0 2024-09-12T00:28:44.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.046+0000 7f5231925800 2 removed watcher, disabling cache 2024-09-12T00:28:44.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.047+0000 7f5231925800 20 remove_watcher() i=1 2024-09-12T00:28:44.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.048+0000 7f5231925800 20 remove_watcher() i=2 2024-09-12T00:28:44.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.049+0000 7f5231925800 20 remove_watcher() i=3 2024-09-12T00:28:44.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.050+0000 7f5231925800 20 remove_watcher() i=4 2024-09-12T00:28:44.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.051+0000 7f5231925800 20 remove_watcher() i=5 2024-09-12T00:28:44.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.052+0000 7f5231925800 20 remove_watcher() i=6 2024-09-12T00:28:44.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.053+0000 7f5231925800 20 remove_watcher() i=7 2024-09-12T00:28:44.061 INFO:teuthology.orchestra.run.smithi073.stdout:[] 2024-09-12T00:28:44.064 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T00:28:44.064 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-09-12T00:28:44.064 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-12T00:28:44.064 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-12T00:28:44.064 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2024-09-12T00:28:44.126 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:28:44.126 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:28:44.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.153+0000 7effc8942800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:28:44.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.153+0000 7effc8942800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:28:44.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.156+0000 7efe3a7fc640 20 reqs_thread_entry: start 2024-09-12T00:28:44.169 INFO:teuthology.orchestra.run.smithi073.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-09-12T00:28:44.169 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-09-12T00:28:44.170 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-12T00:28:44.170 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-12T00:28:44.170 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-09-12T00:28:44.235 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:28:44.235 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:28:44.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.261+0000 7f6e40940800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:28:44.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.261+0000 7f6e40940800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:28:44.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.265+0000 7f6ca27fc640 20 reqs_thread_entry: start 2024-09-12T00:28:44.278 INFO:teuthology.orchestra.run.smithi073.stdout:{"id":"f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T00:28:44.279 DEBUG:tasks.util.rgw: json result: {'id': 'f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T00:28:44.279 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-09-12T00:28:44.279 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-12T00:28:44.279 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-12T00:28:44.279 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2024-09-12T00:28:44.341 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:28:44.341 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:28:44.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.368+0000 7fdcc7087800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:28:44.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.368+0000 7fdcc7087800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:28:44.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.371+0000 7fdb82ffd640 20 reqs_thread_entry: start 2024-09-12T00:28:44.384 INFO:teuthology.orchestra.run.smithi073.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-09-12T00:28:44.384 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-09-12T00:28:44.384 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-12T00:28:44.384 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-12T00:28:44.385 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-09-12T00:28:44.451 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:28:44.451 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:28:44.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.478+0000 7f36431af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:28:44.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.478+0000 7f36431af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:28:44.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:28:44.481+0000 7f34ff7fe640 20 reqs_thread_entry: start 2024-09-12T00:28:44.696 INFO:teuthology.orchestra.run.smithi073.stdout:{"id":"f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T00:28:44.697 DEBUG:tasks.util.rgw: json result: {'id': 'f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T00:28:44.697 INFO:tasks.rgw:Starting rgw... 2024-09-12T00:28:44.697 INFO:tasks.rgw:rgw client.0 config is {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']} 2024-09-12T00:28:44.697 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-12T00:28:44.697 DEBUG:teuthology.orchestra.run.smithi073:> sudo echo -n https://smithi073.front.sepia.ceph.com:443 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-12T00:28:44.737 INFO:teuthology.orchestra.run.smithi073.stdout:https://smithi073.front.sepia.ceph.com:443 2024-09-12T00:28:44.737 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-12T00:28:44.816 DEBUG:teuthology.orchestra.run.smithi073:> sudo keytool -import -alias smithi073.front.sepia.ceph.com -keystore $(readlink -e $(dirname $(readlink -e $(which keytool)))/../lib/security/cacerts) -file /home/ubuntu/cephtest/ca/rgw.client.0.crt -storepass changeit 2024-09-12T00:28:45.011 INFO:teuthology.orchestra.run.smithi073.stderr:Warning: use -cacerts option to access cacerts keystore 2024-09-12T00:28:45.156 INFO:teuthology.orchestra.run.smithi073.stderr:Certificate was added to keystore 2024-09-12T00:28:45.181 DEBUG:tasks.ceph_manager:running ceph.client.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/ceph.client.0.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--max-threads=1024'] 2024-09-12T00:28:45.181 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-12T00:28:45.182 DEBUG:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends 'beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-12T00:28:45.184 INFO:tasks.rgw.client.0:Started 2024-09-12T00:28:45.184 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on https://smithi073.front.sepia.ceph.com:443/ 2024-09-12T00:28:45.184 DEBUG:teuthology.orchestra.run.smithi073:> curl https://smithi073.front.sepia.ceph.com:443/ 2024-09-12T00:28:45.222 INFO:teuthology.orchestra.run.smithi073.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:28:45.222 INFO:teuthology.orchestra.run.smithi073.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:28:45.222 INFO:teuthology.orchestra.run.smithi073.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T00:28:45.223 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T00:28:45.223 INFO:teuthology.orchestra.run.smithi073.stderr:curl: (7) Failed to connect to smithi073.front.sepia.ceph.com port 443: Connection refused 2024-09-12T00:28:46.224 DEBUG:teuthology.orchestra.run.smithi073:> curl https://smithi073.front.sepia.ceph.com:443/ 2024-09-12T00:28:46.257 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T00:28:46.258 INFO:teuthology.orchestra.run.smithi073.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:28:46.258 INFO:teuthology.orchestra.run.smithi073.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:28:46.258 INFO:teuthology.orchestra.run.smithi073.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T00:28:46.258 INFO:teuthology.orchestra.run.smithi073.stderr:curl: (7) Failed to connect to smithi073.front.sepia.ceph.com port 443: Connection refused 2024-09-12T00:28:48.260 DEBUG:teuthology.orchestra.run.smithi073:> curl https://smithi073.front.sepia.ceph.com:443/ 2024-09-12T00:28:48.292 INFO:teuthology.orchestra.run.smithi073.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:28:48.293 INFO:teuthology.orchestra.run.smithi073.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:28:48.294 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T00:28:48.294 INFO:teuthology.orchestra.run.smithi073.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T00:28:48.294 INFO:teuthology.orchestra.run.smithi073.stderr:curl: (7) Failed to connect to smithi073.front.sepia.ceph.com port 443: Connection refused 2024-09-12T00:28:52.296 DEBUG:teuthology.orchestra.run.smithi073:> curl https://smithi073.front.sepia.ceph.com:443/ 2024-09-12T00:28:52.329 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T00:28:52.329 INFO:teuthology.orchestra.run.smithi073.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:28:52.329 INFO:teuthology.orchestra.run.smithi073.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:28:52.330 INFO:teuthology.orchestra.run.smithi073.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T00:28:52.330 INFO:teuthology.orchestra.run.smithi073.stderr:curl: (7) Failed to connect to smithi073.front.sepia.ceph.com port 443: Connection refused 2024-09-12T00:29:00.331 DEBUG:teuthology.orchestra.run.smithi073:> curl https://smithi073.front.sepia.ceph.com:443/ 2024-09-12T00:29:00.366 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T00:29:00.367 INFO:teuthology.orchestra.run.smithi073.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:29:00.367 INFO:teuthology.orchestra.run.smithi073.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:29:00.367 INFO:teuthology.orchestra.run.smithi073.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T00:29:00.367 INFO:teuthology.orchestra.run.smithi073.stderr:curl: (7) Failed to connect to smithi073.front.sepia.ceph.com port 443: Connection refused 2024-09-12T00:29:07.721 INFO:tasks.rgw.client.0.smithi073.stdout:2024-09-12T00:29:07.718+0000 a1be240 -1 ssl_private_key was not found: rgw/cert//default.key 2024-09-12T00:29:16.369 DEBUG:teuthology.orchestra.run.smithi073:> curl https://smithi073.front.sepia.ceph.com:443/ 2024-09-12T00:29:16.408 INFO:teuthology.orchestra.run.smithi073.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:29:16.408 INFO:teuthology.orchestra.run.smithi073.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:29:17.384 INFO:teuthology.orchestra.run.smithi073.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 191 0 --:--:-- --:--:-- --:--:-- 191 2024-09-12T00:29:17.385 INFO:teuthology.orchestra.run.smithi073.stdout:anonymous 2024-09-12T00:29:17.386 INFO:teuthology.run_tasks:Running task tox... 2024-09-12T00:29:17.397 INFO:tasks.tox:Deploying tox from pip... 2024-09-12T00:29:17.398 DEBUG:teuthology.orchestra.run.smithi073:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2024-09-12T00:29:19.726 DEBUG:teuthology.orchestra.run.smithi073:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2024-09-12T00:29:20.238 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting tox==3.15.0 2024-09-12T00:29:20.288 INFO:teuthology.orchestra.run.smithi073.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2024-09-12T00:29:20.415 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting pluggy<1,>=0.12.0 2024-09-12T00:29:20.435 INFO:teuthology.orchestra.run.smithi073.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2024-09-12T00:29:20.710 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2024-09-12T00:29:20.733 INFO:teuthology.orchestra.run.smithi073.stdout: Downloading virtualenv-20.26.4-py3-none-any.whl (6.0 MB) 2024-09-12T00:29:20.997 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting filelock<4,>=3.0.0 2024-09-12T00:29:21.013 INFO:teuthology.orchestra.run.smithi073.stdout: Downloading filelock-3.16.0-py3-none-any.whl (16 kB) 2024-09-12T00:29:21.081 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting toml>=0.9.4 2024-09-12T00:29:21.095 INFO:teuthology.orchestra.run.smithi073.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-09-12T00:29:21.198 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting packaging>=14 2024-09-12T00:29:21.216 INFO:teuthology.orchestra.run.smithi073.stdout: Downloading packaging-24.1-py3-none-any.whl (53 kB) 2024-09-12T00:29:21.307 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting six<2,>=1.14.0 2024-09-12T00:29:21.321 INFO:teuthology.orchestra.run.smithi073.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:29:21.417 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting py<2,>=1.4.17 2024-09-12T00:29:21.433 INFO:teuthology.orchestra.run.smithi073.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2024-09-12T00:29:21.553 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting distlib<1,>=0.3.7 2024-09-12T00:29:21.569 INFO:teuthology.orchestra.run.smithi073.stdout: Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) 2024-09-12T00:29:21.708 INFO:teuthology.orchestra.run.smithi073.stdout:Collecting platformdirs<5,>=3.9.1 2024-09-12T00:29:21.722 INFO:teuthology.orchestra.run.smithi073.stdout: Downloading platformdirs-4.3.2-py3-none-any.whl (18 kB) 2024-09-12T00:29:21.830 INFO:teuthology.orchestra.run.smithi073.stdout:Installing collected packages: platformdirs, filelock, distlib, virtualenv, toml, six, py, pluggy, packaging, tox 2024-09-12T00:29:22.679 INFO:teuthology.orchestra.run.smithi073.stdout:Successfully installed distlib-0.3.8 filelock-3.16.0 packaging-24.1 platformdirs-4.3.2 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.26.4 2024-09-12T00:29:22.877 INFO:teuthology.orchestra.run.smithi073.stderr:WARNING: You are using pip version 21.3.1; however, version 24.2 is available. 2024-09-12T00:29:22.877 INFO:teuthology.orchestra.run.smithi073.stderr:You should consider upgrading via the '/home/ubuntu/cephtest/tox-venv/bin/python3 -m pip install --upgrade pip' command. 2024-09-12T00:29:22.937 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:29:22.955 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:29:22.956 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:29:22.956 DEBUG:teuthology.orchestra.run.smithi073:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:29:22.984 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:29:22.984 INFO:teuthology.orchestra.run.smithi073.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:29:22.985 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:29:23.053 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:29:23.054 DEBUG:teuthology.orchestra.run.smithi073:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:29:23.123 INFO:tasks.workunit:timeout=3h 2024-09-12T00:29:23.123 INFO:tasks.workunit:cleanup=True 2024-09-12T00:29:23.124 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:29:23.192 INFO:tasks.workunit.client.0.smithi073.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:30:07.403 INFO:tasks.workunit.client.0.smithi073.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:30:07.403 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:30:07.403 INFO:tasks.workunit.client.0.smithi073.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:30:07.403 INFO:tasks.workunit.client.0.smithi073.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:30:07.403 INFO:tasks.workunit.client.0.smithi073.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:30:07.404 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:30:07.404 INFO:tasks.workunit.client.0.smithi073.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:30:07.404 INFO:tasks.workunit.client.0.smithi073.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:30:07.404 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:30:07.404 INFO:tasks.workunit.client.0.smithi073.stderr: git switch -c 2024-09-12T00:30:07.404 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:30:07.404 INFO:tasks.workunit.client.0.smithi073.stderr:Or undo this operation with: 2024-09-12T00:30:07.404 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:30:07.404 INFO:tasks.workunit.client.0.smithi073.stderr: git switch - 2024-09-12T00:30:07.404 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:30:07.404 INFO:tasks.workunit.client.0.smithi073.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:30:07.404 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:30:07.405 INFO:tasks.workunit.client.0.smithi073.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:30:07.408 DEBUG:teuthology.orchestra.run.smithi073:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:30:07.484 INFO:tasks.workunit.client.0.smithi073.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:30:07.486 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:30:07.486 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:30:08.055 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:30:08.131 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:30:08.170 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:30:08.172 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:30:08.172 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:30:08.213 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:30:08.214 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T00:30:08.214 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:30:08.283 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2024-09-12T00:30:08.285 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2024-09-12T00:30:08.285 DEBUG:teuthology.orchestra.run.smithi073:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-12T00:30:08.357 INFO:tasks.workunit.client.0.smithi073.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-12T00:30:08.358 INFO:tasks.workunit.client.0.smithi073.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:30:08.358 INFO:tasks.workunit.client.0.smithi073.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:30:10.627 INFO:tasks.workunit.client.0.smithi073.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T00:30:10.627 INFO:tasks.workunit.client.0.smithi073.stderr:++ deactivate nondestructive 2024-09-12T00:30:10.627 INFO:tasks.workunit.client.0.smithi073.stderr:++ '[' -n '' ']' 2024-09-12T00:30:10.627 INFO:tasks.workunit.client.0.smithi073.stderr:++ '[' -n '' ']' 2024-09-12T00:30:10.627 INFO:tasks.workunit.client.0.smithi073.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:30:10.627 INFO:tasks.workunit.client.0.smithi073.stderr:++ hash -r 2024-09-12T00:30:10.627 INFO:tasks.workunit.client.0.smithi073.stderr:++ '[' -n '' ']' 2024-09-12T00:30:10.627 INFO:tasks.workunit.client.0.smithi073.stderr:++ unset VIRTUAL_ENV 2024-09-12T00:30:10.627 INFO:tasks.workunit.client.0.smithi073.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T00:30:10.627 INFO:tasks.workunit.client.0.smithi073.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:30:10.629 INFO:tasks.workunit.client.0.smithi073.stderr:++ export VIRTUAL_ENV 2024-09-12T00:30:10.629 INFO:tasks.workunit.client.0.smithi073.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T00:30:10.629 INFO:tasks.workunit.client.0.smithi073.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T00:30:10.629 INFO:tasks.workunit.client.0.smithi073.stderr:++ export PATH 2024-09-12T00:30:10.629 INFO:tasks.workunit.client.0.smithi073.stderr:++ '[' -n '' ']' 2024-09-12T00:30:10.629 INFO:tasks.workunit.client.0.smithi073.stderr:++ '[' -z '' ']' 2024-09-12T00:30:10.629 INFO:tasks.workunit.client.0.smithi073.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T00:30:10.629 INFO:tasks.workunit.client.0.smithi073.stderr:++ PS1='(rgw) ' 2024-09-12T00:30:10.629 INFO:tasks.workunit.client.0.smithi073.stderr:++ export PS1 2024-09-12T00:30:10.629 INFO:tasks.workunit.client.0.smithi073.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:30:10.629 INFO:tasks.workunit.client.0.smithi073.stderr:++ hash -r 2024-09-12T00:30:10.630 INFO:tasks.workunit.client.0.smithi073.stderr:+ pip install pip --upgrade 2024-09-12T00:30:10.857 INFO:tasks.workunit.client.0.smithi073.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T00:30:11.035 INFO:tasks.workunit.client.0.smithi073.stdout:Collecting pip 2024-09-12T00:30:11.093 INFO:tasks.workunit.client.0.smithi073.stdout: Downloading pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T00:30:11.245 INFO:tasks.workunit.client.0.smithi073.stdout:Installing collected packages: pip 2024-09-12T00:30:11.245 INFO:tasks.workunit.client.0.smithi073.stdout: Attempting uninstall: pip 2024-09-12T00:30:11.245 INFO:tasks.workunit.client.0.smithi073.stdout: Found existing installation: pip 21.3.1 2024-09-12T00:30:11.397 INFO:tasks.workunit.client.0.smithi073.stdout: Uninstalling pip-21.3.1: 2024-09-12T00:30:11.401 INFO:tasks.workunit.client.0.smithi073.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T00:30:12.129 INFO:tasks.workunit.client.0.smithi073.stdout:Successfully installed pip-24.2 2024-09-12T00:30:12.400 INFO:tasks.workunit.client.0.smithi073.stderr:+ pip install boto3 2024-09-12T00:30:13.256 INFO:tasks.workunit.client.0.smithi073.stdout:Collecting boto3 2024-09-12T00:30:13.299 INFO:tasks.workunit.client.0.smithi073.stdout: Downloading boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T00:30:13.903 INFO:tasks.workunit.client.0.smithi073.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T00:30:13.918 INFO:tasks.workunit.client.0.smithi073.stdout: Downloading botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T00:30:14.027 INFO:tasks.workunit.client.0.smithi073.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T00:30:14.043 INFO:tasks.workunit.client.0.smithi073.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T00:30:14.167 INFO:tasks.workunit.client.0.smithi073.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T00:30:14.182 INFO:tasks.workunit.client.0.smithi073.stdout: Downloading s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T00:30:14.318 INFO:tasks.workunit.client.0.smithi073.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:30:14.333 INFO:tasks.workunit.client.0.smithi073.stdout: Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T00:30:14.488 INFO:tasks.workunit.client.0.smithi073.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:30:14.502 INFO:tasks.workunit.client.0.smithi073.stdout: Downloading urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-12T00:30:14.792 INFO:tasks.workunit.client.0.smithi073.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:30:14.807 INFO:tasks.workunit.client.0.smithi073.stdout: Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T00:30:14.880 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T00:30:14.970 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T00:30:15.216 INFO:tasks.workunit.client.0.smithi073.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12.5/12.5 MB 53.2 MB/s eta 0:00:00 2024-09-12T00:30:15.231 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T00:30:15.294 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T00:30:15.353 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T00:30:15.413 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-12T00:30:15.481 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:30:15.605 INFO:tasks.workunit.client.0.smithi073.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T00:30:16.630 INFO:tasks.workunit.client.0.smithi073.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-12T00:30:16.748 INFO:tasks.workunit.client.0.smithi073.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-09-12T00:30:16.877 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2024-09-12T00:30:16.912 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:16.912 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:16.950 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.951+0000 7fe4cc617800 20 rados->read ofs=0 len=0 2024-09-12T00:30:16.951 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.953+0000 7fe4cc617800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:16.951 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.953+0000 7fe4cc617800 20 realm 2024-09-12T00:30:16.951 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.953+0000 7fe4cc617800 20 rados->read ofs=0 len=0 2024-09-12T00:30:16.952 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.953+0000 7fe4cc617800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:16.952 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.953+0000 7fe4cc617800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:16.952 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.953+0000 7fe4cc617800 20 rados->read ofs=0 len=0 2024-09-12T00:30:16.952 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.953+0000 7fe4cc617800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:16.952 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.953+0000 7fe4cc617800 20 rados->read ofs=0 len=0 2024-09-12T00:30:16.953 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.954+0000 7fe4cc617800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:16.953 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.954+0000 7fe4cc617800 20 rados->read ofs=0 len=0 2024-09-12T00:30:16.954 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.955+0000 7fe4cc617800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:16.954 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.955+0000 7fe4cc617800 20 searching for the correct realm 2024-09-12T00:30:16.956 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.958+0000 7fe4c85e8640 0 -- 172.21.15.73:0/1185178046 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fe4bc02f040 msgr2=0x7fe4bc034a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:16.960 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.962+0000 7fe4c75e6640 0 -- 172.21.15.73:0/1185178046 >> [v2:172.21.15.117:6800/110688882,v1:172.21.15.117:6801/110688882] conn(0x55e3a10a6fc0 msgr2=0x55e3a10a93b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:16.965 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.966+0000 7fe4cc617800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:30:16.966 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.966+0000 7fe4cc617800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:16.966 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.966+0000 7fe4cc617800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:30:16.966 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.966+0000 7fe4cc617800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:16.966 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.966+0000 7fe4cc617800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:16.966 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.966+0000 7fe4cc617800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:16.966 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.966+0000 7fe4cc617800 20 rados->read ofs=0 len=0 2024-09-12T00:30:16.966 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.966+0000 7fe4cc617800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:16.966 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.966+0000 7fe4cc617800 20 rados->read ofs=0 len=0 2024-09-12T00:30:16.966 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.966+0000 7fe4cc617800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:16.966 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.966+0000 7fe4cc617800 20 rados->read ofs=0 len=0 2024-09-12T00:30:16.967 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.967+0000 7fe4cc617800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:16.967 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.967+0000 7fe4cc617800 20 zone default found 2024-09-12T00:30:16.967 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.967+0000 7fe4cc617800 4 Realm: () 2024-09-12T00:30:16.967 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.967+0000 7fe4cc617800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:30:16.967 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.967+0000 7fe4cc617800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:30:16.967 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.967+0000 7fe4cc617800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:16.967 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.967+0000 7fe4cc617800 20 zonegroup default 2024-09-12T00:30:16.967 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.967+0000 7fe4cc617800 20 rados->read ofs=0 len=0 2024-09-12T00:30:16.967 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.967+0000 7fe4cc617800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:16.967 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.967+0000 7fe4cc617800 20 rados->read ofs=0 len=0 2024-09-12T00:30:16.967 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.967+0000 7fe4cc617800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:16.967 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.967+0000 7fe4cc617800 20 rados->read ofs=0 len=0 2024-09-12T00:30:16.968 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.967+0000 7fe4cc617800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:16.968 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.967+0000 7fe4cc617800 20 started sync module instance, tier type = 2024-09-12T00:30:16.968 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.967+0000 7fe4cc617800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:30:16.976 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.978+0000 7fe4cc617800 20 add_watcher() i=0 2024-09-12T00:30:16.976 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.978+0000 7fe4cc617800 20 add_watcher() i=1 2024-09-12T00:30:16.977 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.978+0000 7fe4cc617800 20 add_watcher() i=2 2024-09-12T00:30:16.977 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.978+0000 7fe4cc617800 20 add_watcher() i=3 2024-09-12T00:30:16.977 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.978+0000 7fe4cc617800 20 add_watcher() i=4 2024-09-12T00:30:16.977 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.978+0000 7fe4cc617800 20 add_watcher() i=5 2024-09-12T00:30:16.977 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.978+0000 7fe4cc617800 20 add_watcher() i=6 2024-09-12T00:30:16.977 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.979+0000 7fe4cc617800 20 add_watcher() i=7 2024-09-12T00:30:16.978 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.979+0000 7fe4cc617800 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:16.979 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.981+0000 7fe37dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:16.981 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.981+0000 7fe4cc617800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:16.981 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.981+0000 7fe4cc617800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:16.981 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.981+0000 7fe4cc617800 5 note: GC not initialized 2024-09-12T00:30:16.981 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.981+0000 7fe37cfe1640 20 reqs_thread_entry: start 2024-09-12T00:30:16.981 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.981+0000 7fe4cc617800 20 init_complete bucket index max shards: 1 2024-09-12T00:30:16.981 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.981+0000 7fe4cc617800 20 Filter name: none 2024-09-12T00:30:16.981 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.982+0000 7fe2f67fc640 20 reqs_thread_entry: start 2024-09-12T00:30:16.982 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.982+0000 7fe4cc617800 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2024-09-12T00:30:16.982 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.982+0000 7fe4cc617800 20 rados->read ofs=0 len=0 2024-09-12T00:30:16.982 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.982+0000 7fe4cc617800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:16.982 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.982+0000 7fe4cc617800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2024-09-12T00:30:16.982 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.982+0000 7fe4cc617800 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T00:30:16.982 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.982+0000 7fe4cc617800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2024-09-12T00:30:16.982 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.982+0000 7fe4cc617800 20 rados->read ofs=0 len=0 2024-09-12T00:30:16.982 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.982+0000 7fe4cc617800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:16.982 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.982+0000 7fe4cc617800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2024-09-12T00:30:16.982 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.982+0000 7fe4cc617800 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T00:30:16.982 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.982+0000 7fe4cc617800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-12T00:30:16.983 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.982+0000 7fe4cc617800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-12T00:30:16.983 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.984+0000 7fe4cc617800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-12T00:30:16.983 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.984+0000 7fe4cc617800 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T00:30:16.983 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.984+0000 7fe4cc617800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2024-09-12T00:30:16.983 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.984+0000 7fe3a6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724544 cookie 94436147789792 notifier 4716 bl.length()=593 2024-09-12T00:30:16.984 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.984+0000 7fe3a6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-12T00:30:16.984 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:16.984+0000 7fe3a6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T00:30:17.009 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:17.010+0000 7fe4cc617800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-12T00:30:17.009 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:17.010+0000 7fe4cc617800 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T00:30:17.009 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:17.010+0000 7fe4cc617800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2024-09-12T00:30:17.009 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:17.010+0000 7fe3a6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724544 cookie 94436147760688 notifier 4716 bl.length()=186 2024-09-12T00:30:17.009 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:17.010+0000 7fe3a6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-12T00:30:17.009 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:17.010+0000 7fe3a6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T00:30:17.011 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:17.012+0000 7fe37dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:17.013 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:17.015+0000 7fe4cc617800 20 remove_watcher() i=0 2024-09-12T00:30:17.014 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:17.015+0000 7fe4cc617800 2 removed watcher, disabling cache 2024-09-12T00:30:17.015 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:17.016+0000 7fe4cc617800 20 remove_watcher() i=1 2024-09-12T00:30:17.016 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:17.017+0000 7fe4cc617800 20 remove_watcher() i=2 2024-09-12T00:30:17.017 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:17.019+0000 7fe4cc617800 20 remove_watcher() i=3 2024-09-12T00:30:17.018 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:17.020+0000 7fe4cc617800 20 remove_watcher() i=4 2024-09-12T00:30:17.019 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:17.021+0000 7fe4cc617800 20 remove_watcher() i=5 2024-09-12T00:30:17.020 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:17.022+0000 7fe4cc617800 20 remove_watcher() i=6 2024-09-12T00:30:17.021 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:17.023+0000 7fe4cc617800 20 remove_watcher() i=7 2024-09-12T00:30:17.227 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:17.227 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:17.394 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:17.394 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:17.498 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:17.498 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:17.721 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:17.722 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:18.123 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:18.123 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:18.223 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:18.223 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:18.300 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:18.300 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:18.328 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:18.328 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:18.424 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:18.424 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:18.570 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:18.570 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:18.605 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:18.605 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:18.692 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:18.692 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:18.716 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:18.716 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:18.768 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:18.768 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:18.792 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:18.792 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:18.845 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:18.845 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:18.867 INFO:tasks.workunit.client.0.smithi073.stderr:TEST: recalculated bucket check stats are correct 2024-09-12T00:30:18.868 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:30:18.869 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-12T00:30:18.898 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:18.898 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:18.936 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:18.937+0000 7f9f4c73c800 20 rados->read ofs=0 len=0 2024-09-12T00:30:18.937 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:18.939+0000 7f9f4c73c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:18.937 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:18.939+0000 7f9f4c73c800 20 realm 2024-09-12T00:30:18.937 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:18.939+0000 7f9f4c73c800 20 rados->read ofs=0 len=0 2024-09-12T00:30:18.937 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:18.939+0000 7f9f4c73c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:18.938 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:18.939+0000 7f9f4c73c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:18.938 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:18.939+0000 7f9f4c73c800 20 rados->read ofs=0 len=0 2024-09-12T00:30:18.938 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:18.939+0000 7f9f4c73c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:18.938 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:18.939+0000 7f9f4c73c800 20 rados->read ofs=0 len=0 2024-09-12T00:30:18.938 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:18.940+0000 7f9f4c73c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:18.938 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:18.940+0000 7f9f4c73c800 20 rados->read ofs=0 len=0 2024-09-12T00:30:18.939 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:18.941+0000 7f9f4c73c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:18.939 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:18.941+0000 7f9f4c73c800 20 searching for the correct realm 2024-09-12T00:30:18.940 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:18.942+0000 7f9f3ffff640 0 -- 172.21.15.73:0/4271645871 >> [v2:172.21.15.73:6826/269690776,v1:172.21.15.73:6827/269690776] conn(0x7f9f3805f060 msgr2=0x7f9f3804c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:19.147 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.149+0000 7f9f48481640 0 -- 172.21.15.73:0/4271645871 >> [v2:172.21.15.73:6810/1807760270,v1:172.21.15.73:6811/1807760270] conn(0x560dbfa74310 msgr2=0x7f9f400656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:19.355 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.355+0000 7f9f4c73c800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:30:19.355 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.355+0000 7f9f4c73c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:19.356 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.355+0000 7f9f4c73c800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:30:19.356 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.355+0000 7f9f4c73c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:19.356 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.355+0000 7f9f4c73c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:19.356 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.355+0000 7f9f4c73c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:19.356 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.355+0000 7f9f4c73c800 20 rados->read ofs=0 len=0 2024-09-12T00:30:19.356 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.355+0000 7f9f4c73c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:19.356 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.355+0000 7f9f4c73c800 20 rados->read ofs=0 len=0 2024-09-12T00:30:19.356 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.356+0000 7f9f4c73c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:19.356 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.356+0000 7f9f4c73c800 20 rados->read ofs=0 len=0 2024-09-12T00:30:19.356 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.356+0000 7f9f4c73c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:19.356 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.356+0000 7f9f4c73c800 20 zone default found 2024-09-12T00:30:19.357 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.356+0000 7f9f4c73c800 4 Realm: () 2024-09-12T00:30:19.357 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.356+0000 7f9f4c73c800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:30:19.357 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.356+0000 7f9f4c73c800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:30:19.357 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.356+0000 7f9f4c73c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:19.357 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.356+0000 7f9f4c73c800 20 zonegroup default 2024-09-12T00:30:19.357 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.356+0000 7f9f4c73c800 20 rados->read ofs=0 len=0 2024-09-12T00:30:19.357 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.356+0000 7f9f4c73c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:19.357 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.356+0000 7f9f4c73c800 20 rados->read ofs=0 len=0 2024-09-12T00:30:19.357 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.357+0000 7f9f4c73c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:19.357 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.357+0000 7f9f4c73c800 20 rados->read ofs=0 len=0 2024-09-12T00:30:19.358 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.357+0000 7f9f4c73c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:19.358 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.357+0000 7f9f4c73c800 20 started sync module instance, tier type = 2024-09-12T00:30:19.358 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.357+0000 7f9f4c73c800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:30:19.374 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.376+0000 7f9f4c73c800 20 add_watcher() i=0 2024-09-12T00:30:19.374 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.376+0000 7f9f4c73c800 20 add_watcher() i=1 2024-09-12T00:30:19.374 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.376+0000 7f9f4c73c800 20 add_watcher() i=2 2024-09-12T00:30:19.375 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.376+0000 7f9f4c73c800 20 add_watcher() i=3 2024-09-12T00:30:19.375 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.376+0000 7f9f4c73c800 20 add_watcher() i=4 2024-09-12T00:30:19.375 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.376+0000 7f9f4c73c800 20 add_watcher() i=5 2024-09-12T00:30:19.376 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.378+0000 7f9f4c73c800 20 add_watcher() i=6 2024-09-12T00:30:19.377 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.378+0000 7f9f4c73c800 20 add_watcher() i=7 2024-09-12T00:30:19.377 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.378+0000 7f9f4c73c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:19.381 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.381+0000 7f9dfefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:19.381 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.382+0000 7f9f4c73c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:19.381 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.382+0000 7f9f4c73c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:19.381 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.382+0000 7f9f4c73c800 5 note: GC not initialized 2024-09-12T00:30:19.381 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.382+0000 7f9dfdfdb640 20 reqs_thread_entry: start 2024-09-12T00:30:19.381 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.382+0000 7f9f4c73c800 20 init_complete bucket index max shards: 1 2024-09-12T00:30:19.381 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.382+0000 7f9f4c73c800 20 Filter name: none 2024-09-12T00:30:19.381 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.382+0000 7f9d6f7fe640 20 reqs_thread_entry: start 2024-09-12T00:30:19.381 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.382+0000 7f9f4c73c800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:30:19.381 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.382+0000 7f9f4c73c800 20 rados->read ofs=0 len=0 2024-09-12T00:30:19.382 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.383+0000 7f9f4c73c800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:30:19.383 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.383+0000 7f9f4c73c800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:30:19.383 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.383+0000 7f9f4c73c800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:30:19.383 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.383+0000 7f9f4c73c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1 : miss 2024-09-12T00:30:19.383 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.383+0000 7f9f4c73c800 20 rados->read ofs=0 len=0 2024-09-12T00:30:19.383 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.383+0000 7f9f4c73c800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:30:19.383 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.383+0000 7f9f4c73c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1 info.flags=0x17 2024-09-12T00:30:19.383 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.383+0000 7f9f4c73c800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1 to cache LRU end 2024-09-12T00:30:19.383 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.383+0000 7f9f4c73c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:30:19.383 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.383+0000 7f9f4c73c800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:30:19.383 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.383+0000 7f9f4c73c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1 2024-09-12T00:30:19.383 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.383+0000 7f9f4c73c800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:19.386 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.387+0000 7f9dfefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:19.389 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.390+0000 7f9f4c73c800 20 remove_watcher() i=0 2024-09-12T00:30:19.389 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.390+0000 7f9f4c73c800 2 removed watcher, disabling cache 2024-09-12T00:30:19.390 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.391+0000 7f9f4c73c800 20 remove_watcher() i=1 2024-09-12T00:30:19.393 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.394+0000 7f9f4c73c800 20 remove_watcher() i=2 2024-09-12T00:30:19.394 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.396+0000 7f9f4c73c800 20 remove_watcher() i=3 2024-09-12T00:30:19.395 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.397+0000 7f9f4c73c800 20 remove_watcher() i=4 2024-09-12T00:30:19.396 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.398+0000 7f9f4c73c800 20 remove_watcher() i=5 2024-09-12T00:30:19.399 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.401+0000 7f9f4c73c800 20 remove_watcher() i=6 2024-09-12T00:30:19.400 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.402+0000 7f9f4c73c800 20 remove_watcher() i=7 2024-09-12T00:30:19.412 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-12T00:30:19.441 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:19.441 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:19.478 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.480+0000 7f5cf952f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:19.480 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.481+0000 7f5cf952f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:19.480 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.481+0000 7f5cf952f800 20 realm 2024-09-12T00:30:19.480 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.481+0000 7f5cf952f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:19.480 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.482+0000 7f5cf952f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:19.481 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.482+0000 7f5cf952f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:19.481 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.482+0000 7f5cf952f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:19.481 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.482+0000 7f5cf952f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:19.481 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.482+0000 7f5cf952f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:19.481 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.483+0000 7f5cf952f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:19.481 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.483+0000 7f5cf952f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:19.482 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.483+0000 7f5cf952f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:19.482 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.483+0000 7f5cf952f800 20 searching for the correct realm 2024-09-12T00:30:19.484 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.486+0000 7f5cf5a77640 0 -- 172.21.15.73:0/2525795154 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f5ce00ac220 msgr2=0x7f5ce00aac90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:19.488 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.490+0000 7f5ceca75640 0 -- 172.21.15.73:0/2525795154 >> [v2:172.21.15.117:6800/110688882,v1:172.21.15.117:6801/110688882] conn(0x55a096e62c10 msgr2=0x55a096e65000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:30:19.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.494+0000 7f5cf952f800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:30:19.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.494+0000 7f5cf952f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:19.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.494+0000 7f5cf952f800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:30:19.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.494+0000 7f5cf952f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:19.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.494+0000 7f5cf952f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:19.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.494+0000 7f5cf952f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:19.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.494+0000 7f5cf952f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:19.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.494+0000 7f5cf952f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:19.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.494+0000 7f5cf952f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:19.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.494+0000 7f5cf952f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:19.494 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.494+0000 7f5cf952f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:19.495 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.495+0000 7f5cf952f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:19.495 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.495+0000 7f5cf952f800 20 zone default found 2024-09-12T00:30:19.495 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.495+0000 7f5cf952f800 4 Realm: () 2024-09-12T00:30:19.495 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.495+0000 7f5cf952f800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:30:19.495 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.495+0000 7f5cf952f800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:30:19.495 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.495+0000 7f5cf952f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:19.495 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.495+0000 7f5cf952f800 20 zonegroup default 2024-09-12T00:30:19.496 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.495+0000 7f5cf952f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:19.496 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.495+0000 7f5cf952f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:19.496 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.495+0000 7f5cf952f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:19.496 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.495+0000 7f5cf952f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:19.496 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.495+0000 7f5cf952f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:19.496 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.495+0000 7f5cf952f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:19.496 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.495+0000 7f5cf952f800 20 started sync module instance, tier type = 2024-09-12T00:30:19.496 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.495+0000 7f5cf952f800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:30:19.513 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.514+0000 7f5cf952f800 20 add_watcher() i=0 2024-09-12T00:30:19.513 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.514+0000 7f5cf952f800 20 add_watcher() i=1 2024-09-12T00:30:19.513 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.514+0000 7f5cf952f800 20 add_watcher() i=2 2024-09-12T00:30:19.513 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.514+0000 7f5cf952f800 20 add_watcher() i=3 2024-09-12T00:30:19.513 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.514+0000 7f5cf952f800 20 add_watcher() i=4 2024-09-12T00:30:19.513 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.514+0000 7f5cf952f800 20 add_watcher() i=5 2024-09-12T00:30:19.513 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.514+0000 7f5cf952f800 20 add_watcher() i=6 2024-09-12T00:30:19.514 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.515+0000 7f5cf952f800 20 add_watcher() i=7 2024-09-12T00:30:19.514 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.515+0000 7f5cf952f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:19.515 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.517+0000 7f5babfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:19.515 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.517+0000 7f5cf952f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:19.516 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.517+0000 7f5cf952f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:19.516 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.517+0000 7f5cf952f800 5 note: GC not initialized 2024-09-12T00:30:19.516 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.517+0000 7f5baafe5640 20 reqs_thread_entry: start 2024-09-12T00:30:19.517 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.517+0000 7f5cf952f800 20 init_complete bucket index max shards: 1 2024-09-12T00:30:19.517 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.518+0000 7f5cf952f800 20 Filter name: none 2024-09-12T00:30:19.517 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.518+0000 7f5ba8fe1640 20 reqs_thread_entry: start 2024-09-12T00:30:19.517 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.518+0000 7f5cf952f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:19.517 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.518+0000 7f5cf952f800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:30:19.517 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.518+0000 7f5cf952f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:19.518 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.518+0000 7f5cf952f800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:30:19.518 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.518+0000 7f5cf952f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:30:19.518 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.518+0000 7f5cf952f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:19.518 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.519+0000 7f5cf952f800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:30:19.518 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.519+0000 7f5cf952f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:19.518 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.519+0000 7f5cf952f800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:30:19.518 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.519+0000 7f5cf952f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:30:19.519 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.520+0000 7f5babfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:19.521 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.523+0000 7f5cf952f800 20 remove_watcher() i=0 2024-09-12T00:30:19.521 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.523+0000 7f5cf952f800 2 removed watcher, disabling cache 2024-09-12T00:30:19.523 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.524+0000 7f5cf952f800 20 remove_watcher() i=1 2024-09-12T00:30:19.524 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.525+0000 7f5cf952f800 20 remove_watcher() i=2 2024-09-12T00:30:19.525 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.527+0000 7f5cf952f800 20 remove_watcher() i=3 2024-09-12T00:30:19.526 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.528+0000 7f5cf952f800 20 remove_watcher() i=4 2024-09-12T00:30:19.527 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.529+0000 7f5cf952f800 20 remove_watcher() i=5 2024-09-12T00:30:19.528 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.530+0000 7f5cf952f800 20 remove_watcher() i=6 2024-09-12T00:30:19.529 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.531+0000 7f5cf952f800 20 remove_watcher() i=7 2024-09-12T00:30:19.540 INFO:tasks.workunit.client.0.smithi073.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 87, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2024-09-12T00:30:19.540 INFO:tasks.workunit.client.0.smithi073.stderr:TEST: bucket check unlinked does not report normal entries 2024-09-12T00:30:19.540 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:30:19.541 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T00:30:19.574 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:19.574 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:19.614 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.615+0000 7f0fdf52e800 20 rados->read ofs=0 len=0 2024-09-12T00:30:19.615 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.617+0000 7f0fdf52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:19.615 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.617+0000 7f0fdf52e800 20 realm 2024-09-12T00:30:19.615 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.617+0000 7f0fdf52e800 20 rados->read ofs=0 len=0 2024-09-12T00:30:19.616 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.617+0000 7f0fdf52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:19.616 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.617+0000 7f0fdf52e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:19.616 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.617+0000 7f0fdf52e800 20 rados->read ofs=0 len=0 2024-09-12T00:30:19.616 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.617+0000 7f0fdf52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:19.616 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.617+0000 7f0fdf52e800 20 rados->read ofs=0 len=0 2024-09-12T00:30:19.616 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.618+0000 7f0fdf52e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:19.616 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.618+0000 7f0fdf52e800 20 rados->read ofs=0 len=0 2024-09-12T00:30:19.617 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.619+0000 7f0fdf52e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:19.617 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.619+0000 7f0fdf52e800 20 searching for the correct realm 2024-09-12T00:30:19.619 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.621+0000 7f0fdb96c640 0 -- 172.21.15.73:0/4145887055 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f0fd00709f0 msgr2=0x7f0fd0062410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:19.825 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.827+0000 7f0fdb96c640 0 -- 172.21.15.73:0/4145887055 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f0fd00709f0 msgr2=0x7f0fd0062410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:19.829 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.831+0000 7f0fdf52e800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:30:19.830 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.831+0000 7f0fdf52e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:19.830 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.831+0000 7f0fdf52e800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:30:19.830 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.831+0000 7f0fdf52e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:19.830 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.831+0000 7f0fdf52e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:19.830 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.831+0000 7f0fdf52e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:19.830 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.831+0000 7f0fdf52e800 20 rados->read ofs=0 len=0 2024-09-12T00:30:19.830 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.831+0000 7f0fdf52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:19.830 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.831+0000 7f0fdf52e800 20 rados->read ofs=0 len=0 2024-09-12T00:30:19.831 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.832+0000 7f0fdf52e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:19.832 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.832+0000 7f0fdf52e800 20 rados->read ofs=0 len=0 2024-09-12T00:30:19.832 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.832+0000 7f0fdf52e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:19.832 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.832+0000 7f0fdf52e800 20 zone default found 2024-09-12T00:30:19.832 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.832+0000 7f0fdf52e800 4 Realm: () 2024-09-12T00:30:19.832 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.832+0000 7f0fdf52e800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:30:19.832 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.832+0000 7f0fdf52e800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:30:19.832 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.832+0000 7f0fdf52e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:19.832 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.832+0000 7f0fdf52e800 20 zonegroup default 2024-09-12T00:30:19.832 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.832+0000 7f0fdf52e800 20 rados->read ofs=0 len=0 2024-09-12T00:30:19.832 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.832+0000 7f0fdf52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:19.832 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.832+0000 7f0fdf52e800 20 rados->read ofs=0 len=0 2024-09-12T00:30:19.832 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.833+0000 7f0fdf52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:19.833 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.833+0000 7f0fdf52e800 20 rados->read ofs=0 len=0 2024-09-12T00:30:19.833 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.833+0000 7f0fdf52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:19.833 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.833+0000 7f0fdf52e800 20 started sync module instance, tier type = 2024-09-12T00:30:19.833 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.833+0000 7f0fdf52e800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:30:19.849 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.850+0000 7f0fdf52e800 20 add_watcher() i=0 2024-09-12T00:30:19.849 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.850+0000 7f0fdf52e800 20 add_watcher() i=1 2024-09-12T00:30:19.849 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.850+0000 7f0fdf52e800 20 add_watcher() i=2 2024-09-12T00:30:19.849 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.850+0000 7f0fdf52e800 20 add_watcher() i=3 2024-09-12T00:30:19.849 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.850+0000 7f0fdf52e800 20 add_watcher() i=4 2024-09-12T00:30:19.849 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.850+0000 7f0fdf52e800 20 add_watcher() i=5 2024-09-12T00:30:19.849 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.850+0000 7f0fdf52e800 20 add_watcher() i=6 2024-09-12T00:30:19.850 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.851+0000 7f0fdf52e800 20 add_watcher() i=7 2024-09-12T00:30:19.850 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.851+0000 7f0fdf52e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:19.851 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.853+0000 7f0e91fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:19.853 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.854+0000 7f0fdf52e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:19.854 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.854+0000 7f0fdf52e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:19.854 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.854+0000 7f0fdf52e800 5 note: GC not initialized 2024-09-12T00:30:19.854 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.854+0000 7f0e90fe1640 20 reqs_thread_entry: start 2024-09-12T00:30:19.854 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.854+0000 7f0fdf52e800 20 init_complete bucket index max shards: 1 2024-09-12T00:30:19.854 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.854+0000 7f0fdf52e800 20 Filter name: none 2024-09-12T00:30:19.854 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.854+0000 7f0e0a7fc640 20 reqs_thread_entry: start 2024-09-12T00:30:19.854 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.854+0000 7f0fdf52e800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:30:19.854 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.854+0000 7f0fdf52e800 20 rados->read ofs=0 len=0 2024-09-12T00:30:19.855 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.854+0000 7f0fdf52e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:30:19.855 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.854+0000 7f0fdf52e800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:30:19.855 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.854+0000 7f0fdf52e800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:30:19.855 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.854+0000 7f0fdf52e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1 : miss 2024-09-12T00:30:19.855 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.854+0000 7f0fdf52e800 20 rados->read ofs=0 len=0 2024-09-12T00:30:19.855 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.855+0000 7f0fdf52e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:30:19.855 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.855+0000 7f0fdf52e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1 info.flags=0x17 2024-09-12T00:30:19.855 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.855+0000 7f0fdf52e800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1 to cache LRU end 2024-09-12T00:30:19.855 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.855+0000 7f0fdf52e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:30:19.855 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.855+0000 7f0fdf52e800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:30:19.856 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.855+0000 7f0fdf52e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1 2024-09-12T00:30:19.856 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.855+0000 7f0fdf52e800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:19.856 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.856+0000 7f0fdf52e800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T00:30:19.856 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.856+0000 7f0fdf52e800 1 NOTICE: finished all shards (0 entries found) 2024-09-12T00:30:19.856 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.856+0000 7f0e91fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:19.857 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.859+0000 7f0fdf52e800 20 remove_watcher() i=0 2024-09-12T00:30:19.857 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.859+0000 7f0fdf52e800 2 removed watcher, disabling cache 2024-09-12T00:30:19.858 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.860+0000 7f0fdf52e800 20 remove_watcher() i=1 2024-09-12T00:30:19.859 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.861+0000 7f0fdf52e800 20 remove_watcher() i=2 2024-09-12T00:30:19.860 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.862+0000 7f0fdf52e800 20 remove_watcher() i=3 2024-09-12T00:30:19.861 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.863+0000 7f0fdf52e800 20 remove_watcher() i=4 2024-09-12T00:30:19.862 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.864+0000 7f0fdf52e800 20 remove_watcher() i=5 2024-09-12T00:30:19.863 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.865+0000 7f0fdf52e800 20 remove_watcher() i=6 2024-09-12T00:30:19.864 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:19.866+0000 7f0fdf52e800 20 remove_watcher() i=7 2024-09-12T00:30:19.876 INFO:tasks.workunit.client.0.smithi073.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T00:30:20.279 INFO:tasks.workunit.client.0.smithi073.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T00:30:21.680 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:21.681 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:21.791 INFO:tasks.workunit.client.0.smithi073.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:30:21.792 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T00:30:21.824 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:21.824 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:21.860 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:21.862+0000 7f8474a20800 20 rados->read ofs=0 len=0 2024-09-12T00:30:21.862 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:21.863+0000 7f8474a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:21.862 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:21.863+0000 7f8474a20800 20 realm 2024-09-12T00:30:21.862 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:21.863+0000 7f8474a20800 20 rados->read ofs=0 len=0 2024-09-12T00:30:21.862 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:21.863+0000 7f8474a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:21.862 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:21.864+0000 7f8474a20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:21.862 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:21.864+0000 7f8474a20800 20 rados->read ofs=0 len=0 2024-09-12T00:30:21.863 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:21.864+0000 7f8474a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:21.863 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:21.864+0000 7f8474a20800 20 rados->read ofs=0 len=0 2024-09-12T00:30:21.863 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:21.865+0000 7f8474a20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:21.863 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:21.865+0000 7f8474a20800 20 rados->read ofs=0 len=0 2024-09-12T00:30:22.065 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.066+0000 7f8474a20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:22.065 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.067+0000 7f8474a20800 20 searching for the correct realm 2024-09-12T00:30:22.067 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.069+0000 7f8472d0b640 0 -- 172.21.15.73:0/4118692869 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f845c07b040 msgr2=0x7f845c07a920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:22.275 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.277+0000 7f8472d0b640 0 -- 172.21.15.73:0/4118692869 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f845c07b040 msgr2=0x7f845c07a920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:22.280 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.281+0000 7f8474a20800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:30:22.280 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.281+0000 7f8474a20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:22.280 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.281+0000 7f8474a20800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:30:22.280 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.281+0000 7f8474a20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:22.280 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.281+0000 7f8474a20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:22.280 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.281+0000 7f8474a20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:22.281 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.281+0000 7f8474a20800 20 rados->read ofs=0 len=0 2024-09-12T00:30:22.281 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.281+0000 7f8474a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:22.281 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.281+0000 7f8474a20800 20 rados->read ofs=0 len=0 2024-09-12T00:30:22.281 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.282+0000 7f8474a20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:22.281 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.282+0000 7f8474a20800 20 rados->read ofs=0 len=0 2024-09-12T00:30:22.282 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.282+0000 7f8474a20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:22.282 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.282+0000 7f8474a20800 20 zone default found 2024-09-12T00:30:22.282 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.282+0000 7f8474a20800 4 Realm: () 2024-09-12T00:30:22.282 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.282+0000 7f8474a20800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:30:22.282 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.282+0000 7f8474a20800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:30:22.282 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.282+0000 7f8474a20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:22.282 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.282+0000 7f8474a20800 20 zonegroup default 2024-09-12T00:30:22.283 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.282+0000 7f8474a20800 20 rados->read ofs=0 len=0 2024-09-12T00:30:22.283 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.282+0000 7f8474a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:22.283 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.282+0000 7f8474a20800 20 rados->read ofs=0 len=0 2024-09-12T00:30:22.283 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.283+0000 7f8474a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:22.283 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.283+0000 7f8474a20800 20 rados->read ofs=0 len=0 2024-09-12T00:30:22.283 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.283+0000 7f8474a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:22.283 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.283+0000 7f8474a20800 20 started sync module instance, tier type = 2024-09-12T00:30:22.283 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.283+0000 7f8474a20800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:30:22.293 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.295+0000 7f8474a20800 20 add_watcher() i=0 2024-09-12T00:30:22.294 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.295+0000 7f8474a20800 20 add_watcher() i=1 2024-09-12T00:30:22.294 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.295+0000 7f8474a20800 20 add_watcher() i=2 2024-09-12T00:30:22.294 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.295+0000 7f8474a20800 20 add_watcher() i=3 2024-09-12T00:30:22.294 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.295+0000 7f8474a20800 20 add_watcher() i=4 2024-09-12T00:30:22.294 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.295+0000 7f8474a20800 20 add_watcher() i=5 2024-09-12T00:30:22.294 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.295+0000 7f8474a20800 20 add_watcher() i=6 2024-09-12T00:30:22.294 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.296+0000 7f8474a20800 20 add_watcher() i=7 2024-09-12T00:30:22.294 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.296+0000 7f8474a20800 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:22.297 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.298+0000 7f8328fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:22.297 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.298+0000 7f8474a20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:22.297 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.298+0000 7f8474a20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:22.297 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.298+0000 7f8474a20800 5 note: GC not initialized 2024-09-12T00:30:22.298 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.298+0000 7f82a37fe640 20 reqs_thread_entry: start 2024-09-12T00:30:22.298 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.298+0000 7f8474a20800 20 init_complete bucket index max shards: 1 2024-09-12T00:30:22.298 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.298+0000 7f8474a20800 20 Filter name: none 2024-09-12T00:30:22.298 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.299+0000 7f82a17fa640 20 reqs_thread_entry: start 2024-09-12T00:30:22.298 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.299+0000 7f8474a20800 20 rados->read ofs=0 len=0 2024-09-12T00:30:22.298 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.299+0000 7f8474a20800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:30:22.298 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.299+0000 7f8474a20800 20 rados->read ofs=0 len=0 2024-09-12T00:30:22.299 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.299+0000 7f8474a20800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:30:22.299 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.299+0000 7f8474a20800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:30:22.299 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.299+0000 7f8474a20800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:30:22.299 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.299+0000 7f8474a20800 20 INFO: main: starting shard=0 2024-09-12T00:30:22.299 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.299+0000 7f8474a20800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:22.299 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.300+0000 7f8474a20800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T00:30:22.299 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.300+0000 7f8474a20800 20 INFO: main: done 2024-09-12T00:30:22.300 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.301+0000 7f8328fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:22.302 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.303+0000 7f8474a20800 20 remove_watcher() i=0 2024-09-12T00:30:22.302 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.303+0000 7f8474a20800 2 removed watcher, disabling cache 2024-09-12T00:30:22.303 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.305+0000 7f8474a20800 20 remove_watcher() i=1 2024-09-12T00:30:22.304 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.306+0000 7f8474a20800 20 remove_watcher() i=2 2024-09-12T00:30:22.305 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.307+0000 7f8474a20800 20 remove_watcher() i=3 2024-09-12T00:30:22.307 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.308+0000 7f8474a20800 20 remove_watcher() i=4 2024-09-12T00:30:22.308 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.310+0000 7f8474a20800 20 remove_watcher() i=5 2024-09-12T00:30:22.309 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.311+0000 7f8474a20800 20 remove_watcher() i=6 2024-09-12T00:30:22.310 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.312+0000 7f8474a20800 20 remove_watcher() i=7 2024-09-12T00:30:22.323 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:22.323 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:22.349 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:22.349 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:22.374 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:22.374 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:22.460 INFO:tasks.workunit.client.0.smithi073.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:30:22.461 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T00:30:22.492 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:22.492 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:22.529 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.531+0000 7fdee24bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:22.531 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.532+0000 7fdee24bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:22.531 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.532+0000 7fdee24bb800 20 realm 2024-09-12T00:30:22.531 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.532+0000 7fdee24bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:22.531 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.532+0000 7fdee24bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:22.531 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.532+0000 7fdee24bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:22.531 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.532+0000 7fdee24bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:22.531 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.533+0000 7fdee24bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:22.531 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.533+0000 7fdee24bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:22.532 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.534+0000 7fdee24bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:22.532 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.534+0000 7fdee24bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:22.533 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.535+0000 7fdee24bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:22.533 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.535+0000 7fdee24bb800 20 searching for the correct realm 2024-09-12T00:30:22.536 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.538+0000 7fdee07a6640 0 -- 172.21.15.73:0/2654090514 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fdec803e040 msgr2=0x7fdec8031410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:22.540 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.541+0000 7fded7fff640 0 -- 172.21.15.73:0/2654090514 >> [v2:172.21.15.117:6800/110688882,v1:172.21.15.117:6801/110688882] conn(0x55cd477b3ad0 msgr2=0x55cd477b5ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:22.543 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.545+0000 7fdee24bb800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:30:22.543 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.545+0000 7fdee24bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:22.543 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.545+0000 7fdee24bb800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:30:22.544 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.545+0000 7fdee24bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:22.544 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.545+0000 7fdee24bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:22.544 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.545+0000 7fdee24bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:22.544 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.545+0000 7fdee24bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:22.544 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.545+0000 7fdee24bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:22.544 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.545+0000 7fdee24bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:22.544 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.545+0000 7fdee24bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:22.544 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.545+0000 7fdee24bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:22.545 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.545+0000 7fdee24bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:22.545 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.545+0000 7fdee24bb800 20 zone default found 2024-09-12T00:30:22.545 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.545+0000 7fdee24bb800 4 Realm: () 2024-09-12T00:30:22.545 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.545+0000 7fdee24bb800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:30:22.546 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.545+0000 7fdee24bb800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:30:22.546 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.545+0000 7fdee24bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:22.546 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.545+0000 7fdee24bb800 20 zonegroup default 2024-09-12T00:30:22.546 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.545+0000 7fdee24bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:22.546 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.546+0000 7fdee24bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:22.546 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.546+0000 7fdee24bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:22.546 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.546+0000 7fdee24bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:22.546 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.546+0000 7fdee24bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:22.546 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.546+0000 7fdee24bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:22.546 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.546+0000 7fdee24bb800 20 started sync module instance, tier type = 2024-09-12T00:30:22.546 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.546+0000 7fdee24bb800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:30:22.558 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.560+0000 7fdee24bb800 20 add_watcher() i=0 2024-09-12T00:30:22.558 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.560+0000 7fdee24bb800 20 add_watcher() i=1 2024-09-12T00:30:22.558 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.560+0000 7fdee24bb800 20 add_watcher() i=2 2024-09-12T00:30:22.558 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.560+0000 7fdee24bb800 20 add_watcher() i=3 2024-09-12T00:30:22.558 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.560+0000 7fdee24bb800 20 add_watcher() i=4 2024-09-12T00:30:22.558 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.560+0000 7fdee24bb800 20 add_watcher() i=5 2024-09-12T00:30:22.559 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.560+0000 7fdee24bb800 20 add_watcher() i=6 2024-09-12T00:30:22.561 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.562+0000 7fdee24bb800 20 add_watcher() i=7 2024-09-12T00:30:22.561 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.562+0000 7fdee24bb800 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:22.563 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.564+0000 7fdd95fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:22.564 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.565+0000 7fdee24bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:22.564 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.565+0000 7fdee24bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:22.564 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.565+0000 7fdee24bb800 5 note: GC not initialized 2024-09-12T00:30:22.564 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.565+0000 7fdd94fe1640 20 reqs_thread_entry: start 2024-09-12T00:30:22.564 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.565+0000 7fdee24bb800 20 init_complete bucket index max shards: 1 2024-09-12T00:30:22.564 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.565+0000 7fdee24bb800 20 Filter name: none 2024-09-12T00:30:22.564 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.565+0000 7fdd0e7fc640 20 reqs_thread_entry: start 2024-09-12T00:30:22.564 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.565+0000 7fdee24bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:22.565 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.566+0000 7fdee24bb800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:30:22.565 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.566+0000 7fdee24bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:22.565 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.566+0000 7fdee24bb800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:30:22.565 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.566+0000 7fdee24bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:30:22.565 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.566+0000 7fdee24bb800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:30:22.566 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.566+0000 7fdee24bb800 20 INFO: main: starting shard=0 2024-09-12T00:30:22.566 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.566+0000 7fdee24bb800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:22.566 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.567+0000 7fdee24bb800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T00:30:22.566 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.567+0000 7fdee24bb800 20 INFO: main: done 2024-09-12T00:30:22.566 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.568+0000 7fdd95fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:22.569 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.570+0000 7fdee24bb800 20 remove_watcher() i=0 2024-09-12T00:30:22.569 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.570+0000 7fdee24bb800 2 removed watcher, disabling cache 2024-09-12T00:30:22.570 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.572+0000 7fdee24bb800 20 remove_watcher() i=1 2024-09-12T00:30:22.571 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.573+0000 7fdee24bb800 20 remove_watcher() i=2 2024-09-12T00:30:22.572 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.574+0000 7fdee24bb800 20 remove_watcher() i=3 2024-09-12T00:30:22.573 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.575+0000 7fdee24bb800 20 remove_watcher() i=4 2024-09-12T00:30:22.574 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.576+0000 7fdee24bb800 20 remove_watcher() i=5 2024-09-12T00:30:22.575 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.577+0000 7fdee24bb800 20 remove_watcher() i=6 2024-09-12T00:30:22.576 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.578+0000 7fdee24bb800 20 remove_watcher() i=7 2024-09-12T00:30:22.588 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:22.589 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:22.612 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:22.612 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:22.636 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:22.636 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:22.721 INFO:tasks.workunit.client.0.smithi073.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:30:22.722 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-12T00:30:22.752 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:22.752 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:22.976 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.977+0000 7f0827287640 0 --2- 172.21.15.73:0/1804927083 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b5ddfb7e90 0x55b5ddfdc420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T00:30:22.991 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.993+0000 7f082ad42800 20 rados->read ofs=0 len=0 2024-09-12T00:30:22.993 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.995+0000 7f082ad42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:22.993 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.995+0000 7f082ad42800 20 realm 2024-09-12T00:30:22.993 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.995+0000 7f082ad42800 20 rados->read ofs=0 len=0 2024-09-12T00:30:22.994 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.995+0000 7f082ad42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:22.994 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.995+0000 7f082ad42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:22.994 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.995+0000 7f082ad42800 20 rados->read ofs=0 len=0 2024-09-12T00:30:22.994 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.995+0000 7f082ad42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:22.994 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.995+0000 7f082ad42800 20 rados->read ofs=0 len=0 2024-09-12T00:30:22.994 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.996+0000 7f082ad42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:22.994 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.996+0000 7f082ad42800 20 rados->read ofs=0 len=0 2024-09-12T00:30:22.995 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.997+0000 7f082ad42800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:22.995 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.997+0000 7f082ad42800 20 searching for the correct realm 2024-09-12T00:30:22.997 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:22.998+0000 7f081ffff640 0 -- 172.21.15.73:0/1651223600 >> [v2:172.21.15.73:6826/269690776,v1:172.21.15.73:6827/269690776] conn(0x7f08180e9040 msgr2=0x7f081808ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:23.201 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.203+0000 7f0826a86640 0 -- 172.21.15.73:0/1651223600 >> [v2:172.21.15.117:6816/1460498570,v1:172.21.15.117:6817/1460498570] conn(0x7f082002d070 msgr2=0x7f082002f200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:23.208 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.209+0000 7f082ad42800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:30:23.208 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.209+0000 7f082ad42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:23.208 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.209+0000 7f082ad42800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:30:23.208 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.209+0000 7f082ad42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:23.208 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.209+0000 7f082ad42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:23.208 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.209+0000 7f082ad42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:23.208 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.209+0000 7f082ad42800 20 rados->read ofs=0 len=0 2024-09-12T00:30:23.208 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.209+0000 7f082ad42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:23.208 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.209+0000 7f082ad42800 20 rados->read ofs=0 len=0 2024-09-12T00:30:23.210 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.210+0000 7f082ad42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:23.210 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.210+0000 7f082ad42800 20 rados->read ofs=0 len=0 2024-09-12T00:30:23.210 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.210+0000 7f082ad42800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:23.210 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.210+0000 7f082ad42800 20 zone default found 2024-09-12T00:30:23.210 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.210+0000 7f082ad42800 4 Realm: () 2024-09-12T00:30:23.210 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.210+0000 7f082ad42800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:30:23.210 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.210+0000 7f082ad42800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:30:23.210 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.210+0000 7f082ad42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:23.210 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.210+0000 7f082ad42800 20 zonegroup default 2024-09-12T00:30:23.210 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.210+0000 7f082ad42800 20 rados->read ofs=0 len=0 2024-09-12T00:30:23.210 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.210+0000 7f082ad42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:23.210 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.210+0000 7f082ad42800 20 rados->read ofs=0 len=0 2024-09-12T00:30:23.211 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.211+0000 7f082ad42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:23.211 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.211+0000 7f082ad42800 20 rados->read ofs=0 len=0 2024-09-12T00:30:23.211 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.211+0000 7f082ad42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:23.211 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.211+0000 7f082ad42800 20 started sync module instance, tier type = 2024-09-12T00:30:23.211 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.211+0000 7f082ad42800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:30:23.228 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.229+0000 7f082ad42800 20 add_watcher() i=0 2024-09-12T00:30:23.228 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.229+0000 7f082ad42800 20 add_watcher() i=1 2024-09-12T00:30:23.228 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.229+0000 7f082ad42800 20 add_watcher() i=2 2024-09-12T00:30:23.228 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.229+0000 7f082ad42800 20 add_watcher() i=3 2024-09-12T00:30:23.228 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.229+0000 7f082ad42800 20 add_watcher() i=4 2024-09-12T00:30:23.228 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.229+0000 7f082ad42800 20 add_watcher() i=5 2024-09-12T00:30:23.228 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.229+0000 7f082ad42800 20 add_watcher() i=6 2024-09-12T00:30:23.229 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.230+0000 7f082ad42800 20 add_watcher() i=7 2024-09-12T00:30:23.229 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.230+0000 7f082ad42800 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:23.230 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.232+0000 7f06dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:23.231 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.233+0000 7f082ad42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:23.231 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.233+0000 7f082ad42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:23.232 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.233+0000 7f082ad42800 5 note: GC not initialized 2024-09-12T00:30:23.232 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.233+0000 7f0657fff640 20 reqs_thread_entry: start 2024-09-12T00:30:23.232 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.233+0000 7f082ad42800 20 init_complete bucket index max shards: 1 2024-09-12T00:30:23.232 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.233+0000 7f082ad42800 20 Filter name: none 2024-09-12T00:30:23.232 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.233+0000 7f0655ffb640 20 reqs_thread_entry: start 2024-09-12T00:30:23.232 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.233+0000 7f082ad42800 20 rados->read ofs=0 len=0 2024-09-12T00:30:23.233 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.233+0000 7f082ad42800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:30:23.233 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.233+0000 7f082ad42800 20 rados->read ofs=0 len=0 2024-09-12T00:30:23.233 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.234+0000 7f082ad42800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:30:23.233 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.234+0000 7f082ad42800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:30:23.233 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.234+0000 7f082ad42800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:30:23.233 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.234+0000 7f082ad42800 20 INFO: main: starting shard=0 2024-09-12T00:30:23.233 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.234+0000 7f082ad42800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:23.233 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.235+0000 7f082ad42800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:30:23.234 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.235+0000 7f082ad42800 20 INFO: main: done 2024-09-12T00:30:23.234 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.235+0000 7f06dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:23.236 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.238+0000 7f082ad42800 20 remove_watcher() i=0 2024-09-12T00:30:23.236 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.238+0000 7f082ad42800 2 removed watcher, disabling cache 2024-09-12T00:30:23.237 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.239+0000 7f082ad42800 20 remove_watcher() i=1 2024-09-12T00:30:23.238 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.240+0000 7f082ad42800 20 remove_watcher() i=2 2024-09-12T00:30:23.239 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.241+0000 7f082ad42800 20 remove_watcher() i=3 2024-09-12T00:30:23.241 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.243+0000 7f082ad42800 20 remove_watcher() i=4 2024-09-12T00:30:23.242 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.244+0000 7f082ad42800 20 remove_watcher() i=5 2024-09-12T00:30:23.245 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.247+0000 7f082ad42800 20 remove_watcher() i=6 2024-09-12T00:30:23.246 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.248+0000 7f082ad42800 20 remove_watcher() i=7 2024-09-12T00:30:23.259 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:23.259 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:23.282 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:23.282 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:23.365 INFO:tasks.workunit.client.0.smithi073.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:30:23.367 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-12T00:30:23.397 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:23.397 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:23.434 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.435+0000 7fe946b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:23.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.437+0000 7fe946b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:23.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.437+0000 7fe946b1f800 20 realm 2024-09-12T00:30:23.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.437+0000 7fe946b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:23.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.437+0000 7fe946b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:23.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.437+0000 7fe946b1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:23.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.437+0000 7fe946b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:23.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.437+0000 7fe946b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:23.437 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.437+0000 7fe946b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:23.437 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.438+0000 7fe946b1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:23.437 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.438+0000 7fe946b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:23.438 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.439+0000 7fe946b1f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:23.438 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.439+0000 7fe946b1f800 20 searching for the correct realm 2024-09-12T00:30:23.440 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.442+0000 7fe9430a3640 0 -- 172.21.15.73:0/1978106078 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fe92c0d33c0 msgr2=0x7fe92c0b0a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:30:23.648 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.649+0000 7fe9430a3640 0 -- 172.21.15.73:0/1978106078 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fe92c0d33c0 msgr2=0x7fe92c0b0a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:23.652 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.653+0000 7fe946b1f800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:30:23.652 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.653+0000 7fe946b1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:23.652 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.653+0000 7fe946b1f800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:30:23.652 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.653+0000 7fe946b1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:23.652 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.653+0000 7fe946b1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:23.652 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.653+0000 7fe946b1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:23.653 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.653+0000 7fe946b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:23.653 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.654+0000 7fe946b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:23.653 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.654+0000 7fe946b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:23.654 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.654+0000 7fe946b1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:23.654 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.654+0000 7fe946b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:23.654 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.654+0000 7fe946b1f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:23.654 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.654+0000 7fe946b1f800 20 zone default found 2024-09-12T00:30:23.654 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.654+0000 7fe946b1f800 4 Realm: () 2024-09-12T00:30:23.654 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.654+0000 7fe946b1f800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:30:23.654 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.654+0000 7fe946b1f800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:30:23.654 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.654+0000 7fe946b1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:23.654 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.654+0000 7fe946b1f800 20 zonegroup default 2024-09-12T00:30:23.655 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.654+0000 7fe946b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:23.655 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.654+0000 7fe946b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:23.655 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.654+0000 7fe946b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:23.655 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.655+0000 7fe946b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:23.655 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.655+0000 7fe946b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:23.655 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.655+0000 7fe946b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:23.655 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.655+0000 7fe946b1f800 20 started sync module instance, tier type = 2024-09-12T00:30:23.655 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.655+0000 7fe946b1f800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:30:23.668 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.669+0000 7fe946b1f800 20 add_watcher() i=0 2024-09-12T00:30:23.668 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.669+0000 7fe946b1f800 20 add_watcher() i=1 2024-09-12T00:30:23.668 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.669+0000 7fe946b1f800 20 add_watcher() i=2 2024-09-12T00:30:23.668 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.669+0000 7fe946b1f800 20 add_watcher() i=3 2024-09-12T00:30:23.668 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.669+0000 7fe946b1f800 20 add_watcher() i=4 2024-09-12T00:30:23.668 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.669+0000 7fe946b1f800 20 add_watcher() i=5 2024-09-12T00:30:23.670 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.672+0000 7fe946b1f800 20 add_watcher() i=6 2024-09-12T00:30:23.670 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.672+0000 7fe946b1f800 20 add_watcher() i=7 2024-09-12T00:30:23.671 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.672+0000 7fe946b1f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:23.673 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.675+0000 7fe7f97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:23.674 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.675+0000 7fe946b1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:23.674 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.675+0000 7fe946b1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:23.674 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.675+0000 7fe946b1f800 5 note: GC not initialized 2024-09-12T00:30:23.674 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.675+0000 7fe773fff640 20 reqs_thread_entry: start 2024-09-12T00:30:23.674 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.675+0000 7fe946b1f800 20 init_complete bucket index max shards: 1 2024-09-12T00:30:23.674 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.676+0000 7fe946b1f800 20 Filter name: none 2024-09-12T00:30:23.675 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.676+0000 7fe771ffb640 20 reqs_thread_entry: start 2024-09-12T00:30:23.675 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.676+0000 7fe946b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:23.676 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.676+0000 7fe946b1f800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:30:23.676 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.676+0000 7fe946b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:23.676 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.676+0000 7fe946b1f800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:30:23.676 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.676+0000 7fe946b1f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:30:23.676 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.676+0000 7fe946b1f800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:30:23.676 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.676+0000 7fe946b1f800 20 INFO: main: starting shard=0 2024-09-12T00:30:23.676 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.676+0000 7fe946b1f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:23.677 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.677+0000 7fe946b1f800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:30:23.677 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.677+0000 7fe946b1f800 20 INFO: main: done 2024-09-12T00:30:23.677 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.678+0000 7fe7f97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:23.679 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.680+0000 7fe946b1f800 20 remove_watcher() i=0 2024-09-12T00:30:23.679 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.680+0000 7fe946b1f800 2 removed watcher, disabling cache 2024-09-12T00:30:23.680 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.682+0000 7fe946b1f800 20 remove_watcher() i=1 2024-09-12T00:30:23.681 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.683+0000 7fe946b1f800 20 remove_watcher() i=2 2024-09-12T00:30:23.682 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.684+0000 7fe946b1f800 20 remove_watcher() i=3 2024-09-12T00:30:23.683 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.685+0000 7fe946b1f800 20 remove_watcher() i=4 2024-09-12T00:30:23.684 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.686+0000 7fe946b1f800 20 remove_watcher() i=5 2024-09-12T00:30:23.685 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.687+0000 7fe946b1f800 20 remove_watcher() i=6 2024-09-12T00:30:23.686 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:23.688+0000 7fe946b1f800 20 remove_watcher() i=7 2024-09-12T00:30:23.699 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:23.699 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:23.722 INFO:tasks.workunit.client.0.smithi073.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T00:30:24.115 INFO:tasks.workunit.client.0.smithi073.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T00:30:24.507 INFO:tasks.workunit.client.0.smithi073.stderr:TEST: bucket check unlinked finds unlistable entries 2024-09-12T00:30:24.507 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:30:24.508 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T00:30:24.541 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:24.541 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:24.578 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.580+0000 7f7a7dbaf800 20 rados->read ofs=0 len=0 2024-09-12T00:30:24.580 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.581+0000 7f7a7dbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:24.580 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.581+0000 7f7a7dbaf800 20 realm 2024-09-12T00:30:24.580 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.581+0000 7f7a7dbaf800 20 rados->read ofs=0 len=0 2024-09-12T00:30:24.580 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.581+0000 7f7a7dbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:24.580 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.581+0000 7f7a7dbaf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:24.580 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.581+0000 7f7a7dbaf800 20 rados->read ofs=0 len=0 2024-09-12T00:30:24.580 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.581+0000 7f7a7dbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:24.580 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.581+0000 7f7a7dbaf800 20 rados->read ofs=0 len=0 2024-09-12T00:30:24.581 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.582+0000 7f7a7dbaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:24.581 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.582+0000 7f7a7dbaf800 20 rados->read ofs=0 len=0 2024-09-12T00:30:24.581 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.583+0000 7f7a7dbaf800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:24.582 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.583+0000 7f7a7dbaf800 20 searching for the correct realm 2024-09-12T00:30:24.584 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.586+0000 7f7a7bea1640 0 -- 172.21.15.73:0/2821568163 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f7a64063070 msgr2=0x7f7a64064400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:24.790 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.792+0000 7f7a7bea1640 0 -- 172.21.15.73:0/2821568163 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f7a64063070 msgr2=0x7f7a64064400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:24.795 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.796+0000 7f7a7dbaf800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:30:24.795 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.796+0000 7f7a7dbaf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:24.795 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.796+0000 7f7a7dbaf800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:30:24.795 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.796+0000 7f7a7dbaf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:24.795 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.796+0000 7f7a7dbaf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:24.795 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.796+0000 7f7a7dbaf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:24.795 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.796+0000 7f7a7dbaf800 20 rados->read ofs=0 len=0 2024-09-12T00:30:24.795 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.796+0000 7f7a7dbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:24.795 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.796+0000 7f7a7dbaf800 20 rados->read ofs=0 len=0 2024-09-12T00:30:24.797 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.797+0000 7f7a7dbaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:24.797 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.797+0000 7f7a7dbaf800 20 rados->read ofs=0 len=0 2024-09-12T00:30:24.797 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.797+0000 7f7a7dbaf800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:24.797 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.797+0000 7f7a7dbaf800 20 zone default found 2024-09-12T00:30:24.797 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.797+0000 7f7a7dbaf800 4 Realm: () 2024-09-12T00:30:24.797 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.797+0000 7f7a7dbaf800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:30:24.797 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.797+0000 7f7a7dbaf800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:30:24.797 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.797+0000 7f7a7dbaf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:24.797 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.797+0000 7f7a7dbaf800 20 zonegroup default 2024-09-12T00:30:24.797 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.797+0000 7f7a7dbaf800 20 rados->read ofs=0 len=0 2024-09-12T00:30:24.798 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.797+0000 7f7a7dbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:24.798 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.797+0000 7f7a7dbaf800 20 rados->read ofs=0 len=0 2024-09-12T00:30:24.798 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.798+0000 7f7a7dbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:24.798 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.798+0000 7f7a7dbaf800 20 rados->read ofs=0 len=0 2024-09-12T00:30:24.798 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.798+0000 7f7a7dbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:24.798 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.798+0000 7f7a7dbaf800 20 started sync module instance, tier type = 2024-09-12T00:30:24.798 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.798+0000 7f7a7dbaf800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:30:24.809 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.811+0000 7f7a7dbaf800 20 add_watcher() i=0 2024-09-12T00:30:24.809 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.811+0000 7f7a7dbaf800 20 add_watcher() i=1 2024-09-12T00:30:24.809 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.811+0000 7f7a7dbaf800 20 add_watcher() i=2 2024-09-12T00:30:24.809 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.811+0000 7f7a7dbaf800 20 add_watcher() i=3 2024-09-12T00:30:24.810 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.811+0000 7f7a7dbaf800 20 add_watcher() i=4 2024-09-12T00:30:24.810 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.811+0000 7f7a7dbaf800 20 add_watcher() i=5 2024-09-12T00:30:24.810 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.811+0000 7f7a7dbaf800 20 add_watcher() i=6 2024-09-12T00:30:24.812 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.813+0000 7f7a7dbaf800 20 add_watcher() i=7 2024-09-12T00:30:24.812 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.813+0000 7f7a7dbaf800 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:24.813 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.815+0000 7f7931fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:24.815 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.816+0000 7f7a7dbaf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:24.815 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.816+0000 7f7a7dbaf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:24.815 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.816+0000 7f7a7dbaf800 5 note: GC not initialized 2024-09-12T00:30:24.816 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.816+0000 7f7930fe1640 20 reqs_thread_entry: start 2024-09-12T00:30:24.816 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.816+0000 7f7a7dbaf800 20 init_complete bucket index max shards: 1 2024-09-12T00:30:24.816 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.816+0000 7f7a7dbaf800 20 Filter name: none 2024-09-12T00:30:24.816 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.816+0000 7f78aa7fc640 20 reqs_thread_entry: start 2024-09-12T00:30:24.816 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.816+0000 7f7a7dbaf800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:30:24.816 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.816+0000 7f7a7dbaf800 20 rados->read ofs=0 len=0 2024-09-12T00:30:24.816 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.816+0000 7f7a7dbaf800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:30:24.816 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.816+0000 7f7a7dbaf800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:30:24.816 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.816+0000 7f7a7dbaf800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:30:24.816 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.816+0000 7f7a7dbaf800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1 : miss 2024-09-12T00:30:24.816 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.816+0000 7f7a7dbaf800 20 rados->read ofs=0 len=0 2024-09-12T00:30:24.816 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.817+0000 7f7a7dbaf800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:30:24.817 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.817+0000 7f7a7dbaf800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1 info.flags=0x17 2024-09-12T00:30:24.817 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.817+0000 7f7a7dbaf800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1 to cache LRU end 2024-09-12T00:30:24.817 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.817+0000 7f7a7dbaf800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:30:24.817 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.817+0000 7f7a7dbaf800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:30:24.817 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.817+0000 7f7a7dbaf800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1 2024-09-12T00:30:24.817 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.817+0000 7f7a7dbaf800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:24.818 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.819+0000 7f7a7dbaf800 1 NOTICE: finished shard 0 (4 entries found) 2024-09-12T00:30:24.818 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.819+0000 7f7a7dbaf800 1 NOTICE: finished all shards (4 entries found) 2024-09-12T00:30:24.818 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.820+0000 7f7931fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:24.821 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.822+0000 7f7a7dbaf800 20 remove_watcher() i=0 2024-09-12T00:30:24.821 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.822+0000 7f7a7dbaf800 2 removed watcher, disabling cache 2024-09-12T00:30:24.822 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.824+0000 7f7a7dbaf800 20 remove_watcher() i=1 2024-09-12T00:30:24.823 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.824+0000 7f7a7dbaf800 20 remove_watcher() i=2 2024-09-12T00:30:24.824 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.826+0000 7f7a7dbaf800 20 remove_watcher() i=3 2024-09-12T00:30:24.826 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.827+0000 7f7a7dbaf800 20 remove_watcher() i=4 2024-09-12T00:30:24.826 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.828+0000 7f7a7dbaf800 20 remove_watcher() i=5 2024-09-12T00:30:24.827 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.829+0000 7f7a7dbaf800 20 remove_watcher() i=6 2024-09-12T00:30:24.828 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:24.830+0000 7f7a7dbaf800 20 remove_watcher() i=7 2024-09-12T00:30:24.839 INFO:tasks.workunit.client.0.smithi073.stderr:TEST: unlinked entries are not listable 2024-09-12T00:30:24.839 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:30:24.841 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:24.841 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:24.948 INFO:tasks.workunit.client.0.smithi073.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2024-09-12T00:30:24.948 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:30:24.951 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:24.951 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:25.021 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:25.022 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:25.082 INFO:tasks.workunit.client.0.smithi073.stderr:TEST: bucket check unlinked fixes unlistable entries 2024-09-12T00:30:25.082 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:30:25.083 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T00:30:25.116 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:25.117 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:25.157 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.159+0000 7f03f3519800 20 rados->read ofs=0 len=0 2024-09-12T00:30:25.159 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.160+0000 7f03f3519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:25.159 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.160+0000 7f03f3519800 20 realm 2024-09-12T00:30:25.159 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.160+0000 7f03f3519800 20 rados->read ofs=0 len=0 2024-09-12T00:30:25.159 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.160+0000 7f03f3519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:25.159 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.160+0000 7f03f3519800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:25.159 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.160+0000 7f03f3519800 20 rados->read ofs=0 len=0 2024-09-12T00:30:25.160 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.160+0000 7f03f3519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:25.160 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.160+0000 7f03f3519800 20 rados->read ofs=0 len=0 2024-09-12T00:30:25.160 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.161+0000 7f03f3519800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:25.161 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.161+0000 7f03f3519800 20 rados->read ofs=0 len=0 2024-09-12T00:30:25.161 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.162+0000 7f03f3519800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:25.161 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.162+0000 7f03f3519800 20 searching for the correct realm 2024-09-12T00:30:25.162 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.163+0000 7f03f100a640 0 -- 172.21.15.73:0/2009692632 >> [v2:172.21.15.117:6816/1460498570,v1:172.21.15.117:6817/1460498570] conn(0x7f03ec097040 msgr2=0x7f03ec085a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:25.166 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.168+0000 7f03f0809640 0 -- 172.21.15.73:0/2009692632 >> [v2:172.21.15.73:6826/269690776,v1:172.21.15.73:6827/269690776] conn(0x7f03e403f070 msgr2=0x7f03e4023aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:25.173 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.174+0000 7f03f3519800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:30:25.173 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.174+0000 7f03f3519800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:25.173 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.174+0000 7f03f3519800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:30:25.173 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.174+0000 7f03f3519800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:25.173 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.174+0000 7f03f3519800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:25.173 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.174+0000 7f03f3519800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:25.174 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.174+0000 7f03f3519800 20 rados->read ofs=0 len=0 2024-09-12T00:30:25.174 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.174+0000 7f03f3519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:25.174 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.174+0000 7f03f3519800 20 rados->read ofs=0 len=0 2024-09-12T00:30:25.174 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.174+0000 7f03f3519800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:25.174 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.174+0000 7f03f3519800 20 rados->read ofs=0 len=0 2024-09-12T00:30:25.174 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.174+0000 7f03f3519800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:25.174 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.174+0000 7f03f3519800 20 zone default found 2024-09-12T00:30:25.174 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.174+0000 7f03f3519800 4 Realm: () 2024-09-12T00:30:25.174 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.174+0000 7f03f3519800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:30:25.174 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.174+0000 7f03f3519800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:30:25.174 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.174+0000 7f03f3519800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:25.175 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.174+0000 7f03f3519800 20 zonegroup default 2024-09-12T00:30:25.175 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.174+0000 7f03f3519800 20 rados->read ofs=0 len=0 2024-09-12T00:30:25.175 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.175+0000 7f03f3519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:25.175 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.175+0000 7f03f3519800 20 rados->read ofs=0 len=0 2024-09-12T00:30:25.175 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.175+0000 7f03f3519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:25.176 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.175+0000 7f03f3519800 20 rados->read ofs=0 len=0 2024-09-12T00:30:25.176 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.175+0000 7f03f3519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:25.176 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.175+0000 7f03f3519800 20 started sync module instance, tier type = 2024-09-12T00:30:25.176 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.175+0000 7f03f3519800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:30:25.185 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.186+0000 7f03f3519800 20 add_watcher() i=0 2024-09-12T00:30:25.185 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.186+0000 7f03f3519800 20 add_watcher() i=1 2024-09-12T00:30:25.185 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.186+0000 7f03f3519800 20 add_watcher() i=2 2024-09-12T00:30:25.185 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.186+0000 7f03f3519800 20 add_watcher() i=3 2024-09-12T00:30:25.185 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.186+0000 7f03f3519800 20 add_watcher() i=4 2024-09-12T00:30:25.185 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.186+0000 7f03f3519800 20 add_watcher() i=5 2024-09-12T00:30:25.185 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.186+0000 7f03f3519800 20 add_watcher() i=6 2024-09-12T00:30:25.186 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.187+0000 7f03f3519800 20 add_watcher() i=7 2024-09-12T00:30:25.186 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.187+0000 7f03f3519800 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:25.187 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.189+0000 7f02a77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:25.189 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.189+0000 7f03f3519800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:25.189 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.189+0000 7f03f3519800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:25.189 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.189+0000 7f03f3519800 5 note: GC not initialized 2024-09-12T00:30:25.189 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.189+0000 7f02a67e4640 20 reqs_thread_entry: start 2024-09-12T00:30:25.190 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.190+0000 7f03f3519800 20 init_complete bucket index max shards: 1 2024-09-12T00:30:25.190 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.190+0000 7f03f3519800 20 Filter name: none 2024-09-12T00:30:25.190 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.190+0000 7f0217fff640 20 reqs_thread_entry: start 2024-09-12T00:30:25.190 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.190+0000 7f03f3519800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:30:25.190 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.190+0000 7f03f3519800 20 rados->read ofs=0 len=0 2024-09-12T00:30:25.190 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.190+0000 7f03f3519800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:30:25.190 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.190+0000 7f03f3519800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:30:25.190 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.190+0000 7f03f3519800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:30:25.190 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.190+0000 7f03f3519800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1 : miss 2024-09-12T00:30:25.190 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.190+0000 7f03f3519800 20 rados->read ofs=0 len=0 2024-09-12T00:30:25.191 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.190+0000 7f03f3519800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:30:25.191 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.190+0000 7f03f3519800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1 info.flags=0x17 2024-09-12T00:30:25.191 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.190+0000 7f03f3519800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1 to cache LRU end 2024-09-12T00:30:25.191 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.190+0000 7f03f3519800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:30:25.191 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.190+0000 7f03f3519800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:30:25.191 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.190+0000 7f03f3519800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1 2024-09-12T00:30:25.191 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.191+0000 7f03f3519800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:25.192 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.192+0000 7f03f3519800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:25.192 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.192+0000 7f03f3519800 20 get_obj_state: octx=0x5632b8736690 obj=check-bucket:c state=0x5632b8a030e8 s->prefetch_data=0 2024-09-12T00:30:25.192 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.193+0000 7f03f3519800 20 get_obj_state: setting s->obj_tag to lt1lp2accwq0q94fieqdjsi2ug6tt01z 2024-09-12T00:30:25.192 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.193+0000 7f03f3519800 20 get_obj_state_impl: setting s->olh_tag to blne725t6apdkbdmfpr0qrbpl4lvpjy1 2024-09-12T00:30:25.192 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.193+0000 7f03f3519800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=blne725t6apdkbdmfpr0qrbpl4lvpjy1 2024-09-12T00:30:25.192 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.194+0000 7f03f3519800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:25.194 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.195+0000 7f03f3519800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:25.194 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.196+0000 7f03f3519800 20 olh_log_entry: epoch=3 op=3 key=c[vDUf0vGepF4Jv4HUTh8FMPHB2VEpEo7] 2024-09-12T00:30:25.194 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.196+0000 7f03f3519800 20 get_obj_state: octx=0x5632b8736690 obj=check-bucket:_:vDUf0vGepF4Jv4HUTh8FMPHB2VEpEo7_c state=0x5632b8a056b8 s->prefetch_data=0 2024-09-12T00:30:25.195 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.196+0000 7f03f3519800 10 manifest: total_size = 22 2024-09-12T00:30:25.195 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.196+0000 7f03f3519800 20 get_obj_state: setting s->obj_tag to f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13573364395246409650 2024-09-12T00:30:25.195 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.196+0000 7f03f3519800 20 get_obj_state: octx=0x5632b8736690 obj=check-bucket:_:vDUf0vGepF4Jv4HUTh8FMPHB2VEpEo7_c state=0x5632b8a056b8 s->prefetch_data=0 2024-09-12T00:30:25.195 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.196+0000 7f03f3519800 20 prepare_atomic_modification: state is not atomic. state=0x5632b8a056b8 2024-09-12T00:30:25.195 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.196+0000 7f03f3519800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:25.197 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.199+0000 7f03f3519800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:25.198 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.199+0000 7f03f3519800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T00:30:25.198 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.199+0000 7f03f3519800 0 deleting objects inline since gc isn't initialized 2024-09-12T00:30:25.198 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.199+0000 7f03f3519800 5 delete_objs_inline: removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1__shadow:vDUf0vGepF4Jv4HUTh8FMPHB2VEpEo7_.YVFEfY6mcuZY67LiACiztuPLdJFOGQE_0 2024-09-12T00:30:25.199 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.201+0000 7f02d4ff9640 20 handle_completion(): completion ok for obj=c[vDUf0vGepF4Jv4HUTh8FMPHB2VEpEo7] 2024-09-12T00:30:25.199 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.201+0000 7f03f3519800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:30:25.202 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.204+0000 7f03f3519800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:25.203 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.204+0000 7f03f3519800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:25.205 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.206+0000 7f03f3519800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:25.205 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.207+0000 7f03f3519800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:25.205 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.207+0000 7f03f3519800 20 get_obj_state: octx=0x5632b8736690 obj=check-bucket:d state=0x5632b8a030e8 s->prefetch_data=0 2024-09-12T00:30:25.206 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.208+0000 7f03f3519800 20 get_obj_state: setting s->obj_tag to wgurefuotrdv37w10h30ztn33ymskw1l 2024-09-12T00:30:25.206 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.208+0000 7f03f3519800 20 get_obj_state_impl: setting s->olh_tag to nd4cphjyi81kffobzdll62aqvdoad1qi 2024-09-12T00:30:25.206 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.208+0000 7f03f3519800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=nd4cphjyi81kffobzdll62aqvdoad1qi 2024-09-12T00:30:25.207 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.209+0000 7f03f3519800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:25.209 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.210+0000 7f03f3519800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:25.209 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.211+0000 7f03f3519800 20 olh_log_entry: epoch=3 op=3 key=d[waVqbuLZiCsj-1fkSnlIwKPNaYEoEFi] 2024-09-12T00:30:25.209 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.211+0000 7f03f3519800 20 get_obj_state: octx=0x5632b8736690 obj=check-bucket:_:waVqbuLZiCsj-1fkSnlIwKPNaYEoEFi_d state=0x5632b8a05548 s->prefetch_data=0 2024-09-12T00:30:25.209 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.211+0000 7f03f3519800 10 manifest: total_size = 11 2024-09-12T00:30:25.210 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.211+0000 7f03f3519800 20 get_obj_state: setting s->obj_tag to f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17879561548526931969 2024-09-12T00:30:25.210 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.211+0000 7f03f3519800 20 get_obj_state: octx=0x5632b8736690 obj=check-bucket:_:waVqbuLZiCsj-1fkSnlIwKPNaYEoEFi_d state=0x5632b8a05548 s->prefetch_data=0 2024-09-12T00:30:25.210 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.211+0000 7f03f3519800 20 prepare_atomic_modification: state is not atomic. state=0x5632b8a05548 2024-09-12T00:30:25.210 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.211+0000 7f03f3519800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:25.212 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.214+0000 7f03f3519800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:25.213 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.214+0000 7f03f3519800 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-12T00:30:25.213 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.214+0000 7f03f3519800 0 deleting objects inline since gc isn't initialized 2024-09-12T00:30:25.213 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.214+0000 7f03f3519800 5 delete_objs_inline: removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1__shadow:waVqbuLZiCsj-1fkSnlIwKPNaYEoEFi_.5zkQwvaIJoE3XdwvHNsWr7FHcnvmbhX_0 2024-09-12T00:30:25.214 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.215+0000 7f03f3519800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:30:25.216 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.218+0000 7f02c3fff640 20 handle_completion(): completion ok for obj=d[waVqbuLZiCsj-1fkSnlIwKPNaYEoEFi] 2024-09-12T00:30:25.216 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.218+0000 7f03f3519800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:25.217 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.218+0000 7f03f3519800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:25.219 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.220+0000 7f03f3519800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:25.219 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.221+0000 7f03f3519800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:25.219 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.221+0000 7f03f3519800 20 get_obj_state: octx=0x5632b8736690 obj=check-bucket:e state=0x5632b8a030e8 s->prefetch_data=0 2024-09-12T00:30:25.220 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.221+0000 7f03f3519800 20 get_obj_state: setting s->obj_tag to femst4m0z6uyqlmqq0psg396g1q99mnw 2024-09-12T00:30:25.220 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.222+0000 7f03f3519800 20 get_obj_state_impl: setting s->olh_tag to 77yctgpniuk9k110g33763cgz32k9005 2024-09-12T00:30:25.220 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.222+0000 7f03f3519800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=77yctgpniuk9k110g33763cgz32k9005 2024-09-12T00:30:25.222 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.223+0000 7f03f3519800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:25.223 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.225+0000 7f03f3519800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:25.224 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.225+0000 7f03f3519800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-12T00:30:25.224 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.225+0000 7f03f3519800 20 olh_log_entry: epoch=2 op=3 key=e[RXE33fDlc36Exis493A2ou9CilFQ6iW] 2024-09-12T00:30:25.224 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.225+0000 7f03f3519800 20 get_obj_state: octx=0x5632b8736690 obj=check-bucket:_:RXE33fDlc36Exis493A2ou9CilFQ6iW_e state=0x5632b8a05548 s->prefetch_data=0 2024-09-12T00:30:25.224 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.225+0000 7f03f3519800 10 manifest: total_size = 12 2024-09-12T00:30:25.224 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.225+0000 7f03f3519800 20 get_obj_state: setting s->obj_tag to f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13710080845444145218 2024-09-12T00:30:25.224 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.225+0000 7f03f3519800 20 get_obj_state: octx=0x5632b8736690 obj=check-bucket:_:RXE33fDlc36Exis493A2ou9CilFQ6iW_e state=0x5632b8a05548 s->prefetch_data=0 2024-09-12T00:30:25.224 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.225+0000 7f03f3519800 20 prepare_atomic_modification: state is not atomic. state=0x5632b8a05548 2024-09-12T00:30:25.224 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.225+0000 7f03f3519800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:25.226 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.228+0000 7f03f3519800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:25.226 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.228+0000 7f03f3519800 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-12T00:30:25.226 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.228+0000 7f03f3519800 0 deleting objects inline since gc isn't initialized 2024-09-12T00:30:25.226 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.228+0000 7f03f3519800 5 delete_objs_inline: removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1__shadow:RXE33fDlc36Exis493A2ou9CilFQ6iW_.iYj0-E5kFSA5EPOUSgIRNQKb6hosiJ0_0 2024-09-12T00:30:25.227 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.229+0000 7f03f3519800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:30:25.227 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.229+0000 7f02c3fff640 20 handle_completion(): completion ok for obj=e[RXE33fDlc36Exis493A2ou9CilFQ6iW] 2024-09-12T00:30:25.230 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.231+0000 7f03f3519800 20 get_obj_state: octx=0x5632b8736690 obj=check-bucket:e state=0x5632b8a030e8 s->prefetch_data=0 2024-09-12T00:30:25.230 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.231+0000 7f03f3519800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=77yctgpniuk9k110g33763cgz32k9005 2024-09-12T00:30:25.235 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.237+0000 7f03f3519800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:25.237 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.239+0000 7f03f3519800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:25.237 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.239+0000 7f03f3519800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:25.238 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.239+0000 7f03f3519800 20 get_obj_state: octx=0x5632b8736690 obj=check-bucket:f state=0x5632b8a030e8 s->prefetch_data=0 2024-09-12T00:30:25.238 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.240+0000 7f03f3519800 20 get_obj_state: setting s->obj_tag to gsmh8hunfa5ea4im3ddtwl7alwki9y38 2024-09-12T00:30:25.238 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.240+0000 7f03f3519800 20 get_obj_state_impl: setting s->olh_tag to p80m6sjwh5ptcs59iw3cpqbolexu20s0 2024-09-12T00:30:25.238 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.240+0000 7f03f3519800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=p80m6sjwh5ptcs59iw3cpqbolexu20s0 2024-09-12T00:30:25.239 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.241+0000 7f03f3519800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:25.241 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.242+0000 7f03f3519800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:25.241 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.243+0000 7f03f3519800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-12T00:30:25.241 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.243+0000 7f03f3519800 20 olh_log_entry: epoch=2 op=3 key=f[3SlGAiPSfHfgITjlUJAfExWDb5HuUp-] 2024-09-12T00:30:25.241 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.243+0000 7f03f3519800 20 get_obj_state: octx=0x5632b8736690 obj=check-bucket:_:3SlGAiPSfHfgITjlUJAfExWDb5HuUp-_f state=0x5632b89ff428 s->prefetch_data=0 2024-09-12T00:30:25.242 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.243+0000 7f03f3519800 10 manifest: total_size = 12 2024-09-12T00:30:25.242 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.243+0000 7f03f3519800 20 get_obj_state: setting s->obj_tag to f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13365432934457002780 2024-09-12T00:30:25.242 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.243+0000 7f03f3519800 20 get_obj_state: octx=0x5632b8736690 obj=check-bucket:_:3SlGAiPSfHfgITjlUJAfExWDb5HuUp-_f state=0x5632b89ff428 s->prefetch_data=0 2024-09-12T00:30:25.242 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.243+0000 7f03f3519800 20 prepare_atomic_modification: state is not atomic. state=0x5632b89ff428 2024-09-12T00:30:25.242 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.243+0000 7f03f3519800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:25.244 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.246+0000 7f03f3519800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:25.245 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.246+0000 7f03f3519800 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-12T00:30:25.245 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.246+0000 7f03f3519800 0 deleting objects inline since gc isn't initialized 2024-09-12T00:30:25.245 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.246+0000 7f03f3519800 5 delete_objs_inline: removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1__shadow:3SlGAiPSfHfgITjlUJAfExWDb5HuUp-_.QX25pLA4AG1pSlHW1t1NBLQtEJ2xJd3_0 2024-09-12T00:30:25.246 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.248+0000 7f02d4ff9640 20 handle_completion(): completion ok for obj=f[3SlGAiPSfHfgITjlUJAfExWDb5HuUp-] 2024-09-12T00:30:25.247 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.249+0000 7f03f3519800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:30:25.250 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.252+0000 7f03f3519800 20 get_obj_state: octx=0x5632b8736690 obj=check-bucket:f state=0x5632b8a030e8 s->prefetch_data=0 2024-09-12T00:30:25.250 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.252+0000 7f03f3519800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=p80m6sjwh5ptcs59iw3cpqbolexu20s0 2024-09-12T00:30:25.254 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.256+0000 7f03f3519800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:25.256 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.257+0000 7f03f3519800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:25.256 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.257+0000 7f03f3519800 1 NOTICE: finished shard 0 (4 entries removed) 2024-09-12T00:30:25.256 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.257+0000 7f03f3519800 1 NOTICE: finished all shards (4 entries removed) 2024-09-12T00:30:25.256 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.258+0000 7f02a77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:25.259 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.260+0000 7f03f3519800 20 remove_watcher() i=0 2024-09-12T00:30:25.259 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.260+0000 7f03f3519800 2 removed watcher, disabling cache 2024-09-12T00:30:25.260 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.261+0000 7f03f3519800 20 remove_watcher() i=1 2024-09-12T00:30:25.261 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.263+0000 7f03f3519800 20 remove_watcher() i=2 2024-09-12T00:30:25.262 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.264+0000 7f03f3519800 20 remove_watcher() i=3 2024-09-12T00:30:25.263 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.265+0000 7f03f3519800 20 remove_watcher() i=4 2024-09-12T00:30:25.265 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.266+0000 7f03f3519800 20 remove_watcher() i=5 2024-09-12T00:30:25.266 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.268+0000 7f03f3519800 20 remove_watcher() i=6 2024-09-12T00:30:25.267 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.269+0000 7f03f3519800 20 remove_watcher() i=7 2024-09-12T00:30:25.280 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:25.281 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:25.301 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:25.301 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:25.321 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:25.321 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:25.341 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:25.341 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:25.359 INFO:tasks.workunit.client.0.smithi073.stderr:TEST: bucket check unlinked does not affect normal entries 2024-09-12T00:30:25.359 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:30:25.360 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:25.360 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:25.426 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:25.426 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:25.448 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:25.448 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:25.471 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:25.472 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:25.498 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:25.498 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:25.520 INFO:tasks.workunit.client.0.smithi073.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2024-09-12T00:30:25.520 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:30:25.521 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T00:30:25.553 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:25.553 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:25.591 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.591+0000 7fc2daabb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:25.592 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.592+0000 7fc2daabb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:25.592 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.592+0000 7fc2daabb800 20 realm 2024-09-12T00:30:25.592 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.592+0000 7fc2daabb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:25.593 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.593+0000 7fc2daabb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:25.593 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.593+0000 7fc2daabb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:25.593 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.593+0000 7fc2daabb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:25.593 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.593+0000 7fc2daabb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:25.593 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.593+0000 7fc2daabb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:25.593 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.594+0000 7fc2daabb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:25.593 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.594+0000 7fc2daabb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:25.594 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.595+0000 7fc2daabb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:25.594 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.595+0000 7fc2daabb800 20 searching for the correct realm 2024-09-12T00:30:25.596 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.597+0000 7fc2d8da6640 0 -- 172.21.15.73:0/608168519 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fc2c0093ea0 msgr2=0x7fc2c0092910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:25.803 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.804+0000 7fc2d8da6640 0 -- 172.21.15.73:0/608168519 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fc2c0093ea0 msgr2=0x7fc2c0092910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:25.808 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.808+0000 7fc2daabb800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:30:25.808 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.808+0000 7fc2daabb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:25.808 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.808+0000 7fc2daabb800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:30:25.808 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.808+0000 7fc2daabb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:25.808 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.808+0000 7fc2daabb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:25.808 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.808+0000 7fc2daabb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:25.808 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.808+0000 7fc2daabb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:25.809 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.809+0000 7fc2daabb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:25.809 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.809+0000 7fc2daabb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:25.810 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.809+0000 7fc2daabb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:25.810 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.809+0000 7fc2daabb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:25.810 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.809+0000 7fc2daabb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:25.810 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.809+0000 7fc2daabb800 20 zone default found 2024-09-12T00:30:25.810 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.809+0000 7fc2daabb800 4 Realm: () 2024-09-12T00:30:25.810 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.809+0000 7fc2daabb800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:30:25.810 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.809+0000 7fc2daabb800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:30:25.810 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.809+0000 7fc2daabb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:25.810 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.809+0000 7fc2daabb800 20 zonegroup default 2024-09-12T00:30:25.810 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.809+0000 7fc2daabb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:25.811 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.810+0000 7fc2daabb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:25.811 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.810+0000 7fc2daabb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:25.811 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.810+0000 7fc2daabb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:25.811 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.810+0000 7fc2daabb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:25.811 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.810+0000 7fc2daabb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:25.811 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.810+0000 7fc2daabb800 20 started sync module instance, tier type = 2024-09-12T00:30:25.811 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.810+0000 7fc2daabb800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:30:25.830 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.831+0000 7fc2daabb800 20 add_watcher() i=0 2024-09-12T00:30:25.830 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.831+0000 7fc2daabb800 20 add_watcher() i=1 2024-09-12T00:30:25.830 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.831+0000 7fc2daabb800 20 add_watcher() i=2 2024-09-12T00:30:25.831 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.831+0000 7fc2daabb800 20 add_watcher() i=3 2024-09-12T00:30:25.831 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.831+0000 7fc2daabb800 20 add_watcher() i=4 2024-09-12T00:30:25.831 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.831+0000 7fc2daabb800 20 add_watcher() i=5 2024-09-12T00:30:25.831 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.831+0000 7fc2daabb800 20 add_watcher() i=6 2024-09-12T00:30:25.832 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.832+0000 7fc2daabb800 20 add_watcher() i=7 2024-09-12T00:30:25.832 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.832+0000 7fc2daabb800 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:25.834 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.835+0000 7fc18efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:25.835 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.835+0000 7fc2daabb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:25.835 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.835+0000 7fc2daabb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:25.835 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.836+0000 7fc2daabb800 5 note: GC not initialized 2024-09-12T00:30:25.836 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.836+0000 7fc18dfdb640 20 reqs_thread_entry: start 2024-09-12T00:30:25.836 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.836+0000 7fc2daabb800 20 init_complete bucket index max shards: 1 2024-09-12T00:30:25.836 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.836+0000 7fc2daabb800 20 Filter name: none 2024-09-12T00:30:25.836 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.836+0000 7fc0ff7fe640 20 reqs_thread_entry: start 2024-09-12T00:30:25.836 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.836+0000 7fc2daabb800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:30:25.836 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.836+0000 7fc2daabb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:25.837 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.836+0000 7fc2daabb800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:30:25.837 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.836+0000 7fc2daabb800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:30:25.837 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.836+0000 7fc2daabb800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:30:25.837 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.836+0000 7fc2daabb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1 : miss 2024-09-12T00:30:25.837 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.836+0000 7fc2daabb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:25.837 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.837+0000 7fc2daabb800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:30:25.837 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.837+0000 7fc2daabb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1 info.flags=0x17 2024-09-12T00:30:25.837 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.837+0000 7fc2daabb800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1 to cache LRU end 2024-09-12T00:30:25.838 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.837+0000 7fc2daabb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:30:25.838 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.837+0000 7fc2daabb800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:30:25.838 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.837+0000 7fc2daabb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1 2024-09-12T00:30:25.838 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.837+0000 7fc2daabb800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:25.838 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.838+0000 7fc2daabb800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T00:30:25.838 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.838+0000 7fc2daabb800 1 NOTICE: finished all shards (0 entries found) 2024-09-12T00:30:25.838 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.838+0000 7fc18efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:25.844 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.843+0000 7fc2daabb800 20 remove_watcher() i=0 2024-09-12T00:30:25.844 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.843+0000 7fc2daabb800 2 removed watcher, disabling cache 2024-09-12T00:30:25.844 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.844+0000 7fc2daabb800 20 remove_watcher() i=1 2024-09-12T00:30:25.847 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.847+0000 7fc2daabb800 20 remove_watcher() i=2 2024-09-12T00:30:25.848 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.849+0000 7fc2daabb800 20 remove_watcher() i=3 2024-09-12T00:30:25.849 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.850+0000 7fc2daabb800 20 remove_watcher() i=4 2024-09-12T00:30:25.850 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.851+0000 7fc2daabb800 20 remove_watcher() i=5 2024-09-12T00:30:25.851 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.851+0000 7fc2daabb800 20 remove_watcher() i=6 2024-09-12T00:30:25.855 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:25.855+0000 7fc2daabb800 20 remove_watcher() i=7 2024-09-12T00:30:25.869 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:25.869 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:26.006 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:26.006 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:26.058 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T00:30:26.087 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:26.088 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:26.124 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.124+0000 7f4113542800 20 rados->read ofs=0 len=0 2024-09-12T00:30:26.126 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.126+0000 7f4113542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:26.126 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.126+0000 7f4113542800 20 realm 2024-09-12T00:30:26.126 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.126+0000 7f4113542800 20 rados->read ofs=0 len=0 2024-09-12T00:30:26.126 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.126+0000 7f4113542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:26.126 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.126+0000 7f4113542800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:26.126 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.126+0000 7f4113542800 20 rados->read ofs=0 len=0 2024-09-12T00:30:26.126 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.127+0000 7f4113542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:26.126 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.127+0000 7f4113542800 20 rados->read ofs=0 len=0 2024-09-12T00:30:26.127 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.127+0000 7f4113542800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:26.127 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.127+0000 7f4113542800 20 rados->read ofs=0 len=0 2024-09-12T00:30:26.127 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.128+0000 7f4113542800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:26.128 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.128+0000 7f4113542800 20 searching for the correct realm 2024-09-12T00:30:26.130 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.131+0000 7f410fa87640 0 -- 172.21.15.73:0/3578286528 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f4104089030 msgr2=0x7f410408cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:26.337 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.337+0000 7f410fa87640 0 -- 172.21.15.73:0/3578286528 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f4104089030 msgr2=0x7f410408cac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:26.341 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.341+0000 7f4113542800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:30:26.341 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.341+0000 7f4113542800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:26.341 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.341+0000 7f4113542800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:30:26.341 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.341+0000 7f4113542800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:26.341 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.341+0000 7f4113542800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:26.342 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.341+0000 7f4113542800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:26.342 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.341+0000 7f4113542800 20 rados->read ofs=0 len=0 2024-09-12T00:30:26.342 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.342+0000 7f4113542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:26.342 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.342+0000 7f4113542800 20 rados->read ofs=0 len=0 2024-09-12T00:30:26.342 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.342+0000 7f4113542800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:26.342 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.342+0000 7f4113542800 20 rados->read ofs=0 len=0 2024-09-12T00:30:26.343 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.342+0000 7f4113542800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:26.343 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.342+0000 7f4113542800 20 zone default found 2024-09-12T00:30:26.343 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.342+0000 7f4113542800 4 Realm: () 2024-09-12T00:30:26.343 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.342+0000 7f4113542800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:30:26.343 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.342+0000 7f4113542800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:30:26.343 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.342+0000 7f4113542800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:26.344 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.342+0000 7f4113542800 20 zonegroup default 2024-09-12T00:30:26.344 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.342+0000 7f4113542800 20 rados->read ofs=0 len=0 2024-09-12T00:30:26.344 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.342+0000 7f4113542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:26.344 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.342+0000 7f4113542800 20 rados->read ofs=0 len=0 2024-09-12T00:30:26.344 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.343+0000 7f4113542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:26.344 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.343+0000 7f4113542800 20 rados->read ofs=0 len=0 2024-09-12T00:30:26.344 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.343+0000 7f4113542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:26.344 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.343+0000 7f4113542800 20 started sync module instance, tier type = 2024-09-12T00:30:26.344 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.343+0000 7f4113542800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:30:26.359 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.360+0000 7f4113542800 20 add_watcher() i=0 2024-09-12T00:30:26.359 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.360+0000 7f4113542800 20 add_watcher() i=1 2024-09-12T00:30:26.360 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.360+0000 7f4113542800 20 add_watcher() i=2 2024-09-12T00:30:26.360 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.360+0000 7f4113542800 20 add_watcher() i=3 2024-09-12T00:30:26.360 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.360+0000 7f4113542800 20 add_watcher() i=4 2024-09-12T00:30:26.360 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.360+0000 7f4113542800 20 add_watcher() i=5 2024-09-12T00:30:26.360 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.360+0000 7f4113542800 20 add_watcher() i=6 2024-09-12T00:30:26.360 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.361+0000 7f4113542800 20 add_watcher() i=7 2024-09-12T00:30:26.360 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.361+0000 7f4113542800 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:26.362 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.363+0000 7f3fc5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:26.363 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.363+0000 7f4113542800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:26.364 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.363+0000 7f4113542800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:26.364 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.363+0000 7f4113542800 5 note: GC not initialized 2024-09-12T00:30:26.364 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.364+0000 7f3fc4fe1640 20 reqs_thread_entry: start 2024-09-12T00:30:26.364 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.364+0000 7f4113542800 20 init_complete bucket index max shards: 1 2024-09-12T00:30:26.364 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.364+0000 7f4113542800 20 Filter name: none 2024-09-12T00:30:26.364 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.364+0000 7f3f3e7fc640 20 reqs_thread_entry: start 2024-09-12T00:30:26.364 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.364+0000 7f4113542800 20 rados->read ofs=0 len=0 2024-09-12T00:30:26.364 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.364+0000 7f4113542800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:30:26.364 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.364+0000 7f4113542800 20 rados->read ofs=0 len=0 2024-09-12T00:30:26.365 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.365+0000 7f4113542800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:30:26.365 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.365+0000 7f4113542800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:30:26.365 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.365+0000 7f4113542800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:30:26.365 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.365+0000 7f4113542800 20 INFO: main: starting shard=0 2024-09-12T00:30:26.365 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.365+0000 7f4113542800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:26.365 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.366+0000 7f4113542800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-12T00:30:26.365 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.366+0000 7f4113542800 20 INFO: main: done 2024-09-12T00:30:26.366 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.366+0000 7f3fc5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:26.368 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.369+0000 7f4113542800 20 remove_watcher() i=0 2024-09-12T00:30:26.368 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.369+0000 7f4113542800 2 removed watcher, disabling cache 2024-09-12T00:30:26.369 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.370+0000 7f4113542800 20 remove_watcher() i=1 2024-09-12T00:30:26.370 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.371+0000 7f4113542800 20 remove_watcher() i=2 2024-09-12T00:30:26.372 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.373+0000 7f4113542800 20 remove_watcher() i=3 2024-09-12T00:30:26.373 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.374+0000 7f4113542800 20 remove_watcher() i=4 2024-09-12T00:30:26.374 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.375+0000 7f4113542800 20 remove_watcher() i=5 2024-09-12T00:30:26.377 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.378+0000 7f4113542800 20 remove_watcher() i=6 2024-09-12T00:30:26.378 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.379+0000 7f4113542800 20 remove_watcher() i=7 2024-09-12T00:30:26.390 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T00:30:26.421 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:26.421 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:26.457 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.458+0000 7f0bee52e800 20 rados->read ofs=0 len=0 2024-09-12T00:30:26.459 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.459+0000 7f0bee52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:26.459 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.459+0000 7f0bee52e800 20 realm 2024-09-12T00:30:26.459 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.459+0000 7f0bee52e800 20 rados->read ofs=0 len=0 2024-09-12T00:30:26.459 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.460+0000 7f0bee52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:26.459 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.460+0000 7f0bee52e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:26.459 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.460+0000 7f0bee52e800 20 rados->read ofs=0 len=0 2024-09-12T00:30:26.460 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.460+0000 7f0bee52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:26.460 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.460+0000 7f0bee52e800 20 rados->read ofs=0 len=0 2024-09-12T00:30:26.460 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.461+0000 7f0bee52e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:26.460 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.461+0000 7f0bee52e800 20 rados->read ofs=0 len=0 2024-09-12T00:30:26.461 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.462+0000 7f0bee52e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:26.461 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.462+0000 7f0bee52e800 20 searching for the correct realm 2024-09-12T00:30:26.464 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.465+0000 7f0bea2dd640 0 -- 172.21.15.73:0/2920802931 >> [v2:172.21.15.117:6816/1460498570,v1:172.21.15.117:6817/1460498570] conn(0x7f0be4015030 msgr2=0x7f0be405f720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:30:26.469 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.469+0000 7f0be9adc640 0 -- 172.21.15.73:0/2920802931 >> [v2:172.21.15.117:6800/110688882,v1:172.21.15.117:6801/110688882] conn(0x560d7384b670 msgr2=0x560d7384da60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:26.473 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.473+0000 7f0bee52e800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:30:26.473 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.473+0000 7f0bee52e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:26.473 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.473+0000 7f0bee52e800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:30:26.473 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.473+0000 7f0bee52e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:26.473 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.473+0000 7f0bee52e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:26.473 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.473+0000 7f0bee52e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:26.473 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.473+0000 7f0bee52e800 20 rados->read ofs=0 len=0 2024-09-12T00:30:26.473 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.473+0000 7f0bee52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:26.473 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.473+0000 7f0bee52e800 20 rados->read ofs=0 len=0 2024-09-12T00:30:26.474 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.473+0000 7f0bee52e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:26.474 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.473+0000 7f0bee52e800 20 rados->read ofs=0 len=0 2024-09-12T00:30:26.475 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.474+0000 7f0bee52e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:26.475 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.474+0000 7f0bee52e800 20 zone default found 2024-09-12T00:30:26.475 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.474+0000 7f0bee52e800 4 Realm: () 2024-09-12T00:30:26.475 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.474+0000 7f0bee52e800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:30:26.475 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.474+0000 7f0bee52e800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:30:26.475 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.474+0000 7f0bee52e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:26.475 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.474+0000 7f0bee52e800 20 zonegroup default 2024-09-12T00:30:26.475 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.474+0000 7f0bee52e800 20 rados->read ofs=0 len=0 2024-09-12T00:30:26.475 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.474+0000 7f0bee52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:26.476 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.474+0000 7f0bee52e800 20 rados->read ofs=0 len=0 2024-09-12T00:30:26.476 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.474+0000 7f0bee52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:26.476 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.474+0000 7f0bee52e800 20 rados->read ofs=0 len=0 2024-09-12T00:30:26.476 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.474+0000 7f0bee52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:26.476 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.474+0000 7f0bee52e800 20 started sync module instance, tier type = 2024-09-12T00:30:26.476 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.474+0000 7f0bee52e800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:30:26.490 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.490+0000 7f0bee52e800 20 add_watcher() i=0 2024-09-12T00:30:26.490 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.490+0000 7f0bee52e800 20 add_watcher() i=1 2024-09-12T00:30:26.490 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.490+0000 7f0bee52e800 20 add_watcher() i=2 2024-09-12T00:30:26.490 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.490+0000 7f0bee52e800 20 add_watcher() i=3 2024-09-12T00:30:26.490 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.490+0000 7f0bee52e800 20 add_watcher() i=4 2024-09-12T00:30:26.490 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.490+0000 7f0bee52e800 20 add_watcher() i=5 2024-09-12T00:30:26.490 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.491+0000 7f0bee52e800 20 add_watcher() i=6 2024-09-12T00:30:26.491 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.492+0000 7f0bee52e800 20 add_watcher() i=7 2024-09-12T00:30:26.491 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.492+0000 7f0bee52e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:26.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.493+0000 7f0aa0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:26.494 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.494+0000 7f0bee52e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:26.494 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.494+0000 7f0bee52e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:26.494 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.494+0000 7f0bee52e800 5 note: GC not initialized 2024-09-12T00:30:26.494 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.494+0000 7f0a1b7fe640 20 reqs_thread_entry: start 2024-09-12T00:30:26.494 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.494+0000 7f0bee52e800 20 init_complete bucket index max shards: 1 2024-09-12T00:30:26.494 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.494+0000 7f0bee52e800 20 Filter name: none 2024-09-12T00:30:26.494 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.494+0000 7f0a197fa640 20 reqs_thread_entry: start 2024-09-12T00:30:26.494 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.494+0000 7f0bee52e800 20 rados->read ofs=0 len=0 2024-09-12T00:30:26.495 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.495+0000 7f0bee52e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:30:26.495 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.495+0000 7f0bee52e800 20 rados->read ofs=0 len=0 2024-09-12T00:30:26.496 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.495+0000 7f0bee52e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:30:26.496 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.495+0000 7f0bee52e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:30:26.496 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.495+0000 7f0bee52e800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:30:26.496 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.495+0000 7f0bee52e800 20 INFO: main: starting shard=0 2024-09-12T00:30:26.496 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.495+0000 7f0bee52e800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:26.496 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.496+0000 7f0bee52e800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-12T00:30:26.496 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.496+0000 7f0bee52e800 20 INFO: main: done 2024-09-12T00:30:26.496 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.497+0000 7f0aa0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:26.498 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.499+0000 7f0bee52e800 20 remove_watcher() i=0 2024-09-12T00:30:26.498 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.499+0000 7f0bee52e800 2 removed watcher, disabling cache 2024-09-12T00:30:26.500 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.500+0000 7f0bee52e800 20 remove_watcher() i=1 2024-09-12T00:30:26.501 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.501+0000 7f0bee52e800 20 remove_watcher() i=2 2024-09-12T00:30:26.502 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.502+0000 7f0bee52e800 20 remove_watcher() i=3 2024-09-12T00:30:26.503 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.503+0000 7f0bee52e800 20 remove_watcher() i=4 2024-09-12T00:30:26.504 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.504+0000 7f0bee52e800 20 remove_watcher() i=5 2024-09-12T00:30:26.505 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.506+0000 7f0bee52e800 20 remove_watcher() i=6 2024-09-12T00:30:26.506 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.507+0000 7f0bee52e800 20 remove_watcher() i=7 2024-09-12T00:30:26.516 INFO:tasks.workunit.client.0.smithi073.stderr:TEST: bucket check olh finds leftover OLH entries 2024-09-12T00:30:26.516 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:30:26.518 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-12T00:30:26.549 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:26.549 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:26.586 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.586+0000 7f46fab33800 20 rados->read ofs=0 len=0 2024-09-12T00:30:26.588 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.588+0000 7f46fab33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:26.588 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.588+0000 7f46fab33800 20 realm 2024-09-12T00:30:26.588 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.588+0000 7f46fab33800 20 rados->read ofs=0 len=0 2024-09-12T00:30:26.589 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.588+0000 7f46fab33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:26.589 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.588+0000 7f46fab33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:26.589 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.588+0000 7f46fab33800 20 rados->read ofs=0 len=0 2024-09-12T00:30:26.589 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.588+0000 7f46fab33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:26.589 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.588+0000 7f46fab33800 20 rados->read ofs=0 len=0 2024-09-12T00:30:26.589 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.589+0000 7f46fab33800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:26.589 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.589+0000 7f46fab33800 20 rados->read ofs=0 len=0 2024-09-12T00:30:26.589 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.590+0000 7f46fab33800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:26.590 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.590+0000 7f46fab33800 20 searching for the correct realm 2024-09-12T00:30:26.591 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.592+0000 7f46f701b640 0 -- 172.21.15.73:0/3353691558 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f46e001a040 msgr2=0x7f46e0035400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:30:26.798 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.798+0000 7f46f701b640 0 -- 172.21.15.73:0/3353691558 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f46e001a040 msgr2=0x7f46e0035400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:26.802 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.803+0000 7f46fab33800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:30:26.803 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.803+0000 7f46fab33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:26.803 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.803+0000 7f46fab33800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:30:26.803 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.803+0000 7f46fab33800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:26.803 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.803+0000 7f46fab33800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:26.803 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.803+0000 7f46fab33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:26.803 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.803+0000 7f46fab33800 20 rados->read ofs=0 len=0 2024-09-12T00:30:26.803 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.803+0000 7f46fab33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:26.803 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.803+0000 7f46fab33800 20 rados->read ofs=0 len=0 2024-09-12T00:30:26.804 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.803+0000 7f46fab33800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:26.805 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.803+0000 7f46fab33800 20 rados->read ofs=0 len=0 2024-09-12T00:30:26.805 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.804+0000 7f46fab33800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:26.805 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.804+0000 7f46fab33800 20 zone default found 2024-09-12T00:30:26.805 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.804+0000 7f46fab33800 4 Realm: () 2024-09-12T00:30:26.805 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.804+0000 7f46fab33800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:30:26.805 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.804+0000 7f46fab33800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:30:26.805 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.804+0000 7f46fab33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:26.805 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.804+0000 7f46fab33800 20 zonegroup default 2024-09-12T00:30:26.805 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.804+0000 7f46fab33800 20 rados->read ofs=0 len=0 2024-09-12T00:30:26.805 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.804+0000 7f46fab33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:26.805 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.804+0000 7f46fab33800 20 rados->read ofs=0 len=0 2024-09-12T00:30:26.806 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.805+0000 7f46fab33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:26.806 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.805+0000 7f46fab33800 20 rados->read ofs=0 len=0 2024-09-12T00:30:26.806 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.805+0000 7f46fab33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:26.806 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.805+0000 7f46fab33800 20 started sync module instance, tier type = 2024-09-12T00:30:26.806 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.805+0000 7f46fab33800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:30:26.815 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.815+0000 7f46fab33800 20 add_watcher() i=0 2024-09-12T00:30:26.815 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.815+0000 7f46fab33800 20 add_watcher() i=1 2024-09-12T00:30:26.815 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.815+0000 7f46fab33800 20 add_watcher() i=2 2024-09-12T00:30:26.815 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.815+0000 7f46fab33800 20 add_watcher() i=3 2024-09-12T00:30:26.815 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.815+0000 7f46fab33800 20 add_watcher() i=4 2024-09-12T00:30:26.815 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.815+0000 7f46fab33800 20 add_watcher() i=5 2024-09-12T00:30:26.815 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.815+0000 7f46fab33800 20 add_watcher() i=6 2024-09-12T00:30:26.815 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.816+0000 7f46fab33800 20 add_watcher() i=7 2024-09-12T00:30:26.815 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.816+0000 7f46fab33800 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:26.818 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.818+0000 7f45ad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:26.818 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.818+0000 7f46fab33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:26.818 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.818+0000 7f46fab33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:26.818 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.818+0000 7f46fab33800 5 note: GC not initialized 2024-09-12T00:30:26.818 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.818+0000 7f4527fff640 20 reqs_thread_entry: start 2024-09-12T00:30:26.819 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.818+0000 7f46fab33800 20 init_complete bucket index max shards: 1 2024-09-12T00:30:26.819 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.819+0000 7f46fab33800 20 Filter name: none 2024-09-12T00:30:26.819 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.819+0000 7f4525ffb640 20 reqs_thread_entry: start 2024-09-12T00:30:26.819 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.819+0000 7f46fab33800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:30:26.819 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.819+0000 7f46fab33800 20 rados->read ofs=0 len=0 2024-09-12T00:30:26.820 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.819+0000 7f46fab33800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:30:26.820 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.819+0000 7f46fab33800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:30:26.820 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.819+0000 7f46fab33800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:30:26.821 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.819+0000 7f46fab33800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1 : miss 2024-09-12T00:30:26.821 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.819+0000 7f46fab33800 20 rados->read ofs=0 len=0 2024-09-12T00:30:26.821 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.819+0000 7f46fab33800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:30:26.821 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.819+0000 7f46fab33800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1 info.flags=0x17 2024-09-12T00:30:26.821 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.819+0000 7f46fab33800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1 to cache LRU end 2024-09-12T00:30:26.821 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.819+0000 7f46fab33800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:30:26.821 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.819+0000 7f46fab33800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:30:26.821 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.819+0000 7f46fab33800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1 2024-09-12T00:30:26.821 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.819+0000 7f46fab33800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:26.821 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.820+0000 7f46fab33800 1 NOTICE: finished shard 0 (2 entries found) 2024-09-12T00:30:26.821 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.820+0000 7f46fab33800 1 NOTICE: finished all shards (2 entries found) 2024-09-12T00:30:26.821 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.821+0000 7f45ad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:26.823 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.823+0000 7f46fab33800 20 remove_watcher() i=0 2024-09-12T00:30:26.823 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.823+0000 7f46fab33800 2 removed watcher, disabling cache 2024-09-12T00:30:26.824 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.824+0000 7f46fab33800 20 remove_watcher() i=1 2024-09-12T00:30:26.825 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.825+0000 7f46fab33800 20 remove_watcher() i=2 2024-09-12T00:30:26.826 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.827+0000 7f46fab33800 20 remove_watcher() i=3 2024-09-12T00:30:26.827 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.828+0000 7f46fab33800 20 remove_watcher() i=4 2024-09-12T00:30:26.828 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.829+0000 7f46fab33800 20 remove_watcher() i=5 2024-09-12T00:30:26.829 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.829+0000 7f46fab33800 20 remove_watcher() i=6 2024-09-12T00:30:26.830 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.830+0000 7f46fab33800 20 remove_watcher() i=7 2024-09-12T00:30:26.840 INFO:tasks.workunit.client.0.smithi073.stderr:TEST: bucket check olh fixes leftover OLH entries 2024-09-12T00:30:26.840 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:30:26.841 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T00:30:26.875 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:26.875 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:26.912 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.913+0000 7fa5c6d25800 20 rados->read ofs=0 len=0 2024-09-12T00:30:26.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.914+0000 7fa5c6d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:26.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.914+0000 7fa5c6d25800 20 realm 2024-09-12T00:30:26.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.914+0000 7fa5c6d25800 20 rados->read ofs=0 len=0 2024-09-12T00:30:26.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.914+0000 7fa5c6d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:26.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.914+0000 7fa5c6d25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:26.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.914+0000 7fa5c6d25800 20 rados->read ofs=0 len=0 2024-09-12T00:30:26.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.914+0000 7fa5c6d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:26.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.914+0000 7fa5c6d25800 20 rados->read ofs=0 len=0 2024-09-12T00:30:26.915 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.915+0000 7fa5c6d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:26.915 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.915+0000 7fa5c6d25800 20 rados->read ofs=0 len=0 2024-09-12T00:30:26.916 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.916+0000 7fa5c6d25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:26.916 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.916+0000 7fa5c6d25800 20 searching for the correct realm 2024-09-12T00:30:26.918 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:26.918+0000 7fa5c3134640 0 -- 172.21.15.73:0/543647152 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fa5ac091040 msgr2=0x7fa5ac064920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:27.124 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.124+0000 7fa5c3134640 0 -- 172.21.15.73:0/543647152 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fa5ac091040 msgr2=0x7fa5ac064920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:27.128 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.128+0000 7fa5c6d25800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:30:27.128 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.128+0000 7fa5c6d25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:27.128 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.128+0000 7fa5c6d25800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:30:27.128 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.128+0000 7fa5c6d25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:27.128 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.128+0000 7fa5c6d25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:27.128 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.128+0000 7fa5c6d25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:27.128 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.128+0000 7fa5c6d25800 20 rados->read ofs=0 len=0 2024-09-12T00:30:27.128 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.129+0000 7fa5c6d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:27.129 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.129+0000 7fa5c6d25800 20 rados->read ofs=0 len=0 2024-09-12T00:30:27.130 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.129+0000 7fa5c6d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:27.130 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.129+0000 7fa5c6d25800 20 rados->read ofs=0 len=0 2024-09-12T00:30:27.130 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.129+0000 7fa5c6d25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:27.130 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.129+0000 7fa5c6d25800 20 zone default found 2024-09-12T00:30:27.130 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.129+0000 7fa5c6d25800 4 Realm: () 2024-09-12T00:30:27.130 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.129+0000 7fa5c6d25800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:30:27.130 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.129+0000 7fa5c6d25800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:30:27.130 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.129+0000 7fa5c6d25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:27.130 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.129+0000 7fa5c6d25800 20 zonegroup default 2024-09-12T00:30:27.130 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.129+0000 7fa5c6d25800 20 rados->read ofs=0 len=0 2024-09-12T00:30:27.131 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.129+0000 7fa5c6d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:27.131 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.129+0000 7fa5c6d25800 20 rados->read ofs=0 len=0 2024-09-12T00:30:27.131 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.130+0000 7fa5c6d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:27.131 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.130+0000 7fa5c6d25800 20 rados->read ofs=0 len=0 2024-09-12T00:30:27.131 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.130+0000 7fa5c6d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:27.131 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.130+0000 7fa5c6d25800 20 started sync module instance, tier type = 2024-09-12T00:30:27.131 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.130+0000 7fa5c6d25800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:30:27.140 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.140+0000 7fa5c6d25800 20 add_watcher() i=0 2024-09-12T00:30:27.140 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.140+0000 7fa5c6d25800 20 add_watcher() i=1 2024-09-12T00:30:27.140 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.140+0000 7fa5c6d25800 20 add_watcher() i=2 2024-09-12T00:30:27.140 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.140+0000 7fa5c6d25800 20 add_watcher() i=3 2024-09-12T00:30:27.140 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.140+0000 7fa5c6d25800 20 add_watcher() i=4 2024-09-12T00:30:27.140 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.140+0000 7fa5c6d25800 20 add_watcher() i=5 2024-09-12T00:30:27.141 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.142+0000 7fa5c6d25800 20 add_watcher() i=6 2024-09-12T00:30:27.142 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.142+0000 7fa5c6d25800 20 add_watcher() i=7 2024-09-12T00:30:27.142 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.142+0000 7fa5c6d25800 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:27.144 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.144+0000 7fa4797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:27.144 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.145+0000 7fa5c6d25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:27.145 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.145+0000 7fa5c6d25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:27.145 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.145+0000 7fa5c6d25800 5 note: GC not initialized 2024-09-12T00:30:27.145 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.145+0000 7fa3f3fff640 20 reqs_thread_entry: start 2024-09-12T00:30:27.145 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.145+0000 7fa5c6d25800 20 init_complete bucket index max shards: 1 2024-09-12T00:30:27.145 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.145+0000 7fa5c6d25800 20 Filter name: none 2024-09-12T00:30:27.145 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.145+0000 7fa3f1ffb640 20 reqs_thread_entry: start 2024-09-12T00:30:27.145 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.145+0000 7fa5c6d25800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:30:27.145 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.145+0000 7fa5c6d25800 20 rados->read ofs=0 len=0 2024-09-12T00:30:27.146 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.146+0000 7fa5c6d25800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:30:27.146 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.146+0000 7fa5c6d25800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:30:27.146 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.146+0000 7fa5c6d25800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:30:27.146 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.146+0000 7fa5c6d25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1 : miss 2024-09-12T00:30:27.147 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.146+0000 7fa5c6d25800 20 rados->read ofs=0 len=0 2024-09-12T00:30:27.147 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.146+0000 7fa5c6d25800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:30:27.147 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.146+0000 7fa5c6d25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1 info.flags=0x17 2024-09-12T00:30:27.147 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.146+0000 7fa5c6d25800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1 to cache LRU end 2024-09-12T00:30:27.147 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.146+0000 7fa5c6d25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:30:27.147 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.146+0000 7fa5c6d25800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:30:27.147 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.146+0000 7fa5c6d25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1 2024-09-12T00:30:27.147 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.146+0000 7fa5c6d25800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:27.147 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.147+0000 7fa5c6d25800 20 get_obj_state: octx=0x564763258660 obj=check-bucket:c state=0x564763528468 s->prefetch_data=0 2024-09-12T00:30:27.148 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.147+0000 7fa5c6d25800 20 get_obj_state: setting s->obj_tag to lt1lp2accwq0q94fieqdjsi2ug6tt01z 2024-09-12T00:30:27.148 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.147+0000 7fa5c6d25800 20 get_obj_state_impl: setting s->olh_tag to blne725t6apdkbdmfpr0qrbpl4lvpjy1 2024-09-12T00:30:27.148 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.147+0000 7fa5c6d25800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:27.148 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.148+0000 7fa5c6d25800 20 olh_log_entry: epoch=4 op=2 key=c[] 2024-09-12T00:30:27.148 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.148+0000 7fa5c6d25800 20 olh_log_entry: epoch=4 op=3 key=c[I4hPgolRKFozpeXWn5gZw1UeZe7vkM1] 2024-09-12T00:30:27.148 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.148+0000 7fa5c6d25800 20 get_obj_state: octx=0x56476355cfb0 obj=check-bucket:_:I4hPgolRKFozpeXWn5gZw1UeZe7vkM1_c state=0x5647635222a8 s->prefetch_data=0 2024-09-12T00:30:27.149 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.150+0000 7fa5c6d25800 20 get_obj_state: octx=0x56476355cfb0 obj=check-bucket:c state=0x56476351e268 s->prefetch_data=0 2024-09-12T00:30:27.149 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.150+0000 7fa5c6d25800 20 get_obj_state: setting s->obj_tag to lt1lp2accwq0q94fieqdjsi2ug6tt01z 2024-09-12T00:30:27.149 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.150+0000 7fa5c6d25800 20 get_obj_state_impl: setting s->olh_tag to blne725t6apdkbdmfpr0qrbpl4lvpjy1 2024-09-12T00:30:27.150 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.150+0000 7fa5c6d25800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=blne725t6apdkbdmfpr0qrbpl4lvpjy1 2024-09-12T00:30:27.153 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.154+0000 7fa5c6d25800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:27.156 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.157+0000 7fa5c6d25800 20 get_obj_state: octx=0x564763258660 obj=check-bucket:d state=0x564763528468 s->prefetch_data=0 2024-09-12T00:30:27.157 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.157+0000 7fa5c6d25800 20 get_obj_state: setting s->obj_tag to wgurefuotrdv37w10h30ztn33ymskw1l 2024-09-12T00:30:27.157 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.157+0000 7fa5c6d25800 20 get_obj_state_impl: setting s->olh_tag to nd4cphjyi81kffobzdll62aqvdoad1qi 2024-09-12T00:30:27.157 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.157+0000 7fa5c6d25800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:27.157 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.158+0000 7fa5c6d25800 20 olh_log_entry: epoch=4 op=2 key=d[] 2024-09-12T00:30:27.157 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.158+0000 7fa5c6d25800 20 olh_log_entry: epoch=4 op=3 key=d[6wkcjhzh.Nmb2qYkp0kNIelNLIje9zt] 2024-09-12T00:30:27.158 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.158+0000 7fa5c6d25800 20 get_obj_state: octx=0x56476355cfb0 obj=check-bucket:_:6wkcjhzh.Nmb2qYkp0kNIelNLIje9zt_d state=0x564763560a38 s->prefetch_data=0 2024-09-12T00:30:27.159 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.160+0000 7fa5c6d25800 20 get_obj_state: octx=0x56476355cfb0 obj=check-bucket:d state=0x564763524408 s->prefetch_data=0 2024-09-12T00:30:27.159 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.160+0000 7fa5c6d25800 20 get_obj_state: setting s->obj_tag to wgurefuotrdv37w10h30ztn33ymskw1l 2024-09-12T00:30:27.159 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.160+0000 7fa5c6d25800 20 get_obj_state_impl: setting s->olh_tag to nd4cphjyi81kffobzdll62aqvdoad1qi 2024-09-12T00:30:27.159 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.160+0000 7fa5c6d25800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=nd4cphjyi81kffobzdll62aqvdoad1qi 2024-09-12T00:30:27.162 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.163+0000 7fa5c6d25800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:27.163 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.164+0000 7fa5c6d25800 1 NOTICE: finished shard 0 (2 entries removed) 2024-09-12T00:30:27.164 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.164+0000 7fa5c6d25800 1 NOTICE: finished all shards (2 entries removed) 2024-09-12T00:30:27.164 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.165+0000 7fa4797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:27.167 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.167+0000 7fa5c6d25800 20 remove_watcher() i=0 2024-09-12T00:30:27.167 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.167+0000 7fa5c6d25800 2 removed watcher, disabling cache 2024-09-12T00:30:27.169 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.169+0000 7fa5c6d25800 20 remove_watcher() i=1 2024-09-12T00:30:27.169 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.170+0000 7fa5c6d25800 20 remove_watcher() i=2 2024-09-12T00:30:27.171 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.172+0000 7fa5c6d25800 20 remove_watcher() i=3 2024-09-12T00:30:27.172 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.173+0000 7fa5c6d25800 20 remove_watcher() i=4 2024-09-12T00:30:27.173 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.174+0000 7fa5c6d25800 20 remove_watcher() i=5 2024-09-12T00:30:27.175 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.176+0000 7fa5c6d25800 20 remove_watcher() i=6 2024-09-12T00:30:27.176 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.177+0000 7fa5c6d25800 20 remove_watcher() i=7 2024-09-12T00:30:27.188 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T00:30:27.219 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:27.220 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:27.256 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.256+0000 7fb555536800 20 rados->read ofs=0 len=0 2024-09-12T00:30:27.258 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.258+0000 7fb555536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:27.258 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.258+0000 7fb555536800 20 realm 2024-09-12T00:30:27.258 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.258+0000 7fb555536800 20 rados->read ofs=0 len=0 2024-09-12T00:30:27.258 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.258+0000 7fb555536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:27.258 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.258+0000 7fb555536800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:27.259 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.258+0000 7fb555536800 20 rados->read ofs=0 len=0 2024-09-12T00:30:27.259 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.259+0000 7fb555536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:27.259 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.259+0000 7fb555536800 20 rados->read ofs=0 len=0 2024-09-12T00:30:27.259 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.260+0000 7fb555536800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:27.259 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.260+0000 7fb555536800 20 rados->read ofs=0 len=0 2024-09-12T00:30:27.260 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.260+0000 7fb555536800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:27.260 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.260+0000 7fb555536800 20 searching for the correct realm 2024-09-12T00:30:27.262 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.263+0000 7fb551ab8640 0 -- 172.21.15.73:0/1194036740 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fb54801e070 msgr2=0x7fb548067960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:30:27.468 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.469+0000 7fb551ab8640 0 -- 172.21.15.73:0/1194036740 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fb54801e070 msgr2=0x7fb548067960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:27.472 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.473+0000 7fb555536800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:30:27.472 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.473+0000 7fb555536800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:27.472 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.473+0000 7fb555536800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:30:27.472 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.473+0000 7fb555536800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:27.473 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.473+0000 7fb555536800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:27.473 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.473+0000 7fb555536800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:27.473 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.473+0000 7fb555536800 20 rados->read ofs=0 len=0 2024-09-12T00:30:27.473 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.473+0000 7fb555536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:27.473 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.473+0000 7fb555536800 20 rados->read ofs=0 len=0 2024-09-12T00:30:27.474 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.473+0000 7fb555536800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:27.474 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.473+0000 7fb555536800 20 rados->read ofs=0 len=0 2024-09-12T00:30:27.474 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.473+0000 7fb555536800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:27.474 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.473+0000 7fb555536800 20 zone default found 2024-09-12T00:30:27.474 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.473+0000 7fb555536800 4 Realm: () 2024-09-12T00:30:27.475 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.473+0000 7fb555536800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:30:27.475 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.473+0000 7fb555536800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:30:27.475 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.473+0000 7fb555536800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:27.475 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.473+0000 7fb555536800 20 zonegroup default 2024-09-12T00:30:27.475 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.473+0000 7fb555536800 20 rados->read ofs=0 len=0 2024-09-12T00:30:27.475 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.474+0000 7fb555536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:27.475 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.474+0000 7fb555536800 20 rados->read ofs=0 len=0 2024-09-12T00:30:27.475 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.474+0000 7fb555536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:27.475 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.474+0000 7fb555536800 20 rados->read ofs=0 len=0 2024-09-12T00:30:27.475 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.474+0000 7fb555536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:27.475 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.474+0000 7fb555536800 20 started sync module instance, tier type = 2024-09-12T00:30:27.476 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.474+0000 7fb555536800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:30:27.489 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.489+0000 7fb555536800 20 add_watcher() i=0 2024-09-12T00:30:27.489 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.489+0000 7fb555536800 20 add_watcher() i=1 2024-09-12T00:30:27.489 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.489+0000 7fb555536800 20 add_watcher() i=2 2024-09-12T00:30:27.489 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.489+0000 7fb555536800 20 add_watcher() i=3 2024-09-12T00:30:27.489 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.489+0000 7fb555536800 20 add_watcher() i=4 2024-09-12T00:30:27.489 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.489+0000 7fb555536800 20 add_watcher() i=5 2024-09-12T00:30:27.489 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.489+0000 7fb555536800 20 add_watcher() i=6 2024-09-12T00:30:27.490 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.490+0000 7fb555536800 20 add_watcher() i=7 2024-09-12T00:30:27.490 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.490+0000 7fb555536800 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:27.491 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.492+0000 7fb407fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:27.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.493+0000 7fb555536800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:27.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.493+0000 7fb555536800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:27.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.493+0000 7fb555536800 5 note: GC not initialized 2024-09-12T00:30:27.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.493+0000 7fb406fe5640 20 reqs_thread_entry: start 2024-09-12T00:30:27.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.493+0000 7fb555536800 20 init_complete bucket index max shards: 1 2024-09-12T00:30:27.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.493+0000 7fb555536800 20 Filter name: none 2024-09-12T00:30:27.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.493+0000 7fb404fe1640 20 reqs_thread_entry: start 2024-09-12T00:30:27.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.493+0000 7fb555536800 20 rados->read ofs=0 len=0 2024-09-12T00:30:27.494 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.494+0000 7fb555536800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:30:27.494 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.494+0000 7fb555536800 20 rados->read ofs=0 len=0 2024-09-12T00:30:27.494 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.494+0000 7fb555536800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:30:27.494 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.494+0000 7fb555536800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:30:27.494 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.494+0000 7fb555536800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:30:27.494 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.494+0000 7fb555536800 20 INFO: main: starting shard=0 2024-09-12T00:30:27.495 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.494+0000 7fb555536800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:27.495 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.495+0000 7fb555536800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:30:27.495 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.495+0000 7fb555536800 20 INFO: main: done 2024-09-12T00:30:27.495 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.495+0000 7fb407fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:27.497 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.498+0000 7fb555536800 20 remove_watcher() i=0 2024-09-12T00:30:27.497 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.498+0000 7fb555536800 2 removed watcher, disabling cache 2024-09-12T00:30:27.498 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.499+0000 7fb555536800 20 remove_watcher() i=1 2024-09-12T00:30:27.499 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.500+0000 7fb555536800 20 remove_watcher() i=2 2024-09-12T00:30:27.501 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.502+0000 7fb555536800 20 remove_watcher() i=3 2024-09-12T00:30:27.502 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.503+0000 7fb555536800 20 remove_watcher() i=4 2024-09-12T00:30:27.503 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.504+0000 7fb555536800 20 remove_watcher() i=5 2024-09-12T00:30:27.504 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.505+0000 7fb555536800 20 remove_watcher() i=6 2024-09-12T00:30:27.505 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.506+0000 7fb555536800 20 remove_watcher() i=7 2024-09-12T00:30:27.517 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T00:30:27.548 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:27.548 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:27.585 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.585+0000 7f2976c16800 20 rados->read ofs=0 len=0 2024-09-12T00:30:27.587 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.587+0000 7f2976c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:27.587 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.587+0000 7f2976c16800 20 realm 2024-09-12T00:30:27.587 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.587+0000 7f2976c16800 20 rados->read ofs=0 len=0 2024-09-12T00:30:27.587 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.587+0000 7f2976c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:27.587 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.587+0000 7f2976c16800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:27.587 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.587+0000 7f2976c16800 20 rados->read ofs=0 len=0 2024-09-12T00:30:27.587 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.588+0000 7f2976c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:27.587 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.588+0000 7f2976c16800 20 rados->read ofs=0 len=0 2024-09-12T00:30:27.588 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.588+0000 7f2976c16800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:27.588 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.588+0000 7f2976c16800 20 rados->read ofs=0 len=0 2024-09-12T00:30:27.589 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.589+0000 7f2976c16800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:27.589 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.589+0000 7f2976c16800 20 searching for the correct realm 2024-09-12T00:30:27.591 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.591+0000 7f2972be8640 0 -- 172.21.15.73:0/2975728869 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f296809b030 msgr2=0x7f2968026a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:30:27.797 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.797+0000 7f2972be8640 0 -- 172.21.15.73:0/2975728869 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f296809b030 msgr2=0x7f2968026a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:27.801 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.801+0000 7f2976c16800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:30:27.801 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.801+0000 7f2976c16800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:27.801 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.801+0000 7f2976c16800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:30:27.801 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.801+0000 7f2976c16800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:27.801 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.801+0000 7f2976c16800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:27.802 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.801+0000 7f2976c16800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:27.802 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.801+0000 7f2976c16800 20 rados->read ofs=0 len=0 2024-09-12T00:30:27.802 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.801+0000 7f2976c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:27.802 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.801+0000 7f2976c16800 20 rados->read ofs=0 len=0 2024-09-12T00:30:27.802 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.802+0000 7f2976c16800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:27.802 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.802+0000 7f2976c16800 20 rados->read ofs=0 len=0 2024-09-12T00:30:27.803 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.802+0000 7f2976c16800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:27.803 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.802+0000 7f2976c16800 20 zone default found 2024-09-12T00:30:27.803 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.802+0000 7f2976c16800 4 Realm: () 2024-09-12T00:30:27.804 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.802+0000 7f2976c16800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:30:27.804 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.802+0000 7f2976c16800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:30:27.804 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.802+0000 7f2976c16800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:27.804 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.802+0000 7f2976c16800 20 zonegroup default 2024-09-12T00:30:27.804 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.802+0000 7f2976c16800 20 rados->read ofs=0 len=0 2024-09-12T00:30:27.804 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.802+0000 7f2976c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:27.804 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.802+0000 7f2976c16800 20 rados->read ofs=0 len=0 2024-09-12T00:30:27.804 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.803+0000 7f2976c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:27.804 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.803+0000 7f2976c16800 20 rados->read ofs=0 len=0 2024-09-12T00:30:27.804 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.803+0000 7f2976c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:27.804 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.803+0000 7f2976c16800 20 started sync module instance, tier type = 2024-09-12T00:30:27.804 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.803+0000 7f2976c16800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:30:27.813 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.814+0000 7f2976c16800 20 add_watcher() i=0 2024-09-12T00:30:27.813 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.814+0000 7f2976c16800 20 add_watcher() i=1 2024-09-12T00:30:27.813 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.814+0000 7f2976c16800 20 add_watcher() i=2 2024-09-12T00:30:27.814 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.814+0000 7f2976c16800 20 add_watcher() i=3 2024-09-12T00:30:27.814 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.814+0000 7f2976c16800 20 add_watcher() i=4 2024-09-12T00:30:27.814 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.814+0000 7f2976c16800 20 add_watcher() i=5 2024-09-12T00:30:27.814 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.814+0000 7f2976c16800 20 add_watcher() i=6 2024-09-12T00:30:27.816 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.817+0000 7f2976c16800 20 add_watcher() i=7 2024-09-12T00:30:27.816 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.817+0000 7f2976c16800 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:27.818 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.818+0000 7f2828fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:27.819 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.819+0000 7f2976c16800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:27.819 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.819+0000 7f2976c16800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:27.819 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.819+0000 7f2976c16800 5 note: GC not initialized 2024-09-12T00:30:27.819 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.819+0000 7f27a37fe640 20 reqs_thread_entry: start 2024-09-12T00:30:27.819 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.819+0000 7f2976c16800 20 init_complete bucket index max shards: 1 2024-09-12T00:30:27.819 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.819+0000 7f2976c16800 20 Filter name: none 2024-09-12T00:30:27.819 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.819+0000 7f27a17fa640 20 reqs_thread_entry: start 2024-09-12T00:30:27.819 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.819+0000 7f2976c16800 20 rados->read ofs=0 len=0 2024-09-12T00:30:27.820 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.820+0000 7f2976c16800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:30:27.820 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.820+0000 7f2976c16800 20 rados->read ofs=0 len=0 2024-09-12T00:30:27.820 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.820+0000 7f2976c16800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:30:27.820 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.820+0000 7f2976c16800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:30:27.820 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.820+0000 7f2976c16800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:30:27.821 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.820+0000 7f2976c16800 20 INFO: main: starting shard=0 2024-09-12T00:30:27.821 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.820+0000 7f2976c16800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:27.821 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.821+0000 7f2976c16800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:30:27.821 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.821+0000 7f2976c16800 20 INFO: main: done 2024-09-12T00:30:27.821 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.821+0000 7f2828fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:27.824 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.825+0000 7f2976c16800 20 remove_watcher() i=0 2024-09-12T00:30:27.825 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.825+0000 7f2976c16800 2 removed watcher, disabling cache 2024-09-12T00:30:27.826 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.827+0000 7f2976c16800 20 remove_watcher() i=1 2024-09-12T00:30:27.827 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.828+0000 7f2976c16800 20 remove_watcher() i=2 2024-09-12T00:30:27.828 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.829+0000 7f2976c16800 20 remove_watcher() i=3 2024-09-12T00:30:27.829 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.830+0000 7f2976c16800 20 remove_watcher() i=4 2024-09-12T00:30:27.830 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.831+0000 7f2976c16800 20 remove_watcher() i=5 2024-09-12T00:30:27.831 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.832+0000 7f2976c16800 20 remove_watcher() i=6 2024-09-12T00:30:27.832 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.833+0000 7f2976c16800 20 remove_watcher() i=7 2024-09-12T00:30:27.842 INFO:tasks.workunit.client.0.smithi073.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2024-09-12T00:30:27.843 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:30:27.844 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-12T00:30:27.874 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:27.874 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:27.911 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.911+0000 7f7581f42800 20 rados->read ofs=0 len=0 2024-09-12T00:30:27.913 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.913+0000 7f7581f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:27.913 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.913+0000 7f7581f42800 20 realm 2024-09-12T00:30:27.913 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.913+0000 7f7581f42800 20 rados->read ofs=0 len=0 2024-09-12T00:30:27.913 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.913+0000 7f7581f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:27.913 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.913+0000 7f7581f42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:27.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.913+0000 7f7581f42800 20 rados->read ofs=0 len=0 2024-09-12T00:30:27.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.913+0000 7f7581f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:27.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.913+0000 7f7581f42800 20 rados->read ofs=0 len=0 2024-09-12T00:30:27.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.914+0000 7f7581f42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:27.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.914+0000 7f7581f42800 20 rados->read ofs=0 len=0 2024-09-12T00:30:27.915 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.915+0000 7f7581f42800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:27.915 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.915+0000 7f7581f42800 20 searching for the correct realm 2024-09-12T00:30:27.917 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:27.917+0000 7f757e4ee640 0 -- 172.21.15.73:0/2084107127 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f7568020480 msgr2=0x7f7568020900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:28.123 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.124+0000 7f757e4ee640 0 -- 172.21.15.73:0/2084107127 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f7568020480 msgr2=0x7f7568020900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:28.128 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.128+0000 7f7581f42800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:30:28.128 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.128+0000 7f7581f42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:28.128 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.128+0000 7f7581f42800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:30:28.128 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.128+0000 7f7581f42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:28.128 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.128+0000 7f7581f42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:28.128 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.128+0000 7f7581f42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:28.128 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.128+0000 7f7581f42800 20 rados->read ofs=0 len=0 2024-09-12T00:30:28.128 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.128+0000 7f7581f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:28.128 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.128+0000 7f7581f42800 20 rados->read ofs=0 len=0 2024-09-12T00:30:28.128 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.128+0000 7f7581f42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:28.129 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.128+0000 7f7581f42800 20 rados->read ofs=0 len=0 2024-09-12T00:30:28.129 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.128+0000 7f7581f42800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:28.129 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.128+0000 7f7581f42800 20 zone default found 2024-09-12T00:30:28.129 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.128+0000 7f7581f42800 4 Realm: () 2024-09-12T00:30:28.129 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.128+0000 7f7581f42800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:30:28.129 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.128+0000 7f7581f42800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:30:28.129 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.128+0000 7f7581f42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:28.129 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.128+0000 7f7581f42800 20 zonegroup default 2024-09-12T00:30:28.129 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.128+0000 7f7581f42800 20 rados->read ofs=0 len=0 2024-09-12T00:30:28.130 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.129+0000 7f7581f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:28.130 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.129+0000 7f7581f42800 20 rados->read ofs=0 len=0 2024-09-12T00:30:28.130 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.129+0000 7f7581f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:28.130 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.129+0000 7f7581f42800 20 rados->read ofs=0 len=0 2024-09-12T00:30:28.131 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.129+0000 7f7581f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:28.131 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.129+0000 7f7581f42800 20 started sync module instance, tier type = 2024-09-12T00:30:28.131 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.129+0000 7f7581f42800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:30:28.149 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.150+0000 7f7581f42800 20 add_watcher() i=0 2024-09-12T00:30:28.149 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.150+0000 7f7581f42800 20 add_watcher() i=1 2024-09-12T00:30:28.150 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.150+0000 7f7581f42800 20 add_watcher() i=2 2024-09-12T00:30:28.150 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.150+0000 7f7581f42800 20 add_watcher() i=3 2024-09-12T00:30:28.150 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.150+0000 7f7581f42800 20 add_watcher() i=4 2024-09-12T00:30:28.150 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.150+0000 7f7581f42800 20 add_watcher() i=5 2024-09-12T00:30:28.150 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.150+0000 7f7581f42800 20 add_watcher() i=6 2024-09-12T00:30:28.151 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.151+0000 7f7581f42800 20 add_watcher() i=7 2024-09-12T00:30:28.151 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.151+0000 7f7581f42800 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:28.154 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.153+0000 7f742f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:28.154 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.154+0000 7f7581f42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:28.154 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.154+0000 7f7581f42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:28.154 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.154+0000 7f7581f42800 5 note: GC not initialized 2024-09-12T00:30:28.154 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.154+0000 7f742e7fc640 20 reqs_thread_entry: start 2024-09-12T00:30:28.154 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.154+0000 7f7581f42800 20 init_complete bucket index max shards: 1 2024-09-12T00:30:28.154 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.154+0000 7f7581f42800 20 Filter name: none 2024-09-12T00:30:28.154 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.154+0000 7f739ffff640 20 reqs_thread_entry: start 2024-09-12T00:30:28.154 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.154+0000 7f7581f42800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:30:28.154 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.154+0000 7f7581f42800 20 rados->read ofs=0 len=0 2024-09-12T00:30:28.155 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.155+0000 7f7581f42800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:30:28.155 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.155+0000 7f7581f42800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:30:28.155 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.155+0000 7f7581f42800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:30:28.155 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.155+0000 7f7581f42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1 : miss 2024-09-12T00:30:28.155 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.155+0000 7f7581f42800 20 rados->read ofs=0 len=0 2024-09-12T00:30:28.156 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.155+0000 7f7581f42800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:30:28.156 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.155+0000 7f7581f42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1 info.flags=0x17 2024-09-12T00:30:28.156 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.155+0000 7f7581f42800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1 to cache LRU end 2024-09-12T00:30:28.156 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.155+0000 7f7581f42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:30:28.156 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.155+0000 7f7581f42800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:30:28.156 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.155+0000 7f7581f42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1 2024-09-12T00:30:28.156 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.155+0000 7f7581f42800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:28.157 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.156+0000 7f7581f42800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T00:30:28.157 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.156+0000 7f7581f42800 1 NOTICE: finished all shards (0 entries found) 2024-09-12T00:30:28.157 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.157+0000 7f742f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:28.159 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.160+0000 7f7581f42800 20 remove_watcher() i=0 2024-09-12T00:30:28.160 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.160+0000 7f7581f42800 2 removed watcher, disabling cache 2024-09-12T00:30:28.161 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.162+0000 7f7581f42800 20 remove_watcher() i=1 2024-09-12T00:30:28.164 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.164+0000 7f7581f42800 20 remove_watcher() i=2 2024-09-12T00:30:28.165 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.166+0000 7f7581f42800 20 remove_watcher() i=3 2024-09-12T00:30:28.166 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.167+0000 7f7581f42800 20 remove_watcher() i=4 2024-09-12T00:30:28.167 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.168+0000 7f7581f42800 20 remove_watcher() i=5 2024-09-12T00:30:28.169 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.170+0000 7f7581f42800 20 remove_watcher() i=6 2024-09-12T00:30:28.170 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:28.171+0000 7f7581f42800 20 remove_watcher() i=7 2024-09-12T00:30:28.181 INFO:tasks.workunit.client.0.smithi073.stderr:TEST: verify that bucket check fixes do not affect null version objects 2024-09-12T00:30:28.181 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:30:28.183 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:28.183 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:28.207 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:28.207 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:28.231 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:28.231 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:28.298 INFO:tasks.workunit.client.0.smithi073.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2024-09-12T00:30:28.298 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:30:28.299 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:28.299 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:28.365 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:28.365 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:28.590 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:28.590 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:28.652 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:28.652 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:28.677 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:28.677 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:28.740 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:28.741 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:28.765 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:28.765 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:28.818 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:28.819 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:28.843 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:28.843 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:28.908 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:28.908 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:28.934 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:28.934 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:29.002 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:29.002 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:29.027 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:29.027 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:29.082 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:29.082 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:29.114 INFO:tasks.workunit.client.0.smithi073.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T00:30:29.538 INFO:tasks.workunit.client.0.smithi073.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T00:30:30.935 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:30.935 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:31.024 INFO:tasks.workunit.client.0.smithi073.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:30:31.026 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T00:30:31.060 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:31.060 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:31.099 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.099+0000 7f2b99919800 20 rados->read ofs=0 len=0 2024-09-12T00:30:31.101 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.101+0000 7f2b99919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:31.101 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.101+0000 7f2b99919800 20 realm 2024-09-12T00:30:31.101 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.101+0000 7f2b99919800 20 rados->read ofs=0 len=0 2024-09-12T00:30:31.101 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.101+0000 7f2b99919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:31.101 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.101+0000 7f2b99919800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:31.101 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.101+0000 7f2b99919800 20 rados->read ofs=0 len=0 2024-09-12T00:30:31.102 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.102+0000 7f2b99919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:31.102 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.102+0000 7f2b99919800 20 rados->read ofs=0 len=0 2024-09-12T00:30:31.102 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.103+0000 7f2b99919800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:31.102 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.103+0000 7f2b99919800 20 rados->read ofs=0 len=0 2024-09-12T00:30:31.103 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.103+0000 7f2b99919800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:31.103 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.103+0000 7f2b99919800 20 searching for the correct realm 2024-09-12T00:30:31.105 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.106+0000 7f2b97c04640 0 -- 172.21.15.73:0/2684144118 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f2b80095c10 msgr2=0x7f2b8008a910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:30:31.312 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.312+0000 7f2b97c04640 0 -- 172.21.15.73:0/2684144118 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f2b80095c10 msgr2=0x7f2b8008a910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:31.316 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.317+0000 7f2b99919800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:30:31.316 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.317+0000 7f2b99919800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:31.316 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.317+0000 7f2b99919800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:30:31.317 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.317+0000 7f2b99919800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:31.317 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.317+0000 7f2b99919800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:31.317 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.317+0000 7f2b99919800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:31.317 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.317+0000 7f2b99919800 20 rados->read ofs=0 len=0 2024-09-12T00:30:31.317 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.317+0000 7f2b99919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:31.317 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.317+0000 7f2b99919800 20 rados->read ofs=0 len=0 2024-09-12T00:30:31.318 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.317+0000 7f2b99919800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:31.318 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.317+0000 7f2b99919800 20 rados->read ofs=0 len=0 2024-09-12T00:30:31.318 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.318+0000 7f2b99919800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:31.318 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.318+0000 7f2b99919800 20 zone default found 2024-09-12T00:30:31.318 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.318+0000 7f2b99919800 4 Realm: () 2024-09-12T00:30:31.318 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.318+0000 7f2b99919800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:30:31.319 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.318+0000 7f2b99919800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:30:31.319 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.318+0000 7f2b99919800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:31.319 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.318+0000 7f2b99919800 20 zonegroup default 2024-09-12T00:30:31.319 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.318+0000 7f2b99919800 20 rados->read ofs=0 len=0 2024-09-12T00:30:31.319 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.318+0000 7f2b99919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:31.319 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.318+0000 7f2b99919800 20 rados->read ofs=0 len=0 2024-09-12T00:30:31.319 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.318+0000 7f2b99919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:31.319 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.318+0000 7f2b99919800 20 rados->read ofs=0 len=0 2024-09-12T00:30:31.320 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.319+0000 7f2b99919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:31.320 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.319+0000 7f2b99919800 20 started sync module instance, tier type = 2024-09-12T00:30:31.320 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.319+0000 7f2b99919800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:30:31.333 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.334+0000 7f2b99919800 20 add_watcher() i=0 2024-09-12T00:30:31.333 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.334+0000 7f2b99919800 20 add_watcher() i=1 2024-09-12T00:30:31.334 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.334+0000 7f2b99919800 20 add_watcher() i=2 2024-09-12T00:30:31.334 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.334+0000 7f2b99919800 20 add_watcher() i=3 2024-09-12T00:30:31.334 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.334+0000 7f2b99919800 20 add_watcher() i=4 2024-09-12T00:30:31.334 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.334+0000 7f2b99919800 20 add_watcher() i=5 2024-09-12T00:30:31.334 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.334+0000 7f2b99919800 20 add_watcher() i=6 2024-09-12T00:30:31.334 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.335+0000 7f2b99919800 20 add_watcher() i=7 2024-09-12T00:30:31.334 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.335+0000 7f2b99919800 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:31.337 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.338+0000 7f2a4dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:31.338 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.338+0000 7f2b99919800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:31.338 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.338+0000 7f2b99919800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:31.338 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.339+0000 7f2b99919800 5 note: GC not initialized 2024-09-12T00:30:31.339 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.339+0000 7f2a4cfe1640 20 reqs_thread_entry: start 2024-09-12T00:30:31.339 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.339+0000 7f2b99919800 20 init_complete bucket index max shards: 1 2024-09-12T00:30:31.339 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.339+0000 7f2b99919800 20 Filter name: none 2024-09-12T00:30:31.339 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.339+0000 7f29c67fc640 20 reqs_thread_entry: start 2024-09-12T00:30:31.339 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.339+0000 7f2b99919800 20 rados->read ofs=0 len=0 2024-09-12T00:30:31.339 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.340+0000 7f2b99919800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:30:31.340 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.340+0000 7f2b99919800 20 rados->read ofs=0 len=0 2024-09-12T00:30:31.340 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.340+0000 7f2b99919800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:30:31.340 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.340+0000 7f2b99919800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:30:31.340 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.340+0000 7f2b99919800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:30:31.340 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.340+0000 7f2b99919800 20 INFO: main: starting shard=0 2024-09-12T00:30:31.341 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.340+0000 7f2b99919800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:31.341 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.341+0000 7f2b99919800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T00:30:31.341 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.341+0000 7f2b99919800 20 INFO: main: done 2024-09-12T00:30:31.341 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.342+0000 7f2a4dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:31.344 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.345+0000 7f2b99919800 20 remove_watcher() i=0 2024-09-12T00:30:31.345 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.345+0000 7f2b99919800 2 removed watcher, disabling cache 2024-09-12T00:30:31.345 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.346+0000 7f2b99919800 20 remove_watcher() i=1 2024-09-12T00:30:31.349 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.350+0000 7f2b99919800 20 remove_watcher() i=2 2024-09-12T00:30:31.351 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.351+0000 7f2b99919800 20 remove_watcher() i=3 2024-09-12T00:30:31.352 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.352+0000 7f2b99919800 20 remove_watcher() i=4 2024-09-12T00:30:31.353 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.353+0000 7f2b99919800 20 remove_watcher() i=5 2024-09-12T00:30:31.355 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.356+0000 7f2b99919800 20 remove_watcher() i=6 2024-09-12T00:30:31.356 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.357+0000 7f2b99919800 20 remove_watcher() i=7 2024-09-12T00:30:31.369 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:31.369 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:31.393 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:31.393 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:31.416 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:31.416 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:31.500 INFO:tasks.workunit.client.0.smithi073.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:30:31.501 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T00:30:31.533 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:31.533 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:31.570 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.570+0000 7f7a9a11f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:31.572 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.572+0000 7f7a9a11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:31.572 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.572+0000 7f7a9a11f800 20 realm 2024-09-12T00:30:31.572 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.572+0000 7f7a9a11f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:31.572 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.572+0000 7f7a9a11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:31.572 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.572+0000 7f7a9a11f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:31.572 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.572+0000 7f7a9a11f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:31.572 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.572+0000 7f7a9a11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:31.572 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.572+0000 7f7a9a11f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:31.573 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.573+0000 7f7a9a11f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:31.573 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.573+0000 7f7a9a11f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:31.574 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.574+0000 7f7a9a11f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:31.574 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.574+0000 7f7a9a11f800 20 searching for the correct realm 2024-09-12T00:30:31.576 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.577+0000 7f7a966a3640 0 -- 172.21.15.73:0/3285803526 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f7a8c02e3f0 msgr2=0x7f7a8c02e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:31.782 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.782+0000 7f7a966a3640 0 -- 172.21.15.73:0/3285803526 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f7a8c02e3f0 msgr2=0x7f7a8c02e810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:31.786 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.786+0000 7f7a9a11f800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:30:31.786 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.786+0000 7f7a9a11f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:31.786 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.786+0000 7f7a9a11f800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:30:31.786 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.786+0000 7f7a9a11f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:31.786 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.786+0000 7f7a9a11f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:31.786 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.786+0000 7f7a9a11f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:31.787 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.786+0000 7f7a9a11f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:31.787 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.787+0000 7f7a9a11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:31.787 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.787+0000 7f7a9a11f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:31.788 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.787+0000 7f7a9a11f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:31.788 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.787+0000 7f7a9a11f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:31.788 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.787+0000 7f7a9a11f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:31.788 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.787+0000 7f7a9a11f800 20 zone default found 2024-09-12T00:30:31.788 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.787+0000 7f7a9a11f800 4 Realm: () 2024-09-12T00:30:31.788 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.787+0000 7f7a9a11f800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:30:31.788 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.787+0000 7f7a9a11f800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:30:31.789 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.787+0000 7f7a9a11f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:31.789 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.787+0000 7f7a9a11f800 20 zonegroup default 2024-09-12T00:30:31.789 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.787+0000 7f7a9a11f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:31.789 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.788+0000 7f7a9a11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:31.789 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.788+0000 7f7a9a11f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:31.789 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.788+0000 7f7a9a11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:31.789 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.788+0000 7f7a9a11f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:31.789 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.788+0000 7f7a9a11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:31.789 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.788+0000 7f7a9a11f800 20 started sync module instance, tier type = 2024-09-12T00:30:31.789 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.788+0000 7f7a9a11f800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:30:31.807 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.807+0000 7f7a9a11f800 20 add_watcher() i=0 2024-09-12T00:30:31.807 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.807+0000 7f7a9a11f800 20 add_watcher() i=1 2024-09-12T00:30:31.807 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.807+0000 7f7a9a11f800 20 add_watcher() i=2 2024-09-12T00:30:31.807 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.807+0000 7f7a9a11f800 20 add_watcher() i=3 2024-09-12T00:30:31.807 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.807+0000 7f7a9a11f800 20 add_watcher() i=4 2024-09-12T00:30:31.807 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.807+0000 7f7a9a11f800 20 add_watcher() i=5 2024-09-12T00:30:31.807 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.807+0000 7f7a9a11f800 20 add_watcher() i=6 2024-09-12T00:30:31.808 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.808+0000 7f7a9a11f800 20 add_watcher() i=7 2024-09-12T00:30:31.808 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.808+0000 7f7a9a11f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:31.809 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.810+0000 7f793f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:31.810 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.810+0000 7f7a9a11f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:31.810 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.810+0000 7f7a9a11f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:31.810 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.811+0000 7f7a9a11f800 5 note: GC not initialized 2024-09-12T00:30:31.811 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.811+0000 7f793e7fc640 20 reqs_thread_entry: start 2024-09-12T00:30:31.811 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.811+0000 7f7a9a11f800 20 init_complete bucket index max shards: 1 2024-09-12T00:30:31.811 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.811+0000 7f7a9a11f800 20 Filter name: none 2024-09-12T00:30:31.811 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.811+0000 7f78bbfff640 20 reqs_thread_entry: start 2024-09-12T00:30:31.811 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.811+0000 7f7a9a11f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:31.812 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.811+0000 7f7a9a11f800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:30:31.812 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.811+0000 7f7a9a11f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:31.812 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.812+0000 7f7a9a11f800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:30:31.812 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.812+0000 7f7a9a11f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:30:31.812 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.812+0000 7f7a9a11f800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:30:31.812 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.812+0000 7f7a9a11f800 20 INFO: main: starting shard=0 2024-09-12T00:30:31.812 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.812+0000 7f7a9a11f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:31.812 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.813+0000 7f7a9a11f800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T00:30:31.813 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.813+0000 7f7a9a11f800 20 INFO: main: done 2024-09-12T00:30:31.813 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.813+0000 7f793f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:31.815 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.816+0000 7f7a9a11f800 20 remove_watcher() i=0 2024-09-12T00:30:31.815 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.816+0000 7f7a9a11f800 2 removed watcher, disabling cache 2024-09-12T00:30:31.816 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.817+0000 7f7a9a11f800 20 remove_watcher() i=1 2024-09-12T00:30:31.818 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.818+0000 7f7a9a11f800 20 remove_watcher() i=2 2024-09-12T00:30:31.819 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.820+0000 7f7a9a11f800 20 remove_watcher() i=3 2024-09-12T00:30:31.820 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.821+0000 7f7a9a11f800 20 remove_watcher() i=4 2024-09-12T00:30:31.821 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.822+0000 7f7a9a11f800 20 remove_watcher() i=5 2024-09-12T00:30:31.823 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.823+0000 7f7a9a11f800 20 remove_watcher() i=6 2024-09-12T00:30:31.824 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:31.824+0000 7f7a9a11f800 20 remove_watcher() i=7 2024-09-12T00:30:31.836 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:31.836 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:31.858 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:31.858 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:31.950 INFO:tasks.workunit.client.0.smithi073.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:30:31.951 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-12T00:30:31.982 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:31.982 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:32.018 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.019+0000 7f819f8bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:32.020 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.021+0000 7f819f8bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:32.020 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.021+0000 7f819f8bb800 20 realm 2024-09-12T00:30:32.021 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.021+0000 7f819f8bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:32.021 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.021+0000 7f819f8bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:32.021 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.021+0000 7f819f8bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:32.021 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.021+0000 7f819f8bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:32.021 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.021+0000 7f819f8bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:32.021 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.021+0000 7f819f8bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:32.021 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.022+0000 7f819f8bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:32.022 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.022+0000 7f819f8bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:32.022 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.023+0000 7f819f8bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:32.022 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.023+0000 7f819f8bb800 20 searching for the correct realm 2024-09-12T00:30:32.025 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.026+0000 7f819dba6640 0 -- 172.21.15.73:0/2959594521 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f8194015070 msgr2=0x7f819404e440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:32.029 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.030+0000 7f819cba4640 0 -- 172.21.15.73:0/2959594521 >> [v2:172.21.15.117:6800/110688882,v1:172.21.15.117:6801/110688882] conn(0x559c8a533bb0 msgr2=0x559c8a535fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:32.034 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.033+0000 7f819f8bb800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:30:32.035 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.033+0000 7f819f8bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:32.035 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.033+0000 7f819f8bb800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:30:32.035 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.033+0000 7f819f8bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:32.035 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.033+0000 7f819f8bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:32.035 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.033+0000 7f819f8bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:32.035 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.033+0000 7f819f8bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:32.035 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.034+0000 7f819f8bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:32.035 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.034+0000 7f819f8bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:32.035 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.034+0000 7f819f8bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:32.035 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.034+0000 7f819f8bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:32.035 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.034+0000 7f819f8bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:32.035 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.034+0000 7f819f8bb800 20 zone default found 2024-09-12T00:30:32.036 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.034+0000 7f819f8bb800 4 Realm: () 2024-09-12T00:30:32.036 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.034+0000 7f819f8bb800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:30:32.036 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.034+0000 7f819f8bb800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:30:32.036 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.034+0000 7f819f8bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:32.036 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.034+0000 7f819f8bb800 20 zonegroup default 2024-09-12T00:30:32.036 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.034+0000 7f819f8bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:32.036 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.034+0000 7f819f8bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:32.036 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.035+0000 7f819f8bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:32.036 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.035+0000 7f819f8bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:32.036 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.035+0000 7f819f8bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:32.036 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.035+0000 7f819f8bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:32.036 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.035+0000 7f819f8bb800 20 started sync module instance, tier type = 2024-09-12T00:30:32.036 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.035+0000 7f819f8bb800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:30:32.051 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.052+0000 7f819f8bb800 20 add_watcher() i=0 2024-09-12T00:30:32.051 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.052+0000 7f819f8bb800 20 add_watcher() i=1 2024-09-12T00:30:32.051 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.052+0000 7f819f8bb800 20 add_watcher() i=2 2024-09-12T00:30:32.052 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.052+0000 7f819f8bb800 20 add_watcher() i=3 2024-09-12T00:30:32.052 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.052+0000 7f819f8bb800 20 add_watcher() i=4 2024-09-12T00:30:32.052 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.052+0000 7f819f8bb800 20 add_watcher() i=5 2024-09-12T00:30:32.052 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.052+0000 7f819f8bb800 20 add_watcher() i=6 2024-09-12T00:30:32.052 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.053+0000 7f819f8bb800 20 add_watcher() i=7 2024-09-12T00:30:32.052 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.053+0000 7f819f8bb800 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:32.054 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.055+0000 7f80537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:32.054 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.055+0000 7f819f8bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:32.054 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.055+0000 7f819f8bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:32.054 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.055+0000 7f819f8bb800 5 note: GC not initialized 2024-09-12T00:30:32.056 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.055+0000 7f80527e4640 20 reqs_thread_entry: start 2024-09-12T00:30:32.056 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.055+0000 7f819f8bb800 20 init_complete bucket index max shards: 1 2024-09-12T00:30:32.056 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.055+0000 7f819f8bb800 20 Filter name: none 2024-09-12T00:30:32.056 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.055+0000 7f7fc3fff640 20 reqs_thread_entry: start 2024-09-12T00:30:32.056 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.055+0000 7f819f8bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:32.056 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.056+0000 7f819f8bb800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:30:32.056 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.056+0000 7f819f8bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:32.056 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.056+0000 7f819f8bb800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:30:32.056 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.056+0000 7f819f8bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:30:32.056 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.056+0000 7f819f8bb800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:30:32.056 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.056+0000 7f819f8bb800 20 INFO: main: starting shard=0 2024-09-12T00:30:32.057 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.056+0000 7f819f8bb800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:32.057 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.057+0000 7f819f8bb800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:30:32.057 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.057+0000 7f819f8bb800 20 INFO: main: done 2024-09-12T00:30:32.057 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.058+0000 7f80537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:32.059 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.060+0000 7f819f8bb800 20 remove_watcher() i=0 2024-09-12T00:30:32.060 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.060+0000 7f819f8bb800 2 removed watcher, disabling cache 2024-09-12T00:30:32.061 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.061+0000 7f819f8bb800 20 remove_watcher() i=1 2024-09-12T00:30:32.062 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.062+0000 7f819f8bb800 20 remove_watcher() i=2 2024-09-12T00:30:32.063 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.063+0000 7f819f8bb800 20 remove_watcher() i=3 2024-09-12T00:30:32.064 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.065+0000 7f819f8bb800 20 remove_watcher() i=4 2024-09-12T00:30:32.065 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.066+0000 7f819f8bb800 20 remove_watcher() i=5 2024-09-12T00:30:32.066 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.067+0000 7f819f8bb800 20 remove_watcher() i=6 2024-09-12T00:30:32.067 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.068+0000 7f819f8bb800 20 remove_watcher() i=7 2024-09-12T00:30:32.079 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:32.079 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:32.102 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:32.103 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:32.188 INFO:tasks.workunit.client.0.smithi073.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:30:32.189 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-12T00:30:32.219 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:32.219 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:32.256 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.257+0000 7fd1f4614800 20 rados->read ofs=0 len=0 2024-09-12T00:30:32.259 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.259+0000 7fd1f4614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:32.259 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.259+0000 7fd1f4614800 20 realm 2024-09-12T00:30:32.259 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.259+0000 7fd1f4614800 20 rados->read ofs=0 len=0 2024-09-12T00:30:32.259 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.259+0000 7fd1f4614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:32.259 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.259+0000 7fd1f4614800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:32.259 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.259+0000 7fd1f4614800 20 rados->read ofs=0 len=0 2024-09-12T00:30:32.259 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.259+0000 7fd1f4614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:32.259 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.259+0000 7fd1f4614800 20 rados->read ofs=0 len=0 2024-09-12T00:30:32.260 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.260+0000 7fd1f4614800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:32.260 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.260+0000 7fd1f4614800 20 rados->read ofs=0 len=0 2024-09-12T00:30:32.260 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.261+0000 7fd1f4614800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:32.261 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.261+0000 7fd1f4614800 20 searching for the correct realm 2024-09-12T00:30:32.263 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.264+0000 7fd1f05e1640 0 -- 172.21.15.73:0/1127573340 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fd1d80b9240 msgr2=0x7fd1d8088490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:32.470 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.470+0000 7fd1f05e1640 0 -- 172.21.15.73:0/1127573340 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fd1d80b9240 msgr2=0x7fd1d8088490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:32.474 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.474+0000 7fd1f4614800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:30:32.474 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.474+0000 7fd1f4614800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:32.474 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.474+0000 7fd1f4614800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:30:32.474 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.474+0000 7fd1f4614800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:32.474 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.474+0000 7fd1f4614800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:32.474 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.474+0000 7fd1f4614800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:32.475 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.474+0000 7fd1f4614800 20 rados->read ofs=0 len=0 2024-09-12T00:30:32.475 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.475+0000 7fd1f4614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:32.475 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.475+0000 7fd1f4614800 20 rados->read ofs=0 len=0 2024-09-12T00:30:32.476 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.475+0000 7fd1f4614800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:32.476 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.475+0000 7fd1f4614800 20 rados->read ofs=0 len=0 2024-09-12T00:30:32.476 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.475+0000 7fd1f4614800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:32.476 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.475+0000 7fd1f4614800 20 zone default found 2024-09-12T00:30:32.476 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.475+0000 7fd1f4614800 4 Realm: () 2024-09-12T00:30:32.476 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.475+0000 7fd1f4614800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:30:32.476 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.475+0000 7fd1f4614800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:30:32.476 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.475+0000 7fd1f4614800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:32.477 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.475+0000 7fd1f4614800 20 zonegroup default 2024-09-12T00:30:32.477 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.475+0000 7fd1f4614800 20 rados->read ofs=0 len=0 2024-09-12T00:30:32.477 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.475+0000 7fd1f4614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:32.477 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.475+0000 7fd1f4614800 20 rados->read ofs=0 len=0 2024-09-12T00:30:32.477 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.476+0000 7fd1f4614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:32.477 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.476+0000 7fd1f4614800 20 rados->read ofs=0 len=0 2024-09-12T00:30:32.478 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.476+0000 7fd1f4614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:32.478 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.476+0000 7fd1f4614800 20 started sync module instance, tier type = 2024-09-12T00:30:32.478 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.476+0000 7fd1f4614800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:30:32.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.493+0000 7fd1f4614800 20 add_watcher() i=0 2024-09-12T00:30:32.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.493+0000 7fd1f4614800 20 add_watcher() i=1 2024-09-12T00:30:32.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.493+0000 7fd1f4614800 20 add_watcher() i=2 2024-09-12T00:30:32.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.493+0000 7fd1f4614800 20 add_watcher() i=3 2024-09-12T00:30:32.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.493+0000 7fd1f4614800 20 add_watcher() i=4 2024-09-12T00:30:32.494 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.493+0000 7fd1f4614800 20 add_watcher() i=5 2024-09-12T00:30:32.494 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.493+0000 7fd1f4614800 20 add_watcher() i=6 2024-09-12T00:30:32.494 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.494+0000 7fd1f4614800 20 add_watcher() i=7 2024-09-12T00:30:32.494 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.494+0000 7fd1f4614800 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:32.496 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.496+0000 7fd0a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:32.496 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.496+0000 7fd1f4614800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:32.496 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.496+0000 7fd1f4614800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:32.496 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.496+0000 7fd1f4614800 5 note: GC not initialized 2024-09-12T00:30:32.497 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.497+0000 7fd0a4fe1640 20 reqs_thread_entry: start 2024-09-12T00:30:32.497 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.497+0000 7fd1f4614800 20 init_complete bucket index max shards: 1 2024-09-12T00:30:32.497 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.497+0000 7fd1f4614800 20 Filter name: none 2024-09-12T00:30:32.498 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.497+0000 7fd01e7fc640 20 reqs_thread_entry: start 2024-09-12T00:30:32.498 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.497+0000 7fd1f4614800 20 rados->read ofs=0 len=0 2024-09-12T00:30:32.498 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.497+0000 7fd1f4614800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:30:32.498 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.497+0000 7fd1f4614800 20 rados->read ofs=0 len=0 2024-09-12T00:30:32.498 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.498+0000 7fd1f4614800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:30:32.498 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.498+0000 7fd1f4614800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:30:32.498 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.498+0000 7fd1f4614800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:30:32.498 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.498+0000 7fd1f4614800 20 INFO: main: starting shard=0 2024-09-12T00:30:32.498 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.498+0000 7fd1f4614800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:32.499 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.499+0000 7fd1f4614800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:30:32.499 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.499+0000 7fd1f4614800 20 INFO: main: done 2024-09-12T00:30:32.499 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.499+0000 7fd0a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:32.501 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.502+0000 7fd1f4614800 20 remove_watcher() i=0 2024-09-12T00:30:32.501 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.502+0000 7fd1f4614800 2 removed watcher, disabling cache 2024-09-12T00:30:32.502 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.503+0000 7fd1f4614800 20 remove_watcher() i=1 2024-09-12T00:30:32.504 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.504+0000 7fd1f4614800 20 remove_watcher() i=2 2024-09-12T00:30:32.505 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.506+0000 7fd1f4614800 20 remove_watcher() i=3 2024-09-12T00:30:32.506 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.507+0000 7fd1f4614800 20 remove_watcher() i=4 2024-09-12T00:30:32.508 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.508+0000 7fd1f4614800 20 remove_watcher() i=5 2024-09-12T00:30:32.508 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.509+0000 7fd1f4614800 20 remove_watcher() i=6 2024-09-12T00:30:32.509 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:32.510+0000 7fd1f4614800 20 remove_watcher() i=7 2024-09-12T00:30:32.522 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:32.523 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:32.546 INFO:tasks.workunit.client.0.smithi073.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T00:30:32.940 INFO:tasks.workunit.client.0.smithi073.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T00:30:33.332 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-12T00:30:33.361 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:33.361 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:33.398 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.399+0000 7f366112a800 20 rados->read ofs=0 len=0 2024-09-12T00:30:33.400 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.400+0000 7f366112a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:33.400 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.400+0000 7f366112a800 20 realm 2024-09-12T00:30:33.400 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.400+0000 7f366112a800 20 rados->read ofs=0 len=0 2024-09-12T00:30:33.400 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.401+0000 7f366112a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:33.401 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.401+0000 7f366112a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:33.401 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.401+0000 7f366112a800 20 rados->read ofs=0 len=0 2024-09-12T00:30:33.401 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.401+0000 7f366112a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:33.401 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.401+0000 7f366112a800 20 rados->read ofs=0 len=0 2024-09-12T00:30:33.401 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.402+0000 7f366112a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:33.402 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.402+0000 7f366112a800 20 rados->read ofs=0 len=0 2024-09-12T00:30:33.402 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.403+0000 7f366112a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:33.402 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.403+0000 7f366112a800 20 searching for the correct realm 2024-09-12T00:30:33.405 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.405+0000 7f365d562640 0 -- 172.21.15.73:0/3861277876 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f3648046070 msgr2=0x7f364804ac70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:33.409 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.410+0000 7f365d562640 0 -- 172.21.15.73:0/3861277876 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f3528083850 msgr2=0x7f3528085c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:33.414 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.414+0000 7f366112a800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:30:33.414 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.414+0000 7f366112a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:33.414 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.414+0000 7f366112a800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:30:33.414 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.414+0000 7f366112a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:33.414 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.414+0000 7f366112a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:33.414 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.414+0000 7f366112a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:33.414 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.414+0000 7f366112a800 20 rados->read ofs=0 len=0 2024-09-12T00:30:33.414 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.414+0000 7f366112a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:33.414 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.414+0000 7f366112a800 20 rados->read ofs=0 len=0 2024-09-12T00:30:33.415 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.415+0000 7f366112a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:33.415 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.415+0000 7f366112a800 20 rados->read ofs=0 len=0 2024-09-12T00:30:33.416 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.415+0000 7f366112a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:33.416 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.415+0000 7f366112a800 20 zone default found 2024-09-12T00:30:33.416 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.415+0000 7f366112a800 4 Realm: () 2024-09-12T00:30:33.416 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.415+0000 7f366112a800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:30:33.416 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.415+0000 7f366112a800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:30:33.416 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.415+0000 7f366112a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:33.416 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.415+0000 7f366112a800 20 zonegroup default 2024-09-12T00:30:33.416 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.415+0000 7f366112a800 20 rados->read ofs=0 len=0 2024-09-12T00:30:33.416 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.415+0000 7f366112a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:33.417 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.415+0000 7f366112a800 20 rados->read ofs=0 len=0 2024-09-12T00:30:33.417 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.415+0000 7f366112a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:33.417 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.415+0000 7f366112a800 20 rados->read ofs=0 len=0 2024-09-12T00:30:33.417 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.416+0000 7f366112a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:33.417 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.416+0000 7f366112a800 20 started sync module instance, tier type = 2024-09-12T00:30:33.417 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.416+0000 7f366112a800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:30:33.426 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.426+0000 7f366112a800 20 add_watcher() i=0 2024-09-12T00:30:33.426 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.426+0000 7f366112a800 20 add_watcher() i=1 2024-09-12T00:30:33.426 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.426+0000 7f366112a800 20 add_watcher() i=2 2024-09-12T00:30:33.427 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.426+0000 7f366112a800 20 add_watcher() i=3 2024-09-12T00:30:33.427 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.426+0000 7f366112a800 20 add_watcher() i=4 2024-09-12T00:30:33.427 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.426+0000 7f366112a800 20 add_watcher() i=5 2024-09-12T00:30:33.427 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.426+0000 7f366112a800 20 add_watcher() i=6 2024-09-12T00:30:33.428 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.427+0000 7f366112a800 20 add_watcher() i=7 2024-09-12T00:30:33.428 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.427+0000 7f366112a800 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:33.431 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.429+0000 7f35137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:33.431 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.429+0000 7f366112a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:33.432 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.429+0000 7f366112a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:33.432 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.429+0000 7f366112a800 5 note: GC not initialized 2024-09-12T00:30:33.432 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.429+0000 7f35127e4640 20 reqs_thread_entry: start 2024-09-12T00:30:33.432 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.429+0000 7f366112a800 20 init_complete bucket index max shards: 1 2024-09-12T00:30:33.432 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.429+0000 7f366112a800 20 Filter name: none 2024-09-12T00:30:33.432 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.430+0000 7f350bfff640 20 reqs_thread_entry: start 2024-09-12T00:30:33.432 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.430+0000 7f366112a800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:30:33.432 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.430+0000 7f366112a800 20 rados->read ofs=0 len=0 2024-09-12T00:30:33.432 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.430+0000 7f366112a800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:30:33.432 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.430+0000 7f366112a800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:30:33.432 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.430+0000 7f366112a800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:30:33.432 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.430+0000 7f366112a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1 : miss 2024-09-12T00:30:33.433 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.430+0000 7f366112a800 20 rados->read ofs=0 len=0 2024-09-12T00:30:33.433 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.430+0000 7f366112a800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:30:33.433 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.430+0000 7f366112a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1 info.flags=0x17 2024-09-12T00:30:33.433 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.430+0000 7f366112a800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1 to cache LRU end 2024-09-12T00:30:33.433 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.430+0000 7f366112a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:30:33.433 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.430+0000 7f366112a800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:30:33.433 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.430+0000 7f366112a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1 2024-09-12T00:30:33.433 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.430+0000 7f366112a800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:33.434 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.434+0000 7f35137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:33.437 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.438+0000 7f366112a800 20 remove_watcher() i=0 2024-09-12T00:30:33.437 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.438+0000 7f366112a800 2 removed watcher, disabling cache 2024-09-12T00:30:33.438 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.439+0000 7f366112a800 20 remove_watcher() i=1 2024-09-12T00:30:33.439 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.440+0000 7f366112a800 20 remove_watcher() i=2 2024-09-12T00:30:33.441 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.441+0000 7f366112a800 20 remove_watcher() i=3 2024-09-12T00:30:33.442 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.442+0000 7f366112a800 20 remove_watcher() i=4 2024-09-12T00:30:33.443 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.443+0000 7f366112a800 20 remove_watcher() i=5 2024-09-12T00:30:33.444 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.444+0000 7f366112a800 20 remove_watcher() i=6 2024-09-12T00:30:33.445 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.445+0000 7f366112a800 20 remove_watcher() i=7 2024-09-12T00:30:33.456 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T00:30:33.491 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:33.491 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:33.529 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.529+0000 7f4658346800 20 rados->read ofs=0 len=0 2024-09-12T00:30:33.530 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.531+0000 7f4658346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:33.530 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.531+0000 7f4658346800 20 realm 2024-09-12T00:30:33.531 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.531+0000 7f4658346800 20 rados->read ofs=0 len=0 2024-09-12T00:30:33.531 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.531+0000 7f4658346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:33.531 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.531+0000 7f4658346800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:33.531 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.531+0000 7f4658346800 20 rados->read ofs=0 len=0 2024-09-12T00:30:33.531 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.531+0000 7f4658346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:33.531 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.531+0000 7f4658346800 20 rados->read ofs=0 len=0 2024-09-12T00:30:33.531 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.532+0000 7f4658346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:33.531 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.532+0000 7f4658346800 20 rados->read ofs=0 len=0 2024-09-12T00:30:33.532 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.533+0000 7f4658346800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:33.532 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.533+0000 7f4658346800 20 searching for the correct realm 2024-09-12T00:30:33.535 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.536+0000 7f4656631640 0 -- 172.21.15.73:0/2028250993 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f4640038070 msgr2=0x7f4640068880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:33.539 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.540+0000 7f464ffff640 0 -- 172.21.15.73:0/2028250993 >> [v2:172.21.15.117:6800/110688882,v1:172.21.15.117:6801/110688882] conn(0x55bd4940b120 msgr2=0x55bd4940d530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:33.543 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.543+0000 7f4658346800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:30:33.543 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.543+0000 7f4658346800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:33.543 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.543+0000 7f4658346800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:30:33.543 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.543+0000 7f4658346800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:33.543 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.543+0000 7f4658346800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:33.543 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.543+0000 7f4658346800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:33.543 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.543+0000 7f4658346800 20 rados->read ofs=0 len=0 2024-09-12T00:30:33.543 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.543+0000 7f4658346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:33.543 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.543+0000 7f4658346800 20 rados->read ofs=0 len=0 2024-09-12T00:30:33.545 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.544+0000 7f4658346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:33.545 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.544+0000 7f4658346800 20 rados->read ofs=0 len=0 2024-09-12T00:30:33.545 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.544+0000 7f4658346800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:33.545 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.544+0000 7f4658346800 20 zone default found 2024-09-12T00:30:33.545 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.544+0000 7f4658346800 4 Realm: () 2024-09-12T00:30:33.545 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.544+0000 7f4658346800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:30:33.545 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.544+0000 7f4658346800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:30:33.545 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.544+0000 7f4658346800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:33.545 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.544+0000 7f4658346800 20 zonegroup default 2024-09-12T00:30:33.545 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.544+0000 7f4658346800 20 rados->read ofs=0 len=0 2024-09-12T00:30:33.545 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.544+0000 7f4658346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:33.545 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.544+0000 7f4658346800 20 rados->read ofs=0 len=0 2024-09-12T00:30:33.546 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.544+0000 7f4658346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:33.546 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.544+0000 7f4658346800 20 rados->read ofs=0 len=0 2024-09-12T00:30:33.546 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.545+0000 7f4658346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:33.546 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.545+0000 7f4658346800 20 started sync module instance, tier type = 2024-09-12T00:30:33.546 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.545+0000 7f4658346800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:30:33.560 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.561+0000 7f4658346800 20 add_watcher() i=0 2024-09-12T00:30:33.560 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.561+0000 7f4658346800 20 add_watcher() i=1 2024-09-12T00:30:33.560 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.561+0000 7f4658346800 20 add_watcher() i=2 2024-09-12T00:30:33.560 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.561+0000 7f4658346800 20 add_watcher() i=3 2024-09-12T00:30:33.560 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.561+0000 7f4658346800 20 add_watcher() i=4 2024-09-12T00:30:33.560 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.561+0000 7f4658346800 20 add_watcher() i=5 2024-09-12T00:30:33.561 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.561+0000 7f4658346800 20 add_watcher() i=6 2024-09-12T00:30:33.561 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.562+0000 7f4658346800 20 add_watcher() i=7 2024-09-12T00:30:33.561 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.562+0000 7f4658346800 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:33.564 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.564+0000 7f45077fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:33.565 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.565+0000 7f4658346800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:33.566 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.565+0000 7f4658346800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:33.566 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.565+0000 7f4658346800 5 note: GC not initialized 2024-09-12T00:30:33.566 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.565+0000 7f45067fc640 20 reqs_thread_entry: start 2024-09-12T00:30:33.566 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.565+0000 7f4658346800 20 init_complete bucket index max shards: 1 2024-09-12T00:30:33.566 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.565+0000 7f4658346800 20 Filter name: none 2024-09-12T00:30:33.566 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.565+0000 7f4477fff640 20 reqs_thread_entry: start 2024-09-12T00:30:33.566 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.565+0000 7f4658346800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:30:33.566 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.565+0000 7f4658346800 20 rados->read ofs=0 len=0 2024-09-12T00:30:33.566 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.565+0000 7f4658346800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:30:33.566 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.565+0000 7f4658346800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:30:33.567 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.565+0000 7f4658346800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:30:33.567 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.565+0000 7f4658346800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1 : miss 2024-09-12T00:30:33.567 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.565+0000 7f4658346800 20 rados->read ofs=0 len=0 2024-09-12T00:30:33.567 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.566+0000 7f4658346800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:30:33.567 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.566+0000 7f4658346800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1 info.flags=0x17 2024-09-12T00:30:33.567 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.566+0000 7f4658346800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1 to cache LRU end 2024-09-12T00:30:33.567 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.566+0000 7f4658346800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:30:33.567 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.566+0000 7f4658346800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:30:33.567 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.566+0000 7f4658346800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1 2024-09-12T00:30:33.567 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.566+0000 7f4658346800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:33.568 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.567+0000 7f4658346800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:33.568 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.568+0000 7f4658346800 20 get_obj_state: octx=0x55bd49178690 obj=check-bucket:c state=0x55bd494423b8 s->prefetch_data=0 2024-09-12T00:30:33.568 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.568+0000 7f4658346800 20 get_obj_state: setting s->obj_tag to 8w3aqxdwq4w1db0gzyvy4wez67ogsg5m 2024-09-12T00:30:33.568 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.568+0000 7f4658346800 20 get_obj_state_impl: setting s->olh_tag to g4wtdndgkzljpib8l0rt5hl9l4bx9bis 2024-09-12T00:30:33.568 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.568+0000 7f4658346800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=g4wtdndgkzljpib8l0rt5hl9l4bx9bis 2024-09-12T00:30:33.569 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.569+0000 7f4658346800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:33.570 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.571+0000 7f4658346800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:33.571 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.571+0000 7f4658346800 20 olh_log_entry: epoch=3 op=3 key=c[wKC1Lj4D8UuCJ7C7Fo6k1GLXXu9xNhK] 2024-09-12T00:30:33.571 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.571+0000 7f4658346800 20 get_obj_state: octx=0x55bd49178690 obj=check-bucket:_:wKC1Lj4D8UuCJ7C7Fo6k1GLXXu9xNhK_c state=0x55bd494416e8 s->prefetch_data=0 2024-09-12T00:30:33.571 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.571+0000 7f4658346800 10 manifest: total_size = 9 2024-09-12T00:30:33.571 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.571+0000 7f4658346800 20 get_obj_state: setting s->obj_tag to f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3733068841445559297 2024-09-12T00:30:33.571 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.571+0000 7f4658346800 20 get_obj_state: octx=0x55bd49178690 obj=check-bucket:_:wKC1Lj4D8UuCJ7C7Fo6k1GLXXu9xNhK_c state=0x55bd494416e8 s->prefetch_data=0 2024-09-12T00:30:33.571 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.571+0000 7f4658346800 20 prepare_atomic_modification: state is not atomic. state=0x55bd494416e8 2024-09-12T00:30:33.571 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.571+0000 7f4658346800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:33.573 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.573+0000 7f4658346800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:33.573 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.573+0000 7f4658346800 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-09-12T00:30:33.573 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.573+0000 7f4658346800 0 deleting objects inline since gc isn't initialized 2024-09-12T00:30:33.574 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.573+0000 7f4658346800 5 delete_objs_inline: removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1__shadow:wKC1Lj4D8UuCJ7C7Fo6k1GLXXu9xNhK_.PJtPpii53ifRyYea2iVeRcKdc1ak8rW_0 2024-09-12T00:30:33.574 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.575+0000 7f4658346800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:30:33.574 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.575+0000 7f4538ff9640 20 handle_completion(): completion ok for obj=c[wKC1Lj4D8UuCJ7C7Fo6k1GLXXu9xNhK] 2024-09-12T00:30:33.575 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.576+0000 7f4658346800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:33.575 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.576+0000 7f4658346800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:33.576 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.577+0000 7f4658346800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:33.577 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.578+0000 7f4658346800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:33.577 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.578+0000 7f4658346800 20 get_obj_state: octx=0x55bd49178690 obj=check-bucket:d state=0x55bd494423b8 s->prefetch_data=0 2024-09-12T00:30:33.578 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.578+0000 7f4658346800 20 get_obj_state: setting s->obj_tag to fvhhn16orbrbrwcmos1p464owdc0owu0 2024-09-12T00:30:33.578 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.578+0000 7f4658346800 20 get_obj_state_impl: setting s->olh_tag to lv1fc82a46smqjhp0lkhsors0ghsl6w2 2024-09-12T00:30:33.578 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.578+0000 7f4658346800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=lv1fc82a46smqjhp0lkhsors0ghsl6w2 2024-09-12T00:30:33.579 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.580+0000 7f4658346800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:33.581 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.582+0000 7f4658346800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:33.582 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.582+0000 7f4658346800 20 olh_log_entry: epoch=3 op=3 key=d[0g6.OAfn4I2e8PoY.TZ8jChq.NTJggQ] 2024-09-12T00:30:33.582 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.582+0000 7f4658346800 20 get_obj_state: octx=0x55bd49178690 obj=check-bucket:_:0g6.OAfn4I2e8PoY.TZ8jChq.NTJggQ_d state=0x55bd494818f8 s->prefetch_data=0 2024-09-12T00:30:33.582 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.582+0000 7f4658346800 10 manifest: total_size = 22 2024-09-12T00:30:33.582 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.582+0000 7f4658346800 20 get_obj_state: setting s->obj_tag to f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17633488997914613301 2024-09-12T00:30:33.582 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.582+0000 7f4658346800 20 get_obj_state: octx=0x55bd49178690 obj=check-bucket:_:0g6.OAfn4I2e8PoY.TZ8jChq.NTJggQ_d state=0x55bd494818f8 s->prefetch_data=0 2024-09-12T00:30:33.583 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.582+0000 7f4658346800 20 prepare_atomic_modification: state is not atomic. state=0x55bd494818f8 2024-09-12T00:30:33.583 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.582+0000 7f4658346800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:33.584 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.585+0000 7f4658346800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:33.584 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.585+0000 7f4658346800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T00:30:33.584 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.585+0000 7f4658346800 0 deleting objects inline since gc isn't initialized 2024-09-12T00:30:33.584 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.585+0000 7f4658346800 5 delete_objs_inline: removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1__shadow:0g6.OAfn4I2e8PoY.TZ8jChq.NTJggQ_.flWMHaZVHDGnzbcgIkrL5IfKSfM-eZm_0 2024-09-12T00:30:33.585 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.586+0000 7f4658346800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:30:33.586 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.586+0000 7f4538ff9640 20 handle_completion(): completion ok for obj=d[0g6.OAfn4I2e8PoY.TZ8jChq.NTJggQ] 2024-09-12T00:30:33.587 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.587+0000 7f4658346800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:33.587 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.587+0000 7f4658346800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:33.588 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.589+0000 7f4658346800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:33.588 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.589+0000 7f4658346800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:33.589 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.589+0000 7f4658346800 20 get_obj_state: octx=0x55bd49178690 obj=check-bucket:e state=0x55bd494423b8 s->prefetch_data=0 2024-09-12T00:30:33.589 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.590+0000 7f4658346800 20 get_obj_state: setting s->obj_tag to 38lns2dkrzoc44jf71sp311eb0shjsdo 2024-09-12T00:30:33.589 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.590+0000 7f4658346800 20 get_obj_state_impl: setting s->olh_tag to xq669naz998mth9xby3q4g1afm26337u 2024-09-12T00:30:33.589 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.590+0000 7f4658346800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=xq669naz998mth9xby3q4g1afm26337u 2024-09-12T00:30:33.590 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.591+0000 7f4658346800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:33.592 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.593+0000 7f4658346800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:33.593 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.593+0000 7f4658346800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-12T00:30:33.593 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.593+0000 7f4658346800 20 olh_log_entry: epoch=2 op=3 key=e[UxIzJACrVvqDmWfFO97bqXCJwmV7Wdv] 2024-09-12T00:30:33.593 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.593+0000 7f4658346800 20 get_obj_state: octx=0x55bd49178690 obj=check-bucket:_:UxIzJACrVvqDmWfFO97bqXCJwmV7Wdv_e state=0x55bd4947e018 s->prefetch_data=0 2024-09-12T00:30:33.593 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.593+0000 7f4658346800 10 manifest: total_size = 12 2024-09-12T00:30:33.593 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.593+0000 7f4658346800 20 get_obj_state: setting s->obj_tag to f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11625935974303397825 2024-09-12T00:30:33.593 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.593+0000 7f4658346800 20 get_obj_state: octx=0x55bd49178690 obj=check-bucket:_:UxIzJACrVvqDmWfFO97bqXCJwmV7Wdv_e state=0x55bd4947e018 s->prefetch_data=0 2024-09-12T00:30:33.593 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.593+0000 7f4658346800 20 prepare_atomic_modification: state is not atomic. state=0x55bd4947e018 2024-09-12T00:30:33.593 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.593+0000 7f4658346800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:33.595 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.596+0000 7f4658346800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:33.595 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.596+0000 7f4658346800 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-12T00:30:33.595 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.596+0000 7f4658346800 0 deleting objects inline since gc isn't initialized 2024-09-12T00:30:33.595 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.596+0000 7f4658346800 5 delete_objs_inline: removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1__shadow:UxIzJACrVvqDmWfFO97bqXCJwmV7Wdv_.2SIUn3cYPga7qREB2_tzs1hdEgsnevi_0 2024-09-12T00:30:33.596 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.597+0000 7f45397fa640 20 handle_completion(): completion ok for obj=e[UxIzJACrVvqDmWfFO97bqXCJwmV7Wdv] 2024-09-12T00:30:33.597 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.598+0000 7f4658346800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:30:33.598 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.599+0000 7f4658346800 20 get_obj_state: octx=0x55bd49178690 obj=check-bucket:e state=0x55bd494423b8 s->prefetch_data=0 2024-09-12T00:30:33.599 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.599+0000 7f4658346800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=xq669naz998mth9xby3q4g1afm26337u 2024-09-12T00:30:33.601 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.601+0000 7f4658346800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:33.602 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.603+0000 7f4658346800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:33.603 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.603+0000 7f4658346800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:33.603 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.604+0000 7f4658346800 20 get_obj_state: octx=0x55bd49178690 obj=check-bucket:f state=0x55bd494423b8 s->prefetch_data=0 2024-09-12T00:30:33.603 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.604+0000 7f4658346800 20 get_obj_state: setting s->obj_tag to aw10kg1bu0klbv3yg03cytxox63kzr9k 2024-09-12T00:30:33.604 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.604+0000 7f4658346800 20 get_obj_state_impl: setting s->olh_tag to z9fiw3x2uo2kur2haf3vvhvptdf3uhvb 2024-09-12T00:30:33.604 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.604+0000 7f4658346800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=z9fiw3x2uo2kur2haf3vvhvptdf3uhvb 2024-09-12T00:30:33.604 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.605+0000 7f4658346800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:33.606 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.607+0000 7f4658346800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:33.607 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.607+0000 7f4658346800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-12T00:30:33.607 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.607+0000 7f4658346800 20 olh_log_entry: epoch=2 op=3 key=f[h450wLLjyhY0tqUeq-0ElySAEyj0h1Z] 2024-09-12T00:30:33.607 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.607+0000 7f4658346800 20 get_obj_state: octx=0x55bd49178690 obj=check-bucket:_:h450wLLjyhY0tqUeq-0ElySAEyj0h1Z_f state=0x55bd4947dfd8 s->prefetch_data=0 2024-09-12T00:30:33.608 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.608+0000 7f4658346800 10 manifest: total_size = 22 2024-09-12T00:30:33.608 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.608+0000 7f4658346800 20 get_obj_state: setting s->obj_tag to f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5930764036005917109 2024-09-12T00:30:33.608 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.608+0000 7f4658346800 20 get_obj_state: octx=0x55bd49178690 obj=check-bucket:_:h450wLLjyhY0tqUeq-0ElySAEyj0h1Z_f state=0x55bd4947dfd8 s->prefetch_data=0 2024-09-12T00:30:33.608 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.608+0000 7f4658346800 20 prepare_atomic_modification: state is not atomic. state=0x55bd4947dfd8 2024-09-12T00:30:33.608 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.608+0000 7f4658346800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:33.610 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.611+0000 7f4658346800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:33.610 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.611+0000 7f4658346800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T00:30:33.610 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.611+0000 7f4658346800 0 deleting objects inline since gc isn't initialized 2024-09-12T00:30:33.610 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.611+0000 7f4658346800 5 delete_objs_inline: removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1__shadow:h450wLLjyhY0tqUeq-0ElySAEyj0h1Z_.vSrzach8cW0cCEJEEkJTQ1_JCAFvxyH_0 2024-09-12T00:30:33.611 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.612+0000 7f4658346800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:30:33.611 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.612+0000 7f4538ff9640 20 handle_completion(): completion ok for obj=f[h450wLLjyhY0tqUeq-0ElySAEyj0h1Z] 2024-09-12T00:30:33.612 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.613+0000 7f4658346800 20 get_obj_state: octx=0x55bd49178690 obj=check-bucket:f state=0x55bd494423b8 s->prefetch_data=0 2024-09-12T00:30:33.612 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.613+0000 7f4658346800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=z9fiw3x2uo2kur2haf3vvhvptdf3uhvb 2024-09-12T00:30:33.614 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.614+0000 7f4658346800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:33.615 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.616+0000 7f4658346800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1.0 2024-09-12T00:30:33.615 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.616+0000 7f4658346800 1 NOTICE: finished shard 0 (4 entries removed) 2024-09-12T00:30:33.615 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.616+0000 7f4658346800 1 NOTICE: finished all shards (4 entries removed) 2024-09-12T00:30:33.616 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.616+0000 7f45077fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:33.618 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.619+0000 7f4658346800 20 remove_watcher() i=0 2024-09-12T00:30:33.618 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.619+0000 7f4658346800 2 removed watcher, disabling cache 2024-09-12T00:30:33.619 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.620+0000 7f4658346800 20 remove_watcher() i=1 2024-09-12T00:30:33.620 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.621+0000 7f4658346800 20 remove_watcher() i=2 2024-09-12T00:30:33.621 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.622+0000 7f4658346800 20 remove_watcher() i=3 2024-09-12T00:30:33.622 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.623+0000 7f4658346800 20 remove_watcher() i=4 2024-09-12T00:30:33.623 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.624+0000 7f4658346800 20 remove_watcher() i=5 2024-09-12T00:30:33.624 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.625+0000 7f4658346800 20 remove_watcher() i=6 2024-09-12T00:30:33.625 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.626+0000 7f4658346800 20 remove_watcher() i=7 2024-09-12T00:30:33.638 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:33.638 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:33.670 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:33.670 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:33.832 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-12T00:30:33.860 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:33.860 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:33.897 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.897+0000 7f5360326800 20 rados->read ofs=0 len=0 2024-09-12T00:30:33.898 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.899+0000 7f5360326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:33.898 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.899+0000 7f5360326800 20 realm 2024-09-12T00:30:33.898 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.899+0000 7f5360326800 20 rados->read ofs=0 len=0 2024-09-12T00:30:33.899 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.899+0000 7f5360326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:33.899 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.899+0000 7f5360326800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:33.899 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.899+0000 7f5360326800 20 rados->read ofs=0 len=0 2024-09-12T00:30:33.899 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.899+0000 7f5360326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:33.899 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.899+0000 7f5360326800 20 rados->read ofs=0 len=0 2024-09-12T00:30:33.899 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.900+0000 7f5360326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:33.899 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.900+0000 7f5360326800 20 rados->read ofs=0 len=0 2024-09-12T00:30:33.900 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.901+0000 7f5360326800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:33.900 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.901+0000 7f5360326800 20 searching for the correct realm 2024-09-12T00:30:33.902 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.903+0000 7f535b7d8640 0 -- 172.21.15.73:0/3464848260 >> [v2:172.21.15.73:6826/269690776,v1:172.21.15.73:6827/269690776] conn(0x7f534c037060 msgr2=0x7f534c067710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:33.906 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:33.906+0000 7f535bfd9640 0 -- 172.21.15.73:0/3464848260 >> [v2:172.21.15.73:6810/1807760270,v1:172.21.15.73:6811/1807760270] conn(0x7f5354055410 msgr2=0x7f5354055850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:34.111 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.111+0000 7f5360326800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:30:34.112 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.111+0000 7f5360326800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:34.112 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.111+0000 7f5360326800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:30:34.112 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.111+0000 7f5360326800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:34.112 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.111+0000 7f5360326800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:34.112 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.111+0000 7f5360326800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:34.112 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.111+0000 7f5360326800 20 rados->read ofs=0 len=0 2024-09-12T00:30:34.112 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.112+0000 7f5360326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:34.112 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.112+0000 7f5360326800 20 rados->read ofs=0 len=0 2024-09-12T00:30:34.112 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.112+0000 7f5360326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:34.112 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.112+0000 7f5360326800 20 rados->read ofs=0 len=0 2024-09-12T00:30:34.113 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.112+0000 7f5360326800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:34.114 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.112+0000 7f5360326800 20 zone default found 2024-09-12T00:30:34.114 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.112+0000 7f5360326800 4 Realm: () 2024-09-12T00:30:34.114 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.112+0000 7f5360326800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:30:34.114 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.112+0000 7f5360326800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:30:34.114 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.112+0000 7f5360326800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:34.114 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.112+0000 7f5360326800 20 zonegroup default 2024-09-12T00:30:34.114 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.113+0000 7f5360326800 20 rados->read ofs=0 len=0 2024-09-12T00:30:34.114 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.113+0000 7f5360326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:34.114 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.113+0000 7f5360326800 20 rados->read ofs=0 len=0 2024-09-12T00:30:34.114 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.113+0000 7f5360326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:34.114 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.113+0000 7f5360326800 20 rados->read ofs=0 len=0 2024-09-12T00:30:34.114 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.113+0000 7f5360326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:34.114 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.113+0000 7f5360326800 20 started sync module instance, tier type = 2024-09-12T00:30:34.115 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.113+0000 7f5360326800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:30:34.130 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.131+0000 7f5360326800 20 add_watcher() i=0 2024-09-12T00:30:34.131 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.131+0000 7f5360326800 20 add_watcher() i=1 2024-09-12T00:30:34.131 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.131+0000 7f5360326800 20 add_watcher() i=2 2024-09-12T00:30:34.131 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.131+0000 7f5360326800 20 add_watcher() i=3 2024-09-12T00:30:34.131 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.131+0000 7f5360326800 20 add_watcher() i=4 2024-09-12T00:30:34.131 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.131+0000 7f5360326800 20 add_watcher() i=5 2024-09-12T00:30:34.131 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.131+0000 7f5360326800 20 add_watcher() i=6 2024-09-12T00:30:34.131 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.132+0000 7f5360326800 20 add_watcher() i=7 2024-09-12T00:30:34.132 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.132+0000 7f5360326800 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:34.134 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.134+0000 7f5211fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:34.135 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.135+0000 7f5360326800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:34.135 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.135+0000 7f5360326800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:34.135 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.135+0000 7f5360326800 5 note: GC not initialized 2024-09-12T00:30:34.135 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.135+0000 7f5210fe1640 20 reqs_thread_entry: start 2024-09-12T00:30:34.135 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.135+0000 7f5360326800 20 init_complete bucket index max shards: 1 2024-09-12T00:30:34.135 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.135+0000 7f5360326800 20 Filter name: none 2024-09-12T00:30:34.136 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.135+0000 7f518a7fc640 20 reqs_thread_entry: start 2024-09-12T00:30:34.136 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.135+0000 7f5360326800 20 rados->read ofs=0 len=0 2024-09-12T00:30:34.137 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.136+0000 7f5360326800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:30:34.137 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.136+0000 7f5360326800 20 rados->read ofs=0 len=0 2024-09-12T00:30:34.137 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.136+0000 7f5360326800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:30:34.137 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.136+0000 7f5360326800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:30:34.137 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.136+0000 7f5360326800 20 rados->read ofs=0 len=0 2024-09-12T00:30:34.137 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.136+0000 7f5360326800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:30:34.137 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.136+0000 7f5360326800 20 rados->read ofs=0 len=0 2024-09-12T00:30:34.137 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.136+0000 7f5360326800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:30:34.137 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.136+0000 7f5360326800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:30:34.138 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.138+0000 7f5211fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:34.139 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.140+0000 7f5360326800 20 remove_watcher() i=0 2024-09-12T00:30:34.139 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.140+0000 7f5360326800 2 removed watcher, disabling cache 2024-09-12T00:30:34.141 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.142+0000 7f5360326800 20 remove_watcher() i=1 2024-09-12T00:30:34.142 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.143+0000 7f5360326800 20 remove_watcher() i=2 2024-09-12T00:30:34.143 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.144+0000 7f5360326800 20 remove_watcher() i=3 2024-09-12T00:30:34.145 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.145+0000 7f5360326800 20 remove_watcher() i=4 2024-09-12T00:30:34.146 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.146+0000 7f5360326800 20 remove_watcher() i=5 2024-09-12T00:30:34.147 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.148+0000 7f5360326800 20 remove_watcher() i=6 2024-09-12T00:30:34.148 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:30:34.149+0000 7f5360326800 20 remove_watcher() i=7 2024-09-12T00:30:34.159 INFO:tasks.workunit.client.0.smithi073.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-12T00:30:34.159 INFO:tasks.workunit.client.0.smithi073.stderr:Deleting bucket check-bucket 2024-09-12T00:30:34.160 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:34.160 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:34.186 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:34.186 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:30:34.320 INFO:tasks.workunit.client.0.smithi073.stderr:Completed bucket check tests 2024-09-12T00:30:34.320 INFO:tasks.workunit.client.0.smithi073.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-12T00:30:34.320 INFO:tasks.workunit.client.0.smithi073.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-12T00:30:34.320 INFO:tasks.workunit.client.0.smithi073.stdout:connected to https://localhost:443 2024-09-12T00:30:34.382 INFO:tasks.workunit.client.0.smithi073.stderr:+ deactivate 2024-09-12T00:30:34.382 INFO:tasks.workunit.client.0.smithi073.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-12T00:30:34.382 INFO:tasks.workunit.client.0.smithi073.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T00:30:34.382 INFO:tasks.workunit.client.0.smithi073.stderr:+ export PATH 2024-09-12T00:30:34.383 INFO:tasks.workunit.client.0.smithi073.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T00:30:34.383 INFO:tasks.workunit.client.0.smithi073.stderr:+ '[' -n '' ']' 2024-09-12T00:30:34.383 INFO:tasks.workunit.client.0.smithi073.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:30:34.383 INFO:tasks.workunit.client.0.smithi073.stderr:+ hash -r 2024-09-12T00:30:34.383 INFO:tasks.workunit.client.0.smithi073.stderr:+ '[' -n '' ']' 2024-09-12T00:30:34.383 INFO:tasks.workunit.client.0.smithi073.stderr:+ unset VIRTUAL_ENV 2024-09-12T00:30:34.383 INFO:tasks.workunit.client.0.smithi073.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T00:30:34.383 INFO:tasks.workunit.client.0.smithi073.stderr:+ unset -f deactivate 2024-09-12T00:30:34.383 INFO:tasks.workunit.client.0.smithi073.stderr:+ echo OK. 2024-09-12T00:30:34.384 INFO:tasks.workunit.client.0.smithi073.stdout:OK. 2024-09-12T00:30:34.385 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:30:34.385 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:30:34.464 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2024-09-12T00:30:34.464 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:30:34.830 DEBUG:teuthology.parallel:result is None 2024-09-12T00:30:34.831 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:30:34.869 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:30:34.869 DEBUG:teuthology.orchestra.run.smithi073:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:30:34.949 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:30:34.949 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:30:34.959 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:30:34.959 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:30:34.959 DEBUG:teuthology.orchestra.run.smithi073:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:30:35.018 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:30:35.018 INFO:teuthology.orchestra.run.smithi073.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:30:35.019 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:30:35.089 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:30:35.089 DEBUG:teuthology.orchestra.run.smithi073:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:30:35.159 INFO:tasks.workunit:timeout=3h 2024-09-12T00:30:35.159 INFO:tasks.workunit:cleanup=True 2024-09-12T00:30:35.159 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:30:35.230 INFO:tasks.workunit.client.0.smithi073.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:31:19.848 INFO:tasks.workunit.client.0.smithi073.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:31:19.849 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:31:19.849 INFO:tasks.workunit.client.0.smithi073.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:31:19.849 INFO:tasks.workunit.client.0.smithi073.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:31:19.849 INFO:tasks.workunit.client.0.smithi073.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:31:19.849 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:31:19.849 INFO:tasks.workunit.client.0.smithi073.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:31:19.849 INFO:tasks.workunit.client.0.smithi073.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:31:19.849 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:31:19.849 INFO:tasks.workunit.client.0.smithi073.stderr: git switch -c 2024-09-12T00:31:19.850 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:31:19.850 INFO:tasks.workunit.client.0.smithi073.stderr:Or undo this operation with: 2024-09-12T00:31:19.850 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:31:19.850 INFO:tasks.workunit.client.0.smithi073.stderr: git switch - 2024-09-12T00:31:19.850 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:31:19.850 INFO:tasks.workunit.client.0.smithi073.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:31:19.850 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:31:19.850 INFO:tasks.workunit.client.0.smithi073.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:31:19.853 DEBUG:teuthology.orchestra.run.smithi073:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:31:19.922 INFO:tasks.workunit.client.0.smithi073.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:31:19.924 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:31:19.925 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:31:19.973 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:31:20.022 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:31:20.061 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:31:20.062 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:31:20.063 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:31:20.102 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:31:20.105 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T00:31:20.105 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:31:20.175 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2024-09-12T00:31:20.176 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-09-12T00:31:20.177 DEBUG:teuthology.orchestra.run.smithi073:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-09-12T00:31:20.257 INFO:tasks.workunit.client.0.smithi073.stdout:Running main() from gmock_main.cc 2024-09-12T00:31:20.258 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T00:31:20.258 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment set-up. 2024-09-12T00:31:20.258 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 11 tests from ClsLock 2024-09-12T00:31:20.258 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-09-12T00:31:22.413 INFO:tasks.workunit.client.0.smithi073.stdout:lock: mylock 2024-09-12T00:31:22.413 INFO:tasks.workunit.client.0.smithi073.stdout: lock_type: exclusive 2024-09-12T00:31:22.413 INFO:tasks.workunit.client.0.smithi073.stdout: tag: 2024-09-12T00:31:22.414 INFO:tasks.workunit.client.0.smithi073.stdout: lockers: 2024-09-12T00:31:22.414 INFO:tasks.workunit.client.0.smithi073.stdout: client.5054 expiration=2024-09-12T00:33:22.410450+0000 addr=v1:172.21.15.73:0/3292727821 cookie= 2024-09-12T00:31:22.417 INFO:tasks.workunit.client.0.smithi073.stdout:lock: mylock 2024-09-12T00:31:22.417 INFO:tasks.workunit.client.0.smithi073.stdout: lock_type: shared 2024-09-12T00:31:22.417 INFO:tasks.workunit.client.0.smithi073.stdout: tag: 2024-09-12T00:31:22.417 INFO:tasks.workunit.client.0.smithi073.stdout: lockers: 2024-09-12T00:31:22.417 INFO:tasks.workunit.client.0.smithi073.stdout: client.5054 expiration=2024-09-12T00:33:22.417970+0000 addr=v1:172.21.15.73:0/3292727821 cookie= 2024-09-12T00:31:22.417 INFO:tasks.workunit.client.0.smithi073.stdout: client.5057 expiration=0.000000 addr=v1:172.21.15.73:0/3135519238 cookie= 2024-09-12T00:31:22.418 INFO:tasks.workunit.client.0.smithi073.stdout:lock: mylock 2024-09-12T00:31:22.418 INFO:tasks.workunit.client.0.smithi073.stdout: lock_type: shared 2024-09-12T00:31:22.418 INFO:tasks.workunit.client.0.smithi073.stdout: tag: 2024-09-12T00:31:22.419 INFO:tasks.workunit.client.0.smithi073.stdout: lockers: 2024-09-12T00:31:22.419 INFO:tasks.workunit.client.0.smithi073.stdout: client.5057 expiration=0.000000 addr=v1:172.21.15.73:0/3135519238 cookie= 2024-09-12T00:31:23.259 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] ClsLock.TestMultiLocking (3001 ms) 2024-09-12T00:31:23.259 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] ClsLock.TestMeta 2024-09-12T00:31:25.299 INFO:tasks.workunit.client.0.smithi073.stdout:lock: mylock 2024-09-12T00:31:25.299 INFO:tasks.workunit.client.0.smithi073.stdout: lock_type: shared 2024-09-12T00:31:25.299 INFO:tasks.workunit.client.0.smithi073.stdout: tag: 2024-09-12T00:31:25.299 INFO:tasks.workunit.client.0.smithi073.stdout: lockers: 2024-09-12T00:31:25.299 INFO:tasks.workunit.client.0.smithi073.stdout: client.5217 expiration=0.000000 addr=v1:172.21.15.73:0/297503873 cookie= 2024-09-12T00:31:25.301 INFO:tasks.workunit.client.0.smithi073.stdout:lock: mylock 2024-09-12T00:31:25.301 INFO:tasks.workunit.client.0.smithi073.stdout: lock_type: exclusive 2024-09-12T00:31:25.301 INFO:tasks.workunit.client.0.smithi073.stdout: tag: new_tag 2024-09-12T00:31:25.301 INFO:tasks.workunit.client.0.smithi073.stdout: lockers: 2024-09-12T00:31:25.301 INFO:tasks.workunit.client.0.smithi073.stdout: client.5211 expiration=0.000000 addr=v1:172.21.15.73:0/3343774713 cookie= 2024-09-12T00:31:26.267 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] ClsLock.TestMeta (3008 ms) 2024-09-12T00:31:26.268 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] ClsLock.TestCookie 2024-09-12T00:31:28.321 INFO:tasks.workunit.client.0.smithi073.stdout:lock: mylock 2024-09-12T00:31:28.321 INFO:tasks.workunit.client.0.smithi073.stdout: lock_type: exclusive 2024-09-12T00:31:28.321 INFO:tasks.workunit.client.0.smithi073.stdout: tag: 2024-09-12T00:31:28.321 INFO:tasks.workunit.client.0.smithi073.stdout: lockers: 2024-09-12T00:31:28.323 INFO:tasks.workunit.client.0.smithi073.stdout:lock: mylock 2024-09-12T00:31:28.323 INFO:tasks.workunit.client.0.smithi073.stdout: lock_type: shared 2024-09-12T00:31:28.323 INFO:tasks.workunit.client.0.smithi073.stdout: tag: 2024-09-12T00:31:28.324 INFO:tasks.workunit.client.0.smithi073.stdout: lockers: 2024-09-12T00:31:28.324 INFO:tasks.workunit.client.0.smithi073.stdout: client.5226 expiration=0.000000 addr=v1:172.21.15.73:0/3538581499 cookie= 2024-09-12T00:31:28.324 INFO:tasks.workunit.client.0.smithi073.stdout: client.5226 expiration=0.000000 addr=v1:172.21.15.73:0/3538581499 cookie=new cookie 2024-09-12T00:31:29.303 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] ClsLock.TestCookie (3037 ms) 2024-09-12T00:31:29.304 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-09-12T00:31:32.329 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] ClsLock.TestMultipleLocks (3025 ms) 2024-09-12T00:31:32.329 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] ClsLock.TestLockDuration 2024-09-12T00:31:39.569 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] ClsLock.TestLockDuration (7240 ms) 2024-09-12T00:31:39.569 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-09-12T00:31:42.597 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] ClsLock.TestAssertLocked (3028 ms) 2024-09-12T00:31:42.597 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] ClsLock.TestSetCookie 2024-09-12T00:31:45.611 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] ClsLock.TestSetCookie (3015 ms) 2024-09-12T00:31:45.612 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] ClsLock.TestRenew 2024-09-12T00:32:05.671 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] ClsLock.TestRenew (20058 ms) 2024-09-12T00:32:05.672 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-09-12T00:32:12.704 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (7034 ms) 2024-09-12T00:32:12.704 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-09-12T00:32:19.792 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (7088 ms) 2024-09-12T00:32:19.792 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-09-12T00:32:27.828 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8035 ms) 2024-09-12T00:32:27.828 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 11 tests from ClsLock (67570 ms total) 2024-09-12T00:32:27.828 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-09-12T00:32:27.828 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment tear-down 2024-09-12T00:32:27.828 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] 11 tests from 1 test suite ran. (67570 ms total) 2024-09-12T00:32:27.828 INFO:tasks.workunit.client.0.smithi073.stdout:[ PASSED ] 11 tests. 2024-09-12T00:32:27.831 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:32:27.831 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:32:27.915 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2024-09-12T00:32:27.916 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-09-12T00:32:27.916 DEBUG:teuthology.orchestra.run.smithi073:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-09-12T00:32:28.002 INFO:tasks.workunit.client.0.smithi073.stdout:Running main() from gmock_main.cc 2024-09-12T00:32:28.002 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T00:32:28.002 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment set-up. 2024-09-12T00:32:28.002 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 4 tests from cls_log 2024-09-12T00:32:28.002 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-09-12T00:32:30.854 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_log.test_log_add_same_time (2851 ms) 2024-09-12T00:32:30.854 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-09-12T00:32:33.857 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_log.test_log_add_different_time (3004 ms) 2024-09-12T00:32:33.857 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_log.trim_by_time 2024-09-12T00:32:36.884 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_log.trim_by_time (3027 ms) 2024-09-12T00:32:36.884 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_log.trim_by_marker 2024-09-12T00:32:39.888 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_log.trim_by_marker (3004 ms) 2024-09-12T00:32:39.888 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 4 tests from cls_log (11886 ms total) 2024-09-12T00:32:39.889 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-09-12T00:32:39.889 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment tear-down 2024-09-12T00:32:39.889 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] 4 tests from 1 test suite ran. (11886 ms total) 2024-09-12T00:32:39.889 INFO:tasks.workunit.client.0.smithi073.stdout:[ PASSED ] 4 tests. 2024-09-12T00:32:39.891 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:32:39.892 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:32:39.936 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2024-09-12T00:32:39.940 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-09-12T00:32:39.940 DEBUG:teuthology.orchestra.run.smithi073:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-09-12T00:32:40.023 INFO:tasks.workunit.client.0.smithi073.stdout:Running main() from gmock_main.cc 2024-09-12T00:32:40.023 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-12T00:32:40.023 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment set-up. 2024-09-12T00:32:40.024 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 10 tests from cls_refcount 2024-09-12T00:32:40.024 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_refcount.test_implicit 2024-09-12T00:32:42.927 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_refcount.test_implicit (2904 ms) 2024-09-12T00:32:42.928 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2024-09-12T00:32:45.930 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3003 ms) 2024-09-12T00:32:45.930 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_refcount.test_put_snap 2024-09-12T00:32:54.984 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_refcount.test_put_snap (9054 ms) 2024-09-12T00:32:54.984 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_refcount.test_explicit 2024-09-12T00:32:57.997 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_refcount.test_explicit (3012 ms) 2024-09-12T00:32:57.997 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_refcount.set 2024-09-12T00:33:01.024 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_refcount.set (3028 ms) 2024-09-12T00:33:01.024 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_refcount.test_implicit_ec 2024-09-12T00:33:08.067 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_refcount.test_implicit_ec (7042 ms) 2024-09-12T00:33:08.067 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2024-09-12T00:33:15.089 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7022 ms) 2024-09-12T00:33:15.089 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2024-09-12T00:33:28.150 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_refcount.test_put_snap_ec (13061 ms) 2024-09-12T00:33:28.150 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_refcount.test_explicit_ec 2024-09-12T00:33:35.172 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_refcount.test_explicit_ec (7022 ms) 2024-09-12T00:33:35.173 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_refcount.set_ec 2024-09-12T00:33:42.218 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_refcount.set_ec (7046 ms) 2024-09-12T00:33:42.219 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 10 tests from cls_refcount (62195 ms total) 2024-09-12T00:33:42.219 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-09-12T00:33:42.219 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment tear-down 2024-09-12T00:33:42.219 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] 10 tests from 1 test suite ran. (62195 ms total) 2024-09-12T00:33:42.219 INFO:tasks.workunit.client.0.smithi073.stdout:[ PASSED ] 10 tests. 2024-09-12T00:33:42.221 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:33:42.222 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:33:42.265 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2024-09-12T00:33:42.266 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-09-12T00:33:42.266 DEBUG:teuthology.orchestra.run.smithi073:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-09-12T00:33:42.351 INFO:tasks.workunit.client.0.smithi073.stdout:Running main() from gmock_main.cc 2024-09-12T00:33:42.352 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T00:33:42.352 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment set-up. 2024-09-12T00:33:42.352 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 19 tests from cls_rgw 2024-09-12T00:33:44.244 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_rgw.index_basic 2024-09-12T00:33:44.275 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_rgw.index_basic (30 ms) 2024-09-12T00:33:44.275 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-09-12T00:33:44.310 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (35 ms) 2024-09-12T00:33:44.310 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_rgw.index_remove_object 2024-09-12T00:33:44.354 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_rgw.index_remove_object (45 ms) 2024-09-12T00:33:44.355 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_rgw.index_suggest 2024-09-12T00:33:45.849 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_rgw.index_suggest (1494 ms) 2024-09-12T00:33:45.849 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-09-12T00:33:45.856 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_rgw.index_suggest_complete (7 ms) 2024-09-12T00:33:45.856 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_rgw.index_list 2024-09-12T00:33:45.881 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_rgw.index_list (25 ms) 2024-09-12T00:33:45.881 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-09-12T00:34:05.544 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_rgw.index_list_delimited (19663 ms) 2024-09-12T00:34:05.544 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_rgw.bi_list 2024-09-12T00:34:05.622 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_rgw.bi_list (78 ms) 2024-09-12T00:34:05.622 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_rgw.gc_set 2024-09-12T00:34:05.631 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_rgw.gc_set (10 ms) 2024-09-12T00:34:05.632 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_rgw.gc_list 2024-09-12T00:34:05.642 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_rgw.gc_list (10 ms) 2024-09-12T00:34:05.642 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_rgw.gc_defer 2024-09-12T00:34:12.621 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_rgw.gc_defer (6979 ms) 2024-09-12T00:34:12.621 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_rgw.usage_basic 2024-09-12T00:34:12.697 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_rgw.usage_basic (76 ms) 2024-09-12T00:34:12.697 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-09-12T00:34:12.698 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_rgw.usage_clear_no_obj (1 ms) 2024-09-12T00:34:12.698 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_rgw.usage_clear 2024-09-12T00:34:12.795 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_rgw.usage_clear (97 ms) 2024-09-12T00:34:12.795 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-09-12T00:34:12.836 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_rgw.bi_log_trim (41 ms) 2024-09-12T00:34:12.836 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-09-12T00:34:12.849 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_rgw.index_racing_removes (14 ms) 2024-09-12T00:34:12.849 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_rgw.reshardlog_list 2024-09-12T00:34:12.862 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_rgw.reshardlog_list (13 ms) 2024-09-12T00:34:12.862 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_rgw.reshardlog_num 2024-09-12T00:34:12.872 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_rgw.reshardlog_num (9 ms) 2024-09-12T00:34:12.872 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_rgw.bi_put_entries 2024-09-12T00:34:12.895 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_rgw.bi_put_entries (23 ms) 2024-09-12T00:34:13.624 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 19 tests from cls_rgw (28650 ms total) 2024-09-12T00:34:13.624 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-09-12T00:34:13.625 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment tear-down 2024-09-12T00:34:13.625 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] 19 tests from 1 test suite ran. (31273 ms total) 2024-09-12T00:34:13.625 INFO:tasks.workunit.client.0.smithi073.stdout:[ PASSED ] 19 tests. 2024-09-12T00:34:13.627 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:34:13.627 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:34:13.668 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2024-09-12T00:34:13.669 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-09-12T00:34:13.670 DEBUG:teuthology.orchestra.run.smithi073:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-09-12T00:34:13.753 INFO:tasks.workunit.client.0.smithi073.stdout:Running main() from gmock_main.cc 2024-09-12T00:34:13.754 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T00:34:13.754 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment set-up. 2024-09-12T00:34:13.754 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 9 tests from cls_rgw_gc 2024-09-12T00:34:13.754 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_rgw_gc.init 2024-09-12T00:34:15.643 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_rgw_gc.init (1889 ms) 2024-09-12T00:34:15.643 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-09-12T00:34:15.662 INFO:tasks.workunit.client.0.smithi073.stderr:[ ] list info tag = chain-0 2024-09-12T00:34:15.663 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (20 ms) 2024-09-12T00:34:15.663 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-09-12T00:34:15.669 INFO:tasks.workunit.client.0.smithi073.stderr:[ ] next_marker is: = 0/4263 2024-09-12T00:34:15.670 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (7 ms) 2024-09-12T00:34:15.670 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-09-12T00:34:15.677 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (8 ms) 2024-09-12T00:34:15.677 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-09-12T00:34:15.711 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (33 ms) 2024-09-12T00:34:15.711 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-09-12T00:34:15.719 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (8 ms) 2024-09-12T00:34:15.719 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-09-12T00:34:15.727 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (9 ms) 2024-09-12T00:34:15.728 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-09-12T00:34:15.734 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (7 ms) 2024-09-12T00:34:15.734 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_rgw_gc.finalize 2024-09-12T00:34:16.652 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_rgw_gc.finalize (918 ms) 2024-09-12T00:34:16.653 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 9 tests from cls_rgw_gc (2899 ms total) 2024-09-12T00:34:16.653 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-09-12T00:34:16.653 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment tear-down 2024-09-12T00:34:16.653 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] 9 tests from 1 test suite ran. (2899 ms total) 2024-09-12T00:34:16.653 INFO:tasks.workunit.client.0.smithi073.stdout:[ PASSED ] 9 tests. 2024-09-12T00:34:16.655 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:34:16.655 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:34:16.698 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2024-09-12T00:34:16.700 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-09-12T00:34:16.700 DEBUG:teuthology.orchestra.run.smithi073:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-09-12T00:34:16.798 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:34:16.798 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:34:16.798 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] Running 1 test from 1 test suite. 2024-09-12T00:34:16.798 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment set-up. 2024-09-12T00:34:18.656 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 1 test from cls_rgw_stats 2024-09-12T00:34:18.656 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] cls_rgw_stats.simulate 2024-09-12T00:34:18.676 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.676+0000 7f1f2d864780 1 > prepared operation key=1299IOSGYIO9 tag=UI7HIIX109BN type=del size=2584120 2024-09-12T00:34:18.677 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.678+0000 7f1f2d864780 1 > prepared operation key=W6U30X4HJCB1 tag=IIF8W5H5T43O type=write size=36803 2024-09-12T00:34:18.680 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.680+0000 7f1f2d864780 1 > prepared part key=_multipart_SNCGB6Z20450.2~POP2PQONJ6NU.0 size=1048576 2024-09-12T00:34:18.681 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.681+0000 7f1f2d864780 1 > prepared part key=_multipart_SNCGB6Z20450.2~POP2PQONJ6NU.1 size=874622 2024-09-12T00:34:18.681 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.681+0000 7f1f2d864780 1 > prepared multipart upload key=SNCGB6Z20450 upload=POP2PQONJ6NU tag=CQ5YJE4UP3VP type=write size=2971774 2024-09-12T00:34:18.682 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.683+0000 7f1f2d864780 1 > prepared operation key=UTR2UUO6DHLJ tag=0IB84JBEH2XC type=del size=2637480 2024-09-12T00:34:18.685 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.685+0000 7f1f2d864780 1 > prepared part key=_multipart_2RV0899QUJ8W.2~2S5OGFFVJRY7.0 size=1048576 2024-09-12T00:34:18.686 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.686+0000 7f1f2d864780 1 > prepared part key=_multipart_2RV0899QUJ8W.2~2S5OGFFVJRY7.1 size=1048576 2024-09-12T00:34:18.687 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.687+0000 7f1f2d864780 1 > prepared part key=_multipart_2RV0899QUJ8W.2~2S5OGFFVJRY7.2 size=168678 2024-09-12T00:34:18.687 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.687+0000 7f1f2d864780 1 > prepared multipart upload key=2RV0899QUJ8W upload=2S5OGFFVJRY7 tag=18Z96B6G8UIX type=write size=3314406 2024-09-12T00:34:18.689 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.690+0000 7f1f2d864780 1 > prepared part key=_multipart_KHPF1N1MT33Z.2~L0V7SMLKRRE8.0 size=1048576 2024-09-12T00:34:18.690 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.691+0000 7f1f2d864780 1 > prepared part key=_multipart_KHPF1N1MT33Z.2~L0V7SMLKRRE8.1 size=522282 2024-09-12T00:34:18.690 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.691+0000 7f1f2d864780 1 > prepared multipart upload key=KHPF1N1MT33Z upload=L0V7SMLKRRE8 tag=2N16V8I7LVE9 type=write size=2619434 2024-09-12T00:34:18.693 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.693+0000 7f1f2d864780 1 > prepared part key=_multipart_PVB52GO6L8T4.2~419169WOA05A.0 size=1048576 2024-09-12T00:34:18.694 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.694+0000 7f1f2d864780 1 > prepared part key=_multipart_PVB52GO6L8T4.2~419169WOA05A.1 size=1048576 2024-09-12T00:34:18.695 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.695+0000 7f1f2d864780 1 > prepared part key=_multipart_PVB52GO6L8T4.2~419169WOA05A.2 size=682537 2024-09-12T00:34:18.695 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.695+0000 7f1f2d864780 1 > prepared multipart upload key=PVB52GO6L8T4 upload=419169WOA05A tag=Z2ECAM5DI0AM type=write size=3828265 2024-09-12T00:34:18.696 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.697+0000 7f1f2d864780 1 > prepared operation key=FFG41OYEYFZA tag=EFPB3ND43K3B type=del size=1798015 2024-09-12T00:34:18.698 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.699+0000 7f1f2d864780 1 > prepared part key=_multipart_9XK59MVZ5G1O.2~2RFYOZWV0U6Y.0 size=346069 2024-09-12T00:34:18.698 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.699+0000 7f1f2d864780 1 > prepared multipart upload key=9XK59MVZ5G1O upload=2RFYOZWV0U6Y tag=7IUDPWFBVE9Y type=write size=1394645 2024-09-12T00:34:18.701 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.701+0000 7f1f2d864780 1 > prepared part key=_multipart_GSPM8N0K7ODC.2~4V0HSJQJ9WVM.0 size=1048576 2024-09-12T00:34:18.702 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.702+0000 7f1f2d864780 1 > prepared part key=_multipart_GSPM8N0K7ODC.2~4V0HSJQJ9WVM.1 size=854327 2024-09-12T00:34:18.702 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.702+0000 7f1f2d864780 1 > prepared multipart upload key=GSPM8N0K7ODC upload=4V0HSJQJ9WVM tag=YK60TEZ8PCAX type=write size=2951479 2024-09-12T00:34:18.704 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.705+0000 7f1f2d864780 1 > prepared part key=_multipart_9XK59MVZ5G1O.2~57CH7DSVP6GG.0 size=1048576 2024-09-12T00:34:18.705 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.706+0000 7f1f2d864780 1 > prepared part key=_multipart_9XK59MVZ5G1O.2~57CH7DSVP6GG.1 size=1048576 2024-09-12T00:34:18.706 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.707+0000 7f1f2d864780 1 > prepared part key=_multipart_9XK59MVZ5G1O.2~57CH7DSVP6GG.2 size=328094 2024-09-12T00:34:18.706 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.707+0000 7f1f2d864780 1 > prepared multipart upload key=9XK59MVZ5G1O upload=57CH7DSVP6GG tag=762JE08RT6FY type=write size=3473822 2024-09-12T00:34:18.708 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.708+0000 7f1f2d864780 1 > prepared operation key=9XK59MVZ5G1O tag=B3II6QG1R3GR type=write size=70326 2024-09-12T00:34:18.709 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.710+0000 7f1f2d864780 1 > prepared operation key=MSGU3PHLBRJH tag=6ML0LT2AG806 type=del size=1798217 2024-09-12T00:34:18.710 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.711+0000 7f1f2d864780 1 > prepared operation key=GSPM8N0K7ODC tag=BJ2CADUYA9FN type=del size=2641105 2024-09-12T00:34:18.711 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.712+0000 7f1f2d864780 1 > prepared operation key=2YCGIJRK6MUH tag=MS420BLB5RR2 type=del size=3543299 2024-09-12T00:34:18.713 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.713+0000 7f1f2d864780 1 > prepared operation key=W6U30X4HJCB1 tag=3NAPI5OHPP6T type=write size=769977 2024-09-12T00:34:18.714 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.715+0000 7f1f2d864780 1 < completed delete operation key=1299IOSGYIO9 tag=UI7HIIX109BN type=del 2024-09-12T00:34:18.717 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.717+0000 7f1f2d864780 1 > prepared part key=_multipart_ZGO887JDR627.2~RCJOA75XQSNW.0 size=900325 2024-09-12T00:34:18.717 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.717+0000 7f1f2d864780 1 > prepared multipart upload key=ZGO887JDR627 upload=RCJOA75XQSNW tag=GWABABR7OAE5 type=write size=1948901 2024-09-12T00:34:18.719 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.719+0000 7f1f2d864780 1 < suggested update operation key=W6U30X4HJCB1 tag=IIF8W5H5T43O type=write size=36803 2024-09-12T00:34:18.721 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.722+0000 7f1f2d864780 1 > prepared part key=_multipart_SNCGB6Z20450.2~QV8V06CCK9TH.0 size=478170 2024-09-12T00:34:18.721 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.722+0000 7f1f2d864780 1 > prepared multipart upload key=SNCGB6Z20450 upload=QV8V06CCK9TH tag=P4ZMWX2D089O type=write size=1526746 2024-09-12T00:34:18.722 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.723+0000 7f1f2d864780 1 < completed part key=_multipart_SNCGB6Z20450.2~POP2PQONJ6NU.0 size=1048576 2024-09-12T00:34:18.723 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.724+0000 7f1f2d864780 1 < completed part key=_multipart_SNCGB6Z20450.2~POP2PQONJ6NU.1 size=874622 2024-09-12T00:34:18.726 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.726+0000 7f1f2d864780 1 < completed multipart upload key=SNCGB6Z20450 upload=POP2PQONJ6NU tag=CQ5YJE4UP3VP type=write size=2971774 2024-09-12T00:34:18.728 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.728+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~NKOWTE9IG14K.0 size=229179 2024-09-12T00:34:18.728 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.728+0000 7f1f2d864780 1 > prepared multipart upload key=SZP418NVZ5VX upload=NKOWTE9IG14K tag=SST27GJUS01F type=write size=1277755 2024-09-12T00:34:18.729 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.730+0000 7f1f2d864780 1 < canceled operation key=UTR2UUO6DHLJ tag=0IB84JBEH2XC type=del size=2637480 2024-09-12T00:34:18.730 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.731+0000 7f1f2d864780 1 > prepared operation key=4FRVL0KXN2X8 tag=1ELBOQD7AT0Y type=del size=1544914 2024-09-12T00:34:18.732 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.732+0000 7f1f2d864780 1 < completed part key=_multipart_2RV0899QUJ8W.2~2S5OGFFVJRY7.0 size=1048576 2024-09-12T00:34:18.733 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.733+0000 7f1f2d864780 1 < completed part key=_multipart_2RV0899QUJ8W.2~2S5OGFFVJRY7.1 size=1048576 2024-09-12T00:34:18.734 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.735+0000 7f1f2d864780 1 < completed part key=_multipart_2RV0899QUJ8W.2~2S5OGFFVJRY7.2 size=168678 2024-09-12T00:34:18.736 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.737+0000 7f1f2d864780 1 < completed multipart upload key=2RV0899QUJ8W upload=2S5OGFFVJRY7 tag=18Z96B6G8UIX type=write size=3314406 2024-09-12T00:34:18.738 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.739+0000 7f1f2d864780 1 > prepared part key=_multipart_MSGU3PHLBRJH.2~Q4LYMZZISJ1C.0 size=1048576 2024-09-12T00:34:18.739 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.740+0000 7f1f2d864780 1 > prepared part key=_multipart_MSGU3PHLBRJH.2~Q4LYMZZISJ1C.1 size=875651 2024-09-12T00:34:18.740 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.740+0000 7f1f2d864780 1 > prepared multipart upload key=MSGU3PHLBRJH upload=Q4LYMZZISJ1C tag=12LT7EOZLASC type=write size=2972803 2024-09-12T00:34:18.740 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.740+0000 7f1f2d864780 1 < canceled part key=_multipart_KHPF1N1MT33Z.2~L0V7SMLKRRE8.0 size=1048576 2024-09-12T00:34:18.741 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.742+0000 7f1f2d864780 1 < completed part key=_multipart_KHPF1N1MT33Z.2~L0V7SMLKRRE8.1 size=522282 2024-09-12T00:34:18.743 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.744+0000 7f1f2d864780 1 < canceled multipart upload key=KHPF1N1MT33Z upload=L0V7SMLKRRE8 tag=2N16V8I7LVE9 type=write size=2619434 2024-09-12T00:34:18.744 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.745+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=Y3YTAE2O8DPX type=del size=3219225 2024-09-12T00:34:18.745 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.746+0000 7f1f2d864780 1 < completed part key=_multipart_PVB52GO6L8T4.2~419169WOA05A.0 size=1048576 2024-09-12T00:34:18.746 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.747+0000 7f1f2d864780 1 < completed part key=_multipart_PVB52GO6L8T4.2~419169WOA05A.1 size=1048576 2024-09-12T00:34:18.747 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.748+0000 7f1f2d864780 1 < completed part key=_multipart_PVB52GO6L8T4.2~419169WOA05A.2 size=682537 2024-09-12T00:34:18.749 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.750+0000 7f1f2d864780 1 < completed multipart upload key=PVB52GO6L8T4 upload=419169WOA05A tag=Z2ECAM5DI0AM type=write size=3828265 2024-09-12T00:34:18.751 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.751+0000 7f1f2d864780 1 > prepared operation key=S5DVMA14N7VJ tag=LDR15GKORH6B type=del size=1015707 2024-09-12T00:34:18.752 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.753+0000 7f1f2d864780 1 < canceled operation key=FFG41OYEYFZA tag=EFPB3ND43K3B type=del size=1798015 2024-09-12T00:34:18.754 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.754+0000 7f1f2d864780 1 > prepared operation key=4FRVL0KXN2X8 tag=K1A4ZZHYZOF9 type=del size=1969597 2024-09-12T00:34:18.755 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.756+0000 7f1f2d864780 1 < completed part key=_multipart_9XK59MVZ5G1O.2~2RFYOZWV0U6Y.0 size=346069 2024-09-12T00:34:18.757 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.758+0000 7f1f2d864780 1 < completed multipart upload key=9XK59MVZ5G1O upload=2RFYOZWV0U6Y tag=7IUDPWFBVE9Y type=write size=1394645 2024-09-12T00:34:18.758 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.759+0000 7f1f2d864780 1 > prepared operation key=OY145ZXRSF4L tag=X48Z1AA0Y36E type=del size=786116 2024-09-12T00:34:18.760 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.760+0000 7f1f2d864780 1 < completed part key=_multipart_GSPM8N0K7ODC.2~4V0HSJQJ9WVM.0 size=1048576 2024-09-12T00:34:18.761 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.761+0000 7f1f2d864780 1 < completed part key=_multipart_GSPM8N0K7ODC.2~4V0HSJQJ9WVM.1 size=854327 2024-09-12T00:34:18.762 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.763+0000 7f1f2d864780 1 < completed multipart upload key=GSPM8N0K7ODC upload=4V0HSJQJ9WVM tag=YK60TEZ8PCAX type=write size=2951479 2024-09-12T00:34:18.764 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.764+0000 7f1f2d864780 1 > prepared operation key=D21W9QZWY0YU tag=7V16SW48KI80 type=del size=3861859 2024-09-12T00:34:18.766 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.766+0000 7f1f2d864780 1 < completed part key=_multipart_9XK59MVZ5G1O.2~57CH7DSVP6GG.0 size=1048576 2024-09-12T00:34:18.767 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.767+0000 7f1f2d864780 1 < completed part key=_multipart_9XK59MVZ5G1O.2~57CH7DSVP6GG.1 size=1048576 2024-09-12T00:34:18.767 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.767+0000 7f1f2d864780 1 < canceled part key=_multipart_9XK59MVZ5G1O.2~57CH7DSVP6GG.2 size=328094 2024-09-12T00:34:18.769 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.769+0000 7f1f2d864780 1 < canceled multipart upload key=9XK59MVZ5G1O upload=57CH7DSVP6GG tag=762JE08RT6FY type=write size=3473822 2024-09-12T00:34:18.770 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.770+0000 7f1f2d864780 1 > prepared operation key=GSPM8N0K7ODC tag=NWIDU0PQPN54 type=write size=829017 2024-09-12T00:34:18.771 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.772+0000 7f1f2d864780 1 < completed write operation key=9XK59MVZ5G1O tag=B3II6QG1R3GR type=write size=70326 2024-09-12T00:34:18.772 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.773+0000 7f1f2d864780 1 > prepared operation key=SZP418NVZ5VX tag=579J5B21KV55 type=del size=1935456 2024-09-12T00:34:18.773 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.774+0000 7f1f2d864780 1 < completed delete operation key=MSGU3PHLBRJH tag=6ML0LT2AG806 type=del 2024-09-12T00:34:18.774 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.775+0000 7f1f2d864780 1 > prepared operation key=2G3UCYG4R4NM tag=IYNAK0LT4XKD type=del size=664237 2024-09-12T00:34:18.776 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.776+0000 7f1f2d864780 1 < completed delete operation key=GSPM8N0K7ODC tag=BJ2CADUYA9FN type=del 2024-09-12T00:34:18.777 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.777+0000 7f1f2d864780 1 > prepared operation key=3Z1TGGPZKJ69 tag=YL809GEFBK7R type=write size=399839 2024-09-12T00:34:18.778 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.779+0000 7f1f2d864780 1 < canceled operation key=2YCGIJRK6MUH tag=MS420BLB5RR2 type=del size=3543299 2024-09-12T00:34:18.780 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.781+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~2UUGQZLF2F63.0 size=173456 2024-09-12T00:34:18.780 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.781+0000 7f1f2d864780 1 > prepared multipart upload key=1299IOSGYIO9 upload=2UUGQZLF2F63 tag=9A6JQLURGV3R type=write size=1222032 2024-09-12T00:34:18.782 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.783+0000 7f1f2d864780 1 < suggested remove operation key=W6U30X4HJCB1 tag=3NAPI5OHPP6T type=write 2024-09-12T00:34:18.783 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.784+0000 7f1f2d864780 1 > prepared operation key=DYKLAY6J018G tag=LOD6D9DUFHKC type=write size=151162 2024-09-12T00:34:18.785 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.785+0000 7f1f2d864780 1 < completed part key=_multipart_ZGO887JDR627.2~RCJOA75XQSNW.0 size=900325 2024-09-12T00:34:18.786 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.787+0000 7f1f2d864780 1 < completed multipart upload key=ZGO887JDR627 upload=RCJOA75XQSNW tag=GWABABR7OAE5 type=write size=1948901 2024-09-12T00:34:18.787 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.788+0000 7f1f2d864780 1 > prepared operation key=FFG41OYEYFZA tag=4ZSPM8D3WY49 type=del size=788611 2024-09-12T00:34:18.789 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.789+0000 7f1f2d864780 1 < completed part key=_multipart_SNCGB6Z20450.2~QV8V06CCK9TH.0 size=478170 2024-09-12T00:34:18.791 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.791+0000 7f1f2d864780 1 < completed multipart upload key=SNCGB6Z20450 upload=QV8V06CCK9TH tag=P4ZMWX2D089O type=write size=1526746 2024-09-12T00:34:18.792 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.792+0000 7f1f2d864780 1 > prepared operation key=AN26EVAZI527 tag=PKCYMHYE44M0 type=write size=998552 2024-09-12T00:34:18.793 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.794+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~NKOWTE9IG14K.0 size=229179 2024-09-12T00:34:18.795 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.795+0000 7f1f2d864780 1 < completed multipart upload key=SZP418NVZ5VX upload=NKOWTE9IG14K tag=SST27GJUS01F type=write size=1277755 2024-09-12T00:34:18.797 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.797+0000 7f1f2d864780 1 > prepared part key=_multipart_KHPF1N1MT33Z.2~7Y4IGCUWB2M4.0 size=1048576 2024-09-12T00:34:18.798 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.798+0000 7f1f2d864780 1 > prepared part key=_multipart_KHPF1N1MT33Z.2~7Y4IGCUWB2M4.1 size=1048576 2024-09-12T00:34:18.799 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.799+0000 7f1f2d864780 1 > prepared part key=_multipart_KHPF1N1MT33Z.2~7Y4IGCUWB2M4.2 size=859739 2024-09-12T00:34:18.799 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.799+0000 7f1f2d864780 1 > prepared multipart upload key=KHPF1N1MT33Z upload=7Y4IGCUWB2M4 tag=JWBU952RZV6R type=write size=4005467 2024-09-12T00:34:18.800 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.801+0000 7f1f2d864780 1 < completed delete operation key=4FRVL0KXN2X8 tag=1ELBOQD7AT0Y type=del 2024-09-12T00:34:18.802 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.802+0000 7f1f2d864780 1 > prepared operation key=D21W9QZWY0YU tag=GV9U7MCTF30H type=write size=466978 2024-09-12T00:34:18.803 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.804+0000 7f1f2d864780 1 < completed part key=_multipart_MSGU3PHLBRJH.2~Q4LYMZZISJ1C.0 size=1048576 2024-09-12T00:34:18.806 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.806+0000 7f1f2d864780 1 < completed part key=_multipart_MSGU3PHLBRJH.2~Q4LYMZZISJ1C.1 size=875651 2024-09-12T00:34:18.808 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.808+0000 7f1f2d864780 1 < completed multipart upload key=MSGU3PHLBRJH upload=Q4LYMZZISJ1C tag=12LT7EOZLASC type=write size=2972803 2024-09-12T00:34:18.810 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.810+0000 7f1f2d864780 1 > prepared part key=_multipart_FFG41OYEYFZA.2~90LZ4M9J1XWG.0 size=403658 2024-09-12T00:34:18.810 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.810+0000 7f1f2d864780 1 > prepared multipart upload key=FFG41OYEYFZA upload=90LZ4M9J1XWG tag=V6GX75GRHL7R type=write size=1452234 2024-09-12T00:34:18.811 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.811+0000 7f1f2d864780 1 < completed delete operation key=2RV0899QUJ8W tag=Y3YTAE2O8DPX type=del 2024-09-12T00:34:18.812 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.812+0000 7f1f2d864780 1 > prepared operation key=WIIU8VTCLWOD tag=FCF0XUXJASB0 type=write size=556294 2024-09-12T00:34:18.813 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.814+0000 7f1f2d864780 1 < completed delete operation key=S5DVMA14N7VJ tag=LDR15GKORH6B type=del 2024-09-12T00:34:18.815 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.816+0000 7f1f2d864780 1 > prepared part key=_multipart_S5DVMA14N7VJ.2~OP1PHSOTBAX1.0 size=1048576 2024-09-12T00:34:18.816 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.816+0000 7f1f2d864780 1 > prepared part key=_multipart_S5DVMA14N7VJ.2~OP1PHSOTBAX1.1 size=158780 2024-09-12T00:34:18.816 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.816+0000 7f1f2d864780 1 > prepared multipart upload key=S5DVMA14N7VJ upload=OP1PHSOTBAX1 tag=ZXJ1MHJHG9PF type=write size=2255932 2024-09-12T00:34:18.817 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.818+0000 7f1f2d864780 1 < canceled operation key=4FRVL0KXN2X8 tag=K1A4ZZHYZOF9 type=del size=1969597 2024-09-12T00:34:18.818 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.819+0000 7f1f2d864780 1 > prepared operation key=FFG41OYEYFZA tag=R8OPKHKWHEXJ type=write size=32886 2024-09-12T00:34:18.819 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.820+0000 7f1f2d864780 1 < completed delete operation key=OY145ZXRSF4L tag=X48Z1AA0Y36E type=del 2024-09-12T00:34:18.821 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.822+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~IAMBJE586N5B.0 size=1048576 2024-09-12T00:34:18.822 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.823+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~IAMBJE586N5B.1 size=268902 2024-09-12T00:34:18.822 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.823+0000 7f1f2d864780 1 > prepared multipart upload key=W6U30X4HJCB1 upload=IAMBJE586N5B tag=HPSSCUIFKOKA type=write size=2366054 2024-09-12T00:34:18.823 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.824+0000 7f1f2d864780 1 < completed delete operation key=D21W9QZWY0YU tag=7V16SW48KI80 type=del 2024-09-12T00:34:18.824 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.825+0000 7f1f2d864780 1 > prepared operation key=WGKEA4EKF5GP tag=BS0MCBJ1ZPLT type=del size=2684228 2024-09-12T00:34:18.828 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.826+0000 7f1f2d864780 1 < completed write operation key=GSPM8N0K7ODC tag=NWIDU0PQPN54 type=write size=829017 2024-09-12T00:34:18.829 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.828+0000 7f1f2d864780 1 > prepared part key=_multipart_ECZYQEZ942W8.2~3IMZ2WPW521W.0 size=1048576 2024-09-12T00:34:18.829 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.829+0000 7f1f2d864780 1 > prepared part key=_multipart_ECZYQEZ942W8.2~3IMZ2WPW521W.1 size=828827 2024-09-12T00:34:18.829 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.829+0000 7f1f2d864780 1 > prepared multipart upload key=ECZYQEZ942W8 upload=3IMZ2WPW521W tag=5ZSN2ZUT6MKQ type=write size=2925979 2024-09-12T00:34:18.830 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.830+0000 7f1f2d864780 1 < completed delete operation key=SZP418NVZ5VX tag=579J5B21KV55 type=del 2024-09-12T00:34:18.831 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.832+0000 7f1f2d864780 1 > prepared operation key=2YCGIJRK6MUH tag=UGPNVTE3Z9QH type=del size=1322546 2024-09-12T00:34:18.833 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.834+0000 7f1f2d864780 1 < suggested remove operation key=2G3UCYG4R4NM tag=IYNAK0LT4XKD type=del 2024-09-12T00:34:18.834 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.835+0000 7f1f2d864780 1 > prepared operation key=MSGU3PHLBRJH tag=OQEETB8PIXIT type=del size=1328717 2024-09-12T00:34:18.836 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.836+0000 7f1f2d864780 1 < completed write operation key=3Z1TGGPZKJ69 tag=YL809GEFBK7R type=write size=399839 2024-09-12T00:34:18.837 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.837+0000 7f1f2d864780 1 > prepared operation key=3Z1TGGPZKJ69 tag=9GGR250TQ9RB type=write size=427668 2024-09-12T00:34:18.838 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.839+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~2UUGQZLF2F63.0 size=173456 2024-09-12T00:34:18.840 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.840+0000 7f1f2d864780 1 < completed multipart upload key=1299IOSGYIO9 upload=2UUGQZLF2F63 tag=9A6JQLURGV3R type=write size=1222032 2024-09-12T00:34:18.842 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.843+0000 7f1f2d864780 1 > prepared part key=_multipart_2RV0899QUJ8W.2~L8BKMG3CJ09X.0 size=450950 2024-09-12T00:34:18.842 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.843+0000 7f1f2d864780 1 > prepared multipart upload key=2RV0899QUJ8W upload=L8BKMG3CJ09X tag=9KRS91R46W71 type=write size=1499526 2024-09-12T00:34:18.843 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.844+0000 7f1f2d864780 1 < canceled operation key=DYKLAY6J018G tag=LOD6D9DUFHKC type=write size=151162 2024-09-12T00:34:18.845 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.846+0000 7f1f2d864780 1 > prepared part key=_multipart_SNCGB6Z20450.2~7TKXSJ05GROY.0 size=1048576 2024-09-12T00:34:18.846 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.847+0000 7f1f2d864780 1 > prepared part key=_multipart_SNCGB6Z20450.2~7TKXSJ05GROY.1 size=544829 2024-09-12T00:34:18.846 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.847+0000 7f1f2d864780 1 > prepared multipart upload key=SNCGB6Z20450 upload=7TKXSJ05GROY tag=4RD30GPQRM1R type=write size=2641981 2024-09-12T00:34:18.848 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.848+0000 7f1f2d864780 1 < canceled operation key=FFG41OYEYFZA tag=4ZSPM8D3WY49 type=del size=788611 2024-09-12T00:34:18.850 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.850+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~9ARAYTWC1U21.0 size=1048576 2024-09-12T00:34:18.851 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.851+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~9ARAYTWC1U21.1 size=627260 2024-09-12T00:34:18.851 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.851+0000 7f1f2d864780 1 > prepared multipart upload key=4FRVL0KXN2X8 upload=9ARAYTWC1U21 tag=F099FGH6J4XS type=write size=2724412 2024-09-12T00:34:18.852 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.852+0000 7f1f2d864780 1 < completed write operation key=AN26EVAZI527 tag=PKCYMHYE44M0 type=write size=998552 2024-09-12T00:34:18.853 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.854+0000 7f1f2d864780 1 > prepared operation key=W6U30X4HJCB1 tag=XLEBE705XKYN type=del size=3391218 2024-09-12T00:34:18.859 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.855+0000 7f1f2d864780 1 < completed part key=_multipart_KHPF1N1MT33Z.2~7Y4IGCUWB2M4.0 size=1048576 2024-09-12T00:34:18.859 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.855+0000 7f1f2d864780 1 < canceled part key=_multipart_KHPF1N1MT33Z.2~7Y4IGCUWB2M4.1 size=1048576 2024-09-12T00:34:18.859 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.856+0000 7f1f2d864780 1 < completed part key=_multipart_KHPF1N1MT33Z.2~7Y4IGCUWB2M4.2 size=859739 2024-09-12T00:34:18.859 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.858+0000 7f1f2d864780 1 < canceled multipart upload key=KHPF1N1MT33Z upload=7Y4IGCUWB2M4 tag=JWBU952RZV6R type=write size=4005467 2024-09-12T00:34:18.859 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.860+0000 7f1f2d864780 1 > prepared part key=_multipart_3Z1TGGPZKJ69.2~OG9Q02N142KT.0 size=1048576 2024-09-12T00:34:18.860 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.861+0000 7f1f2d864780 1 > prepared part key=_multipart_3Z1TGGPZKJ69.2~OG9Q02N142KT.1 size=1048576 2024-09-12T00:34:18.861 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.862+0000 7f1f2d864780 1 > prepared part key=_multipart_3Z1TGGPZKJ69.2~OG9Q02N142KT.2 size=794603 2024-09-12T00:34:18.861 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.862+0000 7f1f2d864780 1 > prepared multipart upload key=3Z1TGGPZKJ69 upload=OG9Q02N142KT tag=JJXKE0DQ15LO type=write size=3940331 2024-09-12T00:34:18.862 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.863+0000 7f1f2d864780 1 < completed write operation key=D21W9QZWY0YU tag=GV9U7MCTF30H type=write size=466978 2024-09-12T00:34:18.865 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.865+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~UAZTC7ZUNHLF.0 size=1048576 2024-09-12T00:34:18.866 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.866+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~UAZTC7ZUNHLF.1 size=323594 2024-09-12T00:34:18.866 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.866+0000 7f1f2d864780 1 > prepared multipart upload key=FAP6N3H7SBN0 upload=UAZTC7ZUNHLF tag=FQV5KQ8FLO8U type=write size=2420746 2024-09-12T00:34:18.867 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.868+0000 7f1f2d864780 1 < completed part key=_multipart_FFG41OYEYFZA.2~90LZ4M9J1XWG.0 size=403658 2024-09-12T00:34:18.869 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.870+0000 7f1f2d864780 1 < completed multipart upload key=FFG41OYEYFZA upload=90LZ4M9J1XWG tag=V6GX75GRHL7R type=write size=1452234 2024-09-12T00:34:18.870 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.871+0000 7f1f2d864780 1 > prepared operation key=DYKLAY6J018G tag=IXO4FVCF7JVI type=del size=3557739 2024-09-12T00:34:18.871 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.872+0000 7f1f2d864780 1 < completed write operation key=WIIU8VTCLWOD tag=FCF0XUXJASB0 type=write size=556294 2024-09-12T00:34:18.873 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.874+0000 7f1f2d864780 1 > prepared part key=_multipart_GSPM8N0K7ODC.2~HI3A99LPE4BM.0 size=1048576 2024-09-12T00:34:18.874 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.875+0000 7f1f2d864780 1 > prepared part key=_multipart_GSPM8N0K7ODC.2~HI3A99LPE4BM.1 size=569650 2024-09-12T00:34:18.874 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.875+0000 7f1f2d864780 1 > prepared multipart upload key=GSPM8N0K7ODC upload=HI3A99LPE4BM tag=3D41MTUM2S71 type=write size=2666802 2024-09-12T00:34:18.876 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.876+0000 7f1f2d864780 1 < completed part key=_multipart_S5DVMA14N7VJ.2~OP1PHSOTBAX1.0 size=1048576 2024-09-12T00:34:18.876 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.876+0000 7f1f2d864780 1 < canceled part key=_multipart_S5DVMA14N7VJ.2~OP1PHSOTBAX1.1 size=158780 2024-09-12T00:34:18.878 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.878+0000 7f1f2d864780 1 < canceled multipart upload key=S5DVMA14N7VJ upload=OP1PHSOTBAX1 tag=ZXJ1MHJHG9PF type=write size=2255932 2024-09-12T00:34:18.880 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.880+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~3JKTU5AQPC6U.0 size=1048576 2024-09-12T00:34:18.881 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.881+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~3JKTU5AQPC6U.1 size=134885 2024-09-12T00:34:18.881 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.881+0000 7f1f2d864780 1 > prepared multipart upload key=SZP418NVZ5VX upload=3JKTU5AQPC6U tag=MC2SMVUBOJ7G type=write size=2232037 2024-09-12T00:34:18.882 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.882+0000 7f1f2d864780 1 < completed write operation key=FFG41OYEYFZA tag=R8OPKHKWHEXJ type=write size=32886 2024-09-12T00:34:18.883 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.884+0000 7f1f2d864780 1 > prepared operation key=SNCGB6Z20450 tag=VTOGDH3UUB64 type=write size=410375 2024-09-12T00:34:18.884 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.885+0000 7f1f2d864780 1 < completed part key=_multipart_W6U30X4HJCB1.2~IAMBJE586N5B.0 size=1048576 2024-09-12T00:34:18.885 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.886+0000 7f1f2d864780 1 < completed part key=_multipart_W6U30X4HJCB1.2~IAMBJE586N5B.1 size=268902 2024-09-12T00:34:18.887 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.888+0000 7f1f2d864780 1 < completed multipart upload key=W6U30X4HJCB1 upload=IAMBJE586N5B tag=HPSSCUIFKOKA type=write size=2366054 2024-09-12T00:34:18.888 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.889+0000 7f1f2d864780 1 > prepared operation key=2G3UCYG4R4NM tag=9DU46HXLFEW9 type=write size=438828 2024-09-12T00:34:18.889 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.890+0000 7f1f2d864780 1 < completed delete operation key=WGKEA4EKF5GP tag=BS0MCBJ1ZPLT type=del 2024-09-12T00:34:18.892 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.892+0000 7f1f2d864780 1 > prepared part key=_multipart_WIIU8VTCLWOD.2~D52WPITZFRE3.0 size=496407 2024-09-12T00:34:18.892 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.892+0000 7f1f2d864780 1 > prepared multipart upload key=WIIU8VTCLWOD upload=D52WPITZFRE3 tag=U6BJ9PESL3UB type=write size=1544983 2024-09-12T00:34:18.893 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.893+0000 7f1f2d864780 1 < completed part key=_multipart_ECZYQEZ942W8.2~3IMZ2WPW521W.0 size=1048576 2024-09-12T00:34:18.893 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.893+0000 7f1f2d864780 1 < canceled part key=_multipart_ECZYQEZ942W8.2~3IMZ2WPW521W.1 size=828827 2024-09-12T00:34:18.895 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.895+0000 7f1f2d864780 1 < canceled multipart upload key=ECZYQEZ942W8 upload=3IMZ2WPW521W tag=5ZSN2ZUT6MKQ type=write size=2925979 2024-09-12T00:34:18.897 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.897+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~D48DOMGHE1E0.0 size=681040 2024-09-12T00:34:18.897 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.897+0000 7f1f2d864780 1 > prepared multipart upload key=4FRVL0KXN2X8 upload=D48DOMGHE1E0 tag=MD8G9Y63IZZO type=write size=1729616 2024-09-12T00:34:18.899 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.900+0000 7f1f2d864780 1 < suggested remove operation key=2YCGIJRK6MUH tag=UGPNVTE3Z9QH type=del 2024-09-12T00:34:18.900 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.901+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=GXD543CXPMVW type=del size=340607 2024-09-12T00:34:18.902 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.903+0000 7f1f2d864780 1 < suggested update operation key=MSGU3PHLBRJH tag=OQEETB8PIXIT type=del size=1328717 2024-09-12T00:34:18.905 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.905+0000 7f1f2d864780 1 > prepared part key=_multipart_SNCGB6Z20450.2~LT53HZWZ5238.0 size=1048576 2024-09-12T00:34:18.905 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.906+0000 7f1f2d864780 1 > prepared part key=_multipart_SNCGB6Z20450.2~LT53HZWZ5238.1 size=1048576 2024-09-12T00:34:18.906 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.907+0000 7f1f2d864780 1 > prepared part key=_multipart_SNCGB6Z20450.2~LT53HZWZ5238.2 size=720275 2024-09-12T00:34:18.907 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.907+0000 7f1f2d864780 1 > prepared multipart upload key=SNCGB6Z20450 upload=LT53HZWZ5238 tag=FINY2FB456YM type=write size=3866003 2024-09-12T00:34:18.909 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.909+0000 7f1f2d864780 1 < suggested remove operation key=3Z1TGGPZKJ69 tag=9GGR250TQ9RB type=write 2024-09-12T00:34:18.912 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.912+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~JR865HWT6U9O.0 size=1048576 2024-09-12T00:34:18.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.915+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~JR865HWT6U9O.1 size=633622 2024-09-12T00:34:18.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.915+0000 7f1f2d864780 1 > prepared multipart upload key=W6U30X4HJCB1 upload=JR865HWT6U9O tag=UUPCPCK78IXK type=write size=2730774 2024-09-12T00:34:18.916 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.916+0000 7f1f2d864780 1 < completed part key=_multipart_2RV0899QUJ8W.2~L8BKMG3CJ09X.0 size=450950 2024-09-12T00:34:18.918 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.919+0000 7f1f2d864780 1 < completed multipart upload key=2RV0899QUJ8W upload=L8BKMG3CJ09X tag=9KRS91R46W71 type=write size=1499526 2024-09-12T00:34:18.919 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.920+0000 7f1f2d864780 1 > prepared operation key=OY145ZXRSF4L tag=Z7MZV7JVY9AC type=del size=327140 2024-09-12T00:34:18.920 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.921+0000 7f1f2d864780 1 < completed part key=_multipart_SNCGB6Z20450.2~7TKXSJ05GROY.0 size=1048576 2024-09-12T00:34:18.921 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.922+0000 7f1f2d864780 1 < completed part key=_multipart_SNCGB6Z20450.2~7TKXSJ05GROY.1 size=544829 2024-09-12T00:34:18.923 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.924+0000 7f1f2d864780 1 < completed multipart upload key=SNCGB6Z20450 upload=7TKXSJ05GROY tag=4RD30GPQRM1R type=write size=2641981 2024-09-12T00:34:18.925 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.926+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~PTHE2AHCDVWM.0 size=1048576 2024-09-12T00:34:18.926 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.927+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~PTHE2AHCDVWM.1 size=1048576 2024-09-12T00:34:18.927 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.928+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~PTHE2AHCDVWM.2 size=929841 2024-09-12T00:34:18.927 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.928+0000 7f1f2d864780 1 > prepared multipart upload key=0DSQOFS8IIF5 upload=PTHE2AHCDVWM tag=NLN16H3M9LU5 type=write size=4075569 2024-09-12T00:34:18.928 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.929+0000 7f1f2d864780 1 < completed part key=_multipart_4FRVL0KXN2X8.2~9ARAYTWC1U21.0 size=1048576 2024-09-12T00:34:18.929 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.930+0000 7f1f2d864780 1 < completed part key=_multipart_4FRVL0KXN2X8.2~9ARAYTWC1U21.1 size=627260 2024-09-12T00:34:18.931 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.932+0000 7f1f2d864780 1 < completed multipart upload key=4FRVL0KXN2X8 upload=9ARAYTWC1U21 tag=F099FGH6J4XS type=write size=2724412 2024-09-12T00:34:18.933 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.934+0000 7f1f2d864780 1 > prepared part key=_multipart_2YCGIJRK6MUH.2~37HBSEH3SWV5.0 size=99202 2024-09-12T00:34:18.933 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.934+0000 7f1f2d864780 1 > prepared multipart upload key=2YCGIJRK6MUH upload=37HBSEH3SWV5 tag=J1W1F9HLM3QO type=write size=1147778 2024-09-12T00:34:18.937 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.937+0000 7f1f2d864780 1 < suggested remove operation key=W6U30X4HJCB1 tag=XLEBE705XKYN type=del 2024-09-12T00:34:18.939 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.939+0000 7f1f2d864780 1 > prepared part key=_multipart_PVB52GO6L8T4.2~MCEJ50XFTXBN.0 size=68459 2024-09-12T00:34:18.939 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.939+0000 7f1f2d864780 1 > prepared multipart upload key=PVB52GO6L8T4 upload=MCEJ50XFTXBN tag=POU7PRDNJK1Y type=write size=1117035 2024-09-12T00:34:18.940 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.941+0000 7f1f2d864780 1 < completed part key=_multipart_3Z1TGGPZKJ69.2~OG9Q02N142KT.0 size=1048576 2024-09-12T00:34:18.940 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.941+0000 7f1f2d864780 1 < canceled part key=_multipart_3Z1TGGPZKJ69.2~OG9Q02N142KT.1 size=1048576 2024-09-12T00:34:18.941 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.941+0000 7f1f2d864780 1 < completed part key=_multipart_3Z1TGGPZKJ69.2~OG9Q02N142KT.2 size=794603 2024-09-12T00:34:18.943 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.943+0000 7f1f2d864780 1 < canceled multipart upload key=3Z1TGGPZKJ69 upload=OG9Q02N142KT tag=JJXKE0DQ15LO type=write size=3940331 2024-09-12T00:34:18.945 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.945+0000 7f1f2d864780 1 > prepared part key=_multipart_3Z1TGGPZKJ69.2~3QG10BA606ET.0 size=1048576 2024-09-12T00:34:18.946 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.946+0000 7f1f2d864780 1 > prepared part key=_multipart_3Z1TGGPZKJ69.2~3QG10BA606ET.1 size=295985 2024-09-12T00:34:18.946 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.946+0000 7f1f2d864780 1 > prepared multipart upload key=3Z1TGGPZKJ69 upload=3QG10BA606ET tag=0VDIUPBDRAGU type=write size=2393137 2024-09-12T00:34:18.947 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.947+0000 7f1f2d864780 1 < completed part key=_multipart_FAP6N3H7SBN0.2~UAZTC7ZUNHLF.0 size=1048576 2024-09-12T00:34:18.948 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.949+0000 7f1f2d864780 1 < completed part key=_multipart_FAP6N3H7SBN0.2~UAZTC7ZUNHLF.1 size=323594 2024-09-12T00:34:18.950 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.951+0000 7f1f2d864780 1 < completed multipart upload key=FAP6N3H7SBN0 upload=UAZTC7ZUNHLF tag=FQV5KQ8FLO8U type=write size=2420746 2024-09-12T00:34:18.952 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.953+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~XX5JZE0762SF.0 size=520918 2024-09-12T00:34:18.952 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.953+0000 7f1f2d864780 1 > prepared multipart upload key=1299IOSGYIO9 upload=XX5JZE0762SF tag=FLG0KXFUNYM5 type=write size=1569494 2024-09-12T00:34:18.953 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.954+0000 7f1f2d864780 1 < completed delete operation key=DYKLAY6J018G tag=IXO4FVCF7JVI type=del 2024-09-12T00:34:18.955 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.956+0000 7f1f2d864780 1 > prepared part key=_multipart_N9RQIGHVL8VP.2~34BVYW4EUQHV.0 size=152467 2024-09-12T00:34:18.956 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.956+0000 7f1f2d864780 1 > prepared multipart upload key=N9RQIGHVL8VP upload=34BVYW4EUQHV tag=XQEKUE9MD8KF type=write size=1201043 2024-09-12T00:34:18.957 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.957+0000 7f1f2d864780 1 < completed part key=_multipart_GSPM8N0K7ODC.2~HI3A99LPE4BM.0 size=1048576 2024-09-12T00:34:18.958 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.958+0000 7f1f2d864780 1 < completed part key=_multipart_GSPM8N0K7ODC.2~HI3A99LPE4BM.1 size=569650 2024-09-12T00:34:18.959 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.960+0000 7f1f2d864780 1 < completed multipart upload key=GSPM8N0K7ODC upload=HI3A99LPE4BM tag=3D41MTUM2S71 type=write size=2666802 2024-09-12T00:34:18.961 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.961+0000 7f1f2d864780 1 > prepared operation key=PVB52GO6L8T4 tag=A69I1VNMAS8N type=del size=1332896 2024-09-12T00:34:18.962 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.962+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~3JKTU5AQPC6U.0 size=1048576 2024-09-12T00:34:18.963 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.963+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~3JKTU5AQPC6U.1 size=134885 2024-09-12T00:34:18.965 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.965+0000 7f1f2d864780 1 < completed multipart upload key=SZP418NVZ5VX upload=3JKTU5AQPC6U tag=MC2SMVUBOJ7G type=write size=2232037 2024-09-12T00:34:18.966 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.966+0000 7f1f2d864780 1 > prepared operation key=GSPM8N0K7ODC tag=7ZA2LHM96GA1 type=del size=742990 2024-09-12T00:34:18.967 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.968+0000 7f1f2d864780 1 < completed write operation key=SNCGB6Z20450 tag=VTOGDH3UUB64 type=write size=410375 2024-09-12T00:34:18.969 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.970+0000 7f1f2d864780 1 > prepared part key=_multipart_PVB52GO6L8T4.2~HIULSPNGTLIN.0 size=627478 2024-09-12T00:34:18.969 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.970+0000 7f1f2d864780 1 > prepared multipart upload key=PVB52GO6L8T4 upload=HIULSPNGTLIN tag=01EUJKHJS33G type=write size=1676054 2024-09-12T00:34:18.971 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.971+0000 7f1f2d864780 1 < completed write operation key=2G3UCYG4R4NM tag=9DU46HXLFEW9 type=write size=438828 2024-09-12T00:34:18.973 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.973+0000 7f1f2d864780 1 > prepared part key=_multipart_GSPM8N0K7ODC.2~WGYFQIWT4ULN.0 size=87037 2024-09-12T00:34:18.973 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.973+0000 7f1f2d864780 1 > prepared multipart upload key=GSPM8N0K7ODC upload=WGYFQIWT4ULN tag=4XXK61RRG4MQ type=write size=1135613 2024-09-12T00:34:18.974 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.974+0000 7f1f2d864780 1 < completed part key=_multipart_WIIU8VTCLWOD.2~D52WPITZFRE3.0 size=496407 2024-09-12T00:34:18.976 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.976+0000 7f1f2d864780 1 < completed multipart upload key=WIIU8VTCLWOD upload=D52WPITZFRE3 tag=U6BJ9PESL3UB type=write size=1544983 2024-09-12T00:34:18.977 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.977+0000 7f1f2d864780 1 > prepared operation key=FAP6N3H7SBN0 tag=FBE2LWFMKU1K type=del size=3060701 2024-09-12T00:34:18.978 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.979+0000 7f1f2d864780 1 < completed part key=_multipart_4FRVL0KXN2X8.2~D48DOMGHE1E0.0 size=681040 2024-09-12T00:34:18.980 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.980+0000 7f1f2d864780 1 < completed multipart upload key=4FRVL0KXN2X8 upload=D48DOMGHE1E0 tag=MD8G9Y63IZZO type=write size=1729616 2024-09-12T00:34:18.981 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.982+0000 7f1f2d864780 1 > prepared operation key=2YCGIJRK6MUH tag=TJ8W40C2OKDK type=del size=1868503 2024-09-12T00:34:18.982 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.983+0000 7f1f2d864780 1 < completed delete operation key=2RV0899QUJ8W tag=GXD543CXPMVW type=del 2024-09-12T00:34:18.983 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.984+0000 7f1f2d864780 1 > prepared operation key=W6U30X4HJCB1 tag=H1K9XVBYXK80 type=write size=1039343 2024-09-12T00:34:18.985 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.985+0000 7f1f2d864780 1 < completed part key=_multipart_SNCGB6Z20450.2~LT53HZWZ5238.0 size=1048576 2024-09-12T00:34:18.985 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.986+0000 7f1f2d864780 1 < completed part key=_multipart_SNCGB6Z20450.2~LT53HZWZ5238.1 size=1048576 2024-09-12T00:34:18.987 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.987+0000 7f1f2d864780 1 < completed part key=_multipart_SNCGB6Z20450.2~LT53HZWZ5238.2 size=720275 2024-09-12T00:34:18.988 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.989+0000 7f1f2d864780 1 < completed multipart upload key=SNCGB6Z20450 upload=LT53HZWZ5238 tag=FINY2FB456YM type=write size=3866003 2024-09-12T00:34:18.990 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.990+0000 7f1f2d864780 1 > prepared operation key=FFG41OYEYFZA tag=CKD9SYWSS7H8 type=del size=1745341 2024-09-12T00:34:18.990 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.990+0000 7f1f2d864780 1 < canceled part key=_multipart_W6U30X4HJCB1.2~JR865HWT6U9O.0 size=1048576 2024-09-12T00:34:18.991 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.991+0000 7f1f2d864780 1 < completed part key=_multipart_W6U30X4HJCB1.2~JR865HWT6U9O.1 size=633622 2024-09-12T00:34:18.993 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.993+0000 7f1f2d864780 1 < canceled multipart upload key=W6U30X4HJCB1 upload=JR865HWT6U9O tag=UUPCPCK78IXK type=write size=2730774 2024-09-12T00:34:18.994 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.995+0000 7f1f2d864780 1 > prepared operation key=UTR2UUO6DHLJ tag=9U6KXWMY5V7B type=del size=1775538 2024-09-12T00:34:18.995 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.996+0000 7f1f2d864780 1 < completed delete operation key=OY145ZXRSF4L tag=Z7MZV7JVY9AC type=del 2024-09-12T00:34:18.996 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.997+0000 7f1f2d864780 1 > prepared operation key=DYKLAY6J018G tag=S1V4HL202EOP type=del size=1898608 2024-09-12T00:34:18.996 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.997+0000 7f1f2d864780 1 < canceled part key=_multipart_0DSQOFS8IIF5.2~PTHE2AHCDVWM.0 size=1048576 2024-09-12T00:34:18.997 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.998+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~PTHE2AHCDVWM.1 size=1048576 2024-09-12T00:34:18.998 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:18.999+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~PTHE2AHCDVWM.2 size=929841 2024-09-12T00:34:19.000 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.000+0000 7f1f2d864780 1 < canceled multipart upload key=0DSQOFS8IIF5 upload=PTHE2AHCDVWM tag=NLN16H3M9LU5 type=write size=4075569 2024-09-12T00:34:19.002 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.003+0000 7f1f2d864780 1 > prepared part key=_multipart_PVB52GO6L8T4.2~5P15Z8BQ6J29.0 size=91478 2024-09-12T00:34:19.002 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.003+0000 7f1f2d864780 1 > prepared multipart upload key=PVB52GO6L8T4 upload=5P15Z8BQ6J29 tag=ZE5BN9GCPKO5 type=write size=1140054 2024-09-12T00:34:19.003 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.004+0000 7f1f2d864780 1 < completed part key=_multipart_2YCGIJRK6MUH.2~37HBSEH3SWV5.0 size=99202 2024-09-12T00:34:19.005 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.006+0000 7f1f2d864780 1 < completed multipart upload key=2YCGIJRK6MUH upload=37HBSEH3SWV5 tag=J1W1F9HLM3QO type=write size=1147778 2024-09-12T00:34:19.007 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.008+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~HJPHEFB5LSWK.0 size=1048576 2024-09-12T00:34:19.008 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.008+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~HJPHEFB5LSWK.1 size=114909 2024-09-12T00:34:19.008 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.008+0000 7f1f2d864780 1 > prepared multipart upload key=0DSQOFS8IIF5 upload=HJPHEFB5LSWK tag=F26TFNCTS1SR type=write size=2212061 2024-09-12T00:34:19.009 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.010+0000 7f1f2d864780 1 < completed part key=_multipart_PVB52GO6L8T4.2~MCEJ50XFTXBN.0 size=68459 2024-09-12T00:34:19.011 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.011+0000 7f1f2d864780 1 < completed multipart upload key=PVB52GO6L8T4 upload=MCEJ50XFTXBN tag=POU7PRDNJK1Y type=write size=1117035 2024-09-12T00:34:19.013 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.014+0000 7f1f2d864780 1 > prepared part key=_multipart_2YCGIJRK6MUH.2~YGIT15146YJ8.0 size=989158 2024-09-12T00:34:19.013 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.014+0000 7f1f2d864780 1 > prepared multipart upload key=2YCGIJRK6MUH upload=YGIT15146YJ8 tag=94IFO66XZWMW type=write size=2037734 2024-09-12T00:34:19.014 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.015+0000 7f1f2d864780 1 < completed part key=_multipart_3Z1TGGPZKJ69.2~3QG10BA606ET.0 size=1048576 2024-09-12T00:34:19.015 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.016+0000 7f1f2d864780 1 < completed part key=_multipart_3Z1TGGPZKJ69.2~3QG10BA606ET.1 size=295985 2024-09-12T00:34:19.017 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.018+0000 7f1f2d864780 1 < completed multipart upload key=3Z1TGGPZKJ69 upload=3QG10BA606ET tag=0VDIUPBDRAGU type=write size=2393137 2024-09-12T00:34:19.021 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.021+0000 7f1f2d864780 1 > prepared part key=_multipart_ZGO887JDR627.2~40QB5AXLQ3FK.0 size=622874 2024-09-12T00:34:19.021 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.021+0000 7f1f2d864780 1 > prepared multipart upload key=ZGO887JDR627 upload=40QB5AXLQ3FK tag=7PC9NHJZCG1U type=write size=1671450 2024-09-12T00:34:19.021 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.022+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~XX5JZE0762SF.0 size=520918 2024-09-12T00:34:19.023 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.024+0000 7f1f2d864780 1 < completed multipart upload key=1299IOSGYIO9 upload=XX5JZE0762SF tag=FLG0KXFUNYM5 type=write size=1569494 2024-09-12T00:34:19.024 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.025+0000 7f1f2d864780 1 > prepared operation key=WIIU8VTCLWOD tag=49L2O1BUN15B type=write size=915973 2024-09-12T00:34:19.025 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.026+0000 7f1f2d864780 1 < completed part key=_multipart_N9RQIGHVL8VP.2~34BVYW4EUQHV.0 size=152467 2024-09-12T00:34:19.027 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.028+0000 7f1f2d864780 1 < completed multipart upload key=N9RQIGHVL8VP upload=34BVYW4EUQHV tag=XQEKUE9MD8KF type=write size=1201043 2024-09-12T00:34:19.030 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.030+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~XBF3JOHUMZIG.0 size=1048576 2024-09-12T00:34:19.031 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.031+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~XBF3JOHUMZIG.1 size=97442 2024-09-12T00:34:19.031 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.031+0000 7f1f2d864780 1 > prepared multipart upload key=0DSQOFS8IIF5 upload=XBF3JOHUMZIG tag=VN9PQK7C0RPL type=write size=2194594 2024-09-12T00:34:19.032 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.033+0000 7f1f2d864780 1 < completed delete operation key=PVB52GO6L8T4 tag=A69I1VNMAS8N type=del 2024-09-12T00:34:19.036 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.035+0000 7f1f2d864780 1 > prepared part key=_multipart_WKK747ETLW10.2~I1C03FNAH7PO.0 size=511356 2024-09-12T00:34:19.036 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.035+0000 7f1f2d864780 1 > prepared multipart upload key=WKK747ETLW10 upload=I1C03FNAH7PO tag=F4QU4CXZPC4B type=write size=1559932 2024-09-12T00:34:19.037 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.036+0000 7f1f2d864780 1 < completed delete operation key=GSPM8N0K7ODC tag=7ZA2LHM96GA1 type=del 2024-09-12T00:34:19.037 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.038+0000 7f1f2d864780 1 > prepared part key=_multipart_ZGO887JDR627.2~XT09TCB3N277.0 size=608362 2024-09-12T00:34:19.037 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.038+0000 7f1f2d864780 1 > prepared multipart upload key=ZGO887JDR627 upload=XT09TCB3N277 tag=DANHXO6YUQJ3 type=write size=1656938 2024-09-12T00:34:19.038 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.039+0000 7f1f2d864780 1 < completed part key=_multipart_PVB52GO6L8T4.2~HIULSPNGTLIN.0 size=627478 2024-09-12T00:34:19.040 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.041+0000 7f1f2d864780 1 < completed multipart upload key=PVB52GO6L8T4 upload=HIULSPNGTLIN tag=01EUJKHJS33G type=write size=1676054 2024-09-12T00:34:19.042 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.043+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~22K9QGJMGOVP.0 size=1048576 2024-09-12T00:34:19.043 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.044+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~22K9QGJMGOVP.1 size=1048576 2024-09-12T00:34:19.044 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.045+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~22K9QGJMGOVP.2 size=418643 2024-09-12T00:34:19.044 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.045+0000 7f1f2d864780 1 > prepared multipart upload key=D21W9QZWY0YU upload=22K9QGJMGOVP tag=DSDQ8P0DKZRY type=write size=3564371 2024-09-12T00:34:19.045 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.046+0000 7f1f2d864780 1 < completed part key=_multipart_GSPM8N0K7ODC.2~WGYFQIWT4ULN.0 size=87037 2024-09-12T00:34:19.047 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.048+0000 7f1f2d864780 1 < completed multipart upload key=GSPM8N0K7ODC upload=WGYFQIWT4ULN tag=4XXK61RRG4MQ type=write size=1135613 2024-09-12T00:34:19.049 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.050+0000 7f1f2d864780 1 > prepared part key=_multipart_ZYNIJH0TTSM6.2~DEYDKTY0WBCB.0 size=1048576 2024-09-12T00:34:19.050 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.051+0000 7f1f2d864780 1 > prepared part key=_multipart_ZYNIJH0TTSM6.2~DEYDKTY0WBCB.1 size=645754 2024-09-12T00:34:19.051 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.051+0000 7f1f2d864780 1 > prepared multipart upload key=ZYNIJH0TTSM6 upload=DEYDKTY0WBCB tag=19TVV7T2NKTK type=write size=2742906 2024-09-12T00:34:19.052 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.052+0000 7f1f2d864780 1 < completed delete operation key=FAP6N3H7SBN0 tag=FBE2LWFMKU1K type=del 2024-09-12T00:34:19.053 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.053+0000 7f1f2d864780 1 > prepared operation key=N9RQIGHVL8VP tag=679PSC1HRDZY type=write size=784535 2024-09-12T00:34:19.054 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.055+0000 7f1f2d864780 1 < completed delete operation key=2YCGIJRK6MUH tag=TJ8W40C2OKDK type=del 2024-09-12T00:34:19.056 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.057+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~7IU769CL8F96.0 size=521297 2024-09-12T00:34:19.056 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.057+0000 7f1f2d864780 1 > prepared multipart upload key=FAP6N3H7SBN0 upload=7IU769CL8F96 tag=HTNWIMJH0M4K type=write size=1569873 2024-09-12T00:34:19.058 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.058+0000 7f1f2d864780 1 < completed write operation key=W6U30X4HJCB1 tag=H1K9XVBYXK80 type=write size=1039343 2024-09-12T00:34:19.059 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.059+0000 7f1f2d864780 1 > prepared operation key=WKK747ETLW10 tag=7109WR8F33D9 type=write size=836147 2024-09-12T00:34:19.060 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.061+0000 7f1f2d864780 1 < completed delete operation key=FFG41OYEYFZA tag=CKD9SYWSS7H8 type=del 2024-09-12T00:34:19.062 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.063+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~QPP39MBZJUFD.0 size=776846 2024-09-12T00:34:19.062 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.063+0000 7f1f2d864780 1 > prepared multipart upload key=SZP418NVZ5VX upload=QPP39MBZJUFD tag=QNHBNJ4PUT3J type=write size=1825422 2024-09-12T00:34:19.063 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.064+0000 7f1f2d864780 1 < completed delete operation key=UTR2UUO6DHLJ tag=9U6KXWMY5V7B type=del 2024-09-12T00:34:19.065 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.066+0000 7f1f2d864780 1 > prepared part key=_multipart_N9RQIGHVL8VP.2~6JU7Z6FM31PD.0 size=1048576 2024-09-12T00:34:19.066 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.067+0000 7f1f2d864780 1 > prepared part key=_multipart_N9RQIGHVL8VP.2~6JU7Z6FM31PD.1 size=1048576 2024-09-12T00:34:19.067 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.068+0000 7f1f2d864780 1 > prepared part key=_multipart_N9RQIGHVL8VP.2~6JU7Z6FM31PD.2 size=211125 2024-09-12T00:34:19.067 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.068+0000 7f1f2d864780 1 > prepared multipart upload key=N9RQIGHVL8VP upload=6JU7Z6FM31PD tag=HH4V3PVRHZWV type=write size=3356853 2024-09-12T00:34:19.068 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.069+0000 7f1f2d864780 1 < completed delete operation key=DYKLAY6J018G tag=S1V4HL202EOP type=del 2024-09-12T00:34:19.070 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.070+0000 7f1f2d864780 1 > prepared operation key=KHPF1N1MT33Z tag=37JA3FFQ2DD6 type=del size=3146336 2024-09-12T00:34:19.070 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.070+0000 7f1f2d864780 1 < canceled part key=_multipart_PVB52GO6L8T4.2~5P15Z8BQ6J29.0 size=91478 2024-09-12T00:34:19.071 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.072+0000 7f1f2d864780 1 < canceled multipart upload key=PVB52GO6L8T4 upload=5P15Z8BQ6J29 tag=ZE5BN9GCPKO5 type=write size=1140054 2024-09-12T00:34:19.073 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.074+0000 7f1f2d864780 1 > prepared part key=_multipart_FFG41OYEYFZA.2~33VONUB62O3C.0 size=489160 2024-09-12T00:34:19.074 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.074+0000 7f1f2d864780 1 > prepared multipart upload key=FFG41OYEYFZA upload=33VONUB62O3C tag=E81F4R7F98EO type=write size=1537736 2024-09-12T00:34:19.075 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.075+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~HJPHEFB5LSWK.0 size=1048576 2024-09-12T00:34:19.075 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.076+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~HJPHEFB5LSWK.1 size=114909 2024-09-12T00:34:19.077 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.078+0000 7f1f2d864780 1 < completed multipart upload key=0DSQOFS8IIF5 upload=HJPHEFB5LSWK tag=F26TFNCTS1SR type=write size=2212061 2024-09-12T00:34:19.078 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.079+0000 7f1f2d864780 1 > prepared operation key=MSGU3PHLBRJH tag=SPIHCGGTH4BT type=del size=2637218 2024-09-12T00:34:19.080 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.080+0000 7f1f2d864780 1 < completed part key=_multipart_2YCGIJRK6MUH.2~YGIT15146YJ8.0 size=989158 2024-09-12T00:34:19.081 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.082+0000 7f1f2d864780 1 < completed multipart upload key=2YCGIJRK6MUH upload=YGIT15146YJ8 tag=94IFO66XZWMW type=write size=2037734 2024-09-12T00:34:19.082 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.083+0000 7f1f2d864780 1 > prepared operation key=2G3UCYG4R4NM tag=2MH24MH2CFAY type=write size=701073 2024-09-12T00:34:19.084 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.084+0000 7f1f2d864780 1 < completed part key=_multipart_ZGO887JDR627.2~40QB5AXLQ3FK.0 size=622874 2024-09-12T00:34:19.086 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.086+0000 7f1f2d864780 1 < completed multipart upload key=ZGO887JDR627 upload=40QB5AXLQ3FK tag=7PC9NHJZCG1U type=write size=1671450 2024-09-12T00:34:19.086 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.087+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=LGAKWRFXYAIF type=write size=138996 2024-09-12T00:34:19.088 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.088+0000 7f1f2d864780 1 < completed write operation key=WIIU8VTCLWOD tag=49L2O1BUN15B type=write size=915973 2024-09-12T00:34:19.089 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.090+0000 7f1f2d864780 1 > prepared part key=_multipart_WKK747ETLW10.2~SEXLLB161KNL.0 size=1048576 2024-09-12T00:34:19.091 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.091+0000 7f1f2d864780 1 > prepared part key=_multipart_WKK747ETLW10.2~SEXLLB161KNL.1 size=343624 2024-09-12T00:34:19.091 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.091+0000 7f1f2d864780 1 > prepared multipart upload key=WKK747ETLW10 upload=SEXLLB161KNL tag=GJNJ5RNKUPHF type=write size=2440776 2024-09-12T00:34:19.092 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.092+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~XBF3JOHUMZIG.0 size=1048576 2024-09-12T00:34:19.092 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.093+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~XBF3JOHUMZIG.1 size=97442 2024-09-12T00:34:19.094 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.095+0000 7f1f2d864780 1 < completed multipart upload key=0DSQOFS8IIF5 upload=XBF3JOHUMZIG tag=VN9PQK7C0RPL type=write size=2194594 2024-09-12T00:34:19.095 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.096+0000 7f1f2d864780 1 > prepared operation key=WGKEA4EKF5GP tag=SW57QJ6BJ43U type=del size=1074880 2024-09-12T00:34:19.096 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.097+0000 7f1f2d864780 1 < completed part key=_multipart_WKK747ETLW10.2~I1C03FNAH7PO.0 size=511356 2024-09-12T00:34:19.098 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.099+0000 7f1f2d864780 1 < completed multipart upload key=WKK747ETLW10 upload=I1C03FNAH7PO tag=F4QU4CXZPC4B type=write size=1559932 2024-09-12T00:34:19.100 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.101+0000 7f1f2d864780 1 > prepared part key=_multipart_UTR2UUO6DHLJ.2~DAWID4HP13Y0.0 size=237794 2024-09-12T00:34:19.100 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.101+0000 7f1f2d864780 1 > prepared multipart upload key=UTR2UUO6DHLJ upload=DAWID4HP13Y0 tag=2PGVV3ZMIOK0 type=write size=1286370 2024-09-12T00:34:19.101 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.102+0000 7f1f2d864780 1 < completed part key=_multipart_ZGO887JDR627.2~XT09TCB3N277.0 size=608362 2024-09-12T00:34:19.104 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.104+0000 7f1f2d864780 1 < completed multipart upload key=ZGO887JDR627 upload=XT09TCB3N277 tag=DANHXO6YUQJ3 type=write size=1656938 2024-09-12T00:34:19.104 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.105+0000 7f1f2d864780 1 > prepared operation key=OY145ZXRSF4L tag=25DM94XJL9VY type=write size=162755 2024-09-12T00:34:19.105 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.106+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~22K9QGJMGOVP.0 size=1048576 2024-09-12T00:34:19.106 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.107+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~22K9QGJMGOVP.1 size=1048576 2024-09-12T00:34:19.107 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.108+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~22K9QGJMGOVP.2 size=418643 2024-09-12T00:34:19.109 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.110+0000 7f1f2d864780 1 < completed multipart upload key=D21W9QZWY0YU upload=22K9QGJMGOVP tag=DSDQ8P0DKZRY type=write size=3564371 2024-09-12T00:34:19.110 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.111+0000 7f1f2d864780 1 > prepared operation key=GSPM8N0K7ODC tag=40J6PEW3QF49 type=del size=3869584 2024-09-12T00:34:19.112 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.112+0000 7f1f2d864780 1 < completed part key=_multipart_ZYNIJH0TTSM6.2~DEYDKTY0WBCB.0 size=1048576 2024-09-12T00:34:19.112 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.113+0000 7f1f2d864780 1 < completed part key=_multipart_ZYNIJH0TTSM6.2~DEYDKTY0WBCB.1 size=645754 2024-09-12T00:34:19.114 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.115+0000 7f1f2d864780 1 < completed multipart upload key=ZYNIJH0TTSM6 upload=DEYDKTY0WBCB tag=19TVV7T2NKTK type=write size=2742906 2024-09-12T00:34:19.117 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.117+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~ZW68TXO06ZLA.0 size=1048576 2024-09-12T00:34:19.117 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.118+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~ZW68TXO06ZLA.1 size=970907 2024-09-12T00:34:19.117 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.118+0000 7f1f2d864780 1 > prepared multipart upload key=WGKEA4EKF5GP upload=ZW68TXO06ZLA tag=ER826HXP660Y type=write size=3068059 2024-09-12T00:34:19.118 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.119+0000 7f1f2d864780 1 < canceled operation key=N9RQIGHVL8VP tag=679PSC1HRDZY type=write size=784535 2024-09-12T00:34:19.120 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.120+0000 7f1f2d864780 1 > prepared operation key=W6U30X4HJCB1 tag=ROZPC8JB9I1Z type=del size=945114 2024-09-12T00:34:19.121 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.122+0000 7f1f2d864780 1 < completed part key=_multipart_FAP6N3H7SBN0.2~7IU769CL8F96.0 size=521297 2024-09-12T00:34:19.123 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.124+0000 7f1f2d864780 1 < completed multipart upload key=FAP6N3H7SBN0 upload=7IU769CL8F96 tag=HTNWIMJH0M4K type=write size=1569873 2024-09-12T00:34:19.126 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.127+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~FUECFQURT6D4.0 size=1048576 2024-09-12T00:34:19.127 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.128+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~FUECFQURT6D4.1 size=1048576 2024-09-12T00:34:19.128 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.129+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~FUECFQURT6D4.2 size=288935 2024-09-12T00:34:19.128 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.129+0000 7f1f2d864780 1 > prepared multipart upload key=0DSQOFS8IIF5 upload=FUECFQURT6D4 tag=ML2E45FIKAGR type=write size=3434663 2024-09-12T00:34:19.130 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.131+0000 7f1f2d864780 1 < suggested update operation key=WKK747ETLW10 tag=7109WR8F33D9 type=write size=836147 2024-09-12T00:34:19.131 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.132+0000 7f1f2d864780 1 > prepared operation key=MSGU3PHLBRJH tag=YOZ8IGGA4TXE type=del size=3110380 2024-09-12T00:34:19.132 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.133+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~QPP39MBZJUFD.0 size=776846 2024-09-12T00:34:19.134 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.135+0000 7f1f2d864780 1 < completed multipart upload key=SZP418NVZ5VX upload=QPP39MBZJUFD tag=QNHBNJ4PUT3J type=write size=1825422 2024-09-12T00:34:19.136 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.137+0000 7f1f2d864780 1 > prepared part key=_multipart_O1YY03BOEYLM.2~G0G6MTPLBWIX.0 size=821784 2024-09-12T00:34:19.137 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.137+0000 7f1f2d864780 1 > prepared multipart upload key=O1YY03BOEYLM upload=G0G6MTPLBWIX tag=UH0VO838VFS2 type=write size=1870360 2024-09-12T00:34:19.137 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.137+0000 7f1f2d864780 1 < canceled part key=_multipart_N9RQIGHVL8VP.2~6JU7Z6FM31PD.0 size=1048576 2024-09-12T00:34:19.138 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.138+0000 7f1f2d864780 1 < completed part key=_multipart_N9RQIGHVL8VP.2~6JU7Z6FM31PD.1 size=1048576 2024-09-12T00:34:19.138 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.138+0000 7f1f2d864780 1 < canceled part key=_multipart_N9RQIGHVL8VP.2~6JU7Z6FM31PD.2 size=211125 2024-09-12T00:34:19.139 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.140+0000 7f1f2d864780 1 < canceled multipart upload key=N9RQIGHVL8VP upload=6JU7Z6FM31PD tag=HH4V3PVRHZWV type=write size=3356853 2024-09-12T00:34:19.141 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.142+0000 7f1f2d864780 1 > prepared operation key=1299IOSGYIO9 tag=8LKWTF1QY5XT type=del size=3535001 2024-09-12T00:34:19.142 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.143+0000 7f1f2d864780 1 < completed delete operation key=KHPF1N1MT33Z tag=37JA3FFQ2DD6 type=del 2024-09-12T00:34:19.143 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.144+0000 7f1f2d864780 1 > prepared operation key=2G3UCYG4R4NM tag=1ZSVKZTVCSIT type=del size=2616068 2024-09-12T00:34:19.145 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.145+0000 7f1f2d864780 1 < completed part key=_multipart_FFG41OYEYFZA.2~33VONUB62O3C.0 size=489160 2024-09-12T00:34:19.146 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.147+0000 7f1f2d864780 1 < completed multipart upload key=FFG41OYEYFZA upload=33VONUB62O3C tag=E81F4R7F98EO type=write size=1537736 2024-09-12T00:34:19.148 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.148+0000 7f1f2d864780 1 > prepared operation key=WIIU8VTCLWOD tag=HR56GJI5C9I4 type=del size=3891316 2024-09-12T00:34:19.149 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.150+0000 7f1f2d864780 1 < completed delete operation key=MSGU3PHLBRJH tag=SPIHCGGTH4BT type=del 2024-09-12T00:34:19.151 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.152+0000 7f1f2d864780 1 > prepared part key=_multipart_53QCNWX1V1R1.2~MCMU12HA8V69.0 size=504383 2024-09-12T00:34:19.151 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.152+0000 7f1f2d864780 1 > prepared multipart upload key=53QCNWX1V1R1 upload=MCMU12HA8V69 tag=W2MVRK7JIKUO type=write size=1552959 2024-09-12T00:34:19.152 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.153+0000 7f1f2d864780 1 < completed write operation key=2G3UCYG4R4NM tag=2MH24MH2CFAY type=write size=701073 2024-09-12T00:34:19.155 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.155+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~2CXI4JTSILPL.0 size=1048576 2024-09-12T00:34:19.156 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.156+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~2CXI4JTSILPL.1 size=856600 2024-09-12T00:34:19.156 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.156+0000 7f1f2d864780 1 > prepared multipart upload key=1299IOSGYIO9 upload=2CXI4JTSILPL tag=3YLT1QDFI77W type=write size=2953752 2024-09-12T00:34:19.157 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.157+0000 7f1f2d864780 1 < completed write operation key=2RV0899QUJ8W tag=LGAKWRFXYAIF type=write size=138996 2024-09-12T00:34:19.159 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.159+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~Q38TJHWU5RVL.0 size=1048576 2024-09-12T00:34:19.160 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.160+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~Q38TJHWU5RVL.1 size=1048576 2024-09-12T00:34:19.161 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.161+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~Q38TJHWU5RVL.2 size=81263 2024-09-12T00:34:19.161 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.161+0000 7f1f2d864780 1 > prepared multipart upload key=1299IOSGYIO9 upload=Q38TJHWU5RVL tag=3I3QB6FAL5J8 type=write size=3226991 2024-09-12T00:34:19.162 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.162+0000 7f1f2d864780 1 < completed part key=_multipart_WKK747ETLW10.2~SEXLLB161KNL.0 size=1048576 2024-09-12T00:34:19.162 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.162+0000 7f1f2d864780 1 < canceled part key=_multipart_WKK747ETLW10.2~SEXLLB161KNL.1 size=343624 2024-09-12T00:34:19.164 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.164+0000 7f1f2d864780 1 < canceled multipart upload key=WKK747ETLW10 upload=SEXLLB161KNL tag=GJNJ5RNKUPHF type=write size=2440776 2024-09-12T00:34:19.165 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.166+0000 7f1f2d864780 1 > prepared operation key=D21W9QZWY0YU tag=486OTUF9QVD2 type=del size=3123226 2024-09-12T00:34:19.166 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.167+0000 7f1f2d864780 1 < completed delete operation key=WGKEA4EKF5GP tag=SW57QJ6BJ43U type=del 2024-09-12T00:34:19.168 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.168+0000 7f1f2d864780 1 > prepared operation key=PVB52GO6L8T4 tag=K0MNDF9ZTJYJ type=del size=3165361 2024-09-12T00:34:19.169 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.169+0000 7f1f2d864780 1 < completed part key=_multipart_UTR2UUO6DHLJ.2~DAWID4HP13Y0.0 size=237794 2024-09-12T00:34:19.171 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.172+0000 7f1f2d864780 1 < completed multipart upload key=UTR2UUO6DHLJ upload=DAWID4HP13Y0 tag=2PGVV3ZMIOK0 type=write size=1286370 2024-09-12T00:34:19.173 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.174+0000 7f1f2d864780 1 > prepared part key=_multipart_N9RQIGHVL8VP.2~UKVISIOVSN9O.0 size=1048576 2024-09-12T00:34:19.174 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.174+0000 7f1f2d864780 1 > prepared part key=_multipart_N9RQIGHVL8VP.2~UKVISIOVSN9O.1 size=1028049 2024-09-12T00:34:19.174 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.174+0000 7f1f2d864780 1 > prepared multipart upload key=N9RQIGHVL8VP upload=UKVISIOVSN9O tag=X8TZR5EX0QLS type=write size=3125201 2024-09-12T00:34:19.175 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.176+0000 7f1f2d864780 1 < completed write operation key=OY145ZXRSF4L tag=25DM94XJL9VY type=write size=162755 2024-09-12T00:34:19.177 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.177+0000 7f1f2d864780 1 > prepared operation key=SNCGB6Z20450 tag=3H3QI7QJ00JT type=del size=4045096 2024-09-12T00:34:19.177 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.178+0000 7f1f2d864780 1 < completed delete operation key=GSPM8N0K7ODC tag=40J6PEW3QF49 type=del 2024-09-12T00:34:19.179 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.180+0000 7f1f2d864780 1 > prepared part key=_multipart_UTR2UUO6DHLJ.2~WHQVBHFJ2DWT.0 size=1048576 2024-09-12T00:34:19.180 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.181+0000 7f1f2d864780 1 > prepared part key=_multipart_UTR2UUO6DHLJ.2~WHQVBHFJ2DWT.1 size=1048576 2024-09-12T00:34:19.181 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.182+0000 7f1f2d864780 1 > prepared part key=_multipart_UTR2UUO6DHLJ.2~WHQVBHFJ2DWT.2 size=508514 2024-09-12T00:34:19.181 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.182+0000 7f1f2d864780 1 > prepared multipart upload key=UTR2UUO6DHLJ upload=WHQVBHFJ2DWT tag=33CD2IRAUGDP type=write size=3654242 2024-09-12T00:34:19.183 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.183+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~ZW68TXO06ZLA.0 size=1048576 2024-09-12T00:34:19.183 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.183+0000 7f1f2d864780 1 < canceled part key=_multipart_WGKEA4EKF5GP.2~ZW68TXO06ZLA.1 size=970907 2024-09-12T00:34:19.185 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.185+0000 7f1f2d864780 1 < canceled multipart upload key=WGKEA4EKF5GP upload=ZW68TXO06ZLA tag=ER826HXP660Y type=write size=3068059 2024-09-12T00:34:19.186 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.186+0000 7f1f2d864780 1 > prepared operation key=2YCGIJRK6MUH tag=J7T3M514L27Q type=del size=2954957 2024-09-12T00:34:19.187 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.188+0000 7f1f2d864780 1 < completed delete operation key=W6U30X4HJCB1 tag=ROZPC8JB9I1Z type=del 2024-09-12T00:34:19.188 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.189+0000 7f1f2d864780 1 > prepared operation key=D21W9QZWY0YU tag=4OL0LM4MNI3L type=del size=921156 2024-09-12T00:34:19.189 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.190+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~FUECFQURT6D4.0 size=1048576 2024-09-12T00:34:19.190 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.191+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~FUECFQURT6D4.1 size=1048576 2024-09-12T00:34:19.191 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.192+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~FUECFQURT6D4.2 size=288935 2024-09-12T00:34:19.193 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.194+0000 7f1f2d864780 1 < completed multipart upload key=0DSQOFS8IIF5 upload=FUECFQURT6D4 tag=ML2E45FIKAGR type=write size=3434663 2024-09-12T00:34:19.195 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.195+0000 7f1f2d864780 1 > prepared operation key=SZP418NVZ5VX tag=CRLHW1BWIQQ4 type=write size=179106 2024-09-12T00:34:19.197 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.198+0000 7f1f2d864780 1 < suggested remove operation key=MSGU3PHLBRJH tag=YOZ8IGGA4TXE type=del 2024-09-12T00:34:19.201 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.202+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~EK0MEWDMPY6M.0 size=1048576 2024-09-12T00:34:19.202 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.203+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~EK0MEWDMPY6M.1 size=1048576 2024-09-12T00:34:19.203 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.204+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~EK0MEWDMPY6M.2 size=400737 2024-09-12T00:34:19.203 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.204+0000 7f1f2d864780 1 > prepared multipart upload key=WGKEA4EKF5GP upload=EK0MEWDMPY6M tag=9YUJ1P3QLGUV type=write size=3546465 2024-09-12T00:34:19.204 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.205+0000 7f1f2d864780 1 < completed part key=_multipart_O1YY03BOEYLM.2~G0G6MTPLBWIX.0 size=821784 2024-09-12T00:34:19.206 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.207+0000 7f1f2d864780 1 < completed multipart upload key=O1YY03BOEYLM upload=G0G6MTPLBWIX tag=UH0VO838VFS2 type=write size=1870360 2024-09-12T00:34:19.208 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.208+0000 7f1f2d864780 1 > prepared operation key=O1YY03BOEYLM tag=9JLR0CO4M3E3 type=del size=3786039 2024-09-12T00:34:19.209 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.210+0000 7f1f2d864780 1 < completed delete operation key=1299IOSGYIO9 tag=8LKWTF1QY5XT type=del 2024-09-12T00:34:19.210 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.211+0000 7f1f2d864780 1 > prepared operation key=O1YY03BOEYLM tag=5QX9WV6WXVGV type=del size=3567229 2024-09-12T00:34:19.212 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.212+0000 7f1f2d864780 1 < completed delete operation key=2G3UCYG4R4NM tag=1ZSVKZTVCSIT type=del 2024-09-12T00:34:19.213 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.213+0000 7f1f2d864780 1 > prepared operation key=2G3UCYG4R4NM tag=UWY6ZUAU9YKL type=del size=3941668 2024-09-12T00:34:19.214 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.215+0000 7f1f2d864780 1 < completed delete operation key=WIIU8VTCLWOD tag=HR56GJI5C9I4 type=del 2024-09-12T00:34:19.215 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.216+0000 7f1f2d864780 1 > prepared operation key=ZYNIJH0TTSM6 tag=NTDJVE7HCML8 type=del size=224290 2024-09-12T00:34:19.216 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.217+0000 7f1f2d864780 1 < completed part key=_multipart_53QCNWX1V1R1.2~MCMU12HA8V69.0 size=504383 2024-09-12T00:34:19.218 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.219+0000 7f1f2d864780 1 < completed multipart upload key=53QCNWX1V1R1 upload=MCMU12HA8V69 tag=W2MVRK7JIKUO type=write size=1552959 2024-09-12T00:34:19.220 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.220+0000 7f1f2d864780 1 > prepared operation key=4FRVL0KXN2X8 tag=3IF77N6QF2ZV type=del size=486746 2024-09-12T00:34:19.223 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.224+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~2CXI4JTSILPL.0 size=1048576 2024-09-12T00:34:19.224 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.224+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~2CXI4JTSILPL.1 size=856600 2024-09-12T00:34:19.226 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.226+0000 7f1f2d864780 1 < completed multipart upload key=1299IOSGYIO9 upload=2CXI4JTSILPL tag=3YLT1QDFI77W type=write size=2953752 2024-09-12T00:34:19.227 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.228+0000 7f1f2d864780 1 > prepared operation key=D21W9QZWY0YU tag=HO4ORFCZSWK6 type=write size=676669 2024-09-12T00:34:19.228 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.229+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~Q38TJHWU5RVL.0 size=1048576 2024-09-12T00:34:19.229 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.230+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~Q38TJHWU5RVL.1 size=1048576 2024-09-12T00:34:19.229 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.230+0000 7f1f2d864780 1 < canceled part key=_multipart_1299IOSGYIO9.2~Q38TJHWU5RVL.2 size=81263 2024-09-12T00:34:19.231 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.232+0000 7f1f2d864780 1 < canceled multipart upload key=1299IOSGYIO9 upload=Q38TJHWU5RVL tag=3I3QB6FAL5J8 type=write size=3226991 2024-09-12T00:34:19.232 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.233+0000 7f1f2d864780 1 > prepared operation key=WGKEA4EKF5GP tag=92O1KO27EWL8 type=del size=3505709 2024-09-12T00:34:19.235 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.235+0000 7f1f2d864780 1 < suggested remove operation key=D21W9QZWY0YU tag=486OTUF9QVD2 type=del 2024-09-12T00:34:19.237 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.237+0000 7f1f2d864780 1 > prepared part key=_multipart_N9RQIGHVL8VP.2~RKVG7BVDK56X.0 size=1048576 2024-09-12T00:34:19.238 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.238+0000 7f1f2d864780 1 > prepared part key=_multipart_N9RQIGHVL8VP.2~RKVG7BVDK56X.1 size=1048576 2024-09-12T00:34:19.240 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.240+0000 7f1f2d864780 1 > prepared part key=_multipart_N9RQIGHVL8VP.2~RKVG7BVDK56X.2 size=378330 2024-09-12T00:34:19.240 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.240+0000 7f1f2d864780 1 > prepared multipart upload key=N9RQIGHVL8VP upload=RKVG7BVDK56X tag=SNJJ48ZF6770 type=write size=3524058 2024-09-12T00:34:19.241 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.241+0000 7f1f2d864780 1 < completed delete operation key=PVB52GO6L8T4 tag=K0MNDF9ZTJYJ type=del 2024-09-12T00:34:19.242 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.243+0000 7f1f2d864780 1 > prepared operation key=UTR2UUO6DHLJ tag=6C2J2TQ3T82M type=write size=743669 2024-09-12T00:34:19.243 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.244+0000 7f1f2d864780 1 < completed part key=_multipart_N9RQIGHVL8VP.2~UKVISIOVSN9O.0 size=1048576 2024-09-12T00:34:19.244 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.245+0000 7f1f2d864780 1 < completed part key=_multipart_N9RQIGHVL8VP.2~UKVISIOVSN9O.1 size=1028049 2024-09-12T00:34:19.246 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.247+0000 7f1f2d864780 1 < completed multipart upload key=N9RQIGHVL8VP upload=UKVISIOVSN9O tag=X8TZR5EX0QLS type=write size=3125201 2024-09-12T00:34:19.247 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.248+0000 7f1f2d864780 1 > prepared operation key=SZP418NVZ5VX tag=AELV3WZ05LLF type=del size=1124344 2024-09-12T00:34:19.249 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.249+0000 7f1f2d864780 1 < completed delete operation key=SNCGB6Z20450 tag=3H3QI7QJ00JT type=del 2024-09-12T00:34:19.250 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.251+0000 7f1f2d864780 1 > prepared operation key=UTR2UUO6DHLJ tag=YVOU677FEKP1 type=del size=3558060 2024-09-12T00:34:19.251 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.252+0000 7f1f2d864780 1 < completed part key=_multipart_UTR2UUO6DHLJ.2~WHQVBHFJ2DWT.0 size=1048576 2024-09-12T00:34:19.252 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.253+0000 7f1f2d864780 1 < completed part key=_multipart_UTR2UUO6DHLJ.2~WHQVBHFJ2DWT.1 size=1048576 2024-09-12T00:34:19.253 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.254+0000 7f1f2d864780 1 < completed part key=_multipart_UTR2UUO6DHLJ.2~WHQVBHFJ2DWT.2 size=508514 2024-09-12T00:34:19.255 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.256+0000 7f1f2d864780 1 < completed multipart upload key=UTR2UUO6DHLJ upload=WHQVBHFJ2DWT tag=33CD2IRAUGDP type=write size=3654242 2024-09-12T00:34:19.256 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.257+0000 7f1f2d864780 1 > prepared operation key=FAP6N3H7SBN0 tag=FNYBFHW28T3U type=del size=864159 2024-09-12T00:34:19.258 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.258+0000 7f1f2d864780 1 < canceled operation key=2YCGIJRK6MUH tag=J7T3M514L27Q type=del size=2954957 2024-09-12T00:34:19.260 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.261+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~GW8Z3YMYD5AO.0 size=1048576 2024-09-12T00:34:19.261 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.261+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~GW8Z3YMYD5AO.1 size=1048576 2024-09-12T00:34:19.262 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.262+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~GW8Z3YMYD5AO.2 size=208715 2024-09-12T00:34:19.262 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.262+0000 7f1f2d864780 1 > prepared multipart upload key=FAP6N3H7SBN0 upload=GW8Z3YMYD5AO tag=WTQ5Z661P0IN type=write size=3354443 2024-09-12T00:34:19.263 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.264+0000 7f1f2d864780 -1 < failed to complete operation key=D21W9QZWY0YU tag=4OL0LM4MNI3L type=del size=921156: (22) Invalid argument 2024-09-12T00:34:19.264 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.265+0000 7f1f2d864780 1 > prepared operation key=MSGU3PHLBRJH tag=UZREKS5MIU65 type=del size=435435 2024-09-12T00:34:19.265 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.266+0000 7f1f2d864780 1 < completed write operation key=SZP418NVZ5VX tag=CRLHW1BWIQQ4 type=write size=179106 2024-09-12T00:34:19.267 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.268+0000 7f1f2d864780 1 > prepared operation key=PVB52GO6L8T4 tag=TGDGBBN3UZBK type=del size=732633 2024-09-12T00:34:19.268 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.269+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~EK0MEWDMPY6M.0 size=1048576 2024-09-12T00:34:19.268 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.269+0000 7f1f2d864780 1 < canceled part key=_multipart_WGKEA4EKF5GP.2~EK0MEWDMPY6M.1 size=1048576 2024-09-12T00:34:19.269 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.270+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~EK0MEWDMPY6M.2 size=400737 2024-09-12T00:34:19.271 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.272+0000 7f1f2d864780 1 < canceled multipart upload key=WGKEA4EKF5GP upload=EK0MEWDMPY6M tag=9YUJ1P3QLGUV type=write size=3546465 2024-09-12T00:34:19.272 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.273+0000 7f1f2d864780 1 > prepared operation key=4FRVL0KXN2X8 tag=9V63E4TJ37AY type=del size=2406702 2024-09-12T00:34:19.273 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.274+0000 7f1f2d864780 1 < canceled operation key=O1YY03BOEYLM tag=9JLR0CO4M3E3 type=del size=3786039 2024-09-12T00:34:19.274 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.275+0000 7f1f2d864780 1 > prepared operation key=D21W9QZWY0YU tag=WOAYQQ9MLDGW type=del size=1180076 2024-09-12T00:34:19.276 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.276+0000 7f1f2d864780 1 < completed delete operation key=O1YY03BOEYLM tag=5QX9WV6WXVGV type=del 2024-09-12T00:34:19.278 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.278+0000 7f1f2d864780 1 > prepared part key=_multipart_53QCNWX1V1R1.2~GSZ0CAXSVU8E.0 size=1048576 2024-09-12T00:34:19.279 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.279+0000 7f1f2d864780 1 > prepared part key=_multipart_53QCNWX1V1R1.2~GSZ0CAXSVU8E.1 size=1048576 2024-09-12T00:34:19.280 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.280+0000 7f1f2d864780 1 > prepared part key=_multipart_53QCNWX1V1R1.2~GSZ0CAXSVU8E.2 size=231013 2024-09-12T00:34:19.280 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.280+0000 7f1f2d864780 1 > prepared multipart upload key=53QCNWX1V1R1 upload=GSZ0CAXSVU8E tag=MO46JQPQ9UEE type=write size=3376741 2024-09-12T00:34:19.281 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.281+0000 7f1f2d864780 1 < completed delete operation key=2G3UCYG4R4NM tag=UWY6ZUAU9YKL type=del 2024-09-12T00:34:19.282 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.283+0000 7f1f2d864780 1 > prepared operation key=MSGU3PHLBRJH tag=CG7IJVZWHEYX type=del size=3763036 2024-09-12T00:34:19.283 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.284+0000 7f1f2d864780 1 < completed delete operation key=ZYNIJH0TTSM6 tag=NTDJVE7HCML8 type=del 2024-09-12T00:34:19.284 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.285+0000 7f1f2d864780 1 > prepared operation key=ZYNIJH0TTSM6 tag=GVWP8BGKLXT6 type=del size=883107 2024-09-12T00:34:19.285 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.286+0000 7f1f2d864780 1 < completed delete operation key=4FRVL0KXN2X8 tag=3IF77N6QF2ZV type=del 2024-09-12T00:34:19.287 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.288+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~4Q38TG42BL0S.0 size=1048576 2024-09-12T00:34:19.288 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.289+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~4Q38TG42BL0S.1 size=501329 2024-09-12T00:34:19.288 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.289+0000 7f1f2d864780 1 > prepared multipart upload key=1299IOSGYIO9 upload=4Q38TG42BL0S tag=LYCM64XECCMH type=write size=2598481 2024-09-12T00:34:19.289 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.290+0000 7f1f2d864780 -1 < failed to complete operation key=D21W9QZWY0YU tag=HO4ORFCZSWK6 type=write size=676669: (22) Invalid argument 2024-09-12T00:34:19.290 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.291+0000 7f1f2d864780 1 > prepared operation key=DYKLAY6J018G tag=AK50S29M4BYU type=del size=1560928 2024-09-12T00:34:19.291 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.292+0000 7f1f2d864780 1 < completed delete operation key=WGKEA4EKF5GP tag=92O1KO27EWL8 type=del 2024-09-12T00:34:19.293 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.294+0000 7f1f2d864780 1 > prepared part key=_multipart_N9RQIGHVL8VP.2~GNUA11016707.0 size=288203 2024-09-12T00:34:19.294 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.294+0000 7f1f2d864780 1 > prepared multipart upload key=N9RQIGHVL8VP upload=GNUA11016707 tag=ETJ3A4NOGW0K type=write size=1336779 2024-09-12T00:34:19.295 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.295+0000 7f1f2d864780 1 < completed part key=_multipart_N9RQIGHVL8VP.2~RKVG7BVDK56X.0 size=1048576 2024-09-12T00:34:19.296 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.296+0000 7f1f2d864780 1 < completed part key=_multipart_N9RQIGHVL8VP.2~RKVG7BVDK56X.1 size=1048576 2024-09-12T00:34:19.296 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.297+0000 7f1f2d864780 1 < completed part key=_multipart_N9RQIGHVL8VP.2~RKVG7BVDK56X.2 size=378330 2024-09-12T00:34:19.298 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.299+0000 7f1f2d864780 1 < completed multipart upload key=N9RQIGHVL8VP upload=RKVG7BVDK56X tag=SNJJ48ZF6770 type=write size=3524058 2024-09-12T00:34:19.300 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.301+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~B2AC205V8HIN.0 size=211868 2024-09-12T00:34:19.300 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.301+0000 7f1f2d864780 1 > prepared multipart upload key=WGKEA4EKF5GP upload=B2AC205V8HIN tag=930L3NOZB4J5 type=write size=1260444 2024-09-12T00:34:19.301 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.302+0000 7f1f2d864780 1 < completed write operation key=UTR2UUO6DHLJ tag=6C2J2TQ3T82M type=write size=743669 2024-09-12T00:34:19.303 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.303+0000 7f1f2d864780 1 > prepared operation key=D21W9QZWY0YU tag=TY7ASGIMWZIL type=del size=3288673 2024-09-12T00:34:19.304 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.305+0000 7f1f2d864780 1 < completed delete operation key=SZP418NVZ5VX tag=AELV3WZ05LLF type=del 2024-09-12T00:34:19.306 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.307+0000 7f1f2d864780 1 > prepared part key=_multipart_WKK747ETLW10.2~GJLDZRV7JK3I.0 size=1048576 2024-09-12T00:34:19.307 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.308+0000 7f1f2d864780 1 > prepared part key=_multipart_WKK747ETLW10.2~GJLDZRV7JK3I.1 size=1048576 2024-09-12T00:34:19.308 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.309+0000 7f1f2d864780 1 > prepared part key=_multipart_WKK747ETLW10.2~GJLDZRV7JK3I.2 size=333399 2024-09-12T00:34:19.308 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.309+0000 7f1f2d864780 1 > prepared multipart upload key=WKK747ETLW10 upload=GJLDZRV7JK3I tag=3N1Z6BN9DBK2 type=write size=3479127 2024-09-12T00:34:19.309 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.310+0000 7f1f2d864780 1 < completed delete operation key=UTR2UUO6DHLJ tag=YVOU677FEKP1 type=del 2024-09-12T00:34:19.310 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.311+0000 7f1f2d864780 1 > prepared operation key=D21W9QZWY0YU tag=YV57VKMXD53D type=del size=2046058 2024-09-12T00:34:19.311 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.312+0000 7f1f2d864780 1 < completed delete operation key=FAP6N3H7SBN0 tag=FNYBFHW28T3U type=del 2024-09-12T00:34:19.313 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.314+0000 7f1f2d864780 1 > prepared part key=_multipart_KHPF1N1MT33Z.2~K9SGE671GYVA.0 size=1048576 2024-09-12T00:34:19.314 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.315+0000 7f1f2d864780 1 > prepared part key=_multipart_KHPF1N1MT33Z.2~K9SGE671GYVA.1 size=1048576 2024-09-12T00:34:19.316 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.316+0000 7f1f2d864780 1 > prepared part key=_multipart_KHPF1N1MT33Z.2~K9SGE671GYVA.2 size=97862 2024-09-12T00:34:19.316 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.316+0000 7f1f2d864780 1 > prepared multipart upload key=KHPF1N1MT33Z upload=K9SGE671GYVA tag=TA8U0QZ4PFJV type=write size=3243590 2024-09-12T00:34:19.316 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.316+0000 7f1f2d864780 1 < canceled part key=_multipart_FAP6N3H7SBN0.2~GW8Z3YMYD5AO.0 size=1048576 2024-09-12T00:34:19.317 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.317+0000 7f1f2d864780 1 < completed part key=_multipart_FAP6N3H7SBN0.2~GW8Z3YMYD5AO.1 size=1048576 2024-09-12T00:34:19.318 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.318+0000 7f1f2d864780 1 < completed part key=_multipart_FAP6N3H7SBN0.2~GW8Z3YMYD5AO.2 size=208715 2024-09-12T00:34:19.320 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.320+0000 7f1f2d864780 1 < canceled multipart upload key=FAP6N3H7SBN0 upload=GW8Z3YMYD5AO tag=WTQ5Z661P0IN type=write size=3354443 2024-09-12T00:34:19.321 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.322+0000 7f1f2d864780 1 > prepared operation key=MSGU3PHLBRJH tag=99FFFPBJZ229 type=write size=626373 2024-09-12T00:34:19.322 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.323+0000 7f1f2d864780 1 < canceled operation key=MSGU3PHLBRJH tag=UZREKS5MIU65 type=del size=435435 2024-09-12T00:34:19.324 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.325+0000 7f1f2d864780 1 > prepared part key=_multipart_SNCGB6Z20450.2~VJMT8E5YC2RO.0 size=1048576 2024-09-12T00:34:19.325 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.326+0000 7f1f2d864780 1 > prepared part key=_multipart_SNCGB6Z20450.2~VJMT8E5YC2RO.1 size=160006 2024-09-12T00:34:19.326 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.326+0000 7f1f2d864780 1 > prepared multipart upload key=SNCGB6Z20450 upload=VJMT8E5YC2RO tag=DUEUFNAGYT0H type=write size=2257158 2024-09-12T00:34:19.327 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.327+0000 7f1f2d864780 1 < completed delete operation key=PVB52GO6L8T4 tag=TGDGBBN3UZBK type=del 2024-09-12T00:34:19.328 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.329+0000 7f1f2d864780 1 > prepared operation key=KHPF1N1MT33Z tag=7C1BH21PZ6L9 type=del size=1417717 2024-09-12T00:34:19.329 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.330+0000 7f1f2d864780 1 < completed delete operation key=4FRVL0KXN2X8 tag=9V63E4TJ37AY type=del 2024-09-12T00:34:19.330 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.331+0000 7f1f2d864780 1 > prepared operation key=ZGO887JDR627 tag=42A6SNPLPG2T type=del size=2556693 2024-09-12T00:34:19.332 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.332+0000 7f1f2d864780 1 < completed delete operation key=D21W9QZWY0YU tag=WOAYQQ9MLDGW type=del 2024-09-12T00:34:19.333 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.333+0000 7f1f2d864780 1 > prepared operation key=OY145ZXRSF4L tag=K034D2FWFUR1 type=del size=962561 2024-09-12T00:34:19.334 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.335+0000 7f1f2d864780 1 < completed part key=_multipart_53QCNWX1V1R1.2~GSZ0CAXSVU8E.0 size=1048576 2024-09-12T00:34:19.335 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.336+0000 7f1f2d864780 1 < completed part key=_multipart_53QCNWX1V1R1.2~GSZ0CAXSVU8E.1 size=1048576 2024-09-12T00:34:19.336 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.337+0000 7f1f2d864780 1 < completed part key=_multipart_53QCNWX1V1R1.2~GSZ0CAXSVU8E.2 size=231013 2024-09-12T00:34:19.338 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.339+0000 7f1f2d864780 1 < completed multipart upload key=53QCNWX1V1R1 upload=GSZ0CAXSVU8E tag=MO46JQPQ9UEE type=write size=3376741 2024-09-12T00:34:19.339 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.340+0000 7f1f2d864780 1 > prepared operation key=O1YY03BOEYLM tag=GX9AT905OTM8 type=del size=3931793 2024-09-12T00:34:19.340 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.341+0000 7f1f2d864780 1 < completed delete operation key=MSGU3PHLBRJH tag=CG7IJVZWHEYX type=del 2024-09-12T00:34:19.342 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.342+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=1KXM8TZLN7Q6 type=write size=623433 2024-09-12T00:34:19.344 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.345+0000 7f1f2d864780 1 < suggested remove operation key=ZYNIJH0TTSM6 tag=GVWP8BGKLXT6 type=del 2024-09-12T00:34:19.346 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.347+0000 7f1f2d864780 1 > prepared part key=_multipart_MSGU3PHLBRJH.2~31C5NSF3UBJC.0 size=273765 2024-09-12T00:34:19.346 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.347+0000 7f1f2d864780 1 > prepared multipart upload key=MSGU3PHLBRJH upload=31C5NSF3UBJC tag=9LF3603ZAYAI type=write size=1322341 2024-09-12T00:34:19.347 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.348+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~4Q38TG42BL0S.0 size=1048576 2024-09-12T00:34:19.348 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.349+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~4Q38TG42BL0S.1 size=501329 2024-09-12T00:34:19.351 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.352+0000 7f1f2d864780 1 < completed multipart upload key=1299IOSGYIO9 upload=4Q38TG42BL0S tag=LYCM64XECCMH type=write size=2598481 2024-09-12T00:34:19.352 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.353+0000 7f1f2d864780 1 > prepared operation key=MSGU3PHLBRJH tag=YPTV11PNHKV2 type=del size=2909419 2024-09-12T00:34:19.353 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.354+0000 7f1f2d864780 1 < completed delete operation key=DYKLAY6J018G tag=AK50S29M4BYU type=del 2024-09-12T00:34:19.355 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.356+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~E6GA50FKLFHP.0 size=1048576 2024-09-12T00:34:19.356 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.357+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~E6GA50FKLFHP.1 size=597761 2024-09-12T00:34:19.356 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.357+0000 7f1f2d864780 1 > prepared multipart upload key=D21W9QZWY0YU upload=E6GA50FKLFHP tag=82Q1Y8OLNHR2 type=write size=2694913 2024-09-12T00:34:19.358 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.358+0000 7f1f2d864780 1 < completed part key=_multipart_N9RQIGHVL8VP.2~GNUA11016707.0 size=288203 2024-09-12T00:34:19.359 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.360+0000 7f1f2d864780 1 < completed multipart upload key=N9RQIGHVL8VP upload=GNUA11016707 tag=ETJ3A4NOGW0K type=write size=1336779 2024-09-12T00:34:19.361 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.361+0000 7f1f2d864780 1 > prepared operation key=FAP6N3H7SBN0 tag=USSD6IQ82BPO type=del size=4183372 2024-09-12T00:34:19.362 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.362+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~B2AC205V8HIN.0 size=211868 2024-09-12T00:34:19.364 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.364+0000 7f1f2d864780 1 < completed multipart upload key=WGKEA4EKF5GP upload=B2AC205V8HIN tag=930L3NOZB4J5 type=write size=1260444 2024-09-12T00:34:19.365 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.366+0000 7f1f2d864780 1 > prepared operation key=W6U30X4HJCB1 tag=OYXGLYG9FCOX type=del size=692148 2024-09-12T00:34:19.366 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.367+0000 7f1f2d864780 1 < canceled operation key=D21W9QZWY0YU tag=TY7ASGIMWZIL type=del size=3288673 2024-09-12T00:34:19.367 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.368+0000 7f1f2d864780 1 > prepared operation key=WKK747ETLW10 tag=NOB9KU9J1PFW type=del size=1831597 2024-09-12T00:34:19.368 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.368+0000 7f1f2d864780 1 < canceled part key=_multipart_WKK747ETLW10.2~GJLDZRV7JK3I.0 size=1048576 2024-09-12T00:34:19.369 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.369+0000 7f1f2d864780 1 < completed part key=_multipart_WKK747ETLW10.2~GJLDZRV7JK3I.1 size=1048576 2024-09-12T00:34:19.369 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.369+0000 7f1f2d864780 1 < canceled part key=_multipart_WKK747ETLW10.2~GJLDZRV7JK3I.2 size=333399 2024-09-12T00:34:19.370 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.371+0000 7f1f2d864780 1 < canceled multipart upload key=WKK747ETLW10 upload=GJLDZRV7JK3I tag=3N1Z6BN9DBK2 type=write size=3479127 2024-09-12T00:34:19.372 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.372+0000 7f1f2d864780 1 > prepared operation key=1299IOSGYIO9 tag=JXAOC1RR7AFS type=del size=37352 2024-09-12T00:34:19.373 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.373+0000 7f1f2d864780 1 < completed delete operation key=D21W9QZWY0YU tag=YV57VKMXD53D type=del 2024-09-12T00:34:19.374 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.375+0000 7f1f2d864780 1 > prepared operation key=ZGO887JDR627 tag=HAV5DUBY1LOL type=del size=2335265 2024-09-12T00:34:19.375 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.376+0000 7f1f2d864780 1 < completed part key=_multipart_KHPF1N1MT33Z.2~K9SGE671GYVA.0 size=1048576 2024-09-12T00:34:19.376 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.377+0000 7f1f2d864780 1 < completed part key=_multipart_KHPF1N1MT33Z.2~K9SGE671GYVA.1 size=1048576 2024-09-12T00:34:19.377 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.378+0000 7f1f2d864780 1 < completed part key=_multipart_KHPF1N1MT33Z.2~K9SGE671GYVA.2 size=97862 2024-09-12T00:34:19.379 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.380+0000 7f1f2d864780 1 < completed multipart upload key=KHPF1N1MT33Z upload=K9SGE671GYVA tag=TA8U0QZ4PFJV type=write size=3243590 2024-09-12T00:34:19.380 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.381+0000 7f1f2d864780 1 > prepared operation key=PVB52GO6L8T4 tag=I58HZGR5OBKO type=write size=115855 2024-09-12T00:34:19.381 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.382+0000 7f1f2d864780 1 < completed write operation key=MSGU3PHLBRJH tag=99FFFPBJZ229 type=write size=626373 2024-09-12T00:34:19.382 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.383+0000 7f1f2d864780 1 > prepared operation key=53QCNWX1V1R1 tag=RJSUWCYQKNQB type=del size=1819101 2024-09-12T00:34:19.383 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.383+0000 7f1f2d864780 1 < canceled part key=_multipart_SNCGB6Z20450.2~VJMT8E5YC2RO.0 size=1048576 2024-09-12T00:34:19.384 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.384+0000 7f1f2d864780 1 < completed part key=_multipart_SNCGB6Z20450.2~VJMT8E5YC2RO.1 size=160006 2024-09-12T00:34:19.386 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.386+0000 7f1f2d864780 1 < canceled multipart upload key=SNCGB6Z20450 upload=VJMT8E5YC2RO tag=DUEUFNAGYT0H type=write size=2257158 2024-09-12T00:34:19.387 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.387+0000 7f1f2d864780 1 > prepared operation key=W6U30X4HJCB1 tag=6H8MXBJLR5NW type=del size=3086460 2024-09-12T00:34:19.388 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.389+0000 7f1f2d864780 1 < completed delete operation key=KHPF1N1MT33Z tag=7C1BH21PZ6L9 type=del 2024-09-12T00:34:19.390 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.391+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~P2XV13EV088Z.0 size=259507 2024-09-12T00:34:19.390 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.391+0000 7f1f2d864780 1 > prepared multipart upload key=WGKEA4EKF5GP upload=P2XV13EV088Z tag=BHE4GRFLKZ1Y type=write size=1308083 2024-09-12T00:34:19.391 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.392+0000 7f1f2d864780 1 < completed delete operation key=ZGO887JDR627 tag=42A6SNPLPG2T type=del 2024-09-12T00:34:19.392 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.393+0000 7f1f2d864780 1 > prepared operation key=D21W9QZWY0YU tag=E4VBJO3FL8DE type=write size=405511 2024-09-12T00:34:19.394 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.394+0000 7f1f2d864780 1 < completed delete operation key=OY145ZXRSF4L tag=K034D2FWFUR1 type=del 2024-09-12T00:34:19.396 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.396+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~PPSAAP4OZXB1.0 size=1048576 2024-09-12T00:34:19.397 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.397+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~PPSAAP4OZXB1.1 size=1048576 2024-09-12T00:34:19.398 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.398+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~PPSAAP4OZXB1.2 size=109813 2024-09-12T00:34:19.398 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.398+0000 7f1f2d864780 1 > prepared multipart upload key=4FRVL0KXN2X8 upload=PPSAAP4OZXB1 tag=KO8P6D7OQ2DQ type=write size=3255541 2024-09-12T00:34:19.399 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.400+0000 7f1f2d864780 1 < completed delete operation key=O1YY03BOEYLM tag=GX9AT905OTM8 type=del 2024-09-12T00:34:19.400 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.401+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=RAQH8DZ3RI4W type=del size=2665871 2024-09-12T00:34:19.401 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.402+0000 7f1f2d864780 1 < completed write operation key=2RV0899QUJ8W tag=1KXM8TZLN7Q6 type=write size=623433 2024-09-12T00:34:19.403 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.403+0000 7f1f2d864780 1 > prepared operation key=FFG41OYEYFZA tag=0E0IB5RPJP2J type=del size=1195186 2024-09-12T00:34:19.404 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.404+0000 7f1f2d864780 1 < completed part key=_multipart_MSGU3PHLBRJH.2~31C5NSF3UBJC.0 size=273765 2024-09-12T00:34:19.406 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.407+0000 7f1f2d864780 1 < completed multipart upload key=MSGU3PHLBRJH upload=31C5NSF3UBJC tag=9LF3603ZAYAI type=write size=1322341 2024-09-12T00:34:19.407 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.408+0000 7f1f2d864780 1 > prepared operation key=W6U30X4HJCB1 tag=Q45QI7YYM2VD type=del size=3471957 2024-09-12T00:34:19.408 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.409+0000 7f1f2d864780 1 < completed delete operation key=MSGU3PHLBRJH tag=YPTV11PNHKV2 type=del 2024-09-12T00:34:19.410 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.410+0000 7f1f2d864780 1 > prepared operation key=MSGU3PHLBRJH tag=HRVWI3F7JGHC type=write size=465280 2024-09-12T00:34:19.411 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.411+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~E6GA50FKLFHP.0 size=1048576 2024-09-12T00:34:19.412 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.412+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~E6GA50FKLFHP.1 size=597761 2024-09-12T00:34:19.414 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.414+0000 7f1f2d864780 1 < completed multipart upload key=D21W9QZWY0YU upload=E6GA50FKLFHP tag=82Q1Y8OLNHR2 type=write size=2694913 2024-09-12T00:34:19.416 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.416+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~6YJNCASO9Q55.0 size=1048576 2024-09-12T00:34:19.417 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.417+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~6YJNCASO9Q55.1 size=1048576 2024-09-12T00:34:19.418 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.418+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~6YJNCASO9Q55.2 size=735928 2024-09-12T00:34:19.418 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.418+0000 7f1f2d864780 1 > prepared multipart upload key=WGKEA4EKF5GP upload=6YJNCASO9Q55 tag=DADNP2WMTDKH type=write size=3881656 2024-09-12T00:34:19.419 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.419+0000 7f1f2d864780 1 < completed delete operation key=FAP6N3H7SBN0 tag=USSD6IQ82BPO type=del 2024-09-12T00:34:19.421 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.421+0000 7f1f2d864780 1 > prepared part key=_multipart_PVB52GO6L8T4.2~VWPG7Y4IUTJK.0 size=1048576 2024-09-12T00:34:19.422 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.422+0000 7f1f2d864780 1 > prepared part key=_multipart_PVB52GO6L8T4.2~VWPG7Y4IUTJK.1 size=630934 2024-09-12T00:34:19.422 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.422+0000 7f1f2d864780 1 > prepared multipart upload key=PVB52GO6L8T4 upload=VWPG7Y4IUTJK tag=06L4Y2REFT74 type=write size=2728086 2024-09-12T00:34:19.423 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.423+0000 7f1f2d864780 1 < completed delete operation key=W6U30X4HJCB1 tag=OYXGLYG9FCOX type=del 2024-09-12T00:34:19.424 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.425+0000 7f1f2d864780 1 > prepared operation key=AN26EVAZI527 tag=BLNNRBH1AT5N type=write size=123865 2024-09-12T00:34:19.425 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.426+0000 7f1f2d864780 1 < completed delete operation key=WKK747ETLW10 tag=NOB9KU9J1PFW type=del 2024-09-12T00:34:19.426 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.427+0000 7f1f2d864780 1 > prepared operation key=DYKLAY6J018G tag=DFP7E24BMSZQ type=del size=1681062 2024-09-12T00:34:19.427 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.428+0000 7f1f2d864780 1 < canceled operation key=1299IOSGYIO9 tag=JXAOC1RR7AFS type=del size=37352 2024-09-12T00:34:19.428 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.429+0000 7f1f2d864780 1 > prepared operation key=ZYNIJH0TTSM6 tag=MAEAR63WGBE8 type=del size=1526531 2024-09-12T00:34:19.430 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.430+0000 7f1f2d864780 1 < canceled operation key=ZGO887JDR627 tag=HAV5DUBY1LOL type=del size=2335265 2024-09-12T00:34:19.431 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.431+0000 7f1f2d864780 1 > prepared operation key=FAP6N3H7SBN0 tag=NAKGZDD62JEJ type=write size=707540 2024-09-12T00:34:19.432 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.432+0000 7f1f2d864780 1 < completed write operation key=PVB52GO6L8T4 tag=I58HZGR5OBKO type=write size=115855 2024-09-12T00:34:19.433 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.434+0000 7f1f2d864780 1 > prepared operation key=SZP418NVZ5VX tag=9TPDPUMLKLKR type=del size=832952 2024-09-12T00:34:19.435 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.436+0000 7f1f2d864780 1 < suggested remove operation key=53QCNWX1V1R1 tag=RJSUWCYQKNQB type=del 2024-09-12T00:34:19.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.437+0000 7f1f2d864780 1 > prepared operation key=ECZYQEZ942W8 tag=IB106RD89A2X type=del size=2446396 2024-09-12T00:34:19.437 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.438+0000 7f1f2d864780 1 < completed delete operation key=W6U30X4HJCB1 tag=6H8MXBJLR5NW type=del 2024-09-12T00:34:19.439 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.440+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~QQD5AZLE8P9J.0 size=717943 2024-09-12T00:34:19.440 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.440+0000 7f1f2d864780 1 > prepared multipart upload key=4FRVL0KXN2X8 upload=QQD5AZLE8P9J tag=KFB6B820JPXP type=write size=1766519 2024-09-12T00:34:19.441 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.441+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~P2XV13EV088Z.0 size=259507 2024-09-12T00:34:19.442 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.443+0000 7f1f2d864780 1 < completed multipart upload key=WGKEA4EKF5GP upload=P2XV13EV088Z tag=BHE4GRFLKZ1Y type=write size=1308083 2024-09-12T00:34:19.444 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.444+0000 7f1f2d864780 1 > prepared operation key=O1YY03BOEYLM tag=BVBE5K8XUXKC type=del size=3109489 2024-09-12T00:34:19.445 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.445+0000 7f1f2d864780 1 < completed write operation key=D21W9QZWY0YU tag=E4VBJO3FL8DE type=write size=405511 2024-09-12T00:34:19.447 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.447+0000 7f1f2d864780 1 > prepared part key=_multipart_OY145ZXRSF4L.2~DQ7G3CFWMDGH.0 size=132147 2024-09-12T00:34:19.447 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.447+0000 7f1f2d864780 1 > prepared multipart upload key=OY145ZXRSF4L upload=DQ7G3CFWMDGH tag=8O2CLWZP4199 type=write size=1180723 2024-09-12T00:34:19.447 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.448+0000 7f1f2d864780 1 < canceled part key=_multipart_4FRVL0KXN2X8.2~PPSAAP4OZXB1.0 size=1048576 2024-09-12T00:34:19.448 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.449+0000 7f1f2d864780 1 < completed part key=_multipart_4FRVL0KXN2X8.2~PPSAAP4OZXB1.1 size=1048576 2024-09-12T00:34:19.449 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.449+0000 7f1f2d864780 1 < completed part key=_multipart_4FRVL0KXN2X8.2~PPSAAP4OZXB1.2 size=109813 2024-09-12T00:34:19.451 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.451+0000 7f1f2d864780 1 < canceled multipart upload key=4FRVL0KXN2X8 upload=PPSAAP4OZXB1 tag=KO8P6D7OQ2DQ type=write size=3255541 2024-09-12T00:34:19.453 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.454+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~ENLXULAGYIYV.0 size=796369 2024-09-12T00:34:19.453 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.454+0000 7f1f2d864780 1 > prepared multipart upload key=SZP418NVZ5VX upload=ENLXULAGYIYV tag=S3O7IQPCOSOZ type=write size=1844945 2024-09-12T00:34:19.454 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.455+0000 7f1f2d864780 1 < completed delete operation key=2RV0899QUJ8W tag=RAQH8DZ3RI4W type=del 2024-09-12T00:34:19.455 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.456+0000 7f1f2d864780 1 > prepared operation key=GSPM8N0K7ODC tag=3F3LCQWOSFTZ type=del size=2107582 2024-09-12T00:34:19.458 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.459+0000 7f1f2d864780 1 < completed delete operation key=FFG41OYEYFZA tag=0E0IB5RPJP2J type=del 2024-09-12T00:34:19.459 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.460+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=Q93NVL9IALBO type=del size=3087507 2024-09-12T00:34:19.461 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.462+0000 7f1f2d864780 1 < completed delete operation key=W6U30X4HJCB1 tag=Q45QI7YYM2VD type=del 2024-09-12T00:34:19.463 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.463+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=LJGESUA6CXMW type=del size=2064201 2024-09-12T00:34:19.465 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.466+0000 7f1f2d864780 1 < completed write operation key=MSGU3PHLBRJH tag=HRVWI3F7JGHC type=write size=465280 2024-09-12T00:34:19.467 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.468+0000 7f1f2d864780 1 > prepared part key=_multipart_PVB52GO6L8T4.2~5Z818QWGJ1XW.0 size=229336 2024-09-12T00:34:19.468 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.468+0000 7f1f2d864780 1 > prepared multipart upload key=PVB52GO6L8T4 upload=5Z818QWGJ1XW tag=G7TAONX61P3D type=write size=1277912 2024-09-12T00:34:19.469 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.469+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~6YJNCASO9Q55.0 size=1048576 2024-09-12T00:34:19.470 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.470+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~6YJNCASO9Q55.1 size=1048576 2024-09-12T00:34:19.471 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.471+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~6YJNCASO9Q55.2 size=735928 2024-09-12T00:34:19.473 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.474+0000 7f1f2d864780 1 < completed multipart upload key=WGKEA4EKF5GP upload=6YJNCASO9Q55 tag=DADNP2WMTDKH type=write size=3881656 2024-09-12T00:34:19.475 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.476+0000 7f1f2d864780 1 > prepared part key=_multipart_UTR2UUO6DHLJ.2~BGNR16RST5PQ.0 size=1048576 2024-09-12T00:34:19.476 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.477+0000 7f1f2d864780 1 > prepared part key=_multipart_UTR2UUO6DHLJ.2~BGNR16RST5PQ.1 size=1048576 2024-09-12T00:34:19.477 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.478+0000 7f1f2d864780 1 > prepared part key=_multipart_UTR2UUO6DHLJ.2~BGNR16RST5PQ.2 size=41370 2024-09-12T00:34:19.477 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.478+0000 7f1f2d864780 1 > prepared multipart upload key=UTR2UUO6DHLJ upload=BGNR16RST5PQ tag=98W32XROS57C type=write size=3187098 2024-09-12T00:34:19.478 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.478+0000 7f1f2d864780 1 < canceled part key=_multipart_PVB52GO6L8T4.2~VWPG7Y4IUTJK.0 size=1048576 2024-09-12T00:34:19.478 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.478+0000 7f1f2d864780 1 < canceled part key=_multipart_PVB52GO6L8T4.2~VWPG7Y4IUTJK.1 size=630934 2024-09-12T00:34:19.480 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.480+0000 7f1f2d864780 1 < canceled multipart upload key=PVB52GO6L8T4 upload=VWPG7Y4IUTJK tag=06L4Y2REFT74 type=write size=2728086 2024-09-12T00:34:19.481 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.482+0000 7f1f2d864780 1 > prepared part key=_multipart_OY145ZXRSF4L.2~H14X80F5GZXT.0 size=1048576 2024-09-12T00:34:19.482 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.483+0000 7f1f2d864780 1 > prepared part key=_multipart_OY145ZXRSF4L.2~H14X80F5GZXT.1 size=617642 2024-09-12T00:34:19.482 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.483+0000 7f1f2d864780 1 > prepared multipart upload key=OY145ZXRSF4L upload=H14X80F5GZXT tag=3F3ZZRPEG72J type=write size=2714794 2024-09-12T00:34:19.485 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.485+0000 7f1f2d864780 1 < suggested remove operation key=AN26EVAZI527 tag=BLNNRBH1AT5N type=write 2024-09-12T00:34:19.487 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.488+0000 7f1f2d864780 1 > prepared part key=_multipart_2YCGIJRK6MUH.2~PS8L7WJJGY1X.0 size=1048576 2024-09-12T00:34:19.489 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.489+0000 7f1f2d864780 1 > prepared part key=_multipart_2YCGIJRK6MUH.2~PS8L7WJJGY1X.1 size=344851 2024-09-12T00:34:19.489 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.489+0000 7f1f2d864780 1 > prepared multipart upload key=2YCGIJRK6MUH upload=PS8L7WJJGY1X tag=7A63DI17PTUE type=write size=2442003 2024-09-12T00:34:19.491 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.492+0000 7f1f2d864780 1 < suggested remove operation key=DYKLAY6J018G tag=DFP7E24BMSZQ type=del 2024-09-12T00:34:19.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.494+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~HEAEK7O0JUF6.0 size=1048576 2024-09-12T00:34:19.494 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.495+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~HEAEK7O0JUF6.1 size=1048576 2024-09-12T00:34:19.495 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.496+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~HEAEK7O0JUF6.2 size=556048 2024-09-12T00:34:19.495 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.496+0000 7f1f2d864780 1 > prepared multipart upload key=D21W9QZWY0YU upload=HEAEK7O0JUF6 tag=205OY2L0YUZ0 type=write size=3701776 2024-09-12T00:34:19.497 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.497+0000 7f1f2d864780 1 < completed delete operation key=ZYNIJH0TTSM6 tag=MAEAR63WGBE8 type=del 2024-09-12T00:34:19.498 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.499+0000 7f1f2d864780 1 > prepared operation key=1299IOSGYIO9 tag=1Y81IBZ2NVC9 type=write size=694596 2024-09-12T00:34:19.499 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.500+0000 7f1f2d864780 1 < completed write operation key=FAP6N3H7SBN0 tag=NAKGZDD62JEJ type=write size=707540 2024-09-12T00:34:19.501 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.502+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~65VK5H7I0BQ5.0 size=1048576 2024-09-12T00:34:19.502 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.503+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~65VK5H7I0BQ5.1 size=1048576 2024-09-12T00:34:19.503 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.504+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~65VK5H7I0BQ5.2 size=329337 2024-09-12T00:34:19.503 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.504+0000 7f1f2d864780 1 > prepared multipart upload key=1299IOSGYIO9 upload=65VK5H7I0BQ5 tag=E8LOV1ZW46W5 type=write size=3475065 2024-09-12T00:34:19.505 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.505+0000 7f1f2d864780 1 < completed delete operation key=SZP418NVZ5VX tag=9TPDPUMLKLKR type=del 2024-09-12T00:34:19.507 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.507+0000 7f1f2d864780 1 > prepared part key=_multipart_WKK747ETLW10.2~NHGPSNNZ6G3B.0 size=758111 2024-09-12T00:34:19.507 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.507+0000 7f1f2d864780 1 > prepared multipart upload key=WKK747ETLW10 upload=NHGPSNNZ6G3B tag=28YC3CAKVBLV type=write size=1806687 2024-09-12T00:34:19.508 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.509+0000 7f1f2d864780 1 < completed delete operation key=ECZYQEZ942W8 tag=IB106RD89A2X type=del 2024-09-12T00:34:19.509 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.510+0000 7f1f2d864780 1 > prepared operation key=DYKLAY6J018G tag=RVEYYHJO6RSW type=del size=2434360 2024-09-12T00:34:19.511 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.511+0000 7f1f2d864780 1 < completed part key=_multipart_4FRVL0KXN2X8.2~QQD5AZLE8P9J.0 size=717943 2024-09-12T00:34:19.513 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.514+0000 7f1f2d864780 1 < completed multipart upload key=4FRVL0KXN2X8 upload=QQD5AZLE8P9J tag=KFB6B820JPXP type=write size=1766519 2024-09-12T00:34:19.514 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.515+0000 7f1f2d864780 1 > prepared operation key=GSPM8N0K7ODC tag=WE0TQZ1YIAPP type=del size=3923796 2024-09-12T00:34:19.515 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.516+0000 7f1f2d864780 1 < completed delete operation key=O1YY03BOEYLM tag=BVBE5K8XUXKC type=del 2024-09-12T00:34:19.518 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.518+0000 7f1f2d864780 1 > prepared part key=_multipart_O1YY03BOEYLM.2~W8C46DYJ2RIJ.0 size=1048576 2024-09-12T00:34:19.519 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.519+0000 7f1f2d864780 1 > prepared part key=_multipart_O1YY03BOEYLM.2~W8C46DYJ2RIJ.1 size=881760 2024-09-12T00:34:19.519 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.519+0000 7f1f2d864780 1 > prepared multipart upload key=O1YY03BOEYLM upload=W8C46DYJ2RIJ tag=QSOMZH150FWM type=write size=2978912 2024-09-12T00:34:19.520 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.520+0000 7f1f2d864780 1 < completed part key=_multipart_OY145ZXRSF4L.2~DQ7G3CFWMDGH.0 size=132147 2024-09-12T00:34:19.522 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.522+0000 7f1f2d864780 1 < completed multipart upload key=OY145ZXRSF4L upload=DQ7G3CFWMDGH tag=8O2CLWZP4199 type=write size=1180723 2024-09-12T00:34:19.523 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.524+0000 7f1f2d864780 1 > prepared operation key=UTR2UUO6DHLJ tag=AFNTHKM8F9GN type=del size=3330590 2024-09-12T00:34:19.524 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.525+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~ENLXULAGYIYV.0 size=796369 2024-09-12T00:34:19.526 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.527+0000 7f1f2d864780 1 < completed multipart upload key=SZP418NVZ5VX upload=ENLXULAGYIYV tag=S3O7IQPCOSOZ type=write size=1844945 2024-09-12T00:34:19.527 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.528+0000 7f1f2d864780 1 > prepared operation key=WIIU8VTCLWOD tag=YUQGRFQDEE0H type=del size=2175837 2024-09-12T00:34:19.528 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.529+0000 7f1f2d864780 1 < completed delete operation key=GSPM8N0K7ODC tag=3F3LCQWOSFTZ type=del 2024-09-12T00:34:19.529 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.530+0000 7f1f2d864780 1 > prepared operation key=FAP6N3H7SBN0 tag=XDJMI5X9VIKU type=del size=128773 2024-09-12T00:34:19.531 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.531+0000 7f1f2d864780 1 < completed delete operation key=2RV0899QUJ8W tag=Q93NVL9IALBO type=del 2024-09-12T00:34:19.532 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.533+0000 7f1f2d864780 1 > prepared operation key=D21W9QZWY0YU tag=JULM5364H824 type=del size=1001877 2024-09-12T00:34:19.533 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.534+0000 7f1f2d864780 1 < completed delete operation key=2RV0899QUJ8W tag=LJGESUA6CXMW type=del 2024-09-12T00:34:19.534 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.535+0000 7f1f2d864780 1 > prepared operation key=ZYNIJH0TTSM6 tag=0K5H7I9WM6VT type=del size=1996040 2024-09-12T00:34:19.535 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.536+0000 7f1f2d864780 1 < completed part key=_multipart_PVB52GO6L8T4.2~5Z818QWGJ1XW.0 size=229336 2024-09-12T00:34:19.537 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.538+0000 7f1f2d864780 1 < completed multipart upload key=PVB52GO6L8T4 upload=5Z818QWGJ1XW tag=G7TAONX61P3D type=write size=1277912 2024-09-12T00:34:19.539 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.539+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=A9JBSSMS3F4D type=del size=3336039 2024-09-12T00:34:19.540 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.541+0000 7f1f2d864780 1 < completed part key=_multipart_UTR2UUO6DHLJ.2~BGNR16RST5PQ.0 size=1048576 2024-09-12T00:34:19.540 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.541+0000 7f1f2d864780 1 < canceled part key=_multipart_UTR2UUO6DHLJ.2~BGNR16RST5PQ.1 size=1048576 2024-09-12T00:34:19.541 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.542+0000 7f1f2d864780 1 < completed part key=_multipart_UTR2UUO6DHLJ.2~BGNR16RST5PQ.2 size=41370 2024-09-12T00:34:19.543 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.544+0000 7f1f2d864780 1 < canceled multipart upload key=UTR2UUO6DHLJ upload=BGNR16RST5PQ tag=98W32XROS57C type=write size=3187098 2024-09-12T00:34:19.545 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.545+0000 7f1f2d864780 1 > prepared operation key=AN26EVAZI527 tag=0T86ME5SZ7P0 type=del size=1189599 2024-09-12T00:34:19.546 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.547+0000 7f1f2d864780 1 < completed part key=_multipart_OY145ZXRSF4L.2~H14X80F5GZXT.0 size=1048576 2024-09-12T00:34:19.547 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.548+0000 7f1f2d864780 1 < completed part key=_multipart_OY145ZXRSF4L.2~H14X80F5GZXT.1 size=617642 2024-09-12T00:34:19.549 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.550+0000 7f1f2d864780 1 < completed multipart upload key=OY145ZXRSF4L upload=H14X80F5GZXT tag=3F3ZZRPEG72J type=write size=2714794 2024-09-12T00:34:19.550 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.551+0000 7f1f2d864780 1 > prepared operation key=WGKEA4EKF5GP tag=90EK2G01HJYY type=del size=4162247 2024-09-12T00:34:19.551 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.552+0000 7f1f2d864780 1 < completed part key=_multipart_2YCGIJRK6MUH.2~PS8L7WJJGY1X.0 size=1048576 2024-09-12T00:34:19.553 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.553+0000 7f1f2d864780 1 < completed part key=_multipart_2YCGIJRK6MUH.2~PS8L7WJJGY1X.1 size=344851 2024-09-12T00:34:19.554 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.555+0000 7f1f2d864780 1 < completed multipart upload key=2YCGIJRK6MUH upload=PS8L7WJJGY1X tag=7A63DI17PTUE type=write size=2442003 2024-09-12T00:34:19.556 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.556+0000 7f1f2d864780 1 > prepared operation key=S5DVMA14N7VJ tag=AUA0RFLKU0W6 type=write size=893532 2024-09-12T00:34:19.557 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.558+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~HEAEK7O0JUF6.0 size=1048576 2024-09-12T00:34:19.558 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.559+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~HEAEK7O0JUF6.1 size=1048576 2024-09-12T00:34:19.559 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.559+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~HEAEK7O0JUF6.2 size=556048 2024-09-12T00:34:19.561 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.562+0000 7f1f2d864780 1 < completed multipart upload key=D21W9QZWY0YU upload=HEAEK7O0JUF6 tag=205OY2L0YUZ0 type=write size=3701776 2024-09-12T00:34:19.562 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.563+0000 7f1f2d864780 1 > prepared operation key=W6U30X4HJCB1 tag=CCA81R8S1JF6 type=write size=153282 2024-09-12T00:34:19.563 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.564+0000 7f1f2d864780 1 < canceled operation key=1299IOSGYIO9 tag=1Y81IBZ2NVC9 type=write size=694596 2024-09-12T00:34:19.564 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.565+0000 7f1f2d864780 1 > prepared operation key=4FRVL0KXN2X8 tag=13SV9T9TRL5J type=del size=3455906 2024-09-12T00:34:19.566 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.566+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~65VK5H7I0BQ5.0 size=1048576 2024-09-12T00:34:19.567 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.567+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~65VK5H7I0BQ5.1 size=1048576 2024-09-12T00:34:19.568 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.569+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~65VK5H7I0BQ5.2 size=329337 2024-09-12T00:34:19.570 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.571+0000 7f1f2d864780 1 < completed multipart upload key=1299IOSGYIO9 upload=65VK5H7I0BQ5 tag=E8LOV1ZW46W5 type=write size=3475065 2024-09-12T00:34:19.572 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.573+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~XOM2CCECYYHJ.0 size=1048576 2024-09-12T00:34:19.574 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.574+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~XOM2CCECYYHJ.1 size=387161 2024-09-12T00:34:19.574 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.574+0000 7f1f2d864780 1 > prepared multipart upload key=FAP6N3H7SBN0 upload=XOM2CCECYYHJ tag=CV2GCGIOJZ5Y type=write size=2484313 2024-09-12T00:34:19.575 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.575+0000 7f1f2d864780 1 < completed part key=_multipart_WKK747ETLW10.2~NHGPSNNZ6G3B.0 size=758111 2024-09-12T00:34:19.577 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.578+0000 7f1f2d864780 1 < completed multipart upload key=WKK747ETLW10 upload=NHGPSNNZ6G3B tag=28YC3CAKVBLV type=write size=1806687 2024-09-12T00:34:19.579 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.579+0000 7f1f2d864780 1 > prepared operation key=O1YY03BOEYLM tag=HP1D3T3W2B7B type=write size=939256 2024-09-12T00:34:19.580 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.580+0000 7f1f2d864780 1 < completed delete operation key=DYKLAY6J018G tag=RVEYYHJO6RSW type=del 2024-09-12T00:34:19.581 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.582+0000 7f1f2d864780 1 > prepared operation key=N9RQIGHVL8VP tag=FSLHFZAAHFSG type=write size=255823 2024-09-12T00:34:19.583 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.584+0000 7f1f2d864780 1 < suggested update operation key=GSPM8N0K7ODC tag=WE0TQZ1YIAPP type=del size=3923796 2024-09-12T00:34:19.585 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.586+0000 7f1f2d864780 1 > prepared part key=_multipart_9XK59MVZ5G1O.2~F2J9ATJFU5TE.0 size=722915 2024-09-12T00:34:19.586 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.586+0000 7f1f2d864780 1 > prepared multipart upload key=9XK59MVZ5G1O upload=F2J9ATJFU5TE tag=72F3VSGOCRQD type=write size=1771491 2024-09-12T00:34:19.587 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.587+0000 7f1f2d864780 1 < completed part key=_multipart_O1YY03BOEYLM.2~W8C46DYJ2RIJ.0 size=1048576 2024-09-12T00:34:19.588 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.589+0000 7f1f2d864780 1 < completed part key=_multipart_O1YY03BOEYLM.2~W8C46DYJ2RIJ.1 size=881760 2024-09-12T00:34:19.590 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.590+0000 7f1f2d864780 1 < completed multipart upload key=O1YY03BOEYLM upload=W8C46DYJ2RIJ tag=QSOMZH150FWM type=write size=2978912 2024-09-12T00:34:19.591 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.591+0000 7f1f2d864780 1 > prepared operation key=KHPF1N1MT33Z tag=ODKIZ1IS0BUE type=write size=31694 2024-09-12T00:34:19.592 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.593+0000 7f1f2d864780 1 < completed delete operation key=UTR2UUO6DHLJ tag=AFNTHKM8F9GN type=del 2024-09-12T00:34:19.593 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.594+0000 7f1f2d864780 1 > prepared operation key=ZGO887JDR627 tag=V9MKM3FNR9BD type=del size=2153452 2024-09-12T00:34:19.595 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.596+0000 7f1f2d864780 1 < suggested remove operation key=WIIU8VTCLWOD tag=YUQGRFQDEE0H type=del 2024-09-12T00:34:19.597 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.597+0000 7f1f2d864780 1 > prepared operation key=ECZYQEZ942W8 tag=VQPBOUSMP3RR type=write size=878820 2024-09-12T00:34:19.598 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.598+0000 7f1f2d864780 1 < completed delete operation key=FAP6N3H7SBN0 tag=XDJMI5X9VIKU type=del 2024-09-12T00:34:19.600 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.601+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~1GVI82VHAWKD.0 size=1048576 2024-09-12T00:34:19.601 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.602+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~1GVI82VHAWKD.1 size=1048576 2024-09-12T00:34:19.602 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.603+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~1GVI82VHAWKD.2 size=707561 2024-09-12T00:34:19.602 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.603+0000 7f1f2d864780 1 > prepared multipart upload key=D21W9QZWY0YU upload=1GVI82VHAWKD tag=3TA5LCKUD0OE type=write size=3853289 2024-09-12T00:34:19.603 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.604+0000 7f1f2d864780 1 < completed delete operation key=D21W9QZWY0YU tag=JULM5364H824 type=del 2024-09-12T00:34:19.605 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.606+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~1J1XNH5EH7YC.0 size=1048576 2024-09-12T00:34:19.606 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.607+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~1J1XNH5EH7YC.1 size=1048576 2024-09-12T00:34:19.607 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.608+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~1J1XNH5EH7YC.2 size=394743 2024-09-12T00:34:19.607 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.608+0000 7f1f2d864780 1 > prepared multipart upload key=W6U30X4HJCB1 upload=1J1XNH5EH7YC tag=H8VQ8CUMSDZY type=write size=3540471 2024-09-12T00:34:19.608 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.609+0000 7f1f2d864780 1 < completed delete operation key=ZYNIJH0TTSM6 tag=0K5H7I9WM6VT type=del 2024-09-12T00:34:19.610 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.611+0000 7f1f2d864780 1 > prepared part key=_multipart_KHPF1N1MT33Z.2~G63NBD2N0OM1.0 size=616278 2024-09-12T00:34:19.611 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.611+0000 7f1f2d864780 1 > prepared multipart upload key=KHPF1N1MT33Z upload=G63NBD2N0OM1 tag=O9P2DL2A40AD type=write size=1664854 2024-09-12T00:34:19.613 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.613+0000 7f1f2d864780 1 < suggested remove operation key=2RV0899QUJ8W tag=A9JBSSMS3F4D type=del 2024-09-12T00:34:19.614 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.615+0000 7f1f2d864780 1 > prepared operation key=WKK747ETLW10 tag=6OWSSAZ71DTY type=write size=979282 2024-09-12T00:34:19.615 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.616+0000 7f1f2d864780 1 < completed delete operation key=AN26EVAZI527 tag=0T86ME5SZ7P0 type=del 2024-09-12T00:34:19.617 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.618+0000 7f1f2d864780 1 > prepared part key=_multipart_FFG41OYEYFZA.2~7A00TTJWOSI2.0 size=1048576 2024-09-12T00:34:19.618 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.619+0000 7f1f2d864780 1 > prepared part key=_multipart_FFG41OYEYFZA.2~7A00TTJWOSI2.1 size=77905 2024-09-12T00:34:19.618 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.619+0000 7f1f2d864780 1 > prepared multipart upload key=FFG41OYEYFZA upload=7A00TTJWOSI2 tag=1DGZ2YNIQYO1 type=write size=2175057 2024-09-12T00:34:19.619 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.620+0000 7f1f2d864780 1 < completed delete operation key=WGKEA4EKF5GP tag=90EK2G01HJYY type=del 2024-09-12T00:34:19.621 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.622+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~8XJM8SCXU120.0 size=865539 2024-09-12T00:34:19.622 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.622+0000 7f1f2d864780 1 > prepared multipart upload key=W6U30X4HJCB1 upload=8XJM8SCXU120 tag=VAVA707ZUV4C type=write size=1914115 2024-09-12T00:34:19.623 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.623+0000 7f1f2d864780 1 < canceled operation key=S5DVMA14N7VJ tag=AUA0RFLKU0W6 type=write size=893532 2024-09-12T00:34:19.624 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.624+0000 7f1f2d864780 1 > prepared operation key=UTR2UUO6DHLJ tag=KYTBFXM4TA70 type=del size=3900276 2024-09-12T00:34:19.626 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.627+0000 7f1f2d864780 1 < suggested remove operation key=W6U30X4HJCB1 tag=CCA81R8S1JF6 type=write 2024-09-12T00:34:19.627 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.628+0000 7f1f2d864780 1 > prepared operation key=N9RQIGHVL8VP tag=9CFKSGR8508G type=del size=153637 2024-09-12T00:34:19.628 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.629+0000 7f1f2d864780 1 < completed delete operation key=4FRVL0KXN2X8 tag=13SV9T9TRL5J type=del 2024-09-12T00:34:19.630 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.631+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~B657JB5SEVL6.0 size=97875 2024-09-12T00:34:19.630 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.631+0000 7f1f2d864780 1 > prepared multipart upload key=0DSQOFS8IIF5 upload=B657JB5SEVL6 tag=KDKU752YV7O8 type=write size=1146451 2024-09-12T00:34:19.631 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.632+0000 7f1f2d864780 1 < completed part key=_multipart_FAP6N3H7SBN0.2~XOM2CCECYYHJ.0 size=1048576 2024-09-12T00:34:19.632 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.633+0000 7f1f2d864780 1 < completed part key=_multipart_FAP6N3H7SBN0.2~XOM2CCECYYHJ.1 size=387161 2024-09-12T00:34:19.634 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.635+0000 7f1f2d864780 1 < completed multipart upload key=FAP6N3H7SBN0 upload=XOM2CCECYYHJ tag=CV2GCGIOJZ5Y type=write size=2484313 2024-09-12T00:34:19.636 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.636+0000 7f1f2d864780 1 > prepared operation key=WKK747ETLW10 tag=NEUC1GLE8SQT type=del size=736778 2024-09-12T00:34:19.637 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.637+0000 7f1f2d864780 1 < completed write operation key=O1YY03BOEYLM tag=HP1D3T3W2B7B type=write size=939256 2024-09-12T00:34:19.638 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.638+0000 7f1f2d864780 1 > prepared operation key=WKK747ETLW10 tag=TOMW30XJDRRY type=del size=3093488 2024-09-12T00:34:19.639 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.640+0000 7f1f2d864780 1 < completed write operation key=N9RQIGHVL8VP tag=FSLHFZAAHFSG type=write size=255823 2024-09-12T00:34:19.641 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.642+0000 7f1f2d864780 1 > prepared part key=_multipart_WKK747ETLW10.2~U65ZS64GWKZH.0 size=571824 2024-09-12T00:34:19.641 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.642+0000 7f1f2d864780 1 > prepared multipart upload key=WKK747ETLW10 upload=U65ZS64GWKZH tag=ZOYKVE9LE4EV type=write size=1620400 2024-09-12T00:34:19.642 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.643+0000 7f1f2d864780 1 < completed part key=_multipart_9XK59MVZ5G1O.2~F2J9ATJFU5TE.0 size=722915 2024-09-12T00:34:19.644 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.645+0000 7f1f2d864780 1 < completed multipart upload key=9XK59MVZ5G1O upload=F2J9ATJFU5TE tag=72F3VSGOCRQD type=write size=1771491 2024-09-12T00:34:19.648 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.647+0000 7f1f2d864780 1 > prepared part key=_multipart_SNCGB6Z20450.2~VJN5HA7ZILNK.0 size=598266 2024-09-12T00:34:19.648 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.647+0000 7f1f2d864780 1 > prepared multipart upload key=SNCGB6Z20450 upload=VJN5HA7ZILNK tag=LR0VSD9SA4B8 type=write size=1646842 2024-09-12T00:34:19.649 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.649+0000 7f1f2d864780 1 < suggested update operation key=KHPF1N1MT33Z tag=ODKIZ1IS0BUE type=write size=31694 2024-09-12T00:34:19.650 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.651+0000 7f1f2d864780 1 > prepared part key=_multipart_OY145ZXRSF4L.2~8LM81DULK292.0 size=1048576 2024-09-12T00:34:19.652 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.652+0000 7f1f2d864780 1 > prepared part key=_multipart_OY145ZXRSF4L.2~8LM81DULK292.1 size=1048576 2024-09-12T00:34:19.653 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.653+0000 7f1f2d864780 1 > prepared part key=_multipart_OY145ZXRSF4L.2~8LM81DULK292.2 size=795419 2024-09-12T00:34:19.653 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.653+0000 7f1f2d864780 1 > prepared multipart upload key=OY145ZXRSF4L upload=8LM81DULK292 tag=BHWNJG6O565G type=write size=3941147 2024-09-12T00:34:19.654 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.654+0000 7f1f2d864780 1 < completed delete operation key=ZGO887JDR627 tag=V9MKM3FNR9BD type=del 2024-09-12T00:34:19.656 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.656+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~JIGXACOVANDE.0 size=613047 2024-09-12T00:34:19.656 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.656+0000 7f1f2d864780 1 > prepared multipart upload key=4FRVL0KXN2X8 upload=JIGXACOVANDE tag=II652KJC0P5P type=write size=1661623 2024-09-12T00:34:19.658 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.659+0000 7f1f2d864780 1 < suggested remove operation key=ECZYQEZ942W8 tag=VQPBOUSMP3RR type=write 2024-09-12T00:34:19.660 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.661+0000 7f1f2d864780 1 > prepared part key=_multipart_MSGU3PHLBRJH.2~UHHZXT3HZ0XM.0 size=346398 2024-09-12T00:34:19.660 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.661+0000 7f1f2d864780 1 > prepared multipart upload key=MSGU3PHLBRJH upload=UHHZXT3HZ0XM tag=VXGX0JSW1OKY type=write size=1394974 2024-09-12T00:34:19.668 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.669+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~1GVI82VHAWKD.0 size=1048576 2024-09-12T00:34:19.669 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.670+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~1GVI82VHAWKD.1 size=1048576 2024-09-12T00:34:19.671 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.671+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~1GVI82VHAWKD.2 size=707561 2024-09-12T00:34:19.673 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.673+0000 7f1f2d864780 1 < completed multipart upload key=D21W9QZWY0YU upload=1GVI82VHAWKD tag=3TA5LCKUD0OE type=write size=3853289 2024-09-12T00:34:19.674 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.674+0000 7f1f2d864780 1 > prepared operation key=DYKLAY6J018G tag=897NVU8DTH3O type=del size=1332760 2024-09-12T00:34:19.674 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.675+0000 7f1f2d864780 1 < canceled part key=_multipart_W6U30X4HJCB1.2~1J1XNH5EH7YC.0 size=1048576 2024-09-12T00:34:19.674 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.675+0000 7f1f2d864780 1 < canceled part key=_multipart_W6U30X4HJCB1.2~1J1XNH5EH7YC.1 size=1048576 2024-09-12T00:34:19.675 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.676+0000 7f1f2d864780 1 < completed part key=_multipart_W6U30X4HJCB1.2~1J1XNH5EH7YC.2 size=394743 2024-09-12T00:34:19.677 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.677+0000 7f1f2d864780 1 < canceled multipart upload key=W6U30X4HJCB1 upload=1J1XNH5EH7YC tag=H8VQ8CUMSDZY type=write size=3540471 2024-09-12T00:34:19.678 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.679+0000 7f1f2d864780 1 > prepared operation key=PVB52GO6L8T4 tag=M1N5PPX27BD2 type=del size=2527879 2024-09-12T00:34:19.679 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.680+0000 7f1f2d864780 1 < completed part key=_multipart_KHPF1N1MT33Z.2~G63NBD2N0OM1.0 size=616278 2024-09-12T00:34:19.681 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.682+0000 7f1f2d864780 1 < completed multipart upload key=KHPF1N1MT33Z upload=G63NBD2N0OM1 tag=O9P2DL2A40AD type=write size=1664854 2024-09-12T00:34:19.682 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.683+0000 7f1f2d864780 1 > prepared operation key=OY145ZXRSF4L tag=21QF2D76V6GV type=write size=266813 2024-09-12T00:34:19.683 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.685+0000 7f1f2d864780 1 < canceled operation key=WKK747ETLW10 tag=6OWSSAZ71DTY type=write size=979282 2024-09-12T00:34:19.685 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.686+0000 7f1f2d864780 1 > prepared part key=_multipart_53QCNWX1V1R1.2~0478TB3TZ29P.0 size=1048576 2024-09-12T00:34:19.686 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.687+0000 7f1f2d864780 1 > prepared part key=_multipart_53QCNWX1V1R1.2~0478TB3TZ29P.1 size=546110 2024-09-12T00:34:19.686 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.687+0000 7f1f2d864780 1 > prepared multipart upload key=53QCNWX1V1R1 upload=0478TB3TZ29P tag=SF2J2VEBBA2L type=write size=2643262 2024-09-12T00:34:19.688 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.688+0000 7f1f2d864780 1 < completed part key=_multipart_FFG41OYEYFZA.2~7A00TTJWOSI2.0 size=1048576 2024-09-12T00:34:19.689 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.689+0000 7f1f2d864780 1 < completed part key=_multipart_FFG41OYEYFZA.2~7A00TTJWOSI2.1 size=77905 2024-09-12T00:34:19.690 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.691+0000 7f1f2d864780 1 < completed multipart upload key=FFG41OYEYFZA upload=7A00TTJWOSI2 tag=1DGZ2YNIQYO1 type=write size=2175057 2024-09-12T00:34:19.693 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.694+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~UYR0OYAWPSNZ.0 size=1048576 2024-09-12T00:34:19.694 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.695+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~UYR0OYAWPSNZ.1 size=1048576 2024-09-12T00:34:19.695 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.696+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~UYR0OYAWPSNZ.2 size=909931 2024-09-12T00:34:19.695 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.696+0000 7f1f2d864780 1 > prepared multipart upload key=D21W9QZWY0YU upload=UYR0OYAWPSNZ tag=9F9550XXZIG3 type=write size=4055659 2024-09-12T00:34:19.696 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.697+0000 7f1f2d864780 1 < completed part key=_multipart_W6U30X4HJCB1.2~8XJM8SCXU120.0 size=865539 2024-09-12T00:34:19.699 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.700+0000 7f1f2d864780 1 < completed multipart upload key=W6U30X4HJCB1 upload=8XJM8SCXU120 tag=VAVA707ZUV4C type=write size=1914115 2024-09-12T00:34:19.702 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.702+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~TF6IN5PE2625.0 size=258985 2024-09-12T00:34:19.702 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.702+0000 7f1f2d864780 1 > prepared multipart upload key=SZP418NVZ5VX upload=TF6IN5PE2625 tag=9BKWQAPHK9CQ type=write size=1307561 2024-09-12T00:34:19.704 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.704+0000 7f1f2d864780 1 < suggested remove operation key=UTR2UUO6DHLJ tag=KYTBFXM4TA70 type=del 2024-09-12T00:34:19.705 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.706+0000 7f1f2d864780 1 > prepared operation key=2YCGIJRK6MUH tag=NCVF4OKSETEM type=write size=281107 2024-09-12T00:34:19.707 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.708+0000 7f1f2d864780 1 < suggested remove operation key=N9RQIGHVL8VP tag=9CFKSGR8508G type=del 2024-09-12T00:34:19.708 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.709+0000 7f1f2d864780 1 > prepared operation key=ZGO887JDR627 tag=BJR3A8V4BJU5 type=del size=940894 2024-09-12T00:34:19.710 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.711+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~B657JB5SEVL6.0 size=97875 2024-09-12T00:34:19.712 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.713+0000 7f1f2d864780 1 < completed multipart upload key=0DSQOFS8IIF5 upload=B657JB5SEVL6 tag=KDKU752YV7O8 type=write size=1146451 2024-09-12T00:34:19.713 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.714+0000 7f1f2d864780 1 > prepared operation key=FAP6N3H7SBN0 tag=YB028L7KQGD9 type=del size=2987247 2024-09-12T00:34:19.714 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.715+0000 7f1f2d864780 1 < completed delete operation key=WKK747ETLW10 tag=NEUC1GLE8SQT type=del 2024-09-12T00:34:19.715 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.717+0000 7f1f2d864780 1 > prepared operation key=N9RQIGHVL8VP tag=KBYYJ30G8U49 type=del size=1380253 2024-09-12T00:34:19.717 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.718+0000 7f1f2d864780 1 < canceled operation key=WKK747ETLW10 tag=TOMW30XJDRRY type=del size=3093488 2024-09-12T00:34:19.718 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.719+0000 7f1f2d864780 1 > prepared operation key=2YCGIJRK6MUH tag=UVI33T4FCKCM type=del size=1304018 2024-09-12T00:34:19.719 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.720+0000 7f1f2d864780 1 < completed part key=_multipart_WKK747ETLW10.2~U65ZS64GWKZH.0 size=571824 2024-09-12T00:34:19.721 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.722+0000 7f1f2d864780 1 < completed multipart upload key=WKK747ETLW10 upload=U65ZS64GWKZH tag=ZOYKVE9LE4EV type=write size=1620400 2024-09-12T00:34:19.723 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.724+0000 7f1f2d864780 1 > prepared operation key=SZP418NVZ5VX tag=D2DHNECVKD07 type=del size=3366339 2024-09-12T00:34:19.724 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.725+0000 7f1f2d864780 1 < completed part key=_multipart_SNCGB6Z20450.2~VJN5HA7ZILNK.0 size=598266 2024-09-12T00:34:19.726 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.727+0000 7f1f2d864780 1 < completed multipart upload key=SNCGB6Z20450 upload=VJN5HA7ZILNK tag=LR0VSD9SA4B8 type=write size=1646842 2024-09-12T00:34:19.727 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.729+0000 7f1f2d864780 1 > prepared operation key=WKK747ETLW10 tag=0UCMUCVB1CCH type=del size=3247337 2024-09-12T00:34:19.728 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.730+0000 7f1f2d864780 1 < completed part key=_multipart_OY145ZXRSF4L.2~8LM81DULK292.0 size=1048576 2024-09-12T00:34:19.729 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.731+0000 7f1f2d864780 1 < completed part key=_multipart_OY145ZXRSF4L.2~8LM81DULK292.1 size=1048576 2024-09-12T00:34:19.730 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.732+0000 7f1f2d864780 1 < completed part key=_multipart_OY145ZXRSF4L.2~8LM81DULK292.2 size=795419 2024-09-12T00:34:19.732 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.734+0000 7f1f2d864780 1 < completed multipart upload key=OY145ZXRSF4L upload=8LM81DULK292 tag=BHWNJG6O565G type=write size=3941147 2024-09-12T00:34:19.734 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.736+0000 7f1f2d864780 1 > prepared part key=_multipart_2G3UCYG4R4NM.2~QI39XE1X8TR2.0 size=1048576 2024-09-12T00:34:19.735 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.737+0000 7f1f2d864780 1 > prepared part key=_multipart_2G3UCYG4R4NM.2~QI39XE1X8TR2.1 size=1048576 2024-09-12T00:34:19.736 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.738+0000 7f1f2d864780 1 > prepared part key=_multipart_2G3UCYG4R4NM.2~QI39XE1X8TR2.2 size=810586 2024-09-12T00:34:19.736 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.738+0000 7f1f2d864780 1 > prepared multipart upload key=2G3UCYG4R4NM upload=QI39XE1X8TR2 tag=E6GX6QI93R81 type=write size=3956314 2024-09-12T00:34:19.738 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.739+0000 7f1f2d864780 1 < completed part key=_multipart_4FRVL0KXN2X8.2~JIGXACOVANDE.0 size=613047 2024-09-12T00:34:19.740 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.741+0000 7f1f2d864780 1 < completed multipart upload key=4FRVL0KXN2X8 upload=JIGXACOVANDE tag=II652KJC0P5P type=write size=1661623 2024-09-12T00:34:19.741 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.742+0000 7f1f2d864780 1 > prepared operation key=ZGO887JDR627 tag=NF1OV02PKU9I type=del size=481365 2024-09-12T00:34:19.742 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.744+0000 7f1f2d864780 1 < completed part key=_multipart_MSGU3PHLBRJH.2~UHHZXT3HZ0XM.0 size=346398 2024-09-12T00:34:19.744 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.745+0000 7f1f2d864780 1 < completed multipart upload key=MSGU3PHLBRJH upload=UHHZXT3HZ0XM tag=VXGX0JSW1OKY type=write size=1394974 2024-09-12T00:34:19.745 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.747+0000 7f1f2d864780 1 > prepared operation key=2G3UCYG4R4NM tag=JCNTR90TOMI2 type=del size=3871506 2024-09-12T00:34:19.747 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.749+0000 7f1f2d864780 1 < suggested remove operation key=DYKLAY6J018G tag=897NVU8DTH3O type=del 2024-09-12T00:34:19.749 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.751+0000 7f1f2d864780 1 > prepared part key=_multipart_PVB52GO6L8T4.2~E3BTE1FU52UT.0 size=1048576 2024-09-12T00:34:19.750 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.752+0000 7f1f2d864780 1 > prepared part key=_multipart_PVB52GO6L8T4.2~E3BTE1FU52UT.1 size=1048576 2024-09-12T00:34:19.751 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.753+0000 7f1f2d864780 1 > prepared part key=_multipart_PVB52GO6L8T4.2~E3BTE1FU52UT.2 size=910640 2024-09-12T00:34:19.751 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.753+0000 7f1f2d864780 1 > prepared multipart upload key=PVB52GO6L8T4 upload=E3BTE1FU52UT tag=RDXLUTO7DQOA type=write size=4056368 2024-09-12T00:34:19.752 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.754+0000 7f1f2d864780 1 < completed delete operation key=PVB52GO6L8T4 tag=M1N5PPX27BD2 type=del 2024-09-12T00:34:19.753 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.755+0000 7f1f2d864780 1 > prepared operation key=SZP418NVZ5VX tag=AWN6BM4KYO6H type=del size=941315 2024-09-12T00:34:19.755 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.756+0000 7f1f2d864780 1 < completed write operation key=OY145ZXRSF4L tag=21QF2D76V6GV type=write size=266813 2024-09-12T00:34:19.757 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.758+0000 7f1f2d864780 1 > prepared part key=_multipart_2YCGIJRK6MUH.2~6U3I1F032IL5.0 size=1048576 2024-09-12T00:34:19.758 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.759+0000 7f1f2d864780 1 > prepared part key=_multipart_2YCGIJRK6MUH.2~6U3I1F032IL5.1 size=1048576 2024-09-12T00:34:19.759 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.760+0000 7f1f2d864780 1 > prepared part key=_multipart_2YCGIJRK6MUH.2~6U3I1F032IL5.2 size=518048 2024-09-12T00:34:19.759 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.760+0000 7f1f2d864780 1 > prepared multipart upload key=2YCGIJRK6MUH upload=6U3I1F032IL5 tag=OPWH4QHDX3J6 type=write size=3663776 2024-09-12T00:34:19.760 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.762+0000 7f1f2d864780 1 < completed part key=_multipart_53QCNWX1V1R1.2~0478TB3TZ29P.0 size=1048576 2024-09-12T00:34:19.761 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.762+0000 7f1f2d864780 1 < completed part key=_multipart_53QCNWX1V1R1.2~0478TB3TZ29P.1 size=546110 2024-09-12T00:34:19.763 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.765+0000 7f1f2d864780 1 < completed multipart upload key=53QCNWX1V1R1 upload=0478TB3TZ29P tag=SF2J2VEBBA2L type=write size=2643262 2024-09-12T00:34:19.764 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.766+0000 7f1f2d864780 1 > prepared operation key=D21W9QZWY0YU tag=2M2NL0QU7OAC type=del size=1613814 2024-09-12T00:34:19.764 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.766+0000 7f1f2d864780 1 < canceled part key=_multipart_D21W9QZWY0YU.2~UYR0OYAWPSNZ.0 size=1048576 2024-09-12T00:34:19.765 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.767+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~UYR0OYAWPSNZ.1 size=1048576 2024-09-12T00:34:19.766 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.768+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~UYR0OYAWPSNZ.2 size=909931 2024-09-12T00:34:19.768 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.770+0000 7f1f2d864780 1 < canceled multipart upload key=D21W9QZWY0YU upload=UYR0OYAWPSNZ tag=9F9550XXZIG3 type=write size=4055659 2024-09-12T00:34:19.769 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.771+0000 7f1f2d864780 1 > prepared operation key=4FRVL0KXN2X8 tag=32Z1M9TSZIXZ type=write size=930355 2024-09-12T00:34:19.771 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.772+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~TF6IN5PE2625.0 size=258985 2024-09-12T00:34:19.773 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.774+0000 7f1f2d864780 1 < completed multipart upload key=SZP418NVZ5VX upload=TF6IN5PE2625 tag=9BKWQAPHK9CQ type=write size=1307561 2024-09-12T00:34:19.774 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.776+0000 7f1f2d864780 1 > prepared operation key=W6U30X4HJCB1 tag=BA373R2QWVTT type=del size=2798228 2024-09-12T00:34:19.775 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.777+0000 7f1f2d864780 1 < completed write operation key=2YCGIJRK6MUH tag=NCVF4OKSETEM type=write size=281107 2024-09-12T00:34:19.776 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.778+0000 7f1f2d864780 1 > prepared operation key=WGKEA4EKF5GP tag=GQZXP8Y5UU99 type=write size=125232 2024-09-12T00:34:19.777 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.779+0000 7f1f2d864780 1 < completed delete operation key=ZGO887JDR627 tag=BJR3A8V4BJU5 type=del 2024-09-12T00:34:19.779 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.780+0000 7f1f2d864780 1 > prepared operation key=ECZYQEZ942W8 tag=XJDQ4LL0HY4G type=del size=3597484 2024-09-12T00:34:19.780 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.781+0000 7f1f2d864780 1 < completed delete operation key=FAP6N3H7SBN0 tag=YB028L7KQGD9 type=del 2024-09-12T00:34:19.781 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.783+0000 7f1f2d864780 1 > prepared operation key=53QCNWX1V1R1 tag=EAO7J3DX1AAB type=del size=2180338 2024-09-12T00:34:19.782 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.784+0000 7f1f2d864780 1 < completed delete operation key=N9RQIGHVL8VP tag=KBYYJ30G8U49 type=del 2024-09-12T00:34:19.785 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.787+0000 7f1f2d864780 1 > prepared part key=_multipart_GSPM8N0K7ODC.2~RJI4OE9PBPY8.0 size=1048576 2024-09-12T00:34:19.786 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.788+0000 7f1f2d864780 1 > prepared part key=_multipart_GSPM8N0K7ODC.2~RJI4OE9PBPY8.1 size=1048576 2024-09-12T00:34:19.787 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.789+0000 7f1f2d864780 1 > prepared part key=_multipart_GSPM8N0K7ODC.2~RJI4OE9PBPY8.2 size=625144 2024-09-12T00:34:19.787 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.789+0000 7f1f2d864780 1 > prepared multipart upload key=GSPM8N0K7ODC upload=RJI4OE9PBPY8 tag=JRTY1UO9QZNN type=write size=3770872 2024-09-12T00:34:19.788 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.790+0000 7f1f2d864780 1 < completed delete operation key=2YCGIJRK6MUH tag=UVI33T4FCKCM type=del 2024-09-12T00:34:19.791 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.792+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~75XIG5OSO1Z3.0 size=1048576 2024-09-12T00:34:19.792 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.793+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~75XIG5OSO1Z3.1 size=880651 2024-09-12T00:34:19.792 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.793+0000 7f1f2d864780 1 > prepared multipart upload key=FAP6N3H7SBN0 upload=75XIG5OSO1Z3 tag=1MBGUE8BXY24 type=write size=2977803 2024-09-12T00:34:19.793 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.794+0000 7f1f2d864780 1 < canceled operation key=SZP418NVZ5VX tag=D2DHNECVKD07 type=del size=3366339 2024-09-12T00:34:19.794 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.796+0000 7f1f2d864780 1 > prepared operation key=KHPF1N1MT33Z tag=X78PIB7KSHIW type=del size=3549136 2024-09-12T00:34:19.795 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.797+0000 7f1f2d864780 1 < completed delete operation key=WKK747ETLW10 tag=0UCMUCVB1CCH type=del 2024-09-12T00:34:19.797 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.798+0000 7f1f2d864780 1 > prepared operation key=DYKLAY6J018G tag=MO6HCXG7GKN8 type=del size=3979583 2024-09-12T00:34:19.798 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.800+0000 7f1f2d864780 1 < completed part key=_multipart_2G3UCYG4R4NM.2~QI39XE1X8TR2.0 size=1048576 2024-09-12T00:34:19.800 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.801+0000 7f1f2d864780 1 < completed part key=_multipart_2G3UCYG4R4NM.2~QI39XE1X8TR2.1 size=1048576 2024-09-12T00:34:19.800 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.802+0000 7f1f2d864780 1 < completed part key=_multipart_2G3UCYG4R4NM.2~QI39XE1X8TR2.2 size=810586 2024-09-12T00:34:19.803 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.804+0000 7f1f2d864780 1 < completed multipart upload key=2G3UCYG4R4NM upload=QI39XE1X8TR2 tag=E6GX6QI93R81 type=write size=3956314 2024-09-12T00:34:19.806 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.808+0000 7f1f2d864780 1 > prepared part key=_multipart_GSPM8N0K7ODC.2~C309RNY1WQN8.0 size=1048576 2024-09-12T00:34:19.807 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.809+0000 7f1f2d864780 1 > prepared part key=_multipart_GSPM8N0K7ODC.2~C309RNY1WQN8.1 size=427796 2024-09-12T00:34:19.808 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.809+0000 7f1f2d864780 1 > prepared multipart upload key=GSPM8N0K7ODC upload=C309RNY1WQN8 tag=WA4RTAN8U02J type=write size=2524948 2024-09-12T00:34:19.809 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.810+0000 7f1f2d864780 1 < completed delete operation key=ZGO887JDR627 tag=NF1OV02PKU9I type=del 2024-09-12T00:34:19.810 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.812+0000 7f1f2d864780 1 > prepared operation key=SNCGB6Z20450 tag=QMDP1FIYCOUA type=del size=760965 2024-09-12T00:34:19.811 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.813+0000 7f1f2d864780 1 < completed delete operation key=2G3UCYG4R4NM tag=JCNTR90TOMI2 type=del 2024-09-12T00:34:19.812 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.814+0000 7f1f2d864780 1 > prepared operation key=4FRVL0KXN2X8 tag=D4MM37JRB9TJ type=del size=3650342 2024-09-12T00:34:19.813 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.815+0000 7f1f2d864780 1 < completed part key=_multipart_PVB52GO6L8T4.2~E3BTE1FU52UT.0 size=1048576 2024-09-12T00:34:19.813 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.815+0000 7f1f2d864780 1 < canceled part key=_multipart_PVB52GO6L8T4.2~E3BTE1FU52UT.1 size=1048576 2024-09-12T00:34:19.814 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.816+0000 7f1f2d864780 1 < completed part key=_multipart_PVB52GO6L8T4.2~E3BTE1FU52UT.2 size=910640 2024-09-12T00:34:19.816 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.818+0000 7f1f2d864780 1 < canceled multipart upload key=PVB52GO6L8T4 upload=E3BTE1FU52UT tag=RDXLUTO7DQOA type=write size=4056368 2024-09-12T00:34:19.817 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.819+0000 7f1f2d864780 1 > prepared operation key=MSGU3PHLBRJH tag=O22E70E1OF1M type=del size=1389897 2024-09-12T00:34:19.818 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.820+0000 7f1f2d864780 1 < completed delete operation key=SZP418NVZ5VX tag=AWN6BM4KYO6H type=del 2024-09-12T00:34:19.820 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.821+0000 7f1f2d864780 1 > prepared operation key=0DSQOFS8IIF5 tag=L9503DW0ZQNP type=del size=3270658 2024-09-12T00:34:19.821 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.822+0000 7f1f2d864780 1 < completed part key=_multipart_2YCGIJRK6MUH.2~6U3I1F032IL5.0 size=1048576 2024-09-12T00:34:19.822 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.823+0000 7f1f2d864780 1 < completed part key=_multipart_2YCGIJRK6MUH.2~6U3I1F032IL5.1 size=1048576 2024-09-12T00:34:19.823 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.824+0000 7f1f2d864780 1 < completed part key=_multipart_2YCGIJRK6MUH.2~6U3I1F032IL5.2 size=518048 2024-09-12T00:34:19.825 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.826+0000 7f1f2d864780 1 < completed multipart upload key=2YCGIJRK6MUH upload=6U3I1F032IL5 tag=OPWH4QHDX3J6 type=write size=3663776 2024-09-12T00:34:19.827 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.829+0000 7f1f2d864780 1 > prepared part key=_multipart_3Z1TGGPZKJ69.2~X8WMSDBFORYC.0 size=1048576 2024-09-12T00:34:19.828 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.830+0000 7f1f2d864780 1 > prepared part key=_multipart_3Z1TGGPZKJ69.2~X8WMSDBFORYC.1 size=815836 2024-09-12T00:34:19.828 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.830+0000 7f1f2d864780 1 > prepared multipart upload key=3Z1TGGPZKJ69 upload=X8WMSDBFORYC tag=VD5NUCQ5T44D type=write size=2912988 2024-09-12T00:34:19.829 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.831+0000 7f1f2d864780 1 < completed delete operation key=D21W9QZWY0YU tag=2M2NL0QU7OAC type=del 2024-09-12T00:34:19.831 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.833+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~WL2WQ08DXGL5.0 size=1048576 2024-09-12T00:34:19.832 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.834+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~WL2WQ08DXGL5.1 size=339451 2024-09-12T00:34:19.832 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.834+0000 7f1f2d864780 1 > prepared multipart upload key=D21W9QZWY0YU upload=WL2WQ08DXGL5 tag=OUBQG2MJ5TPV type=write size=2436603 2024-09-12T00:34:19.833 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.835+0000 7f1f2d864780 1 < completed write operation key=4FRVL0KXN2X8 tag=32Z1M9TSZIXZ type=write size=930355 2024-09-12T00:34:19.835 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.837+0000 7f1f2d864780 1 > prepared part key=_multipart_N9RQIGHVL8VP.2~1BP2IZNHBCE2.0 size=913116 2024-09-12T00:34:19.835 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.837+0000 7f1f2d864780 1 > prepared multipart upload key=N9RQIGHVL8VP upload=1BP2IZNHBCE2 tag=6MNTPI7VM31I type=write size=1961692 2024-09-12T00:34:19.837 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.838+0000 7f1f2d864780 1 < completed delete operation key=W6U30X4HJCB1 tag=BA373R2QWVTT type=del 2024-09-12T00:34:19.838 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.840+0000 7f1f2d864780 1 > prepared part key=_multipart_AN26EVAZI527.2~YUL2BGZ3P6QN.0 size=1048576 2024-09-12T00:34:19.839 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.841+0000 7f1f2d864780 1 > prepared part key=_multipart_AN26EVAZI527.2~YUL2BGZ3P6QN.1 size=90271 2024-09-12T00:34:19.839 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.841+0000 7f1f2d864780 1 > prepared multipart upload key=AN26EVAZI527 upload=YUL2BGZ3P6QN tag=TMIP68BY61UD type=write size=2187423 2024-09-12T00:34:19.841 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.843+0000 7f1f2d864780 1 < suggested update operation key=WGKEA4EKF5GP tag=GQZXP8Y5UU99 type=write size=125232 2024-09-12T00:34:19.844 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.845+0000 7f1f2d864780 1 > prepared part key=_multipart_2YCGIJRK6MUH.2~RRDN7M6P4QLF.0 size=1048576 2024-09-12T00:34:19.845 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.846+0000 7f1f2d864780 1 > prepared part key=_multipart_2YCGIJRK6MUH.2~RRDN7M6P4QLF.1 size=1048576 2024-09-12T00:34:19.845 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.847+0000 7f1f2d864780 1 > prepared part key=_multipart_2YCGIJRK6MUH.2~RRDN7M6P4QLF.2 size=866352 2024-09-12T00:34:19.846 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.847+0000 7f1f2d864780 1 > prepared multipart upload key=2YCGIJRK6MUH upload=RRDN7M6P4QLF tag=6VOJBZMO8O5V type=write size=4012080 2024-09-12T00:34:19.847 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.848+0000 7f1f2d864780 1 < completed delete operation key=ECZYQEZ942W8 tag=XJDQ4LL0HY4G type=del 2024-09-12T00:34:19.848 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.849+0000 7f1f2d864780 1 > prepared operation key=1299IOSGYIO9 tag=956JFGR5NLBV type=del size=241850 2024-09-12T00:34:19.852 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.851+0000 7f1f2d864780 1 < suggested remove operation key=53QCNWX1V1R1 tag=EAO7J3DX1AAB type=del 2024-09-12T00:34:19.852 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.853+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=E7F0K0EY3YD4 type=del size=18235 2024-09-12T00:34:19.852 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.854+0000 7f1f2d864780 1 < completed part key=_multipart_GSPM8N0K7ODC.2~RJI4OE9PBPY8.0 size=1048576 2024-09-12T00:34:19.853 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.855+0000 7f1f2d864780 1 < completed part key=_multipart_GSPM8N0K7ODC.2~RJI4OE9PBPY8.1 size=1048576 2024-09-12T00:34:19.854 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.856+0000 7f1f2d864780 1 < completed part key=_multipart_GSPM8N0K7ODC.2~RJI4OE9PBPY8.2 size=625144 2024-09-12T00:34:19.856 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.858+0000 7f1f2d864780 1 < completed multipart upload key=GSPM8N0K7ODC upload=RJI4OE9PBPY8 tag=JRTY1UO9QZNN type=write size=3770872 2024-09-12T00:34:19.858 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.860+0000 7f1f2d864780 1 > prepared part key=_multipart_DYKLAY6J018G.2~GI0QN2KWYYPQ.0 size=1048576 2024-09-12T00:34:19.859 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.860+0000 7f1f2d864780 1 > prepared part key=_multipart_DYKLAY6J018G.2~GI0QN2KWYYPQ.1 size=982262 2024-09-12T00:34:19.859 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.860+0000 7f1f2d864780 1 > prepared multipart upload key=DYKLAY6J018G upload=GI0QN2KWYYPQ tag=R7W17P83F3PJ type=write size=3079414 2024-09-12T00:34:19.860 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.862+0000 7f1f2d864780 1 < completed part key=_multipart_FAP6N3H7SBN0.2~75XIG5OSO1Z3.0 size=1048576 2024-09-12T00:34:19.861 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.863+0000 7f1f2d864780 1 < completed part key=_multipart_FAP6N3H7SBN0.2~75XIG5OSO1Z3.1 size=880651 2024-09-12T00:34:19.863 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.864+0000 7f1f2d864780 1 < completed multipart upload key=FAP6N3H7SBN0 upload=75XIG5OSO1Z3 tag=1MBGUE8BXY24 type=write size=2977803 2024-09-12T00:34:19.864 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.865+0000 7f1f2d864780 1 > prepared operation key=3Z1TGGPZKJ69 tag=SP10I72SXBYG type=del size=3475321 2024-09-12T00:34:19.865 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.867+0000 7f1f2d864780 1 < completed delete operation key=KHPF1N1MT33Z tag=X78PIB7KSHIW type=del 2024-09-12T00:34:19.867 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.869+0000 7f1f2d864780 1 > prepared part key=_multipart_UTR2UUO6DHLJ.2~43QSQ904RPQA.0 size=572343 2024-09-12T00:34:19.867 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.869+0000 7f1f2d864780 1 > prepared multipart upload key=UTR2UUO6DHLJ upload=43QSQ904RPQA tag=JG22TPWQR3YE type=write size=1620919 2024-09-12T00:34:19.868 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.870+0000 7f1f2d864780 1 < completed delete operation key=DYKLAY6J018G tag=MO6HCXG7GKN8 type=del 2024-09-12T00:34:19.869 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.871+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=9GHH9XWX7I2K type=del size=2215165 2024-09-12T00:34:19.870 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.871+0000 7f1f2d864780 1 < canceled part key=_multipart_GSPM8N0K7ODC.2~C309RNY1WQN8.0 size=1048576 2024-09-12T00:34:19.870 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.872+0000 7f1f2d864780 1 < completed part key=_multipart_GSPM8N0K7ODC.2~C309RNY1WQN8.1 size=427796 2024-09-12T00:34:19.872 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.874+0000 7f1f2d864780 1 < canceled multipart upload key=GSPM8N0K7ODC upload=C309RNY1WQN8 tag=WA4RTAN8U02J type=write size=2524948 2024-09-12T00:34:19.873 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.875+0000 7f1f2d864780 1 > prepared operation key=9XK59MVZ5G1O tag=T0E2Z67BNRN0 type=del size=3968625 2024-09-12T00:34:19.875 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.876+0000 7f1f2d864780 1 < completed delete operation key=SNCGB6Z20450 tag=QMDP1FIYCOUA type=del 2024-09-12T00:34:19.876 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.877+0000 7f1f2d864780 1 > prepared operation key=S5DVMA14N7VJ tag=GMZP2053LCPJ type=del size=3494954 2024-09-12T00:34:19.878 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.880+0000 7f1f2d864780 1 < suggested remove operation key=4FRVL0KXN2X8 tag=D4MM37JRB9TJ type=del 2024-09-12T00:34:19.879 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.881+0000 7f1f2d864780 1 > prepared operation key=2YCGIJRK6MUH tag=COZ1ACN294C0 type=del size=2654912 2024-09-12T00:34:19.880 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.882+0000 7f1f2d864780 1 < completed delete operation key=MSGU3PHLBRJH tag=O22E70E1OF1M type=del 2024-09-12T00:34:19.881 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.883+0000 7f1f2d864780 1 > prepared operation key=UTR2UUO6DHLJ tag=U5FM59NQ9FIV type=del size=2642514 2024-09-12T00:34:19.884 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.885+0000 7f1f2d864780 1 < suggested update operation key=0DSQOFS8IIF5 tag=L9503DW0ZQNP type=del size=3270658 2024-09-12T00:34:19.885 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.886+0000 7f1f2d864780 1 > prepared operation key=ECZYQEZ942W8 tag=BZUBGBA27943 type=del size=1441368 2024-09-12T00:34:19.886 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.888+0000 7f1f2d864780 1 < completed part key=_multipart_3Z1TGGPZKJ69.2~X8WMSDBFORYC.0 size=1048576 2024-09-12T00:34:19.887 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.889+0000 7f1f2d864780 1 < completed part key=_multipart_3Z1TGGPZKJ69.2~X8WMSDBFORYC.1 size=815836 2024-09-12T00:34:19.889 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.891+0000 7f1f2d864780 1 < completed multipart upload key=3Z1TGGPZKJ69 upload=X8WMSDBFORYC tag=VD5NUCQ5T44D type=write size=2912988 2024-09-12T00:34:19.891 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.893+0000 7f1f2d864780 1 > prepared part key=_multipart_O1YY03BOEYLM.2~SF69BWEC4Q19.0 size=1048576 2024-09-12T00:34:19.892 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.894+0000 7f1f2d864780 1 > prepared part key=_multipart_O1YY03BOEYLM.2~SF69BWEC4Q19.1 size=843754 2024-09-12T00:34:19.892 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.894+0000 7f1f2d864780 1 > prepared multipart upload key=O1YY03BOEYLM upload=SF69BWEC4Q19 tag=XJ6DGVG2AZMK type=write size=2940906 2024-09-12T00:34:19.894 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.895+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~WL2WQ08DXGL5.0 size=1048576 2024-09-12T00:34:19.894 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.896+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~WL2WQ08DXGL5.1 size=339451 2024-09-12T00:34:19.896 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.898+0000 7f1f2d864780 1 < completed multipart upload key=D21W9QZWY0YU upload=WL2WQ08DXGL5 tag=OUBQG2MJ5TPV type=write size=2436603 2024-09-12T00:34:19.899 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.900+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~WAIWKY3JR00H.0 size=1048576 2024-09-12T00:34:19.900 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.901+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~WAIWKY3JR00H.1 size=1048576 2024-09-12T00:34:19.901 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.902+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~WAIWKY3JR00H.2 size=945120 2024-09-12T00:34:19.901 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.902+0000 7f1f2d864780 1 > prepared multipart upload key=0DSQOFS8IIF5 upload=WAIWKY3JR00H tag=AHBYXRMJDQ0V type=write size=4090848 2024-09-12T00:34:19.902 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.904+0000 7f1f2d864780 1 < completed part key=_multipart_N9RQIGHVL8VP.2~1BP2IZNHBCE2.0 size=913116 2024-09-12T00:34:19.904 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.905+0000 7f1f2d864780 1 < completed multipart upload key=N9RQIGHVL8VP upload=1BP2IZNHBCE2 tag=6MNTPI7VM31I type=write size=1961692 2024-09-12T00:34:19.905 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.907+0000 7f1f2d864780 1 > prepared operation key=WKK747ETLW10 tag=VNVT03ROYPAV type=del size=585458 2024-09-12T00:34:19.907 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.908+0000 7f1f2d864780 1 < completed part key=_multipart_AN26EVAZI527.2~YUL2BGZ3P6QN.0 size=1048576 2024-09-12T00:34:19.907 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.909+0000 7f1f2d864780 1 < completed part key=_multipart_AN26EVAZI527.2~YUL2BGZ3P6QN.1 size=90271 2024-09-12T00:34:19.909 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.911+0000 7f1f2d864780 1 < completed multipart upload key=AN26EVAZI527 upload=YUL2BGZ3P6QN tag=TMIP68BY61UD type=write size=2187423 2024-09-12T00:34:19.912 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.913+0000 7f1f2d864780 1 > prepared part key=_multipart_FFG41OYEYFZA.2~8BVFJFKL2VNC.0 size=1048576 2024-09-12T00:34:19.913 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.915+0000 7f1f2d864780 1 > prepared part key=_multipart_FFG41OYEYFZA.2~8BVFJFKL2VNC.1 size=1048576 2024-09-12T00:34:19.916 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.918+0000 7f1f2d864780 1 > prepared part key=_multipart_FFG41OYEYFZA.2~8BVFJFKL2VNC.2 size=154187 2024-09-12T00:34:19.917 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.918+0000 7f1f2d864780 1 > prepared multipart upload key=FFG41OYEYFZA upload=8BVFJFKL2VNC tag=AZ03BILZEHZA type=write size=3299915 2024-09-12T00:34:19.917 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.919+0000 7f1f2d864780 1 < completed part key=_multipart_2YCGIJRK6MUH.2~RRDN7M6P4QLF.0 size=1048576 2024-09-12T00:34:19.918 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.920+0000 7f1f2d864780 1 < completed part key=_multipart_2YCGIJRK6MUH.2~RRDN7M6P4QLF.1 size=1048576 2024-09-12T00:34:19.919 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.921+0000 7f1f2d864780 1 < completed part key=_multipart_2YCGIJRK6MUH.2~RRDN7M6P4QLF.2 size=866352 2024-09-12T00:34:19.921 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.923+0000 7f1f2d864780 1 < completed multipart upload key=2YCGIJRK6MUH upload=RRDN7M6P4QLF tag=6VOJBZMO8O5V type=write size=4012080 2024-09-12T00:34:19.922 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.924+0000 7f1f2d864780 1 > prepared operation key=53QCNWX1V1R1 tag=XTNDMC6UU275 type=del size=4118736 2024-09-12T00:34:19.923 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.925+0000 7f1f2d864780 1 < completed delete operation key=1299IOSGYIO9 tag=956JFGR5NLBV type=del 2024-09-12T00:34:19.924 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.926+0000 7f1f2d864780 1 > prepared operation key=KHPF1N1MT33Z tag=D0EZ40BJ002Z type=write size=268302 2024-09-12T00:34:19.926 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.927+0000 7f1f2d864780 1 < canceled operation key=2RV0899QUJ8W tag=E7F0K0EY3YD4 type=del size=18235 2024-09-12T00:34:19.927 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.929+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=F8LDTEBKIC63 type=del size=3365939 2024-09-12T00:34:19.928 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.930+0000 7f1f2d864780 1 < completed part key=_multipart_DYKLAY6J018G.2~GI0QN2KWYYPQ.0 size=1048576 2024-09-12T00:34:19.929 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.931+0000 7f1f2d864780 1 < completed part key=_multipart_DYKLAY6J018G.2~GI0QN2KWYYPQ.1 size=982262 2024-09-12T00:34:19.931 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.933+0000 7f1f2d864780 1 < completed multipart upload key=DYKLAY6J018G upload=GI0QN2KWYYPQ tag=R7W17P83F3PJ type=write size=3079414 2024-09-12T00:34:19.932 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.934+0000 7f1f2d864780 1 > prepared operation key=9XK59MVZ5G1O tag=UPB6A9KOBM7A type=del size=1624142 2024-09-12T00:34:19.934 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.935+0000 7f1f2d864780 1 < completed delete operation key=3Z1TGGPZKJ69 tag=SP10I72SXBYG type=del 2024-09-12T00:34:19.935 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.936+0000 7f1f2d864780 1 > prepared operation key=WIIU8VTCLWOD tag=FWSV7PXXCSV7 type=write size=384258 2024-09-12T00:34:19.936 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.938+0000 7f1f2d864780 1 < completed part key=_multipart_UTR2UUO6DHLJ.2~43QSQ904RPQA.0 size=572343 2024-09-12T00:34:19.938 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.940+0000 7f1f2d864780 1 < completed multipart upload key=UTR2UUO6DHLJ upload=43QSQ904RPQA tag=JG22TPWQR3YE type=write size=1620919 2024-09-12T00:34:19.940 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.942+0000 7f1f2d864780 1 > prepared part key=_multipart_3Z1TGGPZKJ69.2~I2U6VAN7UOFP.0 size=662403 2024-09-12T00:34:19.940 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.942+0000 7f1f2d864780 1 > prepared multipart upload key=3Z1TGGPZKJ69 upload=I2U6VAN7UOFP tag=PXMAOJXR8M09 type=write size=1710979 2024-09-12T00:34:19.941 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.943+0000 7f1f2d864780 1 < completed delete operation key=2RV0899QUJ8W tag=9GHH9XWX7I2K type=del 2024-09-12T00:34:19.942 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.944+0000 7f1f2d864780 1 > prepared operation key=WGKEA4EKF5GP tag=GX1Z25SVK3WP type=del size=1768792 2024-09-12T00:34:19.943 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.945+0000 7f1f2d864780 1 < completed delete operation key=9XK59MVZ5G1O tag=T0E2Z67BNRN0 type=del 2024-09-12T00:34:19.945 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.946+0000 7f1f2d864780 1 > prepared operation key=DYKLAY6J018G tag=IISP0XG0JSYE type=del size=424597 2024-09-12T00:34:19.945 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.947+0000 7f1f2d864780 1 < canceled operation key=S5DVMA14N7VJ tag=GMZP2053LCPJ type=del size=3494954 2024-09-12T00:34:19.948 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.949+0000 7f1f2d864780 1 > prepared part key=_multipart_9XK59MVZ5G1O.2~5FO0KANI1XSX.0 size=1048576 2024-09-12T00:34:19.948 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.950+0000 7f1f2d864780 1 > prepared part key=_multipart_9XK59MVZ5G1O.2~5FO0KANI1XSX.1 size=1048576 2024-09-12T00:34:19.949 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.951+0000 7f1f2d864780 1 > prepared part key=_multipart_9XK59MVZ5G1O.2~5FO0KANI1XSX.2 size=1018559 2024-09-12T00:34:19.949 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.951+0000 7f1f2d864780 1 > prepared multipart upload key=9XK59MVZ5G1O upload=5FO0KANI1XSX tag=KXQ7VE289Y5B type=write size=4164287 2024-09-12T00:34:19.952 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.953+0000 7f1f2d864780 1 < suggested update operation key=2YCGIJRK6MUH tag=COZ1ACN294C0 type=del size=2654912 2024-09-12T00:34:19.954 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.955+0000 7f1f2d864780 1 > prepared part key=_multipart_OY145ZXRSF4L.2~GVLF6JE69DFV.0 size=1048576 2024-09-12T00:34:19.954 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.956+0000 7f1f2d864780 1 > prepared part key=_multipart_OY145ZXRSF4L.2~GVLF6JE69DFV.1 size=504469 2024-09-12T00:34:19.955 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.956+0000 7f1f2d864780 1 > prepared multipart upload key=OY145ZXRSF4L upload=GVLF6JE69DFV tag=UFJ1PVSV8W29 type=write size=2601621 2024-09-12T00:34:19.956 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.957+0000 7f1f2d864780 1 < completed delete operation key=UTR2UUO6DHLJ tag=U5FM59NQ9FIV type=del 2024-09-12T00:34:19.958 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.959+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~A1FT2SFY3B3V.0 size=1048576 2024-09-12T00:34:19.959 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.960+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~A1FT2SFY3B3V.1 size=1048576 2024-09-12T00:34:19.959 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.961+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~A1FT2SFY3B3V.2 size=2214 2024-09-12T00:34:19.959 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.961+0000 7f1f2d864780 1 > prepared multipart upload key=4FRVL0KXN2X8 upload=A1FT2SFY3B3V tag=AYTD5Q00CICT type=write size=3147942 2024-09-12T00:34:19.961 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.962+0000 7f1f2d864780 1 < completed delete operation key=ECZYQEZ942W8 tag=BZUBGBA27943 type=del 2024-09-12T00:34:19.963 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.964+0000 7f1f2d864780 1 > prepared part key=_multipart_2YCGIJRK6MUH.2~FUL40DZEK1JU.0 size=1048576 2024-09-12T00:34:19.963 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.965+0000 7f1f2d864780 1 > prepared part key=_multipart_2YCGIJRK6MUH.2~FUL40DZEK1JU.1 size=757915 2024-09-12T00:34:19.964 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.965+0000 7f1f2d864780 1 > prepared multipart upload key=2YCGIJRK6MUH upload=FUL40DZEK1JU tag=VA2K7EWXJN1E type=write size=2855067 2024-09-12T00:34:19.965 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.966+0000 7f1f2d864780 1 < completed part key=_multipart_O1YY03BOEYLM.2~SF69BWEC4Q19.0 size=1048576 2024-09-12T00:34:19.965 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.967+0000 7f1f2d864780 1 < completed part key=_multipart_O1YY03BOEYLM.2~SF69BWEC4Q19.1 size=843754 2024-09-12T00:34:19.967 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.969+0000 7f1f2d864780 1 < completed multipart upload key=O1YY03BOEYLM upload=SF69BWEC4Q19 tag=XJ6DGVG2AZMK type=write size=2940906 2024-09-12T00:34:19.968 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.970+0000 7f1f2d864780 1 > prepared operation key=2G3UCYG4R4NM tag=H9Y34RYXC5TT type=del size=3632612 2024-09-12T00:34:19.970 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.971+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~WAIWKY3JR00H.0 size=1048576 2024-09-12T00:34:19.970 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.972+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~WAIWKY3JR00H.1 size=1048576 2024-09-12T00:34:19.971 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.973+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~WAIWKY3JR00H.2 size=945120 2024-09-12T00:34:19.973 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.975+0000 7f1f2d864780 1 < completed multipart upload key=0DSQOFS8IIF5 upload=WAIWKY3JR00H tag=AHBYXRMJDQ0V type=write size=4090848 2024-09-12T00:34:19.975 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.976+0000 7f1f2d864780 1 > prepared operation key=KHPF1N1MT33Z tag=Y29ZWWYSPQSE type=write size=868571 2024-09-12T00:34:19.976 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.977+0000 7f1f2d864780 1 < completed delete operation key=WKK747ETLW10 tag=VNVT03ROYPAV type=del 2024-09-12T00:34:19.978 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.979+0000 7f1f2d864780 1 > prepared part key=_multipart_53QCNWX1V1R1.2~T52IZ4TQEM8C.0 size=1048576 2024-09-12T00:34:19.979 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.980+0000 7f1f2d864780 1 > prepared part key=_multipart_53QCNWX1V1R1.2~T52IZ4TQEM8C.1 size=725882 2024-09-12T00:34:19.979 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.980+0000 7f1f2d864780 1 > prepared multipart upload key=53QCNWX1V1R1 upload=T52IZ4TQEM8C tag=SKPSREX0V6HZ type=write size=2823034 2024-09-12T00:34:19.979 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.981+0000 7f1f2d864780 1 < canceled part key=_multipart_FFG41OYEYFZA.2~8BVFJFKL2VNC.0 size=1048576 2024-09-12T00:34:19.980 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.982+0000 7f1f2d864780 1 < completed part key=_multipart_FFG41OYEYFZA.2~8BVFJFKL2VNC.1 size=1048576 2024-09-12T00:34:19.981 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.983+0000 7f1f2d864780 1 < completed part key=_multipart_FFG41OYEYFZA.2~8BVFJFKL2VNC.2 size=154187 2024-09-12T00:34:19.983 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.984+0000 7f1f2d864780 1 < canceled multipart upload key=FFG41OYEYFZA upload=8BVFJFKL2VNC tag=AZ03BILZEHZA type=write size=3299915 2024-09-12T00:34:19.984 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.986+0000 7f1f2d864780 1 > prepared operation key=D21W9QZWY0YU tag=U2E9V4HELMAT type=del size=4082817 2024-09-12T00:34:19.985 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.987+0000 7f1f2d864780 1 < completed delete operation key=53QCNWX1V1R1 tag=XTNDMC6UU275 type=del 2024-09-12T00:34:19.987 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.988+0000 7f1f2d864780 1 > prepared operation key=SZP418NVZ5VX tag=OY24EO42UI6Y type=write size=939912 2024-09-12T00:34:19.988 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.989+0000 7f1f2d864780 1 < completed write operation key=KHPF1N1MT33Z tag=D0EZ40BJ002Z type=write size=268302 2024-09-12T00:34:19.989 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.991+0000 7f1f2d864780 1 > prepared operation key=2YCGIJRK6MUH tag=3AVPM5DHEOZ2 type=del size=3281770 2024-09-12T00:34:19.990 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.992+0000 7f1f2d864780 1 < completed delete operation key=2RV0899QUJ8W tag=F8LDTEBKIC63 type=del 2024-09-12T00:34:19.992 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.994+0000 7f1f2d864780 1 > prepared part key=_multipart_2RV0899QUJ8W.2~SFPIZ30NGF5S.0 size=339008 2024-09-12T00:34:19.992 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.994+0000 7f1f2d864780 1 > prepared multipart upload key=2RV0899QUJ8W upload=SFPIZ30NGF5S tag=P5UEFHK7BXD3 type=write size=1387584 2024-09-12T00:34:19.994 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.995+0000 7f1f2d864780 1 < completed delete operation key=9XK59MVZ5G1O tag=UPB6A9KOBM7A type=del 2024-09-12T00:34:19.996 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.997+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~G69C0YWIJXSZ.0 size=1033062 2024-09-12T00:34:19.996 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.997+0000 7f1f2d864780 1 > prepared multipart upload key=W6U30X4HJCB1 upload=G69C0YWIJXSZ tag=SMAUICO04GJ4 type=write size=2081638 2024-09-12T00:34:19.997 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:19.999+0000 7f1f2d864780 1 < canceled operation key=WIIU8VTCLWOD tag=FWSV7PXXCSV7 type=write size=384258 2024-09-12T00:34:19.998 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.000+0000 7f1f2d864780 1 > prepared operation key=2YCGIJRK6MUH tag=UHABGZI6KDOB type=write size=610994 2024-09-12T00:34:20.000 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.001+0000 7f1f2d864780 1 < completed part key=_multipart_3Z1TGGPZKJ69.2~I2U6VAN7UOFP.0 size=662403 2024-09-12T00:34:20.001 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.003+0000 7f1f2d864780 1 < completed multipart upload key=3Z1TGGPZKJ69 upload=I2U6VAN7UOFP tag=PXMAOJXR8M09 type=write size=1710979 2024-09-12T00:34:20.003 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.004+0000 7f1f2d864780 1 > prepared operation key=WKK747ETLW10 tag=27GUNM5UYHBY type=write size=477816 2024-09-12T00:34:20.004 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.006+0000 7f1f2d864780 1 < completed delete operation key=WGKEA4EKF5GP tag=GX1Z25SVK3WP type=del 2024-09-12T00:34:20.006 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.008+0000 7f1f2d864780 1 > prepared part key=_multipart_ZGO887JDR627.2~N6P9WDMC81S1.0 size=1048576 2024-09-12T00:34:20.007 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.009+0000 7f1f2d864780 1 > prepared part key=_multipart_ZGO887JDR627.2~N6P9WDMC81S1.1 size=1048576 2024-09-12T00:34:20.008 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.010+0000 7f1f2d864780 1 > prepared part key=_multipart_ZGO887JDR627.2~N6P9WDMC81S1.2 size=765708 2024-09-12T00:34:20.008 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.010+0000 7f1f2d864780 1 > prepared multipart upload key=ZGO887JDR627 upload=N6P9WDMC81S1 tag=0RNC3EYDC94V type=write size=3911436 2024-09-12T00:34:20.009 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.011+0000 7f1f2d864780 1 < completed delete operation key=DYKLAY6J018G tag=IISP0XG0JSYE type=del 2024-09-12T00:34:20.011 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.012+0000 7f1f2d864780 1 > prepared operation key=2G3UCYG4R4NM tag=FEK5J5W036UP type=del size=1081971 2024-09-12T00:34:20.011 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.013+0000 7f1f2d864780 1 < canceled part key=_multipart_9XK59MVZ5G1O.2~5FO0KANI1XSX.0 size=1048576 2024-09-12T00:34:20.012 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.014+0000 7f1f2d864780 1 < completed part key=_multipart_9XK59MVZ5G1O.2~5FO0KANI1XSX.1 size=1048576 2024-09-12T00:34:20.013 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.015+0000 7f1f2d864780 1 < completed part key=_multipart_9XK59MVZ5G1O.2~5FO0KANI1XSX.2 size=1018559 2024-09-12T00:34:20.015 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.017+0000 7f1f2d864780 1 < canceled multipart upload key=9XK59MVZ5G1O upload=5FO0KANI1XSX tag=KXQ7VE289Y5B type=write size=4164287 2024-09-12T00:34:20.016 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.018+0000 7f1f2d864780 1 > prepared operation key=KHPF1N1MT33Z tag=WSHILQRVKZZW type=del size=2849954 2024-09-12T00:34:20.018 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.019+0000 7f1f2d864780 1 < completed part key=_multipart_OY145ZXRSF4L.2~GVLF6JE69DFV.0 size=1048576 2024-09-12T00:34:20.019 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.020+0000 7f1f2d864780 1 < completed part key=_multipart_OY145ZXRSF4L.2~GVLF6JE69DFV.1 size=504469 2024-09-12T00:34:20.021 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.022+0000 7f1f2d864780 1 < completed multipart upload key=OY145ZXRSF4L upload=GVLF6JE69DFV tag=UFJ1PVSV8W29 type=write size=2601621 2024-09-12T00:34:20.022 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.024+0000 7f1f2d864780 1 > prepared operation key=D21W9QZWY0YU tag=1DBL188JJAQG type=del size=863204 2024-09-12T00:34:20.024 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.026+0000 7f1f2d864780 1 < completed part key=_multipart_4FRVL0KXN2X8.2~A1FT2SFY3B3V.0 size=1048576 2024-09-12T00:34:20.025 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.027+0000 7f1f2d864780 1 < completed part key=_multipart_4FRVL0KXN2X8.2~A1FT2SFY3B3V.1 size=1048576 2024-09-12T00:34:20.027 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.028+0000 7f1f2d864780 1 < completed part key=_multipart_4FRVL0KXN2X8.2~A1FT2SFY3B3V.2 size=2214 2024-09-12T00:34:20.029 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.030+0000 7f1f2d864780 1 < completed multipart upload key=4FRVL0KXN2X8 upload=A1FT2SFY3B3V tag=AYTD5Q00CICT type=write size=3147942 2024-09-12T00:34:20.030 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.031+0000 7f1f2d864780 1 > prepared operation key=ECZYQEZ942W8 tag=6PGFBYA09TC1 type=del size=1771088 2024-09-12T00:34:20.030 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.032+0000 7f1f2d864780 1 < canceled part key=_multipart_2YCGIJRK6MUH.2~FUL40DZEK1JU.0 size=1048576 2024-09-12T00:34:20.031 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.033+0000 7f1f2d864780 1 < completed part key=_multipart_2YCGIJRK6MUH.2~FUL40DZEK1JU.1 size=757915 2024-09-12T00:34:20.033 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.034+0000 7f1f2d864780 1 < canceled multipart upload key=2YCGIJRK6MUH upload=FUL40DZEK1JU tag=VA2K7EWXJN1E type=write size=2855067 2024-09-12T00:34:20.035 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.036+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~0SPOCHNCHR0G.0 size=1048576 2024-09-12T00:34:20.036 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.037+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~0SPOCHNCHR0G.1 size=112381 2024-09-12T00:34:20.036 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.037+0000 7f1f2d864780 1 > prepared multipart upload key=1299IOSGYIO9 upload=0SPOCHNCHR0G tag=3C4WYE09RHMK type=write size=2209533 2024-09-12T00:34:20.037 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.039+0000 7f1f2d864780 1 < completed delete operation key=2G3UCYG4R4NM tag=H9Y34RYXC5TT type=del 2024-09-12T00:34:20.038 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.040+0000 7f1f2d864780 1 > prepared operation key=2G3UCYG4R4NM tag=WZQZFTXNIAV1 type=del size=2101964 2024-09-12T00:34:20.039 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.041+0000 7f1f2d864780 1 < completed write operation key=KHPF1N1MT33Z tag=Y29ZWWYSPQSE type=write size=868571 2024-09-12T00:34:20.040 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.042+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=2GAAXDFJ7ISJ type=del size=3963351 2024-09-12T00:34:20.042 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.043+0000 7f1f2d864780 1 < completed part key=_multipart_53QCNWX1V1R1.2~T52IZ4TQEM8C.0 size=1048576 2024-09-12T00:34:20.043 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.044+0000 7f1f2d864780 1 < completed part key=_multipart_53QCNWX1V1R1.2~T52IZ4TQEM8C.1 size=725882 2024-09-12T00:34:20.045 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.046+0000 7f1f2d864780 1 < completed multipart upload key=53QCNWX1V1R1 upload=T52IZ4TQEM8C tag=SKPSREX0V6HZ type=write size=2823034 2024-09-12T00:34:20.046 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.047+0000 7f1f2d864780 1 > prepared operation key=D21W9QZWY0YU tag=YKFG52FLDBYR type=del size=593507 2024-09-12T00:34:20.047 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.049+0000 7f1f2d864780 1 < completed delete operation key=D21W9QZWY0YU tag=U2E9V4HELMAT type=del 2024-09-12T00:34:20.049 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.051+0000 7f1f2d864780 1 > prepared part key=_multipart_ECZYQEZ942W8.2~Y1ZBR4ZM1X89.0 size=1048576 2024-09-12T00:34:20.050 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.052+0000 7f1f2d864780 1 > prepared part key=_multipart_ECZYQEZ942W8.2~Y1ZBR4ZM1X89.1 size=1048576 2024-09-12T00:34:20.051 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.053+0000 7f1f2d864780 1 > prepared part key=_multipart_ECZYQEZ942W8.2~Y1ZBR4ZM1X89.2 size=336255 2024-09-12T00:34:20.051 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.053+0000 7f1f2d864780 1 > prepared multipart upload key=ECZYQEZ942W8 upload=Y1ZBR4ZM1X89 tag=5CTY2HWRA3NF type=write size=3481983 2024-09-12T00:34:20.052 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.054+0000 7f1f2d864780 1 < completed write operation key=SZP418NVZ5VX tag=OY24EO42UI6Y type=write size=939912 2024-09-12T00:34:20.057 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.055+0000 7f1f2d864780 1 > prepared operation key=N9RQIGHVL8VP tag=U66RO9LR0J68 type=del size=2118626 2024-09-12T00:34:20.057 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.056+0000 7f1f2d864780 1 < completed delete operation key=2YCGIJRK6MUH tag=3AVPM5DHEOZ2 type=del 2024-09-12T00:34:20.057 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.057+0000 7f1f2d864780 1 > prepared operation key=0DSQOFS8IIF5 tag=C7RIQQNHTDCC type=write size=992290 2024-09-12T00:34:20.057 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.058+0000 7f1f2d864780 1 < completed part key=_multipart_2RV0899QUJ8W.2~SFPIZ30NGF5S.0 size=339008 2024-09-12T00:34:20.059 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.060+0000 7f1f2d864780 1 < completed multipart upload key=2RV0899QUJ8W upload=SFPIZ30NGF5S tag=P5UEFHK7BXD3 type=write size=1387584 2024-09-12T00:34:20.060 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.061+0000 7f1f2d864780 1 > prepared operation key=FFG41OYEYFZA tag=DC7OAF182LR7 type=del size=1542157 2024-09-12T00:34:20.061 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.062+0000 7f1f2d864780 1 < completed part key=_multipart_W6U30X4HJCB1.2~G69C0YWIJXSZ.0 size=1033062 2024-09-12T00:34:20.063 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.064+0000 7f1f2d864780 1 < completed multipart upload key=W6U30X4HJCB1 upload=G69C0YWIJXSZ tag=SMAUICO04GJ4 type=write size=2081638 2024-09-12T00:34:20.065 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.066+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~WIC0P4Y4UBOV.0 size=1048576 2024-09-12T00:34:20.065 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.067+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~WIC0P4Y4UBOV.1 size=422763 2024-09-12T00:34:20.066 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.067+0000 7f1f2d864780 1 > prepared multipart upload key=1299IOSGYIO9 upload=WIC0P4Y4UBOV tag=CUXIXVM7J1J2 type=write size=2519915 2024-09-12T00:34:20.067 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.068+0000 7f1f2d864780 1 < completed write operation key=2YCGIJRK6MUH tag=UHABGZI6KDOB type=write size=610994 2024-09-12T00:34:20.068 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.069+0000 7f1f2d864780 1 > prepared operation key=W6U30X4HJCB1 tag=T7QV8MHI6YIC type=write size=303335 2024-09-12T00:34:20.070 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.072+0000 7f1f2d864780 1 < suggested update operation key=WKK747ETLW10 tag=27GUNM5UYHBY type=write size=477816 2024-09-12T00:34:20.072 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.074+0000 7f1f2d864780 1 > prepared part key=_multipart_ZGO887JDR627.2~ARWV9P5KG5B6.0 size=1048576 2024-09-12T00:34:20.073 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.074+0000 7f1f2d864780 1 > prepared part key=_multipart_ZGO887JDR627.2~ARWV9P5KG5B6.1 size=1048576 2024-09-12T00:34:20.074 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.075+0000 7f1f2d864780 1 > prepared part key=_multipart_ZGO887JDR627.2~ARWV9P5KG5B6.2 size=1005669 2024-09-12T00:34:20.074 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.075+0000 7f1f2d864780 1 > prepared multipart upload key=ZGO887JDR627 upload=ARWV9P5KG5B6 tag=T0OP0M6NIRF9 type=write size=4151397 2024-09-12T00:34:20.075 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.076+0000 7f1f2d864780 1 < completed part key=_multipart_ZGO887JDR627.2~N6P9WDMC81S1.0 size=1048576 2024-09-12T00:34:20.076 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.077+0000 7f1f2d864780 1 < completed part key=_multipart_ZGO887JDR627.2~N6P9WDMC81S1.1 size=1048576 2024-09-12T00:34:20.076 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.078+0000 7f1f2d864780 1 < completed part key=_multipart_ZGO887JDR627.2~N6P9WDMC81S1.2 size=765708 2024-09-12T00:34:20.078 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.080+0000 7f1f2d864780 1 < completed multipart upload key=ZGO887JDR627 upload=N6P9WDMC81S1 tag=0RNC3EYDC94V type=write size=3911436 2024-09-12T00:34:20.079 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.081+0000 7f1f2d864780 1 > prepared operation key=S5DVMA14N7VJ tag=M0W4RLJED0PV type=del size=762235 2024-09-12T00:34:20.080 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.082+0000 7f1f2d864780 1 < completed delete operation key=2G3UCYG4R4NM tag=FEK5J5W036UP type=del 2024-09-12T00:34:20.081 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.083+0000 7f1f2d864780 1 > prepared operation key=W6U30X4HJCB1 tag=R3UBAOGBIJD4 type=del size=3287850 2024-09-12T00:34:20.082 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.084+0000 7f1f2d864780 1 < canceled operation key=KHPF1N1MT33Z tag=WSHILQRVKZZW type=del size=2849954 2024-09-12T00:34:20.084 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.085+0000 7f1f2d864780 1 > prepared operation key=4FRVL0KXN2X8 tag=0KOCORDXPNA5 type=write size=745614 2024-09-12T00:34:20.085 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.086+0000 7f1f2d864780 1 < completed delete operation key=D21W9QZWY0YU tag=1DBL188JJAQG type=del 2024-09-12T00:34:20.086 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.087+0000 7f1f2d864780 1 > prepared operation key=2G3UCYG4R4NM tag=L0WQK1TOHY1M type=del size=2716360 2024-09-12T00:34:20.087 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.089+0000 7f1f2d864780 1 < completed delete operation key=ECZYQEZ942W8 tag=6PGFBYA09TC1 type=del 2024-09-12T00:34:20.088 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.090+0000 7f1f2d864780 1 > prepared operation key=ZYNIJH0TTSM6 tag=5BGG6D8WE4Y8 type=write size=296872 2024-09-12T00:34:20.089 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.091+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~0SPOCHNCHR0G.0 size=1048576 2024-09-12T00:34:20.090 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.092+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~0SPOCHNCHR0G.1 size=112381 2024-09-12T00:34:20.092 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.094+0000 7f1f2d864780 1 < completed multipart upload key=1299IOSGYIO9 upload=0SPOCHNCHR0G tag=3C4WYE09RHMK type=write size=2209533 2024-09-12T00:34:20.093 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.095+0000 7f1f2d864780 1 > prepared operation key=53QCNWX1V1R1 tag=7YUW9S1DF1M2 type=write size=956574 2024-09-12T00:34:20.094 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.096+0000 7f1f2d864780 1 < completed delete operation key=2G3UCYG4R4NM tag=WZQZFTXNIAV1 type=del 2024-09-12T00:34:20.095 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.097+0000 7f1f2d864780 1 > prepared operation key=AN26EVAZI527 tag=NEKUOTPMOVN9 type=write size=464576 2024-09-12T00:34:20.097 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.098+0000 7f1f2d864780 1 < completed delete operation key=2RV0899QUJ8W tag=2GAAXDFJ7ISJ type=del 2024-09-12T00:34:20.098 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.099+0000 7f1f2d864780 1 > prepared operation key=O1YY03BOEYLM tag=VJAKM8AIKO76 type=del size=2639772 2024-09-12T00:34:20.100 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.101+0000 7f1f2d864780 1 < suggested update operation key=D21W9QZWY0YU tag=YKFG52FLDBYR type=del size=593507 2024-09-12T00:34:20.101 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.103+0000 7f1f2d864780 1 > prepared operation key=WIIU8VTCLWOD tag=LRH1B6YABU4H type=del size=46309 2024-09-12T00:34:20.102 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.104+0000 7f1f2d864780 1 < completed part key=_multipart_ECZYQEZ942W8.2~Y1ZBR4ZM1X89.0 size=1048576 2024-09-12T00:34:20.102 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.104+0000 7f1f2d864780 1 < canceled part key=_multipart_ECZYQEZ942W8.2~Y1ZBR4ZM1X89.1 size=1048576 2024-09-12T00:34:20.103 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.105+0000 7f1f2d864780 1 < completed part key=_multipart_ECZYQEZ942W8.2~Y1ZBR4ZM1X89.2 size=336255 2024-09-12T00:34:20.105 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.106+0000 7f1f2d864780 1 < canceled multipart upload key=ECZYQEZ942W8 upload=Y1ZBR4ZM1X89 tag=5CTY2HWRA3NF type=write size=3481983 2024-09-12T00:34:20.106 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.108+0000 7f1f2d864780 1 > prepared operation key=GSPM8N0K7ODC tag=JZ96PBJV643I type=del size=1378433 2024-09-12T00:34:20.107 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.109+0000 7f1f2d864780 1 < completed delete operation key=N9RQIGHVL8VP tag=U66RO9LR0J68 type=del 2024-09-12T00:34:20.108 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.110+0000 7f1f2d864780 1 > prepared operation key=WKK747ETLW10 tag=J090TRSIYZRG type=del size=2795781 2024-09-12T00:34:20.109 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.111+0000 7f1f2d864780 1 < canceled operation key=0DSQOFS8IIF5 tag=C7RIQQNHTDCC type=write size=992290 2024-09-12T00:34:20.110 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.112+0000 7f1f2d864780 1 > prepared operation key=ECZYQEZ942W8 tag=ZM5Q7KUWHF8W type=write size=105442 2024-09-12T00:34:20.112 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.113+0000 7f1f2d864780 1 < completed delete operation key=FFG41OYEYFZA tag=DC7OAF182LR7 type=del 2024-09-12T00:34:20.113 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.114+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=AVKEZC5S31R7 type=write size=971154 2024-09-12T00:34:20.114 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.115+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~WIC0P4Y4UBOV.0 size=1048576 2024-09-12T00:34:20.115 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.116+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~WIC0P4Y4UBOV.1 size=422763 2024-09-12T00:34:20.117 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.118+0000 7f1f2d864780 1 < completed multipart upload key=1299IOSGYIO9 upload=WIC0P4Y4UBOV tag=CUXIXVM7J1J2 type=write size=2519915 2024-09-12T00:34:20.118 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.119+0000 7f1f2d864780 1 > prepared operation key=9XK59MVZ5G1O tag=YKWJIDQZBC10 type=write size=989954 2024-09-12T00:34:20.119 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.121+0000 7f1f2d864780 1 < canceled operation key=W6U30X4HJCB1 tag=T7QV8MHI6YIC type=write size=303335 2024-09-12T00:34:20.120 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.122+0000 7f1f2d864780 1 > prepared operation key=KHPF1N1MT33Z tag=Q34PZMRKTGO6 type=del size=2077724 2024-09-12T00:34:20.121 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.123+0000 7f1f2d864780 1 < completed part key=_multipart_ZGO887JDR627.2~ARWV9P5KG5B6.0 size=1048576 2024-09-12T00:34:20.122 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.124+0000 7f1f2d864780 1 < completed part key=_multipart_ZGO887JDR627.2~ARWV9P5KG5B6.1 size=1048576 2024-09-12T00:34:20.123 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.125+0000 7f1f2d864780 1 < completed part key=_multipart_ZGO887JDR627.2~ARWV9P5KG5B6.2 size=1005669 2024-09-12T00:34:20.125 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.127+0000 7f1f2d864780 1 < completed multipart upload key=ZGO887JDR627 upload=ARWV9P5KG5B6 tag=T0OP0M6NIRF9 type=write size=4151397 2024-09-12T00:34:20.127 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.129+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~6W1WQK1JPJ2O.0 size=956562 2024-09-12T00:34:20.128 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.129+0000 7f1f2d864780 1 > prepared multipart upload key=FAP6N3H7SBN0 upload=6W1WQK1JPJ2O tag=0TT2EFHPEGQB type=write size=2005138 2024-09-12T00:34:20.129 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.130+0000 7f1f2d864780 1 < canceled operation key=S5DVMA14N7VJ tag=M0W4RLJED0PV type=del size=762235 2024-09-12T00:34:20.132 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.133+0000 7f1f2d864780 1 > prepared part key=_multipart_KHPF1N1MT33Z.2~ZVZUHH9XZB5V.0 size=1048576 2024-09-12T00:34:20.133 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.134+0000 7f1f2d864780 1 > prepared part key=_multipart_KHPF1N1MT33Z.2~ZVZUHH9XZB5V.1 size=785088 2024-09-12T00:34:20.133 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.134+0000 7f1f2d864780 1 > prepared multipart upload key=KHPF1N1MT33Z upload=ZVZUHH9XZB5V tag=NUHUMYF81I3W type=write size=2882240 2024-09-12T00:34:20.134 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.136+0000 7f1f2d864780 1 < completed delete operation key=W6U30X4HJCB1 tag=R3UBAOGBIJD4 type=del 2024-09-12T00:34:20.136 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.138+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~TNWBEL2JGUDE.0 size=306847 2024-09-12T00:34:20.137 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.138+0000 7f1f2d864780 1 > prepared multipart upload key=W6U30X4HJCB1 upload=TNWBEL2JGUDE tag=DZ0X22SOGUVW type=write size=1355423 2024-09-12T00:34:20.137 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.139+0000 7f1f2d864780 1 < completed write operation key=4FRVL0KXN2X8 tag=0KOCORDXPNA5 type=write size=745614 2024-09-12T00:34:20.138 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.140+0000 7f1f2d864780 1 > prepared operation key=4FRVL0KXN2X8 tag=6CJD054MQ2OK type=write size=537893 2024-09-12T00:34:20.141 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.142+0000 7f1f2d864780 1 < suggested update operation key=2G3UCYG4R4NM tag=L0WQK1TOHY1M type=del size=2716360 2024-09-12T00:34:20.143 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.144+0000 7f1f2d864780 1 > prepared part key=_multipart_ZYNIJH0TTSM6.2~TI1SRYXJO1OU.0 size=185176 2024-09-12T00:34:20.143 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.144+0000 7f1f2d864780 1 > prepared multipart upload key=ZYNIJH0TTSM6 upload=TI1SRYXJO1OU tag=O108WV8WG17U type=write size=1233752 2024-09-12T00:34:20.145 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.147+0000 7f1f2d864780 1 < suggested update operation key=ZYNIJH0TTSM6 tag=5BGG6D8WE4Y8 type=write size=296872 2024-09-12T00:34:20.147 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.149+0000 7f1f2d864780 1 > prepared part key=_multipart_WKK747ETLW10.2~HXI6SQ2918FT.0 size=274574 2024-09-12T00:34:20.147 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.149+0000 7f1f2d864780 1 > prepared multipart upload key=WKK747ETLW10 upload=HXI6SQ2918FT tag=57YIMH7VOL8B type=write size=1323150 2024-09-12T00:34:20.148 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.150+0000 7f1f2d864780 1 < completed write operation key=53QCNWX1V1R1 tag=7YUW9S1DF1M2 type=write size=956574 2024-09-12T00:34:20.149 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.151+0000 7f1f2d864780 1 > prepared operation key=GSPM8N0K7ODC tag=UTVASMUQ1EFT type=del size=995498 2024-09-12T00:34:20.151 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.153+0000 7f1f2d864780 1 < suggested remove operation key=AN26EVAZI527 tag=NEKUOTPMOVN9 type=write 2024-09-12T00:34:20.153 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.154+0000 7f1f2d864780 1 > prepared operation key=N9RQIGHVL8VP tag=SAZ06JBZN5IR type=write size=761842 2024-09-12T00:34:20.154 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.155+0000 7f1f2d864780 1 < completed delete operation key=O1YY03BOEYLM tag=VJAKM8AIKO76 type=del 2024-09-12T00:34:20.156 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.158+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~INTSVE4XS4GY.0 size=1048576 2024-09-12T00:34:20.157 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.158+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~INTSVE4XS4GY.1 size=1048576 2024-09-12T00:34:20.158 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.159+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~INTSVE4XS4GY.2 size=205271 2024-09-12T00:34:20.158 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.159+0000 7f1f2d864780 1 > prepared multipart upload key=SZP418NVZ5VX upload=INTSVE4XS4GY tag=NINTCFQX4VJM type=write size=3350999 2024-09-12T00:34:20.159 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.160+0000 7f1f2d864780 1 < completed delete operation key=WIIU8VTCLWOD tag=LRH1B6YABU4H type=del 2024-09-12T00:34:20.160 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.162+0000 7f1f2d864780 1 > prepared operation key=3Z1TGGPZKJ69 tag=1I8TROFE17AC type=del size=1636881 2024-09-12T00:34:20.161 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.163+0000 7f1f2d864780 1 < completed delete operation key=GSPM8N0K7ODC tag=JZ96PBJV643I type=del 2024-09-12T00:34:20.162 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.164+0000 7f1f2d864780 1 > prepared operation key=SZP418NVZ5VX tag=FUA0NX6G8O0U type=del size=1792423 2024-09-12T00:34:20.163 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.165+0000 7f1f2d864780 1 < completed delete operation key=WKK747ETLW10 tag=J090TRSIYZRG type=del 2024-09-12T00:34:20.165 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.166+0000 7f1f2d864780 1 > prepared operation key=N9RQIGHVL8VP tag=48YO141SMT4Y type=del size=1082865 2024-09-12T00:34:20.166 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.167+0000 7f1f2d864780 1 < completed write operation key=ECZYQEZ942W8 tag=ZM5Q7KUWHF8W type=write size=105442 2024-09-12T00:34:20.167 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.169+0000 7f1f2d864780 1 > prepared operation key=SZP418NVZ5VX tag=XWO39ZVPP8AM type=del size=1850441 2024-09-12T00:34:20.168 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.170+0000 7f1f2d864780 1 < completed write operation key=2RV0899QUJ8W tag=AVKEZC5S31R7 type=write size=971154 2024-09-12T00:34:20.169 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.171+0000 7f1f2d864780 1 > prepared operation key=D21W9QZWY0YU tag=YINWXYBQHTZ3 type=del size=1348925 2024-09-12T00:34:20.171 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.172+0000 7f1f2d864780 1 < completed write operation key=9XK59MVZ5G1O tag=YKWJIDQZBC10 type=write size=989954 2024-09-12T00:34:20.173 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.174+0000 7f1f2d864780 1 > prepared part key=_multipart_2G3UCYG4R4NM.2~792V4BWVJY4F.0 size=483130 2024-09-12T00:34:20.173 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.174+0000 7f1f2d864780 1 > prepared multipart upload key=2G3UCYG4R4NM upload=792V4BWVJY4F tag=V2JQFWTIQR2V type=write size=1531706 2024-09-12T00:34:20.174 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.175+0000 7f1f2d864780 1 < completed delete operation key=KHPF1N1MT33Z tag=Q34PZMRKTGO6 type=del 2024-09-12T00:34:20.176 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.177+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~LGOTKTP0YALI.0 size=1048576 2024-09-12T00:34:20.177 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.178+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~LGOTKTP0YALI.1 size=895904 2024-09-12T00:34:20.177 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.178+0000 7f1f2d864780 1 > prepared multipart upload key=WGKEA4EKF5GP upload=LGOTKTP0YALI tag=E7ZM5F937QOK type=write size=2993056 2024-09-12T00:34:20.177 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.178+0000 7f1f2d864780 1 < canceled part key=_multipart_FAP6N3H7SBN0.2~6W1WQK1JPJ2O.0 size=956562 2024-09-12T00:34:20.178 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.180+0000 7f1f2d864780 1 < canceled multipart upload key=FAP6N3H7SBN0 upload=6W1WQK1JPJ2O tag=0TT2EFHPEGQB type=write size=2005138 2024-09-12T00:34:20.180 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.181+0000 7f1f2d864780 1 > prepared operation key=FAP6N3H7SBN0 tag=A1UXKMIONQZ0 type=del size=710301 2024-09-12T00:34:20.181 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.183+0000 7f1f2d864780 1 < completed part key=_multipart_KHPF1N1MT33Z.2~ZVZUHH9XZB5V.0 size=1048576 2024-09-12T00:34:20.182 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.184+0000 7f1f2d864780 1 < completed part key=_multipart_KHPF1N1MT33Z.2~ZVZUHH9XZB5V.1 size=785088 2024-09-12T00:34:20.184 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.186+0000 7f1f2d864780 1 < completed multipart upload key=KHPF1N1MT33Z upload=ZVZUHH9XZB5V tag=NUHUMYF81I3W type=write size=2882240 2024-09-12T00:34:20.186 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.188+0000 7f1f2d864780 1 > prepared part key=_multipart_FFG41OYEYFZA.2~WN0UGT9AMTZA.0 size=942809 2024-09-12T00:34:20.186 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.188+0000 7f1f2d864780 1 > prepared multipart upload key=FFG41OYEYFZA upload=WN0UGT9AMTZA tag=SQ4DRRFOORCX type=write size=1991385 2024-09-12T00:34:20.187 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.188+0000 7f1f2d864780 1 < canceled part key=_multipart_W6U30X4HJCB1.2~TNWBEL2JGUDE.0 size=306847 2024-09-12T00:34:20.188 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.190+0000 7f1f2d864780 1 < canceled multipart upload key=W6U30X4HJCB1 upload=TNWBEL2JGUDE tag=DZ0X22SOGUVW type=write size=1355423 2024-09-12T00:34:20.189 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.191+0000 7f1f2d864780 1 > prepared operation key=W6U30X4HJCB1 tag=7NVXHU4K5VJ8 type=del size=460186 2024-09-12T00:34:20.190 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.192+0000 7f1f2d864780 1 < completed write operation key=4FRVL0KXN2X8 tag=6CJD054MQ2OK type=write size=537893 2024-09-12T00:34:20.192 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.193+0000 7f1f2d864780 1 > prepared operation key=WIIU8VTCLWOD tag=C06I6EVN9D0W type=del size=3623802 2024-09-12T00:34:20.193 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.194+0000 7f1f2d864780 1 < completed part key=_multipart_ZYNIJH0TTSM6.2~TI1SRYXJO1OU.0 size=185176 2024-09-12T00:34:20.195 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.196+0000 7f1f2d864780 1 < completed multipart upload key=ZYNIJH0TTSM6 upload=TI1SRYXJO1OU tag=O108WV8WG17U type=write size=1233752 2024-09-12T00:34:20.196 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.198+0000 7f1f2d864780 1 > prepared operation key=SNCGB6Z20450 tag=12KDOGLWF8T9 type=del size=593336 2024-09-12T00:34:20.197 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.199+0000 7f1f2d864780 1 < completed part key=_multipart_WKK747ETLW10.2~HXI6SQ2918FT.0 size=274574 2024-09-12T00:34:20.201 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.202+0000 7f1f2d864780 1 < completed multipart upload key=WKK747ETLW10 upload=HXI6SQ2918FT tag=57YIMH7VOL8B type=write size=1323150 2024-09-12T00:34:20.203 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.204+0000 7f1f2d864780 1 > prepared part key=_multipart_KHPF1N1MT33Z.2~ATNF05WH5F4P.0 size=289599 2024-09-12T00:34:20.203 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.204+0000 7f1f2d864780 1 > prepared multipart upload key=KHPF1N1MT33Z upload=ATNF05WH5F4P tag=3JJFYKCOXR1J type=write size=1338175 2024-09-12T00:34:20.204 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.205+0000 7f1f2d864780 1 < completed delete operation key=GSPM8N0K7ODC tag=UTVASMUQ1EFT type=del 2024-09-12T00:34:20.205 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.207+0000 7f1f2d864780 1 > prepared operation key=PVB52GO6L8T4 tag=VM0FGXDG3Q4M type=del size=701857 2024-09-12T00:34:20.206 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.208+0000 7f1f2d864780 1 < completed write operation key=N9RQIGHVL8VP tag=SAZ06JBZN5IR type=write size=761842 2024-09-12T00:34:20.207 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.209+0000 7f1f2d864780 1 > prepared operation key=O1YY03BOEYLM tag=LZ62C3I7QMQG type=del size=3967966 2024-09-12T00:34:20.208 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.210+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~INTSVE4XS4GY.0 size=1048576 2024-09-12T00:34:20.209 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.211+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~INTSVE4XS4GY.1 size=1048576 2024-09-12T00:34:20.209 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.211+0000 7f1f2d864780 1 < canceled part key=_multipart_SZP418NVZ5VX.2~INTSVE4XS4GY.2 size=205271 2024-09-12T00:34:20.211 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.213+0000 7f1f2d864780 1 < canceled multipart upload key=SZP418NVZ5VX upload=INTSVE4XS4GY tag=NINTCFQX4VJM type=write size=3350999 2024-09-12T00:34:20.212 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.214+0000 7f1f2d864780 1 > prepared operation key=0DSQOFS8IIF5 tag=NC7XF52UNIR4 type=write size=858076 2024-09-12T00:34:20.213 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.215+0000 7f1f2d864780 1 < completed delete operation key=3Z1TGGPZKJ69 tag=1I8TROFE17AC type=del 2024-09-12T00:34:20.214 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.216+0000 7f1f2d864780 1 > prepared operation key=WIIU8VTCLWOD tag=04Z7RKJC8KPY type=del size=1699771 2024-09-12T00:34:20.216 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.217+0000 7f1f2d864780 1 < completed delete operation key=SZP418NVZ5VX tag=FUA0NX6G8O0U type=del 2024-09-12T00:34:20.217 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.218+0000 7f1f2d864780 1 > prepared operation key=53QCNWX1V1R1 tag=ZL62F6KALNR0 type=del size=1901061 2024-09-12T00:34:20.218 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.220+0000 7f1f2d864780 1 < completed delete operation key=N9RQIGHVL8VP tag=48YO141SMT4Y type=del 2024-09-12T00:34:20.220 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.222+0000 7f1f2d864780 1 > prepared part key=_multipart_2RV0899QUJ8W.2~9K5MSERXSSBE.0 size=1048576 2024-09-12T00:34:20.221 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.222+0000 7f1f2d864780 1 > prepared part key=_multipart_2RV0899QUJ8W.2~9K5MSERXSSBE.1 size=1048576 2024-09-12T00:34:20.222 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.223+0000 7f1f2d864780 1 > prepared part key=_multipart_2RV0899QUJ8W.2~9K5MSERXSSBE.2 size=478277 2024-09-12T00:34:20.222 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.223+0000 7f1f2d864780 1 > prepared multipart upload key=2RV0899QUJ8W upload=9K5MSERXSSBE tag=WZT0YVKP2AZD type=write size=3624005 2024-09-12T00:34:20.223 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.225+0000 7f1f2d864780 1 < completed delete operation key=SZP418NVZ5VX tag=XWO39ZVPP8AM type=del 2024-09-12T00:34:20.224 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.226+0000 7f1f2d864780 1 > prepared operation key=SZP418NVZ5VX tag=8VTUJAIQWSTZ type=del size=2065957 2024-09-12T00:34:20.225 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.227+0000 7f1f2d864780 1 < completed delete operation key=D21W9QZWY0YU tag=YINWXYBQHTZ3 type=del 2024-09-12T00:34:20.227 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.229+0000 7f1f2d864780 1 > prepared part key=_multipart_9XK59MVZ5G1O.2~S50ZZUBUNJ6O.0 size=1048576 2024-09-12T00:34:20.228 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.230+0000 7f1f2d864780 1 > prepared part key=_multipart_9XK59MVZ5G1O.2~S50ZZUBUNJ6O.1 size=998666 2024-09-12T00:34:20.228 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.230+0000 7f1f2d864780 1 > prepared multipart upload key=9XK59MVZ5G1O upload=S50ZZUBUNJ6O tag=B99WLM4GCEYB type=write size=3095818 2024-09-12T00:34:20.229 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.230+0000 7f1f2d864780 1 < canceled part key=_multipart_2G3UCYG4R4NM.2~792V4BWVJY4F.0 size=483130 2024-09-12T00:34:20.230 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.232+0000 7f1f2d864780 1 < canceled multipart upload key=2G3UCYG4R4NM upload=792V4BWVJY4F tag=V2JQFWTIQR2V type=write size=1531706 2024-09-12T00:34:20.231 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.233+0000 7f1f2d864780 1 > prepared operation key=W6U30X4HJCB1 tag=RZDF66LYIX32 type=del size=2749352 2024-09-12T00:34:20.232 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.234+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~LGOTKTP0YALI.0 size=1048576 2024-09-12T00:34:20.234 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.235+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~LGOTKTP0YALI.1 size=895904 2024-09-12T00:34:20.235 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.237+0000 7f1f2d864780 1 < completed multipart upload key=WGKEA4EKF5GP upload=LGOTKTP0YALI tag=E7ZM5F937QOK type=write size=2993056 2024-09-12T00:34:20.237 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.238+0000 7f1f2d864780 1 > prepared operation key=SZP418NVZ5VX tag=01NLUQDEPAW7 type=del size=1388310 2024-09-12T00:34:20.239 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.241+0000 7f1f2d864780 1 < suggested remove operation key=FAP6N3H7SBN0 tag=A1UXKMIONQZ0 type=del 2024-09-12T00:34:20.241 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.243+0000 7f1f2d864780 1 > prepared operation key=KHPF1N1MT33Z tag=YY8S5ZZRFNH0 type=write size=924349 2024-09-12T00:34:20.242 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.244+0000 7f1f2d864780 1 < completed part key=_multipart_FFG41OYEYFZA.2~WN0UGT9AMTZA.0 size=942809 2024-09-12T00:34:20.246 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.248+0000 7f1f2d864780 1 < completed multipart upload key=FFG41OYEYFZA upload=WN0UGT9AMTZA tag=SQ4DRRFOORCX type=write size=1991385 2024-09-12T00:34:20.248 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.250+0000 7f1f2d864780 1 > prepared part key=_multipart_2YCGIJRK6MUH.2~8PCG05RRR2IM.0 size=640697 2024-09-12T00:34:20.248 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.250+0000 7f1f2d864780 1 > prepared multipart upload key=2YCGIJRK6MUH upload=8PCG05RRR2IM tag=4H6I9AN1PIVR type=write size=1689273 2024-09-12T00:34:20.250 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.251+0000 7f1f2d864780 1 < completed delete operation key=W6U30X4HJCB1 tag=7NVXHU4K5VJ8 type=del 2024-09-12T00:34:20.251 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.252+0000 7f1f2d864780 1 > prepared operation key=FAP6N3H7SBN0 tag=4QEF3U8L0AZW type=del size=226748 2024-09-12T00:34:20.252 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.254+0000 7f1f2d864780 1 < completed delete operation key=WIIU8VTCLWOD tag=C06I6EVN9D0W type=del 2024-09-12T00:34:20.253 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.255+0000 7f1f2d864780 1 > prepared operation key=WIIU8VTCLWOD tag=3X5OICPXSHZT type=del size=1248271 2024-09-12T00:34:20.256 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.257+0000 7f1f2d864780 1 < suggested update operation key=SNCGB6Z20450 tag=12KDOGLWF8T9 type=del size=593336 2024-09-12T00:34:20.258 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.259+0000 7f1f2d864780 1 > prepared part key=_multipart_WIIU8VTCLWOD.2~0NV5PQBZT7O6.0 size=1048576 2024-09-12T00:34:20.258 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.260+0000 7f1f2d864780 1 > prepared part key=_multipart_WIIU8VTCLWOD.2~0NV5PQBZT7O6.1 size=265880 2024-09-12T00:34:20.259 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.260+0000 7f1f2d864780 1 > prepared multipart upload key=WIIU8VTCLWOD upload=0NV5PQBZT7O6 tag=EYZC6D7WN1DF type=write size=2363032 2024-09-12T00:34:20.260 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.261+0000 7f1f2d864780 1 < completed part key=_multipart_KHPF1N1MT33Z.2~ATNF05WH5F4P.0 size=289599 2024-09-12T00:34:20.261 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.263+0000 7f1f2d864780 1 < completed multipart upload key=KHPF1N1MT33Z upload=ATNF05WH5F4P tag=3JJFYKCOXR1J type=write size=1338175 2024-09-12T00:34:20.263 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.264+0000 7f1f2d864780 1 > prepared operation key=GSPM8N0K7ODC tag=2TSFPWKQLLHM type=del size=3345532 2024-09-12T00:34:20.264 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.266+0000 7f1f2d864780 1 < completed delete operation key=PVB52GO6L8T4 tag=VM0FGXDG3Q4M type=del 2024-09-12T00:34:20.265 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.267+0000 7f1f2d864780 1 > prepared operation key=2G3UCYG4R4NM tag=ZZ692IOUFNB7 type=del size=2234139 2024-09-12T00:34:20.266 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.268+0000 7f1f2d864780 1 < completed delete operation key=O1YY03BOEYLM tag=LZ62C3I7QMQG type=del 2024-09-12T00:34:20.267 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.269+0000 7f1f2d864780 1 > prepared operation key=D21W9QZWY0YU tag=AQ9MLP0CPZC8 type=del size=3956711 2024-09-12T00:34:20.269 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.270+0000 7f1f2d864780 1 < completed write operation key=0DSQOFS8IIF5 tag=NC7XF52UNIR4 type=write size=858076 2024-09-12T00:34:20.271 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.273+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~Y7CKKYF8RH62.0 size=1048576 2024-09-12T00:34:20.272 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.273+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~Y7CKKYF8RH62.1 size=1048576 2024-09-12T00:34:20.273 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.274+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~Y7CKKYF8RH62.2 size=20394 2024-09-12T00:34:20.273 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.274+0000 7f1f2d864780 1 > prepared multipart upload key=W6U30X4HJCB1 upload=Y7CKKYF8RH62 tag=JKYCVFXQP700 type=write size=3166122 2024-09-12T00:34:20.275 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.277+0000 7f1f2d864780 1 < suggested update operation key=WIIU8VTCLWOD tag=04Z7RKJC8KPY type=del size=1699771 2024-09-12T00:34:20.277 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.279+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~OMBIH0L810W5.0 size=1048576 2024-09-12T00:34:20.278 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.280+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~OMBIH0L810W5.1 size=1048576 2024-09-12T00:34:20.279 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.280+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~OMBIH0L810W5.2 size=577414 2024-09-12T00:34:20.279 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.280+0000 7f1f2d864780 1 > prepared multipart upload key=WGKEA4EKF5GP upload=OMBIH0L810W5 tag=2YPRUMVK0DC9 type=write size=3723142 2024-09-12T00:34:20.280 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.281+0000 7f1f2d864780 1 < completed delete operation key=53QCNWX1V1R1 tag=ZL62F6KALNR0 type=del 2024-09-12T00:34:20.282 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.284+0000 7f1f2d864780 1 > prepared part key=_multipart_ECZYQEZ942W8.2~XMVAIGV7TU0Y.0 size=46052 2024-09-12T00:34:20.282 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.284+0000 7f1f2d864780 1 > prepared multipart upload key=ECZYQEZ942W8 upload=XMVAIGV7TU0Y tag=5DDWBLR2MLFV type=write size=1094628 2024-09-12T00:34:20.283 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.285+0000 7f1f2d864780 1 < completed part key=_multipart_2RV0899QUJ8W.2~9K5MSERXSSBE.0 size=1048576 2024-09-12T00:34:20.284 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.286+0000 7f1f2d864780 1 < completed part key=_multipart_2RV0899QUJ8W.2~9K5MSERXSSBE.1 size=1048576 2024-09-12T00:34:20.285 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.286+0000 7f1f2d864780 1 < completed part key=_multipart_2RV0899QUJ8W.2~9K5MSERXSSBE.2 size=478277 2024-09-12T00:34:20.287 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.289+0000 7f1f2d864780 1 < completed multipart upload key=2RV0899QUJ8W upload=9K5MSERXSSBE tag=WZT0YVKP2AZD type=write size=3624005 2024-09-12T00:34:20.288 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.290+0000 7f1f2d864780 1 > prepared operation key=FAP6N3H7SBN0 tag=GCOU41L3R3TH type=write size=620760 2024-09-12T00:34:20.290 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.291+0000 7f1f2d864780 1 < completed delete operation key=SZP418NVZ5VX tag=8VTUJAIQWSTZ type=del 2024-09-12T00:34:20.291 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.292+0000 7f1f2d864780 1 > prepared operation key=3Z1TGGPZKJ69 tag=TA7NUGRRN8TC type=del size=296070 2024-09-12T00:34:20.291 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.293+0000 7f1f2d864780 1 < canceled part key=_multipart_9XK59MVZ5G1O.2~S50ZZUBUNJ6O.0 size=1048576 2024-09-12T00:34:20.292 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.294+0000 7f1f2d864780 1 < completed part key=_multipart_9XK59MVZ5G1O.2~S50ZZUBUNJ6O.1 size=998666 2024-09-12T00:34:20.294 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.295+0000 7f1f2d864780 1 < canceled multipart upload key=9XK59MVZ5G1O upload=S50ZZUBUNJ6O tag=B99WLM4GCEYB type=write size=3095818 2024-09-12T00:34:20.296 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.298+0000 7f1f2d864780 1 > prepared part key=_multipart_MSGU3PHLBRJH.2~Z3H0HRXORQJF.0 size=1048576 2024-09-12T00:34:20.297 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.298+0000 7f1f2d864780 1 > prepared part key=_multipart_MSGU3PHLBRJH.2~Z3H0HRXORQJF.1 size=249461 2024-09-12T00:34:20.297 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.298+0000 7f1f2d864780 1 > prepared multipart upload key=MSGU3PHLBRJH upload=Z3H0HRXORQJF tag=2HTR5EBGXBKJ type=write size=2346613 2024-09-12T00:34:20.298 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.300+0000 7f1f2d864780 1 < completed delete operation key=W6U30X4HJCB1 tag=RZDF66LYIX32 type=del 2024-09-12T00:34:20.300 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.302+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~RK5ZXOP2EM2C.0 size=1048576 2024-09-12T00:34:20.301 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.303+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~RK5ZXOP2EM2C.1 size=1048576 2024-09-12T00:34:20.302 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.303+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~RK5ZXOP2EM2C.2 size=457957 2024-09-12T00:34:20.302 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.303+0000 7f1f2d864780 1 > prepared multipart upload key=W6U30X4HJCB1 upload=RK5ZXOP2EM2C tag=Y561VJF1R7SG type=write size=3603685 2024-09-12T00:34:20.304 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.306+0000 7f1f2d864780 1 < suggested update operation key=SZP418NVZ5VX tag=01NLUQDEPAW7 type=del size=1388310 2024-09-12T00:34:20.305 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.307+0000 7f1f2d864780 1 > prepared operation key=FFG41OYEYFZA tag=1GJK35CK56F0 type=del size=1723020 2024-09-12T00:34:20.306 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.308+0000 7f1f2d864780 1 < completed write operation key=KHPF1N1MT33Z tag=YY8S5ZZRFNH0 type=write size=924349 2024-09-12T00:34:20.310 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.312+0000 7f1f2d864780 1 > prepared part key=_multipart_2G3UCYG4R4NM.2~AJG71CV3XXAS.0 size=1048576 2024-09-12T00:34:20.311 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.313+0000 7f1f2d864780 1 > prepared part key=_multipart_2G3UCYG4R4NM.2~AJG71CV3XXAS.1 size=300116 2024-09-12T00:34:20.311 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.313+0000 7f1f2d864780 1 > prepared multipart upload key=2G3UCYG4R4NM upload=AJG71CV3XXAS tag=QZCXSV3NOF7T type=write size=2397268 2024-09-12T00:34:20.312 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.314+0000 7f1f2d864780 1 < completed part key=_multipart_2YCGIJRK6MUH.2~8PCG05RRR2IM.0 size=640697 2024-09-12T00:34:20.314 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.316+0000 7f1f2d864780 1 < completed multipart upload key=2YCGIJRK6MUH upload=8PCG05RRR2IM tag=4H6I9AN1PIVR type=write size=1689273 2024-09-12T00:34:20.316 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.318+0000 7f1f2d864780 1 > prepared part key=_multipart_3Z1TGGPZKJ69.2~5XN5E00SFD2R.0 size=920957 2024-09-12T00:34:20.316 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.318+0000 7f1f2d864780 1 > prepared multipart upload key=3Z1TGGPZKJ69 upload=5XN5E00SFD2R tag=JN36ZS5O4A26 type=write size=1969533 2024-09-12T00:34:20.317 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.319+0000 7f1f2d864780 1 < completed delete operation key=FAP6N3H7SBN0 tag=4QEF3U8L0AZW type=del 2024-09-12T00:34:20.319 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.321+0000 7f1f2d864780 1 > prepared part key=_multipart_UTR2UUO6DHLJ.2~UAKS4SN1OCOY.0 size=77085 2024-09-12T00:34:20.319 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.321+0000 7f1f2d864780 1 > prepared multipart upload key=UTR2UUO6DHLJ upload=UAKS4SN1OCOY tag=19VVXLUFZI0G type=write size=1125661 2024-09-12T00:34:20.320 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.322+0000 7f1f2d864780 -1 < failed to complete operation key=WIIU8VTCLWOD tag=3X5OICPXSHZT type=del size=1248271: (22) Invalid argument 2024-09-12T00:34:20.321 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.323+0000 7f1f2d864780 1 > prepared operation key=W6U30X4HJCB1 tag=YCNAIE2ES96N type=write size=71812 2024-09-12T00:34:20.323 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.324+0000 7f1f2d864780 1 < completed part key=_multipart_WIIU8VTCLWOD.2~0NV5PQBZT7O6.0 size=1048576 2024-09-12T00:34:20.324 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.325+0000 7f1f2d864780 1 < completed part key=_multipart_WIIU8VTCLWOD.2~0NV5PQBZT7O6.1 size=265880 2024-09-12T00:34:20.325 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.327+0000 7f1f2d864780 1 < completed multipart upload key=WIIU8VTCLWOD upload=0NV5PQBZT7O6 tag=EYZC6D7WN1DF type=write size=2363032 2024-09-12T00:34:20.327 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.328+0000 7f1f2d864780 1 > prepared operation key=WGKEA4EKF5GP tag=1E5KMJ0SDA2B type=del size=2066914 2024-09-12T00:34:20.331 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.332+0000 7f1f2d864780 1 < suggested update operation key=GSPM8N0K7ODC tag=2TSFPWKQLLHM type=del size=3345532 2024-09-12T00:34:20.333 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.334+0000 7f1f2d864780 1 > prepared part key=_multipart_N9RQIGHVL8VP.2~RM3EOE10P2J0.0 size=1048576 2024-09-12T00:34:20.334 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.335+0000 7f1f2d864780 1 > prepared part key=_multipart_N9RQIGHVL8VP.2~RM3EOE10P2J0.1 size=475704 2024-09-12T00:34:20.334 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.335+0000 7f1f2d864780 1 > prepared multipart upload key=N9RQIGHVL8VP upload=RM3EOE10P2J0 tag=UG25QIX58O7G type=write size=2572856 2024-09-12T00:34:20.335 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.337+0000 7f1f2d864780 1 < completed delete operation key=2G3UCYG4R4NM tag=ZZ692IOUFNB7 type=del 2024-09-12T00:34:20.336 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.338+0000 7f1f2d864780 1 > prepared operation key=DYKLAY6J018G tag=GYS0ZZU0SPN0 type=del size=1928886 2024-09-12T00:34:20.338 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.340+0000 7f1f2d864780 1 < suggested update operation key=D21W9QZWY0YU tag=AQ9MLP0CPZC8 type=del size=3956711 2024-09-12T00:34:20.341 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.342+0000 7f1f2d864780 1 > prepared part key=_multipart_KHPF1N1MT33Z.2~OBVNS3UPSA4E.0 size=1048576 2024-09-12T00:34:20.341 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.343+0000 7f1f2d864780 1 > prepared part key=_multipart_KHPF1N1MT33Z.2~OBVNS3UPSA4E.1 size=542485 2024-09-12T00:34:20.342 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.343+0000 7f1f2d864780 1 > prepared multipart upload key=KHPF1N1MT33Z upload=OBVNS3UPSA4E tag=EP3FKOV26OKX type=write size=2639637 2024-09-12T00:34:20.343 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.344+0000 7f1f2d864780 1 < completed part key=_multipart_W6U30X4HJCB1.2~Y7CKKYF8RH62.0 size=1048576 2024-09-12T00:34:20.343 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.345+0000 7f1f2d864780 1 < completed part key=_multipart_W6U30X4HJCB1.2~Y7CKKYF8RH62.1 size=1048576 2024-09-12T00:34:20.344 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.346+0000 7f1f2d864780 1 < completed part key=_multipart_W6U30X4HJCB1.2~Y7CKKYF8RH62.2 size=20394 2024-09-12T00:34:20.346 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.348+0000 7f1f2d864780 1 < completed multipart upload key=W6U30X4HJCB1 upload=Y7CKKYF8RH62 tag=JKYCVFXQP700 type=write size=3166122 2024-09-12T00:34:20.347 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.349+0000 7f1f2d864780 1 > prepared operation key=2G3UCYG4R4NM tag=KIU4ULAEVJAN type=write size=686567 2024-09-12T00:34:20.349 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.350+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~OMBIH0L810W5.0 size=1048576 2024-09-12T00:34:20.350 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.351+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~OMBIH0L810W5.1 size=1048576 2024-09-12T00:34:20.351 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.352+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~OMBIH0L810W5.2 size=577414 2024-09-12T00:34:20.353 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.355+0000 7f1f2d864780 1 < completed multipart upload key=WGKEA4EKF5GP upload=OMBIH0L810W5 tag=2YPRUMVK0DC9 type=write size=3723142 2024-09-12T00:34:20.354 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.356+0000 7f1f2d864780 1 > prepared operation key=0DSQOFS8IIF5 tag=ABLAMRR7O3VX type=del size=3459389 2024-09-12T00:34:20.355 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.356+0000 7f1f2d864780 1 < canceled part key=_multipart_ECZYQEZ942W8.2~XMVAIGV7TU0Y.0 size=46052 2024-09-12T00:34:20.357 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.358+0000 7f1f2d864780 1 < canceled multipart upload key=ECZYQEZ942W8 upload=XMVAIGV7TU0Y tag=5DDWBLR2MLFV type=write size=1094628 2024-09-12T00:34:20.359 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.361+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~I6749VU9NHHI.0 size=1048576 2024-09-12T00:34:20.360 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.362+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~I6749VU9NHHI.1 size=236373 2024-09-12T00:34:20.360 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.362+0000 7f1f2d864780 1 > prepared multipart upload key=W6U30X4HJCB1 upload=I6749VU9NHHI tag=201SAGPXB0X9 type=write size=2333525 2024-09-12T00:34:20.361 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.363+0000 7f1f2d864780 1 < completed write operation key=FAP6N3H7SBN0 tag=GCOU41L3R3TH type=write size=620760 2024-09-12T00:34:20.364 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.365+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~7TG22PB1M1AW.0 size=1048576 2024-09-12T00:34:20.364 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.366+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~7TG22PB1M1AW.1 size=1048576 2024-09-12T00:34:20.365 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.367+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~7TG22PB1M1AW.2 size=84050 2024-09-12T00:34:20.365 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.367+0000 7f1f2d864780 1 > prepared multipart upload key=1299IOSGYIO9 upload=7TG22PB1M1AW tag=39GV76KFS659 type=write size=3229778 2024-09-12T00:34:20.367 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.368+0000 7f1f2d864780 1 < completed delete operation key=3Z1TGGPZKJ69 tag=TA7NUGRRN8TC type=del 2024-09-12T00:34:20.368 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.369+0000 7f1f2d864780 1 > prepared operation key=S5DVMA14N7VJ tag=DF411MSLTAH5 type=del size=1970322 2024-09-12T00:34:20.369 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.371+0000 7f1f2d864780 1 < completed part key=_multipart_MSGU3PHLBRJH.2~Z3H0HRXORQJF.0 size=1048576 2024-09-12T00:34:20.370 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.372+0000 7f1f2d864780 1 < completed part key=_multipart_MSGU3PHLBRJH.2~Z3H0HRXORQJF.1 size=249461 2024-09-12T00:34:20.372 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.374+0000 7f1f2d864780 1 < completed multipart upload key=MSGU3PHLBRJH upload=Z3H0HRXORQJF tag=2HTR5EBGXBKJ type=write size=2346613 2024-09-12T00:34:20.373 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.375+0000 7f1f2d864780 1 > prepared operation key=O1YY03BOEYLM tag=QPQ3SSZECP7B type=del size=797085 2024-09-12T00:34:20.374 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.376+0000 7f1f2d864780 1 < completed part key=_multipart_W6U30X4HJCB1.2~RK5ZXOP2EM2C.0 size=1048576 2024-09-12T00:34:20.375 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.377+0000 7f1f2d864780 1 < completed part key=_multipart_W6U30X4HJCB1.2~RK5ZXOP2EM2C.1 size=1048576 2024-09-12T00:34:20.376 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.378+0000 7f1f2d864780 1 < completed part key=_multipart_W6U30X4HJCB1.2~RK5ZXOP2EM2C.2 size=457957 2024-09-12T00:34:20.378 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.380+0000 7f1f2d864780 1 < completed multipart upload key=W6U30X4HJCB1 upload=RK5ZXOP2EM2C tag=Y561VJF1R7SG type=write size=3603685 2024-09-12T00:34:20.379 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.381+0000 7f1f2d864780 1 > prepared operation key=ZGO887JDR627 tag=Q5XU67ULTNFR type=write size=675013 2024-09-12T00:34:20.381 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.382+0000 7f1f2d864780 1 < completed delete operation key=FFG41OYEYFZA tag=1GJK35CK56F0 type=del 2024-09-12T00:34:20.382 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.384+0000 7f1f2d864780 1 > prepared operation key=3Z1TGGPZKJ69 tag=9851ZEMNHNKQ type=del size=3227812 2024-09-12T00:34:20.383 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.385+0000 7f1f2d864780 1 < completed part key=_multipart_2G3UCYG4R4NM.2~AJG71CV3XXAS.0 size=1048576 2024-09-12T00:34:20.384 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.386+0000 7f1f2d864780 1 < completed part key=_multipart_2G3UCYG4R4NM.2~AJG71CV3XXAS.1 size=300116 2024-09-12T00:34:20.386 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.388+0000 7f1f2d864780 1 < completed multipart upload key=2G3UCYG4R4NM upload=AJG71CV3XXAS tag=QZCXSV3NOF7T type=write size=2397268 2024-09-12T00:34:20.387 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.389+0000 7f1f2d864780 1 > prepared operation key=KHPF1N1MT33Z tag=P2C93T1U2E01 type=del size=3201947 2024-09-12T00:34:20.388 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.390+0000 7f1f2d864780 1 < completed part key=_multipart_3Z1TGGPZKJ69.2~5XN5E00SFD2R.0 size=920957 2024-09-12T00:34:20.392 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.393+0000 7f1f2d864780 1 < completed multipart upload key=3Z1TGGPZKJ69 upload=5XN5E00SFD2R tag=JN36ZS5O4A26 type=write size=1969533 2024-09-12T00:34:20.393 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.395+0000 7f1f2d864780 1 > prepared operation key=DYKLAY6J018G tag=QXFUHU77PFCX type=del size=1802953 2024-09-12T00:34:20.394 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.396+0000 7f1f2d864780 1 < completed part key=_multipart_UTR2UUO6DHLJ.2~UAKS4SN1OCOY.0 size=77085 2024-09-12T00:34:20.396 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.398+0000 7f1f2d864780 1 < completed multipart upload key=UTR2UUO6DHLJ upload=UAKS4SN1OCOY tag=19VVXLUFZI0G type=write size=1125661 2024-09-12T00:34:20.397 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.399+0000 7f1f2d864780 1 > prepared operation key=2G3UCYG4R4NM tag=1F5GN0G3JY0Y type=del size=2311624 2024-09-12T00:34:20.398 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.400+0000 7f1f2d864780 1 < completed write operation key=W6U30X4HJCB1 tag=YCNAIE2ES96N type=write size=71812 2024-09-12T00:34:20.400 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.402+0000 7f1f2d864780 1 > prepared part key=_multipart_ECZYQEZ942W8.2~2NIGX1G2J3BC.0 size=737585 2024-09-12T00:34:20.401 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.402+0000 7f1f2d864780 1 > prepared multipart upload key=ECZYQEZ942W8 upload=2NIGX1G2J3BC tag=CNUT0RDWK074 type=write size=1786161 2024-09-12T00:34:20.401 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.403+0000 7f1f2d864780 1 < completed delete operation key=WGKEA4EKF5GP tag=1E5KMJ0SDA2B type=del 2024-09-12T00:34:20.403 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.404+0000 7f1f2d864780 1 > prepared operation key=O1YY03BOEYLM tag=F6WXY6OW5F5G type=del size=3319551 2024-09-12T00:34:20.404 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.406+0000 7f1f2d864780 1 < completed part key=_multipart_N9RQIGHVL8VP.2~RM3EOE10P2J0.0 size=1048576 2024-09-12T00:34:20.405 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.407+0000 7f1f2d864780 1 < completed part key=_multipart_N9RQIGHVL8VP.2~RM3EOE10P2J0.1 size=475704 2024-09-12T00:34:20.407 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.408+0000 7f1f2d864780 1 < completed multipart upload key=N9RQIGHVL8VP upload=RM3EOE10P2J0 tag=UG25QIX58O7G type=write size=2572856 2024-09-12T00:34:20.408 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.410+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=KPPSZII8AMG9 type=del size=431335 2024-09-12T00:34:20.409 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.411+0000 7f1f2d864780 1 < canceled operation key=DYKLAY6J018G tag=GYS0ZZU0SPN0 type=del size=1928886 2024-09-12T00:34:20.411 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.413+0000 7f1f2d864780 1 > prepared part key=_multipart_ZGO887JDR627.2~0KWYQ5W6MHGN.0 size=1048576 2024-09-12T00:34:20.412 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.413+0000 7f1f2d864780 1 > prepared part key=_multipart_ZGO887JDR627.2~0KWYQ5W6MHGN.1 size=1048576 2024-09-12T00:34:20.413 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.414+0000 7f1f2d864780 1 > prepared part key=_multipart_ZGO887JDR627.2~0KWYQ5W6MHGN.2 size=855654 2024-09-12T00:34:20.413 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.414+0000 7f1f2d864780 1 > prepared multipart upload key=ZGO887JDR627 upload=0KWYQ5W6MHGN tag=JBZXLON0462H type=write size=4001382 2024-09-12T00:34:20.414 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.415+0000 7f1f2d864780 1 < completed part key=_multipart_KHPF1N1MT33Z.2~OBVNS3UPSA4E.0 size=1048576 2024-09-12T00:34:20.415 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.416+0000 7f1f2d864780 1 < completed part key=_multipart_KHPF1N1MT33Z.2~OBVNS3UPSA4E.1 size=542485 2024-09-12T00:34:20.416 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.418+0000 7f1f2d864780 1 < completed multipart upload key=KHPF1N1MT33Z upload=OBVNS3UPSA4E tag=EP3FKOV26OKX type=write size=2639637 2024-09-12T00:34:20.419 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.420+0000 7f1f2d864780 1 > prepared part key=_multipart_OY145ZXRSF4L.2~O0WZD3BU25WP.0 size=611967 2024-09-12T00:34:20.419 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.420+0000 7f1f2d864780 1 > prepared multipart upload key=OY145ZXRSF4L upload=O0WZD3BU25WP tag=CPOXHN0HDL0F type=write size=1660543 2024-09-12T00:34:20.420 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.421+0000 7f1f2d864780 1 < completed write operation key=2G3UCYG4R4NM tag=KIU4ULAEVJAN type=write size=686567 2024-09-12T00:34:20.421 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.422+0000 7f1f2d864780 1 > prepared operation key=UTR2UUO6DHLJ tag=IA843EFNEI32 type=del size=3125949 2024-09-12T00:34:20.422 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.424+0000 7f1f2d864780 1 < completed delete operation key=0DSQOFS8IIF5 tag=ABLAMRR7O3VX type=del 2024-09-12T00:34:20.423 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.425+0000 7f1f2d864780 1 > prepared operation key=WKK747ETLW10 tag=LMBFN3TI9H95 type=del size=1388851 2024-09-12T00:34:20.424 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.426+0000 7f1f2d864780 1 < completed part key=_multipart_W6U30X4HJCB1.2~I6749VU9NHHI.0 size=1048576 2024-09-12T00:34:20.425 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.427+0000 7f1f2d864780 1 < completed part key=_multipart_W6U30X4HJCB1.2~I6749VU9NHHI.1 size=236373 2024-09-12T00:34:20.427 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.429+0000 7f1f2d864780 1 < completed multipart upload key=W6U30X4HJCB1 upload=I6749VU9NHHI tag=201SAGPXB0X9 type=write size=2333525 2024-09-12T00:34:20.429 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.431+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~RO8OG0IR00SE.0 size=1048576 2024-09-12T00:34:20.430 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.432+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~RO8OG0IR00SE.1 size=1048576 2024-09-12T00:34:20.431 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.433+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~RO8OG0IR00SE.2 size=552233 2024-09-12T00:34:20.431 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.433+0000 7f1f2d864780 1 > prepared multipart upload key=0DSQOFS8IIF5 upload=RO8OG0IR00SE tag=V064SX5O1G2S type=write size=3697961 2024-09-12T00:34:20.432 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.434+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~7TG22PB1M1AW.0 size=1048576 2024-09-12T00:34:20.433 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.435+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~7TG22PB1M1AW.1 size=1048576 2024-09-12T00:34:20.434 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.436+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~7TG22PB1M1AW.2 size=84050 2024-09-12T00:34:20.437 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.439+0000 7f1f2d864780 1 < completed multipart upload key=1299IOSGYIO9 upload=7TG22PB1M1AW tag=39GV76KFS659 type=write size=3229778 2024-09-12T00:34:20.438 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.440+0000 7f1f2d864780 1 > prepared operation key=N9RQIGHVL8VP tag=YUD8CE7336TO type=del size=1450288 2024-09-12T00:34:20.439 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.441+0000 7f1f2d864780 1 < canceled operation key=S5DVMA14N7VJ tag=DF411MSLTAH5 type=del size=1970322 2024-09-12T00:34:20.440 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.442+0000 7f1f2d864780 1 > prepared operation key=PVB52GO6L8T4 tag=6FUDW0Z3JX5L type=write size=561730 2024-09-12T00:34:20.441 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.443+0000 7f1f2d864780 1 < completed delete operation key=O1YY03BOEYLM tag=QPQ3SSZECP7B type=del 2024-09-12T00:34:20.443 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.444+0000 7f1f2d864780 1 > prepared operation key=ECZYQEZ942W8 tag=MIXE3NT36BWK type=write size=254406 2024-09-12T00:34:20.444 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.445+0000 7f1f2d864780 1 < completed write operation key=ZGO887JDR627 tag=Q5XU67ULTNFR type=write size=675013 2024-09-12T00:34:20.445 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.447+0000 7f1f2d864780 1 > prepared operation key=9XK59MVZ5G1O tag=NWV1WILH30OP type=del size=13146 2024-09-12T00:34:20.446 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.448+0000 7f1f2d864780 1 < completed delete operation key=3Z1TGGPZKJ69 tag=9851ZEMNHNKQ type=del 2024-09-12T00:34:20.448 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.450+0000 7f1f2d864780 1 > prepared part key=_multipart_AN26EVAZI527.2~D2IGUVUS4ZWN.0 size=1048576 2024-09-12T00:34:20.449 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.451+0000 7f1f2d864780 1 > prepared part key=_multipart_AN26EVAZI527.2~D2IGUVUS4ZWN.1 size=75119 2024-09-12T00:34:20.449 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.451+0000 7f1f2d864780 1 > prepared multipart upload key=AN26EVAZI527 upload=D2IGUVUS4ZWN tag=WVF7QQRBVOYK type=write size=2172271 2024-09-12T00:34:20.450 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.452+0000 7f1f2d864780 1 < completed delete operation key=KHPF1N1MT33Z tag=P2C93T1U2E01 type=del 2024-09-12T00:34:20.453 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.454+0000 7f1f2d864780 1 > prepared part key=_multipart_MSGU3PHLBRJH.2~TXF79O98XMVV.0 size=1048576 2024-09-12T00:34:20.453 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.455+0000 7f1f2d864780 1 > prepared part key=_multipart_MSGU3PHLBRJH.2~TXF79O98XMVV.1 size=1048576 2024-09-12T00:34:20.454 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.456+0000 7f1f2d864780 1 > prepared part key=_multipart_MSGU3PHLBRJH.2~TXF79O98XMVV.2 size=868209 2024-09-12T00:34:20.454 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.456+0000 7f1f2d864780 1 > prepared multipart upload key=MSGU3PHLBRJH upload=TXF79O98XMVV tag=W5QCMCH2RGYZ type=write size=4013937 2024-09-12T00:34:20.456 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.457+0000 7f1f2d864780 1 < completed delete operation key=DYKLAY6J018G tag=QXFUHU77PFCX type=del 2024-09-12T00:34:20.458 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.459+0000 7f1f2d864780 1 > prepared part key=_multipart_2G3UCYG4R4NM.2~JV3R2PIBU5HR.0 size=1048576 2024-09-12T00:34:20.459 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.461+0000 7f1f2d864780 1 > prepared part key=_multipart_2G3UCYG4R4NM.2~JV3R2PIBU5HR.1 size=1048576 2024-09-12T00:34:20.460 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.462+0000 7f1f2d864780 1 > prepared part key=_multipart_2G3UCYG4R4NM.2~JV3R2PIBU5HR.2 size=337572 2024-09-12T00:34:20.460 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.462+0000 7f1f2d864780 1 > prepared multipart upload key=2G3UCYG4R4NM upload=JV3R2PIBU5HR tag=7WP03QHU25XS type=write size=3483300 2024-09-12T00:34:20.461 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.463+0000 7f1f2d864780 1 < completed delete operation key=2G3UCYG4R4NM tag=1F5GN0G3JY0Y type=del 2024-09-12T00:34:20.464 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.466+0000 7f1f2d864780 1 > prepared part key=_multipart_9XK59MVZ5G1O.2~OKR4AVIPU9R0.0 size=1048576 2024-09-12T00:34:20.465 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.466+0000 7f1f2d864780 1 > prepared part key=_multipart_9XK59MVZ5G1O.2~OKR4AVIPU9R0.1 size=354310 2024-09-12T00:34:20.465 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.466+0000 7f1f2d864780 1 > prepared multipart upload key=9XK59MVZ5G1O upload=OKR4AVIPU9R0 tag=ATAQWFSLR0RR type=write size=2451462 2024-09-12T00:34:20.465 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.467+0000 7f1f2d864780 1 < canceled part key=_multipart_ECZYQEZ942W8.2~2NIGX1G2J3BC.0 size=737585 2024-09-12T00:34:20.467 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.468+0000 7f1f2d864780 1 < canceled multipart upload key=ECZYQEZ942W8 upload=2NIGX1G2J3BC tag=CNUT0RDWK074 type=write size=1786161 2024-09-12T00:34:20.468 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.470+0000 7f1f2d864780 1 > prepared operation key=WGKEA4EKF5GP tag=V3AG5SGOC6LF type=del size=3923849 2024-09-12T00:34:20.469 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.471+0000 7f1f2d864780 1 < completed delete operation key=O1YY03BOEYLM tag=F6WXY6OW5F5G type=del 2024-09-12T00:34:20.471 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.473+0000 7f1f2d864780 1 > prepared part key=_multipart_ZGO887JDR627.2~V1664Z3JJJ6Z.0 size=1048576 2024-09-12T00:34:20.472 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.473+0000 7f1f2d864780 1 > prepared part key=_multipart_ZGO887JDR627.2~V1664Z3JJJ6Z.1 size=1048576 2024-09-12T00:34:20.473 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.474+0000 7f1f2d864780 1 > prepared part key=_multipart_ZGO887JDR627.2~V1664Z3JJJ6Z.2 size=641539 2024-09-12T00:34:20.473 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.474+0000 7f1f2d864780 1 > prepared multipart upload key=ZGO887JDR627 upload=V1664Z3JJJ6Z tag=WPHPY0G9828S type=write size=3787267 2024-09-12T00:34:20.474 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.476+0000 7f1f2d864780 1 < completed delete operation key=2RV0899QUJ8W tag=KPPSZII8AMG9 type=del 2024-09-12T00:34:20.475 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.477+0000 7f1f2d864780 1 > prepared operation key=SZP418NVZ5VX tag=U8XRDV9BFH0D type=del size=1680097 2024-09-12T00:34:20.476 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.478+0000 7f1f2d864780 1 < completed part key=_multipart_ZGO887JDR627.2~0KWYQ5W6MHGN.0 size=1048576 2024-09-12T00:34:20.477 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.479+0000 7f1f2d864780 1 < completed part key=_multipart_ZGO887JDR627.2~0KWYQ5W6MHGN.1 size=1048576 2024-09-12T00:34:20.478 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.480+0000 7f1f2d864780 1 < completed part key=_multipart_ZGO887JDR627.2~0KWYQ5W6MHGN.2 size=855654 2024-09-12T00:34:20.480 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.481+0000 7f1f2d864780 1 < completed multipart upload key=ZGO887JDR627 upload=0KWYQ5W6MHGN tag=JBZXLON0462H type=write size=4001382 2024-09-12T00:34:20.481 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.483+0000 7f1f2d864780 1 > prepared operation key=ZGO887JDR627 tag=Q200C1YAKLNS type=del size=3047630 2024-09-12T00:34:20.482 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.484+0000 7f1f2d864780 1 < completed part key=_multipart_OY145ZXRSF4L.2~O0WZD3BU25WP.0 size=611967 2024-09-12T00:34:20.484 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.485+0000 7f1f2d864780 1 < completed multipart upload key=OY145ZXRSF4L upload=O0WZD3BU25WP tag=CPOXHN0HDL0F type=write size=1660543 2024-09-12T00:34:20.485 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.487+0000 7f1f2d864780 1 > prepared operation key=FAP6N3H7SBN0 tag=3TY6SP8RUJDB type=del size=230161 2024-09-12T00:34:20.486 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.488+0000 7f1f2d864780 1 < completed delete operation key=UTR2UUO6DHLJ tag=IA843EFNEI32 type=del 2024-09-12T00:34:20.487 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.489+0000 7f1f2d864780 1 > prepared operation key=O1YY03BOEYLM tag=UR8RGL3N46LF type=write size=981491 2024-09-12T00:34:20.489 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.491+0000 7f1f2d864780 1 < suggested remove operation key=WKK747ETLW10 tag=LMBFN3TI9H95 type=del 2024-09-12T00:34:20.490 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.492+0000 7f1f2d864780 1 > prepared operation key=WKK747ETLW10 tag=CCAPC9L64DRN type=del size=3055452 2024-09-12T00:34:20.492 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.493+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~RO8OG0IR00SE.0 size=1048576 2024-09-12T00:34:20.492 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.493+0000 7f1f2d864780 1 < canceled part key=_multipart_0DSQOFS8IIF5.2~RO8OG0IR00SE.1 size=1048576 2024-09-12T00:34:20.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.494+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~RO8OG0IR00SE.2 size=552233 2024-09-12T00:34:20.494 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.496+0000 7f1f2d864780 1 < canceled multipart upload key=0DSQOFS8IIF5 upload=RO8OG0IR00SE tag=V064SX5O1G2S type=write size=3697961 2024-09-12T00:34:20.496 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.498+0000 7f1f2d864780 1 > prepared part key=_multipart_OY145ZXRSF4L.2~HC36MR02IWA2.0 size=1048576 2024-09-12T00:34:20.497 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.499+0000 7f1f2d864780 1 > prepared part key=_multipart_OY145ZXRSF4L.2~HC36MR02IWA2.1 size=973165 2024-09-12T00:34:20.497 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.499+0000 7f1f2d864780 1 > prepared multipart upload key=OY145ZXRSF4L upload=HC36MR02IWA2 tag=M4YJH3NJ7GHY type=write size=3070317 2024-09-12T00:34:20.498 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.500+0000 7f1f2d864780 1 < canceled operation key=N9RQIGHVL8VP tag=YUD8CE7336TO type=del size=1450288 2024-09-12T00:34:20.500 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.501+0000 7f1f2d864780 1 > prepared operation key=0DSQOFS8IIF5 tag=T13V6HVCL6MO type=del size=487158 2024-09-12T00:34:20.502 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.504+0000 7f1f2d864780 1 < suggested remove operation key=PVB52GO6L8T4 tag=6FUDW0Z3JX5L type=write 2024-09-12T00:34:20.503 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.505+0000 7f1f2d864780 1 > prepared operation key=MSGU3PHLBRJH tag=72MAS87I0WMF type=del size=4036340 2024-09-12T00:34:20.505 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.506+0000 7f1f2d864780 1 < completed write operation key=ECZYQEZ942W8 tag=MIXE3NT36BWK type=write size=254406 2024-09-12T00:34:20.506 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.507+0000 7f1f2d864780 1 > prepared operation key=0DSQOFS8IIF5 tag=42NL5VF0PSRE type=del size=2205687 2024-09-12T00:34:20.508 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.510+0000 7f1f2d864780 1 < suggested update operation key=9XK59MVZ5G1O tag=NWV1WILH30OP type=del size=13146 2024-09-12T00:34:20.509 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.511+0000 7f1f2d864780 1 > prepared operation key=MSGU3PHLBRJH tag=M9PG1YP8VHUE type=del size=3591254 2024-09-12T00:34:20.511 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.512+0000 7f1f2d864780 1 < completed part key=_multipart_AN26EVAZI527.2~D2IGUVUS4ZWN.0 size=1048576 2024-09-12T00:34:20.511 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.513+0000 7f1f2d864780 1 < completed part key=_multipart_AN26EVAZI527.2~D2IGUVUS4ZWN.1 size=75119 2024-09-12T00:34:20.513 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.515+0000 7f1f2d864780 1 < completed multipart upload key=AN26EVAZI527 upload=D2IGUVUS4ZWN tag=WVF7QQRBVOYK type=write size=2172271 2024-09-12T00:34:20.515 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.516+0000 7f1f2d864780 1 > prepared operation key=UTR2UUO6DHLJ tag=5734XK94R938 type=del size=4122277 2024-09-12T00:34:20.516 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.518+0000 7f1f2d864780 1 < completed part key=_multipart_MSGU3PHLBRJH.2~TXF79O98XMVV.0 size=1048576 2024-09-12T00:34:20.517 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.518+0000 7f1f2d864780 1 < completed part key=_multipart_MSGU3PHLBRJH.2~TXF79O98XMVV.1 size=1048576 2024-09-12T00:34:20.518 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.519+0000 7f1f2d864780 1 < completed part key=_multipart_MSGU3PHLBRJH.2~TXF79O98XMVV.2 size=868209 2024-09-12T00:34:20.520 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.521+0000 7f1f2d864780 1 < completed multipart upload key=MSGU3PHLBRJH upload=TXF79O98XMVV tag=W5QCMCH2RGYZ type=write size=4013937 2024-09-12T00:34:20.522 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.523+0000 7f1f2d864780 1 > prepared part key=_multipart_9XK59MVZ5G1O.2~X7WG6YTX1LWX.0 size=1048576 2024-09-12T00:34:20.523 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.524+0000 7f1f2d864780 1 > prepared part key=_multipart_9XK59MVZ5G1O.2~X7WG6YTX1LWX.1 size=1048576 2024-09-12T00:34:20.524 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.525+0000 7f1f2d864780 1 > prepared part key=_multipart_9XK59MVZ5G1O.2~X7WG6YTX1LWX.2 size=62831 2024-09-12T00:34:20.524 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.525+0000 7f1f2d864780 1 > prepared multipart upload key=9XK59MVZ5G1O upload=X7WG6YTX1LWX tag=Z3J4TEO4KVFG type=write size=3208559 2024-09-12T00:34:20.525 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.526+0000 7f1f2d864780 1 < completed part key=_multipart_2G3UCYG4R4NM.2~JV3R2PIBU5HR.0 size=1048576 2024-09-12T00:34:20.526 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.527+0000 7f1f2d864780 1 < completed part key=_multipart_2G3UCYG4R4NM.2~JV3R2PIBU5HR.1 size=1048576 2024-09-12T00:34:20.527 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.528+0000 7f1f2d864780 1 < completed part key=_multipart_2G3UCYG4R4NM.2~JV3R2PIBU5HR.2 size=337572 2024-09-12T00:34:20.529 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.530+0000 7f1f2d864780 1 < completed multipart upload key=2G3UCYG4R4NM upload=JV3R2PIBU5HR tag=7WP03QHU25XS type=write size=3483300 2024-09-12T00:34:20.530 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.532+0000 7f1f2d864780 1 > prepared operation key=GSPM8N0K7ODC tag=SOFV78R9O0Y2 type=del size=3093122 2024-09-12T00:34:20.531 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.533+0000 7f1f2d864780 1 < completed part key=_multipart_9XK59MVZ5G1O.2~OKR4AVIPU9R0.0 size=1048576 2024-09-12T00:34:20.532 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.534+0000 7f1f2d864780 1 < completed part key=_multipart_9XK59MVZ5G1O.2~OKR4AVIPU9R0.1 size=354310 2024-09-12T00:34:20.534 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.536+0000 7f1f2d864780 1 < completed multipart upload key=9XK59MVZ5G1O upload=OKR4AVIPU9R0 tag=ATAQWFSLR0RR type=write size=2451462 2024-09-12T00:34:20.537 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.538+0000 7f1f2d864780 1 > prepared part key=_multipart_SNCGB6Z20450.2~JDVAF9CQG6A2.0 size=1048576 2024-09-12T00:34:20.538 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.539+0000 7f1f2d864780 1 > prepared part key=_multipart_SNCGB6Z20450.2~JDVAF9CQG6A2.1 size=1048576 2024-09-12T00:34:20.539 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.540+0000 7f1f2d864780 1 > prepared part key=_multipart_SNCGB6Z20450.2~JDVAF9CQG6A2.2 size=382361 2024-09-12T00:34:20.539 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.540+0000 7f1f2d864780 1 > prepared multipart upload key=SNCGB6Z20450 upload=JDVAF9CQG6A2 tag=M8K1RJ06PL1O type=write size=3528089 2024-09-12T00:34:20.540 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.542+0000 7f1f2d864780 1 < completed delete operation key=WGKEA4EKF5GP tag=V3AG5SGOC6LF type=del 2024-09-12T00:34:20.542 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.544+0000 7f1f2d864780 1 > prepared part key=_multipart_53QCNWX1V1R1.2~ZDSK5O734FO0.0 size=353961 2024-09-12T00:34:20.542 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.544+0000 7f1f2d864780 1 > prepared multipart upload key=53QCNWX1V1R1 upload=ZDSK5O734FO0 tag=JPB0TXRNOALD type=write size=1402537 2024-09-12T00:34:20.544 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.545+0000 7f1f2d864780 1 < completed part key=_multipart_ZGO887JDR627.2~V1664Z3JJJ6Z.0 size=1048576 2024-09-12T00:34:20.545 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.546+0000 7f1f2d864780 1 < completed part key=_multipart_ZGO887JDR627.2~V1664Z3JJJ6Z.1 size=1048576 2024-09-12T00:34:20.546 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.547+0000 7f1f2d864780 1 < completed part key=_multipart_ZGO887JDR627.2~V1664Z3JJJ6Z.2 size=641539 2024-09-12T00:34:20.548 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.550+0000 7f1f2d864780 1 < completed multipart upload key=ZGO887JDR627 upload=V1664Z3JJJ6Z tag=WPHPY0G9828S type=write size=3787267 2024-09-12T00:34:20.549 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.551+0000 7f1f2d864780 1 > prepared operation key=ECZYQEZ942W8 tag=3N53RKY0RMZ5 type=del size=3392397 2024-09-12T00:34:20.551 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.553+0000 7f1f2d864780 1 < suggested update operation key=SZP418NVZ5VX tag=U8XRDV9BFH0D type=del size=1680097 2024-09-12T00:34:20.553 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.555+0000 7f1f2d864780 1 > prepared part key=_multipart_2G3UCYG4R4NM.2~LODHFMWARI3S.0 size=1048576 2024-09-12T00:34:20.554 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.556+0000 7f1f2d864780 1 > prepared part key=_multipart_2G3UCYG4R4NM.2~LODHFMWARI3S.1 size=260704 2024-09-12T00:34:20.555 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.556+0000 7f1f2d864780 1 > prepared multipart upload key=2G3UCYG4R4NM upload=LODHFMWARI3S tag=3QTGXWCKZX3J type=write size=2357856 2024-09-12T00:34:20.556 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.557+0000 7f1f2d864780 1 < completed delete operation key=ZGO887JDR627 tag=Q200C1YAKLNS type=del 2024-09-12T00:34:20.557 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.559+0000 7f1f2d864780 1 > prepared operation key=OY145ZXRSF4L tag=TIKOB16IE0K4 type=del size=798502 2024-09-12T00:34:20.558 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.560+0000 7f1f2d864780 1 < completed delete operation key=FAP6N3H7SBN0 tag=3TY6SP8RUJDB type=del 2024-09-12T00:34:20.561 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.562+0000 7f1f2d864780 1 > prepared part key=_multipart_SNCGB6Z20450.2~7KKBCOX0FC97.0 size=429688 2024-09-12T00:34:20.561 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.562+0000 7f1f2d864780 1 > prepared multipart upload key=SNCGB6Z20450 upload=7KKBCOX0FC97 tag=XY2B2ME05MCK type=write size=1478264 2024-09-12T00:34:20.562 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.563+0000 7f1f2d864780 1 < completed write operation key=O1YY03BOEYLM tag=UR8RGL3N46LF type=write size=981491 2024-09-12T00:34:20.564 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.566+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~ZV1YQK5ABPT8.0 size=17920 2024-09-12T00:34:20.564 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.566+0000 7f1f2d864780 1 > prepared multipart upload key=4FRVL0KXN2X8 upload=ZV1YQK5ABPT8 tag=B5XWV4W9RZS1 type=write size=1066496 2024-09-12T00:34:20.566 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.568+0000 7f1f2d864780 1 < suggested remove operation key=WKK747ETLW10 tag=CCAPC9L64DRN type=del 2024-09-12T00:34:20.569 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.570+0000 7f1f2d864780 1 > prepared part key=_multipart_DYKLAY6J018G.2~EYDASAQ3TVPF.0 size=965846 2024-09-12T00:34:20.569 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.570+0000 7f1f2d864780 1 > prepared multipart upload key=DYKLAY6J018G upload=EYDASAQ3TVPF tag=M299HRAGS4TG type=write size=2014422 2024-09-12T00:34:20.570 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.572+0000 7f1f2d864780 1 < completed part key=_multipart_OY145ZXRSF4L.2~HC36MR02IWA2.0 size=1048576 2024-09-12T00:34:20.572 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.573+0000 7f1f2d864780 1 < completed part key=_multipart_OY145ZXRSF4L.2~HC36MR02IWA2.1 size=973165 2024-09-12T00:34:20.576 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.577+0000 7f1f2d864780 1 < completed multipart upload key=OY145ZXRSF4L upload=HC36MR02IWA2 tag=M4YJH3NJ7GHY type=write size=3070317 2024-09-12T00:34:20.578 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.580+0000 7f1f2d864780 1 > prepared part key=_multipart_ECZYQEZ942W8.2~QLM392XRJ332.0 size=1048576 2024-09-12T00:34:20.579 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.581+0000 7f1f2d864780 1 > prepared part key=_multipart_ECZYQEZ942W8.2~QLM392XRJ332.1 size=1048576 2024-09-12T00:34:20.580 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.582+0000 7f1f2d864780 1 > prepared part key=_multipart_ECZYQEZ942W8.2~QLM392XRJ332.2 size=919233 2024-09-12T00:34:20.580 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.582+0000 7f1f2d864780 1 > prepared multipart upload key=ECZYQEZ942W8 upload=QLM392XRJ332 tag=YFLRIGHDARWX type=write size=4064961 2024-09-12T00:34:20.581 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.583+0000 7f1f2d864780 1 < completed delete operation key=0DSQOFS8IIF5 tag=T13V6HVCL6MO type=del 2024-09-12T00:34:20.583 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.585+0000 7f1f2d864780 1 > prepared part key=_multipart_WIIU8VTCLWOD.2~GR1F0AO7DKLZ.0 size=1048576 2024-09-12T00:34:20.584 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.586+0000 7f1f2d864780 1 > prepared part key=_multipart_WIIU8VTCLWOD.2~GR1F0AO7DKLZ.1 size=103386 2024-09-12T00:34:20.584 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.586+0000 7f1f2d864780 1 > prepared multipart upload key=WIIU8VTCLWOD upload=GR1F0AO7DKLZ tag=DO2CYNRPFFNZ type=write size=2200538 2024-09-12T00:34:20.586 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.587+0000 7f1f2d864780 1 < completed delete operation key=MSGU3PHLBRJH tag=72MAS87I0WMF type=del 2024-09-12T00:34:20.587 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.589+0000 7f1f2d864780 1 > prepared operation key=1299IOSGYIO9 tag=SF5JC63NM01U type=del size=1969721 2024-09-12T00:34:20.588 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.590+0000 7f1f2d864780 1 < completed delete operation key=0DSQOFS8IIF5 tag=42NL5VF0PSRE type=del 2024-09-12T00:34:20.589 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.591+0000 7f1f2d864780 1 > prepared operation key=KHPF1N1MT33Z tag=GMO7BB1X97CZ type=del size=1601442 2024-09-12T00:34:20.591 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.592+0000 7f1f2d864780 1 < completed delete operation key=MSGU3PHLBRJH tag=M9PG1YP8VHUE type=del 2024-09-12T00:34:20.592 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.593+0000 7f1f2d864780 1 > prepared operation key=WGKEA4EKF5GP tag=6WHTYF0NETCY type=del size=881908 2024-09-12T00:34:20.593 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.595+0000 7f1f2d864780 1 < completed delete operation key=UTR2UUO6DHLJ tag=5734XK94R938 type=del 2024-09-12T00:34:20.594 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.596+0000 7f1f2d864780 1 > prepared operation key=WGKEA4EKF5GP tag=C1HUXV3V8ISO type=del size=2896181 2024-09-12T00:34:20.595 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.597+0000 7f1f2d864780 1 < completed part key=_multipart_9XK59MVZ5G1O.2~X7WG6YTX1LWX.0 size=1048576 2024-09-12T00:34:20.596 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.598+0000 7f1f2d864780 1 < completed part key=_multipart_9XK59MVZ5G1O.2~X7WG6YTX1LWX.1 size=1048576 2024-09-12T00:34:20.596 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.598+0000 7f1f2d864780 1 < canceled part key=_multipart_9XK59MVZ5G1O.2~X7WG6YTX1LWX.2 size=62831 2024-09-12T00:34:20.598 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.600+0000 7f1f2d864780 1 < canceled multipart upload key=9XK59MVZ5G1O upload=X7WG6YTX1LWX tag=Z3J4TEO4KVFG type=write size=3208559 2024-09-12T00:34:20.600 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.602+0000 7f1f2d864780 1 > prepared part key=_multipart_3Z1TGGPZKJ69.2~IO2I97MXSZMC.0 size=753478 2024-09-12T00:34:20.600 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.602+0000 7f1f2d864780 1 > prepared multipart upload key=3Z1TGGPZKJ69 upload=IO2I97MXSZMC tag=LNMBKPGT3RYU type=write size=1802054 2024-09-12T00:34:20.601 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.603+0000 7f1f2d864780 1 < completed delete operation key=GSPM8N0K7ODC tag=SOFV78R9O0Y2 type=del 2024-09-12T00:34:20.602 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.604+0000 7f1f2d864780 1 > prepared operation key=KHPF1N1MT33Z tag=VD05833RLX6K type=del size=1810800 2024-09-12T00:34:20.603 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.605+0000 7f1f2d864780 1 < completed part key=_multipart_SNCGB6Z20450.2~JDVAF9CQG6A2.0 size=1048576 2024-09-12T00:34:20.604 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.606+0000 7f1f2d864780 1 < completed part key=_multipart_SNCGB6Z20450.2~JDVAF9CQG6A2.1 size=1048576 2024-09-12T00:34:20.605 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.607+0000 7f1f2d864780 1 < completed part key=_multipart_SNCGB6Z20450.2~JDVAF9CQG6A2.2 size=382361 2024-09-12T00:34:20.607 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.609+0000 7f1f2d864780 1 < completed multipart upload key=SNCGB6Z20450 upload=JDVAF9CQG6A2 tag=M8K1RJ06PL1O type=write size=3528089 2024-09-12T00:34:20.609 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.611+0000 7f1f2d864780 1 > prepared part key=_multipart_9XK59MVZ5G1O.2~IDS8YWGSK69P.0 size=937338 2024-09-12T00:34:20.609 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.611+0000 7f1f2d864780 1 > prepared multipart upload key=9XK59MVZ5G1O upload=IDS8YWGSK69P tag=4VV6FGEI4WO4 type=write size=1985914 2024-09-12T00:34:20.610 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.612+0000 7f1f2d864780 1 < completed part key=_multipart_53QCNWX1V1R1.2~ZDSK5O734FO0.0 size=353961 2024-09-12T00:34:20.613 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.614+0000 7f1f2d864780 1 < completed multipart upload key=53QCNWX1V1R1 upload=ZDSK5O734FO0 tag=JPB0TXRNOALD type=write size=1402537 2024-09-12T00:34:20.614 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.615+0000 7f1f2d864780 1 > prepared operation key=N9RQIGHVL8VP tag=BS9N59XZ2K90 type=del size=3327094 2024-09-12T00:34:20.615 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.616+0000 7f1f2d864780 1 < completed delete operation key=ECZYQEZ942W8 tag=3N53RKY0RMZ5 type=del 2024-09-12T00:34:20.616 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.618+0000 7f1f2d864780 1 > prepared operation key=ZGO887JDR627 tag=2AFVT2EGVRMI type=del size=2101432 2024-09-12T00:34:20.617 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.619+0000 7f1f2d864780 1 < completed part key=_multipart_2G3UCYG4R4NM.2~LODHFMWARI3S.0 size=1048576 2024-09-12T00:34:20.618 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.620+0000 7f1f2d864780 1 < completed part key=_multipart_2G3UCYG4R4NM.2~LODHFMWARI3S.1 size=260704 2024-09-12T00:34:20.620 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.622+0000 7f1f2d864780 1 < completed multipart upload key=2G3UCYG4R4NM upload=LODHFMWARI3S tag=3QTGXWCKZX3J type=write size=2357856 2024-09-12T00:34:20.623 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.624+0000 7f1f2d864780 1 > prepared part key=_multipart_ECZYQEZ942W8.2~YFCTEEOD7344.0 size=1048576 2024-09-12T00:34:20.624 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.625+0000 7f1f2d864780 1 > prepared part key=_multipart_ECZYQEZ942W8.2~YFCTEEOD7344.1 size=813821 2024-09-12T00:34:20.624 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.625+0000 7f1f2d864780 1 > prepared multipart upload key=ECZYQEZ942W8 upload=YFCTEEOD7344 tag=MUW9JYRDLZWN type=write size=2910973 2024-09-12T00:34:20.625 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.626+0000 7f1f2d864780 1 < completed delete operation key=OY145ZXRSF4L tag=TIKOB16IE0K4 type=del 2024-09-12T00:34:20.627 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.629+0000 7f1f2d864780 1 > prepared part key=_multipart_2YCGIJRK6MUH.2~QPD32AIXR354.0 size=1048576 2024-09-12T00:34:20.628 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.629+0000 7f1f2d864780 1 > prepared part key=_multipart_2YCGIJRK6MUH.2~QPD32AIXR354.1 size=481443 2024-09-12T00:34:20.629 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.629+0000 7f1f2d864780 1 > prepared multipart upload key=2YCGIJRK6MUH upload=QPD32AIXR354 tag=N7PRY32F22QA type=write size=2578595 2024-09-12T00:34:20.629 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.631+0000 7f1f2d864780 1 < completed part key=_multipart_SNCGB6Z20450.2~7KKBCOX0FC97.0 size=429688 2024-09-12T00:34:20.631 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.633+0000 7f1f2d864780 1 < completed multipart upload key=SNCGB6Z20450 upload=7KKBCOX0FC97 tag=XY2B2ME05MCK type=write size=1478264 2024-09-12T00:34:20.632 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.634+0000 7f1f2d864780 1 > prepared operation key=D21W9QZWY0YU tag=5ZSCIY3307QQ type=del size=2220359 2024-09-12T00:34:20.633 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.635+0000 7f1f2d864780 1 < completed part key=_multipart_4FRVL0KXN2X8.2~ZV1YQK5ABPT8.0 size=17920 2024-09-12T00:34:20.635 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.637+0000 7f1f2d864780 1 < completed multipart upload key=4FRVL0KXN2X8 upload=ZV1YQK5ABPT8 tag=B5XWV4W9RZS1 type=write size=1066496 2024-09-12T00:34:20.637 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.639+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~HENSVET36J1W.0 size=1048576 2024-09-12T00:34:20.638 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.640+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~HENSVET36J1W.1 size=1048576 2024-09-12T00:34:20.639 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.641+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~HENSVET36J1W.2 size=615445 2024-09-12T00:34:20.639 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.641+0000 7f1f2d864780 1 > prepared multipart upload key=SZP418NVZ5VX upload=HENSVET36J1W tag=8O7WXPX511R0 type=write size=3761173 2024-09-12T00:34:20.641 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.642+0000 7f1f2d864780 1 < completed part key=_multipart_DYKLAY6J018G.2~EYDASAQ3TVPF.0 size=965846 2024-09-12T00:34:20.643 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.644+0000 7f1f2d864780 1 < completed multipart upload key=DYKLAY6J018G upload=EYDASAQ3TVPF tag=M299HRAGS4TG type=write size=2014422 2024-09-12T00:34:20.645 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.647+0000 7f1f2d864780 1 > prepared part key=_multipart_O1YY03BOEYLM.2~X714WVWSJ3ZZ.0 size=814306 2024-09-12T00:34:20.645 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.647+0000 7f1f2d864780 1 > prepared multipart upload key=O1YY03BOEYLM upload=X714WVWSJ3ZZ tag=0T2FRD5JLPOM type=write size=1862882 2024-09-12T00:34:20.646 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.648+0000 7f1f2d864780 1 < completed part key=_multipart_ECZYQEZ942W8.2~QLM392XRJ332.0 size=1048576 2024-09-12T00:34:20.647 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.649+0000 7f1f2d864780 1 < completed part key=_multipart_ECZYQEZ942W8.2~QLM392XRJ332.1 size=1048576 2024-09-12T00:34:20.648 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.650+0000 7f1f2d864780 1 < completed part key=_multipart_ECZYQEZ942W8.2~QLM392XRJ332.2 size=919233 2024-09-12T00:34:20.650 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.652+0000 7f1f2d864780 1 < completed multipart upload key=ECZYQEZ942W8 upload=QLM392XRJ332 tag=YFLRIGHDARWX type=write size=4064961 2024-09-12T00:34:20.651 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.653+0000 7f1f2d864780 1 > prepared operation key=WIIU8VTCLWOD tag=J8ZRNL32RL0M type=del size=4072232 2024-09-12T00:34:20.652 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.654+0000 7f1f2d864780 1 < completed part key=_multipart_WIIU8VTCLWOD.2~GR1F0AO7DKLZ.0 size=1048576 2024-09-12T00:34:20.653 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.655+0000 7f1f2d864780 1 < completed part key=_multipart_WIIU8VTCLWOD.2~GR1F0AO7DKLZ.1 size=103386 2024-09-12T00:34:20.655 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.657+0000 7f1f2d864780 1 < completed multipart upload key=WIIU8VTCLWOD upload=GR1F0AO7DKLZ tag=DO2CYNRPFFNZ type=write size=2200538 2024-09-12T00:34:20.656 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.658+0000 7f1f2d864780 1 > prepared operation key=FAP6N3H7SBN0 tag=8L04H1EYWVID type=del size=2880724 2024-09-12T00:34:20.657 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.659+0000 7f1f2d864780 1 < completed delete operation key=1299IOSGYIO9 tag=SF5JC63NM01U type=del 2024-09-12T00:34:20.660 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.661+0000 7f1f2d864780 1 > prepared part key=_multipart_3Z1TGGPZKJ69.2~CVM7G37Y1GZD.0 size=296619 2024-09-12T00:34:20.660 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.661+0000 7f1f2d864780 1 > prepared multipart upload key=3Z1TGGPZKJ69 upload=CVM7G37Y1GZD tag=I1LCT0QIPNJX type=write size=1345195 2024-09-12T00:34:20.661 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.662+0000 7f1f2d864780 1 < completed delete operation key=KHPF1N1MT33Z tag=GMO7BB1X97CZ type=del 2024-09-12T00:34:20.663 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.664+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~E5XU4RUZEIFQ.0 size=100330 2024-09-12T00:34:20.663 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.664+0000 7f1f2d864780 1 > prepared multipart upload key=4FRVL0KXN2X8 upload=E5XU4RUZEIFQ tag=6XFFKS3FIJX3 type=write size=1148906 2024-09-12T00:34:20.664 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.666+0000 7f1f2d864780 1 < completed delete operation key=WGKEA4EKF5GP tag=6WHTYF0NETCY type=del 2024-09-12T00:34:20.668 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.667+0000 7f1f2d864780 1 > prepared operation key=53QCNWX1V1R1 tag=7GAIDMD3A2C6 type=del size=2584014 2024-09-12T00:34:20.669 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.669+0000 7f1f2d864780 1 < suggested update operation key=WGKEA4EKF5GP tag=C1HUXV3V8ISO type=del size=2896181 2024-09-12T00:34:20.669 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.670+0000 7f1f2d864780 1 > prepared operation key=ZYNIJH0TTSM6 tag=EITYIR42BNS1 type=write size=880102 2024-09-12T00:34:20.670 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.671+0000 7f1f2d864780 1 < completed part key=_multipart_3Z1TGGPZKJ69.2~IO2I97MXSZMC.0 size=753478 2024-09-12T00:34:20.674 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.675+0000 7f1f2d864780 1 < completed multipart upload key=3Z1TGGPZKJ69 upload=IO2I97MXSZMC tag=LNMBKPGT3RYU type=write size=1802054 2024-09-12T00:34:20.675 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.677+0000 7f1f2d864780 1 > prepared operation key=D21W9QZWY0YU tag=1LT5E97AAW23 type=del size=4112583 2024-09-12T00:34:20.676 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.678+0000 7f1f2d864780 1 < completed delete operation key=KHPF1N1MT33Z tag=VD05833RLX6K type=del 2024-09-12T00:34:20.679 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.680+0000 7f1f2d864780 1 > prepared part key=_multipart_ZYNIJH0TTSM6.2~JWHY417Y61IF.0 size=130507 2024-09-12T00:34:20.679 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.680+0000 7f1f2d864780 1 > prepared multipart upload key=ZYNIJH0TTSM6 upload=JWHY417Y61IF tag=S43350CVX03O type=write size=1179083 2024-09-12T00:34:20.680 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.681+0000 7f1f2d864780 1 < completed part key=_multipart_9XK59MVZ5G1O.2~IDS8YWGSK69P.0 size=937338 2024-09-12T00:34:20.682 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.684+0000 7f1f2d864780 1 < completed multipart upload key=9XK59MVZ5G1O upload=IDS8YWGSK69P tag=4VV6FGEI4WO4 type=write size=1985914 2024-09-12T00:34:20.685 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.686+0000 7f1f2d864780 1 > prepared part key=_multipart_DYKLAY6J018G.2~DYG3L1N7R7IU.0 size=1048576 2024-09-12T00:34:20.686 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.688+0000 7f1f2d864780 1 > prepared part key=_multipart_DYKLAY6J018G.2~DYG3L1N7R7IU.1 size=446983 2024-09-12T00:34:20.686 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.688+0000 7f1f2d864780 1 > prepared multipart upload key=DYKLAY6J018G upload=DYG3L1N7R7IU tag=57T1GC96FUW6 type=write size=2544135 2024-09-12T00:34:20.687 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.689+0000 7f1f2d864780 1 < completed delete operation key=N9RQIGHVL8VP tag=BS9N59XZ2K90 type=del 2024-09-12T00:34:20.688 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.690+0000 7f1f2d864780 1 > prepared operation key=53QCNWX1V1R1 tag=FIR7LMXTX9ED type=del size=2282142 2024-09-12T00:34:20.689 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.691+0000 7f1f2d864780 1 < completed delete operation key=ZGO887JDR627 tag=2AFVT2EGVRMI type=del 2024-09-12T00:34:20.691 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.693+0000 7f1f2d864780 1 > prepared part key=_multipart_2RV0899QUJ8W.2~S5EO8CUS8PWH.0 size=1048576 2024-09-12T00:34:20.692 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.694+0000 7f1f2d864780 1 > prepared part key=_multipart_2RV0899QUJ8W.2~S5EO8CUS8PWH.1 size=1048576 2024-09-12T00:34:20.693 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.695+0000 7f1f2d864780 1 > prepared part key=_multipart_2RV0899QUJ8W.2~S5EO8CUS8PWH.2 size=928361 2024-09-12T00:34:20.693 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.695+0000 7f1f2d864780 1 > prepared multipart upload key=2RV0899QUJ8W upload=S5EO8CUS8PWH tag=IA5Y9GX2STID type=write size=4074089 2024-09-12T00:34:20.695 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.696+0000 7f1f2d864780 1 < completed part key=_multipart_ECZYQEZ942W8.2~YFCTEEOD7344.0 size=1048576 2024-09-12T00:34:20.696 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.697+0000 7f1f2d864780 1 < completed part key=_multipart_ECZYQEZ942W8.2~YFCTEEOD7344.1 size=813821 2024-09-12T00:34:20.697 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.699+0000 7f1f2d864780 1 < completed multipart upload key=ECZYQEZ942W8 upload=YFCTEEOD7344 tag=MUW9JYRDLZWN type=write size=2910973 2024-09-12T00:34:20.698 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.700+0000 7f1f2d864780 1 > prepared operation key=SNCGB6Z20450 tag=U64PH30U6NYM type=del size=1606581 2024-09-12T00:34:20.700 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.701+0000 7f1f2d864780 1 < completed part key=_multipart_2YCGIJRK6MUH.2~QPD32AIXR354.0 size=1048576 2024-09-12T00:34:20.701 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.702+0000 7f1f2d864780 1 < completed part key=_multipart_2YCGIJRK6MUH.2~QPD32AIXR354.1 size=481443 2024-09-12T00:34:20.703 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.704+0000 7f1f2d864780 1 < completed multipart upload key=2YCGIJRK6MUH upload=QPD32AIXR354 tag=N7PRY32F22QA type=write size=2578595 2024-09-12T00:34:20.704 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.705+0000 7f1f2d864780 1 > prepared operation key=PVB52GO6L8T4 tag=3O3XH35G6O3Y type=write size=452297 2024-09-12T00:34:20.705 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.706+0000 7f1f2d864780 1 < completed delete operation key=D21W9QZWY0YU tag=5ZSCIY3307QQ type=del 2024-09-12T00:34:20.706 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.708+0000 7f1f2d864780 1 > prepared operation key=FFG41OYEYFZA tag=OOK91JT9GKAS type=del size=876584 2024-09-12T00:34:20.707 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.709+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~HENSVET36J1W.0 size=1048576 2024-09-12T00:34:20.707 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.709+0000 7f1f2d864780 1 < canceled part key=_multipart_SZP418NVZ5VX.2~HENSVET36J1W.1 size=1048576 2024-09-12T00:34:20.708 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.710+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~HENSVET36J1W.2 size=615445 2024-09-12T00:34:20.710 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.712+0000 7f1f2d864780 1 < canceled multipart upload key=SZP418NVZ5VX upload=HENSVET36J1W tag=8O7WXPX511R0 type=write size=3761173 2024-09-12T00:34:20.711 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.713+0000 7f1f2d864780 1 > prepared operation key=KHPF1N1MT33Z tag=3Z83L2DRXOCA type=del size=1219816 2024-09-12T00:34:20.712 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.714+0000 7f1f2d864780 1 < completed part key=_multipart_O1YY03BOEYLM.2~X714WVWSJ3ZZ.0 size=814306 2024-09-12T00:34:20.714 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.716+0000 7f1f2d864780 1 < completed multipart upload key=O1YY03BOEYLM upload=X714WVWSJ3ZZ tag=0T2FRD5JLPOM type=write size=1862882 2024-09-12T00:34:20.715 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.717+0000 7f1f2d864780 1 > prepared operation key=2G3UCYG4R4NM tag=JMCRO65746E2 type=del size=4053382 2024-09-12T00:34:20.717 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.718+0000 7f1f2d864780 1 < completed delete operation key=WIIU8VTCLWOD tag=J8ZRNL32RL0M type=del 2024-09-12T00:34:20.718 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.719+0000 7f1f2d864780 1 > prepared operation key=FFG41OYEYFZA tag=RICSLW6H8DH3 type=del size=1492307 2024-09-12T00:34:20.721 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.722+0000 7f1f2d864780 1 < suggested update operation key=FAP6N3H7SBN0 tag=8L04H1EYWVID type=del size=2880724 2024-09-12T00:34:20.723 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.725+0000 7f1f2d864780 1 > prepared part key=_multipart_ECZYQEZ942W8.2~1E5YD7AUHFTM.0 size=490228 2024-09-12T00:34:20.723 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.725+0000 7f1f2d864780 1 > prepared multipart upload key=ECZYQEZ942W8 upload=1E5YD7AUHFTM tag=ZF1SMXE45FC5 type=write size=1538804 2024-09-12T00:34:20.723 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.725+0000 7f1f2d864780 1 < canceled part key=_multipart_3Z1TGGPZKJ69.2~CVM7G37Y1GZD.0 size=296619 2024-09-12T00:34:20.725 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.727+0000 7f1f2d864780 1 < canceled multipart upload key=3Z1TGGPZKJ69 upload=CVM7G37Y1GZD tag=I1LCT0QIPNJX type=write size=1345195 2024-09-12T00:34:20.727 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.729+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~ARFF997REJQB.0 size=965509 2024-09-12T00:34:20.727 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.729+0000 7f1f2d864780 1 > prepared multipart upload key=WGKEA4EKF5GP upload=ARFF997REJQB tag=0ISDWJTBHY8L type=write size=2014085 2024-09-12T00:34:20.729 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.731+0000 7f1f2d864780 1 < completed part key=_multipart_4FRVL0KXN2X8.2~E5XU4RUZEIFQ.0 size=100330 2024-09-12T00:34:20.731 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.732+0000 7f1f2d864780 1 < completed multipart upload key=4FRVL0KXN2X8 upload=E5XU4RUZEIFQ tag=6XFFKS3FIJX3 type=write size=1148906 2024-09-12T00:34:20.732 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.734+0000 7f1f2d864780 1 > prepared operation key=GSPM8N0K7ODC tag=HM0Z00MPSV4A type=write size=591760 2024-09-12T00:34:20.733 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.735+0000 7f1f2d864780 1 < completed delete operation key=53QCNWX1V1R1 tag=7GAIDMD3A2C6 type=del 2024-09-12T00:34:20.735 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.737+0000 7f1f2d864780 1 > prepared part key=_multipart_53QCNWX1V1R1.2~XYFYZ6BHIKER.0 size=1048576 2024-09-12T00:34:20.736 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.738+0000 7f1f2d864780 1 > prepared part key=_multipart_53QCNWX1V1R1.2~XYFYZ6BHIKER.1 size=1048576 2024-09-12T00:34:20.737 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.739+0000 7f1f2d864780 1 > prepared part key=_multipart_53QCNWX1V1R1.2~XYFYZ6BHIKER.2 size=1016016 2024-09-12T00:34:20.737 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.739+0000 7f1f2d864780 1 > prepared multipart upload key=53QCNWX1V1R1 upload=XYFYZ6BHIKER tag=78FZIR2IGHV6 type=write size=4161744 2024-09-12T00:34:20.738 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.740+0000 7f1f2d864780 1 < completed write operation key=ZYNIJH0TTSM6 tag=EITYIR42BNS1 type=write size=880102 2024-09-12T00:34:20.741 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.742+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~0A8AT1VCGV7D.0 size=1048576 2024-09-12T00:34:20.741 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.743+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~0A8AT1VCGV7D.1 size=1048576 2024-09-12T00:34:20.743 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.744+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~0A8AT1VCGV7D.2 size=199076 2024-09-12T00:34:20.743 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.744+0000 7f1f2d864780 1 > prepared multipart upload key=4FRVL0KXN2X8 upload=0A8AT1VCGV7D tag=V6UGD2MFDYT7 type=write size=3344804 2024-09-12T00:34:20.744 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.745+0000 7f1f2d864780 1 < completed delete operation key=D21W9QZWY0YU tag=1LT5E97AAW23 type=del 2024-09-12T00:34:20.745 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.747+0000 7f1f2d864780 1 > prepared operation key=2YCGIJRK6MUH tag=V2OZPCPTGRRW type=write size=910931 2024-09-12T00:34:20.745 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.747+0000 7f1f2d864780 1 < canceled part key=_multipart_ZYNIJH0TTSM6.2~JWHY417Y61IF.0 size=130507 2024-09-12T00:34:20.747 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.749+0000 7f1f2d864780 1 < canceled multipart upload key=ZYNIJH0TTSM6 upload=JWHY417Y61IF tag=S43350CVX03O type=write size=1179083 2024-09-12T00:34:20.750 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.751+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~16UF1Q0O7R5V.0 size=1048576 2024-09-12T00:34:20.751 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.752+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~16UF1Q0O7R5V.1 size=358062 2024-09-12T00:34:20.751 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.752+0000 7f1f2d864780 1 > prepared multipart upload key=1299IOSGYIO9 upload=16UF1Q0O7R5V tag=304M7CAR8VSI type=write size=2455214 2024-09-12T00:34:20.751 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.752+0000 7f1f2d864780 1 < canceled part key=_multipart_DYKLAY6J018G.2~DYG3L1N7R7IU.0 size=1048576 2024-09-12T00:34:20.752 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.754+0000 7f1f2d864780 1 < completed part key=_multipart_DYKLAY6J018G.2~DYG3L1N7R7IU.1 size=446983 2024-09-12T00:34:20.754 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.756+0000 7f1f2d864780 1 < canceled multipart upload key=DYKLAY6J018G upload=DYG3L1N7R7IU tag=57T1GC96FUW6 type=write size=2544135 2024-09-12T00:34:20.755 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.757+0000 7f1f2d864780 1 > prepared operation key=UTR2UUO6DHLJ tag=8BJ8UV5LSJY1 type=del size=3468779 2024-09-12T00:34:20.756 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.758+0000 7f1f2d864780 1 < completed delete operation key=53QCNWX1V1R1 tag=FIR7LMXTX9ED type=del 2024-09-12T00:34:20.758 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.759+0000 7f1f2d864780 1 > prepared operation key=2YCGIJRK6MUH tag=RLXG7LL52Z0S type=del size=3265334 2024-09-12T00:34:20.759 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.761+0000 7f1f2d864780 1 < completed part key=_multipart_2RV0899QUJ8W.2~S5EO8CUS8PWH.0 size=1048576 2024-09-12T00:34:20.760 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.762+0000 7f1f2d864780 1 < completed part key=_multipart_2RV0899QUJ8W.2~S5EO8CUS8PWH.1 size=1048576 2024-09-12T00:34:20.761 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.763+0000 7f1f2d864780 1 < completed part key=_multipart_2RV0899QUJ8W.2~S5EO8CUS8PWH.2 size=928361 2024-09-12T00:34:20.763 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.765+0000 7f1f2d864780 1 < completed multipart upload key=2RV0899QUJ8W upload=S5EO8CUS8PWH tag=IA5Y9GX2STID type=write size=4074089 2024-09-12T00:34:20.764 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.766+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=4AIHQBNQ74JL type=write size=626226 2024-09-12T00:34:20.765 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.767+0000 7f1f2d864780 1 < completed delete operation key=SNCGB6Z20450 tag=U64PH30U6NYM type=del 2024-09-12T00:34:20.767 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.768+0000 7f1f2d864780 1 > prepared operation key=1299IOSGYIO9 tag=R854QB9NCT10 type=del size=2443302 2024-09-12T00:34:20.768 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.769+0000 7f1f2d864780 1 < completed write operation key=PVB52GO6L8T4 tag=3O3XH35G6O3Y type=write size=452297 2024-09-12T00:34:20.769 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.771+0000 7f1f2d864780 1 > prepared operation key=O1YY03BOEYLM tag=TFO95MB4MBAN type=del size=117799 2024-09-12T00:34:20.771 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.773+0000 7f1f2d864780 1 < suggested update operation key=FFG41OYEYFZA tag=OOK91JT9GKAS type=del size=876584 2024-09-12T00:34:20.773 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.774+0000 7f1f2d864780 1 > prepared operation key=O1YY03BOEYLM tag=8RAH7J6X19Q5 type=del size=2496969 2024-09-12T00:34:20.774 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.775+0000 7f1f2d864780 1 < canceled operation key=KHPF1N1MT33Z tag=3Z83L2DRXOCA type=del size=1219816 2024-09-12T00:34:20.776 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.777+0000 7f1f2d864780 1 > prepared part key=_multipart_WKK747ETLW10.2~X5GQ6S31X798.0 size=1048576 2024-09-12T00:34:20.777 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.778+0000 7f1f2d864780 1 > prepared part key=_multipart_WKK747ETLW10.2~X5GQ6S31X798.1 size=1048576 2024-09-12T00:34:20.778 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.779+0000 7f1f2d864780 1 > prepared part key=_multipart_WKK747ETLW10.2~X5GQ6S31X798.2 size=981670 2024-09-12T00:34:20.778 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.779+0000 7f1f2d864780 1 > prepared multipart upload key=WKK747ETLW10 upload=X5GQ6S31X798 tag=D2XTIFDLB9DH type=write size=4127398 2024-09-12T00:34:20.779 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.781+0000 7f1f2d864780 1 < completed delete operation key=2G3UCYG4R4NM tag=JMCRO65746E2 type=del 2024-09-12T00:34:20.780 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.782+0000 7f1f2d864780 1 > prepared operation key=2YCGIJRK6MUH tag=RN79ZR5S2RI5 type=del size=3312557 2024-09-12T00:34:20.781 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.783+0000 7f1f2d864780 -1 < failed to complete operation key=FFG41OYEYFZA tag=RICSLW6H8DH3 type=del size=1492307: (22) Invalid argument 2024-09-12T00:34:20.782 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.784+0000 7f1f2d864780 1 > prepared operation key=ZYNIJH0TTSM6 tag=1OHWPF2D94FM type=del size=2823469 2024-09-12T00:34:20.784 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.785+0000 7f1f2d864780 1 < completed part key=_multipart_ECZYQEZ942W8.2~1E5YD7AUHFTM.0 size=490228 2024-09-12T00:34:20.786 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.787+0000 7f1f2d864780 1 < completed multipart upload key=ECZYQEZ942W8 upload=1E5YD7AUHFTM tag=ZF1SMXE45FC5 type=write size=1538804 2024-09-12T00:34:20.787 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.788+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=NDG88TG3ZYTF type=write size=809917 2024-09-12T00:34:20.787 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.789+0000 7f1f2d864780 1 < canceled part key=_multipart_WGKEA4EKF5GP.2~ARFF997REJQB.0 size=965509 2024-09-12T00:34:20.789 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.791+0000 7f1f2d864780 1 < canceled multipart upload key=WGKEA4EKF5GP upload=ARFF997REJQB tag=0ISDWJTBHY8L type=write size=2014085 2024-09-12T00:34:20.790 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.792+0000 7f1f2d864780 1 > prepared operation key=2YCGIJRK6MUH tag=JCXS1FCGMKQ6 type=del size=2085161 2024-09-12T00:34:20.792 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.794+0000 7f1f2d864780 1 < suggested update operation key=GSPM8N0K7ODC tag=HM0Z00MPSV4A type=write size=591760 2024-09-12T00:34:20.794 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.795+0000 7f1f2d864780 1 > prepared operation key=WGKEA4EKF5GP tag=2GWQA7HFHAEM type=del size=3352560 2024-09-12T00:34:20.795 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.796+0000 7f1f2d864780 1 < completed part key=_multipart_53QCNWX1V1R1.2~XYFYZ6BHIKER.0 size=1048576 2024-09-12T00:34:20.795 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.796+0000 7f1f2d864780 1 < canceled part key=_multipart_53QCNWX1V1R1.2~XYFYZ6BHIKER.1 size=1048576 2024-09-12T00:34:20.796 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.798+0000 7f1f2d864780 1 < completed part key=_multipart_53QCNWX1V1R1.2~XYFYZ6BHIKER.2 size=1016016 2024-09-12T00:34:20.800 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.802+0000 7f1f2d864780 1 < canceled multipart upload key=53QCNWX1V1R1 upload=XYFYZ6BHIKER tag=78FZIR2IGHV6 type=write size=4161744 2024-09-12T00:34:20.802 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.804+0000 7f1f2d864780 1 > prepared operation key=3Z1TGGPZKJ69 tag=WNYN5M53INKJ type=del size=3550389 2024-09-12T00:34:20.803 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.805+0000 7f1f2d864780 1 < completed part key=_multipart_4FRVL0KXN2X8.2~0A8AT1VCGV7D.0 size=1048576 2024-09-12T00:34:20.804 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.806+0000 7f1f2d864780 1 < completed part key=_multipart_4FRVL0KXN2X8.2~0A8AT1VCGV7D.1 size=1048576 2024-09-12T00:34:20.805 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.806+0000 7f1f2d864780 1 < completed part key=_multipart_4FRVL0KXN2X8.2~0A8AT1VCGV7D.2 size=199076 2024-09-12T00:34:20.807 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.809+0000 7f1f2d864780 1 < completed multipart upload key=4FRVL0KXN2X8 upload=0A8AT1VCGV7D tag=V6UGD2MFDYT7 type=write size=3344804 2024-09-12T00:34:20.809 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.811+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~R6CRC67NX23U.0 size=1048576 2024-09-12T00:34:20.810 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.811+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~R6CRC67NX23U.1 size=671617 2024-09-12T00:34:20.810 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.811+0000 7f1f2d864780 1 > prepared multipart upload key=W6U30X4HJCB1 upload=R6CRC67NX23U tag=XCAOPX2UJBL8 type=write size=2768769 2024-09-12T00:34:20.811 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.812+0000 7f1f2d864780 1 < canceled operation key=2YCGIJRK6MUH tag=V2OZPCPTGRRW type=write size=910931 2024-09-12T00:34:20.812 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.814+0000 7f1f2d864780 1 > prepared operation key=0DSQOFS8IIF5 tag=OQC0QUTQG6MZ type=del size=946157 2024-09-12T00:34:20.813 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.815+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~16UF1Q0O7R5V.0 size=1048576 2024-09-12T00:34:20.814 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.816+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~16UF1Q0O7R5V.1 size=358062 2024-09-12T00:34:20.816 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.817+0000 7f1f2d864780 1 < completed multipart upload key=1299IOSGYIO9 upload=16UF1Q0O7R5V tag=304M7CAR8VSI type=write size=2455214 2024-09-12T00:34:20.818 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.819+0000 7f1f2d864780 1 > prepared part key=_multipart_PVB52GO6L8T4.2~T3KOEL3Q9MQ1.0 size=823907 2024-09-12T00:34:20.818 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.819+0000 7f1f2d864780 1 > prepared multipart upload key=PVB52GO6L8T4 upload=T3KOEL3Q9MQ1 tag=ZSQFZQ0R2B28 type=write size=1872483 2024-09-12T00:34:20.819 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.821+0000 7f1f2d864780 1 < completed delete operation key=UTR2UUO6DHLJ tag=8BJ8UV5LSJY1 type=del 2024-09-12T00:34:20.820 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.822+0000 7f1f2d864780 1 > prepared operation key=ZYNIJH0TTSM6 tag=7RSNYSZEO0TY type=del size=1452697 2024-09-12T00:34:20.821 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.823+0000 7f1f2d864780 1 < completed delete operation key=2YCGIJRK6MUH tag=RLXG7LL52Z0S type=del 2024-09-12T00:34:20.822 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.824+0000 7f1f2d864780 1 > prepared operation key=AN26EVAZI527 tag=YN1B6RLRYW8F type=del size=3800103 2024-09-12T00:34:20.823 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.825+0000 7f1f2d864780 1 < completed write operation key=2RV0899QUJ8W tag=4AIHQBNQ74JL type=write size=626226 2024-09-12T00:34:20.825 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.827+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~INW0V5UMAY8G.0 size=1048576 2024-09-12T00:34:20.826 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.828+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~INW0V5UMAY8G.1 size=1048576 2024-09-12T00:34:20.827 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.829+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~INW0V5UMAY8G.2 size=707382 2024-09-12T00:34:20.827 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.829+0000 7f1f2d864780 1 > prepared multipart upload key=WGKEA4EKF5GP upload=INW0V5UMAY8G tag=W0QX0SGV10M3 type=write size=3853110 2024-09-12T00:34:20.828 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.830+0000 7f1f2d864780 1 < completed delete operation key=1299IOSGYIO9 tag=R854QB9NCT10 type=del 2024-09-12T00:34:20.830 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.832+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~Q0PNW9KFQOJG.0 size=1048576 2024-09-12T00:34:20.831 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.833+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~Q0PNW9KFQOJG.1 size=1048576 2024-09-12T00:34:20.832 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.834+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~Q0PNW9KFQOJG.2 size=1032337 2024-09-12T00:34:20.832 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.834+0000 7f1f2d864780 1 > prepared multipart upload key=FAP6N3H7SBN0 upload=Q0PNW9KFQOJG tag=P1DCESW15CPO type=write size=4178065 2024-09-12T00:34:20.834 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.836+0000 7f1f2d864780 1 < suggested remove operation key=O1YY03BOEYLM tag=TFO95MB4MBAN type=del 2024-09-12T00:34:20.835 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.837+0000 7f1f2d864780 1 > prepared operation key=SNCGB6Z20450 tag=A99MOKE0YDAY type=del size=2246110 2024-09-12T00:34:20.836 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.838+0000 7f1f2d864780 -1 < failed to complete operation key=O1YY03BOEYLM tag=8RAH7J6X19Q5 type=del size=2496969: (22) Invalid argument 2024-09-12T00:34:20.838 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.840+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~V9U7IYV1H31K.0 size=1048576 2024-09-12T00:34:20.839 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.841+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~V9U7IYV1H31K.1 size=1048576 2024-09-12T00:34:20.841 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.842+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~V9U7IYV1H31K.2 size=747218 2024-09-12T00:34:20.841 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.842+0000 7f1f2d864780 1 > prepared multipart upload key=1299IOSGYIO9 upload=V9U7IYV1H31K tag=GSKIUXN66P94 type=write size=3892946 2024-09-12T00:34:20.842 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.843+0000 7f1f2d864780 1 < completed part key=_multipart_WKK747ETLW10.2~X5GQ6S31X798.0 size=1048576 2024-09-12T00:34:20.843 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.844+0000 7f1f2d864780 1 < completed part key=_multipart_WKK747ETLW10.2~X5GQ6S31X798.1 size=1048576 2024-09-12T00:34:20.844 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.845+0000 7f1f2d864780 1 < completed part key=_multipart_WKK747ETLW10.2~X5GQ6S31X798.2 size=981670 2024-09-12T00:34:20.846 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.848+0000 7f1f2d864780 1 < completed multipart upload key=WKK747ETLW10 upload=X5GQ6S31X798 tag=D2XTIFDLB9DH type=write size=4127398 2024-09-12T00:34:20.848 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.850+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~B8TZRP2EG3NQ.0 size=1048576 2024-09-12T00:34:20.850 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.851+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~B8TZRP2EG3NQ.1 size=194798 2024-09-12T00:34:20.850 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.851+0000 7f1f2d864780 1 > prepared multipart upload key=FAP6N3H7SBN0 upload=B8TZRP2EG3NQ tag=WCRG5U6ECGJ4 type=write size=2291950 2024-09-12T00:34:20.852 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.854+0000 7f1f2d864780 1 < suggested update operation key=2YCGIJRK6MUH tag=RN79ZR5S2RI5 type=del size=3312557 2024-09-12T00:34:20.854 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.856+0000 7f1f2d864780 1 > prepared part key=_multipart_2YCGIJRK6MUH.2~M4L11J0FQ4DL.0 size=1048576 2024-09-12T00:34:20.855 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.857+0000 7f1f2d864780 1 > prepared part key=_multipart_2YCGIJRK6MUH.2~M4L11J0FQ4DL.1 size=1048576 2024-09-12T00:34:20.856 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.858+0000 7f1f2d864780 1 > prepared part key=_multipart_2YCGIJRK6MUH.2~M4L11J0FQ4DL.2 size=86187 2024-09-12T00:34:20.856 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.858+0000 7f1f2d864780 1 > prepared multipart upload key=2YCGIJRK6MUH upload=M4L11J0FQ4DL tag=K9U057SPDDLZ type=write size=3231915 2024-09-12T00:34:20.857 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.859+0000 7f1f2d864780 1 < completed delete operation key=ZYNIJH0TTSM6 tag=1OHWPF2D94FM type=del 2024-09-12T00:34:20.859 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.860+0000 7f1f2d864780 1 > prepared operation key=O1YY03BOEYLM tag=AT8U7VBR8966 type=del size=2556173 2024-09-12T00:34:20.860 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.861+0000 7f1f2d864780 1 < completed write operation key=2RV0899QUJ8W tag=NDG88TG3ZYTF type=write size=809917 2024-09-12T00:34:20.861 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.863+0000 7f1f2d864780 1 > prepared operation key=UTR2UUO6DHLJ tag=JJ9V2WVRS50Y type=del size=42762 2024-09-12T00:34:20.862 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.864+0000 7f1f2d864780 -1 < failed to complete operation key=2YCGIJRK6MUH tag=JCXS1FCGMKQ6 type=del size=2085161: (22) Invalid argument 2024-09-12T00:34:20.863 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.865+0000 7f1f2d864780 1 > prepared operation key=4FRVL0KXN2X8 tag=BO668Z1C01EC type=write size=610643 2024-09-12T00:34:20.867 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.869+0000 7f1f2d864780 1 < suggested update operation key=WGKEA4EKF5GP tag=2GWQA7HFHAEM type=del size=3352560 2024-09-12T00:34:20.870 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.871+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~MV39N59WFMR8.0 size=853337 2024-09-12T00:34:20.870 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.871+0000 7f1f2d864780 1 > prepared multipart upload key=0DSQOFS8IIF5 upload=MV39N59WFMR8 tag=ZMFNVNK9FBRU type=write size=1901913 2024-09-12T00:34:20.872 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.874+0000 7f1f2d864780 1 < suggested remove operation key=3Z1TGGPZKJ69 tag=WNYN5M53INKJ type=del 2024-09-12T00:34:20.873 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.875+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=ZT2JGGPQ66U1 type=del size=3735270 2024-09-12T00:34:20.875 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.876+0000 7f1f2d864780 1 < completed part key=_multipart_W6U30X4HJCB1.2~R6CRC67NX23U.0 size=1048576 2024-09-12T00:34:20.876 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.878+0000 7f1f2d864780 1 < completed part key=_multipart_W6U30X4HJCB1.2~R6CRC67NX23U.1 size=671617 2024-09-12T00:34:20.878 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.879+0000 7f1f2d864780 1 < completed multipart upload key=W6U30X4HJCB1 upload=R6CRC67NX23U tag=XCAOPX2UJBL8 type=write size=2768769 2024-09-12T00:34:20.879 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.881+0000 7f1f2d864780 1 > prepared operation key=O1YY03BOEYLM tag=SF0NAH5S1BI1 type=write size=69955 2024-09-12T00:34:20.880 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.882+0000 7f1f2d864780 1 < completed delete operation key=0DSQOFS8IIF5 tag=OQC0QUTQG6MZ type=del 2024-09-12T00:34:20.883 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.884+0000 7f1f2d864780 1 > prepared part key=_multipart_53QCNWX1V1R1.2~2XO3JW8N2A40.0 size=1048576 2024-09-12T00:34:20.883 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.885+0000 7f1f2d864780 1 > prepared part key=_multipart_53QCNWX1V1R1.2~2XO3JW8N2A40.1 size=1037605 2024-09-12T00:34:20.883 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.885+0000 7f1f2d864780 1 > prepared multipart upload key=53QCNWX1V1R1 upload=2XO3JW8N2A40 tag=CY2QL2UCA0KU type=write size=3134757 2024-09-12T00:34:20.884 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.886+0000 7f1f2d864780 1 < completed part key=_multipart_PVB52GO6L8T4.2~T3KOEL3Q9MQ1.0 size=823907 2024-09-12T00:34:20.886 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.888+0000 7f1f2d864780 1 < completed multipart upload key=PVB52GO6L8T4 upload=T3KOEL3Q9MQ1 tag=ZSQFZQ0R2B28 type=write size=1872483 2024-09-12T00:34:20.889 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.891+0000 7f1f2d864780 1 > prepared operation key=0DSQOFS8IIF5 tag=H8APL2JFE16V type=del size=3042594 2024-09-12T00:34:20.891 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.893+0000 7f1f2d864780 1 < suggested update operation key=ZYNIJH0TTSM6 tag=7RSNYSZEO0TY type=del size=1452697 2024-09-12T00:34:20.893 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.894+0000 7f1f2d864780 1 > prepared operation key=S5DVMA14N7VJ tag=L8F810GVMN8X type=del size=3036634 2024-09-12T00:34:20.894 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.895+0000 7f1f2d864780 1 < completed delete operation key=AN26EVAZI527 tag=YN1B6RLRYW8F type=del 2024-09-12T00:34:20.895 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.897+0000 7f1f2d864780 1 > prepared operation key=N9RQIGHVL8VP tag=QZYU5Z368B4C type=del size=541658 2024-09-12T00:34:20.896 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.898+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~INW0V5UMAY8G.0 size=1048576 2024-09-12T00:34:20.897 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.899+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~INW0V5UMAY8G.1 size=1048576 2024-09-12T00:34:20.898 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.900+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~INW0V5UMAY8G.2 size=707382 2024-09-12T00:34:20.900 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.901+0000 7f1f2d864780 1 < completed multipart upload key=WGKEA4EKF5GP upload=INW0V5UMAY8G tag=W0QX0SGV10M3 type=write size=3853110 2024-09-12T00:34:20.902 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.903+0000 7f1f2d864780 1 > prepared part key=_multipart_3Z1TGGPZKJ69.2~5JOFQFG96616.0 size=47635 2024-09-12T00:34:20.902 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.903+0000 7f1f2d864780 1 > prepared multipart upload key=3Z1TGGPZKJ69 upload=5JOFQFG96616 tag=EUYQCW9DZ6D7 type=write size=1096211 2024-09-12T00:34:20.902 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.904+0000 7f1f2d864780 1 < canceled part key=_multipart_FAP6N3H7SBN0.2~Q0PNW9KFQOJG.0 size=1048576 2024-09-12T00:34:20.902 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.904+0000 7f1f2d864780 1 < canceled part key=_multipart_FAP6N3H7SBN0.2~Q0PNW9KFQOJG.1 size=1048576 2024-09-12T00:34:20.903 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.905+0000 7f1f2d864780 1 < completed part key=_multipart_FAP6N3H7SBN0.2~Q0PNW9KFQOJG.2 size=1032337 2024-09-12T00:34:20.905 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:20.907+0000 7f1f2d864780 1 < canceled multipart upload key=FAP6N3H7SBN0 upload=Q0PNW9KFQOJG tag=P1DCESW15CPO type=write size=4178065 2024-09-12T00:34:21.109 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.110+0000 7f1f2d864780 1 > prepared operation key=S5DVMA14N7VJ tag=0101HJ5WOKO0 type=del size=4066836 2024-09-12T00:34:21.110 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.111+0000 7f1f2d864780 1 < completed delete operation key=SNCGB6Z20450 tag=A99MOKE0YDAY type=del 2024-09-12T00:34:21.111 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.112+0000 7f1f2d864780 1 > prepared operation key=GSPM8N0K7ODC tag=E428LBA1R40E type=del size=3564048 2024-09-12T00:34:21.113 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.115+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~V9U7IYV1H31K.0 size=1048576 2024-09-12T00:34:21.114 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.116+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~V9U7IYV1H31K.1 size=1048576 2024-09-12T00:34:21.115 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.117+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~V9U7IYV1H31K.2 size=747218 2024-09-12T00:34:21.117 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.119+0000 7f1f2d864780 1 < completed multipart upload key=1299IOSGYIO9 upload=V9U7IYV1H31K tag=GSKIUXN66P94 type=write size=3892946 2024-09-12T00:34:21.118 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.120+0000 7f1f2d864780 1 > prepared operation key=D21W9QZWY0YU tag=9XZHM2AB9LEV type=del size=216375 2024-09-12T00:34:21.119 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.121+0000 7f1f2d864780 1 < completed part key=_multipart_FAP6N3H7SBN0.2~B8TZRP2EG3NQ.0 size=1048576 2024-09-12T00:34:21.120 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.122+0000 7f1f2d864780 1 < completed part key=_multipart_FAP6N3H7SBN0.2~B8TZRP2EG3NQ.1 size=194798 2024-09-12T00:34:21.122 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.124+0000 7f1f2d864780 1 < completed multipart upload key=FAP6N3H7SBN0 upload=B8TZRP2EG3NQ tag=WCRG5U6ECGJ4 type=write size=2291950 2024-09-12T00:34:21.123 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.125+0000 7f1f2d864780 1 > prepared operation key=2YCGIJRK6MUH tag=DZZDHGRW2BUM type=del size=3190689 2024-09-12T00:34:21.124 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.126+0000 7f1f2d864780 1 < completed part key=_multipart_2YCGIJRK6MUH.2~M4L11J0FQ4DL.0 size=1048576 2024-09-12T00:34:21.124 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.126+0000 7f1f2d864780 1 < canceled part key=_multipart_2YCGIJRK6MUH.2~M4L11J0FQ4DL.1 size=1048576 2024-09-12T00:34:21.125 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.127+0000 7f1f2d864780 1 < completed part key=_multipart_2YCGIJRK6MUH.2~M4L11J0FQ4DL.2 size=86187 2024-09-12T00:34:21.127 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.129+0000 7f1f2d864780 1 < canceled multipart upload key=2YCGIJRK6MUH upload=M4L11J0FQ4DL tag=K9U057SPDDLZ type=write size=3231915 2024-09-12T00:34:21.129 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.131+0000 7f1f2d864780 1 > prepared part key=_multipart_2G3UCYG4R4NM.2~HXQMY0BXRB5U.0 size=121699 2024-09-12T00:34:21.129 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.131+0000 7f1f2d864780 1 > prepared multipart upload key=2G3UCYG4R4NM upload=HXQMY0BXRB5U tag=RMXQ27IA2WCK type=write size=1170275 2024-09-12T00:34:21.131 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.133+0000 7f1f2d864780 1 < suggested remove operation key=O1YY03BOEYLM tag=AT8U7VBR8966 type=del 2024-09-12T00:34:21.133 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.134+0000 7f1f2d864780 1 > prepared operation key=N9RQIGHVL8VP tag=40CDZACRPU4N type=del size=698677 2024-09-12T00:34:21.135 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.137+0000 7f1f2d864780 1 < suggested remove operation key=UTR2UUO6DHLJ tag=JJ9V2WVRS50Y type=del 2024-09-12T00:34:21.136 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.138+0000 7f1f2d864780 1 > prepared operation key=O1YY03BOEYLM tag=AV0ANU711LO9 type=del size=1201378 2024-09-12T00:34:21.137 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.139+0000 7f1f2d864780 1 < completed write operation key=4FRVL0KXN2X8 tag=BO668Z1C01EC type=write size=610643 2024-09-12T00:34:21.138 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.140+0000 7f1f2d864780 1 > prepared operation key=W6U30X4HJCB1 tag=QV19X5MC511Q type=write size=734745 2024-09-12T00:34:21.139 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.141+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~MV39N59WFMR8.0 size=853337 2024-09-12T00:34:21.141 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.143+0000 7f1f2d864780 1 < completed multipart upload key=0DSQOFS8IIF5 upload=MV39N59WFMR8 tag=ZMFNVNK9FBRU type=write size=1901913 2024-09-12T00:34:21.142 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.144+0000 7f1f2d864780 1 > prepared operation key=2YCGIJRK6MUH tag=963NGC7BO947 type=del size=3920842 2024-09-12T00:34:21.143 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.145+0000 7f1f2d864780 1 < completed delete operation key=2RV0899QUJ8W tag=ZT2JGGPQ66U1 type=del 2024-09-12T00:34:21.145 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.147+0000 7f1f2d864780 1 > prepared part key=_multipart_UTR2UUO6DHLJ.2~FXJDH617TL5J.0 size=1048576 2024-09-12T00:34:21.146 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.148+0000 7f1f2d864780 1 > prepared part key=_multipart_UTR2UUO6DHLJ.2~FXJDH617TL5J.1 size=727648 2024-09-12T00:34:21.146 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.148+0000 7f1f2d864780 1 > prepared multipart upload key=UTR2UUO6DHLJ upload=FXJDH617TL5J tag=HQJATSRJNJU9 type=write size=2824800 2024-09-12T00:34:21.148 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.150+0000 7f1f2d864780 1 < suggested update operation key=O1YY03BOEYLM tag=SF0NAH5S1BI1 type=write size=69955 2024-09-12T00:34:21.150 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.152+0000 7f1f2d864780 1 > prepared part key=_multipart_FFG41OYEYFZA.2~TMMQRAKONZQ4.0 size=1048576 2024-09-12T00:34:21.151 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.153+0000 7f1f2d864780 1 > prepared part key=_multipart_FFG41OYEYFZA.2~TMMQRAKONZQ4.1 size=1048576 2024-09-12T00:34:21.152 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.154+0000 7f1f2d864780 1 > prepared part key=_multipart_FFG41OYEYFZA.2~TMMQRAKONZQ4.2 size=158420 2024-09-12T00:34:21.152 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.154+0000 7f1f2d864780 1 > prepared multipart upload key=FFG41OYEYFZA upload=TMMQRAKONZQ4 tag=JMW1QFWEOW4X type=write size=3304148 2024-09-12T00:34:21.153 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.155+0000 7f1f2d864780 1 < completed part key=_multipart_53QCNWX1V1R1.2~2XO3JW8N2A40.0 size=1048576 2024-09-12T00:34:21.154 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.156+0000 7f1f2d864780 1 < completed part key=_multipart_53QCNWX1V1R1.2~2XO3JW8N2A40.1 size=1037605 2024-09-12T00:34:21.156 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.158+0000 7f1f2d864780 1 < completed multipart upload key=53QCNWX1V1R1 upload=2XO3JW8N2A40 tag=CY2QL2UCA0KU type=write size=3134757 2024-09-12T00:34:21.157 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.159+0000 7f1f2d864780 1 > prepared operation key=OY145ZXRSF4L tag=L9EDYTFE3M99 type=del size=3523409 2024-09-12T00:34:21.158 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.160+0000 7f1f2d864780 1 < canceled operation key=0DSQOFS8IIF5 tag=H8APL2JFE16V type=del size=3042594 2024-09-12T00:34:21.160 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.161+0000 7f1f2d864780 1 > prepared operation key=ECZYQEZ942W8 tag=N1ZEBIYRA8QO type=write size=892799 2024-09-12T00:34:21.161 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.163+0000 7f1f2d864780 1 < completed delete operation key=S5DVMA14N7VJ tag=L8F810GVMN8X type=del 2024-09-12T00:34:21.163 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.165+0000 7f1f2d864780 1 > prepared part key=_multipart_KHPF1N1MT33Z.2~203SEL0ABOOQ.0 size=330851 2024-09-12T00:34:21.163 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.165+0000 7f1f2d864780 1 > prepared multipart upload key=KHPF1N1MT33Z upload=203SEL0ABOOQ tag=YGTBUK2NLBLQ type=write size=1379427 2024-09-12T00:34:21.164 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.166+0000 7f1f2d864780 1 < completed delete operation key=N9RQIGHVL8VP tag=QZYU5Z368B4C type=del 2024-09-12T00:34:21.165 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.167+0000 7f1f2d864780 1 > prepared operation key=S5DVMA14N7VJ tag=FC9GW1YGS12R type=del size=1037763 2024-09-12T00:34:21.166 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.168+0000 7f1f2d864780 1 < completed part key=_multipart_3Z1TGGPZKJ69.2~5JOFQFG96616.0 size=47635 2024-09-12T00:34:21.168 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.170+0000 7f1f2d864780 1 < completed multipart upload key=3Z1TGGPZKJ69 upload=5JOFQFG96616 tag=EUYQCW9DZ6D7 type=write size=1096211 2024-09-12T00:34:21.170 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.171+0000 7f1f2d864780 1 > prepared operation key=0DSQOFS8IIF5 tag=64E88S5JMDUK type=del size=2970422 2024-09-12T00:34:21.171 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.172+0000 7f1f2d864780 1 < completed delete operation key=S5DVMA14N7VJ tag=0101HJ5WOKO0 type=del 2024-09-12T00:34:21.172 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.174+0000 7f1f2d864780 1 > prepared operation key=ZGO887JDR627 tag=7PON1VLG4E8D type=del size=2084562 2024-09-12T00:34:21.173 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.175+0000 7f1f2d864780 1 < completed delete operation key=GSPM8N0K7ODC tag=E428LBA1R40E type=del 2024-09-12T00:34:21.175 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.177+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~JUVPO8QFP9Q9.0 size=1048576 2024-09-12T00:34:21.176 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.178+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~JUVPO8QFP9Q9.1 size=553332 2024-09-12T00:34:21.176 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.178+0000 7f1f2d864780 1 > prepared multipart upload key=D21W9QZWY0YU upload=JUVPO8QFP9Q9 tag=YDQAHQGEDS4B type=write size=2650484 2024-09-12T00:34:21.177 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.179+0000 7f1f2d864780 1 < canceled operation key=D21W9QZWY0YU tag=9XZHM2AB9LEV type=del size=216375 2024-09-12T00:34:21.178 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.180+0000 7f1f2d864780 1 > prepared operation key=FFG41OYEYFZA tag=KI63HMI3DR06 type=del size=687110 2024-09-12T00:34:21.180 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.181+0000 7f1f2d864780 1 < completed delete operation key=2YCGIJRK6MUH tag=DZZDHGRW2BUM type=del 2024-09-12T00:34:21.182 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.183+0000 7f1f2d864780 1 > prepared part key=_multipart_ZYNIJH0TTSM6.2~6LQ7XVGCSJJS.0 size=258071 2024-09-12T00:34:21.182 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.183+0000 7f1f2d864780 1 > prepared multipart upload key=ZYNIJH0TTSM6 upload=6LQ7XVGCSJJS tag=VFYX3YXXMSLT type=write size=1306647 2024-09-12T00:34:21.183 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.185+0000 7f1f2d864780 1 < completed part key=_multipart_2G3UCYG4R4NM.2~HXQMY0BXRB5U.0 size=121699 2024-09-12T00:34:21.185 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.186+0000 7f1f2d864780 1 < completed multipart upload key=2G3UCYG4R4NM upload=HXQMY0BXRB5U tag=RMXQ27IA2WCK type=write size=1170275 2024-09-12T00:34:21.187 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.189+0000 7f1f2d864780 1 > prepared part key=_multipart_AN26EVAZI527.2~S4YEIDTXA4OP.0 size=489183 2024-09-12T00:34:21.187 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.189+0000 7f1f2d864780 1 > prepared multipart upload key=AN26EVAZI527 upload=S4YEIDTXA4OP tag=975MDU8VB1AG type=write size=1537759 2024-09-12T00:34:21.188 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.190+0000 7f1f2d864780 1 < completed delete operation key=N9RQIGHVL8VP tag=40CDZACRPU4N type=del 2024-09-12T00:34:21.189 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.191+0000 7f1f2d864780 1 > prepared operation key=2YCGIJRK6MUH tag=B7IEP5WAIR74 type=del size=185339 2024-09-12T00:34:21.192 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.193+0000 7f1f2d864780 1 < suggested remove operation key=O1YY03BOEYLM tag=AV0ANU711LO9 type=del 2024-09-12T00:34:21.193 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.194+0000 7f1f2d864780 1 > prepared operation key=ZYNIJH0TTSM6 tag=E8LW7BZ1111S type=del size=11192 2024-09-12T00:34:21.194 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.195+0000 7f1f2d864780 1 < completed write operation key=W6U30X4HJCB1 tag=QV19X5MC511Q type=write size=734745 2024-09-12T00:34:21.196 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.198+0000 7f1f2d864780 1 > prepared part key=_multipart_S5DVMA14N7VJ.2~HNWAPFRN13BU.0 size=1048576 2024-09-12T00:34:21.197 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.198+0000 7f1f2d864780 1 > prepared part key=_multipart_S5DVMA14N7VJ.2~HNWAPFRN13BU.1 size=361296 2024-09-12T00:34:21.197 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.198+0000 7f1f2d864780 1 > prepared multipart upload key=S5DVMA14N7VJ upload=HNWAPFRN13BU tag=DEVVGGOQOKQX type=write size=2458448 2024-09-12T00:34:21.198 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.200+0000 7f1f2d864780 1 < canceled operation key=2YCGIJRK6MUH tag=963NGC7BO947 type=del size=3920842 2024-09-12T00:34:21.200 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.202+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~0UG0OU15HFV9.0 size=190659 2024-09-12T00:34:21.200 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.202+0000 7f1f2d864780 1 > prepared multipart upload key=FAP6N3H7SBN0 upload=0UG0OU15HFV9 tag=NT7O7OKMRBN4 type=write size=1239235 2024-09-12T00:34:21.201 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.202+0000 7f1f2d864780 1 < canceled part key=_multipart_UTR2UUO6DHLJ.2~FXJDH617TL5J.0 size=1048576 2024-09-12T00:34:21.201 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.203+0000 7f1f2d864780 1 < completed part key=_multipart_UTR2UUO6DHLJ.2~FXJDH617TL5J.1 size=727648 2024-09-12T00:34:21.203 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.205+0000 7f1f2d864780 1 < canceled multipart upload key=UTR2UUO6DHLJ upload=FXJDH617TL5J tag=HQJATSRJNJU9 type=write size=2824800 2024-09-12T00:34:21.204 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.206+0000 7f1f2d864780 1 > prepared operation key=2G3UCYG4R4NM tag=WKPA7Y3AOFBZ type=del size=1841141 2024-09-12T00:34:21.205 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.207+0000 7f1f2d864780 1 < completed part key=_multipart_FFG41OYEYFZA.2~TMMQRAKONZQ4.0 size=1048576 2024-09-12T00:34:21.206 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.208+0000 7f1f2d864780 1 < completed part key=_multipart_FFG41OYEYFZA.2~TMMQRAKONZQ4.1 size=1048576 2024-09-12T00:34:21.207 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.209+0000 7f1f2d864780 1 < completed part key=_multipart_FFG41OYEYFZA.2~TMMQRAKONZQ4.2 size=158420 2024-09-12T00:34:21.210 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.211+0000 7f1f2d864780 1 < completed multipart upload key=FFG41OYEYFZA upload=TMMQRAKONZQ4 tag=JMW1QFWEOW4X type=write size=3304148 2024-09-12T00:34:21.211 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.212+0000 7f1f2d864780 1 > prepared operation key=ZYNIJH0TTSM6 tag=C5Y28E7CCHFV type=write size=451546 2024-09-12T00:34:21.212 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.213+0000 7f1f2d864780 1 < completed delete operation key=OY145ZXRSF4L tag=L9EDYTFE3M99 type=del 2024-09-12T00:34:21.213 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.214+0000 7f1f2d864780 1 > prepared operation key=WGKEA4EKF5GP tag=VXMLSQ82BO6S type=del size=3143505 2024-09-12T00:34:21.215 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.216+0000 7f1f2d864780 1 < completed write operation key=ECZYQEZ942W8 tag=N1ZEBIYRA8QO type=write size=892799 2024-09-12T00:34:21.215 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.217+0000 7f1f2d864780 1 > prepared operation key=DYKLAY6J018G tag=690V5ML4N3MV type=del size=1937437 2024-09-12T00:34:21.216 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.218+0000 7f1f2d864780 1 < completed part key=_multipart_KHPF1N1MT33Z.2~203SEL0ABOOQ.0 size=330851 2024-09-12T00:34:21.221 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.220+0000 7f1f2d864780 1 < completed multipart upload key=KHPF1N1MT33Z upload=203SEL0ABOOQ tag=YGTBUK2NLBLQ type=write size=1379427 2024-09-12T00:34:21.221 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.222+0000 7f1f2d864780 1 > prepared operation key=ZGO887JDR627 tag=LFV0U3WWFXYM type=del size=578477 2024-09-12T00:34:21.222 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.223+0000 7f1f2d864780 1 < completed delete operation key=S5DVMA14N7VJ tag=FC9GW1YGS12R type=del 2024-09-12T00:34:21.223 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.224+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=B4Y8P0L8F8CL type=write size=983976 2024-09-12T00:34:21.225 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.226+0000 7f1f2d864780 1 < suggested update operation key=0DSQOFS8IIF5 tag=64E88S5JMDUK type=del size=2970422 2024-09-12T00:34:21.226 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.228+0000 7f1f2d864780 1 > prepared operation key=ECZYQEZ942W8 tag=5RMEWMI5GMRB type=del size=2259497 2024-09-12T00:34:21.227 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.229+0000 7f1f2d864780 1 < completed delete operation key=ZGO887JDR627 tag=7PON1VLG4E8D type=del 2024-09-12T00:34:21.229 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.231+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~03KF8RD8GSAB.0 size=458353 2024-09-12T00:34:21.229 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.231+0000 7f1f2d864780 1 > prepared multipart upload key=WGKEA4EKF5GP upload=03KF8RD8GSAB tag=RMDK1Q9LS7KK type=write size=1506929 2024-09-12T00:34:21.230 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.232+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~JUVPO8QFP9Q9.0 size=1048576 2024-09-12T00:34:21.231 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.233+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~JUVPO8QFP9Q9.1 size=553332 2024-09-12T00:34:21.233 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.234+0000 7f1f2d864780 1 < completed multipart upload key=D21W9QZWY0YU upload=JUVPO8QFP9Q9 tag=YDQAHQGEDS4B type=write size=2650484 2024-09-12T00:34:21.235 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.236+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~8ZW8LIXTBGRN.0 size=295585 2024-09-12T00:34:21.235 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.236+0000 7f1f2d864780 1 > prepared multipart upload key=SZP418NVZ5VX upload=8ZW8LIXTBGRN tag=R0E03ER6A7J8 type=write size=1344161 2024-09-12T00:34:21.236 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.238+0000 7f1f2d864780 1 < completed delete operation key=FFG41OYEYFZA tag=KI63HMI3DR06 type=del 2024-09-12T00:34:21.237 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.239+0000 7f1f2d864780 1 > prepared operation key=W6U30X4HJCB1 tag=TC44P6PMUFIP type=del size=3201605 2024-09-12T00:34:21.237 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.239+0000 7f1f2d864780 1 < canceled part key=_multipart_ZYNIJH0TTSM6.2~6LQ7XVGCSJJS.0 size=258071 2024-09-12T00:34:21.239 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.241+0000 7f1f2d864780 1 < canceled multipart upload key=ZYNIJH0TTSM6 upload=6LQ7XVGCSJJS tag=VFYX3YXXMSLT type=write size=1306647 2024-09-12T00:34:21.241 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.243+0000 7f1f2d864780 1 > prepared part key=_multipart_SNCGB6Z20450.2~YUYJ5CLJRNEL.0 size=1048576 2024-09-12T00:34:21.242 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.244+0000 7f1f2d864780 1 > prepared part key=_multipart_SNCGB6Z20450.2~YUYJ5CLJRNEL.1 size=186016 2024-09-12T00:34:21.242 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.244+0000 7f1f2d864780 1 > prepared multipart upload key=SNCGB6Z20450 upload=YUYJ5CLJRNEL tag=EG78FKZE6P61 type=write size=2283168 2024-09-12T00:34:21.242 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.244+0000 7f1f2d864780 1 < canceled part key=_multipart_AN26EVAZI527.2~S4YEIDTXA4OP.0 size=489183 2024-09-12T00:34:21.244 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.246+0000 7f1f2d864780 1 < canceled multipart upload key=AN26EVAZI527 upload=S4YEIDTXA4OP tag=975MDU8VB1AG type=write size=1537759 2024-09-12T00:34:21.245 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.247+0000 7f1f2d864780 1 > prepared operation key=ZGO887JDR627 tag=PJZTWTHI2AGU type=del size=2943143 2024-09-12T00:34:21.246 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.248+0000 7f1f2d864780 1 < completed delete operation key=2YCGIJRK6MUH tag=B7IEP5WAIR74 type=del 2024-09-12T00:34:21.249 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.251+0000 7f1f2d864780 1 > prepared part key=_multipart_ZGO887JDR627.2~RKLFRCGWOMUW.0 size=1048576 2024-09-12T00:34:21.250 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.251+0000 7f1f2d864780 1 > prepared part key=_multipart_ZGO887JDR627.2~RKLFRCGWOMUW.1 size=1048576 2024-09-12T00:34:21.251 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.252+0000 7f1f2d864780 1 > prepared part key=_multipart_ZGO887JDR627.2~RKLFRCGWOMUW.2 size=288349 2024-09-12T00:34:21.251 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.252+0000 7f1f2d864780 1 > prepared multipart upload key=ZGO887JDR627 upload=RKLFRCGWOMUW tag=6Z1J5W73P2MM type=write size=3434077 2024-09-12T00:34:21.254 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.255+0000 7f1f2d864780 1 < completed delete operation key=ZYNIJH0TTSM6 tag=E8LW7BZ1111S type=del 2024-09-12T00:34:21.256 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.257+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~PXI31BGONMOO.0 size=1048576 2024-09-12T00:34:21.256 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.258+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~PXI31BGONMOO.1 size=1048576 2024-09-12T00:34:21.257 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.259+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~PXI31BGONMOO.2 size=696926 2024-09-12T00:34:21.257 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.259+0000 7f1f2d864780 1 > prepared multipart upload key=FAP6N3H7SBN0 upload=PXI31BGONMOO tag=85MISATW2HLB type=write size=3842654 2024-09-12T00:34:21.259 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.260+0000 7f1f2d864780 1 < completed part key=_multipart_S5DVMA14N7VJ.2~HNWAPFRN13BU.0 size=1048576 2024-09-12T00:34:21.260 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.261+0000 7f1f2d864780 1 < completed part key=_multipart_S5DVMA14N7VJ.2~HNWAPFRN13BU.1 size=361296 2024-09-12T00:34:21.262 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.264+0000 7f1f2d864780 1 < completed multipart upload key=S5DVMA14N7VJ upload=HNWAPFRN13BU tag=DEVVGGOQOKQX type=write size=2458448 2024-09-12T00:34:21.263 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.265+0000 7f1f2d864780 1 > prepared operation key=S5DVMA14N7VJ tag=PYLL9IFQTCMO type=del size=1424905 2024-09-12T00:34:21.264 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.266+0000 7f1f2d864780 1 < completed part key=_multipart_FAP6N3H7SBN0.2~0UG0OU15HFV9.0 size=190659 2024-09-12T00:34:21.266 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.268+0000 7f1f2d864780 1 < completed multipart upload key=FAP6N3H7SBN0 upload=0UG0OU15HFV9 tag=NT7O7OKMRBN4 type=write size=1239235 2024-09-12T00:34:21.269 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.270+0000 7f1f2d864780 1 > prepared part key=_multipart_O1YY03BOEYLM.2~TYU1107KZ3MM.0 size=1048576 2024-09-12T00:34:21.270 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.271+0000 7f1f2d864780 1 > prepared part key=_multipart_O1YY03BOEYLM.2~TYU1107KZ3MM.1 size=1041327 2024-09-12T00:34:21.270 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.271+0000 7f1f2d864780 1 > prepared multipart upload key=O1YY03BOEYLM upload=TYU1107KZ3MM tag=T5CH70IVSAT9 type=write size=3138479 2024-09-12T00:34:21.271 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.273+0000 7f1f2d864780 1 < completed delete operation key=2G3UCYG4R4NM tag=WKPA7Y3AOFBZ type=del 2024-09-12T00:34:21.273 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.275+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~6XWIIAK24UXJ.0 size=512304 2024-09-12T00:34:21.273 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.275+0000 7f1f2d864780 1 > prepared multipart upload key=4FRVL0KXN2X8 upload=6XWIIAK24UXJ tag=DJ6YB4OGGEZ7 type=write size=1560880 2024-09-12T00:34:21.274 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.276+0000 7f1f2d864780 1 < completed write operation key=ZYNIJH0TTSM6 tag=C5Y28E7CCHFV type=write size=451546 2024-09-12T00:34:21.275 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.277+0000 7f1f2d864780 1 > prepared operation key=FAP6N3H7SBN0 tag=K02L92ZG0X13 type=del size=3256167 2024-09-12T00:34:21.277 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.278+0000 7f1f2d864780 1 < completed delete operation key=WGKEA4EKF5GP tag=VXMLSQ82BO6S type=del 2024-09-12T00:34:21.279 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.280+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~FCU7K21L7DEC.0 size=1048576 2024-09-12T00:34:21.280 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.282+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~FCU7K21L7DEC.1 size=905892 2024-09-12T00:34:21.280 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.282+0000 7f1f2d864780 1 > prepared multipart upload key=D21W9QZWY0YU upload=FCU7K21L7DEC tag=ECHQW5W8FH4S type=write size=3003044 2024-09-12T00:34:21.281 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.283+0000 7f1f2d864780 1 < completed delete operation key=DYKLAY6J018G tag=690V5ML4N3MV type=del 2024-09-12T00:34:21.284 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.285+0000 7f1f2d864780 1 > prepared part key=_multipart_2YCGIJRK6MUH.2~LL2UFCGX5JQZ.0 size=874333 2024-09-12T00:34:21.284 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.285+0000 7f1f2d864780 1 > prepared multipart upload key=2YCGIJRK6MUH upload=LL2UFCGX5JQZ tag=JEVNZDT5K53D type=write size=1922909 2024-09-12T00:34:21.286 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.288+0000 7f1f2d864780 1 < suggested remove operation key=ZGO887JDR627 tag=LFV0U3WWFXYM type=del 2024-09-12T00:34:21.288 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.290+0000 7f1f2d864780 1 > prepared part key=_multipart_OY145ZXRSF4L.2~JW31QN7EWOR0.0 size=612210 2024-09-12T00:34:21.288 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.290+0000 7f1f2d864780 1 > prepared multipart upload key=OY145ZXRSF4L upload=JW31QN7EWOR0 tag=9X6HZPWVCTNA type=write size=1660786 2024-09-12T00:34:21.289 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.291+0000 7f1f2d864780 1 < completed write operation key=2RV0899QUJ8W tag=B4Y8P0L8F8CL type=write size=983976 2024-09-12T00:34:21.291 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.292+0000 7f1f2d864780 1 > prepared operation key=2YCGIJRK6MUH tag=3U7PITO1U81I type=del size=3095592 2024-09-12T00:34:21.293 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.295+0000 7f1f2d864780 1 < suggested update operation key=ECZYQEZ942W8 tag=5RMEWMI5GMRB type=del size=2259497 2024-09-12T00:34:21.294 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.296+0000 7f1f2d864780 1 > prepared operation key=O1YY03BOEYLM tag=9Q5WETL0OEML type=del size=3702305 2024-09-12T00:34:21.295 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.297+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~03KF8RD8GSAB.0 size=458353 2024-09-12T00:34:21.297 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.299+0000 7f1f2d864780 1 < completed multipart upload key=WGKEA4EKF5GP upload=03KF8RD8GSAB tag=RMDK1Q9LS7KK type=write size=1506929 2024-09-12T00:34:21.300 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.301+0000 7f1f2d864780 1 > prepared part key=_multipart_OY145ZXRSF4L.2~VK3FVT8R7FU8.0 size=1021948 2024-09-12T00:34:21.300 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.301+0000 7f1f2d864780 1 > prepared multipart upload key=OY145ZXRSF4L upload=VK3FVT8R7FU8 tag=AHJOE5CGBVC5 type=write size=2070524 2024-09-12T00:34:21.301 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.302+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~8ZW8LIXTBGRN.0 size=295585 2024-09-12T00:34:21.303 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.305+0000 7f1f2d864780 1 < completed multipart upload key=SZP418NVZ5VX upload=8ZW8LIXTBGRN tag=R0E03ER6A7J8 type=write size=1344161 2024-09-12T00:34:21.305 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.307+0000 7f1f2d864780 1 > prepared part key=_multipart_ZYNIJH0TTSM6.2~FYT220SJUZ0B.0 size=1048576 2024-09-12T00:34:21.306 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.308+0000 7f1f2d864780 1 > prepared part key=_multipart_ZYNIJH0TTSM6.2~FYT220SJUZ0B.1 size=1048576 2024-09-12T00:34:21.307 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.309+0000 7f1f2d864780 1 > prepared part key=_multipart_ZYNIJH0TTSM6.2~FYT220SJUZ0B.2 size=1029215 2024-09-12T00:34:21.307 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.309+0000 7f1f2d864780 1 > prepared multipart upload key=ZYNIJH0TTSM6 upload=FYT220SJUZ0B tag=AYJLOF22KW2K type=write size=4174943 2024-09-12T00:34:21.308 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.310+0000 7f1f2d864780 1 < completed delete operation key=W6U30X4HJCB1 tag=TC44P6PMUFIP type=del 2024-09-12T00:34:21.310 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.312+0000 7f1f2d864780 1 > prepared part key=_multipart_2YCGIJRK6MUH.2~2IUCJFGRLJYK.0 size=1048576 2024-09-12T00:34:21.311 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.313+0000 7f1f2d864780 1 > prepared part key=_multipart_2YCGIJRK6MUH.2~2IUCJFGRLJYK.1 size=535039 2024-09-12T00:34:21.311 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.313+0000 7f1f2d864780 1 > prepared multipart upload key=2YCGIJRK6MUH upload=2IUCJFGRLJYK tag=PE2DZREZLY7E type=write size=2632191 2024-09-12T00:34:21.312 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.314+0000 7f1f2d864780 1 < completed part key=_multipart_SNCGB6Z20450.2~YUYJ5CLJRNEL.0 size=1048576 2024-09-12T00:34:21.313 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.315+0000 7f1f2d864780 1 < completed part key=_multipart_SNCGB6Z20450.2~YUYJ5CLJRNEL.1 size=186016 2024-09-12T00:34:21.315 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.317+0000 7f1f2d864780 1 < completed multipart upload key=SNCGB6Z20450 upload=YUYJ5CLJRNEL tag=EG78FKZE6P61 type=write size=2283168 2024-09-12T00:34:21.317 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.318+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~TQ1F16U1AQY0.0 size=1048576 2024-09-12T00:34:21.318 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.319+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~TQ1F16U1AQY0.1 size=515107 2024-09-12T00:34:21.318 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.319+0000 7f1f2d864780 1 > prepared multipart upload key=FAP6N3H7SBN0 upload=TQ1F16U1AQY0 tag=S34AC650GG71 type=write size=2612259 2024-09-12T00:34:21.318 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.320+0000 7f1f2d864780 -1 < no bi entry to suggest for operation key=ZGO887JDR627 tag=PJZTWTHI2AGU type=del size=2943143: (2) No such file or directory 2024-09-12T00:34:21.321 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.322+0000 7f1f2d864780 1 > prepared part key=_multipart_KHPF1N1MT33Z.2~R1I02TCE6R52.0 size=29030 2024-09-12T00:34:21.321 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.322+0000 7f1f2d864780 1 > prepared multipart upload key=KHPF1N1MT33Z upload=R1I02TCE6R52 tag=PHOUUF7PD3TI type=write size=1077606 2024-09-12T00:34:21.322 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.323+0000 7f1f2d864780 1 < completed part key=_multipart_ZGO887JDR627.2~RKLFRCGWOMUW.0 size=1048576 2024-09-12T00:34:21.323 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.324+0000 7f1f2d864780 1 < completed part key=_multipart_ZGO887JDR627.2~RKLFRCGWOMUW.1 size=1048576 2024-09-12T00:34:21.324 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.325+0000 7f1f2d864780 1 < completed part key=_multipart_ZGO887JDR627.2~RKLFRCGWOMUW.2 size=288349 2024-09-12T00:34:21.326 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.327+0000 7f1f2d864780 1 < completed multipart upload key=ZGO887JDR627 upload=RKLFRCGWOMUW tag=6Z1J5W73P2MM type=write size=3434077 2024-09-12T00:34:21.328 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.330+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~S8L26QPTA0Q5.0 size=1048576 2024-09-12T00:34:21.329 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.331+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~S8L26QPTA0Q5.1 size=1048576 2024-09-12T00:34:21.331 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.332+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~S8L26QPTA0Q5.2 size=122663 2024-09-12T00:34:21.331 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.332+0000 7f1f2d864780 1 > prepared multipart upload key=FAP6N3H7SBN0 upload=S8L26QPTA0Q5 tag=53GS6CYYPVKX type=write size=3268391 2024-09-12T00:34:21.333 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.335+0000 7f1f2d864780 1 < completed part key=_multipart_FAP6N3H7SBN0.2~PXI31BGONMOO.0 size=1048576 2024-09-12T00:34:21.336 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.338+0000 7f1f2d864780 1 < completed part key=_multipart_FAP6N3H7SBN0.2~PXI31BGONMOO.1 size=1048576 2024-09-12T00:34:21.337 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.339+0000 7f1f2d864780 1 < completed part key=_multipart_FAP6N3H7SBN0.2~PXI31BGONMOO.2 size=696926 2024-09-12T00:34:21.339 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.341+0000 7f1f2d864780 1 < completed multipart upload key=FAP6N3H7SBN0 upload=PXI31BGONMOO tag=85MISATW2HLB type=write size=3842654 2024-09-12T00:34:21.340 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.342+0000 7f1f2d864780 1 > prepared operation key=2G3UCYG4R4NM tag=APPT1ZQ3FYCJ type=del size=3244582 2024-09-12T00:34:21.341 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.343+0000 7f1f2d864780 1 < completed delete operation key=S5DVMA14N7VJ tag=PYLL9IFQTCMO type=del 2024-09-12T00:34:21.343 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.345+0000 7f1f2d864780 1 > prepared part key=_multipart_2RV0899QUJ8W.2~OXR54FIVI6JP.0 size=1048576 2024-09-12T00:34:21.344 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.346+0000 7f1f2d864780 1 > prepared part key=_multipart_2RV0899QUJ8W.2~OXR54FIVI6JP.1 size=779728 2024-09-12T00:34:21.344 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.346+0000 7f1f2d864780 1 > prepared multipart upload key=2RV0899QUJ8W upload=OXR54FIVI6JP tag=UE1I2S7VTZSQ type=write size=2876880 2024-09-12T00:34:21.346 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.347+0000 7f1f2d864780 1 < completed part key=_multipart_O1YY03BOEYLM.2~TYU1107KZ3MM.0 size=1048576 2024-09-12T00:34:21.346 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.348+0000 7f1f2d864780 1 < completed part key=_multipart_O1YY03BOEYLM.2~TYU1107KZ3MM.1 size=1041327 2024-09-12T00:34:21.348 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.350+0000 7f1f2d864780 1 < completed multipart upload key=O1YY03BOEYLM upload=TYU1107KZ3MM tag=T5CH70IVSAT9 type=write size=3138479 2024-09-12T00:34:21.349 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.351+0000 7f1f2d864780 1 > prepared operation key=4FRVL0KXN2X8 tag=726D4L82VW4O type=del size=3789320 2024-09-12T00:34:21.351 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.353+0000 7f1f2d864780 1 < completed part key=_multipart_4FRVL0KXN2X8.2~6XWIIAK24UXJ.0 size=512304 2024-09-12T00:34:21.353 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.355+0000 7f1f2d864780 1 < completed multipart upload key=4FRVL0KXN2X8 upload=6XWIIAK24UXJ tag=DJ6YB4OGGEZ7 type=write size=1560880 2024-09-12T00:34:21.356 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.357+0000 7f1f2d864780 1 > prepared operation key=MSGU3PHLBRJH tag=64MKYI9NQB8T type=write size=149182 2024-09-12T00:34:21.357 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.359+0000 7f1f2d864780 1 < completed delete operation key=FAP6N3H7SBN0 tag=K02L92ZG0X13 type=del 2024-09-12T00:34:21.358 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.360+0000 7f1f2d864780 1 > prepared operation key=ECZYQEZ942W8 tag=Z7A2NER0UI6M type=del size=1133920 2024-09-12T00:34:21.359 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.361+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~FCU7K21L7DEC.0 size=1048576 2024-09-12T00:34:21.360 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.362+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~FCU7K21L7DEC.1 size=905892 2024-09-12T00:34:21.362 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.364+0000 7f1f2d864780 1 < completed multipart upload key=D21W9QZWY0YU upload=FCU7K21L7DEC tag=ECHQW5W8FH4S type=write size=3003044 2024-09-12T00:34:21.364 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.366+0000 7f1f2d864780 1 > prepared part key=_multipart_AN26EVAZI527.2~5AU2UCFQFUTV.0 size=928078 2024-09-12T00:34:21.365 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.366+0000 7f1f2d864780 1 > prepared multipart upload key=AN26EVAZI527 upload=5AU2UCFQFUTV tag=VJJNO8SD2F45 type=write size=1976654 2024-09-12T00:34:21.365 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.367+0000 7f1f2d864780 1 < completed part key=_multipart_2YCGIJRK6MUH.2~LL2UFCGX5JQZ.0 size=874333 2024-09-12T00:34:21.367 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.369+0000 7f1f2d864780 1 < completed multipart upload key=2YCGIJRK6MUH upload=LL2UFCGX5JQZ tag=JEVNZDT5K53D type=write size=1922909 2024-09-12T00:34:21.369 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.370+0000 7f1f2d864780 1 > prepared operation key=2YCGIJRK6MUH tag=YKBLH312RRYP type=del size=1835630 2024-09-12T00:34:21.370 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.371+0000 7f1f2d864780 1 < completed part key=_multipart_OY145ZXRSF4L.2~JW31QN7EWOR0.0 size=612210 2024-09-12T00:34:21.372 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.373+0000 7f1f2d864780 1 < completed multipart upload key=OY145ZXRSF4L upload=JW31QN7EWOR0 tag=9X6HZPWVCTNA type=write size=1660786 2024-09-12T00:34:21.374 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.375+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~OO44A4Y0Q597.0 size=1048576 2024-09-12T00:34:21.374 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.376+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~OO44A4Y0Q597.1 size=1048576 2024-09-12T00:34:21.375 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.377+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~OO44A4Y0Q597.2 size=521445 2024-09-12T00:34:21.375 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.377+0000 7f1f2d864780 1 > prepared multipart upload key=WGKEA4EKF5GP upload=OO44A4Y0Q597 tag=KR0WGB2THADG type=write size=3667173 2024-09-12T00:34:21.377 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.378+0000 7f1f2d864780 1 < canceled operation key=2YCGIJRK6MUH tag=3U7PITO1U81I type=del size=3095592 2024-09-12T00:34:21.378 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.380+0000 7f1f2d864780 1 > prepared operation key=ZGO887JDR627 tag=OJM8VLZY4XVD type=del size=438630 2024-09-12T00:34:21.380 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.382+0000 7f1f2d864780 1 < suggested remove operation key=O1YY03BOEYLM tag=9Q5WETL0OEML type=del 2024-09-12T00:34:21.382 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.383+0000 7f1f2d864780 1 > prepared operation key=KHPF1N1MT33Z tag=7QW0283SHRK0 type=del size=1661607 2024-09-12T00:34:21.383 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.385+0000 7f1f2d864780 1 < completed part key=_multipart_OY145ZXRSF4L.2~VK3FVT8R7FU8.0 size=1021948 2024-09-12T00:34:21.385 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.387+0000 7f1f2d864780 1 < completed multipart upload key=OY145ZXRSF4L upload=VK3FVT8R7FU8 tag=AHJOE5CGBVC5 type=write size=2070524 2024-09-12T00:34:21.386 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.388+0000 7f1f2d864780 1 > prepared operation key=WKK747ETLW10 tag=ZL6VV1XZ3IJ1 type=del size=2032150 2024-09-12T00:34:21.387 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.389+0000 7f1f2d864780 1 < completed part key=_multipart_ZYNIJH0TTSM6.2~FYT220SJUZ0B.0 size=1048576 2024-09-12T00:34:21.388 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.390+0000 7f1f2d864780 1 < completed part key=_multipart_ZYNIJH0TTSM6.2~FYT220SJUZ0B.1 size=1048576 2024-09-12T00:34:21.389 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.391+0000 7f1f2d864780 1 < completed part key=_multipart_ZYNIJH0TTSM6.2~FYT220SJUZ0B.2 size=1029215 2024-09-12T00:34:21.391 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.393+0000 7f1f2d864780 1 < completed multipart upload key=ZYNIJH0TTSM6 upload=FYT220SJUZ0B tag=AYJLOF22KW2K type=write size=4174943 2024-09-12T00:34:21.394 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.395+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~318MFKCGZN1W.0 size=1048576 2024-09-12T00:34:21.395 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.396+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~318MFKCGZN1W.1 size=1048576 2024-09-12T00:34:21.396 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.397+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~318MFKCGZN1W.2 size=913906 2024-09-12T00:34:21.396 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.397+0000 7f1f2d864780 1 > prepared multipart upload key=4FRVL0KXN2X8 upload=318MFKCGZN1W tag=DZOFE4US4NMI type=write size=4059634 2024-09-12T00:34:21.397 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.399+0000 7f1f2d864780 1 < completed part key=_multipart_2YCGIJRK6MUH.2~2IUCJFGRLJYK.0 size=1048576 2024-09-12T00:34:21.398 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.399+0000 7f1f2d864780 1 < completed part key=_multipart_2YCGIJRK6MUH.2~2IUCJFGRLJYK.1 size=535039 2024-09-12T00:34:21.400 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.401+0000 7f1f2d864780 1 < completed multipart upload key=2YCGIJRK6MUH upload=2IUCJFGRLJYK tag=PE2DZREZLY7E type=write size=2632191 2024-09-12T00:34:21.402 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.404+0000 7f1f2d864780 1 > prepared part key=_multipart_WIIU8VTCLWOD.2~L3SNRYYHGDVD.0 size=226156 2024-09-12T00:34:21.402 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.404+0000 7f1f2d864780 1 > prepared multipart upload key=WIIU8VTCLWOD upload=L3SNRYYHGDVD tag=2XZW9NJV7GHK type=write size=1274732 2024-09-12T00:34:21.402 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.404+0000 7f1f2d864780 1 < canceled part key=_multipart_FAP6N3H7SBN0.2~TQ1F16U1AQY0.0 size=1048576 2024-09-12T00:34:21.403 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.405+0000 7f1f2d864780 1 < completed part key=_multipart_FAP6N3H7SBN0.2~TQ1F16U1AQY0.1 size=515107 2024-09-12T00:34:21.405 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.407+0000 7f1f2d864780 1 < canceled multipart upload key=FAP6N3H7SBN0 upload=TQ1F16U1AQY0 tag=S34AC650GG71 type=write size=2612259 2024-09-12T00:34:21.407 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.409+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~FYQHXJLBWAE6.0 size=1048576 2024-09-12T00:34:21.408 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.410+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~FYQHXJLBWAE6.1 size=1048576 2024-09-12T00:34:21.409 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.410+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~FYQHXJLBWAE6.2 size=314859 2024-09-12T00:34:21.409 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.410+0000 7f1f2d864780 1 > prepared multipart upload key=FAP6N3H7SBN0 upload=FYQHXJLBWAE6 tag=35SGKU06TSJB type=write size=3460587 2024-09-12T00:34:21.410 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.412+0000 7f1f2d864780 1 < completed part key=_multipart_KHPF1N1MT33Z.2~R1I02TCE6R52.0 size=29030 2024-09-12T00:34:21.412 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.413+0000 7f1f2d864780 1 < completed multipart upload key=KHPF1N1MT33Z upload=R1I02TCE6R52 tag=PHOUUF7PD3TI type=write size=1077606 2024-09-12T00:34:21.413 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.414+0000 7f1f2d864780 1 > prepared operation key=2YCGIJRK6MUH tag=KTT3RKXLP6YU type=write size=793612 2024-09-12T00:34:21.414 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.416+0000 7f1f2d864780 1 < completed part key=_multipart_FAP6N3H7SBN0.2~S8L26QPTA0Q5.0 size=1048576 2024-09-12T00:34:21.415 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.416+0000 7f1f2d864780 1 < completed part key=_multipart_FAP6N3H7SBN0.2~S8L26QPTA0Q5.1 size=1048576 2024-09-12T00:34:21.416 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.417+0000 7f1f2d864780 1 < completed part key=_multipart_FAP6N3H7SBN0.2~S8L26QPTA0Q5.2 size=122663 2024-09-12T00:34:21.418 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.419+0000 7f1f2d864780 1 < completed multipart upload key=FAP6N3H7SBN0 upload=S8L26QPTA0Q5 tag=53GS6CYYPVKX type=write size=3268391 2024-09-12T00:34:21.419 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.420+0000 7f1f2d864780 1 > prepared operation key=0DSQOFS8IIF5 tag=80688YW94OX0 type=del size=2217175 2024-09-12T00:34:21.420 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.422+0000 7f1f2d864780 1 < canceled operation key=2G3UCYG4R4NM tag=APPT1ZQ3FYCJ type=del size=3244582 2024-09-12T00:34:21.421 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.423+0000 7f1f2d864780 1 > prepared operation key=GSPM8N0K7ODC tag=7NY3Z7P8U51J type=del size=4151042 2024-09-12T00:34:21.422 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.424+0000 7f1f2d864780 1 < completed part key=_multipart_2RV0899QUJ8W.2~OXR54FIVI6JP.0 size=1048576 2024-09-12T00:34:21.423 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.425+0000 7f1f2d864780 1 < completed part key=_multipart_2RV0899QUJ8W.2~OXR54FIVI6JP.1 size=779728 2024-09-12T00:34:21.425 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.427+0000 7f1f2d864780 1 < completed multipart upload key=2RV0899QUJ8W upload=OXR54FIVI6JP tag=UE1I2S7VTZSQ type=write size=2876880 2024-09-12T00:34:21.427 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.429+0000 7f1f2d864780 1 > prepared part key=_multipart_SNCGB6Z20450.2~CTJOPYP7PFIQ.0 size=1048576 2024-09-12T00:34:21.428 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.430+0000 7f1f2d864780 1 > prepared part key=_multipart_SNCGB6Z20450.2~CTJOPYP7PFIQ.1 size=209865 2024-09-12T00:34:21.428 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.430+0000 7f1f2d864780 1 > prepared multipart upload key=SNCGB6Z20450 upload=CTJOPYP7PFIQ tag=BM9KESIJXU65 type=write size=2307017 2024-09-12T00:34:21.429 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.431+0000 7f1f2d864780 1 < completed delete operation key=4FRVL0KXN2X8 tag=726D4L82VW4O type=del 2024-09-12T00:34:21.431 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.432+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=U0PSR9R313NS type=write size=284495 2024-09-12T00:34:21.432 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.433+0000 7f1f2d864780 1 < completed write operation key=MSGU3PHLBRJH tag=64MKYI9NQB8T type=write size=149182 2024-09-12T00:34:21.433 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.435+0000 7f1f2d864780 1 > prepared operation key=N9RQIGHVL8VP tag=GANKUBX3CBKA type=del size=1242520 2024-09-12T00:34:21.435 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.437+0000 7f1f2d864780 1 < suggested update operation key=ECZYQEZ942W8 tag=Z7A2NER0UI6M type=del size=1133920 2024-09-12T00:34:21.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.438+0000 7f1f2d864780 1 > prepared operation key=SZP418NVZ5VX tag=XX4HBLVXMD60 type=del size=2991863 2024-09-12T00:34:21.438 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.439+0000 7f1f2d864780 1 < completed part key=_multipart_AN26EVAZI527.2~5AU2UCFQFUTV.0 size=928078 2024-09-12T00:34:21.440 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.441+0000 7f1f2d864780 1 < completed multipart upload key=AN26EVAZI527 upload=5AU2UCFQFUTV tag=VJJNO8SD2F45 type=write size=1976654 2024-09-12T00:34:21.443 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.444+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~F5L8EJU4Y24C.0 size=1048576 2024-09-12T00:34:21.444 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.445+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~F5L8EJU4Y24C.1 size=1048576 2024-09-12T00:34:21.445 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.446+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~F5L8EJU4Y24C.2 size=505948 2024-09-12T00:34:21.445 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.446+0000 7f1f2d864780 1 > prepared multipart upload key=4FRVL0KXN2X8 upload=F5L8EJU4Y24C tag=HU94FNXY8CMQ type=write size=3651676 2024-09-12T00:34:21.446 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.448+0000 7f1f2d864780 1 < canceled operation key=2YCGIJRK6MUH tag=YKBLH312RRYP type=del size=1835630 2024-09-12T00:34:21.447 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.449+0000 7f1f2d864780 1 > prepared operation key=WKK747ETLW10 tag=29GQTAM1SGBV type=write size=299852 2024-09-12T00:34:21.448 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.450+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~OO44A4Y0Q597.0 size=1048576 2024-09-12T00:34:21.449 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.451+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~OO44A4Y0Q597.1 size=1048576 2024-09-12T00:34:21.450 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.452+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~OO44A4Y0Q597.2 size=521445 2024-09-12T00:34:21.452 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.454+0000 7f1f2d864780 1 < completed multipart upload key=WGKEA4EKF5GP upload=OO44A4Y0Q597 tag=KR0WGB2THADG type=write size=3667173 2024-09-12T00:34:21.455 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.456+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~SJ5SGX40CX7Y.0 size=1048576 2024-09-12T00:34:21.455 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.457+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~SJ5SGX40CX7Y.1 size=1048576 2024-09-12T00:34:21.456 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.458+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~SJ5SGX40CX7Y.2 size=743384 2024-09-12T00:34:21.456 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.458+0000 7f1f2d864780 1 > prepared multipart upload key=1299IOSGYIO9 upload=SJ5SGX40CX7Y tag=FPM38BJT93LZ type=write size=3889112 2024-09-12T00:34:21.457 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.459+0000 7f1f2d864780 1 < completed delete operation key=ZGO887JDR627 tag=OJM8VLZY4XVD type=del 2024-09-12T00:34:21.460 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.461+0000 7f1f2d864780 1 > prepared part key=_multipart_2RV0899QUJ8W.2~KE5JDAF5GEL5.0 size=931557 2024-09-12T00:34:21.460 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.461+0000 7f1f2d864780 1 > prepared multipart upload key=2RV0899QUJ8W upload=KE5JDAF5GEL5 tag=6MJS6GC4ZM60 type=write size=1980133 2024-09-12T00:34:21.461 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.462+0000 7f1f2d864780 1 < canceled operation key=KHPF1N1MT33Z tag=7QW0283SHRK0 type=del size=1661607 2024-09-12T00:34:21.463 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.465+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~SZGX363T2FDD.0 size=1048576 2024-09-12T00:34:21.464 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.465+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~SZGX363T2FDD.1 size=973602 2024-09-12T00:34:21.464 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.465+0000 7f1f2d864780 1 > prepared multipart upload key=FAP6N3H7SBN0 upload=SZGX363T2FDD tag=ZRK9VL3KIOWH type=write size=3070754 2024-09-12T00:34:21.465 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.467+0000 7f1f2d864780 1 < completed delete operation key=WKK747ETLW10 tag=ZL6VV1XZ3IJ1 type=del 2024-09-12T00:34:21.466 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.468+0000 7f1f2d864780 1 > prepared operation key=UTR2UUO6DHLJ tag=43BFF7NUGGXV type=del size=3880062 2024-09-12T00:34:21.467 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.469+0000 7f1f2d864780 1 < completed part key=_multipart_4FRVL0KXN2X8.2~318MFKCGZN1W.0 size=1048576 2024-09-12T00:34:21.468 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.469+0000 7f1f2d864780 1 < canceled part key=_multipart_4FRVL0KXN2X8.2~318MFKCGZN1W.1 size=1048576 2024-09-12T00:34:21.468 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.470+0000 7f1f2d864780 1 < completed part key=_multipart_4FRVL0KXN2X8.2~318MFKCGZN1W.2 size=913906 2024-09-12T00:34:21.470 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.472+0000 7f1f2d864780 1 < canceled multipart upload key=4FRVL0KXN2X8 upload=318MFKCGZN1W tag=DZOFE4US4NMI type=write size=4059634 2024-09-12T00:34:21.472 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.473+0000 7f1f2d864780 1 > prepared operation key=ZYNIJH0TTSM6 tag=SUNKFIK065SH type=del size=324025 2024-09-12T00:34:21.473 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.474+0000 7f1f2d864780 1 < completed part key=_multipart_WIIU8VTCLWOD.2~L3SNRYYHGDVD.0 size=226156 2024-09-12T00:34:21.474 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.476+0000 7f1f2d864780 1 < completed multipart upload key=WIIU8VTCLWOD upload=L3SNRYYHGDVD tag=2XZW9NJV7GHK type=write size=1274732 2024-09-12T00:34:21.476 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.477+0000 7f1f2d864780 1 > prepared operation key=DYKLAY6J018G tag=D8ZY5GMM0UGJ type=del size=1505927 2024-09-12T00:34:21.477 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.478+0000 7f1f2d864780 1 < completed part key=_multipart_FAP6N3H7SBN0.2~FYQHXJLBWAE6.0 size=1048576 2024-09-12T00:34:21.478 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.479+0000 7f1f2d864780 1 < completed part key=_multipart_FAP6N3H7SBN0.2~FYQHXJLBWAE6.1 size=1048576 2024-09-12T00:34:21.479 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.480+0000 7f1f2d864780 1 < completed part key=_multipart_FAP6N3H7SBN0.2~FYQHXJLBWAE6.2 size=314859 2024-09-12T00:34:21.481 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.482+0000 7f1f2d864780 1 < completed multipart upload key=FAP6N3H7SBN0 upload=FYQHXJLBWAE6 tag=35SGKU06TSJB type=write size=3460587 2024-09-12T00:34:21.482 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.483+0000 7f1f2d864780 1 > prepared operation key=FAP6N3H7SBN0 tag=01BIRPBE7HBM type=del size=235557 2024-09-12T00:34:21.483 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.485+0000 7f1f2d864780 1 < canceled operation key=2YCGIJRK6MUH tag=KTT3RKXLP6YU type=write size=793612 2024-09-12T00:34:21.485 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.486+0000 7f1f2d864780 1 > prepared part key=_multipart_WKK747ETLW10.2~SYPTTJ3F80PX.0 size=694778 2024-09-12T00:34:21.485 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.486+0000 7f1f2d864780 1 > prepared multipart upload key=WKK747ETLW10 upload=SYPTTJ3F80PX tag=O85SOZEY7MNI type=write size=1743354 2024-09-12T00:34:21.490 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.489+0000 7f1f2d864780 1 < suggested update operation key=0DSQOFS8IIF5 tag=80688YW94OX0 type=del size=2217175 2024-09-12T00:34:21.490 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.490+0000 7f1f2d864780 1 > prepared operation key=ZYNIJH0TTSM6 tag=DS5VIZNDDNAV type=del size=2938235 2024-09-12T00:34:21.490 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.491+0000 7f1f2d864780 1 < completed delete operation key=GSPM8N0K7ODC tag=7NY3Z7P8U51J type=del 2024-09-12T00:34:21.491 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.493+0000 7f1f2d864780 1 > prepared part key=_multipart_SNCGB6Z20450.2~IDBIH5IU7D1K.0 size=1048576 2024-09-12T00:34:21.492 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.494+0000 7f1f2d864780 1 > prepared part key=_multipart_SNCGB6Z20450.2~IDBIH5IU7D1K.1 size=178590 2024-09-12T00:34:21.492 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.494+0000 7f1f2d864780 1 > prepared multipart upload key=SNCGB6Z20450 upload=IDBIH5IU7D1K tag=Z5LU8411CV8D type=write size=2275742 2024-09-12T00:34:21.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.495+0000 7f1f2d864780 1 < completed part key=_multipart_SNCGB6Z20450.2~CTJOPYP7PFIQ.0 size=1048576 2024-09-12T00:34:21.494 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.496+0000 7f1f2d864780 1 < completed part key=_multipart_SNCGB6Z20450.2~CTJOPYP7PFIQ.1 size=209865 2024-09-12T00:34:21.497 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.498+0000 7f1f2d864780 1 < completed multipart upload key=SNCGB6Z20450 upload=CTJOPYP7PFIQ tag=BM9KESIJXU65 type=write size=2307017 2024-09-12T00:34:21.499 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.500+0000 7f1f2d864780 1 > prepared part key=_multipart_9XK59MVZ5G1O.2~J2DEGV2Y3AFP.0 size=305034 2024-09-12T00:34:21.499 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.500+0000 7f1f2d864780 1 > prepared multipart upload key=9XK59MVZ5G1O upload=J2DEGV2Y3AFP tag=JZX119K3KQGK type=write size=1353610 2024-09-12T00:34:21.500 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.501+0000 7f1f2d864780 1 < completed write operation key=2RV0899QUJ8W tag=U0PSR9R313NS type=write size=284495 2024-09-12T00:34:21.501 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.503+0000 7f1f2d864780 1 > prepared operation key=UTR2UUO6DHLJ tag=C2BWRR7S6BSI type=del size=2899715 2024-09-12T00:34:21.502 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.504+0000 7f1f2d864780 1 < completed delete operation key=N9RQIGHVL8VP tag=GANKUBX3CBKA type=del 2024-09-12T00:34:21.504 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.506+0000 7f1f2d864780 1 > prepared part key=_multipart_SNCGB6Z20450.2~005AO6M1PI86.0 size=1048576 2024-09-12T00:34:21.505 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.507+0000 7f1f2d864780 1 > prepared part key=_multipart_SNCGB6Z20450.2~005AO6M1PI86.1 size=1048576 2024-09-12T00:34:21.506 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.508+0000 7f1f2d864780 1 > prepared part key=_multipart_SNCGB6Z20450.2~005AO6M1PI86.2 size=675891 2024-09-12T00:34:21.506 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.508+0000 7f1f2d864780 1 > prepared multipart upload key=SNCGB6Z20450 upload=005AO6M1PI86 tag=YV8YHQU0BJ9Z type=write size=3821619 2024-09-12T00:34:21.507 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.509+0000 7f1f2d864780 1 < completed delete operation key=SZP418NVZ5VX tag=XX4HBLVXMD60 type=del 2024-09-12T00:34:21.510 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.511+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~PLRH9SQ6LSL3.0 size=1048576 2024-09-12T00:34:21.510 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.512+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~PLRH9SQ6LSL3.1 size=157869 2024-09-12T00:34:21.511 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.512+0000 7f1f2d864780 1 > prepared multipart upload key=SZP418NVZ5VX upload=PLRH9SQ6LSL3 tag=ZF6EIMZK6Z4T type=write size=2255021 2024-09-12T00:34:21.512 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.513+0000 7f1f2d864780 1 < completed part key=_multipart_4FRVL0KXN2X8.2~F5L8EJU4Y24C.0 size=1048576 2024-09-12T00:34:21.513 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.514+0000 7f1f2d864780 1 < completed part key=_multipart_4FRVL0KXN2X8.2~F5L8EJU4Y24C.1 size=1048576 2024-09-12T00:34:21.513 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.515+0000 7f1f2d864780 1 < completed part key=_multipart_4FRVL0KXN2X8.2~F5L8EJU4Y24C.2 size=505948 2024-09-12T00:34:21.515 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.517+0000 7f1f2d864780 1 < completed multipart upload key=4FRVL0KXN2X8 upload=F5L8EJU4Y24C tag=HU94FNXY8CMQ type=write size=3651676 2024-09-12T00:34:21.517 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.519+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~H1FXDIZDLFRN.0 size=565281 2024-09-12T00:34:21.518 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.519+0000 7f1f2d864780 1 > prepared multipart upload key=D21W9QZWY0YU upload=H1FXDIZDLFRN tag=32K22SSA7CUM type=write size=1613857 2024-09-12T00:34:21.520 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.521+0000 7f1f2d864780 1 < suggested remove operation key=WKK747ETLW10 tag=29GQTAM1SGBV type=write 2024-09-12T00:34:21.521 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.523+0000 7f1f2d864780 1 > prepared operation key=OY145ZXRSF4L tag=RRQY9KVVFV3O type=write size=728657 2024-09-12T00:34:21.521 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.523+0000 7f1f2d864780 1 < canceled part key=_multipart_1299IOSGYIO9.2~SJ5SGX40CX7Y.0 size=1048576 2024-09-12T00:34:21.522 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.524+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~SJ5SGX40CX7Y.1 size=1048576 2024-09-12T00:34:21.523 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.525+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~SJ5SGX40CX7Y.2 size=743384 2024-09-12T00:34:21.525 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.527+0000 7f1f2d864780 1 < canceled multipart upload key=1299IOSGYIO9 upload=SJ5SGX40CX7Y tag=FPM38BJT93LZ type=write size=3889112 2024-09-12T00:34:21.526 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.528+0000 7f1f2d864780 1 > prepared operation key=OY145ZXRSF4L tag=FKFXLEUTWT53 type=write size=476949 2024-09-12T00:34:21.528 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.529+0000 7f1f2d864780 1 < completed part key=_multipart_2RV0899QUJ8W.2~KE5JDAF5GEL5.0 size=931557 2024-09-12T00:34:21.530 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.531+0000 7f1f2d864780 1 < completed multipart upload key=2RV0899QUJ8W upload=KE5JDAF5GEL5 tag=6MJS6GC4ZM60 type=write size=1980133 2024-09-12T00:34:21.532 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.533+0000 7f1f2d864780 1 > prepared part key=_multipart_9XK59MVZ5G1O.2~NDFPBCP097NV.0 size=1048576 2024-09-12T00:34:21.533 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.534+0000 7f1f2d864780 1 > prepared part key=_multipart_9XK59MVZ5G1O.2~NDFPBCP097NV.1 size=1048576 2024-09-12T00:34:21.534 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.535+0000 7f1f2d864780 1 > prepared part key=_multipart_9XK59MVZ5G1O.2~NDFPBCP097NV.2 size=224887 2024-09-12T00:34:21.534 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.535+0000 7f1f2d864780 1 > prepared multipart upload key=9XK59MVZ5G1O upload=NDFPBCP097NV tag=U62DLDIBO6KR type=write size=3370615 2024-09-12T00:34:21.534 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.535+0000 7f1f2d864780 1 < canceled part key=_multipart_FAP6N3H7SBN0.2~SZGX363T2FDD.0 size=1048576 2024-09-12T00:34:21.535 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.536+0000 7f1f2d864780 1 < completed part key=_multipart_FAP6N3H7SBN0.2~SZGX363T2FDD.1 size=973602 2024-09-12T00:34:21.537 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.538+0000 7f1f2d864780 1 < canceled multipart upload key=FAP6N3H7SBN0 upload=SZGX363T2FDD tag=ZRK9VL3KIOWH type=write size=3070754 2024-09-12T00:34:21.539 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.540+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~GAUM8EOX4A84.0 size=1048576 2024-09-12T00:34:21.540 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.541+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~GAUM8EOX4A84.1 size=1048576 2024-09-12T00:34:21.541 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.543+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~GAUM8EOX4A84.2 size=974764 2024-09-12T00:34:21.541 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.543+0000 7f1f2d864780 1 > prepared multipart upload key=0DSQOFS8IIF5 upload=GAUM8EOX4A84 tag=OPG79Q7OL0YI type=write size=4120492 2024-09-12T00:34:21.542 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.544+0000 7f1f2d864780 1 < completed delete operation key=UTR2UUO6DHLJ tag=43BFF7NUGGXV type=del 2024-09-12T00:34:21.543 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.545+0000 7f1f2d864780 1 > prepared operation key=PVB52GO6L8T4 tag=MAVRP8KE3E94 type=del size=2527647 2024-09-12T00:34:21.545 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.546+0000 7f1f2d864780 1 < completed delete operation key=ZYNIJH0TTSM6 tag=SUNKFIK065SH type=del 2024-09-12T00:34:21.547 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.548+0000 7f1f2d864780 1 > prepared part key=_multipart_ZGO887JDR627.2~4YB2IYIPQQR3.0 size=1048576 2024-09-12T00:34:21.548 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.549+0000 7f1f2d864780 1 > prepared part key=_multipart_ZGO887JDR627.2~4YB2IYIPQQR3.1 size=1048576 2024-09-12T00:34:21.549 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.551+0000 7f1f2d864780 1 > prepared part key=_multipart_ZGO887JDR627.2~4YB2IYIPQQR3.2 size=106267 2024-09-12T00:34:21.550 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.551+0000 7f1f2d864780 1 > prepared multipart upload key=ZGO887JDR627 upload=4YB2IYIPQQR3 tag=040RG6RUWN8W type=write size=3251995 2024-09-12T00:34:21.551 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.552+0000 7f1f2d864780 1 < completed delete operation key=DYKLAY6J018G tag=D8ZY5GMM0UGJ type=del 2024-09-12T00:34:21.553 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.554+0000 7f1f2d864780 1 > prepared part key=_multipart_PVB52GO6L8T4.2~5U7QHG44B52G.0 size=1048576 2024-09-12T00:34:21.553 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.555+0000 7f1f2d864780 1 > prepared part key=_multipart_PVB52GO6L8T4.2~5U7QHG44B52G.1 size=656320 2024-09-12T00:34:21.553 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.555+0000 7f1f2d864780 1 > prepared multipart upload key=PVB52GO6L8T4 upload=5U7QHG44B52G tag=9EFLY812CSHZ type=write size=2753472 2024-09-12T00:34:21.554 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.556+0000 7f1f2d864780 1 < completed delete operation key=FAP6N3H7SBN0 tag=01BIRPBE7HBM type=del 2024-09-12T00:34:21.556 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.557+0000 7f1f2d864780 1 > prepared operation key=ZGO887JDR627 tag=LNKO7BSN8XMK type=write size=762519 2024-09-12T00:34:21.557 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.559+0000 7f1f2d864780 1 < completed part key=_multipart_WKK747ETLW10.2~SYPTTJ3F80PX.0 size=694778 2024-09-12T00:34:21.561 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.562+0000 7f1f2d864780 1 < completed multipart upload key=WKK747ETLW10 upload=SYPTTJ3F80PX tag=O85SOZEY7MNI type=write size=1743354 2024-09-12T00:34:21.562 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.564+0000 7f1f2d864780 1 > prepared part key=_multipart_UTR2UUO6DHLJ.2~SKJM6WO76OB1.0 size=1048576 2024-09-12T00:34:21.563 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.565+0000 7f1f2d864780 1 > prepared part key=_multipart_UTR2UUO6DHLJ.2~SKJM6WO76OB1.1 size=1048576 2024-09-12T00:34:21.564 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.566+0000 7f1f2d864780 1 > prepared part key=_multipart_UTR2UUO6DHLJ.2~SKJM6WO76OB1.2 size=733879 2024-09-12T00:34:21.564 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.566+0000 7f1f2d864780 1 > prepared multipart upload key=UTR2UUO6DHLJ upload=SKJM6WO76OB1 tag=71RNJCE7K6T3 type=write size=3879607 2024-09-12T00:34:21.565 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.567+0000 7f1f2d864780 1 < completed delete operation key=ZYNIJH0TTSM6 tag=DS5VIZNDDNAV type=del 2024-09-12T00:34:21.566 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.568+0000 7f1f2d864780 1 > prepared operation key=ZGO887JDR627 tag=X271IS9094H6 type=write size=683233 2024-09-12T00:34:21.567 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.569+0000 7f1f2d864780 1 < completed part key=_multipart_SNCGB6Z20450.2~IDBIH5IU7D1K.0 size=1048576 2024-09-12T00:34:21.568 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.569+0000 7f1f2d864780 1 < canceled part key=_multipart_SNCGB6Z20450.2~IDBIH5IU7D1K.1 size=178590 2024-09-12T00:34:21.569 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.571+0000 7f1f2d864780 1 < canceled multipart upload key=SNCGB6Z20450 upload=IDBIH5IU7D1K tag=Z5LU8411CV8D type=write size=2275742 2024-09-12T00:34:21.571 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.573+0000 7f1f2d864780 1 > prepared part key=_multipart_SNCGB6Z20450.2~3PBL2L0JJSQH.0 size=817221 2024-09-12T00:34:21.571 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.573+0000 7f1f2d864780 1 > prepared multipart upload key=SNCGB6Z20450 upload=3PBL2L0JJSQH tag=D8JIJGZZE2D6 type=write size=1865797 2024-09-12T00:34:21.573 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.574+0000 7f1f2d864780 1 < completed part key=_multipart_9XK59MVZ5G1O.2~J2DEGV2Y3AFP.0 size=305034 2024-09-12T00:34:21.574 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.576+0000 7f1f2d864780 1 < completed multipart upload key=9XK59MVZ5G1O upload=J2DEGV2Y3AFP tag=JZX119K3KQGK type=write size=1353610 2024-09-12T00:34:21.576 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.578+0000 7f1f2d864780 1 > prepared part key=_multipart_GSPM8N0K7ODC.2~GLU2CCP3VJ1Y.0 size=1048576 2024-09-12T00:34:21.577 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.579+0000 7f1f2d864780 1 > prepared part key=_multipart_GSPM8N0K7ODC.2~GLU2CCP3VJ1Y.1 size=538682 2024-09-12T00:34:21.577 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.579+0000 7f1f2d864780 1 > prepared multipart upload key=GSPM8N0K7ODC upload=GLU2CCP3VJ1Y tag=I1LSC6XWF02A type=write size=2635834 2024-09-12T00:34:21.578 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.580+0000 7f1f2d864780 1 < completed delete operation key=UTR2UUO6DHLJ tag=C2BWRR7S6BSI type=del 2024-09-12T00:34:21.580 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.581+0000 7f1f2d864780 1 > prepared operation key=MSGU3PHLBRJH tag=PGOQRDPJ6BLU type=del size=1726844 2024-09-12T00:34:21.581 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.583+0000 7f1f2d864780 1 < completed part key=_multipart_SNCGB6Z20450.2~005AO6M1PI86.0 size=1048576 2024-09-12T00:34:21.582 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.584+0000 7f1f2d864780 1 < completed part key=_multipart_SNCGB6Z20450.2~005AO6M1PI86.1 size=1048576 2024-09-12T00:34:21.583 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.585+0000 7f1f2d864780 1 < completed part key=_multipart_SNCGB6Z20450.2~005AO6M1PI86.2 size=675891 2024-09-12T00:34:21.585 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.587+0000 7f1f2d864780 1 < completed multipart upload key=SNCGB6Z20450 upload=005AO6M1PI86 tag=YV8YHQU0BJ9Z type=write size=3821619 2024-09-12T00:34:21.586 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.588+0000 7f1f2d864780 1 > prepared operation key=DYKLAY6J018G tag=BH9A5MSHMFGH type=del size=4036014 2024-09-12T00:34:21.587 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.589+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~PLRH9SQ6LSL3.0 size=1048576 2024-09-12T00:34:21.588 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.590+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~PLRH9SQ6LSL3.1 size=157869 2024-09-12T00:34:21.590 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.592+0000 7f1f2d864780 1 < completed multipart upload key=SZP418NVZ5VX upload=PLRH9SQ6LSL3 tag=ZF6EIMZK6Z4T type=write size=2255021 2024-09-12T00:34:21.592 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.594+0000 7f1f2d864780 1 > prepared part key=_multipart_S5DVMA14N7VJ.2~UY25V12DXK39.0 size=625335 2024-09-12T00:34:21.593 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.594+0000 7f1f2d864780 1 > prepared multipart upload key=S5DVMA14N7VJ upload=UY25V12DXK39 tag=P3VJPL432Q1Z type=write size=1673911 2024-09-12T00:34:21.594 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.595+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~H1FXDIZDLFRN.0 size=565281 2024-09-12T00:34:21.595 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.597+0000 7f1f2d864780 1 < completed multipart upload key=D21W9QZWY0YU upload=H1FXDIZDLFRN tag=32K22SSA7CUM type=write size=1613857 2024-09-12T00:34:21.597 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.599+0000 7f1f2d864780 1 > prepared part key=_multipart_PVB52GO6L8T4.2~V1GJ73MHYUT1.0 size=331426 2024-09-12T00:34:21.597 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.599+0000 7f1f2d864780 1 > prepared multipart upload key=PVB52GO6L8T4 upload=V1GJ73MHYUT1 tag=BJ0MWZYNFHPB type=write size=1380002 2024-09-12T00:34:21.598 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.600+0000 7f1f2d864780 1 < canceled operation key=OY145ZXRSF4L tag=RRQY9KVVFV3O type=write size=728657 2024-09-12T00:34:21.600 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.601+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=I82GD778R34S type=del size=3957980 2024-09-12T00:34:21.601 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.602+0000 7f1f2d864780 1 < canceled operation key=OY145ZXRSF4L tag=FKFXLEUTWT53 type=write size=476949 2024-09-12T00:34:21.602 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.604+0000 7f1f2d864780 1 > prepared operation key=ZYNIJH0TTSM6 tag=8W0GAFLJBAT5 type=del size=2316484 2024-09-12T00:34:21.603 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.605+0000 7f1f2d864780 1 < completed part key=_multipart_9XK59MVZ5G1O.2~NDFPBCP097NV.0 size=1048576 2024-09-12T00:34:21.604 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.606+0000 7f1f2d864780 1 < completed part key=_multipart_9XK59MVZ5G1O.2~NDFPBCP097NV.1 size=1048576 2024-09-12T00:34:21.605 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.607+0000 7f1f2d864780 1 < completed part key=_multipart_9XK59MVZ5G1O.2~NDFPBCP097NV.2 size=224887 2024-09-12T00:34:21.607 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.609+0000 7f1f2d864780 1 < completed multipart upload key=9XK59MVZ5G1O upload=NDFPBCP097NV tag=U62DLDIBO6KR type=write size=3370615 2024-09-12T00:34:21.608 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.610+0000 7f1f2d864780 1 > prepared operation key=S5DVMA14N7VJ tag=CQCWVRMGZW07 type=write size=553145 2024-09-12T00:34:21.609 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.611+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~GAUM8EOX4A84.0 size=1048576 2024-09-12T00:34:21.610 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.611+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~GAUM8EOX4A84.1 size=1048576 2024-09-12T00:34:21.611 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.612+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~GAUM8EOX4A84.2 size=974764 2024-09-12T00:34:21.613 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.614+0000 7f1f2d864780 1 < completed multipart upload key=0DSQOFS8IIF5 upload=GAUM8EOX4A84 tag=OPG79Q7OL0YI type=write size=4120492 2024-09-12T00:34:21.614 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.615+0000 7f1f2d864780 1 > prepared operation key=D21W9QZWY0YU tag=1P874ERA3FXL type=write size=138253 2024-09-12T00:34:21.615 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.617+0000 7f1f2d864780 1 < completed delete operation key=PVB52GO6L8T4 tag=MAVRP8KE3E94 type=del 2024-09-12T00:34:21.616 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.618+0000 7f1f2d864780 1 > prepared operation key=D21W9QZWY0YU tag=JL03G061I33U type=del size=2617459 2024-09-12T00:34:21.617 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.619+0000 7f1f2d864780 1 < completed part key=_multipart_ZGO887JDR627.2~4YB2IYIPQQR3.0 size=1048576 2024-09-12T00:34:21.619 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.620+0000 7f1f2d864780 1 < completed part key=_multipart_ZGO887JDR627.2~4YB2IYIPQQR3.1 size=1048576 2024-09-12T00:34:21.620 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.621+0000 7f1f2d864780 1 < completed part key=_multipart_ZGO887JDR627.2~4YB2IYIPQQR3.2 size=106267 2024-09-12T00:34:21.622 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.624+0000 7f1f2d864780 1 < completed multipart upload key=ZGO887JDR627 upload=4YB2IYIPQQR3 tag=040RG6RUWN8W type=write size=3251995 2024-09-12T00:34:21.623 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.625+0000 7f1f2d864780 1 > prepared operation key=FFG41OYEYFZA tag=WI9D2RWXTNT5 type=del size=1075841 2024-09-12T00:34:21.625 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.626+0000 7f1f2d864780 1 < completed part key=_multipart_PVB52GO6L8T4.2~5U7QHG44B52G.0 size=1048576 2024-09-12T00:34:21.626 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.627+0000 7f1f2d864780 1 < completed part key=_multipart_PVB52GO6L8T4.2~5U7QHG44B52G.1 size=656320 2024-09-12T00:34:21.628 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.629+0000 7f1f2d864780 1 < completed multipart upload key=PVB52GO6L8T4 upload=5U7QHG44B52G tag=9EFLY812CSHZ type=write size=2753472 2024-09-12T00:34:21.630 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.632+0000 7f1f2d864780 1 > prepared part key=_multipart_PVB52GO6L8T4.2~1MIEG6R13I2X.0 size=1048576 2024-09-12T00:34:21.631 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.633+0000 7f1f2d864780 1 > prepared part key=_multipart_PVB52GO6L8T4.2~1MIEG6R13I2X.1 size=729270 2024-09-12T00:34:21.631 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.633+0000 7f1f2d864780 1 > prepared multipart upload key=PVB52GO6L8T4 upload=1MIEG6R13I2X tag=N31W1OSUS0VX type=write size=2826422 2024-09-12T00:34:21.632 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.634+0000 7f1f2d864780 1 < completed write operation key=ZGO887JDR627 tag=LNKO7BSN8XMK type=write size=762519 2024-09-12T00:34:21.633 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.635+0000 7f1f2d864780 1 > prepared operation key=4FRVL0KXN2X8 tag=DEF8FQS7OOB3 type=del size=3227269 2024-09-12T00:34:21.634 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.636+0000 7f1f2d864780 1 < completed part key=_multipart_UTR2UUO6DHLJ.2~SKJM6WO76OB1.0 size=1048576 2024-09-12T00:34:21.635 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.637+0000 7f1f2d864780 1 < completed part key=_multipart_UTR2UUO6DHLJ.2~SKJM6WO76OB1.1 size=1048576 2024-09-12T00:34:21.636 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.638+0000 7f1f2d864780 1 < completed part key=_multipart_UTR2UUO6DHLJ.2~SKJM6WO76OB1.2 size=733879 2024-09-12T00:34:21.638 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.640+0000 7f1f2d864780 1 < completed multipart upload key=UTR2UUO6DHLJ upload=SKJM6WO76OB1 tag=71RNJCE7K6T3 type=write size=3879607 2024-09-12T00:34:21.640 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.642+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~3D6N2MWW85UA.0 size=931452 2024-09-12T00:34:21.640 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.642+0000 7f1f2d864780 1 > prepared multipart upload key=4FRVL0KXN2X8 upload=3D6N2MWW85UA tag=NQRLU5Z9LDW4 type=write size=1980028 2024-09-12T00:34:21.641 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.643+0000 7f1f2d864780 1 < completed write operation key=ZGO887JDR627 tag=X271IS9094H6 type=write size=683233 2024-09-12T00:34:21.643 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.644+0000 7f1f2d864780 1 > prepared operation key=0DSQOFS8IIF5 tag=9JU83U2ZJLE3 type=del size=3005958 2024-09-12T00:34:21.644 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.645+0000 7f1f2d864780 1 < completed part key=_multipart_SNCGB6Z20450.2~3PBL2L0JJSQH.0 size=817221 2024-09-12T00:34:21.646 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.647+0000 7f1f2d864780 1 < completed multipart upload key=SNCGB6Z20450 upload=3PBL2L0JJSQH tag=D8JIJGZZE2D6 type=write size=1865797 2024-09-12T00:34:21.647 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.648+0000 7f1f2d864780 1 > prepared operation key=FAP6N3H7SBN0 tag=VGGU8YP5IXSD type=write size=128626 2024-09-12T00:34:21.648 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.650+0000 7f1f2d864780 1 < completed part key=_multipart_GSPM8N0K7ODC.2~GLU2CCP3VJ1Y.0 size=1048576 2024-09-12T00:34:21.649 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.651+0000 7f1f2d864780 1 < completed part key=_multipart_GSPM8N0K7ODC.2~GLU2CCP3VJ1Y.1 size=538682 2024-09-12T00:34:21.651 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.652+0000 7f1f2d864780 1 < completed multipart upload key=GSPM8N0K7ODC upload=GLU2CCP3VJ1Y tag=I1LSC6XWF02A type=write size=2635834 2024-09-12T00:34:21.652 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.654+0000 7f1f2d864780 1 > prepared operation key=0DSQOFS8IIF5 tag=JW24GCQ8TKN3 type=del size=1448448 2024-09-12T00:34:21.653 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.655+0000 7f1f2d864780 1 < completed delete operation key=MSGU3PHLBRJH tag=PGOQRDPJ6BLU type=del 2024-09-12T00:34:21.655 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.657+0000 7f1f2d864780 1 > prepared part key=_multipart_AN26EVAZI527.2~G8P5RUK4FLAT.0 size=312396 2024-09-12T00:34:21.655 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.657+0000 7f1f2d864780 1 > prepared multipart upload key=AN26EVAZI527 upload=G8P5RUK4FLAT tag=GSKMEJAC6E45 type=write size=1360972 2024-09-12T00:34:21.657 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.658+0000 7f1f2d864780 1 < completed delete operation key=DYKLAY6J018G tag=BH9A5MSHMFGH type=del 2024-09-12T00:34:21.658 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.659+0000 7f1f2d864780 1 > prepared operation key=GSPM8N0K7ODC tag=733F86C76LI1 type=del size=1442446 2024-09-12T00:34:21.659 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.661+0000 7f1f2d864780 1 < completed part key=_multipart_S5DVMA14N7VJ.2~UY25V12DXK39.0 size=625335 2024-09-12T00:34:21.661 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.662+0000 7f1f2d864780 1 < completed multipart upload key=S5DVMA14N7VJ upload=UY25V12DXK39 tag=P3VJPL432Q1Z type=write size=1673911 2024-09-12T00:34:21.663 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.664+0000 7f1f2d864780 1 > prepared part key=_multipart_DYKLAY6J018G.2~2NYZHFS05U1B.0 size=123652 2024-09-12T00:34:21.663 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.664+0000 7f1f2d864780 1 > prepared multipart upload key=DYKLAY6J018G upload=2NYZHFS05U1B tag=VALVZGCV6ZSK type=write size=1172228 2024-09-12T00:34:21.663 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.664+0000 7f1f2d864780 1 < canceled part key=_multipart_PVB52GO6L8T4.2~V1GJ73MHYUT1.0 size=331426 2024-09-12T00:34:21.664 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.666+0000 7f1f2d864780 1 < canceled multipart upload key=PVB52GO6L8T4 upload=V1GJ73MHYUT1 tag=BJ0MWZYNFHPB type=write size=1380002 2024-09-12T00:34:21.667 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.668+0000 7f1f2d864780 1 > prepared part key=_multipart_N9RQIGHVL8VP.2~SVSIBF5XXN5A.0 size=302848 2024-09-12T00:34:21.667 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.668+0000 7f1f2d864780 1 > prepared multipart upload key=N9RQIGHVL8VP upload=SVSIBF5XXN5A tag=TWA3U444RP2T type=write size=1351424 2024-09-12T00:34:21.668 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.669+0000 7f1f2d864780 1 < completed delete operation key=2RV0899QUJ8W tag=I82GD778R34S type=del 2024-09-12T00:34:21.669 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.671+0000 7f1f2d864780 1 > prepared operation key=OY145ZXRSF4L tag=7EEJVAID780A type=del size=3524405 2024-09-12T00:34:21.670 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.672+0000 7f1f2d864780 1 < canceled operation key=ZYNIJH0TTSM6 tag=8W0GAFLJBAT5 type=del size=2316484 2024-09-12T00:34:21.671 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.673+0000 7f1f2d864780 1 > prepared operation key=2YCGIJRK6MUH tag=1R32R2QM1SQK type=write size=736331 2024-09-12T00:34:21.672 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.674+0000 7f1f2d864780 1 < completed write operation key=S5DVMA14N7VJ tag=CQCWVRMGZW07 type=write size=553145 2024-09-12T00:34:21.673 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.675+0000 7f1f2d864780 1 > prepared operation key=WIIU8VTCLWOD tag=YLSTODPMTCFX type=del size=948271 2024-09-12T00:34:21.674 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.676+0000 7f1f2d864780 1 < completed write operation key=D21W9QZWY0YU tag=1P874ERA3FXL type=write size=138253 2024-09-12T00:34:21.676 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.677+0000 7f1f2d864780 1 > prepared operation key=2YCGIJRK6MUH tag=H5G3L5PP6EAV type=del size=4102824 2024-09-12T00:34:21.677 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.678+0000 7f1f2d864780 1 < completed delete operation key=D21W9QZWY0YU tag=JL03G061I33U type=del 2024-09-12T00:34:21.678 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.680+0000 7f1f2d864780 1 > prepared part key=_multipart_PVB52GO6L8T4.2~UJAN1SO6MJXQ.0 size=557019 2024-09-12T00:34:21.679 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.680+0000 7f1f2d864780 1 > prepared multipart upload key=PVB52GO6L8T4 upload=UJAN1SO6MJXQ tag=FTQW4L5I0N6P type=write size=1605595 2024-09-12T00:34:21.681 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.682+0000 7f1f2d864780 1 < suggested remove operation key=FFG41OYEYFZA tag=WI9D2RWXTNT5 type=del 2024-09-12T00:34:21.682 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.684+0000 7f1f2d864780 1 > prepared operation key=2YCGIJRK6MUH tag=RH8NRJQJ0FUT type=del size=3446929 2024-09-12T00:34:21.683 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.685+0000 7f1f2d864780 1 < completed part key=_multipart_PVB52GO6L8T4.2~1MIEG6R13I2X.0 size=1048576 2024-09-12T00:34:21.684 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.686+0000 7f1f2d864780 1 < completed part key=_multipart_PVB52GO6L8T4.2~1MIEG6R13I2X.1 size=729270 2024-09-12T00:34:21.686 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.688+0000 7f1f2d864780 1 < completed multipart upload key=PVB52GO6L8T4 upload=1MIEG6R13I2X tag=N31W1OSUS0VX type=write size=2826422 2024-09-12T00:34:21.687 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.689+0000 7f1f2d864780 1 > prepared operation key=WIIU8VTCLWOD tag=WVIEXFAK8DPD type=del size=3395097 2024-09-12T00:34:21.688 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.690+0000 7f1f2d864780 1 < completed delete operation key=4FRVL0KXN2X8 tag=DEF8FQS7OOB3 type=del 2024-09-12T00:34:21.693 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.692+0000 7f1f2d864780 1 > prepared part key=_multipart_MSGU3PHLBRJH.2~QQ8OOGSNGS8B.0 size=1048576 2024-09-12T00:34:21.693 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.693+0000 7f1f2d864780 1 > prepared part key=_multipart_MSGU3PHLBRJH.2~QQ8OOGSNGS8B.1 size=69183 2024-09-12T00:34:21.693 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.693+0000 7f1f2d864780 1 > prepared multipart upload key=MSGU3PHLBRJH upload=QQ8OOGSNGS8B tag=FA17K4LJYAHN type=write size=2166335 2024-09-12T00:34:21.693 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.694+0000 7f1f2d864780 1 < completed part key=_multipart_4FRVL0KXN2X8.2~3D6N2MWW85UA.0 size=931452 2024-09-12T00:34:21.694 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.696+0000 7f1f2d864780 1 < completed multipart upload key=4FRVL0KXN2X8 upload=3D6N2MWW85UA tag=NQRLU5Z9LDW4 type=write size=1980028 2024-09-12T00:34:21.696 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.697+0000 7f1f2d864780 1 > prepared operation key=0DSQOFS8IIF5 tag=O1SAQ5T5DI70 type=del size=23935 2024-09-12T00:34:21.696 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.698+0000 7f1f2d864780 1 < completed delete operation key=0DSQOFS8IIF5 tag=9JU83U2ZJLE3 type=del 2024-09-12T00:34:21.698 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.699+0000 7f1f2d864780 1 > prepared operation key=WGKEA4EKF5GP tag=SRRAR9NORLFZ type=del size=200883 2024-09-12T00:34:21.699 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.700+0000 7f1f2d864780 1 < completed write operation key=FAP6N3H7SBN0 tag=VGGU8YP5IXSD type=write size=128626 2024-09-12T00:34:21.701 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.703+0000 7f1f2d864780 1 > prepared part key=_multipart_FFG41OYEYFZA.2~SARLD2CL7PP6.0 size=1048576 2024-09-12T00:34:21.702 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.704+0000 7f1f2d864780 1 > prepared part key=_multipart_FFG41OYEYFZA.2~SARLD2CL7PP6.1 size=367894 2024-09-12T00:34:21.702 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.704+0000 7f1f2d864780 1 > prepared multipart upload key=FFG41OYEYFZA upload=SARLD2CL7PP6 tag=I4NQEU2KGZ6U type=write size=2465046 2024-09-12T00:34:21.703 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.705+0000 7f1f2d864780 1 < completed delete operation key=0DSQOFS8IIF5 tag=JW24GCQ8TKN3 type=del 2024-09-12T00:34:21.704 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.706+0000 7f1f2d864780 1 > prepared operation key=O1YY03BOEYLM tag=667YPREXIG66 type=del size=2230356 2024-09-12T00:34:21.706 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.707+0000 7f1f2d864780 1 < completed part key=_multipart_AN26EVAZI527.2~G8P5RUK4FLAT.0 size=312396 2024-09-12T00:34:21.707 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.709+0000 7f1f2d864780 1 < completed multipart upload key=AN26EVAZI527 upload=G8P5RUK4FLAT tag=GSKMEJAC6E45 type=write size=1360972 2024-09-12T00:34:21.709 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.710+0000 7f1f2d864780 1 > prepared operation key=ZGO887JDR627 tag=Y7AWLKV98VON type=del size=2731640 2024-09-12T00:34:21.710 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.712+0000 7f1f2d864780 1 < completed delete operation key=GSPM8N0K7ODC tag=733F86C76LI1 type=del 2024-09-12T00:34:21.711 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.713+0000 7f1f2d864780 1 > prepared operation key=FFG41OYEYFZA tag=XNEUTX01I6U6 type=del size=1962718 2024-09-12T00:34:21.712 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.714+0000 7f1f2d864780 1 < completed part key=_multipart_DYKLAY6J018G.2~2NYZHFS05U1B.0 size=123652 2024-09-12T00:34:21.715 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.716+0000 7f1f2d864780 1 < completed multipart upload key=DYKLAY6J018G upload=2NYZHFS05U1B tag=VALVZGCV6ZSK type=write size=1172228 2024-09-12T00:34:21.717 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.718+0000 7f1f2d864780 1 > prepared part key=_multipart_WIIU8VTCLWOD.2~WF5FENED6JRH.0 size=1048576 2024-09-12T00:34:21.718 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.719+0000 7f1f2d864780 1 > prepared part key=_multipart_WIIU8VTCLWOD.2~WF5FENED6JRH.1 size=1048576 2024-09-12T00:34:21.719 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.720+0000 7f1f2d864780 1 > prepared part key=_multipart_WIIU8VTCLWOD.2~WF5FENED6JRH.2 size=403551 2024-09-12T00:34:21.719 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.720+0000 7f1f2d864780 1 > prepared multipart upload key=WIIU8VTCLWOD upload=WF5FENED6JRH tag=GVGA13FR9AQ4 type=write size=3549279 2024-09-12T00:34:21.720 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.722+0000 7f1f2d864780 1 < completed part key=_multipart_N9RQIGHVL8VP.2~SVSIBF5XXN5A.0 size=302848 2024-09-12T00:34:21.723 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.725+0000 7f1f2d864780 1 < completed multipart upload key=N9RQIGHVL8VP upload=SVSIBF5XXN5A tag=TWA3U444RP2T type=write size=1351424 2024-09-12T00:34:21.727 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.729+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~U4TZVENXQIMO.0 size=1009609 2024-09-12T00:34:21.727 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.729+0000 7f1f2d864780 1 > prepared multipart upload key=W6U30X4HJCB1 upload=U4TZVENXQIMO tag=IS6GU6O84C20 type=write size=2058185 2024-09-12T00:34:21.729 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.731+0000 7f1f2d864780 1 < suggested remove operation key=OY145ZXRSF4L tag=7EEJVAID780A type=del 2024-09-12T00:34:21.731 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.733+0000 7f1f2d864780 1 > prepared operation key=4FRVL0KXN2X8 tag=HSILUV77FSQB type=del size=2624942 2024-09-12T00:34:21.732 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.734+0000 7f1f2d864780 1 < completed write operation key=2YCGIJRK6MUH tag=1R32R2QM1SQK type=write size=736331 2024-09-12T00:34:21.733 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.735+0000 7f1f2d864780 1 > prepared operation key=0DSQOFS8IIF5 tag=O4ZHKFK2KENX type=del size=2596692 2024-09-12T00:34:21.735 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.736+0000 7f1f2d864780 1 < completed delete operation key=WIIU8VTCLWOD tag=YLSTODPMTCFX type=del 2024-09-12T00:34:21.737 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.738+0000 7f1f2d864780 1 > prepared part key=_multipart_OY145ZXRSF4L.2~H9FR0AZN27EI.0 size=1048576 2024-09-12T00:34:21.737 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.739+0000 7f1f2d864780 1 > prepared part key=_multipart_OY145ZXRSF4L.2~H9FR0AZN27EI.1 size=298620 2024-09-12T00:34:21.737 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.739+0000 7f1f2d864780 1 > prepared multipart upload key=OY145ZXRSF4L upload=H9FR0AZN27EI tag=J6XKXY80C336 type=write size=2395772 2024-09-12T00:34:21.738 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.740+0000 7f1f2d864780 1 < completed delete operation key=2YCGIJRK6MUH tag=H5G3L5PP6EAV type=del 2024-09-12T00:34:21.741 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.742+0000 7f1f2d864780 1 > prepared part key=_multipart_ECZYQEZ942W8.2~03V3CJ1SSUFD.0 size=275003 2024-09-12T00:34:21.741 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.742+0000 7f1f2d864780 1 > prepared multipart upload key=ECZYQEZ942W8 upload=03V3CJ1SSUFD tag=JY7NSVG54M2H type=write size=1323579 2024-09-12T00:34:21.742 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.743+0000 7f1f2d864780 1 < completed part key=_multipart_PVB52GO6L8T4.2~UJAN1SO6MJXQ.0 size=557019 2024-09-12T00:34:21.744 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.745+0000 7f1f2d864780 1 < completed multipart upload key=PVB52GO6L8T4 upload=UJAN1SO6MJXQ tag=FTQW4L5I0N6P type=write size=1605595 2024-09-12T00:34:21.745 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.746+0000 7f1f2d864780 1 > prepared operation key=0DSQOFS8IIF5 tag=G5JM5XIWKJDR type=write size=344716 2024-09-12T00:34:21.746 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.748+0000 7f1f2d864780 1 < completed delete operation key=2YCGIJRK6MUH tag=RH8NRJQJ0FUT type=del 2024-09-12T00:34:21.748 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.750+0000 7f1f2d864780 1 > prepared part key=_multipart_OY145ZXRSF4L.2~6G27R2VUDYZQ.0 size=1048576 2024-09-12T00:34:21.749 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.751+0000 7f1f2d864780 1 > prepared part key=_multipart_OY145ZXRSF4L.2~6G27R2VUDYZQ.1 size=112926 2024-09-12T00:34:21.749 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.751+0000 7f1f2d864780 1 > prepared multipart upload key=OY145ZXRSF4L upload=6G27R2VUDYZQ tag=BDJAQ9J9KOH0 type=write size=2210078 2024-09-12T00:34:21.750 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.752+0000 7f1f2d864780 1 < completed delete operation key=WIIU8VTCLWOD tag=WVIEXFAK8DPD type=del 2024-09-12T00:34:21.751 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.753+0000 7f1f2d864780 1 > prepared operation key=0DSQOFS8IIF5 tag=ZLCQXF0ZLXA6 type=del size=4069175 2024-09-12T00:34:21.752 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.754+0000 7f1f2d864780 1 < completed part key=_multipart_MSGU3PHLBRJH.2~QQ8OOGSNGS8B.0 size=1048576 2024-09-12T00:34:21.753 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.755+0000 7f1f2d864780 1 < completed part key=_multipart_MSGU3PHLBRJH.2~QQ8OOGSNGS8B.1 size=69183 2024-09-12T00:34:21.755 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.757+0000 7f1f2d864780 1 < completed multipart upload key=MSGU3PHLBRJH upload=QQ8OOGSNGS8B tag=FA17K4LJYAHN type=write size=2166335 2024-09-12T00:34:21.756 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.758+0000 7f1f2d864780 1 > prepared operation key=S5DVMA14N7VJ tag=P35OBY7AZBHA type=del size=3477040 2024-09-12T00:34:21.757 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.759+0000 7f1f2d864780 1 < completed delete operation key=0DSQOFS8IIF5 tag=O1SAQ5T5DI70 type=del 2024-09-12T00:34:21.759 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.760+0000 7f1f2d864780 1 > prepared operation key=KHPF1N1MT33Z tag=15XBUCSEL6A1 type=del size=1074533 2024-09-12T00:34:21.760 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.762+0000 7f1f2d864780 1 < completed delete operation key=WGKEA4EKF5GP tag=SRRAR9NORLFZ type=del 2024-09-12T00:34:21.762 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.764+0000 7f1f2d864780 1 > prepared part key=_multipart_S5DVMA14N7VJ.2~R1MJ3619FD2M.0 size=530739 2024-09-12T00:34:21.762 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.764+0000 7f1f2d864780 1 > prepared multipart upload key=S5DVMA14N7VJ upload=R1MJ3619FD2M tag=9SVHABQWL5J7 type=write size=1579315 2024-09-12T00:34:21.763 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.765+0000 7f1f2d864780 1 < completed part key=_multipart_FFG41OYEYFZA.2~SARLD2CL7PP6.0 size=1048576 2024-09-12T00:34:21.764 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.766+0000 7f1f2d864780 1 < completed part key=_multipart_FFG41OYEYFZA.2~SARLD2CL7PP6.1 size=367894 2024-09-12T00:34:21.766 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.768+0000 7f1f2d864780 1 < completed multipart upload key=FFG41OYEYFZA upload=SARLD2CL7PP6 tag=I4NQEU2KGZ6U type=write size=2465046 2024-09-12T00:34:21.768 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.769+0000 7f1f2d864780 1 > prepared operation key=ZGO887JDR627 tag=KCIC30RN07FW type=del size=660605 2024-09-12T00:34:21.769 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.771+0000 7f1f2d864780 1 < completed delete operation key=O1YY03BOEYLM tag=667YPREXIG66 type=del 2024-09-12T00:34:21.771 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.773+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~XZTSV4IUALPV.0 size=84787 2024-09-12T00:34:21.771 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.773+0000 7f1f2d864780 1 > prepared multipart upload key=1299IOSGYIO9 upload=XZTSV4IUALPV tag=NO4GZ0URLAJ2 type=write size=1133363 2024-09-12T00:34:21.772 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.774+0000 7f1f2d864780 1 < completed delete operation key=ZGO887JDR627 tag=Y7AWLKV98VON type=del 2024-09-12T00:34:21.774 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.776+0000 7f1f2d864780 1 > prepared part key=_multipart_ECZYQEZ942W8.2~SO2IB6V2D6LH.0 size=1048576 2024-09-12T00:34:21.775 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.777+0000 7f1f2d864780 1 > prepared part key=_multipart_ECZYQEZ942W8.2~SO2IB6V2D6LH.1 size=30290 2024-09-12T00:34:21.775 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.777+0000 7f1f2d864780 1 > prepared multipart upload key=ECZYQEZ942W8 upload=SO2IB6V2D6LH tag=E9096BIR1879 type=write size=2127442 2024-09-12T00:34:21.777 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.779+0000 7f1f2d864780 1 < suggested remove operation key=FFG41OYEYFZA tag=XNEUTX01I6U6 type=del 2024-09-12T00:34:21.779 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.780+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=J0C11D5BW7G3 type=del size=1660375 2024-09-12T00:34:21.780 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.781+0000 7f1f2d864780 1 < completed part key=_multipart_WIIU8VTCLWOD.2~WF5FENED6JRH.0 size=1048576 2024-09-12T00:34:21.781 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.782+0000 7f1f2d864780 1 < completed part key=_multipart_WIIU8VTCLWOD.2~WF5FENED6JRH.1 size=1048576 2024-09-12T00:34:21.782 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.783+0000 7f1f2d864780 1 < completed part key=_multipart_WIIU8VTCLWOD.2~WF5FENED6JRH.2 size=403551 2024-09-12T00:34:21.784 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.785+0000 7f1f2d864780 1 < completed multipart upload key=WIIU8VTCLWOD upload=WF5FENED6JRH tag=GVGA13FR9AQ4 type=write size=3549279 2024-09-12T00:34:21.786 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.787+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~O7YG9F10TP3K.0 size=101327 2024-09-12T00:34:21.786 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.787+0000 7f1f2d864780 1 > prepared multipart upload key=FAP6N3H7SBN0 upload=O7YG9F10TP3K tag=LWDZZC84B1JC type=write size=1149903 2024-09-12T00:34:21.787 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.789+0000 7f1f2d864780 1 < completed part key=_multipart_W6U30X4HJCB1.2~U4TZVENXQIMO.0 size=1009609 2024-09-12T00:34:21.791 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.792+0000 7f1f2d864780 1 < completed multipart upload key=W6U30X4HJCB1 upload=U4TZVENXQIMO tag=IS6GU6O84C20 type=write size=2058185 2024-09-12T00:34:21.793 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.795+0000 7f1f2d864780 1 > prepared part key=_multipart_O1YY03BOEYLM.2~LAV0HI6DI57Z.0 size=1048576 2024-09-12T00:34:21.794 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.796+0000 7f1f2d864780 1 > prepared part key=_multipart_O1YY03BOEYLM.2~LAV0HI6DI57Z.1 size=1048576 2024-09-12T00:34:21.795 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.797+0000 7f1f2d864780 1 > prepared part key=_multipart_O1YY03BOEYLM.2~LAV0HI6DI57Z.2 size=390327 2024-09-12T00:34:21.795 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.797+0000 7f1f2d864780 1 > prepared multipart upload key=O1YY03BOEYLM upload=LAV0HI6DI57Z tag=OBT8DHKYCJKN type=write size=3536055 2024-09-12T00:34:21.796 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.798+0000 7f1f2d864780 1 < completed delete operation key=4FRVL0KXN2X8 tag=HSILUV77FSQB type=del 2024-09-12T00:34:21.797 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.799+0000 7f1f2d864780 1 > prepared operation key=D21W9QZWY0YU tag=HH5G3WO7UOJ9 type=del size=3816526 2024-09-12T00:34:21.798 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.800+0000 7f1f2d864780 1 < completed delete operation key=0DSQOFS8IIF5 tag=O4ZHKFK2KENX type=del 2024-09-12T00:34:21.801 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.802+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~E2SAZTGKZ18L.0 size=1048576 2024-09-12T00:34:21.802 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.803+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~E2SAZTGKZ18L.1 size=448756 2024-09-12T00:34:21.802 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.803+0000 7f1f2d864780 1 > prepared multipart upload key=1299IOSGYIO9 upload=E2SAZTGKZ18L tag=4E2BTWL6ZLHD type=write size=2545908 2024-09-12T00:34:21.803 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.804+0000 7f1f2d864780 1 < completed part key=_multipart_OY145ZXRSF4L.2~H9FR0AZN27EI.0 size=1048576 2024-09-12T00:34:21.803 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.804+0000 7f1f2d864780 1 < canceled part key=_multipart_OY145ZXRSF4L.2~H9FR0AZN27EI.1 size=298620 2024-09-12T00:34:21.805 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.806+0000 7f1f2d864780 1 < canceled multipart upload key=OY145ZXRSF4L upload=H9FR0AZN27EI tag=J6XKXY80C336 type=write size=2395772 2024-09-12T00:34:21.806 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.807+0000 7f1f2d864780 1 > prepared operation key=ZGO887JDR627 tag=FPXCI2HNTDB7 type=del size=2550956 2024-09-12T00:34:21.807 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.809+0000 7f1f2d864780 1 < completed part key=_multipart_ECZYQEZ942W8.2~03V3CJ1SSUFD.0 size=275003 2024-09-12T00:34:21.809 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.811+0000 7f1f2d864780 1 < completed multipart upload key=ECZYQEZ942W8 upload=03V3CJ1SSUFD tag=JY7NSVG54M2H type=write size=1323579 2024-09-12T00:34:21.810 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.812+0000 7f1f2d864780 1 > prepared operation key=O1YY03BOEYLM tag=CG415RJRBK10 type=del size=974379 2024-09-12T00:34:21.811 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.813+0000 7f1f2d864780 1 < completed write operation key=0DSQOFS8IIF5 tag=G5JM5XIWKJDR type=write size=344716 2024-09-12T00:34:21.813 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.814+0000 7f1f2d864780 1 > prepared operation key=OY145ZXRSF4L tag=W8271314GZO7 type=del size=3301061 2024-09-12T00:34:21.814 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.815+0000 7f1f2d864780 1 < completed part key=_multipart_OY145ZXRSF4L.2~6G27R2VUDYZQ.0 size=1048576 2024-09-12T00:34:21.815 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.816+0000 7f1f2d864780 1 < completed part key=_multipart_OY145ZXRSF4L.2~6G27R2VUDYZQ.1 size=112926 2024-09-12T00:34:21.817 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.818+0000 7f1f2d864780 1 < completed multipart upload key=OY145ZXRSF4L upload=6G27R2VUDYZQ tag=BDJAQ9J9KOH0 type=write size=2210078 2024-09-12T00:34:21.818 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.819+0000 7f1f2d864780 1 > prepared operation key=FAP6N3H7SBN0 tag=1ONGZVNX22Z3 type=del size=3603870 2024-09-12T00:34:21.819 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.821+0000 7f1f2d864780 1 < completed delete operation key=0DSQOFS8IIF5 tag=ZLCQXF0ZLXA6 type=del 2024-09-12T00:34:21.820 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.822+0000 7f1f2d864780 1 > prepared operation key=1299IOSGYIO9 tag=2PBSSAIR5CVT type=del size=3092018 2024-09-12T00:34:21.822 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.823+0000 7f1f2d864780 1 < completed delete operation key=S5DVMA14N7VJ tag=P35OBY7AZBHA type=del 2024-09-12T00:34:21.824 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.825+0000 7f1f2d864780 1 > prepared part key=_multipart_9XK59MVZ5G1O.2~42QL5XKQNI1N.0 size=379940 2024-09-12T00:34:21.824 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.825+0000 7f1f2d864780 1 > prepared multipart upload key=9XK59MVZ5G1O upload=42QL5XKQNI1N tag=F5JQKDUUVV29 type=write size=1428516 2024-09-12T00:34:21.825 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.827+0000 7f1f2d864780 1 < canceled operation key=KHPF1N1MT33Z tag=15XBUCSEL6A1 type=del size=1074533 2024-09-12T00:34:21.827 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.829+0000 7f1f2d864780 1 > prepared part key=_multipart_S5DVMA14N7VJ.2~HPEFLE7IPP6T.0 size=1048576 2024-09-12T00:34:21.828 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.829+0000 7f1f2d864780 1 > prepared part key=_multipart_S5DVMA14N7VJ.2~HPEFLE7IPP6T.1 size=1003503 2024-09-12T00:34:21.828 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.829+0000 7f1f2d864780 1 > prepared multipart upload key=S5DVMA14N7VJ upload=HPEFLE7IPP6T tag=UHKPCSMXU2CX type=write size=3100655 2024-09-12T00:34:21.829 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.831+0000 7f1f2d864780 1 < completed part key=_multipart_S5DVMA14N7VJ.2~R1MJ3619FD2M.0 size=530739 2024-09-12T00:34:21.831 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.833+0000 7f1f2d864780 1 < completed multipart upload key=S5DVMA14N7VJ upload=R1MJ3619FD2M tag=9SVHABQWL5J7 type=write size=1579315 2024-09-12T00:34:21.832 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.834+0000 7f1f2d864780 1 > prepared operation key=2YCGIJRK6MUH tag=0H4E59IUDCNJ type=del size=2078913 2024-09-12T00:34:21.834 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.836+0000 7f1f2d864780 1 < suggested update operation key=ZGO887JDR627 tag=KCIC30RN07FW type=del size=660605 2024-09-12T00:34:21.835 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.837+0000 7f1f2d864780 1 > prepared operation key=AN26EVAZI527 tag=XNC9T6B5UZJV type=del size=4183247 2024-09-12T00:34:21.837 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.838+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~XZTSV4IUALPV.0 size=84787 2024-09-12T00:34:21.838 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.840+0000 7f1f2d864780 1 < completed multipart upload key=1299IOSGYIO9 upload=XZTSV4IUALPV tag=NO4GZ0URLAJ2 type=write size=1133363 2024-09-12T00:34:21.840 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.841+0000 7f1f2d864780 1 > prepared operation key=PVB52GO6L8T4 tag=CIFSCXQKHYTJ type=del size=2375517 2024-09-12T00:34:21.841 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.843+0000 7f1f2d864780 1 < completed part key=_multipart_ECZYQEZ942W8.2~SO2IB6V2D6LH.0 size=1048576 2024-09-12T00:34:21.842 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.843+0000 7f1f2d864780 1 < completed part key=_multipart_ECZYQEZ942W8.2~SO2IB6V2D6LH.1 size=30290 2024-09-12T00:34:21.844 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.845+0000 7f1f2d864780 1 < completed multipart upload key=ECZYQEZ942W8 upload=SO2IB6V2D6LH tag=E9096BIR1879 type=write size=2127442 2024-09-12T00:34:21.846 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.847+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~99VY4QOTVG3R.0 size=763735 2024-09-12T00:34:21.846 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.847+0000 7f1f2d864780 1 > prepared multipart upload key=WGKEA4EKF5GP upload=99VY4QOTVG3R tag=EQPNH18WZ3ZX type=write size=1812311 2024-09-12T00:34:21.847 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.849+0000 7f1f2d864780 1 < completed delete operation key=2RV0899QUJ8W tag=J0C11D5BW7G3 type=del 2024-09-12T00:34:21.848 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.850+0000 7f1f2d864780 1 > prepared operation key=O1YY03BOEYLM tag=FR16RH6MXVP2 type=del size=1323995 2024-09-12T00:34:21.849 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.850+0000 7f1f2d864780 1 < canceled part key=_multipart_FAP6N3H7SBN0.2~O7YG9F10TP3K.0 size=101327 2024-09-12T00:34:21.851 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.852+0000 7f1f2d864780 1 < canceled multipart upload key=FAP6N3H7SBN0 upload=O7YG9F10TP3K tag=LWDZZC84B1JC type=write size=1149903 2024-09-12T00:34:21.853 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.855+0000 7f1f2d864780 1 > prepared part key=_multipart_AN26EVAZI527.2~QP3ZNK8FXSXP.0 size=1048576 2024-09-12T00:34:21.854 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.856+0000 7f1f2d864780 1 > prepared part key=_multipart_AN26EVAZI527.2~QP3ZNK8FXSXP.1 size=1048576 2024-09-12T00:34:21.855 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.857+0000 7f1f2d864780 1 > prepared part key=_multipart_AN26EVAZI527.2~QP3ZNK8FXSXP.2 size=752261 2024-09-12T00:34:21.855 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.857+0000 7f1f2d864780 1 > prepared multipart upload key=AN26EVAZI527 upload=QP3ZNK8FXSXP tag=S2GM0G7PMZO0 type=write size=3897989 2024-09-12T00:34:21.856 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.858+0000 7f1f2d864780 1 < completed part key=_multipart_O1YY03BOEYLM.2~LAV0HI6DI57Z.0 size=1048576 2024-09-12T00:34:21.858 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.859+0000 7f1f2d864780 1 < completed part key=_multipart_O1YY03BOEYLM.2~LAV0HI6DI57Z.1 size=1048576 2024-09-12T00:34:21.859 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.860+0000 7f1f2d864780 1 < completed part key=_multipart_O1YY03BOEYLM.2~LAV0HI6DI57Z.2 size=390327 2024-09-12T00:34:21.861 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.862+0000 7f1f2d864780 1 < completed multipart upload key=O1YY03BOEYLM upload=LAV0HI6DI57Z tag=OBT8DHKYCJKN type=write size=3536055 2024-09-12T00:34:21.862 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.864+0000 7f1f2d864780 1 > prepared operation key=D21W9QZWY0YU tag=QN5EQD2F3HXE type=del size=4129666 2024-09-12T00:34:21.863 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.865+0000 7f1f2d864780 1 < completed delete operation key=D21W9QZWY0YU tag=HH5G3WO7UOJ9 type=del 2024-09-12T00:34:21.865 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.866+0000 7f1f2d864780 1 > prepared operation key=GSPM8N0K7ODC tag=NWPZWP5F0819 type=del size=3184885 2024-09-12T00:34:21.866 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.868+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~E2SAZTGKZ18L.0 size=1048576 2024-09-12T00:34:21.866 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.868+0000 7f1f2d864780 1 < canceled part key=_multipart_1299IOSGYIO9.2~E2SAZTGKZ18L.1 size=448756 2024-09-12T00:34:21.868 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.869+0000 7f1f2d864780 1 < canceled multipart upload key=1299IOSGYIO9 upload=E2SAZTGKZ18L tag=4E2BTWL6ZLHD type=write size=2545908 2024-09-12T00:34:21.870 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.872+0000 7f1f2d864780 1 > prepared part key=_multipart_2RV0899QUJ8W.2~DPEXTGXOML2B.0 size=1048576 2024-09-12T00:34:21.871 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.873+0000 7f1f2d864780 1 > prepared part key=_multipart_2RV0899QUJ8W.2~DPEXTGXOML2B.1 size=805065 2024-09-12T00:34:21.871 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.873+0000 7f1f2d864780 1 > prepared multipart upload key=2RV0899QUJ8W upload=DPEXTGXOML2B tag=138AHC2VMOOC type=write size=2902217 2024-09-12T00:34:21.872 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.874+0000 7f1f2d864780 -1 < failed to complete operation key=ZGO887JDR627 tag=FPXCI2HNTDB7 type=del size=2550956: (22) Invalid argument 2024-09-12T00:34:21.873 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.875+0000 7f1f2d864780 1 > prepared operation key=N9RQIGHVL8VP tag=1MJ8J7J740Q6 type=del size=874421 2024-09-12T00:34:21.875 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.877+0000 7f1f2d864780 1 < canceled operation key=O1YY03BOEYLM tag=CG415RJRBK10 type=del size=974379 2024-09-12T00:34:21.876 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.878+0000 7f1f2d864780 1 > prepared operation key=4FRVL0KXN2X8 tag=MODLLMB8B5W2 type=del size=1297012 2024-09-12T00:34:21.878 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.880+0000 7f1f2d864780 1 < suggested update operation key=OY145ZXRSF4L tag=W8271314GZO7 type=del size=3301061 2024-09-12T00:34:21.881 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.882+0000 7f1f2d864780 1 > prepared operation key=DYKLAY6J018G tag=AW4HE38LXE7J type=del size=53305 2024-09-12T00:34:21.883 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.884+0000 7f1f2d864780 1 < suggested update operation key=FAP6N3H7SBN0 tag=1ONGZVNX22Z3 type=del size=3603870 2024-09-12T00:34:21.884 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.886+0000 7f1f2d864780 1 > prepared operation key=0DSQOFS8IIF5 tag=QUP2368JJRKW type=del size=3419759 2024-09-12T00:34:21.885 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.887+0000 7f1f2d864780 1 < completed delete operation key=1299IOSGYIO9 tag=2PBSSAIR5CVT type=del 2024-09-12T00:34:21.887 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.888+0000 7f1f2d864780 1 > prepared operation key=PVB52GO6L8T4 tag=AGT2UGI11ZL5 type=del size=3181152 2024-09-12T00:34:21.888 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.890+0000 7f1f2d864780 1 < completed part key=_multipart_9XK59MVZ5G1O.2~42QL5XKQNI1N.0 size=379940 2024-09-12T00:34:21.890 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.892+0000 7f1f2d864780 1 < completed multipart upload key=9XK59MVZ5G1O upload=42QL5XKQNI1N tag=F5JQKDUUVV29 type=write size=1428516 2024-09-12T00:34:21.891 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.893+0000 7f1f2d864780 1 > prepared operation key=O1YY03BOEYLM tag=ENNPO0MR5K02 type=del size=2330301 2024-09-12T00:34:21.893 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.894+0000 7f1f2d864780 1 < completed part key=_multipart_S5DVMA14N7VJ.2~HPEFLE7IPP6T.0 size=1048576 2024-09-12T00:34:21.893 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.894+0000 7f1f2d864780 1 < canceled part key=_multipart_S5DVMA14N7VJ.2~HPEFLE7IPP6T.1 size=1003503 2024-09-12T00:34:21.897 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.896+0000 7f1f2d864780 1 < canceled multipart upload key=S5DVMA14N7VJ upload=HPEFLE7IPP6T tag=UHKPCSMXU2CX type=write size=3100655 2024-09-12T00:34:21.897 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.897+0000 7f1f2d864780 1 > prepared operation key=SZP418NVZ5VX tag=I28ARNDPPWCR type=del size=4122930 2024-09-12T00:34:21.897 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.899+0000 7f1f2d864780 1 < completed delete operation key=2YCGIJRK6MUH tag=0H4E59IUDCNJ type=del 2024-09-12T00:34:21.898 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.900+0000 7f1f2d864780 1 > prepared operation key=OY145ZXRSF4L tag=DXOSD4BRR1U5 type=del size=2514548 2024-09-12T00:34:21.900 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.901+0000 7f1f2d864780 1 < completed delete operation key=AN26EVAZI527 tag=XNC9T6B5UZJV type=del 2024-09-12T00:34:21.901 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.903+0000 7f1f2d864780 1 > prepared operation key=DYKLAY6J018G tag=X44JXBJ6BNAJ type=write size=648344 2024-09-12T00:34:21.902 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.904+0000 7f1f2d864780 1 < completed delete operation key=PVB52GO6L8T4 tag=CIFSCXQKHYTJ type=del 2024-09-12T00:34:21.903 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.905+0000 7f1f2d864780 1 > prepared operation key=UTR2UUO6DHLJ tag=MBVY0JGCQLB7 type=del size=1788639 2024-09-12T00:34:21.905 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.906+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~99VY4QOTVG3R.0 size=763735 2024-09-12T00:34:21.907 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.908+0000 7f1f2d864780 1 < completed multipart upload key=WGKEA4EKF5GP upload=99VY4QOTVG3R tag=EQPNH18WZ3ZX type=write size=1812311 2024-09-12T00:34:21.908 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.910+0000 7f1f2d864780 1 > prepared operation key=W6U30X4HJCB1 tag=JT96B3MFSH3O type=write size=451135 2024-09-12T00:34:21.911 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.912+0000 7f1f2d864780 1 < suggested remove operation key=O1YY03BOEYLM tag=FR16RH6MXVP2 type=del 2024-09-12T00:34:21.912 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.914+0000 7f1f2d864780 1 > prepared operation key=S5DVMA14N7VJ tag=U5YE4YCKFCD4 type=del size=2913281 2024-09-12T00:34:21.912 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.914+0000 7f1f2d864780 1 < canceled part key=_multipart_AN26EVAZI527.2~QP3ZNK8FXSXP.0 size=1048576 2024-09-12T00:34:21.913 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.915+0000 7f1f2d864780 1 < completed part key=_multipart_AN26EVAZI527.2~QP3ZNK8FXSXP.1 size=1048576 2024-09-12T00:34:21.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.916+0000 7f1f2d864780 1 < completed part key=_multipart_AN26EVAZI527.2~QP3ZNK8FXSXP.2 size=752261 2024-09-12T00:34:21.916 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.918+0000 7f1f2d864780 1 < canceled multipart upload key=AN26EVAZI527 upload=QP3ZNK8FXSXP tag=S2GM0G7PMZO0 type=write size=3897989 2024-09-12T00:34:21.917 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.919+0000 7f1f2d864780 1 > prepared operation key=SZP418NVZ5VX tag=KN9EM0VBFOY0 type=del size=2931038 2024-09-12T00:34:21.919 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.920+0000 7f1f2d864780 1 < canceled operation key=D21W9QZWY0YU tag=QN5EQD2F3HXE type=del size=4129666 2024-09-12T00:34:21.921 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.922+0000 7f1f2d864780 1 > prepared part key=_multipart_WIIU8VTCLWOD.2~1MQ1R3COYV71.0 size=514670 2024-09-12T00:34:21.921 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.922+0000 7f1f2d864780 1 > prepared multipart upload key=WIIU8VTCLWOD upload=1MQ1R3COYV71 tag=D1J0V0NFSS39 type=write size=1563246 2024-09-12T00:34:21.922 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.924+0000 7f1f2d864780 1 < completed delete operation key=GSPM8N0K7ODC tag=NWPZWP5F0819 type=del 2024-09-12T00:34:21.924 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.926+0000 7f1f2d864780 1 > prepared part key=_multipart_S5DVMA14N7VJ.2~YK4NW2WU9UZ4.0 size=1048576 2024-09-12T00:34:21.925 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.927+0000 7f1f2d864780 1 > prepared part key=_multipart_S5DVMA14N7VJ.2~YK4NW2WU9UZ4.1 size=344065 2024-09-12T00:34:21.925 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.927+0000 7f1f2d864780 1 > prepared multipart upload key=S5DVMA14N7VJ upload=YK4NW2WU9UZ4 tag=E868RFICYSM7 type=write size=2441217 2024-09-12T00:34:21.926 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.927+0000 7f1f2d864780 1 < canceled part key=_multipart_2RV0899QUJ8W.2~DPEXTGXOML2B.0 size=1048576 2024-09-12T00:34:21.926 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.928+0000 7f1f2d864780 1 < completed part key=_multipart_2RV0899QUJ8W.2~DPEXTGXOML2B.1 size=805065 2024-09-12T00:34:21.928 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.930+0000 7f1f2d864780 1 < canceled multipart upload key=2RV0899QUJ8W upload=DPEXTGXOML2B tag=138AHC2VMOOC type=write size=2902217 2024-09-12T00:34:21.930 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.932+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~AXALCC472EKH.0 size=1048576 2024-09-12T00:34:21.932 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.933+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~AXALCC472EKH.1 size=221466 2024-09-12T00:34:21.932 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.933+0000 7f1f2d864780 1 > prepared multipart upload key=WGKEA4EKF5GP upload=AXALCC472EKH tag=YDCB7IROOORW type=write size=2318618 2024-09-12T00:34:21.933 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.934+0000 7f1f2d864780 1 < completed delete operation key=N9RQIGHVL8VP tag=1MJ8J7J740Q6 type=del 2024-09-12T00:34:21.934 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.935+0000 7f1f2d864780 1 > prepared operation key=N9RQIGHVL8VP tag=6VRER24B4GCS type=del size=4004018 2024-09-12T00:34:21.936 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.938+0000 7f1f2d864780 1 < suggested update operation key=4FRVL0KXN2X8 tag=MODLLMB8B5W2 type=del size=1297012 2024-09-12T00:34:21.938 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.940+0000 7f1f2d864780 1 > prepared part key=_multipart_SNCGB6Z20450.2~9BX6LTLF3W3L.0 size=1048576 2024-09-12T00:34:21.939 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.941+0000 7f1f2d864780 1 > prepared part key=_multipart_SNCGB6Z20450.2~9BX6LTLF3W3L.1 size=792051 2024-09-12T00:34:21.939 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.941+0000 7f1f2d864780 1 > prepared multipart upload key=SNCGB6Z20450 upload=9BX6LTLF3W3L tag=KY70PBVYSBFB type=write size=2889203 2024-09-12T00:34:21.941 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.942+0000 7f1f2d864780 1 < completed delete operation key=DYKLAY6J018G tag=AW4HE38LXE7J type=del 2024-09-12T00:34:21.942 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.943+0000 7f1f2d864780 1 > prepared operation key=3Z1TGGPZKJ69 tag=Z1359SPUDE9C type=write size=996597 2024-09-12T00:34:21.943 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.945+0000 7f1f2d864780 1 < completed delete operation key=0DSQOFS8IIF5 tag=QUP2368JJRKW type=del 2024-09-12T00:34:21.944 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.946+0000 7f1f2d864780 1 > prepared operation key=SNCGB6Z20450 tag=M2MV7OFWL50P type=del size=626428 2024-09-12T00:34:21.946 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.948+0000 7f1f2d864780 1 < suggested remove operation key=PVB52GO6L8T4 tag=AGT2UGI11ZL5 type=del 2024-09-12T00:34:21.948 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.949+0000 7f1f2d864780 1 > prepared operation key=UTR2UUO6DHLJ tag=I3BG6DLHIEQT type=del size=2356151 2024-09-12T00:34:21.949 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.950+0000 7f1f2d864780 -1 < failed to complete operation key=O1YY03BOEYLM tag=ENNPO0MR5K02 type=del size=2330301: (22) Invalid argument 2024-09-12T00:34:21.951 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.953+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~QC91974T6A4L.0 size=1048576 2024-09-12T00:34:21.952 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.953+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~QC91974T6A4L.1 size=1048576 2024-09-12T00:34:21.953 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.954+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~QC91974T6A4L.2 size=923909 2024-09-12T00:34:21.953 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.954+0000 7f1f2d864780 1 > prepared multipart upload key=SZP418NVZ5VX upload=QC91974T6A4L tag=QJI2ANWZT30H type=write size=4069637 2024-09-12T00:34:21.954 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.955+0000 7f1f2d864780 1 < completed delete operation key=SZP418NVZ5VX tag=I28ARNDPPWCR type=del 2024-09-12T00:34:21.955 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.956+0000 7f1f2d864780 1 > prepared operation key=0DSQOFS8IIF5 tag=LZG18SQVYFD9 type=del size=2079603 2024-09-12T00:34:21.956 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.958+0000 7f1f2d864780 1 < completed delete operation key=OY145ZXRSF4L tag=DXOSD4BRR1U5 type=del 2024-09-12T00:34:21.958 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.960+0000 7f1f2d864780 1 > prepared part key=_multipart_GSPM8N0K7ODC.2~XIC5YG1CJV6V.0 size=1048576 2024-09-12T00:34:21.959 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.960+0000 7f1f2d864780 1 > prepared part key=_multipart_GSPM8N0K7ODC.2~XIC5YG1CJV6V.1 size=1048576 2024-09-12T00:34:21.960 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.961+0000 7f1f2d864780 1 > prepared part key=_multipart_GSPM8N0K7ODC.2~XIC5YG1CJV6V.2 size=963382 2024-09-12T00:34:21.960 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.961+0000 7f1f2d864780 1 > prepared multipart upload key=GSPM8N0K7ODC upload=XIC5YG1CJV6V tag=393J53X0LPRH type=write size=4109110 2024-09-12T00:34:21.961 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.963+0000 7f1f2d864780 1 < completed write operation key=DYKLAY6J018G tag=X44JXBJ6BNAJ type=write size=648344 2024-09-12T00:34:21.963 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.965+0000 7f1f2d864780 1 > prepared part key=_multipart_ZYNIJH0TTSM6.2~DOZLW9G67GUQ.0 size=1048576 2024-09-12T00:34:21.964 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.966+0000 7f1f2d864780 1 > prepared part key=_multipart_ZYNIJH0TTSM6.2~DOZLW9G67GUQ.1 size=580445 2024-09-12T00:34:21.964 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.966+0000 7f1f2d864780 1 > prepared multipart upload key=ZYNIJH0TTSM6 upload=DOZLW9G67GUQ tag=PIQTU8Q7MKQJ type=write size=2677597 2024-09-12T00:34:21.965 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.967+0000 7f1f2d864780 1 < completed delete operation key=UTR2UUO6DHLJ tag=MBVY0JGCQLB7 type=del 2024-09-12T00:34:21.966 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.968+0000 7f1f2d864780 1 > prepared operation key=WGKEA4EKF5GP tag=XIVYPJ5TBMXX type=write size=167324 2024-09-12T00:34:21.968 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.970+0000 7f1f2d864780 1 < suggested update operation key=W6U30X4HJCB1 tag=JT96B3MFSH3O type=write size=451135 2024-09-12T00:34:21.969 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.971+0000 7f1f2d864780 1 > prepared operation key=ZGO887JDR627 tag=GM7FZG60QR90 type=write size=862234 2024-09-12T00:34:21.970 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.972+0000 7f1f2d864780 1 < completed delete operation key=S5DVMA14N7VJ tag=U5YE4YCKFCD4 type=del 2024-09-12T00:34:21.972 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.974+0000 7f1f2d864780 1 > prepared part key=_multipart_ZGO887JDR627.2~VKQJHIC1Z1NA.0 size=1048576 2024-09-12T00:34:21.973 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.975+0000 7f1f2d864780 1 > prepared part key=_multipart_ZGO887JDR627.2~VKQJHIC1Z1NA.1 size=1048576 2024-09-12T00:34:21.974 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.976+0000 7f1f2d864780 1 > prepared part key=_multipart_ZGO887JDR627.2~VKQJHIC1Z1NA.2 size=435245 2024-09-12T00:34:21.974 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.976+0000 7f1f2d864780 1 > prepared multipart upload key=ZGO887JDR627 upload=VKQJHIC1Z1NA tag=41FBWSZHRHJ3 type=write size=3580973 2024-09-12T00:34:21.976 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.978+0000 7f1f2d864780 1 < suggested remove operation key=SZP418NVZ5VX tag=KN9EM0VBFOY0 type=del 2024-09-12T00:34:21.978 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.980+0000 7f1f2d864780 1 > prepared part key=_multipart_DYKLAY6J018G.2~S1FJKMMUMA1P.0 size=352700 2024-09-12T00:34:21.979 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.980+0000 7f1f2d864780 1 > prepared multipart upload key=DYKLAY6J018G upload=S1FJKMMUMA1P tag=3CRT19G3P0IL type=write size=1401276 2024-09-12T00:34:21.979 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.980+0000 7f1f2d864780 1 < canceled part key=_multipart_WIIU8VTCLWOD.2~1MQ1R3COYV71.0 size=514670 2024-09-12T00:34:21.981 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.982+0000 7f1f2d864780 1 < canceled multipart upload key=WIIU8VTCLWOD upload=1MQ1R3COYV71 tag=D1J0V0NFSS39 type=write size=1563246 2024-09-12T00:34:21.982 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.983+0000 7f1f2d864780 1 > prepared operation key=FFG41OYEYFZA tag=B20KNI0K0UWQ type=del size=2907381 2024-09-12T00:34:21.983 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.984+0000 7f1f2d864780 1 < completed part key=_multipart_S5DVMA14N7VJ.2~YK4NW2WU9UZ4.0 size=1048576 2024-09-12T00:34:21.984 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.985+0000 7f1f2d864780 1 < completed part key=_multipart_S5DVMA14N7VJ.2~YK4NW2WU9UZ4.1 size=344065 2024-09-12T00:34:21.985 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.987+0000 7f1f2d864780 1 < completed multipart upload key=S5DVMA14N7VJ upload=YK4NW2WU9UZ4 tag=E868RFICYSM7 type=write size=2441217 2024-09-12T00:34:21.986 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.988+0000 7f1f2d864780 1 > prepared operation key=ZYNIJH0TTSM6 tag=Z913RBKG6DQ1 type=write size=472940 2024-09-12T00:34:21.988 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.990+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~AXALCC472EKH.0 size=1048576 2024-09-12T00:34:21.989 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.991+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~AXALCC472EKH.1 size=221466 2024-09-12T00:34:21.992 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.993+0000 7f1f2d864780 1 < completed multipart upload key=WGKEA4EKF5GP upload=AXALCC472EKH tag=YDCB7IROOORW type=write size=2318618 2024-09-12T00:34:21.994 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.996+0000 7f1f2d864780 1 > prepared operation key=0DSQOFS8IIF5 tag=H3BVO9IOMLRS type=del size=20881 2024-09-12T00:34:21.995 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.997+0000 7f1f2d864780 1 < completed delete operation key=N9RQIGHVL8VP tag=6VRER24B4GCS type=del 2024-09-12T00:34:21.997 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:21.999+0000 7f1f2d864780 1 > prepared operation key=4FRVL0KXN2X8 tag=S7IRRIKV7K3I type=del size=3688453 2024-09-12T00:34:21.998 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.000+0000 7f1f2d864780 1 < completed part key=_multipart_SNCGB6Z20450.2~9BX6LTLF3W3L.0 size=1048576 2024-09-12T00:34:21.999 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.001+0000 7f1f2d864780 1 < completed part key=_multipart_SNCGB6Z20450.2~9BX6LTLF3W3L.1 size=792051 2024-09-12T00:34:22.001 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.003+0000 7f1f2d864780 1 < completed multipart upload key=SNCGB6Z20450 upload=9BX6LTLF3W3L tag=KY70PBVYSBFB type=write size=2889203 2024-09-12T00:34:22.002 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.004+0000 7f1f2d864780 1 > prepared operation key=ZYNIJH0TTSM6 tag=HCQ3VD0YSEHQ type=del size=3295794 2024-09-12T00:34:22.003 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.005+0000 7f1f2d864780 1 < completed write operation key=3Z1TGGPZKJ69 tag=Z1359SPUDE9C type=write size=996597 2024-09-12T00:34:22.005 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.007+0000 7f1f2d864780 1 > prepared operation key=2G3UCYG4R4NM tag=3ODJQTC818OZ type=del size=4155179 2024-09-12T00:34:22.006 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.008+0000 7f1f2d864780 1 < completed delete operation key=SNCGB6Z20450 tag=M2MV7OFWL50P type=del 2024-09-12T00:34:22.007 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.009+0000 7f1f2d864780 1 > prepared operation key=W6U30X4HJCB1 tag=X90CBYV2S32Z type=del size=3196563 2024-09-12T00:34:22.008 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.010+0000 7f1f2d864780 1 < completed delete operation key=UTR2UUO6DHLJ tag=I3BG6DLHIEQT type=del 2024-09-12T00:34:22.010 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.012+0000 7f1f2d864780 1 > prepared part key=_multipart_SNCGB6Z20450.2~05V722JQ1TES.0 size=1048576 2024-09-12T00:34:22.011 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.013+0000 7f1f2d864780 1 > prepared part key=_multipart_SNCGB6Z20450.2~05V722JQ1TES.1 size=1048576 2024-09-12T00:34:22.012 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.014+0000 7f1f2d864780 1 > prepared part key=_multipart_SNCGB6Z20450.2~05V722JQ1TES.2 size=192941 2024-09-12T00:34:22.012 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.014+0000 7f1f2d864780 1 > prepared multipart upload key=SNCGB6Z20450 upload=05V722JQ1TES tag=1Q15K57LNYYR type=write size=3338669 2024-09-12T00:34:22.014 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.015+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~QC91974T6A4L.0 size=1048576 2024-09-12T00:34:22.015 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.016+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~QC91974T6A4L.1 size=1048576 2024-09-12T00:34:22.016 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.017+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~QC91974T6A4L.2 size=923909 2024-09-12T00:34:22.018 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.019+0000 7f1f2d864780 1 < completed multipart upload key=SZP418NVZ5VX upload=QC91974T6A4L tag=QJI2ANWZT30H type=write size=4069637 2024-09-12T00:34:22.019 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.020+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=8FFTW0UQJBLC type=del size=3307731 2024-09-12T00:34:22.020 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.022+0000 7f1f2d864780 1 < completed delete operation key=0DSQOFS8IIF5 tag=LZG18SQVYFD9 type=del 2024-09-12T00:34:22.021 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.023+0000 7f1f2d864780 1 > prepared operation key=2YCGIJRK6MUH tag=Q04H7A95ZS2T type=del size=3963790 2024-09-12T00:34:22.022 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.024+0000 7f1f2d864780 1 < completed part key=_multipart_GSPM8N0K7ODC.2~XIC5YG1CJV6V.0 size=1048576 2024-09-12T00:34:22.023 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.025+0000 7f1f2d864780 1 < completed part key=_multipart_GSPM8N0K7ODC.2~XIC5YG1CJV6V.1 size=1048576 2024-09-12T00:34:22.024 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.026+0000 7f1f2d864780 1 < completed part key=_multipart_GSPM8N0K7ODC.2~XIC5YG1CJV6V.2 size=963382 2024-09-12T00:34:22.026 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.028+0000 7f1f2d864780 1 < completed multipart upload key=GSPM8N0K7ODC upload=XIC5YG1CJV6V tag=393J53X0LPRH type=write size=4109110 2024-09-12T00:34:22.028 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.030+0000 7f1f2d864780 1 > prepared part key=_multipart_N9RQIGHVL8VP.2~7A0VMRCHP3AQ.0 size=1048576 2024-09-12T00:34:22.029 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.030+0000 7f1f2d864780 1 > prepared part key=_multipart_N9RQIGHVL8VP.2~7A0VMRCHP3AQ.1 size=1048576 2024-09-12T00:34:22.030 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.031+0000 7f1f2d864780 1 > prepared part key=_multipart_N9RQIGHVL8VP.2~7A0VMRCHP3AQ.2 size=749947 2024-09-12T00:34:22.030 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.031+0000 7f1f2d864780 1 > prepared multipart upload key=N9RQIGHVL8VP upload=7A0VMRCHP3AQ tag=O6PP714EENLF type=write size=3895675 2024-09-12T00:34:22.031 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.032+0000 7f1f2d864780 1 < completed part key=_multipart_ZYNIJH0TTSM6.2~DOZLW9G67GUQ.0 size=1048576 2024-09-12T00:34:22.032 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.033+0000 7f1f2d864780 1 < completed part key=_multipart_ZYNIJH0TTSM6.2~DOZLW9G67GUQ.1 size=580445 2024-09-12T00:34:22.034 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.035+0000 7f1f2d864780 1 < completed multipart upload key=ZYNIJH0TTSM6 upload=DOZLW9G67GUQ tag=PIQTU8Q7MKQJ type=write size=2677597 2024-09-12T00:34:22.035 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.037+0000 7f1f2d864780 1 > prepared part key=_multipart_DYKLAY6J018G.2~4JBLXDZF0JV3.0 size=1048576 2024-09-12T00:34:22.036 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.038+0000 7f1f2d864780 1 > prepared part key=_multipart_DYKLAY6J018G.2~4JBLXDZF0JV3.1 size=1048576 2024-09-12T00:34:22.037 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.039+0000 7f1f2d864780 1 > prepared part key=_multipart_DYKLAY6J018G.2~4JBLXDZF0JV3.2 size=671268 2024-09-12T00:34:22.037 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.039+0000 7f1f2d864780 1 > prepared multipart upload key=DYKLAY6J018G upload=4JBLXDZF0JV3 tag=AF1JRH7GGNZR type=write size=3816996 2024-09-12T00:34:22.039 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.041+0000 7f1f2d864780 1 < suggested remove operation key=WGKEA4EKF5GP tag=XIVYPJ5TBMXX type=write 2024-09-12T00:34:22.040 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.042+0000 7f1f2d864780 1 > prepared operation key=0DSQOFS8IIF5 tag=XBXF43WYCW0U type=write size=254000 2024-09-12T00:34:22.042 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.043+0000 7f1f2d864780 1 < completed write operation key=ZGO887JDR627 tag=GM7FZG60QR90 type=write size=862234 2024-09-12T00:34:22.044 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.045+0000 7f1f2d864780 1 > prepared part key=_multipart_ZYNIJH0TTSM6.2~0BAMIPGZ7XXD.0 size=1048576 2024-09-12T00:34:22.044 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.046+0000 7f1f2d864780 1 > prepared part key=_multipart_ZYNIJH0TTSM6.2~0BAMIPGZ7XXD.1 size=1048576 2024-09-12T00:34:22.045 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.047+0000 7f1f2d864780 1 > prepared part key=_multipart_ZYNIJH0TTSM6.2~0BAMIPGZ7XXD.2 size=407577 2024-09-12T00:34:22.045 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.047+0000 7f1f2d864780 1 > prepared multipart upload key=ZYNIJH0TTSM6 upload=0BAMIPGZ7XXD tag=GRVD95VTENN5 type=write size=3553305 2024-09-12T00:34:22.046 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.048+0000 7f1f2d864780 1 < completed part key=_multipart_ZGO887JDR627.2~VKQJHIC1Z1NA.0 size=1048576 2024-09-12T00:34:22.047 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.049+0000 7f1f2d864780 1 < completed part key=_multipart_ZGO887JDR627.2~VKQJHIC1Z1NA.1 size=1048576 2024-09-12T00:34:22.047 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.049+0000 7f1f2d864780 1 < canceled part key=_multipart_ZGO887JDR627.2~VKQJHIC1Z1NA.2 size=435245 2024-09-12T00:34:22.049 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.051+0000 7f1f2d864780 1 < canceled multipart upload key=ZGO887JDR627 upload=VKQJHIC1Z1NA tag=41FBWSZHRHJ3 type=write size=3580973 2024-09-12T00:34:22.051 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.053+0000 7f1f2d864780 1 > prepared operation key=SNCGB6Z20450 tag=OOR8E8WXMZV4 type=del size=4157124 2024-09-12T00:34:22.052 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.054+0000 7f1f2d864780 1 < completed part key=_multipart_DYKLAY6J018G.2~S1FJKMMUMA1P.0 size=352700 2024-09-12T00:34:22.054 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.056+0000 7f1f2d864780 1 < completed multipart upload key=DYKLAY6J018G upload=S1FJKMMUMA1P tag=3CRT19G3P0IL type=write size=1401276 2024-09-12T00:34:22.056 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.058+0000 7f1f2d864780 1 > prepared part key=_multipart_ZYNIJH0TTSM6.2~QF508O5RBIJ9.0 size=1048576 2024-09-12T00:34:22.057 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.059+0000 7f1f2d864780 1 > prepared part key=_multipart_ZYNIJH0TTSM6.2~QF508O5RBIJ9.1 size=490810 2024-09-12T00:34:22.057 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.059+0000 7f1f2d864780 1 > prepared multipart upload key=ZYNIJH0TTSM6 upload=QF508O5RBIJ9 tag=S325X2GZI7XA type=write size=2587962 2024-09-12T00:34:22.058 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.060+0000 7f1f2d864780 1 < completed delete operation key=FFG41OYEYFZA tag=B20KNI0K0UWQ type=del 2024-09-12T00:34:22.060 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.062+0000 7f1f2d864780 1 > prepared part key=_multipart_N9RQIGHVL8VP.2~9Y9GHINS7FFA.0 size=155103 2024-09-12T00:34:22.060 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.062+0000 7f1f2d864780 1 > prepared multipart upload key=N9RQIGHVL8VP upload=9Y9GHINS7FFA tag=PC32BLKZWN6T type=write size=1203679 2024-09-12T00:34:22.062 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.063+0000 7f1f2d864780 1 < completed write operation key=ZYNIJH0TTSM6 tag=Z913RBKG6DQ1 type=write size=472940 2024-09-12T00:34:22.063 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.064+0000 7f1f2d864780 1 > prepared operation key=2YCGIJRK6MUH tag=M5NAG1FBF045 type=del size=1451917 2024-09-12T00:34:22.064 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.066+0000 7f1f2d864780 1 < completed delete operation key=0DSQOFS8IIF5 tag=H3BVO9IOMLRS type=del 2024-09-12T00:34:22.066 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.068+0000 7f1f2d864780 1 > prepared part key=_multipart_2G3UCYG4R4NM.2~9T08YHBF9KML.0 size=1048576 2024-09-12T00:34:22.067 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.069+0000 7f1f2d864780 1 > prepared part key=_multipart_2G3UCYG4R4NM.2~9T08YHBF9KML.1 size=1048576 2024-09-12T00:34:22.068 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.070+0000 7f1f2d864780 1 > prepared part key=_multipart_2G3UCYG4R4NM.2~9T08YHBF9KML.2 size=773748 2024-09-12T00:34:22.069 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.070+0000 7f1f2d864780 1 > prepared multipart upload key=2G3UCYG4R4NM upload=9T08YHBF9KML tag=KBUN5NBMSF7E type=write size=3919476 2024-09-12T00:34:22.070 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.071+0000 7f1f2d864780 1 < canceled operation key=4FRVL0KXN2X8 tag=S7IRRIKV7K3I type=del size=3688453 2024-09-12T00:34:22.070 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.072+0000 7f1f2d864780 1 > prepared operation key=UTR2UUO6DHLJ tag=WRXE4KTNK7QW type=write size=574586 2024-09-12T00:34:22.072 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.073+0000 7f1f2d864780 1 < completed delete operation key=ZYNIJH0TTSM6 tag=HCQ3VD0YSEHQ type=del 2024-09-12T00:34:22.073 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.074+0000 7f1f2d864780 1 > prepared operation key=N9RQIGHVL8VP tag=BWLBBEQCQE4U type=write size=48065 2024-09-12T00:34:22.075 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.077+0000 7f1f2d864780 1 < suggested remove operation key=2G3UCYG4R4NM tag=3ODJQTC818OZ type=del 2024-09-12T00:34:22.076 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.078+0000 7f1f2d864780 1 > prepared operation key=KHPF1N1MT33Z tag=BG7T2Z4UB1R5 type=del size=2254915 2024-09-12T00:34:22.077 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.079+0000 7f1f2d864780 1 < canceled operation key=W6U30X4HJCB1 tag=X90CBYV2S32Z type=del size=3196563 2024-09-12T00:34:22.078 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.080+0000 7f1f2d864780 1 > prepared operation key=SZP418NVZ5VX tag=Y8ZJ5O4BU249 type=del size=3629546 2024-09-12T00:34:22.080 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.081+0000 7f1f2d864780 1 < completed part key=_multipart_SNCGB6Z20450.2~05V722JQ1TES.0 size=1048576 2024-09-12T00:34:22.081 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.082+0000 7f1f2d864780 1 < completed part key=_multipart_SNCGB6Z20450.2~05V722JQ1TES.1 size=1048576 2024-09-12T00:34:22.082 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.083+0000 7f1f2d864780 1 < completed part key=_multipart_SNCGB6Z20450.2~05V722JQ1TES.2 size=192941 2024-09-12T00:34:22.084 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.085+0000 7f1f2d864780 1 < completed multipart upload key=SNCGB6Z20450 upload=05V722JQ1TES tag=1Q15K57LNYYR type=write size=3338669 2024-09-12T00:34:22.085 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.086+0000 7f1f2d864780 1 > prepared operation key=MSGU3PHLBRJH tag=OLHMW6J2VNAM type=del size=1656000 2024-09-12T00:34:22.086 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.087+0000 7f1f2d864780 1 < completed delete operation key=2RV0899QUJ8W tag=8FFTW0UQJBLC type=del 2024-09-12T00:34:22.088 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.090+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~NXR9TUE7PY2G.0 size=1048576 2024-09-12T00:34:22.089 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.091+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~NXR9TUE7PY2G.1 size=671665 2024-09-12T00:34:22.089 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.091+0000 7f1f2d864780 1 > prepared multipart upload key=SZP418NVZ5VX upload=NXR9TUE7PY2G tag=KPIYI5E0CT3K type=write size=2768817 2024-09-12T00:34:22.091 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.093+0000 7f1f2d864780 1 < suggested remove operation key=2YCGIJRK6MUH tag=Q04H7A95ZS2T type=del 2024-09-12T00:34:22.093 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.095+0000 7f1f2d864780 1 > prepared part key=_multipart_UTR2UUO6DHLJ.2~GFYZYYEZEGCO.0 size=1048576 2024-09-12T00:34:22.094 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.096+0000 7f1f2d864780 1 > prepared part key=_multipart_UTR2UUO6DHLJ.2~GFYZYYEZEGCO.1 size=570740 2024-09-12T00:34:22.094 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.096+0000 7f1f2d864780 1 > prepared multipart upload key=UTR2UUO6DHLJ upload=GFYZYYEZEGCO tag=SDQGMKAE55FN type=write size=2667892 2024-09-12T00:34:22.095 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.097+0000 7f1f2d864780 1 < completed part key=_multipart_N9RQIGHVL8VP.2~7A0VMRCHP3AQ.0 size=1048576 2024-09-12T00:34:22.096 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.098+0000 7f1f2d864780 1 < completed part key=_multipart_N9RQIGHVL8VP.2~7A0VMRCHP3AQ.1 size=1048576 2024-09-12T00:34:22.100 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.099+0000 7f1f2d864780 1 < completed part key=_multipart_N9RQIGHVL8VP.2~7A0VMRCHP3AQ.2 size=749947 2024-09-12T00:34:22.101 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.102+0000 7f1f2d864780 1 < completed multipart upload key=N9RQIGHVL8VP upload=7A0VMRCHP3AQ tag=O6PP714EENLF type=write size=3895675 2024-09-12T00:34:22.101 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.103+0000 7f1f2d864780 1 > prepared operation key=WIIU8VTCLWOD tag=3644AJ2WRYN4 type=del size=3287241 2024-09-12T00:34:22.103 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.104+0000 7f1f2d864780 1 < completed part key=_multipart_DYKLAY6J018G.2~4JBLXDZF0JV3.0 size=1048576 2024-09-12T00:34:22.103 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.105+0000 7f1f2d864780 1 < completed part key=_multipart_DYKLAY6J018G.2~4JBLXDZF0JV3.1 size=1048576 2024-09-12T00:34:22.104 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.106+0000 7f1f2d864780 1 < completed part key=_multipart_DYKLAY6J018G.2~4JBLXDZF0JV3.2 size=671268 2024-09-12T00:34:22.106 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.108+0000 7f1f2d864780 1 < completed multipart upload key=DYKLAY6J018G upload=4JBLXDZF0JV3 tag=AF1JRH7GGNZR type=write size=3816996 2024-09-12T00:34:22.108 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.110+0000 7f1f2d864780 1 > prepared part key=_multipart_MSGU3PHLBRJH.2~FUL85SW9GNC8.0 size=1048576 2024-09-12T00:34:22.109 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.111+0000 7f1f2d864780 1 > prepared part key=_multipart_MSGU3PHLBRJH.2~FUL85SW9GNC8.1 size=1048576 2024-09-12T00:34:22.110 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.112+0000 7f1f2d864780 1 > prepared part key=_multipart_MSGU3PHLBRJH.2~FUL85SW9GNC8.2 size=566960 2024-09-12T00:34:22.110 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.112+0000 7f1f2d864780 1 > prepared multipart upload key=MSGU3PHLBRJH upload=FUL85SW9GNC8 tag=5FX2M05CXE3C type=write size=3712688 2024-09-12T00:34:22.111 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.113+0000 7f1f2d864780 1 < canceled operation key=0DSQOFS8IIF5 tag=XBXF43WYCW0U type=write size=254000 2024-09-12T00:34:22.113 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.115+0000 7f1f2d864780 1 > prepared part key=_multipart_PVB52GO6L8T4.2~KA9Y3T2SJ3RH.0 size=1048576 2024-09-12T00:34:22.114 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.116+0000 7f1f2d864780 1 > prepared part key=_multipart_PVB52GO6L8T4.2~KA9Y3T2SJ3RH.1 size=151956 2024-09-12T00:34:22.114 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.116+0000 7f1f2d864780 1 > prepared multipart upload key=PVB52GO6L8T4 upload=KA9Y3T2SJ3RH tag=VBTPNOFPYA7N type=write size=2249108 2024-09-12T00:34:22.115 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.117+0000 7f1f2d864780 1 < completed part key=_multipart_ZYNIJH0TTSM6.2~0BAMIPGZ7XXD.0 size=1048576 2024-09-12T00:34:22.116 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.118+0000 7f1f2d864780 1 < completed part key=_multipart_ZYNIJH0TTSM6.2~0BAMIPGZ7XXD.1 size=1048576 2024-09-12T00:34:22.117 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.119+0000 7f1f2d864780 1 < completed part key=_multipart_ZYNIJH0TTSM6.2~0BAMIPGZ7XXD.2 size=407577 2024-09-12T00:34:22.119 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.121+0000 7f1f2d864780 1 < completed multipart upload key=ZYNIJH0TTSM6 upload=0BAMIPGZ7XXD tag=GRVD95VTENN5 type=write size=3553305 2024-09-12T00:34:22.121 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.122+0000 7f1f2d864780 1 > prepared operation key=WGKEA4EKF5GP tag=M3BB23E55UCU type=del size=1883846 2024-09-12T00:34:22.122 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.123+0000 7f1f2d864780 1 < canceled operation key=SNCGB6Z20450 tag=OOR8E8WXMZV4 type=del size=4157124 2024-09-12T00:34:22.123 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.125+0000 7f1f2d864780 1 > prepared operation key=FAP6N3H7SBN0 tag=VMABGBKCDBMK type=del size=687885 2024-09-12T00:34:22.123 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.125+0000 7f1f2d864780 1 < canceled part key=_multipart_ZYNIJH0TTSM6.2~QF508O5RBIJ9.0 size=1048576 2024-09-12T00:34:22.124 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.126+0000 7f1f2d864780 1 < completed part key=_multipart_ZYNIJH0TTSM6.2~QF508O5RBIJ9.1 size=490810 2024-09-12T00:34:22.126 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.128+0000 7f1f2d864780 1 < canceled multipart upload key=ZYNIJH0TTSM6 upload=QF508O5RBIJ9 tag=S325X2GZI7XA type=write size=2587962 2024-09-12T00:34:22.130 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.132+0000 7f1f2d864780 1 > prepared part key=_multipart_SNCGB6Z20450.2~EVU9PM1D2FDH.0 size=1048576 2024-09-12T00:34:22.131 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.132+0000 7f1f2d864780 1 > prepared part key=_multipart_SNCGB6Z20450.2~EVU9PM1D2FDH.1 size=626170 2024-09-12T00:34:22.131 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.132+0000 7f1f2d864780 1 > prepared multipart upload key=SNCGB6Z20450 upload=EVU9PM1D2FDH tag=71MLTZJD0O33 type=write size=2723322 2024-09-12T00:34:22.132 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.134+0000 7f1f2d864780 1 < completed part key=_multipart_N9RQIGHVL8VP.2~9Y9GHINS7FFA.0 size=155103 2024-09-12T00:34:22.134 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.136+0000 7f1f2d864780 1 < completed multipart upload key=N9RQIGHVL8VP upload=9Y9GHINS7FFA tag=PC32BLKZWN6T type=write size=1203679 2024-09-12T00:34:22.135 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.137+0000 7f1f2d864780 1 > prepared operation key=SNCGB6Z20450 tag=YS3PCV3I37AJ type=del size=1290385 2024-09-12T00:34:22.136 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.138+0000 7f1f2d864780 -1 < failed to complete operation key=2YCGIJRK6MUH tag=M5NAG1FBF045 type=del size=1451917: (22) Invalid argument 2024-09-12T00:34:22.137 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.139+0000 7f1f2d864780 1 > prepared operation key=WIIU8VTCLWOD tag=WMUN0G1GVB3Z type=del size=2954668 2024-09-12T00:34:22.138 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.140+0000 7f1f2d864780 1 < completed part key=_multipart_2G3UCYG4R4NM.2~9T08YHBF9KML.0 size=1048576 2024-09-12T00:34:22.139 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.141+0000 7f1f2d864780 1 < completed part key=_multipart_2G3UCYG4R4NM.2~9T08YHBF9KML.1 size=1048576 2024-09-12T00:34:22.140 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.142+0000 7f1f2d864780 1 < completed part key=_multipart_2G3UCYG4R4NM.2~9T08YHBF9KML.2 size=773748 2024-09-12T00:34:22.142 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.144+0000 7f1f2d864780 1 < completed multipart upload key=2G3UCYG4R4NM upload=9T08YHBF9KML tag=KBUN5NBMSF7E type=write size=3919476 2024-09-12T00:34:22.143 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.145+0000 7f1f2d864780 1 > prepared operation key=9XK59MVZ5G1O tag=EZONLNF80GY0 type=del size=876866 2024-09-12T00:34:22.144 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.146+0000 7f1f2d864780 1 < completed write operation key=UTR2UUO6DHLJ tag=WRXE4KTNK7QW type=write size=574586 2024-09-12T00:34:22.146 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.148+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~M1761XHNF80Z.0 size=1048576 2024-09-12T00:34:22.147 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.149+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~M1761XHNF80Z.1 size=1048576 2024-09-12T00:34:22.148 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.150+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~M1761XHNF80Z.2 size=678144 2024-09-12T00:34:22.148 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.150+0000 7f1f2d864780 1 > prepared multipart upload key=4FRVL0KXN2X8 upload=M1761XHNF80Z tag=UA9NB1O757RF type=write size=3823872 2024-09-12T00:34:22.149 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.151+0000 7f1f2d864780 1 < completed write operation key=N9RQIGHVL8VP tag=BWLBBEQCQE4U type=write size=48065 2024-09-12T00:34:22.150 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.152+0000 7f1f2d864780 1 > prepared operation key=2G3UCYG4R4NM tag=WB3OLZH06W0P type=del size=3499431 2024-09-12T00:34:22.153 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.154+0000 7f1f2d864780 1 < suggested update operation key=KHPF1N1MT33Z tag=BG7T2Z4UB1R5 type=del size=2254915 2024-09-12T00:34:22.154 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.155+0000 7f1f2d864780 1 > prepared operation key=53QCNWX1V1R1 tag=YOE8PKWEU6Q4 type=del size=237939 2024-09-12T00:34:22.155 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.157+0000 7f1f2d864780 1 < completed delete operation key=SZP418NVZ5VX tag=Y8ZJ5O4BU249 type=del 2024-09-12T00:34:22.156 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.158+0000 7f1f2d864780 1 > prepared operation key=1299IOSGYIO9 tag=S5QK9M4GEI6E type=del size=2502352 2024-09-12T00:34:22.157 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.159+0000 7f1f2d864780 1 < completed delete operation key=MSGU3PHLBRJH tag=OLHMW6J2VNAM type=del 2024-09-12T00:34:22.158 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.160+0000 7f1f2d864780 1 > prepared operation key=S5DVMA14N7VJ tag=S8EX6ZDN9OBP type=del size=746303 2024-09-12T00:34:22.159 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.161+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~NXR9TUE7PY2G.0 size=1048576 2024-09-12T00:34:22.160 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.161+0000 7f1f2d864780 1 < canceled part key=_multipart_SZP418NVZ5VX.2~NXR9TUE7PY2G.1 size=671665 2024-09-12T00:34:22.161 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.163+0000 7f1f2d864780 1 < canceled multipart upload key=SZP418NVZ5VX upload=NXR9TUE7PY2G tag=KPIYI5E0CT3K type=write size=2768817 2024-09-12T00:34:22.163 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.165+0000 7f1f2d864780 1 > prepared part key=_multipart_MSGU3PHLBRJH.2~IH3OGD2B0I4I.0 size=1048576 2024-09-12T00:34:22.164 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.166+0000 7f1f2d864780 1 > prepared part key=_multipart_MSGU3PHLBRJH.2~IH3OGD2B0I4I.1 size=1048576 2024-09-12T00:34:22.165 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.167+0000 7f1f2d864780 1 > prepared part key=_multipart_MSGU3PHLBRJH.2~IH3OGD2B0I4I.2 size=590210 2024-09-12T00:34:22.165 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.167+0000 7f1f2d864780 1 > prepared multipart upload key=MSGU3PHLBRJH upload=IH3OGD2B0I4I tag=02774SH298EJ type=write size=3735938 2024-09-12T00:34:22.166 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.167+0000 7f1f2d864780 1 < canceled part key=_multipart_UTR2UUO6DHLJ.2~GFYZYYEZEGCO.0 size=1048576 2024-09-12T00:34:22.166 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.168+0000 7f1f2d864780 1 < completed part key=_multipart_UTR2UUO6DHLJ.2~GFYZYYEZEGCO.1 size=570740 2024-09-12T00:34:22.168 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.170+0000 7f1f2d864780 1 < canceled multipart upload key=UTR2UUO6DHLJ upload=GFYZYYEZEGCO tag=SDQGMKAE55FN type=write size=2667892 2024-09-12T00:34:22.170 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.171+0000 7f1f2d864780 1 > prepared operation key=ECZYQEZ942W8 tag=1PDBJ3CVM9F3 type=del size=1816820 2024-09-12T00:34:22.171 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.172+0000 7f1f2d864780 1 < completed delete operation key=WIIU8VTCLWOD tag=3644AJ2WRYN4 type=del 2024-09-12T00:34:22.172 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.174+0000 7f1f2d864780 1 > prepared operation key=FFG41OYEYFZA tag=RMXZ2GA0DOQR type=del size=2338560 2024-09-12T00:34:22.173 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.175+0000 7f1f2d864780 1 < completed part key=_multipart_MSGU3PHLBRJH.2~FUL85SW9GNC8.0 size=1048576 2024-09-12T00:34:22.174 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.176+0000 7f1f2d864780 1 < completed part key=_multipart_MSGU3PHLBRJH.2~FUL85SW9GNC8.1 size=1048576 2024-09-12T00:34:22.175 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.177+0000 7f1f2d864780 1 < completed part key=_multipart_MSGU3PHLBRJH.2~FUL85SW9GNC8.2 size=566960 2024-09-12T00:34:22.177 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.179+0000 7f1f2d864780 1 < completed multipart upload key=MSGU3PHLBRJH upload=FUL85SW9GNC8 tag=5FX2M05CXE3C type=write size=3712688 2024-09-12T00:34:22.179 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.181+0000 7f1f2d864780 1 > prepared part key=_multipart_2YCGIJRK6MUH.2~SGKPS8PB52AZ.0 size=1048576 2024-09-12T00:34:22.180 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.182+0000 7f1f2d864780 1 > prepared part key=_multipart_2YCGIJRK6MUH.2~SGKPS8PB52AZ.1 size=873924 2024-09-12T00:34:22.180 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.182+0000 7f1f2d864780 1 > prepared multipart upload key=2YCGIJRK6MUH upload=SGKPS8PB52AZ tag=VWYPMITTF1MK type=write size=2971076 2024-09-12T00:34:22.181 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.183+0000 7f1f2d864780 1 < completed part key=_multipart_PVB52GO6L8T4.2~KA9Y3T2SJ3RH.0 size=1048576 2024-09-12T00:34:22.182 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.184+0000 7f1f2d864780 1 < completed part key=_multipart_PVB52GO6L8T4.2~KA9Y3T2SJ3RH.1 size=151956 2024-09-12T00:34:22.184 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.186+0000 7f1f2d864780 1 < completed multipart upload key=PVB52GO6L8T4 upload=KA9Y3T2SJ3RH tag=VBTPNOFPYA7N type=write size=2249108 2024-09-12T00:34:22.186 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.188+0000 7f1f2d864780 1 > prepared part key=_multipart_FFG41OYEYFZA.2~GB25XFYL3S7I.0 size=1048576 2024-09-12T00:34:22.187 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.189+0000 7f1f2d864780 1 > prepared part key=_multipart_FFG41OYEYFZA.2~GB25XFYL3S7I.1 size=1048576 2024-09-12T00:34:22.189 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.190+0000 7f1f2d864780 1 > prepared part key=_multipart_FFG41OYEYFZA.2~GB25XFYL3S7I.2 size=671315 2024-09-12T00:34:22.189 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.190+0000 7f1f2d864780 1 > prepared multipart upload key=FFG41OYEYFZA upload=GB25XFYL3S7I tag=W91JDM553N6E type=write size=3817043 2024-09-12T00:34:22.190 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.192+0000 7f1f2d864780 1 < completed delete operation key=WGKEA4EKF5GP tag=M3BB23E55UCU type=del 2024-09-12T00:34:22.191 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.193+0000 7f1f2d864780 1 > prepared operation key=MSGU3PHLBRJH tag=5M5L2QOLVXW2 type=write size=136249 2024-09-12T00:34:22.192 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.194+0000 7f1f2d864780 1 < completed delete operation key=FAP6N3H7SBN0 tag=VMABGBKCDBMK type=del 2024-09-12T00:34:22.194 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.195+0000 7f1f2d864780 1 > prepared operation key=FAP6N3H7SBN0 tag=CAAWL35H8PQH type=del size=2654191 2024-09-12T00:34:22.195 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.197+0000 7f1f2d864780 1 < completed part key=_multipart_SNCGB6Z20450.2~EVU9PM1D2FDH.0 size=1048576 2024-09-12T00:34:22.196 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.198+0000 7f1f2d864780 1 < completed part key=_multipart_SNCGB6Z20450.2~EVU9PM1D2FDH.1 size=626170 2024-09-12T00:34:22.198 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.199+0000 7f1f2d864780 1 < completed multipart upload key=SNCGB6Z20450 upload=EVU9PM1D2FDH tag=71MLTZJD0O33 type=write size=2723322 2024-09-12T00:34:22.200 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.202+0000 7f1f2d864780 1 > prepared part key=_multipart_2RV0899QUJ8W.2~VP1B7YEDA8TM.0 size=1048576 2024-09-12T00:34:22.201 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.202+0000 7f1f2d864780 1 > prepared part key=_multipart_2RV0899QUJ8W.2~VP1B7YEDA8TM.1 size=1048576 2024-09-12T00:34:22.202 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.203+0000 7f1f2d864780 1 > prepared part key=_multipart_2RV0899QUJ8W.2~VP1B7YEDA8TM.2 size=461825 2024-09-12T00:34:22.202 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.203+0000 7f1f2d864780 1 > prepared multipart upload key=2RV0899QUJ8W upload=VP1B7YEDA8TM tag=JXK4D25UB0TG type=write size=3607553 2024-09-12T00:34:22.203 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.205+0000 7f1f2d864780 1 < completed delete operation key=SNCGB6Z20450 tag=YS3PCV3I37AJ type=del 2024-09-12T00:34:22.204 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.206+0000 7f1f2d864780 1 > prepared operation key=SZP418NVZ5VX tag=281EKTYG16L1 type=del size=3526699 2024-09-12T00:34:22.206 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.208+0000 7f1f2d864780 1 < suggested remove operation key=WIIU8VTCLWOD tag=WMUN0G1GVB3Z type=del 2024-09-12T00:34:22.208 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.210+0000 7f1f2d864780 1 > prepared operation key=D21W9QZWY0YU tag=2OI7AI5MZU9R type=del size=3264030 2024-09-12T00:34:22.209 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.211+0000 7f1f2d864780 1 < completed delete operation key=9XK59MVZ5G1O tag=EZONLNF80GY0 type=del 2024-09-12T00:34:22.212 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.213+0000 7f1f2d864780 1 > prepared part key=_multipart_S5DVMA14N7VJ.2~IELOJHXL9LAM.0 size=1048576 2024-09-12T00:34:22.213 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.214+0000 7f1f2d864780 1 > prepared part key=_multipart_S5DVMA14N7VJ.2~IELOJHXL9LAM.1 size=69154 2024-09-12T00:34:22.213 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.214+0000 7f1f2d864780 1 > prepared multipart upload key=S5DVMA14N7VJ upload=IELOJHXL9LAM tag=CPAYFBJUY4PH type=write size=2166306 2024-09-12T00:34:22.214 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.215+0000 7f1f2d864780 1 < completed part key=_multipart_4FRVL0KXN2X8.2~M1761XHNF80Z.0 size=1048576 2024-09-12T00:34:22.214 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.215+0000 7f1f2d864780 1 < canceled part key=_multipart_4FRVL0KXN2X8.2~M1761XHNF80Z.1 size=1048576 2024-09-12T00:34:22.215 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.216+0000 7f1f2d864780 1 < completed part key=_multipart_4FRVL0KXN2X8.2~M1761XHNF80Z.2 size=678144 2024-09-12T00:34:22.217 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.218+0000 7f1f2d864780 1 < canceled multipart upload key=4FRVL0KXN2X8 upload=M1761XHNF80Z tag=UA9NB1O757RF type=write size=3823872 2024-09-12T00:34:22.219 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.221+0000 7f1f2d864780 1 > prepared part key=_multipart_ZYNIJH0TTSM6.2~DY9QU85YF2B5.0 size=1048576 2024-09-12T00:34:22.220 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.222+0000 7f1f2d864780 1 > prepared part key=_multipart_ZYNIJH0TTSM6.2~DY9QU85YF2B5.1 size=915904 2024-09-12T00:34:22.220 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.222+0000 7f1f2d864780 1 > prepared multipart upload key=ZYNIJH0TTSM6 upload=DY9QU85YF2B5 tag=8PTGGG0KMIOO type=write size=3013056 2024-09-12T00:34:22.221 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.223+0000 7f1f2d864780 1 < canceled operation key=2G3UCYG4R4NM tag=WB3OLZH06W0P type=del size=3499431 2024-09-12T00:34:22.222 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.224+0000 7f1f2d864780 1 > prepared operation key=SZP418NVZ5VX tag=K5INBOISG8CN type=del size=1386838 2024-09-12T00:34:22.224 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.225+0000 7f1f2d864780 1 < completed delete operation key=53QCNWX1V1R1 tag=YOE8PKWEU6Q4 type=del 2024-09-12T00:34:22.225 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.226+0000 7f1f2d864780 1 > prepared operation key=SZP418NVZ5VX tag=XWT9ZCM6FBBW type=del size=489150 2024-09-12T00:34:22.227 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.229+0000 7f1f2d864780 1 < suggested remove operation key=1299IOSGYIO9 tag=S5QK9M4GEI6E type=del 2024-09-12T00:34:22.228 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.230+0000 7f1f2d864780 1 > prepared operation key=SZP418NVZ5VX tag=Z5KFWHBXZ9X1 type=del size=3397986 2024-09-12T00:34:22.229 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.231+0000 7f1f2d864780 1 < completed delete operation key=S5DVMA14N7VJ tag=S8EX6ZDN9OBP type=del 2024-09-12T00:34:22.231 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.233+0000 7f1f2d864780 1 > prepared part key=_multipart_S5DVMA14N7VJ.2~PEVX1XXVABDD.0 size=1048576 2024-09-12T00:34:22.232 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.234+0000 7f1f2d864780 1 > prepared part key=_multipart_S5DVMA14N7VJ.2~PEVX1XXVABDD.1 size=109612 2024-09-12T00:34:22.232 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.234+0000 7f1f2d864780 1 > prepared multipart upload key=S5DVMA14N7VJ upload=PEVX1XXVABDD tag=QLW8QZ224RKM type=write size=2206764 2024-09-12T00:34:22.233 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.235+0000 7f1f2d864780 1 < completed part key=_multipart_MSGU3PHLBRJH.2~IH3OGD2B0I4I.0 size=1048576 2024-09-12T00:34:22.234 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.236+0000 7f1f2d864780 1 < completed part key=_multipart_MSGU3PHLBRJH.2~IH3OGD2B0I4I.1 size=1048576 2024-09-12T00:34:22.234 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.236+0000 7f1f2d864780 1 < canceled part key=_multipart_MSGU3PHLBRJH.2~IH3OGD2B0I4I.2 size=590210 2024-09-12T00:34:22.236 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.238+0000 7f1f2d864780 1 < canceled multipart upload key=MSGU3PHLBRJH upload=IH3OGD2B0I4I tag=02774SH298EJ type=write size=3735938 2024-09-12T00:34:22.237 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.239+0000 7f1f2d864780 1 > prepared operation key=WKK747ETLW10 tag=TMKYGKTJ8OMX type=write size=58536 2024-09-12T00:34:22.239 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.241+0000 7f1f2d864780 1 < suggested update operation key=ECZYQEZ942W8 tag=1PDBJ3CVM9F3 type=del size=1816820 2024-09-12T00:34:22.240 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.242+0000 7f1f2d864780 1 > prepared operation key=3Z1TGGPZKJ69 tag=W2LPCUK7LFND type=write size=700679 2024-09-12T00:34:22.243 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.244+0000 7f1f2d864780 1 < suggested remove operation key=FFG41OYEYFZA tag=RMXZ2GA0DOQR type=del 2024-09-12T00:34:22.244 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.246+0000 7f1f2d864780 1 > prepared operation key=DYKLAY6J018G tag=D8671CXLE5F4 type=del size=2631041 2024-09-12T00:34:22.245 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.247+0000 7f1f2d864780 1 < completed part key=_multipart_2YCGIJRK6MUH.2~SGKPS8PB52AZ.0 size=1048576 2024-09-12T00:34:22.246 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.248+0000 7f1f2d864780 1 < completed part key=_multipart_2YCGIJRK6MUH.2~SGKPS8PB52AZ.1 size=873924 2024-09-12T00:34:22.248 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.249+0000 7f1f2d864780 1 < completed multipart upload key=2YCGIJRK6MUH upload=SGKPS8PB52AZ tag=VWYPMITTF1MK type=write size=2971076 2024-09-12T00:34:22.249 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.251+0000 7f1f2d864780 1 > prepared operation key=2YCGIJRK6MUH tag=QKNG8LWWPLHU type=del size=2303132 2024-09-12T00:34:22.250 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.252+0000 7f1f2d864780 1 < completed part key=_multipart_FFG41OYEYFZA.2~GB25XFYL3S7I.0 size=1048576 2024-09-12T00:34:22.250 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.252+0000 7f1f2d864780 1 < canceled part key=_multipart_FFG41OYEYFZA.2~GB25XFYL3S7I.1 size=1048576 2024-09-12T00:34:22.251 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.253+0000 7f1f2d864780 1 < completed part key=_multipart_FFG41OYEYFZA.2~GB25XFYL3S7I.2 size=671315 2024-09-12T00:34:22.253 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.255+0000 7f1f2d864780 1 < canceled multipart upload key=FFG41OYEYFZA upload=GB25XFYL3S7I tag=W91JDM553N6E type=write size=3817043 2024-09-12T00:34:22.255 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.256+0000 7f1f2d864780 1 > prepared part key=_multipart_2YCGIJRK6MUH.2~6AI31BVZD0LN.0 size=291681 2024-09-12T00:34:22.255 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.257+0000 7f1f2d864780 1 > prepared multipart upload key=2YCGIJRK6MUH upload=6AI31BVZD0LN tag=NXMVKSU0YZXP type=write size=1340257 2024-09-12T00:34:22.256 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.258+0000 7f1f2d864780 1 < canceled operation key=MSGU3PHLBRJH tag=5M5L2QOLVXW2 type=write size=136249 2024-09-12T00:34:22.257 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.259+0000 7f1f2d864780 1 > prepared operation key=ZYNIJH0TTSM6 tag=CRCWTRAAJ4D8 type=del size=1062870 2024-09-12T00:34:22.258 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.260+0000 7f1f2d864780 1 < completed delete operation key=FAP6N3H7SBN0 tag=CAAWL35H8PQH type=del 2024-09-12T00:34:22.259 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.261+0000 7f1f2d864780 1 > prepared operation key=FAP6N3H7SBN0 tag=JQHQLBTI4JYE type=del size=3649958 2024-09-12T00:34:22.260 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.262+0000 7f1f2d864780 1 < completed part key=_multipart_2RV0899QUJ8W.2~VP1B7YEDA8TM.0 size=1048576 2024-09-12T00:34:22.261 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.263+0000 7f1f2d864780 1 < completed part key=_multipart_2RV0899QUJ8W.2~VP1B7YEDA8TM.1 size=1048576 2024-09-12T00:34:22.262 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.264+0000 7f1f2d864780 1 < completed part key=_multipart_2RV0899QUJ8W.2~VP1B7YEDA8TM.2 size=461825 2024-09-12T00:34:22.264 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.266+0000 7f1f2d864780 1 < completed multipart upload key=2RV0899QUJ8W upload=VP1B7YEDA8TM tag=JXK4D25UB0TG type=write size=3607553 2024-09-12T00:34:22.266 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.268+0000 7f1f2d864780 1 > prepared part key=_multipart_2G3UCYG4R4NM.2~ATF1OUQOPQDA.0 size=1048576 2024-09-12T00:34:22.267 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.269+0000 7f1f2d864780 1 > prepared part key=_multipart_2G3UCYG4R4NM.2~ATF1OUQOPQDA.1 size=905864 2024-09-12T00:34:22.267 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.269+0000 7f1f2d864780 1 > prepared multipart upload key=2G3UCYG4R4NM upload=ATF1OUQOPQDA tag=9B1C9EFRGE7I type=write size=3003016 2024-09-12T00:34:22.268 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.270+0000 7f1f2d864780 1 < completed delete operation key=SZP418NVZ5VX tag=281EKTYG16L1 type=del 2024-09-12T00:34:22.270 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.272+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~OIG0JTK757UK.0 size=1048576 2024-09-12T00:34:22.271 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.273+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~OIG0JTK757UK.1 size=250635 2024-09-12T00:34:22.271 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.273+0000 7f1f2d864780 1 > prepared multipart upload key=1299IOSGYIO9 upload=OIG0JTK757UK tag=71Z05AZCDL4A type=write size=2347787 2024-09-12T00:34:22.272 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.274+0000 7f1f2d864780 1 < completed delete operation key=D21W9QZWY0YU tag=2OI7AI5MZU9R type=del 2024-09-12T00:34:22.273 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.275+0000 7f1f2d864780 1 > prepared operation key=FAP6N3H7SBN0 tag=J4Q2608KSLOA type=del size=3145380 2024-09-12T00:34:22.274 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.276+0000 7f1f2d864780 1 < completed part key=_multipart_S5DVMA14N7VJ.2~IELOJHXL9LAM.0 size=1048576 2024-09-12T00:34:22.275 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.277+0000 7f1f2d864780 1 < completed part key=_multipart_S5DVMA14N7VJ.2~IELOJHXL9LAM.1 size=69154 2024-09-12T00:34:22.277 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.279+0000 7f1f2d864780 1 < completed multipart upload key=S5DVMA14N7VJ upload=IELOJHXL9LAM tag=CPAYFBJUY4PH type=write size=2166306 2024-09-12T00:34:22.279 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.281+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~RGW9X9Y9REYV.0 size=973422 2024-09-12T00:34:22.279 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.281+0000 7f1f2d864780 1 > prepared multipart upload key=4FRVL0KXN2X8 upload=RGW9X9Y9REYV tag=MYBL8PO6K5RA type=write size=2021998 2024-09-12T00:34:22.281 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.282+0000 7f1f2d864780 1 < completed part key=_multipart_ZYNIJH0TTSM6.2~DY9QU85YF2B5.0 size=1048576 2024-09-12T00:34:22.281 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.283+0000 7f1f2d864780 1 < completed part key=_multipart_ZYNIJH0TTSM6.2~DY9QU85YF2B5.1 size=915904 2024-09-12T00:34:22.283 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.285+0000 7f1f2d864780 1 < completed multipart upload key=ZYNIJH0TTSM6 upload=DY9QU85YF2B5 tag=8PTGGG0KMIOO type=write size=3013056 2024-09-12T00:34:22.285 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.287+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~6H50L05LOU7Z.0 size=1048576 2024-09-12T00:34:22.286 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.288+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~6H50L05LOU7Z.1 size=352719 2024-09-12T00:34:22.286 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.288+0000 7f1f2d864780 1 > prepared multipart upload key=4FRVL0KXN2X8 upload=6H50L05LOU7Z tag=0DCT2MVZEN4E type=write size=2449871 2024-09-12T00:34:22.287 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.289+0000 7f1f2d864780 1 < completed delete operation key=SZP418NVZ5VX tag=K5INBOISG8CN type=del 2024-09-12T00:34:22.289 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.290+0000 7f1f2d864780 1 > prepared operation key=GSPM8N0K7ODC tag=2GHAU95U4NH4 type=del size=1296377 2024-09-12T00:34:22.290 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.292+0000 7f1f2d864780 1 < completed delete operation key=SZP418NVZ5VX tag=XWT9ZCM6FBBW type=del 2024-09-12T00:34:22.292 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.294+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~CRQF0HB4J1HP.0 size=1048576 2024-09-12T00:34:22.293 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.295+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~CRQF0HB4J1HP.1 size=174750 2024-09-12T00:34:22.293 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.295+0000 7f1f2d864780 1 > prepared multipart upload key=4FRVL0KXN2X8 upload=CRQF0HB4J1HP tag=FXXM5RK02VO4 type=write size=2271902 2024-09-12T00:34:22.294 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.296+0000 7f1f2d864780 1 < completed delete operation key=SZP418NVZ5VX tag=Z5KFWHBXZ9X1 type=del 2024-09-12T00:34:22.295 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.297+0000 7f1f2d864780 1 > prepared operation key=0DSQOFS8IIF5 tag=ZR776DO25PX7 type=del size=3268436 2024-09-12T00:34:22.296 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.298+0000 7f1f2d864780 1 < completed part key=_multipart_S5DVMA14N7VJ.2~PEVX1XXVABDD.0 size=1048576 2024-09-12T00:34:22.297 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.299+0000 7f1f2d864780 1 < completed part key=_multipart_S5DVMA14N7VJ.2~PEVX1XXVABDD.1 size=109612 2024-09-12T00:34:22.299 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.301+0000 7f1f2d864780 1 < completed multipart upload key=S5DVMA14N7VJ upload=PEVX1XXVABDD tag=QLW8QZ224RKM type=write size=2206764 2024-09-12T00:34:22.300 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.302+0000 7f1f2d864780 1 > prepared operation key=PVB52GO6L8T4 tag=6CRBNNMBO2GV type=del size=2330038 2024-09-12T00:34:22.305 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.303+0000 7f1f2d864780 1 < completed write operation key=WKK747ETLW10 tag=TMKYGKTJ8OMX type=write size=58536 2024-09-12T00:34:22.305 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.304+0000 7f1f2d864780 1 > prepared operation key=SZP418NVZ5VX tag=RLONQBPABWTV type=write size=919127 2024-09-12T00:34:22.305 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.305+0000 7f1f2d864780 1 < completed write operation key=3Z1TGGPZKJ69 tag=W2LPCUK7LFND type=write size=700679 2024-09-12T00:34:22.305 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.307+0000 7f1f2d864780 1 > prepared operation key=GSPM8N0K7ODC tag=YYQ4JJZKG8WG type=write size=1037539 2024-09-12T00:34:22.306 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.308+0000 7f1f2d864780 1 < completed delete operation key=DYKLAY6J018G tag=D8671CXLE5F4 type=del 2024-09-12T00:34:22.307 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.309+0000 7f1f2d864780 1 > prepared operation key=SNCGB6Z20450 tag=E061FIHQUNQJ type=del size=3144214 2024-09-12T00:34:22.308 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.310+0000 7f1f2d864780 1 < completed delete operation key=2YCGIJRK6MUH tag=QKNG8LWWPLHU type=del 2024-09-12T00:34:22.309 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.311+0000 7f1f2d864780 1 > prepared operation key=KHPF1N1MT33Z tag=K6LYP8W4XSRP type=del size=181004 2024-09-12T00:34:22.311 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.312+0000 7f1f2d864780 1 < completed part key=_multipart_2YCGIJRK6MUH.2~6AI31BVZD0LN.0 size=291681 2024-09-12T00:34:22.312 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.314+0000 7f1f2d864780 1 < completed multipart upload key=2YCGIJRK6MUH upload=6AI31BVZD0LN tag=NXMVKSU0YZXP type=write size=1340257 2024-09-12T00:34:22.315 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.317+0000 7f1f2d864780 1 > prepared part key=_multipart_ZYNIJH0TTSM6.2~BK8Y0SDHBI4G.0 size=520994 2024-09-12T00:34:22.315 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.317+0000 7f1f2d864780 1 > prepared multipart upload key=ZYNIJH0TTSM6 upload=BK8Y0SDHBI4G tag=R74443K7X1WD type=write size=1569570 2024-09-12T00:34:22.318 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.319+0000 7f1f2d864780 1 < suggested update operation key=ZYNIJH0TTSM6 tag=CRCWTRAAJ4D8 type=del size=1062870 2024-09-12T00:34:22.319 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.321+0000 7f1f2d864780 1 > prepared operation key=FAP6N3H7SBN0 tag=KMFKB61ZAAHO type=write size=670204 2024-09-12T00:34:22.320 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.322+0000 7f1f2d864780 1 < completed delete operation key=FAP6N3H7SBN0 tag=JQHQLBTI4JYE type=del 2024-09-12T00:34:22.322 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.324+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~THKWNNW7CWH2.0 size=1048576 2024-09-12T00:34:22.323 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.325+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~THKWNNW7CWH2.1 size=1048576 2024-09-12T00:34:22.324 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.326+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~THKWNNW7CWH2.2 size=23840 2024-09-12T00:34:22.324 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.326+0000 7f1f2d864780 1 > prepared multipart upload key=D21W9QZWY0YU upload=THKWNNW7CWH2 tag=1LDCO1TMVXJB type=write size=3169568 2024-09-12T00:34:22.325 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.327+0000 7f1f2d864780 1 < completed part key=_multipart_2G3UCYG4R4NM.2~ATF1OUQOPQDA.0 size=1048576 2024-09-12T00:34:22.326 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.328+0000 7f1f2d864780 1 < completed part key=_multipart_2G3UCYG4R4NM.2~ATF1OUQOPQDA.1 size=905864 2024-09-12T00:34:22.328 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.330+0000 7f1f2d864780 1 < completed multipart upload key=2G3UCYG4R4NM upload=ATF1OUQOPQDA tag=9B1C9EFRGE7I type=write size=3003016 2024-09-12T00:34:22.330 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.332+0000 7f1f2d864780 1 > prepared part key=_multipart_KHPF1N1MT33Z.2~BV6DDV0AGGBY.0 size=1048576 2024-09-12T00:34:22.331 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.333+0000 7f1f2d864780 1 > prepared part key=_multipart_KHPF1N1MT33Z.2~BV6DDV0AGGBY.1 size=331950 2024-09-12T00:34:22.331 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.333+0000 7f1f2d864780 1 > prepared multipart upload key=KHPF1N1MT33Z upload=BV6DDV0AGGBY tag=JYM75AJE05JY type=write size=2429102 2024-09-12T00:34:22.332 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.334+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~OIG0JTK757UK.0 size=1048576 2024-09-12T00:34:22.333 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.335+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~OIG0JTK757UK.1 size=250635 2024-09-12T00:34:22.335 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.336+0000 7f1f2d864780 1 < completed multipart upload key=1299IOSGYIO9 upload=OIG0JTK757UK tag=71Z05AZCDL4A type=write size=2347787 2024-09-12T00:34:22.336 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.338+0000 7f1f2d864780 1 > prepared operation key=ZGO887JDR627 tag=RW3F43HUO54F type=del size=2835920 2024-09-12T00:34:22.337 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.339+0000 7f1f2d864780 1 < completed delete operation key=FAP6N3H7SBN0 tag=J4Q2608KSLOA type=del 2024-09-12T00:34:22.338 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.340+0000 7f1f2d864780 1 > prepared operation key=N9RQIGHVL8VP tag=J9SNH6EF9L00 type=write size=7093 2024-09-12T00:34:22.340 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.341+0000 7f1f2d864780 1 < completed part key=_multipart_4FRVL0KXN2X8.2~RGW9X9Y9REYV.0 size=973422 2024-09-12T00:34:22.342 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.343+0000 7f1f2d864780 1 < completed multipart upload key=4FRVL0KXN2X8 upload=RGW9X9Y9REYV tag=MYBL8PO6K5RA type=write size=2021998 2024-09-12T00:34:22.344 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.345+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~XOEZYB2RF6ZZ.0 size=1048576 2024-09-12T00:34:22.345 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.346+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~XOEZYB2RF6ZZ.1 size=192425 2024-09-12T00:34:22.345 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.346+0000 7f1f2d864780 1 > prepared multipart upload key=1299IOSGYIO9 upload=XOEZYB2RF6ZZ tag=TI8IJUV7IKH4 type=write size=2289577 2024-09-12T00:34:22.346 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.347+0000 7f1f2d864780 1 < completed part key=_multipart_4FRVL0KXN2X8.2~6H50L05LOU7Z.0 size=1048576 2024-09-12T00:34:22.347 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.348+0000 7f1f2d864780 1 < completed part key=_multipart_4FRVL0KXN2X8.2~6H50L05LOU7Z.1 size=352719 2024-09-12T00:34:22.349 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.350+0000 7f1f2d864780 1 < completed multipart upload key=4FRVL0KXN2X8 upload=6H50L05LOU7Z tag=0DCT2MVZEN4E type=write size=2449871 2024-09-12T00:34:22.350 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.352+0000 7f1f2d864780 1 > prepared operation key=O1YY03BOEYLM tag=D8NCXFDCTAY2 type=del size=2116318 2024-09-12T00:34:22.351 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.353+0000 7f1f2d864780 1 < completed delete operation key=GSPM8N0K7ODC tag=2GHAU95U4NH4 type=del 2024-09-12T00:34:22.353 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.355+0000 7f1f2d864780 1 > prepared part key=_multipart_O1YY03BOEYLM.2~SDVO0FHEFNV1.0 size=1048576 2024-09-12T00:34:22.354 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.356+0000 7f1f2d864780 1 > prepared part key=_multipart_O1YY03BOEYLM.2~SDVO0FHEFNV1.1 size=873335 2024-09-12T00:34:22.354 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.356+0000 7f1f2d864780 1 > prepared multipart upload key=O1YY03BOEYLM upload=SDVO0FHEFNV1 tag=UEDTRFMR3WYQ type=write size=2970487 2024-09-12T00:34:22.355 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.357+0000 7f1f2d864780 1 < completed part key=_multipart_4FRVL0KXN2X8.2~CRQF0HB4J1HP.0 size=1048576 2024-09-12T00:34:22.356 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.358+0000 7f1f2d864780 1 < completed part key=_multipart_4FRVL0KXN2X8.2~CRQF0HB4J1HP.1 size=174750 2024-09-12T00:34:22.359 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.360+0000 7f1f2d864780 1 < completed multipart upload key=4FRVL0KXN2X8 upload=CRQF0HB4J1HP tag=FXXM5RK02VO4 type=write size=2271902 2024-09-12T00:34:22.361 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.362+0000 7f1f2d864780 1 > prepared part key=_multipart_KHPF1N1MT33Z.2~OFZIMDDZWHXX.0 size=813737 2024-09-12T00:34:22.361 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.362+0000 7f1f2d864780 1 > prepared multipart upload key=KHPF1N1MT33Z upload=OFZIMDDZWHXX tag=GCOUPB8DIJPD type=write size=1862313 2024-09-12T00:34:22.362 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.364+0000 7f1f2d864780 1 < completed delete operation key=0DSQOFS8IIF5 tag=ZR776DO25PX7 type=del 2024-09-12T00:34:22.364 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.366+0000 7f1f2d864780 1 > prepared part key=_multipart_PVB52GO6L8T4.2~K23FTN2S9SKG.0 size=1048576 2024-09-12T00:34:22.365 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.367+0000 7f1f2d864780 1 > prepared part key=_multipart_PVB52GO6L8T4.2~K23FTN2S9SKG.1 size=1048576 2024-09-12T00:34:22.366 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.367+0000 7f1f2d864780 1 > prepared part key=_multipart_PVB52GO6L8T4.2~K23FTN2S9SKG.2 size=299000 2024-09-12T00:34:22.366 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.367+0000 7f1f2d864780 1 > prepared multipart upload key=PVB52GO6L8T4 upload=K23FTN2S9SKG tag=RV5ZFYAJK3Z4 type=write size=3444728 2024-09-12T00:34:22.367 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.368+0000 7f1f2d864780 1 < completed delete operation key=PVB52GO6L8T4 tag=6CRBNNMBO2GV type=del 2024-09-12T00:34:22.368 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.370+0000 7f1f2d864780 1 > prepared operation key=ECZYQEZ942W8 tag=5KZKROGNYS5D type=del size=608184 2024-09-12T00:34:22.370 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.372+0000 7f1f2d864780 1 < suggested remove operation key=SZP418NVZ5VX tag=RLONQBPABWTV type=write 2024-09-12T00:34:22.372 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.374+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~R9DI3HA70KVA.0 size=1048576 2024-09-12T00:34:22.373 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.375+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~R9DI3HA70KVA.1 size=14111 2024-09-12T00:34:22.373 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.375+0000 7f1f2d864780 1 > prepared multipart upload key=0DSQOFS8IIF5 upload=R9DI3HA70KVA tag=4WARTDQHA9X6 type=write size=2111263 2024-09-12T00:34:22.374 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.376+0000 7f1f2d864780 1 < completed write operation key=GSPM8N0K7ODC tag=YYQ4JJZKG8WG type=write size=1037539 2024-09-12T00:34:22.377 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.378+0000 7f1f2d864780 1 > prepared part key=_multipart_O1YY03BOEYLM.2~9BZI916C9C7B.0 size=1048576 2024-09-12T00:34:22.378 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.379+0000 7f1f2d864780 1 > prepared part key=_multipart_O1YY03BOEYLM.2~9BZI916C9C7B.1 size=1048576 2024-09-12T00:34:22.378 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.380+0000 7f1f2d864780 1 > prepared part key=_multipart_O1YY03BOEYLM.2~9BZI916C9C7B.2 size=624219 2024-09-12T00:34:22.379 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.380+0000 7f1f2d864780 1 > prepared multipart upload key=O1YY03BOEYLM upload=9BZI916C9C7B tag=RMOOMSRR6NT5 type=write size=3769947 2024-09-12T00:34:22.380 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.381+0000 7f1f2d864780 1 < canceled operation key=SNCGB6Z20450 tag=E061FIHQUNQJ type=del size=3144214 2024-09-12T00:34:22.381 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.383+0000 7f1f2d864780 1 > prepared operation key=WGKEA4EKF5GP tag=87ZRG3U1JI28 type=write size=478855 2024-09-12T00:34:22.382 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.384+0000 7f1f2d864780 1 < canceled operation key=KHPF1N1MT33Z tag=K6LYP8W4XSRP type=del size=181004 2024-09-12T00:34:22.383 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.385+0000 7f1f2d864780 1 > prepared operation key=4FRVL0KXN2X8 tag=GZ9GMABYIRUE type=del size=2017985 2024-09-12T00:34:22.385 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.386+0000 7f1f2d864780 1 < completed part key=_multipart_ZYNIJH0TTSM6.2~BK8Y0SDHBI4G.0 size=520994 2024-09-12T00:34:22.387 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.389+0000 7f1f2d864780 1 < completed multipart upload key=ZYNIJH0TTSM6 upload=BK8Y0SDHBI4G tag=R74443K7X1WD type=write size=1569570 2024-09-12T00:34:22.388 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.390+0000 7f1f2d864780 1 > prepared operation key=GSPM8N0K7ODC tag=HJ9W0QYXFDMJ type=write size=521849 2024-09-12T00:34:22.389 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.391+0000 7f1f2d864780 1 < canceled operation key=FAP6N3H7SBN0 tag=KMFKB61ZAAHO type=write size=670204 2024-09-12T00:34:22.392 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.393+0000 7f1f2d864780 1 > prepared part key=_multipart_53QCNWX1V1R1.2~VP5ATPIIAMJP.0 size=1048576 2024-09-12T00:34:22.392 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.394+0000 7f1f2d864780 1 > prepared part key=_multipart_53QCNWX1V1R1.2~VP5ATPIIAMJP.1 size=1048576 2024-09-12T00:34:22.393 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.395+0000 7f1f2d864780 1 > prepared part key=_multipart_53QCNWX1V1R1.2~VP5ATPIIAMJP.2 size=582244 2024-09-12T00:34:22.393 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.395+0000 7f1f2d864780 1 > prepared multipart upload key=53QCNWX1V1R1 upload=VP5ATPIIAMJP tag=94A5AZRPAVPZ type=write size=3727972 2024-09-12T00:34:22.394 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.396+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~THKWNNW7CWH2.0 size=1048576 2024-09-12T00:34:22.396 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.397+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~THKWNNW7CWH2.1 size=1048576 2024-09-12T00:34:22.396 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.398+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~THKWNNW7CWH2.2 size=23840 2024-09-12T00:34:22.398 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.400+0000 7f1f2d864780 1 < completed multipart upload key=D21W9QZWY0YU upload=THKWNNW7CWH2 tag=1LDCO1TMVXJB type=write size=3169568 2024-09-12T00:34:22.401 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.402+0000 7f1f2d864780 1 > prepared part key=_multipart_PVB52GO6L8T4.2~QASF7K262662.0 size=642698 2024-09-12T00:34:22.401 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.402+0000 7f1f2d864780 1 > prepared multipart upload key=PVB52GO6L8T4 upload=QASF7K262662 tag=TFUGIGW9YX9Q type=write size=1691274 2024-09-12T00:34:22.401 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.403+0000 7f1f2d864780 1 < completed part key=_multipart_KHPF1N1MT33Z.2~BV6DDV0AGGBY.0 size=1048576 2024-09-12T00:34:22.402 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.404+0000 7f1f2d864780 1 < completed part key=_multipart_KHPF1N1MT33Z.2~BV6DDV0AGGBY.1 size=331950 2024-09-12T00:34:22.404 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.406+0000 7f1f2d864780 1 < completed multipart upload key=KHPF1N1MT33Z upload=BV6DDV0AGGBY tag=JYM75AJE05JY type=write size=2429102 2024-09-12T00:34:22.406 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.407+0000 7f1f2d864780 1 > prepared operation key=PVB52GO6L8T4 tag=E3XEZLJ7YIO0 type=del size=3117487 2024-09-12T00:34:22.407 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.408+0000 7f1f2d864780 1 < completed delete operation key=ZGO887JDR627 tag=RW3F43HUO54F type=del 2024-09-12T00:34:22.408 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.410+0000 7f1f2d864780 1 > prepared operation key=0DSQOFS8IIF5 tag=6E68UTXPA80O type=del size=3796578 2024-09-12T00:34:22.409 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.411+0000 7f1f2d864780 1 < completed write operation key=N9RQIGHVL8VP tag=J9SNH6EF9L00 type=write size=7093 2024-09-12T00:34:22.411 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.413+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~RKSQNNNP4HVP.0 size=584546 2024-09-12T00:34:22.411 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.413+0000 7f1f2d864780 1 > prepared multipart upload key=1299IOSGYIO9 upload=RKSQNNNP4HVP tag=FP9XBOZ3NKVW type=write size=1633122 2024-09-12T00:34:22.412 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.414+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~XOEZYB2RF6ZZ.0 size=1048576 2024-09-12T00:34:22.413 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.415+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~XOEZYB2RF6ZZ.1 size=192425 2024-09-12T00:34:22.415 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.417+0000 7f1f2d864780 1 < completed multipart upload key=1299IOSGYIO9 upload=XOEZYB2RF6ZZ tag=TI8IJUV7IKH4 type=write size=2289577 2024-09-12T00:34:22.418 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.419+0000 7f1f2d864780 1 > prepared part key=_multipart_PVB52GO6L8T4.2~KCM58NKRL277.0 size=1048576 2024-09-12T00:34:22.419 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.420+0000 7f1f2d864780 1 > prepared part key=_multipart_PVB52GO6L8T4.2~KCM58NKRL277.1 size=1048576 2024-09-12T00:34:22.420 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.421+0000 7f1f2d864780 1 > prepared part key=_multipart_PVB52GO6L8T4.2~KCM58NKRL277.2 size=186440 2024-09-12T00:34:22.420 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.421+0000 7f1f2d864780 1 > prepared multipart upload key=PVB52GO6L8T4 upload=KCM58NKRL277 tag=8QH6RCPQQPZP type=write size=3332168 2024-09-12T00:34:22.425 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.426+0000 7f1f2d864780 1 < suggested remove operation key=O1YY03BOEYLM tag=D8NCXFDCTAY2 type=del 2024-09-12T00:34:22.427 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.429+0000 7f1f2d864780 1 > prepared part key=_multipart_ZGO887JDR627.2~3E4O0IQ4W4F1.0 size=87132 2024-09-12T00:34:22.427 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.429+0000 7f1f2d864780 1 > prepared multipart upload key=ZGO887JDR627 upload=3E4O0IQ4W4F1 tag=Z58P6O6XJJ24 type=write size=1135708 2024-09-12T00:34:22.428 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.429+0000 7f1f2d864780 1 < canceled part key=_multipart_O1YY03BOEYLM.2~SDVO0FHEFNV1.0 size=1048576 2024-09-12T00:34:22.428 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.430+0000 7f1f2d864780 1 < completed part key=_multipart_O1YY03BOEYLM.2~SDVO0FHEFNV1.1 size=873335 2024-09-12T00:34:22.430 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.432+0000 7f1f2d864780 1 < canceled multipart upload key=O1YY03BOEYLM upload=SDVO0FHEFNV1 tag=UEDTRFMR3WYQ type=write size=2970487 2024-09-12T00:34:22.431 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.433+0000 7f1f2d864780 1 > prepared operation key=WGKEA4EKF5GP tag=RFJ063U77KAG type=del size=237490 2024-09-12T00:34:22.432 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.434+0000 7f1f2d864780 1 < completed part key=_multipart_KHPF1N1MT33Z.2~OFZIMDDZWHXX.0 size=813737 2024-09-12T00:34:22.434 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.436+0000 7f1f2d864780 1 < completed multipart upload key=KHPF1N1MT33Z upload=OFZIMDDZWHXX tag=GCOUPB8DIJPD type=write size=1862313 2024-09-12T00:34:22.435 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.437+0000 7f1f2d864780 1 > prepared operation key=ZYNIJH0TTSM6 tag=IUZ0XRRUT00D type=del size=4048409 2024-09-12T00:34:22.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.438+0000 7f1f2d864780 1 < completed part key=_multipart_PVB52GO6L8T4.2~K23FTN2S9SKG.0 size=1048576 2024-09-12T00:34:22.437 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.439+0000 7f1f2d864780 1 < completed part key=_multipart_PVB52GO6L8T4.2~K23FTN2S9SKG.1 size=1048576 2024-09-12T00:34:22.437 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.439+0000 7f1f2d864780 1 < canceled part key=_multipart_PVB52GO6L8T4.2~K23FTN2S9SKG.2 size=299000 2024-09-12T00:34:22.439 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.441+0000 7f1f2d864780 1 < canceled multipart upload key=PVB52GO6L8T4 upload=K23FTN2S9SKG tag=RV5ZFYAJK3Z4 type=write size=3444728 2024-09-12T00:34:22.440 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.442+0000 7f1f2d864780 1 > prepared operation key=4FRVL0KXN2X8 tag=Z3KKZOCADC0D type=del size=3022797 2024-09-12T00:34:22.443 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.444+0000 7f1f2d864780 1 < completed delete operation key=ECZYQEZ942W8 tag=5KZKROGNYS5D type=del 2024-09-12T00:34:22.444 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.446+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=QSNSUADOFNJB type=del size=3451255 2024-09-12T00:34:22.445 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.447+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~R9DI3HA70KVA.0 size=1048576 2024-09-12T00:34:22.446 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.448+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~R9DI3HA70KVA.1 size=14111 2024-09-12T00:34:22.448 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.450+0000 7f1f2d864780 1 < completed multipart upload key=0DSQOFS8IIF5 upload=R9DI3HA70KVA tag=4WARTDQHA9X6 type=write size=2111263 2024-09-12T00:34:22.449 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.451+0000 7f1f2d864780 1 > prepared operation key=1299IOSGYIO9 tag=M8U0KGJ5H11G type=del size=1993615 2024-09-12T00:34:22.450 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.451+0000 7f1f2d864780 1 < canceled part key=_multipart_O1YY03BOEYLM.2~9BZI916C9C7B.0 size=1048576 2024-09-12T00:34:22.450 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.452+0000 7f1f2d864780 1 < completed part key=_multipart_O1YY03BOEYLM.2~9BZI916C9C7B.1 size=1048576 2024-09-12T00:34:22.451 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.453+0000 7f1f2d864780 1 < completed part key=_multipart_O1YY03BOEYLM.2~9BZI916C9C7B.2 size=624219 2024-09-12T00:34:22.453 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.455+0000 7f1f2d864780 1 < canceled multipart upload key=O1YY03BOEYLM upload=9BZI916C9C7B tag=RMOOMSRR6NT5 type=write size=3769947 2024-09-12T00:34:22.455 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.456+0000 7f1f2d864780 1 > prepared operation key=2G3UCYG4R4NM tag=F0V1ZCFAYNU1 type=write size=119189 2024-09-12T00:34:22.456 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.457+0000 7f1f2d864780 1 < completed write operation key=WGKEA4EKF5GP tag=87ZRG3U1JI28 type=write size=478855 2024-09-12T00:34:22.458 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.459+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~A7LIVG0QOS69.0 size=1048576 2024-09-12T00:34:22.459 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.460+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~A7LIVG0QOS69.1 size=1048576 2024-09-12T00:34:22.460 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.461+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~A7LIVG0QOS69.2 size=204253 2024-09-12T00:34:22.460 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.461+0000 7f1f2d864780 1 > prepared multipart upload key=WGKEA4EKF5GP upload=A7LIVG0QOS69 tag=5MU66R06PDVD type=write size=3349981 2024-09-12T00:34:22.461 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.462+0000 7f1f2d864780 1 < completed delete operation key=4FRVL0KXN2X8 tag=GZ9GMABYIRUE type=del 2024-09-12T00:34:22.462 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.463+0000 7f1f2d864780 1 > prepared operation key=2G3UCYG4R4NM tag=Z92EGXAGOZTG type=del size=2513142 2024-09-12T00:34:22.463 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.465+0000 7f1f2d864780 1 < completed write operation key=GSPM8N0K7ODC tag=HJ9W0QYXFDMJ type=write size=521849 2024-09-12T00:34:22.464 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.466+0000 7f1f2d864780 1 > prepared operation key=O1YY03BOEYLM tag=DQ1C2R1DBJ2J type=del size=19093 2024-09-12T00:34:22.465 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.467+0000 7f1f2d864780 1 < completed part key=_multipart_53QCNWX1V1R1.2~VP5ATPIIAMJP.0 size=1048576 2024-09-12T00:34:22.466 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.468+0000 7f1f2d864780 1 < completed part key=_multipart_53QCNWX1V1R1.2~VP5ATPIIAMJP.1 size=1048576 2024-09-12T00:34:22.466 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.468+0000 7f1f2d864780 1 < canceled part key=_multipart_53QCNWX1V1R1.2~VP5ATPIIAMJP.2 size=582244 2024-09-12T00:34:22.468 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.470+0000 7f1f2d864780 1 < canceled multipart upload key=53QCNWX1V1R1 upload=VP5ATPIIAMJP tag=94A5AZRPAVPZ type=write size=3727972 2024-09-12T00:34:22.469 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.471+0000 7f1f2d864780 1 > prepared operation key=S5DVMA14N7VJ tag=N0VOUZRV1DTI type=del size=1496272 2024-09-12T00:34:22.470 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.471+0000 7f1f2d864780 1 < canceled part key=_multipart_PVB52GO6L8T4.2~QASF7K262662.0 size=642698 2024-09-12T00:34:22.471 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.473+0000 7f1f2d864780 1 < canceled multipart upload key=PVB52GO6L8T4 upload=QASF7K262662 tag=TFUGIGW9YX9Q type=write size=1691274 2024-09-12T00:34:22.473 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.475+0000 7f1f2d864780 1 > prepared part key=_multipart_3Z1TGGPZKJ69.2~F3M3JOUMZABT.0 size=849595 2024-09-12T00:34:22.473 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.475+0000 7f1f2d864780 1 > prepared multipart upload key=3Z1TGGPZKJ69 upload=F3M3JOUMZABT tag=NB7U8812G1O6 type=write size=1898171 2024-09-12T00:34:22.474 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.476+0000 7f1f2d864780 1 < completed delete operation key=PVB52GO6L8T4 tag=E3XEZLJ7YIO0 type=del 2024-09-12T00:34:22.477 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.478+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~FL0LJJSZ9GG7.0 size=344038 2024-09-12T00:34:22.477 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.478+0000 7f1f2d864780 1 > prepared multipart upload key=WGKEA4EKF5GP upload=FL0LJJSZ9GG7 tag=GN585J7BEDPR type=write size=1392614 2024-09-12T00:34:22.478 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.479+0000 7f1f2d864780 1 < completed delete operation key=0DSQOFS8IIF5 tag=6E68UTXPA80O type=del 2024-09-12T00:34:22.480 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.482+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~17032OAG5SMV.0 size=1048576 2024-09-12T00:34:22.481 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.483+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~17032OAG5SMV.1 size=1048576 2024-09-12T00:34:22.482 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.484+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~17032OAG5SMV.2 size=696244 2024-09-12T00:34:22.482 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.484+0000 7f1f2d864780 1 > prepared multipart upload key=D21W9QZWY0YU upload=17032OAG5SMV tag=NH8GOOE3L1PZ type=write size=3841972 2024-09-12T00:34:22.483 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.484+0000 7f1f2d864780 1 < canceled part key=_multipart_1299IOSGYIO9.2~RKSQNNNP4HVP.0 size=584546 2024-09-12T00:34:22.484 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.486+0000 7f1f2d864780 1 < canceled multipart upload key=1299IOSGYIO9 upload=RKSQNNNP4HVP tag=FP9XBOZ3NKVW type=write size=1633122 2024-09-12T00:34:22.485 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.487+0000 7f1f2d864780 1 > prepared operation key=ZYNIJH0TTSM6 tag=E4THG9V7O1SF type=del size=2276283 2024-09-12T00:34:22.486 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.488+0000 7f1f2d864780 1 < completed part key=_multipart_PVB52GO6L8T4.2~KCM58NKRL277.0 size=1048576 2024-09-12T00:34:22.488 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.489+0000 7f1f2d864780 1 < completed part key=_multipart_PVB52GO6L8T4.2~KCM58NKRL277.1 size=1048576 2024-09-12T00:34:22.488 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.489+0000 7f1f2d864780 1 < canceled part key=_multipart_PVB52GO6L8T4.2~KCM58NKRL277.2 size=186440 2024-09-12T00:34:22.490 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.491+0000 7f1f2d864780 1 < canceled multipart upload key=PVB52GO6L8T4 upload=KCM58NKRL277 tag=8QH6RCPQQPZP type=write size=3332168 2024-09-12T00:34:22.491 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.493+0000 7f1f2d864780 1 > prepared operation key=4FRVL0KXN2X8 tag=LXBLXAM9JMH3 type=write size=306039 2024-09-12T00:34:22.492 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.494+0000 7f1f2d864780 1 < completed part key=_multipart_ZGO887JDR627.2~3E4O0IQ4W4F1.0 size=87132 2024-09-12T00:34:22.495 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.496+0000 7f1f2d864780 1 < completed multipart upload key=ZGO887JDR627 upload=3E4O0IQ4W4F1 tag=Z58P6O6XJJ24 type=write size=1135708 2024-09-12T00:34:22.496 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.497+0000 7f1f2d864780 1 > prepared operation key=UTR2UUO6DHLJ tag=DMTIX5PA1CRD type=del size=2702879 2024-09-12T00:34:22.497 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.498+0000 7f1f2d864780 1 < completed delete operation key=WGKEA4EKF5GP tag=RFJ063U77KAG type=del 2024-09-12T00:34:22.499 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.501+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~54HMY5JE8FH8.0 size=1048576 2024-09-12T00:34:22.500 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.502+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~54HMY5JE8FH8.1 size=1048576 2024-09-12T00:34:22.501 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.502+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~54HMY5JE8FH8.2 size=415639 2024-09-12T00:34:22.501 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.502+0000 7f1f2d864780 1 > prepared multipart upload key=0DSQOFS8IIF5 upload=54HMY5JE8FH8 tag=6QTHK6Z29JJH type=write size=3561367 2024-09-12T00:34:22.502 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.504+0000 7f1f2d864780 1 < completed delete operation key=ZYNIJH0TTSM6 tag=IUZ0XRRUT00D type=del 2024-09-12T00:34:22.503 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.505+0000 7f1f2d864780 1 > prepared operation key=AN26EVAZI527 tag=76VXS14AHISR type=del size=1775995 2024-09-12T00:34:22.504 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.506+0000 7f1f2d864780 1 < completed delete operation key=4FRVL0KXN2X8 tag=Z3KKZOCADC0D type=del 2024-09-12T00:34:22.506 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.508+0000 7f1f2d864780 1 > prepared part key=_multipart_DYKLAY6J018G.2~5ANA61V7FVXX.0 size=323458 2024-09-12T00:34:22.506 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.508+0000 7f1f2d864780 1 > prepared multipart upload key=DYKLAY6J018G upload=5ANA61V7FVXX tag=2F1970RFER7S type=write size=1372034 2024-09-12T00:34:22.509 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.510+0000 7f1f2d864780 1 < suggested update operation key=2RV0899QUJ8W tag=QSNSUADOFNJB type=del size=3451255 2024-09-12T00:34:22.513 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.512+0000 7f1f2d864780 1 > prepared part key=_multipart_S5DVMA14N7VJ.2~G2NYRPT1VX53.0 size=1048576 2024-09-12T00:34:22.513 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.513+0000 7f1f2d864780 1 > prepared part key=_multipart_S5DVMA14N7VJ.2~G2NYRPT1VX53.1 size=675300 2024-09-12T00:34:22.513 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.513+0000 7f1f2d864780 1 > prepared multipart upload key=S5DVMA14N7VJ upload=G2NYRPT1VX53 tag=RKTWQSP0QTGC type=write size=2772452 2024-09-12T00:34:22.513 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.514+0000 7f1f2d864780 1 < completed delete operation key=1299IOSGYIO9 tag=M8U0KGJ5H11G type=del 2024-09-12T00:34:22.514 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.516+0000 7f1f2d864780 1 > prepared operation key=MSGU3PHLBRJH tag=ZLNWCCRZUJ56 type=del size=2645180 2024-09-12T00:34:22.515 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.517+0000 7f1f2d864780 1 < completed write operation key=2G3UCYG4R4NM tag=F0V1ZCFAYNU1 type=write size=119189 2024-09-12T00:34:22.516 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.518+0000 7f1f2d864780 1 > prepared operation key=SNCGB6Z20450 tag=RHP17D9CMS4D type=del size=1529745 2024-09-12T00:34:22.517 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.519+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~A7LIVG0QOS69.0 size=1048576 2024-09-12T00:34:22.518 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.520+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~A7LIVG0QOS69.1 size=1048576 2024-09-12T00:34:22.519 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.521+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~A7LIVG0QOS69.2 size=204253 2024-09-12T00:34:22.521 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.523+0000 7f1f2d864780 1 < completed multipart upload key=WGKEA4EKF5GP upload=A7LIVG0QOS69 tag=5MU66R06PDVD type=write size=3349981 2024-09-12T00:34:22.522 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.524+0000 7f1f2d864780 1 > prepared operation key=SZP418NVZ5VX tag=9RQZP6906HCL type=del size=1163211 2024-09-12T00:34:22.523 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.525+0000 7f1f2d864780 1 < completed delete operation key=2G3UCYG4R4NM tag=Z92EGXAGOZTG type=del 2024-09-12T00:34:22.524 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.526+0000 7f1f2d864780 1 > prepared operation key=S5DVMA14N7VJ tag=4JG629TV2EIZ type=write size=644646 2024-09-12T00:34:22.526 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.528+0000 7f1f2d864780 1 < suggested update operation key=O1YY03BOEYLM tag=DQ1C2R1DBJ2J type=del size=19093 2024-09-12T00:34:22.527 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.529+0000 7f1f2d864780 1 > prepared operation key=2YCGIJRK6MUH tag=X30S6N8M4QOW type=del size=257332 2024-09-12T00:34:22.530 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.531+0000 7f1f2d864780 1 < suggested update operation key=S5DVMA14N7VJ tag=N0VOUZRV1DTI type=del size=1496272 2024-09-12T00:34:22.531 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.532+0000 7f1f2d864780 1 > prepared operation key=ZGO887JDR627 tag=GB33JMTJTP4P type=del size=4155600 2024-09-12T00:34:22.533 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.535+0000 7f1f2d864780 1 < completed part key=_multipart_3Z1TGGPZKJ69.2~F3M3JOUMZABT.0 size=849595 2024-09-12T00:34:22.535 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.537+0000 7f1f2d864780 1 < completed multipart upload key=3Z1TGGPZKJ69 upload=F3M3JOUMZABT tag=NB7U8812G1O6 type=write size=1898171 2024-09-12T00:34:22.536 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.538+0000 7f1f2d864780 1 > prepared operation key=PVB52GO6L8T4 tag=4DGNH0T0XH91 type=del size=89891 2024-09-12T00:34:22.537 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.539+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~FL0LJJSZ9GG7.0 size=344038 2024-09-12T00:34:22.539 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.541+0000 7f1f2d864780 1 < completed multipart upload key=WGKEA4EKF5GP upload=FL0LJJSZ9GG7 tag=GN585J7BEDPR type=write size=1392614 2024-09-12T00:34:22.541 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.542+0000 7f1f2d864780 1 > prepared operation key=0DSQOFS8IIF5 tag=VO1WLG0Z1KJ0 type=del size=3545708 2024-09-12T00:34:22.542 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.543+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~17032OAG5SMV.0 size=1048576 2024-09-12T00:34:22.543 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.544+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~17032OAG5SMV.1 size=1048576 2024-09-12T00:34:22.544 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.545+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~17032OAG5SMV.2 size=696244 2024-09-12T00:34:22.546 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.547+0000 7f1f2d864780 1 < completed multipart upload key=D21W9QZWY0YU upload=17032OAG5SMV tag=NH8GOOE3L1PZ type=write size=3841972 2024-09-12T00:34:22.547 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.548+0000 7f1f2d864780 1 > prepared operation key=0DSQOFS8IIF5 tag=DMHEPS515U2D type=del size=2146614 2024-09-12T00:34:22.548 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.550+0000 7f1f2d864780 1 < completed delete operation key=ZYNIJH0TTSM6 tag=E4THG9V7O1SF type=del 2024-09-12T00:34:22.550 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.552+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~B5FD0O990R3I.0 size=1048576 2024-09-12T00:34:22.551 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.553+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~B5FD0O990R3I.1 size=688761 2024-09-12T00:34:22.551 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.553+0000 7f1f2d864780 1 > prepared multipart upload key=0DSQOFS8IIF5 upload=B5FD0O990R3I tag=WPWRS5GK751L type=write size=2785913 2024-09-12T00:34:22.552 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.554+0000 7f1f2d864780 1 < completed write operation key=4FRVL0KXN2X8 tag=LXBLXAM9JMH3 type=write size=306039 2024-09-12T00:34:22.555 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.556+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~4RY19T9669G3.0 size=1048576 2024-09-12T00:34:22.556 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.557+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~4RY19T9669G3.1 size=1048576 2024-09-12T00:34:22.557 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.558+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~4RY19T9669G3.2 size=605697 2024-09-12T00:34:22.557 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.558+0000 7f1f2d864780 1 > prepared multipart upload key=D21W9QZWY0YU upload=4RY19T9669G3 tag=H3T4XLZP4M3H type=write size=3751425 2024-09-12T00:34:22.558 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.559+0000 7f1f2d864780 1 < completed delete operation key=UTR2UUO6DHLJ tag=DMTIX5PA1CRD type=del 2024-09-12T00:34:22.559 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.561+0000 7f1f2d864780 1 > prepared operation key=KHPF1N1MT33Z tag=H4G4W5USBQ7P type=del size=3732118 2024-09-12T00:34:22.560 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.562+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~54HMY5JE8FH8.0 size=1048576 2024-09-12T00:34:22.561 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.563+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~54HMY5JE8FH8.1 size=1048576 2024-09-12T00:34:22.562 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.564+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~54HMY5JE8FH8.2 size=415639 2024-09-12T00:34:22.564 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.565+0000 7f1f2d864780 1 < completed multipart upload key=0DSQOFS8IIF5 upload=54HMY5JE8FH8 tag=6QTHK6Z29JJH type=write size=3561367 2024-09-12T00:34:22.566 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.567+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~0Q2S7UY6VU3P.0 size=54481 2024-09-12T00:34:22.566 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.567+0000 7f1f2d864780 1 > prepared multipart upload key=D21W9QZWY0YU upload=0Q2S7UY6VU3P tag=JBIMLGY7WH4J type=write size=1103057 2024-09-12T00:34:22.567 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.569+0000 7f1f2d864780 1 < completed delete operation key=AN26EVAZI527 tag=76VXS14AHISR type=del 2024-09-12T00:34:22.568 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.570+0000 7f1f2d864780 1 > prepared operation key=9XK59MVZ5G1O tag=Z7JO1UI25EGU type=del size=275951 2024-09-12T00:34:22.569 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.571+0000 7f1f2d864780 1 < completed part key=_multipart_DYKLAY6J018G.2~5ANA61V7FVXX.0 size=323458 2024-09-12T00:34:22.571 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.573+0000 7f1f2d864780 1 < completed multipart upload key=DYKLAY6J018G upload=5ANA61V7FVXX tag=2F1970RFER7S type=write size=1372034 2024-09-12T00:34:22.573 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.574+0000 7f1f2d864780 1 > prepared operation key=FAP6N3H7SBN0 tag=9UY4WOLGTPCO type=del size=2811576 2024-09-12T00:34:22.574 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.575+0000 7f1f2d864780 1 < completed part key=_multipart_S5DVMA14N7VJ.2~G2NYRPT1VX53.0 size=1048576 2024-09-12T00:34:22.574 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.575+0000 7f1f2d864780 1 < canceled part key=_multipart_S5DVMA14N7VJ.2~G2NYRPT1VX53.1 size=675300 2024-09-12T00:34:22.576 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.577+0000 7f1f2d864780 1 < canceled multipart upload key=S5DVMA14N7VJ upload=G2NYRPT1VX53 tag=RKTWQSP0QTGC type=write size=2772452 2024-09-12T00:34:22.577 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.578+0000 7f1f2d864780 1 > prepared operation key=N9RQIGHVL8VP tag=80UGCALI38R8 type=write size=626912 2024-09-12T00:34:22.579 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.581+0000 7f1f2d864780 1 < suggested update operation key=MSGU3PHLBRJH tag=ZLNWCCRZUJ56 type=del size=2645180 2024-09-12T00:34:22.580 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.582+0000 7f1f2d864780 1 > prepared operation key=KHPF1N1MT33Z tag=54JGJTSB1369 type=del size=192473 2024-09-12T00:34:22.582 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.583+0000 7f1f2d864780 1 < completed delete operation key=SNCGB6Z20450 tag=RHP17D9CMS4D type=del 2024-09-12T00:34:22.584 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.585+0000 7f1f2d864780 1 > prepared part key=_multipart_2YCGIJRK6MUH.2~N1IXQ3YVQ00P.0 size=1048576 2024-09-12T00:34:22.585 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.586+0000 7f1f2d864780 1 > prepared part key=_multipart_2YCGIJRK6MUH.2~N1IXQ3YVQ00P.1 size=486043 2024-09-12T00:34:22.585 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.586+0000 7f1f2d864780 1 > prepared multipart upload key=2YCGIJRK6MUH upload=N1IXQ3YVQ00P tag=S1CFV6TF2I98 type=write size=2583195 2024-09-12T00:34:22.586 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.587+0000 7f1f2d864780 1 < completed delete operation key=SZP418NVZ5VX tag=9RQZP6906HCL type=del 2024-09-12T00:34:22.588 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.589+0000 7f1f2d864780 1 > prepared part key=_multipart_O1YY03BOEYLM.2~UZYY8NVW16BF.0 size=1048576 2024-09-12T00:34:22.589 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.590+0000 7f1f2d864780 1 > prepared part key=_multipart_O1YY03BOEYLM.2~UZYY8NVW16BF.1 size=121659 2024-09-12T00:34:22.589 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.590+0000 7f1f2d864780 1 > prepared multipart upload key=O1YY03BOEYLM upload=UZYY8NVW16BF tag=ZHTC15TNC688 type=write size=2218811 2024-09-12T00:34:22.590 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.591+0000 7f1f2d864780 -1 < failed to complete operation key=S5DVMA14N7VJ tag=4JG629TV2EIZ type=write size=644646: (22) Invalid argument 2024-09-12T00:34:22.591 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.593+0000 7f1f2d864780 1 > prepared operation key=D21W9QZWY0YU tag=MUK0NX1SOCA9 type=del size=39694 2024-09-12T00:34:22.592 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.594+0000 7f1f2d864780 1 < completed delete operation key=2YCGIJRK6MUH tag=X30S6N8M4QOW type=del 2024-09-12T00:34:22.594 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.596+0000 7f1f2d864780 1 > prepared part key=_multipart_UTR2UUO6DHLJ.2~1BK2OAMVNTW1.0 size=989994 2024-09-12T00:34:22.594 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.596+0000 7f1f2d864780 1 > prepared multipart upload key=UTR2UUO6DHLJ upload=1BK2OAMVNTW1 tag=154DMHFTY0KW type=write size=2038570 2024-09-12T00:34:22.595 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.597+0000 7f1f2d864780 1 < completed delete operation key=ZGO887JDR627 tag=GB33JMTJTP4P type=del 2024-09-12T00:34:22.597 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.598+0000 7f1f2d864780 1 > prepared operation key=FFG41OYEYFZA tag=569RQKLHZLT4 type=del size=3370365 2024-09-12T00:34:22.598 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.599+0000 7f1f2d864780 1 < canceled operation key=PVB52GO6L8T4 tag=4DGNH0T0XH91 type=del size=89891 2024-09-12T00:34:22.599 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.601+0000 7f1f2d864780 1 > prepared operation key=FFG41OYEYFZA tag=7EJU1U60DES0 type=del size=335397 2024-09-12T00:34:22.600 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.602+0000 7f1f2d864780 1 < completed delete operation key=0DSQOFS8IIF5 tag=VO1WLG0Z1KJ0 type=del 2024-09-12T00:34:22.601 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.603+0000 7f1f2d864780 1 > prepared operation key=DYKLAY6J018G tag=22RV0GRAMPO0 type=del size=332565 2024-09-12T00:34:22.603 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.605+0000 7f1f2d864780 1 < canceled operation key=0DSQOFS8IIF5 tag=DMHEPS515U2D type=del size=2146614 2024-09-12T00:34:22.604 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.606+0000 7f1f2d864780 1 > prepared operation key=WIIU8VTCLWOD tag=O51DMUQRWP1G type=del size=3125280 2024-09-12T00:34:22.605 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.607+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~B5FD0O990R3I.0 size=1048576 2024-09-12T00:34:22.606 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.608+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~B5FD0O990R3I.1 size=688761 2024-09-12T00:34:22.608 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.610+0000 7f1f2d864780 1 < completed multipart upload key=0DSQOFS8IIF5 upload=B5FD0O990R3I tag=WPWRS5GK751L type=write size=2785913 2024-09-12T00:34:22.610 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.612+0000 7f1f2d864780 1 > prepared part key=_multipart_2G3UCYG4R4NM.2~EP2QQOK2LINP.0 size=1048576 2024-09-12T00:34:22.611 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.613+0000 7f1f2d864780 1 > prepared part key=_multipart_2G3UCYG4R4NM.2~EP2QQOK2LINP.1 size=44679 2024-09-12T00:34:22.611 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.613+0000 7f1f2d864780 1 > prepared multipart upload key=2G3UCYG4R4NM upload=EP2QQOK2LINP tag=O9A0XFCR4XY7 type=write size=2141831 2024-09-12T00:34:22.612 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.614+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~4RY19T9669G3.0 size=1048576 2024-09-12T00:34:22.613 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.615+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~4RY19T9669G3.1 size=1048576 2024-09-12T00:34:22.614 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.616+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~4RY19T9669G3.2 size=605697 2024-09-12T00:34:22.616 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.618+0000 7f1f2d864780 1 < completed multipart upload key=D21W9QZWY0YU upload=4RY19T9669G3 tag=H3T4XLZP4M3H type=write size=3751425 2024-09-12T00:34:22.618 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.620+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~VP6IP124XBO1.0 size=1048576 2024-09-12T00:34:22.619 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.621+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~VP6IP124XBO1.1 size=1048576 2024-09-12T00:34:22.620 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.621+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~VP6IP124XBO1.2 size=552007 2024-09-12T00:34:22.620 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.621+0000 7f1f2d864780 1 > prepared multipart upload key=D21W9QZWY0YU upload=VP6IP124XBO1 tag=B937EQRUCCB2 type=write size=3697735 2024-09-12T00:34:22.622 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.624+0000 7f1f2d864780 1 < suggested remove operation key=KHPF1N1MT33Z tag=H4G4W5USBQ7P type=del 2024-09-12T00:34:22.623 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.625+0000 7f1f2d864780 1 > prepared operation key=0DSQOFS8IIF5 tag=NAXO23TG2CI6 type=del size=1692901 2024-09-12T00:34:22.625 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.626+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~0Q2S7UY6VU3P.0 size=54481 2024-09-12T00:34:22.626 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.628+0000 7f1f2d864780 1 < completed multipart upload key=D21W9QZWY0YU upload=0Q2S7UY6VU3P tag=JBIMLGY7WH4J type=write size=1103057 2024-09-12T00:34:22.628 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.629+0000 7f1f2d864780 1 > prepared operation key=WGKEA4EKF5GP tag=MTR67FI5W0RD type=del size=3536488 2024-09-12T00:34:22.629 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.630+0000 7f1f2d864780 1 < completed delete operation key=9XK59MVZ5G1O tag=Z7JO1UI25EGU type=del 2024-09-12T00:34:22.630 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.631+0000 7f1f2d864780 1 > prepared operation key=UTR2UUO6DHLJ tag=O812L91KPUKZ type=del size=1203829 2024-09-12T00:34:22.631 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.633+0000 7f1f2d864780 1 < completed delete operation key=FAP6N3H7SBN0 tag=9UY4WOLGTPCO type=del 2024-09-12T00:34:22.632 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.634+0000 7f1f2d864780 1 > prepared operation key=WKK747ETLW10 tag=09FE71LQ6HVD type=del size=88914 2024-09-12T00:34:22.633 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.635+0000 7f1f2d864780 1 < completed write operation key=N9RQIGHVL8VP tag=80UGCALI38R8 type=write size=626912 2024-09-12T00:34:22.635 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.636+0000 7f1f2d864780 1 > prepared operation key=4FRVL0KXN2X8 tag=KFT2P14X1E7Q type=del size=2557177 2024-09-12T00:34:22.636 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.637+0000 7f1f2d864780 -1 < failed to complete operation key=KHPF1N1MT33Z tag=54JGJTSB1369 type=del size=192473: (22) Invalid argument 2024-09-12T00:34:22.637 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.638+0000 7f1f2d864780 1 > prepared operation key=WKK747ETLW10 tag=MERWQLL43925 type=del size=35202 2024-09-12T00:34:22.638 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.640+0000 7f1f2d864780 1 < completed part key=_multipart_2YCGIJRK6MUH.2~N1IXQ3YVQ00P.0 size=1048576 2024-09-12T00:34:22.639 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.641+0000 7f1f2d864780 1 < completed part key=_multipart_2YCGIJRK6MUH.2~N1IXQ3YVQ00P.1 size=486043 2024-09-12T00:34:22.642 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.644+0000 7f1f2d864780 1 < completed multipart upload key=2YCGIJRK6MUH upload=N1IXQ3YVQ00P tag=S1CFV6TF2I98 type=write size=2583195 2024-09-12T00:34:22.643 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.645+0000 7f1f2d864780 1 > prepared operation key=S5DVMA14N7VJ tag=HY2X6V1XBJQ1 type=del size=330986 2024-09-12T00:34:22.644 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.646+0000 7f1f2d864780 1 < completed part key=_multipart_O1YY03BOEYLM.2~UZYY8NVW16BF.0 size=1048576 2024-09-12T00:34:22.645 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.647+0000 7f1f2d864780 1 < completed part key=_multipart_O1YY03BOEYLM.2~UZYY8NVW16BF.1 size=121659 2024-09-12T00:34:22.647 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.649+0000 7f1f2d864780 1 < completed multipart upload key=O1YY03BOEYLM upload=UZYY8NVW16BF tag=ZHTC15TNC688 type=write size=2218811 2024-09-12T00:34:22.649 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.651+0000 7f1f2d864780 1 > prepared part key=_multipart_ZYNIJH0TTSM6.2~D9FTOO3TOM5O.0 size=1048576 2024-09-12T00:34:22.650 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.652+0000 7f1f2d864780 1 > prepared part key=_multipart_ZYNIJH0TTSM6.2~D9FTOO3TOM5O.1 size=1048576 2024-09-12T00:34:22.652 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.653+0000 7f1f2d864780 1 > prepared part key=_multipart_ZYNIJH0TTSM6.2~D9FTOO3TOM5O.2 size=369520 2024-09-12T00:34:22.652 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.653+0000 7f1f2d864780 1 > prepared multipart upload key=ZYNIJH0TTSM6 upload=D9FTOO3TOM5O tag=V2BZRF3CHLD4 type=write size=3515248 2024-09-12T00:34:22.653 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.654+0000 7f1f2d864780 1 < completed delete operation key=D21W9QZWY0YU tag=MUK0NX1SOCA9 type=del 2024-09-12T00:34:22.655 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.656+0000 7f1f2d864780 1 > prepared part key=_multipart_ECZYQEZ942W8.2~B93J6VN7EKJ4.0 size=1048576 2024-09-12T00:34:22.656 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.657+0000 7f1f2d864780 1 > prepared part key=_multipart_ECZYQEZ942W8.2~B93J6VN7EKJ4.1 size=99080 2024-09-12T00:34:22.656 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.657+0000 7f1f2d864780 1 > prepared multipart upload key=ECZYQEZ942W8 upload=B93J6VN7EKJ4 tag=3ZCOS1JWNVV1 type=write size=2196232 2024-09-12T00:34:22.657 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.658+0000 7f1f2d864780 1 < completed part key=_multipart_UTR2UUO6DHLJ.2~1BK2OAMVNTW1.0 size=989994 2024-09-12T00:34:22.659 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.660+0000 7f1f2d864780 1 < completed multipart upload key=UTR2UUO6DHLJ upload=1BK2OAMVNTW1 tag=154DMHFTY0KW type=write size=2038570 2024-09-12T00:34:22.660 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.661+0000 7f1f2d864780 1 > prepared operation key=53QCNWX1V1R1 tag=2KU6JJ73CMV6 type=del size=2609668 2024-09-12T00:34:22.661 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.663+0000 7f1f2d864780 1 < completed delete operation key=FFG41OYEYFZA tag=569RQKLHZLT4 type=del 2024-09-12T00:34:22.663 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.665+0000 7f1f2d864780 1 > prepared part key=_multipart_OY145ZXRSF4L.2~IBH6N5UPKNUF.0 size=1048576 2024-09-12T00:34:22.664 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.666+0000 7f1f2d864780 1 > prepared part key=_multipart_OY145ZXRSF4L.2~IBH6N5UPKNUF.1 size=85217 2024-09-12T00:34:22.664 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.666+0000 7f1f2d864780 1 > prepared multipart upload key=OY145ZXRSF4L upload=IBH6N5UPKNUF tag=C9JO92LIJJ45 type=write size=2182369 2024-09-12T00:34:22.665 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.667+0000 7f1f2d864780 1 < completed delete operation key=FFG41OYEYFZA tag=7EJU1U60DES0 type=del 2024-09-12T00:34:22.667 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.669+0000 7f1f2d864780 1 > prepared part key=_multipart_9XK59MVZ5G1O.2~6WCTJBB7YI0T.0 size=1048576 2024-09-12T00:34:22.668 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.670+0000 7f1f2d864780 1 > prepared part key=_multipart_9XK59MVZ5G1O.2~6WCTJBB7YI0T.1 size=483100 2024-09-12T00:34:22.668 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.670+0000 7f1f2d864780 1 > prepared multipart upload key=9XK59MVZ5G1O upload=6WCTJBB7YI0T tag=LZ0ER48OCTPQ type=write size=2580252 2024-09-12T00:34:22.670 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.672+0000 7f1f2d864780 1 < suggested update operation key=DYKLAY6J018G tag=22RV0GRAMPO0 type=del size=332565 2024-09-12T00:34:22.673 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.674+0000 7f1f2d864780 1 > prepared part key=_multipart_S5DVMA14N7VJ.2~BX8TF2MI3W41.0 size=916758 2024-09-12T00:34:22.673 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.674+0000 7f1f2d864780 1 > prepared multipart upload key=S5DVMA14N7VJ upload=BX8TF2MI3W41 tag=LM1APY1F3N82 type=write size=1965334 2024-09-12T00:34:22.674 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.675+0000 7f1f2d864780 1 < completed delete operation key=WIIU8VTCLWOD tag=O51DMUQRWP1G type=del 2024-09-12T00:34:22.675 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.677+0000 7f1f2d864780 1 > prepared operation key=AN26EVAZI527 tag=DEDB4MNGVYW7 type=del size=3487998 2024-09-12T00:34:22.676 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.678+0000 7f1f2d864780 1 < completed part key=_multipart_2G3UCYG4R4NM.2~EP2QQOK2LINP.0 size=1048576 2024-09-12T00:34:22.677 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.679+0000 7f1f2d864780 1 < completed part key=_multipart_2G3UCYG4R4NM.2~EP2QQOK2LINP.1 size=44679 2024-09-12T00:34:22.679 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.681+0000 7f1f2d864780 1 < completed multipart upload key=2G3UCYG4R4NM upload=EP2QQOK2LINP tag=O9A0XFCR4XY7 type=write size=2141831 2024-09-12T00:34:22.680 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.682+0000 7f1f2d864780 1 > prepared operation key=N9RQIGHVL8VP tag=G64PXG0T7AA3 type=del size=2407985 2024-09-12T00:34:22.681 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.683+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~VP6IP124XBO1.0 size=1048576 2024-09-12T00:34:22.683 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.684+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~VP6IP124XBO1.1 size=1048576 2024-09-12T00:34:22.683 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.685+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~VP6IP124XBO1.2 size=552007 2024-09-12T00:34:22.685 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.687+0000 7f1f2d864780 1 < completed multipart upload key=D21W9QZWY0YU upload=VP6IP124XBO1 tag=B937EQRUCCB2 type=write size=3697735 2024-09-12T00:34:22.686 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.688+0000 7f1f2d864780 1 > prepared operation key=N9RQIGHVL8VP tag=5DON1FFVPLBX type=del size=2301472 2024-09-12T00:34:22.689 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.690+0000 7f1f2d864780 1 < suggested remove operation key=0DSQOFS8IIF5 tag=NAXO23TG2CI6 type=del 2024-09-12T00:34:22.690 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.692+0000 7f1f2d864780 1 > prepared operation key=OY145ZXRSF4L tag=8SKKSSNKNVWD type=write size=1017374 2024-09-12T00:34:22.691 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.693+0000 7f1f2d864780 1 < completed delete operation key=WGKEA4EKF5GP tag=MTR67FI5W0RD type=del 2024-09-12T00:34:22.693 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.695+0000 7f1f2d864780 1 > prepared part key=_multipart_O1YY03BOEYLM.2~CR8F45Q40S3C.0 size=618745 2024-09-12T00:34:22.693 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.695+0000 7f1f2d864780 1 > prepared multipart upload key=O1YY03BOEYLM upload=CR8F45Q40S3C tag=03B3GY1G24A2 type=write size=1667321 2024-09-12T00:34:22.694 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.696+0000 7f1f2d864780 1 < canceled operation key=UTR2UUO6DHLJ tag=O812L91KPUKZ type=del size=1203829 2024-09-12T00:34:22.697 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.698+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~RKYU0L0MBJUG.0 size=1048576 2024-09-12T00:34:22.698 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.699+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~RKYU0L0MBJUG.1 size=1048576 2024-09-12T00:34:22.699 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.700+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~RKYU0L0MBJUG.2 size=217728 2024-09-12T00:34:22.699 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.700+0000 7f1f2d864780 1 > prepared multipart upload key=FAP6N3H7SBN0 upload=RKYU0L0MBJUG tag=F1GWOK0Y20Y9 type=write size=3363456 2024-09-12T00:34:22.700 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.702+0000 7f1f2d864780 1 < completed delete operation key=WKK747ETLW10 tag=09FE71LQ6HVD type=del 2024-09-12T00:34:22.702 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.704+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~YJR3O4D5QYPM.0 size=719445 2024-09-12T00:34:22.703 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.704+0000 7f1f2d864780 1 > prepared multipart upload key=D21W9QZWY0YU upload=YJR3O4D5QYPM tag=ELL43ZKPNBWT type=write size=1768021 2024-09-12T00:34:22.704 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.706+0000 7f1f2d864780 1 < completed delete operation key=4FRVL0KXN2X8 tag=KFT2P14X1E7Q type=del 2024-09-12T00:34:22.705 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.707+0000 7f1f2d864780 1 > prepared operation key=FAP6N3H7SBN0 tag=4UN695OSN38Y type=del size=1901175 2024-09-12T00:34:22.706 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.708+0000 7f1f2d864780 1 < completed delete operation key=WKK747ETLW10 tag=MERWQLL43925 type=del 2024-09-12T00:34:22.707 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.709+0000 7f1f2d864780 1 > prepared operation key=2G3UCYG4R4NM tag=DABANAR8NDCN type=del size=629651 2024-09-12T00:34:22.710 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.711+0000 7f1f2d864780 1 < suggested update operation key=S5DVMA14N7VJ tag=HY2X6V1XBJQ1 type=del size=330986 2024-09-12T00:34:22.712 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.713+0000 7f1f2d864780 1 > prepared part key=_multipart_2G3UCYG4R4NM.2~5KB73NQ1UW7W.0 size=1048576 2024-09-12T00:34:22.712 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.714+0000 7f1f2d864780 1 > prepared part key=_multipart_2G3UCYG4R4NM.2~5KB73NQ1UW7W.1 size=924822 2024-09-12T00:34:22.712 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.714+0000 7f1f2d864780 1 > prepared multipart upload key=2G3UCYG4R4NM upload=5KB73NQ1UW7W tag=KE38EAE4QA11 type=write size=3021974 2024-09-12T00:34:22.713 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.715+0000 7f1f2d864780 1 < completed part key=_multipart_ZYNIJH0TTSM6.2~D9FTOO3TOM5O.0 size=1048576 2024-09-12T00:34:22.714 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.716+0000 7f1f2d864780 1 < completed part key=_multipart_ZYNIJH0TTSM6.2~D9FTOO3TOM5O.1 size=1048576 2024-09-12T00:34:22.715 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.717+0000 7f1f2d864780 1 < completed part key=_multipart_ZYNIJH0TTSM6.2~D9FTOO3TOM5O.2 size=369520 2024-09-12T00:34:22.721 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.719+0000 7f1f2d864780 1 < completed multipart upload key=ZYNIJH0TTSM6 upload=D9FTOO3TOM5O tag=V2BZRF3CHLD4 type=write size=3515248 2024-09-12T00:34:22.721 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.721+0000 7f1f2d864780 1 > prepared part key=_multipart_9XK59MVZ5G1O.2~3N8I0FA3CPDJ.0 size=1048576 2024-09-12T00:34:22.721 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.721+0000 7f1f2d864780 1 > prepared part key=_multipart_9XK59MVZ5G1O.2~3N8I0FA3CPDJ.1 size=55542 2024-09-12T00:34:22.721 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.721+0000 7f1f2d864780 1 > prepared multipart upload key=9XK59MVZ5G1O upload=3N8I0FA3CPDJ tag=GLTTQT7IP13S type=write size=2152694 2024-09-12T00:34:22.721 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.723+0000 7f1f2d864780 1 < completed part key=_multipart_ECZYQEZ942W8.2~B93J6VN7EKJ4.0 size=1048576 2024-09-12T00:34:22.722 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.724+0000 7f1f2d864780 1 < completed part key=_multipart_ECZYQEZ942W8.2~B93J6VN7EKJ4.1 size=99080 2024-09-12T00:34:22.726 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.728+0000 7f1f2d864780 1 < completed multipart upload key=ECZYQEZ942W8 upload=B93J6VN7EKJ4 tag=3ZCOS1JWNVV1 type=write size=2196232 2024-09-12T00:34:22.727 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.729+0000 7f1f2d864780 1 > prepared operation key=KHPF1N1MT33Z tag=EX0UQ4AJ6V4E type=del size=1207272 2024-09-12T00:34:22.730 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.731+0000 7f1f2d864780 1 < suggested remove operation key=53QCNWX1V1R1 tag=2KU6JJ73CMV6 type=del 2024-09-12T00:34:22.732 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.734+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~ARFBSXRF1A5V.0 size=70180 2024-09-12T00:34:22.732 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.734+0000 7f1f2d864780 1 > prepared multipart upload key=1299IOSGYIO9 upload=ARFBSXRF1A5V tag=WPV456AQTYBL type=write size=1118756 2024-09-12T00:34:22.733 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.735+0000 7f1f2d864780 1 < completed part key=_multipart_OY145ZXRSF4L.2~IBH6N5UPKNUF.0 size=1048576 2024-09-12T00:34:22.734 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.736+0000 7f1f2d864780 1 < completed part key=_multipart_OY145ZXRSF4L.2~IBH6N5UPKNUF.1 size=85217 2024-09-12T00:34:22.736 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.738+0000 7f1f2d864780 1 < completed multipart upload key=OY145ZXRSF4L upload=IBH6N5UPKNUF tag=C9JO92LIJJ45 type=write size=2182369 2024-09-12T00:34:22.737 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.739+0000 7f1f2d864780 1 > prepared operation key=WKK747ETLW10 tag=Q7K4YLL7RO06 type=del size=1676354 2024-09-12T00:34:22.738 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.740+0000 7f1f2d864780 1 < completed part key=_multipart_9XK59MVZ5G1O.2~6WCTJBB7YI0T.0 size=1048576 2024-09-12T00:34:22.739 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.741+0000 7f1f2d864780 1 < completed part key=_multipart_9XK59MVZ5G1O.2~6WCTJBB7YI0T.1 size=483100 2024-09-12T00:34:22.741 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.743+0000 7f1f2d864780 1 < completed multipart upload key=9XK59MVZ5G1O upload=6WCTJBB7YI0T tag=LZ0ER48OCTPQ type=write size=2580252 2024-09-12T00:34:22.743 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.745+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~VY4YEHORRA3V.0 size=908711 2024-09-12T00:34:22.744 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.745+0000 7f1f2d864780 1 > prepared multipart upload key=FAP6N3H7SBN0 upload=VY4YEHORRA3V tag=QOSPBN778WHT type=write size=1957287 2024-09-12T00:34:22.745 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.746+0000 7f1f2d864780 1 < completed part key=_multipart_S5DVMA14N7VJ.2~BX8TF2MI3W41.0 size=916758 2024-09-12T00:34:22.746 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.748+0000 7f1f2d864780 1 < completed multipart upload key=S5DVMA14N7VJ upload=BX8TF2MI3W41 tag=LM1APY1F3N82 type=write size=1965334 2024-09-12T00:34:22.748 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.749+0000 7f1f2d864780 1 > prepared operation key=S5DVMA14N7VJ tag=52KXA3TQEYMJ type=del size=3189229 2024-09-12T00:34:22.749 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.750+0000 7f1f2d864780 1 < completed delete operation key=AN26EVAZI527 tag=DEDB4MNGVYW7 type=del 2024-09-12T00:34:22.750 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.752+0000 7f1f2d864780 1 > prepared operation key=D21W9QZWY0YU tag=7CL12DVBLI96 type=del size=300288 2024-09-12T00:34:22.753 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.754+0000 7f1f2d864780 1 < completed delete operation key=N9RQIGHVL8VP tag=G64PXG0T7AA3 type=del 2024-09-12T00:34:22.754 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.755+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=QFYXR5UV195M type=write size=235743 2024-09-12T00:34:22.755 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.756+0000 7f1f2d864780 1 < completed delete operation key=N9RQIGHVL8VP tag=5DON1FFVPLBX type=del 2024-09-12T00:34:22.756 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.758+0000 7f1f2d864780 1 > prepared operation key=FAP6N3H7SBN0 tag=WG6UZYVIO6IT type=del size=1818023 2024-09-12T00:34:22.757 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.759+0000 7f1f2d864780 1 < completed write operation key=OY145ZXRSF4L tag=8SKKSSNKNVWD type=write size=1017374 2024-09-12T00:34:22.760 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.761+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~C6Q52M1T19B5.0 size=1048576 2024-09-12T00:34:22.761 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.762+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~C6Q52M1T19B5.1 size=1048576 2024-09-12T00:34:22.762 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.763+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~C6Q52M1T19B5.2 size=123077 2024-09-12T00:34:22.762 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.763+0000 7f1f2d864780 1 > prepared multipart upload key=1299IOSGYIO9 upload=C6Q52M1T19B5 tag=5JAINF6NYYP9 type=write size=3268805 2024-09-12T00:34:22.763 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.764+0000 7f1f2d864780 1 < completed part key=_multipart_O1YY03BOEYLM.2~CR8F45Q40S3C.0 size=618745 2024-09-12T00:34:22.765 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.766+0000 7f1f2d864780 1 < completed multipart upload key=O1YY03BOEYLM upload=CR8F45Q40S3C tag=03B3GY1G24A2 type=write size=1667321 2024-09-12T00:34:22.766 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.767+0000 7f1f2d864780 1 > prepared operation key=OY145ZXRSF4L tag=25JE7S3V6SPS type=del size=1529644 2024-09-12T00:34:22.767 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.768+0000 7f1f2d864780 1 < completed part key=_multipart_FAP6N3H7SBN0.2~RKYU0L0MBJUG.0 size=1048576 2024-09-12T00:34:22.768 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.769+0000 7f1f2d864780 1 < completed part key=_multipart_FAP6N3H7SBN0.2~RKYU0L0MBJUG.1 size=1048576 2024-09-12T00:34:22.769 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.770+0000 7f1f2d864780 1 < completed part key=_multipart_FAP6N3H7SBN0.2~RKYU0L0MBJUG.2 size=217728 2024-09-12T00:34:22.771 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.772+0000 7f1f2d864780 1 < completed multipart upload key=FAP6N3H7SBN0 upload=RKYU0L0MBJUG tag=F1GWOK0Y20Y9 type=write size=3363456 2024-09-12T00:34:22.773 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.775+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~YM74X1JTIIK9.0 size=1048576 2024-09-12T00:34:22.774 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.776+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~YM74X1JTIIK9.1 size=1048576 2024-09-12T00:34:22.775 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.777+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~YM74X1JTIIK9.2 size=625036 2024-09-12T00:34:22.775 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.777+0000 7f1f2d864780 1 > prepared multipart upload key=1299IOSGYIO9 upload=YM74X1JTIIK9 tag=13I51N4295UZ type=write size=3770764 2024-09-12T00:34:22.776 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.778+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~YJR3O4D5QYPM.0 size=719445 2024-09-12T00:34:22.778 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.780+0000 7f1f2d864780 1 < completed multipart upload key=D21W9QZWY0YU upload=YJR3O4D5QYPM tag=ELL43ZKPNBWT type=write size=1768021 2024-09-12T00:34:22.779 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.781+0000 7f1f2d864780 1 > prepared operation key=DYKLAY6J018G tag=YMZ03G1GFUY2 type=del size=772196 2024-09-12T00:34:22.781 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.783+0000 7f1f2d864780 1 < suggested remove operation key=FAP6N3H7SBN0 tag=4UN695OSN38Y type=del 2024-09-12T00:34:22.784 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.785+0000 7f1f2d864780 1 > prepared part key=_multipart_2YCGIJRK6MUH.2~J56UOTYGN6RH.0 size=369341 2024-09-12T00:34:22.784 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.785+0000 7f1f2d864780 1 > prepared multipart upload key=2YCGIJRK6MUH upload=J56UOTYGN6RH tag=3Z1NYNN5MUHI type=write size=1417917 2024-09-12T00:34:22.785 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.786+0000 7f1f2d864780 1 < completed delete operation key=2G3UCYG4R4NM tag=DABANAR8NDCN type=del 2024-09-12T00:34:22.786 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.788+0000 7f1f2d864780 1 > prepared operation key=S5DVMA14N7VJ tag=T1GUPQ3TD3A0 type=del size=3847938 2024-09-12T00:34:22.787 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.789+0000 7f1f2d864780 1 < completed part key=_multipart_2G3UCYG4R4NM.2~5KB73NQ1UW7W.0 size=1048576 2024-09-12T00:34:22.788 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.790+0000 7f1f2d864780 1 < completed part key=_multipart_2G3UCYG4R4NM.2~5KB73NQ1UW7W.1 size=924822 2024-09-12T00:34:22.790 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.792+0000 7f1f2d864780 1 < completed multipart upload key=2G3UCYG4R4NM upload=5KB73NQ1UW7W tag=KE38EAE4QA11 type=write size=3021974 2024-09-12T00:34:22.792 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.794+0000 7f1f2d864780 1 > prepared part key=_multipart_9XK59MVZ5G1O.2~CQK9DJQQQ35R.0 size=1048576 2024-09-12T00:34:22.793 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.795+0000 7f1f2d864780 1 > prepared part key=_multipart_9XK59MVZ5G1O.2~CQK9DJQQQ35R.1 size=61430 2024-09-12T00:34:22.793 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.795+0000 7f1f2d864780 1 > prepared multipart upload key=9XK59MVZ5G1O upload=CQK9DJQQQ35R tag=Y48Y6G35H9GZ type=write size=2158582 2024-09-12T00:34:22.794 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.796+0000 7f1f2d864780 1 < completed part key=_multipart_9XK59MVZ5G1O.2~3N8I0FA3CPDJ.0 size=1048576 2024-09-12T00:34:22.795 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.797+0000 7f1f2d864780 1 < completed part key=_multipart_9XK59MVZ5G1O.2~3N8I0FA3CPDJ.1 size=55542 2024-09-12T00:34:22.797 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.799+0000 7f1f2d864780 1 < completed multipart upload key=9XK59MVZ5G1O upload=3N8I0FA3CPDJ tag=GLTTQT7IP13S type=write size=2152694 2024-09-12T00:34:22.798 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.800+0000 7f1f2d864780 1 > prepared operation key=2G3UCYG4R4NM tag=WUJL426IIMR8 type=del size=1073308 2024-09-12T00:34:22.799 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.801+0000 7f1f2d864780 1 < completed delete operation key=KHPF1N1MT33Z tag=EX0UQ4AJ6V4E type=del 2024-09-12T00:34:22.801 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.803+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~WACW40X7YT69.0 size=2728 2024-09-12T00:34:22.801 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.803+0000 7f1f2d864780 1 > prepared multipart upload key=4FRVL0KXN2X8 upload=WACW40X7YT69 tag=M6KV0DTVYKUS type=write size=1051304 2024-09-12T00:34:22.802 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.804+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~ARFBSXRF1A5V.0 size=70180 2024-09-12T00:34:22.804 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.806+0000 7f1f2d864780 1 < completed multipart upload key=1299IOSGYIO9 upload=ARFBSXRF1A5V tag=WPV456AQTYBL type=write size=1118756 2024-09-12T00:34:22.806 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.808+0000 7f1f2d864780 1 > prepared part key=_multipart_S5DVMA14N7VJ.2~1RLLGSTN3Y7L.0 size=1048576 2024-09-12T00:34:22.807 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.809+0000 7f1f2d864780 1 > prepared part key=_multipart_S5DVMA14N7VJ.2~1RLLGSTN3Y7L.1 size=723082 2024-09-12T00:34:22.808 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.809+0000 7f1f2d864780 1 > prepared multipart upload key=S5DVMA14N7VJ upload=1RLLGSTN3Y7L tag=0YDL8NJ1KRHY type=write size=2820234 2024-09-12T00:34:22.808 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.810+0000 7f1f2d864780 1 < completed delete operation key=WKK747ETLW10 tag=Q7K4YLL7RO06 type=del 2024-09-12T00:34:22.810 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.811+0000 7f1f2d864780 1 > prepared operation key=UTR2UUO6DHLJ tag=U1S2AQ6RSV9K type=del size=966575 2024-09-12T00:34:22.812 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.812+0000 7f1f2d864780 1 < completed part key=_multipart_FAP6N3H7SBN0.2~VY4YEHORRA3V.0 size=908711 2024-09-12T00:34:22.813 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.814+0000 7f1f2d864780 1 < completed multipart upload key=FAP6N3H7SBN0 upload=VY4YEHORRA3V tag=QOSPBN778WHT type=write size=1957287 2024-09-12T00:34:22.814 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.816+0000 7f1f2d864780 1 > prepared operation key=2YCGIJRK6MUH tag=7UZK1ZARBNGB type=del size=3605088 2024-09-12T00:34:22.815 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.817+0000 7f1f2d864780 1 < completed delete operation key=S5DVMA14N7VJ tag=52KXA3TQEYMJ type=del 2024-09-12T00:34:22.816 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.818+0000 7f1f2d864780 1 > prepared operation key=WGKEA4EKF5GP tag=QP9EG2MO24VD type=del size=2901871 2024-09-12T00:34:22.817 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.819+0000 7f1f2d864780 1 < completed delete operation key=D21W9QZWY0YU tag=7CL12DVBLI96 type=del 2024-09-12T00:34:22.819 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.820+0000 7f1f2d864780 1 > prepared operation key=53QCNWX1V1R1 tag=NLDHCA3TZNVI type=del size=1109356 2024-09-12T00:34:22.820 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.821+0000 7f1f2d864780 1 < completed write operation key=2RV0899QUJ8W tag=QFYXR5UV195M type=write size=235743 2024-09-12T00:34:22.821 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.823+0000 7f1f2d864780 1 > prepared operation key=0DSQOFS8IIF5 tag=BM6GTJOD0XLB type=write size=968875 2024-09-12T00:34:22.822 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.824+0000 7f1f2d864780 -1 < failed to complete operation key=FAP6N3H7SBN0 tag=WG6UZYVIO6IT type=del size=1818023: (22) Invalid argument 2024-09-12T00:34:22.823 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.825+0000 7f1f2d864780 1 > prepared operation key=ECZYQEZ942W8 tag=ZLOP37E0JWHG type=write size=994767 2024-09-12T00:34:22.825 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.826+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~C6Q52M1T19B5.0 size=1048576 2024-09-12T00:34:22.825 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.827+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~C6Q52M1T19B5.1 size=1048576 2024-09-12T00:34:22.826 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.828+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~C6Q52M1T19B5.2 size=123077 2024-09-12T00:34:22.828 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.830+0000 7f1f2d864780 1 < completed multipart upload key=1299IOSGYIO9 upload=C6Q52M1T19B5 tag=5JAINF6NYYP9 type=write size=3268805 2024-09-12T00:34:22.830 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.831+0000 7f1f2d864780 1 > prepared operation key=WIIU8VTCLWOD tag=4GL9ACCHBCUK type=del size=1602719 2024-09-12T00:34:22.831 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.832+0000 7f1f2d864780 1 < completed delete operation key=OY145ZXRSF4L tag=25JE7S3V6SPS type=del 2024-09-12T00:34:22.832 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.834+0000 7f1f2d864780 1 > prepared operation key=N9RQIGHVL8VP tag=3Z3Y15QL6Z1M type=del size=2340188 2024-09-12T00:34:22.832 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.834+0000 7f1f2d864780 1 < canceled part key=_multipart_1299IOSGYIO9.2~YM74X1JTIIK9.0 size=1048576 2024-09-12T00:34:22.833 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.835+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~YM74X1JTIIK9.1 size=1048576 2024-09-12T00:34:22.834 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.836+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~YM74X1JTIIK9.2 size=625036 2024-09-12T00:34:22.838 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.840+0000 7f1f2d864780 1 < canceled multipart upload key=1299IOSGYIO9 upload=YM74X1JTIIK9 tag=13I51N4295UZ type=write size=3770764 2024-09-12T00:34:22.839 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.841+0000 7f1f2d864780 1 > prepared operation key=W6U30X4HJCB1 tag=9WDMAA8IT93L type=write size=592814 2024-09-12T00:34:22.840 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.842+0000 7f1f2d864780 1 < completed delete operation key=DYKLAY6J018G tag=YMZ03G1GFUY2 type=del 2024-09-12T00:34:22.842 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.844+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~MTTF9OA3G2SX.0 size=926157 2024-09-12T00:34:22.842 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.844+0000 7f1f2d864780 1 > prepared multipart upload key=4FRVL0KXN2X8 upload=MTTF9OA3G2SX tag=UB9IMYK1DND9 type=write size=1974733 2024-09-12T00:34:22.843 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.845+0000 7f1f2d864780 1 < completed part key=_multipart_2YCGIJRK6MUH.2~J56UOTYGN6RH.0 size=369341 2024-09-12T00:34:22.845 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.847+0000 7f1f2d864780 1 < completed multipart upload key=2YCGIJRK6MUH upload=J56UOTYGN6RH tag=3Z1NYNN5MUHI type=write size=1417917 2024-09-12T00:34:22.847 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.848+0000 7f1f2d864780 1 > prepared operation key=2YCGIJRK6MUH tag=MCWG14JIUO22 type=del size=3258152 2024-09-12T00:34:22.849 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.851+0000 7f1f2d864780 1 < suggested remove operation key=S5DVMA14N7VJ tag=T1GUPQ3TD3A0 type=del 2024-09-12T00:34:22.850 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.852+0000 7f1f2d864780 1 > prepared operation key=ECZYQEZ942W8 tag=X9A2FIJF0RRZ type=del size=4023314 2024-09-12T00:34:22.851 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.853+0000 7f1f2d864780 1 < completed part key=_multipart_9XK59MVZ5G1O.2~CQK9DJQQQ35R.0 size=1048576 2024-09-12T00:34:22.852 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.854+0000 7f1f2d864780 1 < completed part key=_multipart_9XK59MVZ5G1O.2~CQK9DJQQQ35R.1 size=61430 2024-09-12T00:34:22.854 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.856+0000 7f1f2d864780 1 < completed multipart upload key=9XK59MVZ5G1O upload=CQK9DJQQQ35R tag=Y48Y6G35H9GZ type=write size=2158582 2024-09-12T00:34:22.855 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.857+0000 7f1f2d864780 1 > prepared operation key=GSPM8N0K7ODC tag=J1B9KR8QKOKP type=write size=584973 2024-09-12T00:34:22.858 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.860+0000 7f1f2d864780 1 < completed delete operation key=2G3UCYG4R4NM tag=WUJL426IIMR8 type=del 2024-09-12T00:34:22.860 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.862+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~TN0PZXQW5NU0.0 size=190211 2024-09-12T00:34:22.860 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.862+0000 7f1f2d864780 1 > prepared multipart upload key=W6U30X4HJCB1 upload=TN0PZXQW5NU0 tag=M6X8H99T04J3 type=write size=1238787 2024-09-12T00:34:22.862 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.863+0000 7f1f2d864780 1 < completed part key=_multipart_4FRVL0KXN2X8.2~WACW40X7YT69.0 size=2728 2024-09-12T00:34:22.864 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.866+0000 7f1f2d864780 1 < completed multipart upload key=4FRVL0KXN2X8 upload=WACW40X7YT69 tag=M6KV0DTVYKUS type=write size=1051304 2024-09-12T00:34:22.865 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.867+0000 7f1f2d864780 1 > prepared operation key=2G3UCYG4R4NM tag=3QZSOCLZYD5X type=del size=2076211 2024-09-12T00:34:22.866 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.868+0000 7f1f2d864780 1 < completed part key=_multipart_S5DVMA14N7VJ.2~1RLLGSTN3Y7L.0 size=1048576 2024-09-12T00:34:22.867 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.869+0000 7f1f2d864780 1 < completed part key=_multipart_S5DVMA14N7VJ.2~1RLLGSTN3Y7L.1 size=723082 2024-09-12T00:34:22.869 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.871+0000 7f1f2d864780 1 < completed multipart upload key=S5DVMA14N7VJ upload=1RLLGSTN3Y7L tag=0YDL8NJ1KRHY type=write size=2820234 2024-09-12T00:34:22.870 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.872+0000 7f1f2d864780 1 > prepared operation key=SNCGB6Z20450 tag=UNGX5ACG7QZS type=del size=2200523 2024-09-12T00:34:22.871 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.873+0000 7f1f2d864780 1 < completed delete operation key=UTR2UUO6DHLJ tag=U1S2AQ6RSV9K type=del 2024-09-12T00:34:22.873 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.874+0000 7f1f2d864780 1 > prepared operation key=3Z1TGGPZKJ69 tag=RP4GBC58F89I type=del size=1987498 2024-09-12T00:34:22.874 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.875+0000 7f1f2d864780 1 < completed delete operation key=2YCGIJRK6MUH tag=7UZK1ZARBNGB type=del 2024-09-12T00:34:22.876 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.877+0000 7f1f2d864780 1 > prepared part key=_multipart_53QCNWX1V1R1.2~7T6K3YPRRHF3.0 size=496559 2024-09-12T00:34:22.876 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.877+0000 7f1f2d864780 1 > prepared multipart upload key=53QCNWX1V1R1 upload=7T6K3YPRRHF3 tag=Y7L2A2AOFTLY type=write size=1545135 2024-09-12T00:34:22.877 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.878+0000 7f1f2d864780 1 < completed delete operation key=WGKEA4EKF5GP tag=QP9EG2MO24VD type=del 2024-09-12T00:34:22.879 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.881+0000 7f1f2d864780 1 > prepared part key=_multipart_ECZYQEZ942W8.2~LDKZKKF5YC9U.0 size=887459 2024-09-12T00:34:22.879 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.881+0000 7f1f2d864780 1 > prepared multipart upload key=ECZYQEZ942W8 upload=LDKZKKF5YC9U tag=K9O4NXKEV11X type=write size=1936035 2024-09-12T00:34:22.880 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.882+0000 7f1f2d864780 1 < completed delete operation key=53QCNWX1V1R1 tag=NLDHCA3TZNVI type=del 2024-09-12T00:34:22.881 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.883+0000 7f1f2d864780 1 > prepared operation key=2YCGIJRK6MUH tag=UXB7IJXLVSRA type=del size=1400837 2024-09-12T00:34:22.883 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.884+0000 7f1f2d864780 1 < completed write operation key=0DSQOFS8IIF5 tag=BM6GTJOD0XLB type=write size=968875 2024-09-12T00:34:22.884 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.886+0000 7f1f2d864780 1 > prepared part key=_multipart_MSGU3PHLBRJH.2~6A5MXDOTZKN4.0 size=2095 2024-09-12T00:34:22.885 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.886+0000 7f1f2d864780 1 > prepared multipart upload key=MSGU3PHLBRJH upload=6A5MXDOTZKN4 tag=E5BGY0EECK52 type=write size=1050671 2024-09-12T00:34:22.885 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.887+0000 7f1f2d864780 1 < completed write operation key=ECZYQEZ942W8 tag=ZLOP37E0JWHG type=write size=994767 2024-09-12T00:34:22.887 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.888+0000 7f1f2d864780 1 > prepared operation key=MSGU3PHLBRJH tag=8E3YHGAX2FRL type=del size=2685628 2024-09-12T00:34:22.888 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.890+0000 7f1f2d864780 1 < completed delete operation key=WIIU8VTCLWOD tag=4GL9ACCHBCUK type=del 2024-09-12T00:34:22.889 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.891+0000 7f1f2d864780 1 > prepared operation key=AN26EVAZI527 tag=QCEXPLE6DWX1 type=del size=2503280 2024-09-12T00:34:22.890 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.892+0000 7f1f2d864780 1 < completed delete operation key=N9RQIGHVL8VP tag=3Z3Y15QL6Z1M type=del 2024-09-12T00:34:22.893 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.895+0000 7f1f2d864780 1 > prepared operation key=W6U30X4HJCB1 tag=9T3XA6L943YT type=del size=3330769 2024-09-12T00:34:22.895 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.896+0000 7f1f2d864780 1 < completed write operation key=W6U30X4HJCB1 tag=9WDMAA8IT93L type=write size=592814 2024-09-12T00:34:22.897 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.898+0000 7f1f2d864780 1 > prepared part key=_multipart_WIIU8VTCLWOD.2~O4DA260Q54DF.0 size=1048576 2024-09-12T00:34:22.897 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.899+0000 7f1f2d864780 1 > prepared part key=_multipart_WIIU8VTCLWOD.2~O4DA260Q54DF.1 size=481766 2024-09-12T00:34:22.897 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.899+0000 7f1f2d864780 1 > prepared multipart upload key=WIIU8VTCLWOD upload=O4DA260Q54DF tag=9JPLYIO2ZF81 type=write size=2578918 2024-09-12T00:34:22.898 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.900+0000 7f1f2d864780 1 < completed part key=_multipart_4FRVL0KXN2X8.2~MTTF9OA3G2SX.0 size=926157 2024-09-12T00:34:22.900 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.902+0000 7f1f2d864780 1 < completed multipart upload key=4FRVL0KXN2X8 upload=MTTF9OA3G2SX tag=UB9IMYK1DND9 type=write size=1974733 2024-09-12T00:34:22.901 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.903+0000 7f1f2d864780 1 > prepared operation key=UTR2UUO6DHLJ tag=1I82I95YOQ4W type=del size=2227897 2024-09-12T00:34:22.903 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.904+0000 7f1f2d864780 1 < completed delete operation key=2YCGIJRK6MUH tag=MCWG14JIUO22 type=del 2024-09-12T00:34:22.904 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.905+0000 7f1f2d864780 1 > prepared operation key=W6U30X4HJCB1 tag=5YM2C9HILDY3 type=del size=1454946 2024-09-12T00:34:22.905 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.906+0000 7f1f2d864780 1 < completed delete operation key=ECZYQEZ942W8 tag=X9A2FIJF0RRZ type=del 2024-09-12T00:34:22.906 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.908+0000 7f1f2d864780 1 > prepared operation key=WKK747ETLW10 tag=JFPZ0IWIO334 type=del size=117434 2024-09-12T00:34:22.907 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.909+0000 7f1f2d864780 1 < completed write operation key=GSPM8N0K7ODC tag=J1B9KR8QKOKP type=write size=584973 2024-09-12T00:34:22.908 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.910+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=94NTKOK5H1EL type=del size=1889446 2024-09-12T00:34:22.909 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.911+0000 7f1f2d864780 1 < completed part key=_multipart_W6U30X4HJCB1.2~TN0PZXQW5NU0.0 size=190211 2024-09-12T00:34:22.911 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.913+0000 7f1f2d864780 1 < completed multipart upload key=W6U30X4HJCB1 upload=TN0PZXQW5NU0 tag=M6X8H99T04J3 type=write size=1238787 2024-09-12T00:34:22.913 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.915+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~WDDV9BIVTT6O.0 size=1048576 2024-09-12T00:34:22.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.916+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~WDDV9BIVTT6O.1 size=1048576 2024-09-12T00:34:22.915 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.917+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~WDDV9BIVTT6O.2 size=821247 2024-09-12T00:34:22.915 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.917+0000 7f1f2d864780 1 > prepared multipart upload key=WGKEA4EKF5GP upload=WDDV9BIVTT6O tag=VO55WING8ZI9 type=write size=3966975 2024-09-12T00:34:22.916 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.918+0000 7f1f2d864780 1 < canceled operation key=2G3UCYG4R4NM tag=3QZSOCLZYD5X type=del size=2076211 2024-09-12T00:34:22.917 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.919+0000 7f1f2d864780 1 > prepared operation key=WKK747ETLW10 tag=M7A71OJ6QO4A type=del size=3831054 2024-09-12T00:34:22.918 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.920+0000 7f1f2d864780 1 < completed delete operation key=SNCGB6Z20450 tag=UNGX5ACG7QZS type=del 2024-09-12T00:34:22.920 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.921+0000 7f1f2d864780 1 > prepared operation key=UTR2UUO6DHLJ tag=I51P574DD12I type=del size=902210 2024-09-12T00:34:22.922 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.924+0000 7f1f2d864780 1 < suggested update operation key=3Z1TGGPZKJ69 tag=RP4GBC58F89I type=del size=1987498 2024-09-12T00:34:22.924 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.926+0000 7f1f2d864780 1 > prepared part key=_multipart_PVB52GO6L8T4.2~1PJLI8HXGY71.0 size=1048576 2024-09-12T00:34:22.925 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.927+0000 7f1f2d864780 1 > prepared part key=_multipart_PVB52GO6L8T4.2~1PJLI8HXGY71.1 size=1048576 2024-09-12T00:34:22.926 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.928+0000 7f1f2d864780 1 > prepared part key=_multipart_PVB52GO6L8T4.2~1PJLI8HXGY71.2 size=654873 2024-09-12T00:34:22.926 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.928+0000 7f1f2d864780 1 > prepared multipart upload key=PVB52GO6L8T4 upload=1PJLI8HXGY71 tag=VXBFMRT9YU0P type=write size=3800601 2024-09-12T00:34:22.927 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.929+0000 7f1f2d864780 1 < completed part key=_multipart_53QCNWX1V1R1.2~7T6K3YPRRHF3.0 size=496559 2024-09-12T00:34:22.929 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.931+0000 7f1f2d864780 1 < completed multipart upload key=53QCNWX1V1R1 upload=7T6K3YPRRHF3 tag=Y7L2A2AOFTLY type=write size=1545135 2024-09-12T00:34:22.931 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.933+0000 7f1f2d864780 1 > prepared part key=_multipart_DYKLAY6J018G.2~1FJ6V75UA335.0 size=936709 2024-09-12T00:34:22.931 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.933+0000 7f1f2d864780 1 > prepared multipart upload key=DYKLAY6J018G upload=1FJ6V75UA335 tag=1USFL24P5LVW type=write size=1985285 2024-09-12T00:34:22.933 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.934+0000 7f1f2d864780 1 < completed part key=_multipart_ECZYQEZ942W8.2~LDKZKKF5YC9U.0 size=887459 2024-09-12T00:34:22.934 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.936+0000 7f1f2d864780 1 < completed multipart upload key=ECZYQEZ942W8 upload=LDKZKKF5YC9U tag=K9O4NXKEV11X type=write size=1936035 2024-09-12T00:34:22.936 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.937+0000 7f1f2d864780 1 > prepared operation key=MSGU3PHLBRJH tag=LX4PRADOBDIB type=del size=3002224 2024-09-12T00:34:22.937 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.939+0000 7f1f2d864780 1 < completed delete operation key=2YCGIJRK6MUH tag=UXB7IJXLVSRA type=del 2024-09-12T00:34:22.939 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.941+0000 7f1f2d864780 1 > prepared part key=_multipart_ECZYQEZ942W8.2~W00VD9R9FC9F.0 size=1048576 2024-09-12T00:34:22.940 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.942+0000 7f1f2d864780 1 > prepared part key=_multipart_ECZYQEZ942W8.2~W00VD9R9FC9F.1 size=968823 2024-09-12T00:34:22.940 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.942+0000 7f1f2d864780 1 > prepared multipart upload key=ECZYQEZ942W8 upload=W00VD9R9FC9F tag=KZD9RU180KDI type=write size=3065975 2024-09-12T00:34:22.941 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.943+0000 7f1f2d864780 1 < completed part key=_multipart_MSGU3PHLBRJH.2~6A5MXDOTZKN4.0 size=2095 2024-09-12T00:34:22.944 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.945+0000 7f1f2d864780 1 < completed multipart upload key=MSGU3PHLBRJH upload=6A5MXDOTZKN4 tag=E5BGY0EECK52 type=write size=1050671 2024-09-12T00:34:22.945 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.946+0000 7f1f2d864780 1 > prepared operation key=1299IOSGYIO9 tag=F736KWCLACSY type=write size=384527 2024-09-12T00:34:22.946 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.947+0000 7f1f2d864780 1 < completed delete operation key=MSGU3PHLBRJH tag=8E3YHGAX2FRL type=del 2024-09-12T00:34:22.947 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.949+0000 7f1f2d864780 1 > prepared operation key=WKK747ETLW10 tag=DRQB25ZSF4F1 type=del size=4120186 2024-09-12T00:34:22.948 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.950+0000 7f1f2d864780 1 < completed delete operation key=AN26EVAZI527 tag=QCEXPLE6DWX1 type=del 2024-09-12T00:34:22.950 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.952+0000 7f1f2d864780 1 > prepared part key=_multipart_O1YY03BOEYLM.2~VV3FRDGTT38U.0 size=1048576 2024-09-12T00:34:22.951 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.953+0000 7f1f2d864780 1 > prepared part key=_multipart_O1YY03BOEYLM.2~VV3FRDGTT38U.1 size=1048576 2024-09-12T00:34:22.952 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.954+0000 7f1f2d864780 1 > prepared part key=_multipart_O1YY03BOEYLM.2~VV3FRDGTT38U.2 size=638629 2024-09-12T00:34:22.952 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.954+0000 7f1f2d864780 1 > prepared multipart upload key=O1YY03BOEYLM upload=VV3FRDGTT38U tag=S3XY92XL64D2 type=write size=3784357 2024-09-12T00:34:22.953 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.955+0000 7f1f2d864780 1 < completed delete operation key=W6U30X4HJCB1 tag=9T3XA6L943YT type=del 2024-09-12T00:34:22.955 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.957+0000 7f1f2d864780 1 > prepared part key=_multipart_KHPF1N1MT33Z.2~Y4ERP9QZ4I8H.0 size=1048576 2024-09-12T00:34:22.956 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.958+0000 7f1f2d864780 1 > prepared part key=_multipart_KHPF1N1MT33Z.2~Y4ERP9QZ4I8H.1 size=525788 2024-09-12T00:34:22.956 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.958+0000 7f1f2d864780 1 > prepared multipart upload key=KHPF1N1MT33Z upload=Y4ERP9QZ4I8H tag=PVW2KKI59BVC type=write size=2622940 2024-09-12T00:34:22.957 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.959+0000 7f1f2d864780 1 < completed part key=_multipart_WIIU8VTCLWOD.2~O4DA260Q54DF.0 size=1048576 2024-09-12T00:34:22.958 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.960+0000 7f1f2d864780 1 < completed part key=_multipart_WIIU8VTCLWOD.2~O4DA260Q54DF.1 size=481766 2024-09-12T00:34:22.960 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.962+0000 7f1f2d864780 1 < completed multipart upload key=WIIU8VTCLWOD upload=O4DA260Q54DF tag=9JPLYIO2ZF81 type=write size=2578918 2024-09-12T00:34:22.961 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.963+0000 7f1f2d864780 1 > prepared operation key=KHPF1N1MT33Z tag=5KMUK2T1WQ2G type=del size=1823903 2024-09-12T00:34:22.964 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.965+0000 7f1f2d864780 1 < suggested remove operation key=UTR2UUO6DHLJ tag=1I82I95YOQ4W type=del 2024-09-12T00:34:22.966 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.967+0000 7f1f2d864780 1 > prepared part key=_multipart_UTR2UUO6DHLJ.2~2ZPU1A3TWVN0.0 size=1048576 2024-09-12T00:34:22.967 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.968+0000 7f1f2d864780 1 > prepared part key=_multipart_UTR2UUO6DHLJ.2~2ZPU1A3TWVN0.1 size=1048576 2024-09-12T00:34:22.969 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.970+0000 7f1f2d864780 1 > prepared part key=_multipart_UTR2UUO6DHLJ.2~2ZPU1A3TWVN0.2 size=55404 2024-09-12T00:34:22.969 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.970+0000 7f1f2d864780 1 > prepared multipart upload key=UTR2UUO6DHLJ upload=2ZPU1A3TWVN0 tag=V93KPX1YMUXZ type=write size=3201132 2024-09-12T00:34:22.971 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.972+0000 7f1f2d864780 1 < suggested remove operation key=W6U30X4HJCB1 tag=5YM2C9HILDY3 type=del 2024-09-12T00:34:22.972 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.974+0000 7f1f2d864780 1 > prepared operation key=O1YY03BOEYLM tag=GRIYTCMIPIKO type=del size=512678 2024-09-12T00:34:22.973 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.975+0000 7f1f2d864780 1 < completed delete operation key=WKK747ETLW10 tag=JFPZ0IWIO334 type=del 2024-09-12T00:34:22.975 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.977+0000 7f1f2d864780 1 > prepared operation key=2G3UCYG4R4NM tag=7EUGEDXPRZLT type=write size=343927 2024-09-12T00:34:22.976 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.978+0000 7f1f2d864780 1 < completed delete operation key=2RV0899QUJ8W tag=94NTKOK5H1EL type=del 2024-09-12T00:34:22.980 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.982+0000 7f1f2d864780 1 > prepared part key=_multipart_AN26EVAZI527.2~LH0AVGXSTJR8.0 size=1048576 2024-09-12T00:34:22.981 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.983+0000 7f1f2d864780 1 > prepared part key=_multipart_AN26EVAZI527.2~LH0AVGXSTJR8.1 size=1048576 2024-09-12T00:34:22.982 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.983+0000 7f1f2d864780 1 > prepared part key=_multipart_AN26EVAZI527.2~LH0AVGXSTJR8.2 size=185616 2024-09-12T00:34:22.982 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.983+0000 7f1f2d864780 1 > prepared multipart upload key=AN26EVAZI527 upload=LH0AVGXSTJR8 tag=W6B84QN0TGLQ type=write size=3331344 2024-09-12T00:34:22.983 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.984+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~WDDV9BIVTT6O.0 size=1048576 2024-09-12T00:34:22.984 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.985+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~WDDV9BIVTT6O.1 size=1048576 2024-09-12T00:34:22.985 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.986+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~WDDV9BIVTT6O.2 size=821247 2024-09-12T00:34:22.986 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.988+0000 7f1f2d864780 1 < completed multipart upload key=WGKEA4EKF5GP upload=WDDV9BIVTT6O tag=VO55WING8ZI9 type=write size=3966975 2024-09-12T00:34:22.989 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.990+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~ZXNE4XL6CVTL.0 size=1048576 2024-09-12T00:34:22.990 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.991+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~ZXNE4XL6CVTL.1 size=612891 2024-09-12T00:34:22.990 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.991+0000 7f1f2d864780 1 > prepared multipart upload key=WGKEA4EKF5GP upload=ZXNE4XL6CVTL tag=DYE171Q1FX0O type=write size=2710043 2024-09-12T00:34:22.992 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.994+0000 7f1f2d864780 1 < suggested remove operation key=WKK747ETLW10 tag=M7A71OJ6QO4A type=del 2024-09-12T00:34:22.993 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.995+0000 7f1f2d864780 1 > prepared operation key=FFG41OYEYFZA tag=EMPNTIOOH22Y type=del size=672739 2024-09-12T00:34:22.994 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.996+0000 7f1f2d864780 -1 < failed to complete operation key=UTR2UUO6DHLJ tag=I51P574DD12I type=del size=902210: (22) Invalid argument 2024-09-12T00:34:22.995 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.997+0000 7f1f2d864780 1 > prepared operation key=53QCNWX1V1R1 tag=VLFRKDDEPUQJ type=del size=1862095 2024-09-12T00:34:22.996 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.997+0000 7f1f2d864780 1 < canceled part key=_multipart_PVB52GO6L8T4.2~1PJLI8HXGY71.0 size=1048576 2024-09-12T00:34:22.997 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.998+0000 7f1f2d864780 1 < completed part key=_multipart_PVB52GO6L8T4.2~1PJLI8HXGY71.1 size=1048576 2024-09-12T00:34:22.997 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:22.998+0000 7f1f2d864780 1 < canceled part key=_multipart_PVB52GO6L8T4.2~1PJLI8HXGY71.2 size=654873 2024-09-12T00:34:22.998 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.000+0000 7f1f2d864780 1 < canceled multipart upload key=PVB52GO6L8T4 upload=1PJLI8HXGY71 tag=VXBFMRT9YU0P type=write size=3800601 2024-09-12T00:34:23.000 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.001+0000 7f1f2d864780 1 > prepared operation key=2G3UCYG4R4NM tag=1THRH4LY00JH type=del size=194833 2024-09-12T00:34:23.001 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.002+0000 7f1f2d864780 1 < completed part key=_multipart_DYKLAY6J018G.2~1FJ6V75UA335.0 size=936709 2024-09-12T00:34:23.002 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.004+0000 7f1f2d864780 1 < completed multipart upload key=DYKLAY6J018G upload=1FJ6V75UA335 tag=1USFL24P5LVW type=write size=1985285 2024-09-12T00:34:23.004 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.005+0000 7f1f2d864780 1 > prepared operation key=OY145ZXRSF4L tag=87IJYHYG077N type=del size=2609860 2024-09-12T00:34:23.005 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.006+0000 7f1f2d864780 1 < completed delete operation key=MSGU3PHLBRJH tag=LX4PRADOBDIB type=del 2024-09-12T00:34:23.007 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.009+0000 7f1f2d864780 1 > prepared part key=_multipart_S5DVMA14N7VJ.2~WF9C4BT6NJNS.0 size=1048576 2024-09-12T00:34:23.008 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.010+0000 7f1f2d864780 1 > prepared part key=_multipart_S5DVMA14N7VJ.2~WF9C4BT6NJNS.1 size=492649 2024-09-12T00:34:23.008 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.010+0000 7f1f2d864780 1 > prepared multipart upload key=S5DVMA14N7VJ upload=WF9C4BT6NJNS tag=IXM7QTX2G52P type=write size=2589801 2024-09-12T00:34:23.009 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.011+0000 7f1f2d864780 1 < completed part key=_multipart_ECZYQEZ942W8.2~W00VD9R9FC9F.0 size=1048576 2024-09-12T00:34:23.010 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.012+0000 7f1f2d864780 1 < completed part key=_multipart_ECZYQEZ942W8.2~W00VD9R9FC9F.1 size=968823 2024-09-12T00:34:23.012 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.014+0000 7f1f2d864780 1 < completed multipart upload key=ECZYQEZ942W8 upload=W00VD9R9FC9F tag=KZD9RU180KDI type=write size=3065975 2024-09-12T00:34:23.013 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.015+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=QORHSJ1U7GHF type=del size=3658836 2024-09-12T00:34:23.014 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.016+0000 7f1f2d864780 1 < completed write operation key=1299IOSGYIO9 tag=F736KWCLACSY type=write size=384527 2024-09-12T00:34:23.016 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.018+0000 7f1f2d864780 1 > prepared part key=_multipart_2RV0899QUJ8W.2~GFI15CEAAMM2.0 size=909291 2024-09-12T00:34:23.017 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.018+0000 7f1f2d864780 1 > prepared multipart upload key=2RV0899QUJ8W upload=GFI15CEAAMM2 tag=27O191LO0QUD type=write size=1957867 2024-09-12T00:34:23.017 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.019+0000 7f1f2d864780 -1 < failed to complete operation key=WKK747ETLW10 tag=DRQB25ZSF4F1 type=del size=4120186: (22) Invalid argument 2024-09-12T00:34:23.020 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.021+0000 7f1f2d864780 1 > prepared part key=_multipart_53QCNWX1V1R1.2~JU0YSTSH3MYT.0 size=989583 2024-09-12T00:34:23.020 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.021+0000 7f1f2d864780 1 > prepared multipart upload key=53QCNWX1V1R1 upload=JU0YSTSH3MYT tag=C4R3H6ILSF38 type=write size=2038159 2024-09-12T00:34:23.021 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.022+0000 7f1f2d864780 1 < completed part key=_multipart_O1YY03BOEYLM.2~VV3FRDGTT38U.0 size=1048576 2024-09-12T00:34:23.021 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.022+0000 7f1f2d864780 1 < canceled part key=_multipart_O1YY03BOEYLM.2~VV3FRDGTT38U.1 size=1048576 2024-09-12T00:34:23.022 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.023+0000 7f1f2d864780 1 < completed part key=_multipart_O1YY03BOEYLM.2~VV3FRDGTT38U.2 size=638629 2024-09-12T00:34:23.024 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.025+0000 7f1f2d864780 1 < canceled multipart upload key=O1YY03BOEYLM upload=VV3FRDGTT38U tag=S3XY92XL64D2 type=write size=3784357 2024-09-12T00:34:23.025 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.026+0000 7f1f2d864780 1 > prepared operation key=WIIU8VTCLWOD tag=203FIJCH5KG2 type=del size=1209335 2024-09-12T00:34:23.026 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.028+0000 7f1f2d864780 1 < completed part key=_multipart_KHPF1N1MT33Z.2~Y4ERP9QZ4I8H.0 size=1048576 2024-09-12T00:34:23.027 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.029+0000 7f1f2d864780 1 < completed part key=_multipart_KHPF1N1MT33Z.2~Y4ERP9QZ4I8H.1 size=525788 2024-09-12T00:34:23.029 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.031+0000 7f1f2d864780 1 < completed multipart upload key=KHPF1N1MT33Z upload=Y4ERP9QZ4I8H tag=PVW2KKI59BVC type=write size=2622940 2024-09-12T00:34:23.031 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.032+0000 7f1f2d864780 1 > prepared operation key=FFG41OYEYFZA tag=H966QKV98N5X type=del size=3793182 2024-09-12T00:34:23.031 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.033+0000 7f1f2d864780 1 < completed delete operation key=KHPF1N1MT33Z tag=5KMUK2T1WQ2G type=del 2024-09-12T00:34:23.033 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.034+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=U7BD3HS5E6YR type=write size=489459 2024-09-12T00:34:23.034 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.035+0000 7f1f2d864780 1 < completed part key=_multipart_UTR2UUO6DHLJ.2~2ZPU1A3TWVN0.0 size=1048576 2024-09-12T00:34:23.035 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.036+0000 7f1f2d864780 1 < completed part key=_multipart_UTR2UUO6DHLJ.2~2ZPU1A3TWVN0.1 size=1048576 2024-09-12T00:34:23.036 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.037+0000 7f1f2d864780 1 < completed part key=_multipart_UTR2UUO6DHLJ.2~2ZPU1A3TWVN0.2 size=55404 2024-09-12T00:34:23.037 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.039+0000 7f1f2d864780 1 < completed multipart upload key=UTR2UUO6DHLJ upload=2ZPU1A3TWVN0 tag=V93KPX1YMUXZ type=write size=3201132 2024-09-12T00:34:23.040 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.041+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~7EGN1X60BAPP.0 size=661492 2024-09-12T00:34:23.040 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.041+0000 7f1f2d864780 1 > prepared multipart upload key=SZP418NVZ5VX upload=7EGN1X60BAPP tag=P8DMDY4ZI4S0 type=write size=1710068 2024-09-12T00:34:23.041 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.042+0000 7f1f2d864780 1 < canceled operation key=O1YY03BOEYLM tag=GRIYTCMIPIKO type=del size=512678 2024-09-12T00:34:23.042 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.043+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=3DQ71O23RRW7 type=write size=927860 2024-09-12T00:34:23.043 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.045+0000 7f1f2d864780 1 < completed write operation key=2G3UCYG4R4NM tag=7EUGEDXPRZLT type=write size=343927 2024-09-12T00:34:23.045 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.047+0000 7f1f2d864780 1 > prepared part key=_multipart_KHPF1N1MT33Z.2~P783FS3WDQDN.0 size=1048576 2024-09-12T00:34:23.046 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.048+0000 7f1f2d864780 1 > prepared part key=_multipart_KHPF1N1MT33Z.2~P783FS3WDQDN.1 size=697284 2024-09-12T00:34:23.046 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.048+0000 7f1f2d864780 1 > prepared multipart upload key=KHPF1N1MT33Z upload=P783FS3WDQDN tag=GM7ZJIQZ8YQG type=write size=2794436 2024-09-12T00:34:23.047 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.049+0000 7f1f2d864780 1 < completed part key=_multipart_AN26EVAZI527.2~LH0AVGXSTJR8.0 size=1048576 2024-09-12T00:34:23.048 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.050+0000 7f1f2d864780 1 < completed part key=_multipart_AN26EVAZI527.2~LH0AVGXSTJR8.1 size=1048576 2024-09-12T00:34:23.049 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.051+0000 7f1f2d864780 1 < completed part key=_multipart_AN26EVAZI527.2~LH0AVGXSTJR8.2 size=185616 2024-09-12T00:34:23.051 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.053+0000 7f1f2d864780 1 < completed multipart upload key=AN26EVAZI527 upload=LH0AVGXSTJR8 tag=W6B84QN0TGLQ type=write size=3331344 2024-09-12T00:34:23.053 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.055+0000 7f1f2d864780 1 > prepared part key=_multipart_ECZYQEZ942W8.2~C97A5RPB4NYB.0 size=200729 2024-09-12T00:34:23.053 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.055+0000 7f1f2d864780 1 > prepared multipart upload key=ECZYQEZ942W8 upload=C97A5RPB4NYB tag=2GTA93YWC6R4 type=write size=1249305 2024-09-12T00:34:23.054 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.056+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~ZXNE4XL6CVTL.0 size=1048576 2024-09-12T00:34:23.054 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.056+0000 7f1f2d864780 1 < canceled part key=_multipart_WGKEA4EKF5GP.2~ZXNE4XL6CVTL.1 size=612891 2024-09-12T00:34:23.056 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.058+0000 7f1f2d864780 1 < canceled multipart upload key=WGKEA4EKF5GP upload=ZXNE4XL6CVTL tag=DYE171Q1FX0O type=write size=2710043 2024-09-12T00:34:23.057 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.059+0000 7f1f2d864780 1 > prepared operation key=SNCGB6Z20450 tag=UOOUV0YRG6PZ type=write size=126231 2024-09-12T00:34:23.058 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.060+0000 7f1f2d864780 1 < completed delete operation key=FFG41OYEYFZA tag=EMPNTIOOH22Y type=del 2024-09-12T00:34:23.060 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.062+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~SM7VS4QPNWSF.0 size=43167 2024-09-12T00:34:23.061 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.062+0000 7f1f2d864780 1 > prepared multipart upload key=0DSQOFS8IIF5 upload=SM7VS4QPNWSF tag=K7XSNV7RPI10 type=write size=1091743 2024-09-12T00:34:23.063 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.064+0000 7f1f2d864780 1 < suggested update operation key=53QCNWX1V1R1 tag=VLFRKDDEPUQJ type=del size=1862095 2024-09-12T00:34:23.065 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.067+0000 7f1f2d864780 1 > prepared part key=_multipart_WIIU8VTCLWOD.2~L8C1FPZEO3VR.0 size=615236 2024-09-12T00:34:23.065 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.067+0000 7f1f2d864780 1 > prepared multipart upload key=WIIU8VTCLWOD upload=L8C1FPZEO3VR tag=D86FK59HG085 type=write size=1663812 2024-09-12T00:34:23.066 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.068+0000 7f1f2d864780 1 < canceled operation key=2G3UCYG4R4NM tag=1THRH4LY00JH type=del size=194833 2024-09-12T00:34:23.068 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.070+0000 7f1f2d864780 1 > prepared part key=_multipart_N9RQIGHVL8VP.2~5DGNO1J4F0ZH.0 size=1048576 2024-09-12T00:34:23.069 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.071+0000 7f1f2d864780 1 > prepared part key=_multipart_N9RQIGHVL8VP.2~5DGNO1J4F0ZH.1 size=652216 2024-09-12T00:34:23.069 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.071+0000 7f1f2d864780 1 > prepared multipart upload key=N9RQIGHVL8VP upload=5DGNO1J4F0ZH tag=0BTIDRPDMVMH type=write size=2749368 2024-09-12T00:34:23.070 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.072+0000 7f1f2d864780 1 < completed delete operation key=OY145ZXRSF4L tag=87IJYHYG077N type=del 2024-09-12T00:34:23.072 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.073+0000 7f1f2d864780 1 > prepared operation key=W6U30X4HJCB1 tag=S69AXHF87BFY type=del size=3053047 2024-09-12T00:34:23.073 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.075+0000 7f1f2d864780 1 < completed part key=_multipart_S5DVMA14N7VJ.2~WF9C4BT6NJNS.0 size=1048576 2024-09-12T00:34:23.074 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.075+0000 7f1f2d864780 1 < completed part key=_multipart_S5DVMA14N7VJ.2~WF9C4BT6NJNS.1 size=492649 2024-09-12T00:34:23.076 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.078+0000 7f1f2d864780 1 < completed multipart upload key=S5DVMA14N7VJ upload=WF9C4BT6NJNS tag=IXM7QTX2G52P type=write size=2589801 2024-09-12T00:34:23.078 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.080+0000 7f1f2d864780 1 > prepared part key=_multipart_KHPF1N1MT33Z.2~86CT0MU0GOK7.0 size=1048576 2024-09-12T00:34:23.079 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.081+0000 7f1f2d864780 1 > prepared part key=_multipart_KHPF1N1MT33Z.2~86CT0MU0GOK7.1 size=370377 2024-09-12T00:34:23.079 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.081+0000 7f1f2d864780 1 > prepared multipart upload key=KHPF1N1MT33Z upload=86CT0MU0GOK7 tag=1IZBVUFJ8OT2 type=write size=2467529 2024-09-12T00:34:23.080 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.082+0000 7f1f2d864780 1 < completed delete operation key=2RV0899QUJ8W tag=QORHSJ1U7GHF type=del 2024-09-12T00:34:23.082 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.083+0000 7f1f2d864780 1 > prepared operation key=1299IOSGYIO9 tag=JNHXZJDV10XZ type=write size=439948 2024-09-12T00:34:23.084 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.086+0000 7f1f2d864780 1 < completed part key=_multipart_2RV0899QUJ8W.2~GFI15CEAAMM2.0 size=909291 2024-09-12T00:34:23.086 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.088+0000 7f1f2d864780 1 < completed multipart upload key=2RV0899QUJ8W upload=GFI15CEAAMM2 tag=27O191LO0QUD type=write size=1957867 2024-09-12T00:34:23.087 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.089+0000 7f1f2d864780 1 > prepared operation key=SZP418NVZ5VX tag=E5U6E7ZKGAXU type=del size=3708083 2024-09-12T00:34:23.088 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.090+0000 7f1f2d864780 1 < completed part key=_multipart_53QCNWX1V1R1.2~JU0YSTSH3MYT.0 size=989583 2024-09-12T00:34:23.090 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.092+0000 7f1f2d864780 1 < completed multipart upload key=53QCNWX1V1R1 upload=JU0YSTSH3MYT tag=C4R3H6ILSF38 type=write size=2038159 2024-09-12T00:34:23.091 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.093+0000 7f1f2d864780 1 > prepared operation key=2YCGIJRK6MUH tag=AHKCQ602D5WM type=del size=1074826 2024-09-12T00:34:23.092 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.094+0000 7f1f2d864780 1 < completed delete operation key=WIIU8VTCLWOD tag=203FIJCH5KG2 type=del 2024-09-12T00:34:23.095 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.096+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~MSUCTSOLC865.0 size=152555 2024-09-12T00:34:23.095 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.096+0000 7f1f2d864780 1 > prepared multipart upload key=W6U30X4HJCB1 upload=MSUCTSOLC865 tag=O813IMPC4YXD type=write size=1201131 2024-09-12T00:34:23.096 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.097+0000 7f1f2d864780 1 < completed delete operation key=FFG41OYEYFZA tag=H966QKV98N5X type=del 2024-09-12T00:34:23.097 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.098+0000 7f1f2d864780 1 > prepared operation key=WIIU8VTCLWOD tag=XFIO6XODIFAB type=del size=1810221 2024-09-12T00:34:23.098 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.099+0000 7f1f2d864780 1 < completed write operation key=2RV0899QUJ8W tag=U7BD3HS5E6YR type=write size=489459 2024-09-12T00:34:23.099 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.100+0000 7f1f2d864780 1 > prepared operation key=UTR2UUO6DHLJ tag=36N7AF3I25XC type=del size=1121807 2024-09-12T00:34:23.100 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.102+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~7EGN1X60BAPP.0 size=661492 2024-09-12T00:34:23.102 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.103+0000 7f1f2d864780 1 < completed multipart upload key=SZP418NVZ5VX upload=7EGN1X60BAPP tag=P8DMDY4ZI4S0 type=write size=1710068 2024-09-12T00:34:23.103 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.105+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=04Q9CQ6XKFH0 type=del size=2165297 2024-09-12T00:34:23.104 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.106+0000 7f1f2d864780 1 < completed write operation key=2RV0899QUJ8W tag=3DQ71O23RRW7 type=write size=927860 2024-09-12T00:34:23.105 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.107+0000 7f1f2d864780 1 > prepared operation key=FFG41OYEYFZA tag=GIIBVPU6UTLQ type=del size=2965921 2024-09-12T00:34:23.106 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.108+0000 7f1f2d864780 1 < completed part key=_multipart_KHPF1N1MT33Z.2~P783FS3WDQDN.0 size=1048576 2024-09-12T00:34:23.107 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.109+0000 7f1f2d864780 1 < completed part key=_multipart_KHPF1N1MT33Z.2~P783FS3WDQDN.1 size=697284 2024-09-12T00:34:23.109 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.111+0000 7f1f2d864780 1 < completed multipart upload key=KHPF1N1MT33Z upload=P783FS3WDQDN tag=GM7ZJIQZ8YQG type=write size=2794436 2024-09-12T00:34:23.110 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.112+0000 7f1f2d864780 1 > prepared operation key=ZYNIJH0TTSM6 tag=ZJCK6M00TDWE type=del size=1805855 2024-09-12T00:34:23.111 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.113+0000 7f1f2d864780 1 < completed part key=_multipart_ECZYQEZ942W8.2~C97A5RPB4NYB.0 size=200729 2024-09-12T00:34:23.113 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.115+0000 7f1f2d864780 1 < completed multipart upload key=ECZYQEZ942W8 upload=C97A5RPB4NYB tag=2GTA93YWC6R4 type=write size=1249305 2024-09-12T00:34:23.115 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.117+0000 7f1f2d864780 1 > prepared part key=_multipart_S5DVMA14N7VJ.2~OKAS8PJGBDU9.0 size=1048576 2024-09-12T00:34:23.116 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.118+0000 7f1f2d864780 1 > prepared part key=_multipart_S5DVMA14N7VJ.2~OKAS8PJGBDU9.1 size=287275 2024-09-12T00:34:23.116 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.118+0000 7f1f2d864780 1 > prepared multipart upload key=S5DVMA14N7VJ upload=OKAS8PJGBDU9 tag=SWOQNHEI758Q type=write size=2384427 2024-09-12T00:34:23.117 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.119+0000 7f1f2d864780 1 < completed write operation key=SNCGB6Z20450 tag=UOOUV0YRG6PZ type=write size=126231 2024-09-12T00:34:23.120 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.121+0000 7f1f2d864780 1 > prepared part key=_multipart_S5DVMA14N7VJ.2~DC8B93NB93QA.0 size=638094 2024-09-12T00:34:23.120 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.121+0000 7f1f2d864780 1 > prepared multipart upload key=S5DVMA14N7VJ upload=DC8B93NB93QA tag=PI2YF2UXL8HC type=write size=1686670 2024-09-12T00:34:23.121 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.122+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~SM7VS4QPNWSF.0 size=43167 2024-09-12T00:34:23.123 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.124+0000 7f1f2d864780 1 < completed multipart upload key=0DSQOFS8IIF5 upload=SM7VS4QPNWSF tag=K7XSNV7RPI10 type=write size=1091743 2024-09-12T00:34:23.124 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.125+0000 7f1f2d864780 1 > prepared operation key=UTR2UUO6DHLJ tag=PJRA576TQH4H type=del size=2153992 2024-09-12T00:34:23.125 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.127+0000 7f1f2d864780 1 < completed part key=_multipart_WIIU8VTCLWOD.2~L8C1FPZEO3VR.0 size=615236 2024-09-12T00:34:23.129 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.128+0000 7f1f2d864780 1 < completed multipart upload key=WIIU8VTCLWOD upload=L8C1FPZEO3VR tag=D86FK59HG085 type=write size=1663812 2024-09-12T00:34:23.129 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.130+0000 7f1f2d864780 1 > prepared part key=_multipart_DYKLAY6J018G.2~YU73Y7QEYN6M.0 size=1048576 2024-09-12T00:34:23.130 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.131+0000 7f1f2d864780 1 > prepared part key=_multipart_DYKLAY6J018G.2~YU73Y7QEYN6M.1 size=1048576 2024-09-12T00:34:23.130 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.132+0000 7f1f2d864780 1 > prepared part key=_multipart_DYKLAY6J018G.2~YU73Y7QEYN6M.2 size=44435 2024-09-12T00:34:23.131 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.132+0000 7f1f2d864780 1 > prepared multipart upload key=DYKLAY6J018G upload=YU73Y7QEYN6M tag=F6FC2YQVVIGJ type=write size=3190163 2024-09-12T00:34:23.132 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.133+0000 7f1f2d864780 1 < completed part key=_multipart_N9RQIGHVL8VP.2~5DGNO1J4F0ZH.0 size=1048576 2024-09-12T00:34:23.133 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.134+0000 7f1f2d864780 1 < completed part key=_multipart_N9RQIGHVL8VP.2~5DGNO1J4F0ZH.1 size=652216 2024-09-12T00:34:23.134 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.136+0000 7f1f2d864780 1 < completed multipart upload key=N9RQIGHVL8VP upload=5DGNO1J4F0ZH tag=0BTIDRPDMVMH type=write size=2749368 2024-09-12T00:34:23.136 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.137+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=SMIS973TPYH4 type=del size=1551790 2024-09-12T00:34:23.137 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.138+0000 7f1f2d864780 1 < canceled operation key=W6U30X4HJCB1 tag=S69AXHF87BFY type=del size=3053047 2024-09-12T00:34:23.138 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.140+0000 7f1f2d864780 1 > prepared operation key=4FRVL0KXN2X8 tag=0DMCP5OFVY2K type=del size=1587776 2024-09-12T00:34:23.139 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.141+0000 7f1f2d864780 1 < completed part key=_multipart_KHPF1N1MT33Z.2~86CT0MU0GOK7.0 size=1048576 2024-09-12T00:34:23.140 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.142+0000 7f1f2d864780 1 < completed part key=_multipart_KHPF1N1MT33Z.2~86CT0MU0GOK7.1 size=370377 2024-09-12T00:34:23.142 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.143+0000 7f1f2d864780 1 < completed multipart upload key=KHPF1N1MT33Z upload=86CT0MU0GOK7 tag=1IZBVUFJ8OT2 type=write size=2467529 2024-09-12T00:34:23.143 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.145+0000 7f1f2d864780 1 > prepared operation key=D21W9QZWY0YU tag=18KG6FW2GPD5 type=del size=3472644 2024-09-12T00:34:23.144 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.146+0000 7f1f2d864780 1 < canceled operation key=1299IOSGYIO9 tag=JNHXZJDV10XZ type=write size=439948 2024-09-12T00:34:23.146 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.148+0000 7f1f2d864780 1 > prepared part key=_multipart_ECZYQEZ942W8.2~Y1IA6YV733KW.0 size=902855 2024-09-12T00:34:23.146 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.148+0000 7f1f2d864780 1 > prepared multipart upload key=ECZYQEZ942W8 upload=Y1IA6YV733KW tag=EXYIF8TDXDGM type=write size=1951431 2024-09-12T00:34:23.147 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.149+0000 7f1f2d864780 1 < completed delete operation key=SZP418NVZ5VX tag=E5U6E7ZKGAXU type=del 2024-09-12T00:34:23.148 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.150+0000 7f1f2d864780 1 > prepared operation key=KHPF1N1MT33Z tag=0MJLBFKQBINJ type=del size=2363078 2024-09-12T00:34:23.149 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.151+0000 7f1f2d864780 1 < completed delete operation key=2YCGIJRK6MUH tag=AHKCQ602D5WM type=del 2024-09-12T00:34:23.151 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.153+0000 7f1f2d864780 1 > prepared part key=_multipart_2YCGIJRK6MUH.2~RDQ2DQVJL3MC.0 size=1048576 2024-09-12T00:34:23.152 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.154+0000 7f1f2d864780 1 > prepared part key=_multipart_2YCGIJRK6MUH.2~RDQ2DQVJL3MC.1 size=771294 2024-09-12T00:34:23.152 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.154+0000 7f1f2d864780 1 > prepared multipart upload key=2YCGIJRK6MUH upload=RDQ2DQVJL3MC tag=KTGCEHQQNL7E type=write size=2868446 2024-09-12T00:34:23.153 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.155+0000 7f1f2d864780 1 < completed part key=_multipart_W6U30X4HJCB1.2~MSUCTSOLC865.0 size=152555 2024-09-12T00:34:23.155 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.157+0000 7f1f2d864780 1 < completed multipart upload key=W6U30X4HJCB1 upload=MSUCTSOLC865 tag=O813IMPC4YXD type=write size=1201131 2024-09-12T00:34:23.156 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.158+0000 7f1f2d864780 1 > prepared operation key=W6U30X4HJCB1 tag=IIAG8PGJ1VX0 type=del size=3956070 2024-09-12T00:34:23.157 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.159+0000 7f1f2d864780 1 < completed delete operation key=WIIU8VTCLWOD tag=XFIO6XODIFAB type=del 2024-09-12T00:34:23.160 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.161+0000 7f1f2d864780 1 > prepared part key=_multipart_KHPF1N1MT33Z.2~3NFN0YD1D2RV.0 size=1048576 2024-09-12T00:34:23.160 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.162+0000 7f1f2d864780 1 > prepared part key=_multipart_KHPF1N1MT33Z.2~3NFN0YD1D2RV.1 size=649787 2024-09-12T00:34:23.161 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.162+0000 7f1f2d864780 1 > prepared multipart upload key=KHPF1N1MT33Z upload=3NFN0YD1D2RV tag=8ZZ0EL46N73B type=write size=2746939 2024-09-12T00:34:23.162 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.163+0000 7f1f2d864780 1 < completed delete operation key=UTR2UUO6DHLJ tag=36N7AF3I25XC type=del 2024-09-12T00:34:23.163 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.164+0000 7f1f2d864780 1 > prepared operation key=3Z1TGGPZKJ69 tag=U0UP7SM2O7OU type=del size=1021613 2024-09-12T00:34:23.164 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.166+0000 7f1f2d864780 1 < completed delete operation key=2RV0899QUJ8W tag=04Q9CQ6XKFH0 type=del 2024-09-12T00:34:23.166 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.168+0000 7f1f2d864780 1 > prepared part key=_multipart_SNCGB6Z20450.2~S5XNBLXB79A8.0 size=546455 2024-09-12T00:34:23.166 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.168+0000 7f1f2d864780 1 > prepared multipart upload key=SNCGB6Z20450 upload=S5XNBLXB79A8 tag=XQ33KK5FR1D7 type=write size=1595031 2024-09-12T00:34:23.167 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.169+0000 7f1f2d864780 1 < completed delete operation key=FFG41OYEYFZA tag=GIIBVPU6UTLQ type=del 2024-09-12T00:34:23.168 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.170+0000 7f1f2d864780 1 > prepared operation key=0DSQOFS8IIF5 tag=EM0FL9U88131 type=del size=1335479 2024-09-12T00:34:23.170 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.171+0000 7f1f2d864780 1 < completed delete operation key=ZYNIJH0TTSM6 tag=ZJCK6M00TDWE type=del 2024-09-12T00:34:23.171 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.172+0000 7f1f2d864780 1 > prepared operation key=W6U30X4HJCB1 tag=145QX5NG24DK type=write size=473553 2024-09-12T00:34:23.172 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.173+0000 7f1f2d864780 1 < completed part key=_multipart_S5DVMA14N7VJ.2~OKAS8PJGBDU9.0 size=1048576 2024-09-12T00:34:23.173 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.174+0000 7f1f2d864780 1 < completed part key=_multipart_S5DVMA14N7VJ.2~OKAS8PJGBDU9.1 size=287275 2024-09-12T00:34:23.175 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.176+0000 7f1f2d864780 1 < completed multipart upload key=S5DVMA14N7VJ upload=OKAS8PJGBDU9 tag=SWOQNHEI758Q type=write size=2384427 2024-09-12T00:34:23.177 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.178+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~C3UUA79054YY.0 size=195088 2024-09-12T00:34:23.177 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.178+0000 7f1f2d864780 1 > prepared multipart upload key=0DSQOFS8IIF5 upload=C3UUA79054YY tag=II3AS3EB2FH7 type=write size=1243664 2024-09-12T00:34:23.178 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.180+0000 7f1f2d864780 1 < completed part key=_multipart_S5DVMA14N7VJ.2~DC8B93NB93QA.0 size=638094 2024-09-12T00:34:23.180 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.182+0000 7f1f2d864780 1 < completed multipart upload key=S5DVMA14N7VJ upload=DC8B93NB93QA tag=PI2YF2UXL8HC type=write size=1686670 2024-09-12T00:34:23.181 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.183+0000 7f1f2d864780 1 > prepared operation key=SZP418NVZ5VX tag=3FD8ETZ6WJ37 type=del size=3635845 2024-09-12T00:34:23.182 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.184+0000 7f1f2d864780 1 < completed delete operation key=UTR2UUO6DHLJ tag=PJRA576TQH4H type=del 2024-09-12T00:34:23.184 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.185+0000 7f1f2d864780 1 > prepared operation key=GSPM8N0K7ODC tag=YVSW2MNPJ863 type=del size=2407981 2024-09-12T00:34:23.185 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.187+0000 7f1f2d864780 1 < completed part key=_multipart_DYKLAY6J018G.2~YU73Y7QEYN6M.0 size=1048576 2024-09-12T00:34:23.186 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.188+0000 7f1f2d864780 1 < completed part key=_multipart_DYKLAY6J018G.2~YU73Y7QEYN6M.1 size=1048576 2024-09-12T00:34:23.187 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.189+0000 7f1f2d864780 1 < completed part key=_multipart_DYKLAY6J018G.2~YU73Y7QEYN6M.2 size=44435 2024-09-12T00:34:23.191 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.192+0000 7f1f2d864780 1 < completed multipart upload key=DYKLAY6J018G upload=YU73Y7QEYN6M tag=F6FC2YQVVIGJ type=write size=3190163 2024-09-12T00:34:23.193 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.195+0000 7f1f2d864780 1 > prepared part key=_multipart_O1YY03BOEYLM.2~2BQ1AYESDDC2.0 size=1048576 2024-09-12T00:34:23.194 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.196+0000 7f1f2d864780 1 > prepared part key=_multipart_O1YY03BOEYLM.2~2BQ1AYESDDC2.1 size=445725 2024-09-12T00:34:23.194 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.196+0000 7f1f2d864780 1 > prepared multipart upload key=O1YY03BOEYLM upload=2BQ1AYESDDC2 tag=AH5462C51V9L type=write size=2542877 2024-09-12T00:34:23.196 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.198+0000 7f1f2d864780 1 < completed delete operation key=2RV0899QUJ8W tag=SMIS973TPYH4 type=del 2024-09-12T00:34:23.197 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.199+0000 7f1f2d864780 1 > prepared operation key=ECZYQEZ942W8 tag=7HLF13I6Q1IW type=del size=683656 2024-09-12T00:34:23.199 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.201+0000 7f1f2d864780 1 < suggested update operation key=4FRVL0KXN2X8 tag=0DMCP5OFVY2K type=del size=1587776 2024-09-12T00:34:23.201 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.202+0000 7f1f2d864780 1 > prepared operation key=W6U30X4HJCB1 tag=439W4WTNIIKR type=write size=382065 2024-09-12T00:34:23.202 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.203+0000 7f1f2d864780 1 < completed delete operation key=D21W9QZWY0YU tag=18KG6FW2GPD5 type=del 2024-09-12T00:34:23.204 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.206+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~HNRFE1JGGN6P.0 size=480938 2024-09-12T00:34:23.204 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.206+0000 7f1f2d864780 1 > prepared multipart upload key=SZP418NVZ5VX upload=HNRFE1JGGN6P tag=XT44WXMW2B6B type=write size=1529514 2024-09-12T00:34:23.205 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.207+0000 7f1f2d864780 1 < completed part key=_multipart_ECZYQEZ942W8.2~Y1IA6YV733KW.0 size=902855 2024-09-12T00:34:23.208 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.209+0000 7f1f2d864780 1 < completed multipart upload key=ECZYQEZ942W8 upload=Y1IA6YV733KW tag=EXYIF8TDXDGM type=write size=1951431 2024-09-12T00:34:23.210 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.212+0000 7f1f2d864780 1 > prepared part key=_multipart_2YCGIJRK6MUH.2~BFPFDRUJOVR6.0 size=1048576 2024-09-12T00:34:23.211 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.213+0000 7f1f2d864780 1 > prepared part key=_multipart_2YCGIJRK6MUH.2~BFPFDRUJOVR6.1 size=1048576 2024-09-12T00:34:23.212 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.214+0000 7f1f2d864780 1 > prepared part key=_multipart_2YCGIJRK6MUH.2~BFPFDRUJOVR6.2 size=554635 2024-09-12T00:34:23.212 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.214+0000 7f1f2d864780 1 > prepared multipart upload key=2YCGIJRK6MUH upload=BFPFDRUJOVR6 tag=4MO4B2KRV8G8 type=write size=3700363 2024-09-12T00:34:23.213 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.215+0000 7f1f2d864780 1 < completed delete operation key=KHPF1N1MT33Z tag=0MJLBFKQBINJ type=del 2024-09-12T00:34:23.215 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.217+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~AY6MDYONKEB1.0 size=1048576 2024-09-12T00:34:23.216 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.218+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~AY6MDYONKEB1.1 size=1048576 2024-09-12T00:34:23.217 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.219+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~AY6MDYONKEB1.2 size=883258 2024-09-12T00:34:23.217 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.219+0000 7f1f2d864780 1 > prepared multipart upload key=D21W9QZWY0YU upload=AY6MDYONKEB1 tag=VWBRSR3YQ63O type=write size=4028986 2024-09-12T00:34:23.217 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.219+0000 7f1f2d864780 1 < canceled part key=_multipart_2YCGIJRK6MUH.2~RDQ2DQVJL3MC.0 size=1048576 2024-09-12T00:34:23.218 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.220+0000 7f1f2d864780 1 < completed part key=_multipart_2YCGIJRK6MUH.2~RDQ2DQVJL3MC.1 size=771294 2024-09-12T00:34:23.220 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.222+0000 7f1f2d864780 1 < canceled multipart upload key=2YCGIJRK6MUH upload=RDQ2DQVJL3MC tag=KTGCEHQQNL7E type=write size=2868446 2024-09-12T00:34:23.221 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.223+0000 7f1f2d864780 1 > prepared operation key=OY145ZXRSF4L tag=TQP62FPGH2XZ type=del size=1136955 2024-09-12T00:34:23.222 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.224+0000 7f1f2d864780 1 < completed delete operation key=W6U30X4HJCB1 tag=IIAG8PGJ1VX0 type=del 2024-09-12T00:34:23.224 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.226+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~5VY1ABUMXISR.0 size=959547 2024-09-12T00:34:23.225 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.226+0000 7f1f2d864780 1 > prepared multipart upload key=WGKEA4EKF5GP upload=5VY1ABUMXISR tag=O0CJ5NTEALBM type=write size=2008123 2024-09-12T00:34:23.225 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.226+0000 7f1f2d864780 1 < canceled part key=_multipart_KHPF1N1MT33Z.2~3NFN0YD1D2RV.0 size=1048576 2024-09-12T00:34:23.226 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.227+0000 7f1f2d864780 1 < completed part key=_multipart_KHPF1N1MT33Z.2~3NFN0YD1D2RV.1 size=649787 2024-09-12T00:34:23.227 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.229+0000 7f1f2d864780 1 < canceled multipart upload key=KHPF1N1MT33Z upload=3NFN0YD1D2RV tag=8ZZ0EL46N73B type=write size=2746939 2024-09-12T00:34:23.229 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.230+0000 7f1f2d864780 1 > prepared operation key=2YCGIJRK6MUH tag=3YEECORML8TA type=del size=84683 2024-09-12T00:34:23.230 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.231+0000 7f1f2d864780 1 < completed delete operation key=3Z1TGGPZKJ69 tag=U0UP7SM2O7OU type=del 2024-09-12T00:34:23.232 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.233+0000 7f1f2d864780 1 > prepared part key=_multipart_MSGU3PHLBRJH.2~4Q7IYSZQKXAH.0 size=24018 2024-09-12T00:34:23.232 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.233+0000 7f1f2d864780 1 > prepared multipart upload key=MSGU3PHLBRJH upload=4Q7IYSZQKXAH tag=HE2IXXUWDG6B type=write size=1072594 2024-09-12T00:34:23.237 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.235+0000 7f1f2d864780 1 < completed part key=_multipart_SNCGB6Z20450.2~S5XNBLXB79A8.0 size=546455 2024-09-12T00:34:23.237 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.237+0000 7f1f2d864780 1 < completed multipart upload key=SNCGB6Z20450 upload=S5XNBLXB79A8 tag=XQ33KK5FR1D7 type=write size=1595031 2024-09-12T00:34:23.237 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.239+0000 7f1f2d864780 1 > prepared part key=_multipart_GSPM8N0K7ODC.2~ZSPU0WQIFP29.0 size=18012 2024-09-12T00:34:23.237 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.239+0000 7f1f2d864780 1 > prepared multipart upload key=GSPM8N0K7ODC upload=ZSPU0WQIFP29 tag=AQI04OOIY7WC type=write size=1066588 2024-09-12T00:34:23.238 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.240+0000 7f1f2d864780 1 < completed delete operation key=0DSQOFS8IIF5 tag=EM0FL9U88131 type=del 2024-09-12T00:34:23.241 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.242+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~SGYIIC7EFX7K.0 size=273187 2024-09-12T00:34:23.241 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.242+0000 7f1f2d864780 1 > prepared multipart upload key=1299IOSGYIO9 upload=SGYIIC7EFX7K tag=F9JOV6N9ZF0E type=write size=1321763 2024-09-12T00:34:23.242 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.244+0000 7f1f2d864780 1 < canceled operation key=W6U30X4HJCB1 tag=145QX5NG24DK type=write size=473553 2024-09-12T00:34:23.244 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.246+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~P2AIYYQOGO9F.0 size=977137 2024-09-12T00:34:23.244 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.246+0000 7f1f2d864780 1 > prepared multipart upload key=1299IOSGYIO9 upload=P2AIYYQOGO9F tag=LEI02ZMUT8JA type=write size=2025713 2024-09-12T00:34:23.246 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.247+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~C3UUA79054YY.0 size=195088 2024-09-12T00:34:23.247 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.249+0000 7f1f2d864780 1 < completed multipart upload key=0DSQOFS8IIF5 upload=C3UUA79054YY tag=II3AS3EB2FH7 type=write size=1243664 2024-09-12T00:34:23.250 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.251+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~G2JG1G51I5R1.0 size=1048576 2024-09-12T00:34:23.250 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.252+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~G2JG1G51I5R1.1 size=209317 2024-09-12T00:34:23.251 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.252+0000 7f1f2d864780 1 > prepared multipart upload key=D21W9QZWY0YU upload=G2JG1G51I5R1 tag=5QTKO605S6JI type=write size=2306469 2024-09-12T00:34:23.253 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.254+0000 7f1f2d864780 1 < suggested remove operation key=SZP418NVZ5VX tag=3FD8ETZ6WJ37 type=del 2024-09-12T00:34:23.255 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.256+0000 7f1f2d864780 1 > prepared part key=_multipart_DYKLAY6J018G.2~3P3XI2R1RYGZ.0 size=1048576 2024-09-12T00:34:23.256 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.257+0000 7f1f2d864780 1 > prepared part key=_multipart_DYKLAY6J018G.2~3P3XI2R1RYGZ.1 size=1048576 2024-09-12T00:34:23.257 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.258+0000 7f1f2d864780 1 > prepared part key=_multipart_DYKLAY6J018G.2~3P3XI2R1RYGZ.2 size=1024318 2024-09-12T00:34:23.257 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.258+0000 7f1f2d864780 1 > prepared multipart upload key=DYKLAY6J018G upload=3P3XI2R1RYGZ tag=1B5XMI8U2D04 type=write size=4170046 2024-09-12T00:34:23.259 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.261+0000 7f1f2d864780 1 < suggested update operation key=GSPM8N0K7ODC tag=YVSW2MNPJ863 type=del size=2407981 2024-09-12T00:34:23.261 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.263+0000 7f1f2d864780 1 > prepared part key=_multipart_WIIU8VTCLWOD.2~QXNU8MMX534Q.0 size=725577 2024-09-12T00:34:23.261 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.263+0000 7f1f2d864780 1 > prepared multipart upload key=WIIU8VTCLWOD upload=QXNU8MMX534Q tag=X851R1OM3LQN type=write size=1774153 2024-09-12T00:34:23.262 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.264+0000 7f1f2d864780 1 < completed part key=_multipart_O1YY03BOEYLM.2~2BQ1AYESDDC2.0 size=1048576 2024-09-12T00:34:23.263 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.264+0000 7f1f2d864780 1 < canceled part key=_multipart_O1YY03BOEYLM.2~2BQ1AYESDDC2.1 size=445725 2024-09-12T00:34:23.264 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.266+0000 7f1f2d864780 1 < canceled multipart upload key=O1YY03BOEYLM upload=2BQ1AYESDDC2 tag=AH5462C51V9L type=write size=2542877 2024-09-12T00:34:23.265 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.267+0000 7f1f2d864780 1 > prepared operation key=N9RQIGHVL8VP tag=IHEVXA46049M type=del size=3147358 2024-09-12T00:34:23.268 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.269+0000 7f1f2d864780 1 < suggested update operation key=ECZYQEZ942W8 tag=7HLF13I6Q1IW type=del size=683656 2024-09-12T00:34:23.269 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.271+0000 7f1f2d864780 1 > prepared operation key=SZP418NVZ5VX tag=USDSL4MAXE1H type=del size=1793562 2024-09-12T00:34:23.270 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.272+0000 7f1f2d864780 1 < completed write operation key=W6U30X4HJCB1 tag=439W4WTNIIKR type=write size=382065 2024-09-12T00:34:23.272 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.274+0000 7f1f2d864780 1 > prepared part key=_multipart_N9RQIGHVL8VP.2~COMEKRY4SCCF.0 size=1018473 2024-09-12T00:34:23.272 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.274+0000 7f1f2d864780 1 > prepared multipart upload key=N9RQIGHVL8VP upload=COMEKRY4SCCF tag=S02IL0B1A4JN type=write size=2067049 2024-09-12T00:34:23.273 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.275+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~HNRFE1JGGN6P.0 size=480938 2024-09-12T00:34:23.275 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.277+0000 7f1f2d864780 1 < completed multipart upload key=SZP418NVZ5VX upload=HNRFE1JGGN6P tag=XT44WXMW2B6B type=write size=1529514 2024-09-12T00:34:23.277 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.279+0000 7f1f2d864780 1 > prepared part key=_multipart_53QCNWX1V1R1.2~G4A65EG07L6H.0 size=209041 2024-09-12T00:34:23.277 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.279+0000 7f1f2d864780 1 > prepared multipart upload key=53QCNWX1V1R1 upload=G4A65EG07L6H tag=FEHUVED0TSOP type=write size=1257617 2024-09-12T00:34:23.278 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.280+0000 7f1f2d864780 1 < completed part key=_multipart_2YCGIJRK6MUH.2~BFPFDRUJOVR6.0 size=1048576 2024-09-12T00:34:23.279 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.281+0000 7f1f2d864780 1 < completed part key=_multipart_2YCGIJRK6MUH.2~BFPFDRUJOVR6.1 size=1048576 2024-09-12T00:34:23.280 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.282+0000 7f1f2d864780 1 < completed part key=_multipart_2YCGIJRK6MUH.2~BFPFDRUJOVR6.2 size=554635 2024-09-12T00:34:23.282 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.284+0000 7f1f2d864780 1 < completed multipart upload key=2YCGIJRK6MUH upload=BFPFDRUJOVR6 tag=4MO4B2KRV8G8 type=write size=3700363 2024-09-12T00:34:23.283 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.285+0000 7f1f2d864780 1 > prepared operation key=DYKLAY6J018G tag=707U5JCNEX2P type=del size=3993982 2024-09-12T00:34:23.283 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.285+0000 7f1f2d864780 1 < canceled part key=_multipart_D21W9QZWY0YU.2~AY6MDYONKEB1.0 size=1048576 2024-09-12T00:34:23.284 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.286+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~AY6MDYONKEB1.1 size=1048576 2024-09-12T00:34:23.285 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.287+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~AY6MDYONKEB1.2 size=883258 2024-09-12T00:34:23.288 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.289+0000 7f1f2d864780 1 < canceled multipart upload key=D21W9QZWY0YU upload=AY6MDYONKEB1 tag=VWBRSR3YQ63O type=write size=4028986 2024-09-12T00:34:23.290 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.292+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~KOJKGQB52FO8.0 size=1048576 2024-09-12T00:34:23.291 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.292+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~KOJKGQB52FO8.1 size=1048576 2024-09-12T00:34:23.292 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.293+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~KOJKGQB52FO8.2 size=949419 2024-09-12T00:34:23.292 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.293+0000 7f1f2d864780 1 > prepared multipart upload key=0DSQOFS8IIF5 upload=KOJKGQB52FO8 tag=4RH7RZB4ZN7E type=write size=4095147 2024-09-12T00:34:23.293 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.295+0000 7f1f2d864780 1 < completed delete operation key=OY145ZXRSF4L tag=TQP62FPGH2XZ type=del 2024-09-12T00:34:23.294 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.296+0000 7f1f2d864780 1 > prepared operation key=S5DVMA14N7VJ tag=O1L01KI9U703 type=del size=3875235 2024-09-12T00:34:23.295 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.297+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~5VY1ABUMXISR.0 size=959547 2024-09-12T00:34:23.297 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.299+0000 7f1f2d864780 1 < completed multipart upload key=WGKEA4EKF5GP upload=5VY1ABUMXISR tag=O0CJ5NTEALBM type=write size=2008123 2024-09-12T00:34:23.298 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.300+0000 7f1f2d864780 1 > prepared operation key=D21W9QZWY0YU tag=RYVFA5V10QDF type=del size=3482561 2024-09-12T00:34:23.301 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.302+0000 7f1f2d864780 1 < completed delete operation key=2YCGIJRK6MUH tag=3YEECORML8TA type=del 2024-09-12T00:34:23.302 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.303+0000 7f1f2d864780 1 > prepared operation key=FFG41OYEYFZA tag=F8FRGAL5E6GT type=del size=3478556 2024-09-12T00:34:23.303 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.305+0000 7f1f2d864780 1 < completed part key=_multipart_MSGU3PHLBRJH.2~4Q7IYSZQKXAH.0 size=24018 2024-09-12T00:34:23.305 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.307+0000 7f1f2d864780 1 < completed multipart upload key=MSGU3PHLBRJH upload=4Q7IYSZQKXAH tag=HE2IXXUWDG6B type=write size=1072594 2024-09-12T00:34:23.306 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.308+0000 7f1f2d864780 1 > prepared operation key=2G3UCYG4R4NM tag=4NDRLDTYQY0G type=del size=3925110 2024-09-12T00:34:23.307 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.309+0000 7f1f2d864780 1 < completed part key=_multipart_GSPM8N0K7ODC.2~ZSPU0WQIFP29.0 size=18012 2024-09-12T00:34:23.309 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.311+0000 7f1f2d864780 1 < completed multipart upload key=GSPM8N0K7ODC upload=ZSPU0WQIFP29 tag=AQI04OOIY7WC type=write size=1066588 2024-09-12T00:34:23.311 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.313+0000 7f1f2d864780 1 > prepared part key=_multipart_N9RQIGHVL8VP.2~JVKIP5I0FUC1.0 size=531848 2024-09-12T00:34:23.311 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.313+0000 7f1f2d864780 1 > prepared multipart upload key=N9RQIGHVL8VP upload=JVKIP5I0FUC1 tag=O7FGKKS9Z44I type=write size=1580424 2024-09-12T00:34:23.312 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.314+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~SGYIIC7EFX7K.0 size=273187 2024-09-12T00:34:23.314 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.316+0000 7f1f2d864780 1 < completed multipart upload key=1299IOSGYIO9 upload=SGYIIC7EFX7K tag=F9JOV6N9ZF0E type=write size=1321763 2024-09-12T00:34:23.316 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.318+0000 7f1f2d864780 1 > prepared part key=_multipart_ECZYQEZ942W8.2~JWJBJVQPOV84.0 size=1048576 2024-09-12T00:34:23.317 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.318+0000 7f1f2d864780 1 > prepared part key=_multipart_ECZYQEZ942W8.2~JWJBJVQPOV84.1 size=1048576 2024-09-12T00:34:23.318 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.319+0000 7f1f2d864780 1 > prepared part key=_multipart_ECZYQEZ942W8.2~JWJBJVQPOV84.2 size=276804 2024-09-12T00:34:23.318 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.319+0000 7f1f2d864780 1 > prepared multipart upload key=ECZYQEZ942W8 upload=JWJBJVQPOV84 tag=HDPZ5O5S3BXH type=write size=3422532 2024-09-12T00:34:23.319 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.321+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~P2AIYYQOGO9F.0 size=977137 2024-09-12T00:34:23.321 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.323+0000 7f1f2d864780 1 < completed multipart upload key=1299IOSGYIO9 upload=P2AIYYQOGO9F tag=LEI02ZMUT8JA type=write size=2025713 2024-09-12T00:34:23.323 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.325+0000 7f1f2d864780 1 > prepared part key=_multipart_53QCNWX1V1R1.2~6O4N4918Z2LK.0 size=1048576 2024-09-12T00:34:23.324 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.326+0000 7f1f2d864780 1 > prepared part key=_multipart_53QCNWX1V1R1.2~6O4N4918Z2LK.1 size=597611 2024-09-12T00:34:23.324 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.326+0000 7f1f2d864780 1 > prepared multipart upload key=53QCNWX1V1R1 upload=6O4N4918Z2LK tag=0DBV1HZ70DPA type=write size=2694763 2024-09-12T00:34:23.325 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.326+0000 7f1f2d864780 1 < canceled part key=_multipart_D21W9QZWY0YU.2~G2JG1G51I5R1.0 size=1048576 2024-09-12T00:34:23.326 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.327+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~G2JG1G51I5R1.1 size=209317 2024-09-12T00:34:23.328 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.329+0000 7f1f2d864780 1 < canceled multipart upload key=D21W9QZWY0YU upload=G2JG1G51I5R1 tag=5QTKO605S6JI type=write size=2306469 2024-09-12T00:34:23.329 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.331+0000 7f1f2d864780 1 > prepared operation key=FAP6N3H7SBN0 tag=S9KX79AXYPPE type=del size=3090725 2024-09-12T00:34:23.330 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.332+0000 7f1f2d864780 1 < completed part key=_multipart_DYKLAY6J018G.2~3P3XI2R1RYGZ.0 size=1048576 2024-09-12T00:34:23.331 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.333+0000 7f1f2d864780 1 < completed part key=_multipart_DYKLAY6J018G.2~3P3XI2R1RYGZ.1 size=1048576 2024-09-12T00:34:23.332 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.334+0000 7f1f2d864780 1 < completed part key=_multipart_DYKLAY6J018G.2~3P3XI2R1RYGZ.2 size=1024318 2024-09-12T00:34:23.335 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.337+0000 7f1f2d864780 1 < completed multipart upload key=DYKLAY6J018G upload=3P3XI2R1RYGZ tag=1B5XMI8U2D04 type=write size=4170046 2024-09-12T00:34:23.338 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.339+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~FTGHRR1FPWAC.0 size=712924 2024-09-12T00:34:23.338 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.339+0000 7f1f2d864780 1 > prepared multipart upload key=1299IOSGYIO9 upload=FTGHRR1FPWAC tag=FVQ9M4AT5KSC type=write size=1761500 2024-09-12T00:34:23.339 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.340+0000 7f1f2d864780 1 < completed part key=_multipart_WIIU8VTCLWOD.2~QXNU8MMX534Q.0 size=725577 2024-09-12T00:34:23.341 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.343+0000 7f1f2d864780 1 < completed multipart upload key=WIIU8VTCLWOD upload=QXNU8MMX534Q tag=X851R1OM3LQN type=write size=1774153 2024-09-12T00:34:23.343 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.345+0000 7f1f2d864780 1 > prepared part key=_multipart_ECZYQEZ942W8.2~XSFXAK1YXGLT.0 size=1048576 2024-09-12T00:34:23.344 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.346+0000 7f1f2d864780 1 > prepared part key=_multipart_ECZYQEZ942W8.2~XSFXAK1YXGLT.1 size=279346 2024-09-12T00:34:23.345 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.346+0000 7f1f2d864780 1 > prepared multipart upload key=ECZYQEZ942W8 upload=XSFXAK1YXGLT tag=AX5NB2IJNC40 type=write size=2376498 2024-09-12T00:34:23.347 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.349+0000 7f1f2d864780 1 < suggested remove operation key=N9RQIGHVL8VP tag=IHEVXA46049M type=del 2024-09-12T00:34:23.348 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.350+0000 7f1f2d864780 1 > prepared operation key=O1YY03BOEYLM tag=DT7EWSJYTJ6W type=del size=3288673 2024-09-12T00:34:23.349 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.351+0000 7f1f2d864780 1 < completed delete operation key=SZP418NVZ5VX tag=USDSL4MAXE1H type=del 2024-09-12T00:34:23.350 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.352+0000 7f1f2d864780 1 > prepared operation key=PVB52GO6L8T4 tag=0VK7GSQ2C7U4 type=del size=1871169 2024-09-12T00:34:23.352 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.353+0000 7f1f2d864780 1 < completed part key=_multipart_N9RQIGHVL8VP.2~COMEKRY4SCCF.0 size=1018473 2024-09-12T00:34:23.353 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.355+0000 7f1f2d864780 1 < completed multipart upload key=N9RQIGHVL8VP upload=COMEKRY4SCCF tag=S02IL0B1A4JN type=write size=2067049 2024-09-12T00:34:23.355 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.356+0000 7f1f2d864780 1 > prepared operation key=S5DVMA14N7VJ tag=J3K3A3OKKSFC type=del size=3091085 2024-09-12T00:34:23.355 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.356+0000 7f1f2d864780 1 < canceled part key=_multipart_53QCNWX1V1R1.2~G4A65EG07L6H.0 size=209041 2024-09-12T00:34:23.357 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.358+0000 7f1f2d864780 1 < canceled multipart upload key=53QCNWX1V1R1 upload=G4A65EG07L6H tag=FEHUVED0TSOP type=write size=1257617 2024-09-12T00:34:23.358 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.359+0000 7f1f2d864780 1 > prepared operation key=W6U30X4HJCB1 tag=F12H9G2IX2DD type=del size=3834097 2024-09-12T00:34:23.359 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.360+0000 7f1f2d864780 1 < completed delete operation key=DYKLAY6J018G tag=707U5JCNEX2P type=del 2024-09-12T00:34:23.361 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.362+0000 7f1f2d864780 1 > prepared part key=_multipart_KHPF1N1MT33Z.2~QNUXFMZ16ADH.0 size=1048576 2024-09-12T00:34:23.362 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.363+0000 7f1f2d864780 1 > prepared part key=_multipart_KHPF1N1MT33Z.2~QNUXFMZ16ADH.1 size=1048576 2024-09-12T00:34:23.363 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.364+0000 7f1f2d864780 1 > prepared part key=_multipart_KHPF1N1MT33Z.2~QNUXFMZ16ADH.2 size=478109 2024-09-12T00:34:23.363 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.364+0000 7f1f2d864780 1 > prepared multipart upload key=KHPF1N1MT33Z upload=QNUXFMZ16ADH tag=X4MN946L2H3H type=write size=3623837 2024-09-12T00:34:23.364 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.365+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~KOJKGQB52FO8.0 size=1048576 2024-09-12T00:34:23.365 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.366+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~KOJKGQB52FO8.1 size=1048576 2024-09-12T00:34:23.365 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.367+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~KOJKGQB52FO8.2 size=949419 2024-09-12T00:34:23.367 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.369+0000 7f1f2d864780 1 < completed multipart upload key=0DSQOFS8IIF5 upload=KOJKGQB52FO8 tag=4RH7RZB4ZN7E type=write size=4095147 2024-09-12T00:34:23.369 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.371+0000 7f1f2d864780 1 > prepared part key=_multipart_DYKLAY6J018G.2~6RTZ2W5960VV.0 size=1048576 2024-09-12T00:34:23.370 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.372+0000 7f1f2d864780 1 > prepared part key=_multipart_DYKLAY6J018G.2~6RTZ2W5960VV.1 size=742803 2024-09-12T00:34:23.370 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.372+0000 7f1f2d864780 1 > prepared multipart upload key=DYKLAY6J018G upload=6RTZ2W5960VV tag=4LKIGWJ62G67 type=write size=2839955 2024-09-12T00:34:23.371 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.373+0000 7f1f2d864780 1 < completed delete operation key=S5DVMA14N7VJ tag=O1L01KI9U703 type=del 2024-09-12T00:34:23.372 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.374+0000 7f1f2d864780 1 > prepared operation key=GSPM8N0K7ODC tag=R0PDKCW0I609 type=del size=1148663 2024-09-12T00:34:23.373 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.375+0000 7f1f2d864780 1 < completed delete operation key=D21W9QZWY0YU tag=RYVFA5V10QDF type=del 2024-09-12T00:34:23.375 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.376+0000 7f1f2d864780 1 > prepared operation key=FAP6N3H7SBN0 tag=ZDC3ZC5Y5WJL type=del size=810768 2024-09-12T00:34:23.376 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.378+0000 7f1f2d864780 1 < completed delete operation key=FFG41OYEYFZA tag=F8FRGAL5E6GT type=del 2024-09-12T00:34:23.378 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.380+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~6HJ0U0QI6USP.0 size=1048576 2024-09-12T00:34:23.379 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.381+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~6HJ0U0QI6USP.1 size=311152 2024-09-12T00:34:23.379 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.381+0000 7f1f2d864780 1 > prepared multipart upload key=0DSQOFS8IIF5 upload=6HJ0U0QI6USP tag=01Z1LU7GLOV8 type=write size=2408304 2024-09-12T00:34:23.380 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.382+0000 7f1f2d864780 1 < completed delete operation key=2G3UCYG4R4NM tag=4NDRLDTYQY0G type=del 2024-09-12T00:34:23.381 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.383+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=2LKE1A6I09HV type=del size=3730311 2024-09-12T00:34:23.382 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.384+0000 7f1f2d864780 1 < completed part key=_multipart_N9RQIGHVL8VP.2~JVKIP5I0FUC1.0 size=531848 2024-09-12T00:34:23.384 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.386+0000 7f1f2d864780 1 < completed multipart upload key=N9RQIGHVL8VP upload=JVKIP5I0FUC1 tag=O7FGKKS9Z44I type=write size=1580424 2024-09-12T00:34:23.386 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.388+0000 7f1f2d864780 1 > prepared part key=_multipart_MSGU3PHLBRJH.2~5YEQ87LGHYBY.0 size=1048576 2024-09-12T00:34:23.388 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.389+0000 7f1f2d864780 1 > prepared part key=_multipart_MSGU3PHLBRJH.2~5YEQ87LGHYBY.1 size=1048576 2024-09-12T00:34:23.388 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.390+0000 7f1f2d864780 1 > prepared part key=_multipart_MSGU3PHLBRJH.2~5YEQ87LGHYBY.2 size=378638 2024-09-12T00:34:23.389 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.390+0000 7f1f2d864780 1 > prepared multipart upload key=MSGU3PHLBRJH upload=5YEQ87LGHYBY tag=PXM5RKW390VH type=write size=3524366 2024-09-12T00:34:23.390 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.391+0000 7f1f2d864780 1 < completed part key=_multipart_ECZYQEZ942W8.2~JWJBJVQPOV84.0 size=1048576 2024-09-12T00:34:23.392 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.394+0000 7f1f2d864780 1 < completed part key=_multipart_ECZYQEZ942W8.2~JWJBJVQPOV84.1 size=1048576 2024-09-12T00:34:23.394 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.395+0000 7f1f2d864780 1 < completed part key=_multipart_ECZYQEZ942W8.2~JWJBJVQPOV84.2 size=276804 2024-09-12T00:34:23.395 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.397+0000 7f1f2d864780 1 < completed multipart upload key=ECZYQEZ942W8 upload=JWJBJVQPOV84 tag=HDPZ5O5S3BXH type=write size=3422532 2024-09-12T00:34:23.398 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.399+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~WNDR0PIJ3K9G.0 size=1048576 2024-09-12T00:34:23.399 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.400+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~WNDR0PIJ3K9G.1 size=1048576 2024-09-12T00:34:23.399 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.401+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~WNDR0PIJ3K9G.2 size=46747 2024-09-12T00:34:23.400 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.401+0000 7f1f2d864780 1 > prepared multipart upload key=0DSQOFS8IIF5 upload=WNDR0PIJ3K9G tag=3ALVZHVT0HYX type=write size=3192475 2024-09-12T00:34:23.401 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.402+0000 7f1f2d864780 1 < completed part key=_multipart_53QCNWX1V1R1.2~6O4N4918Z2LK.0 size=1048576 2024-09-12T00:34:23.402 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.403+0000 7f1f2d864780 1 < completed part key=_multipart_53QCNWX1V1R1.2~6O4N4918Z2LK.1 size=597611 2024-09-12T00:34:23.403 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.405+0000 7f1f2d864780 1 < completed multipart upload key=53QCNWX1V1R1 upload=6O4N4918Z2LK tag=0DBV1HZ70DPA type=write size=2694763 2024-09-12T00:34:23.405 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.407+0000 7f1f2d864780 1 > prepared part key=_multipart_AN26EVAZI527.2~X90UGRGVEFGK.0 size=1048576 2024-09-12T00:34:23.406 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.408+0000 7f1f2d864780 1 > prepared part key=_multipart_AN26EVAZI527.2~X90UGRGVEFGK.1 size=89811 2024-09-12T00:34:23.406 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.408+0000 7f1f2d864780 1 > prepared multipart upload key=AN26EVAZI527 upload=X90UGRGVEFGK tag=EWNL6YJSST5L type=write size=2186963 2024-09-12T00:34:23.410 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.411+0000 7f1f2d864780 1 < suggested remove operation key=FAP6N3H7SBN0 tag=S9KX79AXYPPE type=del 2024-09-12T00:34:23.411 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.413+0000 7f1f2d864780 1 > prepared part key=_multipart_9XK59MVZ5G1O.2~AF6L3M2KL4TH.0 size=1048576 2024-09-12T00:34:23.412 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.414+0000 7f1f2d864780 1 > prepared part key=_multipart_9XK59MVZ5G1O.2~AF6L3M2KL4TH.1 size=1048576 2024-09-12T00:34:23.413 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.415+0000 7f1f2d864780 1 > prepared part key=_multipart_9XK59MVZ5G1O.2~AF6L3M2KL4TH.2 size=716031 2024-09-12T00:34:23.413 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.415+0000 7f1f2d864780 1 > prepared multipart upload key=9XK59MVZ5G1O upload=AF6L3M2KL4TH tag=QGCCXSUAFFKK type=write size=3861759 2024-09-12T00:34:23.414 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.416+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~FTGHRR1FPWAC.0 size=712924 2024-09-12T00:34:23.416 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.418+0000 7f1f2d864780 1 < completed multipart upload key=1299IOSGYIO9 upload=FTGHRR1FPWAC tag=FVQ9M4AT5KSC type=write size=1761500 2024-09-12T00:34:23.418 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.419+0000 7f1f2d864780 1 > prepared operation key=0DSQOFS8IIF5 tag=N6IQS14LBSZI type=del size=872166 2024-09-12T00:34:23.418 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.419+0000 7f1f2d864780 1 < canceled part key=_multipart_ECZYQEZ942W8.2~XSFXAK1YXGLT.0 size=1048576 2024-09-12T00:34:23.418 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.419+0000 7f1f2d864780 1 < canceled part key=_multipart_ECZYQEZ942W8.2~XSFXAK1YXGLT.1 size=279346 2024-09-12T00:34:23.419 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.421+0000 7f1f2d864780 1 < canceled multipart upload key=ECZYQEZ942W8 upload=XSFXAK1YXGLT tag=AX5NB2IJNC40 type=write size=2376498 2024-09-12T00:34:23.421 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.422+0000 7f1f2d864780 1 > prepared operation key=WIIU8VTCLWOD tag=ZG0MM6Y6TFHL type=del size=617616 2024-09-12T00:34:23.422 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.424+0000 7f1f2d864780 1 < canceled operation key=O1YY03BOEYLM tag=DT7EWSJYTJ6W type=del size=3288673 2024-09-12T00:34:23.423 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.425+0000 7f1f2d864780 1 > prepared operation key=FAP6N3H7SBN0 tag=APP4UN0DY85U type=del size=2878164 2024-09-12T00:34:23.424 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.426+0000 7f1f2d864780 1 < completed delete operation key=PVB52GO6L8T4 tag=0VK7GSQ2C7U4 type=del 2024-09-12T00:34:23.425 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.427+0000 7f1f2d864780 1 > prepared operation key=PVB52GO6L8T4 tag=OGMB5L02E7MF type=del size=5156 2024-09-12T00:34:23.427 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.428+0000 7f1f2d864780 1 < completed delete operation key=S5DVMA14N7VJ tag=J3K3A3OKKSFC type=del 2024-09-12T00:34:23.428 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.429+0000 7f1f2d864780 1 > prepared operation key=WKK747ETLW10 tag=VS66PNQPFMF8 type=del size=2361818 2024-09-12T00:34:23.429 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.430+0000 7f1f2d864780 1 < completed delete operation key=W6U30X4HJCB1 tag=F12H9G2IX2DD type=del 2024-09-12T00:34:23.430 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.431+0000 7f1f2d864780 1 > prepared operation key=AN26EVAZI527 tag=O1RR49U27B0C type=del size=1447920 2024-09-12T00:34:23.431 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.433+0000 7f1f2d864780 1 < completed part key=_multipart_KHPF1N1MT33Z.2~QNUXFMZ16ADH.0 size=1048576 2024-09-12T00:34:23.432 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.433+0000 7f1f2d864780 1 < completed part key=_multipart_KHPF1N1MT33Z.2~QNUXFMZ16ADH.1 size=1048576 2024-09-12T00:34:23.433 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.434+0000 7f1f2d864780 1 < completed part key=_multipart_KHPF1N1MT33Z.2~QNUXFMZ16ADH.2 size=478109 2024-09-12T00:34:23.434 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.436+0000 7f1f2d864780 1 < completed multipart upload key=KHPF1N1MT33Z upload=QNUXFMZ16ADH tag=X4MN946L2H3H type=write size=3623837 2024-09-12T00:34:23.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.438+0000 7f1f2d864780 1 > prepared part key=_multipart_ZYNIJH0TTSM6.2~14O8CQG1BUS3.0 size=1048576 2024-09-12T00:34:23.437 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.439+0000 7f1f2d864780 1 > prepared part key=_multipart_ZYNIJH0TTSM6.2~14O8CQG1BUS3.1 size=1048576 2024-09-12T00:34:23.438 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.440+0000 7f1f2d864780 1 > prepared part key=_multipart_ZYNIJH0TTSM6.2~14O8CQG1BUS3.2 size=986098 2024-09-12T00:34:23.438 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.440+0000 7f1f2d864780 1 > prepared multipart upload key=ZYNIJH0TTSM6 upload=14O8CQG1BUS3 tag=70G6S3RBHWIV type=write size=4131826 2024-09-12T00:34:23.439 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.441+0000 7f1f2d864780 1 < completed part key=_multipart_DYKLAY6J018G.2~6RTZ2W5960VV.0 size=1048576 2024-09-12T00:34:23.440 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.442+0000 7f1f2d864780 1 < completed part key=_multipart_DYKLAY6J018G.2~6RTZ2W5960VV.1 size=742803 2024-09-12T00:34:23.442 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.444+0000 7f1f2d864780 1 < completed multipart upload key=DYKLAY6J018G upload=6RTZ2W5960VV tag=4LKIGWJ62G67 type=write size=2839955 2024-09-12T00:34:23.443 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.445+0000 7f1f2d864780 1 > prepared operation key=2G3UCYG4R4NM tag=NYHVV64BL0BQ type=del size=3563748 2024-09-12T00:34:23.444 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.446+0000 7f1f2d864780 1 < completed delete operation key=GSPM8N0K7ODC tag=R0PDKCW0I609 type=del 2024-09-12T00:34:23.445 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.447+0000 7f1f2d864780 1 > prepared operation key=D21W9QZWY0YU tag=3RTKF9HB8MX2 type=del size=3541751 2024-09-12T00:34:23.446 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.448+0000 7f1f2d864780 -1 < failed to complete operation key=FAP6N3H7SBN0 tag=ZDC3ZC5Y5WJL type=del size=810768: (22) Invalid argument 2024-09-12T00:34:23.448 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.450+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~685UIV14BV6F.0 size=1048576 2024-09-12T00:34:23.449 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.451+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~685UIV14BV6F.1 size=1048576 2024-09-12T00:34:23.450 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.451+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~685UIV14BV6F.2 size=472411 2024-09-12T00:34:23.450 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.451+0000 7f1f2d864780 1 > prepared multipart upload key=1299IOSGYIO9 upload=685UIV14BV6F tag=PV563I02USDF type=write size=3618139 2024-09-12T00:34:23.451 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.453+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~6HJ0U0QI6USP.0 size=1048576 2024-09-12T00:34:23.452 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.454+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~6HJ0U0QI6USP.1 size=311152 2024-09-12T00:34:23.454 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.455+0000 7f1f2d864780 1 < completed multipart upload key=0DSQOFS8IIF5 upload=6HJ0U0QI6USP tag=01Z1LU7GLOV8 type=write size=2408304 2024-09-12T00:34:23.455 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.456+0000 7f1f2d864780 1 > prepared operation key=WGKEA4EKF5GP tag=40T9T1H7Y8FD type=del size=1681699 2024-09-12T00:34:23.456 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.458+0000 7f1f2d864780 1 < completed delete operation key=2RV0899QUJ8W tag=2LKE1A6I09HV type=del 2024-09-12T00:34:23.457 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.459+0000 7f1f2d864780 1 > prepared operation key=UTR2UUO6DHLJ tag=Q61652VEC4XO type=del size=3240558 2024-09-12T00:34:23.458 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.460+0000 7f1f2d864780 1 < completed part key=_multipart_MSGU3PHLBRJH.2~5YEQ87LGHYBY.0 size=1048576 2024-09-12T00:34:23.459 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.461+0000 7f1f2d864780 1 < completed part key=_multipart_MSGU3PHLBRJH.2~5YEQ87LGHYBY.1 size=1048576 2024-09-12T00:34:23.459 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.461+0000 7f1f2d864780 1 < canceled part key=_multipart_MSGU3PHLBRJH.2~5YEQ87LGHYBY.2 size=378638 2024-09-12T00:34:23.461 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.462+0000 7f1f2d864780 1 < canceled multipart upload key=MSGU3PHLBRJH upload=5YEQ87LGHYBY tag=PXM5RKW390VH type=write size=3524366 2024-09-12T00:34:23.463 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.464+0000 7f1f2d864780 1 > prepared part key=_multipart_SNCGB6Z20450.2~6TRH57OCAJ97.0 size=1048576 2024-09-12T00:34:23.463 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.465+0000 7f1f2d864780 1 > prepared part key=_multipart_SNCGB6Z20450.2~6TRH57OCAJ97.1 size=1048576 2024-09-12T00:34:23.464 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.466+0000 7f1f2d864780 1 > prepared part key=_multipart_SNCGB6Z20450.2~6TRH57OCAJ97.2 size=431363 2024-09-12T00:34:23.465 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.466+0000 7f1f2d864780 1 > prepared multipart upload key=SNCGB6Z20450 upload=6TRH57OCAJ97 tag=EWIXTT1H30UW type=write size=3577091 2024-09-12T00:34:23.465 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.467+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~WNDR0PIJ3K9G.0 size=1048576 2024-09-12T00:34:23.466 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.468+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~WNDR0PIJ3K9G.1 size=1048576 2024-09-12T00:34:23.467 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.469+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~WNDR0PIJ3K9G.2 size=46747 2024-09-12T00:34:23.469 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.471+0000 7f1f2d864780 1 < completed multipart upload key=0DSQOFS8IIF5 upload=WNDR0PIJ3K9G tag=3ALVZHVT0HYX type=write size=3192475 2024-09-12T00:34:23.471 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.473+0000 7f1f2d864780 1 > prepared part key=_multipart_AN26EVAZI527.2~60K0GDHHT4F6.0 size=1048576 2024-09-12T00:34:23.472 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.474+0000 7f1f2d864780 1 > prepared part key=_multipart_AN26EVAZI527.2~60K0GDHHT4F6.1 size=1001285 2024-09-12T00:34:23.472 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.474+0000 7f1f2d864780 1 > prepared multipart upload key=AN26EVAZI527 upload=60K0GDHHT4F6 tag=LPLV5I5XJAUD type=write size=3098437 2024-09-12T00:34:23.473 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.475+0000 7f1f2d864780 1 < completed part key=_multipart_AN26EVAZI527.2~X90UGRGVEFGK.0 size=1048576 2024-09-12T00:34:23.474 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.476+0000 7f1f2d864780 1 < completed part key=_multipart_AN26EVAZI527.2~X90UGRGVEFGK.1 size=89811 2024-09-12T00:34:23.476 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.478+0000 7f1f2d864780 1 < completed multipart upload key=AN26EVAZI527 upload=X90UGRGVEFGK tag=EWNL6YJSST5L type=write size=2186963 2024-09-12T00:34:23.477 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.479+0000 7f1f2d864780 1 > prepared operation key=DYKLAY6J018G tag=7RVVSLRZCGS9 type=del size=340849 2024-09-12T00:34:23.479 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.480+0000 7f1f2d864780 1 < completed part key=_multipart_9XK59MVZ5G1O.2~AF6L3M2KL4TH.0 size=1048576 2024-09-12T00:34:23.479 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.480+0000 7f1f2d864780 1 < canceled part key=_multipart_9XK59MVZ5G1O.2~AF6L3M2KL4TH.1 size=1048576 2024-09-12T00:34:23.479 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.480+0000 7f1f2d864780 1 < canceled part key=_multipart_9XK59MVZ5G1O.2~AF6L3M2KL4TH.2 size=716031 2024-09-12T00:34:23.480 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.482+0000 7f1f2d864780 1 < canceled multipart upload key=9XK59MVZ5G1O upload=AF6L3M2KL4TH tag=QGCCXSUAFFKK type=write size=3861759 2024-09-12T00:34:23.483 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.484+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~11MH79S9TTRR.0 size=545538 2024-09-12T00:34:23.483 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.484+0000 7f1f2d864780 1 > prepared multipart upload key=0DSQOFS8IIF5 upload=11MH79S9TTRR tag=1K2GM082TNLN type=write size=1594114 2024-09-12T00:34:23.485 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.486+0000 7f1f2d864780 1 < suggested remove operation key=0DSQOFS8IIF5 tag=N6IQS14LBSZI type=del 2024-09-12T00:34:23.487 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.489+0000 7f1f2d864780 1 > prepared part key=_multipart_S5DVMA14N7VJ.2~EIPW4FZSMZLH.0 size=1048576 2024-09-12T00:34:23.488 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.490+0000 7f1f2d864780 1 > prepared part key=_multipart_S5DVMA14N7VJ.2~EIPW4FZSMZLH.1 size=273791 2024-09-12T00:34:23.488 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.490+0000 7f1f2d864780 1 > prepared multipart upload key=S5DVMA14N7VJ upload=EIPW4FZSMZLH tag=PSYVYWDTRYNQ type=write size=2370943 2024-09-12T00:34:23.489 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.491+0000 7f1f2d864780 1 < canceled operation key=WIIU8VTCLWOD tag=ZG0MM6Y6TFHL type=del size=617616 2024-09-12T00:34:23.491 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.493+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~A9V21Q5EF2PA.0 size=1048576 2024-09-12T00:34:23.492 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.494+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~A9V21Q5EF2PA.1 size=1048576 2024-09-12T00:34:23.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.495+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~A9V21Q5EF2PA.2 size=389708 2024-09-12T00:34:23.494 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.495+0000 7f1f2d864780 1 > prepared multipart upload key=1299IOSGYIO9 upload=A9V21Q5EF2PA tag=UZL585DATWCM type=write size=3535436 2024-09-12T00:34:23.496 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.497+0000 7f1f2d864780 1 < suggested update operation key=FAP6N3H7SBN0 tag=APP4UN0DY85U type=del size=2878164 2024-09-12T00:34:23.498 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.500+0000 7f1f2d864780 1 > prepared part key=_multipart_FFG41OYEYFZA.2~1VAVCQ96OS73.0 size=364631 2024-09-12T00:34:23.498 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.500+0000 7f1f2d864780 1 > prepared multipart upload key=FFG41OYEYFZA upload=1VAVCQ96OS73 tag=UHYLWGCOK49I type=write size=1413207 2024-09-12T00:34:23.499 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.501+0000 7f1f2d864780 1 < completed delete operation key=PVB52GO6L8T4 tag=OGMB5L02E7MF type=del 2024-09-12T00:34:23.501 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.502+0000 7f1f2d864780 1 > prepared operation key=4FRVL0KXN2X8 tag=C94ZN10B6IT3 type=del size=3363929 2024-09-12T00:34:23.503 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.505+0000 7f1f2d864780 1 < suggested remove operation key=WKK747ETLW10 tag=VS66PNQPFMF8 type=del 2024-09-12T00:34:23.504 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.506+0000 7f1f2d864780 1 > prepared operation key=O1YY03BOEYLM tag=VRXC5H9HRUHD type=del size=4173629 2024-09-12T00:34:23.506 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.507+0000 7f1f2d864780 1 < completed delete operation key=AN26EVAZI527 tag=O1RR49U27B0C type=del 2024-09-12T00:34:23.508 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.509+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~36E8IL8ERLDK.0 size=413608 2024-09-12T00:34:23.508 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.509+0000 7f1f2d864780 1 > prepared multipart upload key=D21W9QZWY0YU upload=36E8IL8ERLDK tag=TASD2ORN73IS type=write size=1462184 2024-09-12T00:34:23.509 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.511+0000 7f1f2d864780 1 < completed part key=_multipart_ZYNIJH0TTSM6.2~14O8CQG1BUS3.0 size=1048576 2024-09-12T00:34:23.510 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.512+0000 7f1f2d864780 1 < completed part key=_multipart_ZYNIJH0TTSM6.2~14O8CQG1BUS3.1 size=1048576 2024-09-12T00:34:23.511 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.513+0000 7f1f2d864780 1 < completed part key=_multipart_ZYNIJH0TTSM6.2~14O8CQG1BUS3.2 size=986098 2024-09-12T00:34:23.514 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.516+0000 7f1f2d864780 1 < completed multipart upload key=ZYNIJH0TTSM6 upload=14O8CQG1BUS3 tag=70G6S3RBHWIV type=write size=4131826 2024-09-12T00:34:23.516 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.517+0000 7f1f2d864780 1 > prepared operation key=FAP6N3H7SBN0 tag=PYT5S058AXNZ type=del size=3303169 2024-09-12T00:34:23.518 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.519+0000 7f1f2d864780 1 < suggested remove operation key=2G3UCYG4R4NM tag=NYHVV64BL0BQ type=del 2024-09-12T00:34:23.519 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.520+0000 7f1f2d864780 1 > prepared operation key=MSGU3PHLBRJH tag=1QKGJ1T9UZGE type=del size=898657 2024-09-12T00:34:23.520 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.521+0000 7f1f2d864780 1 < completed delete operation key=D21W9QZWY0YU tag=3RTKF9HB8MX2 type=del 2024-09-12T00:34:23.522 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.524+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~7BWS8W3I7NEB.0 size=1048576 2024-09-12T00:34:23.523 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.525+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~7BWS8W3I7NEB.1 size=1048576 2024-09-12T00:34:23.524 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.526+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~7BWS8W3I7NEB.2 size=659435 2024-09-12T00:34:23.525 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.526+0000 7f1f2d864780 1 > prepared multipart upload key=W6U30X4HJCB1 upload=7BWS8W3I7NEB tag=FYD5W314BQED type=write size=3805163 2024-09-12T00:34:23.526 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.527+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~685UIV14BV6F.0 size=1048576 2024-09-12T00:34:23.527 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.528+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~685UIV14BV6F.1 size=1048576 2024-09-12T00:34:23.528 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.529+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~685UIV14BV6F.2 size=472411 2024-09-12T00:34:23.530 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.532+0000 7f1f2d864780 1 < completed multipart upload key=1299IOSGYIO9 upload=685UIV14BV6F tag=PV563I02USDF type=write size=3618139 2024-09-12T00:34:23.532 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.534+0000 7f1f2d864780 1 > prepared part key=_multipart_GSPM8N0K7ODC.2~HILY5TOAHYBH.0 size=1048576 2024-09-12T00:34:23.533 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.535+0000 7f1f2d864780 1 > prepared part key=_multipart_GSPM8N0K7ODC.2~HILY5TOAHYBH.1 size=1048576 2024-09-12T00:34:23.535 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.536+0000 7f1f2d864780 1 > prepared part key=_multipart_GSPM8N0K7ODC.2~HILY5TOAHYBH.2 size=982043 2024-09-12T00:34:23.535 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.536+0000 7f1f2d864780 1 > prepared multipart upload key=GSPM8N0K7ODC upload=HILY5TOAHYBH tag=FIPZW3ITPLBH type=write size=4127771 2024-09-12T00:34:23.536 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.537+0000 7f1f2d864780 1 < canceled operation key=WGKEA4EKF5GP tag=40T9T1H7Y8FD type=del size=1681699 2024-09-12T00:34:23.540 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.539+0000 7f1f2d864780 1 > prepared operation key=KHPF1N1MT33Z tag=LEOCZOW12OPE type=del size=1138678 2024-09-12T00:34:23.540 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.540+0000 7f1f2d864780 1 < completed delete operation key=UTR2UUO6DHLJ tag=Q61652VEC4XO type=del 2024-09-12T00:34:23.540 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.541+0000 7f1f2d864780 1 > prepared operation key=2G3UCYG4R4NM tag=ERBIGCTB6P1K type=write size=985867 2024-09-12T00:34:23.541 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.542+0000 7f1f2d864780 1 < completed part key=_multipart_SNCGB6Z20450.2~6TRH57OCAJ97.0 size=1048576 2024-09-12T00:34:23.542 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.543+0000 7f1f2d864780 1 < completed part key=_multipart_SNCGB6Z20450.2~6TRH57OCAJ97.1 size=1048576 2024-09-12T00:34:23.543 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.544+0000 7f1f2d864780 1 < completed part key=_multipart_SNCGB6Z20450.2~6TRH57OCAJ97.2 size=431363 2024-09-12T00:34:23.545 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.547+0000 7f1f2d864780 1 < completed multipart upload key=SNCGB6Z20450 upload=6TRH57OCAJ97 tag=EWIXTT1H30UW type=write size=3577091 2024-09-12T00:34:23.547 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.549+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~5G9N7BYD9G4J.0 size=715589 2024-09-12T00:34:23.547 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.549+0000 7f1f2d864780 1 > prepared multipart upload key=4FRVL0KXN2X8 upload=5G9N7BYD9G4J tag=9QUTHLCVUE8G type=write size=1764165 2024-09-12T00:34:23.549 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.550+0000 7f1f2d864780 1 < completed part key=_multipart_AN26EVAZI527.2~60K0GDHHT4F6.0 size=1048576 2024-09-12T00:34:23.549 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.551+0000 7f1f2d864780 1 < completed part key=_multipart_AN26EVAZI527.2~60K0GDHHT4F6.1 size=1001285 2024-09-12T00:34:23.551 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.553+0000 7f1f2d864780 1 < completed multipart upload key=AN26EVAZI527 upload=60K0GDHHT4F6 tag=LPLV5I5XJAUD type=write size=3098437 2024-09-12T00:34:23.553 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.555+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~V2L8B8AY6YWC.0 size=1048576 2024-09-12T00:34:23.554 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.556+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~V2L8B8AY6YWC.1 size=227627 2024-09-12T00:34:23.554 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.556+0000 7f1f2d864780 1 > prepared multipart upload key=WGKEA4EKF5GP upload=V2L8B8AY6YWC tag=KB156X4QMWS2 type=write size=2324779 2024-09-12T00:34:23.555 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.557+0000 7f1f2d864780 1 < completed delete operation key=DYKLAY6J018G tag=7RVVSLRZCGS9 type=del 2024-09-12T00:34:23.557 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.559+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~W9HKL1QUU6W1.0 size=1048576 2024-09-12T00:34:23.558 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.560+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~W9HKL1QUU6W1.1 size=1048576 2024-09-12T00:34:23.559 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.561+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~W9HKL1QUU6W1.2 size=560 2024-09-12T00:34:23.559 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.561+0000 7f1f2d864780 1 > prepared multipart upload key=WGKEA4EKF5GP upload=W9HKL1QUU6W1 tag=U0GEQLN2U49Q type=write size=3146288 2024-09-12T00:34:23.560 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.562+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~11MH79S9TTRR.0 size=545538 2024-09-12T00:34:23.562 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.564+0000 7f1f2d864780 1 < completed multipart upload key=0DSQOFS8IIF5 upload=11MH79S9TTRR tag=1K2GM082TNLN type=write size=1594114 2024-09-12T00:34:23.564 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.566+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~87864IZXHSAL.0 size=1048576 2024-09-12T00:34:23.565 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.567+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~87864IZXHSAL.1 size=786794 2024-09-12T00:34:23.565 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.567+0000 7f1f2d864780 1 > prepared multipart upload key=FAP6N3H7SBN0 upload=87864IZXHSAL tag=CDWKS2L3VX47 type=write size=2883946 2024-09-12T00:34:23.566 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.568+0000 7f1f2d864780 1 < completed part key=_multipart_S5DVMA14N7VJ.2~EIPW4FZSMZLH.0 size=1048576 2024-09-12T00:34:23.566 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.568+0000 7f1f2d864780 1 < canceled part key=_multipart_S5DVMA14N7VJ.2~EIPW4FZSMZLH.1 size=273791 2024-09-12T00:34:23.568 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.570+0000 7f1f2d864780 1 < canceled multipart upload key=S5DVMA14N7VJ upload=EIPW4FZSMZLH tag=PSYVYWDTRYNQ type=write size=2370943 2024-09-12T00:34:23.569 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.571+0000 7f1f2d864780 1 > prepared operation key=3Z1TGGPZKJ69 tag=MW21L0UEVLWW type=del size=572526 2024-09-12T00:34:23.570 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.572+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~A9V21Q5EF2PA.0 size=1048576 2024-09-12T00:34:23.571 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.573+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~A9V21Q5EF2PA.1 size=1048576 2024-09-12T00:34:23.572 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.574+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~A9V21Q5EF2PA.2 size=389708 2024-09-12T00:34:23.574 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.575+0000 7f1f2d864780 1 < completed multipart upload key=1299IOSGYIO9 upload=A9V21Q5EF2PA tag=UZL585DATWCM type=write size=3535436 2024-09-12T00:34:23.575 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.577+0000 7f1f2d864780 1 > prepared operation key=ZGO887JDR627 tag=HDR0E2U8B7AY type=write size=9969 2024-09-12T00:34:23.576 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.578+0000 7f1f2d864780 1 < completed part key=_multipart_FFG41OYEYFZA.2~1VAVCQ96OS73.0 size=364631 2024-09-12T00:34:23.578 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.579+0000 7f1f2d864780 1 < completed multipart upload key=FFG41OYEYFZA upload=1VAVCQ96OS73 tag=UHYLWGCOK49I type=write size=1413207 2024-09-12T00:34:23.580 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.581+0000 7f1f2d864780 1 > prepared part key=_multipart_O1YY03BOEYLM.2~FDGFDEPG11K7.0 size=611974 2024-09-12T00:34:23.580 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.581+0000 7f1f2d864780 1 > prepared multipart upload key=O1YY03BOEYLM upload=FDGFDEPG11K7 tag=5ACRQFZGWPDA type=write size=1660550 2024-09-12T00:34:23.581 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.583+0000 7f1f2d864780 1 < completed delete operation key=4FRVL0KXN2X8 tag=C94ZN10B6IT3 type=del 2024-09-12T00:34:23.582 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.584+0000 7f1f2d864780 1 > prepared operation key=KHPF1N1MT33Z tag=Q4ZO2RR3JN0G type=del size=1063734 2024-09-12T00:34:23.584 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.586+0000 7f1f2d864780 1 < suggested update operation key=O1YY03BOEYLM tag=VRXC5H9HRUHD type=del size=4173629 2024-09-12T00:34:23.586 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.588+0000 7f1f2d864780 1 > prepared part key=_multipart_SNCGB6Z20450.2~AB09IBSYQG8E.0 size=112621 2024-09-12T00:34:23.587 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.588+0000 7f1f2d864780 1 > prepared multipart upload key=SNCGB6Z20450 upload=AB09IBSYQG8E tag=2NO7BUG4BYC8 type=write size=1161197 2024-09-12T00:34:23.588 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.589+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~36E8IL8ERLDK.0 size=413608 2024-09-12T00:34:23.589 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.591+0000 7f1f2d864780 1 < completed multipart upload key=D21W9QZWY0YU upload=36E8IL8ERLDK tag=TASD2ORN73IS type=write size=1462184 2024-09-12T00:34:23.592 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.593+0000 7f1f2d864780 1 > prepared part key=_multipart_2RV0899QUJ8W.2~ZUV9CGMEFKRK.0 size=193256 2024-09-12T00:34:23.592 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.593+0000 7f1f2d864780 1 > prepared multipart upload key=2RV0899QUJ8W upload=ZUV9CGMEFKRK tag=7MW74EK3DNDF type=write size=1241832 2024-09-12T00:34:23.593 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.594+0000 7f1f2d864780 1 < completed delete operation key=FAP6N3H7SBN0 tag=PYT5S058AXNZ type=del 2024-09-12T00:34:23.595 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.597+0000 7f1f2d864780 1 > prepared part key=_multipart_OY145ZXRSF4L.2~BZ6XKW63E0FW.0 size=537275 2024-09-12T00:34:23.595 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.597+0000 7f1f2d864780 1 > prepared multipart upload key=OY145ZXRSF4L upload=BZ6XKW63E0FW tag=JGK532NZUC92 type=write size=1585851 2024-09-12T00:34:23.597 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.599+0000 7f1f2d864780 1 < suggested remove operation key=MSGU3PHLBRJH tag=1QKGJ1T9UZGE type=del 2024-09-12T00:34:23.600 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.602+0000 7f1f2d864780 1 > prepared operation key=AN26EVAZI527 tag=4QHDJEUSL3VI type=del size=910796 2024-09-12T00:34:23.601 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.603+0000 7f1f2d864780 1 < completed part key=_multipart_W6U30X4HJCB1.2~7BWS8W3I7NEB.0 size=1048576 2024-09-12T00:34:23.602 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.604+0000 7f1f2d864780 1 < completed part key=_multipart_W6U30X4HJCB1.2~7BWS8W3I7NEB.1 size=1048576 2024-09-12T00:34:23.603 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.605+0000 7f1f2d864780 1 < completed part key=_multipart_W6U30X4HJCB1.2~7BWS8W3I7NEB.2 size=659435 2024-09-12T00:34:23.605 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.607+0000 7f1f2d864780 1 < completed multipart upload key=W6U30X4HJCB1 upload=7BWS8W3I7NEB tag=FYD5W314BQED type=write size=3805163 2024-09-12T00:34:23.606 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.608+0000 7f1f2d864780 1 > prepared operation key=FFG41OYEYFZA tag=EAHYV8603E5F type=del size=1125563 2024-09-12T00:34:23.607 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.609+0000 7f1f2d864780 1 < completed part key=_multipart_GSPM8N0K7ODC.2~HILY5TOAHYBH.0 size=1048576 2024-09-12T00:34:23.608 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.610+0000 7f1f2d864780 1 < completed part key=_multipart_GSPM8N0K7ODC.2~HILY5TOAHYBH.1 size=1048576 2024-09-12T00:34:23.609 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.611+0000 7f1f2d864780 1 < completed part key=_multipart_GSPM8N0K7ODC.2~HILY5TOAHYBH.2 size=982043 2024-09-12T00:34:23.611 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.613+0000 7f1f2d864780 1 < completed multipart upload key=GSPM8N0K7ODC upload=HILY5TOAHYBH tag=FIPZW3ITPLBH type=write size=4127771 2024-09-12T00:34:23.613 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.615+0000 7f1f2d864780 1 > prepared part key=_multipart_AN26EVAZI527.2~PE003V3OU97G.0 size=1048576 2024-09-12T00:34:23.614 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.616+0000 7f1f2d864780 1 > prepared part key=_multipart_AN26EVAZI527.2~PE003V3OU97G.1 size=1048576 2024-09-12T00:34:23.615 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.617+0000 7f1f2d864780 1 > prepared part key=_multipart_AN26EVAZI527.2~PE003V3OU97G.2 size=438594 2024-09-12T00:34:23.615 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.617+0000 7f1f2d864780 1 > prepared multipart upload key=AN26EVAZI527 upload=PE003V3OU97G tag=2YFSPMKVKQQP type=write size=3584322 2024-09-12T00:34:23.616 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.618+0000 7f1f2d864780 1 < completed delete operation key=KHPF1N1MT33Z tag=LEOCZOW12OPE type=del 2024-09-12T00:34:23.617 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.619+0000 7f1f2d864780 1 > prepared operation key=SZP418NVZ5VX tag=JC6ERFDCK6FO type=del size=3835103 2024-09-12T00:34:23.619 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.620+0000 7f1f2d864780 1 < completed write operation key=2G3UCYG4R4NM tag=ERBIGCTB6P1K type=write size=985867 2024-09-12T00:34:23.620 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.621+0000 7f1f2d864780 1 > prepared operation key=ECZYQEZ942W8 tag=Q3Y8YAFIROVL type=del size=4079331 2024-09-12T00:34:23.621 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.623+0000 7f1f2d864780 1 < completed part key=_multipart_4FRVL0KXN2X8.2~5G9N7BYD9G4J.0 size=715589 2024-09-12T00:34:23.624 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.626+0000 7f1f2d864780 1 < completed multipart upload key=4FRVL0KXN2X8 upload=5G9N7BYD9G4J tag=9QUTHLCVUE8G type=write size=1764165 2024-09-12T00:34:23.625 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.627+0000 7f1f2d864780 1 > prepared operation key=FAP6N3H7SBN0 tag=3M7Y3BZUJP1Y type=write size=532650 2024-09-12T00:34:23.626 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.628+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~V2L8B8AY6YWC.0 size=1048576 2024-09-12T00:34:23.627 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.629+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~V2L8B8AY6YWC.1 size=227627 2024-09-12T00:34:23.629 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.631+0000 7f1f2d864780 1 < completed multipart upload key=WGKEA4EKF5GP upload=V2L8B8AY6YWC tag=KB156X4QMWS2 type=write size=2324779 2024-09-12T00:34:23.630 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.632+0000 7f1f2d864780 1 > prepared operation key=KHPF1N1MT33Z tag=D3EK23PZOLXF type=write size=16127 2024-09-12T00:34:23.632 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.633+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~W9HKL1QUU6W1.0 size=1048576 2024-09-12T00:34:23.633 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.634+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~W9HKL1QUU6W1.1 size=1048576 2024-09-12T00:34:23.633 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.635+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~W9HKL1QUU6W1.2 size=560 2024-09-12T00:34:23.635 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.637+0000 7f1f2d864780 1 < completed multipart upload key=WGKEA4EKF5GP upload=W9HKL1QUU6W1 tag=U0GEQLN2U49Q type=write size=3146288 2024-09-12T00:34:23.636 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.638+0000 7f1f2d864780 1 > prepared operation key=3Z1TGGPZKJ69 tag=JIXLJY4LWHI5 type=del size=2070974 2024-09-12T00:34:23.639 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.639+0000 7f1f2d864780 1 < completed part key=_multipart_FAP6N3H7SBN0.2~87864IZXHSAL.0 size=1048576 2024-09-12T00:34:23.639 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.640+0000 7f1f2d864780 1 < completed part key=_multipart_FAP6N3H7SBN0.2~87864IZXHSAL.1 size=786794 2024-09-12T00:34:23.641 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.642+0000 7f1f2d864780 1 < completed multipart upload key=FAP6N3H7SBN0 upload=87864IZXHSAL tag=CDWKS2L3VX47 type=write size=2883946 2024-09-12T00:34:23.643 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.644+0000 7f1f2d864780 1 > prepared part key=_multipart_UTR2UUO6DHLJ.2~WV98WS38RPG9.0 size=1048576 2024-09-12T00:34:23.643 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.645+0000 7f1f2d864780 1 > prepared part key=_multipart_UTR2UUO6DHLJ.2~WV98WS38RPG9.1 size=1048576 2024-09-12T00:34:23.644 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.646+0000 7f1f2d864780 1 > prepared part key=_multipart_UTR2UUO6DHLJ.2~WV98WS38RPG9.2 size=982899 2024-09-12T00:34:23.645 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.646+0000 7f1f2d864780 1 > prepared multipart upload key=UTR2UUO6DHLJ upload=WV98WS38RPG9 tag=NOL7U7YAYRZJ type=write size=4128627 2024-09-12T00:34:23.645 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.647+0000 7f1f2d864780 1 < completed delete operation key=3Z1TGGPZKJ69 tag=MW21L0UEVLWW type=del 2024-09-12T00:34:23.647 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.648+0000 7f1f2d864780 1 > prepared operation key=2G3UCYG4R4NM tag=3A6KOYNF61RW type=del size=4031767 2024-09-12T00:34:23.649 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.651+0000 7f1f2d864780 1 < suggested update operation key=ZGO887JDR627 tag=HDR0E2U8B7AY type=write size=9969 2024-09-12T00:34:23.651 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.653+0000 7f1f2d864780 1 > prepared part key=_multipart_N9RQIGHVL8VP.2~126MHZK4OBLY.0 size=1048576 2024-09-12T00:34:23.652 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.654+0000 7f1f2d864780 1 > prepared part key=_multipart_N9RQIGHVL8VP.2~126MHZK4OBLY.1 size=1048576 2024-09-12T00:34:23.653 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.655+0000 7f1f2d864780 1 > prepared part key=_multipart_N9RQIGHVL8VP.2~126MHZK4OBLY.2 size=80896 2024-09-12T00:34:23.653 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.655+0000 7f1f2d864780 1 > prepared multipart upload key=N9RQIGHVL8VP upload=126MHZK4OBLY tag=ZABEGS5SCZUY type=write size=3226624 2024-09-12T00:34:23.654 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.656+0000 7f1f2d864780 1 < completed part key=_multipart_O1YY03BOEYLM.2~FDGFDEPG11K7.0 size=611974 2024-09-12T00:34:23.656 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.658+0000 7f1f2d864780 1 < completed multipart upload key=O1YY03BOEYLM upload=FDGFDEPG11K7 tag=5ACRQFZGWPDA type=write size=1660550 2024-09-12T00:34:23.657 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.659+0000 7f1f2d864780 1 > prepared operation key=S5DVMA14N7VJ tag=XUENE246B4NH type=del size=405014 2024-09-12T00:34:23.659 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.660+0000 7f1f2d864780 1 < completed delete operation key=KHPF1N1MT33Z tag=Q4ZO2RR3JN0G type=del 2024-09-12T00:34:23.660 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.661+0000 7f1f2d864780 1 > prepared operation key=FAP6N3H7SBN0 tag=PI36EB1RP253 type=del size=3261753 2024-09-12T00:34:23.661 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.663+0000 7f1f2d864780 1 < completed part key=_multipart_SNCGB6Z20450.2~AB09IBSYQG8E.0 size=112621 2024-09-12T00:34:23.663 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.665+0000 7f1f2d864780 1 < completed multipart upload key=SNCGB6Z20450 upload=AB09IBSYQG8E tag=2NO7BUG4BYC8 type=write size=1161197 2024-09-12T00:34:23.664 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.666+0000 7f1f2d864780 1 > prepared operation key=2YCGIJRK6MUH tag=0TDFUMABOKX1 type=del size=461417 2024-09-12T00:34:23.665 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.667+0000 7f1f2d864780 1 < completed part key=_multipart_2RV0899QUJ8W.2~ZUV9CGMEFKRK.0 size=193256 2024-09-12T00:34:23.667 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.669+0000 7f1f2d864780 1 < completed multipart upload key=2RV0899QUJ8W upload=ZUV9CGMEFKRK tag=7MW74EK3DNDF type=write size=1241832 2024-09-12T00:34:23.669 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.670+0000 7f1f2d864780 1 > prepared operation key=PVB52GO6L8T4 tag=YOSO4X3HOF2Q type=del size=2455341 2024-09-12T00:34:23.670 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.672+0000 7f1f2d864780 1 < completed part key=_multipart_OY145ZXRSF4L.2~BZ6XKW63E0FW.0 size=537275 2024-09-12T00:34:23.672 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.673+0000 7f1f2d864780 1 < completed multipart upload key=OY145ZXRSF4L upload=BZ6XKW63E0FW tag=JGK532NZUC92 type=write size=1585851 2024-09-12T00:34:23.673 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.675+0000 7f1f2d864780 1 > prepared operation key=PVB52GO6L8T4 tag=BPXOM4X2FJLC type=del size=29568 2024-09-12T00:34:23.675 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.677+0000 7f1f2d864780 1 < suggested remove operation key=AN26EVAZI527 tag=4QHDJEUSL3VI type=del 2024-09-12T00:34:23.677 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.678+0000 7f1f2d864780 1 > prepared operation key=SNCGB6Z20450 tag=RU8QBUDSP7FV type=del size=2093529 2024-09-12T00:34:23.678 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.680+0000 7f1f2d864780 1 < completed delete operation key=FFG41OYEYFZA tag=EAHYV8603E5F type=del 2024-09-12T00:34:23.679 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.681+0000 7f1f2d864780 1 > prepared operation key=PVB52GO6L8T4 tag=32PCC4JSJZ5K type=del size=1809558 2024-09-12T00:34:23.681 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.682+0000 7f1f2d864780 1 < completed part key=_multipart_AN26EVAZI527.2~PE003V3OU97G.0 size=1048576 2024-09-12T00:34:23.681 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.683+0000 7f1f2d864780 1 < completed part key=_multipart_AN26EVAZI527.2~PE003V3OU97G.1 size=1048576 2024-09-12T00:34:23.682 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.684+0000 7f1f2d864780 1 < completed part key=_multipart_AN26EVAZI527.2~PE003V3OU97G.2 size=438594 2024-09-12T00:34:23.684 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.686+0000 7f1f2d864780 1 < completed multipart upload key=AN26EVAZI527 upload=PE003V3OU97G tag=2YFSPMKVKQQP type=write size=3584322 2024-09-12T00:34:23.687 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.688+0000 7f1f2d864780 1 > prepared part key=_multipart_2G3UCYG4R4NM.2~EP32DLARL2LL.0 size=1048576 2024-09-12T00:34:23.688 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.689+0000 7f1f2d864780 1 > prepared part key=_multipart_2G3UCYG4R4NM.2~EP32DLARL2LL.1 size=1048576 2024-09-12T00:34:23.689 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.690+0000 7f1f2d864780 1 > prepared part key=_multipart_2G3UCYG4R4NM.2~EP32DLARL2LL.2 size=347637 2024-09-12T00:34:23.689 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.690+0000 7f1f2d864780 1 > prepared multipart upload key=2G3UCYG4R4NM upload=EP32DLARL2LL tag=BMQS7UBTZT7T type=write size=3493365 2024-09-12T00:34:23.690 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.692+0000 7f1f2d864780 1 < completed delete operation key=SZP418NVZ5VX tag=JC6ERFDCK6FO type=del 2024-09-12T00:34:23.691 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.693+0000 7f1f2d864780 1 > prepared operation key=UTR2UUO6DHLJ tag=MG7MX5VU53GV type=del size=2669664 2024-09-12T00:34:23.693 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.694+0000 7f1f2d864780 1 < completed delete operation key=ECZYQEZ942W8 tag=Q3Y8YAFIROVL type=del 2024-09-12T00:34:23.694 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.696+0000 7f1f2d864780 1 > prepared operation key=OY145ZXRSF4L tag=XV7V6LG0EK98 type=del size=511395 2024-09-12T00:34:23.697 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.698+0000 7f1f2d864780 1 < suggested remove operation key=FAP6N3H7SBN0 tag=3M7Y3BZUJP1Y type=write 2024-09-12T00:34:23.698 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.699+0000 7f1f2d864780 1 > prepared operation key=MSGU3PHLBRJH tag=WLA4BHN49RJ6 type=del size=4145582 2024-09-12T00:34:23.699 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.701+0000 7f1f2d864780 1 < completed write operation key=KHPF1N1MT33Z tag=D3EK23PZOLXF type=write size=16127 2024-09-12T00:34:23.700 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.702+0000 7f1f2d864780 1 > prepared operation key=WKK747ETLW10 tag=30N1HGW2Y1M4 type=write size=674663 2024-09-12T00:34:23.703 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.704+0000 7f1f2d864780 1 < suggested update operation key=3Z1TGGPZKJ69 tag=JIXLJY4LWHI5 type=del size=2070974 2024-09-12T00:34:23.704 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.706+0000 7f1f2d864780 1 > prepared operation key=AN26EVAZI527 tag=ZDP19PI1WDU4 type=del size=271437 2024-09-12T00:34:23.705 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.707+0000 7f1f2d864780 1 < completed part key=_multipart_UTR2UUO6DHLJ.2~WV98WS38RPG9.0 size=1048576 2024-09-12T00:34:23.706 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.708+0000 7f1f2d864780 1 < completed part key=_multipart_UTR2UUO6DHLJ.2~WV98WS38RPG9.1 size=1048576 2024-09-12T00:34:23.707 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.708+0000 7f1f2d864780 1 < canceled part key=_multipart_UTR2UUO6DHLJ.2~WV98WS38RPG9.2 size=982899 2024-09-12T00:34:23.708 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.710+0000 7f1f2d864780 1 < canceled multipart upload key=UTR2UUO6DHLJ upload=WV98WS38RPG9 tag=NOL7U7YAYRZJ type=write size=4128627 2024-09-12T00:34:23.710 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.711+0000 7f1f2d864780 1 > prepared operation key=WIIU8VTCLWOD tag=X35H6VBX3TEZ type=del size=2280002 2024-09-12T00:34:23.711 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.713+0000 7f1f2d864780 1 < completed delete operation key=2G3UCYG4R4NM tag=3A6KOYNF61RW type=del 2024-09-12T00:34:23.713 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.715+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~U7KZOH98RZM2.0 size=1048576 2024-09-12T00:34:23.714 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.716+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~U7KZOH98RZM2.1 size=294880 2024-09-12T00:34:23.714 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.716+0000 7f1f2d864780 1 > prepared multipart upload key=FAP6N3H7SBN0 upload=U7KZOH98RZM2 tag=I8V7CP1QP3HA type=write size=2392032 2024-09-12T00:34:23.715 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.717+0000 7f1f2d864780 1 < completed part key=_multipart_N9RQIGHVL8VP.2~126MHZK4OBLY.0 size=1048576 2024-09-12T00:34:23.716 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.718+0000 7f1f2d864780 1 < completed part key=_multipart_N9RQIGHVL8VP.2~126MHZK4OBLY.1 size=1048576 2024-09-12T00:34:23.717 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.719+0000 7f1f2d864780 1 < completed part key=_multipart_N9RQIGHVL8VP.2~126MHZK4OBLY.2 size=80896 2024-09-12T00:34:23.719 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.721+0000 7f1f2d864780 1 < completed multipart upload key=N9RQIGHVL8VP upload=126MHZK4OBLY tag=ZABEGS5SCZUY type=write size=3226624 2024-09-12T00:34:23.720 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.722+0000 7f1f2d864780 1 > prepared operation key=N9RQIGHVL8VP tag=LV7TRZN651TX type=del size=2340632 2024-09-12T00:34:23.722 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.723+0000 7f1f2d864780 1 < completed delete operation key=S5DVMA14N7VJ tag=XUENE246B4NH type=del 2024-09-12T00:34:23.723 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.725+0000 7f1f2d864780 1 > prepared operation key=KHPF1N1MT33Z tag=L9CY49Z4T7NZ type=del size=2433633 2024-09-12T00:34:23.724 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.726+0000 7f1f2d864780 -1 < failed to complete operation key=FAP6N3H7SBN0 tag=PI36EB1RP253 type=del size=3261753: (22) Invalid argument 2024-09-12T00:34:23.727 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.728+0000 7f1f2d864780 1 > prepared part key=_multipart_UTR2UUO6DHLJ.2~8WQKH9T4WRNF.0 size=1048576 2024-09-12T00:34:23.728 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.730+0000 7f1f2d864780 1 > prepared part key=_multipart_UTR2UUO6DHLJ.2~8WQKH9T4WRNF.1 size=860807 2024-09-12T00:34:23.728 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.730+0000 7f1f2d864780 1 > prepared multipart upload key=UTR2UUO6DHLJ upload=8WQKH9T4WRNF tag=D7YJQRFEWN1A type=write size=2957959 2024-09-12T00:34:23.729 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.731+0000 7f1f2d864780 1 < completed delete operation key=2YCGIJRK6MUH tag=0TDFUMABOKX1 type=del 2024-09-12T00:34:23.732 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.733+0000 7f1f2d864780 1 > prepared part key=_multipart_O1YY03BOEYLM.2~XUQRG5FPP7BI.0 size=795749 2024-09-12T00:34:23.732 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.733+0000 7f1f2d864780 1 > prepared multipart upload key=O1YY03BOEYLM upload=XUQRG5FPP7BI tag=TPNNBQRYIRG0 type=write size=1844325 2024-09-12T00:34:23.733 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.734+0000 7f1f2d864780 1 < completed delete operation key=PVB52GO6L8T4 tag=YOSO4X3HOF2Q type=del 2024-09-12T00:34:23.734 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.736+0000 7f1f2d864780 1 > prepared operation key=ZYNIJH0TTSM6 tag=1L6YO6QISBX1 type=del size=1563911 2024-09-12T00:34:23.737 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.738+0000 7f1f2d864780 1 < completed delete operation key=PVB52GO6L8T4 tag=BPXOM4X2FJLC type=del 2024-09-12T00:34:23.740 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.742+0000 7f1f2d864780 1 > prepared part key=_multipart_PVB52GO6L8T4.2~4U56UWXFCGH1.0 size=820177 2024-09-12T00:34:23.741 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.742+0000 7f1f2d864780 1 > prepared multipart upload key=PVB52GO6L8T4 upload=4U56UWXFCGH1 tag=X6L270KYH6QW type=write size=1868753 2024-09-12T00:34:23.743 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.744+0000 7f1f2d864780 1 < completed delete operation key=SNCGB6Z20450 tag=RU8QBUDSP7FV type=del 2024-09-12T00:34:23.744 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.745+0000 7f1f2d864780 1 > prepared operation key=2YCGIJRK6MUH tag=2QUDJ2P1AJKL type=del size=1065967 2024-09-12T00:34:23.745 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.746+0000 7f1f2d864780 1 < canceled operation key=PVB52GO6L8T4 tag=32PCC4JSJZ5K type=del size=1809558 2024-09-12T00:34:23.746 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.747+0000 7f1f2d864780 1 > prepared operation key=UTR2UUO6DHLJ tag=V5QRGJD85PB3 type=del size=961947 2024-09-12T00:34:23.747 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.748+0000 7f1f2d864780 1 < canceled part key=_multipart_2G3UCYG4R4NM.2~EP32DLARL2LL.0 size=1048576 2024-09-12T00:34:23.747 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.749+0000 7f1f2d864780 1 < completed part key=_multipart_2G3UCYG4R4NM.2~EP32DLARL2LL.1 size=1048576 2024-09-12T00:34:23.748 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.750+0000 7f1f2d864780 1 < completed part key=_multipart_2G3UCYG4R4NM.2~EP32DLARL2LL.2 size=347637 2024-09-12T00:34:23.750 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.752+0000 7f1f2d864780 1 < canceled multipart upload key=2G3UCYG4R4NM upload=EP32DLARL2LL tag=BMQS7UBTZT7T type=write size=3493365 2024-09-12T00:34:23.751 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.753+0000 7f1f2d864780 1 > prepared operation key=ZYNIJH0TTSM6 tag=6P3349QCSBWQ type=del size=3095596 2024-09-12T00:34:23.754 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.755+0000 7f1f2d864780 1 < suggested update operation key=UTR2UUO6DHLJ tag=MG7MX5VU53GV type=del size=2669664 2024-09-12T00:34:23.755 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.756+0000 7f1f2d864780 1 > prepared operation key=9XK59MVZ5G1O tag=9570GI0VQUST type=del size=3478124 2024-09-12T00:34:23.756 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.758+0000 7f1f2d864780 1 < completed delete operation key=OY145ZXRSF4L tag=XV7V6LG0EK98 type=del 2024-09-12T00:34:23.758 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.760+0000 7f1f2d864780 1 > prepared part key=_multipart_WKK747ETLW10.2~ALGTDRWT8CCG.0 size=1048576 2024-09-12T00:34:23.759 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.761+0000 7f1f2d864780 1 > prepared part key=_multipart_WKK747ETLW10.2~ALGTDRWT8CCG.1 size=1048576 2024-09-12T00:34:23.760 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.762+0000 7f1f2d864780 1 > prepared part key=_multipart_WKK747ETLW10.2~ALGTDRWT8CCG.2 size=110291 2024-09-12T00:34:23.760 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.762+0000 7f1f2d864780 1 > prepared multipart upload key=WKK747ETLW10 upload=ALGTDRWT8CCG tag=KTTUTI5M3Z6C type=write size=3256019 2024-09-12T00:34:23.761 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.763+0000 7f1f2d864780 1 < completed delete operation key=MSGU3PHLBRJH tag=WLA4BHN49RJ6 type=del 2024-09-12T00:34:23.762 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.764+0000 7f1f2d864780 1 > prepared operation key=2G3UCYG4R4NM tag=1516ZVDCQZG2 type=del size=2452318 2024-09-12T00:34:23.764 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.765+0000 7f1f2d864780 1 < completed write operation key=WKK747ETLW10 tag=30N1HGW2Y1M4 type=write size=674663 2024-09-12T00:34:23.765 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.766+0000 7f1f2d864780 1 > prepared operation key=53QCNWX1V1R1 tag=S9UMFWLPR1T7 type=del size=529146 2024-09-12T00:34:23.767 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.769+0000 7f1f2d864780 1 < suggested update operation key=AN26EVAZI527 tag=ZDP19PI1WDU4 type=del size=271437 2024-09-12T00:34:23.768 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.770+0000 7f1f2d864780 1 > prepared operation key=MSGU3PHLBRJH tag=DYVQAE3PYPRG type=del size=2440662 2024-09-12T00:34:23.769 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.771+0000 7f1f2d864780 1 < completed delete operation key=WIIU8VTCLWOD tag=X35H6VBX3TEZ type=del 2024-09-12T00:34:23.771 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.773+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~EQM9212L6Q7W.0 size=1048576 2024-09-12T00:34:23.772 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.774+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~EQM9212L6Q7W.1 size=613699 2024-09-12T00:34:23.772 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.774+0000 7f1f2d864780 1 > prepared multipart upload key=1299IOSGYIO9 upload=EQM9212L6Q7W tag=TURIA9Y1N5OF type=write size=2710851 2024-09-12T00:34:23.774 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.775+0000 7f1f2d864780 1 < completed part key=_multipart_FAP6N3H7SBN0.2~U7KZOH98RZM2.0 size=1048576 2024-09-12T00:34:23.774 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.776+0000 7f1f2d864780 1 < completed part key=_multipart_FAP6N3H7SBN0.2~U7KZOH98RZM2.1 size=294880 2024-09-12T00:34:23.776 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.778+0000 7f1f2d864780 1 < completed multipart upload key=FAP6N3H7SBN0 upload=U7KZOH98RZM2 tag=I8V7CP1QP3HA type=write size=2392032 2024-09-12T00:34:23.778 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.779+0000 7f1f2d864780 1 > prepared operation key=0DSQOFS8IIF5 tag=TYEOMASG1ZE3 type=del size=2938011 2024-09-12T00:34:23.779 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.780+0000 7f1f2d864780 1 < completed delete operation key=N9RQIGHVL8VP tag=LV7TRZN651TX type=del 2024-09-12T00:34:23.780 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.782+0000 7f1f2d864780 1 > prepared operation key=SNCGB6Z20450 tag=R3AWN97UCTMQ type=del size=2545392 2024-09-12T00:34:23.781 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.783+0000 7f1f2d864780 1 < completed delete operation key=KHPF1N1MT33Z tag=L9CY49Z4T7NZ type=del 2024-09-12T00:34:23.782 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.784+0000 7f1f2d864780 1 > prepared operation key=53QCNWX1V1R1 tag=RVJYG0GU2N2D type=del size=2354773 2024-09-12T00:34:23.783 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.785+0000 7f1f2d864780 1 < completed part key=_multipart_UTR2UUO6DHLJ.2~8WQKH9T4WRNF.0 size=1048576 2024-09-12T00:34:23.784 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.786+0000 7f1f2d864780 1 < completed part key=_multipart_UTR2UUO6DHLJ.2~8WQKH9T4WRNF.1 size=860807 2024-09-12T00:34:23.786 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.788+0000 7f1f2d864780 1 < completed multipart upload key=UTR2UUO6DHLJ upload=8WQKH9T4WRNF tag=D7YJQRFEWN1A type=write size=2957959 2024-09-12T00:34:23.787 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.789+0000 7f1f2d864780 1 > prepared operation key=SZP418NVZ5VX tag=1GJLOEF8XYHV type=del size=2722559 2024-09-12T00:34:23.789 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.790+0000 7f1f2d864780 1 < completed part key=_multipart_O1YY03BOEYLM.2~XUQRG5FPP7BI.0 size=795749 2024-09-12T00:34:23.791 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.793+0000 7f1f2d864780 1 < completed multipart upload key=O1YY03BOEYLM upload=XUQRG5FPP7BI tag=TPNNBQRYIRG0 type=write size=1844325 2024-09-12T00:34:23.793 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.795+0000 7f1f2d864780 1 > prepared part key=_multipart_GSPM8N0K7ODC.2~NASH2FMG90HQ.0 size=1048576 2024-09-12T00:34:23.794 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.795+0000 7f1f2d864780 1 > prepared part key=_multipart_GSPM8N0K7ODC.2~NASH2FMG90HQ.1 size=514916 2024-09-12T00:34:23.794 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.795+0000 7f1f2d864780 1 > prepared multipart upload key=GSPM8N0K7ODC upload=NASH2FMG90HQ tag=YLJDEIHRL8XN type=write size=2612068 2024-09-12T00:34:23.795 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.797+0000 7f1f2d864780 1 < completed delete operation key=ZYNIJH0TTSM6 tag=1L6YO6QISBX1 type=del 2024-09-12T00:34:23.797 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.799+0000 7f1f2d864780 1 > prepared part key=_multipart_ZGO887JDR627.2~W6NCU5YAZLUS.0 size=1048576 2024-09-12T00:34:23.798 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.800+0000 7f1f2d864780 1 > prepared part key=_multipart_ZGO887JDR627.2~W6NCU5YAZLUS.1 size=1048576 2024-09-12T00:34:23.799 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.801+0000 7f1f2d864780 1 > prepared part key=_multipart_ZGO887JDR627.2~W6NCU5YAZLUS.2 size=754118 2024-09-12T00:34:23.799 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.801+0000 7f1f2d864780 1 > prepared multipart upload key=ZGO887JDR627 upload=W6NCU5YAZLUS tag=EUZWXTX4GRXC type=write size=3899846 2024-09-12T00:34:23.800 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.802+0000 7f1f2d864780 1 < completed part key=_multipart_PVB52GO6L8T4.2~4U56UWXFCGH1.0 size=820177 2024-09-12T00:34:23.802 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.804+0000 7f1f2d864780 1 < completed multipart upload key=PVB52GO6L8T4 upload=4U56UWXFCGH1 tag=X6L270KYH6QW type=write size=1868753 2024-09-12T00:34:23.804 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.806+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~PJ69572YVGE2.0 size=1008396 2024-09-12T00:34:23.804 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.806+0000 7f1f2d864780 1 > prepared multipart upload key=1299IOSGYIO9 upload=PJ69572YVGE2 tag=I0RU5YBXC7MS type=write size=2056972 2024-09-12T00:34:23.805 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.807+0000 7f1f2d864780 1 < completed delete operation key=2YCGIJRK6MUH tag=2QUDJ2P1AJKL type=del 2024-09-12T00:34:23.807 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.809+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~F9MYDE4UZ8G7.0 size=1048576 2024-09-12T00:34:23.808 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.810+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~F9MYDE4UZ8G7.1 size=1048576 2024-09-12T00:34:23.809 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.811+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~F9MYDE4UZ8G7.2 size=557618 2024-09-12T00:34:23.809 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.811+0000 7f1f2d864780 1 > prepared multipart upload key=1299IOSGYIO9 upload=F9MYDE4UZ8G7 tag=XMJS63DILZLK type=write size=3703346 2024-09-12T00:34:23.810 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.812+0000 7f1f2d864780 -1 < failed to complete operation key=UTR2UUO6DHLJ tag=V5QRGJD85PB3 type=del size=961947: (22) Invalid argument 2024-09-12T00:34:23.812 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.813+0000 7f1f2d864780 1 > prepared operation key=53QCNWX1V1R1 tag=ZYCA1OM2DXAL type=del size=1493016 2024-09-12T00:34:23.813 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.814+0000 7f1f2d864780 1 < completed delete operation key=ZYNIJH0TTSM6 tag=6P3349QCSBWQ type=del 2024-09-12T00:34:23.814 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.816+0000 7f1f2d864780 1 > prepared operation key=PVB52GO6L8T4 tag=OUH6WO2CI6LW type=del size=3068089 2024-09-12T00:34:23.817 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.818+0000 7f1f2d864780 1 < suggested update operation key=9XK59MVZ5G1O tag=9570GI0VQUST type=del size=3478124 2024-09-12T00:34:23.818 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.820+0000 7f1f2d864780 1 > prepared operation key=WGKEA4EKF5GP tag=T7Z6Y0W6S8G7 type=del size=2816880 2024-09-12T00:34:23.819 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.821+0000 7f1f2d864780 1 < completed part key=_multipart_WKK747ETLW10.2~ALGTDRWT8CCG.0 size=1048576 2024-09-12T00:34:23.820 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.822+0000 7f1f2d864780 1 < completed part key=_multipart_WKK747ETLW10.2~ALGTDRWT8CCG.1 size=1048576 2024-09-12T00:34:23.821 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.823+0000 7f1f2d864780 1 < completed part key=_multipart_WKK747ETLW10.2~ALGTDRWT8CCG.2 size=110291 2024-09-12T00:34:23.823 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.825+0000 7f1f2d864780 1 < completed multipart upload key=WKK747ETLW10 upload=ALGTDRWT8CCG tag=KTTUTI5M3Z6C type=write size=3256019 2024-09-12T00:34:23.825 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.826+0000 7f1f2d864780 1 > prepared operation key=N9RQIGHVL8VP tag=X3085IED3Y86 type=del size=1635832 2024-09-12T00:34:23.827 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.829+0000 7f1f2d864780 1 < suggested update operation key=2G3UCYG4R4NM tag=1516ZVDCQZG2 type=del size=2452318 2024-09-12T00:34:23.829 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.830+0000 7f1f2d864780 1 > prepared operation key=ZYNIJH0TTSM6 tag=9926Q4XJVWWY type=del size=1014692 2024-09-12T00:34:23.830 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.831+0000 7f1f2d864780 1 < canceled operation key=53QCNWX1V1R1 tag=S9UMFWLPR1T7 type=del size=529146 2024-09-12T00:34:23.831 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.833+0000 7f1f2d864780 1 > prepared operation key=3Z1TGGPZKJ69 tag=3HUWBTCB3VPM type=del size=3660387 2024-09-12T00:34:23.832 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.834+0000 7f1f2d864780 1 < completed delete operation key=MSGU3PHLBRJH tag=DYVQAE3PYPRG type=del 2024-09-12T00:34:23.834 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.836+0000 7f1f2d864780 1 > prepared part key=_multipart_WKK747ETLW10.2~XUWSABOIL6B4.0 size=615528 2024-09-12T00:34:23.834 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.836+0000 7f1f2d864780 1 > prepared multipart upload key=WKK747ETLW10 upload=XUWSABOIL6B4 tag=GDX0VA0JDLGP type=write size=1664104 2024-09-12T00:34:23.835 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.837+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~EQM9212L6Q7W.0 size=1048576 2024-09-12T00:34:23.836 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.838+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~EQM9212L6Q7W.1 size=613699 2024-09-12T00:34:23.838 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.840+0000 7f1f2d864780 1 < completed multipart upload key=1299IOSGYIO9 upload=EQM9212L6Q7W tag=TURIA9Y1N5OF type=write size=2710851 2024-09-12T00:34:23.839 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.841+0000 7f1f2d864780 1 > prepared operation key=AN26EVAZI527 tag=J1XL7TGJNAHO type=del size=3769679 2024-09-12T00:34:23.841 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.842+0000 7f1f2d864780 1 < completed delete operation key=0DSQOFS8IIF5 tag=TYEOMASG1ZE3 type=del 2024-09-12T00:34:23.842 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.844+0000 7f1f2d864780 1 > prepared operation key=S5DVMA14N7VJ tag=Z8WD093LRKUL type=del size=1239344 2024-09-12T00:34:23.843 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.845+0000 7f1f2d864780 1 < completed delete operation key=SNCGB6Z20450 tag=R3AWN97UCTMQ type=del 2024-09-12T00:34:23.845 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.847+0000 7f1f2d864780 1 > prepared part key=_multipart_GSPM8N0K7ODC.2~3WY0XJJBUSHP.0 size=1048576 2024-09-12T00:34:23.846 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.848+0000 7f1f2d864780 1 > prepared part key=_multipart_GSPM8N0K7ODC.2~3WY0XJJBUSHP.1 size=83114 2024-09-12T00:34:23.846 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.848+0000 7f1f2d864780 1 > prepared multipart upload key=GSPM8N0K7ODC upload=3WY0XJJBUSHP tag=VWGRAESIWDBO type=write size=2180266 2024-09-12T00:34:23.847 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.849+0000 7f1f2d864780 1 < completed delete operation key=53QCNWX1V1R1 tag=RVJYG0GU2N2D type=del 2024-09-12T00:34:23.849 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.850+0000 7f1f2d864780 1 > prepared operation key=3Z1TGGPZKJ69 tag=B9H5GDKX0B4E type=write size=544053 2024-09-12T00:34:23.851 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.853+0000 7f1f2d864780 1 < completed delete operation key=SZP418NVZ5VX tag=1GJLOEF8XYHV type=del 2024-09-12T00:34:23.852 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.854+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=4V3GVDFW3R5U type=del size=2868824 2024-09-12T00:34:23.854 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.855+0000 7f1f2d864780 1 < completed part key=_multipart_GSPM8N0K7ODC.2~NASH2FMG90HQ.0 size=1048576 2024-09-12T00:34:23.855 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.856+0000 7f1f2d864780 1 < completed part key=_multipart_GSPM8N0K7ODC.2~NASH2FMG90HQ.1 size=514916 2024-09-12T00:34:23.857 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.858+0000 7f1f2d864780 1 < completed multipart upload key=GSPM8N0K7ODC upload=NASH2FMG90HQ tag=YLJDEIHRL8XN type=write size=2612068 2024-09-12T00:34:23.858 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.859+0000 7f1f2d864780 1 > prepared operation key=ECZYQEZ942W8 tag=1VX3RZVEYRG7 type=del size=70289 2024-09-12T00:34:23.859 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.860+0000 7f1f2d864780 1 < completed part key=_multipart_ZGO887JDR627.2~W6NCU5YAZLUS.0 size=1048576 2024-09-12T00:34:23.860 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.861+0000 7f1f2d864780 1 < completed part key=_multipart_ZGO887JDR627.2~W6NCU5YAZLUS.1 size=1048576 2024-09-12T00:34:23.861 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.862+0000 7f1f2d864780 1 < completed part key=_multipart_ZGO887JDR627.2~W6NCU5YAZLUS.2 size=754118 2024-09-12T00:34:23.863 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.864+0000 7f1f2d864780 1 < completed multipart upload key=ZGO887JDR627 upload=W6NCU5YAZLUS tag=EUZWXTX4GRXC type=write size=3899846 2024-09-12T00:34:23.865 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.867+0000 7f1f2d864780 1 > prepared part key=_multipart_N9RQIGHVL8VP.2~80PIRKHB9Z2M.0 size=895729 2024-09-12T00:34:23.865 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.867+0000 7f1f2d864780 1 > prepared multipart upload key=N9RQIGHVL8VP upload=80PIRKHB9Z2M tag=GZJZJA8LYSXF type=write size=1944305 2024-09-12T00:34:23.866 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.868+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~PJ69572YVGE2.0 size=1008396 2024-09-12T00:34:23.869 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.870+0000 7f1f2d864780 1 < completed multipart upload key=1299IOSGYIO9 upload=PJ69572YVGE2 tag=I0RU5YBXC7MS type=write size=2056972 2024-09-12T00:34:23.870 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.871+0000 7f1f2d864780 1 > prepared operation key=D21W9QZWY0YU tag=VIT1B9E4RE4M type=del size=2660382 2024-09-12T00:34:23.871 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.873+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~F9MYDE4UZ8G7.0 size=1048576 2024-09-12T00:34:23.872 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.874+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~F9MYDE4UZ8G7.1 size=1048576 2024-09-12T00:34:23.872 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.874+0000 7f1f2d864780 1 < canceled part key=_multipart_1299IOSGYIO9.2~F9MYDE4UZ8G7.2 size=557618 2024-09-12T00:34:23.874 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.875+0000 7f1f2d864780 1 < canceled multipart upload key=1299IOSGYIO9 upload=F9MYDE4UZ8G7 tag=XMJS63DILZLK type=write size=3703346 2024-09-12T00:34:23.875 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.877+0000 7f1f2d864780 1 > prepared operation key=SZP418NVZ5VX tag=B1EWE8XJ0A1W type=del size=2628544 2024-09-12T00:34:23.877 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.879+0000 7f1f2d864780 1 < suggested remove operation key=53QCNWX1V1R1 tag=ZYCA1OM2DXAL type=del 2024-09-12T00:34:23.878 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.880+0000 7f1f2d864780 1 > prepared operation key=9XK59MVZ5G1O tag=E2EVC00E9TGA type=write size=662402 2024-09-12T00:34:23.880 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.882+0000 7f1f2d864780 1 < suggested update operation key=PVB52GO6L8T4 tag=OUH6WO2CI6LW type=del size=3068089 2024-09-12T00:34:23.882 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.884+0000 7f1f2d864780 1 > prepared part key=_multipart_AN26EVAZI527.2~UQWJJNC7T641.0 size=445421 2024-09-12T00:34:23.883 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.884+0000 7f1f2d864780 1 > prepared multipart upload key=AN26EVAZI527 upload=UQWJJNC7T641 tag=OOQVL1U508QV type=write size=1493997 2024-09-12T00:34:23.883 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.885+0000 7f1f2d864780 1 < completed delete operation key=WGKEA4EKF5GP tag=T7Z6Y0W6S8G7 type=del 2024-09-12T00:34:23.885 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.887+0000 7f1f2d864780 1 > prepared part key=_multipart_N9RQIGHVL8VP.2~CRQLX9OR2G54.0 size=1048576 2024-09-12T00:34:23.886 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.888+0000 7f1f2d864780 1 > prepared part key=_multipart_N9RQIGHVL8VP.2~CRQLX9OR2G54.1 size=826352 2024-09-12T00:34:23.886 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.888+0000 7f1f2d864780 1 > prepared multipart upload key=N9RQIGHVL8VP upload=CRQLX9OR2G54 tag=H02S8B8G72E6 type=write size=2923504 2024-09-12T00:34:23.887 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.889+0000 7f1f2d864780 1 < completed delete operation key=N9RQIGHVL8VP tag=X3085IED3Y86 type=del 2024-09-12T00:34:23.888 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.890+0000 7f1f2d864780 1 > prepared operation key=FFG41OYEYFZA tag=2EWVNMBVH6OE type=del size=2888258 2024-09-12T00:34:23.890 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.891+0000 7f1f2d864780 1 < completed delete operation key=ZYNIJH0TTSM6 tag=9926Q4XJVWWY type=del 2024-09-12T00:34:23.891 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.892+0000 7f1f2d864780 1 > prepared operation key=2G3UCYG4R4NM tag=ED2NYEPSASRQ type=del size=2930330 2024-09-12T00:34:23.893 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.894+0000 7f1f2d864780 1 < suggested update operation key=3Z1TGGPZKJ69 tag=3HUWBTCB3VPM type=del size=3660387 2024-09-12T00:34:23.895 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.896+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~1CENM9PWYXQ4.0 size=1048576 2024-09-12T00:34:23.896 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.897+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~1CENM9PWYXQ4.1 size=1048576 2024-09-12T00:34:23.896 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.898+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~1CENM9PWYXQ4.2 size=27943 2024-09-12T00:34:23.896 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.898+0000 7f1f2d864780 1 > prepared multipart upload key=W6U30X4HJCB1 upload=1CENM9PWYXQ4 tag=ONADQR1E21JF type=write size=3173671 2024-09-12T00:34:23.897 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.899+0000 7f1f2d864780 1 < completed part key=_multipart_WKK747ETLW10.2~XUWSABOIL6B4.0 size=615528 2024-09-12T00:34:23.899 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.901+0000 7f1f2d864780 1 < completed multipart upload key=WKK747ETLW10 upload=XUWSABOIL6B4 tag=GDX0VA0JDLGP type=write size=1664104 2024-09-12T00:34:23.900 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.902+0000 7f1f2d864780 1 > prepared operation key=ZGO887JDR627 tag=F0VSX5LDZ1EF type=del size=3800526 2024-09-12T00:34:23.901 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.903+0000 7f1f2d864780 1 < completed delete operation key=AN26EVAZI527 tag=J1XL7TGJNAHO type=del 2024-09-12T00:34:23.903 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.904+0000 7f1f2d864780 1 > prepared operation key=D21W9QZWY0YU tag=YI8O3F1OWC9Y type=del size=3069139 2024-09-12T00:34:23.904 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.906+0000 7f1f2d864780 1 < completed delete operation key=S5DVMA14N7VJ tag=Z8WD093LRKUL type=del 2024-09-12T00:34:23.905 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.907+0000 7f1f2d864780 1 > prepared operation key=ZYNIJH0TTSM6 tag=HDT3MEVN2WUA type=del size=4073897 2024-09-12T00:34:23.907 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.908+0000 7f1f2d864780 1 < completed part key=_multipart_GSPM8N0K7ODC.2~3WY0XJJBUSHP.0 size=1048576 2024-09-12T00:34:23.907 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.908+0000 7f1f2d864780 1 < canceled part key=_multipart_GSPM8N0K7ODC.2~3WY0XJJBUSHP.1 size=83114 2024-09-12T00:34:23.908 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.910+0000 7f1f2d864780 1 < canceled multipart upload key=GSPM8N0K7ODC upload=3WY0XJJBUSHP tag=VWGRAESIWDBO type=write size=2180266 2024-09-12T00:34:23.909 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.911+0000 7f1f2d864780 1 > prepared operation key=WKK747ETLW10 tag=F8CAV8B2I3RL type=del size=1316247 2024-09-12T00:34:23.911 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.912+0000 7f1f2d864780 -1 < failed to complete operation key=3Z1TGGPZKJ69 tag=B9H5GDKX0B4E type=write size=544053: (22) Invalid argument 2024-09-12T00:34:23.912 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.914+0000 7f1f2d864780 1 > prepared operation key=W6U30X4HJCB1 tag=BLP7UNWLFGJE type=del size=573853 2024-09-12T00:34:23.913 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.915+0000 7f1f2d864780 1 < completed delete operation key=2RV0899QUJ8W tag=4V3GVDFW3R5U type=del 2024-09-12T00:34:23.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.916+0000 7f1f2d864780 1 > prepared operation key=1299IOSGYIO9 tag=OEBIJS7H6542 type=del size=998436 2024-09-12T00:34:23.916 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.917+0000 7f1f2d864780 1 < canceled operation key=ECZYQEZ942W8 tag=1VX3RZVEYRG7 type=del size=70289 2024-09-12T00:34:23.918 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.920+0000 7f1f2d864780 1 > prepared part key=_multipart_WIIU8VTCLWOD.2~C04YNU71SU73.0 size=1048576 2024-09-12T00:34:23.919 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.920+0000 7f1f2d864780 1 > prepared part key=_multipart_WIIU8VTCLWOD.2~C04YNU71SU73.1 size=1048576 2024-09-12T00:34:23.920 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.921+0000 7f1f2d864780 1 > prepared part key=_multipart_WIIU8VTCLWOD.2~C04YNU71SU73.2 size=552657 2024-09-12T00:34:23.920 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.921+0000 7f1f2d864780 1 > prepared multipart upload key=WIIU8VTCLWOD upload=C04YNU71SU73 tag=T0LS02TFGKUF type=write size=3698385 2024-09-12T00:34:23.921 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.923+0000 7f1f2d864780 1 < completed part key=_multipart_N9RQIGHVL8VP.2~80PIRKHB9Z2M.0 size=895729 2024-09-12T00:34:23.923 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.925+0000 7f1f2d864780 1 < completed multipart upload key=N9RQIGHVL8VP upload=80PIRKHB9Z2M tag=GZJZJA8LYSXF type=write size=1944305 2024-09-12T00:34:23.925 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.927+0000 7f1f2d864780 1 > prepared part key=_multipart_UTR2UUO6DHLJ.2~MOTT7JGQ8JW0.0 size=1048576 2024-09-12T00:34:23.926 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.928+0000 7f1f2d864780 1 > prepared part key=_multipart_UTR2UUO6DHLJ.2~MOTT7JGQ8JW0.1 size=493189 2024-09-12T00:34:23.926 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.928+0000 7f1f2d864780 1 > prepared multipart upload key=UTR2UUO6DHLJ upload=MOTT7JGQ8JW0 tag=1UXKND2H6QH1 type=write size=2590341 2024-09-12T00:34:23.927 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.929+0000 7f1f2d864780 1 < completed delete operation key=D21W9QZWY0YU tag=VIT1B9E4RE4M type=del 2024-09-12T00:34:23.929 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.931+0000 7f1f2d864780 1 > prepared part key=_multipart_UTR2UUO6DHLJ.2~JXE0J8N3ZG04.0 size=1048576 2024-09-12T00:34:23.930 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.932+0000 7f1f2d864780 1 > prepared part key=_multipart_UTR2UUO6DHLJ.2~JXE0J8N3ZG04.1 size=165400 2024-09-12T00:34:23.930 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.932+0000 7f1f2d864780 1 > prepared multipart upload key=UTR2UUO6DHLJ upload=JXE0J8N3ZG04 tag=UXITJZ5JWGRJ type=write size=2262552 2024-09-12T00:34:23.932 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.933+0000 7f1f2d864780 1 < completed delete operation key=SZP418NVZ5VX tag=B1EWE8XJ0A1W type=del 2024-09-12T00:34:23.934 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.935+0000 7f1f2d864780 1 > prepared part key=_multipart_MSGU3PHLBRJH.2~CV42MMNRCB5F.0 size=1048576 2024-09-12T00:34:23.935 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.936+0000 7f1f2d864780 1 > prepared part key=_multipart_MSGU3PHLBRJH.2~CV42MMNRCB5F.1 size=1048576 2024-09-12T00:34:23.936 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.937+0000 7f1f2d864780 1 > prepared part key=_multipart_MSGU3PHLBRJH.2~CV42MMNRCB5F.2 size=474189 2024-09-12T00:34:23.936 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.937+0000 7f1f2d864780 1 > prepared multipart upload key=MSGU3PHLBRJH upload=CV42MMNRCB5F tag=E9GVJB0J9YSH type=write size=3619917 2024-09-12T00:34:23.937 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.938+0000 7f1f2d864780 1 < canceled operation key=9XK59MVZ5G1O tag=E2EVC00E9TGA type=write size=662402 2024-09-12T00:34:23.939 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.941+0000 7f1f2d864780 1 > prepared part key=_multipart_WKK747ETLW10.2~B0TJ4ASDOBSG.0 size=1048576 2024-09-12T00:34:23.940 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.942+0000 7f1f2d864780 1 > prepared part key=_multipart_WKK747ETLW10.2~B0TJ4ASDOBSG.1 size=895111 2024-09-12T00:34:23.940 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.942+0000 7f1f2d864780 1 > prepared multipart upload key=WKK747ETLW10 upload=B0TJ4ASDOBSG tag=NUAKIA5KWRVX type=write size=2992263 2024-09-12T00:34:23.941 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.943+0000 7f1f2d864780 1 < completed part key=_multipart_AN26EVAZI527.2~UQWJJNC7T641.0 size=445421 2024-09-12T00:34:23.943 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.945+0000 7f1f2d864780 1 < completed multipart upload key=AN26EVAZI527 upload=UQWJJNC7T641 tag=OOQVL1U508QV type=write size=1493997 2024-09-12T00:34:23.944 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.946+0000 7f1f2d864780 1 > prepared operation key=9XK59MVZ5G1O tag=FOPYB6TYFMUX type=del size=2091631 2024-09-12T00:34:23.944 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.946+0000 7f1f2d864780 1 < canceled part key=_multipart_N9RQIGHVL8VP.2~CRQLX9OR2G54.0 size=1048576 2024-09-12T00:34:23.945 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.947+0000 7f1f2d864780 1 < completed part key=_multipart_N9RQIGHVL8VP.2~CRQLX9OR2G54.1 size=826352 2024-09-12T00:34:23.947 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.949+0000 7f1f2d864780 1 < canceled multipart upload key=N9RQIGHVL8VP upload=CRQLX9OR2G54 tag=H02S8B8G72E6 type=write size=2923504 2024-09-12T00:34:23.948 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.950+0000 7f1f2d864780 1 > prepared operation key=AN26EVAZI527 tag=Y57HXNIMEU3P type=del size=172886 2024-09-12T00:34:23.950 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.951+0000 7f1f2d864780 1 < completed delete operation key=FFG41OYEYFZA tag=2EWVNMBVH6OE type=del 2024-09-12T00:34:23.951 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.953+0000 7f1f2d864780 1 > prepared operation key=FAP6N3H7SBN0 tag=KPPHE9EXKAM3 type=write size=474844 2024-09-12T00:34:23.952 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.954+0000 7f1f2d864780 1 < canceled operation key=2G3UCYG4R4NM tag=ED2NYEPSASRQ type=del size=2930330 2024-09-12T00:34:23.953 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.955+0000 7f1f2d864780 1 > prepared operation key=S5DVMA14N7VJ tag=JBW5VFKSFDLZ type=del size=3020547 2024-09-12T00:34:23.954 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.956+0000 7f1f2d864780 1 < completed part key=_multipart_W6U30X4HJCB1.2~1CENM9PWYXQ4.0 size=1048576 2024-09-12T00:34:23.955 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.957+0000 7f1f2d864780 1 < completed part key=_multipart_W6U30X4HJCB1.2~1CENM9PWYXQ4.1 size=1048576 2024-09-12T00:34:23.956 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.958+0000 7f1f2d864780 1 < completed part key=_multipart_W6U30X4HJCB1.2~1CENM9PWYXQ4.2 size=27943 2024-09-12T00:34:23.959 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.961+0000 7f1f2d864780 1 < completed multipart upload key=W6U30X4HJCB1 upload=1CENM9PWYXQ4 tag=ONADQR1E21JF type=write size=3173671 2024-09-12T00:34:23.960 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.962+0000 7f1f2d864780 1 > prepared operation key=W6U30X4HJCB1 tag=9TFVT1XVBUYL type=del size=1496514 2024-09-12T00:34:23.962 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.963+0000 7f1f2d864780 1 < completed delete operation key=ZGO887JDR627 tag=F0VSX5LDZ1EF type=del 2024-09-12T00:34:23.963 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.964+0000 7f1f2d864780 1 > prepared operation key=ZGO887JDR627 tag=4NIG0852589X type=del size=821244 2024-09-12T00:34:23.964 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.966+0000 7f1f2d864780 1 < completed delete operation key=D21W9QZWY0YU tag=YI8O3F1OWC9Y type=del 2024-09-12T00:34:23.965 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.967+0000 7f1f2d864780 1 > prepared operation key=OY145ZXRSF4L tag=8HQQCD7UM3HV type=del size=1584529 2024-09-12T00:34:23.966 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.968+0000 7f1f2d864780 1 < completed delete operation key=ZYNIJH0TTSM6 tag=HDT3MEVN2WUA type=del 2024-09-12T00:34:23.967 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.969+0000 7f1f2d864780 1 > prepared operation key=D21W9QZWY0YU tag=TONBDAHSZH5D type=write size=574545 2024-09-12T00:34:23.969 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.970+0000 7f1f2d864780 1 < completed delete operation key=WKK747ETLW10 tag=F8CAV8B2I3RL type=del 2024-09-12T00:34:23.971 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.972+0000 7f1f2d864780 1 > prepared part key=_multipart_AN26EVAZI527.2~RJ0QGGVEZLJR.0 size=1048576 2024-09-12T00:34:23.972 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.973+0000 7f1f2d864780 1 > prepared part key=_multipart_AN26EVAZI527.2~RJ0QGGVEZLJR.1 size=772313 2024-09-12T00:34:23.972 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.973+0000 7f1f2d864780 1 > prepared multipart upload key=AN26EVAZI527 upload=RJ0QGGVEZLJR tag=3TECZBDPUG0U type=write size=2869465 2024-09-12T00:34:23.973 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.975+0000 7f1f2d864780 1 < completed delete operation key=W6U30X4HJCB1 tag=BLP7UNWLFGJE type=del 2024-09-12T00:34:23.974 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.976+0000 7f1f2d864780 1 > prepared operation key=FFG41OYEYFZA tag=QFDUKAYMQLNP type=write size=974365 2024-09-12T00:34:23.975 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.977+0000 7f1f2d864780 1 < completed delete operation key=1299IOSGYIO9 tag=OEBIJS7H6542 type=del 2024-09-12T00:34:23.977 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.979+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~83NDTPE64SFG.0 size=1048576 2024-09-12T00:34:23.978 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.980+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~83NDTPE64SFG.1 size=690285 2024-09-12T00:34:23.978 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.980+0000 7f1f2d864780 1 > prepared multipart upload key=1299IOSGYIO9 upload=83NDTPE64SFG tag=B0RMT3NUXJ7P type=write size=2787437 2024-09-12T00:34:23.979 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.981+0000 7f1f2d864780 1 < completed part key=_multipart_WIIU8VTCLWOD.2~C04YNU71SU73.0 size=1048576 2024-09-12T00:34:23.980 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.982+0000 7f1f2d864780 1 < completed part key=_multipart_WIIU8VTCLWOD.2~C04YNU71SU73.1 size=1048576 2024-09-12T00:34:23.981 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.983+0000 7f1f2d864780 1 < completed part key=_multipart_WIIU8VTCLWOD.2~C04YNU71SU73.2 size=552657 2024-09-12T00:34:23.983 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.985+0000 7f1f2d864780 1 < completed multipart upload key=WIIU8VTCLWOD upload=C04YNU71SU73 tag=T0LS02TFGKUF type=write size=3698385 2024-09-12T00:34:23.984 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.986+0000 7f1f2d864780 1 > prepared operation key=2YCGIJRK6MUH tag=8ASHPEVI5LYU type=del size=2242104 2024-09-12T00:34:23.985 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.987+0000 7f1f2d864780 1 < completed part key=_multipart_UTR2UUO6DHLJ.2~MOTT7JGQ8JW0.0 size=1048576 2024-09-12T00:34:23.986 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.988+0000 7f1f2d864780 1 < completed part key=_multipart_UTR2UUO6DHLJ.2~MOTT7JGQ8JW0.1 size=493189 2024-09-12T00:34:23.988 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.990+0000 7f1f2d864780 1 < completed multipart upload key=UTR2UUO6DHLJ upload=MOTT7JGQ8JW0 tag=1UXKND2H6QH1 type=write size=2590341 2024-09-12T00:34:23.990 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.992+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~3Z69RFW2IQRG.0 size=1048576 2024-09-12T00:34:23.991 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.993+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~3Z69RFW2IQRG.1 size=300902 2024-09-12T00:34:23.991 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.993+0000 7f1f2d864780 1 > prepared multipart upload key=SZP418NVZ5VX upload=3Z69RFW2IQRG tag=87A5UR5TTXO6 type=write size=2398054 2024-09-12T00:34:23.992 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.994+0000 7f1f2d864780 1 < completed part key=_multipart_UTR2UUO6DHLJ.2~JXE0J8N3ZG04.0 size=1048576 2024-09-12T00:34:23.993 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.995+0000 7f1f2d864780 1 < completed part key=_multipart_UTR2UUO6DHLJ.2~JXE0J8N3ZG04.1 size=165400 2024-09-12T00:34:23.995 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.997+0000 7f1f2d864780 1 < completed multipart upload key=UTR2UUO6DHLJ upload=JXE0J8N3ZG04 tag=UXITJZ5JWGRJ type=write size=2262552 2024-09-12T00:34:23.996 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.998+0000 7f1f2d864780 1 > prepared operation key=53QCNWX1V1R1 tag=7M59L4Z5PQFU type=del size=3857500 2024-09-12T00:34:23.998 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.999+0000 7f1f2d864780 1 < completed part key=_multipart_MSGU3PHLBRJH.2~CV42MMNRCB5F.0 size=1048576 2024-09-12T00:34:23.998 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.999+0000 7f1f2d864780 1 < canceled part key=_multipart_MSGU3PHLBRJH.2~CV42MMNRCB5F.1 size=1048576 2024-09-12T00:34:23.998 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:23.999+0000 7f1f2d864780 1 < canceled part key=_multipart_MSGU3PHLBRJH.2~CV42MMNRCB5F.2 size=474189 2024-09-12T00:34:24.000 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.001+0000 7f1f2d864780 1 < canceled multipart upload key=MSGU3PHLBRJH upload=CV42MMNRCB5F tag=E9GVJB0J9YSH type=write size=3619917 2024-09-12T00:34:24.002 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.004+0000 7f1f2d864780 1 > prepared part key=_multipart_WIIU8VTCLWOD.2~N1UYLKTLLY54.0 size=1048576 2024-09-12T00:34:24.003 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.004+0000 7f1f2d864780 1 > prepared part key=_multipart_WIIU8VTCLWOD.2~N1UYLKTLLY54.1 size=701151 2024-09-12T00:34:24.003 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.004+0000 7f1f2d864780 1 > prepared multipart upload key=WIIU8VTCLWOD upload=N1UYLKTLLY54 tag=YKC22SBMVUFE type=write size=2798303 2024-09-12T00:34:24.004 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.006+0000 7f1f2d864780 1 < completed part key=_multipart_WKK747ETLW10.2~B0TJ4ASDOBSG.0 size=1048576 2024-09-12T00:34:24.005 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.007+0000 7f1f2d864780 1 < completed part key=_multipart_WKK747ETLW10.2~B0TJ4ASDOBSG.1 size=895111 2024-09-12T00:34:24.007 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.008+0000 7f1f2d864780 1 < completed multipart upload key=WKK747ETLW10 upload=B0TJ4ASDOBSG tag=NUAKIA5KWRVX type=write size=2992263 2024-09-12T00:34:24.008 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.010+0000 7f1f2d864780 1 > prepared operation key=ZYNIJH0TTSM6 tag=BCK6SUGUGDUW type=write size=738434 2024-09-12T00:34:24.010 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.012+0000 7f1f2d864780 1 < suggested update operation key=9XK59MVZ5G1O tag=FOPYB6TYFMUX type=del size=2091631 2024-09-12T00:34:24.011 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.013+0000 7f1f2d864780 1 > prepared operation key=2G3UCYG4R4NM tag=T0323BE0G6OF type=del size=142157 2024-09-12T00:34:24.012 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.014+0000 7f1f2d864780 1 < completed delete operation key=AN26EVAZI527 tag=Y57HXNIMEU3P type=del 2024-09-12T00:34:24.015 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.016+0000 7f1f2d864780 1 > prepared part key=_multipart_PVB52GO6L8T4.2~SKZVE8NXA94F.0 size=324078 2024-09-12T00:34:24.015 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.016+0000 7f1f2d864780 1 > prepared multipart upload key=PVB52GO6L8T4 upload=SKZVE8NXA94F tag=SIA6XQKJREXB type=write size=1372654 2024-09-12T00:34:24.016 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.017+0000 7f1f2d864780 1 < completed write operation key=FAP6N3H7SBN0 tag=KPPHE9EXKAM3 type=write size=474844 2024-09-12T00:34:24.017 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.019+0000 7f1f2d864780 1 > prepared operation key=UTR2UUO6DHLJ tag=MK609WHHFIOJ type=del size=3597799 2024-09-12T00:34:24.018 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.020+0000 7f1f2d864780 1 < completed delete operation key=S5DVMA14N7VJ tag=JBW5VFKSFDLZ type=del 2024-09-12T00:34:24.019 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.021+0000 7f1f2d864780 1 > prepared operation key=53QCNWX1V1R1 tag=NAVZJSDAV6F1 type=del size=2887928 2024-09-12T00:34:24.020 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.022+0000 7f1f2d864780 1 < completed delete operation key=W6U30X4HJCB1 tag=9TFVT1XVBUYL type=del 2024-09-12T00:34:24.021 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.023+0000 7f1f2d864780 1 > prepared operation key=0DSQOFS8IIF5 tag=EL5AO4FPTXWS type=del size=2304422 2024-09-12T00:34:24.023 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.024+0000 7f1f2d864780 1 < canceled operation key=ZGO887JDR627 tag=4NIG0852589X type=del size=821244 2024-09-12T00:34:24.024 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.025+0000 7f1f2d864780 1 > prepared operation key=MSGU3PHLBRJH tag=E3PFJJCYC9O6 type=del size=2841899 2024-09-12T00:34:24.025 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.027+0000 7f1f2d864780 1 < completed delete operation key=OY145ZXRSF4L tag=8HQQCD7UM3HV type=del 2024-09-12T00:34:24.026 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.028+0000 7f1f2d864780 1 > prepared operation key=4FRVL0KXN2X8 tag=BAM56ZYJSE9M type=del size=502214 2024-09-12T00:34:24.027 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.029+0000 7f1f2d864780 1 < completed write operation key=D21W9QZWY0YU tag=TONBDAHSZH5D type=write size=574545 2024-09-12T00:34:24.029 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.031+0000 7f1f2d864780 1 > prepared part key=_multipart_OY145ZXRSF4L.2~WZ5DVFF5VA25.0 size=1048576 2024-09-12T00:34:24.030 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.032+0000 7f1f2d864780 1 > prepared part key=_multipart_OY145ZXRSF4L.2~WZ5DVFF5VA25.1 size=109681 2024-09-12T00:34:24.030 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.032+0000 7f1f2d864780 1 > prepared multipart upload key=OY145ZXRSF4L upload=WZ5DVFF5VA25 tag=4PGV2EXCQ9S3 type=write size=2206833 2024-09-12T00:34:24.031 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.033+0000 7f1f2d864780 1 < completed part key=_multipart_AN26EVAZI527.2~RJ0QGGVEZLJR.0 size=1048576 2024-09-12T00:34:24.032 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.034+0000 7f1f2d864780 1 < completed part key=_multipart_AN26EVAZI527.2~RJ0QGGVEZLJR.1 size=772313 2024-09-12T00:34:24.035 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.036+0000 7f1f2d864780 1 < completed multipart upload key=AN26EVAZI527 upload=RJ0QGGVEZLJR tag=3TECZBDPUG0U type=write size=2869465 2024-09-12T00:34:24.036 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.038+0000 7f1f2d864780 1 > prepared operation key=WIIU8VTCLWOD tag=BQ1OOP6ZZCJY type=write size=128017 2024-09-12T00:34:24.037 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.039+0000 7f1f2d864780 1 < completed write operation key=FFG41OYEYFZA tag=QFDUKAYMQLNP type=write size=974365 2024-09-12T00:34:24.038 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.040+0000 7f1f2d864780 1 > prepared operation key=3Z1TGGPZKJ69 tag=NXP4UI9UHJNO type=write size=481080 2024-09-12T00:34:24.040 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.041+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~83NDTPE64SFG.0 size=1048576 2024-09-12T00:34:24.041 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.042+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~83NDTPE64SFG.1 size=690285 2024-09-12T00:34:24.043 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.044+0000 7f1f2d864780 1 < completed multipart upload key=1299IOSGYIO9 upload=83NDTPE64SFG tag=B0RMT3NUXJ7P type=write size=2787437 2024-09-12T00:34:24.045 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.046+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~JS8R1D2QN0N0.0 size=1048576 2024-09-12T00:34:24.046 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.047+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~JS8R1D2QN0N0.1 size=892108 2024-09-12T00:34:24.046 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.047+0000 7f1f2d864780 1 > prepared multipart upload key=SZP418NVZ5VX upload=JS8R1D2QN0N0 tag=WQOL2EFG1NZP type=write size=2989260 2024-09-12T00:34:24.047 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.048+0000 7f1f2d864780 1 < completed delete operation key=2YCGIJRK6MUH tag=8ASHPEVI5LYU type=del 2024-09-12T00:34:24.048 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.050+0000 7f1f2d864780 1 > prepared operation key=SNCGB6Z20450 tag=2QXTO7XPW9MJ type=del size=2071502 2024-09-12T00:34:24.049 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.051+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~3Z69RFW2IQRG.0 size=1048576 2024-09-12T00:34:24.050 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.052+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~3Z69RFW2IQRG.1 size=300902 2024-09-12T00:34:24.052 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.054+0000 7f1f2d864780 1 < completed multipart upload key=SZP418NVZ5VX upload=3Z69RFW2IQRG tag=87A5UR5TTXO6 type=write size=2398054 2024-09-12T00:34:24.053 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.055+0000 7f1f2d864780 1 > prepared operation key=GSPM8N0K7ODC tag=KYVBHDMKH88S type=del size=2644335 2024-09-12T00:34:24.054 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.056+0000 7f1f2d864780 1 < completed delete operation key=53QCNWX1V1R1 tag=7M59L4Z5PQFU type=del 2024-09-12T00:34:24.056 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.058+0000 7f1f2d864780 1 > prepared operation key=S5DVMA14N7VJ tag=124HIY1S2OUC type=del size=3115372 2024-09-12T00:34:24.057 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.059+0000 7f1f2d864780 1 < completed part key=_multipart_WIIU8VTCLWOD.2~N1UYLKTLLY54.0 size=1048576 2024-09-12T00:34:24.058 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.060+0000 7f1f2d864780 1 < completed part key=_multipart_WIIU8VTCLWOD.2~N1UYLKTLLY54.1 size=701151 2024-09-12T00:34:24.060 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.062+0000 7f1f2d864780 1 < completed multipart upload key=WIIU8VTCLWOD upload=N1UYLKTLLY54 tag=YKC22SBMVUFE type=write size=2798303 2024-09-12T00:34:24.061 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.063+0000 7f1f2d864780 1 > prepared operation key=9XK59MVZ5G1O tag=HYZWLF6OWESG type=write size=147881 2024-09-12T00:34:24.063 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.064+0000 7f1f2d864780 1 < completed write operation key=ZYNIJH0TTSM6 tag=BCK6SUGUGDUW type=write size=738434 2024-09-12T00:34:24.064 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.065+0000 7f1f2d864780 1 > prepared operation key=53QCNWX1V1R1 tag=VGR38YD1XO1H type=del size=3855182 2024-09-12T00:34:24.065 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.067+0000 7f1f2d864780 1 < completed delete operation key=2G3UCYG4R4NM tag=T0323BE0G6OF type=del 2024-09-12T00:34:24.066 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.068+0000 7f1f2d864780 1 > prepared operation key=DYKLAY6J018G tag=V5CS2720WY0Y type=del size=2880548 2024-09-12T00:34:24.067 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.069+0000 7f1f2d864780 1 < completed part key=_multipart_PVB52GO6L8T4.2~SKZVE8NXA94F.0 size=324078 2024-09-12T00:34:24.071 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.072+0000 7f1f2d864780 1 < completed multipart upload key=PVB52GO6L8T4 upload=SKZVE8NXA94F tag=SIA6XQKJREXB type=write size=1372654 2024-09-12T00:34:24.073 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.074+0000 7f1f2d864780 1 > prepared part key=_multipart_ECZYQEZ942W8.2~TL8MXSTPIP74.0 size=1048576 2024-09-12T00:34:24.074 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.075+0000 7f1f2d864780 1 > prepared part key=_multipart_ECZYQEZ942W8.2~TL8MXSTPIP74.1 size=1048576 2024-09-12T00:34:24.075 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.076+0000 7f1f2d864780 1 > prepared part key=_multipart_ECZYQEZ942W8.2~TL8MXSTPIP74.2 size=476458 2024-09-12T00:34:24.075 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.076+0000 7f1f2d864780 1 > prepared multipart upload key=ECZYQEZ942W8 upload=TL8MXSTPIP74 tag=R54RYTDPF3U8 type=write size=3622186 2024-09-12T00:34:24.077 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.079+0000 7f1f2d864780 1 < suggested update operation key=UTR2UUO6DHLJ tag=MK609WHHFIOJ type=del size=3597799 2024-09-12T00:34:24.079 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.081+0000 7f1f2d864780 1 > prepared part key=_multipart_3Z1TGGPZKJ69.2~NUNTA63GHXVM.0 size=1048576 2024-09-12T00:34:24.080 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.082+0000 7f1f2d864780 1 > prepared part key=_multipart_3Z1TGGPZKJ69.2~NUNTA63GHXVM.1 size=1048576 2024-09-12T00:34:24.081 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.083+0000 7f1f2d864780 1 > prepared part key=_multipart_3Z1TGGPZKJ69.2~NUNTA63GHXVM.2 size=162267 2024-09-12T00:34:24.082 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.083+0000 7f1f2d864780 1 > prepared multipart upload key=3Z1TGGPZKJ69 upload=NUNTA63GHXVM tag=TT07F19N6HXJ type=write size=3307995 2024-09-12T00:34:24.083 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.084+0000 7f1f2d864780 1 < completed delete operation key=53QCNWX1V1R1 tag=NAVZJSDAV6F1 type=del 2024-09-12T00:34:24.085 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.087+0000 7f1f2d864780 1 > prepared part key=_multipart_WKK747ETLW10.2~YWTGTW94N3Q3.0 size=992649 2024-09-12T00:34:24.085 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.087+0000 7f1f2d864780 1 > prepared multipart upload key=WKK747ETLW10 upload=YWTGTW94N3Q3 tag=I5OPA0BQZWV8 type=write size=2041225 2024-09-12T00:34:24.086 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.088+0000 7f1f2d864780 1 < completed delete operation key=0DSQOFS8IIF5 tag=EL5AO4FPTXWS type=del 2024-09-12T00:34:24.088 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.089+0000 7f1f2d864780 1 > prepared operation key=1299IOSGYIO9 tag=D5TK52DM56ZB type=del size=2655066 2024-09-12T00:34:24.089 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.090+0000 7f1f2d864780 1 < completed delete operation key=MSGU3PHLBRJH tag=E3PFJJCYC9O6 type=del 2024-09-12T00:34:24.090 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.092+0000 7f1f2d864780 1 > prepared operation key=2G3UCYG4R4NM tag=4ORGPDJAREX9 type=del size=1247044 2024-09-12T00:34:24.092 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.094+0000 7f1f2d864780 1 < suggested remove operation key=4FRVL0KXN2X8 tag=BAM56ZYJSE9M type=del 2024-09-12T00:34:24.093 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.095+0000 7f1f2d864780 1 > prepared operation key=WIIU8VTCLWOD tag=0QAGWRA0JSX9 type=write size=241332 2024-09-12T00:34:24.094 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.096+0000 7f1f2d864780 1 < completed part key=_multipart_OY145ZXRSF4L.2~WZ5DVFF5VA25.0 size=1048576 2024-09-12T00:34:24.095 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.097+0000 7f1f2d864780 1 < completed part key=_multipart_OY145ZXRSF4L.2~WZ5DVFF5VA25.1 size=109681 2024-09-12T00:34:24.097 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.099+0000 7f1f2d864780 1 < completed multipart upload key=OY145ZXRSF4L upload=WZ5DVFF5VA25 tag=4PGV2EXCQ9S3 type=write size=2206833 2024-09-12T00:34:24.098 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.100+0000 7f1f2d864780 1 > prepared operation key=4FRVL0KXN2X8 tag=7SBYB4LRSKGR type=del size=4061817 2024-09-12T00:34:24.099 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.101+0000 7f1f2d864780 1 < completed write operation key=WIIU8VTCLWOD tag=BQ1OOP6ZZCJY type=write size=128017 2024-09-12T00:34:24.101 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.102+0000 7f1f2d864780 1 > prepared operation key=0DSQOFS8IIF5 tag=7F6KEJVKQ3EV type=write size=587980 2024-09-12T00:34:24.102 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.103+0000 7f1f2d864780 1 < completed write operation key=3Z1TGGPZKJ69 tag=NXP4UI9UHJNO type=write size=481080 2024-09-12T00:34:24.103 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.104+0000 7f1f2d864780 1 > prepared operation key=GSPM8N0K7ODC tag=JS9VOFF9K6T1 type=del size=1472243 2024-09-12T00:34:24.104 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.106+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~JS8R1D2QN0N0.0 size=1048576 2024-09-12T00:34:24.105 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.107+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~JS8R1D2QN0N0.1 size=892108 2024-09-12T00:34:24.107 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.108+0000 7f1f2d864780 1 < completed multipart upload key=SZP418NVZ5VX upload=JS8R1D2QN0N0 tag=WQOL2EFG1NZP type=write size=2989260 2024-09-12T00:34:24.109 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.110+0000 7f1f2d864780 1 > prepared part key=_multipart_MSGU3PHLBRJH.2~25ZEIWBBT650.0 size=544069 2024-09-12T00:34:24.109 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.110+0000 7f1f2d864780 1 > prepared multipart upload key=MSGU3PHLBRJH upload=25ZEIWBBT650 tag=L7Q3VM29C8OK type=write size=1592645 2024-09-12T00:34:24.110 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.112+0000 7f1f2d864780 1 < completed delete operation key=SNCGB6Z20450 tag=2QXTO7XPW9MJ type=del 2024-09-12T00:34:24.111 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.113+0000 7f1f2d864780 1 > prepared operation key=GSPM8N0K7ODC tag=IFJVIO0EJ50T type=del size=1078410 2024-09-12T00:34:24.113 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.114+0000 7f1f2d864780 1 < completed delete operation key=GSPM8N0K7ODC tag=KYVBHDMKH88S type=del 2024-09-12T00:34:24.114 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.115+0000 7f1f2d864780 1 > prepared operation key=N9RQIGHVL8VP tag=IO3IORLVWXVV type=del size=2277384 2024-09-12T00:34:24.115 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.116+0000 7f1f2d864780 1 < completed delete operation key=S5DVMA14N7VJ tag=124HIY1S2OUC type=del 2024-09-12T00:34:24.116 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.118+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=HDR1YUQ16X9P type=del size=1364966 2024-09-12T00:34:24.117 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.119+0000 7f1f2d864780 1 < completed write operation key=9XK59MVZ5G1O tag=HYZWLF6OWESG type=write size=147881 2024-09-12T00:34:24.119 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.121+0000 7f1f2d864780 1 > prepared part key=_multipart_9XK59MVZ5G1O.2~IHJQ2OSI3UMB.0 size=1048576 2024-09-12T00:34:24.121 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.122+0000 7f1f2d864780 1 > prepared part key=_multipart_9XK59MVZ5G1O.2~IHJQ2OSI3UMB.1 size=18617 2024-09-12T00:34:24.121 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.122+0000 7f1f2d864780 1 > prepared multipart upload key=9XK59MVZ5G1O upload=IHJQ2OSI3UMB tag=VRFKJF6CQYY3 type=write size=2115769 2024-09-12T00:34:24.122 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.123+0000 7f1f2d864780 1 < completed delete operation key=53QCNWX1V1R1 tag=VGR38YD1XO1H type=del 2024-09-12T00:34:24.123 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.124+0000 7f1f2d864780 1 > prepared operation key=WKK747ETLW10 tag=NON3NWZ4L8V0 type=write size=374566 2024-09-12T00:34:24.124 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.125+0000 7f1f2d864780 1 < completed delete operation key=DYKLAY6J018G tag=V5CS2720WY0Y type=del 2024-09-12T00:34:24.126 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.128+0000 7f1f2d864780 1 > prepared part key=_multipart_53QCNWX1V1R1.2~T8GTRPT951M2.0 size=1048576 2024-09-12T00:34:24.127 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.129+0000 7f1f2d864780 1 > prepared part key=_multipart_53QCNWX1V1R1.2~T8GTRPT951M2.1 size=579227 2024-09-12T00:34:24.127 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.129+0000 7f1f2d864780 1 > prepared multipart upload key=53QCNWX1V1R1 upload=T8GTRPT951M2 tag=OUXF2ZAR1AK1 type=write size=2676379 2024-09-12T00:34:24.128 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.130+0000 7f1f2d864780 1 < completed part key=_multipart_ECZYQEZ942W8.2~TL8MXSTPIP74.0 size=1048576 2024-09-12T00:34:24.129 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.131+0000 7f1f2d864780 1 < completed part key=_multipart_ECZYQEZ942W8.2~TL8MXSTPIP74.1 size=1048576 2024-09-12T00:34:24.130 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.132+0000 7f1f2d864780 1 < completed part key=_multipart_ECZYQEZ942W8.2~TL8MXSTPIP74.2 size=476458 2024-09-12T00:34:24.132 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.134+0000 7f1f2d864780 1 < completed multipart upload key=ECZYQEZ942W8 upload=TL8MXSTPIP74 tag=R54RYTDPF3U8 type=write size=3622186 2024-09-12T00:34:24.134 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.136+0000 7f1f2d864780 1 > prepared part key=_multipart_OY145ZXRSF4L.2~QKIQ7ID36AMX.0 size=265642 2024-09-12T00:34:24.134 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.136+0000 7f1f2d864780 1 > prepared multipart upload key=OY145ZXRSF4L upload=QKIQ7ID36AMX tag=FZS85MP2IC2A type=write size=1314218 2024-09-12T00:34:24.135 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.137+0000 7f1f2d864780 1 < completed part key=_multipart_3Z1TGGPZKJ69.2~NUNTA63GHXVM.0 size=1048576 2024-09-12T00:34:24.135 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.137+0000 7f1f2d864780 1 < canceled part key=_multipart_3Z1TGGPZKJ69.2~NUNTA63GHXVM.1 size=1048576 2024-09-12T00:34:24.136 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.138+0000 7f1f2d864780 1 < completed part key=_multipart_3Z1TGGPZKJ69.2~NUNTA63GHXVM.2 size=162267 2024-09-12T00:34:24.138 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.140+0000 7f1f2d864780 1 < canceled multipart upload key=3Z1TGGPZKJ69 upload=NUNTA63GHXVM tag=TT07F19N6HXJ type=write size=3307995 2024-09-12T00:34:24.139 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.141+0000 7f1f2d864780 1 > prepared operation key=PVB52GO6L8T4 tag=4PS7GVXX4ZFZ type=del size=3977015 2024-09-12T00:34:24.140 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.142+0000 7f1f2d864780 1 < completed part key=_multipart_WKK747ETLW10.2~YWTGTW94N3Q3.0 size=992649 2024-09-12T00:34:24.142 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.144+0000 7f1f2d864780 1 < completed multipart upload key=WKK747ETLW10 upload=YWTGTW94N3Q3 tag=I5OPA0BQZWV8 type=write size=2041225 2024-09-12T00:34:24.143 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.145+0000 7f1f2d864780 1 > prepared operation key=53QCNWX1V1R1 tag=WPNMM4ZEDMVX type=del size=3916674 2024-09-12T00:34:24.144 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.146+0000 7f1f2d864780 1 < completed delete operation key=1299IOSGYIO9 tag=D5TK52DM56ZB type=del 2024-09-12T00:34:24.145 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.147+0000 7f1f2d864780 1 > prepared operation key=ZGO887JDR627 tag=XKMWD1QXELJ7 type=del size=367519 2024-09-12T00:34:24.146 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.148+0000 7f1f2d864780 1 < completed delete operation key=2G3UCYG4R4NM tag=4ORGPDJAREX9 type=del 2024-09-12T00:34:24.148 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.149+0000 7f1f2d864780 1 > prepared operation key=OY145ZXRSF4L tag=HL65JD9S29EV type=del size=2873944 2024-09-12T00:34:24.149 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.150+0000 7f1f2d864780 1 < completed write operation key=WIIU8VTCLWOD tag=0QAGWRA0JSX9 type=write size=241332 2024-09-12T00:34:24.151 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.152+0000 7f1f2d864780 1 > prepared part key=_multipart_PVB52GO6L8T4.2~69IFZA6O9CUJ.0 size=1048576 2024-09-12T00:34:24.151 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.153+0000 7f1f2d864780 1 > prepared part key=_multipart_PVB52GO6L8T4.2~69IFZA6O9CUJ.1 size=618496 2024-09-12T00:34:24.152 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.153+0000 7f1f2d864780 1 > prepared multipart upload key=PVB52GO6L8T4 upload=69IFZA6O9CUJ tag=IFIIC0WM5ZB5 type=write size=2715648 2024-09-12T00:34:24.153 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.154+0000 7f1f2d864780 1 < completed delete operation key=4FRVL0KXN2X8 tag=7SBYB4LRSKGR type=del 2024-09-12T00:34:24.156 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.155+0000 7f1f2d864780 1 > prepared operation key=MSGU3PHLBRJH tag=0ZEUGGF3Y5J0 type=del size=3927221 2024-09-12T00:34:24.156 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.157+0000 7f1f2d864780 1 < canceled operation key=0DSQOFS8IIF5 tag=7F6KEJVKQ3EV type=write size=587980 2024-09-12T00:34:24.156 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.158+0000 7f1f2d864780 1 > prepared operation key=DYKLAY6J018G tag=LZX7BQJ16JZP type=write size=1024971 2024-09-12T00:34:24.159 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.160+0000 7f1f2d864780 1 < suggested update operation key=GSPM8N0K7ODC tag=JS9VOFF9K6T1 type=del size=1472243 2024-09-12T00:34:24.161 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.162+0000 7f1f2d864780 1 > prepared part key=_multipart_2G3UCYG4R4NM.2~PFCHIFMJ91ZU.0 size=1048576 2024-09-12T00:34:24.162 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.163+0000 7f1f2d864780 1 > prepared part key=_multipart_2G3UCYG4R4NM.2~PFCHIFMJ91ZU.1 size=388589 2024-09-12T00:34:24.162 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.163+0000 7f1f2d864780 1 > prepared multipart upload key=2G3UCYG4R4NM upload=PFCHIFMJ91ZU tag=6O626AA2SV0G type=write size=2485741 2024-09-12T00:34:24.163 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.165+0000 7f1f2d864780 1 < completed part key=_multipart_MSGU3PHLBRJH.2~25ZEIWBBT650.0 size=544069 2024-09-12T00:34:24.165 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.167+0000 7f1f2d864780 1 < completed multipart upload key=MSGU3PHLBRJH upload=25ZEIWBBT650 tag=L7Q3VM29C8OK type=write size=1592645 2024-09-12T00:34:24.167 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.169+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~1UX3IRY2YZ9P.0 size=559135 2024-09-12T00:34:24.167 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.169+0000 7f1f2d864780 1 > prepared multipart upload key=SZP418NVZ5VX upload=1UX3IRY2YZ9P tag=FSIMGEFAB2I0 type=write size=1607711 2024-09-12T00:34:24.169 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.170+0000 7f1f2d864780 -1 < failed to complete operation key=GSPM8N0K7ODC tag=IFJVIO0EJ50T type=del size=1078410: (22) Invalid argument 2024-09-12T00:34:24.171 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.172+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~VLJ8WQUFUKMK.0 size=1048576 2024-09-12T00:34:24.172 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.173+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~VLJ8WQUFUKMK.1 size=578001 2024-09-12T00:34:24.172 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.173+0000 7f1f2d864780 1 > prepared multipart upload key=FAP6N3H7SBN0 upload=VLJ8WQUFUKMK tag=2TJXSLSVQSKP type=write size=2675153 2024-09-12T00:34:24.173 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.174+0000 7f1f2d864780 1 < completed delete operation key=N9RQIGHVL8VP tag=IO3IORLVWXVV type=del 2024-09-12T00:34:24.174 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.176+0000 7f1f2d864780 1 > prepared operation key=WIIU8VTCLWOD tag=NHYCWTM14IOY type=write size=19210 2024-09-12T00:34:24.175 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.177+0000 7f1f2d864780 1 < completed delete operation key=2RV0899QUJ8W tag=HDR1YUQ16X9P type=del 2024-09-12T00:34:24.176 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.178+0000 7f1f2d864780 1 > prepared operation key=ECZYQEZ942W8 tag=OA905FCT8VYQ type=del size=3112295 2024-09-12T00:34:24.177 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.179+0000 7f1f2d864780 1 < completed part key=_multipart_9XK59MVZ5G1O.2~IHJQ2OSI3UMB.0 size=1048576 2024-09-12T00:34:24.179 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.181+0000 7f1f2d864780 1 < completed part key=_multipart_9XK59MVZ5G1O.2~IHJQ2OSI3UMB.1 size=18617 2024-09-12T00:34:24.181 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.183+0000 7f1f2d864780 1 < completed multipart upload key=9XK59MVZ5G1O upload=IHJQ2OSI3UMB tag=VRFKJF6CQYY3 type=write size=2115769 2024-09-12T00:34:24.184 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.185+0000 7f1f2d864780 1 > prepared operation key=1299IOSGYIO9 tag=Y88RG0QLT7OA type=del size=1422024 2024-09-12T00:34:24.185 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.187+0000 7f1f2d864780 1 < canceled operation key=WKK747ETLW10 tag=NON3NWZ4L8V0 type=write size=374566 2024-09-12T00:34:24.186 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.188+0000 7f1f2d864780 1 > prepared operation key=W6U30X4HJCB1 tag=N6PBE19WGZ02 type=del size=2086333 2024-09-12T00:34:24.187 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.189+0000 7f1f2d864780 1 < completed part key=_multipart_53QCNWX1V1R1.2~T8GTRPT951M2.0 size=1048576 2024-09-12T00:34:24.188 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.190+0000 7f1f2d864780 1 < completed part key=_multipart_53QCNWX1V1R1.2~T8GTRPT951M2.1 size=579227 2024-09-12T00:34:24.190 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.192+0000 7f1f2d864780 1 < completed multipart upload key=53QCNWX1V1R1 upload=T8GTRPT951M2 tag=OUXF2ZAR1AK1 type=write size=2676379 2024-09-12T00:34:24.191 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.193+0000 7f1f2d864780 1 > prepared operation key=2G3UCYG4R4NM tag=MJ1I04P3P425 type=del size=2119695 2024-09-12T00:34:24.192 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.194+0000 7f1f2d864780 1 < completed part key=_multipart_OY145ZXRSF4L.2~QKIQ7ID36AMX.0 size=265642 2024-09-12T00:34:24.194 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.196+0000 7f1f2d864780 1 < completed multipart upload key=OY145ZXRSF4L upload=QKIQ7ID36AMX tag=FZS85MP2IC2A type=write size=1314218 2024-09-12T00:34:24.196 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.198+0000 7f1f2d864780 1 > prepared part key=_multipart_2RV0899QUJ8W.2~SQBP9WHIZBYS.0 size=1048576 2024-09-12T00:34:24.197 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.199+0000 7f1f2d864780 1 > prepared part key=_multipart_2RV0899QUJ8W.2~SQBP9WHIZBYS.1 size=1048576 2024-09-12T00:34:24.198 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.200+0000 7f1f2d864780 1 > prepared part key=_multipart_2RV0899QUJ8W.2~SQBP9WHIZBYS.2 size=383547 2024-09-12T00:34:24.198 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.200+0000 7f1f2d864780 1 > prepared multipart upload key=2RV0899QUJ8W upload=SQBP9WHIZBYS tag=HYQ7XL356L5Z type=write size=3529275 2024-09-12T00:34:24.199 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.201+0000 7f1f2d864780 1 < completed delete operation key=PVB52GO6L8T4 tag=4PS7GVXX4ZFZ type=del 2024-09-12T00:34:24.201 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.203+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~WALPRJNYTXLX.0 size=1048576 2024-09-12T00:34:24.202 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.204+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~WALPRJNYTXLX.1 size=1048576 2024-09-12T00:34:24.203 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.205+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~WALPRJNYTXLX.2 size=42003 2024-09-12T00:34:24.203 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.205+0000 7f1f2d864780 1 > prepared multipart upload key=W6U30X4HJCB1 upload=WALPRJNYTXLX tag=36NXPABFTKQ9 type=write size=3187731 2024-09-12T00:34:24.204 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.206+0000 7f1f2d864780 1 < completed delete operation key=53QCNWX1V1R1 tag=WPNMM4ZEDMVX type=del 2024-09-12T00:34:24.205 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.207+0000 7f1f2d864780 1 > prepared operation key=WGKEA4EKF5GP tag=06VIQVGNEQUF type=del size=3557485 2024-09-12T00:34:24.206 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.208+0000 7f1f2d864780 1 < completed delete operation key=ZGO887JDR627 tag=XKMWD1QXELJ7 type=del 2024-09-12T00:34:24.209 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.210+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~VE2UFJTZD9Z5.0 size=1048576 2024-09-12T00:34:24.210 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.211+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~VE2UFJTZD9Z5.1 size=10174 2024-09-12T00:34:24.210 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.211+0000 7f1f2d864780 1 > prepared multipart upload key=WGKEA4EKF5GP upload=VE2UFJTZD9Z5 tag=6TF8733IK5GZ type=write size=2107326 2024-09-12T00:34:24.211 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.212+0000 7f1f2d864780 1 < completed delete operation key=OY145ZXRSF4L tag=HL65JD9S29EV type=del 2024-09-12T00:34:24.213 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.215+0000 7f1f2d864780 1 > prepared part key=_multipart_53QCNWX1V1R1.2~8E731W40AWVC.0 size=15539 2024-09-12T00:34:24.213 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.215+0000 7f1f2d864780 1 > prepared multipart upload key=53QCNWX1V1R1 upload=8E731W40AWVC tag=W98RXZS35POB type=write size=1064115 2024-09-12T00:34:24.214 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.216+0000 7f1f2d864780 1 < completed part key=_multipart_PVB52GO6L8T4.2~69IFZA6O9CUJ.0 size=1048576 2024-09-12T00:34:24.215 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.216+0000 7f1f2d864780 1 < canceled part key=_multipart_PVB52GO6L8T4.2~69IFZA6O9CUJ.1 size=618496 2024-09-12T00:34:24.217 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.218+0000 7f1f2d864780 1 < canceled multipart upload key=PVB52GO6L8T4 upload=69IFZA6O9CUJ tag=IFIIC0WM5ZB5 type=write size=2715648 2024-09-12T00:34:24.219 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.220+0000 7f1f2d864780 1 > prepared part key=_multipart_MSGU3PHLBRJH.2~XA29W62NEI4M.0 size=1048576 2024-09-12T00:34:24.220 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.221+0000 7f1f2d864780 1 > prepared part key=_multipart_MSGU3PHLBRJH.2~XA29W62NEI4M.1 size=244113 2024-09-12T00:34:24.220 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.221+0000 7f1f2d864780 1 > prepared multipart upload key=MSGU3PHLBRJH upload=XA29W62NEI4M tag=OWTAEKYMZKHT type=write size=2341265 2024-09-12T00:34:24.221 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.223+0000 7f1f2d864780 1 < completed delete operation key=MSGU3PHLBRJH tag=0ZEUGGF3Y5J0 type=del 2024-09-12T00:34:24.223 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.225+0000 7f1f2d864780 1 > prepared part key=_multipart_DYKLAY6J018G.2~0F3L3V0TEIL8.0 size=415083 2024-09-12T00:34:24.223 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.225+0000 7f1f2d864780 1 > prepared multipart upload key=DYKLAY6J018G upload=0F3L3V0TEIL8 tag=LREMY1HA5Q5E type=write size=1463659 2024-09-12T00:34:24.224 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.226+0000 7f1f2d864780 1 < completed write operation key=DYKLAY6J018G tag=LZX7BQJ16JZP type=write size=1024971 2024-09-12T00:34:24.225 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.227+0000 7f1f2d864780 1 > prepared operation key=FFG41OYEYFZA tag=18ECMQHO18B3 type=write size=482788 2024-09-12T00:34:24.227 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.228+0000 7f1f2d864780 1 < completed part key=_multipart_2G3UCYG4R4NM.2~PFCHIFMJ91ZU.0 size=1048576 2024-09-12T00:34:24.227 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.228+0000 7f1f2d864780 1 < canceled part key=_multipart_2G3UCYG4R4NM.2~PFCHIFMJ91ZU.1 size=388589 2024-09-12T00:34:24.228 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.230+0000 7f1f2d864780 1 < canceled multipart upload key=2G3UCYG4R4NM upload=PFCHIFMJ91ZU tag=6O626AA2SV0G type=write size=2485741 2024-09-12T00:34:24.230 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.231+0000 7f1f2d864780 1 > prepared operation key=DYKLAY6J018G tag=WNM17QXN916Q type=del size=2758173 2024-09-12T00:34:24.231 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.232+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~1UX3IRY2YZ9P.0 size=559135 2024-09-12T00:34:24.233 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.234+0000 7f1f2d864780 1 < completed multipart upload key=SZP418NVZ5VX upload=1UX3IRY2YZ9P tag=FSIMGEFAB2I0 type=write size=1607711 2024-09-12T00:34:24.234 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.236+0000 7f1f2d864780 1 > prepared operation key=2G3UCYG4R4NM tag=TK1DIJIUZGSU type=del size=674379 2024-09-12T00:34:24.234 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.236+0000 7f1f2d864780 1 < canceled part key=_multipart_FAP6N3H7SBN0.2~VLJ8WQUFUKMK.0 size=1048576 2024-09-12T00:34:24.235 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.237+0000 7f1f2d864780 1 < completed part key=_multipart_FAP6N3H7SBN0.2~VLJ8WQUFUKMK.1 size=578001 2024-09-12T00:34:24.237 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.239+0000 7f1f2d864780 1 < canceled multipart upload key=FAP6N3H7SBN0 upload=VLJ8WQUFUKMK tag=2TJXSLSVQSKP type=write size=2675153 2024-09-12T00:34:24.238 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.240+0000 7f1f2d864780 1 > prepared operation key=MSGU3PHLBRJH tag=9UKEUTE2S320 type=write size=201855 2024-09-12T00:34:24.240 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.242+0000 7f1f2d864780 1 < suggested remove operation key=WIIU8VTCLWOD tag=NHYCWTM14IOY type=write 2024-09-12T00:34:24.243 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.244+0000 7f1f2d864780 1 > prepared part key=_multipart_ZYNIJH0TTSM6.2~Q1J8MQUW7NQ4.0 size=446081 2024-09-12T00:34:24.243 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.244+0000 7f1f2d864780 1 > prepared multipart upload key=ZYNIJH0TTSM6 upload=Q1J8MQUW7NQ4 tag=Y7IQELMSGOPR type=write size=1494657 2024-09-12T00:34:24.244 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.245+0000 7f1f2d864780 1 < completed delete operation key=ECZYQEZ942W8 tag=OA905FCT8VYQ type=del 2024-09-12T00:34:24.245 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.246+0000 7f1f2d864780 1 > prepared operation key=N9RQIGHVL8VP tag=6J59H50FNZCV type=del size=3578049 2024-09-12T00:34:24.246 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.248+0000 7f1f2d864780 1 < completed delete operation key=1299IOSGYIO9 tag=Y88RG0QLT7OA type=del 2024-09-12T00:34:24.248 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.250+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~1LXXW06ZAWNK.0 size=1048576 2024-09-12T00:34:24.249 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.251+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~1LXXW06ZAWNK.1 size=961802 2024-09-12T00:34:24.249 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.251+0000 7f1f2d864780 1 > prepared multipart upload key=WGKEA4EKF5GP upload=1LXXW06ZAWNK tag=4RK3U2DSCU8L type=write size=3058954 2024-09-12T00:34:24.250 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.252+0000 7f1f2d864780 1 < completed delete operation key=W6U30X4HJCB1 tag=N6PBE19WGZ02 type=del 2024-09-12T00:34:24.251 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.253+0000 7f1f2d864780 1 > prepared operation key=0DSQOFS8IIF5 tag=PQZO8XXWLGOY type=del size=3467024 2024-09-12T00:34:24.253 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.254+0000 7f1f2d864780 1 < completed delete operation key=2G3UCYG4R4NM tag=MJ1I04P3P425 type=del 2024-09-12T00:34:24.255 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.256+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~UZGTA5PDKHW4.0 size=1048576 2024-09-12T00:34:24.256 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.257+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~UZGTA5PDKHW4.1 size=1048576 2024-09-12T00:34:24.257 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.258+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~UZGTA5PDKHW4.2 size=522649 2024-09-12T00:34:24.257 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.258+0000 7f1f2d864780 1 > prepared multipart upload key=0DSQOFS8IIF5 upload=UZGTA5PDKHW4 tag=17PAPVIQKF98 type=write size=3668377 2024-09-12T00:34:24.258 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.259+0000 7f1f2d864780 1 < completed part key=_multipart_2RV0899QUJ8W.2~SQBP9WHIZBYS.0 size=1048576 2024-09-12T00:34:24.259 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.261+0000 7f1f2d864780 1 < completed part key=_multipart_2RV0899QUJ8W.2~SQBP9WHIZBYS.1 size=1048576 2024-09-12T00:34:24.260 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.262+0000 7f1f2d864780 1 < completed part key=_multipart_2RV0899QUJ8W.2~SQBP9WHIZBYS.2 size=383547 2024-09-12T00:34:24.262 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.264+0000 7f1f2d864780 1 < completed multipart upload key=2RV0899QUJ8W upload=SQBP9WHIZBYS tag=HYQ7XL356L5Z type=write size=3529275 2024-09-12T00:34:24.263 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.265+0000 7f1f2d864780 1 > prepared operation key=AN26EVAZI527 tag=AQUVZUHA3Q75 type=del size=2129688 2024-09-12T00:34:24.264 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.266+0000 7f1f2d864780 1 < completed part key=_multipart_W6U30X4HJCB1.2~WALPRJNYTXLX.0 size=1048576 2024-09-12T00:34:24.265 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.267+0000 7f1f2d864780 1 < completed part key=_multipart_W6U30X4HJCB1.2~WALPRJNYTXLX.1 size=1048576 2024-09-12T00:34:24.266 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.268+0000 7f1f2d864780 1 < completed part key=_multipart_W6U30X4HJCB1.2~WALPRJNYTXLX.2 size=42003 2024-09-12T00:34:24.268 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.270+0000 7f1f2d864780 1 < completed multipart upload key=W6U30X4HJCB1 upload=WALPRJNYTXLX tag=36NXPABFTKQ9 type=write size=3187731 2024-09-12T00:34:24.269 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.271+0000 7f1f2d864780 1 > prepared operation key=ZGO887JDR627 tag=RRSS108QHC7O type=del size=770544 2024-09-12T00:34:24.270 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.272+0000 7f1f2d864780 1 < completed delete operation key=WGKEA4EKF5GP tag=06VIQVGNEQUF type=del 2024-09-12T00:34:24.272 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.273+0000 7f1f2d864780 1 > prepared operation key=DYKLAY6J018G tag=JH8CDVCPD1FJ type=write size=823467 2024-09-12T00:34:24.273 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.275+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~VE2UFJTZD9Z5.0 size=1048576 2024-09-12T00:34:24.274 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.276+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~VE2UFJTZD9Z5.1 size=10174 2024-09-12T00:34:24.276 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.278+0000 7f1f2d864780 1 < completed multipart upload key=WGKEA4EKF5GP upload=VE2UFJTZD9Z5 tag=6TF8733IK5GZ type=write size=2107326 2024-09-12T00:34:24.278 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.280+0000 7f1f2d864780 1 > prepared part key=_multipart_53QCNWX1V1R1.2~WSMVQ4Z39HOU.0 size=1048576 2024-09-12T00:34:24.279 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.281+0000 7f1f2d864780 1 > prepared part key=_multipart_53QCNWX1V1R1.2~WSMVQ4Z39HOU.1 size=1048576 2024-09-12T00:34:24.280 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.282+0000 7f1f2d864780 1 > prepared part key=_multipart_53QCNWX1V1R1.2~WSMVQ4Z39HOU.2 size=810781 2024-09-12T00:34:24.280 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.282+0000 7f1f2d864780 1 > prepared multipart upload key=53QCNWX1V1R1 upload=WSMVQ4Z39HOU tag=KLTYHIPAT2NG type=write size=3956509 2024-09-12T00:34:24.281 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.283+0000 7f1f2d864780 1 < completed part key=_multipart_53QCNWX1V1R1.2~8E731W40AWVC.0 size=15539 2024-09-12T00:34:24.283 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.285+0000 7f1f2d864780 1 < completed multipart upload key=53QCNWX1V1R1 upload=8E731W40AWVC tag=W98RXZS35POB type=write size=1064115 2024-09-12T00:34:24.284 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.286+0000 7f1f2d864780 1 > prepared operation key=53QCNWX1V1R1 tag=JZ78KKZF2WSS type=del size=2646178 2024-09-12T00:34:24.285 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.287+0000 7f1f2d864780 1 < completed part key=_multipart_MSGU3PHLBRJH.2~XA29W62NEI4M.0 size=1048576 2024-09-12T00:34:24.286 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.288+0000 7f1f2d864780 1 < completed part key=_multipart_MSGU3PHLBRJH.2~XA29W62NEI4M.1 size=244113 2024-09-12T00:34:24.290 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.291+0000 7f1f2d864780 1 < completed multipart upload key=MSGU3PHLBRJH upload=XA29W62NEI4M tag=OWTAEKYMZKHT type=write size=2341265 2024-09-12T00:34:24.292 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.294+0000 7f1f2d864780 1 > prepared part key=_multipart_UTR2UUO6DHLJ.2~7S1U7LU6ZXXR.0 size=1048576 2024-09-12T00:34:24.293 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.295+0000 7f1f2d864780 1 > prepared part key=_multipart_UTR2UUO6DHLJ.2~7S1U7LU6ZXXR.1 size=517345 2024-09-12T00:34:24.293 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.295+0000 7f1f2d864780 1 > prepared multipart upload key=UTR2UUO6DHLJ upload=7S1U7LU6ZXXR tag=U5NWKZ3IZ1SW type=write size=2614497 2024-09-12T00:34:24.293 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.295+0000 7f1f2d864780 1 < canceled part key=_multipart_DYKLAY6J018G.2~0F3L3V0TEIL8.0 size=415083 2024-09-12T00:34:24.295 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.297+0000 7f1f2d864780 1 < canceled multipart upload key=DYKLAY6J018G upload=0F3L3V0TEIL8 tag=LREMY1HA5Q5E type=write size=1463659 2024-09-12T00:34:24.296 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.298+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=08KUFM8YFCBF type=del size=4039679 2024-09-12T00:34:24.297 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.299+0000 7f1f2d864780 1 < completed write operation key=FFG41OYEYFZA tag=18ECMQHO18B3 type=write size=482788 2024-09-12T00:34:24.299 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.300+0000 7f1f2d864780 1 > prepared operation key=S5DVMA14N7VJ tag=2F3RCFDZAW4G type=del size=2163976 2024-09-12T00:34:24.300 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.301+0000 7f1f2d864780 1 < completed delete operation key=DYKLAY6J018G tag=WNM17QXN916Q type=del 2024-09-12T00:34:24.302 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.303+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~CLW9PADH0CF4.0 size=1048576 2024-09-12T00:34:24.303 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.304+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~CLW9PADH0CF4.1 size=1048576 2024-09-12T00:34:24.304 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.305+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~CLW9PADH0CF4.2 size=838247 2024-09-12T00:34:24.304 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.305+0000 7f1f2d864780 1 > prepared multipart upload key=SZP418NVZ5VX upload=CLW9PADH0CF4 tag=QDQZOPZUJBXO type=write size=3983975 2024-09-12T00:34:24.305 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.306+0000 7f1f2d864780 1 < canceled operation key=2G3UCYG4R4NM tag=TK1DIJIUZGSU type=del size=674379 2024-09-12T00:34:24.306 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.308+0000 7f1f2d864780 1 > prepared operation key=FFG41OYEYFZA tag=5LCTQBSI8OAT type=del size=278540 2024-09-12T00:34:24.307 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.309+0000 7f1f2d864780 1 < completed write operation key=MSGU3PHLBRJH tag=9UKEUTE2S320 type=write size=201855 2024-09-12T00:34:24.308 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.310+0000 7f1f2d864780 1 > prepared operation key=GSPM8N0K7ODC tag=Q49FSE02NKKR type=del size=2895461 2024-09-12T00:34:24.309 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.311+0000 7f1f2d864780 1 < completed part key=_multipart_ZYNIJH0TTSM6.2~Q1J8MQUW7NQ4.0 size=446081 2024-09-12T00:34:24.311 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.313+0000 7f1f2d864780 1 < completed multipart upload key=ZYNIJH0TTSM6 upload=Q1J8MQUW7NQ4 tag=Y7IQELMSGOPR type=write size=1494657 2024-09-12T00:34:24.313 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.315+0000 7f1f2d864780 1 > prepared part key=_multipart_N9RQIGHVL8VP.2~D0E3V44HDL8A.0 size=833875 2024-09-12T00:34:24.313 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.315+0000 7f1f2d864780 1 > prepared multipart upload key=N9RQIGHVL8VP upload=D0E3V44HDL8A tag=NP7WRQ12Y2MG type=write size=1882451 2024-09-12T00:34:24.314 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.316+0000 7f1f2d864780 1 < completed delete operation key=N9RQIGHVL8VP tag=6J59H50FNZCV type=del 2024-09-12T00:34:24.315 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.317+0000 7f1f2d864780 1 > prepared operation key=4FRVL0KXN2X8 tag=SXUVY1C509EM type=del size=2444211 2024-09-12T00:34:24.315 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.317+0000 7f1f2d864780 1 < canceled part key=_multipart_WGKEA4EKF5GP.2~1LXXW06ZAWNK.0 size=1048576 2024-09-12T00:34:24.316 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.318+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~1LXXW06ZAWNK.1 size=961802 2024-09-12T00:34:24.324 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.326+0000 7f1f2d864780 1 < canceled multipart upload key=WGKEA4EKF5GP upload=1LXXW06ZAWNK tag=4RK3U2DSCU8L type=write size=3058954 2024-09-12T00:34:24.326 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.328+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~DXW3V0U0I4N4.0 size=1048576 2024-09-12T00:34:24.327 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.329+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~DXW3V0U0I4N4.1 size=1048576 2024-09-12T00:34:24.328 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.330+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~DXW3V0U0I4N4.2 size=195657 2024-09-12T00:34:24.328 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.330+0000 7f1f2d864780 1 > prepared multipart upload key=1299IOSGYIO9 upload=DXW3V0U0I4N4 tag=UIPPHTS32QVQ type=write size=3341385 2024-09-12T00:34:24.330 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.332+0000 7f1f2d864780 1 < suggested update operation key=0DSQOFS8IIF5 tag=PQZO8XXWLGOY type=del size=3467024 2024-09-12T00:34:24.332 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.334+0000 7f1f2d864780 1 > prepared part key=_multipart_SNCGB6Z20450.2~5H0BXOILZKDW.0 size=209788 2024-09-12T00:34:24.332 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.334+0000 7f1f2d864780 1 > prepared multipart upload key=SNCGB6Z20450 upload=5H0BXOILZKDW tag=BO374RDEMKNG type=write size=1258364 2024-09-12T00:34:24.333 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.335+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~UZGTA5PDKHW4.0 size=1048576 2024-09-12T00:34:24.334 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.336+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~UZGTA5PDKHW4.1 size=1048576 2024-09-12T00:34:24.335 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.337+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~UZGTA5PDKHW4.2 size=522649 2024-09-12T00:34:24.337 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.338+0000 7f1f2d864780 1 < completed multipart upload key=0DSQOFS8IIF5 upload=UZGTA5PDKHW4 tag=17PAPVIQKF98 type=write size=3668377 2024-09-12T00:34:24.338 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.339+0000 7f1f2d864780 1 > prepared operation key=0DSQOFS8IIF5 tag=8AXP053W2C1W type=del size=2132666 2024-09-12T00:34:24.340 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.342+0000 7f1f2d864780 1 < suggested update operation key=AN26EVAZI527 tag=AQUVZUHA3Q75 type=del size=2129688 2024-09-12T00:34:24.341 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.343+0000 7f1f2d864780 1 > prepared operation key=SNCGB6Z20450 tag=WR3VXARLIUS8 type=write size=777879 2024-09-12T00:34:24.342 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.344+0000 7f1f2d864780 1 < completed delete operation key=ZGO887JDR627 tag=RRSS108QHC7O type=del 2024-09-12T00:34:24.344 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.345+0000 7f1f2d864780 1 > prepared operation key=SZP418NVZ5VX tag=ZNGG60PLPYR3 type=del size=3811697 2024-09-12T00:34:24.345 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.346+0000 7f1f2d864780 1 < canceled operation key=DYKLAY6J018G tag=JH8CDVCPD1FJ type=write size=823467 2024-09-12T00:34:24.346 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.347+0000 7f1f2d864780 1 > prepared operation key=D21W9QZWY0YU tag=XX1FCRV4JTVE type=del size=3538771 2024-09-12T00:34:24.347 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.349+0000 7f1f2d864780 1 < completed part key=_multipart_53QCNWX1V1R1.2~WSMVQ4Z39HOU.0 size=1048576 2024-09-12T00:34:24.348 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.350+0000 7f1f2d864780 1 < completed part key=_multipart_53QCNWX1V1R1.2~WSMVQ4Z39HOU.1 size=1048576 2024-09-12T00:34:24.349 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.350+0000 7f1f2d864780 1 < completed part key=_multipart_53QCNWX1V1R1.2~WSMVQ4Z39HOU.2 size=810781 2024-09-12T00:34:24.351 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.352+0000 7f1f2d864780 1 < completed multipart upload key=53QCNWX1V1R1 upload=WSMVQ4Z39HOU tag=KLTYHIPAT2NG type=write size=3956509 2024-09-12T00:34:24.353 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.354+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~6TSD1WJLYMXO.0 size=1048576 2024-09-12T00:34:24.354 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.355+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~6TSD1WJLYMXO.1 size=70122 2024-09-12T00:34:24.354 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.355+0000 7f1f2d864780 1 > prepared multipart upload key=FAP6N3H7SBN0 upload=6TSD1WJLYMXO tag=EWM9ZZDNK114 type=write size=2167274 2024-09-12T00:34:24.355 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.356+0000 7f1f2d864780 1 < completed delete operation key=53QCNWX1V1R1 tag=JZ78KKZF2WSS type=del 2024-09-12T00:34:24.357 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.358+0000 7f1f2d864780 1 > prepared part key=_multipart_2RV0899QUJ8W.2~0LNJEZBZ7F5S.0 size=1048576 2024-09-12T00:34:24.358 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.359+0000 7f1f2d864780 1 > prepared part key=_multipart_2RV0899QUJ8W.2~0LNJEZBZ7F5S.1 size=1048576 2024-09-12T00:34:24.359 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.360+0000 7f1f2d864780 1 > prepared part key=_multipart_2RV0899QUJ8W.2~0LNJEZBZ7F5S.2 size=490016 2024-09-12T00:34:24.359 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.360+0000 7f1f2d864780 1 > prepared multipart upload key=2RV0899QUJ8W upload=0LNJEZBZ7F5S tag=GQJJRUAX09BZ type=write size=3635744 2024-09-12T00:34:24.360 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.362+0000 7f1f2d864780 1 < completed part key=_multipart_UTR2UUO6DHLJ.2~7S1U7LU6ZXXR.0 size=1048576 2024-09-12T00:34:24.361 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.363+0000 7f1f2d864780 1 < completed part key=_multipart_UTR2UUO6DHLJ.2~7S1U7LU6ZXXR.1 size=517345 2024-09-12T00:34:24.363 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.365+0000 7f1f2d864780 1 < completed multipart upload key=UTR2UUO6DHLJ upload=7S1U7LU6ZXXR tag=U5NWKZ3IZ1SW type=write size=2614497 2024-09-12T00:34:24.365 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.367+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~3L01BJYZAVDG.0 size=1048576 2024-09-12T00:34:24.366 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.368+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~3L01BJYZAVDG.1 size=63274 2024-09-12T00:34:24.366 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.368+0000 7f1f2d864780 1 > prepared multipart upload key=SZP418NVZ5VX upload=3L01BJYZAVDG tag=HKW6YL4XVDSH type=write size=2160426 2024-09-12T00:34:24.369 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.370+0000 7f1f2d864780 1 < suggested update operation key=2RV0899QUJ8W tag=08KUFM8YFCBF type=del size=4039679 2024-09-12T00:34:24.371 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.372+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~XPVH9W9PACTD.0 size=1048576 2024-09-12T00:34:24.371 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.373+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~XPVH9W9PACTD.1 size=1048576 2024-09-12T00:34:24.372 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.374+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~XPVH9W9PACTD.2 size=424948 2024-09-12T00:34:24.373 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.374+0000 7f1f2d864780 1 > prepared multipart upload key=SZP418NVZ5VX upload=XPVH9W9PACTD tag=8EBR3G9053YB type=write size=3570676 2024-09-12T00:34:24.375 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.376+0000 7f1f2d864780 1 < suggested update operation key=S5DVMA14N7VJ tag=2F3RCFDZAW4G type=del size=2163976 2024-09-12T00:34:24.376 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.378+0000 7f1f2d864780 1 > prepared operation key=D21W9QZWY0YU tag=DNLCAWNN5MH3 type=del size=1651361 2024-09-12T00:34:24.377 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.379+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~CLW9PADH0CF4.0 size=1048576 2024-09-12T00:34:24.378 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.380+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~CLW9PADH0CF4.1 size=1048576 2024-09-12T00:34:24.379 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.381+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~CLW9PADH0CF4.2 size=838247 2024-09-12T00:34:24.381 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.382+0000 7f1f2d864780 1 < completed multipart upload key=SZP418NVZ5VX upload=CLW9PADH0CF4 tag=QDQZOPZUJBXO type=write size=3983975 2024-09-12T00:34:24.383 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.385+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~UOVV1U41JS2F.0 size=1048576 2024-09-12T00:34:24.384 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.385+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~UOVV1U41JS2F.1 size=802701 2024-09-12T00:34:24.384 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.385+0000 7f1f2d864780 1 > prepared multipart upload key=D21W9QZWY0YU upload=UOVV1U41JS2F tag=SH9H7FE592C8 type=write size=2899853 2024-09-12T00:34:24.385 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.387+0000 7f1f2d864780 1 < completed delete operation key=FFG41OYEYFZA tag=5LCTQBSI8OAT type=del 2024-09-12T00:34:24.386 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.388+0000 7f1f2d864780 1 > prepared operation key=ECZYQEZ942W8 tag=DFNWSC23LPVJ type=del size=1575316 2024-09-12T00:34:24.388 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.390+0000 7f1f2d864780 1 < suggested update operation key=GSPM8N0K7ODC tag=Q49FSE02NKKR type=del size=2895461 2024-09-12T00:34:24.390 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.391+0000 7f1f2d864780 1 > prepared operation key=0DSQOFS8IIF5 tag=3AE7ZCJVFQHO type=del size=1959546 2024-09-12T00:34:24.391 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.392+0000 7f1f2d864780 1 < completed part key=_multipart_N9RQIGHVL8VP.2~D0E3V44HDL8A.0 size=833875 2024-09-12T00:34:24.393 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.394+0000 7f1f2d864780 1 < completed multipart upload key=N9RQIGHVL8VP upload=D0E3V44HDL8A tag=NP7WRQ12Y2MG type=write size=1882451 2024-09-12T00:34:24.395 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.397+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~VYUUZSRZ9IXF.0 size=1048576 2024-09-12T00:34:24.396 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.397+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~VYUUZSRZ9IXF.1 size=356374 2024-09-12T00:34:24.396 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.397+0000 7f1f2d864780 1 > prepared multipart upload key=FAP6N3H7SBN0 upload=VYUUZSRZ9IXF tag=9OS4F44Z6SV2 type=write size=2453526 2024-09-12T00:34:24.397 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.399+0000 7f1f2d864780 1 < completed delete operation key=4FRVL0KXN2X8 tag=SXUVY1C509EM type=del 2024-09-12T00:34:24.398 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.400+0000 7f1f2d864780 1 > prepared operation key=ECZYQEZ942W8 tag=X13WGXY8DA1B type=write size=104572 2024-09-12T00:34:24.401 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.402+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~DXW3V0U0I4N4.0 size=1048576 2024-09-12T00:34:24.401 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.402+0000 7f1f2d864780 1 < canceled part key=_multipart_1299IOSGYIO9.2~DXW3V0U0I4N4.1 size=1048576 2024-09-12T00:34:24.402 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.403+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~DXW3V0U0I4N4.2 size=195657 2024-09-12T00:34:24.403 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.405+0000 7f1f2d864780 1 < canceled multipart upload key=1299IOSGYIO9 upload=DXW3V0U0I4N4 tag=UIPPHTS32QVQ type=write size=3341385 2024-09-12T00:34:24.405 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.406+0000 7f1f2d864780 1 > prepared operation key=ZGO887JDR627 tag=Z7K6YRYEXE76 type=del size=148270 2024-09-12T00:34:24.406 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.408+0000 7f1f2d864780 1 < completed part key=_multipart_SNCGB6Z20450.2~5H0BXOILZKDW.0 size=209788 2024-09-12T00:34:24.408 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.409+0000 7f1f2d864780 1 < completed multipart upload key=SNCGB6Z20450 upload=5H0BXOILZKDW tag=BO374RDEMKNG type=write size=1258364 2024-09-12T00:34:24.409 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.411+0000 7f1f2d864780 1 > prepared operation key=3Z1TGGPZKJ69 tag=L8T2QKKY61JU type=write size=976293 2024-09-12T00:34:24.410 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.412+0000 7f1f2d864780 1 < completed delete operation key=0DSQOFS8IIF5 tag=8AXP053W2C1W type=del 2024-09-12T00:34:24.411 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.413+0000 7f1f2d864780 1 > prepared operation key=ECZYQEZ942W8 tag=OMOKZ7UGZ1X0 type=write size=559180 2024-09-12T00:34:24.412 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.414+0000 7f1f2d864780 1 < completed write operation key=SNCGB6Z20450 tag=WR3VXARLIUS8 type=write size=777879 2024-09-12T00:34:24.414 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.415+0000 7f1f2d864780 1 > prepared operation key=N9RQIGHVL8VP tag=JVQSIG0NUMIO type=del size=3822732 2024-09-12T00:34:24.415 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.417+0000 7f1f2d864780 1 < suggested update operation key=SZP418NVZ5VX tag=ZNGG60PLPYR3 type=del size=3811697 2024-09-12T00:34:24.417 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.418+0000 7f1f2d864780 1 > prepared operation key=FFG41OYEYFZA tag=IDUNO63ZLUSV type=del size=4089288 2024-09-12T00:34:24.419 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.421+0000 7f1f2d864780 1 < suggested update operation key=D21W9QZWY0YU tag=XX1FCRV4JTVE type=del size=3538771 2024-09-12T00:34:24.421 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.423+0000 7f1f2d864780 1 > prepared part key=_multipart_PVB52GO6L8T4.2~X1CFM4ESE3PM.0 size=494815 2024-09-12T00:34:24.421 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.423+0000 7f1f2d864780 1 > prepared multipart upload key=PVB52GO6L8T4 upload=X1CFM4ESE3PM tag=U86DKC2J2TMY type=write size=1543391 2024-09-12T00:34:24.422 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.424+0000 7f1f2d864780 1 < completed part key=_multipart_FAP6N3H7SBN0.2~6TSD1WJLYMXO.0 size=1048576 2024-09-12T00:34:24.423 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.425+0000 7f1f2d864780 1 < completed part key=_multipart_FAP6N3H7SBN0.2~6TSD1WJLYMXO.1 size=70122 2024-09-12T00:34:24.425 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.427+0000 7f1f2d864780 1 < completed multipart upload key=FAP6N3H7SBN0 upload=6TSD1WJLYMXO tag=EWM9ZZDNK114 type=write size=2167274 2024-09-12T00:34:24.427 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.429+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~M6S2EZH7UJSE.0 size=1048576 2024-09-12T00:34:24.428 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.430+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~M6S2EZH7UJSE.1 size=190501 2024-09-12T00:34:24.428 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.430+0000 7f1f2d864780 1 > prepared multipart upload key=1299IOSGYIO9 upload=M6S2EZH7UJSE tag=U36FUDZ4OK4K type=write size=2287653 2024-09-12T00:34:24.429 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.431+0000 7f1f2d864780 1 < completed part key=_multipart_2RV0899QUJ8W.2~0LNJEZBZ7F5S.0 size=1048576 2024-09-12T00:34:24.430 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.432+0000 7f1f2d864780 1 < completed part key=_multipart_2RV0899QUJ8W.2~0LNJEZBZ7F5S.1 size=1048576 2024-09-12T00:34:24.431 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.433+0000 7f1f2d864780 1 < completed part key=_multipart_2RV0899QUJ8W.2~0LNJEZBZ7F5S.2 size=490016 2024-09-12T00:34:24.433 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.435+0000 7f1f2d864780 1 < completed multipart upload key=2RV0899QUJ8W upload=0LNJEZBZ7F5S tag=GQJJRUAX09BZ type=write size=3635744 2024-09-12T00:34:24.435 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.437+0000 7f1f2d864780 1 > prepared part key=_multipart_N9RQIGHVL8VP.2~3FMK3J45L07D.0 size=590410 2024-09-12T00:34:24.435 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.437+0000 7f1f2d864780 1 > prepared multipart upload key=N9RQIGHVL8VP upload=3FMK3J45L07D tag=3LDG339ZQFNU type=write size=1638986 2024-09-12T00:34:24.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.438+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~3L01BJYZAVDG.0 size=1048576 2024-09-12T00:34:24.437 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.439+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~3L01BJYZAVDG.1 size=63274 2024-09-12T00:34:24.439 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.441+0000 7f1f2d864780 1 < completed multipart upload key=SZP418NVZ5VX upload=3L01BJYZAVDG tag=HKW6YL4XVDSH type=write size=2160426 2024-09-12T00:34:24.442 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.443+0000 7f1f2d864780 1 > prepared part key=_multipart_SNCGB6Z20450.2~SIDSW2GLK2R9.0 size=1048576 2024-09-12T00:34:24.443 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.444+0000 7f1f2d864780 1 > prepared part key=_multipart_SNCGB6Z20450.2~SIDSW2GLK2R9.1 size=690212 2024-09-12T00:34:24.443 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.444+0000 7f1f2d864780 1 > prepared multipart upload key=SNCGB6Z20450 upload=SIDSW2GLK2R9 tag=HZKRJR3M2K54 type=write size=2787364 2024-09-12T00:34:24.444 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.446+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~XPVH9W9PACTD.0 size=1048576 2024-09-12T00:34:24.445 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.447+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~XPVH9W9PACTD.1 size=1048576 2024-09-12T00:34:24.446 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.448+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~XPVH9W9PACTD.2 size=424948 2024-09-12T00:34:24.448 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.449+0000 7f1f2d864780 1 < completed multipart upload key=SZP418NVZ5VX upload=XPVH9W9PACTD tag=8EBR3G9053YB type=write size=3570676 2024-09-12T00:34:24.449 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.451+0000 7f1f2d864780 1 > prepared operation key=ZYNIJH0TTSM6 tag=Q06S7CNVJYZ6 type=del size=2809547 2024-09-12T00:34:24.451 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.453+0000 7f1f2d864780 1 < suggested update operation key=D21W9QZWY0YU tag=DNLCAWNN5MH3 type=del size=1651361 2024-09-12T00:34:24.453 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.454+0000 7f1f2d864780 1 > prepared operation key=3Z1TGGPZKJ69 tag=JGLGS23FCI3S type=del size=3230870 2024-09-12T00:34:24.454 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.456+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~UOVV1U41JS2F.0 size=1048576 2024-09-12T00:34:24.455 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.457+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~UOVV1U41JS2F.1 size=802701 2024-09-12T00:34:24.457 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.459+0000 7f1f2d864780 1 < completed multipart upload key=D21W9QZWY0YU upload=UOVV1U41JS2F tag=SH9H7FE592C8 type=write size=2899853 2024-09-12T00:34:24.460 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.461+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~D490KSB0BMU5.0 size=1048576 2024-09-12T00:34:24.461 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.462+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~D490KSB0BMU5.1 size=1048576 2024-09-12T00:34:24.462 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.463+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~D490KSB0BMU5.2 size=103096 2024-09-12T00:34:24.462 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.463+0000 7f1f2d864780 1 > prepared multipart upload key=D21W9QZWY0YU upload=D490KSB0BMU5 tag=01V2Z5UB5OGQ type=write size=3248824 2024-09-12T00:34:24.463 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.464+0000 7f1f2d864780 1 < completed delete operation key=ECZYQEZ942W8 tag=DFNWSC23LPVJ type=del 2024-09-12T00:34:24.465 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.467+0000 7f1f2d864780 1 > prepared part key=_multipart_3Z1TGGPZKJ69.2~FT3N4AIE7XL7.0 size=1048576 2024-09-12T00:34:24.466 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.468+0000 7f1f2d864780 1 > prepared part key=_multipart_3Z1TGGPZKJ69.2~FT3N4AIE7XL7.1 size=1048576 2024-09-12T00:34:24.467 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.469+0000 7f1f2d864780 1 > prepared part key=_multipart_3Z1TGGPZKJ69.2~FT3N4AIE7XL7.2 size=315594 2024-09-12T00:34:24.467 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.469+0000 7f1f2d864780 1 > prepared multipart upload key=3Z1TGGPZKJ69 upload=FT3N4AIE7XL7 tag=1O15LAW9QZ90 type=write size=3461322 2024-09-12T00:34:24.468 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.470+0000 7f1f2d864780 1 < completed delete operation key=0DSQOFS8IIF5 tag=3AE7ZCJVFQHO type=del 2024-09-12T00:34:24.471 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.472+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~CQIAV1JK6J5Z.0 size=1048576 2024-09-12T00:34:24.472 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.473+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~CQIAV1JK6J5Z.1 size=1048576 2024-09-12T00:34:24.473 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.474+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~CQIAV1JK6J5Z.2 size=226545 2024-09-12T00:34:24.473 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.474+0000 7f1f2d864780 1 > prepared multipart upload key=WGKEA4EKF5GP upload=CQIAV1JK6J5Z tag=XJWYCAUYM2YB type=write size=3372273 2024-09-12T00:34:24.474 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.475+0000 7f1f2d864780 1 < completed part key=_multipart_FAP6N3H7SBN0.2~VYUUZSRZ9IXF.0 size=1048576 2024-09-12T00:34:24.475 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.476+0000 7f1f2d864780 1 < completed part key=_multipart_FAP6N3H7SBN0.2~VYUUZSRZ9IXF.1 size=356374 2024-09-12T00:34:24.477 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.479+0000 7f1f2d864780 1 < completed multipart upload key=FAP6N3H7SBN0 upload=VYUUZSRZ9IXF tag=9OS4F44Z6SV2 type=write size=2453526 2024-09-12T00:34:24.479 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.481+0000 7f1f2d864780 1 > prepared part key=_multipart_53QCNWX1V1R1.2~ZLMDZTJIPUNH.0 size=1048576 2024-09-12T00:34:24.480 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.482+0000 7f1f2d864780 1 > prepared part key=_multipart_53QCNWX1V1R1.2~ZLMDZTJIPUNH.1 size=552423 2024-09-12T00:34:24.480 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.482+0000 7f1f2d864780 1 > prepared multipart upload key=53QCNWX1V1R1 upload=ZLMDZTJIPUNH tag=2DAK2X1NU323 type=write size=2649575 2024-09-12T00:34:24.481 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.483+0000 7f1f2d864780 1 < completed write operation key=ECZYQEZ942W8 tag=X13WGXY8DA1B type=write size=104572 2024-09-12T00:34:24.483 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.484+0000 7f1f2d864780 1 > prepared operation key=FAP6N3H7SBN0 tag=RU9JR4J4710T type=del size=3205624 2024-09-12T00:34:24.485 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.487+0000 7f1f2d864780 1 < suggested update operation key=ZGO887JDR627 tag=Z7K6YRYEXE76 type=del size=148270 2024-09-12T00:34:24.486 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.488+0000 7f1f2d864780 1 > prepared operation key=SNCGB6Z20450 tag=4W3GNB04R0WH type=del size=3616546 2024-09-12T00:34:24.488 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.489+0000 7f1f2d864780 1 < completed write operation key=3Z1TGGPZKJ69 tag=L8T2QKKY61JU type=write size=976293 2024-09-12T00:34:24.490 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.492+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~TEZCV5TFSUJH.0 size=1012745 2024-09-12T00:34:24.490 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.492+0000 7f1f2d864780 1 > prepared multipart upload key=FAP6N3H7SBN0 upload=TEZCV5TFSUJH tag=N07BQUDAU8DV type=write size=2061321 2024-09-12T00:34:24.491 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.493+0000 7f1f2d864780 1 < completed write operation key=ECZYQEZ942W8 tag=OMOKZ7UGZ1X0 type=write size=559180 2024-09-12T00:34:24.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.494+0000 7f1f2d864780 1 > prepared operation key=UTR2UUO6DHLJ tag=8DTTLO4GM1PG type=del size=2946164 2024-09-12T00:34:24.494 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.496+0000 7f1f2d864780 1 < completed delete operation key=N9RQIGHVL8VP tag=JVQSIG0NUMIO type=del 2024-09-12T00:34:24.496 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.498+0000 7f1f2d864780 1 > prepared part key=_multipart_ZGO887JDR627.2~Y74JPJZMGSA1.0 size=1048576 2024-09-12T00:34:24.497 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.499+0000 7f1f2d864780 1 > prepared part key=_multipart_ZGO887JDR627.2~Y74JPJZMGSA1.1 size=725772 2024-09-12T00:34:24.497 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.499+0000 7f1f2d864780 1 > prepared multipart upload key=ZGO887JDR627 upload=Y74JPJZMGSA1 tag=QWOVSZSFHW17 type=write size=2822924 2024-09-12T00:34:24.499 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.500+0000 7f1f2d864780 1 < completed delete operation key=FFG41OYEYFZA tag=IDUNO63ZLUSV type=del 2024-09-12T00:34:24.500 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.501+0000 7f1f2d864780 1 > prepared operation key=OY145ZXRSF4L tag=WU78Z9NJL2SD type=del size=2695706 2024-09-12T00:34:24.501 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.503+0000 7f1f2d864780 1 < completed part key=_multipart_PVB52GO6L8T4.2~X1CFM4ESE3PM.0 size=494815 2024-09-12T00:34:24.503 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.505+0000 7f1f2d864780 1 < completed multipart upload key=PVB52GO6L8T4 upload=X1CFM4ESE3PM tag=U86DKC2J2TMY type=write size=1543391 2024-09-12T00:34:24.505 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.506+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=3XDJPDJ61HY6 type=del size=2242618 2024-09-12T00:34:24.506 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.508+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~M6S2EZH7UJSE.0 size=1048576 2024-09-12T00:34:24.507 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.509+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~M6S2EZH7UJSE.1 size=190501 2024-09-12T00:34:24.509 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.511+0000 7f1f2d864780 1 < completed multipart upload key=1299IOSGYIO9 upload=M6S2EZH7UJSE tag=U36FUDZ4OK4K type=write size=2287653 2024-09-12T00:34:24.510 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.512+0000 7f1f2d864780 1 > prepared operation key=FFG41OYEYFZA tag=HK03QXYURXXJ type=del size=3507339 2024-09-12T00:34:24.513 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.514+0000 7f1f2d864780 1 < completed part key=_multipart_N9RQIGHVL8VP.2~3FMK3J45L07D.0 size=590410 2024-09-12T00:34:24.515 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.516+0000 7f1f2d864780 1 < completed multipart upload key=N9RQIGHVL8VP upload=3FMK3J45L07D tag=3LDG339ZQFNU type=write size=1638986 2024-09-12T00:34:24.516 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.518+0000 7f1f2d864780 1 > prepared operation key=FFG41OYEYFZA tag=7HKTGW2K9MHI type=write size=947455 2024-09-12T00:34:24.518 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.519+0000 7f1f2d864780 1 < completed part key=_multipart_SNCGB6Z20450.2~SIDSW2GLK2R9.0 size=1048576 2024-09-12T00:34:24.519 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.520+0000 7f1f2d864780 1 < completed part key=_multipart_SNCGB6Z20450.2~SIDSW2GLK2R9.1 size=690212 2024-09-12T00:34:24.520 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.522+0000 7f1f2d864780 1 < completed multipart upload key=SNCGB6Z20450 upload=SIDSW2GLK2R9 tag=HZKRJR3M2K54 type=write size=2787364 2024-09-12T00:34:24.522 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.523+0000 7f1f2d864780 1 > prepared operation key=2YCGIJRK6MUH tag=ON8HJU5Z5TOX type=del size=1908094 2024-09-12T00:34:24.523 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.525+0000 7f1f2d864780 1 < completed delete operation key=ZYNIJH0TTSM6 tag=Q06S7CNVJYZ6 type=del 2024-09-12T00:34:24.524 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.526+0000 7f1f2d864780 1 > prepared operation key=O1YY03BOEYLM tag=I0X15G5JFAAD type=del size=3284455 2024-09-12T00:34:24.525 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.527+0000 7f1f2d864780 1 < completed delete operation key=3Z1TGGPZKJ69 tag=JGLGS23FCI3S type=del 2024-09-12T00:34:24.527 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.529+0000 7f1f2d864780 1 > prepared part key=_multipart_WKK747ETLW10.2~F8W2QM0LFNHD.0 size=1048576 2024-09-12T00:34:24.528 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.530+0000 7f1f2d864780 1 > prepared part key=_multipart_WKK747ETLW10.2~F8W2QM0LFNHD.1 size=1048576 2024-09-12T00:34:24.530 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.531+0000 7f1f2d864780 1 > prepared part key=_multipart_WKK747ETLW10.2~F8W2QM0LFNHD.2 size=470951 2024-09-12T00:34:24.530 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.531+0000 7f1f2d864780 1 > prepared multipart upload key=WKK747ETLW10 upload=F8W2QM0LFNHD tag=UAO3XPLTNWY3 type=write size=3616679 2024-09-12T00:34:24.530 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.531+0000 7f1f2d864780 1 < canceled part key=_multipart_D21W9QZWY0YU.2~D490KSB0BMU5.0 size=1048576 2024-09-12T00:34:24.531 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.532+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~D490KSB0BMU5.1 size=1048576 2024-09-12T00:34:24.532 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.533+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~D490KSB0BMU5.2 size=103096 2024-09-12T00:34:24.534 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.535+0000 7f1f2d864780 1 < canceled multipart upload key=D21W9QZWY0YU upload=D490KSB0BMU5 tag=01V2Z5UB5OGQ type=write size=3248824 2024-09-12T00:34:24.535 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.537+0000 7f1f2d864780 1 > prepared operation key=ZYNIJH0TTSM6 tag=YN40HNDDW5AD type=del size=4074739 2024-09-12T00:34:24.537 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.538+0000 7f1f2d864780 1 < completed part key=_multipart_3Z1TGGPZKJ69.2~FT3N4AIE7XL7.0 size=1048576 2024-09-12T00:34:24.537 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.539+0000 7f1f2d864780 1 < completed part key=_multipart_3Z1TGGPZKJ69.2~FT3N4AIE7XL7.1 size=1048576 2024-09-12T00:34:24.538 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.540+0000 7f1f2d864780 1 < completed part key=_multipart_3Z1TGGPZKJ69.2~FT3N4AIE7XL7.2 size=315594 2024-09-12T00:34:24.540 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.542+0000 7f1f2d864780 1 < completed multipart upload key=3Z1TGGPZKJ69 upload=FT3N4AIE7XL7 tag=1O15LAW9QZ90 type=write size=3461322 2024-09-12T00:34:24.541 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.543+0000 7f1f2d864780 1 > prepared operation key=WGKEA4EKF5GP tag=A8KO6P8ESFX3 type=del size=1732207 2024-09-12T00:34:24.543 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.545+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~CQIAV1JK6J5Z.0 size=1048576 2024-09-12T00:34:24.544 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.546+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~CQIAV1JK6J5Z.1 size=1048576 2024-09-12T00:34:24.545 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.547+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~CQIAV1JK6J5Z.2 size=226545 2024-09-12T00:34:24.547 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.549+0000 7f1f2d864780 1 < completed multipart upload key=WGKEA4EKF5GP upload=CQIAV1JK6J5Z tag=XJWYCAUYM2YB type=write size=3372273 2024-09-12T00:34:24.548 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.550+0000 7f1f2d864780 1 > prepared operation key=UTR2UUO6DHLJ tag=SX5FE9C2RANG type=del size=2784392 2024-09-12T00:34:24.550 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.551+0000 7f1f2d864780 1 < completed part key=_multipart_53QCNWX1V1R1.2~ZLMDZTJIPUNH.0 size=1048576 2024-09-12T00:34:24.551 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.552+0000 7f1f2d864780 1 < completed part key=_multipart_53QCNWX1V1R1.2~ZLMDZTJIPUNH.1 size=552423 2024-09-12T00:34:24.553 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.555+0000 7f1f2d864780 1 < completed multipart upload key=53QCNWX1V1R1 upload=ZLMDZTJIPUNH tag=2DAK2X1NU323 type=write size=2649575 2024-09-12T00:34:24.555 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.557+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~18SBKVU39TWN.0 size=1048576 2024-09-12T00:34:24.556 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.558+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~18SBKVU39TWN.1 size=704112 2024-09-12T00:34:24.556 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.558+0000 7f1f2d864780 1 > prepared multipart upload key=4FRVL0KXN2X8 upload=18SBKVU39TWN tag=KU5KGWRKNSHK type=write size=2801264 2024-09-12T00:34:24.557 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.559+0000 7f1f2d864780 1 < canceled operation key=FAP6N3H7SBN0 tag=RU9JR4J4710T type=del size=3205624 2024-09-12T00:34:24.559 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.560+0000 7f1f2d864780 1 > prepared operation key=ZYNIJH0TTSM6 tag=O1G91B65GQEJ type=del size=3934270 2024-09-12T00:34:24.561 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.562+0000 7f1f2d864780 1 < suggested remove operation key=SNCGB6Z20450 tag=4W3GNB04R0WH type=del 2024-09-12T00:34:24.562 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.564+0000 7f1f2d864780 1 > prepared operation key=FAP6N3H7SBN0 tag=PW9K3H9XZT1N type=del size=1596228 2024-09-12T00:34:24.563 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.565+0000 7f1f2d864780 1 < completed part key=_multipart_FAP6N3H7SBN0.2~TEZCV5TFSUJH.0 size=1012745 2024-09-12T00:34:24.565 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.567+0000 7f1f2d864780 1 < completed multipart upload key=FAP6N3H7SBN0 upload=TEZCV5TFSUJH tag=N07BQUDAU8DV type=write size=2061321 2024-09-12T00:34:24.567 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.569+0000 7f1f2d864780 1 > prepared part key=_multipart_OY145ZXRSF4L.2~V7NWRVC6AXFX.0 size=1048576 2024-09-12T00:34:24.568 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.570+0000 7f1f2d864780 1 > prepared part key=_multipart_OY145ZXRSF4L.2~V7NWRVC6AXFX.1 size=1048576 2024-09-12T00:34:24.569 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.571+0000 7f1f2d864780 1 > prepared part key=_multipart_OY145ZXRSF4L.2~V7NWRVC6AXFX.2 size=17657 2024-09-12T00:34:24.569 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.571+0000 7f1f2d864780 1 > prepared multipart upload key=OY145ZXRSF4L upload=V7NWRVC6AXFX tag=MYGGGJB2M2YG type=write size=3163385 2024-09-12T00:34:24.571 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.573+0000 7f1f2d864780 1 < suggested remove operation key=UTR2UUO6DHLJ tag=8DTTLO4GM1PG type=del 2024-09-12T00:34:24.573 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.575+0000 7f1f2d864780 1 > prepared part key=_multipart_FFG41OYEYFZA.2~QYE6K8BA88XU.0 size=1048576 2024-09-12T00:34:24.574 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.576+0000 7f1f2d864780 1 > prepared part key=_multipart_FFG41OYEYFZA.2~QYE6K8BA88XU.1 size=1048576 2024-09-12T00:34:24.575 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.577+0000 7f1f2d864780 1 > prepared part key=_multipart_FFG41OYEYFZA.2~QYE6K8BA88XU.2 size=136483 2024-09-12T00:34:24.575 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.577+0000 7f1f2d864780 1 > prepared multipart upload key=FFG41OYEYFZA upload=QYE6K8BA88XU tag=RR0SG3M3IL4N type=write size=3282211 2024-09-12T00:34:24.576 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.578+0000 7f1f2d864780 1 < completed part key=_multipart_ZGO887JDR627.2~Y74JPJZMGSA1.0 size=1048576 2024-09-12T00:34:24.577 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.579+0000 7f1f2d864780 1 < completed part key=_multipart_ZGO887JDR627.2~Y74JPJZMGSA1.1 size=725772 2024-09-12T00:34:24.579 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.581+0000 7f1f2d864780 1 < completed multipart upload key=ZGO887JDR627 upload=Y74JPJZMGSA1 tag=QWOVSZSFHW17 type=write size=2822924 2024-09-12T00:34:24.580 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.582+0000 7f1f2d864780 1 > prepared operation key=D21W9QZWY0YU tag=7GQNQ8LPPY6Z type=del size=2316300 2024-09-12T00:34:24.581 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.583+0000 7f1f2d864780 1 < completed delete operation key=OY145ZXRSF4L tag=WU78Z9NJL2SD type=del 2024-09-12T00:34:24.582 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.584+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=QQ8T0RKY41CM type=del size=2176464 2024-09-12T00:34:24.584 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.586+0000 7f1f2d864780 1 < suggested remove operation key=2RV0899QUJ8W tag=3XDJPDJ61HY6 type=del 2024-09-12T00:34:24.586 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.588+0000 7f1f2d864780 1 > prepared part key=_multipart_2RV0899QUJ8W.2~6DN8BMKMBFO1.0 size=1048576 2024-09-12T00:34:24.587 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.589+0000 7f1f2d864780 1 > prepared part key=_multipart_2RV0899QUJ8W.2~6DN8BMKMBFO1.1 size=1048576 2024-09-12T00:34:24.588 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.590+0000 7f1f2d864780 1 > prepared part key=_multipart_2RV0899QUJ8W.2~6DN8BMKMBFO1.2 size=985434 2024-09-12T00:34:24.588 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.590+0000 7f1f2d864780 1 > prepared multipart upload key=2RV0899QUJ8W upload=6DN8BMKMBFO1 tag=NK88HRD0W67R type=write size=4131162 2024-09-12T00:34:24.589 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.591+0000 7f1f2d864780 1 < completed delete operation key=FFG41OYEYFZA tag=HK03QXYURXXJ type=del 2024-09-12T00:34:24.591 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.593+0000 7f1f2d864780 1 > prepared part key=_multipart_DYKLAY6J018G.2~RVU3UU8HM86Y.0 size=219662 2024-09-12T00:34:24.591 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.593+0000 7f1f2d864780 1 > prepared multipart upload key=DYKLAY6J018G upload=RVU3UU8HM86Y tag=HY7GXX77UKDQ type=write size=1268238 2024-09-12T00:34:24.592 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.594+0000 7f1f2d864780 1 < canceled operation key=FFG41OYEYFZA tag=7HKTGW2K9MHI type=write size=947455 2024-09-12T00:34:24.593 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.595+0000 7f1f2d864780 1 > prepared operation key=FFG41OYEYFZA tag=07M25QL8T0K5 type=del size=1551746 2024-09-12T00:34:24.595 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.596+0000 7f1f2d864780 1 < completed delete operation key=2YCGIJRK6MUH tag=ON8HJU5Z5TOX type=del 2024-09-12T00:34:24.597 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.598+0000 7f1f2d864780 1 > prepared part key=_multipart_UTR2UUO6DHLJ.2~6B91IETVOWA3.0 size=1048576 2024-09-12T00:34:24.598 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.599+0000 7f1f2d864780 1 > prepared part key=_multipart_UTR2UUO6DHLJ.2~6B91IETVOWA3.1 size=644605 2024-09-12T00:34:24.598 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.599+0000 7f1f2d864780 1 > prepared multipart upload key=UTR2UUO6DHLJ upload=6B91IETVOWA3 tag=QYVX7JJFNSLO type=write size=2741757 2024-09-12T00:34:24.599 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.600+0000 7f1f2d864780 1 < canceled operation key=O1YY03BOEYLM tag=I0X15G5JFAAD type=del size=3284455 2024-09-12T00:34:24.601 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.602+0000 7f1f2d864780 1 > prepared part key=_multipart_FFG41OYEYFZA.2~1A1N16WP8UY6.0 size=600663 2024-09-12T00:34:24.601 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.602+0000 7f1f2d864780 1 > prepared multipart upload key=FFG41OYEYFZA upload=1A1N16WP8UY6 tag=53HGKP3ZVZFI type=write size=1649239 2024-09-12T00:34:24.602 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.604+0000 7f1f2d864780 1 < completed part key=_multipart_WKK747ETLW10.2~F8W2QM0LFNHD.0 size=1048576 2024-09-12T00:34:24.603 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.604+0000 7f1f2d864780 1 < completed part key=_multipart_WKK747ETLW10.2~F8W2QM0LFNHD.1 size=1048576 2024-09-12T00:34:24.604 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.605+0000 7f1f2d864780 1 < completed part key=_multipart_WKK747ETLW10.2~F8W2QM0LFNHD.2 size=470951 2024-09-12T00:34:24.606 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.607+0000 7f1f2d864780 1 < completed multipart upload key=WKK747ETLW10 upload=F8W2QM0LFNHD tag=UAO3XPLTNWY3 type=write size=3616679 2024-09-12T00:34:24.608 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.609+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~V8XFP58O79BR.0 size=807502 2024-09-12T00:34:24.608 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.609+0000 7f1f2d864780 1 > prepared multipart upload key=0DSQOFS8IIF5 upload=V8XFP58O79BR tag=VAEL3UE8SAL0 type=write size=1856078 2024-09-12T00:34:24.609 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.610+0000 7f1f2d864780 1 < completed delete operation key=ZYNIJH0TTSM6 tag=YN40HNDDW5AD type=del 2024-09-12T00:34:24.610 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.612+0000 7f1f2d864780 1 > prepared operation key=W6U30X4HJCB1 tag=144366RWH7EA type=write size=235052 2024-09-12T00:34:24.611 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.613+0000 7f1f2d864780 1 < canceled operation key=WGKEA4EKF5GP tag=A8KO6P8ESFX3 type=del size=1732207 2024-09-12T00:34:24.612 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.614+0000 7f1f2d864780 1 > prepared operation key=KHPF1N1MT33Z tag=9YJ7W42BZ91X type=del size=266517 2024-09-12T00:34:24.613 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.615+0000 7f1f2d864780 -1 < failed to complete operation key=UTR2UUO6DHLJ tag=SX5FE9C2RANG type=del size=2784392: (22) Invalid argument 2024-09-12T00:34:24.614 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.616+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=QJSLN82868W6 type=del size=1485766 2024-09-12T00:34:24.616 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.617+0000 7f1f2d864780 1 < completed part key=_multipart_4FRVL0KXN2X8.2~18SBKVU39TWN.0 size=1048576 2024-09-12T00:34:24.616 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.617+0000 7f1f2d864780 1 < canceled part key=_multipart_4FRVL0KXN2X8.2~18SBKVU39TWN.1 size=704112 2024-09-12T00:34:24.618 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.619+0000 7f1f2d864780 1 < canceled multipart upload key=4FRVL0KXN2X8 upload=18SBKVU39TWN tag=KU5KGWRKNSHK type=write size=2801264 2024-09-12T00:34:24.619 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.620+0000 7f1f2d864780 1 > prepared operation key=ECZYQEZ942W8 tag=FXAHLKP7JVDN type=del size=2761160 2024-09-12T00:34:24.621 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.623+0000 7f1f2d864780 1 < completed delete operation key=ZYNIJH0TTSM6 tag=O1G91B65GQEJ type=del 2024-09-12T00:34:24.622 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.624+0000 7f1f2d864780 1 > prepared operation key=D21W9QZWY0YU tag=BKXPURSPJ2YL type=del size=1581408 2024-09-12T00:34:24.624 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.625+0000 7f1f2d864780 1 < completed delete operation key=FAP6N3H7SBN0 tag=PW9K3H9XZT1N type=del 2024-09-12T00:34:24.625 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.627+0000 7f1f2d864780 1 > prepared operation key=ZGO887JDR627 tag=V0EY37Y8VGYR type=del size=2224968 2024-09-12T00:34:24.626 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.628+0000 7f1f2d864780 1 < completed part key=_multipart_OY145ZXRSF4L.2~V7NWRVC6AXFX.0 size=1048576 2024-09-12T00:34:24.627 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.629+0000 7f1f2d864780 1 < completed part key=_multipart_OY145ZXRSF4L.2~V7NWRVC6AXFX.1 size=1048576 2024-09-12T00:34:24.627 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.629+0000 7f1f2d864780 1 < canceled part key=_multipart_OY145ZXRSF4L.2~V7NWRVC6AXFX.2 size=17657 2024-09-12T00:34:24.629 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.631+0000 7f1f2d864780 1 < canceled multipart upload key=OY145ZXRSF4L upload=V7NWRVC6AXFX tag=MYGGGJB2M2YG type=write size=3163385 2024-09-12T00:34:24.631 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.633+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~V1K8GIZYQ7O3.0 size=1048576 2024-09-12T00:34:24.632 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.634+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~V1K8GIZYQ7O3.1 size=537265 2024-09-12T00:34:24.632 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.634+0000 7f1f2d864780 1 > prepared multipart upload key=W6U30X4HJCB1 upload=V1K8GIZYQ7O3 tag=UPYQNJQPTQ8N type=write size=2634417 2024-09-12T00:34:24.633 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.635+0000 7f1f2d864780 1 < completed part key=_multipart_FFG41OYEYFZA.2~QYE6K8BA88XU.0 size=1048576 2024-09-12T00:34:24.634 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.636+0000 7f1f2d864780 1 < completed part key=_multipart_FFG41OYEYFZA.2~QYE6K8BA88XU.1 size=1048576 2024-09-12T00:34:24.635 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.637+0000 7f1f2d864780 1 < completed part key=_multipart_FFG41OYEYFZA.2~QYE6K8BA88XU.2 size=136483 2024-09-12T00:34:24.638 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.640+0000 7f1f2d864780 1 < completed multipart upload key=FFG41OYEYFZA upload=QYE6K8BA88XU tag=RR0SG3M3IL4N type=write size=3282211 2024-09-12T00:34:24.640 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.642+0000 7f1f2d864780 1 > prepared part key=_multipart_PVB52GO6L8T4.2~0UJSXN1SGC4G.0 size=235694 2024-09-12T00:34:24.640 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.642+0000 7f1f2d864780 1 > prepared multipart upload key=PVB52GO6L8T4 upload=0UJSXN1SGC4G tag=CN316L0USRL6 type=write size=1284270 2024-09-12T00:34:24.643 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.645+0000 7f1f2d864780 1 < suggested update operation key=D21W9QZWY0YU tag=7GQNQ8LPPY6Z type=del size=2316300 2024-09-12T00:34:24.645 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.647+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~UDHWWK9AEJKT.0 size=1048576 2024-09-12T00:34:24.646 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.648+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~UDHWWK9AEJKT.1 size=157672 2024-09-12T00:34:24.646 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.648+0000 7f1f2d864780 1 > prepared multipart upload key=FAP6N3H7SBN0 upload=UDHWWK9AEJKT tag=34IRNZ655DA6 type=write size=2254824 2024-09-12T00:34:24.647 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.649+0000 7f1f2d864780 -1 < failed to complete operation key=2RV0899QUJ8W tag=QQ8T0RKY41CM type=del size=2176464: (22) Invalid argument 2024-09-12T00:34:24.649 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.650+0000 7f1f2d864780 1 > prepared operation key=3Z1TGGPZKJ69 tag=KDSHCLTNH04E type=write size=389066 2024-09-12T00:34:24.650 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.651+0000 7f1f2d864780 1 < completed part key=_multipart_2RV0899QUJ8W.2~6DN8BMKMBFO1.0 size=1048576 2024-09-12T00:34:24.651 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.652+0000 7f1f2d864780 1 < completed part key=_multipart_2RV0899QUJ8W.2~6DN8BMKMBFO1.1 size=1048576 2024-09-12T00:34:24.652 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.653+0000 7f1f2d864780 1 < completed part key=_multipart_2RV0899QUJ8W.2~6DN8BMKMBFO1.2 size=985434 2024-09-12T00:34:24.655 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.656+0000 7f1f2d864780 1 < completed multipart upload key=2RV0899QUJ8W upload=6DN8BMKMBFO1 tag=NK88HRD0W67R type=write size=4131162 2024-09-12T00:34:24.656 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.657+0000 7f1f2d864780 1 > prepared operation key=W6U30X4HJCB1 tag=KORKUPQ4CWWY type=write size=216628 2024-09-12T00:34:24.657 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.659+0000 7f1f2d864780 1 < completed part key=_multipart_DYKLAY6J018G.2~RVU3UU8HM86Y.0 size=219662 2024-09-12T00:34:24.659 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.661+0000 7f1f2d864780 1 < completed multipart upload key=DYKLAY6J018G upload=RVU3UU8HM86Y tag=HY7GXX77UKDQ type=write size=1268238 2024-09-12T00:34:24.660 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.662+0000 7f1f2d864780 1 > prepared operation key=AN26EVAZI527 tag=TI0VMTGTN7X5 type=del size=3717344 2024-09-12T00:34:24.661 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.663+0000 7f1f2d864780 1 < completed delete operation key=FFG41OYEYFZA tag=07M25QL8T0K5 type=del 2024-09-12T00:34:24.663 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.665+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~G2K0GZO13RLX.0 size=1048576 2024-09-12T00:34:24.664 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.666+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~G2K0GZO13RLX.1 size=1048211 2024-09-12T00:34:24.665 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.666+0000 7f1f2d864780 1 > prepared multipart upload key=1299IOSGYIO9 upload=G2K0GZO13RLX tag=TWV4M6VAR05E type=write size=3145363 2024-09-12T00:34:24.666 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.667+0000 7f1f2d864780 1 < completed part key=_multipart_UTR2UUO6DHLJ.2~6B91IETVOWA3.0 size=1048576 2024-09-12T00:34:24.666 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.668+0000 7f1f2d864780 1 < completed part key=_multipart_UTR2UUO6DHLJ.2~6B91IETVOWA3.1 size=644605 2024-09-12T00:34:24.668 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.670+0000 7f1f2d864780 1 < completed multipart upload key=UTR2UUO6DHLJ upload=6B91IETVOWA3 tag=QYVX7JJFNSLO type=write size=2741757 2024-09-12T00:34:24.670 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.671+0000 7f1f2d864780 1 > prepared operation key=1299IOSGYIO9 tag=F2Y8VV5F48JW type=del size=4088657 2024-09-12T00:34:24.671 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.673+0000 7f1f2d864780 1 < completed part key=_multipart_FFG41OYEYFZA.2~1A1N16WP8UY6.0 size=600663 2024-09-12T00:34:24.673 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.675+0000 7f1f2d864780 1 < completed multipart upload key=FFG41OYEYFZA upload=1A1N16WP8UY6 tag=53HGKP3ZVZFI type=write size=1649239 2024-09-12T00:34:24.674 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.676+0000 7f1f2d864780 1 > prepared operation key=FFG41OYEYFZA tag=T3TN3L8DBQAH type=del size=317960 2024-09-12T00:34:24.676 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.677+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~V8XFP58O79BR.0 size=807502 2024-09-12T00:34:24.678 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.679+0000 7f1f2d864780 1 < completed multipart upload key=0DSQOFS8IIF5 upload=V8XFP58O79BR tag=VAEL3UE8SAL0 type=write size=1856078 2024-09-12T00:34:24.679 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.681+0000 7f1f2d864780 1 > prepared operation key=W6U30X4HJCB1 tag=NXK7N70L2EDA type=del size=1125327 2024-09-12T00:34:24.681 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.682+0000 7f1f2d864780 1 < completed write operation key=W6U30X4HJCB1 tag=144366RWH7EA type=write size=235052 2024-09-12T00:34:24.682 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.684+0000 7f1f2d864780 1 > prepared part key=_multipart_FFG41OYEYFZA.2~9ZA32NJ0RQKV.0 size=736776 2024-09-12T00:34:24.683 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.684+0000 7f1f2d864780 1 > prepared multipart upload key=FFG41OYEYFZA upload=9ZA32NJ0RQKV tag=2F2A2J2RTHP2 type=write size=1785352 2024-09-12T00:34:24.685 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.687+0000 7f1f2d864780 1 < suggested update operation key=KHPF1N1MT33Z tag=9YJ7W42BZ91X type=del size=266517 2024-09-12T00:34:24.686 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.688+0000 7f1f2d864780 1 > prepared operation key=W6U30X4HJCB1 tag=FGTVTNHCMR8C type=write size=124857 2024-09-12T00:34:24.687 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.689+0000 7f1f2d864780 1 < completed delete operation key=2RV0899QUJ8W tag=QJSLN82868W6 type=del 2024-09-12T00:34:24.689 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.690+0000 7f1f2d864780 1 > prepared operation key=2YCGIJRK6MUH tag=XTXQOKB02G63 type=del size=1017800 2024-09-12T00:34:24.690 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.691+0000 7f1f2d864780 1 < completed delete operation key=ECZYQEZ942W8 tag=FXAHLKP7JVDN type=del 2024-09-12T00:34:24.691 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.693+0000 7f1f2d864780 1 > prepared operation key=ZGO887JDR627 tag=B2K9C2WLJ0YN type=del size=3459705 2024-09-12T00:34:24.692 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.694+0000 7f1f2d864780 -1 < failed to complete operation key=D21W9QZWY0YU tag=BKXPURSPJ2YL type=del size=1581408: (22) Invalid argument 2024-09-12T00:34:24.694 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.695+0000 7f1f2d864780 1 > prepared operation key=WGKEA4EKF5GP tag=L18K4Z46KMSB type=del size=3170890 2024-09-12T00:34:24.696 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.698+0000 7f1f2d864780 1 < suggested remove operation key=ZGO887JDR627 tag=V0EY37Y8VGYR type=del 2024-09-12T00:34:24.698 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.700+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~ZQH4OWX944V4.0 size=1048576 2024-09-12T00:34:24.699 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.701+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~ZQH4OWX944V4.1 size=1048576 2024-09-12T00:34:24.700 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.702+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~ZQH4OWX944V4.2 size=550840 2024-09-12T00:34:24.700 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.702+0000 7f1f2d864780 1 > prepared multipart upload key=D21W9QZWY0YU upload=ZQH4OWX944V4 tag=0OZN0FO3IT7E type=write size=3696568 2024-09-12T00:34:24.702 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.703+0000 7f1f2d864780 1 < completed part key=_multipart_W6U30X4HJCB1.2~V1K8GIZYQ7O3.0 size=1048576 2024-09-12T00:34:24.703 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.705+0000 7f1f2d864780 1 < completed part key=_multipart_W6U30X4HJCB1.2~V1K8GIZYQ7O3.1 size=537265 2024-09-12T00:34:24.705 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.707+0000 7f1f2d864780 1 < completed multipart upload key=W6U30X4HJCB1 upload=V1K8GIZYQ7O3 tag=UPYQNJQPTQ8N type=write size=2634417 2024-09-12T00:34:24.708 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.709+0000 7f1f2d864780 1 > prepared part key=_multipart_GSPM8N0K7ODC.2~DNM61EL9POM2.0 size=1048576 2024-09-12T00:34:24.709 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.710+0000 7f1f2d864780 1 > prepared part key=_multipart_GSPM8N0K7ODC.2~DNM61EL9POM2.1 size=568397 2024-09-12T00:34:24.709 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.710+0000 7f1f2d864780 1 > prepared multipart upload key=GSPM8N0K7ODC upload=DNM61EL9POM2 tag=4QQK4THOOMYB type=write size=2665549 2024-09-12T00:34:24.710 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.712+0000 7f1f2d864780 1 < completed part key=_multipart_PVB52GO6L8T4.2~0UJSXN1SGC4G.0 size=235694 2024-09-12T00:34:24.712 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.714+0000 7f1f2d864780 1 < completed multipart upload key=PVB52GO6L8T4 upload=0UJSXN1SGC4G tag=CN316L0USRL6 type=write size=1284270 2024-09-12T00:34:24.714 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.716+0000 7f1f2d864780 1 > prepared part key=_multipart_S5DVMA14N7VJ.2~B561V2GBZX5I.0 size=656205 2024-09-12T00:34:24.715 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.716+0000 7f1f2d864780 1 > prepared multipart upload key=S5DVMA14N7VJ upload=B561V2GBZX5I tag=NMAIU74BQLQL type=write size=1704781 2024-09-12T00:34:24.716 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.717+0000 7f1f2d864780 1 < completed part key=_multipart_FAP6N3H7SBN0.2~UDHWWK9AEJKT.0 size=1048576 2024-09-12T00:34:24.717 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.718+0000 7f1f2d864780 1 < completed part key=_multipart_FAP6N3H7SBN0.2~UDHWWK9AEJKT.1 size=157672 2024-09-12T00:34:24.719 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.721+0000 7f1f2d864780 1 < completed multipart upload key=FAP6N3H7SBN0 upload=UDHWWK9AEJKT tag=34IRNZ655DA6 type=write size=2254824 2024-09-12T00:34:24.720 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.722+0000 7f1f2d864780 1 > prepared operation key=0DSQOFS8IIF5 tag=0FEPD7KDL0BJ type=del size=1814298 2024-09-12T00:34:24.721 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.723+0000 7f1f2d864780 1 < completed write operation key=3Z1TGGPZKJ69 tag=KDSHCLTNH04E type=write size=389066 2024-09-12T00:34:24.724 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.725+0000 7f1f2d864780 1 > prepared part key=_multipart_S5DVMA14N7VJ.2~5IR99KXSLBEY.0 size=1048576 2024-09-12T00:34:24.726 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.727+0000 7f1f2d864780 1 > prepared part key=_multipart_S5DVMA14N7VJ.2~5IR99KXSLBEY.1 size=1048576 2024-09-12T00:34:24.727 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.728+0000 7f1f2d864780 1 > prepared part key=_multipart_S5DVMA14N7VJ.2~5IR99KXSLBEY.2 size=856132 2024-09-12T00:34:24.727 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.728+0000 7f1f2d864780 1 > prepared multipart upload key=S5DVMA14N7VJ upload=5IR99KXSLBEY tag=G62EM5CW8K4X type=write size=4001860 2024-09-12T00:34:24.728 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.730+0000 7f1f2d864780 1 < completed write operation key=W6U30X4HJCB1 tag=KORKUPQ4CWWY type=write size=216628 2024-09-12T00:34:24.729 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.731+0000 7f1f2d864780 1 > prepared operation key=WGKEA4EKF5GP tag=345BJ71L2EHX type=del size=2333947 2024-09-12T00:34:24.731 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.732+0000 7f1f2d864780 1 < canceled operation key=AN26EVAZI527 tag=TI0VMTGTN7X5 type=del size=3717344 2024-09-12T00:34:24.733 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.734+0000 7f1f2d864780 1 > prepared part key=_multipart_ZYNIJH0TTSM6.2~JF9AK5MDK110.0 size=1048576 2024-09-12T00:34:24.735 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.735+0000 7f1f2d864780 1 > prepared part key=_multipart_ZYNIJH0TTSM6.2~JF9AK5MDK110.1 size=1048576 2024-09-12T00:34:24.735 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.736+0000 7f1f2d864780 1 > prepared part key=_multipart_ZYNIJH0TTSM6.2~JF9AK5MDK110.2 size=458739 2024-09-12T00:34:24.735 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.736+0000 7f1f2d864780 1 > prepared multipart upload key=ZYNIJH0TTSM6 upload=JF9AK5MDK110 tag=A77HNPEARUCA type=write size=3604467 2024-09-12T00:34:24.736 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.737+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~G2K0GZO13RLX.0 size=1048576 2024-09-12T00:34:24.738 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.739+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~G2K0GZO13RLX.1 size=1048211 2024-09-12T00:34:24.740 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.742+0000 7f1f2d864780 1 < completed multipart upload key=1299IOSGYIO9 upload=G2K0GZO13RLX tag=TWV4M6VAR05E type=write size=3145363 2024-09-12T00:34:24.742 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.743+0000 7f1f2d864780 1 > prepared operation key=D21W9QZWY0YU tag=WY4GX4TX7XL1 type=del size=1342128 2024-09-12T00:34:24.743 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.744+0000 7f1f2d864780 1 < completed delete operation key=1299IOSGYIO9 tag=F2Y8VV5F48JW type=del 2024-09-12T00:34:24.745 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.747+0000 7f1f2d864780 1 > prepared part key=_multipart_WKK747ETLW10.2~7VNVOJNUQS1H.0 size=515604 2024-09-12T00:34:24.745 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.747+0000 7f1f2d864780 1 > prepared multipart upload key=WKK747ETLW10 upload=7VNVOJNUQS1H tag=CY7X3XWPT2IL type=write size=1564180 2024-09-12T00:34:24.746 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.748+0000 7f1f2d864780 1 < completed delete operation key=FFG41OYEYFZA tag=T3TN3L8DBQAH type=del 2024-09-12T00:34:24.747 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.749+0000 7f1f2d864780 1 > prepared operation key=2YCGIJRK6MUH tag=XBSUGJI1OP1C type=del size=173270 2024-09-12T00:34:24.749 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.750+0000 7f1f2d864780 1 < completed delete operation key=W6U30X4HJCB1 tag=NXK7N70L2EDA type=del 2024-09-12T00:34:24.750 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.751+0000 7f1f2d864780 1 > prepared operation key=PVB52GO6L8T4 tag=2ZZDAM3S938Y type=del size=3784474 2024-09-12T00:34:24.751 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.753+0000 7f1f2d864780 1 < completed part key=_multipart_FFG41OYEYFZA.2~9ZA32NJ0RQKV.0 size=736776 2024-09-12T00:34:24.753 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.755+0000 7f1f2d864780 1 < completed multipart upload key=FFG41OYEYFZA upload=9ZA32NJ0RQKV tag=2F2A2J2RTHP2 type=write size=1785352 2024-09-12T00:34:24.754 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.756+0000 7f1f2d864780 1 > prepared operation key=0DSQOFS8IIF5 tag=GSO7WIQ5D73X type=del size=976482 2024-09-12T00:34:24.757 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.758+0000 7f1f2d864780 1 < suggested remove operation key=W6U30X4HJCB1 tag=FGTVTNHCMR8C type=write 2024-09-12T00:34:24.758 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.760+0000 7f1f2d864780 1 > prepared operation key=S5DVMA14N7VJ tag=F1XO2Q1CPVKG type=del size=60156 2024-09-12T00:34:24.759 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.761+0000 7f1f2d864780 1 < completed delete operation key=2YCGIJRK6MUH tag=XTXQOKB02G63 type=del 2024-09-12T00:34:24.761 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.763+0000 7f1f2d864780 1 > prepared part key=_multipart_DYKLAY6J018G.2~FCMNF9HS8NFU.0 size=376514 2024-09-12T00:34:24.761 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.763+0000 7f1f2d864780 1 > prepared multipart upload key=DYKLAY6J018G upload=FCMNF9HS8NFU tag=KTQVIZZF0W1X type=write size=1425090 2024-09-12T00:34:24.763 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.764+0000 7f1f2d864780 -1 < failed to complete operation key=ZGO887JDR627 tag=B2K9C2WLJ0YN type=del size=3459705: (22) Invalid argument 2024-09-12T00:34:24.764 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.766+0000 7f1f2d864780 1 > prepared operation key=1299IOSGYIO9 tag=NM81HIS052IA type=del size=1437567 2024-09-12T00:34:24.766 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.768+0000 7f1f2d864780 1 < suggested remove operation key=WGKEA4EKF5GP tag=L18K4Z46KMSB type=del 2024-09-12T00:34:24.767 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.769+0000 7f1f2d864780 1 > prepared operation key=W6U30X4HJCB1 tag=ZJRUDWWNMYQ4 type=del size=331780 2024-09-12T00:34:24.769 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.770+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~ZQH4OWX944V4.0 size=1048576 2024-09-12T00:34:24.770 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.771+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~ZQH4OWX944V4.1 size=1048576 2024-09-12T00:34:24.771 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.772+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~ZQH4OWX944V4.2 size=550840 2024-09-12T00:34:24.773 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.774+0000 7f1f2d864780 1 < completed multipart upload key=D21W9QZWY0YU upload=ZQH4OWX944V4 tag=0OZN0FO3IT7E type=write size=3696568 2024-09-12T00:34:24.774 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.775+0000 7f1f2d864780 1 > prepared operation key=4FRVL0KXN2X8 tag=X35W2SBWH8K0 type=write size=10213 2024-09-12T00:34:24.775 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.777+0000 7f1f2d864780 1 < completed part key=_multipart_GSPM8N0K7ODC.2~DNM61EL9POM2.0 size=1048576 2024-09-12T00:34:24.776 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.778+0000 7f1f2d864780 1 < completed part key=_multipart_GSPM8N0K7ODC.2~DNM61EL9POM2.1 size=568397 2024-09-12T00:34:24.778 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.780+0000 7f1f2d864780 1 < completed multipart upload key=GSPM8N0K7ODC upload=DNM61EL9POM2 tag=4QQK4THOOMYB type=write size=2665549 2024-09-12T00:34:24.779 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.781+0000 7f1f2d864780 1 > prepared operation key=PVB52GO6L8T4 tag=NPI0KVDX25WC type=del size=1997407 2024-09-12T00:34:24.780 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.782+0000 7f1f2d864780 1 < completed part key=_multipart_S5DVMA14N7VJ.2~B561V2GBZX5I.0 size=656205 2024-09-12T00:34:24.782 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.784+0000 7f1f2d864780 1 < completed multipart upload key=S5DVMA14N7VJ upload=B561V2GBZX5I tag=NMAIU74BQLQL type=write size=1704781 2024-09-12T00:34:24.784 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.786+0000 7f1f2d864780 1 > prepared operation key=WIIU8VTCLWOD tag=JLN1ZW2GU45T type=write size=290951 2024-09-12T00:34:24.786 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.787+0000 7f1f2d864780 1 < completed delete operation key=0DSQOFS8IIF5 tag=0FEPD7KDL0BJ type=del 2024-09-12T00:34:24.787 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.789+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=DJQHNCUMWIM2 type=del size=3120258 2024-09-12T00:34:24.789 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.790+0000 7f1f2d864780 1 < completed part key=_multipart_S5DVMA14N7VJ.2~5IR99KXSLBEY.0 size=1048576 2024-09-12T00:34:24.789 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.791+0000 7f1f2d864780 1 < completed part key=_multipart_S5DVMA14N7VJ.2~5IR99KXSLBEY.1 size=1048576 2024-09-12T00:34:24.790 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.792+0000 7f1f2d864780 1 < completed part key=_multipart_S5DVMA14N7VJ.2~5IR99KXSLBEY.2 size=856132 2024-09-12T00:34:24.792 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.794+0000 7f1f2d864780 1 < completed multipart upload key=S5DVMA14N7VJ upload=5IR99KXSLBEY tag=G62EM5CW8K4X type=write size=4001860 2024-09-12T00:34:24.795 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.796+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~NEG0XSRN25U7.0 size=1048576 2024-09-12T00:34:24.795 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.797+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~NEG0XSRN25U7.1 size=1048576 2024-09-12T00:34:24.796 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.798+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~NEG0XSRN25U7.2 size=1027418 2024-09-12T00:34:24.797 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.798+0000 7f1f2d864780 1 > prepared multipart upload key=SZP418NVZ5VX upload=NEG0XSRN25U7 tag=M9B3SP38GQZL type=write size=4173146 2024-09-12T00:34:24.798 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.799+0000 7f1f2d864780 -1 < failed to complete operation key=WGKEA4EKF5GP tag=345BJ71L2EHX type=del size=2333947: (22) Invalid argument 2024-09-12T00:34:24.799 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.801+0000 7f1f2d864780 1 > prepared operation key=SNCGB6Z20450 tag=19H9LF3P8182 type=write size=945275 2024-09-12T00:34:24.800 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.802+0000 7f1f2d864780 1 < completed part key=_multipart_ZYNIJH0TTSM6.2~JF9AK5MDK110.0 size=1048576 2024-09-12T00:34:24.801 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.803+0000 7f1f2d864780 1 < completed part key=_multipart_ZYNIJH0TTSM6.2~JF9AK5MDK110.1 size=1048576 2024-09-12T00:34:24.802 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.803+0000 7f1f2d864780 1 < completed part key=_multipart_ZYNIJH0TTSM6.2~JF9AK5MDK110.2 size=458739 2024-09-12T00:34:24.804 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.805+0000 7f1f2d864780 1 < completed multipart upload key=ZYNIJH0TTSM6 upload=JF9AK5MDK110 tag=A77HNPEARUCA type=write size=3604467 2024-09-12T00:34:24.805 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.806+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=GWSGEGPTPKUK type=del size=856070 2024-09-12T00:34:24.806 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.808+0000 7f1f2d864780 1 < completed delete operation key=D21W9QZWY0YU tag=WY4GX4TX7XL1 type=del 2024-09-12T00:34:24.807 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.809+0000 7f1f2d864780 1 > prepared operation key=O1YY03BOEYLM tag=JZFVR0617AZX type=write size=560159 2024-09-12T00:34:24.808 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.810+0000 7f1f2d864780 1 < completed part key=_multipart_WKK747ETLW10.2~7VNVOJNUQS1H.0 size=515604 2024-09-12T00:34:24.810 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.812+0000 7f1f2d864780 1 < completed multipart upload key=WKK747ETLW10 upload=7VNVOJNUQS1H tag=CY7X3XWPT2IL type=write size=1564180 2024-09-12T00:34:24.811 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.813+0000 7f1f2d864780 1 > prepared operation key=4FRVL0KXN2X8 tag=Y1BV41ODWDGV type=del size=2138537 2024-09-12T00:34:24.812 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.814+0000 7f1f2d864780 1 < completed delete operation key=2YCGIJRK6MUH tag=XBSUGJI1OP1C type=del 2024-09-12T00:34:24.813 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.815+0000 7f1f2d864780 1 > prepared operation key=FFG41OYEYFZA tag=UOTZVTAWWXDS type=del size=297819 2024-09-12T00:34:24.815 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.816+0000 7f1f2d864780 1 < canceled operation key=PVB52GO6L8T4 tag=2ZZDAM3S938Y type=del size=3784474 2024-09-12T00:34:24.816 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.817+0000 7f1f2d864780 1 > prepared operation key=W6U30X4HJCB1 tag=JAR0WN0KI0WK type=del size=2040327 2024-09-12T00:34:24.817 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.819+0000 7f1f2d864780 1 < completed delete operation key=0DSQOFS8IIF5 tag=GSO7WIQ5D73X type=del 2024-09-12T00:34:24.819 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.821+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~QOJ195B4EL65.0 size=1048576 2024-09-12T00:34:24.820 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.821+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~QOJ195B4EL65.1 size=31033 2024-09-12T00:34:24.820 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.821+0000 7f1f2d864780 1 > prepared multipart upload key=D21W9QZWY0YU upload=QOJ195B4EL65 tag=BCNFPPPFVWMF type=write size=2128185 2024-09-12T00:34:24.822 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.824+0000 7f1f2d864780 1 < suggested update operation key=S5DVMA14N7VJ tag=F1XO2Q1CPVKG type=del size=60156 2024-09-12T00:34:24.823 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.825+0000 7f1f2d864780 1 > prepared operation key=PVB52GO6L8T4 tag=B7HDAOJH79SQ type=del size=858398 2024-09-12T00:34:24.825 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.826+0000 7f1f2d864780 1 < completed part key=_multipart_DYKLAY6J018G.2~FCMNF9HS8NFU.0 size=376514 2024-09-12T00:34:24.826 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.828+0000 7f1f2d864780 1 < completed multipart upload key=DYKLAY6J018G upload=FCMNF9HS8NFU tag=KTQVIZZF0W1X type=write size=1425090 2024-09-12T00:34:24.828 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.829+0000 7f1f2d864780 1 > prepared operation key=ECZYQEZ942W8 tag=2IMCTIDJJ9XH type=del size=4166193 2024-09-12T00:34:24.829 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.830+0000 7f1f2d864780 1 < completed delete operation key=1299IOSGYIO9 tag=NM81HIS052IA type=del 2024-09-12T00:34:24.831 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.832+0000 7f1f2d864780 1 > prepared part key=_multipart_FFG41OYEYFZA.2~QB84C5RL8COJ.0 size=1048576 2024-09-12T00:34:24.832 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.833+0000 7f1f2d864780 1 > prepared part key=_multipart_FFG41OYEYFZA.2~QB84C5RL8COJ.1 size=1048576 2024-09-12T00:34:24.833 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.834+0000 7f1f2d864780 1 > prepared part key=_multipart_FFG41OYEYFZA.2~QB84C5RL8COJ.2 size=322247 2024-09-12T00:34:24.833 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.834+0000 7f1f2d864780 1 > prepared multipart upload key=FFG41OYEYFZA upload=QB84C5RL8COJ tag=YDEOSJ67Y40O type=write size=3467975 2024-09-12T00:34:24.834 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.836+0000 7f1f2d864780 1 < completed delete operation key=W6U30X4HJCB1 tag=ZJRUDWWNMYQ4 type=del 2024-09-12T00:34:24.835 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.837+0000 7f1f2d864780 1 > prepared operation key=3Z1TGGPZKJ69 tag=8HX2GHZRJ7FJ type=del size=1655956 2024-09-12T00:34:24.836 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.838+0000 7f1f2d864780 1 < completed write operation key=4FRVL0KXN2X8 tag=X35W2SBWH8K0 type=write size=10213 2024-09-12T00:34:24.837 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.839+0000 7f1f2d864780 1 > prepared operation key=53QCNWX1V1R1 tag=8HJ7JISLLLYU type=del size=3824977 2024-09-12T00:34:24.840 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.841+0000 7f1f2d864780 1 < suggested update operation key=PVB52GO6L8T4 tag=NPI0KVDX25WC type=del size=1997407 2024-09-12T00:34:24.841 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.843+0000 7f1f2d864780 1 > prepared operation key=OY145ZXRSF4L tag=6GWQ6EPYH3O1 type=write size=305382 2024-09-12T00:34:24.842 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.844+0000 7f1f2d864780 1 < completed write operation key=WIIU8VTCLWOD tag=JLN1ZW2GU45T type=write size=290951 2024-09-12T00:34:24.843 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.845+0000 7f1f2d864780 1 > prepared operation key=FAP6N3H7SBN0 tag=KA550Y9L5M2M type=del size=3460133 2024-09-12T00:34:24.845 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.846+0000 7f1f2d864780 1 < canceled operation key=2RV0899QUJ8W tag=DJQHNCUMWIM2 type=del size=3120258 2024-09-12T00:34:24.847 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.848+0000 7f1f2d864780 1 > prepared part key=_multipart_PVB52GO6L8T4.2~LTL8B92JLJKP.0 size=1048576 2024-09-12T00:34:24.847 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.849+0000 7f1f2d864780 1 > prepared part key=_multipart_PVB52GO6L8T4.2~LTL8B92JLJKP.1 size=235172 2024-09-12T00:34:24.847 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.849+0000 7f1f2d864780 1 > prepared multipart upload key=PVB52GO6L8T4 upload=LTL8B92JLJKP tag=MWFL2QORDFJE type=write size=2332324 2024-09-12T00:34:24.849 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.850+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~NEG0XSRN25U7.0 size=1048576 2024-09-12T00:34:24.851 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.852+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~NEG0XSRN25U7.1 size=1048576 2024-09-12T00:34:24.851 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.852+0000 7f1f2d864780 1 < canceled part key=_multipart_SZP418NVZ5VX.2~NEG0XSRN25U7.2 size=1027418 2024-09-12T00:34:24.853 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.854+0000 7f1f2d864780 1 < canceled multipart upload key=SZP418NVZ5VX upload=NEG0XSRN25U7 tag=M9B3SP38GQZL type=write size=4173146 2024-09-12T00:34:24.854 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.856+0000 7f1f2d864780 1 > prepared part key=_multipart_ZGO887JDR627.2~734E2P4RGRXG.0 size=614702 2024-09-12T00:34:24.855 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.856+0000 7f1f2d864780 1 > prepared multipart upload key=ZGO887JDR627 upload=734E2P4RGRXG tag=FXPULVDRLQEZ type=write size=1663278 2024-09-12T00:34:24.856 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.857+0000 7f1f2d864780 1 < completed write operation key=SNCGB6Z20450 tag=19H9LF3P8182 type=write size=945275 2024-09-12T00:34:24.858 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.859+0000 7f1f2d864780 1 > prepared part key=_multipart_UTR2UUO6DHLJ.2~73IMM1J83MHT.0 size=1048576 2024-09-12T00:34:24.859 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.860+0000 7f1f2d864780 1 > prepared part key=_multipart_UTR2UUO6DHLJ.2~73IMM1J83MHT.1 size=571132 2024-09-12T00:34:24.859 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.860+0000 7f1f2d864780 1 > prepared multipart upload key=UTR2UUO6DHLJ upload=73IMM1J83MHT tag=WC3YDF8A83UB type=write size=2668284 2024-09-12T00:34:24.861 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.862+0000 7f1f2d864780 1 < suggested update operation key=2RV0899QUJ8W tag=GWSGEGPTPKUK type=del size=856070 2024-09-12T00:34:24.862 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.864+0000 7f1f2d864780 1 > prepared operation key=2G3UCYG4R4NM tag=E0D5O0OLTMWX type=del size=3863796 2024-09-12T00:34:24.863 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.865+0000 7f1f2d864780 1 < completed write operation key=O1YY03BOEYLM tag=JZFVR0617AZX type=write size=560159 2024-09-12T00:34:24.865 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.866+0000 7f1f2d864780 1 > prepared operation key=UTR2UUO6DHLJ tag=4PFV6QB9EH8T type=del size=2569051 2024-09-12T00:34:24.866 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.867+0000 7f1f2d864780 1 < completed delete operation key=4FRVL0KXN2X8 tag=Y1BV41ODWDGV type=del 2024-09-12T00:34:24.868 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.870+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~1OVA4HKYE00A.0 size=1048576 2024-09-12T00:34:24.869 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.871+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~1OVA4HKYE00A.1 size=1048576 2024-09-12T00:34:24.870 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.872+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~1OVA4HKYE00A.2 size=271233 2024-09-12T00:34:24.870 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.872+0000 7f1f2d864780 1 > prepared multipart upload key=W6U30X4HJCB1 upload=1OVA4HKYE00A tag=R1Y2W3YU5SQW type=write size=3416961 2024-09-12T00:34:24.871 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.873+0000 7f1f2d864780 1 < completed delete operation key=FFG41OYEYFZA tag=UOTZVTAWWXDS type=del 2024-09-12T00:34:24.872 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.874+0000 7f1f2d864780 1 > prepared operation key=4FRVL0KXN2X8 tag=06VE9V8LLBMZ type=del size=1557326 2024-09-12T00:34:24.874 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.876+0000 7f1f2d864780 1 < suggested update operation key=W6U30X4HJCB1 tag=JAR0WN0KI0WK type=del size=2040327 2024-09-12T00:34:24.876 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.877+0000 7f1f2d864780 1 > prepared operation key=KHPF1N1MT33Z tag=SJ1WDSKLAGZS type=del size=2368027 2024-09-12T00:34:24.877 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.878+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~QOJ195B4EL65.0 size=1048576 2024-09-12T00:34:24.878 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.879+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~QOJ195B4EL65.1 size=31033 2024-09-12T00:34:24.880 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.881+0000 7f1f2d864780 1 < completed multipart upload key=D21W9QZWY0YU upload=QOJ195B4EL65 tag=BCNFPPPFVWMF type=write size=2128185 2024-09-12T00:34:24.881 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.882+0000 7f1f2d864780 1 > prepared operation key=1299IOSGYIO9 tag=KQ4UKYRKC2NC type=del size=795497 2024-09-12T00:34:24.882 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.883+0000 7f1f2d864780 -1 < failed to complete operation key=PVB52GO6L8T4 tag=B7HDAOJH79SQ type=del size=858398: (22) Invalid argument 2024-09-12T00:34:24.883 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.884+0000 7f1f2d864780 1 > prepared operation key=S5DVMA14N7VJ tag=XKL6ESDZ79ON type=del size=970991 2024-09-12T00:34:24.885 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.887+0000 7f1f2d864780 1 < suggested remove operation key=ECZYQEZ942W8 tag=2IMCTIDJJ9XH type=del 2024-09-12T00:34:24.886 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.888+0000 7f1f2d864780 1 > prepared operation key=ECZYQEZ942W8 tag=PQ123A553IQ9 type=del size=3760398 2024-09-12T00:34:24.887 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.889+0000 7f1f2d864780 1 < completed part key=_multipart_FFG41OYEYFZA.2~QB84C5RL8COJ.0 size=1048576 2024-09-12T00:34:24.888 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.890+0000 7f1f2d864780 1 < completed part key=_multipart_FFG41OYEYFZA.2~QB84C5RL8COJ.1 size=1048576 2024-09-12T00:34:24.889 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.890+0000 7f1f2d864780 1 < completed part key=_multipart_FFG41OYEYFZA.2~QB84C5RL8COJ.2 size=322247 2024-09-12T00:34:24.891 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.892+0000 7f1f2d864780 1 < completed multipart upload key=FFG41OYEYFZA upload=QB84C5RL8COJ tag=YDEOSJ67Y40O type=write size=3467975 2024-09-12T00:34:24.892 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.893+0000 7f1f2d864780 1 > prepared operation key=UTR2UUO6DHLJ tag=03J13CFX217D type=del size=778845 2024-09-12T00:34:24.893 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.894+0000 7f1f2d864780 1 < completed delete operation key=3Z1TGGPZKJ69 tag=8HX2GHZRJ7FJ type=del 2024-09-12T00:34:24.894 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.896+0000 7f1f2d864780 1 > prepared operation key=4FRVL0KXN2X8 tag=RA58TNKA985Y type=del size=267433 2024-09-12T00:34:24.895 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.897+0000 7f1f2d864780 1 < completed delete operation key=53QCNWX1V1R1 tag=8HJ7JISLLLYU type=del 2024-09-12T00:34:24.896 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.898+0000 7f1f2d864780 1 > prepared operation key=S5DVMA14N7VJ tag=2D18R33MLE5L type=write size=594344 2024-09-12T00:34:24.897 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.899+0000 7f1f2d864780 1 < completed write operation key=OY145ZXRSF4L tag=6GWQ6EPYH3O1 type=write size=305382 2024-09-12T00:34:24.899 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.901+0000 7f1f2d864780 1 > prepared part key=_multipart_SNCGB6Z20450.2~IRF08WZU258C.0 size=633002 2024-09-12T00:34:24.899 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.901+0000 7f1f2d864780 1 > prepared multipart upload key=SNCGB6Z20450 upload=IRF08WZU258C tag=J2735RCH3RJV type=write size=1681578 2024-09-12T00:34:24.900 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.902+0000 7f1f2d864780 1 < canceled operation key=FAP6N3H7SBN0 tag=KA550Y9L5M2M type=del size=3460133 2024-09-12T00:34:24.902 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.904+0000 7f1f2d864780 1 > prepared part key=_multipart_O1YY03BOEYLM.2~71OHAMLX6QCE.0 size=201761 2024-09-12T00:34:24.902 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.904+0000 7f1f2d864780 1 > prepared multipart upload key=O1YY03BOEYLM upload=71OHAMLX6QCE tag=IAGQ3VATZMQO type=write size=1250337 2024-09-12T00:34:24.903 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.905+0000 7f1f2d864780 1 < completed part key=_multipart_PVB52GO6L8T4.2~LTL8B92JLJKP.0 size=1048576 2024-09-12T00:34:24.904 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.906+0000 7f1f2d864780 1 < completed part key=_multipart_PVB52GO6L8T4.2~LTL8B92JLJKP.1 size=235172 2024-09-12T00:34:24.906 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.907+0000 7f1f2d864780 1 < completed multipart upload key=PVB52GO6L8T4 upload=LTL8B92JLJKP tag=MWFL2QORDFJE type=write size=2332324 2024-09-12T00:34:24.908 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.909+0000 7f1f2d864780 1 > prepared part key=_multipart_OY145ZXRSF4L.2~02JVQ9X8RB8B.0 size=1048576 2024-09-12T00:34:24.909 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.910+0000 7f1f2d864780 1 > prepared part key=_multipart_OY145ZXRSF4L.2~02JVQ9X8RB8B.1 size=234679 2024-09-12T00:34:24.909 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.910+0000 7f1f2d864780 1 > prepared multipart upload key=OY145ZXRSF4L upload=02JVQ9X8RB8B tag=SXVYJ6IS2Y93 type=write size=2331831 2024-09-12T00:34:24.910 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.911+0000 7f1f2d864780 1 < completed part key=_multipart_ZGO887JDR627.2~734E2P4RGRXG.0 size=614702 2024-09-12T00:34:24.912 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.913+0000 7f1f2d864780 1 < completed multipart upload key=ZGO887JDR627 upload=734E2P4RGRXG tag=FXPULVDRLQEZ type=write size=1663278 2024-09-12T00:34:24.913 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.914+0000 7f1f2d864780 1 > prepared operation key=SNCGB6Z20450 tag=8L3NS2DUHTL9 type=del size=2508735 2024-09-12T00:34:24.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.916+0000 7f1f2d864780 1 < completed part key=_multipart_UTR2UUO6DHLJ.2~73IMM1J83MHT.0 size=1048576 2024-09-12T00:34:24.915 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.917+0000 7f1f2d864780 1 < completed part key=_multipart_UTR2UUO6DHLJ.2~73IMM1J83MHT.1 size=571132 2024-09-12T00:34:24.917 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.919+0000 7f1f2d864780 1 < completed multipart upload key=UTR2UUO6DHLJ upload=73IMM1J83MHT tag=WC3YDF8A83UB type=write size=2668284 2024-09-12T00:34:24.918 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.920+0000 7f1f2d864780 1 > prepared operation key=AN26EVAZI527 tag=KF8K6D7Q0FUK type=del size=2254882 2024-09-12T00:34:24.919 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.921+0000 7f1f2d864780 1 < completed delete operation key=2G3UCYG4R4NM tag=E0D5O0OLTMWX type=del 2024-09-12T00:34:24.920 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.922+0000 7f1f2d864780 1 > prepared operation key=ZGO887JDR627 tag=9L3X9IG9PTZV type=del size=4140971 2024-09-12T00:34:24.922 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.923+0000 7f1f2d864780 1 < completed delete operation key=UTR2UUO6DHLJ tag=4PFV6QB9EH8T type=del 2024-09-12T00:34:24.923 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.925+0000 7f1f2d864780 1 > prepared operation key=WGKEA4EKF5GP tag=7V502Z1I490W type=del size=3054535 2024-09-12T00:34:24.924 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.926+0000 7f1f2d864780 1 < completed part key=_multipart_W6U30X4HJCB1.2~1OVA4HKYE00A.0 size=1048576 2024-09-12T00:34:24.925 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.927+0000 7f1f2d864780 1 < completed part key=_multipart_W6U30X4HJCB1.2~1OVA4HKYE00A.1 size=1048576 2024-09-12T00:34:24.926 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.928+0000 7f1f2d864780 1 < completed part key=_multipart_W6U30X4HJCB1.2~1OVA4HKYE00A.2 size=271233 2024-09-12T00:34:24.928 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.930+0000 7f1f2d864780 1 < completed multipart upload key=W6U30X4HJCB1 upload=1OVA4HKYE00A tag=R1Y2W3YU5SQW type=write size=3416961 2024-09-12T00:34:24.930 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.932+0000 7f1f2d864780 1 > prepared part key=_multipart_2RV0899QUJ8W.2~K337RQK3LJW2.0 size=1048576 2024-09-12T00:34:24.931 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.933+0000 7f1f2d864780 1 > prepared part key=_multipart_2RV0899QUJ8W.2~K337RQK3LJW2.1 size=1048576 2024-09-12T00:34:24.932 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.934+0000 7f1f2d864780 1 > prepared part key=_multipart_2RV0899QUJ8W.2~K337RQK3LJW2.2 size=302823 2024-09-12T00:34:24.932 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.934+0000 7f1f2d864780 1 > prepared multipart upload key=2RV0899QUJ8W upload=K337RQK3LJW2 tag=7GTW36LVJIEJ type=write size=3448551 2024-09-12T00:34:24.933 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.935+0000 7f1f2d864780 1 < completed delete operation key=4FRVL0KXN2X8 tag=06VE9V8LLBMZ type=del 2024-09-12T00:34:24.934 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.936+0000 7f1f2d864780 1 > prepared operation key=2YCGIJRK6MUH tag=73J5NN3N601K type=del size=4065293 2024-09-12T00:34:24.937 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.938+0000 7f1f2d864780 1 < suggested remove operation key=KHPF1N1MT33Z tag=SJ1WDSKLAGZS type=del 2024-09-12T00:34:24.938 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.939+0000 7f1f2d864780 1 > prepared operation key=WIIU8VTCLWOD tag=65APD7M4IJ5C type=del size=1108362 2024-09-12T00:34:24.939 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.941+0000 7f1f2d864780 1 < completed delete operation key=1299IOSGYIO9 tag=KQ4UKYRKC2NC type=del 2024-09-12T00:34:24.940 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.942+0000 7f1f2d864780 1 > prepared operation key=AN26EVAZI527 tag=F6PCK70BIXKV type=del size=951312 2024-09-12T00:34:24.941 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.943+0000 7f1f2d864780 1 < completed delete operation key=S5DVMA14N7VJ tag=XKL6ESDZ79ON type=del 2024-09-12T00:34:24.943 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.944+0000 7f1f2d864780 1 > prepared operation key=3Z1TGGPZKJ69 tag=JK3GKNVUYCF3 type=write size=772630 2024-09-12T00:34:24.944 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.946+0000 7f1f2d864780 1 < completed delete operation key=ECZYQEZ942W8 tag=PQ123A553IQ9 type=del 2024-09-12T00:34:24.945 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.947+0000 7f1f2d864780 1 > prepared operation key=AN26EVAZI527 tag=6N88BFTEWB44 type=del size=896395 2024-09-12T00:34:24.946 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.948+0000 7f1f2d864780 1 < completed delete operation key=UTR2UUO6DHLJ tag=03J13CFX217D type=del 2024-09-12T00:34:24.947 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.949+0000 7f1f2d864780 1 > prepared operation key=W6U30X4HJCB1 tag=GK4FSX618XCS type=write size=216953 2024-09-12T00:34:24.949 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.950+0000 7f1f2d864780 1 < completed delete operation key=4FRVL0KXN2X8 tag=RA58TNKA985Y type=del 2024-09-12T00:34:24.951 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.952+0000 7f1f2d864780 1 > prepared part key=_multipart_SNCGB6Z20450.2~5BGV0UZVSPO5.0 size=1048576 2024-09-12T00:34:24.951 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.953+0000 7f1f2d864780 1 > prepared part key=_multipart_SNCGB6Z20450.2~5BGV0UZVSPO5.1 size=1048576 2024-09-12T00:34:24.952 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.954+0000 7f1f2d864780 1 > prepared part key=_multipart_SNCGB6Z20450.2~5BGV0UZVSPO5.2 size=946350 2024-09-12T00:34:24.952 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.954+0000 7f1f2d864780 1 > prepared multipart upload key=SNCGB6Z20450 upload=5BGV0UZVSPO5 tag=MBI4HJ1DELG8 type=write size=4092078 2024-09-12T00:34:24.954 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.955+0000 7f1f2d864780 1 < completed write operation key=S5DVMA14N7VJ tag=2D18R33MLE5L type=write size=594344 2024-09-12T00:34:24.955 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.957+0000 7f1f2d864780 1 > prepared operation key=GSPM8N0K7ODC tag=QVIBEWZQF5QS type=del size=3076319 2024-09-12T00:34:24.955 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.957+0000 7f1f2d864780 1 < canceled part key=_multipart_SNCGB6Z20450.2~IRF08WZU258C.0 size=633002 2024-09-12T00:34:24.959 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.960+0000 7f1f2d864780 1 < canceled multipart upload key=SNCGB6Z20450 upload=IRF08WZU258C tag=J2735RCH3RJV type=write size=1681578 2024-09-12T00:34:24.960 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.961+0000 7f1f2d864780 1 > prepared operation key=FFG41OYEYFZA tag=SS04P8GZFE66 type=del size=548092 2024-09-12T00:34:24.961 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.963+0000 7f1f2d864780 1 < completed part key=_multipart_O1YY03BOEYLM.2~71OHAMLX6QCE.0 size=201761 2024-09-12T00:34:24.963 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.965+0000 7f1f2d864780 1 < completed multipart upload key=O1YY03BOEYLM upload=71OHAMLX6QCE tag=IAGQ3VATZMQO type=write size=1250337 2024-09-12T00:34:24.965 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.967+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~SFVDCUXYM703.0 size=1048576 2024-09-12T00:34:24.966 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.968+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~SFVDCUXYM703.1 size=1048576 2024-09-12T00:34:24.967 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.969+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~SFVDCUXYM703.2 size=262951 2024-09-12T00:34:24.967 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.969+0000 7f1f2d864780 1 > prepared multipart upload key=D21W9QZWY0YU upload=SFVDCUXYM703 tag=15GB6APLM6BS type=write size=3408679 2024-09-12T00:34:24.968 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.970+0000 7f1f2d864780 1 < completed part key=_multipart_OY145ZXRSF4L.2~02JVQ9X8RB8B.0 size=1048576 2024-09-12T00:34:24.969 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.971+0000 7f1f2d864780 1 < completed part key=_multipart_OY145ZXRSF4L.2~02JVQ9X8RB8B.1 size=234679 2024-09-12T00:34:24.971 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.973+0000 7f1f2d864780 1 < completed multipart upload key=OY145ZXRSF4L upload=02JVQ9X8RB8B tag=SXVYJ6IS2Y93 type=write size=2331831 2024-09-12T00:34:24.973 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.975+0000 7f1f2d864780 1 > prepared part key=_multipart_ZGO887JDR627.2~CVFMPHLEX3BK.0 size=515302 2024-09-12T00:34:24.973 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.975+0000 7f1f2d864780 1 > prepared multipart upload key=ZGO887JDR627 upload=CVFMPHLEX3BK tag=IOKKOJORSOHX type=write size=1563878 2024-09-12T00:34:24.974 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.976+0000 7f1f2d864780 1 < completed delete operation key=SNCGB6Z20450 tag=8L3NS2DUHTL9 type=del 2024-09-12T00:34:24.976 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.978+0000 7f1f2d864780 1 > prepared part key=_multipart_WKK747ETLW10.2~KT9DZUQ44N7L.0 size=1048576 2024-09-12T00:34:24.977 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.978+0000 7f1f2d864780 1 > prepared part key=_multipart_WKK747ETLW10.2~KT9DZUQ44N7L.1 size=1048576 2024-09-12T00:34:24.978 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.979+0000 7f1f2d864780 1 > prepared part key=_multipart_WKK747ETLW10.2~KT9DZUQ44N7L.2 size=656589 2024-09-12T00:34:24.978 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.979+0000 7f1f2d864780 1 > prepared multipart upload key=WKK747ETLW10 upload=KT9DZUQ44N7L tag=NUC7I4UJHW8I type=write size=3802317 2024-09-12T00:34:24.979 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.980+0000 7f1f2d864780 1 < completed delete operation key=AN26EVAZI527 tag=KF8K6D7Q0FUK type=del 2024-09-12T00:34:24.980 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.982+0000 7f1f2d864780 1 > prepared operation key=2G3UCYG4R4NM tag=S9HO0OACKCH3 type=del size=2397986 2024-09-12T00:34:24.982 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.984+0000 7f1f2d864780 1 < suggested remove operation key=ZGO887JDR627 tag=9L3X9IG9PTZV type=del 2024-09-12T00:34:24.983 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.985+0000 7f1f2d864780 1 > prepared operation key=53QCNWX1V1R1 tag=N7414X8J5UDA type=write size=60169 2024-09-12T00:34:24.984 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.986+0000 7f1f2d864780 1 < completed delete operation key=WGKEA4EKF5GP tag=7V502Z1I490W type=del 2024-09-12T00:34:24.985 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.987+0000 7f1f2d864780 1 > prepared operation key=MSGU3PHLBRJH tag=REWOFWNZZH1S type=del size=3608613 2024-09-12T00:34:24.986 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.988+0000 7f1f2d864780 1 < completed part key=_multipart_2RV0899QUJ8W.2~K337RQK3LJW2.0 size=1048576 2024-09-12T00:34:24.987 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.989+0000 7f1f2d864780 1 < completed part key=_multipart_2RV0899QUJ8W.2~K337RQK3LJW2.1 size=1048576 2024-09-12T00:34:24.988 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.990+0000 7f1f2d864780 1 < completed part key=_multipart_2RV0899QUJ8W.2~K337RQK3LJW2.2 size=302823 2024-09-12T00:34:24.990 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.992+0000 7f1f2d864780 1 < completed multipart upload key=2RV0899QUJ8W upload=K337RQK3LJW2 tag=7GTW36LVJIEJ type=write size=3448551 2024-09-12T00:34:24.991 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.993+0000 7f1f2d864780 1 > prepared operation key=0DSQOFS8IIF5 tag=ZN70P4E5KNIA type=write size=407134 2024-09-12T00:34:24.993 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.995+0000 7f1f2d864780 1 < suggested remove operation key=2YCGIJRK6MUH tag=73J5NN3N601K type=del 2024-09-12T00:34:24.994 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.996+0000 7f1f2d864780 1 > prepared operation key=N9RQIGHVL8VP tag=ZJFCGGUIRLIW type=del size=496111 2024-09-12T00:34:24.996 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.997+0000 7f1f2d864780 1 < canceled operation key=WIIU8VTCLWOD tag=65APD7M4IJ5C type=del size=1108362 2024-09-12T00:34:24.997 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.998+0000 7f1f2d864780 1 > prepared operation key=S5DVMA14N7VJ tag=0VXY9PE0P1L7 type=write size=432818 2024-09-12T00:34:24.998 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:24.999+0000 7f1f2d864780 1 < completed delete operation key=AN26EVAZI527 tag=F6PCK70BIXKV type=del 2024-09-12T00:34:25.000 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.001+0000 7f1f2d864780 1 > prepared part key=_multipart_MSGU3PHLBRJH.2~DF3R0P31NVAD.0 size=1048576 2024-09-12T00:34:25.001 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.002+0000 7f1f2d864780 1 > prepared part key=_multipart_MSGU3PHLBRJH.2~DF3R0P31NVAD.1 size=270803 2024-09-12T00:34:25.001 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.002+0000 7f1f2d864780 1 > prepared multipart upload key=MSGU3PHLBRJH upload=DF3R0P31NVAD tag=7HESM5K74OJO type=write size=2367955 2024-09-12T00:34:25.003 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.004+0000 7f1f2d864780 1 < suggested update operation key=3Z1TGGPZKJ69 tag=JK3GKNVUYCF3 type=write size=772630 2024-09-12T00:34:25.004 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.006+0000 7f1f2d864780 1 > prepared operation key=53QCNWX1V1R1 tag=QRG84BPEI9ZW type=del size=161663 2024-09-12T00:34:25.005 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.007+0000 7f1f2d864780 1 < completed delete operation key=AN26EVAZI527 tag=6N88BFTEWB44 type=del 2024-09-12T00:34:25.006 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.008+0000 7f1f2d864780 1 > prepared operation key=FFG41OYEYFZA tag=HY01VBHMZ16X type=write size=85629 2024-09-12T00:34:25.007 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.009+0000 7f1f2d864780 1 < completed write operation key=W6U30X4HJCB1 tag=GK4FSX618XCS type=write size=216953 2024-09-12T00:34:25.008 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.010+0000 7f1f2d864780 1 > prepared operation key=S5DVMA14N7VJ tag=ACOX0QLYSBSH type=del size=285218 2024-09-12T00:34:25.010 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.011+0000 7f1f2d864780 1 < completed part key=_multipart_SNCGB6Z20450.2~5BGV0UZVSPO5.0 size=1048576 2024-09-12T00:34:25.010 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.011+0000 7f1f2d864780 1 < canceled part key=_multipart_SNCGB6Z20450.2~5BGV0UZVSPO5.1 size=1048576 2024-09-12T00:34:25.010 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.012+0000 7f1f2d864780 1 < completed part key=_multipart_SNCGB6Z20450.2~5BGV0UZVSPO5.2 size=946350 2024-09-12T00:34:25.012 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.014+0000 7f1f2d864780 1 < canceled multipart upload key=SNCGB6Z20450 upload=5BGV0UZVSPO5 tag=MBI4HJ1DELG8 type=write size=4092078 2024-09-12T00:34:25.013 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.015+0000 7f1f2d864780 1 > prepared operation key=W6U30X4HJCB1 tag=PBUR4LH2S452 type=del size=2330690 2024-09-12T00:34:25.015 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.016+0000 7f1f2d864780 1 < canceled operation key=GSPM8N0K7ODC tag=QVIBEWZQF5QS type=del size=3076319 2024-09-12T00:34:25.016 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.017+0000 7f1f2d864780 1 > prepared operation key=GSPM8N0K7ODC tag=KWKYSQRZIA8M type=del size=186480 2024-09-12T00:34:25.017 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.019+0000 7f1f2d864780 1 < completed delete operation key=FFG41OYEYFZA tag=SS04P8GZFE66 type=del 2024-09-12T00:34:25.018 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.020+0000 7f1f2d864780 1 > prepared operation key=OY145ZXRSF4L tag=L20JEIVJX795 type=del size=1448604 2024-09-12T00:34:25.019 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.021+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~SFVDCUXYM703.0 size=1048576 2024-09-12T00:34:25.019 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.021+0000 7f1f2d864780 1 < canceled part key=_multipart_D21W9QZWY0YU.2~SFVDCUXYM703.1 size=1048576 2024-09-12T00:34:25.020 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.022+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~SFVDCUXYM703.2 size=262951 2024-09-12T00:34:25.022 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.024+0000 7f1f2d864780 1 < canceled multipart upload key=D21W9QZWY0YU upload=SFVDCUXYM703 tag=15GB6APLM6BS type=write size=3408679 2024-09-12T00:34:25.024 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.026+0000 7f1f2d864780 1 > prepared part key=_multipart_53QCNWX1V1R1.2~SJ16VAXORB2W.0 size=1048576 2024-09-12T00:34:25.025 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.026+0000 7f1f2d864780 1 > prepared part key=_multipart_53QCNWX1V1R1.2~SJ16VAXORB2W.1 size=545655 2024-09-12T00:34:25.025 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.026+0000 7f1f2d864780 1 > prepared multipart upload key=53QCNWX1V1R1 upload=SJ16VAXORB2W tag=JNHA278ZKD9W type=write size=2642807 2024-09-12T00:34:25.026 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.028+0000 7f1f2d864780 1 < completed part key=_multipart_ZGO887JDR627.2~CVFMPHLEX3BK.0 size=515302 2024-09-12T00:34:25.028 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.029+0000 7f1f2d864780 1 < completed multipart upload key=ZGO887JDR627 upload=CVFMPHLEX3BK tag=IOKKOJORSOHX type=write size=1563878 2024-09-12T00:34:25.029 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.030+0000 7f1f2d864780 1 > prepared operation key=ECZYQEZ942W8 tag=XD7FKVKPLUG0 type=del size=1187064 2024-09-12T00:34:25.030 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.032+0000 7f1f2d864780 1 < completed part key=_multipart_WKK747ETLW10.2~KT9DZUQ44N7L.0 size=1048576 2024-09-12T00:34:25.030 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.032+0000 7f1f2d864780 1 < canceled part key=_multipart_WKK747ETLW10.2~KT9DZUQ44N7L.1 size=1048576 2024-09-12T00:34:25.031 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.033+0000 7f1f2d864780 1 < completed part key=_multipart_WKK747ETLW10.2~KT9DZUQ44N7L.2 size=656589 2024-09-12T00:34:25.033 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.035+0000 7f1f2d864780 1 < canceled multipart upload key=WKK747ETLW10 upload=KT9DZUQ44N7L tag=NUC7I4UJHW8I type=write size=3802317 2024-09-12T00:34:25.034 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.036+0000 7f1f2d864780 1 > prepared operation key=PVB52GO6L8T4 tag=IR5FHU5V96HK type=del size=2373734 2024-09-12T00:34:25.037 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.038+0000 7f1f2d864780 1 < suggested remove operation key=2G3UCYG4R4NM tag=S9HO0OACKCH3 type=del 2024-09-12T00:34:25.039 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.041+0000 7f1f2d864780 1 > prepared part key=_multipart_DYKLAY6J018G.2~NWXM4MWMN5T6.0 size=967561 2024-09-12T00:34:25.039 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.041+0000 7f1f2d864780 1 > prepared multipart upload key=DYKLAY6J018G upload=NWXM4MWMN5T6 tag=PSM2I3RMFZ2E type=write size=2016137 2024-09-12T00:34:25.040 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.042+0000 7f1f2d864780 1 < canceled operation key=53QCNWX1V1R1 tag=N7414X8J5UDA type=write size=60169 2024-09-12T00:34:25.041 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.043+0000 7f1f2d864780 1 > prepared operation key=OY145ZXRSF4L tag=SO3DCHI5QJYF type=del size=3796723 2024-09-12T00:34:25.044 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.045+0000 7f1f2d864780 1 < suggested update operation key=MSGU3PHLBRJH tag=REWOFWNZZH1S type=del size=3608613 2024-09-12T00:34:25.046 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.048+0000 7f1f2d864780 1 > prepared part key=_multipart_GSPM8N0K7ODC.2~A2Y4P08F7T41.0 size=1048576 2024-09-12T00:34:25.047 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.049+0000 7f1f2d864780 1 > prepared part key=_multipart_GSPM8N0K7ODC.2~A2Y4P08F7T41.1 size=1015794 2024-09-12T00:34:25.047 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.049+0000 7f1f2d864780 1 > prepared multipart upload key=GSPM8N0K7ODC upload=A2Y4P08F7T41 tag=NAHWMDR7KAQA type=write size=3112946 2024-09-12T00:34:25.048 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.050+0000 7f1f2d864780 1 < completed write operation key=0DSQOFS8IIF5 tag=ZN70P4E5KNIA type=write size=407134 2024-09-12T00:34:25.049 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.051+0000 7f1f2d864780 1 > prepared operation key=2YCGIJRK6MUH tag=XKB3NQ2SFXZ8 type=del size=9686 2024-09-12T00:34:25.050 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.052+0000 7f1f2d864780 1 < completed delete operation key=N9RQIGHVL8VP tag=ZJFCGGUIRLIW type=del 2024-09-12T00:34:25.051 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.053+0000 7f1f2d864780 1 > prepared operation key=1299IOSGYIO9 tag=X3AWB2BQKY1D type=del size=2462910 2024-09-12T00:34:25.053 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.054+0000 7f1f2d864780 1 < completed write operation key=S5DVMA14N7VJ tag=0VXY9PE0P1L7 type=write size=432818 2024-09-12T00:34:25.054 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.056+0000 7f1f2d864780 1 > prepared operation key=WGKEA4EKF5GP tag=12SUBDBQE7FL type=del size=1744292 2024-09-12T00:34:25.055 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.057+0000 7f1f2d864780 1 < completed part key=_multipart_MSGU3PHLBRJH.2~DF3R0P31NVAD.0 size=1048576 2024-09-12T00:34:25.056 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.058+0000 7f1f2d864780 1 < completed part key=_multipart_MSGU3PHLBRJH.2~DF3R0P31NVAD.1 size=270803 2024-09-12T00:34:25.058 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.059+0000 7f1f2d864780 1 < completed multipart upload key=MSGU3PHLBRJH upload=DF3R0P31NVAD tag=7HESM5K74OJO type=write size=2367955 2024-09-12T00:34:25.059 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.061+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=LFX5OIWHD9H7 type=del size=1489247 2024-09-12T00:34:25.060 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.062+0000 7f1f2d864780 1 < completed delete operation key=53QCNWX1V1R1 tag=QRG84BPEI9ZW type=del 2024-09-12T00:34:25.062 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.063+0000 7f1f2d864780 1 > prepared operation key=0DSQOFS8IIF5 tag=WEWEODZHL24T type=del size=934503 2024-09-12T00:34:25.063 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.064+0000 7f1f2d864780 1 < completed write operation key=FFG41OYEYFZA tag=HY01VBHMZ16X type=write size=85629 2024-09-12T00:34:25.064 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.066+0000 7f1f2d864780 1 > prepared operation key=FFG41OYEYFZA tag=WW6N9FUOPUAX type=del size=3270624 2024-09-12T00:34:25.068 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.070+0000 7f1f2d864780 1 < suggested update operation key=S5DVMA14N7VJ tag=ACOX0QLYSBSH type=del size=285218 2024-09-12T00:34:25.070 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.072+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~442LHPI9YRAS.0 size=1048576 2024-09-12T00:34:25.071 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.073+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~442LHPI9YRAS.1 size=1048576 2024-09-12T00:34:25.072 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.074+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~442LHPI9YRAS.2 size=170011 2024-09-12T00:34:25.073 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.074+0000 7f1f2d864780 1 > prepared multipart upload key=SZP418NVZ5VX upload=442LHPI9YRAS tag=A4E98HO2LZ6K type=write size=3315739 2024-09-12T00:34:25.074 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.075+0000 7f1f2d864780 1 < completed delete operation key=W6U30X4HJCB1 tag=PBUR4LH2S452 type=del 2024-09-12T00:34:25.075 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.077+0000 7f1f2d864780 1 > prepared operation key=FFG41OYEYFZA tag=43TWN6WLCY00 type=del size=1315266 2024-09-12T00:34:25.077 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.079+0000 7f1f2d864780 1 < suggested update operation key=GSPM8N0K7ODC tag=KWKYSQRZIA8M type=del size=186480 2024-09-12T00:34:25.079 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.080+0000 7f1f2d864780 1 > prepared operation key=ZGO887JDR627 tag=1OVDU2J076SK type=del size=1037963 2024-09-12T00:34:25.080 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.081+0000 7f1f2d864780 1 < canceled operation key=OY145ZXRSF4L tag=L20JEIVJX795 type=del size=1448604 2024-09-12T00:34:25.081 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.082+0000 7f1f2d864780 1 > prepared operation key=3Z1TGGPZKJ69 tag=0J89O0GUXUBA type=write size=622510 2024-09-12T00:34:25.082 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.084+0000 7f1f2d864780 1 < completed part key=_multipart_53QCNWX1V1R1.2~SJ16VAXORB2W.0 size=1048576 2024-09-12T00:34:25.083 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.085+0000 7f1f2d864780 1 < completed part key=_multipart_53QCNWX1V1R1.2~SJ16VAXORB2W.1 size=545655 2024-09-12T00:34:25.085 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.086+0000 7f1f2d864780 1 < completed multipart upload key=53QCNWX1V1R1 upload=SJ16VAXORB2W tag=JNHA278ZKD9W type=write size=2642807 2024-09-12T00:34:25.086 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.087+0000 7f1f2d864780 1 > prepared operation key=N9RQIGHVL8VP tag=NTT7PU1C09PI type=del size=338560 2024-09-12T00:34:25.087 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.089+0000 7f1f2d864780 1 < completed delete operation key=ECZYQEZ942W8 tag=XD7FKVKPLUG0 type=del 2024-09-12T00:34:25.088 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.090+0000 7f1f2d864780 1 > prepared operation key=WGKEA4EKF5GP tag=JHI20U881HWT type=del size=4019970 2024-09-12T00:34:25.089 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.091+0000 7f1f2d864780 1 < completed delete operation key=PVB52GO6L8T4 tag=IR5FHU5V96HK type=del 2024-09-12T00:34:25.090 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.092+0000 7f1f2d864780 1 > prepared operation key=OY145ZXRSF4L tag=JHRPYJPJWS60 type=write size=909682 2024-09-12T00:34:25.091 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.092+0000 7f1f2d864780 1 < canceled part key=_multipart_DYKLAY6J018G.2~NWXM4MWMN5T6.0 size=967561 2024-09-12T00:34:25.092 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.094+0000 7f1f2d864780 1 < canceled multipart upload key=DYKLAY6J018G upload=NWXM4MWMN5T6 tag=PSM2I3RMFZ2E type=write size=2016137 2024-09-12T00:34:25.093 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.095+0000 7f1f2d864780 1 > prepared operation key=4FRVL0KXN2X8 tag=YTWNLOHW64RL type=del size=4057348 2024-09-12T00:34:25.094 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.096+0000 7f1f2d864780 1 < completed delete operation key=OY145ZXRSF4L tag=SO3DCHI5QJYF type=del 2024-09-12T00:34:25.097 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.098+0000 7f1f2d864780 1 > prepared part key=_multipart_N9RQIGHVL8VP.2~BJ4596HU0YJO.0 size=1048576 2024-09-12T00:34:25.098 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.099+0000 7f1f2d864780 1 > prepared part key=_multipart_N9RQIGHVL8VP.2~BJ4596HU0YJO.1 size=235772 2024-09-12T00:34:25.098 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.099+0000 7f1f2d864780 1 > prepared multipart upload key=N9RQIGHVL8VP upload=BJ4596HU0YJO tag=B9QTW1XYOXC1 type=write size=2332924 2024-09-12T00:34:25.098 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.099+0000 7f1f2d864780 1 < canceled part key=_multipart_GSPM8N0K7ODC.2~A2Y4P08F7T41.0 size=1048576 2024-09-12T00:34:25.099 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.100+0000 7f1f2d864780 1 < completed part key=_multipart_GSPM8N0K7ODC.2~A2Y4P08F7T41.1 size=1015794 2024-09-12T00:34:25.100 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.102+0000 7f1f2d864780 1 < canceled multipart upload key=GSPM8N0K7ODC upload=A2Y4P08F7T41 tag=NAHWMDR7KAQA type=write size=3112946 2024-09-12T00:34:25.102 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.103+0000 7f1f2d864780 1 > prepared operation key=3Z1TGGPZKJ69 tag=OG5RTHMOI2J9 type=del size=2363134 2024-09-12T00:34:25.103 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.104+0000 7f1f2d864780 1 < completed delete operation key=2YCGIJRK6MUH tag=XKB3NQ2SFXZ8 type=del 2024-09-12T00:34:25.104 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.106+0000 7f1f2d864780 1 > prepared operation key=ZGO887JDR627 tag=UPOHG7CYF5TK type=write size=131020 2024-09-12T00:34:25.105 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.107+0000 7f1f2d864780 1 < completed delete operation key=1299IOSGYIO9 tag=X3AWB2BQKY1D type=del 2024-09-12T00:34:25.107 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.108+0000 7f1f2d864780 1 > prepared operation key=53QCNWX1V1R1 tag=WAHVOBV0MT62 type=del size=19957 2024-09-12T00:34:25.109 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.111+0000 7f1f2d864780 1 < completed delete operation key=WGKEA4EKF5GP tag=12SUBDBQE7FL type=del 2024-09-12T00:34:25.110 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.112+0000 7f1f2d864780 1 > prepared operation key=DYKLAY6J018G tag=RW725NGL28XI type=write size=1043497 2024-09-12T00:34:25.113 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.115+0000 7f1f2d864780 1 < suggested remove operation key=2RV0899QUJ8W tag=LFX5OIWHD9H7 type=del 2024-09-12T00:34:25.115 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.117+0000 7f1f2d864780 1 > prepared part key=_multipart_ZGO887JDR627.2~NRN63XX17U8Q.0 size=1048576 2024-09-12T00:34:25.116 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.118+0000 7f1f2d864780 1 > prepared part key=_multipart_ZGO887JDR627.2~NRN63XX17U8Q.1 size=1048576 2024-09-12T00:34:25.117 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.119+0000 7f1f2d864780 1 > prepared part key=_multipart_ZGO887JDR627.2~NRN63XX17U8Q.2 size=392464 2024-09-12T00:34:25.117 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.119+0000 7f1f2d864780 1 > prepared multipart upload key=ZGO887JDR627 upload=NRN63XX17U8Q tag=XNVEAY6RWPV5 type=write size=3538192 2024-09-12T00:34:25.120 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.121+0000 7f1f2d864780 1 < suggested update operation key=0DSQOFS8IIF5 tag=WEWEODZHL24T type=del size=934503 2024-09-12T00:34:25.121 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.123+0000 7f1f2d864780 1 > prepared operation key=MSGU3PHLBRJH tag=QHC7RFX3EIRV type=del size=1396372 2024-09-12T00:34:25.122 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.124+0000 7f1f2d864780 1 < completed delete operation key=FFG41OYEYFZA tag=WW6N9FUOPUAX type=del 2024-09-12T00:34:25.124 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.125+0000 7f1f2d864780 1 > prepared operation key=ZYNIJH0TTSM6 tag=2X43RC7DDKPC type=del size=2381685 2024-09-12T00:34:25.124 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.126+0000 7f1f2d864780 1 < canceled part key=_multipart_SZP418NVZ5VX.2~442LHPI9YRAS.0 size=1048576 2024-09-12T00:34:25.125 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.127+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~442LHPI9YRAS.1 size=1048576 2024-09-12T00:34:25.126 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.128+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~442LHPI9YRAS.2 size=170011 2024-09-12T00:34:25.128 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.130+0000 7f1f2d864780 1 < canceled multipart upload key=SZP418NVZ5VX upload=442LHPI9YRAS tag=A4E98HO2LZ6K type=write size=3315739 2024-09-12T00:34:25.129 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.131+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=6A4SLWKXGS4E type=del size=1872288 2024-09-12T00:34:25.131 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.132+0000 7f1f2d864780 1 < completed delete operation key=FFG41OYEYFZA tag=43TWN6WLCY00 type=del 2024-09-12T00:34:25.132 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.133+0000 7f1f2d864780 1 > prepared operation key=SZP418NVZ5VX tag=JK026XAJCM26 type=del size=3009144 2024-09-12T00:34:25.133 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.135+0000 7f1f2d864780 1 < completed delete operation key=ZGO887JDR627 tag=1OVDU2J076SK type=del 2024-09-12T00:34:25.135 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.137+0000 7f1f2d864780 1 > prepared part key=_multipart_AN26EVAZI527.2~M3CO6DLJE16X.0 size=1048576 2024-09-12T00:34:25.136 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.138+0000 7f1f2d864780 1 > prepared part key=_multipart_AN26EVAZI527.2~M3CO6DLJE16X.1 size=1048576 2024-09-12T00:34:25.137 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.139+0000 7f1f2d864780 1 > prepared part key=_multipart_AN26EVAZI527.2~M3CO6DLJE16X.2 size=56192 2024-09-12T00:34:25.137 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.139+0000 7f1f2d864780 1 > prepared multipart upload key=AN26EVAZI527 upload=M3CO6DLJE16X tag=FK323IYCJSC0 type=write size=3201920 2024-09-12T00:34:25.138 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.140+0000 7f1f2d864780 1 < completed write operation key=3Z1TGGPZKJ69 tag=0J89O0GUXUBA type=write size=622510 2024-09-12T00:34:25.141 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.142+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~P44CEW9ZFHS0.0 size=228542 2024-09-12T00:34:25.141 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.142+0000 7f1f2d864780 1 > prepared multipart upload key=0DSQOFS8IIF5 upload=P44CEW9ZFHS0 tag=8AUQ70AYI2CL type=write size=1277118 2024-09-12T00:34:25.142 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.143+0000 7f1f2d864780 1 < completed delete operation key=N9RQIGHVL8VP tag=NTT7PU1C09PI type=del 2024-09-12T00:34:25.144 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.146+0000 7f1f2d864780 1 > prepared part key=_multipart_ZGO887JDR627.2~256OHG1M12P4.0 size=114488 2024-09-12T00:34:25.144 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.146+0000 7f1f2d864780 1 > prepared multipart upload key=ZGO887JDR627 upload=256OHG1M12P4 tag=RSERDYM6AFEB type=write size=1163064 2024-09-12T00:34:25.145 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.147+0000 7f1f2d864780 1 < completed delete operation key=WGKEA4EKF5GP tag=JHI20U881HWT type=del 2024-09-12T00:34:25.147 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.148+0000 7f1f2d864780 1 > prepared operation key=SZP418NVZ5VX tag=955T9ZX7SIFJ type=write size=485209 2024-09-12T00:34:25.148 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.149+0000 7f1f2d864780 1 < completed write operation key=OY145ZXRSF4L tag=JHRPYJPJWS60 type=write size=909682 2024-09-12T00:34:25.150 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.151+0000 7f1f2d864780 1 > prepared part key=_multipart_WIIU8VTCLWOD.2~ABZ2IW6VNAM7.0 size=626758 2024-09-12T00:34:25.150 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.151+0000 7f1f2d864780 1 > prepared multipart upload key=WIIU8VTCLWOD upload=ABZ2IW6VNAM7 tag=UNE6WQ7CV3N2 type=write size=1675334 2024-09-12T00:34:25.152 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.154+0000 7f1f2d864780 1 < suggested update operation key=4FRVL0KXN2X8 tag=YTWNLOHW64RL type=del size=4057348 2024-09-12T00:34:25.153 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.155+0000 7f1f2d864780 1 > prepared operation key=MSGU3PHLBRJH tag=0QP5OK3H2XEN type=del size=402752 2024-09-12T00:34:25.155 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.156+0000 7f1f2d864780 1 < completed part key=_multipart_N9RQIGHVL8VP.2~BJ4596HU0YJO.0 size=1048576 2024-09-12T00:34:25.155 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.157+0000 7f1f2d864780 1 < completed part key=_multipart_N9RQIGHVL8VP.2~BJ4596HU0YJO.1 size=235772 2024-09-12T00:34:25.157 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.159+0000 7f1f2d864780 1 < completed multipart upload key=N9RQIGHVL8VP upload=BJ4596HU0YJO tag=B9QTW1XYOXC1 type=write size=2332924 2024-09-12T00:34:25.158 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.160+0000 7f1f2d864780 1 > prepared operation key=0DSQOFS8IIF5 tag=O986GSSZWKE7 type=write size=636516 2024-09-12T00:34:25.160 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.161+0000 7f1f2d864780 1 < completed delete operation key=3Z1TGGPZKJ69 tag=OG5RTHMOI2J9 type=del 2024-09-12T00:34:25.161 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.163+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=113LYYNJ3DW6 type=del size=3210828 2024-09-12T00:34:25.162 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.164+0000 7f1f2d864780 1 < completed write operation key=ZGO887JDR627 tag=UPOHG7CYF5TK type=write size=131020 2024-09-12T00:34:25.163 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.165+0000 7f1f2d864780 1 > prepared operation key=ECZYQEZ942W8 tag=XQE663X3J7AR type=del size=2808387 2024-09-12T00:34:25.165 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.166+0000 7f1f2d864780 1 < completed delete operation key=53QCNWX1V1R1 tag=WAHVOBV0MT62 type=del 2024-09-12T00:34:25.166 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.167+0000 7f1f2d864780 1 > prepared operation key=OY145ZXRSF4L tag=GK39NNNZN59Z type=del size=673252 2024-09-12T00:34:25.167 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.168+0000 7f1f2d864780 1 < completed write operation key=DYKLAY6J018G tag=RW725NGL28XI type=write size=1043497 2024-09-12T00:34:25.168 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.170+0000 7f1f2d864780 1 > prepared operation key=WGKEA4EKF5GP tag=YE4XMXO4IBBP type=del size=1851860 2024-09-12T00:34:25.168 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.170+0000 7f1f2d864780 1 < canceled part key=_multipart_ZGO887JDR627.2~NRN63XX17U8Q.0 size=1048576 2024-09-12T00:34:25.169 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.171+0000 7f1f2d864780 1 < completed part key=_multipart_ZGO887JDR627.2~NRN63XX17U8Q.1 size=1048576 2024-09-12T00:34:25.170 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.172+0000 7f1f2d864780 1 < completed part key=_multipart_ZGO887JDR627.2~NRN63XX17U8Q.2 size=392464 2024-09-12T00:34:25.172 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.174+0000 7f1f2d864780 1 < canceled multipart upload key=ZGO887JDR627 upload=NRN63XX17U8Q tag=XNVEAY6RWPV5 type=write size=3538192 2024-09-12T00:34:25.173 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.175+0000 7f1f2d864780 1 > prepared operation key=UTR2UUO6DHLJ tag=6I2C0NTWM66X type=del size=2405840 2024-09-12T00:34:25.174 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.176+0000 7f1f2d864780 1 < completed delete operation key=MSGU3PHLBRJH tag=QHC7RFX3EIRV type=del 2024-09-12T00:34:25.176 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.177+0000 7f1f2d864780 1 > prepared operation key=2YCGIJRK6MUH tag=Q7ZLHZ7T1OIU type=del size=3173318 2024-09-12T00:34:25.177 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.179+0000 7f1f2d864780 1 < completed delete operation key=ZYNIJH0TTSM6 tag=2X43RC7DDKPC type=del 2024-09-12T00:34:25.179 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.181+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~P7VC590CK8C2.0 size=1008316 2024-09-12T00:34:25.179 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.181+0000 7f1f2d864780 1 > prepared multipart upload key=SZP418NVZ5VX upload=P7VC590CK8C2 tag=733EOZC3KWFA type=write size=2056892 2024-09-12T00:34:25.180 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.182+0000 7f1f2d864780 1 < canceled operation key=2RV0899QUJ8W tag=6A4SLWKXGS4E type=del size=1872288 2024-09-12T00:34:25.186 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.187+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~TJODWK99H9H3.0 size=881107 2024-09-12T00:34:25.186 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.187+0000 7f1f2d864780 1 > prepared multipart upload key=4FRVL0KXN2X8 upload=TJODWK99H9H3 tag=T09HR9SKFSS1 type=write size=1929683 2024-09-12T00:34:25.187 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.188+0000 7f1f2d864780 1 < completed delete operation key=SZP418NVZ5VX tag=JK026XAJCM26 type=del 2024-09-12T00:34:25.188 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.190+0000 7f1f2d864780 1 > prepared operation key=WKK747ETLW10 tag=DQQ4U3V6A9SK type=del size=2236528 2024-09-12T00:34:25.190 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.191+0000 7f1f2d864780 1 < completed part key=_multipart_AN26EVAZI527.2~M3CO6DLJE16X.0 size=1048576 2024-09-12T00:34:25.191 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.192+0000 7f1f2d864780 1 < completed part key=_multipart_AN26EVAZI527.2~M3CO6DLJE16X.1 size=1048576 2024-09-12T00:34:25.191 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.193+0000 7f1f2d864780 1 < completed part key=_multipart_AN26EVAZI527.2~M3CO6DLJE16X.2 size=56192 2024-09-12T00:34:25.193 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.195+0000 7f1f2d864780 1 < completed multipart upload key=AN26EVAZI527 upload=M3CO6DLJE16X tag=FK323IYCJSC0 type=write size=3201920 2024-09-12T00:34:25.196 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.198+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~GIUB4R2LRXDR.0 size=1048576 2024-09-12T00:34:25.197 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.199+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~GIUB4R2LRXDR.1 size=1048576 2024-09-12T00:34:25.198 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.200+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~GIUB4R2LRXDR.2 size=905314 2024-09-12T00:34:25.198 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.200+0000 7f1f2d864780 1 > prepared multipart upload key=WGKEA4EKF5GP upload=GIUB4R2LRXDR tag=B09VR5C88CP9 type=write size=4051042 2024-09-12T00:34:25.199 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.201+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~P44CEW9ZFHS0.0 size=228542 2024-09-12T00:34:25.201 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.203+0000 7f1f2d864780 1 < completed multipart upload key=0DSQOFS8IIF5 upload=P44CEW9ZFHS0 tag=8AUQ70AYI2CL type=write size=1277118 2024-09-12T00:34:25.204 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.206+0000 7f1f2d864780 1 > prepared part key=_multipart_ZYNIJH0TTSM6.2~1KD1ECEZND2S.0 size=1048576 2024-09-12T00:34:25.205 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.207+0000 7f1f2d864780 1 > prepared part key=_multipart_ZYNIJH0TTSM6.2~1KD1ECEZND2S.1 size=1048576 2024-09-12T00:34:25.206 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.208+0000 7f1f2d864780 1 > prepared part key=_multipart_ZYNIJH0TTSM6.2~1KD1ECEZND2S.2 size=560418 2024-09-12T00:34:25.206 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.208+0000 7f1f2d864780 1 > prepared multipart upload key=ZYNIJH0TTSM6 upload=1KD1ECEZND2S tag=OJ7D6K9ZYSIF type=write size=3706146 2024-09-12T00:34:25.208 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.209+0000 7f1f2d864780 1 < completed part key=_multipart_ZGO887JDR627.2~256OHG1M12P4.0 size=114488 2024-09-12T00:34:25.210 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.212+0000 7f1f2d864780 1 < completed multipart upload key=ZGO887JDR627 upload=256OHG1M12P4 tag=RSERDYM6AFEB type=write size=1163064 2024-09-12T00:34:25.212 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.214+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~7FLHDQF8ZU66.0 size=1048576 2024-09-12T00:34:25.213 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.215+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~7FLHDQF8ZU66.1 size=1048576 2024-09-12T00:34:25.214 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.216+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~7FLHDQF8ZU66.2 size=901663 2024-09-12T00:34:25.215 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.216+0000 7f1f2d864780 1 > prepared multipart upload key=WGKEA4EKF5GP upload=7FLHDQF8ZU66 tag=TJ3LFIFO3ZH7 type=write size=4047391 2024-09-12T00:34:25.216 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.217+0000 7f1f2d864780 1 < completed write operation key=SZP418NVZ5VX tag=955T9ZX7SIFJ type=write size=485209 2024-09-12T00:34:25.217 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.219+0000 7f1f2d864780 1 > prepared operation key=WKK747ETLW10 tag=K6MSLGHHI3XT type=del size=3315535 2024-09-12T00:34:25.219 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.220+0000 7f1f2d864780 1 < completed part key=_multipart_WIIU8VTCLWOD.2~ABZ2IW6VNAM7.0 size=626758 2024-09-12T00:34:25.221 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.222+0000 7f1f2d864780 1 < completed multipart upload key=WIIU8VTCLWOD upload=ABZ2IW6VNAM7 tag=UNE6WQ7CV3N2 type=write size=1675334 2024-09-12T00:34:25.222 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.224+0000 7f1f2d864780 1 > prepared operation key=3Z1TGGPZKJ69 tag=GTATOA01XCCO type=del size=1894007 2024-09-12T00:34:25.223 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.225+0000 7f1f2d864780 1 < completed delete operation key=MSGU3PHLBRJH tag=0QP5OK3H2XEN type=del 2024-09-12T00:34:25.224 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.226+0000 7f1f2d864780 1 > prepared operation key=OY145ZXRSF4L tag=L9KD7O4KAC3T type=write size=422827 2024-09-12T00:34:25.225 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.227+0000 7f1f2d864780 1 < completed write operation key=0DSQOFS8IIF5 tag=O986GSSZWKE7 type=write size=636516 2024-09-12T00:34:25.228 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.229+0000 7f1f2d864780 1 > prepared part key=_multipart_UTR2UUO6DHLJ.2~7D8ACLL42ALA.0 size=1048576 2024-09-12T00:34:25.228 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.230+0000 7f1f2d864780 1 > prepared part key=_multipart_UTR2UUO6DHLJ.2~7D8ACLL42ALA.1 size=1048576 2024-09-12T00:34:25.229 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.231+0000 7f1f2d864780 1 > prepared part key=_multipart_UTR2UUO6DHLJ.2~7D8ACLL42ALA.2 size=550607 2024-09-12T00:34:25.229 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.231+0000 7f1f2d864780 1 > prepared multipart upload key=UTR2UUO6DHLJ upload=7D8ACLL42ALA tag=BVK42906PVRT type=write size=3696335 2024-09-12T00:34:25.230 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.232+0000 7f1f2d864780 1 < completed delete operation key=2RV0899QUJ8W tag=113LYYNJ3DW6 type=del 2024-09-12T00:34:25.232 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.234+0000 7f1f2d864780 1 > prepared part key=_multipart_N9RQIGHVL8VP.2~RP8U94VW9MVY.0 size=1048576 2024-09-12T00:34:25.233 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.235+0000 7f1f2d864780 1 > prepared part key=_multipart_N9RQIGHVL8VP.2~RP8U94VW9MVY.1 size=907220 2024-09-12T00:34:25.233 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.235+0000 7f1f2d864780 1 > prepared multipart upload key=N9RQIGHVL8VP upload=RP8U94VW9MVY tag=3EBP8YK3PBXB type=write size=3004372 2024-09-12T00:34:25.234 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.236+0000 7f1f2d864780 1 < completed delete operation key=ECZYQEZ942W8 tag=XQE663X3J7AR type=del 2024-09-12T00:34:25.235 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.237+0000 7f1f2d864780 1 > prepared operation key=WKK747ETLW10 tag=ALPFJ0TEVQ6T type=del size=2915378 2024-09-12T00:34:25.237 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.238+0000 7f1f2d864780 1 < completed delete operation key=OY145ZXRSF4L tag=GK39NNNZN59Z type=del 2024-09-12T00:34:25.238 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.240+0000 7f1f2d864780 1 > prepared part key=_multipart_WKK747ETLW10.2~3QNHI9IDUOFQ.0 size=1048576 2024-09-12T00:34:25.239 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.241+0000 7f1f2d864780 1 > prepared part key=_multipart_WKK747ETLW10.2~3QNHI9IDUOFQ.1 size=1048576 2024-09-12T00:34:25.240 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.242+0000 7f1f2d864780 1 > prepared part key=_multipart_WKK747ETLW10.2~3QNHI9IDUOFQ.2 size=172723 2024-09-12T00:34:25.240 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.242+0000 7f1f2d864780 1 > prepared multipart upload key=WKK747ETLW10 upload=3QNHI9IDUOFQ tag=OPR6OIZII42M type=write size=3318451 2024-09-12T00:34:25.241 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.243+0000 7f1f2d864780 1 < completed delete operation key=WGKEA4EKF5GP tag=YE4XMXO4IBBP type=del 2024-09-12T00:34:25.242 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.244+0000 7f1f2d864780 1 > prepared operation key=SZP418NVZ5VX tag=WN4TLJTCRW4A type=write size=844454 2024-09-12T00:34:25.245 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.246+0000 7f1f2d864780 1 < suggested remove operation key=UTR2UUO6DHLJ tag=6I2C0NTWM66X type=del 2024-09-12T00:34:25.246 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.247+0000 7f1f2d864780 1 > prepared operation key=GSPM8N0K7ODC tag=42VXGW3DPIPZ type=del size=3643689 2024-09-12T00:34:25.248 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.249+0000 7f1f2d864780 1 < suggested update operation key=2YCGIJRK6MUH tag=Q7ZLHZ7T1OIU type=del size=3173318 2024-09-12T00:34:25.249 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.251+0000 7f1f2d864780 1 > prepared operation key=3Z1TGGPZKJ69 tag=EOBVNIQBS26T type=del size=2598257 2024-09-12T00:34:25.250 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.252+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~P7VC590CK8C2.0 size=1008316 2024-09-12T00:34:25.252 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.254+0000 7f1f2d864780 1 < completed multipart upload key=SZP418NVZ5VX upload=P7VC590CK8C2 tag=733EOZC3KWFA type=write size=2056892 2024-09-12T00:34:25.255 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.256+0000 7f1f2d864780 1 > prepared part key=_multipart_ZYNIJH0TTSM6.2~WASPU94BDLBH.0 size=811989 2024-09-12T00:34:25.255 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.256+0000 7f1f2d864780 1 > prepared multipart upload key=ZYNIJH0TTSM6 upload=WASPU94BDLBH tag=MZBE1D90IK5V type=write size=1860565 2024-09-12T00:34:25.256 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.258+0000 7f1f2d864780 1 < completed part key=_multipart_4FRVL0KXN2X8.2~TJODWK99H9H3.0 size=881107 2024-09-12T00:34:25.258 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.259+0000 7f1f2d864780 1 < completed multipart upload key=4FRVL0KXN2X8 upload=TJODWK99H9H3 tag=T09HR9SKFSS1 type=write size=1929683 2024-09-12T00:34:25.259 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.260+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=42RMC20CUO92 type=del size=3139860 2024-09-12T00:34:25.261 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.263+0000 7f1f2d864780 1 < suggested update operation key=WKK747ETLW10 tag=DQQ4U3V6A9SK type=del size=2236528 2024-09-12T00:34:25.262 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.264+0000 7f1f2d864780 1 > prepared operation key=AN26EVAZI527 tag=ZTH5VSINXFRQ type=del size=958864 2024-09-12T00:34:25.264 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.265+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~GIUB4R2LRXDR.0 size=1048576 2024-09-12T00:34:25.264 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.265+0000 7f1f2d864780 1 < canceled part key=_multipart_WGKEA4EKF5GP.2~GIUB4R2LRXDR.1 size=1048576 2024-09-12T00:34:25.265 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.266+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~GIUB4R2LRXDR.2 size=905314 2024-09-12T00:34:25.266 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.268+0000 7f1f2d864780 1 < canceled multipart upload key=WGKEA4EKF5GP upload=GIUB4R2LRXDR tag=B09VR5C88CP9 type=write size=4051042 2024-09-12T00:34:25.269 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.271+0000 7f1f2d864780 1 > prepared part key=_multipart_FFG41OYEYFZA.2~YR4038UA9F0O.0 size=1048576 2024-09-12T00:34:25.270 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.272+0000 7f1f2d864780 1 > prepared part key=_multipart_FFG41OYEYFZA.2~YR4038UA9F0O.1 size=497322 2024-09-12T00:34:25.270 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.272+0000 7f1f2d864780 1 > prepared multipart upload key=FFG41OYEYFZA upload=YR4038UA9F0O tag=B4TDTFRM4366 type=write size=2594474 2024-09-12T00:34:25.271 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.272+0000 7f1f2d864780 1 < canceled part key=_multipart_ZYNIJH0TTSM6.2~1KD1ECEZND2S.0 size=1048576 2024-09-12T00:34:25.271 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.273+0000 7f1f2d864780 1 < completed part key=_multipart_ZYNIJH0TTSM6.2~1KD1ECEZND2S.1 size=1048576 2024-09-12T00:34:25.271 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.273+0000 7f1f2d864780 1 < canceled part key=_multipart_ZYNIJH0TTSM6.2~1KD1ECEZND2S.2 size=560418 2024-09-12T00:34:25.273 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.275+0000 7f1f2d864780 1 < canceled multipart upload key=ZYNIJH0TTSM6 upload=1KD1ECEZND2S tag=OJ7D6K9ZYSIF type=write size=3706146 2024-09-12T00:34:25.276 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.277+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~L4I035HE0XEJ.0 size=689998 2024-09-12T00:34:25.276 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.277+0000 7f1f2d864780 1 > prepared multipart upload key=4FRVL0KXN2X8 upload=L4I035HE0XEJ tag=SKEE34Z30567 type=write size=1738574 2024-09-12T00:34:25.276 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.278+0000 7f1f2d864780 1 < canceled part key=_multipart_WGKEA4EKF5GP.2~7FLHDQF8ZU66.0 size=1048576 2024-09-12T00:34:25.277 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.279+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~7FLHDQF8ZU66.1 size=1048576 2024-09-12T00:34:25.277 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.279+0000 7f1f2d864780 1 < canceled part key=_multipart_WGKEA4EKF5GP.2~7FLHDQF8ZU66.2 size=901663 2024-09-12T00:34:25.279 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.281+0000 7f1f2d864780 1 < canceled multipart upload key=WGKEA4EKF5GP upload=7FLHDQF8ZU66 tag=TJ3LFIFO3ZH7 type=write size=4047391 2024-09-12T00:34:25.283 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.284+0000 7f1f2d864780 1 > prepared part key=_multipart_2RV0899QUJ8W.2~MAF2RUA3NMI3.0 size=1048576 2024-09-12T00:34:25.284 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.285+0000 7f1f2d864780 1 > prepared part key=_multipart_2RV0899QUJ8W.2~MAF2RUA3NMI3.1 size=809386 2024-09-12T00:34:25.284 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.285+0000 7f1f2d864780 1 > prepared multipart upload key=2RV0899QUJ8W upload=MAF2RUA3NMI3 tag=UQCPLTN3XAFY type=write size=2906538 2024-09-12T00:34:25.285 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.286+0000 7f1f2d864780 -1 < failed to complete operation key=WKK747ETLW10 tag=K6MSLGHHI3XT type=del size=3315535: (22) Invalid argument 2024-09-12T00:34:25.286 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.288+0000 7f1f2d864780 1 > prepared operation key=WGKEA4EKF5GP tag=ZWYHH392EGY3 type=del size=1201328 2024-09-12T00:34:25.287 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.289+0000 7f1f2d864780 1 < completed delete operation key=3Z1TGGPZKJ69 tag=GTATOA01XCCO type=del 2024-09-12T00:34:25.288 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.290+0000 7f1f2d864780 1 > prepared operation key=DYKLAY6J018G tag=T72FD8IOI35K type=del size=1647890 2024-09-12T00:34:25.290 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.291+0000 7f1f2d864780 1 < completed write operation key=OY145ZXRSF4L tag=L9KD7O4KAC3T type=write size=422827 2024-09-12T00:34:25.291 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.292+0000 7f1f2d864780 1 > prepared operation key=53QCNWX1V1R1 tag=QB233D2H82U3 type=del size=2338167 2024-09-12T00:34:25.292 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.293+0000 7f1f2d864780 1 < completed part key=_multipart_UTR2UUO6DHLJ.2~7D8ACLL42ALA.0 size=1048576 2024-09-12T00:34:25.293 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.294+0000 7f1f2d864780 1 < completed part key=_multipart_UTR2UUO6DHLJ.2~7D8ACLL42ALA.1 size=1048576 2024-09-12T00:34:25.294 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.295+0000 7f1f2d864780 1 < completed part key=_multipart_UTR2UUO6DHLJ.2~7D8ACLL42ALA.2 size=550607 2024-09-12T00:34:25.296 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.297+0000 7f1f2d864780 1 < completed multipart upload key=UTR2UUO6DHLJ upload=7D8ACLL42ALA tag=BVK42906PVRT type=write size=3696335 2024-09-12T00:34:25.299 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.300+0000 7f1f2d864780 1 > prepared part key=_multipart_DYKLAY6J018G.2~KCLW0L5842UF.0 size=1017409 2024-09-12T00:34:25.299 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.300+0000 7f1f2d864780 1 > prepared multipart upload key=DYKLAY6J018G upload=KCLW0L5842UF tag=5P8UNK94K9JK type=write size=2065985 2024-09-12T00:34:25.300 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.301+0000 7f1f2d864780 1 < completed part key=_multipart_N9RQIGHVL8VP.2~RP8U94VW9MVY.0 size=1048576 2024-09-12T00:34:25.300 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.301+0000 7f1f2d864780 1 < canceled part key=_multipart_N9RQIGHVL8VP.2~RP8U94VW9MVY.1 size=907220 2024-09-12T00:34:25.302 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.303+0000 7f1f2d864780 1 < canceled multipart upload key=N9RQIGHVL8VP upload=RP8U94VW9MVY tag=3EBP8YK3PBXB type=write size=3004372 2024-09-12T00:34:25.304 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.305+0000 7f1f2d864780 1 > prepared part key=_multipart_2YCGIJRK6MUH.2~Z4KXRTWGSXJM.0 size=1048576 2024-09-12T00:34:25.305 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.306+0000 7f1f2d864780 1 > prepared part key=_multipart_2YCGIJRK6MUH.2~Z4KXRTWGSXJM.1 size=1048576 2024-09-12T00:34:25.305 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.307+0000 7f1f2d864780 1 > prepared part key=_multipart_2YCGIJRK6MUH.2~Z4KXRTWGSXJM.2 size=768142 2024-09-12T00:34:25.306 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.307+0000 7f1f2d864780 1 > prepared multipart upload key=2YCGIJRK6MUH upload=Z4KXRTWGSXJM tag=GAXGUAHGYJOY type=write size=3913870 2024-09-12T00:34:25.307 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.308+0000 7f1f2d864780 -1 < failed to complete operation key=WKK747ETLW10 tag=ALPFJ0TEVQ6T type=del size=2915378: (22) Invalid argument 2024-09-12T00:34:25.309 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.310+0000 7f1f2d864780 1 > prepared part key=_multipart_AN26EVAZI527.2~BONSY26Y27R1.0 size=1048576 2024-09-12T00:34:25.310 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.311+0000 7f1f2d864780 1 > prepared part key=_multipart_AN26EVAZI527.2~BONSY26Y27R1.1 size=1048576 2024-09-12T00:34:25.310 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.312+0000 7f1f2d864780 1 > prepared part key=_multipart_AN26EVAZI527.2~BONSY26Y27R1.2 size=857900 2024-09-12T00:34:25.311 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.312+0000 7f1f2d864780 1 > prepared multipart upload key=AN26EVAZI527 upload=BONSY26Y27R1 tag=QZ8M64GKPHFY type=write size=4003628 2024-09-12T00:34:25.312 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.313+0000 7f1f2d864780 1 < completed part key=_multipart_WKK747ETLW10.2~3QNHI9IDUOFQ.0 size=1048576 2024-09-12T00:34:25.312 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.314+0000 7f1f2d864780 1 < completed part key=_multipart_WKK747ETLW10.2~3QNHI9IDUOFQ.1 size=1048576 2024-09-12T00:34:25.313 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.315+0000 7f1f2d864780 1 < completed part key=_multipart_WKK747ETLW10.2~3QNHI9IDUOFQ.2 size=172723 2024-09-12T00:34:25.315 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.317+0000 7f1f2d864780 1 < completed multipart upload key=WKK747ETLW10 upload=3QNHI9IDUOFQ tag=OPR6OIZII42M type=write size=3318451 2024-09-12T00:34:25.318 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.319+0000 7f1f2d864780 1 > prepared part key=_multipart_WIIU8VTCLWOD.2~NLUFOZ3JQJ35.0 size=770627 2024-09-12T00:34:25.318 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.319+0000 7f1f2d864780 1 > prepared multipart upload key=WIIU8VTCLWOD upload=NLUFOZ3JQJ35 tag=YAJ1HHL5Y0LX type=write size=1819203 2024-09-12T00:34:25.319 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.320+0000 7f1f2d864780 1 < completed write operation key=SZP418NVZ5VX tag=WN4TLJTCRW4A type=write size=844454 2024-09-12T00:34:25.320 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.322+0000 7f1f2d864780 1 > prepared operation key=FFG41OYEYFZA tag=ZHGA2XBJV8N1 type=del size=1843040 2024-09-12T00:34:25.321 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.323+0000 7f1f2d864780 1 < completed delete operation key=GSPM8N0K7ODC tag=42VXGW3DPIPZ type=del 2024-09-12T00:34:25.323 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.325+0000 7f1f2d864780 1 > prepared part key=_multipart_2G3UCYG4R4NM.2~JRE860F4ADBP.0 size=1048576 2024-09-12T00:34:25.324 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.326+0000 7f1f2d864780 1 > prepared part key=_multipart_2G3UCYG4R4NM.2~JRE860F4ADBP.1 size=1048576 2024-09-12T00:34:25.325 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.327+0000 7f1f2d864780 1 > prepared part key=_multipart_2G3UCYG4R4NM.2~JRE860F4ADBP.2 size=28877 2024-09-12T00:34:25.325 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.327+0000 7f1f2d864780 1 > prepared multipart upload key=2G3UCYG4R4NM upload=JRE860F4ADBP tag=HI7JNH83FUBR type=write size=3174605 2024-09-12T00:34:25.327 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.329+0000 7f1f2d864780 1 < suggested update operation key=3Z1TGGPZKJ69 tag=EOBVNIQBS26T type=del size=2598257 2024-09-12T00:34:25.329 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.331+0000 7f1f2d864780 1 > prepared part key=_multipart_2RV0899QUJ8W.2~O608LI2DV8YO.0 size=1048576 2024-09-12T00:34:25.330 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.332+0000 7f1f2d864780 1 > prepared part key=_multipart_2RV0899QUJ8W.2~O608LI2DV8YO.1 size=573925 2024-09-12T00:34:25.330 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.332+0000 7f1f2d864780 1 > prepared multipart upload key=2RV0899QUJ8W upload=O608LI2DV8YO tag=A2MDDEKLXMT8 type=write size=2671077 2024-09-12T00:34:25.331 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.333+0000 7f1f2d864780 1 < completed part key=_multipart_ZYNIJH0TTSM6.2~WASPU94BDLBH.0 size=811989 2024-09-12T00:34:25.333 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.335+0000 7f1f2d864780 1 < completed multipart upload key=ZYNIJH0TTSM6 upload=WASPU94BDLBH tag=MZBE1D90IK5V type=write size=1860565 2024-09-12T00:34:25.334 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.336+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=KWHBX6P03W4D type=del size=113210 2024-09-12T00:34:25.335 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.337+0000 7f1f2d864780 1 < completed delete operation key=2RV0899QUJ8W tag=42RMC20CUO92 type=del 2024-09-12T00:34:25.337 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.338+0000 7f1f2d864780 1 > prepared operation key=FAP6N3H7SBN0 tag=9YLUQQHI1KME type=del size=3715609 2024-09-12T00:34:25.338 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.339+0000 7f1f2d864780 1 < completed delete operation key=AN26EVAZI527 tag=ZTH5VSINXFRQ type=del 2024-09-12T00:34:25.339 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.341+0000 7f1f2d864780 1 > prepared operation key=2G3UCYG4R4NM tag=IMXFHR2DM82R type=del size=979303 2024-09-12T00:34:25.340 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.342+0000 7f1f2d864780 1 < completed part key=_multipart_FFG41OYEYFZA.2~YR4038UA9F0O.0 size=1048576 2024-09-12T00:34:25.341 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.343+0000 7f1f2d864780 1 < completed part key=_multipart_FFG41OYEYFZA.2~YR4038UA9F0O.1 size=497322 2024-09-12T00:34:25.343 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.345+0000 7f1f2d864780 1 < completed multipart upload key=FFG41OYEYFZA upload=YR4038UA9F0O tag=B4TDTFRM4366 type=write size=2594474 2024-09-12T00:34:25.345 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.347+0000 7f1f2d864780 1 > prepared part key=_multipart_OY145ZXRSF4L.2~WAYSRRXEI6Y0.0 size=1048576 2024-09-12T00:34:25.346 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.348+0000 7f1f2d864780 1 > prepared part key=_multipart_OY145ZXRSF4L.2~WAYSRRXEI6Y0.1 size=1048576 2024-09-12T00:34:25.347 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.348+0000 7f1f2d864780 1 > prepared part key=_multipart_OY145ZXRSF4L.2~WAYSRRXEI6Y0.2 size=118714 2024-09-12T00:34:25.347 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.348+0000 7f1f2d864780 1 > prepared multipart upload key=OY145ZXRSF4L upload=WAYSRRXEI6Y0 tag=P4WRNIHQ80R7 type=write size=3264442 2024-09-12T00:34:25.348 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.350+0000 7f1f2d864780 1 < completed part key=_multipart_4FRVL0KXN2X8.2~L4I035HE0XEJ.0 size=689998 2024-09-12T00:34:25.350 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.351+0000 7f1f2d864780 1 < completed multipart upload key=4FRVL0KXN2X8 upload=L4I035HE0XEJ tag=SKEE34Z30567 type=write size=1738574 2024-09-12T00:34:25.351 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.353+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=09L3SYM3PY9Z type=del size=666657 2024-09-12T00:34:25.352 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.354+0000 7f1f2d864780 1 < completed part key=_multipart_2RV0899QUJ8W.2~MAF2RUA3NMI3.0 size=1048576 2024-09-12T00:34:25.353 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.355+0000 7f1f2d864780 1 < completed part key=_multipart_2RV0899QUJ8W.2~MAF2RUA3NMI3.1 size=809386 2024-09-12T00:34:25.355 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.357+0000 7f1f2d864780 1 < completed multipart upload key=2RV0899QUJ8W upload=MAF2RUA3NMI3 tag=UQCPLTN3XAFY type=write size=2906538 2024-09-12T00:34:25.356 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.358+0000 7f1f2d864780 1 > prepared operation key=1299IOSGYIO9 tag=92DS6W88G6NI type=del size=3662329 2024-09-12T00:34:25.358 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.359+0000 7f1f2d864780 1 < completed delete operation key=WGKEA4EKF5GP tag=ZWYHH392EGY3 type=del 2024-09-12T00:34:25.359 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.361+0000 7f1f2d864780 1 > prepared operation key=SZP418NVZ5VX tag=SZCM3M7HCYA5 type=write size=111199 2024-09-12T00:34:25.360 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.362+0000 7f1f2d864780 1 < completed delete operation key=DYKLAY6J018G tag=T72FD8IOI35K type=del 2024-09-12T00:34:25.361 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.363+0000 7f1f2d864780 1 > prepared operation key=ECZYQEZ942W8 tag=ND9KG6JF3O86 type=del size=1488165 2024-09-12T00:34:25.362 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.364+0000 7f1f2d864780 1 < completed delete operation key=53QCNWX1V1R1 tag=QB233D2H82U3 type=del 2024-09-12T00:34:25.365 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.366+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~7Q474O4JJT0L.0 size=1048576 2024-09-12T00:34:25.366 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.367+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~7Q474O4JJT0L.1 size=909978 2024-09-12T00:34:25.366 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.367+0000 7f1f2d864780 1 > prepared multipart upload key=SZP418NVZ5VX upload=7Q474O4JJT0L tag=RYUWO1BN4EM0 type=write size=3007130 2024-09-12T00:34:25.368 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.370+0000 7f1f2d864780 1 < completed part key=_multipart_DYKLAY6J018G.2~KCLW0L5842UF.0 size=1017409 2024-09-12T00:34:25.370 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.372+0000 7f1f2d864780 1 < completed multipart upload key=DYKLAY6J018G upload=KCLW0L5842UF tag=5P8UNK94K9JK type=write size=2065985 2024-09-12T00:34:25.372 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.374+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~CETMTCHMAIGF.0 size=1048576 2024-09-12T00:34:25.373 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.375+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~CETMTCHMAIGF.1 size=1048576 2024-09-12T00:34:25.374 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.376+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~CETMTCHMAIGF.2 size=20223 2024-09-12T00:34:25.374 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.376+0000 7f1f2d864780 1 > prepared multipart upload key=W6U30X4HJCB1 upload=CETMTCHMAIGF tag=1TKWDA0KPAGJ type=write size=3165951 2024-09-12T00:34:25.376 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.377+0000 7f1f2d864780 1 < completed part key=_multipart_2YCGIJRK6MUH.2~Z4KXRTWGSXJM.0 size=1048576 2024-09-12T00:34:25.377 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.378+0000 7f1f2d864780 1 < completed part key=_multipart_2YCGIJRK6MUH.2~Z4KXRTWGSXJM.1 size=1048576 2024-09-12T00:34:25.378 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.379+0000 7f1f2d864780 1 < completed part key=_multipart_2YCGIJRK6MUH.2~Z4KXRTWGSXJM.2 size=768142 2024-09-12T00:34:25.380 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.381+0000 7f1f2d864780 1 < completed multipart upload key=2YCGIJRK6MUH upload=Z4KXRTWGSXJM tag=GAXGUAHGYJOY type=write size=3913870 2024-09-12T00:34:25.381 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.383+0000 7f1f2d864780 1 > prepared operation key=0DSQOFS8IIF5 tag=543M5GCM73KK type=del size=3237115 2024-09-12T00:34:25.382 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.384+0000 7f1f2d864780 1 < completed part key=_multipart_AN26EVAZI527.2~BONSY26Y27R1.0 size=1048576 2024-09-12T00:34:25.384 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.385+0000 7f1f2d864780 1 < completed part key=_multipart_AN26EVAZI527.2~BONSY26Y27R1.1 size=1048576 2024-09-12T00:34:25.385 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.386+0000 7f1f2d864780 1 < completed part key=_multipart_AN26EVAZI527.2~BONSY26Y27R1.2 size=857900 2024-09-12T00:34:25.387 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.389+0000 7f1f2d864780 1 < completed multipart upload key=AN26EVAZI527 upload=BONSY26Y27R1 tag=QZ8M64GKPHFY type=write size=4003628 2024-09-12T00:34:25.389 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.391+0000 7f1f2d864780 1 > prepared part key=_multipart_2G3UCYG4R4NM.2~FPTELSCSI6AZ.0 size=960650 2024-09-12T00:34:25.389 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.391+0000 7f1f2d864780 1 > prepared multipart upload key=2G3UCYG4R4NM upload=FPTELSCSI6AZ tag=9UITBW0AD5DK type=write size=2009226 2024-09-12T00:34:25.392 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.392+0000 7f1f2d864780 1 < completed part key=_multipart_WIIU8VTCLWOD.2~NLUFOZ3JQJ35.0 size=770627 2024-09-12T00:34:25.392 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.394+0000 7f1f2d864780 1 < completed multipart upload key=WIIU8VTCLWOD upload=NLUFOZ3JQJ35 tag=YAJ1HHL5Y0LX type=write size=1819203 2024-09-12T00:34:25.395 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.396+0000 7f1f2d864780 1 > prepared part key=_multipart_2RV0899QUJ8W.2~ENV1LFB6LNX0.0 size=1048576 2024-09-12T00:34:25.396 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.397+0000 7f1f2d864780 1 > prepared part key=_multipart_2RV0899QUJ8W.2~ENV1LFB6LNX0.1 size=1048576 2024-09-12T00:34:25.396 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.398+0000 7f1f2d864780 1 > prepared part key=_multipart_2RV0899QUJ8W.2~ENV1LFB6LNX0.2 size=735724 2024-09-12T00:34:25.397 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.398+0000 7f1f2d864780 1 > prepared multipart upload key=2RV0899QUJ8W upload=ENV1LFB6LNX0 tag=RTZYM4AHYV5U type=write size=3881452 2024-09-12T00:34:25.398 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.399+0000 7f1f2d864780 1 < completed delete operation key=FFG41OYEYFZA tag=ZHGA2XBJV8N1 type=del 2024-09-12T00:34:25.400 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.402+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~3Y3VD9GOUQ8N.0 size=1048576 2024-09-12T00:34:25.401 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.403+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~3Y3VD9GOUQ8N.1 size=1048576 2024-09-12T00:34:25.402 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.403+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~3Y3VD9GOUQ8N.2 size=852262 2024-09-12T00:34:25.402 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.403+0000 7f1f2d864780 1 > prepared multipart upload key=WGKEA4EKF5GP upload=3Y3VD9GOUQ8N tag=9NF2QH2VGLSX type=write size=3997990 2024-09-12T00:34:25.403 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.404+0000 7f1f2d864780 1 < canceled part key=_multipart_2G3UCYG4R4NM.2~JRE860F4ADBP.0 size=1048576 2024-09-12T00:34:25.403 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.405+0000 7f1f2d864780 1 < completed part key=_multipart_2G3UCYG4R4NM.2~JRE860F4ADBP.1 size=1048576 2024-09-12T00:34:25.404 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.406+0000 7f1f2d864780 1 < completed part key=_multipart_2G3UCYG4R4NM.2~JRE860F4ADBP.2 size=28877 2024-09-12T00:34:25.407 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.408+0000 7f1f2d864780 1 < canceled multipart upload key=2G3UCYG4R4NM upload=JRE860F4ADBP tag=HI7JNH83FUBR type=write size=3174605 2024-09-12T00:34:25.408 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.410+0000 7f1f2d864780 1 > prepared operation key=GSPM8N0K7ODC tag=1BJTDOOG7Z3X type=del size=4168087 2024-09-12T00:34:25.409 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.411+0000 7f1f2d864780 1 < completed part key=_multipart_2RV0899QUJ8W.2~O608LI2DV8YO.0 size=1048576 2024-09-12T00:34:25.410 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.412+0000 7f1f2d864780 1 < completed part key=_multipart_2RV0899QUJ8W.2~O608LI2DV8YO.1 size=573925 2024-09-12T00:34:25.412 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.414+0000 7f1f2d864780 1 < completed multipart upload key=2RV0899QUJ8W upload=O608LI2DV8YO tag=A2MDDEKLXMT8 type=write size=2671077 2024-09-12T00:34:25.413 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.415+0000 7f1f2d864780 1 > prepared operation key=1299IOSGYIO9 tag=C8KRGWHPVCYA type=del size=2519020 2024-09-12T00:34:25.415 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.417+0000 7f1f2d864780 1 < suggested remove operation key=2RV0899QUJ8W tag=KWHBX6P03W4D type=del 2024-09-12T00:34:25.416 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.418+0000 7f1f2d864780 1 > prepared operation key=ZGO887JDR627 tag=N7SNY1ANYGLT type=del size=2778014 2024-09-12T00:34:25.417 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.419+0000 7f1f2d864780 1 < canceled operation key=FAP6N3H7SBN0 tag=9YLUQQHI1KME type=del size=3715609 2024-09-12T00:34:25.418 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.420+0000 7f1f2d864780 1 > prepared operation key=2G3UCYG4R4NM tag=VWYEZES2R90V type=del size=525951 2024-09-12T00:34:25.420 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.421+0000 7f1f2d864780 1 < completed delete operation key=2G3UCYG4R4NM tag=IMXFHR2DM82R type=del 2024-09-12T00:34:25.421 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.423+0000 7f1f2d864780 1 > prepared part key=_multipart_UTR2UUO6DHLJ.2~2YKO5STY6DVP.0 size=1048576 2024-09-12T00:34:25.422 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.424+0000 7f1f2d864780 1 > prepared part key=_multipart_UTR2UUO6DHLJ.2~2YKO5STY6DVP.1 size=1048576 2024-09-12T00:34:25.423 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.425+0000 7f1f2d864780 1 > prepared part key=_multipart_UTR2UUO6DHLJ.2~2YKO5STY6DVP.2 size=579049 2024-09-12T00:34:25.423 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.425+0000 7f1f2d864780 1 > prepared multipart upload key=UTR2UUO6DHLJ upload=2YKO5STY6DVP tag=AQ7S12UB5NN2 type=write size=3724777 2024-09-12T00:34:25.424 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.426+0000 7f1f2d864780 1 < completed part key=_multipart_OY145ZXRSF4L.2~WAYSRRXEI6Y0.0 size=1048576 2024-09-12T00:34:25.425 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.427+0000 7f1f2d864780 1 < completed part key=_multipart_OY145ZXRSF4L.2~WAYSRRXEI6Y0.1 size=1048576 2024-09-12T00:34:25.426 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.428+0000 7f1f2d864780 1 < completed part key=_multipart_OY145ZXRSF4L.2~WAYSRRXEI6Y0.2 size=118714 2024-09-12T00:34:25.428 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.430+0000 7f1f2d864780 1 < completed multipart upload key=OY145ZXRSF4L upload=WAYSRRXEI6Y0 tag=P4WRNIHQ80R7 type=write size=3264442 2024-09-12T00:34:25.430 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.431+0000 7f1f2d864780 1 > prepared part key=_multipart_MSGU3PHLBRJH.2~8L4C6J231L4T.0 size=1002282 2024-09-12T00:34:25.430 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.431+0000 7f1f2d864780 1 > prepared multipart upload key=MSGU3PHLBRJH upload=8L4C6J231L4T tag=GZYCDXXGSKTQ type=write size=2050858 2024-09-12T00:34:25.431 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.432+0000 7f1f2d864780 -1 < failed to complete operation key=2RV0899QUJ8W tag=09L3SYM3PY9Z type=del size=666657: (22) Invalid argument 2024-09-12T00:34:25.432 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.434+0000 7f1f2d864780 1 > prepared operation key=S5DVMA14N7VJ tag=QFA248UC7CSE type=write size=552478 2024-09-12T00:34:25.433 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.435+0000 7f1f2d864780 1 < completed delete operation key=1299IOSGYIO9 tag=92DS6W88G6NI type=del 2024-09-12T00:34:25.435 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.437+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~JHM48SXRIJ6F.0 size=1048576 2024-09-12T00:34:25.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.438+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~JHM48SXRIJ6F.1 size=1048576 2024-09-12T00:34:25.437 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.439+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~JHM48SXRIJ6F.2 size=695680 2024-09-12T00:34:25.437 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.439+0000 7f1f2d864780 1 > prepared multipart upload key=D21W9QZWY0YU upload=JHM48SXRIJ6F tag=Y0YBHK1ASZV2 type=write size=3841408 2024-09-12T00:34:25.438 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.440+0000 7f1f2d864780 1 < completed write operation key=SZP418NVZ5VX tag=SZCM3M7HCYA5 type=write size=111199 2024-09-12T00:34:25.440 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.442+0000 7f1f2d864780 1 > prepared part key=_multipart_ECZYQEZ942W8.2~A2YAXRSN5L8B.0 size=1048576 2024-09-12T00:34:25.441 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.443+0000 7f1f2d864780 1 > prepared part key=_multipart_ECZYQEZ942W8.2~A2YAXRSN5L8B.1 size=569145 2024-09-12T00:34:25.441 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.443+0000 7f1f2d864780 1 > prepared multipart upload key=ECZYQEZ942W8 upload=A2YAXRSN5L8B tag=PEMBXTEMY2BF type=write size=2666297 2024-09-12T00:34:25.443 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.445+0000 7f1f2d864780 1 < suggested remove operation key=ECZYQEZ942W8 tag=ND9KG6JF3O86 type=del 2024-09-12T00:34:25.444 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.446+0000 7f1f2d864780 1 > prepared operation key=3Z1TGGPZKJ69 tag=UCR8X7LA39JD type=del size=2578083 2024-09-12T00:34:25.445 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.447+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~7Q474O4JJT0L.0 size=1048576 2024-09-12T00:34:25.445 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.447+0000 7f1f2d864780 1 < canceled part key=_multipart_SZP418NVZ5VX.2~7Q474O4JJT0L.1 size=909978 2024-09-12T00:34:25.447 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.449+0000 7f1f2d864780 1 < canceled multipart upload key=SZP418NVZ5VX upload=7Q474O4JJT0L tag=RYUWO1BN4EM0 type=write size=3007130 2024-09-12T00:34:25.448 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.450+0000 7f1f2d864780 1 > prepared operation key=MSGU3PHLBRJH tag=L4NCP93TO8PH type=del size=1198868 2024-09-12T00:34:25.449 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.451+0000 7f1f2d864780 1 < completed part key=_multipart_W6U30X4HJCB1.2~CETMTCHMAIGF.0 size=1048576 2024-09-12T00:34:25.450 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.452+0000 7f1f2d864780 1 < completed part key=_multipart_W6U30X4HJCB1.2~CETMTCHMAIGF.1 size=1048576 2024-09-12T00:34:25.451 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.453+0000 7f1f2d864780 1 < completed part key=_multipart_W6U30X4HJCB1.2~CETMTCHMAIGF.2 size=20223 2024-09-12T00:34:25.453 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.454+0000 7f1f2d864780 1 < completed multipart upload key=W6U30X4HJCB1 upload=CETMTCHMAIGF tag=1TKWDA0KPAGJ type=write size=3165951 2024-09-12T00:34:25.454 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.456+0000 7f1f2d864780 1 > prepared operation key=ECZYQEZ942W8 tag=V8INF2HOH6HP type=del size=459923 2024-09-12T00:34:25.455 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.457+0000 7f1f2d864780 1 < completed delete operation key=0DSQOFS8IIF5 tag=543M5GCM73KK type=del 2024-09-12T00:34:25.457 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.459+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~IK2O2XU6T0WR.0 size=1048576 2024-09-12T00:34:25.458 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.460+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~IK2O2XU6T0WR.1 size=870381 2024-09-12T00:34:25.458 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.460+0000 7f1f2d864780 1 > prepared multipart upload key=0DSQOFS8IIF5 upload=IK2O2XU6T0WR tag=P1EJCBDS1MYG type=write size=2967533 2024-09-12T00:34:25.459 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.461+0000 7f1f2d864780 1 < completed part key=_multipart_2G3UCYG4R4NM.2~FPTELSCSI6AZ.0 size=960650 2024-09-12T00:34:25.461 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.463+0000 7f1f2d864780 1 < completed multipart upload key=2G3UCYG4R4NM upload=FPTELSCSI6AZ tag=9UITBW0AD5DK type=write size=2009226 2024-09-12T00:34:25.462 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.464+0000 7f1f2d864780 1 > prepared operation key=S5DVMA14N7VJ tag=0ZM18HWBA1WC type=del size=2169977 2024-09-12T00:34:25.463 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.465+0000 7f1f2d864780 1 < completed part key=_multipart_2RV0899QUJ8W.2~ENV1LFB6LNX0.0 size=1048576 2024-09-12T00:34:25.465 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.466+0000 7f1f2d864780 1 < completed part key=_multipart_2RV0899QUJ8W.2~ENV1LFB6LNX0.1 size=1048576 2024-09-12T00:34:25.465 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.467+0000 7f1f2d864780 1 < completed part key=_multipart_2RV0899QUJ8W.2~ENV1LFB6LNX0.2 size=735724 2024-09-12T00:34:25.467 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.469+0000 7f1f2d864780 1 < completed multipart upload key=2RV0899QUJ8W upload=ENV1LFB6LNX0 tag=RTZYM4AHYV5U type=write size=3881452 2024-09-12T00:34:25.469 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.471+0000 7f1f2d864780 1 > prepared part key=_multipart_O1YY03BOEYLM.2~ODEUMQFFGWRH.0 size=649350 2024-09-12T00:34:25.469 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.471+0000 7f1f2d864780 1 > prepared multipart upload key=O1YY03BOEYLM upload=ODEUMQFFGWRH tag=OR7CQ0T4QZZY type=write size=1697926 2024-09-12T00:34:25.470 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.472+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~3Y3VD9GOUQ8N.0 size=1048576 2024-09-12T00:34:25.471 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.473+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~3Y3VD9GOUQ8N.1 size=1048576 2024-09-12T00:34:25.471 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.473+0000 7f1f2d864780 1 < canceled part key=_multipart_WGKEA4EKF5GP.2~3Y3VD9GOUQ8N.2 size=852262 2024-09-12T00:34:25.473 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.475+0000 7f1f2d864780 1 < canceled multipart upload key=WGKEA4EKF5GP upload=3Y3VD9GOUQ8N tag=9NF2QH2VGLSX type=write size=3997990 2024-09-12T00:34:25.475 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.476+0000 7f1f2d864780 1 > prepared operation key=W6U30X4HJCB1 tag=JYFFK1YDG7KA type=write size=728192 2024-09-12T00:34:25.477 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.478+0000 7f1f2d864780 1 < suggested remove operation key=GSPM8N0K7ODC tag=1BJTDOOG7Z3X type=del 2024-09-12T00:34:25.479 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.480+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~TPT2HI7TNWRB.0 size=1048576 2024-09-12T00:34:25.480 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.481+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~TPT2HI7TNWRB.1 size=1048576 2024-09-12T00:34:25.481 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.482+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~TPT2HI7TNWRB.2 size=35 2024-09-12T00:34:25.481 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.482+0000 7f1f2d864780 1 > prepared multipart upload key=0DSQOFS8IIF5 upload=TPT2HI7TNWRB tag=9I7JOPU36SB4 type=write size=3145763 2024-09-12T00:34:25.482 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.483+0000 7f1f2d864780 1 < completed delete operation key=1299IOSGYIO9 tag=C8KRGWHPVCYA type=del 2024-09-12T00:34:25.484 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.486+0000 7f1f2d864780 1 > prepared part key=_multipart_53QCNWX1V1R1.2~KITVKTSQPQY6.0 size=682594 2024-09-12T00:34:25.484 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.486+0000 7f1f2d864780 1 > prepared multipart upload key=53QCNWX1V1R1 upload=KITVKTSQPQY6 tag=JWNZINGIXS5W type=write size=1731170 2024-09-12T00:34:25.485 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.487+0000 7f1f2d864780 1 < completed delete operation key=ZGO887JDR627 tag=N7SNY1ANYGLT type=del 2024-09-12T00:34:25.487 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.488+0000 7f1f2d864780 1 > prepared operation key=AN26EVAZI527 tag=K9KSIW5G30MP type=del size=188407 2024-09-12T00:34:25.488 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.490+0000 7f1f2d864780 1 < completed delete operation key=2G3UCYG4R4NM tag=VWYEZES2R90V type=del 2024-09-12T00:34:25.489 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.491+0000 7f1f2d864780 1 > prepared operation key=KHPF1N1MT33Z tag=V8IF230I9LGA type=del size=2446090 2024-09-12T00:34:25.491 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.492+0000 7f1f2d864780 1 < completed part key=_multipart_UTR2UUO6DHLJ.2~2YKO5STY6DVP.0 size=1048576 2024-09-12T00:34:25.492 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.493+0000 7f1f2d864780 1 < completed part key=_multipart_UTR2UUO6DHLJ.2~2YKO5STY6DVP.1 size=1048576 2024-09-12T00:34:25.492 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.494+0000 7f1f2d864780 1 < completed part key=_multipart_UTR2UUO6DHLJ.2~2YKO5STY6DVP.2 size=579049 2024-09-12T00:34:25.495 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.496+0000 7f1f2d864780 1 < completed multipart upload key=UTR2UUO6DHLJ upload=2YKO5STY6DVP tag=AQ7S12UB5NN2 type=write size=3724777 2024-09-12T00:34:25.496 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.498+0000 7f1f2d864780 1 > prepared operation key=1299IOSGYIO9 tag=3DN0T0TKUJOR type=write size=706129 2024-09-12T00:34:25.497 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.498+0000 7f1f2d864780 1 < canceled part key=_multipart_MSGU3PHLBRJH.2~8L4C6J231L4T.0 size=1002282 2024-09-12T00:34:25.499 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.500+0000 7f1f2d864780 1 < canceled multipart upload key=MSGU3PHLBRJH upload=8L4C6J231L4T tag=GZYCDXXGSKTQ type=write size=2050858 2024-09-12T00:34:25.500 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.502+0000 7f1f2d864780 1 > prepared operation key=OY145ZXRSF4L tag=7TLHJ5EF3RWR type=del size=1844127 2024-09-12T00:34:25.503 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.504+0000 7f1f2d864780 1 < suggested update operation key=S5DVMA14N7VJ tag=QFA248UC7CSE type=write size=552478 2024-09-12T00:34:25.504 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.506+0000 7f1f2d864780 1 > prepared operation key=ZGO887JDR627 tag=MVX5R01NASM4 type=del size=478134 2024-09-12T00:34:25.505 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.507+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~JHM48SXRIJ6F.0 size=1048576 2024-09-12T00:34:25.506 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.508+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~JHM48SXRIJ6F.1 size=1048576 2024-09-12T00:34:25.507 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.509+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~JHM48SXRIJ6F.2 size=695680 2024-09-12T00:34:25.509 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.511+0000 7f1f2d864780 1 < completed multipart upload key=D21W9QZWY0YU upload=JHM48SXRIJ6F tag=Y0YBHK1ASZV2 type=write size=3841408 2024-09-12T00:34:25.511 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.512+0000 7f1f2d864780 1 > prepared operation key=AN26EVAZI527 tag=HVD7WGX7MSQP type=del size=589303 2024-09-12T00:34:25.513 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.515+0000 7f1f2d864780 1 < completed part key=_multipart_ECZYQEZ942W8.2~A2YAXRSN5L8B.0 size=1048576 2024-09-12T00:34:25.514 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.516+0000 7f1f2d864780 1 < completed part key=_multipart_ECZYQEZ942W8.2~A2YAXRSN5L8B.1 size=569145 2024-09-12T00:34:25.517 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.518+0000 7f1f2d864780 1 < completed multipart upload key=ECZYQEZ942W8 upload=A2YAXRSN5L8B tag=PEMBXTEMY2BF type=write size=2666297 2024-09-12T00:34:25.518 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.519+0000 7f1f2d864780 1 > prepared operation key=FFG41OYEYFZA tag=1FG2OQ3ALDAA type=del size=505242 2024-09-12T00:34:25.519 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.521+0000 7f1f2d864780 1 < completed delete operation key=3Z1TGGPZKJ69 tag=UCR8X7LA39JD type=del 2024-09-12T00:34:25.520 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.522+0000 7f1f2d864780 1 > prepared operation key=3Z1TGGPZKJ69 tag=LN3Z3I2XSQV3 type=del size=2819180 2024-09-12T00:34:25.522 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.524+0000 7f1f2d864780 1 < completed delete operation key=MSGU3PHLBRJH tag=L4NCP93TO8PH type=del 2024-09-12T00:34:25.523 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.525+0000 7f1f2d864780 1 > prepared operation key=2G3UCYG4R4NM tag=BXORAU739SLD type=del size=3377253 2024-09-12T00:34:25.524 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.526+0000 7f1f2d864780 1 < completed delete operation key=ECZYQEZ942W8 tag=V8INF2HOH6HP type=del 2024-09-12T00:34:25.525 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.527+0000 7f1f2d864780 1 > prepared operation key=ECZYQEZ942W8 tag=TNAWXF904UU5 type=del size=3898808 2024-09-12T00:34:25.527 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.528+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~IK2O2XU6T0WR.0 size=1048576 2024-09-12T00:34:25.528 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.529+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~IK2O2XU6T0WR.1 size=870381 2024-09-12T00:34:25.529 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.531+0000 7f1f2d864780 1 < completed multipart upload key=0DSQOFS8IIF5 upload=IK2O2XU6T0WR tag=P1EJCBDS1MYG type=write size=2967533 2024-09-12T00:34:25.532 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.533+0000 7f1f2d864780 1 > prepared part key=_multipart_SNCGB6Z20450.2~DVIBVDOSFJJ5.0 size=1048576 2024-09-12T00:34:25.533 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.534+0000 7f1f2d864780 1 > prepared part key=_multipart_SNCGB6Z20450.2~DVIBVDOSFJJ5.1 size=868192 2024-09-12T00:34:25.533 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.534+0000 7f1f2d864780 1 > prepared multipart upload key=SNCGB6Z20450 upload=DVIBVDOSFJJ5 tag=0I4KJCGRTF0J type=write size=2965344 2024-09-12T00:34:25.535 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.536+0000 7f1f2d864780 1 < suggested remove operation key=S5DVMA14N7VJ tag=0ZM18HWBA1WC type=del 2024-09-12T00:34:25.537 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.538+0000 7f1f2d864780 1 > prepared part key=_multipart_53QCNWX1V1R1.2~HUVT23N8HGGS.0 size=236469 2024-09-12T00:34:25.537 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.538+0000 7f1f2d864780 1 > prepared multipart upload key=53QCNWX1V1R1 upload=HUVT23N8HGGS tag=AQJ1CB0W3KGV type=write size=1285045 2024-09-12T00:34:25.538 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.540+0000 7f1f2d864780 1 < completed part key=_multipart_O1YY03BOEYLM.2~ODEUMQFFGWRH.0 size=649350 2024-09-12T00:34:25.541 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.542+0000 7f1f2d864780 1 < completed multipart upload key=O1YY03BOEYLM upload=ODEUMQFFGWRH tag=OR7CQ0T4QZZY type=write size=1697926 2024-09-12T00:34:25.543 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.544+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~TZ50QKC33ODN.0 size=895675 2024-09-12T00:34:25.543 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.544+0000 7f1f2d864780 1 > prepared multipart upload key=1299IOSGYIO9 upload=TZ50QKC33ODN tag=27R6DX4CNWOF type=write size=1944251 2024-09-12T00:34:25.544 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.545+0000 7f1f2d864780 1 < completed write operation key=W6U30X4HJCB1 tag=JYFFK1YDG7KA type=write size=728192 2024-09-12T00:34:25.546 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.547+0000 7f1f2d864780 1 > prepared part key=_multipart_S5DVMA14N7VJ.2~P2KVRGRAVG0S.0 size=1048576 2024-09-12T00:34:25.547 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.548+0000 7f1f2d864780 1 > prepared part key=_multipart_S5DVMA14N7VJ.2~P2KVRGRAVG0S.1 size=1048576 2024-09-12T00:34:25.548 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.549+0000 7f1f2d864780 1 > prepared part key=_multipart_S5DVMA14N7VJ.2~P2KVRGRAVG0S.2 size=152531 2024-09-12T00:34:25.548 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.549+0000 7f1f2d864780 1 > prepared multipart upload key=S5DVMA14N7VJ upload=P2KVRGRAVG0S tag=OOT67H1KPELJ type=write size=3298259 2024-09-12T00:34:25.549 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.550+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~TPT2HI7TNWRB.0 size=1048576 2024-09-12T00:34:25.550 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.551+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~TPT2HI7TNWRB.1 size=1048576 2024-09-12T00:34:25.551 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.552+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~TPT2HI7TNWRB.2 size=35 2024-09-12T00:34:25.553 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.554+0000 7f1f2d864780 1 < completed multipart upload key=0DSQOFS8IIF5 upload=TPT2HI7TNWRB tag=9I7JOPU36SB4 type=write size=3145763 2024-09-12T00:34:25.555 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.556+0000 7f1f2d864780 1 > prepared part key=_multipart_N9RQIGHVL8VP.2~1VVHROMDD2ZO.0 size=217849 2024-09-12T00:34:25.555 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.556+0000 7f1f2d864780 1 > prepared multipart upload key=N9RQIGHVL8VP upload=1VVHROMDD2ZO tag=E4HNNJRNY0B4 type=write size=1266425 2024-09-12T00:34:25.556 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.558+0000 7f1f2d864780 1 < completed part key=_multipart_53QCNWX1V1R1.2~KITVKTSQPQY6.0 size=682594 2024-09-12T00:34:25.558 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.559+0000 7f1f2d864780 1 < completed multipart upload key=53QCNWX1V1R1 upload=KITVKTSQPQY6 tag=JWNZINGIXS5W type=write size=1731170 2024-09-12T00:34:25.559 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.560+0000 7f1f2d864780 1 > prepared operation key=3Z1TGGPZKJ69 tag=R0SAT7CPGWVT type=del size=3124583 2024-09-12T00:34:25.560 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.562+0000 7f1f2d864780 1 < canceled operation key=AN26EVAZI527 tag=K9KSIW5G30MP type=del size=188407 2024-09-12T00:34:25.562 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.564+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~2Z83SJKN40S5.0 size=608920 2024-09-12T00:34:25.562 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.564+0000 7f1f2d864780 1 > prepared multipart upload key=SZP418NVZ5VX upload=2Z83SJKN40S5 tag=95I7SETJIPB4 type=write size=1657496 2024-09-12T00:34:25.563 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.565+0000 7f1f2d864780 1 < completed delete operation key=KHPF1N1MT33Z tag=V8IF230I9LGA type=del 2024-09-12T00:34:25.565 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.567+0000 7f1f2d864780 1 > prepared part key=_multipart_KHPF1N1MT33Z.2~2158WRU25HFN.0 size=532605 2024-09-12T00:34:25.565 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.567+0000 7f1f2d864780 1 > prepared multipart upload key=KHPF1N1MT33Z upload=2158WRU25HFN tag=F8PNXBCLVN70 type=write size=1581181 2024-09-12T00:34:25.566 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.568+0000 7f1f2d864780 1 < completed write operation key=1299IOSGYIO9 tag=3DN0T0TKUJOR type=write size=706129 2024-09-12T00:34:25.569 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.570+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~B3M7SL7KFKPR.0 size=1048576 2024-09-12T00:34:25.570 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.571+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~B3M7SL7KFKPR.1 size=975088 2024-09-12T00:34:25.570 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.571+0000 7f1f2d864780 1 > prepared multipart upload key=W6U30X4HJCB1 upload=B3M7SL7KFKPR tag=J6SNQ54X45U4 type=write size=3072240 2024-09-12T00:34:25.571 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.573+0000 7f1f2d864780 1 < completed delete operation key=OY145ZXRSF4L tag=7TLHJ5EF3RWR type=del 2024-09-12T00:34:25.572 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.574+0000 7f1f2d864780 1 > prepared operation key=WKK747ETLW10 tag=S6QI7WDE3DGQ type=del size=1135647 2024-09-12T00:34:25.573 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.575+0000 7f1f2d864780 1 < completed delete operation key=ZGO887JDR627 tag=MVX5R01NASM4 type=del 2024-09-12T00:34:25.574 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.576+0000 7f1f2d864780 1 > prepared operation key=FAP6N3H7SBN0 tag=FECHOPAG71F7 type=write size=158227 2024-09-12T00:34:25.576 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.577+0000 7f1f2d864780 1 < completed delete operation key=AN26EVAZI527 tag=HVD7WGX7MSQP type=del 2024-09-12T00:34:25.577 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.579+0000 7f1f2d864780 1 > prepared operation key=DYKLAY6J018G tag=U6AB8RD79CPK type=write size=972417 2024-09-12T00:34:25.579 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.580+0000 7f1f2d864780 1 < completed delete operation key=FFG41OYEYFZA tag=1FG2OQ3ALDAA type=del 2024-09-12T00:34:25.579 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.581+0000 7f1f2d864780 1 > prepared operation key=SNCGB6Z20450 tag=XDFFV3E16ZFJ type=del size=3875838 2024-09-12T00:34:25.581 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.583+0000 7f1f2d864780 1 < completed delete operation key=3Z1TGGPZKJ69 tag=LN3Z3I2XSQV3 type=del 2024-09-12T00:34:25.582 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.584+0000 7f1f2d864780 1 > prepared operation key=PVB52GO6L8T4 tag=FWYEWUW79HUI type=del size=359144 2024-09-12T00:34:25.583 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.585+0000 7f1f2d864780 1 < completed delete operation key=2G3UCYG4R4NM tag=BXORAU739SLD type=del 2024-09-12T00:34:25.585 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.587+0000 7f1f2d864780 1 > prepared part key=_multipart_OY145ZXRSF4L.2~LGU5P6HPXM4D.0 size=313244 2024-09-12T00:34:25.586 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.587+0000 7f1f2d864780 1 > prepared multipart upload key=OY145ZXRSF4L upload=LGU5P6HPXM4D tag=LG133D8XHF1H type=write size=1361820 2024-09-12T00:34:25.588 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.589+0000 7f1f2d864780 1 < suggested remove operation key=ECZYQEZ942W8 tag=TNAWXF904UU5 type=del 2024-09-12T00:34:25.590 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.591+0000 7f1f2d864780 1 > prepared operation key=MSGU3PHLBRJH tag=XGFN8UKNHYJ2 type=del size=1148669 2024-09-12T00:34:25.591 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.592+0000 7f1f2d864780 1 < completed part key=_multipart_SNCGB6Z20450.2~DVIBVDOSFJJ5.0 size=1048576 2024-09-12T00:34:25.591 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.592+0000 7f1f2d864780 1 < canceled part key=_multipart_SNCGB6Z20450.2~DVIBVDOSFJJ5.1 size=868192 2024-09-12T00:34:25.593 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.595+0000 7f1f2d864780 1 < canceled multipart upload key=SNCGB6Z20450 upload=DVIBVDOSFJJ5 tag=0I4KJCGRTF0J type=write size=2965344 2024-09-12T00:34:25.595 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.597+0000 7f1f2d864780 1 > prepared part key=_multipart_KHPF1N1MT33Z.2~APIHR3IN7JYF.0 size=206980 2024-09-12T00:34:25.595 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.597+0000 7f1f2d864780 1 > prepared multipart upload key=KHPF1N1MT33Z upload=APIHR3IN7JYF tag=PEES6OY83PKF type=write size=1255556 2024-09-12T00:34:25.596 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.598+0000 7f1f2d864780 1 < completed part key=_multipart_53QCNWX1V1R1.2~HUVT23N8HGGS.0 size=236469 2024-09-12T00:34:25.600 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.600+0000 7f1f2d864780 1 < completed multipart upload key=53QCNWX1V1R1 upload=HUVT23N8HGGS tag=AQJ1CB0W3KGV type=write size=1285045 2024-09-12T00:34:25.600 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.602+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~3Q6O3D3Z1K3K.0 size=695760 2024-09-12T00:34:25.600 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.602+0000 7f1f2d864780 1 > prepared multipart upload key=D21W9QZWY0YU upload=3Q6O3D3Z1K3K tag=H9OQMRHJACNZ type=write size=1744336 2024-09-12T00:34:25.601 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.602+0000 7f1f2d864780 1 < canceled part key=_multipart_1299IOSGYIO9.2~TZ50QKC33ODN.0 size=895675 2024-09-12T00:34:25.602 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.604+0000 7f1f2d864780 1 < canceled multipart upload key=1299IOSGYIO9 upload=TZ50QKC33ODN tag=27R6DX4CNWOF type=write size=1944251 2024-09-12T00:34:25.604 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.605+0000 7f1f2d864780 1 > prepared operation key=N9RQIGHVL8VP tag=5DEN9RMLTA19 type=write size=808157 2024-09-12T00:34:25.604 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.606+0000 7f1f2d864780 1 < canceled part key=_multipart_S5DVMA14N7VJ.2~P2KVRGRAVG0S.0 size=1048576 2024-09-12T00:34:25.605 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.607+0000 7f1f2d864780 1 < completed part key=_multipart_S5DVMA14N7VJ.2~P2KVRGRAVG0S.1 size=1048576 2024-09-12T00:34:25.606 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.608+0000 7f1f2d864780 1 < completed part key=_multipart_S5DVMA14N7VJ.2~P2KVRGRAVG0S.2 size=152531 2024-09-12T00:34:25.608 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.610+0000 7f1f2d864780 1 < canceled multipart upload key=S5DVMA14N7VJ upload=P2KVRGRAVG0S tag=OOT67H1KPELJ type=write size=3298259 2024-09-12T00:34:25.609 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.611+0000 7f1f2d864780 1 > prepared operation key=SNCGB6Z20450 tag=PXF0AUX9V4NG type=del size=512655 2024-09-12T00:34:25.610 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.612+0000 7f1f2d864780 1 < completed part key=_multipart_N9RQIGHVL8VP.2~1VVHROMDD2ZO.0 size=217849 2024-09-12T00:34:25.612 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.614+0000 7f1f2d864780 1 < completed multipart upload key=N9RQIGHVL8VP upload=1VVHROMDD2ZO tag=E4HNNJRNY0B4 type=write size=1266425 2024-09-12T00:34:25.614 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.616+0000 7f1f2d864780 1 > prepared part key=_multipart_3Z1TGGPZKJ69.2~UKCEINZ85O3X.0 size=1048576 2024-09-12T00:34:25.616 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.617+0000 7f1f2d864780 1 > prepared part key=_multipart_3Z1TGGPZKJ69.2~UKCEINZ85O3X.1 size=1048576 2024-09-12T00:34:25.617 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.619+0000 7f1f2d864780 1 > prepared part key=_multipart_3Z1TGGPZKJ69.2~UKCEINZ85O3X.2 size=87340 2024-09-12T00:34:25.617 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.619+0000 7f1f2d864780 1 > prepared multipart upload key=3Z1TGGPZKJ69 upload=UKCEINZ85O3X tag=3J4NMMY7L2R2 type=write size=3233068 2024-09-12T00:34:25.618 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.620+0000 7f1f2d864780 1 < completed delete operation key=3Z1TGGPZKJ69 tag=R0SAT7CPGWVT type=del 2024-09-12T00:34:25.620 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.622+0000 7f1f2d864780 1 > prepared part key=_multipart_SNCGB6Z20450.2~DAUVEMOSG0MK.0 size=69201 2024-09-12T00:34:25.621 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.622+0000 7f1f2d864780 1 > prepared multipart upload key=SNCGB6Z20450 upload=DAUVEMOSG0MK tag=NAISTEETD2TK type=write size=1117777 2024-09-12T00:34:25.622 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.623+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~2Z83SJKN40S5.0 size=608920 2024-09-12T00:34:25.624 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.625+0000 7f1f2d864780 1 < completed multipart upload key=SZP418NVZ5VX upload=2Z83SJKN40S5 tag=95I7SETJIPB4 type=write size=1657496 2024-09-12T00:34:25.626 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.628+0000 7f1f2d864780 1 > prepared operation key=3Z1TGGPZKJ69 tag=VBAH2BRVGFO1 type=del size=425942 2024-09-12T00:34:25.629 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.630+0000 7f1f2d864780 1 < completed part key=_multipart_KHPF1N1MT33Z.2~2158WRU25HFN.0 size=532605 2024-09-12T00:34:25.632 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.634+0000 7f1f2d864780 1 < completed multipart upload key=KHPF1N1MT33Z upload=2158WRU25HFN tag=F8PNXBCLVN70 type=write size=1581181 2024-09-12T00:34:25.633 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.635+0000 7f1f2d864780 1 > prepared operation key=DYKLAY6J018G tag=6XYQ7465DFMV type=del size=1141935 2024-09-12T00:34:25.634 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.636+0000 7f1f2d864780 1 < completed part key=_multipart_W6U30X4HJCB1.2~B3M7SL7KFKPR.0 size=1048576 2024-09-12T00:34:25.636 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.637+0000 7f1f2d864780 1 < completed part key=_multipart_W6U30X4HJCB1.2~B3M7SL7KFKPR.1 size=975088 2024-09-12T00:34:25.638 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.639+0000 7f1f2d864780 1 < completed multipart upload key=W6U30X4HJCB1 upload=B3M7SL7KFKPR tag=J6SNQ54X45U4 type=write size=3072240 2024-09-12T00:34:25.640 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.642+0000 7f1f2d864780 1 > prepared operation key=3Z1TGGPZKJ69 tag=HI6EBB274SA8 type=del size=2052820 2024-09-12T00:34:25.641 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.643+0000 7f1f2d864780 1 < completed delete operation key=WKK747ETLW10 tag=S6QI7WDE3DGQ type=del 2024-09-12T00:34:25.643 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.644+0000 7f1f2d864780 1 > prepared operation key=AN26EVAZI527 tag=6MYNG8CNAWHF type=write size=447162 2024-09-12T00:34:25.644 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.645+0000 7f1f2d864780 1 < completed write operation key=FAP6N3H7SBN0 tag=FECHOPAG71F7 type=write size=158227 2024-09-12T00:34:25.646 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.648+0000 7f1f2d864780 1 > prepared part key=_multipart_DYKLAY6J018G.2~VQSZONST83V9.0 size=1048576 2024-09-12T00:34:25.647 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.649+0000 7f1f2d864780 1 > prepared part key=_multipart_DYKLAY6J018G.2~VQSZONST83V9.1 size=208067 2024-09-12T00:34:25.647 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.649+0000 7f1f2d864780 1 > prepared multipart upload key=DYKLAY6J018G upload=VQSZONST83V9 tag=RYV6D9H2Q2MF type=write size=2305219 2024-09-12T00:34:25.649 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.651+0000 7f1f2d864780 1 < suggested remove operation key=DYKLAY6J018G tag=U6AB8RD79CPK type=write 2024-09-12T00:34:25.652 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.653+0000 7f1f2d864780 1 > prepared part key=_multipart_DYKLAY6J018G.2~N72W9AJY1LN4.0 size=1048576 2024-09-12T00:34:25.653 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.654+0000 7f1f2d864780 1 > prepared part key=_multipart_DYKLAY6J018G.2~N72W9AJY1LN4.1 size=285594 2024-09-12T00:34:25.653 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.654+0000 7f1f2d864780 1 > prepared multipart upload key=DYKLAY6J018G upload=N72W9AJY1LN4 tag=H34A2VM6X302 type=write size=2382746 2024-09-12T00:34:25.655 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.657+0000 7f1f2d864780 1 < suggested remove operation key=SNCGB6Z20450 tag=XDFFV3E16ZFJ type=del 2024-09-12T00:34:25.656 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.658+0000 7f1f2d864780 1 > prepared operation key=3Z1TGGPZKJ69 tag=GPD2HNYK142A type=del size=117087 2024-09-12T00:34:25.659 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.660+0000 7f1f2d864780 1 < suggested remove operation key=PVB52GO6L8T4 tag=FWYEWUW79HUI type=del 2024-09-12T00:34:25.661 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.663+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~T6RPNNBLBXRP.0 size=492802 2024-09-12T00:34:25.661 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.663+0000 7f1f2d864780 1 > prepared multipart upload key=WGKEA4EKF5GP upload=T6RPNNBLBXRP tag=1WHQMAU8MI5X type=write size=1541378 2024-09-12T00:34:25.662 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.664+0000 7f1f2d864780 1 < completed part key=_multipart_OY145ZXRSF4L.2~LGU5P6HPXM4D.0 size=313244 2024-09-12T00:34:25.664 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.666+0000 7f1f2d864780 1 < completed multipart upload key=OY145ZXRSF4L upload=LGU5P6HPXM4D tag=LG133D8XHF1H type=write size=1361820 2024-09-12T00:34:25.666 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.668+0000 7f1f2d864780 1 > prepared part key=_multipart_KHPF1N1MT33Z.2~UJMMNBWWW2HB.0 size=801727 2024-09-12T00:34:25.667 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.668+0000 7f1f2d864780 1 > prepared multipart upload key=KHPF1N1MT33Z upload=UJMMNBWWW2HB tag=96YKFEQEX3IW type=write size=1850303 2024-09-12T00:34:25.668 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.669+0000 7f1f2d864780 1 < completed delete operation key=MSGU3PHLBRJH tag=XGFN8UKNHYJ2 type=del 2024-09-12T00:34:25.669 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.671+0000 7f1f2d864780 1 > prepared operation key=ZGO887JDR627 tag=Z1SAHX83KBPF type=del size=1757707 2024-09-12T00:34:25.670 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.672+0000 7f1f2d864780 1 < completed part key=_multipart_KHPF1N1MT33Z.2~APIHR3IN7JYF.0 size=206980 2024-09-12T00:34:25.672 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.674+0000 7f1f2d864780 1 < completed multipart upload key=KHPF1N1MT33Z upload=APIHR3IN7JYF tag=PEES6OY83PKF type=write size=1255556 2024-09-12T00:34:25.674 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.676+0000 7f1f2d864780 1 > prepared part key=_multipart_53QCNWX1V1R1.2~DH4U9H527L08.0 size=1048576 2024-09-12T00:34:25.675 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.677+0000 7f1f2d864780 1 > prepared part key=_multipart_53QCNWX1V1R1.2~DH4U9H527L08.1 size=1048576 2024-09-12T00:34:25.676 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.677+0000 7f1f2d864780 1 > prepared part key=_multipart_53QCNWX1V1R1.2~DH4U9H527L08.2 size=78253 2024-09-12T00:34:25.676 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.677+0000 7f1f2d864780 1 > prepared multipart upload key=53QCNWX1V1R1 upload=DH4U9H527L08 tag=UEQ0POGSZFO2 type=write size=3223981 2024-09-12T00:34:25.677 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.679+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~3Q6O3D3Z1K3K.0 size=695760 2024-09-12T00:34:25.679 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.680+0000 7f1f2d864780 1 < completed multipart upload key=D21W9QZWY0YU upload=3Q6O3D3Z1K3K tag=H9OQMRHJACNZ type=write size=1744336 2024-09-12T00:34:25.682 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.683+0000 7f1f2d864780 1 > prepared operation key=N9RQIGHVL8VP tag=LZ4IK6IA8YLD type=del size=2790632 2024-09-12T00:34:25.683 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.684+0000 7f1f2d864780 1 < completed write operation key=N9RQIGHVL8VP tag=5DEN9RMLTA19 type=write size=808157 2024-09-12T00:34:25.685 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.687+0000 7f1f2d864780 1 > prepared part key=_multipart_2YCGIJRK6MUH.2~ESGEEL7892V7.0 size=1048576 2024-09-12T00:34:25.686 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.687+0000 7f1f2d864780 1 > prepared part key=_multipart_2YCGIJRK6MUH.2~ESGEEL7892V7.1 size=1048576 2024-09-12T00:34:25.687 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.688+0000 7f1f2d864780 1 > prepared part key=_multipart_2YCGIJRK6MUH.2~ESGEEL7892V7.2 size=595123 2024-09-12T00:34:25.687 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.688+0000 7f1f2d864780 1 > prepared multipart upload key=2YCGIJRK6MUH upload=ESGEEL7892V7 tag=F6JZ82W4LPI8 type=write size=3740851 2024-09-12T00:34:25.688 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.690+0000 7f1f2d864780 -1 < failed to complete operation key=SNCGB6Z20450 tag=PXF0AUX9V4NG type=del size=512655: (22) Invalid argument 2024-09-12T00:34:25.689 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.691+0000 7f1f2d864780 1 > prepared operation key=UTR2UUO6DHLJ tag=97C9GGX8CLD2 type=del size=2013500 2024-09-12T00:34:25.690 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.692+0000 7f1f2d864780 1 < completed part key=_multipart_3Z1TGGPZKJ69.2~UKCEINZ85O3X.0 size=1048576 2024-09-12T00:34:25.691 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.693+0000 7f1f2d864780 1 < completed part key=_multipart_3Z1TGGPZKJ69.2~UKCEINZ85O3X.1 size=1048576 2024-09-12T00:34:25.692 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.694+0000 7f1f2d864780 1 < completed part key=_multipart_3Z1TGGPZKJ69.2~UKCEINZ85O3X.2 size=87340 2024-09-12T00:34:25.694 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.696+0000 7f1f2d864780 1 < completed multipart upload key=3Z1TGGPZKJ69 upload=UKCEINZ85O3X tag=3J4NMMY7L2R2 type=write size=3233068 2024-09-12T00:34:25.695 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.697+0000 7f1f2d864780 1 > prepared operation key=D21W9QZWY0YU tag=KUNXPM6IA1ZY type=del size=477232 2024-09-12T00:34:25.697 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.698+0000 7f1f2d864780 1 < completed part key=_multipart_SNCGB6Z20450.2~DAUVEMOSG0MK.0 size=69201 2024-09-12T00:34:25.699 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.700+0000 7f1f2d864780 1 < completed multipart upload key=SNCGB6Z20450 upload=DAUVEMOSG0MK tag=NAISTEETD2TK type=write size=1117777 2024-09-12T00:34:25.700 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.701+0000 7f1f2d864780 1 > prepared operation key=DYKLAY6J018G tag=7DWSN4GQTCH4 type=write size=766617 2024-09-12T00:34:25.701 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.703+0000 7f1f2d864780 1 < completed delete operation key=3Z1TGGPZKJ69 tag=VBAH2BRVGFO1 type=del 2024-09-12T00:34:25.702 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.704+0000 7f1f2d864780 1 > prepared operation key=UTR2UUO6DHLJ tag=TVCU9J0PBIJJ type=del size=1731671 2024-09-12T00:34:25.704 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.705+0000 7f1f2d864780 -1 < failed to complete operation key=DYKLAY6J018G tag=6XYQ7465DFMV type=del size=1141935: (22) Invalid argument 2024-09-12T00:34:25.705 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.706+0000 7f1f2d864780 1 > prepared operation key=ZGO887JDR627 tag=KQY0K5YR4HW1 type=del size=1697712 2024-09-12T00:34:25.706 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.707+0000 7f1f2d864780 1 < completed delete operation key=3Z1TGGPZKJ69 tag=HI6EBB274SA8 type=del 2024-09-12T00:34:25.707 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.709+0000 7f1f2d864780 1 > prepared operation key=GSPM8N0K7ODC tag=2WLPCSS7562B type=del size=3736296 2024-09-12T00:34:25.708 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.710+0000 7f1f2d864780 1 < completed write operation key=AN26EVAZI527 tag=6MYNG8CNAWHF type=write size=447162 2024-09-12T00:34:25.710 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.712+0000 7f1f2d864780 1 > prepared part key=_multipart_OY145ZXRSF4L.2~FGOEY0LCXLJT.0 size=1048576 2024-09-12T00:34:25.711 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.713+0000 7f1f2d864780 1 > prepared part key=_multipart_OY145ZXRSF4L.2~FGOEY0LCXLJT.1 size=1048576 2024-09-12T00:34:25.712 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.714+0000 7f1f2d864780 1 > prepared part key=_multipart_OY145ZXRSF4L.2~FGOEY0LCXLJT.2 size=753295 2024-09-12T00:34:25.712 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.714+0000 7f1f2d864780 1 > prepared multipart upload key=OY145ZXRSF4L upload=FGOEY0LCXLJT tag=CKPNEBO9X02V type=write size=3899023 2024-09-12T00:34:25.713 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.715+0000 7f1f2d864780 1 < completed part key=_multipart_DYKLAY6J018G.2~VQSZONST83V9.0 size=1048576 2024-09-12T00:34:25.714 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.716+0000 7f1f2d864780 1 < completed part key=_multipart_DYKLAY6J018G.2~VQSZONST83V9.1 size=208067 2024-09-12T00:34:25.716 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.718+0000 7f1f2d864780 1 < completed multipart upload key=DYKLAY6J018G upload=VQSZONST83V9 tag=RYV6D9H2Q2MF type=write size=2305219 2024-09-12T00:34:25.717 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.719+0000 7f1f2d864780 1 > prepared operation key=3Z1TGGPZKJ69 tag=MLC5MXO7FEG7 type=del size=3191679 2024-09-12T00:34:25.719 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.720+0000 7f1f2d864780 1 < completed part key=_multipart_DYKLAY6J018G.2~N72W9AJY1LN4.0 size=1048576 2024-09-12T00:34:25.720 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.721+0000 7f1f2d864780 1 < completed part key=_multipart_DYKLAY6J018G.2~N72W9AJY1LN4.1 size=285594 2024-09-12T00:34:25.722 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.723+0000 7f1f2d864780 1 < completed multipart upload key=DYKLAY6J018G upload=N72W9AJY1LN4 tag=H34A2VM6X302 type=write size=2382746 2024-09-12T00:34:25.723 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.725+0000 7f1f2d864780 1 > prepared operation key=MSGU3PHLBRJH tag=R0FIKCBG7396 type=del size=525310 2024-09-12T00:34:25.724 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.726+0000 7f1f2d864780 1 < completed delete operation key=3Z1TGGPZKJ69 tag=GPD2HNYK142A type=del 2024-09-12T00:34:25.725 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.727+0000 7f1f2d864780 1 > prepared operation key=UTR2UUO6DHLJ tag=GZMRK7ZUT21U type=del size=4192402 2024-09-12T00:34:25.728 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.730+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~T6RPNNBLBXRP.0 size=492802 2024-09-12T00:34:25.730 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.732+0000 7f1f2d864780 1 < completed multipart upload key=WGKEA4EKF5GP upload=T6RPNNBLBXRP tag=1WHQMAU8MI5X type=write size=1541378 2024-09-12T00:34:25.731 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.733+0000 7f1f2d864780 1 > prepared operation key=2G3UCYG4R4NM tag=QDUMSV1Q20JC type=del size=2759545 2024-09-12T00:34:25.733 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.735+0000 7f1f2d864780 1 < completed part key=_multipart_KHPF1N1MT33Z.2~UJMMNBWWW2HB.0 size=801727 2024-09-12T00:34:25.735 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.737+0000 7f1f2d864780 1 < completed multipart upload key=KHPF1N1MT33Z upload=UJMMNBWWW2HB tag=96YKFEQEX3IW type=write size=1850303 2024-09-12T00:34:25.736 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.738+0000 7f1f2d864780 1 > prepared operation key=3Z1TGGPZKJ69 tag=8YUX2U09RBF2 type=del size=259212 2024-09-12T00:34:25.737 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.739+0000 7f1f2d864780 1 < completed delete operation key=ZGO887JDR627 tag=Z1SAHX83KBPF type=del 2024-09-12T00:34:25.738 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.740+0000 7f1f2d864780 1 > prepared operation key=D21W9QZWY0YU tag=B67PSR9JXOW8 type=del size=115647 2024-09-12T00:34:25.740 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.741+0000 7f1f2d864780 1 < completed part key=_multipart_53QCNWX1V1R1.2~DH4U9H527L08.0 size=1048576 2024-09-12T00:34:25.741 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.742+0000 7f1f2d864780 1 < completed part key=_multipart_53QCNWX1V1R1.2~DH4U9H527L08.1 size=1048576 2024-09-12T00:34:25.741 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.742+0000 7f1f2d864780 1 < canceled part key=_multipart_53QCNWX1V1R1.2~DH4U9H527L08.2 size=78253 2024-09-12T00:34:25.743 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.744+0000 7f1f2d864780 1 < canceled multipart upload key=53QCNWX1V1R1 upload=DH4U9H527L08 tag=UEQ0POGSZFO2 type=write size=3223981 2024-09-12T00:34:25.745 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.747+0000 7f1f2d864780 1 > prepared operation key=3Z1TGGPZKJ69 tag=H8MY0LQIZUEG type=del size=3445194 2024-09-12T00:34:25.748 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.749+0000 7f1f2d864780 1 < suggested remove operation key=N9RQIGHVL8VP tag=LZ4IK6IA8YLD type=del 2024-09-12T00:34:25.749 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.751+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~CFEPSX9YG10S.0 size=1048576 2024-09-12T00:34:25.750 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.752+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~CFEPSX9YG10S.1 size=1048576 2024-09-12T00:34:25.751 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.753+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~CFEPSX9YG10S.2 size=472260 2024-09-12T00:34:25.751 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.753+0000 7f1f2d864780 1 > prepared multipart upload key=SZP418NVZ5VX upload=CFEPSX9YG10S tag=0W4HPMJEAZH1 type=write size=3617988 2024-09-12T00:34:25.752 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.754+0000 7f1f2d864780 1 < completed part key=_multipart_2YCGIJRK6MUH.2~ESGEEL7892V7.0 size=1048576 2024-09-12T00:34:25.753 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.755+0000 7f1f2d864780 1 < completed part key=_multipart_2YCGIJRK6MUH.2~ESGEEL7892V7.1 size=1048576 2024-09-12T00:34:25.754 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.756+0000 7f1f2d864780 1 < completed part key=_multipart_2YCGIJRK6MUH.2~ESGEEL7892V7.2 size=595123 2024-09-12T00:34:25.756 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.758+0000 7f1f2d864780 1 < completed multipart upload key=2YCGIJRK6MUH upload=ESGEEL7892V7 tag=F6JZ82W4LPI8 type=write size=3740851 2024-09-12T00:34:25.757 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.759+0000 7f1f2d864780 1 > prepared operation key=1299IOSGYIO9 tag=54K3GN1LCFHX type=write size=702179 2024-09-12T00:34:25.760 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.761+0000 7f1f2d864780 1 < suggested remove operation key=UTR2UUO6DHLJ tag=97C9GGX8CLD2 type=del 2024-09-12T00:34:25.760 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.762+0000 7f1f2d864780 1 > prepared operation key=ZGO887JDR627 tag=PF3L0ZTBQAI3 type=del size=837760 2024-09-12T00:34:25.762 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.763+0000 7f1f2d864780 1 < completed delete operation key=D21W9QZWY0YU tag=KUNXPM6IA1ZY type=del 2024-09-12T00:34:25.764 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.765+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~RZ2VGE8EMI0U.0 size=1048576 2024-09-12T00:34:25.765 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.766+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~RZ2VGE8EMI0U.1 size=1048576 2024-09-12T00:34:25.765 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.767+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~RZ2VGE8EMI0U.2 size=489550 2024-09-12T00:34:25.766 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.767+0000 7f1f2d864780 1 > prepared multipart upload key=FAP6N3H7SBN0 upload=RZ2VGE8EMI0U tag=WKS7ERK53Q92 type=write size=3635278 2024-09-12T00:34:25.767 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.768+0000 7f1f2d864780 1 < completed write operation key=DYKLAY6J018G tag=7DWSN4GQTCH4 type=write size=766617 2024-09-12T00:34:25.769 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.770+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~VET7AUP2NQ2K.0 size=1048576 2024-09-12T00:34:25.770 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.771+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~VET7AUP2NQ2K.1 size=74098 2024-09-12T00:34:25.770 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.771+0000 7f1f2d864780 1 > prepared multipart upload key=1299IOSGYIO9 upload=VET7AUP2NQ2K tag=VOOOD1BTYZ23 type=write size=2171250 2024-09-12T00:34:25.771 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.772+0000 7f1f2d864780 -1 < failed to complete operation key=UTR2UUO6DHLJ tag=TVCU9J0PBIJJ type=del size=1731671: (22) Invalid argument 2024-09-12T00:34:25.772 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.774+0000 7f1f2d864780 1 > prepared operation key=2G3UCYG4R4NM tag=H9GG447H23Z3 type=write size=731943 2024-09-12T00:34:25.774 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.776+0000 7f1f2d864780 1 < suggested remove operation key=ZGO887JDR627 tag=KQY0K5YR4HW1 type=del 2024-09-12T00:34:25.775 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.777+0000 7f1f2d864780 1 > prepared operation key=KHPF1N1MT33Z tag=C33NUXWF29QQ type=write size=430023 2024-09-12T00:34:25.777 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.778+0000 7f1f2d864780 1 < completed delete operation key=GSPM8N0K7ODC tag=2WLPCSS7562B type=del 2024-09-12T00:34:25.779 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.781+0000 7f1f2d864780 1 > prepared part key=_multipart_2G3UCYG4R4NM.2~C0Q3TMB4AFRL.0 size=1048576 2024-09-12T00:34:25.781 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.782+0000 7f1f2d864780 1 > prepared part key=_multipart_2G3UCYG4R4NM.2~C0Q3TMB4AFRL.1 size=753871 2024-09-12T00:34:25.781 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.782+0000 7f1f2d864780 1 > prepared multipart upload key=2G3UCYG4R4NM upload=C0Q3TMB4AFRL tag=5A2JFU1TVIP4 type=write size=2851023 2024-09-12T00:34:25.781 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.782+0000 7f1f2d864780 1 < canceled part key=_multipart_OY145ZXRSF4L.2~FGOEY0LCXLJT.0 size=1048576 2024-09-12T00:34:25.781 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.783+0000 7f1f2d864780 1 < completed part key=_multipart_OY145ZXRSF4L.2~FGOEY0LCXLJT.1 size=1048576 2024-09-12T00:34:25.782 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.784+0000 7f1f2d864780 1 < completed part key=_multipart_OY145ZXRSF4L.2~FGOEY0LCXLJT.2 size=753295 2024-09-12T00:34:25.785 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.786+0000 7f1f2d864780 1 < canceled multipart upload key=OY145ZXRSF4L upload=FGOEY0LCXLJT tag=CKPNEBO9X02V type=write size=3899023 2024-09-12T00:34:25.787 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.788+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~9CRLUHE8DWET.0 size=1048576 2024-09-12T00:34:25.788 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.789+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~9CRLUHE8DWET.1 size=1048576 2024-09-12T00:34:25.789 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.790+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~9CRLUHE8DWET.2 size=16858 2024-09-12T00:34:25.789 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.790+0000 7f1f2d864780 1 > prepared multipart upload key=4FRVL0KXN2X8 upload=9CRLUHE8DWET tag=8HETFAA79J1D type=write size=3162586 2024-09-12T00:34:25.790 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.791+0000 7f1f2d864780 1 < canceled operation key=3Z1TGGPZKJ69 tag=MLC5MXO7FEG7 type=del size=3191679 2024-09-12T00:34:25.791 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.792+0000 7f1f2d864780 1 > prepared operation key=GSPM8N0K7ODC tag=O0S48JEBHFAT type=write size=346036 2024-09-12T00:34:25.792 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.794+0000 7f1f2d864780 1 < completed delete operation key=MSGU3PHLBRJH tag=R0FIKCBG7396 type=del 2024-09-12T00:34:25.793 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.795+0000 7f1f2d864780 1 > prepared operation key=O1YY03BOEYLM tag=5HER063DFKXW type=write size=552977 2024-09-12T00:34:25.794 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.796+0000 7f1f2d864780 -1 < failed to complete operation key=UTR2UUO6DHLJ tag=GZMRK7ZUT21U type=del size=4192402: (22) Invalid argument 2024-09-12T00:34:25.795 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.797+0000 7f1f2d864780 1 > prepared operation key=ZYNIJH0TTSM6 tag=18289V7GMYV0 type=write size=91806 2024-09-12T00:34:25.797 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.799+0000 7f1f2d864780 1 < suggested update operation key=2G3UCYG4R4NM tag=QDUMSV1Q20JC type=del size=2759545 2024-09-12T00:34:25.799 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.800+0000 7f1f2d864780 1 > prepared operation key=3Z1TGGPZKJ69 tag=GXQ2D456XIVA type=del size=4167204 2024-09-12T00:34:25.800 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.801+0000 7f1f2d864780 1 < completed delete operation key=3Z1TGGPZKJ69 tag=8YUX2U09RBF2 type=del 2024-09-12T00:34:25.801 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.802+0000 7f1f2d864780 1 > prepared operation key=4FRVL0KXN2X8 tag=35TETKRRH2BN type=del size=1394271 2024-09-12T00:34:25.804 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.804+0000 7f1f2d864780 1 < canceled operation key=D21W9QZWY0YU tag=B67PSR9JXOW8 type=del size=115647 2024-09-12T00:34:25.805 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.806+0000 7f1f2d864780 1 > prepared part key=_multipart_2RV0899QUJ8W.2~0EXHWXZQI0HF.0 size=383291 2024-09-12T00:34:25.805 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.806+0000 7f1f2d864780 1 > prepared multipart upload key=2RV0899QUJ8W upload=0EXHWXZQI0HF tag=TC4KT3ZZ9GJL type=write size=1431867 2024-09-12T00:34:25.805 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.807+0000 7f1f2d864780 1 < completed delete operation key=3Z1TGGPZKJ69 tag=H8MY0LQIZUEG type=del 2024-09-12T00:34:25.806 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.808+0000 7f1f2d864780 1 > prepared operation key=AN26EVAZI527 tag=ZFJ6BB309QMM type=del size=716501 2024-09-12T00:34:25.807 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.809+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~CFEPSX9YG10S.0 size=1048576 2024-09-12T00:34:25.808 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.810+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~CFEPSX9YG10S.1 size=1048576 2024-09-12T00:34:25.809 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.811+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~CFEPSX9YG10S.2 size=472260 2024-09-12T00:34:25.811 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.812+0000 7f1f2d864780 1 < completed multipart upload key=SZP418NVZ5VX upload=CFEPSX9YG10S tag=0W4HPMJEAZH1 type=write size=3617988 2024-09-12T00:34:25.813 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.815+0000 7f1f2d864780 1 > prepared part key=_multipart_WKK747ETLW10.2~EH4C0K2O7UU3.0 size=1048576 2024-09-12T00:34:25.814 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.815+0000 7f1f2d864780 1 > prepared part key=_multipart_WKK747ETLW10.2~EH4C0K2O7UU3.1 size=117068 2024-09-12T00:34:25.814 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.815+0000 7f1f2d864780 1 > prepared multipart upload key=WKK747ETLW10 upload=EH4C0K2O7UU3 tag=EBQZ3P9YZVAY type=write size=2214220 2024-09-12T00:34:25.816 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.818+0000 7f1f2d864780 1 < suggested remove operation key=1299IOSGYIO9 tag=54K3GN1LCFHX type=write 2024-09-12T00:34:25.818 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.820+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~GVGP4V20K4II.0 size=225991 2024-09-12T00:34:25.818 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.820+0000 7f1f2d864780 1 > prepared multipart upload key=FAP6N3H7SBN0 upload=GVGP4V20K4II tag=LJE0V472FMYN type=write size=1274567 2024-09-12T00:34:25.819 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.821+0000 7f1f2d864780 -1 < failed to complete operation key=ZGO887JDR627 tag=PF3L0ZTBQAI3 type=del size=837760: (22) Invalid argument 2024-09-12T00:34:25.821 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.822+0000 7f1f2d864780 1 > prepared operation key=SNCGB6Z20450 tag=0ETKPJS193F5 type=del size=3011856 2024-09-12T00:34:25.822 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.823+0000 7f1f2d864780 1 < completed part key=_multipart_FAP6N3H7SBN0.2~RZ2VGE8EMI0U.0 size=1048576 2024-09-12T00:34:25.823 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.824+0000 7f1f2d864780 1 < completed part key=_multipart_FAP6N3H7SBN0.2~RZ2VGE8EMI0U.1 size=1048576 2024-09-12T00:34:25.824 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.826+0000 7f1f2d864780 1 < completed part key=_multipart_FAP6N3H7SBN0.2~RZ2VGE8EMI0U.2 size=489550 2024-09-12T00:34:25.826 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.828+0000 7f1f2d864780 1 < completed multipart upload key=FAP6N3H7SBN0 upload=RZ2VGE8EMI0U tag=WKS7ERK53Q92 type=write size=3635278 2024-09-12T00:34:25.827 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.829+0000 7f1f2d864780 1 > prepared operation key=DYKLAY6J018G tag=5QZ507DNZ13W type=del size=3980308 2024-09-12T00:34:25.828 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.830+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~VET7AUP2NQ2K.0 size=1048576 2024-09-12T00:34:25.829 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.831+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~VET7AUP2NQ2K.1 size=74098 2024-09-12T00:34:25.831 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.833+0000 7f1f2d864780 1 < completed multipart upload key=1299IOSGYIO9 upload=VET7AUP2NQ2K tag=VOOOD1BTYZ23 type=write size=2171250 2024-09-12T00:34:25.834 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.835+0000 7f1f2d864780 1 > prepared part key=_multipart_3Z1TGGPZKJ69.2~27CQAUUUDCCK.0 size=373208 2024-09-12T00:34:25.834 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.835+0000 7f1f2d864780 1 > prepared multipart upload key=3Z1TGGPZKJ69 upload=27CQAUUUDCCK tag=B1Q6PJ2JHSKP type=write size=1421784 2024-09-12T00:34:25.836 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.838+0000 7f1f2d864780 1 < suggested update operation key=2G3UCYG4R4NM tag=H9GG447H23Z3 type=write size=731943 2024-09-12T00:34:25.838 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.840+0000 7f1f2d864780 1 > prepared part key=_multipart_WKK747ETLW10.2~QZJQZYV284GV.0 size=172932 2024-09-12T00:34:25.839 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.840+0000 7f1f2d864780 1 > prepared multipart upload key=WKK747ETLW10 upload=QZJQZYV284GV tag=YBBS760CDLWB type=write size=1221508 2024-09-12T00:34:25.841 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.843+0000 7f1f2d864780 1 < suggested update operation key=KHPF1N1MT33Z tag=C33NUXWF29QQ type=write size=430023 2024-09-12T00:34:25.842 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.844+0000 7f1f2d864780 1 > prepared operation key=N9RQIGHVL8VP tag=K2SC0ZW16D6V type=del size=2451725 2024-09-12T00:34:25.844 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.845+0000 7f1f2d864780 1 < completed part key=_multipart_2G3UCYG4R4NM.2~C0Q3TMB4AFRL.0 size=1048576 2024-09-12T00:34:25.845 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.846+0000 7f1f2d864780 1 < completed part key=_multipart_2G3UCYG4R4NM.2~C0Q3TMB4AFRL.1 size=753871 2024-09-12T00:34:25.847 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.848+0000 7f1f2d864780 1 < completed multipart upload key=2G3UCYG4R4NM upload=C0Q3TMB4AFRL tag=5A2JFU1TVIP4 type=write size=2851023 2024-09-12T00:34:25.848 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.850+0000 7f1f2d864780 1 > prepared operation key=ZYNIJH0TTSM6 tag=1SSZKG6BHGW1 type=del size=285653 2024-09-12T00:34:25.849 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.851+0000 7f1f2d864780 1 < completed part key=_multipart_4FRVL0KXN2X8.2~9CRLUHE8DWET.0 size=1048576 2024-09-12T00:34:25.851 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.852+0000 7f1f2d864780 1 < completed part key=_multipart_4FRVL0KXN2X8.2~9CRLUHE8DWET.1 size=1048576 2024-09-12T00:34:25.852 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.853+0000 7f1f2d864780 1 < completed part key=_multipart_4FRVL0KXN2X8.2~9CRLUHE8DWET.2 size=16858 2024-09-12T00:34:25.855 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.856+0000 7f1f2d864780 1 < completed multipart upload key=4FRVL0KXN2X8 upload=9CRLUHE8DWET tag=8HETFAA79J1D type=write size=3162586 2024-09-12T00:34:25.856 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.857+0000 7f1f2d864780 1 > prepared operation key=ZGO887JDR627 tag=QC1OCF2PGM0T type=write size=269995 2024-09-12T00:34:25.857 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.859+0000 7f1f2d864780 1 < completed write operation key=GSPM8N0K7ODC tag=O0S48JEBHFAT type=write size=346036 2024-09-12T00:34:25.859 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.860+0000 7f1f2d864780 1 > prepared operation key=0DSQOFS8IIF5 tag=ZPIKPMBENN6D type=del size=3883480 2024-09-12T00:34:25.860 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.862+0000 7f1f2d864780 1 < canceled operation key=O1YY03BOEYLM tag=5HER063DFKXW type=write size=552977 2024-09-12T00:34:25.861 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.863+0000 7f1f2d864780 1 > prepared operation key=AN26EVAZI527 tag=GBMGRMIDKGQY type=del size=4074192 2024-09-12T00:34:25.862 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.864+0000 7f1f2d864780 1 < completed write operation key=ZYNIJH0TTSM6 tag=18289V7GMYV0 type=write size=91806 2024-09-12T00:34:25.863 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.865+0000 7f1f2d864780 1 > prepared operation key=AN26EVAZI527 tag=5H8QPTKFY9FZ type=del size=4174889 2024-09-12T00:34:25.864 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.866+0000 7f1f2d864780 1 < completed delete operation key=3Z1TGGPZKJ69 tag=GXQ2D456XIVA type=del 2024-09-12T00:34:25.865 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.867+0000 7f1f2d864780 1 > prepared operation key=4FRVL0KXN2X8 tag=U08Q3QPAX4Q5 type=write size=705502 2024-09-12T00:34:25.867 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.868+0000 7f1f2d864780 1 < completed delete operation key=4FRVL0KXN2X8 tag=35TETKRRH2BN type=del 2024-09-12T00:34:25.868 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.869+0000 7f1f2d864780 1 > prepared operation key=ZYNIJH0TTSM6 tag=UT52SWCO8CMC type=del size=1347192 2024-09-12T00:34:25.869 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.870+0000 7f1f2d864780 1 < completed part key=_multipart_2RV0899QUJ8W.2~0EXHWXZQI0HF.0 size=383291 2024-09-12T00:34:25.871 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.872+0000 7f1f2d864780 1 < completed multipart upload key=2RV0899QUJ8W upload=0EXHWXZQI0HF tag=TC4KT3ZZ9GJL type=write size=1431867 2024-09-12T00:34:25.873 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.874+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~O8N5QIVPJO4J.0 size=955364 2024-09-12T00:34:25.873 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.874+0000 7f1f2d864780 1 > prepared multipart upload key=SZP418NVZ5VX upload=O8N5QIVPJO4J tag=6YVOH7GJ96RT type=write size=2003940 2024-09-12T00:34:25.874 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.875+0000 7f1f2d864780 1 < completed delete operation key=AN26EVAZI527 tag=ZFJ6BB309QMM type=del 2024-09-12T00:34:25.875 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.876+0000 7f1f2d864780 1 > prepared operation key=KHPF1N1MT33Z tag=ZFU7FW4JZAZT type=del size=2310816 2024-09-12T00:34:25.876 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.878+0000 7f1f2d864780 1 < completed part key=_multipart_WKK747ETLW10.2~EH4C0K2O7UU3.0 size=1048576 2024-09-12T00:34:25.877 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.878+0000 7f1f2d864780 1 < completed part key=_multipart_WKK747ETLW10.2~EH4C0K2O7UU3.1 size=117068 2024-09-12T00:34:25.879 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.880+0000 7f1f2d864780 1 < completed multipart upload key=WKK747ETLW10 upload=EH4C0K2O7UU3 tag=EBQZ3P9YZVAY type=write size=2214220 2024-09-12T00:34:25.881 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.883+0000 7f1f2d864780 1 > prepared part key=_multipart_S5DVMA14N7VJ.2~GCC6N5ITJOR8.0 size=741377 2024-09-12T00:34:25.881 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.883+0000 7f1f2d864780 1 > prepared multipart upload key=S5DVMA14N7VJ upload=GCC6N5ITJOR8 tag=6Q3K0GPOPOF4 type=write size=1789953 2024-09-12T00:34:25.882 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.884+0000 7f1f2d864780 1 < completed part key=_multipart_FAP6N3H7SBN0.2~GVGP4V20K4II.0 size=225991 2024-09-12T00:34:25.884 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.886+0000 7f1f2d864780 1 < completed multipart upload key=FAP6N3H7SBN0 upload=GVGP4V20K4II tag=LJE0V472FMYN type=write size=1274567 2024-09-12T00:34:25.886 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.888+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~5NP39X9R5WQD.0 size=1048576 2024-09-12T00:34:25.887 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.889+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~5NP39X9R5WQD.1 size=1048576 2024-09-12T00:34:25.888 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.889+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~5NP39X9R5WQD.2 size=840406 2024-09-12T00:34:25.888 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.889+0000 7f1f2d864780 1 > prepared multipart upload key=4FRVL0KXN2X8 upload=5NP39X9R5WQD tag=WF7U6SNV2G9C type=write size=3986134 2024-09-12T00:34:25.889 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.891+0000 7f1f2d864780 1 < completed delete operation key=SNCGB6Z20450 tag=0ETKPJS193F5 type=del 2024-09-12T00:34:25.890 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.892+0000 7f1f2d864780 1 > prepared operation key=ZYNIJH0TTSM6 tag=M93TKKHOLNNN type=del size=3657911 2024-09-12T00:34:25.891 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.893+0000 7f1f2d864780 1 < completed delete operation key=DYKLAY6J018G tag=5QZ507DNZ13W type=del 2024-09-12T00:34:25.893 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.894+0000 7f1f2d864780 1 > prepared operation key=N9RQIGHVL8VP tag=H14AEJDK7PKC type=del size=980845 2024-09-12T00:34:25.894 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.895+0000 7f1f2d864780 1 < completed part key=_multipart_3Z1TGGPZKJ69.2~27CQAUUUDCCK.0 size=373208 2024-09-12T00:34:25.896 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.897+0000 7f1f2d864780 1 < completed multipart upload key=3Z1TGGPZKJ69 upload=27CQAUUUDCCK tag=B1Q6PJ2JHSKP type=write size=1421784 2024-09-12T00:34:25.898 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.899+0000 7f1f2d864780 1 > prepared part key=_multipart_ZYNIJH0TTSM6.2~7RCPVCWZ2031.0 size=795292 2024-09-12T00:34:25.898 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.900+0000 7f1f2d864780 1 > prepared multipart upload key=ZYNIJH0TTSM6 upload=7RCPVCWZ2031 tag=S1RDC7P8AZC7 type=write size=1843868 2024-09-12T00:34:25.899 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.901+0000 7f1f2d864780 1 < completed part key=_multipart_WKK747ETLW10.2~QZJQZYV284GV.0 size=172932 2024-09-12T00:34:25.901 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.903+0000 7f1f2d864780 1 < completed multipart upload key=WKK747ETLW10 upload=QZJQZYV284GV tag=YBBS760CDLWB type=write size=1221508 2024-09-12T00:34:25.902 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.904+0000 7f1f2d864780 1 > prepared operation key=2G3UCYG4R4NM tag=6XN4ROBLN4MW type=del size=196920 2024-09-12T00:34:25.903 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.905+0000 7f1f2d864780 1 < completed delete operation key=N9RQIGHVL8VP tag=K2SC0ZW16D6V type=del 2024-09-12T00:34:25.906 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.907+0000 7f1f2d864780 1 > prepared part key=_multipart_GSPM8N0K7ODC.2~UMYW3QRS3SCB.0 size=1048576 2024-09-12T00:34:25.906 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.908+0000 7f1f2d864780 1 > prepared part key=_multipart_GSPM8N0K7ODC.2~UMYW3QRS3SCB.1 size=56199 2024-09-12T00:34:25.906 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.908+0000 7f1f2d864780 1 > prepared multipart upload key=GSPM8N0K7ODC upload=UMYW3QRS3SCB tag=Z2P7P0FG9XRT type=write size=2153351 2024-09-12T00:34:25.908 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.909+0000 7f1f2d864780 1 < completed delete operation key=ZYNIJH0TTSM6 tag=1SSZKG6BHGW1 type=del 2024-09-12T00:34:25.909 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.911+0000 7f1f2d864780 1 > prepared operation key=FAP6N3H7SBN0 tag=MM494CH351S3 type=del size=1191044 2024-09-12T00:34:25.910 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.912+0000 7f1f2d864780 1 < completed write operation key=ZGO887JDR627 tag=QC1OCF2PGM0T type=write size=269995 2024-09-12T00:34:25.912 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.913+0000 7f1f2d864780 1 > prepared operation key=3Z1TGGPZKJ69 tag=WKTO95H2RJYM type=write size=6796 2024-09-12T00:34:25.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.916+0000 7f1f2d864780 1 < suggested update operation key=0DSQOFS8IIF5 tag=ZPIKPMBENN6D type=del size=3883480 2024-09-12T00:34:25.915 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.917+0000 7f1f2d864780 1 > prepared operation key=SZP418NVZ5VX tag=H1K3FSZQNP4J type=write size=964459 2024-09-12T00:34:25.918 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.919+0000 7f1f2d864780 1 < suggested update operation key=AN26EVAZI527 tag=GBMGRMIDKGQY type=del size=4074192 2024-09-12T00:34:25.920 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.922+0000 7f1f2d864780 1 > prepared part key=_multipart_9XK59MVZ5G1O.2~HJRK1V62VG0I.0 size=136463 2024-09-12T00:34:25.920 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.922+0000 7f1f2d864780 1 > prepared multipart upload key=9XK59MVZ5G1O upload=HJRK1V62VG0I tag=RMT6EJ62FUB7 type=write size=1185039 2024-09-12T00:34:25.922 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.924+0000 7f1f2d864780 1 < suggested remove operation key=AN26EVAZI527 tag=5H8QPTKFY9FZ type=del 2024-09-12T00:34:25.923 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.925+0000 7f1f2d864780 1 > prepared operation key=MSGU3PHLBRJH tag=O1F3EWKHDCP5 type=write size=459579 2024-09-12T00:34:25.925 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.926+0000 7f1f2d864780 1 < completed write operation key=4FRVL0KXN2X8 tag=U08Q3QPAX4Q5 type=write size=705502 2024-09-12T00:34:25.926 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.927+0000 7f1f2d864780 1 > prepared operation key=AN26EVAZI527 tag=UYX93I7RQ7QO type=write size=86337 2024-09-12T00:34:25.928 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.929+0000 7f1f2d864780 1 < suggested remove operation key=ZYNIJH0TTSM6 tag=UT52SWCO8CMC type=del 2024-09-12T00:34:25.930 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.931+0000 7f1f2d864780 1 > prepared part key=_multipart_AN26EVAZI527.2~S2ZZJZU0G0YD.0 size=598305 2024-09-12T00:34:25.930 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.931+0000 7f1f2d864780 1 > prepared multipart upload key=AN26EVAZI527 upload=S2ZZJZU0G0YD tag=2P7Z7B88BH1S type=write size=1646881 2024-09-12T00:34:25.931 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.932+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~O8N5QIVPJO4J.0 size=955364 2024-09-12T00:34:25.933 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.934+0000 7f1f2d864780 1 < completed multipart upload key=SZP418NVZ5VX upload=O8N5QIVPJO4J tag=6YVOH7GJ96RT type=write size=2003940 2024-09-12T00:34:25.934 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.936+0000 7f1f2d864780 1 > prepared operation key=FFG41OYEYFZA tag=QGJ2SZT11O99 type=del size=756481 2024-09-12T00:34:25.935 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.937+0000 7f1f2d864780 1 < completed delete operation key=KHPF1N1MT33Z tag=ZFU7FW4JZAZT type=del 2024-09-12T00:34:25.938 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.939+0000 7f1f2d864780 1 > prepared part key=_multipart_AN26EVAZI527.2~W52PNKQ8MKFC.0 size=1048576 2024-09-12T00:34:25.939 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.940+0000 7f1f2d864780 1 > prepared part key=_multipart_AN26EVAZI527.2~W52PNKQ8MKFC.1 size=1036952 2024-09-12T00:34:25.939 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.940+0000 7f1f2d864780 1 > prepared multipart upload key=AN26EVAZI527 upload=W52PNKQ8MKFC tag=R2KG45DRZHAU type=write size=3134104 2024-09-12T00:34:25.940 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.941+0000 7f1f2d864780 1 < completed part key=_multipart_S5DVMA14N7VJ.2~GCC6N5ITJOR8.0 size=741377 2024-09-12T00:34:25.942 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.943+0000 7f1f2d864780 1 < completed multipart upload key=S5DVMA14N7VJ upload=GCC6N5ITJOR8 tag=6Q3K0GPOPOF4 type=write size=1789953 2024-09-12T00:34:25.943 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.945+0000 7f1f2d864780 1 > prepared operation key=AN26EVAZI527 tag=RHG6X4SDA5IC type=del size=3833251 2024-09-12T00:34:25.944 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.946+0000 7f1f2d864780 1 < completed part key=_multipart_4FRVL0KXN2X8.2~5NP39X9R5WQD.0 size=1048576 2024-09-12T00:34:25.945 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.947+0000 7f1f2d864780 1 < completed part key=_multipart_4FRVL0KXN2X8.2~5NP39X9R5WQD.1 size=1048576 2024-09-12T00:34:25.946 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.948+0000 7f1f2d864780 1 < completed part key=_multipart_4FRVL0KXN2X8.2~5NP39X9R5WQD.2 size=840406 2024-09-12T00:34:25.948 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.950+0000 7f1f2d864780 1 < completed multipart upload key=4FRVL0KXN2X8 upload=5NP39X9R5WQD tag=WF7U6SNV2G9C type=write size=3986134 2024-09-12T00:34:25.950 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.951+0000 7f1f2d864780 1 > prepared operation key=FAP6N3H7SBN0 tag=5DRA18OA6NNG type=del size=9226 2024-09-12T00:34:25.951 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.952+0000 7f1f2d864780 -1 < failed to complete operation key=ZYNIJH0TTSM6 tag=M93TKKHOLNNN type=del size=3657911: (22) Invalid argument 2024-09-12T00:34:25.952 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.954+0000 7f1f2d864780 1 > prepared operation key=DYKLAY6J018G tag=2E5V2B8EXQI6 type=del size=4142249 2024-09-12T00:34:25.953 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.955+0000 7f1f2d864780 1 < completed delete operation key=N9RQIGHVL8VP tag=H14AEJDK7PKC type=del 2024-09-12T00:34:25.954 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.956+0000 7f1f2d864780 1 > prepared operation key=UTR2UUO6DHLJ tag=JUPT9SRAW17U type=del size=322092 2024-09-12T00:34:25.956 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.957+0000 7f1f2d864780 1 < completed part key=_multipart_ZYNIJH0TTSM6.2~7RCPVCWZ2031.0 size=795292 2024-09-12T00:34:25.957 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.959+0000 7f1f2d864780 1 < completed multipart upload key=ZYNIJH0TTSM6 upload=7RCPVCWZ2031 tag=S1RDC7P8AZC7 type=write size=1843868 2024-09-12T00:34:25.959 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.960+0000 7f1f2d864780 1 > prepared operation key=D21W9QZWY0YU tag=L00XDGOZFQ3X type=del size=2840031 2024-09-12T00:34:25.960 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.961+0000 7f1f2d864780 1 < canceled operation key=2G3UCYG4R4NM tag=6XN4ROBLN4MW type=del size=196920 2024-09-12T00:34:25.961 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.963+0000 7f1f2d864780 1 > prepared operation key=WIIU8VTCLWOD tag=CS58Y6IMAUFC type=del size=1718474 2024-09-12T00:34:25.962 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.964+0000 7f1f2d864780 1 < completed part key=_multipart_GSPM8N0K7ODC.2~UMYW3QRS3SCB.0 size=1048576 2024-09-12T00:34:25.963 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.965+0000 7f1f2d864780 1 < completed part key=_multipart_GSPM8N0K7ODC.2~UMYW3QRS3SCB.1 size=56199 2024-09-12T00:34:25.966 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.968+0000 7f1f2d864780 1 < completed multipart upload key=GSPM8N0K7ODC upload=UMYW3QRS3SCB tag=Z2P7P0FG9XRT type=write size=2153351 2024-09-12T00:34:25.969 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.970+0000 7f1f2d864780 1 > prepared part key=_multipart_OY145ZXRSF4L.2~1C7LGG3RNWD6.0 size=1048576 2024-09-12T00:34:25.970 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.971+0000 7f1f2d864780 1 > prepared part key=_multipart_OY145ZXRSF4L.2~1C7LGG3RNWD6.1 size=1048576 2024-09-12T00:34:25.971 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.972+0000 7f1f2d864780 1 > prepared part key=_multipart_OY145ZXRSF4L.2~1C7LGG3RNWD6.2 size=819929 2024-09-12T00:34:25.971 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.972+0000 7f1f2d864780 1 > prepared multipart upload key=OY145ZXRSF4L upload=1C7LGG3RNWD6 tag=RAU7OYFFY1CK type=write size=3965657 2024-09-12T00:34:25.972 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.973+0000 7f1f2d864780 1 < completed delete operation key=FAP6N3H7SBN0 tag=MM494CH351S3 type=del 2024-09-12T00:34:25.974 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.976+0000 7f1f2d864780 1 > prepared part key=_multipart_N9RQIGHVL8VP.2~0GETCSTLKL4S.0 size=1048576 2024-09-12T00:34:25.975 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.977+0000 7f1f2d864780 1 > prepared part key=_multipart_N9RQIGHVL8VP.2~0GETCSTLKL4S.1 size=1048576 2024-09-12T00:34:25.976 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.978+0000 7f1f2d864780 1 > prepared part key=_multipart_N9RQIGHVL8VP.2~0GETCSTLKL4S.2 size=220750 2024-09-12T00:34:25.976 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.978+0000 7f1f2d864780 1 > prepared multipart upload key=N9RQIGHVL8VP upload=0GETCSTLKL4S tag=WNSF0MNBIATC type=write size=3366478 2024-09-12T00:34:25.977 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.979+0000 7f1f2d864780 1 < completed write operation key=3Z1TGGPZKJ69 tag=WKTO95H2RJYM type=write size=6796 2024-09-12T00:34:25.979 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.981+0000 7f1f2d864780 1 > prepared part key=_multipart_GSPM8N0K7ODC.2~1CQM7B48BABA.0 size=1048576 2024-09-12T00:34:25.981 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.982+0000 7f1f2d864780 1 > prepared part key=_multipart_GSPM8N0K7ODC.2~1CQM7B48BABA.1 size=1048576 2024-09-12T00:34:25.981 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.982+0000 7f1f2d864780 1 > prepared part key=_multipart_GSPM8N0K7ODC.2~1CQM7B48BABA.2 size=82150 2024-09-12T00:34:25.981 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.982+0000 7f1f2d864780 1 > prepared multipart upload key=GSPM8N0K7ODC upload=1CQM7B48BABA tag=KABCKL3O4A07 type=write size=3227878 2024-09-12T00:34:25.983 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.985+0000 7f1f2d864780 1 < suggested update operation key=SZP418NVZ5VX tag=H1K3FSZQNP4J type=write size=964459 2024-09-12T00:34:25.984 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.986+0000 7f1f2d864780 1 > prepared operation key=WGKEA4EKF5GP tag=2W0BNICUH77I type=del size=1434767 2024-09-12T00:34:25.984 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.986+0000 7f1f2d864780 1 < canceled part key=_multipart_9XK59MVZ5G1O.2~HJRK1V62VG0I.0 size=136463 2024-09-12T00:34:25.986 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.988+0000 7f1f2d864780 1 < canceled multipart upload key=9XK59MVZ5G1O upload=HJRK1V62VG0I tag=RMT6EJ62FUB7 type=write size=1185039 2024-09-12T00:34:25.987 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.989+0000 7f1f2d864780 1 > prepared operation key=PVB52GO6L8T4 tag=35TYW2XQZEZT type=del size=3869553 2024-09-12T00:34:25.989 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.990+0000 7f1f2d864780 1 < completed write operation key=MSGU3PHLBRJH tag=O1F3EWKHDCP5 type=write size=459579 2024-09-12T00:34:25.991 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.992+0000 7f1f2d864780 1 > prepared part key=_multipart_3Z1TGGPZKJ69.2~04274FKE0QUH.0 size=1048576 2024-09-12T00:34:25.992 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.993+0000 7f1f2d864780 1 > prepared part key=_multipart_3Z1TGGPZKJ69.2~04274FKE0QUH.1 size=166008 2024-09-12T00:34:25.992 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.993+0000 7f1f2d864780 1 > prepared multipart upload key=3Z1TGGPZKJ69 upload=04274FKE0QUH tag=QJV5WCXP9FQ4 type=write size=2263160 2024-09-12T00:34:25.993 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.994+0000 7f1f2d864780 1 < completed write operation key=AN26EVAZI527 tag=UYX93I7RQ7QO type=write size=86337 2024-09-12T00:34:25.995 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.997+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~OY4ES5YPD7RV.0 size=1048576 2024-09-12T00:34:25.996 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.998+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~OY4ES5YPD7RV.1 size=328281 2024-09-12T00:34:25.996 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.998+0000 7f1f2d864780 1 > prepared multipart upload key=W6U30X4HJCB1 upload=OY4ES5YPD7RV tag=XUDRHWB55X6Y type=write size=2425433 2024-09-12T00:34:25.997 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:25.999+0000 7f1f2d864780 1 < completed part key=_multipart_AN26EVAZI527.2~S2ZZJZU0G0YD.0 size=598305 2024-09-12T00:34:25.999 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.001+0000 7f1f2d864780 1 < completed multipart upload key=AN26EVAZI527 upload=S2ZZJZU0G0YD tag=2P7Z7B88BH1S type=write size=1646881 2024-09-12T00:34:26.001 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.003+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~PC8SHSMCPHNX.0 size=1048576 2024-09-12T00:34:26.002 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.004+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~PC8SHSMCPHNX.1 size=35920 2024-09-12T00:34:26.002 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.004+0000 7f1f2d864780 1 > prepared multipart upload key=W6U30X4HJCB1 upload=PC8SHSMCPHNX tag=75VFHJ868JJA type=write size=2133072 2024-09-12T00:34:26.003 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.005+0000 7f1f2d864780 1 < completed delete operation key=FFG41OYEYFZA tag=QGJ2SZT11O99 type=del 2024-09-12T00:34:26.008 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.007+0000 7f1f2d864780 1 > prepared part key=_multipart_2YCGIJRK6MUH.2~DNRL7972HV67.0 size=173885 2024-09-12T00:34:26.009 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.007+0000 7f1f2d864780 1 > prepared multipart upload key=2YCGIJRK6MUH upload=DNRL7972HV67 tag=CR51H0TJJZ25 type=write size=1222461 2024-09-12T00:34:26.009 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.008+0000 7f1f2d864780 1 < completed part key=_multipart_AN26EVAZI527.2~W52PNKQ8MKFC.0 size=1048576 2024-09-12T00:34:26.009 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.009+0000 7f1f2d864780 1 < completed part key=_multipart_AN26EVAZI527.2~W52PNKQ8MKFC.1 size=1036952 2024-09-12T00:34:26.009 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.011+0000 7f1f2d864780 1 < completed multipart upload key=AN26EVAZI527 upload=W52PNKQ8MKFC tag=R2KG45DRZHAU type=write size=3134104 2024-09-12T00:34:26.012 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.013+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~6YGOQYDNV4BX.0 size=1048576 2024-09-12T00:34:26.012 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.014+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~6YGOQYDNV4BX.1 size=1048576 2024-09-12T00:34:26.013 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.015+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~6YGOQYDNV4BX.2 size=319927 2024-09-12T00:34:26.013 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.015+0000 7f1f2d864780 1 > prepared multipart upload key=4FRVL0KXN2X8 upload=6YGOQYDNV4BX tag=E28ZE06KRY47 type=write size=3465655 2024-09-12T00:34:26.016 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.017+0000 7f1f2d864780 1 < suggested update operation key=AN26EVAZI527 tag=RHG6X4SDA5IC type=del size=3833251 2024-09-12T00:34:26.017 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.019+0000 7f1f2d864780 1 > prepared operation key=PVB52GO6L8T4 tag=2X0SFGNZXMKB type=del size=913333 2024-09-12T00:34:26.018 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.020+0000 7f1f2d864780 1 < completed delete operation key=FAP6N3H7SBN0 tag=5DRA18OA6NNG type=del 2024-09-12T00:34:26.019 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.021+0000 7f1f2d864780 1 > prepared operation key=O1YY03BOEYLM tag=26D8W9HQM0FM type=del size=2264857 2024-09-12T00:34:26.021 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.022+0000 7f1f2d864780 1 < completed delete operation key=DYKLAY6J018G tag=2E5V2B8EXQI6 type=del 2024-09-12T00:34:26.022 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.023+0000 7f1f2d864780 1 > prepared operation key=1299IOSGYIO9 tag=GKU8YRY6SDJI type=del size=196003 2024-09-12T00:34:26.023 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.025+0000 7f1f2d864780 1 < completed delete operation key=UTR2UUO6DHLJ tag=JUPT9SRAW17U type=del 2024-09-12T00:34:26.025 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.027+0000 7f1f2d864780 1 > prepared part key=_multipart_FFG41OYEYFZA.2~6JOD4F2FH3Y9.0 size=378413 2024-09-12T00:34:26.025 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.027+0000 7f1f2d864780 1 > prepared multipart upload key=FFG41OYEYFZA upload=6JOD4F2FH3Y9 tag=90HIXXTVWPFN type=write size=1426989 2024-09-12T00:34:26.026 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.028+0000 7f1f2d864780 1 < completed delete operation key=D21W9QZWY0YU tag=L00XDGOZFQ3X type=del 2024-09-12T00:34:26.028 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.030+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~L0NAMXGO9OZM.0 size=1048576 2024-09-12T00:34:26.029 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.031+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~L0NAMXGO9OZM.1 size=692979 2024-09-12T00:34:26.029 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.031+0000 7f1f2d864780 1 > prepared multipart upload key=D21W9QZWY0YU upload=L0NAMXGO9OZM tag=N4519MS87TXG type=write size=2790131 2024-09-12T00:34:26.031 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.032+0000 7f1f2d864780 1 < completed delete operation key=WIIU8VTCLWOD tag=CS58Y6IMAUFC type=del 2024-09-12T00:34:26.032 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.033+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=T7LD02L8UO4Y type=del size=1342774 2024-09-12T00:34:26.033 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.035+0000 7f1f2d864780 1 < completed part key=_multipart_OY145ZXRSF4L.2~1C7LGG3RNWD6.0 size=1048576 2024-09-12T00:34:26.034 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.036+0000 7f1f2d864780 1 < completed part key=_multipart_OY145ZXRSF4L.2~1C7LGG3RNWD6.1 size=1048576 2024-09-12T00:34:26.035 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.037+0000 7f1f2d864780 1 < completed part key=_multipart_OY145ZXRSF4L.2~1C7LGG3RNWD6.2 size=819929 2024-09-12T00:34:26.037 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.039+0000 7f1f2d864780 1 < completed multipart upload key=OY145ZXRSF4L upload=1C7LGG3RNWD6 tag=RAU7OYFFY1CK type=write size=3965657 2024-09-12T00:34:26.038 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.040+0000 7f1f2d864780 1 > prepared operation key=PVB52GO6L8T4 tag=ZYQQJQDG2NOD type=write size=452919 2024-09-12T00:34:26.039 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.041+0000 7f1f2d864780 1 < completed part key=_multipart_N9RQIGHVL8VP.2~0GETCSTLKL4S.0 size=1048576 2024-09-12T00:34:26.040 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.042+0000 7f1f2d864780 1 < completed part key=_multipart_N9RQIGHVL8VP.2~0GETCSTLKL4S.1 size=1048576 2024-09-12T00:34:26.041 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.043+0000 7f1f2d864780 1 < completed part key=_multipart_N9RQIGHVL8VP.2~0GETCSTLKL4S.2 size=220750 2024-09-12T00:34:26.043 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.045+0000 7f1f2d864780 1 < completed multipart upload key=N9RQIGHVL8VP upload=0GETCSTLKL4S tag=WNSF0MNBIATC type=write size=3366478 2024-09-12T00:34:26.045 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.046+0000 7f1f2d864780 1 > prepared operation key=WGKEA4EKF5GP tag=9732LDKQQZR4 type=write size=232261 2024-09-12T00:34:26.046 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.048+0000 7f1f2d864780 1 < completed part key=_multipart_GSPM8N0K7ODC.2~1CQM7B48BABA.0 size=1048576 2024-09-12T00:34:26.047 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.048+0000 7f1f2d864780 1 < completed part key=_multipart_GSPM8N0K7ODC.2~1CQM7B48BABA.1 size=1048576 2024-09-12T00:34:26.048 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.049+0000 7f1f2d864780 1 < completed part key=_multipart_GSPM8N0K7ODC.2~1CQM7B48BABA.2 size=82150 2024-09-12T00:34:26.050 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.051+0000 7f1f2d864780 1 < completed multipart upload key=GSPM8N0K7ODC upload=1CQM7B48BABA tag=KABCKL3O4A07 type=write size=3227878 2024-09-12T00:34:26.051 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.053+0000 7f1f2d864780 1 > prepared operation key=53QCNWX1V1R1 tag=0SXOL3C8W3CD type=del size=3832188 2024-09-12T00:34:26.053 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.054+0000 7f1f2d864780 1 < completed delete operation key=WGKEA4EKF5GP tag=2W0BNICUH77I type=del 2024-09-12T00:34:26.054 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.055+0000 7f1f2d864780 1 > prepared operation key=2G3UCYG4R4NM tag=RAPQJQZPLLQM type=write size=15472 2024-09-12T00:34:26.055 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.057+0000 7f1f2d864780 1 < completed delete operation key=PVB52GO6L8T4 tag=35TYW2XQZEZT type=del 2024-09-12T00:34:26.056 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.058+0000 7f1f2d864780 1 > prepared operation key=PVB52GO6L8T4 tag=3KE0RAD3D4PA type=write size=767160 2024-09-12T00:34:26.057 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.058+0000 7f1f2d864780 1 < canceled part key=_multipart_3Z1TGGPZKJ69.2~04274FKE0QUH.0 size=1048576 2024-09-12T00:34:26.058 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.059+0000 7f1f2d864780 1 < completed part key=_multipart_3Z1TGGPZKJ69.2~04274FKE0QUH.1 size=166008 2024-09-12T00:34:26.060 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.061+0000 7f1f2d864780 1 < canceled multipart upload key=3Z1TGGPZKJ69 upload=04274FKE0QUH tag=QJV5WCXP9FQ4 type=write size=2263160 2024-09-12T00:34:26.061 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.063+0000 7f1f2d864780 1 > prepared operation key=ZYNIJH0TTSM6 tag=G2TUI9T1H6IK type=del size=1314580 2024-09-12T00:34:26.062 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.064+0000 7f1f2d864780 1 < completed part key=_multipart_W6U30X4HJCB1.2~OY4ES5YPD7RV.0 size=1048576 2024-09-12T00:34:26.063 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.065+0000 7f1f2d864780 1 < completed part key=_multipart_W6U30X4HJCB1.2~OY4ES5YPD7RV.1 size=328281 2024-09-12T00:34:26.065 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.067+0000 7f1f2d864780 1 < completed multipart upload key=W6U30X4HJCB1 upload=OY4ES5YPD7RV tag=XUDRHWB55X6Y type=write size=2425433 2024-09-12T00:34:26.068 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.069+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~KI96MPKOMGDM.0 size=1048576 2024-09-12T00:34:26.069 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.070+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~KI96MPKOMGDM.1 size=1048576 2024-09-12T00:34:26.070 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.071+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~KI96MPKOMGDM.2 size=520903 2024-09-12T00:34:26.070 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.071+0000 7f1f2d864780 1 > prepared multipart upload key=4FRVL0KXN2X8 upload=KI96MPKOMGDM tag=410EXLSXX2SO type=write size=3666631 2024-09-12T00:34:26.071 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.073+0000 7f1f2d864780 1 < completed part key=_multipart_W6U30X4HJCB1.2~PC8SHSMCPHNX.0 size=1048576 2024-09-12T00:34:26.072 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.074+0000 7f1f2d864780 1 < completed part key=_multipart_W6U30X4HJCB1.2~PC8SHSMCPHNX.1 size=35920 2024-09-12T00:34:26.074 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.076+0000 7f1f2d864780 1 < completed multipart upload key=W6U30X4HJCB1 upload=PC8SHSMCPHNX tag=75VFHJ868JJA type=write size=2133072 2024-09-12T00:34:26.076 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.078+0000 7f1f2d864780 1 > prepared operation key=2G3UCYG4R4NM tag=W6QMIHFE8ZOW type=del size=2705727 2024-09-12T00:34:26.077 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.079+0000 7f1f2d864780 1 < completed part key=_multipart_2YCGIJRK6MUH.2~DNRL7972HV67.0 size=173885 2024-09-12T00:34:26.079 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.081+0000 7f1f2d864780 1 < completed multipart upload key=2YCGIJRK6MUH upload=DNRL7972HV67 tag=CR51H0TJJZ25 type=write size=1222461 2024-09-12T00:34:26.081 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.082+0000 7f1f2d864780 1 > prepared operation key=SZP418NVZ5VX tag=5JWJ3LAJ0689 type=del size=5631 2024-09-12T00:34:26.082 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.083+0000 7f1f2d864780 1 < completed part key=_multipart_4FRVL0KXN2X8.2~6YGOQYDNV4BX.0 size=1048576 2024-09-12T00:34:26.083 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.084+0000 7f1f2d864780 1 < completed part key=_multipart_4FRVL0KXN2X8.2~6YGOQYDNV4BX.1 size=1048576 2024-09-12T00:34:26.084 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.085+0000 7f1f2d864780 1 < completed part key=_multipart_4FRVL0KXN2X8.2~6YGOQYDNV4BX.2 size=319927 2024-09-12T00:34:26.085 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.087+0000 7f1f2d864780 1 < completed multipart upload key=4FRVL0KXN2X8 upload=6YGOQYDNV4BX tag=E28ZE06KRY47 type=write size=3465655 2024-09-12T00:34:26.087 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.088+0000 7f1f2d864780 1 > prepared operation key=KHPF1N1MT33Z tag=J77M5NPNCEKK type=del size=3275666 2024-09-12T00:34:26.089 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.091+0000 7f1f2d864780 1 < suggested remove operation key=PVB52GO6L8T4 tag=2X0SFGNZXMKB type=del 2024-09-12T00:34:26.091 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.093+0000 7f1f2d864780 1 > prepared part key=_multipart_2RV0899QUJ8W.2~9CPV7HI14IDG.0 size=1048576 2024-09-12T00:34:26.092 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.094+0000 7f1f2d864780 1 > prepared part key=_multipart_2RV0899QUJ8W.2~9CPV7HI14IDG.1 size=768217 2024-09-12T00:34:26.092 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.094+0000 7f1f2d864780 1 > prepared multipart upload key=2RV0899QUJ8W upload=9CPV7HI14IDG tag=M6R2Z0YIN2CV type=write size=2865369 2024-09-12T00:34:26.093 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.095+0000 7f1f2d864780 1 < completed delete operation key=O1YY03BOEYLM tag=26D8W9HQM0FM type=del 2024-09-12T00:34:26.094 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.096+0000 7f1f2d864780 1 > prepared operation key=OY145ZXRSF4L tag=KLMM2ID89811 type=del size=1078797 2024-09-12T00:34:26.095 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.097+0000 7f1f2d864780 1 < completed delete operation key=1299IOSGYIO9 tag=GKU8YRY6SDJI type=del 2024-09-12T00:34:26.097 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.099+0000 7f1f2d864780 1 > prepared part key=_multipart_S5DVMA14N7VJ.2~AY80QZ38YZ8W.0 size=237590 2024-09-12T00:34:26.097 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.099+0000 7f1f2d864780 1 > prepared multipart upload key=S5DVMA14N7VJ upload=AY80QZ38YZ8W tag=2GAHNSO8ETZG type=write size=1286166 2024-09-12T00:34:26.099 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.100+0000 7f1f2d864780 1 < completed part key=_multipart_FFG41OYEYFZA.2~6JOD4F2FH3Y9.0 size=378413 2024-09-12T00:34:26.101 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.102+0000 7f1f2d864780 1 < completed multipart upload key=FFG41OYEYFZA upload=6JOD4F2FH3Y9 tag=90HIXXTVWPFN type=write size=1426989 2024-09-12T00:34:26.102 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.103+0000 7f1f2d864780 1 > prepared operation key=S5DVMA14N7VJ tag=KLJW5BBVYD3Y type=write size=10521 2024-09-12T00:34:26.102 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.104+0000 7f1f2d864780 1 < canceled part key=_multipart_D21W9QZWY0YU.2~L0NAMXGO9OZM.0 size=1048576 2024-09-12T00:34:26.105 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.106+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~L0NAMXGO9OZM.1 size=692979 2024-09-12T00:34:26.107 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.108+0000 7f1f2d864780 1 < canceled multipart upload key=D21W9QZWY0YU upload=L0NAMXGO9OZM tag=N4519MS87TXG type=write size=2790131 2024-09-12T00:34:26.109 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.110+0000 7f1f2d864780 1 > prepared part key=_multipart_3Z1TGGPZKJ69.2~JSMG9R9K61JT.0 size=612684 2024-09-12T00:34:26.109 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.110+0000 7f1f2d864780 1 > prepared multipart upload key=3Z1TGGPZKJ69 upload=JSMG9R9K61JT tag=WB4TV3EU0UCX type=write size=1661260 2024-09-12T00:34:26.110 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.112+0000 7f1f2d864780 1 < completed delete operation key=2RV0899QUJ8W tag=T7LD02L8UO4Y type=del 2024-09-12T00:34:26.112 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.113+0000 7f1f2d864780 1 > prepared operation key=UTR2UUO6DHLJ tag=PEWMRGCWYFQD type=write size=449728 2024-09-12T00:34:26.113 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.114+0000 7f1f2d864780 -1 < failed to complete operation key=PVB52GO6L8T4 tag=ZYQQJQDG2NOD type=write size=452919: (22) Invalid argument 2024-09-12T00:34:26.115 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.116+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~7MC62H9IC1C4.0 size=1048576 2024-09-12T00:34:26.116 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.117+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~7MC62H9IC1C4.1 size=1048576 2024-09-12T00:34:26.117 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.118+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~7MC62H9IC1C4.2 size=616486 2024-09-12T00:34:26.117 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.118+0000 7f1f2d864780 1 > prepared multipart upload key=0DSQOFS8IIF5 upload=7MC62H9IC1C4 tag=V844DQ2MEEN4 type=write size=3762214 2024-09-12T00:34:26.119 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.121+0000 7f1f2d864780 1 < suggested update operation key=WGKEA4EKF5GP tag=9732LDKQQZR4 type=write size=232261 2024-09-12T00:34:26.120 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.122+0000 7f1f2d864780 1 > prepared operation key=0DSQOFS8IIF5 tag=KIXWILKD31OL type=del size=2803369 2024-09-12T00:34:26.121 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.123+0000 7f1f2d864780 1 < completed delete operation key=53QCNWX1V1R1 tag=0SXOL3C8W3CD type=del 2024-09-12T00:34:26.123 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.125+0000 7f1f2d864780 1 > prepared part key=_multipart_WIIU8VTCLWOD.2~S3A8EKSU95F2.0 size=860945 2024-09-12T00:34:26.124 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.125+0000 7f1f2d864780 1 > prepared multipart upload key=WIIU8VTCLWOD upload=S3A8EKSU95F2 tag=MF8XMQ079CL2 type=write size=1909521 2024-09-12T00:34:26.125 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.126+0000 7f1f2d864780 1 < completed write operation key=2G3UCYG4R4NM tag=RAPQJQZPLLQM type=write size=15472 2024-09-12T00:34:26.126 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.127+0000 7f1f2d864780 1 > prepared operation key=53QCNWX1V1R1 tag=5KO64HFLHOXK type=del size=1508295 2024-09-12T00:34:26.127 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.129+0000 7f1f2d864780 -1 < failed to complete operation key=PVB52GO6L8T4 tag=3KE0RAD3D4PA type=write size=767160: (22) Invalid argument 2024-09-12T00:34:26.128 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.130+0000 7f1f2d864780 1 > prepared operation key=O1YY03BOEYLM tag=EL46ROQ4W2ED type=del size=867180 2024-09-12T00:34:26.130 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.131+0000 7f1f2d864780 1 < canceled operation key=ZYNIJH0TTSM6 tag=G2TUI9T1H6IK type=del size=1314580 2024-09-12T00:34:26.131 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.132+0000 7f1f2d864780 1 > prepared operation key=KHPF1N1MT33Z tag=3OS50PKQTSVU type=del size=631952 2024-09-12T00:34:26.132 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.133+0000 7f1f2d864780 1 < completed part key=_multipart_4FRVL0KXN2X8.2~KI96MPKOMGDM.0 size=1048576 2024-09-12T00:34:26.133 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.135+0000 7f1f2d864780 1 < completed part key=_multipart_4FRVL0KXN2X8.2~KI96MPKOMGDM.1 size=1048576 2024-09-12T00:34:26.134 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.135+0000 7f1f2d864780 1 < completed part key=_multipart_4FRVL0KXN2X8.2~KI96MPKOMGDM.2 size=520903 2024-09-12T00:34:26.136 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.138+0000 7f1f2d864780 1 < completed multipart upload key=4FRVL0KXN2X8 upload=KI96MPKOMGDM tag=410EXLSXX2SO type=write size=3666631 2024-09-12T00:34:26.138 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.140+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~GCTAOPYJ0K4G.0 size=1048576 2024-09-12T00:34:26.139 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.141+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~GCTAOPYJ0K4G.1 size=1048576 2024-09-12T00:34:26.142 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.143+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~GCTAOPYJ0K4G.2 size=335859 2024-09-12T00:34:26.142 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.143+0000 7f1f2d864780 1 > prepared multipart upload key=SZP418NVZ5VX upload=GCTAOPYJ0K4G tag=82PFJIV9VG14 type=write size=3481587 2024-09-12T00:34:26.143 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.145+0000 7f1f2d864780 1 < completed delete operation key=2G3UCYG4R4NM tag=W6QMIHFE8ZOW type=del 2024-09-12T00:34:26.145 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.147+0000 7f1f2d864780 1 > prepared part key=_multipart_UTR2UUO6DHLJ.2~O4QP2EWGG6B2.0 size=1048576 2024-09-12T00:34:26.146 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.148+0000 7f1f2d864780 1 > prepared part key=_multipart_UTR2UUO6DHLJ.2~O4QP2EWGG6B2.1 size=162796 2024-09-12T00:34:26.146 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.148+0000 7f1f2d864780 1 > prepared multipart upload key=UTR2UUO6DHLJ upload=O4QP2EWGG6B2 tag=PEC0NP7Q8XB5 type=write size=2259948 2024-09-12T00:34:26.148 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.150+0000 7f1f2d864780 1 < suggested update operation key=SZP418NVZ5VX tag=5JWJ3LAJ0689 type=del size=5631 2024-09-12T00:34:26.150 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.151+0000 7f1f2d864780 1 > prepared operation key=D21W9QZWY0YU tag=8P2WYG630P0X type=del size=3048466 2024-09-12T00:34:26.151 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.152+0000 7f1f2d864780 1 < completed delete operation key=KHPF1N1MT33Z tag=J77M5NPNCEKK type=del 2024-09-12T00:34:26.153 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.154+0000 7f1f2d864780 1 > prepared part key=_multipart_N9RQIGHVL8VP.2~FASE3BT0JAER.0 size=1048576 2024-09-12T00:34:26.154 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.155+0000 7f1f2d864780 1 > prepared part key=_multipart_N9RQIGHVL8VP.2~FASE3BT0JAER.1 size=1048576 2024-09-12T00:34:26.155 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.156+0000 7f1f2d864780 1 > prepared part key=_multipart_N9RQIGHVL8VP.2~FASE3BT0JAER.2 size=231784 2024-09-12T00:34:26.155 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.156+0000 7f1f2d864780 1 > prepared multipart upload key=N9RQIGHVL8VP upload=FASE3BT0JAER tag=8AMRSYNHP2PG type=write size=3377512 2024-09-12T00:34:26.156 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.157+0000 7f1f2d864780 1 < completed part key=_multipart_2RV0899QUJ8W.2~9CPV7HI14IDG.0 size=1048576 2024-09-12T00:34:26.156 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.157+0000 7f1f2d864780 1 < canceled part key=_multipart_2RV0899QUJ8W.2~9CPV7HI14IDG.1 size=768217 2024-09-12T00:34:26.158 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.159+0000 7f1f2d864780 1 < canceled multipart upload key=2RV0899QUJ8W upload=9CPV7HI14IDG tag=M6R2Z0YIN2CV type=write size=2865369 2024-09-12T00:34:26.159 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.161+0000 7f1f2d864780 1 > prepared operation key=0DSQOFS8IIF5 tag=4STCUVBFSGFN type=del size=793697 2024-09-12T00:34:26.163 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.165+0000 7f1f2d864780 1 < suggested remove operation key=OY145ZXRSF4L tag=KLMM2ID89811 type=del 2024-09-12T00:34:26.165 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.167+0000 7f1f2d864780 1 > prepared part key=_multipart_WIIU8VTCLWOD.2~EZO3BZZGJRZ8.0 size=1048576 2024-09-12T00:34:26.166 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.168+0000 7f1f2d864780 1 > prepared part key=_multipart_WIIU8VTCLWOD.2~EZO3BZZGJRZ8.1 size=582766 2024-09-12T00:34:26.166 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.168+0000 7f1f2d864780 1 > prepared multipart upload key=WIIU8VTCLWOD upload=EZO3BZZGJRZ8 tag=N4QSAZINWTZU type=write size=2679918 2024-09-12T00:34:26.167 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.169+0000 7f1f2d864780 1 < completed part key=_multipart_S5DVMA14N7VJ.2~AY80QZ38YZ8W.0 size=237590 2024-09-12T00:34:26.169 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.171+0000 7f1f2d864780 1 < completed multipart upload key=S5DVMA14N7VJ upload=AY80QZ38YZ8W tag=2GAHNSO8ETZG type=write size=1286166 2024-09-12T00:34:26.170 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.172+0000 7f1f2d864780 1 > prepared operation key=SNCGB6Z20450 tag=ELH7ZA55JKA8 type=write size=1037756 2024-09-12T00:34:26.172 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.174+0000 7f1f2d864780 1 < suggested remove operation key=S5DVMA14N7VJ tag=KLJW5BBVYD3Y type=write 2024-09-12T00:34:26.174 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.176+0000 7f1f2d864780 1 > prepared part key=_multipart_WKK747ETLW10.2~XSDO0SEYIV5R.0 size=1048576 2024-09-12T00:34:26.175 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.177+0000 7f1f2d864780 1 > prepared part key=_multipart_WKK747ETLW10.2~XSDO0SEYIV5R.1 size=1043885 2024-09-12T00:34:26.175 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.177+0000 7f1f2d864780 1 > prepared multipart upload key=WKK747ETLW10 upload=XSDO0SEYIV5R tag=LCHS46V3O1CT type=write size=3141037 2024-09-12T00:34:26.176 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.178+0000 7f1f2d864780 1 < completed part key=_multipart_3Z1TGGPZKJ69.2~JSMG9R9K61JT.0 size=612684 2024-09-12T00:34:26.178 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.180+0000 7f1f2d864780 1 < completed multipart upload key=3Z1TGGPZKJ69 upload=JSMG9R9K61JT tag=WB4TV3EU0UCX type=write size=1661260 2024-09-12T00:34:26.179 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.181+0000 7f1f2d864780 1 > prepared operation key=SZP418NVZ5VX tag=C6KAQ6TZOK43 type=del size=3118691 2024-09-12T00:34:26.180 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.182+0000 7f1f2d864780 1 < completed write operation key=UTR2UUO6DHLJ tag=PEWMRGCWYFQD type=write size=449728 2024-09-12T00:34:26.182 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.184+0000 7f1f2d864780 1 > prepared part key=_multipart_AN26EVAZI527.2~2TLMOHLFX5PH.0 size=1048576 2024-09-12T00:34:26.183 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.185+0000 7f1f2d864780 1 > prepared part key=_multipart_AN26EVAZI527.2~2TLMOHLFX5PH.1 size=712012 2024-09-12T00:34:26.183 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.185+0000 7f1f2d864780 1 > prepared multipart upload key=AN26EVAZI527 upload=2TLMOHLFX5PH tag=NOE47UD4PTGP type=write size=2809164 2024-09-12T00:34:26.184 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.186+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~7MC62H9IC1C4.0 size=1048576 2024-09-12T00:34:26.185 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.187+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~7MC62H9IC1C4.1 size=1048576 2024-09-12T00:34:26.186 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.188+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~7MC62H9IC1C4.2 size=616486 2024-09-12T00:34:26.189 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.191+0000 7f1f2d864780 1 < completed multipart upload key=0DSQOFS8IIF5 upload=7MC62H9IC1C4 tag=V844DQ2MEEN4 type=write size=3762214 2024-09-12T00:34:26.190 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.192+0000 7f1f2d864780 1 > prepared operation key=WIIU8VTCLWOD tag=1RDDF607XUHJ type=del size=1812781 2024-09-12T00:34:26.191 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.193+0000 7f1f2d864780 1 < completed delete operation key=0DSQOFS8IIF5 tag=KIXWILKD31OL type=del 2024-09-12T00:34:26.192 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.194+0000 7f1f2d864780 1 > prepared operation key=2YCGIJRK6MUH tag=LU0GJRFVQDN2 type=del size=2629468 2024-09-12T00:34:26.193 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.195+0000 7f1f2d864780 1 < completed part key=_multipart_WIIU8VTCLWOD.2~S3A8EKSU95F2.0 size=860945 2024-09-12T00:34:26.195 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.197+0000 7f1f2d864780 1 < completed multipart upload key=WIIU8VTCLWOD upload=S3A8EKSU95F2 tag=MF8XMQ079CL2 type=write size=1909521 2024-09-12T00:34:26.197 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.199+0000 7f1f2d864780 1 > prepared part key=_multipart_OY145ZXRSF4L.2~MJZQ3XHNO81I.0 size=1048576 2024-09-12T00:34:26.198 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.200+0000 7f1f2d864780 1 > prepared part key=_multipart_OY145ZXRSF4L.2~MJZQ3XHNO81I.1 size=1048576 2024-09-12T00:34:26.199 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.201+0000 7f1f2d864780 1 > prepared part key=_multipart_OY145ZXRSF4L.2~MJZQ3XHNO81I.2 size=411355 2024-09-12T00:34:26.199 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.201+0000 7f1f2d864780 1 > prepared multipart upload key=OY145ZXRSF4L upload=MJZQ3XHNO81I tag=4F76RNVK9GQT type=write size=3557083 2024-09-12T00:34:26.200 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.202+0000 7f1f2d864780 1 < completed delete operation key=53QCNWX1V1R1 tag=5KO64HFLHOXK type=del 2024-09-12T00:34:26.202 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.204+0000 7f1f2d864780 1 > prepared part key=_multipart_3Z1TGGPZKJ69.2~T5LP7K4V2RD4.0 size=1048576 2024-09-12T00:34:26.203 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.205+0000 7f1f2d864780 1 > prepared part key=_multipart_3Z1TGGPZKJ69.2~T5LP7K4V2RD4.1 size=573801 2024-09-12T00:34:26.203 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.205+0000 7f1f2d864780 1 > prepared multipart upload key=3Z1TGGPZKJ69 upload=T5LP7K4V2RD4 tag=VINVDHYRDXXH type=write size=2670953 2024-09-12T00:34:26.205 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.206+0000 7f1f2d864780 1 < completed delete operation key=O1YY03BOEYLM tag=EL46ROQ4W2ED type=del 2024-09-12T00:34:26.207 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.208+0000 7f1f2d864780 1 > prepared part key=_multipart_WIIU8VTCLWOD.2~YJ9RDURI9KWA.0 size=1048576 2024-09-12T00:34:26.208 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.209+0000 7f1f2d864780 1 > prepared part key=_multipart_WIIU8VTCLWOD.2~YJ9RDURI9KWA.1 size=1048576 2024-09-12T00:34:26.209 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.210+0000 7f1f2d864780 1 > prepared part key=_multipart_WIIU8VTCLWOD.2~YJ9RDURI9KWA.2 size=16945 2024-09-12T00:34:26.209 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.210+0000 7f1f2d864780 1 > prepared multipart upload key=WIIU8VTCLWOD upload=YJ9RDURI9KWA tag=EVDTLIYD058C type=write size=3162673 2024-09-12T00:34:26.210 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.211+0000 7f1f2d864780 1 < completed delete operation key=KHPF1N1MT33Z tag=3OS50PKQTSVU type=del 2024-09-12T00:34:26.211 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.213+0000 7f1f2d864780 1 > prepared operation key=ZGO887JDR627 tag=K30FQD6YLR9A type=write size=564793 2024-09-12T00:34:26.212 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.214+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~GCTAOPYJ0K4G.0 size=1048576 2024-09-12T00:34:26.213 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.215+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~GCTAOPYJ0K4G.1 size=1048576 2024-09-12T00:34:26.214 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.216+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~GCTAOPYJ0K4G.2 size=335859 2024-09-12T00:34:26.216 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.218+0000 7f1f2d864780 1 < completed multipart upload key=SZP418NVZ5VX upload=GCTAOPYJ0K4G tag=82PFJIV9VG14 type=write size=3481587 2024-09-12T00:34:26.217 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.219+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=2DIW8ME80Q2J type=del size=1040012 2024-09-12T00:34:26.218 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.220+0000 7f1f2d864780 1 < completed part key=_multipart_UTR2UUO6DHLJ.2~O4QP2EWGG6B2.0 size=1048576 2024-09-12T00:34:26.219 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.221+0000 7f1f2d864780 1 < completed part key=_multipart_UTR2UUO6DHLJ.2~O4QP2EWGG6B2.1 size=162796 2024-09-12T00:34:26.223 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.225+0000 7f1f2d864780 1 < completed multipart upload key=UTR2UUO6DHLJ upload=O4QP2EWGG6B2 tag=PEC0NP7Q8XB5 type=write size=2259948 2024-09-12T00:34:26.224 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.226+0000 7f1f2d864780 1 > prepared operation key=3Z1TGGPZKJ69 tag=MGNY71S5R092 type=del size=1300638 2024-09-12T00:34:26.225 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.227+0000 7f1f2d864780 1 < completed delete operation key=D21W9QZWY0YU tag=8P2WYG630P0X type=del 2024-09-12T00:34:26.226 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.228+0000 7f1f2d864780 1 > prepared operation key=WKK747ETLW10 tag=5B6H07WV411I type=del size=3409266 2024-09-12T00:34:26.228 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.229+0000 7f1f2d864780 1 < completed part key=_multipart_N9RQIGHVL8VP.2~FASE3BT0JAER.0 size=1048576 2024-09-12T00:34:26.228 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.230+0000 7f1f2d864780 1 < completed part key=_multipart_N9RQIGHVL8VP.2~FASE3BT0JAER.1 size=1048576 2024-09-12T00:34:26.229 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.231+0000 7f1f2d864780 1 < completed part key=_multipart_N9RQIGHVL8VP.2~FASE3BT0JAER.2 size=231784 2024-09-12T00:34:26.231 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.233+0000 7f1f2d864780 1 < completed multipart upload key=N9RQIGHVL8VP upload=FASE3BT0JAER tag=8AMRSYNHP2PG type=write size=3377512 2024-09-12T00:34:26.232 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.234+0000 7f1f2d864780 1 > prepared operation key=ZYNIJH0TTSM6 tag=ANMJ7SY3P5DY type=write size=1015692 2024-09-12T00:34:26.234 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.235+0000 7f1f2d864780 1 < canceled operation key=0DSQOFS8IIF5 tag=4STCUVBFSGFN type=del size=793697 2024-09-12T00:34:26.235 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.236+0000 7f1f2d864780 1 > prepared operation key=53QCNWX1V1R1 tag=J1TOAZTPQPMD type=del size=3657272 2024-09-12T00:34:26.236 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.238+0000 7f1f2d864780 1 < completed part key=_multipart_WIIU8VTCLWOD.2~EZO3BZZGJRZ8.0 size=1048576 2024-09-12T00:34:26.237 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.238+0000 7f1f2d864780 1 < completed part key=_multipart_WIIU8VTCLWOD.2~EZO3BZZGJRZ8.1 size=582766 2024-09-12T00:34:26.239 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.240+0000 7f1f2d864780 1 < completed multipart upload key=WIIU8VTCLWOD upload=EZO3BZZGJRZ8 tag=N4QSAZINWTZU type=write size=2679918 2024-09-12T00:34:26.241 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.242+0000 7f1f2d864780 1 > prepared part key=_multipart_2YCGIJRK6MUH.2~D1TUOSJS1UUZ.0 size=1048576 2024-09-12T00:34:26.242 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.243+0000 7f1f2d864780 1 > prepared part key=_multipart_2YCGIJRK6MUH.2~D1TUOSJS1UUZ.1 size=471983 2024-09-12T00:34:26.242 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.243+0000 7f1f2d864780 1 > prepared multipart upload key=2YCGIJRK6MUH upload=D1TUOSJS1UUZ tag=GSNKXQFE8002 type=write size=2569135 2024-09-12T00:34:26.243 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.245+0000 7f1f2d864780 1 < completed write operation key=SNCGB6Z20450 tag=ELH7ZA55JKA8 type=write size=1037756 2024-09-12T00:34:26.244 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.246+0000 7f1f2d864780 1 > prepared operation key=DYKLAY6J018G tag=ZKATHOK8FC0T type=del size=1802642 2024-09-12T00:34:26.245 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.247+0000 7f1f2d864780 1 < completed part key=_multipart_WKK747ETLW10.2~XSDO0SEYIV5R.0 size=1048576 2024-09-12T00:34:26.246 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.248+0000 7f1f2d864780 1 < completed part key=_multipart_WKK747ETLW10.2~XSDO0SEYIV5R.1 size=1043885 2024-09-12T00:34:26.248 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.250+0000 7f1f2d864780 1 < completed multipart upload key=WKK747ETLW10 upload=XSDO0SEYIV5R tag=LCHS46V3O1CT type=write size=3141037 2024-09-12T00:34:26.249 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.251+0000 7f1f2d864780 1 > prepared operation key=ZGO887JDR627 tag=U0X4VJ04C3DD type=del size=48534 2024-09-12T00:34:26.250 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.252+0000 7f1f2d864780 1 < canceled operation key=SZP418NVZ5VX tag=C6KAQ6TZOK43 type=del size=3118691 2024-09-12T00:34:26.252 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.253+0000 7f1f2d864780 1 > prepared operation key=WKK747ETLW10 tag=QKFYOJB07E46 type=del size=202906 2024-09-12T00:34:26.253 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.254+0000 7f1f2d864780 1 < completed part key=_multipart_AN26EVAZI527.2~2TLMOHLFX5PH.0 size=1048576 2024-09-12T00:34:26.254 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.255+0000 7f1f2d864780 1 < completed part key=_multipart_AN26EVAZI527.2~2TLMOHLFX5PH.1 size=712012 2024-09-12T00:34:26.255 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.257+0000 7f1f2d864780 1 < completed multipart upload key=AN26EVAZI527 upload=2TLMOHLFX5PH tag=NOE47UD4PTGP type=write size=2809164 2024-09-12T00:34:26.257 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.258+0000 7f1f2d864780 1 > prepared operation key=SNCGB6Z20450 tag=Q7TBQYNR24YD type=write size=989925 2024-09-12T00:34:26.258 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.259+0000 7f1f2d864780 1 < completed delete operation key=WIIU8VTCLWOD tag=1RDDF607XUHJ type=del 2024-09-12T00:34:26.259 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.261+0000 7f1f2d864780 1 > prepared operation key=AN26EVAZI527 tag=R1I16QWA6WA4 type=del size=1985468 2024-09-12T00:34:26.260 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.262+0000 7f1f2d864780 1 < completed delete operation key=2YCGIJRK6MUH tag=LU0GJRFVQDN2 type=del 2024-09-12T00:34:26.261 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.263+0000 7f1f2d864780 1 > prepared operation key=SNCGB6Z20450 tag=BXVOF9WO62FQ type=del size=530525 2024-09-12T00:34:26.262 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.264+0000 7f1f2d864780 1 < completed part key=_multipart_OY145ZXRSF4L.2~MJZQ3XHNO81I.0 size=1048576 2024-09-12T00:34:26.263 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.264+0000 7f1f2d864780 1 < canceled part key=_multipart_OY145ZXRSF4L.2~MJZQ3XHNO81I.1 size=1048576 2024-09-12T00:34:26.264 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.265+0000 7f1f2d864780 1 < completed part key=_multipart_OY145ZXRSF4L.2~MJZQ3XHNO81I.2 size=411355 2024-09-12T00:34:26.265 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.267+0000 7f1f2d864780 1 < canceled multipart upload key=OY145ZXRSF4L upload=MJZQ3XHNO81I tag=4F76RNVK9GQT type=write size=3557083 2024-09-12T00:34:26.266 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.268+0000 7f1f2d864780 1 > prepared operation key=PVB52GO6L8T4 tag=QK07CDD87OR6 type=write size=78174 2024-09-12T00:34:26.268 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.269+0000 7f1f2d864780 1 < completed part key=_multipart_3Z1TGGPZKJ69.2~T5LP7K4V2RD4.0 size=1048576 2024-09-12T00:34:26.268 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.269+0000 7f1f2d864780 1 < canceled part key=_multipart_3Z1TGGPZKJ69.2~T5LP7K4V2RD4.1 size=573801 2024-09-12T00:34:26.270 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.271+0000 7f1f2d864780 1 < canceled multipart upload key=3Z1TGGPZKJ69 upload=T5LP7K4V2RD4 tag=VINVDHYRDXXH type=write size=2670953 2024-09-12T00:34:26.271 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.272+0000 7f1f2d864780 1 > prepared operation key=O1YY03BOEYLM tag=QDQEADS243BY type=write size=653821 2024-09-12T00:34:26.272 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.274+0000 7f1f2d864780 1 < completed part key=_multipart_WIIU8VTCLWOD.2~YJ9RDURI9KWA.0 size=1048576 2024-09-12T00:34:26.273 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.275+0000 7f1f2d864780 1 < completed part key=_multipart_WIIU8VTCLWOD.2~YJ9RDURI9KWA.1 size=1048576 2024-09-12T00:34:26.274 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.276+0000 7f1f2d864780 1 < completed part key=_multipart_WIIU8VTCLWOD.2~YJ9RDURI9KWA.2 size=16945 2024-09-12T00:34:26.276 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.278+0000 7f1f2d864780 1 < completed multipart upload key=WIIU8VTCLWOD upload=YJ9RDURI9KWA tag=EVDTLIYD058C type=write size=3162673 2024-09-12T00:34:26.279 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.280+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~SZWNFVEDQPQD.0 size=1048576 2024-09-12T00:34:26.279 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.281+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~SZWNFVEDQPQD.1 size=1048576 2024-09-12T00:34:26.280 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.282+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~SZWNFVEDQPQD.2 size=608390 2024-09-12T00:34:26.281 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.282+0000 7f1f2d864780 1 > prepared multipart upload key=FAP6N3H7SBN0 upload=SZWNFVEDQPQD tag=A42BFEYRUMWK type=write size=3754118 2024-09-12T00:34:26.282 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.283+0000 7f1f2d864780 1 < completed write operation key=ZGO887JDR627 tag=K30FQD6YLR9A type=write size=564793 2024-09-12T00:34:26.284 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.285+0000 7f1f2d864780 1 > prepared part key=_multipart_2RV0899QUJ8W.2~B6ENE0FG8KVY.0 size=892950 2024-09-12T00:34:26.284 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.285+0000 7f1f2d864780 1 > prepared multipart upload key=2RV0899QUJ8W upload=B6ENE0FG8KVY tag=9ZSKE74Y0STP type=write size=1941526 2024-09-12T00:34:26.285 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.287+0000 7f1f2d864780 1 < completed delete operation key=2RV0899QUJ8W tag=2DIW8ME80Q2J type=del 2024-09-12T00:34:26.287 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.289+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~W1MLGIGR6A62.0 size=858461 2024-09-12T00:34:26.287 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.289+0000 7f1f2d864780 1 > prepared multipart upload key=D21W9QZWY0YU upload=W1MLGIGR6A62 tag=BVWPOTTU7MYY type=write size=1907037 2024-09-12T00:34:26.288 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.290+0000 7f1f2d864780 1 < completed delete operation key=3Z1TGGPZKJ69 tag=MGNY71S5R092 type=del 2024-09-12T00:34:26.289 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.291+0000 7f1f2d864780 1 > prepared operation key=MSGU3PHLBRJH tag=1TI4I72UKASB type=write size=989756 2024-09-12T00:34:26.291 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.292+0000 7f1f2d864780 1 < completed delete operation key=WKK747ETLW10 tag=5B6H07WV411I type=del 2024-09-12T00:34:26.292 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.293+0000 7f1f2d864780 1 > prepared operation key=AN26EVAZI527 tag=K8QFTQFTZRVG type=del size=298818 2024-09-12T00:34:26.293 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.295+0000 7f1f2d864780 1 < canceled operation key=ZYNIJH0TTSM6 tag=ANMJ7SY3P5DY type=write size=1015692 2024-09-12T00:34:26.294 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.296+0000 7f1f2d864780 1 > prepared operation key=KHPF1N1MT33Z tag=0EPDC2EKX8GY type=del size=1398164 2024-09-12T00:34:26.295 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.297+0000 7f1f2d864780 1 < completed delete operation key=53QCNWX1V1R1 tag=J1TOAZTPQPMD type=del 2024-09-12T00:34:26.297 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.298+0000 7f1f2d864780 1 > prepared operation key=DYKLAY6J018G tag=I64XVQKA0ASM type=del size=2003998 2024-09-12T00:34:26.299 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.301+0000 7f1f2d864780 1 < completed part key=_multipart_2YCGIJRK6MUH.2~D1TUOSJS1UUZ.0 size=1048576 2024-09-12T00:34:26.300 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.302+0000 7f1f2d864780 1 < completed part key=_multipart_2YCGIJRK6MUH.2~D1TUOSJS1UUZ.1 size=471983 2024-09-12T00:34:26.302 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.303+0000 7f1f2d864780 1 < completed multipart upload key=2YCGIJRK6MUH upload=D1TUOSJS1UUZ tag=GSNKXQFE8002 type=write size=2569135 2024-09-12T00:34:26.303 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.304+0000 7f1f2d864780 1 > prepared operation key=2YCGIJRK6MUH tag=O00SNIG4KGMZ type=del size=2674623 2024-09-12T00:34:26.304 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.306+0000 7f1f2d864780 1 < completed delete operation key=DYKLAY6J018G tag=ZKATHOK8FC0T type=del 2024-09-12T00:34:26.305 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.307+0000 7f1f2d864780 1 > prepared operation key=S5DVMA14N7VJ tag=GXZ9B7MRD60K type=write size=534883 2024-09-12T00:34:26.307 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.309+0000 7f1f2d864780 1 < suggested update operation key=ZGO887JDR627 tag=U0X4VJ04C3DD type=del size=48534 2024-09-12T00:34:26.309 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.311+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~AD4FNORE7EA5.0 size=557365 2024-09-12T00:34:26.309 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.311+0000 7f1f2d864780 1 > prepared multipart upload key=SZP418NVZ5VX upload=AD4FNORE7EA5 tag=DUL38KSTYFHR type=write size=1605941 2024-09-12T00:34:26.310 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.312+0000 7f1f2d864780 1 < completed delete operation key=WKK747ETLW10 tag=QKFYOJB07E46 type=del 2024-09-12T00:34:26.312 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.313+0000 7f1f2d864780 1 > prepared operation key=3Z1TGGPZKJ69 tag=3O3CX4MHRSNT type=del size=2141331 2024-09-12T00:34:26.313 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.314+0000 7f1f2d864780 1 < completed write operation key=SNCGB6Z20450 tag=Q7TBQYNR24YD type=write size=989925 2024-09-12T00:34:26.314 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.315+0000 7f1f2d864780 1 > prepared operation key=ECZYQEZ942W8 tag=2TYBIY8RZL4Y type=write size=949319 2024-09-12T00:34:26.315 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.317+0000 7f1f2d864780 1 < completed delete operation key=AN26EVAZI527 tag=R1I16QWA6WA4 type=del 2024-09-12T00:34:26.316 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.318+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=L29TDTICOPD9 type=del size=2819369 2024-09-12T00:34:26.317 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.319+0000 7f1f2d864780 1 < completed delete operation key=SNCGB6Z20450 tag=BXVOF9WO62FQ type=del 2024-09-12T00:34:26.318 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.320+0000 7f1f2d864780 1 > prepared operation key=OY145ZXRSF4L tag=T1TW0H6YQKO3 type=del size=217806 2024-09-12T00:34:26.319 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.321+0000 7f1f2d864780 1 < canceled operation key=PVB52GO6L8T4 tag=QK07CDD87OR6 type=write size=78174 2024-09-12T00:34:26.321 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.322+0000 7f1f2d864780 1 > prepared operation key=4FRVL0KXN2X8 tag=XEGYDQT6S650 type=del size=983496 2024-09-12T00:34:26.323 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.324+0000 7f1f2d864780 1 < suggested remove operation key=O1YY03BOEYLM tag=QDQEADS243BY type=write 2024-09-12T00:34:26.324 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.325+0000 7f1f2d864780 1 > prepared operation key=MSGU3PHLBRJH tag=TLBDE12LQUCG type=del size=1790260 2024-09-12T00:34:26.325 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.327+0000 7f1f2d864780 1 < completed part key=_multipart_FAP6N3H7SBN0.2~SZWNFVEDQPQD.0 size=1048576 2024-09-12T00:34:26.326 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.327+0000 7f1f2d864780 1 < completed part key=_multipart_FAP6N3H7SBN0.2~SZWNFVEDQPQD.1 size=1048576 2024-09-12T00:34:26.327 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.328+0000 7f1f2d864780 1 < completed part key=_multipart_FAP6N3H7SBN0.2~SZWNFVEDQPQD.2 size=608390 2024-09-12T00:34:26.329 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.330+0000 7f1f2d864780 1 < completed multipart upload key=FAP6N3H7SBN0 upload=SZWNFVEDQPQD tag=A42BFEYRUMWK type=write size=3754118 2024-09-12T00:34:26.330 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.331+0000 7f1f2d864780 1 > prepared operation key=0DSQOFS8IIF5 tag=AOO2FBYY6OOT type=del size=1468809 2024-09-12T00:34:26.331 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.333+0000 7f1f2d864780 1 < completed part key=_multipart_2RV0899QUJ8W.2~B6ENE0FG8KVY.0 size=892950 2024-09-12T00:34:26.333 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.334+0000 7f1f2d864780 1 < completed multipart upload key=2RV0899QUJ8W upload=B6ENE0FG8KVY tag=9ZSKE74Y0STP type=write size=1941526 2024-09-12T00:34:26.334 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.335+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=QYHNZH9WYX52 type=del size=843908 2024-09-12T00:34:26.334 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.336+0000 7f1f2d864780 1 < canceled part key=_multipart_D21W9QZWY0YU.2~W1MLGIGR6A62.0 size=858461 2024-09-12T00:34:26.336 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.338+0000 7f1f2d864780 1 < canceled multipart upload key=D21W9QZWY0YU upload=W1MLGIGR6A62 tag=BVWPOTTU7MYY type=write size=1907037 2024-09-12T00:34:26.337 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.339+0000 7f1f2d864780 1 > prepared operation key=OY145ZXRSF4L tag=0QUUCFX0XRZ3 type=write size=314314 2024-09-12T00:34:26.338 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.340+0000 7f1f2d864780 1 < canceled operation key=MSGU3PHLBRJH tag=1TI4I72UKASB type=write size=989756 2024-09-12T00:34:26.340 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.342+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~NBY84NASFV2J.0 size=1048576 2024-09-12T00:34:26.341 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.343+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~NBY84NASFV2J.1 size=981879 2024-09-12T00:34:26.341 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.343+0000 7f1f2d864780 1 > prepared multipart upload key=W6U30X4HJCB1 upload=NBY84NASFV2J tag=S1TMAG33ZNS9 type=write size=3079031 2024-09-12T00:34:26.342 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.344+0000 7f1f2d864780 1 < completed delete operation key=AN26EVAZI527 tag=K8QFTQFTZRVG type=del 2024-09-12T00:34:26.344 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.345+0000 7f1f2d864780 1 > prepared operation key=GSPM8N0K7ODC tag=BMH5S5RS0XSJ type=write size=73350 2024-09-12T00:34:26.345 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.346+0000 7f1f2d864780 1 < completed delete operation key=KHPF1N1MT33Z tag=0EPDC2EKX8GY type=del 2024-09-12T00:34:26.346 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.347+0000 7f1f2d864780 1 > prepared operation key=SNCGB6Z20450 tag=W9PO6BZUXGRS type=del size=3585291 2024-09-12T00:34:26.347 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.349+0000 7f1f2d864780 1 < completed delete operation key=DYKLAY6J018G tag=I64XVQKA0ASM type=del 2024-09-12T00:34:26.348 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.350+0000 7f1f2d864780 1 > prepared operation key=UTR2UUO6DHLJ tag=KXDC9MPB1A0S type=del size=1708534 2024-09-12T00:34:26.349 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.351+0000 7f1f2d864780 1 < completed delete operation key=2YCGIJRK6MUH tag=O00SNIG4KGMZ type=del 2024-09-12T00:34:26.351 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.353+0000 7f1f2d864780 1 > prepared part key=_multipart_DYKLAY6J018G.2~34PPHNDLEQC1.0 size=1048576 2024-09-12T00:34:26.352 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.354+0000 7f1f2d864780 1 > prepared part key=_multipart_DYKLAY6J018G.2~34PPHNDLEQC1.1 size=1048576 2024-09-12T00:34:26.353 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.355+0000 7f1f2d864780 1 > prepared part key=_multipart_DYKLAY6J018G.2~34PPHNDLEQC1.2 size=574498 2024-09-12T00:34:26.353 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.355+0000 7f1f2d864780 1 > prepared multipart upload key=DYKLAY6J018G upload=34PPHNDLEQC1 tag=Q1IJ1PZQYMTO type=write size=3720226 2024-09-12T00:34:26.355 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.357+0000 7f1f2d864780 1 < suggested remove operation key=S5DVMA14N7VJ tag=GXZ9B7MRD60K type=write 2024-09-12T00:34:26.356 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.358+0000 7f1f2d864780 1 > prepared operation key=OY145ZXRSF4L tag=2VCLYE5V79PM type=write size=763820 2024-09-12T00:34:26.358 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.359+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~AD4FNORE7EA5.0 size=557365 2024-09-12T00:34:26.360 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.361+0000 7f1f2d864780 1 < completed multipart upload key=SZP418NVZ5VX upload=AD4FNORE7EA5 tag=DUL38KSTYFHR type=write size=1605941 2024-09-12T00:34:26.361 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.362+0000 7f1f2d864780 1 > prepared operation key=WIIU8VTCLWOD tag=80UPXRM8IPU5 type=del size=1881461 2024-09-12T00:34:26.362 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.364+0000 7f1f2d864780 1 < completed delete operation key=3Z1TGGPZKJ69 tag=3O3CX4MHRSNT type=del 2024-09-12T00:34:26.364 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.366+0000 7f1f2d864780 1 > prepared part key=_multipart_AN26EVAZI527.2~VKSYROBBQ4K0.0 size=1031976 2024-09-12T00:34:26.364 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.366+0000 7f1f2d864780 1 > prepared multipart upload key=AN26EVAZI527 upload=VKSYROBBQ4K0 tag=RMJ6FPC3DA47 type=write size=2080552 2024-09-12T00:34:26.365 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.367+0000 7f1f2d864780 1 < completed write operation key=ECZYQEZ942W8 tag=2TYBIY8RZL4Y type=write size=949319 2024-09-12T00:34:26.367 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.368+0000 7f1f2d864780 1 > prepared operation key=OY145ZXRSF4L tag=NVSVQMTKAVK2 type=write size=940508 2024-09-12T00:34:26.368 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.369+0000 7f1f2d864780 1 < completed delete operation key=2RV0899QUJ8W tag=L29TDTICOPD9 type=del 2024-09-12T00:34:26.369 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.371+0000 7f1f2d864780 1 > prepared operation key=PVB52GO6L8T4 tag=FLBWVYWHMBE7 type=del size=2853722 2024-09-12T00:34:26.370 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.372+0000 7f1f2d864780 1 < completed delete operation key=OY145ZXRSF4L tag=T1TW0H6YQKO3 type=del 2024-09-12T00:34:26.371 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.373+0000 7f1f2d864780 1 > prepared operation key=SNCGB6Z20450 tag=UF83Z15IRE39 type=del size=3650761 2024-09-12T00:34:26.372 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.374+0000 7f1f2d864780 1 < completed delete operation key=4FRVL0KXN2X8 tag=XEGYDQT6S650 type=del 2024-09-12T00:34:26.373 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.375+0000 7f1f2d864780 1 > prepared operation key=0DSQOFS8IIF5 tag=WEL7C54DO2AX type=del size=3504150 2024-09-12T00:34:26.375 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.376+0000 7f1f2d864780 1 < canceled operation key=MSGU3PHLBRJH tag=TLBDE12LQUCG type=del size=1790260 2024-09-12T00:34:26.377 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.378+0000 7f1f2d864780 1 > prepared part key=_multipart_ZGO887JDR627.2~J7BCC38N4QDV.0 size=1048576 2024-09-12T00:34:26.378 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.379+0000 7f1f2d864780 1 > prepared part key=_multipart_ZGO887JDR627.2~J7BCC38N4QDV.1 size=1048576 2024-09-12T00:34:26.379 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.380+0000 7f1f2d864780 1 > prepared part key=_multipart_ZGO887JDR627.2~J7BCC38N4QDV.2 size=171709 2024-09-12T00:34:26.379 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.380+0000 7f1f2d864780 1 > prepared multipart upload key=ZGO887JDR627 upload=J7BCC38N4QDV tag=9IE1N2N0PC70 type=write size=3317437 2024-09-12T00:34:26.380 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.381+0000 7f1f2d864780 1 < completed delete operation key=0DSQOFS8IIF5 tag=AOO2FBYY6OOT type=del 2024-09-12T00:34:26.382 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.383+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~IK923F0SYDEF.0 size=1048576 2024-09-12T00:34:26.383 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.384+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~IK923F0SYDEF.1 size=1048576 2024-09-12T00:34:26.384 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.385+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~IK923F0SYDEF.2 size=246336 2024-09-12T00:34:26.384 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.385+0000 7f1f2d864780 1 > prepared multipart upload key=D21W9QZWY0YU upload=IK923F0SYDEF tag=E7NH65I9IRCS type=write size=3392064 2024-09-12T00:34:26.385 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.387+0000 7f1f2d864780 1 < completed delete operation key=2RV0899QUJ8W tag=QYHNZH9WYX52 type=del 2024-09-12T00:34:26.386 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.388+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=4O0T8GP6HAU5 type=write size=475980 2024-09-12T00:34:26.387 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.389+0000 7f1f2d864780 1 < completed write operation key=OY145ZXRSF4L tag=0QUUCFX0XRZ3 type=write size=314314 2024-09-12T00:34:26.388 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.390+0000 7f1f2d864780 1 > prepared operation key=W6U30X4HJCB1 tag=CVBSOHA09KYZ type=del size=1044948 2024-09-12T00:34:26.389 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.390+0000 7f1f2d864780 1 < canceled part key=_multipart_W6U30X4HJCB1.2~NBY84NASFV2J.0 size=1048576 2024-09-12T00:34:26.389 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.391+0000 7f1f2d864780 1 < completed part key=_multipart_W6U30X4HJCB1.2~NBY84NASFV2J.1 size=981879 2024-09-12T00:34:26.391 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.393+0000 7f1f2d864780 1 < canceled multipart upload key=W6U30X4HJCB1 upload=NBY84NASFV2J tag=S1TMAG33ZNS9 type=write size=3079031 2024-09-12T00:34:26.392 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.394+0000 7f1f2d864780 1 > prepared operation key=9XK59MVZ5G1O tag=BTMVV01J6NTY type=del size=3155150 2024-09-12T00:34:26.394 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.395+0000 7f1f2d864780 1 < completed write operation key=GSPM8N0K7ODC tag=BMH5S5RS0XSJ type=write size=73350 2024-09-12T00:34:26.395 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.397+0000 7f1f2d864780 1 > prepared operation key=WKK747ETLW10 tag=IFV6D2ZIUY8U type=del size=422381 2024-09-12T00:34:26.397 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.399+0000 7f1f2d864780 1 < suggested remove operation key=SNCGB6Z20450 tag=W9PO6BZUXGRS type=del 2024-09-12T00:34:26.398 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.400+0000 7f1f2d864780 1 > prepared operation key=AN26EVAZI527 tag=W16BQKY7DR70 type=del size=959741 2024-09-12T00:34:26.401 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.403+0000 7f1f2d864780 1 < suggested remove operation key=UTR2UUO6DHLJ tag=KXDC9MPB1A0S type=del 2024-09-12T00:34:26.402 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.404+0000 7f1f2d864780 1 > prepared operation key=KHPF1N1MT33Z tag=0Q61NR1NGY6Y type=write size=232597 2024-09-12T00:34:26.404 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.405+0000 7f1f2d864780 1 < completed part key=_multipart_DYKLAY6J018G.2~34PPHNDLEQC1.0 size=1048576 2024-09-12T00:34:26.405 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.406+0000 7f1f2d864780 1 < completed part key=_multipart_DYKLAY6J018G.2~34PPHNDLEQC1.1 size=1048576 2024-09-12T00:34:26.406 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.407+0000 7f1f2d864780 1 < completed part key=_multipart_DYKLAY6J018G.2~34PPHNDLEQC1.2 size=574498 2024-09-12T00:34:26.408 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.410+0000 7f1f2d864780 1 < completed multipart upload key=DYKLAY6J018G upload=34PPHNDLEQC1 tag=Q1IJ1PZQYMTO type=write size=3720226 2024-09-12T00:34:26.410 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.411+0000 7f1f2d864780 1 > prepared operation key=OY145ZXRSF4L tag=RTZDQI6CY8DF type=del size=1918874 2024-09-12T00:34:26.412 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.414+0000 7f1f2d864780 1 < suggested update operation key=OY145ZXRSF4L tag=2VCLYE5V79PM type=write size=763820 2024-09-12T00:34:26.414 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.415+0000 7f1f2d864780 1 > prepared operation key=1299IOSGYIO9 tag=G21IEY3A11SK type=del size=1090429 2024-09-12T00:34:26.415 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.417+0000 7f1f2d864780 1 < completed delete operation key=WIIU8VTCLWOD tag=80UPXRM8IPU5 type=del 2024-09-12T00:34:26.416 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.418+0000 7f1f2d864780 1 > prepared operation key=S5DVMA14N7VJ tag=Y008X8GN5S5J type=del size=3278107 2024-09-12T00:34:26.416 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.418+0000 7f1f2d864780 1 < canceled part key=_multipart_AN26EVAZI527.2~VKSYROBBQ4K0.0 size=1031976 2024-09-12T00:34:26.420 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.420+0000 7f1f2d864780 1 < canceled multipart upload key=AN26EVAZI527 upload=VKSYROBBQ4K0 tag=RMJ6FPC3DA47 type=write size=2080552 2024-09-12T00:34:26.420 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.422+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~1YYTGTKT3NAY.0 size=1048576 2024-09-12T00:34:26.421 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.423+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~1YYTGTKT3NAY.1 size=111627 2024-09-12T00:34:26.421 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.423+0000 7f1f2d864780 1 > prepared multipart upload key=FAP6N3H7SBN0 upload=1YYTGTKT3NAY tag=OCNB030K0DE5 type=write size=2208779 2024-09-12T00:34:26.423 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.424+0000 7f1f2d864780 -1 < failed to complete operation key=OY145ZXRSF4L tag=NVSVQMTKAVK2 type=write size=940508: (22) Invalid argument 2024-09-12T00:34:26.425 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.426+0000 7f1f2d864780 1 > prepared part key=_multipart_N9RQIGHVL8VP.2~QTUIOCKWJEBM.0 size=1048576 2024-09-12T00:34:26.426 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.427+0000 7f1f2d864780 1 > prepared part key=_multipart_N9RQIGHVL8VP.2~QTUIOCKWJEBM.1 size=153050 2024-09-12T00:34:26.426 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.427+0000 7f1f2d864780 1 > prepared multipart upload key=N9RQIGHVL8VP upload=QTUIOCKWJEBM tag=X6JWIT9A45T8 type=write size=2250202 2024-09-12T00:34:26.428 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.430+0000 7f1f2d864780 1 < suggested update operation key=PVB52GO6L8T4 tag=FLBWVYWHMBE7 type=del size=2853722 2024-09-12T00:34:26.429 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.431+0000 7f1f2d864780 1 > prepared operation key=W6U30X4HJCB1 tag=D1U3K4JZAXTZ type=del size=1865476 2024-09-12T00:34:26.430 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.432+0000 7f1f2d864780 -1 < failed to complete operation key=SNCGB6Z20450 tag=UF83Z15IRE39 type=del size=3650761: (22) Invalid argument 2024-09-12T00:34:26.431 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.433+0000 7f1f2d864780 1 > prepared operation key=1299IOSGYIO9 tag=8RVEDAPB8E25 type=del size=1097996 2024-09-12T00:34:26.433 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.435+0000 7f1f2d864780 1 < suggested update operation key=0DSQOFS8IIF5 tag=WEL7C54DO2AX type=del size=3504150 2024-09-12T00:34:26.435 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.437+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~P0ZDDVXG63KT.0 size=1048576 2024-09-12T00:34:26.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.438+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~P0ZDDVXG63KT.1 size=1048576 2024-09-12T00:34:26.437 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.439+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~P0ZDDVXG63KT.2 size=287330 2024-09-12T00:34:26.437 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.439+0000 7f1f2d864780 1 > prepared multipart upload key=D21W9QZWY0YU upload=P0ZDDVXG63KT tag=EIQVXPCOP677 type=write size=3433058 2024-09-12T00:34:26.438 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.440+0000 7f1f2d864780 1 < completed part key=_multipart_ZGO887JDR627.2~J7BCC38N4QDV.0 size=1048576 2024-09-12T00:34:26.439 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.441+0000 7f1f2d864780 1 < completed part key=_multipart_ZGO887JDR627.2~J7BCC38N4QDV.1 size=1048576 2024-09-12T00:34:26.441 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.442+0000 7f1f2d864780 1 < completed part key=_multipart_ZGO887JDR627.2~J7BCC38N4QDV.2 size=171709 2024-09-12T00:34:26.443 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.444+0000 7f1f2d864780 1 < completed multipart upload key=ZGO887JDR627 upload=J7BCC38N4QDV tag=9IE1N2N0PC70 type=write size=3317437 2024-09-12T00:34:26.445 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.446+0000 7f1f2d864780 1 > prepared part key=_multipart_KHPF1N1MT33Z.2~6H1T3ASBWU63.0 size=1048576 2024-09-12T00:34:26.446 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.447+0000 7f1f2d864780 1 > prepared part key=_multipart_KHPF1N1MT33Z.2~6H1T3ASBWU63.1 size=1048576 2024-09-12T00:34:26.447 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.448+0000 7f1f2d864780 1 > prepared part key=_multipart_KHPF1N1MT33Z.2~6H1T3ASBWU63.2 size=33694 2024-09-12T00:34:26.447 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.448+0000 7f1f2d864780 1 > prepared multipart upload key=KHPF1N1MT33Z upload=6H1T3ASBWU63 tag=N5CM3OSQTHVC type=write size=3179422 2024-09-12T00:34:26.448 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.449+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~IK923F0SYDEF.0 size=1048576 2024-09-12T00:34:26.449 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.451+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~IK923F0SYDEF.1 size=1048576 2024-09-12T00:34:26.450 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.452+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~IK923F0SYDEF.2 size=246336 2024-09-12T00:34:26.453 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.454+0000 7f1f2d864780 1 < completed multipart upload key=D21W9QZWY0YU upload=IK923F0SYDEF tag=E7NH65I9IRCS type=write size=3392064 2024-09-12T00:34:26.455 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.457+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~5DT4H3C2CAVF.0 size=1048576 2024-09-12T00:34:26.456 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.458+0000 7f1f2d864780 1 > prepared part key=_multipart_D21W9QZWY0YU.2~5DT4H3C2CAVF.1 size=16640 2024-09-12T00:34:26.456 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.458+0000 7f1f2d864780 1 > prepared multipart upload key=D21W9QZWY0YU upload=5DT4H3C2CAVF tag=HHL5QF7A0DH7 type=write size=2113792 2024-09-12T00:34:26.457 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.459+0000 7f1f2d864780 1 < completed write operation key=2RV0899QUJ8W tag=4O0T8GP6HAU5 type=write size=475980 2024-09-12T00:34:26.460 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.461+0000 7f1f2d864780 1 > prepared part key=_multipart_ZGO887JDR627.2~EETT26Z33HT7.0 size=1015265 2024-09-12T00:34:26.460 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.461+0000 7f1f2d864780 1 > prepared multipart upload key=ZGO887JDR627 upload=EETT26Z33HT7 tag=RL4UC69EV1KS type=write size=2063841 2024-09-12T00:34:26.461 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.463+0000 7f1f2d864780 1 < completed delete operation key=W6U30X4HJCB1 tag=CVBSOHA09KYZ type=del 2024-09-12T00:34:26.462 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.464+0000 7f1f2d864780 1 > prepared operation key=SNCGB6Z20450 tag=0A3LERLMG2PL type=write size=10663 2024-09-12T00:34:26.464 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.465+0000 7f1f2d864780 1 < completed delete operation key=9XK59MVZ5G1O tag=BTMVV01J6NTY type=del 2024-09-12T00:34:26.466 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.467+0000 7f1f2d864780 1 > prepared part key=_multipart_SNCGB6Z20450.2~9M52DWZ2KICS.0 size=1048576 2024-09-12T00:34:26.467 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.468+0000 7f1f2d864780 1 > prepared part key=_multipart_SNCGB6Z20450.2~9M52DWZ2KICS.1 size=1048576 2024-09-12T00:34:26.468 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.469+0000 7f1f2d864780 1 > prepared part key=_multipart_SNCGB6Z20450.2~9M52DWZ2KICS.2 size=183798 2024-09-12T00:34:26.468 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.469+0000 7f1f2d864780 1 > prepared multipart upload key=SNCGB6Z20450 upload=9M52DWZ2KICS tag=4EGRXXXNNX3D type=write size=3329526 2024-09-12T00:34:26.469 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.470+0000 7f1f2d864780 1 < completed delete operation key=WKK747ETLW10 tag=IFV6D2ZIUY8U type=del 2024-09-12T00:34:26.471 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.473+0000 7f1f2d864780 1 > prepared part key=_multipart_ZGO887JDR627.2~1TMDQ9RI9Q2W.0 size=1048576 2024-09-12T00:34:26.472 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.474+0000 7f1f2d864780 1 > prepared part key=_multipart_ZGO887JDR627.2~1TMDQ9RI9Q2W.1 size=990595 2024-09-12T00:34:26.473 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.474+0000 7f1f2d864780 1 > prepared multipart upload key=ZGO887JDR627 upload=1TMDQ9RI9Q2W tag=6LNBOZ224W60 type=write size=3087747 2024-09-12T00:34:26.474 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.475+0000 7f1f2d864780 1 < completed delete operation key=AN26EVAZI527 tag=W16BQKY7DR70 type=del 2024-09-12T00:34:26.475 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.477+0000 7f1f2d864780 1 > prepared operation key=53QCNWX1V1R1 tag=RAFXY3ZOP2J3 type=del size=4065558 2024-09-12T00:34:26.477 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.479+0000 7f1f2d864780 1 < suggested remove operation key=KHPF1N1MT33Z tag=0Q61NR1NGY6Y type=write 2024-09-12T00:34:26.478 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.480+0000 7f1f2d864780 1 > prepared operation key=FAP6N3H7SBN0 tag=2OWPPQSOIVA8 type=del size=993329 2024-09-12T00:34:26.479 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.481+0000 7f1f2d864780 -1 < failed to complete operation key=OY145ZXRSF4L tag=RTZDQI6CY8DF type=del size=1918874: (22) Invalid argument 2024-09-12T00:34:26.481 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.482+0000 7f1f2d864780 1 > prepared operation key=1299IOSGYIO9 tag=81X7S3MSI7J3 type=del size=2431043 2024-09-12T00:34:26.482 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.483+0000 7f1f2d864780 1 < completed delete operation key=1299IOSGYIO9 tag=G21IEY3A11SK type=del 2024-09-12T00:34:26.484 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.486+0000 7f1f2d864780 1 > prepared part key=_multipart_GSPM8N0K7ODC.2~RA752VMFWWB4.0 size=1048576 2024-09-12T00:34:26.485 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.486+0000 7f1f2d864780 1 > prepared part key=_multipart_GSPM8N0K7ODC.2~RA752VMFWWB4.1 size=1048576 2024-09-12T00:34:26.486 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.487+0000 7f1f2d864780 1 > prepared part key=_multipart_GSPM8N0K7ODC.2~RA752VMFWWB4.2 size=609260 2024-09-12T00:34:26.486 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.487+0000 7f1f2d864780 1 > prepared multipart upload key=GSPM8N0K7ODC upload=RA752VMFWWB4 tag=U9RLBC10QCYU type=write size=3754988 2024-09-12T00:34:26.488 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.490+0000 7f1f2d864780 1 < suggested remove operation key=S5DVMA14N7VJ tag=Y008X8GN5S5J type=del 2024-09-12T00:34:26.489 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.491+0000 7f1f2d864780 1 > prepared operation key=OY145ZXRSF4L tag=URQPLHIG0G0B type=del size=2248342 2024-09-12T00:34:26.490 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.492+0000 7f1f2d864780 1 < completed part key=_multipart_FAP6N3H7SBN0.2~1YYTGTKT3NAY.0 size=1048576 2024-09-12T00:34:26.491 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.493+0000 7f1f2d864780 1 < completed part key=_multipart_FAP6N3H7SBN0.2~1YYTGTKT3NAY.1 size=111627 2024-09-12T00:34:26.494 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.495+0000 7f1f2d864780 1 < completed multipart upload key=FAP6N3H7SBN0 upload=1YYTGTKT3NAY tag=OCNB030K0DE5 type=write size=2208779 2024-09-12T00:34:26.496 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.497+0000 7f1f2d864780 1 > prepared part key=_multipart_UTR2UUO6DHLJ.2~9I6BLKLJGJM0.0 size=69923 2024-09-12T00:34:26.496 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.497+0000 7f1f2d864780 1 > prepared multipart upload key=UTR2UUO6DHLJ upload=9I6BLKLJGJM0 tag=N9E14QA5CXW5 type=write size=1118499 2024-09-12T00:34:26.497 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.498+0000 7f1f2d864780 1 < completed part key=_multipart_N9RQIGHVL8VP.2~QTUIOCKWJEBM.0 size=1048576 2024-09-12T00:34:26.498 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.500+0000 7f1f2d864780 1 < completed part key=_multipart_N9RQIGHVL8VP.2~QTUIOCKWJEBM.1 size=153050 2024-09-12T00:34:26.500 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.502+0000 7f1f2d864780 1 < completed multipart upload key=N9RQIGHVL8VP upload=QTUIOCKWJEBM tag=X6JWIT9A45T8 type=write size=2250202 2024-09-12T00:34:26.501 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.503+0000 7f1f2d864780 1 > prepared operation key=4FRVL0KXN2X8 tag=LSXKR8NDCILO type=del size=1376545 2024-09-12T00:34:26.503 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.505+0000 7f1f2d864780 1 < suggested update operation key=W6U30X4HJCB1 tag=D1U3K4JZAXTZ type=del size=1865476 2024-09-12T00:34:26.505 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.506+0000 7f1f2d864780 1 > prepared operation key=SZP418NVZ5VX tag=Q3VR58FU02M2 type=write size=646793 2024-09-12T00:34:26.506 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.508+0000 7f1f2d864780 1 < completed delete operation key=1299IOSGYIO9 tag=8RVEDAPB8E25 type=del 2024-09-12T00:34:26.507 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.509+0000 7f1f2d864780 1 > prepared operation key=WKK747ETLW10 tag=BSAEY6MCNLHL type=write size=158850 2024-09-12T00:34:26.508 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.510+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~P0ZDDVXG63KT.0 size=1048576 2024-09-12T00:34:26.509 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.511+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~P0ZDDVXG63KT.1 size=1048576 2024-09-12T00:34:26.510 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.512+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~P0ZDDVXG63KT.2 size=287330 2024-09-12T00:34:26.512 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.514+0000 7f1f2d864780 1 < completed multipart upload key=D21W9QZWY0YU upload=P0ZDDVXG63KT tag=EIQVXPCOP677 type=write size=3433058 2024-09-12T00:34:26.514 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.516+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~DL3X08RHQ514.0 size=1048576 2024-09-12T00:34:26.515 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.517+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~DL3X08RHQ514.1 size=1048576 2024-09-12T00:34:26.516 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.518+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~DL3X08RHQ514.2 size=935474 2024-09-12T00:34:26.516 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.518+0000 7f1f2d864780 1 > prepared multipart upload key=SZP418NVZ5VX upload=DL3X08RHQ514 tag=LDSU4HTGWUPN type=write size=4081202 2024-09-12T00:34:26.517 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.519+0000 7f1f2d864780 1 < completed part key=_multipart_KHPF1N1MT33Z.2~6H1T3ASBWU63.0 size=1048576 2024-09-12T00:34:26.518 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.520+0000 7f1f2d864780 1 < completed part key=_multipart_KHPF1N1MT33Z.2~6H1T3ASBWU63.1 size=1048576 2024-09-12T00:34:26.520 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.522+0000 7f1f2d864780 1 < completed part key=_multipart_KHPF1N1MT33Z.2~6H1T3ASBWU63.2 size=33694 2024-09-12T00:34:26.522 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.524+0000 7f1f2d864780 1 < completed multipart upload key=KHPF1N1MT33Z upload=6H1T3ASBWU63 tag=N5CM3OSQTHVC type=write size=3179422 2024-09-12T00:34:26.524 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.526+0000 7f1f2d864780 1 > prepared part key=_multipart_SNCGB6Z20450.2~0L3GDGIE0HIY.0 size=1048576 2024-09-12T00:34:26.525 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.527+0000 7f1f2d864780 1 > prepared part key=_multipart_SNCGB6Z20450.2~0L3GDGIE0HIY.1 size=151588 2024-09-12T00:34:26.525 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.527+0000 7f1f2d864780 1 > prepared multipart upload key=SNCGB6Z20450 upload=0L3GDGIE0HIY tag=1RODC2JELVWZ type=write size=2248740 2024-09-12T00:34:26.526 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.528+0000 7f1f2d864780 1 < completed part key=_multipart_D21W9QZWY0YU.2~5DT4H3C2CAVF.0 size=1048576 2024-09-12T00:34:26.526 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.528+0000 7f1f2d864780 1 < canceled part key=_multipart_D21W9QZWY0YU.2~5DT4H3C2CAVF.1 size=16640 2024-09-12T00:34:26.528 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.530+0000 7f1f2d864780 1 < canceled multipart upload key=D21W9QZWY0YU upload=5DT4H3C2CAVF tag=HHL5QF7A0DH7 type=write size=2113792 2024-09-12T00:34:26.530 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.532+0000 7f1f2d864780 1 > prepared part key=_multipart_ECZYQEZ942W8.2~YCH148KVC7IZ.0 size=1048576 2024-09-12T00:34:26.531 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.533+0000 7f1f2d864780 1 > prepared part key=_multipart_ECZYQEZ942W8.2~YCH148KVC7IZ.1 size=1048576 2024-09-12T00:34:26.532 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.534+0000 7f1f2d864780 1 > prepared part key=_multipart_ECZYQEZ942W8.2~YCH148KVC7IZ.2 size=938235 2024-09-12T00:34:26.532 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.534+0000 7f1f2d864780 1 > prepared multipart upload key=ECZYQEZ942W8 upload=YCH148KVC7IZ tag=SPZXUFCKEYB2 type=write size=4083963 2024-09-12T00:34:26.533 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.535+0000 7f1f2d864780 1 < completed part key=_multipart_ZGO887JDR627.2~EETT26Z33HT7.0 size=1015265 2024-09-12T00:34:26.535 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.537+0000 7f1f2d864780 1 < completed multipart upload key=ZGO887JDR627 upload=EETT26Z33HT7 tag=RL4UC69EV1KS type=write size=2063841 2024-09-12T00:34:26.536 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.538+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=YWS84U562MA3 type=del size=301354 2024-09-12T00:34:26.538 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.540+0000 7f1f2d864780 1 < suggested update operation key=SNCGB6Z20450 tag=0A3LERLMG2PL type=write size=10663 2024-09-12T00:34:26.539 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.541+0000 7f1f2d864780 1 > prepared operation key=MSGU3PHLBRJH tag=ZSPS0BG9VHZA type=del size=2219712 2024-09-12T00:34:26.540 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.542+0000 7f1f2d864780 1 < completed part key=_multipart_SNCGB6Z20450.2~9M52DWZ2KICS.0 size=1048576 2024-09-12T00:34:26.541 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.543+0000 7f1f2d864780 1 < completed part key=_multipart_SNCGB6Z20450.2~9M52DWZ2KICS.1 size=1048576 2024-09-12T00:34:26.542 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.544+0000 7f1f2d864780 1 < completed part key=_multipart_SNCGB6Z20450.2~9M52DWZ2KICS.2 size=183798 2024-09-12T00:34:26.544 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.546+0000 7f1f2d864780 1 < completed multipart upload key=SNCGB6Z20450 upload=9M52DWZ2KICS tag=4EGRXXXNNX3D type=write size=3329526 2024-09-12T00:34:26.546 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.547+0000 7f1f2d864780 1 > prepared operation key=WKK747ETLW10 tag=NXY51JGC04JH type=del size=3238607 2024-09-12T00:34:26.546 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.548+0000 7f1f2d864780 1 < canceled part key=_multipart_ZGO887JDR627.2~1TMDQ9RI9Q2W.0 size=1048576 2024-09-12T00:34:26.547 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.548+0000 7f1f2d864780 1 < completed part key=_multipart_ZGO887JDR627.2~1TMDQ9RI9Q2W.1 size=990595 2024-09-12T00:34:26.549 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.550+0000 7f1f2d864780 1 < canceled multipart upload key=ZGO887JDR627 upload=1TMDQ9RI9Q2W tag=6LNBOZ224W60 type=write size=3087747 2024-09-12T00:34:26.550 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.552+0000 7f1f2d864780 1 > prepared operation key=9XK59MVZ5G1O tag=Q445B4X2XLRW type=del size=1927956 2024-09-12T00:34:26.551 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.553+0000 7f1f2d864780 1 < completed delete operation key=53QCNWX1V1R1 tag=RAFXY3ZOP2J3 type=del 2024-09-12T00:34:26.552 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.554+0000 7f1f2d864780 1 > prepared operation key=WIIU8VTCLWOD tag=X4Q1GYBWDUL8 type=del size=263119 2024-09-12T00:34:26.554 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.556+0000 7f1f2d864780 1 < suggested remove operation key=FAP6N3H7SBN0 tag=2OWPPQSOIVA8 type=del 2024-09-12T00:34:26.557 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.558+0000 7f1f2d864780 1 > prepared part key=_multipart_OY145ZXRSF4L.2~QO1WTOA2P8CK.0 size=1048576 2024-09-12T00:34:26.558 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.559+0000 7f1f2d864780 1 > prepared part key=_multipart_OY145ZXRSF4L.2~QO1WTOA2P8CK.1 size=1048576 2024-09-12T00:34:26.558 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.560+0000 7f1f2d864780 1 > prepared part key=_multipart_OY145ZXRSF4L.2~QO1WTOA2P8CK.2 size=901917 2024-09-12T00:34:26.559 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.560+0000 7f1f2d864780 1 > prepared multipart upload key=OY145ZXRSF4L upload=QO1WTOA2P8CK tag=MBMGAO663R5B type=write size=4047645 2024-09-12T00:34:26.560 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.561+0000 7f1f2d864780 1 < completed delete operation key=1299IOSGYIO9 tag=81X7S3MSI7J3 type=del 2024-09-12T00:34:26.561 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.563+0000 7f1f2d864780 1 > prepared operation key=ZYNIJH0TTSM6 tag=UGS6PHN1B3AR type=del size=1288317 2024-09-12T00:34:26.562 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.564+0000 7f1f2d864780 1 < completed part key=_multipart_GSPM8N0K7ODC.2~RA752VMFWWB4.0 size=1048576 2024-09-12T00:34:26.563 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.565+0000 7f1f2d864780 1 < completed part key=_multipart_GSPM8N0K7ODC.2~RA752VMFWWB4.1 size=1048576 2024-09-12T00:34:26.564 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.566+0000 7f1f2d864780 1 < completed part key=_multipart_GSPM8N0K7ODC.2~RA752VMFWWB4.2 size=609260 2024-09-12T00:34:26.566 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.568+0000 7f1f2d864780 1 < completed multipart upload key=GSPM8N0K7ODC upload=RA752VMFWWB4 tag=U9RLBC10QCYU type=write size=3754988 2024-09-12T00:34:26.567 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.569+0000 7f1f2d864780 1 > prepared operation key=DYKLAY6J018G tag=MV6B63ICG88Z type=del size=3654315 2024-09-12T00:34:26.569 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.570+0000 7f1f2d864780 1 < completed delete operation key=OY145ZXRSF4L tag=URQPLHIG0G0B type=del 2024-09-12T00:34:26.571 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.573+0000 7f1f2d864780 1 > prepared part key=_multipart_FFG41OYEYFZA.2~065T7AWDYIKD.0 size=1048576 2024-09-12T00:34:26.572 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.574+0000 7f1f2d864780 1 > prepared part key=_multipart_FFG41OYEYFZA.2~065T7AWDYIKD.1 size=1048576 2024-09-12T00:34:26.573 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.575+0000 7f1f2d864780 1 > prepared part key=_multipart_FFG41OYEYFZA.2~065T7AWDYIKD.2 size=547539 2024-09-12T00:34:26.573 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.575+0000 7f1f2d864780 1 > prepared multipart upload key=FFG41OYEYFZA upload=065T7AWDYIKD tag=UHY3DRYJUISL type=write size=3693267 2024-09-12T00:34:26.574 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.576+0000 7f1f2d864780 1 < completed part key=_multipart_UTR2UUO6DHLJ.2~9I6BLKLJGJM0.0 size=69923 2024-09-12T00:34:26.577 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.578+0000 7f1f2d864780 1 < completed multipart upload key=UTR2UUO6DHLJ upload=9I6BLKLJGJM0 tag=N9E14QA5CXW5 type=write size=1118499 2024-09-12T00:34:26.579 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.581+0000 7f1f2d864780 1 > prepared part key=_multipart_2G3UCYG4R4NM.2~87NXUDY49XHG.0 size=1048576 2024-09-12T00:34:26.580 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.582+0000 7f1f2d864780 1 > prepared part key=_multipart_2G3UCYG4R4NM.2~87NXUDY49XHG.1 size=1032959 2024-09-12T00:34:26.580 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.582+0000 7f1f2d864780 1 > prepared multipart upload key=2G3UCYG4R4NM upload=87NXUDY49XHG tag=C97RLDPENGI7 type=write size=3130111 2024-09-12T00:34:26.583 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.584+0000 7f1f2d864780 1 < suggested update operation key=4FRVL0KXN2X8 tag=LSXKR8NDCILO type=del size=1376545 2024-09-12T00:34:26.584 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.585+0000 7f1f2d864780 1 > prepared operation key=O1YY03BOEYLM tag=T1DB7ITIN10S type=write size=824923 2024-09-12T00:34:26.585 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.587+0000 7f1f2d864780 1 < canceled operation key=SZP418NVZ5VX tag=Q3VR58FU02M2 type=write size=646793 2024-09-12T00:34:26.586 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.588+0000 7f1f2d864780 1 > prepared operation key=SNCGB6Z20450 tag=DX03BMVCHQRG type=del size=859099 2024-09-12T00:34:26.587 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.589+0000 7f1f2d864780 1 < completed write operation key=WKK747ETLW10 tag=BSAEY6MCNLHL type=write size=158850 2024-09-12T00:34:26.589 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.590+0000 7f1f2d864780 1 > prepared operation key=S5DVMA14N7VJ tag=T0N66JE18D38 type=del size=2476660 2024-09-12T00:34:26.590 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.591+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~DL3X08RHQ514.0 size=1048576 2024-09-12T00:34:26.591 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.592+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~DL3X08RHQ514.1 size=1048576 2024-09-12T00:34:26.592 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.593+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~DL3X08RHQ514.2 size=935474 2024-09-12T00:34:26.594 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.595+0000 7f1f2d864780 1 < completed multipart upload key=SZP418NVZ5VX upload=DL3X08RHQ514 tag=LDSU4HTGWUPN type=write size=4081202 2024-09-12T00:34:26.595 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.597+0000 7f1f2d864780 1 > prepared operation key=MSGU3PHLBRJH tag=BVTFN72UY625 type=del size=4083058 2024-09-12T00:34:26.596 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.598+0000 7f1f2d864780 1 < completed part key=_multipart_SNCGB6Z20450.2~0L3GDGIE0HIY.0 size=1048576 2024-09-12T00:34:26.597 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.599+0000 7f1f2d864780 1 < completed part key=_multipart_SNCGB6Z20450.2~0L3GDGIE0HIY.1 size=151588 2024-09-12T00:34:26.599 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.601+0000 7f1f2d864780 1 < completed multipart upload key=SNCGB6Z20450 upload=0L3GDGIE0HIY tag=1RODC2JELVWZ type=write size=2248740 2024-09-12T00:34:26.600 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.602+0000 7f1f2d864780 1 > prepared operation key=AN26EVAZI527 tag=D08R537LYBXB type=write size=225797 2024-09-12T00:34:26.601 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.602+0000 7f1f2d864780 1 < canceled part key=_multipart_ECZYQEZ942W8.2~YCH148KVC7IZ.0 size=1048576 2024-09-12T00:34:26.601 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.602+0000 7f1f2d864780 1 < canceled part key=_multipart_ECZYQEZ942W8.2~YCH148KVC7IZ.1 size=1048576 2024-09-12T00:34:26.602 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.603+0000 7f1f2d864780 1 < completed part key=_multipart_ECZYQEZ942W8.2~YCH148KVC7IZ.2 size=938235 2024-09-12T00:34:26.603 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.605+0000 7f1f2d864780 1 < canceled multipart upload key=ECZYQEZ942W8 upload=YCH148KVC7IZ tag=SPZXUFCKEYB2 type=write size=4083963 2024-09-12T00:34:26.605 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.606+0000 7f1f2d864780 1 > prepared operation key=WIIU8VTCLWOD tag=ZPUDG3MYF00K type=del size=184869 2024-09-12T00:34:26.606 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.607+0000 7f1f2d864780 1 < completed delete operation key=2RV0899QUJ8W tag=YWS84U562MA3 type=del 2024-09-12T00:34:26.607 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.609+0000 7f1f2d864780 1 > prepared operation key=1299IOSGYIO9 tag=2XCENIKMROBE type=del size=3571372 2024-09-12T00:34:26.608 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.610+0000 7f1f2d864780 1 < completed delete operation key=MSGU3PHLBRJH tag=ZSPS0BG9VHZA type=del 2024-09-12T00:34:26.610 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.612+0000 7f1f2d864780 1 > prepared part key=_multipart_ZGO887JDR627.2~ZBTHI8N118S9.0 size=1048576 2024-09-12T00:34:26.611 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.613+0000 7f1f2d864780 1 > prepared part key=_multipart_ZGO887JDR627.2~ZBTHI8N118S9.1 size=667691 2024-09-12T00:34:26.611 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.613+0000 7f1f2d864780 1 > prepared multipart upload key=ZGO887JDR627 upload=ZBTHI8N118S9 tag=YQ3N4WLRBUS0 type=write size=2764843 2024-09-12T00:34:26.612 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.614+0000 7f1f2d864780 1 < completed delete operation key=WKK747ETLW10 tag=NXY51JGC04JH type=del 2024-09-12T00:34:26.615 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.616+0000 7f1f2d864780 1 > prepared part key=_multipart_53QCNWX1V1R1.2~K60064DAXGYI.0 size=1048576 2024-09-12T00:34:26.615 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.617+0000 7f1f2d864780 1 > prepared part key=_multipart_53QCNWX1V1R1.2~K60064DAXGYI.1 size=1048576 2024-09-12T00:34:26.616 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.618+0000 7f1f2d864780 1 > prepared part key=_multipart_53QCNWX1V1R1.2~K60064DAXGYI.2 size=1023475 2024-09-12T00:34:26.617 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.618+0000 7f1f2d864780 1 > prepared multipart upload key=53QCNWX1V1R1 upload=K60064DAXGYI tag=FXKYSESGO5XO type=write size=4169203 2024-09-12T00:34:26.618 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.619+0000 7f1f2d864780 1 < completed delete operation key=9XK59MVZ5G1O tag=Q445B4X2XLRW type=del 2024-09-12T00:34:26.622 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.623+0000 7f1f2d864780 1 > prepared part key=_multipart_FFG41OYEYFZA.2~VLPAHUBH7810.0 size=1048576 2024-09-12T00:34:26.623 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.624+0000 7f1f2d864780 1 > prepared part key=_multipart_FFG41OYEYFZA.2~VLPAHUBH7810.1 size=1048576 2024-09-12T00:34:26.624 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.625+0000 7f1f2d864780 1 > prepared part key=_multipart_FFG41OYEYFZA.2~VLPAHUBH7810.2 size=986804 2024-09-12T00:34:26.624 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.625+0000 7f1f2d864780 1 > prepared multipart upload key=FFG41OYEYFZA upload=VLPAHUBH7810 tag=K7KA1W3Q6S21 type=write size=4132532 2024-09-12T00:34:26.629 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.628+0000 7f1f2d864780 1 < suggested update operation key=WIIU8VTCLWOD tag=X4Q1GYBWDUL8 type=del size=263119 2024-09-12T00:34:26.629 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.629+0000 7f1f2d864780 1 > prepared operation key=1299IOSGYIO9 tag=T6H84NJMIT4W type=del size=1089041 2024-09-12T00:34:26.629 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.630+0000 7f1f2d864780 1 < completed part key=_multipart_OY145ZXRSF4L.2~QO1WTOA2P8CK.0 size=1048576 2024-09-12T00:34:26.630 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.631+0000 7f1f2d864780 1 < completed part key=_multipart_OY145ZXRSF4L.2~QO1WTOA2P8CK.1 size=1048576 2024-09-12T00:34:26.631 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.633+0000 7f1f2d864780 1 < completed part key=_multipart_OY145ZXRSF4L.2~QO1WTOA2P8CK.2 size=901917 2024-09-12T00:34:26.635 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.637+0000 7f1f2d864780 1 < completed multipart upload key=OY145ZXRSF4L upload=QO1WTOA2P8CK tag=MBMGAO663R5B type=write size=4047645 2024-09-12T00:34:26.638 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.640+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~5ISW9J9P5DSC.0 size=754774 2024-09-12T00:34:26.638 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.640+0000 7f1f2d864780 1 > prepared multipart upload key=SZP418NVZ5VX upload=5ISW9J9P5DSC tag=MIY5RTRKLX3B type=write size=1803350 2024-09-12T00:34:26.639 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.641+0000 7f1f2d864780 1 < canceled operation key=ZYNIJH0TTSM6 tag=UGS6PHN1B3AR type=del size=1288317 2024-09-12T00:34:26.640 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.642+0000 7f1f2d864780 1 > prepared operation key=ZGO887JDR627 tag=75RL64NTS5KR type=del size=1009676 2024-09-12T00:34:26.642 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.643+0000 7f1f2d864780 1 < completed delete operation key=DYKLAY6J018G tag=MV6B63ICG88Z type=del 2024-09-12T00:34:26.644 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.645+0000 7f1f2d864780 1 > prepared part key=_multipart_OY145ZXRSF4L.2~BZF1RCT3604A.0 size=140572 2024-09-12T00:34:26.644 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.645+0000 7f1f2d864780 1 > prepared multipart upload key=OY145ZXRSF4L upload=BZF1RCT3604A tag=XTPYWS09CQFB type=write size=1189148 2024-09-12T00:34:26.645 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.646+0000 7f1f2d864780 1 < completed part key=_multipart_FFG41OYEYFZA.2~065T7AWDYIKD.0 size=1048576 2024-09-12T00:34:26.646 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.647+0000 7f1f2d864780 1 < completed part key=_multipart_FFG41OYEYFZA.2~065T7AWDYIKD.1 size=1048576 2024-09-12T00:34:26.647 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.648+0000 7f1f2d864780 1 < completed part key=_multipart_FFG41OYEYFZA.2~065T7AWDYIKD.2 size=547539 2024-09-12T00:34:26.648 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.650+0000 7f1f2d864780 1 < completed multipart upload key=FFG41OYEYFZA upload=065T7AWDYIKD tag=UHY3DRYJUISL type=write size=3693267 2024-09-12T00:34:26.650 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.651+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=RZRPK2V75HOR type=del size=878543 2024-09-12T00:34:26.651 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.652+0000 7f1f2d864780 1 < completed part key=_multipart_2G3UCYG4R4NM.2~87NXUDY49XHG.0 size=1048576 2024-09-12T00:34:26.652 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.653+0000 7f1f2d864780 1 < completed part key=_multipart_2G3UCYG4R4NM.2~87NXUDY49XHG.1 size=1032959 2024-09-12T00:34:26.654 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.655+0000 7f1f2d864780 1 < completed multipart upload key=2G3UCYG4R4NM upload=87NXUDY49XHG tag=C97RLDPENGI7 type=write size=3130111 2024-09-12T00:34:26.655 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.657+0000 7f1f2d864780 1 > prepared operation key=0DSQOFS8IIF5 tag=2QABT4TXD62R type=del size=3022198 2024-09-12T00:34:26.656 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.658+0000 7f1f2d864780 1 < completed write operation key=O1YY03BOEYLM tag=T1DB7ITIN10S type=write size=824923 2024-09-12T00:34:26.657 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.659+0000 7f1f2d864780 1 > prepared operation key=OY145ZXRSF4L tag=1PTI352D3UXP type=del size=603925 2024-09-12T00:34:26.660 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.661+0000 7f1f2d864780 1 < suggested remove operation key=SNCGB6Z20450 tag=DX03BMVCHQRG type=del 2024-09-12T00:34:26.661 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.663+0000 7f1f2d864780 1 > prepared operation key=UTR2UUO6DHLJ tag=DFC44S6CDBTL type=del size=510333 2024-09-12T00:34:26.662 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.664+0000 7f1f2d864780 1 < completed delete operation key=S5DVMA14N7VJ tag=T0N66JE18D38 type=del 2024-09-12T00:34:26.664 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.666+0000 7f1f2d864780 1 > prepared part key=_multipart_UTR2UUO6DHLJ.2~3AG5VPG6FTWA.0 size=1048576 2024-09-12T00:34:26.665 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.667+0000 7f1f2d864780 1 > prepared part key=_multipart_UTR2UUO6DHLJ.2~3AG5VPG6FTWA.1 size=1048576 2024-09-12T00:34:26.666 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.668+0000 7f1f2d864780 1 > prepared part key=_multipart_UTR2UUO6DHLJ.2~3AG5VPG6FTWA.2 size=249724 2024-09-12T00:34:26.666 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.668+0000 7f1f2d864780 1 > prepared multipart upload key=UTR2UUO6DHLJ upload=3AG5VPG6FTWA tag=CCLWC2KFTZOZ type=write size=3395452 2024-09-12T00:34:26.667 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.669+0000 7f1f2d864780 1 < completed delete operation key=MSGU3PHLBRJH tag=BVTFN72UY625 type=del 2024-09-12T00:34:26.668 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.670+0000 7f1f2d864780 1 > prepared operation key=UTR2UUO6DHLJ tag=LDKIBNV8VZRK type=del size=863638 2024-09-12T00:34:26.669 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.671+0000 7f1f2d864780 1 < completed write operation key=AN26EVAZI527 tag=D08R537LYBXB type=write size=225797 2024-09-12T00:34:26.670 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.672+0000 7f1f2d864780 1 > prepared operation key=WIIU8VTCLWOD tag=786LY1VORC4Z type=del size=2870188 2024-09-12T00:34:26.672 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.673+0000 7f1f2d864780 -1 < failed to complete operation key=WIIU8VTCLWOD tag=ZPUDG3MYF00K type=del size=184869: (22) Invalid argument 2024-09-12T00:34:26.674 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.675+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~VNKFJ317CKFR.0 size=1048576 2024-09-12T00:34:26.674 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.676+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~VNKFJ317CKFR.1 size=37244 2024-09-12T00:34:26.674 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.676+0000 7f1f2d864780 1 > prepared multipart upload key=W6U30X4HJCB1 upload=VNKFJ317CKFR tag=5UPUNUVDR5D7 type=write size=2134396 2024-09-12T00:34:26.676 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.677+0000 7f1f2d864780 1 < canceled operation key=1299IOSGYIO9 tag=2XCENIKMROBE type=del size=3571372 2024-09-12T00:34:26.678 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.679+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~A71T51GMFYU9.0 size=1048576 2024-09-12T00:34:26.679 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.680+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~A71T51GMFYU9.1 size=623635 2024-09-12T00:34:26.679 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.680+0000 7f1f2d864780 1 > prepared multipart upload key=WGKEA4EKF5GP upload=A71T51GMFYU9 tag=BR4IKY2IK644 type=write size=2720787 2024-09-12T00:34:26.680 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.682+0000 7f1f2d864780 1 < completed part key=_multipart_ZGO887JDR627.2~ZBTHI8N118S9.0 size=1048576 2024-09-12T00:34:26.681 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.682+0000 7f1f2d864780 1 < completed part key=_multipart_ZGO887JDR627.2~ZBTHI8N118S9.1 size=667691 2024-09-12T00:34:26.683 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.685+0000 7f1f2d864780 1 < completed multipart upload key=ZGO887JDR627 upload=ZBTHI8N118S9 tag=YQ3N4WLRBUS0 type=write size=2764843 2024-09-12T00:34:26.684 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.686+0000 7f1f2d864780 1 > prepared operation key=S5DVMA14N7VJ tag=YANRGJ1AJ873 type=del size=3600538 2024-09-12T00:34:26.686 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.687+0000 7f1f2d864780 1 < completed part key=_multipart_53QCNWX1V1R1.2~K60064DAXGYI.0 size=1048576 2024-09-12T00:34:26.687 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.688+0000 7f1f2d864780 1 < completed part key=_multipart_53QCNWX1V1R1.2~K60064DAXGYI.1 size=1048576 2024-09-12T00:34:26.688 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.689+0000 7f1f2d864780 1 < completed part key=_multipart_53QCNWX1V1R1.2~K60064DAXGYI.2 size=1023475 2024-09-12T00:34:26.690 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.691+0000 7f1f2d864780 1 < completed multipart upload key=53QCNWX1V1R1 upload=K60064DAXGYI tag=FXKYSESGO5XO type=write size=4169203 2024-09-12T00:34:26.691 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.693+0000 7f1f2d864780 1 > prepared operation key=OY145ZXRSF4L tag=QVC0VWH24YQS type=del size=331343 2024-09-12T00:34:26.692 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.694+0000 7f1f2d864780 1 < completed part key=_multipart_FFG41OYEYFZA.2~VLPAHUBH7810.0 size=1048576 2024-09-12T00:34:26.693 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.695+0000 7f1f2d864780 1 < completed part key=_multipart_FFG41OYEYFZA.2~VLPAHUBH7810.1 size=1048576 2024-09-12T00:34:26.694 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.696+0000 7f1f2d864780 1 < completed part key=_multipart_FFG41OYEYFZA.2~VLPAHUBH7810.2 size=986804 2024-09-12T00:34:26.696 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.698+0000 7f1f2d864780 1 < completed multipart upload key=FFG41OYEYFZA upload=VLPAHUBH7810 tag=K7KA1W3Q6S21 type=write size=4132532 2024-09-12T00:34:26.698 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.700+0000 7f1f2d864780 1 > prepared part key=_multipart_ZGO887JDR627.2~APS22R8EA03Z.0 size=1048576 2024-09-12T00:34:26.699 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.701+0000 7f1f2d864780 1 > prepared part key=_multipart_ZGO887JDR627.2~APS22R8EA03Z.1 size=1048576 2024-09-12T00:34:26.700 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.702+0000 7f1f2d864780 1 > prepared part key=_multipart_ZGO887JDR627.2~APS22R8EA03Z.2 size=813641 2024-09-12T00:34:26.700 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.702+0000 7f1f2d864780 1 > prepared multipart upload key=ZGO887JDR627 upload=APS22R8EA03Z tag=AT4PHBMDTDZM type=write size=3959369 2024-09-12T00:34:26.701 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.703+0000 7f1f2d864780 1 < completed delete operation key=1299IOSGYIO9 tag=T6H84NJMIT4W type=del 2024-09-12T00:34:26.702 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.704+0000 7f1f2d864780 1 > prepared operation key=4FRVL0KXN2X8 tag=1IXMQKGZGMZU type=del size=1997081 2024-09-12T00:34:26.703 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.705+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~5ISW9J9P5DSC.0 size=754774 2024-09-12T00:34:26.706 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.707+0000 7f1f2d864780 1 < completed multipart upload key=SZP418NVZ5VX upload=5ISW9J9P5DSC tag=MIY5RTRKLX3B type=write size=1803350 2024-09-12T00:34:26.707 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.708+0000 7f1f2d864780 1 > prepared operation key=2YCGIJRK6MUH tag=98N3JQ9ANXKL type=del size=1969545 2024-09-12T00:34:26.708 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.710+0000 7f1f2d864780 1 < completed delete operation key=ZGO887JDR627 tag=75RL64NTS5KR type=del 2024-09-12T00:34:26.709 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.711+0000 7f1f2d864780 1 > prepared operation key=FFG41OYEYFZA tag=7NH8XOIF30ZJ type=del size=1343855 2024-09-12T00:34:26.710 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.712+0000 7f1f2d864780 1 < completed part key=_multipart_OY145ZXRSF4L.2~BZF1RCT3604A.0 size=140572 2024-09-12T00:34:26.712 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.714+0000 7f1f2d864780 1 < completed multipart upload key=OY145ZXRSF4L upload=BZF1RCT3604A tag=XTPYWS09CQFB type=write size=1189148 2024-09-12T00:34:26.715 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.716+0000 7f1f2d864780 1 > prepared part key=_multipart_S5DVMA14N7VJ.2~ZFBB1K1WF2XP.0 size=978878 2024-09-12T00:34:26.715 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.716+0000 7f1f2d864780 1 > prepared multipart upload key=S5DVMA14N7VJ upload=ZFBB1K1WF2XP tag=14KKGVLKANM1 type=write size=2027454 2024-09-12T00:34:26.716 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.717+0000 7f1f2d864780 1 < completed delete operation key=2RV0899QUJ8W tag=RZRPK2V75HOR type=del 2024-09-12T00:34:26.717 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.719+0000 7f1f2d864780 1 > prepared operation key=2YCGIJRK6MUH tag=ATMIVDW2L6BZ type=del size=784670 2024-09-12T00:34:26.719 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.721+0000 7f1f2d864780 1 < suggested update operation key=0DSQOFS8IIF5 tag=2QABT4TXD62R type=del size=3022198 2024-09-12T00:34:26.721 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.722+0000 7f1f2d864780 1 > prepared operation key=WIIU8VTCLWOD tag=R84N4O1W666M type=write size=98802 2024-09-12T00:34:26.723 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.724+0000 7f1f2d864780 1 < suggested update operation key=OY145ZXRSF4L tag=1PTI352D3UXP type=del size=603925 2024-09-12T00:34:26.724 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.725+0000 7f1f2d864780 1 > prepared operation key=WKK747ETLW10 tag=29E9WNG1P3N6 type=del size=4115926 2024-09-12T00:34:26.725 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.727+0000 7f1f2d864780 1 < completed delete operation key=UTR2UUO6DHLJ tag=DFC44S6CDBTL type=del 2024-09-12T00:34:26.727 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.729+0000 7f1f2d864780 1 > prepared part key=_multipart_9XK59MVZ5G1O.2~CGX2S2XAP0EM.0 size=1048576 2024-09-12T00:34:26.728 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.730+0000 7f1f2d864780 1 > prepared part key=_multipart_9XK59MVZ5G1O.2~CGX2S2XAP0EM.1 size=1048576 2024-09-12T00:34:26.730 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.731+0000 7f1f2d864780 1 > prepared part key=_multipart_9XK59MVZ5G1O.2~CGX2S2XAP0EM.2 size=112291 2024-09-12T00:34:26.730 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.731+0000 7f1f2d864780 1 > prepared multipart upload key=9XK59MVZ5G1O upload=CGX2S2XAP0EM tag=IXX96HP0DBJP type=write size=3258019 2024-09-12T00:34:26.731 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.733+0000 7f1f2d864780 1 < completed part key=_multipart_UTR2UUO6DHLJ.2~3AG5VPG6FTWA.0 size=1048576 2024-09-12T00:34:26.732 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.734+0000 7f1f2d864780 1 < completed part key=_multipart_UTR2UUO6DHLJ.2~3AG5VPG6FTWA.1 size=1048576 2024-09-12T00:34:26.733 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.735+0000 7f1f2d864780 1 < completed part key=_multipart_UTR2UUO6DHLJ.2~3AG5VPG6FTWA.2 size=249724 2024-09-12T00:34:26.735 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.736+0000 7f1f2d864780 1 < completed multipart upload key=UTR2UUO6DHLJ upload=3AG5VPG6FTWA tag=CCLWC2KFTZOZ type=write size=3395452 2024-09-12T00:34:26.737 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.738+0000 7f1f2d864780 1 > prepared part key=_multipart_9XK59MVZ5G1O.2~NBG7XJU5F92H.0 size=646956 2024-09-12T00:34:26.737 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.738+0000 7f1f2d864780 1 > prepared multipart upload key=9XK59MVZ5G1O upload=NBG7XJU5F92H tag=KCAP3ZPCQKJU type=write size=1695532 2024-09-12T00:34:26.738 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.740+0000 7f1f2d864780 1 < completed delete operation key=UTR2UUO6DHLJ tag=LDKIBNV8VZRK type=del 2024-09-12T00:34:26.740 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.742+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~SWAS1BTV72F8.0 size=1048576 2024-09-12T00:34:26.741 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.742+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~SWAS1BTV72F8.1 size=1048576 2024-09-12T00:34:26.743 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.744+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~SWAS1BTV72F8.2 size=377572 2024-09-12T00:34:26.743 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.744+0000 7f1f2d864780 1 > prepared multipart upload key=4FRVL0KXN2X8 upload=SWAS1BTV72F8 tag=7TCJ96IYNKXC type=write size=3523300 2024-09-12T00:34:26.744 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.746+0000 7f1f2d864780 1 < completed delete operation key=WIIU8VTCLWOD tag=786LY1VORC4Z type=del 2024-09-12T00:34:26.746 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.748+0000 7f1f2d864780 1 > prepared part key=_multipart_KHPF1N1MT33Z.2~7HCG22O89DSZ.0 size=538939 2024-09-12T00:34:26.746 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.748+0000 7f1f2d864780 1 > prepared multipart upload key=KHPF1N1MT33Z upload=7HCG22O89DSZ tag=JMY8439B2YL3 type=write size=1587515 2024-09-12T00:34:26.747 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.749+0000 7f1f2d864780 1 < completed part key=_multipart_W6U30X4HJCB1.2~VNKFJ317CKFR.0 size=1048576 2024-09-12T00:34:26.748 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.750+0000 7f1f2d864780 1 < completed part key=_multipart_W6U30X4HJCB1.2~VNKFJ317CKFR.1 size=37244 2024-09-12T00:34:26.750 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.752+0000 7f1f2d864780 1 < completed multipart upload key=W6U30X4HJCB1 upload=VNKFJ317CKFR tag=5UPUNUVDR5D7 type=write size=2134396 2024-09-12T00:34:26.751 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.753+0000 7f1f2d864780 1 > prepared operation key=0DSQOFS8IIF5 tag=40QDOWCLO835 type=del size=1391464 2024-09-12T00:34:26.752 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.754+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~A71T51GMFYU9.0 size=1048576 2024-09-12T00:34:26.753 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.755+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~A71T51GMFYU9.1 size=623635 2024-09-12T00:34:26.755 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.757+0000 7f1f2d864780 1 < completed multipart upload key=WGKEA4EKF5GP upload=A71T51GMFYU9 tag=BR4IKY2IK644 type=write size=2720787 2024-09-12T00:34:26.757 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.758+0000 7f1f2d864780 1 > prepared operation key=AN26EVAZI527 tag=OVU4XXFYAZ0N type=write size=326332 2024-09-12T00:34:26.758 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.759+0000 7f1f2d864780 1 < canceled operation key=S5DVMA14N7VJ tag=YANRGJ1AJ873 type=del size=3600538 2024-09-12T00:34:26.760 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.761+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~F3U2EVZ3AFDZ.0 size=1048576 2024-09-12T00:34:26.761 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.762+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~F3U2EVZ3AFDZ.1 size=928173 2024-09-12T00:34:26.761 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.762+0000 7f1f2d864780 1 > prepared multipart upload key=WGKEA4EKF5GP upload=F3U2EVZ3AFDZ tag=0SDHB0934JPZ type=write size=3025325 2024-09-12T00:34:26.763 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.765+0000 7f1f2d864780 1 < suggested update operation key=OY145ZXRSF4L tag=QVC0VWH24YQS type=del size=331343 2024-09-12T00:34:26.765 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.767+0000 7f1f2d864780 1 > prepared part key=_multipart_AN26EVAZI527.2~KDWVEWH18JOR.0 size=1048576 2024-09-12T00:34:26.766 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.768+0000 7f1f2d864780 1 > prepared part key=_multipart_AN26EVAZI527.2~KDWVEWH18JOR.1 size=245269 2024-09-12T00:34:26.766 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.768+0000 7f1f2d864780 1 > prepared multipart upload key=AN26EVAZI527 upload=KDWVEWH18JOR tag=SPFXGR9AIGL3 type=write size=2342421 2024-09-12T00:34:26.767 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.769+0000 7f1f2d864780 1 < completed part key=_multipart_ZGO887JDR627.2~APS22R8EA03Z.0 size=1048576 2024-09-12T00:34:26.767 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.769+0000 7f1f2d864780 1 < canceled part key=_multipart_ZGO887JDR627.2~APS22R8EA03Z.1 size=1048576 2024-09-12T00:34:26.768 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.770+0000 7f1f2d864780 1 < completed part key=_multipart_ZGO887JDR627.2~APS22R8EA03Z.2 size=813641 2024-09-12T00:34:26.770 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.772+0000 7f1f2d864780 1 < canceled multipart upload key=ZGO887JDR627 upload=APS22R8EA03Z tag=AT4PHBMDTDZM type=write size=3959369 2024-09-12T00:34:26.772 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.774+0000 7f1f2d864780 1 > prepared part key=_multipart_2YCGIJRK6MUH.2~7ODRC957FN93.0 size=1048576 2024-09-12T00:34:26.773 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.775+0000 7f1f2d864780 1 > prepared part key=_multipart_2YCGIJRK6MUH.2~7ODRC957FN93.1 size=1048576 2024-09-12T00:34:26.774 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.776+0000 7f1f2d864780 1 > prepared part key=_multipart_2YCGIJRK6MUH.2~7ODRC957FN93.2 size=74894 2024-09-12T00:34:26.774 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.776+0000 7f1f2d864780 1 > prepared multipart upload key=2YCGIJRK6MUH upload=7ODRC957FN93 tag=KKYHHQB0OI1W type=write size=3220622 2024-09-12T00:34:26.776 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.778+0000 7f1f2d864780 1 < suggested update operation key=4FRVL0KXN2X8 tag=1IXMQKGZGMZU type=del size=1997081 2024-09-12T00:34:26.777 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.779+0000 7f1f2d864780 1 > prepared operation key=S5DVMA14N7VJ tag=6XJSBNJKYXGZ type=del size=1572540 2024-09-12T00:34:26.778 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.780+0000 7f1f2d864780 1 < canceled operation key=2YCGIJRK6MUH tag=98N3JQ9ANXKL type=del size=1969545 2024-09-12T00:34:26.780 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.782+0000 7f1f2d864780 1 > prepared part key=_multipart_GSPM8N0K7ODC.2~9JUNPP9IQGLX.0 size=1048576 2024-09-12T00:34:26.781 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.783+0000 7f1f2d864780 1 > prepared part key=_multipart_GSPM8N0K7ODC.2~9JUNPP9IQGLX.1 size=1020299 2024-09-12T00:34:26.781 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.783+0000 7f1f2d864780 1 > prepared multipart upload key=GSPM8N0K7ODC upload=9JUNPP9IQGLX tag=I1HWCAKJP31B type=write size=3117451 2024-09-12T00:34:26.783 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.784+0000 7f1f2d864780 1 < completed delete operation key=FFG41OYEYFZA tag=7NH8XOIF30ZJ type=del 2024-09-12T00:34:26.784 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.786+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~MZV8GQ8SQCZB.0 size=1048576 2024-09-12T00:34:26.785 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.787+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~MZV8GQ8SQCZB.1 size=1048576 2024-09-12T00:34:26.786 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.788+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~MZV8GQ8SQCZB.2 size=913064 2024-09-12T00:34:26.786 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.788+0000 7f1f2d864780 1 > prepared multipart upload key=W6U30X4HJCB1 upload=MZV8GQ8SQCZB tag=07N02L1BQPY3 type=write size=4058792 2024-09-12T00:34:26.787 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.789+0000 7f1f2d864780 1 < completed part key=_multipart_S5DVMA14N7VJ.2~ZFBB1K1WF2XP.0 size=978878 2024-09-12T00:34:26.789 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.791+0000 7f1f2d864780 1 < completed multipart upload key=S5DVMA14N7VJ upload=ZFBB1K1WF2XP tag=14KKGVLKANM1 type=write size=2027454 2024-09-12T00:34:26.790 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.792+0000 7f1f2d864780 1 > prepared operation key=WGKEA4EKF5GP tag=B752QT07J2YV type=del size=157008 2024-09-12T00:34:26.791 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.793+0000 7f1f2d864780 1 < completed delete operation key=2YCGIJRK6MUH tag=ATMIVDW2L6BZ type=del 2024-09-12T00:34:26.793 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.795+0000 7f1f2d864780 1 > prepared part key=_multipart_ZGO887JDR627.2~P1DAZ4ZD83G4.0 size=485627 2024-09-12T00:34:26.793 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.795+0000 7f1f2d864780 1 > prepared multipart upload key=ZGO887JDR627 upload=P1DAZ4ZD83G4 tag=EU7T2XQ45S01 type=write size=1534203 2024-09-12T00:34:26.794 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.796+0000 7f1f2d864780 1 < completed write operation key=WIIU8VTCLWOD tag=R84N4O1W666M type=write size=98802 2024-09-12T00:34:26.797 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.798+0000 7f1f2d864780 1 > prepared part key=_multipart_PVB52GO6L8T4.2~UQ7TWXJ08VB0.0 size=1048576 2024-09-12T00:34:26.797 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.799+0000 7f1f2d864780 1 > prepared part key=_multipart_PVB52GO6L8T4.2~UQ7TWXJ08VB0.1 size=1048576 2024-09-12T00:34:26.799 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.800+0000 7f1f2d864780 1 > prepared part key=_multipart_PVB52GO6L8T4.2~UQ7TWXJ08VB0.2 size=120492 2024-09-12T00:34:26.799 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.800+0000 7f1f2d864780 1 > prepared multipart upload key=PVB52GO6L8T4 upload=UQ7TWXJ08VB0 tag=BQ91FDDE4SML type=write size=3266220 2024-09-12T00:34:26.800 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.801+0000 7f1f2d864780 1 < completed delete operation key=WKK747ETLW10 tag=29E9WNG1P3N6 type=del 2024-09-12T00:34:26.802 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.803+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~7LSR9NFKW1T1.0 size=1048576 2024-09-12T00:34:26.803 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.804+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~7LSR9NFKW1T1.1 size=804149 2024-09-12T00:34:26.803 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.804+0000 7f1f2d864780 1 > prepared multipart upload key=1299IOSGYIO9 upload=7LSR9NFKW1T1 tag=DUISIHUB0D0U type=write size=2901301 2024-09-12T00:34:26.803 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.804+0000 7f1f2d864780 1 < canceled part key=_multipart_9XK59MVZ5G1O.2~CGX2S2XAP0EM.0 size=1048576 2024-09-12T00:34:26.804 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.805+0000 7f1f2d864780 1 < completed part key=_multipart_9XK59MVZ5G1O.2~CGX2S2XAP0EM.1 size=1048576 2024-09-12T00:34:26.805 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.806+0000 7f1f2d864780 1 < completed part key=_multipart_9XK59MVZ5G1O.2~CGX2S2XAP0EM.2 size=112291 2024-09-12T00:34:26.807 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.808+0000 7f1f2d864780 1 < canceled multipart upload key=9XK59MVZ5G1O upload=CGX2S2XAP0EM tag=IXX96HP0DBJP type=write size=3258019 2024-09-12T00:34:26.808 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.809+0000 7f1f2d864780 1 > prepared operation key=53QCNWX1V1R1 tag=XP0B27N6V79G type=del size=1226508 2024-09-12T00:34:26.809 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.810+0000 7f1f2d864780 1 < completed part key=_multipart_9XK59MVZ5G1O.2~NBG7XJU5F92H.0 size=646956 2024-09-12T00:34:26.811 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.812+0000 7f1f2d864780 1 < completed multipart upload key=9XK59MVZ5G1O upload=NBG7XJU5F92H tag=KCAP3ZPCQKJU type=write size=1695532 2024-09-12T00:34:26.812 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.813+0000 7f1f2d864780 1 > prepared operation key=SNCGB6Z20450 tag=84AIJ37QAHL7 type=del size=950106 2024-09-12T00:34:26.813 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.815+0000 7f1f2d864780 1 < completed part key=_multipart_4FRVL0KXN2X8.2~SWAS1BTV72F8.0 size=1048576 2024-09-12T00:34:26.814 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.816+0000 7f1f2d864780 1 < completed part key=_multipart_4FRVL0KXN2X8.2~SWAS1BTV72F8.1 size=1048576 2024-09-12T00:34:26.815 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.817+0000 7f1f2d864780 1 < completed part key=_multipart_4FRVL0KXN2X8.2~SWAS1BTV72F8.2 size=377572 2024-09-12T00:34:26.817 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.819+0000 7f1f2d864780 1 < completed multipart upload key=4FRVL0KXN2X8 upload=SWAS1BTV72F8 tag=7TCJ96IYNKXC type=write size=3523300 2024-09-12T00:34:26.818 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.820+0000 7f1f2d864780 1 > prepared operation key=3Z1TGGPZKJ69 tag=XZYX1LNSFRE5 type=del size=227162 2024-09-12T00:34:26.819 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.821+0000 7f1f2d864780 1 < completed part key=_multipart_KHPF1N1MT33Z.2~7HCG22O89DSZ.0 size=538939 2024-09-12T00:34:26.821 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.823+0000 7f1f2d864780 1 < completed multipart upload key=KHPF1N1MT33Z upload=7HCG22O89DSZ tag=JMY8439B2YL3 type=write size=1587515 2024-09-12T00:34:26.822 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.824+0000 7f1f2d864780 1 > prepared operation key=ZYNIJH0TTSM6 tag=R2VSDN0K6YA1 type=del size=771099 2024-09-12T00:34:26.823 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.825+0000 7f1f2d864780 1 < completed delete operation key=0DSQOFS8IIF5 tag=40QDOWCLO835 type=del 2024-09-12T00:34:26.825 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.827+0000 7f1f2d864780 1 > prepared part key=_multipart_9XK59MVZ5G1O.2~VBXLYGV7DDCC.0 size=1048576 2024-09-12T00:34:26.826 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.828+0000 7f1f2d864780 1 > prepared part key=_multipart_9XK59MVZ5G1O.2~VBXLYGV7DDCC.1 size=1048576 2024-09-12T00:34:26.827 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.829+0000 7f1f2d864780 1 > prepared part key=_multipart_9XK59MVZ5G1O.2~VBXLYGV7DDCC.2 size=129102 2024-09-12T00:34:26.827 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.829+0000 7f1f2d864780 1 > prepared multipart upload key=9XK59MVZ5G1O upload=VBXLYGV7DDCC tag=CDOD0JZZEO6O type=write size=3274830 2024-09-12T00:34:26.829 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.830+0000 7f1f2d864780 1 < completed write operation key=AN26EVAZI527 tag=OVU4XXFYAZ0N type=write size=326332 2024-09-12T00:34:26.830 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.831+0000 7f1f2d864780 1 > prepared operation key=WKK747ETLW10 tag=OR3RIA9L8AT4 type=del size=1609619 2024-09-12T00:34:26.831 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.833+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~F3U2EVZ3AFDZ.0 size=1048576 2024-09-12T00:34:26.832 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.833+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~F3U2EVZ3AFDZ.1 size=928173 2024-09-12T00:34:26.836 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.835+0000 7f1f2d864780 1 < completed multipart upload key=WGKEA4EKF5GP upload=F3U2EVZ3AFDZ tag=0SDHB0934JPZ type=write size=3025325 2024-09-12T00:34:26.836 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.837+0000 7f1f2d864780 1 > prepared operation key=GSPM8N0K7ODC tag=NJ3K585DA1GA type=write size=626181 2024-09-12T00:34:26.837 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.838+0000 7f1f2d864780 1 < completed part key=_multipart_AN26EVAZI527.2~KDWVEWH18JOR.0 size=1048576 2024-09-12T00:34:26.837 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.839+0000 7f1f2d864780 1 < completed part key=_multipart_AN26EVAZI527.2~KDWVEWH18JOR.1 size=245269 2024-09-12T00:34:26.839 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.841+0000 7f1f2d864780 1 < completed multipart upload key=AN26EVAZI527 upload=KDWVEWH18JOR tag=SPFXGR9AIGL3 type=write size=2342421 2024-09-12T00:34:26.840 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.842+0000 7f1f2d864780 1 > prepared operation key=D21W9QZWY0YU tag=HR6UBC2NFXI2 type=del size=2378615 2024-09-12T00:34:26.841 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.843+0000 7f1f2d864780 1 < completed part key=_multipart_2YCGIJRK6MUH.2~7ODRC957FN93.0 size=1048576 2024-09-12T00:34:26.842 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.844+0000 7f1f2d864780 1 < completed part key=_multipart_2YCGIJRK6MUH.2~7ODRC957FN93.1 size=1048576 2024-09-12T00:34:26.843 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.845+0000 7f1f2d864780 1 < completed part key=_multipart_2YCGIJRK6MUH.2~7ODRC957FN93.2 size=74894 2024-09-12T00:34:26.845 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.847+0000 7f1f2d864780 1 < completed multipart upload key=2YCGIJRK6MUH upload=7ODRC957FN93 tag=KKYHHQB0OI1W type=write size=3220622 2024-09-12T00:34:26.848 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.849+0000 7f1f2d864780 1 > prepared operation key=2G3UCYG4R4NM tag=RV2D254UY1T6 type=del size=1690547 2024-09-12T00:34:26.849 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.851+0000 7f1f2d864780 1 < completed delete operation key=S5DVMA14N7VJ tag=6XJSBNJKYXGZ type=del 2024-09-12T00:34:26.851 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.853+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~KBNZYG86KDOW.0 size=1048576 2024-09-12T00:34:26.852 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.854+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~KBNZYG86KDOW.1 size=950554 2024-09-12T00:34:26.852 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.854+0000 7f1f2d864780 1 > prepared multipart upload key=W6U30X4HJCB1 upload=KBNZYG86KDOW tag=YP3SF2M1MAZ3 type=write size=3047706 2024-09-12T00:34:26.853 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.855+0000 7f1f2d864780 1 < completed part key=_multipart_GSPM8N0K7ODC.2~9JUNPP9IQGLX.0 size=1048576 2024-09-12T00:34:26.854 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.856+0000 7f1f2d864780 1 < completed part key=_multipart_GSPM8N0K7ODC.2~9JUNPP9IQGLX.1 size=1020299 2024-09-12T00:34:26.856 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.858+0000 7f1f2d864780 1 < completed multipart upload key=GSPM8N0K7ODC upload=9JUNPP9IQGLX tag=I1HWCAKJP31B type=write size=3117451 2024-09-12T00:34:26.858 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.859+0000 7f1f2d864780 1 > prepared operation key=ZGO887JDR627 tag=2435H33D9ZSW type=del size=2361776 2024-09-12T00:34:26.859 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.860+0000 7f1f2d864780 1 < completed part key=_multipart_W6U30X4HJCB1.2~MZV8GQ8SQCZB.0 size=1048576 2024-09-12T00:34:26.860 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.861+0000 7f1f2d864780 1 < completed part key=_multipart_W6U30X4HJCB1.2~MZV8GQ8SQCZB.1 size=1048576 2024-09-12T00:34:26.861 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.863+0000 7f1f2d864780 1 < completed part key=_multipart_W6U30X4HJCB1.2~MZV8GQ8SQCZB.2 size=913064 2024-09-12T00:34:26.863 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.864+0000 7f1f2d864780 1 < completed multipart upload key=W6U30X4HJCB1 upload=MZV8GQ8SQCZB tag=07N02L1BQPY3 type=write size=4058792 2024-09-12T00:34:26.864 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.866+0000 7f1f2d864780 1 > prepared operation key=FAP6N3H7SBN0 tag=HYOLDOLT3ZPG type=del size=1046081 2024-09-12T00:34:26.865 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.867+0000 7f1f2d864780 1 < completed delete operation key=WGKEA4EKF5GP tag=B752QT07J2YV type=del 2024-09-12T00:34:26.867 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.869+0000 7f1f2d864780 1 > prepared part key=_multipart_ZGO887JDR627.2~HT9Y72XXXJG7.0 size=444993 2024-09-12T00:34:26.867 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.869+0000 7f1f2d864780 1 > prepared multipart upload key=ZGO887JDR627 upload=HT9Y72XXXJG7 tag=79TSWEGIA6P7 type=write size=1493569 2024-09-12T00:34:26.869 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.870+0000 7f1f2d864780 1 < completed part key=_multipart_ZGO887JDR627.2~P1DAZ4ZD83G4.0 size=485627 2024-09-12T00:34:26.870 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.872+0000 7f1f2d864780 1 < completed multipart upload key=ZGO887JDR627 upload=P1DAZ4ZD83G4 tag=EU7T2XQ45S01 type=write size=1534203 2024-09-12T00:34:26.872 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.873+0000 7f1f2d864780 1 > prepared operation key=DYKLAY6J018G tag=NHIO8ME8LEAY type=del size=833724 2024-09-12T00:34:26.873 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.874+0000 7f1f2d864780 1 < completed part key=_multipart_PVB52GO6L8T4.2~UQ7TWXJ08VB0.0 size=1048576 2024-09-12T00:34:26.873 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.874+0000 7f1f2d864780 1 < canceled part key=_multipart_PVB52GO6L8T4.2~UQ7TWXJ08VB0.1 size=1048576 2024-09-12T00:34:26.874 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.875+0000 7f1f2d864780 1 < completed part key=_multipart_PVB52GO6L8T4.2~UQ7TWXJ08VB0.2 size=120492 2024-09-12T00:34:26.876 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.877+0000 7f1f2d864780 1 < canceled multipart upload key=PVB52GO6L8T4 upload=UQ7TWXJ08VB0 tag=BQ91FDDE4SML type=write size=3266220 2024-09-12T00:34:26.877 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.878+0000 7f1f2d864780 1 > prepared operation key=0DSQOFS8IIF5 tag=EE51JH6U7F2L type=del size=3813123 2024-09-12T00:34:26.878 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.880+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~7LSR9NFKW1T1.0 size=1048576 2024-09-12T00:34:26.879 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.881+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~7LSR9NFKW1T1.1 size=804149 2024-09-12T00:34:26.881 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.883+0000 7f1f2d864780 1 < completed multipart upload key=1299IOSGYIO9 upload=7LSR9NFKW1T1 tag=DUISIHUB0D0U type=write size=2901301 2024-09-12T00:34:26.883 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.885+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~N33R36Q19D32.0 size=1048576 2024-09-12T00:34:26.884 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.886+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~N33R36Q19D32.1 size=312825 2024-09-12T00:34:26.884 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.886+0000 7f1f2d864780 1 > prepared multipart upload key=FAP6N3H7SBN0 upload=N33R36Q19D32 tag=S6GTUGR1TGZE type=write size=2409977 2024-09-12T00:34:26.886 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.888+0000 7f1f2d864780 1 < suggested update operation key=53QCNWX1V1R1 tag=XP0B27N6V79G type=del size=1226508 2024-09-12T00:34:26.888 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.890+0000 7f1f2d864780 1 > prepared part key=_multipart_ZYNIJH0TTSM6.2~YKF43MQV8U3Q.0 size=1048576 2024-09-12T00:34:26.889 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.891+0000 7f1f2d864780 1 > prepared part key=_multipart_ZYNIJH0TTSM6.2~YKF43MQV8U3Q.1 size=645100 2024-09-12T00:34:26.889 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.891+0000 7f1f2d864780 1 > prepared multipart upload key=ZYNIJH0TTSM6 upload=YKF43MQV8U3Q tag=C3UGOYF5UCTW type=write size=2742252 2024-09-12T00:34:26.890 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.892+0000 7f1f2d864780 1 < canceled operation key=SNCGB6Z20450 tag=84AIJ37QAHL7 type=del size=950106 2024-09-12T00:34:26.892 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.894+0000 7f1f2d864780 1 > prepared part key=_multipart_FFG41OYEYFZA.2~6A4JK0CTHQB1.0 size=1048576 2024-09-12T00:34:26.893 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.895+0000 7f1f2d864780 1 > prepared part key=_multipart_FFG41OYEYFZA.2~6A4JK0CTHQB1.1 size=1048576 2024-09-12T00:34:26.894 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.896+0000 7f1f2d864780 1 > prepared part key=_multipart_FFG41OYEYFZA.2~6A4JK0CTHQB1.2 size=820513 2024-09-12T00:34:26.894 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.896+0000 7f1f2d864780 1 > prepared multipart upload key=FFG41OYEYFZA upload=6A4JK0CTHQB1 tag=YLSY8LA6N0D4 type=write size=3966241 2024-09-12T00:34:26.895 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.897+0000 7f1f2d864780 1 < canceled operation key=3Z1TGGPZKJ69 tag=XZYX1LNSFRE5 type=del size=227162 2024-09-12T00:34:26.896 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.898+0000 7f1f2d864780 1 > prepared operation key=0DSQOFS8IIF5 tag=AZL8S81JQBOI type=del size=3161676 2024-09-12T00:34:26.897 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.899+0000 7f1f2d864780 1 < completed delete operation key=ZYNIJH0TTSM6 tag=R2VSDN0K6YA1 type=del 2024-09-12T00:34:26.899 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.900+0000 7f1f2d864780 1 > prepared operation key=FAP6N3H7SBN0 tag=01HXW41LTK7H type=del size=305879 2024-09-12T00:34:26.900 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.901+0000 7f1f2d864780 1 < completed part key=_multipart_9XK59MVZ5G1O.2~VBXLYGV7DDCC.0 size=1048576 2024-09-12T00:34:26.901 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.903+0000 7f1f2d864780 1 < completed part key=_multipart_9XK59MVZ5G1O.2~VBXLYGV7DDCC.1 size=1048576 2024-09-12T00:34:26.902 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.903+0000 7f1f2d864780 1 < completed part key=_multipart_9XK59MVZ5G1O.2~VBXLYGV7DDCC.2 size=129102 2024-09-12T00:34:26.904 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.906+0000 7f1f2d864780 1 < completed multipart upload key=9XK59MVZ5G1O upload=VBXLYGV7DDCC tag=CDOD0JZZEO6O type=write size=3274830 2024-09-12T00:34:26.906 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.908+0000 7f1f2d864780 1 > prepared part key=_multipart_FFG41OYEYFZA.2~VPCFOWT21TNQ.0 size=394900 2024-09-12T00:34:26.906 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.908+0000 7f1f2d864780 1 > prepared multipart upload key=FFG41OYEYFZA upload=VPCFOWT21TNQ tag=PYBVVDJQNA6J type=write size=1443476 2024-09-12T00:34:26.907 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.909+0000 7f1f2d864780 1 < completed delete operation key=WKK747ETLW10 tag=OR3RIA9L8AT4 type=del 2024-09-12T00:34:26.909 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.911+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~XEORXA6ERKZI.0 size=1048576 2024-09-12T00:34:26.910 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.912+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~XEORXA6ERKZI.1 size=1048576 2024-09-12T00:34:26.911 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.913+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~XEORXA6ERKZI.2 size=434411 2024-09-12T00:34:26.911 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.913+0000 7f1f2d864780 1 > prepared multipart upload key=0DSQOFS8IIF5 upload=XEORXA6ERKZI tag=OIT34NL3XO4T type=write size=3580139 2024-09-12T00:34:26.912 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.914+0000 7f1f2d864780 1 < completed write operation key=GSPM8N0K7ODC tag=NJ3K585DA1GA type=write size=626181 2024-09-12T00:34:26.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.916+0000 7f1f2d864780 1 > prepared part key=_multipart_3Z1TGGPZKJ69.2~KNMS2VZZ8496.0 size=1048576 2024-09-12T00:34:26.915 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.917+0000 7f1f2d864780 1 > prepared part key=_multipart_3Z1TGGPZKJ69.2~KNMS2VZZ8496.1 size=814478 2024-09-12T00:34:26.915 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.917+0000 7f1f2d864780 1 > prepared multipart upload key=3Z1TGGPZKJ69 upload=KNMS2VZZ8496 tag=X3UKDLRXO9HT type=write size=2911630 2024-09-12T00:34:26.916 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.918+0000 7f1f2d864780 1 < completed delete operation key=D21W9QZWY0YU tag=HR6UBC2NFXI2 type=del 2024-09-12T00:34:26.918 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.920+0000 7f1f2d864780 1 > prepared part key=_multipart_53QCNWX1V1R1.2~TWXMY28JLCWZ.0 size=237433 2024-09-12T00:34:26.918 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.920+0000 7f1f2d864780 1 > prepared multipart upload key=53QCNWX1V1R1 upload=TWXMY28JLCWZ tag=TLF7O26MSCJS type=write size=1286009 2024-09-12T00:34:26.920 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.922+0000 7f1f2d864780 1 < suggested update operation key=2G3UCYG4R4NM tag=RV2D254UY1T6 type=del size=1690547 2024-09-12T00:34:26.922 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.923+0000 7f1f2d864780 1 > prepared operation key=ECZYQEZ942W8 tag=HYTP68Z6T80X type=write size=86 2024-09-12T00:34:26.923 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.925+0000 7f1f2d864780 1 < completed part key=_multipart_W6U30X4HJCB1.2~KBNZYG86KDOW.0 size=1048576 2024-09-12T00:34:26.924 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.926+0000 7f1f2d864780 1 < completed part key=_multipart_W6U30X4HJCB1.2~KBNZYG86KDOW.1 size=950554 2024-09-12T00:34:26.926 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.928+0000 7f1f2d864780 1 < completed multipart upload key=W6U30X4HJCB1 upload=KBNZYG86KDOW tag=YP3SF2M1MAZ3 type=write size=3047706 2024-09-12T00:34:26.927 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.929+0000 7f1f2d864780 1 > prepared operation key=2YCGIJRK6MUH tag=T4X3RF4W0QO0 type=del size=1396790 2024-09-12T00:34:26.930 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.931+0000 7f1f2d864780 1 < suggested update operation key=ZGO887JDR627 tag=2435H33D9ZSW type=del size=2361776 2024-09-12T00:34:26.931 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.933+0000 7f1f2d864780 1 > prepared operation key=WIIU8VTCLWOD tag=CBH6RA9GIJOZ type=del size=1432571 2024-09-12T00:34:26.933 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.935+0000 7f1f2d864780 1 < suggested remove operation key=FAP6N3H7SBN0 tag=HYOLDOLT3ZPG type=del 2024-09-12T00:34:26.934 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.936+0000 7f1f2d864780 1 > prepared operation key=O1YY03BOEYLM tag=AOOY3JGFB6RX type=del size=1323610 2024-09-12T00:34:26.936 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.938+0000 7f1f2d864780 1 < completed part key=_multipart_ZGO887JDR627.2~HT9Y72XXXJG7.0 size=444993 2024-09-12T00:34:26.938 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.939+0000 7f1f2d864780 1 < completed multipart upload key=ZGO887JDR627 upload=HT9Y72XXXJG7 tag=79TSWEGIA6P7 type=write size=1493569 2024-09-12T00:34:26.939 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.941+0000 7f1f2d864780 1 > prepared operation key=GSPM8N0K7ODC tag=331OWJMLDAWO type=del size=1405367 2024-09-12T00:34:26.940 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.942+0000 7f1f2d864780 1 < completed delete operation key=DYKLAY6J018G tag=NHIO8ME8LEAY type=del 2024-09-12T00:34:26.941 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.943+0000 7f1f2d864780 1 > prepared operation key=FAP6N3H7SBN0 tag=1I516H2HY3NL type=del size=3998006 2024-09-12T00:34:26.943 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.945+0000 7f1f2d864780 1 < suggested update operation key=0DSQOFS8IIF5 tag=EE51JH6U7F2L type=del size=3813123 2024-09-12T00:34:26.945 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.946+0000 7f1f2d864780 1 > prepared operation key=3Z1TGGPZKJ69 tag=2I4SUM0C08H1 type=del size=3035281 2024-09-12T00:34:26.946 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.948+0000 7f1f2d864780 1 < completed part key=_multipart_FAP6N3H7SBN0.2~N33R36Q19D32.0 size=1048576 2024-09-12T00:34:26.947 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.949+0000 7f1f2d864780 1 < completed part key=_multipart_FAP6N3H7SBN0.2~N33R36Q19D32.1 size=312825 2024-09-12T00:34:26.949 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.950+0000 7f1f2d864780 1 < completed multipart upload key=FAP6N3H7SBN0 upload=N33R36Q19D32 tag=S6GTUGR1TGZE type=write size=2409977 2024-09-12T00:34:26.951 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.953+0000 7f1f2d864780 1 > prepared part key=_multipart_2YCGIJRK6MUH.2~3LAIVA79CDP0.0 size=549022 2024-09-12T00:34:26.951 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.953+0000 7f1f2d864780 1 > prepared multipart upload key=2YCGIJRK6MUH upload=3LAIVA79CDP0 tag=FGFTW9Q1JO42 type=write size=1597598 2024-09-12T00:34:26.952 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.954+0000 7f1f2d864780 1 < completed part key=_multipart_ZYNIJH0TTSM6.2~YKF43MQV8U3Q.0 size=1048576 2024-09-12T00:34:26.953 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.955+0000 7f1f2d864780 1 < completed part key=_multipart_ZYNIJH0TTSM6.2~YKF43MQV8U3Q.1 size=645100 2024-09-12T00:34:26.956 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.958+0000 7f1f2d864780 1 < completed multipart upload key=ZYNIJH0TTSM6 upload=YKF43MQV8U3Q tag=C3UGOYF5UCTW type=write size=2742252 2024-09-12T00:34:26.958 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.960+0000 7f1f2d864780 1 > prepared part key=_multipart_WKK747ETLW10.2~SAP2766B2XAE.0 size=1048576 2024-09-12T00:34:26.959 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.961+0000 7f1f2d864780 1 > prepared part key=_multipart_WKK747ETLW10.2~SAP2766B2XAE.1 size=1048576 2024-09-12T00:34:26.960 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.962+0000 7f1f2d864780 1 > prepared part key=_multipart_WKK747ETLW10.2~SAP2766B2XAE.2 size=82309 2024-09-12T00:34:26.960 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.962+0000 7f1f2d864780 1 > prepared multipart upload key=WKK747ETLW10 upload=SAP2766B2XAE tag=EKEN00Q1W4GF type=write size=3228037 2024-09-12T00:34:26.961 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.963+0000 7f1f2d864780 1 < completed part key=_multipart_FFG41OYEYFZA.2~6A4JK0CTHQB1.0 size=1048576 2024-09-12T00:34:26.962 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.964+0000 7f1f2d864780 1 < completed part key=_multipart_FFG41OYEYFZA.2~6A4JK0CTHQB1.1 size=1048576 2024-09-12T00:34:26.963 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.965+0000 7f1f2d864780 1 < completed part key=_multipart_FFG41OYEYFZA.2~6A4JK0CTHQB1.2 size=820513 2024-09-12T00:34:26.965 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.966+0000 7f1f2d864780 1 < completed multipart upload key=FFG41OYEYFZA upload=6A4JK0CTHQB1 tag=YLSY8LA6N0D4 type=write size=3966241 2024-09-12T00:34:26.966 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.968+0000 7f1f2d864780 1 > prepared operation key=AN26EVAZI527 tag=P4FOF23P4I2C type=del size=3023456 2024-09-12T00:34:26.967 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.969+0000 7f1f2d864780 -1 < failed to complete operation key=0DSQOFS8IIF5 tag=AZL8S81JQBOI type=del size=3161676: (22) Invalid argument 2024-09-12T00:34:26.969 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.971+0000 7f1f2d864780 1 > prepared part key=_multipart_UTR2UUO6DHLJ.2~8NKHX5JDZ2RD.0 size=1048576 2024-09-12T00:34:26.970 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.972+0000 7f1f2d864780 1 > prepared part key=_multipart_UTR2UUO6DHLJ.2~8NKHX5JDZ2RD.1 size=1048576 2024-09-12T00:34:26.971 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.972+0000 7f1f2d864780 1 > prepared part key=_multipart_UTR2UUO6DHLJ.2~8NKHX5JDZ2RD.2 size=728547 2024-09-12T00:34:26.971 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.972+0000 7f1f2d864780 1 > prepared multipart upload key=UTR2UUO6DHLJ upload=8NKHX5JDZ2RD tag=4NZWVGAJ16II type=write size=3874275 2024-09-12T00:34:26.973 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.975+0000 7f1f2d864780 1 < suggested remove operation key=FAP6N3H7SBN0 tag=01HXW41LTK7H type=del 2024-09-12T00:34:26.975 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.977+0000 7f1f2d864780 1 > prepared part key=_multipart_OY145ZXRSF4L.2~CAYGAAOXQH4H.0 size=366838 2024-09-12T00:34:26.976 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.977+0000 7f1f2d864780 1 > prepared multipart upload key=OY145ZXRSF4L upload=CAYGAAOXQH4H tag=4BJAPSU0UZEI type=write size=1415414 2024-09-12T00:34:26.976 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.978+0000 7f1f2d864780 1 < completed part key=_multipart_FFG41OYEYFZA.2~VPCFOWT21TNQ.0 size=394900 2024-09-12T00:34:26.978 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.980+0000 7f1f2d864780 1 < completed multipart upload key=FFG41OYEYFZA upload=VPCFOWT21TNQ tag=PYBVVDJQNA6J type=write size=1443476 2024-09-12T00:34:26.980 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.981+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=BW3W0SM3UKVU type=write size=88033 2024-09-12T00:34:26.980 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.982+0000 7f1f2d864780 1 < canceled part key=_multipart_0DSQOFS8IIF5.2~XEORXA6ERKZI.0 size=1048576 2024-09-12T00:34:26.981 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.983+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~XEORXA6ERKZI.1 size=1048576 2024-09-12T00:34:26.982 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.983+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~XEORXA6ERKZI.2 size=434411 2024-09-12T00:34:26.984 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.986+0000 7f1f2d864780 1 < canceled multipart upload key=0DSQOFS8IIF5 upload=XEORXA6ERKZI tag=OIT34NL3XO4T type=write size=3580139 2024-09-12T00:34:26.986 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.988+0000 7f1f2d864780 1 > prepared part key=_multipart_WIIU8VTCLWOD.2~36R6YD0NP8UH.0 size=1048576 2024-09-12T00:34:26.988 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.989+0000 7f1f2d864780 1 > prepared part key=_multipart_WIIU8VTCLWOD.2~36R6YD0NP8UH.1 size=1025437 2024-09-12T00:34:26.988 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.989+0000 7f1f2d864780 1 > prepared multipart upload key=WIIU8VTCLWOD upload=36R6YD0NP8UH tag=0O9ASPKR1CTR type=write size=3122589 2024-09-12T00:34:26.988 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.989+0000 7f1f2d864780 1 < canceled part key=_multipart_3Z1TGGPZKJ69.2~KNMS2VZZ8496.0 size=1048576 2024-09-12T00:34:26.988 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.990+0000 7f1f2d864780 1 < completed part key=_multipart_3Z1TGGPZKJ69.2~KNMS2VZZ8496.1 size=814478 2024-09-12T00:34:26.990 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.992+0000 7f1f2d864780 1 < canceled multipart upload key=3Z1TGGPZKJ69 upload=KNMS2VZZ8496 tag=X3UKDLRXO9HT type=write size=2911630 2024-09-12T00:34:26.992 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.994+0000 7f1f2d864780 1 > prepared part key=_multipart_GSPM8N0K7ODC.2~RADLWL8O5MIY.0 size=1048576 2024-09-12T00:34:26.993 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.995+0000 7f1f2d864780 1 > prepared part key=_multipart_GSPM8N0K7ODC.2~RADLWL8O5MIY.1 size=1048576 2024-09-12T00:34:26.994 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.996+0000 7f1f2d864780 1 > prepared part key=_multipart_GSPM8N0K7ODC.2~RADLWL8O5MIY.2 size=470161 2024-09-12T00:34:26.994 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.996+0000 7f1f2d864780 1 > prepared multipart upload key=GSPM8N0K7ODC upload=RADLWL8O5MIY tag=216YLNFNMKLG type=write size=3615889 2024-09-12T00:34:26.995 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.997+0000 7f1f2d864780 1 < completed part key=_multipart_53QCNWX1V1R1.2~TWXMY28JLCWZ.0 size=237433 2024-09-12T00:34:26.997 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:26.999+0000 7f1f2d864780 1 < completed multipart upload key=53QCNWX1V1R1 upload=TWXMY28JLCWZ tag=TLF7O26MSCJS type=write size=1286009 2024-09-12T00:34:26.999 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.001+0000 7f1f2d864780 1 > prepared part key=_multipart_ZGO887JDR627.2~GNTV2RZCW5ZG.0 size=1048576 2024-09-12T00:34:27.000 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.002+0000 7f1f2d864780 1 > prepared part key=_multipart_ZGO887JDR627.2~GNTV2RZCW5ZG.1 size=785328 2024-09-12T00:34:27.000 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.002+0000 7f1f2d864780 1 > prepared multipart upload key=ZGO887JDR627 upload=GNTV2RZCW5ZG tag=R7JKQ5MQSZGU type=write size=2882480 2024-09-12T00:34:27.001 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.003+0000 7f1f2d864780 1 < completed write operation key=ECZYQEZ942W8 tag=HYTP68Z6T80X type=write size=86 2024-09-12T00:34:27.004 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.005+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~6L8V2BGZ34EC.0 size=1048576 2024-09-12T00:34:27.004 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.006+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~6L8V2BGZ34EC.1 size=1048576 2024-09-12T00:34:27.005 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.007+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~6L8V2BGZ34EC.2 size=1031990 2024-09-12T00:34:27.005 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.007+0000 7f1f2d864780 1 > prepared multipart upload key=W6U30X4HJCB1 upload=6L8V2BGZ34EC tag=MJDG3UCJWUK7 type=write size=4177718 2024-09-12T00:34:27.007 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.008+0000 7f1f2d864780 1 < completed delete operation key=2YCGIJRK6MUH tag=T4X3RF4W0QO0 type=del 2024-09-12T00:34:27.008 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.009+0000 7f1f2d864780 1 > prepared operation key=W6U30X4HJCB1 tag=5O5G5HSI8H1G type=del size=953224 2024-09-12T00:34:27.010 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.012+0000 7f1f2d864780 1 < suggested remove operation key=WIIU8VTCLWOD tag=CBH6RA9GIJOZ type=del 2024-09-12T00:34:27.011 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.013+0000 7f1f2d864780 1 > prepared operation key=53QCNWX1V1R1 tag=8B3YKW4SDMCH type=del size=2786791 2024-09-12T00:34:27.013 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.015+0000 7f1f2d864780 1 < suggested update operation key=O1YY03BOEYLM tag=AOOY3JGFB6RX type=del size=1323610 2024-09-12T00:34:27.015 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.017+0000 7f1f2d864780 1 > prepared part key=_multipart_ZYNIJH0TTSM6.2~4MV5C2VHTR29.0 size=799477 2024-09-12T00:34:27.015 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.017+0000 7f1f2d864780 1 > prepared multipart upload key=ZYNIJH0TTSM6 upload=4MV5C2VHTR29 tag=CVWPZHEW745R type=write size=1848053 2024-09-12T00:34:27.016 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.018+0000 7f1f2d864780 1 < completed delete operation key=GSPM8N0K7ODC tag=331OWJMLDAWO type=del 2024-09-12T00:34:27.017 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.019+0000 7f1f2d864780 1 > prepared operation key=2G3UCYG4R4NM tag=9K6OI5NBYL9T type=del size=3478976 2024-09-12T00:34:27.019 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.020+0000 7f1f2d864780 -1 < failed to complete operation key=FAP6N3H7SBN0 tag=1I516H2HY3NL type=del size=3998006: (22) Invalid argument 2024-09-12T00:34:27.021 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.022+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~9W76A9DCAJJ9.0 size=1048576 2024-09-12T00:34:27.022 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.023+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~9W76A9DCAJJ9.1 size=1048576 2024-09-12T00:34:27.022 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.024+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~9W76A9DCAJJ9.2 size=946637 2024-09-12T00:34:27.023 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.024+0000 7f1f2d864780 1 > prepared multipart upload key=SZP418NVZ5VX upload=9W76A9DCAJJ9 tag=JKUUCV868HTI type=write size=4092365 2024-09-12T00:34:27.024 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.025+0000 7f1f2d864780 1 < completed delete operation key=3Z1TGGPZKJ69 tag=2I4SUM0C08H1 type=del 2024-09-12T00:34:27.025 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.026+0000 7f1f2d864780 1 > prepared operation key=D21W9QZWY0YU tag=8B4VUBATMD68 type=del size=2716848 2024-09-12T00:34:27.026 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.027+0000 7f1f2d864780 1 < completed part key=_multipart_2YCGIJRK6MUH.2~3LAIVA79CDP0.0 size=549022 2024-09-12T00:34:27.028 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.029+0000 7f1f2d864780 1 < completed multipart upload key=2YCGIJRK6MUH upload=3LAIVA79CDP0 tag=FGFTW9Q1JO42 type=write size=1597598 2024-09-12T00:34:27.029 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.030+0000 7f1f2d864780 1 > prepared operation key=PVB52GO6L8T4 tag=NW0JSMMEZC65 type=del size=3447631 2024-09-12T00:34:27.029 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.031+0000 7f1f2d864780 1 < canceled part key=_multipart_WKK747ETLW10.2~SAP2766B2XAE.0 size=1048576 2024-09-12T00:34:27.030 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.032+0000 7f1f2d864780 1 < completed part key=_multipart_WKK747ETLW10.2~SAP2766B2XAE.1 size=1048576 2024-09-12T00:34:27.031 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.033+0000 7f1f2d864780 1 < completed part key=_multipart_WKK747ETLW10.2~SAP2766B2XAE.2 size=82309 2024-09-12T00:34:27.033 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.035+0000 7f1f2d864780 1 < canceled multipart upload key=WKK747ETLW10 upload=SAP2766B2XAE tag=EKEN00Q1W4GF type=write size=3228037 2024-09-12T00:34:27.035 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.037+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~18456R041RN5.0 size=1048576 2024-09-12T00:34:27.036 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.038+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~18456R041RN5.1 size=1048576 2024-09-12T00:34:27.037 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.039+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~18456R041RN5.2 size=461634 2024-09-12T00:34:27.037 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.039+0000 7f1f2d864780 1 > prepared multipart upload key=0DSQOFS8IIF5 upload=18456R041RN5 tag=T5OD32CVIFKD type=write size=3607362 2024-09-12T00:34:27.038 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.040+0000 7f1f2d864780 1 < completed delete operation key=AN26EVAZI527 tag=P4FOF23P4I2C type=del 2024-09-12T00:34:27.040 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.041+0000 7f1f2d864780 1 > prepared operation key=FAP6N3H7SBN0 tag=A57YZBHFB2B0 type=del size=1139668 2024-09-12T00:34:27.041 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.043+0000 7f1f2d864780 1 < completed part key=_multipart_UTR2UUO6DHLJ.2~8NKHX5JDZ2RD.0 size=1048576 2024-09-12T00:34:27.042 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.043+0000 7f1f2d864780 1 < completed part key=_multipart_UTR2UUO6DHLJ.2~8NKHX5JDZ2RD.1 size=1048576 2024-09-12T00:34:27.043 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.044+0000 7f1f2d864780 1 < completed part key=_multipart_UTR2UUO6DHLJ.2~8NKHX5JDZ2RD.2 size=728547 2024-09-12T00:34:27.045 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.047+0000 7f1f2d864780 1 < completed multipart upload key=UTR2UUO6DHLJ upload=8NKHX5JDZ2RD tag=4NZWVGAJ16II type=write size=3874275 2024-09-12T00:34:27.047 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.048+0000 7f1f2d864780 1 > prepared operation key=D21W9QZWY0YU tag=XGBAI4RCBE3Q type=del size=3681886 2024-09-12T00:34:27.048 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.050+0000 7f1f2d864780 1 < completed part key=_multipart_OY145ZXRSF4L.2~CAYGAAOXQH4H.0 size=366838 2024-09-12T00:34:27.050 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.052+0000 7f1f2d864780 1 < completed multipart upload key=OY145ZXRSF4L upload=CAYGAAOXQH4H tag=4BJAPSU0UZEI type=write size=1415414 2024-09-12T00:34:27.052 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.053+0000 7f1f2d864780 1 > prepared part key=_multipart_0DSQOFS8IIF5.2~1I4NUKHGF05F.0 size=497681 2024-09-12T00:34:27.052 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.053+0000 7f1f2d864780 1 > prepared multipart upload key=0DSQOFS8IIF5 upload=1I4NUKHGF05F tag=DKC20RW4T1RI type=write size=1546257 2024-09-12T00:34:27.053 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.055+0000 7f1f2d864780 1 < completed write operation key=2RV0899QUJ8W tag=BW3W0SM3UKVU type=write size=88033 2024-09-12T00:34:27.054 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.056+0000 7f1f2d864780 1 > prepared operation key=SNCGB6Z20450 tag=FSAOAWPLMGGS type=del size=3483666 2024-09-12T00:34:27.055 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.057+0000 7f1f2d864780 1 < completed part key=_multipart_WIIU8VTCLWOD.2~36R6YD0NP8UH.0 size=1048576 2024-09-12T00:34:27.056 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.058+0000 7f1f2d864780 1 < completed part key=_multipart_WIIU8VTCLWOD.2~36R6YD0NP8UH.1 size=1025437 2024-09-12T00:34:27.058 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.060+0000 7f1f2d864780 1 < completed multipart upload key=WIIU8VTCLWOD upload=36R6YD0NP8UH tag=0O9ASPKR1CTR type=write size=3122589 2024-09-12T00:34:27.061 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.062+0000 7f1f2d864780 1 > prepared part key=_multipart_ECZYQEZ942W8.2~IKFX7GXIUK7O.0 size=1048576 2024-09-12T00:34:27.063 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.064+0000 7f1f2d864780 1 > prepared part key=_multipart_ECZYQEZ942W8.2~IKFX7GXIUK7O.1 size=168956 2024-09-12T00:34:27.063 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.064+0000 7f1f2d864780 1 > prepared multipart upload key=ECZYQEZ942W8 upload=IKFX7GXIUK7O tag=A2T5SGULJWND type=write size=2266108 2024-09-12T00:34:27.064 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.066+0000 7f1f2d864780 1 < completed part key=_multipart_GSPM8N0K7ODC.2~RADLWL8O5MIY.0 size=1048576 2024-09-12T00:34:27.065 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.067+0000 7f1f2d864780 1 < completed part key=_multipart_GSPM8N0K7ODC.2~RADLWL8O5MIY.1 size=1048576 2024-09-12T00:34:27.066 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.068+0000 7f1f2d864780 1 < completed part key=_multipart_GSPM8N0K7ODC.2~RADLWL8O5MIY.2 size=470161 2024-09-12T00:34:27.068 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.070+0000 7f1f2d864780 1 < completed multipart upload key=GSPM8N0K7ODC upload=RADLWL8O5MIY tag=216YLNFNMKLG type=write size=3615889 2024-09-12T00:34:27.069 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.071+0000 7f1f2d864780 1 > prepared operation key=ECZYQEZ942W8 tag=QNE7PJJ03EF0 type=del size=3680201 2024-09-12T00:34:27.070 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.072+0000 7f1f2d864780 1 < completed part key=_multipart_ZGO887JDR627.2~GNTV2RZCW5ZG.0 size=1048576 2024-09-12T00:34:27.071 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.073+0000 7f1f2d864780 1 < completed part key=_multipart_ZGO887JDR627.2~GNTV2RZCW5ZG.1 size=785328 2024-09-12T00:34:27.073 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.075+0000 7f1f2d864780 1 < completed multipart upload key=ZGO887JDR627 upload=GNTV2RZCW5ZG tag=R7JKQ5MQSZGU type=write size=2882480 2024-09-12T00:34:27.074 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.076+0000 7f1f2d864780 1 > prepared operation key=9XK59MVZ5G1O tag=XYH9ITRYUJZ1 type=del size=4031727 2024-09-12T00:34:27.075 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.077+0000 7f1f2d864780 1 < completed part key=_multipart_W6U30X4HJCB1.2~6L8V2BGZ34EC.0 size=1048576 2024-09-12T00:34:27.076 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.078+0000 7f1f2d864780 1 < completed part key=_multipart_W6U30X4HJCB1.2~6L8V2BGZ34EC.1 size=1048576 2024-09-12T00:34:27.076 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.078+0000 7f1f2d864780 1 < canceled part key=_multipart_W6U30X4HJCB1.2~6L8V2BGZ34EC.2 size=1031990 2024-09-12T00:34:27.078 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.080+0000 7f1f2d864780 1 < canceled multipart upload key=W6U30X4HJCB1 upload=6L8V2BGZ34EC tag=MJDG3UCJWUK7 type=write size=4177718 2024-09-12T00:34:27.079 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.081+0000 7f1f2d864780 1 > prepared operation key=WGKEA4EKF5GP tag=ITYZHIUPKJ2C type=del size=36456 2024-09-12T00:34:27.081 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.082+0000 7f1f2d864780 1 < completed delete operation key=W6U30X4HJCB1 tag=5O5G5HSI8H1G type=del 2024-09-12T00:34:27.082 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.083+0000 7f1f2d864780 1 > prepared operation key=AN26EVAZI527 tag=RXIG5Z03RT31 type=write size=90299 2024-09-12T00:34:27.084 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.086+0000 7f1f2d864780 1 < suggested update operation key=53QCNWX1V1R1 tag=8B3YKW4SDMCH type=del size=2786791 2024-09-12T00:34:27.086 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.087+0000 7f1f2d864780 1 > prepared operation key=1299IOSGYIO9 tag=D8725N15BSX7 type=del size=1764897 2024-09-12T00:34:27.087 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.088+0000 7f1f2d864780 1 < completed part key=_multipart_ZYNIJH0TTSM6.2~4MV5C2VHTR29.0 size=799477 2024-09-12T00:34:27.089 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.090+0000 7f1f2d864780 1 < completed multipart upload key=ZYNIJH0TTSM6 upload=4MV5C2VHTR29 tag=CVWPZHEW745R type=write size=1848053 2024-09-12T00:34:27.091 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.093+0000 7f1f2d864780 1 > prepared part key=_multipart_WKK747ETLW10.2~M9QL6HPJ6ET1.0 size=555891 2024-09-12T00:34:27.091 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.093+0000 7f1f2d864780 1 > prepared multipart upload key=WKK747ETLW10 upload=M9QL6HPJ6ET1 tag=SC6LTBII03LG type=write size=1604467 2024-09-12T00:34:27.092 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.094+0000 7f1f2d864780 1 < completed delete operation key=2G3UCYG4R4NM tag=9K6OI5NBYL9T type=del 2024-09-12T00:34:27.093 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.095+0000 7f1f2d864780 1 > prepared operation key=D21W9QZWY0YU tag=QUEM24HWB2Z1 type=del size=2167735 2024-09-12T00:34:27.094 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.096+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~9W76A9DCAJJ9.0 size=1048576 2024-09-12T00:34:27.095 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.097+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~9W76A9DCAJJ9.1 size=1048576 2024-09-12T00:34:27.097 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.098+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~9W76A9DCAJJ9.2 size=946637 2024-09-12T00:34:27.098 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.100+0000 7f1f2d864780 1 < completed multipart upload key=SZP418NVZ5VX upload=9W76A9DCAJJ9 tag=JKUUCV868HTI type=write size=4092365 2024-09-12T00:34:27.100 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.101+0000 7f1f2d864780 1 > prepared operation key=53QCNWX1V1R1 tag=V2EYSRINJPM9 type=del size=2380616 2024-09-12T00:34:27.101 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.102+0000 7f1f2d864780 1 < completed delete operation key=D21W9QZWY0YU tag=8B4VUBATMD68 type=del 2024-09-12T00:34:27.102 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.104+0000 7f1f2d864780 1 > prepared operation key=WKK747ETLW10 tag=2FMVDGVTKPEQ type=del size=536964 2024-09-12T00:34:27.103 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.105+0000 7f1f2d864780 1 < completed delete operation key=PVB52GO6L8T4 tag=NW0JSMMEZC65 type=del 2024-09-12T00:34:27.104 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.106+0000 7f1f2d864780 1 > prepared operation key=ZYNIJH0TTSM6 tag=N1CIFW9WLURG type=del size=2723988 2024-09-12T00:34:27.106 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.107+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~18456R041RN5.0 size=1048576 2024-09-12T00:34:27.106 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.108+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~18456R041RN5.1 size=1048576 2024-09-12T00:34:27.107 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.109+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~18456R041RN5.2 size=461634 2024-09-12T00:34:27.109 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.111+0000 7f1f2d864780 1 < completed multipart upload key=0DSQOFS8IIF5 upload=18456R041RN5 tag=T5OD32CVIFKD type=write size=3607362 2024-09-12T00:34:27.110 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.112+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=OUMHDXXZWZJU type=del size=4117937 2024-09-12T00:34:27.111 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.113+0000 7f1f2d864780 1 < completed delete operation key=FAP6N3H7SBN0 tag=A57YZBHFB2B0 type=del 2024-09-12T00:34:27.113 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.115+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~Q50QMWJDRNDU.0 size=835576 2024-09-12T00:34:27.113 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.115+0000 7f1f2d864780 1 > prepared multipart upload key=WGKEA4EKF5GP upload=Q50QMWJDRNDU tag=AV1V4E2X434X type=write size=1884152 2024-09-12T00:34:27.115 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.117+0000 7f1f2d864780 1 < suggested remove operation key=D21W9QZWY0YU tag=XGBAI4RCBE3Q type=del 2024-09-12T00:34:27.117 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.119+0000 7f1f2d864780 1 > prepared part key=_multipart_MSGU3PHLBRJH.2~FSI7UG7U5AE1.0 size=1048576 2024-09-12T00:34:27.118 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.120+0000 7f1f2d864780 1 > prepared part key=_multipart_MSGU3PHLBRJH.2~FSI7UG7U5AE1.1 size=1048576 2024-09-12T00:34:27.119 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.120+0000 7f1f2d864780 1 > prepared part key=_multipart_MSGU3PHLBRJH.2~FSI7UG7U5AE1.2 size=919574 2024-09-12T00:34:27.119 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.120+0000 7f1f2d864780 1 > prepared multipart upload key=MSGU3PHLBRJH upload=FSI7UG7U5AE1 tag=660B6D9SA28M type=write size=4065302 2024-09-12T00:34:27.120 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.122+0000 7f1f2d864780 1 < completed part key=_multipart_0DSQOFS8IIF5.2~1I4NUKHGF05F.0 size=497681 2024-09-12T00:34:27.122 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.123+0000 7f1f2d864780 1 < completed multipart upload key=0DSQOFS8IIF5 upload=1I4NUKHGF05F tag=DKC20RW4T1RI type=write size=1546257 2024-09-12T00:34:27.123 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.125+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=U70T35UQTW1Z type=write size=1015405 2024-09-12T00:34:27.124 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.126+0000 7f1f2d864780 1 < completed delete operation key=SNCGB6Z20450 tag=FSAOAWPLMGGS type=del 2024-09-12T00:34:27.125 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.127+0000 7f1f2d864780 1 > prepared operation key=FAP6N3H7SBN0 tag=1TIELLVNJLKM type=del size=2474654 2024-09-12T00:34:27.127 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.128+0000 7f1f2d864780 1 < completed part key=_multipart_ECZYQEZ942W8.2~IKFX7GXIUK7O.0 size=1048576 2024-09-12T00:34:27.128 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.129+0000 7f1f2d864780 1 < completed part key=_multipart_ECZYQEZ942W8.2~IKFX7GXIUK7O.1 size=168956 2024-09-12T00:34:27.129 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.131+0000 7f1f2d864780 1 < completed multipart upload key=ECZYQEZ942W8 upload=IKFX7GXIUK7O tag=A2T5SGULJWND type=write size=2266108 2024-09-12T00:34:27.130 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.132+0000 7f1f2d864780 1 > prepared operation key=FAP6N3H7SBN0 tag=A36POKNUO7QS type=del size=3635817 2024-09-12T00:34:27.132 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.133+0000 7f1f2d864780 1 < completed delete operation key=ECZYQEZ942W8 tag=QNE7PJJ03EF0 type=del 2024-09-12T00:34:27.133 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.135+0000 7f1f2d864780 1 > prepared operation key=4FRVL0KXN2X8 tag=J6RW2OG72F4O type=del size=1372872 2024-09-12T00:34:27.134 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.136+0000 7f1f2d864780 1 < completed delete operation key=9XK59MVZ5G1O tag=XYH9ITRYUJZ1 type=del 2024-09-12T00:34:27.137 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.138+0000 7f1f2d864780 1 > prepared part key=_multipart_DYKLAY6J018G.2~EUXB9AOYIE64.0 size=748338 2024-09-12T00:34:27.137 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.138+0000 7f1f2d864780 1 > prepared multipart upload key=DYKLAY6J018G upload=EUXB9AOYIE64 tag=IRPULYT2FEY8 type=write size=1796914 2024-09-12T00:34:27.138 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.140+0000 7f1f2d864780 1 < completed delete operation key=WGKEA4EKF5GP tag=ITYZHIUPKJ2C type=del 2024-09-12T00:34:27.139 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.141+0000 7f1f2d864780 1 > prepared operation key=3Z1TGGPZKJ69 tag=DSP02V1RWSWN type=del size=703407 2024-09-12T00:34:27.141 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.143+0000 7f1f2d864780 1 < suggested update operation key=AN26EVAZI527 tag=RXIG5Z03RT31 type=write size=90299 2024-09-12T00:34:27.144 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.145+0000 7f1f2d864780 1 > prepared part key=_multipart_WKK747ETLW10.2~BJRHMDVSNC1R.0 size=87118 2024-09-12T00:34:27.144 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.145+0000 7f1f2d864780 1 > prepared multipart upload key=WKK747ETLW10 upload=BJRHMDVSNC1R tag=B0LPG51W7PE8 type=write size=1135694 2024-09-12T00:34:27.145 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.146+0000 7f1f2d864780 1 < completed delete operation key=1299IOSGYIO9 tag=D8725N15BSX7 type=del 2024-09-12T00:34:27.147 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.148+0000 7f1f2d864780 1 > prepared part key=_multipart_ZYNIJH0TTSM6.2~UOOXA1R7A0RF.0 size=162350 2024-09-12T00:34:27.147 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.148+0000 7f1f2d864780 1 > prepared multipart upload key=ZYNIJH0TTSM6 upload=UOOXA1R7A0RF tag=V7ZUAWE6SPDN type=write size=1210926 2024-09-12T00:34:27.148 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.150+0000 7f1f2d864780 1 < completed part key=_multipart_WKK747ETLW10.2~M9QL6HPJ6ET1.0 size=555891 2024-09-12T00:34:27.150 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.151+0000 7f1f2d864780 1 < completed multipart upload key=WKK747ETLW10 upload=M9QL6HPJ6ET1 tag=SC6LTBII03LG type=write size=1604467 2024-09-12T00:34:27.151 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.153+0000 7f1f2d864780 1 > prepared operation key=WKK747ETLW10 tag=8SH5CECELDJR type=del size=484411 2024-09-12T00:34:27.151 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.153+0000 7f1f2d864780 -1 < no bi entry to suggest for operation key=D21W9QZWY0YU tag=QUEM24HWB2Z1 type=del size=2167735: (2) No such file or directory 2024-09-12T00:34:27.153 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.155+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~T4VYJ5Z0C87N.0 size=1048576 2024-09-12T00:34:27.154 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.156+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~T4VYJ5Z0C87N.1 size=1048576 2024-09-12T00:34:27.155 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.157+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~T4VYJ5Z0C87N.2 size=373052 2024-09-12T00:34:27.155 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.157+0000 7f1f2d864780 1 > prepared multipart upload key=W6U30X4HJCB1 upload=T4VYJ5Z0C87N tag=6WNM26GRDY4E type=write size=3518780 2024-09-12T00:34:27.156 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.158+0000 7f1f2d864780 1 < completed delete operation key=53QCNWX1V1R1 tag=V2EYSRINJPM9 type=del 2024-09-12T00:34:27.159 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.160+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~IQNDAJPV6B9H.0 size=1048576 2024-09-12T00:34:27.159 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.161+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~IQNDAJPV6B9H.1 size=1048576 2024-09-12T00:34:27.160 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.162+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~IQNDAJPV6B9H.2 size=592568 2024-09-12T00:34:27.161 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.162+0000 7f1f2d864780 1 > prepared multipart upload key=SZP418NVZ5VX upload=IQNDAJPV6B9H tag=CS3X3QF9D4P5 type=write size=3738296 2024-09-12T00:34:27.162 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.163+0000 7f1f2d864780 1 < completed delete operation key=WKK747ETLW10 tag=2FMVDGVTKPEQ type=del 2024-09-12T00:34:27.163 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.165+0000 7f1f2d864780 1 > prepared operation key=ZYNIJH0TTSM6 tag=UUYTVV17NESA type=write size=167602 2024-09-12T00:34:27.165 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.167+0000 7f1f2d864780 1 < suggested remove operation key=ZYNIJH0TTSM6 tag=N1CIFW9WLURG type=del 2024-09-12T00:34:27.167 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.169+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~ZI7XUFR2BI1Q.0 size=1048576 2024-09-12T00:34:27.168 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.170+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~ZI7XUFR2BI1Q.1 size=833572 2024-09-12T00:34:27.168 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.170+0000 7f1f2d864780 1 > prepared multipart upload key=SZP418NVZ5VX upload=ZI7XUFR2BI1Q tag=M1J3FWP3KR1U type=write size=2930724 2024-09-12T00:34:27.170 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.171+0000 7f1f2d864780 1 < completed delete operation key=2RV0899QUJ8W tag=OUMHDXXZWZJU type=del 2024-09-12T00:34:27.172 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.174+0000 7f1f2d864780 1 > prepared operation key=9XK59MVZ5G1O tag=MXY4BSX53NUW type=del size=2135717 2024-09-12T00:34:27.173 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.175+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~Q50QMWJDRNDU.0 size=835576 2024-09-12T00:34:27.175 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.177+0000 7f1f2d864780 1 < completed multipart upload key=WGKEA4EKF5GP upload=Q50QMWJDRNDU tag=AV1V4E2X434X type=write size=1884152 2024-09-12T00:34:27.177 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.179+0000 7f1f2d864780 1 > prepared part key=_multipart_2YCGIJRK6MUH.2~1MO8QK58HHAB.0 size=1048576 2024-09-12T00:34:27.178 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.180+0000 7f1f2d864780 1 > prepared part key=_multipart_2YCGIJRK6MUH.2~1MO8QK58HHAB.1 size=1048576 2024-09-12T00:34:27.179 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.181+0000 7f1f2d864780 1 > prepared part key=_multipart_2YCGIJRK6MUH.2~1MO8QK58HHAB.2 size=758306 2024-09-12T00:34:27.179 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.181+0000 7f1f2d864780 1 > prepared multipart upload key=2YCGIJRK6MUH upload=1MO8QK58HHAB tag=MUXIMVSIG6C4 type=write size=3904034 2024-09-12T00:34:27.181 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.182+0000 7f1f2d864780 1 < completed part key=_multipart_MSGU3PHLBRJH.2~FSI7UG7U5AE1.0 size=1048576 2024-09-12T00:34:27.182 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.183+0000 7f1f2d864780 1 < completed part key=_multipart_MSGU3PHLBRJH.2~FSI7UG7U5AE1.1 size=1048576 2024-09-12T00:34:27.182 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.184+0000 7f1f2d864780 1 < completed part key=_multipart_MSGU3PHLBRJH.2~FSI7UG7U5AE1.2 size=919574 2024-09-12T00:34:27.185 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.186+0000 7f1f2d864780 1 < completed multipart upload key=MSGU3PHLBRJH upload=FSI7UG7U5AE1 tag=660B6D9SA28M type=write size=4065302 2024-09-12T00:34:27.187 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.188+0000 7f1f2d864780 1 > prepared part key=_multipart_SNCGB6Z20450.2~FIUVZGJAJVCQ.0 size=1048576 2024-09-12T00:34:27.188 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.189+0000 7f1f2d864780 1 > prepared part key=_multipart_SNCGB6Z20450.2~FIUVZGJAJVCQ.1 size=786493 2024-09-12T00:34:27.188 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.189+0000 7f1f2d864780 1 > prepared multipart upload key=SNCGB6Z20450 upload=FIUVZGJAJVCQ tag=BLJL0YUI8D36 type=write size=2883645 2024-09-12T00:34:27.189 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.190+0000 7f1f2d864780 1 < completed write operation key=2RV0899QUJ8W tag=U70T35UQTW1Z type=write size=1015405 2024-09-12T00:34:27.190 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.192+0000 7f1f2d864780 1 > prepared operation key=FFG41OYEYFZA tag=EOLD6W0X5JA0 type=del size=906152 2024-09-12T00:34:27.191 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.193+0000 7f1f2d864780 1 < completed delete operation key=FAP6N3H7SBN0 tag=1TIELLVNJLKM type=del 2024-09-12T00:34:27.192 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.194+0000 7f1f2d864780 1 > prepared operation key=N9RQIGHVL8VP tag=LFCQYXI34C29 type=del size=2149538 2024-09-12T00:34:27.194 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.195+0000 7f1f2d864780 1 < completed delete operation key=FAP6N3H7SBN0 tag=A36POKNUO7QS type=del 2024-09-12T00:34:27.195 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.196+0000 7f1f2d864780 1 > prepared operation key=W6U30X4HJCB1 tag=4AWQXCXO51SQ type=write size=942415 2024-09-12T00:34:27.196 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.198+0000 7f1f2d864780 1 < completed delete operation key=4FRVL0KXN2X8 tag=J6RW2OG72F4O type=del 2024-09-12T00:34:27.198 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.200+0000 7f1f2d864780 1 > prepared part key=_multipart_2G3UCYG4R4NM.2~PTYT8CTEDQER.0 size=1048576 2024-09-12T00:34:27.199 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.201+0000 7f1f2d864780 1 > prepared part key=_multipart_2G3UCYG4R4NM.2~PTYT8CTEDQER.1 size=1048576 2024-09-12T00:34:27.200 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.202+0000 7f1f2d864780 1 > prepared part key=_multipart_2G3UCYG4R4NM.2~PTYT8CTEDQER.2 size=510444 2024-09-12T00:34:27.200 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.202+0000 7f1f2d864780 1 > prepared multipart upload key=2G3UCYG4R4NM upload=PTYT8CTEDQER tag=REF9EW2MY4UT type=write size=3656172 2024-09-12T00:34:27.201 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.202+0000 7f1f2d864780 1 < canceled part key=_multipart_DYKLAY6J018G.2~EUXB9AOYIE64.0 size=748338 2024-09-12T00:34:27.202 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.204+0000 7f1f2d864780 1 < canceled multipart upload key=DYKLAY6J018G upload=EUXB9AOYIE64 tag=IRPULYT2FEY8 type=write size=1796914 2024-09-12T00:34:27.203 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.205+0000 7f1f2d864780 1 > prepared operation key=MSGU3PHLBRJH tag=MGUW3GJM9Z6W type=del size=3900689 2024-09-12T00:34:27.205 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.206+0000 7f1f2d864780 1 < completed delete operation key=3Z1TGGPZKJ69 tag=DSP02V1RWSWN type=del 2024-09-12T00:34:27.206 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.207+0000 7f1f2d864780 1 > prepared operation key=3Z1TGGPZKJ69 tag=OD6PRFQS3JZL type=del size=557378 2024-09-12T00:34:27.207 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.209+0000 7f1f2d864780 1 < completed part key=_multipart_WKK747ETLW10.2~BJRHMDVSNC1R.0 size=87118 2024-09-12T00:34:27.209 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.211+0000 7f1f2d864780 1 < completed multipart upload key=WKK747ETLW10 upload=BJRHMDVSNC1R tag=B0LPG51W7PE8 type=write size=1135694 2024-09-12T00:34:27.211 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.213+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~2KG29KLSCBAM.0 size=1048576 2024-09-12T00:34:27.213 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.214+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~2KG29KLSCBAM.1 size=692495 2024-09-12T00:34:27.213 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.214+0000 7f1f2d864780 1 > prepared multipart upload key=1299IOSGYIO9 upload=2KG29KLSCBAM tag=9J0Z3F9AKNFQ type=write size=2789647 2024-09-12T00:34:27.214 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.216+0000 7f1f2d864780 1 < completed part key=_multipart_ZYNIJH0TTSM6.2~UOOXA1R7A0RF.0 size=162350 2024-09-12T00:34:27.216 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.218+0000 7f1f2d864780 1 < completed multipart upload key=ZYNIJH0TTSM6 upload=UOOXA1R7A0RF tag=V7ZUAWE6SPDN type=write size=1210926 2024-09-12T00:34:27.217 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.219+0000 7f1f2d864780 1 > prepared operation key=2RV0899QUJ8W tag=IW768XONT2FH type=write size=64903 2024-09-12T00:34:27.219 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.220+0000 7f1f2d864780 1 < completed delete operation key=WKK747ETLW10 tag=8SH5CECELDJR type=del 2024-09-12T00:34:27.221 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.222+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~ZLHEKTTC1WPS.0 size=442476 2024-09-12T00:34:27.221 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.222+0000 7f1f2d864780 1 > prepared multipart upload key=SZP418NVZ5VX upload=ZLHEKTTC1WPS tag=O2NZ30PSLKRW type=write size=1491052 2024-09-12T00:34:27.222 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.224+0000 7f1f2d864780 1 < completed part key=_multipart_W6U30X4HJCB1.2~T4VYJ5Z0C87N.0 size=1048576 2024-09-12T00:34:27.222 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.224+0000 7f1f2d864780 1 < canceled part key=_multipart_W6U30X4HJCB1.2~T4VYJ5Z0C87N.1 size=1048576 2024-09-12T00:34:27.223 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.224+0000 7f1f2d864780 1 < completed part key=_multipart_W6U30X4HJCB1.2~T4VYJ5Z0C87N.2 size=373052 2024-09-12T00:34:27.225 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.226+0000 7f1f2d864780 1 < canceled multipart upload key=W6U30X4HJCB1 upload=T4VYJ5Z0C87N tag=6WNM26GRDY4E type=write size=3518780 2024-09-12T00:34:27.226 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.227+0000 7f1f2d864780 1 > prepared operation key=PVB52GO6L8T4 tag=O13UFPRQ9N9N type=del size=2178169 2024-09-12T00:34:27.226 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.228+0000 7f1f2d864780 1 < canceled part key=_multipart_SZP418NVZ5VX.2~IQNDAJPV6B9H.0 size=1048576 2024-09-12T00:34:27.227 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.229+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~IQNDAJPV6B9H.1 size=1048576 2024-09-12T00:34:27.228 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.230+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~IQNDAJPV6B9H.2 size=592568 2024-09-12T00:34:27.230 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.232+0000 7f1f2d864780 1 < canceled multipart upload key=SZP418NVZ5VX upload=IQNDAJPV6B9H tag=CS3X3QF9D4P5 type=write size=3738296 2024-09-12T00:34:27.232 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.233+0000 7f1f2d864780 1 > prepared operation key=2G3UCYG4R4NM tag=79LE173JGEFT type=del size=1688879 2024-09-12T00:34:27.234 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.236+0000 7f1f2d864780 1 < suggested remove operation key=ZYNIJH0TTSM6 tag=UUYTVV17NESA type=write 2024-09-12T00:34:27.235 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.237+0000 7f1f2d864780 1 > prepared operation key=ECZYQEZ942W8 tag=MSNK1X402SR9 type=del size=1200797 2024-09-12T00:34:27.237 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.238+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~ZI7XUFR2BI1Q.0 size=1048576 2024-09-12T00:34:27.237 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.238+0000 7f1f2d864780 1 < canceled part key=_multipart_SZP418NVZ5VX.2~ZI7XUFR2BI1Q.1 size=833572 2024-09-12T00:34:27.241 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.240+0000 7f1f2d864780 1 < canceled multipart upload key=SZP418NVZ5VX upload=ZI7XUFR2BI1Q tag=M1J3FWP3KR1U type=write size=2930724 2024-09-12T00:34:27.241 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.242+0000 7f1f2d864780 1 > prepared operation key=PVB52GO6L8T4 tag=8W70WMQICEQW type=del size=2592524 2024-09-12T00:34:27.243 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.244+0000 7f1f2d864780 1 < suggested remove operation key=9XK59MVZ5G1O tag=MXY4BSX53NUW type=del 2024-09-12T00:34:27.245 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.246+0000 7f1f2d864780 1 > prepared part key=_multipart_9XK59MVZ5G1O.2~2B0C6YM53A56.0 size=1048576 2024-09-12T00:34:27.246 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.247+0000 7f1f2d864780 1 > prepared part key=_multipart_9XK59MVZ5G1O.2~2B0C6YM53A56.1 size=180273 2024-09-12T00:34:27.246 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.247+0000 7f1f2d864780 1 > prepared multipart upload key=9XK59MVZ5G1O upload=2B0C6YM53A56 tag=9ARQ3OSULKTG type=write size=2277425 2024-09-12T00:34:27.246 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.247+0000 7f1f2d864780 1 < canceled part key=_multipart_2YCGIJRK6MUH.2~1MO8QK58HHAB.0 size=1048576 2024-09-12T00:34:27.247 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.248+0000 7f1f2d864780 1 < completed part key=_multipart_2YCGIJRK6MUH.2~1MO8QK58HHAB.1 size=1048576 2024-09-12T00:34:27.247 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.248+0000 7f1f2d864780 1 < canceled part key=_multipart_2YCGIJRK6MUH.2~1MO8QK58HHAB.2 size=758306 2024-09-12T00:34:27.249 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.250+0000 7f1f2d864780 1 < canceled multipart upload key=2YCGIJRK6MUH upload=1MO8QK58HHAB tag=MUXIMVSIG6C4 type=write size=3904034 2024-09-12T00:34:27.250 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.252+0000 7f1f2d864780 1 > prepared operation key=O1YY03BOEYLM tag=X6Q7NS7UVWXL type=del size=83041 2024-09-12T00:34:27.251 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.253+0000 7f1f2d864780 1 < completed part key=_multipart_SNCGB6Z20450.2~FIUVZGJAJVCQ.0 size=1048576 2024-09-12T00:34:27.252 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.254+0000 7f1f2d864780 1 < completed part key=_multipart_SNCGB6Z20450.2~FIUVZGJAJVCQ.1 size=786493 2024-09-12T00:34:27.254 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.256+0000 7f1f2d864780 1 < completed multipart upload key=SNCGB6Z20450 upload=FIUVZGJAJVCQ tag=BLJL0YUI8D36 type=write size=2883645 2024-09-12T00:34:27.256 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.258+0000 7f1f2d864780 1 > prepared part key=_multipart_AN26EVAZI527.2~BIT28DFUJNRP.0 size=1020348 2024-09-12T00:34:27.257 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.258+0000 7f1f2d864780 1 > prepared multipart upload key=AN26EVAZI527 upload=BIT28DFUJNRP tag=US8MIK2ZJQLZ type=write size=2068924 2024-09-12T00:34:27.259 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.260+0000 7f1f2d864780 1 < suggested update operation key=FFG41OYEYFZA tag=EOLD6W0X5JA0 type=del size=906152 2024-09-12T00:34:27.260 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.261+0000 7f1f2d864780 1 > prepared operation key=4FRVL0KXN2X8 tag=CANP9FIG7O3H type=del size=3118612 2024-09-12T00:34:27.262 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.264+0000 7f1f2d864780 1 < suggested update operation key=N9RQIGHVL8VP tag=LFCQYXI34C29 type=del size=2149538 2024-09-12T00:34:27.263 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.265+0000 7f1f2d864780 1 > prepared operation key=SNCGB6Z20450 tag=H36CY2NBC11R type=del size=817729 2024-09-12T00:34:27.264 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.266+0000 7f1f2d864780 1 < completed write operation key=W6U30X4HJCB1 tag=4AWQXCXO51SQ type=write size=942415 2024-09-12T00:34:27.266 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.267+0000 7f1f2d864780 1 > prepared operation key=2YCGIJRK6MUH tag=SMJZ03IY5TJW type=del size=4179014 2024-09-12T00:34:27.266 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.267+0000 7f1f2d864780 1 < canceled part key=_multipart_2G3UCYG4R4NM.2~PTYT8CTEDQER.0 size=1048576 2024-09-12T00:34:27.267 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.268+0000 7f1f2d864780 1 < completed part key=_multipart_2G3UCYG4R4NM.2~PTYT8CTEDQER.1 size=1048576 2024-09-12T00:34:27.268 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.269+0000 7f1f2d864780 1 < completed part key=_multipart_2G3UCYG4R4NM.2~PTYT8CTEDQER.2 size=510444 2024-09-12T00:34:27.270 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.271+0000 7f1f2d864780 1 < canceled multipart upload key=2G3UCYG4R4NM upload=PTYT8CTEDQER tag=REF9EW2MY4UT type=write size=3656172 2024-09-12T00:34:27.271 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.273+0000 7f1f2d864780 1 > prepared operation key=AN26EVAZI527 tag=243CVNQ9X2WX type=del size=3725578 2024-09-12T00:34:27.272 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.274+0000 7f1f2d864780 1 < completed delete operation key=MSGU3PHLBRJH tag=MGUW3GJM9Z6W type=del 2024-09-12T00:34:27.274 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.276+0000 7f1f2d864780 1 > prepared part key=_multipart_WIIU8VTCLWOD.2~GFPED9CZRCB6.0 size=1048576 2024-09-12T00:34:27.275 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.277+0000 7f1f2d864780 1 > prepared part key=_multipart_WIIU8VTCLWOD.2~GFPED9CZRCB6.1 size=454703 2024-09-12T00:34:27.275 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.277+0000 7f1f2d864780 1 > prepared multipart upload key=WIIU8VTCLWOD upload=GFPED9CZRCB6 tag=32XSHK42H12I type=write size=2551855 2024-09-12T00:34:27.276 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.278+0000 7f1f2d864780 1 < completed delete operation key=3Z1TGGPZKJ69 tag=OD6PRFQS3JZL type=del 2024-09-12T00:34:27.278 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.279+0000 7f1f2d864780 1 > prepared operation key=ECZYQEZ942W8 tag=3DJD5P26121X type=del size=3588505 2024-09-12T00:34:27.279 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.280+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~2KG29KLSCBAM.0 size=1048576 2024-09-12T00:34:27.280 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.281+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~2KG29KLSCBAM.1 size=692495 2024-09-12T00:34:27.282 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.283+0000 7f1f2d864780 1 < completed multipart upload key=1299IOSGYIO9 upload=2KG29KLSCBAM tag=9J0Z3F9AKNFQ type=write size=2789647 2024-09-12T00:34:27.285 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.287+0000 7f1f2d864780 1 > prepared part key=_multipart_ECZYQEZ942W8.2~11N55G6JPTRW.0 size=405957 2024-09-12T00:34:27.285 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.287+0000 7f1f2d864780 1 > prepared multipart upload key=ECZYQEZ942W8 upload=11N55G6JPTRW tag=BXRY3NGY6KYJ type=write size=1454533 2024-09-12T00:34:27.286 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.288+0000 7f1f2d864780 1 < canceled operation key=2RV0899QUJ8W tag=IW768XONT2FH type=write size=64903 2024-09-12T00:34:27.288 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.290+0000 7f1f2d864780 1 > prepared operation key=OY145ZXRSF4L tag=KUEAUNCG1MMN type=del size=3382839 2024-09-12T00:34:27.289 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.291+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~ZLHEKTTC1WPS.0 size=442476 2024-09-12T00:34:27.291 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.293+0000 7f1f2d864780 1 < completed multipart upload key=SZP418NVZ5VX upload=ZLHEKTTC1WPS tag=O2NZ30PSLKRW type=write size=1491052 2024-09-12T00:34:27.292 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.294+0000 7f1f2d864780 1 > prepared operation key=KHPF1N1MT33Z tag=2XUZ9OEJUO8J type=del size=2214001 2024-09-12T00:34:27.293 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.295+0000 7f1f2d864780 1 < completed delete operation key=PVB52GO6L8T4 tag=O13UFPRQ9N9N type=del 2024-09-12T00:34:27.296 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.297+0000 7f1f2d864780 1 > prepared part key=_multipart_S5DVMA14N7VJ.2~5T7JINSPA2G9.0 size=531009 2024-09-12T00:34:27.296 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.297+0000 7f1f2d864780 1 > prepared multipart upload key=S5DVMA14N7VJ upload=5T7JINSPA2G9 tag=Q9ABC4KGSFS7 type=write size=1579585 2024-09-12T00:34:27.298 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.299+0000 7f1f2d864780 1 < suggested update operation key=2G3UCYG4R4NM tag=79LE173JGEFT type=del size=1688879 2024-09-12T00:34:27.299 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.301+0000 7f1f2d864780 1 > prepared operation key=FFG41OYEYFZA tag=Q0KY5XVWEDLA type=del size=1446145 2024-09-12T00:34:27.300 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.302+0000 7f1f2d864780 1 < completed delete operation key=ECZYQEZ942W8 tag=MSNK1X402SR9 type=del 2024-09-12T00:34:27.302 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.304+0000 7f1f2d864780 1 > prepared part key=_multipart_2YCGIJRK6MUH.2~4NPRSFXB2Z9C.0 size=1048576 2024-09-12T00:34:27.303 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.305+0000 7f1f2d864780 1 > prepared part key=_multipart_2YCGIJRK6MUH.2~4NPRSFXB2Z9C.1 size=1048576 2024-09-12T00:34:27.304 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.306+0000 7f1f2d864780 1 > prepared part key=_multipart_2YCGIJRK6MUH.2~4NPRSFXB2Z9C.2 size=78870 2024-09-12T00:34:27.304 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.306+0000 7f1f2d864780 1 > prepared multipart upload key=2YCGIJRK6MUH upload=4NPRSFXB2Z9C tag=MGJZ0FF0CI2M type=write size=3224598 2024-09-12T00:34:27.305 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.307+0000 7f1f2d864780 1 < canceled operation key=PVB52GO6L8T4 tag=8W70WMQICEQW type=del size=2592524 2024-09-12T00:34:27.307 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.308+0000 7f1f2d864780 1 > prepared operation key=S5DVMA14N7VJ tag=YMVF34BN7GSX type=del size=2391965 2024-09-12T00:34:27.308 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.309+0000 7f1f2d864780 1 < completed part key=_multipart_9XK59MVZ5G1O.2~2B0C6YM53A56.0 size=1048576 2024-09-12T00:34:27.309 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.310+0000 7f1f2d864780 1 < completed part key=_multipart_9XK59MVZ5G1O.2~2B0C6YM53A56.1 size=180273 2024-09-12T00:34:27.311 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.312+0000 7f1f2d864780 1 < completed multipart upload key=9XK59MVZ5G1O upload=2B0C6YM53A56 tag=9ARQ3OSULKTG type=write size=2277425 2024-09-12T00:34:27.313 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.315+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~WNO98BQIPP41.0 size=31458 2024-09-12T00:34:27.313 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.315+0000 7f1f2d864780 1 > prepared multipart upload key=1299IOSGYIO9 upload=WNO98BQIPP41 tag=ZEIXML8H1OWS type=write size=1080034 2024-09-12T00:34:27.314 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.316+0000 7f1f2d864780 1 < completed delete operation key=O1YY03BOEYLM tag=X6Q7NS7UVWXL type=del 2024-09-12T00:34:27.315 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.317+0000 7f1f2d864780 1 > prepared operation key=D21W9QZWY0YU tag=EOJAJCF3VXBM type=del size=1045775 2024-09-12T00:34:27.316 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.318+0000 7f1f2d864780 1 < completed part key=_multipart_AN26EVAZI527.2~BIT28DFUJNRP.0 size=1020348 2024-09-12T00:34:27.318 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.320+0000 7f1f2d864780 1 < completed multipart upload key=AN26EVAZI527 upload=BIT28DFUJNRP tag=US8MIK2ZJQLZ type=write size=2068924 2024-09-12T00:34:27.320 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.321+0000 7f1f2d864780 1 > prepared operation key=O1YY03BOEYLM tag=LGVYJE2MOWDP type=del size=4112444 2024-09-12T00:34:27.321 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.323+0000 7f1f2d864780 1 < completed delete operation key=4FRVL0KXN2X8 tag=CANP9FIG7O3H type=del 2024-09-12T00:34:27.322 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.324+0000 7f1f2d864780 1 > prepared operation key=SZP418NVZ5VX tag=K0DZW69NJ1H4 type=del size=3795060 2024-09-12T00:34:27.323 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.325+0000 7f1f2d864780 1 < completed delete operation key=SNCGB6Z20450 tag=H36CY2NBC11R type=del 2024-09-12T00:34:27.324 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.326+0000 7f1f2d864780 1 > prepared operation key=S5DVMA14N7VJ tag=H2WNOL0SP3I4 type=del size=696274 2024-09-12T00:34:27.325 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.327+0000 7f1f2d864780 1 < completed delete operation key=2YCGIJRK6MUH tag=SMJZ03IY5TJW type=del 2024-09-12T00:34:27.326 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.328+0000 7f1f2d864780 1 > prepared operation key=S5DVMA14N7VJ tag=VJDVKMS5TASI type=del size=3692823 2024-09-12T00:34:27.328 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.329+0000 7f1f2d864780 1 < completed delete operation key=AN26EVAZI527 tag=243CVNQ9X2WX type=del 2024-09-12T00:34:27.329 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.330+0000 7f1f2d864780 1 > prepared operation key=FAP6N3H7SBN0 tag=7P80RWE1EIEH type=del size=3509133 2024-09-12T00:34:27.330 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.332+0000 7f1f2d864780 1 < completed part key=_multipart_WIIU8VTCLWOD.2~GFPED9CZRCB6.0 size=1048576 2024-09-12T00:34:27.331 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.333+0000 7f1f2d864780 1 < completed part key=_multipart_WIIU8VTCLWOD.2~GFPED9CZRCB6.1 size=454703 2024-09-12T00:34:27.333 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.334+0000 7f1f2d864780 1 < completed multipart upload key=WIIU8VTCLWOD upload=GFPED9CZRCB6 tag=32XSHK42H12I type=write size=2551855 2024-09-12T00:34:27.334 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.336+0000 7f1f2d864780 1 > prepared operation key=9XK59MVZ5G1O tag=0PP701KG7K27 type=del size=3933715 2024-09-12T00:34:27.335 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.337+0000 7f1f2d864780 1 < canceled operation key=ECZYQEZ942W8 tag=3DJD5P26121X type=del size=3588505 2024-09-12T00:34:27.338 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.339+0000 7f1f2d864780 1 > prepared part key=_multipart_1299IOSGYIO9.2~27YNGVBATZ3U.0 size=309378 2024-09-12T00:34:27.338 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.339+0000 7f1f2d864780 1 > prepared multipart upload key=1299IOSGYIO9 upload=27YNGVBATZ3U tag=ZA0P0J76ZPG7 type=write size=1357954 2024-09-12T00:34:27.339 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.341+0000 7f1f2d864780 1 < completed part key=_multipart_ECZYQEZ942W8.2~11N55G6JPTRW.0 size=405957 2024-09-12T00:34:27.341 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.343+0000 7f1f2d864780 1 < completed multipart upload key=ECZYQEZ942W8 upload=11N55G6JPTRW tag=BXRY3NGY6KYJ type=write size=1454533 2024-09-12T00:34:27.342 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.344+0000 7f1f2d864780 1 > prepared operation key=OY145ZXRSF4L tag=G4R2WQFU27KP type=del size=3467364 2024-09-12T00:34:27.344 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.345+0000 7f1f2d864780 1 < completed delete operation key=OY145ZXRSF4L tag=KUEAUNCG1MMN type=del 2024-09-12T00:34:27.346 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.347+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~L4GJBD59K2T3.0 size=1048576 2024-09-12T00:34:27.347 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.348+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~L4GJBD59K2T3.1 size=378233 2024-09-12T00:34:27.347 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.348+0000 7f1f2d864780 1 > prepared multipart upload key=WGKEA4EKF5GP upload=L4GJBD59K2T3 tag=2UHQMC5HP73K type=write size=2475385 2024-09-12T00:34:27.348 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.349+0000 7f1f2d864780 1 < completed delete operation key=KHPF1N1MT33Z tag=2XUZ9OEJUO8J type=del 2024-09-12T00:34:27.350 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.351+0000 7f1f2d864780 1 > prepared part key=_multipart_N9RQIGHVL8VP.2~CC7G1ZYZJNJR.0 size=742695 2024-09-12T00:34:27.350 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.351+0000 7f1f2d864780 1 > prepared multipart upload key=N9RQIGHVL8VP upload=CC7G1ZYZJNJR tag=QQALXSS8ZKNF type=write size=1791271 2024-09-12T00:34:27.351 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.352+0000 7f1f2d864780 1 < completed part key=_multipart_S5DVMA14N7VJ.2~5T7JINSPA2G9.0 size=531009 2024-09-12T00:34:27.353 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.355+0000 7f1f2d864780 1 < completed multipart upload key=S5DVMA14N7VJ upload=5T7JINSPA2G9 tag=Q9ABC4KGSFS7 type=write size=1579585 2024-09-12T00:34:27.354 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.356+0000 7f1f2d864780 1 > prepared operation key=S5DVMA14N7VJ tag=2XCQ00V078E9 type=del size=693566 2024-09-12T00:34:27.355 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.357+0000 7f1f2d864780 1 < completed delete operation key=FFG41OYEYFZA tag=Q0KY5XVWEDLA type=del 2024-09-12T00:34:27.357 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.358+0000 7f1f2d864780 1 > prepared operation key=GSPM8N0K7ODC tag=PWOPSPM10PKX type=del size=531822 2024-09-12T00:34:27.358 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.359+0000 7f1f2d864780 1 < completed part key=_multipart_2YCGIJRK6MUH.2~4NPRSFXB2Z9C.0 size=1048576 2024-09-12T00:34:27.359 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.360+0000 7f1f2d864780 1 < completed part key=_multipart_2YCGIJRK6MUH.2~4NPRSFXB2Z9C.1 size=1048576 2024-09-12T00:34:27.360 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.361+0000 7f1f2d864780 1 < completed part key=_multipart_2YCGIJRK6MUH.2~4NPRSFXB2Z9C.2 size=78870 2024-09-12T00:34:27.361 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.363+0000 7f1f2d864780 1 < completed multipart upload key=2YCGIJRK6MUH upload=4NPRSFXB2Z9C tag=MGJZ0FF0CI2M type=write size=3224598 2024-09-12T00:34:27.363 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.364+0000 7f1f2d864780 1 > prepared operation key=S5DVMA14N7VJ tag=HABUUO02HW2S type=del size=495269 2024-09-12T00:34:27.364 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.366+0000 7f1f2d864780 1 < completed delete operation key=S5DVMA14N7VJ tag=YMVF34BN7GSX type=del 2024-09-12T00:34:27.365 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.367+0000 7f1f2d864780 1 > prepared operation key=2YCGIJRK6MUH tag=JBC0SYO9SOC3 type=del size=2195891 2024-09-12T00:34:27.366 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.368+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~WNO98BQIPP41.0 size=31458 2024-09-12T00:34:27.368 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.370+0000 7f1f2d864780 1 < completed multipart upload key=1299IOSGYIO9 upload=WNO98BQIPP41 tag=ZEIXML8H1OWS type=write size=1080034 2024-09-12T00:34:27.370 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.372+0000 7f1f2d864780 1 > prepared part key=_multipart_ZYNIJH0TTSM6.2~XX7XWH5LWG09.0 size=123648 2024-09-12T00:34:27.370 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.372+0000 7f1f2d864780 1 > prepared multipart upload key=ZYNIJH0TTSM6 upload=XX7XWH5LWG09 tag=X7KXTHNXY9WA type=write size=1172224 2024-09-12T00:34:27.371 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.373+0000 7f1f2d864780 1 < canceled operation key=D21W9QZWY0YU tag=EOJAJCF3VXBM type=del size=1045775 2024-09-12T00:34:27.373 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.375+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~AE02RWVY0R1R.0 size=782648 2024-09-12T00:34:27.374 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.375+0000 7f1f2d864780 1 > prepared multipart upload key=SZP418NVZ5VX upload=AE02RWVY0R1R tag=DIQBLDA53E17 type=write size=1831224 2024-09-12T00:34:27.375 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.376+0000 7f1f2d864780 1 < completed delete operation key=O1YY03BOEYLM tag=LGVYJE2MOWDP type=del 2024-09-12T00:34:27.376 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.377+0000 7f1f2d864780 1 > prepared operation key=W6U30X4HJCB1 tag=4U67I0ZG0FBD type=del size=3776277 2024-09-12T00:34:27.377 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.379+0000 7f1f2d864780 1 < completed delete operation key=SZP418NVZ5VX tag=K0DZW69NJ1H4 type=del 2024-09-12T00:34:27.379 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.381+0000 7f1f2d864780 1 > prepared part key=_multipart_53QCNWX1V1R1.2~0U8E7KONZLC8.0 size=267059 2024-09-12T00:34:27.379 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.381+0000 7f1f2d864780 1 > prepared multipart upload key=53QCNWX1V1R1 upload=0U8E7KONZLC8 tag=UQ22NQ6DNH09 type=write size=1315635 2024-09-12T00:34:27.380 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.382+0000 7f1f2d864780 1 < completed delete operation key=S5DVMA14N7VJ tag=H2WNOL0SP3I4 type=del 2024-09-12T00:34:27.382 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.384+0000 7f1f2d864780 1 > prepared part key=_multipart_3Z1TGGPZKJ69.2~6J1VA9GI18PP.0 size=752228 2024-09-12T00:34:27.383 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.384+0000 7f1f2d864780 1 > prepared multipart upload key=3Z1TGGPZKJ69 upload=6J1VA9GI18PP tag=LSEQF98GB06M type=write size=1800804 2024-09-12T00:34:27.384 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.385+0000 7f1f2d864780 1 < completed delete operation key=S5DVMA14N7VJ tag=VJDVKMS5TASI type=del 2024-09-12T00:34:27.386 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.388+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~RVT222S7I115.0 size=646788 2024-09-12T00:34:27.386 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.388+0000 7f1f2d864780 1 > prepared multipart upload key=4FRVL0KXN2X8 upload=RVT222S7I115 tag=V0TOOYRN14R1 type=write size=1695364 2024-09-12T00:34:27.389 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.390+0000 7f1f2d864780 1 < suggested remove operation key=FAP6N3H7SBN0 tag=7P80RWE1EIEH type=del 2024-09-12T00:34:27.391 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.393+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~O8Q9ZHFY622R.0 size=1048576 2024-09-12T00:34:27.393 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.394+0000 7f1f2d864780 1 > prepared part key=_multipart_4FRVL0KXN2X8.2~O8Q9ZHFY622R.1 size=848007 2024-09-12T00:34:27.393 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.394+0000 7f1f2d864780 1 > prepared multipart upload key=4FRVL0KXN2X8 upload=O8Q9ZHFY622R tag=71VHK1CFMLR5 type=write size=2945159 2024-09-12T00:34:27.394 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.396+0000 7f1f2d864780 1 < completed delete operation key=9XK59MVZ5G1O tag=0PP701KG7K27 type=del 2024-09-12T00:34:27.397 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.399+0000 7f1f2d864780 1 > prepared part key=_multipart_SZP418NVZ5VX.2~CC8VP1CEESLK.0 size=571646 2024-09-12T00:34:27.397 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.399+0000 7f1f2d864780 1 > prepared multipart upload key=SZP418NVZ5VX upload=CC8VP1CEESLK tag=RJ20Q8RFHO4W type=write size=1620222 2024-09-12T00:34:27.398 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.400+0000 7f1f2d864780 1 < completed part key=_multipart_1299IOSGYIO9.2~27YNGVBATZ3U.0 size=309378 2024-09-12T00:34:27.401 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.403+0000 7f1f2d864780 1 < completed multipart upload key=1299IOSGYIO9 upload=27YNGVBATZ3U tag=ZA0P0J76ZPG7 type=write size=1357954 2024-09-12T00:34:27.403 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.405+0000 7f1f2d864780 1 > prepared part key=_multipart_S5DVMA14N7VJ.2~AM8MBAZGKTAE.0 size=1048576 2024-09-12T00:34:27.404 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.405+0000 7f1f2d864780 1 > prepared part key=_multipart_S5DVMA14N7VJ.2~AM8MBAZGKTAE.1 size=71264 2024-09-12T00:34:27.404 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.405+0000 7f1f2d864780 1 > prepared multipart upload key=S5DVMA14N7VJ upload=AM8MBAZGKTAE tag=NTRGPWRO06J9 type=write size=2168416 2024-09-12T00:34:27.405 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.407+0000 7f1f2d864780 1 < canceled operation key=OY145ZXRSF4L tag=G4R2WQFU27KP type=del size=3467364 2024-09-12T00:34:27.406 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.408+0000 7f1f2d864780 1 > prepared operation key=DYKLAY6J018G tag=RZKFF8XAAG0Q type=del size=2686036 2024-09-12T00:34:27.407 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.409+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~L4GJBD59K2T3.0 size=1048576 2024-09-12T00:34:27.408 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.410+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~L4GJBD59K2T3.1 size=378233 2024-09-12T00:34:27.411 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.412+0000 7f1f2d864780 1 < completed multipart upload key=WGKEA4EKF5GP upload=L4GJBD59K2T3 tag=2UHQMC5HP73K type=write size=2475385 2024-09-12T00:34:27.412 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.413+0000 7f1f2d864780 1 > prepared operation key=MSGU3PHLBRJH tag=AH0CXEJ8FS6Q type=del size=713918 2024-09-12T00:34:27.414 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.416+0000 7f1f2d864780 1 < completed part key=_multipart_N9RQIGHVL8VP.2~CC7G1ZYZJNJR.0 size=742695 2024-09-12T00:34:27.417 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.418+0000 7f1f2d864780 1 < completed multipart upload key=N9RQIGHVL8VP upload=CC7G1ZYZJNJR tag=QQALXSS8ZKNF type=write size=1791271 2024-09-12T00:34:27.419 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.420+0000 7f1f2d864780 1 > prepared part key=_multipart_WKK747ETLW10.2~LHP7LSU3A7QH.0 size=1048576 2024-09-12T00:34:27.420 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.421+0000 7f1f2d864780 1 > prepared part key=_multipart_WKK747ETLW10.2~LHP7LSU3A7QH.1 size=1048576 2024-09-12T00:34:27.421 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.422+0000 7f1f2d864780 1 > prepared part key=_multipart_WKK747ETLW10.2~LHP7LSU3A7QH.2 size=213787 2024-09-12T00:34:27.421 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.422+0000 7f1f2d864780 1 > prepared multipart upload key=WKK747ETLW10 upload=LHP7LSU3A7QH tag=32TRJMX5J44H type=write size=3359515 2024-09-12T00:34:27.422 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.424+0000 7f1f2d864780 1 < completed delete operation key=S5DVMA14N7VJ tag=2XCQ00V078E9 type=del 2024-09-12T00:34:27.424 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.426+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~PDTM6HIP60FL.0 size=1048576 2024-09-12T00:34:27.425 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.427+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~PDTM6HIP60FL.1 size=1048576 2024-09-12T00:34:27.427 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.428+0000 7f1f2d864780 1 > prepared part key=_multipart_WGKEA4EKF5GP.2~PDTM6HIP60FL.2 size=974343 2024-09-12T00:34:27.427 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.428+0000 7f1f2d864780 1 > prepared multipart upload key=WGKEA4EKF5GP upload=PDTM6HIP60FL tag=ATO8ALK9M30S type=write size=4120071 2024-09-12T00:34:27.429 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.430+0000 7f1f2d864780 1 < suggested remove operation key=GSPM8N0K7ODC tag=PWOPSPM10PKX type=del 2024-09-12T00:34:27.431 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.432+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~I02PM71G3GVQ.0 size=1048576 2024-09-12T00:34:27.432 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.433+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~I02PM71G3GVQ.1 size=1048576 2024-09-12T00:34:27.433 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.434+0000 7f1f2d864780 1 > prepared part key=_multipart_FAP6N3H7SBN0.2~I02PM71G3GVQ.2 size=435264 2024-09-12T00:34:27.433 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.434+0000 7f1f2d864780 1 > prepared multipart upload key=FAP6N3H7SBN0 upload=I02PM71G3GVQ tag=F4QMPJKU7UDY type=write size=3580992 2024-09-12T00:34:27.434 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.435+0000 7f1f2d864780 1 < completed delete operation key=S5DVMA14N7VJ tag=HABUUO02HW2S type=del 2024-09-12T00:34:27.435 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.437+0000 7f1f2d864780 1 > prepared operation key=OY145ZXRSF4L tag=XA2OXEXSN65E type=del size=687891 2024-09-12T00:34:27.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.438+0000 7f1f2d864780 1 < canceled operation key=2YCGIJRK6MUH tag=JBC0SYO9SOC3 type=del size=2195891 2024-09-12T00:34:27.437 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.439+0000 7f1f2d864780 1 > prepared operation key=0DSQOFS8IIF5 tag=CLS3B6FXRLM1 type=del size=3160463 2024-09-12T00:34:27.438 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.440+0000 7f1f2d864780 1 < completed part key=_multipart_ZYNIJH0TTSM6.2~XX7XWH5LWG09.0 size=123648 2024-09-12T00:34:27.441 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.442+0000 7f1f2d864780 1 < completed multipart upload key=ZYNIJH0TTSM6 upload=XX7XWH5LWG09 tag=X7KXTHNXY9WA type=write size=1172224 2024-09-12T00:34:27.442 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.443+0000 7f1f2d864780 1 > prepared operation key=SZP418NVZ5VX tag=BOAXS433LDQK type=del size=591369 2024-09-12T00:34:27.442 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.444+0000 7f1f2d864780 1 < canceled part key=_multipart_SZP418NVZ5VX.2~AE02RWVY0R1R.0 size=782648 2024-09-12T00:34:27.444 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.445+0000 7f1f2d864780 1 < canceled multipart upload key=SZP418NVZ5VX upload=AE02RWVY0R1R tag=DIQBLDA53E17 type=write size=1831224 2024-09-12T00:34:27.445 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.447+0000 7f1f2d864780 1 > prepared operation key=AN26EVAZI527 tag=1FCL693Z13G0 type=del size=2474856 2024-09-12T00:34:27.446 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.448+0000 7f1f2d864780 1 < completed delete operation key=W6U30X4HJCB1 tag=4U67I0ZG0FBD type=del 2024-09-12T00:34:27.447 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.449+0000 7f1f2d864780 1 > prepared operation key=PVB52GO6L8T4 tag=M5SIYZ9KZ925 type=del size=1655591 2024-09-12T00:34:27.449 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.450+0000 7f1f2d864780 1 < completed part key=_multipart_53QCNWX1V1R1.2~0U8E7KONZLC8.0 size=267059 2024-09-12T00:34:27.450 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.452+0000 7f1f2d864780 1 < completed multipart upload key=53QCNWX1V1R1 upload=0U8E7KONZLC8 tag=UQ22NQ6DNH09 type=write size=1315635 2024-09-12T00:34:27.452 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.453+0000 7f1f2d864780 1 > prepared operation key=1299IOSGYIO9 tag=61CJUGECN0PC type=del size=2306552 2024-09-12T00:34:27.453 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.454+0000 7f1f2d864780 1 < completed part key=_multipart_3Z1TGGPZKJ69.2~6J1VA9GI18PP.0 size=752228 2024-09-12T00:34:27.455 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.456+0000 7f1f2d864780 1 < completed multipart upload key=3Z1TGGPZKJ69 upload=6J1VA9GI18PP tag=LSEQF98GB06M type=write size=1800804 2024-09-12T00:34:27.456 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.458+0000 7f1f2d864780 1 > prepared operation key=WKK747ETLW10 tag=0413BCE3I45Q type=del size=3600331 2024-09-12T00:34:27.457 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.459+0000 7f1f2d864780 1 < completed part key=_multipart_4FRVL0KXN2X8.2~RVT222S7I115.0 size=646788 2024-09-12T00:34:27.459 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.461+0000 7f1f2d864780 1 < completed multipart upload key=4FRVL0KXN2X8 upload=RVT222S7I115 tag=V0TOOYRN14R1 type=write size=1695364 2024-09-12T00:34:27.460 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.462+0000 7f1f2d864780 1 > prepared operation key=SNCGB6Z20450 tag=JAVDRQHPT8A0 type=del size=386428 2024-09-12T00:34:27.461 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.463+0000 7f1f2d864780 1 < completed part key=_multipart_4FRVL0KXN2X8.2~O8Q9ZHFY622R.0 size=1048576 2024-09-12T00:34:27.462 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.464+0000 7f1f2d864780 1 < completed part key=_multipart_4FRVL0KXN2X8.2~O8Q9ZHFY622R.1 size=848007 2024-09-12T00:34:27.464 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.466+0000 7f1f2d864780 1 < completed multipart upload key=4FRVL0KXN2X8 upload=O8Q9ZHFY622R tag=71VHK1CFMLR5 type=write size=2945159 2024-09-12T00:34:27.467 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.468+0000 7f1f2d864780 1 > prepared part key=_multipart_O1YY03BOEYLM.2~5PXRDCVHHLCO.0 size=1048576 2024-09-12T00:34:27.467 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.469+0000 7f1f2d864780 1 > prepared part key=_multipart_O1YY03BOEYLM.2~5PXRDCVHHLCO.1 size=1048576 2024-09-12T00:34:27.469 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.470+0000 7f1f2d864780 1 > prepared part key=_multipart_O1YY03BOEYLM.2~5PXRDCVHHLCO.2 size=807937 2024-09-12T00:34:27.469 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.470+0000 7f1f2d864780 1 > prepared multipart upload key=O1YY03BOEYLM upload=5PXRDCVHHLCO tag=921CK0C20QYX type=write size=3953665 2024-09-12T00:34:27.470 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.471+0000 7f1f2d864780 1 < completed part key=_multipart_SZP418NVZ5VX.2~CC8VP1CEESLK.0 size=571646 2024-09-12T00:34:27.472 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.473+0000 7f1f2d864780 1 < completed multipart upload key=SZP418NVZ5VX upload=CC8VP1CEESLK tag=RJ20Q8RFHO4W type=write size=1620222 2024-09-12T00:34:27.474 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.475+0000 7f1f2d864780 1 > prepared part key=_multipart_2RV0899QUJ8W.2~T9QSRJS3TQSH.0 size=1048576 2024-09-12T00:34:27.475 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.476+0000 7f1f2d864780 1 > prepared part key=_multipart_2RV0899QUJ8W.2~T9QSRJS3TQSH.1 size=253212 2024-09-12T00:34:27.475 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.476+0000 7f1f2d864780 1 > prepared multipart upload key=2RV0899QUJ8W upload=T9QSRJS3TQSH tag=V9SKSVMT70YT type=write size=2350364 2024-09-12T00:34:27.476 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.477+0000 7f1f2d864780 1 < completed part key=_multipart_S5DVMA14N7VJ.2~AM8MBAZGKTAE.0 size=1048576 2024-09-12T00:34:27.477 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.479+0000 7f1f2d864780 1 < completed part key=_multipart_S5DVMA14N7VJ.2~AM8MBAZGKTAE.1 size=71264 2024-09-12T00:34:27.479 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.480+0000 7f1f2d864780 1 < completed multipart upload key=S5DVMA14N7VJ upload=AM8MBAZGKTAE tag=NTRGPWRO06J9 type=write size=2168416 2024-09-12T00:34:27.480 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.482+0000 7f1f2d864780 1 > prepared operation key=FFG41OYEYFZA tag=MAPJ3HJZ5VPL type=write size=551299 2024-09-12T00:34:27.481 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.483+0000 7f1f2d864780 1 < completed delete operation key=DYKLAY6J018G tag=RZKFF8XAAG0Q type=del 2024-09-12T00:34:27.482 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.484+0000 7f1f2d864780 1 > prepared operation key=UTR2UUO6DHLJ tag=TMINAVVEYR83 type=del size=3095860 2024-09-12T00:34:27.485 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.486+0000 7f1f2d864780 1 < suggested update operation key=MSGU3PHLBRJH tag=AH0CXEJ8FS6Q type=del size=713918 2024-09-12T00:34:27.487 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.488+0000 7f1f2d864780 1 > prepared part key=_multipart_AN26EVAZI527.2~YWFCX7AS0BQ7.0 size=1048576 2024-09-12T00:34:27.488 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.489+0000 7f1f2d864780 1 > prepared part key=_multipart_AN26EVAZI527.2~YWFCX7AS0BQ7.1 size=1048576 2024-09-12T00:34:27.489 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.490+0000 7f1f2d864780 1 > prepared part key=_multipart_AN26EVAZI527.2~YWFCX7AS0BQ7.2 size=872645 2024-09-12T00:34:27.489 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.490+0000 7f1f2d864780 1 > prepared multipart upload key=AN26EVAZI527 upload=YWFCX7AS0BQ7 tag=Y9WAQAJI9NXL type=write size=4018373 2024-09-12T00:34:27.490 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.492+0000 7f1f2d864780 1 < completed part key=_multipart_WKK747ETLW10.2~LHP7LSU3A7QH.0 size=1048576 2024-09-12T00:34:27.490 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.492+0000 7f1f2d864780 1 < canceled part key=_multipart_WKK747ETLW10.2~LHP7LSU3A7QH.1 size=1048576 2024-09-12T00:34:27.490 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.492+0000 7f1f2d864780 1 < canceled part key=_multipart_WKK747ETLW10.2~LHP7LSU3A7QH.2 size=213787 2024-09-12T00:34:27.492 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.494+0000 7f1f2d864780 1 < canceled multipart upload key=WKK747ETLW10 upload=LHP7LSU3A7QH tag=32TRJMX5J44H type=write size=3359515 2024-09-12T00:34:27.494 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.496+0000 7f1f2d864780 1 > prepared part key=_multipart_N9RQIGHVL8VP.2~W2YOLAPWA7LY.0 size=1048576 2024-09-12T00:34:27.495 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.497+0000 7f1f2d864780 1 > prepared part key=_multipart_N9RQIGHVL8VP.2~W2YOLAPWA7LY.1 size=1048576 2024-09-12T00:34:27.496 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.498+0000 7f1f2d864780 1 > prepared part key=_multipart_N9RQIGHVL8VP.2~W2YOLAPWA7LY.2 size=412976 2024-09-12T00:34:27.496 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.498+0000 7f1f2d864780 1 > prepared multipart upload key=N9RQIGHVL8VP upload=W2YOLAPWA7LY tag=UKR9H48TWS19 type=write size=3558704 2024-09-12T00:34:27.497 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.499+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~PDTM6HIP60FL.0 size=1048576 2024-09-12T00:34:27.498 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.500+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~PDTM6HIP60FL.1 size=1048576 2024-09-12T00:34:27.499 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.501+0000 7f1f2d864780 1 < completed part key=_multipart_WGKEA4EKF5GP.2~PDTM6HIP60FL.2 size=974343 2024-09-12T00:34:27.501 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.503+0000 7f1f2d864780 1 < completed multipart upload key=WGKEA4EKF5GP upload=PDTM6HIP60FL tag=ATO8ALK9M30S type=write size=4120071 2024-09-12T00:34:27.503 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.505+0000 7f1f2d864780 1 > prepared part key=_multipart_O1YY03BOEYLM.2~BUAC89U27OHY.0 size=1048576 2024-09-12T00:34:27.504 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.506+0000 7f1f2d864780 1 > prepared part key=_multipart_O1YY03BOEYLM.2~BUAC89U27OHY.1 size=1048576 2024-09-12T00:34:27.505 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.507+0000 7f1f2d864780 1 > prepared part key=_multipart_O1YY03BOEYLM.2~BUAC89U27OHY.2 size=281435 2024-09-12T00:34:27.505 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.507+0000 7f1f2d864780 1 > prepared multipart upload key=O1YY03BOEYLM upload=BUAC89U27OHY tag=0CYM7XW0JKYL type=write size=3427163 2024-09-12T00:34:27.507 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.509+0000 7f1f2d864780 1 < completed part key=_multipart_FAP6N3H7SBN0.2~I02PM71G3GVQ.0 size=1048576 2024-09-12T00:34:27.508 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.510+0000 7f1f2d864780 1 < completed part key=_multipart_FAP6N3H7SBN0.2~I02PM71G3GVQ.1 size=1048576 2024-09-12T00:34:27.509 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.511+0000 7f1f2d864780 1 < completed part key=_multipart_FAP6N3H7SBN0.2~I02PM71G3GVQ.2 size=435264 2024-09-12T00:34:27.511 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.513+0000 7f1f2d864780 1 < completed multipart upload key=FAP6N3H7SBN0 upload=I02PM71G3GVQ tag=F4QMPJKU7UDY type=write size=3580992 2024-09-12T00:34:27.512 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.514+0000 7f1f2d864780 1 > prepared operation key=MSGU3PHLBRJH tag=UYQHTM8P1MIY type=del size=598063 2024-09-12T00:34:27.513 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.515+0000 7f1f2d864780 1 < completed delete operation key=OY145ZXRSF4L tag=XA2OXEXSN65E type=del 2024-09-12T00:34:27.515 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.516+0000 7f1f2d864780 1 > prepared operation key=WGKEA4EKF5GP tag=OPAPKA27QN9E type=del size=1884031 2024-09-12T00:34:27.516 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.517+0000 7f1f2d864780 1 < completed delete operation key=0DSQOFS8IIF5 tag=CLS3B6FXRLM1 type=del 2024-09-12T00:34:27.517 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.519+0000 7f1f2d864780 1 > prepared operation key=53QCNWX1V1R1 tag=Q6I2RT0VCGK0 type=del size=375195 2024-09-12T00:34:27.518 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.520+0000 7f1f2d864780 1 < completed delete operation key=SZP418NVZ5VX tag=BOAXS433LDQK type=del 2024-09-12T00:34:27.520 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.521+0000 7f1f2d864780 1 > prepared operation key=S5DVMA14N7VJ tag=VTC28UQ0Y5EV type=del size=1231563 2024-09-12T00:34:27.521 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.522+0000 7f1f2d864780 1 < completed delete operation key=AN26EVAZI527 tag=1FCL693Z13G0 type=del 2024-09-12T00:34:27.523 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.524+0000 7f1f2d864780 1 > prepared part key=_multipart_PVB52GO6L8T4.2~V0P2X8W4BD2Z.0 size=1048576 2024-09-12T00:34:27.524 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.525+0000 7f1f2d864780 1 > prepared part key=_multipart_PVB52GO6L8T4.2~V0P2X8W4BD2Z.1 size=1048576 2024-09-12T00:34:27.525 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.526+0000 7f1f2d864780 1 > prepared part key=_multipart_PVB52GO6L8T4.2~V0P2X8W4BD2Z.2 size=42875 2024-09-12T00:34:27.525 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.526+0000 7f1f2d864780 1 > prepared multipart upload key=PVB52GO6L8T4 upload=V0P2X8W4BD2Z tag=R5295285WEEN type=write size=3188603 2024-09-12T00:34:27.526 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.528+0000 7f1f2d864780 1 < canceled operation key=PVB52GO6L8T4 tag=M5SIYZ9KZ925 type=del size=1655591 2024-09-12T00:34:27.528 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.530+0000 7f1f2d864780 1 > prepared part key=_multipart_PVB52GO6L8T4.2~Y6DCUOJJ30F1.0 size=1048576 2024-09-12T00:34:27.529 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.531+0000 7f1f2d864780 1 > prepared part key=_multipart_PVB52GO6L8T4.2~Y6DCUOJJ30F1.1 size=935872 2024-09-12T00:34:27.529 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.531+0000 7f1f2d864780 1 > prepared multipart upload key=PVB52GO6L8T4 upload=Y6DCUOJJ30F1 tag=ETOPXYT9YEEM type=write size=3033024 2024-09-12T00:34:27.530 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.532+0000 7f1f2d864780 1 < completed delete operation key=1299IOSGYIO9 tag=61CJUGECN0PC type=del 2024-09-12T00:34:27.532 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.533+0000 7f1f2d864780 1 > prepared operation key=WGKEA4EKF5GP tag=FW0CMB4MRF7D type=del size=3970880 2024-09-12T00:34:27.533 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.534+0000 7f1f2d864780 1 < completed delete operation key=WKK747ETLW10 tag=0413BCE3I45Q type=del 2024-09-12T00:34:27.534 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.535+0000 7f1f2d864780 1 > prepared operation key=WGKEA4EKF5GP tag=V3HNWBFNBQW9 type=del size=3484846 2024-09-12T00:34:27.535 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.537+0000 7f1f2d864780 1 < completed delete operation key=SNCGB6Z20450 tag=JAVDRQHPT8A0 type=del 2024-09-12T00:34:27.537 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.539+0000 7f1f2d864780 1 > prepared part key=_multipart_ZGO887JDR627.2~KHZ06UP0GU0J.0 size=1048576 2024-09-12T00:34:27.538 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.540+0000 7f1f2d864780 1 > prepared part key=_multipart_ZGO887JDR627.2~KHZ06UP0GU0J.1 size=181011 2024-09-12T00:34:27.538 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.540+0000 7f1f2d864780 1 > prepared multipart upload key=ZGO887JDR627 upload=KHZ06UP0GU0J tag=RKVD2ZZ63BEW type=write size=2278163 2024-09-12T00:34:27.539 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.541+0000 7f1f2d864780 1 < completed part key=_multipart_O1YY03BOEYLM.2~5PXRDCVHHLCO.0 size=1048576 2024-09-12T00:34:27.540 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.542+0000 7f1f2d864780 1 < completed part key=_multipart_O1YY03BOEYLM.2~5PXRDCVHHLCO.1 size=1048576 2024-09-12T00:34:27.541 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.543+0000 7f1f2d864780 1 < completed part key=_multipart_O1YY03BOEYLM.2~5PXRDCVHHLCO.2 size=807937 2024-09-12T00:34:27.543 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.545+0000 7f1f2d864780 1 < completed multipart upload key=O1YY03BOEYLM upload=5PXRDCVHHLCO tag=921CK0C20QYX type=write size=3953665 2024-09-12T00:34:27.544 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.546+0000 7f1f2d864780 1 > prepared operation key=4FRVL0KXN2X8 tag=Y4TAHAPQJFWS type=del size=3755531 2024-09-12T00:34:27.546 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.547+0000 7f1f2d864780 1 < completed part key=_multipart_2RV0899QUJ8W.2~T9QSRJS3TQSH.0 size=1048576 2024-09-12T00:34:27.547 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.548+0000 7f1f2d864780 1 < completed part key=_multipart_2RV0899QUJ8W.2~T9QSRJS3TQSH.1 size=253212 2024-09-12T00:34:27.549 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.550+0000 7f1f2d864780 1 < completed multipart upload key=2RV0899QUJ8W upload=T9QSRJS3TQSH tag=V9SKSVMT70YT type=write size=2350364 2024-09-12T00:34:27.550 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.551+0000 7f1f2d864780 1 > prepared operation key=SNCGB6Z20450 tag=A8X0YEMKC5R0 type=del size=601198 2024-09-12T00:34:27.551 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.553+0000 7f1f2d864780 1 < completed write operation key=FFG41OYEYFZA tag=MAPJ3HJZ5VPL type=write size=551299 2024-09-12T00:34:27.552 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.554+0000 7f1f2d864780 1 > prepared operation key=3Z1TGGPZKJ69 tag=CN9F5IMLD1YT type=del size=1915717 2024-09-12T00:34:27.553 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.555+0000 7f1f2d864780 1 < completed delete operation key=UTR2UUO6DHLJ tag=TMINAVVEYR83 type=del 2024-09-12T00:34:27.555 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.556+0000 7f1f2d864780 1 > prepared operation key=WKK747ETLW10 tag=8NBE582CS5H3 type=del size=921717 2024-09-12T00:34:27.556 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.558+0000 7f1f2d864780 1 < completed part key=_multipart_AN26EVAZI527.2~YWFCX7AS0BQ7.0 size=1048576 2024-09-12T00:34:27.556 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.558+0000 7f1f2d864780 1 < canceled part key=_multipart_AN26EVAZI527.2~YWFCX7AS0BQ7.1 size=1048576 2024-09-12T00:34:27.557 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.558+0000 7f1f2d864780 1 < completed part key=_multipart_AN26EVAZI527.2~YWFCX7AS0BQ7.2 size=872645 2024-09-12T00:34:27.559 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.560+0000 7f1f2d864780 1 < canceled multipart upload key=AN26EVAZI527 upload=YWFCX7AS0BQ7 tag=Y9WAQAJI9NXL type=write size=4018373 2024-09-12T00:34:27.560 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.562+0000 7f1f2d864780 1 > prepared operation key=4FRVL0KXN2X8 tag=AJ5I2TIEX64R type=del size=3918510 2024-09-12T00:34:27.561 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.563+0000 7f1f2d864780 1 < completed part key=_multipart_N9RQIGHVL8VP.2~W2YOLAPWA7LY.0 size=1048576 2024-09-12T00:34:27.562 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.564+0000 7f1f2d864780 1 < completed part key=_multipart_N9RQIGHVL8VP.2~W2YOLAPWA7LY.1 size=1048576 2024-09-12T00:34:27.563 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.565+0000 7f1f2d864780 1 < completed part key=_multipart_N9RQIGHVL8VP.2~W2YOLAPWA7LY.2 size=412976 2024-09-12T00:34:27.565 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.567+0000 7f1f2d864780 1 < completed multipart upload key=N9RQIGHVL8VP upload=W2YOLAPWA7LY tag=UKR9H48TWS19 type=write size=3558704 2024-09-12T00:34:27.567 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.568+0000 7f1f2d864780 1 > prepared operation key=S5DVMA14N7VJ tag=LIX8E08LV9WD type=write size=773745 2024-09-12T00:34:27.568 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.570+0000 7f1f2d864780 1 < completed part key=_multipart_O1YY03BOEYLM.2~BUAC89U27OHY.0 size=1048576 2024-09-12T00:34:27.569 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.571+0000 7f1f2d864780 1 < completed part key=_multipart_O1YY03BOEYLM.2~BUAC89U27OHY.1 size=1048576 2024-09-12T00:34:27.570 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.572+0000 7f1f2d864780 1 < completed part key=_multipart_O1YY03BOEYLM.2~BUAC89U27OHY.2 size=281435 2024-09-12T00:34:27.572 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.574+0000 7f1f2d864780 1 < completed multipart upload key=O1YY03BOEYLM upload=BUAC89U27OHY tag=0CYM7XW0JKYL type=write size=3427163 2024-09-12T00:34:27.573 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.575+0000 7f1f2d864780 1 > prepared operation key=ZGO887JDR627 tag=MLNQF5XB8A8I type=del size=1179368 2024-09-12T00:34:27.575 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.576+0000 7f1f2d864780 1 < completed delete operation key=MSGU3PHLBRJH tag=UYQHTM8P1MIY type=del 2024-09-12T00:34:27.576 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.578+0000 7f1f2d864780 1 > prepared operation key=SNCGB6Z20450 tag=8HH140HJ24VZ type=del size=4004501 2024-09-12T00:34:27.578 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.579+0000 7f1f2d864780 1 < canceled operation key=WGKEA4EKF5GP tag=OPAPKA27QN9E type=del size=1884031 2024-09-12T00:34:27.578 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.580+0000 7f1f2d864780 1 > prepared operation key=0DSQOFS8IIF5 tag=VRTRMNVNTFL4 type=del size=1258892 2024-09-12T00:34:27.580 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.581+0000 7f1f2d864780 1 < completed delete operation key=53QCNWX1V1R1 tag=Q6I2RT0VCGK0 type=del 2024-09-12T00:34:27.582 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.584+0000 7f1f2d864780 1 > prepared part key=_multipart_WKK747ETLW10.2~ZHJ0YO7AJAX5.0 size=696340 2024-09-12T00:34:27.582 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.584+0000 7f1f2d864780 1 > prepared multipart upload key=WKK747ETLW10 upload=ZHJ0YO7AJAX5 tag=YPHFF3T03957 type=write size=1744916 2024-09-12T00:34:27.583 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.585+0000 7f1f2d864780 1 < completed delete operation key=S5DVMA14N7VJ tag=VTC28UQ0Y5EV type=del 2024-09-12T00:34:27.586 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.587+0000 7f1f2d864780 1 > prepared part key=_multipart_53QCNWX1V1R1.2~1JY2PRFYJBN6.0 size=1048576 2024-09-12T00:34:27.587 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.588+0000 7f1f2d864780 1 > prepared part key=_multipart_53QCNWX1V1R1.2~1JY2PRFYJBN6.1 size=811734 2024-09-12T00:34:27.587 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.588+0000 7f1f2d864780 1 > prepared multipart upload key=53QCNWX1V1R1 upload=1JY2PRFYJBN6 tag=APVNSHM5VMSY type=write size=2908886 2024-09-12T00:34:27.588 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.590+0000 7f1f2d864780 1 < completed part key=_multipart_PVB52GO6L8T4.2~V0P2X8W4BD2Z.0 size=1048576 2024-09-12T00:34:27.590 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.591+0000 7f1f2d864780 1 < completed part key=_multipart_PVB52GO6L8T4.2~V0P2X8W4BD2Z.1 size=1048576 2024-09-12T00:34:27.590 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.592+0000 7f1f2d864780 1 < completed part key=_multipart_PVB52GO6L8T4.2~V0P2X8W4BD2Z.2 size=42875 2024-09-12T00:34:27.593 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.594+0000 7f1f2d864780 1 < completed multipart upload key=PVB52GO6L8T4 upload=V0P2X8W4BD2Z tag=R5295285WEEN type=write size=3188603 2024-09-12T00:34:27.594 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.595+0000 7f1f2d864780 1 > prepared operation key=AN26EVAZI527 tag=E7DJRV3VI6V0 type=del size=2858642 2024-09-12T00:34:27.595 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.597+0000 7f1f2d864780 1 < completed part key=_multipart_PVB52GO6L8T4.2~Y6DCUOJJ30F1.0 size=1048576 2024-09-12T00:34:27.596 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.598+0000 7f1f2d864780 1 < completed part key=_multipart_PVB52GO6L8T4.2~Y6DCUOJJ30F1.1 size=935872 2024-09-12T00:34:27.599 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.600+0000 7f1f2d864780 1 < completed multipart upload key=PVB52GO6L8T4 upload=Y6DCUOJJ30F1 tag=ETOPXYT9YEEM type=write size=3033024 2024-09-12T00:34:27.600 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.601+0000 7f1f2d864780 1 > prepared operation key=0DSQOFS8IIF5 tag=WPRXRH8H0IKF type=del size=3510421 2024-09-12T00:34:27.602 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.603+0000 7f1f2d864780 1 < suggested update operation key=WGKEA4EKF5GP tag=FW0CMB4MRF7D type=del size=3970880 2024-09-12T00:34:27.604 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.606+0000 7f1f2d864780 1 > prepared part key=_multipart_MSGU3PHLBRJH.2~0J7VXY0OFUND.0 size=1048576 2024-09-12T00:34:27.605 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.606+0000 7f1f2d864780 1 > prepared part key=_multipart_MSGU3PHLBRJH.2~0J7VXY0OFUND.1 size=1048576 2024-09-12T00:34:27.606 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.607+0000 7f1f2d864780 1 > prepared part key=_multipart_MSGU3PHLBRJH.2~0J7VXY0OFUND.2 size=812189 2024-09-12T00:34:27.606 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.607+0000 7f1f2d864780 1 > prepared multipart upload key=MSGU3PHLBRJH upload=0J7VXY0OFUND tag=SUNG2DRP3UZY type=write size=3957917 2024-09-12T00:34:27.607 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.608+0000 7f1f2d864780 -1 < failed to complete operation key=WGKEA4EKF5GP tag=V3HNWBFNBQW9 type=del size=3484846: (22) Invalid argument 2024-09-12T00:34:27.608 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.610+0000 7f1f2d864780 1 > prepared operation key=GSPM8N0K7ODC tag=78W1SN1O6H1J type=del size=2629972 2024-09-12T00:34:27.609 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.611+0000 7f1f2d864780 1 < completed part key=_multipart_ZGO887JDR627.2~KHZ06UP0GU0J.0 size=1048576 2024-09-12T00:34:27.610 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.612+0000 7f1f2d864780 1 < completed part key=_multipart_ZGO887JDR627.2~KHZ06UP0GU0J.1 size=181011 2024-09-12T00:34:27.612 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.614+0000 7f1f2d864780 1 < completed multipart upload key=ZGO887JDR627 upload=KHZ06UP0GU0J tag=RKVD2ZZ63BEW type=write size=2278163 2024-09-12T00:34:27.613 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.615+0000 7f1f2d864780 1 > prepared operation key=2G3UCYG4R4NM tag=JZDTKQIXDXP1 type=write size=394410 2024-09-12T00:34:27.614 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.616+0000 7f1f2d864780 1 < completed delete operation key=4FRVL0KXN2X8 tag=Y4TAHAPQJFWS type=del 2024-09-12T00:34:27.616 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.618+0000 7f1f2d864780 1 > prepared part key=_multipart_ECZYQEZ942W8.2~RG74Q8UXZH8M.0 size=1048576 2024-09-12T00:34:27.617 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.619+0000 7f1f2d864780 1 > prepared part key=_multipart_ECZYQEZ942W8.2~RG74Q8UXZH8M.1 size=1048576 2024-09-12T00:34:27.619 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.621+0000 7f1f2d864780 1 > prepared part key=_multipart_ECZYQEZ942W8.2~RG74Q8UXZH8M.2 size=3073 2024-09-12T00:34:27.619 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.621+0000 7f1f2d864780 1 > prepared multipart upload key=ECZYQEZ942W8 upload=RG74Q8UXZH8M tag=BMF28QXGPZGQ type=write size=3148801 2024-09-12T00:34:27.620 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.622+0000 7f1f2d864780 1 < completed delete operation key=SNCGB6Z20450 tag=A8X0YEMKC5R0 type=del 2024-09-12T00:34:27.621 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.623+0000 7f1f2d864780 1 > prepared operation key=N9RQIGHVL8VP tag=U613YBCDAIDZ type=del size=2827669 2024-09-12T00:34:27.623 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.624+0000 7f1f2d864780 1 < completed delete operation key=3Z1TGGPZKJ69 tag=CN9F5IMLD1YT type=del 2024-09-12T00:34:27.624 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.625+0000 7f1f2d864780 1 > prepared operation key=SNCGB6Z20450 tag=P14QWY62JRMF type=del size=2496225 2024-09-12T00:34:27.625 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.627+0000 7f1f2d864780 1 < canceled operation key=WKK747ETLW10 tag=8NBE582CS5H3 type=del size=921717 2024-09-12T00:34:27.626 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.628+0000 7f1f2d864780 1 > prepared operation key=WGKEA4EKF5GP tag=G99ESWF7IPXW type=del size=938740 2024-09-12T00:34:27.628 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.630+0000 7f1f2d864780 1 < suggested remove operation key=4FRVL0KXN2X8 tag=AJ5I2TIEX64R type=del 2024-09-12T00:34:27.630 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.632+0000 7f1f2d864780 1 > prepared part key=_multipart_W6U30X4HJCB1.2~QUK28TU01ANL.0 size=775805 2024-09-12T00:34:27.630 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.632+0000 7f1f2d864780 1 > prepared multipart upload key=W6U30X4HJCB1 upload=QUK28TU01ANL tag=9T06RZ3ZOW8B type=write size=1824381 2024-09-12T00:34:27.633 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.634+0000 7f1f2d864780 1 < suggested update operation key=S5DVMA14N7VJ tag=LIX8E08LV9WD type=write size=773745 2024-09-12T00:34:27.634 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.636+0000 7f1f2d864780 1 > prepared operation key=UTR2UUO6DHLJ tag=IYU8GL0BOAWG type=del size=3017567 2024-09-12T00:34:27.635 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.637+0000 7f1f2d864780 1 < canceled operation key=ZGO887JDR627 tag=MLNQF5XB8A8I type=del size=1179368 2024-09-12T00:34:27.636 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.638+0000 7f1f2d864780 1 > prepared operation key=WKK747ETLW10 tag=CG6TOMGDOJYF type=del size=4064892 2024-09-12T00:34:27.637 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.639+0000 7f1f2d864780 1 < completed delete operation key=SNCGB6Z20450 tag=8HH140HJ24VZ type=del 2024-09-12T00:34:27.638 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.640+0000 7f1f2d864780 1 > prepared operation key=DYKLAY6J018G tag=BCL0XEIOVH69 type=del size=924780 2024-09-12T00:34:27.640 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.641+0000 7f1f2d864780 1 < completed delete operation key=0DSQOFS8IIF5 tag=VRTRMNVNTFL4 type=del 2024-09-12T00:34:27.642 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.643+0000 7f1f2d864780 1 > prepared part key=_multipart_DYKLAY6J018G.2~NWU48ALLUD98.0 size=1048576 2024-09-12T00:34:27.643 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.644+0000 7f1f2d864780 1 > prepared part key=_multipart_DYKLAY6J018G.2~NWU48ALLUD98.1 size=381162 2024-09-12T00:34:27.643 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.644+0000 7f1f2d864780 1 > prepared multipart upload key=DYKLAY6J018G upload=NWU48ALLUD98 tag=2L0YWDPIMXUU type=write size=2478314 2024-09-12T00:34:27.644 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.645+0000 7f1f2d864780 1 < completed part key=_multipart_WKK747ETLW10.2~ZHJ0YO7AJAX5.0 size=696340 2024-09-12T00:34:27.646 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.647+0000 7f1f2d864780 1 < completed multipart upload key=WKK747ETLW10 upload=ZHJ0YO7AJAX5 tag=YPHFF3T03957 type=write size=1744916 2024-09-12T00:34:27.647 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.648+0000 7f1f2d864780 1 > prepared operation key=AN26EVAZI527 tag=LUQGT2P1QQH2 type=del size=3620333 2024-09-12T00:34:27.648 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.650+0000 7f1f2d864780 1 < completed part key=_multipart_53QCNWX1V1R1.2~1JY2PRFYJBN6.0 size=1048576 2024-09-12T00:34:27.649 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.651+0000 7f1f2d864780 1 < completed part key=_multipart_53QCNWX1V1R1.2~1JY2PRFYJBN6.1 size=811734 2024-09-12T00:34:27.652 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.652+0000 7f1f2d864780 1 < completed multipart upload key=53QCNWX1V1R1 upload=1JY2PRFYJBN6 tag=APVNSHM5VMSY type=write size=2908886 2024-09-12T00:34:27.652 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.654+0000 7f1f2d864780 1 > prepared operation key=FAP6N3H7SBN0 tag=6VSIK3GTL4XS type=del size=1362268 2024-09-12T00:34:27.653 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.655+0000 7f1f2d864780 1 < canceled operation key=AN26EVAZI527 tag=E7DJRV3VI6V0 type=del size=2858642 2024-09-12T00:34:27.654 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.656+0000 7f1f2d864780 1 > prepared operation key=53QCNWX1V1R1 tag=3TM43AKZ6P0M type=del size=46016 2024-09-12T00:34:27.655 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.657+0000 7f1f2d864780 1 < canceled operation key=0DSQOFS8IIF5 tag=WPRXRH8H0IKF type=del size=3510421 2024-09-12T00:34:27.656 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.658+0000 7f1f2d864780 1 > prepared operation key=FAP6N3H7SBN0 tag=ZJI75N9YWOMX type=del size=4098944 2024-09-12T00:34:27.658 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.659+0000 7f1f2d864780 1 < completed part key=_multipart_MSGU3PHLBRJH.2~0J7VXY0OFUND.0 size=1048576 2024-09-12T00:34:27.658 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.659+0000 7f1f2d864780 1 < canceled part key=_multipart_MSGU3PHLBRJH.2~0J7VXY0OFUND.1 size=1048576 2024-09-12T00:34:27.658 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.659+0000 7f1f2d864780 1 < canceled part key=_multipart_MSGU3PHLBRJH.2~0J7VXY0OFUND.2 size=812189 2024-09-12T00:34:27.659 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.661+0000 7f1f2d864780 1 < canceled multipart upload key=MSGU3PHLBRJH upload=0J7VXY0OFUND tag=SUNG2DRP3UZY type=write size=3957917 2024-09-12T00:34:27.661 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.662+0000 7f1f2d864780 1 > prepared operation key=ZGO887JDR627 tag=W1CY9EGEC92A type=del size=3020485 2024-09-12T00:34:27.662 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.663+0000 7f1f2d864780 1 < completed delete operation key=GSPM8N0K7ODC tag=78W1SN1O6H1J type=del 2024-09-12T00:34:27.664 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.665+0000 7f1f2d864780 1 > prepared part key=_multipart_PVB52GO6L8T4.2~7LB9KK1NW9K8.0 size=1048576 2024-09-12T00:34:27.666 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.668+0000 7f1f2d864780 1 > prepared part key=_multipart_PVB52GO6L8T4.2~7LB9KK1NW9K8.1 size=43168 2024-09-12T00:34:27.666 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.668+0000 7f1f2d864780 1 > prepared multipart upload key=PVB52GO6L8T4 upload=7LB9KK1NW9K8 tag=56K6YA8ZY5IW type=write size=2140320 2024-09-12T00:34:27.667 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.669+0000 7f1f2d864780 1 < completed write operation key=2G3UCYG4R4NM tag=JZDTKQIXDXP1 type=write size=394410 2024-09-12T00:34:27.670 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.671+0000 7f1f2d864780 1 > prepared part key=_multipart_FFG41OYEYFZA.2~ND7QVHYPL3NA.0 size=1048576 2024-09-12T00:34:27.670 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.672+0000 7f1f2d864780 1 > prepared part key=_multipart_FFG41OYEYFZA.2~ND7QVHYPL3NA.1 size=758250 2024-09-12T00:34:27.671 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.672+0000 7f1f2d864780 1 > prepared multipart upload key=FFG41OYEYFZA upload=ND7QVHYPL3NA tag=DNGST943AL5C type=write size=2855402 2024-09-12T00:34:27.672 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.673+0000 7f1f2d864780 1 < completed part key=_multipart_ECZYQEZ942W8.2~RG74Q8UXZH8M.0 size=1048576 2024-09-12T00:34:27.673 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.675+0000 7f1f2d864780 1 < completed part key=_multipart_ECZYQEZ942W8.2~RG74Q8UXZH8M.1 size=1048576 2024-09-12T00:34:27.674 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.676+0000 7f1f2d864780 1 < completed part key=_multipart_ECZYQEZ942W8.2~RG74Q8UXZH8M.2 size=3073 2024-09-12T00:34:27.676 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.678+0000 7f1f2d864780 1 < completed multipart upload key=ECZYQEZ942W8 upload=RG74Q8UXZH8M tag=BMF28QXGPZGQ type=write size=3148801 2024-09-12T00:34:27.677 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.679+0000 7f1f2d864780 1 > prepared operation key=O1YY03BOEYLM tag=5U5N1GCB1QUB type=del size=281212 2024-09-12T00:34:27.678 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.680+0000 7f1f2d864780 1 < completed delete operation key=N9RQIGHVL8VP tag=U613YBCDAIDZ type=del 2024-09-12T00:34:27.679 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.681+0000 7f1f2d864780 1 > prepared operation key=DYKLAY6J018G tag=DLUP70COG4SW type=del size=2401771 2024-09-12T00:34:27.680 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.682+0000 7f1f2d864780 1 < completed delete operation key=SNCGB6Z20450 tag=P14QWY62JRMF type=del 2024-09-12T00:34:27.681 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:34:27.683+0000 7f1f2d864780 1 > prepared operation key=SZP418NVZ5VX tag=WO23LCAQBJD6 type=del size=166392 2024-09-12T00:34:27.682 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] cls_rgw_stats.simulate (9026 ms) 2024-09-12T00:34:27.682 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 1 test from cls_rgw_stats (9026 ms total) 2024-09-12T00:34:27.682 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-09-12T00:34:27.682 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment tear-down 2024-09-12T00:34:27.738 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] 1 test from 1 test suite ran. (10940 ms total) 2024-09-12T00:34:27.738 INFO:tasks.workunit.client.0.smithi073.stdout:[ PASSED ] 1 test. 2024-09-12T00:34:27.742 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:34:27.742 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:34:27.821 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2024-09-12T00:34:27.822 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-09-12T00:34:27.822 DEBUG:teuthology.orchestra.run.smithi073:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-09-12T00:34:27.904 INFO:tasks.workunit.client.0.smithi073.stdout:Running main() from gmock_main.cc 2024-09-12T00:34:27.904 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] Running 31 tests from 1 test suite. 2024-09-12T00:34:27.905 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment set-up. 2024-09-12T00:34:29.756 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 31 tests from CmpOmap 2024-09-12T00:34:29.756 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-09-12T00:34:29.772 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (17 ms) 2024-09-12T00:34:29.772 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-09-12T00:34:29.776 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (4 ms) 2024-09-12T00:34:29.776 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-09-12T00:34:29.779 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (3 ms) 2024-09-12T00:34:29.779 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-09-12T00:34:29.782 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (3 ms) 2024-09-12T00:34:29.782 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-09-12T00:34:29.789 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] CmpOmap.cmp_vals_str (7 ms) 2024-09-12T00:34:29.789 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-09-12T00:34:29.795 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] CmpOmap.cmp_vals_u64 (7 ms) 2024-09-12T00:34:29.796 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-09-12T00:34:29.799 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (3 ms) 2024-09-12T00:34:29.799 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-09-12T00:34:29.802 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (4 ms) 2024-09-12T00:34:29.802 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-09-12T00:34:29.806 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (3 ms) 2024-09-12T00:34:29.806 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-09-12T00:34:29.810 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (5 ms) 2024-09-12T00:34:29.810 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-09-12T00:34:29.811 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (0 ms) 2024-09-12T00:34:29.811 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-09-12T00:34:29.812 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (1 ms) 2024-09-12T00:34:29.812 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-09-12T00:34:29.818 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (7 ms) 2024-09-12T00:34:29.819 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-09-12T00:34:29.825 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (6 ms) 2024-09-12T00:34:29.825 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-09-12T00:34:29.831 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (6 ms) 2024-09-12T00:34:29.831 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-09-12T00:34:29.837 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (7 ms) 2024-09-12T00:34:29.837 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-09-12T00:34:29.845 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] CmpOmap.cmp_set_vals_str (7 ms) 2024-09-12T00:34:29.845 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-09-12T00:34:29.853 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (8 ms) 2024-09-12T00:34:29.853 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-09-12T00:34:29.856 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (3 ms) 2024-09-12T00:34:29.856 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-09-12T00:34:29.858 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (2 ms) 2024-09-12T00:34:29.858 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-09-12T00:34:29.859 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (1 ms) 2024-09-12T00:34:29.859 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-09-12T00:34:29.859 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (1 ms) 2024-09-12T00:34:29.859 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-09-12T00:34:29.865 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (5 ms) 2024-09-12T00:34:29.865 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-09-12T00:34:29.871 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (7 ms) 2024-09-12T00:34:29.872 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-09-12T00:34:29.878 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (7 ms) 2024-09-12T00:34:29.879 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-09-12T00:34:29.886 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (8 ms) 2024-09-12T00:34:29.886 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-09-12T00:34:29.888 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (2 ms) 2024-09-12T00:34:29.889 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-09-12T00:34:29.891 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (2 ms) 2024-09-12T00:34:29.891 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-09-12T00:34:29.892 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (1 ms) 2024-09-12T00:34:29.892 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-09-12T00:34:29.892 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (1 ms) 2024-09-12T00:34:29.892 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-09-12T00:34:29.900 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (7 ms) 2024-09-12T00:34:29.900 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 31 tests from CmpOmap (145 ms total) 2024-09-12T00:34:29.900 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-09-12T00:34:29.900 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment tear-down 2024-09-12T00:34:30.763 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] 31 tests from 1 test suite ran. (2859 ms total) 2024-09-12T00:34:30.763 INFO:tasks.workunit.client.0.smithi073.stdout:[ PASSED ] 31 tests. 2024-09-12T00:34:30.766 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:34:30.766 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:34:30.852 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2024-09-12T00:34:30.853 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-09-12T00:34:30.853 DEBUG:teuthology.orchestra.run.smithi073:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-09-12T00:34:30.900 INFO:tasks.workunit.client.0.smithi073.stdout:Running main() from gmock_main.cc 2024-09-12T00:34:30.900 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T00:34:30.900 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment set-up. 2024-09-12T00:34:30.900 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 24 tests from TestCls2PCQueue 2024-09-12T00:34:30.900 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-09-12T00:34:33.779 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2879 ms) 2024-09-12T00:34:33.779 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-09-12T00:34:36.796 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3016 ms) 2024-09-12T00:34:36.796 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-09-12T00:34:39.804 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] TestCls2PCQueue.Reserve (3008 ms) 2024-09-12T00:34:39.804 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-09-12T00:34:42.833 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3031 ms) 2024-09-12T00:34:42.834 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-09-12T00:34:45.838 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] TestCls2PCQueue.Commit (3004 ms) 2024-09-12T00:34:45.838 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] TestCls2PCQueue.Stats 2024-09-12T00:34:48.867 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] TestCls2PCQueue.Stats (3029 ms) 2024-09-12T00:34:48.867 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2024-09-12T00:34:52.898 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (4031 ms) 2024-09-12T00:34:52.898 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-09-12T00:34:55.905 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] TestCls2PCQueue.Abort (3006 ms) 2024-09-12T00:34:55.905 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-09-12T00:34:58.939 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] TestCls2PCQueue.ReserveError (3034 ms) 2024-09-12T00:34:58.939 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-09-12T00:35:01.950 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] TestCls2PCQueue.CommitError (3012 ms) 2024-09-12T00:35:01.951 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-09-12T00:35:04.968 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] TestCls2PCQueue.AbortError (3018 ms) 2024-09-12T00:35:04.969 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-09-12T00:35:07.982 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3014 ms) 2024-09-12T00:35:07.983 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-09-12T00:35:11.017 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3035 ms) 2024-09-12T00:35:11.017 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-09-12T00:35:14.027 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3008 ms) 2024-09-12T00:35:14.027 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-09-12T00:35:17.045 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3020 ms) 2024-09-12T00:35:17.045 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-09-12T00:35:20.064 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3019 ms) 2024-09-12T00:35:20.064 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-09-12T00:35:23.094 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3026 ms) 2024-09-12T00:35:23.131 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-09-12T00:35:26.097 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] TestCls2PCQueue.Cleanup (3007 ms) 2024-09-12T00:35:26.098 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-09-12T00:35:36.151 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] TestCls2PCQueue.MultiProducer (10054 ms) 2024-09-12T00:35:36.151 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-09-12T00:35:39.188 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (3037 ms) 2024-09-12T00:35:39.188 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-09-12T00:35:52.271 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (13083 ms) 2024-09-12T00:35:52.272 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-09-12T00:35:56.303 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (4030 ms) 2024-09-12T00:35:56.303 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-09-12T00:36:01.646 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (5344 ms) 2024-09-12T00:36:01.646 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-09-12T00:36:06.689 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (5043 ms) 2024-09-12T00:36:06.689 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 24 tests from TestCls2PCQueue (95789 ms total) 2024-09-12T00:36:06.689 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-09-12T00:36:06.689 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment tear-down 2024-09-12T00:36:06.689 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] 24 tests from 1 test suite ran. (95789 ms total) 2024-09-12T00:36:06.689 INFO:tasks.workunit.client.0.smithi073.stdout:[ PASSED ] 24 tests. 2024-09-12T00:36:06.692 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:36:06.693 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:36:06.758 INFO:tasks.workunit:Running workunits matching cls/test_cls_user.sh on client.0... 2024-09-12T00:36:06.759 INFO:tasks.workunit:Running workunit cls/test_cls_user.sh... 2024-09-12T00:36:06.759 DEBUG:teuthology.orchestra.run.smithi073:workunit test cls/test_cls_user.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_user.sh 2024-09-12T00:36:06.813 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:06.814 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:06.814 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T00:36:06.814 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment set-up. 2024-09-12T00:36:08.690 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 4 tests from ClsAccount 2024-09-12T00:36:08.691 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] ClsAccount.add 2024-09-12T00:36:08.715 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] ClsAccount.add (25 ms) 2024-09-12T00:36:08.715 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] ClsAccount.get 2024-09-12T00:36:08.720 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] ClsAccount.get (5 ms) 2024-09-12T00:36:08.720 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] ClsAccount.rm 2024-09-12T00:36:08.726 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] ClsAccount.rm (7 ms) 2024-09-12T00:36:08.727 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] ClsAccount.list 2024-09-12T00:36:08.743 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] ClsAccount.list (16 ms) 2024-09-12T00:36:08.743 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 4 tests from ClsAccount (53 ms total) 2024-09-12T00:36:08.743 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-09-12T00:36:08.743 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment tear-down 2024-09-12T00:36:09.701 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] 4 tests from 1 test suite ran. (2886 ms total) 2024-09-12T00:36:09.701 INFO:tasks.workunit.client.0.smithi073.stdout:[ PASSED ] 4 tests. 2024-09-12T00:36:09.705 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:36:09.706 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:36:09.750 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2024-09-12T00:36:09.751 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2024-09-12T00:36:09.751 DEBUG:teuthology.orchestra.run.smithi073:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-09-12T00:36:09.846 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:09.847 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:09.848 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] Running 6 tests from 1 test suite. 2024-09-12T00:36:09.848 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment set-up. 2024-09-12T00:36:11.724 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 6 tests from rgw_gc_log 2024-09-12T00:36:11.724 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2024-09-12T00:36:11.740 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] rgw_gc_log.init_existing_queue (16 ms) 2024-09-12T00:36:11.740 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2024-09-12T00:36:11.743 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] rgw_gc_log.init_existing_omap (3 ms) 2024-09-12T00:36:11.743 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2024-09-12T00:36:11.746 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (4 ms) 2024-09-12T00:36:11.746 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2024-09-12T00:36:11.748 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (1 ms) 2024-09-12T00:36:11.748 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2024-09-12T00:36:11.751 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] rgw_gc_log.defer1_after_init (4 ms) 2024-09-12T00:36:11.752 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2024-09-12T00:36:11.753 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] rgw_gc_log.defer2_before_init (1 ms) 2024-09-12T00:36:11.753 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 6 tests from rgw_gc_log (29 ms total) 2024-09-12T00:36:11.753 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-09-12T00:36:11.753 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment tear-down 2024-09-12T00:36:12.723 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] 6 tests from 1 test suite ran. (2877 ms total) 2024-09-12T00:36:12.723 INFO:tasks.workunit.client.0.smithi073.stdout:[ PASSED ] 6 tests. 2024-09-12T00:36:12.727 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:36:12.728 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:36:12.770 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2024-09-12T00:36:12.771 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2024-09-12T00:36:12.772 DEBUG:teuthology.orchestra.run.smithi073:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-09-12T00:36:12.868 INFO:tasks.workunit.client.0.smithi073.stdout:Running main() from gmock_main.cc 2024-09-12T00:36:12.868 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T00:36:12.869 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment set-up. 2024-09-12T00:36:12.869 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 4 tests from TestRGWObj 2024-09-12T00:36:12.869 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] TestRGWObj.underscore 2024-09-12T00:36:12.869 INFO:tasks.workunit.client.0.smithi073.stdout:parsed: _obj 2024-09-12T00:36:12.869 INFO:tasks.workunit.client.0.smithi073.stdout:parsed: _obj 2024-09-12T00:36:12.869 INFO:tasks.workunit.client.0.smithi073.stdout:stripped: _obj ns= i= 2024-09-12T00:36:12.869 INFO:tasks.workunit.client.0.smithi073.stdout:parsed: _obj 2024-09-12T00:36:12.869 INFO:tasks.workunit.client.0.smithi073.stdout:parsed: _obj 2024-09-12T00:36:12.869 INFO:tasks.workunit.client.0.smithi073.stdout:stripped: _obj ns= i= 2024-09-12T00:36:12.869 INFO:tasks.workunit.client.0.smithi073.stdout:parsed: _obj 2024-09-12T00:36:12.869 INFO:tasks.workunit.client.0.smithi073.stdout:parsed: _obj 2024-09-12T00:36:12.869 INFO:tasks.workunit.client.0.smithi073.stdout:stripped: _obj ns= i= 2024-09-12T00:36:12.869 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.870 INFO:tasks.workunit.client.0.smithi073.stdout: "obj1": { 2024-09-12T00:36:12.870 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.870 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.870 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.870 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.870 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.870 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.870 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.870 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.870 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.870 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.870 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.870 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.871 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_obj", 2024-09-12T00:36:12.871 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:12.871 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:12.871 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.871 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.871 INFO:tasks.workunit.client.0.smithi073.stdout: "obj2": { 2024-09-12T00:36:12.871 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.871 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.871 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.871 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.871 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.871 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.871 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.871 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.872 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.872 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.872 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.872 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.872 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_obj", 2024-09-12T00:36:12.872 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:12.872 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:12.872 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.872 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.872 INFO:tasks.workunit.client.0.smithi073.stdout: "obj3": { 2024-09-12T00:36:12.872 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.872 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.873 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.873 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.873 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.873 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.873 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.873 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.873 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.873 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.873 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.873 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.873 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_obj", 2024-09-12T00:36:12.873 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:12.873 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:12.874 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.874 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.874 INFO:tasks.workunit.client.0.smithi073.stdout: "obj3-2": { 2024-09-12T00:36:12.874 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.874 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.874 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.874 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.874 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.874 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.874 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.874 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.874 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.874 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.875 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.875 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.875 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_obj", 2024-09-12T00:36:12.875 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:12.875 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:12.875 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.875 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.875 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.875 INFO:tasks.workunit.client.0.smithi073.stdout:parsed: _obj 2024-09-12T00:36:12.875 INFO:tasks.workunit.client.0.smithi073.stdout:parsed: _obj 2024-09-12T00:36:12.875 INFO:tasks.workunit.client.0.smithi073.stdout:stripped: _obj ns=ns i= 2024-09-12T00:36:12.875 INFO:tasks.workunit.client.0.smithi073.stdout:parsed: _obj 2024-09-12T00:36:12.875 INFO:tasks.workunit.client.0.smithi073.stdout:parsed: _obj 2024-09-12T00:36:12.875 INFO:tasks.workunit.client.0.smithi073.stdout:stripped: _obj ns=ns i= 2024-09-12T00:36:12.875 INFO:tasks.workunit.client.0.smithi073.stdout:parsed: _obj 2024-09-12T00:36:12.876 INFO:tasks.workunit.client.0.smithi073.stdout:parsed: _obj 2024-09-12T00:36:12.876 INFO:tasks.workunit.client.0.smithi073.stdout:stripped: _obj ns=ns i= 2024-09-12T00:36:12.876 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.876 INFO:tasks.workunit.client.0.smithi073.stdout: "obj1": { 2024-09-12T00:36:12.876 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.876 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.876 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.876 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.876 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.876 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.876 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.876 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.876 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.877 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.877 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.877 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.877 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_obj", 2024-09-12T00:36:12.877 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:12.877 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "ns" 2024-09-12T00:36:12.877 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.877 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.877 INFO:tasks.workunit.client.0.smithi073.stdout: "obj2": { 2024-09-12T00:36:12.877 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.877 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.877 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.877 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.877 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.878 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.878 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.878 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.878 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.878 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.878 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.878 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.880 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_obj", 2024-09-12T00:36:12.880 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:12.880 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "ns" 2024-09-12T00:36:12.880 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.880 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.880 INFO:tasks.workunit.client.0.smithi073.stdout: "obj3": { 2024-09-12T00:36:12.880 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.880 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.880 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.881 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.881 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.881 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.881 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.881 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.881 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.881 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.881 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.881 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.881 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_obj", 2024-09-12T00:36:12.881 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:12.881 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:12.881 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.881 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.882 INFO:tasks.workunit.client.0.smithi073.stdout: "obj3-2": { 2024-09-12T00:36:12.882 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.882 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.882 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.882 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.882 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.882 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.882 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.882 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.882 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.882 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.882 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.882 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.882 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_obj", 2024-09-12T00:36:12.883 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:12.883 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "ns" 2024-09-12T00:36:12.883 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.883 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.883 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.883 INFO:tasks.workunit.client.0.smithi073.stdout:parsed: _obj[v1] 2024-09-12T00:36:12.883 INFO:tasks.workunit.client.0.smithi073.stdout:parsed: _obj[v1] 2024-09-12T00:36:12.883 INFO:tasks.workunit.client.0.smithi073.stdout:stripped: _obj ns= i=v1 2024-09-12T00:36:12.883 INFO:tasks.workunit.client.0.smithi073.stdout:parsed: _obj[v1] 2024-09-12T00:36:12.883 INFO:tasks.workunit.client.0.smithi073.stdout:parsed: _obj[v1] 2024-09-12T00:36:12.883 INFO:tasks.workunit.client.0.smithi073.stdout:stripped: _obj ns= i=v1 2024-09-12T00:36:12.883 INFO:tasks.workunit.client.0.smithi073.stdout:parsed: _obj[v1] 2024-09-12T00:36:12.883 INFO:tasks.workunit.client.0.smithi073.stdout:parsed: _obj[v1] 2024-09-12T00:36:12.884 INFO:tasks.workunit.client.0.smithi073.stdout:stripped: _obj ns= i=v1 2024-09-12T00:36:12.884 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.884 INFO:tasks.workunit.client.0.smithi073.stdout: "obj1": { 2024-09-12T00:36:12.884 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.884 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.884 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.884 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.884 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.884 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.884 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.884 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.884 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.884 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.885 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.885 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.885 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_obj", 2024-09-12T00:36:12.885 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "v1", 2024-09-12T00:36:12.885 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:12.885 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.885 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.885 INFO:tasks.workunit.client.0.smithi073.stdout: "obj2": { 2024-09-12T00:36:12.885 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.885 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.885 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.885 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.885 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.886 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.886 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.886 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.886 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.886 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.886 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.886 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.886 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_obj", 2024-09-12T00:36:12.886 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "v1", 2024-09-12T00:36:12.886 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:12.886 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.886 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.886 INFO:tasks.workunit.client.0.smithi073.stdout: "obj3": { 2024-09-12T00:36:12.886 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.887 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.887 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.887 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.887 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.887 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.887 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.887 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.887 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.887 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.887 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.887 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.887 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_obj", 2024-09-12T00:36:12.887 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:12.887 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:12.888 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.888 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.888 INFO:tasks.workunit.client.0.smithi073.stdout: "obj3-2": { 2024-09-12T00:36:12.888 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.888 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.888 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.888 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.888 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.888 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.888 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.888 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.888 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.888 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.888 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.889 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.889 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_obj", 2024-09-12T00:36:12.889 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "v1", 2024-09-12T00:36:12.889 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:12.889 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.889 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.889 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.889 INFO:tasks.workunit.client.0.smithi073.stdout:parsed: _obj[v1] 2024-09-12T00:36:12.889 INFO:tasks.workunit.client.0.smithi073.stdout:parsed: _obj[v1] 2024-09-12T00:36:12.889 INFO:tasks.workunit.client.0.smithi073.stdout:stripped: _obj ns=ns i=v1 2024-09-12T00:36:12.889 INFO:tasks.workunit.client.0.smithi073.stdout:parsed: _obj[v1] 2024-09-12T00:36:12.889 INFO:tasks.workunit.client.0.smithi073.stdout:parsed: _obj[v1] 2024-09-12T00:36:12.889 INFO:tasks.workunit.client.0.smithi073.stdout:stripped: _obj ns=ns i=v1 2024-09-12T00:36:12.889 INFO:tasks.workunit.client.0.smithi073.stdout:parsed: _obj[v1] 2024-09-12T00:36:12.890 INFO:tasks.workunit.client.0.smithi073.stdout:parsed: _obj[v1] 2024-09-12T00:36:12.890 INFO:tasks.workunit.client.0.smithi073.stdout:stripped: _obj ns=ns i=v1 2024-09-12T00:36:12.890 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.890 INFO:tasks.workunit.client.0.smithi073.stdout: "obj1": { 2024-09-12T00:36:12.890 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.890 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.890 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.890 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.890 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.890 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.890 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.890 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.890 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.890 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.890 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.891 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.891 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_obj", 2024-09-12T00:36:12.891 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "v1", 2024-09-12T00:36:12.891 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "ns" 2024-09-12T00:36:12.891 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.891 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.891 INFO:tasks.workunit.client.0.smithi073.stdout: "obj2": { 2024-09-12T00:36:12.891 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.891 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.891 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.891 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.891 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.891 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.891 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.891 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.892 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.892 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.892 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.892 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.892 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_obj", 2024-09-12T00:36:12.892 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "v1", 2024-09-12T00:36:12.892 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "ns" 2024-09-12T00:36:12.892 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.892 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.892 INFO:tasks.workunit.client.0.smithi073.stdout: "obj3": { 2024-09-12T00:36:12.892 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.892 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.892 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.892 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.893 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.893 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.893 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.893 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.893 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.893 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.893 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.893 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.893 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_obj", 2024-09-12T00:36:12.893 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:12.893 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:12.893 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.893 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.893 INFO:tasks.workunit.client.0.smithi073.stdout: "obj3-2": { 2024-09-12T00:36:12.894 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.894 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.894 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.894 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.894 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.894 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.894 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.894 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.894 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.894 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.894 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.894 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.894 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_obj", 2024-09-12T00:36:12.895 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "v1", 2024-09-12T00:36:12.895 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "ns" 2024-09-12T00:36:12.895 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.895 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.895 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.895 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] TestRGWObj.underscore (0 ms) 2024-09-12T00:36:12.895 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] TestRGWObj.no_underscore 2024-09-12T00:36:12.895 INFO:tasks.workunit.client.0.smithi073.stdout:parsed: obj 2024-09-12T00:36:12.895 INFO:tasks.workunit.client.0.smithi073.stdout:parsed: obj 2024-09-12T00:36:12.895 INFO:tasks.workunit.client.0.smithi073.stdout:stripped: obj ns= i= 2024-09-12T00:36:12.895 INFO:tasks.workunit.client.0.smithi073.stdout:parsed: obj 2024-09-12T00:36:12.895 INFO:tasks.workunit.client.0.smithi073.stdout:parsed: obj 2024-09-12T00:36:12.895 INFO:tasks.workunit.client.0.smithi073.stdout:stripped: obj ns= i= 2024-09-12T00:36:12.895 INFO:tasks.workunit.client.0.smithi073.stdout:parsed: obj 2024-09-12T00:36:12.896 INFO:tasks.workunit.client.0.smithi073.stdout:parsed: obj 2024-09-12T00:36:12.896 INFO:tasks.workunit.client.0.smithi073.stdout:stripped: obj ns= i= 2024-09-12T00:36:12.896 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.896 INFO:tasks.workunit.client.0.smithi073.stdout: "obj1": { 2024-09-12T00:36:12.896 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.896 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.896 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.896 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.896 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.896 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.896 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.896 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.897 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.897 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.897 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.897 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.897 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "obj", 2024-09-12T00:36:12.897 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:12.897 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:12.897 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.897 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.897 INFO:tasks.workunit.client.0.smithi073.stdout: "obj2": { 2024-09-12T00:36:12.897 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.897 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.897 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.897 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.898 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.898 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.898 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.898 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.898 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.898 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.898 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.898 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.898 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "obj", 2024-09-12T00:36:12.898 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:12.898 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:12.898 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.898 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.898 INFO:tasks.workunit.client.0.smithi073.stdout: "obj3": { 2024-09-12T00:36:12.899 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.899 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.899 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.899 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.899 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.899 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.899 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.899 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.899 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.899 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.899 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.899 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.899 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "obj", 2024-09-12T00:36:12.899 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:12.900 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:12.900 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.900 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.900 INFO:tasks.workunit.client.0.smithi073.stdout: "obj3-2": { 2024-09-12T00:36:12.900 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.900 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.900 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.900 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.900 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.900 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.900 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.900 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.900 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.901 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.901 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.901 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.901 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "obj", 2024-09-12T00:36:12.901 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:12.901 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:12.901 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.901 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.901 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.901 INFO:tasks.workunit.client.0.smithi073.stdout:parsed: obj 2024-09-12T00:36:12.901 INFO:tasks.workunit.client.0.smithi073.stdout:parsed: obj 2024-09-12T00:36:12.901 INFO:tasks.workunit.client.0.smithi073.stdout:stripped: obj ns=ns i= 2024-09-12T00:36:12.901 INFO:tasks.workunit.client.0.smithi073.stdout:parsed: obj 2024-09-12T00:36:12.901 INFO:tasks.workunit.client.0.smithi073.stdout:parsed: obj 2024-09-12T00:36:12.902 INFO:tasks.workunit.client.0.smithi073.stdout:stripped: obj ns=ns i= 2024-09-12T00:36:12.902 INFO:tasks.workunit.client.0.smithi073.stdout:parsed: obj 2024-09-12T00:36:12.902 INFO:tasks.workunit.client.0.smithi073.stdout:parsed: obj 2024-09-12T00:36:12.902 INFO:tasks.workunit.client.0.smithi073.stdout:stripped: obj ns=ns i= 2024-09-12T00:36:12.902 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.902 INFO:tasks.workunit.client.0.smithi073.stdout: "obj1": { 2024-09-12T00:36:12.902 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.902 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.902 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.902 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.902 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.902 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.902 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.902 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.903 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.903 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.903 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.903 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.903 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "obj", 2024-09-12T00:36:12.903 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:12.903 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "ns" 2024-09-12T00:36:12.903 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.903 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.903 INFO:tasks.workunit.client.0.smithi073.stdout: "obj2": { 2024-09-12T00:36:12.903 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.903 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.903 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.904 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.904 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.904 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.904 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.904 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.904 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.904 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.904 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.904 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.904 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "obj", 2024-09-12T00:36:12.904 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:12.904 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "ns" 2024-09-12T00:36:12.904 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.904 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.905 INFO:tasks.workunit.client.0.smithi073.stdout: "obj3": { 2024-09-12T00:36:12.905 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.905 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.905 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.905 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.905 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.905 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.905 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.905 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.905 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.905 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.905 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.905 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.905 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "obj", 2024-09-12T00:36:12.906 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:12.906 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:12.906 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.906 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.906 INFO:tasks.workunit.client.0.smithi073.stdout: "obj3-2": { 2024-09-12T00:36:12.906 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.906 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.906 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.906 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.906 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.906 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.906 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.906 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.907 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.907 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.907 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.907 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.907 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "obj", 2024-09-12T00:36:12.907 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:12.907 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "ns" 2024-09-12T00:36:12.907 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.907 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.907 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.907 INFO:tasks.workunit.client.0.smithi073.stdout:parsed: obj[v1] 2024-09-12T00:36:12.907 INFO:tasks.workunit.client.0.smithi073.stdout:parsed: obj[v1] 2024-09-12T00:36:12.907 INFO:tasks.workunit.client.0.smithi073.stdout:stripped: obj ns= i=v1 2024-09-12T00:36:12.907 INFO:tasks.workunit.client.0.smithi073.stdout:parsed: obj[v1] 2024-09-12T00:36:12.908 INFO:tasks.workunit.client.0.smithi073.stdout:parsed: obj[v1] 2024-09-12T00:36:12.908 INFO:tasks.workunit.client.0.smithi073.stdout:stripped: obj ns= i=v1 2024-09-12T00:36:12.908 INFO:tasks.workunit.client.0.smithi073.stdout:parsed: obj[v1] 2024-09-12T00:36:12.908 INFO:tasks.workunit.client.0.smithi073.stdout:parsed: obj[v1] 2024-09-12T00:36:12.908 INFO:tasks.workunit.client.0.smithi073.stdout:stripped: obj ns= i=v1 2024-09-12T00:36:12.908 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.908 INFO:tasks.workunit.client.0.smithi073.stdout: "obj1": { 2024-09-12T00:36:12.908 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.908 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.908 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.908 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.908 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.908 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.909 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.909 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.909 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.909 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.909 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.909 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.909 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "obj", 2024-09-12T00:36:12.909 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "v1", 2024-09-12T00:36:12.909 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:12.909 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.909 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.909 INFO:tasks.workunit.client.0.smithi073.stdout: "obj2": { 2024-09-12T00:36:12.909 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.909 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.910 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.910 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.910 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.910 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.910 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.910 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.910 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.910 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.910 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.910 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.910 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "obj", 2024-09-12T00:36:12.910 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "v1", 2024-09-12T00:36:12.910 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:12.910 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.911 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.911 INFO:tasks.workunit.client.0.smithi073.stdout: "obj3": { 2024-09-12T00:36:12.911 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.911 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.911 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.911 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.911 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.911 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.911 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.911 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.911 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.911 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.911 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.911 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.912 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "obj", 2024-09-12T00:36:12.912 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:12.912 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:12.912 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.912 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.912 INFO:tasks.workunit.client.0.smithi073.stdout: "obj3-2": { 2024-09-12T00:36:12.912 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.912 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.912 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.912 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.912 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.912 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.912 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.912 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.913 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.913 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.913 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.913 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.913 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "obj", 2024-09-12T00:36:12.913 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "v1", 2024-09-12T00:36:12.913 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:12.913 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.913 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.913 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.913 INFO:tasks.workunit.client.0.smithi073.stdout:parsed: obj[v1] 2024-09-12T00:36:12.913 INFO:tasks.workunit.client.0.smithi073.stdout:parsed: obj[v1] 2024-09-12T00:36:12.913 INFO:tasks.workunit.client.0.smithi073.stdout:stripped: obj ns=ns i=v1 2024-09-12T00:36:12.913 INFO:tasks.workunit.client.0.smithi073.stdout:parsed: obj[v1] 2024-09-12T00:36:12.914 INFO:tasks.workunit.client.0.smithi073.stdout:parsed: obj[v1] 2024-09-12T00:36:12.914 INFO:tasks.workunit.client.0.smithi073.stdout:stripped: obj ns=ns i=v1 2024-09-12T00:36:12.914 INFO:tasks.workunit.client.0.smithi073.stdout:parsed: obj[v1] 2024-09-12T00:36:12.914 INFO:tasks.workunit.client.0.smithi073.stdout:parsed: obj[v1] 2024-09-12T00:36:12.914 INFO:tasks.workunit.client.0.smithi073.stdout:stripped: obj ns=ns i=v1 2024-09-12T00:36:12.914 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.914 INFO:tasks.workunit.client.0.smithi073.stdout: "obj1": { 2024-09-12T00:36:12.914 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.914 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.914 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.914 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.914 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.914 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.914 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.914 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.915 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.915 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.915 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.915 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.915 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "obj", 2024-09-12T00:36:12.915 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "v1", 2024-09-12T00:36:12.915 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "ns" 2024-09-12T00:36:12.915 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.915 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.915 INFO:tasks.workunit.client.0.smithi073.stdout: "obj2": { 2024-09-12T00:36:12.915 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.915 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.916 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.916 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.916 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.916 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.916 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.916 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.916 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.916 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.917 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.917 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.917 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "obj", 2024-09-12T00:36:12.917 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "v1", 2024-09-12T00:36:12.917 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "ns" 2024-09-12T00:36:12.917 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.917 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.917 INFO:tasks.workunit.client.0.smithi073.stdout: "obj3": { 2024-09-12T00:36:12.917 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.917 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.917 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.917 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.917 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.918 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.918 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.918 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.918 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.918 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.918 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.918 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.918 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "obj", 2024-09-12T00:36:12.918 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:12.918 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:12.918 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.918 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.918 INFO:tasks.workunit.client.0.smithi073.stdout: "obj3-2": { 2024-09-12T00:36:12.918 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.919 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.919 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.919 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.919 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.919 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.919 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.919 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.919 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.919 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.919 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.919 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.919 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "obj", 2024-09-12T00:36:12.919 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "v1", 2024-09-12T00:36:12.919 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "ns" 2024-09-12T00:36:12.920 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.920 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.920 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.920 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2024-09-12T00:36:12.920 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] TestRGWObj.obj_to_raw 2024-09-12T00:36:12.920 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.920 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.920 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.920 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.920 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.920 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.920 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.921 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.921 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.921 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.921 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.921 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.921 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.921 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.921 INFO:tasks.workunit.client.0.smithi073.stdout: "obj": { 2024-09-12T00:36:12.921 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.921 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.921 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.921 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.921 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.921 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.922 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.922 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.922 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.922 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.922 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.922 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.922 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "myobj", 2024-09-12T00:36:12.922 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:12.922 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:12.922 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.922 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.922 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.922 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.923 INFO:tasks.workunit.client.0.smithi073.stdout: "raw_obj": { 2024-09-12T00:36:12.923 INFO:tasks.workunit.client.0.smithi073.stdout: "pool": "default-placement.data", 2024-09-12T00:36:12.923 INFO:tasks.workunit.client.0.smithi073.stdout: "oid": "marker_myobj", 2024-09-12T00:36:12.923 INFO:tasks.workunit.client.0.smithi073.stdout: "loc": "" 2024-09-12T00:36:12.923 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.923 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.923 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.923 INFO:tasks.workunit.client.0.smithi073.stdout: "new_obj": { 2024-09-12T00:36:12.923 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.923 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.923 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.923 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.923 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.924 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.924 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.924 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.924 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.924 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.924 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.924 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.924 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "myobj", 2024-09-12T00:36:12.924 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:12.924 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:12.924 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.924 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.924 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.925 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.925 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.925 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:12.925 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.925 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.925 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.925 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.925 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:12.925 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.925 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:12.925 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.925 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.925 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.926 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.926 INFO:tasks.workunit.client.0.smithi073.stdout: "obj": { 2024-09-12T00:36:12.926 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.926 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:12.926 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.926 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.926 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.926 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.926 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:12.926 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.926 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:12.926 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.926 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.927 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.927 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "myobj", 2024-09-12T00:36:12.927 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:12.927 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:12.927 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.927 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.927 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.927 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.927 INFO:tasks.workunit.client.0.smithi073.stdout: "raw_obj": { 2024-09-12T00:36:12.927 INFO:tasks.workunit.client.0.smithi073.stdout: "pool": ".data-pool", 2024-09-12T00:36:12.927 INFO:tasks.workunit.client.0.smithi073.stdout: "oid": "marker_myobj", 2024-09-12T00:36:12.927 INFO:tasks.workunit.client.0.smithi073.stdout: "loc": "" 2024-09-12T00:36:12.928 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.928 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.928 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.928 INFO:tasks.workunit.client.0.smithi073.stdout: "new_obj": { 2024-09-12T00:36:12.928 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.928 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:12.928 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.928 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.928 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.928 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.928 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:12.928 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.928 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:12.929 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.929 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.929 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.929 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "myobj", 2024-09-12T00:36:12.929 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:12.929 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:12.929 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.929 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.929 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.929 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.929 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.929 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.929 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.930 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.930 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.930 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.930 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.930 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.930 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.930 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.930 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.930 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.930 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.930 INFO:tasks.workunit.client.0.smithi073.stdout: "obj": { 2024-09-12T00:36:12.930 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.930 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.930 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.931 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.931 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.931 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.931 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.931 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.931 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.931 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.931 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.931 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.931 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "myobj", 2024-09-12T00:36:12.931 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:12.931 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "ns" 2024-09-12T00:36:12.931 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.931 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.932 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.932 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.932 INFO:tasks.workunit.client.0.smithi073.stdout: "raw_obj": { 2024-09-12T00:36:12.932 INFO:tasks.workunit.client.0.smithi073.stdout: "pool": "default-placement.data", 2024-09-12T00:36:12.932 INFO:tasks.workunit.client.0.smithi073.stdout: "oid": "marker__ns_myobj", 2024-09-12T00:36:12.932 INFO:tasks.workunit.client.0.smithi073.stdout: "loc": "" 2024-09-12T00:36:12.932 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.932 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.932 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.932 INFO:tasks.workunit.client.0.smithi073.stdout: "new_obj": { 2024-09-12T00:36:12.932 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.932 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.932 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.933 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.933 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.933 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.933 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.933 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.933 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.933 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.933 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.933 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.933 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "myobj", 2024-09-12T00:36:12.933 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:12.933 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "ns" 2024-09-12T00:36:12.933 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.933 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.934 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.934 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.934 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.934 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:12.934 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.934 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.934 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.934 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.934 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:12.934 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.934 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:12.934 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.934 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.935 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.935 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.935 INFO:tasks.workunit.client.0.smithi073.stdout: "obj": { 2024-09-12T00:36:12.935 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.935 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:12.935 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.935 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.935 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.935 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.935 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:12.935 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.935 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:12.935 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.935 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.936 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.936 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "myobj", 2024-09-12T00:36:12.936 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:12.936 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "ns" 2024-09-12T00:36:12.936 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.936 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.936 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.936 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.936 INFO:tasks.workunit.client.0.smithi073.stdout: "raw_obj": { 2024-09-12T00:36:12.936 INFO:tasks.workunit.client.0.smithi073.stdout: "pool": ".data-pool", 2024-09-12T00:36:12.936 INFO:tasks.workunit.client.0.smithi073.stdout: "oid": "marker__ns_myobj", 2024-09-12T00:36:12.936 INFO:tasks.workunit.client.0.smithi073.stdout: "loc": "" 2024-09-12T00:36:12.936 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.937 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.937 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.937 INFO:tasks.workunit.client.0.smithi073.stdout: "new_obj": { 2024-09-12T00:36:12.937 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.937 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:12.937 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.937 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.937 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.937 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.937 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:12.937 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.937 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:12.937 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.938 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.938 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.938 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "myobj", 2024-09-12T00:36:12.938 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:12.938 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "ns" 2024-09-12T00:36:12.938 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.938 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.938 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.938 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.938 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.938 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.938 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.938 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.939 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.939 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.939 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.939 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.939 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.939 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.939 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.939 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.939 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.939 INFO:tasks.workunit.client.0.smithi073.stdout: "obj": { 2024-09-12T00:36:12.939 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.939 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.939 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.939 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.940 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.940 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.940 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.940 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.940 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.940 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.940 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.940 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.940 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "myobj", 2024-09-12T00:36:12.940 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "inst", 2024-09-12T00:36:12.940 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:12.940 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.940 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.941 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.941 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.941 INFO:tasks.workunit.client.0.smithi073.stdout: "raw_obj": { 2024-09-12T00:36:12.941 INFO:tasks.workunit.client.0.smithi073.stdout: "pool": "default-placement.data", 2024-09-12T00:36:12.941 INFO:tasks.workunit.client.0.smithi073.stdout: "oid": "marker__:inst_myobj", 2024-09-12T00:36:12.941 INFO:tasks.workunit.client.0.smithi073.stdout: "loc": "" 2024-09-12T00:36:12.941 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.941 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.941 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.941 INFO:tasks.workunit.client.0.smithi073.stdout: "new_obj": { 2024-09-12T00:36:12.941 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.941 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.942 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.942 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.942 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.942 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.942 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.942 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.942 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.942 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.942 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.942 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.942 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "myobj", 2024-09-12T00:36:12.942 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "inst", 2024-09-12T00:36:12.943 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:12.943 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.943 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.943 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.943 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.943 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.943 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:12.943 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.943 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.943 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.943 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.944 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:12.944 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.944 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:12.944 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.944 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.944 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.944 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.944 INFO:tasks.workunit.client.0.smithi073.stdout: "obj": { 2024-09-12T00:36:12.944 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.944 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:12.944 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.944 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.944 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.945 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.945 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:12.945 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.945 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:12.945 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.945 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.945 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.945 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "myobj", 2024-09-12T00:36:12.945 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "inst", 2024-09-12T00:36:12.945 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:12.945 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.945 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.946 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.946 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.946 INFO:tasks.workunit.client.0.smithi073.stdout: "raw_obj": { 2024-09-12T00:36:12.946 INFO:tasks.workunit.client.0.smithi073.stdout: "pool": ".data-pool", 2024-09-12T00:36:12.946 INFO:tasks.workunit.client.0.smithi073.stdout: "oid": "marker__:inst_myobj", 2024-09-12T00:36:12.946 INFO:tasks.workunit.client.0.smithi073.stdout: "loc": "" 2024-09-12T00:36:12.946 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.946 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.946 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.946 INFO:tasks.workunit.client.0.smithi073.stdout: "new_obj": { 2024-09-12T00:36:12.946 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.946 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:12.946 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.947 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.947 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.947 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.947 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:12.947 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.947 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:12.947 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.947 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.947 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.947 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "myobj", 2024-09-12T00:36:12.947 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "inst", 2024-09-12T00:36:12.947 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:12.947 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.948 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.948 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.948 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.948 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.948 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.948 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.948 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.948 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.948 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.948 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.948 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.948 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.948 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.948 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.949 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.949 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.949 INFO:tasks.workunit.client.0.smithi073.stdout: "obj": { 2024-09-12T00:36:12.949 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.949 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.949 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.949 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.949 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.949 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.949 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.949 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.949 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.949 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.949 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.950 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.950 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "myobj", 2024-09-12T00:36:12.950 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "inst", 2024-09-12T00:36:12.950 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "ns" 2024-09-12T00:36:12.950 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.950 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.950 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.950 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.950 INFO:tasks.workunit.client.0.smithi073.stdout: "raw_obj": { 2024-09-12T00:36:12.951 INFO:tasks.workunit.client.0.smithi073.stdout: "pool": "default-placement.data", 2024-09-12T00:36:12.951 INFO:tasks.workunit.client.0.smithi073.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T00:36:12.951 INFO:tasks.workunit.client.0.smithi073.stdout: "loc": "" 2024-09-12T00:36:12.951 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.951 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.951 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.951 INFO:tasks.workunit.client.0.smithi073.stdout: "new_obj": { 2024-09-12T00:36:12.951 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.951 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.951 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.951 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.951 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.951 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.952 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.952 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.952 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.952 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.952 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.952 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.952 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "myobj", 2024-09-12T00:36:12.952 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "inst", 2024-09-12T00:36:12.952 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "ns" 2024-09-12T00:36:12.952 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.952 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.952 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.952 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.953 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.953 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:12.953 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.953 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.953 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.953 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.953 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:12.953 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.953 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:12.953 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.953 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.953 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.953 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.954 INFO:tasks.workunit.client.0.smithi073.stdout: "obj": { 2024-09-12T00:36:12.954 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.954 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:12.954 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.954 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.954 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.954 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.954 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:12.954 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.954 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:12.954 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.954 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.954 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.954 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "myobj", 2024-09-12T00:36:12.955 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "inst", 2024-09-12T00:36:12.955 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "ns" 2024-09-12T00:36:12.955 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.955 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.955 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.955 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.955 INFO:tasks.workunit.client.0.smithi073.stdout: "raw_obj": { 2024-09-12T00:36:12.955 INFO:tasks.workunit.client.0.smithi073.stdout: "pool": ".data-pool", 2024-09-12T00:36:12.955 INFO:tasks.workunit.client.0.smithi073.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T00:36:12.955 INFO:tasks.workunit.client.0.smithi073.stdout: "loc": "" 2024-09-12T00:36:12.955 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.955 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.956 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.956 INFO:tasks.workunit.client.0.smithi073.stdout: "new_obj": { 2024-09-12T00:36:12.956 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.956 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:12.956 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.956 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.956 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.956 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.956 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:12.956 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.956 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:12.956 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.956 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.956 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.957 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "myobj", 2024-09-12T00:36:12.957 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "inst", 2024-09-12T00:36:12.957 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "ns" 2024-09-12T00:36:12.957 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.957 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.957 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.957 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.957 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.957 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.957 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.957 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.957 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.957 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.958 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.958 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.958 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.958 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.958 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.958 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.958 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.958 INFO:tasks.workunit.client.0.smithi073.stdout: "obj": { 2024-09-12T00:36:12.958 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.958 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.958 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.958 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.958 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.958 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.959 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.959 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.959 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.959 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.959 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.959 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.959 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_myobj", 2024-09-12T00:36:12.959 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:12.959 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:12.959 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.959 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.959 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.959 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.959 INFO:tasks.workunit.client.0.smithi073.stdout: "raw_obj": { 2024-09-12T00:36:12.960 INFO:tasks.workunit.client.0.smithi073.stdout: "pool": "default-placement.data", 2024-09-12T00:36:12.960 INFO:tasks.workunit.client.0.smithi073.stdout: "oid": "marker___myobj", 2024-09-12T00:36:12.960 INFO:tasks.workunit.client.0.smithi073.stdout: "loc": "marker__myobj" 2024-09-12T00:36:12.960 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.960 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.960 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.960 INFO:tasks.workunit.client.0.smithi073.stdout: "new_obj": { 2024-09-12T00:36:12.960 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.960 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.960 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.960 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.960 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.961 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.961 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.961 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.961 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.961 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.961 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.961 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.961 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_myobj", 2024-09-12T00:36:12.961 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:12.961 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:12.961 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.961 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.961 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.961 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.962 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.962 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:12.962 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.962 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.962 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.962 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.962 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:12.962 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.962 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:12.962 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.962 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.962 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.962 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.962 INFO:tasks.workunit.client.0.smithi073.stdout: "obj": { 2024-09-12T00:36:12.963 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.963 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:12.963 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.963 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.963 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.963 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.963 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:12.963 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.963 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:12.963 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.963 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.963 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.963 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_myobj", 2024-09-12T00:36:12.963 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:12.964 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:12.964 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.964 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.964 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.964 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.964 INFO:tasks.workunit.client.0.smithi073.stdout: "raw_obj": { 2024-09-12T00:36:12.964 INFO:tasks.workunit.client.0.smithi073.stdout: "pool": ".data-pool", 2024-09-12T00:36:12.964 INFO:tasks.workunit.client.0.smithi073.stdout: "oid": "marker___myobj", 2024-09-12T00:36:12.964 INFO:tasks.workunit.client.0.smithi073.stdout: "loc": "marker__myobj" 2024-09-12T00:36:12.964 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.964 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.964 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.964 INFO:tasks.workunit.client.0.smithi073.stdout: "new_obj": { 2024-09-12T00:36:12.965 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.965 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:12.965 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.965 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.965 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.965 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.965 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:12.965 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.965 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:12.965 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.965 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.965 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.965 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_myobj", 2024-09-12T00:36:12.965 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:12.965 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:12.966 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.966 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.966 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.966 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.966 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.966 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.966 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.966 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.966 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.966 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.966 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.966 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.966 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.967 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.967 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.967 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.967 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.967 INFO:tasks.workunit.client.0.smithi073.stdout: "obj": { 2024-09-12T00:36:12.967 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.967 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.967 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.967 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.967 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.967 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.967 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.967 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.967 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.968 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.968 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.968 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.968 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_myobj", 2024-09-12T00:36:12.968 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:12.968 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "ns" 2024-09-12T00:36:12.968 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.968 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.968 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.968 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.968 INFO:tasks.workunit.client.0.smithi073.stdout: "raw_obj": { 2024-09-12T00:36:12.968 INFO:tasks.workunit.client.0.smithi073.stdout: "pool": "default-placement.data", 2024-09-12T00:36:12.968 INFO:tasks.workunit.client.0.smithi073.stdout: "oid": "marker__ns__myobj", 2024-09-12T00:36:12.969 INFO:tasks.workunit.client.0.smithi073.stdout: "loc": "" 2024-09-12T00:36:12.969 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.969 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.969 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.969 INFO:tasks.workunit.client.0.smithi073.stdout: "new_obj": { 2024-09-12T00:36:12.969 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.969 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.969 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.969 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.969 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.969 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.969 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.969 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.969 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.970 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.970 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.970 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.970 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_myobj", 2024-09-12T00:36:12.970 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:12.970 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "ns" 2024-09-12T00:36:12.970 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.970 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.970 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.970 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.970 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.970 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:12.970 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.970 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.971 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.971 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.971 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:12.971 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.971 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:12.971 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.971 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.971 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.971 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.971 INFO:tasks.workunit.client.0.smithi073.stdout: "obj": { 2024-09-12T00:36:12.971 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.971 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:12.971 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.971 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.972 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.972 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.972 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:12.972 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.972 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:12.972 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.972 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.972 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.972 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_myobj", 2024-09-12T00:36:12.972 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:12.972 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "ns" 2024-09-12T00:36:12.972 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.972 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.973 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.973 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.973 INFO:tasks.workunit.client.0.smithi073.stdout: "raw_obj": { 2024-09-12T00:36:12.973 INFO:tasks.workunit.client.0.smithi073.stdout: "pool": ".data-pool", 2024-09-12T00:36:12.973 INFO:tasks.workunit.client.0.smithi073.stdout: "oid": "marker__ns__myobj", 2024-09-12T00:36:12.973 INFO:tasks.workunit.client.0.smithi073.stdout: "loc": "" 2024-09-12T00:36:12.973 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.973 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.973 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.973 INFO:tasks.workunit.client.0.smithi073.stdout: "new_obj": { 2024-09-12T00:36:12.973 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.973 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:12.973 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.974 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.974 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.974 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.974 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:12.974 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.974 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:12.974 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.974 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.974 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.974 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_myobj", 2024-09-12T00:36:12.974 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:12.974 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "ns" 2024-09-12T00:36:12.974 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.974 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.975 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.975 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.975 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.975 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.975 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.975 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.975 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.975 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.975 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.975 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.975 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.975 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.975 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.975 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.976 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.976 INFO:tasks.workunit.client.0.smithi073.stdout: "obj": { 2024-09-12T00:36:12.976 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.976 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.976 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.976 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.976 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.976 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.976 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.976 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.976 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.976 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.976 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.977 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.977 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_myobj", 2024-09-12T00:36:12.977 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "inst", 2024-09-12T00:36:12.977 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:12.977 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.977 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.977 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.977 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.977 INFO:tasks.workunit.client.0.smithi073.stdout: "raw_obj": { 2024-09-12T00:36:12.977 INFO:tasks.workunit.client.0.smithi073.stdout: "pool": "default-placement.data", 2024-09-12T00:36:12.977 INFO:tasks.workunit.client.0.smithi073.stdout: "oid": "marker__:inst__myobj", 2024-09-12T00:36:12.977 INFO:tasks.workunit.client.0.smithi073.stdout: "loc": "marker__myobj" 2024-09-12T00:36:12.977 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.977 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.978 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.978 INFO:tasks.workunit.client.0.smithi073.stdout: "new_obj": { 2024-09-12T00:36:12.978 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.978 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.978 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.978 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.978 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.978 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.978 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.978 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.978 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.978 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.978 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.978 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.979 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_myobj", 2024-09-12T00:36:12.979 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "inst", 2024-09-12T00:36:12.979 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:12.979 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.979 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.979 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.979 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.979 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.979 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:12.979 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.979 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.979 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.979 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.980 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:12.980 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.980 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:12.980 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.980 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.980 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.980 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.980 INFO:tasks.workunit.client.0.smithi073.stdout: "obj": { 2024-09-12T00:36:12.980 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.980 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:12.980 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.980 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.980 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.981 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.981 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:12.981 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.981 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:12.981 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.981 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.981 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.981 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_myobj", 2024-09-12T00:36:12.981 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "inst", 2024-09-12T00:36:12.981 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:12.981 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.981 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.981 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.981 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.982 INFO:tasks.workunit.client.0.smithi073.stdout: "raw_obj": { 2024-09-12T00:36:12.982 INFO:tasks.workunit.client.0.smithi073.stdout: "pool": ".data-pool", 2024-09-12T00:36:12.982 INFO:tasks.workunit.client.0.smithi073.stdout: "oid": "marker__:inst__myobj", 2024-09-12T00:36:12.982 INFO:tasks.workunit.client.0.smithi073.stdout: "loc": "marker__myobj" 2024-09-12T00:36:12.982 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.982 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.982 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.982 INFO:tasks.workunit.client.0.smithi073.stdout: "new_obj": { 2024-09-12T00:36:12.982 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.982 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:12.982 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.982 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.982 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.983 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.983 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:12.983 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.983 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:12.983 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.983 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.983 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.983 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_myobj", 2024-09-12T00:36:12.983 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "inst", 2024-09-12T00:36:12.983 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:12.983 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.983 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.983 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.983 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.984 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.984 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.984 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.984 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.984 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.984 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.984 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.984 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.984 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.984 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.984 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.984 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.984 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.985 INFO:tasks.workunit.client.0.smithi073.stdout: "obj": { 2024-09-12T00:36:12.985 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.985 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.985 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.985 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.985 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.985 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.985 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.985 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.985 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.985 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.985 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.985 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.986 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_myobj", 2024-09-12T00:36:12.986 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "inst", 2024-09-12T00:36:12.986 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "ns" 2024-09-12T00:36:12.986 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.986 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.986 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.986 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.986 INFO:tasks.workunit.client.0.smithi073.stdout: "raw_obj": { 2024-09-12T00:36:12.986 INFO:tasks.workunit.client.0.smithi073.stdout: "pool": "default-placement.data", 2024-09-12T00:36:12.986 INFO:tasks.workunit.client.0.smithi073.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T00:36:12.986 INFO:tasks.workunit.client.0.smithi073.stdout: "loc": "" 2024-09-12T00:36:12.986 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.986 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.987 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.987 INFO:tasks.workunit.client.0.smithi073.stdout: "new_obj": { 2024-09-12T00:36:12.987 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.987 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.987 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.987 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.987 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.987 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.987 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.987 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.987 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.987 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.987 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.987 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.988 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_myobj", 2024-09-12T00:36:12.988 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "inst", 2024-09-12T00:36:12.988 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "ns" 2024-09-12T00:36:12.988 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.988 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.988 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.988 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.988 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.988 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:12.988 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.988 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.988 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.989 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.989 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:12.989 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.989 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:12.989 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.989 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.989 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.989 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.989 INFO:tasks.workunit.client.0.smithi073.stdout: "obj": { 2024-09-12T00:36:12.989 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.989 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:12.989 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.989 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.990 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.990 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.990 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:12.990 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.990 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:12.990 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.990 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.990 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.990 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_myobj", 2024-09-12T00:36:12.990 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "inst", 2024-09-12T00:36:12.990 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "ns" 2024-09-12T00:36:12.990 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.990 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.990 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.991 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.991 INFO:tasks.workunit.client.0.smithi073.stdout: "raw_obj": { 2024-09-12T00:36:12.991 INFO:tasks.workunit.client.0.smithi073.stdout: "pool": ".data-pool", 2024-09-12T00:36:12.991 INFO:tasks.workunit.client.0.smithi073.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T00:36:12.991 INFO:tasks.workunit.client.0.smithi073.stdout: "loc": "" 2024-09-12T00:36:12.991 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.991 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.991 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.991 INFO:tasks.workunit.client.0.smithi073.stdout: "new_obj": { 2024-09-12T00:36:12.991 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.991 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:12.991 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.991 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.992 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.992 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.992 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:12.992 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.992 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:12.992 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.992 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.992 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.992 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_myobj", 2024-09-12T00:36:12.992 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "inst", 2024-09-12T00:36:12.992 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "ns" 2024-09-12T00:36:12.992 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.992 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.993 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.993 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.993 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.993 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.993 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.993 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.993 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.993 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.993 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.993 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.993 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.993 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.993 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.993 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.994 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.994 INFO:tasks.workunit.client.0.smithi073.stdout: "obj": { 2024-09-12T00:36:12.994 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.994 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.994 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.994 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.994 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.994 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.994 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.994 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.994 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.994 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.994 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.994 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.995 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_myobj_", 2024-09-12T00:36:12.995 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:12.995 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:12.995 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.995 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.995 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.995 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.995 INFO:tasks.workunit.client.0.smithi073.stdout: "raw_obj": { 2024-09-12T00:36:12.995 INFO:tasks.workunit.client.0.smithi073.stdout: "pool": "default-placement.data", 2024-09-12T00:36:12.995 INFO:tasks.workunit.client.0.smithi073.stdout: "oid": "marker___myobj_", 2024-09-12T00:36:12.995 INFO:tasks.workunit.client.0.smithi073.stdout: "loc": "marker__myobj_" 2024-09-12T00:36:12.995 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.995 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.996 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.996 INFO:tasks.workunit.client.0.smithi073.stdout: "new_obj": { 2024-09-12T00:36:12.996 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.996 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:12.996 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.996 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.996 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.996 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.996 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:12.996 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.996 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:12.996 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.996 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.997 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.997 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_myobj_", 2024-09-12T00:36:12.997 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:12.997 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:12.997 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.997 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.997 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.997 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.997 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.997 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:12.997 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.997 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.997 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.997 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.998 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:12.998 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.998 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:12.998 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.998 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.998 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.998 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.998 INFO:tasks.workunit.client.0.smithi073.stdout: "obj": { 2024-09-12T00:36:12.998 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:12.998 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:12.998 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:12.998 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:12.998 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:12.998 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:12.999 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:12.999 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:12.999 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:12.999 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.999 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:12.999 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:12.999 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_myobj_", 2024-09-12T00:36:12.999 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:12.999 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:12.999 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.999 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:12.999 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:12.999 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:12.999 INFO:tasks.workunit.client.0.smithi073.stdout: "raw_obj": { 2024-09-12T00:36:13.000 INFO:tasks.workunit.client.0.smithi073.stdout: "pool": ".data-pool", 2024-09-12T00:36:13.000 INFO:tasks.workunit.client.0.smithi073.stdout: "oid": "marker___myobj_", 2024-09-12T00:36:13.000 INFO:tasks.workunit.client.0.smithi073.stdout: "loc": "marker__myobj_" 2024-09-12T00:36:13.000 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.000 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.000 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.000 INFO:tasks.workunit.client.0.smithi073.stdout: "new_obj": { 2024-09-12T00:36:13.000 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:13.000 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:13.000 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:13.000 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:13.000 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:13.000 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:13.001 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:13.001 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:13.001 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:13.001 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.001 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:13.001 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:13.001 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_myobj_", 2024-09-12T00:36:13.001 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:13.001 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:13.001 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.001 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.001 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.001 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.001 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:13.002 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:13.002 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:13.002 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:13.002 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:13.002 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:13.002 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:13.002 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:13.002 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:13.002 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.002 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.002 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.002 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.002 INFO:tasks.workunit.client.0.smithi073.stdout: "obj": { 2024-09-12T00:36:13.002 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:13.003 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:13.003 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:13.003 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:13.003 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:13.003 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:13.003 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:13.003 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:13.003 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:13.003 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.003 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:13.003 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:13.003 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_myobj_", 2024-09-12T00:36:13.003 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:13.003 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "ns" 2024-09-12T00:36:13.004 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.004 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.004 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.004 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.004 INFO:tasks.workunit.client.0.smithi073.stdout: "raw_obj": { 2024-09-12T00:36:13.004 INFO:tasks.workunit.client.0.smithi073.stdout: "pool": "default-placement.data", 2024-09-12T00:36:13.004 INFO:tasks.workunit.client.0.smithi073.stdout: "oid": "marker__ns__myobj_", 2024-09-12T00:36:13.004 INFO:tasks.workunit.client.0.smithi073.stdout: "loc": "" 2024-09-12T00:36:13.004 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.004 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.004 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.004 INFO:tasks.workunit.client.0.smithi073.stdout: "new_obj": { 2024-09-12T00:36:13.004 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:13.005 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:13.005 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:13.005 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:13.005 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:13.005 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:13.005 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:13.005 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:13.005 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:13.005 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.005 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:13.005 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:13.005 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_myobj_", 2024-09-12T00:36:13.005 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:13.005 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "ns" 2024-09-12T00:36:13.006 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.006 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.006 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.006 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.006 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:13.006 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:13.006 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:13.006 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:13.006 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:13.006 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:13.006 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:13.006 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:13.006 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:13.007 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.007 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.007 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.007 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.007 INFO:tasks.workunit.client.0.smithi073.stdout: "obj": { 2024-09-12T00:36:13.007 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:13.007 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:13.007 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:13.007 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:13.007 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:13.007 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:13.007 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:13.007 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:13.008 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:13.008 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.008 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:13.008 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:13.008 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_myobj_", 2024-09-12T00:36:13.008 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:13.008 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "ns" 2024-09-12T00:36:13.008 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.008 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.008 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.008 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.008 INFO:tasks.workunit.client.0.smithi073.stdout: "raw_obj": { 2024-09-12T00:36:13.008 INFO:tasks.workunit.client.0.smithi073.stdout: "pool": ".data-pool", 2024-09-12T00:36:13.008 INFO:tasks.workunit.client.0.smithi073.stdout: "oid": "marker__ns__myobj_", 2024-09-12T00:36:13.009 INFO:tasks.workunit.client.0.smithi073.stdout: "loc": "" 2024-09-12T00:36:13.009 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.009 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.009 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.009 INFO:tasks.workunit.client.0.smithi073.stdout: "new_obj": { 2024-09-12T00:36:13.009 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:13.009 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:13.009 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:13.009 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:13.009 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:13.009 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:13.009 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:13.009 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:13.009 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:13.010 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.010 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:13.010 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:13.010 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_myobj_", 2024-09-12T00:36:13.010 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:13.010 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "ns" 2024-09-12T00:36:13.010 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.010 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.010 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.010 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.010 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:13.010 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:13.010 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:13.011 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:13.011 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:13.011 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:13.011 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:13.011 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:13.011 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:13.011 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.011 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.011 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.011 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.011 INFO:tasks.workunit.client.0.smithi073.stdout: "obj": { 2024-09-12T00:36:13.011 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:13.011 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:13.012 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:13.012 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:13.012 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:13.012 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:13.012 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:13.012 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:13.012 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:13.012 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.012 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:13.012 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:13.012 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_myobj_", 2024-09-12T00:36:13.012 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "inst", 2024-09-12T00:36:13.012 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:13.012 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.013 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.013 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.013 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.013 INFO:tasks.workunit.client.0.smithi073.stdout: "raw_obj": { 2024-09-12T00:36:13.013 INFO:tasks.workunit.client.0.smithi073.stdout: "pool": "default-placement.data", 2024-09-12T00:36:13.013 INFO:tasks.workunit.client.0.smithi073.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T00:36:13.013 INFO:tasks.workunit.client.0.smithi073.stdout: "loc": "marker__myobj_" 2024-09-12T00:36:13.013 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.013 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.013 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.013 INFO:tasks.workunit.client.0.smithi073.stdout: "new_obj": { 2024-09-12T00:36:13.013 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:13.013 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:13.014 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:13.014 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:13.014 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:13.014 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:13.014 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:13.014 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:13.014 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:13.014 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.014 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:13.014 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:13.014 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_myobj_", 2024-09-12T00:36:13.014 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "inst", 2024-09-12T00:36:13.014 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:13.014 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.015 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.015 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.015 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.015 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:13.015 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:13.015 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:13.015 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:13.015 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:13.015 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:13.015 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:13.015 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:13.015 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:13.015 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.016 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.016 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.016 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.016 INFO:tasks.workunit.client.0.smithi073.stdout: "obj": { 2024-09-12T00:36:13.016 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:13.016 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:13.016 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:13.016 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:13.016 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:13.017 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:13.017 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:13.017 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:13.017 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:13.017 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.017 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:13.017 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:13.017 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_myobj_", 2024-09-12T00:36:13.017 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "inst", 2024-09-12T00:36:13.017 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:13.017 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.017 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.017 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.018 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.018 INFO:tasks.workunit.client.0.smithi073.stdout: "raw_obj": { 2024-09-12T00:36:13.018 INFO:tasks.workunit.client.0.smithi073.stdout: "pool": ".data-pool", 2024-09-12T00:36:13.018 INFO:tasks.workunit.client.0.smithi073.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T00:36:13.018 INFO:tasks.workunit.client.0.smithi073.stdout: "loc": "marker__myobj_" 2024-09-12T00:36:13.018 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.018 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.018 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.018 INFO:tasks.workunit.client.0.smithi073.stdout: "new_obj": { 2024-09-12T00:36:13.018 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:13.018 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:13.018 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:13.018 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:13.019 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:13.019 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:13.019 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:13.019 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:13.019 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:13.019 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.019 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:13.019 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:13.019 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_myobj_", 2024-09-12T00:36:13.019 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "inst", 2024-09-12T00:36:13.019 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:13.019 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.019 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.019 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.020 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.020 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:13.020 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:13.020 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:13.020 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:13.020 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:13.020 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:13.020 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:13.020 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:13.020 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:13.020 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.020 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.020 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.020 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.021 INFO:tasks.workunit.client.0.smithi073.stdout: "obj": { 2024-09-12T00:36:13.021 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:13.021 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:13.021 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:13.021 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:13.021 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:13.021 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:13.021 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:13.021 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:13.021 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:13.021 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.021 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:13.021 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:13.022 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_myobj_", 2024-09-12T00:36:13.022 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "inst", 2024-09-12T00:36:13.022 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "ns" 2024-09-12T00:36:13.022 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.022 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.022 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.022 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.022 INFO:tasks.workunit.client.0.smithi073.stdout: "raw_obj": { 2024-09-12T00:36:13.022 INFO:tasks.workunit.client.0.smithi073.stdout: "pool": "default-placement.data", 2024-09-12T00:36:13.022 INFO:tasks.workunit.client.0.smithi073.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T00:36:13.022 INFO:tasks.workunit.client.0.smithi073.stdout: "loc": "" 2024-09-12T00:36:13.022 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.022 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.022 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.023 INFO:tasks.workunit.client.0.smithi073.stdout: "new_obj": { 2024-09-12T00:36:13.023 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:13.023 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "test", 2024-09-12T00:36:13.023 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:13.023 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:13.023 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:13.023 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:13.023 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": "", 2024-09-12T00:36:13.023 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:13.023 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": "" 2024-09-12T00:36:13.023 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.023 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:13.023 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:13.023 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_myobj_", 2024-09-12T00:36:13.024 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "inst", 2024-09-12T00:36:13.024 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "ns" 2024-09-12T00:36:13.024 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.024 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.024 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.024 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.024 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:13.024 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:13.024 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:13.024 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:13.024 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:13.024 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:13.025 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:13.025 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:13.025 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:13.025 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.025 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.025 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.025 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.025 INFO:tasks.workunit.client.0.smithi073.stdout: "obj": { 2024-09-12T00:36:13.025 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:13.025 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:13.025 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:13.025 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:13.025 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:13.026 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:13.026 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:13.026 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:13.026 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:13.026 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.026 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:13.026 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:13.026 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_myobj_", 2024-09-12T00:36:13.026 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "inst", 2024-09-12T00:36:13.026 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "ns" 2024-09-12T00:36:13.026 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.026 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.027 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.027 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.027 INFO:tasks.workunit.client.0.smithi073.stdout: "raw_obj": { 2024-09-12T00:36:13.027 INFO:tasks.workunit.client.0.smithi073.stdout: "pool": ".data-pool", 2024-09-12T00:36:13.027 INFO:tasks.workunit.client.0.smithi073.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T00:36:13.027 INFO:tasks.workunit.client.0.smithi073.stdout: "loc": "" 2024-09-12T00:36:13.027 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.027 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.027 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.027 INFO:tasks.workunit.client.0.smithi073.stdout: "new_obj": { 2024-09-12T00:36:13.027 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:13.027 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:13.027 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:13.028 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:13.028 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:13.028 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:13.028 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:13.028 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:13.028 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:13.028 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.028 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:13.028 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:13.028 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_myobj_", 2024-09-12T00:36:13.028 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "inst", 2024-09-12T00:36:13.028 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "ns" 2024-09-12T00:36:13.028 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.028 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.029 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.029 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] TestRGWObj.obj_to_raw (0 ms) 2024-09-12T00:36:13.029 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] TestRGWObj.old_to_raw 2024-09-12T00:36:13.029 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.029 INFO:tasks.workunit.client.0.smithi073.stdout: "raw_obj": { 2024-09-12T00:36:13.029 INFO:tasks.workunit.client.0.smithi073.stdout: "pool": ".data-pool", 2024-09-12T00:36:13.029 INFO:tasks.workunit.client.0.smithi073.stdout: "oid": "marker_myobj", 2024-09-12T00:36:13.029 INFO:tasks.workunit.client.0.smithi073.stdout: "loc": "" 2024-09-12T00:36:13.029 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.029 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.029 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.029 INFO:tasks.workunit.client.0.smithi073.stdout: "new_obj": { 2024-09-12T00:36:13.029 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:13.030 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:13.030 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:13.030 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:13.030 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:13.030 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:13.030 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:13.030 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:13.030 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:13.030 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.030 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:13.030 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:13.030 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "myobj", 2024-09-12T00:36:13.030 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:13.030 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:13.031 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.031 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.031 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.031 INFO:tasks.workunit.client.0.smithi073.stdout:raw=.data-pool:marker_myobj 2024-09-12T00:36:13.031 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.031 INFO:tasks.workunit.client.0.smithi073.stdout: "raw_obj2": { 2024-09-12T00:36:13.031 INFO:tasks.workunit.client.0.smithi073.stdout: "pool": ".data-pool", 2024-09-12T00:36:13.031 INFO:tasks.workunit.client.0.smithi073.stdout: "oid": "marker_myobj", 2024-09-12T00:36:13.031 INFO:tasks.workunit.client.0.smithi073.stdout: "loc": "" 2024-09-12T00:36:13.031 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.031 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.031 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.031 INFO:tasks.workunit.client.0.smithi073.stdout: "new_obj2": { 2024-09-12T00:36:13.031 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:13.031 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:13.032 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:13.032 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:13.032 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:13.032 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:13.032 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:13.032 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:13.032 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:13.032 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.032 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:13.032 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:13.032 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "myobj", 2024-09-12T00:36:13.032 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:13.032 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:13.032 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.033 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.033 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.033 INFO:tasks.workunit.client.0.smithi073.stdout:raw2=.data-pool:marker_myobj 2024-09-12T00:36:13.033 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.033 INFO:tasks.workunit.client.0.smithi073.stdout: "raw_obj": { 2024-09-12T00:36:13.033 INFO:tasks.workunit.client.0.smithi073.stdout: "pool": ".data-pool", 2024-09-12T00:36:13.033 INFO:tasks.workunit.client.0.smithi073.stdout: "oid": "marker__ns_myobj", 2024-09-12T00:36:13.033 INFO:tasks.workunit.client.0.smithi073.stdout: "loc": "" 2024-09-12T00:36:13.033 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.033 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.033 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.033 INFO:tasks.workunit.client.0.smithi073.stdout: "new_obj": { 2024-09-12T00:36:13.033 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:13.034 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:13.034 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:13.034 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:13.034 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:13.034 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:13.034 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:13.034 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:13.034 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:13.034 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.034 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:13.034 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:13.034 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "myobj", 2024-09-12T00:36:13.034 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:13.034 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "ns" 2024-09-12T00:36:13.035 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.035 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.035 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.035 INFO:tasks.workunit.client.0.smithi073.stdout:raw=.data-pool:marker__ns_myobj 2024-09-12T00:36:13.035 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.035 INFO:tasks.workunit.client.0.smithi073.stdout: "raw_obj2": { 2024-09-12T00:36:13.035 INFO:tasks.workunit.client.0.smithi073.stdout: "pool": ".data-pool", 2024-09-12T00:36:13.035 INFO:tasks.workunit.client.0.smithi073.stdout: "oid": "marker__ns_myobj", 2024-09-12T00:36:13.035 INFO:tasks.workunit.client.0.smithi073.stdout: "loc": "" 2024-09-12T00:36:13.035 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.035 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.035 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.035 INFO:tasks.workunit.client.0.smithi073.stdout: "new_obj2": { 2024-09-12T00:36:13.035 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:13.036 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:13.036 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:13.036 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:13.036 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:13.036 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:13.036 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:13.036 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:13.036 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:13.036 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.036 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:13.036 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:13.036 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "myobj", 2024-09-12T00:36:13.036 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:13.037 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "ns" 2024-09-12T00:36:13.037 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.037 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.037 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.037 INFO:tasks.workunit.client.0.smithi073.stdout:raw2=.data-pool:marker__ns_myobj 2024-09-12T00:36:13.037 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.037 INFO:tasks.workunit.client.0.smithi073.stdout: "raw_obj": { 2024-09-12T00:36:13.037 INFO:tasks.workunit.client.0.smithi073.stdout: "pool": ".data-pool", 2024-09-12T00:36:13.037 INFO:tasks.workunit.client.0.smithi073.stdout: "oid": "marker__:inst_myobj", 2024-09-12T00:36:13.037 INFO:tasks.workunit.client.0.smithi073.stdout: "loc": "" 2024-09-12T00:36:13.037 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.037 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.037 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.038 INFO:tasks.workunit.client.0.smithi073.stdout: "new_obj": { 2024-09-12T00:36:13.038 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:13.038 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:13.038 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:13.038 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:13.038 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:13.038 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:13.038 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:13.038 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:13.038 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:13.038 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.038 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:13.038 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:13.039 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "myobj", 2024-09-12T00:36:13.039 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "inst", 2024-09-12T00:36:13.039 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:13.039 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.039 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.039 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.039 INFO:tasks.workunit.client.0.smithi073.stdout:raw=.data-pool:marker__:inst_myobj 2024-09-12T00:36:13.039 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.039 INFO:tasks.workunit.client.0.smithi073.stdout: "raw_obj2": { 2024-09-12T00:36:13.039 INFO:tasks.workunit.client.0.smithi073.stdout: "pool": ".data-pool", 2024-09-12T00:36:13.039 INFO:tasks.workunit.client.0.smithi073.stdout: "oid": "marker__:inst_myobj", 2024-09-12T00:36:13.039 INFO:tasks.workunit.client.0.smithi073.stdout: "loc": "" 2024-09-12T00:36:13.039 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.040 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.040 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.040 INFO:tasks.workunit.client.0.smithi073.stdout: "new_obj2": { 2024-09-12T00:36:13.040 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:13.040 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:13.040 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:13.040 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:13.040 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:13.040 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:13.040 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:13.040 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:13.040 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:13.040 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.040 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:13.041 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:13.041 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "myobj", 2024-09-12T00:36:13.041 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "inst", 2024-09-12T00:36:13.041 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:13.041 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.041 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.041 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.041 INFO:tasks.workunit.client.0.smithi073.stdout:raw2=.data-pool:marker__:inst_myobj 2024-09-12T00:36:13.041 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.041 INFO:tasks.workunit.client.0.smithi073.stdout: "raw_obj": { 2024-09-12T00:36:13.041 INFO:tasks.workunit.client.0.smithi073.stdout: "pool": ".data-pool", 2024-09-12T00:36:13.041 INFO:tasks.workunit.client.0.smithi073.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T00:36:13.041 INFO:tasks.workunit.client.0.smithi073.stdout: "loc": "" 2024-09-12T00:36:13.041 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.042 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.042 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.042 INFO:tasks.workunit.client.0.smithi073.stdout: "new_obj": { 2024-09-12T00:36:13.042 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:13.042 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:13.042 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:13.042 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:13.042 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:13.042 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:13.042 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:13.042 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:13.042 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:13.042 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.042 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:13.043 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:13.043 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "myobj", 2024-09-12T00:36:13.043 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "inst", 2024-09-12T00:36:13.043 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "ns" 2024-09-12T00:36:13.043 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.043 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.043 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.043 INFO:tasks.workunit.client.0.smithi073.stdout:raw=.data-pool:marker__ns:inst_myobj 2024-09-12T00:36:13.043 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.043 INFO:tasks.workunit.client.0.smithi073.stdout: "raw_obj2": { 2024-09-12T00:36:13.043 INFO:tasks.workunit.client.0.smithi073.stdout: "pool": ".data-pool", 2024-09-12T00:36:13.043 INFO:tasks.workunit.client.0.smithi073.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T00:36:13.043 INFO:tasks.workunit.client.0.smithi073.stdout: "loc": "" 2024-09-12T00:36:13.044 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.044 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.044 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.044 INFO:tasks.workunit.client.0.smithi073.stdout: "new_obj2": { 2024-09-12T00:36:13.044 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:13.044 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:13.044 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:13.044 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:13.044 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:13.044 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:13.044 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:13.044 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:13.044 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:13.044 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.045 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:13.045 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:13.045 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "myobj", 2024-09-12T00:36:13.045 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "inst", 2024-09-12T00:36:13.045 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "ns" 2024-09-12T00:36:13.045 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.045 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.045 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.045 INFO:tasks.workunit.client.0.smithi073.stdout:raw2=.data-pool:marker__ns:inst_myobj 2024-09-12T00:36:13.045 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.045 INFO:tasks.workunit.client.0.smithi073.stdout: "raw_obj": { 2024-09-12T00:36:13.045 INFO:tasks.workunit.client.0.smithi073.stdout: "pool": ".data-pool", 2024-09-12T00:36:13.045 INFO:tasks.workunit.client.0.smithi073.stdout: "oid": "marker___myobj", 2024-09-12T00:36:13.045 INFO:tasks.workunit.client.0.smithi073.stdout: "loc": "marker__myobj" 2024-09-12T00:36:13.046 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.046 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.046 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.046 INFO:tasks.workunit.client.0.smithi073.stdout: "new_obj": { 2024-09-12T00:36:13.046 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:13.046 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:13.046 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:13.046 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:13.046 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:13.046 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:13.046 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:13.046 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:13.046 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:13.047 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.047 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:13.047 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:13.047 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_myobj", 2024-09-12T00:36:13.047 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:13.047 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:13.047 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.047 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.047 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.047 INFO:tasks.workunit.client.0.smithi073.stdout:raw=.data-pool:marker___myobj 2024-09-12T00:36:13.047 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.047 INFO:tasks.workunit.client.0.smithi073.stdout: "raw_obj2": { 2024-09-12T00:36:13.047 INFO:tasks.workunit.client.0.smithi073.stdout: "pool": ".data-pool", 2024-09-12T00:36:13.047 INFO:tasks.workunit.client.0.smithi073.stdout: "oid": "marker___myobj", 2024-09-12T00:36:13.048 INFO:tasks.workunit.client.0.smithi073.stdout: "loc": "marker__myobj" 2024-09-12T00:36:13.048 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.048 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.048 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.048 INFO:tasks.workunit.client.0.smithi073.stdout: "new_obj2": { 2024-09-12T00:36:13.048 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:13.048 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:13.048 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:13.048 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:13.048 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:13.048 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:13.048 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:13.048 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:13.049 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:13.049 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.049 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:13.049 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:13.049 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_myobj", 2024-09-12T00:36:13.049 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:13.049 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:13.049 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.049 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.049 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.049 INFO:tasks.workunit.client.0.smithi073.stdout:raw2=.data-pool:marker___myobj 2024-09-12T00:36:13.049 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.049 INFO:tasks.workunit.client.0.smithi073.stdout: "raw_obj": { 2024-09-12T00:36:13.050 INFO:tasks.workunit.client.0.smithi073.stdout: "pool": ".data-pool", 2024-09-12T00:36:13.050 INFO:tasks.workunit.client.0.smithi073.stdout: "oid": "marker__ns__myobj", 2024-09-12T00:36:13.050 INFO:tasks.workunit.client.0.smithi073.stdout: "loc": "" 2024-09-12T00:36:13.050 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.050 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.050 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.050 INFO:tasks.workunit.client.0.smithi073.stdout: "new_obj": { 2024-09-12T00:36:13.050 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:13.050 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:13.050 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:13.050 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:13.051 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:13.051 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:13.051 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:13.051 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:13.051 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:13.051 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.051 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:13.051 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:13.051 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_myobj", 2024-09-12T00:36:13.051 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:13.051 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "ns" 2024-09-12T00:36:13.052 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.052 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.052 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.052 INFO:tasks.workunit.client.0.smithi073.stdout:raw=.data-pool:marker__ns__myobj 2024-09-12T00:36:13.052 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.052 INFO:tasks.workunit.client.0.smithi073.stdout: "raw_obj2": { 2024-09-12T00:36:13.052 INFO:tasks.workunit.client.0.smithi073.stdout: "pool": ".data-pool", 2024-09-12T00:36:13.052 INFO:tasks.workunit.client.0.smithi073.stdout: "oid": "marker__ns__myobj", 2024-09-12T00:36:13.052 INFO:tasks.workunit.client.0.smithi073.stdout: "loc": "" 2024-09-12T00:36:13.052 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.052 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.052 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.053 INFO:tasks.workunit.client.0.smithi073.stdout: "new_obj2": { 2024-09-12T00:36:13.053 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:13.053 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:13.053 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:13.053 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:13.053 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:13.053 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:13.053 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:13.053 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:13.053 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:13.053 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.053 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:13.054 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:13.054 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_myobj", 2024-09-12T00:36:13.054 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:13.054 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "ns" 2024-09-12T00:36:13.054 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.054 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.054 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.054 INFO:tasks.workunit.client.0.smithi073.stdout:raw2=.data-pool:marker__ns__myobj 2024-09-12T00:36:13.054 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.054 INFO:tasks.workunit.client.0.smithi073.stdout: "raw_obj": { 2024-09-12T00:36:13.054 INFO:tasks.workunit.client.0.smithi073.stdout: "pool": ".data-pool", 2024-09-12T00:36:13.054 INFO:tasks.workunit.client.0.smithi073.stdout: "oid": "marker__:inst__myobj", 2024-09-12T00:36:13.054 INFO:tasks.workunit.client.0.smithi073.stdout: "loc": "marker__myobj" 2024-09-12T00:36:13.055 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.055 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.055 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.055 INFO:tasks.workunit.client.0.smithi073.stdout: "new_obj": { 2024-09-12T00:36:13.055 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:13.055 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:13.055 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:13.055 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:13.055 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:13.055 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:13.055 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:13.055 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:13.055 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:13.056 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.056 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:13.056 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:13.056 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_myobj", 2024-09-12T00:36:13.056 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "inst", 2024-09-12T00:36:13.056 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:13.056 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.056 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.056 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.056 INFO:tasks.workunit.client.0.smithi073.stdout:raw=.data-pool:marker__:inst__myobj 2024-09-12T00:36:13.056 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.056 INFO:tasks.workunit.client.0.smithi073.stdout: "raw_obj2": { 2024-09-12T00:36:13.056 INFO:tasks.workunit.client.0.smithi073.stdout: "pool": ".data-pool", 2024-09-12T00:36:13.057 INFO:tasks.workunit.client.0.smithi073.stdout: "oid": "marker__:inst__myobj", 2024-09-12T00:36:13.057 INFO:tasks.workunit.client.0.smithi073.stdout: "loc": "marker__myobj" 2024-09-12T00:36:13.057 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.057 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.057 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.057 INFO:tasks.workunit.client.0.smithi073.stdout: "new_obj2": { 2024-09-12T00:36:13.057 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:13.057 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:13.057 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:13.057 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:13.057 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:13.057 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:13.057 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:13.058 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:13.058 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:13.058 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.058 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:13.058 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:13.058 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_myobj", 2024-09-12T00:36:13.058 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "inst", 2024-09-12T00:36:13.058 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:13.058 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.058 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.058 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.058 INFO:tasks.workunit.client.0.smithi073.stdout:raw2=.data-pool:marker__:inst__myobj 2024-09-12T00:36:13.059 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.059 INFO:tasks.workunit.client.0.smithi073.stdout: "raw_obj": { 2024-09-12T00:36:13.059 INFO:tasks.workunit.client.0.smithi073.stdout: "pool": ".data-pool", 2024-09-12T00:36:13.059 INFO:tasks.workunit.client.0.smithi073.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T00:36:13.059 INFO:tasks.workunit.client.0.smithi073.stdout: "loc": "" 2024-09-12T00:36:13.059 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.059 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.059 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.059 INFO:tasks.workunit.client.0.smithi073.stdout: "new_obj": { 2024-09-12T00:36:13.059 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:13.059 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:13.059 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:13.059 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:13.060 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:13.060 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:13.060 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:13.060 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:13.060 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:13.060 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.060 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:13.060 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:13.060 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_myobj", 2024-09-12T00:36:13.060 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "inst", 2024-09-12T00:36:13.060 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "ns" 2024-09-12T00:36:13.060 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.061 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.061 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.061 INFO:tasks.workunit.client.0.smithi073.stdout:raw=.data-pool:marker__ns:inst__myobj 2024-09-12T00:36:13.061 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.061 INFO:tasks.workunit.client.0.smithi073.stdout: "raw_obj2": { 2024-09-12T00:36:13.061 INFO:tasks.workunit.client.0.smithi073.stdout: "pool": ".data-pool", 2024-09-12T00:36:13.061 INFO:tasks.workunit.client.0.smithi073.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T00:36:13.061 INFO:tasks.workunit.client.0.smithi073.stdout: "loc": "" 2024-09-12T00:36:13.061 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.061 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.061 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.061 INFO:tasks.workunit.client.0.smithi073.stdout: "new_obj2": { 2024-09-12T00:36:13.061 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:13.062 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:13.062 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:13.062 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:13.062 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:13.062 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:13.062 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:13.062 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:13.062 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:13.062 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.062 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:13.062 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:13.062 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_myobj", 2024-09-12T00:36:13.062 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "inst", 2024-09-12T00:36:13.062 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "ns" 2024-09-12T00:36:13.063 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.063 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.063 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.063 INFO:tasks.workunit.client.0.smithi073.stdout:raw2=.data-pool:marker__ns:inst__myobj 2024-09-12T00:36:13.063 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.063 INFO:tasks.workunit.client.0.smithi073.stdout: "raw_obj": { 2024-09-12T00:36:13.063 INFO:tasks.workunit.client.0.smithi073.stdout: "pool": ".data-pool", 2024-09-12T00:36:13.063 INFO:tasks.workunit.client.0.smithi073.stdout: "oid": "marker___myobj_", 2024-09-12T00:36:13.063 INFO:tasks.workunit.client.0.smithi073.stdout: "loc": "marker__myobj_" 2024-09-12T00:36:13.063 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.063 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.063 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.063 INFO:tasks.workunit.client.0.smithi073.stdout: "new_obj": { 2024-09-12T00:36:13.063 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:13.063 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:13.064 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:13.064 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:13.064 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:13.064 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:13.064 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:13.064 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:13.064 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:13.064 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.064 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:13.064 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:13.064 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_myobj_", 2024-09-12T00:36:13.064 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:13.064 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:13.065 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.065 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.065 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.065 INFO:tasks.workunit.client.0.smithi073.stdout:raw=.data-pool:marker___myobj_ 2024-09-12T00:36:13.065 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.065 INFO:tasks.workunit.client.0.smithi073.stdout: "raw_obj2": { 2024-09-12T00:36:13.065 INFO:tasks.workunit.client.0.smithi073.stdout: "pool": ".data-pool", 2024-09-12T00:36:13.065 INFO:tasks.workunit.client.0.smithi073.stdout: "oid": "marker___myobj_", 2024-09-12T00:36:13.065 INFO:tasks.workunit.client.0.smithi073.stdout: "loc": "marker__myobj_" 2024-09-12T00:36:13.065 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.065 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.065 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.065 INFO:tasks.workunit.client.0.smithi073.stdout: "new_obj2": { 2024-09-12T00:36:13.066 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:13.066 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:13.066 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:13.066 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:13.066 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:13.066 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:13.066 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:13.066 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:13.066 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:13.066 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.066 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:13.066 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:13.066 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_myobj_", 2024-09-12T00:36:13.066 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:13.066 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:13.067 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.067 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.067 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.067 INFO:tasks.workunit.client.0.smithi073.stdout:raw2=.data-pool:marker___myobj_ 2024-09-12T00:36:13.067 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.067 INFO:tasks.workunit.client.0.smithi073.stdout: "raw_obj": { 2024-09-12T00:36:13.067 INFO:tasks.workunit.client.0.smithi073.stdout: "pool": ".data-pool", 2024-09-12T00:36:13.067 INFO:tasks.workunit.client.0.smithi073.stdout: "oid": "marker__ns__myobj_", 2024-09-12T00:36:13.067 INFO:tasks.workunit.client.0.smithi073.stdout: "loc": "" 2024-09-12T00:36:13.067 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.067 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.067 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.067 INFO:tasks.workunit.client.0.smithi073.stdout: "new_obj": { 2024-09-12T00:36:13.068 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:13.068 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:13.068 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:13.068 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:13.068 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:13.068 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:13.068 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:13.068 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:13.068 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:13.068 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.068 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:13.068 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:13.068 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_myobj_", 2024-09-12T00:36:13.069 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:13.069 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "ns" 2024-09-12T00:36:13.069 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.069 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.069 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.069 INFO:tasks.workunit.client.0.smithi073.stdout:raw=.data-pool:marker__ns__myobj_ 2024-09-12T00:36:13.069 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.069 INFO:tasks.workunit.client.0.smithi073.stdout: "raw_obj2": { 2024-09-12T00:36:13.069 INFO:tasks.workunit.client.0.smithi073.stdout: "pool": ".data-pool", 2024-09-12T00:36:13.069 INFO:tasks.workunit.client.0.smithi073.stdout: "oid": "marker__ns__myobj_", 2024-09-12T00:36:13.069 INFO:tasks.workunit.client.0.smithi073.stdout: "loc": "" 2024-09-12T00:36:13.069 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.070 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.070 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.070 INFO:tasks.workunit.client.0.smithi073.stdout: "new_obj2": { 2024-09-12T00:36:13.070 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:13.070 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:13.070 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:13.070 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:13.070 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:13.070 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:13.070 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:13.070 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:13.070 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:13.070 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.071 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:13.071 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:13.071 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_myobj_", 2024-09-12T00:36:13.071 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "", 2024-09-12T00:36:13.071 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "ns" 2024-09-12T00:36:13.071 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.071 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.071 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.071 INFO:tasks.workunit.client.0.smithi073.stdout:raw2=.data-pool:marker__ns__myobj_ 2024-09-12T00:36:13.071 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.071 INFO:tasks.workunit.client.0.smithi073.stdout: "raw_obj": { 2024-09-12T00:36:13.071 INFO:tasks.workunit.client.0.smithi073.stdout: "pool": ".data-pool", 2024-09-12T00:36:13.071 INFO:tasks.workunit.client.0.smithi073.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T00:36:13.072 INFO:tasks.workunit.client.0.smithi073.stdout: "loc": "marker__myobj_" 2024-09-12T00:36:13.072 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.072 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.072 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.072 INFO:tasks.workunit.client.0.smithi073.stdout: "new_obj": { 2024-09-12T00:36:13.072 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:13.072 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:13.072 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:13.072 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:13.072 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:13.072 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:13.072 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:13.073 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:13.073 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:13.073 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.073 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:13.073 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:13.073 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_myobj_", 2024-09-12T00:36:13.073 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "inst", 2024-09-12T00:36:13.073 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:13.073 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.073 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.073 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.073 INFO:tasks.workunit.client.0.smithi073.stdout:raw=.data-pool:marker__:inst__myobj_ 2024-09-12T00:36:13.073 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.074 INFO:tasks.workunit.client.0.smithi073.stdout: "raw_obj2": { 2024-09-12T00:36:13.074 INFO:tasks.workunit.client.0.smithi073.stdout: "pool": ".data-pool", 2024-09-12T00:36:13.074 INFO:tasks.workunit.client.0.smithi073.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T00:36:13.074 INFO:tasks.workunit.client.0.smithi073.stdout: "loc": "marker__myobj_" 2024-09-12T00:36:13.074 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.074 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.074 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.074 INFO:tasks.workunit.client.0.smithi073.stdout: "new_obj2": { 2024-09-12T00:36:13.074 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:13.074 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:13.074 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:13.074 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:13.075 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:13.075 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:13.075 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:13.075 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:13.075 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:13.075 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.075 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:13.075 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:13.075 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_myobj_", 2024-09-12T00:36:13.075 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "inst", 2024-09-12T00:36:13.075 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "" 2024-09-12T00:36:13.075 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.075 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.075 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.076 INFO:tasks.workunit.client.0.smithi073.stdout:raw2=.data-pool:marker__:inst__myobj_ 2024-09-12T00:36:13.076 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.076 INFO:tasks.workunit.client.0.smithi073.stdout: "raw_obj": { 2024-09-12T00:36:13.076 INFO:tasks.workunit.client.0.smithi073.stdout: "pool": ".data-pool", 2024-09-12T00:36:13.076 INFO:tasks.workunit.client.0.smithi073.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T00:36:13.076 INFO:tasks.workunit.client.0.smithi073.stdout: "loc": "" 2024-09-12T00:36:13.076 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.076 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.076 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.076 INFO:tasks.workunit.client.0.smithi073.stdout: "new_obj": { 2024-09-12T00:36:13.076 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:13.076 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:13.077 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:13.077 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:13.077 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:13.077 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:13.077 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:13.077 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:13.077 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:13.077 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.077 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:13.077 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:13.077 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_myobj_", 2024-09-12T00:36:13.077 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "inst", 2024-09-12T00:36:13.077 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "ns" 2024-09-12T00:36:13.077 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.078 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.078 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.078 INFO:tasks.workunit.client.0.smithi073.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2024-09-12T00:36:13.078 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.078 INFO:tasks.workunit.client.0.smithi073.stdout: "raw_obj2": { 2024-09-12T00:36:13.078 INFO:tasks.workunit.client.0.smithi073.stdout: "pool": ".data-pool", 2024-09-12T00:36:13.078 INFO:tasks.workunit.client.0.smithi073.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T00:36:13.078 INFO:tasks.workunit.client.0.smithi073.stdout: "loc": "" 2024-09-12T00:36:13.078 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.078 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.078 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.078 INFO:tasks.workunit.client.0.smithi073.stdout: "new_obj2": { 2024-09-12T00:36:13.078 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket": { 2024-09-12T00:36:13.078 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "ebtest", 2024-09-12T00:36:13.079 INFO:tasks.workunit.client.0.smithi073.stdout: "marker": "marker", 2024-09-12T00:36:13.079 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_id": "bucket-id", 2024-09-12T00:36:13.079 INFO:tasks.workunit.client.0.smithi073.stdout: "tenant": "", 2024-09-12T00:36:13.079 INFO:tasks.workunit.client.0.smithi073.stdout: "explicit_placement": { 2024-09-12T00:36:13.079 INFO:tasks.workunit.client.0.smithi073.stdout: "data_pool": ".data-pool", 2024-09-12T00:36:13.079 INFO:tasks.workunit.client.0.smithi073.stdout: "data_extra_pool": "", 2024-09-12T00:36:13.079 INFO:tasks.workunit.client.0.smithi073.stdout: "index_pool": ".index-pool" 2024-09-12T00:36:13.079 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.079 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:13.079 INFO:tasks.workunit.client.0.smithi073.stdout: "key": { 2024-09-12T00:36:13.079 INFO:tasks.workunit.client.0.smithi073.stdout: "name": "_myobj_", 2024-09-12T00:36:13.079 INFO:tasks.workunit.client.0.smithi073.stdout: "instance": "inst", 2024-09-12T00:36:13.079 INFO:tasks.workunit.client.0.smithi073.stdout: "ns": "ns" 2024-09-12T00:36:13.079 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.079 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.080 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.080 INFO:tasks.workunit.client.0.smithi073.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2024-09-12T00:36:13.080 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] TestRGWObj.old_to_raw (0 ms) 2024-09-12T00:36:13.080 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 4 tests from TestRGWObj (0 ms total) 2024-09-12T00:36:13.080 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-09-12T00:36:13.080 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment tear-down 2024-09-12T00:36:13.080 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] 4 tests from 1 test suite ran. (0 ms total) 2024-09-12T00:36:13.080 INFO:tasks.workunit.client.0.smithi073.stdout:[ PASSED ] 4 tests. 2024-09-12T00:36:13.080 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:36:13.080 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:36:13.120 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2024-09-12T00:36:13.121 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2024-09-12T00:36:13.122 DEBUG:teuthology.orchestra.run.smithi073:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-09-12T00:36:13.235 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:13.235 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:13.272 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.273+0000 7fce30840800 20 rados->read ofs=0 len=0 2024-09-12T00:36:13.273 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.274+0000 7fce30840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:13.273 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.274+0000 7fce30840800 20 realm 2024-09-12T00:36:13.273 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.274+0000 7fce30840800 20 rados->read ofs=0 len=0 2024-09-12T00:36:13.273 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.275+0000 7fce30840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:13.273 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.275+0000 7fce30840800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:13.274 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.275+0000 7fce30840800 20 rados->read ofs=0 len=0 2024-09-12T00:36:13.274 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.275+0000 7fce30840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:13.274 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.275+0000 7fce30840800 20 rados->read ofs=0 len=0 2024-09-12T00:36:13.274 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.276+0000 7fce30840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:13.274 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.276+0000 7fce30840800 20 rados->read ofs=0 len=0 2024-09-12T00:36:13.275 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.277+0000 7fce30840800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:13.275 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.277+0000 7fce30840800 20 searching for the correct realm 2024-09-12T00:36:13.287 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.289+0000 7fce2eb2b640 0 -- 172.21.15.73:0/2126509103 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fce1800b040 msgr2=0x7fce18051940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:13.496 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.496+0000 7fce2eb2b640 0 -- 172.21.15.73:0/2126509103 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fce1800b040 msgr2=0x7fce18051940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:13.499 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.501+0000 7fce30840800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:36:13.500 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.501+0000 7fce30840800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:13.500 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.501+0000 7fce30840800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:36:13.500 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.501+0000 7fce30840800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:13.500 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.501+0000 7fce30840800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:13.500 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.501+0000 7fce30840800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:13.500 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.501+0000 7fce30840800 20 rados->read ofs=0 len=0 2024-09-12T00:36:13.500 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.501+0000 7fce30840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:13.500 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.501+0000 7fce30840800 20 rados->read ofs=0 len=0 2024-09-12T00:36:13.501 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.502+0000 7fce30840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:13.502 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.502+0000 7fce30840800 20 rados->read ofs=0 len=0 2024-09-12T00:36:13.502 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.502+0000 7fce30840800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:13.502 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.502+0000 7fce30840800 20 zone default found 2024-09-12T00:36:13.502 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.502+0000 7fce30840800 4 Realm: () 2024-09-12T00:36:13.502 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.502+0000 7fce30840800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:36:13.502 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.502+0000 7fce30840800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:36:13.502 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.502+0000 7fce30840800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:13.502 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.502+0000 7fce30840800 20 zonegroup default 2024-09-12T00:36:13.502 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.502+0000 7fce30840800 20 rados->read ofs=0 len=0 2024-09-12T00:36:13.502 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.502+0000 7fce30840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:13.502 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.502+0000 7fce30840800 20 rados->read ofs=0 len=0 2024-09-12T00:36:13.502 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.502+0000 7fce30840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:13.503 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.502+0000 7fce30840800 20 rados->read ofs=0 len=0 2024-09-12T00:36:13.503 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.503+0000 7fce30840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:13.503 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.503+0000 7fce30840800 20 started sync module instance, tier type = 2024-09-12T00:36:13.503 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.503+0000 7fce30840800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:36:13.511 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.513+0000 7fce30840800 20 add_watcher() i=0 2024-09-12T00:36:13.511 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.513+0000 7fce30840800 20 add_watcher() i=1 2024-09-12T00:36:13.511 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.513+0000 7fce30840800 20 add_watcher() i=2 2024-09-12T00:36:13.512 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.513+0000 7fce30840800 20 add_watcher() i=3 2024-09-12T00:36:13.512 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.513+0000 7fce30840800 20 add_watcher() i=4 2024-09-12T00:36:13.512 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.513+0000 7fce30840800 20 add_watcher() i=5 2024-09-12T00:36:13.512 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.513+0000 7fce30840800 20 add_watcher() i=6 2024-09-12T00:36:13.513 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.514+0000 7fce30840800 20 add_watcher() i=7 2024-09-12T00:36:13.513 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.514+0000 7fce30840800 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:13.515 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.516+0000 7fcce4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:13.516 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.517+0000 7fce30840800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:13.516 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.517+0000 7fce30840800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:13.516 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.517+0000 7fce30840800 5 note: GC not initialized 2024-09-12T00:36:13.516 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.517+0000 7fcc5f7fe640 20 reqs_thread_entry: start 2024-09-12T00:36:13.516 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.517+0000 7fce30840800 20 init_complete bucket index max shards: 1 2024-09-12T00:36:13.516 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.517+0000 7fce30840800 20 Filter name: none 2024-09-12T00:36:13.516 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.517+0000 7fcc5d7fa640 20 reqs_thread_entry: start 2024-09-12T00:36:13.516 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.517+0000 7fce30840800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2024-09-12T00:36:13.516 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.517+0000 7fce30840800 20 rados->read ofs=0 len=0 2024-09-12T00:36:13.517 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.518+0000 7fce30840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:13.517 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.518+0000 7fce30840800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2024-09-12T00:36:13.518 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.518+0000 7fce30840800 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T00:36:13.518 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.518+0000 7fce30840800 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2024-09-12T00:36:13.518 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.518+0000 7fce30840800 20 rados->read ofs=0 len=0 2024-09-12T00:36:13.518 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.518+0000 7fce30840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:13.518 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.518+0000 7fce30840800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2024-09-12T00:36:13.518 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.518+0000 7fce30840800 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T00:36:13.518 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.518+0000 7fce30840800 10 cache get: name=default.rgw.meta+users.keys+iQQISZpdTBufyO/u/mrX+4YvJOc= : miss 2024-09-12T00:36:13.518 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.518+0000 7fce30840800 20 rados->read ofs=0 len=0 2024-09-12T00:36:13.518 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.518+0000 7fce30840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:13.518 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.518+0000 7fce30840800 10 cache put: name=default.rgw.meta+users.keys+iQQISZpdTBufyO/u/mrX+4YvJOc= info.flags=0x0 2024-09-12T00:36:13.518 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.518+0000 7fce30840800 10 adding default.rgw.meta+users.keys+iQQISZpdTBufyO/u/mrX+4YvJOc= to cache LRU end 2024-09-12T00:36:13.519 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.518+0000 7fce30840800 10 cache get: name=default.rgw.meta+users.keys+iQQISZpdTBufyO/u/mrX+4YvJOc= : hit (negative entry) 2024-09-12T00:36:13.519 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.518+0000 7fce30840800 10 cache get: name=default.rgw.meta+users.keys+iQQISZpdTBufyO/u/mrX+4YvJOc= : hit (negative entry) 2024-09-12T00:36:13.519 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.519+0000 7fce30840800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-12T00:36:13.519 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.519+0000 7fce30840800 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T00:36:13.519 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.519+0000 7fce30840800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2024-09-12T00:36:13.520 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.520+0000 7fcd11ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856705 cookie 94641142326240 notifier 5330 bl.length()=697 2024-09-12T00:36:13.520 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.520+0000 7fcd11ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-12T00:36:13.520 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.520+0000 7fcd11ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T00:36:13.521 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.523+0000 7fce30840800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-12T00:36:13.522 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.523+0000 7fce30840800 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T00:36:13.522 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.523+0000 7fce30840800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2024-09-12T00:36:13.522 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.523+0000 7fcd11ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856704 cookie 94641142322560 notifier 5330 bl.length()=194 2024-09-12T00:36:13.522 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.523+0000 7fcd11ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-12T00:36:13.522 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.523+0000 7fcd11ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T00:36:13.525 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.527+0000 7fce30840800 10 cache put: name=default.rgw.meta+users.keys+iQQISZpdTBufyO/u/mrX+4YvJOc= info.flags=0x7 2024-09-12T00:36:13.525 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.527+0000 7fce30840800 10 moving default.rgw.meta+users.keys+iQQISZpdTBufyO/u/mrX+4YvJOc= to cache LRU end 2024-09-12T00:36:13.525 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.527+0000 7fce30840800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:iQQISZpdTBufyO/u/mrX+4YvJOc=, ofs0, ns] 2024-09-12T00:36:13.526 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.527+0000 7fcd11ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856706 cookie 94641142326240 notifier 5330 bl.length()=203 2024-09-12T00:36:13.526 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.527+0000 7fcd11ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+iQQISZpdTBufyO/u/mrX+4YvJOc= info.flags=0x7 2024-09-12T00:36:13.526 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.527+0000 7fcd11ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+iQQISZpdTBufyO/u/mrX+4YvJOc= to cache LRU end 2024-09-12T00:36:13.527 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:36:13.527 INFO:tasks.workunit.client.0.smithi073.stdout: "user_id": "ceph-test-librgw-file", 2024-09-12T00:36:13.527 INFO:tasks.workunit.client.0.smithi073.stdout: "display_name": "librgw test user", 2024-09-12T00:36:13.527 INFO:tasks.workunit.client.0.smithi073.stdout: "email": "librgw@example.com", 2024-09-12T00:36:13.527 INFO:tasks.workunit.client.0.smithi073.stdout: "suspended": 0, 2024-09-12T00:36:13.527 INFO:tasks.workunit.client.0.smithi073.stdout: "max_buckets": 1000, 2024-09-12T00:36:13.527 INFO:tasks.workunit.client.0.smithi073.stdout: "subusers": [], 2024-09-12T00:36:13.527 INFO:tasks.workunit.client.0.smithi073.stdout: "keys": [ 2024-09-12T00:36:13.528 INFO:tasks.workunit.client.0.smithi073.stdout: { 2024-09-12T00:36:13.528 INFO:tasks.workunit.client.0.smithi073.stdout: "user": "ceph-test-librgw-file", 2024-09-12T00:36:13.528 INFO:tasks.workunit.client.0.smithi073.stdout: "access_key": "iQQISZpdTBufyO/u/mrX+4YvJOc=", 2024-09-12T00:36:13.528 INFO:tasks.workunit.client.0.smithi073.stdout: "secret_key": "lLDuJOIAn3IDJALPq+7DNpqXRmmWI4ZCtD9oTrAFX43BOfWDkJXhyQ==", 2024-09-12T00:36:13.528 INFO:tasks.workunit.client.0.smithi073.stdout: "active": true, 2024-09-12T00:36:13.528 INFO:tasks.workunit.client.0.smithi073.stdout: "create_date": "2024-09-12T00:36:13.519349Z" 2024-09-12T00:36:13.528 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:36:13.528 INFO:tasks.workunit.client.0.smithi073.stdout: ], 2024-09-12T00:36:13.528 INFO:tasks.workunit.client.0.smithi073.stdout: "swift_keys": [], 2024-09-12T00:36:13.528 INFO:tasks.workunit.client.0.smithi073.stdout: "caps": [], 2024-09-12T00:36:13.528 INFO:tasks.workunit.client.0.smithi073.stdout: "op_mask": "read, write, delete", 2024-09-12T00:36:13.528 INFO:tasks.workunit.client.0.smithi073.stdout: "default_placement": "", 2024-09-12T00:36:13.528 INFO:tasks.workunit.client.0.smithi073.stdout: "default_storage_class": "", 2024-09-12T00:36:13.529 INFO:tasks.workunit.client.0.smithi073.stdout: "placement_tags": [], 2024-09-12T00:36:13.529 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_quota": { 2024-09-12T00:36:13.529 INFO:tasks.workunit.client.0.smithi073.stdout: "enabled": false, 2024-09-12T00:36:13.529 INFO:tasks.workunit.client.0.smithi073.stdout: "check_on_raw": false, 2024-09-12T00:36:13.529 INFO:tasks.workunit.client.0.smithi073.stdout: "max_size": -1, 2024-09-12T00:36:13.529 INFO:tasks.workunit.client.0.smithi073.stdout: "max_size_kb": 0, 2024-09-12T00:36:13.529 INFO:tasks.workunit.client.0.smithi073.stdout: "max_objects": -1 2024-09-12T00:36:13.529 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:13.529 INFO:tasks.workunit.client.0.smithi073.stdout: "user_quota": { 2024-09-12T00:36:13.529 INFO:tasks.workunit.client.0.smithi073.stdout: "enabled": false, 2024-09-12T00:36:13.529 INFO:tasks.workunit.client.0.smithi073.stdout: "check_on_raw": false, 2024-09-12T00:36:13.529 INFO:tasks.workunit.client.0.smithi073.stdout: "max_size": -1, 2024-09-12T00:36:13.529 INFO:tasks.workunit.client.0.smithi073.stdout: "max_size_kb": 0, 2024-09-12T00:36:13.530 INFO:tasks.workunit.client.0.smithi073.stdout: "max_objects": -1 2024-09-12T00:36:13.530 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:36:13.530 INFO:tasks.workunit.client.0.smithi073.stdout: "temp_url_keys": [], 2024-09-12T00:36:13.530 INFO:tasks.workunit.client.0.smithi073.stdout: "type": "rgw", 2024-09-12T00:36:13.530 INFO:tasks.workunit.client.0.smithi073.stdout: "mfa_ids": [], 2024-09-12T00:36:13.530 INFO:tasks.workunit.client.0.smithi073.stdout: "account_id": "", 2024-09-12T00:36:13.530 INFO:tasks.workunit.client.0.smithi073.stdout: "path": "/", 2024-09-12T00:36:13.530 INFO:tasks.workunit.client.0.smithi073.stdout: "create_date": "2024-09-12T00:36:13.519337Z", 2024-09-12T00:36:13.530 INFO:tasks.workunit.client.0.smithi073.stdout: "tags": [], 2024-09-12T00:36:13.530 INFO:tasks.workunit.client.0.smithi073.stdout: "group_ids": [] 2024-09-12T00:36:13.530 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:36:13.530 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-09-12T00:36:13.531 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.529+0000 7fcce4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:13.531 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.531+0000 7fce30840800 20 remove_watcher() i=0 2024-09-12T00:36:13.531 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.531+0000 7fce30840800 2 removed watcher, disabling cache 2024-09-12T00:36:13.531 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.532+0000 7fce30840800 20 remove_watcher() i=1 2024-09-12T00:36:13.532 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.533+0000 7fce30840800 20 remove_watcher() i=2 2024-09-12T00:36:13.533 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.535+0000 7fce30840800 20 remove_watcher() i=3 2024-09-12T00:36:13.534 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.535+0000 7fce30840800 20 remove_watcher() i=4 2024-09-12T00:36:13.535 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.536+0000 7fce30840800 20 remove_watcher() i=5 2024-09-12T00:36:13.536 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.537+0000 7fce30840800 20 remove_watcher() i=6 2024-09-12T00:36:13.537 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:13.538+0000 7fce30840800 20 remove_watcher() i=7 2024-09-12T00:36:13.547 INFO:tasks.workunit.client.0.smithi073.stdout:phase 1.1 2024-09-12T00:36:13.569 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T00:36:13.569 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment set-up. 2024-09-12T00:36:13.569 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 24 tests from LibRGW 2024-09-12T00:36:13.569 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:36:13.580 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:13.580 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:13.955 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.INIT (387 ms) 2024-09-12T00:36:13.956 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T00:36:13.956 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-12T00:36:13.957 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:36:13.957 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T00:36:13.957 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T00:36:13.967 INFO:tasks.workunit.client.0.smithi073.stdout:creating: nfsroot:foo/bar/baz/quux 2024-09-12T00:36:13.971 INFO:tasks.workunit.client.0.smithi073.stdout:creating: nfsroot:foo/f1 2024-09-12T00:36:13.975 INFO:tasks.workunit.client.0.smithi073.stdout:creating: nfsroot:foo/f2 2024-09-12T00:36:13.978 INFO:tasks.workunit.client.0.smithi073.stdout:creating: nfsroot:foo/bar/f1 2024-09-12T00:36:13.982 INFO:tasks.workunit.client.0.smithi073.stdout:creating: nfsroot:foo/bar/d1/ 2024-09-12T00:36:13.985 INFO:tasks.workunit.client.0.smithi073.stdout:creating: nfsroot:foo/bar/baz/hungry 2024-09-12T00:36:13.987 INFO:tasks.workunit.client.0.smithi073.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2024-09-12T00:36:13.990 INFO:tasks.workunit.client.0.smithi073.stdout:creating: nfsroot:foo/bar/baz/momma 2024-09-12T00:36:13.993 INFO:tasks.workunit.client.0.smithi073.stdout:creating: nfsroot:foo/bar/baz/bear/ 2024-09-12T00:36:13.995 INFO:tasks.workunit.client.0.smithi073.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2024-09-12T00:36:13.998 INFO:tasks.workunit.client.0.smithi073.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2024-09-12T00:36:14.001 INFO:tasks.workunit.client.0.smithi073.stdout:creating: nfsroot:foo/bar/baz/frobozz 2024-09-12T00:36:14.004 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.SETUP_HIER1 (47 ms) 2024-09-12T00:36:14.004 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T00:36:14.096 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.SETUP_DIRS1 (92 ms) 2024-09-12T00:36:14.096 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T00:36:14.096 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T00:36:14.096 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T00:36:14.113 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (14 ms) 2024-09-12T00:36:14.113 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T00:36:14.148 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (38 ms) 2024-09-12T00:36:14.149 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T00:36:14.149 INFO:tasks.workunit.client.0.smithi073.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2024-09-12T00:36:14.154 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (6 ms) 2024-09-12T00:36:14.154 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T00:36:14.154 INFO:tasks.workunit.client.0.smithi073.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2024-09-12T00:36:14.160 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (6 ms) 2024-09-12T00:36:14.160 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T00:36:14.160 INFO:tasks.workunit.client.0.smithi073.stdout:scanning objects in /bdirs1/dir_0 2024-09-12T00:36:14.160 INFO:tasks.workunit.client.0.smithi073.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:36:14.160 INFO:tasks.workunit.client.0.smithi073.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:36:14.161 INFO:tasks.workunit.client.0.smithi073.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:36:14.161 INFO:tasks.workunit.client.0.smithi073.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:36:14.161 INFO:tasks.workunit.client.0.smithi073.stdout:scanning objects in /bdirs1/dir_1 2024-09-12T00:36:14.161 INFO:tasks.workunit.client.0.smithi073.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:36:14.161 INFO:tasks.workunit.client.0.smithi073.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:36:14.161 INFO:tasks.workunit.client.0.smithi073.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:36:14.161 INFO:tasks.workunit.client.0.smithi073.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:36:14.161 INFO:tasks.workunit.client.0.smithi073.stdout:scanning objects in /bdirs1/dir_2 2024-09-12T00:36:14.161 INFO:tasks.workunit.client.0.smithi073.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:36:14.161 INFO:tasks.workunit.client.0.smithi073.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:36:14.161 INFO:tasks.workunit.client.0.smithi073.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:36:14.161 INFO:tasks.workunit.client.0.smithi073.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:36:14.161 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T00:36:14.161 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T00:36:14.162 INFO:tasks.workunit.client.0.smithi073.stdout:read back objects in /bdirs1/dir_0 2024-09-12T00:36:14.162 INFO:tasks.workunit.client.0.smithi073.stdout:reading 0,256 dir_0/sfile_0 2024-09-12T00:36:14.162 INFO:tasks.workunit.client.0.smithi073.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:36:14.162 INFO:tasks.workunit.client.0.smithi073.stdout:reading 0,256 dir_0/sfile_1 2024-09-12T00:36:14.162 INFO:tasks.workunit.client.0.smithi073.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:36:14.162 INFO:tasks.workunit.client.0.smithi073.stdout:read back objects in /bdirs1/dir_1 2024-09-12T00:36:14.162 INFO:tasks.workunit.client.0.smithi073.stdout:reading 0,256 dir_1/sfile_0 2024-09-12T00:36:14.163 INFO:tasks.workunit.client.0.smithi073.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:36:14.163 INFO:tasks.workunit.client.0.smithi073.stdout:reading 0,256 dir_1/sfile_1 2024-09-12T00:36:14.164 INFO:tasks.workunit.client.0.smithi073.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:36:14.164 INFO:tasks.workunit.client.0.smithi073.stdout:read back objects in /bdirs1/dir_2 2024-09-12T00:36:14.164 INFO:tasks.workunit.client.0.smithi073.stdout:reading 0,256 dir_2/sfile_0 2024-09-12T00:36:14.165 INFO:tasks.workunit.client.0.smithi073.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:36:14.165 INFO:tasks.workunit.client.0.smithi073.stdout:reading 0,256 dir_2/sfile_1 2024-09-12T00:36:14.166 INFO:tasks.workunit.client.0.smithi073.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:36:14.166 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.READ_DIRS1 (6 ms) 2024-09-12T00:36:14.166 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T00:36:14.339 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.READF_SETUP1 (173 ms) 2024-09-12T00:36:14.339 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T00:36:14.339 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T00:36:14.340 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T00:36:14.340 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T00:36:14.340 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T00:36:14.340 INFO:tasks.workunit.client.0.smithi073.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:36:14.340 INFO:tasks.workunit.client.0.smithi073.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:36:14.340 INFO:tasks.workunit.client.0.smithi073.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:36:14.340 INFO:tasks.workunit.client.0.smithi073.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:36:14.340 INFO:tasks.workunit.client.0.smithi073.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:36:14.340 INFO:tasks.workunit.client.0.smithi073.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:36:14.340 INFO:tasks.workunit.client.0.smithi073.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:36:14.340 INFO:tasks.workunit.client.0.smithi073.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:36:14.340 INFO:tasks.workunit.client.0.smithi073.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:36:14.340 INFO:tasks.workunit.client.0.smithi073.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:36:14.341 INFO:tasks.workunit.client.0.smithi073.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:36:14.341 INFO:tasks.workunit.client.0.smithi073.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:36:14.341 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T00:36:14.341 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T00:36:14.347 INFO:tasks.workunit.client.0.smithi073.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-12T00:36:14.347 INFO:tasks.workunit.client.0.smithi073.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-12T00:36:14.350 INFO:tasks.workunit.client.0.smithi073.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-12T00:36:14.352 INFO:tasks.workunit.client.0.smithi073.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-12T00:36:14.354 INFO:tasks.workunit.client.0.smithi073.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T00:36:14.354 INFO:tasks.workunit.client.0.smithi073.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T00:36:14.355 INFO:tasks.workunit.client.0.smithi073.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-12T00:36:14.355 INFO:tasks.workunit.client.0.smithi073.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-12T00:36:14.356 INFO:tasks.workunit.client.0.smithi073.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T00:36:14.356 INFO:tasks.workunit.client.0.smithi073.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T00:36:14.357 INFO:tasks.workunit.client.0.smithi073.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-12T00:36:14.360 INFO:tasks.workunit.client.0.smithi073.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-12T00:36:14.360 INFO:tasks.workunit.client.0.smithi073.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-12T00:36:14.360 INFO:tasks.workunit.client.0.smithi073.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-12T00:36:14.360 INFO:tasks.workunit.client.0.smithi073.stdout:/nfsroot/foo (foo): DIR 2024-09-12T00:36:14.360 INFO:tasks.workunit.client.0.smithi073.stdout:/nfsroot (nfsroot): DIR 2024-09-12T00:36:14.360 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.HIER1 (20 ms) 2024-09-12T00:36:14.361 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:36:14.361 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T00:36:14.361 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:36:14.361 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T00:36:14.361 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:36:14.361 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T00:36:14.362 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:36:14.362 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:36:14.362 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:36:14.362 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:36:14.362 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:36:14.362 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:36:14.362 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:36:14.363 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:14.360+0000 7fcf09b208c0 -1 shutting down 2024-09-12T00:36:14.363 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:14.361+0000 7fcde1a04640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 64459, si_uid : 1000, si_addr0x3e80000fbcb, si_status0 2024-09-12T00:36:44.207 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.SHUTDOWN (29847 ms) 2024-09-12T00:36:44.207 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 24 tests from LibRGW (30637 ms total) 2024-09-12T00:36:44.207 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-09-12T00:36:44.207 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment tear-down 2024-09-12T00:36:44.207 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] 24 tests from 1 test suite ran. (30637 ms total) 2024-09-12T00:36:44.207 INFO:tasks.workunit.client.0.smithi073.stdout:[ PASSED ] 24 tests. 2024-09-12T00:36:44.213 INFO:tasks.workunit.client.0.smithi073.stdout:phase 1.2 2024-09-12T00:36:44.236 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T00:36:44.237 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment set-up. 2024-09-12T00:36:44.237 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 24 tests from LibRGW 2024-09-12T00:36:44.237 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:36:44.245 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:44.245 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:44.652 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.INIT (415 ms) 2024-09-12T00:36:44.652 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T00:36:44.654 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-12T00:36:44.654 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:36:44.654 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T00:36:44.654 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T00:36:44.654 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2024-09-12T00:36:44.654 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T00:36:44.654 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2024-09-12T00:36:44.654 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T00:36:44.654 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T00:36:44.654 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T00:36:44.654 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-12T00:36:44.654 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T00:36:44.654 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-12T00:36:44.654 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T00:36:44.655 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-12T00:36:44.655 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T00:36:44.655 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-12T00:36:44.655 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T00:36:44.655 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T00:36:44.655 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T00:36:44.655 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2024-09-12T00:36:44.655 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T00:36:44.655 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-12T00:36:44.655 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T00:36:44.655 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T00:36:44.655 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T00:36:44.655 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T00:36:44.655 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T00:36:44.655 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T00:36:44.656 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T00:36:44.656 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2024-09-12T00:36:44.656 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:36:44.656 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T00:36:44.656 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:36:44.656 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T00:36:44.656 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:36:44.656 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T00:36:44.656 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:36:44.656 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:36:44.656 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:36:44.656 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:36:44.656 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:36:44.657 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:36:44.657 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:36:44.657 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:44.655+0000 7f641cb268c0 -1 shutting down 2024-09-12T00:36:44.657 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:36:44.656+0000 7f62f4977640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 65078, si_uid : 1000, si_addr0x3e80000fe36, si_status0 2024-09-12T00:37:14.780 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.SHUTDOWN (30127 ms) 2024-09-12T00:37:14.780 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 24 tests from LibRGW (30543 ms total) 2024-09-12T00:37:14.780 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-09-12T00:37:14.780 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment tear-down 2024-09-12T00:37:14.780 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] 24 tests from 1 test suite ran. (30543 ms total) 2024-09-12T00:37:14.780 INFO:tasks.workunit.client.0.smithi073.stdout:[ PASSED ] 24 tests. 2024-09-12T00:37:14.786 INFO:tasks.workunit.client.0.smithi073.stdout:phase 1.3 2024-09-12T00:37:14.810 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T00:37:14.810 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment set-up. 2024-09-12T00:37:14.810 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 24 tests from LibRGW 2024-09-12T00:37:14.811 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:37:14.821 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:14.821 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:15.205 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.INIT (394 ms) 2024-09-12T00:37:15.205 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T00:37:15.206 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-12T00:37:15.206 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:37:15.206 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T00:37:15.206 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T00:37:15.211 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.SETUP_HIER1 (6 ms) 2024-09-12T00:37:15.212 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T00:37:15.271 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.SETUP_DIRS1 (59 ms) 2024-09-12T00:37:15.271 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T00:37:15.271 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T00:37:15.271 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T00:37:15.271 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-12T00:37:15.271 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T00:37:15.271 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-12T00:37:15.271 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T00:37:15.271 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-12T00:37:15.271 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T00:37:15.271 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-12T00:37:15.272 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T00:37:15.272 INFO:tasks.workunit.client.0.smithi073.stdout:scanning objects in /bdirs1/dir_0 2024-09-12T00:37:15.272 INFO:tasks.workunit.client.0.smithi073.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:37:15.272 INFO:tasks.workunit.client.0.smithi073.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:37:15.272 INFO:tasks.workunit.client.0.smithi073.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:37:15.272 INFO:tasks.workunit.client.0.smithi073.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:37:15.272 INFO:tasks.workunit.client.0.smithi073.stdout:scanning objects in /bdirs1/dir_1 2024-09-12T00:37:15.272 INFO:tasks.workunit.client.0.smithi073.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:37:15.272 INFO:tasks.workunit.client.0.smithi073.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:37:15.272 INFO:tasks.workunit.client.0.smithi073.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:37:15.272 INFO:tasks.workunit.client.0.smithi073.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:37:15.272 INFO:tasks.workunit.client.0.smithi073.stdout:scanning objects in /bdirs1/dir_2 2024-09-12T00:37:15.272 INFO:tasks.workunit.client.0.smithi073.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:37:15.272 INFO:tasks.workunit.client.0.smithi073.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:37:15.273 INFO:tasks.workunit.client.0.smithi073.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:37:15.273 INFO:tasks.workunit.client.0.smithi073.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:37:15.273 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T00:37:15.273 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T00:37:15.273 INFO:tasks.workunit.client.0.smithi073.stdout:read back objects in /bdirs1/dir_0 2024-09-12T00:37:15.273 INFO:tasks.workunit.client.0.smithi073.stdout:reading 0,256 dir_0/sfile_0 2024-09-12T00:37:15.273 INFO:tasks.workunit.client.0.smithi073.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:37:15.273 INFO:tasks.workunit.client.0.smithi073.stdout:reading 0,256 dir_0/sfile_1 2024-09-12T00:37:15.274 INFO:tasks.workunit.client.0.smithi073.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:37:15.274 INFO:tasks.workunit.client.0.smithi073.stdout:read back objects in /bdirs1/dir_1 2024-09-12T00:37:15.274 INFO:tasks.workunit.client.0.smithi073.stdout:reading 0,256 dir_1/sfile_0 2024-09-12T00:37:15.274 INFO:tasks.workunit.client.0.smithi073.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:37:15.274 INFO:tasks.workunit.client.0.smithi073.stdout:reading 0,256 dir_1/sfile_1 2024-09-12T00:37:15.275 INFO:tasks.workunit.client.0.smithi073.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:37:15.275 INFO:tasks.workunit.client.0.smithi073.stdout:read back objects in /bdirs1/dir_2 2024-09-12T00:37:15.275 INFO:tasks.workunit.client.0.smithi073.stdout:reading 0,256 dir_2/sfile_0 2024-09-12T00:37:15.275 INFO:tasks.workunit.client.0.smithi073.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:37:15.275 INFO:tasks.workunit.client.0.smithi073.stdout:reading 0,256 dir_2/sfile_1 2024-09-12T00:37:15.277 INFO:tasks.workunit.client.0.smithi073.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:37:15.277 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.READ_DIRS1 (6 ms) 2024-09-12T00:37:15.277 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T00:37:15.277 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-12T00:37:15.277 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T00:37:15.277 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T00:37:15.277 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T00:37:15.277 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T00:37:15.278 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T00:37:15.278 INFO:tasks.workunit.client.0.smithi073.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:37:15.278 INFO:tasks.workunit.client.0.smithi073.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:37:15.278 INFO:tasks.workunit.client.0.smithi073.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:37:15.278 INFO:tasks.workunit.client.0.smithi073.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:37:15.278 INFO:tasks.workunit.client.0.smithi073.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:37:15.278 INFO:tasks.workunit.client.0.smithi073.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:37:15.278 INFO:tasks.workunit.client.0.smithi073.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:37:15.278 INFO:tasks.workunit.client.0.smithi073.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:37:15.278 INFO:tasks.workunit.client.0.smithi073.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:37:15.278 INFO:tasks.workunit.client.0.smithi073.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:37:15.278 INFO:tasks.workunit.client.0.smithi073.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:37:15.278 INFO:tasks.workunit.client.0.smithi073.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:37:15.278 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T00:37:15.278 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T00:37:15.284 INFO:tasks.workunit.client.0.smithi073.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-12T00:37:15.284 INFO:tasks.workunit.client.0.smithi073.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-12T00:37:15.286 INFO:tasks.workunit.client.0.smithi073.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-12T00:37:15.288 INFO:tasks.workunit.client.0.smithi073.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-12T00:37:15.290 INFO:tasks.workunit.client.0.smithi073.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T00:37:15.290 INFO:tasks.workunit.client.0.smithi073.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T00:37:15.291 INFO:tasks.workunit.client.0.smithi073.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-12T00:37:15.291 INFO:tasks.workunit.client.0.smithi073.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-12T00:37:15.292 INFO:tasks.workunit.client.0.smithi073.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T00:37:15.292 INFO:tasks.workunit.client.0.smithi073.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T00:37:15.292 INFO:tasks.workunit.client.0.smithi073.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-12T00:37:15.294 INFO:tasks.workunit.client.0.smithi073.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-12T00:37:15.294 INFO:tasks.workunit.client.0.smithi073.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-12T00:37:15.295 INFO:tasks.workunit.client.0.smithi073.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-12T00:37:15.295 INFO:tasks.workunit.client.0.smithi073.stdout:/nfsroot/foo (foo): DIR 2024-09-12T00:37:15.295 INFO:tasks.workunit.client.0.smithi073.stdout:/nfsroot (nfsroot): DIR 2024-09-12T00:37:15.295 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.HIER1 (17 ms) 2024-09-12T00:37:15.295 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:37:15.295 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T00:37:15.295 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:37:15.295 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T00:37:15.295 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:37:15.295 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T00:37:15.295 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:37:15.295 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:37:15.296 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:37:15.296 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:37:15.296 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:37:15.296 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:37:15.296 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:37:15.296 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:37:15.295+0000 7f08a29208c0 -1 shutting down 2024-09-12T00:37:15.296 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:37:15.296+0000 7f077a804640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 65697, si_uid : 1000, si_addr0x3e8000100a1, si_status0 2024-09-12T00:37:45.447 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.SHUTDOWN (30153 ms) 2024-09-12T00:37:45.448 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 24 tests from LibRGW (30636 ms total) 2024-09-12T00:37:45.448 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-09-12T00:37:45.448 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment tear-down 2024-09-12T00:37:45.448 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] 24 tests from 1 test suite ran. (30636 ms total) 2024-09-12T00:37:45.448 INFO:tasks.workunit.client.0.smithi073.stdout:[ PASSED ] 24 tests. 2024-09-12T00:37:45.453 INFO:tasks.workunit.client.0.smithi073.stdout:phase 2.1 2024-09-12T00:37:45.478 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T00:37:45.478 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment set-up. 2024-09-12T00:37:45.478 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 9 tests from LibRGW 2024-09-12T00:37:45.478 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:37:45.487 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:45.487 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:45.868 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.INIT (390 ms) 2024-09-12T00:37:45.868 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:37:45.869 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:37:45.869 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:37:45.884 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.CREATE_BUCKET (15 ms) 2024-09-12T00:37:45.884 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:37:45.884 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T00:37:45.884 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-12T00:37:45.894 INFO:tasks.workunit.client.0.smithi073.stdout:created: sorrydave0 2024-09-12T00:37:45.903 INFO:tasks.workunit.client.0.smithi073.stdout:created: sorrydave1 2024-09-12T00:37:45.912 INFO:tasks.workunit.client.0.smithi073.stdout:created: sorrydave2 2024-09-12T00:37:45.921 INFO:tasks.workunit.client.0.smithi073.stdout:created: sorrydave3 2024-09-12T00:37:45.932 INFO:tasks.workunit.client.0.smithi073.stdout:created: sorrydave4 2024-09-12T00:37:45.938 INFO:tasks.workunit.client.0.smithi073.stdout:created: sorrydave5 2024-09-12T00:37:45.949 INFO:tasks.workunit.client.0.smithi073.stdout:created: sorrydave6 2024-09-12T00:37:45.958 INFO:tasks.workunit.client.0.smithi073.stdout:created: sorrydave7 2024-09-12T00:37:45.967 INFO:tasks.workunit.client.0.smithi073.stdout:created: sorrydave8 2024-09-12T00:37:45.975 INFO:tasks.workunit.client.0.smithi073.stdout:created: sorrydave9 2024-09-12T00:37:45.976 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (92 ms) 2024-09-12T00:37:45.976 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-12T00:37:46.145 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (169 ms) 2024-09-12T00:37:46.146 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:37:46.146 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:37:46.146 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:37:46.146 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:37:46.146 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:37:46.146 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:37:46.147+0000 7febcb4c18c0 -1 shutting down 2024-09-12T00:37:46.146 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:37:46.148+0000 7feaa24d5640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 66316, si_uid : 1000, si_addr0x3e80001030c, si_status0 2024-09-12T00:38:16.188 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.SHUTDOWN (30042 ms) 2024-09-12T00:38:16.188 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 9 tests from LibRGW (30710 ms total) 2024-09-12T00:38:16.188 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-09-12T00:38:16.188 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment tear-down 2024-09-12T00:38:16.188 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] 9 tests from 1 test suite ran. (30710 ms total) 2024-09-12T00:38:16.189 INFO:tasks.workunit.client.0.smithi073.stdout:[ PASSED ] 9 tests. 2024-09-12T00:38:16.194 INFO:tasks.workunit.client.0.smithi073.stdout:phase 2.2 2024-09-12T00:38:16.220 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T00:38:16.220 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment set-up. 2024-09-12T00:38:16.220 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 9 tests from LibRGW 2024-09-12T00:38:16.220 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:38:16.230 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:16.230 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:16.427 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.INIT (207 ms) 2024-09-12T00:38:16.427 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:38:16.428 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:38:16.428 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:38:16.428 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T00:38:16.429 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:38:16.449 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.DELETE_BUCKET (21 ms) 2024-09-12T00:38:16.449 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-12T00:38:16.458 INFO:tasks.workunit.client.0.smithi073.stdout:created: sorrydave0 2024-09-12T00:38:16.467 INFO:tasks.workunit.client.0.smithi073.stdout:created: sorrydave1 2024-09-12T00:38:16.477 INFO:tasks.workunit.client.0.smithi073.stdout:created: sorrydave2 2024-09-12T00:38:16.485 INFO:tasks.workunit.client.0.smithi073.stdout:created: sorrydave3 2024-09-12T00:38:16.494 INFO:tasks.workunit.client.0.smithi073.stdout:created: sorrydave4 2024-09-12T00:38:16.503 INFO:tasks.workunit.client.0.smithi073.stdout:created: sorrydave5 2024-09-12T00:38:16.512 INFO:tasks.workunit.client.0.smithi073.stdout:created: sorrydave6 2024-09-12T00:38:16.522 INFO:tasks.workunit.client.0.smithi073.stdout:created: sorrydave7 2024-09-12T00:38:16.530 INFO:tasks.workunit.client.0.smithi073.stdout:created: sorrydave8 2024-09-12T00:38:16.539 INFO:tasks.workunit.client.0.smithi073.stdout:created: sorrydave9 2024-09-12T00:38:16.539 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (90 ms) 2024-09-12T00:38:16.539 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-12T00:38:16.707 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (168 ms) 2024-09-12T00:38:16.707 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:38:16.707 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:38:16.707 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:38:16.708 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:38:16.708 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:38:16.708 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:38:16.708+0000 7fa18b5518c0 -1 shutting down 2024-09-12T00:38:16.708 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:38:16.709+0000 7fa06354c640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 66935, si_uid : 1000, si_addr0x3e800010577, si_status0 2024-09-12T00:38:46.832 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.SHUTDOWN (30125 ms) 2024-09-12T00:38:46.833 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 9 tests from LibRGW (30612 ms total) 2024-09-12T00:38:46.833 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-09-12T00:38:46.833 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment tear-down 2024-09-12T00:38:46.833 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] 9 tests from 1 test suite ran. (30612 ms total) 2024-09-12T00:38:46.833 INFO:tasks.workunit.client.0.smithi073.stdout:[ PASSED ] 9 tests. 2024-09-12T00:38:46.838 INFO:tasks.workunit.client.0.smithi073.stdout:phase 3.1 2024-09-12T00:38:47.153 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-12T00:38:47.153 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment set-up. 2024-09-12T00:38:47.153 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 13 tests from LibRGW 2024-09-12T00:38:47.153 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:38:47.162 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:47.162 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:47.365 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.INIT (212 ms) 2024-09-12T00:38:47.365 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:38:47.365 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:38:47.365 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:38:47.375 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.CREATE_BUCKET (9 ms) 2024-09-12T00:38:47.375 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T00:38:47.379 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (4 ms) 2024-09-12T00:38:47.379 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T00:38:47.380 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (1 ms) 2024-09-12T00:38:47.380 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.LARGE1 2024-09-12T00:38:47.443 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.LARGE1 (63 ms) 2024-09-12T00:38:47.443 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.LARGE2 2024-09-12T00:38:47.495 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.LARGE2 (52 ms) 2024-09-12T00:38:47.496 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T00:38:47.496 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T00:38:47.496 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T00:38:47.496 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-12T00:38:47.496 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:38:47.496 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T00:38:47.496 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:38:47.496 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:38:47.496 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:38:47.496 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:38:47.496 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:38:47.497 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:38:47.496+0000 7f6bf9d1f8c0 -1 shutting down 2024-09-12T00:38:47.497 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:38:47.498+0000 7f6ad1be0640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 67554, si_uid : 1000, si_addr0x3e8000107e2, si_status0 2024-09-12T00:39:17.614 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.SHUTDOWN (30119 ms) 2024-09-12T00:39:17.614 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 13 tests from LibRGW (30461 ms total) 2024-09-12T00:39:17.614 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-09-12T00:39:17.615 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment tear-down 2024-09-12T00:39:17.615 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] 13 tests from 1 test suite ran. (30461 ms total) 2024-09-12T00:39:17.615 INFO:tasks.workunit.client.0.smithi073.stdout:[ PASSED ] 13 tests. 2024-09-12T00:39:17.621 INFO:tasks.workunit.client.0.smithi073.stdout:phase 3.2 2024-09-12T00:39:17.934 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-12T00:39:17.934 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment set-up. 2024-09-12T00:39:17.934 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 13 tests from LibRGW 2024-09-12T00:39:17.935 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:39:17.942 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:17.943 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:18.319 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.INIT (385 ms) 2024-09-12T00:39:18.319 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:39:18.320 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:39:18.320 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:39:18.320 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T00:39:18.320 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T00:39:18.325 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (6 ms) 2024-09-12T00:39:18.325 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T00:39:18.329 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (3 ms) 2024-09-12T00:39:18.329 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.LARGE1 2024-09-12T00:39:18.389 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.LARGE1 (61 ms) 2024-09-12T00:39:18.390 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.LARGE2 2024-09-12T00:39:18.390 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2024-09-12T00:39:18.390 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T00:39:18.390 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T00:39:18.390 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T00:39:18.394 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.DELETE_OBJECT (4 ms) 2024-09-12T00:39:18.394 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:39:18.412 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.DELETE_BUCKET (18 ms) 2024-09-12T00:39:18.412 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:39:18.412 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:39:18.412 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:39:18.413 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:39:18.413 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:39:18.413 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:39:18.414+0000 7f6df75278c0 -1 shutting down 2024-09-12T00:39:18.413 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:39:18.415+0000 7f6ccf3ac640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 68173, si_uid : 1000, si_addr0x3e800010a4d, si_status0 2024-09-12T00:39:48.685 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.SHUTDOWN (30273 ms) 2024-09-12T00:39:48.685 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 13 tests from LibRGW (30751 ms total) 2024-09-12T00:39:48.685 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-09-12T00:39:48.685 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment tear-down 2024-09-12T00:39:48.686 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] 13 tests from 1 test suite ran. (30751 ms total) 2024-09-12T00:39:48.686 INFO:tasks.workunit.client.0.smithi073.stdout:[ PASSED ] 13 tests. 2024-09-12T00:39:48.693 INFO:tasks.workunit.client.0.smithi073.stdout:phase 4.1 2024-09-12T00:39:48.718 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T00:39:48.719 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment set-up. 2024-09-12T00:39:48.719 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 11 tests from LibRGW 2024-09-12T00:39:48.719 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.TVAR 2024-09-12T00:39:48.719 INFO:tasks.workunit.client.0.smithi073.stdout:read i1: 64001 2024-09-12T00:39:48.719 INFO:tasks.workunit.client.0.smithi073.stdout:read s1: blunderbuss 2024-09-12T00:39:48.719 INFO:tasks.workunit.client.0.smithi073.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-12T00:39:48.719 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:39:48.729 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:48.730 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:48.928 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.INIT (209 ms) 2024-09-12T00:39:48.928 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:39:48.929 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:39:48.929 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:39:48.946 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (18 ms) 2024-09-12T00:39:48.947 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:39:49.441 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_0 2024-09-12T00:39:49.441 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_1 2024-09-12T00:39:49.441 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_2 2024-09-12T00:39:49.441 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_3 2024-09-12T00:39:49.442 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_4 2024-09-12T00:39:49.442 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_5 2024-09-12T00:39:49.442 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_6 2024-09-12T00:39:49.442 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_7 2024-09-12T00:39:49.442 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_8 2024-09-12T00:39:49.442 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_9 2024-09-12T00:39:49.443 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_10 2024-09-12T00:39:49.443 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_11 2024-09-12T00:39:49.443 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_12 2024-09-12T00:39:49.443 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_13 2024-09-12T00:39:49.443 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_14 2024-09-12T00:39:49.443 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_15 2024-09-12T00:39:49.444 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_16 2024-09-12T00:39:49.444 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_17 2024-09-12T00:39:49.444 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_18 2024-09-12T00:39:49.444 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_19 2024-09-12T00:39:49.444 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_20 2024-09-12T00:39:49.444 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_21 2024-09-12T00:39:49.444 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_22 2024-09-12T00:39:49.444 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_23 2024-09-12T00:39:49.444 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_24 2024-09-12T00:39:49.444 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_25 2024-09-12T00:39:49.444 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_26 2024-09-12T00:39:49.444 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_27 2024-09-12T00:39:49.444 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_28 2024-09-12T00:39:49.445 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_29 2024-09-12T00:39:49.445 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_30 2024-09-12T00:39:49.445 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_31 2024-09-12T00:39:49.445 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_32 2024-09-12T00:39:49.445 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_33 2024-09-12T00:39:49.445 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_34 2024-09-12T00:39:49.446 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_35 2024-09-12T00:39:49.446 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_36 2024-09-12T00:39:49.446 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_37 2024-09-12T00:39:49.446 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_38 2024-09-12T00:39:49.446 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_39 2024-09-12T00:39:49.446 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_40 2024-09-12T00:39:49.446 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_41 2024-09-12T00:39:49.446 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_42 2024-09-12T00:39:49.446 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_43 2024-09-12T00:39:49.446 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_44 2024-09-12T00:39:49.446 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_45 2024-09-12T00:39:49.446 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_46 2024-09-12T00:39:49.447 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_47 2024-09-12T00:39:49.447 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_48 2024-09-12T00:39:49.447 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_49 2024-09-12T00:39:49.447 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_50 2024-09-12T00:39:49.447 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_51 2024-09-12T00:39:49.447 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_52 2024-09-12T00:39:49.447 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_53 2024-09-12T00:39:49.447 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_54 2024-09-12T00:39:49.447 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_55 2024-09-12T00:39:49.447 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_56 2024-09-12T00:39:49.447 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_57 2024-09-12T00:39:49.447 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_58 2024-09-12T00:39:49.447 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_59 2024-09-12T00:39:49.448 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_60 2024-09-12T00:39:49.448 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_61 2024-09-12T00:39:49.448 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_62 2024-09-12T00:39:49.448 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_63 2024-09-12T00:39:49.448 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_64 2024-09-12T00:39:49.448 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_65 2024-09-12T00:39:49.448 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_66 2024-09-12T00:39:49.448 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_67 2024-09-12T00:39:49.448 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_68 2024-09-12T00:39:49.448 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_69 2024-09-12T00:39:49.448 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_70 2024-09-12T00:39:49.448 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_71 2024-09-12T00:39:49.448 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_72 2024-09-12T00:39:49.449 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_73 2024-09-12T00:39:49.449 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_74 2024-09-12T00:39:49.449 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_75 2024-09-12T00:39:49.449 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_76 2024-09-12T00:39:49.449 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_77 2024-09-12T00:39:49.449 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_78 2024-09-12T00:39:49.449 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_79 2024-09-12T00:39:49.449 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_80 2024-09-12T00:39:49.449 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_81 2024-09-12T00:39:49.449 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_82 2024-09-12T00:39:49.449 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_83 2024-09-12T00:39:49.449 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_84 2024-09-12T00:39:49.450 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_85 2024-09-12T00:39:49.450 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_86 2024-09-12T00:39:49.450 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_87 2024-09-12T00:39:49.450 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_88 2024-09-12T00:39:49.450 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_89 2024-09-12T00:39:49.450 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_90 2024-09-12T00:39:49.450 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_91 2024-09-12T00:39:49.450 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_92 2024-09-12T00:39:49.451 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_93 2024-09-12T00:39:49.451 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_94 2024-09-12T00:39:49.451 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_95 2024-09-12T00:39:49.451 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_96 2024-09-12T00:39:49.451 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_97 2024-09-12T00:39:49.451 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_98 2024-09-12T00:39:49.451 INFO:tasks.workunit.client.0.smithi073.stdout:created: dmarker:f_99 2024-09-12T00:39:49.451 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (494 ms) 2024-09-12T00:39:49.451 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:39:49.453 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2024-09-12T00:39:49.453 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2024-09-12T00:39:49.453 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T00:39:49.453 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T00:39:49.453 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T00:39:49.453 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T00:39:49.453 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T00:39:49.453 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T00:39:49.453 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T00:39:49.454 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T00:39:49.454 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T00:39:49.454 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T00:39:49.454 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T00:39:49.454 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T00:39:49.454 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T00:39:49.454 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T00:39:49.454 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T00:39:49.454 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T00:39:49.454 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T00:39:49.454 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T00:39:49.454 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T00:39:49.454 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T00:39:49.455 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T00:39:49.455 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T00:39:49.455 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T00:39:49.455 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T00:39:49.455 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T00:39:49.455 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T00:39:49.455 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T00:39:49.455 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T00:39:49.455 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T00:39:49.455 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T00:39:49.455 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T00:39:49.456 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T00:39:49.456 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T00:39:49.456 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T00:39:49.456 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T00:39:49.456 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T00:39:49.456 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T00:39:49.456 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T00:39:49.456 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T00:39:49.456 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T00:39:49.456 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T00:39:49.456 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T00:39:49.456 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T00:39:49.457 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T00:39:49.457 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T00:39:49.457 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T00:39:49.457 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T00:39:49.457 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T00:39:49.457 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T00:39:49.457 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T00:39:49.457 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T00:39:49.457 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T00:39:49.457 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T00:39:49.457 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T00:39:49.457 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T00:39:49.457 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T00:39:49.458 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T00:39:49.458 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T00:39:49.458 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T00:39:49.458 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T00:39:49.458 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T00:39:49.458 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T00:39:49.458 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T00:39:49.458 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T00:39:49.458 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T00:39:49.458 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T00:39:49.458 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T00:39:49.458 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T00:39:49.458 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T00:39:49.459 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T00:39:49.459 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T00:39:49.459 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T00:39:49.459 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T00:39:49.459 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T00:39:49.459 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T00:39:49.459 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T00:39:49.459 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T00:39:49.459 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T00:39:49.460 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T00:39:49.460 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T00:39:49.460 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T00:39:49.460 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T00:39:49.460 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T00:39:49.460 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T00:39:49.460 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T00:39:49.460 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T00:39:49.460 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T00:39:49.460 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T00:39:49.460 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T00:39:49.460 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T00:39:49.460 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T00:39:49.460 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T00:39:49.461 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T00:39:49.461 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T00:39:49.465 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T00:39:49.465 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T00:39:49.465 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T00:39:49.465 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T00:39:49.465 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T00:39:49.465 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T00:39:49.465 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.MARKER1_READDIR (4 ms) 2024-09-12T00:39:49.465 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-12T00:39:49.465 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T00:39:49.466 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T00:39:49.466 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T00:39:49.466 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T00:39:49.466 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T00:39:49.466 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T00:39:49.466 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T00:39:49.466 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T00:39:49.467 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T00:39:49.467 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T00:39:49.467 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T00:39:49.467 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T00:39:49.467 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T00:39:49.467 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T00:39:49.467 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T00:39:49.467 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T00:39:49.468 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T00:39:49.468 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T00:39:49.468 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T00:39:49.468 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T00:39:49.468 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T00:39:49.468 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T00:39:49.468 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T00:39:49.468 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T00:39:49.468 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T00:39:49.469 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T00:39:49.469 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T00:39:49.469 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T00:39:49.469 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T00:39:49.469 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T00:39:49.469 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T00:39:49.469 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T00:39:49.469 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T00:39:49.469 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T00:39:49.469 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T00:39:49.469 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T00:39:49.469 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T00:39:49.469 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T00:39:49.470 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T00:39:49.470 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T00:39:49.470 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T00:39:49.470 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T00:39:49.470 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T00:39:49.470 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T00:39:49.470 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T00:39:49.470 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T00:39:49.471 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T00:39:49.471 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T00:39:49.471 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T00:39:49.471 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T00:39:49.471 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T00:39:49.471 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T00:39:49.471 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T00:39:49.471 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T00:39:49.471 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T00:39:49.472 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T00:39:49.472 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T00:39:49.472 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T00:39:49.472 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T00:39:49.472 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T00:39:49.472 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T00:39:49.472 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T00:39:49.473 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T00:39:49.473 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T00:39:49.473 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T00:39:49.473 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T00:39:49.473 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T00:39:49.473 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T00:39:49.473 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T00:39:49.473 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T00:39:49.473 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T00:39:49.474 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T00:39:49.474 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T00:39:49.474 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T00:39:49.474 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T00:39:49.474 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T00:39:49.474 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T00:39:49.474 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T00:39:49.474 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T00:39:49.474 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T00:39:49.475 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T00:39:49.475 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T00:39:49.475 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T00:39:49.475 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T00:39:49.475 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T00:39:49.475 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T00:39:49.475 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T00:39:49.475 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T00:39:49.475 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T00:39:49.476 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T00:39:49.476 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T00:39:49.476 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T00:39:49.476 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T00:39:49.476 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T00:39:49.476 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T00:39:49.476 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T00:39:49.477 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T00:39:49.477 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T00:39:49.477 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T00:39:49.477 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T00:39:49.477 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.MARKER2_READDIR (3 ms) 2024-09-12T00:39:49.477 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:39:49.477 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:39:49.477 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:39:49.477 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:39:49.478 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:39:49.478 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.UMOUNT (1 ms) 2024-09-12T00:39:49.478 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:39:49.478 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:39:49.450+0000 7ff882d1f8c0 -1 shutting down 2024-09-12T00:39:49.479 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:39:49.451+0000 7ff75abcf640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 68792, si_uid : 1000, si_addr0x3e800010cb8, si_status0 2024-09-12T00:40:19.200 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.SHUTDOWN (29751 ms) 2024-09-12T00:40:19.200 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 11 tests from LibRGW (30481 ms total) 2024-09-12T00:40:19.201 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-09-12T00:40:19.201 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment tear-down 2024-09-12T00:40:19.201 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] 11 tests from 1 test suite ran. (30481 ms total) 2024-09-12T00:40:19.201 INFO:tasks.workunit.client.0.smithi073.stdout:[ PASSED ] 11 tests. 2024-09-12T00:40:19.207 INFO:tasks.workunit.client.0.smithi073.stdout:phase 4.2 2024-09-12T00:40:19.233 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T00:40:19.233 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment set-up. 2024-09-12T00:40:19.233 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 11 tests from LibRGW 2024-09-12T00:40:19.234 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.TVAR 2024-09-12T00:40:19.234 INFO:tasks.workunit.client.0.smithi073.stdout:read i1: 64001 2024-09-12T00:40:19.234 INFO:tasks.workunit.client.0.smithi073.stdout:read s1: blunderbuss 2024-09-12T00:40:19.234 INFO:tasks.workunit.client.0.smithi073.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-12T00:40:19.234 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:40:19.242 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:19.242 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:19.630 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.INIT (396 ms) 2024-09-12T00:40:19.630 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:40:19.630 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:40:19.630 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:40:19.640 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (10 ms) 2024-09-12T00:40:19.640 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:40:19.641 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T00:40:19.641 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:40:19.641 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T00:40:19.641 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-12T00:40:19.644 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T00:40:19.644 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T00:40:19.644 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T00:40:19.644 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T00:40:19.644 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T00:40:19.644 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T00:40:19.644 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T00:40:19.645 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T00:40:19.645 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T00:40:19.645 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T00:40:19.645 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T00:40:19.645 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T00:40:19.645 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T00:40:19.645 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T00:40:19.645 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T00:40:19.645 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T00:40:19.645 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T00:40:19.645 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T00:40:19.646 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T00:40:19.646 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T00:40:19.646 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T00:40:19.646 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T00:40:19.646 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T00:40:19.646 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T00:40:19.646 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T00:40:19.646 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T00:40:19.646 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T00:40:19.646 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T00:40:19.646 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T00:40:19.646 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T00:40:19.646 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T00:40:19.647 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T00:40:19.647 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T00:40:19.647 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T00:40:19.647 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T00:40:19.647 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T00:40:19.647 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T00:40:19.647 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T00:40:19.647 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T00:40:19.647 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T00:40:19.647 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T00:40:19.647 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T00:40:19.647 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T00:40:19.647 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T00:40:19.648 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T00:40:19.648 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T00:40:19.648 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T00:40:19.648 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T00:40:19.648 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T00:40:19.648 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T00:40:19.648 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T00:40:19.648 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T00:40:19.648 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T00:40:19.648 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T00:40:19.648 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T00:40:19.648 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T00:40:19.648 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T00:40:19.649 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T00:40:19.649 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T00:40:19.649 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T00:40:19.649 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T00:40:19.649 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T00:40:19.649 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T00:40:19.649 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T00:40:19.649 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T00:40:19.649 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T00:40:19.649 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T00:40:19.650 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T00:40:19.650 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T00:40:19.650 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T00:40:19.650 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T00:40:19.650 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T00:40:19.650 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T00:40:19.650 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T00:40:19.650 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T00:40:19.650 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T00:40:19.651 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T00:40:19.651 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T00:40:19.651 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T00:40:19.651 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T00:40:19.651 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T00:40:19.651 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T00:40:19.651 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T00:40:19.651 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T00:40:19.651 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T00:40:19.651 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T00:40:19.651 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T00:40:19.651 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T00:40:19.651 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T00:40:19.651 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T00:40:19.652 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T00:40:19.652 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T00:40:19.652 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T00:40:19.652 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T00:40:19.652 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T00:40:19.652 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T00:40:19.652 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T00:40:19.652 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T00:40:19.652 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T00:40:19.652 INFO:tasks.workunit.client.0.smithi073.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T00:40:19.652 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.MARKER2_READDIR (3 ms) 2024-09-12T00:40:19.652 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:40:19.652 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:40:19.652 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:40:19.653 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:40:19.653 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:40:19.653 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:40:19.653 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:40:19.653 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:40:19.645+0000 7f6d3171f8c0 -1 shutting down 2024-09-12T00:40:19.653 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:40:19.647+0000 7f6c095cf640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 69411, si_uid : 1000, si_addr0x3e800010f23, si_status0 2024-09-12T00:40:49.671 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.SHUTDOWN (30027 ms) 2024-09-12T00:40:49.671 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 11 tests from LibRGW (30438 ms total) 2024-09-12T00:40:49.671 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-09-12T00:40:49.671 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment tear-down 2024-09-12T00:40:49.671 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] 11 tests from 1 test suite ran. (30438 ms total) 2024-09-12T00:40:49.671 INFO:tasks.workunit.client.0.smithi073.stdout:[ PASSED ] 11 tests. 2024-09-12T00:40:49.677 INFO:tasks.workunit.client.0.smithi073.stdout:phase 5.1 2024-09-12T00:40:49.711 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T00:40:49.711 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment set-up. 2024-09-12T00:40:49.712 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 19 tests from LibRGW 2024-09-12T00:40:49.712 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:40:49.722 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:49.722 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:49.898 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.INIT (187 ms) 2024-09-12T00:40:49.898 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:40:49.899 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:40:49.899 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:40:49.908 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.CREATE_BUCKET (9 ms) 2024-09-12T00:40:49.908 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T00:40:49.911 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (4 ms) 2024-09-12T00:40:49.912 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-12T00:40:49.912 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-12T00:40:49.912 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T00:40:49.913 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2024-09-12T00:40:49.913 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-12T00:40:49.913 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-12T00:40:49.913 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-12T00:40:49.917 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.PUT_OBJECT (4 ms) 2024-09-12T00:40:49.917 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-12T00:40:49.919 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.GET_OBJECT (1 ms) 2024-09-12T00:40:49.919 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T00:40:49.919 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T00:40:49.919 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-12T00:40:49.919 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-12T00:40:49.919 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.WRITEV 2024-09-12T00:40:49.919 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-12T00:40:49.919 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.READV 2024-09-12T00:40:49.919 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-12T00:40:49.919 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-12T00:40:49.919 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-12T00:40:49.919 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T00:40:49.920 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-12T00:40:49.920 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:40:49.920 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T00:40:49.920 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:40:49.920 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:40:49.920 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:40:49.920 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:40:49.920 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:40:49.920 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:40:49.919+0000 7fcd83cb58c0 -1 shutting down 2024-09-12T00:40:49.921 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:40:49.920+0000 7fcc5d9f4640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 70033, si_uid : 1000, si_addr0x3e800011191, si_status0 2024-09-12T00:41:20.007 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.SHUTDOWN (30088 ms) 2024-09-12T00:41:20.008 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 19 tests from LibRGW (30296 ms total) 2024-09-12T00:41:20.008 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-09-12T00:41:20.008 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment tear-down 2024-09-12T00:41:20.008 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] 19 tests from 1 test suite ran. (30296 ms total) 2024-09-12T00:41:20.008 INFO:tasks.workunit.client.0.smithi073.stdout:[ PASSED ] 19 tests. 2024-09-12T00:41:20.014 INFO:tasks.workunit.client.0.smithi073.stdout:phase 5.2 2024-09-12T00:41:20.048 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T00:41:20.048 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment set-up. 2024-09-12T00:41:20.048 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 19 tests from LibRGW 2024-09-12T00:41:20.048 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:41:20.055 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:41:20.055 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:41:20.237 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.INIT (189 ms) 2024-09-12T00:41:20.237 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:41:20.237 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:41:20.238 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:41:20.238 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T00:41:20.238 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T00:41:20.243 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (5 ms) 2024-09-12T00:41:20.244 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-12T00:41:20.244 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-12T00:41:20.244 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T00:41:20.244 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2024-09-12T00:41:20.244 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-12T00:41:20.244 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-12T00:41:20.244 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-12T00:41:20.244 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2024-09-12T00:41:20.244 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-12T00:41:20.244 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2024-09-12T00:41:20.244 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T00:41:20.245 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.STAT_OBJECT (1 ms) 2024-09-12T00:41:20.245 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-12T00:41:20.245 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-12T00:41:20.245 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.WRITEV 2024-09-12T00:41:20.245 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-12T00:41:20.245 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.READV 2024-09-12T00:41:20.245 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-12T00:41:20.245 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-12T00:41:20.245 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-12T00:41:20.245 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T00:41:20.248 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.DELETE_OBJECT (4 ms) 2024-09-12T00:41:20.248 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:41:20.265 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.DELETE_BUCKET (17 ms) 2024-09-12T00:41:20.265 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:41:20.265 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:41:20.265 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:41:20.265 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:41:20.265 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:41:20.265 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:41:20.266+0000 7f786e1278c0 -1 shutting down 2024-09-12T00:41:20.266 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:41:20.267+0000 7f77460bd640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 70652, si_uid : 1000, si_addr0x3e8000113fc, si_status0 2024-09-12T00:41:50.540 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.SHUTDOWN (30275 ms) 2024-09-12T00:41:50.540 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 19 tests from LibRGW (30492 ms total) 2024-09-12T00:41:50.540 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-09-12T00:41:50.540 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment tear-down 2024-09-12T00:41:50.540 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] 19 tests from 1 test suite ran. (30492 ms total) 2024-09-12T00:41:50.540 INFO:tasks.workunit.client.0.smithi073.stdout:[ PASSED ] 19 tests. 2024-09-12T00:41:50.546 INFO:tasks.workunit.client.0.smithi073.stdout:phase 6.1 2024-09-12T00:41:50.571 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-12T00:41:50.571 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment set-up. 2024-09-12T00:41:50.571 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 10 tests from LibRGW 2024-09-12T00:41:50.571 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:41:50.579 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:41:50.579 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:41:50.960 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.INIT (389 ms) 2024-09-12T00:41:50.960 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:41:50.960 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:41:50.961 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.CREATE_BUCKETS 2024-09-12T00:41:50.980 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.CREATE_BUCKETS (19 ms) 2024-09-12T00:41:50.980 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.LOOKUP_BUCKETS 2024-09-12T00:41:50.987 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.LOOKUP_BUCKETS (7 ms) 2024-09-12T00:41:50.987 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.TOPDIR_RENAME 2024-09-12T00:41:51.005 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.TOPDIR_RENAME (17 ms) 2024-09-12T00:41:51.005 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.SUBDIR_RENAME 2024-09-12T00:41:51.025 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.SUBDIR_RENAME (22 ms) 2024-09-12T00:41:51.025 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.CROSS_BUCKET_RENAME 2024-09-12T00:41:51.046 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.CROSS_BUCKET_RENAME (21 ms) 2024-09-12T00:41:51.047 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:41:51.047 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:41:51.047 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:41:51.047 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:41:51.047 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:41:51.047 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:41:51.048+0000 7f5fcfe318c0 -1 shutting down 2024-09-12T00:41:51.047 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:41:51.049+0000 7f5ea539b640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 71271, si_uid : 1000, si_addr0x3e800011667, si_status0 2024-09-12T00:42:21.113 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibRGW.SHUTDOWN (30066 ms) 2024-09-12T00:42:21.114 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 10 tests from LibRGW (30542 ms total) 2024-09-12T00:42:21.114 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-09-12T00:42:21.114 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment tear-down 2024-09-12T00:42:21.114 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] 10 tests from 1 test suite ran. (30542 ms total) 2024-09-12T00:42:21.114 INFO:tasks.workunit.client.0.smithi073.stdout:[ PASSED ] 10 tests. 2024-09-12T00:42:21.121 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:42:21.121 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:42:21.165 INFO:tasks.workunit:Running workunits matching rgw/test_awssdkv4_sig.sh on client.0... 2024-09-12T00:42:21.166 INFO:tasks.workunit:Running workunit rgw/test_awssdkv4_sig.sh... 2024-09-12T00:42:21.166 DEBUG:teuthology.orchestra.run.smithi073:workunit test rgw/test_awssdkv4_sig.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-09-12T00:42:21.241 INFO:tasks.workunit.client.0.smithi073.stderr:+ '[' -z ']' 2024-09-12T00:42:21.242 INFO:tasks.workunit.client.0.smithi073.stderr:+ export AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T00:42:21.242 INFO:tasks.workunit.client.0.smithi073.stderr:+ AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T00:42:21.242 INFO:tasks.workunit.client.0.smithi073.stderr:+ export AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T00:42:21.242 INFO:tasks.workunit.client.0.smithi073.stderr:+ AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T00:42:21.242 INFO:tasks.workunit.client.0.smithi073.stderr:+ radosgw-admin user create --uid ceph-test-maven --access-key lNCnR47C2g+ZidCWBAUuwfSAA7Q= --secret tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== --display-name 'maven test user' --email sigv4@example.com 2024-09-12T00:42:21.279 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:42:21.279 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:42:21.317 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.318+0000 7f8dbf014800 20 rados->read ofs=0 len=0 2024-09-12T00:42:21.319 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.319+0000 7f8dbf014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:21.319 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.319+0000 7f8dbf014800 20 realm 2024-09-12T00:42:21.319 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.319+0000 7f8dbf014800 20 rados->read ofs=0 len=0 2024-09-12T00:42:21.319 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.320+0000 7f8dbf014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:21.319 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.320+0000 7f8dbf014800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:21.320 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.320+0000 7f8dbf014800 20 rados->read ofs=0 len=0 2024-09-12T00:42:21.320 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.320+0000 7f8dbf014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:21.320 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.320+0000 7f8dbf014800 20 rados->read ofs=0 len=0 2024-09-12T00:42:21.320 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.321+0000 7f8dbf014800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:21.320 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.321+0000 7f8dbf014800 20 rados->read ofs=0 len=0 2024-09-12T00:42:21.321 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.322+0000 7f8dbf014800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:21.321 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.322+0000 7f8dbf014800 20 searching for the correct realm 2024-09-12T00:42:21.324 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.324+0000 7f8dbaecc640 0 -- 172.21.15.73:0/1104103741 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f8db0070110 msgr2=0x7f8db0085130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:21.530 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.530+0000 7f8dbaecc640 0 -- 172.21.15.73:0/1104103741 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f8db0070110 msgr2=0x7f8db0085130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:21.535 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.534+0000 7f8dbf014800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:42:21.535 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.534+0000 7f8dbf014800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:21.535 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.534+0000 7f8dbf014800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:42:21.535 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.534+0000 7f8dbf014800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:21.535 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.534+0000 7f8dbf014800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:21.535 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.534+0000 7f8dbf014800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:21.536 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.534+0000 7f8dbf014800 20 rados->read ofs=0 len=0 2024-09-12T00:42:21.536 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.535+0000 7f8dbf014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:21.536 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.535+0000 7f8dbf014800 20 rados->read ofs=0 len=0 2024-09-12T00:42:21.536 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.535+0000 7f8dbf014800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:21.536 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.535+0000 7f8dbf014800 20 rados->read ofs=0 len=0 2024-09-12T00:42:21.536 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.535+0000 7f8dbf014800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:21.536 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.535+0000 7f8dbf014800 20 zone default found 2024-09-12T00:42:21.536 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.535+0000 7f8dbf014800 4 Realm: () 2024-09-12T00:42:21.536 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.535+0000 7f8dbf014800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:42:21.536 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.535+0000 7f8dbf014800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:42:21.536 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.535+0000 7f8dbf014800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:21.536 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.535+0000 7f8dbf014800 20 zonegroup default 2024-09-12T00:42:21.536 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.535+0000 7f8dbf014800 20 rados->read ofs=0 len=0 2024-09-12T00:42:21.537 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.536+0000 7f8dbf014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:21.537 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.536+0000 7f8dbf014800 20 rados->read ofs=0 len=0 2024-09-12T00:42:21.537 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.536+0000 7f8dbf014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:21.537 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.536+0000 7f8dbf014800 20 rados->read ofs=0 len=0 2024-09-12T00:42:21.538 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.536+0000 7f8dbf014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:21.538 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.536+0000 7f8dbf014800 20 started sync module instance, tier type = 2024-09-12T00:42:21.538 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.536+0000 7f8dbf014800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:42:21.545 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.546+0000 7f8dbf014800 20 add_watcher() i=0 2024-09-12T00:42:21.545 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.546+0000 7f8dbf014800 20 add_watcher() i=1 2024-09-12T00:42:21.545 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.546+0000 7f8dbf014800 20 add_watcher() i=2 2024-09-12T00:42:21.545 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.546+0000 7f8dbf014800 20 add_watcher() i=3 2024-09-12T00:42:21.546 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.546+0000 7f8dbf014800 20 add_watcher() i=4 2024-09-12T00:42:21.546 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.546+0000 7f8dbf014800 20 add_watcher() i=5 2024-09-12T00:42:21.546 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.546+0000 7f8dbf014800 20 add_watcher() i=6 2024-09-12T00:42:21.546 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.547+0000 7f8dbf014800 20 add_watcher() i=7 2024-09-12T00:42:21.546 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.547+0000 7f8dbf014800 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:21.548 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.548+0000 7f8c70fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:21.550 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.549+0000 7f8dbf014800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:21.550 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.549+0000 7f8dbf014800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:21.550 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.549+0000 7f8dbf014800 5 note: GC not initialized 2024-09-12T00:42:21.550 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.549+0000 7f8beb7fe640 20 reqs_thread_entry: start 2024-09-12T00:42:21.550 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.549+0000 7f8dbf014800 20 init_complete bucket index max shards: 1 2024-09-12T00:42:21.551 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.549+0000 7f8dbf014800 20 Filter name: none 2024-09-12T00:42:21.551 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.549+0000 7f8be97fa640 20 reqs_thread_entry: start 2024-09-12T00:42:21.551 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.549+0000 7f8dbf014800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-maven : miss 2024-09-12T00:42:21.551 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.549+0000 7f8dbf014800 20 rados->read ofs=0 len=0 2024-09-12T00:42:21.551 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.550+0000 7f8dbf014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:21.551 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.550+0000 7f8dbf014800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x0 2024-09-12T00:42:21.551 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.550+0000 7f8dbf014800 10 adding default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T00:42:21.551 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.550+0000 7f8dbf014800 10 cache get: name=default.rgw.meta+users.email+sigv4@example.com : miss 2024-09-12T00:42:21.551 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.550+0000 7f8dbf014800 20 rados->read ofs=0 len=0 2024-09-12T00:42:21.551 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.550+0000 7f8dbf014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:21.551 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.550+0000 7f8dbf014800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x0 2024-09-12T00:42:21.552 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.550+0000 7f8dbf014800 10 adding default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T00:42:21.552 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.550+0000 7f8dbf014800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : miss 2024-09-12T00:42:21.552 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.550+0000 7f8dbf014800 20 rados->read ofs=0 len=0 2024-09-12T00:42:21.552 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.550+0000 7f8dbf014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:21.552 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.550+0000 7f8dbf014800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x0 2024-09-12T00:42:21.552 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.550+0000 7f8dbf014800 10 adding default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T00:42:21.552 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.550+0000 7f8dbf014800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-12T00:42:21.552 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.550+0000 7f8dbf014800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-12T00:42:21.553 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.551+0000 7f8dbf014800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-12T00:42:21.553 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.551+0000 7f8dbf014800 10 moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T00:42:21.553 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.551+0000 7f8dbf014800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-maven, ofs0, ns] 2024-09-12T00:42:21.553 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.552+0000 7f8c9dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856717 cookie 94810554523760 notifier 5552 bl.length()=677 2024-09-12T00:42:21.553 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.552+0000 7f8c9dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-12T00:42:21.553 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.552+0000 7f8c9dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T00:42:21.554 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.555+0000 7f8dbf014800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-12T00:42:21.554 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.555+0000 7f8dbf014800 10 moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T00:42:21.554 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.555+0000 7f8dbf014800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:sigv4@example.com, ofs0, ns] 2024-09-12T00:42:21.555 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.555+0000 7f8c9dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856759 cookie 94810554505744 notifier 5552 bl.length()=187 2024-09-12T00:42:21.555 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.555+0000 7f8c9dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-12T00:42:21.555 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.555+0000 7f8c9dffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T00:42:21.557 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.558+0000 7f8dbf014800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-12T00:42:21.557 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.558+0000 7f8dbf014800 10 moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T00:42:21.557 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.558+0000 7f8dbf014800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:lNCnR47C2g+ZidCWBAUuwfSAA7Q=, ofs0, ns] 2024-09-12T00:42:21.557 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.558+0000 7f8c9dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856760 cookie 94810554505744 notifier 5552 bl.length()=197 2024-09-12T00:42:21.557 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.558+0000 7f8c9dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-12T00:42:21.558 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.558+0000 7f8c9dffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T00:42:21.558 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:42:21.559 INFO:tasks.workunit.client.0.smithi073.stdout: "user_id": "ceph-test-maven", 2024-09-12T00:42:21.559 INFO:tasks.workunit.client.0.smithi073.stdout: "display_name": "maven test user", 2024-09-12T00:42:21.559 INFO:tasks.workunit.client.0.smithi073.stdout: "email": "sigv4@example.com", 2024-09-12T00:42:21.559 INFO:tasks.workunit.client.0.smithi073.stdout: "suspended": 0, 2024-09-12T00:42:21.559 INFO:tasks.workunit.client.0.smithi073.stdout: "max_buckets": 1000, 2024-09-12T00:42:21.559 INFO:tasks.workunit.client.0.smithi073.stdout: "subusers": [], 2024-09-12T00:42:21.559 INFO:tasks.workunit.client.0.smithi073.stdout: "keys": [ 2024-09-12T00:42:21.559 INFO:tasks.workunit.client.0.smithi073.stdout: { 2024-09-12T00:42:21.559 INFO:tasks.workunit.client.0.smithi073.stdout: "user": "ceph-test-maven", 2024-09-12T00:42:21.560 INFO:tasks.workunit.client.0.smithi073.stdout: "access_key": "lNCnR47C2g+ZidCWBAUuwfSAA7Q=", 2024-09-12T00:42:21.560 INFO:tasks.workunit.client.0.smithi073.stdout: "secret_key": "tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g==", 2024-09-12T00:42:21.560 INFO:tasks.workunit.client.0.smithi073.stdout: "active": true, 2024-09-12T00:42:21.560 INFO:tasks.workunit.client.0.smithi073.stdout: "create_date": "2024-09-12T00:42:21.552525Z" 2024-09-12T00:42:21.560 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:42:21.560 INFO:tasks.workunit.client.0.smithi073.stdout: ], 2024-09-12T00:42:21.560 INFO:tasks.workunit.client.0.smithi073.stdout: "swift_keys": [], 2024-09-12T00:42:21.560 INFO:tasks.workunit.client.0.smithi073.stdout: "caps": [], 2024-09-12T00:42:21.560 INFO:tasks.workunit.client.0.smithi073.stdout: "op_mask": "read, write, delete", 2024-09-12T00:42:21.560 INFO:tasks.workunit.client.0.smithi073.stdout: "default_placement": "", 2024-09-12T00:42:21.560 INFO:tasks.workunit.client.0.smithi073.stdout: "default_storage_class": "", 2024-09-12T00:42:21.560 INFO:tasks.workunit.client.0.smithi073.stdout: "placement_tags": [], 2024-09-12T00:42:21.560 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_quota": { 2024-09-12T00:42:21.561 INFO:tasks.workunit.client.0.smithi073.stdout: "enabled": false, 2024-09-12T00:42:21.561 INFO:tasks.workunit.client.0.smithi073.stdout: "check_on_raw": false, 2024-09-12T00:42:21.561 INFO:tasks.workunit.client.0.smithi073.stdout: "max_size": -1, 2024-09-12T00:42:21.561 INFO:tasks.workunit.client.0.smithi073.stdout: "max_size_kb": 0, 2024-09-12T00:42:21.561 INFO:tasks.workunit.client.0.smithi073.stdout: "max_objects": -1 2024-09-12T00:42:21.561 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:42:21.561 INFO:tasks.workunit.client.0.smithi073.stdout: "user_quota": { 2024-09-12T00:42:21.561 INFO:tasks.workunit.client.0.smithi073.stdout: "enabled": false, 2024-09-12T00:42:21.561 INFO:tasks.workunit.client.0.smithi073.stdout: "check_on_raw": false, 2024-09-12T00:42:21.561 INFO:tasks.workunit.client.0.smithi073.stdout: "max_size": -1, 2024-09-12T00:42:21.561 INFO:tasks.workunit.client.0.smithi073.stdout: "max_size_kb": 0, 2024-09-12T00:42:21.561 INFO:tasks.workunit.client.0.smithi073.stdout: "max_objects": -1 2024-09-12T00:42:21.561 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:42:21.561 INFO:tasks.workunit.client.0.smithi073.stdout: "temp_url_keys": [], 2024-09-12T00:42:21.561 INFO:tasks.workunit.client.0.smithi073.stdout: "type": "rgw", 2024-09-12T00:42:21.562 INFO:tasks.workunit.client.0.smithi073.stdout: "mfa_ids": [], 2024-09-12T00:42:21.562 INFO:tasks.workunit.client.0.smithi073.stdout: "account_id": "", 2024-09-12T00:42:21.562 INFO:tasks.workunit.client.0.smithi073.stdout: "path": "/", 2024-09-12T00:42:21.562 INFO:tasks.workunit.client.0.smithi073.stdout: "create_date": "2024-09-12T00:42:21.552509Z", 2024-09-12T00:42:21.562 INFO:tasks.workunit.client.0.smithi073.stdout: "tags": [], 2024-09-12T00:42:21.562 INFO:tasks.workunit.client.0.smithi073.stdout: "group_ids": [] 2024-09-12T00:42:21.562 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:42:21.562 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-09-12T00:42:21.563 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.560+0000 7f8c70fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:21.563 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.562+0000 7f8dbf014800 20 remove_watcher() i=0 2024-09-12T00:42:21.563 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.562+0000 7f8dbf014800 2 removed watcher, disabling cache 2024-09-12T00:42:21.563 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.563+0000 7f8dbf014800 20 remove_watcher() i=1 2024-09-12T00:42:21.564 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.565+0000 7f8dbf014800 20 remove_watcher() i=2 2024-09-12T00:42:21.565 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.566+0000 7f8dbf014800 20 remove_watcher() i=3 2024-09-12T00:42:21.566 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.567+0000 7f8dbf014800 20 remove_watcher() i=4 2024-09-12T00:42:21.567 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.568+0000 7f8dbf014800 20 remove_watcher() i=5 2024-09-12T00:42:21.568 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.568+0000 7f8dbf014800 20 remove_watcher() i=6 2024-09-12T00:42:21.569 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:42:21.569+0000 7f8dbf014800 20 remove_watcher() i=7 2024-09-12T00:42:21.579 INFO:tasks.workunit.client.0.smithi073.stderr:+ '[' -z ']' 2024-09-12T00:42:21.579 INFO:tasks.workunit.client.0.smithi073.stderr:+ '[' -z /home/ubuntu/cephtest ']' 2024-09-12T00:42:21.579 INFO:tasks.workunit.client.0.smithi073.stderr:++ cat /home/ubuntu/cephtest/url_file 2024-09-12T00:42:21.580 INFO:tasks.workunit.client.0.smithi073.stderr:+ export RGW_HTTP_ENDPOINT_URL=https://smithi073.front.sepia.ceph.com:443 2024-09-12T00:42:21.581 INFO:tasks.workunit.client.0.smithi073.stderr:+ RGW_HTTP_ENDPOINT_URL=https://smithi073.front.sepia.ceph.com:443 2024-09-12T00:42:21.581 INFO:tasks.workunit.client.0.smithi073.stderr:+ '[' -z /home/ubuntu/cephtest/clone.client.0 ']' 2024-09-12T00:42:21.581 INFO:tasks.workunit.client.0.smithi073.stderr:+ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-09-12T00:42:21.581 INFO:tasks.workunit.client.0.smithi073.stderr:+ ./mvnw clean package 2024-09-12T00:42:21.589 INFO:tasks.workunit.client.0.smithi073.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-12T00:42:23.020 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] Scanning for projects... 2024-09-12T00:42:23.126 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom 2024-09-12T00:42:23.209 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 1.4/5.6 kB Progress (1): 2.8/5.6 kB Progress (1): 4.1/5.6 kB Progress (1): 5.5/5.6 kB Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom (5.6 kB at 66 kB/s) 2024-09-12T00:42:23.221 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom 2024-09-12T00:42:23.263 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 1.4/83 kB Progress (1): 2.8/83 kB Progress (1): 4.1/83 kB Progress (1): 5.5/83 kB Progress (1): 6.9/83 kB Progress (1): 8.3/83 kB Progress (1): 9.7/83 kB Progress (1): 11/83 kB Progress (1): 12/83 kB Progress (1): 14/83 kB Progress (1): 15/83 kB Progress (1): 16/83 kB Progress (1): 18/83 kB Progress (1): 19/83 kB Progress (1): 21/83 kB Progress (1): 22/83 kB Progress (1): 23/83 kB Progress (1): 25/83 kB Progress (1): 26/83 kB Progress (1): 27/83 kB Progress (1): 29/83 kB Progress (1): 30/83 kB Progress (1): 32/83 kB Progress (1): 33/83 kB Progress (1): 34/83 kB Progress (1): 36/83 kB Progress (1): 37/83 kB Progress (1): 38/83 kB Progress (1): 40/83 kB Progress (1): 41/83 kB Progress (1): 43/83 kB Progress (1): 44/83 kB Progress (1): 45/83 kB Progress (1): 47/83 kB Progress (1): 48/83 kB Progress (1): 49/83 kB Progress (1): 66/83 kB Progress (1): 82/83 kB Progress (1): 83 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom (83 kB at 1.9 MB/s) 2024-09-12T00:42:23.271 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom 2024-09-12T00:42:23.292 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/77 kB Progress (1): 33/77 kB Progress (1): 49/77 kB Progress (1): 66/77 kB Progress (1): 77 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom (77 kB at 3.7 MB/s) 2024-09-12T00:42:23.313 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] 2024-09-12T00:42:23.313 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-12T00:42:23.313 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] Building jcksum 1.0 2024-09-12T00:42:23.313 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] from pom.xml 2024-09-12T00:42:23.313 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-12T00:42:23.316 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom 2024-09-12T00:42:23.335 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom (5.3 kB at 265 kB/s) 2024-09-12T00:42:23.341 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom 2024-09-12T00:42:23.357 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom (9.9 kB at 660 kB/s) 2024-09-12T00:42:23.361 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom 2024-09-12T00:42:23.377 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/45 kB Progress (1): 32/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom (45 kB at 2.7 MB/s) 2024-09-12T00:42:23.382 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom 2024-09-12T00:42:23.398 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom (21 kB at 1.2 MB/s) 2024-09-12T00:42:23.409 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar 2024-09-12T00:42:23.429 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar (36 kB at 1.7 MB/s) 2024-09-12T00:42:23.436 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom 2024-09-12T00:42:23.452 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom (8.2 kB at 544 kB/s) 2024-09-12T00:42:23.455 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom 2024-09-12T00:42:23.470 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom (8.1 kB at 506 kB/s) 2024-09-12T00:42:23.473 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom 2024-09-12T00:42:23.492 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/48 kB Progress (1): 33/48 kB Progress (1): 48 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom (48 kB at 2.5 MB/s) 2024-09-12T00:42:23.495 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom 2024-09-12T00:42:23.511 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom (21 kB at 1.4 MB/s) 2024-09-12T00:42:23.516 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar 2024-09-12T00:42:23.535 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar (31 kB at 1.5 MB/s) 2024-09-12T00:42:23.543 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom 2024-09-12T00:42:23.559 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 9.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom (9.8 kB at 654 kB/s) 2024-09-12T00:42:23.565 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar 2024-09-12T00:42:23.583 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/66 kB Progress (1): 32/66 kB Progress (1): 49/66 kB Progress (1): 65/66 kB Progress (1): 66 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar (66 kB at 3.6 MB/s) 2024-09-12T00:42:23.589 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom 2024-09-12T00:42:23.605 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom (5.3 kB at 313 kB/s) 2024-09-12T00:42:23.607 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom 2024-09-12T00:42:23.624 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom (22 kB at 1.4 MB/s) 2024-09-12T00:42:23.629 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom 2024-09-12T00:42:23.646 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/50 kB Progress (1): 33/50 kB Progress (1): 49/50 kB Progress (1): 50 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom (50 kB at 2.9 MB/s) 2024-09-12T00:42:23.651 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom 2024-09-12T00:42:23.667 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom (24 kB at 1.5 MB/s) 2024-09-12T00:42:23.675 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom 2024-09-12T00:42:23.690 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom (5.6 kB at 352 kB/s) 2024-09-12T00:42:23.694 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar 2024-09-12T00:42:23.711 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 15/45 kB Progress (1): 31/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar (45 kB at 2.6 MB/s) 2024-09-12T00:42:23.718 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom 2024-09-12T00:42:23.733 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom (6.8 kB at 451 kB/s) 2024-09-12T00:42:23.736 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom 2024-09-12T00:42:23.752 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom (9.9 kB at 619 kB/s) 2024-09-12T00:42:23.755 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom 2024-09-12T00:42:23.771 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/46 kB Progress (1): 33/46 kB Progress (1): 46 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom (46 kB at 2.7 MB/s) 2024-09-12T00:42:23.775 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom 2024-09-12T00:42:23.791 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom (20 kB at 1.3 MB/s) 2024-09-12T00:42:23.796 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar 2024-09-12T00:42:23.812 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar (27 kB at 1.7 MB/s) 2024-09-12T00:42:23.825 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom 2024-09-12T00:42:23.842 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom (6.1 kB at 380 kB/s) 2024-09-12T00:42:23.844 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom 2024-09-12T00:42:23.860 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom (21 kB at 1.3 MB/s) 2024-09-12T00:42:23.866 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom 2024-09-12T00:42:23.883 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom (20 kB at 1.2 MB/s) 2024-09-12T00:42:23.893 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom 2024-09-12T00:42:23.910 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 4.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom (4.0 kB at 236 kB/s) 2024-09-12T00:42:23.913 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom 2024-09-12T00:42:23.928 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 1.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom (1.6 kB at 97 kB/s) 2024-09-12T00:42:23.930 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom 2024-09-12T00:42:23.947 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom (2.2 kB at 139 kB/s) 2024-09-12T00:42:23.951 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom 2024-09-12T00:42:23.966 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 3.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom (3.6 kB at 227 kB/s) 2024-09-12T00:42:23.972 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom 2024-09-12T00:42:23.986 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom (3.2 kB at 215 kB/s) 2024-09-12T00:42:23.990 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom 2024-09-12T00:42:24.006 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom (11 kB at 645 kB/s) 2024-09-12T00:42:24.010 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom 2024-09-12T00:42:24.025 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom (1.7 kB at 112 kB/s) 2024-09-12T00:42:24.028 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom 2024-09-12T00:42:24.044 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom (3.8 kB at 255 kB/s) 2024-09-12T00:42:24.047 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom 2024-09-12T00:42:24.063 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom (4.9 kB at 307 kB/s) 2024-09-12T00:42:24.066 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom 2024-09-12T00:42:24.080 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom (1.2 kB at 77 kB/s) 2024-09-12T00:42:24.083 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom 2024-09-12T00:42:24.097 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom (3.8 kB at 256 kB/s) 2024-09-12T00:42:24.099 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom 2024-09-12T00:42:24.114 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom (14 kB at 920 kB/s) 2024-09-12T00:42:24.116 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom 2024-09-12T00:42:24.135 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 3.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom (3.7 kB at 204 kB/s) 2024-09-12T00:42:24.138 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom 2024-09-12T00:42:24.154 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom (2.5 kB at 144 kB/s) 2024-09-12T00:42:24.158 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom 2024-09-12T00:42:24.176 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 2.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom (2.9 kB at 182 kB/s) 2024-09-12T00:42:24.177 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom 2024-09-12T00:42:24.194 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 7.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom (7.4 kB at 436 kB/s) 2024-09-12T00:42:24.197 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom 2024-09-12T00:42:24.214 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 5.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom (5.5 kB at 321 kB/s) 2024-09-12T00:42:24.218 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom 2024-09-12T00:42:24.234 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom (3.5 kB at 218 kB/s) 2024-09-12T00:42:24.238 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom 2024-09-12T00:42:24.254 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 4.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom (4.4 kB at 275 kB/s) 2024-09-12T00:42:24.256 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom 2024-09-12T00:42:24.271 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom (2.4 kB at 150 kB/s) 2024-09-12T00:42:24.275 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom 2024-09-12T00:42:24.291 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom (6.4 kB at 402 kB/s) 2024-09-12T00:42:24.294 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom 2024-09-12T00:42:24.309 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom (6.1 kB at 404 kB/s) 2024-09-12T00:42:24.313 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom 2024-09-12T00:42:24.328 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom (3.0 kB at 198 kB/s) 2024-09-12T00:42:24.331 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom 2024-09-12T00:42:24.346 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom (3.5 kB at 217 kB/s) 2024-09-12T00:42:24.350 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom 2024-09-12T00:42:24.365 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom (4.1 kB at 255 kB/s) 2024-09-12T00:42:24.367 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom 2024-09-12T00:42:24.383 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom (1.8 kB at 118 kB/s) 2024-09-12T00:42:24.386 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom 2024-09-12T00:42:24.401 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom (6.6 kB at 441 kB/s) 2024-09-12T00:42:24.403 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom 2024-09-12T00:42:24.418 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom (16 kB at 1.1 MB/s) 2024-09-12T00:42:24.420 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom 2024-09-12T00:42:24.435 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/35 kB Progress (1): 32/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom (35 kB at 2.2 MB/s) 2024-09-12T00:42:24.438 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom 2024-09-12T00:42:24.453 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom (17 kB at 1.1 MB/s) 2024-09-12T00:42:24.456 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom 2024-09-12T00:42:24.471 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom (5.0 kB at 331 kB/s) 2024-09-12T00:42:24.472 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom 2024-09-12T00:42:24.487 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom (13 kB at 878 kB/s) 2024-09-12T00:42:24.491 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom 2024-09-12T00:42:24.516 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom (14 kB at 537 kB/s) 2024-09-12T00:42:24.519 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom 2024-09-12T00:42:24.536 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/68 kB Progress (1): 32/68 kB Progress (1): 49/68 kB Progress (1): 65/68 kB Progress (1): 68 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom (68 kB at 3.8 MB/s) 2024-09-12T00:42:24.542 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2024-09-12T00:42:24.557 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 kB at 1.0 MB/s) 2024-09-12T00:42:24.561 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom 2024-09-12T00:42:24.576 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom (15 kB at 1.0 MB/s) 2024-09-12T00:42:24.578 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom 2024-09-12T00:42:24.595 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/79 kB Progress (1): 32/79 kB Progress (1): 49/79 kB Progress (1): 65/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom (79 kB at 4.7 MB/s) 2024-09-12T00:42:24.600 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom 2024-09-12T00:42:24.616 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom (18 kB at 1.2 MB/s) 2024-09-12T00:42:24.620 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom 2024-09-12T00:42:24.636 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom (20 kB at 1.2 MB/s) 2024-09-12T00:42:24.640 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom 2024-09-12T00:42:24.658 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom (78 kB at 4.3 MB/s) 2024-09-12T00:42:24.666 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom 2024-09-12T00:42:24.682 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom (3.8 kB at 240 kB/s) 2024-09-12T00:42:24.684 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom 2024-09-12T00:42:24.699 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom (14 kB at 920 kB/s) 2024-09-12T00:42:24.702 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom 2024-09-12T00:42:24.717 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom (3.2 kB at 214 kB/s) 2024-09-12T00:42:24.719 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom 2024-09-12T00:42:24.735 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom (3.2 kB at 199 kB/s) 2024-09-12T00:42:24.737 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom 2024-09-12T00:42:24.752 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom (2.0 kB at 136 kB/s) 2024-09-12T00:42:24.755 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom 2024-09-12T00:42:24.771 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom (2.8 kB at 177 kB/s) 2024-09-12T00:42:24.773 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom 2024-09-12T00:42:24.788 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom (1.5 kB at 95 kB/s) 2024-09-12T00:42:24.790 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom 2024-09-12T00:42:24.806 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom (3.0 kB at 201 kB/s) 2024-09-12T00:42:24.808 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom 2024-09-12T00:42:24.823 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom (3.2 kB at 200 kB/s) 2024-09-12T00:42:24.825 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom 2024-09-12T00:42:24.841 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom (3.2 kB at 200 kB/s) 2024-09-12T00:42:24.844 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom 2024-09-12T00:42:24.861 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 1.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom (1.0 kB at 60 kB/s) 2024-09-12T00:42:24.864 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom 2024-09-12T00:42:24.880 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 964 B Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom (964 B at 64 kB/s) 2024-09-12T00:42:24.882 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom 2024-09-12T00:42:24.897 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom (3.1 kB at 203 kB/s) 2024-09-12T00:42:24.899 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom 2024-09-12T00:42:24.914 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom (3.0 kB at 202 kB/s) 2024-09-12T00:42:24.916 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom 2024-09-12T00:42:24.932 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom (3.4 kB at 229 kB/s) 2024-09-12T00:42:24.934 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom 2024-09-12T00:42:24.949 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom (3.4 kB at 215 kB/s) 2024-09-12T00:42:24.951 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom 2024-09-12T00:42:24.967 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom (3.0 kB at 202 kB/s) 2024-09-12T00:42:24.983 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar 2024-09-12T00:42:25.070 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3 MB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar (3.3 MB at 38 MB/s) 2024-09-12T00:42:25.071 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar 2024-09-12T00:42:25.071 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar 2024-09-12T00:42:25.071 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar 2024-09-12T00:42:25.072 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar 2024-09-12T00:42:25.072 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar 2024-09-12T00:42:25.090 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/98 kB Progress (1): 33/98 kB Progress (1): 49/98 kB Progress (1): 62/98 kB Progress (1): 78/98 kB Progress (1): 95/98 kB Progress (1): 98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar (98 kB at 4.7 MB/s) 2024-09-12T00:42:25.091 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar 2024-09-12T00:42:25.107 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/16 kB Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar (16 kB at 458 kB/s) 2024-09-12T00:42:25.107 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar 2024-09-12T00:42:25.124 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 1.4/16 kB Progress (1): 2.8/16 kB Progress (1): 4.1/16 kB Progress (1): 5.5/16 kB Progress (1): 6.9/16 kB Progress (2): 6.9/16 kB | 1.4/35 kB Progress (2): 8.3/16 kB | 1.4/35 kB Progress (2): 8.3/16 kB | 2.8/35 kB Progress (2): 9.7/16 kB | 2.8/35 kB Progress (2): 9.7/16 kB | 4.1/35 kB Progress (3): 9.7/16 kB | 4.1/35 kB | 1.4/71 kB Progress (3): 9.7/16 kB | 5.5/35 kB | 1.4/71 kB Progress (3): 9.7/16 kB | 5.5/35 kB | 2.8/71 kB Progress (3): 9.7/16 kB | 6.9/35 kB | 2.8/71 kB Progress (3): 9.7/16 kB | 6.9/35 kB | 4.1/71 kB Progress (3): 11/16 kB | 6.9/35 kB | 4.1/71 kB Progress (3): 11/16 kB | 8.3/35 kB | 4.1/71 kB Progress (3): 11/16 kB | 8.3/35 kB | 5.5/71 kB Progress (3): 12/16 kB | 8.3/35 kB | 5.5/71 kB Progress (3): 12/16 kB | 9.7/35 kB | 5.5/71 kB Progress (3): 14/16 kB | 9.7/35 kB | 5.5/71 kB Progress (3): 14/16 kB | 9.7/35 kB | 6.9/71 kB Progress (3): 15/16 kB | 9.7/35 kB | 6.9/71 kB Progress (3): 15/16 kB | 11/35 kB | 6.9/71 kB Progress (3): 16 kB | 11/35 kB | 6.9/71 kB Progress (3): 16 kB | 11/35 kB | 8.3/71 kB Progress (3): 16 kB | 12/35 kB | 8.3/71 kB Progress (3): 16 kB | 12/35 kB | 9.7/71 kB Progress (3): 16 kB | 14/35 kB | 9.7/71 kB Progress (3): 16 kB | 14/35 kB | 11/71 kB Progress (3): 16 kB | 15/35 kB | 11/71 kB Progress (3): 16 kB | 15/35 kB | 12/71 kB Progress (3): 16 kB | 16/35 kB | 12/71 kB Progress (3): 16 kB | 16/35 kB | 14/71 kB Progress (3): 16 kB | 16/35 kB | 15/71 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar (16 kB at 343 kB/s) 2024-09-12T00:42:25.124 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (2): 18/35 kB | 15/71 kB Progress (2): 18/35 kB | 16/71 kB Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar 2024-09-12T00:42:25.135 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (2): 19/35 kB | 16/71 kB Progress (2): 19/35 kB | 18/71 kB Progress (2): 19/35 kB | 19/71 kB Progress (3): 19/35 kB | 19/71 kB | 1.4/49 kB Progress (3): 21/35 kB | 19/71 kB | 1.4/49 kB Progress (3): 21/35 kB | 19/71 kB | 2.8/49 kB Progress (3): 22/35 kB | 19/71 kB | 2.8/49 kB Progress (3): 22/35 kB | 19/71 kB | 4.1/49 kB Progress (3): 22/35 kB | 21/71 kB | 4.1/49 kB Progress (3): 23/35 kB | 21/71 kB | 4.1/49 kB Progress (3): 23/35 kB | 21/71 kB | 5.5/49 kB Progress (3): 23/35 kB | 22/71 kB | 5.5/49 kB Progress (3): 23/35 kB | 22/71 kB | 6.9/49 kB Progress (3): 23/35 kB | 23/71 kB | 6.9/49 kB Progress (3): 23/35 kB | 23/71 kB | 8.3/49 kB Progress (3): 23/35 kB | 23/71 kB | 9.7/49 kB Progress (3): 25/35 kB | 23/71 kB | 9.7/49 kB Progress (3): 25/35 kB | 23/71 kB | 11/49 kB Progress (3): 26/35 kB | 23/71 kB | 11/49 kB Progress (3): 26/35 kB | 23/71 kB | 12/49 kB Progress (3): 26/35 kB | 25/71 kB | 12/49 kB Progress (3): 26/35 kB | 25/71 kB | 14/49 kB Progress (3): 26/35 kB | 26/71 kB | 14/49 kB Progress (3): 26/35 kB | 26/71 kB | 15/49 kB Progress (3): 26/35 kB | 27/71 kB | 15/49 kB Progress (3): 27/35 kB | 27/71 kB | 15/49 kB Progress (3): 27/35 kB | 27/71 kB | 17/49 kB Progress (3): 29/35 kB | 27/71 kB | 17/49 kB Progress (3): 30/35 kB | 27/71 kB | 17/49 kB Progress (3): 30/35 kB | 27/71 kB | 18/49 kB Progress (3): 30/35 kB | 27/71 kB | 19/49 kB Progress (3): 30/35 kB | 29/71 kB | 19/49 kB Progress (3): 30/35 kB | 30/71 kB | 19/49 kB Progress (3): 30/35 kB | 30/71 kB | 21/49 kB Progress (3): 30/35 kB | 30/71 kB | 22/49 kB Progress (3): 30/35 kB | 30/71 kB | 23/49 kB Progress (3): 30/35 kB | 30/71 kB | 25/49 kB Progress (3): 30/35 kB | 30/71 kB | 26/49 kB Progress (3): 30/35 kB | 30/71 kB | 28/49 kB Progress (3): 30/35 kB | 30/71 kB | 29/49 kB Progress (3): 30/35 kB | 30/71 kB | 30/49 kB Progress (4): 30/35 kB | 30/71 kB | 30/49 kB | 16/782 kB Progress (4): 30/35 kB | 30/71 kB | 30/49 kB | 33/782 kB Progress (4): 30/35 kB | 30/71 kB | 30/49 kB | 49/782 kB Progress (4): 30/35 kB | 30/71 kB | 30/49 kB | 65/782 kB Progress (4): 30/35 kB | 30/71 kB | 30/49 kB | 81/782 kB Progress (4): 30/35 kB | 30/71 kB | 30/49 kB | 98/782 kB Progress (4): 30/35 kB | 30/71 kB | 30/49 kB | 114/782 kB Progress (4): 30/35 kB | 30/71 kB | 30/49 kB | 130/782 kB Progress (4): 30/35 kB | 30/71 kB | 30/49 kB | 147/782 kB Progress (4): 30/35 kB | 30/71 kB | 30/49 kB | 163/782 kB Progress (4): 30/35 kB | 30/71 kB | 30/49 kB | 180/782 kB Progress (4): 30/35 kB | 30/71 kB | 30/49 kB | 196/782 kB Progress (4): 30/35 kB | 30/71 kB | 30/49 kB | 212/782 kB Progress (4): 30/35 kB | 30/71 kB | 30/49 kB | 229/782 kB Progress (4): 30/35 kB | 30/71 kB | 30/49 kB | 245/782 kB Progress (4): 30/35 kB | 30/71 kB | 30/49 kB | 262/782 kB Progress (4): 30/35 kB | 30/71 kB | 30/49 kB | 278/782 kB Progress (4): 30/35 kB | 30/71 kB | 30/49 kB | 294/782 kB Progress (4): 30/35 kB | 30/71 kB | 30/49 kB | 311/782 kB Progress (4): 30/35 kB | 30/71 kB | 30/49 kB | 327/782 kB Progress (4): 30/35 kB | 30/71 kB | 30/49 kB | 343/782 kB Progress (4): 30/35 kB | 30/71 kB | 30/49 kB | 360/782 kB Progress (4): 30/35 kB | 30/71 kB | 30/49 kB | 376/782 kB Progress (4): 30/35 kB | 30/71 kB | 30/49 kB | 393/782 kB Progress (4): 30/35 kB | 30/71 kB | 30/49 kB | 409/782 kB Progress (4): 32/35 kB | 30/71 kB | 30/49 kB | 409/782 kB Progress (4): 33/35 kB | 30/71 kB | 30/49 kB | 409/782 kB Progress (4): 33/35 kB | 30/71 kB | 30/49 kB | 421/782 kB Progress (4): 34/35 kB | 30/71 kB | 30/49 kB | 421/782 kB Progress (4): 35 kB | 30/71 kB | 30/49 kB | 421/782 kB Progress (4): 35 kB | 32/71 kB | 30/49 kB | 421/782 kB Progress (4): 35 kB | 32/71 kB | 30/49 kB | 438/782 kB Progress (4): 35 kB | 33/71 kB | 30/49 kB | 438/782 kB Progress (4): 35 kB | 34/71 kB | 30/49 kB | 438/782 kB Progress (4): 35 kB | 34/71 kB | 30/49 kB | 454/782 kB Progress (4): 35 kB | 36/71 kB | 30/49 kB | 454/782 kB Progress (4): 35 kB | 37/71 kB | 30/49 kB | 454/782 kB Progress (4): 35 kB | 38/71 kB | 30/49 kB | 454/782 kB Progress (4): 35 kB | 38/71 kB | 30/49 kB | 470/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar (35 kB at 596 kB/s) 2024-09-12T00:42:25.135 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar 2024-09-12T00:42:25.135 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (3): 38/71 kB | 30/49 kB | 487/782 kB Progress (3): 38/71 kB | 30/49 kB | 503/782 kB Progress (3): 40/71 kB | 30/49 kB | 503/782 kB Progress (3): 40/71 kB | 30/49 kB | 520/782 kB Progress (3): 41/71 kB | 30/49 kB | 520/782 kB Progress (3): 43/71 kB | 30/49 kB | 520/782 kB Progress (3): 44/71 kB | 30/49 kB | 520/782 kB Progress (3): 44/71 kB | 32/49 kB | 520/782 kB Progress (3): 45/71 kB | 32/49 kB | 520/782 kB Progress (3): 45/71 kB | 33/49 kB | 520/782 kB Progress (3): 47/71 kB | 33/49 kB | 520/782 kB Progress (3): 47/71 kB | 33/49 kB | 536/782 kB Progress (3): 47/71 kB | 34/49 kB | 536/782 kB Progress (3): 47/71 kB | 36/49 kB | 536/782 kB Progress (3): 48/71 kB | 36/49 kB | 536/782 kB Progress (3): 49/71 kB | 36/49 kB | 536/782 kB Progress (3): 51/71 kB | 36/49 kB | 536/782 kB Progress (3): 51/71 kB | 36/49 kB | 552/782 kB Progress (3): 52/71 kB | 36/49 kB | 552/782 kB Progress (3): 54/71 kB | 36/49 kB | 552/782 kB Progress (3): 54/71 kB | 37/49 kB | 552/782 kB Progress (3): 54/71 kB | 39/49 kB | 552/782 kB Progress (3): 54/71 kB | 39/49 kB | 569/782 kB Progress (3): 54/71 kB | 40/49 kB | 569/782 kB Progress (3): 54/71 kB | 41/49 kB | 569/782 kB Progress (3): 54/71 kB | 41/49 kB | 585/782 kB Progress (3): 54/71 kB | 43/49 kB | 585/782 kB Progress (3): 54/71 kB | 43/49 kB | 601/782 kB Progress (3): 54/71 kB | 44/49 kB | 601/782 kB Progress (3): 54/71 kB | 46/49 kB | 601/782 kB Progress (4): 54/71 kB | 46/49 kB | 601/782 kB | 1.4/11 kB Progress (4): 54/71 kB | 47/49 kB | 601/782 kB | 1.4/11 kB Progress (4): 54/71 kB | 47/49 kB | 601/782 kB | 2.8/11 kB Progress (4): 55/71 kB | 47/49 kB | 601/782 kB | 2.8/11 kB Progress (4): 55/71 kB | 47/49 kB | 601/782 kB | 4.1/11 kB Progress (4): 56/71 kB | 47/49 kB | 601/782 kB | 4.1/11 kB Progress (4): 56/71 kB | 48/49 kB | 601/782 kB | 4.1/11 kB Progress (4): 56/71 kB | 48/49 kB | 618/782 kB | 4.1/11 kB Progress (4): 58/71 kB | 48/49 kB | 618/782 kB | 4.1/11 kB Progress (4): 58/71 kB | 48/49 kB | 618/782 kB | 5.5/11 kB Progress (4): 59/71 kB | 48/49 kB | 618/782 kB | 5.5/11 kB Progress (4): 59/71 kB | 49 kB | 618/782 kB | 5.5/11 kB Progress (4): 61/71 kB | 49 kB | 618/782 kB | 5.5/11 kB Progress (4): 61/71 kB | 49 kB | 618/782 kB | 6.9/11 kB Progress (4): 62/71 kB | 49 kB | 618/782 kB | 6.9/11 kB Progress (4): 62/71 kB | 49 kB | 634/782 kB | 6.9/11 kB Progress (4): 62/71 kB | 49 kB | 634/782 kB | 8.3/11 kB Progress (4): 62/71 kB | 49 kB | 634/782 kB | 8.3/11 kB Progress (4): 62/71 kB | 49 kB | 634/782 kB | 9.7/11 kB Progress (4): 62/71 kB | 49 kB | 634/782 kB | 11/11 kB Progress (4): 62/71 kB | 49 kB | 634/782 kB | 11 kB Progress (4): 62/71 kB | 49 kB | 651/782 kB | 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar (49 kB at 794 kB/s) 2024-09-12T00:42:25.135 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar 2024-09-12T00:42:25.135 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (3): 62/71 kB | 667/782 kB | 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar (11 kB at 186 kB/s) 2024-09-12T00:42:25.135 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar 2024-09-12T00:42:25.137 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (2): 62/71 kB | 683/782 kB Progress (2): 62/71 kB | 700/782 kB Progress (2): 62/71 kB | 716/782 kB Progress (2): 62/71 kB | 733/782 kB Progress (2): 62/71 kB | 749/782 kB Progress (2): 62/71 kB | 765/782 kB Progress (2): 62/71 kB | 782/782 kB Progress (2): 62/71 kB | 782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar (782 kB at 12 MB/s) 2024-09-12T00:42:25.137 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar 2024-09-12T00:42:25.143 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 71 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar (71 kB at 980 kB/s) 2024-09-12T00:42:25.143 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar 2024-09-12T00:42:25.154 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 1.4/205 kB Progress (1): 2.8/205 kB Progress (1): 4.1/205 kB Progress (1): 5.5/205 kB Progress (1): 6.9/205 kB Progress (1): 8.3/205 kB Progress (1): 9.7/205 kB Progress (1): 11/205 kB Progress (1): 12/205 kB Progress (1): 14/205 kB Progress (1): 15/205 kB Progress (1): 16/205 kB Progress (1): 33/205 kB Progress (2): 33/205 kB | 1.4/30 kB Progress (2): 33/205 kB | 2.8/30 kB Progress (2): 33/205 kB | 4.1/30 kB Progress (2): 33/205 kB | 5.5/30 kB Progress (2): 33/205 kB | 6.9/30 kB Progress (2): 33/205 kB | 8.3/30 kB Progress (2): 33/205 kB | 9.7/30 kB Progress (2): 33/205 kB | 11/30 kB Progress (2): 33/205 kB | 12/30 kB Progress (2): 33/205 kB | 14/30 kB Progress (2): 33/205 kB | 15/30 kB Progress (3): 33/205 kB | 15/30 kB | 16/81 kB Progress (3): 33/205 kB | 17/30 kB | 16/81 kB Progress (3): 33/205 kB | 18/30 kB | 16/81 kB Progress (3): 33/205 kB | 19/30 kB | 16/81 kB Progress (3): 33/205 kB | 21/30 kB | 16/81 kB Progress (3): 33/205 kB | 22/30 kB | 16/81 kB Progress (3): 33/205 kB | 23/30 kB | 16/81 kB Progress (3): 33/205 kB | 25/30 kB | 16/81 kB Progress (4): 33/205 kB | 25/30 kB | 16/81 kB | 16/798 kB Progress (4): 33/205 kB | 26/30 kB | 16/81 kB | 16/798 kB Progress (4): 33/205 kB | 26/30 kB | 33/81 kB | 16/798 kB Progress (4): 33/205 kB | 26/30 kB | 33/81 kB | 33/798 kB Progress (4): 33/205 kB | 28/30 kB | 33/81 kB | 33/798 kB Progress (4): 33/205 kB | 28/30 kB | 33/81 kB | 49/798 kB Progress (4): 33/205 kB | 29/30 kB | 33/81 kB | 49/798 kB Progress (4): 33/205 kB | 30 kB | 33/81 kB | 49/798 kB Progress (4): 33/205 kB | 30 kB | 33/81 kB | 66/798 kB Progress (4): 33/205 kB | 30 kB | 33/81 kB | 82/798 kB Progress (4): 33/205 kB | 30 kB | 33/81 kB | 97/798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar (30 kB at 373 kB/s) 2024-09-12T00:42:25.154 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (3): 33/205 kB | 33/81 kB | 114/798 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar 2024-09-12T00:42:25.159 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (3): 33/205 kB | 49/81 kB | 114/798 kB Progress (3): 33/205 kB | 49/81 kB | 130/798 kB Progress (3): 33/205 kB | 49/81 kB | 146/798 kB Progress (3): 33/205 kB | 49/81 kB | 163/798 kB Progress (3): 33/205 kB | 49/81 kB | 179/798 kB Progress (3): 33/205 kB | 64/81 kB | 179/798 kB Progress (3): 33/205 kB | 64/81 kB | 195/798 kB Progress (3): 33/205 kB | 64/81 kB | 212/798 kB Progress (3): 33/205 kB | 64/81 kB | 228/798 kB Progress (3): 33/205 kB | 64/81 kB | 245/798 kB Progress (3): 33/205 kB | 64/81 kB | 261/798 kB Progress (3): 33/205 kB | 64/81 kB | 277/798 kB Progress (3): 33/205 kB | 64/81 kB | 294/798 kB Progress (3): 33/205 kB | 64/81 kB | 310/798 kB Progress (3): 33/205 kB | 64/81 kB | 327/798 kB Progress (3): 33/205 kB | 64/81 kB | 343/798 kB Progress (3): 49/205 kB | 64/81 kB | 343/798 kB Progress (3): 49/205 kB | 64/81 kB | 359/798 kB Progress (3): 49/205 kB | 64/81 kB | 376/798 kB Progress (4): 49/205 kB | 64/81 kB | 376/798 kB | 13 kB Progress (4): 49/205 kB | 64/81 kB | 392/798 kB | 13 kB Progress (4): 64/205 kB | 64/81 kB | 392/798 kB | 13 kB Progress (4): 64/205 kB | 64/81 kB | 408/798 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar (13 kB at 154 kB/s) 2024-09-12T00:42:25.159 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (3): 64/205 kB | 64/81 kB | 425/798 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar 2024-09-12T00:42:25.164 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (3): 64/205 kB | 64/81 kB | 441/798 kB Progress (3): 64/205 kB | 64/81 kB | 458/798 kB Progress (3): 64/205 kB | 64/81 kB | 474/798 kB Progress (3): 80/205 kB | 64/81 kB | 474/798 kB Progress (3): 80/205 kB | 64/81 kB | 490/798 kB Progress (3): 80/205 kB | 64/81 kB | 507/798 kB Progress (3): 80/205 kB | 64/81 kB | 523/798 kB Progress (3): 80/205 kB | 64/81 kB | 540/798 kB Progress (3): 80/205 kB | 64/81 kB | 556/798 kB Progress (3): 80/205 kB | 64/81 kB | 572/798 kB Progress (3): 97/205 kB | 64/81 kB | 572/798 kB Progress (3): 97/205 kB | 64/81 kB | 589/798 kB Progress (3): 97/205 kB | 64/81 kB | 605/798 kB Progress (3): 97/205 kB | 64/81 kB | 621/798 kB Progress (3): 97/205 kB | 64/81 kB | 638/798 kB Progress (3): 113/205 kB | 64/81 kB | 638/798 kB Progress (3): 113/205 kB | 64/81 kB | 654/798 kB Progress (3): 113/205 kB | 64/81 kB | 671/798 kB Progress (3): 113/205 kB | 81/81 kB | 671/798 kB Progress (3): 113/205 kB | 81/81 kB | 687/798 kB Progress (3): 113/205 kB | 81 kB | 687/798 kB Progress (3): 130/205 kB | 81 kB | 687/798 kB Progress (3): 130/205 kB | 81 kB | 703/798 kB Progress (3): 130/205 kB | 81 kB | 720/798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar (81 kB at 893 kB/s) 2024-09-12T00:42:25.164 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar 2024-09-12T00:42:25.165 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (2): 130/205 kB | 736/798 kB Progress (2): 130/205 kB | 753/798 kB Progress (2): 130/205 kB | 769/798 kB Progress (2): 130/205 kB | 785/798 kB Progress (2): 130/205 kB | 798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar (798 kB at 8.6 MB/s) 2024-09-12T00:42:25.166 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar 2024-09-12T00:42:25.172 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (2): 130/205 kB | 16/182 kB Progress (2): 146/205 kB | 16/182 kB Progress (2): 162/205 kB | 16/182 kB Progress (2): 179/205 kB | 16/182 kB Progress (2): 179/205 kB | 33/182 kB Progress (2): 195/205 kB | 33/182 kB Progress (2): 205 kB | 33/182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar (205 kB at 2.1 MB/s) 2024-09-12T00:42:25.172 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar 2024-09-12T00:42:25.180 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 49/182 kB Progress (1): 62/182 kB Progress (2): 62/182 kB | 16/151 kB Progress (2): 62/182 kB | 33/151 kB Progress (2): 62/182 kB | 49/151 kB Progress (2): 62/182 kB | 63/151 kB Progress (3): 62/182 kB | 63/151 kB | 16/27 kB Progress (3): 62/182 kB | 63/151 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar (27 kB at 255 kB/s) 2024-09-12T00:42:25.181 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar 2024-09-12T00:42:25.182 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (2): 78/182 kB | 63/151 kB Progress (3): 78/182 kB | 63/151 kB | 16/30 kB Progress (3): 78/182 kB | 63/151 kB | 30 kB Progress (3): 95/182 kB | 63/151 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar (30 kB at 278 kB/s) 2024-09-12T00:42:25.182 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar 2024-09-12T00:42:25.188 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (2): 111/182 kB | 63/151 kB Progress (2): 128/182 kB | 63/151 kB Progress (2): 144/182 kB | 63/151 kB Progress (2): 160/182 kB | 63/151 kB Progress (2): 177/182 kB | 63/151 kB Progress (2): 177/182 kB | 79/151 kB Progress (3): 177/182 kB | 79/151 kB | 16/385 kB Progress (3): 182 kB | 79/151 kB | 16/385 kB Progress (3): 182 kB | 79/151 kB | 33/385 kB Progress (3): 182 kB | 96/151 kB | 33/385 kB Progress (3): 182 kB | 96/151 kB | 49/385 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar (182 kB at 1.6 MB/s) 2024-09-12T00:42:25.188 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (2): 96/151 kB | 66/385 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar 2024-09-12T00:42:25.192 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (2): 96/151 kB | 82/385 kB Progress (2): 112/151 kB | 82/385 kB Progress (2): 112/151 kB | 98/385 kB Progress (2): 112/151 kB | 113/385 kB Progress (2): 112/151 kB | 129/385 kB Progress (2): 128/151 kB | 129/385 kB Progress (2): 128/151 kB | 145/385 kB Progress (2): 128/151 kB | 162/385 kB Progress (2): 145/151 kB | 162/385 kB Progress (2): 145/151 kB | 178/385 kB Progress (2): 145/151 kB | 195/385 kB Progress (2): 151 kB | 195/385 kB Progress (2): 151 kB | 211/385 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar (151 kB at 1.3 MB/s) 2024-09-12T00:42:25.192 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 227/385 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar 2024-09-12T00:42:25.195 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 244/385 kB Progress (1): 260/385 kB Progress (2): 260/385 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar (13 kB at 108 kB/s) 2024-09-12T00:42:25.196 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar 2024-09-12T00:42:25.198 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (2): 260/385 kB | 16/75 kB Progress (2): 260/385 kB | 33/75 kB Progress (2): 260/385 kB | 49/75 kB Progress (2): 260/385 kB | 64/75 kB Progress (2): 260/385 kB | 75 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar (75 kB at 601 kB/s) 2024-09-12T00:42:25.198 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar 2024-09-12T00:42:25.201 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 277/385 kB Progress (1): 293/385 kB Progress (1): 309/385 kB Progress (1): 326/385 kB Progress (1): 342/385 kB Progress (1): 358/385 kB Progress (1): 375/385 kB Progress (1): 385 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar (385 kB at 3.0 MB/s) 2024-09-12T00:42:25.201 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar 2024-09-12T00:42:25.234 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/780 kB Progress (1): 33/780 kB Progress (1): 49/780 kB Progress (1): 62/780 kB Progress (1): 79/780 kB Progress (1): 95/780 kB Progress (1): 111/780 kB Progress (1): 128/780 kB Progress (1): 144/780 kB Progress (1): 161/780 kB Progress (1): 177/780 kB Progress (2): 177/780 kB | 16/329 kB Progress (2): 193/780 kB | 16/329 kB Progress (2): 193/780 kB | 32/329 kB Progress (2): 210/780 kB | 32/329 kB Progress (2): 210/780 kB | 49/329 kB Progress (2): 210/780 kB | 65/329 kB Progress (2): 226/780 kB | 65/329 kB Progress (2): 226/780 kB | 80/329 kB Progress (2): 242/780 kB | 80/329 kB Progress (2): 242/780 kB | 96/329 kB Progress (2): 242/780 kB | 112/329 kB Progress (2): 242/780 kB | 129/329 kB Progress (2): 242/780 kB | 145/329 kB Progress (2): 242/780 kB | 162/329 kB Progress (2): 242/780 kB | 178/329 kB Progress (2): 242/780 kB | 194/329 kB Progress (2): 242/780 kB | 211/329 kB Progress (3): 242/780 kB | 211/329 kB | 16/501 kB Progress (4): 242/780 kB | 211/329 kB | 16/501 kB | 16/354 kB Progress (4): 242/780 kB | 211/329 kB | 33/501 kB | 16/354 kB Progress (4): 242/780 kB | 211/329 kB | 33/501 kB | 33/354 kB Progress (4): 242/780 kB | 211/329 kB | 33/501 kB | 49/354 kB Progress (4): 242/780 kB | 211/329 kB | 49/501 kB | 49/354 kB Progress (4): 242/780 kB | 211/329 kB | 49/501 kB | 62/354 kB Progress (4): 242/780 kB | 211/329 kB | 49/501 kB | 79/354 kB Progress (4): 242/780 kB | 211/329 kB | 62/501 kB | 79/354 kB Progress (4): 259/780 kB | 211/329 kB | 62/501 kB | 79/354 kB Progress (4): 259/780 kB | 211/329 kB | 62/501 kB | 95/354 kB Progress (4): 275/780 kB | 211/329 kB | 62/501 kB | 95/354 kB Progress (4): 275/780 kB | 211/329 kB | 62/501 kB | 112/354 kB Progress (4): 292/780 kB | 211/329 kB | 62/501 kB | 112/354 kB Progress (4): 292/780 kB | 211/329 kB | 62/501 kB | 128/354 kB Progress (4): 292/780 kB | 211/329 kB | 78/501 kB | 128/354 kB Progress (4): 292/780 kB | 211/329 kB | 78/501 kB | 144/354 kB Progress (4): 292/780 kB | 211/329 kB | 94/501 kB | 144/354 kB Progress (4): 292/780 kB | 211/329 kB | 94/501 kB | 161/354 kB Progress (4): 308/780 kB | 211/329 kB | 94/501 kB | 161/354 kB Progress (4): 308/780 kB | 211/329 kB | 111/501 kB | 161/354 kB Progress (4): 308/780 kB | 211/329 kB | 111/501 kB | 177/354 kB Progress (4): 324/780 kB | 211/329 kB | 111/501 kB | 177/354 kB Progress (4): 341/780 kB | 211/329 kB | 111/501 kB | 177/354 kB Progress (4): 341/780 kB | 211/329 kB | 111/501 kB | 194/354 kB Progress (4): 341/780 kB | 211/329 kB | 127/501 kB | 194/354 kB Progress (4): 357/780 kB | 211/329 kB | 127/501 kB | 194/354 kB Progress (4): 357/780 kB | 211/329 kB | 144/501 kB | 194/354 kB Progress (4): 357/780 kB | 211/329 kB | 144/501 kB | 210/354 kB Progress (4): 374/780 kB | 211/329 kB | 144/501 kB | 210/354 kB Progress (4): 390/780 kB | 211/329 kB | 144/501 kB | 210/354 kB Progress (4): 390/780 kB | 211/329 kB | 144/501 kB | 226/354 kB Progress (4): 406/780 kB | 211/329 kB | 144/501 kB | 226/354 kB Progress (4): 406/780 kB | 211/329 kB | 144/501 kB | 243/354 kB Progress (4): 423/780 kB | 211/329 kB | 144/501 kB | 243/354 kB Progress (5): 423/780 kB | 211/329 kB | 144/501 kB | 243/354 kB | 16/41 kB Progress (5): 423/780 kB | 211/329 kB | 144/501 kB | 259/354 kB | 16/41 kB Progress (5): 439/780 kB | 211/329 kB | 144/501 kB | 259/354 kB | 16/41 kB Progress (5): 439/780 kB | 227/329 kB | 144/501 kB | 259/354 kB | 16/41 kB Progress (5): 439/780 kB | 227/329 kB | 144/501 kB | 275/354 kB | 16/41 kB Progress (5): 439/780 kB | 227/329 kB | 144/501 kB | 275/354 kB | 32/41 kB Progress (5): 439/780 kB | 243/329 kB | 144/501 kB | 275/354 kB | 32/41 kB Progress (5): 455/780 kB | 243/329 kB | 144/501 kB | 275/354 kB | 32/41 kB Progress (5): 455/780 kB | 243/329 kB | 144/501 kB | 275/354 kB | 41 kB Progress (5): 455/780 kB | 243/329 kB | 144/501 kB | 292/354 kB | 41 kB Progress (5): 455/780 kB | 260/329 kB | 144/501 kB | 292/354 kB | 41 kB Progress (5): 472/780 kB | 260/329 kB | 144/501 kB | 292/354 kB | 41 kB Progress (5): 472/780 kB | 260/329 kB | 144/501 kB | 308/354 kB | 41 kB Progress (5): 488/780 kB | 260/329 kB | 144/501 kB | 308/354 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar (41 kB at 260 kB/s) 2024-09-12T00:42:25.234 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (4): 488/780 kB | 276/329 kB | 144/501 kB | 308/354 kB Progress (4): 488/780 kB | 276/329 kB | 144/501 kB | 325/354 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar 2024-09-12T00:42:25.234 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (4): 488/780 kB | 276/329 kB | 160/501 kB | 325/354 kB Progress (4): 505/780 kB | 276/329 kB | 160/501 kB | 325/354 kB Progress (4): 505/780 kB | 276/329 kB | 160/501 kB | 341/354 kB Progress (4): 505/780 kB | 293/329 kB | 160/501 kB | 341/354 kB Progress (4): 505/780 kB | 293/329 kB | 176/501 kB | 341/354 kB Progress (4): 521/780 kB | 293/329 kB | 176/501 kB | 341/354 kB Progress (4): 521/780 kB | 293/329 kB | 176/501 kB | 354 kB Progress (4): 521/780 kB | 309/329 kB | 176/501 kB | 354 kB Progress (4): 521/780 kB | 309/329 kB | 193/501 kB | 354 kB Progress (4): 537/780 kB | 309/329 kB | 193/501 kB | 354 kB Progress (4): 537/780 kB | 325/329 kB | 193/501 kB | 354 kB Progress (4): 537/780 kB | 325/329 kB | 209/501 kB | 354 kB Progress (4): 554/780 kB | 325/329 kB | 209/501 kB | 354 kB Progress (4): 554/780 kB | 329 kB | 209/501 kB | 354 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar (354 kB at 2.2 MB/s) 2024-09-12T00:42:25.234 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar 2024-09-12T00:42:25.236 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (3): 554/780 kB | 329 kB | 225/501 kB Progress (3): 570/780 kB | 329 kB | 225/501 kB Progress (3): 570/780 kB | 329 kB | 242/501 kB Progress (3): 587/780 kB | 329 kB | 242/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar (329 kB at 2.0 MB/s) 2024-09-12T00:42:25.236 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar 2024-09-12T00:42:25.238 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (2): 603/780 kB | 242/501 kB Progress (2): 603/780 kB | 258/501 kB Progress (2): 619/780 kB | 258/501 kB Progress (2): 619/780 kB | 275/501 kB Progress (2): 636/780 kB | 275/501 kB Progress (2): 652/780 kB | 275/501 kB Progress (2): 652/780 kB | 291/501 kB Progress (2): 668/780 kB | 291/501 kB Progress (2): 685/780 kB | 291/501 kB Progress (2): 685/780 kB | 307/501 kB Progress (2): 701/780 kB | 307/501 kB Progress (2): 701/780 kB | 324/501 kB Progress (2): 718/780 kB | 324/501 kB Progress (2): 734/780 kB | 324/501 kB Progress (2): 734/780 kB | 340/501 kB Progress (2): 750/780 kB | 340/501 kB Progress (2): 767/780 kB | 340/501 kB Progress (2): 767/780 kB | 357/501 kB Progress (2): 780 kB | 357/501 kB Progress (2): 780 kB | 373/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar (780 kB at 4.8 MB/s) 2024-09-12T00:42:25.238 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar 2024-09-12T00:42:25.245 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 389/501 kB Progress (1): 406/501 kB Progress (1): 422/501 kB Progress (1): 438/501 kB Progress (1): 455/501 kB Progress (1): 471/501 kB Progress (1): 488/501 kB Progress (1): 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar (501 kB at 2.9 MB/s) 2024-09-12T00:42:25.245 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar 2024-09-12T00:42:25.248 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar (6.4 kB at 37 kB/s) 2024-09-12T00:42:25.248 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar 2024-09-12T00:42:25.253 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/211 kB Progress (1): 33/211 kB Progress (1): 49/211 kB Progress (1): 64/211 kB Progress (1): 80/211 kB Progress (1): 97/211 kB Progress (2): 97/211 kB | 16/586 kB Progress (2): 97/211 kB | 33/586 kB Progress (2): 113/211 kB | 33/586 kB Progress (2): 113/211 kB | 37/586 kB Progress (2): 129/211 kB | 37/586 kB Progress (2): 129/211 kB | 53/586 kB Progress (3): 129/211 kB | 53/586 kB | 14 kB Progress (3): 146/211 kB | 53/586 kB | 14 kB Progress (3): 146/211 kB | 69/586 kB | 14 kB Progress (3): 162/211 kB | 69/586 kB | 14 kB Progress (3): 162/211 kB | 86/586 kB | 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar (14 kB at 80 kB/s) 2024-09-12T00:42:25.253 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar 2024-09-12T00:42:25.255 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (2): 178/211 kB | 86/586 kB Progress (2): 178/211 kB | 102/586 kB Progress (2): 195/211 kB | 102/586 kB Progress (2): 195/211 kB | 118/586 kB Progress (2): 195/211 kB | 135/586 kB Progress (2): 211 kB | 135/586 kB Progress (2): 211 kB | 151/586 kB Progress (2): 211 kB | 168/586 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar (211 kB at 1.2 MB/s) 2024-09-12T00:42:25.255 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 184/586 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar 2024-09-12T00:42:25.262 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 200/586 kB Progress (1): 217/586 kB Progress (1): 233/586 kB Progress (1): 250/586 kB Progress (1): 266/586 kB Progress (1): 282/586 kB Progress (1): 299/586 kB Progress (1): 315/586 kB Progress (1): 331/586 kB Progress (1): 348/586 kB Progress (1): 364/586 kB Progress (1): 381/586 kB Progress (1): 397/586 kB Progress (1): 413/586 kB Progress (1): 430/586 kB Progress (1): 446/586 kB Progress (1): 463/586 kB Progress (1): 479/586 kB Progress (1): 495/586 kB Progress (1): 512/586 kB Progress (1): 528/586 kB Progress (2): 528/586 kB | 16/106 kB Progress (2): 528/586 kB | 33/106 kB Progress (2): 528/586 kB | 49/106 kB Progress (2): 528/586 kB | 66/106 kB Progress (2): 528/586 kB | 82/106 kB Progress (3): 528/586 kB | 82/106 kB | 6.8 kB Progress (3): 528/586 kB | 98/106 kB | 6.8 kB Progress (3): 528/586 kB | 106 kB | 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar (6.8 kB at 36 kB/s) 2024-09-12T00:42:25.262 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar 2024-09-12T00:42:25.263 INFO:tasks.workunit.client.0.smithi073.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar (106 kB at 562 kB/s) 2024-09-12T00:42:25.263 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar 2024-09-12T00:42:25.265 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 544/586 kB Progress (1): 561/586 kB Progress (1): 577/586 kB Progress (1): 586 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar (586 kB at 3.1 MB/s) 2024-09-12T00:42:25.265 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar 2024-09-12T00:42:25.271 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/245 kB Progress (1): 33/245 kB Progress (1): 49/245 kB Progress (1): 65/245 kB Progress (1): 81/245 kB Progress (1): 98/245 kB Progress (1): 114/245 kB Progress (1): 130/245 kB Progress (1): 147/245 kB Progress (1): 163/245 kB Progress (1): 179/245 kB Progress (1): 196/245 kB Progress (1): 212/245 kB Progress (1): 229/245 kB Progress (1): 245 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar (245 kB at 1.2 MB/s) 2024-09-12T00:42:25.271 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar 2024-09-12T00:42:25.278 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/205 kB Progress (1): 32/205 kB Progress (1): 49/205 kB Progress (1): 65/205 kB Progress (1): 81/205 kB Progress (1): 98/205 kB Progress (1): 114/205 kB Progress (1): 131/205 kB Progress (1): 147/205 kB Progress (1): 163/205 kB Progress (1): 180/205 kB Progress (1): 196/205 kB Progress (1): 205 kB Progress (2): 205 kB | 15 kB Progress (3): 205 kB | 15 kB | 16/16 kB Progress (3): 205 kB | 15 kB | 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar (15 kB at 75 kB/s) 2024-09-12T00:42:25.278 INFO:tasks.workunit.client.0.smithi073.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar (16 kB at 81 kB/s) 2024-09-12T00:42:25.278 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar 2024-09-12T00:42:25.278 INFO:tasks.workunit.client.0.smithi073.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar (205 kB at 1.0 MB/s) 2024-09-12T00:42:25.279 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar 2024-09-12T00:42:25.279 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar 2024-09-12T00:42:25.280 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar (6.4 kB at 31 kB/s) 2024-09-12T00:42:25.287 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar (23 kB at 106 kB/s) 2024-09-12T00:42:25.293 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar (24 kB at 111 kB/s) 2024-09-12T00:42:25.293 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 15/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar (17 kB at 79 kB/s) 2024-09-12T00:42:25.298 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/184 kB Progress (1): 33/184 kB Progress (1): 49/184 kB Progress (1): 66/184 kB Progress (1): 82/184 kB Progress (1): 98/184 kB Progress (1): 115/184 kB Progress (1): 131/184 kB Progress (1): 147/184 kB Progress (1): 164/184 kB Progress (1): 180/184 kB Progress (1): 184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar (184 kB at 821 kB/s) 2024-09-12T00:42:25.316 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] 2024-09-12T00:42:25.317 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] --- clean:3.2.0:clean (default-clean) @ jcksum --- 2024-09-12T00:42:25.322 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom 2024-09-12T00:42:25.337 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom (5.8 kB at 389 kB/s) 2024-09-12T00:42:25.339 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom 2024-09-12T00:42:25.354 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom (5.1 kB at 364 kB/s) 2024-09-12T00:42:25.356 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom 2024-09-12T00:42:25.371 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/43 kB Progress (1): 33/43 kB Progress (1): 43 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom (43 kB at 2.7 MB/s) 2024-09-12T00:42:25.375 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom 2024-09-12T00:42:25.390 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom (14 kB at 950 kB/s) 2024-09-12T00:42:25.395 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar 2024-09-12T00:42:25.412 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/153 kB Progress (1): 32/153 kB Progress (1): 49/153 kB Progress (1): 65/153 kB Progress (1): 78/153 kB Progress (1): 95/153 kB Progress (1): 111/153 kB Progress (1): 128/153 kB Progress (1): 144/153 kB Progress (1): 153 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar (153 kB at 8.5 MB/s) 2024-09-12T00:42:25.413 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar 2024-09-12T00:42:25.430 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/215 kB Progress (1): 33/215 kB Progress (1): 49/215 kB Progress (1): 62/215 kB Progress (1): 78/215 kB Progress (1): 95/215 kB Progress (1): 111/215 kB Progress (1): 127/215 kB Progress (1): 144/215 kB Progress (1): 160/215 kB Progress (1): 177/215 kB Progress (1): 193/215 kB Progress (1): 209/215 kB Progress (1): 215 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar (215 kB at 12 MB/s) 2024-09-12T00:42:25.466 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] 2024-09-12T00:42:25.466 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-12T00:42:25.469 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom 2024-09-12T00:42:25.484 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom (2.7 kB at 177 kB/s) 2024-09-12T00:42:25.486 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom 2024-09-12T00:42:25.504 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom (23 kB at 1.3 MB/s) 2024-09-12T00:42:25.507 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom 2024-09-12T00:42:25.521 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 8.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom (8.8 kB at 585 kB/s) 2024-09-12T00:42:25.523 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom 2024-09-12T00:42:25.538 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom (25 kB at 1.8 MB/s) 2024-09-12T00:42:25.541 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom 2024-09-12T00:42:25.556 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom (6.0 kB at 402 kB/s) 2024-09-12T00:42:25.557 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom 2024-09-12T00:42:25.574 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom (3.2 kB at 230 kB/s) 2024-09-12T00:42:25.575 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom 2024-09-12T00:42:25.590 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 612 B Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom (612 B at 41 kB/s) 2024-09-12T00:42:25.591 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom 2024-09-12T00:42:25.606 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom (2.7 kB at 196 kB/s) 2024-09-12T00:42:25.607 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom 2024-09-12T00:42:25.622 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom (14 kB at 940 kB/s) 2024-09-12T00:42:25.625 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom 2024-09-12T00:42:25.639 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom (3.2 kB at 214 kB/s) 2024-09-12T00:42:25.641 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom 2024-09-12T00:42:25.656 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom (8.4 kB at 557 kB/s) 2024-09-12T00:42:25.657 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom 2024-09-12T00:42:25.672 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom (8.4 kB at 597 kB/s) 2024-09-12T00:42:25.674 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom 2024-09-12T00:42:25.689 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 8.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom (8.0 kB at 534 kB/s) 2024-09-12T00:42:25.691 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom 2024-09-12T00:42:25.706 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom (20 kB at 1.4 MB/s) 2024-09-12T00:42:25.710 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom 2024-09-12T00:42:25.724 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom (5.1 kB at 340 kB/s) 2024-09-12T00:42:25.727 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom 2024-09-12T00:42:25.742 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom (31 kB at 2.0 MB/s) 2024-09-12T00:42:25.746 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom 2024-09-12T00:42:25.760 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom (5.1 kB at 340 kB/s) 2024-09-12T00:42:25.764 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar 2024-09-12T00:42:25.779 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/85 kB Progress (1): 33/85 kB Progress (1): 49/85 kB Progress (1): 66/85 kB Progress (1): 82/85 kB Progress (1): 85 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar (85 kB at 5.3 MB/s) 2024-09-12T00:42:25.780 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar 2024-09-12T00:42:25.780 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar 2024-09-12T00:42:25.780 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar 2024-09-12T00:42:25.780 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar 2024-09-12T00:42:25.781 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar 2024-09-12T00:42:25.804 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 2.5 kB Progress (2): 2.5 kB | 8.5 kB Progress (3): 2.5 kB | 8.5 kB | 16/55 kB Progress (4): 2.5 kB | 8.5 kB | 16/55 kB | 16/41 kB Progress (5): 2.5 kB | 8.5 kB | 16/55 kB | 16/41 kB | 16/269 kB Progress (5): 2.5 kB | 8.5 kB | 32/55 kB | 16/41 kB | 16/269 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar (2.5 kB at 114 kB/s) 2024-09-12T00:42:25.804 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (4): 8.5 kB | 32/55 kB | 33/41 kB | 16/269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar (8.5 kB at 386 kB/s) 2024-09-12T00:42:25.804 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (3): 32/55 kB | 33/41 kB | 33/269 kB Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar 2024-09-12T00:42:25.804 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar 2024-09-12T00:42:25.804 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (3): 32/55 kB | 41 kB | 33/269 kB Progress (3): 49/55 kB | 41 kB | 33/269 kB Progress (3): 55 kB | 41 kB | 33/269 kB Progress (3): 55 kB | 41 kB | 49/269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar (41 kB at 1.8 MB/s) 2024-09-12T00:42:25.804 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (2): 55 kB | 63/269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar (55 kB at 2.4 MB/s) 2024-09-12T00:42:25.806 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 79/269 kB Progress (1): 96/269 kB Progress (1): 112/269 kB Progress (1): 128/269 kB Progress (1): 145/269 kB Progress (1): 161/269 kB Progress (1): 177/269 kB Progress (1): 194/269 kB Progress (1): 210/269 kB Progress (1): 227/269 kB Progress (1): 243/269 kB Progress (1): 259/269 kB Progress (1): 269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar (269 kB at 10 MB/s) 2024-09-12T00:42:25.824 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/587 kB Progress (1): 33/587 kB Progress (1): 49/587 kB Progress (1): 64/587 kB Progress (1): 80/587 kB Progress (1): 96/587 kB Progress (1): 113/587 kB Progress (1): 129/587 kB Progress (1): 146/587 kB Progress (1): 162/587 kB Progress (1): 178/587 kB Progress (1): 195/587 kB Progress (1): 211/587 kB Progress (1): 227/587 kB Progress (1): 244/587 kB Progress (2): 244/587 kB | 15/327 kB Progress (2): 260/587 kB | 15/327 kB Progress (2): 260/587 kB | 31/327 kB Progress (2): 277/587 kB | 31/327 kB Progress (2): 277/587 kB | 48/327 kB Progress (2): 293/587 kB | 48/327 kB Progress (2): 293/587 kB | 64/327 kB Progress (2): 309/587 kB | 64/327 kB Progress (2): 309/587 kB | 81/327 kB Progress (2): 326/587 kB | 81/327 kB Progress (2): 326/587 kB | 97/327 kB Progress (2): 342/587 kB | 97/327 kB Progress (2): 342/587 kB | 113/327 kB Progress (2): 359/587 kB | 113/327 kB Progress (2): 359/587 kB | 130/327 kB Progress (2): 375/587 kB | 130/327 kB Progress (2): 375/587 kB | 146/327 kB Progress (2): 391/587 kB | 146/327 kB Progress (2): 391/587 kB | 162/327 kB Progress (2): 408/587 kB | 162/327 kB Progress (2): 408/587 kB | 179/327 kB Progress (2): 424/587 kB | 179/327 kB Progress (2): 424/587 kB | 195/327 kB Progress (2): 440/587 kB | 195/327 kB Progress (2): 440/587 kB | 212/327 kB Progress (2): 457/587 kB | 212/327 kB Progress (2): 457/587 kB | 228/327 kB Progress (2): 473/587 kB | 228/327 kB Progress (2): 473/587 kB | 244/327 kB Progress (2): 490/587 kB | 244/327 kB Progress (2): 490/587 kB | 261/327 kB Progress (2): 506/587 kB | 261/327 kB Progress (2): 506/587 kB | 277/327 kB Progress (2): 522/587 kB | 277/327 kB Progress (2): 522/587 kB | 294/327 kB Progress (2): 539/587 kB | 294/327 kB Progress (2): 539/587 kB | 310/327 kB Progress (2): 555/587 kB | 310/327 kB Progress (2): 555/587 kB | 326/327 kB Progress (2): 555/587 kB | 327 kB Progress (2): 572/587 kB | 327 kB Progress (2): 587 kB | 327 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar (327 kB at 7.6 MB/s) 2024-09-12T00:42:25.824 INFO:tasks.workunit.client.0.smithi073.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar (587 kB at 13 MB/s) 2024-09-12T00:42:25.855 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-12T00:42:25.856 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] 2024-09-12T00:42:25.856 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-12T00:42:25.861 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom 2024-09-12T00:42:25.876 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom (4.7 kB at 316 kB/s) 2024-09-12T00:42:25.877 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom 2024-09-12T00:42:25.892 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom (6.4 kB at 424 kB/s) 2024-09-12T00:42:25.894 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom 2024-09-12T00:42:25.908 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/33 kB Progress (1): 32/33 kB Progress (1): 33 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom (33 kB at 2.3 MB/s) 2024-09-12T00:42:25.910 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2024-09-12T00:42:25.925 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 kB at 873 kB/s) 2024-09-12T00:42:25.929 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom 2024-09-12T00:42:25.945 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 815 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom (815 B at 51 kB/s) 2024-09-12T00:42:25.947 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom 2024-09-12T00:42:25.962 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom (4.2 kB at 265 kB/s) 2024-09-12T00:42:25.965 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom 2024-09-12T00:42:25.982 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom (17 kB at 1.0 MB/s) 2024-09-12T00:42:25.986 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom 2024-09-12T00:42:26.001 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom (5.0 kB at 331 kB/s) 2024-09-12T00:42:26.003 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom 2024-09-12T00:42:26.018 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom (4.1 kB at 276 kB/s) 2024-09-12T00:42:26.021 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom 2024-09-12T00:42:26.037 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom (2.4 kB at 158 kB/s) 2024-09-12T00:42:26.039 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom 2024-09-12T00:42:26.055 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom (11 kB at 706 kB/s) 2024-09-12T00:42:26.058 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom 2024-09-12T00:42:26.075 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom (17 kB at 1.0 MB/s) 2024-09-12T00:42:26.078 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2024-09-12T00:42:26.093 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 411 kB/s) 2024-09-12T00:42:26.097 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom 2024-09-12T00:42:26.113 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom (1.1 kB at 66 kB/s) 2024-09-12T00:42:26.115 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom 2024-09-12T00:42:26.131 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom (8.4 kB at 524 kB/s) 2024-09-12T00:42:26.133 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom 2024-09-12T00:42:26.148 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom (2.7 kB at 179 kB/s) 2024-09-12T00:42:26.152 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom 2024-09-12T00:42:26.167 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom (5.6 kB at 375 kB/s) 2024-09-12T00:42:26.170 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom 2024-09-12T00:42:26.187 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom (1.1 kB at 71 kB/s) 2024-09-12T00:42:26.191 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom 2024-09-12T00:42:26.206 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 770 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom (770 B at 48 kB/s) 2024-09-12T00:42:26.208 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom 2024-09-12T00:42:26.224 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom (6.0 kB at 377 kB/s) 2024-09-12T00:42:26.225 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom 2024-09-12T00:42:26.240 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom (26 kB at 1.8 MB/s) 2024-09-12T00:42:26.243 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom 2024-09-12T00:42:26.257 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom (1.2 kB at 80 kB/s) 2024-09-12T00:42:26.259 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom 2024-09-12T00:42:26.274 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 1.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom (1.3 kB at 88 kB/s) 2024-09-12T00:42:26.281 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar 2024-09-12T00:42:26.296 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar (14 kB at 903 kB/s) 2024-09-12T00:42:26.296 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar 2024-09-12T00:42:26.296 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar 2024-09-12T00:42:26.297 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar 2024-09-12T00:42:26.297 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar 2024-09-12T00:42:26.297 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar 2024-09-12T00:42:26.312 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/55 kB Progress (1): 33/55 kB Progress (2): 33/55 kB | 16/334 kB Progress (2): 49/55 kB | 16/334 kB Progress (2): 49/55 kB | 33/334 kB Progress (2): 55 kB | 33/334 kB Progress (3): 55 kB | 33/334 kB | 4.2 kB Progress (3): 55 kB | 49/334 kB | 4.2 kB Progress (3): 55 kB | 65/334 kB | 4.2 kB Progress (4): 55 kB | 65/334 kB | 4.2 kB | 16/122 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar (4.2 kB at 281 kB/s) 2024-09-12T00:42:26.312 INFO:tasks.workunit.client.0.smithi073.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar (55 kB at 3.6 MB/s) 2024-09-12T00:42:26.312 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar 2024-09-12T00:42:26.312 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar 2024-09-12T00:42:26.314 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (2): 82/334 kB | 16/122 kB Progress (2): 82/334 kB | 33/122 kB Progress (2): 98/334 kB | 33/122 kB Progress (2): 98/334 kB | 49/122 kB Progress (2): 98/334 kB | 66/122 kB Progress (2): 114/334 kB | 66/122 kB Progress (2): 114/334 kB | 82/122 kB Progress (2): 114/334 kB | 98/122 kB Progress (2): 131/334 kB | 98/122 kB Progress (2): 131/334 kB | 114/122 kB Progress (2): 147/334 kB | 114/122 kB Progress (2): 147/334 kB | 122 kB Progress (2): 164/334 kB | 122 kB Progress (2): 180/334 kB | 122 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar (122 kB at 7.2 MB/s) 2024-09-12T00:42:26.314 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar 2024-09-12T00:42:26.314 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 196/334 kB Progress (1): 213/334 kB Progress (1): 229/334 kB Progress (1): 246/334 kB Progress (2): 246/334 kB | 16/27 kB Progress (2): 246/334 kB | 27 kB Progress (2): 262/334 kB | 27 kB Progress (2): 278/334 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar (27 kB at 1.6 MB/s) 2024-09-12T00:42:26.315 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 295/334 kB Progress (1): 311/334 kB Progress (1): 327/334 kB Progress (1): 334 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar (334 kB at 17 MB/s) 2024-09-12T00:42:26.326 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/267 kB Progress (1): 33/267 kB Progress (2): 33/267 kB | 4.7 kB Progress (2): 49/267 kB | 4.7 kB Progress (2): 65/267 kB | 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar (4.7 kB at 161 kB/s) 2024-09-12T00:42:26.327 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 81/267 kB Progress (1): 98/267 kB Progress (1): 114/267 kB Progress (2): 114/267 kB | 16/23 kB Progress (2): 114/267 kB | 23 kB Progress (2): 131/267 kB | 23 kB Progress (2): 147/267 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar (23 kB at 760 kB/s) 2024-09-12T00:42:26.329 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 163/267 kB Progress (1): 180/267 kB Progress (1): 196/267 kB Progress (1): 212/267 kB Progress (1): 229/267 kB Progress (1): 245/267 kB Progress (1): 262/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar (267 kB at 8.4 MB/s) 2024-09-12T00:42:26.386 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] Changes detected - recompiling the module! :source 2024-09-12T00:42:26.387 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/classes 2024-09-12T00:42:27.040 INFO:tasks.workunit.client.0.smithi073.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-12T00:42:27.040 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] 2024-09-12T00:42:27.040 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-12T00:42:27.044 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-12T00:42:27.044 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] 2024-09-12T00:42:27.044 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-12T00:42:27.051 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] Changes detected - recompiling the module! :dependency 2024-09-12T00:42:27.051 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/test-classes 2024-09-12T00:42:27.259 INFO:tasks.workunit.client.0.smithi073.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-12T00:42:27.260 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] 2024-09-12T00:42:27.260 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-12T00:42:27.265 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom 2024-09-12T00:42:27.281 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 6.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom (6.2 kB at 390 kB/s) 2024-09-12T00:42:27.285 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom 2024-09-12T00:42:27.300 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom (3.5 kB at 221 kB/s) 2024-09-12T00:42:27.305 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom 2024-09-12T00:42:27.322 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom (3.3 kB at 192 kB/s) 2024-09-12T00:42:27.326 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom 2024-09-12T00:42:27.341 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom (4.1 kB at 271 kB/s) 2024-09-12T00:42:27.345 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom 2024-09-12T00:42:27.361 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom (3.3 kB at 220 kB/s) 2024-09-12T00:42:27.365 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom 2024-09-12T00:42:27.380 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom (4.5 kB at 278 kB/s) 2024-09-12T00:42:27.384 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom 2024-09-12T00:42:27.400 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom (1.8 kB at 117 kB/s) 2024-09-12T00:42:27.403 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom 2024-09-12T00:42:27.418 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom (2.2 kB at 157 kB/s) 2024-09-12T00:42:27.420 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom 2024-09-12T00:42:27.434 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom (30 kB at 2.0 MB/s) 2024-09-12T00:42:27.437 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom 2024-09-12T00:42:27.452 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 1.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom (1.9 kB at 126 kB/s) 2024-09-12T00:42:27.456 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom 2024-09-12T00:42:27.471 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom (5.8 kB at 387 kB/s) 2024-09-12T00:42:27.475 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom 2024-09-12T00:42:27.490 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 2.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom (2.3 kB at 147 kB/s) 2024-09-12T00:42:27.492 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom 2024-09-12T00:42:27.507 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom (22 kB at 1.5 MB/s) 2024-09-12T00:42:27.509 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom 2024-09-12T00:42:27.524 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/37 kB Progress (1): 32/37 kB Progress (1): 37 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom (37 kB at 2.7 MB/s) 2024-09-12T00:42:27.526 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2024-09-12T00:42:27.541 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom (15 kB at 1.1 MB/s) 2024-09-12T00:42:27.545 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom 2024-09-12T00:42:27.559 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 8.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom (8.7 kB at 618 kB/s) 2024-09-12T00:42:27.561 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom 2024-09-12T00:42:27.577 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom (27 kB at 1.7 MB/s) 2024-09-12T00:42:27.580 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom 2024-09-12T00:42:27.594 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom (8.1 kB at 576 kB/s) 2024-09-12T00:42:27.597 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom 2024-09-12T00:42:27.612 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom (2.2 kB at 145 kB/s) 2024-09-12T00:42:27.614 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom 2024-09-12T00:42:27.629 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom (2.6 kB at 185 kB/s) 2024-09-12T00:42:27.632 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom 2024-09-12T00:42:27.647 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom (1.5 kB at 110 kB/s) 2024-09-12T00:42:27.648 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom 2024-09-12T00:42:27.662 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom (3.1 kB at 204 kB/s) 2024-09-12T00:42:27.664 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom 2024-09-12T00:42:27.678 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom (20 kB at 1.4 MB/s) 2024-09-12T00:42:27.680 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom 2024-09-12T00:42:27.695 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom (6.8 kB at 483 kB/s) 2024-09-12T00:42:27.696 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom 2024-09-12T00:42:27.710 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom (14 kB at 969 kB/s) 2024-09-12T00:42:27.713 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom 2024-09-12T00:42:27.728 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom (3.0 kB at 212 kB/s) 2024-09-12T00:42:27.729 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom 2024-09-12T00:42:27.744 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom (6.8 kB at 486 kB/s) 2024-09-12T00:42:27.745 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom 2024-09-12T00:42:27.759 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom (8.4 kB at 600 kB/s) 2024-09-12T00:42:27.762 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom 2024-09-12T00:42:27.776 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom (2.1 kB at 138 kB/s) 2024-09-12T00:42:27.779 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom 2024-09-12T00:42:27.794 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom (2.2 kB at 149 kB/s) 2024-09-12T00:42:27.798 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom 2024-09-12T00:42:27.812 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom (3.0 kB at 202 kB/s) 2024-09-12T00:42:27.816 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom 2024-09-12T00:42:27.832 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom (15 kB at 880 kB/s) 2024-09-12T00:42:27.834 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom 2024-09-12T00:42:27.849 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom (15 kB at 906 kB/s) 2024-09-12T00:42:27.852 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom 2024-09-12T00:42:27.867 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom (13 kB at 959 kB/s) 2024-09-12T00:42:27.869 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom 2024-09-12T00:42:27.884 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom (4.8 kB at 319 kB/s) 2024-09-12T00:42:27.886 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom 2024-09-12T00:42:27.901 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom (6.3 kB at 392 kB/s) 2024-09-12T00:42:27.903 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom 2024-09-12T00:42:27.918 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/32 kB Progress (1): 32 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom (32 kB at 2.2 MB/s) 2024-09-12T00:42:27.922 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom 2024-09-12T00:42:27.937 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom (17 kB at 1.2 MB/s) 2024-09-12T00:42:27.938 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom 2024-09-12T00:42:27.953 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom (15 kB at 1.1 MB/s) 2024-09-12T00:42:27.955 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom 2024-09-12T00:42:27.969 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 750 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom (750 B at 54 kB/s) 2024-09-12T00:42:27.970 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom 2024-09-12T00:42:27.985 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom (4.8 kB at 343 kB/s) 2024-09-12T00:42:27.988 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom 2024-09-12T00:42:28.002 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 7.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom (7.9 kB at 527 kB/s) 2024-09-12T00:42:28.005 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom 2024-09-12T00:42:28.019 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom (3.0 kB at 214 kB/s) 2024-09-12T00:42:28.022 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom 2024-09-12T00:42:28.037 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom (4.2 kB at 283 kB/s) 2024-09-12T00:42:28.040 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom 2024-09-12T00:42:28.054 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom (2.1 kB at 147 kB/s) 2024-09-12T00:42:28.057 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom 2024-09-12T00:42:28.071 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom (3.5 kB at 232 kB/s) 2024-09-12T00:42:28.074 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom 2024-09-12T00:42:28.089 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom (11 kB at 729 kB/s) 2024-09-12T00:42:28.090 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom 2024-09-12T00:42:28.105 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom (13 kB at 962 kB/s) 2024-09-12T00:42:28.107 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom 2024-09-12T00:42:28.121 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/19 kB Progress (1): 19 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom (19 kB at 1.2 MB/s) 2024-09-12T00:42:28.124 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom 2024-09-12T00:42:28.138 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 363 B Downloaded from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom (363 B at 26 kB/s) 2024-09-12T00:42:28.139 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom 2024-09-12T00:42:28.155 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom (6.1 kB at 407 kB/s) 2024-09-12T00:42:28.156 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom 2024-09-12T00:42:28.170 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom (7.3 kB at 524 kB/s) 2024-09-12T00:42:28.172 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2024-09-12T00:42:28.186 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom (4.8 kB at 345 kB/s) 2024-09-12T00:42:28.189 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom 2024-09-12T00:42:28.203 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom (7.3 kB at 487 kB/s) 2024-09-12T00:42:28.206 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom 2024-09-12T00:42:28.221 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom (22 kB at 1.5 MB/s) 2024-09-12T00:42:28.223 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom 2024-09-12T00:42:28.238 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/78 kB Progress (1): 32/78 kB Progress (1): 49/78 kB Progress (1): 65/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom (78 kB at 4.9 MB/s) 2024-09-12T00:42:28.241 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom 2024-09-12T00:42:28.256 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom (23 kB at 1.5 MB/s) 2024-09-12T00:42:28.259 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom 2024-09-12T00:42:28.273 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom (5.6 kB at 377 kB/s) 2024-09-12T00:42:28.275 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom 2024-09-12T00:42:28.289 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 4.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom (4.3 kB at 305 kB/s) 2024-09-12T00:42:28.290 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom 2024-09-12T00:42:28.305 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom (3.2 kB at 228 kB/s) 2024-09-12T00:42:28.306 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom 2024-09-12T00:42:28.320 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/28 kB Progress (1): 28 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom (28 kB at 1.9 MB/s) 2024-09-12T00:42:28.323 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom 2024-09-12T00:42:28.337 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom (2.4 kB at 169 kB/s) 2024-09-12T00:42:28.341 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar 2024-09-12T00:42:28.359 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/308 kB Progress (1): 33/308 kB Progress (1): 49/308 kB Progress (1): 62/308 kB Progress (1): 79/308 kB Progress (1): 95/308 kB Progress (1): 112/308 kB Progress (1): 128/308 kB Progress (1): 144/308 kB Progress (1): 161/308 kB Progress (1): 177/308 kB Progress (1): 194/308 kB Progress (1): 210/308 kB Progress (1): 226/308 kB Progress (1): 243/308 kB Progress (1): 259/308 kB Progress (1): 275/308 kB Progress (1): 292/308 kB Progress (1): 308 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar (308 kB at 17 MB/s) 2024-09-12T00:42:28.360 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar 2024-09-12T00:42:28.360 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar 2024-09-12T00:42:28.360 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar 2024-09-12T00:42:28.361 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar 2024-09-12T00:42:28.361 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar 2024-09-12T00:42:28.380 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 8.2 kB Progress (2): 8.2 kB | 16/171 kB Progress (3): 8.2 kB | 16/171 kB | 15/26 kB Progress (3): 8.2 kB | 33/171 kB | 15/26 kB Progress (3): 8.2 kB | 33/171 kB | 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar (8.2 kB at 481 kB/s) 2024-09-12T00:42:28.380 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (3): 33/171 kB | 26 kB | 15/118 kB Progress (3): 49/171 kB | 26 kB | 15/118 kB Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar 2024-09-12T00:42:28.380 INFO:tasks.workunit.client.0.smithi073.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar (26 kB at 1.4 MB/s) 2024-09-12T00:42:28.380 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (2): 63/171 kB | 15/118 kB Progress (3): 63/171 kB | 15/118 kB | 14 kB Progress (3): 63/171 kB | 31/118 kB | 14 kB Progress (3): 79/171 kB | 31/118 kB | 14 kB Progress (3): 79/171 kB | 48/118 kB | 14 kB Progress (3): 95/171 kB | 48/118 kB | 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar (14 kB at 715 kB/s) 2024-09-12T00:42:28.380 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar 2024-09-12T00:42:28.380 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (2): 95/171 kB | 64/118 kB Progress (2): 112/171 kB | 64/118 kB Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar 2024-09-12T00:42:28.381 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (2): 128/171 kB | 64/118 kB Progress (2): 128/171 kB | 81/118 kB Progress (2): 144/171 kB | 81/118 kB Progress (2): 144/171 kB | 93/118 kB Progress (2): 161/171 kB | 93/118 kB Progress (2): 171 kB | 93/118 kB Progress (2): 171 kB | 109/118 kB Progress (2): 171 kB | 118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar (171 kB at 8.1 MB/s) 2024-09-12T00:42:28.381 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar 2024-09-12T00:42:28.381 INFO:tasks.workunit.client.0.smithi073.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar (118 kB at 5.6 MB/s) 2024-09-12T00:42:28.381 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar 2024-09-12T00:42:28.395 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/146 kB Progress (1): 33/146 kB Progress (2): 33/146 kB | 16/61 kB Progress (2): 49/146 kB | 16/61 kB Progress (3): 49/146 kB | 16/61 kB | 16/136 kB Progress (3): 49/146 kB | 32/61 kB | 16/136 kB Progress (3): 65/146 kB | 32/61 kB | 16/136 kB Progress (3): 65/146 kB | 32/61 kB | 33/136 kB Progress (3): 65/146 kB | 49/61 kB | 33/136 kB Progress (3): 81/146 kB | 49/61 kB | 33/136 kB Progress (3): 81/146 kB | 49/61 kB | 49/136 kB Progress (3): 81/146 kB | 61 kB | 49/136 kB Progress (3): 98/146 kB | 61 kB | 49/136 kB Progress (3): 98/146 kB | 61 kB | 63/136 kB Progress (3): 114/146 kB | 61 kB | 63/136 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar (61 kB at 1.8 MB/s) 2024-09-12T00:42:28.396 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (2): 114/146 kB | 80/136 kB Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar 2024-09-12T00:42:28.396 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (2): 131/146 kB | 80/136 kB Progress (2): 131/146 kB | 96/136 kB Progress (2): 146 kB | 96/136 kB Progress (2): 146 kB | 112/136 kB Progress (3): 146 kB | 112/136 kB | 16/58 kB Progress (3): 146 kB | 129/136 kB | 16/58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar (146 kB at 4.3 MB/s) 2024-09-12T00:42:28.396 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (2): 136 kB | 16/58 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar 2024-09-12T00:42:28.396 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (2): 136 kB | 33/58 kB Progress (2): 136 kB | 49/58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar (136 kB at 4.0 MB/s) 2024-09-12T00:42:28.396 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar (58 kB at 1.6 MB/s) 2024-09-12T00:42:28.403 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/501 kB Progress (1): 33/501 kB Progress (1): 49/501 kB Progress (1): 63/501 kB Progress (1): 80/501 kB Progress (1): 96/501 kB Progress (1): 113/501 kB Progress (1): 129/501 kB Progress (1): 145/501 kB Progress (1): 162/501 kB Progress (1): 178/501 kB Progress (1): 194/501 kB Progress (1): 211/501 kB Progress (1): 227/501 kB Progress (1): 244/501 kB Progress (1): 260/501 kB Progress (1): 276/501 kB Progress (1): 293/501 kB Progress (1): 309/501 kB Progress (1): 325/501 kB Progress (1): 342/501 kB Progress (1): 358/501 kB Progress (1): 375/501 kB Progress (1): 391/501 kB Progress (1): 407/501 kB Progress (1): 424/501 kB Progress (1): 440/501 kB Progress (1): 457/501 kB Progress (1): 473/501 kB Progress (1): 489/501 kB Progress (1): 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar (501 kB at 12 MB/s) 2024-09-12T00:42:28.411 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/124 kB Progress (1): 32/124 kB Progress (2): 32/124 kB | 0/2.4 MB Progress (2): 49/124 kB | 0/2.4 MB Progress (2): 49/124 kB | 0/2.4 MB Progress (2): 65/124 kB | 0/2.4 MB Progress (2): 65/124 kB | 0/2.4 MB Progress (2): 65/124 kB | 0.1/2.4 MB Progress (2): 81/124 kB | 0.1/2.4 MB Progress (2): 81/124 kB | 0.1/2.4 MB Progress (2): 98/124 kB | 0.1/2.4 MB Progress (2): 98/124 kB | 0.1/2.4 MB Progress (2): 98/124 kB | 0.1/2.4 MB Progress (2): 114/124 kB | 0.1/2.4 MB Progress (2): 114/124 kB | 0.1/2.4 MB Progress (2): 124 kB | 0.1/2.4 MB Progress (2): 124 kB | 0.1/2.4 MB Progress (2): 124 kB | 0.2/2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar (124 kB at 2.4 MB/s) 2024-09-12T00:42:28.442 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar (2.4 MB at 30 MB/s) 2024-09-12T00:42:28.533 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] 2024-09-12T00:42:28.533 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] --- jar:3.3.0:jar (default-jar) @ jcksum --- 2024-09-12T00:42:28.535 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom 2024-09-12T00:42:28.550 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom (4.5 kB at 320 kB/s) 2024-09-12T00:42:28.552 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom 2024-09-12T00:42:28.566 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom (4.9 kB at 350 kB/s) 2024-09-12T00:42:28.567 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom 2024-09-12T00:42:28.583 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom (45 kB at 3.0 MB/s) 2024-09-12T00:42:28.584 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom 2024-09-12T00:42:28.599 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom (21 kB at 1.5 MB/s) 2024-09-12T00:42:28.601 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom 2024-09-12T00:42:28.616 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 5.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom (5.2 kB at 370 kB/s) 2024-09-12T00:42:28.618 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom 2024-09-12T00:42:28.633 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 3.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom (3.9 kB at 261 kB/s) 2024-09-12T00:42:28.635 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom 2024-09-12T00:42:28.650 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom (6.0 kB at 430 kB/s) 2024-09-12T00:42:28.652 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom 2024-09-12T00:42:28.666 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom (6.3 kB at 447 kB/s) 2024-09-12T00:42:28.668 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom 2024-09-12T00:42:28.682 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom (20 kB at 1.4 MB/s) 2024-09-12T00:42:28.685 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom 2024-09-12T00:42:28.700 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom (15 kB at 1.0 MB/s) 2024-09-12T00:42:28.702 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom 2024-09-12T00:42:28.716 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom (2.0 kB at 146 kB/s) 2024-09-12T00:42:28.718 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom 2024-09-12T00:42:28.732 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom (8.2 kB at 548 kB/s) 2024-09-12T00:42:28.734 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom 2024-09-12T00:42:28.748 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom (25 kB at 1.7 MB/s) 2024-09-12T00:42:28.753 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar 2024-09-12T00:42:28.767 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/36 kB Progress (1): 32/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar (36 kB at 2.4 MB/s) 2024-09-12T00:42:28.768 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar 2024-09-12T00:42:28.768 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar 2024-09-12T00:42:28.769 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar 2024-09-12T00:42:28.769 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar 2024-09-12T00:42:28.769 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar 2024-09-12T00:42:28.786 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/79 kB Progress (2): 16/79 kB | 16/26 kB Progress (3): 16/79 kB | 16/26 kB | 16/211 kB Progress (3): 16/79 kB | 26 kB | 16/211 kB Progress (4): 16/79 kB | 26 kB | 16/211 kB | 0/1.0 MB Progress (4): 33/79 kB | 26 kB | 16/211 kB | 0/1.0 MB Progress (4): 33/79 kB | 26 kB | 16/211 kB | 0/1.0 MB Progress (5): 33/79 kB | 26 kB | 16/211 kB | 0/1.0 MB | 16/58 kB Progress (5): 33/79 kB | 26 kB | 32/211 kB | 0/1.0 MB | 16/58 kB Progress (5): 49/79 kB | 26 kB | 32/211 kB | 0/1.0 MB | 16/58 kB Progress (5): 49/79 kB | 26 kB | 32/211 kB | 0/1.0 MB | 16/58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar (26 kB at 1.6 MB/s) 2024-09-12T00:42:28.786 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (4): 49/79 kB | 32/211 kB | 0/1.0 MB | 33/58 kB Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar 2024-09-12T00:42:28.786 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (4): 66/79 kB | 32/211 kB | 0/1.0 MB | 33/58 kB Progress (4): 66/79 kB | 32/211 kB | 0.1/1.0 MB | 33/58 kB Progress (4): 66/79 kB | 32/211 kB | 0.1/1.0 MB | 49/58 kB Progress (4): 66/79 kB | 32/211 kB | 0.1/1.0 MB | 49/58 kB Progress (4): 66/79 kB | 49/211 kB | 0.1/1.0 MB | 49/58 kB Progress (4): 66/79 kB | 49/211 kB | 0.1/1.0 MB | 58 kB Progress (4): 79 kB | 49/211 kB | 0.1/1.0 MB | 58 kB Progress (4): 79 kB | 49/211 kB | 0.1/1.0 MB | 58 kB Progress (4): 79 kB | 65/211 kB | 0.1/1.0 MB | 58 kB Progress (4): 79 kB | 78/211 kB | 0.1/1.0 MB | 58 kB Progress (4): 79 kB | 78/211 kB | 0.1/1.0 MB | 58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar (79 kB at 4.4 MB/s) 2024-09-12T00:42:28.786 INFO:tasks.workunit.client.0.smithi073.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar (58 kB at 3.2 MB/s) 2024-09-12T00:42:28.787 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar 2024-09-12T00:42:28.788 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (2): 94/211 kB | 0.1/1.0 MB Progress (2): 94/211 kB | 0.1/1.0 MB Progress (2): 110/211 kB | 0.1/1.0 MB Progress (2): 127/211 kB | 0.1/1.0 MB Progress (2): 127/211 kB | 0.1/1.0 MB Progress (2): 143/211 kB | 0.1/1.0 MB Progress (2): 143/211 kB | 0.2/1.0 MB Progress (2): 160/211 kB | 0.2/1.0 MB Progress (2): 176/211 kB | 0.2/1.0 MB Progress (2): 176/211 kB | 0.2/1.0 MB Progress (2): 192/211 kB | 0.2/1.0 MB Progress (2): 192/211 kB | 0.2/1.0 MB Progress (2): 209/211 kB | 0.2/1.0 MB Progress (2): 211 kB | 0.2/1.0 MB Progress (2): 211 kB | 0.2/1.0 MB Progress (2): 211 kB | 0.2/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar (211 kB at 11 MB/s) 2024-09-12T00:42:28.800 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 0.2/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (2): 0.7/1.0 MB | 16/116 kB Progress (2): 0.7/1.0 MB | 16/116 kB Progress (2): 0.7/1.0 MB | 33/116 kB Progress (2): 0.8/1.0 MB | 33/116 kB Progress (2): 0.8/1.0 MB | 49/116 kB Progress (2): 0.8/1.0 MB | 49/116 kB Progress (2): 0.8/1.0 MB | 66/116 kB Progress (2): 0.8/1.0 MB | 82/116 kB Progress (2): 0.8/1.0 MB | 82/116 kB Progress (2): 0.8/1.0 MB | 98/116 kB Progress (3): 0.8/1.0 MB | 98/116 kB | 16/267 kB Progress (3): 0.8/1.0 MB | 98/116 kB | 16/267 kB Progress (3): 0.8/1.0 MB | 115/116 kB | 16/267 kB Progress (3): 0.8/1.0 MB | 116 kB | 16/267 kB Progress (3): 0.8/1.0 MB | 116 kB | 16/267 kB Progress (3): 0.8/1.0 MB | 116 kB | 33/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar (116 kB at 3.7 MB/s) 2024-09-12T00:42:28.803 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (2): 0.8/1.0 MB | 33/267 kB Progress (2): 0.8/1.0 MB | 49/267 kB Progress (2): 0.9/1.0 MB | 49/267 kB Progress (2): 0.9/1.0 MB | 62/267 kB Progress (2): 0.9/1.0 MB | 62/267 kB Progress (2): 0.9/1.0 MB | 78/267 kB Progress (2): 0.9/1.0 MB | 78/267 kB Progress (2): 0.9/1.0 MB | 78/267 kB Progress (2): 0.9/1.0 MB | 94/267 kB Progress (2): 0.9/1.0 MB | 94/267 kB Progress (2): 0.9/1.0 MB | 111/267 kB Progress (2): 0.9/1.0 MB | 111/267 kB Progress (2): 1.0/1.0 MB | 111/267 kB Progress (2): 1.0/1.0 MB | 127/267 kB Progress (2): 1.0/1.0 MB | 127/267 kB Progress (2): 1.0/1.0 MB | 127/267 kB Progress (2): 1.0/1.0 MB | 144/267 kB Progress (2): 1.0/1.0 MB | 144/267 kB Progress (2): 1.0 MB | 144/267 kB Progress (2): 1.0 MB | 160/267 kB Progress (2): 1.0 MB | 176/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar (1.0 MB at 29 MB/s) 2024-09-12T00:42:28.805 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 193/267 kB Progress (1): 209/267 kB Progress (1): 225/267 kB Progress (1): 242/267 kB Progress (1): 258/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar (267 kB at 7.4 MB/s) 2024-09-12T00:42:28.947 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] Building jar: /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/target/jcksum-1.0.jar 2024-09-12T00:42:28.983 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:42:28.983 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] BUILD SUCCESS 2024-09-12T00:42:28.983 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:42:28.984 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] Total time: 5.997 s 2024-09-12T00:42:28.984 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] Finished at: 2024-09-12T00:42:28Z 2024-09-12T00:42:28.984 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:42:29.006 INFO:tasks.workunit.client.0.smithi073.stderr:+ ./mvnw test -Dtest=PutObjects 2024-09-12T00:42:29.015 INFO:tasks.workunit.client.0.smithi073.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-12T00:42:29.978 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] Scanning for projects... 2024-09-12T00:42:30.062 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] 2024-09-12T00:42:30.063 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-12T00:42:30.063 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] Building jcksum 1.0 2024-09-12T00:42:30.063 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] from pom.xml 2024-09-12T00:42:30.063 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-12T00:42:30.368 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] 2024-09-12T00:42:30.368 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-12T00:42:30.452 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-12T00:42:30.453 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] 2024-09-12T00:42:30.453 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-12T00:42:30.536 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-12T00:42:30.536 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] 2024-09-12T00:42:30.536 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-12T00:42:30.538 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-12T00:42:30.538 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] 2024-09-12T00:42:30.538 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-12T00:42:30.542 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-12T00:42:30.543 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] 2024-09-12T00:42:30.543 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-12T00:42:30.714 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider 2024-09-12T00:42:30.925 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom 2024-09-12T00:42:31.141 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 1.4/4.7 kB Progress (1): 2.8/4.7 kB Progress (1): 4.1/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom (4.7 kB at 21 kB/s) 2024-09-12T00:42:31.153 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom 2024-09-12T00:42:31.173 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom (2.6 kB at 131 kB/s) 2024-09-12T00:42:31.180 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom 2024-09-12T00:42:31.199 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom (2.8 kB at 148 kB/s) 2024-09-12T00:42:31.205 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom 2024-09-12T00:42:31.223 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 1.4/3.0 kB Progress (1): 2.8/3.0 kB Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom (3.0 kB at 168 kB/s) 2024-09-12T00:42:31.227 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom 2024-09-12T00:42:31.245 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 1.4/3.2 kB Progress (1): 2.8/3.2 kB Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom (3.2 kB at 178 kB/s) 2024-09-12T00:42:31.249 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom 2024-09-12T00:42:31.266 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 1.4/1.7 kB Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom (1.7 kB at 99 kB/s) 2024-09-12T00:42:31.269 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom 2024-09-12T00:42:31.285 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom (2.8 kB at 167 kB/s) 2024-09-12T00:42:31.290 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar 2024-09-12T00:42:31.314 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 1.4/27 kB Progress (1): 2.8/27 kB Progress (1): 4.1/27 kB Progress (1): 5.5/27 kB Progress (1): 6.9/27 kB Progress (1): 8.3/27 kB Progress (1): 9.7/27 kB Progress (1): 11/27 kB Progress (1): 12/27 kB Progress (1): 14/27 kB Progress (1): 15/27 kB Progress (1): 16/27 kB Progress (1): 18/27 kB Progress (1): 19/27 kB Progress (1): 21/27 kB Progress (1): 22/27 kB Progress (1): 23/27 kB Progress (1): 25/27 kB Progress (1): 26/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar (27 kB at 1.2 MB/s) 2024-09-12T00:42:31.315 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar 2024-09-12T00:42:31.315 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar 2024-09-12T00:42:31.315 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar 2024-09-12T00:42:31.316 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar 2024-09-12T00:42:31.316 INFO:tasks.workunit.client.0.smithi073.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar 2024-09-12T00:42:31.359 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 16/189 kB Progress (1): 33/189 kB Progress (1): 49/189 kB Progress (1): 66/189 kB Progress (1): 82/189 kB Progress (1): 98/189 kB Progress (1): 115/189 kB Progress (1): 131/189 kB Progress (1): 147/189 kB Progress (1): 164/189 kB Progress (1): 180/189 kB Progress (1): 189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar (189 kB at 4.2 MB/s) 2024-09-12T00:42:31.369 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 1.4/7.7 kB Progress (1): 2.8/7.7 kB Progress (1): 4.1/7.7 kB Progress (2): 4.1/7.7 kB | 16/103 kB Progress (2): 5.5/7.7 kB | 16/103 kB Progress (2): 6.9/7.7 kB | 16/103 kB Progress (3): 6.9/7.7 kB | 16/103 kB | 1.4/18 kB Progress (3): 7.7 kB | 16/103 kB | 1.4/18 kB Progress (3): 7.7 kB | 16/103 kB | 2.8/18 kB Progress (4): 7.7 kB | 16/103 kB | 2.8/18 kB | 16/169 kB Progress (4): 7.7 kB | 16/103 kB | 4.1/18 kB | 16/169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar (7.7 kB at 144 kB/s) 2024-09-12T00:42:31.375 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (3): 16/103 kB | 5.5/18 kB | 16/169 kB Progress (3): 16/103 kB | 6.9/18 kB | 16/169 kB Progress (3): 16/103 kB | 8.3/18 kB | 16/169 kB Progress (3): 16/103 kB | 9.7/18 kB | 16/169 kB Progress (3): 16/103 kB | 11/18 kB | 16/169 kB Progress (3): 16/103 kB | 12/18 kB | 16/169 kB Progress (3): 16/103 kB | 14/18 kB | 16/169 kB Progress (3): 16/103 kB | 15/18 kB | 16/169 kB Progress (3): 16/103 kB | 16/18 kB | 16/169 kB Progress (3): 16/103 kB | 17/18 kB | 16/169 kB Progress (3): 16/103 kB | 18 kB | 16/169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar (18 kB at 288 kB/s) 2024-09-12T00:42:31.393 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (2): 33/103 kB | 16/169 kB Progress (2): 33/103 kB | 33/169 kB Progress (2): 49/103 kB | 33/169 kB Progress (2): 49/103 kB | 49/169 kB Progress (2): 66/103 kB | 49/169 kB Progress (2): 82/103 kB | 49/169 kB Progress (2): 82/103 kB | 66/169 kB Progress (2): 98/103 kB | 66/169 kB Progress (2): 103 kB | 66/169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar (103 kB at 1.3 MB/s) 2024-09-12T00:42:31.405 INFO:tasks.workunit.client.0.smithi073.stdout:Progress (1): 82/169 kB Progress (1): 98/169 kB Progress (1): 115/169 kB Progress (1): 131/169 kB Progress (1): 147/169 kB Progress (1): 164/169 kB Progress (1): 169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar (169 kB at 1.9 MB/s) 2024-09-12T00:42:31.419 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] 2024-09-12T00:42:31.419 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] ------------------------------------------------------- 2024-09-12T00:42:31.419 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] T E S T S 2024-09-12T00:42:31.419 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] ------------------------------------------------------- 2024-09-12T00:42:31.857 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] Running io.ceph.jcksum.PutObjects 2024-09-12T00:42:31.894 INFO:tasks.workunit.client.0.smithi073.stdout:PutObjects.java: starting test run: 2024-09-12T00:42:31.894 INFO:tasks.workunit.client.0.smithi073.stdout: AccessKey=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T00:42:31.894 INFO:tasks.workunit.client.0.smithi073.stdout: SecretKey=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T00:42:31.894 INFO:tasks.workunit.client.0.smithi073.stdout: EndpointUrl=https://smithi073.front.sepia.ceph.com:443 2024-09-12T00:42:31.992 INFO:tasks.workunit.client.0.smithi073.stderr:[main] WARN software.amazon.awssdk.http.apache.ApacheHttpClient - SSL Certificate verification is disabled. This is not a safe setting and should only be used for testing. 2024-09-12T00:42:32.092 INFO:tasks.workunit.client.0.smithi073.stdout:DEBUG: Environment Variables Read 2024-09-12T00:42:32.394 INFO:tasks.workunit.client.0.smithi073.stdout:DEBUG: S3 Client Initialized 2024-09-12T00:42:32.394 INFO:tasks.workunit.client.0.smithi073.stdout:DEBUG: Generating File 2024-09-12T00:42:32.394 INFO:tasks.workunit.client.0.smithi073.stdout:DEBUG: File Generated 2024-09-12T00:42:32.394 INFO:tasks.workunit.client.0.smithi073.stdout:DEBUG: Generating File 2024-09-12T00:42:32.394 INFO:tasks.workunit.client.0.smithi073.stdout:DEBUG: File Generated 2024-09-12T00:42:32.394 INFO:tasks.workunit.client.0.smithi073.stdout:DEBUG: Generating File 2024-09-12T00:42:32.394 INFO:tasks.workunit.client.0.smithi073.stdout:DEBUG: File Generated 2024-09-12T00:42:32.394 INFO:tasks.workunit.client.0.smithi073.stdout:DEBUG: Generating File 2024-09-12T00:42:32.395 INFO:tasks.workunit.client.0.smithi073.stdout:DEBUG: File Generated 2024-09-12T00:42:32.395 INFO:tasks.workunit.client.0.smithi073.stdout:DEBUG: Generating File 2024-09-12T00:42:32.395 INFO:tasks.workunit.client.0.smithi073.stdout:DEBUG: File Generated 2024-09-12T00:42:32.395 INFO:tasks.workunit.client.0.smithi073.stdout:DEBUG: Generating File 2024-09-12T00:42:32.395 INFO:tasks.workunit.client.0.smithi073.stdout:DEBUG: File Generated 2024-09-12T00:42:32.395 INFO:tasks.workunit.client.0.smithi073.stdout:DEBUG: Generated Big Files 2024-09-12T00:42:32.820 INFO:tasks.workunit.client.0.smithi073.stdout:HeadBucketResponse() 2024-09-12T00:42:32.821 INFO:tasks.workunit.client.0.smithi073.stdout:sheik is ready 2024-09-12T00:42:32.821 INFO:tasks.workunit.client.0.smithi073.stdout:DEBUG: Test Bucket Created 2024-09-12T00:42:32.893 INFO:tasks.workunit.client.0.smithi073.stdout:putObjectFromFileNoCksum called with file-0b 2024-09-12T00:42:33.093 INFO:tasks.workunit.client.0.smithi073.stdout:putObjectFromFileNoCksum called with file-8b 2024-09-12T00:42:33.194 INFO:tasks.workunit.client.0.smithi073.stdout:putObjectFromFileNoCksum called with file-200b 2024-09-12T00:42:33.294 INFO:tasks.workunit.client.0.smithi073.stdout:putObjectFromFileNoCksum called with file-21983b 2024-09-12T00:42:33.394 INFO:tasks.workunit.client.0.smithi073.stdout:putObjectFromFileNoCksum called with file-5519b 2024-09-12T00:42:33.695 INFO:tasks.workunit.client.0.smithi073.stdout:putObjectFromFileNoCksum called with file-204329b 2024-09-12T00:42:33.895 INFO:tasks.workunit.client.0.smithi073.stdout:putObjectFromFileNoCksum called with file-256k 2024-09-12T00:42:34.095 INFO:tasks.workunit.client.0.smithi073.stdout:putObjectFromFileNoCksum called with file-1m 2024-09-12T00:42:34.497 INFO:tasks.workunit.client.0.smithi073.stdout:putObjectFromFileNoCksum called with file-1038757b 2024-09-12T00:42:34.996 INFO:tasks.workunit.client.0.smithi073.stdout:mpuObjectFromFileNoCksum called with file-5m 2024-09-12T00:42:39.905 INFO:tasks.workunit.client.0.smithi073.stdout:mpuObjectFromFileNoCksum called with file-10m 2024-09-12T00:42:43.510 INFO:tasks.workunit.client.0.smithi073.stdout:mpuObjectFromFileNoCksum called with file-100m 2024-09-12T00:43:19.727 INFO:tasks.workunit.client.0.smithi073.stdout:arg: file-0b 2024-09-12T00:43:19.728 INFO:tasks.workunit.client.0.smithi073.stdout:arg: file-8b 2024-09-12T00:43:19.728 INFO:tasks.workunit.client.0.smithi073.stdout:arg: file-200b 2024-09-12T00:43:19.730 INFO:tasks.workunit.client.0.smithi073.stdout:arg: file-21983b 2024-09-12T00:43:19.730 INFO:tasks.workunit.client.0.smithi073.stdout:arg: file-5519b 2024-09-12T00:43:19.731 INFO:tasks.workunit.client.0.smithi073.stdout:arg: file-204329b 2024-09-12T00:43:19.732 INFO:tasks.workunit.client.0.smithi073.stdout:arg: file-256k 2024-09-12T00:43:19.733 INFO:tasks.workunit.client.0.smithi073.stdout:arg: file-1m 2024-09-12T00:43:19.734 INFO:tasks.workunit.client.0.smithi073.stdout:arg: file-1038757b 2024-09-12T00:43:19.753 INFO:tasks.workunit.client.0.smithi073.stdout:putObjectFromFileCksum called with file-0b 2024-09-12T00:43:19.853 INFO:tasks.workunit.client.0.smithi073.stdout:PutObjectResponse 2024-09-12T00:43:19.953 INFO:tasks.workunit.client.0.smithi073.stdout:putObjectFromFileCksum called with file-8b 2024-09-12T00:43:19.954 INFO:tasks.workunit.client.0.smithi073.stdout:PutObjectResponse 2024-09-12T00:43:20.053 INFO:tasks.workunit.client.0.smithi073.stdout:putObjectFromFileCksum called with file-200b 2024-09-12T00:43:20.054 INFO:tasks.workunit.client.0.smithi073.stdout:PutObjectResponse 2024-09-12T00:43:20.154 INFO:tasks.workunit.client.0.smithi073.stdout:putObjectFromFileCksum called with file-21983b 2024-09-12T00:43:20.244 INFO:tasks.workunit.client.0.smithi073.stdout:PutObjectResponse 2024-09-12T00:43:20.253 INFO:tasks.workunit.client.0.smithi073.stdout:putObjectFromFileCksum called with file-5519b 2024-09-12T00:43:20.354 INFO:tasks.workunit.client.0.smithi073.stdout:PutObjectResponse 2024-09-12T00:43:20.454 INFO:tasks.workunit.client.0.smithi073.stdout:putObjectFromFileCksum called with file-204329b 2024-09-12T00:43:20.554 INFO:tasks.workunit.client.0.smithi073.stdout:PutObjectResponse 2024-09-12T00:43:20.654 INFO:tasks.workunit.client.0.smithi073.stdout:putObjectFromFileCksum called with file-256k 2024-09-12T00:43:20.854 INFO:tasks.workunit.client.0.smithi073.stdout:PutObjectResponse 2024-09-12T00:43:20.955 INFO:tasks.workunit.client.0.smithi073.stdout:putObjectFromFileCksum called with file-1m 2024-09-12T00:43:21.355 INFO:tasks.workunit.client.0.smithi073.stdout:PutObjectResponse 2024-09-12T00:43:21.555 INFO:tasks.workunit.client.0.smithi073.stdout:putObjectFromFileCksum called with file-1038757b 2024-09-12T00:43:21.855 INFO:tasks.workunit.client.0.smithi073.stdout:PutObjectResponse 2024-09-12T00:43:22.056 INFO:tasks.workunit.client.0.smithi073.stdout:mpuObjectFromFileCksum called with file-5m 2024-09-12T00:43:25.559 INFO:tasks.workunit.client.0.smithi073.stdout:mpuObjectFromFileCksum called with file-10m 2024-09-12T00:43:30.864 INFO:tasks.workunit.client.0.smithi073.stdout:mpuObjectFromFileCksum called with file-100m 2024-09-12T00:44:21.630 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 109.8 s -- in io.ceph.jcksum.PutObjects 2024-09-12T00:44:21.642 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] 2024-09-12T00:44:21.642 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] Results: 2024-09-12T00:44:21.642 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] 2024-09-12T00:44:21.642 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0 2024-09-12T00:44:21.642 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] 2024-09-12T00:44:21.644 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:44:21.644 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] BUILD SUCCESS 2024-09-12T00:44:21.644 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:44:21.645 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] Total time: 01:51 min 2024-09-12T00:44:21.645 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] Finished at: 2024-09-12T00:44:21Z 2024-09-12T00:44:21.645 INFO:tasks.workunit.client.0.smithi073.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:44:21.667 INFO:tasks.workunit.client.0.smithi073.stderr:+ exit 2024-09-12T00:44:21.668 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:44:21.668 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:44:21.746 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh'] on client.0... 2024-09-12T00:44:21.746 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:44:22.112 DEBUG:teuthology.parallel:result is None 2024-09-12T00:44:22.112 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:44:22.150 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:44:22.151 DEBUG:teuthology.orchestra.run.smithi073:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:44:22.220 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:44:22.221 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:44:22.231 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:44:22.231 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:44:22.232 DEBUG:teuthology.orchestra.run.smithi073:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:44:22.289 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:44:22.289 INFO:teuthology.orchestra.run.smithi073.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:44:22.290 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:44:22.358 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:44:22.358 DEBUG:teuthology.orchestra.run.smithi073:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:44:22.427 INFO:tasks.workunit:timeout=3h 2024-09-12T00:44:22.428 INFO:tasks.workunit:cleanup=True 2024-09-12T00:44:22.429 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:44:22.497 INFO:tasks.workunit.client.0.smithi073.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:45:07.749 INFO:tasks.workunit.client.0.smithi073.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:45:07.749 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:45:07.749 INFO:tasks.workunit.client.0.smithi073.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:45:07.749 INFO:tasks.workunit.client.0.smithi073.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:45:07.750 INFO:tasks.workunit.client.0.smithi073.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:45:07.750 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:45:07.750 INFO:tasks.workunit.client.0.smithi073.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:45:07.750 INFO:tasks.workunit.client.0.smithi073.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:45:07.750 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:45:07.750 INFO:tasks.workunit.client.0.smithi073.stderr: git switch -c 2024-09-12T00:45:07.750 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:45:07.750 INFO:tasks.workunit.client.0.smithi073.stderr:Or undo this operation with: 2024-09-12T00:45:07.750 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:45:07.750 INFO:tasks.workunit.client.0.smithi073.stderr: git switch - 2024-09-12T00:45:07.750 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:45:07.750 INFO:tasks.workunit.client.0.smithi073.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:45:07.750 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:45:07.751 INFO:tasks.workunit.client.0.smithi073.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:45:07.754 DEBUG:teuthology.orchestra.run.smithi073:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:45:07.823 INFO:tasks.workunit.client.0.smithi073.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:45:07.825 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:45:07.825 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:45:07.873 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:45:07.921 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:45:07.960 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:45:07.961 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:45:07.961 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:45:07.999 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:45:08.003 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T00:45:08.003 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:45:08.072 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2024-09-12T00:45:08.074 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2024-09-12T00:45:08.074 DEBUG:teuthology.orchestra.run.smithi073:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-09-12T00:45:08.147 INFO:tasks.workunit.client.0.smithi073.stdout:INFO: fully qualified domain name: smithi073.front.sepia.ceph.com 2024-09-12T00:45:08.147 INFO:tasks.workunit.client.0.smithi073.stdout:== TESTING *COMPLETING* MULTIPART UPLOAD WITH RE-UPLOADS == 2024-09-12T00:45:08.148 INFO:tasks.workunit.client.0.smithi073.stdout:== TESTING VERSIONED BUCKET == 2024-09-12T00:45:10.710 INFO:tasks.workunit.client.0.smithi073.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T00:45:10.910 INFO:tasks.workunit.client.0.smithi073.stdout:Collecting pip 2024-09-12T00:45:10.915 INFO:tasks.workunit.client.0.smithi073.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T00:45:10.960 INFO:tasks.workunit.client.0.smithi073.stdout:Installing collected packages: pip 2024-09-12T00:45:10.960 INFO:tasks.workunit.client.0.smithi073.stdout: Attempting uninstall: pip 2024-09-12T00:45:10.960 INFO:tasks.workunit.client.0.smithi073.stdout: Found existing installation: pip 21.3.1 2024-09-12T00:45:11.110 INFO:tasks.workunit.client.0.smithi073.stdout: Uninstalling pip-21.3.1: 2024-09-12T00:45:11.115 INFO:tasks.workunit.client.0.smithi073.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T00:45:11.842 INFO:tasks.workunit.client.0.smithi073.stdout:Successfully installed pip-24.2 2024-09-12T00:45:12.656 INFO:tasks.workunit.client.0.smithi073.stdout:Collecting boto3 2024-09-12T00:45:12.658 INFO:tasks.workunit.client.0.smithi073.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T00:45:13.196 INFO:tasks.workunit.client.0.smithi073.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T00:45:13.197 INFO:tasks.workunit.client.0.smithi073.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T00:45:13.239 INFO:tasks.workunit.client.0.smithi073.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T00:45:13.241 INFO:tasks.workunit.client.0.smithi073.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T00:45:13.285 INFO:tasks.workunit.client.0.smithi073.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T00:45:13.286 INFO:tasks.workunit.client.0.smithi073.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T00:45:13.343 INFO:tasks.workunit.client.0.smithi073.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:45:13.344 INFO:tasks.workunit.client.0.smithi073.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T00:45:13.429 INFO:tasks.workunit.client.0.smithi073.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:45:13.430 INFO:tasks.workunit.client.0.smithi073.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-12T00:45:13.574 INFO:tasks.workunit.client.0.smithi073.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:45:13.575 INFO:tasks.workunit.client.0.smithi073.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T00:45:13.579 INFO:tasks.workunit.client.0.smithi073.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T00:45:13.580 INFO:tasks.workunit.client.0.smithi073.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T00:45:13.590 INFO:tasks.workunit.client.0.smithi073.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T00:45:13.591 INFO:tasks.workunit.client.0.smithi073.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T00:45:13.593 INFO:tasks.workunit.client.0.smithi073.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T00:45:13.594 INFO:tasks.workunit.client.0.smithi073.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-12T00:45:13.595 INFO:tasks.workunit.client.0.smithi073.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:45:13.670 INFO:tasks.workunit.client.0.smithi073.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T00:45:14.687 INFO:tasks.workunit.client.0.smithi073.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-12T00:45:14.919 INFO:tasks.workunit.client.0.smithi073.stdout:INFO: creating user 2024-09-12T00:45:15.236 INFO:tasks.workunit.client.0.smithi073.stdout:{ 2024-09-12T00:45:15.236 INFO:tasks.workunit.client.0.smithi073.stdout: "user_id": "testid", 2024-09-12T00:45:15.236 INFO:tasks.workunit.client.0.smithi073.stdout: "display_name": "M. Tester", 2024-09-12T00:45:15.236 INFO:tasks.workunit.client.0.smithi073.stdout: "email": "tester@ceph.com", 2024-09-12T00:45:15.236 INFO:tasks.workunit.client.0.smithi073.stdout: "suspended": 0, 2024-09-12T00:45:15.236 INFO:tasks.workunit.client.0.smithi073.stdout: "max_buckets": 1000, 2024-09-12T00:45:15.236 INFO:tasks.workunit.client.0.smithi073.stdout: "subusers": [], 2024-09-12T00:45:15.236 INFO:tasks.workunit.client.0.smithi073.stdout: "keys": [ 2024-09-12T00:45:15.236 INFO:tasks.workunit.client.0.smithi073.stdout: { 2024-09-12T00:45:15.236 INFO:tasks.workunit.client.0.smithi073.stdout: "user": "testid", 2024-09-12T00:45:15.237 INFO:tasks.workunit.client.0.smithi073.stdout: "access_key": "0555b35654ad1656d804", 2024-09-12T00:45:15.237 INFO:tasks.workunit.client.0.smithi073.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==", 2024-09-12T00:45:15.237 INFO:tasks.workunit.client.0.smithi073.stdout: "active": true, 2024-09-12T00:45:15.237 INFO:tasks.workunit.client.0.smithi073.stdout: "create_date": "2024-09-12T00:45:15.228690Z" 2024-09-12T00:45:15.237 INFO:tasks.workunit.client.0.smithi073.stdout: } 2024-09-12T00:45:15.237 INFO:tasks.workunit.client.0.smithi073.stdout: ], 2024-09-12T00:45:15.237 INFO:tasks.workunit.client.0.smithi073.stdout: "swift_keys": [], 2024-09-12T00:45:15.237 INFO:tasks.workunit.client.0.smithi073.stdout: "caps": [], 2024-09-12T00:45:15.238 INFO:tasks.workunit.client.0.smithi073.stdout: "op_mask": "read, write, delete", 2024-09-12T00:45:15.238 INFO:tasks.workunit.client.0.smithi073.stdout: "default_placement": "", 2024-09-12T00:45:15.238 INFO:tasks.workunit.client.0.smithi073.stdout: "default_storage_class": "", 2024-09-12T00:45:15.238 INFO:tasks.workunit.client.0.smithi073.stdout: "placement_tags": [], 2024-09-12T00:45:15.238 INFO:tasks.workunit.client.0.smithi073.stdout: "bucket_quota": { 2024-09-12T00:45:15.238 INFO:tasks.workunit.client.0.smithi073.stdout: "enabled": false, 2024-09-12T00:45:15.238 INFO:tasks.workunit.client.0.smithi073.stdout: "check_on_raw": false, 2024-09-12T00:45:15.238 INFO:tasks.workunit.client.0.smithi073.stdout: "max_size": -1, 2024-09-12T00:45:15.239 INFO:tasks.workunit.client.0.smithi073.stdout: "max_size_kb": 0, 2024-09-12T00:45:15.239 INFO:tasks.workunit.client.0.smithi073.stdout: "max_objects": -1 2024-09-12T00:45:15.239 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:45:15.239 INFO:tasks.workunit.client.0.smithi073.stdout: "user_quota": { 2024-09-12T00:45:15.239 INFO:tasks.workunit.client.0.smithi073.stdout: "enabled": false, 2024-09-12T00:45:15.239 INFO:tasks.workunit.client.0.smithi073.stdout: "check_on_raw": false, 2024-09-12T00:45:15.240 INFO:tasks.workunit.client.0.smithi073.stdout: "max_size": -1, 2024-09-12T00:45:15.240 INFO:tasks.workunit.client.0.smithi073.stdout: "max_size_kb": 0, 2024-09-12T00:45:15.240 INFO:tasks.workunit.client.0.smithi073.stdout: "max_objects": -1 2024-09-12T00:45:15.240 INFO:tasks.workunit.client.0.smithi073.stdout: }, 2024-09-12T00:45:15.240 INFO:tasks.workunit.client.0.smithi073.stdout: "temp_url_keys": [], 2024-09-12T00:45:15.240 INFO:tasks.workunit.client.0.smithi073.stdout: "type": "rgw", 2024-09-12T00:45:15.240 INFO:tasks.workunit.client.0.smithi073.stdout: "mfa_ids": [], 2024-09-12T00:45:15.241 INFO:tasks.workunit.client.0.smithi073.stdout: "account_id": "", 2024-09-12T00:45:15.241 INFO:tasks.workunit.client.0.smithi073.stdout: "path": "/", 2024-09-12T00:45:15.241 INFO:tasks.workunit.client.0.smithi073.stdout: "create_date": "2024-09-12T00:45:15.228678Z", 2024-09-12T00:45:15.241 INFO:tasks.workunit.client.0.smithi073.stdout: "tags": [], 2024-09-12T00:45:15.241 INFO:tasks.workunit.client.0.smithi073.stdout: "group_ids": [] 2024-09-12T00:45:15.241 INFO:tasks.workunit.client.0.smithi073.stdout:} 2024-09-12T00:45:15.242 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-09-12T00:45:24.821 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi073.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:45:24.822 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:45:24.872 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi073.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:45:24.872 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:45:24.922 INFO:tasks.workunit.client.0.smithi073.stderr:5+0 records in 2024-09-12T00:45:24.922 INFO:tasks.workunit.client.0.smithi073.stderr:5+0 records out 2024-09-12T00:45:24.922 INFO:tasks.workunit.client.0.smithi073.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0150618 s, 348 MB/s 2024-09-12T00:45:24.925 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi073.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:45:24.925 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:45:25.002 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi073.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:45:25.002 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:45:26.055 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi073.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:45:26.055 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:45:27.091 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi073.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:45:27.091 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:45:28.143 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi073.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:45:28.144 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:45:29.195 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi073.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:45:29.195 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:45:30.245 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi073.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:45:30.245 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:45:31.288 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi073.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:45:31.289 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:45:32.339 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi073.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:45:32.339 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:45:33.385 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi073.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:45:33.385 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:45:34.446 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi073.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:45:34.446 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:45:35.500 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi073.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:45:35.501 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:45:36.545 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi073.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:45:36.545 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:45:37.589 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi073.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:45:37.590 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:45:38.637 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi073.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:45:38.637 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:45:38.770 INFO:tasks.workunit.client.0.smithi073.stdout:bucket nams is reupload-bkt-116362 2024-09-12T00:45:38.770 INFO:tasks.workunit.client.0.smithi073.stdout:endpoint is https://smithi073.front.sepia.ceph.com:443 2024-09-12T00:45:38.770 INFO:tasks.workunit.client.0.smithi073.stdout:start UploadId=2~1m1JZAO4Swwehu3hRN0Q4aubQQd7Wjg 2024-09-12T00:45:38.770 INFO:tasks.workunit.client.0.smithi073.stdout:phase 1 uploaded part {'ETag': '"ac21c2603ee04e860f6cc185dad35dfe"', 'PartNumber': 1} 2024-09-12T00:45:38.771 INFO:tasks.workunit.client.0.smithi073.stdout:phase 1 uploaded part {'ETag': '"ac21c2603ee04e860f6cc185dad35dfe"', 'PartNumber': 2} 2024-09-12T00:45:38.771 INFO:tasks.workunit.client.0.smithi073.stdout:phase 2 uploaded part {'ETag': '"ac21c2603ee04e860f6cc185dad35dfe"', 'PartNumber': 1} 2024-09-12T00:45:38.771 INFO:tasks.workunit.client.0.smithi073.stdout:phase 2 uploaded part {'ETag': '"ac21c2603ee04e860f6cc185dad35dfe"', 'PartNumber': 1} 2024-09-12T00:45:38.771 INFO:tasks.workunit.client.0.smithi073.stdout:phase 2 uploaded part {'ETag': '"ac21c2603ee04e860f6cc185dad35dfe"', 'PartNumber': 1} 2024-09-12T00:45:38.771 INFO:tasks.workunit.client.0.smithi073.stdout:phase 2 uploaded part {'ETag': '"ac21c2603ee04e860f6cc185dad35dfe"', 'PartNumber': 1} 2024-09-12T00:45:38.771 INFO:tasks.workunit.client.0.smithi073.stdout:phase 2 uploaded part {'ETag': '"ac21c2603ee04e860f6cc185dad35dfe"', 'PartNumber': 1} 2024-09-12T00:45:38.771 INFO:tasks.workunit.client.0.smithi073.stdout:phase 2 uploaded part {'ETag': '"ac21c2603ee04e860f6cc185dad35dfe"', 'PartNumber': 1} 2024-09-12T00:45:38.771 INFO:tasks.workunit.client.0.smithi073.stdout:phase 2 uploaded part {'ETag': '"ac21c2603ee04e860f6cc185dad35dfe"', 'PartNumber': 1} 2024-09-12T00:45:38.771 INFO:tasks.workunit.client.0.smithi073.stdout:phase 2 uploaded part {'ETag': '"ac21c2603ee04e860f6cc185dad35dfe"', 'PartNumber': 1} 2024-09-12T00:45:38.771 INFO:tasks.workunit.client.0.smithi073.stdout:phase 2 uploaded part {'ETag': '"ac21c2603ee04e860f6cc185dad35dfe"', 'PartNumber': 1} 2024-09-12T00:45:38.771 INFO:tasks.workunit.client.0.smithi073.stdout:phase 2 uploaded part {'ETag': '"ac21c2603ee04e860f6cc185dad35dfe"', 'PartNumber': 1} 2024-09-12T00:45:38.771 INFO:tasks.workunit.client.0.smithi073.stdout:phase 2 uploaded part {'ETag': '"ac21c2603ee04e860f6cc185dad35dfe"', 'PartNumber': 1} 2024-09-12T00:45:38.772 INFO:tasks.workunit.client.0.smithi073.stdout:completing multipart upload, parts=[{'ETag': '"ac21c2603ee04e860f6cc185dad35dfe"', 'PartNumber': 1}, {'ETag': '"ac21c2603ee04e860f6cc185dad35dfe"', 'PartNumber': 2}] 2024-09-12T00:45:39.790 INFO:tasks.workunit.client.0.smithi073.stdout:radosgw-admin bucket radoslist: 2024-09-12T00:45:39.791 INFO:tasks.workunit.client.0.smithi073.stdout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3__:-K-uTtS8YkPKe-1svWjwATg-tNM.Wq2_mpu_test4 2024-09-12T00:45:39.791 INFO:tasks.workunit.client.0.smithi073.stdout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3_mpu_test4 2024-09-12T00:45:39.791 INFO:tasks.workunit.client.0.smithi073.stdout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3__multipart_mpu_test4.2~1m1JZAO4Swwehu3hRN0Q4aubQQd7Wjg.2 2024-09-12T00:45:39.791 INFO:tasks.workunit.client.0.smithi073.stdout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3__multipart_mpu_test4.BG42t-yximfd2pmMZJaZjSUG4NBRRV-n.1 2024-09-12T00:45:39.851 INFO:tasks.workunit.client.0.smithi073.stdout:rados ls: 2024-09-12T00:45:39.851 INFO:tasks.workunit.client.0.smithi073.stdout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3__:-K-uTtS8YkPKe-1svWjwATg-tNM.Wq2_mpu_test4 2024-09-12T00:45:39.851 INFO:tasks.workunit.client.0.smithi073.stdout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3_mpu_test4 2024-09-12T00:45:39.851 INFO:tasks.workunit.client.0.smithi073.stdout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3__multipart_mpu_test4.2~1m1JZAO4Swwehu3hRN0Q4aubQQd7Wjg.2 2024-09-12T00:45:39.852 INFO:tasks.workunit.client.0.smithi073.stdout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3__multipart_mpu_test4.BG42t-yximfd2pmMZJaZjSUG4NBRRV-n.1 2024-09-12T00:45:39.923 INFO:tasks.workunit.client.0.smithi073.stdout:== PASSED == 2024-09-12T00:45:39.923 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:45:39.923 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:45:40.003 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2024-09-12T00:45:40.003 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:45:40.377 DEBUG:teuthology.parallel:result is None 2024-09-12T00:45:40.378 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:45:40.417 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:45:40.417 DEBUG:teuthology.orchestra.run.smithi073:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:45:40.486 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:45:40.486 INFO:teuthology.run_tasks:Running task ragweed... 2024-09-12T00:45:40.502 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'force-branch': 'wip-67986', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2024-09-12T00:45:40.502 INFO:tasks.ragweed:Downloading ragweed... 2024-09-12T00:45:40.502 INFO:tasks.ragweed:Using branch 'wip-67986' for ragweed 2024-09-12T00:45:40.503 DEBUG:teuthology.orchestra.run.smithi073:> git clone -b wip-67986 https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T00:45:40.555 INFO:teuthology.orchestra.run.smithi073.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-12T00:45:40.705 INFO:tasks.ragweed:Creating rgw users... 2024-09-12T00:45:40.705 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2024-09-12T00:45:40.705 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key QAOKTBZNKYAMILECXZBI --secret IasulU0cLXVV1vel/mifbkpntUo8DsXlzh7auyu0KaJBqmjY1TY27Q== --email ragweed.client.0+test@test.test --system false 2024-09-12T00:45:40.812 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:45:40.812 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:45:40.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:40.846+0000 7ff817935800 20 rados->read ofs=0 len=0 2024-09-12T00:45:40.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:40.848+0000 7ff817935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:40.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:40.848+0000 7ff817935800 20 realm 2024-09-12T00:45:40.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:40.848+0000 7ff817935800 20 rados->read ofs=0 len=0 2024-09-12T00:45:40.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:40.848+0000 7ff817935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:40.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:40.848+0000 7ff817935800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:45:40.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:40.848+0000 7ff817935800 20 rados->read ofs=0 len=0 2024-09-12T00:45:40.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:40.848+0000 7ff817935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:40.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:40.848+0000 7ff817935800 20 rados->read ofs=0 len=0 2024-09-12T00:45:40.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:40.849+0000 7ff817935800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:45:40.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:40.849+0000 7ff817935800 20 rados->read ofs=0 len=0 2024-09-12T00:45:40.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:40.850+0000 7ff817935800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:45:40.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:40.850+0000 7ff817935800 20 searching for the correct realm 2024-09-12T00:45:40.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:40.852+0000 7ff813dc4640 0 -- 172.21.15.73:0/3685144901 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7ff808020060 msgr2=0x7ff808089710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:45:41.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.058+0000 7ff813dc4640 0 -- 172.21.15.73:0/3685144901 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7ff808020060 msgr2=0x7ff808089710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:45:41.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.062+0000 7ff817935800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:45:41.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.062+0000 7ff817935800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:45:41.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.062+0000 7ff817935800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:45:41.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.062+0000 7ff817935800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:45:41.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.062+0000 7ff817935800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:45:41.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.062+0000 7ff817935800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:45:41.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.062+0000 7ff817935800 20 rados->read ofs=0 len=0 2024-09-12T00:45:41.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.062+0000 7ff817935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:41.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.062+0000 7ff817935800 20 rados->read ofs=0 len=0 2024-09-12T00:45:41.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.063+0000 7ff817935800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:45:41.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.063+0000 7ff817935800 20 rados->read ofs=0 len=0 2024-09-12T00:45:41.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.063+0000 7ff817935800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:45:41.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.063+0000 7ff817935800 20 zone default found 2024-09-12T00:45:41.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.063+0000 7ff817935800 4 Realm: () 2024-09-12T00:45:41.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.063+0000 7ff817935800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:45:41.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.063+0000 7ff817935800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:45:41.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.063+0000 7ff817935800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:45:41.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.063+0000 7ff817935800 20 zonegroup default 2024-09-12T00:45:41.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.063+0000 7ff817935800 20 rados->read ofs=0 len=0 2024-09-12T00:45:41.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.063+0000 7ff817935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:41.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.063+0000 7ff817935800 20 rados->read ofs=0 len=0 2024-09-12T00:45:41.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.064+0000 7ff817935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:41.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.064+0000 7ff817935800 20 rados->read ofs=0 len=0 2024-09-12T00:45:41.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.064+0000 7ff817935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:41.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.064+0000 7ff817935800 20 started sync module instance, tier type = 2024-09-12T00:45:41.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.064+0000 7ff817935800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:45:41.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.073+0000 7ff817935800 20 add_watcher() i=0 2024-09-12T00:45:41.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.073+0000 7ff817935800 20 add_watcher() i=1 2024-09-12T00:45:41.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.073+0000 7ff817935800 20 add_watcher() i=2 2024-09-12T00:45:41.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.073+0000 7ff817935800 20 add_watcher() i=3 2024-09-12T00:45:41.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.073+0000 7ff817935800 20 add_watcher() i=4 2024-09-12T00:45:41.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.073+0000 7ff817935800 20 add_watcher() i=5 2024-09-12T00:45:41.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.074+0000 7ff817935800 20 add_watcher() i=6 2024-09-12T00:45:41.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.074+0000 7ff817935800 20 add_watcher() i=7 2024-09-12T00:45:41.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.074+0000 7ff817935800 2 all 8 watchers are set, enabling cache 2024-09-12T00:45:41.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.076+0000 7ff6c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:45:41.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.076+0000 7ff817935800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:45:41.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.076+0000 7ff817935800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:45:41.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.076+0000 7ff817935800 5 note: GC not initialized 2024-09-12T00:45:41.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.077+0000 7ff6c8fe1640 20 reqs_thread_entry: start 2024-09-12T00:45:41.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.077+0000 7ff817935800 20 init_complete bucket index max shards: 1 2024-09-12T00:45:41.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.077+0000 7ff817935800 20 Filter name: none 2024-09-12T00:45:41.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.077+0000 7ff6427fc640 20 reqs_thread_entry: start 2024-09-12T00:45:41.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.077+0000 7ff817935800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-12T00:45:41.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.077+0000 7ff817935800 20 rados->read ofs=0 len=0 2024-09-12T00:45:41.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.077+0000 7ff817935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:41.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.077+0000 7ff817935800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2024-09-12T00:45:41.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.077+0000 7ff817935800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T00:45:41.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.077+0000 7ff817935800 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2024-09-12T00:45:41.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.077+0000 7ff817935800 20 rados->read ofs=0 len=0 2024-09-12T00:45:41.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.078+0000 7ff817935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:41.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.078+0000 7ff817935800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2024-09-12T00:45:41.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.078+0000 7ff817935800 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T00:45:41.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.078+0000 7ff817935800 10 cache get: name=default.rgw.meta+users.keys+QAOKTBZNKYAMILECXZBI : miss 2024-09-12T00:45:41.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.078+0000 7ff817935800 20 rados->read ofs=0 len=0 2024-09-12T00:45:41.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.078+0000 7ff817935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:41.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.078+0000 7ff817935800 10 cache put: name=default.rgw.meta+users.keys+QAOKTBZNKYAMILECXZBI info.flags=0x0 2024-09-12T00:45:41.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.078+0000 7ff817935800 10 adding default.rgw.meta+users.keys+QAOKTBZNKYAMILECXZBI to cache LRU end 2024-09-12T00:45:41.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.078+0000 7ff817935800 10 cache get: name=default.rgw.meta+users.keys+QAOKTBZNKYAMILECXZBI : hit (negative entry) 2024-09-12T00:45:41.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.078+0000 7ff817935800 10 cache get: name=default.rgw.meta+users.keys+QAOKTBZNKYAMILECXZBI : hit (negative entry) 2024-09-12T00:45:41.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.079+0000 7ff817935800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-12T00:45:41.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.079+0000 7ff817935800 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T00:45:41.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.079+0000 7ff817935800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-12T00:45:41.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.080+0000 7ff6f6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758612 cookie 94214784726400 notifier 5666 bl.length()=675 2024-09-12T00:45:41.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.080+0000 7ff6f6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-12T00:45:41.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.080+0000 7ff6f6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T00:45:41.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.083+0000 7ff817935800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-12T00:45:41.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.083+0000 7ff817935800 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T00:45:41.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.083+0000 7ff817935800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-12T00:45:41.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.083+0000 7ff6f6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758649 cookie 94214784723728 notifier 5666 bl.length()=202 2024-09-12T00:45:41.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.083+0000 7ff6f6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-12T00:45:41.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.083+0000 7ff6f6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T00:45:41.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.086+0000 7ff817935800 10 cache put: name=default.rgw.meta+users.keys+QAOKTBZNKYAMILECXZBI info.flags=0x7 2024-09-12T00:45:41.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.086+0000 7ff817935800 10 moving default.rgw.meta+users.keys+QAOKTBZNKYAMILECXZBI to cache LRU end 2024-09-12T00:45:41.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.086+0000 7ff817935800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.keys:QAOKTBZNKYAMILECXZBI, ofs0, ns] 2024-09-12T00:45:41.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.086+0000 7ff6f6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758607 cookie 94214784740576 notifier 5666 bl.length()=190 2024-09-12T00:45:41.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.086+0000 7ff6f6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+QAOKTBZNKYAMILECXZBI info.flags=0x7 2024-09-12T00:45:41.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.086+0000 7ff6f6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+QAOKTBZNKYAMILECXZBI to cache LRU end 2024-09-12T00:45:41.086 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T00:45:41.086 INFO:teuthology.orchestra.run.smithi073.stdout: "user_id": "ragweed.client.0", 2024-09-12T00:45:41.086 INFO:teuthology.orchestra.run.smithi073.stdout: "display_name": "Mr. ragweed.client.0", 2024-09-12T00:45:41.086 INFO:teuthology.orchestra.run.smithi073.stdout: "email": "ragweed.client.0+test@test.test", 2024-09-12T00:45:41.086 INFO:teuthology.orchestra.run.smithi073.stdout: "suspended": 0, 2024-09-12T00:45:41.086 INFO:teuthology.orchestra.run.smithi073.stdout: "max_buckets": 1000, 2024-09-12T00:45:41.086 INFO:teuthology.orchestra.run.smithi073.stdout: "subusers": [], 2024-09-12T00:45:41.087 INFO:teuthology.orchestra.run.smithi073.stdout: "keys": [ 2024-09-12T00:45:41.087 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T00:45:41.087 INFO:teuthology.orchestra.run.smithi073.stdout: "user": "ragweed.client.0", 2024-09-12T00:45:41.087 INFO:teuthology.orchestra.run.smithi073.stdout: "access_key": "QAOKTBZNKYAMILECXZBI", 2024-09-12T00:45:41.087 INFO:teuthology.orchestra.run.smithi073.stdout: "secret_key": "IasulU0cLXVV1vel/mifbkpntUo8DsXlzh7auyu0KaJBqmjY1TY27Q==", 2024-09-12T00:45:41.087 INFO:teuthology.orchestra.run.smithi073.stdout: "active": true, 2024-09-12T00:45:41.087 INFO:teuthology.orchestra.run.smithi073.stdout: "create_date": "2024-09-12T00:45:41.079285Z" 2024-09-12T00:45:41.087 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T00:45:41.087 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-12T00:45:41.087 INFO:teuthology.orchestra.run.smithi073.stdout: "swift_keys": [], 2024-09-12T00:45:41.088 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": [], 2024-09-12T00:45:41.088 INFO:teuthology.orchestra.run.smithi073.stdout: "op_mask": "read, write, delete", 2024-09-12T00:45:41.088 INFO:teuthology.orchestra.run.smithi073.stdout: "default_placement": "", 2024-09-12T00:45:41.088 INFO:teuthology.orchestra.run.smithi073.stdout: "default_storage_class": "", 2024-09-12T00:45:41.088 INFO:teuthology.orchestra.run.smithi073.stdout: "placement_tags": [], 2024-09-12T00:45:41.088 INFO:teuthology.orchestra.run.smithi073.stdout: "bucket_quota": { 2024-09-12T00:45:41.088 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": false, 2024-09-12T00:45:41.088 INFO:teuthology.orchestra.run.smithi073.stdout: "check_on_raw": false, 2024-09-12T00:45:41.088 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size": -1, 2024-09-12T00:45:41.088 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size_kb": 0, 2024-09-12T00:45:41.089 INFO:teuthology.orchestra.run.smithi073.stdout: "max_objects": -1 2024-09-12T00:45:41.089 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T00:45:41.089 INFO:teuthology.orchestra.run.smithi073.stdout: "user_quota": { 2024-09-12T00:45:41.089 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": false, 2024-09-12T00:45:41.089 INFO:teuthology.orchestra.run.smithi073.stdout: "check_on_raw": false, 2024-09-12T00:45:41.089 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size": -1, 2024-09-12T00:45:41.089 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size_kb": 0, 2024-09-12T00:45:41.089 INFO:teuthology.orchestra.run.smithi073.stdout: "max_objects": -1 2024-09-12T00:45:41.089 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T00:45:41.089 INFO:teuthology.orchestra.run.smithi073.stdout: "temp_url_keys": [], 2024-09-12T00:45:41.089 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "rgw", 2024-09-12T00:45:41.089 INFO:teuthology.orchestra.run.smithi073.stdout: "mfa_ids": [], 2024-09-12T00:45:41.090 INFO:teuthology.orchestra.run.smithi073.stdout: "account_id": "", 2024-09-12T00:45:41.090 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/", 2024-09-12T00:45:41.090 INFO:teuthology.orchestra.run.smithi073.stdout: "create_date": "2024-09-12T00:45:41.079250Z", 2024-09-12T00:45:41.090 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-12T00:45:41.090 INFO:teuthology.orchestra.run.smithi073.stdout: "group_ids": [] 2024-09-12T00:45:41.090 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T00:45:41.090 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:45:41.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.088+0000 7ff6c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:45:41.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.090+0000 7ff817935800 20 remove_watcher() i=0 2024-09-12T00:45:41.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.090+0000 7ff817935800 2 removed watcher, disabling cache 2024-09-12T00:45:41.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.091+0000 7ff817935800 20 remove_watcher() i=1 2024-09-12T00:45:41.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.092+0000 7ff817935800 20 remove_watcher() i=2 2024-09-12T00:45:41.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.093+0000 7ff817935800 20 remove_watcher() i=3 2024-09-12T00:45:41.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.094+0000 7ff817935800 20 remove_watcher() i=4 2024-09-12T00:45:41.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.096+0000 7ff817935800 20 remove_watcher() i=5 2024-09-12T00:45:41.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.096+0000 7ff817935800 20 remove_watcher() i=6 2024-09-12T00:45:41.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.097+0000 7ff817935800 20 remove_watcher() i=7 2024-09-12T00:45:41.107 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2024-09-12T00:45:41.107 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key TZEFHVGKRAHDRHNWSEKF --secret rvhwQ8o5J6xUKb29sHZz1bTwmH0IzRYkygZ0lreRAZTA3+ar85Eftg== --email sysuser.client.0+test@test.test --system true 2024-09-12T00:45:41.174 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:45:41.174 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:45:41.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.209+0000 7f15ed820800 20 rados->read ofs=0 len=0 2024-09-12T00:45:41.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.210+0000 7f15ed820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:41.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.210+0000 7f15ed820800 20 realm 2024-09-12T00:45:41.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.210+0000 7f15ed820800 20 rados->read ofs=0 len=0 2024-09-12T00:45:41.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.211+0000 7f15ed820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:41.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.211+0000 7f15ed820800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:45:41.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.211+0000 7f15ed820800 20 rados->read ofs=0 len=0 2024-09-12T00:45:41.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.211+0000 7f15ed820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:41.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.211+0000 7f15ed820800 20 rados->read ofs=0 len=0 2024-09-12T00:45:41.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.212+0000 7f15ed820800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:45:41.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.212+0000 7f15ed820800 20 rados->read ofs=0 len=0 2024-09-12T00:45:41.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.213+0000 7f15ed820800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:45:41.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.213+0000 7f15ed820800 20 searching for the correct realm 2024-09-12T00:45:41.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.215+0000 7f15ebb12640 0 -- 172.21.15.73:0/2509883448 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f15d4021ac0 msgr2=0x7f15d4068930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:45:41.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.421+0000 7f15ebb12640 0 -- 172.21.15.73:0/2509883448 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f15d4021ac0 msgr2=0x7f15d4068930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:45:41.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.425+0000 7f15ed820800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:45:41.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.425+0000 7f15ed820800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:45:41.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.425+0000 7f15ed820800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:45:41.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.425+0000 7f15ed820800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:45:41.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.425+0000 7f15ed820800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:45:41.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.425+0000 7f15ed820800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:45:41.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.425+0000 7f15ed820800 20 rados->read ofs=0 len=0 2024-09-12T00:45:41.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.425+0000 7f15ed820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:41.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.425+0000 7f15ed820800 20 rados->read ofs=0 len=0 2024-09-12T00:45:41.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.426+0000 7f15ed820800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:45:41.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.426+0000 7f15ed820800 20 rados->read ofs=0 len=0 2024-09-12T00:45:41.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.426+0000 7f15ed820800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:45:41.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.426+0000 7f15ed820800 20 zone default found 2024-09-12T00:45:41.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.426+0000 7f15ed820800 4 Realm: () 2024-09-12T00:45:41.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.426+0000 7f15ed820800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:45:41.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.426+0000 7f15ed820800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:45:41.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.426+0000 7f15ed820800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:45:41.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.426+0000 7f15ed820800 20 zonegroup default 2024-09-12T00:45:41.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.426+0000 7f15ed820800 20 rados->read ofs=0 len=0 2024-09-12T00:45:41.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.426+0000 7f15ed820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:41.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.426+0000 7f15ed820800 20 rados->read ofs=0 len=0 2024-09-12T00:45:41.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.427+0000 7f15ed820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:41.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.427+0000 7f15ed820800 20 rados->read ofs=0 len=0 2024-09-12T00:45:41.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.427+0000 7f15ed820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:41.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.427+0000 7f15ed820800 20 started sync module instance, tier type = 2024-09-12T00:45:41.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.427+0000 7f15ed820800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:45:41.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.436+0000 7f15ed820800 20 add_watcher() i=0 2024-09-12T00:45:41.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.436+0000 7f15ed820800 20 add_watcher() i=1 2024-09-12T00:45:41.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.436+0000 7f15ed820800 20 add_watcher() i=2 2024-09-12T00:45:41.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.436+0000 7f15ed820800 20 add_watcher() i=3 2024-09-12T00:45:41.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.436+0000 7f15ed820800 20 add_watcher() i=4 2024-09-12T00:45:41.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.436+0000 7f15ed820800 20 add_watcher() i=5 2024-09-12T00:45:41.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.436+0000 7f15ed820800 20 add_watcher() i=6 2024-09-12T00:45:41.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.437+0000 7f15ed820800 20 add_watcher() i=7 2024-09-12T00:45:41.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.437+0000 7f15ed820800 2 all 8 watchers are set, enabling cache 2024-09-12T00:45:41.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.439+0000 7f14a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:45:41.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.439+0000 7f15ed820800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:45:41.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.439+0000 7f15ed820800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:45:41.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.439+0000 7f15ed820800 5 note: GC not initialized 2024-09-12T00:45:41.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.439+0000 7f14a0fe1640 20 reqs_thread_entry: start 2024-09-12T00:45:41.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.439+0000 7f15ed820800 20 init_complete bucket index max shards: 1 2024-09-12T00:45:41.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.440+0000 7f15ed820800 20 Filter name: none 2024-09-12T00:45:41.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.440+0000 7f141a7fc640 20 reqs_thread_entry: start 2024-09-12T00:45:41.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.440+0000 7f15ed820800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-12T00:45:41.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.440+0000 7f15ed820800 20 rados->read ofs=0 len=0 2024-09-12T00:45:41.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.440+0000 7f15ed820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:41.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.440+0000 7f15ed820800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2024-09-12T00:45:41.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.440+0000 7f15ed820800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T00:45:41.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.440+0000 7f15ed820800 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2024-09-12T00:45:41.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.440+0000 7f15ed820800 20 rados->read ofs=0 len=0 2024-09-12T00:45:41.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.440+0000 7f15ed820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:41.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.440+0000 7f15ed820800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2024-09-12T00:45:41.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.440+0000 7f15ed820800 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T00:45:41.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.440+0000 7f15ed820800 10 cache get: name=default.rgw.meta+users.keys+TZEFHVGKRAHDRHNWSEKF : miss 2024-09-12T00:45:41.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.440+0000 7f15ed820800 20 rados->read ofs=0 len=0 2024-09-12T00:45:41.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.441+0000 7f15ed820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:41.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.441+0000 7f15ed820800 10 cache put: name=default.rgw.meta+users.keys+TZEFHVGKRAHDRHNWSEKF info.flags=0x0 2024-09-12T00:45:41.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.441+0000 7f15ed820800 10 adding default.rgw.meta+users.keys+TZEFHVGKRAHDRHNWSEKF to cache LRU end 2024-09-12T00:45:41.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.441+0000 7f15ed820800 10 cache get: name=default.rgw.meta+users.keys+TZEFHVGKRAHDRHNWSEKF : hit (negative entry) 2024-09-12T00:45:41.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.441+0000 7f15ed820800 10 cache get: name=default.rgw.meta+users.keys+TZEFHVGKRAHDRHNWSEKF : hit (negative entry) 2024-09-12T00:45:41.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.442+0000 7f15ed820800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-12T00:45:41.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.442+0000 7f15ed820800 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T00:45:41.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.442+0000 7f15ed820800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-12T00:45:41.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.442+0000 7f14ceffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758650 cookie 94840777119984 notifier 5973 bl.length()=675 2024-09-12T00:45:41.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.442+0000 7f14ceffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-12T00:45:41.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.442+0000 7f14ceffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T00:45:41.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.445+0000 7f15ed820800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-12T00:45:41.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.445+0000 7f15ed820800 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T00:45:41.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.445+0000 7f15ed820800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-12T00:45:41.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.445+0000 7f14ceffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758613 cookie 94840777133760 notifier 5973 bl.length()=202 2024-09-12T00:45:41.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.445+0000 7f14ceffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-12T00:45:41.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.445+0000 7f14ceffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T00:45:41.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.448+0000 7f15ed820800 10 cache put: name=default.rgw.meta+users.keys+TZEFHVGKRAHDRHNWSEKF info.flags=0x7 2024-09-12T00:45:41.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.448+0000 7f15ed820800 10 moving default.rgw.meta+users.keys+TZEFHVGKRAHDRHNWSEKF to cache LRU end 2024-09-12T00:45:41.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.448+0000 7f15ed820800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:TZEFHVGKRAHDRHNWSEKF, ofs0, ns] 2024-09-12T00:45:41.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.448+0000 7f14ce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758651 cookie 94840777119984 notifier 5973 bl.length()=190 2024-09-12T00:45:41.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.448+0000 7f14ce7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+TZEFHVGKRAHDRHNWSEKF info.flags=0x7 2024-09-12T00:45:41.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.448+0000 7f14ce7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+TZEFHVGKRAHDRHNWSEKF to cache LRU end 2024-09-12T00:45:41.448 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T00:45:41.448 INFO:teuthology.orchestra.run.smithi073.stdout: "user_id": "sysuser.client.0", 2024-09-12T00:45:41.448 INFO:teuthology.orchestra.run.smithi073.stdout: "display_name": "Mr. sysuser.client.0", 2024-09-12T00:45:41.448 INFO:teuthology.orchestra.run.smithi073.stdout: "email": "sysuser.client.0+test@test.test", 2024-09-12T00:45:41.448 INFO:teuthology.orchestra.run.smithi073.stdout: "suspended": 0, 2024-09-12T00:45:41.448 INFO:teuthology.orchestra.run.smithi073.stdout: "max_buckets": 1000, 2024-09-12T00:45:41.449 INFO:teuthology.orchestra.run.smithi073.stdout: "subusers": [], 2024-09-12T00:45:41.449 INFO:teuthology.orchestra.run.smithi073.stdout: "keys": [ 2024-09-12T00:45:41.449 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T00:45:41.449 INFO:teuthology.orchestra.run.smithi073.stdout: "user": "sysuser.client.0", 2024-09-12T00:45:41.449 INFO:teuthology.orchestra.run.smithi073.stdout: "access_key": "TZEFHVGKRAHDRHNWSEKF", 2024-09-12T00:45:41.449 INFO:teuthology.orchestra.run.smithi073.stdout: "secret_key": "rvhwQ8o5J6xUKb29sHZz1bTwmH0IzRYkygZ0lreRAZTA3+ar85Eftg==", 2024-09-12T00:45:41.449 INFO:teuthology.orchestra.run.smithi073.stdout: "active": true, 2024-09-12T00:45:41.449 INFO:teuthology.orchestra.run.smithi073.stdout: "create_date": "2024-09-12T00:45:41.441918Z" 2024-09-12T00:45:41.449 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T00:45:41.449 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-12T00:45:41.449 INFO:teuthology.orchestra.run.smithi073.stdout: "swift_keys": [], 2024-09-12T00:45:41.449 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": [], 2024-09-12T00:45:41.449 INFO:teuthology.orchestra.run.smithi073.stdout: "op_mask": "read, write, delete", 2024-09-12T00:45:41.449 INFO:teuthology.orchestra.run.smithi073.stdout: "system": true, 2024-09-12T00:45:41.450 INFO:teuthology.orchestra.run.smithi073.stdout: "default_placement": "", 2024-09-12T00:45:41.450 INFO:teuthology.orchestra.run.smithi073.stdout: "default_storage_class": "", 2024-09-12T00:45:41.450 INFO:teuthology.orchestra.run.smithi073.stdout: "placement_tags": [], 2024-09-12T00:45:41.450 INFO:teuthology.orchestra.run.smithi073.stdout: "bucket_quota": { 2024-09-12T00:45:41.450 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": false, 2024-09-12T00:45:41.450 INFO:teuthology.orchestra.run.smithi073.stdout: "check_on_raw": false, 2024-09-12T00:45:41.450 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size": -1, 2024-09-12T00:45:41.450 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size_kb": 0, 2024-09-12T00:45:41.450 INFO:teuthology.orchestra.run.smithi073.stdout: "max_objects": -1 2024-09-12T00:45:41.450 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T00:45:41.450 INFO:teuthology.orchestra.run.smithi073.stdout: "user_quota": { 2024-09-12T00:45:41.450 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": false, 2024-09-12T00:45:41.450 INFO:teuthology.orchestra.run.smithi073.stdout: "check_on_raw": false, 2024-09-12T00:45:41.450 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size": -1, 2024-09-12T00:45:41.450 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size_kb": 0, 2024-09-12T00:45:41.451 INFO:teuthology.orchestra.run.smithi073.stdout: "max_objects": -1 2024-09-12T00:45:41.451 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T00:45:41.451 INFO:teuthology.orchestra.run.smithi073.stdout: "temp_url_keys": [], 2024-09-12T00:45:41.451 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "rgw", 2024-09-12T00:45:41.451 INFO:teuthology.orchestra.run.smithi073.stdout: "mfa_ids": [], 2024-09-12T00:45:41.451 INFO:teuthology.orchestra.run.smithi073.stdout: "account_id": "", 2024-09-12T00:45:41.451 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/", 2024-09-12T00:45:41.451 INFO:teuthology.orchestra.run.smithi073.stdout: "create_date": "2024-09-12T00:45:41.441903Z", 2024-09-12T00:45:41.451 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-12T00:45:41.451 INFO:teuthology.orchestra.run.smithi073.stdout: "group_ids": [] 2024-09-12T00:45:41.451 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T00:45:41.451 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:45:41.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.450+0000 7f14a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:45:41.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.453+0000 7f15ed820800 20 remove_watcher() i=0 2024-09-12T00:45:41.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.453+0000 7f15ed820800 2 removed watcher, disabling cache 2024-09-12T00:45:41.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.454+0000 7f15ed820800 20 remove_watcher() i=1 2024-09-12T00:45:41.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.455+0000 7f15ed820800 20 remove_watcher() i=2 2024-09-12T00:45:41.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.456+0000 7f15ed820800 20 remove_watcher() i=3 2024-09-12T00:45:41.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.457+0000 7f15ed820800 20 remove_watcher() i=4 2024-09-12T00:45:41.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.458+0000 7f15ed820800 20 remove_watcher() i=5 2024-09-12T00:45:41.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.459+0000 7f15ed820800 20 remove_watcher() i=6 2024-09-12T00:45:41.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:45:41.460+0000 7f15ed820800 20 remove_watcher() i=7 2024-09-12T00:45:41.470 INFO:tasks.ragweed:Configuring ragweed... 2024-09-12T00:45:41.470 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T00:45:41.470 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2024-09-12T00:45:41.499 INFO:tasks.ragweed:Configuring boto... 2024-09-12T00:45:41.499 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T00:45:41.499 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/boto.cfg 2024-09-12T00:45:41.568 DEBUG:teuthology.orchestra.run.smithi073:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2024-09-12T00:45:41.760 INFO:teuthology.orchestra.run.smithi073.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2024-09-12T00:45:41.924 INFO:teuthology.orchestra.run.smithi073.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2024-09-12T00:45:42.491 INFO:teuthology.orchestra.run.smithi073.stdout:py installdeps: -rrequirements.txt 2024-09-12T00:45:48.710 INFO:teuthology.orchestra.run.smithi073.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2024-09-12T00:45:52.142 INFO:teuthology.orchestra.run.smithi073.stdout:py installed: asyncssh==2.13.2,Babel==2.9.1,bcrypt==3.2.2,boto==2.49.0,cachetools==4.2.4,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2023.5.7,cffi==1.14.5,chardet==4.0.0,cheroot==8.6.0,CherryPy==18.6.1,cockpit @ file:///builddir/build/BUILD/cockpit-323/tmp/wheel/cockpit-323-py3-none-any.whl,cryptography==36.0.1,dasbus==1.4,dbus-python==1.2.18,distro==1.5.0,docopt==0.6.2,exceptiongroup==1.2.2,execnet==2.1.1,file-magic==0.4.0,gevent==24.2.1,google-auth==2.34.0,gpg==1.15.1,greenlet==3.1.0,grpcio==1.46.7,grpcio-tools==1.46.7,httplib2==0.22.0,idna==2.10,iniconfig==2.0.0,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.0.0,jaraco.functools==3.5.0,jaraco.text==3.2.0,Jinja2==2.11.3,jsonpatch==1.21,jsonpointer==2.0,kubernetes==26.1.0,libcomps==0.1.18,logutils==0.3.5,lxml==4.6.5,Mako==1.1.4.dev0,MarkupSafe==1.1.1,more-itertools==8.12.0,munch==4.0.0,natsort==7.1.1,nftables==0.1,numpy==1.20.1,oauthlib==3.1.1,packaging==20.9,pecan==1.4.2,perf==0.1,pexpect==4.8.0,pluggy==1.5.0,ply==3.11,portend==3.1.0,prettytable==0.7.2,protobuf==3.14.0,psutil==5.8.0,ptyprocess==0.6.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.20,PyGObject==3.40.1,pyOpenSSL==21.0.0,pyparsing==2.4.7,PySocks==1.7.1,pytest==8.3.3,python-dateutil==2.8.1,python-linux-procfs==0.7.3,pytz==2021.1,pyudev==0.22.0,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=fb9c41e54640291a5348fe1b0824ecd1d936d2c72f62f5484217da3bfe134891,rbd==2.0.0,registries-conf-ctl==1.0,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rpm==4.16.1.3,rsa==4.9,s3cmd==2.4.0,scipy==1.6.2,selinux==3.6,sepolicy==3.6,setools==4.4.4,setroubleshoot @ file:///builddir/build/BUILD/setroubleshoot-3.3.32/src,six==1.15.0,systemd-python==234,tempora==5.0.0,toml==0.10.2,tomli==2.0.1,typing_extensions==4.12.2,urllib3==1.26.5,WebOb==1.8.8,websocket-client==1.2.3,Werkzeug==2.0.3,zc.lockfile==2.0,zope.event==5.0,zope.interface==7.0.3 2024-09-12T00:45:52.142 INFO:teuthology.orchestra.run.smithi073.stdout:py run-test-pre: PYTHONHASHSEED='2687136874' 2024-09-12T00:45:52.142 INFO:teuthology.orchestra.run.smithi073.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2024-09-12T00:45:52.363 INFO:teuthology.orchestra.run.smithi073.stdout:============================= test session starts ============================== 2024-09-12T00:45:52.363 INFO:teuthology.orchestra.run.smithi073.stdout:platform linux -- Python 3.9.19, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2024-09-12T00:45:52.363 INFO:teuthology.orchestra.run.smithi073.stdout:cachedir: .tox/py/.pytest_cache 2024-09-12T00:45:52.363 INFO:teuthology.orchestra.run.smithi073.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T00:45:52.363 INFO:teuthology.orchestra.run.smithi073.stdout:configfile: pytest.ini 2024-09-12T00:45:52.460 INFO:teuthology.orchestra.run.smithi073.stdout:collecting ... collected 9 items 2024-09-12T00:45:52.461 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:45:57.920 INFO:teuthology.orchestra.run.smithi073.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2024-09-12T00:46:04.120 INFO:teuthology.orchestra.run.smithi073.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2024-09-12T00:46:08.631 INFO:teuthology.orchestra.run.smithi073.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2024-09-12T00:46:14.837 INFO:teuthology.orchestra.run.smithi073.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2024-09-12T00:46:21.000 INFO:teuthology.orchestra.run.smithi073.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2024-09-12T00:46:35.123 INFO:teuthology.orchestra.run.smithi073.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2024-09-12T00:46:46.952 INFO:teuthology.orchestra.run.smithi073.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2024-09-12T00:47:00.346 INFO:teuthology.orchestra.run.smithi073.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2024-09-12T00:47:26.852 INFO:teuthology.orchestra.run.smithi073.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2024-09-12T00:47:26.852 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:47:26.852 INFO:teuthology.orchestra.run.smithi073.stdout:=============================== warnings summary =============================== 2024-09-12T00:47:26.852 INFO:teuthology.orchestra.run.smithi073.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-09-12T00:47:26.852 INFO:teuthology.orchestra.run.smithi073.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-09-12T00:47:26.852 INFO:teuthology.orchestra.run.smithi073.stdout: import imp 2024-09-12T00:47:26.852 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:47:26.853 INFO:teuthology.orchestra.run.smithi073.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-12T00:47:26.853 INFO:teuthology.orchestra.run.smithi073.stdout:=================== 9 passed, 1 warning in 94.49s (0:01:34) ==================== 2024-09-12T00:47:26.885 INFO:teuthology.orchestra.run.smithi073.stdout:___________________________________ summary ____________________________________ 2024-09-12T00:47:26.885 INFO:teuthology.orchestra.run.smithi073.stdout: py: commands succeeded 2024-09-12T00:47:26.885 INFO:teuthology.orchestra.run.smithi073.stdout: congratulations :) 2024-09-12T00:47:26.902 INFO:tasks.ragweed:Cleaning up boto... 2024-09-12T00:47:26.903 DEBUG:teuthology.orchestra.run.smithi073:> rm -f /home/ubuntu/cephtest/boto.cfg 2024-09-12T00:47:26.931 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2024-09-12T00:47:27.028 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:47:27.028 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:27.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.063+0000 7fbb4a326800 20 rados->read ofs=0 len=0 2024-09-12T00:47:27.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.065+0000 7fbb4a326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:27.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.065+0000 7fbb4a326800 20 realm 2024-09-12T00:47:27.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.065+0000 7fbb4a326800 20 rados->read ofs=0 len=0 2024-09-12T00:47:27.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.065+0000 7fbb4a326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:27.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.065+0000 7fbb4a326800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:27.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.065+0000 7fbb4a326800 20 rados->read ofs=0 len=0 2024-09-12T00:47:27.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.065+0000 7fbb4a326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:27.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.065+0000 7fbb4a326800 20 rados->read ofs=0 len=0 2024-09-12T00:47:27.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.066+0000 7fbb4a326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:27.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.066+0000 7fbb4a326800 20 rados->read ofs=0 len=0 2024-09-12T00:47:27.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.067+0000 7fbb4a326800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:27.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.067+0000 7fbb4a326800 20 searching for the correct realm 2024-09-12T00:47:27.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.069+0000 7fbb4670a640 0 -- 172.21.15.73:0/3520240959 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fbb30096c10 msgr2=0x7fbb3007e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:27.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.275+0000 7fbb4670a640 0 -- 172.21.15.73:0/3520240959 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fbb30096c10 msgr2=0x7fbb3007e920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:27.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.280+0000 7fbb4a326800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:47:27.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.280+0000 7fbb4a326800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:27.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.280+0000 7fbb4a326800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:47:27.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.280+0000 7fbb4a326800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:27.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.280+0000 7fbb4a326800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:27.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.280+0000 7fbb4a326800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:27.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.280+0000 7fbb4a326800 20 rados->read ofs=0 len=0 2024-09-12T00:47:27.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.280+0000 7fbb4a326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:27.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.280+0000 7fbb4a326800 20 rados->read ofs=0 len=0 2024-09-12T00:47:27.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.280+0000 7fbb4a326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:27.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.280+0000 7fbb4a326800 20 rados->read ofs=0 len=0 2024-09-12T00:47:27.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.280+0000 7fbb4a326800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:27.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.280+0000 7fbb4a326800 20 zone default found 2024-09-12T00:47:27.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.280+0000 7fbb4a326800 4 Realm: () 2024-09-12T00:47:27.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.280+0000 7fbb4a326800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:47:27.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.280+0000 7fbb4a326800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:47:27.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.280+0000 7fbb4a326800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:27.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.280+0000 7fbb4a326800 20 zonegroup default 2024-09-12T00:47:27.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.280+0000 7fbb4a326800 20 rados->read ofs=0 len=0 2024-09-12T00:47:27.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.281+0000 7fbb4a326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:27.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.281+0000 7fbb4a326800 20 rados->read ofs=0 len=0 2024-09-12T00:47:27.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.281+0000 7fbb4a326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:27.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.281+0000 7fbb4a326800 20 rados->read ofs=0 len=0 2024-09-12T00:47:27.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.281+0000 7fbb4a326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:27.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.281+0000 7fbb4a326800 20 started sync module instance, tier type = 2024-09-12T00:47:27.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.281+0000 7fbb4a326800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:47:27.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.291+0000 7fbb4a326800 20 add_watcher() i=0 2024-09-12T00:47:27.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.291+0000 7fbb4a326800 20 add_watcher() i=1 2024-09-12T00:47:27.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.291+0000 7fbb4a326800 20 add_watcher() i=2 2024-09-12T00:47:27.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.291+0000 7fbb4a326800 20 add_watcher() i=3 2024-09-12T00:47:27.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.291+0000 7fbb4a326800 20 add_watcher() i=4 2024-09-12T00:47:27.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.291+0000 7fbb4a326800 20 add_watcher() i=5 2024-09-12T00:47:27.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.291+0000 7fbb4a326800 20 add_watcher() i=6 2024-09-12T00:47:27.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.292+0000 7fbb4a326800 20 add_watcher() i=7 2024-09-12T00:47:27.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.292+0000 7fbb4a326800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:27.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.293+0000 7fb9f77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:27.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.294+0000 7fbb4a326800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:27.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.294+0000 7fbb4a326800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:27.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.334+0000 7fb9f67fc640 20 reqs_thread_entry: start 2024-09-12T00:47:27.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.334+0000 7fbb4a326800 20 init_complete bucket index max shards: 1 2024-09-12T00:47:27.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.334+0000 7fbb4a326800 20 Filter name: none 2024-09-12T00:47:27.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.334+0000 7fb967fff640 20 reqs_thread_entry: start 2024-09-12T00:47:27.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.334+0000 7fbb4a326800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-12T00:47:27.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.334+0000 7fbb4a326800 20 rados->read ofs=0 len=0 2024-09-12T00:47:27.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.335+0000 7fbb4a326800 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T00:47:27.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.335+0000 7fbb4a326800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2024-09-12T00:47:27.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.335+0000 7fbb4a326800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T00:47:27.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.335+0000 7fbb4a326800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:47:27.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.335+0000 7fbb4a326800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4 : miss 2024-09-12T00:47:27.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.335+0000 7fbb4a326800 20 rados->read ofs=0 len=0 2024-09-12T00:47:27.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.336+0000 7fbb4a326800 20 rados_obj.operate() r=0 bl.length=426 2024-09-12T00:47:27.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.336+0000 7fbb4a326800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4 info.flags=0x17 2024-09-12T00:47:27.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.336+0000 7fbb4a326800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4 to cache LRU end 2024-09-12T00:47:27.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.336+0000 7fbb4a326800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:47:27.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.336+0000 7fbb4a326800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:47:27.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.336+0000 7fbb4a326800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4 2024-09-12T00:47:27.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.336+0000 7fbb4a326800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2024-09-12T00:47:27.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.336+0000 7fbb4a326800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2024-09-12T00:47:27.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.336+0000 7fbb4a326800 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2024-09-12T00:47:27.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.336+0000 7fbb4a326800 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2024-09-12T00:47:27.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.336+0000 7fbb4a326800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2024-09-12T00:47:27.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.336+0000 7fbb4a326800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2024-09-12T00:47:27.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.336+0000 7fbb4a326800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2024-09-12T00:47:27.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.336+0000 7fbb4a326800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2024-09-12T00:47:27.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.336+0000 7fbb4a326800 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2024-09-12T00:47:27.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.336+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb30064a40 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55910129c248 s->prefetch_data=0 2024-09-12T00:47:27.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.336+0000 7fbb4a326800 10 manifest: total_size = 13111 2024-09-12T00:47:27.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.336+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2543924524881173479 2024-09-12T00:47:27.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.336+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb30064a40 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55910129c248 s->prefetch_data=0 2024-09-12T00:47:27.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.336+0000 7fbb4a326800 20 prepare_atomic_modification: state is not atomic. state=0x55910129c248 2024-09-12T00:47:27.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.337+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4.0 2024-09-12T00:47:27.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.339+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:47:27.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.339+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=13111 stripe_ofs=13111 part_ofs=0 rule->part_size=0 2024-09-12T00:47:27.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.339+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2543924524881173479 2024-09-12T00:47:27.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.339+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:47:27.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.339+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4__shadow_.3pPdSyCMMpBuMpxvrJ2WMOXqqRXWDtm_0 2024-09-12T00:47:27.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.339+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:47:27.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.339+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:47:27.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.339+0000 7fbb4a326800 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2543924524881173479 2024-09-12T00:47:27.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.340+0000 7fba297fa640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2024-09-12T00:47:27.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.340+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb30064a40 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55910129bca8 s->prefetch_data=0 2024-09-12T00:47:27.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.341+0000 7fbb4a326800 10 manifest: total_size = 13124 2024-09-12T00:47:27.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.341+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8037276550306321580 2024-09-12T00:47:27.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.341+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb30064a40 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55910129bca8 s->prefetch_data=0 2024-09-12T00:47:27.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.341+0000 7fbb4a326800 20 prepare_atomic_modification: state is not atomic. state=0x55910129bca8 2024-09-12T00:47:27.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.341+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4.0 2024-09-12T00:47:27.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.343+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:47:27.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.343+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=13124 stripe_ofs=13124 part_ofs=0 rule->part_size=0 2024-09-12T00:47:27.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.343+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8037276550306321580 2024-09-12T00:47:27.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.343+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:47:27.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.343+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4__shadow_.--rx3SYTklAfYxY01RzpadvHjYmb0ku_0 2024-09-12T00:47:27.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.343+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:47:27.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.343+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:47:27.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.343+0000 7fbb4a326800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8037276550306321580 2024-09-12T00:47:27.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.344+0000 7fba28ff9640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2024-09-12T00:47:27.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.344+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb30064a40 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55910129bbf8 s->prefetch_data=0 2024-09-12T00:47:27.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.345+0000 7fbb4a326800 10 manifest: total_size = 5067 2024-09-12T00:47:27.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.345+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.607235285549188140 2024-09-12T00:47:27.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.345+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb30064a40 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55910129bbf8 s->prefetch_data=0 2024-09-12T00:47:27.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.345+0000 7fbb4a326800 20 prepare_atomic_modification: state is not atomic. state=0x55910129bbf8 2024-09-12T00:47:27.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.345+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4.0 2024-09-12T00:47:27.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.347+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:47:27.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.347+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=5067 stripe_ofs=5067 part_ofs=0 rule->part_size=0 2024-09-12T00:47:27.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.347+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.607235285549188140 2024-09-12T00:47:27.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.347+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:47:27.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.347+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4__shadow_.bxtALqRW-fUJj-h6zT1njWGtBh9NVYL_0 2024-09-12T00:47:27.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.347+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 327 2024-09-12T00:47:27.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.347+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:47:27.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.347+0000 7fbb4a326800 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.607235285549188140 2024-09-12T00:47:27.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.348+0000 7fba297fa640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2024-09-12T00:47:27.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.349+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb30064a40 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55910129bbf8 s->prefetch_data=0 2024-09-12T00:47:27.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.349+0000 7fbb4a326800 10 manifest: total_size = 12851 2024-09-12T00:47:27.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.349+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10233233160712319745 2024-09-12T00:47:27.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.349+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb30064a40 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55910129bbf8 s->prefetch_data=0 2024-09-12T00:47:27.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.349+0000 7fbb4a326800 20 prepare_atomic_modification: state is not atomic. state=0x55910129bbf8 2024-09-12T00:47:27.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.349+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4.0 2024-09-12T00:47:27.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.351+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:47:27.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.351+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=12851 stripe_ofs=12851 part_ofs=0 rule->part_size=0 2024-09-12T00:47:27.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.351+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10233233160712319745 2024-09-12T00:47:27.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.351+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:47:27.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.351+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4__shadow_.x0YCL93QBhEDB7fMu5CM7p3HLNFTn_6_0 2024-09-12T00:47:27.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.351+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:47:27.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.351+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:47:27.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.351+0000 7fbb4a326800 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10233233160712319745 2024-09-12T00:47:27.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.352+0000 7fba28ff9640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2024-09-12T00:47:27.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.353+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb30064a40 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55910129bbf8 s->prefetch_data=0 2024-09-12T00:47:27.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.353+0000 7fbb4a326800 10 manifest: total_size = 7662 2024-09-12T00:47:27.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.353+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13582829744013629290 2024-09-12T00:47:27.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.353+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb30064a40 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55910129bbf8 s->prefetch_data=0 2024-09-12T00:47:27.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.353+0000 7fbb4a326800 20 prepare_atomic_modification: state is not atomic. state=0x55910129bbf8 2024-09-12T00:47:27.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.353+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4.0 2024-09-12T00:47:27.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.355+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:47:27.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.355+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=7662 stripe_ofs=7662 part_ofs=0 rule->part_size=0 2024-09-12T00:47:27.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.355+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13582829744013629290 2024-09-12T00:47:27.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.355+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:47:27.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.355+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4__shadow_.-Ie1Oy5DuEU2-JSnj3Jv1e-vxC8d4k6_0 2024-09-12T00:47:27.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.355+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:47:27.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.355+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:47:27.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.355+0000 7fbb4a326800 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13582829744013629290 2024-09-12T00:47:27.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.356+0000 7fba297fa640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2024-09-12T00:47:27.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.356+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb30064a40 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55910129bbf8 s->prefetch_data=0 2024-09-12T00:47:27.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.357+0000 7fbb4a326800 10 manifest: total_size = 5038 2024-09-12T00:47:27.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.357+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9446003720218632413 2024-09-12T00:47:27.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.357+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb30064a40 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55910129bbf8 s->prefetch_data=0 2024-09-12T00:47:27.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.357+0000 7fbb4a326800 20 prepare_atomic_modification: state is not atomic. state=0x55910129bbf8 2024-09-12T00:47:27.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.357+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4.0 2024-09-12T00:47:27.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.359+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:47:27.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.359+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=5038 stripe_ofs=5038 part_ofs=0 rule->part_size=0 2024-09-12T00:47:27.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.359+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9446003720218632413 2024-09-12T00:47:27.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.359+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:47:27.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.359+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4__shadow_.S0vvoNz6lTXzLW7Xsk2QqsZat8Tlku7_0 2024-09-12T00:47:27.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.359+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:47:27.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.359+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:47:27.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.359+0000 7fbb4a326800 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9446003720218632413 2024-09-12T00:47:27.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.360+0000 7fba28ff9640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2024-09-12T00:47:27.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.360+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb30064a40 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55910129bbf8 s->prefetch_data=0 2024-09-12T00:47:27.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.361+0000 7fbb4a326800 10 manifest: total_size = 5363 2024-09-12T00:47:27.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.361+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12644898477813733443 2024-09-12T00:47:27.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.361+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb30064a40 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55910129bbf8 s->prefetch_data=0 2024-09-12T00:47:27.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.361+0000 7fbb4a326800 20 prepare_atomic_modification: state is not atomic. state=0x55910129bbf8 2024-09-12T00:47:27.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.361+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4.0 2024-09-12T00:47:27.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.363+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:47:27.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.363+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=5363 stripe_ofs=5363 part_ofs=0 rule->part_size=0 2024-09-12T00:47:27.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.363+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12644898477813733443 2024-09-12T00:47:27.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.363+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:47:27.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.363+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4__shadow_.yBdlkS6jVxsvpUsVq0HJ2ejCu68RDS-_0 2024-09-12T00:47:27.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.363+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:47:27.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.363+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:47:27.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.363+0000 7fbb4a326800 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12644898477813733443 2024-09-12T00:47:27.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.364+0000 7fba297fa640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2024-09-12T00:47:27.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.364+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb30064a40 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55910129bbf8 s->prefetch_data=0 2024-09-12T00:47:27.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.364+0000 7fbb4a326800 10 manifest: total_size = 7727 2024-09-12T00:47:27.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.364+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11736093612082126775 2024-09-12T00:47:27.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.364+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb30064a40 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55910129bbf8 s->prefetch_data=0 2024-09-12T00:47:27.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.364+0000 7fbb4a326800 20 prepare_atomic_modification: state is not atomic. state=0x55910129bbf8 2024-09-12T00:47:27.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.364+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4.0 2024-09-12T00:47:27.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.366+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:47:27.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.366+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=7727 stripe_ofs=7727 part_ofs=0 rule->part_size=0 2024-09-12T00:47:27.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.366+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11736093612082126775 2024-09-12T00:47:27.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.366+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:47:27.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.366+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4__shadow_.NpKSR2gnY-v3tY2F937Qkd_W5phOVWy_0 2024-09-12T00:47:27.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.366+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:47:27.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.366+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:47:27.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.366+0000 7fbb4a326800 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11736093612082126775 2024-09-12T00:47:27.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.367+0000 7fba28ff9640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2024-09-12T00:47:27.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.368+0000 7fbb4a326800 20 get_obj_state: octx=0x559101226df0 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55910129bbf8 s->prefetch_data=0 2024-09-12T00:47:27.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.368+0000 7fbb4a326800 10 manifest: total_size = 38602 2024-09-12T00:47:27.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.368+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13197240827817767882 2024-09-12T00:47:27.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.368+0000 7fbb4a326800 20 get_obj_state: octx=0x559101226df0 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55910129bbf8 s->prefetch_data=0 2024-09-12T00:47:27.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.368+0000 7fbb4a326800 20 prepare_atomic_modification: state is not atomic. state=0x55910129bbf8 2024-09-12T00:47:27.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.368+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4.0 2024-09-12T00:47:27.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.370+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:47:27.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.370+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=38602 stripe_ofs=38602 part_ofs=0 rule->part_size=0 2024-09-12T00:47:27.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.370+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13197240827817767882 2024-09-12T00:47:27.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.370+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:47:27.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.370+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4__shadow_.RPaK2lE1mYm5zEARllaUd0qAe_MsUgf_0 2024-09-12T00:47:27.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.370+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:47:27.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.370+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:47:27.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.370+0000 7fbb4a326800 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13197240827817767882 2024-09-12T00:47:27.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.372+0000 7fba297fa640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2024-09-12T00:47:27.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.372+0000 7fbb4a326800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:47:27.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.372+0000 7fbb4a326800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:47:27.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.372+0000 7fbb4a326800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:47:27.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.372+0000 7fbb4a326800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:47:27.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.372+0000 7fbb4a326800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:47:27.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.372+0000 7fbb4a326800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:47:27.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.372+0000 7fbb4a326800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4])"; uploads.size()=0; is_truncated=0 2024-09-12T00:47:27.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.373+0000 7fbb4a326800 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2024-09-12T00:47:27.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.373+0000 7fbb4a326800 20 rados->read ofs=0 len=0 2024-09-12T00:47:27.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.374+0000 7fbb4a326800 20 rados_obj.operate() r=0 bl.length=204 2024-09-12T00:47:27.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.374+0000 7fbb4a326800 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2024-09-12T00:47:27.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.374+0000 7fbb4a326800 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2024-09-12T00:47:27.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.375+0000 7fbb4a326800 10 removing default.rgw.meta+root+test-client.0-conf from cache 2024-09-12T00:47:27.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.375+0000 7fbb4a326800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2024-09-12T00:47:27.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.375+0000 7fba28ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496990 cookie 94081277352880 notifier 6006 bl.length()=162 2024-09-12T00:47:27.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.378+0000 7fbb4a326800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4 from cache 2024-09-12T00:47:27.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.378+0000 7fbb4a326800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4, ofs0, ns] 2024-09-12T00:47:27.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.379+0000 7fba28ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497010 cookie 94081277350400 notifier 6006 bl.length()=219 2024-09-12T00:47:27.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.381+0000 7fbb4a326800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4 : miss 2024-09-12T00:47:27.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.381+0000 7fbb4a326800 20 rados->read ofs=0 len=0 2024-09-12T00:47:27.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.381+0000 7fbb4a326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:27.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.381+0000 7fbb4a326800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4 info.flags=0x0 2024-09-12T00:47:27.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.381+0000 7fbb4a326800 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4 to cache LRU end 2024-09-12T00:47:27.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.384+0000 7fbb4a326800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11 : miss 2024-09-12T00:47:27.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.384+0000 7fbb4a326800 20 rados->read ofs=0 len=0 2024-09-12T00:47:27.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.384+0000 7fbb4a326800 20 rados_obj.operate() r=0 bl.length=457 2024-09-12T00:47:27.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.384+0000 7fbb4a326800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11 info.flags=0x17 2024-09-12T00:47:27.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.384+0000 7fbb4a326800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11 to cache LRU end 2024-09-12T00:47:27.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.384+0000 7fbb4a326800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:47:27.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.384+0000 7fbb4a326800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:47:27.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.384+0000 7fbb4a326800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11 2024-09-12T00:47:27.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.385+0000 7fbb4a326800 10 cls_bucket_list_unordered: got foo 2024-09-12T00:47:27.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.385+0000 7fbb4a326800 20 get_obj_state: octx=0x559101226df0 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x559101221548 s->prefetch_data=0 2024-09-12T00:47:27.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.385+0000 7fbb4a326800 10 manifest: total_size = 74198 2024-09-12T00:47:27.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.385+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7767853877224514757 2024-09-12T00:47:27.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.385+0000 7fbb4a326800 20 get_obj_state: octx=0x559101226df0 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x559101221548 s->prefetch_data=0 2024-09-12T00:47:27.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.385+0000 7fbb4a326800 20 prepare_atomic_modification: state is not atomic. state=0x559101221548 2024-09-12T00:47:27.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.385+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11.0 2024-09-12T00:47:27.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.387+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T00:47:27.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.387+0000 7fbb4a326800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=20613 2024-09-12T00:47:27.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.387+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-12T00:47:27.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.387+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T00:47:27.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.387+0000 7fbb4a326800 20 RGWObjManifest::operator++(): stripe_ofs=6312069 part_ofs=20613 rule->part_size=20613 2024-09-12T00:47:27.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.387+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2024-09-12T00:47:27.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.387+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T00:47:27.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.387+0000 7fbb4a326800 20 RGWObjManifest::operator++(): stripe_ofs=6332682 part_ofs=41226 rule->part_size=20613 2024-09-12T00:47:27.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.387+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2024-09-12T00:47:27.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.387+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2024-09-12T00:47:27.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.387+0000 7fbb4a326800 20 RGWObjManifest::operator++(): stripe_ofs=6353295 part_ofs=61839 rule->part_size=12359 2024-09-12T00:47:27.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.387+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2024-09-12T00:47:27.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.387+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7767853877224514757 2024-09-12T00:47:27.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.387+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:47:27.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.387+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11__multipart_foo.2~mkgUQzJYFGivMov6G8qxpRiwf_Glu1S.1 2024-09-12T00:47:27.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.387+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-12T00:47:27.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.387+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11__multipart_foo.2~mkgUQzJYFGivMov6G8qxpRiwf_Glu1S.2 2024-09-12T00:47:27.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.387+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-12T00:47:27.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.387+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11__multipart_foo.2~mkgUQzJYFGivMov6G8qxpRiwf_Glu1S.3 2024-09-12T00:47:27.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.387+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-12T00:47:27.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.387+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11__multipart_foo.2~mkgUQzJYFGivMov6G8qxpRiwf_Glu1S.4 2024-09-12T00:47:27.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.387+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-12T00:47:27.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.387+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:47:27.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.387+0000 7fbb4a326800 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7767853877224514757 2024-09-12T00:47:27.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.389+0000 7fba297fa640 20 handle_completion(): completion ok for obj=foo 2024-09-12T00:47:27.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.389+0000 7fbb4a326800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:47:27.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.389+0000 7fbb4a326800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:47:27.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.389+0000 7fbb4a326800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:47:27.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.389+0000 7fbb4a326800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:47:27.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.389+0000 7fbb4a326800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:47:27.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.389+0000 7fbb4a326800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:47:27.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.389+0000 7fbb4a326800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11])"; uploads.size()=0; is_truncated=0 2024-09-12T00:47:27.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.390+0000 7fbb4a326800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2024-09-12T00:47:27.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.390+0000 7fbb4a326800 20 rados->read ofs=0 len=0 2024-09-12T00:47:27.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.391+0000 7fbb4a326800 20 rados_obj.operate() r=0 bl.length=235 2024-09-12T00:47:27.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.391+0000 7fbb4a326800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2024-09-12T00:47:27.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.391+0000 7fbb4a326800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2024-09-12T00:47:27.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.392+0000 7fbb4a326800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2024-09-12T00:47:27.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.392+0000 7fbb4a326800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2024-09-12T00:47:27.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.392+0000 7fba28ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497011 cookie 94081277350400 notifier 6006 bl.length()=191 2024-09-12T00:47:27.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.395+0000 7fbb4a326800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11 from cache 2024-09-12T00:47:27.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.395+0000 7fbb4a326800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11, ofs0, ns] 2024-09-12T00:47:27.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.395+0000 7fba297fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496974 cookie 94081277368016 notifier 6006 bl.length()=249 2024-09-12T00:47:27.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.397+0000 7fbb4a326800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11 : miss 2024-09-12T00:47:27.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.397+0000 7fbb4a326800 20 rados->read ofs=0 len=0 2024-09-12T00:47:27.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.397+0000 7fbb4a326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:27.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.397+0000 7fbb4a326800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11 info.flags=0x0 2024-09-12T00:47:27.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.397+0000 7fbb4a326800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11 to cache LRU end 2024-09-12T00:47:27.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.399+0000 7fbb4a326800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12 : miss 2024-09-12T00:47:27.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.399+0000 7fbb4a326800 20 rados->read ofs=0 len=0 2024-09-12T00:47:27.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.400+0000 7fbb4a326800 20 rados_obj.operate() r=0 bl.length=464 2024-09-12T00:47:27.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.400+0000 7fbb4a326800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12 info.flags=0x17 2024-09-12T00:47:27.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.400+0000 7fbb4a326800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12 to cache LRU end 2024-09-12T00:47:27.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.400+0000 7fbb4a326800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:47:27.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.400+0000 7fbb4a326800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:47:27.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.400+0000 7fbb4a326800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12 2024-09-12T00:47:27.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.401+0000 7fbb4a326800 10 cls_bucket_list_unordered: got foo 2024-09-12T00:47:27.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.401+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb30004ac0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55910129bad8 s->prefetch_data=0 2024-09-12T00:47:27.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.401+0000 7fbb4a326800 10 manifest: total_size = 1667 2024-09-12T00:47:27.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.401+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11395806791327694308 2024-09-12T00:47:27.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.401+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb30004ac0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55910129bad8 s->prefetch_data=0 2024-09-12T00:47:27.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.401+0000 7fbb4a326800 20 prepare_atomic_modification: state is not atomic. state=0x55910129bad8 2024-09-12T00:47:27.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.401+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12.0 2024-09-12T00:47:27.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.403+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T00:47:27.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.403+0000 7fbb4a326800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=516 2024-09-12T00:47:27.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.403+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-12T00:47:27.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.403+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T00:47:27.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.403+0000 7fbb4a326800 20 RGWObjManifest::operator++(): stripe_ofs=6291972 part_ofs=516 rule->part_size=516 2024-09-12T00:47:27.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.403+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=516 2024-09-12T00:47:27.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.403+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T00:47:27.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.403+0000 7fbb4a326800 20 RGWObjManifest::operator++(): stripe_ofs=6292488 part_ofs=1032 rule->part_size=516 2024-09-12T00:47:27.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.403+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=1548 stripe_ofs=1548 part_ofs=1548 rule->part_size=119 2024-09-12T00:47:27.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.403+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=119 rules.size()=2 2024-09-12T00:47:27.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.403+0000 7fbb4a326800 20 RGWObjManifest::operator++(): stripe_ofs=6293004 part_ofs=1548 rule->part_size=119 2024-09-12T00:47:27.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.403+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=1667 stripe_ofs=1667 part_ofs=1667 rule->part_size=119 2024-09-12T00:47:27.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.403+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11395806791327694308 2024-09-12T00:47:27.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.403+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:47:27.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.403+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12__multipart_foo.2~HtpRUiqdFt-xF10uCKJ6o9MuGTOkubb.1 2024-09-12T00:47:27.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.403+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-12T00:47:27.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.403+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12__multipart_foo.2~HtpRUiqdFt-xF10uCKJ6o9MuGTOkubb.2 2024-09-12T00:47:27.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.403+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-12T00:47:27.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.403+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12__multipart_foo.2~HtpRUiqdFt-xF10uCKJ6o9MuGTOkubb.3 2024-09-12T00:47:27.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.403+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-12T00:47:27.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.403+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12__multipart_foo.2~HtpRUiqdFt-xF10uCKJ6o9MuGTOkubb.4 2024-09-12T00:47:27.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.403+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-12T00:47:27.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.403+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:47:27.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.404+0000 7fbb4a326800 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11395806791327694308 2024-09-12T00:47:27.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.405+0000 7fba28ff9640 20 handle_completion(): completion ok for obj=foo 2024-09-12T00:47:27.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.405+0000 7fbb4a326800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:47:27.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.405+0000 7fbb4a326800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:47:27.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.405+0000 7fbb4a326800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:47:27.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.405+0000 7fbb4a326800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:47:27.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.405+0000 7fbb4a326800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:47:27.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.405+0000 7fbb4a326800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:47:27.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.405+0000 7fbb4a326800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12])"; uploads.size()=0; is_truncated=0 2024-09-12T00:47:27.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.407+0000 7fbb4a326800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2024-09-12T00:47:27.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.407+0000 7fbb4a326800 20 rados->read ofs=0 len=0 2024-09-12T00:47:27.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.407+0000 7fbb4a326800 20 rados_obj.operate() r=0 bl.length=242 2024-09-12T00:47:27.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.407+0000 7fbb4a326800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2024-09-12T00:47:27.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.407+0000 7fbb4a326800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2024-09-12T00:47:27.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.408+0000 7fbb4a326800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2024-09-12T00:47:27.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.408+0000 7fbb4a326800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2024-09-12T00:47:27.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.409+0000 7fba297fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497026 cookie 94081277359040 notifier 6006 bl.length()=198 2024-09-12T00:47:27.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.411+0000 7fbb4a326800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12 from cache 2024-09-12T00:47:27.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.411+0000 7fbb4a326800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12, ofs0, ns] 2024-09-12T00:47:27.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.411+0000 7fba28ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497027 cookie 94081277359040 notifier 6006 bl.length()=256 2024-09-12T00:47:27.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.414+0000 7fbb4a326800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12 : miss 2024-09-12T00:47:27.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.414+0000 7fbb4a326800 20 rados->read ofs=0 len=0 2024-09-12T00:47:27.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.414+0000 7fbb4a326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:27.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.414+0000 7fbb4a326800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12 info.flags=0x0 2024-09-12T00:47:27.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.414+0000 7fbb4a326800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12 to cache LRU end 2024-09-12T00:47:27.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.416+0000 7fbb4a326800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10 : miss 2024-09-12T00:47:27.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.416+0000 7fbb4a326800 20 rados->read ofs=0 len=0 2024-09-12T00:47:27.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.416+0000 7fbb4a326800 20 rados_obj.operate() r=0 bl.length=459 2024-09-12T00:47:27.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.416+0000 7fbb4a326800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10 info.flags=0x17 2024-09-12T00:47:27.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.416+0000 7fbb4a326800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10 to cache LRU end 2024-09-12T00:47:27.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.416+0000 7fbb4a326800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:47:27.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.416+0000 7fbb4a326800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:47:27.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.416+0000 7fbb4a326800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10 2024-09-12T00:47:27.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.417+0000 7fbb4a326800 10 cls_bucket_list_unordered: got foo[p.KHFA8sxEJhXWIJJMqTvL.vQTzSEGg] 2024-09-12T00:47:27.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.417+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10.0 2024-09-12T00:47:27.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.417+0000 7fbb4a326800 20 get_obj_state: octx=0x559101224200 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55910121fa78 s->prefetch_data=0 2024-09-12T00:47:27.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.418+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to fh6rbxkwtyc5ce0dq2g75mfn5n6wcyyc 2024-09-12T00:47:27.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.418+0000 7fbb4a326800 20 get_obj_state_impl: setting s->olh_tag to oljqwqlmy876vexatx3ehddib68bkh6a 2024-09-12T00:47:27.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.418+0000 7fbb4a326800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=oljqwqlmy876vexatx3ehddib68bkh6a 2024-09-12T00:47:27.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.419+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10.0 2024-09-12T00:47:27.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.420+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10.0 2024-09-12T00:47:27.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.420+0000 7fbb4a326800 20 olh_log_entry: epoch=3 op=2 key=foo[] 2024-09-12T00:47:27.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.420+0000 7fbb4a326800 20 olh_log_entry: epoch=3 op=3 key=foo[p.KHFA8sxEJhXWIJJMqTvL.vQTzSEGg] 2024-09-12T00:47:27.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.420+0000 7fbb4a326800 20 get_obj_state: octx=0x559101224200 obj=test-client.0-r-test-multipart-index-versioning.1:_:p.KHFA8sxEJhXWIJJMqTvL.vQTzSEGg_foo state=0x55910123ae58 s->prefetch_data=0 2024-09-12T00:47:27.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.421+0000 7fbb4a326800 10 manifest: total_size = 886297 2024-09-12T00:47:27.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.421+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15828859719122824338 2024-09-12T00:47:27.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.421+0000 7fbb4a326800 20 get_obj_state: octx=0x559101224200 obj=test-client.0-r-test-multipart-index-versioning.1:_:p.KHFA8sxEJhXWIJJMqTvL.vQTzSEGg_foo state=0x55910123ae58 s->prefetch_data=0 2024-09-12T00:47:27.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.421+0000 7fbb4a326800 20 prepare_atomic_modification: state is not atomic. state=0x55910123ae58 2024-09-12T00:47:27.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.421+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10.0 2024-09-12T00:47:27.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.423+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T00:47:27.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.423+0000 7fbb4a326800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=246247 2024-09-12T00:47:27.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.423+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-12T00:47:27.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.423+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T00:47:27.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.423+0000 7fbb4a326800 20 RGWObjManifest::operator++(): stripe_ofs=6537703 part_ofs=246247 rule->part_size=246247 2024-09-12T00:47:27.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.423+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2024-09-12T00:47:27.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.423+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T00:47:27.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.423+0000 7fbb4a326800 20 RGWObjManifest::operator++(): stripe_ofs=6783950 part_ofs=492494 rule->part_size=246247 2024-09-12T00:47:27.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.423+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2024-09-12T00:47:27.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.423+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2024-09-12T00:47:27.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.423+0000 7fbb4a326800 20 RGWObjManifest::operator++(): stripe_ofs=7030197 part_ofs=738741 rule->part_size=147556 2024-09-12T00:47:27.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.423+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2024-09-12T00:47:27.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.423+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15828859719122824338 2024-09-12T00:47:27.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.423+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:47:27.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.423+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10__multipart_foo.2~kZIbosltDv1akiLT0-_K4jpAaug2Pe1.1 2024-09-12T00:47:27.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.423+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-12T00:47:27.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.423+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10__multipart_foo.2~kZIbosltDv1akiLT0-_K4jpAaug2Pe1.2 2024-09-12T00:47:27.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.423+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-12T00:47:27.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.423+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10__multipart_foo.2~kZIbosltDv1akiLT0-_K4jpAaug2Pe1.3 2024-09-12T00:47:27.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.423+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-12T00:47:27.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.423+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10__multipart_foo.2~kZIbosltDv1akiLT0-_K4jpAaug2Pe1.4 2024-09-12T00:47:27.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.423+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-12T00:47:27.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.423+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:47:27.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.423+0000 7fbb4a326800 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15828859719122824338 2024-09-12T00:47:27.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.424+0000 7fba28ff9640 20 handle_completion(): completion ok for obj=foo[p.KHFA8sxEJhXWIJJMqTvL.vQTzSEGg] 2024-09-12T00:47:27.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.425+0000 7fbb4a326800 20 get_obj_state: octx=0x559101224200 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55910121fa78 s->prefetch_data=0 2024-09-12T00:47:27.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.426+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10.0 2024-09-12T00:47:27.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.427+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10.0 2024-09-12T00:47:27.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.427+0000 7fbb4a326800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:47:27.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.427+0000 7fbb4a326800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:47:27.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.428+0000 7fbb4a326800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:47:27.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.428+0000 7fbb4a326800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:47:27.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.428+0000 7fbb4a326800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:47:27.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.428+0000 7fbb4a326800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:47:27.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.428+0000 7fbb4a326800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10])"; uploads.size()=0; is_truncated=0 2024-09-12T00:47:27.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.429+0000 7fbb4a326800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2024-09-12T00:47:27.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.429+0000 7fbb4a326800 20 rados->read ofs=0 len=0 2024-09-12T00:47:27.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.429+0000 7fbb4a326800 20 rados_obj.operate() r=0 bl.length=237 2024-09-12T00:47:27.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.429+0000 7fbb4a326800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2024-09-12T00:47:27.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.429+0000 7fbb4a326800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2024-09-12T00:47:27.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.430+0000 7fbb4a326800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2024-09-12T00:47:27.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.430+0000 7fbb4a326800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2024-09-12T00:47:27.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.430+0000 7fba297fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497028 cookie 94081277359040 notifier 6006 bl.length()=193 2024-09-12T00:47:27.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.433+0000 7fbb4a326800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10 from cache 2024-09-12T00:47:27.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.433+0000 7fbb4a326800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10, ofs0, ns] 2024-09-12T00:47:27.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.433+0000 7fba28ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496991 cookie 94081277352880 notifier 6006 bl.length()=251 2024-09-12T00:47:27.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.436+0000 7fbb4a326800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10 : miss 2024-09-12T00:47:27.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.436+0000 7fbb4a326800 20 rados->read ofs=0 len=0 2024-09-12T00:47:27.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.436+0000 7fbb4a326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:27.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.436+0000 7fbb4a326800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10 info.flags=0x0 2024-09-12T00:47:27.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.436+0000 7fbb4a326800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10 to cache LRU end 2024-09-12T00:47:27.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.438+0000 7fbb4a326800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9 : miss 2024-09-12T00:47:27.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.438+0000 7fbb4a326800 20 rados->read ofs=0 len=0 2024-09-12T00:47:27.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.439+0000 7fbb4a326800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:47:27.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.439+0000 7fbb4a326800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9 info.flags=0x17 2024-09-12T00:47:27.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.439+0000 7fbb4a326800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9 to cache LRU end 2024-09-12T00:47:27.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.439+0000 7fbb4a326800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:47:27.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.439+0000 7fbb4a326800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:47:27.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.439+0000 7fbb4a326800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9 2024-09-12T00:47:27.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.439+0000 7fbb4a326800 10 cls_bucket_list_unordered: got foo 2024-09-12T00:47:27.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.439+0000 7fbb4a326800 20 get_obj_state: octx=0x559101222cf0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55910121fa78 s->prefetch_data=0 2024-09-12T00:47:27.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.439+0000 7fbb4a326800 10 manifest: total_size = 74198 2024-09-12T00:47:27.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.439+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3670578218949790427 2024-09-12T00:47:27.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.439+0000 7fbb4a326800 20 get_obj_state: octx=0x559101222cf0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55910121fa78 s->prefetch_data=0 2024-09-12T00:47:27.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.439+0000 7fbb4a326800 20 prepare_atomic_modification: state is not atomic. state=0x55910121fa78 2024-09-12T00:47:27.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.439+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9.0 2024-09-12T00:47:27.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.441+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T00:47:27.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.441+0000 7fbb4a326800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=20613 2024-09-12T00:47:27.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.441+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-12T00:47:27.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.441+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T00:47:27.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.441+0000 7fbb4a326800 20 RGWObjManifest::operator++(): stripe_ofs=6312069 part_ofs=20613 rule->part_size=20613 2024-09-12T00:47:27.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.441+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2024-09-12T00:47:27.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.441+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T00:47:27.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.441+0000 7fbb4a326800 20 RGWObjManifest::operator++(): stripe_ofs=6332682 part_ofs=41226 rule->part_size=20613 2024-09-12T00:47:27.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.441+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2024-09-12T00:47:27.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.441+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2024-09-12T00:47:27.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.441+0000 7fbb4a326800 20 RGWObjManifest::operator++(): stripe_ofs=6353295 part_ofs=61839 rule->part_size=12359 2024-09-12T00:47:27.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.441+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2024-09-12T00:47:27.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.441+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3670578218949790427 2024-09-12T00:47:27.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.441+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:47:27.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.441+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9__multipart_foo.2~S0iNao5b_n6YpUJx0D_u4kjruhB2d9j.1 2024-09-12T00:47:27.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.441+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 344 2024-09-12T00:47:27.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.441+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9__multipart_foo.2~S0iNao5b_n6YpUJx0D_u4kjruhB2d9j.2 2024-09-12T00:47:27.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.441+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 588 2024-09-12T00:47:27.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.441+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9__multipart_foo.2~S0iNao5b_n6YpUJx0D_u4kjruhB2d9j.3 2024-09-12T00:47:27.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.441+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 832 2024-09-12T00:47:27.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.441+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9__multipart_foo.2~S0iNao5b_n6YpUJx0D_u4kjruhB2d9j.4 2024-09-12T00:47:27.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.441+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1076 2024-09-12T00:47:27.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.441+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:47:27.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.441+0000 7fbb4a326800 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3670578218949790427 2024-09-12T00:47:27.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.442+0000 7fba297fa640 20 handle_completion(): completion ok for obj=foo 2024-09-12T00:47:27.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.443+0000 7fbb4a326800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:47:27.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.443+0000 7fbb4a326800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:47:27.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.443+0000 7fbb4a326800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:47:27.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.443+0000 7fbb4a326800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:47:27.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.443+0000 7fbb4a326800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:47:27.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.443+0000 7fbb4a326800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:47:27.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.443+0000 7fbb4a326800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9])"; uploads.size()=0; is_truncated=0 2024-09-12T00:47:27.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.444+0000 7fbb4a326800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2024-09-12T00:47:27.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.444+0000 7fbb4a326800 20 rados->read ofs=0 len=0 2024-09-12T00:47:27.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.445+0000 7fbb4a326800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:47:27.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.445+0000 7fbb4a326800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2024-09-12T00:47:27.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.445+0000 7fbb4a326800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2024-09-12T00:47:27.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.446+0000 7fbb4a326800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2024-09-12T00:47:27.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.446+0000 7fbb4a326800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2024-09-12T00:47:27.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.446+0000 7fba28ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496992 cookie 94081277365744 notifier 6006 bl.length()=183 2024-09-12T00:47:27.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.449+0000 7fbb4a326800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9 from cache 2024-09-12T00:47:27.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.449+0000 7fbb4a326800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9, ofs0, ns] 2024-09-12T00:47:27.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.449+0000 7fba28ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496977 cookie 94081277376880 notifier 6006 bl.length()=240 2024-09-12T00:47:27.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.451+0000 7fbb4a326800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9 : miss 2024-09-12T00:47:27.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.451+0000 7fbb4a326800 20 rados->read ofs=0 len=0 2024-09-12T00:47:27.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.451+0000 7fbb4a326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:27.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.451+0000 7fbb4a326800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9 info.flags=0x0 2024-09-12T00:47:27.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.451+0000 7fbb4a326800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9 to cache LRU end 2024-09-12T00:47:27.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.454+0000 7fbb4a326800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15 : miss 2024-09-12T00:47:27.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.454+0000 7fbb4a326800 20 rados->read ofs=0 len=0 2024-09-12T00:47:27.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.454+0000 7fbb4a326800 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:47:27.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.454+0000 7fbb4a326800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15 info.flags=0x17 2024-09-12T00:47:27.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.454+0000 7fbb4a326800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15 to cache LRU end 2024-09-12T00:47:27.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.454+0000 7fbb4a326800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:47:27.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.454+0000 7fbb4a326800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:47:27.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.454+0000 7fbb4a326800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15 2024-09-12T00:47:27.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.455+0000 7fbb4a326800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T00:47:27.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.455+0000 7fbb4a326800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-12T00:47:27.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.455+0000 7fbb4a326800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-12T00:47:27.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.455+0000 7fbb4a326800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-12T00:47:27.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.455+0000 7fbb4a326800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T00:47:27.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.455+0000 7fbb4a326800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-12T00:47:27.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.455+0000 7fbb4a326800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-12T00:47:27.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.455+0000 7fbb4a326800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-12T00:47:27.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.455+0000 7fbb4a326800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T00:47:27.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.455+0000 7fbb4a326800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-12T00:47:27.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.455+0000 7fbb4a326800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-12T00:47:27.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.455+0000 7fbb4a326800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-12T00:47:27.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.455+0000 7fbb4a326800 20 get_obj_state: octx=0x55910129c4d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x559101242268 s->prefetch_data=0 2024-09-12T00:47:27.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.456+0000 7fbb4a326800 10 manifest: total_size = 5242880 2024-09-12T00:47:27.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.456+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4703076284671197260 2024-09-12T00:47:27.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.456+0000 7fbb4a326800 20 get_obj_state: octx=0x55910129c4d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x559101242268 s->prefetch_data=0 2024-09-12T00:47:27.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.456+0000 7fbb4a326800 20 prepare_atomic_modification: state is not atomic. state=0x559101242268 2024-09-12T00:47:27.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.456+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15.0 2024-09-12T00:47:27.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.458+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:47:27.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.458+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:47:27.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.458+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4703076284671197260 2024-09-12T00:47:27.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.458+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:47:27.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.458+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15__shadow_.oAW_hiSp3cXrD2rdh17i_UHpnognwQ1_0 2024-09-12T00:47:27.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.458+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-12T00:47:27.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.458+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:47:27.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.458+0000 7fbb4a326800 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4703076284671197260 2024-09-12T00:47:27.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.459+0000 7fba28ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T00:47:27.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.459+0000 7fbb4a326800 20 get_obj_state: octx=0x559101228840 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x559101242268 s->prefetch_data=0 2024-09-12T00:47:27.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.460+0000 7fbb4a326800 10 manifest: total_size = 5242880 2024-09-12T00:47:27.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.460+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9077386875916417639 2024-09-12T00:47:27.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.460+0000 7fbb4a326800 20 get_obj_state: octx=0x559101228840 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x559101242268 s->prefetch_data=0 2024-09-12T00:47:27.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.460+0000 7fbb4a326800 20 prepare_atomic_modification: state is not atomic. state=0x559101242268 2024-09-12T00:47:27.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.460+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15.0 2024-09-12T00:47:27.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.462+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:47:27.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.462+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:47:27.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.462+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9077386875916417639 2024-09-12T00:47:27.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.462+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:47:27.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.462+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15__shadow_.oAW_hiSp3cXrD2rdh17i_UHpnognwQ1_0 2024-09-12T00:47:27.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.462+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-12T00:47:27.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.462+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:47:27.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.462+0000 7fbb4a326800 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9077386875916417639 2024-09-12T00:47:27.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.463+0000 7fba297fa640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-12T00:47:27.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.463+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb4000a4b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x559101242268 s->prefetch_data=0 2024-09-12T00:47:27.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.463+0000 7fbb4a326800 10 manifest: total_size = 5242880 2024-09-12T00:47:27.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.463+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to _4lY5R1e81rYGI2Wy6UT6VTCSR4iYXuy 2024-09-12T00:47:27.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.463+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb4000a4b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x559101242268 s->prefetch_data=0 2024-09-12T00:47:27.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.463+0000 7fbb4a326800 20 prepare_atomic_modification: state is not atomic. state=0x559101242268 2024-09-12T00:47:27.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.463+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15.0 2024-09-12T00:47:27.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.466+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:47:27.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.466+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:47:27.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.466+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - tag is: _4lY5R1e81rYGI2Wy6UT6VTCSR4iYXuy 2024-09-12T00:47:27.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.466+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:47:27.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.466+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15__shadow_.4yuRw8VhITgjJLoR4yoJ0ASJeVrxdiw_0 2024-09-12T00:47:27.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.466+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T00:47:27.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.466+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:47:27.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.466+0000 7fbb4a326800 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: _4lY5R1e81rYGI2Wy6UT6VTCSR4iYXuy 2024-09-12T00:47:27.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.467+0000 7fba28ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-12T00:47:27.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.467+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb40004f10 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x559101242268 s->prefetch_data=0 2024-09-12T00:47:27.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.467+0000 7fbb4a326800 10 manifest: total_size = 5242880 2024-09-12T00:47:27.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.467+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to _qPClndDhGbdoDUIcSHxDZXhmk5SvGk1 2024-09-12T00:47:27.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.467+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb40004f10 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x559101242268 s->prefetch_data=0 2024-09-12T00:47:27.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.467+0000 7fbb4a326800 20 prepare_atomic_modification: state is not atomic. state=0x559101242268 2024-09-12T00:47:27.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.467+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15.0 2024-09-12T00:47:27.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.469+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:47:27.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.469+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:47:27.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.469+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - tag is: _qPClndDhGbdoDUIcSHxDZXhmk5SvGk1 2024-09-12T00:47:27.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.469+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:47:27.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.469+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15__shadow_.tRDhGs81AZCXFB-jO4wLzC0PJHjqP54_0 2024-09-12T00:47:27.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.469+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T00:47:27.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.469+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:47:27.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.469+0000 7fbb4a326800 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: _qPClndDhGbdoDUIcSHxDZXhmk5SvGk1 2024-09-12T00:47:27.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.470+0000 7fba297fa640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-12T00:47:27.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.470+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb4000a4b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x559101242268 s->prefetch_data=0 2024-09-12T00:47:27.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.471+0000 7fbb4a326800 10 manifest: total_size = 5242880 2024-09-12T00:47:27.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.471+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7907179862597881335 2024-09-12T00:47:27.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.471+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb4000a4b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x559101242268 s->prefetch_data=0 2024-09-12T00:47:27.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.471+0000 7fbb4a326800 20 prepare_atomic_modification: state is not atomic. state=0x559101242268 2024-09-12T00:47:27.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.471+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15.0 2024-09-12T00:47:27.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.473+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:47:27.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.473+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:47:27.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.473+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7907179862597881335 2024-09-12T00:47:27.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.473+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:47:27.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.473+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15__shadow_.FQZRgj7kU-hpMCJLEyI7BIhl1X_wDmq_0 2024-09-12T00:47:27.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.473+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-12T00:47:27.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.473+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:47:27.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.473+0000 7fbb4a326800 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7907179862597881335 2024-09-12T00:47:27.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.474+0000 7fba28ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T00:47:27.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.474+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb40004f10 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x559101242268 s->prefetch_data=0 2024-09-12T00:47:27.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.474+0000 7fbb4a326800 10 manifest: total_size = 5242880 2024-09-12T00:47:27.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.474+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to _NXG055-zbp9hnIimeiu-Zx69ijxc73v 2024-09-12T00:47:27.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.474+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb40004f10 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x559101242268 s->prefetch_data=0 2024-09-12T00:47:27.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.474+0000 7fbb4a326800 20 prepare_atomic_modification: state is not atomic. state=0x559101242268 2024-09-12T00:47:27.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.474+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15.0 2024-09-12T00:47:27.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.476+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:47:27.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.476+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:47:27.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.476+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - tag is: _NXG055-zbp9hnIimeiu-Zx69ijxc73v 2024-09-12T00:47:27.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.476+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:47:27.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.476+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15__shadow_.gw494sD7G-Jv1_xYfYo6qM5XhwYrAvx_0 2024-09-12T00:47:27.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.476+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T00:47:27.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.476+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:47:27.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.476+0000 7fbb4a326800 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: _NXG055-zbp9hnIimeiu-Zx69ijxc73v 2024-09-12T00:47:27.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.477+0000 7fba297fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-12T00:47:27.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.478+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb4000a4b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x559101242268 s->prefetch_data=0 2024-09-12T00:47:27.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.478+0000 7fbb4a326800 10 manifest: total_size = 5242880 2024-09-12T00:47:27.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.478+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10402148564831662732 2024-09-12T00:47:27.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.478+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb4000a4b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x559101242268 s->prefetch_data=0 2024-09-12T00:47:27.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.478+0000 7fbb4a326800 20 prepare_atomic_modification: state is not atomic. state=0x559101242268 2024-09-12T00:47:27.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.478+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15.0 2024-09-12T00:47:27.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.480+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:47:27.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.480+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:47:27.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.480+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10402148564831662732 2024-09-12T00:47:27.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.480+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:47:27.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.480+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15__shadow_.FQZRgj7kU-hpMCJLEyI7BIhl1X_wDmq_0 2024-09-12T00:47:27.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.480+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-09-12T00:47:27.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.480+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:47:27.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.480+0000 7fbb4a326800 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10402148564831662732 2024-09-12T00:47:27.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.481+0000 7fba28ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-12T00:47:27.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.482+0000 7fbb4a326800 20 get_obj_state: octx=0x559101223da0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x559101242268 s->prefetch_data=0 2024-09-12T00:47:27.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.482+0000 7fbb4a326800 10 manifest: total_size = 5242880 2024-09-12T00:47:27.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.482+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to _Dm3Y2RNqPbFbDKfJU458C5UE2gkoxgL 2024-09-12T00:47:27.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.482+0000 7fbb4a326800 20 get_obj_state: octx=0x559101223da0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x559101242268 s->prefetch_data=0 2024-09-12T00:47:27.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.482+0000 7fbb4a326800 20 prepare_atomic_modification: state is not atomic. state=0x559101242268 2024-09-12T00:47:27.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.482+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15.0 2024-09-12T00:47:27.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.484+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:47:27.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.484+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:47:27.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.484+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - tag is: _Dm3Y2RNqPbFbDKfJU458C5UE2gkoxgL 2024-09-12T00:47:27.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.484+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:47:27.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.484+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15__shadow_.5nAPTX9vR1cYx6UIohL5kzWbty6YlfO_0 2024-09-12T00:47:27.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.484+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T00:47:27.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.484+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:47:27.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.484+0000 7fbb4a326800 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: _Dm3Y2RNqPbFbDKfJU458C5UE2gkoxgL 2024-09-12T00:47:27.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.485+0000 7fba297fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-12T00:47:27.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.486+0000 7fbb4a326800 20 get_obj_state: octx=0x559101223da0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x559101242268 s->prefetch_data=0 2024-09-12T00:47:27.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.486+0000 7fbb4a326800 10 manifest: total_size = 27197 2024-09-12T00:47:27.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.486+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10571912184384997977 2024-09-12T00:47:27.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.486+0000 7fbb4a326800 20 get_obj_state: octx=0x559101223da0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x559101242268 s->prefetch_data=0 2024-09-12T00:47:27.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.486+0000 7fbb4a326800 20 prepare_atomic_modification: state is not atomic. state=0x559101242268 2024-09-12T00:47:27.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.486+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15.0 2024-09-12T00:47:27.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.488+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:47:27.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.488+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=27197 stripe_ofs=27197 part_ofs=0 rule->part_size=0 2024-09-12T00:47:27.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.488+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10571912184384997977 2024-09-12T00:47:27.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.488+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:47:27.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.488+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15__shadow_.YSW08tBacgAGg43NOtRlJgDa2n4exnj_0 2024-09-12T00:47:27.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.488+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 331 2024-09-12T00:47:27.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.488+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:47:27.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.488+0000 7fbb4a326800 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10571912184384997977 2024-09-12T00:47:27.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.489+0000 7fba28ff9640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T00:47:27.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.489+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb300045a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x559101242268 s->prefetch_data=0 2024-09-12T00:47:27.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.489+0000 7fbb4a326800 10 manifest: total_size = 27197 2024-09-12T00:47:27.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.489+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to _yqWDITg8t1oIM_F7o3Vg3rkgilOculh 2024-09-12T00:47:27.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.489+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb300045a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x559101242268 s->prefetch_data=0 2024-09-12T00:47:27.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.489+0000 7fbb4a326800 20 prepare_atomic_modification: state is not atomic. state=0x559101242268 2024-09-12T00:47:27.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.489+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15.0 2024-09-12T00:47:27.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.492+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:47:27.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.492+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=27197 stripe_ofs=27197 part_ofs=0 rule->part_size=0 2024-09-12T00:47:27.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.492+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - tag is: _yqWDITg8t1oIM_F7o3Vg3rkgilOculh 2024-09-12T00:47:27.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.492+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:47:27.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.492+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15__shadow_.4MX-UT4f4qDc1yvNvQK84T_ZEVCFs2N_0 2024-09-12T00:47:27.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.492+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T00:47:27.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.492+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:47:27.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.492+0000 7fbb4a326800 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: _yqWDITg8t1oIM_F7o3Vg3rkgilOculh 2024-09-12T00:47:27.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.493+0000 7fba297fa640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-12T00:47:27.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.494+0000 7fbb4a326800 20 get_obj_state: octx=0x559101222ed0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x559101242268 s->prefetch_data=0 2024-09-12T00:47:27.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.494+0000 7fbb4a326800 10 manifest: total_size = 27197 2024-09-12T00:47:27.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.494+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to _bd35pSRvsyn1AOr76EE2QEYW9rxDBgA 2024-09-12T00:47:27.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.494+0000 7fbb4a326800 20 get_obj_state: octx=0x559101222ed0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x559101242268 s->prefetch_data=0 2024-09-12T00:47:27.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.494+0000 7fbb4a326800 20 prepare_atomic_modification: state is not atomic. state=0x559101242268 2024-09-12T00:47:27.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.494+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15.0 2024-09-12T00:47:27.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.497+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:47:27.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.497+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=27197 stripe_ofs=27197 part_ofs=0 rule->part_size=0 2024-09-12T00:47:27.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.497+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - tag is: _bd35pSRvsyn1AOr76EE2QEYW9rxDBgA 2024-09-12T00:47:27.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.497+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:47:27.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.497+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15__shadow_.mLKkdxfB7vMcYf1x081Rov2_SZtcu1z_0 2024-09-12T00:47:27.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.497+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T00:47:27.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.497+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:47:27.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.497+0000 7fbb4a326800 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: _bd35pSRvsyn1AOr76EE2QEYW9rxDBgA 2024-09-12T00:47:27.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.498+0000 7fba28ff9640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-12T00:47:27.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.498+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb40004f10 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x559101242268 s->prefetch_data=0 2024-09-12T00:47:27.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.498+0000 7fbb4a326800 10 manifest: total_size = 27197 2024-09-12T00:47:27.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.498+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2348924899500435515 2024-09-12T00:47:27.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.498+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb40004f10 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x559101242268 s->prefetch_data=0 2024-09-12T00:47:27.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.498+0000 7fbb4a326800 20 prepare_atomic_modification: state is not atomic. state=0x559101242268 2024-09-12T00:47:27.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.498+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15.0 2024-09-12T00:47:27.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.500+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:47:27.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.500+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=27197 stripe_ofs=27197 part_ofs=0 rule->part_size=0 2024-09-12T00:47:27.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.500+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2348924899500435515 2024-09-12T00:47:27.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.500+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:47:27.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.500+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15__shadow_.YSW08tBacgAGg43NOtRlJgDa2n4exnj_0 2024-09-12T00:47:27.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.500+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-12T00:47:27.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.500+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:47:27.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.500+0000 7fbb4a326800 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2348924899500435515 2024-09-12T00:47:27.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.502+0000 7fba297fa640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-12T00:47:27.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.502+0000 7fbb4a326800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:47:27.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.502+0000 7fbb4a326800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:47:27.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.502+0000 7fbb4a326800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:47:27.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.502+0000 7fbb4a326800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:47:27.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.502+0000 7fbb4a326800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:47:27.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.502+0000 7fbb4a326800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:47:27.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.502+0000 7fbb4a326800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15])"; uploads.size()=0; is_truncated=0 2024-09-12T00:47:27.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.503+0000 7fbb4a326800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2024-09-12T00:47:27.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.503+0000 7fbb4a326800 20 rados->read ofs=0 len=0 2024-09-12T00:47:27.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.504+0000 7fbb4a326800 20 rados_obj.operate() r=0 bl.length=233 2024-09-12T00:47:27.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.504+0000 7fbb4a326800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2024-09-12T00:47:27.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.504+0000 7fbb4a326800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2024-09-12T00:47:27.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.505+0000 7fbb4a326800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2024-09-12T00:47:27.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.505+0000 7fbb4a326800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2024-09-12T00:47:27.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.505+0000 7fba28ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497029 cookie 94081277359040 notifier 6006 bl.length()=189 2024-09-12T00:47:27.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.508+0000 7fbb4a326800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15 from cache 2024-09-12T00:47:27.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.508+0000 7fbb4a326800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15, ofs0, ns] 2024-09-12T00:47:27.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.509+0000 7fba28ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496993 cookie 94081277352880 notifier 6006 bl.length()=247 2024-09-12T00:47:27.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.511+0000 7fbb4a326800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15 : miss 2024-09-12T00:47:27.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.511+0000 7fbb4a326800 20 rados->read ofs=0 len=0 2024-09-12T00:47:27.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.511+0000 7fbb4a326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:27.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.511+0000 7fbb4a326800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15 info.flags=0x0 2024-09-12T00:47:27.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.511+0000 7fbb4a326800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15 to cache LRU end 2024-09-12T00:47:27.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.513+0000 7fbb4a326800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16 : miss 2024-09-12T00:47:27.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.513+0000 7fbb4a326800 20 rados->read ofs=0 len=0 2024-09-12T00:47:27.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.514+0000 7fbb4a326800 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T00:47:27.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.514+0000 7fbb4a326800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16 info.flags=0x17 2024-09-12T00:47:27.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.514+0000 7fbb4a326800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16 to cache LRU end 2024-09-12T00:47:27.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.514+0000 7fbb4a326800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:47:27.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.514+0000 7fbb4a326800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:47:27.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.514+0000 7fbb4a326800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16 2024-09-12T00:47:27.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.514+0000 7fbb4a326800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T00:47:27.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.514+0000 7fbb4a326800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-12T00:47:27.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.514+0000 7fbb4a326800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-12T00:47:27.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.514+0000 7fbb4a326800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-12T00:47:27.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.514+0000 7fbb4a326800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T00:47:27.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.514+0000 7fbb4a326800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-12T00:47:27.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.514+0000 7fbb4a326800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-12T00:47:27.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.514+0000 7fbb4a326800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-12T00:47:27.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.514+0000 7fbb4a326800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T00:47:27.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.514+0000 7fbb4a326800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-12T00:47:27.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.514+0000 7fbb4a326800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-12T00:47:27.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.514+0000 7fbb4a326800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-12T00:47:27.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.515+0000 7fbb4a326800 20 get_obj_state: octx=0x559101240080 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55910122be88 s->prefetch_data=0 2024-09-12T00:47:27.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.515+0000 7fbb4a326800 10 manifest: total_size = 11534336 2024-09-12T00:47:27.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.515+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7999983469757324940 2024-09-12T00:47:27.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.515+0000 7fbb4a326800 20 get_obj_state: octx=0x559101240080 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55910122be88 s->prefetch_data=0 2024-09-12T00:47:27.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.515+0000 7fbb4a326800 20 prepare_atomic_modification: state is not atomic. state=0x55910122be88 2024-09-12T00:47:27.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.515+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16.0 2024-09-12T00:47:27.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.517+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:47:27.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.517+0000 7fbb4a326800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T00:47:27.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.517+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:47:27.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.517+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:47:27.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.517+0000 7fbb4a326800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:47:27.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.517+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:47:27.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.517+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:47:27.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.517+0000 7fbb4a326800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:47:27.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.517+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:47:27.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.517+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7999983469757324940 2024-09-12T00:47:27.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.517+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:47:27.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.517+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__multipart_foo-FROZEN.2~3vQreT-2Bj6sjzbLXNPzYMaxU5oWF1U.1 2024-09-12T00:47:27.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.517+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-12T00:47:27.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.517+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__multipart_foo-FROZEN.2~3vQreT-2Bj6sjzbLXNPzYMaxU5oWF1U.2 2024-09-12T00:47:27.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.517+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 634 2024-09-12T00:47:27.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.517+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__multipart_foo-FROZEN.2~3vQreT-2Bj6sjzbLXNPzYMaxU5oWF1U.3 2024-09-12T00:47:27.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.517+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 901 2024-09-12T00:47:27.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.517+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:47:27.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.517+0000 7fbb4a326800 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7999983469757324940 2024-09-12T00:47:27.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.519+0000 7fba297fa640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T00:47:27.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.519+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb38089180 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55910122be88 s->prefetch_data=0 2024-09-12T00:47:27.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.519+0000 7fbb4a326800 10 manifest: total_size = 11534336 2024-09-12T00:47:27.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.519+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18186205859112665028 2024-09-12T00:47:27.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.519+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb38089180 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55910122be88 s->prefetch_data=0 2024-09-12T00:47:27.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.519+0000 7fbb4a326800 20 prepare_atomic_modification: state is not atomic. state=0x55910122be88 2024-09-12T00:47:27.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.519+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16.0 2024-09-12T00:47:27.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.522+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:47:27.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.522+0000 7fbb4a326800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T00:47:27.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.522+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:47:27.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.522+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:47:27.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.522+0000 7fbb4a326800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:47:27.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.522+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:47:27.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.522+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:47:27.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.522+0000 7fbb4a326800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:47:27.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.522+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:47:27.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.522+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18186205859112665028 2024-09-12T00:47:27.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.522+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:47:27.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.522+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__multipart_foo-FROZEN.2~3vQreT-2Bj6sjzbLXNPzYMaxU5oWF1U.1 2024-09-12T00:47:27.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.522+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-12T00:47:27.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.522+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__multipart_foo-FROZEN.2~3vQreT-2Bj6sjzbLXNPzYMaxU5oWF1U.2 2024-09-12T00:47:27.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.522+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 635 2024-09-12T00:47:27.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.522+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__multipart_foo-FROZEN.2~3vQreT-2Bj6sjzbLXNPzYMaxU5oWF1U.3 2024-09-12T00:47:27.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.522+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 902 2024-09-12T00:47:27.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.522+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:47:27.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.522+0000 7fbb4a326800 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18186205859112665028 2024-09-12T00:47:27.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.523+0000 7fba28ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-12T00:47:27.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.525+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb40004f10 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55910122be88 s->prefetch_data=0 2024-09-12T00:47:27.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.525+0000 7fbb4a326800 10 manifest: total_size = 11534336 2024-09-12T00:47:27.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.525+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to _XkAVz5trFvzaR83zVXZnrQe053B_a5q 2024-09-12T00:47:27.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.525+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb40004f10 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55910122be88 s->prefetch_data=0 2024-09-12T00:47:27.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.525+0000 7fbb4a326800 20 prepare_atomic_modification: state is not atomic. state=0x55910122be88 2024-09-12T00:47:27.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.525+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16.0 2024-09-12T00:47:27.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.527+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:47:27.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.527+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T00:47:27.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.527+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:47:27.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.527+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T00:47:27.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.527+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - tag is: _XkAVz5trFvzaR83zVXZnrQe053B_a5q 2024-09-12T00:47:27.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.527+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:47:27.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.527+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__shadow_.ICXNd9yTTngyK0y_W14IHGNCCyJ1TBo_0 2024-09-12T00:47:27.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.527+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T00:47:27.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.527+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__shadow_.ICXNd9yTTngyK0y_W14IHGNCCyJ1TBo_1 2024-09-12T00:47:27.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.527+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-12T00:47:27.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.527+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:47:27.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.527+0000 7fbb4a326800 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: _XkAVz5trFvzaR83zVXZnrQe053B_a5q 2024-09-12T00:47:27.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.528+0000 7fba297fa640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-12T00:47:27.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.529+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb4000a4b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55910122bd28 s->prefetch_data=0 2024-09-12T00:47:27.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.529+0000 7fbb4a326800 10 manifest: total_size = 11534336 2024-09-12T00:47:27.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.529+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to _3a2TbOY7-6t-SU7ASR8NszI8-IpWjb2 2024-09-12T00:47:27.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.529+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb4000a4b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55910122bd28 s->prefetch_data=0 2024-09-12T00:47:27.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.529+0000 7fbb4a326800 20 prepare_atomic_modification: state is not atomic. state=0x55910122bd28 2024-09-12T00:47:27.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.529+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16.0 2024-09-12T00:47:27.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.532+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:47:27.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.532+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T00:47:27.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.532+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:47:27.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.532+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T00:47:27.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.532+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - tag is: _3a2TbOY7-6t-SU7ASR8NszI8-IpWjb2 2024-09-12T00:47:27.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.532+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:47:27.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.532+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__shadow_.gqR8mzMEa0uPAmpObwz0vr8Ln4MSQk9_0 2024-09-12T00:47:27.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.532+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T00:47:27.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.532+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__shadow_.gqR8mzMEa0uPAmpObwz0vr8Ln4MSQk9_1 2024-09-12T00:47:27.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.532+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T00:47:27.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.532+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:47:27.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.532+0000 7fbb4a326800 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: _3a2TbOY7-6t-SU7ASR8NszI8-IpWjb2 2024-09-12T00:47:27.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.533+0000 7fba28ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-12T00:47:27.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.533+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb38089180 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55910122bd28 s->prefetch_data=0 2024-09-12T00:47:27.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.533+0000 7fbb4a326800 10 manifest: total_size = 11534336 2024-09-12T00:47:27.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.533+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2292370384872199453 2024-09-12T00:47:27.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.533+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb38089180 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55910122bd28 s->prefetch_data=0 2024-09-12T00:47:27.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.533+0000 7fbb4a326800 20 prepare_atomic_modification: state is not atomic. state=0x55910122bd28 2024-09-12T00:47:27.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.533+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16.0 2024-09-12T00:47:27.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.535+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:47:27.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.535+0000 7fbb4a326800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T00:47:27.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.535+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:47:27.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.535+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:47:27.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.535+0000 7fbb4a326800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:47:27.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.535+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:47:27.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.535+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:47:27.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.535+0000 7fbb4a326800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:47:27.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.535+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:47:27.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.535+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2292370384872199453 2024-09-12T00:47:27.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.535+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:47:27.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.535+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__multipart_foo-LUKEWARM.2~KkLEbQ8XHe0ERbagNN62TPOj_lpltQP.1 2024-09-12T00:47:27.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.535+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-12T00:47:27.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.535+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__multipart_foo-LUKEWARM.2~KkLEbQ8XHe0ERbagNN62TPOj_lpltQP.2 2024-09-12T00:47:27.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.535+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 646 2024-09-12T00:47:27.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.535+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__multipart_foo-LUKEWARM.2~KkLEbQ8XHe0ERbagNN62TPOj_lpltQP.3 2024-09-12T00:47:27.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.535+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 919 2024-09-12T00:47:27.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.535+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:47:27.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.535+0000 7fbb4a326800 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2292370384872199453 2024-09-12T00:47:27.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.536+0000 7fba297fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T00:47:27.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.537+0000 7fbb4a326800 20 get_obj_state: octx=0x55910129ca40 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x559101236b98 s->prefetch_data=0 2024-09-12T00:47:27.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.537+0000 7fbb4a326800 10 manifest: total_size = 11534336 2024-09-12T00:47:27.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.537+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to _PR5LHb6bNBSe2nVzf1fmgzxIDeWLZNY 2024-09-12T00:47:27.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.537+0000 7fbb4a326800 20 get_obj_state: octx=0x55910129ca40 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x559101236b98 s->prefetch_data=0 2024-09-12T00:47:27.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.537+0000 7fbb4a326800 20 prepare_atomic_modification: state is not atomic. state=0x559101236b98 2024-09-12T00:47:27.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.537+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16.0 2024-09-12T00:47:27.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.540+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:47:27.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.540+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T00:47:27.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.540+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:47:27.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.540+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T00:47:27.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.540+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - tag is: _PR5LHb6bNBSe2nVzf1fmgzxIDeWLZNY 2024-09-12T00:47:27.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.540+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:47:27.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.540+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__shadow_.tJV3uEArRFPUzbZ4kJbuwa_k_0AEiDH_0 2024-09-12T00:47:27.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.540+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T00:47:27.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.540+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__shadow_.tJV3uEArRFPUzbZ4kJbuwa_k_0AEiDH_1 2024-09-12T00:47:27.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.540+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-12T00:47:27.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.540+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:47:27.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.540+0000 7fbb4a326800 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: _PR5LHb6bNBSe2nVzf1fmgzxIDeWLZNY 2024-09-12T00:47:27.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.541+0000 7fba28ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-12T00:47:27.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.541+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb38089180 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x559101236b98 s->prefetch_data=0 2024-09-12T00:47:27.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.541+0000 7fbb4a326800 10 manifest: total_size = 11534336 2024-09-12T00:47:27.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.541+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16703532687249948369 2024-09-12T00:47:27.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.541+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb38089180 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x559101236b98 s->prefetch_data=0 2024-09-12T00:47:27.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.541+0000 7fbb4a326800 20 prepare_atomic_modification: state is not atomic. state=0x559101236b98 2024-09-12T00:47:27.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.541+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16.0 2024-09-12T00:47:27.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.544+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:47:27.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.544+0000 7fbb4a326800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T00:47:27.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.544+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:47:27.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.544+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:47:27.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.544+0000 7fbb4a326800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:47:27.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.544+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:47:27.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.544+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:47:27.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.544+0000 7fbb4a326800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:47:27.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.544+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:47:27.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.544+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16703532687249948369 2024-09-12T00:47:27.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.544+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:47:27.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.544+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__multipart_foo-LUKEWARM.2~KkLEbQ8XHe0ERbagNN62TPOj_lpltQP.1 2024-09-12T00:47:27.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.544+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-12T00:47:27.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.544+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__multipart_foo-LUKEWARM.2~KkLEbQ8XHe0ERbagNN62TPOj_lpltQP.2 2024-09-12T00:47:27.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.544+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 647 2024-09-12T00:47:27.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.544+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__multipart_foo-LUKEWARM.2~KkLEbQ8XHe0ERbagNN62TPOj_lpltQP.3 2024-09-12T00:47:27.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.544+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 920 2024-09-12T00:47:27.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.544+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:47:27.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.544+0000 7fbb4a326800 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16703532687249948369 2024-09-12T00:47:27.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.545+0000 7fba297fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-12T00:47:27.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.545+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb38004cb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x559101236b98 s->prefetch_data=0 2024-09-12T00:47:27.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.545+0000 7fbb4a326800 10 manifest: total_size = 11534336 2024-09-12T00:47:27.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.545+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to _WSFQyqpuQEyfJ86zv7RU_SDe_9cLR6n 2024-09-12T00:47:27.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.545+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb38004cb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x559101236b98 s->prefetch_data=0 2024-09-12T00:47:27.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.545+0000 7fbb4a326800 20 prepare_atomic_modification: state is not atomic. state=0x559101236b98 2024-09-12T00:47:27.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.545+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16.0 2024-09-12T00:47:27.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.548+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:47:27.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.548+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T00:47:27.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.548+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:47:27.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.548+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T00:47:27.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.548+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - tag is: _WSFQyqpuQEyfJ86zv7RU_SDe_9cLR6n 2024-09-12T00:47:27.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.548+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:47:27.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.548+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__shadow_.iRISnhXyU2xuJrx7q797HxL2EIaxydp_0 2024-09-12T00:47:27.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.548+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T00:47:27.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.548+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__shadow_.iRISnhXyU2xuJrx7q797HxL2EIaxydp_1 2024-09-12T00:47:27.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.548+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T00:47:27.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.548+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:47:27.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.548+0000 7fbb4a326800 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: _WSFQyqpuQEyfJ86zv7RU_SDe_9cLR6n 2024-09-12T00:47:27.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.549+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb38089180 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x559101236b98 s->prefetch_data=0 2024-09-12T00:47:27.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.550+0000 7fbb4a326800 10 manifest: total_size = 16378 2024-09-12T00:47:27.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.550+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10636927906633586803 2024-09-12T00:47:27.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.550+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb38089180 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x559101236b98 s->prefetch_data=0 2024-09-12T00:47:27.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.550+0000 7fbb4a326800 20 prepare_atomic_modification: state is not atomic. state=0x559101236b98 2024-09-12T00:47:27.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.550+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16.0 2024-09-12T00:47:27.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.550+0000 7fba28ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-12T00:47:27.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.552+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=7673 rules.size()=3 2024-09-12T00:47:27.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.552+0000 7fbb4a326800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=7673 2024-09-12T00:47:27.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.552+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=7673 stripe_ofs=7673 part_ofs=7673 rule->part_size=7670 2024-09-12T00:47:27.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.552+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=3 2024-09-12T00:47:27.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.552+0000 7fbb4a326800 20 RGWObjManifest::operator++(): stripe_ofs=6299129 part_ofs=7673 rule->part_size=7670 2024-09-12T00:47:27.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.552+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=15343 stripe_ofs=15343 part_ofs=15343 rule->part_size=1035 2024-09-12T00:47:27.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.552+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=1035 rules.size()=3 2024-09-12T00:47:27.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.552+0000 7fbb4a326800 20 RGWObjManifest::operator++(): stripe_ofs=6306799 part_ofs=15343 rule->part_size=1035 2024-09-12T00:47:27.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.552+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=16378 stripe_ofs=16378 part_ofs=16378 rule->part_size=1035 2024-09-12T00:47:27.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.552+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10636927906633586803 2024-09-12T00:47:27.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.552+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:47:27.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.552+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__multipart_foo-STANDARD.2~9RG2VEYRfif8VmTRB2IwKJXR8DE14Tv.1 2024-09-12T00:47:27.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.552+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-12T00:47:27.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.552+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__multipart_foo-STANDARD.2~9RG2VEYRfif8VmTRB2IwKJXR8DE14Tv.2 2024-09-12T00:47:27.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.552+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-09-12T00:47:27.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.552+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__multipart_foo-STANDARD.2~9RG2VEYRfif8VmTRB2IwKJXR8DE14Tv.3 2024-09-12T00:47:27.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.552+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-09-12T00:47:27.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.552+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:47:27.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.552+0000 7fbb4a326800 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10636927906633586803 2024-09-12T00:47:27.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.553+0000 7fba297fa640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T00:47:27.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.553+0000 7fbb4a326800 20 get_obj_state: octx=0x559101242690 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55910122a638 s->prefetch_data=0 2024-09-12T00:47:27.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.553+0000 7fbb4a326800 10 manifest: total_size = 16378 2024-09-12T00:47:27.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.553+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to _uB8n2X5sKqEu0gTSoNIplnYYAu3i3qH 2024-09-12T00:47:27.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.553+0000 7fbb4a326800 20 get_obj_state: octx=0x559101242690 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55910122a638 s->prefetch_data=0 2024-09-12T00:47:27.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.553+0000 7fbb4a326800 20 prepare_atomic_modification: state is not atomic. state=0x55910122a638 2024-09-12T00:47:27.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.553+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16.0 2024-09-12T00:47:27.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.555+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:47:27.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.555+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=16378 stripe_ofs=16378 part_ofs=0 rule->part_size=0 2024-09-12T00:47:27.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.555+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - tag is: _uB8n2X5sKqEu0gTSoNIplnYYAu3i3qH 2024-09-12T00:47:27.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.555+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:47:27.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.555+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__shadow_.XiKs-ej7nytBhpkPK-m4no_QlrgXzl2_0 2024-09-12T00:47:27.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.555+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T00:47:27.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.555+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:47:27.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.555+0000 7fbb4a326800 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: _uB8n2X5sKqEu0gTSoNIplnYYAu3i3qH 2024-09-12T00:47:27.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.556+0000 7fba28ff9640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-12T00:47:27.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.557+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb38004cb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55910122a5d8 s->prefetch_data=0 2024-09-12T00:47:27.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.557+0000 7fbb4a326800 10 manifest: total_size = 16378 2024-09-12T00:47:27.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.557+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to _vyckHBFOi1nYdBPCsTU4kKr4Cvwzr7K 2024-09-12T00:47:27.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.557+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb38004cb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55910122a5d8 s->prefetch_data=0 2024-09-12T00:47:27.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.557+0000 7fbb4a326800 20 prepare_atomic_modification: state is not atomic. state=0x55910122a5d8 2024-09-12T00:47:27.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.557+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16.0 2024-09-12T00:47:27.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.559+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:47:27.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.559+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=16378 stripe_ofs=16378 part_ofs=0 rule->part_size=0 2024-09-12T00:47:27.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.559+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - tag is: _vyckHBFOi1nYdBPCsTU4kKr4Cvwzr7K 2024-09-12T00:47:27.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.559+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:47:27.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.559+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__shadow_.yFbI6YrD9OC9X9BIO2tOddQfG5SLnx8_0 2024-09-12T00:47:27.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.559+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T00:47:27.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.559+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:47:27.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.559+0000 7fbb4a326800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: _vyckHBFOi1nYdBPCsTU4kKr4Cvwzr7K 2024-09-12T00:47:27.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.560+0000 7fba297fa640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-12T00:47:27.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.560+0000 7fbb4a326800 20 get_obj_state: octx=0x5591011e89a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55910122a5d8 s->prefetch_data=0 2024-09-12T00:47:27.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.561+0000 7fbb4a326800 10 manifest: total_size = 16378 2024-09-12T00:47:27.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.561+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14705110757789608233 2024-09-12T00:47:27.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.561+0000 7fbb4a326800 20 get_obj_state: octx=0x5591011e89a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55910122a5d8 s->prefetch_data=0 2024-09-12T00:47:27.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.561+0000 7fbb4a326800 20 prepare_atomic_modification: state is not atomic. state=0x55910122a5d8 2024-09-12T00:47:27.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.561+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16.0 2024-09-12T00:47:27.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.563+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=7673 rules.size()=3 2024-09-12T00:47:27.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.563+0000 7fbb4a326800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=7673 2024-09-12T00:47:27.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.563+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=7673 stripe_ofs=7673 part_ofs=7673 rule->part_size=7670 2024-09-12T00:47:27.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.563+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=3 2024-09-12T00:47:27.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.563+0000 7fbb4a326800 20 RGWObjManifest::operator++(): stripe_ofs=6299129 part_ofs=7673 rule->part_size=7670 2024-09-12T00:47:27.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.563+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=15343 stripe_ofs=15343 part_ofs=15343 rule->part_size=1035 2024-09-12T00:47:27.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.563+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=1035 rules.size()=3 2024-09-12T00:47:27.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.563+0000 7fbb4a326800 20 RGWObjManifest::operator++(): stripe_ofs=6306799 part_ofs=15343 rule->part_size=1035 2024-09-12T00:47:27.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.563+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=16378 stripe_ofs=16378 part_ofs=16378 rule->part_size=1035 2024-09-12T00:47:27.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.563+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14705110757789608233 2024-09-12T00:47:27.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.563+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:47:27.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.563+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__multipart_foo-STANDARD.2~9RG2VEYRfif8VmTRB2IwKJXR8DE14Tv.1 2024-09-12T00:47:27.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.563+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-12T00:47:27.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.563+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__multipart_foo-STANDARD.2~9RG2VEYRfif8VmTRB2IwKJXR8DE14Tv.2 2024-09-12T00:47:27.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.563+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-09-12T00:47:27.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.563+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__multipart_foo-STANDARD.2~9RG2VEYRfif8VmTRB2IwKJXR8DE14Tv.3 2024-09-12T00:47:27.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.563+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-09-12T00:47:27.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.563+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:47:27.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.563+0000 7fbb4a326800 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14705110757789608233 2024-09-12T00:47:27.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.564+0000 7fba28ff9640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-12T00:47:27.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.564+0000 7fbb4a326800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:47:27.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.564+0000 7fbb4a326800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:47:27.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.564+0000 7fbb4a326800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:47:27.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.564+0000 7fbb4a326800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:47:27.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.564+0000 7fbb4a326800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:47:27.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.564+0000 7fbb4a326800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:47:27.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.564+0000 7fbb4a326800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16])"; uploads.size()=0; is_truncated=0 2024-09-12T00:47:27.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.566+0000 7fbb4a326800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2024-09-12T00:47:27.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.566+0000 7fbb4a326800 20 rados->read ofs=0 len=0 2024-09-12T00:47:27.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.566+0000 7fbb4a326800 20 rados_obj.operate() r=0 bl.length=243 2024-09-12T00:47:27.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.566+0000 7fbb4a326800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2024-09-12T00:47:27.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.566+0000 7fbb4a326800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2024-09-12T00:47:27.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.567+0000 7fbb4a326800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2024-09-12T00:47:27.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.567+0000 7fbb4a326800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2024-09-12T00:47:27.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.568+0000 7fba297fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496977 cookie 94081277363104 notifier 6006 bl.length()=199 2024-09-12T00:47:27.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.570+0000 7fbb4a326800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16 from cache 2024-09-12T00:47:27.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.570+0000 7fbb4a326800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16, ofs0, ns] 2024-09-12T00:47:27.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.571+0000 7fba28ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496978 cookie 94081277363104 notifier 6006 bl.length()=257 2024-09-12T00:47:27.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.573+0000 7fbb4a326800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16 : miss 2024-09-12T00:47:27.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.573+0000 7fbb4a326800 20 rados->read ofs=0 len=0 2024-09-12T00:47:27.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.573+0000 7fbb4a326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:27.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.573+0000 7fbb4a326800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16 info.flags=0x0 2024-09-12T00:47:27.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.573+0000 7fbb4a326800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16 to cache LRU end 2024-09-12T00:47:27.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.575+0000 7fbb4a326800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14 : miss 2024-09-12T00:47:27.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.575+0000 7fbb4a326800 20 rados->read ofs=0 len=0 2024-09-12T00:47:27.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.576+0000 7fbb4a326800 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T00:47:27.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.576+0000 7fbb4a326800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14 info.flags=0x17 2024-09-12T00:47:27.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.576+0000 7fbb4a326800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14 to cache LRU end 2024-09-12T00:47:27.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.576+0000 7fbb4a326800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:47:27.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.576+0000 7fbb4a326800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:47:27.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.576+0000 7fbb4a326800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14 2024-09-12T00:47:27.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.576+0000 7fbb4a326800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T00:47:27.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.576+0000 7fbb4a326800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T00:47:27.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.576+0000 7fbb4a326800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T00:47:27.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.576+0000 7fbb4a326800 20 get_obj_state: octx=0x55910129ca40 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x5591011ccca8 s->prefetch_data=0 2024-09-12T00:47:27.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.577+0000 7fbb4a326800 10 manifest: total_size = 11534336 2024-09-12T00:47:27.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.577+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9439554793537873693 2024-09-12T00:47:27.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.577+0000 7fbb4a326800 20 get_obj_state: octx=0x55910129ca40 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x5591011ccca8 s->prefetch_data=0 2024-09-12T00:47:27.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.577+0000 7fbb4a326800 20 prepare_atomic_modification: state is not atomic. state=0x5591011ccca8 2024-09-12T00:47:27.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.577+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14.0 2024-09-12T00:47:27.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.579+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:47:27.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.579+0000 7fbb4a326800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T00:47:27.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.579+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:47:27.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.579+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:47:27.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.579+0000 7fbb4a326800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:47:27.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.579+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:47:27.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.579+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:47:27.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.579+0000 7fbb4a326800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:47:27.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.579+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:47:27.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.579+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9439554793537873693 2024-09-12T00:47:27.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.579+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:47:27.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.579+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14__multipart_foo-FROZEN.2~J_TyXqqtf60P_uYiwCoqdMvy4cayM-Z.1 2024-09-12T00:47:27.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.579+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-12T00:47:27.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.579+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14__multipart_foo-FROZEN.2~J_TyXqqtf60P_uYiwCoqdMvy4cayM-Z.2 2024-09-12T00:47:27.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.579+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 634 2024-09-12T00:47:27.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.579+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14__multipart_foo-FROZEN.2~J_TyXqqtf60P_uYiwCoqdMvy4cayM-Z.3 2024-09-12T00:47:27.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.579+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 901 2024-09-12T00:47:27.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.579+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:47:27.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.579+0000 7fbb4a326800 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9439554793537873693 2024-09-12T00:47:27.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.580+0000 7fba28ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T00:47:27.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.580+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb38004cb0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x5591011ccca8 s->prefetch_data=0 2024-09-12T00:47:27.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.581+0000 7fbb4a326800 10 manifest: total_size = 11534336 2024-09-12T00:47:27.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.581+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.537277653652835992 2024-09-12T00:47:27.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.581+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb38004cb0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x5591011ccca8 s->prefetch_data=0 2024-09-12T00:47:27.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.581+0000 7fbb4a326800 20 prepare_atomic_modification: state is not atomic. state=0x5591011ccca8 2024-09-12T00:47:27.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.581+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14.0 2024-09-12T00:47:27.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.583+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:47:27.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.583+0000 7fbb4a326800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T00:47:27.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.583+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:47:27.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.583+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:47:27.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.583+0000 7fbb4a326800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:47:27.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.583+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:47:27.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.583+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:47:27.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.583+0000 7fbb4a326800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:47:27.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.583+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:47:27.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.583+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.537277653652835992 2024-09-12T00:47:27.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.583+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:47:27.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.583+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14__multipart_foo-LUKEWARM.2~VKazdSWUv_DN6_DA4N-MBk9RpkH5kCl.1 2024-09-12T00:47:27.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.583+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 372 2024-09-12T00:47:27.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.583+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14__multipart_foo-LUKEWARM.2~VKazdSWUv_DN6_DA4N-MBk9RpkH5kCl.2 2024-09-12T00:47:27.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.583+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 645 2024-09-12T00:47:27.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.583+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14__multipart_foo-LUKEWARM.2~VKazdSWUv_DN6_DA4N-MBk9RpkH5kCl.3 2024-09-12T00:47:27.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.583+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 918 2024-09-12T00:47:27.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.583+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:47:27.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.583+0000 7fbb4a326800 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.537277653652835992 2024-09-12T00:47:27.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.584+0000 7fbb4a326800 20 get_obj_state: octx=0x559101222dc0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x5591011ccca8 s->prefetch_data=0 2024-09-12T00:47:27.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.584+0000 7fba297fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T00:47:27.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.584+0000 7fbb4a326800 10 manifest: total_size = 1087 2024-09-12T00:47:27.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.584+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13104223196468160585 2024-09-12T00:47:27.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.584+0000 7fbb4a326800 20 get_obj_state: octx=0x559101222dc0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x5591011ccca8 s->prefetch_data=0 2024-09-12T00:47:27.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.584+0000 7fbb4a326800 20 prepare_atomic_modification: state is not atomic. state=0x5591011ccca8 2024-09-12T00:47:27.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.584+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14.0 2024-09-12T00:47:27.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.586+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T00:47:27.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.586+0000 7fbb4a326800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=516 2024-09-12T00:47:27.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.586+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-12T00:47:27.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.586+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T00:47:27.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.586+0000 7fbb4a326800 20 RGWObjManifest::operator++(): stripe_ofs=6291972 part_ofs=516 rule->part_size=516 2024-09-12T00:47:27.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.586+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=55 2024-09-12T00:47:27.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.586+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=55 rules.size()=2 2024-09-12T00:47:27.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.586+0000 7fbb4a326800 20 RGWObjManifest::operator++(): stripe_ofs=6292488 part_ofs=1032 rule->part_size=55 2024-09-12T00:47:27.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.586+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=1087 rule->part_size=55 2024-09-12T00:47:27.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.586+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13104223196468160585 2024-09-12T00:47:27.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.586+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:47:27.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.586+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14__multipart_foo-STANDARD.2~am8BmrJtyXPwA0py_SVpMRvLgr0ID02.1 2024-09-12T00:47:27.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.586+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-12T00:47:27.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.586+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14__multipart_foo-STANDARD.2~am8BmrJtyXPwA0py_SVpMRvLgr0ID02.2 2024-09-12T00:47:27.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.586+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-09-12T00:47:27.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.586+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14__multipart_foo-STANDARD.2~am8BmrJtyXPwA0py_SVpMRvLgr0ID02.3 2024-09-12T00:47:27.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.586+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-09-12T00:47:27.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.586+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:47:27.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.586+0000 7fbb4a326800 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13104223196468160585 2024-09-12T00:47:27.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.587+0000 7fba28ff9640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T00:47:27.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.588+0000 7fbb4a326800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:47:27.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.588+0000 7fbb4a326800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:47:27.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.588+0000 7fbb4a326800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:47:27.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.588+0000 7fbb4a326800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:47:27.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.588+0000 7fbb4a326800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:47:27.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.588+0000 7fbb4a326800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:47:27.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.588+0000 7fbb4a326800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14])"; uploads.size()=0; is_truncated=0 2024-09-12T00:47:27.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.589+0000 7fbb4a326800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2024-09-12T00:47:27.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.589+0000 7fbb4a326800 20 rados->read ofs=0 len=0 2024-09-12T00:47:27.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.590+0000 7fbb4a326800 20 rados_obj.operate() r=0 bl.length=238 2024-09-12T00:47:27.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.590+0000 7fbb4a326800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2024-09-12T00:47:27.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.590+0000 7fbb4a326800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2024-09-12T00:47:27.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.590+0000 7fbb4a326800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2024-09-12T00:47:27.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.590+0000 7fbb4a326800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2024-09-12T00:47:27.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.591+0000 7fba297fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496975 cookie 94081277368016 notifier 6006 bl.length()=194 2024-09-12T00:47:27.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.593+0000 7fbb4a326800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14 from cache 2024-09-12T00:47:27.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.593+0000 7fbb4a326800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14, ofs0, ns] 2024-09-12T00:47:27.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.594+0000 7fba297fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496979 cookie 94081277363104 notifier 6006 bl.length()=252 2024-09-12T00:47:27.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.596+0000 7fbb4a326800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14 : miss 2024-09-12T00:47:27.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.596+0000 7fbb4a326800 20 rados->read ofs=0 len=0 2024-09-12T00:47:27.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.596+0000 7fbb4a326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:27.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.596+0000 7fbb4a326800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14 info.flags=0x0 2024-09-12T00:47:27.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.596+0000 7fbb4a326800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14 to cache LRU end 2024-09-12T00:47:27.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.598+0000 7fbb4a326800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13 : miss 2024-09-12T00:47:27.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.598+0000 7fbb4a326800 20 rados->read ofs=0 len=0 2024-09-12T00:47:27.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.599+0000 7fbb4a326800 20 rados_obj.operate() r=0 bl.length=450 2024-09-12T00:47:27.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.599+0000 7fbb4a326800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13 info.flags=0x17 2024-09-12T00:47:27.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.599+0000 7fbb4a326800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13 to cache LRU end 2024-09-12T00:47:27.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.599+0000 7fbb4a326800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:47:27.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.599+0000 7fbb4a326800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:47:27.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.599+0000 7fbb4a326800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13 2024-09-12T00:47:27.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.599+0000 7fbb4a326800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T00:47:27.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.599+0000 7fbb4a326800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T00:47:27.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.599+0000 7fbb4a326800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T00:47:27.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.599+0000 7fbb4a326800 20 get_obj_state: octx=0x559101222dc0 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x559101229c78 s->prefetch_data=0 2024-09-12T00:47:27.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.599+0000 7fbb4a326800 10 manifest: total_size = 10485760 2024-09-12T00:47:27.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.599+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8752860565282527826 2024-09-12T00:47:27.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.599+0000 7fbb4a326800 20 get_obj_state: octx=0x559101222dc0 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x559101229c78 s->prefetch_data=0 2024-09-12T00:47:27.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.599+0000 7fbb4a326800 20 prepare_atomic_modification: state is not atomic. state=0x559101229c78 2024-09-12T00:47:27.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.599+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13.0 2024-09-12T00:47:27.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.602+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:47:27.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.602+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T00:47:27.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.602+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:47:27.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.602+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T00:47:27.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.602+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8752860565282527826 2024-09-12T00:47:27.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.602+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:47:27.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.602+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13__shadow_.cGIWfHtZekWnOzDLGYdIQXYQ4FnL6mZ_0 2024-09-12T00:47:27.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.602+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-12T00:47:27.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.602+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13__shadow_.cGIWfHtZekWnOzDLGYdIQXYQ4FnL6mZ_1 2024-09-12T00:47:27.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.602+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 574 2024-09-12T00:47:27.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.602+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:47:27.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.602+0000 7fbb4a326800 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8752860565282527826 2024-09-12T00:47:27.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.603+0000 7fba297fa640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T00:47:27.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.603+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb4000fb90 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x559101229c78 s->prefetch_data=0 2024-09-12T00:47:27.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.603+0000 7fbb4a326800 10 manifest: total_size = 10485760 2024-09-12T00:47:27.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.603+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6673749372926418610 2024-09-12T00:47:27.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.603+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb4000fb90 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x559101229c78 s->prefetch_data=0 2024-09-12T00:47:27.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.603+0000 7fbb4a326800 20 prepare_atomic_modification: state is not atomic. state=0x559101229c78 2024-09-12T00:47:27.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.603+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13.0 2024-09-12T00:47:27.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.605+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:47:27.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.605+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T00:47:27.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.605+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:47:27.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.605+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T00:47:27.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.605+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6673749372926418610 2024-09-12T00:47:27.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.605+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:47:27.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.605+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13__shadow_.jiTFT-iMDSoGjS7VeRuCS2qZx_Bcx3w_0 2024-09-12T00:47:27.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.605+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-12T00:47:27.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.605+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13__shadow_.jiTFT-iMDSoGjS7VeRuCS2qZx_Bcx3w_1 2024-09-12T00:47:27.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.605+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-09-12T00:47:27.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.605+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:47:27.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.605+0000 7fbb4a326800 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6673749372926418610 2024-09-12T00:47:27.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.606+0000 7fba28ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T00:47:27.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.607+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb38004cb0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x559101229c78 s->prefetch_data=0 2024-09-12T00:47:27.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.607+0000 7fbb4a326800 10 manifest: total_size = 3303 2024-09-12T00:47:27.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.607+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6849704977173778872 2024-09-12T00:47:27.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.607+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb38004cb0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x559101229c78 s->prefetch_data=0 2024-09-12T00:47:27.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.607+0000 7fbb4a326800 20 prepare_atomic_modification: state is not atomic. state=0x559101229c78 2024-09-12T00:47:27.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.607+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13.0 2024-09-12T00:47:27.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.609+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:47:27.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.609+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=3303 stripe_ofs=3303 part_ofs=0 rule->part_size=0 2024-09-12T00:47:27.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.609+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6849704977173778872 2024-09-12T00:47:27.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.609+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:47:27.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.609+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13__shadow_.KhIEgt2jP4zxmtwymXt_rbOIIFcdAuV_0 2024-09-12T00:47:27.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.609+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-12T00:47:27.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.609+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:47:27.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.609+0000 7fbb4a326800 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6849704977173778872 2024-09-12T00:47:27.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.610+0000 7fba297fa640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T00:47:27.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.610+0000 7fbb4a326800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:47:27.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.611+0000 7fbb4a326800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:47:27.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.611+0000 7fbb4a326800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:47:27.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.611+0000 7fbb4a326800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:47:27.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.611+0000 7fbb4a326800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:47:27.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.611+0000 7fbb4a326800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:47:27.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.611+0000 7fbb4a326800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13])"; uploads.size()=0; is_truncated=0 2024-09-12T00:47:27.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.612+0000 7fbb4a326800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2024-09-12T00:47:27.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.612+0000 7fbb4a326800 20 rados->read ofs=0 len=0 2024-09-12T00:47:27.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.613+0000 7fbb4a326800 20 rados_obj.operate() r=0 bl.length=228 2024-09-12T00:47:27.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.613+0000 7fbb4a326800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2024-09-12T00:47:27.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.613+0000 7fbb4a326800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2024-09-12T00:47:27.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.614+0000 7fbb4a326800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2024-09-12T00:47:27.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.614+0000 7fbb4a326800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2024-09-12T00:47:27.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.614+0000 7fba28ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497030 cookie 94081277359040 notifier 6006 bl.length()=184 2024-09-12T00:47:27.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.616+0000 7fbb4a326800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13 from cache 2024-09-12T00:47:27.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.616+0000 7fbb4a326800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13, ofs0, ns] 2024-09-12T00:47:27.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.617+0000 7fba28ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497031 cookie 94081277359040 notifier 6006 bl.length()=242 2024-09-12T00:47:27.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.619+0000 7fbb4a326800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13 : miss 2024-09-12T00:47:27.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.619+0000 7fbb4a326800 20 rados->read ofs=0 len=0 2024-09-12T00:47:27.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.619+0000 7fbb4a326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:27.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.619+0000 7fbb4a326800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13 info.flags=0x0 2024-09-12T00:47:27.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.619+0000 7fbb4a326800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13 to cache LRU end 2024-09-12T00:47:27.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.621+0000 7fbb4a326800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6 : miss 2024-09-12T00:47:27.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.621+0000 7fbb4a326800 20 rados->read ofs=0 len=0 2024-09-12T00:47:27.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.622+0000 7fbb4a326800 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T00:47:27.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.622+0000 7fbb4a326800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6 info.flags=0x17 2024-09-12T00:47:27.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.622+0000 7fbb4a326800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6 to cache LRU end 2024-09-12T00:47:27.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.622+0000 7fbb4a326800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:47:27.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.622+0000 7fbb4a326800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:47:27.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.622+0000 7fbb4a326800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6 2024-09-12T00:47:27.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.622+0000 7fbb4a326800 10 cls_bucket_list_unordered: got __ 2024-09-12T00:47:27.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.622+0000 7fbb4a326800 10 cls_bucket_list_unordered: got __ _ 2024-09-12T00:47:27.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.622+0000 7fbb4a326800 10 cls_bucket_list_unordered: got ___ 2024-09-12T00:47:27.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.622+0000 7fbb4a326800 10 cls_bucket_list_unordered: got obj 2024-09-12T00:47:27.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.622+0000 7fbb4a326800 20 get_obj_state: octx=0x5591012204c0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x559101229c78 s->prefetch_data=0 2024-09-12T00:47:27.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.622+0000 7fbb4a326800 10 manifest: total_size = 0 2024-09-12T00:47:27.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.622+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1843576312649776167 2024-09-12T00:47:27.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.622+0000 7fbb4a326800 20 get_obj_state: octx=0x5591012204c0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x559101229c78 s->prefetch_data=0 2024-09-12T00:47:27.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.622+0000 7fbb4a326800 20 prepare_atomic_modification: state is not atomic. state=0x559101229c78 2024-09-12T00:47:27.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.622+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6.0 2024-09-12T00:47:27.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.624+0000 7fbb4a326800 20 get_obj_state: octx=0x5591012204c0 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x559101229c78 s->prefetch_data=0 2024-09-12T00:47:27.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.625+0000 7fbb4a326800 10 manifest: total_size = 0 2024-09-12T00:47:27.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.625+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2261716662754131761 2024-09-12T00:47:27.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.625+0000 7fbb4a326800 20 get_obj_state: octx=0x5591012204c0 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x559101229c78 s->prefetch_data=0 2024-09-12T00:47:27.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.625+0000 7fbb4a326800 20 prepare_atomic_modification: state is not atomic. state=0x559101229c78 2024-09-12T00:47:27.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.625+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6.0 2024-09-12T00:47:27.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.625+0000 7fba28ff9640 20 handle_completion(): completion ok for obj=__ 2024-09-12T00:47:27.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.627+0000 7fbb4a326800 20 get_obj_state: octx=0x5591012204c0 obj=test-client.0-r-test-small-obj-data.1:___ state=0x559101229c78 s->prefetch_data=0 2024-09-12T00:47:27.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.627+0000 7fbb4a326800 10 manifest: total_size = 0 2024-09-12T00:47:27.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.627+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8805656178870115071 2024-09-12T00:47:27.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.627+0000 7fbb4a326800 20 get_obj_state: octx=0x5591012204c0 obj=test-client.0-r-test-small-obj-data.1:___ state=0x559101229c78 s->prefetch_data=0 2024-09-12T00:47:27.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.627+0000 7fbb4a326800 20 prepare_atomic_modification: state is not atomic. state=0x559101229c78 2024-09-12T00:47:27.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.627+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6.0 2024-09-12T00:47:27.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.628+0000 7fba297fa640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T00:47:27.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.629+0000 7fbb4a326800 20 get_obj_state: octx=0x5591012204c0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x559101229c78 s->prefetch_data=0 2024-09-12T00:47:27.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.629+0000 7fbb4a326800 10 manifest: total_size = 0 2024-09-12T00:47:27.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.629+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5228559919522929113 2024-09-12T00:47:27.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.629+0000 7fbb4a326800 20 get_obj_state: octx=0x5591012204c0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x559101229c78 s->prefetch_data=0 2024-09-12T00:47:27.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.629+0000 7fbb4a326800 20 prepare_atomic_modification: state is not atomic. state=0x559101229c78 2024-09-12T00:47:27.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.629+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6.0 2024-09-12T00:47:27.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.630+0000 7fba28ff9640 20 handle_completion(): completion ok for obj=___ 2024-09-12T00:47:27.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.631+0000 7fbb4a326800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:47:27.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.631+0000 7fbb4a326800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:47:27.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.633+0000 7fba297fa640 20 handle_completion(): completion ok for obj=obj 2024-09-12T00:47:27.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.633+0000 7fbb4a326800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:47:27.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.633+0000 7fbb4a326800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:47:27.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.633+0000 7fbb4a326800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:47:27.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.633+0000 7fbb4a326800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:47:27.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.633+0000 7fbb4a326800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6])"; uploads.size()=0; is_truncated=0 2024-09-12T00:47:27.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.634+0000 7fbb4a326800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2024-09-12T00:47:27.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.634+0000 7fbb4a326800 20 rados->read ofs=0 len=0 2024-09-12T00:47:27.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.636+0000 7fbb4a326800 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T00:47:27.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.636+0000 7fbb4a326800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2024-09-12T00:47:27.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.636+0000 7fbb4a326800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2024-09-12T00:47:27.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.637+0000 7fbb4a326800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2024-09-12T00:47:27.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.637+0000 7fbb4a326800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2024-09-12T00:47:27.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.638+0000 7fba28ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497012 cookie 94081277350400 notifier 6006 bl.length()=181 2024-09-12T00:47:27.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.640+0000 7fbb4a326800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6 from cache 2024-09-12T00:47:27.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.640+0000 7fbb4a326800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6, ofs0, ns] 2024-09-12T00:47:27.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.641+0000 7fba28ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496994 cookie 94081277365744 notifier 6006 bl.length()=238 2024-09-12T00:47:27.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.643+0000 7fbb4a326800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6 : miss 2024-09-12T00:47:27.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.643+0000 7fbb4a326800 20 rados->read ofs=0 len=0 2024-09-12T00:47:27.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.644+0000 7fbb4a326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:27.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.644+0000 7fbb4a326800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6 info.flags=0x0 2024-09-12T00:47:27.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.644+0000 7fbb4a326800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6 to cache LRU end 2024-09-12T00:47:27.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.646+0000 7fbb4a326800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7 : miss 2024-09-12T00:47:27.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.646+0000 7fbb4a326800 20 rados->read ofs=0 len=0 2024-09-12T00:47:27.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.646+0000 7fbb4a326800 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T00:47:27.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.646+0000 7fbb4a326800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7 info.flags=0x17 2024-09-12T00:47:27.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.646+0000 7fbb4a326800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7 to cache LRU end 2024-09-12T00:47:27.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.646+0000 7fbb4a326800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:47:27.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.646+0000 7fbb4a326800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:47:27.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.646+0000 7fbb4a326800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7 2024-09-12T00:47:27.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.647+0000 7fbb4a326800 10 cls_bucket_list_unordered: got __ 2024-09-12T00:47:27.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.647+0000 7fbb4a326800 10 cls_bucket_list_unordered: got __ _ 2024-09-12T00:47:27.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.647+0000 7fbb4a326800 10 cls_bucket_list_unordered: got ___ 2024-09-12T00:47:27.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.647+0000 7fbb4a326800 10 cls_bucket_list_unordered: got obj 2024-09-12T00:47:27.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.647+0000 7fbb4a326800 20 get_obj_state: octx=0x559101221ca0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x559101229c78 s->prefetch_data=0 2024-09-12T00:47:27.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.647+0000 7fbb4a326800 10 manifest: total_size = 38 2024-09-12T00:47:27.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.647+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17008245754973181792 2024-09-12T00:47:27.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.647+0000 7fbb4a326800 20 get_obj_state: octx=0x559101221ca0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x559101229c78 s->prefetch_data=0 2024-09-12T00:47:27.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.647+0000 7fbb4a326800 20 prepare_atomic_modification: state is not atomic. state=0x559101229c78 2024-09-12T00:47:27.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.647+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7.0 2024-09-12T00:47:27.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.650+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:47:27.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.650+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=38 stripe_ofs=38 part_ofs=0 rule->part_size=0 2024-09-12T00:47:27.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.650+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17008245754973181792 2024-09-12T00:47:27.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.650+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:47:27.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.650+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7__shadow_.lDHFuhqJvPhxRqflq2x9T6-MDjoNa_8_0 2024-09-12T00:47:27.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.650+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:47:27.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.650+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:47:27.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.650+0000 7fbb4a326800 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17008245754973181792 2024-09-12T00:47:27.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.651+0000 7fba28ff9640 20 handle_completion(): completion ok for obj=__ 2024-09-12T00:47:27.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.651+0000 7fbb4a326800 20 get_obj_state: octx=0x559101221ca0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x559101229c78 s->prefetch_data=0 2024-09-12T00:47:27.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.651+0000 7fbb4a326800 10 manifest: total_size = 527 2024-09-12T00:47:27.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.651+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5910687835959758163 2024-09-12T00:47:27.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.651+0000 7fbb4a326800 20 get_obj_state: octx=0x559101221ca0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x559101229c78 s->prefetch_data=0 2024-09-12T00:47:27.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.651+0000 7fbb4a326800 20 prepare_atomic_modification: state is not atomic. state=0x559101229c78 2024-09-12T00:47:27.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.651+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7.0 2024-09-12T00:47:27.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.653+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:47:27.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.653+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=527 stripe_ofs=527 part_ofs=0 rule->part_size=0 2024-09-12T00:47:27.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.653+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5910687835959758163 2024-09-12T00:47:27.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.653+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:47:27.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.653+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7__shadow_.Yss9QKrJFgQetzU5MRdQSuotyhNh4-s_0 2024-09-12T00:47:27.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.653+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:47:27.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.653+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:47:27.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.653+0000 7fbb4a326800 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5910687835959758163 2024-09-12T00:47:27.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.654+0000 7fba297fa640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T00:47:27.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.654+0000 7fbb4a326800 20 get_obj_state: octx=0x559101241db0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x559101229c78 s->prefetch_data=0 2024-09-12T00:47:27.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.655+0000 7fbb4a326800 10 manifest: total_size = 38 2024-09-12T00:47:27.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.655+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6942076131429465990 2024-09-12T00:47:27.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.655+0000 7fbb4a326800 20 get_obj_state: octx=0x559101241db0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x559101229c78 s->prefetch_data=0 2024-09-12T00:47:27.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.655+0000 7fbb4a326800 20 prepare_atomic_modification: state is not atomic. state=0x559101229c78 2024-09-12T00:47:27.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.655+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7.0 2024-09-12T00:47:27.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.657+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:47:27.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.657+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=38 stripe_ofs=38 part_ofs=0 rule->part_size=0 2024-09-12T00:47:27.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.657+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6942076131429465990 2024-09-12T00:47:27.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.657+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:47:27.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.657+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7__shadow_.CwcpolRkhJVE6sJkkhPafRllt3_mmra_0 2024-09-12T00:47:27.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.657+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:47:27.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.657+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:47:27.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.657+0000 7fbb4a326800 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6942076131429465990 2024-09-12T00:47:27.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.658+0000 7fba28ff9640 20 handle_completion(): completion ok for obj=___ 2024-09-12T00:47:27.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.658+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb30096b00 obj=test-client.0-r-test-small-obj-data.2:obj state=0x559101229c78 s->prefetch_data=0 2024-09-12T00:47:27.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.659+0000 7fbb4a326800 10 manifest: total_size = 524288 2024-09-12T00:47:27.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.659+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11000351985317588353 2024-09-12T00:47:27.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.659+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb30096b00 obj=test-client.0-r-test-small-obj-data.2:obj state=0x559101229c78 s->prefetch_data=0 2024-09-12T00:47:27.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.659+0000 7fbb4a326800 20 prepare_atomic_modification: state is not atomic. state=0x559101229c78 2024-09-12T00:47:27.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.659+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7.0 2024-09-12T00:47:27.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.660+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:47:27.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.660+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=524288 stripe_ofs=524288 part_ofs=0 rule->part_size=0 2024-09-12T00:47:27.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.660+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11000351985317588353 2024-09-12T00:47:27.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.660+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:47:27.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.660+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7__shadow_.bkaDP3FYbNwdeXeTzM-VckWUVARE1U__0 2024-09-12T00:47:27.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.660+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:47:27.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.660+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:47:27.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.660+0000 7fbb4a326800 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11000351985317588353 2024-09-12T00:47:27.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.662+0000 7fba297fa640 20 handle_completion(): completion ok for obj=obj 2024-09-12T00:47:27.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.662+0000 7fbb4a326800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:47:27.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.662+0000 7fbb4a326800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:47:27.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.662+0000 7fbb4a326800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:47:27.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.662+0000 7fbb4a326800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:47:27.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.662+0000 7fbb4a326800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:47:27.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.662+0000 7fbb4a326800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:47:27.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.662+0000 7fbb4a326800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7])"; uploads.size()=0; is_truncated=0 2024-09-12T00:47:27.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.664+0000 7fbb4a326800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2024-09-12T00:47:27.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.664+0000 7fbb4a326800 20 rados->read ofs=0 len=0 2024-09-12T00:47:27.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.664+0000 7fbb4a326800 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T00:47:27.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.664+0000 7fbb4a326800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2024-09-12T00:47:27.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.664+0000 7fbb4a326800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2024-09-12T00:47:27.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.665+0000 7fbb4a326800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2024-09-12T00:47:27.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.665+0000 7fbb4a326800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2024-09-12T00:47:27.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.666+0000 7fba28ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497013 cookie 94081277350400 notifier 6006 bl.length()=181 2024-09-12T00:47:27.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.668+0000 7fbb4a326800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7 from cache 2024-09-12T00:47:27.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.668+0000 7fbb4a326800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7, ofs0, ns] 2024-09-12T00:47:27.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.668+0000 7fba28ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496995 cookie 94081277365744 notifier 6006 bl.length()=238 2024-09-12T00:47:27.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.670+0000 7fbb4a326800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7 : miss 2024-09-12T00:47:27.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.670+0000 7fbb4a326800 20 rados->read ofs=0 len=0 2024-09-12T00:47:27.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.671+0000 7fbb4a326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:27.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.671+0000 7fbb4a326800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7 info.flags=0x0 2024-09-12T00:47:27.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.671+0000 7fbb4a326800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7 to cache LRU end 2024-09-12T00:47:27.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.673+0000 7fbb4a326800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8 : miss 2024-09-12T00:47:27.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.673+0000 7fbb4a326800 20 rados->read ofs=0 len=0 2024-09-12T00:47:27.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.673+0000 7fbb4a326800 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T00:47:27.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.673+0000 7fbb4a326800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8 info.flags=0x17 2024-09-12T00:47:27.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.673+0000 7fbb4a326800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8 to cache LRU end 2024-09-12T00:47:27.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.673+0000 7fbb4a326800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:47:27.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.673+0000 7fbb4a326800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:47:27.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.673+0000 7fbb4a326800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8 2024-09-12T00:47:27.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.674+0000 7fbb4a326800 10 cls_bucket_list_unordered: got __ 2024-09-12T00:47:27.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.674+0000 7fbb4a326800 10 cls_bucket_list_unordered: got __ _ 2024-09-12T00:47:27.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.674+0000 7fbb4a326800 10 cls_bucket_list_unordered: got ___ 2024-09-12T00:47:27.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.674+0000 7fbb4a326800 10 cls_bucket_list_unordered: got obj 2024-09-12T00:47:27.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.674+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb300568c0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x559101229c78 s->prefetch_data=0 2024-09-12T00:47:27.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.674+0000 7fbb4a326800 10 manifest: total_size = 1035 2024-09-12T00:47:27.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.674+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14526118791914064140 2024-09-12T00:47:27.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.674+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb300568c0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x559101229c78 s->prefetch_data=0 2024-09-12T00:47:27.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.674+0000 7fbb4a326800 20 prepare_atomic_modification: state is not atomic. state=0x559101229c78 2024-09-12T00:47:27.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.674+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8.0 2024-09-12T00:47:27.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.676+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:47:27.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.676+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=1035 stripe_ofs=1035 part_ofs=0 rule->part_size=0 2024-09-12T00:47:27.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.676+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14526118791914064140 2024-09-12T00:47:27.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.676+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:47:27.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.676+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8__shadow_.fakDfpA1UER1-AvDEg2flsSZLaWvIg3_0 2024-09-12T00:47:27.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.676+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:47:27.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.676+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:47:27.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.676+0000 7fbb4a326800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14526118791914064140 2024-09-12T00:47:27.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.677+0000 7fba297fa640 20 handle_completion(): completion ok for obj=__ 2024-09-12T00:47:27.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.677+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb300568c0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x559101229c78 s->prefetch_data=0 2024-09-12T00:47:27.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.678+0000 7fbb4a326800 10 manifest: total_size = 4134 2024-09-12T00:47:27.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.678+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8365475146845089361 2024-09-12T00:47:27.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.678+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb300568c0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x559101229c78 s->prefetch_data=0 2024-09-12T00:47:27.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.678+0000 7fbb4a326800 20 prepare_atomic_modification: state is not atomic. state=0x559101229c78 2024-09-12T00:47:27.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.678+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8.0 2024-09-12T00:47:27.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.680+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:47:27.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.680+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=4134 stripe_ofs=4134 part_ofs=0 rule->part_size=0 2024-09-12T00:47:27.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.680+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8365475146845089361 2024-09-12T00:47:27.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.680+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:47:27.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.680+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8__shadow_.werUkgy-RkpUU0XkbkkW7Bn-1QGRQrA_0 2024-09-12T00:47:27.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.680+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:47:27.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.680+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:47:27.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.680+0000 7fbb4a326800 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8365475146845089361 2024-09-12T00:47:27.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.681+0000 7fba28ff9640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T00:47:27.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.681+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb300568c0 obj=test-client.0-r-test-small-obj-data.3:___ state=0x559101229c78 s->prefetch_data=0 2024-09-12T00:47:27.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.681+0000 7fbb4a326800 10 manifest: total_size = 1048576 2024-09-12T00:47:27.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.681+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15163698396306019932 2024-09-12T00:47:27.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.681+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb300568c0 obj=test-client.0-r-test-small-obj-data.3:___ state=0x559101229c78 s->prefetch_data=0 2024-09-12T00:47:27.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.681+0000 7fbb4a326800 20 prepare_atomic_modification: state is not atomic. state=0x559101229c78 2024-09-12T00:47:27.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.681+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8.0 2024-09-12T00:47:27.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.683+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:47:27.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.683+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=1048576 stripe_ofs=1048576 part_ofs=0 rule->part_size=0 2024-09-12T00:47:27.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.683+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15163698396306019932 2024-09-12T00:47:27.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.683+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:47:27.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.683+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8__shadow_.Vs5fmy6KejdOdKGQRs8xUsPrIXwUURP_0 2024-09-12T00:47:27.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.683+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:47:27.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.683+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:47:27.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.683+0000 7fbb4a326800 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15163698396306019932 2024-09-12T00:47:27.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.685+0000 7fba297fa640 20 handle_completion(): completion ok for obj=___ 2024-09-12T00:47:27.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.685+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb300568c0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x559101229c78 s->prefetch_data=0 2024-09-12T00:47:27.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.685+0000 7fbb4a326800 10 manifest: total_size = 4134 2024-09-12T00:47:27.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.685+0000 7fbb4a326800 20 get_obj_state: setting s->obj_tag to f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15201155941029709124 2024-09-12T00:47:27.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.685+0000 7fbb4a326800 20 get_obj_state: octx=0x7fbb300568c0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x559101229c78 s->prefetch_data=0 2024-09-12T00:47:27.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.685+0000 7fbb4a326800 20 prepare_atomic_modification: state is not atomic. state=0x559101229c78 2024-09-12T00:47:27.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.685+0000 7fbb4a326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8.0 2024-09-12T00:47:27.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.687+0000 7fbb4a326800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:47:27.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.687+0000 7fbb4a326800 20 RGWObjManifest::operator++(): result: ofs=4134 stripe_ofs=4134 part_ofs=0 rule->part_size=0 2024-09-12T00:47:27.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.687+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15201155941029709124 2024-09-12T00:47:27.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.687+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:47:27.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.687+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8__shadow_.o_KCNKIobQ0mvOYJqpbmkNySfr-TTEW_0 2024-09-12T00:47:27.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.687+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:47:27.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.687+0000 7fbb4a326800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:47:27.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.687+0000 7fbb4a326800 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15201155941029709124 2024-09-12T00:47:27.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.688+0000 7fba28ff9640 20 handle_completion(): completion ok for obj=obj 2024-09-12T00:47:27.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.689+0000 7fbb4a326800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:47:27.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.689+0000 7fbb4a326800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:47:27.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.689+0000 7fbb4a326800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:47:27.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.689+0000 7fbb4a326800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:47:27.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.689+0000 7fbb4a326800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:47:27.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.689+0000 7fbb4a326800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:47:27.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.689+0000 7fbb4a326800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8])"; uploads.size()=0; is_truncated=0 2024-09-12T00:47:27.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.690+0000 7fbb4a326800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2024-09-12T00:47:27.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.690+0000 7fbb4a326800 20 rados->read ofs=0 len=0 2024-09-12T00:47:27.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.691+0000 7fbb4a326800 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T00:47:27.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.691+0000 7fbb4a326800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2024-09-12T00:47:27.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.691+0000 7fbb4a326800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2024-09-12T00:47:27.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.692+0000 7fbb4a326800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2024-09-12T00:47:27.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.692+0000 7fbb4a326800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2024-09-12T00:47:27.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.692+0000 7fba297fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497014 cookie 94081277350400 notifier 6006 bl.length()=181 2024-09-12T00:47:27.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.695+0000 7fbb4a326800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8 from cache 2024-09-12T00:47:27.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.695+0000 7fbb4a326800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8, ofs0, ns] 2024-09-12T00:47:27.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.695+0000 7fba28ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496996 cookie 94081277365744 notifier 6006 bl.length()=238 2024-09-12T00:47:27.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.698+0000 7fbb4a326800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8 : miss 2024-09-12T00:47:27.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.698+0000 7fbb4a326800 20 rados->read ofs=0 len=0 2024-09-12T00:47:27.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.698+0000 7fbb4a326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:27.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.698+0000 7fbb4a326800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8 info.flags=0x0 2024-09-12T00:47:27.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.698+0000 7fbb4a326800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8 to cache LRU end 2024-09-12T00:47:27.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.700+0000 7fbb4a326800 10 removing key index: QAOKTBZNKYAMILECXZBI 2024-09-12T00:47:27.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.701+0000 7fbb4a326800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.keys:QAOKTBZNKYAMILECXZBI, ofs0, ns] 2024-09-12T00:47:27.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.701+0000 7fba297fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496978 cookie 94081277376880 notifier 6006 bl.length()=170 2024-09-12T00:47:27.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.702+0000 7fbb4a326800 10 removing email index: ragweed.client.0+test@test.test 2024-09-12T00:47:27.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.710+0000 7fbb4a326800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-12T00:47:27.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.710+0000 7fba28ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497032 cookie 94081277359040 notifier 6006 bl.length()=182 2024-09-12T00:47:27.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.711+0000 7fbb4a326800 10 removing user buckets index 2024-09-12T00:47:27.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.712+0000 7fbb4a326800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2024-09-12T00:47:27.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.713+0000 7fba28ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496976 cookie 94081277368016 notifier 6006 bl.length()=173 2024-09-12T00:47:27.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.714+0000 7fbb4a326800 10 removing user index: ragweed.client.0 2024-09-12T00:47:27.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.715+0000 7fbb4a326800 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2024-09-12T00:47:27.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.715+0000 7fbb4a326800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-12T00:47:27.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.715+0000 7fba28ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496997 cookie 94081277365744 notifier 6006 bl.length()=165 2024-09-12T00:47:27.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.719+0000 7fb9f77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:27.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.721+0000 7fbb4a326800 20 remove_watcher() i=0 2024-09-12T00:47:27.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.721+0000 7fbb4a326800 2 removed watcher, disabling cache 2024-09-12T00:47:27.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.722+0000 7fbb4a326800 20 remove_watcher() i=1 2024-09-12T00:47:27.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.723+0000 7fbb4a326800 20 remove_watcher() i=2 2024-09-12T00:47:27.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.724+0000 7fbb4a326800 20 remove_watcher() i=3 2024-09-12T00:47:27.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.725+0000 7fbb4a326800 20 remove_watcher() i=4 2024-09-12T00:47:27.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.726+0000 7fbb4a326800 20 remove_watcher() i=5 2024-09-12T00:47:27.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.726+0000 7fbb4a326800 20 remove_watcher() i=6 2024-09-12T00:47:27.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.727+0000 7fbb4a326800 20 remove_watcher() i=7 2024-09-12T00:47:27.737 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2024-09-12T00:47:27.795 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:47:27.796 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:27.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.829+0000 7f539e775800 20 rados->read ofs=0 len=0 2024-09-12T00:47:27.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.831+0000 7f539e775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:27.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.831+0000 7f539e775800 20 realm 2024-09-12T00:47:27.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.831+0000 7f539e775800 20 rados->read ofs=0 len=0 2024-09-12T00:47:27.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.831+0000 7f539e775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:27.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.831+0000 7f539e775800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:27.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.831+0000 7f539e775800 20 rados->read ofs=0 len=0 2024-09-12T00:47:27.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.831+0000 7f539e775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:27.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.831+0000 7f539e775800 20 rados->read ofs=0 len=0 2024-09-12T00:47:27.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.832+0000 7f539e775800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:27.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.832+0000 7f539e775800 20 rados->read ofs=0 len=0 2024-09-12T00:47:27.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.833+0000 7f539e775800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:27.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.833+0000 7f539e775800 20 searching for the correct realm 2024-09-12T00:47:27.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:27.835+0000 7f539ca60640 0 -- 172.21.15.73:0/4042944242 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f5384056980 msgr2=0x7f5384064430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:47:28.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.041+0000 7f539ca60640 0 -- 172.21.15.73:0/4042944242 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f5384056980 msgr2=0x7f5384064430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:28.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.045+0000 7f539e775800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:47:28.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.045+0000 7f539e775800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:28.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.045+0000 7f539e775800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:47:28.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.045+0000 7f539e775800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:28.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.045+0000 7f539e775800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:28.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.045+0000 7f539e775800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:28.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.045+0000 7f539e775800 20 rados->read ofs=0 len=0 2024-09-12T00:47:28.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.045+0000 7f539e775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:28.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.045+0000 7f539e775800 20 rados->read ofs=0 len=0 2024-09-12T00:47:28.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.045+0000 7f539e775800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:28.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.045+0000 7f539e775800 20 rados->read ofs=0 len=0 2024-09-12T00:47:28.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.046+0000 7f539e775800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:28.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.046+0000 7f539e775800 20 zone default found 2024-09-12T00:47:28.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.046+0000 7f539e775800 4 Realm: () 2024-09-12T00:47:28.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.046+0000 7f539e775800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:47:28.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.046+0000 7f539e775800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:47:28.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.046+0000 7f539e775800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:28.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.046+0000 7f539e775800 20 zonegroup default 2024-09-12T00:47:28.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.046+0000 7f539e775800 20 rados->read ofs=0 len=0 2024-09-12T00:47:28.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.046+0000 7f539e775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:28.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.046+0000 7f539e775800 20 rados->read ofs=0 len=0 2024-09-12T00:47:28.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.046+0000 7f539e775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:28.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.046+0000 7f539e775800 20 rados->read ofs=0 len=0 2024-09-12T00:47:28.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.046+0000 7f539e775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:28.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.046+0000 7f539e775800 20 started sync module instance, tier type = 2024-09-12T00:47:28.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.046+0000 7f539e775800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:47:28.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.055+0000 7f539e775800 20 add_watcher() i=0 2024-09-12T00:47:28.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.055+0000 7f539e775800 20 add_watcher() i=1 2024-09-12T00:47:28.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.055+0000 7f539e775800 20 add_watcher() i=2 2024-09-12T00:47:28.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.055+0000 7f539e775800 20 add_watcher() i=3 2024-09-12T00:47:28.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.055+0000 7f539e775800 20 add_watcher() i=4 2024-09-12T00:47:28.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.055+0000 7f539e775800 20 add_watcher() i=5 2024-09-12T00:47:28.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.055+0000 7f539e775800 20 add_watcher() i=6 2024-09-12T00:47:28.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.056+0000 7f539e775800 20 add_watcher() i=7 2024-09-12T00:47:28.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.056+0000 7f539e775800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:28.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.058+0000 7f5252fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:28.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.058+0000 7f539e775800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:28.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.058+0000 7f539e775800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:28.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.093+0000 7f5251fe3640 20 reqs_thread_entry: start 2024-09-12T00:47:28.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.093+0000 7f539e775800 20 init_complete bucket index max shards: 1 2024-09-12T00:47:28.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.094+0000 7f539e775800 20 Filter name: none 2024-09-12T00:47:28.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.094+0000 7f524b7fe640 20 reqs_thread_entry: start 2024-09-12T00:47:28.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.094+0000 7f539e775800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-12T00:47:28.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.094+0000 7f539e775800 20 rados->read ofs=0 len=0 2024-09-12T00:47:28.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.094+0000 7f539e775800 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T00:47:28.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.094+0000 7f539e775800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2024-09-12T00:47:28.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.094+0000 7f539e775800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T00:47:28.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.094+0000 7f539e775800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:47:28.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.095+0000 7f539e775800 10 removing key index: TZEFHVGKRAHDRHNWSEKF 2024-09-12T00:47:28.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.096+0000 7f539e775800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:TZEFHVGKRAHDRHNWSEKF, ofs0, ns] 2024-09-12T00:47:28.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.096+0000 7f527b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497033 cookie 94190447230288 notifier 5726 bl.length()=170 2024-09-12T00:47:28.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.098+0000 7f539e775800 10 removing email index: sysuser.client.0+test@test.test 2024-09-12T00:47:28.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.099+0000 7f539e775800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-12T00:47:28.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.099+0000 7f527b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496998 cookie 94190447235392 notifier 5726 bl.length()=182 2024-09-12T00:47:28.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.100+0000 7f539e775800 10 removing user buckets index 2024-09-12T00:47:28.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.101+0000 7f539e775800 10 removing user index: sysuser.client.0 2024-09-12T00:47:28.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.102+0000 7f539e775800 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2024-09-12T00:47:28.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.102+0000 7f539e775800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-12T00:47:28.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.103+0000 7f527affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497034 cookie 94190447230288 notifier 5726 bl.length()=165 2024-09-12T00:47:28.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.104+0000 7f5252fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:28.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.107+0000 7f539e775800 20 remove_watcher() i=0 2024-09-12T00:47:28.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.107+0000 7f539e775800 2 removed watcher, disabling cache 2024-09-12T00:47:28.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.108+0000 7f539e775800 20 remove_watcher() i=1 2024-09-12T00:47:28.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.108+0000 7f539e775800 20 remove_watcher() i=2 2024-09-12T00:47:28.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.109+0000 7f539e775800 20 remove_watcher() i=3 2024-09-12T00:47:28.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.110+0000 7f539e775800 20 remove_watcher() i=4 2024-09-12T00:47:28.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.111+0000 7f539e775800 20 remove_watcher() i=5 2024-09-12T00:47:28.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.112+0000 7f539e775800 20 remove_watcher() i=6 2024-09-12T00:47:28.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:47:28.113+0000 7f539e775800 20 remove_watcher() i=7 2024-09-12T00:47:28.123 INFO:tasks.ragweed:Removing ragweed... 2024-09-12T00:47:28.123 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T00:47:28.204 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:47:28.215 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:47:28.215 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:47:28.215 DEBUG:teuthology.orchestra.run.smithi073:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:47:28.245 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:47:28.245 INFO:teuthology.orchestra.run.smithi073.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:47:28.245 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:47:28.314 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:47:28.314 DEBUG:teuthology.orchestra.run.smithi073:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:47:28.384 INFO:tasks.workunit:timeout=3h 2024-09-12T00:47:28.384 INFO:tasks.workunit:cleanup=True 2024-09-12T00:47:28.385 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:47:28.453 INFO:tasks.workunit.client.0.smithi073.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:48:14.534 INFO:tasks.workunit.client.0.smithi073.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:48:14.535 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:14.535 INFO:tasks.workunit.client.0.smithi073.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:48:14.535 INFO:tasks.workunit.client.0.smithi073.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:48:14.535 INFO:tasks.workunit.client.0.smithi073.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:48:14.535 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:14.535 INFO:tasks.workunit.client.0.smithi073.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:48:14.535 INFO:tasks.workunit.client.0.smithi073.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:48:14.535 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:14.535 INFO:tasks.workunit.client.0.smithi073.stderr: git switch -c 2024-09-12T00:48:14.535 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:14.536 INFO:tasks.workunit.client.0.smithi073.stderr:Or undo this operation with: 2024-09-12T00:48:14.536 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:14.536 INFO:tasks.workunit.client.0.smithi073.stderr: git switch - 2024-09-12T00:48:14.536 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:14.536 INFO:tasks.workunit.client.0.smithi073.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:48:14.536 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:14.536 INFO:tasks.workunit.client.0.smithi073.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:48:14.539 DEBUG:teuthology.orchestra.run.smithi073:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:48:14.608 INFO:tasks.workunit.client.0.smithi073.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:48:14.610 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:48:14.610 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:48:14.658 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:48:14.706 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:48:14.745 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:48:14.746 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:48:14.746 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:48:14.785 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:48:14.788 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T00:48:14.788 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:48:14.859 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2024-09-12T00:48:14.860 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2024-09-12T00:48:14.860 DEBUG:teuthology.orchestra.run.smithi073:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-12T00:48:14.932 INFO:tasks.workunit.client.0.smithi073.stderr:+ ulimit -c 0 2024-09-12T00:48:14.932 INFO:tasks.workunit.client.0.smithi073.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-12T00:48:14.933 INFO:tasks.workunit.client.0.smithi073.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:48:14.933 INFO:tasks.workunit.client.0.smithi073.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:48:17.268 INFO:tasks.workunit.client.0.smithi073.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T00:48:17.269 INFO:tasks.workunit.client.0.smithi073.stderr:++ deactivate nondestructive 2024-09-12T00:48:17.269 INFO:tasks.workunit.client.0.smithi073.stderr:++ '[' -n '' ']' 2024-09-12T00:48:17.269 INFO:tasks.workunit.client.0.smithi073.stderr:++ '[' -n '' ']' 2024-09-12T00:48:17.269 INFO:tasks.workunit.client.0.smithi073.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:48:17.269 INFO:tasks.workunit.client.0.smithi073.stderr:++ hash -r 2024-09-12T00:48:17.269 INFO:tasks.workunit.client.0.smithi073.stderr:++ '[' -n '' ']' 2024-09-12T00:48:17.269 INFO:tasks.workunit.client.0.smithi073.stderr:++ unset VIRTUAL_ENV 2024-09-12T00:48:17.269 INFO:tasks.workunit.client.0.smithi073.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T00:48:17.269 INFO:tasks.workunit.client.0.smithi073.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:48:17.269 INFO:tasks.workunit.client.0.smithi073.stderr:++ export VIRTUAL_ENV 2024-09-12T00:48:17.269 INFO:tasks.workunit.client.0.smithi073.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T00:48:17.269 INFO:tasks.workunit.client.0.smithi073.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T00:48:17.270 INFO:tasks.workunit.client.0.smithi073.stderr:++ export PATH 2024-09-12T00:48:17.270 INFO:tasks.workunit.client.0.smithi073.stderr:++ '[' -n '' ']' 2024-09-12T00:48:17.270 INFO:tasks.workunit.client.0.smithi073.stderr:++ '[' -z '' ']' 2024-09-12T00:48:17.270 INFO:tasks.workunit.client.0.smithi073.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T00:48:17.270 INFO:tasks.workunit.client.0.smithi073.stderr:++ PS1='(rgw) ' 2024-09-12T00:48:17.270 INFO:tasks.workunit.client.0.smithi073.stderr:++ export PS1 2024-09-12T00:48:17.270 INFO:tasks.workunit.client.0.smithi073.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:48:17.270 INFO:tasks.workunit.client.0.smithi073.stderr:++ hash -r 2024-09-12T00:48:17.270 INFO:tasks.workunit.client.0.smithi073.stderr:+ pip install pip --upgrade 2024-09-12T00:48:17.497 INFO:tasks.workunit.client.0.smithi073.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T00:48:17.677 INFO:tasks.workunit.client.0.smithi073.stdout:Collecting pip 2024-09-12T00:48:17.682 INFO:tasks.workunit.client.0.smithi073.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T00:48:17.726 INFO:tasks.workunit.client.0.smithi073.stdout:Installing collected packages: pip 2024-09-12T00:48:17.726 INFO:tasks.workunit.client.0.smithi073.stdout: Attempting uninstall: pip 2024-09-12T00:48:17.726 INFO:tasks.workunit.client.0.smithi073.stdout: Found existing installation: pip 21.3.1 2024-09-12T00:48:17.881 INFO:tasks.workunit.client.0.smithi073.stdout: Uninstalling pip-21.3.1: 2024-09-12T00:48:17.887 INFO:tasks.workunit.client.0.smithi073.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T00:48:18.620 INFO:tasks.workunit.client.0.smithi073.stdout:Successfully installed pip-24.2 2024-09-12T00:48:18.668 INFO:tasks.workunit.client.0.smithi073.stderr:+ pip install boto3 2024-09-12T00:48:19.465 INFO:tasks.workunit.client.0.smithi073.stdout:Collecting boto3 2024-09-12T00:48:19.466 INFO:tasks.workunit.client.0.smithi073.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T00:48:20.000 INFO:tasks.workunit.client.0.smithi073.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T00:48:20.001 INFO:tasks.workunit.client.0.smithi073.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T00:48:20.048 INFO:tasks.workunit.client.0.smithi073.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T00:48:20.049 INFO:tasks.workunit.client.0.smithi073.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T00:48:20.103 INFO:tasks.workunit.client.0.smithi073.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T00:48:20.105 INFO:tasks.workunit.client.0.smithi073.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T00:48:20.154 INFO:tasks.workunit.client.0.smithi073.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:48:20.155 INFO:tasks.workunit.client.0.smithi073.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T00:48:20.231 INFO:tasks.workunit.client.0.smithi073.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:48:20.233 INFO:tasks.workunit.client.0.smithi073.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-12T00:48:20.452 INFO:tasks.workunit.client.0.smithi073.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:48:20.453 INFO:tasks.workunit.client.0.smithi073.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T00:48:20.458 INFO:tasks.workunit.client.0.smithi073.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T00:48:20.459 INFO:tasks.workunit.client.0.smithi073.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T00:48:20.468 INFO:tasks.workunit.client.0.smithi073.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T00:48:20.470 INFO:tasks.workunit.client.0.smithi073.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T00:48:20.471 INFO:tasks.workunit.client.0.smithi073.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T00:48:20.472 INFO:tasks.workunit.client.0.smithi073.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-12T00:48:20.474 INFO:tasks.workunit.client.0.smithi073.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:48:20.547 INFO:tasks.workunit.client.0.smithi073.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T00:48:21.591 INFO:tasks.workunit.client.0.smithi073.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-12T00:48:21.710 INFO:tasks.workunit.client.0.smithi073.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-09-12T00:48:21.833 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2024-09-12T00:48:21.867 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:21.867 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:21.905 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:21.906+0000 7f6134d25800 20 rados->read ofs=0 len=0 2024-09-12T00:48:21.907 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:21.908+0000 7f6134d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:21.907 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:21.908+0000 7f6134d25800 20 realm 2024-09-12T00:48:21.907 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:21.908+0000 7f6134d25800 20 rados->read ofs=0 len=0 2024-09-12T00:48:21.907 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:21.908+0000 7f6134d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:21.907 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:21.908+0000 7f6134d25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:21.907 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:21.908+0000 7f6134d25800 20 rados->read ofs=0 len=0 2024-09-12T00:48:21.907 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:21.908+0000 7f6134d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:21.907 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:21.908+0000 7f6134d25800 20 rados->read ofs=0 len=0 2024-09-12T00:48:21.908 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:21.909+0000 7f6134d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:21.908 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:21.909+0000 7f6134d25800 20 rados->read ofs=0 len=0 2024-09-12T00:48:21.909 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:21.910+0000 7f6134d25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:21.909 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:21.910+0000 7f6134d25800 20 searching for the correct realm 2024-09-12T00:48:21.911 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:21.912+0000 7f6130132640 0 -- 172.21.15.73:0/1944726272 >> [v2:172.21.15.73:6826/269690776,v1:172.21.15.73:6827/269690776] conn(0x7f6120061040 msgr2=0x7f6120064040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:21.915 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:21.916+0000 7f6130933640 0 -- 172.21.15.73:0/1944726272 >> [v2:172.21.15.73:6810/1807760270,v1:172.21.15.73:6811/1807760270] conn(0x7f612806c0b0 msgr2=0x7f61280678a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:22.122 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.122+0000 7f6134d25800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:48:22.122 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.122+0000 7f6134d25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:22.122 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.122+0000 7f6134d25800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:48:22.123 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.122+0000 7f6134d25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:22.123 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.122+0000 7f6134d25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:22.123 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.122+0000 7f6134d25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:22.123 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.122+0000 7f6134d25800 20 rados->read ofs=0 len=0 2024-09-12T00:48:22.123 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.122+0000 7f6134d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:22.123 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.122+0000 7f6134d25800 20 rados->read ofs=0 len=0 2024-09-12T00:48:22.123 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.122+0000 7f6134d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:22.123 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.122+0000 7f6134d25800 20 rados->read ofs=0 len=0 2024-09-12T00:48:22.123 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.123+0000 7f6134d25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:22.123 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.123+0000 7f6134d25800 20 zone default found 2024-09-12T00:48:22.123 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.123+0000 7f6134d25800 4 Realm: () 2024-09-12T00:48:22.123 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.123+0000 7f6134d25800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:48:22.124 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.123+0000 7f6134d25800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:48:22.124 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.123+0000 7f6134d25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:22.124 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.123+0000 7f6134d25800 20 zonegroup default 2024-09-12T00:48:22.124 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.123+0000 7f6134d25800 20 rados->read ofs=0 len=0 2024-09-12T00:48:22.124 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.123+0000 7f6134d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:22.124 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.123+0000 7f6134d25800 20 rados->read ofs=0 len=0 2024-09-12T00:48:22.124 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.123+0000 7f6134d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:22.124 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.123+0000 7f6134d25800 20 rados->read ofs=0 len=0 2024-09-12T00:48:22.124 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.124+0000 7f6134d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:22.124 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.124+0000 7f6134d25800 20 started sync module instance, tier type = 2024-09-12T00:48:22.124 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.124+0000 7f6134d25800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:48:22.132 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.133+0000 7f6134d25800 20 add_watcher() i=0 2024-09-12T00:48:22.132 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.133+0000 7f6134d25800 20 add_watcher() i=1 2024-09-12T00:48:22.132 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.133+0000 7f6134d25800 20 add_watcher() i=2 2024-09-12T00:48:22.132 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.133+0000 7f6134d25800 20 add_watcher() i=3 2024-09-12T00:48:22.133 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.133+0000 7f6134d25800 20 add_watcher() i=4 2024-09-12T00:48:22.133 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.133+0000 7f6134d25800 20 add_watcher() i=5 2024-09-12T00:48:22.133 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.133+0000 7f6134d25800 20 add_watcher() i=6 2024-09-12T00:48:22.133 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.134+0000 7f6134d25800 20 add_watcher() i=7 2024-09-12T00:48:22.133 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.134+0000 7f6134d25800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:22.136 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.136+0000 7f5fe6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:22.137 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.136+0000 7f6134d25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:22.137 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.136+0000 7f6134d25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:22.137 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.137+0000 7f6134d25800 5 note: GC not initialized 2024-09-12T00:48:22.137 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.137+0000 7f5fe5fe3640 20 reqs_thread_entry: start 2024-09-12T00:48:22.137 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.137+0000 7f6134d25800 20 init_complete bucket index max shards: 1 2024-09-12T00:48:22.137 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.137+0000 7f6134d25800 20 Filter name: none 2024-09-12T00:48:22.137 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.137+0000 7f5f577fe640 20 reqs_thread_entry: start 2024-09-12T00:48:22.137 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.137+0000 7f6134d25800 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2024-09-12T00:48:22.137 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.137+0000 7f6134d25800 20 rados->read ofs=0 len=0 2024-09-12T00:48:22.138 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.137+0000 7f6134d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:22.138 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.137+0000 7f6134d25800 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2024-09-12T00:48:22.138 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.137+0000 7f6134d25800 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2024-09-12T00:48:22.138 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.137+0000 7f6134d25800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-12T00:48:22.138 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.137+0000 7f6134d25800 20 rados->read ofs=0 len=0 2024-09-12T00:48:22.138 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.138+0000 7f6134d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:22.139 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.138+0000 7f6134d25800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-09-12T00:48:22.139 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.138+0000 7f6134d25800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T00:48:22.139 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.138+0000 7f6134d25800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-12T00:48:22.139 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.138+0000 7f6134d25800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-12T00:48:22.140 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.139+0000 7f6134d25800 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-09-12T00:48:22.140 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.139+0000 7f6134d25800 10 moving default.rgw.meta+users.uid+tester to cache LRU end 2024-09-12T00:48:22.140 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.139+0000 7f6134d25800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester, ofs0, ns] 2024-09-12T00:48:22.140 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.140+0000 7f6007fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496977 cookie 94335185736304 notifier 5744 bl.length()=569 2024-09-12T00:48:22.141 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.140+0000 7f6007fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-09-12T00:48:22.141 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.140+0000 7f6007fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester to cache LRU end 2024-09-12T00:48:22.142 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.142+0000 7f6134d25800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-12T00:48:22.142 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.142+0000 7f6134d25800 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T00:48:22.142 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.142+0000 7f6134d25800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-12T00:48:22.142 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.142+0000 7f6007fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496978 cookie 94335185734096 notifier 5744 bl.length()=180 2024-09-12T00:48:22.142 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.142+0000 7f6007fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-12T00:48:22.142 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.142+0000 7f6007fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T00:48:22.143 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.144+0000 7f5fe6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:22.146 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.147+0000 7f6134d25800 20 remove_watcher() i=0 2024-09-12T00:48:22.146 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.147+0000 7f6134d25800 2 removed watcher, disabling cache 2024-09-12T00:48:22.147 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.148+0000 7f6134d25800 20 remove_watcher() i=1 2024-09-12T00:48:22.148 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.149+0000 7f6134d25800 20 remove_watcher() i=2 2024-09-12T00:48:22.149 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.150+0000 7f6134d25800 20 remove_watcher() i=3 2024-09-12T00:48:22.150 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.152+0000 7f6134d25800 20 remove_watcher() i=4 2024-09-12T00:48:22.151 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.153+0000 7f6134d25800 20 remove_watcher() i=5 2024-09-12T00:48:22.152 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.154+0000 7f6134d25800 20 remove_watcher() i=6 2024-09-12T00:48:22.153 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:22.155+0000 7f6134d25800 20 remove_watcher() i=7 2024-09-12T00:48:32.960 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:32.960 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:33.008 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:33.008 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:33.049 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:33.049 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:33.086 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:33.087 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:33.114 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:33.114 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:33.174 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:33.174 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:33.229 INFO:tasks.workunit.client.0.smithi073.stderr:TEST: reshard add 2024-09-12T00:48:33.229 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:33.230 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:48:33.258 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:33.258 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:33.295 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.296+0000 7f33d4942800 20 rados->read ofs=0 len=0 2024-09-12T00:48:33.297 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.298+0000 7f33d4942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:33.297 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.298+0000 7f33d4942800 20 realm 2024-09-12T00:48:33.297 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.298+0000 7f33d4942800 20 rados->read ofs=0 len=0 2024-09-12T00:48:33.297 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.298+0000 7f33d4942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:33.297 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.298+0000 7f33d4942800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:33.297 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.298+0000 7f33d4942800 20 rados->read ofs=0 len=0 2024-09-12T00:48:33.297 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.298+0000 7f33d4942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:33.297 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.298+0000 7f33d4942800 20 rados->read ofs=0 len=0 2024-09-12T00:48:33.298 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.299+0000 7f33d4942800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:33.298 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.299+0000 7f33d4942800 20 rados->read ofs=0 len=0 2024-09-12T00:48:33.299 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.300+0000 7f33d4942800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:33.299 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.300+0000 7f33d4942800 20 searching for the correct realm 2024-09-12T00:48:33.301 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.303+0000 7f33d0e87640 0 -- 172.21.15.73:0/1249846930 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f33c403b020 msgr2=0x7f33c4066b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:33.305 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.307+0000 7f33cfe85640 0 -- 172.21.15.73:0/1249846930 >> [v2:172.21.15.117:6800/110688882,v1:172.21.15.117:6801/110688882] conn(0x55ec535b6270 msgr2=0x55ec535b8660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:48:33.310 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.311+0000 7f33d4942800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:48:33.310 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.311+0000 7f33d4942800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:33.310 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.311+0000 7f33d4942800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:48:33.310 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.311+0000 7f33d4942800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:33.310 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.311+0000 7f33d4942800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:33.310 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.311+0000 7f33d4942800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:33.310 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.311+0000 7f33d4942800 20 rados->read ofs=0 len=0 2024-09-12T00:48:33.311 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.311+0000 7f33d4942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:33.311 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.311+0000 7f33d4942800 20 rados->read ofs=0 len=0 2024-09-12T00:48:33.312 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.312+0000 7f33d4942800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:33.312 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.312+0000 7f33d4942800 20 rados->read ofs=0 len=0 2024-09-12T00:48:33.312 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.312+0000 7f33d4942800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:33.312 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.312+0000 7f33d4942800 20 zone default found 2024-09-12T00:48:33.312 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.312+0000 7f33d4942800 4 Realm: () 2024-09-12T00:48:33.312 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.312+0000 7f33d4942800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:48:33.312 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.312+0000 7f33d4942800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:48:33.312 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.312+0000 7f33d4942800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:33.312 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.312+0000 7f33d4942800 20 zonegroup default 2024-09-12T00:48:33.313 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.312+0000 7f33d4942800 20 rados->read ofs=0 len=0 2024-09-12T00:48:33.313 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.312+0000 7f33d4942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:33.313 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.312+0000 7f33d4942800 20 rados->read ofs=0 len=0 2024-09-12T00:48:33.313 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.312+0000 7f33d4942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:33.313 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.312+0000 7f33d4942800 20 rados->read ofs=0 len=0 2024-09-12T00:48:33.313 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.313+0000 7f33d4942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:33.313 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.313+0000 7f33d4942800 20 started sync module instance, tier type = 2024-09-12T00:48:33.313 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.313+0000 7f33d4942800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:48:33.320 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.322+0000 7f33d4942800 20 add_watcher() i=0 2024-09-12T00:48:33.321 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.322+0000 7f33d4942800 20 add_watcher() i=1 2024-09-12T00:48:33.321 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.322+0000 7f33d4942800 20 add_watcher() i=2 2024-09-12T00:48:33.321 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.322+0000 7f33d4942800 20 add_watcher() i=3 2024-09-12T00:48:33.321 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.322+0000 7f33d4942800 20 add_watcher() i=4 2024-09-12T00:48:33.321 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.322+0000 7f33d4942800 20 add_watcher() i=5 2024-09-12T00:48:33.321 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.322+0000 7f33d4942800 20 add_watcher() i=6 2024-09-12T00:48:33.322 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.323+0000 7f33d4942800 20 add_watcher() i=7 2024-09-12T00:48:33.322 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.323+0000 7f33d4942800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:33.323 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.324+0000 7f3286fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:33.324 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.324+0000 7f33d4942800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:33.324 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.324+0000 7f33d4942800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:33.324 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.324+0000 7f33d4942800 5 note: GC not initialized 2024-09-12T00:48:33.324 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.325+0000 7f3285fdb640 20 reqs_thread_entry: start 2024-09-12T00:48:33.324 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.325+0000 7f33d4942800 20 init_complete bucket index max shards: 1 2024-09-12T00:48:33.324 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.325+0000 7f33d4942800 20 Filter name: none 2024-09-12T00:48:33.324 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.325+0000 7f31f77fe640 20 reqs_thread_entry: start 2024-09-12T00:48:33.324 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.325+0000 7f33d4942800 20 rados->read ofs=0 len=0 2024-09-12T00:48:33.325 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.326+0000 7f33d4942800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:48:33.326 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.326+0000 7f33d4942800 20 rados->read ofs=0 len=0 2024-09-12T00:48:33.326 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.326+0000 7f33d4942800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:48:33.326 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.326+0000 7f33d4942800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:33.326 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.326+0000 7f33d4942800 20 rados->read ofs=0 len=0 2024-09-12T00:48:33.326 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.327+0000 7f33d4942800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:48:33.326 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.327+0000 7f33d4942800 20 rados->read ofs=0 len=0 2024-09-12T00:48:33.326 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.327+0000 7f33d4942800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:48:33.326 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.327+0000 7f33d4942800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:33.327 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.328+0000 7f3286fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:33.329 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.330+0000 7f33d4942800 20 remove_watcher() i=0 2024-09-12T00:48:33.329 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.330+0000 7f33d4942800 2 removed watcher, disabling cache 2024-09-12T00:48:33.330 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.331+0000 7f33d4942800 20 remove_watcher() i=1 2024-09-12T00:48:33.331 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.333+0000 7f33d4942800 20 remove_watcher() i=2 2024-09-12T00:48:33.332 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.334+0000 7f33d4942800 20 remove_watcher() i=3 2024-09-12T00:48:33.333 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.335+0000 7f33d4942800 20 remove_watcher() i=4 2024-09-12T00:48:33.334 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.336+0000 7f33d4942800 20 remove_watcher() i=5 2024-09-12T00:48:33.335 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.336+0000 7f33d4942800 20 remove_watcher() i=6 2024-09-12T00:48:33.336 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.337+0000 7f33d4942800 20 remove_watcher() i=7 2024-09-12T00:48:33.347 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:33.347 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:48:33.348 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: a-bucket id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 num_objects: 0 size_kb: 0 num_shards: 1 2024-09-12T00:48:33.348 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:33.349 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 2 2024-09-12T00:48:33.380 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:33.380 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:33.416 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.417+0000 7f24cd414800 20 rados->read ofs=0 len=0 2024-09-12T00:48:33.418 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.419+0000 7f24cd414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:33.418 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.419+0000 7f24cd414800 20 realm 2024-09-12T00:48:33.418 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.419+0000 7f24cd414800 20 rados->read ofs=0 len=0 2024-09-12T00:48:33.418 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.419+0000 7f24cd414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:33.418 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.419+0000 7f24cd414800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:33.418 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.419+0000 7f24cd414800 20 rados->read ofs=0 len=0 2024-09-12T00:48:33.418 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.419+0000 7f24cd414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:33.418 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.419+0000 7f24cd414800 20 rados->read ofs=0 len=0 2024-09-12T00:48:33.419 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.420+0000 7f24cd414800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:33.419 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.420+0000 7f24cd414800 20 rados->read ofs=0 len=0 2024-09-12T00:48:33.420 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.421+0000 7f24cd414800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:33.420 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.421+0000 7f24cd414800 20 searching for the correct realm 2024-09-12T00:48:33.422 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.423+0000 7f24c92cc640 0 -- 172.21.15.73:0/1088332149 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f24b4046040 msgr2=0x7f24b4024410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:33.628 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.630+0000 7f24c92cc640 0 -- 172.21.15.73:0/1088332149 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f24b4046040 msgr2=0x7f24b4024410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:33.633 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.634+0000 7f24cd414800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:48:33.633 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.634+0000 7f24cd414800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:33.633 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.634+0000 7f24cd414800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:48:33.633 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.634+0000 7f24cd414800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:33.633 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.634+0000 7f24cd414800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:33.633 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.634+0000 7f24cd414800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:33.633 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.634+0000 7f24cd414800 20 rados->read ofs=0 len=0 2024-09-12T00:48:33.633 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.634+0000 7f24cd414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:33.633 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.634+0000 7f24cd414800 20 rados->read ofs=0 len=0 2024-09-12T00:48:33.634 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.634+0000 7f24cd414800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:33.635 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.634+0000 7f24cd414800 20 rados->read ofs=0 len=0 2024-09-12T00:48:33.635 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.635+0000 7f24cd414800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:33.635 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.635+0000 7f24cd414800 20 zone default found 2024-09-12T00:48:33.635 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.635+0000 7f24cd414800 4 Realm: () 2024-09-12T00:48:33.635 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.635+0000 7f24cd414800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:48:33.635 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.635+0000 7f24cd414800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:48:33.635 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.635+0000 7f24cd414800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:33.635 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.635+0000 7f24cd414800 20 zonegroup default 2024-09-12T00:48:33.635 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.635+0000 7f24cd414800 20 rados->read ofs=0 len=0 2024-09-12T00:48:33.635 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.635+0000 7f24cd414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:33.635 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.635+0000 7f24cd414800 20 rados->read ofs=0 len=0 2024-09-12T00:48:33.635 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.635+0000 7f24cd414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:33.635 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.635+0000 7f24cd414800 20 rados->read ofs=0 len=0 2024-09-12T00:48:33.635 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.635+0000 7f24cd414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:33.636 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.635+0000 7f24cd414800 20 started sync module instance, tier type = 2024-09-12T00:48:33.636 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.635+0000 7f24cd414800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:48:33.644 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.645+0000 7f24cd414800 20 add_watcher() i=0 2024-09-12T00:48:33.644 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.645+0000 7f24cd414800 20 add_watcher() i=1 2024-09-12T00:48:33.644 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.645+0000 7f24cd414800 20 add_watcher() i=2 2024-09-12T00:48:33.644 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.645+0000 7f24cd414800 20 add_watcher() i=3 2024-09-12T00:48:33.644 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.645+0000 7f24cd414800 20 add_watcher() i=4 2024-09-12T00:48:33.645 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.645+0000 7f24cd414800 20 add_watcher() i=5 2024-09-12T00:48:33.645 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.645+0000 7f24cd414800 20 add_watcher() i=6 2024-09-12T00:48:33.645 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.646+0000 7f24cd414800 20 add_watcher() i=7 2024-09-12T00:48:33.645 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.646+0000 7f24cd414800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:33.647 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.648+0000 7f237efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:33.647 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.648+0000 7f24cd414800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:33.648 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.648+0000 7f24cd414800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:33.648 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.648+0000 7f24cd414800 5 note: GC not initialized 2024-09-12T00:48:33.648 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.648+0000 7f237dfe3640 20 reqs_thread_entry: start 2024-09-12T00:48:33.648 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.648+0000 7f24cd414800 20 init_complete bucket index max shards: 1 2024-09-12T00:48:33.648 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.649+0000 7f24cd414800 20 Filter name: none 2024-09-12T00:48:33.648 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.649+0000 7f22ef7fe640 20 reqs_thread_entry: start 2024-09-12T00:48:33.648 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.649+0000 7f24cd414800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:48:33.648 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.649+0000 7f24cd414800 20 rados->read ofs=0 len=0 2024-09-12T00:48:33.649 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.649+0000 7f24cd414800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:48:33.649 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.649+0000 7f24cd414800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:48:33.650 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.649+0000 7f24cd414800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:48:33.650 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.649+0000 7f24cd414800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 : miss 2024-09-12T00:48:33.650 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.649+0000 7f24cd414800 20 rados->read ofs=0 len=0 2024-09-12T00:48:33.650 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.649+0000 7f24cd414800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:48:33.650 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.650+0000 7f24cd414800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:48:33.650 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.650+0000 7f24cd414800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:48:33.650 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.650+0000 7f24cd414800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:48:33.650 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.650+0000 7f24cd414800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:48:33.650 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.650+0000 7f24cd414800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 2024-09-12T00:48:33.651 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.652+0000 7f237efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:33.653 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.654+0000 7f24cd414800 20 remove_watcher() i=0 2024-09-12T00:48:33.653 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.654+0000 7f24cd414800 2 removed watcher, disabling cache 2024-09-12T00:48:33.654 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.656+0000 7f24cd414800 20 remove_watcher() i=1 2024-09-12T00:48:33.655 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.657+0000 7f24cd414800 20 remove_watcher() i=2 2024-09-12T00:48:33.656 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.658+0000 7f24cd414800 20 remove_watcher() i=3 2024-09-12T00:48:33.661 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.659+0000 7f24cd414800 20 remove_watcher() i=4 2024-09-12T00:48:33.662 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.660+0000 7f24cd414800 20 remove_watcher() i=5 2024-09-12T00:48:33.662 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.661+0000 7f24cd414800 20 remove_watcher() i=6 2024-09-12T00:48:33.662 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.661+0000 7f24cd414800 20 remove_watcher() i=7 2024-09-12T00:48:33.672 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin reshard list 2024-09-12T00:48:33.699 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:33.699 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:33.735 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.736+0000 7f01f9b40800 20 rados->read ofs=0 len=0 2024-09-12T00:48:33.737 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.738+0000 7f01f9b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:33.737 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.738+0000 7f01f9b40800 20 realm 2024-09-12T00:48:33.738 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.738+0000 7f01f9b40800 20 rados->read ofs=0 len=0 2024-09-12T00:48:33.738 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.738+0000 7f01f9b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:33.738 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.738+0000 7f01f9b40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:33.738 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.738+0000 7f01f9b40800 20 rados->read ofs=0 len=0 2024-09-12T00:48:33.738 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.738+0000 7f01f9b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:33.738 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.739+0000 7f01f9b40800 20 rados->read ofs=0 len=0 2024-09-12T00:48:33.739 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.740+0000 7f01f9b40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:33.739 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.740+0000 7f01f9b40800 20 rados->read ofs=0 len=0 2024-09-12T00:48:33.739 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.741+0000 7f01f9b40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:33.739 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.741+0000 7f01f9b40800 20 searching for the correct realm 2024-09-12T00:48:33.743 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.745+0000 7f01effff640 0 -- 172.21.15.73:0/457624083 >> [v2:172.21.15.117:6800/110688882,v1:172.21.15.117:6801/110688882] conn(0x5583fcc05550 msgr2=0x5583fcc07940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:33.747 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.748+0000 7f01effff640 0 -- 172.21.15.73:0/457624083 >> [v2:172.21.15.73:6826/269690776,v1:172.21.15.73:6827/269690776] conn(0x7f01e8013030 msgr2=0x7f01e804d920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:33.750 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.751+0000 7f01f9b40800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:48:33.750 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.751+0000 7f01f9b40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:33.750 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.751+0000 7f01f9b40800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:48:33.750 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.751+0000 7f01f9b40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:33.750 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.751+0000 7f01f9b40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:33.750 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.751+0000 7f01f9b40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:33.750 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.751+0000 7f01f9b40800 20 rados->read ofs=0 len=0 2024-09-12T00:48:33.750 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.751+0000 7f01f9b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:33.750 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.751+0000 7f01f9b40800 20 rados->read ofs=0 len=0 2024-09-12T00:48:33.752 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.751+0000 7f01f9b40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:33.752 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.751+0000 7f01f9b40800 20 rados->read ofs=0 len=0 2024-09-12T00:48:33.752 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.752+0000 7f01f9b40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:33.752 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.752+0000 7f01f9b40800 20 zone default found 2024-09-12T00:48:33.752 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.752+0000 7f01f9b40800 4 Realm: () 2024-09-12T00:48:33.752 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.752+0000 7f01f9b40800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:48:33.752 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.752+0000 7f01f9b40800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:48:33.752 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.752+0000 7f01f9b40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:33.752 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.752+0000 7f01f9b40800 20 zonegroup default 2024-09-12T00:48:33.752 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.752+0000 7f01f9b40800 20 rados->read ofs=0 len=0 2024-09-12T00:48:33.753 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.752+0000 7f01f9b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:33.753 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.752+0000 7f01f9b40800 20 rados->read ofs=0 len=0 2024-09-12T00:48:33.753 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.752+0000 7f01f9b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:33.753 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.752+0000 7f01f9b40800 20 rados->read ofs=0 len=0 2024-09-12T00:48:33.753 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.752+0000 7f01f9b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:33.753 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.752+0000 7f01f9b40800 20 started sync module instance, tier type = 2024-09-12T00:48:33.753 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.752+0000 7f01f9b40800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:48:33.760 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.761+0000 7f01f9b40800 20 add_watcher() i=0 2024-09-12T00:48:33.760 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.761+0000 7f01f9b40800 20 add_watcher() i=1 2024-09-12T00:48:33.760 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.761+0000 7f01f9b40800 20 add_watcher() i=2 2024-09-12T00:48:33.760 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.761+0000 7f01f9b40800 20 add_watcher() i=3 2024-09-12T00:48:33.760 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.761+0000 7f01f9b40800 20 add_watcher() i=4 2024-09-12T00:48:33.760 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.761+0000 7f01f9b40800 20 add_watcher() i=5 2024-09-12T00:48:33.760 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.761+0000 7f01f9b40800 20 add_watcher() i=6 2024-09-12T00:48:33.761 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.762+0000 7f01f9b40800 20 add_watcher() i=7 2024-09-12T00:48:33.761 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.762+0000 7f01f9b40800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:33.763 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.764+0000 7f00a77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:33.763 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.764+0000 7f01f9b40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:33.764 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.764+0000 7f01f9b40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:33.764 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.764+0000 7f01f9b40800 5 note: GC not initialized 2024-09-12T00:48:33.764 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.764+0000 7f00a67fc640 20 reqs_thread_entry: start 2024-09-12T00:48:33.764 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.765+0000 7f01f9b40800 20 init_complete bucket index max shards: 1 2024-09-12T00:48:33.764 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.765+0000 7f01f9b40800 20 Filter name: none 2024-09-12T00:48:33.764 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.765+0000 7f0017fff640 20 reqs_thread_entry: start 2024-09-12T00:48:33.770 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.771+0000 7f00a77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:33.772 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.773+0000 7f01f9b40800 20 remove_watcher() i=0 2024-09-12T00:48:33.772 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.773+0000 7f01f9b40800 2 removed watcher, disabling cache 2024-09-12T00:48:33.773 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.775+0000 7f01f9b40800 20 remove_watcher() i=1 2024-09-12T00:48:33.774 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.776+0000 7f01f9b40800 20 remove_watcher() i=2 2024-09-12T00:48:33.775 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.777+0000 7f01f9b40800 20 remove_watcher() i=3 2024-09-12T00:48:33.777 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.778+0000 7f01f9b40800 20 remove_watcher() i=4 2024-09-12T00:48:33.777 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.779+0000 7f01f9b40800 20 remove_watcher() i=5 2024-09-12T00:48:33.778 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.780+0000 7f01f9b40800 20 remove_watcher() i=6 2024-09-12T00:48:33.779 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.781+0000 7f01f9b40800 20 remove_watcher() i=7 2024-09-12T00:48:33.790 INFO:tasks.workunit.client.0.smithi073.stderr:bucket name a-bucket 2024-09-12T00:48:33.790 INFO:tasks.workunit.client.0.smithi073.stderr:TEST: reshard process 2024-09-12T00:48:33.790 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:33.791 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin reshard process 2024-09-12T00:48:33.818 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:33.818 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:33.856 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.858+0000 7f70f271f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:33.858 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.859+0000 7f70f271f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:33.858 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.859+0000 7f70f271f800 20 realm 2024-09-12T00:48:33.858 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.859+0000 7f70f271f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:33.858 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.859+0000 7f70f271f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:33.858 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.859+0000 7f70f271f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:33.859 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.859+0000 7f70f271f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:33.859 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.860+0000 7f70f271f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:33.859 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.860+0000 7f70f271f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:33.859 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.861+0000 7f70f271f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:33.859 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.861+0000 7f70f271f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:33.860 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.861+0000 7f70f271f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:33.860 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.861+0000 7f70f271f800 20 searching for the correct realm 2024-09-12T00:48:33.861 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:33.863+0000 7f70e7fff640 0 -- 172.21.15.73:0/409081721 >> [v2:172.21.15.73:6826/269690776,v1:172.21.15.73:6827/269690776] conn(0x7f70e0060740 msgr2=0x7f70e0062d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:34.068 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.070+0000 7f70ee4a2640 0 -- 172.21.15.73:0/409081721 >> [v2:172.21.15.73:6810/1807760270,v1:172.21.15.73:6811/1807760270] conn(0x7f70e802d060 msgr2=0x7f70e806d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:34.276 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.277+0000 7f70f271f800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:48:34.276 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.277+0000 7f70f271f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:34.276 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.277+0000 7f70f271f800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:48:34.276 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.277+0000 7f70f271f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:34.276 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.277+0000 7f70f271f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:34.276 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.277+0000 7f70f271f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:34.276 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.277+0000 7f70f271f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:34.276 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.277+0000 7f70f271f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:34.276 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.277+0000 7f70f271f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:34.278 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.277+0000 7f70f271f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:34.278 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.277+0000 7f70f271f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:34.278 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.278+0000 7f70f271f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:34.278 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.278+0000 7f70f271f800 20 zone default found 2024-09-12T00:48:34.278 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.278+0000 7f70f271f800 4 Realm: () 2024-09-12T00:48:34.278 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.278+0000 7f70f271f800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:48:34.278 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.278+0000 7f70f271f800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:48:34.278 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.278+0000 7f70f271f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:34.279 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.278+0000 7f70f271f800 20 zonegroup default 2024-09-12T00:48:34.279 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.278+0000 7f70f271f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:34.279 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.278+0000 7f70f271f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:34.279 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.278+0000 7f70f271f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:34.279 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.278+0000 7f70f271f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:34.279 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.278+0000 7f70f271f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:34.279 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.279+0000 7f70f271f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:34.279 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.279+0000 7f70f271f800 20 started sync module instance, tier type = 2024-09-12T00:48:34.279 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.279+0000 7f70f271f800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:48:34.287 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.288+0000 7f70f271f800 20 add_watcher() i=0 2024-09-12T00:48:34.287 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.288+0000 7f70f271f800 20 add_watcher() i=1 2024-09-12T00:48:34.287 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.288+0000 7f70f271f800 20 add_watcher() i=2 2024-09-12T00:48:34.287 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.288+0000 7f70f271f800 20 add_watcher() i=3 2024-09-12T00:48:34.287 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.288+0000 7f70f271f800 20 add_watcher() i=4 2024-09-12T00:48:34.287 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.288+0000 7f70f271f800 20 add_watcher() i=5 2024-09-12T00:48:34.287 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.288+0000 7f70f271f800 20 add_watcher() i=6 2024-09-12T00:48:34.288 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.289+0000 7f70f271f800 20 add_watcher() i=7 2024-09-12T00:48:34.288 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.289+0000 7f70f271f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:34.289 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.291+0000 7f6fa4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:34.290 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.291+0000 7f70f271f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:34.290 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.291+0000 7f70f271f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:34.290 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.291+0000 7f70f271f800 5 note: GC not initialized 2024-09-12T00:48:34.291 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.291+0000 7f6f1f7fe640 20 reqs_thread_entry: start 2024-09-12T00:48:34.291 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.291+0000 7f70f271f800 20 init_complete bucket index max shards: 1 2024-09-12T00:48:34.291 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.291+0000 7f70f271f800 20 Filter name: none 2024-09-12T00:48:34.291 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.292+0000 7f6f1d7fa640 20 reqs_thread_entry: start 2024-09-12T00:48:34.291 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.292+0000 7f70f271f800 20 processing logshard = reshard.0000000000 2024-09-12T00:48:34.293 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.294+0000 7f70f271f800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-12T00:48:34.293 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.294+0000 7f70f271f800 20 processing logshard = reshard.0000000001 2024-09-12T00:48:34.296 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.297+0000 7f70f271f800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-12T00:48:34.296 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.297+0000 7f70f271f800 20 processing logshard = reshard.0000000002 2024-09-12T00:48:34.298 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.300+0000 7f70f271f800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-12T00:48:34.298 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.300+0000 7f70f271f800 20 processing logshard = reshard.0000000003 2024-09-12T00:48:34.301 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.302+0000 7f70f271f800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-12T00:48:34.301 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.302+0000 7f70f271f800 20 processing logshard = reshard.0000000004 2024-09-12T00:48:34.303 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.305+0000 7f70f271f800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-12T00:48:34.303 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.305+0000 7f70f271f800 20 processing logshard = reshard.0000000005 2024-09-12T00:48:34.306 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.307+0000 7f70f271f800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-12T00:48:34.306 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.307+0000 7f70f271f800 20 processing logshard = reshard.0000000006 2024-09-12T00:48:34.308 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.309+0000 7f70f271f800 20 process_entry resharding a-bucket 2024-09-12T00:48:34.308 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.309+0000 7f70f271f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:48:34.308 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.309+0000 7f70f271f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:34.308 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.309+0000 7f70f271f800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:48:34.308 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.309+0000 7f70f271f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-12T00:48:34.308 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.309+0000 7f70f271f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:48:34.308 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.309+0000 7f70f271f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 : miss 2024-09-12T00:48:34.309 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.309+0000 7f70f271f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:34.309 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.310+0000 7f70f271f800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:48:34.309 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.310+0000 7f70f271f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:48:34.309 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.310+0000 7f70f271f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:48:34.309 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.310+0000 7f70f271f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:48:34.309 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.310+0000 7f70f271f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:48:34.310 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.310+0000 7f70f271f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 2024-09-12T00:48:34.313 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.315+0000 7f70f271f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:48:34.313 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.315+0000 7f70f271f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:48:34.313 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.315+0000 7f70f271f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:48:34.314 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.315+0000 7f70f271f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17, ofs0, ns] 2024-09-12T00:48:34.314 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.315+0000 7f6fd1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496982 cookie 94246370130944 notifier 6114 bl.length()=827 2024-09-12T00:48:34.314 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.315+0000 7f6fd1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:48:34.314 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.315+0000 7f6fd1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:48:34.314 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.315+0000 7f6fd1ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:48:34.315 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.317+0000 7f70f271f800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): orig_sources= new_sources= 2024-09-12T00:48:34.315 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.317+0000 7f70f271f800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): potential sources added=[] removed=[] 2024-09-12T00:48:34.315 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.317+0000 7f70f271f800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): orig_dests= new_dests= 2024-09-12T00:48:34.316 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.317+0000 7f70f271f800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): potential dests added=[] removed=[] 2024-09-12T00:48:34.318 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.319+0000 7f70f271f800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.1.0 2024-09-12T00:48:34.318 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.319+0000 7f70f271f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.1.0 2024-09-12T00:48:34.318 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.319+0000 7f70f271f800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.1.1 2024-09-12T00:48:34.318 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.319+0000 7f70f271f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.1.1 2024-09-12T00:48:34.318 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.319+0000 7f70f271f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.0 2024-09-12T00:48:34.319 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.320+0000 7f70f271f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 : hit (requested=0x17, cached=0x17) 2024-09-12T00:48:34.319 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.320+0000 7f70f271f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 2024-09-12T00:48:34.320 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.321+0000 7f70f271f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:48:34.320 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.321+0000 7f70f271f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:48:34.320 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.321+0000 7f70f271f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:48:34.320 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.321+0000 7f70f271f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17, ofs0, ns] 2024-09-12T00:48:34.320 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.321+0000 7f6fd17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496983 cookie 94246370130944 notifier 6114 bl.length()=827 2024-09-12T00:48:34.321 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.321+0000 7f6fd17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:48:34.321 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.321+0000 7f6fd17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:48:34.321 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.321+0000 7f6fd17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:48:34.321 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.323+0000 7f70f271f800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): orig_sources= new_sources= 2024-09-12T00:48:34.321 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.323+0000 7f70f271f800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): potential sources added=[] removed=[] 2024-09-12T00:48:34.321 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.323+0000 7f70f271f800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): orig_dests= new_dests= 2024-09-12T00:48:34.321 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.323+0000 7f70f271f800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): potential dests added=[] removed=[] 2024-09-12T00:48:34.323 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.324+0000 7f70f271f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.0 2024-09-12T00:48:34.323 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.324+0000 7f70f271f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 : hit (requested=0x17, cached=0x17) 2024-09-12T00:48:34.323 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.324+0000 7f70f271f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 2024-09-12T00:48:34.325 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.326+0000 7f70f271f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:48:34.325 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.326+0000 7f70f271f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:48:34.325 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.326+0000 7f70f271f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:48:34.325 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.326+0000 7f70f271f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17, ofs0, ns] 2024-09-12T00:48:34.325 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.326+0000 7f6fd1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496984 cookie 94246370130944 notifier 6114 bl.length()=795 2024-09-12T00:48:34.325 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.326+0000 7f6fd1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:48:34.325 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.326+0000 7f6fd1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:48:34.325 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.326+0000 7f6fd1ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:48:34.326 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.327+0000 7f70f271f800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): orig_sources= new_sources= 2024-09-12T00:48:34.326 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.327+0000 7f70f271f800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): potential sources added=[] removed=[] 2024-09-12T00:48:34.326 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.327+0000 7f70f271f800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): orig_dests= new_dests= 2024-09-12T00:48:34.326 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.327+0000 7f70f271f800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): potential dests added=[] removed=[] 2024-09-12T00:48:34.327 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.328+0000 7f70f271f800 1 execute INFO: reshard of bucket "a-bucket" from 1 shards to 2 shards completed successfully 2024-09-12T00:48:34.328 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.329+0000 7f70f271f800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-12T00:48:34.330 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.331+0000 7f70f271f800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-12T00:48:34.330 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.331+0000 7f70f271f800 20 processing logshard = reshard.0000000007 2024-09-12T00:48:34.332 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.334+0000 7f70f271f800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-12T00:48:34.332 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.334+0000 7f70f271f800 20 processing logshard = reshard.0000000008 2024-09-12T00:48:34.335 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.336+0000 7f70f271f800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-12T00:48:34.335 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.336+0000 7f70f271f800 20 processing logshard = reshard.0000000009 2024-09-12T00:48:34.338 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.339+0000 7f70f271f800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-12T00:48:34.338 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.339+0000 7f70f271f800 20 processing logshard = reshard.0000000010 2024-09-12T00:48:34.341 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.342+0000 7f70f271f800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-12T00:48:34.341 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.342+0000 7f70f271f800 20 processing logshard = reshard.0000000011 2024-09-12T00:48:34.343 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.345+0000 7f70f271f800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-12T00:48:34.343 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.345+0000 7f70f271f800 20 processing logshard = reshard.0000000012 2024-09-12T00:48:34.346 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.347+0000 7f70f271f800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-12T00:48:34.346 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.347+0000 7f70f271f800 20 processing logshard = reshard.0000000013 2024-09-12T00:48:34.349 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.350+0000 7f70f271f800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-12T00:48:34.349 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.350+0000 7f70f271f800 20 processing logshard = reshard.0000000014 2024-09-12T00:48:34.351 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.352+0000 7f70f271f800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-12T00:48:34.351 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.352+0000 7f70f271f800 20 processing logshard = reshard.0000000015 2024-09-12T00:48:34.354 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.355+0000 7f70f271f800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-12T00:48:34.354 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.356+0000 7f6fa4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:34.357 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.358+0000 7f70f271f800 20 remove_watcher() i=0 2024-09-12T00:48:34.357 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.358+0000 7f70f271f800 2 removed watcher, disabling cache 2024-09-12T00:48:34.358 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.359+0000 7f70f271f800 20 remove_watcher() i=1 2024-09-12T00:48:34.359 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.360+0000 7f70f271f800 20 remove_watcher() i=2 2024-09-12T00:48:34.360 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.361+0000 7f70f271f800 20 remove_watcher() i=3 2024-09-12T00:48:34.361 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.362+0000 7f70f271f800 20 remove_watcher() i=4 2024-09-12T00:48:34.361 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.363+0000 7f70f271f800 20 remove_watcher() i=5 2024-09-12T00:48:34.362 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.364+0000 7f70f271f800 20 remove_watcher() i=6 2024-09-12T00:48:34.363 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:34.365+0000 7f70f271f800 20 remove_watcher() i=7 2024-09-12T00:48:39.382 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:48:39.414 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:39.414 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:39.455 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.457+0000 7f9d4b146800 20 rados->read ofs=0 len=0 2024-09-12T00:48:39.457 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.458+0000 7f9d4b146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:39.457 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.458+0000 7f9d4b146800 20 realm 2024-09-12T00:48:39.457 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.458+0000 7f9d4b146800 20 rados->read ofs=0 len=0 2024-09-12T00:48:39.458 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.458+0000 7f9d4b146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:39.458 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.458+0000 7f9d4b146800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:39.458 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.458+0000 7f9d4b146800 20 rados->read ofs=0 len=0 2024-09-12T00:48:39.458 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.459+0000 7f9d4b146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:39.458 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.459+0000 7f9d4b146800 20 rados->read ofs=0 len=0 2024-09-12T00:48:39.458 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.460+0000 7f9d4b146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:39.458 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.460+0000 7f9d4b146800 20 rados->read ofs=0 len=0 2024-09-12T00:48:39.459 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.460+0000 7f9d4b146800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:39.459 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.460+0000 7f9d4b146800 20 searching for the correct realm 2024-09-12T00:48:39.462 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.463+0000 7f9d49438640 0 -- 172.21.15.73:0/3351968460 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f9d34057250 msgr2=0x7f9d340644b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:39.669 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.670+0000 7f9d48c37640 0 -- 172.21.15.73:0/3351968460 >> [v2:172.21.15.73:6810/1807760270,v1:172.21.15.73:6811/1807760270] conn(0x7f9d44042040 msgr2=0x7f9d44032420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:39.877 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.878+0000 7f9d4b146800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:48:39.877 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.878+0000 7f9d4b146800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:39.877 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.878+0000 7f9d4b146800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:48:39.877 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.878+0000 7f9d4b146800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:39.878 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.878+0000 7f9d4b146800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:39.878 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.878+0000 7f9d4b146800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:39.878 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.878+0000 7f9d4b146800 20 rados->read ofs=0 len=0 2024-09-12T00:48:39.878 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.878+0000 7f9d4b146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:39.878 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.878+0000 7f9d4b146800 20 rados->read ofs=0 len=0 2024-09-12T00:48:39.879 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.879+0000 7f9d4b146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:39.879 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.879+0000 7f9d4b146800 20 rados->read ofs=0 len=0 2024-09-12T00:48:39.879 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.879+0000 7f9d4b146800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:39.879 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.879+0000 7f9d4b146800 20 zone default found 2024-09-12T00:48:39.879 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.879+0000 7f9d4b146800 4 Realm: () 2024-09-12T00:48:39.879 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.879+0000 7f9d4b146800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:48:39.879 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.879+0000 7f9d4b146800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:48:39.880 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.879+0000 7f9d4b146800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:39.880 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.879+0000 7f9d4b146800 20 zonegroup default 2024-09-12T00:48:39.880 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.879+0000 7f9d4b146800 20 rados->read ofs=0 len=0 2024-09-12T00:48:39.880 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.880+0000 7f9d4b146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:39.880 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.880+0000 7f9d4b146800 20 rados->read ofs=0 len=0 2024-09-12T00:48:39.880 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.880+0000 7f9d4b146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:39.880 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.880+0000 7f9d4b146800 20 rados->read ofs=0 len=0 2024-09-12T00:48:39.880 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.880+0000 7f9d4b146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:39.881 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.880+0000 7f9d4b146800 20 started sync module instance, tier type = 2024-09-12T00:48:39.881 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.881+0000 7f9d4b146800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:48:39.891 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.892+0000 7f9d4b146800 20 add_watcher() i=0 2024-09-12T00:48:39.891 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.892+0000 7f9d4b146800 20 add_watcher() i=1 2024-09-12T00:48:39.891 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.892+0000 7f9d4b146800 20 add_watcher() i=2 2024-09-12T00:48:39.891 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.892+0000 7f9d4b146800 20 add_watcher() i=3 2024-09-12T00:48:39.891 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.892+0000 7f9d4b146800 20 add_watcher() i=4 2024-09-12T00:48:39.891 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.892+0000 7f9d4b146800 20 add_watcher() i=5 2024-09-12T00:48:39.891 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.892+0000 7f9d4b146800 20 add_watcher() i=6 2024-09-12T00:48:39.892 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.893+0000 7f9d4b146800 20 add_watcher() i=7 2024-09-12T00:48:39.892 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.893+0000 7f9d4b146800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:39.894 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.895+0000 7f9bfefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:39.895 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.896+0000 7f9d4b146800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:39.895 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.896+0000 7f9d4b146800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:39.895 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.896+0000 7f9d4b146800 5 note: GC not initialized 2024-09-12T00:48:39.895 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.896+0000 7f9bfdfe3640 20 reqs_thread_entry: start 2024-09-12T00:48:39.895 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.896+0000 7f9d4b146800 20 init_complete bucket index max shards: 1 2024-09-12T00:48:39.895 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.896+0000 7f9d4b146800 20 Filter name: none 2024-09-12T00:48:39.895 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.896+0000 7f9b6f7fe640 20 reqs_thread_entry: start 2024-09-12T00:48:39.895 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.896+0000 7f9d4b146800 20 rados->read ofs=0 len=0 2024-09-12T00:48:39.896 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.897+0000 7f9d4b146800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:48:39.896 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.897+0000 7f9d4b146800 20 rados->read ofs=0 len=0 2024-09-12T00:48:39.896 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.897+0000 7f9d4b146800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:48:39.897 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.897+0000 7f9d4b146800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:39.897 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.897+0000 7f9d4b146800 20 rados->read ofs=0 len=0 2024-09-12T00:48:39.897 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.898+0000 7f9d4b146800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:48:39.897 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.898+0000 7f9d4b146800 20 rados->read ofs=0 len=0 2024-09-12T00:48:39.897 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.898+0000 7f9d4b146800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:48:39.897 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.898+0000 7f9d4b146800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:39.898 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.900+0000 7f9bfefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:39.901 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.903+0000 7f9d4b146800 20 remove_watcher() i=0 2024-09-12T00:48:39.901 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.903+0000 7f9d4b146800 2 removed watcher, disabling cache 2024-09-12T00:48:39.902 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.904+0000 7f9d4b146800 20 remove_watcher() i=1 2024-09-12T00:48:39.904 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.905+0000 7f9d4b146800 20 remove_watcher() i=2 2024-09-12T00:48:39.905 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.906+0000 7f9d4b146800 20 remove_watcher() i=3 2024-09-12T00:48:39.906 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.907+0000 7f9d4b146800 20 remove_watcher() i=4 2024-09-12T00:48:39.907 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.909+0000 7f9d4b146800 20 remove_watcher() i=5 2024-09-12T00:48:39.908 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.910+0000 7f9d4b146800 20 remove_watcher() i=6 2024-09-12T00:48:39.910 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:39.911+0000 7f9d4b146800 20 remove_watcher() i=7 2024-09-12T00:48:39.922 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:39.922 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:48:39.922 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: a-bucket id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 num_objects: 0 size_kb: 0 num_shards: 2 2024-09-12T00:48:39.922 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:39.922 INFO:tasks.workunit.client.0.smithi073.stderr:TEST: reshard add non empty bucket 2024-09-12T00:48:39.922 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:39.926 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:39.927 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:39.967 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:39.967 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:40.001 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:40.002 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:40.036 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:40.036 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:40.070 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:40.070 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:40.105 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:40.105 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:40.139 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:40.139 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:40.174 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:40.174 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:40.207 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:48:40.236 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:40.236 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:40.273 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.274+0000 7ff3c0098800 20 rados->read ofs=0 len=0 2024-09-12T00:48:40.275 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.276+0000 7ff3c0098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:40.275 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.276+0000 7ff3c0098800 20 realm 2024-09-12T00:48:40.275 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.276+0000 7ff3c0098800 20 rados->read ofs=0 len=0 2024-09-12T00:48:40.275 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.276+0000 7ff3c0098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:40.275 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.276+0000 7ff3c0098800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:40.276 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.276+0000 7ff3c0098800 20 rados->read ofs=0 len=0 2024-09-12T00:48:40.276 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.276+0000 7ff3c0098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:40.276 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.276+0000 7ff3c0098800 20 rados->read ofs=0 len=0 2024-09-12T00:48:40.276 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.277+0000 7ff3c0098800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:40.276 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.277+0000 7ff3c0098800 20 rados->read ofs=0 len=0 2024-09-12T00:48:40.277 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.278+0000 7ff3c0098800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:40.277 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.278+0000 7ff3c0098800 20 searching for the correct realm 2024-09-12T00:48:40.279 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.281+0000 7ff3be38a640 0 -- 172.21.15.73:0/3563690586 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7ff3a8053040 msgr2=0x7ff3a8043460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:40.486 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.487+0000 7ff3be38a640 0 -- 172.21.15.73:0/3563690586 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7ff3a8053040 msgr2=0x7ff3a8043460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:40.490 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.491+0000 7ff3c0098800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:48:40.490 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.491+0000 7ff3c0098800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:40.490 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.491+0000 7ff3c0098800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:48:40.491 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.491+0000 7ff3c0098800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:40.491 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.491+0000 7ff3c0098800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:40.491 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.491+0000 7ff3c0098800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:40.491 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.491+0000 7ff3c0098800 20 rados->read ofs=0 len=0 2024-09-12T00:48:40.491 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.491+0000 7ff3c0098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:40.491 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.491+0000 7ff3c0098800 20 rados->read ofs=0 len=0 2024-09-12T00:48:40.491 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.492+0000 7ff3c0098800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:40.491 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.492+0000 7ff3c0098800 20 rados->read ofs=0 len=0 2024-09-12T00:48:40.492 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.492+0000 7ff3c0098800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:40.492 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.492+0000 7ff3c0098800 20 zone default found 2024-09-12T00:48:40.492 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.492+0000 7ff3c0098800 4 Realm: () 2024-09-12T00:48:40.492 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.492+0000 7ff3c0098800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:48:40.492 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.492+0000 7ff3c0098800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:48:40.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.492+0000 7ff3c0098800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:40.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.492+0000 7ff3c0098800 20 zonegroup default 2024-09-12T00:48:40.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.492+0000 7ff3c0098800 20 rados->read ofs=0 len=0 2024-09-12T00:48:40.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.492+0000 7ff3c0098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:40.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.492+0000 7ff3c0098800 20 rados->read ofs=0 len=0 2024-09-12T00:48:40.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.493+0000 7ff3c0098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:40.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.493+0000 7ff3c0098800 20 rados->read ofs=0 len=0 2024-09-12T00:48:40.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.493+0000 7ff3c0098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:40.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.493+0000 7ff3c0098800 20 started sync module instance, tier type = 2024-09-12T00:48:40.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.493+0000 7ff3c0098800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:48:40.501 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.502+0000 7ff3c0098800 20 add_watcher() i=0 2024-09-12T00:48:40.501 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.502+0000 7ff3c0098800 20 add_watcher() i=1 2024-09-12T00:48:40.501 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.502+0000 7ff3c0098800 20 add_watcher() i=2 2024-09-12T00:48:40.501 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.502+0000 7ff3c0098800 20 add_watcher() i=3 2024-09-12T00:48:40.501 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.502+0000 7ff3c0098800 20 add_watcher() i=4 2024-09-12T00:48:40.501 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.502+0000 7ff3c0098800 20 add_watcher() i=5 2024-09-12T00:48:40.501 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.502+0000 7ff3c0098800 20 add_watcher() i=6 2024-09-12T00:48:40.503 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.505+0000 7ff3c0098800 20 add_watcher() i=7 2024-09-12T00:48:40.504 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.505+0000 7ff3c0098800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:40.505 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.506+0000 7ff2577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:40.506 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.507+0000 7ff3c0098800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:40.506 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.507+0000 7ff3c0098800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:40.506 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.507+0000 7ff3c0098800 5 note: GC not initialized 2024-09-12T00:48:40.507 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.507+0000 7ff2567fc640 20 reqs_thread_entry: start 2024-09-12T00:48:40.507 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.507+0000 7ff3c0098800 20 init_complete bucket index max shards: 1 2024-09-12T00:48:40.507 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.507+0000 7ff3c0098800 20 Filter name: none 2024-09-12T00:48:40.507 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.507+0000 7ff1e3fff640 20 reqs_thread_entry: start 2024-09-12T00:48:40.507 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.507+0000 7ff3c0098800 20 rados->read ofs=0 len=0 2024-09-12T00:48:40.508 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.508+0000 7ff3c0098800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:48:40.508 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.508+0000 7ff3c0098800 20 rados->read ofs=0 len=0 2024-09-12T00:48:40.509 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.508+0000 7ff3c0098800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:48:40.509 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.508+0000 7ff3c0098800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:40.509 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.508+0000 7ff3c0098800 20 rados->read ofs=0 len=0 2024-09-12T00:48:40.509 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.509+0000 7ff3c0098800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:48:40.509 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.509+0000 7ff3c0098800 20 rados->read ofs=0 len=0 2024-09-12T00:48:40.509 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.509+0000 7ff3c0098800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:48:40.509 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.509+0000 7ff3c0098800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:40.510 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.510+0000 7ff2577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:40.511 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.513+0000 7ff3c0098800 20 remove_watcher() i=0 2024-09-12T00:48:40.511 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.513+0000 7ff3c0098800 2 removed watcher, disabling cache 2024-09-12T00:48:40.512 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.514+0000 7ff3c0098800 20 remove_watcher() i=1 2024-09-12T00:48:40.513 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.515+0000 7ff3c0098800 20 remove_watcher() i=2 2024-09-12T00:48:40.514 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.516+0000 7ff3c0098800 20 remove_watcher() i=3 2024-09-12T00:48:40.516 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.517+0000 7ff3c0098800 20 remove_watcher() i=4 2024-09-12T00:48:40.516 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.518+0000 7ff3c0098800 20 remove_watcher() i=5 2024-09-12T00:48:40.517 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.519+0000 7ff3c0098800 20 remove_watcher() i=6 2024-09-12T00:48:40.518 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.520+0000 7ff3c0098800 20 remove_watcher() i=7 2024-09-12T00:48:40.529 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:40.529 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:48:40.529 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: a-bucket id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 num_objects: 8 size_kb: 1 num_shards: 2 2024-09-12T00:48:40.529 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:40.530 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 3 2024-09-12T00:48:40.561 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:40.561 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:40.598 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.599+0000 7ff7c8b2e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:40.600 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.601+0000 7ff7c8b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:40.600 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.601+0000 7ff7c8b2e800 20 realm 2024-09-12T00:48:40.600 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.601+0000 7ff7c8b2e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:40.600 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.601+0000 7ff7c8b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:40.600 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.601+0000 7ff7c8b2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:40.600 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.601+0000 7ff7c8b2e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:40.600 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.601+0000 7ff7c8b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:40.601 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.601+0000 7ff7c8b2e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:40.601 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.602+0000 7ff7c8b2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:40.601 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.602+0000 7ff7c8b2e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:40.602 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.603+0000 7ff7c8b2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:40.602 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.603+0000 7ff7c8b2e800 20 searching for the correct realm 2024-09-12T00:48:40.606 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.607+0000 7ff7c50de640 0 -- 172.21.15.73:0/2602644410 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7ff7b0029060 msgr2=0x7ff7b007b150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:40.610 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.611+0000 7ff7c48dd640 0 -- 172.21.15.73:0/2602644410 >> [v2:172.21.15.117:6824/197320478,v1:172.21.15.117:6825/197320478] conn(0x5647a3cca3f0 msgr2=0x5647a3ccc8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:40.613 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.614+0000 7ff7c8b2e800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:48:40.613 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.614+0000 7ff7c8b2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:40.613 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.614+0000 7ff7c8b2e800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:48:40.613 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.614+0000 7ff7c8b2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:40.613 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.614+0000 7ff7c8b2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:40.613 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.614+0000 7ff7c8b2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:40.613 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.614+0000 7ff7c8b2e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:40.613 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.614+0000 7ff7c8b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:40.613 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.614+0000 7ff7c8b2e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:40.614 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.614+0000 7ff7c8b2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:40.615 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.614+0000 7ff7c8b2e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:40.615 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.615+0000 7ff7c8b2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:40.615 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.615+0000 7ff7c8b2e800 20 zone default found 2024-09-12T00:48:40.615 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.615+0000 7ff7c8b2e800 4 Realm: () 2024-09-12T00:48:40.615 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.615+0000 7ff7c8b2e800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:48:40.615 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.615+0000 7ff7c8b2e800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:48:40.615 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.615+0000 7ff7c8b2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:40.615 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.615+0000 7ff7c8b2e800 20 zonegroup default 2024-09-12T00:48:40.615 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.615+0000 7ff7c8b2e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:40.615 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.615+0000 7ff7c8b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:40.615 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.615+0000 7ff7c8b2e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:40.615 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.615+0000 7ff7c8b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:40.616 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.615+0000 7ff7c8b2e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:40.616 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.615+0000 7ff7c8b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:40.616 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.615+0000 7ff7c8b2e800 20 started sync module instance, tier type = 2024-09-12T00:48:40.616 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.615+0000 7ff7c8b2e800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:48:40.623 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.624+0000 7ff7c8b2e800 20 add_watcher() i=0 2024-09-12T00:48:40.623 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.624+0000 7ff7c8b2e800 20 add_watcher() i=1 2024-09-12T00:48:40.623 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.624+0000 7ff7c8b2e800 20 add_watcher() i=2 2024-09-12T00:48:40.623 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.624+0000 7ff7c8b2e800 20 add_watcher() i=3 2024-09-12T00:48:40.623 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.624+0000 7ff7c8b2e800 20 add_watcher() i=4 2024-09-12T00:48:40.624 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.624+0000 7ff7c8b2e800 20 add_watcher() i=5 2024-09-12T00:48:40.624 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.624+0000 7ff7c8b2e800 20 add_watcher() i=6 2024-09-12T00:48:40.624 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.625+0000 7ff7c8b2e800 20 add_watcher() i=7 2024-09-12T00:48:40.624 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.625+0000 7ff7c8b2e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:40.626 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.627+0000 7ff67afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:40.627 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.627+0000 7ff7c8b2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:40.627 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.627+0000 7ff7c8b2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:40.628 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.627+0000 7ff7c8b2e800 5 note: GC not initialized 2024-09-12T00:48:40.628 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.627+0000 7ff679fe3640 20 reqs_thread_entry: start 2024-09-12T00:48:40.628 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.628+0000 7ff7c8b2e800 20 init_complete bucket index max shards: 1 2024-09-12T00:48:40.628 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.628+0000 7ff7c8b2e800 20 Filter name: none 2024-09-12T00:48:40.628 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.628+0000 7ff5eb7fe640 20 reqs_thread_entry: start 2024-09-12T00:48:40.628 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.628+0000 7ff7c8b2e800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:48:40.628 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.628+0000 7ff7c8b2e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:40.628 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.628+0000 7ff7c8b2e800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:48:40.629 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.628+0000 7ff7c8b2e800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:48:40.629 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.628+0000 7ff7c8b2e800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:48:40.629 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.628+0000 7ff7c8b2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 : miss 2024-09-12T00:48:40.629 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.628+0000 7ff7c8b2e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:40.629 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.629+0000 7ff7c8b2e800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:48:40.629 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.629+0000 7ff7c8b2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:48:40.629 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.629+0000 7ff7c8b2e800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:48:40.629 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.629+0000 7ff7c8b2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:48:40.629 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.629+0000 7ff7c8b2e800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:48:40.629 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.629+0000 7ff7c8b2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 2024-09-12T00:48:40.630 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.630+0000 7ff67afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:40.632 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.633+0000 7ff7c8b2e800 20 remove_watcher() i=0 2024-09-12T00:48:40.632 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.633+0000 7ff7c8b2e800 2 removed watcher, disabling cache 2024-09-12T00:48:40.633 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.634+0000 7ff7c8b2e800 20 remove_watcher() i=1 2024-09-12T00:48:40.634 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.635+0000 7ff7c8b2e800 20 remove_watcher() i=2 2024-09-12T00:48:40.635 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.636+0000 7ff7c8b2e800 20 remove_watcher() i=3 2024-09-12T00:48:40.636 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.637+0000 7ff7c8b2e800 20 remove_watcher() i=4 2024-09-12T00:48:40.637 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.638+0000 7ff7c8b2e800 20 remove_watcher() i=5 2024-09-12T00:48:40.638 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.639+0000 7ff7c8b2e800 20 remove_watcher() i=6 2024-09-12T00:48:40.639 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.640+0000 7ff7c8b2e800 20 remove_watcher() i=7 2024-09-12T00:48:40.651 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin reshard list 2024-09-12T00:48:40.677 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:40.677 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:40.714 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.715+0000 7f071152f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:40.716 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.717+0000 7f071152f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:40.716 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.717+0000 7f071152f800 20 realm 2024-09-12T00:48:40.716 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.717+0000 7f071152f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:40.716 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.717+0000 7f071152f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:40.716 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.717+0000 7f071152f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:40.716 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.717+0000 7f071152f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:40.717 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.717+0000 7f071152f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:40.717 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.717+0000 7f071152f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:40.717 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.718+0000 7f071152f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:40.717 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.718+0000 7f071152f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:40.718 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.719+0000 7f071152f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:40.718 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.719+0000 7f071152f800 20 searching for the correct realm 2024-09-12T00:48:40.720 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.722+0000 7f070da1b640 0 -- 172.21.15.73:0/2934744798 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f06f80aea70 msgr2=0x7f06f80a4940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:40.926 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.928+0000 7f070da1b640 0 -- 172.21.15.73:0/2934744798 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f06f80aea70 msgr2=0x7f06f80a4940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:40.931 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.932+0000 7f071152f800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:48:40.931 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.932+0000 7f071152f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:40.931 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.932+0000 7f071152f800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:48:40.931 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.932+0000 7f071152f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:40.931 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.932+0000 7f071152f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:40.931 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.932+0000 7f071152f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:40.931 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.932+0000 7f071152f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:40.931 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.932+0000 7f071152f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:40.931 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.932+0000 7f071152f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:40.933 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.932+0000 7f071152f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:40.933 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.932+0000 7f071152f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:40.933 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.933+0000 7f071152f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:40.933 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.933+0000 7f071152f800 20 zone default found 2024-09-12T00:48:40.933 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.933+0000 7f071152f800 4 Realm: () 2024-09-12T00:48:40.933 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.933+0000 7f071152f800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:48:40.933 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.933+0000 7f071152f800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:48:40.933 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.933+0000 7f071152f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:40.933 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.933+0000 7f071152f800 20 zonegroup default 2024-09-12T00:48:40.933 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.933+0000 7f071152f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:40.934 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.933+0000 7f071152f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:40.934 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.933+0000 7f071152f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:40.934 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.933+0000 7f071152f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:40.934 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.933+0000 7f071152f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:40.934 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.933+0000 7f071152f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:40.934 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.933+0000 7f071152f800 20 started sync module instance, tier type = 2024-09-12T00:48:40.934 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.933+0000 7f071152f800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:48:40.942 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.943+0000 7f071152f800 20 add_watcher() i=0 2024-09-12T00:48:40.942 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.943+0000 7f071152f800 20 add_watcher() i=1 2024-09-12T00:48:40.942 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.943+0000 7f071152f800 20 add_watcher() i=2 2024-09-12T00:48:40.942 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.943+0000 7f071152f800 20 add_watcher() i=3 2024-09-12T00:48:40.942 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.943+0000 7f071152f800 20 add_watcher() i=4 2024-09-12T00:48:40.943 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.943+0000 7f071152f800 20 add_watcher() i=5 2024-09-12T00:48:40.943 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.943+0000 7f071152f800 20 add_watcher() i=6 2024-09-12T00:48:40.943 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.944+0000 7f071152f800 20 add_watcher() i=7 2024-09-12T00:48:40.943 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.944+0000 7f071152f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:40.945 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.946+0000 7f05c3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:40.945 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.946+0000 7f071152f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:40.945 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.946+0000 7f071152f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:40.945 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.946+0000 7f071152f800 5 note: GC not initialized 2024-09-12T00:48:40.945 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.946+0000 7f05c2fe5640 20 reqs_thread_entry: start 2024-09-12T00:48:40.946 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.946+0000 7f071152f800 20 init_complete bucket index max shards: 1 2024-09-12T00:48:40.946 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.946+0000 7f071152f800 20 Filter name: none 2024-09-12T00:48:40.946 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.946+0000 7f05c0fe1640 20 reqs_thread_entry: start 2024-09-12T00:48:40.951 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.953+0000 7f05c3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:40.954 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.955+0000 7f071152f800 20 remove_watcher() i=0 2024-09-12T00:48:40.954 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.955+0000 7f071152f800 2 removed watcher, disabling cache 2024-09-12T00:48:40.955 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.956+0000 7f071152f800 20 remove_watcher() i=1 2024-09-12T00:48:40.956 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.957+0000 7f071152f800 20 remove_watcher() i=2 2024-09-12T00:48:40.957 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.958+0000 7f071152f800 20 remove_watcher() i=3 2024-09-12T00:48:40.958 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.960+0000 7f071152f800 20 remove_watcher() i=4 2024-09-12T00:48:40.959 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.961+0000 7f071152f800 20 remove_watcher() i=5 2024-09-12T00:48:40.960 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.961+0000 7f071152f800 20 remove_watcher() i=6 2024-09-12T00:48:40.961 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:40.962+0000 7f071152f800 20 remove_watcher() i=7 2024-09-12T00:48:40.971 INFO:tasks.workunit.client.0.smithi073.stderr:bucket name a-bucket 2024-09-12T00:48:40.971 INFO:tasks.workunit.client.0.smithi073.stderr:TEST: reshard process non empty bucket 2024-09-12T00:48:40.971 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:40.973 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin reshard process 2024-09-12T00:48:40.999 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:40.999 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:41.037 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.038+0000 7f90bd123800 20 rados->read ofs=0 len=0 2024-09-12T00:48:41.038 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.039+0000 7f90bd123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:41.038 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.039+0000 7f90bd123800 20 realm 2024-09-12T00:48:41.038 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.039+0000 7f90bd123800 20 rados->read ofs=0 len=0 2024-09-12T00:48:41.038 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.039+0000 7f90bd123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:41.038 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.039+0000 7f90bd123800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:41.039 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.039+0000 7f90bd123800 20 rados->read ofs=0 len=0 2024-09-12T00:48:41.039 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.039+0000 7f90bd123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:41.039 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.039+0000 7f90bd123800 20 rados->read ofs=0 len=0 2024-09-12T00:48:41.039 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.041+0000 7f90bd123800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:41.040 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.041+0000 7f90bd123800 20 rados->read ofs=0 len=0 2024-09-12T00:48:41.040 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.041+0000 7f90bd123800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:41.040 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.041+0000 7f90bd123800 20 searching for the correct realm 2024-09-12T00:48:41.042 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.044+0000 7f90b9614640 0 -- 172.21.15.73:0/1428150238 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f90a0063040 msgr2=0x7f90a008e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:41.251 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.250+0000 7f90b9614640 0 -- 172.21.15.73:0/1428150238 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f90a0063040 msgr2=0x7f90a008e5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:41.253 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.254+0000 7f90bd123800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:48:41.253 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.254+0000 7f90bd123800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:41.253 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.254+0000 7f90bd123800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:48:41.254 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.254+0000 7f90bd123800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:41.254 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.254+0000 7f90bd123800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:41.254 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.254+0000 7f90bd123800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:41.254 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.254+0000 7f90bd123800 20 rados->read ofs=0 len=0 2024-09-12T00:48:41.254 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.255+0000 7f90bd123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:41.254 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.255+0000 7f90bd123800 20 rados->read ofs=0 len=0 2024-09-12T00:48:41.255 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.255+0000 7f90bd123800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:41.255 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.255+0000 7f90bd123800 20 rados->read ofs=0 len=0 2024-09-12T00:48:41.255 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.255+0000 7f90bd123800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:41.256 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.255+0000 7f90bd123800 20 zone default found 2024-09-12T00:48:41.256 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.255+0000 7f90bd123800 4 Realm: () 2024-09-12T00:48:41.256 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.255+0000 7f90bd123800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:48:41.256 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.255+0000 7f90bd123800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:48:41.256 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.255+0000 7f90bd123800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:41.256 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.255+0000 7f90bd123800 20 zonegroup default 2024-09-12T00:48:41.256 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.255+0000 7f90bd123800 20 rados->read ofs=0 len=0 2024-09-12T00:48:41.256 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.256+0000 7f90bd123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:41.256 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.256+0000 7f90bd123800 20 rados->read ofs=0 len=0 2024-09-12T00:48:41.256 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.256+0000 7f90bd123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:41.256 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.256+0000 7f90bd123800 20 rados->read ofs=0 len=0 2024-09-12T00:48:41.256 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.256+0000 7f90bd123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:41.256 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.256+0000 7f90bd123800 20 started sync module instance, tier type = 2024-09-12T00:48:41.257 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.256+0000 7f90bd123800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:48:41.264 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.266+0000 7f90bd123800 20 add_watcher() i=0 2024-09-12T00:48:41.265 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.266+0000 7f90bd123800 20 add_watcher() i=1 2024-09-12T00:48:41.265 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.266+0000 7f90bd123800 20 add_watcher() i=2 2024-09-12T00:48:41.265 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.266+0000 7f90bd123800 20 add_watcher() i=3 2024-09-12T00:48:41.265 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.266+0000 7f90bd123800 20 add_watcher() i=4 2024-09-12T00:48:41.265 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.266+0000 7f90bd123800 20 add_watcher() i=5 2024-09-12T00:48:41.265 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.266+0000 7f90bd123800 20 add_watcher() i=6 2024-09-12T00:48:41.265 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.267+0000 7f90bd123800 20 add_watcher() i=7 2024-09-12T00:48:41.265 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.267+0000 7f90bd123800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:41.267 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.268+0000 7f8f6f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:41.268 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.269+0000 7f90bd123800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:41.268 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.269+0000 7f90bd123800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:41.268 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.269+0000 7f90bd123800 5 note: GC not initialized 2024-09-12T00:48:41.268 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.269+0000 7f8f6e7e4640 20 reqs_thread_entry: start 2024-09-12T00:48:41.268 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.269+0000 7f90bd123800 20 init_complete bucket index max shards: 1 2024-09-12T00:48:41.268 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.269+0000 7f90bd123800 20 Filter name: none 2024-09-12T00:48:41.268 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.269+0000 7f8f67fff640 20 reqs_thread_entry: start 2024-09-12T00:48:41.268 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.269+0000 7f90bd123800 20 processing logshard = reshard.0000000000 2024-09-12T00:48:41.271 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.272+0000 7f90bd123800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-12T00:48:41.271 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.272+0000 7f90bd123800 20 processing logshard = reshard.0000000001 2024-09-12T00:48:41.273 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.275+0000 7f90bd123800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-12T00:48:41.274 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.275+0000 7f90bd123800 20 processing logshard = reshard.0000000002 2024-09-12T00:48:41.276 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.277+0000 7f90bd123800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-12T00:48:41.276 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.277+0000 7f90bd123800 20 processing logshard = reshard.0000000003 2024-09-12T00:48:41.278 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.280+0000 7f90bd123800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-12T00:48:41.278 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.280+0000 7f90bd123800 20 processing logshard = reshard.0000000004 2024-09-12T00:48:41.281 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.283+0000 7f90bd123800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-12T00:48:41.281 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.283+0000 7f90bd123800 20 processing logshard = reshard.0000000005 2024-09-12T00:48:41.283 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.285+0000 7f90bd123800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-12T00:48:41.284 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.285+0000 7f90bd123800 20 processing logshard = reshard.0000000006 2024-09-12T00:48:41.285 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.286+0000 7f90bd123800 20 process_entry resharding a-bucket 2024-09-12T00:48:41.285 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.286+0000 7f90bd123800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:48:41.285 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.286+0000 7f90bd123800 20 rados->read ofs=0 len=0 2024-09-12T00:48:41.286 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.287+0000 7f90bd123800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:48:41.286 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.287+0000 7f90bd123800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-12T00:48:41.286 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.287+0000 7f90bd123800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:48:41.286 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.287+0000 7f90bd123800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 : miss 2024-09-12T00:48:41.287 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.287+0000 7f90bd123800 20 rados->read ofs=0 len=0 2024-09-12T00:48:41.287 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.287+0000 7f90bd123800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:48:41.287 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.287+0000 7f90bd123800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:48:41.287 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.287+0000 7f90bd123800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:48:41.287 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.287+0000 7f90bd123800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:48:41.287 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.287+0000 7f90bd123800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:48:41.287 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.287+0000 7f90bd123800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 2024-09-12T00:48:41.292 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.293+0000 7f90bd123800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:48:41.292 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.293+0000 7f90bd123800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:48:41.292 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.293+0000 7f90bd123800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:48:41.292 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.293+0000 7f90bd123800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17, ofs0, ns] 2024-09-12T00:48:41.292 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.293+0000 7f8f8f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496985 cookie 94304117310880 notifier 6198 bl.length()=827 2024-09-12T00:48:41.292 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.293+0000 7f8f8f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:48:41.292 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.293+0000 7f8f8f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:48:41.292 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.293+0000 7f8f8f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:48:41.293 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.295+0000 7f90bd123800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): orig_sources= new_sources= 2024-09-12T00:48:41.293 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.295+0000 7f90bd123800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): potential sources added=[] removed=[] 2024-09-12T00:48:41.293 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.295+0000 7f90bd123800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): orig_dests= new_dests= 2024-09-12T00:48:41.293 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.295+0000 7f90bd123800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): potential dests added=[] removed=[] 2024-09-12T00:48:41.296 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.297+0000 7f90bd123800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.0 2024-09-12T00:48:41.296 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.297+0000 7f90bd123800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.0 2024-09-12T00:48:41.296 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.297+0000 7f90bd123800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.1 2024-09-12T00:48:41.296 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.297+0000 7f90bd123800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.1 2024-09-12T00:48:41.296 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.297+0000 7f90bd123800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.2 2024-09-12T00:48:41.296 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.297+0000 7f90bd123800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.2 2024-09-12T00:48:41.296 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.297+0000 7f90bd123800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.1.0 2024-09-12T00:48:41.296 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.297+0000 7f90bd123800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.1.0 2024-09-12T00:48:41.297 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.297+0000 7f90bd123800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.1.1 2024-09-12T00:48:41.297 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.297+0000 7f90bd123800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.1.1 2024-09-12T00:48:41.298 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.299+0000 7f90bd123800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 : hit (requested=0x17, cached=0x17) 2024-09-12T00:48:41.298 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.299+0000 7f90bd123800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 2024-09-12T00:48:41.299 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.300+0000 7f90bd123800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:48:41.300 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.300+0000 7f90bd123800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:48:41.300 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.300+0000 7f90bd123800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:48:41.300 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.300+0000 7f90bd123800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17, ofs0, ns] 2024-09-12T00:48:41.300 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.301+0000 7f8f8f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496986 cookie 94304117310880 notifier 6198 bl.length()=827 2024-09-12T00:48:41.300 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.301+0000 7f8f8f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:48:41.300 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.301+0000 7f8f8f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:48:41.300 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.301+0000 7f8f8f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:48:41.301 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.302+0000 7f90bd123800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): orig_sources= new_sources= 2024-09-12T00:48:41.301 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.302+0000 7f90bd123800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): potential sources added=[] removed=[] 2024-09-12T00:48:41.301 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.302+0000 7f90bd123800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): orig_dests= new_dests= 2024-09-12T00:48:41.301 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.302+0000 7f90bd123800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): potential dests added=[] removed=[] 2024-09-12T00:48:41.302 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.303+0000 7f90bd123800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.1.0 2024-09-12T00:48:41.302 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.303+0000 7f90bd123800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.1.0 2024-09-12T00:48:41.303 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.304+0000 7f90bd123800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.1.1 2024-09-12T00:48:41.303 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.304+0000 7f90bd123800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.1.1 2024-09-12T00:48:41.303 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.304+0000 7f90bd123800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 : hit (requested=0x17, cached=0x17) 2024-09-12T00:48:41.303 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.304+0000 7f90bd123800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 2024-09-12T00:48:41.304 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.305+0000 7f90bd123800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:48:41.304 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.305+0000 7f90bd123800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:48:41.304 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.305+0000 7f90bd123800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:48:41.304 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.305+0000 7f90bd123800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17, ofs0, ns] 2024-09-12T00:48:41.305 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.305+0000 7f8f8f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496987 cookie 94304117310880 notifier 6198 bl.length()=795 2024-09-12T00:48:41.305 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.305+0000 7f8f8f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:48:41.305 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.305+0000 7f8f8f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:48:41.305 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.305+0000 7f8f8f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:48:41.305 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.307+0000 7f90bd123800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): orig_sources= new_sources= 2024-09-12T00:48:41.305 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.307+0000 7f90bd123800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): potential sources added=[] removed=[] 2024-09-12T00:48:41.306 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.307+0000 7f90bd123800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): orig_dests= new_dests= 2024-09-12T00:48:41.306 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.307+0000 7f90bd123800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): potential dests added=[] removed=[] 2024-09-12T00:48:41.307 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.308+0000 7f90bd123800 1 execute INFO: reshard of bucket "a-bucket" from 2 shards to 3 shards completed successfully 2024-09-12T00:48:41.308 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.309+0000 7f90bd123800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-12T00:48:41.311 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.313+0000 7f90bd123800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-12T00:48:41.311 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.313+0000 7f90bd123800 20 processing logshard = reshard.0000000007 2024-09-12T00:48:41.314 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.315+0000 7f90bd123800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-12T00:48:41.314 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.315+0000 7f90bd123800 20 processing logshard = reshard.0000000008 2024-09-12T00:48:41.316 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.318+0000 7f90bd123800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-12T00:48:41.316 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.318+0000 7f90bd123800 20 processing logshard = reshard.0000000009 2024-09-12T00:48:41.319 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.320+0000 7f90bd123800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-12T00:48:41.319 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.320+0000 7f90bd123800 20 processing logshard = reshard.0000000010 2024-09-12T00:48:41.321 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.322+0000 7f90bd123800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-12T00:48:41.321 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.322+0000 7f90bd123800 20 processing logshard = reshard.0000000011 2024-09-12T00:48:41.323 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.325+0000 7f90bd123800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-12T00:48:41.323 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.325+0000 7f90bd123800 20 processing logshard = reshard.0000000012 2024-09-12T00:48:41.327 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.328+0000 7f90bd123800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-12T00:48:41.327 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.328+0000 7f90bd123800 20 processing logshard = reshard.0000000013 2024-09-12T00:48:41.329 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.331+0000 7f90bd123800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-12T00:48:41.329 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.331+0000 7f90bd123800 20 processing logshard = reshard.0000000014 2024-09-12T00:48:41.331 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.333+0000 7f90bd123800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-12T00:48:41.331 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.333+0000 7f90bd123800 20 processing logshard = reshard.0000000015 2024-09-12T00:48:41.334 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.336+0000 7f90bd123800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-12T00:48:41.335 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.336+0000 7f8f6f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:41.337 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.339+0000 7f90bd123800 20 remove_watcher() i=0 2024-09-12T00:48:41.338 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.339+0000 7f90bd123800 2 removed watcher, disabling cache 2024-09-12T00:48:41.338 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.340+0000 7f90bd123800 20 remove_watcher() i=1 2024-09-12T00:48:41.339 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.341+0000 7f90bd123800 20 remove_watcher() i=2 2024-09-12T00:48:41.341 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.342+0000 7f90bd123800 20 remove_watcher() i=3 2024-09-12T00:48:41.342 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.343+0000 7f90bd123800 20 remove_watcher() i=4 2024-09-12T00:48:41.342 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.344+0000 7f90bd123800 20 remove_watcher() i=5 2024-09-12T00:48:41.343 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.345+0000 7f90bd123800 20 remove_watcher() i=6 2024-09-12T00:48:41.344 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.346+0000 7f90bd123800 20 remove_watcher() i=7 2024-09-12T00:48:41.356 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:48:41.385 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:41.385 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:41.421 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.422+0000 7f0ad1740800 20 rados->read ofs=0 len=0 2024-09-12T00:48:41.424 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.425+0000 7f0ad1740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:41.424 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.425+0000 7f0ad1740800 20 realm 2024-09-12T00:48:41.424 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.425+0000 7f0ad1740800 20 rados->read ofs=0 len=0 2024-09-12T00:48:41.424 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.425+0000 7f0ad1740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:41.424 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.425+0000 7f0ad1740800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:41.424 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.425+0000 7f0ad1740800 20 rados->read ofs=0 len=0 2024-09-12T00:48:41.424 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.425+0000 7f0ad1740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:41.424 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.425+0000 7f0ad1740800 20 rados->read ofs=0 len=0 2024-09-12T00:48:41.425 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.426+0000 7f0ad1740800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:41.425 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.426+0000 7f0ad1740800 20 rados->read ofs=0 len=0 2024-09-12T00:48:41.425 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.427+0000 7f0ad1740800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:41.425 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.427+0000 7f0ad1740800 20 searching for the correct realm 2024-09-12T00:48:41.428 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.430+0000 7f0acd4c0640 0 -- 172.21.15.73:0/840116148 >> [v2:172.21.15.117:6816/1460498570,v1:172.21.15.117:6817/1460498570] conn(0x7f0ac8065a30 msgr2=0x7f0ac80644a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:41.432 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.433+0000 7f0acd4c0640 0 -- 172.21.15.73:0/840116148 >> [v2:172.21.15.117:6816/1460498570,v1:172.21.15.117:6817/1460498570] conn(0x7f0998086310 msgr2=0x7f0998088740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:48:41.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.437+0000 7f0ad1740800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:48:41.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.437+0000 7f0ad1740800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:41.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.437+0000 7f0ad1740800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:48:41.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.437+0000 7f0ad1740800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:41.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.437+0000 7f0ad1740800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:41.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.437+0000 7f0ad1740800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:41.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.437+0000 7f0ad1740800 20 rados->read ofs=0 len=0 2024-09-12T00:48:41.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.437+0000 7f0ad1740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:41.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.437+0000 7f0ad1740800 20 rados->read ofs=0 len=0 2024-09-12T00:48:41.438 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.437+0000 7f0ad1740800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:41.438 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.437+0000 7f0ad1740800 20 rados->read ofs=0 len=0 2024-09-12T00:48:41.438 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.438+0000 7f0ad1740800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:41.438 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.438+0000 7f0ad1740800 20 zone default found 2024-09-12T00:48:41.438 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.438+0000 7f0ad1740800 4 Realm: () 2024-09-12T00:48:41.438 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.438+0000 7f0ad1740800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:48:41.438 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.438+0000 7f0ad1740800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:48:41.438 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.438+0000 7f0ad1740800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:41.439 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.438+0000 7f0ad1740800 20 zonegroup default 2024-09-12T00:48:41.439 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.438+0000 7f0ad1740800 20 rados->read ofs=0 len=0 2024-09-12T00:48:41.439 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.438+0000 7f0ad1740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:41.439 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.438+0000 7f0ad1740800 20 rados->read ofs=0 len=0 2024-09-12T00:48:41.439 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.438+0000 7f0ad1740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:41.439 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.438+0000 7f0ad1740800 20 rados->read ofs=0 len=0 2024-09-12T00:48:41.439 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.439+0000 7f0ad1740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:41.439 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.439+0000 7f0ad1740800 20 started sync module instance, tier type = 2024-09-12T00:48:41.439 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.439+0000 7f0ad1740800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:48:41.446 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.447+0000 7f0ad1740800 20 add_watcher() i=0 2024-09-12T00:48:41.446 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.447+0000 7f0ad1740800 20 add_watcher() i=1 2024-09-12T00:48:41.446 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.447+0000 7f0ad1740800 20 add_watcher() i=2 2024-09-12T00:48:41.446 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.447+0000 7f0ad1740800 20 add_watcher() i=3 2024-09-12T00:48:41.447 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.447+0000 7f0ad1740800 20 add_watcher() i=4 2024-09-12T00:48:41.447 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.447+0000 7f0ad1740800 20 add_watcher() i=5 2024-09-12T00:48:41.447 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.447+0000 7f0ad1740800 20 add_watcher() i=6 2024-09-12T00:48:41.447 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.448+0000 7f0ad1740800 20 add_watcher() i=7 2024-09-12T00:48:41.447 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.448+0000 7f0ad1740800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:41.449 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.450+0000 7f09837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:41.449 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.450+0000 7f0ad1740800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:41.450 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.450+0000 7f0ad1740800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:41.450 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.450+0000 7f0ad1740800 5 note: GC not initialized 2024-09-12T00:48:41.450 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.450+0000 7f09827e4640 20 reqs_thread_entry: start 2024-09-12T00:48:41.450 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.451+0000 7f0ad1740800 20 init_complete bucket index max shards: 1 2024-09-12T00:48:41.450 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.451+0000 7f0ad1740800 20 Filter name: none 2024-09-12T00:48:41.450 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.451+0000 7f08f3fff640 20 reqs_thread_entry: start 2024-09-12T00:48:41.450 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.451+0000 7f0ad1740800 20 rados->read ofs=0 len=0 2024-09-12T00:48:41.451 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.452+0000 7f0ad1740800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:48:41.451 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.452+0000 7f0ad1740800 20 rados->read ofs=0 len=0 2024-09-12T00:48:41.451 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.452+0000 7f0ad1740800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:48:41.451 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.452+0000 7f0ad1740800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:41.451 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.452+0000 7f0ad1740800 20 rados->read ofs=0 len=0 2024-09-12T00:48:41.451 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.452+0000 7f0ad1740800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:48:41.451 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.452+0000 7f0ad1740800 20 rados->read ofs=0 len=0 2024-09-12T00:48:41.452 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.453+0000 7f0ad1740800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:48:41.452 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.453+0000 7f0ad1740800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:41.452 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.454+0000 7f09837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:41.455 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.456+0000 7f0ad1740800 20 remove_watcher() i=0 2024-09-12T00:48:41.455 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.456+0000 7f0ad1740800 2 removed watcher, disabling cache 2024-09-12T00:48:41.456 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.457+0000 7f0ad1740800 20 remove_watcher() i=1 2024-09-12T00:48:41.456 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.458+0000 7f0ad1740800 20 remove_watcher() i=2 2024-09-12T00:48:41.458 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.459+0000 7f0ad1740800 20 remove_watcher() i=3 2024-09-12T00:48:41.460 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.460+0000 7f0ad1740800 20 remove_watcher() i=4 2024-09-12T00:48:41.460 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.461+0000 7f0ad1740800 20 remove_watcher() i=5 2024-09-12T00:48:41.460 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.462+0000 7f0ad1740800 20 remove_watcher() i=6 2024-09-12T00:48:41.462 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:41.463+0000 7f0ad1740800 20 remove_watcher() i=7 2024-09-12T00:48:41.472 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:41.472 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:48:41.472 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: a-bucket id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 num_objects: 8 size_kb: 1 num_shards: 3 2024-09-12T00:48:41.472 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:41.472 INFO:tasks.workunit.client.0.smithi073.stderr:TEST: reshard bucket with EIO injected at init_index 2024-09-12T00:48:41.472 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:41.474 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:41.474 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:41.517 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:41.518 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:41.577 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:41.577 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:41.612 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:41.612 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:41.647 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:41.648 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:41.681 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:41.681 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:41.715 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:41.715 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:41.750 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:41.750 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:41.784 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:41.784 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:41.818 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:41.818 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:41.851 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:41.851 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:41.885 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:41.885 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:41.920 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:41.920 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:41.955 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:41.955 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:41.988 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:41.989 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:42.021 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:42.022 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:42.056 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:42.056 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:42.090 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:42.090 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:42.123 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:42.123 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:42.157 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:42.157 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:42.191 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:42.191 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:42.225 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:42.226 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:42.262 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:48:42.290 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:42.290 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:42.327 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.328+0000 7fabdfa40800 20 rados->read ofs=0 len=0 2024-09-12T00:48:42.330 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.329+0000 7fabdfa40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:42.330 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.329+0000 7fabdfa40800 20 realm 2024-09-12T00:48:42.330 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.329+0000 7fabdfa40800 20 rados->read ofs=0 len=0 2024-09-12T00:48:42.330 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.329+0000 7fabdfa40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:42.330 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.329+0000 7fabdfa40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:42.330 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.329+0000 7fabdfa40800 20 rados->read ofs=0 len=0 2024-09-12T00:48:42.330 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.330+0000 7fabdfa40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:42.330 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.330+0000 7fabdfa40800 20 rados->read ofs=0 len=0 2024-09-12T00:48:42.331 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.331+0000 7fabdfa40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:42.331 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.331+0000 7fabdfa40800 20 rados->read ofs=0 len=0 2024-09-12T00:48:42.331 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.331+0000 7fabdfa40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:42.331 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.331+0000 7fabdfa40800 20 searching for the correct realm 2024-09-12T00:48:42.333 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.334+0000 7fabddd2b640 0 -- 172.21.15.73:0/886076338 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fabc803e040 msgr2=0x7fabc8025420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:42.337 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.338+0000 7fabddd2b640 0 -- 172.21.15.73:0/886076338 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7faaa8086290 msgr2=0x7faaa80886c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:42.341 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.341+0000 7fabdfa40800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:48:42.341 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.341+0000 7fabdfa40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:42.342 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.341+0000 7fabdfa40800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:48:42.342 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.341+0000 7fabdfa40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:42.342 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.341+0000 7fabdfa40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:42.342 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.341+0000 7fabdfa40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:42.342 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.341+0000 7fabdfa40800 20 rados->read ofs=0 len=0 2024-09-12T00:48:42.342 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.342+0000 7fabdfa40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:42.342 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.342+0000 7fabdfa40800 20 rados->read ofs=0 len=0 2024-09-12T00:48:42.343 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.342+0000 7fabdfa40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:42.343 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.342+0000 7fabdfa40800 20 rados->read ofs=0 len=0 2024-09-12T00:48:42.344 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.342+0000 7fabdfa40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:42.344 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.342+0000 7fabdfa40800 20 zone default found 2024-09-12T00:48:42.344 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.342+0000 7fabdfa40800 4 Realm: () 2024-09-12T00:48:42.344 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.342+0000 7fabdfa40800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:48:42.344 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.342+0000 7fabdfa40800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:48:42.344 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.342+0000 7fabdfa40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:42.344 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.342+0000 7fabdfa40800 20 zonegroup default 2024-09-12T00:48:42.344 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.342+0000 7fabdfa40800 20 rados->read ofs=0 len=0 2024-09-12T00:48:42.344 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.342+0000 7fabdfa40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:42.344 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.343+0000 7fabdfa40800 20 rados->read ofs=0 len=0 2024-09-12T00:48:42.344 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.343+0000 7fabdfa40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:42.344 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.343+0000 7fabdfa40800 20 rados->read ofs=0 len=0 2024-09-12T00:48:42.345 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.343+0000 7fabdfa40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:42.345 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.343+0000 7fabdfa40800 20 started sync module instance, tier type = 2024-09-12T00:48:42.345 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.343+0000 7fabdfa40800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:48:42.352 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.352+0000 7fabdfa40800 20 add_watcher() i=0 2024-09-12T00:48:42.352 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.352+0000 7fabdfa40800 20 add_watcher() i=1 2024-09-12T00:48:42.352 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.352+0000 7fabdfa40800 20 add_watcher() i=2 2024-09-12T00:48:42.352 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.352+0000 7fabdfa40800 20 add_watcher() i=3 2024-09-12T00:48:42.352 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.352+0000 7fabdfa40800 20 add_watcher() i=4 2024-09-12T00:48:42.352 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.352+0000 7fabdfa40800 20 add_watcher() i=5 2024-09-12T00:48:42.352 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.352+0000 7fabdfa40800 20 add_watcher() i=6 2024-09-12T00:48:42.352 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.353+0000 7fabdfa40800 20 add_watcher() i=7 2024-09-12T00:48:42.353 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.353+0000 7fabdfa40800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:42.354 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.354+0000 7faa93fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:42.355 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.354+0000 7fabdfa40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:42.355 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.354+0000 7fabdfa40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:42.355 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.354+0000 7fabdfa40800 5 note: GC not initialized 2024-09-12T00:48:42.355 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.355+0000 7faa92fe5640 20 reqs_thread_entry: start 2024-09-12T00:48:42.355 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.355+0000 7fabdfa40800 20 init_complete bucket index max shards: 1 2024-09-12T00:48:42.355 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.355+0000 7fabdfa40800 20 Filter name: none 2024-09-12T00:48:42.355 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.355+0000 7faa90fe1640 20 reqs_thread_entry: start 2024-09-12T00:48:42.356 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.355+0000 7fabdfa40800 20 rados->read ofs=0 len=0 2024-09-12T00:48:42.357 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.356+0000 7fabdfa40800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:48:42.357 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.356+0000 7fabdfa40800 20 rados->read ofs=0 len=0 2024-09-12T00:48:42.357 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.356+0000 7fabdfa40800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:48:42.357 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.356+0000 7fabdfa40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:42.357 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.356+0000 7fabdfa40800 20 rados->read ofs=0 len=0 2024-09-12T00:48:42.357 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.356+0000 7fabdfa40800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:48:42.357 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.356+0000 7fabdfa40800 20 rados->read ofs=0 len=0 2024-09-12T00:48:42.357 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.357+0000 7fabdfa40800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:48:42.357 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.357+0000 7fabdfa40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:42.358 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.358+0000 7faa93fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:42.359 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.360+0000 7fabdfa40800 20 remove_watcher() i=0 2024-09-12T00:48:42.359 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.360+0000 7fabdfa40800 2 removed watcher, disabling cache 2024-09-12T00:48:42.360 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.361+0000 7fabdfa40800 20 remove_watcher() i=1 2024-09-12T00:48:42.361 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.362+0000 7fabdfa40800 20 remove_watcher() i=2 2024-09-12T00:48:42.362 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.362+0000 7fabdfa40800 20 remove_watcher() i=3 2024-09-12T00:48:42.363 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.364+0000 7fabdfa40800 20 remove_watcher() i=4 2024-09-12T00:48:42.364 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.365+0000 7fabdfa40800 20 remove_watcher() i=5 2024-09-12T00:48:42.365 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.365+0000 7fabdfa40800 20 remove_watcher() i=6 2024-09-12T00:48:42.366 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.366+0000 7fabdfa40800 20 remove_watcher() i=7 2024-09-12T00:48:42.377 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:42.377 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:48:42.377 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: error-at-init-index id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:48:42.377 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:42.378 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index 2024-09-12T00:48:42.412 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:42.413 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:42.450 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.450+0000 7fcd4f214800 20 rados->read ofs=0 len=0 2024-09-12T00:48:42.451 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.451+0000 7fcd4f214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:42.451 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.451+0000 7fcd4f214800 20 realm 2024-09-12T00:48:42.452 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.451+0000 7fcd4f214800 20 rados->read ofs=0 len=0 2024-09-12T00:48:42.452 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.452+0000 7fcd4f214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:42.452 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.452+0000 7fcd4f214800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:42.452 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.452+0000 7fcd4f214800 20 rados->read ofs=0 len=0 2024-09-12T00:48:42.452 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.452+0000 7fcd4f214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:42.452 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.452+0000 7fcd4f214800 20 rados->read ofs=0 len=0 2024-09-12T00:48:42.453 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.453+0000 7fcd4f214800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:42.453 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.453+0000 7fcd4f214800 20 rados->read ofs=0 len=0 2024-09-12T00:48:42.453 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.454+0000 7fcd4f214800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:42.453 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.454+0000 7fcd4f214800 20 searching for the correct realm 2024-09-12T00:48:42.455 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.456+0000 7fcd4b1e1640 0 -- 172.21.15.73:0/532863910 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fcd34086040 msgr2=0x7fcd34063460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:42.662 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.663+0000 7fcd4b1e1640 0 -- 172.21.15.73:0/532863910 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fcd34086040 msgr2=0x7fcd34063460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:42.666 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.666+0000 7fcd4f214800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:48:42.666 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.666+0000 7fcd4f214800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:42.667 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.666+0000 7fcd4f214800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:48:42.667 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.666+0000 7fcd4f214800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:42.667 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.666+0000 7fcd4f214800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:42.667 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.666+0000 7fcd4f214800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:42.667 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.666+0000 7fcd4f214800 20 rados->read ofs=0 len=0 2024-09-12T00:48:42.667 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.667+0000 7fcd4f214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:42.667 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.667+0000 7fcd4f214800 20 rados->read ofs=0 len=0 2024-09-12T00:48:42.668 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.667+0000 7fcd4f214800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:42.668 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.667+0000 7fcd4f214800 20 rados->read ofs=0 len=0 2024-09-12T00:48:42.669 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.667+0000 7fcd4f214800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:42.669 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.667+0000 7fcd4f214800 20 zone default found 2024-09-12T00:48:42.669 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.667+0000 7fcd4f214800 4 Realm: () 2024-09-12T00:48:42.669 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.667+0000 7fcd4f214800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:48:42.669 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.667+0000 7fcd4f214800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:48:42.669 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.667+0000 7fcd4f214800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:42.669 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.667+0000 7fcd4f214800 20 zonegroup default 2024-09-12T00:48:42.669 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.667+0000 7fcd4f214800 20 rados->read ofs=0 len=0 2024-09-12T00:48:42.669 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.667+0000 7fcd4f214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:42.669 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.668+0000 7fcd4f214800 20 rados->read ofs=0 len=0 2024-09-12T00:48:42.669 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.668+0000 7fcd4f214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:42.669 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.668+0000 7fcd4f214800 20 rados->read ofs=0 len=0 2024-09-12T00:48:42.669 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.668+0000 7fcd4f214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:42.670 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.668+0000 7fcd4f214800 20 started sync module instance, tier type = 2024-09-12T00:48:42.670 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.668+0000 7fcd4f214800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:48:42.677 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.677+0000 7fcd4f214800 20 add_watcher() i=0 2024-09-12T00:48:42.677 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.677+0000 7fcd4f214800 20 add_watcher() i=1 2024-09-12T00:48:42.677 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.677+0000 7fcd4f214800 20 add_watcher() i=2 2024-09-12T00:48:42.677 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.677+0000 7fcd4f214800 20 add_watcher() i=3 2024-09-12T00:48:42.677 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.677+0000 7fcd4f214800 20 add_watcher() i=4 2024-09-12T00:48:42.678 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.677+0000 7fcd4f214800 20 add_watcher() i=5 2024-09-12T00:48:42.678 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.677+0000 7fcd4f214800 20 add_watcher() i=6 2024-09-12T00:48:42.678 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.678+0000 7fcd4f214800 20 add_watcher() i=7 2024-09-12T00:48:42.678 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.678+0000 7fcd4f214800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:42.679 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.680+0000 7fcc017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:42.681 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.680+0000 7fcd4f214800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:42.681 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.680+0000 7fcd4f214800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:42.681 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.680+0000 7fcd4f214800 5 note: GC not initialized 2024-09-12T00:48:42.681 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.680+0000 7fcb7bfff640 20 reqs_thread_entry: start 2024-09-12T00:48:42.681 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.681+0000 7fcd4f214800 20 init_complete bucket index max shards: 1 2024-09-12T00:48:42.681 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.681+0000 7fcd4f214800 20 Filter name: none 2024-09-12T00:48:42.681 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.681+0000 7fcb79ffb640 20 reqs_thread_entry: start 2024-09-12T00:48:42.681 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.681+0000 7fcd4f214800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T00:48:42.681 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.681+0000 7fcd4f214800 20 rados->read ofs=0 len=0 2024-09-12T00:48:42.682 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.681+0000 7fcd4f214800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:48:42.682 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.681+0000 7fcd4f214800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T00:48:42.682 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.681+0000 7fcd4f214800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T00:48:42.682 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.681+0000 7fcd4f214800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19 : miss 2024-09-12T00:48:42.682 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.681+0000 7fcd4f214800 20 rados->read ofs=0 len=0 2024-09-12T00:48:42.683 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.682+0000 7fcd4f214800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:48:42.683 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.682+0000 7fcd4f214800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19 info.flags=0x17 2024-09-12T00:48:42.683 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.682+0000 7fcd4f214800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19 to cache LRU end 2024-09-12T00:48:42.683 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.682+0000 7fcd4f214800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:48:42.683 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.682+0000 7fcd4f214800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:42.683 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.682+0000 7fcd4f214800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19 2024-09-12T00:48:42.683 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.683+0000 7fcd4f214800 -1 Injecting error=-5 at location=init_index 2024-09-12T00:48:42.684 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.683+0000 7fcd4f214800 0 ERROR: init_target_index failed to initialize target index shard objects: (5) Input/output error 2024-09-12T00:48:42.684 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.685+0000 7fcc017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:42.688 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.687+0000 7fcd4f214800 20 remove_watcher() i=0 2024-09-12T00:48:42.688 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.687+0000 7fcd4f214800 2 removed watcher, disabling cache 2024-09-12T00:48:42.688 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.689+0000 7fcd4f214800 20 remove_watcher() i=1 2024-09-12T00:48:42.689 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.690+0000 7fcd4f214800 20 remove_watcher() i=2 2024-09-12T00:48:42.690 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.691+0000 7fcd4f214800 20 remove_watcher() i=3 2024-09-12T00:48:42.692 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.692+0000 7fcd4f214800 20 remove_watcher() i=4 2024-09-12T00:48:42.693 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.693+0000 7fcd4f214800 20 remove_watcher() i=5 2024-09-12T00:48:42.694 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.694+0000 7fcd4f214800 20 remove_watcher() i=6 2024-09-12T00:48:42.695 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.695+0000 7fcd4f214800 20 remove_watcher() i=7 2024-09-12T00:48:42.706 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:48:42.735 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:42.735 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:42.772 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.772+0000 7f6881c10800 20 rados->read ofs=0 len=0 2024-09-12T00:48:42.774 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.774+0000 7f6881c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:42.774 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.774+0000 7f6881c10800 20 realm 2024-09-12T00:48:42.774 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.774+0000 7f6881c10800 20 rados->read ofs=0 len=0 2024-09-12T00:48:42.774 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.774+0000 7f6881c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:42.774 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.774+0000 7f6881c10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:42.774 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.774+0000 7f6881c10800 20 rados->read ofs=0 len=0 2024-09-12T00:48:42.774 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.774+0000 7f6881c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:42.775 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.774+0000 7f6881c10800 20 rados->read ofs=0 len=0 2024-09-12T00:48:42.775 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.775+0000 7f6881c10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:42.775 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.775+0000 7f6881c10800 20 rados->read ofs=0 len=0 2024-09-12T00:48:42.776 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.776+0000 7f6881c10800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:42.776 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.776+0000 7f6881c10800 20 searching for the correct realm 2024-09-12T00:48:42.777 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.777+0000 7f6877fff640 0 -- 172.21.15.73:0/1304283109 >> [v2:172.21.15.73:6826/269690776,v1:172.21.15.73:6827/269690776] conn(0x7f6870049030 msgr2=0x7f6870049920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:48:42.982 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:42.983+0000 7f687d37a640 0 -- 172.21.15.73:0/1304283109 >> [v2:172.21.15.73:6810/1807760270,v1:172.21.15.73:6811/1807760270] conn(0x55a80c44ee00 msgr2=0x7f68780cda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:43.189 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.188+0000 7f6881c10800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:48:43.189 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.188+0000 7f6881c10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:43.189 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.188+0000 7f6881c10800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:48:43.189 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.188+0000 7f6881c10800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:43.189 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.188+0000 7f6881c10800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:43.189 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.188+0000 7f6881c10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:43.189 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.188+0000 7f6881c10800 20 rados->read ofs=0 len=0 2024-09-12T00:48:43.189 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.189+0000 7f6881c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:43.189 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.189+0000 7f6881c10800 20 rados->read ofs=0 len=0 2024-09-12T00:48:43.191 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.189+0000 7f6881c10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:43.191 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.189+0000 7f6881c10800 20 rados->read ofs=0 len=0 2024-09-12T00:48:43.191 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.190+0000 7f6881c10800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:43.191 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.190+0000 7f6881c10800 20 zone default found 2024-09-12T00:48:43.191 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.190+0000 7f6881c10800 4 Realm: () 2024-09-12T00:48:43.191 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.190+0000 7f6881c10800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:48:43.191 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.190+0000 7f6881c10800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:48:43.191 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.190+0000 7f6881c10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:43.191 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.190+0000 7f6881c10800 20 zonegroup default 2024-09-12T00:48:43.191 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.190+0000 7f6881c10800 20 rados->read ofs=0 len=0 2024-09-12T00:48:43.191 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.190+0000 7f6881c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:43.192 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.190+0000 7f6881c10800 20 rados->read ofs=0 len=0 2024-09-12T00:48:43.192 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.191+0000 7f6881c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:43.192 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.191+0000 7f6881c10800 20 rados->read ofs=0 len=0 2024-09-12T00:48:43.192 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.191+0000 7f6881c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:43.192 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.191+0000 7f6881c10800 20 started sync module instance, tier type = 2024-09-12T00:48:43.192 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.191+0000 7f6881c10800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:48:43.200 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.200+0000 7f6881c10800 20 add_watcher() i=0 2024-09-12T00:48:43.200 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.200+0000 7f6881c10800 20 add_watcher() i=1 2024-09-12T00:48:43.200 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.200+0000 7f6881c10800 20 add_watcher() i=2 2024-09-12T00:48:43.200 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.200+0000 7f6881c10800 20 add_watcher() i=3 2024-09-12T00:48:43.200 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.200+0000 7f6881c10800 20 add_watcher() i=4 2024-09-12T00:48:43.201 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.200+0000 7f6881c10800 20 add_watcher() i=5 2024-09-12T00:48:43.201 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.200+0000 7f6881c10800 20 add_watcher() i=6 2024-09-12T00:48:43.201 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.201+0000 7f6881c10800 20 add_watcher() i=7 2024-09-12T00:48:43.201 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.201+0000 7f6881c10800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:43.202 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.203+0000 7f67337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:43.203 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.203+0000 7f6881c10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:43.204 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.203+0000 7f6881c10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:43.204 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.203+0000 7f6881c10800 5 note: GC not initialized 2024-09-12T00:48:43.204 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.203+0000 7f67327e4640 20 reqs_thread_entry: start 2024-09-12T00:48:43.204 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.204+0000 7f6881c10800 20 init_complete bucket index max shards: 1 2024-09-12T00:48:43.204 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.204+0000 7f6881c10800 20 Filter name: none 2024-09-12T00:48:43.204 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.204+0000 7f66a3fff640 20 reqs_thread_entry: start 2024-09-12T00:48:43.204 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.204+0000 7f6881c10800 20 rados->read ofs=0 len=0 2024-09-12T00:48:43.205 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.204+0000 7f6881c10800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:48:43.205 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.204+0000 7f6881c10800 20 rados->read ofs=0 len=0 2024-09-12T00:48:43.205 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.205+0000 7f6881c10800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:48:43.206 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.205+0000 7f6881c10800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:43.206 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.205+0000 7f6881c10800 20 rados->read ofs=0 len=0 2024-09-12T00:48:43.206 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.205+0000 7f6881c10800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:48:43.206 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.205+0000 7f6881c10800 20 rados->read ofs=0 len=0 2024-09-12T00:48:43.206 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.206+0000 7f6881c10800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:48:43.206 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.206+0000 7f6881c10800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:43.207 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.207+0000 7f67337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:43.209 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.210+0000 7f6881c10800 20 remove_watcher() i=0 2024-09-12T00:48:43.209 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.210+0000 7f6881c10800 2 removed watcher, disabling cache 2024-09-12T00:48:43.210 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.211+0000 7f6881c10800 20 remove_watcher() i=1 2024-09-12T00:48:43.211 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.212+0000 7f6881c10800 20 remove_watcher() i=2 2024-09-12T00:48:43.212 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.213+0000 7f6881c10800 20 remove_watcher() i=3 2024-09-12T00:48:43.213 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.214+0000 7f6881c10800 20 remove_watcher() i=4 2024-09-12T00:48:43.214 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.215+0000 7f6881c10800 20 remove_watcher() i=5 2024-09-12T00:48:43.215 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.216+0000 7f6881c10800 20 remove_watcher() i=6 2024-09-12T00:48:43.217 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.217+0000 7f6881c10800 20 remove_watcher() i=7 2024-09-12T00:48:43.227 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:43.227 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:48:43.227 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: error-at-init-index id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:48:43.228 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:43.229 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:43.230 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:43.263 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:43.263 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:43.319 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:48:43.352 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:43.352 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:43.389 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.389+0000 7f13d9214800 20 rados->read ofs=0 len=0 2024-09-12T00:48:43.390 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.390+0000 7f13d9214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:43.390 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.390+0000 7f13d9214800 20 realm 2024-09-12T00:48:43.390 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.390+0000 7f13d9214800 20 rados->read ofs=0 len=0 2024-09-12T00:48:43.390 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.390+0000 7f13d9214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:43.391 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.390+0000 7f13d9214800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:43.391 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.390+0000 7f13d9214800 20 rados->read ofs=0 len=0 2024-09-12T00:48:43.391 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.390+0000 7f13d9214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:43.391 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.390+0000 7f13d9214800 20 rados->read ofs=0 len=0 2024-09-12T00:48:43.391 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.391+0000 7f13d9214800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:43.391 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.391+0000 7f13d9214800 20 rados->read ofs=0 len=0 2024-09-12T00:48:43.392 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.392+0000 7f13d9214800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:43.392 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.392+0000 7f13d9214800 20 searching for the correct realm 2024-09-12T00:48:43.394 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.395+0000 7f13d50cc640 0 -- 172.21.15.73:0/1688123199 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f13bc085040 msgr2=0x7f13bc071cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:43.600 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.600+0000 7f13d50cc640 0 -- 172.21.15.73:0/1688123199 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f13bc085040 msgr2=0x7f13bc071cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:43.604 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.605+0000 7f13d9214800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:48:43.605 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.605+0000 7f13d9214800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:43.605 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.605+0000 7f13d9214800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:48:43.605 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.605+0000 7f13d9214800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:43.605 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.605+0000 7f13d9214800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:43.605 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.605+0000 7f13d9214800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:43.605 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.605+0000 7f13d9214800 20 rados->read ofs=0 len=0 2024-09-12T00:48:43.605 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.605+0000 7f13d9214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:43.605 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.605+0000 7f13d9214800 20 rados->read ofs=0 len=0 2024-09-12T00:48:43.606 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.605+0000 7f13d9214800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:43.606 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.605+0000 7f13d9214800 20 rados->read ofs=0 len=0 2024-09-12T00:48:43.606 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.605+0000 7f13d9214800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:43.607 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.605+0000 7f13d9214800 20 zone default found 2024-09-12T00:48:43.607 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.605+0000 7f13d9214800 4 Realm: () 2024-09-12T00:48:43.607 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.605+0000 7f13d9214800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:48:43.607 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.605+0000 7f13d9214800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:48:43.607 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.605+0000 7f13d9214800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:43.607 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.605+0000 7f13d9214800 20 zonegroup default 2024-09-12T00:48:43.607 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.605+0000 7f13d9214800 20 rados->read ofs=0 len=0 2024-09-12T00:48:43.607 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.606+0000 7f13d9214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:43.607 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.606+0000 7f13d9214800 20 rados->read ofs=0 len=0 2024-09-12T00:48:43.607 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.606+0000 7f13d9214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:43.607 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.606+0000 7f13d9214800 20 rados->read ofs=0 len=0 2024-09-12T00:48:43.607 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.606+0000 7f13d9214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:43.608 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.606+0000 7f13d9214800 20 started sync module instance, tier type = 2024-09-12T00:48:43.608 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.606+0000 7f13d9214800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:48:43.615 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.615+0000 7f13d9214800 20 add_watcher() i=0 2024-09-12T00:48:43.615 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.615+0000 7f13d9214800 20 add_watcher() i=1 2024-09-12T00:48:43.616 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.615+0000 7f13d9214800 20 add_watcher() i=2 2024-09-12T00:48:43.616 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.615+0000 7f13d9214800 20 add_watcher() i=3 2024-09-12T00:48:43.616 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.615+0000 7f13d9214800 20 add_watcher() i=4 2024-09-12T00:48:43.616 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.615+0000 7f13d9214800 20 add_watcher() i=5 2024-09-12T00:48:43.616 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.615+0000 7f13d9214800 20 add_watcher() i=6 2024-09-12T00:48:43.616 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.616+0000 7f13d9214800 20 add_watcher() i=7 2024-09-12T00:48:43.616 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.616+0000 7f13d9214800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:43.618 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.618+0000 7f128afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:43.619 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.618+0000 7f13d9214800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:43.619 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.618+0000 7f13d9214800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:43.619 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.618+0000 7f13d9214800 5 note: GC not initialized 2024-09-12T00:48:43.619 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.619+0000 7f1289fe3640 20 reqs_thread_entry: start 2024-09-12T00:48:43.619 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.619+0000 7f13d9214800 20 init_complete bucket index max shards: 1 2024-09-12T00:48:43.619 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.619+0000 7f13d9214800 20 Filter name: none 2024-09-12T00:48:43.619 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.619+0000 7f11fb7fe640 20 reqs_thread_entry: start 2024-09-12T00:48:43.619 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.619+0000 7f13d9214800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T00:48:43.619 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.619+0000 7f13d9214800 20 rados->read ofs=0 len=0 2024-09-12T00:48:43.620 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.619+0000 7f13d9214800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:48:43.620 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.619+0000 7f13d9214800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T00:48:43.620 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.619+0000 7f13d9214800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T00:48:43.620 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.619+0000 7f13d9214800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19 : miss 2024-09-12T00:48:43.621 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.619+0000 7f13d9214800 20 rados->read ofs=0 len=0 2024-09-12T00:48:43.621 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.620+0000 7f13d9214800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:48:43.621 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.620+0000 7f13d9214800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19 info.flags=0x17 2024-09-12T00:48:43.621 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.620+0000 7f13d9214800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19 to cache LRU end 2024-09-12T00:48:43.621 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.620+0000 7f13d9214800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:48:43.621 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.620+0000 7f13d9214800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:43.621 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.620+0000 7f13d9214800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19 2024-09-12T00:48:43.624 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.624+0000 7f13d9214800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19 info.flags=0x17 2024-09-12T00:48:43.624 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.624+0000 7f13d9214800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19 to cache LRU end 2024-09-12T00:48:43.624 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.624+0000 7f13d9214800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:43.624 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.624+0000 7f13d9214800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19, ofs0, ns] 2024-09-12T00:48:43.624 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.624+0000 7f12abfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496981 cookie 93884944635552 notifier 5981 bl.length()=911 2024-09-12T00:48:43.624 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.624+0000 7f12abfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19 info.flags=0x17 2024-09-12T00:48:43.624 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.624+0000 7f12abfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19 to cache LRU end 2024-09-12T00:48:43.624 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.624+0000 7f12abfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:43.625 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.625+0000 7f13d9214800 20 handle_bi_update(): bucket=:error-at-init-index[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19]): orig_sources= new_sources= 2024-09-12T00:48:43.625 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.625+0000 7f13d9214800 20 handle_bi_update(): bucket=:error-at-init-index[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19]): potential sources added=[] removed=[] 2024-09-12T00:48:43.625 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.625+0000 7f13d9214800 20 handle_bi_update(): bucket=:error-at-init-index[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19]): orig_dests= new_dests= 2024-09-12T00:48:43.625 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.625+0000 7f13d9214800 20 handle_bi_update(): bucket=:error-at-init-index[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19]): potential dests added=[] removed=[] 2024-09-12T00:48:43.628 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.628+0000 7f13d9214800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19.1.0 2024-09-12T00:48:43.628 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.628+0000 7f13d9214800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19.1.0 2024-09-12T00:48:43.628 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.628+0000 7f13d9214800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19.1.1 2024-09-12T00:48:43.628 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.628+0000 7f13d9214800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19.1.1 2024-09-12T00:48:43.628 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.628+0000 7f13d9214800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19.0 2024-09-12T00:48:43.630 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.630+0000 7f13d9214800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19 : hit (requested=0x17, cached=0x17) 2024-09-12T00:48:43.630 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.630+0000 7f13d9214800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19 2024-09-12T00:48:43.632 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.632+0000 7f13d9214800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19 info.flags=0x17 2024-09-12T00:48:43.632 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.632+0000 7f13d9214800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19 to cache LRU end 2024-09-12T00:48:43.632 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.632+0000 7f13d9214800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:43.632 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.632+0000 7f13d9214800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19, ofs0, ns] 2024-09-12T00:48:43.632 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.632+0000 7f12abfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496982 cookie 93884944635552 notifier 5981 bl.length()=911 2024-09-12T00:48:43.632 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.632+0000 7f12abfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19 info.flags=0x17 2024-09-12T00:48:43.632 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.632+0000 7f12abfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19 to cache LRU end 2024-09-12T00:48:43.632 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.632+0000 7f12abfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:43.633 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.633+0000 7f13d9214800 20 handle_bi_update(): bucket=:error-at-init-index[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19]): orig_sources= new_sources= 2024-09-12T00:48:43.633 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.633+0000 7f13d9214800 20 handle_bi_update(): bucket=:error-at-init-index[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19]): potential sources added=[] removed=[] 2024-09-12T00:48:43.633 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.633+0000 7f13d9214800 20 handle_bi_update(): bucket=:error-at-init-index[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19]): orig_dests= new_dests= 2024-09-12T00:48:43.633 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.633+0000 7f13d9214800 20 handle_bi_update(): bucket=:error-at-init-index[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19]): potential dests added=[] removed=[] 2024-09-12T00:48:43.634 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.635+0000 7f13d9214800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19.0 2024-09-12T00:48:43.635 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.635+0000 7f13d9214800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19 : hit (requested=0x17, cached=0x17) 2024-09-12T00:48:43.635 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.635+0000 7f13d9214800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19 2024-09-12T00:48:43.636 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.636+0000 7f13d9214800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19 info.flags=0x17 2024-09-12T00:48:43.636 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.636+0000 7f13d9214800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19 to cache LRU end 2024-09-12T00:48:43.636 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.636+0000 7f13d9214800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:43.637 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.636+0000 7f13d9214800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19, ofs0, ns] 2024-09-12T00:48:43.637 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.637+0000 7f12abfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496983 cookie 93884944635552 notifier 5981 bl.length()=879 2024-09-12T00:48:43.637 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.637+0000 7f12abfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19 info.flags=0x17 2024-09-12T00:48:43.637 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.637+0000 7f12abfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19 to cache LRU end 2024-09-12T00:48:43.637 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.637+0000 7f12abfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:43.637 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.638+0000 7f13d9214800 20 handle_bi_update(): bucket=:error-at-init-index[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19]): orig_sources= new_sources= 2024-09-12T00:48:43.638 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.638+0000 7f13d9214800 20 handle_bi_update(): bucket=:error-at-init-index[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19]): potential sources added=[] removed=[] 2024-09-12T00:48:43.638 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.638+0000 7f13d9214800 20 handle_bi_update(): bucket=:error-at-init-index[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19]): orig_dests= new_dests= 2024-09-12T00:48:43.638 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.638+0000 7f13d9214800 20 handle_bi_update(): bucket=:error-at-init-index[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19]): potential dests added=[] removed=[] 2024-09-12T00:48:43.639 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.639+0000 7f13d9214800 1 execute INFO: reshard of bucket "error-at-init-index" from 1 shards to 2 shards completed successfully 2024-09-12T00:48:43.641 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.641+0000 7f128afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:43.643 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.643+0000 7f13d9214800 20 remove_watcher() i=0 2024-09-12T00:48:43.643 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.643+0000 7f13d9214800 2 removed watcher, disabling cache 2024-09-12T00:48:43.644 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.644+0000 7f13d9214800 20 remove_watcher() i=1 2024-09-12T00:48:43.645 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.645+0000 7f13d9214800 20 remove_watcher() i=2 2024-09-12T00:48:43.646 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.646+0000 7f13d9214800 20 remove_watcher() i=3 2024-09-12T00:48:43.647 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.648+0000 7f13d9214800 20 remove_watcher() i=4 2024-09-12T00:48:43.648 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.648+0000 7f13d9214800 20 remove_watcher() i=5 2024-09-12T00:48:43.649 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.649+0000 7f13d9214800 20 remove_watcher() i=6 2024-09-12T00:48:43.650 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.650+0000 7f13d9214800 20 remove_watcher() i=7 2024-09-12T00:48:43.662 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:48:43.691 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:43.691 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:43.727 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.727+0000 7f98ea936800 20 rados->read ofs=0 len=0 2024-09-12T00:48:43.729 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.729+0000 7f98ea936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:43.729 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.729+0000 7f98ea936800 20 realm 2024-09-12T00:48:43.729 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.729+0000 7f98ea936800 20 rados->read ofs=0 len=0 2024-09-12T00:48:43.729 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.729+0000 7f98ea936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:43.729 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.729+0000 7f98ea936800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:43.729 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.729+0000 7f98ea936800 20 rados->read ofs=0 len=0 2024-09-12T00:48:43.729 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.729+0000 7f98ea936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:43.729 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.729+0000 7f98ea936800 20 rados->read ofs=0 len=0 2024-09-12T00:48:43.730 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.730+0000 7f98ea936800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:43.730 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.730+0000 7f98ea936800 20 rados->read ofs=0 len=0 2024-09-12T00:48:43.731 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.731+0000 7f98ea936800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:43.731 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.731+0000 7f98ea936800 20 searching for the correct realm 2024-09-12T00:48:43.733 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.733+0000 7f98dffff640 0 -- 172.21.15.73:0/3641211225 >> [v2:172.21.15.73:6826/269690776,v1:172.21.15.73:6827/269690776] conn(0x7f98d806ac20 msgr2=0x7f98d804a4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:43.939 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:43.939+0000 7f98e66b7640 0 -- 172.21.15.73:0/3641211225 >> [v2:172.21.15.73:6810/1807760270,v1:172.21.15.73:6811/1807760270] conn(0x7f98e0067c20 msgr2=0x7f98e0086430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:44.146 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.145+0000 7f98ea936800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:48:44.146 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.145+0000 7f98ea936800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:44.146 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.145+0000 7f98ea936800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:48:44.147 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.145+0000 7f98ea936800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:44.147 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.145+0000 7f98ea936800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:44.147 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.145+0000 7f98ea936800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:44.147 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.145+0000 7f98ea936800 20 rados->read ofs=0 len=0 2024-09-12T00:48:44.147 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.146+0000 7f98ea936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:44.147 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.146+0000 7f98ea936800 20 rados->read ofs=0 len=0 2024-09-12T00:48:44.147 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.146+0000 7f98ea936800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:44.147 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.146+0000 7f98ea936800 20 rados->read ofs=0 len=0 2024-09-12T00:48:44.147 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.146+0000 7f98ea936800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:44.147 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.146+0000 7f98ea936800 20 zone default found 2024-09-12T00:48:44.147 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.146+0000 7f98ea936800 4 Realm: () 2024-09-12T00:48:44.147 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.146+0000 7f98ea936800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:48:44.147 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.146+0000 7f98ea936800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:48:44.148 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.146+0000 7f98ea936800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:44.148 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.146+0000 7f98ea936800 20 zonegroup default 2024-09-12T00:48:44.148 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.146+0000 7f98ea936800 20 rados->read ofs=0 len=0 2024-09-12T00:48:44.148 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.147+0000 7f98ea936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:44.148 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.147+0000 7f98ea936800 20 rados->read ofs=0 len=0 2024-09-12T00:48:44.148 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.147+0000 7f98ea936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:44.149 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.147+0000 7f98ea936800 20 rados->read ofs=0 len=0 2024-09-12T00:48:44.149 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.147+0000 7f98ea936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:44.149 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.147+0000 7f98ea936800 20 started sync module instance, tier type = 2024-09-12T00:48:44.149 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.147+0000 7f98ea936800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:48:44.157 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.157+0000 7f98ea936800 20 add_watcher() i=0 2024-09-12T00:48:44.157 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.157+0000 7f98ea936800 20 add_watcher() i=1 2024-09-12T00:48:44.157 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.157+0000 7f98ea936800 20 add_watcher() i=2 2024-09-12T00:48:44.157 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.157+0000 7f98ea936800 20 add_watcher() i=3 2024-09-12T00:48:44.157 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.157+0000 7f98ea936800 20 add_watcher() i=4 2024-09-12T00:48:44.157 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.157+0000 7f98ea936800 20 add_watcher() i=5 2024-09-12T00:48:44.158 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.157+0000 7f98ea936800 20 add_watcher() i=6 2024-09-12T00:48:44.158 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.158+0000 7f98ea936800 20 add_watcher() i=7 2024-09-12T00:48:44.158 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.158+0000 7f98ea936800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:44.160 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.159+0000 7f979cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:44.160 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.160+0000 7f98ea936800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:44.160 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.160+0000 7f98ea936800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:44.160 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.160+0000 7f98ea936800 5 note: GC not initialized 2024-09-12T00:48:44.160 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.160+0000 7f97177fe640 20 reqs_thread_entry: start 2024-09-12T00:48:44.161 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.160+0000 7f98ea936800 20 init_complete bucket index max shards: 1 2024-09-12T00:48:44.161 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.160+0000 7f98ea936800 20 Filter name: none 2024-09-12T00:48:44.161 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.160+0000 7f97157fa640 20 reqs_thread_entry: start 2024-09-12T00:48:44.161 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.160+0000 7f98ea936800 20 rados->read ofs=0 len=0 2024-09-12T00:48:44.162 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.161+0000 7f98ea936800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:48:44.162 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.161+0000 7f98ea936800 20 rados->read ofs=0 len=0 2024-09-12T00:48:44.162 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.161+0000 7f98ea936800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:48:44.162 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.161+0000 7f98ea936800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:44.162 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.161+0000 7f98ea936800 20 rados->read ofs=0 len=0 2024-09-12T00:48:44.162 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.162+0000 7f98ea936800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:48:44.162 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.162+0000 7f98ea936800 20 rados->read ofs=0 len=0 2024-09-12T00:48:44.162 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.162+0000 7f98ea936800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:48:44.162 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.162+0000 7f98ea936800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:44.163 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.163+0000 7f979cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:44.165 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.166+0000 7f98ea936800 20 remove_watcher() i=0 2024-09-12T00:48:44.165 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.166+0000 7f98ea936800 2 removed watcher, disabling cache 2024-09-12T00:48:44.166 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.167+0000 7f98ea936800 20 remove_watcher() i=1 2024-09-12T00:48:44.167 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.168+0000 7f98ea936800 20 remove_watcher() i=2 2024-09-12T00:48:44.169 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.169+0000 7f98ea936800 20 remove_watcher() i=3 2024-09-12T00:48:44.170 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.170+0000 7f98ea936800 20 remove_watcher() i=4 2024-09-12T00:48:44.171 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.171+0000 7f98ea936800 20 remove_watcher() i=5 2024-09-12T00:48:44.174 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.174+0000 7f98ea936800 20 remove_watcher() i=6 2024-09-12T00:48:44.174 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:44.175+0000 7f98ea936800 20 remove_watcher() i=7 2024-09-12T00:48:44.185 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:44.185 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:48:44.185 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: error-at-init-index id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:48:44.185 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:44.187 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:44.187 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:44.207 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:44.207 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:44.419 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:44.419 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:44.488 INFO:tasks.workunit.client.0.smithi073.stderr:TEST: reshard bucket with EOPNOTSUPP injected at init_index 2024-09-12T00:48:44.488 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:44.489 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:44.489 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:44.529 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:44.529 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:44.585 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:44.585 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:44.621 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:44.621 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:44.656 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:44.656 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:44.692 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:44.692 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:44.728 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:44.729 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:44.762 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:44.763 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:44.797 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:44.797 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:44.832 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:44.832 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:44.866 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:44.867 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:44.901 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:44.901 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:44.936 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:44.937 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:44.972 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:44.972 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:45.008 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:45.008 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:45.043 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:45.043 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:45.078 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:45.078 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:45.115 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:45.115 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:45.150 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:45.150 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:45.186 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:45.186 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:45.223 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:45.223 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:45.259 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:45.259 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:45.296 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:48:45.324 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:45.325 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:45.362 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.363+0000 7f544413a800 20 rados->read ofs=0 len=0 2024-09-12T00:48:45.364 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.364+0000 7f544413a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:45.364 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.364+0000 7f544413a800 20 realm 2024-09-12T00:48:45.365 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.364+0000 7f544413a800 20 rados->read ofs=0 len=0 2024-09-12T00:48:45.365 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.365+0000 7f544413a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:45.365 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.365+0000 7f544413a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:45.365 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.365+0000 7f544413a800 20 rados->read ofs=0 len=0 2024-09-12T00:48:45.365 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.365+0000 7f544413a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:45.365 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.365+0000 7f544413a800 20 rados->read ofs=0 len=0 2024-09-12T00:48:45.365 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.366+0000 7f544413a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:45.365 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.366+0000 7f544413a800 20 rados->read ofs=0 len=0 2024-09-12T00:48:45.366 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.366+0000 7f544413a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:45.366 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.366+0000 7f544413a800 20 searching for the correct realm 2024-09-12T00:48:45.368 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.368+0000 7f5440682640 0 -- 172.21.15.73:0/55402575 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f54280bd040 msgr2=0x7f54280a4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:48:45.574 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.574+0000 7f5440682640 0 -- 172.21.15.73:0/55402575 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f54280bd040 msgr2=0x7f54280a4790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:45.578 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.578+0000 7f544413a800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:48:45.578 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.578+0000 7f544413a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:45.578 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.578+0000 7f544413a800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:48:45.578 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.578+0000 7f544413a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:45.578 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.578+0000 7f544413a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:45.578 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.578+0000 7f544413a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:45.579 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.578+0000 7f544413a800 20 rados->read ofs=0 len=0 2024-09-12T00:48:45.579 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.578+0000 7f544413a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:45.579 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.578+0000 7f544413a800 20 rados->read ofs=0 len=0 2024-09-12T00:48:45.580 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.579+0000 7f544413a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:45.580 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.579+0000 7f544413a800 20 rados->read ofs=0 len=0 2024-09-12T00:48:45.580 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.579+0000 7f544413a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:45.580 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.579+0000 7f544413a800 20 zone default found 2024-09-12T00:48:45.581 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.579+0000 7f544413a800 4 Realm: () 2024-09-12T00:48:45.581 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.579+0000 7f544413a800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:48:45.581 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.579+0000 7f544413a800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:48:45.581 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.579+0000 7f544413a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:45.581 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.579+0000 7f544413a800 20 zonegroup default 2024-09-12T00:48:45.581 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.579+0000 7f544413a800 20 rados->read ofs=0 len=0 2024-09-12T00:48:45.581 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.579+0000 7f544413a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:45.581 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.579+0000 7f544413a800 20 rados->read ofs=0 len=0 2024-09-12T00:48:45.581 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.580+0000 7f544413a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:45.581 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.580+0000 7f544413a800 20 rados->read ofs=0 len=0 2024-09-12T00:48:45.581 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.580+0000 7f544413a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:45.581 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.580+0000 7f544413a800 20 started sync module instance, tier type = 2024-09-12T00:48:45.581 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.580+0000 7f544413a800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:48:45.592 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.592+0000 7f544413a800 20 add_watcher() i=0 2024-09-12T00:48:45.592 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.592+0000 7f544413a800 20 add_watcher() i=1 2024-09-12T00:48:45.592 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.592+0000 7f544413a800 20 add_watcher() i=2 2024-09-12T00:48:45.593 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.592+0000 7f544413a800 20 add_watcher() i=3 2024-09-12T00:48:45.593 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.592+0000 7f544413a800 20 add_watcher() i=4 2024-09-12T00:48:45.593 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.592+0000 7f544413a800 20 add_watcher() i=5 2024-09-12T00:48:45.593 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.592+0000 7f544413a800 20 add_watcher() i=6 2024-09-12T00:48:45.594 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.594+0000 7f544413a800 20 add_watcher() i=7 2024-09-12T00:48:45.594 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.594+0000 7f544413a800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:45.596 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.596+0000 7f52f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:45.597 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.596+0000 7f544413a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:45.597 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.596+0000 7f544413a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:45.597 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.596+0000 7f544413a800 5 note: GC not initialized 2024-09-12T00:48:45.597 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.597+0000 7f52f4fe1640 20 reqs_thread_entry: start 2024-09-12T00:48:45.597 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.597+0000 7f544413a800 20 init_complete bucket index max shards: 1 2024-09-12T00:48:45.597 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.597+0000 7f544413a800 20 Filter name: none 2024-09-12T00:48:45.597 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.597+0000 7f526e7fc640 20 reqs_thread_entry: start 2024-09-12T00:48:45.597 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.597+0000 7f544413a800 20 rados->read ofs=0 len=0 2024-09-12T00:48:45.598 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.597+0000 7f544413a800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:48:45.598 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.597+0000 7f544413a800 20 rados->read ofs=0 len=0 2024-09-12T00:48:45.598 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.598+0000 7f544413a800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:48:45.598 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.598+0000 7f544413a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:45.598 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.598+0000 7f544413a800 20 rados->read ofs=0 len=0 2024-09-12T00:48:45.599 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.598+0000 7f544413a800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:48:45.599 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.598+0000 7f544413a800 20 rados->read ofs=0 len=0 2024-09-12T00:48:45.599 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.599+0000 7f544413a800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:48:45.599 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.599+0000 7f544413a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:45.600 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.600+0000 7f52f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:45.602 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.602+0000 7f544413a800 20 remove_watcher() i=0 2024-09-12T00:48:45.602 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.602+0000 7f544413a800 2 removed watcher, disabling cache 2024-09-12T00:48:45.603 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.603+0000 7f544413a800 20 remove_watcher() i=1 2024-09-12T00:48:45.604 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.604+0000 7f544413a800 20 remove_watcher() i=2 2024-09-12T00:48:45.605 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.606+0000 7f544413a800 20 remove_watcher() i=3 2024-09-12T00:48:45.606 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.607+0000 7f544413a800 20 remove_watcher() i=4 2024-09-12T00:48:45.607 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.608+0000 7f544413a800 20 remove_watcher() i=5 2024-09-12T00:48:45.608 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.609+0000 7f544413a800 20 remove_watcher() i=6 2024-09-12T00:48:45.609 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.610+0000 7f544413a800 20 remove_watcher() i=7 2024-09-12T00:48:45.620 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:45.620 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:48:45.621 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: error-at-init-index id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.20 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:48:45.621 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:45.622 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index --inject-error-code 95 2024-09-12T00:48:45.658 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:45.658 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:45.695 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.696+0000 7f64a23af800 20 rados->read ofs=0 len=0 2024-09-12T00:48:45.697 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.697+0000 7f64a23af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:45.697 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.697+0000 7f64a23af800 20 realm 2024-09-12T00:48:45.697 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.697+0000 7f64a23af800 20 rados->read ofs=0 len=0 2024-09-12T00:48:45.697 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.697+0000 7f64a23af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:45.698 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.697+0000 7f64a23af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:45.698 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.697+0000 7f64a23af800 20 rados->read ofs=0 len=0 2024-09-12T00:48:45.698 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.698+0000 7f64a23af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:45.698 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.698+0000 7f64a23af800 20 rados->read ofs=0 len=0 2024-09-12T00:48:45.698 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.699+0000 7f64a23af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:45.698 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.699+0000 7f64a23af800 20 rados->read ofs=0 len=0 2024-09-12T00:48:45.699 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.699+0000 7f64a23af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:45.699 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.699+0000 7f64a23af800 20 searching for the correct realm 2024-09-12T00:48:45.701 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.702+0000 7f64a069a640 0 -- 172.21.15.73:0/3205599104 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f6494075070 msgr2=0x7f6494003440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:45.908 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.908+0000 7f64a069a640 0 -- 172.21.15.73:0/3205599104 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f6494075070 msgr2=0x7f6494003440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:45.913 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.912+0000 7f64a23af800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:48:45.913 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.912+0000 7f64a23af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:45.913 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.912+0000 7f64a23af800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:48:45.913 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.912+0000 7f64a23af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:45.913 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.912+0000 7f64a23af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:45.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.912+0000 7f64a23af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:45.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.912+0000 7f64a23af800 20 rados->read ofs=0 len=0 2024-09-12T00:48:45.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.912+0000 7f64a23af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:45.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.912+0000 7f64a23af800 20 rados->read ofs=0 len=0 2024-09-12T00:48:45.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.913+0000 7f64a23af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:45.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.913+0000 7f64a23af800 20 rados->read ofs=0 len=0 2024-09-12T00:48:45.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.913+0000 7f64a23af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:45.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.913+0000 7f64a23af800 20 zone default found 2024-09-12T00:48:45.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.913+0000 7f64a23af800 4 Realm: () 2024-09-12T00:48:45.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.913+0000 7f64a23af800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:48:45.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.913+0000 7f64a23af800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:48:45.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.913+0000 7f64a23af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:45.915 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.913+0000 7f64a23af800 20 zonegroup default 2024-09-12T00:48:45.915 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.913+0000 7f64a23af800 20 rados->read ofs=0 len=0 2024-09-12T00:48:45.915 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.913+0000 7f64a23af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:45.915 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.913+0000 7f64a23af800 20 rados->read ofs=0 len=0 2024-09-12T00:48:45.915 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.914+0000 7f64a23af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:45.915 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.914+0000 7f64a23af800 20 rados->read ofs=0 len=0 2024-09-12T00:48:45.915 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.914+0000 7f64a23af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:45.916 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.914+0000 7f64a23af800 20 started sync module instance, tier type = 2024-09-12T00:48:45.916 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.914+0000 7f64a23af800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:48:45.924 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.925+0000 7f64a23af800 20 add_watcher() i=0 2024-09-12T00:48:45.925 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.925+0000 7f64a23af800 20 add_watcher() i=1 2024-09-12T00:48:45.925 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.925+0000 7f64a23af800 20 add_watcher() i=2 2024-09-12T00:48:45.925 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.925+0000 7f64a23af800 20 add_watcher() i=3 2024-09-12T00:48:45.925 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.925+0000 7f64a23af800 20 add_watcher() i=4 2024-09-12T00:48:45.925 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.925+0000 7f64a23af800 20 add_watcher() i=5 2024-09-12T00:48:45.925 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.925+0000 7f64a23af800 20 add_watcher() i=6 2024-09-12T00:48:45.925 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.926+0000 7f64a23af800 20 add_watcher() i=7 2024-09-12T00:48:45.926 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.926+0000 7f64a23af800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:45.927 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.927+0000 7f6355fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:45.927 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.928+0000 7f64a23af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:45.928 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.928+0000 7f64a23af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:45.928 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.928+0000 7f64a23af800 5 note: GC not initialized 2024-09-12T00:48:45.929 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.928+0000 7f6354fe1640 20 reqs_thread_entry: start 2024-09-12T00:48:45.929 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.928+0000 7f64a23af800 20 init_complete bucket index max shards: 1 2024-09-12T00:48:45.929 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.928+0000 7f64a23af800 20 Filter name: none 2024-09-12T00:48:45.929 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.928+0000 7f62ce7fc640 20 reqs_thread_entry: start 2024-09-12T00:48:45.929 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.928+0000 7f64a23af800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T00:48:45.929 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.928+0000 7f64a23af800 20 rados->read ofs=0 len=0 2024-09-12T00:48:45.929 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.929+0000 7f64a23af800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:48:45.929 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.929+0000 7f64a23af800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T00:48:45.929 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.929+0000 7f64a23af800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T00:48:45.930 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.929+0000 7f64a23af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.20 : miss 2024-09-12T00:48:45.930 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.929+0000 7f64a23af800 20 rados->read ofs=0 len=0 2024-09-12T00:48:45.930 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.929+0000 7f64a23af800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:48:45.930 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.929+0000 7f64a23af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.20 info.flags=0x17 2024-09-12T00:48:45.930 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.929+0000 7f64a23af800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.20 to cache LRU end 2024-09-12T00:48:45.931 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.929+0000 7f64a23af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:48:45.931 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.929+0000 7f64a23af800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:45.931 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.930+0000 7f64a23af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.20 2024-09-12T00:48:45.931 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.931+0000 7f64a23af800 -1 Injecting error=-95 at location=init_index 2024-09-12T00:48:45.931 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.931+0000 7f64a23af800 0 WARNING: init_index() does not supported logrecord, falling back to block reshard mode. 2024-09-12T00:48:45.933 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.934+0000 7f64a23af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.20 info.flags=0x17 2024-09-12T00:48:45.934 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.934+0000 7f64a23af800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.20 to cache LRU end 2024-09-12T00:48:45.934 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.934+0000 7f64a23af800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:45.934 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.934+0000 7f64a23af800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.20, ofs0, ns] 2024-09-12T00:48:45.934 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.934+0000 7f637effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496988 cookie 94118239037280 notifier 6032 bl.length()=911 2024-09-12T00:48:45.934 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.934+0000 7f637effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.20 info.flags=0x17 2024-09-12T00:48:45.934 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.934+0000 7f637effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.20 to cache LRU end 2024-09-12T00:48:45.934 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.934+0000 7f637effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:45.935 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.935+0000 7f64a23af800 20 handle_bi_update(): bucket=:error-at-init-index[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.20]): orig_sources= new_sources= 2024-09-12T00:48:45.935 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.935+0000 7f64a23af800 20 handle_bi_update(): bucket=:error-at-init-index[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.20]): potential sources added=[] removed=[] 2024-09-12T00:48:45.935 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.935+0000 7f64a23af800 20 handle_bi_update(): bucket=:error-at-init-index[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.20]): orig_dests= new_dests= 2024-09-12T00:48:45.935 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.935+0000 7f64a23af800 20 handle_bi_update(): bucket=:error-at-init-index[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.20]): potential dests added=[] removed=[] 2024-09-12T00:48:45.936 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.936+0000 7f64a23af800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.20.1.0 2024-09-12T00:48:45.936 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.936+0000 7f64a23af800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.20.1.0 2024-09-12T00:48:45.937 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.937+0000 7f64a23af800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.20.1.1 2024-09-12T00:48:45.937 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.937+0000 7f64a23af800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.20.1.1 2024-09-12T00:48:45.937 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.937+0000 7f64a23af800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.20.0 2024-09-12T00:48:45.938 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.939+0000 7f64a23af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.20 : hit (requested=0x17, cached=0x17) 2024-09-12T00:48:45.938 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.939+0000 7f64a23af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.20 2024-09-12T00:48:45.940 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.940+0000 7f64a23af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.20 info.flags=0x17 2024-09-12T00:48:45.940 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.940+0000 7f64a23af800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.20 to cache LRU end 2024-09-12T00:48:45.940 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.940+0000 7f64a23af800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:45.940 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.940+0000 7f64a23af800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.20, ofs0, ns] 2024-09-12T00:48:45.940 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.940+0000 7f637e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496989 cookie 94118239037280 notifier 6032 bl.length()=879 2024-09-12T00:48:45.940 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.940+0000 7f637e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.20 info.flags=0x17 2024-09-12T00:48:45.940 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.940+0000 7f637e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.20 to cache LRU end 2024-09-12T00:48:45.941 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.940+0000 7f637e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:45.941 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.942+0000 7f64a23af800 20 handle_bi_update(): bucket=:error-at-init-index[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.20]): orig_sources= new_sources= 2024-09-12T00:48:45.941 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.942+0000 7f64a23af800 20 handle_bi_update(): bucket=:error-at-init-index[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.20]): potential sources added=[] removed=[] 2024-09-12T00:48:45.941 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.942+0000 7f64a23af800 20 handle_bi_update(): bucket=:error-at-init-index[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.20]): orig_dests= new_dests= 2024-09-12T00:48:45.941 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.942+0000 7f64a23af800 20 handle_bi_update(): bucket=:error-at-init-index[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.20]): potential dests added=[] removed=[] 2024-09-12T00:48:45.942 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.943+0000 7f64a23af800 1 execute INFO: reshard of bucket "error-at-init-index" from 1 shards to 2 shards completed successfully 2024-09-12T00:48:45.944 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.945+0000 7f6355fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:45.947 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.947+0000 7f64a23af800 20 remove_watcher() i=0 2024-09-12T00:48:45.947 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.947+0000 7f64a23af800 2 removed watcher, disabling cache 2024-09-12T00:48:45.948 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.948+0000 7f64a23af800 20 remove_watcher() i=1 2024-09-12T00:48:45.949 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.949+0000 7f64a23af800 20 remove_watcher() i=2 2024-09-12T00:48:45.950 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.950+0000 7f64a23af800 20 remove_watcher() i=3 2024-09-12T00:48:45.951 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.951+0000 7f64a23af800 20 remove_watcher() i=4 2024-09-12T00:48:45.952 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.952+0000 7f64a23af800 20 remove_watcher() i=5 2024-09-12T00:48:45.953 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.953+0000 7f64a23af800 20 remove_watcher() i=6 2024-09-12T00:48:45.954 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:45.954+0000 7f64a23af800 20 remove_watcher() i=7 2024-09-12T00:48:45.966 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:48:45.995 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:45.995 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:46.032 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.033+0000 7fee29815800 20 rados->read ofs=0 len=0 2024-09-12T00:48:46.034 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.034+0000 7fee29815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:46.034 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.034+0000 7fee29815800 20 realm 2024-09-12T00:48:46.034 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.034+0000 7fee29815800 20 rados->read ofs=0 len=0 2024-09-12T00:48:46.035 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.035+0000 7fee29815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:46.035 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.035+0000 7fee29815800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:46.035 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.035+0000 7fee29815800 20 rados->read ofs=0 len=0 2024-09-12T00:48:46.035 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.035+0000 7fee29815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:46.035 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.035+0000 7fee29815800 20 rados->read ofs=0 len=0 2024-09-12T00:48:46.035 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.036+0000 7fee29815800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:46.035 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.036+0000 7fee29815800 20 rados->read ofs=0 len=0 2024-09-12T00:48:46.036 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.037+0000 7fee29815800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:46.036 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.037+0000 7fee29815800 20 searching for the correct realm 2024-09-12T00:48:46.038 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.039+0000 7fee25793640 0 -- 172.21.15.73:0/1066123161 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fee10057020 msgr2=0x7fee1003aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:46.245 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.246+0000 7fee25793640 0 -- 172.21.15.73:0/1066123161 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fee10057020 msgr2=0x7fee1003aa80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:46.251 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.251+0000 7fee29815800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:48:46.251 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.251+0000 7fee29815800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:46.251 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.251+0000 7fee29815800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:48:46.251 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.251+0000 7fee29815800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:46.251 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.251+0000 7fee29815800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:46.251 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.251+0000 7fee29815800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:46.251 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.251+0000 7fee29815800 20 rados->read ofs=0 len=0 2024-09-12T00:48:46.251 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.251+0000 7fee29815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:46.252 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.251+0000 7fee29815800 20 rados->read ofs=0 len=0 2024-09-12T00:48:46.253 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.251+0000 7fee29815800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:46.253 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.251+0000 7fee29815800 20 rados->read ofs=0 len=0 2024-09-12T00:48:46.253 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.252+0000 7fee29815800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:46.253 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.252+0000 7fee29815800 20 zone default found 2024-09-12T00:48:46.253 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.252+0000 7fee29815800 4 Realm: () 2024-09-12T00:48:46.253 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.252+0000 7fee29815800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:48:46.253 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.252+0000 7fee29815800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:48:46.253 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.252+0000 7fee29815800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:46.253 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.252+0000 7fee29815800 20 zonegroup default 2024-09-12T00:48:46.254 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.252+0000 7fee29815800 20 rados->read ofs=0 len=0 2024-09-12T00:48:46.254 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.252+0000 7fee29815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:46.254 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.252+0000 7fee29815800 20 rados->read ofs=0 len=0 2024-09-12T00:48:46.254 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.252+0000 7fee29815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:46.254 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.252+0000 7fee29815800 20 rados->read ofs=0 len=0 2024-09-12T00:48:46.254 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.253+0000 7fee29815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:46.254 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.253+0000 7fee29815800 20 started sync module instance, tier type = 2024-09-12T00:48:46.254 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.253+0000 7fee29815800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:48:46.263 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.263+0000 7fee29815800 20 add_watcher() i=0 2024-09-12T00:48:46.263 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.263+0000 7fee29815800 20 add_watcher() i=1 2024-09-12T00:48:46.263 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.263+0000 7fee29815800 20 add_watcher() i=2 2024-09-12T00:48:46.263 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.263+0000 7fee29815800 20 add_watcher() i=3 2024-09-12T00:48:46.263 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.263+0000 7fee29815800 20 add_watcher() i=4 2024-09-12T00:48:46.264 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.263+0000 7fee29815800 20 add_watcher() i=5 2024-09-12T00:48:46.264 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.263+0000 7fee29815800 20 add_watcher() i=6 2024-09-12T00:48:46.264 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.264+0000 7fee29815800 20 add_watcher() i=7 2024-09-12T00:48:46.264 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.264+0000 7fee29815800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:46.265 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.266+0000 7fecdb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:46.267 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.266+0000 7fee29815800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:46.267 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.266+0000 7fee29815800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:46.267 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.266+0000 7fee29815800 5 note: GC not initialized 2024-09-12T00:48:46.267 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.266+0000 7fecda7e4640 20 reqs_thread_entry: start 2024-09-12T00:48:46.267 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.266+0000 7fee29815800 20 init_complete bucket index max shards: 1 2024-09-12T00:48:46.267 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.267+0000 7fee29815800 20 Filter name: none 2024-09-12T00:48:46.267 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.267+0000 7fecd3fff640 20 reqs_thread_entry: start 2024-09-12T00:48:46.268 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.267+0000 7fee29815800 20 rados->read ofs=0 len=0 2024-09-12T00:48:46.268 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.267+0000 7fee29815800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:48:46.268 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.267+0000 7fee29815800 20 rados->read ofs=0 len=0 2024-09-12T00:48:46.269 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.268+0000 7fee29815800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:48:46.269 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.268+0000 7fee29815800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:46.269 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.268+0000 7fee29815800 20 rados->read ofs=0 len=0 2024-09-12T00:48:46.269 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.268+0000 7fee29815800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:48:46.269 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.268+0000 7fee29815800 20 rados->read ofs=0 len=0 2024-09-12T00:48:46.269 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.269+0000 7fee29815800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:48:46.269 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.269+0000 7fee29815800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:46.270 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.270+0000 7fecdb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:46.272 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.272+0000 7fee29815800 20 remove_watcher() i=0 2024-09-12T00:48:46.272 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.272+0000 7fee29815800 2 removed watcher, disabling cache 2024-09-12T00:48:46.273 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.273+0000 7fee29815800 20 remove_watcher() i=1 2024-09-12T00:48:46.275 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.275+0000 7fee29815800 20 remove_watcher() i=2 2024-09-12T00:48:46.275 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.276+0000 7fee29815800 20 remove_watcher() i=3 2024-09-12T00:48:46.276 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.277+0000 7fee29815800 20 remove_watcher() i=4 2024-09-12T00:48:46.277 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.278+0000 7fee29815800 20 remove_watcher() i=5 2024-09-12T00:48:46.278 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.279+0000 7fee29815800 20 remove_watcher() i=6 2024-09-12T00:48:46.279 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:46.280+0000 7fee29815800 20 remove_watcher() i=7 2024-09-12T00:48:46.290 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:46.290 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:48:46.291 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: error-at-init-index id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.20 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-12T00:48:46.291 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:46.293 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:46.293 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:46.312 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:46.312 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:46.537 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:46.537 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:46.600 INFO:tasks.workunit.client.0.smithi073.stderr:TEST: reshard bucket with abort at init_index 2024-09-12T00:48:46.600 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:46.601 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:46.601 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:46.641 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:46.641 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:46.697 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:46.698 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:46.734 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:46.734 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:46.767 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:46.768 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:46.803 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:46.803 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:46.838 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:46.838 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:46.872 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:46.872 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:46.907 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:46.907 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:46.942 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:46.942 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:46.976 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:46.976 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:47.011 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:47.011 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:47.045 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:47.045 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:47.081 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:47.082 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:47.117 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:47.117 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:47.151 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:47.151 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:47.185 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:47.185 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:47.219 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:47.220 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:47.254 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:47.254 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:47.289 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:47.289 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:47.323 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:47.323 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:47.358 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:47.358 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:47.393 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T00:48:47.421 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:47.421 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:47.457 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:47.457+0000 7f3ac4b42800 20 rados->read ofs=0 len=0 2024-09-12T00:48:47.459 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:47.459+0000 7f3ac4b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:47.459 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:47.459+0000 7f3ac4b42800 20 realm 2024-09-12T00:48:47.459 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:47.459+0000 7f3ac4b42800 20 rados->read ofs=0 len=0 2024-09-12T00:48:47.459 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:47.459+0000 7f3ac4b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:47.459 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:47.459+0000 7f3ac4b42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:47.459 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:47.459+0000 7f3ac4b42800 20 rados->read ofs=0 len=0 2024-09-12T00:48:47.459 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:47.459+0000 7f3ac4b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:47.460 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:47.459+0000 7f3ac4b42800 20 rados->read ofs=0 len=0 2024-09-12T00:48:47.460 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:47.460+0000 7f3ac4b42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:47.460 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:47.460+0000 7f3ac4b42800 20 rados->read ofs=0 len=0 2024-09-12T00:48:47.461 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:47.461+0000 7f3ac4b42800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:47.461 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:47.461+0000 7f3ac4b42800 20 searching for the correct realm 2024-09-12T00:48:47.663 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:47.664+0000 7f3ac1087640 0 -- 172.21.15.73:0/1794043226 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f3aac032070 msgr2=0x7f3aac0685f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:48:48.071 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.071+0000 7f3ac1087640 0 -- 172.21.15.73:0/1794043226 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f3aac032070 msgr2=0x7f3aac0685f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:48.076 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.076+0000 7f3ac4b42800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:48:48.076 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.076+0000 7f3ac4b42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:48.076 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.076+0000 7f3ac4b42800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:48:48.076 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.076+0000 7f3ac4b42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:48.076 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.076+0000 7f3ac4b42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:48.077 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.076+0000 7f3ac4b42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:48.077 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.076+0000 7f3ac4b42800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.077 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.076+0000 7f3ac4b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:48.077 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.076+0000 7f3ac4b42800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.078 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.077+0000 7f3ac4b42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:48.078 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.077+0000 7f3ac4b42800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.078 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.077+0000 7f3ac4b42800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:48.078 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.077+0000 7f3ac4b42800 20 zone default found 2024-09-12T00:48:48.078 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.077+0000 7f3ac4b42800 4 Realm: () 2024-09-12T00:48:48.078 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.077+0000 7f3ac4b42800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:48:48.078 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.077+0000 7f3ac4b42800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:48:48.078 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.077+0000 7f3ac4b42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:48.078 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.077+0000 7f3ac4b42800 20 zonegroup default 2024-09-12T00:48:48.079 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.077+0000 7f3ac4b42800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.079 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.078+0000 7f3ac4b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:48.079 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.078+0000 7f3ac4b42800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.079 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.078+0000 7f3ac4b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:48.079 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.078+0000 7f3ac4b42800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.079 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.079+0000 7f3ac4b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:48.079 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.079+0000 7f3ac4b42800 20 started sync module instance, tier type = 2024-09-12T00:48:48.080 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.079+0000 7f3ac4b42800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:48:48.089 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.089+0000 7f3ac4b42800 20 add_watcher() i=0 2024-09-12T00:48:48.089 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.089+0000 7f3ac4b42800 20 add_watcher() i=1 2024-09-12T00:48:48.089 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.089+0000 7f3ac4b42800 20 add_watcher() i=2 2024-09-12T00:48:48.089 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.089+0000 7f3ac4b42800 20 add_watcher() i=3 2024-09-12T00:48:48.089 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.089+0000 7f3ac4b42800 20 add_watcher() i=4 2024-09-12T00:48:48.090 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.089+0000 7f3ac4b42800 20 add_watcher() i=5 2024-09-12T00:48:48.090 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.089+0000 7f3ac4b42800 20 add_watcher() i=6 2024-09-12T00:48:48.090 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.090+0000 7f3ac4b42800 20 add_watcher() i=7 2024-09-12T00:48:48.090 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.090+0000 7f3ac4b42800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:48.092 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.092+0000 7f39777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:48.092 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.093+0000 7f3ac4b42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:48.093 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.093+0000 7f3ac4b42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:48.093 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.093+0000 7f3ac4b42800 5 note: GC not initialized 2024-09-12T00:48:48.097 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.093+0000 7f39767e4640 20 reqs_thread_entry: start 2024-09-12T00:48:48.097 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.093+0000 7f3ac4b42800 20 init_complete bucket index max shards: 1 2024-09-12T00:48:48.097 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.093+0000 7f3ac4b42800 20 Filter name: none 2024-09-12T00:48:48.097 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.093+0000 7f396f7fe640 20 reqs_thread_entry: start 2024-09-12T00:48:48.097 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.093+0000 7f3ac4b42800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.098 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.094+0000 7f3ac4b42800 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:48:48.098 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.094+0000 7f3ac4b42800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.098 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.095+0000 7f3ac4b42800 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:48:48.098 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.095+0000 7f3ac4b42800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:48.098 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.095+0000 7f3ac4b42800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.098 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.095+0000 7f3ac4b42800 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:48:48.098 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.095+0000 7f3ac4b42800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.098 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.096+0000 7f3ac4b42800 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:48:48.098 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.096+0000 7f3ac4b42800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:48.098 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.097+0000 7f39777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:48.099 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.100+0000 7f3ac4b42800 20 remove_watcher() i=0 2024-09-12T00:48:48.099 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.100+0000 7f3ac4b42800 2 removed watcher, disabling cache 2024-09-12T00:48:48.101 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.101+0000 7f3ac4b42800 20 remove_watcher() i=1 2024-09-12T00:48:48.102 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.102+0000 7f3ac4b42800 20 remove_watcher() i=2 2024-09-12T00:48:48.103 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.104+0000 7f3ac4b42800 20 remove_watcher() i=3 2024-09-12T00:48:48.104 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.105+0000 7f3ac4b42800 20 remove_watcher() i=4 2024-09-12T00:48:48.105 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.106+0000 7f3ac4b42800 20 remove_watcher() i=5 2024-09-12T00:48:48.107 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.107+0000 7f3ac4b42800 20 remove_watcher() i=6 2024-09-12T00:48:48.108 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.108+0000 7f3ac4b42800 20 remove_watcher() i=7 2024-09-12T00:48:48.120 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:48.120 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:48:48.121 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: abort-at-init-indext id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:48:48.121 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:48.122 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at init_index 2024-09-12T00:48:48.158 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:48.158 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:48.198 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.198+0000 7f3e9312c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.200 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.200+0000 7f3e9312c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:48.200 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.200+0000 7f3e9312c800 20 realm 2024-09-12T00:48:48.200 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.200+0000 7f3e9312c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.200 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.200+0000 7f3e9312c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:48.200 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.200+0000 7f3e9312c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:48.201 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.200+0000 7f3e9312c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.201 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.200+0000 7f3e9312c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:48.201 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.200+0000 7f3e9312c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.201 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.201+0000 7f3e9312c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:48.201 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.202+0000 7f3e9312c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.202 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.202+0000 7f3e9312c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:48.202 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.202+0000 7f3e9312c800 20 searching for the correct realm 2024-09-12T00:48:48.205 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.205+0000 7f3e8f562640 0 -- 172.21.15.73:0/1364781717 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f3e84018070 msgr2=0x7f3e84089d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:48.412 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.413+0000 7f3e8f562640 0 -- 172.21.15.73:0/1364781717 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f3e84018070 msgr2=0x7f3e84089d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:48.417 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.417+0000 7f3e9312c800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:48:48.417 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.417+0000 7f3e9312c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:48.418 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.417+0000 7f3e9312c800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:48:48.418 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.417+0000 7f3e9312c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:48.418 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.417+0000 7f3e9312c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:48.418 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.417+0000 7f3e9312c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:48.418 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.417+0000 7f3e9312c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.418 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.417+0000 7f3e9312c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:48.418 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.417+0000 7f3e9312c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.418 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.418+0000 7f3e9312c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:48.418 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.418+0000 7f3e9312c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.419 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.418+0000 7f3e9312c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:48.419 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.418+0000 7f3e9312c800 20 zone default found 2024-09-12T00:48:48.419 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.418+0000 7f3e9312c800 4 Realm: () 2024-09-12T00:48:48.420 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.418+0000 7f3e9312c800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:48:48.420 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.418+0000 7f3e9312c800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:48:48.420 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.418+0000 7f3e9312c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:48.420 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.418+0000 7f3e9312c800 20 zonegroup default 2024-09-12T00:48:48.420 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.418+0000 7f3e9312c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.420 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.418+0000 7f3e9312c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:48.420 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.418+0000 7f3e9312c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.420 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.419+0000 7f3e9312c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:48.420 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.419+0000 7f3e9312c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.420 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.419+0000 7f3e9312c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:48.420 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.419+0000 7f3e9312c800 20 started sync module instance, tier type = 2024-09-12T00:48:48.420 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.419+0000 7f3e9312c800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:48:48.428 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.428+0000 7f3e9312c800 20 add_watcher() i=0 2024-09-12T00:48:48.428 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.428+0000 7f3e9312c800 20 add_watcher() i=1 2024-09-12T00:48:48.428 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.428+0000 7f3e9312c800 20 add_watcher() i=2 2024-09-12T00:48:48.428 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.428+0000 7f3e9312c800 20 add_watcher() i=3 2024-09-12T00:48:48.428 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.428+0000 7f3e9312c800 20 add_watcher() i=4 2024-09-12T00:48:48.428 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.428+0000 7f3e9312c800 20 add_watcher() i=5 2024-09-12T00:48:48.428 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.428+0000 7f3e9312c800 20 add_watcher() i=6 2024-09-12T00:48:48.429 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.429+0000 7f3e9312c800 20 add_watcher() i=7 2024-09-12T00:48:48.429 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.429+0000 7f3e9312c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:48.430 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.431+0000 7f3d457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:48.431 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.431+0000 7f3e9312c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:48.431 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.431+0000 7f3e9312c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:48.432 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.431+0000 7f3e9312c800 5 note: GC not initialized 2024-09-12T00:48:48.432 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.431+0000 7f3cbffff640 20 reqs_thread_entry: start 2024-09-12T00:48:48.432 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.432+0000 7f3e9312c800 20 init_complete bucket index max shards: 1 2024-09-12T00:48:48.432 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.432+0000 7f3e9312c800 20 Filter name: none 2024-09-12T00:48:48.432 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.432+0000 7f3cbdffb640 20 reqs_thread_entry: start 2024-09-12T00:48:48.432 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.432+0000 7f3e9312c800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:48:48.432 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.432+0000 7f3e9312c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.433 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.432+0000 7f3e9312c800 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:48:48.433 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.432+0000 7f3e9312c800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:48:48.433 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.432+0000 7f3e9312c800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:48:48.433 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.432+0000 7f3e9312c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21 : miss 2024-09-12T00:48:48.433 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.432+0000 7f3e9312c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.433 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.433+0000 7f3e9312c800 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:48:48.433 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.433+0000 7f3e9312c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21 info.flags=0x17 2024-09-12T00:48:48.433 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.433+0000 7f3e9312c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21 to cache LRU end 2024-09-12T00:48:48.433 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.433+0000 7f3e9312c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:48:48.433 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.433+0000 7f3e9312c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:48.434 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.433+0000 7f3e9312c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21 2024-09-12T00:48:48.434 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3e9312c800 time 2024-09-12T00:48:48.436536+0000 2024-09-12T00:48:48.434 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:48:48.435 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:48:48.435 INFO:tasks.workunit.client.0.smithi073.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3e9478c71a] 2024-09-12T00:48:48.435 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3e9478c8d8] 2024-09-12T00:48:48.435 INFO:tasks.workunit.client.0.smithi073.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a8fa672641] 2024-09-12T00:48:48.435 INFO:tasks.workunit.client.0.smithi073.stderr: 4: radosgw-admin(+0xd877a4) [0x55a8fab847a4] 2024-09-12T00:48:48.435 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a8fa68231d] 2024-09-12T00:48:48.435 INFO:tasks.workunit.client.0.smithi073.stderr: 6: main() 2024-09-12T00:48:48.435 INFO:tasks.workunit.client.0.smithi073.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f3e93429590] 2024-09-12T00:48:48.435 INFO:tasks.workunit.client.0.smithi073.stderr: 8: __libc_start_main() 2024-09-12T00:48:48.436 INFO:tasks.workunit.client.0.smithi073.stderr: 9: _start() 2024-09-12T00:48:48.436 INFO:tasks.workunit.client.0.smithi073.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:48:48.436 INFO:tasks.workunit.client.0.smithi073.stderr: in thread 7f3e9312c800 thread_name:radosgw-admin 2024-09-12T00:48:48.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.435+0000 7f3e9312c800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3e9312c800 time 2024-09-12T00:48:48.436536+0000 2024-09-12T00:48:48.436 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:48:48.436 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:48.436 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:48:48.436 INFO:tasks.workunit.client.0.smithi073.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3e9478c71a] 2024-09-12T00:48:48.436 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3e9478c8d8] 2024-09-12T00:48:48.436 INFO:tasks.workunit.client.0.smithi073.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a8fa672641] 2024-09-12T00:48:48.436 INFO:tasks.workunit.client.0.smithi073.stderr: 4: radosgw-admin(+0xd877a4) [0x55a8fab847a4] 2024-09-12T00:48:48.436 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a8fa68231d] 2024-09-12T00:48:48.436 INFO:tasks.workunit.client.0.smithi073.stderr: 6: main() 2024-09-12T00:48:48.436 INFO:tasks.workunit.client.0.smithi073.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f3e93429590] 2024-09-12T00:48:48.437 INFO:tasks.workunit.client.0.smithi073.stderr: 8: __libc_start_main() 2024-09-12T00:48:48.437 INFO:tasks.workunit.client.0.smithi073.stderr: 9: _start() 2024-09-12T00:48:48.437 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:48.455 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:48:48.455 INFO:tasks.workunit.client.0.smithi073.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3e9343e6f0] 2024-09-12T00:48:48.456 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3e9348b99c] 2024-09-12T00:48:48.456 INFO:tasks.workunit.client.0.smithi073.stderr: 3: raise() 2024-09-12T00:48:48.456 INFO:tasks.workunit.client.0.smithi073.stderr: 4: abort() 2024-09-12T00:48:48.456 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3e9478c774] 2024-09-12T00:48:48.456 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3e9478c8d8] 2024-09-12T00:48:48.456 INFO:tasks.workunit.client.0.smithi073.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a8fa672641] 2024-09-12T00:48:48.456 INFO:tasks.workunit.client.0.smithi073.stderr: 8: radosgw-admin(+0xd877a4) [0x55a8fab847a4] 2024-09-12T00:48:48.456 INFO:tasks.workunit.client.0.smithi073.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a8fa68231d] 2024-09-12T00:48:48.456 INFO:tasks.workunit.client.0.smithi073.stderr: 10: main() 2024-09-12T00:48:48.456 INFO:tasks.workunit.client.0.smithi073.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f3e93429590] 2024-09-12T00:48:48.456 INFO:tasks.workunit.client.0.smithi073.stderr: 12: __libc_start_main() 2024-09-12T00:48:48.457 INFO:tasks.workunit.client.0.smithi073.stderr: 13: _start() 2024-09-12T00:48:48.457 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.436+0000 7f3e9312c800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:48:48.457 INFO:tasks.workunit.client.0.smithi073.stderr: in thread 7f3e9312c800 thread_name:radosgw-admin 2024-09-12T00:48:48.457 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:48.457 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:48:48.457 INFO:tasks.workunit.client.0.smithi073.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3e9343e6f0] 2024-09-12T00:48:48.457 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3e9348b99c] 2024-09-12T00:48:48.457 INFO:tasks.workunit.client.0.smithi073.stderr: 3: raise() 2024-09-12T00:48:48.457 INFO:tasks.workunit.client.0.smithi073.stderr: 4: abort() 2024-09-12T00:48:48.457 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3e9478c774] 2024-09-12T00:48:48.457 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3e9478c8d8] 2024-09-12T00:48:48.457 INFO:tasks.workunit.client.0.smithi073.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a8fa672641] 2024-09-12T00:48:48.458 INFO:tasks.workunit.client.0.smithi073.stderr: 8: radosgw-admin(+0xd877a4) [0x55a8fab847a4] 2024-09-12T00:48:48.458 INFO:tasks.workunit.client.0.smithi073.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a8fa68231d] 2024-09-12T00:48:48.458 INFO:tasks.workunit.client.0.smithi073.stderr: 10: main() 2024-09-12T00:48:48.458 INFO:tasks.workunit.client.0.smithi073.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f3e93429590] 2024-09-12T00:48:48.458 INFO:tasks.workunit.client.0.smithi073.stderr: 12: __libc_start_main() 2024-09-12T00:48:48.458 INFO:tasks.workunit.client.0.smithi073.stderr: 13: _start() 2024-09-12T00:48:48.458 INFO:tasks.workunit.client.0.smithi073.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:48:48.458 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:48.458 INFO:tasks.workunit.client.0.smithi073.stderr:--- begin dump of recent events --- 2024-09-12T00:48:48.458 INFO:tasks.workunit.client.0.smithi073.stderr: -499> 2024-09-12T00:48:48.180+0000 7f3e8e560640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:48.458 INFO:tasks.workunit.client.0.smithi073.stderr: -498> 2024-09-12T00:48:48.180+0000 7f3e8e560640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:48.458 INFO:tasks.workunit.client.0.smithi073.stderr: -497> 2024-09-12T00:48:48.180+0000 7f3e8e560640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:48.458 INFO:tasks.workunit.client.0.smithi073.stderr: -496> 2024-09-12T00:48:48.180+0000 7f3e8f562640 10 monclient(hunting): get_auth_request con 0x55a8fbf65e00 auth_method 0 2024-09-12T00:48:48.459 INFO:tasks.workunit.client.0.smithi073.stderr: -495> 2024-09-12T00:48:48.180+0000 7f3e8f562640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:48.459 INFO:tasks.workunit.client.0.smithi073.stderr: -494> 2024-09-12T00:48:48.180+0000 7f3e8f562640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:48.459 INFO:tasks.workunit.client.0.smithi073.stderr: -493> 2024-09-12T00:48:48.180+0000 7f3e8f562640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:48.459 INFO:tasks.workunit.client.0.smithi073.stderr: -492> 2024-09-12T00:48:48.180+0000 7f3e8ed61640 10 monclient(hunting): handle_auth_done global_id 6071 payload 274 2024-09-12T00:48:48.459 INFO:tasks.workunit.client.0.smithi073.stderr: -491> 2024-09-12T00:48:48.180+0000 7f3e8ed61640 10 monclient: _finish_hunting 0 2024-09-12T00:48:48.459 INFO:tasks.workunit.client.0.smithi073.stderr: -490> 2024-09-12T00:48:48.180+0000 7f3e8ed61640 1 monclient: found mon.noname-c 2024-09-12T00:48:48.459 INFO:tasks.workunit.client.0.smithi073.stderr: -489> 2024-09-12T00:48:48.180+0000 7f3e8ed61640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.73:3301/0 2024-09-12T00:48:48.459 INFO:tasks.workunit.client.0.smithi073.stderr: -488> 2024-09-12T00:48:48.180+0000 7f3d7ce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:48.459 INFO:tasks.workunit.client.0.smithi073.stderr: -487> 2024-09-12T00:48:48.180+0000 7f3d7ce09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:48:48.459 INFO:tasks.workunit.client.0.smithi073.stderr: -486> 2024-09-12T00:48:48.180+0000 7f3d7ce09640 10 monclient: dump: 2024-09-12T00:48:48.459 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:48:48.459 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:48:48.460 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:48:48.460 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:48:48.460 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:48.460 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:48:48.460 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:48:48.460 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:48:48.460 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:48:48.460 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:48.460 INFO:tasks.workunit.client.0.smithi073.stderr: -485> 2024-09-12T00:48:48.180+0000 7f3d7ce09640 10 monclient: _finish_auth 0 2024-09-12T00:48:48.460 INFO:tasks.workunit.client.0.smithi073.stderr: -484> 2024-09-12T00:48:48.180+0000 7f3d7ce09640 10 monclient: _check_auth_tickets 2024-09-12T00:48:48.460 INFO:tasks.workunit.client.0.smithi073.stderr: -483> 2024-09-12T00:48:48.180+0000 7f3d7ce09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:48:48.460 INFO:tasks.workunit.client.0.smithi073.stderr: -482> 2024-09-12T00:48:48.180+0000 7f3e9312c800 5 monclient: authenticate success, global_id 6071 2024-09-12T00:48:48.460 INFO:tasks.workunit.client.0.smithi073.stderr: -481> 2024-09-12T00:48:48.180+0000 7f3e9312c800 10 monclient: get_monmap_and_config success 2024-09-12T00:48:48.461 INFO:tasks.workunit.client.0.smithi073.stderr: -480> 2024-09-12T00:48:48.180+0000 7f3d7ce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:48.461 INFO:tasks.workunit.client.0.smithi073.stderr: -479> 2024-09-12T00:48:48.180+0000 7f3e9312c800 4 set_mon_vals no callback set 2024-09-12T00:48:48.461 INFO:tasks.workunit.client.0.smithi073.stderr: -478> 2024-09-12T00:48:48.180+0000 7f3d7ce09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:48:48.461 INFO:tasks.workunit.client.0.smithi073.stderr: -477> 2024-09-12T00:48:48.180+0000 7f3d7ce09640 10 monclient: dump: 2024-09-12T00:48:48.461 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:48:48.461 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:48:48.461 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:48:48.461 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:48:48.461 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:48.461 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:48:48.461 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:48:48.461 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:48:48.461 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:48:48.462 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:48.462 INFO:tasks.workunit.client.0.smithi073.stderr: -476> 2024-09-12T00:48:48.181+0000 7f3e9312c800 10 monclient: shutdown 2024-09-12T00:48:48.462 INFO:tasks.workunit.client.0.smithi073.stderr: -475> 2024-09-12T00:48:48.181+0000 7f3e9312c800 5 asok(0x55a8fbe8d630) unregister_commands rotate-key 2024-09-12T00:48:48.462 INFO:tasks.workunit.client.0.smithi073.stderr: -474> 2024-09-12T00:48:48.181+0000 7f3e9312c800 10 monclient: build_initial_monmap 2024-09-12T00:48:48.462 INFO:tasks.workunit.client.0.smithi073.stderr: -473> 2024-09-12T00:48:48.181+0000 7f3e9312c800 1 build_initial for_mkfs: 0 2024-09-12T00:48:48.462 INFO:tasks.workunit.client.0.smithi073.stderr: -472> 2024-09-12T00:48:48.181+0000 7f3e9312c800 10 monclient: monmap: 2024-09-12T00:48:48.462 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:48:48.462 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:48:48.462 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:48:48.462 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:48:48.462 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:48:48.462 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:48:48.462 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:48:48.463 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:48:48.463 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:48:48.463 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:48.463 INFO:tasks.workunit.client.0.smithi073.stderr: -471> 2024-09-12T00:48:48.181+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0b3640) adding auth protocol: cephx 2024-09-12T00:48:48.463 INFO:tasks.workunit.client.0.smithi073.stderr: -470> 2024-09-12T00:48:48.181+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0b3640) adding auth protocol: cephx 2024-09-12T00:48:48.463 INFO:tasks.workunit.client.0.smithi073.stderr: -469> 2024-09-12T00:48:48.181+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0b3640) adding auth protocol: cephx 2024-09-12T00:48:48.463 INFO:tasks.workunit.client.0.smithi073.stderr: -468> 2024-09-12T00:48:48.181+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0b3640) adding con mode: secure 2024-09-12T00:48:48.463 INFO:tasks.workunit.client.0.smithi073.stderr: -467> 2024-09-12T00:48:48.181+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0b3640) adding con mode: crc 2024-09-12T00:48:48.463 INFO:tasks.workunit.client.0.smithi073.stderr: -466> 2024-09-12T00:48:48.181+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0b3640) adding con mode: secure 2024-09-12T00:48:48.463 INFO:tasks.workunit.client.0.smithi073.stderr: -465> 2024-09-12T00:48:48.181+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0b3640) adding con mode: crc 2024-09-12T00:48:48.463 INFO:tasks.workunit.client.0.smithi073.stderr: -464> 2024-09-12T00:48:48.181+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0b3640) adding con mode: secure 2024-09-12T00:48:48.464 INFO:tasks.workunit.client.0.smithi073.stderr: -463> 2024-09-12T00:48:48.181+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0b3640) adding con mode: crc 2024-09-12T00:48:48.464 INFO:tasks.workunit.client.0.smithi073.stderr: -462> 2024-09-12T00:48:48.181+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0b3640) adding con mode: crc 2024-09-12T00:48:48.464 INFO:tasks.workunit.client.0.smithi073.stderr: -461> 2024-09-12T00:48:48.181+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0b3640) adding con mode: secure 2024-09-12T00:48:48.464 INFO:tasks.workunit.client.0.smithi073.stderr: -460> 2024-09-12T00:48:48.181+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0b3640) adding con mode: crc 2024-09-12T00:48:48.464 INFO:tasks.workunit.client.0.smithi073.stderr: -459> 2024-09-12T00:48:48.181+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0b3640) adding con mode: secure 2024-09-12T00:48:48.464 INFO:tasks.workunit.client.0.smithi073.stderr: -458> 2024-09-12T00:48:48.181+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0b3640) adding con mode: crc 2024-09-12T00:48:48.464 INFO:tasks.workunit.client.0.smithi073.stderr: -457> 2024-09-12T00:48:48.181+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0b3640) adding con mode: secure 2024-09-12T00:48:48.464 INFO:tasks.workunit.client.0.smithi073.stderr: -456> 2024-09-12T00:48:48.181+0000 7f3e9312c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:48.464 INFO:tasks.workunit.client.0.smithi073.stderr: -455> 2024-09-12T00:48:48.181+0000 7f3e9312c800 1 librados: starting msgr at 2024-09-12T00:48:48.464 INFO:tasks.workunit.client.0.smithi073.stderr: -454> 2024-09-12T00:48:48.181+0000 7f3e9312c800 1 librados: starting objecter 2024-09-12T00:48:48.464 INFO:tasks.workunit.client.0.smithi073.stderr: -453> 2024-09-12T00:48:48.182+0000 7f3e9312c800 5 asok(0x55a8fbe8d630) register_command objecter_requests hook 0x55a8fc0b30b0 2024-09-12T00:48:48.465 INFO:tasks.workunit.client.0.smithi073.stderr: -452> 2024-09-12T00:48:48.182+0000 7f3e9312c800 1 librados: setting wanted keys 2024-09-12T00:48:48.465 INFO:tasks.workunit.client.0.smithi073.stderr: -451> 2024-09-12T00:48:48.182+0000 7f3e9312c800 1 librados: calling monclient init 2024-09-12T00:48:48.465 INFO:tasks.workunit.client.0.smithi073.stderr: -450> 2024-09-12T00:48:48.182+0000 7f3e9312c800 10 monclient: init 2024-09-12T00:48:48.465 INFO:tasks.workunit.client.0.smithi073.stderr: -449> 2024-09-12T00:48:48.182+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0ada30) adding auth protocol: cephx 2024-09-12T00:48:48.465 INFO:tasks.workunit.client.0.smithi073.stderr: -448> 2024-09-12T00:48:48.182+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0ada30) adding auth protocol: cephx 2024-09-12T00:48:48.465 INFO:tasks.workunit.client.0.smithi073.stderr: -447> 2024-09-12T00:48:48.182+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0ada30) adding auth protocol: cephx 2024-09-12T00:48:48.465 INFO:tasks.workunit.client.0.smithi073.stderr: -446> 2024-09-12T00:48:48.182+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0ada30) adding con mode: secure 2024-09-12T00:48:48.465 INFO:tasks.workunit.client.0.smithi073.stderr: -445> 2024-09-12T00:48:48.182+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0ada30) adding con mode: crc 2024-09-12T00:48:48.465 INFO:tasks.workunit.client.0.smithi073.stderr: -444> 2024-09-12T00:48:48.182+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0ada30) adding con mode: secure 2024-09-12T00:48:48.465 INFO:tasks.workunit.client.0.smithi073.stderr: -443> 2024-09-12T00:48:48.182+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0ada30) adding con mode: crc 2024-09-12T00:48:48.465 INFO:tasks.workunit.client.0.smithi073.stderr: -442> 2024-09-12T00:48:48.182+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0ada30) adding con mode: secure 2024-09-12T00:48:48.465 INFO:tasks.workunit.client.0.smithi073.stderr: -441> 2024-09-12T00:48:48.182+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0ada30) adding con mode: crc 2024-09-12T00:48:48.465 INFO:tasks.workunit.client.0.smithi073.stderr: -440> 2024-09-12T00:48:48.182+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0ada30) adding con mode: crc 2024-09-12T00:48:48.466 INFO:tasks.workunit.client.0.smithi073.stderr: -439> 2024-09-12T00:48:48.182+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0ada30) adding con mode: secure 2024-09-12T00:48:48.466 INFO:tasks.workunit.client.0.smithi073.stderr: -438> 2024-09-12T00:48:48.182+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0ada30) adding con mode: crc 2024-09-12T00:48:48.466 INFO:tasks.workunit.client.0.smithi073.stderr: -437> 2024-09-12T00:48:48.182+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0ada30) adding con mode: secure 2024-09-12T00:48:48.466 INFO:tasks.workunit.client.0.smithi073.stderr: -436> 2024-09-12T00:48:48.182+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0ada30) adding con mode: crc 2024-09-12T00:48:48.466 INFO:tasks.workunit.client.0.smithi073.stderr: -435> 2024-09-12T00:48:48.182+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0ada30) adding con mode: secure 2024-09-12T00:48:48.466 INFO:tasks.workunit.client.0.smithi073.stderr: -434> 2024-09-12T00:48:48.182+0000 7f3e9312c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:48.466 INFO:tasks.workunit.client.0.smithi073.stderr: -433> 2024-09-12T00:48:48.182+0000 7f3e9312c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:48.466 INFO:tasks.workunit.client.0.smithi073.stderr: -432> 2024-09-12T00:48:48.182+0000 7f3e9312c800 5 asok(0x55a8fbe8d630) register_command rotate-key hook 0x55a8fc0adb78 2024-09-12T00:48:48.466 INFO:tasks.workunit.client.0.smithi073.stderr: -431> 2024-09-12T00:48:48.182+0000 7f3e9312c800 10 monclient: _reopen_session rank -1 2024-09-12T00:48:48.466 INFO:tasks.workunit.client.0.smithi073.stderr: -430> 2024-09-12T00:48:48.182+0000 7f3e9312c800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:48:48.466 INFO:tasks.workunit.client.0.smithi073.stderr: -429> 2024-09-12T00:48:48.182+0000 7f3e9312c800 10 monclient(hunting): picked mon.noname-b con 0x55a8fbf37f40 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:48:48.466 INFO:tasks.workunit.client.0.smithi073.stderr: -428> 2024-09-12T00:48:48.182+0000 7f3e9312c800 10 monclient(hunting): picked mon.noname-c con 0x55a8fbf62290 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:48:48.467 INFO:tasks.workunit.client.0.smithi073.stderr: -427> 2024-09-12T00:48:48.182+0000 7f3e9312c800 10 monclient(hunting): picked mon.noname-a con 0x55a8fbf65e00 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:48:48.467 INFO:tasks.workunit.client.0.smithi073.stderr: -426> 2024-09-12T00:48:48.182+0000 7f3e9312c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:48.467 INFO:tasks.workunit.client.0.smithi073.stderr: -425> 2024-09-12T00:48:48.182+0000 7f3e9312c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:48.467 INFO:tasks.workunit.client.0.smithi073.stderr: -424> 2024-09-12T00:48:48.182+0000 7f3e9312c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:48.467 INFO:tasks.workunit.client.0.smithi073.stderr: -423> 2024-09-12T00:48:48.182+0000 7f3e9312c800 10 monclient(hunting): _renew_subs 2024-09-12T00:48:48.467 INFO:tasks.workunit.client.0.smithi073.stderr: -422> 2024-09-12T00:48:48.182+0000 7f3e9312c800 10 monclient(hunting): authenticate will time out at 1988.853726s 2024-09-12T00:48:48.467 INFO:tasks.workunit.client.0.smithi073.stderr: -421> 2024-09-12T00:48:48.182+0000 7f3e8e560640 10 monclient(hunting): get_auth_request con 0x55a8fbf62290 auth_method 0 2024-09-12T00:48:48.467 INFO:tasks.workunit.client.0.smithi073.stderr: -420> 2024-09-12T00:48:48.182+0000 7f3e8e560640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:48.467 INFO:tasks.workunit.client.0.smithi073.stderr: -419> 2024-09-12T00:48:48.182+0000 7f3e8e560640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:48.467 INFO:tasks.workunit.client.0.smithi073.stderr: -418> 2024-09-12T00:48:48.182+0000 7f3e8e560640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:48.467 INFO:tasks.workunit.client.0.smithi073.stderr: -417> 2024-09-12T00:48:48.182+0000 7f3e8f562640 10 monclient(hunting): get_auth_request con 0x55a8fbf65e00 auth_method 0 2024-09-12T00:48:48.467 INFO:tasks.workunit.client.0.smithi073.stderr: -416> 2024-09-12T00:48:48.182+0000 7f3e8f562640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:48.467 INFO:tasks.workunit.client.0.smithi073.stderr: -415> 2024-09-12T00:48:48.182+0000 7f3e8f562640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:48.468 INFO:tasks.workunit.client.0.smithi073.stderr: -414> 2024-09-12T00:48:48.182+0000 7f3e8f562640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:48.468 INFO:tasks.workunit.client.0.smithi073.stderr: -413> 2024-09-12T00:48:48.182+0000 7f3e8e560640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:48.468 INFO:tasks.workunit.client.0.smithi073.stderr: -412> 2024-09-12T00:48:48.182+0000 7f3e8e560640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:48.468 INFO:tasks.workunit.client.0.smithi073.stderr: -411> 2024-09-12T00:48:48.182+0000 7f3e8e560640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:48.468 INFO:tasks.workunit.client.0.smithi073.stderr: -410> 2024-09-12T00:48:48.182+0000 7f3e8f562640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:48.468 INFO:tasks.workunit.client.0.smithi073.stderr: -409> 2024-09-12T00:48:48.182+0000 7f3e8f562640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:48.468 INFO:tasks.workunit.client.0.smithi073.stderr: -408> 2024-09-12T00:48:48.182+0000 7f3e8f562640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:48.468 INFO:tasks.workunit.client.0.smithi073.stderr: -407> 2024-09-12T00:48:48.182+0000 7f3e8ed61640 10 monclient(hunting): get_auth_request con 0x55a8fbf37f40 auth_method 0 2024-09-12T00:48:48.468 INFO:tasks.workunit.client.0.smithi073.stderr: -406> 2024-09-12T00:48:48.182+0000 7f3e8ed61640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:48.468 INFO:tasks.workunit.client.0.smithi073.stderr: -405> 2024-09-12T00:48:48.182+0000 7f3e8ed61640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:48.468 INFO:tasks.workunit.client.0.smithi073.stderr: -404> 2024-09-12T00:48:48.182+0000 7f3e8ed61640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:48.468 INFO:tasks.workunit.client.0.smithi073.stderr: -403> 2024-09-12T00:48:48.183+0000 7f3e8e560640 10 monclient(hunting): handle_auth_done global_id 6074 payload 824 2024-09-12T00:48:48.468 INFO:tasks.workunit.client.0.smithi073.stderr: -402> 2024-09-12T00:48:48.183+0000 7f3e8e560640 10 monclient: _finish_hunting 0 2024-09-12T00:48:48.468 INFO:tasks.workunit.client.0.smithi073.stderr: -401> 2024-09-12T00:48:48.183+0000 7f3e8e560640 1 monclient: found mon.noname-c 2024-09-12T00:48:48.469 INFO:tasks.workunit.client.0.smithi073.stderr: -400> 2024-09-12T00:48:48.183+0000 7f3e8e560640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.73:3301/0 2024-09-12T00:48:48.469 INFO:tasks.workunit.client.0.smithi073.stderr: -399> 2024-09-12T00:48:48.183+0000 7f3d7b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:48.469 INFO:tasks.workunit.client.0.smithi073.stderr: -398> 2024-09-12T00:48:48.183+0000 7f3d7b606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:48:48.469 INFO:tasks.workunit.client.0.smithi073.stderr: -397> 2024-09-12T00:48:48.183+0000 7f3d7b606640 10 monclient: dump: 2024-09-12T00:48:48.469 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:48:48.469 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:48:48.469 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:48:48.469 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:48:48.469 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:48.469 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:48:48.469 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:48:48.469 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:48:48.469 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:48:48.470 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:48.470 INFO:tasks.workunit.client.0.smithi073.stderr: -396> 2024-09-12T00:48:48.183+0000 7f3d7b606640 10 monclient: _finish_auth 0 2024-09-12T00:48:48.470 INFO:tasks.workunit.client.0.smithi073.stderr: -395> 2024-09-12T00:48:48.183+0000 7f3d7b606640 10 monclient: _check_auth_tickets 2024-09-12T00:48:48.470 INFO:tasks.workunit.client.0.smithi073.stderr: -394> 2024-09-12T00:48:48.183+0000 7f3d7b606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:48:48.470 INFO:tasks.workunit.client.0.smithi073.stderr: -393> 2024-09-12T00:48:48.183+0000 7f3d7b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:48.470 INFO:tasks.workunit.client.0.smithi073.stderr: -392> 2024-09-12T00:48:48.183+0000 7f3d7b606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:48:48.470 INFO:tasks.workunit.client.0.smithi073.stderr: -391> 2024-09-12T00:48:48.183+0000 7f3d7b606640 10 monclient: dump: 2024-09-12T00:48:48.470 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:48:48.470 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:48:48.470 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:48:48.470 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:48:48.470 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:48.470 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:48:48.471 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:48:48.471 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:48:48.471 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:48:48.471 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:48.471 INFO:tasks.workunit.client.0.smithi073.stderr: -390> 2024-09-12T00:48:48.183+0000 7f3e9312c800 5 monclient: authenticate success, global_id 6074 2024-09-12T00:48:48.471 INFO:tasks.workunit.client.0.smithi073.stderr: -389> 2024-09-12T00:48:48.183+0000 7f3e9312c800 10 monclient: _renew_subs 2024-09-12T00:48:48.471 INFO:tasks.workunit.client.0.smithi073.stderr: -388> 2024-09-12T00:48:48.183+0000 7f3d7ce09640 4 set_mon_vals no callback set 2024-09-12T00:48:48.471 INFO:tasks.workunit.client.0.smithi073.stderr: -387> 2024-09-12T00:48:48.183+0000 7f3e9312c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:48:48.471 INFO:tasks.workunit.client.0.smithi073.stderr: -386> 2024-09-12T00:48:48.183+0000 7f3e9312c800 10 monclient: _renew_subs 2024-09-12T00:48:48.471 INFO:tasks.workunit.client.0.smithi073.stderr: -385> 2024-09-12T00:48:48.183+0000 7f3e9312c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:48:48.471 INFO:tasks.workunit.client.0.smithi073.stderr: -384> 2024-09-12T00:48:48.183+0000 7f3e9312c800 1 librados: init done 2024-09-12T00:48:48.471 INFO:tasks.workunit.client.0.smithi073.stderr: -383> 2024-09-12T00:48:48.185+0000 7f3d7b606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:48:48.471 INFO:tasks.workunit.client.0.smithi073.stderr: -382> 2024-09-12T00:48:48.185+0000 7f3d7b606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:48:48.471 INFO:tasks.workunit.client.0.smithi073.stderr: -381> 2024-09-12T00:48:48.185+0000 7f3d7b606640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:48:48.472 INFO:tasks.workunit.client.0.smithi073.stderr: -380> 2024-09-12T00:48:48.185+0000 7f3e8ed61640 10 monclient: get_auth_request con 0x7f3d74076470 auth_method 0 2024-09-12T00:48:48.472 INFO:tasks.workunit.client.0.smithi073.stderr: -379> 2024-09-12T00:48:48.185+0000 7f3e8f562640 10 monclient: get_auth_request con 0x55a8fc0d63a0 auth_method 0 2024-09-12T00:48:48.472 INFO:tasks.workunit.client.0.smithi073.stderr: -378> 2024-09-12T00:48:48.186+0000 7f3e8ed61640 10 monclient: get_auth_request con 0x55a8fc0f90f0 auth_method 0 2024-09-12T00:48:48.472 INFO:tasks.workunit.client.0.smithi073.stderr: -377> 2024-09-12T00:48:48.187+0000 7f3e8e560640 10 monclient: get_auth_request con 0x55a8fc0fd800 auth_method 0 2024-09-12T00:48:48.472 INFO:tasks.workunit.client.0.smithi073.stderr: -376> 2024-09-12T00:48:48.189+0000 7f3e9312c800 10 monclient: build_initial_monmap 2024-09-12T00:48:48.472 INFO:tasks.workunit.client.0.smithi073.stderr: -375> 2024-09-12T00:48:48.189+0000 7f3e9312c800 1 build_initial for_mkfs: 0 2024-09-12T00:48:48.472 INFO:tasks.workunit.client.0.smithi073.stderr: -374> 2024-09-12T00:48:48.189+0000 7f3e9312c800 10 monclient: monmap: 2024-09-12T00:48:48.472 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:48:48.472 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:48:48.472 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:48:48.472 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:48:48.472 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:48:48.472 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:48:48.473 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:48:48.473 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:48:48.473 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:48:48.473 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:48.473 INFO:tasks.workunit.client.0.smithi073.stderr: -373> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc102530) adding auth protocol: cephx 2024-09-12T00:48:48.473 INFO:tasks.workunit.client.0.smithi073.stderr: -372> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc102530) adding auth protocol: cephx 2024-09-12T00:48:48.473 INFO:tasks.workunit.client.0.smithi073.stderr: -371> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc102530) adding auth protocol: cephx 2024-09-12T00:48:48.473 INFO:tasks.workunit.client.0.smithi073.stderr: -370> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc102530) adding con mode: secure 2024-09-12T00:48:48.473 INFO:tasks.workunit.client.0.smithi073.stderr: -369> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc102530) adding con mode: crc 2024-09-12T00:48:48.473 INFO:tasks.workunit.client.0.smithi073.stderr: -368> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc102530) adding con mode: secure 2024-09-12T00:48:48.473 INFO:tasks.workunit.client.0.smithi073.stderr: -367> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc102530) adding con mode: crc 2024-09-12T00:48:48.473 INFO:tasks.workunit.client.0.smithi073.stderr: -366> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc102530) adding con mode: secure 2024-09-12T00:48:48.473 INFO:tasks.workunit.client.0.smithi073.stderr: -365> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc102530) adding con mode: crc 2024-09-12T00:48:48.474 INFO:tasks.workunit.client.0.smithi073.stderr: -364> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc102530) adding con mode: crc 2024-09-12T00:48:48.474 INFO:tasks.workunit.client.0.smithi073.stderr: -363> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc102530) adding con mode: secure 2024-09-12T00:48:48.474 INFO:tasks.workunit.client.0.smithi073.stderr: -362> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc102530) adding con mode: crc 2024-09-12T00:48:48.474 INFO:tasks.workunit.client.0.smithi073.stderr: -361> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc102530) adding con mode: secure 2024-09-12T00:48:48.474 INFO:tasks.workunit.client.0.smithi073.stderr: -360> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc102530) adding con mode: crc 2024-09-12T00:48:48.474 INFO:tasks.workunit.client.0.smithi073.stderr: -359> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc102530) adding con mode: secure 2024-09-12T00:48:48.474 INFO:tasks.workunit.client.0.smithi073.stderr: -358> 2024-09-12T00:48:48.189+0000 7f3e9312c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:48.474 INFO:tasks.workunit.client.0.smithi073.stderr: -357> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 asok(0x55a8fbe8d630) register_command objecter_requests cmddesc objecter_requests hook 0x55a8fc105f20 EEXIST 2024-09-12T00:48:48.474 INFO:tasks.workunit.client.0.smithi073.stderr: -356> 2024-09-12T00:48:48.189+0000 7f3e9312c800 10 monclient: init 2024-09-12T00:48:48.474 INFO:tasks.workunit.client.0.smithi073.stderr: -355> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc100c08) adding auth protocol: cephx 2024-09-12T00:48:48.474 INFO:tasks.workunit.client.0.smithi073.stderr: -354> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc100c08) adding auth protocol: cephx 2024-09-12T00:48:48.474 INFO:tasks.workunit.client.0.smithi073.stderr: -353> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc100c08) adding auth protocol: cephx 2024-09-12T00:48:48.474 INFO:tasks.workunit.client.0.smithi073.stderr: -352> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc100c08) adding con mode: secure 2024-09-12T00:48:48.475 INFO:tasks.workunit.client.0.smithi073.stderr: -351> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc100c08) adding con mode: crc 2024-09-12T00:48:48.475 INFO:tasks.workunit.client.0.smithi073.stderr: -350> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc100c08) adding con mode: secure 2024-09-12T00:48:48.475 INFO:tasks.workunit.client.0.smithi073.stderr: -349> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc100c08) adding con mode: crc 2024-09-12T00:48:48.475 INFO:tasks.workunit.client.0.smithi073.stderr: -348> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc100c08) adding con mode: secure 2024-09-12T00:48:48.475 INFO:tasks.workunit.client.0.smithi073.stderr: -347> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc100c08) adding con mode: crc 2024-09-12T00:48:48.475 INFO:tasks.workunit.client.0.smithi073.stderr: -346> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc100c08) adding con mode: crc 2024-09-12T00:48:48.475 INFO:tasks.workunit.client.0.smithi073.stderr: -345> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc100c08) adding con mode: secure 2024-09-12T00:48:48.475 INFO:tasks.workunit.client.0.smithi073.stderr: -344> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc100c08) adding con mode: crc 2024-09-12T00:48:48.475 INFO:tasks.workunit.client.0.smithi073.stderr: -343> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc100c08) adding con mode: secure 2024-09-12T00:48:48.475 INFO:tasks.workunit.client.0.smithi073.stderr: -342> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc100c08) adding con mode: crc 2024-09-12T00:48:48.475 INFO:tasks.workunit.client.0.smithi073.stderr: -341> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc100c08) adding con mode: secure 2024-09-12T00:48:48.475 INFO:tasks.workunit.client.0.smithi073.stderr: -340> 2024-09-12T00:48:48.190+0000 7f3e9312c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:48.475 INFO:tasks.workunit.client.0.smithi073.stderr: -339> 2024-09-12T00:48:48.190+0000 7f3e9312c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:48.475 INFO:tasks.workunit.client.0.smithi073.stderr: -338> 2024-09-12T00:48:48.190+0000 7f3e9312c800 5 asok(0x55a8fbe8d630) register_command rotate-key cmddesc rotate-key hook 0x55a8fc100d50 EEXIST 2024-09-12T00:48:48.476 INFO:tasks.workunit.client.0.smithi073.stderr: -337> 2024-09-12T00:48:48.190+0000 7f3e9312c800 10 monclient: _reopen_session rank -1 2024-09-12T00:48:48.476 INFO:tasks.workunit.client.0.smithi073.stderr: -336> 2024-09-12T00:48:48.190+0000 7f3e9312c800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:48:48.476 INFO:tasks.workunit.client.0.smithi073.stderr: -335> 2024-09-12T00:48:48.190+0000 7f3e9312c800 10 monclient(hunting): picked mon.noname-c con 0x55a8fc129c10 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:48:48.476 INFO:tasks.workunit.client.0.smithi073.stderr: -334> 2024-09-12T00:48:48.190+0000 7f3e9312c800 10 monclient(hunting): picked mon.noname-a con 0x55a8fc12bee0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:48:48.476 INFO:tasks.workunit.client.0.smithi073.stderr: -333> 2024-09-12T00:48:48.190+0000 7f3e9312c800 10 monclient(hunting): picked mon.noname-b con 0x55a8fc1283e0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:48:48.476 INFO:tasks.workunit.client.0.smithi073.stderr: -332> 2024-09-12T00:48:48.190+0000 7f3e9312c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:48.476 INFO:tasks.workunit.client.0.smithi073.stderr: -331> 2024-09-12T00:48:48.190+0000 7f3e9312c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:48.476 INFO:tasks.workunit.client.0.smithi073.stderr: -330> 2024-09-12T00:48:48.190+0000 7f3e9312c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:48.476 INFO:tasks.workunit.client.0.smithi073.stderr: -329> 2024-09-12T00:48:48.190+0000 7f3e9312c800 10 monclient(hunting): _renew_subs 2024-09-12T00:48:48.476 INFO:tasks.workunit.client.0.smithi073.stderr: -328> 2024-09-12T00:48:48.190+0000 7f3e9312c800 10 monclient(hunting): authenticate will time out at 1988.861358s 2024-09-12T00:48:48.476 INFO:tasks.workunit.client.0.smithi073.stderr: -327> 2024-09-12T00:48:48.190+0000 7f3e8ed61640 10 monclient(hunting): get_auth_request con 0x55a8fc129c10 auth_method 0 2024-09-12T00:48:48.476 INFO:tasks.workunit.client.0.smithi073.stderr: -326> 2024-09-12T00:48:48.190+0000 7f3e8ed61640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:48.477 INFO:tasks.workunit.client.0.smithi073.stderr: -325> 2024-09-12T00:48:48.190+0000 7f3e8ed61640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:48.477 INFO:tasks.workunit.client.0.smithi073.stderr: -324> 2024-09-12T00:48:48.190+0000 7f3e8ed61640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:48.477 INFO:tasks.workunit.client.0.smithi073.stderr: -323> 2024-09-12T00:48:48.190+0000 7f3e8e560640 10 monclient(hunting): get_auth_request con 0x55a8fc12bee0 auth_method 0 2024-09-12T00:48:48.477 INFO:tasks.workunit.client.0.smithi073.stderr: -322> 2024-09-12T00:48:48.190+0000 7f3e8e560640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:48.477 INFO:tasks.workunit.client.0.smithi073.stderr: -321> 2024-09-12T00:48:48.190+0000 7f3e8e560640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:48.477 INFO:tasks.workunit.client.0.smithi073.stderr: -320> 2024-09-12T00:48:48.190+0000 7f3e8e560640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:48.477 INFO:tasks.workunit.client.0.smithi073.stderr: -319> 2024-09-12T00:48:48.190+0000 7f3e8e560640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:48.477 INFO:tasks.workunit.client.0.smithi073.stderr: -318> 2024-09-12T00:48:48.190+0000 7f3e8e560640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:48.477 INFO:tasks.workunit.client.0.smithi073.stderr: -317> 2024-09-12T00:48:48.190+0000 7f3e8e560640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:48.477 INFO:tasks.workunit.client.0.smithi073.stderr: -316> 2024-09-12T00:48:48.190+0000 7f3e8ed61640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:48.477 INFO:tasks.workunit.client.0.smithi073.stderr: -315> 2024-09-12T00:48:48.190+0000 7f3e8ed61640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:48.477 INFO:tasks.workunit.client.0.smithi073.stderr: -314> 2024-09-12T00:48:48.190+0000 7f3e8ed61640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:48.477 INFO:tasks.workunit.client.0.smithi073.stderr: -313> 2024-09-12T00:48:48.190+0000 7f3e8e560640 10 monclient(hunting): handle_auth_done global_id 6387 payload 824 2024-09-12T00:48:48.478 INFO:tasks.workunit.client.0.smithi073.stderr: -312> 2024-09-12T00:48:48.190+0000 7f3e8e560640 10 monclient: _finish_hunting 0 2024-09-12T00:48:48.478 INFO:tasks.workunit.client.0.smithi073.stderr: -311> 2024-09-12T00:48:48.190+0000 7f3e8e560640 1 monclient: found mon.noname-a 2024-09-12T00:48:48.478 INFO:tasks.workunit.client.0.smithi073.stderr: -310> 2024-09-12T00:48:48.190+0000 7f3e8e560640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:48:48.478 INFO:tasks.workunit.client.0.smithi073.stderr: -309> 2024-09-12T00:48:48.190+0000 7f3e8f562640 10 monclient: get_auth_request con 0x55a8fc1283e0 auth_method 0 2024-09-12T00:48:48.478 INFO:tasks.workunit.client.0.smithi073.stderr: -308> 2024-09-12T00:48:48.190+0000 7f3d78e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:48.478 INFO:tasks.workunit.client.0.smithi073.stderr: -307> 2024-09-12T00:48:48.190+0000 7f3d78e01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:48:48.478 INFO:tasks.workunit.client.0.smithi073.stderr: -306> 2024-09-12T00:48:48.190+0000 7f3d78e01640 10 monclient: dump: 2024-09-12T00:48:48.478 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:48:48.478 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:48:48.478 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:48:48.478 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:48:48.478 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:48.478 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:48:48.479 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:48:48.479 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:48:48.479 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:48:48.479 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:48.479 INFO:tasks.workunit.client.0.smithi073.stderr: -305> 2024-09-12T00:48:48.190+0000 7f3d78e01640 10 monclient: _finish_auth 0 2024-09-12T00:48:48.479 INFO:tasks.workunit.client.0.smithi073.stderr: -304> 2024-09-12T00:48:48.190+0000 7f3d78e01640 10 monclient: _check_auth_tickets 2024-09-12T00:48:48.479 INFO:tasks.workunit.client.0.smithi073.stderr: -303> 2024-09-12T00:48:48.190+0000 7f3d78e01640 10 monclient: handle_config config(0 keys) 2024-09-12T00:48:48.479 INFO:tasks.workunit.client.0.smithi073.stderr: -302> 2024-09-12T00:48:48.191+0000 7f3d78e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:48.479 INFO:tasks.workunit.client.0.smithi073.stderr: -301> 2024-09-12T00:48:48.191+0000 7f3d78e01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:48:48.479 INFO:tasks.workunit.client.0.smithi073.stderr: -300> 2024-09-12T00:48:48.191+0000 7f3d78e01640 10 monclient: dump: 2024-09-12T00:48:48.479 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:48:48.479 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:48:48.479 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:48:48.479 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:48:48.480 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:48.480 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:48:48.480 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:48:48.480 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:48:48.480 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:48:48.480 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:48.480 INFO:tasks.workunit.client.0.smithi073.stderr: -299> 2024-09-12T00:48:48.191+0000 7f3e9312c800 5 monclient: authenticate success, global_id 6387 2024-09-12T00:48:48.480 INFO:tasks.workunit.client.0.smithi073.stderr: -298> 2024-09-12T00:48:48.191+0000 7f3e9312c800 10 monclient: _renew_subs 2024-09-12T00:48:48.480 INFO:tasks.workunit.client.0.smithi073.stderr: -297> 2024-09-12T00:48:48.191+0000 7f3e9312c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:48:48.480 INFO:tasks.workunit.client.0.smithi073.stderr: -296> 2024-09-12T00:48:48.191+0000 7f3e8fd63640 4 set_mon_vals no callback set 2024-09-12T00:48:48.480 INFO:tasks.workunit.client.0.smithi073.stderr: -295> 2024-09-12T00:48:48.191+0000 7f3e9312c800 10 monclient: _renew_subs 2024-09-12T00:48:48.480 INFO:tasks.workunit.client.0.smithi073.stderr: -294> 2024-09-12T00:48:48.191+0000 7f3e9312c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:48:48.481 INFO:tasks.workunit.client.0.smithi073.stderr: -293> 2024-09-12T00:48:48.192+0000 7f3d78e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:48:48.481 INFO:tasks.workunit.client.0.smithi073.stderr: -292> 2024-09-12T00:48:48.192+0000 7f3d78e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:48:48.481 INFO:tasks.workunit.client.0.smithi073.stderr: -291> 2024-09-12T00:48:48.192+0000 7f3d78e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:48:48.481 INFO:tasks.workunit.client.0.smithi073.stderr: -290> 2024-09-12T00:48:48.192+0000 7f3e8ed61640 10 monclient: get_auth_request con 0x7f3d68076380 auth_method 0 2024-09-12T00:48:48.481 INFO:tasks.workunit.client.0.smithi073.stderr: -289> 2024-09-12T00:48:48.193+0000 7f3e9312c800 10 monclient: get_monmap_and_config 2024-09-12T00:48:48.481 INFO:tasks.workunit.client.0.smithi073.stderr: -288> 2024-09-12T00:48:48.193+0000 7f3e9312c800 10 monclient: build_initial_monmap 2024-09-12T00:48:48.481 INFO:tasks.workunit.client.0.smithi073.stderr: -287> 2024-09-12T00:48:48.193+0000 7f3e9312c800 1 build_initial for_mkfs: 0 2024-09-12T00:48:48.481 INFO:tasks.workunit.client.0.smithi073.stderr: -286> 2024-09-12T00:48:48.193+0000 7f3e9312c800 10 monclient: monmap: 2024-09-12T00:48:48.481 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:48:48.481 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:48:48.481 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:48:48.481 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:48:48.481 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:48:48.482 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:48:48.482 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:48:48.482 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:48:48.482 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:48:48.482 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:48.482 INFO:tasks.workunit.client.0.smithi073.stderr: -285> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc149b90) adding auth protocol: cephx 2024-09-12T00:48:48.482 INFO:tasks.workunit.client.0.smithi073.stderr: -284> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc149b90) adding auth protocol: cephx 2024-09-12T00:48:48.482 INFO:tasks.workunit.client.0.smithi073.stderr: -283> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc149b90) adding auth protocol: cephx 2024-09-12T00:48:48.482 INFO:tasks.workunit.client.0.smithi073.stderr: -282> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc149b90) adding con mode: secure 2024-09-12T00:48:48.482 INFO:tasks.workunit.client.0.smithi073.stderr: -281> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc149b90) adding con mode: crc 2024-09-12T00:48:48.482 INFO:tasks.workunit.client.0.smithi073.stderr: -280> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc149b90) adding con mode: secure 2024-09-12T00:48:48.482 INFO:tasks.workunit.client.0.smithi073.stderr: -279> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc149b90) adding con mode: crc 2024-09-12T00:48:48.482 INFO:tasks.workunit.client.0.smithi073.stderr: -278> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc149b90) adding con mode: secure 2024-09-12T00:48:48.483 INFO:tasks.workunit.client.0.smithi073.stderr: -277> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc149b90) adding con mode: crc 2024-09-12T00:48:48.483 INFO:tasks.workunit.client.0.smithi073.stderr: -276> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc149b90) adding con mode: crc 2024-09-12T00:48:48.483 INFO:tasks.workunit.client.0.smithi073.stderr: -275> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc149b90) adding con mode: secure 2024-09-12T00:48:48.483 INFO:tasks.workunit.client.0.smithi073.stderr: -274> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc149b90) adding con mode: crc 2024-09-12T00:48:48.483 INFO:tasks.workunit.client.0.smithi073.stderr: -273> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc149b90) adding con mode: secure 2024-09-12T00:48:48.483 INFO:tasks.workunit.client.0.smithi073.stderr: -272> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc149b90) adding con mode: crc 2024-09-12T00:48:48.483 INFO:tasks.workunit.client.0.smithi073.stderr: -271> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc149b90) adding con mode: secure 2024-09-12T00:48:48.483 INFO:tasks.workunit.client.0.smithi073.stderr: -270> 2024-09-12T00:48:48.193+0000 7f3e9312c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:48.483 INFO:tasks.workunit.client.0.smithi073.stderr: -269> 2024-09-12T00:48:48.193+0000 7f3e9312c800 10 monclient: init 2024-09-12T00:48:48.483 INFO:tasks.workunit.client.0.smithi073.stderr: -268> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815691d0) adding auth protocol: cephx 2024-09-12T00:48:48.483 INFO:tasks.workunit.client.0.smithi073.stderr: -267> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815691d0) adding auth protocol: cephx 2024-09-12T00:48:48.483 INFO:tasks.workunit.client.0.smithi073.stderr: -266> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815691d0) adding auth protocol: cephx 2024-09-12T00:48:48.483 INFO:tasks.workunit.client.0.smithi073.stderr: -265> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815691d0) adding con mode: secure 2024-09-12T00:48:48.484 INFO:tasks.workunit.client.0.smithi073.stderr: -264> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815691d0) adding con mode: crc 2024-09-12T00:48:48.484 INFO:tasks.workunit.client.0.smithi073.stderr: -263> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815691d0) adding con mode: secure 2024-09-12T00:48:48.484 INFO:tasks.workunit.client.0.smithi073.stderr: -262> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815691d0) adding con mode: crc 2024-09-12T00:48:48.484 INFO:tasks.workunit.client.0.smithi073.stderr: -261> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815691d0) adding con mode: secure 2024-09-12T00:48:48.484 INFO:tasks.workunit.client.0.smithi073.stderr: -260> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815691d0) adding con mode: crc 2024-09-12T00:48:48.484 INFO:tasks.workunit.client.0.smithi073.stderr: -259> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815691d0) adding con mode: crc 2024-09-12T00:48:48.484 INFO:tasks.workunit.client.0.smithi073.stderr: -258> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815691d0) adding con mode: secure 2024-09-12T00:48:48.484 INFO:tasks.workunit.client.0.smithi073.stderr: -257> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815691d0) adding con mode: crc 2024-09-12T00:48:48.484 INFO:tasks.workunit.client.0.smithi073.stderr: -256> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815691d0) adding con mode: secure 2024-09-12T00:48:48.484 INFO:tasks.workunit.client.0.smithi073.stderr: -255> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815691d0) adding con mode: crc 2024-09-12T00:48:48.484 INFO:tasks.workunit.client.0.smithi073.stderr: -254> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815691d0) adding con mode: secure 2024-09-12T00:48:48.484 INFO:tasks.workunit.client.0.smithi073.stderr: -253> 2024-09-12T00:48:48.193+0000 7f3e9312c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:48.484 INFO:tasks.workunit.client.0.smithi073.stderr: -252> 2024-09-12T00:48:48.193+0000 7f3e9312c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:48.484 INFO:tasks.workunit.client.0.smithi073.stderr: -251> 2024-09-12T00:48:48.194+0000 7f3e9312c800 5 asok(0x55a8fbe8d630) register_command rotate-key cmddesc rotate-key hook 0x7ffd81569318 EEXIST 2024-09-12T00:48:48.485 INFO:tasks.workunit.client.0.smithi073.stderr: -250> 2024-09-12T00:48:48.194+0000 7f3e9312c800 10 monclient: _reopen_session rank -1 2024-09-12T00:48:48.485 INFO:tasks.workunit.client.0.smithi073.stderr: -249> 2024-09-12T00:48:48.194+0000 7f3e9312c800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:48:48.485 INFO:tasks.workunit.client.0.smithi073.stderr: -248> 2024-09-12T00:48:48.194+0000 7f3e9312c800 10 monclient(hunting): picked mon.noname-c con 0x55a8fc17e250 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:48:48.485 INFO:tasks.workunit.client.0.smithi073.stderr: -247> 2024-09-12T00:48:48.194+0000 7f3e9312c800 10 monclient(hunting): picked mon.noname-b con 0x55a8fc14f1a0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:48:48.485 INFO:tasks.workunit.client.0.smithi073.stderr: -246> 2024-09-12T00:48:48.194+0000 7f3e9312c800 10 monclient(hunting): picked mon.noname-a con 0x55a8fc179af0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:48:48.485 INFO:tasks.workunit.client.0.smithi073.stderr: -245> 2024-09-12T00:48:48.194+0000 7f3e9312c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:48.485 INFO:tasks.workunit.client.0.smithi073.stderr: -244> 2024-09-12T00:48:48.194+0000 7f3e9312c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:48.485 INFO:tasks.workunit.client.0.smithi073.stderr: -243> 2024-09-12T00:48:48.194+0000 7f3e9312c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:48.485 INFO:tasks.workunit.client.0.smithi073.stderr: -242> 2024-09-12T00:48:48.194+0000 7f3e9312c800 10 monclient(hunting): _renew_subs 2024-09-12T00:48:48.485 INFO:tasks.workunit.client.0.smithi073.stderr: -241> 2024-09-12T00:48:48.194+0000 7f3e9312c800 10 monclient(hunting): authenticate will time out at 1988.865077s 2024-09-12T00:48:48.485 INFO:tasks.workunit.client.0.smithi073.stderr: -240> 2024-09-12T00:48:48.194+0000 7f3e8ed61640 10 monclient(hunting): get_auth_request con 0x55a8fc17e250 auth_method 0 2024-09-12T00:48:48.485 INFO:tasks.workunit.client.0.smithi073.stderr: -239> 2024-09-12T00:48:48.194+0000 7f3e8ed61640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:48.486 INFO:tasks.workunit.client.0.smithi073.stderr: -238> 2024-09-12T00:48:48.194+0000 7f3e8ed61640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:48.486 INFO:tasks.workunit.client.0.smithi073.stderr: -237> 2024-09-12T00:48:48.194+0000 7f3e8ed61640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:48.486 INFO:tasks.workunit.client.0.smithi073.stderr: -236> 2024-09-12T00:48:48.194+0000 7f3e8f562640 10 monclient(hunting): get_auth_request con 0x55a8fc179af0 auth_method 0 2024-09-12T00:48:48.486 INFO:tasks.workunit.client.0.smithi073.stderr: -235> 2024-09-12T00:48:48.194+0000 7f3e8f562640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:48.486 INFO:tasks.workunit.client.0.smithi073.stderr: -234> 2024-09-12T00:48:48.194+0000 7f3e8f562640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:48.486 INFO:tasks.workunit.client.0.smithi073.stderr: -233> 2024-09-12T00:48:48.194+0000 7f3e8f562640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:48.486 INFO:tasks.workunit.client.0.smithi073.stderr: -232> 2024-09-12T00:48:48.194+0000 7f3e8ed61640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:48.486 INFO:tasks.workunit.client.0.smithi073.stderr: -231> 2024-09-12T00:48:48.194+0000 7f3e8ed61640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:48.486 INFO:tasks.workunit.client.0.smithi073.stderr: -230> 2024-09-12T00:48:48.194+0000 7f3e8ed61640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:48.486 INFO:tasks.workunit.client.0.smithi073.stderr: -229> 2024-09-12T00:48:48.194+0000 7f3e8f562640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:48.486 INFO:tasks.workunit.client.0.smithi073.stderr: -228> 2024-09-12T00:48:48.194+0000 7f3e8f562640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:48.486 INFO:tasks.workunit.client.0.smithi073.stderr: -227> 2024-09-12T00:48:48.194+0000 7f3e8f562640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:48.486 INFO:tasks.workunit.client.0.smithi073.stderr: -226> 2024-09-12T00:48:48.194+0000 7f3e8e560640 10 monclient(hunting): get_auth_request con 0x55a8fc14f1a0 auth_method 0 2024-09-12T00:48:48.486 INFO:tasks.workunit.client.0.smithi073.stderr: -225> 2024-09-12T00:48:48.194+0000 7f3e8e560640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:48.487 INFO:tasks.workunit.client.0.smithi073.stderr: -224> 2024-09-12T00:48:48.194+0000 7f3e8e560640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:48.487 INFO:tasks.workunit.client.0.smithi073.stderr: -223> 2024-09-12T00:48:48.194+0000 7f3e8e560640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:48.487 INFO:tasks.workunit.client.0.smithi073.stderr: -222> 2024-09-12T00:48:48.194+0000 7f3e8f562640 10 monclient(hunting): handle_auth_done global_id 6390 payload 274 2024-09-12T00:48:48.487 INFO:tasks.workunit.client.0.smithi073.stderr: -221> 2024-09-12T00:48:48.194+0000 7f3e8f562640 10 monclient: _finish_hunting 0 2024-09-12T00:48:48.487 INFO:tasks.workunit.client.0.smithi073.stderr: -220> 2024-09-12T00:48:48.194+0000 7f3e8f562640 1 monclient: found mon.noname-a 2024-09-12T00:48:48.487 INFO:tasks.workunit.client.0.smithi073.stderr: -219> 2024-09-12T00:48:48.194+0000 7f3e8f562640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:48:48.487 INFO:tasks.workunit.client.0.smithi073.stderr: -218> 2024-09-12T00:48:48.194+0000 7f3d727fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:48.487 INFO:tasks.workunit.client.0.smithi073.stderr: -217> 2024-09-12T00:48:48.194+0000 7f3d727fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:48:48.487 INFO:tasks.workunit.client.0.smithi073.stderr: -216> 2024-09-12T00:48:48.194+0000 7f3d727fc640 10 monclient: dump: 2024-09-12T00:48:48.487 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:48:48.487 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:48:48.487 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:48:48.487 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:48:48.487 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:48.487 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:48:48.488 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:48:48.488 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:48:48.488 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:48:48.488 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:48.488 INFO:tasks.workunit.client.0.smithi073.stderr: -215> 2024-09-12T00:48:48.194+0000 7f3d727fc640 10 monclient: _finish_auth 0 2024-09-12T00:48:48.488 INFO:tasks.workunit.client.0.smithi073.stderr: -214> 2024-09-12T00:48:48.194+0000 7f3d727fc640 10 monclient: _check_auth_tickets 2024-09-12T00:48:48.488 INFO:tasks.workunit.client.0.smithi073.stderr: -213> 2024-09-12T00:48:48.194+0000 7f3d727fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:48:48.488 INFO:tasks.workunit.client.0.smithi073.stderr: -212> 2024-09-12T00:48:48.194+0000 7f3e9312c800 5 monclient: authenticate success, global_id 6390 2024-09-12T00:48:48.488 INFO:tasks.workunit.client.0.smithi073.stderr: -211> 2024-09-12T00:48:48.194+0000 7f3e9312c800 10 monclient: get_monmap_and_config success 2024-09-12T00:48:48.488 INFO:tasks.workunit.client.0.smithi073.stderr: -210> 2024-09-12T00:48:48.194+0000 7f3e9312c800 4 set_mon_vals no callback set 2024-09-12T00:48:48.488 INFO:tasks.workunit.client.0.smithi073.stderr: -209> 2024-09-12T00:48:48.194+0000 7f3d727fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:48.488 INFO:tasks.workunit.client.0.smithi073.stderr: -208> 2024-09-12T00:48:48.194+0000 7f3d727fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:48:48.488 INFO:tasks.workunit.client.0.smithi073.stderr: -207> 2024-09-12T00:48:48.194+0000 7f3d727fc640 10 monclient: dump: 2024-09-12T00:48:48.488 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:48:48.489 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:48:48.489 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:48:48.489 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:48:48.489 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:48.489 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:48:48.489 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:48:48.489 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:48:48.489 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:48:48.489 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:48.489 INFO:tasks.workunit.client.0.smithi073.stderr: -206> 2024-09-12T00:48:48.195+0000 7f3e9312c800 10 monclient: shutdown 2024-09-12T00:48:48.489 INFO:tasks.workunit.client.0.smithi073.stderr: -205> 2024-09-12T00:48:48.195+0000 7f3e9312c800 10 monclient: build_initial_monmap 2024-09-12T00:48:48.489 INFO:tasks.workunit.client.0.smithi073.stderr: -204> 2024-09-12T00:48:48.195+0000 7f3e9312c800 1 build_initial for_mkfs: 0 2024-09-12T00:48:48.490 INFO:tasks.workunit.client.0.smithi073.stderr: -203> 2024-09-12T00:48:48.195+0000 7f3e9312c800 10 monclient: monmap: 2024-09-12T00:48:48.490 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:48:48.490 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:48:48.490 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:48:48.490 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:48:48.490 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:48:48.490 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:48:48.490 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:48:48.490 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:48:48.490 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:48:48.490 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:48.490 INFO:tasks.workunit.client.0.smithi073.stderr: -202> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1706f0) adding auth protocol: cephx 2024-09-12T00:48:48.491 INFO:tasks.workunit.client.0.smithi073.stderr: -201> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1706f0) adding auth protocol: cephx 2024-09-12T00:48:48.491 INFO:tasks.workunit.client.0.smithi073.stderr: -200> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1706f0) adding auth protocol: cephx 2024-09-12T00:48:48.491 INFO:tasks.workunit.client.0.smithi073.stderr: -199> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1706f0) adding con mode: secure 2024-09-12T00:48:48.491 INFO:tasks.workunit.client.0.smithi073.stderr: -198> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1706f0) adding con mode: crc 2024-09-12T00:48:48.491 INFO:tasks.workunit.client.0.smithi073.stderr: -197> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1706f0) adding con mode: secure 2024-09-12T00:48:48.491 INFO:tasks.workunit.client.0.smithi073.stderr: -196> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1706f0) adding con mode: crc 2024-09-12T00:48:48.491 INFO:tasks.workunit.client.0.smithi073.stderr: -195> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1706f0) adding con mode: secure 2024-09-12T00:48:48.491 INFO:tasks.workunit.client.0.smithi073.stderr: -194> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1706f0) adding con mode: crc 2024-09-12T00:48:48.491 INFO:tasks.workunit.client.0.smithi073.stderr: -193> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1706f0) adding con mode: crc 2024-09-12T00:48:48.491 INFO:tasks.workunit.client.0.smithi073.stderr: -192> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1706f0) adding con mode: secure 2024-09-12T00:48:48.491 INFO:tasks.workunit.client.0.smithi073.stderr: -191> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1706f0) adding con mode: crc 2024-09-12T00:48:48.491 INFO:tasks.workunit.client.0.smithi073.stderr: -190> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1706f0) adding con mode: secure 2024-09-12T00:48:48.491 INFO:tasks.workunit.client.0.smithi073.stderr: -189> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1706f0) adding con mode: crc 2024-09-12T00:48:48.492 INFO:tasks.workunit.client.0.smithi073.stderr: -188> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1706f0) adding con mode: secure 2024-09-12T00:48:48.492 INFO:tasks.workunit.client.0.smithi073.stderr: -187> 2024-09-12T00:48:48.195+0000 7f3e9312c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:48.492 INFO:tasks.workunit.client.0.smithi073.stderr: -186> 2024-09-12T00:48:48.195+0000 7f3e9312c800 1 librados: starting msgr at 2024-09-12T00:48:48.492 INFO:tasks.workunit.client.0.smithi073.stderr: -185> 2024-09-12T00:48:48.195+0000 7f3e9312c800 1 librados: starting objecter 2024-09-12T00:48:48.492 INFO:tasks.workunit.client.0.smithi073.stderr: -184> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 asok(0x55a8fbe8d630) register_command objecter_requests cmddesc objecter_requests hook 0x55a8fc14c640 EEXIST 2024-09-12T00:48:48.492 INFO:tasks.workunit.client.0.smithi073.stderr: -183> 2024-09-12T00:48:48.195+0000 7f3e9312c800 1 librados: setting wanted keys 2024-09-12T00:48:48.492 INFO:tasks.workunit.client.0.smithi073.stderr: -182> 2024-09-12T00:48:48.195+0000 7f3e9312c800 1 librados: calling monclient init 2024-09-12T00:48:48.492 INFO:tasks.workunit.client.0.smithi073.stderr: -181> 2024-09-12T00:48:48.195+0000 7f3e9312c800 10 monclient: init 2024-09-12T00:48:48.492 INFO:tasks.workunit.client.0.smithi073.stderr: -180> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1419c0) adding auth protocol: cephx 2024-09-12T00:48:48.492 INFO:tasks.workunit.client.0.smithi073.stderr: -179> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1419c0) adding auth protocol: cephx 2024-09-12T00:48:48.492 INFO:tasks.workunit.client.0.smithi073.stderr: -178> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1419c0) adding auth protocol: cephx 2024-09-12T00:48:48.492 INFO:tasks.workunit.client.0.smithi073.stderr: -177> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1419c0) adding con mode: secure 2024-09-12T00:48:48.493 INFO:tasks.workunit.client.0.smithi073.stderr: -176> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1419c0) adding con mode: crc 2024-09-12T00:48:48.493 INFO:tasks.workunit.client.0.smithi073.stderr: -175> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1419c0) adding con mode: secure 2024-09-12T00:48:48.493 INFO:tasks.workunit.client.0.smithi073.stderr: -174> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1419c0) adding con mode: crc 2024-09-12T00:48:48.493 INFO:tasks.workunit.client.0.smithi073.stderr: -173> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1419c0) adding con mode: secure 2024-09-12T00:48:48.493 INFO:tasks.workunit.client.0.smithi073.stderr: -172> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1419c0) adding con mode: crc 2024-09-12T00:48:48.493 INFO:tasks.workunit.client.0.smithi073.stderr: -171> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1419c0) adding con mode: crc 2024-09-12T00:48:48.493 INFO:tasks.workunit.client.0.smithi073.stderr: -170> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1419c0) adding con mode: secure 2024-09-12T00:48:48.493 INFO:tasks.workunit.client.0.smithi073.stderr: -169> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1419c0) adding con mode: crc 2024-09-12T00:48:48.493 INFO:tasks.workunit.client.0.smithi073.stderr: -168> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1419c0) adding con mode: secure 2024-09-12T00:48:48.493 INFO:tasks.workunit.client.0.smithi073.stderr: -167> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1419c0) adding con mode: crc 2024-09-12T00:48:48.493 INFO:tasks.workunit.client.0.smithi073.stderr: -166> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1419c0) adding con mode: secure 2024-09-12T00:48:48.493 INFO:tasks.workunit.client.0.smithi073.stderr: -165> 2024-09-12T00:48:48.196+0000 7f3e9312c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:48.494 INFO:tasks.workunit.client.0.smithi073.stderr: -164> 2024-09-12T00:48:48.196+0000 7f3e9312c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:48.494 INFO:tasks.workunit.client.0.smithi073.stderr: -163> 2024-09-12T00:48:48.196+0000 7f3e9312c800 5 asok(0x55a8fbe8d630) register_command rotate-key cmddesc rotate-key hook 0x55a8fc141b08 EEXIST 2024-09-12T00:48:48.494 INFO:tasks.workunit.client.0.smithi073.stderr: -162> 2024-09-12T00:48:48.196+0000 7f3e9312c800 10 monclient: _reopen_session rank -1 2024-09-12T00:48:48.494 INFO:tasks.workunit.client.0.smithi073.stderr: -161> 2024-09-12T00:48:48.196+0000 7f3e9312c800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:48:48.494 INFO:tasks.workunit.client.0.smithi073.stderr: -160> 2024-09-12T00:48:48.196+0000 7f3e9312c800 10 monclient(hunting): picked mon.noname-a con 0x55a8fc14f1a0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:48:48.494 INFO:tasks.workunit.client.0.smithi073.stderr: -159> 2024-09-12T00:48:48.196+0000 7f3e9312c800 10 monclient(hunting): picked mon.noname-b con 0x55a8fc179af0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:48:48.494 INFO:tasks.workunit.client.0.smithi073.stderr: -158> 2024-09-12T00:48:48.196+0000 7f3e9312c800 10 monclient(hunting): picked mon.noname-c con 0x55a8fc17e250 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:48:48.494 INFO:tasks.workunit.client.0.smithi073.stderr: -157> 2024-09-12T00:48:48.196+0000 7f3e9312c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:48.494 INFO:tasks.workunit.client.0.smithi073.stderr: -156> 2024-09-12T00:48:48.196+0000 7f3e9312c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:48.494 INFO:tasks.workunit.client.0.smithi073.stderr: -155> 2024-09-12T00:48:48.196+0000 7f3e9312c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:48.494 INFO:tasks.workunit.client.0.smithi073.stderr: -154> 2024-09-12T00:48:48.196+0000 7f3e9312c800 10 monclient(hunting): _renew_subs 2024-09-12T00:48:48.494 INFO:tasks.workunit.client.0.smithi073.stderr: -153> 2024-09-12T00:48:48.196+0000 7f3e9312c800 10 monclient(hunting): authenticate will time out at 1988.867441s 2024-09-12T00:48:48.495 INFO:tasks.workunit.client.0.smithi073.stderr: -152> 2024-09-12T00:48:48.196+0000 7f3e8ed61640 10 monclient(hunting): get_auth_request con 0x55a8fc14f1a0 auth_method 0 2024-09-12T00:48:48.495 INFO:tasks.workunit.client.0.smithi073.stderr: -151> 2024-09-12T00:48:48.196+0000 7f3e8ed61640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:48.495 INFO:tasks.workunit.client.0.smithi073.stderr: -150> 2024-09-12T00:48:48.196+0000 7f3e8ed61640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:48.495 INFO:tasks.workunit.client.0.smithi073.stderr: -149> 2024-09-12T00:48:48.196+0000 7f3e8ed61640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:48.495 INFO:tasks.workunit.client.0.smithi073.stderr: -148> 2024-09-12T00:48:48.196+0000 7f3e8f562640 10 monclient(hunting): get_auth_request con 0x55a8fc17e250 auth_method 0 2024-09-12T00:48:48.495 INFO:tasks.workunit.client.0.smithi073.stderr: -147> 2024-09-12T00:48:48.196+0000 7f3e8f562640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:48.495 INFO:tasks.workunit.client.0.smithi073.stderr: -146> 2024-09-12T00:48:48.196+0000 7f3e8f562640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:48.495 INFO:tasks.workunit.client.0.smithi073.stderr: -145> 2024-09-12T00:48:48.196+0000 7f3e8f562640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:48.495 INFO:tasks.workunit.client.0.smithi073.stderr: -144> 2024-09-12T00:48:48.196+0000 7f3e8ed61640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:48.495 INFO:tasks.workunit.client.0.smithi073.stderr: -143> 2024-09-12T00:48:48.196+0000 7f3e8ed61640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:48.495 INFO:tasks.workunit.client.0.smithi073.stderr: -142> 2024-09-12T00:48:48.196+0000 7f3e8ed61640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:48.495 INFO:tasks.workunit.client.0.smithi073.stderr: -141> 2024-09-12T00:48:48.196+0000 7f3e8f562640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:48.495 INFO:tasks.workunit.client.0.smithi073.stderr: -140> 2024-09-12T00:48:48.196+0000 7f3e8f562640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:48.495 INFO:tasks.workunit.client.0.smithi073.stderr: -139> 2024-09-12T00:48:48.196+0000 7f3e8f562640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:48.495 INFO:tasks.workunit.client.0.smithi073.stderr: -138> 2024-09-12T00:48:48.196+0000 7f3e8e560640 10 monclient(hunting): get_auth_request con 0x55a8fc179af0 auth_method 0 2024-09-12T00:48:48.496 INFO:tasks.workunit.client.0.smithi073.stderr: -137> 2024-09-12T00:48:48.196+0000 7f3e8e560640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:48.496 INFO:tasks.workunit.client.0.smithi073.stderr: -136> 2024-09-12T00:48:48.196+0000 7f3e8e560640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:48.496 INFO:tasks.workunit.client.0.smithi073.stderr: -135> 2024-09-12T00:48:48.196+0000 7f3e8e560640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:48.496 INFO:tasks.workunit.client.0.smithi073.stderr: -134> 2024-09-12T00:48:48.196+0000 7f3e8ed61640 10 monclient(hunting): handle_auth_done global_id 6393 payload 824 2024-09-12T00:48:48.496 INFO:tasks.workunit.client.0.smithi073.stderr: -133> 2024-09-12T00:48:48.196+0000 7f3e8ed61640 10 monclient: _finish_hunting 0 2024-09-12T00:48:48.496 INFO:tasks.workunit.client.0.smithi073.stderr: -132> 2024-09-12T00:48:48.196+0000 7f3e8ed61640 1 monclient: found mon.noname-a 2024-09-12T00:48:48.496 INFO:tasks.workunit.client.0.smithi073.stderr: -131> 2024-09-12T00:48:48.196+0000 7f3e8ed61640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:48:48.496 INFO:tasks.workunit.client.0.smithi073.stderr: -130> 2024-09-12T00:48:48.197+0000 7f3d70ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:48.496 INFO:tasks.workunit.client.0.smithi073.stderr: -129> 2024-09-12T00:48:48.197+0000 7f3d70ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:48:48.496 INFO:tasks.workunit.client.0.smithi073.stderr: -128> 2024-09-12T00:48:48.197+0000 7f3d70ff9640 10 monclient: dump: 2024-09-12T00:48:48.496 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:48:48.496 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:48:48.497 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:48:48.497 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:48:48.497 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:48.497 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:48:48.497 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:48:48.497 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:48:48.497 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:48:48.497 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:48.497 INFO:tasks.workunit.client.0.smithi073.stderr: -127> 2024-09-12T00:48:48.197+0000 7f3d70ff9640 10 monclient: _finish_auth 0 2024-09-12T00:48:48.497 INFO:tasks.workunit.client.0.smithi073.stderr: -126> 2024-09-12T00:48:48.197+0000 7f3d70ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:48:48.497 INFO:tasks.workunit.client.0.smithi073.stderr: -125> 2024-09-12T00:48:48.197+0000 7f3d70ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:48:48.497 INFO:tasks.workunit.client.0.smithi073.stderr: -124> 2024-09-12T00:48:48.197+0000 7f3d70ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:48.497 INFO:tasks.workunit.client.0.smithi073.stderr: -123> 2024-09-12T00:48:48.197+0000 7f3d70ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:48:48.497 INFO:tasks.workunit.client.0.smithi073.stderr: -122> 2024-09-12T00:48:48.197+0000 7f3d70ff9640 10 monclient: dump: 2024-09-12T00:48:48.498 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:48:48.498 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:48:48.498 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:48:48.498 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:48:48.498 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:48.498 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:48:48.498 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:48:48.498 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:48:48.498 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:48:48.498 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:48.498 INFO:tasks.workunit.client.0.smithi073.stderr: -121> 2024-09-12T00:48:48.197+0000 7f3e9312c800 5 monclient: authenticate success, global_id 6393 2024-09-12T00:48:48.498 INFO:tasks.workunit.client.0.smithi073.stderr: -120> 2024-09-12T00:48:48.197+0000 7f3e9312c800 10 monclient: _renew_subs 2024-09-12T00:48:48.498 INFO:tasks.workunit.client.0.smithi073.stderr: -119> 2024-09-12T00:48:48.197+0000 7f3d727fc640 4 set_mon_vals no callback set 2024-09-12T00:48:48.499 INFO:tasks.workunit.client.0.smithi073.stderr: -118> 2024-09-12T00:48:48.197+0000 7f3e9312c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:48:48.499 INFO:tasks.workunit.client.0.smithi073.stderr: -117> 2024-09-12T00:48:48.197+0000 7f3e9312c800 10 monclient: _renew_subs 2024-09-12T00:48:48.499 INFO:tasks.workunit.client.0.smithi073.stderr: -116> 2024-09-12T00:48:48.197+0000 7f3e9312c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:48:48.499 INFO:tasks.workunit.client.0.smithi073.stderr: -115> 2024-09-12T00:48:48.197+0000 7f3e9312c800 1 librados: init done 2024-09-12T00:48:48.499 INFO:tasks.workunit.client.0.smithi073.stderr: -114> 2024-09-12T00:48:48.197+0000 7f3e9312c800 5 asok(0x55a8fbe8d630) register_command cr dump hook 0x55a8fc14e398 2024-09-12T00:48:48.499 INFO:tasks.workunit.client.0.smithi073.stderr: -113> 2024-09-12T00:48:48.198+0000 7f3e9312c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.499 INFO:tasks.workunit.client.0.smithi073.stderr: -112> 2024-09-12T00:48:48.199+0000 7f3d70ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:48:48.499 INFO:tasks.workunit.client.0.smithi073.stderr: -111> 2024-09-12T00:48:48.199+0000 7f3d70ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:48:48.499 INFO:tasks.workunit.client.0.smithi073.stderr: -110> 2024-09-12T00:48:48.199+0000 7f3d70ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:48:48.499 INFO:tasks.workunit.client.0.smithi073.stderr: -109> 2024-09-12T00:48:48.199+0000 7f3e8e560640 10 monclient: get_auth_request con 0x7f3d580764a0 auth_method 0 2024-09-12T00:48:48.499 INFO:tasks.workunit.client.0.smithi073.stderr: -108> 2024-09-12T00:48:48.199+0000 7f3e8f562640 10 monclient: get_auth_request con 0x55a8fc198920 auth_method 0 2024-09-12T00:48:48.499 INFO:tasks.workunit.client.0.smithi073.stderr: -107> 2024-09-12T00:48:48.200+0000 7f3e9312c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:48.499 INFO:tasks.workunit.client.0.smithi073.stderr: -106> 2024-09-12T00:48:48.200+0000 7f3e9312c800 20 realm 2024-09-12T00:48:48.499 INFO:tasks.workunit.client.0.smithi073.stderr: -105> 2024-09-12T00:48:48.200+0000 7f3e9312c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.499 INFO:tasks.workunit.client.0.smithi073.stderr: -104> 2024-09-12T00:48:48.200+0000 7f3e9312c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:48.500 INFO:tasks.workunit.client.0.smithi073.stderr: -103> 2024-09-12T00:48:48.200+0000 7f3e9312c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:48.500 INFO:tasks.workunit.client.0.smithi073.stderr: -102> 2024-09-12T00:48:48.200+0000 7f3e9312c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.500 INFO:tasks.workunit.client.0.smithi073.stderr: -101> 2024-09-12T00:48:48.200+0000 7f3e9312c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:48.500 INFO:tasks.workunit.client.0.smithi073.stderr: -100> 2024-09-12T00:48:48.200+0000 7f3e9312c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.500 INFO:tasks.workunit.client.0.smithi073.stderr: -99> 2024-09-12T00:48:48.201+0000 7f3e8ed61640 10 monclient: get_auth_request con 0x55a8fc19cb10 auth_method 0 2024-09-12T00:48:48.500 INFO:tasks.workunit.client.0.smithi073.stderr: -98> 2024-09-12T00:48:48.201+0000 7f3e9312c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:48.500 INFO:tasks.workunit.client.0.smithi073.stderr: -97> 2024-09-12T00:48:48.202+0000 7f3e9312c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.500 INFO:tasks.workunit.client.0.smithi073.stderr: -96> 2024-09-12T00:48:48.202+0000 7f3e8e560640 10 monclient: get_auth_request con 0x55a8fc1a0370 auth_method 0 2024-09-12T00:48:48.500 INFO:tasks.workunit.client.0.smithi073.stderr: -95> 2024-09-12T00:48:48.202+0000 7f3e9312c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:48.500 INFO:tasks.workunit.client.0.smithi073.stderr: -94> 2024-09-12T00:48:48.202+0000 7f3e9312c800 20 searching for the correct realm 2024-09-12T00:48:48.500 INFO:tasks.workunit.client.0.smithi073.stderr: -93> 2024-09-12T00:48:48.203+0000 7f3e8f562640 10 monclient: get_auth_request con 0x55a8fc1a5130 auth_method 0 2024-09-12T00:48:48.500 INFO:tasks.workunit.client.0.smithi073.stderr: -92> 2024-09-12T00:48:48.203+0000 7f3e8ed61640 10 monclient: get_auth_request con 0x7f3e88023930 auth_method 0 2024-09-12T00:48:48.500 INFO:tasks.workunit.client.0.smithi073.stderr: -91> 2024-09-12T00:48:48.204+0000 7f3e8e560640 10 monclient: get_auth_request con 0x7f3e80099650 auth_method 0 2024-09-12T00:48:48.501 INFO:tasks.workunit.client.0.smithi073.stderr: -90> 2024-09-12T00:48:48.205+0000 7f3e8f562640 10 monclient: get_auth_request con 0x7f3e84018070 auth_method 0 2024-09-12T00:48:48.501 INFO:tasks.workunit.client.0.smithi073.stderr: -89> 2024-09-12T00:48:48.205+0000 7f3e8f562640 0 -- 172.21.15.73:0/1364781717 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f3e84018070 msgr2=0x7f3e84089d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:48.501 INFO:tasks.workunit.client.0.smithi073.stderr: -88> 2024-09-12T00:48:48.407+0000 7f3e8f562640 10 monclient: get_auth_request con 0x7f3e84018070 auth_method 0 2024-09-12T00:48:48.501 INFO:tasks.workunit.client.0.smithi073.stderr: -87> 2024-09-12T00:48:48.412+0000 7f3e8ed61640 10 monclient: get_auth_request con 0x7f3e88043040 auth_method 0 2024-09-12T00:48:48.501 INFO:tasks.workunit.client.0.smithi073.stderr: -86> 2024-09-12T00:48:48.413+0000 7f3e8f562640 0 -- 172.21.15.73:0/1364781717 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f3e84018070 msgr2=0x7f3e84089d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:48.501 INFO:tasks.workunit.client.0.smithi073.stderr: -85> 2024-09-12T00:48:48.413+0000 7f3d70ff9640 1 client.6393.objecter ms_handle_reset 0x7f3e84018070 session 0x7f3e8408f870 osd.4 2024-09-12T00:48:48.501 INFO:tasks.workunit.client.0.smithi073.stderr: -84> 2024-09-12T00:48:48.413+0000 7f3d70ff9640 10 monclient: _renew_subs 2024-09-12T00:48:48.501 INFO:tasks.workunit.client.0.smithi073.stderr: -83> 2024-09-12T00:48:48.413+0000 7f3d70ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:48:48.501 INFO:tasks.workunit.client.0.smithi073.stderr: -82> 2024-09-12T00:48:48.413+0000 7f3e8f562640 10 monclient: get_auth_request con 0x7f3d580862c0 auth_method 0 2024-09-12T00:48:48.501 INFO:tasks.workunit.client.0.smithi073.stderr: -81> 2024-09-12T00:48:48.417+0000 7f3e9312c800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:48:48.501 INFO:tasks.workunit.client.0.smithi073.stderr: -80> 2024-09-12T00:48:48.417+0000 7f3e9312c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:48.501 INFO:tasks.workunit.client.0.smithi073.stderr: -79> 2024-09-12T00:48:48.417+0000 7f3e9312c800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:48:48.501 INFO:tasks.workunit.client.0.smithi073.stderr: -78> 2024-09-12T00:48:48.417+0000 7f3e9312c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:48.501 INFO:tasks.workunit.client.0.smithi073.stderr: -77> 2024-09-12T00:48:48.417+0000 7f3e9312c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:48.502 INFO:tasks.workunit.client.0.smithi073.stderr: -76> 2024-09-12T00:48:48.417+0000 7f3e9312c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:48.502 INFO:tasks.workunit.client.0.smithi073.stderr: -75> 2024-09-12T00:48:48.417+0000 7f3e9312c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.502 INFO:tasks.workunit.client.0.smithi073.stderr: -74> 2024-09-12T00:48:48.417+0000 7f3e9312c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:48.502 INFO:tasks.workunit.client.0.smithi073.stderr: -73> 2024-09-12T00:48:48.417+0000 7f3e9312c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.502 INFO:tasks.workunit.client.0.smithi073.stderr: -72> 2024-09-12T00:48:48.418+0000 7f3e9312c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:48.502 INFO:tasks.workunit.client.0.smithi073.stderr: -71> 2024-09-12T00:48:48.418+0000 7f3e9312c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.502 INFO:tasks.workunit.client.0.smithi073.stderr: -70> 2024-09-12T00:48:48.418+0000 7f3e9312c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:48.502 INFO:tasks.workunit.client.0.smithi073.stderr: -69> 2024-09-12T00:48:48.418+0000 7f3e9312c800 20 zone default found 2024-09-12T00:48:48.502 INFO:tasks.workunit.client.0.smithi073.stderr: -68> 2024-09-12T00:48:48.418+0000 7f3e9312c800 4 Realm: () 2024-09-12T00:48:48.502 INFO:tasks.workunit.client.0.smithi073.stderr: -67> 2024-09-12T00:48:48.418+0000 7f3e9312c800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:48:48.502 INFO:tasks.workunit.client.0.smithi073.stderr: -66> 2024-09-12T00:48:48.418+0000 7f3e9312c800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:48:48.502 INFO:tasks.workunit.client.0.smithi073.stderr: -65> 2024-09-12T00:48:48.418+0000 7f3e9312c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:48.502 INFO:tasks.workunit.client.0.smithi073.stderr: -64> 2024-09-12T00:48:48.418+0000 7f3e9312c800 20 zonegroup default 2024-09-12T00:48:48.502 INFO:tasks.workunit.client.0.smithi073.stderr: -63> 2024-09-12T00:48:48.418+0000 7f3e9312c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.502 INFO:tasks.workunit.client.0.smithi073.stderr: -62> 2024-09-12T00:48:48.418+0000 7f3e9312c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:48.503 INFO:tasks.workunit.client.0.smithi073.stderr: -61> 2024-09-12T00:48:48.418+0000 7f3e9312c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.503 INFO:tasks.workunit.client.0.smithi073.stderr: -60> 2024-09-12T00:48:48.419+0000 7f3e9312c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:48.503 INFO:tasks.workunit.client.0.smithi073.stderr: -59> 2024-09-12T00:48:48.419+0000 7f3e9312c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.503 INFO:tasks.workunit.client.0.smithi073.stderr: -58> 2024-09-12T00:48:48.419+0000 7f3e9312c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:48.503 INFO:tasks.workunit.client.0.smithi073.stderr: -57> 2024-09-12T00:48:48.419+0000 7f3e9312c800 20 started sync module instance, tier type = 2024-09-12T00:48:48.503 INFO:tasks.workunit.client.0.smithi073.stderr: -56> 2024-09-12T00:48:48.419+0000 7f3e9312c800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:48:48.503 INFO:tasks.workunit.client.0.smithi073.stderr: -55> 2024-09-12T00:48:48.428+0000 7f3e9312c800 20 add_watcher() i=0 2024-09-12T00:48:48.503 INFO:tasks.workunit.client.0.smithi073.stderr: -54> 2024-09-12T00:48:48.428+0000 7f3e9312c800 20 add_watcher() i=1 2024-09-12T00:48:48.503 INFO:tasks.workunit.client.0.smithi073.stderr: -53> 2024-09-12T00:48:48.428+0000 7f3e9312c800 20 add_watcher() i=2 2024-09-12T00:48:48.503 INFO:tasks.workunit.client.0.smithi073.stderr: -52> 2024-09-12T00:48:48.428+0000 7f3e9312c800 20 add_watcher() i=3 2024-09-12T00:48:48.503 INFO:tasks.workunit.client.0.smithi073.stderr: -51> 2024-09-12T00:48:48.428+0000 7f3e9312c800 20 add_watcher() i=4 2024-09-12T00:48:48.503 INFO:tasks.workunit.client.0.smithi073.stderr: -50> 2024-09-12T00:48:48.428+0000 7f3e9312c800 20 add_watcher() i=5 2024-09-12T00:48:48.503 INFO:tasks.workunit.client.0.smithi073.stderr: -49> 2024-09-12T00:48:48.428+0000 7f3e9312c800 20 add_watcher() i=6 2024-09-12T00:48:48.503 INFO:tasks.workunit.client.0.smithi073.stderr: -48> 2024-09-12T00:48:48.429+0000 7f3e9312c800 20 add_watcher() i=7 2024-09-12T00:48:48.504 INFO:tasks.workunit.client.0.smithi073.stderr: -47> 2024-09-12T00:48:48.429+0000 7f3e9312c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:48.504 INFO:tasks.workunit.client.0.smithi073.stderr: -46> 2024-09-12T00:48:48.431+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815696b0) adding auth protocol: cephx 2024-09-12T00:48:48.504 INFO:tasks.workunit.client.0.smithi073.stderr: -45> 2024-09-12T00:48:48.431+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815696b0) adding auth protocol: cephx 2024-09-12T00:48:48.504 INFO:tasks.workunit.client.0.smithi073.stderr: -44> 2024-09-12T00:48:48.431+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815696b0) adding auth protocol: cephx 2024-09-12T00:48:48.504 INFO:tasks.workunit.client.0.smithi073.stderr: -43> 2024-09-12T00:48:48.431+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815696b0) adding con mode: secure 2024-09-12T00:48:48.504 INFO:tasks.workunit.client.0.smithi073.stderr: -42> 2024-09-12T00:48:48.431+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815696b0) adding con mode: crc 2024-09-12T00:48:48.504 INFO:tasks.workunit.client.0.smithi073.stderr: -41> 2024-09-12T00:48:48.431+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815696b0) adding con mode: secure 2024-09-12T00:48:48.504 INFO:tasks.workunit.client.0.smithi073.stderr: -40> 2024-09-12T00:48:48.431+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815696b0) adding con mode: crc 2024-09-12T00:48:48.504 INFO:tasks.workunit.client.0.smithi073.stderr: -39> 2024-09-12T00:48:48.431+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815696b0) adding con mode: secure 2024-09-12T00:48:48.504 INFO:tasks.workunit.client.0.smithi073.stderr: -38> 2024-09-12T00:48:48.431+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815696b0) adding con mode: crc 2024-09-12T00:48:48.504 INFO:tasks.workunit.client.0.smithi073.stderr: -37> 2024-09-12T00:48:48.431+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815696b0) adding con mode: crc 2024-09-12T00:48:48.504 INFO:tasks.workunit.client.0.smithi073.stderr: -36> 2024-09-12T00:48:48.431+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815696b0) adding con mode: secure 2024-09-12T00:48:48.504 INFO:tasks.workunit.client.0.smithi073.stderr: -35> 2024-09-12T00:48:48.431+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815696b0) adding con mode: crc 2024-09-12T00:48:48.504 INFO:tasks.workunit.client.0.smithi073.stderr: -34> 2024-09-12T00:48:48.431+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815696b0) adding con mode: secure 2024-09-12T00:48:48.505 INFO:tasks.workunit.client.0.smithi073.stderr: -33> 2024-09-12T00:48:48.431+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815696b0) adding con mode: crc 2024-09-12T00:48:48.505 INFO:tasks.workunit.client.0.smithi073.stderr: -32> 2024-09-12T00:48:48.431+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815696b0) adding con mode: secure 2024-09-12T00:48:48.505 INFO:tasks.workunit.client.0.smithi073.stderr: -31> 2024-09-12T00:48:48.431+0000 7f3d457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:48.505 INFO:tasks.workunit.client.0.smithi073.stderr: -30> 2024-09-12T00:48:48.431+0000 7f3e9312c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:48.505 INFO:tasks.workunit.client.0.smithi073.stderr: -29> 2024-09-12T00:48:48.431+0000 7f3e9312c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:48.505 INFO:tasks.workunit.client.0.smithi073.stderr: -28> 2024-09-12T00:48:48.431+0000 7f3e9312c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:48.505 INFO:tasks.workunit.client.0.smithi073.stderr: -27> 2024-09-12T00:48:48.431+0000 7f3e9312c800 5 asok(0x55a8fbe8d630) register_command cache list hook 0x55a8fc1888e0 2024-09-12T00:48:48.505 INFO:tasks.workunit.client.0.smithi073.stderr: -26> 2024-09-12T00:48:48.431+0000 7f3e9312c800 5 asok(0x55a8fbe8d630) register_command cache inspect hook 0x55a8fc1888e0 2024-09-12T00:48:48.505 INFO:tasks.workunit.client.0.smithi073.stderr: -25> 2024-09-12T00:48:48.431+0000 7f3e9312c800 5 asok(0x55a8fbe8d630) register_command cache erase hook 0x55a8fc1888e0 2024-09-12T00:48:48.505 INFO:tasks.workunit.client.0.smithi073.stderr: -24> 2024-09-12T00:48:48.431+0000 7f3e9312c800 5 asok(0x55a8fbe8d630) register_command cache zap hook 0x55a8fc1888e0 2024-09-12T00:48:48.505 INFO:tasks.workunit.client.0.smithi073.stderr: -23> 2024-09-12T00:48:48.431+0000 7f3e9312c800 5 note: GC not initialized 2024-09-12T00:48:48.505 INFO:tasks.workunit.client.0.smithi073.stderr: -22> 2024-09-12T00:48:48.431+0000 7f3cbffff640 20 reqs_thread_entry: start 2024-09-12T00:48:48.505 INFO:tasks.workunit.client.0.smithi073.stderr: -21> 2024-09-12T00:48:48.431+0000 7f3e9312c800 5 asok(0x55a8fbe8d630) register_command sync trace show hook 0x7f3e8800c040 2024-09-12T00:48:48.505 INFO:tasks.workunit.client.0.smithi073.stderr: -20> 2024-09-12T00:48:48.431+0000 7f3e9312c800 5 asok(0x55a8fbe8d630) register_command sync trace history hook 0x7f3e8800c040 2024-09-12T00:48:48.506 INFO:tasks.workunit.client.0.smithi073.stderr: -19> 2024-09-12T00:48:48.431+0000 7f3e9312c800 5 asok(0x55a8fbe8d630) register_command sync trace active hook 0x7f3e8800c040 2024-09-12T00:48:48.506 INFO:tasks.workunit.client.0.smithi073.stderr: -18> 2024-09-12T00:48:48.431+0000 7f3e9312c800 5 asok(0x55a8fbe8d630) register_command sync trace active_short hook 0x7f3e8800c040 2024-09-12T00:48:48.506 INFO:tasks.workunit.client.0.smithi073.stderr: -17> 2024-09-12T00:48:48.432+0000 7f3e9312c800 20 init_complete bucket index max shards: 1 2024-09-12T00:48:48.506 INFO:tasks.workunit.client.0.smithi073.stderr: -16> 2024-09-12T00:48:48.432+0000 7f3e9312c800 20 Filter name: none 2024-09-12T00:48:48.506 INFO:tasks.workunit.client.0.smithi073.stderr: -15> 2024-09-12T00:48:48.432+0000 7f3cbdffb640 20 reqs_thread_entry: start 2024-09-12T00:48:48.506 INFO:tasks.workunit.client.0.smithi073.stderr: -14> 2024-09-12T00:48:48.432+0000 7f3e9312c800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:48:48.506 INFO:tasks.workunit.client.0.smithi073.stderr: -13> 2024-09-12T00:48:48.432+0000 7f3e9312c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.506 INFO:tasks.workunit.client.0.smithi073.stderr: -12> 2024-09-12T00:48:48.432+0000 7f3e9312c800 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:48:48.506 INFO:tasks.workunit.client.0.smithi073.stderr: -11> 2024-09-12T00:48:48.432+0000 7f3e9312c800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:48:48.506 INFO:tasks.workunit.client.0.smithi073.stderr: -10> 2024-09-12T00:48:48.432+0000 7f3e9312c800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:48:48.506 INFO:tasks.workunit.client.0.smithi073.stderr: -9> 2024-09-12T00:48:48.432+0000 7f3e9312c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21 : miss 2024-09-12T00:48:48.506 INFO:tasks.workunit.client.0.smithi073.stderr: -8> 2024-09-12T00:48:48.432+0000 7f3e9312c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.506 INFO:tasks.workunit.client.0.smithi073.stderr: -7> 2024-09-12T00:48:48.433+0000 7f3e9312c800 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:48:48.507 INFO:tasks.workunit.client.0.smithi073.stderr: -6> 2024-09-12T00:48:48.433+0000 7f3e9312c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21 info.flags=0x17 2024-09-12T00:48:48.507 INFO:tasks.workunit.client.0.smithi073.stderr: -5> 2024-09-12T00:48:48.433+0000 7f3e9312c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21 to cache LRU end 2024-09-12T00:48:48.507 INFO:tasks.workunit.client.0.smithi073.stderr: -4> 2024-09-12T00:48:48.433+0000 7f3e9312c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:48:48.507 INFO:tasks.workunit.client.0.smithi073.stderr: -3> 2024-09-12T00:48:48.433+0000 7f3e9312c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:48.507 INFO:tasks.workunit.client.0.smithi073.stderr: -2> 2024-09-12T00:48:48.433+0000 7f3e9312c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21 2024-09-12T00:48:48.507 INFO:tasks.workunit.client.0.smithi073.stderr: -1> 2024-09-12T00:48:48.435+0000 7f3e9312c800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3e9312c800 time 2024-09-12T00:48:48.436536+0000 2024-09-12T00:48:48.507 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:48:48.507 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:48.507 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:48:48.507 INFO:tasks.workunit.client.0.smithi073.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3e9478c71a] 2024-09-12T00:48:48.507 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3e9478c8d8] 2024-09-12T00:48:48.507 INFO:tasks.workunit.client.0.smithi073.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a8fa672641] 2024-09-12T00:48:48.507 INFO:tasks.workunit.client.0.smithi073.stderr: 4: radosgw-admin(+0xd877a4) [0x55a8fab847a4] 2024-09-12T00:48:48.507 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a8fa68231d] 2024-09-12T00:48:48.508 INFO:tasks.workunit.client.0.smithi073.stderr: 6: main() 2024-09-12T00:48:48.508 INFO:tasks.workunit.client.0.smithi073.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f3e93429590] 2024-09-12T00:48:48.508 INFO:tasks.workunit.client.0.smithi073.stderr: 8: __libc_start_main() 2024-09-12T00:48:48.508 INFO:tasks.workunit.client.0.smithi073.stderr: 9: _start() 2024-09-12T00:48:48.508 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:48.508 INFO:tasks.workunit.client.0.smithi073.stderr: 0> 2024-09-12T00:48:48.436+0000 7f3e9312c800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:48:48.508 INFO:tasks.workunit.client.0.smithi073.stderr: in thread 7f3e9312c800 thread_name:radosgw-admin 2024-09-12T00:48:48.508 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:48.508 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:48:48.508 INFO:tasks.workunit.client.0.smithi073.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3e9343e6f0] 2024-09-12T00:48:48.508 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3e9348b99c] 2024-09-12T00:48:48.508 INFO:tasks.workunit.client.0.smithi073.stderr: 3: raise() 2024-09-12T00:48:48.508 INFO:tasks.workunit.client.0.smithi073.stderr: 4: abort() 2024-09-12T00:48:48.508 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3e9478c774] 2024-09-12T00:48:48.508 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3e9478c8d8] 2024-09-12T00:48:48.509 INFO:tasks.workunit.client.0.smithi073.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a8fa672641] 2024-09-12T00:48:48.509 INFO:tasks.workunit.client.0.smithi073.stderr: 8: radosgw-admin(+0xd877a4) [0x55a8fab847a4] 2024-09-12T00:48:48.509 INFO:tasks.workunit.client.0.smithi073.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a8fa68231d] 2024-09-12T00:48:48.509 INFO:tasks.workunit.client.0.smithi073.stderr: 10: main() 2024-09-12T00:48:48.509 INFO:tasks.workunit.client.0.smithi073.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f3e93429590] 2024-09-12T00:48:48.509 INFO:tasks.workunit.client.0.smithi073.stderr: 12: __libc_start_main() 2024-09-12T00:48:48.509 INFO:tasks.workunit.client.0.smithi073.stderr: 13: _start() 2024-09-12T00:48:48.509 INFO:tasks.workunit.client.0.smithi073.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:48:48.509 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:48.509 INFO:tasks.workunit.client.0.smithi073.stderr:--- logging levels --- 2024-09-12T00:48:48.509 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 none 2024-09-12T00:48:48.509 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 lockdep 2024-09-12T00:48:48.510 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 context 2024-09-12T00:48:48.510 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 crush 2024-09-12T00:48:48.510 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds 2024-09-12T00:48:48.510 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_balancer 2024-09-12T00:48:48.510 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_locker 2024-09-12T00:48:48.510 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_log 2024-09-12T00:48:48.510 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_log_expire 2024-09-12T00:48:48.510 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_migrator 2024-09-12T00:48:48.510 INFO:tasks.workunit.client.0.smithi073.stderr: 3/ 5 mds_quiesce 2024-09-12T00:48:48.510 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 buffer 2024-09-12T00:48:48.510 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 timer 2024-09-12T00:48:48.510 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 filer 2024-09-12T00:48:48.510 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 striper 2024-09-12T00:48:48.511 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 objecter 2024-09-12T00:48:48.511 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rados 2024-09-12T00:48:48.511 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd 2024-09-12T00:48:48.511 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_mirror 2024-09-12T00:48:48.511 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_replay 2024-09-12T00:48:48.511 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_pwl 2024-09-12T00:48:48.511 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 journaler 2024-09-12T00:48:48.511 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 objectcacher 2024-09-12T00:48:48.511 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:48:48.511 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 client 2024-09-12T00:48:48.511 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 osd 2024-09-12T00:48:48.511 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 optracker 2024-09-12T00:48:48.511 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 objclass 2024-09-12T00:48:48.511 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 filestore 2024-09-12T00:48:48.512 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 journal 2024-09-12T00:48:48.512 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 0 ms 2024-09-12T00:48:48.512 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mon 2024-09-12T00:48:48.512 INFO:tasks.workunit.client.0.smithi073.stderr: 0/10 monc 2024-09-12T00:48:48.512 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 paxos 2024-09-12T00:48:48.512 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 tp 2024-09-12T00:48:48.512 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 auth 2024-09-12T00:48:48.512 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 crypto 2024-09-12T00:48:48.512 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 finisher 2024-09-12T00:48:48.512 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 reserver 2024-09-12T00:48:48.512 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 heartbeatmap 2024-09-12T00:48:48.512 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 perfcounter 2024-09-12T00:48:48.512 INFO:tasks.workunit.client.0.smithi073.stderr: 20/20 rgw 2024-09-12T00:48:48.512 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_sync 2024-09-12T00:48:48.513 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_datacache 2024-09-12T00:48:48.513 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_access 2024-09-12T00:48:48.513 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:48:48.513 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_flight 2024-09-12T00:48:48.513 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:48:48.513 INFO:tasks.workunit.client.0.smithi073.stderr: 20/20 rgw_notification 2024-09-12T00:48:48.513 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 javaclient 2024-09-12T00:48:48.513 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 asok 2024-09-12T00:48:48.513 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 throttle 2024-09-12T00:48:48.513 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 0 refs 2024-09-12T00:48:48.513 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 compressor 2024-09-12T00:48:48.513 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 bluestore 2024-09-12T00:48:48.513 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 bluefs 2024-09-12T00:48:48.514 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 bdev 2024-09-12T00:48:48.514 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 kstore 2024-09-12T00:48:48.514 INFO:tasks.workunit.client.0.smithi073.stderr: 4/ 5 rocksdb 2024-09-12T00:48:48.514 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 fuse 2024-09-12T00:48:48.514 INFO:tasks.workunit.client.0.smithi073.stderr: 2/ 5 mgr 2024-09-12T00:48:48.514 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mgrc 2024-09-12T00:48:48.514 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 dpdk 2024-09-12T00:48:48.514 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 eventtrace 2024-09-12T00:48:48.514 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 prioritycache 2024-09-12T00:48:48.514 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 test 2024-09-12T00:48:48.514 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:48:48.514 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cephsqlite 2024-09-12T00:48:48.514 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:48:48.514 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore 2024-09-12T00:48:48.514 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_onode 2024-09-12T00:48:48.515 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_odata 2024-09-12T00:48:48.515 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_omap 2024-09-12T00:48:48.515 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_tm 2024-09-12T00:48:48.515 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_t 2024-09-12T00:48:48.515 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:48:48.515 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_epm 2024-09-12T00:48:48.515 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_lba 2024-09-12T00:48:48.515 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:48:48.515 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_cache 2024-09-12T00:48:48.515 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_journal 2024-09-12T00:48:48.515 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_device 2024-09-12T00:48:48.515 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_backref 2024-09-12T00:48:48.515 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 alienstore 2024-09-12T00:48:48.516 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mclock 2024-09-12T00:48:48.516 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cyanstore 2024-09-12T00:48:48.516 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 ceph_exporter 2024-09-12T00:48:48.516 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 memstore 2024-09-12T00:48:48.516 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 trace 2024-09-12T00:48:48.516 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 ceph_dedup 2024-09-12T00:48:48.516 INFO:tasks.workunit.client.0.smithi073.stderr: -2/-2 (syslog threshold) 2024-09-12T00:48:48.516 INFO:tasks.workunit.client.0.smithi073.stderr: 99/99 (stderr threshold) 2024-09-12T00:48:48.516 INFO:tasks.workunit.client.0.smithi073.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:48:48.516 INFO:tasks.workunit.client.0.smithi073.stderr: 7f3cbdffb640 / http_manager 2024-09-12T00:48:48.516 INFO:tasks.workunit.client.0.smithi073.stderr: 7f3cbffff640 / http_manager 2024-09-12T00:48:48.516 INFO:tasks.workunit.client.0.smithi073.stderr: 7f3d457e2640 / rgw_dt_lg_renew 2024-09-12T00:48:48.516 INFO:tasks.workunit.client.0.smithi073.stderr: 7f3d70ff9640 / ms_dispatch 2024-09-12T00:48:48.517 INFO:tasks.workunit.client.0.smithi073.stderr: 7f3d727fc640 / io_context_pool 2024-09-12T00:48:48.517 INFO:tasks.workunit.client.0.smithi073.stderr: 7f3d78e01640 / ms_dispatch 2024-09-12T00:48:48.517 INFO:tasks.workunit.client.0.smithi073.stderr: 7f3d7b606640 / ms_dispatch 2024-09-12T00:48:48.517 INFO:tasks.workunit.client.0.smithi073.stderr: 7f3d7ce09640 / io_context_pool 2024-09-12T00:48:48.517 INFO:tasks.workunit.client.0.smithi073.stderr: 7f3e8e560640 / msgr-worker-2 2024-09-12T00:48:48.517 INFO:tasks.workunit.client.0.smithi073.stderr: 7f3e8ed61640 / msgr-worker-1 2024-09-12T00:48:48.517 INFO:tasks.workunit.client.0.smithi073.stderr: 7f3e8f562640 / msgr-worker-0 2024-09-12T00:48:48.517 INFO:tasks.workunit.client.0.smithi073.stderr: 7f3e8fd63640 / io_context_pool 2024-09-12T00:48:48.517 INFO:tasks.workunit.client.0.smithi073.stderr: 7f3e9312c800 / radosgw-admin 2024-09-12T00:48:48.517 INFO:tasks.workunit.client.0.smithi073.stderr: max_recent 500 2024-09-12T00:48:48.517 INFO:tasks.workunit.client.0.smithi073.stderr: max_new 1000 2024-09-12T00:48:48.517 INFO:tasks.workunit.client.0.smithi073.stderr: log_file /var/log/ceph/ceph-client.admin.90687.log 2024-09-12T00:48:48.517 INFO:tasks.workunit.client.0.smithi073.stderr:--- end dump of recent events --- 2024-09-12T00:48:48.518 INFO:tasks.workunit.client.0.smithi073.stderr:--- begin dump of recent events --- 2024-09-12T00:48:48.518 INFO:tasks.workunit.client.0.smithi073.stderr: -499> 2024-09-12T00:48:48.180+0000 7f3e8e560640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:48.518 INFO:tasks.workunit.client.0.smithi073.stderr: -498> 2024-09-12T00:48:48.180+0000 7f3e8e560640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:48.518 INFO:tasks.workunit.client.0.smithi073.stderr: -497> 2024-09-12T00:48:48.180+0000 7f3e8e560640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:48.518 INFO:tasks.workunit.client.0.smithi073.stderr: -496> 2024-09-12T00:48:48.180+0000 7f3e8f562640 10 monclient(hunting): get_auth_request con 0x55a8fbf65e00 auth_method 0 2024-09-12T00:48:48.518 INFO:tasks.workunit.client.0.smithi073.stderr: -495> 2024-09-12T00:48:48.180+0000 7f3e8f562640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:48.518 INFO:tasks.workunit.client.0.smithi073.stderr: -494> 2024-09-12T00:48:48.180+0000 7f3e8f562640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:48.518 INFO:tasks.workunit.client.0.smithi073.stderr: -493> 2024-09-12T00:48:48.180+0000 7f3e8f562640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:48.518 INFO:tasks.workunit.client.0.smithi073.stderr: -492> 2024-09-12T00:48:48.180+0000 7f3e8ed61640 10 monclient(hunting): handle_auth_done global_id 6071 payload 274 2024-09-12T00:48:48.518 INFO:tasks.workunit.client.0.smithi073.stderr: -491> 2024-09-12T00:48:48.180+0000 7f3e8ed61640 10 monclient: _finish_hunting 0 2024-09-12T00:48:48.518 INFO:tasks.workunit.client.0.smithi073.stderr: -490> 2024-09-12T00:48:48.180+0000 7f3e8ed61640 1 monclient: found mon.noname-c 2024-09-12T00:48:48.518 INFO:tasks.workunit.client.0.smithi073.stderr: -489> 2024-09-12T00:48:48.180+0000 7f3e8ed61640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.73:3301/0 2024-09-12T00:48:48.518 INFO:tasks.workunit.client.0.smithi073.stderr: -488> 2024-09-12T00:48:48.180+0000 7f3d7ce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:48.518 INFO:tasks.workunit.client.0.smithi073.stderr: -487> 2024-09-12T00:48:48.180+0000 7f3d7ce09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:48:48.519 INFO:tasks.workunit.client.0.smithi073.stderr: -486> 2024-09-12T00:48:48.180+0000 7f3d7ce09640 10 monclient: dump: 2024-09-12T00:48:48.519 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:48:48.519 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:48:48.519 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:48:48.519 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:48:48.519 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:48.519 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:48:48.519 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:48:48.519 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:48:48.519 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:48:48.519 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:48.519 INFO:tasks.workunit.client.0.smithi073.stderr: -485> 2024-09-12T00:48:48.180+0000 7f3d7ce09640 10 monclient: _finish_auth 0 2024-09-12T00:48:48.519 INFO:tasks.workunit.client.0.smithi073.stderr: -484> 2024-09-12T00:48:48.180+0000 7f3d7ce09640 10 monclient: _check_auth_tickets 2024-09-12T00:48:48.520 INFO:tasks.workunit.client.0.smithi073.stderr: -483> 2024-09-12T00:48:48.180+0000 7f3d7ce09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:48:48.520 INFO:tasks.workunit.client.0.smithi073.stderr: -482> 2024-09-12T00:48:48.180+0000 7f3e9312c800 5 monclient: authenticate success, global_id 6071 2024-09-12T00:48:48.520 INFO:tasks.workunit.client.0.smithi073.stderr: -481> 2024-09-12T00:48:48.180+0000 7f3e9312c800 10 monclient: get_monmap_and_config success 2024-09-12T00:48:48.520 INFO:tasks.workunit.client.0.smithi073.stderr: -480> 2024-09-12T00:48:48.180+0000 7f3d7ce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:48.520 INFO:tasks.workunit.client.0.smithi073.stderr: -479> 2024-09-12T00:48:48.180+0000 7f3e9312c800 4 set_mon_vals no callback set 2024-09-12T00:48:48.520 INFO:tasks.workunit.client.0.smithi073.stderr: -478> 2024-09-12T00:48:48.180+0000 7f3d7ce09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:48:48.520 INFO:tasks.workunit.client.0.smithi073.stderr: -477> 2024-09-12T00:48:48.180+0000 7f3d7ce09640 10 monclient: dump: 2024-09-12T00:48:48.520 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:48:48.520 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:48:48.520 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:48:48.520 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:48:48.520 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:48.520 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:48:48.520 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:48:48.521 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:48:48.521 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:48:48.521 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:48.521 INFO:tasks.workunit.client.0.smithi073.stderr: -476> 2024-09-12T00:48:48.181+0000 7f3e9312c800 10 monclient: shutdown 2024-09-12T00:48:48.521 INFO:tasks.workunit.client.0.smithi073.stderr: -475> 2024-09-12T00:48:48.181+0000 7f3e9312c800 5 asok(0x55a8fbe8d630) unregister_commands rotate-key 2024-09-12T00:48:48.521 INFO:tasks.workunit.client.0.smithi073.stderr: -474> 2024-09-12T00:48:48.181+0000 7f3e9312c800 10 monclient: build_initial_monmap 2024-09-12T00:48:48.521 INFO:tasks.workunit.client.0.smithi073.stderr: -473> 2024-09-12T00:48:48.181+0000 7f3e9312c800 1 build_initial for_mkfs: 0 2024-09-12T00:48:48.521 INFO:tasks.workunit.client.0.smithi073.stderr: -472> 2024-09-12T00:48:48.181+0000 7f3e9312c800 10 monclient: monmap: 2024-09-12T00:48:48.521 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:48:48.521 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:48:48.521 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:48:48.521 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:48:48.521 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:48:48.521 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:48:48.522 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:48:48.522 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:48:48.522 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:48:48.522 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:48.522 INFO:tasks.workunit.client.0.smithi073.stderr: -471> 2024-09-12T00:48:48.181+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0b3640) adding auth protocol: cephx 2024-09-12T00:48:48.522 INFO:tasks.workunit.client.0.smithi073.stderr: -470> 2024-09-12T00:48:48.181+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0b3640) adding auth protocol: cephx 2024-09-12T00:48:48.522 INFO:tasks.workunit.client.0.smithi073.stderr: -469> 2024-09-12T00:48:48.181+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0b3640) adding auth protocol: cephx 2024-09-12T00:48:48.522 INFO:tasks.workunit.client.0.smithi073.stderr: -468> 2024-09-12T00:48:48.181+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0b3640) adding con mode: secure 2024-09-12T00:48:48.522 INFO:tasks.workunit.client.0.smithi073.stderr: -467> 2024-09-12T00:48:48.181+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0b3640) adding con mode: crc 2024-09-12T00:48:48.522 INFO:tasks.workunit.client.0.smithi073.stderr: -466> 2024-09-12T00:48:48.181+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0b3640) adding con mode: secure 2024-09-12T00:48:48.522 INFO:tasks.workunit.client.0.smithi073.stderr: -465> 2024-09-12T00:48:48.181+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0b3640) adding con mode: crc 2024-09-12T00:48:48.522 INFO:tasks.workunit.client.0.smithi073.stderr: -464> 2024-09-12T00:48:48.181+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0b3640) adding con mode: secure 2024-09-12T00:48:48.522 INFO:tasks.workunit.client.0.smithi073.stderr: -463> 2024-09-12T00:48:48.181+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0b3640) adding con mode: crc 2024-09-12T00:48:48.522 INFO:tasks.workunit.client.0.smithi073.stderr: -462> 2024-09-12T00:48:48.181+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0b3640) adding con mode: crc 2024-09-12T00:48:48.522 INFO:tasks.workunit.client.0.smithi073.stderr: -461> 2024-09-12T00:48:48.181+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0b3640) adding con mode: secure 2024-09-12T00:48:48.523 INFO:tasks.workunit.client.0.smithi073.stderr: -460> 2024-09-12T00:48:48.181+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0b3640) adding con mode: crc 2024-09-12T00:48:48.523 INFO:tasks.workunit.client.0.smithi073.stderr: -459> 2024-09-12T00:48:48.181+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0b3640) adding con mode: secure 2024-09-12T00:48:48.523 INFO:tasks.workunit.client.0.smithi073.stderr: -458> 2024-09-12T00:48:48.181+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0b3640) adding con mode: crc 2024-09-12T00:48:48.523 INFO:tasks.workunit.client.0.smithi073.stderr: -457> 2024-09-12T00:48:48.181+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0b3640) adding con mode: secure 2024-09-12T00:48:48.523 INFO:tasks.workunit.client.0.smithi073.stderr: -456> 2024-09-12T00:48:48.181+0000 7f3e9312c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:48.523 INFO:tasks.workunit.client.0.smithi073.stderr: -455> 2024-09-12T00:48:48.181+0000 7f3e9312c800 1 librados: starting msgr at 2024-09-12T00:48:48.523 INFO:tasks.workunit.client.0.smithi073.stderr: -454> 2024-09-12T00:48:48.181+0000 7f3e9312c800 1 librados: starting objecter 2024-09-12T00:48:48.523 INFO:tasks.workunit.client.0.smithi073.stderr: -453> 2024-09-12T00:48:48.182+0000 7f3e9312c800 5 asok(0x55a8fbe8d630) register_command objecter_requests hook 0x55a8fc0b30b0 2024-09-12T00:48:48.523 INFO:tasks.workunit.client.0.smithi073.stderr: -452> 2024-09-12T00:48:48.182+0000 7f3e9312c800 1 librados: setting wanted keys 2024-09-12T00:48:48.523 INFO:tasks.workunit.client.0.smithi073.stderr: -451> 2024-09-12T00:48:48.182+0000 7f3e9312c800 1 librados: calling monclient init 2024-09-12T00:48:48.523 INFO:tasks.workunit.client.0.smithi073.stderr: -450> 2024-09-12T00:48:48.182+0000 7f3e9312c800 10 monclient: init 2024-09-12T00:48:48.523 INFO:tasks.workunit.client.0.smithi073.stderr: -449> 2024-09-12T00:48:48.182+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0ada30) adding auth protocol: cephx 2024-09-12T00:48:48.524 INFO:tasks.workunit.client.0.smithi073.stderr: -448> 2024-09-12T00:48:48.182+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0ada30) adding auth protocol: cephx 2024-09-12T00:48:48.524 INFO:tasks.workunit.client.0.smithi073.stderr: -447> 2024-09-12T00:48:48.182+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0ada30) adding auth protocol: cephx 2024-09-12T00:48:48.524 INFO:tasks.workunit.client.0.smithi073.stderr: -446> 2024-09-12T00:48:48.182+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0ada30) adding con mode: secure 2024-09-12T00:48:48.524 INFO:tasks.workunit.client.0.smithi073.stderr: -445> 2024-09-12T00:48:48.182+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0ada30) adding con mode: crc 2024-09-12T00:48:48.524 INFO:tasks.workunit.client.0.smithi073.stderr: -444> 2024-09-12T00:48:48.182+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0ada30) adding con mode: secure 2024-09-12T00:48:48.524 INFO:tasks.workunit.client.0.smithi073.stderr: -443> 2024-09-12T00:48:48.182+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0ada30) adding con mode: crc 2024-09-12T00:48:48.524 INFO:tasks.workunit.client.0.smithi073.stderr: -442> 2024-09-12T00:48:48.182+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0ada30) adding con mode: secure 2024-09-12T00:48:48.524 INFO:tasks.workunit.client.0.smithi073.stderr: -441> 2024-09-12T00:48:48.182+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0ada30) adding con mode: crc 2024-09-12T00:48:48.524 INFO:tasks.workunit.client.0.smithi073.stderr: -440> 2024-09-12T00:48:48.182+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0ada30) adding con mode: crc 2024-09-12T00:48:48.524 INFO:tasks.workunit.client.0.smithi073.stderr: -439> 2024-09-12T00:48:48.182+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0ada30) adding con mode: secure 2024-09-12T00:48:48.524 INFO:tasks.workunit.client.0.smithi073.stderr: -438> 2024-09-12T00:48:48.182+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0ada30) adding con mode: crc 2024-09-12T00:48:48.524 INFO:tasks.workunit.client.0.smithi073.stderr: -437> 2024-09-12T00:48:48.182+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0ada30) adding con mode: secure 2024-09-12T00:48:48.524 INFO:tasks.workunit.client.0.smithi073.stderr: -436> 2024-09-12T00:48:48.182+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0ada30) adding con mode: crc 2024-09-12T00:48:48.525 INFO:tasks.workunit.client.0.smithi073.stderr: -435> 2024-09-12T00:48:48.182+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc0ada30) adding con mode: secure 2024-09-12T00:48:48.525 INFO:tasks.workunit.client.0.smithi073.stderr: -434> 2024-09-12T00:48:48.182+0000 7f3e9312c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:48.525 INFO:tasks.workunit.client.0.smithi073.stderr: -433> 2024-09-12T00:48:48.182+0000 7f3e9312c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:48.525 INFO:tasks.workunit.client.0.smithi073.stderr: -432> 2024-09-12T00:48:48.182+0000 7f3e9312c800 5 asok(0x55a8fbe8d630) register_command rotate-key hook 0x55a8fc0adb78 2024-09-12T00:48:48.525 INFO:tasks.workunit.client.0.smithi073.stderr: -431> 2024-09-12T00:48:48.182+0000 7f3e9312c800 10 monclient: _reopen_session rank -1 2024-09-12T00:48:48.525 INFO:tasks.workunit.client.0.smithi073.stderr: -430> 2024-09-12T00:48:48.182+0000 7f3e9312c800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:48:48.525 INFO:tasks.workunit.client.0.smithi073.stderr: -429> 2024-09-12T00:48:48.182+0000 7f3e9312c800 10 monclient(hunting): picked mon.noname-b con 0x55a8fbf37f40 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:48:48.525 INFO:tasks.workunit.client.0.smithi073.stderr: -428> 2024-09-12T00:48:48.182+0000 7f3e9312c800 10 monclient(hunting): picked mon.noname-c con 0x55a8fbf62290 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:48:48.525 INFO:tasks.workunit.client.0.smithi073.stderr: -427> 2024-09-12T00:48:48.182+0000 7f3e9312c800 10 monclient(hunting): picked mon.noname-a con 0x55a8fbf65e00 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:48:48.525 INFO:tasks.workunit.client.0.smithi073.stderr: -426> 2024-09-12T00:48:48.182+0000 7f3e9312c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:48.525 INFO:tasks.workunit.client.0.smithi073.stderr: -425> 2024-09-12T00:48:48.182+0000 7f3e9312c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:48.525 INFO:tasks.workunit.client.0.smithi073.stderr: -424> 2024-09-12T00:48:48.182+0000 7f3e9312c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:48.526 INFO:tasks.workunit.client.0.smithi073.stderr: -423> 2024-09-12T00:48:48.182+0000 7f3e9312c800 10 monclient(hunting): _renew_subs 2024-09-12T00:48:48.526 INFO:tasks.workunit.client.0.smithi073.stderr: -422> 2024-09-12T00:48:48.182+0000 7f3e9312c800 10 monclient(hunting): authenticate will time out at 1988.853726s 2024-09-12T00:48:48.526 INFO:tasks.workunit.client.0.smithi073.stderr: -421> 2024-09-12T00:48:48.182+0000 7f3e8e560640 10 monclient(hunting): get_auth_request con 0x55a8fbf62290 auth_method 0 2024-09-12T00:48:48.526 INFO:tasks.workunit.client.0.smithi073.stderr: -420> 2024-09-12T00:48:48.182+0000 7f3e8e560640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:48.526 INFO:tasks.workunit.client.0.smithi073.stderr: -419> 2024-09-12T00:48:48.182+0000 7f3e8e560640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:48.526 INFO:tasks.workunit.client.0.smithi073.stderr: -418> 2024-09-12T00:48:48.182+0000 7f3e8e560640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:48.526 INFO:tasks.workunit.client.0.smithi073.stderr: -417> 2024-09-12T00:48:48.182+0000 7f3e8f562640 10 monclient(hunting): get_auth_request con 0x55a8fbf65e00 auth_method 0 2024-09-12T00:48:48.526 INFO:tasks.workunit.client.0.smithi073.stderr: -416> 2024-09-12T00:48:48.182+0000 7f3e8f562640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:48.526 INFO:tasks.workunit.client.0.smithi073.stderr: -415> 2024-09-12T00:48:48.182+0000 7f3e8f562640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:48.526 INFO:tasks.workunit.client.0.smithi073.stderr: -414> 2024-09-12T00:48:48.182+0000 7f3e8f562640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:48.526 INFO:tasks.workunit.client.0.smithi073.stderr: -413> 2024-09-12T00:48:48.182+0000 7f3e8e560640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:48.526 INFO:tasks.workunit.client.0.smithi073.stderr: -412> 2024-09-12T00:48:48.182+0000 7f3e8e560640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:48.527 INFO:tasks.workunit.client.0.smithi073.stderr: -411> 2024-09-12T00:48:48.182+0000 7f3e8e560640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:48.527 INFO:tasks.workunit.client.0.smithi073.stderr: -410> 2024-09-12T00:48:48.182+0000 7f3e8f562640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:48.527 INFO:tasks.workunit.client.0.smithi073.stderr: -409> 2024-09-12T00:48:48.182+0000 7f3e8f562640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:48.527 INFO:tasks.workunit.client.0.smithi073.stderr: -408> 2024-09-12T00:48:48.182+0000 7f3e8f562640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:48.527 INFO:tasks.workunit.client.0.smithi073.stderr: -407> 2024-09-12T00:48:48.182+0000 7f3e8ed61640 10 monclient(hunting): get_auth_request con 0x55a8fbf37f40 auth_method 0 2024-09-12T00:48:48.527 INFO:tasks.workunit.client.0.smithi073.stderr: -406> 2024-09-12T00:48:48.182+0000 7f3e8ed61640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:48.527 INFO:tasks.workunit.client.0.smithi073.stderr: -405> 2024-09-12T00:48:48.182+0000 7f3e8ed61640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:48.527 INFO:tasks.workunit.client.0.smithi073.stderr: -404> 2024-09-12T00:48:48.182+0000 7f3e8ed61640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:48.527 INFO:tasks.workunit.client.0.smithi073.stderr: -403> 2024-09-12T00:48:48.183+0000 7f3e8e560640 10 monclient(hunting): handle_auth_done global_id 6074 payload 824 2024-09-12T00:48:48.527 INFO:tasks.workunit.client.0.smithi073.stderr: -402> 2024-09-12T00:48:48.183+0000 7f3e8e560640 10 monclient: _finish_hunting 0 2024-09-12T00:48:48.527 INFO:tasks.workunit.client.0.smithi073.stderr: -401> 2024-09-12T00:48:48.183+0000 7f3e8e560640 1 monclient: found mon.noname-c 2024-09-12T00:48:48.527 INFO:tasks.workunit.client.0.smithi073.stderr: -400> 2024-09-12T00:48:48.183+0000 7f3e8e560640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.73:3301/0 2024-09-12T00:48:48.527 INFO:tasks.workunit.client.0.smithi073.stderr: -399> 2024-09-12T00:48:48.183+0000 7f3d7b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:48.528 INFO:tasks.workunit.client.0.smithi073.stderr: -398> 2024-09-12T00:48:48.183+0000 7f3d7b606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:48:48.528 INFO:tasks.workunit.client.0.smithi073.stderr: -397> 2024-09-12T00:48:48.183+0000 7f3d7b606640 10 monclient: dump: 2024-09-12T00:48:48.528 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:48:48.528 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:48:48.528 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:48:48.528 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:48:48.528 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:48.528 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:48:48.528 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:48:48.528 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:48:48.528 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:48:48.528 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:48.528 INFO:tasks.workunit.client.0.smithi073.stderr: -396> 2024-09-12T00:48:48.183+0000 7f3d7b606640 10 monclient: _finish_auth 0 2024-09-12T00:48:48.529 INFO:tasks.workunit.client.0.smithi073.stderr: -395> 2024-09-12T00:48:48.183+0000 7f3d7b606640 10 monclient: _check_auth_tickets 2024-09-12T00:48:48.529 INFO:tasks.workunit.client.0.smithi073.stderr: -394> 2024-09-12T00:48:48.183+0000 7f3d7b606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:48:48.529 INFO:tasks.workunit.client.0.smithi073.stderr: -393> 2024-09-12T00:48:48.183+0000 7f3d7b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:48.529 INFO:tasks.workunit.client.0.smithi073.stderr: -392> 2024-09-12T00:48:48.183+0000 7f3d7b606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:48:48.529 INFO:tasks.workunit.client.0.smithi073.stderr: -391> 2024-09-12T00:48:48.183+0000 7f3d7b606640 10 monclient: dump: 2024-09-12T00:48:48.529 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:48:48.529 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:48:48.529 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:48:48.529 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:48:48.529 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:48.529 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:48:48.529 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:48:48.529 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:48:48.530 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:48:48.530 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:48.530 INFO:tasks.workunit.client.0.smithi073.stderr: -390> 2024-09-12T00:48:48.183+0000 7f3e9312c800 5 monclient: authenticate success, global_id 6074 2024-09-12T00:48:48.530 INFO:tasks.workunit.client.0.smithi073.stderr: -389> 2024-09-12T00:48:48.183+0000 7f3e9312c800 10 monclient: _renew_subs 2024-09-12T00:48:48.530 INFO:tasks.workunit.client.0.smithi073.stderr: -388> 2024-09-12T00:48:48.183+0000 7f3d7ce09640 4 set_mon_vals no callback set 2024-09-12T00:48:48.530 INFO:tasks.workunit.client.0.smithi073.stderr: -387> 2024-09-12T00:48:48.183+0000 7f3e9312c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:48:48.530 INFO:tasks.workunit.client.0.smithi073.stderr: -386> 2024-09-12T00:48:48.183+0000 7f3e9312c800 10 monclient: _renew_subs 2024-09-12T00:48:48.530 INFO:tasks.workunit.client.0.smithi073.stderr: -385> 2024-09-12T00:48:48.183+0000 7f3e9312c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:48:48.530 INFO:tasks.workunit.client.0.smithi073.stderr: -384> 2024-09-12T00:48:48.183+0000 7f3e9312c800 1 librados: init done 2024-09-12T00:48:48.530 INFO:tasks.workunit.client.0.smithi073.stderr: -383> 2024-09-12T00:48:48.185+0000 7f3d7b606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:48:48.530 INFO:tasks.workunit.client.0.smithi073.stderr: -382> 2024-09-12T00:48:48.185+0000 7f3d7b606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:48:48.530 INFO:tasks.workunit.client.0.smithi073.stderr: -381> 2024-09-12T00:48:48.185+0000 7f3d7b606640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:48:48.530 INFO:tasks.workunit.client.0.smithi073.stderr: -380> 2024-09-12T00:48:48.185+0000 7f3e8ed61640 10 monclient: get_auth_request con 0x7f3d74076470 auth_method 0 2024-09-12T00:48:48.531 INFO:tasks.workunit.client.0.smithi073.stderr: -379> 2024-09-12T00:48:48.185+0000 7f3e8f562640 10 monclient: get_auth_request con 0x55a8fc0d63a0 auth_method 0 2024-09-12T00:48:48.531 INFO:tasks.workunit.client.0.smithi073.stderr: -378> 2024-09-12T00:48:48.186+0000 7f3e8ed61640 10 monclient: get_auth_request con 0x55a8fc0f90f0 auth_method 0 2024-09-12T00:48:48.531 INFO:tasks.workunit.client.0.smithi073.stderr: -377> 2024-09-12T00:48:48.187+0000 7f3e8e560640 10 monclient: get_auth_request con 0x55a8fc0fd800 auth_method 0 2024-09-12T00:48:48.531 INFO:tasks.workunit.client.0.smithi073.stderr: -376> 2024-09-12T00:48:48.189+0000 7f3e9312c800 10 monclient: build_initial_monmap 2024-09-12T00:48:48.531 INFO:tasks.workunit.client.0.smithi073.stderr: -375> 2024-09-12T00:48:48.189+0000 7f3e9312c800 1 build_initial for_mkfs: 0 2024-09-12T00:48:48.531 INFO:tasks.workunit.client.0.smithi073.stderr: -374> 2024-09-12T00:48:48.189+0000 7f3e9312c800 10 monclient: monmap: 2024-09-12T00:48:48.531 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:48:48.531 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:48:48.531 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:48:48.531 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:48:48.531 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:48:48.531 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:48:48.531 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:48:48.532 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:48:48.532 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:48:48.532 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:48.532 INFO:tasks.workunit.client.0.smithi073.stderr: -373> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc102530) adding auth protocol: cephx 2024-09-12T00:48:48.532 INFO:tasks.workunit.client.0.smithi073.stderr: -372> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc102530) adding auth protocol: cephx 2024-09-12T00:48:48.532 INFO:tasks.workunit.client.0.smithi073.stderr: -371> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc102530) adding auth protocol: cephx 2024-09-12T00:48:48.532 INFO:tasks.workunit.client.0.smithi073.stderr: -370> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc102530) adding con mode: secure 2024-09-12T00:48:48.532 INFO:tasks.workunit.client.0.smithi073.stderr: -369> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc102530) adding con mode: crc 2024-09-12T00:48:48.532 INFO:tasks.workunit.client.0.smithi073.stderr: -368> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc102530) adding con mode: secure 2024-09-12T00:48:48.532 INFO:tasks.workunit.client.0.smithi073.stderr: -367> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc102530) adding con mode: crc 2024-09-12T00:48:48.532 INFO:tasks.workunit.client.0.smithi073.stderr: -366> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc102530) adding con mode: secure 2024-09-12T00:48:48.532 INFO:tasks.workunit.client.0.smithi073.stderr: -365> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc102530) adding con mode: crc 2024-09-12T00:48:48.533 INFO:tasks.workunit.client.0.smithi073.stderr: -364> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc102530) adding con mode: crc 2024-09-12T00:48:48.533 INFO:tasks.workunit.client.0.smithi073.stderr: -363> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc102530) adding con mode: secure 2024-09-12T00:48:48.533 INFO:tasks.workunit.client.0.smithi073.stderr: -362> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc102530) adding con mode: crc 2024-09-12T00:48:48.533 INFO:tasks.workunit.client.0.smithi073.stderr: -361> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc102530) adding con mode: secure 2024-09-12T00:48:48.533 INFO:tasks.workunit.client.0.smithi073.stderr: -360> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc102530) adding con mode: crc 2024-09-12T00:48:48.533 INFO:tasks.workunit.client.0.smithi073.stderr: -359> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc102530) adding con mode: secure 2024-09-12T00:48:48.533 INFO:tasks.workunit.client.0.smithi073.stderr: -358> 2024-09-12T00:48:48.189+0000 7f3e9312c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:48.533 INFO:tasks.workunit.client.0.smithi073.stderr: -357> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 asok(0x55a8fbe8d630) register_command objecter_requests cmddesc objecter_requests hook 0x55a8fc105f20 EEXIST 2024-09-12T00:48:48.533 INFO:tasks.workunit.client.0.smithi073.stderr: -356> 2024-09-12T00:48:48.189+0000 7f3e9312c800 10 monclient: init 2024-09-12T00:48:48.533 INFO:tasks.workunit.client.0.smithi073.stderr: -355> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc100c08) adding auth protocol: cephx 2024-09-12T00:48:48.533 INFO:tasks.workunit.client.0.smithi073.stderr: -354> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc100c08) adding auth protocol: cephx 2024-09-12T00:48:48.533 INFO:tasks.workunit.client.0.smithi073.stderr: -353> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc100c08) adding auth protocol: cephx 2024-09-12T00:48:48.533 INFO:tasks.workunit.client.0.smithi073.stderr: -352> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc100c08) adding con mode: secure 2024-09-12T00:48:48.534 INFO:tasks.workunit.client.0.smithi073.stderr: -351> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc100c08) adding con mode: crc 2024-09-12T00:48:48.534 INFO:tasks.workunit.client.0.smithi073.stderr: -350> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc100c08) adding con mode: secure 2024-09-12T00:48:48.534 INFO:tasks.workunit.client.0.smithi073.stderr: -349> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc100c08) adding con mode: crc 2024-09-12T00:48:48.534 INFO:tasks.workunit.client.0.smithi073.stderr: -348> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc100c08) adding con mode: secure 2024-09-12T00:48:48.534 INFO:tasks.workunit.client.0.smithi073.stderr: -347> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc100c08) adding con mode: crc 2024-09-12T00:48:48.534 INFO:tasks.workunit.client.0.smithi073.stderr: -346> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc100c08) adding con mode: crc 2024-09-12T00:48:48.534 INFO:tasks.workunit.client.0.smithi073.stderr: -345> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc100c08) adding con mode: secure 2024-09-12T00:48:48.534 INFO:tasks.workunit.client.0.smithi073.stderr: -344> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc100c08) adding con mode: crc 2024-09-12T00:48:48.534 INFO:tasks.workunit.client.0.smithi073.stderr: -343> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc100c08) adding con mode: secure 2024-09-12T00:48:48.534 INFO:tasks.workunit.client.0.smithi073.stderr: -342> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc100c08) adding con mode: crc 2024-09-12T00:48:48.534 INFO:tasks.workunit.client.0.smithi073.stderr: -341> 2024-09-12T00:48:48.189+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc100c08) adding con mode: secure 2024-09-12T00:48:48.534 INFO:tasks.workunit.client.0.smithi073.stderr: -340> 2024-09-12T00:48:48.190+0000 7f3e9312c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:48.534 INFO:tasks.workunit.client.0.smithi073.stderr: -339> 2024-09-12T00:48:48.190+0000 7f3e9312c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:48.535 INFO:tasks.workunit.client.0.smithi073.stderr: -338> 2024-09-12T00:48:48.190+0000 7f3e9312c800 5 asok(0x55a8fbe8d630) register_command rotate-key cmddesc rotate-key hook 0x55a8fc100d50 EEXIST 2024-09-12T00:48:48.535 INFO:tasks.workunit.client.0.smithi073.stderr: -337> 2024-09-12T00:48:48.190+0000 7f3e9312c800 10 monclient: _reopen_session rank -1 2024-09-12T00:48:48.535 INFO:tasks.workunit.client.0.smithi073.stderr: -336> 2024-09-12T00:48:48.190+0000 7f3e9312c800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:48:48.535 INFO:tasks.workunit.client.0.smithi073.stderr: -335> 2024-09-12T00:48:48.190+0000 7f3e9312c800 10 monclient(hunting): picked mon.noname-c con 0x55a8fc129c10 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:48:48.535 INFO:tasks.workunit.client.0.smithi073.stderr: -334> 2024-09-12T00:48:48.190+0000 7f3e9312c800 10 monclient(hunting): picked mon.noname-a con 0x55a8fc12bee0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:48:48.535 INFO:tasks.workunit.client.0.smithi073.stderr: -333> 2024-09-12T00:48:48.190+0000 7f3e9312c800 10 monclient(hunting): picked mon.noname-b con 0x55a8fc1283e0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:48:48.535 INFO:tasks.workunit.client.0.smithi073.stderr: -332> 2024-09-12T00:48:48.190+0000 7f3e9312c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:48.535 INFO:tasks.workunit.client.0.smithi073.stderr: -331> 2024-09-12T00:48:48.190+0000 7f3e9312c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:48.535 INFO:tasks.workunit.client.0.smithi073.stderr: -330> 2024-09-12T00:48:48.190+0000 7f3e9312c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:48.535 INFO:tasks.workunit.client.0.smithi073.stderr: -329> 2024-09-12T00:48:48.190+0000 7f3e9312c800 10 monclient(hunting): _renew_subs 2024-09-12T00:48:48.535 INFO:tasks.workunit.client.0.smithi073.stderr: -328> 2024-09-12T00:48:48.190+0000 7f3e9312c800 10 monclient(hunting): authenticate will time out at 1988.861358s 2024-09-12T00:48:48.535 INFO:tasks.workunit.client.0.smithi073.stderr: -327> 2024-09-12T00:48:48.190+0000 7f3e8ed61640 10 monclient(hunting): get_auth_request con 0x55a8fc129c10 auth_method 0 2024-09-12T00:48:48.535 INFO:tasks.workunit.client.0.smithi073.stderr: -326> 2024-09-12T00:48:48.190+0000 7f3e8ed61640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:48.536 INFO:tasks.workunit.client.0.smithi073.stderr: -325> 2024-09-12T00:48:48.190+0000 7f3e8ed61640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:48.536 INFO:tasks.workunit.client.0.smithi073.stderr: -324> 2024-09-12T00:48:48.190+0000 7f3e8ed61640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:48.536 INFO:tasks.workunit.client.0.smithi073.stderr: -323> 2024-09-12T00:48:48.190+0000 7f3e8e560640 10 monclient(hunting): get_auth_request con 0x55a8fc12bee0 auth_method 0 2024-09-12T00:48:48.536 INFO:tasks.workunit.client.0.smithi073.stderr: -322> 2024-09-12T00:48:48.190+0000 7f3e8e560640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:48.536 INFO:tasks.workunit.client.0.smithi073.stderr: -321> 2024-09-12T00:48:48.190+0000 7f3e8e560640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:48.536 INFO:tasks.workunit.client.0.smithi073.stderr: -320> 2024-09-12T00:48:48.190+0000 7f3e8e560640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:48.536 INFO:tasks.workunit.client.0.smithi073.stderr: -319> 2024-09-12T00:48:48.190+0000 7f3e8e560640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:48.536 INFO:tasks.workunit.client.0.smithi073.stderr: -318> 2024-09-12T00:48:48.190+0000 7f3e8e560640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:48.536 INFO:tasks.workunit.client.0.smithi073.stderr: -317> 2024-09-12T00:48:48.190+0000 7f3e8e560640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:48.536 INFO:tasks.workunit.client.0.smithi073.stderr: -316> 2024-09-12T00:48:48.190+0000 7f3e8ed61640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:48.536 INFO:tasks.workunit.client.0.smithi073.stderr: -315> 2024-09-12T00:48:48.190+0000 7f3e8ed61640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:48.536 INFO:tasks.workunit.client.0.smithi073.stderr: -314> 2024-09-12T00:48:48.190+0000 7f3e8ed61640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:48.536 INFO:tasks.workunit.client.0.smithi073.stderr: -313> 2024-09-12T00:48:48.190+0000 7f3e8e560640 10 monclient(hunting): handle_auth_done global_id 6387 payload 824 2024-09-12T00:48:48.537 INFO:tasks.workunit.client.0.smithi073.stderr: -312> 2024-09-12T00:48:48.190+0000 7f3e8e560640 10 monclient: _finish_hunting 0 2024-09-12T00:48:48.537 INFO:tasks.workunit.client.0.smithi073.stderr: -311> 2024-09-12T00:48:48.190+0000 7f3e8e560640 1 monclient: found mon.noname-a 2024-09-12T00:48:48.537 INFO:tasks.workunit.client.0.smithi073.stderr: -310> 2024-09-12T00:48:48.190+0000 7f3e8e560640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:48:48.537 INFO:tasks.workunit.client.0.smithi073.stderr: -309> 2024-09-12T00:48:48.190+0000 7f3e8f562640 10 monclient: get_auth_request con 0x55a8fc1283e0 auth_method 0 2024-09-12T00:48:48.537 INFO:tasks.workunit.client.0.smithi073.stderr: -308> 2024-09-12T00:48:48.190+0000 7f3d78e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:48.537 INFO:tasks.workunit.client.0.smithi073.stderr: -307> 2024-09-12T00:48:48.190+0000 7f3d78e01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:48:48.537 INFO:tasks.workunit.client.0.smithi073.stderr: -306> 2024-09-12T00:48:48.190+0000 7f3d78e01640 10 monclient: dump: 2024-09-12T00:48:48.537 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:48:48.537 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:48:48.537 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:48:48.537 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:48:48.537 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:48.537 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:48:48.538 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:48:48.538 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:48:48.538 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:48:48.538 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:48.538 INFO:tasks.workunit.client.0.smithi073.stderr: -305> 2024-09-12T00:48:48.190+0000 7f3d78e01640 10 monclient: _finish_auth 0 2024-09-12T00:48:48.538 INFO:tasks.workunit.client.0.smithi073.stderr: -304> 2024-09-12T00:48:48.190+0000 7f3d78e01640 10 monclient: _check_auth_tickets 2024-09-12T00:48:48.538 INFO:tasks.workunit.client.0.smithi073.stderr: -303> 2024-09-12T00:48:48.190+0000 7f3d78e01640 10 monclient: handle_config config(0 keys) 2024-09-12T00:48:48.538 INFO:tasks.workunit.client.0.smithi073.stderr: -302> 2024-09-12T00:48:48.191+0000 7f3d78e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:48.538 INFO:tasks.workunit.client.0.smithi073.stderr: -301> 2024-09-12T00:48:48.191+0000 7f3d78e01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:48:48.538 INFO:tasks.workunit.client.0.smithi073.stderr: -300> 2024-09-12T00:48:48.191+0000 7f3d78e01640 10 monclient: dump: 2024-09-12T00:48:48.538 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:48:48.538 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:48:48.538 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:48:48.538 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:48:48.539 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:48.539 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:48:48.539 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:48:48.539 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:48:48.539 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:48:48.539 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:48.539 INFO:tasks.workunit.client.0.smithi073.stderr: -299> 2024-09-12T00:48:48.191+0000 7f3e9312c800 5 monclient: authenticate success, global_id 6387 2024-09-12T00:48:48.539 INFO:tasks.workunit.client.0.smithi073.stderr: -298> 2024-09-12T00:48:48.191+0000 7f3e9312c800 10 monclient: _renew_subs 2024-09-12T00:48:48.539 INFO:tasks.workunit.client.0.smithi073.stderr: -297> 2024-09-12T00:48:48.191+0000 7f3e9312c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:48:48.539 INFO:tasks.workunit.client.0.smithi073.stderr: -296> 2024-09-12T00:48:48.191+0000 7f3e8fd63640 4 set_mon_vals no callback set 2024-09-12T00:48:48.539 INFO:tasks.workunit.client.0.smithi073.stderr: -295> 2024-09-12T00:48:48.191+0000 7f3e9312c800 10 monclient: _renew_subs 2024-09-12T00:48:48.539 INFO:tasks.workunit.client.0.smithi073.stderr: -294> 2024-09-12T00:48:48.191+0000 7f3e9312c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:48:48.539 INFO:tasks.workunit.client.0.smithi073.stderr: -293> 2024-09-12T00:48:48.192+0000 7f3d78e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:48:48.540 INFO:tasks.workunit.client.0.smithi073.stderr: -292> 2024-09-12T00:48:48.192+0000 7f3d78e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:48:48.540 INFO:tasks.workunit.client.0.smithi073.stderr: -291> 2024-09-12T00:48:48.192+0000 7f3d78e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:48:48.540 INFO:tasks.workunit.client.0.smithi073.stderr: -290> 2024-09-12T00:48:48.192+0000 7f3e8ed61640 10 monclient: get_auth_request con 0x7f3d68076380 auth_method 0 2024-09-12T00:48:48.540 INFO:tasks.workunit.client.0.smithi073.stderr: -289> 2024-09-12T00:48:48.193+0000 7f3e9312c800 10 monclient: get_monmap_and_config 2024-09-12T00:48:48.540 INFO:tasks.workunit.client.0.smithi073.stderr: -288> 2024-09-12T00:48:48.193+0000 7f3e9312c800 10 monclient: build_initial_monmap 2024-09-12T00:48:48.540 INFO:tasks.workunit.client.0.smithi073.stderr: -287> 2024-09-12T00:48:48.193+0000 7f3e9312c800 1 build_initial for_mkfs: 0 2024-09-12T00:48:48.540 INFO:tasks.workunit.client.0.smithi073.stderr: -286> 2024-09-12T00:48:48.193+0000 7f3e9312c800 10 monclient: monmap: 2024-09-12T00:48:48.540 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:48:48.540 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:48:48.540 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:48:48.540 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:48:48.540 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:48:48.541 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:48:48.541 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:48:48.541 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:48:48.541 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:48:48.541 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:48.541 INFO:tasks.workunit.client.0.smithi073.stderr: -285> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc149b90) adding auth protocol: cephx 2024-09-12T00:48:48.541 INFO:tasks.workunit.client.0.smithi073.stderr: -284> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc149b90) adding auth protocol: cephx 2024-09-12T00:48:48.541 INFO:tasks.workunit.client.0.smithi073.stderr: -283> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc149b90) adding auth protocol: cephx 2024-09-12T00:48:48.541 INFO:tasks.workunit.client.0.smithi073.stderr: -282> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc149b90) adding con mode: secure 2024-09-12T00:48:48.541 INFO:tasks.workunit.client.0.smithi073.stderr: -281> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc149b90) adding con mode: crc 2024-09-12T00:48:48.541 INFO:tasks.workunit.client.0.smithi073.stderr: -280> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc149b90) adding con mode: secure 2024-09-12T00:48:48.541 INFO:tasks.workunit.client.0.smithi073.stderr: -279> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc149b90) adding con mode: crc 2024-09-12T00:48:48.541 INFO:tasks.workunit.client.0.smithi073.stderr: -278> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc149b90) adding con mode: secure 2024-09-12T00:48:48.542 INFO:tasks.workunit.client.0.smithi073.stderr: -277> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc149b90) adding con mode: crc 2024-09-12T00:48:48.542 INFO:tasks.workunit.client.0.smithi073.stderr: -276> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc149b90) adding con mode: crc 2024-09-12T00:48:48.542 INFO:tasks.workunit.client.0.smithi073.stderr: -275> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc149b90) adding con mode: secure 2024-09-12T00:48:48.542 INFO:tasks.workunit.client.0.smithi073.stderr: -274> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc149b90) adding con mode: crc 2024-09-12T00:48:48.542 INFO:tasks.workunit.client.0.smithi073.stderr: -273> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc149b90) adding con mode: secure 2024-09-12T00:48:48.542 INFO:tasks.workunit.client.0.smithi073.stderr: -272> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc149b90) adding con mode: crc 2024-09-12T00:48:48.542 INFO:tasks.workunit.client.0.smithi073.stderr: -271> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc149b90) adding con mode: secure 2024-09-12T00:48:48.542 INFO:tasks.workunit.client.0.smithi073.stderr: -270> 2024-09-12T00:48:48.193+0000 7f3e9312c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:48.542 INFO:tasks.workunit.client.0.smithi073.stderr: -269> 2024-09-12T00:48:48.193+0000 7f3e9312c800 10 monclient: init 2024-09-12T00:48:48.542 INFO:tasks.workunit.client.0.smithi073.stderr: -268> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815691d0) adding auth protocol: cephx 2024-09-12T00:48:48.542 INFO:tasks.workunit.client.0.smithi073.stderr: -267> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815691d0) adding auth protocol: cephx 2024-09-12T00:48:48.542 INFO:tasks.workunit.client.0.smithi073.stderr: -266> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815691d0) adding auth protocol: cephx 2024-09-12T00:48:48.542 INFO:tasks.workunit.client.0.smithi073.stderr: -265> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815691d0) adding con mode: secure 2024-09-12T00:48:48.543 INFO:tasks.workunit.client.0.smithi073.stderr: -264> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815691d0) adding con mode: crc 2024-09-12T00:48:48.543 INFO:tasks.workunit.client.0.smithi073.stderr: -263> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815691d0) adding con mode: secure 2024-09-12T00:48:48.543 INFO:tasks.workunit.client.0.smithi073.stderr: -262> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815691d0) adding con mode: crc 2024-09-12T00:48:48.543 INFO:tasks.workunit.client.0.smithi073.stderr: -261> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815691d0) adding con mode: secure 2024-09-12T00:48:48.543 INFO:tasks.workunit.client.0.smithi073.stderr: -260> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815691d0) adding con mode: crc 2024-09-12T00:48:48.543 INFO:tasks.workunit.client.0.smithi073.stderr: -259> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815691d0) adding con mode: crc 2024-09-12T00:48:48.543 INFO:tasks.workunit.client.0.smithi073.stderr: -258> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815691d0) adding con mode: secure 2024-09-12T00:48:48.543 INFO:tasks.workunit.client.0.smithi073.stderr: -257> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815691d0) adding con mode: crc 2024-09-12T00:48:48.543 INFO:tasks.workunit.client.0.smithi073.stderr: -256> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815691d0) adding con mode: secure 2024-09-12T00:48:48.543 INFO:tasks.workunit.client.0.smithi073.stderr: -255> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815691d0) adding con mode: crc 2024-09-12T00:48:48.543 INFO:tasks.workunit.client.0.smithi073.stderr: -254> 2024-09-12T00:48:48.193+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815691d0) adding con mode: secure 2024-09-12T00:48:48.543 INFO:tasks.workunit.client.0.smithi073.stderr: -253> 2024-09-12T00:48:48.193+0000 7f3e9312c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:48.543 INFO:tasks.workunit.client.0.smithi073.stderr: -252> 2024-09-12T00:48:48.193+0000 7f3e9312c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:48.544 INFO:tasks.workunit.client.0.smithi073.stderr: -251> 2024-09-12T00:48:48.194+0000 7f3e9312c800 5 asok(0x55a8fbe8d630) register_command rotate-key cmddesc rotate-key hook 0x7ffd81569318 EEXIST 2024-09-12T00:48:48.544 INFO:tasks.workunit.client.0.smithi073.stderr: -250> 2024-09-12T00:48:48.194+0000 7f3e9312c800 10 monclient: _reopen_session rank -1 2024-09-12T00:48:48.544 INFO:tasks.workunit.client.0.smithi073.stderr: -249> 2024-09-12T00:48:48.194+0000 7f3e9312c800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:48:48.544 INFO:tasks.workunit.client.0.smithi073.stderr: -248> 2024-09-12T00:48:48.194+0000 7f3e9312c800 10 monclient(hunting): picked mon.noname-c con 0x55a8fc17e250 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:48:48.544 INFO:tasks.workunit.client.0.smithi073.stderr: -247> 2024-09-12T00:48:48.194+0000 7f3e9312c800 10 monclient(hunting): picked mon.noname-b con 0x55a8fc14f1a0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:48:48.544 INFO:tasks.workunit.client.0.smithi073.stderr: -246> 2024-09-12T00:48:48.194+0000 7f3e9312c800 10 monclient(hunting): picked mon.noname-a con 0x55a8fc179af0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:48:48.544 INFO:tasks.workunit.client.0.smithi073.stderr: -245> 2024-09-12T00:48:48.194+0000 7f3e9312c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:48.544 INFO:tasks.workunit.client.0.smithi073.stderr: -244> 2024-09-12T00:48:48.194+0000 7f3e9312c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:48.544 INFO:tasks.workunit.client.0.smithi073.stderr: -243> 2024-09-12T00:48:48.194+0000 7f3e9312c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:48.544 INFO:tasks.workunit.client.0.smithi073.stderr: -242> 2024-09-12T00:48:48.194+0000 7f3e9312c800 10 monclient(hunting): _renew_subs 2024-09-12T00:48:48.544 INFO:tasks.workunit.client.0.smithi073.stderr: -241> 2024-09-12T00:48:48.194+0000 7f3e9312c800 10 monclient(hunting): authenticate will time out at 1988.865077s 2024-09-12T00:48:48.544 INFO:tasks.workunit.client.0.smithi073.stderr: -240> 2024-09-12T00:48:48.194+0000 7f3e8ed61640 10 monclient(hunting): get_auth_request con 0x55a8fc17e250 auth_method 0 2024-09-12T00:48:48.545 INFO:tasks.workunit.client.0.smithi073.stderr: -239> 2024-09-12T00:48:48.194+0000 7f3e8ed61640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:48.545 INFO:tasks.workunit.client.0.smithi073.stderr: -238> 2024-09-12T00:48:48.194+0000 7f3e8ed61640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:48.545 INFO:tasks.workunit.client.0.smithi073.stderr: -237> 2024-09-12T00:48:48.194+0000 7f3e8ed61640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:48.545 INFO:tasks.workunit.client.0.smithi073.stderr: -236> 2024-09-12T00:48:48.194+0000 7f3e8f562640 10 monclient(hunting): get_auth_request con 0x55a8fc179af0 auth_method 0 2024-09-12T00:48:48.545 INFO:tasks.workunit.client.0.smithi073.stderr: -235> 2024-09-12T00:48:48.194+0000 7f3e8f562640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:48.545 INFO:tasks.workunit.client.0.smithi073.stderr: -234> 2024-09-12T00:48:48.194+0000 7f3e8f562640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:48.545 INFO:tasks.workunit.client.0.smithi073.stderr: -233> 2024-09-12T00:48:48.194+0000 7f3e8f562640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:48.545 INFO:tasks.workunit.client.0.smithi073.stderr: -232> 2024-09-12T00:48:48.194+0000 7f3e8ed61640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:48.545 INFO:tasks.workunit.client.0.smithi073.stderr: -231> 2024-09-12T00:48:48.194+0000 7f3e8ed61640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:48.545 INFO:tasks.workunit.client.0.smithi073.stderr: -230> 2024-09-12T00:48:48.194+0000 7f3e8ed61640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:48.545 INFO:tasks.workunit.client.0.smithi073.stderr: -229> 2024-09-12T00:48:48.194+0000 7f3e8f562640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:48.545 INFO:tasks.workunit.client.0.smithi073.stderr: -228> 2024-09-12T00:48:48.194+0000 7f3e8f562640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:48.545 INFO:tasks.workunit.client.0.smithi073.stderr: -227> 2024-09-12T00:48:48.194+0000 7f3e8f562640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:48.546 INFO:tasks.workunit.client.0.smithi073.stderr: -226> 2024-09-12T00:48:48.194+0000 7f3e8e560640 10 monclient(hunting): get_auth_request con 0x55a8fc14f1a0 auth_method 0 2024-09-12T00:48:48.546 INFO:tasks.workunit.client.0.smithi073.stderr: -225> 2024-09-12T00:48:48.194+0000 7f3e8e560640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:48.546 INFO:tasks.workunit.client.0.smithi073.stderr: -224> 2024-09-12T00:48:48.194+0000 7f3e8e560640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:48.546 INFO:tasks.workunit.client.0.smithi073.stderr: -223> 2024-09-12T00:48:48.194+0000 7f3e8e560640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:48.546 INFO:tasks.workunit.client.0.smithi073.stderr: -222> 2024-09-12T00:48:48.194+0000 7f3e8f562640 10 monclient(hunting): handle_auth_done global_id 6390 payload 274 2024-09-12T00:48:48.546 INFO:tasks.workunit.client.0.smithi073.stderr: -221> 2024-09-12T00:48:48.194+0000 7f3e8f562640 10 monclient: _finish_hunting 0 2024-09-12T00:48:48.546 INFO:tasks.workunit.client.0.smithi073.stderr: -220> 2024-09-12T00:48:48.194+0000 7f3e8f562640 1 monclient: found mon.noname-a 2024-09-12T00:48:48.546 INFO:tasks.workunit.client.0.smithi073.stderr: -219> 2024-09-12T00:48:48.194+0000 7f3e8f562640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:48:48.546 INFO:tasks.workunit.client.0.smithi073.stderr: -218> 2024-09-12T00:48:48.194+0000 7f3d727fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:48.546 INFO:tasks.workunit.client.0.smithi073.stderr: -217> 2024-09-12T00:48:48.194+0000 7f3d727fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:48:48.546 INFO:tasks.workunit.client.0.smithi073.stderr: -216> 2024-09-12T00:48:48.194+0000 7f3d727fc640 10 monclient: dump: 2024-09-12T00:48:48.546 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:48:48.546 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:48:48.547 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:48:48.547 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:48:48.547 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:48.547 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:48:48.547 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:48:48.547 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:48:48.547 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:48:48.547 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:48.547 INFO:tasks.workunit.client.0.smithi073.stderr: -215> 2024-09-12T00:48:48.194+0000 7f3d727fc640 10 monclient: _finish_auth 0 2024-09-12T00:48:48.547 INFO:tasks.workunit.client.0.smithi073.stderr: -214> 2024-09-12T00:48:48.194+0000 7f3d727fc640 10 monclient: _check_auth_tickets 2024-09-12T00:48:48.547 INFO:tasks.workunit.client.0.smithi073.stderr: -213> 2024-09-12T00:48:48.194+0000 7f3d727fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:48:48.547 INFO:tasks.workunit.client.0.smithi073.stderr: -212> 2024-09-12T00:48:48.194+0000 7f3e9312c800 5 monclient: authenticate success, global_id 6390 2024-09-12T00:48:48.548 INFO:tasks.workunit.client.0.smithi073.stderr: -211> 2024-09-12T00:48:48.194+0000 7f3e9312c800 10 monclient: get_monmap_and_config success 2024-09-12T00:48:48.548 INFO:tasks.workunit.client.0.smithi073.stderr: -210> 2024-09-12T00:48:48.194+0000 7f3e9312c800 4 set_mon_vals no callback set 2024-09-12T00:48:48.548 INFO:tasks.workunit.client.0.smithi073.stderr: -209> 2024-09-12T00:48:48.194+0000 7f3d727fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:48.548 INFO:tasks.workunit.client.0.smithi073.stderr: -208> 2024-09-12T00:48:48.194+0000 7f3d727fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:48:48.548 INFO:tasks.workunit.client.0.smithi073.stderr: -207> 2024-09-12T00:48:48.194+0000 7f3d727fc640 10 monclient: dump: 2024-09-12T00:48:48.548 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:48:48.548 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:48:48.548 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:48:48.548 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:48:48.548 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:48.548 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:48:48.548 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:48:48.548 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:48:48.549 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:48:48.549 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:48.549 INFO:tasks.workunit.client.0.smithi073.stderr: -206> 2024-09-12T00:48:48.195+0000 7f3e9312c800 10 monclient: shutdown 2024-09-12T00:48:48.549 INFO:tasks.workunit.client.0.smithi073.stderr: -205> 2024-09-12T00:48:48.195+0000 7f3e9312c800 10 monclient: build_initial_monmap 2024-09-12T00:48:48.549 INFO:tasks.workunit.client.0.smithi073.stderr: -204> 2024-09-12T00:48:48.195+0000 7f3e9312c800 1 build_initial for_mkfs: 0 2024-09-12T00:48:48.549 INFO:tasks.workunit.client.0.smithi073.stderr: -203> 2024-09-12T00:48:48.195+0000 7f3e9312c800 10 monclient: monmap: 2024-09-12T00:48:48.549 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:48:48.549 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:48:48.549 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:48:48.549 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:48:48.549 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:48:48.549 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:48:48.549 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:48:48.550 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:48:48.550 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:48:48.550 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:48.550 INFO:tasks.workunit.client.0.smithi073.stderr: -202> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1706f0) adding auth protocol: cephx 2024-09-12T00:48:48.550 INFO:tasks.workunit.client.0.smithi073.stderr: -201> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1706f0) adding auth protocol: cephx 2024-09-12T00:48:48.550 INFO:tasks.workunit.client.0.smithi073.stderr: -200> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1706f0) adding auth protocol: cephx 2024-09-12T00:48:48.550 INFO:tasks.workunit.client.0.smithi073.stderr: -199> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1706f0) adding con mode: secure 2024-09-12T00:48:48.550 INFO:tasks.workunit.client.0.smithi073.stderr: -198> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1706f0) adding con mode: crc 2024-09-12T00:48:48.550 INFO:tasks.workunit.client.0.smithi073.stderr: -197> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1706f0) adding con mode: secure 2024-09-12T00:48:48.550 INFO:tasks.workunit.client.0.smithi073.stderr: -196> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1706f0) adding con mode: crc 2024-09-12T00:48:48.550 INFO:tasks.workunit.client.0.smithi073.stderr: -195> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1706f0) adding con mode: secure 2024-09-12T00:48:48.550 INFO:tasks.workunit.client.0.smithi073.stderr: -194> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1706f0) adding con mode: crc 2024-09-12T00:48:48.550 INFO:tasks.workunit.client.0.smithi073.stderr: -193> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1706f0) adding con mode: crc 2024-09-12T00:48:48.551 INFO:tasks.workunit.client.0.smithi073.stderr: -192> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1706f0) adding con mode: secure 2024-09-12T00:48:48.551 INFO:tasks.workunit.client.0.smithi073.stderr: -191> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1706f0) adding con mode: crc 2024-09-12T00:48:48.551 INFO:tasks.workunit.client.0.smithi073.stderr: -190> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1706f0) adding con mode: secure 2024-09-12T00:48:48.551 INFO:tasks.workunit.client.0.smithi073.stderr: -189> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1706f0) adding con mode: crc 2024-09-12T00:48:48.551 INFO:tasks.workunit.client.0.smithi073.stderr: -188> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1706f0) adding con mode: secure 2024-09-12T00:48:48.551 INFO:tasks.workunit.client.0.smithi073.stderr: -187> 2024-09-12T00:48:48.195+0000 7f3e9312c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:48.551 INFO:tasks.workunit.client.0.smithi073.stderr: -186> 2024-09-12T00:48:48.195+0000 7f3e9312c800 1 librados: starting msgr at 2024-09-12T00:48:48.551 INFO:tasks.workunit.client.0.smithi073.stderr: -185> 2024-09-12T00:48:48.195+0000 7f3e9312c800 1 librados: starting objecter 2024-09-12T00:48:48.551 INFO:tasks.workunit.client.0.smithi073.stderr: -184> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 asok(0x55a8fbe8d630) register_command objecter_requests cmddesc objecter_requests hook 0x55a8fc14c640 EEXIST 2024-09-12T00:48:48.551 INFO:tasks.workunit.client.0.smithi073.stderr: -183> 2024-09-12T00:48:48.195+0000 7f3e9312c800 1 librados: setting wanted keys 2024-09-12T00:48:48.551 INFO:tasks.workunit.client.0.smithi073.stderr: -182> 2024-09-12T00:48:48.195+0000 7f3e9312c800 1 librados: calling monclient init 2024-09-12T00:48:48.551 INFO:tasks.workunit.client.0.smithi073.stderr: -181> 2024-09-12T00:48:48.195+0000 7f3e9312c800 10 monclient: init 2024-09-12T00:48:48.551 INFO:tasks.workunit.client.0.smithi073.stderr: -180> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1419c0) adding auth protocol: cephx 2024-09-12T00:48:48.551 INFO:tasks.workunit.client.0.smithi073.stderr: -179> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1419c0) adding auth protocol: cephx 2024-09-12T00:48:48.552 INFO:tasks.workunit.client.0.smithi073.stderr: -178> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1419c0) adding auth protocol: cephx 2024-09-12T00:48:48.552 INFO:tasks.workunit.client.0.smithi073.stderr: -177> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1419c0) adding con mode: secure 2024-09-12T00:48:48.552 INFO:tasks.workunit.client.0.smithi073.stderr: -176> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1419c0) adding con mode: crc 2024-09-12T00:48:48.552 INFO:tasks.workunit.client.0.smithi073.stderr: -175> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1419c0) adding con mode: secure 2024-09-12T00:48:48.552 INFO:tasks.workunit.client.0.smithi073.stderr: -174> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1419c0) adding con mode: crc 2024-09-12T00:48:48.552 INFO:tasks.workunit.client.0.smithi073.stderr: -173> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1419c0) adding con mode: secure 2024-09-12T00:48:48.552 INFO:tasks.workunit.client.0.smithi073.stderr: -172> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1419c0) adding con mode: crc 2024-09-12T00:48:48.552 INFO:tasks.workunit.client.0.smithi073.stderr: -171> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1419c0) adding con mode: crc 2024-09-12T00:48:48.552 INFO:tasks.workunit.client.0.smithi073.stderr: -170> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1419c0) adding con mode: secure 2024-09-12T00:48:48.552 INFO:tasks.workunit.client.0.smithi073.stderr: -169> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1419c0) adding con mode: crc 2024-09-12T00:48:48.552 INFO:tasks.workunit.client.0.smithi073.stderr: -168> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1419c0) adding con mode: secure 2024-09-12T00:48:48.552 INFO:tasks.workunit.client.0.smithi073.stderr: -167> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1419c0) adding con mode: crc 2024-09-12T00:48:48.553 INFO:tasks.workunit.client.0.smithi073.stderr: -166> 2024-09-12T00:48:48.195+0000 7f3e9312c800 5 AuthRegistry(0x55a8fc1419c0) adding con mode: secure 2024-09-12T00:48:48.553 INFO:tasks.workunit.client.0.smithi073.stderr: -165> 2024-09-12T00:48:48.196+0000 7f3e9312c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:48.553 INFO:tasks.workunit.client.0.smithi073.stderr: -164> 2024-09-12T00:48:48.196+0000 7f3e9312c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:48.553 INFO:tasks.workunit.client.0.smithi073.stderr: -163> 2024-09-12T00:48:48.196+0000 7f3e9312c800 5 asok(0x55a8fbe8d630) register_command rotate-key cmddesc rotate-key hook 0x55a8fc141b08 EEXIST 2024-09-12T00:48:48.553 INFO:tasks.workunit.client.0.smithi073.stderr: -162> 2024-09-12T00:48:48.196+0000 7f3e9312c800 10 monclient: _reopen_session rank -1 2024-09-12T00:48:48.553 INFO:tasks.workunit.client.0.smithi073.stderr: -161> 2024-09-12T00:48:48.196+0000 7f3e9312c800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:48:48.553 INFO:tasks.workunit.client.0.smithi073.stderr: -160> 2024-09-12T00:48:48.196+0000 7f3e9312c800 10 monclient(hunting): picked mon.noname-a con 0x55a8fc14f1a0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:48:48.553 INFO:tasks.workunit.client.0.smithi073.stderr: -159> 2024-09-12T00:48:48.196+0000 7f3e9312c800 10 monclient(hunting): picked mon.noname-b con 0x55a8fc179af0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:48:48.553 INFO:tasks.workunit.client.0.smithi073.stderr: -158> 2024-09-12T00:48:48.196+0000 7f3e9312c800 10 monclient(hunting): picked mon.noname-c con 0x55a8fc17e250 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:48:48.553 INFO:tasks.workunit.client.0.smithi073.stderr: -157> 2024-09-12T00:48:48.196+0000 7f3e9312c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:48.553 INFO:tasks.workunit.client.0.smithi073.stderr: -156> 2024-09-12T00:48:48.196+0000 7f3e9312c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:48.553 INFO:tasks.workunit.client.0.smithi073.stderr: -155> 2024-09-12T00:48:48.196+0000 7f3e9312c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:48.553 INFO:tasks.workunit.client.0.smithi073.stderr: -154> 2024-09-12T00:48:48.196+0000 7f3e9312c800 10 monclient(hunting): _renew_subs 2024-09-12T00:48:48.554 INFO:tasks.workunit.client.0.smithi073.stderr: -153> 2024-09-12T00:48:48.196+0000 7f3e9312c800 10 monclient(hunting): authenticate will time out at 1988.867441s 2024-09-12T00:48:48.554 INFO:tasks.workunit.client.0.smithi073.stderr: -152> 2024-09-12T00:48:48.196+0000 7f3e8ed61640 10 monclient(hunting): get_auth_request con 0x55a8fc14f1a0 auth_method 0 2024-09-12T00:48:48.554 INFO:tasks.workunit.client.0.smithi073.stderr: -151> 2024-09-12T00:48:48.196+0000 7f3e8ed61640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:48.554 INFO:tasks.workunit.client.0.smithi073.stderr: -150> 2024-09-12T00:48:48.196+0000 7f3e8ed61640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:48.554 INFO:tasks.workunit.client.0.smithi073.stderr: -149> 2024-09-12T00:48:48.196+0000 7f3e8ed61640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:48.554 INFO:tasks.workunit.client.0.smithi073.stderr: -148> 2024-09-12T00:48:48.196+0000 7f3e8f562640 10 monclient(hunting): get_auth_request con 0x55a8fc17e250 auth_method 0 2024-09-12T00:48:48.554 INFO:tasks.workunit.client.0.smithi073.stderr: -147> 2024-09-12T00:48:48.196+0000 7f3e8f562640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:48.554 INFO:tasks.workunit.client.0.smithi073.stderr: -146> 2024-09-12T00:48:48.196+0000 7f3e8f562640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:48.554 INFO:tasks.workunit.client.0.smithi073.stderr: -145> 2024-09-12T00:48:48.196+0000 7f3e8f562640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:48.554 INFO:tasks.workunit.client.0.smithi073.stderr: -144> 2024-09-12T00:48:48.196+0000 7f3e8ed61640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:48.554 INFO:tasks.workunit.client.0.smithi073.stderr: -143> 2024-09-12T00:48:48.196+0000 7f3e8ed61640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:48.554 INFO:tasks.workunit.client.0.smithi073.stderr: -142> 2024-09-12T00:48:48.196+0000 7f3e8ed61640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:48.554 INFO:tasks.workunit.client.0.smithi073.stderr: -141> 2024-09-12T00:48:48.196+0000 7f3e8f562640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:48.555 INFO:tasks.workunit.client.0.smithi073.stderr: -140> 2024-09-12T00:48:48.196+0000 7f3e8f562640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:48.555 INFO:tasks.workunit.client.0.smithi073.stderr: -139> 2024-09-12T00:48:48.196+0000 7f3e8f562640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:48.555 INFO:tasks.workunit.client.0.smithi073.stderr: -138> 2024-09-12T00:48:48.196+0000 7f3e8e560640 10 monclient(hunting): get_auth_request con 0x55a8fc179af0 auth_method 0 2024-09-12T00:48:48.555 INFO:tasks.workunit.client.0.smithi073.stderr: -137> 2024-09-12T00:48:48.196+0000 7f3e8e560640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:48.555 INFO:tasks.workunit.client.0.smithi073.stderr: -136> 2024-09-12T00:48:48.196+0000 7f3e8e560640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:48.555 INFO:tasks.workunit.client.0.smithi073.stderr: -135> 2024-09-12T00:48:48.196+0000 7f3e8e560640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:48.555 INFO:tasks.workunit.client.0.smithi073.stderr: -134> 2024-09-12T00:48:48.196+0000 7f3e8ed61640 10 monclient(hunting): handle_auth_done global_id 6393 payload 824 2024-09-12T00:48:48.555 INFO:tasks.workunit.client.0.smithi073.stderr: -133> 2024-09-12T00:48:48.196+0000 7f3e8ed61640 10 monclient: _finish_hunting 0 2024-09-12T00:48:48.555 INFO:tasks.workunit.client.0.smithi073.stderr: -132> 2024-09-12T00:48:48.196+0000 7f3e8ed61640 1 monclient: found mon.noname-a 2024-09-12T00:48:48.555 INFO:tasks.workunit.client.0.smithi073.stderr: -131> 2024-09-12T00:48:48.196+0000 7f3e8ed61640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:48:48.555 INFO:tasks.workunit.client.0.smithi073.stderr: -130> 2024-09-12T00:48:48.197+0000 7f3d70ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:48.555 INFO:tasks.workunit.client.0.smithi073.stderr: -129> 2024-09-12T00:48:48.197+0000 7f3d70ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:48:48.555 INFO:tasks.workunit.client.0.smithi073.stderr: -128> 2024-09-12T00:48:48.197+0000 7f3d70ff9640 10 monclient: dump: 2024-09-12T00:48:48.555 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:48:48.556 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:48:48.556 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:48:48.556 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:48:48.556 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:48.556 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:48:48.556 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:48:48.556 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:48:48.556 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:48:48.556 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:48.556 INFO:tasks.workunit.client.0.smithi073.stderr: -127> 2024-09-12T00:48:48.197+0000 7f3d70ff9640 10 monclient: _finish_auth 0 2024-09-12T00:48:48.556 INFO:tasks.workunit.client.0.smithi073.stderr: -126> 2024-09-12T00:48:48.197+0000 7f3d70ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:48:48.556 INFO:tasks.workunit.client.0.smithi073.stderr: -125> 2024-09-12T00:48:48.197+0000 7f3d70ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:48:48.556 INFO:tasks.workunit.client.0.smithi073.stderr: -124> 2024-09-12T00:48:48.197+0000 7f3d70ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:48.557 INFO:tasks.workunit.client.0.smithi073.stderr: -123> 2024-09-12T00:48:48.197+0000 7f3d70ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:48:48.557 INFO:tasks.workunit.client.0.smithi073.stderr: -122> 2024-09-12T00:48:48.197+0000 7f3d70ff9640 10 monclient: dump: 2024-09-12T00:48:48.557 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:48:48.557 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:48:48.557 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:48:48.557 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:48:48.557 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:48.557 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:48:48.557 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:48:48.557 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:48:48.557 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:48:48.557 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:48.557 INFO:tasks.workunit.client.0.smithi073.stderr: -121> 2024-09-12T00:48:48.197+0000 7f3e9312c800 5 monclient: authenticate success, global_id 6393 2024-09-12T00:48:48.558 INFO:tasks.workunit.client.0.smithi073.stderr: -120> 2024-09-12T00:48:48.197+0000 7f3e9312c800 10 monclient: _renew_subs 2024-09-12T00:48:48.558 INFO:tasks.workunit.client.0.smithi073.stderr: -119> 2024-09-12T00:48:48.197+0000 7f3d727fc640 4 set_mon_vals no callback set 2024-09-12T00:48:48.558 INFO:tasks.workunit.client.0.smithi073.stderr: -118> 2024-09-12T00:48:48.197+0000 7f3e9312c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:48:48.558 INFO:tasks.workunit.client.0.smithi073.stderr: -117> 2024-09-12T00:48:48.197+0000 7f3e9312c800 10 monclient: _renew_subs 2024-09-12T00:48:48.558 INFO:tasks.workunit.client.0.smithi073.stderr: -116> 2024-09-12T00:48:48.197+0000 7f3e9312c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:48:48.558 INFO:tasks.workunit.client.0.smithi073.stderr: -115> 2024-09-12T00:48:48.197+0000 7f3e9312c800 1 librados: init done 2024-09-12T00:48:48.558 INFO:tasks.workunit.client.0.smithi073.stderr: -114> 2024-09-12T00:48:48.197+0000 7f3e9312c800 5 asok(0x55a8fbe8d630) register_command cr dump hook 0x55a8fc14e398 2024-09-12T00:48:48.558 INFO:tasks.workunit.client.0.smithi073.stderr: -113> 2024-09-12T00:48:48.198+0000 7f3e9312c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.558 INFO:tasks.workunit.client.0.smithi073.stderr: -112> 2024-09-12T00:48:48.199+0000 7f3d70ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:48:48.558 INFO:tasks.workunit.client.0.smithi073.stderr: -111> 2024-09-12T00:48:48.199+0000 7f3d70ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:48:48.558 INFO:tasks.workunit.client.0.smithi073.stderr: -110> 2024-09-12T00:48:48.199+0000 7f3d70ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:48:48.558 INFO:tasks.workunit.client.0.smithi073.stderr: -109> 2024-09-12T00:48:48.199+0000 7f3e8e560640 10 monclient: get_auth_request con 0x7f3d580764a0 auth_method 0 2024-09-12T00:48:48.558 INFO:tasks.workunit.client.0.smithi073.stderr: -108> 2024-09-12T00:48:48.199+0000 7f3e8f562640 10 monclient: get_auth_request con 0x55a8fc198920 auth_method 0 2024-09-12T00:48:48.559 INFO:tasks.workunit.client.0.smithi073.stderr: -107> 2024-09-12T00:48:48.200+0000 7f3e9312c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:48.559 INFO:tasks.workunit.client.0.smithi073.stderr: -106> 2024-09-12T00:48:48.200+0000 7f3e9312c800 20 realm 2024-09-12T00:48:48.559 INFO:tasks.workunit.client.0.smithi073.stderr: -105> 2024-09-12T00:48:48.200+0000 7f3e9312c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.559 INFO:tasks.workunit.client.0.smithi073.stderr: -104> 2024-09-12T00:48:48.200+0000 7f3e9312c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:48.559 INFO:tasks.workunit.client.0.smithi073.stderr: -103> 2024-09-12T00:48:48.200+0000 7f3e9312c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:48.559 INFO:tasks.workunit.client.0.smithi073.stderr: -102> 2024-09-12T00:48:48.200+0000 7f3e9312c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.559 INFO:tasks.workunit.client.0.smithi073.stderr: -101> 2024-09-12T00:48:48.200+0000 7f3e9312c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:48.559 INFO:tasks.workunit.client.0.smithi073.stderr: -100> 2024-09-12T00:48:48.200+0000 7f3e9312c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.559 INFO:tasks.workunit.client.0.smithi073.stderr: -99> 2024-09-12T00:48:48.201+0000 7f3e8ed61640 10 monclient: get_auth_request con 0x55a8fc19cb10 auth_method 0 2024-09-12T00:48:48.559 INFO:tasks.workunit.client.0.smithi073.stderr: -98> 2024-09-12T00:48:48.201+0000 7f3e9312c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:48.559 INFO:tasks.workunit.client.0.smithi073.stderr: -97> 2024-09-12T00:48:48.202+0000 7f3e9312c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.559 INFO:tasks.workunit.client.0.smithi073.stderr: -96> 2024-09-12T00:48:48.202+0000 7f3e8e560640 10 monclient: get_auth_request con 0x55a8fc1a0370 auth_method 0 2024-09-12T00:48:48.559 INFO:tasks.workunit.client.0.smithi073.stderr: -95> 2024-09-12T00:48:48.202+0000 7f3e9312c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:48.559 INFO:tasks.workunit.client.0.smithi073.stderr: -94> 2024-09-12T00:48:48.202+0000 7f3e9312c800 20 searching for the correct realm 2024-09-12T00:48:48.560 INFO:tasks.workunit.client.0.smithi073.stderr: -93> 2024-09-12T00:48:48.203+0000 7f3e8f562640 10 monclient: get_auth_request con 0x55a8fc1a5130 auth_method 0 2024-09-12T00:48:48.560 INFO:tasks.workunit.client.0.smithi073.stderr: -92> 2024-09-12T00:48:48.203+0000 7f3e8ed61640 10 monclient: get_auth_request con 0x7f3e88023930 auth_method 0 2024-09-12T00:48:48.560 INFO:tasks.workunit.client.0.smithi073.stderr: -91> 2024-09-12T00:48:48.204+0000 7f3e8e560640 10 monclient: get_auth_request con 0x7f3e80099650 auth_method 0 2024-09-12T00:48:48.560 INFO:tasks.workunit.client.0.smithi073.stderr: -90> 2024-09-12T00:48:48.205+0000 7f3e8f562640 10 monclient: get_auth_request con 0x7f3e84018070 auth_method 0 2024-09-12T00:48:48.560 INFO:tasks.workunit.client.0.smithi073.stderr: -89> 2024-09-12T00:48:48.205+0000 7f3e8f562640 0 -- 172.21.15.73:0/1364781717 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f3e84018070 msgr2=0x7f3e84089d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:48.560 INFO:tasks.workunit.client.0.smithi073.stderr: -88> 2024-09-12T00:48:48.407+0000 7f3e8f562640 10 monclient: get_auth_request con 0x7f3e84018070 auth_method 0 2024-09-12T00:48:48.560 INFO:tasks.workunit.client.0.smithi073.stderr: -87> 2024-09-12T00:48:48.412+0000 7f3e8ed61640 10 monclient: get_auth_request con 0x7f3e88043040 auth_method 0 2024-09-12T00:48:48.560 INFO:tasks.workunit.client.0.smithi073.stderr: -86> 2024-09-12T00:48:48.413+0000 7f3e8f562640 0 -- 172.21.15.73:0/1364781717 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f3e84018070 msgr2=0x7f3e84089d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:48.560 INFO:tasks.workunit.client.0.smithi073.stderr: -85> 2024-09-12T00:48:48.413+0000 7f3d70ff9640 1 client.6393.objecter ms_handle_reset 0x7f3e84018070 session 0x7f3e8408f870 osd.4 2024-09-12T00:48:48.560 INFO:tasks.workunit.client.0.smithi073.stderr: -84> 2024-09-12T00:48:48.413+0000 7f3d70ff9640 10 monclient: _renew_subs 2024-09-12T00:48:48.560 INFO:tasks.workunit.client.0.smithi073.stderr: -83> 2024-09-12T00:48:48.413+0000 7f3d70ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:48:48.560 INFO:tasks.workunit.client.0.smithi073.stderr: -82> 2024-09-12T00:48:48.413+0000 7f3e8f562640 10 monclient: get_auth_request con 0x7f3d580862c0 auth_method 0 2024-09-12T00:48:48.561 INFO:tasks.workunit.client.0.smithi073.stderr: -81> 2024-09-12T00:48:48.417+0000 7f3e9312c800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:48:48.561 INFO:tasks.workunit.client.0.smithi073.stderr: -80> 2024-09-12T00:48:48.417+0000 7f3e9312c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:48.561 INFO:tasks.workunit.client.0.smithi073.stderr: -79> 2024-09-12T00:48:48.417+0000 7f3e9312c800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:48:48.561 INFO:tasks.workunit.client.0.smithi073.stderr: -78> 2024-09-12T00:48:48.417+0000 7f3e9312c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:48.561 INFO:tasks.workunit.client.0.smithi073.stderr: -77> 2024-09-12T00:48:48.417+0000 7f3e9312c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:48.561 INFO:tasks.workunit.client.0.smithi073.stderr: -76> 2024-09-12T00:48:48.417+0000 7f3e9312c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:48.561 INFO:tasks.workunit.client.0.smithi073.stderr: -75> 2024-09-12T00:48:48.417+0000 7f3e9312c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.561 INFO:tasks.workunit.client.0.smithi073.stderr: -74> 2024-09-12T00:48:48.417+0000 7f3e9312c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:48.561 INFO:tasks.workunit.client.0.smithi073.stderr: -73> 2024-09-12T00:48:48.417+0000 7f3e9312c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.561 INFO:tasks.workunit.client.0.smithi073.stderr: -72> 2024-09-12T00:48:48.418+0000 7f3e9312c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:48.561 INFO:tasks.workunit.client.0.smithi073.stderr: -71> 2024-09-12T00:48:48.418+0000 7f3e9312c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.561 INFO:tasks.workunit.client.0.smithi073.stderr: -70> 2024-09-12T00:48:48.418+0000 7f3e9312c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:48.561 INFO:tasks.workunit.client.0.smithi073.stderr: -69> 2024-09-12T00:48:48.418+0000 7f3e9312c800 20 zone default found 2024-09-12T00:48:48.561 INFO:tasks.workunit.client.0.smithi073.stderr: -68> 2024-09-12T00:48:48.418+0000 7f3e9312c800 4 Realm: () 2024-09-12T00:48:48.562 INFO:tasks.workunit.client.0.smithi073.stderr: -67> 2024-09-12T00:48:48.418+0000 7f3e9312c800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:48:48.562 INFO:tasks.workunit.client.0.smithi073.stderr: -66> 2024-09-12T00:48:48.418+0000 7f3e9312c800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:48:48.562 INFO:tasks.workunit.client.0.smithi073.stderr: -65> 2024-09-12T00:48:48.418+0000 7f3e9312c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:48.562 INFO:tasks.workunit.client.0.smithi073.stderr: -64> 2024-09-12T00:48:48.418+0000 7f3e9312c800 20 zonegroup default 2024-09-12T00:48:48.562 INFO:tasks.workunit.client.0.smithi073.stderr: -63> 2024-09-12T00:48:48.418+0000 7f3e9312c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.562 INFO:tasks.workunit.client.0.smithi073.stderr: -62> 2024-09-12T00:48:48.418+0000 7f3e9312c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:48.562 INFO:tasks.workunit.client.0.smithi073.stderr: -61> 2024-09-12T00:48:48.418+0000 7f3e9312c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.562 INFO:tasks.workunit.client.0.smithi073.stderr: -60> 2024-09-12T00:48:48.419+0000 7f3e9312c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:48.562 INFO:tasks.workunit.client.0.smithi073.stderr: -59> 2024-09-12T00:48:48.419+0000 7f3e9312c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.562 INFO:tasks.workunit.client.0.smithi073.stderr: -58> 2024-09-12T00:48:48.419+0000 7f3e9312c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:48.562 INFO:tasks.workunit.client.0.smithi073.stderr: -57> 2024-09-12T00:48:48.419+0000 7f3e9312c800 20 started sync module instance, tier type = 2024-09-12T00:48:48.562 INFO:tasks.workunit.client.0.smithi073.stderr: -56> 2024-09-12T00:48:48.419+0000 7f3e9312c800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:48:48.562 INFO:tasks.workunit.client.0.smithi073.stderr: -55> 2024-09-12T00:48:48.428+0000 7f3e9312c800 20 add_watcher() i=0 2024-09-12T00:48:48.563 INFO:tasks.workunit.client.0.smithi073.stderr: -54> 2024-09-12T00:48:48.428+0000 7f3e9312c800 20 add_watcher() i=1 2024-09-12T00:48:48.563 INFO:tasks.workunit.client.0.smithi073.stderr: -53> 2024-09-12T00:48:48.428+0000 7f3e9312c800 20 add_watcher() i=2 2024-09-12T00:48:48.563 INFO:tasks.workunit.client.0.smithi073.stderr: -52> 2024-09-12T00:48:48.428+0000 7f3e9312c800 20 add_watcher() i=3 2024-09-12T00:48:48.563 INFO:tasks.workunit.client.0.smithi073.stderr: -51> 2024-09-12T00:48:48.428+0000 7f3e9312c800 20 add_watcher() i=4 2024-09-12T00:48:48.563 INFO:tasks.workunit.client.0.smithi073.stderr: -50> 2024-09-12T00:48:48.428+0000 7f3e9312c800 20 add_watcher() i=5 2024-09-12T00:48:48.563 INFO:tasks.workunit.client.0.smithi073.stderr: -49> 2024-09-12T00:48:48.428+0000 7f3e9312c800 20 add_watcher() i=6 2024-09-12T00:48:48.563 INFO:tasks.workunit.client.0.smithi073.stderr: -48> 2024-09-12T00:48:48.429+0000 7f3e9312c800 20 add_watcher() i=7 2024-09-12T00:48:48.563 INFO:tasks.workunit.client.0.smithi073.stderr: -47> 2024-09-12T00:48:48.429+0000 7f3e9312c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:48.563 INFO:tasks.workunit.client.0.smithi073.stderr: -46> 2024-09-12T00:48:48.431+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815696b0) adding auth protocol: cephx 2024-09-12T00:48:48.563 INFO:tasks.workunit.client.0.smithi073.stderr: -45> 2024-09-12T00:48:48.431+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815696b0) adding auth protocol: cephx 2024-09-12T00:48:48.563 INFO:tasks.workunit.client.0.smithi073.stderr: -44> 2024-09-12T00:48:48.431+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815696b0) adding auth protocol: cephx 2024-09-12T00:48:48.563 INFO:tasks.workunit.client.0.smithi073.stderr: -43> 2024-09-12T00:48:48.431+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815696b0) adding con mode: secure 2024-09-12T00:48:48.563 INFO:tasks.workunit.client.0.smithi073.stderr: -42> 2024-09-12T00:48:48.431+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815696b0) adding con mode: crc 2024-09-12T00:48:48.563 INFO:tasks.workunit.client.0.smithi073.stderr: -41> 2024-09-12T00:48:48.431+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815696b0) adding con mode: secure 2024-09-12T00:48:48.564 INFO:tasks.workunit.client.0.smithi073.stderr: -40> 2024-09-12T00:48:48.431+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815696b0) adding con mode: crc 2024-09-12T00:48:48.564 INFO:tasks.workunit.client.0.smithi073.stderr: -39> 2024-09-12T00:48:48.431+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815696b0) adding con mode: secure 2024-09-12T00:48:48.564 INFO:tasks.workunit.client.0.smithi073.stderr: -38> 2024-09-12T00:48:48.431+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815696b0) adding con mode: crc 2024-09-12T00:48:48.564 INFO:tasks.workunit.client.0.smithi073.stderr: -37> 2024-09-12T00:48:48.431+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815696b0) adding con mode: crc 2024-09-12T00:48:48.564 INFO:tasks.workunit.client.0.smithi073.stderr: -36> 2024-09-12T00:48:48.431+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815696b0) adding con mode: secure 2024-09-12T00:48:48.564 INFO:tasks.workunit.client.0.smithi073.stderr: -35> 2024-09-12T00:48:48.431+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815696b0) adding con mode: crc 2024-09-12T00:48:48.564 INFO:tasks.workunit.client.0.smithi073.stderr: -34> 2024-09-12T00:48:48.431+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815696b0) adding con mode: secure 2024-09-12T00:48:48.564 INFO:tasks.workunit.client.0.smithi073.stderr: -33> 2024-09-12T00:48:48.431+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815696b0) adding con mode: crc 2024-09-12T00:48:48.564 INFO:tasks.workunit.client.0.smithi073.stderr: -32> 2024-09-12T00:48:48.431+0000 7f3e9312c800 5 AuthRegistry(0x7ffd815696b0) adding con mode: secure 2024-09-12T00:48:48.564 INFO:tasks.workunit.client.0.smithi073.stderr: -31> 2024-09-12T00:48:48.431+0000 7f3d457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:48.564 INFO:tasks.workunit.client.0.smithi073.stderr: -30> 2024-09-12T00:48:48.431+0000 7f3e9312c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:48.565 INFO:tasks.workunit.client.0.smithi073.stderr: -29> 2024-09-12T00:48:48.431+0000 7f3e9312c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:48.565 INFO:tasks.workunit.client.0.smithi073.stderr: -28> 2024-09-12T00:48:48.431+0000 7f3e9312c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:48.565 INFO:tasks.workunit.client.0.smithi073.stderr: -27> 2024-09-12T00:48:48.431+0000 7f3e9312c800 5 asok(0x55a8fbe8d630) register_command cache list hook 0x55a8fc1888e0 2024-09-12T00:48:48.565 INFO:tasks.workunit.client.0.smithi073.stderr: -26> 2024-09-12T00:48:48.431+0000 7f3e9312c800 5 asok(0x55a8fbe8d630) register_command cache inspect hook 0x55a8fc1888e0 2024-09-12T00:48:48.565 INFO:tasks.workunit.client.0.smithi073.stderr: -25> 2024-09-12T00:48:48.431+0000 7f3e9312c800 5 asok(0x55a8fbe8d630) register_command cache erase hook 0x55a8fc1888e0 2024-09-12T00:48:48.565 INFO:tasks.workunit.client.0.smithi073.stderr: -24> 2024-09-12T00:48:48.431+0000 7f3e9312c800 5 asok(0x55a8fbe8d630) register_command cache zap hook 0x55a8fc1888e0 2024-09-12T00:48:48.565 INFO:tasks.workunit.client.0.smithi073.stderr: -23> 2024-09-12T00:48:48.431+0000 7f3e9312c800 5 note: GC not initialized 2024-09-12T00:48:48.565 INFO:tasks.workunit.client.0.smithi073.stderr: -22> 2024-09-12T00:48:48.431+0000 7f3cbffff640 20 reqs_thread_entry: start 2024-09-12T00:48:48.565 INFO:tasks.workunit.client.0.smithi073.stderr: -21> 2024-09-12T00:48:48.431+0000 7f3e9312c800 5 asok(0x55a8fbe8d630) register_command sync trace show hook 0x7f3e8800c040 2024-09-12T00:48:48.565 INFO:tasks.workunit.client.0.smithi073.stderr: -20> 2024-09-12T00:48:48.431+0000 7f3e9312c800 5 asok(0x55a8fbe8d630) register_command sync trace history hook 0x7f3e8800c040 2024-09-12T00:48:48.565 INFO:tasks.workunit.client.0.smithi073.stderr: -19> 2024-09-12T00:48:48.431+0000 7f3e9312c800 5 asok(0x55a8fbe8d630) register_command sync trace active hook 0x7f3e8800c040 2024-09-12T00:48:48.565 INFO:tasks.workunit.client.0.smithi073.stderr: -18> 2024-09-12T00:48:48.431+0000 7f3e9312c800 5 asok(0x55a8fbe8d630) register_command sync trace active_short hook 0x7f3e8800c040 2024-09-12T00:48:48.565 INFO:tasks.workunit.client.0.smithi073.stderr: -17> 2024-09-12T00:48:48.432+0000 7f3e9312c800 20 init_complete bucket index max shards: 1 2024-09-12T00:48:48.566 INFO:tasks.workunit.client.0.smithi073.stderr: -16> 2024-09-12T00:48:48.432+0000 7f3e9312c800 20 Filter name: none 2024-09-12T00:48:48.566 INFO:tasks.workunit.client.0.smithi073.stderr: -15> 2024-09-12T00:48:48.432+0000 7f3cbdffb640 20 reqs_thread_entry: start 2024-09-12T00:48:48.566 INFO:tasks.workunit.client.0.smithi073.stderr: -14> 2024-09-12T00:48:48.432+0000 7f3e9312c800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:48:48.566 INFO:tasks.workunit.client.0.smithi073.stderr: -13> 2024-09-12T00:48:48.432+0000 7f3e9312c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.566 INFO:tasks.workunit.client.0.smithi073.stderr: -12> 2024-09-12T00:48:48.432+0000 7f3e9312c800 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:48:48.566 INFO:tasks.workunit.client.0.smithi073.stderr: -11> 2024-09-12T00:48:48.432+0000 7f3e9312c800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:48:48.566 INFO:tasks.workunit.client.0.smithi073.stderr: -10> 2024-09-12T00:48:48.432+0000 7f3e9312c800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:48:48.566 INFO:tasks.workunit.client.0.smithi073.stderr: -9> 2024-09-12T00:48:48.432+0000 7f3e9312c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21 : miss 2024-09-12T00:48:48.566 INFO:tasks.workunit.client.0.smithi073.stderr: -8> 2024-09-12T00:48:48.432+0000 7f3e9312c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.566 INFO:tasks.workunit.client.0.smithi073.stderr: -7> 2024-09-12T00:48:48.433+0000 7f3e9312c800 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:48:48.566 INFO:tasks.workunit.client.0.smithi073.stderr: -6> 2024-09-12T00:48:48.433+0000 7f3e9312c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21 info.flags=0x17 2024-09-12T00:48:48.566 INFO:tasks.workunit.client.0.smithi073.stderr: -5> 2024-09-12T00:48:48.433+0000 7f3e9312c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21 to cache LRU end 2024-09-12T00:48:48.566 INFO:tasks.workunit.client.0.smithi073.stderr: -4> 2024-09-12T00:48:48.433+0000 7f3e9312c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:48:48.567 INFO:tasks.workunit.client.0.smithi073.stderr: -3> 2024-09-12T00:48:48.433+0000 7f3e9312c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:48.567 INFO:tasks.workunit.client.0.smithi073.stderr: -2> 2024-09-12T00:48:48.433+0000 7f3e9312c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21 2024-09-12T00:48:48.567 INFO:tasks.workunit.client.0.smithi073.stderr: -1> 2024-09-12T00:48:48.435+0000 7f3e9312c800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3e9312c800 time 2024-09-12T00:48:48.436536+0000 2024-09-12T00:48:48.567 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:48:48.567 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:48.567 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:48:48.567 INFO:tasks.workunit.client.0.smithi073.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3e9478c71a] 2024-09-12T00:48:48.567 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3e9478c8d8] 2024-09-12T00:48:48.567 INFO:tasks.workunit.client.0.smithi073.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a8fa672641] 2024-09-12T00:48:48.567 INFO:tasks.workunit.client.0.smithi073.stderr: 4: radosgw-admin(+0xd877a4) [0x55a8fab847a4] 2024-09-12T00:48:48.567 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a8fa68231d] 2024-09-12T00:48:48.567 INFO:tasks.workunit.client.0.smithi073.stderr: 6: main() 2024-09-12T00:48:48.567 INFO:tasks.workunit.client.0.smithi073.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f3e93429590] 2024-09-12T00:48:48.568 INFO:tasks.workunit.client.0.smithi073.stderr: 8: __libc_start_main() 2024-09-12T00:48:48.568 INFO:tasks.workunit.client.0.smithi073.stderr: 9: _start() 2024-09-12T00:48:48.568 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:48.568 INFO:tasks.workunit.client.0.smithi073.stderr: 0> 2024-09-12T00:48:48.436+0000 7f3e9312c800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:48:48.568 INFO:tasks.workunit.client.0.smithi073.stderr: in thread 7f3e9312c800 thread_name:radosgw-admin 2024-09-12T00:48:48.568 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:48.568 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:48:48.568 INFO:tasks.workunit.client.0.smithi073.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3e9343e6f0] 2024-09-12T00:48:48.568 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3e9348b99c] 2024-09-12T00:48:48.568 INFO:tasks.workunit.client.0.smithi073.stderr: 3: raise() 2024-09-12T00:48:48.568 INFO:tasks.workunit.client.0.smithi073.stderr: 4: abort() 2024-09-12T00:48:48.568 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3e9478c774] 2024-09-12T00:48:48.568 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3e9478c8d8] 2024-09-12T00:48:48.569 INFO:tasks.workunit.client.0.smithi073.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a8fa672641] 2024-09-12T00:48:48.569 INFO:tasks.workunit.client.0.smithi073.stderr: 8: radosgw-admin(+0xd877a4) [0x55a8fab847a4] 2024-09-12T00:48:48.569 INFO:tasks.workunit.client.0.smithi073.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a8fa68231d] 2024-09-12T00:48:48.569 INFO:tasks.workunit.client.0.smithi073.stderr: 10: main() 2024-09-12T00:48:48.569 INFO:tasks.workunit.client.0.smithi073.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f3e93429590] 2024-09-12T00:48:48.569 INFO:tasks.workunit.client.0.smithi073.stderr: 12: __libc_start_main() 2024-09-12T00:48:48.569 INFO:tasks.workunit.client.0.smithi073.stderr: 13: _start() 2024-09-12T00:48:48.569 INFO:tasks.workunit.client.0.smithi073.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:48:48.569 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:48.569 INFO:tasks.workunit.client.0.smithi073.stderr:--- logging levels --- 2024-09-12T00:48:48.569 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 none 2024-09-12T00:48:48.569 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 lockdep 2024-09-12T00:48:48.569 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 context 2024-09-12T00:48:48.570 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 crush 2024-09-12T00:48:48.570 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds 2024-09-12T00:48:48.570 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_balancer 2024-09-12T00:48:48.570 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_locker 2024-09-12T00:48:48.570 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_log 2024-09-12T00:48:48.570 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_log_expire 2024-09-12T00:48:48.570 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_migrator 2024-09-12T00:48:48.570 INFO:tasks.workunit.client.0.smithi073.stderr: 3/ 5 mds_quiesce 2024-09-12T00:48:48.570 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 buffer 2024-09-12T00:48:48.570 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 timer 2024-09-12T00:48:48.570 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 filer 2024-09-12T00:48:48.570 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 striper 2024-09-12T00:48:48.570 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 objecter 2024-09-12T00:48:48.571 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rados 2024-09-12T00:48:48.571 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd 2024-09-12T00:48:48.571 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_mirror 2024-09-12T00:48:48.571 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_replay 2024-09-12T00:48:48.571 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_pwl 2024-09-12T00:48:48.571 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 journaler 2024-09-12T00:48:48.571 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 objectcacher 2024-09-12T00:48:48.571 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:48:48.571 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 client 2024-09-12T00:48:48.571 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 osd 2024-09-12T00:48:48.571 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 optracker 2024-09-12T00:48:48.571 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 objclass 2024-09-12T00:48:48.571 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 filestore 2024-09-12T00:48:48.571 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 journal 2024-09-12T00:48:48.572 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 0 ms 2024-09-12T00:48:48.572 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mon 2024-09-12T00:48:48.572 INFO:tasks.workunit.client.0.smithi073.stderr: 0/10 monc 2024-09-12T00:48:48.572 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 paxos 2024-09-12T00:48:48.572 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 tp 2024-09-12T00:48:48.572 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 auth 2024-09-12T00:48:48.572 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 crypto 2024-09-12T00:48:48.572 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 finisher 2024-09-12T00:48:48.572 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 reserver 2024-09-12T00:48:48.572 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 heartbeatmap 2024-09-12T00:48:48.572 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 perfcounter 2024-09-12T00:48:48.572 INFO:tasks.workunit.client.0.smithi073.stderr: 20/20 rgw 2024-09-12T00:48:48.572 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_sync 2024-09-12T00:48:48.572 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_datacache 2024-09-12T00:48:48.573 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_access 2024-09-12T00:48:48.573 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:48:48.573 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_flight 2024-09-12T00:48:48.573 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:48:48.573 INFO:tasks.workunit.client.0.smithi073.stderr: 20/20 rgw_notification 2024-09-12T00:48:48.573 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 javaclient 2024-09-12T00:48:48.573 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 asok 2024-09-12T00:48:48.573 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 throttle 2024-09-12T00:48:48.573 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 0 refs 2024-09-12T00:48:48.573 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 compressor 2024-09-12T00:48:48.573 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 bluestore 2024-09-12T00:48:48.573 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 bluefs 2024-09-12T00:48:48.573 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 bdev 2024-09-12T00:48:48.574 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 kstore 2024-09-12T00:48:48.574 INFO:tasks.workunit.client.0.smithi073.stderr: 4/ 5 rocksdb 2024-09-12T00:48:48.574 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 fuse 2024-09-12T00:48:48.574 INFO:tasks.workunit.client.0.smithi073.stderr: 2/ 5 mgr 2024-09-12T00:48:48.574 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mgrc 2024-09-12T00:48:48.574 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 dpdk 2024-09-12T00:48:48.574 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 eventtrace 2024-09-12T00:48:48.574 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 prioritycache 2024-09-12T00:48:48.574 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 test 2024-09-12T00:48:48.574 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:48:48.574 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cephsqlite 2024-09-12T00:48:48.574 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:48:48.574 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore 2024-09-12T00:48:48.575 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_onode 2024-09-12T00:48:48.575 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_odata 2024-09-12T00:48:48.575 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_omap 2024-09-12T00:48:48.575 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_tm 2024-09-12T00:48:48.575 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_t 2024-09-12T00:48:48.575 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:48:48.575 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_epm 2024-09-12T00:48:48.575 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_lba 2024-09-12T00:48:48.575 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:48:48.575 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_cache 2024-09-12T00:48:48.575 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_journal 2024-09-12T00:48:48.575 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_device 2024-09-12T00:48:48.575 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_backref 2024-09-12T00:48:48.575 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 alienstore 2024-09-12T00:48:48.576 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mclock 2024-09-12T00:48:48.576 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cyanstore 2024-09-12T00:48:48.576 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 ceph_exporter 2024-09-12T00:48:48.576 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 memstore 2024-09-12T00:48:48.576 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 trace 2024-09-12T00:48:48.576 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 ceph_dedup 2024-09-12T00:48:48.576 INFO:tasks.workunit.client.0.smithi073.stderr: -2/-2 (syslog threshold) 2024-09-12T00:48:48.576 INFO:tasks.workunit.client.0.smithi073.stderr: 99/99 (stderr threshold) 2024-09-12T00:48:48.576 INFO:tasks.workunit.client.0.smithi073.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:48:48.576 INFO:tasks.workunit.client.0.smithi073.stderr: 7f3cbdffb640 / http_manager 2024-09-12T00:48:48.576 INFO:tasks.workunit.client.0.smithi073.stderr: 7f3cbffff640 / http_manager 2024-09-12T00:48:48.576 INFO:tasks.workunit.client.0.smithi073.stderr: 7f3d457e2640 / rgw_dt_lg_renew 2024-09-12T00:48:48.576 INFO:tasks.workunit.client.0.smithi073.stderr: 7f3d70ff9640 / ms_dispatch 2024-09-12T00:48:48.576 INFO:tasks.workunit.client.0.smithi073.stderr: 7f3d727fc640 / io_context_pool 2024-09-12T00:48:48.576 INFO:tasks.workunit.client.0.smithi073.stderr: 7f3d78e01640 / ms_dispatch 2024-09-12T00:48:48.577 INFO:tasks.workunit.client.0.smithi073.stderr: 7f3d7b606640 / ms_dispatch 2024-09-12T00:48:48.577 INFO:tasks.workunit.client.0.smithi073.stderr: 7f3d7ce09640 / io_context_pool 2024-09-12T00:48:48.577 INFO:tasks.workunit.client.0.smithi073.stderr: 7f3e8e560640 / msgr-worker-2 2024-09-12T00:48:48.577 INFO:tasks.workunit.client.0.smithi073.stderr: 7f3e8ed61640 / msgr-worker-1 2024-09-12T00:48:48.577 INFO:tasks.workunit.client.0.smithi073.stderr: 7f3e8f562640 / msgr-worker-0 2024-09-12T00:48:48.577 INFO:tasks.workunit.client.0.smithi073.stderr: 7f3e8fd63640 / io_context_pool 2024-09-12T00:48:48.577 INFO:tasks.workunit.client.0.smithi073.stderr: 7f3e9312c800 / radosgw-admin 2024-09-12T00:48:48.577 INFO:tasks.workunit.client.0.smithi073.stderr: max_recent 500 2024-09-12T00:48:48.577 INFO:tasks.workunit.client.0.smithi073.stderr: max_new 1000 2024-09-12T00:48:48.577 INFO:tasks.workunit.client.0.smithi073.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:48:48.438231Z_cc5f727a-1d7d-4f14-a75a-e564c5527828/log 2024-09-12T00:48:48.577 INFO:tasks.workunit.client.0.smithi073.stderr:--- end dump of recent events --- 2024-09-12T00:48:48.577 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T00:48:48.583 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:48.583 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:48.583 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.512+0000 7fbd32d75800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.583 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.513+0000 7fbd32d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:48.583 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.513+0000 7fbd32d75800 20 realm 2024-09-12T00:48:48.583 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.513+0000 7fbd32d75800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.583 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.514+0000 7fbd32d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:48.583 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.514+0000 7fbd32d75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:48.583 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.514+0000 7fbd32d75800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.583 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.514+0000 7fbd32d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:48.583 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.514+0000 7fbd32d75800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.584 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.515+0000 7fbd32d75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:48.584 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.515+0000 7fbd32d75800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.584 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.516+0000 7fbd32d75800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:48.584 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.516+0000 7fbd32d75800 20 searching for the correct realm 2024-09-12T00:48:48.584 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.519+0000 7fbd31060640 0 -- 172.21.15.73:0/2512864913 >> [v2:172.21.15.73:6818/153097326,v1:172.21.15.73:6819/153097326] conn(0x55baad218e40 msgr2=0x55baad21b230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:48.584 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.523+0000 7fbd3085f640 0 -- 172.21.15.73:0/2512864913 >> [v2:172.21.15.73:6810/1807760270,v1:172.21.15.73:6811/1807760270] conn(0x7fbd2c06bbd0 msgr2=0x7fbd2c06a930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:48.584 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.526+0000 7fbd32d75800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:48:48.584 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.526+0000 7fbd32d75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:48.584 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.526+0000 7fbd32d75800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:48:48.584 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.526+0000 7fbd32d75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:48.584 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.526+0000 7fbd32d75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:48.584 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.526+0000 7fbd32d75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:48.585 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.526+0000 7fbd32d75800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.585 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.526+0000 7fbd32d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:48.585 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.526+0000 7fbd32d75800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.585 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.527+0000 7fbd32d75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:48.585 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.527+0000 7fbd32d75800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.585 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.527+0000 7fbd32d75800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:48.585 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.527+0000 7fbd32d75800 20 zone default found 2024-09-12T00:48:48.585 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.527+0000 7fbd32d75800 4 Realm: () 2024-09-12T00:48:48.585 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.527+0000 7fbd32d75800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:48:48.585 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.527+0000 7fbd32d75800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:48:48.585 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.527+0000 7fbd32d75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:48.585 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.527+0000 7fbd32d75800 20 zonegroup default 2024-09-12T00:48:48.585 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.527+0000 7fbd32d75800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.586 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.527+0000 7fbd32d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:48.586 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.527+0000 7fbd32d75800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.586 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.528+0000 7fbd32d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:48.586 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.528+0000 7fbd32d75800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.586 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.528+0000 7fbd32d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:48.586 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.528+0000 7fbd32d75800 20 started sync module instance, tier type = 2024-09-12T00:48:48.586 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.528+0000 7fbd32d75800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:48:48.586 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.537+0000 7fbd32d75800 20 add_watcher() i=0 2024-09-12T00:48:48.586 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.537+0000 7fbd32d75800 20 add_watcher() i=1 2024-09-12T00:48:48.586 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.537+0000 7fbd32d75800 20 add_watcher() i=2 2024-09-12T00:48:48.586 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.537+0000 7fbd32d75800 20 add_watcher() i=3 2024-09-12T00:48:48.586 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.537+0000 7fbd32d75800 20 add_watcher() i=4 2024-09-12T00:48:48.586 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.537+0000 7fbd32d75800 20 add_watcher() i=5 2024-09-12T00:48:48.587 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.537+0000 7fbd32d75800 20 add_watcher() i=6 2024-09-12T00:48:48.587 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.538+0000 7fbd32d75800 20 add_watcher() i=7 2024-09-12T00:48:48.587 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.538+0000 7fbd32d75800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:48.587 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.539+0000 7fbbe6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:48.587 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.540+0000 7fbd32d75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:48.587 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.540+0000 7fbd32d75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:48.587 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.540+0000 7fbd32d75800 5 note: GC not initialized 2024-09-12T00:48:48.587 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.540+0000 7fbbe5fe3640 20 reqs_thread_entry: start 2024-09-12T00:48:48.587 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.540+0000 7fbd32d75800 20 init_complete bucket index max shards: 1 2024-09-12T00:48:48.587 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.540+0000 7fbd32d75800 20 Filter name: none 2024-09-12T00:48:48.587 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.540+0000 7fbb577fe640 20 reqs_thread_entry: start 2024-09-12T00:48:48.587 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.540+0000 7fbd32d75800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.587 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.541+0000 7fbd32d75800 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:48:48.588 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.541+0000 7fbd32d75800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.588 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.541+0000 7fbd32d75800 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:48:48.588 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.541+0000 7fbd32d75800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:48.588 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.541+0000 7fbd32d75800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.588 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.541+0000 7fbd32d75800 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:48:48.588 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.541+0000 7fbd32d75800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.588 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.542+0000 7fbd32d75800 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:48:48.588 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.542+0000 7fbd32d75800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:48.588 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.543+0000 7fbbe6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:48.588 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.545+0000 7fbd32d75800 20 remove_watcher() i=0 2024-09-12T00:48:48.588 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.545+0000 7fbd32d75800 2 removed watcher, disabling cache 2024-09-12T00:48:48.588 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.546+0000 7fbd32d75800 20 remove_watcher() i=1 2024-09-12T00:48:48.588 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.547+0000 7fbd32d75800 20 remove_watcher() i=2 2024-09-12T00:48:48.589 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.548+0000 7fbd32d75800 20 remove_watcher() i=3 2024-09-12T00:48:48.589 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.549+0000 7fbd32d75800 20 remove_watcher() i=4 2024-09-12T00:48:48.589 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.550+0000 7fbd32d75800 20 remove_watcher() i=5 2024-09-12T00:48:48.589 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.551+0000 7fbd32d75800 20 remove_watcher() i=6 2024-09-12T00:48:48.589 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.552+0000 7fbd32d75800 20 remove_watcher() i=7 2024-09-12T00:48:48.589 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:48.589 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:48:48.589 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: abort-at-init-indext id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:48:48.589 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:48:48.589 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:48.589 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:48.597 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:48.597 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:48:48.652 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:48:48.683 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:48.683 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:48.720 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.721+0000 7f9597d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.722 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.722+0000 7f9597d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:48.722 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.722+0000 7f9597d2e800 20 realm 2024-09-12T00:48:48.722 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.722+0000 7f9597d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.722 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.722+0000 7f9597d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:48.722 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.722+0000 7f9597d2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:48.723 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.722+0000 7f9597d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.723 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.722+0000 7f9597d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:48.723 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.722+0000 7f9597d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.723 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.723+0000 7f9597d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:48.723 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.724+0000 7f9597d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.724 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.724+0000 7f9597d2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:48.724 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.724+0000 7f9597d2e800 20 searching for the correct realm 2024-09-12T00:48:48.727 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.727+0000 7f9594165640 0 -- 172.21.15.73:0/616105651 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f957c018070 msgr2=0x7f957c097390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:48.731 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.731+0000 7f9594165640 0 -- 172.21.15.73:0/616105651 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f945c0864b0 msgr2=0x7f945c0888e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:48.735 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.735+0000 7f9597d2e800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:48:48.736 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.735+0000 7f9597d2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:48.736 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.735+0000 7f9597d2e800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:48:48.736 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.735+0000 7f9597d2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:48.736 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.735+0000 7f9597d2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:48.736 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.735+0000 7f9597d2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:48.736 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.735+0000 7f9597d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.736 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.736+0000 7f9597d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:48.736 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.736+0000 7f9597d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.737 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.736+0000 7f9597d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:48.738 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.736+0000 7f9597d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.738 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.736+0000 7f9597d2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:48.738 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.736+0000 7f9597d2e800 20 zone default found 2024-09-12T00:48:48.738 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.736+0000 7f9597d2e800 4 Realm: () 2024-09-12T00:48:48.738 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.736+0000 7f9597d2e800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:48:48.738 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.736+0000 7f9597d2e800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:48:48.738 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.736+0000 7f9597d2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:48.738 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.736+0000 7f9597d2e800 20 zonegroup default 2024-09-12T00:48:48.738 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.736+0000 7f9597d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.738 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.737+0000 7f9597d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:48.738 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.737+0000 7f9597d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.738 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.737+0000 7f9597d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:48.738 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.737+0000 7f9597d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.739 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.737+0000 7f9597d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:48.739 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.737+0000 7f9597d2e800 20 started sync module instance, tier type = 2024-09-12T00:48:48.739 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.737+0000 7f9597d2e800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:48:48.746 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.746+0000 7f9597d2e800 20 add_watcher() i=0 2024-09-12T00:48:48.746 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.746+0000 7f9597d2e800 20 add_watcher() i=1 2024-09-12T00:48:48.746 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.746+0000 7f9597d2e800 20 add_watcher() i=2 2024-09-12T00:48:48.746 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.746+0000 7f9597d2e800 20 add_watcher() i=3 2024-09-12T00:48:48.747 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.746+0000 7f9597d2e800 20 add_watcher() i=4 2024-09-12T00:48:48.747 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.746+0000 7f9597d2e800 20 add_watcher() i=5 2024-09-12T00:48:48.747 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.746+0000 7f9597d2e800 20 add_watcher() i=6 2024-09-12T00:48:48.747 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.747+0000 7f9597d2e800 20 add_watcher() i=7 2024-09-12T00:48:48.747 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.747+0000 7f9597d2e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:48.749 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.749+0000 7f9449fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:48.749 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.749+0000 7f9597d2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:48.750 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.749+0000 7f9597d2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:48.750 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.749+0000 7f9597d2e800 5 note: GC not initialized 2024-09-12T00:48:48.750 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.750+0000 7f9448fe1640 20 reqs_thread_entry: start 2024-09-12T00:48:48.750 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.750+0000 7f9597d2e800 20 init_complete bucket index max shards: 1 2024-09-12T00:48:48.750 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.750+0000 7f9597d2e800 20 Filter name: none 2024-09-12T00:48:48.750 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.750+0000 7f93c27fc640 20 reqs_thread_entry: start 2024-09-12T00:48:48.750 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.750+0000 7f9597d2e800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:48:48.750 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.750+0000 7f9597d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.751 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.750+0000 7f9597d2e800 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:48:48.751 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.750+0000 7f9597d2e800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:48:48.751 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.750+0000 7f9597d2e800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:48:48.751 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.750+0000 7f9597d2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21 : miss 2024-09-12T00:48:48.751 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.750+0000 7f9597d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.751 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.751+0000 7f9597d2e800 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:48:48.752 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.751+0000 7f9597d2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21 info.flags=0x17 2024-09-12T00:48:48.752 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.751+0000 7f9597d2e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21 to cache LRU end 2024-09-12T00:48:48.752 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.751+0000 7f9597d2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:48:48.752 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.751+0000 7f9597d2e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:48.752 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.751+0000 7f9597d2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21 2024-09-12T00:48:48.752 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.752+0000 7f9597d2e800 0 INFO: RGWReshardLock::lock found lock on abort-at-init-indext:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21 to be held by another RGW process; skipping for now 2024-09-12T00:48:48.752 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.753+0000 7f9449fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:48.755 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.755+0000 7f9597d2e800 20 remove_watcher() i=0 2024-09-12T00:48:48.755 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.755+0000 7f9597d2e800 2 removed watcher, disabling cache 2024-09-12T00:48:48.756 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.756+0000 7f9597d2e800 20 remove_watcher() i=1 2024-09-12T00:48:48.757 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.757+0000 7f9597d2e800 20 remove_watcher() i=2 2024-09-12T00:48:48.758 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.758+0000 7f9597d2e800 20 remove_watcher() i=3 2024-09-12T00:48:48.759 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.759+0000 7f9597d2e800 20 remove_watcher() i=4 2024-09-12T00:48:48.760 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.760+0000 7f9597d2e800 20 remove_watcher() i=5 2024-09-12T00:48:48.761 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.761+0000 7f9597d2e800 20 remove_watcher() i=6 2024-09-12T00:48:48.762 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:48:48.762+0000 7f9597d2e800 20 remove_watcher() i=7 2024-09-12T00:48:48.772 INFO:tasks.workunit.client.0.smithi073.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:49:18.803 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:49:18.840 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:18.841 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:18.884 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.885+0000 7f37ea213800 20 rados->read ofs=0 len=0 2024-09-12T00:49:18.886 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.887+0000 7f37ea213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:18.886 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.887+0000 7f37ea213800 20 realm 2024-09-12T00:49:18.886 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.887+0000 7f37ea213800 20 rados->read ofs=0 len=0 2024-09-12T00:49:18.886 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.887+0000 7f37ea213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:18.886 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.887+0000 7f37ea213800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:18.886 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.887+0000 7f37ea213800 20 rados->read ofs=0 len=0 2024-09-12T00:49:18.886 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.887+0000 7f37ea213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:18.886 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.887+0000 7f37ea213800 20 rados->read ofs=0 len=0 2024-09-12T00:49:18.887 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.888+0000 7f37ea213800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:18.887 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.888+0000 7f37ea213800 20 rados->read ofs=0 len=0 2024-09-12T00:49:18.888 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.889+0000 7f37ea213800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:18.888 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.889+0000 7f37ea213800 20 searching for the correct realm 2024-09-12T00:49:18.889 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.891+0000 7f37e5992640 0 -- 172.21.15.73:0/2115830094 >> [v2:172.21.15.117:6816/1460498570,v1:172.21.15.117:6817/1460498570] conn(0x7f37e002b060 msgr2=0x7f37e0062980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:18.893 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.894+0000 7f37dffff640 0 -- 172.21.15.73:0/2115830094 >> [v2:172.21.15.73:6826/269690776,v1:172.21.15.73:6827/269690776] conn(0x7f37d8060070 msgr2=0x7f37d80b8840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:18.899 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.900+0000 7f37ea213800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:49:18.899 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.900+0000 7f37ea213800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:18.899 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.900+0000 7f37ea213800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:49:18.899 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.900+0000 7f37ea213800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:18.899 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.900+0000 7f37ea213800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:18.900 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.900+0000 7f37ea213800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:18.900 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.900+0000 7f37ea213800 20 rados->read ofs=0 len=0 2024-09-12T00:49:18.900 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.900+0000 7f37ea213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:18.900 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.900+0000 7f37ea213800 20 rados->read ofs=0 len=0 2024-09-12T00:49:18.901 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.901+0000 7f37ea213800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:18.901 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.901+0000 7f37ea213800 20 rados->read ofs=0 len=0 2024-09-12T00:49:18.901 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.901+0000 7f37ea213800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:18.901 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.901+0000 7f37ea213800 20 zone default found 2024-09-12T00:49:18.901 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.901+0000 7f37ea213800 4 Realm: () 2024-09-12T00:49:18.901 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.901+0000 7f37ea213800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:49:18.901 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.901+0000 7f37ea213800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:49:18.902 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.901+0000 7f37ea213800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:18.902 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.901+0000 7f37ea213800 20 zonegroup default 2024-09-12T00:49:18.902 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.901+0000 7f37ea213800 20 rados->read ofs=0 len=0 2024-09-12T00:49:18.902 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.902+0000 7f37ea213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:18.902 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.902+0000 7f37ea213800 20 rados->read ofs=0 len=0 2024-09-12T00:49:18.902 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.902+0000 7f37ea213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:18.902 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.902+0000 7f37ea213800 20 rados->read ofs=0 len=0 2024-09-12T00:49:18.902 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.902+0000 7f37ea213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:18.902 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.902+0000 7f37ea213800 20 started sync module instance, tier type = 2024-09-12T00:49:18.902 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.902+0000 7f37ea213800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:49:18.910 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.912+0000 7f37ea213800 20 add_watcher() i=0 2024-09-12T00:49:18.911 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.912+0000 7f37ea213800 20 add_watcher() i=1 2024-09-12T00:49:18.911 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.912+0000 7f37ea213800 20 add_watcher() i=2 2024-09-12T00:49:18.911 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.912+0000 7f37ea213800 20 add_watcher() i=3 2024-09-12T00:49:18.911 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.912+0000 7f37ea213800 20 add_watcher() i=4 2024-09-12T00:49:18.911 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.912+0000 7f37ea213800 20 add_watcher() i=5 2024-09-12T00:49:18.911 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.912+0000 7f37ea213800 20 add_watcher() i=6 2024-09-12T00:49:18.911 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.913+0000 7f37ea213800 20 add_watcher() i=7 2024-09-12T00:49:18.912 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.913+0000 7f37ea213800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:18.913 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.915+0000 7f369bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:18.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.915+0000 7f37ea213800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:18.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.915+0000 7f37ea213800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:18.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.915+0000 7f37ea213800 5 note: GC not initialized 2024-09-12T00:49:18.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.915+0000 7f369afe5640 20 reqs_thread_entry: start 2024-09-12T00:49:18.915 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.915+0000 7f37ea213800 20 init_complete bucket index max shards: 1 2024-09-12T00:49:18.915 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.915+0000 7f37ea213800 20 Filter name: none 2024-09-12T00:49:18.915 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.915+0000 7f3698fe1640 20 reqs_thread_entry: start 2024-09-12T00:49:18.915 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.916+0000 7f37ea213800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:49:18.915 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.916+0000 7f37ea213800 20 rados->read ofs=0 len=0 2024-09-12T00:49:18.916 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.916+0000 7f37ea213800 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:49:18.916 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.916+0000 7f37ea213800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:49:18.916 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.916+0000 7f37ea213800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:49:18.916 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.916+0000 7f37ea213800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21 : miss 2024-09-12T00:49:18.916 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.916+0000 7f37ea213800 20 rados->read ofs=0 len=0 2024-09-12T00:49:18.916 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.916+0000 7f37ea213800 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:49:18.916 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.916+0000 7f37ea213800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21 info.flags=0x17 2024-09-12T00:49:18.916 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.916+0000 7f37ea213800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21 to cache LRU end 2024-09-12T00:49:18.916 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.916+0000 7f37ea213800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:18.916 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.916+0000 7f37ea213800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:18.917 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.916+0000 7f37ea213800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21 2024-09-12T00:49:18.920 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.921+0000 7f37ea213800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21 info.flags=0x17 2024-09-12T00:49:18.920 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.921+0000 7f37ea213800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21 to cache LRU end 2024-09-12T00:49:18.920 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.921+0000 7f37ea213800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:18.920 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.921+0000 7f37ea213800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21, ofs0, ns] 2024-09-12T00:49:18.920 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.921+0000 7f36c97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496993 cookie 94595068969792 notifier 6131 bl.length()=913 2024-09-12T00:49:18.920 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.921+0000 7f36c97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21 info.flags=0x17 2024-09-12T00:49:18.921 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.921+0000 7f36c97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21 to cache LRU end 2024-09-12T00:49:18.921 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.921+0000 7f36c97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:18.921 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.923+0000 7f37ea213800 20 handle_bi_update(): bucket=:abort-at-init-indext[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21]): orig_sources= new_sources= 2024-09-12T00:49:18.922 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.923+0000 7f37ea213800 20 handle_bi_update(): bucket=:abort-at-init-indext[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21]): potential sources added=[] removed=[] 2024-09-12T00:49:18.922 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.923+0000 7f37ea213800 20 handle_bi_update(): bucket=:abort-at-init-indext[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21]): orig_dests= new_dests= 2024-09-12T00:49:18.922 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.923+0000 7f37ea213800 20 handle_bi_update(): bucket=:abort-at-init-indext[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21]): potential dests added=[] removed=[] 2024-09-12T00:49:18.924 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.925+0000 7f37ea213800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21.1.0 2024-09-12T00:49:18.924 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.925+0000 7f37ea213800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21.1.0 2024-09-12T00:49:18.924 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.925+0000 7f37ea213800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21.1.1 2024-09-12T00:49:18.924 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.925+0000 7f37ea213800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21.1.1 2024-09-12T00:49:18.924 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.925+0000 7f37ea213800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21.0 2024-09-12T00:49:18.926 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.927+0000 7f37ea213800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21 : hit (requested=0x17, cached=0x17) 2024-09-12T00:49:18.926 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.927+0000 7f37ea213800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21 2024-09-12T00:49:18.928 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.929+0000 7f37ea213800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21 info.flags=0x17 2024-09-12T00:49:18.929 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.929+0000 7f37ea213800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21 to cache LRU end 2024-09-12T00:49:18.929 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.929+0000 7f37ea213800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:18.929 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.929+0000 7f37ea213800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21, ofs0, ns] 2024-09-12T00:49:18.929 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.929+0000 7f36c97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496994 cookie 94595068969792 notifier 6131 bl.length()=913 2024-09-12T00:49:18.929 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.930+0000 7f36c97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21 info.flags=0x17 2024-09-12T00:49:18.929 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.930+0000 7f36c97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21 to cache LRU end 2024-09-12T00:49:18.929 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.930+0000 7f36c97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:18.930 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.931+0000 7f37ea213800 20 handle_bi_update(): bucket=:abort-at-init-indext[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21]): orig_sources= new_sources= 2024-09-12T00:49:18.930 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.931+0000 7f37ea213800 20 handle_bi_update(): bucket=:abort-at-init-indext[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21]): potential sources added=[] removed=[] 2024-09-12T00:49:18.930 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.931+0000 7f37ea213800 20 handle_bi_update(): bucket=:abort-at-init-indext[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21]): orig_dests= new_dests= 2024-09-12T00:49:18.930 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.931+0000 7f37ea213800 20 handle_bi_update(): bucket=:abort-at-init-indext[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21]): potential dests added=[] removed=[] 2024-09-12T00:49:18.931 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.932+0000 7f37ea213800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21.0 2024-09-12T00:49:18.931 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.932+0000 7f37ea213800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21 : hit (requested=0x17, cached=0x17) 2024-09-12T00:49:18.931 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.932+0000 7f37ea213800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21 2024-09-12T00:49:18.933 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.934+0000 7f37ea213800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21 info.flags=0x17 2024-09-12T00:49:18.933 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.934+0000 7f37ea213800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21 to cache LRU end 2024-09-12T00:49:18.933 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.934+0000 7f37ea213800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:18.933 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.934+0000 7f37ea213800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21, ofs0, ns] 2024-09-12T00:49:18.934 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.934+0000 7f36c8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496995 cookie 94595068969792 notifier 6131 bl.length()=881 2024-09-12T00:49:18.934 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.934+0000 7f36c8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21 info.flags=0x17 2024-09-12T00:49:18.934 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.934+0000 7f36c8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21 to cache LRU end 2024-09-12T00:49:18.934 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.934+0000 7f36c8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:18.934 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.936+0000 7f37ea213800 20 handle_bi_update(): bucket=:abort-at-init-indext[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21]): orig_sources= new_sources= 2024-09-12T00:49:18.934 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.936+0000 7f37ea213800 20 handle_bi_update(): bucket=:abort-at-init-indext[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21]): potential sources added=[] removed=[] 2024-09-12T00:49:18.934 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.936+0000 7f37ea213800 20 handle_bi_update(): bucket=:abort-at-init-indext[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21]): orig_dests= new_dests= 2024-09-12T00:49:18.934 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.936+0000 7f37ea213800 20 handle_bi_update(): bucket=:abort-at-init-indext[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21]): potential dests added=[] removed=[] 2024-09-12T00:49:18.936 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.937+0000 7f37ea213800 1 execute INFO: reshard of bucket "abort-at-init-indext" from 1 shards to 2 shards completed successfully 2024-09-12T00:49:18.938 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.939+0000 7f369bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:18.940 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.941+0000 7f37ea213800 20 remove_watcher() i=0 2024-09-12T00:49:18.940 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.941+0000 7f37ea213800 2 removed watcher, disabling cache 2024-09-12T00:49:18.941 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.943+0000 7f37ea213800 20 remove_watcher() i=1 2024-09-12T00:49:18.942 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.944+0000 7f37ea213800 20 remove_watcher() i=2 2024-09-12T00:49:18.943 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.945+0000 7f37ea213800 20 remove_watcher() i=3 2024-09-12T00:49:18.944 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.946+0000 7f37ea213800 20 remove_watcher() i=4 2024-09-12T00:49:18.945 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.947+0000 7f37ea213800 20 remove_watcher() i=5 2024-09-12T00:49:18.948 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.949+0000 7f37ea213800 20 remove_watcher() i=6 2024-09-12T00:49:18.949 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:18.950+0000 7f37ea213800 20 remove_watcher() i=7 2024-09-12T00:49:18.961 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T00:49:18.989 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:18.989 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:19.026 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.027+0000 7f4221546800 20 rados->read ofs=0 len=0 2024-09-12T00:49:19.028 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.028+0000 7f4221546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:19.028 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.028+0000 7f4221546800 20 realm 2024-09-12T00:49:19.028 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.028+0000 7f4221546800 20 rados->read ofs=0 len=0 2024-09-12T00:49:19.028 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.029+0000 7f4221546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:19.028 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.029+0000 7f4221546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:19.028 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.029+0000 7f4221546800 20 rados->read ofs=0 len=0 2024-09-12T00:49:19.028 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.029+0000 7f4221546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:19.028 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.029+0000 7f4221546800 20 rados->read ofs=0 len=0 2024-09-12T00:49:19.029 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.030+0000 7f4221546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:19.029 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.030+0000 7f4221546800 20 rados->read ofs=0 len=0 2024-09-12T00:49:19.029 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.031+0000 7f4221546800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:19.029 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.031+0000 7f4221546800 20 searching for the correct realm 2024-09-12T00:49:19.031 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.033+0000 7f421f838640 0 -- 172.21.15.73:0/3776909274 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f421401f070 msgr2=0x7f4214085a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:49:19.238 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.239+0000 7f421f838640 0 -- 172.21.15.73:0/3776909274 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f421401f070 msgr2=0x7f4214085a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:19.242 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.243+0000 7f4221546800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:49:19.242 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.243+0000 7f4221546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:19.242 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.243+0000 7f4221546800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:49:19.243 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.243+0000 7f4221546800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:19.243 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.243+0000 7f4221546800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:19.243 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.243+0000 7f4221546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:19.243 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.243+0000 7f4221546800 20 rados->read ofs=0 len=0 2024-09-12T00:49:19.243 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.243+0000 7f4221546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:19.243 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.243+0000 7f4221546800 20 rados->read ofs=0 len=0 2024-09-12T00:49:19.244 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.244+0000 7f4221546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:19.244 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.244+0000 7f4221546800 20 rados->read ofs=0 len=0 2024-09-12T00:49:19.245 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.244+0000 7f4221546800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:19.245 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.244+0000 7f4221546800 20 zone default found 2024-09-12T00:49:19.245 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.244+0000 7f4221546800 4 Realm: () 2024-09-12T00:49:19.245 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.244+0000 7f4221546800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:49:19.245 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.244+0000 7f4221546800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:49:19.245 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.244+0000 7f4221546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:19.245 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.244+0000 7f4221546800 20 zonegroup default 2024-09-12T00:49:19.245 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.244+0000 7f4221546800 20 rados->read ofs=0 len=0 2024-09-12T00:49:19.245 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.244+0000 7f4221546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:19.245 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.244+0000 7f4221546800 20 rados->read ofs=0 len=0 2024-09-12T00:49:19.245 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.245+0000 7f4221546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:19.245 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.245+0000 7f4221546800 20 rados->read ofs=0 len=0 2024-09-12T00:49:19.245 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.245+0000 7f4221546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:19.245 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.245+0000 7f4221546800 20 started sync module instance, tier type = 2024-09-12T00:49:19.246 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.245+0000 7f4221546800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:49:19.253 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.254+0000 7f4221546800 20 add_watcher() i=0 2024-09-12T00:49:19.253 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.254+0000 7f4221546800 20 add_watcher() i=1 2024-09-12T00:49:19.253 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.254+0000 7f4221546800 20 add_watcher() i=2 2024-09-12T00:49:19.254 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.254+0000 7f4221546800 20 add_watcher() i=3 2024-09-12T00:49:19.254 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.254+0000 7f4221546800 20 add_watcher() i=4 2024-09-12T00:49:19.254 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.254+0000 7f4221546800 20 add_watcher() i=5 2024-09-12T00:49:19.254 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.254+0000 7f4221546800 20 add_watcher() i=6 2024-09-12T00:49:19.254 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.255+0000 7f4221546800 20 add_watcher() i=7 2024-09-12T00:49:19.254 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.255+0000 7f4221546800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:19.256 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.257+0000 7f40d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:19.256 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.257+0000 7f4221546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:19.256 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.257+0000 7f4221546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:19.256 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.257+0000 7f4221546800 5 note: GC not initialized 2024-09-12T00:49:19.257 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.257+0000 7f40d4fe1640 20 reqs_thread_entry: start 2024-09-12T00:49:19.257 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.257+0000 7f4221546800 20 init_complete bucket index max shards: 1 2024-09-12T00:49:19.257 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.257+0000 7f4221546800 20 Filter name: none 2024-09-12T00:49:19.257 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.258+0000 7f404e7fc640 20 reqs_thread_entry: start 2024-09-12T00:49:19.257 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.258+0000 7f4221546800 20 rados->read ofs=0 len=0 2024-09-12T00:49:19.258 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.258+0000 7f4221546800 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:49:19.258 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.258+0000 7f4221546800 20 rados->read ofs=0 len=0 2024-09-12T00:49:19.258 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.259+0000 7f4221546800 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:49:19.258 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.259+0000 7f4221546800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:19.258 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.259+0000 7f4221546800 20 rados->read ofs=0 len=0 2024-09-12T00:49:19.258 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.259+0000 7f4221546800 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:49:19.258 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.259+0000 7f4221546800 20 rados->read ofs=0 len=0 2024-09-12T00:49:19.259 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.259+0000 7f4221546800 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:49:19.259 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.259+0000 7f4221546800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:19.259 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.261+0000 7f40d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:19.261 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.263+0000 7f4221546800 20 remove_watcher() i=0 2024-09-12T00:49:19.262 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.263+0000 7f4221546800 2 removed watcher, disabling cache 2024-09-12T00:49:19.262 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.264+0000 7f4221546800 20 remove_watcher() i=1 2024-09-12T00:49:19.263 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.265+0000 7f4221546800 20 remove_watcher() i=2 2024-09-12T00:49:19.264 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.266+0000 7f4221546800 20 remove_watcher() i=3 2024-09-12T00:49:19.265 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.267+0000 7f4221546800 20 remove_watcher() i=4 2024-09-12T00:49:19.266 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.268+0000 7f4221546800 20 remove_watcher() i=5 2024-09-12T00:49:19.267 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.269+0000 7f4221546800 20 remove_watcher() i=6 2024-09-12T00:49:19.268 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:19.270+0000 7f4221546800 20 remove_watcher() i=7 2024-09-12T00:49:19.279 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:19.279 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:49:19.279 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: abort-at-init-indext id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:49:19.279 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:19.281 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:19.281 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:19.301 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:19.302 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:19.515 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:19.515 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:19.577 INFO:tasks.workunit.client.0.smithi073.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2024-09-12T00:49:19.577 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:19.578 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:19.578 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:19.625 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:19.625 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:19.681 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:19.681 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:19.717 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:19.717 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:19.753 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:19.753 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:19.788 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:19.789 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:19.822 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:19.823 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:19.858 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:19.858 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:19.893 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:19.893 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:19.927 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:19.928 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:19.963 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:19.963 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:20.001 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:20.001 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:20.036 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:20.036 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:20.068 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:20.069 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:20.103 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:20.103 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:20.138 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:20.138 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:20.173 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:20.173 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:20.207 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:20.207 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:20.242 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:20.242 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:20.278 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:20.278 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:20.312 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:20.312 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:20.347 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:20.347 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:20.382 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:49:20.411 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:20.412 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:20.448 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.449+0000 7f1104542800 20 rados->read ofs=0 len=0 2024-09-12T00:49:20.450 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.451+0000 7f1104542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:20.451 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.451+0000 7f1104542800 20 realm 2024-09-12T00:49:20.451 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.451+0000 7f1104542800 20 rados->read ofs=0 len=0 2024-09-12T00:49:20.451 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.451+0000 7f1104542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:20.451 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.451+0000 7f1104542800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:20.451 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.451+0000 7f1104542800 20 rados->read ofs=0 len=0 2024-09-12T00:49:20.451 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.451+0000 7f1104542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:20.451 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.451+0000 7f1104542800 20 rados->read ofs=0 len=0 2024-09-12T00:49:20.452 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.453+0000 7f1104542800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:20.452 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.453+0000 7f1104542800 20 rados->read ofs=0 len=0 2024-09-12T00:49:20.452 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.453+0000 7f1104542800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:20.452 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.453+0000 7f1104542800 20 searching for the correct realm 2024-09-12T00:49:20.454 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.456+0000 7f1100a87640 0 -- 172.21.15.73:0/3478762819 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f10e800e070 msgr2=0x7f10e8061aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:20.660 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.661+0000 7f1100a87640 0 -- 172.21.15.73:0/3478762819 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f10e800e070 msgr2=0x7f10e8061aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:20.665 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.665+0000 7f1104542800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:49:20.665 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.665+0000 7f1104542800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:20.665 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.665+0000 7f1104542800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:49:20.665 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.665+0000 7f1104542800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:20.665 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.665+0000 7f1104542800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:20.665 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.665+0000 7f1104542800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:20.665 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.665+0000 7f1104542800 20 rados->read ofs=0 len=0 2024-09-12T00:49:20.665 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.666+0000 7f1104542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:20.665 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.666+0000 7f1104542800 20 rados->read ofs=0 len=0 2024-09-12T00:49:20.666 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.666+0000 7f1104542800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:20.666 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.666+0000 7f1104542800 20 rados->read ofs=0 len=0 2024-09-12T00:49:20.667 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.666+0000 7f1104542800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:20.667 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.666+0000 7f1104542800 20 zone default found 2024-09-12T00:49:20.667 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.666+0000 7f1104542800 4 Realm: () 2024-09-12T00:49:20.667 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.666+0000 7f1104542800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:49:20.667 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.666+0000 7f1104542800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:49:20.667 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.666+0000 7f1104542800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:20.667 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.666+0000 7f1104542800 20 zonegroup default 2024-09-12T00:49:20.667 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.666+0000 7f1104542800 20 rados->read ofs=0 len=0 2024-09-12T00:49:20.667 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.667+0000 7f1104542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:20.668 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.667+0000 7f1104542800 20 rados->read ofs=0 len=0 2024-09-12T00:49:20.668 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.667+0000 7f1104542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:20.668 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.667+0000 7f1104542800 20 rados->read ofs=0 len=0 2024-09-12T00:49:20.668 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.667+0000 7f1104542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:20.668 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.667+0000 7f1104542800 20 started sync module instance, tier type = 2024-09-12T00:49:20.668 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.667+0000 7f1104542800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:49:20.676 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.677+0000 7f1104542800 20 add_watcher() i=0 2024-09-12T00:49:20.676 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.677+0000 7f1104542800 20 add_watcher() i=1 2024-09-12T00:49:20.676 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.677+0000 7f1104542800 20 add_watcher() i=2 2024-09-12T00:49:20.676 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.677+0000 7f1104542800 20 add_watcher() i=3 2024-09-12T00:49:20.676 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.677+0000 7f1104542800 20 add_watcher() i=4 2024-09-12T00:49:20.676 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.677+0000 7f1104542800 20 add_watcher() i=5 2024-09-12T00:49:20.676 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.677+0000 7f1104542800 20 add_watcher() i=6 2024-09-12T00:49:20.677 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.678+0000 7f1104542800 20 add_watcher() i=7 2024-09-12T00:49:20.677 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.678+0000 7f1104542800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:20.679 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.680+0000 7f0fb6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:20.680 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.680+0000 7f1104542800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:20.680 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.680+0000 7f1104542800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:20.680 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.680+0000 7f1104542800 5 note: GC not initialized 2024-09-12T00:49:20.680 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.680+0000 7f0fb5fdb640 20 reqs_thread_entry: start 2024-09-12T00:49:20.680 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.680+0000 7f1104542800 20 init_complete bucket index max shards: 1 2024-09-12T00:49:20.681 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.680+0000 7f1104542800 20 Filter name: none 2024-09-12T00:49:20.681 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.680+0000 7f0f277fe640 20 reqs_thread_entry: start 2024-09-12T00:49:20.681 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.680+0000 7f1104542800 20 rados->read ofs=0 len=0 2024-09-12T00:49:20.682 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.681+0000 7f1104542800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:49:20.682 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.681+0000 7f1104542800 20 rados->read ofs=0 len=0 2024-09-12T00:49:20.682 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.682+0000 7f1104542800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:49:20.682 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.682+0000 7f1104542800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:20.682 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.682+0000 7f1104542800 20 rados->read ofs=0 len=0 2024-09-12T00:49:20.683 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.682+0000 7f1104542800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:49:20.683 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.682+0000 7f1104542800 20 rados->read ofs=0 len=0 2024-09-12T00:49:20.683 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.683+0000 7f1104542800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:49:20.683 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.683+0000 7f1104542800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:20.683 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.684+0000 7f0fb6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:20.685 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.686+0000 7f1104542800 20 remove_watcher() i=0 2024-09-12T00:49:20.685 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.686+0000 7f1104542800 2 removed watcher, disabling cache 2024-09-12T00:49:20.686 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.688+0000 7f1104542800 20 remove_watcher() i=1 2024-09-12T00:49:20.687 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.689+0000 7f1104542800 20 remove_watcher() i=2 2024-09-12T00:49:20.689 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.690+0000 7f1104542800 20 remove_watcher() i=3 2024-09-12T00:49:20.689 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.691+0000 7f1104542800 20 remove_watcher() i=4 2024-09-12T00:49:20.690 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.692+0000 7f1104542800 20 remove_watcher() i=5 2024-09-12T00:49:20.691 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.693+0000 7f1104542800 20 remove_watcher() i=6 2024-09-12T00:49:20.692 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.693+0000 7f1104542800 20 remove_watcher() i=7 2024-09-12T00:49:20.702 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:20.702 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:49:20.702 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: error-at-set-target-layout id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:49:20.702 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:20.704 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2024-09-12T00:49:20.738 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:20.738 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:20.775 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.776+0000 7f60a9020800 20 rados->read ofs=0 len=0 2024-09-12T00:49:20.776 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.777+0000 7f60a9020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:20.776 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.777+0000 7f60a9020800 20 realm 2024-09-12T00:49:20.776 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.777+0000 7f60a9020800 20 rados->read ofs=0 len=0 2024-09-12T00:49:20.776 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.777+0000 7f60a9020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:20.776 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.777+0000 7f60a9020800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:20.777 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.777+0000 7f60a9020800 20 rados->read ofs=0 len=0 2024-09-12T00:49:20.777 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.777+0000 7f60a9020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:20.777 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.777+0000 7f60a9020800 20 rados->read ofs=0 len=0 2024-09-12T00:49:20.777 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.778+0000 7f60a9020800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:20.778 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.778+0000 7f60a9020800 20 rados->read ofs=0 len=0 2024-09-12T00:49:20.778 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.779+0000 7f60a9020800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:20.778 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.779+0000 7f60a9020800 20 searching for the correct realm 2024-09-12T00:49:20.780 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.782+0000 7f60a7312640 0 -- 172.21.15.73:0/3758577470 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f609c064ec0 msgr2=0x7f609c09e0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:20.988 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.989+0000 7f60a7312640 0 -- 172.21.15.73:0/3758577470 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f609c064ec0 msgr2=0x7f609c09e0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:20.993 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.993+0000 7f60a9020800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:49:20.993 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.994+0000 7f60a9020800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:20.994 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.994+0000 7f60a9020800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:49:20.994 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.994+0000 7f60a9020800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:20.994 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.994+0000 7f60a9020800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:20.994 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.994+0000 7f60a9020800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:20.994 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.994+0000 7f60a9020800 20 rados->read ofs=0 len=0 2024-09-12T00:49:20.994 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.994+0000 7f60a9020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:20.994 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.994+0000 7f60a9020800 20 rados->read ofs=0 len=0 2024-09-12T00:49:20.994 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.994+0000 7f60a9020800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:20.994 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.994+0000 7f60a9020800 20 rados->read ofs=0 len=0 2024-09-12T00:49:20.994 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.994+0000 7f60a9020800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:20.994 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.994+0000 7f60a9020800 20 zone default found 2024-09-12T00:49:20.994 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.994+0000 7f60a9020800 4 Realm: () 2024-09-12T00:49:20.994 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.994+0000 7f60a9020800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:49:20.995 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.994+0000 7f60a9020800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:49:20.995 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.994+0000 7f60a9020800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:20.995 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.994+0000 7f60a9020800 20 zonegroup default 2024-09-12T00:49:20.995 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.994+0000 7f60a9020800 20 rados->read ofs=0 len=0 2024-09-12T00:49:20.995 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.995+0000 7f60a9020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:20.995 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.995+0000 7f60a9020800 20 rados->read ofs=0 len=0 2024-09-12T00:49:20.996 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.995+0000 7f60a9020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:20.996 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.995+0000 7f60a9020800 20 rados->read ofs=0 len=0 2024-09-12T00:49:20.996 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.995+0000 7f60a9020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:20.996 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.995+0000 7f60a9020800 20 started sync module instance, tier type = 2024-09-12T00:49:20.996 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:20.995+0000 7f60a9020800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:49:21.004 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.006+0000 7f60a9020800 20 add_watcher() i=0 2024-09-12T00:49:21.005 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.006+0000 7f60a9020800 20 add_watcher() i=1 2024-09-12T00:49:21.005 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.006+0000 7f60a9020800 20 add_watcher() i=2 2024-09-12T00:49:21.005 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.006+0000 7f60a9020800 20 add_watcher() i=3 2024-09-12T00:49:21.005 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.006+0000 7f60a9020800 20 add_watcher() i=4 2024-09-12T00:49:21.005 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.006+0000 7f60a9020800 20 add_watcher() i=5 2024-09-12T00:49:21.005 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.006+0000 7f60a9020800 20 add_watcher() i=6 2024-09-12T00:49:21.005 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.007+0000 7f60a9020800 20 add_watcher() i=7 2024-09-12T00:49:21.005 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.007+0000 7f60a9020800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:21.008 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.008+0000 7f5f5d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:21.008 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.009+0000 7f60a9020800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:21.008 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.009+0000 7f60a9020800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:21.008 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.009+0000 7f60a9020800 5 note: GC not initialized 2024-09-12T00:49:21.008 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.009+0000 7f5ed7fff640 20 reqs_thread_entry: start 2024-09-12T00:49:21.008 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.009+0000 7f60a9020800 20 init_complete bucket index max shards: 1 2024-09-12T00:49:21.008 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.009+0000 7f60a9020800 20 Filter name: none 2024-09-12T00:49:21.008 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.009+0000 7f5ed5ffb640 20 reqs_thread_entry: start 2024-09-12T00:49:21.008 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.009+0000 7f60a9020800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T00:49:21.009 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.009+0000 7f60a9020800 20 rados->read ofs=0 len=0 2024-09-12T00:49:21.009 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.010+0000 7f60a9020800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:49:21.009 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.010+0000 7f60a9020800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T00:49:21.010 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.010+0000 7f60a9020800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T00:49:21.010 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.010+0000 7f60a9020800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22 : miss 2024-09-12T00:49:21.010 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.010+0000 7f60a9020800 20 rados->read ofs=0 len=0 2024-09-12T00:49:21.010 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.010+0000 7f60a9020800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:49:21.010 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.010+0000 7f60a9020800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22 info.flags=0x17 2024-09-12T00:49:21.010 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.010+0000 7f60a9020800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22 to cache LRU end 2024-09-12T00:49:21.010 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.010+0000 7f60a9020800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:21.010 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.010+0000 7f60a9020800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:21.010 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.010+0000 7f60a9020800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22 2024-09-12T00:49:21.011 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.013+0000 7f60a9020800 -1 Injecting error=-5 at location=set_target_layout 2024-09-12T00:49:21.011 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.013+0000 7f60a9020800 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2024-09-12T00:49:21.014 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.016+0000 7f5f5d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:21.017 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.018+0000 7f60a9020800 20 remove_watcher() i=0 2024-09-12T00:49:21.017 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.018+0000 7f60a9020800 2 removed watcher, disabling cache 2024-09-12T00:49:21.018 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.019+0000 7f60a9020800 20 remove_watcher() i=1 2024-09-12T00:49:21.019 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.020+0000 7f60a9020800 20 remove_watcher() i=2 2024-09-12T00:49:21.020 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.022+0000 7f60a9020800 20 remove_watcher() i=3 2024-09-12T00:49:21.021 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.023+0000 7f60a9020800 20 remove_watcher() i=4 2024-09-12T00:49:21.022 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.024+0000 7f60a9020800 20 remove_watcher() i=5 2024-09-12T00:49:21.023 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.025+0000 7f60a9020800 20 remove_watcher() i=6 2024-09-12T00:49:21.025 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.026+0000 7f60a9020800 20 remove_watcher() i=7 2024-09-12T00:49:21.037 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:49:21.065 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:21.065 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:21.102 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.103+0000 7f8f9dc14800 20 rados->read ofs=0 len=0 2024-09-12T00:49:21.104 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.105+0000 7f8f9dc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:21.104 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.105+0000 7f8f9dc14800 20 realm 2024-09-12T00:49:21.104 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.105+0000 7f8f9dc14800 20 rados->read ofs=0 len=0 2024-09-12T00:49:21.104 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.105+0000 7f8f9dc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:21.104 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.105+0000 7f8f9dc14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:21.104 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.105+0000 7f8f9dc14800 20 rados->read ofs=0 len=0 2024-09-12T00:49:21.104 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.105+0000 7f8f9dc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:21.105 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.105+0000 7f8f9dc14800 20 rados->read ofs=0 len=0 2024-09-12T00:49:21.105 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.106+0000 7f8f9dc14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:21.105 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.106+0000 7f8f9dc14800 20 rados->read ofs=0 len=0 2024-09-12T00:49:21.106 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.107+0000 7f8f9dc14800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:21.106 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.107+0000 7f8f9dc14800 20 searching for the correct realm 2024-09-12T00:49:21.109 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.110+0000 7f8f99acc640 0 -- 172.21.15.73:0/1149582126 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f8f84027030 msgr2=0x7f8f84098760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:21.113 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.114+0000 7f8f93fff640 0 -- 172.21.15.73:0/1149582126 >> [v2:172.21.15.117:6800/110688882,v1:172.21.15.117:6801/110688882] conn(0x55d999ccfc60 msgr2=0x55d999cd2050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:21.116 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.117+0000 7f8f9dc14800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:49:21.116 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.117+0000 7f8f9dc14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:21.117 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.117+0000 7f8f9dc14800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:49:21.117 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.117+0000 7f8f9dc14800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:21.117 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.117+0000 7f8f9dc14800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:21.117 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.117+0000 7f8f9dc14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:21.117 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.117+0000 7f8f9dc14800 20 rados->read ofs=0 len=0 2024-09-12T00:49:21.117 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.118+0000 7f8f9dc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:21.117 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.118+0000 7f8f9dc14800 20 rados->read ofs=0 len=0 2024-09-12T00:49:21.118 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.118+0000 7f8f9dc14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:21.118 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.118+0000 7f8f9dc14800 20 rados->read ofs=0 len=0 2024-09-12T00:49:21.118 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.118+0000 7f8f9dc14800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:21.119 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.118+0000 7f8f9dc14800 20 zone default found 2024-09-12T00:49:21.119 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.118+0000 7f8f9dc14800 4 Realm: () 2024-09-12T00:49:21.119 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.118+0000 7f8f9dc14800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:49:21.119 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.118+0000 7f8f9dc14800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:49:21.119 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.118+0000 7f8f9dc14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:21.119 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.118+0000 7f8f9dc14800 20 zonegroup default 2024-09-12T00:49:21.119 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.118+0000 7f8f9dc14800 20 rados->read ofs=0 len=0 2024-09-12T00:49:21.119 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.118+0000 7f8f9dc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:21.119 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.118+0000 7f8f9dc14800 20 rados->read ofs=0 len=0 2024-09-12T00:49:21.119 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.119+0000 7f8f9dc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:21.119 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.119+0000 7f8f9dc14800 20 rados->read ofs=0 len=0 2024-09-12T00:49:21.119 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.119+0000 7f8f9dc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:21.119 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.119+0000 7f8f9dc14800 20 started sync module instance, tier type = 2024-09-12T00:49:21.120 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.119+0000 7f8f9dc14800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:49:21.127 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.128+0000 7f8f9dc14800 20 add_watcher() i=0 2024-09-12T00:49:21.127 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.128+0000 7f8f9dc14800 20 add_watcher() i=1 2024-09-12T00:49:21.127 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.128+0000 7f8f9dc14800 20 add_watcher() i=2 2024-09-12T00:49:21.127 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.128+0000 7f8f9dc14800 20 add_watcher() i=3 2024-09-12T00:49:21.127 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.128+0000 7f8f9dc14800 20 add_watcher() i=4 2024-09-12T00:49:21.127 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.128+0000 7f8f9dc14800 20 add_watcher() i=5 2024-09-12T00:49:21.127 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.128+0000 7f8f9dc14800 20 add_watcher() i=6 2024-09-12T00:49:21.127 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.129+0000 7f8f9dc14800 20 add_watcher() i=7 2024-09-12T00:49:21.127 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.129+0000 7f8f9dc14800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:21.129 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.130+0000 7f8e4f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:21.130 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.131+0000 7f8f9dc14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:21.130 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.131+0000 7f8f9dc14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:21.131 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.131+0000 7f8f9dc14800 5 note: GC not initialized 2024-09-12T00:49:21.131 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.131+0000 7f8e4e7e4640 20 reqs_thread_entry: start 2024-09-12T00:49:21.131 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.131+0000 7f8f9dc14800 20 init_complete bucket index max shards: 1 2024-09-12T00:49:21.131 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.131+0000 7f8f9dc14800 20 Filter name: none 2024-09-12T00:49:21.131 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.131+0000 7f8dbffff640 20 reqs_thread_entry: start 2024-09-12T00:49:21.131 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.131+0000 7f8f9dc14800 20 rados->read ofs=0 len=0 2024-09-12T00:49:21.131 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.132+0000 7f8f9dc14800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:49:21.131 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.132+0000 7f8f9dc14800 20 rados->read ofs=0 len=0 2024-09-12T00:49:21.132 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.132+0000 7f8f9dc14800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:49:21.132 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.132+0000 7f8f9dc14800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:21.132 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.132+0000 7f8f9dc14800 20 rados->read ofs=0 len=0 2024-09-12T00:49:21.132 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.133+0000 7f8f9dc14800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:49:21.132 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.133+0000 7f8f9dc14800 20 rados->read ofs=0 len=0 2024-09-12T00:49:21.132 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.133+0000 7f8f9dc14800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:49:21.132 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.133+0000 7f8f9dc14800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:21.133 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.134+0000 7f8e4f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:21.135 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.136+0000 7f8f9dc14800 20 remove_watcher() i=0 2024-09-12T00:49:21.135 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.136+0000 7f8f9dc14800 2 removed watcher, disabling cache 2024-09-12T00:49:21.136 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.137+0000 7f8f9dc14800 20 remove_watcher() i=1 2024-09-12T00:49:21.137 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.138+0000 7f8f9dc14800 20 remove_watcher() i=2 2024-09-12T00:49:21.138 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.139+0000 7f8f9dc14800 20 remove_watcher() i=3 2024-09-12T00:49:21.139 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.141+0000 7f8f9dc14800 20 remove_watcher() i=4 2024-09-12T00:49:21.140 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.142+0000 7f8f9dc14800 20 remove_watcher() i=5 2024-09-12T00:49:21.141 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.143+0000 7f8f9dc14800 20 remove_watcher() i=6 2024-09-12T00:49:21.142 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.144+0000 7f8f9dc14800 20 remove_watcher() i=7 2024-09-12T00:49:21.153 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:21.153 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:49:21.153 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: error-at-set-target-layout id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:49:21.153 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:21.154 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:21.154 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:21.186 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:21.186 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:21.243 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:49:21.274 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:21.274 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:21.311 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.313+0000 7fdf8c72c800 20 rados->read ofs=0 len=0 2024-09-12T00:49:21.313 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.314+0000 7fdf8c72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:21.313 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.314+0000 7fdf8c72c800 20 realm 2024-09-12T00:49:21.313 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.314+0000 7fdf8c72c800 20 rados->read ofs=0 len=0 2024-09-12T00:49:21.314 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.314+0000 7fdf8c72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:21.314 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.314+0000 7fdf8c72c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:21.314 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.314+0000 7fdf8c72c800 20 rados->read ofs=0 len=0 2024-09-12T00:49:21.314 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.315+0000 7fdf8c72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:21.314 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.315+0000 7fdf8c72c800 20 rados->read ofs=0 len=0 2024-09-12T00:49:21.314 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.315+0000 7fdf8c72c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:21.314 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.315+0000 7fdf8c72c800 20 rados->read ofs=0 len=0 2024-09-12T00:49:21.315 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.316+0000 7fdf8c72c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:21.315 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.316+0000 7fdf8c72c800 20 searching for the correct realm 2024-09-12T00:49:21.317 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.318+0000 7fdf88b46640 0 -- 172.21.15.73:0/3362677112 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fdf7c06a070 msgr2=0x7fdf7c0aa7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:49:21.523 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.524+0000 7fdf88b46640 0 -- 172.21.15.73:0/3362677112 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fdf7c06a070 msgr2=0x7fdf7c0aa7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:21.528 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.528+0000 7fdf8c72c800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:49:21.528 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.528+0000 7fdf8c72c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:21.528 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.528+0000 7fdf8c72c800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:49:21.528 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.528+0000 7fdf8c72c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:21.528 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.528+0000 7fdf8c72c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:21.528 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.528+0000 7fdf8c72c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:21.529 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.528+0000 7fdf8c72c800 20 rados->read ofs=0 len=0 2024-09-12T00:49:21.529 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.528+0000 7fdf8c72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:21.529 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.528+0000 7fdf8c72c800 20 rados->read ofs=0 len=0 2024-09-12T00:49:21.529 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.529+0000 7fdf8c72c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:21.529 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.529+0000 7fdf8c72c800 20 rados->read ofs=0 len=0 2024-09-12T00:49:21.529 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.529+0000 7fdf8c72c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:21.529 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.529+0000 7fdf8c72c800 20 zone default found 2024-09-12T00:49:21.529 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.529+0000 7fdf8c72c800 4 Realm: () 2024-09-12T00:49:21.529 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.529+0000 7fdf8c72c800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:49:21.529 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.529+0000 7fdf8c72c800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:49:21.529 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.529+0000 7fdf8c72c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:21.529 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.529+0000 7fdf8c72c800 20 zonegroup default 2024-09-12T00:49:21.529 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.529+0000 7fdf8c72c800 20 rados->read ofs=0 len=0 2024-09-12T00:49:21.530 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.529+0000 7fdf8c72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:21.530 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.529+0000 7fdf8c72c800 20 rados->read ofs=0 len=0 2024-09-12T00:49:21.530 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.530+0000 7fdf8c72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:21.530 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.530+0000 7fdf8c72c800 20 rados->read ofs=0 len=0 2024-09-12T00:49:21.530 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.530+0000 7fdf8c72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:21.530 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.530+0000 7fdf8c72c800 20 started sync module instance, tier type = 2024-09-12T00:49:21.530 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.530+0000 7fdf8c72c800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:49:21.538 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.540+0000 7fdf8c72c800 20 add_watcher() i=0 2024-09-12T00:49:21.538 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.540+0000 7fdf8c72c800 20 add_watcher() i=1 2024-09-12T00:49:21.539 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.540+0000 7fdf8c72c800 20 add_watcher() i=2 2024-09-12T00:49:21.539 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.540+0000 7fdf8c72c800 20 add_watcher() i=3 2024-09-12T00:49:21.539 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.540+0000 7fdf8c72c800 20 add_watcher() i=4 2024-09-12T00:49:21.539 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.540+0000 7fdf8c72c800 20 add_watcher() i=5 2024-09-12T00:49:21.539 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.540+0000 7fdf8c72c800 20 add_watcher() i=6 2024-09-12T00:49:21.539 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.540+0000 7fdf8c72c800 20 add_watcher() i=7 2024-09-12T00:49:21.539 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.540+0000 7fdf8c72c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:21.541 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.542+0000 7fde3efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:21.542 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.543+0000 7fdf8c72c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:21.542 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.543+0000 7fdf8c72c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:21.542 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.543+0000 7fdf8c72c800 5 note: GC not initialized 2024-09-12T00:49:21.542 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.543+0000 7fde3dfdb640 20 reqs_thread_entry: start 2024-09-12T00:49:21.542 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.543+0000 7fdf8c72c800 20 init_complete bucket index max shards: 1 2024-09-12T00:49:21.542 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.543+0000 7fdf8c72c800 20 Filter name: none 2024-09-12T00:49:21.542 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.543+0000 7fddaf7fe640 20 reqs_thread_entry: start 2024-09-12T00:49:21.542 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.543+0000 7fdf8c72c800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T00:49:21.543 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.543+0000 7fdf8c72c800 20 rados->read ofs=0 len=0 2024-09-12T00:49:21.543 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.544+0000 7fdf8c72c800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:49:21.543 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.544+0000 7fdf8c72c800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T00:49:21.544 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.544+0000 7fdf8c72c800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T00:49:21.544 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.544+0000 7fdf8c72c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22 : miss 2024-09-12T00:49:21.544 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.544+0000 7fdf8c72c800 20 rados->read ofs=0 len=0 2024-09-12T00:49:21.544 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.544+0000 7fdf8c72c800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:49:21.544 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.544+0000 7fdf8c72c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22 info.flags=0x17 2024-09-12T00:49:21.544 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.544+0000 7fdf8c72c800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22 to cache LRU end 2024-09-12T00:49:21.544 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.544+0000 7fdf8c72c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:21.544 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.544+0000 7fdf8c72c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:21.544 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.544+0000 7fdf8c72c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22 2024-09-12T00:49:21.546 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.548+0000 7fdf8c72c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22 info.flags=0x17 2024-09-12T00:49:21.547 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.548+0000 7fdf8c72c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22 to cache LRU end 2024-09-12T00:49:21.547 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.548+0000 7fdf8c72c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:21.547 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.548+0000 7fdf8c72c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22, ofs0, ns] 2024-09-12T00:49:21.547 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.548+0000 7fde5f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496989 cookie 94212628285248 notifier 6215 bl.length()=925 2024-09-12T00:49:21.547 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.548+0000 7fde5f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22 info.flags=0x17 2024-09-12T00:49:21.547 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.548+0000 7fde5f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22 to cache LRU end 2024-09-12T00:49:21.547 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.548+0000 7fde5f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:21.548 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.550+0000 7fdf8c72c800 20 handle_bi_update(): bucket=:error-at-set-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22]): orig_sources= new_sources= 2024-09-12T00:49:21.548 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.550+0000 7fdf8c72c800 20 handle_bi_update(): bucket=:error-at-set-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22]): potential sources added=[] removed=[] 2024-09-12T00:49:21.549 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.550+0000 7fdf8c72c800 20 handle_bi_update(): bucket=:error-at-set-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22]): orig_dests= new_dests= 2024-09-12T00:49:21.549 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.550+0000 7fdf8c72c800 20 handle_bi_update(): bucket=:error-at-set-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22]): potential dests added=[] removed=[] 2024-09-12T00:49:21.550 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.552+0000 7fdf8c72c800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22.1.0 2024-09-12T00:49:21.550 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.552+0000 7fdf8c72c800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22.1.0 2024-09-12T00:49:21.551 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.552+0000 7fdf8c72c800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22.1.1 2024-09-12T00:49:21.551 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.552+0000 7fdf8c72c800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22.1.1 2024-09-12T00:49:21.551 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.552+0000 7fdf8c72c800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22.0 2024-09-12T00:49:21.553 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.554+0000 7fdf8c72c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22 : hit (requested=0x17, cached=0x17) 2024-09-12T00:49:21.553 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.554+0000 7fdf8c72c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22 2024-09-12T00:49:21.554 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.555+0000 7fdf8c72c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22 info.flags=0x17 2024-09-12T00:49:21.554 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.555+0000 7fdf8c72c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22 to cache LRU end 2024-09-12T00:49:21.554 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.555+0000 7fdf8c72c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:21.554 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.555+0000 7fdf8c72c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22, ofs0, ns] 2024-09-12T00:49:21.555 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.556+0000 7fde5f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496990 cookie 94212628285248 notifier 6215 bl.length()=925 2024-09-12T00:49:21.555 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.556+0000 7fde5f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22 info.flags=0x17 2024-09-12T00:49:21.555 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.556+0000 7fde5f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22 to cache LRU end 2024-09-12T00:49:21.555 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.556+0000 7fde5f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:21.556 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.557+0000 7fdf8c72c800 20 handle_bi_update(): bucket=:error-at-set-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22]): orig_sources= new_sources= 2024-09-12T00:49:21.556 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.557+0000 7fdf8c72c800 20 handle_bi_update(): bucket=:error-at-set-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22]): potential sources added=[] removed=[] 2024-09-12T00:49:21.556 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.557+0000 7fdf8c72c800 20 handle_bi_update(): bucket=:error-at-set-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22]): orig_dests= new_dests= 2024-09-12T00:49:21.556 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.557+0000 7fdf8c72c800 20 handle_bi_update(): bucket=:error-at-set-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22]): potential dests added=[] removed=[] 2024-09-12T00:49:21.557 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.558+0000 7fdf8c72c800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22.0 2024-09-12T00:49:21.557 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.559+0000 7fdf8c72c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22 : hit (requested=0x17, cached=0x17) 2024-09-12T00:49:21.557 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.559+0000 7fdf8c72c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22 2024-09-12T00:49:21.559 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.560+0000 7fdf8c72c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22 info.flags=0x17 2024-09-12T00:49:21.559 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.560+0000 7fdf8c72c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22 to cache LRU end 2024-09-12T00:49:21.559 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.560+0000 7fdf8c72c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:21.559 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.560+0000 7fdf8c72c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22, ofs0, ns] 2024-09-12T00:49:21.559 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.560+0000 7fde5f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496991 cookie 94212628285248 notifier 6215 bl.length()=893 2024-09-12T00:49:21.559 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.560+0000 7fde5f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22 info.flags=0x17 2024-09-12T00:49:21.559 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.560+0000 7fde5f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22 to cache LRU end 2024-09-12T00:49:21.559 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.560+0000 7fde5f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:21.560 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.562+0000 7fdf8c72c800 20 handle_bi_update(): bucket=:error-at-set-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22]): orig_sources= new_sources= 2024-09-12T00:49:21.560 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.562+0000 7fdf8c72c800 20 handle_bi_update(): bucket=:error-at-set-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22]): potential sources added=[] removed=[] 2024-09-12T00:49:21.560 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.562+0000 7fdf8c72c800 20 handle_bi_update(): bucket=:error-at-set-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22]): orig_dests= new_dests= 2024-09-12T00:49:21.560 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.562+0000 7fdf8c72c800 20 handle_bi_update(): bucket=:error-at-set-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22]): potential dests added=[] removed=[] 2024-09-12T00:49:21.561 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.563+0000 7fdf8c72c800 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T00:49:21.563 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.564+0000 7fde3efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:21.566 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.567+0000 7fdf8c72c800 20 remove_watcher() i=0 2024-09-12T00:49:21.566 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.567+0000 7fdf8c72c800 2 removed watcher, disabling cache 2024-09-12T00:49:21.567 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.568+0000 7fdf8c72c800 20 remove_watcher() i=1 2024-09-12T00:49:21.568 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.569+0000 7fdf8c72c800 20 remove_watcher() i=2 2024-09-12T00:49:21.569 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.570+0000 7fdf8c72c800 20 remove_watcher() i=3 2024-09-12T00:49:21.570 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.572+0000 7fdf8c72c800 20 remove_watcher() i=4 2024-09-12T00:49:21.571 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.572+0000 7fdf8c72c800 20 remove_watcher() i=5 2024-09-12T00:49:21.572 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.573+0000 7fdf8c72c800 20 remove_watcher() i=6 2024-09-12T00:49:21.573 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.574+0000 7fdf8c72c800 20 remove_watcher() i=7 2024-09-12T00:49:21.585 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:49:21.613 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:21.613 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:21.651 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.652+0000 7f663fdaf800 20 rados->read ofs=0 len=0 2024-09-12T00:49:21.653 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.654+0000 7f663fdaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:21.653 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.654+0000 7f663fdaf800 20 realm 2024-09-12T00:49:21.653 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.654+0000 7f663fdaf800 20 rados->read ofs=0 len=0 2024-09-12T00:49:21.653 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.654+0000 7f663fdaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:21.653 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.654+0000 7f663fdaf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:21.653 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.654+0000 7f663fdaf800 20 rados->read ofs=0 len=0 2024-09-12T00:49:21.653 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.654+0000 7f663fdaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:21.653 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.654+0000 7f663fdaf800 20 rados->read ofs=0 len=0 2024-09-12T00:49:21.654 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.655+0000 7f663fdaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:21.654 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.655+0000 7f663fdaf800 20 rados->read ofs=0 len=0 2024-09-12T00:49:21.654 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.656+0000 7f663fdaf800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:21.655 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.656+0000 7f663fdaf800 20 searching for the correct realm 2024-09-12T00:49:21.658 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.659+0000 7f663e09a640 0 -- 172.21.15.73:0/179106196 >> [v2:172.21.15.73:6800/2864081714,v1:172.21.15.73:6801/2864081714] conn(0x55f5e52da100 msgr2=0x55f5e52dc590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:49:21.662 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.663+0000 7f663d899640 0 -- 172.21.15.73:0/179106196 >> [v2:172.21.15.117:6816/1460498570,v1:172.21.15.117:6817/1460498570] conn(0x7f6638031040 msgr2=0x7f6638020940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:21.665 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.666+0000 7f663fdaf800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:49:21.665 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.666+0000 7f663fdaf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:21.665 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.666+0000 7f663fdaf800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:49:21.666 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.666+0000 7f663fdaf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:21.666 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.666+0000 7f663fdaf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:21.666 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.666+0000 7f663fdaf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:21.666 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.666+0000 7f663fdaf800 20 rados->read ofs=0 len=0 2024-09-12T00:49:21.666 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.667+0000 7f663fdaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:21.666 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.667+0000 7f663fdaf800 20 rados->read ofs=0 len=0 2024-09-12T00:49:21.667 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.667+0000 7f663fdaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:21.667 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.667+0000 7f663fdaf800 20 rados->read ofs=0 len=0 2024-09-12T00:49:21.667 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.667+0000 7f663fdaf800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:21.667 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.667+0000 7f663fdaf800 20 zone default found 2024-09-12T00:49:21.668 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.667+0000 7f663fdaf800 4 Realm: () 2024-09-12T00:49:21.668 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.667+0000 7f663fdaf800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:49:21.668 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.667+0000 7f663fdaf800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:49:21.668 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.667+0000 7f663fdaf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:21.668 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.667+0000 7f663fdaf800 20 zonegroup default 2024-09-12T00:49:21.668 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.667+0000 7f663fdaf800 20 rados->read ofs=0 len=0 2024-09-12T00:49:21.668 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.667+0000 7f663fdaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:21.668 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.667+0000 7f663fdaf800 20 rados->read ofs=0 len=0 2024-09-12T00:49:21.668 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.668+0000 7f663fdaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:21.668 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.668+0000 7f663fdaf800 20 rados->read ofs=0 len=0 2024-09-12T00:49:21.668 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.668+0000 7f663fdaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:21.668 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.668+0000 7f663fdaf800 20 started sync module instance, tier type = 2024-09-12T00:49:21.668 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.668+0000 7f663fdaf800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:49:21.676 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.677+0000 7f663fdaf800 20 add_watcher() i=0 2024-09-12T00:49:21.676 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.677+0000 7f663fdaf800 20 add_watcher() i=1 2024-09-12T00:49:21.676 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.677+0000 7f663fdaf800 20 add_watcher() i=2 2024-09-12T00:49:21.676 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.677+0000 7f663fdaf800 20 add_watcher() i=3 2024-09-12T00:49:21.676 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.677+0000 7f663fdaf800 20 add_watcher() i=4 2024-09-12T00:49:21.676 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.677+0000 7f663fdaf800 20 add_watcher() i=5 2024-09-12T00:49:21.676 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.677+0000 7f663fdaf800 20 add_watcher() i=6 2024-09-12T00:49:21.677 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.678+0000 7f663fdaf800 20 add_watcher() i=7 2024-09-12T00:49:21.677 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.678+0000 7f663fdaf800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:21.678 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.680+0000 7f64ef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:21.679 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.680+0000 7f663fdaf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:21.679 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.680+0000 7f663fdaf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:21.679 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.680+0000 7f663fdaf800 5 note: GC not initialized 2024-09-12T00:49:21.679 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.680+0000 7f64ee7fc640 20 reqs_thread_entry: start 2024-09-12T00:49:21.680 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.680+0000 7f663fdaf800 20 init_complete bucket index max shards: 1 2024-09-12T00:49:21.680 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.680+0000 7f663fdaf800 20 Filter name: none 2024-09-12T00:49:21.680 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.680+0000 7f645ffff640 20 reqs_thread_entry: start 2024-09-12T00:49:21.680 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.680+0000 7f663fdaf800 20 rados->read ofs=0 len=0 2024-09-12T00:49:21.681 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.681+0000 7f663fdaf800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:49:21.681 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.681+0000 7f663fdaf800 20 rados->read ofs=0 len=0 2024-09-12T00:49:21.681 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.681+0000 7f663fdaf800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:49:21.681 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.681+0000 7f663fdaf800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:21.681 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.681+0000 7f663fdaf800 20 rados->read ofs=0 len=0 2024-09-12T00:49:21.681 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.682+0000 7f663fdaf800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:49:21.681 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.682+0000 7f663fdaf800 20 rados->read ofs=0 len=0 2024-09-12T00:49:21.681 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.682+0000 7f663fdaf800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:49:21.682 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.682+0000 7f663fdaf800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:21.682 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.683+0000 7f64ef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:21.684 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.686+0000 7f663fdaf800 20 remove_watcher() i=0 2024-09-12T00:49:21.684 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.686+0000 7f663fdaf800 2 removed watcher, disabling cache 2024-09-12T00:49:21.685 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.687+0000 7f663fdaf800 20 remove_watcher() i=1 2024-09-12T00:49:21.687 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.688+0000 7f663fdaf800 20 remove_watcher() i=2 2024-09-12T00:49:21.688 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.689+0000 7f663fdaf800 20 remove_watcher() i=3 2024-09-12T00:49:21.688 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.690+0000 7f663fdaf800 20 remove_watcher() i=4 2024-09-12T00:49:21.689 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.691+0000 7f663fdaf800 20 remove_watcher() i=5 2024-09-12T00:49:21.690 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.692+0000 7f663fdaf800 20 remove_watcher() i=6 2024-09-12T00:49:21.691 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:21.693+0000 7f663fdaf800 20 remove_watcher() i=7 2024-09-12T00:49:21.701 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:21.701 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:49:21.701 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: error-at-set-target-layout id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:49:21.702 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:21.703 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:21.703 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:21.723 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:21.723 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:21.940 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:21.941 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:22.002 INFO:tasks.workunit.client.0.smithi073.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2024-09-12T00:49:22.002 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:22.003 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:22.003 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:22.042 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:22.042 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:22.099 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:22.099 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:22.131 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:22.132 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:22.167 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:22.167 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:22.201 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:22.201 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:22.237 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:22.237 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:22.271 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:22.271 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:22.307 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:22.307 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:22.342 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:22.342 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:22.377 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:22.377 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:22.412 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:22.412 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:22.446 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:22.447 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:22.481 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:22.481 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:22.516 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:22.516 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:22.549 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:22.549 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:22.585 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:22.585 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:22.620 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:22.620 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:22.655 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:22.655 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:22.689 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:22.689 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:22.724 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:22.725 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:22.758 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:22.759 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:22.794 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:49:22.822 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:22.822 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:22.862 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:22.863+0000 7fe7e0240800 20 rados->read ofs=0 len=0 2024-09-12T00:49:22.864 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:22.865+0000 7fe7e0240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:22.864 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:22.865+0000 7fe7e0240800 20 realm 2024-09-12T00:49:22.864 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:22.865+0000 7fe7e0240800 20 rados->read ofs=0 len=0 2024-09-12T00:49:22.864 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:22.865+0000 7fe7e0240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:22.864 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:22.865+0000 7fe7e0240800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:22.865 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:22.865+0000 7fe7e0240800 20 rados->read ofs=0 len=0 2024-09-12T00:49:22.865 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:22.865+0000 7fe7e0240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:22.865 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:22.865+0000 7fe7e0240800 20 rados->read ofs=0 len=0 2024-09-12T00:49:22.865 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:22.866+0000 7fe7e0240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:22.865 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:22.866+0000 7fe7e0240800 20 rados->read ofs=0 len=0 2024-09-12T00:49:22.866 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:22.867+0000 7fe7e0240800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:22.866 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:22.867+0000 7fe7e0240800 20 searching for the correct realm 2024-09-12T00:49:22.866 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:22.867+0000 7fe7de52b640 0 -- 172.21.15.73:0/84501609 >> [v2:172.21.15.73:6800/2864081714,v1:172.21.15.73:6801/2864081714] conn(0x55c3a2f81440 msgr2=0x55c3a2f83900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:23.070 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.071+0000 7fe7de52b640 0 -- 172.21.15.73:0/84501609 >> [v2:172.21.15.73:6800/2864081714,v1:172.21.15.73:6801/2864081714] conn(0x55c3a2f81440 msgr2=0x55c3a2f83900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:23.079 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.079+0000 7fe7e0240800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:49:23.080 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.079+0000 7fe7e0240800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:23.080 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.079+0000 7fe7e0240800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:49:23.080 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.079+0000 7fe7e0240800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:23.080 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.079+0000 7fe7e0240800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:23.080 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.079+0000 7fe7e0240800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:23.080 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.079+0000 7fe7e0240800 20 rados->read ofs=0 len=0 2024-09-12T00:49:23.080 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.079+0000 7fe7e0240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:23.080 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.079+0000 7fe7e0240800 20 rados->read ofs=0 len=0 2024-09-12T00:49:23.080 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.079+0000 7fe7e0240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:23.080 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.079+0000 7fe7e0240800 20 rados->read ofs=0 len=0 2024-09-12T00:49:23.081 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.080+0000 7fe7e0240800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:23.081 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.080+0000 7fe7e0240800 20 zone default found 2024-09-12T00:49:23.081 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.080+0000 7fe7e0240800 4 Realm: () 2024-09-12T00:49:23.081 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.080+0000 7fe7e0240800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:49:23.081 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.080+0000 7fe7e0240800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:49:23.081 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.080+0000 7fe7e0240800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:23.081 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.080+0000 7fe7e0240800 20 zonegroup default 2024-09-12T00:49:23.081 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.080+0000 7fe7e0240800 20 rados->read ofs=0 len=0 2024-09-12T00:49:23.081 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.080+0000 7fe7e0240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:23.081 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.080+0000 7fe7e0240800 20 rados->read ofs=0 len=0 2024-09-12T00:49:23.081 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.080+0000 7fe7e0240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:23.082 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.080+0000 7fe7e0240800 20 rados->read ofs=0 len=0 2024-09-12T00:49:23.082 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.081+0000 7fe7e0240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:23.082 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.081+0000 7fe7e0240800 20 started sync module instance, tier type = 2024-09-12T00:49:23.082 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.081+0000 7fe7e0240800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:49:23.089 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.090+0000 7fe7e0240800 20 add_watcher() i=0 2024-09-12T00:49:23.089 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.090+0000 7fe7e0240800 20 add_watcher() i=1 2024-09-12T00:49:23.089 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.090+0000 7fe7e0240800 20 add_watcher() i=2 2024-09-12T00:49:23.089 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.090+0000 7fe7e0240800 20 add_watcher() i=3 2024-09-12T00:49:23.089 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.090+0000 7fe7e0240800 20 add_watcher() i=4 2024-09-12T00:49:23.089 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.090+0000 7fe7e0240800 20 add_watcher() i=5 2024-09-12T00:49:23.090 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.090+0000 7fe7e0240800 20 add_watcher() i=6 2024-09-12T00:49:23.090 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.091+0000 7fe7e0240800 20 add_watcher() i=7 2024-09-12T00:49:23.090 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.091+0000 7fe7e0240800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:23.091 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.093+0000 7fe68f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:23.093 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.093+0000 7fe7e0240800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:23.093 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.093+0000 7fe7e0240800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:23.093 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.093+0000 7fe7e0240800 5 note: GC not initialized 2024-09-12T00:49:23.093 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.093+0000 7fe68e7fc640 20 reqs_thread_entry: start 2024-09-12T00:49:23.093 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.093+0000 7fe7e0240800 20 init_complete bucket index max shards: 1 2024-09-12T00:49:23.093 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.093+0000 7fe7e0240800 20 Filter name: none 2024-09-12T00:49:23.093 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.094+0000 7fe5fffff640 20 reqs_thread_entry: start 2024-09-12T00:49:23.093 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.094+0000 7fe7e0240800 20 rados->read ofs=0 len=0 2024-09-12T00:49:23.094 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.094+0000 7fe7e0240800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:49:23.094 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.094+0000 7fe7e0240800 20 rados->read ofs=0 len=0 2024-09-12T00:49:23.095 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.095+0000 7fe7e0240800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:49:23.095 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.095+0000 7fe7e0240800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:23.095 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.095+0000 7fe7e0240800 20 rados->read ofs=0 len=0 2024-09-12T00:49:23.095 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.095+0000 7fe7e0240800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:49:23.095 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.095+0000 7fe7e0240800 20 rados->read ofs=0 len=0 2024-09-12T00:49:23.095 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.096+0000 7fe7e0240800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:49:23.095 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.096+0000 7fe7e0240800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:23.096 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.097+0000 7fe68f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:23.098 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.099+0000 7fe7e0240800 20 remove_watcher() i=0 2024-09-12T00:49:23.098 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.099+0000 7fe7e0240800 2 removed watcher, disabling cache 2024-09-12T00:49:23.099 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.100+0000 7fe7e0240800 20 remove_watcher() i=1 2024-09-12T00:49:23.100 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.101+0000 7fe7e0240800 20 remove_watcher() i=2 2024-09-12T00:49:23.101 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.102+0000 7fe7e0240800 20 remove_watcher() i=3 2024-09-12T00:49:23.102 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.103+0000 7fe7e0240800 20 remove_watcher() i=4 2024-09-12T00:49:23.103 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.104+0000 7fe7e0240800 20 remove_watcher() i=5 2024-09-12T00:49:23.104 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.105+0000 7fe7e0240800 20 remove_watcher() i=6 2024-09-12T00:49:23.105 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.106+0000 7fe7e0240800 20 remove_watcher() i=7 2024-09-12T00:49:23.115 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:23.115 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:49:23.115 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: error-at-set-target-layout id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:49:23.115 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:23.116 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2024-09-12T00:49:23.153 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:23.153 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:23.191 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.192+0000 7f66d65ad800 20 rados->read ofs=0 len=0 2024-09-12T00:49:23.192 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.193+0000 7f66d65ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:23.193 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.193+0000 7f66d65ad800 20 realm 2024-09-12T00:49:23.193 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.193+0000 7f66d65ad800 20 rados->read ofs=0 len=0 2024-09-12T00:49:23.193 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.194+0000 7f66d65ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:23.193 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.194+0000 7f66d65ad800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:23.193 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.194+0000 7f66d65ad800 20 rados->read ofs=0 len=0 2024-09-12T00:49:23.193 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.194+0000 7f66d65ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:23.193 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.194+0000 7f66d65ad800 20 rados->read ofs=0 len=0 2024-09-12T00:49:23.194 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.195+0000 7f66d65ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:23.194 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.195+0000 7f66d65ad800 20 rados->read ofs=0 len=0 2024-09-12T00:49:23.195 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.196+0000 7f66d65ad800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:23.195 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.196+0000 7f66d65ad800 20 searching for the correct realm 2024-09-12T00:49:23.196 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.197+0000 7f66cbfff640 0 -- 172.21.15.73:0/3801008004 >> [v2:172.21.15.73:6826/269690776,v1:172.21.15.73:6827/269690776] conn(0x7f66c4096200 msgr2=0x7f66c4082990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:23.402 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.403+0000 7f66d4097640 0 -- 172.21.15.73:0/3801008004 >> [v2:172.21.15.73:6810/1807760270,v1:172.21.15.73:6811/1807760270] conn(0x7f66cc0ad6e0 msgr2=0x7f66cc060430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:23.609 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.610+0000 7f66d65ad800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:49:23.610 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.610+0000 7f66d65ad800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:23.610 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.610+0000 7f66d65ad800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:49:23.610 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.610+0000 7f66d65ad800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:23.610 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.610+0000 7f66d65ad800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:23.610 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.610+0000 7f66d65ad800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:23.610 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.610+0000 7f66d65ad800 20 rados->read ofs=0 len=0 2024-09-12T00:49:23.610 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.610+0000 7f66d65ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:23.610 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.610+0000 7f66d65ad800 20 rados->read ofs=0 len=0 2024-09-12T00:49:23.610 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.611+0000 7f66d65ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:23.610 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.611+0000 7f66d65ad800 20 rados->read ofs=0 len=0 2024-09-12T00:49:23.611 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.611+0000 7f66d65ad800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:23.611 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.611+0000 7f66d65ad800 20 zone default found 2024-09-12T00:49:23.611 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.611+0000 7f66d65ad800 4 Realm: () 2024-09-12T00:49:23.612 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.611+0000 7f66d65ad800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:49:23.612 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.611+0000 7f66d65ad800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:49:23.612 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.611+0000 7f66d65ad800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:23.612 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.611+0000 7f66d65ad800 20 zonegroup default 2024-09-12T00:49:23.612 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.611+0000 7f66d65ad800 20 rados->read ofs=0 len=0 2024-09-12T00:49:23.612 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.611+0000 7f66d65ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:23.612 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.611+0000 7f66d65ad800 20 rados->read ofs=0 len=0 2024-09-12T00:49:23.612 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.612+0000 7f66d65ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:23.612 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.612+0000 7f66d65ad800 20 rados->read ofs=0 len=0 2024-09-12T00:49:23.612 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.612+0000 7f66d65ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:23.612 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.612+0000 7f66d65ad800 20 started sync module instance, tier type = 2024-09-12T00:49:23.613 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.612+0000 7f66d65ad800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:49:23.620 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.621+0000 7f66d65ad800 20 add_watcher() i=0 2024-09-12T00:49:23.620 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.621+0000 7f66d65ad800 20 add_watcher() i=1 2024-09-12T00:49:23.620 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.621+0000 7f66d65ad800 20 add_watcher() i=2 2024-09-12T00:49:23.621 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.621+0000 7f66d65ad800 20 add_watcher() i=3 2024-09-12T00:49:23.621 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.621+0000 7f66d65ad800 20 add_watcher() i=4 2024-09-12T00:49:23.621 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.621+0000 7f66d65ad800 20 add_watcher() i=5 2024-09-12T00:49:23.621 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.621+0000 7f66d65ad800 20 add_watcher() i=6 2024-09-12T00:49:23.621 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.622+0000 7f66d65ad800 20 add_watcher() i=7 2024-09-12T00:49:23.621 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.622+0000 7f66d65ad800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:23.623 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.624+0000 7f658afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:23.624 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.624+0000 7f66d65ad800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:23.624 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.624+0000 7f66d65ad800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:23.624 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.624+0000 7f66d65ad800 5 note: GC not initialized 2024-09-12T00:49:23.624 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.625+0000 7f6589fdb640 20 reqs_thread_entry: start 2024-09-12T00:49:23.624 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.625+0000 7f66d65ad800 20 init_complete bucket index max shards: 1 2024-09-12T00:49:23.624 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.625+0000 7f66d65ad800 20 Filter name: none 2024-09-12T00:49:23.624 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.625+0000 7f64fb7fe640 20 reqs_thread_entry: start 2024-09-12T00:49:23.624 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.625+0000 7f66d65ad800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T00:49:23.624 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.625+0000 7f66d65ad800 20 rados->read ofs=0 len=0 2024-09-12T00:49:23.625 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.625+0000 7f66d65ad800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:49:23.625 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.625+0000 7f66d65ad800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T00:49:23.625 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.625+0000 7f66d65ad800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T00:49:23.625 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.625+0000 7f66d65ad800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23 : miss 2024-09-12T00:49:23.625 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.625+0000 7f66d65ad800 20 rados->read ofs=0 len=0 2024-09-12T00:49:23.625 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.626+0000 7f66d65ad800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:49:23.626 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.626+0000 7f66d65ad800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23 info.flags=0x17 2024-09-12T00:49:23.626 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.626+0000 7f66d65ad800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23 to cache LRU end 2024-09-12T00:49:23.626 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.626+0000 7f66d65ad800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:23.626 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.626+0000 7f66d65ad800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:23.626 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.626+0000 7f66d65ad800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23 2024-09-12T00:49:23.627 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.629+0000 7f66d65ad800 -1 Injecting error=-125 at location=set_target_layout 2024-09-12T00:49:23.629 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.630+0000 7f66d65ad800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23 info.flags=0x17 2024-09-12T00:49:23.629 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.630+0000 7f66d65ad800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23 to cache LRU end 2024-09-12T00:49:23.629 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.630+0000 7f66d65ad800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:23.629 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.630+0000 7f66d65ad800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23, ofs0, ns] 2024-09-12T00:49:23.629 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.630+0000 7f65ab7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496994 cookie 93993122928720 notifier 6594 bl.length()=925 2024-09-12T00:49:23.630 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.630+0000 7f65ab7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23 info.flags=0x17 2024-09-12T00:49:23.630 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.630+0000 7f65ab7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23 to cache LRU end 2024-09-12T00:49:23.630 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.630+0000 7f65ab7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:23.631 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.632+0000 7f66d65ad800 20 handle_bi_update(): bucket=:error-at-set-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23]): orig_sources= new_sources= 2024-09-12T00:49:23.631 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.632+0000 7f66d65ad800 20 handle_bi_update(): bucket=:error-at-set-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23]): potential sources added=[] removed=[] 2024-09-12T00:49:23.631 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.632+0000 7f66d65ad800 20 handle_bi_update(): bucket=:error-at-set-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23]): orig_dests= new_dests= 2024-09-12T00:49:23.631 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.632+0000 7f66d65ad800 20 handle_bi_update(): bucket=:error-at-set-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23]): potential dests added=[] removed=[] 2024-09-12T00:49:23.633 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.634+0000 7f66d65ad800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23.1.0 2024-09-12T00:49:23.633 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.634+0000 7f66d65ad800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23.1.0 2024-09-12T00:49:23.633 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.634+0000 7f66d65ad800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23.1.1 2024-09-12T00:49:23.633 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.634+0000 7f66d65ad800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23.1.1 2024-09-12T00:49:23.633 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.634+0000 7f66d65ad800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23.0 2024-09-12T00:49:23.635 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.637+0000 7f66d65ad800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23 : hit (requested=0x17, cached=0x17) 2024-09-12T00:49:23.635 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.637+0000 7f66d65ad800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23 2024-09-12T00:49:23.637 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.638+0000 7f66d65ad800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23 info.flags=0x17 2024-09-12T00:49:23.637 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.638+0000 7f66d65ad800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23 to cache LRU end 2024-09-12T00:49:23.638 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.638+0000 7f66d65ad800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:23.638 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.638+0000 7f66d65ad800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23, ofs0, ns] 2024-09-12T00:49:23.638 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.638+0000 7f65ab7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496995 cookie 93993122928720 notifier 6594 bl.length()=925 2024-09-12T00:49:23.638 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.639+0000 7f65ab7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23 info.flags=0x17 2024-09-12T00:49:23.638 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.639+0000 7f65ab7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23 to cache LRU end 2024-09-12T00:49:23.638 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.639+0000 7f65ab7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:23.639 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.640+0000 7f66d65ad800 20 handle_bi_update(): bucket=:error-at-set-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23]): orig_sources= new_sources= 2024-09-12T00:49:23.639 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.640+0000 7f66d65ad800 20 handle_bi_update(): bucket=:error-at-set-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23]): potential sources added=[] removed=[] 2024-09-12T00:49:23.639 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.640+0000 7f66d65ad800 20 handle_bi_update(): bucket=:error-at-set-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23]): orig_dests= new_dests= 2024-09-12T00:49:23.639 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.640+0000 7f66d65ad800 20 handle_bi_update(): bucket=:error-at-set-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23]): potential dests added=[] removed=[] 2024-09-12T00:49:23.639 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.641+0000 7f66d65ad800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23.0 2024-09-12T00:49:23.640 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.641+0000 7f66d65ad800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23 : hit (requested=0x17, cached=0x17) 2024-09-12T00:49:23.640 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.641+0000 7f66d65ad800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23 2024-09-12T00:49:23.641 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.643+0000 7f66d65ad800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23 info.flags=0x17 2024-09-12T00:49:23.641 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.643+0000 7f66d65ad800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23 to cache LRU end 2024-09-12T00:49:23.641 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.643+0000 7f66d65ad800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:23.641 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.643+0000 7f66d65ad800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23, ofs0, ns] 2024-09-12T00:49:23.642 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.643+0000 7f65ab7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496996 cookie 93993122928720 notifier 6594 bl.length()=893 2024-09-12T00:49:23.642 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.643+0000 7f65ab7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23 info.flags=0x17 2024-09-12T00:49:23.642 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.643+0000 7f65ab7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23 to cache LRU end 2024-09-12T00:49:23.642 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.643+0000 7f65ab7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:23.643 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.644+0000 7f66d65ad800 20 handle_bi_update(): bucket=:error-at-set-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23]): orig_sources= new_sources= 2024-09-12T00:49:23.643 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.644+0000 7f66d65ad800 20 handle_bi_update(): bucket=:error-at-set-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23]): potential sources added=[] removed=[] 2024-09-12T00:49:23.643 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.644+0000 7f66d65ad800 20 handle_bi_update(): bucket=:error-at-set-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23]): orig_dests= new_dests= 2024-09-12T00:49:23.643 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.644+0000 7f66d65ad800 20 handle_bi_update(): bucket=:error-at-set-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23]): potential dests added=[] removed=[] 2024-09-12T00:49:23.644 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.645+0000 7f66d65ad800 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T00:49:23.645 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.647+0000 7f658afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:23.648 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.649+0000 7f66d65ad800 20 remove_watcher() i=0 2024-09-12T00:49:23.648 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.649+0000 7f66d65ad800 2 removed watcher, disabling cache 2024-09-12T00:49:23.649 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.650+0000 7f66d65ad800 20 remove_watcher() i=1 2024-09-12T00:49:23.650 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.651+0000 7f66d65ad800 20 remove_watcher() i=2 2024-09-12T00:49:23.651 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.652+0000 7f66d65ad800 20 remove_watcher() i=3 2024-09-12T00:49:23.652 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.653+0000 7f66d65ad800 20 remove_watcher() i=4 2024-09-12T00:49:23.653 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.654+0000 7f66d65ad800 20 remove_watcher() i=5 2024-09-12T00:49:23.654 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.655+0000 7f66d65ad800 20 remove_watcher() i=6 2024-09-12T00:49:23.655 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.656+0000 7f66d65ad800 20 remove_watcher() i=7 2024-09-12T00:49:23.667 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:49:23.696 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:23.696 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:23.733 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.734+0000 7f1c13498800 20 rados->read ofs=0 len=0 2024-09-12T00:49:23.735 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.736+0000 7f1c13498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:23.735 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.736+0000 7f1c13498800 20 realm 2024-09-12T00:49:23.735 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.736+0000 7f1c13498800 20 rados->read ofs=0 len=0 2024-09-12T00:49:23.735 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.736+0000 7f1c13498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:23.736 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.736+0000 7f1c13498800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:23.736 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.736+0000 7f1c13498800 20 rados->read ofs=0 len=0 2024-09-12T00:49:23.736 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.737+0000 7f1c13498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:23.736 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.737+0000 7f1c13498800 20 rados->read ofs=0 len=0 2024-09-12T00:49:23.736 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.738+0000 7f1c13498800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:23.736 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.738+0000 7f1c13498800 20 rados->read ofs=0 len=0 2024-09-12T00:49:23.737 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.738+0000 7f1c13498800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:23.737 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.738+0000 7f1c13498800 20 searching for the correct realm 2024-09-12T00:49:23.739 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.740+0000 7f1c11783640 0 -- 172.21.15.73:0/1030829074 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f1bfc04b070 msgr2=0x7f1bfc08b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:49:23.947 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.948+0000 7f1c11783640 0 -- 172.21.15.73:0/1030829074 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f1bfc04b070 msgr2=0x7f1bfc08b150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:23.951 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.952+0000 7f1c13498800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:49:23.951 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.952+0000 7f1c13498800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:23.951 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.952+0000 7f1c13498800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:49:23.951 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.952+0000 7f1c13498800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:23.951 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.952+0000 7f1c13498800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:23.951 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.952+0000 7f1c13498800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:23.952 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.952+0000 7f1c13498800 20 rados->read ofs=0 len=0 2024-09-12T00:49:23.952 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.952+0000 7f1c13498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:23.952 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.952+0000 7f1c13498800 20 rados->read ofs=0 len=0 2024-09-12T00:49:23.952 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.952+0000 7f1c13498800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:23.952 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.953+0000 7f1c13498800 20 rados->read ofs=0 len=0 2024-09-12T00:49:23.953 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.953+0000 7f1c13498800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:23.953 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.953+0000 7f1c13498800 20 zone default found 2024-09-12T00:49:23.953 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.953+0000 7f1c13498800 4 Realm: () 2024-09-12T00:49:23.953 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.953+0000 7f1c13498800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:49:23.953 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.953+0000 7f1c13498800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:49:23.954 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.953+0000 7f1c13498800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:23.954 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.953+0000 7f1c13498800 20 zonegroup default 2024-09-12T00:49:23.954 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.953+0000 7f1c13498800 20 rados->read ofs=0 len=0 2024-09-12T00:49:23.954 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.953+0000 7f1c13498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:23.954 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.953+0000 7f1c13498800 20 rados->read ofs=0 len=0 2024-09-12T00:49:23.954 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.953+0000 7f1c13498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:23.954 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.953+0000 7f1c13498800 20 rados->read ofs=0 len=0 2024-09-12T00:49:23.954 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.954+0000 7f1c13498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:23.954 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.954+0000 7f1c13498800 20 started sync module instance, tier type = 2024-09-12T00:49:23.954 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.954+0000 7f1c13498800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:49:23.962 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.963+0000 7f1c13498800 20 add_watcher() i=0 2024-09-12T00:49:23.962 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.963+0000 7f1c13498800 20 add_watcher() i=1 2024-09-12T00:49:23.962 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.963+0000 7f1c13498800 20 add_watcher() i=2 2024-09-12T00:49:23.962 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.963+0000 7f1c13498800 20 add_watcher() i=3 2024-09-12T00:49:23.962 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.963+0000 7f1c13498800 20 add_watcher() i=4 2024-09-12T00:49:23.962 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.963+0000 7f1c13498800 20 add_watcher() i=5 2024-09-12T00:49:23.962 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.963+0000 7f1c13498800 20 add_watcher() i=6 2024-09-12T00:49:23.963 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.964+0000 7f1c13498800 20 add_watcher() i=7 2024-09-12T00:49:23.963 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.964+0000 7f1c13498800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:23.964 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.965+0000 7f1ac77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:23.965 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.966+0000 7f1c13498800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:23.966 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.966+0000 7f1c13498800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:23.966 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.966+0000 7f1c13498800 5 note: GC not initialized 2024-09-12T00:49:23.966 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.966+0000 7f1ac67e4640 20 reqs_thread_entry: start 2024-09-12T00:49:23.966 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.966+0000 7f1c13498800 20 init_complete bucket index max shards: 1 2024-09-12T00:49:23.966 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.966+0000 7f1c13498800 20 Filter name: none 2024-09-12T00:49:23.966 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.966+0000 7f1abffff640 20 reqs_thread_entry: start 2024-09-12T00:49:23.966 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.966+0000 7f1c13498800 20 rados->read ofs=0 len=0 2024-09-12T00:49:23.966 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.967+0000 7f1c13498800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:49:23.966 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.967+0000 7f1c13498800 20 rados->read ofs=0 len=0 2024-09-12T00:49:23.967 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.968+0000 7f1c13498800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:49:23.967 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.968+0000 7f1c13498800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:23.967 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.968+0000 7f1c13498800 20 rados->read ofs=0 len=0 2024-09-12T00:49:23.967 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.969+0000 7f1c13498800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:49:23.968 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.969+0000 7f1c13498800 20 rados->read ofs=0 len=0 2024-09-12T00:49:23.968 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.969+0000 7f1c13498800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:49:23.968 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.969+0000 7f1c13498800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:23.969 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.970+0000 7f1ac77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:23.971 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.973+0000 7f1c13498800 20 remove_watcher() i=0 2024-09-12T00:49:23.971 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.973+0000 7f1c13498800 2 removed watcher, disabling cache 2024-09-12T00:49:23.972 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.974+0000 7f1c13498800 20 remove_watcher() i=1 2024-09-12T00:49:23.973 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.975+0000 7f1c13498800 20 remove_watcher() i=2 2024-09-12T00:49:23.974 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.976+0000 7f1c13498800 20 remove_watcher() i=3 2024-09-12T00:49:23.975 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.977+0000 7f1c13498800 20 remove_watcher() i=4 2024-09-12T00:49:23.976 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.978+0000 7f1c13498800 20 remove_watcher() i=5 2024-09-12T00:49:23.977 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.979+0000 7f1c13498800 20 remove_watcher() i=6 2024-09-12T00:49:23.978 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:23.980+0000 7f1c13498800 20 remove_watcher() i=7 2024-09-12T00:49:23.988 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:23.989 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:49:23.989 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: error-at-set-target-layout id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-12T00:49:23.989 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:23.990 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:23.991 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:24.010 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:24.010 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:24.224 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:24.225 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:24.288 INFO:tasks.workunit.client.0.smithi073.stderr:TEST: reshard bucket with abort at set_target_layout 2024-09-12T00:49:24.288 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:24.290 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:24.290 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:24.332 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:24.332 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:24.388 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:24.389 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:24.425 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:24.425 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:24.459 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:24.459 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:24.493 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:24.493 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:24.529 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:24.529 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:24.563 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:24.563 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:24.598 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:24.598 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:24.639 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:24.640 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:24.675 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:24.676 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:24.710 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:24.710 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:24.745 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:24.745 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:24.780 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:24.780 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:24.816 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:24.816 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:24.851 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:24.852 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:24.887 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:24.888 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:24.923 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:24.924 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:24.958 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:24.958 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:24.993 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:24.994 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:25.027 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:25.027 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:25.061 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:25.062 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:25.098 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T00:49:25.125 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:25.126 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:25.363 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.365+0000 7f4161e13800 20 rados->read ofs=0 len=0 2024-09-12T00:49:25.365 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.366+0000 7f4161e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:25.365 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.366+0000 7f4161e13800 20 realm 2024-09-12T00:49:25.365 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.366+0000 7f4161e13800 20 rados->read ofs=0 len=0 2024-09-12T00:49:25.366 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.367+0000 7f4161e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:25.366 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.367+0000 7f4161e13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:25.366 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.367+0000 7f4161e13800 20 rados->read ofs=0 len=0 2024-09-12T00:49:25.366 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.367+0000 7f4161e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:25.366 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.367+0000 7f4161e13800 20 rados->read ofs=0 len=0 2024-09-12T00:49:25.366 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.368+0000 7f4161e13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:25.366 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.368+0000 7f4161e13800 20 rados->read ofs=0 len=0 2024-09-12T00:49:25.367 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.369+0000 7f4161e13800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:25.367 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.369+0000 7f4161e13800 20 searching for the correct realm 2024-09-12T00:49:25.369 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.370+0000 7f4157fff640 0 -- 172.21.15.73:0/4007997155 >> [v2:172.21.15.73:6826/269690776,v1:172.21.15.73:6827/269690776] conn(0x7f415007f040 msgr2=0x7f4150047b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:25.575 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.576+0000 7f415d548640 0 -- 172.21.15.73:0/4007997155 >> [v2:172.21.15.73:6810/1807760270,v1:172.21.15.73:6811/1807760270] conn(0x7f4158066d10 msgr2=0x7f415808c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:25.781 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.782+0000 7f4161e13800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:49:25.781 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.782+0000 7f4161e13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:25.781 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.782+0000 7f4161e13800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:49:25.781 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.782+0000 7f4161e13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:25.781 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.782+0000 7f4161e13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:25.781 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.782+0000 7f4161e13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:25.781 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.782+0000 7f4161e13800 20 rados->read ofs=0 len=0 2024-09-12T00:49:25.781 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.782+0000 7f4161e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:25.781 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.782+0000 7f4161e13800 20 rados->read ofs=0 len=0 2024-09-12T00:49:25.783 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.782+0000 7f4161e13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:25.783 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.782+0000 7f4161e13800 20 rados->read ofs=0 len=0 2024-09-12T00:49:25.783 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.783+0000 7f4161e13800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:25.783 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.783+0000 7f4161e13800 20 zone default found 2024-09-12T00:49:25.783 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.783+0000 7f4161e13800 4 Realm: () 2024-09-12T00:49:25.783 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.783+0000 7f4161e13800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:49:25.783 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.783+0000 7f4161e13800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:49:25.783 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.783+0000 7f4161e13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:25.783 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.783+0000 7f4161e13800 20 zonegroup default 2024-09-12T00:49:25.783 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.783+0000 7f4161e13800 20 rados->read ofs=0 len=0 2024-09-12T00:49:25.783 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.783+0000 7f4161e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:25.783 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.783+0000 7f4161e13800 20 rados->read ofs=0 len=0 2024-09-12T00:49:25.784 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.783+0000 7f4161e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:25.784 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.783+0000 7f4161e13800 20 rados->read ofs=0 len=0 2024-09-12T00:49:25.784 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.783+0000 7f4161e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:25.784 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.783+0000 7f4161e13800 20 started sync module instance, tier type = 2024-09-12T00:49:25.784 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.783+0000 7f4161e13800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:49:25.791 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.793+0000 7f4161e13800 20 add_watcher() i=0 2024-09-12T00:49:25.792 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.793+0000 7f4161e13800 20 add_watcher() i=1 2024-09-12T00:49:25.792 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.793+0000 7f4161e13800 20 add_watcher() i=2 2024-09-12T00:49:25.792 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.793+0000 7f4161e13800 20 add_watcher() i=3 2024-09-12T00:49:25.792 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.793+0000 7f4161e13800 20 add_watcher() i=4 2024-09-12T00:49:25.792 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.793+0000 7f4161e13800 20 add_watcher() i=5 2024-09-12T00:49:25.792 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.793+0000 7f4161e13800 20 add_watcher() i=6 2024-09-12T00:49:25.792 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.794+0000 7f4161e13800 20 add_watcher() i=7 2024-09-12T00:49:25.792 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.794+0000 7f4161e13800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:25.794 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.795+0000 7f4013fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:25.795 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.796+0000 7f4161e13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:25.795 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.796+0000 7f4161e13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:25.795 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.796+0000 7f4161e13800 5 note: GC not initialized 2024-09-12T00:49:25.795 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.796+0000 7f4012fe5640 20 reqs_thread_entry: start 2024-09-12T00:49:25.795 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.796+0000 7f4161e13800 20 init_complete bucket index max shards: 1 2024-09-12T00:49:25.795 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.796+0000 7f4161e13800 20 Filter name: none 2024-09-12T00:49:25.795 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.796+0000 7f4010fe1640 20 reqs_thread_entry: start 2024-09-12T00:49:25.796 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.796+0000 7f4161e13800 20 rados->read ofs=0 len=0 2024-09-12T00:49:25.796 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.797+0000 7f4161e13800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:49:25.796 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.797+0000 7f4161e13800 20 rados->read ofs=0 len=0 2024-09-12T00:49:25.797 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.798+0000 7f4161e13800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:49:25.797 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.798+0000 7f4161e13800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:25.797 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.798+0000 7f4161e13800 20 rados->read ofs=0 len=0 2024-09-12T00:49:25.797 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.798+0000 7f4161e13800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:49:25.797 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.798+0000 7f4161e13800 20 rados->read ofs=0 len=0 2024-09-12T00:49:25.797 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.798+0000 7f4161e13800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:49:25.797 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.798+0000 7f4161e13800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:25.798 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.800+0000 7f4013fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:25.800 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.802+0000 7f4161e13800 20 remove_watcher() i=0 2024-09-12T00:49:25.800 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.802+0000 7f4161e13800 2 removed watcher, disabling cache 2024-09-12T00:49:25.801 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.803+0000 7f4161e13800 20 remove_watcher() i=1 2024-09-12T00:49:25.802 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.804+0000 7f4161e13800 20 remove_watcher() i=2 2024-09-12T00:49:25.804 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.805+0000 7f4161e13800 20 remove_watcher() i=3 2024-09-12T00:49:25.805 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.806+0000 7f4161e13800 20 remove_watcher() i=4 2024-09-12T00:49:25.806 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.807+0000 7f4161e13800 20 remove_watcher() i=5 2024-09-12T00:49:25.807 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.808+0000 7f4161e13800 20 remove_watcher() i=6 2024-09-12T00:49:25.808 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.809+0000 7f4161e13800 20 remove_watcher() i=7 2024-09-12T00:49:25.818 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:25.818 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:49:25.818 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: abort-at-set-target-layout id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:49:25.818 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:25.819 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2024-09-12T00:49:25.853 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:25.853 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:25.890 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.891+0000 7f48bc546800 20 rados->read ofs=0 len=0 2024-09-12T00:49:25.892 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.893+0000 7f48bc546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:25.892 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.893+0000 7f48bc546800 20 realm 2024-09-12T00:49:25.892 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.893+0000 7f48bc546800 20 rados->read ofs=0 len=0 2024-09-12T00:49:25.892 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.893+0000 7f48bc546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:25.892 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.893+0000 7f48bc546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:25.892 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.893+0000 7f48bc546800 20 rados->read ofs=0 len=0 2024-09-12T00:49:25.892 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.893+0000 7f48bc546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:25.893 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.893+0000 7f48bc546800 20 rados->read ofs=0 len=0 2024-09-12T00:49:25.893 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.894+0000 7f48bc546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:25.893 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.894+0000 7f48bc546800 20 rados->read ofs=0 len=0 2024-09-12T00:49:25.894 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.895+0000 7f48bc546800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:25.894 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.895+0000 7f48bc546800 20 searching for the correct realm 2024-09-12T00:49:25.896 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:25.897+0000 7f48ba838640 0 -- 172.21.15.73:0/819594272 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f48b0040030 msgr2=0x7f48b006b2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:49:26.103 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.104+0000 7f48ba838640 0 -- 172.21.15.73:0/819594272 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f48b0040030 msgr2=0x7f48b006b2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:26.107 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.108+0000 7f48bc546800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:49:26.107 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.108+0000 7f48bc546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:26.107 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.108+0000 7f48bc546800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:49:26.107 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.108+0000 7f48bc546800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:26.107 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.108+0000 7f48bc546800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:26.107 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.108+0000 7f48bc546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:26.108 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.108+0000 7f48bc546800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.108 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.108+0000 7f48bc546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:26.108 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.108+0000 7f48bc546800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.109 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.109+0000 7f48bc546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:26.109 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.109+0000 7f48bc546800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.109 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.109+0000 7f48bc546800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:26.109 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.109+0000 7f48bc546800 20 zone default found 2024-09-12T00:49:26.109 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.109+0000 7f48bc546800 4 Realm: () 2024-09-12T00:49:26.109 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.109+0000 7f48bc546800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:49:26.109 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.109+0000 7f48bc546800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:49:26.109 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.109+0000 7f48bc546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:26.109 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.109+0000 7f48bc546800 20 zonegroup default 2024-09-12T00:49:26.110 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.109+0000 7f48bc546800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.110 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.109+0000 7f48bc546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:26.110 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.109+0000 7f48bc546800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.110 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.110+0000 7f48bc546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:26.110 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.110+0000 7f48bc546800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.110 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.110+0000 7f48bc546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:26.110 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.110+0000 7f48bc546800 20 started sync module instance, tier type = 2024-09-12T00:49:26.110 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.110+0000 7f48bc546800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:49:26.121 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.122+0000 7f48bc546800 20 add_watcher() i=0 2024-09-12T00:49:26.121 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.122+0000 7f48bc546800 20 add_watcher() i=1 2024-09-12T00:49:26.121 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.122+0000 7f48bc546800 20 add_watcher() i=2 2024-09-12T00:49:26.121 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.122+0000 7f48bc546800 20 add_watcher() i=3 2024-09-12T00:49:26.121 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.122+0000 7f48bc546800 20 add_watcher() i=4 2024-09-12T00:49:26.121 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.122+0000 7f48bc546800 20 add_watcher() i=5 2024-09-12T00:49:26.121 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.122+0000 7f48bc546800 20 add_watcher() i=6 2024-09-12T00:49:26.122 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.123+0000 7f48bc546800 20 add_watcher() i=7 2024-09-12T00:49:26.122 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.123+0000 7f48bc546800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:26.123 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.124+0000 7f4770fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:26.124 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.125+0000 7f48bc546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:26.124 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.125+0000 7f48bc546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:26.124 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.125+0000 7f48bc546800 5 note: GC not initialized 2024-09-12T00:49:26.124 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.125+0000 7f46eb7fe640 20 reqs_thread_entry: start 2024-09-12T00:49:26.124 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.125+0000 7f48bc546800 20 init_complete bucket index max shards: 1 2024-09-12T00:49:26.124 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.125+0000 7f48bc546800 20 Filter name: none 2024-09-12T00:49:26.124 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.125+0000 7f46e97fa640 20 reqs_thread_entry: start 2024-09-12T00:49:26.124 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.125+0000 7f48bc546800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:49:26.124 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.125+0000 7f48bc546800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.125 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.125+0000 7f48bc546800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:49:26.125 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.125+0000 7f48bc546800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:49:26.125 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.125+0000 7f48bc546800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:49:26.125 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.126+0000 7f48bc546800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24 : miss 2024-09-12T00:49:26.126 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.126+0000 7f48bc546800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.126 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.126+0000 7f48bc546800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:49:26.126 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.126+0000 7f48bc546800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24 info.flags=0x17 2024-09-12T00:49:26.126 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.126+0000 7f48bc546800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24 to cache LRU end 2024-09-12T00:49:26.126 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.126+0000 7f48bc546800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:26.126 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.126+0000 7f48bc546800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:26.126 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.126+0000 7f48bc546800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24 2024-09-12T00:49:26.127 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f48bc546800 time 2024-09-12T00:49:26.129531+0000 2024-09-12T00:49:26.127 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:49:26.128 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:49:26.128 INFO:tasks.workunit.client.0.smithi073.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f48bfb8c71a] 2024-09-12T00:49:26.128 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f48bfb8c8d8] 2024-09-12T00:49:26.128 INFO:tasks.workunit.client.0.smithi073.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55abcdb0b641] 2024-09-12T00:49:26.128 INFO:tasks.workunit.client.0.smithi073.stderr: 4: radosgw-admin(+0xd878e8) [0x55abce01d8e8] 2024-09-12T00:49:26.128 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55abcdb1b31d] 2024-09-12T00:49:26.128 INFO:tasks.workunit.client.0.smithi073.stderr: 6: main() 2024-09-12T00:49:26.128 INFO:tasks.workunit.client.0.smithi073.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f48be829590] 2024-09-12T00:49:26.128 INFO:tasks.workunit.client.0.smithi073.stderr: 8: __libc_start_main() 2024-09-12T00:49:26.128 INFO:tasks.workunit.client.0.smithi073.stderr: 9: _start() 2024-09-12T00:49:26.129 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.129+0000 7f48bc546800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f48bc546800 time 2024-09-12T00:49:26.129531+0000 2024-09-12T00:49:26.129 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:49:26.129 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:26.129 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:49:26.129 INFO:tasks.workunit.client.0.smithi073.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f48bfb8c71a] 2024-09-12T00:49:26.129 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f48bfb8c8d8] 2024-09-12T00:49:26.129 INFO:tasks.workunit.client.0.smithi073.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55abcdb0b641] 2024-09-12T00:49:26.129 INFO:tasks.workunit.client.0.smithi073.stderr: 4: radosgw-admin(+0xd878e8) [0x55abce01d8e8] 2024-09-12T00:49:26.129 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55abcdb1b31d] 2024-09-12T00:49:26.129 INFO:tasks.workunit.client.0.smithi073.stderr: 6: main() 2024-09-12T00:49:26.129 INFO:tasks.workunit.client.0.smithi073.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f48be829590] 2024-09-12T00:49:26.129 INFO:tasks.workunit.client.0.smithi073.stderr: 8: __libc_start_main() 2024-09-12T00:49:26.129 INFO:tasks.workunit.client.0.smithi073.stderr: 9: _start() 2024-09-12T00:49:26.130 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:26.130 INFO:tasks.workunit.client.0.smithi073.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:49:26.130 INFO:tasks.workunit.client.0.smithi073.stderr: in thread 7f48bc546800 thread_name:radosgw-admin 2024-09-12T00:49:26.145 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:49:26.145 INFO:tasks.workunit.client.0.smithi073.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f48be83e6f0] 2024-09-12T00:49:26.145 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f48be88b99c] 2024-09-12T00:49:26.145 INFO:tasks.workunit.client.0.smithi073.stderr: 3: raise() 2024-09-12T00:49:26.145 INFO:tasks.workunit.client.0.smithi073.stderr: 4: abort() 2024-09-12T00:49:26.145 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f48bfb8c774] 2024-09-12T00:49:26.145 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f48bfb8c8d8] 2024-09-12T00:49:26.146 INFO:tasks.workunit.client.0.smithi073.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55abcdb0b641] 2024-09-12T00:49:26.146 INFO:tasks.workunit.client.0.smithi073.stderr: 8: radosgw-admin(+0xd878e8) [0x55abce01d8e8] 2024-09-12T00:49:26.146 INFO:tasks.workunit.client.0.smithi073.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55abcdb1b31d] 2024-09-12T00:49:26.146 INFO:tasks.workunit.client.0.smithi073.stderr: 10: main() 2024-09-12T00:49:26.146 INFO:tasks.workunit.client.0.smithi073.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f48be829590] 2024-09-12T00:49:26.146 INFO:tasks.workunit.client.0.smithi073.stderr: 12: __libc_start_main() 2024-09-12T00:49:26.146 INFO:tasks.workunit.client.0.smithi073.stderr: 13: _start() 2024-09-12T00:49:26.146 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.130+0000 7f48bc546800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:49:26.146 INFO:tasks.workunit.client.0.smithi073.stderr: in thread 7f48bc546800 thread_name:radosgw-admin 2024-09-12T00:49:26.146 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:26.146 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:49:26.146 INFO:tasks.workunit.client.0.smithi073.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f48be83e6f0] 2024-09-12T00:49:26.147 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f48be88b99c] 2024-09-12T00:49:26.147 INFO:tasks.workunit.client.0.smithi073.stderr: 3: raise() 2024-09-12T00:49:26.147 INFO:tasks.workunit.client.0.smithi073.stderr: 4: abort() 2024-09-12T00:49:26.147 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f48bfb8c774] 2024-09-12T00:49:26.147 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f48bfb8c8d8] 2024-09-12T00:49:26.147 INFO:tasks.workunit.client.0.smithi073.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55abcdb0b641] 2024-09-12T00:49:26.147 INFO:tasks.workunit.client.0.smithi073.stderr: 8: radosgw-admin(+0xd878e8) [0x55abce01d8e8] 2024-09-12T00:49:26.147 INFO:tasks.workunit.client.0.smithi073.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55abcdb1b31d] 2024-09-12T00:49:26.147 INFO:tasks.workunit.client.0.smithi073.stderr: 10: main() 2024-09-12T00:49:26.147 INFO:tasks.workunit.client.0.smithi073.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f48be829590] 2024-09-12T00:49:26.147 INFO:tasks.workunit.client.0.smithi073.stderr: 12: __libc_start_main() 2024-09-12T00:49:26.147 INFO:tasks.workunit.client.0.smithi073.stderr: 13: _start() 2024-09-12T00:49:26.147 INFO:tasks.workunit.client.0.smithi073.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:49:26.148 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:26.148 INFO:tasks.workunit.client.0.smithi073.stderr:--- begin dump of recent events --- 2024-09-12T00:49:26.148 INFO:tasks.workunit.client.0.smithi073.stderr: -499> 2024-09-12T00:49:25.873+0000 7f48ba037640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:26.148 INFO:tasks.workunit.client.0.smithi073.stderr: -498> 2024-09-12T00:49:25.873+0000 7f48ba838640 10 monclient(hunting): handle_auth_done global_id 6636 payload 274 2024-09-12T00:49:26.148 INFO:tasks.workunit.client.0.smithi073.stderr: -497> 2024-09-12T00:49:25.873+0000 7f48ba838640 10 monclient: _finish_hunting 0 2024-09-12T00:49:26.148 INFO:tasks.workunit.client.0.smithi073.stderr: -496> 2024-09-12T00:49:25.873+0000 7f48ba838640 1 monclient: found mon.noname-a 2024-09-12T00:49:26.148 INFO:tasks.workunit.client.0.smithi073.stderr: -495> 2024-09-12T00:49:25.873+0000 7f48ba838640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:49:26.148 INFO:tasks.workunit.client.0.smithi073.stderr: -494> 2024-09-12T00:49:25.874+0000 7f47a8608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:26.148 INFO:tasks.workunit.client.0.smithi073.stderr: -493> 2024-09-12T00:49:25.874+0000 7f47a8608640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:49:26.148 INFO:tasks.workunit.client.0.smithi073.stderr: -492> 2024-09-12T00:49:25.874+0000 7f47a8608640 10 monclient: dump: 2024-09-12T00:49:26.148 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:49:26.148 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:49:26.148 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:49:26.149 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:49:26.149 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:26.149 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:49:26.149 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:49:26.149 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:49:26.149 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:49:26.149 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:26.149 INFO:tasks.workunit.client.0.smithi073.stderr: -491> 2024-09-12T00:49:25.874+0000 7f47a8608640 10 monclient: _finish_auth 0 2024-09-12T00:49:26.149 INFO:tasks.workunit.client.0.smithi073.stderr: -490> 2024-09-12T00:49:25.874+0000 7f47a8608640 10 monclient: _check_auth_tickets 2024-09-12T00:49:26.149 INFO:tasks.workunit.client.0.smithi073.stderr: -489> 2024-09-12T00:49:25.874+0000 7f47a8608640 10 monclient: handle_config config(0 keys) 2024-09-12T00:49:26.149 INFO:tasks.workunit.client.0.smithi073.stderr: -488> 2024-09-12T00:49:25.874+0000 7f47a8608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:26.149 INFO:tasks.workunit.client.0.smithi073.stderr: -487> 2024-09-12T00:49:25.874+0000 7f47a8608640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:49:26.149 INFO:tasks.workunit.client.0.smithi073.stderr: -486> 2024-09-12T00:49:25.874+0000 7f47a8608640 10 monclient: dump: 2024-09-12T00:49:26.150 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:49:26.150 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:49:26.150 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:49:26.150 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:49:26.150 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:26.150 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:49:26.150 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:49:26.150 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:49:26.150 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:49:26.150 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:26.150 INFO:tasks.workunit.client.0.smithi073.stderr: -485> 2024-09-12T00:49:25.874+0000 7f48bc546800 5 monclient: authenticate success, global_id 6636 2024-09-12T00:49:26.150 INFO:tasks.workunit.client.0.smithi073.stderr: -484> 2024-09-12T00:49:25.874+0000 7f48bc546800 10 monclient: get_monmap_and_config success 2024-09-12T00:49:26.150 INFO:tasks.workunit.client.0.smithi073.stderr: -483> 2024-09-12T00:49:25.874+0000 7f48bc546800 4 set_mon_vals no callback set 2024-09-12T00:49:26.150 INFO:tasks.workunit.client.0.smithi073.stderr: -482> 2024-09-12T00:49:25.874+0000 7f48bc546800 10 monclient: shutdown 2024-09-12T00:49:26.151 INFO:tasks.workunit.client.0.smithi073.stderr: -481> 2024-09-12T00:49:25.874+0000 7f48bc546800 5 asok(0x55abcfd69630) unregister_commands rotate-key 2024-09-12T00:49:26.151 INFO:tasks.workunit.client.0.smithi073.stderr: -480> 2024-09-12T00:49:25.874+0000 7f48bc546800 10 monclient: build_initial_monmap 2024-09-12T00:49:26.151 INFO:tasks.workunit.client.0.smithi073.stderr: -479> 2024-09-12T00:49:25.874+0000 7f48bc546800 1 build_initial for_mkfs: 0 2024-09-12T00:49:26.151 INFO:tasks.workunit.client.0.smithi073.stderr: -478> 2024-09-12T00:49:25.874+0000 7f48bc546800 10 monclient: monmap: 2024-09-12T00:49:26.151 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:49:26.151 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:49:26.151 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:49:26.151 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:49:26.151 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:49:26.151 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:49:26.151 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:49:26.151 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:49:26.151 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:49:26.151 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:26.152 INFO:tasks.workunit.client.0.smithi073.stderr: -477> 2024-09-12T00:49:25.874+0000 7f48bc546800 5 AuthRegistry(0x55abcff8f4c0) adding auth protocol: cephx 2024-09-12T00:49:26.152 INFO:tasks.workunit.client.0.smithi073.stderr: -476> 2024-09-12T00:49:25.874+0000 7f48bc546800 5 AuthRegistry(0x55abcff8f4c0) adding auth protocol: cephx 2024-09-12T00:49:26.152 INFO:tasks.workunit.client.0.smithi073.stderr: -475> 2024-09-12T00:49:25.874+0000 7f48bc546800 5 AuthRegistry(0x55abcff8f4c0) adding auth protocol: cephx 2024-09-12T00:49:26.152 INFO:tasks.workunit.client.0.smithi073.stderr: -474> 2024-09-12T00:49:25.874+0000 7f48bc546800 5 AuthRegistry(0x55abcff8f4c0) adding con mode: secure 2024-09-12T00:49:26.152 INFO:tasks.workunit.client.0.smithi073.stderr: -473> 2024-09-12T00:49:25.874+0000 7f48bc546800 5 AuthRegistry(0x55abcff8f4c0) adding con mode: crc 2024-09-12T00:49:26.152 INFO:tasks.workunit.client.0.smithi073.stderr: -472> 2024-09-12T00:49:25.874+0000 7f48bc546800 5 AuthRegistry(0x55abcff8f4c0) adding con mode: secure 2024-09-12T00:49:26.152 INFO:tasks.workunit.client.0.smithi073.stderr: -471> 2024-09-12T00:49:25.874+0000 7f48bc546800 5 AuthRegistry(0x55abcff8f4c0) adding con mode: crc 2024-09-12T00:49:26.152 INFO:tasks.workunit.client.0.smithi073.stderr: -470> 2024-09-12T00:49:25.874+0000 7f48bc546800 5 AuthRegistry(0x55abcff8f4c0) adding con mode: secure 2024-09-12T00:49:26.152 INFO:tasks.workunit.client.0.smithi073.stderr: -469> 2024-09-12T00:49:25.874+0000 7f48bc546800 5 AuthRegistry(0x55abcff8f4c0) adding con mode: crc 2024-09-12T00:49:26.152 INFO:tasks.workunit.client.0.smithi073.stderr: -468> 2024-09-12T00:49:25.874+0000 7f48bc546800 5 AuthRegistry(0x55abcff8f4c0) adding con mode: crc 2024-09-12T00:49:26.152 INFO:tasks.workunit.client.0.smithi073.stderr: -467> 2024-09-12T00:49:25.874+0000 7f48bc546800 5 AuthRegistry(0x55abcff8f4c0) adding con mode: secure 2024-09-12T00:49:26.152 INFO:tasks.workunit.client.0.smithi073.stderr: -466> 2024-09-12T00:49:25.874+0000 7f48bc546800 5 AuthRegistry(0x55abcff8f4c0) adding con mode: crc 2024-09-12T00:49:26.152 INFO:tasks.workunit.client.0.smithi073.stderr: -465> 2024-09-12T00:49:25.874+0000 7f48bc546800 5 AuthRegistry(0x55abcff8f4c0) adding con mode: secure 2024-09-12T00:49:26.153 INFO:tasks.workunit.client.0.smithi073.stderr: -464> 2024-09-12T00:49:25.874+0000 7f48bc546800 5 AuthRegistry(0x55abcff8f4c0) adding con mode: crc 2024-09-12T00:49:26.153 INFO:tasks.workunit.client.0.smithi073.stderr: -463> 2024-09-12T00:49:25.874+0000 7f48bc546800 5 AuthRegistry(0x55abcff8f4c0) adding con mode: secure 2024-09-12T00:49:26.153 INFO:tasks.workunit.client.0.smithi073.stderr: -462> 2024-09-12T00:49:25.875+0000 7f48bc546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:26.153 INFO:tasks.workunit.client.0.smithi073.stderr: -461> 2024-09-12T00:49:25.875+0000 7f48bc546800 1 librados: starting msgr at 2024-09-12T00:49:26.153 INFO:tasks.workunit.client.0.smithi073.stderr: -460> 2024-09-12T00:49:25.875+0000 7f48bc546800 1 librados: starting objecter 2024-09-12T00:49:26.153 INFO:tasks.workunit.client.0.smithi073.stderr: -459> 2024-09-12T00:49:25.875+0000 7f48bc546800 5 asok(0x55abcfd69630) register_command objecter_requests hook 0x55abcffb3e10 2024-09-12T00:49:26.153 INFO:tasks.workunit.client.0.smithi073.stderr: -458> 2024-09-12T00:49:25.875+0000 7f48bc546800 1 librados: setting wanted keys 2024-09-12T00:49:26.153 INFO:tasks.workunit.client.0.smithi073.stderr: -457> 2024-09-12T00:49:25.875+0000 7f48bc546800 1 librados: calling monclient init 2024-09-12T00:49:26.153 INFO:tasks.workunit.client.0.smithi073.stderr: -456> 2024-09-12T00:49:25.875+0000 7f48bc546800 10 monclient: init 2024-09-12T00:49:26.153 INFO:tasks.workunit.client.0.smithi073.stderr: -455> 2024-09-12T00:49:25.875+0000 7f48bc546800 5 AuthRegistry(0x55abcff898e0) adding auth protocol: cephx 2024-09-12T00:49:26.153 INFO:tasks.workunit.client.0.smithi073.stderr: -454> 2024-09-12T00:49:25.875+0000 7f48bc546800 5 AuthRegistry(0x55abcff898e0) adding auth protocol: cephx 2024-09-12T00:49:26.153 INFO:tasks.workunit.client.0.smithi073.stderr: -453> 2024-09-12T00:49:25.875+0000 7f48bc546800 5 AuthRegistry(0x55abcff898e0) adding auth protocol: cephx 2024-09-12T00:49:26.153 INFO:tasks.workunit.client.0.smithi073.stderr: -452> 2024-09-12T00:49:25.875+0000 7f48bc546800 5 AuthRegistry(0x55abcff898e0) adding con mode: secure 2024-09-12T00:49:26.154 INFO:tasks.workunit.client.0.smithi073.stderr: -451> 2024-09-12T00:49:25.875+0000 7f48bc546800 5 AuthRegistry(0x55abcff898e0) adding con mode: crc 2024-09-12T00:49:26.154 INFO:tasks.workunit.client.0.smithi073.stderr: -450> 2024-09-12T00:49:25.875+0000 7f48bc546800 5 AuthRegistry(0x55abcff898e0) adding con mode: secure 2024-09-12T00:49:26.154 INFO:tasks.workunit.client.0.smithi073.stderr: -449> 2024-09-12T00:49:25.875+0000 7f48bc546800 5 AuthRegistry(0x55abcff898e0) adding con mode: crc 2024-09-12T00:49:26.154 INFO:tasks.workunit.client.0.smithi073.stderr: -448> 2024-09-12T00:49:25.875+0000 7f48bc546800 5 AuthRegistry(0x55abcff898e0) adding con mode: secure 2024-09-12T00:49:26.154 INFO:tasks.workunit.client.0.smithi073.stderr: -447> 2024-09-12T00:49:25.875+0000 7f48bc546800 5 AuthRegistry(0x55abcff898e0) adding con mode: crc 2024-09-12T00:49:26.154 INFO:tasks.workunit.client.0.smithi073.stderr: -446> 2024-09-12T00:49:25.875+0000 7f48bc546800 5 AuthRegistry(0x55abcff898e0) adding con mode: crc 2024-09-12T00:49:26.154 INFO:tasks.workunit.client.0.smithi073.stderr: -445> 2024-09-12T00:49:25.875+0000 7f48bc546800 5 AuthRegistry(0x55abcff898e0) adding con mode: secure 2024-09-12T00:49:26.154 INFO:tasks.workunit.client.0.smithi073.stderr: -444> 2024-09-12T00:49:25.875+0000 7f48bc546800 5 AuthRegistry(0x55abcff898e0) adding con mode: crc 2024-09-12T00:49:26.154 INFO:tasks.workunit.client.0.smithi073.stderr: -443> 2024-09-12T00:49:25.875+0000 7f48bc546800 5 AuthRegistry(0x55abcff898e0) adding con mode: secure 2024-09-12T00:49:26.154 INFO:tasks.workunit.client.0.smithi073.stderr: -442> 2024-09-12T00:49:25.875+0000 7f48bc546800 5 AuthRegistry(0x55abcff898e0) adding con mode: crc 2024-09-12T00:49:26.154 INFO:tasks.workunit.client.0.smithi073.stderr: -441> 2024-09-12T00:49:25.875+0000 7f48bc546800 5 AuthRegistry(0x55abcff898e0) adding con mode: secure 2024-09-12T00:49:26.154 INFO:tasks.workunit.client.0.smithi073.stderr: -440> 2024-09-12T00:49:25.875+0000 7f48bc546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:26.154 INFO:tasks.workunit.client.0.smithi073.stderr: -439> 2024-09-12T00:49:25.875+0000 7f48bc546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:26.155 INFO:tasks.workunit.client.0.smithi073.stderr: -438> 2024-09-12T00:49:25.875+0000 7f48bc546800 5 asok(0x55abcfd69630) register_command rotate-key hook 0x55abcff89a28 2024-09-12T00:49:26.155 INFO:tasks.workunit.client.0.smithi073.stderr: -437> 2024-09-12T00:49:25.875+0000 7f48bc546800 10 monclient: _reopen_session rank -1 2024-09-12T00:49:26.155 INFO:tasks.workunit.client.0.smithi073.stderr: -436> 2024-09-12T00:49:25.875+0000 7f48bc546800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:49:26.155 INFO:tasks.workunit.client.0.smithi073.stderr: -435> 2024-09-12T00:49:25.875+0000 7f48bc546800 10 monclient(hunting): picked mon.noname-c con 0x55abcfe41da0 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:49:26.155 INFO:tasks.workunit.client.0.smithi073.stderr: -434> 2024-09-12T00:49:25.875+0000 7f48bc546800 10 monclient(hunting): picked mon.noname-b con 0x55abcfecf690 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:49:26.155 INFO:tasks.workunit.client.0.smithi073.stderr: -433> 2024-09-12T00:49:25.875+0000 7f48bc546800 10 monclient(hunting): picked mon.noname-a con 0x55abcfed7f90 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:49:26.155 INFO:tasks.workunit.client.0.smithi073.stderr: -432> 2024-09-12T00:49:25.875+0000 7f48bc546800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:26.155 INFO:tasks.workunit.client.0.smithi073.stderr: -431> 2024-09-12T00:49:25.875+0000 7f48bc546800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:26.155 INFO:tasks.workunit.client.0.smithi073.stderr: -430> 2024-09-12T00:49:25.875+0000 7f48bc546800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:26.155 INFO:tasks.workunit.client.0.smithi073.stderr: -429> 2024-09-12T00:49:25.875+0000 7f48bc546800 10 monclient(hunting): _renew_subs 2024-09-12T00:49:26.155 INFO:tasks.workunit.client.0.smithi073.stderr: -428> 2024-09-12T00:49:25.875+0000 7f48bc546800 10 monclient(hunting): authenticate will time out at 2026.545906s 2024-09-12T00:49:26.155 INFO:tasks.workunit.client.0.smithi073.stderr: -427> 2024-09-12T00:49:25.875+0000 7f48ba037640 10 monclient(hunting): get_auth_request con 0x55abcfe41da0 auth_method 0 2024-09-12T00:49:26.155 INFO:tasks.workunit.client.0.smithi073.stderr: -426> 2024-09-12T00:49:25.876+0000 7f48ba037640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:26.155 INFO:tasks.workunit.client.0.smithi073.stderr: -425> 2024-09-12T00:49:25.876+0000 7f48ba037640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:26.156 INFO:tasks.workunit.client.0.smithi073.stderr: -424> 2024-09-12T00:49:25.876+0000 7f48ba037640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:26.156 INFO:tasks.workunit.client.0.smithi073.stderr: -423> 2024-09-12T00:49:25.876+0000 7f48ba838640 10 monclient(hunting): get_auth_request con 0x55abcfed7f90 auth_method 0 2024-09-12T00:49:26.156 INFO:tasks.workunit.client.0.smithi073.stderr: -422> 2024-09-12T00:49:25.876+0000 7f48ba838640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:26.156 INFO:tasks.workunit.client.0.smithi073.stderr: -421> 2024-09-12T00:49:25.876+0000 7f48ba838640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:26.156 INFO:tasks.workunit.client.0.smithi073.stderr: -420> 2024-09-12T00:49:25.876+0000 7f48ba838640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:26.156 INFO:tasks.workunit.client.0.smithi073.stderr: -419> 2024-09-12T00:49:25.876+0000 7f48ba037640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:26.156 INFO:tasks.workunit.client.0.smithi073.stderr: -418> 2024-09-12T00:49:25.876+0000 7f48ba037640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:26.156 INFO:tasks.workunit.client.0.smithi073.stderr: -417> 2024-09-12T00:49:25.876+0000 7f48ba037640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:26.156 INFO:tasks.workunit.client.0.smithi073.stderr: -416> 2024-09-12T00:49:25.876+0000 7f48ba838640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:26.156 INFO:tasks.workunit.client.0.smithi073.stderr: -415> 2024-09-12T00:49:25.876+0000 7f48ba838640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:26.156 INFO:tasks.workunit.client.0.smithi073.stderr: -414> 2024-09-12T00:49:25.876+0000 7f48ba838640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:26.156 INFO:tasks.workunit.client.0.smithi073.stderr: -413> 2024-09-12T00:49:25.876+0000 7f48b9836640 10 monclient(hunting): get_auth_request con 0x55abcfecf690 auth_method 0 2024-09-12T00:49:26.156 INFO:tasks.workunit.client.0.smithi073.stderr: -412> 2024-09-12T00:49:25.876+0000 7f48b9836640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:26.157 INFO:tasks.workunit.client.0.smithi073.stderr: -411> 2024-09-12T00:49:25.876+0000 7f48b9836640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:26.157 INFO:tasks.workunit.client.0.smithi073.stderr: -410> 2024-09-12T00:49:25.876+0000 7f48b9836640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:26.157 INFO:tasks.workunit.client.0.smithi073.stderr: -409> 2024-09-12T00:49:25.876+0000 7f48ba037640 10 monclient(hunting): handle_auth_done global_id 6299 payload 824 2024-09-12T00:49:26.157 INFO:tasks.workunit.client.0.smithi073.stderr: -408> 2024-09-12T00:49:25.876+0000 7f48ba037640 10 monclient: _finish_hunting 0 2024-09-12T00:49:26.157 INFO:tasks.workunit.client.0.smithi073.stderr: -407> 2024-09-12T00:49:25.876+0000 7f48ba037640 1 monclient: found mon.noname-c 2024-09-12T00:49:26.157 INFO:tasks.workunit.client.0.smithi073.stderr: -406> 2024-09-12T00:49:25.876+0000 7f48ba037640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.73:3301/0 2024-09-12T00:49:26.157 INFO:tasks.workunit.client.0.smithi073.stderr: -405> 2024-09-12T00:49:25.876+0000 7f47a6e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:26.157 INFO:tasks.workunit.client.0.smithi073.stderr: -404> 2024-09-12T00:49:25.876+0000 7f47a6e05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:49:26.157 INFO:tasks.workunit.client.0.smithi073.stderr: -403> 2024-09-12T00:49:25.876+0000 7f47a6e05640 10 monclient: dump: 2024-09-12T00:49:26.157 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:49:26.157 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:49:26.157 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:49:26.157 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:49:26.158 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:26.158 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:49:26.158 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:49:26.158 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:49:26.158 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:49:26.158 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:26.158 INFO:tasks.workunit.client.0.smithi073.stderr: -402> 2024-09-12T00:49:25.876+0000 7f47a6e05640 10 monclient: _finish_auth 0 2024-09-12T00:49:26.158 INFO:tasks.workunit.client.0.smithi073.stderr: -401> 2024-09-12T00:49:25.876+0000 7f47a6e05640 10 monclient: _check_auth_tickets 2024-09-12T00:49:26.158 INFO:tasks.workunit.client.0.smithi073.stderr: -400> 2024-09-12T00:49:25.876+0000 7f47a6e05640 10 monclient: handle_config config(0 keys) 2024-09-12T00:49:26.158 INFO:tasks.workunit.client.0.smithi073.stderr: -399> 2024-09-12T00:49:25.876+0000 7f47a6e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:26.158 INFO:tasks.workunit.client.0.smithi073.stderr: -398> 2024-09-12T00:49:25.876+0000 7f47a6e05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:49:26.158 INFO:tasks.workunit.client.0.smithi073.stderr: -397> 2024-09-12T00:49:25.876+0000 7f47a6e05640 10 monclient: dump: 2024-09-12T00:49:26.158 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:49:26.158 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:49:26.159 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:49:26.159 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:49:26.159 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:26.159 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:49:26.159 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:49:26.159 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:49:26.159 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:49:26.159 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:26.159 INFO:tasks.workunit.client.0.smithi073.stderr: -396> 2024-09-12T00:49:25.876+0000 7f48bc546800 5 monclient: authenticate success, global_id 6299 2024-09-12T00:49:26.159 INFO:tasks.workunit.client.0.smithi073.stderr: -395> 2024-09-12T00:49:25.876+0000 7f48bc546800 10 monclient: _renew_subs 2024-09-12T00:49:26.159 INFO:tasks.workunit.client.0.smithi073.stderr: -394> 2024-09-12T00:49:25.876+0000 7f48bc546800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:49:26.159 INFO:tasks.workunit.client.0.smithi073.stderr: -393> 2024-09-12T00:49:25.876+0000 7f47a8608640 4 set_mon_vals no callback set 2024-09-12T00:49:26.159 INFO:tasks.workunit.client.0.smithi073.stderr: -392> 2024-09-12T00:49:25.876+0000 7f48bc546800 10 monclient: _renew_subs 2024-09-12T00:49:26.159 INFO:tasks.workunit.client.0.smithi073.stderr: -391> 2024-09-12T00:49:25.876+0000 7f48bc546800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:49:26.160 INFO:tasks.workunit.client.0.smithi073.stderr: -390> 2024-09-12T00:49:25.876+0000 7f48bc546800 1 librados: init done 2024-09-12T00:49:26.160 INFO:tasks.workunit.client.0.smithi073.stderr: -389> 2024-09-12T00:49:25.878+0000 7f47a6e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:49:26.160 INFO:tasks.workunit.client.0.smithi073.stderr: -388> 2024-09-12T00:49:25.878+0000 7f47a6e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:49:26.160 INFO:tasks.workunit.client.0.smithi073.stderr: -387> 2024-09-12T00:49:25.878+0000 7f47a6e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:49:26.160 INFO:tasks.workunit.client.0.smithi073.stderr: -386> 2024-09-12T00:49:25.878+0000 7f48b9836640 10 monclient: get_auth_request con 0x7f47a0076470 auth_method 0 2024-09-12T00:49:26.160 INFO:tasks.workunit.client.0.smithi073.stderr: -385> 2024-09-12T00:49:25.878+0000 7f48ba838640 10 monclient: get_auth_request con 0x55abcffb2b10 auth_method 0 2024-09-12T00:49:26.160 INFO:tasks.workunit.client.0.smithi073.stderr: -384> 2024-09-12T00:49:25.879+0000 7f48ba037640 10 monclient: get_auth_request con 0x55abcffd52e0 auth_method 0 2024-09-12T00:49:26.160 INFO:tasks.workunit.client.0.smithi073.stderr: -383> 2024-09-12T00:49:25.880+0000 7f48b9836640 10 monclient: get_auth_request con 0x55abcffd9690 auth_method 0 2024-09-12T00:49:26.160 INFO:tasks.workunit.client.0.smithi073.stderr: -382> 2024-09-12T00:49:25.882+0000 7f48bc546800 10 monclient: build_initial_monmap 2024-09-12T00:49:26.160 INFO:tasks.workunit.client.0.smithi073.stderr: -381> 2024-09-12T00:49:25.882+0000 7f48bc546800 1 build_initial for_mkfs: 0 2024-09-12T00:49:26.160 INFO:tasks.workunit.client.0.smithi073.stderr: -380> 2024-09-12T00:49:25.882+0000 7f48bc546800 10 monclient: monmap: 2024-09-12T00:49:26.160 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:49:26.162 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:49:26.162 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:49:26.162 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:49:26.162 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:49:26.162 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:49:26.162 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:49:26.162 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:49:26.162 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:49:26.162 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:26.162 INFO:tasks.workunit.client.0.smithi073.stderr: -379> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffde550) adding auth protocol: cephx 2024-09-12T00:49:26.162 INFO:tasks.workunit.client.0.smithi073.stderr: -378> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffde550) adding auth protocol: cephx 2024-09-12T00:49:26.163 INFO:tasks.workunit.client.0.smithi073.stderr: -377> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffde550) adding auth protocol: cephx 2024-09-12T00:49:26.163 INFO:tasks.workunit.client.0.smithi073.stderr: -376> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffde550) adding con mode: secure 2024-09-12T00:49:26.163 INFO:tasks.workunit.client.0.smithi073.stderr: -375> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffde550) adding con mode: crc 2024-09-12T00:49:26.163 INFO:tasks.workunit.client.0.smithi073.stderr: -374> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffde550) adding con mode: secure 2024-09-12T00:49:26.163 INFO:tasks.workunit.client.0.smithi073.stderr: -373> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffde550) adding con mode: crc 2024-09-12T00:49:26.163 INFO:tasks.workunit.client.0.smithi073.stderr: -372> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffde550) adding con mode: secure 2024-09-12T00:49:26.163 INFO:tasks.workunit.client.0.smithi073.stderr: -371> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffde550) adding con mode: crc 2024-09-12T00:49:26.163 INFO:tasks.workunit.client.0.smithi073.stderr: -370> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffde550) adding con mode: crc 2024-09-12T00:49:26.163 INFO:tasks.workunit.client.0.smithi073.stderr: -369> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffde550) adding con mode: secure 2024-09-12T00:49:26.163 INFO:tasks.workunit.client.0.smithi073.stderr: -368> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffde550) adding con mode: crc 2024-09-12T00:49:26.163 INFO:tasks.workunit.client.0.smithi073.stderr: -367> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffde550) adding con mode: secure 2024-09-12T00:49:26.163 INFO:tasks.workunit.client.0.smithi073.stderr: -366> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffde550) adding con mode: crc 2024-09-12T00:49:26.163 INFO:tasks.workunit.client.0.smithi073.stderr: -365> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffde550) adding con mode: secure 2024-09-12T00:49:26.164 INFO:tasks.workunit.client.0.smithi073.stderr: -364> 2024-09-12T00:49:25.882+0000 7f48bc546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:26.164 INFO:tasks.workunit.client.0.smithi073.stderr: -363> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 asok(0x55abcfd69630) register_command objecter_requests cmddesc objecter_requests hook 0x55abcffe1f60 EEXIST 2024-09-12T00:49:26.164 INFO:tasks.workunit.client.0.smithi073.stderr: -362> 2024-09-12T00:49:25.882+0000 7f48bc546800 10 monclient: init 2024-09-12T00:49:26.164 INFO:tasks.workunit.client.0.smithi073.stderr: -361> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffdcc28) adding auth protocol: cephx 2024-09-12T00:49:26.164 INFO:tasks.workunit.client.0.smithi073.stderr: -360> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffdcc28) adding auth protocol: cephx 2024-09-12T00:49:26.164 INFO:tasks.workunit.client.0.smithi073.stderr: -359> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffdcc28) adding auth protocol: cephx 2024-09-12T00:49:26.164 INFO:tasks.workunit.client.0.smithi073.stderr: -358> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffdcc28) adding con mode: secure 2024-09-12T00:49:26.164 INFO:tasks.workunit.client.0.smithi073.stderr: -357> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffdcc28) adding con mode: crc 2024-09-12T00:49:26.164 INFO:tasks.workunit.client.0.smithi073.stderr: -356> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffdcc28) adding con mode: secure 2024-09-12T00:49:26.164 INFO:tasks.workunit.client.0.smithi073.stderr: -355> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffdcc28) adding con mode: crc 2024-09-12T00:49:26.164 INFO:tasks.workunit.client.0.smithi073.stderr: -354> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffdcc28) adding con mode: secure 2024-09-12T00:49:26.164 INFO:tasks.workunit.client.0.smithi073.stderr: -353> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffdcc28) adding con mode: crc 2024-09-12T00:49:26.164 INFO:tasks.workunit.client.0.smithi073.stderr: -352> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffdcc28) adding con mode: crc 2024-09-12T00:49:26.165 INFO:tasks.workunit.client.0.smithi073.stderr: -351> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffdcc28) adding con mode: secure 2024-09-12T00:49:26.165 INFO:tasks.workunit.client.0.smithi073.stderr: -350> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffdcc28) adding con mode: crc 2024-09-12T00:49:26.165 INFO:tasks.workunit.client.0.smithi073.stderr: -349> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffdcc28) adding con mode: secure 2024-09-12T00:49:26.165 INFO:tasks.workunit.client.0.smithi073.stderr: -348> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffdcc28) adding con mode: crc 2024-09-12T00:49:26.165 INFO:tasks.workunit.client.0.smithi073.stderr: -347> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffdcc28) adding con mode: secure 2024-09-12T00:49:26.165 INFO:tasks.workunit.client.0.smithi073.stderr: -346> 2024-09-12T00:49:25.882+0000 7f48bc546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:26.165 INFO:tasks.workunit.client.0.smithi073.stderr: -345> 2024-09-12T00:49:25.883+0000 7f48bc546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:26.165 INFO:tasks.workunit.client.0.smithi073.stderr: -344> 2024-09-12T00:49:25.883+0000 7f48bc546800 5 asok(0x55abcfd69630) register_command rotate-key cmddesc rotate-key hook 0x55abcffdcd70 EEXIST 2024-09-12T00:49:26.165 INFO:tasks.workunit.client.0.smithi073.stderr: -343> 2024-09-12T00:49:25.883+0000 7f48bc546800 10 monclient: _reopen_session rank -1 2024-09-12T00:49:26.165 INFO:tasks.workunit.client.0.smithi073.stderr: -342> 2024-09-12T00:49:25.883+0000 7f48bc546800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:49:26.165 INFO:tasks.workunit.client.0.smithi073.stderr: -341> 2024-09-12T00:49:25.883+0000 7f48bc546800 10 monclient(hunting): picked mon.noname-c con 0x55abd0005c50 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:49:26.165 INFO:tasks.workunit.client.0.smithi073.stderr: -340> 2024-09-12T00:49:25.883+0000 7f48bc546800 10 monclient(hunting): picked mon.noname-a con 0x55abd0007f20 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:49:26.165 INFO:tasks.workunit.client.0.smithi073.stderr: -339> 2024-09-12T00:49:25.883+0000 7f48bc546800 10 monclient(hunting): picked mon.noname-b con 0x55abd0004420 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:49:26.165 INFO:tasks.workunit.client.0.smithi073.stderr: -338> 2024-09-12T00:49:25.883+0000 7f48bc546800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:26.166 INFO:tasks.workunit.client.0.smithi073.stderr: -337> 2024-09-12T00:49:25.883+0000 7f48bc546800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:26.166 INFO:tasks.workunit.client.0.smithi073.stderr: -336> 2024-09-12T00:49:25.883+0000 7f48bc546800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:26.166 INFO:tasks.workunit.client.0.smithi073.stderr: -335> 2024-09-12T00:49:25.883+0000 7f48bc546800 10 monclient(hunting): _renew_subs 2024-09-12T00:49:26.166 INFO:tasks.workunit.client.0.smithi073.stderr: -334> 2024-09-12T00:49:25.883+0000 7f48bc546800 10 monclient(hunting): authenticate will time out at 2026.553277s 2024-09-12T00:49:26.166 INFO:tasks.workunit.client.0.smithi073.stderr: -333> 2024-09-12T00:49:25.883+0000 7f48ba037640 10 monclient(hunting): get_auth_request con 0x55abd0005c50 auth_method 0 2024-09-12T00:49:26.166 INFO:tasks.workunit.client.0.smithi073.stderr: -332> 2024-09-12T00:49:25.883+0000 7f48ba037640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:26.166 INFO:tasks.workunit.client.0.smithi073.stderr: -331> 2024-09-12T00:49:25.883+0000 7f48ba037640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:26.166 INFO:tasks.workunit.client.0.smithi073.stderr: -330> 2024-09-12T00:49:25.883+0000 7f48ba037640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:26.166 INFO:tasks.workunit.client.0.smithi073.stderr: -329> 2024-09-12T00:49:25.883+0000 7f48b9836640 10 monclient(hunting): get_auth_request con 0x55abd0007f20 auth_method 0 2024-09-12T00:49:26.166 INFO:tasks.workunit.client.0.smithi073.stderr: -328> 2024-09-12T00:49:25.883+0000 7f48b9836640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:26.166 INFO:tasks.workunit.client.0.smithi073.stderr: -327> 2024-09-12T00:49:25.883+0000 7f48b9836640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:26.166 INFO:tasks.workunit.client.0.smithi073.stderr: -326> 2024-09-12T00:49:25.883+0000 7f48b9836640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:26.166 INFO:tasks.workunit.client.0.smithi073.stderr: -325> 2024-09-12T00:49:25.883+0000 7f48ba037640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:26.167 INFO:tasks.workunit.client.0.smithi073.stderr: -324> 2024-09-12T00:49:25.883+0000 7f48ba037640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:26.167 INFO:tasks.workunit.client.0.smithi073.stderr: -323> 2024-09-12T00:49:25.883+0000 7f48ba037640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:26.167 INFO:tasks.workunit.client.0.smithi073.stderr: -322> 2024-09-12T00:49:25.883+0000 7f48b9836640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:26.167 INFO:tasks.workunit.client.0.smithi073.stderr: -321> 2024-09-12T00:49:25.883+0000 7f48b9836640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:26.167 INFO:tasks.workunit.client.0.smithi073.stderr: -320> 2024-09-12T00:49:25.883+0000 7f48b9836640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:26.167 INFO:tasks.workunit.client.0.smithi073.stderr: -319> 2024-09-12T00:49:25.883+0000 7f48ba838640 10 monclient(hunting): get_auth_request con 0x55abd0004420 auth_method 0 2024-09-12T00:49:26.167 INFO:tasks.workunit.client.0.smithi073.stderr: -318> 2024-09-12T00:49:25.883+0000 7f48ba838640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:26.167 INFO:tasks.workunit.client.0.smithi073.stderr: -317> 2024-09-12T00:49:25.883+0000 7f48ba838640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:26.167 INFO:tasks.workunit.client.0.smithi073.stderr: -316> 2024-09-12T00:49:25.883+0000 7f48ba838640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:26.167 INFO:tasks.workunit.client.0.smithi073.stderr: -315> 2024-09-12T00:49:25.883+0000 7f48ba037640 10 monclient(hunting): handle_auth_done global_id 6302 payload 824 2024-09-12T00:49:26.167 INFO:tasks.workunit.client.0.smithi073.stderr: -314> 2024-09-12T00:49:25.883+0000 7f48ba037640 10 monclient: _finish_hunting 0 2024-09-12T00:49:26.167 INFO:tasks.workunit.client.0.smithi073.stderr: -313> 2024-09-12T00:49:25.883+0000 7f48ba037640 1 monclient: found mon.noname-c 2024-09-12T00:49:26.167 INFO:tasks.workunit.client.0.smithi073.stderr: -312> 2024-09-12T00:49:25.883+0000 7f48ba037640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.73:3301/0 2024-09-12T00:49:26.168 INFO:tasks.workunit.client.0.smithi073.stderr: -311> 2024-09-12T00:49:25.883+0000 7f479ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:26.168 INFO:tasks.workunit.client.0.smithi073.stderr: -310> 2024-09-12T00:49:25.883+0000 7f479ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:49:26.168 INFO:tasks.workunit.client.0.smithi073.stderr: -309> 2024-09-12T00:49:25.883+0000 7f479ffff640 10 monclient: dump: 2024-09-12T00:49:26.168 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:49:26.168 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:49:26.168 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:49:26.168 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:49:26.168 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:26.168 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:49:26.168 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:49:26.168 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:49:26.168 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:49:26.168 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:26.169 INFO:tasks.workunit.client.0.smithi073.stderr: -308> 2024-09-12T00:49:25.883+0000 7f479ffff640 10 monclient: _finish_auth 0 2024-09-12T00:49:26.169 INFO:tasks.workunit.client.0.smithi073.stderr: -307> 2024-09-12T00:49:25.883+0000 7f479ffff640 10 monclient: _check_auth_tickets 2024-09-12T00:49:26.169 INFO:tasks.workunit.client.0.smithi073.stderr: -306> 2024-09-12T00:49:25.883+0000 7f479ffff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:49:26.169 INFO:tasks.workunit.client.0.smithi073.stderr: -305> 2024-09-12T00:49:25.883+0000 7f479ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:26.169 INFO:tasks.workunit.client.0.smithi073.stderr: -304> 2024-09-12T00:49:25.883+0000 7f479ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:49:26.169 INFO:tasks.workunit.client.0.smithi073.stderr: -303> 2024-09-12T00:49:25.883+0000 7f479ffff640 10 monclient: dump: 2024-09-12T00:49:26.169 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:49:26.169 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:49:26.169 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:49:26.169 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:49:26.169 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:26.169 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:49:26.169 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:49:26.170 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:49:26.170 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:49:26.170 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:26.170 INFO:tasks.workunit.client.0.smithi073.stderr: -302> 2024-09-12T00:49:25.883+0000 7f48bc546800 5 monclient: authenticate success, global_id 6302 2024-09-12T00:49:26.170 INFO:tasks.workunit.client.0.smithi073.stderr: -301> 2024-09-12T00:49:25.883+0000 7f48bb039640 4 set_mon_vals no callback set 2024-09-12T00:49:26.170 INFO:tasks.workunit.client.0.smithi073.stderr: -300> 2024-09-12T00:49:25.883+0000 7f48bc546800 10 monclient: _renew_subs 2024-09-12T00:49:26.170 INFO:tasks.workunit.client.0.smithi073.stderr: -299> 2024-09-12T00:49:25.883+0000 7f48bc546800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:49:26.170 INFO:tasks.workunit.client.0.smithi073.stderr: -298> 2024-09-12T00:49:25.883+0000 7f48bc546800 10 monclient: _renew_subs 2024-09-12T00:49:26.170 INFO:tasks.workunit.client.0.smithi073.stderr: -297> 2024-09-12T00:49:25.883+0000 7f48bc546800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:49:26.170 INFO:tasks.workunit.client.0.smithi073.stderr: -296> 2024-09-12T00:49:25.885+0000 7f479ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:49:26.170 INFO:tasks.workunit.client.0.smithi073.stderr: -295> 2024-09-12T00:49:25.885+0000 7f479ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:49:26.170 INFO:tasks.workunit.client.0.smithi073.stderr: -294> 2024-09-12T00:49:25.885+0000 7f479ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:49:26.170 INFO:tasks.workunit.client.0.smithi073.stderr: -293> 2024-09-12T00:49:25.885+0000 7f48b9836640 10 monclient: get_auth_request con 0x7f4794076380 auth_method 0 2024-09-12T00:49:26.170 INFO:tasks.workunit.client.0.smithi073.stderr: -292> 2024-09-12T00:49:25.885+0000 7f48bc546800 10 monclient: get_monmap_and_config 2024-09-12T00:49:26.171 INFO:tasks.workunit.client.0.smithi073.stderr: -291> 2024-09-12T00:49:25.885+0000 7f48bc546800 10 monclient: build_initial_monmap 2024-09-12T00:49:26.171 INFO:tasks.workunit.client.0.smithi073.stderr: -290> 2024-09-12T00:49:25.885+0000 7f48bc546800 1 build_initial for_mkfs: 0 2024-09-12T00:49:26.171 INFO:tasks.workunit.client.0.smithi073.stderr: -289> 2024-09-12T00:49:25.885+0000 7f48bc546800 10 monclient: monmap: 2024-09-12T00:49:26.171 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:49:26.171 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:49:26.171 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:49:26.171 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:49:26.171 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:49:26.171 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:49:26.172 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:49:26.172 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:49:26.172 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:49:26.172 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:26.172 INFO:tasks.workunit.client.0.smithi073.stderr: -288> 2024-09-12T00:49:25.885+0000 7f48bc546800 5 AuthRegistry(0x55abd0025790) adding auth protocol: cephx 2024-09-12T00:49:26.172 INFO:tasks.workunit.client.0.smithi073.stderr: -287> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x55abd0025790) adding auth protocol: cephx 2024-09-12T00:49:26.172 INFO:tasks.workunit.client.0.smithi073.stderr: -286> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x55abd0025790) adding auth protocol: cephx 2024-09-12T00:49:26.172 INFO:tasks.workunit.client.0.smithi073.stderr: -285> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x55abd0025790) adding con mode: secure 2024-09-12T00:49:26.172 INFO:tasks.workunit.client.0.smithi073.stderr: -284> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x55abd0025790) adding con mode: crc 2024-09-12T00:49:26.172 INFO:tasks.workunit.client.0.smithi073.stderr: -283> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x55abd0025790) adding con mode: secure 2024-09-12T00:49:26.172 INFO:tasks.workunit.client.0.smithi073.stderr: -282> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x55abd0025790) adding con mode: crc 2024-09-12T00:49:26.172 INFO:tasks.workunit.client.0.smithi073.stderr: -281> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x55abd0025790) adding con mode: secure 2024-09-12T00:49:26.173 INFO:tasks.workunit.client.0.smithi073.stderr: -280> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x55abd0025790) adding con mode: crc 2024-09-12T00:49:26.173 INFO:tasks.workunit.client.0.smithi073.stderr: -279> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x55abd0025790) adding con mode: crc 2024-09-12T00:49:26.173 INFO:tasks.workunit.client.0.smithi073.stderr: -278> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x55abd0025790) adding con mode: secure 2024-09-12T00:49:26.173 INFO:tasks.workunit.client.0.smithi073.stderr: -277> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x55abd0025790) adding con mode: crc 2024-09-12T00:49:26.173 INFO:tasks.workunit.client.0.smithi073.stderr: -276> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x55abd0025790) adding con mode: secure 2024-09-12T00:49:26.173 INFO:tasks.workunit.client.0.smithi073.stderr: -275> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x55abd0025790) adding con mode: crc 2024-09-12T00:49:26.173 INFO:tasks.workunit.client.0.smithi073.stderr: -274> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x55abd0025790) adding con mode: secure 2024-09-12T00:49:26.173 INFO:tasks.workunit.client.0.smithi073.stderr: -273> 2024-09-12T00:49:25.886+0000 7f48bc546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:26.173 INFO:tasks.workunit.client.0.smithi073.stderr: -272> 2024-09-12T00:49:25.886+0000 7f48bc546800 10 monclient: init 2024-09-12T00:49:26.173 INFO:tasks.workunit.client.0.smithi073.stderr: -271> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e8cc0) adding auth protocol: cephx 2024-09-12T00:49:26.173 INFO:tasks.workunit.client.0.smithi073.stderr: -270> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e8cc0) adding auth protocol: cephx 2024-09-12T00:49:26.173 INFO:tasks.workunit.client.0.smithi073.stderr: -269> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e8cc0) adding auth protocol: cephx 2024-09-12T00:49:26.173 INFO:tasks.workunit.client.0.smithi073.stderr: -268> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e8cc0) adding con mode: secure 2024-09-12T00:49:26.173 INFO:tasks.workunit.client.0.smithi073.stderr: -267> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e8cc0) adding con mode: crc 2024-09-12T00:49:26.174 INFO:tasks.workunit.client.0.smithi073.stderr: -266> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e8cc0) adding con mode: secure 2024-09-12T00:49:26.174 INFO:tasks.workunit.client.0.smithi073.stderr: -265> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e8cc0) adding con mode: crc 2024-09-12T00:49:26.174 INFO:tasks.workunit.client.0.smithi073.stderr: -264> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e8cc0) adding con mode: secure 2024-09-12T00:49:26.174 INFO:tasks.workunit.client.0.smithi073.stderr: -263> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e8cc0) adding con mode: crc 2024-09-12T00:49:26.174 INFO:tasks.workunit.client.0.smithi073.stderr: -262> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e8cc0) adding con mode: crc 2024-09-12T00:49:26.174 INFO:tasks.workunit.client.0.smithi073.stderr: -261> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e8cc0) adding con mode: secure 2024-09-12T00:49:26.174 INFO:tasks.workunit.client.0.smithi073.stderr: -260> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e8cc0) adding con mode: crc 2024-09-12T00:49:26.174 INFO:tasks.workunit.client.0.smithi073.stderr: -259> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e8cc0) adding con mode: secure 2024-09-12T00:49:26.174 INFO:tasks.workunit.client.0.smithi073.stderr: -258> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e8cc0) adding con mode: crc 2024-09-12T00:49:26.174 INFO:tasks.workunit.client.0.smithi073.stderr: -257> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e8cc0) adding con mode: secure 2024-09-12T00:49:26.174 INFO:tasks.workunit.client.0.smithi073.stderr: -256> 2024-09-12T00:49:25.886+0000 7f48bc546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:26.174 INFO:tasks.workunit.client.0.smithi073.stderr: -255> 2024-09-12T00:49:25.886+0000 7f48bc546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:26.174 INFO:tasks.workunit.client.0.smithi073.stderr: -254> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 asok(0x55abcfd69630) register_command rotate-key cmddesc rotate-key hook 0x7ffded8e8e08 EEXIST 2024-09-12T00:49:26.174 INFO:tasks.workunit.client.0.smithi073.stderr: -253> 2024-09-12T00:49:25.886+0000 7f48bc546800 10 monclient: _reopen_session rank -1 2024-09-12T00:49:26.175 INFO:tasks.workunit.client.0.smithi073.stderr: -252> 2024-09-12T00:49:25.886+0000 7f48bc546800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:49:26.175 INFO:tasks.workunit.client.0.smithi073.stderr: -251> 2024-09-12T00:49:25.886+0000 7f48bc546800 10 monclient(hunting): picked mon.noname-a con 0x55abd0059de0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:49:26.175 INFO:tasks.workunit.client.0.smithi073.stderr: -250> 2024-09-12T00:49:25.886+0000 7f48bc546800 10 monclient(hunting): picked mon.noname-c con 0x55abd00552e0 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:49:26.175 INFO:tasks.workunit.client.0.smithi073.stderr: -249> 2024-09-12T00:49:25.886+0000 7f48bc546800 10 monclient(hunting): picked mon.noname-b con 0x55abd004b750 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:49:26.175 INFO:tasks.workunit.client.0.smithi073.stderr: -248> 2024-09-12T00:49:25.886+0000 7f48bc546800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:26.175 INFO:tasks.workunit.client.0.smithi073.stderr: -247> 2024-09-12T00:49:25.886+0000 7f48bc546800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:26.175 INFO:tasks.workunit.client.0.smithi073.stderr: -246> 2024-09-12T00:49:25.886+0000 7f48bc546800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:26.175 INFO:tasks.workunit.client.0.smithi073.stderr: -245> 2024-09-12T00:49:25.886+0000 7f48bc546800 10 monclient(hunting): _renew_subs 2024-09-12T00:49:26.175 INFO:tasks.workunit.client.0.smithi073.stderr: -244> 2024-09-12T00:49:25.886+0000 7f48bc546800 10 monclient(hunting): authenticate will time out at 2026.556885s 2024-09-12T00:49:26.175 INFO:tasks.workunit.client.0.smithi073.stderr: -243> 2024-09-12T00:49:25.886+0000 7f48ba037640 10 monclient(hunting): get_auth_request con 0x55abd0059de0 auth_method 0 2024-09-12T00:49:26.175 INFO:tasks.workunit.client.0.smithi073.stderr: -242> 2024-09-12T00:49:25.886+0000 7f48ba037640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:26.175 INFO:tasks.workunit.client.0.smithi073.stderr: -241> 2024-09-12T00:49:25.886+0000 7f48ba037640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:26.176 INFO:tasks.workunit.client.0.smithi073.stderr: -240> 2024-09-12T00:49:25.886+0000 7f48ba037640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:26.176 INFO:tasks.workunit.client.0.smithi073.stderr: -239> 2024-09-12T00:49:25.887+0000 7f48b9836640 10 monclient(hunting): get_auth_request con 0x55abd00552e0 auth_method 0 2024-09-12T00:49:26.176 INFO:tasks.workunit.client.0.smithi073.stderr: -238> 2024-09-12T00:49:25.887+0000 7f48b9836640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:26.176 INFO:tasks.workunit.client.0.smithi073.stderr: -237> 2024-09-12T00:49:25.887+0000 7f48b9836640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:26.176 INFO:tasks.workunit.client.0.smithi073.stderr: -236> 2024-09-12T00:49:25.887+0000 7f48b9836640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:26.176 INFO:tasks.workunit.client.0.smithi073.stderr: -235> 2024-09-12T00:49:25.887+0000 7f48ba037640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:26.176 INFO:tasks.workunit.client.0.smithi073.stderr: -234> 2024-09-12T00:49:25.887+0000 7f48ba037640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:26.176 INFO:tasks.workunit.client.0.smithi073.stderr: -233> 2024-09-12T00:49:25.887+0000 7f48ba037640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:26.176 INFO:tasks.workunit.client.0.smithi073.stderr: -232> 2024-09-12T00:49:25.887+0000 7f48b9836640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:26.176 INFO:tasks.workunit.client.0.smithi073.stderr: -231> 2024-09-12T00:49:25.887+0000 7f48b9836640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:26.176 INFO:tasks.workunit.client.0.smithi073.stderr: -230> 2024-09-12T00:49:25.887+0000 7f48b9836640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:26.176 INFO:tasks.workunit.client.0.smithi073.stderr: -229> 2024-09-12T00:49:25.887+0000 7f48ba838640 10 monclient(hunting): get_auth_request con 0x55abd004b750 auth_method 0 2024-09-12T00:49:26.176 INFO:tasks.workunit.client.0.smithi073.stderr: -228> 2024-09-12T00:49:25.887+0000 7f48ba838640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:26.177 INFO:tasks.workunit.client.0.smithi073.stderr: -227> 2024-09-12T00:49:25.887+0000 7f48ba838640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:26.177 INFO:tasks.workunit.client.0.smithi073.stderr: -226> 2024-09-12T00:49:25.887+0000 7f48ba838640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:26.177 INFO:tasks.workunit.client.0.smithi073.stderr: -225> 2024-09-12T00:49:25.887+0000 7f48ba037640 10 monclient(hunting): handle_auth_done global_id 6645 payload 274 2024-09-12T00:49:26.177 INFO:tasks.workunit.client.0.smithi073.stderr: -224> 2024-09-12T00:49:25.887+0000 7f48ba037640 10 monclient: _finish_hunting 0 2024-09-12T00:49:26.177 INFO:tasks.workunit.client.0.smithi073.stderr: -223> 2024-09-12T00:49:25.887+0000 7f48ba037640 1 monclient: found mon.noname-a 2024-09-12T00:49:26.177 INFO:tasks.workunit.client.0.smithi073.stderr: -222> 2024-09-12T00:49:25.887+0000 7f48ba037640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:49:26.177 INFO:tasks.workunit.client.0.smithi073.stderr: -221> 2024-09-12T00:49:25.887+0000 7f479dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:26.177 INFO:tasks.workunit.client.0.smithi073.stderr: -220> 2024-09-12T00:49:25.887+0000 7f479dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:49:26.177 INFO:tasks.workunit.client.0.smithi073.stderr: -219> 2024-09-12T00:49:25.887+0000 7f479dffb640 10 monclient: dump: 2024-09-12T00:49:26.177 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:49:26.177 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:49:26.177 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:49:26.177 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:49:26.177 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:26.178 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:49:26.178 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:49:26.178 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:49:26.178 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:49:26.178 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:26.178 INFO:tasks.workunit.client.0.smithi073.stderr: -218> 2024-09-12T00:49:25.887+0000 7f479dffb640 10 monclient: _finish_auth 0 2024-09-12T00:49:26.178 INFO:tasks.workunit.client.0.smithi073.stderr: -217> 2024-09-12T00:49:25.887+0000 7f479dffb640 10 monclient: _check_auth_tickets 2024-09-12T00:49:26.178 INFO:tasks.workunit.client.0.smithi073.stderr: -216> 2024-09-12T00:49:25.887+0000 7f479dffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:49:26.178 INFO:tasks.workunit.client.0.smithi073.stderr: -215> 2024-09-12T00:49:25.887+0000 7f479dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:26.178 INFO:tasks.workunit.client.0.smithi073.stderr: -214> 2024-09-12T00:49:25.887+0000 7f479dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:49:26.178 INFO:tasks.workunit.client.0.smithi073.stderr: -213> 2024-09-12T00:49:25.887+0000 7f479dffb640 10 monclient: dump: 2024-09-12T00:49:26.178 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:49:26.178 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:49:26.179 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:49:26.179 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:49:26.179 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:26.179 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:49:26.179 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:49:26.179 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:49:26.179 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:49:26.179 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:26.179 INFO:tasks.workunit.client.0.smithi073.stderr: -212> 2024-09-12T00:49:25.887+0000 7f48bc546800 5 monclient: authenticate success, global_id 6645 2024-09-12T00:49:26.179 INFO:tasks.workunit.client.0.smithi073.stderr: -211> 2024-09-12T00:49:25.887+0000 7f48bc546800 10 monclient: get_monmap_and_config success 2024-09-12T00:49:26.179 INFO:tasks.workunit.client.0.smithi073.stderr: -210> 2024-09-12T00:49:25.887+0000 7f48bc546800 4 set_mon_vals no callback set 2024-09-12T00:49:26.179 INFO:tasks.workunit.client.0.smithi073.stderr: -209> 2024-09-12T00:49:25.887+0000 7f48bc546800 10 monclient: shutdown 2024-09-12T00:49:26.179 INFO:tasks.workunit.client.0.smithi073.stderr: -208> 2024-09-12T00:49:25.888+0000 7f48bc546800 10 monclient: build_initial_monmap 2024-09-12T00:49:26.180 INFO:tasks.workunit.client.0.smithi073.stderr: -207> 2024-09-12T00:49:25.888+0000 7f48bc546800 1 build_initial for_mkfs: 0 2024-09-12T00:49:26.180 INFO:tasks.workunit.client.0.smithi073.stderr: -206> 2024-09-12T00:49:25.888+0000 7f48bc546800 10 monclient: monmap: 2024-09-12T00:49:26.180 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:49:26.180 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:49:26.180 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:49:26.180 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:49:26.180 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:49:26.180 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:49:26.180 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:49:26.180 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:49:26.180 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:49:26.180 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:26.180 INFO:tasks.workunit.client.0.smithi073.stderr: -205> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd004bc80) adding auth protocol: cephx 2024-09-12T00:49:26.180 INFO:tasks.workunit.client.0.smithi073.stderr: -204> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd004bc80) adding auth protocol: cephx 2024-09-12T00:49:26.181 INFO:tasks.workunit.client.0.smithi073.stderr: -203> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd004bc80) adding auth protocol: cephx 2024-09-12T00:49:26.181 INFO:tasks.workunit.client.0.smithi073.stderr: -202> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd004bc80) adding con mode: secure 2024-09-12T00:49:26.181 INFO:tasks.workunit.client.0.smithi073.stderr: -201> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd004bc80) adding con mode: crc 2024-09-12T00:49:26.181 INFO:tasks.workunit.client.0.smithi073.stderr: -200> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd004bc80) adding con mode: secure 2024-09-12T00:49:26.181 INFO:tasks.workunit.client.0.smithi073.stderr: -199> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd004bc80) adding con mode: crc 2024-09-12T00:49:26.181 INFO:tasks.workunit.client.0.smithi073.stderr: -198> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd004bc80) adding con mode: secure 2024-09-12T00:49:26.181 INFO:tasks.workunit.client.0.smithi073.stderr: -197> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd004bc80) adding con mode: crc 2024-09-12T00:49:26.181 INFO:tasks.workunit.client.0.smithi073.stderr: -196> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd004bc80) adding con mode: crc 2024-09-12T00:49:26.181 INFO:tasks.workunit.client.0.smithi073.stderr: -195> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd004bc80) adding con mode: secure 2024-09-12T00:49:26.181 INFO:tasks.workunit.client.0.smithi073.stderr: -194> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd004bc80) adding con mode: crc 2024-09-12T00:49:26.181 INFO:tasks.workunit.client.0.smithi073.stderr: -193> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd004bc80) adding con mode: secure 2024-09-12T00:49:26.181 INFO:tasks.workunit.client.0.smithi073.stderr: -192> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd004bc80) adding con mode: crc 2024-09-12T00:49:26.181 INFO:tasks.workunit.client.0.smithi073.stderr: -191> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd004bc80) adding con mode: secure 2024-09-12T00:49:26.182 INFO:tasks.workunit.client.0.smithi073.stderr: -190> 2024-09-12T00:49:25.888+0000 7f48bc546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:26.182 INFO:tasks.workunit.client.0.smithi073.stderr: -189> 2024-09-12T00:49:25.888+0000 7f48bc546800 1 librados: starting msgr at 2024-09-12T00:49:26.182 INFO:tasks.workunit.client.0.smithi073.stderr: -188> 2024-09-12T00:49:25.888+0000 7f48bc546800 1 librados: starting objecter 2024-09-12T00:49:26.182 INFO:tasks.workunit.client.0.smithi073.stderr: -187> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 asok(0x55abcfd69630) register_command objecter_requests cmddesc objecter_requests hook 0x55abcffcc140 EEXIST 2024-09-12T00:49:26.182 INFO:tasks.workunit.client.0.smithi073.stderr: -186> 2024-09-12T00:49:25.888+0000 7f48bc546800 1 librados: setting wanted keys 2024-09-12T00:49:26.182 INFO:tasks.workunit.client.0.smithi073.stderr: -185> 2024-09-12T00:49:25.888+0000 7f48bc546800 1 librados: calling monclient init 2024-09-12T00:49:26.182 INFO:tasks.workunit.client.0.smithi073.stderr: -184> 2024-09-12T00:49:25.888+0000 7f48bc546800 10 monclient: init 2024-09-12T00:49:26.182 INFO:tasks.workunit.client.0.smithi073.stderr: -183> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd001da00) adding auth protocol: cephx 2024-09-12T00:49:26.182 INFO:tasks.workunit.client.0.smithi073.stderr: -182> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd001da00) adding auth protocol: cephx 2024-09-12T00:49:26.182 INFO:tasks.workunit.client.0.smithi073.stderr: -181> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd001da00) adding auth protocol: cephx 2024-09-12T00:49:26.182 INFO:tasks.workunit.client.0.smithi073.stderr: -180> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd001da00) adding con mode: secure 2024-09-12T00:49:26.182 INFO:tasks.workunit.client.0.smithi073.stderr: -179> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd001da00) adding con mode: crc 2024-09-12T00:49:26.182 INFO:tasks.workunit.client.0.smithi073.stderr: -178> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd001da00) adding con mode: secure 2024-09-12T00:49:26.182 INFO:tasks.workunit.client.0.smithi073.stderr: -177> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd001da00) adding con mode: crc 2024-09-12T00:49:26.183 INFO:tasks.workunit.client.0.smithi073.stderr: -176> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd001da00) adding con mode: secure 2024-09-12T00:49:26.183 INFO:tasks.workunit.client.0.smithi073.stderr: -175> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd001da00) adding con mode: crc 2024-09-12T00:49:26.183 INFO:tasks.workunit.client.0.smithi073.stderr: -174> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd001da00) adding con mode: crc 2024-09-12T00:49:26.183 INFO:tasks.workunit.client.0.smithi073.stderr: -173> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd001da00) adding con mode: secure 2024-09-12T00:49:26.183 INFO:tasks.workunit.client.0.smithi073.stderr: -172> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd001da00) adding con mode: crc 2024-09-12T00:49:26.183 INFO:tasks.workunit.client.0.smithi073.stderr: -171> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd001da00) adding con mode: secure 2024-09-12T00:49:26.183 INFO:tasks.workunit.client.0.smithi073.stderr: -170> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd001da00) adding con mode: crc 2024-09-12T00:49:26.183 INFO:tasks.workunit.client.0.smithi073.stderr: -169> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd001da00) adding con mode: secure 2024-09-12T00:49:26.183 INFO:tasks.workunit.client.0.smithi073.stderr: -168> 2024-09-12T00:49:25.888+0000 7f48bc546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:26.183 INFO:tasks.workunit.client.0.smithi073.stderr: -167> 2024-09-12T00:49:25.888+0000 7f48bc546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:26.183 INFO:tasks.workunit.client.0.smithi073.stderr: -166> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 asok(0x55abcfd69630) register_command rotate-key cmddesc rotate-key hook 0x55abd001db48 EEXIST 2024-09-12T00:49:26.183 INFO:tasks.workunit.client.0.smithi073.stderr: -165> 2024-09-12T00:49:25.888+0000 7f48bc546800 10 monclient: _reopen_session rank -1 2024-09-12T00:49:26.183 INFO:tasks.workunit.client.0.smithi073.stderr: -164> 2024-09-12T00:49:25.889+0000 7f48bc546800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:49:26.184 INFO:tasks.workunit.client.0.smithi073.stderr: -163> 2024-09-12T00:49:25.889+0000 7f48bc546800 10 monclient(hunting): picked mon.noname-b con 0x55abd004b750 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:49:26.184 INFO:tasks.workunit.client.0.smithi073.stderr: -162> 2024-09-12T00:49:25.889+0000 7f48bc546800 10 monclient(hunting): picked mon.noname-c con 0x55abd00552e0 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:49:26.184 INFO:tasks.workunit.client.0.smithi073.stderr: -161> 2024-09-12T00:49:25.889+0000 7f48bc546800 10 monclient(hunting): picked mon.noname-a con 0x55abd0059de0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:49:26.184 INFO:tasks.workunit.client.0.smithi073.stderr: -160> 2024-09-12T00:49:25.889+0000 7f48bc546800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:26.184 INFO:tasks.workunit.client.0.smithi073.stderr: -159> 2024-09-12T00:49:25.889+0000 7f48bc546800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:26.184 INFO:tasks.workunit.client.0.smithi073.stderr: -158> 2024-09-12T00:49:25.889+0000 7f48bc546800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:26.184 INFO:tasks.workunit.client.0.smithi073.stderr: -157> 2024-09-12T00:49:25.889+0000 7f48bc546800 10 monclient(hunting): _renew_subs 2024-09-12T00:49:26.184 INFO:tasks.workunit.client.0.smithi073.stderr: -156> 2024-09-12T00:49:25.889+0000 7f48bc546800 10 monclient(hunting): authenticate will time out at 2026.559052s 2024-09-12T00:49:26.184 INFO:tasks.workunit.client.0.smithi073.stderr: -155> 2024-09-12T00:49:25.889+0000 7f48b9836640 10 monclient(hunting): get_auth_request con 0x55abd00552e0 auth_method 0 2024-09-12T00:49:26.184 INFO:tasks.workunit.client.0.smithi073.stderr: -154> 2024-09-12T00:49:25.889+0000 7f48b9836640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:26.184 INFO:tasks.workunit.client.0.smithi073.stderr: -153> 2024-09-12T00:49:25.889+0000 7f48b9836640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:26.184 INFO:tasks.workunit.client.0.smithi073.stderr: -152> 2024-09-12T00:49:25.889+0000 7f48b9836640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:26.184 INFO:tasks.workunit.client.0.smithi073.stderr: -151> 2024-09-12T00:49:25.889+0000 7f48ba838640 10 monclient(hunting): get_auth_request con 0x55abd0059de0 auth_method 0 2024-09-12T00:49:26.185 INFO:tasks.workunit.client.0.smithi073.stderr: -150> 2024-09-12T00:49:25.889+0000 7f48ba838640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:26.185 INFO:tasks.workunit.client.0.smithi073.stderr: -149> 2024-09-12T00:49:25.889+0000 7f48ba838640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:26.185 INFO:tasks.workunit.client.0.smithi073.stderr: -148> 2024-09-12T00:49:25.889+0000 7f48ba838640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:26.185 INFO:tasks.workunit.client.0.smithi073.stderr: -147> 2024-09-12T00:49:25.889+0000 7f48b9836640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:26.185 INFO:tasks.workunit.client.0.smithi073.stderr: -146> 2024-09-12T00:49:25.889+0000 7f48b9836640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:26.185 INFO:tasks.workunit.client.0.smithi073.stderr: -145> 2024-09-12T00:49:25.889+0000 7f48b9836640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:26.185 INFO:tasks.workunit.client.0.smithi073.stderr: -144> 2024-09-12T00:49:25.889+0000 7f48ba037640 10 monclient(hunting): get_auth_request con 0x55abd004b750 auth_method 0 2024-09-12T00:49:26.185 INFO:tasks.workunit.client.0.smithi073.stderr: -143> 2024-09-12T00:49:25.889+0000 7f48ba037640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:26.185 INFO:tasks.workunit.client.0.smithi073.stderr: -142> 2024-09-12T00:49:25.889+0000 7f48ba037640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:26.185 INFO:tasks.workunit.client.0.smithi073.stderr: -141> 2024-09-12T00:49:25.889+0000 7f48ba037640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:26.185 INFO:tasks.workunit.client.0.smithi073.stderr: -140> 2024-09-12T00:49:25.889+0000 7f48ba838640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:26.185 INFO:tasks.workunit.client.0.smithi073.stderr: -139> 2024-09-12T00:49:25.889+0000 7f48ba838640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:26.185 INFO:tasks.workunit.client.0.smithi073.stderr: -138> 2024-09-12T00:49:25.889+0000 7f48ba838640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:26.185 INFO:tasks.workunit.client.0.smithi073.stderr: -137> 2024-09-12T00:49:25.889+0000 7f48ba037640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:26.186 INFO:tasks.workunit.client.0.smithi073.stderr: -136> 2024-09-12T00:49:25.889+0000 7f48ba037640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:26.186 INFO:tasks.workunit.client.0.smithi073.stderr: -135> 2024-09-12T00:49:25.889+0000 7f48ba037640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:26.186 INFO:tasks.workunit.client.0.smithi073.stderr: -134> 2024-09-12T00:49:25.889+0000 7f48b9836640 10 monclient(hunting): handle_auth_done global_id 6308 payload 824 2024-09-12T00:49:26.186 INFO:tasks.workunit.client.0.smithi073.stderr: -133> 2024-09-12T00:49:25.889+0000 7f48b9836640 10 monclient: _finish_hunting 0 2024-09-12T00:49:26.186 INFO:tasks.workunit.client.0.smithi073.stderr: -132> 2024-09-12T00:49:25.889+0000 7f48b9836640 1 monclient: found mon.noname-c 2024-09-12T00:49:26.186 INFO:tasks.workunit.client.0.smithi073.stderr: -131> 2024-09-12T00:49:25.889+0000 7f48b9836640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.73:3301/0 2024-09-12T00:49:26.186 INFO:tasks.workunit.client.0.smithi073.stderr: -130> 2024-09-12T00:49:25.889+0000 7f478bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:26.186 INFO:tasks.workunit.client.0.smithi073.stderr: -129> 2024-09-12T00:49:25.889+0000 7f478bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:49:26.186 INFO:tasks.workunit.client.0.smithi073.stderr: -128> 2024-09-12T00:49:25.889+0000 7f478bfff640 10 monclient: dump: 2024-09-12T00:49:26.186 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:49:26.186 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:49:26.186 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:49:26.186 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:49:26.186 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:26.187 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:49:26.187 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:49:26.187 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:49:26.187 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:49:26.187 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:26.187 INFO:tasks.workunit.client.0.smithi073.stderr: -127> 2024-09-12T00:49:25.889+0000 7f478bfff640 10 monclient: _finish_auth 0 2024-09-12T00:49:26.187 INFO:tasks.workunit.client.0.smithi073.stderr: -126> 2024-09-12T00:49:25.889+0000 7f478bfff640 10 monclient: _check_auth_tickets 2024-09-12T00:49:26.187 INFO:tasks.workunit.client.0.smithi073.stderr: -125> 2024-09-12T00:49:25.889+0000 7f478bfff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:49:26.187 INFO:tasks.workunit.client.0.smithi073.stderr: -124> 2024-09-12T00:49:25.889+0000 7f478bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:26.187 INFO:tasks.workunit.client.0.smithi073.stderr: -123> 2024-09-12T00:49:25.889+0000 7f478bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:49:26.187 INFO:tasks.workunit.client.0.smithi073.stderr: -122> 2024-09-12T00:49:25.889+0000 7f478bfff640 10 monclient: dump: 2024-09-12T00:49:26.187 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:49:26.187 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:49:26.188 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:49:26.188 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:49:26.188 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:26.188 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:49:26.188 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:49:26.188 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:49:26.188 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:49:26.188 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:26.188 INFO:tasks.workunit.client.0.smithi073.stderr: -121> 2024-09-12T00:49:25.889+0000 7f48bc546800 5 monclient: authenticate success, global_id 6308 2024-09-12T00:49:26.188 INFO:tasks.workunit.client.0.smithi073.stderr: -120> 2024-09-12T00:49:25.889+0000 7f48bc546800 10 monclient: _renew_subs 2024-09-12T00:49:26.188 INFO:tasks.workunit.client.0.smithi073.stderr: -119> 2024-09-12T00:49:25.889+0000 7f48bc546800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:49:26.188 INFO:tasks.workunit.client.0.smithi073.stderr: -118> 2024-09-12T00:49:25.889+0000 7f479dffb640 4 set_mon_vals no callback set 2024-09-12T00:49:26.188 INFO:tasks.workunit.client.0.smithi073.stderr: -117> 2024-09-12T00:49:25.889+0000 7f48bc546800 10 monclient: _renew_subs 2024-09-12T00:49:26.188 INFO:tasks.workunit.client.0.smithi073.stderr: -116> 2024-09-12T00:49:25.889+0000 7f48bc546800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:49:26.189 INFO:tasks.workunit.client.0.smithi073.stderr: -115> 2024-09-12T00:49:25.889+0000 7f48bc546800 1 librados: init done 2024-09-12T00:49:26.189 INFO:tasks.workunit.client.0.smithi073.stderr: -114> 2024-09-12T00:49:25.889+0000 7f48bc546800 5 asok(0x55abcfd69630) register_command cr dump hook 0x55abd0050848 2024-09-12T00:49:26.189 INFO:tasks.workunit.client.0.smithi073.stderr: -113> 2024-09-12T00:49:25.891+0000 7f48bc546800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.189 INFO:tasks.workunit.client.0.smithi073.stderr: -112> 2024-09-12T00:49:25.892+0000 7f478bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:49:26.189 INFO:tasks.workunit.client.0.smithi073.stderr: -111> 2024-09-12T00:49:25.892+0000 7f478bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:49:26.189 INFO:tasks.workunit.client.0.smithi073.stderr: -110> 2024-09-12T00:49:25.892+0000 7f478bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:49:26.189 INFO:tasks.workunit.client.0.smithi073.stderr: -109> 2024-09-12T00:49:25.892+0000 7f48ba037640 10 monclient: get_auth_request con 0x7f4784076470 auth_method 0 2024-09-12T00:49:26.189 INFO:tasks.workunit.client.0.smithi073.stderr: -108> 2024-09-12T00:49:25.892+0000 7f48ba838640 10 monclient: get_auth_request con 0x55abd00741f0 auth_method 0 2024-09-12T00:49:26.189 INFO:tasks.workunit.client.0.smithi073.stderr: -107> 2024-09-12T00:49:25.893+0000 7f48bc546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:26.189 INFO:tasks.workunit.client.0.smithi073.stderr: -106> 2024-09-12T00:49:25.893+0000 7f48bc546800 20 realm 2024-09-12T00:49:26.189 INFO:tasks.workunit.client.0.smithi073.stderr: -105> 2024-09-12T00:49:25.893+0000 7f48bc546800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.189 INFO:tasks.workunit.client.0.smithi073.stderr: -104> 2024-09-12T00:49:25.893+0000 7f48bc546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:26.189 INFO:tasks.workunit.client.0.smithi073.stderr: -103> 2024-09-12T00:49:25.893+0000 7f48bc546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:26.190 INFO:tasks.workunit.client.0.smithi073.stderr: -102> 2024-09-12T00:49:25.893+0000 7f48bc546800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.190 INFO:tasks.workunit.client.0.smithi073.stderr: -101> 2024-09-12T00:49:25.893+0000 7f48bc546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:26.190 INFO:tasks.workunit.client.0.smithi073.stderr: -100> 2024-09-12T00:49:25.893+0000 7f48bc546800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.190 INFO:tasks.workunit.client.0.smithi073.stderr: -99> 2024-09-12T00:49:25.893+0000 7f48ba037640 10 monclient: get_auth_request con 0x55abd0078410 auth_method 0 2024-09-12T00:49:26.190 INFO:tasks.workunit.client.0.smithi073.stderr: -98> 2024-09-12T00:49:25.894+0000 7f48bc546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:26.190 INFO:tasks.workunit.client.0.smithi073.stderr: -97> 2024-09-12T00:49:25.894+0000 7f48bc546800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.190 INFO:tasks.workunit.client.0.smithi073.stderr: -96> 2024-09-12T00:49:25.894+0000 7f48b9836640 10 monclient: get_auth_request con 0x55abd007bc70 auth_method 0 2024-09-12T00:49:26.190 INFO:tasks.workunit.client.0.smithi073.stderr: -95> 2024-09-12T00:49:25.895+0000 7f48bc546800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:26.190 INFO:tasks.workunit.client.0.smithi073.stderr: -94> 2024-09-12T00:49:25.895+0000 7f48bc546800 20 searching for the correct realm 2024-09-12T00:49:26.190 INFO:tasks.workunit.client.0.smithi073.stderr: -93> 2024-09-12T00:49:25.895+0000 7f48ba838640 10 monclient: get_auth_request con 0x55abd00809f0 auth_method 0 2024-09-12T00:49:26.190 INFO:tasks.workunit.client.0.smithi073.stderr: -92> 2024-09-12T00:49:25.896+0000 7f48ba037640 10 monclient: get_auth_request con 0x7f48b4025040 auth_method 0 2024-09-12T00:49:26.190 INFO:tasks.workunit.client.0.smithi073.stderr: -91> 2024-09-12T00:49:25.896+0000 7f48b9836640 10 monclient: get_auth_request con 0x7f48ac0b6230 auth_method 0 2024-09-12T00:49:26.190 INFO:tasks.workunit.client.0.smithi073.stderr: -90> 2024-09-12T00:49:25.897+0000 7f48ba838640 10 monclient: get_auth_request con 0x7f48b0040030 auth_method 0 2024-09-12T00:49:26.191 INFO:tasks.workunit.client.0.smithi073.stderr: -89> 2024-09-12T00:49:25.897+0000 7f48ba838640 0 -- 172.21.15.73:0/819594272 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f48b0040030 msgr2=0x7f48b006b2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:49:26.191 INFO:tasks.workunit.client.0.smithi073.stderr: -88> 2024-09-12T00:49:26.099+0000 7f48ba838640 10 monclient: get_auth_request con 0x7f48b0040030 auth_method 0 2024-09-12T00:49:26.191 INFO:tasks.workunit.client.0.smithi073.stderr: -87> 2024-09-12T00:49:26.103+0000 7f48ba037640 10 monclient: get_auth_request con 0x7f48b4034410 auth_method 0 2024-09-12T00:49:26.191 INFO:tasks.workunit.client.0.smithi073.stderr: -86> 2024-09-12T00:49:26.104+0000 7f48ba838640 0 -- 172.21.15.73:0/819594272 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f48b0040030 msgr2=0x7f48b006b2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:26.191 INFO:tasks.workunit.client.0.smithi073.stderr: -85> 2024-09-12T00:49:26.104+0000 7f478bfff640 1 client.6308.objecter ms_handle_reset 0x7f48b0040030 session 0x7f48b006c650 osd.4 2024-09-12T00:49:26.191 INFO:tasks.workunit.client.0.smithi073.stderr: -84> 2024-09-12T00:49:26.104+0000 7f478bfff640 10 monclient: _renew_subs 2024-09-12T00:49:26.191 INFO:tasks.workunit.client.0.smithi073.stderr: -83> 2024-09-12T00:49:26.104+0000 7f478bfff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:49:26.191 INFO:tasks.workunit.client.0.smithi073.stderr: -82> 2024-09-12T00:49:26.104+0000 7f48ba838640 10 monclient: get_auth_request con 0x7f4784086310 auth_method 0 2024-09-12T00:49:26.191 INFO:tasks.workunit.client.0.smithi073.stderr: -81> 2024-09-12T00:49:26.108+0000 7f48bc546800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:49:26.191 INFO:tasks.workunit.client.0.smithi073.stderr: -80> 2024-09-12T00:49:26.108+0000 7f48bc546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:26.191 INFO:tasks.workunit.client.0.smithi073.stderr: -79> 2024-09-12T00:49:26.108+0000 7f48bc546800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:49:26.191 INFO:tasks.workunit.client.0.smithi073.stderr: -78> 2024-09-12T00:49:26.108+0000 7f48bc546800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:26.191 INFO:tasks.workunit.client.0.smithi073.stderr: -77> 2024-09-12T00:49:26.108+0000 7f48bc546800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:26.191 INFO:tasks.workunit.client.0.smithi073.stderr: -76> 2024-09-12T00:49:26.108+0000 7f48bc546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:26.192 INFO:tasks.workunit.client.0.smithi073.stderr: -75> 2024-09-12T00:49:26.108+0000 7f48bc546800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.192 INFO:tasks.workunit.client.0.smithi073.stderr: -74> 2024-09-12T00:49:26.108+0000 7f48bc546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:26.192 INFO:tasks.workunit.client.0.smithi073.stderr: -73> 2024-09-12T00:49:26.108+0000 7f48bc546800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.192 INFO:tasks.workunit.client.0.smithi073.stderr: -72> 2024-09-12T00:49:26.109+0000 7f48bc546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:26.192 INFO:tasks.workunit.client.0.smithi073.stderr: -71> 2024-09-12T00:49:26.109+0000 7f48bc546800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.192 INFO:tasks.workunit.client.0.smithi073.stderr: -70> 2024-09-12T00:49:26.109+0000 7f48bc546800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:26.192 INFO:tasks.workunit.client.0.smithi073.stderr: -69> 2024-09-12T00:49:26.109+0000 7f48bc546800 20 zone default found 2024-09-12T00:49:26.192 INFO:tasks.workunit.client.0.smithi073.stderr: -68> 2024-09-12T00:49:26.109+0000 7f48bc546800 4 Realm: () 2024-09-12T00:49:26.192 INFO:tasks.workunit.client.0.smithi073.stderr: -67> 2024-09-12T00:49:26.109+0000 7f48bc546800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:49:26.192 INFO:tasks.workunit.client.0.smithi073.stderr: -66> 2024-09-12T00:49:26.109+0000 7f48bc546800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:49:26.192 INFO:tasks.workunit.client.0.smithi073.stderr: -65> 2024-09-12T00:49:26.109+0000 7f48bc546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:26.192 INFO:tasks.workunit.client.0.smithi073.stderr: -64> 2024-09-12T00:49:26.109+0000 7f48bc546800 20 zonegroup default 2024-09-12T00:49:26.192 INFO:tasks.workunit.client.0.smithi073.stderr: -63> 2024-09-12T00:49:26.109+0000 7f48bc546800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.193 INFO:tasks.workunit.client.0.smithi073.stderr: -62> 2024-09-12T00:49:26.109+0000 7f48bc546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:26.193 INFO:tasks.workunit.client.0.smithi073.stderr: -61> 2024-09-12T00:49:26.109+0000 7f48bc546800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.193 INFO:tasks.workunit.client.0.smithi073.stderr: -60> 2024-09-12T00:49:26.110+0000 7f48bc546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:26.193 INFO:tasks.workunit.client.0.smithi073.stderr: -59> 2024-09-12T00:49:26.110+0000 7f48bc546800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.193 INFO:tasks.workunit.client.0.smithi073.stderr: -58> 2024-09-12T00:49:26.110+0000 7f48bc546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:26.193 INFO:tasks.workunit.client.0.smithi073.stderr: -57> 2024-09-12T00:49:26.110+0000 7f48bc546800 20 started sync module instance, tier type = 2024-09-12T00:49:26.193 INFO:tasks.workunit.client.0.smithi073.stderr: -56> 2024-09-12T00:49:26.110+0000 7f48bc546800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:49:26.193 INFO:tasks.workunit.client.0.smithi073.stderr: -55> 2024-09-12T00:49:26.122+0000 7f48bc546800 20 add_watcher() i=0 2024-09-12T00:49:26.193 INFO:tasks.workunit.client.0.smithi073.stderr: -54> 2024-09-12T00:49:26.122+0000 7f48bc546800 20 add_watcher() i=1 2024-09-12T00:49:26.193 INFO:tasks.workunit.client.0.smithi073.stderr: -53> 2024-09-12T00:49:26.122+0000 7f48bc546800 20 add_watcher() i=2 2024-09-12T00:49:26.193 INFO:tasks.workunit.client.0.smithi073.stderr: -52> 2024-09-12T00:49:26.122+0000 7f48bc546800 20 add_watcher() i=3 2024-09-12T00:49:26.193 INFO:tasks.workunit.client.0.smithi073.stderr: -51> 2024-09-12T00:49:26.122+0000 7f48bc546800 20 add_watcher() i=4 2024-09-12T00:49:26.193 INFO:tasks.workunit.client.0.smithi073.stderr: -50> 2024-09-12T00:49:26.122+0000 7f48bc546800 20 add_watcher() i=5 2024-09-12T00:49:26.194 INFO:tasks.workunit.client.0.smithi073.stderr: -49> 2024-09-12T00:49:26.122+0000 7f48bc546800 20 add_watcher() i=6 2024-09-12T00:49:26.194 INFO:tasks.workunit.client.0.smithi073.stderr: -48> 2024-09-12T00:49:26.123+0000 7f48bc546800 20 add_watcher() i=7 2024-09-12T00:49:26.194 INFO:tasks.workunit.client.0.smithi073.stderr: -47> 2024-09-12T00:49:26.123+0000 7f48bc546800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:26.194 INFO:tasks.workunit.client.0.smithi073.stderr: -46> 2024-09-12T00:49:26.124+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e91a0) adding auth protocol: cephx 2024-09-12T00:49:26.194 INFO:tasks.workunit.client.0.smithi073.stderr: -45> 2024-09-12T00:49:26.124+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e91a0) adding auth protocol: cephx 2024-09-12T00:49:26.194 INFO:tasks.workunit.client.0.smithi073.stderr: -44> 2024-09-12T00:49:26.124+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e91a0) adding auth protocol: cephx 2024-09-12T00:49:26.194 INFO:tasks.workunit.client.0.smithi073.stderr: -43> 2024-09-12T00:49:26.124+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e91a0) adding con mode: secure 2024-09-12T00:49:26.194 INFO:tasks.workunit.client.0.smithi073.stderr: -42> 2024-09-12T00:49:26.124+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e91a0) adding con mode: crc 2024-09-12T00:49:26.194 INFO:tasks.workunit.client.0.smithi073.stderr: -41> 2024-09-12T00:49:26.124+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e91a0) adding con mode: secure 2024-09-12T00:49:26.194 INFO:tasks.workunit.client.0.smithi073.stderr: -40> 2024-09-12T00:49:26.124+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e91a0) adding con mode: crc 2024-09-12T00:49:26.194 INFO:tasks.workunit.client.0.smithi073.stderr: -39> 2024-09-12T00:49:26.124+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e91a0) adding con mode: secure 2024-09-12T00:49:26.194 INFO:tasks.workunit.client.0.smithi073.stderr: -38> 2024-09-12T00:49:26.124+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e91a0) adding con mode: crc 2024-09-12T00:49:26.194 INFO:tasks.workunit.client.0.smithi073.stderr: -37> 2024-09-12T00:49:26.124+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e91a0) adding con mode: crc 2024-09-12T00:49:26.194 INFO:tasks.workunit.client.0.smithi073.stderr: -36> 2024-09-12T00:49:26.124+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e91a0) adding con mode: secure 2024-09-12T00:49:26.195 INFO:tasks.workunit.client.0.smithi073.stderr: -35> 2024-09-12T00:49:26.124+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e91a0) adding con mode: crc 2024-09-12T00:49:26.195 INFO:tasks.workunit.client.0.smithi073.stderr: -34> 2024-09-12T00:49:26.124+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e91a0) adding con mode: secure 2024-09-12T00:49:26.195 INFO:tasks.workunit.client.0.smithi073.stderr: -33> 2024-09-12T00:49:26.124+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e91a0) adding con mode: crc 2024-09-12T00:49:26.195 INFO:tasks.workunit.client.0.smithi073.stderr: -32> 2024-09-12T00:49:26.124+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e91a0) adding con mode: secure 2024-09-12T00:49:26.195 INFO:tasks.workunit.client.0.smithi073.stderr: -31> 2024-09-12T00:49:26.124+0000 7f4770fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:26.195 INFO:tasks.workunit.client.0.smithi073.stderr: -30> 2024-09-12T00:49:26.125+0000 7f48bc546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:26.195 INFO:tasks.workunit.client.0.smithi073.stderr: -29> 2024-09-12T00:49:26.125+0000 7f48bc546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:26.195 INFO:tasks.workunit.client.0.smithi073.stderr: -28> 2024-09-12T00:49:26.125+0000 7f48bc546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:26.195 INFO:tasks.workunit.client.0.smithi073.stderr: -27> 2024-09-12T00:49:26.125+0000 7f48bc546800 5 asok(0x55abcfd69630) register_command cache list hook 0x55abd005f1c0 2024-09-12T00:49:26.195 INFO:tasks.workunit.client.0.smithi073.stderr: -26> 2024-09-12T00:49:26.125+0000 7f48bc546800 5 asok(0x55abcfd69630) register_command cache inspect hook 0x55abd005f1c0 2024-09-12T00:49:26.195 INFO:tasks.workunit.client.0.smithi073.stderr: -25> 2024-09-12T00:49:26.125+0000 7f48bc546800 5 asok(0x55abcfd69630) register_command cache erase hook 0x55abd005f1c0 2024-09-12T00:49:26.195 INFO:tasks.workunit.client.0.smithi073.stderr: -24> 2024-09-12T00:49:26.125+0000 7f48bc546800 5 asok(0x55abcfd69630) register_command cache zap hook 0x55abd005f1c0 2024-09-12T00:49:26.195 INFO:tasks.workunit.client.0.smithi073.stderr: -23> 2024-09-12T00:49:26.125+0000 7f48bc546800 5 note: GC not initialized 2024-09-12T00:49:26.196 INFO:tasks.workunit.client.0.smithi073.stderr: -22> 2024-09-12T00:49:26.125+0000 7f46eb7fe640 20 reqs_thread_entry: start 2024-09-12T00:49:26.196 INFO:tasks.workunit.client.0.smithi073.stderr: -21> 2024-09-12T00:49:26.125+0000 7f48bc546800 5 asok(0x55abcfd69630) register_command sync trace show hook 0x7f48ac004020 2024-09-12T00:49:26.196 INFO:tasks.workunit.client.0.smithi073.stderr: -20> 2024-09-12T00:49:26.125+0000 7f48bc546800 5 asok(0x55abcfd69630) register_command sync trace history hook 0x7f48ac004020 2024-09-12T00:49:26.196 INFO:tasks.workunit.client.0.smithi073.stderr: -19> 2024-09-12T00:49:26.125+0000 7f48bc546800 5 asok(0x55abcfd69630) register_command sync trace active hook 0x7f48ac004020 2024-09-12T00:49:26.196 INFO:tasks.workunit.client.0.smithi073.stderr: -18> 2024-09-12T00:49:26.125+0000 7f48bc546800 5 asok(0x55abcfd69630) register_command sync trace active_short hook 0x7f48ac004020 2024-09-12T00:49:26.196 INFO:tasks.workunit.client.0.smithi073.stderr: -17> 2024-09-12T00:49:26.125+0000 7f48bc546800 20 init_complete bucket index max shards: 1 2024-09-12T00:49:26.196 INFO:tasks.workunit.client.0.smithi073.stderr: -16> 2024-09-12T00:49:26.125+0000 7f48bc546800 20 Filter name: none 2024-09-12T00:49:26.196 INFO:tasks.workunit.client.0.smithi073.stderr: -15> 2024-09-12T00:49:26.125+0000 7f46e97fa640 20 reqs_thread_entry: start 2024-09-12T00:49:26.196 INFO:tasks.workunit.client.0.smithi073.stderr: -14> 2024-09-12T00:49:26.125+0000 7f48bc546800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:49:26.196 INFO:tasks.workunit.client.0.smithi073.stderr: -13> 2024-09-12T00:49:26.125+0000 7f48bc546800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.196 INFO:tasks.workunit.client.0.smithi073.stderr: -12> 2024-09-12T00:49:26.125+0000 7f48bc546800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:49:26.196 INFO:tasks.workunit.client.0.smithi073.stderr: -11> 2024-09-12T00:49:26.125+0000 7f48bc546800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:49:26.196 INFO:tasks.workunit.client.0.smithi073.stderr: -10> 2024-09-12T00:49:26.125+0000 7f48bc546800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:49:26.197 INFO:tasks.workunit.client.0.smithi073.stderr: -9> 2024-09-12T00:49:26.126+0000 7f48bc546800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24 : miss 2024-09-12T00:49:26.197 INFO:tasks.workunit.client.0.smithi073.stderr: -8> 2024-09-12T00:49:26.126+0000 7f48bc546800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.197 INFO:tasks.workunit.client.0.smithi073.stderr: -7> 2024-09-12T00:49:26.126+0000 7f48bc546800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:49:26.197 INFO:tasks.workunit.client.0.smithi073.stderr: -6> 2024-09-12T00:49:26.126+0000 7f48bc546800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24 info.flags=0x17 2024-09-12T00:49:26.197 INFO:tasks.workunit.client.0.smithi073.stderr: -5> 2024-09-12T00:49:26.126+0000 7f48bc546800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24 to cache LRU end 2024-09-12T00:49:26.197 INFO:tasks.workunit.client.0.smithi073.stderr: -4> 2024-09-12T00:49:26.126+0000 7f48bc546800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:26.197 INFO:tasks.workunit.client.0.smithi073.stderr: -3> 2024-09-12T00:49:26.126+0000 7f48bc546800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:26.197 INFO:tasks.workunit.client.0.smithi073.stderr: -2> 2024-09-12T00:49:26.126+0000 7f48bc546800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24 2024-09-12T00:49:26.197 INFO:tasks.workunit.client.0.smithi073.stderr: -1> 2024-09-12T00:49:26.129+0000 7f48bc546800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f48bc546800 time 2024-09-12T00:49:26.129531+0000 2024-09-12T00:49:26.197 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:49:26.197 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:26.197 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:49:26.197 INFO:tasks.workunit.client.0.smithi073.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f48bfb8c71a] 2024-09-12T00:49:26.197 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f48bfb8c8d8] 2024-09-12T00:49:26.198 INFO:tasks.workunit.client.0.smithi073.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55abcdb0b641] 2024-09-12T00:49:26.198 INFO:tasks.workunit.client.0.smithi073.stderr: 4: radosgw-admin(+0xd878e8) [0x55abce01d8e8] 2024-09-12T00:49:26.198 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55abcdb1b31d] 2024-09-12T00:49:26.198 INFO:tasks.workunit.client.0.smithi073.stderr: 6: main() 2024-09-12T00:49:26.198 INFO:tasks.workunit.client.0.smithi073.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f48be829590] 2024-09-12T00:49:26.198 INFO:tasks.workunit.client.0.smithi073.stderr: 8: __libc_start_main() 2024-09-12T00:49:26.198 INFO:tasks.workunit.client.0.smithi073.stderr: 9: _start() 2024-09-12T00:49:26.198 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:26.198 INFO:tasks.workunit.client.0.smithi073.stderr: 0> 2024-09-12T00:49:26.130+0000 7f48bc546800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:49:26.198 INFO:tasks.workunit.client.0.smithi073.stderr: in thread 7f48bc546800 thread_name:radosgw-admin 2024-09-12T00:49:26.198 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:26.199 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:49:26.199 INFO:tasks.workunit.client.0.smithi073.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f48be83e6f0] 2024-09-12T00:49:26.199 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f48be88b99c] 2024-09-12T00:49:26.199 INFO:tasks.workunit.client.0.smithi073.stderr: 3: raise() 2024-09-12T00:49:26.199 INFO:tasks.workunit.client.0.smithi073.stderr: 4: abort() 2024-09-12T00:49:26.199 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f48bfb8c774] 2024-09-12T00:49:26.199 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f48bfb8c8d8] 2024-09-12T00:49:26.199 INFO:tasks.workunit.client.0.smithi073.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55abcdb0b641] 2024-09-12T00:49:26.199 INFO:tasks.workunit.client.0.smithi073.stderr: 8: radosgw-admin(+0xd878e8) [0x55abce01d8e8] 2024-09-12T00:49:26.199 INFO:tasks.workunit.client.0.smithi073.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55abcdb1b31d] 2024-09-12T00:49:26.199 INFO:tasks.workunit.client.0.smithi073.stderr: 10: main() 2024-09-12T00:49:26.199 INFO:tasks.workunit.client.0.smithi073.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f48be829590] 2024-09-12T00:49:26.199 INFO:tasks.workunit.client.0.smithi073.stderr: 12: __libc_start_main() 2024-09-12T00:49:26.200 INFO:tasks.workunit.client.0.smithi073.stderr: 13: _start() 2024-09-12T00:49:26.200 INFO:tasks.workunit.client.0.smithi073.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:49:26.200 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:26.200 INFO:tasks.workunit.client.0.smithi073.stderr:--- logging levels --- 2024-09-12T00:49:26.200 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 none 2024-09-12T00:49:26.200 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 lockdep 2024-09-12T00:49:26.200 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 context 2024-09-12T00:49:26.200 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 crush 2024-09-12T00:49:26.200 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds 2024-09-12T00:49:26.200 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_balancer 2024-09-12T00:49:26.200 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_locker 2024-09-12T00:49:26.200 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_log 2024-09-12T00:49:26.200 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_log_expire 2024-09-12T00:49:26.200 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_migrator 2024-09-12T00:49:26.201 INFO:tasks.workunit.client.0.smithi073.stderr: 3/ 5 mds_quiesce 2024-09-12T00:49:26.201 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 buffer 2024-09-12T00:49:26.201 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 timer 2024-09-12T00:49:26.201 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 filer 2024-09-12T00:49:26.201 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 striper 2024-09-12T00:49:26.201 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 objecter 2024-09-12T00:49:26.201 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rados 2024-09-12T00:49:26.201 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd 2024-09-12T00:49:26.201 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_mirror 2024-09-12T00:49:26.201 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_replay 2024-09-12T00:49:26.201 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_pwl 2024-09-12T00:49:26.201 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 journaler 2024-09-12T00:49:26.201 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 objectcacher 2024-09-12T00:49:26.201 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:49:26.202 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 client 2024-09-12T00:49:26.202 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 osd 2024-09-12T00:49:26.202 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 optracker 2024-09-12T00:49:26.202 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 objclass 2024-09-12T00:49:26.202 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 filestore 2024-09-12T00:49:26.202 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 journal 2024-09-12T00:49:26.202 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 0 ms 2024-09-12T00:49:26.202 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mon 2024-09-12T00:49:26.202 INFO:tasks.workunit.client.0.smithi073.stderr: 0/10 monc 2024-09-12T00:49:26.203 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 paxos 2024-09-12T00:49:26.203 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 tp 2024-09-12T00:49:26.203 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 auth 2024-09-12T00:49:26.203 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 crypto 2024-09-12T00:49:26.203 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 finisher 2024-09-12T00:49:26.203 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 reserver 2024-09-12T00:49:26.203 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 heartbeatmap 2024-09-12T00:49:26.203 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 perfcounter 2024-09-12T00:49:26.203 INFO:tasks.workunit.client.0.smithi073.stderr: 20/20 rgw 2024-09-12T00:49:26.203 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_sync 2024-09-12T00:49:26.203 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_datacache 2024-09-12T00:49:26.203 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_access 2024-09-12T00:49:26.204 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:49:26.204 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_flight 2024-09-12T00:49:26.204 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:49:26.204 INFO:tasks.workunit.client.0.smithi073.stderr: 20/20 rgw_notification 2024-09-12T00:49:26.204 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 javaclient 2024-09-12T00:49:26.204 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 asok 2024-09-12T00:49:26.204 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 throttle 2024-09-12T00:49:26.204 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 0 refs 2024-09-12T00:49:26.204 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 compressor 2024-09-12T00:49:26.204 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 bluestore 2024-09-12T00:49:26.204 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 bluefs 2024-09-12T00:49:26.204 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 bdev 2024-09-12T00:49:26.204 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 kstore 2024-09-12T00:49:26.204 INFO:tasks.workunit.client.0.smithi073.stderr: 4/ 5 rocksdb 2024-09-12T00:49:26.205 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 fuse 2024-09-12T00:49:26.205 INFO:tasks.workunit.client.0.smithi073.stderr: 2/ 5 mgr 2024-09-12T00:49:26.205 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mgrc 2024-09-12T00:49:26.205 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 dpdk 2024-09-12T00:49:26.205 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 eventtrace 2024-09-12T00:49:26.205 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 prioritycache 2024-09-12T00:49:26.205 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 test 2024-09-12T00:49:26.205 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:49:26.205 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cephsqlite 2024-09-12T00:49:26.205 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:49:26.205 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore 2024-09-12T00:49:26.205 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_onode 2024-09-12T00:49:26.205 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_odata 2024-09-12T00:49:26.205 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_omap 2024-09-12T00:49:26.206 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_tm 2024-09-12T00:49:26.206 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_t 2024-09-12T00:49:26.206 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:49:26.206 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_epm 2024-09-12T00:49:26.206 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_lba 2024-09-12T00:49:26.206 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:49:26.206 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_cache 2024-09-12T00:49:26.206 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_journal 2024-09-12T00:49:26.206 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_device 2024-09-12T00:49:26.206 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_backref 2024-09-12T00:49:26.206 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 alienstore 2024-09-12T00:49:26.206 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mclock 2024-09-12T00:49:26.206 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cyanstore 2024-09-12T00:49:26.207 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 ceph_exporter 2024-09-12T00:49:26.207 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 memstore 2024-09-12T00:49:26.207 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 trace 2024-09-12T00:49:26.207 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 ceph_dedup 2024-09-12T00:49:26.207 INFO:tasks.workunit.client.0.smithi073.stderr: -2/-2 (syslog threshold) 2024-09-12T00:49:26.207 INFO:tasks.workunit.client.0.smithi073.stderr: 99/99 (stderr threshold) 2024-09-12T00:49:26.207 INFO:tasks.workunit.client.0.smithi073.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:49:26.207 INFO:tasks.workunit.client.0.smithi073.stderr: 7f46e97fa640 / http_manager 2024-09-12T00:49:26.207 INFO:tasks.workunit.client.0.smithi073.stderr: 7f46eb7fe640 / http_manager 2024-09-12T00:49:26.207 INFO:tasks.workunit.client.0.smithi073.stderr: 7f4770fe1640 / rgw_dt_lg_renew 2024-09-12T00:49:26.207 INFO:tasks.workunit.client.0.smithi073.stderr: 7f478bfff640 / ms_dispatch 2024-09-12T00:49:26.207 INFO:tasks.workunit.client.0.smithi073.stderr: 7f479dffb640 / io_context_pool 2024-09-12T00:49:26.207 INFO:tasks.workunit.client.0.smithi073.stderr: 7f479ffff640 / ms_dispatch 2024-09-12T00:49:26.207 INFO:tasks.workunit.client.0.smithi073.stderr: 7f47a6e05640 / ms_dispatch 2024-09-12T00:49:26.208 INFO:tasks.workunit.client.0.smithi073.stderr: 7f47a8608640 / io_context_pool 2024-09-12T00:49:26.208 INFO:tasks.workunit.client.0.smithi073.stderr: 7f48b9836640 / msgr-worker-2 2024-09-12T00:49:26.208 INFO:tasks.workunit.client.0.smithi073.stderr: 7f48ba037640 / msgr-worker-1 2024-09-12T00:49:26.208 INFO:tasks.workunit.client.0.smithi073.stderr: 7f48ba838640 / msgr-worker-0 2024-09-12T00:49:26.208 INFO:tasks.workunit.client.0.smithi073.stderr: 7f48bb039640 / io_context_pool 2024-09-12T00:49:26.208 INFO:tasks.workunit.client.0.smithi073.stderr: 7f48bc546800 / radosgw-admin 2024-09-12T00:49:26.208 INFO:tasks.workunit.client.0.smithi073.stderr: max_recent 500 2024-09-12T00:49:26.208 INFO:tasks.workunit.client.0.smithi073.stderr: max_new 1000 2024-09-12T00:49:26.208 INFO:tasks.workunit.client.0.smithi073.stderr: log_file /var/log/ceph/ceph-client.admin.98934.log 2024-09-12T00:49:26.208 INFO:tasks.workunit.client.0.smithi073.stderr:--- end dump of recent events --- 2024-09-12T00:49:26.208 INFO:tasks.workunit.client.0.smithi073.stderr:--- begin dump of recent events --- 2024-09-12T00:49:26.208 INFO:tasks.workunit.client.0.smithi073.stderr: -499> 2024-09-12T00:49:25.873+0000 7f48ba037640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:26.208 INFO:tasks.workunit.client.0.smithi073.stderr: -498> 2024-09-12T00:49:25.873+0000 7f48ba838640 10 monclient(hunting): handle_auth_done global_id 6636 payload 274 2024-09-12T00:49:26.209 INFO:tasks.workunit.client.0.smithi073.stderr: -497> 2024-09-12T00:49:25.873+0000 7f48ba838640 10 monclient: _finish_hunting 0 2024-09-12T00:49:26.209 INFO:tasks.workunit.client.0.smithi073.stderr: -496> 2024-09-12T00:49:25.873+0000 7f48ba838640 1 monclient: found mon.noname-a 2024-09-12T00:49:26.209 INFO:tasks.workunit.client.0.smithi073.stderr: -495> 2024-09-12T00:49:25.873+0000 7f48ba838640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:49:26.209 INFO:tasks.workunit.client.0.smithi073.stderr: -494> 2024-09-12T00:49:25.874+0000 7f47a8608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:26.209 INFO:tasks.workunit.client.0.smithi073.stderr: -493> 2024-09-12T00:49:25.874+0000 7f47a8608640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:49:26.209 INFO:tasks.workunit.client.0.smithi073.stderr: -492> 2024-09-12T00:49:25.874+0000 7f47a8608640 10 monclient: dump: 2024-09-12T00:49:26.209 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:49:26.209 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:49:26.209 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:49:26.209 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:49:26.209 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:26.209 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:49:26.209 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:49:26.210 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:49:26.210 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:49:26.210 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:26.210 INFO:tasks.workunit.client.0.smithi073.stderr: -491> 2024-09-12T00:49:25.874+0000 7f47a8608640 10 monclient: _finish_auth 0 2024-09-12T00:49:26.210 INFO:tasks.workunit.client.0.smithi073.stderr: -490> 2024-09-12T00:49:25.874+0000 7f47a8608640 10 monclient: _check_auth_tickets 2024-09-12T00:49:26.210 INFO:tasks.workunit.client.0.smithi073.stderr: -489> 2024-09-12T00:49:25.874+0000 7f47a8608640 10 monclient: handle_config config(0 keys) 2024-09-12T00:49:26.210 INFO:tasks.workunit.client.0.smithi073.stderr: -488> 2024-09-12T00:49:25.874+0000 7f47a8608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:26.210 INFO:tasks.workunit.client.0.smithi073.stderr: -487> 2024-09-12T00:49:25.874+0000 7f47a8608640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:49:26.210 INFO:tasks.workunit.client.0.smithi073.stderr: -486> 2024-09-12T00:49:25.874+0000 7f47a8608640 10 monclient: dump: 2024-09-12T00:49:26.210 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:49:26.210 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:49:26.210 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:49:26.210 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:49:26.210 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:26.211 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:49:26.211 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:49:26.211 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:49:26.211 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:49:26.211 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:26.211 INFO:tasks.workunit.client.0.smithi073.stderr: -485> 2024-09-12T00:49:25.874+0000 7f48bc546800 5 monclient: authenticate success, global_id 6636 2024-09-12T00:49:26.211 INFO:tasks.workunit.client.0.smithi073.stderr: -484> 2024-09-12T00:49:25.874+0000 7f48bc546800 10 monclient: get_monmap_and_config success 2024-09-12T00:49:26.211 INFO:tasks.workunit.client.0.smithi073.stderr: -483> 2024-09-12T00:49:25.874+0000 7f48bc546800 4 set_mon_vals no callback set 2024-09-12T00:49:26.211 INFO:tasks.workunit.client.0.smithi073.stderr: -482> 2024-09-12T00:49:25.874+0000 7f48bc546800 10 monclient: shutdown 2024-09-12T00:49:26.211 INFO:tasks.workunit.client.0.smithi073.stderr: -481> 2024-09-12T00:49:25.874+0000 7f48bc546800 5 asok(0x55abcfd69630) unregister_commands rotate-key 2024-09-12T00:49:26.211 INFO:tasks.workunit.client.0.smithi073.stderr: -480> 2024-09-12T00:49:25.874+0000 7f48bc546800 10 monclient: build_initial_monmap 2024-09-12T00:49:26.211 INFO:tasks.workunit.client.0.smithi073.stderr: -479> 2024-09-12T00:49:25.874+0000 7f48bc546800 1 build_initial for_mkfs: 0 2024-09-12T00:49:26.211 INFO:tasks.workunit.client.0.smithi073.stderr: -478> 2024-09-12T00:49:25.874+0000 7f48bc546800 10 monclient: monmap: 2024-09-12T00:49:26.212 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:49:26.212 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:49:26.212 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:49:26.212 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:49:26.212 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:49:26.212 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:49:26.212 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:49:26.212 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:49:26.212 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:49:26.212 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:26.212 INFO:tasks.workunit.client.0.smithi073.stderr: -477> 2024-09-12T00:49:25.874+0000 7f48bc546800 5 AuthRegistry(0x55abcff8f4c0) adding auth protocol: cephx 2024-09-12T00:49:26.212 INFO:tasks.workunit.client.0.smithi073.stderr: -476> 2024-09-12T00:49:25.874+0000 7f48bc546800 5 AuthRegistry(0x55abcff8f4c0) adding auth protocol: cephx 2024-09-12T00:49:26.212 INFO:tasks.workunit.client.0.smithi073.stderr: -475> 2024-09-12T00:49:25.874+0000 7f48bc546800 5 AuthRegistry(0x55abcff8f4c0) adding auth protocol: cephx 2024-09-12T00:49:26.212 INFO:tasks.workunit.client.0.smithi073.stderr: -474> 2024-09-12T00:49:25.874+0000 7f48bc546800 5 AuthRegistry(0x55abcff8f4c0) adding con mode: secure 2024-09-12T00:49:26.213 INFO:tasks.workunit.client.0.smithi073.stderr: -473> 2024-09-12T00:49:25.874+0000 7f48bc546800 5 AuthRegistry(0x55abcff8f4c0) adding con mode: crc 2024-09-12T00:49:26.213 INFO:tasks.workunit.client.0.smithi073.stderr: -472> 2024-09-12T00:49:25.874+0000 7f48bc546800 5 AuthRegistry(0x55abcff8f4c0) adding con mode: secure 2024-09-12T00:49:26.213 INFO:tasks.workunit.client.0.smithi073.stderr: -471> 2024-09-12T00:49:25.874+0000 7f48bc546800 5 AuthRegistry(0x55abcff8f4c0) adding con mode: crc 2024-09-12T00:49:26.213 INFO:tasks.workunit.client.0.smithi073.stderr: -470> 2024-09-12T00:49:25.874+0000 7f48bc546800 5 AuthRegistry(0x55abcff8f4c0) adding con mode: secure 2024-09-12T00:49:26.213 INFO:tasks.workunit.client.0.smithi073.stderr: -469> 2024-09-12T00:49:25.874+0000 7f48bc546800 5 AuthRegistry(0x55abcff8f4c0) adding con mode: crc 2024-09-12T00:49:26.213 INFO:tasks.workunit.client.0.smithi073.stderr: -468> 2024-09-12T00:49:25.874+0000 7f48bc546800 5 AuthRegistry(0x55abcff8f4c0) adding con mode: crc 2024-09-12T00:49:26.213 INFO:tasks.workunit.client.0.smithi073.stderr: -467> 2024-09-12T00:49:25.874+0000 7f48bc546800 5 AuthRegistry(0x55abcff8f4c0) adding con mode: secure 2024-09-12T00:49:26.213 INFO:tasks.workunit.client.0.smithi073.stderr: -466> 2024-09-12T00:49:25.874+0000 7f48bc546800 5 AuthRegistry(0x55abcff8f4c0) adding con mode: crc 2024-09-12T00:49:26.213 INFO:tasks.workunit.client.0.smithi073.stderr: -465> 2024-09-12T00:49:25.874+0000 7f48bc546800 5 AuthRegistry(0x55abcff8f4c0) adding con mode: secure 2024-09-12T00:49:26.213 INFO:tasks.workunit.client.0.smithi073.stderr: -464> 2024-09-12T00:49:25.874+0000 7f48bc546800 5 AuthRegistry(0x55abcff8f4c0) adding con mode: crc 2024-09-12T00:49:26.213 INFO:tasks.workunit.client.0.smithi073.stderr: -463> 2024-09-12T00:49:25.874+0000 7f48bc546800 5 AuthRegistry(0x55abcff8f4c0) adding con mode: secure 2024-09-12T00:49:26.213 INFO:tasks.workunit.client.0.smithi073.stderr: -462> 2024-09-12T00:49:25.875+0000 7f48bc546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:26.213 INFO:tasks.workunit.client.0.smithi073.stderr: -461> 2024-09-12T00:49:25.875+0000 7f48bc546800 1 librados: starting msgr at 2024-09-12T00:49:26.214 INFO:tasks.workunit.client.0.smithi073.stderr: -460> 2024-09-12T00:49:25.875+0000 7f48bc546800 1 librados: starting objecter 2024-09-12T00:49:26.214 INFO:tasks.workunit.client.0.smithi073.stderr: -459> 2024-09-12T00:49:25.875+0000 7f48bc546800 5 asok(0x55abcfd69630) register_command objecter_requests hook 0x55abcffb3e10 2024-09-12T00:49:26.214 INFO:tasks.workunit.client.0.smithi073.stderr: -458> 2024-09-12T00:49:25.875+0000 7f48bc546800 1 librados: setting wanted keys 2024-09-12T00:49:26.214 INFO:tasks.workunit.client.0.smithi073.stderr: -457> 2024-09-12T00:49:25.875+0000 7f48bc546800 1 librados: calling monclient init 2024-09-12T00:49:26.214 INFO:tasks.workunit.client.0.smithi073.stderr: -456> 2024-09-12T00:49:25.875+0000 7f48bc546800 10 monclient: init 2024-09-12T00:49:26.214 INFO:tasks.workunit.client.0.smithi073.stderr: -455> 2024-09-12T00:49:25.875+0000 7f48bc546800 5 AuthRegistry(0x55abcff898e0) adding auth protocol: cephx 2024-09-12T00:49:26.214 INFO:tasks.workunit.client.0.smithi073.stderr: -454> 2024-09-12T00:49:25.875+0000 7f48bc546800 5 AuthRegistry(0x55abcff898e0) adding auth protocol: cephx 2024-09-12T00:49:26.214 INFO:tasks.workunit.client.0.smithi073.stderr: -453> 2024-09-12T00:49:25.875+0000 7f48bc546800 5 AuthRegistry(0x55abcff898e0) adding auth protocol: cephx 2024-09-12T00:49:26.214 INFO:tasks.workunit.client.0.smithi073.stderr: -452> 2024-09-12T00:49:25.875+0000 7f48bc546800 5 AuthRegistry(0x55abcff898e0) adding con mode: secure 2024-09-12T00:49:26.214 INFO:tasks.workunit.client.0.smithi073.stderr: -451> 2024-09-12T00:49:25.875+0000 7f48bc546800 5 AuthRegistry(0x55abcff898e0) adding con mode: crc 2024-09-12T00:49:26.214 INFO:tasks.workunit.client.0.smithi073.stderr: -450> 2024-09-12T00:49:25.875+0000 7f48bc546800 5 AuthRegistry(0x55abcff898e0) adding con mode: secure 2024-09-12T00:49:26.214 INFO:tasks.workunit.client.0.smithi073.stderr: -449> 2024-09-12T00:49:25.875+0000 7f48bc546800 5 AuthRegistry(0x55abcff898e0) adding con mode: crc 2024-09-12T00:49:26.214 INFO:tasks.workunit.client.0.smithi073.stderr: -448> 2024-09-12T00:49:25.875+0000 7f48bc546800 5 AuthRegistry(0x55abcff898e0) adding con mode: secure 2024-09-12T00:49:26.214 INFO:tasks.workunit.client.0.smithi073.stderr: -447> 2024-09-12T00:49:25.875+0000 7f48bc546800 5 AuthRegistry(0x55abcff898e0) adding con mode: crc 2024-09-12T00:49:26.215 INFO:tasks.workunit.client.0.smithi073.stderr: -446> 2024-09-12T00:49:25.875+0000 7f48bc546800 5 AuthRegistry(0x55abcff898e0) adding con mode: crc 2024-09-12T00:49:26.215 INFO:tasks.workunit.client.0.smithi073.stderr: -445> 2024-09-12T00:49:25.875+0000 7f48bc546800 5 AuthRegistry(0x55abcff898e0) adding con mode: secure 2024-09-12T00:49:26.215 INFO:tasks.workunit.client.0.smithi073.stderr: -444> 2024-09-12T00:49:25.875+0000 7f48bc546800 5 AuthRegistry(0x55abcff898e0) adding con mode: crc 2024-09-12T00:49:26.215 INFO:tasks.workunit.client.0.smithi073.stderr: -443> 2024-09-12T00:49:25.875+0000 7f48bc546800 5 AuthRegistry(0x55abcff898e0) adding con mode: secure 2024-09-12T00:49:26.215 INFO:tasks.workunit.client.0.smithi073.stderr: -442> 2024-09-12T00:49:25.875+0000 7f48bc546800 5 AuthRegistry(0x55abcff898e0) adding con mode: crc 2024-09-12T00:49:26.215 INFO:tasks.workunit.client.0.smithi073.stderr: -441> 2024-09-12T00:49:25.875+0000 7f48bc546800 5 AuthRegistry(0x55abcff898e0) adding con mode: secure 2024-09-12T00:49:26.215 INFO:tasks.workunit.client.0.smithi073.stderr: -440> 2024-09-12T00:49:25.875+0000 7f48bc546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:26.215 INFO:tasks.workunit.client.0.smithi073.stderr: -439> 2024-09-12T00:49:25.875+0000 7f48bc546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:26.215 INFO:tasks.workunit.client.0.smithi073.stderr: -438> 2024-09-12T00:49:25.875+0000 7f48bc546800 5 asok(0x55abcfd69630) register_command rotate-key hook 0x55abcff89a28 2024-09-12T00:49:26.215 INFO:tasks.workunit.client.0.smithi073.stderr: -437> 2024-09-12T00:49:25.875+0000 7f48bc546800 10 monclient: _reopen_session rank -1 2024-09-12T00:49:26.215 INFO:tasks.workunit.client.0.smithi073.stderr: -436> 2024-09-12T00:49:25.875+0000 7f48bc546800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:49:26.215 INFO:tasks.workunit.client.0.smithi073.stderr: -435> 2024-09-12T00:49:25.875+0000 7f48bc546800 10 monclient(hunting): picked mon.noname-c con 0x55abcfe41da0 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:49:26.215 INFO:tasks.workunit.client.0.smithi073.stderr: -434> 2024-09-12T00:49:25.875+0000 7f48bc546800 10 monclient(hunting): picked mon.noname-b con 0x55abcfecf690 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:49:26.216 INFO:tasks.workunit.client.0.smithi073.stderr: -433> 2024-09-12T00:49:25.875+0000 7f48bc546800 10 monclient(hunting): picked mon.noname-a con 0x55abcfed7f90 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:49:26.216 INFO:tasks.workunit.client.0.smithi073.stderr: -432> 2024-09-12T00:49:25.875+0000 7f48bc546800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:26.216 INFO:tasks.workunit.client.0.smithi073.stderr: -431> 2024-09-12T00:49:25.875+0000 7f48bc546800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:26.216 INFO:tasks.workunit.client.0.smithi073.stderr: -430> 2024-09-12T00:49:25.875+0000 7f48bc546800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:26.216 INFO:tasks.workunit.client.0.smithi073.stderr: -429> 2024-09-12T00:49:25.875+0000 7f48bc546800 10 monclient(hunting): _renew_subs 2024-09-12T00:49:26.216 INFO:tasks.workunit.client.0.smithi073.stderr: -428> 2024-09-12T00:49:25.875+0000 7f48bc546800 10 monclient(hunting): authenticate will time out at 2026.545906s 2024-09-12T00:49:26.216 INFO:tasks.workunit.client.0.smithi073.stderr: -427> 2024-09-12T00:49:25.875+0000 7f48ba037640 10 monclient(hunting): get_auth_request con 0x55abcfe41da0 auth_method 0 2024-09-12T00:49:26.216 INFO:tasks.workunit.client.0.smithi073.stderr: -426> 2024-09-12T00:49:25.876+0000 7f48ba037640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:26.216 INFO:tasks.workunit.client.0.smithi073.stderr: -425> 2024-09-12T00:49:25.876+0000 7f48ba037640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:26.216 INFO:tasks.workunit.client.0.smithi073.stderr: -424> 2024-09-12T00:49:25.876+0000 7f48ba037640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:26.216 INFO:tasks.workunit.client.0.smithi073.stderr: -423> 2024-09-12T00:49:25.876+0000 7f48ba838640 10 monclient(hunting): get_auth_request con 0x55abcfed7f90 auth_method 0 2024-09-12T00:49:26.216 INFO:tasks.workunit.client.0.smithi073.stderr: -422> 2024-09-12T00:49:25.876+0000 7f48ba838640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:26.216 INFO:tasks.workunit.client.0.smithi073.stderr: -421> 2024-09-12T00:49:25.876+0000 7f48ba838640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:26.217 INFO:tasks.workunit.client.0.smithi073.stderr: -420> 2024-09-12T00:49:25.876+0000 7f48ba838640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:26.217 INFO:tasks.workunit.client.0.smithi073.stderr: -419> 2024-09-12T00:49:25.876+0000 7f48ba037640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:26.217 INFO:tasks.workunit.client.0.smithi073.stderr: -418> 2024-09-12T00:49:25.876+0000 7f48ba037640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:26.217 INFO:tasks.workunit.client.0.smithi073.stderr: -417> 2024-09-12T00:49:25.876+0000 7f48ba037640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:26.217 INFO:tasks.workunit.client.0.smithi073.stderr: -416> 2024-09-12T00:49:25.876+0000 7f48ba838640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:26.217 INFO:tasks.workunit.client.0.smithi073.stderr: -415> 2024-09-12T00:49:25.876+0000 7f48ba838640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:26.217 INFO:tasks.workunit.client.0.smithi073.stderr: -414> 2024-09-12T00:49:25.876+0000 7f48ba838640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:26.217 INFO:tasks.workunit.client.0.smithi073.stderr: -413> 2024-09-12T00:49:25.876+0000 7f48b9836640 10 monclient(hunting): get_auth_request con 0x55abcfecf690 auth_method 0 2024-09-12T00:49:26.217 INFO:tasks.workunit.client.0.smithi073.stderr: -412> 2024-09-12T00:49:25.876+0000 7f48b9836640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:26.217 INFO:tasks.workunit.client.0.smithi073.stderr: -411> 2024-09-12T00:49:25.876+0000 7f48b9836640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:26.217 INFO:tasks.workunit.client.0.smithi073.stderr: -410> 2024-09-12T00:49:25.876+0000 7f48b9836640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:26.217 INFO:tasks.workunit.client.0.smithi073.stderr: -409> 2024-09-12T00:49:25.876+0000 7f48ba037640 10 monclient(hunting): handle_auth_done global_id 6299 payload 824 2024-09-12T00:49:26.217 INFO:tasks.workunit.client.0.smithi073.stderr: -408> 2024-09-12T00:49:25.876+0000 7f48ba037640 10 monclient: _finish_hunting 0 2024-09-12T00:49:26.218 INFO:tasks.workunit.client.0.smithi073.stderr: -407> 2024-09-12T00:49:25.876+0000 7f48ba037640 1 monclient: found mon.noname-c 2024-09-12T00:49:26.218 INFO:tasks.workunit.client.0.smithi073.stderr: -406> 2024-09-12T00:49:25.876+0000 7f48ba037640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.73:3301/0 2024-09-12T00:49:26.218 INFO:tasks.workunit.client.0.smithi073.stderr: -405> 2024-09-12T00:49:25.876+0000 7f47a6e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:26.218 INFO:tasks.workunit.client.0.smithi073.stderr: -404> 2024-09-12T00:49:25.876+0000 7f47a6e05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:49:26.218 INFO:tasks.workunit.client.0.smithi073.stderr: -403> 2024-09-12T00:49:25.876+0000 7f47a6e05640 10 monclient: dump: 2024-09-12T00:49:26.218 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:49:26.218 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:49:26.218 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:49:26.218 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:49:26.218 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:26.218 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:49:26.218 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:49:26.218 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:49:26.218 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:49:26.219 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:26.219 INFO:tasks.workunit.client.0.smithi073.stderr: -402> 2024-09-12T00:49:25.876+0000 7f47a6e05640 10 monclient: _finish_auth 0 2024-09-12T00:49:26.219 INFO:tasks.workunit.client.0.smithi073.stderr: -401> 2024-09-12T00:49:25.876+0000 7f47a6e05640 10 monclient: _check_auth_tickets 2024-09-12T00:49:26.219 INFO:tasks.workunit.client.0.smithi073.stderr: -400> 2024-09-12T00:49:25.876+0000 7f47a6e05640 10 monclient: handle_config config(0 keys) 2024-09-12T00:49:26.219 INFO:tasks.workunit.client.0.smithi073.stderr: -399> 2024-09-12T00:49:25.876+0000 7f47a6e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:26.219 INFO:tasks.workunit.client.0.smithi073.stderr: -398> 2024-09-12T00:49:25.876+0000 7f47a6e05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:49:26.219 INFO:tasks.workunit.client.0.smithi073.stderr: -397> 2024-09-12T00:49:25.876+0000 7f47a6e05640 10 monclient: dump: 2024-09-12T00:49:26.219 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:49:26.219 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:49:26.219 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:49:26.219 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:49:26.219 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:26.219 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:49:26.220 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:49:26.220 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:49:26.220 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:49:26.220 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:26.220 INFO:tasks.workunit.client.0.smithi073.stderr: -396> 2024-09-12T00:49:25.876+0000 7f48bc546800 5 monclient: authenticate success, global_id 6299 2024-09-12T00:49:26.220 INFO:tasks.workunit.client.0.smithi073.stderr: -395> 2024-09-12T00:49:25.876+0000 7f48bc546800 10 monclient: _renew_subs 2024-09-12T00:49:26.220 INFO:tasks.workunit.client.0.smithi073.stderr: -394> 2024-09-12T00:49:25.876+0000 7f48bc546800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:49:26.220 INFO:tasks.workunit.client.0.smithi073.stderr: -393> 2024-09-12T00:49:25.876+0000 7f47a8608640 4 set_mon_vals no callback set 2024-09-12T00:49:26.220 INFO:tasks.workunit.client.0.smithi073.stderr: -392> 2024-09-12T00:49:25.876+0000 7f48bc546800 10 monclient: _renew_subs 2024-09-12T00:49:26.220 INFO:tasks.workunit.client.0.smithi073.stderr: -391> 2024-09-12T00:49:25.876+0000 7f48bc546800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:49:26.220 INFO:tasks.workunit.client.0.smithi073.stderr: -390> 2024-09-12T00:49:25.876+0000 7f48bc546800 1 librados: init done 2024-09-12T00:49:26.220 INFO:tasks.workunit.client.0.smithi073.stderr: -389> 2024-09-12T00:49:25.878+0000 7f47a6e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:49:26.220 INFO:tasks.workunit.client.0.smithi073.stderr: -388> 2024-09-12T00:49:25.878+0000 7f47a6e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:49:26.221 INFO:tasks.workunit.client.0.smithi073.stderr: -387> 2024-09-12T00:49:25.878+0000 7f47a6e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:49:26.221 INFO:tasks.workunit.client.0.smithi073.stderr: -386> 2024-09-12T00:49:25.878+0000 7f48b9836640 10 monclient: get_auth_request con 0x7f47a0076470 auth_method 0 2024-09-12T00:49:26.221 INFO:tasks.workunit.client.0.smithi073.stderr: -385> 2024-09-12T00:49:25.878+0000 7f48ba838640 10 monclient: get_auth_request con 0x55abcffb2b10 auth_method 0 2024-09-12T00:49:26.221 INFO:tasks.workunit.client.0.smithi073.stderr: -384> 2024-09-12T00:49:25.879+0000 7f48ba037640 10 monclient: get_auth_request con 0x55abcffd52e0 auth_method 0 2024-09-12T00:49:26.221 INFO:tasks.workunit.client.0.smithi073.stderr: -383> 2024-09-12T00:49:25.880+0000 7f48b9836640 10 monclient: get_auth_request con 0x55abcffd9690 auth_method 0 2024-09-12T00:49:26.221 INFO:tasks.workunit.client.0.smithi073.stderr: -382> 2024-09-12T00:49:25.882+0000 7f48bc546800 10 monclient: build_initial_monmap 2024-09-12T00:49:26.221 INFO:tasks.workunit.client.0.smithi073.stderr: -381> 2024-09-12T00:49:25.882+0000 7f48bc546800 1 build_initial for_mkfs: 0 2024-09-12T00:49:26.221 INFO:tasks.workunit.client.0.smithi073.stderr: -380> 2024-09-12T00:49:25.882+0000 7f48bc546800 10 monclient: monmap: 2024-09-12T00:49:26.221 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:49:26.221 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:49:26.221 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:49:26.221 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:49:26.221 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:49:26.221 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:49:26.222 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:49:26.222 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:49:26.222 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:49:26.222 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:26.222 INFO:tasks.workunit.client.0.smithi073.stderr: -379> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffde550) adding auth protocol: cephx 2024-09-12T00:49:26.222 INFO:tasks.workunit.client.0.smithi073.stderr: -378> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffde550) adding auth protocol: cephx 2024-09-12T00:49:26.222 INFO:tasks.workunit.client.0.smithi073.stderr: -377> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffde550) adding auth protocol: cephx 2024-09-12T00:49:26.222 INFO:tasks.workunit.client.0.smithi073.stderr: -376> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffde550) adding con mode: secure 2024-09-12T00:49:26.222 INFO:tasks.workunit.client.0.smithi073.stderr: -375> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffde550) adding con mode: crc 2024-09-12T00:49:26.222 INFO:tasks.workunit.client.0.smithi073.stderr: -374> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffde550) adding con mode: secure 2024-09-12T00:49:26.222 INFO:tasks.workunit.client.0.smithi073.stderr: -373> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffde550) adding con mode: crc 2024-09-12T00:49:26.222 INFO:tasks.workunit.client.0.smithi073.stderr: -372> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffde550) adding con mode: secure 2024-09-12T00:49:26.222 INFO:tasks.workunit.client.0.smithi073.stderr: -371> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffde550) adding con mode: crc 2024-09-12T00:49:26.223 INFO:tasks.workunit.client.0.smithi073.stderr: -370> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffde550) adding con mode: crc 2024-09-12T00:49:26.223 INFO:tasks.workunit.client.0.smithi073.stderr: -369> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffde550) adding con mode: secure 2024-09-12T00:49:26.223 INFO:tasks.workunit.client.0.smithi073.stderr: -368> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffde550) adding con mode: crc 2024-09-12T00:49:26.223 INFO:tasks.workunit.client.0.smithi073.stderr: -367> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffde550) adding con mode: secure 2024-09-12T00:49:26.223 INFO:tasks.workunit.client.0.smithi073.stderr: -366> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffde550) adding con mode: crc 2024-09-12T00:49:26.223 INFO:tasks.workunit.client.0.smithi073.stderr: -365> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffde550) adding con mode: secure 2024-09-12T00:49:26.223 INFO:tasks.workunit.client.0.smithi073.stderr: -364> 2024-09-12T00:49:25.882+0000 7f48bc546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:26.223 INFO:tasks.workunit.client.0.smithi073.stderr: -363> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 asok(0x55abcfd69630) register_command objecter_requests cmddesc objecter_requests hook 0x55abcffe1f60 EEXIST 2024-09-12T00:49:26.223 INFO:tasks.workunit.client.0.smithi073.stderr: -362> 2024-09-12T00:49:25.882+0000 7f48bc546800 10 monclient: init 2024-09-12T00:49:26.223 INFO:tasks.workunit.client.0.smithi073.stderr: -361> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffdcc28) adding auth protocol: cephx 2024-09-12T00:49:26.223 INFO:tasks.workunit.client.0.smithi073.stderr: -360> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffdcc28) adding auth protocol: cephx 2024-09-12T00:49:26.223 INFO:tasks.workunit.client.0.smithi073.stderr: -359> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffdcc28) adding auth protocol: cephx 2024-09-12T00:49:26.223 INFO:tasks.workunit.client.0.smithi073.stderr: -358> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffdcc28) adding con mode: secure 2024-09-12T00:49:26.224 INFO:tasks.workunit.client.0.smithi073.stderr: -357> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffdcc28) adding con mode: crc 2024-09-12T00:49:26.224 INFO:tasks.workunit.client.0.smithi073.stderr: -356> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffdcc28) adding con mode: secure 2024-09-12T00:49:26.224 INFO:tasks.workunit.client.0.smithi073.stderr: -355> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffdcc28) adding con mode: crc 2024-09-12T00:49:26.224 INFO:tasks.workunit.client.0.smithi073.stderr: -354> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffdcc28) adding con mode: secure 2024-09-12T00:49:26.224 INFO:tasks.workunit.client.0.smithi073.stderr: -353> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffdcc28) adding con mode: crc 2024-09-12T00:49:26.224 INFO:tasks.workunit.client.0.smithi073.stderr: -352> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffdcc28) adding con mode: crc 2024-09-12T00:49:26.224 INFO:tasks.workunit.client.0.smithi073.stderr: -351> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffdcc28) adding con mode: secure 2024-09-12T00:49:26.224 INFO:tasks.workunit.client.0.smithi073.stderr: -350> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffdcc28) adding con mode: crc 2024-09-12T00:49:26.224 INFO:tasks.workunit.client.0.smithi073.stderr: -349> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffdcc28) adding con mode: secure 2024-09-12T00:49:26.224 INFO:tasks.workunit.client.0.smithi073.stderr: -348> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffdcc28) adding con mode: crc 2024-09-12T00:49:26.224 INFO:tasks.workunit.client.0.smithi073.stderr: -347> 2024-09-12T00:49:25.882+0000 7f48bc546800 5 AuthRegistry(0x55abcffdcc28) adding con mode: secure 2024-09-12T00:49:26.224 INFO:tasks.workunit.client.0.smithi073.stderr: -346> 2024-09-12T00:49:25.882+0000 7f48bc546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:26.224 INFO:tasks.workunit.client.0.smithi073.stderr: -345> 2024-09-12T00:49:25.883+0000 7f48bc546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:26.225 INFO:tasks.workunit.client.0.smithi073.stderr: -344> 2024-09-12T00:49:25.883+0000 7f48bc546800 5 asok(0x55abcfd69630) register_command rotate-key cmddesc rotate-key hook 0x55abcffdcd70 EEXIST 2024-09-12T00:49:26.225 INFO:tasks.workunit.client.0.smithi073.stderr: -343> 2024-09-12T00:49:25.883+0000 7f48bc546800 10 monclient: _reopen_session rank -1 2024-09-12T00:49:26.225 INFO:tasks.workunit.client.0.smithi073.stderr: -342> 2024-09-12T00:49:25.883+0000 7f48bc546800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:49:26.225 INFO:tasks.workunit.client.0.smithi073.stderr: -341> 2024-09-12T00:49:25.883+0000 7f48bc546800 10 monclient(hunting): picked mon.noname-c con 0x55abd0005c50 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:49:26.225 INFO:tasks.workunit.client.0.smithi073.stderr: -340> 2024-09-12T00:49:25.883+0000 7f48bc546800 10 monclient(hunting): picked mon.noname-a con 0x55abd0007f20 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:49:26.225 INFO:tasks.workunit.client.0.smithi073.stderr: -339> 2024-09-12T00:49:25.883+0000 7f48bc546800 10 monclient(hunting): picked mon.noname-b con 0x55abd0004420 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:49:26.225 INFO:tasks.workunit.client.0.smithi073.stderr: -338> 2024-09-12T00:49:25.883+0000 7f48bc546800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:26.225 INFO:tasks.workunit.client.0.smithi073.stderr: -337> 2024-09-12T00:49:25.883+0000 7f48bc546800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:26.225 INFO:tasks.workunit.client.0.smithi073.stderr: -336> 2024-09-12T00:49:25.883+0000 7f48bc546800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:26.225 INFO:tasks.workunit.client.0.smithi073.stderr: -335> 2024-09-12T00:49:25.883+0000 7f48bc546800 10 monclient(hunting): _renew_subs 2024-09-12T00:49:26.225 INFO:tasks.workunit.client.0.smithi073.stderr: -334> 2024-09-12T00:49:25.883+0000 7f48bc546800 10 monclient(hunting): authenticate will time out at 2026.553277s 2024-09-12T00:49:26.225 INFO:tasks.workunit.client.0.smithi073.stderr: -333> 2024-09-12T00:49:25.883+0000 7f48ba037640 10 monclient(hunting): get_auth_request con 0x55abd0005c50 auth_method 0 2024-09-12T00:49:26.225 INFO:tasks.workunit.client.0.smithi073.stderr: -332> 2024-09-12T00:49:25.883+0000 7f48ba037640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:26.226 INFO:tasks.workunit.client.0.smithi073.stderr: -331> 2024-09-12T00:49:25.883+0000 7f48ba037640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:26.226 INFO:tasks.workunit.client.0.smithi073.stderr: -330> 2024-09-12T00:49:25.883+0000 7f48ba037640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:26.226 INFO:tasks.workunit.client.0.smithi073.stderr: -329> 2024-09-12T00:49:25.883+0000 7f48b9836640 10 monclient(hunting): get_auth_request con 0x55abd0007f20 auth_method 0 2024-09-12T00:49:26.226 INFO:tasks.workunit.client.0.smithi073.stderr: -328> 2024-09-12T00:49:25.883+0000 7f48b9836640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:26.226 INFO:tasks.workunit.client.0.smithi073.stderr: -327> 2024-09-12T00:49:25.883+0000 7f48b9836640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:26.226 INFO:tasks.workunit.client.0.smithi073.stderr: -326> 2024-09-12T00:49:25.883+0000 7f48b9836640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:26.226 INFO:tasks.workunit.client.0.smithi073.stderr: -325> 2024-09-12T00:49:25.883+0000 7f48ba037640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:26.226 INFO:tasks.workunit.client.0.smithi073.stderr: -324> 2024-09-12T00:49:25.883+0000 7f48ba037640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:26.226 INFO:tasks.workunit.client.0.smithi073.stderr: -323> 2024-09-12T00:49:25.883+0000 7f48ba037640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:26.226 INFO:tasks.workunit.client.0.smithi073.stderr: -322> 2024-09-12T00:49:25.883+0000 7f48b9836640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:26.226 INFO:tasks.workunit.client.0.smithi073.stderr: -321> 2024-09-12T00:49:25.883+0000 7f48b9836640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:26.226 INFO:tasks.workunit.client.0.smithi073.stderr: -320> 2024-09-12T00:49:25.883+0000 7f48b9836640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:26.226 INFO:tasks.workunit.client.0.smithi073.stderr: -319> 2024-09-12T00:49:25.883+0000 7f48ba838640 10 monclient(hunting): get_auth_request con 0x55abd0004420 auth_method 0 2024-09-12T00:49:26.227 INFO:tasks.workunit.client.0.smithi073.stderr: -318> 2024-09-12T00:49:25.883+0000 7f48ba838640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:26.227 INFO:tasks.workunit.client.0.smithi073.stderr: -317> 2024-09-12T00:49:25.883+0000 7f48ba838640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:26.227 INFO:tasks.workunit.client.0.smithi073.stderr: -316> 2024-09-12T00:49:25.883+0000 7f48ba838640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:26.227 INFO:tasks.workunit.client.0.smithi073.stderr: -315> 2024-09-12T00:49:25.883+0000 7f48ba037640 10 monclient(hunting): handle_auth_done global_id 6302 payload 824 2024-09-12T00:49:26.227 INFO:tasks.workunit.client.0.smithi073.stderr: -314> 2024-09-12T00:49:25.883+0000 7f48ba037640 10 monclient: _finish_hunting 0 2024-09-12T00:49:26.227 INFO:tasks.workunit.client.0.smithi073.stderr: -313> 2024-09-12T00:49:25.883+0000 7f48ba037640 1 monclient: found mon.noname-c 2024-09-12T00:49:26.227 INFO:tasks.workunit.client.0.smithi073.stderr: -312> 2024-09-12T00:49:25.883+0000 7f48ba037640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.73:3301/0 2024-09-12T00:49:26.227 INFO:tasks.workunit.client.0.smithi073.stderr: -311> 2024-09-12T00:49:25.883+0000 7f479ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:26.227 INFO:tasks.workunit.client.0.smithi073.stderr: -310> 2024-09-12T00:49:25.883+0000 7f479ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:49:26.227 INFO:tasks.workunit.client.0.smithi073.stderr: -309> 2024-09-12T00:49:25.883+0000 7f479ffff640 10 monclient: dump: 2024-09-12T00:49:26.227 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:49:26.227 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:49:26.227 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:49:26.228 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:49:26.228 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:26.228 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:49:26.228 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:49:26.228 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:49:26.228 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:49:26.228 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:26.228 INFO:tasks.workunit.client.0.smithi073.stderr: -308> 2024-09-12T00:49:25.883+0000 7f479ffff640 10 monclient: _finish_auth 0 2024-09-12T00:49:26.228 INFO:tasks.workunit.client.0.smithi073.stderr: -307> 2024-09-12T00:49:25.883+0000 7f479ffff640 10 monclient: _check_auth_tickets 2024-09-12T00:49:26.228 INFO:tasks.workunit.client.0.smithi073.stderr: -306> 2024-09-12T00:49:25.883+0000 7f479ffff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:49:26.228 INFO:tasks.workunit.client.0.smithi073.stderr: -305> 2024-09-12T00:49:25.883+0000 7f479ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:26.228 INFO:tasks.workunit.client.0.smithi073.stderr: -304> 2024-09-12T00:49:25.883+0000 7f479ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:49:26.228 INFO:tasks.workunit.client.0.smithi073.stderr: -303> 2024-09-12T00:49:25.883+0000 7f479ffff640 10 monclient: dump: 2024-09-12T00:49:26.228 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:49:26.229 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:49:26.229 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:49:26.229 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:49:26.229 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:26.229 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:49:26.229 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:49:26.229 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:49:26.229 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:49:26.229 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:26.229 INFO:tasks.workunit.client.0.smithi073.stderr: -302> 2024-09-12T00:49:25.883+0000 7f48bc546800 5 monclient: authenticate success, global_id 6302 2024-09-12T00:49:26.229 INFO:tasks.workunit.client.0.smithi073.stderr: -301> 2024-09-12T00:49:25.883+0000 7f48bb039640 4 set_mon_vals no callback set 2024-09-12T00:49:26.229 INFO:tasks.workunit.client.0.smithi073.stderr: -300> 2024-09-12T00:49:25.883+0000 7f48bc546800 10 monclient: _renew_subs 2024-09-12T00:49:26.229 INFO:tasks.workunit.client.0.smithi073.stderr: -299> 2024-09-12T00:49:25.883+0000 7f48bc546800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:49:26.230 INFO:tasks.workunit.client.0.smithi073.stderr: -298> 2024-09-12T00:49:25.883+0000 7f48bc546800 10 monclient: _renew_subs 2024-09-12T00:49:26.230 INFO:tasks.workunit.client.0.smithi073.stderr: -297> 2024-09-12T00:49:25.883+0000 7f48bc546800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:49:26.230 INFO:tasks.workunit.client.0.smithi073.stderr: -296> 2024-09-12T00:49:25.885+0000 7f479ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:49:26.230 INFO:tasks.workunit.client.0.smithi073.stderr: -295> 2024-09-12T00:49:25.885+0000 7f479ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:49:26.230 INFO:tasks.workunit.client.0.smithi073.stderr: -294> 2024-09-12T00:49:25.885+0000 7f479ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:49:26.230 INFO:tasks.workunit.client.0.smithi073.stderr: -293> 2024-09-12T00:49:25.885+0000 7f48b9836640 10 monclient: get_auth_request con 0x7f4794076380 auth_method 0 2024-09-12T00:49:26.230 INFO:tasks.workunit.client.0.smithi073.stderr: -292> 2024-09-12T00:49:25.885+0000 7f48bc546800 10 monclient: get_monmap_and_config 2024-09-12T00:49:26.230 INFO:tasks.workunit.client.0.smithi073.stderr: -291> 2024-09-12T00:49:25.885+0000 7f48bc546800 10 monclient: build_initial_monmap 2024-09-12T00:49:26.230 INFO:tasks.workunit.client.0.smithi073.stderr: -290> 2024-09-12T00:49:25.885+0000 7f48bc546800 1 build_initial for_mkfs: 0 2024-09-12T00:49:26.230 INFO:tasks.workunit.client.0.smithi073.stderr: -289> 2024-09-12T00:49:25.885+0000 7f48bc546800 10 monclient: monmap: 2024-09-12T00:49:26.230 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:49:26.230 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:49:26.230 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:49:26.230 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:49:26.231 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:49:26.231 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:49:26.231 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:49:26.231 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:49:26.231 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:49:26.231 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:26.231 INFO:tasks.workunit.client.0.smithi073.stderr: -288> 2024-09-12T00:49:25.885+0000 7f48bc546800 5 AuthRegistry(0x55abd0025790) adding auth protocol: cephx 2024-09-12T00:49:26.231 INFO:tasks.workunit.client.0.smithi073.stderr: -287> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x55abd0025790) adding auth protocol: cephx 2024-09-12T00:49:26.231 INFO:tasks.workunit.client.0.smithi073.stderr: -286> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x55abd0025790) adding auth protocol: cephx 2024-09-12T00:49:26.231 INFO:tasks.workunit.client.0.smithi073.stderr: -285> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x55abd0025790) adding con mode: secure 2024-09-12T00:49:26.231 INFO:tasks.workunit.client.0.smithi073.stderr: -284> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x55abd0025790) adding con mode: crc 2024-09-12T00:49:26.231 INFO:tasks.workunit.client.0.smithi073.stderr: -283> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x55abd0025790) adding con mode: secure 2024-09-12T00:49:26.231 INFO:tasks.workunit.client.0.smithi073.stderr: -282> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x55abd0025790) adding con mode: crc 2024-09-12T00:49:26.232 INFO:tasks.workunit.client.0.smithi073.stderr: -281> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x55abd0025790) adding con mode: secure 2024-09-12T00:49:26.232 INFO:tasks.workunit.client.0.smithi073.stderr: -280> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x55abd0025790) adding con mode: crc 2024-09-12T00:49:26.232 INFO:tasks.workunit.client.0.smithi073.stderr: -279> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x55abd0025790) adding con mode: crc 2024-09-12T00:49:26.232 INFO:tasks.workunit.client.0.smithi073.stderr: -278> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x55abd0025790) adding con mode: secure 2024-09-12T00:49:26.232 INFO:tasks.workunit.client.0.smithi073.stderr: -277> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x55abd0025790) adding con mode: crc 2024-09-12T00:49:26.232 INFO:tasks.workunit.client.0.smithi073.stderr: -276> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x55abd0025790) adding con mode: secure 2024-09-12T00:49:26.232 INFO:tasks.workunit.client.0.smithi073.stderr: -275> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x55abd0025790) adding con mode: crc 2024-09-12T00:49:26.232 INFO:tasks.workunit.client.0.smithi073.stderr: -274> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x55abd0025790) adding con mode: secure 2024-09-12T00:49:26.232 INFO:tasks.workunit.client.0.smithi073.stderr: -273> 2024-09-12T00:49:25.886+0000 7f48bc546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:26.232 INFO:tasks.workunit.client.0.smithi073.stderr: -272> 2024-09-12T00:49:25.886+0000 7f48bc546800 10 monclient: init 2024-09-12T00:49:26.232 INFO:tasks.workunit.client.0.smithi073.stderr: -271> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e8cc0) adding auth protocol: cephx 2024-09-12T00:49:26.232 INFO:tasks.workunit.client.0.smithi073.stderr: -270> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e8cc0) adding auth protocol: cephx 2024-09-12T00:49:26.232 INFO:tasks.workunit.client.0.smithi073.stderr: -269> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e8cc0) adding auth protocol: cephx 2024-09-12T00:49:26.232 INFO:tasks.workunit.client.0.smithi073.stderr: -268> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e8cc0) adding con mode: secure 2024-09-12T00:49:26.233 INFO:tasks.workunit.client.0.smithi073.stderr: -267> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e8cc0) adding con mode: crc 2024-09-12T00:49:26.233 INFO:tasks.workunit.client.0.smithi073.stderr: -266> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e8cc0) adding con mode: secure 2024-09-12T00:49:26.233 INFO:tasks.workunit.client.0.smithi073.stderr: -265> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e8cc0) adding con mode: crc 2024-09-12T00:49:26.233 INFO:tasks.workunit.client.0.smithi073.stderr: -264> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e8cc0) adding con mode: secure 2024-09-12T00:49:26.233 INFO:tasks.workunit.client.0.smithi073.stderr: -263> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e8cc0) adding con mode: crc 2024-09-12T00:49:26.233 INFO:tasks.workunit.client.0.smithi073.stderr: -262> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e8cc0) adding con mode: crc 2024-09-12T00:49:26.233 INFO:tasks.workunit.client.0.smithi073.stderr: -261> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e8cc0) adding con mode: secure 2024-09-12T00:49:26.233 INFO:tasks.workunit.client.0.smithi073.stderr: -260> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e8cc0) adding con mode: crc 2024-09-12T00:49:26.233 INFO:tasks.workunit.client.0.smithi073.stderr: -259> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e8cc0) adding con mode: secure 2024-09-12T00:49:26.233 INFO:tasks.workunit.client.0.smithi073.stderr: -258> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e8cc0) adding con mode: crc 2024-09-12T00:49:26.233 INFO:tasks.workunit.client.0.smithi073.stderr: -257> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e8cc0) adding con mode: secure 2024-09-12T00:49:26.233 INFO:tasks.workunit.client.0.smithi073.stderr: -256> 2024-09-12T00:49:25.886+0000 7f48bc546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:26.233 INFO:tasks.workunit.client.0.smithi073.stderr: -255> 2024-09-12T00:49:25.886+0000 7f48bc546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:26.234 INFO:tasks.workunit.client.0.smithi073.stderr: -254> 2024-09-12T00:49:25.886+0000 7f48bc546800 5 asok(0x55abcfd69630) register_command rotate-key cmddesc rotate-key hook 0x7ffded8e8e08 EEXIST 2024-09-12T00:49:26.234 INFO:tasks.workunit.client.0.smithi073.stderr: -253> 2024-09-12T00:49:25.886+0000 7f48bc546800 10 monclient: _reopen_session rank -1 2024-09-12T00:49:26.234 INFO:tasks.workunit.client.0.smithi073.stderr: -252> 2024-09-12T00:49:25.886+0000 7f48bc546800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:49:26.234 INFO:tasks.workunit.client.0.smithi073.stderr: -251> 2024-09-12T00:49:25.886+0000 7f48bc546800 10 monclient(hunting): picked mon.noname-a con 0x55abd0059de0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:49:26.234 INFO:tasks.workunit.client.0.smithi073.stderr: -250> 2024-09-12T00:49:25.886+0000 7f48bc546800 10 monclient(hunting): picked mon.noname-c con 0x55abd00552e0 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:49:26.234 INFO:tasks.workunit.client.0.smithi073.stderr: -249> 2024-09-12T00:49:25.886+0000 7f48bc546800 10 monclient(hunting): picked mon.noname-b con 0x55abd004b750 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:49:26.234 INFO:tasks.workunit.client.0.smithi073.stderr: -248> 2024-09-12T00:49:25.886+0000 7f48bc546800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:26.234 INFO:tasks.workunit.client.0.smithi073.stderr: -247> 2024-09-12T00:49:25.886+0000 7f48bc546800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:26.234 INFO:tasks.workunit.client.0.smithi073.stderr: -246> 2024-09-12T00:49:25.886+0000 7f48bc546800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:26.234 INFO:tasks.workunit.client.0.smithi073.stderr: -245> 2024-09-12T00:49:25.886+0000 7f48bc546800 10 monclient(hunting): _renew_subs 2024-09-12T00:49:26.234 INFO:tasks.workunit.client.0.smithi073.stderr: -244> 2024-09-12T00:49:25.886+0000 7f48bc546800 10 monclient(hunting): authenticate will time out at 2026.556885s 2024-09-12T00:49:26.234 INFO:tasks.workunit.client.0.smithi073.stderr: -243> 2024-09-12T00:49:25.886+0000 7f48ba037640 10 monclient(hunting): get_auth_request con 0x55abd0059de0 auth_method 0 2024-09-12T00:49:26.234 INFO:tasks.workunit.client.0.smithi073.stderr: -242> 2024-09-12T00:49:25.886+0000 7f48ba037640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:26.234 INFO:tasks.workunit.client.0.smithi073.stderr: -241> 2024-09-12T00:49:25.886+0000 7f48ba037640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:26.235 INFO:tasks.workunit.client.0.smithi073.stderr: -240> 2024-09-12T00:49:25.886+0000 7f48ba037640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:26.235 INFO:tasks.workunit.client.0.smithi073.stderr: -239> 2024-09-12T00:49:25.887+0000 7f48b9836640 10 monclient(hunting): get_auth_request con 0x55abd00552e0 auth_method 0 2024-09-12T00:49:26.235 INFO:tasks.workunit.client.0.smithi073.stderr: -238> 2024-09-12T00:49:25.887+0000 7f48b9836640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:26.235 INFO:tasks.workunit.client.0.smithi073.stderr: -237> 2024-09-12T00:49:25.887+0000 7f48b9836640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:26.235 INFO:tasks.workunit.client.0.smithi073.stderr: -236> 2024-09-12T00:49:25.887+0000 7f48b9836640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:26.235 INFO:tasks.workunit.client.0.smithi073.stderr: -235> 2024-09-12T00:49:25.887+0000 7f48ba037640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:26.235 INFO:tasks.workunit.client.0.smithi073.stderr: -234> 2024-09-12T00:49:25.887+0000 7f48ba037640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:26.235 INFO:tasks.workunit.client.0.smithi073.stderr: -233> 2024-09-12T00:49:25.887+0000 7f48ba037640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:26.235 INFO:tasks.workunit.client.0.smithi073.stderr: -232> 2024-09-12T00:49:25.887+0000 7f48b9836640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:26.235 INFO:tasks.workunit.client.0.smithi073.stderr: -231> 2024-09-12T00:49:25.887+0000 7f48b9836640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:26.235 INFO:tasks.workunit.client.0.smithi073.stderr: -230> 2024-09-12T00:49:25.887+0000 7f48b9836640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:26.235 INFO:tasks.workunit.client.0.smithi073.stderr: -229> 2024-09-12T00:49:25.887+0000 7f48ba838640 10 monclient(hunting): get_auth_request con 0x55abd004b750 auth_method 0 2024-09-12T00:49:26.235 INFO:tasks.workunit.client.0.smithi073.stderr: -228> 2024-09-12T00:49:25.887+0000 7f48ba838640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:26.236 INFO:tasks.workunit.client.0.smithi073.stderr: -227> 2024-09-12T00:49:25.887+0000 7f48ba838640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:26.236 INFO:tasks.workunit.client.0.smithi073.stderr: -226> 2024-09-12T00:49:25.887+0000 7f48ba838640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:26.236 INFO:tasks.workunit.client.0.smithi073.stderr: -225> 2024-09-12T00:49:25.887+0000 7f48ba037640 10 monclient(hunting): handle_auth_done global_id 6645 payload 274 2024-09-12T00:49:26.236 INFO:tasks.workunit.client.0.smithi073.stderr: -224> 2024-09-12T00:49:25.887+0000 7f48ba037640 10 monclient: _finish_hunting 0 2024-09-12T00:49:26.236 INFO:tasks.workunit.client.0.smithi073.stderr: -223> 2024-09-12T00:49:25.887+0000 7f48ba037640 1 monclient: found mon.noname-a 2024-09-12T00:49:26.236 INFO:tasks.workunit.client.0.smithi073.stderr: -222> 2024-09-12T00:49:25.887+0000 7f48ba037640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:49:26.236 INFO:tasks.workunit.client.0.smithi073.stderr: -221> 2024-09-12T00:49:25.887+0000 7f479dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:26.236 INFO:tasks.workunit.client.0.smithi073.stderr: -220> 2024-09-12T00:49:25.887+0000 7f479dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:49:26.236 INFO:tasks.workunit.client.0.smithi073.stderr: -219> 2024-09-12T00:49:25.887+0000 7f479dffb640 10 monclient: dump: 2024-09-12T00:49:26.236 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:49:26.236 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:49:26.236 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:49:26.236 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:49:26.237 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:26.237 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:49:26.237 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:49:26.237 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:49:26.237 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:49:26.237 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:26.237 INFO:tasks.workunit.client.0.smithi073.stderr: -218> 2024-09-12T00:49:25.887+0000 7f479dffb640 10 monclient: _finish_auth 0 2024-09-12T00:49:26.237 INFO:tasks.workunit.client.0.smithi073.stderr: -217> 2024-09-12T00:49:25.887+0000 7f479dffb640 10 monclient: _check_auth_tickets 2024-09-12T00:49:26.237 INFO:tasks.workunit.client.0.smithi073.stderr: -216> 2024-09-12T00:49:25.887+0000 7f479dffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:49:26.237 INFO:tasks.workunit.client.0.smithi073.stderr: -215> 2024-09-12T00:49:25.887+0000 7f479dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:26.237 INFO:tasks.workunit.client.0.smithi073.stderr: -214> 2024-09-12T00:49:25.887+0000 7f479dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:49:26.237 INFO:tasks.workunit.client.0.smithi073.stderr: -213> 2024-09-12T00:49:25.887+0000 7f479dffb640 10 monclient: dump: 2024-09-12T00:49:26.237 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:49:26.237 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:49:26.238 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:49:26.238 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:49:26.238 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:26.238 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:49:26.238 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:49:26.238 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:49:26.238 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:49:26.238 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:26.238 INFO:tasks.workunit.client.0.smithi073.stderr: -212> 2024-09-12T00:49:25.887+0000 7f48bc546800 5 monclient: authenticate success, global_id 6645 2024-09-12T00:49:26.238 INFO:tasks.workunit.client.0.smithi073.stderr: -211> 2024-09-12T00:49:25.887+0000 7f48bc546800 10 monclient: get_monmap_and_config success 2024-09-12T00:49:26.238 INFO:tasks.workunit.client.0.smithi073.stderr: -210> 2024-09-12T00:49:25.887+0000 7f48bc546800 4 set_mon_vals no callback set 2024-09-12T00:49:26.238 INFO:tasks.workunit.client.0.smithi073.stderr: -209> 2024-09-12T00:49:25.887+0000 7f48bc546800 10 monclient: shutdown 2024-09-12T00:49:26.238 INFO:tasks.workunit.client.0.smithi073.stderr: -208> 2024-09-12T00:49:25.888+0000 7f48bc546800 10 monclient: build_initial_monmap 2024-09-12T00:49:26.239 INFO:tasks.workunit.client.0.smithi073.stderr: -207> 2024-09-12T00:49:25.888+0000 7f48bc546800 1 build_initial for_mkfs: 0 2024-09-12T00:49:26.239 INFO:tasks.workunit.client.0.smithi073.stderr: -206> 2024-09-12T00:49:25.888+0000 7f48bc546800 10 monclient: monmap: 2024-09-12T00:49:26.239 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:49:26.239 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:49:26.239 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:49:26.239 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:49:26.239 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:49:26.239 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:49:26.239 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:49:26.239 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:49:26.239 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:49:26.239 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:26.239 INFO:tasks.workunit.client.0.smithi073.stderr: -205> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd004bc80) adding auth protocol: cephx 2024-09-12T00:49:26.239 INFO:tasks.workunit.client.0.smithi073.stderr: -204> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd004bc80) adding auth protocol: cephx 2024-09-12T00:49:26.240 INFO:tasks.workunit.client.0.smithi073.stderr: -203> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd004bc80) adding auth protocol: cephx 2024-09-12T00:49:26.240 INFO:tasks.workunit.client.0.smithi073.stderr: -202> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd004bc80) adding con mode: secure 2024-09-12T00:49:26.240 INFO:tasks.workunit.client.0.smithi073.stderr: -201> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd004bc80) adding con mode: crc 2024-09-12T00:49:26.240 INFO:tasks.workunit.client.0.smithi073.stderr: -200> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd004bc80) adding con mode: secure 2024-09-12T00:49:26.240 INFO:tasks.workunit.client.0.smithi073.stderr: -199> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd004bc80) adding con mode: crc 2024-09-12T00:49:26.240 INFO:tasks.workunit.client.0.smithi073.stderr: -198> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd004bc80) adding con mode: secure 2024-09-12T00:49:26.240 INFO:tasks.workunit.client.0.smithi073.stderr: -197> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd004bc80) adding con mode: crc 2024-09-12T00:49:26.240 INFO:tasks.workunit.client.0.smithi073.stderr: -196> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd004bc80) adding con mode: crc 2024-09-12T00:49:26.240 INFO:tasks.workunit.client.0.smithi073.stderr: -195> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd004bc80) adding con mode: secure 2024-09-12T00:49:26.240 INFO:tasks.workunit.client.0.smithi073.stderr: -194> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd004bc80) adding con mode: crc 2024-09-12T00:49:26.240 INFO:tasks.workunit.client.0.smithi073.stderr: -193> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd004bc80) adding con mode: secure 2024-09-12T00:49:26.240 INFO:tasks.workunit.client.0.smithi073.stderr: -192> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd004bc80) adding con mode: crc 2024-09-12T00:49:26.240 INFO:tasks.workunit.client.0.smithi073.stderr: -191> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd004bc80) adding con mode: secure 2024-09-12T00:49:26.240 INFO:tasks.workunit.client.0.smithi073.stderr: -190> 2024-09-12T00:49:25.888+0000 7f48bc546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:26.241 INFO:tasks.workunit.client.0.smithi073.stderr: -189> 2024-09-12T00:49:25.888+0000 7f48bc546800 1 librados: starting msgr at 2024-09-12T00:49:26.241 INFO:tasks.workunit.client.0.smithi073.stderr: -188> 2024-09-12T00:49:25.888+0000 7f48bc546800 1 librados: starting objecter 2024-09-12T00:49:26.241 INFO:tasks.workunit.client.0.smithi073.stderr: -187> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 asok(0x55abcfd69630) register_command objecter_requests cmddesc objecter_requests hook 0x55abcffcc140 EEXIST 2024-09-12T00:49:26.241 INFO:tasks.workunit.client.0.smithi073.stderr: -186> 2024-09-12T00:49:25.888+0000 7f48bc546800 1 librados: setting wanted keys 2024-09-12T00:49:26.241 INFO:tasks.workunit.client.0.smithi073.stderr: -185> 2024-09-12T00:49:25.888+0000 7f48bc546800 1 librados: calling monclient init 2024-09-12T00:49:26.241 INFO:tasks.workunit.client.0.smithi073.stderr: -184> 2024-09-12T00:49:25.888+0000 7f48bc546800 10 monclient: init 2024-09-12T00:49:26.241 INFO:tasks.workunit.client.0.smithi073.stderr: -183> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd001da00) adding auth protocol: cephx 2024-09-12T00:49:26.241 INFO:tasks.workunit.client.0.smithi073.stderr: -182> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd001da00) adding auth protocol: cephx 2024-09-12T00:49:26.241 INFO:tasks.workunit.client.0.smithi073.stderr: -181> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd001da00) adding auth protocol: cephx 2024-09-12T00:49:26.241 INFO:tasks.workunit.client.0.smithi073.stderr: -180> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd001da00) adding con mode: secure 2024-09-12T00:49:26.241 INFO:tasks.workunit.client.0.smithi073.stderr: -179> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd001da00) adding con mode: crc 2024-09-12T00:49:26.241 INFO:tasks.workunit.client.0.smithi073.stderr: -178> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd001da00) adding con mode: secure 2024-09-12T00:49:26.241 INFO:tasks.workunit.client.0.smithi073.stderr: -177> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd001da00) adding con mode: crc 2024-09-12T00:49:26.242 INFO:tasks.workunit.client.0.smithi073.stderr: -176> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd001da00) adding con mode: secure 2024-09-12T00:49:26.242 INFO:tasks.workunit.client.0.smithi073.stderr: -175> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd001da00) adding con mode: crc 2024-09-12T00:49:26.242 INFO:tasks.workunit.client.0.smithi073.stderr: -174> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd001da00) adding con mode: crc 2024-09-12T00:49:26.242 INFO:tasks.workunit.client.0.smithi073.stderr: -173> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd001da00) adding con mode: secure 2024-09-12T00:49:26.242 INFO:tasks.workunit.client.0.smithi073.stderr: -172> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd001da00) adding con mode: crc 2024-09-12T00:49:26.242 INFO:tasks.workunit.client.0.smithi073.stderr: -171> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd001da00) adding con mode: secure 2024-09-12T00:49:26.242 INFO:tasks.workunit.client.0.smithi073.stderr: -170> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd001da00) adding con mode: crc 2024-09-12T00:49:26.242 INFO:tasks.workunit.client.0.smithi073.stderr: -169> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 AuthRegistry(0x55abd001da00) adding con mode: secure 2024-09-12T00:49:26.242 INFO:tasks.workunit.client.0.smithi073.stderr: -168> 2024-09-12T00:49:25.888+0000 7f48bc546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:26.242 INFO:tasks.workunit.client.0.smithi073.stderr: -167> 2024-09-12T00:49:25.888+0000 7f48bc546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:26.242 INFO:tasks.workunit.client.0.smithi073.stderr: -166> 2024-09-12T00:49:25.888+0000 7f48bc546800 5 asok(0x55abcfd69630) register_command rotate-key cmddesc rotate-key hook 0x55abd001db48 EEXIST 2024-09-12T00:49:26.242 INFO:tasks.workunit.client.0.smithi073.stderr: -165> 2024-09-12T00:49:25.888+0000 7f48bc546800 10 monclient: _reopen_session rank -1 2024-09-12T00:49:26.242 INFO:tasks.workunit.client.0.smithi073.stderr: -164> 2024-09-12T00:49:25.889+0000 7f48bc546800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:49:26.242 INFO:tasks.workunit.client.0.smithi073.stderr: -163> 2024-09-12T00:49:25.889+0000 7f48bc546800 10 monclient(hunting): picked mon.noname-b con 0x55abd004b750 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:49:26.243 INFO:tasks.workunit.client.0.smithi073.stderr: -162> 2024-09-12T00:49:25.889+0000 7f48bc546800 10 monclient(hunting): picked mon.noname-c con 0x55abd00552e0 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:49:26.243 INFO:tasks.workunit.client.0.smithi073.stderr: -161> 2024-09-12T00:49:25.889+0000 7f48bc546800 10 monclient(hunting): picked mon.noname-a con 0x55abd0059de0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:49:26.243 INFO:tasks.workunit.client.0.smithi073.stderr: -160> 2024-09-12T00:49:25.889+0000 7f48bc546800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:26.243 INFO:tasks.workunit.client.0.smithi073.stderr: -159> 2024-09-12T00:49:25.889+0000 7f48bc546800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:26.243 INFO:tasks.workunit.client.0.smithi073.stderr: -158> 2024-09-12T00:49:25.889+0000 7f48bc546800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:26.243 INFO:tasks.workunit.client.0.smithi073.stderr: -157> 2024-09-12T00:49:25.889+0000 7f48bc546800 10 monclient(hunting): _renew_subs 2024-09-12T00:49:26.243 INFO:tasks.workunit.client.0.smithi073.stderr: -156> 2024-09-12T00:49:25.889+0000 7f48bc546800 10 monclient(hunting): authenticate will time out at 2026.559052s 2024-09-12T00:49:26.243 INFO:tasks.workunit.client.0.smithi073.stderr: -155> 2024-09-12T00:49:25.889+0000 7f48b9836640 10 monclient(hunting): get_auth_request con 0x55abd00552e0 auth_method 0 2024-09-12T00:49:26.243 INFO:tasks.workunit.client.0.smithi073.stderr: -154> 2024-09-12T00:49:25.889+0000 7f48b9836640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:26.243 INFO:tasks.workunit.client.0.smithi073.stderr: -153> 2024-09-12T00:49:25.889+0000 7f48b9836640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:26.243 INFO:tasks.workunit.client.0.smithi073.stderr: -152> 2024-09-12T00:49:25.889+0000 7f48b9836640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:26.243 INFO:tasks.workunit.client.0.smithi073.stderr: -151> 2024-09-12T00:49:25.889+0000 7f48ba838640 10 monclient(hunting): get_auth_request con 0x55abd0059de0 auth_method 0 2024-09-12T00:49:26.243 INFO:tasks.workunit.client.0.smithi073.stderr: -150> 2024-09-12T00:49:25.889+0000 7f48ba838640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:26.244 INFO:tasks.workunit.client.0.smithi073.stderr: -149> 2024-09-12T00:49:25.889+0000 7f48ba838640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:26.244 INFO:tasks.workunit.client.0.smithi073.stderr: -148> 2024-09-12T00:49:25.889+0000 7f48ba838640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:26.244 INFO:tasks.workunit.client.0.smithi073.stderr: -147> 2024-09-12T00:49:25.889+0000 7f48b9836640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:26.244 INFO:tasks.workunit.client.0.smithi073.stderr: -146> 2024-09-12T00:49:25.889+0000 7f48b9836640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:26.244 INFO:tasks.workunit.client.0.smithi073.stderr: -145> 2024-09-12T00:49:25.889+0000 7f48b9836640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:26.244 INFO:tasks.workunit.client.0.smithi073.stderr: -144> 2024-09-12T00:49:25.889+0000 7f48ba037640 10 monclient(hunting): get_auth_request con 0x55abd004b750 auth_method 0 2024-09-12T00:49:26.244 INFO:tasks.workunit.client.0.smithi073.stderr: -143> 2024-09-12T00:49:25.889+0000 7f48ba037640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:26.244 INFO:tasks.workunit.client.0.smithi073.stderr: -142> 2024-09-12T00:49:25.889+0000 7f48ba037640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:26.244 INFO:tasks.workunit.client.0.smithi073.stderr: -141> 2024-09-12T00:49:25.889+0000 7f48ba037640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:26.244 INFO:tasks.workunit.client.0.smithi073.stderr: -140> 2024-09-12T00:49:25.889+0000 7f48ba838640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:26.244 INFO:tasks.workunit.client.0.smithi073.stderr: -139> 2024-09-12T00:49:25.889+0000 7f48ba838640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:26.244 INFO:tasks.workunit.client.0.smithi073.stderr: -138> 2024-09-12T00:49:25.889+0000 7f48ba838640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:26.244 INFO:tasks.workunit.client.0.smithi073.stderr: -137> 2024-09-12T00:49:25.889+0000 7f48ba037640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:26.245 INFO:tasks.workunit.client.0.smithi073.stderr: -136> 2024-09-12T00:49:25.889+0000 7f48ba037640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:26.245 INFO:tasks.workunit.client.0.smithi073.stderr: -135> 2024-09-12T00:49:25.889+0000 7f48ba037640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:26.245 INFO:tasks.workunit.client.0.smithi073.stderr: -134> 2024-09-12T00:49:25.889+0000 7f48b9836640 10 monclient(hunting): handle_auth_done global_id 6308 payload 824 2024-09-12T00:49:26.245 INFO:tasks.workunit.client.0.smithi073.stderr: -133> 2024-09-12T00:49:25.889+0000 7f48b9836640 10 monclient: _finish_hunting 0 2024-09-12T00:49:26.245 INFO:tasks.workunit.client.0.smithi073.stderr: -132> 2024-09-12T00:49:25.889+0000 7f48b9836640 1 monclient: found mon.noname-c 2024-09-12T00:49:26.245 INFO:tasks.workunit.client.0.smithi073.stderr: -131> 2024-09-12T00:49:25.889+0000 7f48b9836640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.73:3301/0 2024-09-12T00:49:26.245 INFO:tasks.workunit.client.0.smithi073.stderr: -130> 2024-09-12T00:49:25.889+0000 7f478bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:26.245 INFO:tasks.workunit.client.0.smithi073.stderr: -129> 2024-09-12T00:49:25.889+0000 7f478bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:49:26.245 INFO:tasks.workunit.client.0.smithi073.stderr: -128> 2024-09-12T00:49:25.889+0000 7f478bfff640 10 monclient: dump: 2024-09-12T00:49:26.245 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:49:26.245 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:49:26.245 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:49:26.245 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:49:26.245 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:26.246 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:49:26.246 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:49:26.246 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:49:26.246 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:49:26.246 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:26.246 INFO:tasks.workunit.client.0.smithi073.stderr: -127> 2024-09-12T00:49:25.889+0000 7f478bfff640 10 monclient: _finish_auth 0 2024-09-12T00:49:26.246 INFO:tasks.workunit.client.0.smithi073.stderr: -126> 2024-09-12T00:49:25.889+0000 7f478bfff640 10 monclient: _check_auth_tickets 2024-09-12T00:49:26.246 INFO:tasks.workunit.client.0.smithi073.stderr: -125> 2024-09-12T00:49:25.889+0000 7f478bfff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:49:26.246 INFO:tasks.workunit.client.0.smithi073.stderr: -124> 2024-09-12T00:49:25.889+0000 7f478bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:26.246 INFO:tasks.workunit.client.0.smithi073.stderr: -123> 2024-09-12T00:49:25.889+0000 7f478bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:49:26.246 INFO:tasks.workunit.client.0.smithi073.stderr: -122> 2024-09-12T00:49:25.889+0000 7f478bfff640 10 monclient: dump: 2024-09-12T00:49:26.246 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:49:26.246 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:49:26.247 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:49:26.247 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:49:26.247 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:26.247 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:49:26.247 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:49:26.247 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:49:26.247 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:49:26.247 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:26.247 INFO:tasks.workunit.client.0.smithi073.stderr: -121> 2024-09-12T00:49:25.889+0000 7f48bc546800 5 monclient: authenticate success, global_id 6308 2024-09-12T00:49:26.247 INFO:tasks.workunit.client.0.smithi073.stderr: -120> 2024-09-12T00:49:25.889+0000 7f48bc546800 10 monclient: _renew_subs 2024-09-12T00:49:26.247 INFO:tasks.workunit.client.0.smithi073.stderr: -119> 2024-09-12T00:49:25.889+0000 7f48bc546800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:49:26.247 INFO:tasks.workunit.client.0.smithi073.stderr: -118> 2024-09-12T00:49:25.889+0000 7f479dffb640 4 set_mon_vals no callback set 2024-09-12T00:49:26.247 INFO:tasks.workunit.client.0.smithi073.stderr: -117> 2024-09-12T00:49:25.889+0000 7f48bc546800 10 monclient: _renew_subs 2024-09-12T00:49:26.247 INFO:tasks.workunit.client.0.smithi073.stderr: -116> 2024-09-12T00:49:25.889+0000 7f48bc546800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:49:26.248 INFO:tasks.workunit.client.0.smithi073.stderr: -115> 2024-09-12T00:49:25.889+0000 7f48bc546800 1 librados: init done 2024-09-12T00:49:26.248 INFO:tasks.workunit.client.0.smithi073.stderr: -114> 2024-09-12T00:49:25.889+0000 7f48bc546800 5 asok(0x55abcfd69630) register_command cr dump hook 0x55abd0050848 2024-09-12T00:49:26.248 INFO:tasks.workunit.client.0.smithi073.stderr: -113> 2024-09-12T00:49:25.891+0000 7f48bc546800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.248 INFO:tasks.workunit.client.0.smithi073.stderr: -112> 2024-09-12T00:49:25.892+0000 7f478bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:49:26.248 INFO:tasks.workunit.client.0.smithi073.stderr: -111> 2024-09-12T00:49:25.892+0000 7f478bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:49:26.248 INFO:tasks.workunit.client.0.smithi073.stderr: -110> 2024-09-12T00:49:25.892+0000 7f478bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:49:26.248 INFO:tasks.workunit.client.0.smithi073.stderr: -109> 2024-09-12T00:49:25.892+0000 7f48ba037640 10 monclient: get_auth_request con 0x7f4784076470 auth_method 0 2024-09-12T00:49:26.248 INFO:tasks.workunit.client.0.smithi073.stderr: -108> 2024-09-12T00:49:25.892+0000 7f48ba838640 10 monclient: get_auth_request con 0x55abd00741f0 auth_method 0 2024-09-12T00:49:26.248 INFO:tasks.workunit.client.0.smithi073.stderr: -107> 2024-09-12T00:49:25.893+0000 7f48bc546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:26.248 INFO:tasks.workunit.client.0.smithi073.stderr: -106> 2024-09-12T00:49:25.893+0000 7f48bc546800 20 realm 2024-09-12T00:49:26.248 INFO:tasks.workunit.client.0.smithi073.stderr: -105> 2024-09-12T00:49:25.893+0000 7f48bc546800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.248 INFO:tasks.workunit.client.0.smithi073.stderr: -104> 2024-09-12T00:49:25.893+0000 7f48bc546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:26.248 INFO:tasks.workunit.client.0.smithi073.stderr: -103> 2024-09-12T00:49:25.893+0000 7f48bc546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:26.249 INFO:tasks.workunit.client.0.smithi073.stderr: -102> 2024-09-12T00:49:25.893+0000 7f48bc546800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.249 INFO:tasks.workunit.client.0.smithi073.stderr: -101> 2024-09-12T00:49:25.893+0000 7f48bc546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:26.249 INFO:tasks.workunit.client.0.smithi073.stderr: -100> 2024-09-12T00:49:25.893+0000 7f48bc546800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.249 INFO:tasks.workunit.client.0.smithi073.stderr: -99> 2024-09-12T00:49:25.893+0000 7f48ba037640 10 monclient: get_auth_request con 0x55abd0078410 auth_method 0 2024-09-12T00:49:26.249 INFO:tasks.workunit.client.0.smithi073.stderr: -98> 2024-09-12T00:49:25.894+0000 7f48bc546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:26.249 INFO:tasks.workunit.client.0.smithi073.stderr: -97> 2024-09-12T00:49:25.894+0000 7f48bc546800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.249 INFO:tasks.workunit.client.0.smithi073.stderr: -96> 2024-09-12T00:49:25.894+0000 7f48b9836640 10 monclient: get_auth_request con 0x55abd007bc70 auth_method 0 2024-09-12T00:49:26.249 INFO:tasks.workunit.client.0.smithi073.stderr: -95> 2024-09-12T00:49:25.895+0000 7f48bc546800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:26.249 INFO:tasks.workunit.client.0.smithi073.stderr: -94> 2024-09-12T00:49:25.895+0000 7f48bc546800 20 searching for the correct realm 2024-09-12T00:49:26.249 INFO:tasks.workunit.client.0.smithi073.stderr: -93> 2024-09-12T00:49:25.895+0000 7f48ba838640 10 monclient: get_auth_request con 0x55abd00809f0 auth_method 0 2024-09-12T00:49:26.249 INFO:tasks.workunit.client.0.smithi073.stderr: -92> 2024-09-12T00:49:25.896+0000 7f48ba037640 10 monclient: get_auth_request con 0x7f48b4025040 auth_method 0 2024-09-12T00:49:26.249 INFO:tasks.workunit.client.0.smithi073.stderr: -91> 2024-09-12T00:49:25.896+0000 7f48b9836640 10 monclient: get_auth_request con 0x7f48ac0b6230 auth_method 0 2024-09-12T00:49:26.249 INFO:tasks.workunit.client.0.smithi073.stderr: -90> 2024-09-12T00:49:25.897+0000 7f48ba838640 10 monclient: get_auth_request con 0x7f48b0040030 auth_method 0 2024-09-12T00:49:26.249 INFO:tasks.workunit.client.0.smithi073.stderr: -89> 2024-09-12T00:49:25.897+0000 7f48ba838640 0 -- 172.21.15.73:0/819594272 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f48b0040030 msgr2=0x7f48b006b2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:49:26.250 INFO:tasks.workunit.client.0.smithi073.stderr: -88> 2024-09-12T00:49:26.099+0000 7f48ba838640 10 monclient: get_auth_request con 0x7f48b0040030 auth_method 0 2024-09-12T00:49:26.250 INFO:tasks.workunit.client.0.smithi073.stderr: -87> 2024-09-12T00:49:26.103+0000 7f48ba037640 10 monclient: get_auth_request con 0x7f48b4034410 auth_method 0 2024-09-12T00:49:26.250 INFO:tasks.workunit.client.0.smithi073.stderr: -86> 2024-09-12T00:49:26.104+0000 7f48ba838640 0 -- 172.21.15.73:0/819594272 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f48b0040030 msgr2=0x7f48b006b2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:26.250 INFO:tasks.workunit.client.0.smithi073.stderr: -85> 2024-09-12T00:49:26.104+0000 7f478bfff640 1 client.6308.objecter ms_handle_reset 0x7f48b0040030 session 0x7f48b006c650 osd.4 2024-09-12T00:49:26.250 INFO:tasks.workunit.client.0.smithi073.stderr: -84> 2024-09-12T00:49:26.104+0000 7f478bfff640 10 monclient: _renew_subs 2024-09-12T00:49:26.250 INFO:tasks.workunit.client.0.smithi073.stderr: -83> 2024-09-12T00:49:26.104+0000 7f478bfff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:49:26.250 INFO:tasks.workunit.client.0.smithi073.stderr: -82> 2024-09-12T00:49:26.104+0000 7f48ba838640 10 monclient: get_auth_request con 0x7f4784086310 auth_method 0 2024-09-12T00:49:26.250 INFO:tasks.workunit.client.0.smithi073.stderr: -81> 2024-09-12T00:49:26.108+0000 7f48bc546800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:49:26.250 INFO:tasks.workunit.client.0.smithi073.stderr: -80> 2024-09-12T00:49:26.108+0000 7f48bc546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:26.250 INFO:tasks.workunit.client.0.smithi073.stderr: -79> 2024-09-12T00:49:26.108+0000 7f48bc546800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:49:26.251 INFO:tasks.workunit.client.0.smithi073.stderr: -78> 2024-09-12T00:49:26.108+0000 7f48bc546800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:26.251 INFO:tasks.workunit.client.0.smithi073.stderr: -77> 2024-09-12T00:49:26.108+0000 7f48bc546800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:26.251 INFO:tasks.workunit.client.0.smithi073.stderr: -76> 2024-09-12T00:49:26.108+0000 7f48bc546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:26.251 INFO:tasks.workunit.client.0.smithi073.stderr: -75> 2024-09-12T00:49:26.108+0000 7f48bc546800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.251 INFO:tasks.workunit.client.0.smithi073.stderr: -74> 2024-09-12T00:49:26.108+0000 7f48bc546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:26.251 INFO:tasks.workunit.client.0.smithi073.stderr: -73> 2024-09-12T00:49:26.108+0000 7f48bc546800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.251 INFO:tasks.workunit.client.0.smithi073.stderr: -72> 2024-09-12T00:49:26.109+0000 7f48bc546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:26.251 INFO:tasks.workunit.client.0.smithi073.stderr: -71> 2024-09-12T00:49:26.109+0000 7f48bc546800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.251 INFO:tasks.workunit.client.0.smithi073.stderr: -70> 2024-09-12T00:49:26.109+0000 7f48bc546800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:26.251 INFO:tasks.workunit.client.0.smithi073.stderr: -69> 2024-09-12T00:49:26.109+0000 7f48bc546800 20 zone default found 2024-09-12T00:49:26.251 INFO:tasks.workunit.client.0.smithi073.stderr: -68> 2024-09-12T00:49:26.109+0000 7f48bc546800 4 Realm: () 2024-09-12T00:49:26.251 INFO:tasks.workunit.client.0.smithi073.stderr: -67> 2024-09-12T00:49:26.109+0000 7f48bc546800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:49:26.251 INFO:tasks.workunit.client.0.smithi073.stderr: -66> 2024-09-12T00:49:26.109+0000 7f48bc546800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:49:26.252 INFO:tasks.workunit.client.0.smithi073.stderr: -65> 2024-09-12T00:49:26.109+0000 7f48bc546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:26.252 INFO:tasks.workunit.client.0.smithi073.stderr: -64> 2024-09-12T00:49:26.109+0000 7f48bc546800 20 zonegroup default 2024-09-12T00:49:26.252 INFO:tasks.workunit.client.0.smithi073.stderr: -63> 2024-09-12T00:49:26.109+0000 7f48bc546800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.252 INFO:tasks.workunit.client.0.smithi073.stderr: -62> 2024-09-12T00:49:26.109+0000 7f48bc546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:26.252 INFO:tasks.workunit.client.0.smithi073.stderr: -61> 2024-09-12T00:49:26.109+0000 7f48bc546800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.252 INFO:tasks.workunit.client.0.smithi073.stderr: -60> 2024-09-12T00:49:26.110+0000 7f48bc546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:26.252 INFO:tasks.workunit.client.0.smithi073.stderr: -59> 2024-09-12T00:49:26.110+0000 7f48bc546800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.252 INFO:tasks.workunit.client.0.smithi073.stderr: -58> 2024-09-12T00:49:26.110+0000 7f48bc546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:26.252 INFO:tasks.workunit.client.0.smithi073.stderr: -57> 2024-09-12T00:49:26.110+0000 7f48bc546800 20 started sync module instance, tier type = 2024-09-12T00:49:26.252 INFO:tasks.workunit.client.0.smithi073.stderr: -56> 2024-09-12T00:49:26.110+0000 7f48bc546800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:49:26.252 INFO:tasks.workunit.client.0.smithi073.stderr: -55> 2024-09-12T00:49:26.122+0000 7f48bc546800 20 add_watcher() i=0 2024-09-12T00:49:26.252 INFO:tasks.workunit.client.0.smithi073.stderr: -54> 2024-09-12T00:49:26.122+0000 7f48bc546800 20 add_watcher() i=1 2024-09-12T00:49:26.252 INFO:tasks.workunit.client.0.smithi073.stderr: -53> 2024-09-12T00:49:26.122+0000 7f48bc546800 20 add_watcher() i=2 2024-09-12T00:49:26.252 INFO:tasks.workunit.client.0.smithi073.stderr: -52> 2024-09-12T00:49:26.122+0000 7f48bc546800 20 add_watcher() i=3 2024-09-12T00:49:26.253 INFO:tasks.workunit.client.0.smithi073.stderr: -51> 2024-09-12T00:49:26.122+0000 7f48bc546800 20 add_watcher() i=4 2024-09-12T00:49:26.253 INFO:tasks.workunit.client.0.smithi073.stderr: -50> 2024-09-12T00:49:26.122+0000 7f48bc546800 20 add_watcher() i=5 2024-09-12T00:49:26.253 INFO:tasks.workunit.client.0.smithi073.stderr: -49> 2024-09-12T00:49:26.122+0000 7f48bc546800 20 add_watcher() i=6 2024-09-12T00:49:26.253 INFO:tasks.workunit.client.0.smithi073.stderr: -48> 2024-09-12T00:49:26.123+0000 7f48bc546800 20 add_watcher() i=7 2024-09-12T00:49:26.253 INFO:tasks.workunit.client.0.smithi073.stderr: -47> 2024-09-12T00:49:26.123+0000 7f48bc546800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:26.253 INFO:tasks.workunit.client.0.smithi073.stderr: -46> 2024-09-12T00:49:26.124+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e91a0) adding auth protocol: cephx 2024-09-12T00:49:26.253 INFO:tasks.workunit.client.0.smithi073.stderr: -45> 2024-09-12T00:49:26.124+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e91a0) adding auth protocol: cephx 2024-09-12T00:49:26.253 INFO:tasks.workunit.client.0.smithi073.stderr: -44> 2024-09-12T00:49:26.124+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e91a0) adding auth protocol: cephx 2024-09-12T00:49:26.253 INFO:tasks.workunit.client.0.smithi073.stderr: -43> 2024-09-12T00:49:26.124+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e91a0) adding con mode: secure 2024-09-12T00:49:26.253 INFO:tasks.workunit.client.0.smithi073.stderr: -42> 2024-09-12T00:49:26.124+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e91a0) adding con mode: crc 2024-09-12T00:49:26.253 INFO:tasks.workunit.client.0.smithi073.stderr: -41> 2024-09-12T00:49:26.124+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e91a0) adding con mode: secure 2024-09-12T00:49:26.253 INFO:tasks.workunit.client.0.smithi073.stderr: -40> 2024-09-12T00:49:26.124+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e91a0) adding con mode: crc 2024-09-12T00:49:26.253 INFO:tasks.workunit.client.0.smithi073.stderr: -39> 2024-09-12T00:49:26.124+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e91a0) adding con mode: secure 2024-09-12T00:49:26.254 INFO:tasks.workunit.client.0.smithi073.stderr: -38> 2024-09-12T00:49:26.124+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e91a0) adding con mode: crc 2024-09-12T00:49:26.254 INFO:tasks.workunit.client.0.smithi073.stderr: -37> 2024-09-12T00:49:26.124+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e91a0) adding con mode: crc 2024-09-12T00:49:26.254 INFO:tasks.workunit.client.0.smithi073.stderr: -36> 2024-09-12T00:49:26.124+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e91a0) adding con mode: secure 2024-09-12T00:49:26.254 INFO:tasks.workunit.client.0.smithi073.stderr: -35> 2024-09-12T00:49:26.124+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e91a0) adding con mode: crc 2024-09-12T00:49:26.254 INFO:tasks.workunit.client.0.smithi073.stderr: -34> 2024-09-12T00:49:26.124+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e91a0) adding con mode: secure 2024-09-12T00:49:26.254 INFO:tasks.workunit.client.0.smithi073.stderr: -33> 2024-09-12T00:49:26.124+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e91a0) adding con mode: crc 2024-09-12T00:49:26.254 INFO:tasks.workunit.client.0.smithi073.stderr: -32> 2024-09-12T00:49:26.124+0000 7f48bc546800 5 AuthRegistry(0x7ffded8e91a0) adding con mode: secure 2024-09-12T00:49:26.254 INFO:tasks.workunit.client.0.smithi073.stderr: -31> 2024-09-12T00:49:26.124+0000 7f4770fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:26.254 INFO:tasks.workunit.client.0.smithi073.stderr: -30> 2024-09-12T00:49:26.125+0000 7f48bc546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:26.254 INFO:tasks.workunit.client.0.smithi073.stderr: -29> 2024-09-12T00:49:26.125+0000 7f48bc546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:26.254 INFO:tasks.workunit.client.0.smithi073.stderr: -28> 2024-09-12T00:49:26.125+0000 7f48bc546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:26.254 INFO:tasks.workunit.client.0.smithi073.stderr: -27> 2024-09-12T00:49:26.125+0000 7f48bc546800 5 asok(0x55abcfd69630) register_command cache list hook 0x55abd005f1c0 2024-09-12T00:49:26.254 INFO:tasks.workunit.client.0.smithi073.stderr: -26> 2024-09-12T00:49:26.125+0000 7f48bc546800 5 asok(0x55abcfd69630) register_command cache inspect hook 0x55abd005f1c0 2024-09-12T00:49:26.255 INFO:tasks.workunit.client.0.smithi073.stderr: -25> 2024-09-12T00:49:26.125+0000 7f48bc546800 5 asok(0x55abcfd69630) register_command cache erase hook 0x55abd005f1c0 2024-09-12T00:49:26.255 INFO:tasks.workunit.client.0.smithi073.stderr: -24> 2024-09-12T00:49:26.125+0000 7f48bc546800 5 asok(0x55abcfd69630) register_command cache zap hook 0x55abd005f1c0 2024-09-12T00:49:26.255 INFO:tasks.workunit.client.0.smithi073.stderr: -23> 2024-09-12T00:49:26.125+0000 7f48bc546800 5 note: GC not initialized 2024-09-12T00:49:26.255 INFO:tasks.workunit.client.0.smithi073.stderr: -22> 2024-09-12T00:49:26.125+0000 7f46eb7fe640 20 reqs_thread_entry: start 2024-09-12T00:49:26.255 INFO:tasks.workunit.client.0.smithi073.stderr: -21> 2024-09-12T00:49:26.125+0000 7f48bc546800 5 asok(0x55abcfd69630) register_command sync trace show hook 0x7f48ac004020 2024-09-12T00:49:26.255 INFO:tasks.workunit.client.0.smithi073.stderr: -20> 2024-09-12T00:49:26.125+0000 7f48bc546800 5 asok(0x55abcfd69630) register_command sync trace history hook 0x7f48ac004020 2024-09-12T00:49:26.255 INFO:tasks.workunit.client.0.smithi073.stderr: -19> 2024-09-12T00:49:26.125+0000 7f48bc546800 5 asok(0x55abcfd69630) register_command sync trace active hook 0x7f48ac004020 2024-09-12T00:49:26.255 INFO:tasks.workunit.client.0.smithi073.stderr: -18> 2024-09-12T00:49:26.125+0000 7f48bc546800 5 asok(0x55abcfd69630) register_command sync trace active_short hook 0x7f48ac004020 2024-09-12T00:49:26.255 INFO:tasks.workunit.client.0.smithi073.stderr: -17> 2024-09-12T00:49:26.125+0000 7f48bc546800 20 init_complete bucket index max shards: 1 2024-09-12T00:49:26.255 INFO:tasks.workunit.client.0.smithi073.stderr: -16> 2024-09-12T00:49:26.125+0000 7f48bc546800 20 Filter name: none 2024-09-12T00:49:26.255 INFO:tasks.workunit.client.0.smithi073.stderr: -15> 2024-09-12T00:49:26.125+0000 7f46e97fa640 20 reqs_thread_entry: start 2024-09-12T00:49:26.255 INFO:tasks.workunit.client.0.smithi073.stderr: -14> 2024-09-12T00:49:26.125+0000 7f48bc546800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:49:26.255 INFO:tasks.workunit.client.0.smithi073.stderr: -13> 2024-09-12T00:49:26.125+0000 7f48bc546800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.255 INFO:tasks.workunit.client.0.smithi073.stderr: -12> 2024-09-12T00:49:26.125+0000 7f48bc546800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:49:26.256 INFO:tasks.workunit.client.0.smithi073.stderr: -11> 2024-09-12T00:49:26.125+0000 7f48bc546800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:49:26.256 INFO:tasks.workunit.client.0.smithi073.stderr: -10> 2024-09-12T00:49:26.125+0000 7f48bc546800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:49:26.256 INFO:tasks.workunit.client.0.smithi073.stderr: -9> 2024-09-12T00:49:26.126+0000 7f48bc546800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24 : miss 2024-09-12T00:49:26.256 INFO:tasks.workunit.client.0.smithi073.stderr: -8> 2024-09-12T00:49:26.126+0000 7f48bc546800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.256 INFO:tasks.workunit.client.0.smithi073.stderr: -7> 2024-09-12T00:49:26.126+0000 7f48bc546800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:49:26.256 INFO:tasks.workunit.client.0.smithi073.stderr: -6> 2024-09-12T00:49:26.126+0000 7f48bc546800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24 info.flags=0x17 2024-09-12T00:49:26.256 INFO:tasks.workunit.client.0.smithi073.stderr: -5> 2024-09-12T00:49:26.126+0000 7f48bc546800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24 to cache LRU end 2024-09-12T00:49:26.256 INFO:tasks.workunit.client.0.smithi073.stderr: -4> 2024-09-12T00:49:26.126+0000 7f48bc546800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:26.256 INFO:tasks.workunit.client.0.smithi073.stderr: -3> 2024-09-12T00:49:26.126+0000 7f48bc546800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:26.256 INFO:tasks.workunit.client.0.smithi073.stderr: -2> 2024-09-12T00:49:26.126+0000 7f48bc546800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24 2024-09-12T00:49:26.256 INFO:tasks.workunit.client.0.smithi073.stderr: -1> 2024-09-12T00:49:26.129+0000 7f48bc546800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f48bc546800 time 2024-09-12T00:49:26.129531+0000 2024-09-12T00:49:26.256 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:49:26.256 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:26.257 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:49:26.257 INFO:tasks.workunit.client.0.smithi073.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f48bfb8c71a] 2024-09-12T00:49:26.257 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f48bfb8c8d8] 2024-09-12T00:49:26.257 INFO:tasks.workunit.client.0.smithi073.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55abcdb0b641] 2024-09-12T00:49:26.257 INFO:tasks.workunit.client.0.smithi073.stderr: 4: radosgw-admin(+0xd878e8) [0x55abce01d8e8] 2024-09-12T00:49:26.257 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55abcdb1b31d] 2024-09-12T00:49:26.257 INFO:tasks.workunit.client.0.smithi073.stderr: 6: main() 2024-09-12T00:49:26.257 INFO:tasks.workunit.client.0.smithi073.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f48be829590] 2024-09-12T00:49:26.257 INFO:tasks.workunit.client.0.smithi073.stderr: 8: __libc_start_main() 2024-09-12T00:49:26.257 INFO:tasks.workunit.client.0.smithi073.stderr: 9: _start() 2024-09-12T00:49:26.257 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:26.257 INFO:tasks.workunit.client.0.smithi073.stderr: 0> 2024-09-12T00:49:26.130+0000 7f48bc546800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:49:26.257 INFO:tasks.workunit.client.0.smithi073.stderr: in thread 7f48bc546800 thread_name:radosgw-admin 2024-09-12T00:49:26.258 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:26.258 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:49:26.258 INFO:tasks.workunit.client.0.smithi073.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f48be83e6f0] 2024-09-12T00:49:26.258 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f48be88b99c] 2024-09-12T00:49:26.258 INFO:tasks.workunit.client.0.smithi073.stderr: 3: raise() 2024-09-12T00:49:26.258 INFO:tasks.workunit.client.0.smithi073.stderr: 4: abort() 2024-09-12T00:49:26.258 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f48bfb8c774] 2024-09-12T00:49:26.258 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f48bfb8c8d8] 2024-09-12T00:49:26.258 INFO:tasks.workunit.client.0.smithi073.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55abcdb0b641] 2024-09-12T00:49:26.258 INFO:tasks.workunit.client.0.smithi073.stderr: 8: radosgw-admin(+0xd878e8) [0x55abce01d8e8] 2024-09-12T00:49:26.258 INFO:tasks.workunit.client.0.smithi073.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55abcdb1b31d] 2024-09-12T00:49:26.258 INFO:tasks.workunit.client.0.smithi073.stderr: 10: main() 2024-09-12T00:49:26.258 INFO:tasks.workunit.client.0.smithi073.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f48be829590] 2024-09-12T00:49:26.259 INFO:tasks.workunit.client.0.smithi073.stderr: 12: __libc_start_main() 2024-09-12T00:49:26.259 INFO:tasks.workunit.client.0.smithi073.stderr: 13: _start() 2024-09-12T00:49:26.259 INFO:tasks.workunit.client.0.smithi073.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:49:26.259 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:26.259 INFO:tasks.workunit.client.0.smithi073.stderr:--- logging levels --- 2024-09-12T00:49:26.259 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 none 2024-09-12T00:49:26.259 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 lockdep 2024-09-12T00:49:26.259 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 context 2024-09-12T00:49:26.259 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 crush 2024-09-12T00:49:26.259 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds 2024-09-12T00:49:26.259 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_balancer 2024-09-12T00:49:26.259 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_locker 2024-09-12T00:49:26.259 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_log 2024-09-12T00:49:26.259 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_log_expire 2024-09-12T00:49:26.260 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_migrator 2024-09-12T00:49:26.260 INFO:tasks.workunit.client.0.smithi073.stderr: 3/ 5 mds_quiesce 2024-09-12T00:49:26.260 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 buffer 2024-09-12T00:49:26.260 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 timer 2024-09-12T00:49:26.260 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 filer 2024-09-12T00:49:26.260 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 striper 2024-09-12T00:49:26.260 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 objecter 2024-09-12T00:49:26.260 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rados 2024-09-12T00:49:26.260 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd 2024-09-12T00:49:26.260 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_mirror 2024-09-12T00:49:26.260 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_replay 2024-09-12T00:49:26.260 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_pwl 2024-09-12T00:49:26.260 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 journaler 2024-09-12T00:49:26.261 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 objectcacher 2024-09-12T00:49:26.261 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:49:26.261 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 client 2024-09-12T00:49:26.261 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 osd 2024-09-12T00:49:26.261 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 optracker 2024-09-12T00:49:26.261 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 objclass 2024-09-12T00:49:26.261 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 filestore 2024-09-12T00:49:26.261 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 journal 2024-09-12T00:49:26.261 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 0 ms 2024-09-12T00:49:26.261 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mon 2024-09-12T00:49:26.261 INFO:tasks.workunit.client.0.smithi073.stderr: 0/10 monc 2024-09-12T00:49:26.261 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 paxos 2024-09-12T00:49:26.261 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 tp 2024-09-12T00:49:26.262 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 auth 2024-09-12T00:49:26.262 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 crypto 2024-09-12T00:49:26.262 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 finisher 2024-09-12T00:49:26.262 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 reserver 2024-09-12T00:49:26.262 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 heartbeatmap 2024-09-12T00:49:26.262 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 perfcounter 2024-09-12T00:49:26.262 INFO:tasks.workunit.client.0.smithi073.stderr: 20/20 rgw 2024-09-12T00:49:26.262 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_sync 2024-09-12T00:49:26.262 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_datacache 2024-09-12T00:49:26.262 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_access 2024-09-12T00:49:26.262 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:49:26.262 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_flight 2024-09-12T00:49:26.262 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:49:26.262 INFO:tasks.workunit.client.0.smithi073.stderr: 20/20 rgw_notification 2024-09-12T00:49:26.263 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 javaclient 2024-09-12T00:49:26.263 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 asok 2024-09-12T00:49:26.263 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 throttle 2024-09-12T00:49:26.263 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 0 refs 2024-09-12T00:49:26.263 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 compressor 2024-09-12T00:49:26.263 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 bluestore 2024-09-12T00:49:26.263 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 bluefs 2024-09-12T00:49:26.263 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 bdev 2024-09-12T00:49:26.263 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 kstore 2024-09-12T00:49:26.263 INFO:tasks.workunit.client.0.smithi073.stderr: 4/ 5 rocksdb 2024-09-12T00:49:26.263 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 fuse 2024-09-12T00:49:26.263 INFO:tasks.workunit.client.0.smithi073.stderr: 2/ 5 mgr 2024-09-12T00:49:26.263 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mgrc 2024-09-12T00:49:26.264 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 dpdk 2024-09-12T00:49:26.264 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 eventtrace 2024-09-12T00:49:26.264 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 prioritycache 2024-09-12T00:49:26.264 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 test 2024-09-12T00:49:26.264 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:49:26.264 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cephsqlite 2024-09-12T00:49:26.264 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:49:26.264 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore 2024-09-12T00:49:26.264 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_onode 2024-09-12T00:49:26.264 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_odata 2024-09-12T00:49:26.264 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_omap 2024-09-12T00:49:26.264 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_tm 2024-09-12T00:49:26.264 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_t 2024-09-12T00:49:26.265 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:49:26.265 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_epm 2024-09-12T00:49:26.265 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_lba 2024-09-12T00:49:26.265 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:49:26.265 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_cache 2024-09-12T00:49:26.265 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_journal 2024-09-12T00:49:26.265 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_device 2024-09-12T00:49:26.265 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_backref 2024-09-12T00:49:26.265 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 alienstore 2024-09-12T00:49:26.265 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mclock 2024-09-12T00:49:26.265 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cyanstore 2024-09-12T00:49:26.265 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 ceph_exporter 2024-09-12T00:49:26.265 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 memstore 2024-09-12T00:49:26.265 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 trace 2024-09-12T00:49:26.266 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 ceph_dedup 2024-09-12T00:49:26.266 INFO:tasks.workunit.client.0.smithi073.stderr: -2/-2 (syslog threshold) 2024-09-12T00:49:26.266 INFO:tasks.workunit.client.0.smithi073.stderr: 99/99 (stderr threshold) 2024-09-12T00:49:26.266 INFO:tasks.workunit.client.0.smithi073.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:49:26.266 INFO:tasks.workunit.client.0.smithi073.stderr: 7f46e97fa640 / http_manager 2024-09-12T00:49:26.266 INFO:tasks.workunit.client.0.smithi073.stderr: 7f46eb7fe640 / http_manager 2024-09-12T00:49:26.266 INFO:tasks.workunit.client.0.smithi073.stderr: 7f4770fe1640 / rgw_dt_lg_renew 2024-09-12T00:49:26.266 INFO:tasks.workunit.client.0.smithi073.stderr: 7f478bfff640 / ms_dispatch 2024-09-12T00:49:26.266 INFO:tasks.workunit.client.0.smithi073.stderr: 7f479dffb640 / io_context_pool 2024-09-12T00:49:26.266 INFO:tasks.workunit.client.0.smithi073.stderr: 7f479ffff640 / ms_dispatch 2024-09-12T00:49:26.266 INFO:tasks.workunit.client.0.smithi073.stderr: 7f47a6e05640 / ms_dispatch 2024-09-12T00:49:26.266 INFO:tasks.workunit.client.0.smithi073.stderr: 7f47a8608640 / io_context_pool 2024-09-12T00:49:26.266 INFO:tasks.workunit.client.0.smithi073.stderr: 7f48b9836640 / msgr-worker-2 2024-09-12T00:49:26.266 INFO:tasks.workunit.client.0.smithi073.stderr: 7f48ba037640 / msgr-worker-1 2024-09-12T00:49:26.267 INFO:tasks.workunit.client.0.smithi073.stderr: 7f48ba838640 / msgr-worker-0 2024-09-12T00:49:26.267 INFO:tasks.workunit.client.0.smithi073.stderr: 7f48bb039640 / io_context_pool 2024-09-12T00:49:26.267 INFO:tasks.workunit.client.0.smithi073.stderr: 7f48bc546800 / radosgw-admin 2024-09-12T00:49:26.267 INFO:tasks.workunit.client.0.smithi073.stderr: max_recent 500 2024-09-12T00:49:26.267 INFO:tasks.workunit.client.0.smithi073.stderr: max_new 1000 2024-09-12T00:49:26.267 INFO:tasks.workunit.client.0.smithi073.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:49:26.131166Z_8d32d325-e027-48ca-be35-463115631776/log 2024-09-12T00:49:26.267 INFO:tasks.workunit.client.0.smithi073.stderr:--- end dump of recent events --- 2024-09-12T00:49:26.267 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T00:49:26.273 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:26.273 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:26.273 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.205+0000 7ff4fcd26800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.273 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.206+0000 7ff4fcd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:26.273 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.206+0000 7ff4fcd26800 20 realm 2024-09-12T00:49:26.273 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.206+0000 7ff4fcd26800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.273 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.207+0000 7ff4fcd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:26.273 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.207+0000 7ff4fcd26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:26.273 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.207+0000 7ff4fcd26800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.273 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.207+0000 7ff4fcd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:26.274 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.207+0000 7ff4fcd26800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.274 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.208+0000 7ff4fcd26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:26.274 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.208+0000 7ff4fcd26800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.274 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.208+0000 7ff4fcd26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:26.274 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.208+0000 7ff4fcd26800 20 searching for the correct realm 2024-09-12T00:49:26.274 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.211+0000 7ff4f9270640 0 -- 172.21.15.73:0/629910534 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7ff4e4015070 msgr2=0x7ff4e4045510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:26.274 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.215+0000 7ff4f3fff640 0 -- 172.21.15.73:0/629910534 >> [v2:172.21.15.117:6800/110688882,v1:172.21.15.117:6801/110688882] conn(0x55f737dde7a0 msgr2=0x55f737de0b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:26.274 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.218+0000 7ff4fcd26800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:49:26.274 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.218+0000 7ff4fcd26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:26.274 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.218+0000 7ff4fcd26800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:49:26.274 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.218+0000 7ff4fcd26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:26.274 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.218+0000 7ff4fcd26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:26.274 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.218+0000 7ff4fcd26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:26.275 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.218+0000 7ff4fcd26800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.275 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.218+0000 7ff4fcd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:26.275 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.218+0000 7ff4fcd26800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.275 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.219+0000 7ff4fcd26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:26.275 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.219+0000 7ff4fcd26800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.275 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.219+0000 7ff4fcd26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:26.275 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.219+0000 7ff4fcd26800 20 zone default found 2024-09-12T00:49:26.275 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.219+0000 7ff4fcd26800 4 Realm: () 2024-09-12T00:49:26.275 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.219+0000 7ff4fcd26800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:49:26.275 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.219+0000 7ff4fcd26800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:49:26.275 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.219+0000 7ff4fcd26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:26.275 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.219+0000 7ff4fcd26800 20 zonegroup default 2024-09-12T00:49:26.275 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.219+0000 7ff4fcd26800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.276 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.219+0000 7ff4fcd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:26.276 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.219+0000 7ff4fcd26800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.276 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.219+0000 7ff4fcd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:26.276 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.219+0000 7ff4fcd26800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.276 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.220+0000 7ff4fcd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:26.276 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.220+0000 7ff4fcd26800 20 started sync module instance, tier type = 2024-09-12T00:49:26.276 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.220+0000 7ff4fcd26800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:49:26.276 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.228+0000 7ff4fcd26800 20 add_watcher() i=0 2024-09-12T00:49:26.276 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.228+0000 7ff4fcd26800 20 add_watcher() i=1 2024-09-12T00:49:26.276 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.228+0000 7ff4fcd26800 20 add_watcher() i=2 2024-09-12T00:49:26.276 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.228+0000 7ff4fcd26800 20 add_watcher() i=3 2024-09-12T00:49:26.276 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.228+0000 7ff4fcd26800 20 add_watcher() i=4 2024-09-12T00:49:26.276 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.228+0000 7ff4fcd26800 20 add_watcher() i=5 2024-09-12T00:49:26.277 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.228+0000 7ff4fcd26800 20 add_watcher() i=6 2024-09-12T00:49:26.277 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.229+0000 7ff4fcd26800 20 add_watcher() i=7 2024-09-12T00:49:26.277 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.229+0000 7ff4fcd26800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:26.277 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.231+0000 7ff3af7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:26.277 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.231+0000 7ff4fcd26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:26.277 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.231+0000 7ff4fcd26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:26.277 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.231+0000 7ff4fcd26800 5 note: GC not initialized 2024-09-12T00:49:26.277 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.231+0000 7ff3ae7e4640 20 reqs_thread_entry: start 2024-09-12T00:49:26.277 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.232+0000 7ff4fcd26800 20 init_complete bucket index max shards: 1 2024-09-12T00:49:26.277 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.232+0000 7ff4fcd26800 20 Filter name: none 2024-09-12T00:49:26.277 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.232+0000 7ff3a77fe640 20 reqs_thread_entry: start 2024-09-12T00:49:26.277 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.232+0000 7ff4fcd26800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.277 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.232+0000 7ff4fcd26800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:49:26.277 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.232+0000 7ff4fcd26800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.278 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.233+0000 7ff4fcd26800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:49:26.278 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.233+0000 7ff4fcd26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:26.278 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.233+0000 7ff4fcd26800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.278 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.233+0000 7ff4fcd26800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:49:26.278 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.233+0000 7ff4fcd26800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.278 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.234+0000 7ff4fcd26800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:49:26.278 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.234+0000 7ff4fcd26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:26.278 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.235+0000 7ff3af7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:26.278 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.237+0000 7ff4fcd26800 20 remove_watcher() i=0 2024-09-12T00:49:26.278 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.237+0000 7ff4fcd26800 2 removed watcher, disabling cache 2024-09-12T00:49:26.278 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.238+0000 7ff4fcd26800 20 remove_watcher() i=1 2024-09-12T00:49:26.278 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.239+0000 7ff4fcd26800 20 remove_watcher() i=2 2024-09-12T00:49:26.278 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.240+0000 7ff4fcd26800 20 remove_watcher() i=3 2024-09-12T00:49:26.278 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.242+0000 7ff4fcd26800 20 remove_watcher() i=4 2024-09-12T00:49:26.279 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.243+0000 7ff4fcd26800 20 remove_watcher() i=5 2024-09-12T00:49:26.279 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.244+0000 7ff4fcd26800 20 remove_watcher() i=6 2024-09-12T00:49:26.279 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.245+0000 7ff4fcd26800 20 remove_watcher() i=7 2024-09-12T00:49:26.279 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:26.279 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:49:26.279 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: abort-at-set-target-layout id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:49:26.279 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:26.279 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:26.279 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:26.286 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:26.286 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:26.343 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:49:26.373 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:26.374 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:26.410 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.411+0000 7f75f8135800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.412 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.413+0000 7f75f8135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:26.412 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.413+0000 7f75f8135800 20 realm 2024-09-12T00:49:26.412 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.413+0000 7f75f8135800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.412 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.413+0000 7f75f8135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:26.413 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.413+0000 7f75f8135800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:26.413 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.413+0000 7f75f8135800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.413 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.413+0000 7f75f8135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:26.413 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.414+0000 7f75f8135800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.413 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.414+0000 7f75f8135800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:26.413 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.414+0000 7f75f8135800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.414 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.415+0000 7f75f8135800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:26.414 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.415+0000 7f75f8135800 20 searching for the correct realm 2024-09-12T00:49:26.416 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.417+0000 7f75f467e640 0 -- 172.21.15.73:0/250379330 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f75dc044070 msgr2=0x7f75dc06b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:26.623 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.624+0000 7f75f467e640 0 -- 172.21.15.73:0/250379330 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f75dc044070 msgr2=0x7f75dc06b340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:26.627 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.628+0000 7f75f8135800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:49:26.627 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.628+0000 7f75f8135800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:26.627 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.628+0000 7f75f8135800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:49:26.627 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.628+0000 7f75f8135800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:26.627 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.628+0000 7f75f8135800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:26.627 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.628+0000 7f75f8135800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:26.627 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.628+0000 7f75f8135800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.627 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.628+0000 7f75f8135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:26.627 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.628+0000 7f75f8135800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.629 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.628+0000 7f75f8135800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:26.629 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.628+0000 7f75f8135800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.630 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.629+0000 7f75f8135800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:26.630 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.629+0000 7f75f8135800 20 zone default found 2024-09-12T00:49:26.630 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.629+0000 7f75f8135800 4 Realm: () 2024-09-12T00:49:26.630 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.629+0000 7f75f8135800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:49:26.630 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.629+0000 7f75f8135800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:49:26.630 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.629+0000 7f75f8135800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:26.630 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.629+0000 7f75f8135800 20 zonegroup default 2024-09-12T00:49:26.631 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.629+0000 7f75f8135800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.631 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.629+0000 7f75f8135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:26.631 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.629+0000 7f75f8135800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.631 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.629+0000 7f75f8135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:26.631 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.629+0000 7f75f8135800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.631 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.630+0000 7f75f8135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:26.631 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.630+0000 7f75f8135800 20 started sync module instance, tier type = 2024-09-12T00:49:26.631 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.630+0000 7f75f8135800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:49:26.637 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.638+0000 7f75f8135800 20 add_watcher() i=0 2024-09-12T00:49:26.637 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.638+0000 7f75f8135800 20 add_watcher() i=1 2024-09-12T00:49:26.637 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.638+0000 7f75f8135800 20 add_watcher() i=2 2024-09-12T00:49:26.638 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.638+0000 7f75f8135800 20 add_watcher() i=3 2024-09-12T00:49:26.638 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.638+0000 7f75f8135800 20 add_watcher() i=4 2024-09-12T00:49:26.638 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.638+0000 7f75f8135800 20 add_watcher() i=5 2024-09-12T00:49:26.638 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.638+0000 7f75f8135800 20 add_watcher() i=6 2024-09-12T00:49:26.639 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.639+0000 7f75f8135800 20 add_watcher() i=7 2024-09-12T00:49:26.639 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.639+0000 7f75f8135800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:26.642 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.642+0000 7f74a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:26.642 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.642+0000 7f75f8135800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:26.642 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.642+0000 7f75f8135800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:26.642 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.642+0000 7f75f8135800 5 note: GC not initialized 2024-09-12T00:49:26.642 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.642+0000 7f74a8fe1640 20 reqs_thread_entry: start 2024-09-12T00:49:26.642 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.643+0000 7f75f8135800 20 init_complete bucket index max shards: 1 2024-09-12T00:49:26.642 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.643+0000 7f75f8135800 20 Filter name: none 2024-09-12T00:49:26.642 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.643+0000 7f74227fc640 20 reqs_thread_entry: start 2024-09-12T00:49:26.642 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.643+0000 7f75f8135800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:49:26.642 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.643+0000 7f75f8135800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.643 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.643+0000 7f75f8135800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:49:26.643 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.643+0000 7f75f8135800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:49:26.644 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.643+0000 7f75f8135800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:49:26.644 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.643+0000 7f75f8135800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24 : miss 2024-09-12T00:49:26.644 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.643+0000 7f75f8135800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.644 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.644+0000 7f75f8135800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:49:26.644 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.644+0000 7f75f8135800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24 info.flags=0x17 2024-09-12T00:49:26.644 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.644+0000 7f75f8135800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24 to cache LRU end 2024-09-12T00:49:26.644 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.644+0000 7f75f8135800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:26.644 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.644+0000 7f75f8135800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:26.645 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.644+0000 7f75f8135800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24 2024-09-12T00:49:26.645 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.645+0000 7f75f8135800 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24 to be held by another RGW process; skipping for now 2024-09-12T00:49:26.645 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.646+0000 7f74a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:26.647 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.648+0000 7f75f8135800 20 remove_watcher() i=0 2024-09-12T00:49:26.647 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.648+0000 7f75f8135800 2 removed watcher, disabling cache 2024-09-12T00:49:26.648 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.649+0000 7f75f8135800 20 remove_watcher() i=1 2024-09-12T00:49:26.649 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.650+0000 7f75f8135800 20 remove_watcher() i=2 2024-09-12T00:49:26.649 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.651+0000 7f75f8135800 20 remove_watcher() i=3 2024-09-12T00:49:26.651 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.652+0000 7f75f8135800 20 remove_watcher() i=4 2024-09-12T00:49:26.651 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.653+0000 7f75f8135800 20 remove_watcher() i=5 2024-09-12T00:49:26.653 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.654+0000 7f75f8135800 20 remove_watcher() i=6 2024-09-12T00:49:26.653 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:26.655+0000 7f75f8135800 20 remove_watcher() i=7 2024-09-12T00:49:26.664 INFO:tasks.workunit.client.0.smithi073.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:49:56.687 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:49:56.723 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:56.723 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:56.765 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:56.766+0000 7f2629540800 20 rados->read ofs=0 len=0 2024-09-12T00:49:56.766 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:56.767+0000 7f2629540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:56.767 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:56.767+0000 7f2629540800 20 realm 2024-09-12T00:49:56.767 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:56.767+0000 7f2629540800 20 rados->read ofs=0 len=0 2024-09-12T00:49:56.767 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:56.768+0000 7f2629540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:56.767 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:56.768+0000 7f2629540800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:56.767 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:56.768+0000 7f2629540800 20 rados->read ofs=0 len=0 2024-09-12T00:49:56.767 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:56.768+0000 7f2629540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:56.767 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:56.768+0000 7f2629540800 20 rados->read ofs=0 len=0 2024-09-12T00:49:56.768 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:56.769+0000 7f2629540800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:56.768 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:56.769+0000 7f2629540800 20 rados->read ofs=0 len=0 2024-09-12T00:49:56.769 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:56.770+0000 7f2629540800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:56.769 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:56.770+0000 7f2629540800 20 searching for the correct realm 2024-09-12T00:49:56.771 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:56.773+0000 7f2625aee640 0 -- 172.21.15.73:0/2292643739 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f261002b040 msgr2=0x7f261002b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:49:56.979 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:56.981+0000 7f26252ed640 0 -- 172.21.15.73:0/2292643739 >> [v2:172.21.15.73:6810/1807760270,v1:172.21.15.73:6811/1807760270] conn(0x7f2620063c20 msgr2=0x7f2620092400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:57.188 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.188+0000 7f2629540800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:49:57.188 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.188+0000 7f2629540800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:57.188 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.188+0000 7f2629540800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:49:57.188 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.188+0000 7f2629540800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:57.188 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.189+0000 7f2629540800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:57.188 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.189+0000 7f2629540800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:57.188 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.189+0000 7f2629540800 20 rados->read ofs=0 len=0 2024-09-12T00:49:57.188 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.189+0000 7f2629540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:57.188 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.189+0000 7f2629540800 20 rados->read ofs=0 len=0 2024-09-12T00:49:57.190 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.189+0000 7f2629540800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:57.190 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.189+0000 7f2629540800 20 rados->read ofs=0 len=0 2024-09-12T00:49:57.190 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.190+0000 7f2629540800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:57.190 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.190+0000 7f2629540800 20 zone default found 2024-09-12T00:49:57.190 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.190+0000 7f2629540800 4 Realm: () 2024-09-12T00:49:57.190 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.190+0000 7f2629540800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:49:57.190 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.190+0000 7f2629540800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:49:57.190 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.190+0000 7f2629540800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:57.190 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.190+0000 7f2629540800 20 zonegroup default 2024-09-12T00:49:57.191 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.190+0000 7f2629540800 20 rados->read ofs=0 len=0 2024-09-12T00:49:57.191 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.190+0000 7f2629540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:57.191 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.190+0000 7f2629540800 20 rados->read ofs=0 len=0 2024-09-12T00:49:57.191 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.191+0000 7f2629540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:57.191 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.191+0000 7f2629540800 20 rados->read ofs=0 len=0 2024-09-12T00:49:57.191 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.191+0000 7f2629540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:57.191 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.191+0000 7f2629540800 20 started sync module instance, tier type = 2024-09-12T00:49:57.191 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.191+0000 7f2629540800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:49:57.200 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.201+0000 7f2629540800 20 add_watcher() i=0 2024-09-12T00:49:57.200 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.201+0000 7f2629540800 20 add_watcher() i=1 2024-09-12T00:49:57.200 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.201+0000 7f2629540800 20 add_watcher() i=2 2024-09-12T00:49:57.200 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.201+0000 7f2629540800 20 add_watcher() i=3 2024-09-12T00:49:57.201 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.201+0000 7f2629540800 20 add_watcher() i=4 2024-09-12T00:49:57.201 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.201+0000 7f2629540800 20 add_watcher() i=5 2024-09-12T00:49:57.201 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.201+0000 7f2629540800 20 add_watcher() i=6 2024-09-12T00:49:57.201 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.203+0000 7f2629540800 20 add_watcher() i=7 2024-09-12T00:49:57.201 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.203+0000 7f2629540800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:57.203 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.204+0000 7f24db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:57.204 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.205+0000 7f2629540800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:57.204 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.205+0000 7f2629540800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:57.205 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.205+0000 7f2629540800 5 note: GC not initialized 2024-09-12T00:49:57.205 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.205+0000 7f24da7e4640 20 reqs_thread_entry: start 2024-09-12T00:49:57.205 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.205+0000 7f2629540800 20 init_complete bucket index max shards: 1 2024-09-12T00:49:57.205 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.205+0000 7f2629540800 20 Filter name: none 2024-09-12T00:49:57.205 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.205+0000 7f244bfff640 20 reqs_thread_entry: start 2024-09-12T00:49:57.205 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.206+0000 7f2629540800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:49:57.205 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.206+0000 7f2629540800 20 rados->read ofs=0 len=0 2024-09-12T00:49:57.206 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.206+0000 7f2629540800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:49:57.206 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.206+0000 7f2629540800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:49:57.206 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.206+0000 7f2629540800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:49:57.206 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.206+0000 7f2629540800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24 : miss 2024-09-12T00:49:57.206 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.206+0000 7f2629540800 20 rados->read ofs=0 len=0 2024-09-12T00:49:57.206 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.207+0000 7f2629540800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:49:57.206 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.207+0000 7f2629540800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24 info.flags=0x17 2024-09-12T00:49:57.207 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.207+0000 7f2629540800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24 to cache LRU end 2024-09-12T00:49:57.207 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.207+0000 7f2629540800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:57.207 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.207+0000 7f2629540800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:57.207 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.207+0000 7f2629540800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24 2024-09-12T00:49:57.210 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.211+0000 7f2629540800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24 info.flags=0x17 2024-09-12T00:49:57.210 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.211+0000 7f2629540800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24 to cache LRU end 2024-09-12T00:49:57.210 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.211+0000 7f2629540800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:57.210 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.211+0000 7f2629540800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24, ofs0, ns] 2024-09-12T00:49:57.210 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.211+0000 7f2508ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497037 cookie 94114499111728 notifier 6702 bl.length()=925 2024-09-12T00:49:57.210 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.211+0000 7f2508ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24 info.flags=0x17 2024-09-12T00:49:57.210 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.211+0000 7f2508ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24 to cache LRU end 2024-09-12T00:49:57.210 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.211+0000 7f2508ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:57.212 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.213+0000 7f2629540800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24]): orig_sources= new_sources= 2024-09-12T00:49:57.212 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.213+0000 7f2629540800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24]): potential sources added=[] removed=[] 2024-09-12T00:49:57.212 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.213+0000 7f2629540800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24]): orig_dests= new_dests= 2024-09-12T00:49:57.212 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.213+0000 7f2629540800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24]): potential dests added=[] removed=[] 2024-09-12T00:49:57.216 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.217+0000 7f2629540800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24.1.0 2024-09-12T00:49:57.216 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.217+0000 7f2629540800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24.1.0 2024-09-12T00:49:57.216 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.217+0000 7f2629540800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24.1.1 2024-09-12T00:49:57.216 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.217+0000 7f2629540800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24.1.1 2024-09-12T00:49:57.216 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.217+0000 7f2629540800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24.0 2024-09-12T00:49:57.218 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.219+0000 7f2629540800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24 : hit (requested=0x17, cached=0x17) 2024-09-12T00:49:57.218 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.219+0000 7f2629540800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24 2024-09-12T00:49:57.219 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.221+0000 7f2629540800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24 info.flags=0x17 2024-09-12T00:49:57.220 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.221+0000 7f2629540800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24 to cache LRU end 2024-09-12T00:49:57.220 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.221+0000 7f2629540800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:57.220 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.221+0000 7f2629540800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24, ofs0, ns] 2024-09-12T00:49:57.220 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.221+0000 7f2508ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497038 cookie 94114499111728 notifier 6702 bl.length()=925 2024-09-12T00:49:57.220 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.221+0000 7f2508ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24 info.flags=0x17 2024-09-12T00:49:57.220 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.221+0000 7f2508ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24 to cache LRU end 2024-09-12T00:49:57.220 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.221+0000 7f2508ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:57.222 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.223+0000 7f2629540800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24]): orig_sources= new_sources= 2024-09-12T00:49:57.222 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.223+0000 7f2629540800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24]): potential sources added=[] removed=[] 2024-09-12T00:49:57.222 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.223+0000 7f2629540800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24]): orig_dests= new_dests= 2024-09-12T00:49:57.222 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.223+0000 7f2629540800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24]): potential dests added=[] removed=[] 2024-09-12T00:49:57.223 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.224+0000 7f2629540800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24.0 2024-09-12T00:49:57.223 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.225+0000 7f2629540800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24 : hit (requested=0x17, cached=0x17) 2024-09-12T00:49:57.223 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.225+0000 7f2629540800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24 2024-09-12T00:49:57.225 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.226+0000 7f2629540800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24 info.flags=0x17 2024-09-12T00:49:57.225 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.226+0000 7f2629540800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24 to cache LRU end 2024-09-12T00:49:57.225 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.226+0000 7f2629540800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:57.225 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.226+0000 7f2629540800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24, ofs0, ns] 2024-09-12T00:49:57.226 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.227+0000 7f24f7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497039 cookie 94114499111728 notifier 6702 bl.length()=893 2024-09-12T00:49:57.226 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.227+0000 7f24f7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24 info.flags=0x17 2024-09-12T00:49:57.226 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.227+0000 7f24f7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24 to cache LRU end 2024-09-12T00:49:57.226 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.227+0000 7f24f7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:57.227 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.228+0000 7f2629540800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24]): orig_sources= new_sources= 2024-09-12T00:49:57.227 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.228+0000 7f2629540800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24]): potential sources added=[] removed=[] 2024-09-12T00:49:57.227 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.228+0000 7f2629540800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24]): orig_dests= new_dests= 2024-09-12T00:49:57.227 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.228+0000 7f2629540800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24]): potential dests added=[] removed=[] 2024-09-12T00:49:57.228 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.229+0000 7f2629540800 1 execute INFO: reshard of bucket "abort-at-set-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T00:49:57.230 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.231+0000 7f24db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:57.233 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.234+0000 7f2629540800 20 remove_watcher() i=0 2024-09-12T00:49:57.233 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.234+0000 7f2629540800 2 removed watcher, disabling cache 2024-09-12T00:49:57.234 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.235+0000 7f2629540800 20 remove_watcher() i=1 2024-09-12T00:49:57.235 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.236+0000 7f2629540800 20 remove_watcher() i=2 2024-09-12T00:49:57.236 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.238+0000 7f2629540800 20 remove_watcher() i=3 2024-09-12T00:49:57.237 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.239+0000 7f2629540800 20 remove_watcher() i=4 2024-09-12T00:49:57.239 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.240+0000 7f2629540800 20 remove_watcher() i=5 2024-09-12T00:49:57.240 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.241+0000 7f2629540800 20 remove_watcher() i=6 2024-09-12T00:49:57.241 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.242+0000 7f2629540800 20 remove_watcher() i=7 2024-09-12T00:49:57.254 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T00:49:57.284 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:57.284 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:57.323 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.324+0000 7f166eb39800 20 rados->read ofs=0 len=0 2024-09-12T00:49:57.324 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.325+0000 7f166eb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:57.324 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.325+0000 7f166eb39800 20 realm 2024-09-12T00:49:57.325 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.325+0000 7f166eb39800 20 rados->read ofs=0 len=0 2024-09-12T00:49:57.325 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.326+0000 7f166eb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:57.325 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.326+0000 7f166eb39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:57.325 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.326+0000 7f166eb39800 20 rados->read ofs=0 len=0 2024-09-12T00:49:57.325 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.326+0000 7f166eb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:57.325 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.326+0000 7f166eb39800 20 rados->read ofs=0 len=0 2024-09-12T00:49:57.325 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.327+0000 7f166eb39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:57.325 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.327+0000 7f166eb39800 20 rados->read ofs=0 len=0 2024-09-12T00:49:57.326 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.328+0000 7f166eb39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:57.326 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.328+0000 7f166eb39800 20 searching for the correct realm 2024-09-12T00:49:57.327 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.329+0000 7f166a7c7640 0 -- 172.21.15.73:0/3225274152 >> [v2:172.21.15.117:6816/1460498570,v1:172.21.15.117:6817/1460498570] conn(0x7f166407b040 msgr2=0x7f1664061940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:57.534 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.535+0000 7f1663fff640 0 -- 172.21.15.73:0/3225274152 >> [v2:172.21.15.73:6826/269690776,v1:172.21.15.73:6827/269690776] conn(0x7f165c01b040 msgr2=0x7f165c0a45e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:57.742 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.743+0000 7f166eb39800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:49:57.742 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.743+0000 7f166eb39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:57.742 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.743+0000 7f166eb39800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:49:57.742 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.743+0000 7f166eb39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:57.742 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.743+0000 7f166eb39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:57.742 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.743+0000 7f166eb39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:57.742 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.743+0000 7f166eb39800 20 rados->read ofs=0 len=0 2024-09-12T00:49:57.742 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.743+0000 7f166eb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:57.743 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.743+0000 7f166eb39800 20 rados->read ofs=0 len=0 2024-09-12T00:49:57.744 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.743+0000 7f166eb39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:57.744 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.743+0000 7f166eb39800 20 rados->read ofs=0 len=0 2024-09-12T00:49:57.744 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.744+0000 7f166eb39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:57.744 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.744+0000 7f166eb39800 20 zone default found 2024-09-12T00:49:57.744 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.744+0000 7f166eb39800 4 Realm: () 2024-09-12T00:49:57.744 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.744+0000 7f166eb39800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:49:57.744 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.744+0000 7f166eb39800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:49:57.744 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.744+0000 7f166eb39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:57.744 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.744+0000 7f166eb39800 20 zonegroup default 2024-09-12T00:49:57.744 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.744+0000 7f166eb39800 20 rados->read ofs=0 len=0 2024-09-12T00:49:57.744 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.744+0000 7f166eb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:57.745 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.744+0000 7f166eb39800 20 rados->read ofs=0 len=0 2024-09-12T00:49:57.745 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.745+0000 7f166eb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:57.745 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.745+0000 7f166eb39800 20 rados->read ofs=0 len=0 2024-09-12T00:49:57.745 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.745+0000 7f166eb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:57.745 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.745+0000 7f166eb39800 20 started sync module instance, tier type = 2024-09-12T00:49:57.745 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.745+0000 7f166eb39800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:49:57.753 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.754+0000 7f166eb39800 20 add_watcher() i=0 2024-09-12T00:49:57.753 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.754+0000 7f166eb39800 20 add_watcher() i=1 2024-09-12T00:49:57.753 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.754+0000 7f166eb39800 20 add_watcher() i=2 2024-09-12T00:49:57.753 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.754+0000 7f166eb39800 20 add_watcher() i=3 2024-09-12T00:49:57.753 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.754+0000 7f166eb39800 20 add_watcher() i=4 2024-09-12T00:49:57.753 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.754+0000 7f166eb39800 20 add_watcher() i=5 2024-09-12T00:49:57.753 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.754+0000 7f166eb39800 20 add_watcher() i=6 2024-09-12T00:49:57.754 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.755+0000 7f166eb39800 20 add_watcher() i=7 2024-09-12T00:49:57.754 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.755+0000 7f166eb39800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:57.756 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.757+0000 7f1520fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:57.757 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.757+0000 7f166eb39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:57.757 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.757+0000 7f166eb39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:57.757 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.757+0000 7f166eb39800 5 note: GC not initialized 2024-09-12T00:49:57.757 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.758+0000 7f149b7fe640 20 reqs_thread_entry: start 2024-09-12T00:49:57.757 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.758+0000 7f166eb39800 20 init_complete bucket index max shards: 1 2024-09-12T00:49:57.757 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.758+0000 7f166eb39800 20 Filter name: none 2024-09-12T00:49:57.757 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.758+0000 7f14997fa640 20 reqs_thread_entry: start 2024-09-12T00:49:57.757 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.758+0000 7f166eb39800 20 rados->read ofs=0 len=0 2024-09-12T00:49:57.759 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.759+0000 7f166eb39800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:49:57.759 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.759+0000 7f166eb39800 20 rados->read ofs=0 len=0 2024-09-12T00:49:57.759 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.759+0000 7f166eb39800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:49:57.759 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.759+0000 7f166eb39800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:57.759 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.759+0000 7f166eb39800 20 rados->read ofs=0 len=0 2024-09-12T00:49:57.759 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.760+0000 7f166eb39800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:49:57.759 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.760+0000 7f166eb39800 20 rados->read ofs=0 len=0 2024-09-12T00:49:57.759 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.760+0000 7f166eb39800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:49:57.759 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.760+0000 7f166eb39800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:57.760 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.761+0000 7f1520fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:57.762 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.764+0000 7f166eb39800 20 remove_watcher() i=0 2024-09-12T00:49:57.763 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.764+0000 7f166eb39800 2 removed watcher, disabling cache 2024-09-12T00:49:57.763 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.765+0000 7f166eb39800 20 remove_watcher() i=1 2024-09-12T00:49:57.765 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.766+0000 7f166eb39800 20 remove_watcher() i=2 2024-09-12T00:49:57.766 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.767+0000 7f166eb39800 20 remove_watcher() i=3 2024-09-12T00:49:57.767 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.768+0000 7f166eb39800 20 remove_watcher() i=4 2024-09-12T00:49:57.768 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.769+0000 7f166eb39800 20 remove_watcher() i=5 2024-09-12T00:49:57.769 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.770+0000 7f166eb39800 20 remove_watcher() i=6 2024-09-12T00:49:57.770 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:57.771+0000 7f166eb39800 20 remove_watcher() i=7 2024-09-12T00:49:57.780 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:57.780 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:49:57.780 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: abort-at-set-target-layout id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:49:57.780 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:57.782 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:57.782 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:57.800 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:57.800 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:58.017 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:58.017 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:58.080 INFO:tasks.workunit.client.0.smithi073.stderr:TEST: reshard bucket with EIO injected at trim_reshard_log_entries 2024-09-12T00:49:58.081 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:58.081 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:58.082 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:58.122 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:58.122 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:58.178 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:58.178 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:58.214 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:58.214 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:58.248 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:58.248 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:58.283 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:58.283 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:58.317 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:58.317 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:58.353 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:58.353 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:58.389 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:58.389 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:58.424 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:58.424 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:58.459 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:58.459 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:58.494 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:58.494 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:58.529 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:58.529 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:58.563 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:58.563 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:58.598 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:58.598 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:58.635 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:58.635 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:58.668 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:58.668 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:58.736 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:58.736 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:58.772 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:58.772 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:58.806 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:58.806 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:58.840 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:58.840 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:58.875 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:58.875 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:58.909 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:49:58.937 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:58.937 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:58.974 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:58.975+0000 7f69ee32e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:58.975 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:58.976+0000 7f69ee32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:58.976 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:58.976+0000 7f69ee32e800 20 realm 2024-09-12T00:49:58.976 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:58.976+0000 7f69ee32e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:58.976 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:58.977+0000 7f69ee32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:58.976 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:58.977+0000 7f69ee32e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:58.976 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:58.977+0000 7f69ee32e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:58.976 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:58.977+0000 7f69ee32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:58.976 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:58.977+0000 7f69ee32e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:58.977 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:58.978+0000 7f69ee32e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:58.977 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:58.978+0000 7f69ee32e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:58.977 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:58.979+0000 7f69ee32e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:58.977 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:58.979+0000 7f69ee32e800 20 searching for the correct realm 2024-09-12T00:49:58.980 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:58.981+0000 7f69ea765640 0 -- 172.21.15.73:0/4227733035 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f69d40661a0 msgr2=0x7f69d401da80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:58.984 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:58.985+0000 7f69ea765640 0 -- 172.21.15.73:0/4227733035 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f68b4086310 msgr2=0x7f68b4088740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:58.988 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:58.989+0000 7f69ee32e800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:49:58.988 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:58.989+0000 7f69ee32e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:58.988 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:58.989+0000 7f69ee32e800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:49:58.988 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:58.989+0000 7f69ee32e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:58.988 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:58.989+0000 7f69ee32e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:58.989 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:58.989+0000 7f69ee32e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:58.989 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:58.989+0000 7f69ee32e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:58.989 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:58.989+0000 7f69ee32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:58.989 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:58.989+0000 7f69ee32e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:58.989 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:58.989+0000 7f69ee32e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:58.989 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:58.989+0000 7f69ee32e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:58.990 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:58.990+0000 7f69ee32e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:58.990 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:58.990+0000 7f69ee32e800 20 zone default found 2024-09-12T00:49:58.990 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:58.990+0000 7f69ee32e800 4 Realm: () 2024-09-12T00:49:58.990 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:58.990+0000 7f69ee32e800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:49:58.990 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:58.990+0000 7f69ee32e800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:49:58.990 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:58.990+0000 7f69ee32e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:58.990 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:58.990+0000 7f69ee32e800 20 zonegroup default 2024-09-12T00:49:58.991 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:58.990+0000 7f69ee32e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:58.991 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:58.990+0000 7f69ee32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:58.991 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:58.990+0000 7f69ee32e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:58.991 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:58.990+0000 7f69ee32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:58.991 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:58.990+0000 7f69ee32e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:58.991 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:58.991+0000 7f69ee32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:58.991 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:58.991+0000 7f69ee32e800 20 started sync module instance, tier type = 2024-09-12T00:49:58.991 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:58.991+0000 7f69ee32e800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:49:58.998 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:58.999+0000 7f69ee32e800 20 add_watcher() i=0 2024-09-12T00:49:58.998 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:58.999+0000 7f69ee32e800 20 add_watcher() i=1 2024-09-12T00:49:58.999 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:58.999+0000 7f69ee32e800 20 add_watcher() i=2 2024-09-12T00:49:58.999 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:58.999+0000 7f69ee32e800 20 add_watcher() i=3 2024-09-12T00:49:58.999 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:58.999+0000 7f69ee32e800 20 add_watcher() i=4 2024-09-12T00:49:58.999 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:58.999+0000 7f69ee32e800 20 add_watcher() i=5 2024-09-12T00:49:58.999 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:58.999+0000 7f69ee32e800 20 add_watcher() i=6 2024-09-12T00:49:58.999 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.000+0000 7f69ee32e800 20 add_watcher() i=7 2024-09-12T00:49:58.999 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.000+0000 7f69ee32e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:59.003 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.002+0000 7f689b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:59.003 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.002+0000 7f69ee32e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:59.003 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.002+0000 7f69ee32e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:59.003 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.002+0000 7f69ee32e800 5 note: GC not initialized 2024-09-12T00:49:59.003 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.002+0000 7f689a7fc640 20 reqs_thread_entry: start 2024-09-12T00:49:59.003 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.003+0000 7f69ee32e800 20 init_complete bucket index max shards: 1 2024-09-12T00:49:59.003 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.003+0000 7f69ee32e800 20 Filter name: none 2024-09-12T00:49:59.003 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.003+0000 7f680bfff640 20 reqs_thread_entry: start 2024-09-12T00:49:59.003 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.003+0000 7f69ee32e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:59.004 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.003+0000 7f69ee32e800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:49:59.004 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.003+0000 7f69ee32e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:59.004 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.004+0000 7f69ee32e800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:49:59.004 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.004+0000 7f69ee32e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:59.004 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.004+0000 7f69ee32e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:59.005 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.004+0000 7f69ee32e800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:49:59.005 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.004+0000 7f69ee32e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:59.005 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.005+0000 7f69ee32e800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:49:59.005 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.005+0000 7f69ee32e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:59.005 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.006+0000 7f689b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:59.006 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.008+0000 7f69ee32e800 20 remove_watcher() i=0 2024-09-12T00:49:59.007 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.008+0000 7f69ee32e800 2 removed watcher, disabling cache 2024-09-12T00:49:59.008 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.009+0000 7f69ee32e800 20 remove_watcher() i=1 2024-09-12T00:49:59.009 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.010+0000 7f69ee32e800 20 remove_watcher() i=2 2024-09-12T00:49:59.010 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.011+0000 7f69ee32e800 20 remove_watcher() i=3 2024-09-12T00:49:59.011 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.012+0000 7f69ee32e800 20 remove_watcher() i=4 2024-09-12T00:49:59.012 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.013+0000 7f69ee32e800 20 remove_watcher() i=5 2024-09-12T00:49:59.013 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.014+0000 7f69ee32e800 20 remove_watcher() i=6 2024-09-12T00:49:59.014 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.015+0000 7f69ee32e800 20 remove_watcher() i=7 2024-09-12T00:49:59.024 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:59.024 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:49:59.024 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: error-at-trim-reshard-log-entries id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:49:59.024 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:59.025 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries 2024-09-12T00:49:59.060 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:59.060 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:59.096 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.097+0000 7fed26123800 20 rados->read ofs=0 len=0 2024-09-12T00:49:59.098 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.099+0000 7fed26123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:59.098 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.099+0000 7fed26123800 20 realm 2024-09-12T00:49:59.098 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.099+0000 7fed26123800 20 rados->read ofs=0 len=0 2024-09-12T00:49:59.098 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.099+0000 7fed26123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:59.098 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.099+0000 7fed26123800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:59.098 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.099+0000 7fed26123800 20 rados->read ofs=0 len=0 2024-09-12T00:49:59.098 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.099+0000 7fed26123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:59.098 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.099+0000 7fed26123800 20 rados->read ofs=0 len=0 2024-09-12T00:49:59.099 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.100+0000 7fed26123800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:59.099 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.100+0000 7fed26123800 20 rados->read ofs=0 len=0 2024-09-12T00:49:59.099 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.101+0000 7fed26123800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:59.099 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.101+0000 7fed26123800 20 searching for the correct realm 2024-09-12T00:49:59.102 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.104+0000 7fed22614640 0 -- 172.21.15.73:0/1186579024 >> [v2:172.21.15.73:6800/2864081714,v1:172.21.15.73:6801/2864081714] conn(0x55a1f257d330 msgr2=0x55a1f257f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:59.106 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.108+0000 7fed21e13640 0 -- 172.21.15.73:0/1186579024 >> [v2:172.21.15.117:6816/1460498570,v1:172.21.15.117:6817/1460498570] conn(0x7fed1c033040 msgr2=0x7fed1c01a470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:59.110 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.111+0000 7fed26123800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:49:59.110 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.111+0000 7fed26123800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:59.110 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.111+0000 7fed26123800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:49:59.110 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.111+0000 7fed26123800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:59.110 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.111+0000 7fed26123800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:59.110 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.111+0000 7fed26123800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:59.110 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.111+0000 7fed26123800 20 rados->read ofs=0 len=0 2024-09-12T00:49:59.110 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.111+0000 7fed26123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:59.110 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.111+0000 7fed26123800 20 rados->read ofs=0 len=0 2024-09-12T00:49:59.111 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.111+0000 7fed26123800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:59.112 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.111+0000 7fed26123800 20 rados->read ofs=0 len=0 2024-09-12T00:49:59.112 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.111+0000 7fed26123800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:59.112 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.112+0000 7fed26123800 20 zone default found 2024-09-12T00:49:59.112 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.112+0000 7fed26123800 4 Realm: () 2024-09-12T00:49:59.112 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.112+0000 7fed26123800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:49:59.112 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.112+0000 7fed26123800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:49:59.112 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.112+0000 7fed26123800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:59.112 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.112+0000 7fed26123800 20 zonegroup default 2024-09-12T00:49:59.112 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.112+0000 7fed26123800 20 rados->read ofs=0 len=0 2024-09-12T00:49:59.112 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.112+0000 7fed26123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:59.112 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.112+0000 7fed26123800 20 rados->read ofs=0 len=0 2024-09-12T00:49:59.112 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.112+0000 7fed26123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:59.113 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.112+0000 7fed26123800 20 rados->read ofs=0 len=0 2024-09-12T00:49:59.113 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.112+0000 7fed26123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:59.113 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.112+0000 7fed26123800 20 started sync module instance, tier type = 2024-09-12T00:49:59.113 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.112+0000 7fed26123800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:49:59.120 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.121+0000 7fed26123800 20 add_watcher() i=0 2024-09-12T00:49:59.120 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.121+0000 7fed26123800 20 add_watcher() i=1 2024-09-12T00:49:59.120 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.121+0000 7fed26123800 20 add_watcher() i=2 2024-09-12T00:49:59.120 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.121+0000 7fed26123800 20 add_watcher() i=3 2024-09-12T00:49:59.120 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.121+0000 7fed26123800 20 add_watcher() i=4 2024-09-12T00:49:59.120 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.121+0000 7fed26123800 20 add_watcher() i=5 2024-09-12T00:49:59.120 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.121+0000 7fed26123800 20 add_watcher() i=6 2024-09-12T00:49:59.120 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.122+0000 7fed26123800 20 add_watcher() i=7 2024-09-12T00:49:59.121 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.122+0000 7fed26123800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:59.122 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.123+0000 7febd37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:59.123 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.124+0000 7fed26123800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:59.123 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.124+0000 7fed26123800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:59.123 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.124+0000 7fed26123800 5 note: GC not initialized 2024-09-12T00:49:59.123 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.124+0000 7febd27fc640 20 reqs_thread_entry: start 2024-09-12T00:49:59.123 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.124+0000 7fed26123800 20 init_complete bucket index max shards: 1 2024-09-12T00:49:59.123 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.124+0000 7fed26123800 20 Filter name: none 2024-09-12T00:49:59.123 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.124+0000 7feb43fff640 20 reqs_thread_entry: start 2024-09-12T00:49:59.124 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.124+0000 7fed26123800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T00:49:59.124 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.124+0000 7fed26123800 20 rados->read ofs=0 len=0 2024-09-12T00:49:59.124 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.125+0000 7fed26123800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:49:59.124 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.125+0000 7fed26123800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:49:59.125 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.125+0000 7fed26123800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:49:59.125 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.125+0000 7fed26123800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25 : miss 2024-09-12T00:49:59.125 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.125+0000 7fed26123800 20 rados->read ofs=0 len=0 2024-09-12T00:49:59.125 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.125+0000 7fed26123800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:49:59.125 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.125+0000 7fed26123800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25 info.flags=0x17 2024-09-12T00:49:59.125 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.125+0000 7fed26123800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25 to cache LRU end 2024-09-12T00:49:59.125 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.125+0000 7fed26123800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:59.125 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.125+0000 7fed26123800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:59.125 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.125+0000 7fed26123800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25 2024-09-12T00:49:59.128 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.129+0000 7fed26123800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25 info.flags=0x17 2024-09-12T00:49:59.128 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.129+0000 7fed26123800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25 to cache LRU end 2024-09-12T00:49:59.128 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.129+0000 7fed26123800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:59.129 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.129+0000 7fed26123800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25, ofs0, ns] 2024-09-12T00:49:59.129 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.130+0000 7fec057fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496987 cookie 94154043957184 notifier 6753 bl.length()=939 2024-09-12T00:49:59.129 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.130+0000 7fec057fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25 info.flags=0x17 2024-09-12T00:49:59.129 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.130+0000 7fec057fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25 to cache LRU end 2024-09-12T00:49:59.129 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.130+0000 7fec057fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:59.130 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.131+0000 7fed26123800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25]): orig_sources= new_sources= 2024-09-12T00:49:59.130 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.131+0000 7fed26123800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25]): potential sources added=[] removed=[] 2024-09-12T00:49:59.130 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.131+0000 7fed26123800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25]): orig_dests= new_dests= 2024-09-12T00:49:59.130 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.131+0000 7fed26123800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25]): potential dests added=[] removed=[] 2024-09-12T00:49:59.130 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.131+0000 7fed26123800 -1 Injecting error=-5 at location=trim_reshard_log_entries 2024-09-12T00:49:59.130 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.131+0000 7fed26123800 0 ERROR: init_reshard failed to trim reshard log entries: (5) Input/output error 2024-09-12T00:49:59.132 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.133+0000 7febd37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:59.134 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.135+0000 7fed26123800 20 remove_watcher() i=0 2024-09-12T00:49:59.134 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.135+0000 7fed26123800 2 removed watcher, disabling cache 2024-09-12T00:49:59.135 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.136+0000 7fed26123800 20 remove_watcher() i=1 2024-09-12T00:49:59.136 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.137+0000 7fed26123800 20 remove_watcher() i=2 2024-09-12T00:49:59.137 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.138+0000 7fed26123800 20 remove_watcher() i=3 2024-09-12T00:49:59.138 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.139+0000 7fed26123800 20 remove_watcher() i=4 2024-09-12T00:49:59.139 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.140+0000 7fed26123800 20 remove_watcher() i=5 2024-09-12T00:49:59.140 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.141+0000 7fed26123800 20 remove_watcher() i=6 2024-09-12T00:49:59.141 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.142+0000 7fed26123800 20 remove_watcher() i=7 2024-09-12T00:49:59.153 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:49:59.181 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:59.181 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:59.217 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.219+0000 7fc0a5d21800 20 rados->read ofs=0 len=0 2024-09-12T00:49:59.219 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.220+0000 7fc0a5d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:59.219 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.220+0000 7fc0a5d21800 20 realm 2024-09-12T00:49:59.219 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.220+0000 7fc0a5d21800 20 rados->read ofs=0 len=0 2024-09-12T00:49:59.219 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.220+0000 7fc0a5d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:59.219 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.220+0000 7fc0a5d21800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:59.219 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.220+0000 7fc0a5d21800 20 rados->read ofs=0 len=0 2024-09-12T00:49:59.219 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.220+0000 7fc0a5d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:59.220 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.220+0000 7fc0a5d21800 20 rados->read ofs=0 len=0 2024-09-12T00:49:59.220 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.221+0000 7fc0a5d21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:59.220 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.221+0000 7fc0a5d21800 20 rados->read ofs=0 len=0 2024-09-12T00:49:59.221 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.222+0000 7fc0a5d21800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:59.221 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.222+0000 7fc0a5d21800 20 searching for the correct realm 2024-09-12T00:49:59.223 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.224+0000 7fc0a220d640 0 -- 172.21.15.73:0/3742102260 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fc08c078070 msgr2=0x7fc08c07a0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:59.429 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.430+0000 7fc0a220d640 0 -- 172.21.15.73:0/3742102260 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fc08c078070 msgr2=0x7fc08c07a0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:59.434 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.434+0000 7fc0a5d21800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:49:59.434 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.434+0000 7fc0a5d21800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:59.434 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.434+0000 7fc0a5d21800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:49:59.434 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.434+0000 7fc0a5d21800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:59.434 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.434+0000 7fc0a5d21800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:59.434 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.434+0000 7fc0a5d21800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:59.434 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.434+0000 7fc0a5d21800 20 rados->read ofs=0 len=0 2024-09-12T00:49:59.434 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.434+0000 7fc0a5d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:59.434 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.434+0000 7fc0a5d21800 20 rados->read ofs=0 len=0 2024-09-12T00:49:59.434 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.434+0000 7fc0a5d21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:59.434 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.434+0000 7fc0a5d21800 20 rados->read ofs=0 len=0 2024-09-12T00:49:59.435 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.435+0000 7fc0a5d21800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:59.435 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.435+0000 7fc0a5d21800 20 zone default found 2024-09-12T00:49:59.435 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.435+0000 7fc0a5d21800 4 Realm: () 2024-09-12T00:49:59.435 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.435+0000 7fc0a5d21800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:49:59.435 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.435+0000 7fc0a5d21800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:49:59.435 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.435+0000 7fc0a5d21800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:59.435 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.435+0000 7fc0a5d21800 20 zonegroup default 2024-09-12T00:49:59.435 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.435+0000 7fc0a5d21800 20 rados->read ofs=0 len=0 2024-09-12T00:49:59.435 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.435+0000 7fc0a5d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:59.435 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.435+0000 7fc0a5d21800 20 rados->read ofs=0 len=0 2024-09-12T00:49:59.435 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.435+0000 7fc0a5d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:59.435 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.435+0000 7fc0a5d21800 20 rados->read ofs=0 len=0 2024-09-12T00:49:59.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.435+0000 7fc0a5d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:59.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.435+0000 7fc0a5d21800 20 started sync module instance, tier type = 2024-09-12T00:49:59.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.435+0000 7fc0a5d21800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:49:59.443 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.444+0000 7fc0a5d21800 20 add_watcher() i=0 2024-09-12T00:49:59.443 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.444+0000 7fc0a5d21800 20 add_watcher() i=1 2024-09-12T00:49:59.443 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.444+0000 7fc0a5d21800 20 add_watcher() i=2 2024-09-12T00:49:59.443 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.444+0000 7fc0a5d21800 20 add_watcher() i=3 2024-09-12T00:49:59.443 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.444+0000 7fc0a5d21800 20 add_watcher() i=4 2024-09-12T00:49:59.443 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.444+0000 7fc0a5d21800 20 add_watcher() i=5 2024-09-12T00:49:59.443 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.444+0000 7fc0a5d21800 20 add_watcher() i=6 2024-09-12T00:49:59.444 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.445+0000 7fc0a5d21800 20 add_watcher() i=7 2024-09-12T00:49:59.444 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.445+0000 7fc0a5d21800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:59.445 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.447+0000 7fbf537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:59.446 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.447+0000 7fc0a5d21800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:59.447 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.447+0000 7fc0a5d21800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:59.447 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.447+0000 7fc0a5d21800 5 note: GC not initialized 2024-09-12T00:49:59.447 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.447+0000 7fbf527fc640 20 reqs_thread_entry: start 2024-09-12T00:49:59.447 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.447+0000 7fc0a5d21800 20 init_complete bucket index max shards: 1 2024-09-12T00:49:59.447 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.447+0000 7fc0a5d21800 20 Filter name: none 2024-09-12T00:49:59.447 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.447+0000 7fbec3fff640 20 reqs_thread_entry: start 2024-09-12T00:49:59.447 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.447+0000 7fc0a5d21800 20 rados->read ofs=0 len=0 2024-09-12T00:49:59.447 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.448+0000 7fc0a5d21800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:49:59.447 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.448+0000 7fc0a5d21800 20 rados->read ofs=0 len=0 2024-09-12T00:49:59.448 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.449+0000 7fc0a5d21800 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:49:59.448 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.449+0000 7fc0a5d21800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:59.448 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.449+0000 7fc0a5d21800 20 rados->read ofs=0 len=0 2024-09-12T00:49:59.449 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.449+0000 7fc0a5d21800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:49:59.449 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.449+0000 7fc0a5d21800 20 rados->read ofs=0 len=0 2024-09-12T00:49:59.449 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.449+0000 7fc0a5d21800 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:49:59.449 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.449+0000 7fc0a5d21800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:59.449 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.450+0000 7fbf537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:59.451 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.453+0000 7fc0a5d21800 20 remove_watcher() i=0 2024-09-12T00:49:59.451 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.453+0000 7fc0a5d21800 2 removed watcher, disabling cache 2024-09-12T00:49:59.452 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.454+0000 7fc0a5d21800 20 remove_watcher() i=1 2024-09-12T00:49:59.453 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.455+0000 7fc0a5d21800 20 remove_watcher() i=2 2024-09-12T00:49:59.454 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.456+0000 7fc0a5d21800 20 remove_watcher() i=3 2024-09-12T00:49:59.455 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.457+0000 7fc0a5d21800 20 remove_watcher() i=4 2024-09-12T00:49:59.456 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.458+0000 7fc0a5d21800 20 remove_watcher() i=5 2024-09-12T00:49:59.457 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.459+0000 7fc0a5d21800 20 remove_watcher() i=6 2024-09-12T00:49:59.458 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.460+0000 7fc0a5d21800 20 remove_watcher() i=7 2024-09-12T00:49:59.469 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:59.469 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:49:59.469 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: error-at-trim-reshard-log-entries id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:49:59.469 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:49:59.470 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:59.471 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:59.504 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:59.504 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:49:59.561 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:49:59.592 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:59.592 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:59.629 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.630+0000 7fdc8c02f800 20 rados->read ofs=0 len=0 2024-09-12T00:49:59.631 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.632+0000 7fdc8c02f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:59.631 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.632+0000 7fdc8c02f800 20 realm 2024-09-12T00:49:59.631 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.632+0000 7fdc8c02f800 20 rados->read ofs=0 len=0 2024-09-12T00:49:59.631 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.632+0000 7fdc8c02f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:59.631 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.632+0000 7fdc8c02f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:59.631 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.632+0000 7fdc8c02f800 20 rados->read ofs=0 len=0 2024-09-12T00:49:59.632 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.632+0000 7fdc8c02f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:59.632 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.632+0000 7fdc8c02f800 20 rados->read ofs=0 len=0 2024-09-12T00:49:59.632 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.633+0000 7fdc8c02f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:59.632 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.633+0000 7fdc8c02f800 20 rados->read ofs=0 len=0 2024-09-12T00:49:59.633 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.634+0000 7fdc8c02f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:59.633 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.634+0000 7fdc8c02f800 20 searching for the correct realm 2024-09-12T00:49:59.635 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.636+0000 7fdc8a31a640 0 -- 172.21.15.73:0/414564247 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fdc7401f040 msgr2=0x7fdc7406a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:59.841 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.843+0000 7fdc8a31a640 0 -- 172.21.15.73:0/414564247 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fdc7401f040 msgr2=0x7fdc7406a0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:59.845 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.846+0000 7fdc8c02f800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:49:59.846 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.846+0000 7fdc8c02f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:59.846 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.846+0000 7fdc8c02f800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:49:59.846 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.846+0000 7fdc8c02f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:59.846 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.846+0000 7fdc8c02f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:59.846 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.846+0000 7fdc8c02f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:59.846 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.846+0000 7fdc8c02f800 20 rados->read ofs=0 len=0 2024-09-12T00:49:59.846 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.847+0000 7fdc8c02f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:59.846 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.847+0000 7fdc8c02f800 20 rados->read ofs=0 len=0 2024-09-12T00:49:59.846 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.847+0000 7fdc8c02f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:59.846 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.847+0000 7fdc8c02f800 20 rados->read ofs=0 len=0 2024-09-12T00:49:59.847 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.847+0000 7fdc8c02f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:59.847 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.847+0000 7fdc8c02f800 20 zone default found 2024-09-12T00:49:59.848 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.847+0000 7fdc8c02f800 4 Realm: () 2024-09-12T00:49:59.848 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.847+0000 7fdc8c02f800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:49:59.848 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.847+0000 7fdc8c02f800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:49:59.848 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.847+0000 7fdc8c02f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:59.848 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.847+0000 7fdc8c02f800 20 zonegroup default 2024-09-12T00:49:59.848 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.847+0000 7fdc8c02f800 20 rados->read ofs=0 len=0 2024-09-12T00:49:59.848 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.847+0000 7fdc8c02f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:59.848 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.847+0000 7fdc8c02f800 20 rados->read ofs=0 len=0 2024-09-12T00:49:59.848 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.848+0000 7fdc8c02f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:59.848 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.848+0000 7fdc8c02f800 20 rados->read ofs=0 len=0 2024-09-12T00:49:59.849 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.848+0000 7fdc8c02f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:59.849 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.848+0000 7fdc8c02f800 20 started sync module instance, tier type = 2024-09-12T00:49:59.849 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.848+0000 7fdc8c02f800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:49:59.855 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.856+0000 7fdc8c02f800 20 add_watcher() i=0 2024-09-12T00:49:59.855 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.856+0000 7fdc8c02f800 20 add_watcher() i=1 2024-09-12T00:49:59.855 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.856+0000 7fdc8c02f800 20 add_watcher() i=2 2024-09-12T00:49:59.855 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.856+0000 7fdc8c02f800 20 add_watcher() i=3 2024-09-12T00:49:59.855 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.856+0000 7fdc8c02f800 20 add_watcher() i=4 2024-09-12T00:49:59.856 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.856+0000 7fdc8c02f800 20 add_watcher() i=5 2024-09-12T00:49:59.856 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.856+0000 7fdc8c02f800 20 add_watcher() i=6 2024-09-12T00:49:59.856 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.857+0000 7fdc8c02f800 20 add_watcher() i=7 2024-09-12T00:49:59.856 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.857+0000 7fdc8c02f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:59.857 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.859+0000 7fdb3b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:59.858 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.859+0000 7fdc8c02f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:59.858 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.859+0000 7fdc8c02f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:59.859 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.859+0000 7fdc8c02f800 5 note: GC not initialized 2024-09-12T00:49:59.859 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.859+0000 7fdb3a7fc640 20 reqs_thread_entry: start 2024-09-12T00:49:59.859 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.859+0000 7fdc8c02f800 20 init_complete bucket index max shards: 1 2024-09-12T00:49:59.859 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.860+0000 7fdc8c02f800 20 Filter name: none 2024-09-12T00:49:59.859 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.860+0000 7fdaabfff640 20 reqs_thread_entry: start 2024-09-12T00:49:59.859 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.860+0000 7fdc8c02f800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T00:49:59.859 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.860+0000 7fdc8c02f800 20 rados->read ofs=0 len=0 2024-09-12T00:49:59.860 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.860+0000 7fdc8c02f800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:49:59.860 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.860+0000 7fdc8c02f800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:49:59.860 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.861+0000 7fdc8c02f800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:49:59.860 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.861+0000 7fdc8c02f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25 : miss 2024-09-12T00:49:59.860 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.861+0000 7fdc8c02f800 20 rados->read ofs=0 len=0 2024-09-12T00:49:59.860 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.861+0000 7fdc8c02f800 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:49:59.860 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.861+0000 7fdc8c02f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25 info.flags=0x17 2024-09-12T00:49:59.860 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.861+0000 7fdc8c02f800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25 to cache LRU end 2024-09-12T00:49:59.860 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.861+0000 7fdc8c02f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:59.861 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.861+0000 7fdc8c02f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:59.861 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.861+0000 7fdc8c02f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25 2024-09-12T00:49:59.861 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.862+0000 7fdc8c02f800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:49:59.865 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.866+0000 7fdc8c02f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25 info.flags=0x17 2024-09-12T00:49:59.865 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.866+0000 7fdc8c02f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25 to cache LRU end 2024-09-12T00:49:59.865 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.866+0000 7fdc8c02f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:59.865 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.866+0000 7fdc8c02f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25, ofs0, ns] 2024-09-12T00:49:59.865 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.866+0000 7fdb6d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496988 cookie 94669780673712 notifier 6437 bl.length()=939 2024-09-12T00:49:59.865 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.866+0000 7fdb6d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25 info.flags=0x17 2024-09-12T00:49:59.865 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.866+0000 7fdb6d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25 to cache LRU end 2024-09-12T00:49:59.865 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.866+0000 7fdb6d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:59.866 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.868+0000 7fdc8c02f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25]): orig_sources= new_sources= 2024-09-12T00:49:59.866 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.868+0000 7fdc8c02f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25]): potential sources added=[] removed=[] 2024-09-12T00:49:59.866 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.868+0000 7fdc8c02f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25]): orig_dests= new_dests= 2024-09-12T00:49:59.867 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.868+0000 7fdc8c02f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25]): potential dests added=[] removed=[] 2024-09-12T00:49:59.869 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.870+0000 7fdc8c02f800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25.2.0 2024-09-12T00:49:59.869 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.870+0000 7fdc8c02f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25.2.0 2024-09-12T00:49:59.869 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.870+0000 7fdc8c02f800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25.2.1 2024-09-12T00:49:59.869 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.870+0000 7fdc8c02f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25.2.1 2024-09-12T00:49:59.869 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.870+0000 7fdc8c02f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25.0 2024-09-12T00:49:59.872 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.873+0000 7fdc8c02f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25 : hit (requested=0x17, cached=0x17) 2024-09-12T00:49:59.872 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.873+0000 7fdc8c02f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25 2024-09-12T00:49:59.877 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.874+0000 7fdc8c02f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25 info.flags=0x17 2024-09-12T00:49:59.877 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.874+0000 7fdc8c02f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25 to cache LRU end 2024-09-12T00:49:59.877 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.874+0000 7fdc8c02f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:59.877 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.874+0000 7fdc8c02f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25, ofs0, ns] 2024-09-12T00:49:59.878 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.875+0000 7fdb6d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496989 cookie 94669780673712 notifier 6437 bl.length()=939 2024-09-12T00:49:59.878 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.875+0000 7fdb6d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25 info.flags=0x17 2024-09-12T00:49:59.878 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.875+0000 7fdb6d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25 to cache LRU end 2024-09-12T00:49:59.878 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.875+0000 7fdb6d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:59.878 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.876+0000 7fdc8c02f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25]): orig_sources= new_sources= 2024-09-12T00:49:59.878 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.876+0000 7fdc8c02f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25]): potential sources added=[] removed=[] 2024-09-12T00:49:59.878 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.876+0000 7fdc8c02f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25]): orig_dests= new_dests= 2024-09-12T00:49:59.878 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.876+0000 7fdc8c02f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25]): potential dests added=[] removed=[] 2024-09-12T00:49:59.878 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.877+0000 7fdc8c02f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25.0 2024-09-12T00:49:59.879 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.877+0000 7fdc8c02f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25 : hit (requested=0x17, cached=0x17) 2024-09-12T00:49:59.879 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.877+0000 7fdc8c02f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25 2024-09-12T00:49:59.879 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.879+0000 7fdc8c02f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25 info.flags=0x17 2024-09-12T00:49:59.879 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.879+0000 7fdc8c02f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25 to cache LRU end 2024-09-12T00:49:59.880 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.879+0000 7fdc8c02f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:59.880 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.879+0000 7fdc8c02f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25, ofs0, ns] 2024-09-12T00:49:59.880 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.879+0000 7fdb6d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496990 cookie 94669780673712 notifier 6437 bl.length()=907 2024-09-12T00:49:59.880 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.879+0000 7fdb6d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25 info.flags=0x17 2024-09-12T00:49:59.880 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.879+0000 7fdb6d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25 to cache LRU end 2024-09-12T00:49:59.880 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.879+0000 7fdb6d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:59.880 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.880+0000 7fdc8c02f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25]): orig_sources= new_sources= 2024-09-12T00:49:59.880 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.880+0000 7fdc8c02f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25]): potential sources added=[] removed=[] 2024-09-12T00:49:59.880 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.880+0000 7fdc8c02f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25]): orig_dests= new_dests= 2024-09-12T00:49:59.880 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.880+0000 7fdc8c02f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25]): potential dests added=[] removed=[] 2024-09-12T00:49:59.881 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.881+0000 7fdc8c02f800 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 1 shards to 2 shards completed successfully 2024-09-12T00:49:59.882 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.883+0000 7fdb3b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:59.884 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.885+0000 7fdc8c02f800 20 remove_watcher() i=0 2024-09-12T00:49:59.884 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.885+0000 7fdc8c02f800 2 removed watcher, disabling cache 2024-09-12T00:49:59.885 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.887+0000 7fdc8c02f800 20 remove_watcher() i=1 2024-09-12T00:49:59.886 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.888+0000 7fdc8c02f800 20 remove_watcher() i=2 2024-09-12T00:49:59.887 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.889+0000 7fdc8c02f800 20 remove_watcher() i=3 2024-09-12T00:49:59.889 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.890+0000 7fdc8c02f800 20 remove_watcher() i=4 2024-09-12T00:49:59.889 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.891+0000 7fdc8c02f800 20 remove_watcher() i=5 2024-09-12T00:49:59.890 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.891+0000 7fdc8c02f800 20 remove_watcher() i=6 2024-09-12T00:49:59.891 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.892+0000 7fdc8c02f800 20 remove_watcher() i=7 2024-09-12T00:49:59.903 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:49:59.931 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:59.931 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:59.967 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.969+0000 7f8fbbc40800 20 rados->read ofs=0 len=0 2024-09-12T00:49:59.969 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.970+0000 7f8fbbc40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:59.970 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.970+0000 7f8fbbc40800 20 realm 2024-09-12T00:49:59.970 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.970+0000 7f8fbbc40800 20 rados->read ofs=0 len=0 2024-09-12T00:49:59.970 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.971+0000 7f8fbbc40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:59.970 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.971+0000 7f8fbbc40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:59.970 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.971+0000 7f8fbbc40800 20 rados->read ofs=0 len=0 2024-09-12T00:49:59.970 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.971+0000 7f8fbbc40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:59.970 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.971+0000 7f8fbbc40800 20 rados->read ofs=0 len=0 2024-09-12T00:49:59.971 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.972+0000 7f8fbbc40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:59.971 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.972+0000 7f8fbbc40800 20 rados->read ofs=0 len=0 2024-09-12T00:49:59.971 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.973+0000 7f8fbbc40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:59.971 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.973+0000 7f8fbbc40800 20 searching for the correct realm 2024-09-12T00:49:59.974 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:49:59.975+0000 7f8fb9f2b640 0 -- 172.21.15.73:0/3479780010 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f8fa408a2a0 msgr2=0x7f8fa40a6a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:50:00.179 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.180+0000 7f8fb9f2b640 0 -- 172.21.15.73:0/3479780010 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f8fa408a2a0 msgr2=0x7f8fa40a6a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:00.183 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.184+0000 7f8fbbc40800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:50:00.183 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.184+0000 7f8fbbc40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:00.183 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.184+0000 7f8fbbc40800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:50:00.183 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.184+0000 7f8fbbc40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:00.183 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.184+0000 7f8fbbc40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:00.183 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.184+0000 7f8fbbc40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:00.183 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.184+0000 7f8fbbc40800 20 rados->read ofs=0 len=0 2024-09-12T00:50:00.183 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.184+0000 7f8fbbc40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:00.183 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.184+0000 7f8fbbc40800 20 rados->read ofs=0 len=0 2024-09-12T00:50:00.185 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.184+0000 7f8fbbc40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:00.185 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.184+0000 7f8fbbc40800 20 rados->read ofs=0 len=0 2024-09-12T00:50:00.185 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.185+0000 7f8fbbc40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:00.185 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.185+0000 7f8fbbc40800 20 zone default found 2024-09-12T00:50:00.185 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.185+0000 7f8fbbc40800 4 Realm: () 2024-09-12T00:50:00.185 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.185+0000 7f8fbbc40800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:50:00.185 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.185+0000 7f8fbbc40800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:50:00.185 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.185+0000 7f8fbbc40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:00.185 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.185+0000 7f8fbbc40800 20 zonegroup default 2024-09-12T00:50:00.185 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.185+0000 7f8fbbc40800 20 rados->read ofs=0 len=0 2024-09-12T00:50:00.185 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.185+0000 7f8fbbc40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:00.185 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.185+0000 7f8fbbc40800 20 rados->read ofs=0 len=0 2024-09-12T00:50:00.186 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.185+0000 7f8fbbc40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:00.186 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.185+0000 7f8fbbc40800 20 rados->read ofs=0 len=0 2024-09-12T00:50:00.186 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.185+0000 7f8fbbc40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:00.186 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.185+0000 7f8fbbc40800 20 started sync module instance, tier type = 2024-09-12T00:50:00.186 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.185+0000 7f8fbbc40800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:50:00.193 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.195+0000 7f8fbbc40800 20 add_watcher() i=0 2024-09-12T00:50:00.193 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.195+0000 7f8fbbc40800 20 add_watcher() i=1 2024-09-12T00:50:00.194 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.195+0000 7f8fbbc40800 20 add_watcher() i=2 2024-09-12T00:50:00.194 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.195+0000 7f8fbbc40800 20 add_watcher() i=3 2024-09-12T00:50:00.194 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.195+0000 7f8fbbc40800 20 add_watcher() i=4 2024-09-12T00:50:00.194 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.195+0000 7f8fbbc40800 20 add_watcher() i=5 2024-09-12T00:50:00.194 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.195+0000 7f8fbbc40800 20 add_watcher() i=6 2024-09-12T00:50:00.194 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.196+0000 7f8fbbc40800 20 add_watcher() i=7 2024-09-12T00:50:00.194 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.196+0000 7f8fbbc40800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:00.196 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.197+0000 7f8e6f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:00.197 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.197+0000 7f8fbbc40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:00.197 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.197+0000 7f8fbbc40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:00.197 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.197+0000 7f8fbbc40800 5 note: GC not initialized 2024-09-12T00:50:00.197 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.198+0000 7f8e6e7e4640 20 reqs_thread_entry: start 2024-09-12T00:50:00.197 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.198+0000 7f8fbbc40800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:00.197 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.198+0000 7f8fbbc40800 20 Filter name: none 2024-09-12T00:50:00.197 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.198+0000 7f8ddffff640 20 reqs_thread_entry: start 2024-09-12T00:50:00.197 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.198+0000 7f8fbbc40800 20 rados->read ofs=0 len=0 2024-09-12T00:50:00.199 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.198+0000 7f8fbbc40800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:50:00.199 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.198+0000 7f8fbbc40800 20 rados->read ofs=0 len=0 2024-09-12T00:50:00.199 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.199+0000 7f8fbbc40800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:50:00.199 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.199+0000 7f8fbbc40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:00.199 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.199+0000 7f8fbbc40800 20 rados->read ofs=0 len=0 2024-09-12T00:50:00.200 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.199+0000 7f8fbbc40800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:50:00.200 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.199+0000 7f8fbbc40800 20 rados->read ofs=0 len=0 2024-09-12T00:50:00.200 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.200+0000 7f8fbbc40800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:50:00.200 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.200+0000 7f8fbbc40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:00.200 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.201+0000 7f8e6f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:00.202 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.203+0000 7f8fbbc40800 20 remove_watcher() i=0 2024-09-12T00:50:00.202 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.203+0000 7f8fbbc40800 2 removed watcher, disabling cache 2024-09-12T00:50:00.202 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.204+0000 7f8fbbc40800 20 remove_watcher() i=1 2024-09-12T00:50:00.203 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.205+0000 7f8fbbc40800 20 remove_watcher() i=2 2024-09-12T00:50:00.204 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.206+0000 7f8fbbc40800 20 remove_watcher() i=3 2024-09-12T00:50:00.205 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.207+0000 7f8fbbc40800 20 remove_watcher() i=4 2024-09-12T00:50:00.206 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.208+0000 7f8fbbc40800 20 remove_watcher() i=5 2024-09-12T00:50:00.207 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.209+0000 7f8fbbc40800 20 remove_watcher() i=6 2024-09-12T00:50:00.208 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:00.210+0000 7f8fbbc40800 20 remove_watcher() i=7 2024-09-12T00:50:00.218 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:00.218 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:50:00.219 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: error-at-trim-reshard-log-entries id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:50:00.219 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:00.220 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:00.220 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:00.241 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:00.241 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:00.448 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:00.448 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:00.509 INFO:tasks.workunit.client.0.smithi073.stderr:TEST: reshard bucket with EOPNOTSUPP injected at trim_reshard_log_entries 2024-09-12T00:50:00.509 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:00.509 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:00.510 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:00.550 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:00.550 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:00.605 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:00.605 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:00.637 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:00.637 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:00.672 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:00.672 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:00.706 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:00.706 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:00.739 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:00.739 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:00.773 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:00.773 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:00.806 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:00.807 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:00.840 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:00.841 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:00.876 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:00.876 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:00.913 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:00.913 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:00.946 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:00.946 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:00.981 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:00.981 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:01.015 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:01.016 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:01.050 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:01.051 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:01.086 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:01.086 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:01.122 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:01.122 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:01.156 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:01.156 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:01.190 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:01.190 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:01.224 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:01.224 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:01.260 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:01.260 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:01.295 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:50:01.324 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:01.324 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:01.362 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.363+0000 7f441a60f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:01.363 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.364+0000 7f441a60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:01.364 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.364+0000 7f441a60f800 20 realm 2024-09-12T00:50:01.364 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.365+0000 7f441a60f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:01.364 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.365+0000 7f441a60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:01.364 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.365+0000 7f441a60f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:01.364 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.365+0000 7f441a60f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:01.364 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.365+0000 7f441a60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:01.364 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.365+0000 7f441a60f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:01.365 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.366+0000 7f441a60f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:01.365 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.366+0000 7f441a60f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:01.365 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.366+0000 7f441a60f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:01.365 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.366+0000 7f441a60f800 20 searching for the correct realm 2024-09-12T00:50:01.366 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.367+0000 7f4418100640 0 -- 172.21.15.73:0/3529782521 >> [v2:172.21.15.117:6816/1460498570,v1:172.21.15.117:6817/1460498570] conn(0x5597a18308b0 msgr2=0x7f4410060bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:01.570 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.571+0000 7f44178ff640 0 -- 172.21.15.73:0/3529782521 >> [v2:172.21.15.73:6826/269690776,v1:172.21.15.73:6827/269690776] conn(0x7f44080cd040 msgr2=0x7f440804e3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:01.777 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.778+0000 7f441a60f800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:50:01.778 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.778+0000 7f441a60f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:01.778 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.778+0000 7f441a60f800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:50:01.778 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.778+0000 7f441a60f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:01.778 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.778+0000 7f441a60f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:01.778 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.778+0000 7f441a60f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:01.778 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.778+0000 7f441a60f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:01.778 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.778+0000 7f441a60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:01.778 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.778+0000 7f441a60f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:01.778 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.779+0000 7f441a60f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:01.778 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.779+0000 7f441a60f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:01.780 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.779+0000 7f441a60f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:01.780 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.779+0000 7f441a60f800 20 zone default found 2024-09-12T00:50:01.780 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.779+0000 7f441a60f800 4 Realm: () 2024-09-12T00:50:01.780 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.779+0000 7f441a60f800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:50:01.780 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.779+0000 7f441a60f800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:50:01.780 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.779+0000 7f441a60f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:01.780 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.779+0000 7f441a60f800 20 zonegroup default 2024-09-12T00:50:01.780 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.779+0000 7f441a60f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:01.780 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.779+0000 7f441a60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:01.780 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.779+0000 7f441a60f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:01.781 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.780+0000 7f441a60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:01.781 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.780+0000 7f441a60f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:01.781 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.780+0000 7f441a60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:01.781 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.780+0000 7f441a60f800 20 started sync module instance, tier type = 2024-09-12T00:50:01.781 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.780+0000 7f441a60f800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:50:01.788 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.790+0000 7f441a60f800 20 add_watcher() i=0 2024-09-12T00:50:01.788 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.790+0000 7f441a60f800 20 add_watcher() i=1 2024-09-12T00:50:01.788 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.790+0000 7f441a60f800 20 add_watcher() i=2 2024-09-12T00:50:01.788 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.790+0000 7f441a60f800 20 add_watcher() i=3 2024-09-12T00:50:01.789 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.790+0000 7f441a60f800 20 add_watcher() i=4 2024-09-12T00:50:01.789 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.790+0000 7f441a60f800 20 add_watcher() i=5 2024-09-12T00:50:01.789 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.790+0000 7f441a60f800 20 add_watcher() i=6 2024-09-12T00:50:01.789 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.791+0000 7f441a60f800 20 add_watcher() i=7 2024-09-12T00:50:01.789 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.791+0000 7f441a60f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:01.791 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.792+0000 7f42cefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:01.792 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.792+0000 7f441a60f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:01.792 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.792+0000 7f441a60f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:01.792 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.792+0000 7f441a60f800 5 note: GC not initialized 2024-09-12T00:50:01.792 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.793+0000 7f42cdfdb640 20 reqs_thread_entry: start 2024-09-12T00:50:01.792 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.793+0000 7f441a60f800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:01.792 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.793+0000 7f441a60f800 20 Filter name: none 2024-09-12T00:50:01.792 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.793+0000 7f423f7fe640 20 reqs_thread_entry: start 2024-09-12T00:50:01.792 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.793+0000 7f441a60f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:01.794 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.794+0000 7f441a60f800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:50:01.794 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.794+0000 7f441a60f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:01.794 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.794+0000 7f441a60f800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:50:01.794 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.794+0000 7f441a60f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:01.794 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.794+0000 7f441a60f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:01.794 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.795+0000 7f441a60f800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:50:01.794 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.795+0000 7f441a60f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:01.794 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.795+0000 7f441a60f800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:50:01.794 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.795+0000 7f441a60f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:01.795 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.796+0000 7f42cefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:01.797 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.798+0000 7f441a60f800 20 remove_watcher() i=0 2024-09-12T00:50:01.797 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.798+0000 7f441a60f800 2 removed watcher, disabling cache 2024-09-12T00:50:01.797 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.799+0000 7f441a60f800 20 remove_watcher() i=1 2024-09-12T00:50:01.798 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.800+0000 7f441a60f800 20 remove_watcher() i=2 2024-09-12T00:50:01.799 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.801+0000 7f441a60f800 20 remove_watcher() i=3 2024-09-12T00:50:01.800 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.802+0000 7f441a60f800 20 remove_watcher() i=4 2024-09-12T00:50:01.801 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.802+0000 7f441a60f800 20 remove_watcher() i=5 2024-09-12T00:50:01.802 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.803+0000 7f441a60f800 20 remove_watcher() i=6 2024-09-12T00:50:01.803 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.804+0000 7f441a60f800 20 remove_watcher() i=7 2024-09-12T00:50:01.813 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:01.813 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:50:01.813 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: error-at-trim-reshard-log-entries id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.26 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:50:01.813 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:01.815 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries --inject-error-code 95 2024-09-12T00:50:01.851 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:01.851 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:01.887 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.889+0000 7fd88c746800 20 rados->read ofs=0 len=0 2024-09-12T00:50:01.889 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.890+0000 7fd88c746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:01.889 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.890+0000 7fd88c746800 20 realm 2024-09-12T00:50:01.889 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.890+0000 7fd88c746800 20 rados->read ofs=0 len=0 2024-09-12T00:50:01.889 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.890+0000 7fd88c746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:01.890 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.890+0000 7fd88c746800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:01.890 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.890+0000 7fd88c746800 20 rados->read ofs=0 len=0 2024-09-12T00:50:01.890 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.891+0000 7fd88c746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:01.890 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.891+0000 7fd88c746800 20 rados->read ofs=0 len=0 2024-09-12T00:50:01.890 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.891+0000 7fd88c746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:01.890 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.891+0000 7fd88c746800 20 rados->read ofs=0 len=0 2024-09-12T00:50:01.891 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.892+0000 7fd88c746800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:01.891 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.892+0000 7fd88c746800 20 searching for the correct realm 2024-09-12T00:50:01.894 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.895+0000 7fd88aa31640 0 -- 172.21.15.73:0/1008198895 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fd874063040 msgr2=0x7fd874056470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:01.897 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.898+0000 7fd881a2f640 0 -- 172.21.15.73:0/1008198895 >> [v2:172.21.15.117:6800/110688882,v1:172.21.15.117:6801/110688882] conn(0x558140df8d90 msgr2=0x558140dfb1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:01.901 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.902+0000 7fd88c746800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:50:01.901 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.902+0000 7fd88c746800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:01.901 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.902+0000 7fd88c746800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:50:01.901 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.902+0000 7fd88c746800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:01.902 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.902+0000 7fd88c746800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:01.902 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.902+0000 7fd88c746800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:01.902 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.902+0000 7fd88c746800 20 rados->read ofs=0 len=0 2024-09-12T00:50:01.902 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.902+0000 7fd88c746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:01.902 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.902+0000 7fd88c746800 20 rados->read ofs=0 len=0 2024-09-12T00:50:01.902 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.902+0000 7fd88c746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:01.902 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.902+0000 7fd88c746800 20 rados->read ofs=0 len=0 2024-09-12T00:50:01.903 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.902+0000 7fd88c746800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:01.903 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.902+0000 7fd88c746800 20 zone default found 2024-09-12T00:50:01.903 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.902+0000 7fd88c746800 4 Realm: () 2024-09-12T00:50:01.903 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.902+0000 7fd88c746800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:50:01.903 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.902+0000 7fd88c746800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:50:01.903 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.902+0000 7fd88c746800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:01.903 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.902+0000 7fd88c746800 20 zonegroup default 2024-09-12T00:50:01.903 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.902+0000 7fd88c746800 20 rados->read ofs=0 len=0 2024-09-12T00:50:01.903 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.903+0000 7fd88c746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:01.903 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.903+0000 7fd88c746800 20 rados->read ofs=0 len=0 2024-09-12T00:50:01.904 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.903+0000 7fd88c746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:01.904 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.903+0000 7fd88c746800 20 rados->read ofs=0 len=0 2024-09-12T00:50:01.904 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.903+0000 7fd88c746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:01.904 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.903+0000 7fd88c746800 20 started sync module instance, tier type = 2024-09-12T00:50:01.904 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.903+0000 7fd88c746800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:50:01.910 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.912+0000 7fd88c746800 20 add_watcher() i=0 2024-09-12T00:50:01.910 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.912+0000 7fd88c746800 20 add_watcher() i=1 2024-09-12T00:50:01.911 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.912+0000 7fd88c746800 20 add_watcher() i=2 2024-09-12T00:50:01.911 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.912+0000 7fd88c746800 20 add_watcher() i=3 2024-09-12T00:50:01.911 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.912+0000 7fd88c746800 20 add_watcher() i=4 2024-09-12T00:50:01.911 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.912+0000 7fd88c746800 20 add_watcher() i=5 2024-09-12T00:50:01.911 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.912+0000 7fd88c746800 20 add_watcher() i=6 2024-09-12T00:50:01.911 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.912+0000 7fd88c746800 20 add_watcher() i=7 2024-09-12T00:50:01.911 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.912+0000 7fd88c746800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:01.912 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.914+0000 7fd740fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:01.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.914+0000 7fd88c746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:01.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.914+0000 7fd88c746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:01.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.914+0000 7fd88c746800 5 note: GC not initialized 2024-09-12T00:50:01.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.914+0000 7fd6bb7fe640 20 reqs_thread_entry: start 2024-09-12T00:50:01.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.915+0000 7fd88c746800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:01.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.915+0000 7fd88c746800 20 Filter name: none 2024-09-12T00:50:01.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.915+0000 7fd6b97fa640 20 reqs_thread_entry: start 2024-09-12T00:50:01.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.915+0000 7fd88c746800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T00:50:01.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.915+0000 7fd88c746800 20 rados->read ofs=0 len=0 2024-09-12T00:50:01.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.915+0000 7fd88c746800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:50:01.916 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.915+0000 7fd88c746800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:50:01.916 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.915+0000 7fd88c746800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:50:01.916 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.915+0000 7fd88c746800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.26 : miss 2024-09-12T00:50:01.916 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.915+0000 7fd88c746800 20 rados->read ofs=0 len=0 2024-09-12T00:50:01.917 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.915+0000 7fd88c746800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:50:01.917 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.916+0000 7fd88c746800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.26 info.flags=0x17 2024-09-12T00:50:01.917 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.916+0000 7fd88c746800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.26 to cache LRU end 2024-09-12T00:50:01.917 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.916+0000 7fd88c746800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:01.917 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.916+0000 7fd88c746800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:01.917 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.916+0000 7fd88c746800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.26 2024-09-12T00:50:01.918 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.919+0000 7fd88c746800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.26 info.flags=0x17 2024-09-12T00:50:01.918 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.919+0000 7fd88c746800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.26 to cache LRU end 2024-09-12T00:50:01.918 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.919+0000 7fd88c746800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:01.918 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.919+0000 7fd88c746800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.26, ofs0, ns] 2024-09-12T00:50:01.918 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.919+0000 7fd76dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496995 cookie 94013627575904 notifier 6846 bl.length()=939 2024-09-12T00:50:01.918 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.919+0000 7fd76dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.26 info.flags=0x17 2024-09-12T00:50:01.918 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.919+0000 7fd76dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.26 to cache LRU end 2024-09-12T00:50:01.918 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.919+0000 7fd76dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:01.920 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.921+0000 7fd88c746800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.26]): orig_sources= new_sources= 2024-09-12T00:50:01.920 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.921+0000 7fd88c746800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.26]): potential sources added=[] removed=[] 2024-09-12T00:50:01.920 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.921+0000 7fd88c746800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.26]): orig_dests= new_dests= 2024-09-12T00:50:01.920 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.921+0000 7fd88c746800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.26]): potential dests added=[] removed=[] 2024-09-12T00:50:01.920 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.921+0000 7fd88c746800 -1 Injecting error=-95 at location=trim_reshard_log_entries 2024-09-12T00:50:01.920 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.921+0000 7fd88c746800 0 WARNING: trim_reshard_log_entries() does not supported logrecord, falling back to block reshard mode. 2024-09-12T00:50:01.921 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.922+0000 7fd88c746800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.26.1.0 2024-09-12T00:50:01.921 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.922+0000 7fd88c746800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.26.1.0 2024-09-12T00:50:01.921 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.922+0000 7fd88c746800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.26.1.1 2024-09-12T00:50:01.921 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.922+0000 7fd88c746800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.26.1.1 2024-09-12T00:50:01.921 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.922+0000 7fd88c746800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.26.0 2024-09-12T00:50:01.923 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.925+0000 7fd88c746800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.26 : hit (requested=0x17, cached=0x17) 2024-09-12T00:50:01.923 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.925+0000 7fd88c746800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.26 2024-09-12T00:50:01.925 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.926+0000 7fd88c746800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.26 info.flags=0x17 2024-09-12T00:50:01.925 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.926+0000 7fd88c746800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.26 to cache LRU end 2024-09-12T00:50:01.925 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.926+0000 7fd88c746800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:01.925 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.926+0000 7fd88c746800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.26, ofs0, ns] 2024-09-12T00:50:01.925 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.926+0000 7fd76d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496996 cookie 94013627575904 notifier 6846 bl.length()=907 2024-09-12T00:50:01.925 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.926+0000 7fd76d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.26 info.flags=0x17 2024-09-12T00:50:01.925 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.926+0000 7fd76d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.26 to cache LRU end 2024-09-12T00:50:01.925 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.926+0000 7fd76d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:01.926 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.927+0000 7fd88c746800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.26]): orig_sources= new_sources= 2024-09-12T00:50:01.926 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.927+0000 7fd88c746800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.26]): potential sources added=[] removed=[] 2024-09-12T00:50:01.926 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.927+0000 7fd88c746800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.26]): orig_dests= new_dests= 2024-09-12T00:50:01.926 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.927+0000 7fd88c746800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.26]): potential dests added=[] removed=[] 2024-09-12T00:50:01.927 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.928+0000 7fd88c746800 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 1 shards to 2 shards completed successfully 2024-09-12T00:50:01.929 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.930+0000 7fd740fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:01.931 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.932+0000 7fd88c746800 20 remove_watcher() i=0 2024-09-12T00:50:01.931 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.932+0000 7fd88c746800 2 removed watcher, disabling cache 2024-09-12T00:50:01.932 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.933+0000 7fd88c746800 20 remove_watcher() i=1 2024-09-12T00:50:01.933 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.934+0000 7fd88c746800 20 remove_watcher() i=2 2024-09-12T00:50:01.933 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.935+0000 7fd88c746800 20 remove_watcher() i=3 2024-09-12T00:50:01.934 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.936+0000 7fd88c746800 20 remove_watcher() i=4 2024-09-12T00:50:01.935 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.937+0000 7fd88c746800 20 remove_watcher() i=5 2024-09-12T00:50:01.936 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.938+0000 7fd88c746800 20 remove_watcher() i=6 2024-09-12T00:50:01.937 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:01.939+0000 7fd88c746800 20 remove_watcher() i=7 2024-09-12T00:50:01.950 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:50:01.978 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:01.978 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:02.016 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.017+0000 7f1d16d46800 20 rados->read ofs=0 len=0 2024-09-12T00:50:02.018 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.019+0000 7f1d16d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:02.018 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.019+0000 7f1d16d46800 20 realm 2024-09-12T00:50:02.018 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.019+0000 7f1d16d46800 20 rados->read ofs=0 len=0 2024-09-12T00:50:02.018 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.019+0000 7f1d16d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:02.018 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.019+0000 7f1d16d46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:02.018 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.019+0000 7f1d16d46800 20 rados->read ofs=0 len=0 2024-09-12T00:50:02.018 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.019+0000 7f1d16d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:02.018 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.019+0000 7f1d16d46800 20 rados->read ofs=0 len=0 2024-09-12T00:50:02.019 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.020+0000 7f1d16d46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:02.019 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.020+0000 7f1d16d46800 20 rados->read ofs=0 len=0 2024-09-12T00:50:02.019 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.021+0000 7f1d16d46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:02.019 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.021+0000 7f1d16d46800 20 searching for the correct realm 2024-09-12T00:50:02.021 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.022+0000 7f1d0c02f640 0 -- 172.21.15.73:0/1463206219 >> [v2:172.21.15.73:6826/269690776,v1:172.21.15.73:6827/269690776] conn(0x7f1d040729a0 msgr2=0x7f1d04068870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:02.227 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.228+0000 7f1d14830640 0 -- 172.21.15.73:0/1463206219 >> [v2:172.21.15.73:6810/1807760270,v1:172.21.15.73:6811/1807760270] conn(0x7f1d100682e0 msgr2=0x7f1d100957d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:02.433 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.434+0000 7f1d16d46800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:50:02.433 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.434+0000 7f1d16d46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:02.433 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.434+0000 7f1d16d46800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:50:02.433 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.434+0000 7f1d16d46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:02.434 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.434+0000 7f1d16d46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:02.434 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.434+0000 7f1d16d46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:02.434 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.434+0000 7f1d16d46800 20 rados->read ofs=0 len=0 2024-09-12T00:50:02.434 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.434+0000 7f1d16d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:02.434 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.434+0000 7f1d16d46800 20 rados->read ofs=0 len=0 2024-09-12T00:50:02.434 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.434+0000 7f1d16d46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:02.434 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.435+0000 7f1d16d46800 20 rados->read ofs=0 len=0 2024-09-12T00:50:02.435 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.435+0000 7f1d16d46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:02.435 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.435+0000 7f1d16d46800 20 zone default found 2024-09-12T00:50:02.435 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.435+0000 7f1d16d46800 4 Realm: () 2024-09-12T00:50:02.435 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.435+0000 7f1d16d46800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:50:02.435 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.435+0000 7f1d16d46800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:50:02.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.435+0000 7f1d16d46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:02.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.435+0000 7f1d16d46800 20 zonegroup default 2024-09-12T00:50:02.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.435+0000 7f1d16d46800 20 rados->read ofs=0 len=0 2024-09-12T00:50:02.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.435+0000 7f1d16d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:02.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.435+0000 7f1d16d46800 20 rados->read ofs=0 len=0 2024-09-12T00:50:02.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.435+0000 7f1d16d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:02.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.435+0000 7f1d16d46800 20 rados->read ofs=0 len=0 2024-09-12T00:50:02.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.436+0000 7f1d16d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:02.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.436+0000 7f1d16d46800 20 started sync module instance, tier type = 2024-09-12T00:50:02.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.436+0000 7f1d16d46800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:50:02.443 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.445+0000 7f1d16d46800 20 add_watcher() i=0 2024-09-12T00:50:02.443 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.445+0000 7f1d16d46800 20 add_watcher() i=1 2024-09-12T00:50:02.444 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.445+0000 7f1d16d46800 20 add_watcher() i=2 2024-09-12T00:50:02.444 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.445+0000 7f1d16d46800 20 add_watcher() i=3 2024-09-12T00:50:02.444 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.445+0000 7f1d16d46800 20 add_watcher() i=4 2024-09-12T00:50:02.444 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.445+0000 7f1d16d46800 20 add_watcher() i=5 2024-09-12T00:50:02.444 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.445+0000 7f1d16d46800 20 add_watcher() i=6 2024-09-12T00:50:02.444 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.446+0000 7f1d16d46800 20 add_watcher() i=7 2024-09-12T00:50:02.444 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.446+0000 7f1d16d46800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:02.446 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.447+0000 7f1bc77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:02.447 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.447+0000 7f1d16d46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:02.447 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.447+0000 7f1d16d46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:02.447 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.447+0000 7f1d16d46800 5 note: GC not initialized 2024-09-12T00:50:02.447 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.448+0000 7f1bc67e4640 20 reqs_thread_entry: start 2024-09-12T00:50:02.447 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.448+0000 7f1d16d46800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:02.448 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.448+0000 7f1d16d46800 20 Filter name: none 2024-09-12T00:50:02.448 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.448+0000 7f1bbf7fe640 20 reqs_thread_entry: start 2024-09-12T00:50:02.448 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.448+0000 7f1d16d46800 20 rados->read ofs=0 len=0 2024-09-12T00:50:02.448 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.448+0000 7f1d16d46800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:50:02.448 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.448+0000 7f1d16d46800 20 rados->read ofs=0 len=0 2024-09-12T00:50:02.449 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.449+0000 7f1d16d46800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:50:02.449 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.449+0000 7f1d16d46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:02.449 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.449+0000 7f1d16d46800 20 rados->read ofs=0 len=0 2024-09-12T00:50:02.449 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.450+0000 7f1d16d46800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:50:02.449 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.450+0000 7f1d16d46800 20 rados->read ofs=0 len=0 2024-09-12T00:50:02.449 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.450+0000 7f1d16d46800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:50:02.449 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.450+0000 7f1d16d46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:02.450 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.451+0000 7f1bc77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:02.452 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.453+0000 7f1d16d46800 20 remove_watcher() i=0 2024-09-12T00:50:02.452 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.453+0000 7f1d16d46800 2 removed watcher, disabling cache 2024-09-12T00:50:02.453 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.454+0000 7f1d16d46800 20 remove_watcher() i=1 2024-09-12T00:50:02.454 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.455+0000 7f1d16d46800 20 remove_watcher() i=2 2024-09-12T00:50:02.455 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.456+0000 7f1d16d46800 20 remove_watcher() i=3 2024-09-12T00:50:02.456 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.457+0000 7f1d16d46800 20 remove_watcher() i=4 2024-09-12T00:50:02.457 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.458+0000 7f1d16d46800 20 remove_watcher() i=5 2024-09-12T00:50:02.458 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.459+0000 7f1d16d46800 20 remove_watcher() i=6 2024-09-12T00:50:02.459 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:02.460+0000 7f1d16d46800 20 remove_watcher() i=7 2024-09-12T00:50:02.470 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:02.470 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:50:02.470 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: error-at-trim-reshard-log-entries id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.26 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-12T00:50:02.470 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:02.472 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:02.472 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:02.491 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:02.491 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:02.712 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:02.712 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:02.774 INFO:tasks.workunit.client.0.smithi073.stderr:TEST: reshard bucket with abort at trim_reshard_log_entries 2024-09-12T00:50:02.774 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:02.776 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:02.776 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:02.816 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:02.816 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:02.872 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:02.873 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:02.910 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:02.910 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:02.943 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:02.943 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:02.977 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:02.977 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:03.012 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:03.012 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:03.046 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:03.047 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:03.080 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:03.080 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:03.114 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:03.114 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:03.149 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:03.149 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:03.183 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:03.183 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:03.217 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:03.217 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:03.251 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:03.251 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:03.285 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:03.285 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:03.322 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:03.322 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:03.356 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:03.357 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:03.391 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:03.392 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:03.425 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:03.425 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:03.465 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:03.465 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:03.498 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:03.499 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:03.533 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:03.533 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:03.567 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T00:50:03.595 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:03.595 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:03.632 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.633+0000 7f6b60baf800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.633 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.634+0000 7f6b60baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:03.633 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.634+0000 7f6b60baf800 20 realm 2024-09-12T00:50:03.633 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.634+0000 7f6b60baf800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.634 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.635+0000 7f6b60baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:03.634 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.635+0000 7f6b60baf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:03.634 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.635+0000 7f6b60baf800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.634 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.635+0000 7f6b60baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:03.634 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.635+0000 7f6b60baf800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.634 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.636+0000 7f6b60baf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:03.635 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.636+0000 7f6b60baf800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.635 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.636+0000 7f6b60baf800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:03.635 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.637+0000 7f6b60baf800 20 searching for the correct realm 2024-09-12T00:50:03.637 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.639+0000 7f6b5eea1640 0 -- 172.21.15.73:0/3957376720 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f6b48042ba0 msgr2=0x7f6b48015400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:03.843 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.844+0000 7f6b5eea1640 0 -- 172.21.15.73:0/3957376720 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f6b48042ba0 msgr2=0x7f6b48015400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:03.846 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.847+0000 7f6b60baf800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:50:03.846 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.847+0000 7f6b60baf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:03.847 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.847+0000 7f6b60baf800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:50:03.847 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.847+0000 7f6b60baf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:03.847 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.847+0000 7f6b60baf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:03.847 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.847+0000 7f6b60baf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:03.847 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.847+0000 7f6b60baf800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.847 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.848+0000 7f6b60baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:03.847 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.848+0000 7f6b60baf800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.848 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.848+0000 7f6b60baf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:03.848 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.848+0000 7f6b60baf800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.848 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.848+0000 7f6b60baf800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:03.849 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.848+0000 7f6b60baf800 20 zone default found 2024-09-12T00:50:03.849 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.848+0000 7f6b60baf800 4 Realm: () 2024-09-12T00:50:03.849 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.848+0000 7f6b60baf800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:50:03.849 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.848+0000 7f6b60baf800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:50:03.849 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.848+0000 7f6b60baf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:03.849 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.848+0000 7f6b60baf800 20 zonegroup default 2024-09-12T00:50:03.849 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.848+0000 7f6b60baf800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.849 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.849+0000 7f6b60baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:03.849 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.849+0000 7f6b60baf800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.849 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.849+0000 7f6b60baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:03.849 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.849+0000 7f6b60baf800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.849 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.849+0000 7f6b60baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:03.849 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.849+0000 7f6b60baf800 20 started sync module instance, tier type = 2024-09-12T00:50:03.849 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.849+0000 7f6b60baf800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:50:03.857 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.859+0000 7f6b60baf800 20 add_watcher() i=0 2024-09-12T00:50:03.857 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.859+0000 7f6b60baf800 20 add_watcher() i=1 2024-09-12T00:50:03.858 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.859+0000 7f6b60baf800 20 add_watcher() i=2 2024-09-12T00:50:03.858 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.859+0000 7f6b60baf800 20 add_watcher() i=3 2024-09-12T00:50:03.858 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.859+0000 7f6b60baf800 20 add_watcher() i=4 2024-09-12T00:50:03.858 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.859+0000 7f6b60baf800 20 add_watcher() i=5 2024-09-12T00:50:03.858 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.859+0000 7f6b60baf800 20 add_watcher() i=6 2024-09-12T00:50:03.858 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.859+0000 7f6b60baf800 20 add_watcher() i=7 2024-09-12T00:50:03.858 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.859+0000 7f6b60baf800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:03.860 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.861+0000 7f6a14fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:03.860 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.861+0000 7f6b60baf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:03.860 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.861+0000 7f6b60baf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:03.860 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.861+0000 7f6b60baf800 5 note: GC not initialized 2024-09-12T00:50:03.861 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.861+0000 7f698f7fe640 20 reqs_thread_entry: start 2024-09-12T00:50:03.861 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.861+0000 7f6b60baf800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:03.861 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.862+0000 7f6b60baf800 20 Filter name: none 2024-09-12T00:50:03.861 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.862+0000 7f698d7fa640 20 reqs_thread_entry: start 2024-09-12T00:50:03.861 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.862+0000 7f6b60baf800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.861 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.862+0000 7f6b60baf800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:50:03.861 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.862+0000 7f6b60baf800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.862 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.863+0000 7f6b60baf800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:50:03.863 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.863+0000 7f6b60baf800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:03.863 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.863+0000 7f6b60baf800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.863 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.863+0000 7f6b60baf800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:50:03.863 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.863+0000 7f6b60baf800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.863 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.863+0000 7f6b60baf800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:50:03.863 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.863+0000 7f6b60baf800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:03.863 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.865+0000 7f6a14fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:03.865 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.867+0000 7f6b60baf800 20 remove_watcher() i=0 2024-09-12T00:50:03.865 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.867+0000 7f6b60baf800 2 removed watcher, disabling cache 2024-09-12T00:50:03.866 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.868+0000 7f6b60baf800 20 remove_watcher() i=1 2024-09-12T00:50:03.867 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.869+0000 7f6b60baf800 20 remove_watcher() i=2 2024-09-12T00:50:03.868 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.870+0000 7f6b60baf800 20 remove_watcher() i=3 2024-09-12T00:50:03.869 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.871+0000 7f6b60baf800 20 remove_watcher() i=4 2024-09-12T00:50:03.870 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.872+0000 7f6b60baf800 20 remove_watcher() i=5 2024-09-12T00:50:03.871 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.873+0000 7f6b60baf800 20 remove_watcher() i=6 2024-09-12T00:50:03.872 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.874+0000 7f6b60baf800 20 remove_watcher() i=7 2024-09-12T00:50:03.882 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:03.883 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:50:03.883 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: abort-at-trim-reshard-log-entries id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:50:03.883 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:03.884 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at trim_reshard_log_entries 2024-09-12T00:50:03.918 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:03.918 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:03.955 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.956+0000 7f535e698800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.956 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.957+0000 7f535e698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:03.957 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.957+0000 7f535e698800 20 realm 2024-09-12T00:50:03.957 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.957+0000 7f535e698800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.957 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.958+0000 7f535e698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:03.957 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.958+0000 7f535e698800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:03.957 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.958+0000 7f535e698800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.957 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.958+0000 7f535e698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:03.957 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.958+0000 7f535e698800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.958 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.959+0000 7f535e698800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:03.958 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.959+0000 7f535e698800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.958 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.960+0000 7f535e698800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:03.958 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.960+0000 7f535e698800 20 searching for the correct realm 2024-09-12T00:50:03.960 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:03.962+0000 7f535c983640 0 -- 172.21.15.73:0/4248616062 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f534406b030 msgr2=0x7f53440ab6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:04.168 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.168+0000 7f535c983640 0 -- 172.21.15.73:0/4248616062 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f534406b030 msgr2=0x7f53440ab6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:04.171 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.172+0000 7f535e698800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:50:04.171 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.172+0000 7f535e698800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:04.171 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.172+0000 7f535e698800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:50:04.171 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.172+0000 7f535e698800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:04.171 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.172+0000 7f535e698800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:04.171 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.172+0000 7f535e698800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:04.171 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.172+0000 7f535e698800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.171 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.172+0000 7f535e698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:04.172 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.172+0000 7f535e698800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.172 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.172+0000 7f535e698800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:04.172 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.172+0000 7f535e698800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.173 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.172+0000 7f535e698800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:04.173 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.172+0000 7f535e698800 20 zone default found 2024-09-12T00:50:04.173 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.172+0000 7f535e698800 4 Realm: () 2024-09-12T00:50:04.173 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.172+0000 7f535e698800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:50:04.173 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.172+0000 7f535e698800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:50:04.173 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.172+0000 7f535e698800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:04.173 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.172+0000 7f535e698800 20 zonegroup default 2024-09-12T00:50:04.173 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.172+0000 7f535e698800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.173 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.173+0000 7f535e698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:04.173 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.173+0000 7f535e698800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.174 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.173+0000 7f535e698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:04.174 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.173+0000 7f535e698800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.174 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.173+0000 7f535e698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:04.174 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.173+0000 7f535e698800 20 started sync module instance, tier type = 2024-09-12T00:50:04.174 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.173+0000 7f535e698800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:50:04.181 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.182+0000 7f535e698800 20 add_watcher() i=0 2024-09-12T00:50:04.181 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.182+0000 7f535e698800 20 add_watcher() i=1 2024-09-12T00:50:04.181 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.182+0000 7f535e698800 20 add_watcher() i=2 2024-09-12T00:50:04.181 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.182+0000 7f535e698800 20 add_watcher() i=3 2024-09-12T00:50:04.181 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.182+0000 7f535e698800 20 add_watcher() i=4 2024-09-12T00:50:04.181 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.182+0000 7f535e698800 20 add_watcher() i=5 2024-09-12T00:50:04.182 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.182+0000 7f535e698800 20 add_watcher() i=6 2024-09-12T00:50:04.182 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.183+0000 7f535e698800 20 add_watcher() i=7 2024-09-12T00:50:04.182 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.183+0000 7f535e698800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:04.183 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.185+0000 7f5212fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:04.184 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.185+0000 7f535e698800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:04.185 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.185+0000 7f535e698800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:04.185 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.185+0000 7f535e698800 5 note: GC not initialized 2024-09-12T00:50:04.185 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.185+0000 7f5211fdb640 20 reqs_thread_entry: start 2024-09-12T00:50:04.185 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.185+0000 7f535e698800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:04.185 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.185+0000 7f535e698800 20 Filter name: none 2024-09-12T00:50:04.185 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.186+0000 7f51837fe640 20 reqs_thread_entry: start 2024-09-12T00:50:04.185 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.186+0000 7f535e698800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:50:04.185 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.186+0000 7f535e698800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.186 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.186+0000 7f535e698800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:50:04.186 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.186+0000 7f535e698800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:50:04.186 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.186+0000 7f535e698800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:50:04.186 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.186+0000 7f535e698800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27 : miss 2024-09-12T00:50:04.186 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.186+0000 7f535e698800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.186 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.187+0000 7f535e698800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:50:04.186 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.187+0000 7f535e698800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27 info.flags=0x17 2024-09-12T00:50:04.187 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.187+0000 7f535e698800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27 to cache LRU end 2024-09-12T00:50:04.187 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.187+0000 7f535e698800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:04.187 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.187+0000 7f535e698800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:04.187 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.187+0000 7f535e698800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27 2024-09-12T00:50:04.189 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.190+0000 7f535e698800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27 info.flags=0x17 2024-09-12T00:50:04.189 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.190+0000 7f535e698800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27 to cache LRU end 2024-09-12T00:50:04.189 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.190+0000 7f535e698800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:04.189 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.190+0000 7f535e698800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27, ofs0, ns] 2024-09-12T00:50:04.189 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.191+0000 7f52337fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497043 cookie 94229840089024 notifier 6533 bl.length()=939 2024-09-12T00:50:04.190 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.191+0000 7f52337fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27 info.flags=0x17 2024-09-12T00:50:04.190 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.191+0000 7f52337fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27 to cache LRU end 2024-09-12T00:50:04.190 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.191+0000 7f52337fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:04.191 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.192+0000 7f535e698800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27]): orig_sources= new_sources= 2024-09-12T00:50:04.191 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.192+0000 7f535e698800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27]): potential sources added=[] removed=[] 2024-09-12T00:50:04.191 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.192+0000 7f535e698800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27]): orig_dests= new_dests= 2024-09-12T00:50:04.191 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.192+0000 7f535e698800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27]): potential dests added=[] removed=[] 2024-09-12T00:50:04.192 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f535e698800 time 2024-09-12T00:50:04.193674+0000 2024-09-12T00:50:04.192 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:50:04.192 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:04.192 INFO:tasks.workunit.client.0.smithi073.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f5361b8c71a] 2024-09-12T00:50:04.192 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5361b8c8d8] 2024-09-12T00:50:04.192 INFO:tasks.workunit.client.0.smithi073.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b396e9a641] 2024-09-12T00:50:04.192 INFO:tasks.workunit.client.0.smithi073.stderr: 4: radosgw-admin(+0xd884de) [0x55b3973ad4de] 2024-09-12T00:50:04.192 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b396eaa31d] 2024-09-12T00:50:04.193 INFO:tasks.workunit.client.0.smithi073.stderr: 6: main() 2024-09-12T00:50:04.193 INFO:tasks.workunit.client.0.smithi073.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f5360829590] 2024-09-12T00:50:04.193 INFO:tasks.workunit.client.0.smithi073.stderr: 8: __libc_start_main() 2024-09-12T00:50:04.193 INFO:tasks.workunit.client.0.smithi073.stderr: 9: _start() 2024-09-12T00:50:04.193 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.193+0000 7f535e698800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f535e698800 time 2024-09-12T00:50:04.193674+0000 2024-09-12T00:50:04.193 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:50:04.193 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:04.193 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:04.193 INFO:tasks.workunit.client.0.smithi073.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f5361b8c71a] 2024-09-12T00:50:04.193 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5361b8c8d8] 2024-09-12T00:50:04.193 INFO:tasks.workunit.client.0.smithi073.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b396e9a641] 2024-09-12T00:50:04.193 INFO:tasks.workunit.client.0.smithi073.stderr: 4: radosgw-admin(+0xd884de) [0x55b3973ad4de] 2024-09-12T00:50:04.193 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b396eaa31d] 2024-09-12T00:50:04.194 INFO:tasks.workunit.client.0.smithi073.stderr: 6: main() 2024-09-12T00:50:04.194 INFO:tasks.workunit.client.0.smithi073.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f5360829590] 2024-09-12T00:50:04.194 INFO:tasks.workunit.client.0.smithi073.stderr: 8: __libc_start_main() 2024-09-12T00:50:04.194 INFO:tasks.workunit.client.0.smithi073.stderr: 9: _start() 2024-09-12T00:50:04.194 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:04.194 INFO:tasks.workunit.client.0.smithi073.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:50:04.194 INFO:tasks.workunit.client.0.smithi073.stderr: in thread 7f535e698800 thread_name:radosgw-admin 2024-09-12T00:50:04.211 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:04.211 INFO:tasks.workunit.client.0.smithi073.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f536083e6f0] 2024-09-12T00:50:04.211 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f536088b99c] 2024-09-12T00:50:04.211 INFO:tasks.workunit.client.0.smithi073.stderr: 3: raise() 2024-09-12T00:50:04.211 INFO:tasks.workunit.client.0.smithi073.stderr: 4: abort() 2024-09-12T00:50:04.211 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f5361b8c774] 2024-09-12T00:50:04.211 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5361b8c8d8] 2024-09-12T00:50:04.211 INFO:tasks.workunit.client.0.smithi073.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b396e9a641] 2024-09-12T00:50:04.211 INFO:tasks.workunit.client.0.smithi073.stderr: 8: radosgw-admin(+0xd884de) [0x55b3973ad4de] 2024-09-12T00:50:04.212 INFO:tasks.workunit.client.0.smithi073.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b396eaa31d] 2024-09-12T00:50:04.212 INFO:tasks.workunit.client.0.smithi073.stderr: 10: main() 2024-09-12T00:50:04.212 INFO:tasks.workunit.client.0.smithi073.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f5360829590] 2024-09-12T00:50:04.212 INFO:tasks.workunit.client.0.smithi073.stderr: 12: __libc_start_main() 2024-09-12T00:50:04.212 INFO:tasks.workunit.client.0.smithi073.stderr: 13: _start() 2024-09-12T00:50:04.212 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.194+0000 7f535e698800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:50:04.212 INFO:tasks.workunit.client.0.smithi073.stderr: in thread 7f535e698800 thread_name:radosgw-admin 2024-09-12T00:50:04.212 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:04.212 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:04.212 INFO:tasks.workunit.client.0.smithi073.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f536083e6f0] 2024-09-12T00:50:04.212 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f536088b99c] 2024-09-12T00:50:04.212 INFO:tasks.workunit.client.0.smithi073.stderr: 3: raise() 2024-09-12T00:50:04.212 INFO:tasks.workunit.client.0.smithi073.stderr: 4: abort() 2024-09-12T00:50:04.213 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f5361b8c774] 2024-09-12T00:50:04.213 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5361b8c8d8] 2024-09-12T00:50:04.213 INFO:tasks.workunit.client.0.smithi073.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b396e9a641] 2024-09-12T00:50:04.213 INFO:tasks.workunit.client.0.smithi073.stderr: 8: radosgw-admin(+0xd884de) [0x55b3973ad4de] 2024-09-12T00:50:04.213 INFO:tasks.workunit.client.0.smithi073.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b396eaa31d] 2024-09-12T00:50:04.213 INFO:tasks.workunit.client.0.smithi073.stderr: 10: main() 2024-09-12T00:50:04.213 INFO:tasks.workunit.client.0.smithi073.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f5360829590] 2024-09-12T00:50:04.213 INFO:tasks.workunit.client.0.smithi073.stderr: 12: __libc_start_main() 2024-09-12T00:50:04.213 INFO:tasks.workunit.client.0.smithi073.stderr: 13: _start() 2024-09-12T00:50:04.213 INFO:tasks.workunit.client.0.smithi073.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:50:04.213 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:04.213 INFO:tasks.workunit.client.0.smithi073.stderr:--- begin dump of recent events --- 2024-09-12T00:50:04.213 INFO:tasks.workunit.client.0.smithi073.stderr: -499> 2024-09-12T00:50:03.939+0000 7f535e698800 5 monclient: authenticate success, global_id 6521 2024-09-12T00:50:04.214 INFO:tasks.workunit.client.0.smithi073.stderr: -498> 2024-09-12T00:50:03.939+0000 7f535e698800 10 monclient: get_monmap_and_config success 2024-09-12T00:50:04.214 INFO:tasks.workunit.client.0.smithi073.stderr: -497> 2024-09-12T00:50:03.939+0000 7f535e698800 4 set_mon_vals no callback set 2024-09-12T00:50:04.214 INFO:tasks.workunit.client.0.smithi073.stderr: -496> 2024-09-12T00:50:03.940+0000 7f535e698800 10 monclient: shutdown 2024-09-12T00:50:04.214 INFO:tasks.workunit.client.0.smithi073.stderr: -495> 2024-09-12T00:50:03.940+0000 7f535e698800 5 asok(0x55b397f35630) unregister_commands rotate-key 2024-09-12T00:50:04.214 INFO:tasks.workunit.client.0.smithi073.stderr: -494> 2024-09-12T00:50:03.940+0000 7f535e698800 10 monclient: build_initial_monmap 2024-09-12T00:50:04.214 INFO:tasks.workunit.client.0.smithi073.stderr: -493> 2024-09-12T00:50:03.940+0000 7f535e698800 1 build_initial for_mkfs: 0 2024-09-12T00:50:04.214 INFO:tasks.workunit.client.0.smithi073.stderr: -492> 2024-09-12T00:50:03.940+0000 7f535e698800 10 monclient: monmap: 2024-09-12T00:50:04.214 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:50:04.214 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:04.214 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:50:04.214 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:50:04.214 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:04.214 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:50:04.215 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:50:04.215 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:50:04.215 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:50:04.215 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:04.215 INFO:tasks.workunit.client.0.smithi073.stderr: -491> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b39815da50) adding auth protocol: cephx 2024-09-12T00:50:04.215 INFO:tasks.workunit.client.0.smithi073.stderr: -490> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b39815da50) adding auth protocol: cephx 2024-09-12T00:50:04.215 INFO:tasks.workunit.client.0.smithi073.stderr: -489> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b39815da50) adding auth protocol: cephx 2024-09-12T00:50:04.215 INFO:tasks.workunit.client.0.smithi073.stderr: -488> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b39815da50) adding con mode: secure 2024-09-12T00:50:04.215 INFO:tasks.workunit.client.0.smithi073.stderr: -487> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b39815da50) adding con mode: crc 2024-09-12T00:50:04.215 INFO:tasks.workunit.client.0.smithi073.stderr: -486> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b39815da50) adding con mode: secure 2024-09-12T00:50:04.215 INFO:tasks.workunit.client.0.smithi073.stderr: -485> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b39815da50) adding con mode: crc 2024-09-12T00:50:04.215 INFO:tasks.workunit.client.0.smithi073.stderr: -484> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b39815da50) adding con mode: secure 2024-09-12T00:50:04.215 INFO:tasks.workunit.client.0.smithi073.stderr: -483> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b39815da50) adding con mode: crc 2024-09-12T00:50:04.215 INFO:tasks.workunit.client.0.smithi073.stderr: -482> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b39815da50) adding con mode: crc 2024-09-12T00:50:04.216 INFO:tasks.workunit.client.0.smithi073.stderr: -481> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b39815da50) adding con mode: secure 2024-09-12T00:50:04.216 INFO:tasks.workunit.client.0.smithi073.stderr: -480> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b39815da50) adding con mode: crc 2024-09-12T00:50:04.216 INFO:tasks.workunit.client.0.smithi073.stderr: -479> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b39815da50) adding con mode: secure 2024-09-12T00:50:04.216 INFO:tasks.workunit.client.0.smithi073.stderr: -478> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b39815da50) adding con mode: crc 2024-09-12T00:50:04.216 INFO:tasks.workunit.client.0.smithi073.stderr: -477> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b39815da50) adding con mode: secure 2024-09-12T00:50:04.216 INFO:tasks.workunit.client.0.smithi073.stderr: -476> 2024-09-12T00:50:03.940+0000 7f535e698800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:04.216 INFO:tasks.workunit.client.0.smithi073.stderr: -475> 2024-09-12T00:50:03.940+0000 7f535e698800 1 librados: starting msgr at 2024-09-12T00:50:04.216 INFO:tasks.workunit.client.0.smithi073.stderr: -474> 2024-09-12T00:50:03.940+0000 7f535e698800 1 librados: starting objecter 2024-09-12T00:50:04.216 INFO:tasks.workunit.client.0.smithi073.stderr: -473> 2024-09-12T00:50:03.940+0000 7f535e698800 5 asok(0x55b397f35630) register_command objecter_requests hook 0x55b398189320 2024-09-12T00:50:04.216 INFO:tasks.workunit.client.0.smithi073.stderr: -472> 2024-09-12T00:50:03.940+0000 7f535e698800 1 librados: setting wanted keys 2024-09-12T00:50:04.216 INFO:tasks.workunit.client.0.smithi073.stderr: -471> 2024-09-12T00:50:03.940+0000 7f535e698800 1 librados: calling monclient init 2024-09-12T00:50:04.216 INFO:tasks.workunit.client.0.smithi073.stderr: -470> 2024-09-12T00:50:03.940+0000 7f535e698800 10 monclient: init 2024-09-12T00:50:04.216 INFO:tasks.workunit.client.0.smithi073.stderr: -469> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b398157e20) adding auth protocol: cephx 2024-09-12T00:50:04.216 INFO:tasks.workunit.client.0.smithi073.stderr: -468> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b398157e20) adding auth protocol: cephx 2024-09-12T00:50:04.217 INFO:tasks.workunit.client.0.smithi073.stderr: -467> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b398157e20) adding auth protocol: cephx 2024-09-12T00:50:04.217 INFO:tasks.workunit.client.0.smithi073.stderr: -466> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b398157e20) adding con mode: secure 2024-09-12T00:50:04.217 INFO:tasks.workunit.client.0.smithi073.stderr: -465> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b398157e20) adding con mode: crc 2024-09-12T00:50:04.217 INFO:tasks.workunit.client.0.smithi073.stderr: -464> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b398157e20) adding con mode: secure 2024-09-12T00:50:04.217 INFO:tasks.workunit.client.0.smithi073.stderr: -463> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b398157e20) adding con mode: crc 2024-09-12T00:50:04.217 INFO:tasks.workunit.client.0.smithi073.stderr: -462> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b398157e20) adding con mode: secure 2024-09-12T00:50:04.217 INFO:tasks.workunit.client.0.smithi073.stderr: -461> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b398157e20) adding con mode: crc 2024-09-12T00:50:04.217 INFO:tasks.workunit.client.0.smithi073.stderr: -460> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b398157e20) adding con mode: crc 2024-09-12T00:50:04.217 INFO:tasks.workunit.client.0.smithi073.stderr: -459> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b398157e20) adding con mode: secure 2024-09-12T00:50:04.217 INFO:tasks.workunit.client.0.smithi073.stderr: -458> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b398157e20) adding con mode: crc 2024-09-12T00:50:04.217 INFO:tasks.workunit.client.0.smithi073.stderr: -457> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b398157e20) adding con mode: secure 2024-09-12T00:50:04.217 INFO:tasks.workunit.client.0.smithi073.stderr: -456> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b398157e20) adding con mode: crc 2024-09-12T00:50:04.217 INFO:tasks.workunit.client.0.smithi073.stderr: -455> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b398157e20) adding con mode: secure 2024-09-12T00:50:04.218 INFO:tasks.workunit.client.0.smithi073.stderr: -454> 2024-09-12T00:50:03.940+0000 7f535e698800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:04.218 INFO:tasks.workunit.client.0.smithi073.stderr: -453> 2024-09-12T00:50:03.941+0000 7f535e698800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:04.218 INFO:tasks.workunit.client.0.smithi073.stderr: -452> 2024-09-12T00:50:03.941+0000 7f535e698800 5 asok(0x55b397f35630) register_command rotate-key hook 0x55b398157f68 2024-09-12T00:50:04.218 INFO:tasks.workunit.client.0.smithi073.stderr: -451> 2024-09-12T00:50:03.941+0000 7f535e698800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:04.218 INFO:tasks.workunit.client.0.smithi073.stderr: -450> 2024-09-12T00:50:03.941+0000 7f535e698800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:50:04.218 INFO:tasks.workunit.client.0.smithi073.stderr: -449> 2024-09-12T00:50:03.941+0000 7f535e698800 10 monclient(hunting): picked mon.noname-b con 0x55b398001100 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:50:04.218 INFO:tasks.workunit.client.0.smithi073.stderr: -448> 2024-09-12T00:50:03.941+0000 7f535e698800 10 monclient(hunting): picked mon.noname-a con 0x55b39800dda0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:50:04.218 INFO:tasks.workunit.client.0.smithi073.stderr: -447> 2024-09-12T00:50:03.941+0000 7f535e698800 10 monclient(hunting): picked mon.noname-c con 0x55b39809b030 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:50:04.218 INFO:tasks.workunit.client.0.smithi073.stderr: -446> 2024-09-12T00:50:03.941+0000 7f535e698800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:04.218 INFO:tasks.workunit.client.0.smithi073.stderr: -445> 2024-09-12T00:50:03.941+0000 7f535e698800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:04.218 INFO:tasks.workunit.client.0.smithi073.stderr: -444> 2024-09-12T00:50:03.941+0000 7f535e698800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:04.218 INFO:tasks.workunit.client.0.smithi073.stderr: -443> 2024-09-12T00:50:03.941+0000 7f535e698800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:04.218 INFO:tasks.workunit.client.0.smithi073.stderr: -442> 2024-09-12T00:50:03.941+0000 7f535e698800 10 monclient(hunting): authenticate will time out at 2064.611284s 2024-09-12T00:50:04.218 INFO:tasks.workunit.client.0.smithi073.stderr: -441> 2024-09-12T00:50:03.941+0000 7f5353981640 10 monclient(hunting): get_auth_request con 0x55b39800dda0 auth_method 0 2024-09-12T00:50:04.219 INFO:tasks.workunit.client.0.smithi073.stderr: -440> 2024-09-12T00:50:03.941+0000 7f5353981640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:04.219 INFO:tasks.workunit.client.0.smithi073.stderr: -439> 2024-09-12T00:50:03.941+0000 7f5353981640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:04.219 INFO:tasks.workunit.client.0.smithi073.stderr: -438> 2024-09-12T00:50:03.941+0000 7f5353981640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:04.219 INFO:tasks.workunit.client.0.smithi073.stderr: -437> 2024-09-12T00:50:03.941+0000 7f535c983640 10 monclient(hunting): get_auth_request con 0x55b39809b030 auth_method 0 2024-09-12T00:50:04.219 INFO:tasks.workunit.client.0.smithi073.stderr: -436> 2024-09-12T00:50:03.941+0000 7f535c983640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:04.219 INFO:tasks.workunit.client.0.smithi073.stderr: -435> 2024-09-12T00:50:03.941+0000 7f535c983640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:04.219 INFO:tasks.workunit.client.0.smithi073.stderr: -434> 2024-09-12T00:50:03.941+0000 7f535c983640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:04.219 INFO:tasks.workunit.client.0.smithi073.stderr: -433> 2024-09-12T00:50:03.941+0000 7f5353981640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:04.219 INFO:tasks.workunit.client.0.smithi073.stderr: -432> 2024-09-12T00:50:03.941+0000 7f5353981640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:04.219 INFO:tasks.workunit.client.0.smithi073.stderr: -431> 2024-09-12T00:50:03.941+0000 7f5353981640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:04.219 INFO:tasks.workunit.client.0.smithi073.stderr: -430> 2024-09-12T00:50:03.941+0000 7f535c182640 10 monclient(hunting): get_auth_request con 0x55b398001100 auth_method 0 2024-09-12T00:50:04.219 INFO:tasks.workunit.client.0.smithi073.stderr: -429> 2024-09-12T00:50:03.941+0000 7f535c182640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:04.219 INFO:tasks.workunit.client.0.smithi073.stderr: -428> 2024-09-12T00:50:03.941+0000 7f535c182640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:04.219 INFO:tasks.workunit.client.0.smithi073.stderr: -427> 2024-09-12T00:50:03.941+0000 7f535c182640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:04.220 INFO:tasks.workunit.client.0.smithi073.stderr: -426> 2024-09-12T00:50:03.941+0000 7f535c983640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:04.220 INFO:tasks.workunit.client.0.smithi073.stderr: -425> 2024-09-12T00:50:03.941+0000 7f535c983640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:04.220 INFO:tasks.workunit.client.0.smithi073.stderr: -424> 2024-09-12T00:50:03.941+0000 7f535c983640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:04.220 INFO:tasks.workunit.client.0.smithi073.stderr: -423> 2024-09-12T00:50:03.941+0000 7f535c182640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:04.220 INFO:tasks.workunit.client.0.smithi073.stderr: -422> 2024-09-12T00:50:03.941+0000 7f535c182640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:04.220 INFO:tasks.workunit.client.0.smithi073.stderr: -421> 2024-09-12T00:50:03.941+0000 7f535c182640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:04.220 INFO:tasks.workunit.client.0.smithi073.stderr: -420> 2024-09-12T00:50:03.941+0000 7f5353981640 10 monclient(hunting): handle_auth_done global_id 6888 payload 824 2024-09-12T00:50:04.220 INFO:tasks.workunit.client.0.smithi073.stderr: -419> 2024-09-12T00:50:03.941+0000 7f5353981640 10 monclient: _finish_hunting 0 2024-09-12T00:50:04.220 INFO:tasks.workunit.client.0.smithi073.stderr: -418> 2024-09-12T00:50:03.941+0000 7f5353981640 1 monclient: found mon.noname-a 2024-09-12T00:50:04.220 INFO:tasks.workunit.client.0.smithi073.stderr: -417> 2024-09-12T00:50:03.941+0000 7f5353981640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:50:04.220 INFO:tasks.workunit.client.0.smithi073.stderr: -416> 2024-09-12T00:50:03.941+0000 7f5248e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:04.220 INFO:tasks.workunit.client.0.smithi073.stderr: -415> 2024-09-12T00:50:03.941+0000 7f5248e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:50:04.220 INFO:tasks.workunit.client.0.smithi073.stderr: -414> 2024-09-12T00:50:03.941+0000 7f5248e09640 10 monclient: dump: 2024-09-12T00:50:04.220 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:50:04.221 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:50:04.221 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:04.221 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:04.221 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:04.221 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:50:04.221 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:50:04.221 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:50:04.221 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:50:04.221 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:04.221 INFO:tasks.workunit.client.0.smithi073.stderr: -413> 2024-09-12T00:50:03.941+0000 7f5248e09640 10 monclient: _finish_auth 0 2024-09-12T00:50:04.221 INFO:tasks.workunit.client.0.smithi073.stderr: -412> 2024-09-12T00:50:03.941+0000 7f5248e09640 10 monclient: _check_auth_tickets 2024-09-12T00:50:04.221 INFO:tasks.workunit.client.0.smithi073.stderr: -411> 2024-09-12T00:50:03.941+0000 7f535e698800 5 monclient: authenticate success, global_id 6888 2024-09-12T00:50:04.221 INFO:tasks.workunit.client.0.smithi073.stderr: -410> 2024-09-12T00:50:03.941+0000 7f535e698800 10 monclient: _renew_subs 2024-09-12T00:50:04.221 INFO:tasks.workunit.client.0.smithi073.stderr: -409> 2024-09-12T00:50:03.941+0000 7f535e698800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:50:04.222 INFO:tasks.workunit.client.0.smithi073.stderr: -408> 2024-09-12T00:50:03.941+0000 7f5248e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:04.222 INFO:tasks.workunit.client.0.smithi073.stderr: -407> 2024-09-12T00:50:03.941+0000 7f5248e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:04.222 INFO:tasks.workunit.client.0.smithi073.stderr: -406> 2024-09-12T00:50:03.941+0000 7f5248e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:50:04.222 INFO:tasks.workunit.client.0.smithi073.stderr: -405> 2024-09-12T00:50:03.941+0000 7f5248e09640 10 monclient: dump: 2024-09-12T00:50:04.222 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:50:04.222 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:50:04.222 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:04.222 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:04.222 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:04.222 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:50:04.222 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:50:04.222 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:50:04.222 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:50:04.223 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:04.223 INFO:tasks.workunit.client.0.smithi073.stderr: -404> 2024-09-12T00:50:03.941+0000 7f524a60c640 4 set_mon_vals no callback set 2024-09-12T00:50:04.223 INFO:tasks.workunit.client.0.smithi073.stderr: -403> 2024-09-12T00:50:03.942+0000 7f535e698800 10 monclient: _renew_subs 2024-09-12T00:50:04.223 INFO:tasks.workunit.client.0.smithi073.stderr: -402> 2024-09-12T00:50:03.942+0000 7f535e698800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:50:04.223 INFO:tasks.workunit.client.0.smithi073.stderr: -401> 2024-09-12T00:50:03.942+0000 7f535e698800 1 librados: init done 2024-09-12T00:50:04.223 INFO:tasks.workunit.client.0.smithi073.stderr: -400> 2024-09-12T00:50:03.943+0000 7f5248e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:50:04.223 INFO:tasks.workunit.client.0.smithi073.stderr: -399> 2024-09-12T00:50:03.943+0000 7f5248e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:50:04.223 INFO:tasks.workunit.client.0.smithi073.stderr: -398> 2024-09-12T00:50:03.943+0000 7f5248e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:50:04.223 INFO:tasks.workunit.client.0.smithi073.stderr: -397> 2024-09-12T00:50:03.944+0000 7f535c182640 10 monclient: get_auth_request con 0x7f52440764a0 auth_method 0 2024-09-12T00:50:04.223 INFO:tasks.workunit.client.0.smithi073.stderr: -396> 2024-09-12T00:50:03.944+0000 7f535c983640 10 monclient: get_auth_request con 0x55b3981a06e0 auth_method 0 2024-09-12T00:50:04.223 INFO:tasks.workunit.client.0.smithi073.stderr: -395> 2024-09-12T00:50:03.945+0000 7f535c182640 10 monclient: get_auth_request con 0x55b3981a38c0 auth_method 0 2024-09-12T00:50:04.223 INFO:tasks.workunit.client.0.smithi073.stderr: -394> 2024-09-12T00:50:03.946+0000 7f5353981640 10 monclient: get_auth_request con 0x55b3981a7ab0 auth_method 0 2024-09-12T00:50:04.223 INFO:tasks.workunit.client.0.smithi073.stderr: -393> 2024-09-12T00:50:03.947+0000 7f535e698800 10 monclient: build_initial_monmap 2024-09-12T00:50:04.223 INFO:tasks.workunit.client.0.smithi073.stderr: -392> 2024-09-12T00:50:03.947+0000 7f535e698800 1 build_initial for_mkfs: 0 2024-09-12T00:50:04.224 INFO:tasks.workunit.client.0.smithi073.stderr: -391> 2024-09-12T00:50:03.947+0000 7f535e698800 10 monclient: monmap: 2024-09-12T00:50:04.224 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:50:04.224 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:04.224 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:50:04.224 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:50:04.224 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:04.224 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:50:04.224 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:50:04.224 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:50:04.224 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:50:04.224 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:04.224 INFO:tasks.workunit.client.0.smithi073.stderr: -390> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981ac8e0) adding auth protocol: cephx 2024-09-12T00:50:04.224 INFO:tasks.workunit.client.0.smithi073.stderr: -389> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981ac8e0) adding auth protocol: cephx 2024-09-12T00:50:04.225 INFO:tasks.workunit.client.0.smithi073.stderr: -388> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981ac8e0) adding auth protocol: cephx 2024-09-12T00:50:04.225 INFO:tasks.workunit.client.0.smithi073.stderr: -387> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981ac8e0) adding con mode: secure 2024-09-12T00:50:04.225 INFO:tasks.workunit.client.0.smithi073.stderr: -386> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981ac8e0) adding con mode: crc 2024-09-12T00:50:04.225 INFO:tasks.workunit.client.0.smithi073.stderr: -385> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981ac8e0) adding con mode: secure 2024-09-12T00:50:04.225 INFO:tasks.workunit.client.0.smithi073.stderr: -384> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981ac8e0) adding con mode: crc 2024-09-12T00:50:04.225 INFO:tasks.workunit.client.0.smithi073.stderr: -383> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981ac8e0) adding con mode: secure 2024-09-12T00:50:04.225 INFO:tasks.workunit.client.0.smithi073.stderr: -382> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981ac8e0) adding con mode: crc 2024-09-12T00:50:04.225 INFO:tasks.workunit.client.0.smithi073.stderr: -381> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981ac8e0) adding con mode: crc 2024-09-12T00:50:04.225 INFO:tasks.workunit.client.0.smithi073.stderr: -380> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981ac8e0) adding con mode: secure 2024-09-12T00:50:04.225 INFO:tasks.workunit.client.0.smithi073.stderr: -379> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981ac8e0) adding con mode: crc 2024-09-12T00:50:04.225 INFO:tasks.workunit.client.0.smithi073.stderr: -378> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981ac8e0) adding con mode: secure 2024-09-12T00:50:04.225 INFO:tasks.workunit.client.0.smithi073.stderr: -377> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981ac8e0) adding con mode: crc 2024-09-12T00:50:04.226 INFO:tasks.workunit.client.0.smithi073.stderr: -376> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981ac8e0) adding con mode: secure 2024-09-12T00:50:04.226 INFO:tasks.workunit.client.0.smithi073.stderr: -375> 2024-09-12T00:50:03.947+0000 7f535e698800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:04.226 INFO:tasks.workunit.client.0.smithi073.stderr: -374> 2024-09-12T00:50:03.947+0000 7f535e698800 5 asok(0x55b397f35630) register_command objecter_requests cmddesc objecter_requests hook 0x55b3981b0370 EEXIST 2024-09-12T00:50:04.226 INFO:tasks.workunit.client.0.smithi073.stderr: -373> 2024-09-12T00:50:03.947+0000 7f535e698800 10 monclient: init 2024-09-12T00:50:04.226 INFO:tasks.workunit.client.0.smithi073.stderr: -372> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981aafb8) adding auth protocol: cephx 2024-09-12T00:50:04.226 INFO:tasks.workunit.client.0.smithi073.stderr: -371> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981aafb8) adding auth protocol: cephx 2024-09-12T00:50:04.226 INFO:tasks.workunit.client.0.smithi073.stderr: -370> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981aafb8) adding auth protocol: cephx 2024-09-12T00:50:04.226 INFO:tasks.workunit.client.0.smithi073.stderr: -369> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981aafb8) adding con mode: secure 2024-09-12T00:50:04.226 INFO:tasks.workunit.client.0.smithi073.stderr: -368> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981aafb8) adding con mode: crc 2024-09-12T00:50:04.226 INFO:tasks.workunit.client.0.smithi073.stderr: -367> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981aafb8) adding con mode: secure 2024-09-12T00:50:04.226 INFO:tasks.workunit.client.0.smithi073.stderr: -366> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981aafb8) adding con mode: crc 2024-09-12T00:50:04.226 INFO:tasks.workunit.client.0.smithi073.stderr: -365> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981aafb8) adding con mode: secure 2024-09-12T00:50:04.226 INFO:tasks.workunit.client.0.smithi073.stderr: -364> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981aafb8) adding con mode: crc 2024-09-12T00:50:04.226 INFO:tasks.workunit.client.0.smithi073.stderr: -363> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981aafb8) adding con mode: crc 2024-09-12T00:50:04.227 INFO:tasks.workunit.client.0.smithi073.stderr: -362> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981aafb8) adding con mode: secure 2024-09-12T00:50:04.227 INFO:tasks.workunit.client.0.smithi073.stderr: -361> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981aafb8) adding con mode: crc 2024-09-12T00:50:04.227 INFO:tasks.workunit.client.0.smithi073.stderr: -360> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981aafb8) adding con mode: secure 2024-09-12T00:50:04.227 INFO:tasks.workunit.client.0.smithi073.stderr: -359> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981aafb8) adding con mode: crc 2024-09-12T00:50:04.227 INFO:tasks.workunit.client.0.smithi073.stderr: -358> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981aafb8) adding con mode: secure 2024-09-12T00:50:04.227 INFO:tasks.workunit.client.0.smithi073.stderr: -357> 2024-09-12T00:50:03.948+0000 7f535e698800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:04.227 INFO:tasks.workunit.client.0.smithi073.stderr: -356> 2024-09-12T00:50:03.948+0000 7f535e698800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:04.227 INFO:tasks.workunit.client.0.smithi073.stderr: -355> 2024-09-12T00:50:03.948+0000 7f535e698800 5 asok(0x55b397f35630) register_command rotate-key cmddesc rotate-key hook 0x55b3981ab100 EEXIST 2024-09-12T00:50:04.227 INFO:tasks.workunit.client.0.smithi073.stderr: -354> 2024-09-12T00:50:03.948+0000 7f535e698800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:04.227 INFO:tasks.workunit.client.0.smithi073.stderr: -353> 2024-09-12T00:50:03.948+0000 7f535e698800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:50:04.227 INFO:tasks.workunit.client.0.smithi073.stderr: -352> 2024-09-12T00:50:03.948+0000 7f535e698800 10 monclient(hunting): picked mon.noname-b con 0x55b3981d4060 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:50:04.227 INFO:tasks.workunit.client.0.smithi073.stderr: -351> 2024-09-12T00:50:03.948+0000 7f535e698800 10 monclient(hunting): picked mon.noname-c con 0x55b3981d6330 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:50:04.227 INFO:tasks.workunit.client.0.smithi073.stderr: -350> 2024-09-12T00:50:03.948+0000 7f535e698800 10 monclient(hunting): picked mon.noname-a con 0x55b3981d2830 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:50:04.227 INFO:tasks.workunit.client.0.smithi073.stderr: -349> 2024-09-12T00:50:03.948+0000 7f535e698800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:04.228 INFO:tasks.workunit.client.0.smithi073.stderr: -348> 2024-09-12T00:50:03.948+0000 7f535e698800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:04.228 INFO:tasks.workunit.client.0.smithi073.stderr: -347> 2024-09-12T00:50:03.948+0000 7f535e698800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:04.228 INFO:tasks.workunit.client.0.smithi073.stderr: -346> 2024-09-12T00:50:03.948+0000 7f535e698800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:04.228 INFO:tasks.workunit.client.0.smithi073.stderr: -345> 2024-09-12T00:50:03.948+0000 7f535e698800 10 monclient(hunting): authenticate will time out at 2064.618329s 2024-09-12T00:50:04.228 INFO:tasks.workunit.client.0.smithi073.stderr: -344> 2024-09-12T00:50:03.948+0000 7f5353981640 10 monclient(hunting): get_auth_request con 0x55b3981d6330 auth_method 0 2024-09-12T00:50:04.228 INFO:tasks.workunit.client.0.smithi073.stderr: -343> 2024-09-12T00:50:03.948+0000 7f5353981640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:04.228 INFO:tasks.workunit.client.0.smithi073.stderr: -342> 2024-09-12T00:50:03.948+0000 7f5353981640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:04.228 INFO:tasks.workunit.client.0.smithi073.stderr: -341> 2024-09-12T00:50:03.948+0000 7f5353981640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:04.228 INFO:tasks.workunit.client.0.smithi073.stderr: -340> 2024-09-12T00:50:03.948+0000 7f535c983640 10 monclient(hunting): get_auth_request con 0x55b3981d2830 auth_method 0 2024-09-12T00:50:04.228 INFO:tasks.workunit.client.0.smithi073.stderr: -339> 2024-09-12T00:50:03.948+0000 7f535c983640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:04.228 INFO:tasks.workunit.client.0.smithi073.stderr: -338> 2024-09-12T00:50:03.948+0000 7f535c983640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:04.228 INFO:tasks.workunit.client.0.smithi073.stderr: -337> 2024-09-12T00:50:03.948+0000 7f535c983640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:04.228 INFO:tasks.workunit.client.0.smithi073.stderr: -336> 2024-09-12T00:50:03.948+0000 7f5353981640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:04.229 INFO:tasks.workunit.client.0.smithi073.stderr: -335> 2024-09-12T00:50:03.948+0000 7f5353981640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:04.229 INFO:tasks.workunit.client.0.smithi073.stderr: -334> 2024-09-12T00:50:03.948+0000 7f5353981640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:04.229 INFO:tasks.workunit.client.0.smithi073.stderr: -333> 2024-09-12T00:50:03.948+0000 7f535c983640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:04.229 INFO:tasks.workunit.client.0.smithi073.stderr: -332> 2024-09-12T00:50:03.948+0000 7f535c983640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:04.229 INFO:tasks.workunit.client.0.smithi073.stderr: -331> 2024-09-12T00:50:03.948+0000 7f535c983640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:04.229 INFO:tasks.workunit.client.0.smithi073.stderr: -330> 2024-09-12T00:50:03.948+0000 7f535c182640 10 monclient(hunting): get_auth_request con 0x55b3981d4060 auth_method 0 2024-09-12T00:50:04.229 INFO:tasks.workunit.client.0.smithi073.stderr: -329> 2024-09-12T00:50:03.948+0000 7f535c182640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:04.229 INFO:tasks.workunit.client.0.smithi073.stderr: -328> 2024-09-12T00:50:03.948+0000 7f535c182640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:04.229 INFO:tasks.workunit.client.0.smithi073.stderr: -327> 2024-09-12T00:50:03.948+0000 7f535c182640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:04.229 INFO:tasks.workunit.client.0.smithi073.stderr: -326> 2024-09-12T00:50:03.948+0000 7f5353981640 10 monclient(hunting): handle_auth_done global_id 6527 payload 824 2024-09-12T00:50:04.229 INFO:tasks.workunit.client.0.smithi073.stderr: -325> 2024-09-12T00:50:03.948+0000 7f5353981640 10 monclient: _finish_hunting 0 2024-09-12T00:50:04.229 INFO:tasks.workunit.client.0.smithi073.stderr: -324> 2024-09-12T00:50:03.948+0000 7f5353981640 1 monclient: found mon.noname-c 2024-09-12T00:50:04.229 INFO:tasks.workunit.client.0.smithi073.stderr: -323> 2024-09-12T00:50:03.948+0000 7f5353981640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.73:3301/0 2024-09-12T00:50:04.230 INFO:tasks.workunit.client.0.smithi073.stderr: -322> 2024-09-12T00:50:03.948+0000 7f5241ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:04.230 INFO:tasks.workunit.client.0.smithi073.stderr: -321> 2024-09-12T00:50:03.948+0000 7f5241ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:50:04.230 INFO:tasks.workunit.client.0.smithi073.stderr: -320> 2024-09-12T00:50:03.948+0000 7f5241ffb640 10 monclient: dump: 2024-09-12T00:50:04.230 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:50:04.230 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:50:04.230 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:04.230 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:04.230 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:04.230 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:50:04.230 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:50:04.230 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:50:04.230 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:50:04.230 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:04.230 INFO:tasks.workunit.client.0.smithi073.stderr: -319> 2024-09-12T00:50:03.948+0000 7f5241ffb640 10 monclient: _finish_auth 0 2024-09-12T00:50:04.230 INFO:tasks.workunit.client.0.smithi073.stderr: -318> 2024-09-12T00:50:03.948+0000 7f5241ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:50:04.231 INFO:tasks.workunit.client.0.smithi073.stderr: -317> 2024-09-12T00:50:03.948+0000 7f5241ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:04.231 INFO:tasks.workunit.client.0.smithi073.stderr: -316> 2024-09-12T00:50:03.948+0000 7f5241ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:04.231 INFO:tasks.workunit.client.0.smithi073.stderr: -315> 2024-09-12T00:50:03.948+0000 7f5241ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:50:04.231 INFO:tasks.workunit.client.0.smithi073.stderr: -314> 2024-09-12T00:50:03.948+0000 7f5241ffb640 10 monclient: dump: 2024-09-12T00:50:04.231 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:50:04.231 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:50:04.231 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:04.231 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:04.231 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:04.231 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:50:04.231 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:50:04.231 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:50:04.231 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:50:04.232 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:04.232 INFO:tasks.workunit.client.0.smithi073.stderr: -313> 2024-09-12T00:50:03.948+0000 7f535e698800 5 monclient: authenticate success, global_id 6527 2024-09-12T00:50:04.232 INFO:tasks.workunit.client.0.smithi073.stderr: -312> 2024-09-12T00:50:03.948+0000 7f535d184640 4 set_mon_vals no callback set 2024-09-12T00:50:04.232 INFO:tasks.workunit.client.0.smithi073.stderr: -311> 2024-09-12T00:50:03.948+0000 7f535e698800 10 monclient: _renew_subs 2024-09-12T00:50:04.232 INFO:tasks.workunit.client.0.smithi073.stderr: -310> 2024-09-12T00:50:03.948+0000 7f535e698800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:50:04.232 INFO:tasks.workunit.client.0.smithi073.stderr: -309> 2024-09-12T00:50:03.949+0000 7f535e698800 10 monclient: _renew_subs 2024-09-12T00:50:04.232 INFO:tasks.workunit.client.0.smithi073.stderr: -308> 2024-09-12T00:50:03.949+0000 7f535e698800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:50:04.232 INFO:tasks.workunit.client.0.smithi073.stderr: -307> 2024-09-12T00:50:03.950+0000 7f5241ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:50:04.232 INFO:tasks.workunit.client.0.smithi073.stderr: -306> 2024-09-12T00:50:03.950+0000 7f5241ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:50:04.232 INFO:tasks.workunit.client.0.smithi073.stderr: -305> 2024-09-12T00:50:03.950+0000 7f5241ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:50:04.232 INFO:tasks.workunit.client.0.smithi073.stderr: -304> 2024-09-12T00:50:03.950+0000 7f535c182640 10 monclient: get_auth_request con 0x7f5234076380 auth_method 0 2024-09-12T00:50:04.232 INFO:tasks.workunit.client.0.smithi073.stderr: -303> 2024-09-12T00:50:03.951+0000 7f535e698800 10 monclient: get_monmap_and_config 2024-09-12T00:50:04.232 INFO:tasks.workunit.client.0.smithi073.stderr: -302> 2024-09-12T00:50:03.951+0000 7f535e698800 10 monclient: build_initial_monmap 2024-09-12T00:50:04.232 INFO:tasks.workunit.client.0.smithi073.stderr: -301> 2024-09-12T00:50:03.951+0000 7f535e698800 1 build_initial for_mkfs: 0 2024-09-12T00:50:04.233 INFO:tasks.workunit.client.0.smithi073.stderr: -300> 2024-09-12T00:50:03.951+0000 7f535e698800 10 monclient: monmap: 2024-09-12T00:50:04.233 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:50:04.233 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:04.233 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:50:04.233 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:50:04.233 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:04.233 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:50:04.233 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:50:04.233 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:50:04.233 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:50:04.233 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:04.233 INFO:tasks.workunit.client.0.smithi073.stderr: -299> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x55b3981f3850) adding auth protocol: cephx 2024-09-12T00:50:04.233 INFO:tasks.workunit.client.0.smithi073.stderr: -298> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x55b3981f3850) adding auth protocol: cephx 2024-09-12T00:50:04.234 INFO:tasks.workunit.client.0.smithi073.stderr: -297> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x55b3981f3850) adding auth protocol: cephx 2024-09-12T00:50:04.234 INFO:tasks.workunit.client.0.smithi073.stderr: -296> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x55b3981f3850) adding con mode: secure 2024-09-12T00:50:04.234 INFO:tasks.workunit.client.0.smithi073.stderr: -295> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x55b3981f3850) adding con mode: crc 2024-09-12T00:50:04.234 INFO:tasks.workunit.client.0.smithi073.stderr: -294> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x55b3981f3850) adding con mode: secure 2024-09-12T00:50:04.234 INFO:tasks.workunit.client.0.smithi073.stderr: -293> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x55b3981f3850) adding con mode: crc 2024-09-12T00:50:04.234 INFO:tasks.workunit.client.0.smithi073.stderr: -292> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x55b3981f3850) adding con mode: secure 2024-09-12T00:50:04.234 INFO:tasks.workunit.client.0.smithi073.stderr: -291> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x55b3981f3850) adding con mode: crc 2024-09-12T00:50:04.234 INFO:tasks.workunit.client.0.smithi073.stderr: -290> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x55b3981f3850) adding con mode: crc 2024-09-12T00:50:04.234 INFO:tasks.workunit.client.0.smithi073.stderr: -289> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x55b3981f3850) adding con mode: secure 2024-09-12T00:50:04.234 INFO:tasks.workunit.client.0.smithi073.stderr: -288> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x55b3981f3850) adding con mode: crc 2024-09-12T00:50:04.234 INFO:tasks.workunit.client.0.smithi073.stderr: -287> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x55b3981f3850) adding con mode: secure 2024-09-12T00:50:04.234 INFO:tasks.workunit.client.0.smithi073.stderr: -286> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x55b3981f3850) adding con mode: crc 2024-09-12T00:50:04.234 INFO:tasks.workunit.client.0.smithi073.stderr: -285> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x55b3981f3850) adding con mode: secure 2024-09-12T00:50:04.234 INFO:tasks.workunit.client.0.smithi073.stderr: -284> 2024-09-12T00:50:03.951+0000 7f535e698800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:04.235 INFO:tasks.workunit.client.0.smithi073.stderr: -283> 2024-09-12T00:50:03.951+0000 7f535e698800 10 monclient: init 2024-09-12T00:50:04.235 INFO:tasks.workunit.client.0.smithi073.stderr: -282> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a68c0) adding auth protocol: cephx 2024-09-12T00:50:04.235 INFO:tasks.workunit.client.0.smithi073.stderr: -281> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a68c0) adding auth protocol: cephx 2024-09-12T00:50:04.235 INFO:tasks.workunit.client.0.smithi073.stderr: -280> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a68c0) adding auth protocol: cephx 2024-09-12T00:50:04.235 INFO:tasks.workunit.client.0.smithi073.stderr: -279> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a68c0) adding con mode: secure 2024-09-12T00:50:04.235 INFO:tasks.workunit.client.0.smithi073.stderr: -278> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a68c0) adding con mode: crc 2024-09-12T00:50:04.235 INFO:tasks.workunit.client.0.smithi073.stderr: -277> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a68c0) adding con mode: secure 2024-09-12T00:50:04.235 INFO:tasks.workunit.client.0.smithi073.stderr: -276> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a68c0) adding con mode: crc 2024-09-12T00:50:04.235 INFO:tasks.workunit.client.0.smithi073.stderr: -275> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a68c0) adding con mode: secure 2024-09-12T00:50:04.235 INFO:tasks.workunit.client.0.smithi073.stderr: -274> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a68c0) adding con mode: crc 2024-09-12T00:50:04.235 INFO:tasks.workunit.client.0.smithi073.stderr: -273> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a68c0) adding con mode: crc 2024-09-12T00:50:04.235 INFO:tasks.workunit.client.0.smithi073.stderr: -272> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a68c0) adding con mode: secure 2024-09-12T00:50:04.235 INFO:tasks.workunit.client.0.smithi073.stderr: -271> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a68c0) adding con mode: crc 2024-09-12T00:50:04.235 INFO:tasks.workunit.client.0.smithi073.stderr: -270> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a68c0) adding con mode: secure 2024-09-12T00:50:04.235 INFO:tasks.workunit.client.0.smithi073.stderr: -269> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a68c0) adding con mode: crc 2024-09-12T00:50:04.236 INFO:tasks.workunit.client.0.smithi073.stderr: -268> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a68c0) adding con mode: secure 2024-09-12T00:50:04.236 INFO:tasks.workunit.client.0.smithi073.stderr: -267> 2024-09-12T00:50:03.951+0000 7f535e698800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:04.236 INFO:tasks.workunit.client.0.smithi073.stderr: -266> 2024-09-12T00:50:03.951+0000 7f535e698800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:04.236 INFO:tasks.workunit.client.0.smithi073.stderr: -265> 2024-09-12T00:50:03.951+0000 7f535e698800 5 asok(0x55b397f35630) register_command rotate-key cmddesc rotate-key hook 0x7ffd7b1a6a08 EEXIST 2024-09-12T00:50:04.236 INFO:tasks.workunit.client.0.smithi073.stderr: -264> 2024-09-12T00:50:03.951+0000 7f535e698800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:04.236 INFO:tasks.workunit.client.0.smithi073.stderr: -263> 2024-09-12T00:50:03.951+0000 7f535e698800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:50:04.236 INFO:tasks.workunit.client.0.smithi073.stderr: -262> 2024-09-12T00:50:03.951+0000 7f535e698800 10 monclient(hunting): picked mon.noname-c con 0x55b398227d80 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:50:04.236 INFO:tasks.workunit.client.0.smithi073.stderr: -261> 2024-09-12T00:50:03.952+0000 7f535e698800 10 monclient(hunting): picked mon.noname-a con 0x55b3981f78e0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:50:04.236 INFO:tasks.workunit.client.0.smithi073.stderr: -260> 2024-09-12T00:50:03.952+0000 7f535e698800 10 monclient(hunting): picked mon.noname-b con 0x55b3981f4810 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:50:04.236 INFO:tasks.workunit.client.0.smithi073.stderr: -259> 2024-09-12T00:50:03.952+0000 7f535e698800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:04.236 INFO:tasks.workunit.client.0.smithi073.stderr: -258> 2024-09-12T00:50:03.952+0000 7f535e698800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:04.236 INFO:tasks.workunit.client.0.smithi073.stderr: -257> 2024-09-12T00:50:03.952+0000 7f535e698800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:04.236 INFO:tasks.workunit.client.0.smithi073.stderr: -256> 2024-09-12T00:50:03.952+0000 7f535e698800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:04.236 INFO:tasks.workunit.client.0.smithi073.stderr: -255> 2024-09-12T00:50:03.952+0000 7f535e698800 10 monclient(hunting): authenticate will time out at 2064.622036s 2024-09-12T00:50:04.237 INFO:tasks.workunit.client.0.smithi073.stderr: -254> 2024-09-12T00:50:03.952+0000 7f535c182640 10 monclient(hunting): get_auth_request con 0x55b398227d80 auth_method 0 2024-09-12T00:50:04.237 INFO:tasks.workunit.client.0.smithi073.stderr: -253> 2024-09-12T00:50:03.952+0000 7f535c182640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:04.237 INFO:tasks.workunit.client.0.smithi073.stderr: -252> 2024-09-12T00:50:03.952+0000 7f535c182640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:04.237 INFO:tasks.workunit.client.0.smithi073.stderr: -251> 2024-09-12T00:50:03.952+0000 7f535c182640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:04.237 INFO:tasks.workunit.client.0.smithi073.stderr: -250> 2024-09-12T00:50:03.952+0000 7f5353981640 10 monclient(hunting): get_auth_request con 0x55b3981f78e0 auth_method 0 2024-09-12T00:50:04.237 INFO:tasks.workunit.client.0.smithi073.stderr: -249> 2024-09-12T00:50:03.952+0000 7f5353981640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:04.237 INFO:tasks.workunit.client.0.smithi073.stderr: -248> 2024-09-12T00:50:03.952+0000 7f5353981640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:04.237 INFO:tasks.workunit.client.0.smithi073.stderr: -247> 2024-09-12T00:50:03.952+0000 7f5353981640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:04.237 INFO:tasks.workunit.client.0.smithi073.stderr: -246> 2024-09-12T00:50:03.952+0000 7f535c983640 10 monclient(hunting): get_auth_request con 0x55b3981f4810 auth_method 0 2024-09-12T00:50:04.237 INFO:tasks.workunit.client.0.smithi073.stderr: -245> 2024-09-12T00:50:03.952+0000 7f535c983640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:04.237 INFO:tasks.workunit.client.0.smithi073.stderr: -244> 2024-09-12T00:50:03.952+0000 7f535c983640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:04.237 INFO:tasks.workunit.client.0.smithi073.stderr: -243> 2024-09-12T00:50:03.952+0000 7f535c983640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:04.237 INFO:tasks.workunit.client.0.smithi073.stderr: -242> 2024-09-12T00:50:03.952+0000 7f535c182640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:04.238 INFO:tasks.workunit.client.0.smithi073.stderr: -241> 2024-09-12T00:50:03.952+0000 7f535c182640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:04.238 INFO:tasks.workunit.client.0.smithi073.stderr: -240> 2024-09-12T00:50:03.952+0000 7f535c182640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:04.238 INFO:tasks.workunit.client.0.smithi073.stderr: -239> 2024-09-12T00:50:03.952+0000 7f5353981640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:04.238 INFO:tasks.workunit.client.0.smithi073.stderr: -238> 2024-09-12T00:50:03.952+0000 7f5353981640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:04.238 INFO:tasks.workunit.client.0.smithi073.stderr: -237> 2024-09-12T00:50:03.952+0000 7f5353981640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:04.238 INFO:tasks.workunit.client.0.smithi073.stderr: -236> 2024-09-12T00:50:03.952+0000 7f535c983640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:04.238 INFO:tasks.workunit.client.0.smithi073.stderr: -235> 2024-09-12T00:50:03.952+0000 7f535c983640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:04.238 INFO:tasks.workunit.client.0.smithi073.stderr: -234> 2024-09-12T00:50:03.952+0000 7f535c983640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:04.238 INFO:tasks.workunit.client.0.smithi073.stderr: -233> 2024-09-12T00:50:03.952+0000 7f535c182640 10 monclient(hunting): handle_auth_done global_id 6530 payload 274 2024-09-12T00:50:04.238 INFO:tasks.workunit.client.0.smithi073.stderr: -232> 2024-09-12T00:50:03.952+0000 7f535c182640 10 monclient: _finish_hunting 0 2024-09-12T00:50:04.238 INFO:tasks.workunit.client.0.smithi073.stderr: -231> 2024-09-12T00:50:03.952+0000 7f535c182640 1 monclient: found mon.noname-c 2024-09-12T00:50:04.238 INFO:tasks.workunit.client.0.smithi073.stderr: -230> 2024-09-12T00:50:03.952+0000 7f535c182640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.73:3301/0 2024-09-12T00:50:04.238 INFO:tasks.workunit.client.0.smithi073.stderr: -229> 2024-09-12T00:50:03.952+0000 7f52337fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:04.238 INFO:tasks.workunit.client.0.smithi073.stderr: -228> 2024-09-12T00:50:03.952+0000 7f52337fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:50:04.239 INFO:tasks.workunit.client.0.smithi073.stderr: -227> 2024-09-12T00:50:03.952+0000 7f52337fe640 10 monclient: dump: 2024-09-12T00:50:04.239 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:50:04.239 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:50:04.239 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:04.239 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:04.239 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:04.239 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:50:04.239 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:50:04.239 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:50:04.239 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:50:04.239 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:04.239 INFO:tasks.workunit.client.0.smithi073.stderr: -226> 2024-09-12T00:50:03.952+0000 7f52337fe640 10 monclient: _finish_auth 0 2024-09-12T00:50:04.239 INFO:tasks.workunit.client.0.smithi073.stderr: -225> 2024-09-12T00:50:03.952+0000 7f52337fe640 10 monclient: _check_auth_tickets 2024-09-12T00:50:04.240 INFO:tasks.workunit.client.0.smithi073.stderr: -224> 2024-09-12T00:50:03.952+0000 7f52337fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:04.240 INFO:tasks.workunit.client.0.smithi073.stderr: -223> 2024-09-12T00:50:03.952+0000 7f52337fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:04.240 INFO:tasks.workunit.client.0.smithi073.stderr: -222> 2024-09-12T00:50:03.952+0000 7f52337fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:50:04.240 INFO:tasks.workunit.client.0.smithi073.stderr: -221> 2024-09-12T00:50:03.952+0000 7f52337fe640 10 monclient: dump: 2024-09-12T00:50:04.240 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:50:04.240 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:50:04.240 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:04.240 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:04.240 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:04.240 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:50:04.240 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:50:04.240 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:50:04.240 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:50:04.241 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:04.241 INFO:tasks.workunit.client.0.smithi073.stderr: -220> 2024-09-12T00:50:03.952+0000 7f535e698800 5 monclient: authenticate success, global_id 6530 2024-09-12T00:50:04.241 INFO:tasks.workunit.client.0.smithi073.stderr: -219> 2024-09-12T00:50:03.952+0000 7f535e698800 10 monclient: get_monmap_and_config success 2024-09-12T00:50:04.241 INFO:tasks.workunit.client.0.smithi073.stderr: -218> 2024-09-12T00:50:03.952+0000 7f535e698800 4 set_mon_vals no callback set 2024-09-12T00:50:04.241 INFO:tasks.workunit.client.0.smithi073.stderr: -217> 2024-09-12T00:50:03.953+0000 7f535e698800 10 monclient: shutdown 2024-09-12T00:50:04.241 INFO:tasks.workunit.client.0.smithi073.stderr: -216> 2024-09-12T00:50:03.953+0000 7f535e698800 10 monclient: build_initial_monmap 2024-09-12T00:50:04.241 INFO:tasks.workunit.client.0.smithi073.stderr: -215> 2024-09-12T00:50:03.953+0000 7f535e698800 1 build_initial for_mkfs: 0 2024-09-12T00:50:04.241 INFO:tasks.workunit.client.0.smithi073.stderr: -214> 2024-09-12T00:50:03.953+0000 7f535e698800 10 monclient: monmap: 2024-09-12T00:50:04.241 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:50:04.241 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:04.241 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:50:04.241 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:50:04.241 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:04.242 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:50:04.242 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:50:04.242 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:50:04.242 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:50:04.242 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:04.242 INFO:tasks.workunit.client.0.smithi073.stderr: -213> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981f53b0) adding auth protocol: cephx 2024-09-12T00:50:04.242 INFO:tasks.workunit.client.0.smithi073.stderr: -212> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981f53b0) adding auth protocol: cephx 2024-09-12T00:50:04.242 INFO:tasks.workunit.client.0.smithi073.stderr: -211> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981f53b0) adding auth protocol: cephx 2024-09-12T00:50:04.242 INFO:tasks.workunit.client.0.smithi073.stderr: -210> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981f53b0) adding con mode: secure 2024-09-12T00:50:04.242 INFO:tasks.workunit.client.0.smithi073.stderr: -209> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981f53b0) adding con mode: crc 2024-09-12T00:50:04.242 INFO:tasks.workunit.client.0.smithi073.stderr: -208> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981f53b0) adding con mode: secure 2024-09-12T00:50:04.242 INFO:tasks.workunit.client.0.smithi073.stderr: -207> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981f53b0) adding con mode: crc 2024-09-12T00:50:04.242 INFO:tasks.workunit.client.0.smithi073.stderr: -206> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981f53b0) adding con mode: secure 2024-09-12T00:50:04.243 INFO:tasks.workunit.client.0.smithi073.stderr: -205> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981f53b0) adding con mode: crc 2024-09-12T00:50:04.243 INFO:tasks.workunit.client.0.smithi073.stderr: -204> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981f53b0) adding con mode: crc 2024-09-12T00:50:04.243 INFO:tasks.workunit.client.0.smithi073.stderr: -203> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981f53b0) adding con mode: secure 2024-09-12T00:50:04.243 INFO:tasks.workunit.client.0.smithi073.stderr: -202> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981f53b0) adding con mode: crc 2024-09-12T00:50:04.243 INFO:tasks.workunit.client.0.smithi073.stderr: -201> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981f53b0) adding con mode: secure 2024-09-12T00:50:04.243 INFO:tasks.workunit.client.0.smithi073.stderr: -200> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981f53b0) adding con mode: crc 2024-09-12T00:50:04.243 INFO:tasks.workunit.client.0.smithi073.stderr: -199> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981f53b0) adding con mode: secure 2024-09-12T00:50:04.243 INFO:tasks.workunit.client.0.smithi073.stderr: -198> 2024-09-12T00:50:03.953+0000 7f535e698800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:04.243 INFO:tasks.workunit.client.0.smithi073.stderr: -197> 2024-09-12T00:50:03.953+0000 7f535e698800 1 librados: starting msgr at 2024-09-12T00:50:04.243 INFO:tasks.workunit.client.0.smithi073.stderr: -196> 2024-09-12T00:50:03.953+0000 7f535e698800 1 librados: starting objecter 2024-09-12T00:50:04.243 INFO:tasks.workunit.client.0.smithi073.stderr: -195> 2024-09-12T00:50:03.953+0000 7f535e698800 5 asok(0x55b397f35630) register_command objecter_requests cmddesc objecter_requests hook 0x55b3981f6e40 EEXIST 2024-09-12T00:50:04.243 INFO:tasks.workunit.client.0.smithi073.stderr: -194> 2024-09-12T00:50:03.953+0000 7f535e698800 1 librados: setting wanted keys 2024-09-12T00:50:04.243 INFO:tasks.workunit.client.0.smithi073.stderr: -193> 2024-09-12T00:50:03.953+0000 7f535e698800 1 librados: calling monclient init 2024-09-12T00:50:04.243 INFO:tasks.workunit.client.0.smithi073.stderr: -192> 2024-09-12T00:50:03.953+0000 7f535e698800 10 monclient: init 2024-09-12T00:50:04.244 INFO:tasks.workunit.client.0.smithi073.stderr: -191> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981ebe10) adding auth protocol: cephx 2024-09-12T00:50:04.244 INFO:tasks.workunit.client.0.smithi073.stderr: -190> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981ebe10) adding auth protocol: cephx 2024-09-12T00:50:04.244 INFO:tasks.workunit.client.0.smithi073.stderr: -189> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981ebe10) adding auth protocol: cephx 2024-09-12T00:50:04.244 INFO:tasks.workunit.client.0.smithi073.stderr: -188> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981ebe10) adding con mode: secure 2024-09-12T00:50:04.244 INFO:tasks.workunit.client.0.smithi073.stderr: -187> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981ebe10) adding con mode: crc 2024-09-12T00:50:04.244 INFO:tasks.workunit.client.0.smithi073.stderr: -186> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981ebe10) adding con mode: secure 2024-09-12T00:50:04.244 INFO:tasks.workunit.client.0.smithi073.stderr: -185> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981ebe10) adding con mode: crc 2024-09-12T00:50:04.244 INFO:tasks.workunit.client.0.smithi073.stderr: -184> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981ebe10) adding con mode: secure 2024-09-12T00:50:04.244 INFO:tasks.workunit.client.0.smithi073.stderr: -183> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981ebe10) adding con mode: crc 2024-09-12T00:50:04.244 INFO:tasks.workunit.client.0.smithi073.stderr: -182> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981ebe10) adding con mode: crc 2024-09-12T00:50:04.244 INFO:tasks.workunit.client.0.smithi073.stderr: -181> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981ebe10) adding con mode: secure 2024-09-12T00:50:04.244 INFO:tasks.workunit.client.0.smithi073.stderr: -180> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981ebe10) adding con mode: crc 2024-09-12T00:50:04.245 INFO:tasks.workunit.client.0.smithi073.stderr: -179> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981ebe10) adding con mode: secure 2024-09-12T00:50:04.245 INFO:tasks.workunit.client.0.smithi073.stderr: -178> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981ebe10) adding con mode: crc 2024-09-12T00:50:04.245 INFO:tasks.workunit.client.0.smithi073.stderr: -177> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981ebe10) adding con mode: secure 2024-09-12T00:50:04.245 INFO:tasks.workunit.client.0.smithi073.stderr: -176> 2024-09-12T00:50:03.953+0000 7f535e698800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:04.245 INFO:tasks.workunit.client.0.smithi073.stderr: -175> 2024-09-12T00:50:03.954+0000 7f535e698800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:04.245 INFO:tasks.workunit.client.0.smithi073.stderr: -174> 2024-09-12T00:50:03.954+0000 7f535e698800 5 asok(0x55b397f35630) register_command rotate-key cmddesc rotate-key hook 0x55b3981ebf58 EEXIST 2024-09-12T00:50:04.245 INFO:tasks.workunit.client.0.smithi073.stderr: -173> 2024-09-12T00:50:03.954+0000 7f535e698800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:04.245 INFO:tasks.workunit.client.0.smithi073.stderr: -172> 2024-09-12T00:50:03.954+0000 7f535e698800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:50:04.245 INFO:tasks.workunit.client.0.smithi073.stderr: -171> 2024-09-12T00:50:03.954+0000 7f535e698800 10 monclient(hunting): picked mon.noname-c con 0x55b3981f4810 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:50:04.245 INFO:tasks.workunit.client.0.smithi073.stderr: -170> 2024-09-12T00:50:03.954+0000 7f535e698800 10 monclient(hunting): picked mon.noname-a con 0x55b3981f78e0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:50:04.246 INFO:tasks.workunit.client.0.smithi073.stderr: -169> 2024-09-12T00:50:03.954+0000 7f535e698800 10 monclient(hunting): picked mon.noname-b con 0x55b398227d80 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:50:04.246 INFO:tasks.workunit.client.0.smithi073.stderr: -168> 2024-09-12T00:50:03.954+0000 7f535e698800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:04.246 INFO:tasks.workunit.client.0.smithi073.stderr: -167> 2024-09-12T00:50:03.954+0000 7f535e698800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:04.246 INFO:tasks.workunit.client.0.smithi073.stderr: -166> 2024-09-12T00:50:03.954+0000 7f535e698800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:04.246 INFO:tasks.workunit.client.0.smithi073.stderr: -165> 2024-09-12T00:50:03.954+0000 7f535e698800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:04.246 INFO:tasks.workunit.client.0.smithi073.stderr: -164> 2024-09-12T00:50:03.954+0000 7f535e698800 10 monclient(hunting): authenticate will time out at 2064.624270s 2024-09-12T00:50:04.246 INFO:tasks.workunit.client.0.smithi073.stderr: -163> 2024-09-12T00:50:03.954+0000 7f535c182640 10 monclient(hunting): get_auth_request con 0x55b3981f4810 auth_method 0 2024-09-12T00:50:04.246 INFO:tasks.workunit.client.0.smithi073.stderr: -162> 2024-09-12T00:50:03.954+0000 7f535c182640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:04.246 INFO:tasks.workunit.client.0.smithi073.stderr: -161> 2024-09-12T00:50:03.954+0000 7f535c182640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:04.246 INFO:tasks.workunit.client.0.smithi073.stderr: -160> 2024-09-12T00:50:03.954+0000 7f535c182640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:04.246 INFO:tasks.workunit.client.0.smithi073.stderr: -159> 2024-09-12T00:50:03.954+0000 7f5353981640 10 monclient(hunting): get_auth_request con 0x55b3981f78e0 auth_method 0 2024-09-12T00:50:04.246 INFO:tasks.workunit.client.0.smithi073.stderr: -158> 2024-09-12T00:50:03.954+0000 7f5353981640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:04.246 INFO:tasks.workunit.client.0.smithi073.stderr: -157> 2024-09-12T00:50:03.954+0000 7f5353981640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:04.246 INFO:tasks.workunit.client.0.smithi073.stderr: -156> 2024-09-12T00:50:03.954+0000 7f5353981640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:04.247 INFO:tasks.workunit.client.0.smithi073.stderr: -155> 2024-09-12T00:50:03.954+0000 7f535c182640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:04.247 INFO:tasks.workunit.client.0.smithi073.stderr: -154> 2024-09-12T00:50:03.954+0000 7f535c182640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:04.247 INFO:tasks.workunit.client.0.smithi073.stderr: -153> 2024-09-12T00:50:03.954+0000 7f535c182640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:04.247 INFO:tasks.workunit.client.0.smithi073.stderr: -152> 2024-09-12T00:50:03.954+0000 7f5353981640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:04.247 INFO:tasks.workunit.client.0.smithi073.stderr: -151> 2024-09-12T00:50:03.954+0000 7f5353981640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:04.247 INFO:tasks.workunit.client.0.smithi073.stderr: -150> 2024-09-12T00:50:03.954+0000 7f5353981640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:04.247 INFO:tasks.workunit.client.0.smithi073.stderr: -149> 2024-09-12T00:50:03.954+0000 7f535c983640 10 monclient(hunting): get_auth_request con 0x55b398227d80 auth_method 0 2024-09-12T00:50:04.247 INFO:tasks.workunit.client.0.smithi073.stderr: -148> 2024-09-12T00:50:03.954+0000 7f535c983640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:04.247 INFO:tasks.workunit.client.0.smithi073.stderr: -147> 2024-09-12T00:50:03.954+0000 7f535c983640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:04.247 INFO:tasks.workunit.client.0.smithi073.stderr: -146> 2024-09-12T00:50:03.954+0000 7f535c983640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:04.247 INFO:tasks.workunit.client.0.smithi073.stderr: -145> 2024-09-12T00:50:03.954+0000 7f535c182640 10 monclient(hunting): handle_auth_done global_id 6533 payload 824 2024-09-12T00:50:04.247 INFO:tasks.workunit.client.0.smithi073.stderr: -144> 2024-09-12T00:50:03.954+0000 7f535c182640 10 monclient: _finish_hunting 0 2024-09-12T00:50:04.247 INFO:tasks.workunit.client.0.smithi073.stderr: -143> 2024-09-12T00:50:03.954+0000 7f535c182640 1 monclient: found mon.noname-c 2024-09-12T00:50:04.248 INFO:tasks.workunit.client.0.smithi073.stderr: -142> 2024-09-12T00:50:03.954+0000 7f535c182640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.73:3301/0 2024-09-12T00:50:04.248 INFO:tasks.workunit.client.0.smithi073.stderr: -141> 2024-09-12T00:50:03.954+0000 7f5231ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:04.248 INFO:tasks.workunit.client.0.smithi073.stderr: -140> 2024-09-12T00:50:03.954+0000 7f5231ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:50:04.248 INFO:tasks.workunit.client.0.smithi073.stderr: -139> 2024-09-12T00:50:03.954+0000 7f5231ffb640 10 monclient: dump: 2024-09-12T00:50:04.248 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:50:04.248 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:50:04.248 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:04.248 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:04.248 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:04.248 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:50:04.248 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:50:04.248 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:50:04.248 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:50:04.248 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:04.249 INFO:tasks.workunit.client.0.smithi073.stderr: -138> 2024-09-12T00:50:03.954+0000 7f5231ffb640 10 monclient: _finish_auth 0 2024-09-12T00:50:04.249 INFO:tasks.workunit.client.0.smithi073.stderr: -137> 2024-09-12T00:50:03.954+0000 7f5231ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:50:04.249 INFO:tasks.workunit.client.0.smithi073.stderr: -136> 2024-09-12T00:50:03.954+0000 7f5231ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:04.249 INFO:tasks.workunit.client.0.smithi073.stderr: -135> 2024-09-12T00:50:03.954+0000 7f5231ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:04.249 INFO:tasks.workunit.client.0.smithi073.stderr: -134> 2024-09-12T00:50:03.954+0000 7f5231ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:50:04.249 INFO:tasks.workunit.client.0.smithi073.stderr: -133> 2024-09-12T00:50:03.954+0000 7f5231ffb640 10 monclient: dump: 2024-09-12T00:50:04.249 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:50:04.249 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:50:04.249 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:04.249 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:04.249 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:04.249 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:50:04.249 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:50:04.250 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:50:04.250 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:50:04.250 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:04.250 INFO:tasks.workunit.client.0.smithi073.stderr: -132> 2024-09-12T00:50:03.954+0000 7f535e698800 5 monclient: authenticate success, global_id 6533 2024-09-12T00:50:04.250 INFO:tasks.workunit.client.0.smithi073.stderr: -131> 2024-09-12T00:50:03.954+0000 7f52337fe640 4 set_mon_vals no callback set 2024-09-12T00:50:04.250 INFO:tasks.workunit.client.0.smithi073.stderr: -130> 2024-09-12T00:50:03.954+0000 7f535e698800 10 monclient: _renew_subs 2024-09-12T00:50:04.250 INFO:tasks.workunit.client.0.smithi073.stderr: -129> 2024-09-12T00:50:03.954+0000 7f535e698800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:50:04.250 INFO:tasks.workunit.client.0.smithi073.stderr: -128> 2024-09-12T00:50:03.954+0000 7f535e698800 10 monclient: _renew_subs 2024-09-12T00:50:04.250 INFO:tasks.workunit.client.0.smithi073.stderr: -127> 2024-09-12T00:50:03.954+0000 7f535e698800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:50:04.250 INFO:tasks.workunit.client.0.smithi073.stderr: -126> 2024-09-12T00:50:03.954+0000 7f535e698800 1 librados: init done 2024-09-12T00:50:04.250 INFO:tasks.workunit.client.0.smithi073.stderr: -125> 2024-09-12T00:50:03.954+0000 7f535e698800 5 asok(0x55b397f35630) register_command cr dump hook 0x55b3982190e8 2024-09-12T00:50:04.250 INFO:tasks.workunit.client.0.smithi073.stderr: -124> 2024-09-12T00:50:03.956+0000 7f535e698800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.250 INFO:tasks.workunit.client.0.smithi073.stderr: -123> 2024-09-12T00:50:03.956+0000 7f5231ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:50:04.251 INFO:tasks.workunit.client.0.smithi073.stderr: -122> 2024-09-12T00:50:03.956+0000 7f5231ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:50:04.251 INFO:tasks.workunit.client.0.smithi073.stderr: -121> 2024-09-12T00:50:03.957+0000 7f5231ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:50:04.251 INFO:tasks.workunit.client.0.smithi073.stderr: -120> 2024-09-12T00:50:03.957+0000 7f5353981640 10 monclient: get_auth_request con 0x7f5224076470 auth_method 0 2024-09-12T00:50:04.251 INFO:tasks.workunit.client.0.smithi073.stderr: -119> 2024-09-12T00:50:03.957+0000 7f535c983640 10 monclient: get_auth_request con 0x55b398242610 auth_method 0 2024-09-12T00:50:04.251 INFO:tasks.workunit.client.0.smithi073.stderr: -118> 2024-09-12T00:50:03.957+0000 7f535e698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:04.251 INFO:tasks.workunit.client.0.smithi073.stderr: -117> 2024-09-12T00:50:03.957+0000 7f535e698800 20 realm 2024-09-12T00:50:04.251 INFO:tasks.workunit.client.0.smithi073.stderr: -116> 2024-09-12T00:50:03.957+0000 7f535e698800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.251 INFO:tasks.workunit.client.0.smithi073.stderr: -115> 2024-09-12T00:50:03.958+0000 7f535e698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:04.251 INFO:tasks.workunit.client.0.smithi073.stderr: -114> 2024-09-12T00:50:03.958+0000 7f535e698800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:04.251 INFO:tasks.workunit.client.0.smithi073.stderr: -113> 2024-09-12T00:50:03.958+0000 7f535e698800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.251 INFO:tasks.workunit.client.0.smithi073.stderr: -112> 2024-09-12T00:50:03.958+0000 7f535e698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:04.251 INFO:tasks.workunit.client.0.smithi073.stderr: -111> 2024-09-12T00:50:03.958+0000 7f535e698800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.251 INFO:tasks.workunit.client.0.smithi073.stderr: -110> 2024-09-12T00:50:03.958+0000 7f535c182640 10 monclient: get_auth_request con 0x55b3982467b0 auth_method 0 2024-09-12T00:50:04.251 INFO:tasks.workunit.client.0.smithi073.stderr: -109> 2024-09-12T00:50:03.959+0000 7f535e698800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:04.252 INFO:tasks.workunit.client.0.smithi073.stderr: -108> 2024-09-12T00:50:03.959+0000 7f535e698800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.252 INFO:tasks.workunit.client.0.smithi073.stderr: -107> 2024-09-12T00:50:03.959+0000 7f5353981640 10 monclient: get_auth_request con 0x55b39824a030 auth_method 0 2024-09-12T00:50:04.252 INFO:tasks.workunit.client.0.smithi073.stderr: -106> 2024-09-12T00:50:03.960+0000 7f535e698800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:04.252 INFO:tasks.workunit.client.0.smithi073.stderr: -105> 2024-09-12T00:50:03.960+0000 7f535e698800 20 searching for the correct realm 2024-09-12T00:50:04.252 INFO:tasks.workunit.client.0.smithi073.stderr: -104> 2024-09-12T00:50:03.960+0000 7f535c983640 10 monclient: get_auth_request con 0x55b39824edb0 auth_method 0 2024-09-12T00:50:04.252 INFO:tasks.workunit.client.0.smithi073.stderr: -103> 2024-09-12T00:50:03.960+0000 7f535c182640 10 monclient: get_auth_request con 0x7f5354018070 auth_method 0 2024-09-12T00:50:04.252 INFO:tasks.workunit.client.0.smithi073.stderr: -102> 2024-09-12T00:50:03.961+0000 7f5353981640 10 monclient: get_auth_request con 0x7f534c076f50 auth_method 0 2024-09-12T00:50:04.252 INFO:tasks.workunit.client.0.smithi073.stderr: -101> 2024-09-12T00:50:03.962+0000 7f535c983640 0 -- 172.21.15.73:0/4248616062 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f534406b030 msgr2=0x7f53440ab6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:04.252 INFO:tasks.workunit.client.0.smithi073.stderr: -100> 2024-09-12T00:50:04.163+0000 7f535c983640 10 monclient: get_auth_request con 0x7f534406b030 auth_method 0 2024-09-12T00:50:04.252 INFO:tasks.workunit.client.0.smithi073.stderr: -99> 2024-09-12T00:50:04.167+0000 7f535c182640 10 monclient: get_auth_request con 0x7f5354044950 auth_method 0 2024-09-12T00:50:04.252 INFO:tasks.workunit.client.0.smithi073.stderr: -98> 2024-09-12T00:50:04.168+0000 7f535c983640 0 -- 172.21.15.73:0/4248616062 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f534406b030 msgr2=0x7f53440ab6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:04.252 INFO:tasks.workunit.client.0.smithi073.stderr: -97> 2024-09-12T00:50:04.168+0000 7f5231ffb640 1 client.6533.objecter ms_handle_reset 0x7f534406b030 session 0x7f5344005040 osd.4 2024-09-12T00:50:04.252 INFO:tasks.workunit.client.0.smithi073.stderr: -96> 2024-09-12T00:50:04.168+0000 7f5231ffb640 10 monclient: _renew_subs 2024-09-12T00:50:04.253 INFO:tasks.workunit.client.0.smithi073.stderr: -95> 2024-09-12T00:50:04.168+0000 7f5231ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:50:04.253 INFO:tasks.workunit.client.0.smithi073.stderr: -94> 2024-09-12T00:50:04.168+0000 7f535c983640 10 monclient: get_auth_request con 0x7f5224086370 auth_method 0 2024-09-12T00:50:04.253 INFO:tasks.workunit.client.0.smithi073.stderr: -93> 2024-09-12T00:50:04.172+0000 7f535e698800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:50:04.253 INFO:tasks.workunit.client.0.smithi073.stderr: -92> 2024-09-12T00:50:04.172+0000 7f535e698800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:04.253 INFO:tasks.workunit.client.0.smithi073.stderr: -91> 2024-09-12T00:50:04.172+0000 7f535e698800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:50:04.253 INFO:tasks.workunit.client.0.smithi073.stderr: -90> 2024-09-12T00:50:04.172+0000 7f535e698800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:04.253 INFO:tasks.workunit.client.0.smithi073.stderr: -89> 2024-09-12T00:50:04.172+0000 7f535e698800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:04.253 INFO:tasks.workunit.client.0.smithi073.stderr: -88> 2024-09-12T00:50:04.172+0000 7f535e698800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:04.253 INFO:tasks.workunit.client.0.smithi073.stderr: -87> 2024-09-12T00:50:04.172+0000 7f535e698800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.253 INFO:tasks.workunit.client.0.smithi073.stderr: -86> 2024-09-12T00:50:04.172+0000 7f535e698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:04.253 INFO:tasks.workunit.client.0.smithi073.stderr: -85> 2024-09-12T00:50:04.172+0000 7f535e698800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.253 INFO:tasks.workunit.client.0.smithi073.stderr: -84> 2024-09-12T00:50:04.172+0000 7f535e698800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:04.253 INFO:tasks.workunit.client.0.smithi073.stderr: -83> 2024-09-12T00:50:04.172+0000 7f535e698800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.254 INFO:tasks.workunit.client.0.smithi073.stderr: -82> 2024-09-12T00:50:04.172+0000 7f535e698800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:04.254 INFO:tasks.workunit.client.0.smithi073.stderr: -81> 2024-09-12T00:50:04.172+0000 7f535e698800 20 zone default found 2024-09-12T00:50:04.254 INFO:tasks.workunit.client.0.smithi073.stderr: -80> 2024-09-12T00:50:04.172+0000 7f535e698800 4 Realm: () 2024-09-12T00:50:04.254 INFO:tasks.workunit.client.0.smithi073.stderr: -79> 2024-09-12T00:50:04.172+0000 7f535e698800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:50:04.254 INFO:tasks.workunit.client.0.smithi073.stderr: -78> 2024-09-12T00:50:04.172+0000 7f535e698800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:50:04.254 INFO:tasks.workunit.client.0.smithi073.stderr: -77> 2024-09-12T00:50:04.172+0000 7f535e698800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:04.254 INFO:tasks.workunit.client.0.smithi073.stderr: -76> 2024-09-12T00:50:04.172+0000 7f535e698800 20 zonegroup default 2024-09-12T00:50:04.254 INFO:tasks.workunit.client.0.smithi073.stderr: -75> 2024-09-12T00:50:04.172+0000 7f535e698800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.254 INFO:tasks.workunit.client.0.smithi073.stderr: -74> 2024-09-12T00:50:04.173+0000 7f535e698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:04.254 INFO:tasks.workunit.client.0.smithi073.stderr: -73> 2024-09-12T00:50:04.173+0000 7f535e698800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.254 INFO:tasks.workunit.client.0.smithi073.stderr: -72> 2024-09-12T00:50:04.173+0000 7f535e698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:04.254 INFO:tasks.workunit.client.0.smithi073.stderr: -71> 2024-09-12T00:50:04.173+0000 7f535e698800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.254 INFO:tasks.workunit.client.0.smithi073.stderr: -70> 2024-09-12T00:50:04.173+0000 7f535e698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:04.254 INFO:tasks.workunit.client.0.smithi073.stderr: -69> 2024-09-12T00:50:04.173+0000 7f535e698800 20 started sync module instance, tier type = 2024-09-12T00:50:04.255 INFO:tasks.workunit.client.0.smithi073.stderr: -68> 2024-09-12T00:50:04.173+0000 7f535e698800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:50:04.255 INFO:tasks.workunit.client.0.smithi073.stderr: -67> 2024-09-12T00:50:04.182+0000 7f535e698800 20 add_watcher() i=0 2024-09-12T00:50:04.255 INFO:tasks.workunit.client.0.smithi073.stderr: -66> 2024-09-12T00:50:04.182+0000 7f535e698800 20 add_watcher() i=1 2024-09-12T00:50:04.255 INFO:tasks.workunit.client.0.smithi073.stderr: -65> 2024-09-12T00:50:04.182+0000 7f535e698800 20 add_watcher() i=2 2024-09-12T00:50:04.255 INFO:tasks.workunit.client.0.smithi073.stderr: -64> 2024-09-12T00:50:04.182+0000 7f535e698800 20 add_watcher() i=3 2024-09-12T00:50:04.255 INFO:tasks.workunit.client.0.smithi073.stderr: -63> 2024-09-12T00:50:04.182+0000 7f535e698800 20 add_watcher() i=4 2024-09-12T00:50:04.255 INFO:tasks.workunit.client.0.smithi073.stderr: -62> 2024-09-12T00:50:04.182+0000 7f535e698800 20 add_watcher() i=5 2024-09-12T00:50:04.255 INFO:tasks.workunit.client.0.smithi073.stderr: -61> 2024-09-12T00:50:04.182+0000 7f535e698800 20 add_watcher() i=6 2024-09-12T00:50:04.255 INFO:tasks.workunit.client.0.smithi073.stderr: -60> 2024-09-12T00:50:04.183+0000 7f535e698800 20 add_watcher() i=7 2024-09-12T00:50:04.255 INFO:tasks.workunit.client.0.smithi073.stderr: -59> 2024-09-12T00:50:04.183+0000 7f535e698800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:04.255 INFO:tasks.workunit.client.0.smithi073.stderr: -58> 2024-09-12T00:50:04.185+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a6da0) adding auth protocol: cephx 2024-09-12T00:50:04.255 INFO:tasks.workunit.client.0.smithi073.stderr: -57> 2024-09-12T00:50:04.185+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a6da0) adding auth protocol: cephx 2024-09-12T00:50:04.255 INFO:tasks.workunit.client.0.smithi073.stderr: -56> 2024-09-12T00:50:04.185+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a6da0) adding auth protocol: cephx 2024-09-12T00:50:04.255 INFO:tasks.workunit.client.0.smithi073.stderr: -55> 2024-09-12T00:50:04.185+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a6da0) adding con mode: secure 2024-09-12T00:50:04.256 INFO:tasks.workunit.client.0.smithi073.stderr: -54> 2024-09-12T00:50:04.185+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a6da0) adding con mode: crc 2024-09-12T00:50:04.256 INFO:tasks.workunit.client.0.smithi073.stderr: -53> 2024-09-12T00:50:04.185+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a6da0) adding con mode: secure 2024-09-12T00:50:04.256 INFO:tasks.workunit.client.0.smithi073.stderr: -52> 2024-09-12T00:50:04.185+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a6da0) adding con mode: crc 2024-09-12T00:50:04.256 INFO:tasks.workunit.client.0.smithi073.stderr: -51> 2024-09-12T00:50:04.185+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a6da0) adding con mode: secure 2024-09-12T00:50:04.256 INFO:tasks.workunit.client.0.smithi073.stderr: -50> 2024-09-12T00:50:04.185+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a6da0) adding con mode: crc 2024-09-12T00:50:04.256 INFO:tasks.workunit.client.0.smithi073.stderr: -49> 2024-09-12T00:50:04.185+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a6da0) adding con mode: crc 2024-09-12T00:50:04.256 INFO:tasks.workunit.client.0.smithi073.stderr: -48> 2024-09-12T00:50:04.185+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a6da0) adding con mode: secure 2024-09-12T00:50:04.256 INFO:tasks.workunit.client.0.smithi073.stderr: -47> 2024-09-12T00:50:04.185+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a6da0) adding con mode: crc 2024-09-12T00:50:04.256 INFO:tasks.workunit.client.0.smithi073.stderr: -46> 2024-09-12T00:50:04.185+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a6da0) adding con mode: secure 2024-09-12T00:50:04.256 INFO:tasks.workunit.client.0.smithi073.stderr: -45> 2024-09-12T00:50:04.185+0000 7f5212fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:04.256 INFO:tasks.workunit.client.0.smithi073.stderr: -44> 2024-09-12T00:50:04.185+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a6da0) adding con mode: crc 2024-09-12T00:50:04.256 INFO:tasks.workunit.client.0.smithi073.stderr: -43> 2024-09-12T00:50:04.185+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a6da0) adding con mode: secure 2024-09-12T00:50:04.256 INFO:tasks.workunit.client.0.smithi073.stderr: -42> 2024-09-12T00:50:04.185+0000 7f535e698800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:04.257 INFO:tasks.workunit.client.0.smithi073.stderr: -41> 2024-09-12T00:50:04.185+0000 7f535e698800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:04.257 INFO:tasks.workunit.client.0.smithi073.stderr: -40> 2024-09-12T00:50:04.185+0000 7f535e698800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:04.257 INFO:tasks.workunit.client.0.smithi073.stderr: -39> 2024-09-12T00:50:04.185+0000 7f535e698800 5 asok(0x55b397f35630) register_command cache list hook 0x55b398218dd0 2024-09-12T00:50:04.257 INFO:tasks.workunit.client.0.smithi073.stderr: -38> 2024-09-12T00:50:04.185+0000 7f535e698800 5 asok(0x55b397f35630) register_command cache inspect hook 0x55b398218dd0 2024-09-12T00:50:04.257 INFO:tasks.workunit.client.0.smithi073.stderr: -37> 2024-09-12T00:50:04.185+0000 7f535e698800 5 asok(0x55b397f35630) register_command cache erase hook 0x55b398218dd0 2024-09-12T00:50:04.257 INFO:tasks.workunit.client.0.smithi073.stderr: -36> 2024-09-12T00:50:04.185+0000 7f535e698800 5 asok(0x55b397f35630) register_command cache zap hook 0x55b398218dd0 2024-09-12T00:50:04.257 INFO:tasks.workunit.client.0.smithi073.stderr: -35> 2024-09-12T00:50:04.185+0000 7f535e698800 5 note: GC not initialized 2024-09-12T00:50:04.257 INFO:tasks.workunit.client.0.smithi073.stderr: -34> 2024-09-12T00:50:04.185+0000 7f5211fdb640 20 reqs_thread_entry: start 2024-09-12T00:50:04.257 INFO:tasks.workunit.client.0.smithi073.stderr: -33> 2024-09-12T00:50:04.185+0000 7f535e698800 5 asok(0x55b397f35630) register_command sync trace show hook 0x7f534c013070 2024-09-12T00:50:04.257 INFO:tasks.workunit.client.0.smithi073.stderr: -32> 2024-09-12T00:50:04.185+0000 7f535e698800 5 asok(0x55b397f35630) register_command sync trace history hook 0x7f534c013070 2024-09-12T00:50:04.257 INFO:tasks.workunit.client.0.smithi073.stderr: -31> 2024-09-12T00:50:04.185+0000 7f535e698800 5 asok(0x55b397f35630) register_command sync trace active hook 0x7f534c013070 2024-09-12T00:50:04.257 INFO:tasks.workunit.client.0.smithi073.stderr: -30> 2024-09-12T00:50:04.185+0000 7f535e698800 5 asok(0x55b397f35630) register_command sync trace active_short hook 0x7f534c013070 2024-09-12T00:50:04.257 INFO:tasks.workunit.client.0.smithi073.stderr: -29> 2024-09-12T00:50:04.185+0000 7f535e698800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:04.258 INFO:tasks.workunit.client.0.smithi073.stderr: -28> 2024-09-12T00:50:04.185+0000 7f535e698800 20 Filter name: none 2024-09-12T00:50:04.258 INFO:tasks.workunit.client.0.smithi073.stderr: -27> 2024-09-12T00:50:04.186+0000 7f51837fe640 20 reqs_thread_entry: start 2024-09-12T00:50:04.258 INFO:tasks.workunit.client.0.smithi073.stderr: -26> 2024-09-12T00:50:04.186+0000 7f535e698800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:50:04.258 INFO:tasks.workunit.client.0.smithi073.stderr: -25> 2024-09-12T00:50:04.186+0000 7f535e698800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.258 INFO:tasks.workunit.client.0.smithi073.stderr: -24> 2024-09-12T00:50:04.186+0000 7f535e698800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:50:04.258 INFO:tasks.workunit.client.0.smithi073.stderr: -23> 2024-09-12T00:50:04.186+0000 7f535e698800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:50:04.258 INFO:tasks.workunit.client.0.smithi073.stderr: -22> 2024-09-12T00:50:04.186+0000 7f535e698800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:50:04.258 INFO:tasks.workunit.client.0.smithi073.stderr: -21> 2024-09-12T00:50:04.186+0000 7f535e698800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27 : miss 2024-09-12T00:50:04.258 INFO:tasks.workunit.client.0.smithi073.stderr: -20> 2024-09-12T00:50:04.186+0000 7f535e698800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.258 INFO:tasks.workunit.client.0.smithi073.stderr: -19> 2024-09-12T00:50:04.187+0000 7f535e698800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:50:04.258 INFO:tasks.workunit.client.0.smithi073.stderr: -18> 2024-09-12T00:50:04.187+0000 7f535e698800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27 info.flags=0x17 2024-09-12T00:50:04.258 INFO:tasks.workunit.client.0.smithi073.stderr: -17> 2024-09-12T00:50:04.187+0000 7f535e698800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27 to cache LRU end 2024-09-12T00:50:04.258 INFO:tasks.workunit.client.0.smithi073.stderr: -16> 2024-09-12T00:50:04.187+0000 7f535e698800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:04.259 INFO:tasks.workunit.client.0.smithi073.stderr: -15> 2024-09-12T00:50:04.187+0000 7f535e698800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:04.259 INFO:tasks.workunit.client.0.smithi073.stderr: -14> 2024-09-12T00:50:04.187+0000 7f535e698800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27 2024-09-12T00:50:04.259 INFO:tasks.workunit.client.0.smithi073.stderr: -13> 2024-09-12T00:50:04.190+0000 7f535e698800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27 info.flags=0x17 2024-09-12T00:50:04.259 INFO:tasks.workunit.client.0.smithi073.stderr: -12> 2024-09-12T00:50:04.190+0000 7f535e698800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27 to cache LRU end 2024-09-12T00:50:04.259 INFO:tasks.workunit.client.0.smithi073.stderr: -11> 2024-09-12T00:50:04.190+0000 7f535e698800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:04.259 INFO:tasks.workunit.client.0.smithi073.stderr: -10> 2024-09-12T00:50:04.190+0000 7f535e698800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27, ofs0, ns] 2024-09-12T00:50:04.259 INFO:tasks.workunit.client.0.smithi073.stderr: -9> 2024-09-12T00:50:04.191+0000 7f52337fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497043 cookie 94229840089024 notifier 6533 bl.length()=939 2024-09-12T00:50:04.259 INFO:tasks.workunit.client.0.smithi073.stderr: -8> 2024-09-12T00:50:04.191+0000 7f52337fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27 info.flags=0x17 2024-09-12T00:50:04.259 INFO:tasks.workunit.client.0.smithi073.stderr: -7> 2024-09-12T00:50:04.191+0000 7f52337fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27 to cache LRU end 2024-09-12T00:50:04.259 INFO:tasks.workunit.client.0.smithi073.stderr: -6> 2024-09-12T00:50:04.191+0000 7f52337fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:04.259 INFO:tasks.workunit.client.0.smithi073.stderr: -5> 2024-09-12T00:50:04.192+0000 7f535e698800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27]): orig_sources= new_sources= 2024-09-12T00:50:04.259 INFO:tasks.workunit.client.0.smithi073.stderr: -4> 2024-09-12T00:50:04.192+0000 7f535e698800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27]): potential sources added=[] removed=[] 2024-09-12T00:50:04.260 INFO:tasks.workunit.client.0.smithi073.stderr: -3> 2024-09-12T00:50:04.192+0000 7f535e698800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27]): orig_dests= new_dests= 2024-09-12T00:50:04.260 INFO:tasks.workunit.client.0.smithi073.stderr: -2> 2024-09-12T00:50:04.192+0000 7f535e698800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27]): potential dests added=[] removed=[] 2024-09-12T00:50:04.260 INFO:tasks.workunit.client.0.smithi073.stderr: -1> 2024-09-12T00:50:04.193+0000 7f535e698800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f535e698800 time 2024-09-12T00:50:04.193674+0000 2024-09-12T00:50:04.260 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:50:04.260 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:04.260 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:04.260 INFO:tasks.workunit.client.0.smithi073.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f5361b8c71a] 2024-09-12T00:50:04.260 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5361b8c8d8] 2024-09-12T00:50:04.260 INFO:tasks.workunit.client.0.smithi073.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b396e9a641] 2024-09-12T00:50:04.260 INFO:tasks.workunit.client.0.smithi073.stderr: 4: radosgw-admin(+0xd884de) [0x55b3973ad4de] 2024-09-12T00:50:04.260 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b396eaa31d] 2024-09-12T00:50:04.260 INFO:tasks.workunit.client.0.smithi073.stderr: 6: main() 2024-09-12T00:50:04.260 INFO:tasks.workunit.client.0.smithi073.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f5360829590] 2024-09-12T00:50:04.261 INFO:tasks.workunit.client.0.smithi073.stderr: 8: __libc_start_main() 2024-09-12T00:50:04.261 INFO:tasks.workunit.client.0.smithi073.stderr: 9: _start() 2024-09-12T00:50:04.261 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:04.261 INFO:tasks.workunit.client.0.smithi073.stderr: 0> 2024-09-12T00:50:04.194+0000 7f535e698800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:50:04.261 INFO:tasks.workunit.client.0.smithi073.stderr: in thread 7f535e698800 thread_name:radosgw-admin 2024-09-12T00:50:04.261 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:04.261 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:04.261 INFO:tasks.workunit.client.0.smithi073.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f536083e6f0] 2024-09-12T00:50:04.261 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f536088b99c] 2024-09-12T00:50:04.261 INFO:tasks.workunit.client.0.smithi073.stderr: 3: raise() 2024-09-12T00:50:04.261 INFO:tasks.workunit.client.0.smithi073.stderr: 4: abort() 2024-09-12T00:50:04.261 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f5361b8c774] 2024-09-12T00:50:04.261 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5361b8c8d8] 2024-09-12T00:50:04.262 INFO:tasks.workunit.client.0.smithi073.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b396e9a641] 2024-09-12T00:50:04.262 INFO:tasks.workunit.client.0.smithi073.stderr: 8: radosgw-admin(+0xd884de) [0x55b3973ad4de] 2024-09-12T00:50:04.262 INFO:tasks.workunit.client.0.smithi073.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b396eaa31d] 2024-09-12T00:50:04.262 INFO:tasks.workunit.client.0.smithi073.stderr: 10: main() 2024-09-12T00:50:04.262 INFO:tasks.workunit.client.0.smithi073.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f5360829590] 2024-09-12T00:50:04.262 INFO:tasks.workunit.client.0.smithi073.stderr: 12: __libc_start_main() 2024-09-12T00:50:04.262 INFO:tasks.workunit.client.0.smithi073.stderr: 13: _start() 2024-09-12T00:50:04.262 INFO:tasks.workunit.client.0.smithi073.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:50:04.262 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:04.262 INFO:tasks.workunit.client.0.smithi073.stderr:--- logging levels --- 2024-09-12T00:50:04.262 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 none 2024-09-12T00:50:04.262 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 lockdep 2024-09-12T00:50:04.263 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 context 2024-09-12T00:50:04.263 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 crush 2024-09-12T00:50:04.263 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds 2024-09-12T00:50:04.263 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_balancer 2024-09-12T00:50:04.263 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_locker 2024-09-12T00:50:04.263 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_log 2024-09-12T00:50:04.263 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_log_expire 2024-09-12T00:50:04.263 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_migrator 2024-09-12T00:50:04.263 INFO:tasks.workunit.client.0.smithi073.stderr: 3/ 5 mds_quiesce 2024-09-12T00:50:04.263 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 buffer 2024-09-12T00:50:04.263 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 timer 2024-09-12T00:50:04.263 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 filer 2024-09-12T00:50:04.263 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 striper 2024-09-12T00:50:04.263 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 objecter 2024-09-12T00:50:04.264 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rados 2024-09-12T00:50:04.264 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd 2024-09-12T00:50:04.264 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_mirror 2024-09-12T00:50:04.264 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_replay 2024-09-12T00:50:04.264 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_pwl 2024-09-12T00:50:04.264 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 journaler 2024-09-12T00:50:04.264 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 objectcacher 2024-09-12T00:50:04.264 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:50:04.264 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 client 2024-09-12T00:50:04.264 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 osd 2024-09-12T00:50:04.264 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 optracker 2024-09-12T00:50:04.264 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 objclass 2024-09-12T00:50:04.264 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 filestore 2024-09-12T00:50:04.264 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 journal 2024-09-12T00:50:04.265 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 0 ms 2024-09-12T00:50:04.265 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mon 2024-09-12T00:50:04.265 INFO:tasks.workunit.client.0.smithi073.stderr: 0/10 monc 2024-09-12T00:50:04.265 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 paxos 2024-09-12T00:50:04.265 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 tp 2024-09-12T00:50:04.265 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 auth 2024-09-12T00:50:04.265 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 crypto 2024-09-12T00:50:04.265 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 finisher 2024-09-12T00:50:04.265 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 reserver 2024-09-12T00:50:04.265 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 heartbeatmap 2024-09-12T00:50:04.265 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 perfcounter 2024-09-12T00:50:04.265 INFO:tasks.workunit.client.0.smithi073.stderr: 20/20 rgw 2024-09-12T00:50:04.265 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_sync 2024-09-12T00:50:04.266 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_datacache 2024-09-12T00:50:04.266 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_access 2024-09-12T00:50:04.266 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:50:04.266 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_flight 2024-09-12T00:50:04.266 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:50:04.266 INFO:tasks.workunit.client.0.smithi073.stderr: 20/20 rgw_notification 2024-09-12T00:50:04.266 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 javaclient 2024-09-12T00:50:04.266 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 asok 2024-09-12T00:50:04.266 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 throttle 2024-09-12T00:50:04.266 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 0 refs 2024-09-12T00:50:04.266 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 compressor 2024-09-12T00:50:04.266 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 bluestore 2024-09-12T00:50:04.266 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 bluefs 2024-09-12T00:50:04.267 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 bdev 2024-09-12T00:50:04.267 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 kstore 2024-09-12T00:50:04.267 INFO:tasks.workunit.client.0.smithi073.stderr: 4/ 5 rocksdb 2024-09-12T00:50:04.267 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 fuse 2024-09-12T00:50:04.267 INFO:tasks.workunit.client.0.smithi073.stderr: 2/ 5 mgr 2024-09-12T00:50:04.267 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mgrc 2024-09-12T00:50:04.267 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 dpdk 2024-09-12T00:50:04.267 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 eventtrace 2024-09-12T00:50:04.267 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 prioritycache 2024-09-12T00:50:04.267 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 test 2024-09-12T00:50:04.267 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:50:04.267 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cephsqlite 2024-09-12T00:50:04.267 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:50:04.267 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore 2024-09-12T00:50:04.268 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_onode 2024-09-12T00:50:04.268 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_odata 2024-09-12T00:50:04.268 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_omap 2024-09-12T00:50:04.268 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_tm 2024-09-12T00:50:04.268 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_t 2024-09-12T00:50:04.268 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:50:04.268 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_epm 2024-09-12T00:50:04.268 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_lba 2024-09-12T00:50:04.268 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:50:04.268 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_cache 2024-09-12T00:50:04.268 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_journal 2024-09-12T00:50:04.268 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_device 2024-09-12T00:50:04.268 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_backref 2024-09-12T00:50:04.268 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 alienstore 2024-09-12T00:50:04.269 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mclock 2024-09-12T00:50:04.269 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cyanstore 2024-09-12T00:50:04.269 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 ceph_exporter 2024-09-12T00:50:04.269 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 memstore 2024-09-12T00:50:04.269 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 trace 2024-09-12T00:50:04.269 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 ceph_dedup 2024-09-12T00:50:04.269 INFO:tasks.workunit.client.0.smithi073.stderr: -2/-2 (syslog threshold) 2024-09-12T00:50:04.269 INFO:tasks.workunit.client.0.smithi073.stderr: 99/99 (stderr threshold) 2024-09-12T00:50:04.269 INFO:tasks.workunit.client.0.smithi073.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:50:04.269 INFO:tasks.workunit.client.0.smithi073.stderr: 7f51837fe640 / http_manager 2024-09-12T00:50:04.269 INFO:tasks.workunit.client.0.smithi073.stderr: 7f5211fdb640 / http_manager 2024-09-12T00:50:04.269 INFO:tasks.workunit.client.0.smithi073.stderr: 7f5212fdd640 / rgw_dt_lg_renew 2024-09-12T00:50:04.269 INFO:tasks.workunit.client.0.smithi073.stderr: 7f5231ffb640 / ms_dispatch 2024-09-12T00:50:04.270 INFO:tasks.workunit.client.0.smithi073.stderr: 7f52337fe640 / io_context_pool 2024-09-12T00:50:04.270 INFO:tasks.workunit.client.0.smithi073.stderr: 7f5241ffb640 / ms_dispatch 2024-09-12T00:50:04.270 INFO:tasks.workunit.client.0.smithi073.stderr: 7f5248e09640 / ms_dispatch 2024-09-12T00:50:04.270 INFO:tasks.workunit.client.0.smithi073.stderr: 7f524a60c640 / io_context_pool 2024-09-12T00:50:04.270 INFO:tasks.workunit.client.0.smithi073.stderr: 7f5353981640 / msgr-worker-2 2024-09-12T00:50:04.270 INFO:tasks.workunit.client.0.smithi073.stderr: 7f535c182640 / msgr-worker-1 2024-09-12T00:50:04.270 INFO:tasks.workunit.client.0.smithi073.stderr: 7f535c983640 / msgr-worker-0 2024-09-12T00:50:04.270 INFO:tasks.workunit.client.0.smithi073.stderr: 7f535d184640 / io_context_pool 2024-09-12T00:50:04.270 INFO:tasks.workunit.client.0.smithi073.stderr: 7f535e698800 / radosgw-admin 2024-09-12T00:50:04.270 INFO:tasks.workunit.client.0.smithi073.stderr: max_recent 500 2024-09-12T00:50:04.270 INFO:tasks.workunit.client.0.smithi073.stderr: max_new 1000 2024-09-12T00:50:04.270 INFO:tasks.workunit.client.0.smithi073.stderr: log_file /var/log/ceph/ceph-client.admin.107181.log 2024-09-12T00:50:04.270 INFO:tasks.workunit.client.0.smithi073.stderr:--- end dump of recent events --- 2024-09-12T00:50:04.271 INFO:tasks.workunit.client.0.smithi073.stderr:--- begin dump of recent events --- 2024-09-12T00:50:04.271 INFO:tasks.workunit.client.0.smithi073.stderr: -499> 2024-09-12T00:50:03.939+0000 7f535e698800 5 monclient: authenticate success, global_id 6521 2024-09-12T00:50:04.271 INFO:tasks.workunit.client.0.smithi073.stderr: -498> 2024-09-12T00:50:03.939+0000 7f535e698800 10 monclient: get_monmap_and_config success 2024-09-12T00:50:04.271 INFO:tasks.workunit.client.0.smithi073.stderr: -497> 2024-09-12T00:50:03.939+0000 7f535e698800 4 set_mon_vals no callback set 2024-09-12T00:50:04.271 INFO:tasks.workunit.client.0.smithi073.stderr: -496> 2024-09-12T00:50:03.940+0000 7f535e698800 10 monclient: shutdown 2024-09-12T00:50:04.271 INFO:tasks.workunit.client.0.smithi073.stderr: -495> 2024-09-12T00:50:03.940+0000 7f535e698800 5 asok(0x55b397f35630) unregister_commands rotate-key 2024-09-12T00:50:04.271 INFO:tasks.workunit.client.0.smithi073.stderr: -494> 2024-09-12T00:50:03.940+0000 7f535e698800 10 monclient: build_initial_monmap 2024-09-12T00:50:04.271 INFO:tasks.workunit.client.0.smithi073.stderr: -493> 2024-09-12T00:50:03.940+0000 7f535e698800 1 build_initial for_mkfs: 0 2024-09-12T00:50:04.271 INFO:tasks.workunit.client.0.smithi073.stderr: -492> 2024-09-12T00:50:03.940+0000 7f535e698800 10 monclient: monmap: 2024-09-12T00:50:04.271 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:50:04.271 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:04.271 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:50:04.271 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:50:04.271 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:04.272 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:50:04.272 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:50:04.272 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:50:04.272 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:50:04.272 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:04.272 INFO:tasks.workunit.client.0.smithi073.stderr: -491> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b39815da50) adding auth protocol: cephx 2024-09-12T00:50:04.272 INFO:tasks.workunit.client.0.smithi073.stderr: -490> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b39815da50) adding auth protocol: cephx 2024-09-12T00:50:04.272 INFO:tasks.workunit.client.0.smithi073.stderr: -489> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b39815da50) adding auth protocol: cephx 2024-09-12T00:50:04.272 INFO:tasks.workunit.client.0.smithi073.stderr: -488> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b39815da50) adding con mode: secure 2024-09-12T00:50:04.272 INFO:tasks.workunit.client.0.smithi073.stderr: -487> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b39815da50) adding con mode: crc 2024-09-12T00:50:04.272 INFO:tasks.workunit.client.0.smithi073.stderr: -486> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b39815da50) adding con mode: secure 2024-09-12T00:50:04.272 INFO:tasks.workunit.client.0.smithi073.stderr: -485> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b39815da50) adding con mode: crc 2024-09-12T00:50:04.272 INFO:tasks.workunit.client.0.smithi073.stderr: -484> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b39815da50) adding con mode: secure 2024-09-12T00:50:04.273 INFO:tasks.workunit.client.0.smithi073.stderr: -483> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b39815da50) adding con mode: crc 2024-09-12T00:50:04.273 INFO:tasks.workunit.client.0.smithi073.stderr: -482> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b39815da50) adding con mode: crc 2024-09-12T00:50:04.273 INFO:tasks.workunit.client.0.smithi073.stderr: -481> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b39815da50) adding con mode: secure 2024-09-12T00:50:04.273 INFO:tasks.workunit.client.0.smithi073.stderr: -480> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b39815da50) adding con mode: crc 2024-09-12T00:50:04.273 INFO:tasks.workunit.client.0.smithi073.stderr: -479> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b39815da50) adding con mode: secure 2024-09-12T00:50:04.273 INFO:tasks.workunit.client.0.smithi073.stderr: -478> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b39815da50) adding con mode: crc 2024-09-12T00:50:04.273 INFO:tasks.workunit.client.0.smithi073.stderr: -477> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b39815da50) adding con mode: secure 2024-09-12T00:50:04.273 INFO:tasks.workunit.client.0.smithi073.stderr: -476> 2024-09-12T00:50:03.940+0000 7f535e698800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:04.273 INFO:tasks.workunit.client.0.smithi073.stderr: -475> 2024-09-12T00:50:03.940+0000 7f535e698800 1 librados: starting msgr at 2024-09-12T00:50:04.273 INFO:tasks.workunit.client.0.smithi073.stderr: -474> 2024-09-12T00:50:03.940+0000 7f535e698800 1 librados: starting objecter 2024-09-12T00:50:04.273 INFO:tasks.workunit.client.0.smithi073.stderr: -473> 2024-09-12T00:50:03.940+0000 7f535e698800 5 asok(0x55b397f35630) register_command objecter_requests hook 0x55b398189320 2024-09-12T00:50:04.273 INFO:tasks.workunit.client.0.smithi073.stderr: -472> 2024-09-12T00:50:03.940+0000 7f535e698800 1 librados: setting wanted keys 2024-09-12T00:50:04.273 INFO:tasks.workunit.client.0.smithi073.stderr: -471> 2024-09-12T00:50:03.940+0000 7f535e698800 1 librados: calling monclient init 2024-09-12T00:50:04.273 INFO:tasks.workunit.client.0.smithi073.stderr: -470> 2024-09-12T00:50:03.940+0000 7f535e698800 10 monclient: init 2024-09-12T00:50:04.274 INFO:tasks.workunit.client.0.smithi073.stderr: -469> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b398157e20) adding auth protocol: cephx 2024-09-12T00:50:04.274 INFO:tasks.workunit.client.0.smithi073.stderr: -468> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b398157e20) adding auth protocol: cephx 2024-09-12T00:50:04.274 INFO:tasks.workunit.client.0.smithi073.stderr: -467> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b398157e20) adding auth protocol: cephx 2024-09-12T00:50:04.274 INFO:tasks.workunit.client.0.smithi073.stderr: -466> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b398157e20) adding con mode: secure 2024-09-12T00:50:04.274 INFO:tasks.workunit.client.0.smithi073.stderr: -465> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b398157e20) adding con mode: crc 2024-09-12T00:50:04.274 INFO:tasks.workunit.client.0.smithi073.stderr: -464> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b398157e20) adding con mode: secure 2024-09-12T00:50:04.274 INFO:tasks.workunit.client.0.smithi073.stderr: -463> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b398157e20) adding con mode: crc 2024-09-12T00:50:04.274 INFO:tasks.workunit.client.0.smithi073.stderr: -462> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b398157e20) adding con mode: secure 2024-09-12T00:50:04.274 INFO:tasks.workunit.client.0.smithi073.stderr: -461> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b398157e20) adding con mode: crc 2024-09-12T00:50:04.274 INFO:tasks.workunit.client.0.smithi073.stderr: -460> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b398157e20) adding con mode: crc 2024-09-12T00:50:04.274 INFO:tasks.workunit.client.0.smithi073.stderr: -459> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b398157e20) adding con mode: secure 2024-09-12T00:50:04.274 INFO:tasks.workunit.client.0.smithi073.stderr: -458> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b398157e20) adding con mode: crc 2024-09-12T00:50:04.274 INFO:tasks.workunit.client.0.smithi073.stderr: -457> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b398157e20) adding con mode: secure 2024-09-12T00:50:04.275 INFO:tasks.workunit.client.0.smithi073.stderr: -456> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b398157e20) adding con mode: crc 2024-09-12T00:50:04.275 INFO:tasks.workunit.client.0.smithi073.stderr: -455> 2024-09-12T00:50:03.940+0000 7f535e698800 5 AuthRegistry(0x55b398157e20) adding con mode: secure 2024-09-12T00:50:04.275 INFO:tasks.workunit.client.0.smithi073.stderr: -454> 2024-09-12T00:50:03.940+0000 7f535e698800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:04.275 INFO:tasks.workunit.client.0.smithi073.stderr: -453> 2024-09-12T00:50:03.941+0000 7f535e698800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:04.275 INFO:tasks.workunit.client.0.smithi073.stderr: -452> 2024-09-12T00:50:03.941+0000 7f535e698800 5 asok(0x55b397f35630) register_command rotate-key hook 0x55b398157f68 2024-09-12T00:50:04.275 INFO:tasks.workunit.client.0.smithi073.stderr: -451> 2024-09-12T00:50:03.941+0000 7f535e698800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:04.275 INFO:tasks.workunit.client.0.smithi073.stderr: -450> 2024-09-12T00:50:03.941+0000 7f535e698800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:50:04.275 INFO:tasks.workunit.client.0.smithi073.stderr: -449> 2024-09-12T00:50:03.941+0000 7f535e698800 10 monclient(hunting): picked mon.noname-b con 0x55b398001100 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:50:04.275 INFO:tasks.workunit.client.0.smithi073.stderr: -448> 2024-09-12T00:50:03.941+0000 7f535e698800 10 monclient(hunting): picked mon.noname-a con 0x55b39800dda0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:50:04.275 INFO:tasks.workunit.client.0.smithi073.stderr: -447> 2024-09-12T00:50:03.941+0000 7f535e698800 10 monclient(hunting): picked mon.noname-c con 0x55b39809b030 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:50:04.275 INFO:tasks.workunit.client.0.smithi073.stderr: -446> 2024-09-12T00:50:03.941+0000 7f535e698800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:04.275 INFO:tasks.workunit.client.0.smithi073.stderr: -445> 2024-09-12T00:50:03.941+0000 7f535e698800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:04.275 INFO:tasks.workunit.client.0.smithi073.stderr: -444> 2024-09-12T00:50:03.941+0000 7f535e698800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:04.275 INFO:tasks.workunit.client.0.smithi073.stderr: -443> 2024-09-12T00:50:03.941+0000 7f535e698800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:04.276 INFO:tasks.workunit.client.0.smithi073.stderr: -442> 2024-09-12T00:50:03.941+0000 7f535e698800 10 monclient(hunting): authenticate will time out at 2064.611284s 2024-09-12T00:50:04.276 INFO:tasks.workunit.client.0.smithi073.stderr: -441> 2024-09-12T00:50:03.941+0000 7f5353981640 10 monclient(hunting): get_auth_request con 0x55b39800dda0 auth_method 0 2024-09-12T00:50:04.276 INFO:tasks.workunit.client.0.smithi073.stderr: -440> 2024-09-12T00:50:03.941+0000 7f5353981640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:04.276 INFO:tasks.workunit.client.0.smithi073.stderr: -439> 2024-09-12T00:50:03.941+0000 7f5353981640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:04.276 INFO:tasks.workunit.client.0.smithi073.stderr: -438> 2024-09-12T00:50:03.941+0000 7f5353981640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:04.276 INFO:tasks.workunit.client.0.smithi073.stderr: -437> 2024-09-12T00:50:03.941+0000 7f535c983640 10 monclient(hunting): get_auth_request con 0x55b39809b030 auth_method 0 2024-09-12T00:50:04.276 INFO:tasks.workunit.client.0.smithi073.stderr: -436> 2024-09-12T00:50:03.941+0000 7f535c983640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:04.276 INFO:tasks.workunit.client.0.smithi073.stderr: -435> 2024-09-12T00:50:03.941+0000 7f535c983640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:04.276 INFO:tasks.workunit.client.0.smithi073.stderr: -434> 2024-09-12T00:50:03.941+0000 7f535c983640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:04.276 INFO:tasks.workunit.client.0.smithi073.stderr: -433> 2024-09-12T00:50:03.941+0000 7f5353981640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:04.276 INFO:tasks.workunit.client.0.smithi073.stderr: -432> 2024-09-12T00:50:03.941+0000 7f5353981640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:04.276 INFO:tasks.workunit.client.0.smithi073.stderr: -431> 2024-09-12T00:50:03.941+0000 7f5353981640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:04.276 INFO:tasks.workunit.client.0.smithi073.stderr: -430> 2024-09-12T00:50:03.941+0000 7f535c182640 10 monclient(hunting): get_auth_request con 0x55b398001100 auth_method 0 2024-09-12T00:50:04.277 INFO:tasks.workunit.client.0.smithi073.stderr: -429> 2024-09-12T00:50:03.941+0000 7f535c182640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:04.277 INFO:tasks.workunit.client.0.smithi073.stderr: -428> 2024-09-12T00:50:03.941+0000 7f535c182640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:04.277 INFO:tasks.workunit.client.0.smithi073.stderr: -427> 2024-09-12T00:50:03.941+0000 7f535c182640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:04.277 INFO:tasks.workunit.client.0.smithi073.stderr: -426> 2024-09-12T00:50:03.941+0000 7f535c983640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:04.277 INFO:tasks.workunit.client.0.smithi073.stderr: -425> 2024-09-12T00:50:03.941+0000 7f535c983640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:04.277 INFO:tasks.workunit.client.0.smithi073.stderr: -424> 2024-09-12T00:50:03.941+0000 7f535c983640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:04.277 INFO:tasks.workunit.client.0.smithi073.stderr: -423> 2024-09-12T00:50:03.941+0000 7f535c182640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:04.277 INFO:tasks.workunit.client.0.smithi073.stderr: -422> 2024-09-12T00:50:03.941+0000 7f535c182640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:04.277 INFO:tasks.workunit.client.0.smithi073.stderr: -421> 2024-09-12T00:50:03.941+0000 7f535c182640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:04.277 INFO:tasks.workunit.client.0.smithi073.stderr: -420> 2024-09-12T00:50:03.941+0000 7f5353981640 10 monclient(hunting): handle_auth_done global_id 6888 payload 824 2024-09-12T00:50:04.277 INFO:tasks.workunit.client.0.smithi073.stderr: -419> 2024-09-12T00:50:03.941+0000 7f5353981640 10 monclient: _finish_hunting 0 2024-09-12T00:50:04.277 INFO:tasks.workunit.client.0.smithi073.stderr: -418> 2024-09-12T00:50:03.941+0000 7f5353981640 1 monclient: found mon.noname-a 2024-09-12T00:50:04.277 INFO:tasks.workunit.client.0.smithi073.stderr: -417> 2024-09-12T00:50:03.941+0000 7f5353981640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:50:04.277 INFO:tasks.workunit.client.0.smithi073.stderr: -416> 2024-09-12T00:50:03.941+0000 7f5248e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:04.278 INFO:tasks.workunit.client.0.smithi073.stderr: -415> 2024-09-12T00:50:03.941+0000 7f5248e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:50:04.278 INFO:tasks.workunit.client.0.smithi073.stderr: -414> 2024-09-12T00:50:03.941+0000 7f5248e09640 10 monclient: dump: 2024-09-12T00:50:04.278 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:50:04.278 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:50:04.278 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:04.278 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:04.278 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:04.278 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:50:04.278 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:50:04.278 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:50:04.278 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:50:04.278 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:04.278 INFO:tasks.workunit.client.0.smithi073.stderr: -413> 2024-09-12T00:50:03.941+0000 7f5248e09640 10 monclient: _finish_auth 0 2024-09-12T00:50:04.278 INFO:tasks.workunit.client.0.smithi073.stderr: -412> 2024-09-12T00:50:03.941+0000 7f5248e09640 10 monclient: _check_auth_tickets 2024-09-12T00:50:04.279 INFO:tasks.workunit.client.0.smithi073.stderr: -411> 2024-09-12T00:50:03.941+0000 7f535e698800 5 monclient: authenticate success, global_id 6888 2024-09-12T00:50:04.279 INFO:tasks.workunit.client.0.smithi073.stderr: -410> 2024-09-12T00:50:03.941+0000 7f535e698800 10 monclient: _renew_subs 2024-09-12T00:50:04.279 INFO:tasks.workunit.client.0.smithi073.stderr: -409> 2024-09-12T00:50:03.941+0000 7f535e698800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:50:04.279 INFO:tasks.workunit.client.0.smithi073.stderr: -408> 2024-09-12T00:50:03.941+0000 7f5248e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:04.279 INFO:tasks.workunit.client.0.smithi073.stderr: -407> 2024-09-12T00:50:03.941+0000 7f5248e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:04.279 INFO:tasks.workunit.client.0.smithi073.stderr: -406> 2024-09-12T00:50:03.941+0000 7f5248e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:50:04.279 INFO:tasks.workunit.client.0.smithi073.stderr: -405> 2024-09-12T00:50:03.941+0000 7f5248e09640 10 monclient: dump: 2024-09-12T00:50:04.279 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:50:04.279 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:50:04.279 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:04.279 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:04.279 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:04.279 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:50:04.280 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:50:04.280 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:50:04.280 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:50:04.280 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:04.280 INFO:tasks.workunit.client.0.smithi073.stderr: -404> 2024-09-12T00:50:03.941+0000 7f524a60c640 4 set_mon_vals no callback set 2024-09-12T00:50:04.280 INFO:tasks.workunit.client.0.smithi073.stderr: -403> 2024-09-12T00:50:03.942+0000 7f535e698800 10 monclient: _renew_subs 2024-09-12T00:50:04.280 INFO:tasks.workunit.client.0.smithi073.stderr: -402> 2024-09-12T00:50:03.942+0000 7f535e698800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:50:04.280 INFO:tasks.workunit.client.0.smithi073.stderr: -401> 2024-09-12T00:50:03.942+0000 7f535e698800 1 librados: init done 2024-09-12T00:50:04.280 INFO:tasks.workunit.client.0.smithi073.stderr: -400> 2024-09-12T00:50:03.943+0000 7f5248e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:50:04.280 INFO:tasks.workunit.client.0.smithi073.stderr: -399> 2024-09-12T00:50:03.943+0000 7f5248e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:50:04.280 INFO:tasks.workunit.client.0.smithi073.stderr: -398> 2024-09-12T00:50:03.943+0000 7f5248e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:50:04.280 INFO:tasks.workunit.client.0.smithi073.stderr: -397> 2024-09-12T00:50:03.944+0000 7f535c182640 10 monclient: get_auth_request con 0x7f52440764a0 auth_method 0 2024-09-12T00:50:04.280 INFO:tasks.workunit.client.0.smithi073.stderr: -396> 2024-09-12T00:50:03.944+0000 7f535c983640 10 monclient: get_auth_request con 0x55b3981a06e0 auth_method 0 2024-09-12T00:50:04.280 INFO:tasks.workunit.client.0.smithi073.stderr: -395> 2024-09-12T00:50:03.945+0000 7f535c182640 10 monclient: get_auth_request con 0x55b3981a38c0 auth_method 0 2024-09-12T00:50:04.281 INFO:tasks.workunit.client.0.smithi073.stderr: -394> 2024-09-12T00:50:03.946+0000 7f5353981640 10 monclient: get_auth_request con 0x55b3981a7ab0 auth_method 0 2024-09-12T00:50:04.281 INFO:tasks.workunit.client.0.smithi073.stderr: -393> 2024-09-12T00:50:03.947+0000 7f535e698800 10 monclient: build_initial_monmap 2024-09-12T00:50:04.281 INFO:tasks.workunit.client.0.smithi073.stderr: -392> 2024-09-12T00:50:03.947+0000 7f535e698800 1 build_initial for_mkfs: 0 2024-09-12T00:50:04.281 INFO:tasks.workunit.client.0.smithi073.stderr: -391> 2024-09-12T00:50:03.947+0000 7f535e698800 10 monclient: monmap: 2024-09-12T00:50:04.281 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:50:04.281 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:04.281 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:50:04.281 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:50:04.281 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:04.281 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:50:04.281 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:50:04.281 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:50:04.281 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:50:04.282 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:04.282 INFO:tasks.workunit.client.0.smithi073.stderr: -390> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981ac8e0) adding auth protocol: cephx 2024-09-12T00:50:04.282 INFO:tasks.workunit.client.0.smithi073.stderr: -389> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981ac8e0) adding auth protocol: cephx 2024-09-12T00:50:04.282 INFO:tasks.workunit.client.0.smithi073.stderr: -388> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981ac8e0) adding auth protocol: cephx 2024-09-12T00:50:04.282 INFO:tasks.workunit.client.0.smithi073.stderr: -387> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981ac8e0) adding con mode: secure 2024-09-12T00:50:04.282 INFO:tasks.workunit.client.0.smithi073.stderr: -386> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981ac8e0) adding con mode: crc 2024-09-12T00:50:04.282 INFO:tasks.workunit.client.0.smithi073.stderr: -385> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981ac8e0) adding con mode: secure 2024-09-12T00:50:04.282 INFO:tasks.workunit.client.0.smithi073.stderr: -384> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981ac8e0) adding con mode: crc 2024-09-12T00:50:04.282 INFO:tasks.workunit.client.0.smithi073.stderr: -383> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981ac8e0) adding con mode: secure 2024-09-12T00:50:04.282 INFO:tasks.workunit.client.0.smithi073.stderr: -382> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981ac8e0) adding con mode: crc 2024-09-12T00:50:04.282 INFO:tasks.workunit.client.0.smithi073.stderr: -381> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981ac8e0) adding con mode: crc 2024-09-12T00:50:04.282 INFO:tasks.workunit.client.0.smithi073.stderr: -380> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981ac8e0) adding con mode: secure 2024-09-12T00:50:04.282 INFO:tasks.workunit.client.0.smithi073.stderr: -379> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981ac8e0) adding con mode: crc 2024-09-12T00:50:04.282 INFO:tasks.workunit.client.0.smithi073.stderr: -378> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981ac8e0) adding con mode: secure 2024-09-12T00:50:04.283 INFO:tasks.workunit.client.0.smithi073.stderr: -377> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981ac8e0) adding con mode: crc 2024-09-12T00:50:04.283 INFO:tasks.workunit.client.0.smithi073.stderr: -376> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981ac8e0) adding con mode: secure 2024-09-12T00:50:04.283 INFO:tasks.workunit.client.0.smithi073.stderr: -375> 2024-09-12T00:50:03.947+0000 7f535e698800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:04.283 INFO:tasks.workunit.client.0.smithi073.stderr: -374> 2024-09-12T00:50:03.947+0000 7f535e698800 5 asok(0x55b397f35630) register_command objecter_requests cmddesc objecter_requests hook 0x55b3981b0370 EEXIST 2024-09-12T00:50:04.283 INFO:tasks.workunit.client.0.smithi073.stderr: -373> 2024-09-12T00:50:03.947+0000 7f535e698800 10 monclient: init 2024-09-12T00:50:04.283 INFO:tasks.workunit.client.0.smithi073.stderr: -372> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981aafb8) adding auth protocol: cephx 2024-09-12T00:50:04.283 INFO:tasks.workunit.client.0.smithi073.stderr: -371> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981aafb8) adding auth protocol: cephx 2024-09-12T00:50:04.283 INFO:tasks.workunit.client.0.smithi073.stderr: -370> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981aafb8) adding auth protocol: cephx 2024-09-12T00:50:04.283 INFO:tasks.workunit.client.0.smithi073.stderr: -369> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981aafb8) adding con mode: secure 2024-09-12T00:50:04.283 INFO:tasks.workunit.client.0.smithi073.stderr: -368> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981aafb8) adding con mode: crc 2024-09-12T00:50:04.283 INFO:tasks.workunit.client.0.smithi073.stderr: -367> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981aafb8) adding con mode: secure 2024-09-12T00:50:04.283 INFO:tasks.workunit.client.0.smithi073.stderr: -366> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981aafb8) adding con mode: crc 2024-09-12T00:50:04.283 INFO:tasks.workunit.client.0.smithi073.stderr: -365> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981aafb8) adding con mode: secure 2024-09-12T00:50:04.284 INFO:tasks.workunit.client.0.smithi073.stderr: -364> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981aafb8) adding con mode: crc 2024-09-12T00:50:04.284 INFO:tasks.workunit.client.0.smithi073.stderr: -363> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981aafb8) adding con mode: crc 2024-09-12T00:50:04.284 INFO:tasks.workunit.client.0.smithi073.stderr: -362> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981aafb8) adding con mode: secure 2024-09-12T00:50:04.284 INFO:tasks.workunit.client.0.smithi073.stderr: -361> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981aafb8) adding con mode: crc 2024-09-12T00:50:04.284 INFO:tasks.workunit.client.0.smithi073.stderr: -360> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981aafb8) adding con mode: secure 2024-09-12T00:50:04.284 INFO:tasks.workunit.client.0.smithi073.stderr: -359> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981aafb8) adding con mode: crc 2024-09-12T00:50:04.284 INFO:tasks.workunit.client.0.smithi073.stderr: -358> 2024-09-12T00:50:03.947+0000 7f535e698800 5 AuthRegistry(0x55b3981aafb8) adding con mode: secure 2024-09-12T00:50:04.284 INFO:tasks.workunit.client.0.smithi073.stderr: -357> 2024-09-12T00:50:03.948+0000 7f535e698800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:04.284 INFO:tasks.workunit.client.0.smithi073.stderr: -356> 2024-09-12T00:50:03.948+0000 7f535e698800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:04.284 INFO:tasks.workunit.client.0.smithi073.stderr: -355> 2024-09-12T00:50:03.948+0000 7f535e698800 5 asok(0x55b397f35630) register_command rotate-key cmddesc rotate-key hook 0x55b3981ab100 EEXIST 2024-09-12T00:50:04.284 INFO:tasks.workunit.client.0.smithi073.stderr: -354> 2024-09-12T00:50:03.948+0000 7f535e698800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:04.284 INFO:tasks.workunit.client.0.smithi073.stderr: -353> 2024-09-12T00:50:03.948+0000 7f535e698800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:50:04.284 INFO:tasks.workunit.client.0.smithi073.stderr: -352> 2024-09-12T00:50:03.948+0000 7f535e698800 10 monclient(hunting): picked mon.noname-b con 0x55b3981d4060 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:50:04.285 INFO:tasks.workunit.client.0.smithi073.stderr: -351> 2024-09-12T00:50:03.948+0000 7f535e698800 10 monclient(hunting): picked mon.noname-c con 0x55b3981d6330 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:50:04.285 INFO:tasks.workunit.client.0.smithi073.stderr: -350> 2024-09-12T00:50:03.948+0000 7f535e698800 10 monclient(hunting): picked mon.noname-a con 0x55b3981d2830 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:50:04.285 INFO:tasks.workunit.client.0.smithi073.stderr: -349> 2024-09-12T00:50:03.948+0000 7f535e698800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:04.285 INFO:tasks.workunit.client.0.smithi073.stderr: -348> 2024-09-12T00:50:03.948+0000 7f535e698800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:04.285 INFO:tasks.workunit.client.0.smithi073.stderr: -347> 2024-09-12T00:50:03.948+0000 7f535e698800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:04.285 INFO:tasks.workunit.client.0.smithi073.stderr: -346> 2024-09-12T00:50:03.948+0000 7f535e698800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:04.285 INFO:tasks.workunit.client.0.smithi073.stderr: -345> 2024-09-12T00:50:03.948+0000 7f535e698800 10 monclient(hunting): authenticate will time out at 2064.618329s 2024-09-12T00:50:04.285 INFO:tasks.workunit.client.0.smithi073.stderr: -344> 2024-09-12T00:50:03.948+0000 7f5353981640 10 monclient(hunting): get_auth_request con 0x55b3981d6330 auth_method 0 2024-09-12T00:50:04.285 INFO:tasks.workunit.client.0.smithi073.stderr: -343> 2024-09-12T00:50:03.948+0000 7f5353981640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:04.285 INFO:tasks.workunit.client.0.smithi073.stderr: -342> 2024-09-12T00:50:03.948+0000 7f5353981640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:04.285 INFO:tasks.workunit.client.0.smithi073.stderr: -341> 2024-09-12T00:50:03.948+0000 7f5353981640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:04.285 INFO:tasks.workunit.client.0.smithi073.stderr: -340> 2024-09-12T00:50:03.948+0000 7f535c983640 10 monclient(hunting): get_auth_request con 0x55b3981d2830 auth_method 0 2024-09-12T00:50:04.285 INFO:tasks.workunit.client.0.smithi073.stderr: -339> 2024-09-12T00:50:03.948+0000 7f535c983640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:04.286 INFO:tasks.workunit.client.0.smithi073.stderr: -338> 2024-09-12T00:50:03.948+0000 7f535c983640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:04.286 INFO:tasks.workunit.client.0.smithi073.stderr: -337> 2024-09-12T00:50:03.948+0000 7f535c983640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:04.286 INFO:tasks.workunit.client.0.smithi073.stderr: -336> 2024-09-12T00:50:03.948+0000 7f5353981640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:04.286 INFO:tasks.workunit.client.0.smithi073.stderr: -335> 2024-09-12T00:50:03.948+0000 7f5353981640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:04.286 INFO:tasks.workunit.client.0.smithi073.stderr: -334> 2024-09-12T00:50:03.948+0000 7f5353981640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:04.286 INFO:tasks.workunit.client.0.smithi073.stderr: -333> 2024-09-12T00:50:03.948+0000 7f535c983640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:04.286 INFO:tasks.workunit.client.0.smithi073.stderr: -332> 2024-09-12T00:50:03.948+0000 7f535c983640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:04.286 INFO:tasks.workunit.client.0.smithi073.stderr: -331> 2024-09-12T00:50:03.948+0000 7f535c983640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:04.286 INFO:tasks.workunit.client.0.smithi073.stderr: -330> 2024-09-12T00:50:03.948+0000 7f535c182640 10 monclient(hunting): get_auth_request con 0x55b3981d4060 auth_method 0 2024-09-12T00:50:04.286 INFO:tasks.workunit.client.0.smithi073.stderr: -329> 2024-09-12T00:50:03.948+0000 7f535c182640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:04.286 INFO:tasks.workunit.client.0.smithi073.stderr: -328> 2024-09-12T00:50:03.948+0000 7f535c182640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:04.286 INFO:tasks.workunit.client.0.smithi073.stderr: -327> 2024-09-12T00:50:03.948+0000 7f535c182640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:04.286 INFO:tasks.workunit.client.0.smithi073.stderr: -326> 2024-09-12T00:50:03.948+0000 7f5353981640 10 monclient(hunting): handle_auth_done global_id 6527 payload 824 2024-09-12T00:50:04.287 INFO:tasks.workunit.client.0.smithi073.stderr: -325> 2024-09-12T00:50:03.948+0000 7f5353981640 10 monclient: _finish_hunting 0 2024-09-12T00:50:04.287 INFO:tasks.workunit.client.0.smithi073.stderr: -324> 2024-09-12T00:50:03.948+0000 7f5353981640 1 monclient: found mon.noname-c 2024-09-12T00:50:04.287 INFO:tasks.workunit.client.0.smithi073.stderr: -323> 2024-09-12T00:50:03.948+0000 7f5353981640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.73:3301/0 2024-09-12T00:50:04.287 INFO:tasks.workunit.client.0.smithi073.stderr: -322> 2024-09-12T00:50:03.948+0000 7f5241ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:04.287 INFO:tasks.workunit.client.0.smithi073.stderr: -321> 2024-09-12T00:50:03.948+0000 7f5241ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:50:04.287 INFO:tasks.workunit.client.0.smithi073.stderr: -320> 2024-09-12T00:50:03.948+0000 7f5241ffb640 10 monclient: dump: 2024-09-12T00:50:04.287 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:50:04.287 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:50:04.287 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:04.287 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:04.287 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:04.287 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:50:04.287 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:50:04.288 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:50:04.288 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:50:04.288 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:04.288 INFO:tasks.workunit.client.0.smithi073.stderr: -319> 2024-09-12T00:50:03.948+0000 7f5241ffb640 10 monclient: _finish_auth 0 2024-09-12T00:50:04.288 INFO:tasks.workunit.client.0.smithi073.stderr: -318> 2024-09-12T00:50:03.948+0000 7f5241ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:50:04.288 INFO:tasks.workunit.client.0.smithi073.stderr: -317> 2024-09-12T00:50:03.948+0000 7f5241ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:04.288 INFO:tasks.workunit.client.0.smithi073.stderr: -316> 2024-09-12T00:50:03.948+0000 7f5241ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:04.288 INFO:tasks.workunit.client.0.smithi073.stderr: -315> 2024-09-12T00:50:03.948+0000 7f5241ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:50:04.288 INFO:tasks.workunit.client.0.smithi073.stderr: -314> 2024-09-12T00:50:03.948+0000 7f5241ffb640 10 monclient: dump: 2024-09-12T00:50:04.288 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:50:04.288 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:50:04.288 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:04.288 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:04.289 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:04.289 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:50:04.289 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:50:04.289 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:50:04.289 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:50:04.289 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:04.289 INFO:tasks.workunit.client.0.smithi073.stderr: -313> 2024-09-12T00:50:03.948+0000 7f535e698800 5 monclient: authenticate success, global_id 6527 2024-09-12T00:50:04.289 INFO:tasks.workunit.client.0.smithi073.stderr: -312> 2024-09-12T00:50:03.948+0000 7f535d184640 4 set_mon_vals no callback set 2024-09-12T00:50:04.289 INFO:tasks.workunit.client.0.smithi073.stderr: -311> 2024-09-12T00:50:03.948+0000 7f535e698800 10 monclient: _renew_subs 2024-09-12T00:50:04.289 INFO:tasks.workunit.client.0.smithi073.stderr: -310> 2024-09-12T00:50:03.948+0000 7f535e698800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:50:04.289 INFO:tasks.workunit.client.0.smithi073.stderr: -309> 2024-09-12T00:50:03.949+0000 7f535e698800 10 monclient: _renew_subs 2024-09-12T00:50:04.289 INFO:tasks.workunit.client.0.smithi073.stderr: -308> 2024-09-12T00:50:03.949+0000 7f535e698800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:50:04.289 INFO:tasks.workunit.client.0.smithi073.stderr: -307> 2024-09-12T00:50:03.950+0000 7f5241ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:50:04.290 INFO:tasks.workunit.client.0.smithi073.stderr: -306> 2024-09-12T00:50:03.950+0000 7f5241ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:50:04.290 INFO:tasks.workunit.client.0.smithi073.stderr: -305> 2024-09-12T00:50:03.950+0000 7f5241ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:50:04.290 INFO:tasks.workunit.client.0.smithi073.stderr: -304> 2024-09-12T00:50:03.950+0000 7f535c182640 10 monclient: get_auth_request con 0x7f5234076380 auth_method 0 2024-09-12T00:50:04.290 INFO:tasks.workunit.client.0.smithi073.stderr: -303> 2024-09-12T00:50:03.951+0000 7f535e698800 10 monclient: get_monmap_and_config 2024-09-12T00:50:04.290 INFO:tasks.workunit.client.0.smithi073.stderr: -302> 2024-09-12T00:50:03.951+0000 7f535e698800 10 monclient: build_initial_monmap 2024-09-12T00:50:04.290 INFO:tasks.workunit.client.0.smithi073.stderr: -301> 2024-09-12T00:50:03.951+0000 7f535e698800 1 build_initial for_mkfs: 0 2024-09-12T00:50:04.290 INFO:tasks.workunit.client.0.smithi073.stderr: -300> 2024-09-12T00:50:03.951+0000 7f535e698800 10 monclient: monmap: 2024-09-12T00:50:04.290 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:50:04.290 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:04.290 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:50:04.290 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:50:04.290 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:04.290 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:50:04.290 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:50:04.291 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:50:04.291 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:50:04.291 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:04.291 INFO:tasks.workunit.client.0.smithi073.stderr: -299> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x55b3981f3850) adding auth protocol: cephx 2024-09-12T00:50:04.291 INFO:tasks.workunit.client.0.smithi073.stderr: -298> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x55b3981f3850) adding auth protocol: cephx 2024-09-12T00:50:04.291 INFO:tasks.workunit.client.0.smithi073.stderr: -297> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x55b3981f3850) adding auth protocol: cephx 2024-09-12T00:50:04.291 INFO:tasks.workunit.client.0.smithi073.stderr: -296> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x55b3981f3850) adding con mode: secure 2024-09-12T00:50:04.291 INFO:tasks.workunit.client.0.smithi073.stderr: -295> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x55b3981f3850) adding con mode: crc 2024-09-12T00:50:04.291 INFO:tasks.workunit.client.0.smithi073.stderr: -294> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x55b3981f3850) adding con mode: secure 2024-09-12T00:50:04.291 INFO:tasks.workunit.client.0.smithi073.stderr: -293> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x55b3981f3850) adding con mode: crc 2024-09-12T00:50:04.291 INFO:tasks.workunit.client.0.smithi073.stderr: -292> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x55b3981f3850) adding con mode: secure 2024-09-12T00:50:04.291 INFO:tasks.workunit.client.0.smithi073.stderr: -291> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x55b3981f3850) adding con mode: crc 2024-09-12T00:50:04.291 INFO:tasks.workunit.client.0.smithi073.stderr: -290> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x55b3981f3850) adding con mode: crc 2024-09-12T00:50:04.292 INFO:tasks.workunit.client.0.smithi073.stderr: -289> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x55b3981f3850) adding con mode: secure 2024-09-12T00:50:04.292 INFO:tasks.workunit.client.0.smithi073.stderr: -288> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x55b3981f3850) adding con mode: crc 2024-09-12T00:50:04.292 INFO:tasks.workunit.client.0.smithi073.stderr: -287> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x55b3981f3850) adding con mode: secure 2024-09-12T00:50:04.292 INFO:tasks.workunit.client.0.smithi073.stderr: -286> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x55b3981f3850) adding con mode: crc 2024-09-12T00:50:04.292 INFO:tasks.workunit.client.0.smithi073.stderr: -285> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x55b3981f3850) adding con mode: secure 2024-09-12T00:50:04.292 INFO:tasks.workunit.client.0.smithi073.stderr: -284> 2024-09-12T00:50:03.951+0000 7f535e698800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:04.292 INFO:tasks.workunit.client.0.smithi073.stderr: -283> 2024-09-12T00:50:03.951+0000 7f535e698800 10 monclient: init 2024-09-12T00:50:04.292 INFO:tasks.workunit.client.0.smithi073.stderr: -282> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a68c0) adding auth protocol: cephx 2024-09-12T00:50:04.292 INFO:tasks.workunit.client.0.smithi073.stderr: -281> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a68c0) adding auth protocol: cephx 2024-09-12T00:50:04.292 INFO:tasks.workunit.client.0.smithi073.stderr: -280> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a68c0) adding auth protocol: cephx 2024-09-12T00:50:04.292 INFO:tasks.workunit.client.0.smithi073.stderr: -279> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a68c0) adding con mode: secure 2024-09-12T00:50:04.292 INFO:tasks.workunit.client.0.smithi073.stderr: -278> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a68c0) adding con mode: crc 2024-09-12T00:50:04.292 INFO:tasks.workunit.client.0.smithi073.stderr: -277> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a68c0) adding con mode: secure 2024-09-12T00:50:04.292 INFO:tasks.workunit.client.0.smithi073.stderr: -276> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a68c0) adding con mode: crc 2024-09-12T00:50:04.293 INFO:tasks.workunit.client.0.smithi073.stderr: -275> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a68c0) adding con mode: secure 2024-09-12T00:50:04.293 INFO:tasks.workunit.client.0.smithi073.stderr: -274> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a68c0) adding con mode: crc 2024-09-12T00:50:04.293 INFO:tasks.workunit.client.0.smithi073.stderr: -273> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a68c0) adding con mode: crc 2024-09-12T00:50:04.293 INFO:tasks.workunit.client.0.smithi073.stderr: -272> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a68c0) adding con mode: secure 2024-09-12T00:50:04.293 INFO:tasks.workunit.client.0.smithi073.stderr: -271> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a68c0) adding con mode: crc 2024-09-12T00:50:04.293 INFO:tasks.workunit.client.0.smithi073.stderr: -270> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a68c0) adding con mode: secure 2024-09-12T00:50:04.293 INFO:tasks.workunit.client.0.smithi073.stderr: -269> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a68c0) adding con mode: crc 2024-09-12T00:50:04.293 INFO:tasks.workunit.client.0.smithi073.stderr: -268> 2024-09-12T00:50:03.951+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a68c0) adding con mode: secure 2024-09-12T00:50:04.293 INFO:tasks.workunit.client.0.smithi073.stderr: -267> 2024-09-12T00:50:03.951+0000 7f535e698800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:04.293 INFO:tasks.workunit.client.0.smithi073.stderr: -266> 2024-09-12T00:50:03.951+0000 7f535e698800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:04.293 INFO:tasks.workunit.client.0.smithi073.stderr: -265> 2024-09-12T00:50:03.951+0000 7f535e698800 5 asok(0x55b397f35630) register_command rotate-key cmddesc rotate-key hook 0x7ffd7b1a6a08 EEXIST 2024-09-12T00:50:04.293 INFO:tasks.workunit.client.0.smithi073.stderr: -264> 2024-09-12T00:50:03.951+0000 7f535e698800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:04.293 INFO:tasks.workunit.client.0.smithi073.stderr: -263> 2024-09-12T00:50:03.951+0000 7f535e698800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:50:04.293 INFO:tasks.workunit.client.0.smithi073.stderr: -262> 2024-09-12T00:50:03.951+0000 7f535e698800 10 monclient(hunting): picked mon.noname-c con 0x55b398227d80 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:50:04.294 INFO:tasks.workunit.client.0.smithi073.stderr: -261> 2024-09-12T00:50:03.952+0000 7f535e698800 10 monclient(hunting): picked mon.noname-a con 0x55b3981f78e0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:50:04.294 INFO:tasks.workunit.client.0.smithi073.stderr: -260> 2024-09-12T00:50:03.952+0000 7f535e698800 10 monclient(hunting): picked mon.noname-b con 0x55b3981f4810 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:50:04.294 INFO:tasks.workunit.client.0.smithi073.stderr: -259> 2024-09-12T00:50:03.952+0000 7f535e698800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:04.294 INFO:tasks.workunit.client.0.smithi073.stderr: -258> 2024-09-12T00:50:03.952+0000 7f535e698800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:04.294 INFO:tasks.workunit.client.0.smithi073.stderr: -257> 2024-09-12T00:50:03.952+0000 7f535e698800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:04.294 INFO:tasks.workunit.client.0.smithi073.stderr: -256> 2024-09-12T00:50:03.952+0000 7f535e698800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:04.294 INFO:tasks.workunit.client.0.smithi073.stderr: -255> 2024-09-12T00:50:03.952+0000 7f535e698800 10 monclient(hunting): authenticate will time out at 2064.622036s 2024-09-12T00:50:04.294 INFO:tasks.workunit.client.0.smithi073.stderr: -254> 2024-09-12T00:50:03.952+0000 7f535c182640 10 monclient(hunting): get_auth_request con 0x55b398227d80 auth_method 0 2024-09-12T00:50:04.294 INFO:tasks.workunit.client.0.smithi073.stderr: -253> 2024-09-12T00:50:03.952+0000 7f535c182640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:04.294 INFO:tasks.workunit.client.0.smithi073.stderr: -252> 2024-09-12T00:50:03.952+0000 7f535c182640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:04.294 INFO:tasks.workunit.client.0.smithi073.stderr: -251> 2024-09-12T00:50:03.952+0000 7f535c182640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:04.294 INFO:tasks.workunit.client.0.smithi073.stderr: -250> 2024-09-12T00:50:03.952+0000 7f5353981640 10 monclient(hunting): get_auth_request con 0x55b3981f78e0 auth_method 0 2024-09-12T00:50:04.294 INFO:tasks.workunit.client.0.smithi073.stderr: -249> 2024-09-12T00:50:03.952+0000 7f5353981640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:04.294 INFO:tasks.workunit.client.0.smithi073.stderr: -248> 2024-09-12T00:50:03.952+0000 7f5353981640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:04.295 INFO:tasks.workunit.client.0.smithi073.stderr: -247> 2024-09-12T00:50:03.952+0000 7f5353981640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:04.295 INFO:tasks.workunit.client.0.smithi073.stderr: -246> 2024-09-12T00:50:03.952+0000 7f535c983640 10 monclient(hunting): get_auth_request con 0x55b3981f4810 auth_method 0 2024-09-12T00:50:04.295 INFO:tasks.workunit.client.0.smithi073.stderr: -245> 2024-09-12T00:50:03.952+0000 7f535c983640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:04.295 INFO:tasks.workunit.client.0.smithi073.stderr: -244> 2024-09-12T00:50:03.952+0000 7f535c983640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:04.295 INFO:tasks.workunit.client.0.smithi073.stderr: -243> 2024-09-12T00:50:03.952+0000 7f535c983640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:04.295 INFO:tasks.workunit.client.0.smithi073.stderr: -242> 2024-09-12T00:50:03.952+0000 7f535c182640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:04.295 INFO:tasks.workunit.client.0.smithi073.stderr: -241> 2024-09-12T00:50:03.952+0000 7f535c182640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:04.295 INFO:tasks.workunit.client.0.smithi073.stderr: -240> 2024-09-12T00:50:03.952+0000 7f535c182640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:04.295 INFO:tasks.workunit.client.0.smithi073.stderr: -239> 2024-09-12T00:50:03.952+0000 7f5353981640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:04.295 INFO:tasks.workunit.client.0.smithi073.stderr: -238> 2024-09-12T00:50:03.952+0000 7f5353981640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:04.295 INFO:tasks.workunit.client.0.smithi073.stderr: -237> 2024-09-12T00:50:03.952+0000 7f5353981640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:04.295 INFO:tasks.workunit.client.0.smithi073.stderr: -236> 2024-09-12T00:50:03.952+0000 7f535c983640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:04.295 INFO:tasks.workunit.client.0.smithi073.stderr: -235> 2024-09-12T00:50:03.952+0000 7f535c983640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:04.295 INFO:tasks.workunit.client.0.smithi073.stderr: -234> 2024-09-12T00:50:03.952+0000 7f535c983640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:04.296 INFO:tasks.workunit.client.0.smithi073.stderr: -233> 2024-09-12T00:50:03.952+0000 7f535c182640 10 monclient(hunting): handle_auth_done global_id 6530 payload 274 2024-09-12T00:50:04.296 INFO:tasks.workunit.client.0.smithi073.stderr: -232> 2024-09-12T00:50:03.952+0000 7f535c182640 10 monclient: _finish_hunting 0 2024-09-12T00:50:04.296 INFO:tasks.workunit.client.0.smithi073.stderr: -231> 2024-09-12T00:50:03.952+0000 7f535c182640 1 monclient: found mon.noname-c 2024-09-12T00:50:04.296 INFO:tasks.workunit.client.0.smithi073.stderr: -230> 2024-09-12T00:50:03.952+0000 7f535c182640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.73:3301/0 2024-09-12T00:50:04.296 INFO:tasks.workunit.client.0.smithi073.stderr: -229> 2024-09-12T00:50:03.952+0000 7f52337fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:04.296 INFO:tasks.workunit.client.0.smithi073.stderr: -228> 2024-09-12T00:50:03.952+0000 7f52337fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:50:04.296 INFO:tasks.workunit.client.0.smithi073.stderr: -227> 2024-09-12T00:50:03.952+0000 7f52337fe640 10 monclient: dump: 2024-09-12T00:50:04.296 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:50:04.296 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:50:04.296 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:04.296 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:04.296 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:04.296 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:50:04.297 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:50:04.297 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:50:04.297 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:50:04.297 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:04.297 INFO:tasks.workunit.client.0.smithi073.stderr: -226> 2024-09-12T00:50:03.952+0000 7f52337fe640 10 monclient: _finish_auth 0 2024-09-12T00:50:04.297 INFO:tasks.workunit.client.0.smithi073.stderr: -225> 2024-09-12T00:50:03.952+0000 7f52337fe640 10 monclient: _check_auth_tickets 2024-09-12T00:50:04.297 INFO:tasks.workunit.client.0.smithi073.stderr: -224> 2024-09-12T00:50:03.952+0000 7f52337fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:04.297 INFO:tasks.workunit.client.0.smithi073.stderr: -223> 2024-09-12T00:50:03.952+0000 7f52337fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:04.297 INFO:tasks.workunit.client.0.smithi073.stderr: -222> 2024-09-12T00:50:03.952+0000 7f52337fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:50:04.297 INFO:tasks.workunit.client.0.smithi073.stderr: -221> 2024-09-12T00:50:03.952+0000 7f52337fe640 10 monclient: dump: 2024-09-12T00:50:04.297 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:50:04.297 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:50:04.297 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:04.297 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:04.298 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:04.298 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:50:04.298 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:50:04.298 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:50:04.298 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:50:04.298 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:04.298 INFO:tasks.workunit.client.0.smithi073.stderr: -220> 2024-09-12T00:50:03.952+0000 7f535e698800 5 monclient: authenticate success, global_id 6530 2024-09-12T00:50:04.298 INFO:tasks.workunit.client.0.smithi073.stderr: -219> 2024-09-12T00:50:03.952+0000 7f535e698800 10 monclient: get_monmap_and_config success 2024-09-12T00:50:04.298 INFO:tasks.workunit.client.0.smithi073.stderr: -218> 2024-09-12T00:50:03.952+0000 7f535e698800 4 set_mon_vals no callback set 2024-09-12T00:50:04.298 INFO:tasks.workunit.client.0.smithi073.stderr: -217> 2024-09-12T00:50:03.953+0000 7f535e698800 10 monclient: shutdown 2024-09-12T00:50:04.298 INFO:tasks.workunit.client.0.smithi073.stderr: -216> 2024-09-12T00:50:03.953+0000 7f535e698800 10 monclient: build_initial_monmap 2024-09-12T00:50:04.298 INFO:tasks.workunit.client.0.smithi073.stderr: -215> 2024-09-12T00:50:03.953+0000 7f535e698800 1 build_initial for_mkfs: 0 2024-09-12T00:50:04.298 INFO:tasks.workunit.client.0.smithi073.stderr: -214> 2024-09-12T00:50:03.953+0000 7f535e698800 10 monclient: monmap: 2024-09-12T00:50:04.299 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:50:04.299 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:04.299 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:50:04.299 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:50:04.299 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:04.299 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:50:04.299 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:50:04.299 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:50:04.299 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:50:04.299 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:04.299 INFO:tasks.workunit.client.0.smithi073.stderr: -213> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981f53b0) adding auth protocol: cephx 2024-09-12T00:50:04.299 INFO:tasks.workunit.client.0.smithi073.stderr: -212> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981f53b0) adding auth protocol: cephx 2024-09-12T00:50:04.299 INFO:tasks.workunit.client.0.smithi073.stderr: -211> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981f53b0) adding auth protocol: cephx 2024-09-12T00:50:04.300 INFO:tasks.workunit.client.0.smithi073.stderr: -210> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981f53b0) adding con mode: secure 2024-09-12T00:50:04.300 INFO:tasks.workunit.client.0.smithi073.stderr: -209> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981f53b0) adding con mode: crc 2024-09-12T00:50:04.300 INFO:tasks.workunit.client.0.smithi073.stderr: -208> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981f53b0) adding con mode: secure 2024-09-12T00:50:04.300 INFO:tasks.workunit.client.0.smithi073.stderr: -207> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981f53b0) adding con mode: crc 2024-09-12T00:50:04.300 INFO:tasks.workunit.client.0.smithi073.stderr: -206> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981f53b0) adding con mode: secure 2024-09-12T00:50:04.300 INFO:tasks.workunit.client.0.smithi073.stderr: -205> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981f53b0) adding con mode: crc 2024-09-12T00:50:04.300 INFO:tasks.workunit.client.0.smithi073.stderr: -204> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981f53b0) adding con mode: crc 2024-09-12T00:50:04.300 INFO:tasks.workunit.client.0.smithi073.stderr: -203> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981f53b0) adding con mode: secure 2024-09-12T00:50:04.300 INFO:tasks.workunit.client.0.smithi073.stderr: -202> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981f53b0) adding con mode: crc 2024-09-12T00:50:04.300 INFO:tasks.workunit.client.0.smithi073.stderr: -201> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981f53b0) adding con mode: secure 2024-09-12T00:50:04.300 INFO:tasks.workunit.client.0.smithi073.stderr: -200> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981f53b0) adding con mode: crc 2024-09-12T00:50:04.300 INFO:tasks.workunit.client.0.smithi073.stderr: -199> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981f53b0) adding con mode: secure 2024-09-12T00:50:04.300 INFO:tasks.workunit.client.0.smithi073.stderr: -198> 2024-09-12T00:50:03.953+0000 7f535e698800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:04.301 INFO:tasks.workunit.client.0.smithi073.stderr: -197> 2024-09-12T00:50:03.953+0000 7f535e698800 1 librados: starting msgr at 2024-09-12T00:50:04.301 INFO:tasks.workunit.client.0.smithi073.stderr: -196> 2024-09-12T00:50:03.953+0000 7f535e698800 1 librados: starting objecter 2024-09-12T00:50:04.301 INFO:tasks.workunit.client.0.smithi073.stderr: -195> 2024-09-12T00:50:03.953+0000 7f535e698800 5 asok(0x55b397f35630) register_command objecter_requests cmddesc objecter_requests hook 0x55b3981f6e40 EEXIST 2024-09-12T00:50:04.301 INFO:tasks.workunit.client.0.smithi073.stderr: -194> 2024-09-12T00:50:03.953+0000 7f535e698800 1 librados: setting wanted keys 2024-09-12T00:50:04.301 INFO:tasks.workunit.client.0.smithi073.stderr: -193> 2024-09-12T00:50:03.953+0000 7f535e698800 1 librados: calling monclient init 2024-09-12T00:50:04.301 INFO:tasks.workunit.client.0.smithi073.stderr: -192> 2024-09-12T00:50:03.953+0000 7f535e698800 10 monclient: init 2024-09-12T00:50:04.301 INFO:tasks.workunit.client.0.smithi073.stderr: -191> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981ebe10) adding auth protocol: cephx 2024-09-12T00:50:04.301 INFO:tasks.workunit.client.0.smithi073.stderr: -190> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981ebe10) adding auth protocol: cephx 2024-09-12T00:50:04.301 INFO:tasks.workunit.client.0.smithi073.stderr: -189> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981ebe10) adding auth protocol: cephx 2024-09-12T00:50:04.301 INFO:tasks.workunit.client.0.smithi073.stderr: -188> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981ebe10) adding con mode: secure 2024-09-12T00:50:04.301 INFO:tasks.workunit.client.0.smithi073.stderr: -187> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981ebe10) adding con mode: crc 2024-09-12T00:50:04.301 INFO:tasks.workunit.client.0.smithi073.stderr: -186> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981ebe10) adding con mode: secure 2024-09-12T00:50:04.301 INFO:tasks.workunit.client.0.smithi073.stderr: -185> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981ebe10) adding con mode: crc 2024-09-12T00:50:04.301 INFO:tasks.workunit.client.0.smithi073.stderr: -184> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981ebe10) adding con mode: secure 2024-09-12T00:50:04.302 INFO:tasks.workunit.client.0.smithi073.stderr: -183> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981ebe10) adding con mode: crc 2024-09-12T00:50:04.302 INFO:tasks.workunit.client.0.smithi073.stderr: -182> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981ebe10) adding con mode: crc 2024-09-12T00:50:04.302 INFO:tasks.workunit.client.0.smithi073.stderr: -181> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981ebe10) adding con mode: secure 2024-09-12T00:50:04.302 INFO:tasks.workunit.client.0.smithi073.stderr: -180> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981ebe10) adding con mode: crc 2024-09-12T00:50:04.302 INFO:tasks.workunit.client.0.smithi073.stderr: -179> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981ebe10) adding con mode: secure 2024-09-12T00:50:04.302 INFO:tasks.workunit.client.0.smithi073.stderr: -178> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981ebe10) adding con mode: crc 2024-09-12T00:50:04.302 INFO:tasks.workunit.client.0.smithi073.stderr: -177> 2024-09-12T00:50:03.953+0000 7f535e698800 5 AuthRegistry(0x55b3981ebe10) adding con mode: secure 2024-09-12T00:50:04.302 INFO:tasks.workunit.client.0.smithi073.stderr: -176> 2024-09-12T00:50:03.953+0000 7f535e698800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:04.302 INFO:tasks.workunit.client.0.smithi073.stderr: -175> 2024-09-12T00:50:03.954+0000 7f535e698800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:04.302 INFO:tasks.workunit.client.0.smithi073.stderr: -174> 2024-09-12T00:50:03.954+0000 7f535e698800 5 asok(0x55b397f35630) register_command rotate-key cmddesc rotate-key hook 0x55b3981ebf58 EEXIST 2024-09-12T00:50:04.302 INFO:tasks.workunit.client.0.smithi073.stderr: -173> 2024-09-12T00:50:03.954+0000 7f535e698800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:04.302 INFO:tasks.workunit.client.0.smithi073.stderr: -172> 2024-09-12T00:50:03.954+0000 7f535e698800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:50:04.302 INFO:tasks.workunit.client.0.smithi073.stderr: -171> 2024-09-12T00:50:03.954+0000 7f535e698800 10 monclient(hunting): picked mon.noname-c con 0x55b3981f4810 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:50:04.303 INFO:tasks.workunit.client.0.smithi073.stderr: -170> 2024-09-12T00:50:03.954+0000 7f535e698800 10 monclient(hunting): picked mon.noname-a con 0x55b3981f78e0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:50:04.303 INFO:tasks.workunit.client.0.smithi073.stderr: -169> 2024-09-12T00:50:03.954+0000 7f535e698800 10 monclient(hunting): picked mon.noname-b con 0x55b398227d80 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:50:04.303 INFO:tasks.workunit.client.0.smithi073.stderr: -168> 2024-09-12T00:50:03.954+0000 7f535e698800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:04.303 INFO:tasks.workunit.client.0.smithi073.stderr: -167> 2024-09-12T00:50:03.954+0000 7f535e698800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:04.303 INFO:tasks.workunit.client.0.smithi073.stderr: -166> 2024-09-12T00:50:03.954+0000 7f535e698800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:04.303 INFO:tasks.workunit.client.0.smithi073.stderr: -165> 2024-09-12T00:50:03.954+0000 7f535e698800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:04.303 INFO:tasks.workunit.client.0.smithi073.stderr: -164> 2024-09-12T00:50:03.954+0000 7f535e698800 10 monclient(hunting): authenticate will time out at 2064.624270s 2024-09-12T00:50:04.303 INFO:tasks.workunit.client.0.smithi073.stderr: -163> 2024-09-12T00:50:03.954+0000 7f535c182640 10 monclient(hunting): get_auth_request con 0x55b3981f4810 auth_method 0 2024-09-12T00:50:04.303 INFO:tasks.workunit.client.0.smithi073.stderr: -162> 2024-09-12T00:50:03.954+0000 7f535c182640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:04.303 INFO:tasks.workunit.client.0.smithi073.stderr: -161> 2024-09-12T00:50:03.954+0000 7f535c182640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:04.303 INFO:tasks.workunit.client.0.smithi073.stderr: -160> 2024-09-12T00:50:03.954+0000 7f535c182640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:04.303 INFO:tasks.workunit.client.0.smithi073.stderr: -159> 2024-09-12T00:50:03.954+0000 7f5353981640 10 monclient(hunting): get_auth_request con 0x55b3981f78e0 auth_method 0 2024-09-12T00:50:04.303 INFO:tasks.workunit.client.0.smithi073.stderr: -158> 2024-09-12T00:50:03.954+0000 7f5353981640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:04.304 INFO:tasks.workunit.client.0.smithi073.stderr: -157> 2024-09-12T00:50:03.954+0000 7f5353981640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:04.304 INFO:tasks.workunit.client.0.smithi073.stderr: -156> 2024-09-12T00:50:03.954+0000 7f5353981640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:04.304 INFO:tasks.workunit.client.0.smithi073.stderr: -155> 2024-09-12T00:50:03.954+0000 7f535c182640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:04.304 INFO:tasks.workunit.client.0.smithi073.stderr: -154> 2024-09-12T00:50:03.954+0000 7f535c182640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:04.304 INFO:tasks.workunit.client.0.smithi073.stderr: -153> 2024-09-12T00:50:03.954+0000 7f535c182640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:04.304 INFO:tasks.workunit.client.0.smithi073.stderr: -152> 2024-09-12T00:50:03.954+0000 7f5353981640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:04.304 INFO:tasks.workunit.client.0.smithi073.stderr: -151> 2024-09-12T00:50:03.954+0000 7f5353981640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:04.304 INFO:tasks.workunit.client.0.smithi073.stderr: -150> 2024-09-12T00:50:03.954+0000 7f5353981640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:04.304 INFO:tasks.workunit.client.0.smithi073.stderr: -149> 2024-09-12T00:50:03.954+0000 7f535c983640 10 monclient(hunting): get_auth_request con 0x55b398227d80 auth_method 0 2024-09-12T00:50:04.304 INFO:tasks.workunit.client.0.smithi073.stderr: -148> 2024-09-12T00:50:03.954+0000 7f535c983640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:04.304 INFO:tasks.workunit.client.0.smithi073.stderr: -147> 2024-09-12T00:50:03.954+0000 7f535c983640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:04.304 INFO:tasks.workunit.client.0.smithi073.stderr: -146> 2024-09-12T00:50:03.954+0000 7f535c983640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:04.304 INFO:tasks.workunit.client.0.smithi073.stderr: -145> 2024-09-12T00:50:03.954+0000 7f535c182640 10 monclient(hunting): handle_auth_done global_id 6533 payload 824 2024-09-12T00:50:04.304 INFO:tasks.workunit.client.0.smithi073.stderr: -144> 2024-09-12T00:50:03.954+0000 7f535c182640 10 monclient: _finish_hunting 0 2024-09-12T00:50:04.305 INFO:tasks.workunit.client.0.smithi073.stderr: -143> 2024-09-12T00:50:03.954+0000 7f535c182640 1 monclient: found mon.noname-c 2024-09-12T00:50:04.305 INFO:tasks.workunit.client.0.smithi073.stderr: -142> 2024-09-12T00:50:03.954+0000 7f535c182640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.73:3301/0 2024-09-12T00:50:04.305 INFO:tasks.workunit.client.0.smithi073.stderr: -141> 2024-09-12T00:50:03.954+0000 7f5231ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:04.305 INFO:tasks.workunit.client.0.smithi073.stderr: -140> 2024-09-12T00:50:03.954+0000 7f5231ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:50:04.305 INFO:tasks.workunit.client.0.smithi073.stderr: -139> 2024-09-12T00:50:03.954+0000 7f5231ffb640 10 monclient: dump: 2024-09-12T00:50:04.305 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:50:04.305 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:50:04.305 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:04.305 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:04.305 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:04.305 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:50:04.305 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:50:04.305 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:50:04.306 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:50:04.306 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:04.306 INFO:tasks.workunit.client.0.smithi073.stderr: -138> 2024-09-12T00:50:03.954+0000 7f5231ffb640 10 monclient: _finish_auth 0 2024-09-12T00:50:04.306 INFO:tasks.workunit.client.0.smithi073.stderr: -137> 2024-09-12T00:50:03.954+0000 7f5231ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:50:04.306 INFO:tasks.workunit.client.0.smithi073.stderr: -136> 2024-09-12T00:50:03.954+0000 7f5231ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:04.306 INFO:tasks.workunit.client.0.smithi073.stderr: -135> 2024-09-12T00:50:03.954+0000 7f5231ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:04.306 INFO:tasks.workunit.client.0.smithi073.stderr: -134> 2024-09-12T00:50:03.954+0000 7f5231ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:50:04.306 INFO:tasks.workunit.client.0.smithi073.stderr: -133> 2024-09-12T00:50:03.954+0000 7f5231ffb640 10 monclient: dump: 2024-09-12T00:50:04.306 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:50:04.306 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:50:04.306 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:04.306 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:04.306 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:04.306 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:50:04.307 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:50:04.307 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:50:04.307 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:50:04.307 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:04.307 INFO:tasks.workunit.client.0.smithi073.stderr: -132> 2024-09-12T00:50:03.954+0000 7f535e698800 5 monclient: authenticate success, global_id 6533 2024-09-12T00:50:04.307 INFO:tasks.workunit.client.0.smithi073.stderr: -131> 2024-09-12T00:50:03.954+0000 7f52337fe640 4 set_mon_vals no callback set 2024-09-12T00:50:04.307 INFO:tasks.workunit.client.0.smithi073.stderr: -130> 2024-09-12T00:50:03.954+0000 7f535e698800 10 monclient: _renew_subs 2024-09-12T00:50:04.307 INFO:tasks.workunit.client.0.smithi073.stderr: -129> 2024-09-12T00:50:03.954+0000 7f535e698800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:50:04.307 INFO:tasks.workunit.client.0.smithi073.stderr: -128> 2024-09-12T00:50:03.954+0000 7f535e698800 10 monclient: _renew_subs 2024-09-12T00:50:04.307 INFO:tasks.workunit.client.0.smithi073.stderr: -127> 2024-09-12T00:50:03.954+0000 7f535e698800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:50:04.307 INFO:tasks.workunit.client.0.smithi073.stderr: -126> 2024-09-12T00:50:03.954+0000 7f535e698800 1 librados: init done 2024-09-12T00:50:04.307 INFO:tasks.workunit.client.0.smithi073.stderr: -125> 2024-09-12T00:50:03.954+0000 7f535e698800 5 asok(0x55b397f35630) register_command cr dump hook 0x55b3982190e8 2024-09-12T00:50:04.307 INFO:tasks.workunit.client.0.smithi073.stderr: -124> 2024-09-12T00:50:03.956+0000 7f535e698800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.307 INFO:tasks.workunit.client.0.smithi073.stderr: -123> 2024-09-12T00:50:03.956+0000 7f5231ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:50:04.308 INFO:tasks.workunit.client.0.smithi073.stderr: -122> 2024-09-12T00:50:03.956+0000 7f5231ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:50:04.308 INFO:tasks.workunit.client.0.smithi073.stderr: -121> 2024-09-12T00:50:03.957+0000 7f5231ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:50:04.308 INFO:tasks.workunit.client.0.smithi073.stderr: -120> 2024-09-12T00:50:03.957+0000 7f5353981640 10 monclient: get_auth_request con 0x7f5224076470 auth_method 0 2024-09-12T00:50:04.308 INFO:tasks.workunit.client.0.smithi073.stderr: -119> 2024-09-12T00:50:03.957+0000 7f535c983640 10 monclient: get_auth_request con 0x55b398242610 auth_method 0 2024-09-12T00:50:04.308 INFO:tasks.workunit.client.0.smithi073.stderr: -118> 2024-09-12T00:50:03.957+0000 7f535e698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:04.308 INFO:tasks.workunit.client.0.smithi073.stderr: -117> 2024-09-12T00:50:03.957+0000 7f535e698800 20 realm 2024-09-12T00:50:04.308 INFO:tasks.workunit.client.0.smithi073.stderr: -116> 2024-09-12T00:50:03.957+0000 7f535e698800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.308 INFO:tasks.workunit.client.0.smithi073.stderr: -115> 2024-09-12T00:50:03.958+0000 7f535e698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:04.308 INFO:tasks.workunit.client.0.smithi073.stderr: -114> 2024-09-12T00:50:03.958+0000 7f535e698800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:04.308 INFO:tasks.workunit.client.0.smithi073.stderr: -113> 2024-09-12T00:50:03.958+0000 7f535e698800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.308 INFO:tasks.workunit.client.0.smithi073.stderr: -112> 2024-09-12T00:50:03.958+0000 7f535e698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:04.308 INFO:tasks.workunit.client.0.smithi073.stderr: -111> 2024-09-12T00:50:03.958+0000 7f535e698800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.308 INFO:tasks.workunit.client.0.smithi073.stderr: -110> 2024-09-12T00:50:03.958+0000 7f535c182640 10 monclient: get_auth_request con 0x55b3982467b0 auth_method 0 2024-09-12T00:50:04.309 INFO:tasks.workunit.client.0.smithi073.stderr: -109> 2024-09-12T00:50:03.959+0000 7f535e698800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:04.309 INFO:tasks.workunit.client.0.smithi073.stderr: -108> 2024-09-12T00:50:03.959+0000 7f535e698800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.309 INFO:tasks.workunit.client.0.smithi073.stderr: -107> 2024-09-12T00:50:03.959+0000 7f5353981640 10 monclient: get_auth_request con 0x55b39824a030 auth_method 0 2024-09-12T00:50:04.309 INFO:tasks.workunit.client.0.smithi073.stderr: -106> 2024-09-12T00:50:03.960+0000 7f535e698800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:04.309 INFO:tasks.workunit.client.0.smithi073.stderr: -105> 2024-09-12T00:50:03.960+0000 7f535e698800 20 searching for the correct realm 2024-09-12T00:50:04.309 INFO:tasks.workunit.client.0.smithi073.stderr: -104> 2024-09-12T00:50:03.960+0000 7f535c983640 10 monclient: get_auth_request con 0x55b39824edb0 auth_method 0 2024-09-12T00:50:04.309 INFO:tasks.workunit.client.0.smithi073.stderr: -103> 2024-09-12T00:50:03.960+0000 7f535c182640 10 monclient: get_auth_request con 0x7f5354018070 auth_method 0 2024-09-12T00:50:04.309 INFO:tasks.workunit.client.0.smithi073.stderr: -102> 2024-09-12T00:50:03.961+0000 7f5353981640 10 monclient: get_auth_request con 0x7f534c076f50 auth_method 0 2024-09-12T00:50:04.309 INFO:tasks.workunit.client.0.smithi073.stderr: -101> 2024-09-12T00:50:03.962+0000 7f535c983640 0 -- 172.21.15.73:0/4248616062 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f534406b030 msgr2=0x7f53440ab6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:04.309 INFO:tasks.workunit.client.0.smithi073.stderr: -100> 2024-09-12T00:50:04.163+0000 7f535c983640 10 monclient: get_auth_request con 0x7f534406b030 auth_method 0 2024-09-12T00:50:04.309 INFO:tasks.workunit.client.0.smithi073.stderr: -99> 2024-09-12T00:50:04.167+0000 7f535c182640 10 monclient: get_auth_request con 0x7f5354044950 auth_method 0 2024-09-12T00:50:04.309 INFO:tasks.workunit.client.0.smithi073.stderr: -98> 2024-09-12T00:50:04.168+0000 7f535c983640 0 -- 172.21.15.73:0/4248616062 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f534406b030 msgr2=0x7f53440ab6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:04.309 INFO:tasks.workunit.client.0.smithi073.stderr: -97> 2024-09-12T00:50:04.168+0000 7f5231ffb640 1 client.6533.objecter ms_handle_reset 0x7f534406b030 session 0x7f5344005040 osd.4 2024-09-12T00:50:04.310 INFO:tasks.workunit.client.0.smithi073.stderr: -96> 2024-09-12T00:50:04.168+0000 7f5231ffb640 10 monclient: _renew_subs 2024-09-12T00:50:04.310 INFO:tasks.workunit.client.0.smithi073.stderr: -95> 2024-09-12T00:50:04.168+0000 7f5231ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:50:04.310 INFO:tasks.workunit.client.0.smithi073.stderr: -94> 2024-09-12T00:50:04.168+0000 7f535c983640 10 monclient: get_auth_request con 0x7f5224086370 auth_method 0 2024-09-12T00:50:04.310 INFO:tasks.workunit.client.0.smithi073.stderr: -93> 2024-09-12T00:50:04.172+0000 7f535e698800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:50:04.310 INFO:tasks.workunit.client.0.smithi073.stderr: -92> 2024-09-12T00:50:04.172+0000 7f535e698800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:04.310 INFO:tasks.workunit.client.0.smithi073.stderr: -91> 2024-09-12T00:50:04.172+0000 7f535e698800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:50:04.310 INFO:tasks.workunit.client.0.smithi073.stderr: -90> 2024-09-12T00:50:04.172+0000 7f535e698800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:04.310 INFO:tasks.workunit.client.0.smithi073.stderr: -89> 2024-09-12T00:50:04.172+0000 7f535e698800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:04.310 INFO:tasks.workunit.client.0.smithi073.stderr: -88> 2024-09-12T00:50:04.172+0000 7f535e698800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:04.310 INFO:tasks.workunit.client.0.smithi073.stderr: -87> 2024-09-12T00:50:04.172+0000 7f535e698800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.310 INFO:tasks.workunit.client.0.smithi073.stderr: -86> 2024-09-12T00:50:04.172+0000 7f535e698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:04.310 INFO:tasks.workunit.client.0.smithi073.stderr: -85> 2024-09-12T00:50:04.172+0000 7f535e698800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.310 INFO:tasks.workunit.client.0.smithi073.stderr: -84> 2024-09-12T00:50:04.172+0000 7f535e698800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:04.311 INFO:tasks.workunit.client.0.smithi073.stderr: -83> 2024-09-12T00:50:04.172+0000 7f535e698800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.311 INFO:tasks.workunit.client.0.smithi073.stderr: -82> 2024-09-12T00:50:04.172+0000 7f535e698800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:04.311 INFO:tasks.workunit.client.0.smithi073.stderr: -81> 2024-09-12T00:50:04.172+0000 7f535e698800 20 zone default found 2024-09-12T00:50:04.311 INFO:tasks.workunit.client.0.smithi073.stderr: -80> 2024-09-12T00:50:04.172+0000 7f535e698800 4 Realm: () 2024-09-12T00:50:04.311 INFO:tasks.workunit.client.0.smithi073.stderr: -79> 2024-09-12T00:50:04.172+0000 7f535e698800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:50:04.311 INFO:tasks.workunit.client.0.smithi073.stderr: -78> 2024-09-12T00:50:04.172+0000 7f535e698800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:50:04.311 INFO:tasks.workunit.client.0.smithi073.stderr: -77> 2024-09-12T00:50:04.172+0000 7f535e698800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:04.311 INFO:tasks.workunit.client.0.smithi073.stderr: -76> 2024-09-12T00:50:04.172+0000 7f535e698800 20 zonegroup default 2024-09-12T00:50:04.311 INFO:tasks.workunit.client.0.smithi073.stderr: -75> 2024-09-12T00:50:04.172+0000 7f535e698800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.311 INFO:tasks.workunit.client.0.smithi073.stderr: -74> 2024-09-12T00:50:04.173+0000 7f535e698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:04.311 INFO:tasks.workunit.client.0.smithi073.stderr: -73> 2024-09-12T00:50:04.173+0000 7f535e698800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.311 INFO:tasks.workunit.client.0.smithi073.stderr: -72> 2024-09-12T00:50:04.173+0000 7f535e698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:04.311 INFO:tasks.workunit.client.0.smithi073.stderr: -71> 2024-09-12T00:50:04.173+0000 7f535e698800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.312 INFO:tasks.workunit.client.0.smithi073.stderr: -70> 2024-09-12T00:50:04.173+0000 7f535e698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:04.312 INFO:tasks.workunit.client.0.smithi073.stderr: -69> 2024-09-12T00:50:04.173+0000 7f535e698800 20 started sync module instance, tier type = 2024-09-12T00:50:04.312 INFO:tasks.workunit.client.0.smithi073.stderr: -68> 2024-09-12T00:50:04.173+0000 7f535e698800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:50:04.312 INFO:tasks.workunit.client.0.smithi073.stderr: -67> 2024-09-12T00:50:04.182+0000 7f535e698800 20 add_watcher() i=0 2024-09-12T00:50:04.312 INFO:tasks.workunit.client.0.smithi073.stderr: -66> 2024-09-12T00:50:04.182+0000 7f535e698800 20 add_watcher() i=1 2024-09-12T00:50:04.312 INFO:tasks.workunit.client.0.smithi073.stderr: -65> 2024-09-12T00:50:04.182+0000 7f535e698800 20 add_watcher() i=2 2024-09-12T00:50:04.312 INFO:tasks.workunit.client.0.smithi073.stderr: -64> 2024-09-12T00:50:04.182+0000 7f535e698800 20 add_watcher() i=3 2024-09-12T00:50:04.312 INFO:tasks.workunit.client.0.smithi073.stderr: -63> 2024-09-12T00:50:04.182+0000 7f535e698800 20 add_watcher() i=4 2024-09-12T00:50:04.312 INFO:tasks.workunit.client.0.smithi073.stderr: -62> 2024-09-12T00:50:04.182+0000 7f535e698800 20 add_watcher() i=5 2024-09-12T00:50:04.312 INFO:tasks.workunit.client.0.smithi073.stderr: -61> 2024-09-12T00:50:04.182+0000 7f535e698800 20 add_watcher() i=6 2024-09-12T00:50:04.312 INFO:tasks.workunit.client.0.smithi073.stderr: -60> 2024-09-12T00:50:04.183+0000 7f535e698800 20 add_watcher() i=7 2024-09-12T00:50:04.312 INFO:tasks.workunit.client.0.smithi073.stderr: -59> 2024-09-12T00:50:04.183+0000 7f535e698800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:04.312 INFO:tasks.workunit.client.0.smithi073.stderr: -58> 2024-09-12T00:50:04.185+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a6da0) adding auth protocol: cephx 2024-09-12T00:50:04.312 INFO:tasks.workunit.client.0.smithi073.stderr: -57> 2024-09-12T00:50:04.185+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a6da0) adding auth protocol: cephx 2024-09-12T00:50:04.313 INFO:tasks.workunit.client.0.smithi073.stderr: -56> 2024-09-12T00:50:04.185+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a6da0) adding auth protocol: cephx 2024-09-12T00:50:04.313 INFO:tasks.workunit.client.0.smithi073.stderr: -55> 2024-09-12T00:50:04.185+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a6da0) adding con mode: secure 2024-09-12T00:50:04.313 INFO:tasks.workunit.client.0.smithi073.stderr: -54> 2024-09-12T00:50:04.185+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a6da0) adding con mode: crc 2024-09-12T00:50:04.313 INFO:tasks.workunit.client.0.smithi073.stderr: -53> 2024-09-12T00:50:04.185+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a6da0) adding con mode: secure 2024-09-12T00:50:04.313 INFO:tasks.workunit.client.0.smithi073.stderr: -52> 2024-09-12T00:50:04.185+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a6da0) adding con mode: crc 2024-09-12T00:50:04.313 INFO:tasks.workunit.client.0.smithi073.stderr: -51> 2024-09-12T00:50:04.185+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a6da0) adding con mode: secure 2024-09-12T00:50:04.313 INFO:tasks.workunit.client.0.smithi073.stderr: -50> 2024-09-12T00:50:04.185+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a6da0) adding con mode: crc 2024-09-12T00:50:04.313 INFO:tasks.workunit.client.0.smithi073.stderr: -49> 2024-09-12T00:50:04.185+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a6da0) adding con mode: crc 2024-09-12T00:50:04.313 INFO:tasks.workunit.client.0.smithi073.stderr: -48> 2024-09-12T00:50:04.185+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a6da0) adding con mode: secure 2024-09-12T00:50:04.313 INFO:tasks.workunit.client.0.smithi073.stderr: -47> 2024-09-12T00:50:04.185+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a6da0) adding con mode: crc 2024-09-12T00:50:04.313 INFO:tasks.workunit.client.0.smithi073.stderr: -46> 2024-09-12T00:50:04.185+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a6da0) adding con mode: secure 2024-09-12T00:50:04.313 INFO:tasks.workunit.client.0.smithi073.stderr: -45> 2024-09-12T00:50:04.185+0000 7f5212fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:04.313 INFO:tasks.workunit.client.0.smithi073.stderr: -44> 2024-09-12T00:50:04.185+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a6da0) adding con mode: crc 2024-09-12T00:50:04.314 INFO:tasks.workunit.client.0.smithi073.stderr: -43> 2024-09-12T00:50:04.185+0000 7f535e698800 5 AuthRegistry(0x7ffd7b1a6da0) adding con mode: secure 2024-09-12T00:50:04.314 INFO:tasks.workunit.client.0.smithi073.stderr: -42> 2024-09-12T00:50:04.185+0000 7f535e698800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:04.314 INFO:tasks.workunit.client.0.smithi073.stderr: -41> 2024-09-12T00:50:04.185+0000 7f535e698800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:04.314 INFO:tasks.workunit.client.0.smithi073.stderr: -40> 2024-09-12T00:50:04.185+0000 7f535e698800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:04.314 INFO:tasks.workunit.client.0.smithi073.stderr: -39> 2024-09-12T00:50:04.185+0000 7f535e698800 5 asok(0x55b397f35630) register_command cache list hook 0x55b398218dd0 2024-09-12T00:50:04.314 INFO:tasks.workunit.client.0.smithi073.stderr: -38> 2024-09-12T00:50:04.185+0000 7f535e698800 5 asok(0x55b397f35630) register_command cache inspect hook 0x55b398218dd0 2024-09-12T00:50:04.314 INFO:tasks.workunit.client.0.smithi073.stderr: -37> 2024-09-12T00:50:04.185+0000 7f535e698800 5 asok(0x55b397f35630) register_command cache erase hook 0x55b398218dd0 2024-09-12T00:50:04.314 INFO:tasks.workunit.client.0.smithi073.stderr: -36> 2024-09-12T00:50:04.185+0000 7f535e698800 5 asok(0x55b397f35630) register_command cache zap hook 0x55b398218dd0 2024-09-12T00:50:04.314 INFO:tasks.workunit.client.0.smithi073.stderr: -35> 2024-09-12T00:50:04.185+0000 7f535e698800 5 note: GC not initialized 2024-09-12T00:50:04.314 INFO:tasks.workunit.client.0.smithi073.stderr: -34> 2024-09-12T00:50:04.185+0000 7f5211fdb640 20 reqs_thread_entry: start 2024-09-12T00:50:04.314 INFO:tasks.workunit.client.0.smithi073.stderr: -33> 2024-09-12T00:50:04.185+0000 7f535e698800 5 asok(0x55b397f35630) register_command sync trace show hook 0x7f534c013070 2024-09-12T00:50:04.314 INFO:tasks.workunit.client.0.smithi073.stderr: -32> 2024-09-12T00:50:04.185+0000 7f535e698800 5 asok(0x55b397f35630) register_command sync trace history hook 0x7f534c013070 2024-09-12T00:50:04.314 INFO:tasks.workunit.client.0.smithi073.stderr: -31> 2024-09-12T00:50:04.185+0000 7f535e698800 5 asok(0x55b397f35630) register_command sync trace active hook 0x7f534c013070 2024-09-12T00:50:04.315 INFO:tasks.workunit.client.0.smithi073.stderr: -30> 2024-09-12T00:50:04.185+0000 7f535e698800 5 asok(0x55b397f35630) register_command sync trace active_short hook 0x7f534c013070 2024-09-12T00:50:04.315 INFO:tasks.workunit.client.0.smithi073.stderr: -29> 2024-09-12T00:50:04.185+0000 7f535e698800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:04.315 INFO:tasks.workunit.client.0.smithi073.stderr: -28> 2024-09-12T00:50:04.185+0000 7f535e698800 20 Filter name: none 2024-09-12T00:50:04.315 INFO:tasks.workunit.client.0.smithi073.stderr: -27> 2024-09-12T00:50:04.186+0000 7f51837fe640 20 reqs_thread_entry: start 2024-09-12T00:50:04.315 INFO:tasks.workunit.client.0.smithi073.stderr: -26> 2024-09-12T00:50:04.186+0000 7f535e698800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:50:04.315 INFO:tasks.workunit.client.0.smithi073.stderr: -25> 2024-09-12T00:50:04.186+0000 7f535e698800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.315 INFO:tasks.workunit.client.0.smithi073.stderr: -24> 2024-09-12T00:50:04.186+0000 7f535e698800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:50:04.315 INFO:tasks.workunit.client.0.smithi073.stderr: -23> 2024-09-12T00:50:04.186+0000 7f535e698800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:50:04.315 INFO:tasks.workunit.client.0.smithi073.stderr: -22> 2024-09-12T00:50:04.186+0000 7f535e698800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:50:04.315 INFO:tasks.workunit.client.0.smithi073.stderr: -21> 2024-09-12T00:50:04.186+0000 7f535e698800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27 : miss 2024-09-12T00:50:04.315 INFO:tasks.workunit.client.0.smithi073.stderr: -20> 2024-09-12T00:50:04.186+0000 7f535e698800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.315 INFO:tasks.workunit.client.0.smithi073.stderr: -19> 2024-09-12T00:50:04.187+0000 7f535e698800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:50:04.315 INFO:tasks.workunit.client.0.smithi073.stderr: -18> 2024-09-12T00:50:04.187+0000 7f535e698800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27 info.flags=0x17 2024-09-12T00:50:04.315 INFO:tasks.workunit.client.0.smithi073.stderr: -17> 2024-09-12T00:50:04.187+0000 7f535e698800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27 to cache LRU end 2024-09-12T00:50:04.316 INFO:tasks.workunit.client.0.smithi073.stderr: -16> 2024-09-12T00:50:04.187+0000 7f535e698800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:04.316 INFO:tasks.workunit.client.0.smithi073.stderr: -15> 2024-09-12T00:50:04.187+0000 7f535e698800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:04.316 INFO:tasks.workunit.client.0.smithi073.stderr: -14> 2024-09-12T00:50:04.187+0000 7f535e698800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27 2024-09-12T00:50:04.316 INFO:tasks.workunit.client.0.smithi073.stderr: -13> 2024-09-12T00:50:04.190+0000 7f535e698800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27 info.flags=0x17 2024-09-12T00:50:04.316 INFO:tasks.workunit.client.0.smithi073.stderr: -12> 2024-09-12T00:50:04.190+0000 7f535e698800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27 to cache LRU end 2024-09-12T00:50:04.316 INFO:tasks.workunit.client.0.smithi073.stderr: -11> 2024-09-12T00:50:04.190+0000 7f535e698800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:04.316 INFO:tasks.workunit.client.0.smithi073.stderr: -10> 2024-09-12T00:50:04.190+0000 7f535e698800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27, ofs0, ns] 2024-09-12T00:50:04.316 INFO:tasks.workunit.client.0.smithi073.stderr: -9> 2024-09-12T00:50:04.191+0000 7f52337fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497043 cookie 94229840089024 notifier 6533 bl.length()=939 2024-09-12T00:50:04.316 INFO:tasks.workunit.client.0.smithi073.stderr: -8> 2024-09-12T00:50:04.191+0000 7f52337fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27 info.flags=0x17 2024-09-12T00:50:04.316 INFO:tasks.workunit.client.0.smithi073.stderr: -7> 2024-09-12T00:50:04.191+0000 7f52337fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27 to cache LRU end 2024-09-12T00:50:04.316 INFO:tasks.workunit.client.0.smithi073.stderr: -6> 2024-09-12T00:50:04.191+0000 7f52337fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:04.316 INFO:tasks.workunit.client.0.smithi073.stderr: -5> 2024-09-12T00:50:04.192+0000 7f535e698800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27]): orig_sources= new_sources= 2024-09-12T00:50:04.316 INFO:tasks.workunit.client.0.smithi073.stderr: -4> 2024-09-12T00:50:04.192+0000 7f535e698800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27]): potential sources added=[] removed=[] 2024-09-12T00:50:04.317 INFO:tasks.workunit.client.0.smithi073.stderr: -3> 2024-09-12T00:50:04.192+0000 7f535e698800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27]): orig_dests= new_dests= 2024-09-12T00:50:04.317 INFO:tasks.workunit.client.0.smithi073.stderr: -2> 2024-09-12T00:50:04.192+0000 7f535e698800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27]): potential dests added=[] removed=[] 2024-09-12T00:50:04.317 INFO:tasks.workunit.client.0.smithi073.stderr: -1> 2024-09-12T00:50:04.193+0000 7f535e698800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f535e698800 time 2024-09-12T00:50:04.193674+0000 2024-09-12T00:50:04.317 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:50:04.317 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:04.317 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:04.317 INFO:tasks.workunit.client.0.smithi073.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f5361b8c71a] 2024-09-12T00:50:04.317 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5361b8c8d8] 2024-09-12T00:50:04.317 INFO:tasks.workunit.client.0.smithi073.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b396e9a641] 2024-09-12T00:50:04.317 INFO:tasks.workunit.client.0.smithi073.stderr: 4: radosgw-admin(+0xd884de) [0x55b3973ad4de] 2024-09-12T00:50:04.317 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b396eaa31d] 2024-09-12T00:50:04.317 INFO:tasks.workunit.client.0.smithi073.stderr: 6: main() 2024-09-12T00:50:04.317 INFO:tasks.workunit.client.0.smithi073.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f5360829590] 2024-09-12T00:50:04.318 INFO:tasks.workunit.client.0.smithi073.stderr: 8: __libc_start_main() 2024-09-12T00:50:04.318 INFO:tasks.workunit.client.0.smithi073.stderr: 9: _start() 2024-09-12T00:50:04.318 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:04.318 INFO:tasks.workunit.client.0.smithi073.stderr: 0> 2024-09-12T00:50:04.194+0000 7f535e698800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:50:04.318 INFO:tasks.workunit.client.0.smithi073.stderr: in thread 7f535e698800 thread_name:radosgw-admin 2024-09-12T00:50:04.318 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:04.318 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:04.318 INFO:tasks.workunit.client.0.smithi073.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f536083e6f0] 2024-09-12T00:50:04.318 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f536088b99c] 2024-09-12T00:50:04.318 INFO:tasks.workunit.client.0.smithi073.stderr: 3: raise() 2024-09-12T00:50:04.318 INFO:tasks.workunit.client.0.smithi073.stderr: 4: abort() 2024-09-12T00:50:04.318 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f5361b8c774] 2024-09-12T00:50:04.318 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5361b8c8d8] 2024-09-12T00:50:04.318 INFO:tasks.workunit.client.0.smithi073.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b396e9a641] 2024-09-12T00:50:04.319 INFO:tasks.workunit.client.0.smithi073.stderr: 8: radosgw-admin(+0xd884de) [0x55b3973ad4de] 2024-09-12T00:50:04.319 INFO:tasks.workunit.client.0.smithi073.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b396eaa31d] 2024-09-12T00:50:04.319 INFO:tasks.workunit.client.0.smithi073.stderr: 10: main() 2024-09-12T00:50:04.319 INFO:tasks.workunit.client.0.smithi073.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f5360829590] 2024-09-12T00:50:04.319 INFO:tasks.workunit.client.0.smithi073.stderr: 12: __libc_start_main() 2024-09-12T00:50:04.319 INFO:tasks.workunit.client.0.smithi073.stderr: 13: _start() 2024-09-12T00:50:04.319 INFO:tasks.workunit.client.0.smithi073.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:50:04.319 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:04.319 INFO:tasks.workunit.client.0.smithi073.stderr:--- logging levels --- 2024-09-12T00:50:04.319 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 none 2024-09-12T00:50:04.319 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 lockdep 2024-09-12T00:50:04.319 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 context 2024-09-12T00:50:04.319 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 crush 2024-09-12T00:50:04.320 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds 2024-09-12T00:50:04.320 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_balancer 2024-09-12T00:50:04.320 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_locker 2024-09-12T00:50:04.320 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_log 2024-09-12T00:50:04.320 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_log_expire 2024-09-12T00:50:04.320 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_migrator 2024-09-12T00:50:04.320 INFO:tasks.workunit.client.0.smithi073.stderr: 3/ 5 mds_quiesce 2024-09-12T00:50:04.320 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 buffer 2024-09-12T00:50:04.320 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 timer 2024-09-12T00:50:04.320 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 filer 2024-09-12T00:50:04.320 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 striper 2024-09-12T00:50:04.320 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 objecter 2024-09-12T00:50:04.320 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rados 2024-09-12T00:50:04.320 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd 2024-09-12T00:50:04.321 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_mirror 2024-09-12T00:50:04.321 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_replay 2024-09-12T00:50:04.321 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_pwl 2024-09-12T00:50:04.321 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 journaler 2024-09-12T00:50:04.321 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 objectcacher 2024-09-12T00:50:04.321 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:50:04.321 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 client 2024-09-12T00:50:04.321 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 osd 2024-09-12T00:50:04.321 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 optracker 2024-09-12T00:50:04.321 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 objclass 2024-09-12T00:50:04.321 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 filestore 2024-09-12T00:50:04.321 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 journal 2024-09-12T00:50:04.321 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 0 ms 2024-09-12T00:50:04.321 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mon 2024-09-12T00:50:04.322 INFO:tasks.workunit.client.0.smithi073.stderr: 0/10 monc 2024-09-12T00:50:04.322 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 paxos 2024-09-12T00:50:04.322 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 tp 2024-09-12T00:50:04.322 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 auth 2024-09-12T00:50:04.322 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 crypto 2024-09-12T00:50:04.322 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 finisher 2024-09-12T00:50:04.322 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 reserver 2024-09-12T00:50:04.322 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 heartbeatmap 2024-09-12T00:50:04.322 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 perfcounter 2024-09-12T00:50:04.322 INFO:tasks.workunit.client.0.smithi073.stderr: 20/20 rgw 2024-09-12T00:50:04.322 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_sync 2024-09-12T00:50:04.322 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_datacache 2024-09-12T00:50:04.322 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_access 2024-09-12T00:50:04.322 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:50:04.323 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_flight 2024-09-12T00:50:04.323 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:50:04.323 INFO:tasks.workunit.client.0.smithi073.stderr: 20/20 rgw_notification 2024-09-12T00:50:04.323 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 javaclient 2024-09-12T00:50:04.323 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 asok 2024-09-12T00:50:04.323 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 throttle 2024-09-12T00:50:04.323 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 0 refs 2024-09-12T00:50:04.323 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 compressor 2024-09-12T00:50:04.323 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 bluestore 2024-09-12T00:50:04.323 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 bluefs 2024-09-12T00:50:04.323 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 bdev 2024-09-12T00:50:04.323 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 kstore 2024-09-12T00:50:04.323 INFO:tasks.workunit.client.0.smithi073.stderr: 4/ 5 rocksdb 2024-09-12T00:50:04.323 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 fuse 2024-09-12T00:50:04.324 INFO:tasks.workunit.client.0.smithi073.stderr: 2/ 5 mgr 2024-09-12T00:50:04.324 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mgrc 2024-09-12T00:50:04.324 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 dpdk 2024-09-12T00:50:04.324 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 eventtrace 2024-09-12T00:50:04.324 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 prioritycache 2024-09-12T00:50:04.324 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 test 2024-09-12T00:50:04.324 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:50:04.324 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cephsqlite 2024-09-12T00:50:04.324 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:50:04.324 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore 2024-09-12T00:50:04.324 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_onode 2024-09-12T00:50:04.324 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_odata 2024-09-12T00:50:04.324 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_omap 2024-09-12T00:50:04.325 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_tm 2024-09-12T00:50:04.325 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_t 2024-09-12T00:50:04.325 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:50:04.325 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_epm 2024-09-12T00:50:04.325 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_lba 2024-09-12T00:50:04.325 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:50:04.325 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_cache 2024-09-12T00:50:04.325 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_journal 2024-09-12T00:50:04.325 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_device 2024-09-12T00:50:04.325 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_backref 2024-09-12T00:50:04.325 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 alienstore 2024-09-12T00:50:04.325 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mclock 2024-09-12T00:50:04.325 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cyanstore 2024-09-12T00:50:04.325 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 ceph_exporter 2024-09-12T00:50:04.325 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 memstore 2024-09-12T00:50:04.326 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 trace 2024-09-12T00:50:04.326 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 ceph_dedup 2024-09-12T00:50:04.326 INFO:tasks.workunit.client.0.smithi073.stderr: -2/-2 (syslog threshold) 2024-09-12T00:50:04.326 INFO:tasks.workunit.client.0.smithi073.stderr: 99/99 (stderr threshold) 2024-09-12T00:50:04.326 INFO:tasks.workunit.client.0.smithi073.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:50:04.326 INFO:tasks.workunit.client.0.smithi073.stderr: 7f51837fe640 / http_manager 2024-09-12T00:50:04.326 INFO:tasks.workunit.client.0.smithi073.stderr: 7f5211fdb640 / http_manager 2024-09-12T00:50:04.326 INFO:tasks.workunit.client.0.smithi073.stderr: 7f5212fdd640 / rgw_dt_lg_renew 2024-09-12T00:50:04.326 INFO:tasks.workunit.client.0.smithi073.stderr: 7f5231ffb640 / ms_dispatch 2024-09-12T00:50:04.326 INFO:tasks.workunit.client.0.smithi073.stderr: 7f52337fe640 / io_context_pool 2024-09-12T00:50:04.326 INFO:tasks.workunit.client.0.smithi073.stderr: 7f5241ffb640 / ms_dispatch 2024-09-12T00:50:04.326 INFO:tasks.workunit.client.0.smithi073.stderr: 7f5248e09640 / ms_dispatch 2024-09-12T00:50:04.326 INFO:tasks.workunit.client.0.smithi073.stderr: 7f524a60c640 / io_context_pool 2024-09-12T00:50:04.326 INFO:tasks.workunit.client.0.smithi073.stderr: 7f5353981640 / msgr-worker-2 2024-09-12T00:50:04.327 INFO:tasks.workunit.client.0.smithi073.stderr: 7f535c182640 / msgr-worker-1 2024-09-12T00:50:04.327 INFO:tasks.workunit.client.0.smithi073.stderr: 7f535c983640 / msgr-worker-0 2024-09-12T00:50:04.327 INFO:tasks.workunit.client.0.smithi073.stderr: 7f535d184640 / io_context_pool 2024-09-12T00:50:04.327 INFO:tasks.workunit.client.0.smithi073.stderr: 7f535e698800 / radosgw-admin 2024-09-12T00:50:04.327 INFO:tasks.workunit.client.0.smithi073.stderr: max_recent 500 2024-09-12T00:50:04.327 INFO:tasks.workunit.client.0.smithi073.stderr: max_new 1000 2024-09-12T00:50:04.327 INFO:tasks.workunit.client.0.smithi073.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:50:04.195348Z_505e33cf-6d29-4149-9321-6a9720e22291/log 2024-09-12T00:50:04.327 INFO:tasks.workunit.client.0.smithi073.stderr:--- end dump of recent events --- 2024-09-12T00:50:04.327 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T00:50:04.329 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:04.329 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:04.329 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.268+0000 7faa40b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.329 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.270+0000 7faa40b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:04.329 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.270+0000 7faa40b2c800 20 realm 2024-09-12T00:50:04.329 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.270+0000 7faa40b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.329 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.270+0000 7faa40b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:04.329 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.270+0000 7faa40b2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:04.329 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.270+0000 7faa40b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.329 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.270+0000 7faa40b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:04.329 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.270+0000 7faa40b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.330 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.271+0000 7faa40b2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:04.330 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.271+0000 7faa40b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.330 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.272+0000 7faa40b2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:04.330 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.272+0000 7faa40b2c800 20 searching for the correct realm 2024-09-12T00:50:04.330 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.274+0000 7faa3d0ae640 0 -- 172.21.15.73:0/4042567013 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7faa2407c070 msgr2=0x7faa240aa780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:04.479 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.480+0000 7faa3d0ae640 0 -- 172.21.15.73:0/4042567013 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7faa2407c070 msgr2=0x7faa240aa780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:04.483 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.484+0000 7faa40b2c800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:50:04.483 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.484+0000 7faa40b2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:04.483 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.484+0000 7faa40b2c800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:50:04.483 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.484+0000 7faa40b2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:04.483 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.484+0000 7faa40b2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:04.483 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.484+0000 7faa40b2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:04.483 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.484+0000 7faa40b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.483 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.484+0000 7faa40b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:04.484 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.484+0000 7faa40b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.484 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.484+0000 7faa40b2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:04.484 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.484+0000 7faa40b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.485 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.484+0000 7faa40b2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:04.485 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.484+0000 7faa40b2c800 20 zone default found 2024-09-12T00:50:04.485 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.484+0000 7faa40b2c800 4 Realm: () 2024-09-12T00:50:04.485 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.484+0000 7faa40b2c800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:50:04.486 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.484+0000 7faa40b2c800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:50:04.486 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.484+0000 7faa40b2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:04.486 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.484+0000 7faa40b2c800 20 zonegroup default 2024-09-12T00:50:04.486 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.484+0000 7faa40b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.486 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.485+0000 7faa40b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:04.486 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.485+0000 7faa40b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.486 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.485+0000 7faa40b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:04.486 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.485+0000 7faa40b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.486 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.485+0000 7faa40b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:04.486 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.485+0000 7faa40b2c800 20 started sync module instance, tier type = 2024-09-12T00:50:04.486 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.485+0000 7faa40b2c800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:50:04.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.494+0000 7faa40b2c800 20 add_watcher() i=0 2024-09-12T00:50:04.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.494+0000 7faa40b2c800 20 add_watcher() i=1 2024-09-12T00:50:04.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.494+0000 7faa40b2c800 20 add_watcher() i=2 2024-09-12T00:50:04.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.494+0000 7faa40b2c800 20 add_watcher() i=3 2024-09-12T00:50:04.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.494+0000 7faa40b2c800 20 add_watcher() i=4 2024-09-12T00:50:04.494 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.495+0000 7faa40b2c800 20 add_watcher() i=5 2024-09-12T00:50:04.494 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.495+0000 7faa40b2c800 20 add_watcher() i=6 2024-09-12T00:50:04.495 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.496+0000 7faa40b2c800 20 add_watcher() i=7 2024-09-12T00:50:04.495 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.496+0000 7faa40b2c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:04.496 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.498+0000 7fa8f2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:04.497 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.498+0000 7faa40b2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:04.497 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.498+0000 7faa40b2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:04.497 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.498+0000 7faa40b2c800 5 note: GC not initialized 2024-09-12T00:50:04.498 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.498+0000 7fa8f1fe3640 20 reqs_thread_entry: start 2024-09-12T00:50:04.498 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.498+0000 7faa40b2c800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:04.498 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.498+0000 7faa40b2c800 20 Filter name: none 2024-09-12T00:50:04.498 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.499+0000 7fa8637fe640 20 reqs_thread_entry: start 2024-09-12T00:50:04.498 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.499+0000 7faa40b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.499 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.499+0000 7faa40b2c800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:50:04.499 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.499+0000 7faa40b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.499 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.500+0000 7faa40b2c800 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:50:04.499 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.500+0000 7faa40b2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:04.499 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.500+0000 7faa40b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.499 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.500+0000 7faa40b2c800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:50:04.499 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.500+0000 7faa40b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.500 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.501+0000 7faa40b2c800 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:50:04.500 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.501+0000 7faa40b2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:04.500 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.502+0000 7fa8f2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:04.502 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.504+0000 7faa40b2c800 20 remove_watcher() i=0 2024-09-12T00:50:04.502 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.504+0000 7faa40b2c800 2 removed watcher, disabling cache 2024-09-12T00:50:04.503 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.505+0000 7faa40b2c800 20 remove_watcher() i=1 2024-09-12T00:50:04.504 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.506+0000 7faa40b2c800 20 remove_watcher() i=2 2024-09-12T00:50:04.505 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.507+0000 7faa40b2c800 20 remove_watcher() i=3 2024-09-12T00:50:04.506 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.508+0000 7faa40b2c800 20 remove_watcher() i=4 2024-09-12T00:50:04.507 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.509+0000 7faa40b2c800 20 remove_watcher() i=5 2024-09-12T00:50:04.508 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.510+0000 7faa40b2c800 20 remove_watcher() i=6 2024-09-12T00:50:04.509 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.511+0000 7faa40b2c800 20 remove_watcher() i=7 2024-09-12T00:50:04.520 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:04.520 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:50:04.520 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: abort-at-trim-reshard-log-entries id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:50:04.520 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:04.521 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:04.521 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:04.555 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:04.555 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:04.612 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:50:04.642 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:04.643 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:04.877 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.878+0000 7f797f0c0640 0 --2- 172.21.15.73:0/3759453491 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56350875be50 0x56350875d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T00:50:04.882 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.883+0000 7f798333e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.884 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.885+0000 7f798333e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:04.884 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.885+0000 7f798333e800 20 realm 2024-09-12T00:50:04.884 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.885+0000 7f798333e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.884 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.885+0000 7f798333e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:04.884 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.885+0000 7f798333e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:04.884 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.885+0000 7f798333e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.884 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.885+0000 7f798333e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:04.884 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.885+0000 7f798333e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.885 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.886+0000 7f798333e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:04.885 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.886+0000 7f798333e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.885 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.886+0000 7f798333e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:04.885 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.887+0000 7f798333e800 20 searching for the correct realm 2024-09-12T00:50:04.886 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:04.887+0000 7f797f0c0640 0 -- 172.21.15.73:0/546775740 >> [v2:172.21.15.117:6816/1460498570,v1:172.21.15.117:6817/1460498570] conn(0x7f7978073030 msgr2=0x7f79780a4610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:05.091 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.092+0000 7f7977fff640 0 -- 172.21.15.73:0/546775740 >> [v2:172.21.15.73:6826/269690776,v1:172.21.15.73:6827/269690776] conn(0x7f7970001c20 msgr2=0x7f79700672c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:05.096 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.098+0000 7f798333e800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:50:05.097 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.098+0000 7f798333e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:05.097 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.098+0000 7f798333e800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:50:05.097 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.098+0000 7f798333e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:05.097 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.098+0000 7f798333e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:05.097 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.098+0000 7f798333e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:05.097 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.098+0000 7f798333e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:05.097 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.098+0000 7f798333e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:05.097 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.098+0000 7f798333e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:05.098 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.098+0000 7f798333e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:05.099 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.098+0000 7f798333e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:05.099 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.098+0000 7f798333e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:05.099 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.098+0000 7f798333e800 20 zone default found 2024-09-12T00:50:05.099 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.098+0000 7f798333e800 4 Realm: () 2024-09-12T00:50:05.099 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.098+0000 7f798333e800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:50:05.099 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.098+0000 7f798333e800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:50:05.099 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.098+0000 7f798333e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:05.099 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.098+0000 7f798333e800 20 zonegroup default 2024-09-12T00:50:05.099 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.098+0000 7f798333e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:05.099 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.099+0000 7f798333e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:05.099 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.099+0000 7f798333e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:05.099 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.099+0000 7f798333e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:05.100 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.099+0000 7f798333e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:05.100 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.099+0000 7f798333e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:05.100 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.099+0000 7f798333e800 20 started sync module instance, tier type = 2024-09-12T00:50:05.100 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.099+0000 7f798333e800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:50:05.107 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.108+0000 7f798333e800 20 add_watcher() i=0 2024-09-12T00:50:05.107 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.108+0000 7f798333e800 20 add_watcher() i=1 2024-09-12T00:50:05.107 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.108+0000 7f798333e800 20 add_watcher() i=2 2024-09-12T00:50:05.107 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.108+0000 7f798333e800 20 add_watcher() i=3 2024-09-12T00:50:05.107 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.108+0000 7f798333e800 20 add_watcher() i=4 2024-09-12T00:50:05.107 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.108+0000 7f798333e800 20 add_watcher() i=5 2024-09-12T00:50:05.107 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.108+0000 7f798333e800 20 add_watcher() i=6 2024-09-12T00:50:05.107 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.109+0000 7f798333e800 20 add_watcher() i=7 2024-09-12T00:50:05.108 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.109+0000 7f798333e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:05.109 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.110+0000 7f78367e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:05.110 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.111+0000 7f798333e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:05.110 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.111+0000 7f798333e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:05.110 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.111+0000 7f798333e800 5 note: GC not initialized 2024-09-12T00:50:05.110 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.111+0000 7f78357e2640 20 reqs_thread_entry: start 2024-09-12T00:50:05.110 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.111+0000 7f798333e800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:05.111 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.111+0000 7f798333e800 20 Filter name: none 2024-09-12T00:50:05.111 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.111+0000 7f782e7fc640 20 reqs_thread_entry: start 2024-09-12T00:50:05.111 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.111+0000 7f798333e800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:50:05.111 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.111+0000 7f798333e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:05.112 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.112+0000 7f798333e800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:50:05.112 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.112+0000 7f798333e800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:50:05.112 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.112+0000 7f798333e800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:50:05.112 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.112+0000 7f798333e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27 : miss 2024-09-12T00:50:05.112 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.112+0000 7f798333e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:05.112 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.113+0000 7f798333e800 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:50:05.112 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.113+0000 7f798333e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27 info.flags=0x17 2024-09-12T00:50:05.112 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.113+0000 7f798333e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27 to cache LRU end 2024-09-12T00:50:05.112 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.113+0000 7f798333e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:05.112 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.113+0000 7f798333e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:05.112 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.113+0000 7f798333e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27 2024-09-12T00:50:05.113 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.114+0000 7f798333e800 0 INFO: RGWReshardLock::lock found lock on abort-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27 to be held by another RGW process; skipping for now 2024-09-12T00:50:05.113 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.115+0000 7f78367e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:05.115 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.117+0000 7f798333e800 20 remove_watcher() i=0 2024-09-12T00:50:05.115 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.117+0000 7f798333e800 2 removed watcher, disabling cache 2024-09-12T00:50:05.116 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.118+0000 7f798333e800 20 remove_watcher() i=1 2024-09-12T00:50:05.117 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.119+0000 7f798333e800 20 remove_watcher() i=2 2024-09-12T00:50:05.118 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.120+0000 7f798333e800 20 remove_watcher() i=3 2024-09-12T00:50:05.119 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.121+0000 7f798333e800 20 remove_watcher() i=4 2024-09-12T00:50:05.120 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.122+0000 7f798333e800 20 remove_watcher() i=5 2024-09-12T00:50:05.121 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.123+0000 7f798333e800 20 remove_watcher() i=6 2024-09-12T00:50:05.122 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:05.124+0000 7f798333e800 20 remove_watcher() i=7 2024-09-12T00:50:05.132 INFO:tasks.workunit.client.0.smithi073.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:50:35.164 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:50:35.200 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:35.200 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:35.242 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.243+0000 7fea89630800 20 rados->read ofs=0 len=0 2024-09-12T00:50:35.244 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.245+0000 7fea89630800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:35.244 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.245+0000 7fea89630800 20 realm 2024-09-12T00:50:35.244 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.245+0000 7fea89630800 20 rados->read ofs=0 len=0 2024-09-12T00:50:35.244 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.245+0000 7fea89630800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:35.244 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.245+0000 7fea89630800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:35.244 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.245+0000 7fea89630800 20 rados->read ofs=0 len=0 2024-09-12T00:50:35.244 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.245+0000 7fea89630800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:35.244 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.245+0000 7fea89630800 20 rados->read ofs=0 len=0 2024-09-12T00:50:35.245 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.246+0000 7fea89630800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:35.245 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.246+0000 7fea89630800 20 rados->read ofs=0 len=0 2024-09-12T00:50:35.246 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.247+0000 7fea89630800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:35.246 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.247+0000 7fea89630800 20 searching for the correct realm 2024-09-12T00:50:35.248 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.250+0000 7fea85154640 0 -- 172.21.15.73:0/2115015238 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fea78074030 msgr2=0x7fea780c1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:35.456 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.457+0000 7fea85154640 0 -- 172.21.15.73:0/2115015238 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fea78074030 msgr2=0x7fea780c1820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:35.461 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.462+0000 7fea89630800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:50:35.461 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.462+0000 7fea89630800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:35.461 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.462+0000 7fea89630800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:50:35.461 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.462+0000 7fea89630800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:35.461 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.462+0000 7fea89630800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:35.461 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.462+0000 7fea89630800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:35.461 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.462+0000 7fea89630800 20 rados->read ofs=0 len=0 2024-09-12T00:50:35.461 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.462+0000 7fea89630800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:35.461 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.462+0000 7fea89630800 20 rados->read ofs=0 len=0 2024-09-12T00:50:35.463 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.462+0000 7fea89630800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:35.463 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.462+0000 7fea89630800 20 rados->read ofs=0 len=0 2024-09-12T00:50:35.463 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.463+0000 7fea89630800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:35.463 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.463+0000 7fea89630800 20 zone default found 2024-09-12T00:50:35.463 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.463+0000 7fea89630800 4 Realm: () 2024-09-12T00:50:35.463 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.463+0000 7fea89630800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:50:35.463 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.463+0000 7fea89630800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:50:35.463 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.463+0000 7fea89630800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:35.463 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.463+0000 7fea89630800 20 zonegroup default 2024-09-12T00:50:35.463 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.463+0000 7fea89630800 20 rados->read ofs=0 len=0 2024-09-12T00:50:35.464 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.463+0000 7fea89630800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:35.464 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.463+0000 7fea89630800 20 rados->read ofs=0 len=0 2024-09-12T00:50:35.464 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.463+0000 7fea89630800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:35.464 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.463+0000 7fea89630800 20 rados->read ofs=0 len=0 2024-09-12T00:50:35.464 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.464+0000 7fea89630800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:35.464 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.464+0000 7fea89630800 20 started sync module instance, tier type = 2024-09-12T00:50:35.464 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.464+0000 7fea89630800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:50:35.473 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.474+0000 7fea89630800 20 add_watcher() i=0 2024-09-12T00:50:35.473 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.474+0000 7fea89630800 20 add_watcher() i=1 2024-09-12T00:50:35.473 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.474+0000 7fea89630800 20 add_watcher() i=2 2024-09-12T00:50:35.473 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.474+0000 7fea89630800 20 add_watcher() i=3 2024-09-12T00:50:35.473 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.474+0000 7fea89630800 20 add_watcher() i=4 2024-09-12T00:50:35.473 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.474+0000 7fea89630800 20 add_watcher() i=5 2024-09-12T00:50:35.473 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.474+0000 7fea89630800 20 add_watcher() i=6 2024-09-12T00:50:35.474 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.475+0000 7fea89630800 20 add_watcher() i=7 2024-09-12T00:50:35.474 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.475+0000 7fea89630800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:35.477 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.477+0000 7fe93afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:35.477 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.477+0000 7fea89630800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:35.477 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.477+0000 7fea89630800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:35.477 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.478+0000 7fea89630800 5 note: GC not initialized 2024-09-12T00:50:35.477 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.478+0000 7fe939fe3640 20 reqs_thread_entry: start 2024-09-12T00:50:35.477 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.478+0000 7fea89630800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:35.477 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.478+0000 7fea89630800 20 Filter name: none 2024-09-12T00:50:35.477 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.478+0000 7fe8ab7fe640 20 reqs_thread_entry: start 2024-09-12T00:50:35.478 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.478+0000 7fea89630800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:50:35.478 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.478+0000 7fea89630800 20 rados->read ofs=0 len=0 2024-09-12T00:50:35.479 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.479+0000 7fea89630800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:50:35.479 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.479+0000 7fea89630800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:50:35.479 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.479+0000 7fea89630800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:50:35.479 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.479+0000 7fea89630800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27 : miss 2024-09-12T00:50:35.479 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.479+0000 7fea89630800 20 rados->read ofs=0 len=0 2024-09-12T00:50:35.479 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.479+0000 7fea89630800 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:50:35.479 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.479+0000 7fea89630800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27 info.flags=0x17 2024-09-12T00:50:35.479 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.479+0000 7fea89630800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27 to cache LRU end 2024-09-12T00:50:35.479 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.479+0000 7fea89630800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:35.479 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.479+0000 7fea89630800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:35.479 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.479+0000 7fea89630800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27 2024-09-12T00:50:35.480 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.480+0000 7fea89630800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:50:35.483 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.484+0000 7fea89630800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27 info.flags=0x17 2024-09-12T00:50:35.483 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.484+0000 7fea89630800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27 to cache LRU end 2024-09-12T00:50:35.483 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.484+0000 7fea89630800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:35.483 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.484+0000 7fea89630800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27, ofs0, ns] 2024-09-12T00:50:35.484 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.485+0000 7fe95bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497044 cookie 94047328888096 notifier 6954 bl.length()=939 2024-09-12T00:50:35.484 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.485+0000 7fe95bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27 info.flags=0x17 2024-09-12T00:50:35.484 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.485+0000 7fe95bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27 to cache LRU end 2024-09-12T00:50:35.484 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.485+0000 7fe95bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:35.485 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.487+0000 7fea89630800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27]): orig_sources= new_sources= 2024-09-12T00:50:35.485 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.487+0000 7fea89630800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27]): potential sources added=[] removed=[] 2024-09-12T00:50:35.485 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.487+0000 7fea89630800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27]): orig_dests= new_dests= 2024-09-12T00:50:35.486 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.487+0000 7fea89630800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27]): potential dests added=[] removed=[] 2024-09-12T00:50:35.488 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.489+0000 7fea89630800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27.2.0 2024-09-12T00:50:35.488 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.489+0000 7fea89630800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27.2.0 2024-09-12T00:50:35.488 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.489+0000 7fea89630800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27.2.1 2024-09-12T00:50:35.488 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.489+0000 7fea89630800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27.2.1 2024-09-12T00:50:35.488 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.489+0000 7fea89630800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27.0 2024-09-12T00:50:35.490 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.492+0000 7fea89630800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27 : hit (requested=0x17, cached=0x17) 2024-09-12T00:50:35.490 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.492+0000 7fea89630800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27 2024-09-12T00:50:35.492 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.493+0000 7fea89630800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27 info.flags=0x17 2024-09-12T00:50:35.492 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.493+0000 7fea89630800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27 to cache LRU end 2024-09-12T00:50:35.492 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.493+0000 7fea89630800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:35.492 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.493+0000 7fea89630800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27, ofs0, ns] 2024-09-12T00:50:35.492 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.493+0000 7fe95bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497045 cookie 94047328888096 notifier 6954 bl.length()=939 2024-09-12T00:50:35.492 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.493+0000 7fe95bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27 info.flags=0x17 2024-09-12T00:50:35.492 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.493+0000 7fe95bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27 to cache LRU end 2024-09-12T00:50:35.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.493+0000 7fe95bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:35.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.495+0000 7fea89630800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27]): orig_sources= new_sources= 2024-09-12T00:50:35.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.495+0000 7fea89630800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27]): potential sources added=[] removed=[] 2024-09-12T00:50:35.494 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.495+0000 7fea89630800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27]): orig_dests= new_dests= 2024-09-12T00:50:35.494 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.495+0000 7fea89630800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27]): potential dests added=[] removed=[] 2024-09-12T00:50:35.495 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.496+0000 7fea89630800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27.0 2024-09-12T00:50:35.495 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.496+0000 7fea89630800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27 : hit (requested=0x17, cached=0x17) 2024-09-12T00:50:35.495 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.496+0000 7fea89630800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27 2024-09-12T00:50:35.496 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.498+0000 7fea89630800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27 info.flags=0x17 2024-09-12T00:50:35.496 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.498+0000 7fea89630800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27 to cache LRU end 2024-09-12T00:50:35.496 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.498+0000 7fea89630800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:35.497 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.498+0000 7fea89630800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27, ofs0, ns] 2024-09-12T00:50:35.497 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.498+0000 7fe95b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497046 cookie 94047328888096 notifier 6954 bl.length()=907 2024-09-12T00:50:35.497 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.498+0000 7fe95b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27 info.flags=0x17 2024-09-12T00:50:35.497 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.498+0000 7fe95b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27 to cache LRU end 2024-09-12T00:50:35.497 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.498+0000 7fe95b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:35.498 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.499+0000 7fea89630800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27]): orig_sources= new_sources= 2024-09-12T00:50:35.498 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.499+0000 7fea89630800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27]): potential sources added=[] removed=[] 2024-09-12T00:50:35.498 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.499+0000 7fea89630800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27]): orig_dests= new_dests= 2024-09-12T00:50:35.498 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.499+0000 7fea89630800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27]): potential dests added=[] removed=[] 2024-09-12T00:50:35.499 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.500+0000 7fea89630800 1 execute INFO: reshard of bucket "abort-at-trim-reshard-log-entries" from 1 shards to 2 shards completed successfully 2024-09-12T00:50:35.501 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.502+0000 7fe93afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:35.504 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.505+0000 7fea89630800 20 remove_watcher() i=0 2024-09-12T00:50:35.504 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.505+0000 7fea89630800 2 removed watcher, disabling cache 2024-09-12T00:50:35.505 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.506+0000 7fea89630800 20 remove_watcher() i=1 2024-09-12T00:50:35.506 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.507+0000 7fea89630800 20 remove_watcher() i=2 2024-09-12T00:50:35.507 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.508+0000 7fea89630800 20 remove_watcher() i=3 2024-09-12T00:50:35.509 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.510+0000 7fea89630800 20 remove_watcher() i=4 2024-09-12T00:50:35.510 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.511+0000 7fea89630800 20 remove_watcher() i=5 2024-09-12T00:50:35.511 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.512+0000 7fea89630800 20 remove_watcher() i=6 2024-09-12T00:50:35.512 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.513+0000 7fea89630800 20 remove_watcher() i=7 2024-09-12T00:50:35.525 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T00:50:35.554 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:35.554 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:35.591 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.592+0000 7f7949935800 20 rados->read ofs=0 len=0 2024-09-12T00:50:35.593 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.594+0000 7f7949935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:35.593 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.594+0000 7f7949935800 20 realm 2024-09-12T00:50:35.593 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.594+0000 7f7949935800 20 rados->read ofs=0 len=0 2024-09-12T00:50:35.593 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.594+0000 7f7949935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:35.593 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.594+0000 7f7949935800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:35.594 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.594+0000 7f7949935800 20 rados->read ofs=0 len=0 2024-09-12T00:50:35.594 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.594+0000 7f7949935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:35.594 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.594+0000 7f7949935800 20 rados->read ofs=0 len=0 2024-09-12T00:50:35.797 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.798+0000 7f7949935800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:35.797 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.798+0000 7f7949935800 20 rados->read ofs=0 len=0 2024-09-12T00:50:35.797 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.799+0000 7f7949935800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:35.797 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.799+0000 7f7949935800 20 searching for the correct realm 2024-09-12T00:50:35.799 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:35.801+0000 7f7945e22640 0 -- 172.21.15.73:0/4076345795 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f7930082020 msgr2=0x7f79300c1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:36.007 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.008+0000 7f7945e22640 0 -- 172.21.15.73:0/4076345795 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f7930082020 msgr2=0x7f79300c1ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:36.011 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.012+0000 7f7949935800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:50:36.011 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.012+0000 7f7949935800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:36.011 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.012+0000 7f7949935800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:50:36.011 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.012+0000 7f7949935800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:36.011 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.012+0000 7f7949935800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:36.011 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.012+0000 7f7949935800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:36.011 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.012+0000 7f7949935800 20 rados->read ofs=0 len=0 2024-09-12T00:50:36.011 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.012+0000 7f7949935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:36.012 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.012+0000 7f7949935800 20 rados->read ofs=0 len=0 2024-09-12T00:50:36.013 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.013+0000 7f7949935800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:36.013 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.013+0000 7f7949935800 20 rados->read ofs=0 len=0 2024-09-12T00:50:36.013 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.013+0000 7f7949935800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:36.013 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.013+0000 7f7949935800 20 zone default found 2024-09-12T00:50:36.013 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.013+0000 7f7949935800 4 Realm: () 2024-09-12T00:50:36.013 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.013+0000 7f7949935800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:50:36.013 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.013+0000 7f7949935800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:50:36.013 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.013+0000 7f7949935800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:36.014 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.013+0000 7f7949935800 20 zonegroup default 2024-09-12T00:50:36.014 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.013+0000 7f7949935800 20 rados->read ofs=0 len=0 2024-09-12T00:50:36.014 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.013+0000 7f7949935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:36.014 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.013+0000 7f7949935800 20 rados->read ofs=0 len=0 2024-09-12T00:50:36.014 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.013+0000 7f7949935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:36.014 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.013+0000 7f7949935800 20 rados->read ofs=0 len=0 2024-09-12T00:50:36.014 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.014+0000 7f7949935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:36.014 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.014+0000 7f7949935800 20 started sync module instance, tier type = 2024-09-12T00:50:36.014 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.014+0000 7f7949935800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:50:36.022 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.023+0000 7f7949935800 20 add_watcher() i=0 2024-09-12T00:50:36.022 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.023+0000 7f7949935800 20 add_watcher() i=1 2024-09-12T00:50:36.022 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.023+0000 7f7949935800 20 add_watcher() i=2 2024-09-12T00:50:36.022 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.023+0000 7f7949935800 20 add_watcher() i=3 2024-09-12T00:50:36.022 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.023+0000 7f7949935800 20 add_watcher() i=4 2024-09-12T00:50:36.022 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.023+0000 7f7949935800 20 add_watcher() i=5 2024-09-12T00:50:36.022 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.023+0000 7f7949935800 20 add_watcher() i=6 2024-09-12T00:50:36.023 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.024+0000 7f7949935800 20 add_watcher() i=7 2024-09-12T00:50:36.023 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.024+0000 7f7949935800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:36.025 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.026+0000 7f77fb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:36.025 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.026+0000 7f7949935800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:36.026 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.026+0000 7f7949935800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:36.026 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.026+0000 7f7949935800 5 note: GC not initialized 2024-09-12T00:50:36.026 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.026+0000 7f77fa7e4640 20 reqs_thread_entry: start 2024-09-12T00:50:36.026 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.026+0000 7f7949935800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:36.026 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.026+0000 7f7949935800 20 Filter name: none 2024-09-12T00:50:36.026 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.027+0000 7f776bfff640 20 reqs_thread_entry: start 2024-09-12T00:50:36.026 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.027+0000 7f7949935800 20 rados->read ofs=0 len=0 2024-09-12T00:50:36.027 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.027+0000 7f7949935800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:50:36.028 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.027+0000 7f7949935800 20 rados->read ofs=0 len=0 2024-09-12T00:50:36.028 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.028+0000 7f7949935800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:50:36.028 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.028+0000 7f7949935800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:36.028 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.028+0000 7f7949935800 20 rados->read ofs=0 len=0 2024-09-12T00:50:36.028 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.028+0000 7f7949935800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:50:36.028 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.028+0000 7f7949935800 20 rados->read ofs=0 len=0 2024-09-12T00:50:36.028 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.029+0000 7f7949935800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:50:36.028 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.029+0000 7f7949935800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:36.028 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.030+0000 7f77fb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:36.031 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.032+0000 7f7949935800 20 remove_watcher() i=0 2024-09-12T00:50:36.031 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.032+0000 7f7949935800 2 removed watcher, disabling cache 2024-09-12T00:50:36.032 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.033+0000 7f7949935800 20 remove_watcher() i=1 2024-09-12T00:50:36.033 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.035+0000 7f7949935800 20 remove_watcher() i=2 2024-09-12T00:50:36.035 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.036+0000 7f7949935800 20 remove_watcher() i=3 2024-09-12T00:50:36.036 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.037+0000 7f7949935800 20 remove_watcher() i=4 2024-09-12T00:50:36.037 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.038+0000 7f7949935800 20 remove_watcher() i=5 2024-09-12T00:50:36.038 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.039+0000 7f7949935800 20 remove_watcher() i=6 2024-09-12T00:50:36.039 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:36.040+0000 7f7949935800 20 remove_watcher() i=7 2024-09-12T00:50:36.049 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:36.049 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:50:36.049 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: abort-at-trim-reshard-log-entries id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:50:36.049 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:36.051 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:36.051 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:36.071 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:36.072 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:36.274 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:36.274 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:36.337 INFO:tasks.workunit.client.0.smithi073.stderr:TEST: reshard bucket with EIO injected at block_writes 2024-09-12T00:50:36.337 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:36.338 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:36.338 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:36.379 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:36.379 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:36.434 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:36.435 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:36.472 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:36.473 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:36.507 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:36.507 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:36.542 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:36.542 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:36.576 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:36.576 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:36.612 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:36.612 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:36.647 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:36.647 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:36.682 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:36.682 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:36.717 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:36.717 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:36.752 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:36.752 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:36.788 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:36.788 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:36.821 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:36.822 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:36.856 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:36.856 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:36.890 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:36.890 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:36.926 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:36.926 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:36.962 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:36.963 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:36.998 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:36.998 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:37.034 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:37.034 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:37.069 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:37.069 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:37.104 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:37.104 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:37.140 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T00:50:37.169 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:37.169 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:37.205 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.206+0000 7f4233322800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.207 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.208+0000 7f4233322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:37.207 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.208+0000 7f4233322800 20 realm 2024-09-12T00:50:37.207 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.208+0000 7f4233322800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.208 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.208+0000 7f4233322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:37.208 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.208+0000 7f4233322800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:37.208 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.208+0000 7f4233322800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.208 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.209+0000 7f4233322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:37.208 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.209+0000 7f4233322800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.209 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.210+0000 7f4233322800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:37.209 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.210+0000 7f4233322800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.210 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.211+0000 7f4233322800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:37.210 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.211+0000 7f4233322800 20 searching for the correct realm 2024-09-12T00:50:37.213 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.214+0000 7f422ef02640 0 -- 172.21.15.73:0/2872040065 >> [v2:172.21.15.117:6816/1460498570,v1:172.21.15.117:6817/1460498570] conn(0x7f422800e040 msgr2=0x7f422806b8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:37.217 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.218+0000 7f422ef02640 0 -- 172.21.15.73:0/2872040065 >> [v2:172.21.15.117:6816/1460498570,v1:172.21.15.117:6817/1460498570] conn(0x7f40f8086310 msgr2=0x7f40f8088740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:37.221 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.222+0000 7f4233322800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:50:37.221 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.222+0000 7f4233322800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:37.221 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.222+0000 7f4233322800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:50:37.221 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.222+0000 7f4233322800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:37.221 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.222+0000 7f4233322800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:37.221 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.222+0000 7f4233322800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:37.221 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.222+0000 7f4233322800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.221 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.222+0000 7f4233322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:37.221 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.222+0000 7f4233322800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.223 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.222+0000 7f4233322800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:37.223 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.222+0000 7f4233322800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.223 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.223+0000 7f4233322800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:37.223 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.223+0000 7f4233322800 20 zone default found 2024-09-12T00:50:37.223 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.223+0000 7f4233322800 4 Realm: () 2024-09-12T00:50:37.223 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.223+0000 7f4233322800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:50:37.224 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.223+0000 7f4233322800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:50:37.224 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.223+0000 7f4233322800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:37.224 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.223+0000 7f4233322800 20 zonegroup default 2024-09-12T00:50:37.224 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.223+0000 7f4233322800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.224 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.223+0000 7f4233322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:37.224 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.223+0000 7f4233322800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.224 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.223+0000 7f4233322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:37.224 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.223+0000 7f4233322800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.224 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.223+0000 7f4233322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:37.224 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.223+0000 7f4233322800 20 started sync module instance, tier type = 2024-09-12T00:50:37.224 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.223+0000 7f4233322800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:50:37.232 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.233+0000 7f4233322800 20 add_watcher() i=0 2024-09-12T00:50:37.232 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.233+0000 7f4233322800 20 add_watcher() i=1 2024-09-12T00:50:37.232 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.233+0000 7f4233322800 20 add_watcher() i=2 2024-09-12T00:50:37.232 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.233+0000 7f4233322800 20 add_watcher() i=3 2024-09-12T00:50:37.232 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.233+0000 7f4233322800 20 add_watcher() i=4 2024-09-12T00:50:37.232 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.233+0000 7f4233322800 20 add_watcher() i=5 2024-09-12T00:50:37.232 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.233+0000 7f4233322800 20 add_watcher() i=6 2024-09-12T00:50:37.233 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.234+0000 7f4233322800 20 add_watcher() i=7 2024-09-12T00:50:37.233 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.234+0000 7f4233322800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:37.235 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.236+0000 7f40e57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:37.235 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.236+0000 7f4233322800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:37.235 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.236+0000 7f4233322800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:37.235 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.236+0000 7f4233322800 5 note: GC not initialized 2024-09-12T00:50:37.235 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.236+0000 7f405ffff640 20 reqs_thread_entry: start 2024-09-12T00:50:37.236 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.236+0000 7f4233322800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:37.236 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.236+0000 7f4233322800 20 Filter name: none 2024-09-12T00:50:37.236 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.236+0000 7f405dffb640 20 reqs_thread_entry: start 2024-09-12T00:50:37.236 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.236+0000 7f4233322800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.237 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.237+0000 7f4233322800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:50:37.237 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.237+0000 7f4233322800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.237 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.237+0000 7f4233322800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:50:37.237 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.237+0000 7f4233322800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:37.237 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.238+0000 7f4233322800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.237 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.238+0000 7f4233322800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:50:37.237 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.238+0000 7f4233322800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.237 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.238+0000 7f4233322800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:50:37.237 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.238+0000 7f4233322800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:37.238 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.239+0000 7f40e57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:37.241 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.242+0000 7f4233322800 20 remove_watcher() i=0 2024-09-12T00:50:37.241 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.242+0000 7f4233322800 2 removed watcher, disabling cache 2024-09-12T00:50:37.241 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.243+0000 7f4233322800 20 remove_watcher() i=1 2024-09-12T00:50:37.242 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.244+0000 7f4233322800 20 remove_watcher() i=2 2024-09-12T00:50:37.243 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.245+0000 7f4233322800 20 remove_watcher() i=3 2024-09-12T00:50:37.244 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.246+0000 7f4233322800 20 remove_watcher() i=4 2024-09-12T00:50:37.245 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.247+0000 7f4233322800 20 remove_watcher() i=5 2024-09-12T00:50:37.246 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.248+0000 7f4233322800 20 remove_watcher() i=6 2024-09-12T00:50:37.247 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.249+0000 7f4233322800 20 remove_watcher() i=7 2024-09-12T00:50:37.257 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:37.257 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:50:37.257 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: error-at-block-writes id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:50:37.257 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:37.259 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2024-09-12T00:50:37.292 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:37.293 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:37.330 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.331+0000 7f47eddab800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.332 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.332+0000 7f47eddab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:37.332 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.332+0000 7f47eddab800 20 realm 2024-09-12T00:50:37.332 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.332+0000 7f47eddab800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.332 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.333+0000 7f47eddab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:37.332 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.333+0000 7f47eddab800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:37.332 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.333+0000 7f47eddab800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.332 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.333+0000 7f47eddab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:37.332 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.333+0000 7f47eddab800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.333 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.334+0000 7f47eddab800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:37.333 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.334+0000 7f47eddab800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.334 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.335+0000 7f47eddab800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:37.334 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.335+0000 7f47eddab800 20 searching for the correct realm 2024-09-12T00:50:37.336 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.337+0000 7f47ec096640 0 -- 172.21.15.73:0/4229424060 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f47e0018070 msgr2=0x7f47e005fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:50:37.543 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.544+0000 7f47ec096640 0 -- 172.21.15.73:0/4229424060 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f47e0018070 msgr2=0x7f47e005fa30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:37.548 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.548+0000 7f47eddab800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:50:37.548 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.548+0000 7f47eddab800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:37.548 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.548+0000 7f47eddab800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:50:37.548 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.548+0000 7f47eddab800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:37.548 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.548+0000 7f47eddab800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:37.548 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.548+0000 7f47eddab800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:37.548 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.548+0000 7f47eddab800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.548 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.548+0000 7f47eddab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:37.548 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.548+0000 7f47eddab800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.548 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.548+0000 7f47eddab800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:37.549 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.548+0000 7f47eddab800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.549 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.548+0000 7f47eddab800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:37.549 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.548+0000 7f47eddab800 20 zone default found 2024-09-12T00:50:37.549 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.548+0000 7f47eddab800 4 Realm: () 2024-09-12T00:50:37.549 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.548+0000 7f47eddab800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:50:37.549 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.548+0000 7f47eddab800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:50:37.549 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.548+0000 7f47eddab800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:37.549 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.548+0000 7f47eddab800 20 zonegroup default 2024-09-12T00:50:37.549 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.548+0000 7f47eddab800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.549 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.549+0000 7f47eddab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:37.549 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.549+0000 7f47eddab800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.549 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.549+0000 7f47eddab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:37.550 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.549+0000 7f47eddab800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.550 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.549+0000 7f47eddab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:37.550 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.549+0000 7f47eddab800 20 started sync module instance, tier type = 2024-09-12T00:50:37.550 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.549+0000 7f47eddab800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:50:37.558 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.559+0000 7f47eddab800 20 add_watcher() i=0 2024-09-12T00:50:37.558 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.559+0000 7f47eddab800 20 add_watcher() i=1 2024-09-12T00:50:37.558 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.559+0000 7f47eddab800 20 add_watcher() i=2 2024-09-12T00:50:37.558 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.559+0000 7f47eddab800 20 add_watcher() i=3 2024-09-12T00:50:37.558 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.559+0000 7f47eddab800 20 add_watcher() i=4 2024-09-12T00:50:37.558 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.559+0000 7f47eddab800 20 add_watcher() i=5 2024-09-12T00:50:37.559 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.559+0000 7f47eddab800 20 add_watcher() i=6 2024-09-12T00:50:37.559 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.560+0000 7f47eddab800 20 add_watcher() i=7 2024-09-12T00:50:37.559 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.560+0000 7f47eddab800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:37.561 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.562+0000 7f46a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:37.561 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.562+0000 7f47eddab800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:37.561 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.562+0000 7f47eddab800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:37.561 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.562+0000 7f47eddab800 5 note: GC not initialized 2024-09-12T00:50:37.561 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.562+0000 7f46a0fe1640 20 reqs_thread_entry: start 2024-09-12T00:50:37.561 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.562+0000 7f47eddab800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:37.562 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.562+0000 7f47eddab800 20 Filter name: none 2024-09-12T00:50:37.562 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.562+0000 7f461a7fc640 20 reqs_thread_entry: start 2024-09-12T00:50:37.562 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.562+0000 7f47eddab800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-12T00:50:37.562 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.562+0000 7f47eddab800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.563 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.563+0000 7f47eddab800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:50:37.563 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.563+0000 7f47eddab800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-12T00:50:37.563 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.563+0000 7f47eddab800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-12T00:50:37.563 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.563+0000 7f47eddab800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28 : miss 2024-09-12T00:50:37.563 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.563+0000 7f47eddab800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.563 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.563+0000 7f47eddab800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:50:37.563 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.563+0000 7f47eddab800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28 info.flags=0x17 2024-09-12T00:50:37.563 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.563+0000 7f47eddab800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28 to cache LRU end 2024-09-12T00:50:37.563 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.563+0000 7f47eddab800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:37.563 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.563+0000 7f47eddab800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:37.564 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.563+0000 7f47eddab800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28 2024-09-12T00:50:37.566 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.567+0000 7f47eddab800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28 info.flags=0x17 2024-09-12T00:50:37.566 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.567+0000 7f47eddab800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28 to cache LRU end 2024-09-12T00:50:37.566 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.567+0000 7f47eddab800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:37.566 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.567+0000 7f47eddab800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28, ofs0, ns] 2024-09-12T00:50:37.566 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.567+0000 7f46caffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497001 cookie 94579197353616 notifier 6626 bl.length()=915 2024-09-12T00:50:37.566 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.567+0000 7f46caffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28 info.flags=0x17 2024-09-12T00:50:37.567 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.567+0000 7f46caffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28 to cache LRU end 2024-09-12T00:50:37.567 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.567+0000 7f46caffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:37.567 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.569+0000 7f47eddab800 20 handle_bi_update(): bucket=:error-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28]): orig_sources= new_sources= 2024-09-12T00:50:37.568 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.569+0000 7f47eddab800 20 handle_bi_update(): bucket=:error-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28]): potential sources added=[] removed=[] 2024-09-12T00:50:37.568 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.569+0000 7f47eddab800 20 handle_bi_update(): bucket=:error-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28]): orig_dests= new_dests= 2024-09-12T00:50:37.568 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.569+0000 7f47eddab800 20 handle_bi_update(): bucket=:error-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28]): potential dests added=[] removed=[] 2024-09-12T00:50:37.573 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.571+0000 7f47eddab800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28.1.0 2024-09-12T00:50:37.573 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.571+0000 7f47eddab800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28.1.0 2024-09-12T00:50:37.573 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.571+0000 7f47eddab800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28.1.1 2024-09-12T00:50:37.573 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.571+0000 7f47eddab800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28.1.1 2024-09-12T00:50:37.573 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.571+0000 7f47eddab800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28.0 2024-09-12T00:50:37.574 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.574+0000 7f47eddab800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28 : hit (requested=0x17, cached=0x17) 2024-09-12T00:50:37.574 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.574+0000 7f47eddab800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28 2024-09-12T00:50:37.575 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.575+0000 7f47eddab800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28 info.flags=0x17 2024-09-12T00:50:37.575 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.575+0000 7f47eddab800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28 to cache LRU end 2024-09-12T00:50:37.576 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.575+0000 7f47eddab800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:37.576 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.575+0000 7f47eddab800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28, ofs0, ns] 2024-09-12T00:50:37.576 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.575+0000 7f46caffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497002 cookie 94579197353616 notifier 6626 bl.length()=915 2024-09-12T00:50:37.576 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.575+0000 7f46caffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28 info.flags=0x17 2024-09-12T00:50:37.576 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.575+0000 7f46caffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28 to cache LRU end 2024-09-12T00:50:37.576 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.575+0000 7f46caffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:37.576 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.576+0000 7f47eddab800 20 handle_bi_update(): bucket=:error-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28]): orig_sources= new_sources= 2024-09-12T00:50:37.577 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.576+0000 7f47eddab800 20 handle_bi_update(): bucket=:error-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28]): potential sources added=[] removed=[] 2024-09-12T00:50:37.577 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.576+0000 7f47eddab800 20 handle_bi_update(): bucket=:error-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28]): orig_dests= new_dests= 2024-09-12T00:50:37.577 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.576+0000 7f47eddab800 20 handle_bi_update(): bucket=:error-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28]): potential dests added=[] removed=[] 2024-09-12T00:50:37.577 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.576+0000 7f47eddab800 -1 Injecting error=-5 at location=block_writes 2024-09-12T00:50:37.577 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.576+0000 7f47eddab800 0 ERROR: change_reshard_state failed to pause writes to the current index: (5) Input/output error 2024-09-12T00:50:37.578 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.579+0000 7f47eddab800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28 : hit (requested=0x17, cached=0x17) 2024-09-12T00:50:37.578 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.579+0000 7f47eddab800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28 2024-09-12T00:50:37.579 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.580+0000 7f47eddab800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28 info.flags=0x17 2024-09-12T00:50:37.579 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.580+0000 7f47eddab800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28 to cache LRU end 2024-09-12T00:50:37.579 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.580+0000 7f47eddab800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:37.579 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.580+0000 7f47eddab800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28, ofs0, ns] 2024-09-12T00:50:37.580 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.580+0000 7f46ca7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497003 cookie 94579197353616 notifier 6626 bl.length()=883 2024-09-12T00:50:37.580 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.580+0000 7f46ca7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28 info.flags=0x17 2024-09-12T00:50:37.580 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.580+0000 7f46ca7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28 to cache LRU end 2024-09-12T00:50:37.580 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.580+0000 7f46ca7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:37.580 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.582+0000 7f47eddab800 20 handle_bi_update(): bucket=:error-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28]): orig_sources= new_sources= 2024-09-12T00:50:37.581 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.582+0000 7f47eddab800 20 handle_bi_update(): bucket=:error-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28]): potential sources added=[] removed=[] 2024-09-12T00:50:37.581 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.582+0000 7f47eddab800 20 handle_bi_update(): bucket=:error-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28]): orig_dests= new_dests= 2024-09-12T00:50:37.581 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.582+0000 7f47eddab800 20 handle_bi_update(): bucket=:error-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28]): potential dests added=[] removed=[] 2024-09-12T00:50:37.582 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.583+0000 7f47eddab800 1 execute INFO: reshard of bucket "error-at-block-writes" canceled due to errors 2024-09-12T00:50:37.583 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.585+0000 7f46a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:37.586 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.587+0000 7f47eddab800 20 remove_watcher() i=0 2024-09-12T00:50:37.586 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.587+0000 7f47eddab800 2 removed watcher, disabling cache 2024-09-12T00:50:37.587 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.588+0000 7f47eddab800 20 remove_watcher() i=1 2024-09-12T00:50:37.588 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.589+0000 7f47eddab800 20 remove_watcher() i=2 2024-09-12T00:50:37.589 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.590+0000 7f47eddab800 20 remove_watcher() i=3 2024-09-12T00:50:37.590 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.591+0000 7f47eddab800 20 remove_watcher() i=4 2024-09-12T00:50:37.591 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.592+0000 7f47eddab800 20 remove_watcher() i=5 2024-09-12T00:50:37.592 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.593+0000 7f47eddab800 20 remove_watcher() i=6 2024-09-12T00:50:37.593 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.594+0000 7f47eddab800 20 remove_watcher() i=7 2024-09-12T00:50:37.604 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T00:50:37.632 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:37.633 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:37.669 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.670+0000 7f554a933800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.671 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.672+0000 7f554a933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:37.672 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.672+0000 7f554a933800 20 realm 2024-09-12T00:50:37.672 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.672+0000 7f554a933800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.672 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.673+0000 7f554a933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:37.672 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.673+0000 7f554a933800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:37.672 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.673+0000 7f554a933800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.672 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.673+0000 7f554a933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:37.672 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.673+0000 7f554a933800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.672 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.674+0000 7f554a933800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:37.673 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.674+0000 7f554a933800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.673 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.675+0000 7f554a933800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:37.673 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.675+0000 7f554a933800 20 searching for the correct realm 2024-09-12T00:50:37.676 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.677+0000 7f5546e1b640 0 -- 172.21.15.73:0/1446678243 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f553c00ac20 msgr2=0x7f553c037910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:37.883 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.884+0000 7f5546e1b640 0 -- 172.21.15.73:0/1446678243 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f553c00ac20 msgr2=0x7f553c037910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:37.888 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.888+0000 7f554a933800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:50:37.888 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.888+0000 7f554a933800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:37.888 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.888+0000 7f554a933800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:50:37.888 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.888+0000 7f554a933800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:37.888 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.888+0000 7f554a933800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:37.889 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.888+0000 7f554a933800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:37.889 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.888+0000 7f554a933800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.889 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.888+0000 7f554a933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:37.889 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.888+0000 7f554a933800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.889 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.889+0000 7f554a933800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:37.889 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.889+0000 7f554a933800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.889 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.889+0000 7f554a933800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:37.889 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.889+0000 7f554a933800 20 zone default found 2024-09-12T00:50:37.889 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.889+0000 7f554a933800 4 Realm: () 2024-09-12T00:50:37.889 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.889+0000 7f554a933800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:50:37.889 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.889+0000 7f554a933800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:50:37.890 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.889+0000 7f554a933800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:37.890 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.889+0000 7f554a933800 20 zonegroup default 2024-09-12T00:50:37.890 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.889+0000 7f554a933800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.890 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.889+0000 7f554a933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:37.890 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.889+0000 7f554a933800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.891 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.890+0000 7f554a933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:37.891 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.890+0000 7f554a933800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.891 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.890+0000 7f554a933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:37.891 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.890+0000 7f554a933800 20 started sync module instance, tier type = 2024-09-12T00:50:37.891 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.890+0000 7f554a933800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:50:37.898 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.899+0000 7f554a933800 20 add_watcher() i=0 2024-09-12T00:50:37.898 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.899+0000 7f554a933800 20 add_watcher() i=1 2024-09-12T00:50:37.898 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.899+0000 7f554a933800 20 add_watcher() i=2 2024-09-12T00:50:37.898 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.899+0000 7f554a933800 20 add_watcher() i=3 2024-09-12T00:50:37.898 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.899+0000 7f554a933800 20 add_watcher() i=4 2024-09-12T00:50:37.898 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.899+0000 7f554a933800 20 add_watcher() i=5 2024-09-12T00:50:37.898 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.899+0000 7f554a933800 20 add_watcher() i=6 2024-09-12T00:50:37.899 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.900+0000 7f554a933800 20 add_watcher() i=7 2024-09-12T00:50:37.899 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.900+0000 7f554a933800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:37.901 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.902+0000 7f53fcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:37.901 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.902+0000 7f554a933800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:37.901 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.902+0000 7f554a933800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:37.901 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.902+0000 7f554a933800 5 note: GC not initialized 2024-09-12T00:50:37.901 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.902+0000 7f53777fe640 20 reqs_thread_entry: start 2024-09-12T00:50:37.902 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.902+0000 7f554a933800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:37.902 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.902+0000 7f554a933800 20 Filter name: none 2024-09-12T00:50:37.902 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.902+0000 7f53757fa640 20 reqs_thread_entry: start 2024-09-12T00:50:37.902 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.902+0000 7f554a933800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.903 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.903+0000 7f554a933800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:50:37.903 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.903+0000 7f554a933800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.903 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.904+0000 7f554a933800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:50:37.903 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.904+0000 7f554a933800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:37.903 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.904+0000 7f554a933800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.904 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.904+0000 7f554a933800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:50:37.904 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.904+0000 7f554a933800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.904 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.905+0000 7f554a933800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:50:37.904 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.905+0000 7f554a933800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:37.905 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.906+0000 7f53fcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:37.907 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.908+0000 7f554a933800 20 remove_watcher() i=0 2024-09-12T00:50:37.907 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.908+0000 7f554a933800 2 removed watcher, disabling cache 2024-09-12T00:50:37.908 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.909+0000 7f554a933800 20 remove_watcher() i=1 2024-09-12T00:50:37.909 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.910+0000 7f554a933800 20 remove_watcher() i=2 2024-09-12T00:50:37.910 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.911+0000 7f554a933800 20 remove_watcher() i=3 2024-09-12T00:50:37.911 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.912+0000 7f554a933800 20 remove_watcher() i=4 2024-09-12T00:50:37.912 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.913+0000 7f554a933800 20 remove_watcher() i=5 2024-09-12T00:50:37.913 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.914+0000 7f554a933800 20 remove_watcher() i=6 2024-09-12T00:50:37.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:37.915+0000 7f554a933800 20 remove_watcher() i=7 2024-09-12T00:50:37.924 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:37.924 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:50:37.924 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: error-at-block-writes id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:50:37.924 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:37.927 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:37.927 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:37.960 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:37.960 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:38.016 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:50:38.048 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:38.048 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:38.085 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.086+0000 7f624e339800 20 rados->read ofs=0 len=0 2024-09-12T00:50:38.087 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.088+0000 7f624e339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:38.087 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.088+0000 7f624e339800 20 realm 2024-09-12T00:50:38.087 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.088+0000 7f624e339800 20 rados->read ofs=0 len=0 2024-09-12T00:50:38.087 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.088+0000 7f624e339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:38.087 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.088+0000 7f624e339800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:38.087 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.088+0000 7f624e339800 20 rados->read ofs=0 len=0 2024-09-12T00:50:38.088 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.089+0000 7f624e339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:38.088 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.089+0000 7f624e339800 20 rados->read ofs=0 len=0 2024-09-12T00:50:38.088 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.089+0000 7f624e339800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:38.088 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.089+0000 7f624e339800 20 rados->read ofs=0 len=0 2024-09-12T00:50:38.089 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.090+0000 7f624e339800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:38.089 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.090+0000 7f624e339800 20 searching for the correct realm 2024-09-12T00:50:38.092 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.094+0000 7f624a7c8640 0 -- 172.21.15.73:0/3276975584 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f624000b040 msgr2=0x7f6240035420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:50:38.097 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.098+0000 7f6249fc7640 0 -- 172.21.15.73:0/3276975584 >> [v2:172.21.15.73:6810/1807760270,v1:172.21.15.73:6811/1807760270] conn(0x7f62440b1580 msgr2=0x7f62440af190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:38.100 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.101+0000 7f624e339800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:50:38.100 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.101+0000 7f624e339800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:38.100 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.101+0000 7f624e339800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:50:38.100 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.101+0000 7f624e339800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:38.100 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.101+0000 7f624e339800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:38.100 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.101+0000 7f624e339800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:38.100 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.101+0000 7f624e339800 20 rados->read ofs=0 len=0 2024-09-12T00:50:38.100 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.101+0000 7f624e339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:38.100 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.101+0000 7f624e339800 20 rados->read ofs=0 len=0 2024-09-12T00:50:38.102 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.101+0000 7f624e339800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:38.102 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.101+0000 7f624e339800 20 rados->read ofs=0 len=0 2024-09-12T00:50:38.102 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.102+0000 7f624e339800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:38.102 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.102+0000 7f624e339800 20 zone default found 2024-09-12T00:50:38.102 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.102+0000 7f624e339800 4 Realm: () 2024-09-12T00:50:38.102 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.102+0000 7f624e339800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:50:38.102 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.102+0000 7f624e339800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:50:38.102 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.102+0000 7f624e339800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:38.102 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.102+0000 7f624e339800 20 zonegroup default 2024-09-12T00:50:38.102 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.102+0000 7f624e339800 20 rados->read ofs=0 len=0 2024-09-12T00:50:38.103 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.102+0000 7f624e339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:38.103 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.102+0000 7f624e339800 20 rados->read ofs=0 len=0 2024-09-12T00:50:38.103 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.102+0000 7f624e339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:38.103 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.102+0000 7f624e339800 20 rados->read ofs=0 len=0 2024-09-12T00:50:38.103 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.103+0000 7f624e339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:38.103 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.103+0000 7f624e339800 20 started sync module instance, tier type = 2024-09-12T00:50:38.103 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.103+0000 7f624e339800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:50:38.111 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.112+0000 7f624e339800 20 add_watcher() i=0 2024-09-12T00:50:38.111 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.112+0000 7f624e339800 20 add_watcher() i=1 2024-09-12T00:50:38.111 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.112+0000 7f624e339800 20 add_watcher() i=2 2024-09-12T00:50:38.111 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.112+0000 7f624e339800 20 add_watcher() i=3 2024-09-12T00:50:38.111 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.112+0000 7f624e339800 20 add_watcher() i=4 2024-09-12T00:50:38.111 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.112+0000 7f624e339800 20 add_watcher() i=5 2024-09-12T00:50:38.111 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.112+0000 7f624e339800 20 add_watcher() i=6 2024-09-12T00:50:38.111 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.113+0000 7f624e339800 20 add_watcher() i=7 2024-09-12T00:50:38.112 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.113+0000 7f624e339800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:38.113 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.114+0000 7f60fbfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:38.114 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.115+0000 7f624e339800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:38.114 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.115+0000 7f624e339800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:38.114 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.115+0000 7f624e339800 5 note: GC not initialized 2024-09-12T00:50:38.114 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.115+0000 7f60faffd640 20 reqs_thread_entry: start 2024-09-12T00:50:38.114 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.115+0000 7f624e339800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:38.114 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.115+0000 7f624e339800 20 Filter name: none 2024-09-12T00:50:38.115 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.115+0000 7f60f8ff9640 20 reqs_thread_entry: start 2024-09-12T00:50:38.115 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.115+0000 7f624e339800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-12T00:50:38.115 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.115+0000 7f624e339800 20 rados->read ofs=0 len=0 2024-09-12T00:50:38.115 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.116+0000 7f624e339800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:50:38.116 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.116+0000 7f624e339800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-12T00:50:38.116 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.116+0000 7f624e339800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-12T00:50:38.116 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.116+0000 7f624e339800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28 : miss 2024-09-12T00:50:38.116 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.116+0000 7f624e339800 20 rados->read ofs=0 len=0 2024-09-12T00:50:38.116 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.116+0000 7f624e339800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:50:38.116 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.116+0000 7f624e339800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28 info.flags=0x17 2024-09-12T00:50:38.116 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.116+0000 7f624e339800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28 to cache LRU end 2024-09-12T00:50:38.116 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.116+0000 7f624e339800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:38.116 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.116+0000 7f624e339800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:38.116 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.116+0000 7f624e339800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28 2024-09-12T00:50:38.119 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.120+0000 7f624e339800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28 info.flags=0x17 2024-09-12T00:50:38.119 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.120+0000 7f624e339800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28 to cache LRU end 2024-09-12T00:50:38.119 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.120+0000 7f624e339800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:38.119 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.120+0000 7f624e339800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28, ofs0, ns] 2024-09-12T00:50:38.119 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.120+0000 7f612d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497004 cookie 93983139552336 notifier 6659 bl.length()=915 2024-09-12T00:50:38.119 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.120+0000 7f612d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28 info.flags=0x17 2024-09-12T00:50:38.119 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.120+0000 7f612d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28 to cache LRU end 2024-09-12T00:50:38.119 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.120+0000 7f612d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:38.120 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.122+0000 7f624e339800 20 handle_bi_update(): bucket=:error-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28]): orig_sources= new_sources= 2024-09-12T00:50:38.121 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.122+0000 7f624e339800 20 handle_bi_update(): bucket=:error-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28]): potential sources added=[] removed=[] 2024-09-12T00:50:38.121 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.122+0000 7f624e339800 20 handle_bi_update(): bucket=:error-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28]): orig_dests= new_dests= 2024-09-12T00:50:38.121 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.122+0000 7f624e339800 20 handle_bi_update(): bucket=:error-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28]): potential dests added=[] removed=[] 2024-09-12T00:50:38.123 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.124+0000 7f624e339800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28.1.0 2024-09-12T00:50:38.123 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.124+0000 7f624e339800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28.1.0 2024-09-12T00:50:38.123 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.124+0000 7f624e339800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28.1.1 2024-09-12T00:50:38.123 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.124+0000 7f624e339800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28.1.1 2024-09-12T00:50:38.123 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.124+0000 7f624e339800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28.0 2024-09-12T00:50:38.125 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.126+0000 7f624e339800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28 : hit (requested=0x17, cached=0x17) 2024-09-12T00:50:38.125 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.126+0000 7f624e339800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28 2024-09-12T00:50:38.127 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.127+0000 7f624e339800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28 info.flags=0x17 2024-09-12T00:50:38.127 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.127+0000 7f624e339800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28 to cache LRU end 2024-09-12T00:50:38.127 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.127+0000 7f624e339800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:38.127 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.127+0000 7f624e339800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28, ofs0, ns] 2024-09-12T00:50:38.127 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.128+0000 7f612d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497005 cookie 93983139552336 notifier 6659 bl.length()=915 2024-09-12T00:50:38.127 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.128+0000 7f612d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28 info.flags=0x17 2024-09-12T00:50:38.127 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.128+0000 7f612d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28 to cache LRU end 2024-09-12T00:50:38.127 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.128+0000 7f612d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:38.128 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.129+0000 7f624e339800 20 handle_bi_update(): bucket=:error-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28]): orig_sources= new_sources= 2024-09-12T00:50:38.128 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.129+0000 7f624e339800 20 handle_bi_update(): bucket=:error-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28]): potential sources added=[] removed=[] 2024-09-12T00:50:38.128 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.129+0000 7f624e339800 20 handle_bi_update(): bucket=:error-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28]): orig_dests= new_dests= 2024-09-12T00:50:38.128 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.129+0000 7f624e339800 20 handle_bi_update(): bucket=:error-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28]): potential dests added=[] removed=[] 2024-09-12T00:50:38.129 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.130+0000 7f624e339800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28.0 2024-09-12T00:50:38.129 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.131+0000 7f624e339800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28 : hit (requested=0x17, cached=0x17) 2024-09-12T00:50:38.129 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.131+0000 7f624e339800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28 2024-09-12T00:50:38.131 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.132+0000 7f624e339800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28 info.flags=0x17 2024-09-12T00:50:38.131 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.132+0000 7f624e339800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28 to cache LRU end 2024-09-12T00:50:38.131 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.132+0000 7f624e339800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:38.131 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.132+0000 7f624e339800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28, ofs0, ns] 2024-09-12T00:50:38.131 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.132+0000 7f612cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497006 cookie 93983139552336 notifier 6659 bl.length()=883 2024-09-12T00:50:38.131 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.132+0000 7f612cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28 info.flags=0x17 2024-09-12T00:50:38.131 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.132+0000 7f612cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28 to cache LRU end 2024-09-12T00:50:38.131 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.132+0000 7f612cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:38.132 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.133+0000 7f624e339800 20 handle_bi_update(): bucket=:error-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28]): orig_sources= new_sources= 2024-09-12T00:50:38.132 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.133+0000 7f624e339800 20 handle_bi_update(): bucket=:error-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28]): potential sources added=[] removed=[] 2024-09-12T00:50:38.133 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.133+0000 7f624e339800 20 handle_bi_update(): bucket=:error-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28]): orig_dests= new_dests= 2024-09-12T00:50:38.133 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.133+0000 7f624e339800 20 handle_bi_update(): bucket=:error-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28]): potential dests added=[] removed=[] 2024-09-12T00:50:38.133 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.135+0000 7f624e339800 1 execute INFO: reshard of bucket "error-at-block-writes" from 1 shards to 2 shards completed successfully 2024-09-12T00:50:38.135 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.137+0000 7f60fbfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:38.137 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.139+0000 7f624e339800 20 remove_watcher() i=0 2024-09-12T00:50:38.138 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.139+0000 7f624e339800 2 removed watcher, disabling cache 2024-09-12T00:50:38.138 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.140+0000 7f624e339800 20 remove_watcher() i=1 2024-09-12T00:50:38.139 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.141+0000 7f624e339800 20 remove_watcher() i=2 2024-09-12T00:50:38.141 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.142+0000 7f624e339800 20 remove_watcher() i=3 2024-09-12T00:50:38.142 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.143+0000 7f624e339800 20 remove_watcher() i=4 2024-09-12T00:50:38.143 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.144+0000 7f624e339800 20 remove_watcher() i=5 2024-09-12T00:50:38.144 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.145+0000 7f624e339800 20 remove_watcher() i=6 2024-09-12T00:50:38.145 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.146+0000 7f624e339800 20 remove_watcher() i=7 2024-09-12T00:50:38.157 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T00:50:38.185 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:38.186 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:38.222 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.224+0000 7fd0f9b35800 20 rados->read ofs=0 len=0 2024-09-12T00:50:38.224 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.225+0000 7fd0f9b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:38.224 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.225+0000 7fd0f9b35800 20 realm 2024-09-12T00:50:38.224 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.225+0000 7fd0f9b35800 20 rados->read ofs=0 len=0 2024-09-12T00:50:38.224 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.225+0000 7fd0f9b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:38.225 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.225+0000 7fd0f9b35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:38.225 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.225+0000 7fd0f9b35800 20 rados->read ofs=0 len=0 2024-09-12T00:50:38.225 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.226+0000 7fd0f9b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:38.225 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.226+0000 7fd0f9b35800 20 rados->read ofs=0 len=0 2024-09-12T00:50:38.225 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.227+0000 7fd0f9b35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:38.225 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.227+0000 7fd0f9b35800 20 rados->read ofs=0 len=0 2024-09-12T00:50:38.226 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.227+0000 7fd0f9b35800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:38.226 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.227+0000 7fd0f9b35800 20 searching for the correct realm 2024-09-12T00:50:38.227 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.229+0000 7fd0f58e4640 0 -- 172.21.15.73:0/1507362619 >> [v2:172.21.15.117:6816/1460498570,v1:172.21.15.117:6817/1460498570] conn(0x55dc46262080 msgr2=0x7fd0f007eac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:38.231 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.232+0000 7fd0f58e4640 0 -- 172.21.15.73:0/1507362619 >> [v2:172.21.15.117:6816/1460498570,v1:172.21.15.117:6817/1460498570] conn(0x7fcfc0086370 msgr2=0x7fcfc00887a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:38.236 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.237+0000 7fd0f9b35800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:50:38.236 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.237+0000 7fd0f9b35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:38.236 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.237+0000 7fd0f9b35800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:50:38.236 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.237+0000 7fd0f9b35800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:38.237 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.237+0000 7fd0f9b35800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:38.237 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.237+0000 7fd0f9b35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:38.237 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.237+0000 7fd0f9b35800 20 rados->read ofs=0 len=0 2024-09-12T00:50:38.237 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.238+0000 7fd0f9b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:38.237 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.238+0000 7fd0f9b35800 20 rados->read ofs=0 len=0 2024-09-12T00:50:38.238 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.238+0000 7fd0f9b35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:38.238 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.238+0000 7fd0f9b35800 20 rados->read ofs=0 len=0 2024-09-12T00:50:38.239 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.238+0000 7fd0f9b35800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:38.239 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.238+0000 7fd0f9b35800 20 zone default found 2024-09-12T00:50:38.239 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.238+0000 7fd0f9b35800 4 Realm: () 2024-09-12T00:50:38.239 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.238+0000 7fd0f9b35800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:50:38.239 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.238+0000 7fd0f9b35800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:50:38.239 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.238+0000 7fd0f9b35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:38.239 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.238+0000 7fd0f9b35800 20 zonegroup default 2024-09-12T00:50:38.239 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.238+0000 7fd0f9b35800 20 rados->read ofs=0 len=0 2024-09-12T00:50:38.239 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.238+0000 7fd0f9b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:38.239 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.238+0000 7fd0f9b35800 20 rados->read ofs=0 len=0 2024-09-12T00:50:38.239 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.239+0000 7fd0f9b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:38.240 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.239+0000 7fd0f9b35800 20 rados->read ofs=0 len=0 2024-09-12T00:50:38.240 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.239+0000 7fd0f9b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:38.240 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.239+0000 7fd0f9b35800 20 started sync module instance, tier type = 2024-09-12T00:50:38.240 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.239+0000 7fd0f9b35800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:50:38.246 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.247+0000 7fd0f9b35800 20 add_watcher() i=0 2024-09-12T00:50:38.246 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.247+0000 7fd0f9b35800 20 add_watcher() i=1 2024-09-12T00:50:38.246 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.247+0000 7fd0f9b35800 20 add_watcher() i=2 2024-09-12T00:50:38.247 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.247+0000 7fd0f9b35800 20 add_watcher() i=3 2024-09-12T00:50:38.247 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.247+0000 7fd0f9b35800 20 add_watcher() i=4 2024-09-12T00:50:38.247 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.247+0000 7fd0f9b35800 20 add_watcher() i=5 2024-09-12T00:50:38.247 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.247+0000 7fd0f9b35800 20 add_watcher() i=6 2024-09-12T00:50:38.247 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.248+0000 7fd0f9b35800 20 add_watcher() i=7 2024-09-12T00:50:38.247 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.248+0000 7fd0f9b35800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:38.248 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.250+0000 7fcfa77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:38.249 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.250+0000 7fd0f9b35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:38.250 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.250+0000 7fd0f9b35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:38.250 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.250+0000 7fd0f9b35800 5 note: GC not initialized 2024-09-12T00:50:38.250 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.250+0000 7fcfa67fc640 20 reqs_thread_entry: start 2024-09-12T00:50:38.250 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.250+0000 7fd0f9b35800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:38.250 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.250+0000 7fd0f9b35800 20 Filter name: none 2024-09-12T00:50:38.250 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.251+0000 7fcf17fff640 20 reqs_thread_entry: start 2024-09-12T00:50:38.250 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.251+0000 7fd0f9b35800 20 rados->read ofs=0 len=0 2024-09-12T00:50:38.251 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.251+0000 7fd0f9b35800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:50:38.252 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.251+0000 7fd0f9b35800 20 rados->read ofs=0 len=0 2024-09-12T00:50:38.252 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.252+0000 7fd0f9b35800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:50:38.252 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.252+0000 7fd0f9b35800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:38.252 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.252+0000 7fd0f9b35800 20 rados->read ofs=0 len=0 2024-09-12T00:50:38.252 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.252+0000 7fd0f9b35800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:50:38.252 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.252+0000 7fd0f9b35800 20 rados->read ofs=0 len=0 2024-09-12T00:50:38.252 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.252+0000 7fd0f9b35800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:50:38.252 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.252+0000 7fd0f9b35800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:38.252 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.254+0000 7fcfa77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:38.254 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.256+0000 7fd0f9b35800 20 remove_watcher() i=0 2024-09-12T00:50:38.254 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.256+0000 7fd0f9b35800 2 removed watcher, disabling cache 2024-09-12T00:50:38.255 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.257+0000 7fd0f9b35800 20 remove_watcher() i=1 2024-09-12T00:50:38.256 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.258+0000 7fd0f9b35800 20 remove_watcher() i=2 2024-09-12T00:50:38.257 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.259+0000 7fd0f9b35800 20 remove_watcher() i=3 2024-09-12T00:50:38.258 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.260+0000 7fd0f9b35800 20 remove_watcher() i=4 2024-09-12T00:50:38.259 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.261+0000 7fd0f9b35800 20 remove_watcher() i=5 2024-09-12T00:50:38.260 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.262+0000 7fd0f9b35800 20 remove_watcher() i=6 2024-09-12T00:50:38.261 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:38.263+0000 7fd0f9b35800 20 remove_watcher() i=7 2024-09-12T00:50:38.271 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:38.271 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:50:38.272 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: error-at-block-writes id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:50:38.272 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:38.273 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:38.273 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:38.294 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:38.294 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:38.503 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:38.503 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:38.565 INFO:tasks.workunit.client.0.smithi073.stderr:TEST: reshard bucket with abort at block_writes 2024-09-12T00:50:38.565 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:38.566 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:38.566 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:38.607 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:38.607 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:38.663 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:38.663 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:38.698 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:38.698 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:38.733 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:38.733 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:38.769 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:38.769 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:38.803 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:38.803 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:38.836 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:38.836 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:38.871 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:38.871 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:38.906 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:38.906 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:38.941 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:38.941 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:38.976 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:38.976 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:39.010 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:39.010 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:39.045 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:39.045 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:39.079 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:39.079 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:39.114 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:39.114 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:39.147 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:39.147 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:39.180 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:39.181 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:39.216 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:39.216 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:39.251 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:39.252 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:39.287 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:39.287 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:39.322 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:39.322 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:39.358 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T00:50:39.386 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:39.386 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:39.423 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.424+0000 7f7907a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.425 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.426+0000 7f7907a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:39.425 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.426+0000 7f7907a0e800 20 realm 2024-09-12T00:50:39.425 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.426+0000 7f7907a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.425 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.426+0000 7f7907a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:39.426 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.426+0000 7f7907a0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:39.426 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.426+0000 7f7907a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.426 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.426+0000 7f7907a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:39.426 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.426+0000 7f7907a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.426 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.427+0000 7f7907a0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:39.426 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.427+0000 7f7907a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.427 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.428+0000 7f7907a0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:39.427 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.428+0000 7f7907a0e800 20 searching for the correct realm 2024-09-12T00:50:39.428 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.429+0000 7f78fbfff640 0 -- 172.21.15.73:0/62482242 >> [v2:172.21.15.73:6826/269690776,v1:172.21.15.73:6827/269690776] conn(0x7f78f40c6160 msgr2=0x7f78f40da9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:39.633 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.634+0000 7f7903059640 0 -- 172.21.15.73:0/62482242 >> [v2:172.21.15.73:6810/1807760270,v1:172.21.15.73:6811/1807760270] conn(0x55c8f9aa4af0 msgr2=0x7f78fc031440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:39.840 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.840+0000 7f7907a0e800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:50:39.840 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.840+0000 7f7907a0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:39.840 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.840+0000 7f7907a0e800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:50:39.841 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.840+0000 7f7907a0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:39.841 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.840+0000 7f7907a0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:39.841 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.840+0000 7f7907a0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:39.841 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.840+0000 7f7907a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.841 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.840+0000 7f7907a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:39.841 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.840+0000 7f7907a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.841 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.841+0000 7f7907a0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:39.841 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.841+0000 7f7907a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.841 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.841+0000 7f7907a0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:39.841 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.841+0000 7f7907a0e800 20 zone default found 2024-09-12T00:50:39.841 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.841+0000 7f7907a0e800 4 Realm: () 2024-09-12T00:50:39.841 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.841+0000 7f7907a0e800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:50:39.841 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.841+0000 7f7907a0e800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:50:39.842 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.841+0000 7f7907a0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:39.842 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.841+0000 7f7907a0e800 20 zonegroup default 2024-09-12T00:50:39.842 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.841+0000 7f7907a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.842 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.841+0000 7f7907a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:39.842 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.841+0000 7f7907a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.842 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.842+0000 7f7907a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:39.842 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.842+0000 7f7907a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.843 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.842+0000 7f7907a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:39.843 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.842+0000 7f7907a0e800 20 started sync module instance, tier type = 2024-09-12T00:50:39.843 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.842+0000 7f7907a0e800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:50:39.850 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.852+0000 7f7907a0e800 20 add_watcher() i=0 2024-09-12T00:50:39.851 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.852+0000 7f7907a0e800 20 add_watcher() i=1 2024-09-12T00:50:39.851 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.852+0000 7f7907a0e800 20 add_watcher() i=2 2024-09-12T00:50:39.851 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.852+0000 7f7907a0e800 20 add_watcher() i=3 2024-09-12T00:50:39.851 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.852+0000 7f7907a0e800 20 add_watcher() i=4 2024-09-12T00:50:39.851 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.852+0000 7f7907a0e800 20 add_watcher() i=5 2024-09-12T00:50:39.851 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.852+0000 7f7907a0e800 20 add_watcher() i=6 2024-09-12T00:50:39.851 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.853+0000 7f7907a0e800 20 add_watcher() i=7 2024-09-12T00:50:39.851 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.853+0000 7f7907a0e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:39.854 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.854+0000 7f77b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:39.854 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.855+0000 7f7907a0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:39.854 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.855+0000 7f7907a0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:39.854 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.855+0000 7f7907a0e800 5 note: GC not initialized 2024-09-12T00:50:39.854 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.855+0000 7f77b8fe1640 20 reqs_thread_entry: start 2024-09-12T00:50:39.854 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.855+0000 7f7907a0e800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:39.855 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.855+0000 7f7907a0e800 20 Filter name: none 2024-09-12T00:50:39.855 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.855+0000 7f77327fc640 20 reqs_thread_entry: start 2024-09-12T00:50:39.855 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.855+0000 7f7907a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.856 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.856+0000 7f7907a0e800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:50:39.856 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.856+0000 7f7907a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.856 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.856+0000 7f7907a0e800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:50:39.856 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.856+0000 7f7907a0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:39.856 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.856+0000 7f7907a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.856 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.857+0000 7f7907a0e800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:50:39.856 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.857+0000 7f7907a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.857 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.857+0000 7f7907a0e800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:50:39.857 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.857+0000 7f7907a0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:39.857 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.859+0000 7f77b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:39.859 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.861+0000 7f7907a0e800 20 remove_watcher() i=0 2024-09-12T00:50:39.860 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.861+0000 7f7907a0e800 2 removed watcher, disabling cache 2024-09-12T00:50:39.861 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.862+0000 7f7907a0e800 20 remove_watcher() i=1 2024-09-12T00:50:39.862 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.863+0000 7f7907a0e800 20 remove_watcher() i=2 2024-09-12T00:50:39.863 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.864+0000 7f7907a0e800 20 remove_watcher() i=3 2024-09-12T00:50:39.864 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.865+0000 7f7907a0e800 20 remove_watcher() i=4 2024-09-12T00:50:39.865 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.866+0000 7f7907a0e800 20 remove_watcher() i=5 2024-09-12T00:50:39.866 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.867+0000 7f7907a0e800 20 remove_watcher() i=6 2024-09-12T00:50:39.867 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.868+0000 7f7907a0e800 20 remove_watcher() i=7 2024-09-12T00:50:39.877 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:39.877 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:50:39.877 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: abort-at-block-writes id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:50:39.877 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:39.879 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2024-09-12T00:50:39.913 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:39.913 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:39.950 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.951+0000 7faf4fa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.952 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.953+0000 7faf4fa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:39.952 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.953+0000 7faf4fa0f800 20 realm 2024-09-12T00:50:39.952 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.953+0000 7faf4fa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.952 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.953+0000 7faf4fa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:39.952 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.953+0000 7faf4fa0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:39.953 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.953+0000 7faf4fa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.953 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.953+0000 7faf4fa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:39.953 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.953+0000 7faf4fa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.953 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.954+0000 7faf4fa0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:39.953 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.954+0000 7faf4fa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.954 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.955+0000 7faf4fa0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:39.954 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.955+0000 7faf4fa0f800 20 searching for the correct realm 2024-09-12T00:50:39.956 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:39.957+0000 7faf4dcfa640 0 -- 172.21.15.73:0/3481744197 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7faf3807f1e0 msgr2=0x7faf38093680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:40.162 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.163+0000 7faf4dcfa640 0 -- 172.21.15.73:0/3481744197 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7faf3807f1e0 msgr2=0x7faf38093680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:40.167 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.167+0000 7faf4fa0f800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:50:40.167 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.167+0000 7faf4fa0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:40.167 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.167+0000 7faf4fa0f800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:50:40.167 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.167+0000 7faf4fa0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:40.167 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.167+0000 7faf4fa0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:40.168 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.167+0000 7faf4fa0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:40.168 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.167+0000 7faf4fa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.168 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.168+0000 7faf4fa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:40.168 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.168+0000 7faf4fa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.168 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.168+0000 7faf4fa0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:40.168 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.168+0000 7faf4fa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.168 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.168+0000 7faf4fa0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:40.168 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.168+0000 7faf4fa0f800 20 zone default found 2024-09-12T00:50:40.168 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.168+0000 7faf4fa0f800 4 Realm: () 2024-09-12T00:50:40.168 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.168+0000 7faf4fa0f800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:50:40.168 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.168+0000 7faf4fa0f800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:50:40.168 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.168+0000 7faf4fa0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:40.168 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.168+0000 7faf4fa0f800 20 zonegroup default 2024-09-12T00:50:40.169 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.168+0000 7faf4fa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.169 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.168+0000 7faf4fa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:40.169 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.168+0000 7faf4fa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.169 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.169+0000 7faf4fa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:40.169 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.169+0000 7faf4fa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.169 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.169+0000 7faf4fa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:40.169 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.169+0000 7faf4fa0f800 20 started sync module instance, tier type = 2024-09-12T00:50:40.170 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.169+0000 7faf4fa0f800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:50:40.179 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.180+0000 7faf4fa0f800 20 add_watcher() i=0 2024-09-12T00:50:40.179 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.180+0000 7faf4fa0f800 20 add_watcher() i=1 2024-09-12T00:50:40.179 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.180+0000 7faf4fa0f800 20 add_watcher() i=2 2024-09-12T00:50:40.179 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.180+0000 7faf4fa0f800 20 add_watcher() i=3 2024-09-12T00:50:40.180 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.180+0000 7faf4fa0f800 20 add_watcher() i=4 2024-09-12T00:50:40.180 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.180+0000 7faf4fa0f800 20 add_watcher() i=5 2024-09-12T00:50:40.180 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.180+0000 7faf4fa0f800 20 add_watcher() i=6 2024-09-12T00:50:40.180 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.181+0000 7faf4fa0f800 20 add_watcher() i=7 2024-09-12T00:50:40.180 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.181+0000 7faf4fa0f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:40.183 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.183+0000 7fae037e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:40.183 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.183+0000 7faf4fa0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:40.183 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.183+0000 7faf4fa0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:40.183 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.183+0000 7faf4fa0f800 5 note: GC not initialized 2024-09-12T00:50:40.183 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.183+0000 7fae027e4640 20 reqs_thread_entry: start 2024-09-12T00:50:40.184 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.183+0000 7faf4fa0f800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:40.184 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.183+0000 7faf4fa0f800 20 Filter name: none 2024-09-12T00:50:40.184 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.184+0000 7fad73fff640 20 reqs_thread_entry: start 2024-09-12T00:50:40.184 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.184+0000 7faf4fa0f800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:50:40.184 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.184+0000 7faf4fa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.184 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.184+0000 7faf4fa0f800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:50:40.184 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.184+0000 7faf4fa0f800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:50:40.184 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.184+0000 7faf4fa0f800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:50:40.184 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.184+0000 7faf4fa0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 : miss 2024-09-12T00:50:40.184 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.184+0000 7faf4fa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.184 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.184+0000 7faf4fa0f800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:50:40.185 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.184+0000 7faf4fa0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 info.flags=0x17 2024-09-12T00:50:40.185 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.184+0000 7faf4fa0f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 to cache LRU end 2024-09-12T00:50:40.185 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.184+0000 7faf4fa0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:40.185 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.184+0000 7faf4fa0f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:40.185 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.184+0000 7faf4fa0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 2024-09-12T00:50:40.187 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.188+0000 7faf4fa0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 info.flags=0x17 2024-09-12T00:50:40.187 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.188+0000 7faf4fa0f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 to cache LRU end 2024-09-12T00:50:40.187 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.188+0000 7faf4fa0f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:40.187 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.188+0000 7faf4fa0f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29, ofs0, ns] 2024-09-12T00:50:40.187 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.188+0000 7fae30ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497049 cookie 94413395019920 notifier 6707 bl.length()=915 2024-09-12T00:50:40.187 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.188+0000 7fae30ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 info.flags=0x17 2024-09-12T00:50:40.187 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.188+0000 7fae30ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 to cache LRU end 2024-09-12T00:50:40.187 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.188+0000 7fae30ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:40.189 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.190+0000 7faf4fa0f800 20 handle_bi_update(): bucket=:abort-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29]): orig_sources= new_sources= 2024-09-12T00:50:40.189 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.190+0000 7faf4fa0f800 20 handle_bi_update(): bucket=:abort-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29]): potential sources added=[] removed=[] 2024-09-12T00:50:40.189 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.190+0000 7faf4fa0f800 20 handle_bi_update(): bucket=:abort-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29]): orig_dests= new_dests= 2024-09-12T00:50:40.189 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.190+0000 7faf4fa0f800 20 handle_bi_update(): bucket=:abort-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29]): potential dests added=[] removed=[] 2024-09-12T00:50:40.193 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.194+0000 7faf4fa0f800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29.1.0 2024-09-12T00:50:40.193 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.194+0000 7faf4fa0f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29.1.0 2024-09-12T00:50:40.193 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.194+0000 7faf4fa0f800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29.1.1 2024-09-12T00:50:40.193 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.194+0000 7faf4fa0f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29.1.1 2024-09-12T00:50:40.194 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.194+0000 7faf4fa0f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29.0 2024-09-12T00:50:40.195 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.197+0000 7faf4fa0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:50:40.195 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.197+0000 7faf4fa0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 2024-09-12T00:50:40.197 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.198+0000 7faf4fa0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 info.flags=0x17 2024-09-12T00:50:40.197 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.198+0000 7faf4fa0f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 to cache LRU end 2024-09-12T00:50:40.197 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.198+0000 7faf4fa0f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:40.197 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.198+0000 7faf4fa0f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29, ofs0, ns] 2024-09-12T00:50:40.197 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.198+0000 7fae1ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497050 cookie 94413395019920 notifier 6707 bl.length()=915 2024-09-12T00:50:40.197 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.198+0000 7fae1ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 info.flags=0x17 2024-09-12T00:50:40.198 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.198+0000 7fae1ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 to cache LRU end 2024-09-12T00:50:40.198 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.198+0000 7fae1ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:40.198 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.200+0000 7faf4fa0f800 20 handle_bi_update(): bucket=:abort-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29]): orig_sources= new_sources= 2024-09-12T00:50:40.199 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.200+0000 7faf4fa0f800 20 handle_bi_update(): bucket=:abort-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29]): potential sources added=[] removed=[] 2024-09-12T00:50:40.199 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.200+0000 7faf4fa0f800 20 handle_bi_update(): bucket=:abort-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29]): orig_dests= new_dests= 2024-09-12T00:50:40.199 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.200+0000 7faf4fa0f800 20 handle_bi_update(): bucket=:abort-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29]): potential dests added=[] removed=[] 2024-09-12T00:50:40.199 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7faf4fa0f800 time 2024-09-12T00:50:40.200882+0000 2024-09-12T00:50:40.199 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:50:40.199 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:40.200 INFO:tasks.workunit.client.0.smithi073.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7faf52f8c71a] 2024-09-12T00:50:40.200 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7faf52f8c8d8] 2024-09-12T00:50:40.200 INFO:tasks.workunit.client.0.smithi073.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55de52b34641] 2024-09-12T00:50:40.200 INFO:tasks.workunit.client.0.smithi073.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x55de52b43582] 2024-09-12T00:50:40.200 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55de52b443e4] 2024-09-12T00:50:40.200 INFO:tasks.workunit.client.0.smithi073.stderr: 6: main() 2024-09-12T00:50:40.200 INFO:tasks.workunit.client.0.smithi073.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7faf51c29590] 2024-09-12T00:50:40.200 INFO:tasks.workunit.client.0.smithi073.stderr: 8: __libc_start_main() 2024-09-12T00:50:40.200 INFO:tasks.workunit.client.0.smithi073.stderr: 9: _start() 2024-09-12T00:50:40.200 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.200+0000 7faf4fa0f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7faf4fa0f800 time 2024-09-12T00:50:40.200882+0000 2024-09-12T00:50:40.200 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:50:40.201 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:40.201 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:40.201 INFO:tasks.workunit.client.0.smithi073.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7faf52f8c71a] 2024-09-12T00:50:40.201 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7faf52f8c8d8] 2024-09-12T00:50:40.201 INFO:tasks.workunit.client.0.smithi073.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55de52b34641] 2024-09-12T00:50:40.201 INFO:tasks.workunit.client.0.smithi073.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x55de52b43582] 2024-09-12T00:50:40.201 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55de52b443e4] 2024-09-12T00:50:40.201 INFO:tasks.workunit.client.0.smithi073.stderr: 6: main() 2024-09-12T00:50:40.201 INFO:tasks.workunit.client.0.smithi073.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7faf51c29590] 2024-09-12T00:50:40.201 INFO:tasks.workunit.client.0.smithi073.stderr: 8: __libc_start_main() 2024-09-12T00:50:40.201 INFO:tasks.workunit.client.0.smithi073.stderr: 9: _start() 2024-09-12T00:50:40.201 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:40.201 INFO:tasks.workunit.client.0.smithi073.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:50:40.201 INFO:tasks.workunit.client.0.smithi073.stderr: in thread 7faf4fa0f800 thread_name:radosgw-admin 2024-09-12T00:50:40.221 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:40.221 INFO:tasks.workunit.client.0.smithi073.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7faf51c3e6f0] 2024-09-12T00:50:40.221 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7faf51c8b99c] 2024-09-12T00:50:40.221 INFO:tasks.workunit.client.0.smithi073.stderr: 3: raise() 2024-09-12T00:50:40.221 INFO:tasks.workunit.client.0.smithi073.stderr: 4: abort() 2024-09-12T00:50:40.221 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7faf52f8c774] 2024-09-12T00:50:40.221 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7faf52f8c8d8] 2024-09-12T00:50:40.221 INFO:tasks.workunit.client.0.smithi073.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55de52b34641] 2024-09-12T00:50:40.222 INFO:tasks.workunit.client.0.smithi073.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x55de52b43582] 2024-09-12T00:50:40.222 INFO:tasks.workunit.client.0.smithi073.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55de52b443e4] 2024-09-12T00:50:40.222 INFO:tasks.workunit.client.0.smithi073.stderr: 10: main() 2024-09-12T00:50:40.222 INFO:tasks.workunit.client.0.smithi073.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7faf51c29590] 2024-09-12T00:50:40.222 INFO:tasks.workunit.client.0.smithi073.stderr: 12: __libc_start_main() 2024-09-12T00:50:40.222 INFO:tasks.workunit.client.0.smithi073.stderr: 13: _start() 2024-09-12T00:50:40.222 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.201+0000 7faf4fa0f800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:50:40.222 INFO:tasks.workunit.client.0.smithi073.stderr: in thread 7faf4fa0f800 thread_name:radosgw-admin 2024-09-12T00:50:40.222 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:40.222 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:40.222 INFO:tasks.workunit.client.0.smithi073.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7faf51c3e6f0] 2024-09-12T00:50:40.223 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7faf51c8b99c] 2024-09-12T00:50:40.223 INFO:tasks.workunit.client.0.smithi073.stderr: 3: raise() 2024-09-12T00:50:40.223 INFO:tasks.workunit.client.0.smithi073.stderr: 4: abort() 2024-09-12T00:50:40.223 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7faf52f8c774] 2024-09-12T00:50:40.223 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7faf52f8c8d8] 2024-09-12T00:50:40.223 INFO:tasks.workunit.client.0.smithi073.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55de52b34641] 2024-09-12T00:50:40.223 INFO:tasks.workunit.client.0.smithi073.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x55de52b43582] 2024-09-12T00:50:40.223 INFO:tasks.workunit.client.0.smithi073.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55de52b443e4] 2024-09-12T00:50:40.223 INFO:tasks.workunit.client.0.smithi073.stderr: 10: main() 2024-09-12T00:50:40.223 INFO:tasks.workunit.client.0.smithi073.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7faf51c29590] 2024-09-12T00:50:40.223 INFO:tasks.workunit.client.0.smithi073.stderr: 12: __libc_start_main() 2024-09-12T00:50:40.223 INFO:tasks.workunit.client.0.smithi073.stderr: 13: _start() 2024-09-12T00:50:40.223 INFO:tasks.workunit.client.0.smithi073.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:50:40.223 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:40.224 INFO:tasks.workunit.client.0.smithi073.stderr:--- begin dump of recent events --- 2024-09-12T00:50:40.224 INFO:tasks.workunit.client.0.smithi073.stderr: -499> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 5 AuthRegistry(0x55de54cf98d0) adding con mode: crc 2024-09-12T00:50:40.224 INFO:tasks.workunit.client.0.smithi073.stderr: -498> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 5 AuthRegistry(0x55de54cf98d0) adding con mode: secure 2024-09-12T00:50:40.224 INFO:tasks.workunit.client.0.smithi073.stderr: -497> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 5 AuthRegistry(0x55de54cf98d0) adding con mode: crc 2024-09-12T00:50:40.224 INFO:tasks.workunit.client.0.smithi073.stderr: -496> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 5 AuthRegistry(0x55de54cf98d0) adding con mode: crc 2024-09-12T00:50:40.224 INFO:tasks.workunit.client.0.smithi073.stderr: -495> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 5 AuthRegistry(0x55de54cf98d0) adding con mode: secure 2024-09-12T00:50:40.224 INFO:tasks.workunit.client.0.smithi073.stderr: -494> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 5 AuthRegistry(0x55de54cf98d0) adding con mode: crc 2024-09-12T00:50:40.224 INFO:tasks.workunit.client.0.smithi073.stderr: -493> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 5 AuthRegistry(0x55de54cf98d0) adding con mode: secure 2024-09-12T00:50:40.224 INFO:tasks.workunit.client.0.smithi073.stderr: -492> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 5 AuthRegistry(0x55de54cf98d0) adding con mode: crc 2024-09-12T00:50:40.224 INFO:tasks.workunit.client.0.smithi073.stderr: -491> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 5 AuthRegistry(0x55de54cf98d0) adding con mode: secure 2024-09-12T00:50:40.224 INFO:tasks.workunit.client.0.smithi073.stderr: -490> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:40.224 INFO:tasks.workunit.client.0.smithi073.stderr: -489> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 1 librados: starting msgr at 2024-09-12T00:50:40.225 INFO:tasks.workunit.client.0.smithi073.stderr: -488> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 1 librados: starting objecter 2024-09-12T00:50:40.225 INFO:tasks.workunit.client.0.smithi073.stderr: -487> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 5 asok(0x55de54ad7630) register_command objecter_requests hook 0x55de54cfcc80 2024-09-12T00:50:40.225 INFO:tasks.workunit.client.0.smithi073.stderr: -486> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 1 librados: setting wanted keys 2024-09-12T00:50:40.225 INFO:tasks.workunit.client.0.smithi073.stderr: -485> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 1 librados: calling monclient init 2024-09-12T00:50:40.225 INFO:tasks.workunit.client.0.smithi073.stderr: -484> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 10 monclient: init 2024-09-12T00:50:40.225 INFO:tasks.workunit.client.0.smithi073.stderr: -483> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 5 AuthRegistry(0x55de54cf75d0) adding auth protocol: cephx 2024-09-12T00:50:40.225 INFO:tasks.workunit.client.0.smithi073.stderr: -482> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 5 AuthRegistry(0x55de54cf75d0) adding auth protocol: cephx 2024-09-12T00:50:40.225 INFO:tasks.workunit.client.0.smithi073.stderr: -481> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 5 AuthRegistry(0x55de54cf75d0) adding auth protocol: cephx 2024-09-12T00:50:40.225 INFO:tasks.workunit.client.0.smithi073.stderr: -480> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 5 AuthRegistry(0x55de54cf75d0) adding con mode: secure 2024-09-12T00:50:40.225 INFO:tasks.workunit.client.0.smithi073.stderr: -479> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 5 AuthRegistry(0x55de54cf75d0) adding con mode: crc 2024-09-12T00:50:40.225 INFO:tasks.workunit.client.0.smithi073.stderr: -478> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 5 AuthRegistry(0x55de54cf75d0) adding con mode: secure 2024-09-12T00:50:40.225 INFO:tasks.workunit.client.0.smithi073.stderr: -477> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 5 AuthRegistry(0x55de54cf75d0) adding con mode: crc 2024-09-12T00:50:40.225 INFO:tasks.workunit.client.0.smithi073.stderr: -476> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 5 AuthRegistry(0x55de54cf75d0) adding con mode: secure 2024-09-12T00:50:40.226 INFO:tasks.workunit.client.0.smithi073.stderr: -475> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 5 AuthRegistry(0x55de54cf75d0) adding con mode: crc 2024-09-12T00:50:40.226 INFO:tasks.workunit.client.0.smithi073.stderr: -474> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 5 AuthRegistry(0x55de54cf75d0) adding con mode: crc 2024-09-12T00:50:40.226 INFO:tasks.workunit.client.0.smithi073.stderr: -473> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 5 AuthRegistry(0x55de54cf75d0) adding con mode: secure 2024-09-12T00:50:40.226 INFO:tasks.workunit.client.0.smithi073.stderr: -472> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 5 AuthRegistry(0x55de54cf75d0) adding con mode: crc 2024-09-12T00:50:40.226 INFO:tasks.workunit.client.0.smithi073.stderr: -471> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 5 AuthRegistry(0x55de54cf75d0) adding con mode: secure 2024-09-12T00:50:40.226 INFO:tasks.workunit.client.0.smithi073.stderr: -470> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 5 AuthRegistry(0x55de54cf75d0) adding con mode: crc 2024-09-12T00:50:40.226 INFO:tasks.workunit.client.0.smithi073.stderr: -469> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 5 AuthRegistry(0x55de54cf75d0) adding con mode: secure 2024-09-12T00:50:40.226 INFO:tasks.workunit.client.0.smithi073.stderr: -468> 2024-09-12T00:50:39.936+0000 7faf4fa0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:40.226 INFO:tasks.workunit.client.0.smithi073.stderr: -467> 2024-09-12T00:50:39.936+0000 7faf4fa0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:40.226 INFO:tasks.workunit.client.0.smithi073.stderr: -466> 2024-09-12T00:50:39.936+0000 7faf4fa0f800 5 asok(0x55de54ad7630) register_command rotate-key hook 0x55de54cf7718 2024-09-12T00:50:40.226 INFO:tasks.workunit.client.0.smithi073.stderr: -465> 2024-09-12T00:50:39.936+0000 7faf4fa0f800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:40.226 INFO:tasks.workunit.client.0.smithi073.stderr: -464> 2024-09-12T00:50:39.936+0000 7faf4fa0f800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:50:40.226 INFO:tasks.workunit.client.0.smithi073.stderr: -463> 2024-09-12T00:50:39.936+0000 7faf4fa0f800 10 monclient(hunting): picked mon.noname-b con 0x55de54b6e230 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:50:40.227 INFO:tasks.workunit.client.0.smithi073.stderr: -462> 2024-09-12T00:50:39.936+0000 7faf4fa0f800 10 monclient(hunting): picked mon.noname-a con 0x55de54ba23b0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:50:40.227 INFO:tasks.workunit.client.0.smithi073.stderr: -461> 2024-09-12T00:50:39.936+0000 7faf4fa0f800 10 monclient(hunting): picked mon.noname-c con 0x55de54c3ad00 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:50:40.227 INFO:tasks.workunit.client.0.smithi073.stderr: -460> 2024-09-12T00:50:39.936+0000 7faf4fa0f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:40.227 INFO:tasks.workunit.client.0.smithi073.stderr: -459> 2024-09-12T00:50:39.936+0000 7faf4fa0f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:40.227 INFO:tasks.workunit.client.0.smithi073.stderr: -458> 2024-09-12T00:50:39.936+0000 7faf4fa0f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:40.227 INFO:tasks.workunit.client.0.smithi073.stderr: -457> 2024-09-12T00:50:39.936+0000 7faf4fa0f800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:40.227 INFO:tasks.workunit.client.0.smithi073.stderr: -456> 2024-09-12T00:50:39.936+0000 7faf4fa0f800 10 monclient(hunting): authenticate will time out at 2100.606382s 2024-09-12T00:50:40.227 INFO:tasks.workunit.client.0.smithi073.stderr: -455> 2024-09-12T00:50:39.936+0000 7faf4dcfa640 10 monclient(hunting): get_auth_request con 0x55de54c3ad00 auth_method 0 2024-09-12T00:50:40.227 INFO:tasks.workunit.client.0.smithi073.stderr: -454> 2024-09-12T00:50:39.936+0000 7faf4dcfa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:40.227 INFO:tasks.workunit.client.0.smithi073.stderr: -453> 2024-09-12T00:50:39.936+0000 7faf4dcfa640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:40.227 INFO:tasks.workunit.client.0.smithi073.stderr: -452> 2024-09-12T00:50:39.936+0000 7faf4dcfa640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:40.227 INFO:tasks.workunit.client.0.smithi073.stderr: -451> 2024-09-12T00:50:39.936+0000 7faf4ccf8640 10 monclient(hunting): get_auth_request con 0x55de54ba23b0 auth_method 0 2024-09-12T00:50:40.227 INFO:tasks.workunit.client.0.smithi073.stderr: -450> 2024-09-12T00:50:39.936+0000 7faf4ccf8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:40.228 INFO:tasks.workunit.client.0.smithi073.stderr: -449> 2024-09-12T00:50:39.936+0000 7faf4ccf8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:40.228 INFO:tasks.workunit.client.0.smithi073.stderr: -448> 2024-09-12T00:50:39.936+0000 7faf4ccf8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:40.228 INFO:tasks.workunit.client.0.smithi073.stderr: -447> 2024-09-12T00:50:39.936+0000 7faf4ccf8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:40.228 INFO:tasks.workunit.client.0.smithi073.stderr: -446> 2024-09-12T00:50:39.936+0000 7faf4ccf8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:40.228 INFO:tasks.workunit.client.0.smithi073.stderr: -445> 2024-09-12T00:50:39.936+0000 7faf4ccf8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:40.228 INFO:tasks.workunit.client.0.smithi073.stderr: -444> 2024-09-12T00:50:39.936+0000 7faf4dcfa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:40.228 INFO:tasks.workunit.client.0.smithi073.stderr: -443> 2024-09-12T00:50:39.936+0000 7faf4dcfa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:40.228 INFO:tasks.workunit.client.0.smithi073.stderr: -442> 2024-09-12T00:50:39.936+0000 7faf4dcfa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:40.228 INFO:tasks.workunit.client.0.smithi073.stderr: -441> 2024-09-12T00:50:39.936+0000 7faf4d4f9640 10 monclient(hunting): get_auth_request con 0x55de54b6e230 auth_method 0 2024-09-12T00:50:40.228 INFO:tasks.workunit.client.0.smithi073.stderr: -440> 2024-09-12T00:50:39.936+0000 7faf4d4f9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:40.228 INFO:tasks.workunit.client.0.smithi073.stderr: -439> 2024-09-12T00:50:39.936+0000 7faf4d4f9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:40.228 INFO:tasks.workunit.client.0.smithi073.stderr: -438> 2024-09-12T00:50:39.936+0000 7faf4d4f9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:40.228 INFO:tasks.workunit.client.0.smithi073.stderr: -437> 2024-09-12T00:50:39.936+0000 7faf4ccf8640 10 monclient(hunting): handle_auth_done global_id 7092 payload 824 2024-09-12T00:50:40.229 INFO:tasks.workunit.client.0.smithi073.stderr: -436> 2024-09-12T00:50:39.936+0000 7faf4ccf8640 10 monclient: _finish_hunting 0 2024-09-12T00:50:40.229 INFO:tasks.workunit.client.0.smithi073.stderr: -435> 2024-09-12T00:50:39.936+0000 7faf4ccf8640 1 monclient: found mon.noname-a 2024-09-12T00:50:40.229 INFO:tasks.workunit.client.0.smithi073.stderr: -434> 2024-09-12T00:50:39.936+0000 7faf4ccf8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:50:40.229 INFO:tasks.workunit.client.0.smithi073.stderr: -433> 2024-09-12T00:50:39.936+0000 7fae39e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:40.229 INFO:tasks.workunit.client.0.smithi073.stderr: -432> 2024-09-12T00:50:39.936+0000 7fae39e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:50:40.229 INFO:tasks.workunit.client.0.smithi073.stderr: -431> 2024-09-12T00:50:39.936+0000 7fae39e03640 10 monclient: dump: 2024-09-12T00:50:40.229 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:50:40.229 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:50:40.229 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:40.229 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:40.229 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:40.229 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:50:40.229 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:50:40.230 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:50:40.230 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:50:40.230 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:40.230 INFO:tasks.workunit.client.0.smithi073.stderr: -430> 2024-09-12T00:50:39.937+0000 7fae39e03640 10 monclient: _finish_auth 0 2024-09-12T00:50:40.230 INFO:tasks.workunit.client.0.smithi073.stderr: -429> 2024-09-12T00:50:39.937+0000 7fae39e03640 10 monclient: _check_auth_tickets 2024-09-12T00:50:40.230 INFO:tasks.workunit.client.0.smithi073.stderr: -428> 2024-09-12T00:50:39.937+0000 7fae39e03640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:40.230 INFO:tasks.workunit.client.0.smithi073.stderr: -427> 2024-09-12T00:50:39.937+0000 7fae39e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:40.230 INFO:tasks.workunit.client.0.smithi073.stderr: -426> 2024-09-12T00:50:39.937+0000 7fae39e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:50:40.230 INFO:tasks.workunit.client.0.smithi073.stderr: -425> 2024-09-12T00:50:39.937+0000 7fae39e03640 10 monclient: dump: 2024-09-12T00:50:40.232 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:50:40.232 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:50:40.232 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:40.232 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:40.232 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:40.232 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:50:40.232 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:50:40.232 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:50:40.232 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:50:40.232 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:40.232 INFO:tasks.workunit.client.0.smithi073.stderr: -424> 2024-09-12T00:50:39.937+0000 7faf4fa0f800 5 monclient: authenticate success, global_id 7092 2024-09-12T00:50:40.232 INFO:tasks.workunit.client.0.smithi073.stderr: -423> 2024-09-12T00:50:39.937+0000 7faf4fa0f800 10 monclient: _renew_subs 2024-09-12T00:50:40.232 INFO:tasks.workunit.client.0.smithi073.stderr: -422> 2024-09-12T00:50:39.937+0000 7faf4fa0f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:50:40.233 INFO:tasks.workunit.client.0.smithi073.stderr: -421> 2024-09-12T00:50:39.937+0000 7fae3b606640 4 set_mon_vals no callback set 2024-09-12T00:50:40.233 INFO:tasks.workunit.client.0.smithi073.stderr: -420> 2024-09-12T00:50:39.937+0000 7faf4fa0f800 10 monclient: _renew_subs 2024-09-12T00:50:40.233 INFO:tasks.workunit.client.0.smithi073.stderr: -419> 2024-09-12T00:50:39.937+0000 7faf4fa0f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:50:40.233 INFO:tasks.workunit.client.0.smithi073.stderr: -418> 2024-09-12T00:50:39.937+0000 7faf4fa0f800 1 librados: init done 2024-09-12T00:50:40.233 INFO:tasks.workunit.client.0.smithi073.stderr: -417> 2024-09-12T00:50:39.938+0000 7fae39e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:50:40.233 INFO:tasks.workunit.client.0.smithi073.stderr: -416> 2024-09-12T00:50:39.938+0000 7fae39e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:50:40.233 INFO:tasks.workunit.client.0.smithi073.stderr: -415> 2024-09-12T00:50:39.938+0000 7fae39e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:50:40.233 INFO:tasks.workunit.client.0.smithi073.stderr: -414> 2024-09-12T00:50:39.939+0000 7faf4d4f9640 10 monclient: get_auth_request con 0x7fae340764a0 auth_method 0 2024-09-12T00:50:40.233 INFO:tasks.workunit.client.0.smithi073.stderr: -413> 2024-09-12T00:50:39.939+0000 7faf4dcfa640 10 monclient: get_auth_request con 0x55de54d1fd90 auth_method 0 2024-09-12T00:50:40.233 INFO:tasks.workunit.client.0.smithi073.stderr: -412> 2024-09-12T00:50:39.940+0000 7faf4d4f9640 10 monclient: get_auth_request con 0x55de54d42c30 auth_method 0 2024-09-12T00:50:40.233 INFO:tasks.workunit.client.0.smithi073.stderr: -411> 2024-09-12T00:50:39.941+0000 7faf4ccf8640 10 monclient: get_auth_request con 0x55de54d47030 auth_method 0 2024-09-12T00:50:40.233 INFO:tasks.workunit.client.0.smithi073.stderr: -410> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 10 monclient: build_initial_monmap 2024-09-12T00:50:40.234 INFO:tasks.workunit.client.0.smithi073.stderr: -409> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 1 build_initial for_mkfs: 0 2024-09-12T00:50:40.234 INFO:tasks.workunit.client.0.smithi073.stderr: -408> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 10 monclient: monmap: 2024-09-12T00:50:40.234 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:50:40.234 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:40.234 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:50:40.234 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:50:40.234 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:40.234 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:50:40.234 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:50:40.234 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:50:40.234 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:50:40.234 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:40.234 INFO:tasks.workunit.client.0.smithi073.stderr: -407> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4bef0) adding auth protocol: cephx 2024-09-12T00:50:40.235 INFO:tasks.workunit.client.0.smithi073.stderr: -406> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4bef0) adding auth protocol: cephx 2024-09-12T00:50:40.235 INFO:tasks.workunit.client.0.smithi073.stderr: -405> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4bef0) adding auth protocol: cephx 2024-09-12T00:50:40.235 INFO:tasks.workunit.client.0.smithi073.stderr: -404> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4bef0) adding con mode: secure 2024-09-12T00:50:40.235 INFO:tasks.workunit.client.0.smithi073.stderr: -403> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4bef0) adding con mode: crc 2024-09-12T00:50:40.235 INFO:tasks.workunit.client.0.smithi073.stderr: -402> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4bef0) adding con mode: secure 2024-09-12T00:50:40.235 INFO:tasks.workunit.client.0.smithi073.stderr: -401> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4bef0) adding con mode: crc 2024-09-12T00:50:40.235 INFO:tasks.workunit.client.0.smithi073.stderr: -400> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4bef0) adding con mode: secure 2024-09-12T00:50:40.235 INFO:tasks.workunit.client.0.smithi073.stderr: -399> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4bef0) adding con mode: crc 2024-09-12T00:50:40.235 INFO:tasks.workunit.client.0.smithi073.stderr: -398> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4bef0) adding con mode: crc 2024-09-12T00:50:40.235 INFO:tasks.workunit.client.0.smithi073.stderr: -397> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4bef0) adding con mode: secure 2024-09-12T00:50:40.235 INFO:tasks.workunit.client.0.smithi073.stderr: -396> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4bef0) adding con mode: crc 2024-09-12T00:50:40.235 INFO:tasks.workunit.client.0.smithi073.stderr: -395> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4bef0) adding con mode: secure 2024-09-12T00:50:40.235 INFO:tasks.workunit.client.0.smithi073.stderr: -394> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4bef0) adding con mode: crc 2024-09-12T00:50:40.235 INFO:tasks.workunit.client.0.smithi073.stderr: -393> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4bef0) adding con mode: secure 2024-09-12T00:50:40.236 INFO:tasks.workunit.client.0.smithi073.stderr: -392> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:40.236 INFO:tasks.workunit.client.0.smithi073.stderr: -391> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 asok(0x55de54ad7630) register_command objecter_requests cmddesc objecter_requests hook 0x55de54d4f400 EEXIST 2024-09-12T00:50:40.236 INFO:tasks.workunit.client.0.smithi073.stderr: -390> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 10 monclient: init 2024-09-12T00:50:40.236 INFO:tasks.workunit.client.0.smithi073.stderr: -389> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4a5c8) adding auth protocol: cephx 2024-09-12T00:50:40.236 INFO:tasks.workunit.client.0.smithi073.stderr: -388> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4a5c8) adding auth protocol: cephx 2024-09-12T00:50:40.236 INFO:tasks.workunit.client.0.smithi073.stderr: -387> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4a5c8) adding auth protocol: cephx 2024-09-12T00:50:40.236 INFO:tasks.workunit.client.0.smithi073.stderr: -386> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4a5c8) adding con mode: secure 2024-09-12T00:50:40.236 INFO:tasks.workunit.client.0.smithi073.stderr: -385> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4a5c8) adding con mode: crc 2024-09-12T00:50:40.236 INFO:tasks.workunit.client.0.smithi073.stderr: -384> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4a5c8) adding con mode: secure 2024-09-12T00:50:40.236 INFO:tasks.workunit.client.0.smithi073.stderr: -383> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4a5c8) adding con mode: crc 2024-09-12T00:50:40.236 INFO:tasks.workunit.client.0.smithi073.stderr: -382> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4a5c8) adding con mode: secure 2024-09-12T00:50:40.237 INFO:tasks.workunit.client.0.smithi073.stderr: -381> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4a5c8) adding con mode: crc 2024-09-12T00:50:40.237 INFO:tasks.workunit.client.0.smithi073.stderr: -380> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4a5c8) adding con mode: crc 2024-09-12T00:50:40.237 INFO:tasks.workunit.client.0.smithi073.stderr: -379> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4a5c8) adding con mode: secure 2024-09-12T00:50:40.237 INFO:tasks.workunit.client.0.smithi073.stderr: -378> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4a5c8) adding con mode: crc 2024-09-12T00:50:40.237 INFO:tasks.workunit.client.0.smithi073.stderr: -377> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4a5c8) adding con mode: secure 2024-09-12T00:50:40.237 INFO:tasks.workunit.client.0.smithi073.stderr: -376> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4a5c8) adding con mode: crc 2024-09-12T00:50:40.237 INFO:tasks.workunit.client.0.smithi073.stderr: -375> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4a5c8) adding con mode: secure 2024-09-12T00:50:40.237 INFO:tasks.workunit.client.0.smithi073.stderr: -374> 2024-09-12T00:50:39.943+0000 7faf4fa0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:40.237 INFO:tasks.workunit.client.0.smithi073.stderr: -373> 2024-09-12T00:50:39.943+0000 7faf4fa0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:40.237 INFO:tasks.workunit.client.0.smithi073.stderr: -372> 2024-09-12T00:50:39.943+0000 7faf4fa0f800 5 asok(0x55de54ad7630) register_command rotate-key cmddesc rotate-key hook 0x55de54d4a710 EEXIST 2024-09-12T00:50:40.237 INFO:tasks.workunit.client.0.smithi073.stderr: -371> 2024-09-12T00:50:39.943+0000 7faf4fa0f800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:40.237 INFO:tasks.workunit.client.0.smithi073.stderr: -370> 2024-09-12T00:50:39.943+0000 7faf4fa0f800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:50:40.237 INFO:tasks.workunit.client.0.smithi073.stderr: -369> 2024-09-12T00:50:39.943+0000 7faf4fa0f800 10 monclient(hunting): picked mon.noname-a con 0x55de54d73720 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:50:40.238 INFO:tasks.workunit.client.0.smithi073.stderr: -368> 2024-09-12T00:50:39.943+0000 7faf4fa0f800 10 monclient(hunting): picked mon.noname-c con 0x55de54d73b00 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:50:40.238 INFO:tasks.workunit.client.0.smithi073.stderr: -367> 2024-09-12T00:50:39.943+0000 7faf4fa0f800 10 monclient(hunting): picked mon.noname-b con 0x55de54d72430 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:50:40.238 INFO:tasks.workunit.client.0.smithi073.stderr: -366> 2024-09-12T00:50:39.943+0000 7faf4fa0f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:40.238 INFO:tasks.workunit.client.0.smithi073.stderr: -365> 2024-09-12T00:50:39.943+0000 7faf4fa0f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:40.238 INFO:tasks.workunit.client.0.smithi073.stderr: -364> 2024-09-12T00:50:39.943+0000 7faf4fa0f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:40.238 INFO:tasks.workunit.client.0.smithi073.stderr: -363> 2024-09-12T00:50:39.943+0000 7faf4fa0f800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:40.238 INFO:tasks.workunit.client.0.smithi073.stderr: -362> 2024-09-12T00:50:39.943+0000 7faf4fa0f800 10 monclient(hunting): authenticate will time out at 2100.613425s 2024-09-12T00:50:40.238 INFO:tasks.workunit.client.0.smithi073.stderr: -361> 2024-09-12T00:50:39.943+0000 7faf4d4f9640 10 monclient(hunting): get_auth_request con 0x55de54d73720 auth_method 0 2024-09-12T00:50:40.238 INFO:tasks.workunit.client.0.smithi073.stderr: -360> 2024-09-12T00:50:39.943+0000 7faf4d4f9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:40.238 INFO:tasks.workunit.client.0.smithi073.stderr: -359> 2024-09-12T00:50:39.943+0000 7faf4d4f9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:40.238 INFO:tasks.workunit.client.0.smithi073.stderr: -358> 2024-09-12T00:50:39.943+0000 7faf4d4f9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:40.238 INFO:tasks.workunit.client.0.smithi073.stderr: -357> 2024-09-12T00:50:39.943+0000 7faf4ccf8640 10 monclient(hunting): get_auth_request con 0x55de54d73b00 auth_method 0 2024-09-12T00:50:40.238 INFO:tasks.workunit.client.0.smithi073.stderr: -356> 2024-09-12T00:50:39.943+0000 7faf4ccf8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:40.239 INFO:tasks.workunit.client.0.smithi073.stderr: -355> 2024-09-12T00:50:39.943+0000 7faf4ccf8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:40.239 INFO:tasks.workunit.client.0.smithi073.stderr: -354> 2024-09-12T00:50:39.943+0000 7faf4ccf8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:40.239 INFO:tasks.workunit.client.0.smithi073.stderr: -353> 2024-09-12T00:50:39.943+0000 7faf4d4f9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:40.239 INFO:tasks.workunit.client.0.smithi073.stderr: -352> 2024-09-12T00:50:39.943+0000 7faf4d4f9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:40.239 INFO:tasks.workunit.client.0.smithi073.stderr: -351> 2024-09-12T00:50:39.943+0000 7faf4d4f9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:40.239 INFO:tasks.workunit.client.0.smithi073.stderr: -350> 2024-09-12T00:50:39.943+0000 7faf4ccf8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:40.239 INFO:tasks.workunit.client.0.smithi073.stderr: -349> 2024-09-12T00:50:39.943+0000 7faf4ccf8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:40.239 INFO:tasks.workunit.client.0.smithi073.stderr: -348> 2024-09-12T00:50:39.943+0000 7faf4ccf8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:40.239 INFO:tasks.workunit.client.0.smithi073.stderr: -347> 2024-09-12T00:50:39.943+0000 7faf4dcfa640 10 monclient(hunting): get_auth_request con 0x55de54d72430 auth_method 0 2024-09-12T00:50:40.239 INFO:tasks.workunit.client.0.smithi073.stderr: -346> 2024-09-12T00:50:39.943+0000 7faf4dcfa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:40.239 INFO:tasks.workunit.client.0.smithi073.stderr: -345> 2024-09-12T00:50:39.943+0000 7faf4dcfa640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:40.239 INFO:tasks.workunit.client.0.smithi073.stderr: -344> 2024-09-12T00:50:39.943+0000 7faf4dcfa640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:40.239 INFO:tasks.workunit.client.0.smithi073.stderr: -343> 2024-09-12T00:50:39.943+0000 7faf4ccf8640 10 monclient(hunting): handle_auth_done global_id 6701 payload 824 2024-09-12T00:50:40.240 INFO:tasks.workunit.client.0.smithi073.stderr: -342> 2024-09-12T00:50:39.943+0000 7faf4ccf8640 10 monclient: _finish_hunting 0 2024-09-12T00:50:40.240 INFO:tasks.workunit.client.0.smithi073.stderr: -341> 2024-09-12T00:50:39.943+0000 7faf4ccf8640 1 monclient: found mon.noname-c 2024-09-12T00:50:40.240 INFO:tasks.workunit.client.0.smithi073.stderr: -340> 2024-09-12T00:50:39.943+0000 7faf4ccf8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.73:3301/0 2024-09-12T00:50:40.240 INFO:tasks.workunit.client.0.smithi073.stderr: -339> 2024-09-12T00:50:39.943+0000 7fae32ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:40.240 INFO:tasks.workunit.client.0.smithi073.stderr: -338> 2024-09-12T00:50:39.944+0000 7fae32ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:50:40.240 INFO:tasks.workunit.client.0.smithi073.stderr: -337> 2024-09-12T00:50:39.944+0000 7fae32ffd640 10 monclient: dump: 2024-09-12T00:50:40.240 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:50:40.240 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:50:40.240 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:40.240 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:40.240 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:40.240 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:50:40.241 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:50:40.241 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:50:40.241 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:50:40.241 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:40.241 INFO:tasks.workunit.client.0.smithi073.stderr: -336> 2024-09-12T00:50:39.944+0000 7fae32ffd640 10 monclient: _finish_auth 0 2024-09-12T00:50:40.241 INFO:tasks.workunit.client.0.smithi073.stderr: -335> 2024-09-12T00:50:39.944+0000 7fae32ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:50:40.241 INFO:tasks.workunit.client.0.smithi073.stderr: -334> 2024-09-12T00:50:39.944+0000 7fae32ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:40.241 INFO:tasks.workunit.client.0.smithi073.stderr: -333> 2024-09-12T00:50:39.944+0000 7fae32ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:40.241 INFO:tasks.workunit.client.0.smithi073.stderr: -332> 2024-09-12T00:50:39.944+0000 7fae32ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:50:40.241 INFO:tasks.workunit.client.0.smithi073.stderr: -331> 2024-09-12T00:50:39.944+0000 7fae32ffd640 10 monclient: dump: 2024-09-12T00:50:40.241 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:50:40.241 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:50:40.241 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:40.241 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:40.242 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:40.242 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:50:40.242 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:50:40.242 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:50:40.242 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:50:40.242 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:40.242 INFO:tasks.workunit.client.0.smithi073.stderr: -330> 2024-09-12T00:50:39.944+0000 7faf4fa0f800 5 monclient: authenticate success, global_id 6701 2024-09-12T00:50:40.242 INFO:tasks.workunit.client.0.smithi073.stderr: -329> 2024-09-12T00:50:39.944+0000 7faf4e4fb640 4 set_mon_vals no callback set 2024-09-12T00:50:40.242 INFO:tasks.workunit.client.0.smithi073.stderr: -328> 2024-09-12T00:50:39.944+0000 7faf4fa0f800 10 monclient: _renew_subs 2024-09-12T00:50:40.242 INFO:tasks.workunit.client.0.smithi073.stderr: -327> 2024-09-12T00:50:39.944+0000 7faf4fa0f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:50:40.242 INFO:tasks.workunit.client.0.smithi073.stderr: -326> 2024-09-12T00:50:39.944+0000 7faf4fa0f800 10 monclient: _renew_subs 2024-09-12T00:50:40.242 INFO:tasks.workunit.client.0.smithi073.stderr: -325> 2024-09-12T00:50:39.944+0000 7faf4fa0f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:50:40.242 INFO:tasks.workunit.client.0.smithi073.stderr: -324> 2024-09-12T00:50:39.945+0000 7fae32ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:50:40.243 INFO:tasks.workunit.client.0.smithi073.stderr: -323> 2024-09-12T00:50:39.945+0000 7fae32ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:50:40.243 INFO:tasks.workunit.client.0.smithi073.stderr: -322> 2024-09-12T00:50:39.945+0000 7fae32ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:50:40.243 INFO:tasks.workunit.client.0.smithi073.stderr: -321> 2024-09-12T00:50:39.945+0000 7faf4d4f9640 10 monclient: get_auth_request con 0x7fae28076380 auth_method 0 2024-09-12T00:50:40.243 INFO:tasks.workunit.client.0.smithi073.stderr: -320> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 10 monclient: get_monmap_and_config 2024-09-12T00:50:40.243 INFO:tasks.workunit.client.0.smithi073.stderr: -319> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 10 monclient: build_initial_monmap 2024-09-12T00:50:40.243 INFO:tasks.workunit.client.0.smithi073.stderr: -318> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 1 build_initial for_mkfs: 0 2024-09-12T00:50:40.243 INFO:tasks.workunit.client.0.smithi073.stderr: -317> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 10 monclient: monmap: 2024-09-12T00:50:40.243 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:50:40.243 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:40.243 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:50:40.243 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:50:40.243 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:40.244 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:50:40.244 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:50:40.244 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:50:40.244 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:50:40.244 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:40.244 INFO:tasks.workunit.client.0.smithi073.stderr: -316> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d92fd0) adding auth protocol: cephx 2024-09-12T00:50:40.244 INFO:tasks.workunit.client.0.smithi073.stderr: -315> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d92fd0) adding auth protocol: cephx 2024-09-12T00:50:40.244 INFO:tasks.workunit.client.0.smithi073.stderr: -314> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d92fd0) adding auth protocol: cephx 2024-09-12T00:50:40.244 INFO:tasks.workunit.client.0.smithi073.stderr: -313> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d92fd0) adding con mode: secure 2024-09-12T00:50:40.244 INFO:tasks.workunit.client.0.smithi073.stderr: -312> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d92fd0) adding con mode: crc 2024-09-12T00:50:40.244 INFO:tasks.workunit.client.0.smithi073.stderr: -311> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d92fd0) adding con mode: secure 2024-09-12T00:50:40.244 INFO:tasks.workunit.client.0.smithi073.stderr: -310> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d92fd0) adding con mode: crc 2024-09-12T00:50:40.244 INFO:tasks.workunit.client.0.smithi073.stderr: -309> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d92fd0) adding con mode: secure 2024-09-12T00:50:40.245 INFO:tasks.workunit.client.0.smithi073.stderr: -308> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d92fd0) adding con mode: crc 2024-09-12T00:50:40.245 INFO:tasks.workunit.client.0.smithi073.stderr: -307> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d92fd0) adding con mode: crc 2024-09-12T00:50:40.245 INFO:tasks.workunit.client.0.smithi073.stderr: -306> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d92fd0) adding con mode: secure 2024-09-12T00:50:40.245 INFO:tasks.workunit.client.0.smithi073.stderr: -305> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d92fd0) adding con mode: crc 2024-09-12T00:50:40.245 INFO:tasks.workunit.client.0.smithi073.stderr: -304> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d92fd0) adding con mode: secure 2024-09-12T00:50:40.245 INFO:tasks.workunit.client.0.smithi073.stderr: -303> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d92fd0) adding con mode: crc 2024-09-12T00:50:40.245 INFO:tasks.workunit.client.0.smithi073.stderr: -302> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d92fd0) adding con mode: secure 2024-09-12T00:50:40.245 INFO:tasks.workunit.client.0.smithi073.stderr: -301> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:40.245 INFO:tasks.workunit.client.0.smithi073.stderr: -300> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 10 monclient: init 2024-09-12T00:50:40.245 INFO:tasks.workunit.client.0.smithi073.stderr: -299> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f39b70) adding auth protocol: cephx 2024-09-12T00:50:40.245 INFO:tasks.workunit.client.0.smithi073.stderr: -298> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f39b70) adding auth protocol: cephx 2024-09-12T00:50:40.245 INFO:tasks.workunit.client.0.smithi073.stderr: -297> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f39b70) adding auth protocol: cephx 2024-09-12T00:50:40.245 INFO:tasks.workunit.client.0.smithi073.stderr: -296> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f39b70) adding con mode: secure 2024-09-12T00:50:40.246 INFO:tasks.workunit.client.0.smithi073.stderr: -295> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f39b70) adding con mode: crc 2024-09-12T00:50:40.246 INFO:tasks.workunit.client.0.smithi073.stderr: -294> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f39b70) adding con mode: secure 2024-09-12T00:50:40.246 INFO:tasks.workunit.client.0.smithi073.stderr: -293> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f39b70) adding con mode: crc 2024-09-12T00:50:40.246 INFO:tasks.workunit.client.0.smithi073.stderr: -292> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f39b70) adding con mode: secure 2024-09-12T00:50:40.246 INFO:tasks.workunit.client.0.smithi073.stderr: -291> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f39b70) adding con mode: crc 2024-09-12T00:50:40.246 INFO:tasks.workunit.client.0.smithi073.stderr: -290> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f39b70) adding con mode: crc 2024-09-12T00:50:40.246 INFO:tasks.workunit.client.0.smithi073.stderr: -289> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f39b70) adding con mode: secure 2024-09-12T00:50:40.246 INFO:tasks.workunit.client.0.smithi073.stderr: -288> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f39b70) adding con mode: crc 2024-09-12T00:50:40.246 INFO:tasks.workunit.client.0.smithi073.stderr: -287> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f39b70) adding con mode: secure 2024-09-12T00:50:40.246 INFO:tasks.workunit.client.0.smithi073.stderr: -286> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f39b70) adding con mode: crc 2024-09-12T00:50:40.246 INFO:tasks.workunit.client.0.smithi073.stderr: -285> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f39b70) adding con mode: secure 2024-09-12T00:50:40.246 INFO:tasks.workunit.client.0.smithi073.stderr: -284> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:40.247 INFO:tasks.workunit.client.0.smithi073.stderr: -283> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:40.247 INFO:tasks.workunit.client.0.smithi073.stderr: -282> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 asok(0x55de54ad7630) register_command rotate-key cmddesc rotate-key hook 0x7ffce9f39cb8 EEXIST 2024-09-12T00:50:40.247 INFO:tasks.workunit.client.0.smithi073.stderr: -281> 2024-09-12T00:50:39.947+0000 7faf4fa0f800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:40.247 INFO:tasks.workunit.client.0.smithi073.stderr: -280> 2024-09-12T00:50:39.947+0000 7faf4fa0f800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:50:40.247 INFO:tasks.workunit.client.0.smithi073.stderr: -279> 2024-09-12T00:50:39.947+0000 7faf4fa0f800 10 monclient(hunting): picked mon.noname-a con 0x55de54dc7610 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:50:40.247 INFO:tasks.workunit.client.0.smithi073.stderr: -278> 2024-09-12T00:50:39.947+0000 7faf4fa0f800 10 monclient(hunting): picked mon.noname-c con 0x55de54d98620 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:50:40.247 INFO:tasks.workunit.client.0.smithi073.stderr: -277> 2024-09-12T00:50:39.947+0000 7faf4fa0f800 10 monclient(hunting): picked mon.noname-b con 0x55de54dc2af0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:50:40.247 INFO:tasks.workunit.client.0.smithi073.stderr: -276> 2024-09-12T00:50:39.947+0000 7faf4fa0f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:40.247 INFO:tasks.workunit.client.0.smithi073.stderr: -275> 2024-09-12T00:50:39.947+0000 7faf4fa0f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:40.247 INFO:tasks.workunit.client.0.smithi073.stderr: -274> 2024-09-12T00:50:39.947+0000 7faf4fa0f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:40.247 INFO:tasks.workunit.client.0.smithi073.stderr: -273> 2024-09-12T00:50:39.947+0000 7faf4fa0f800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:40.247 INFO:tasks.workunit.client.0.smithi073.stderr: -272> 2024-09-12T00:50:39.947+0000 7faf4fa0f800 10 monclient(hunting): authenticate will time out at 2100.617070s 2024-09-12T00:50:40.247 INFO:tasks.workunit.client.0.smithi073.stderr: -271> 2024-09-12T00:50:39.947+0000 7faf4ccf8640 10 monclient(hunting): get_auth_request con 0x55de54d98620 auth_method 0 2024-09-12T00:50:40.248 INFO:tasks.workunit.client.0.smithi073.stderr: -270> 2024-09-12T00:50:39.947+0000 7faf4ccf8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:40.248 INFO:tasks.workunit.client.0.smithi073.stderr: -269> 2024-09-12T00:50:39.947+0000 7faf4ccf8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:40.248 INFO:tasks.workunit.client.0.smithi073.stderr: -268> 2024-09-12T00:50:39.947+0000 7faf4ccf8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:40.248 INFO:tasks.workunit.client.0.smithi073.stderr: -267> 2024-09-12T00:50:39.947+0000 7faf4d4f9640 10 monclient(hunting): get_auth_request con 0x55de54dc7610 auth_method 0 2024-09-12T00:50:40.248 INFO:tasks.workunit.client.0.smithi073.stderr: -266> 2024-09-12T00:50:39.947+0000 7faf4d4f9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:40.248 INFO:tasks.workunit.client.0.smithi073.stderr: -265> 2024-09-12T00:50:39.947+0000 7faf4d4f9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:40.248 INFO:tasks.workunit.client.0.smithi073.stderr: -264> 2024-09-12T00:50:39.947+0000 7faf4d4f9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:40.248 INFO:tasks.workunit.client.0.smithi073.stderr: -263> 2024-09-12T00:50:39.947+0000 7faf4ccf8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:40.248 INFO:tasks.workunit.client.0.smithi073.stderr: -262> 2024-09-12T00:50:39.947+0000 7faf4ccf8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:40.248 INFO:tasks.workunit.client.0.smithi073.stderr: -261> 2024-09-12T00:50:39.947+0000 7faf4ccf8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:40.248 INFO:tasks.workunit.client.0.smithi073.stderr: -260> 2024-09-12T00:50:39.947+0000 7faf4d4f9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:40.248 INFO:tasks.workunit.client.0.smithi073.stderr: -259> 2024-09-12T00:50:39.947+0000 7faf4d4f9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:40.248 INFO:tasks.workunit.client.0.smithi073.stderr: -258> 2024-09-12T00:50:39.947+0000 7faf4d4f9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:40.249 INFO:tasks.workunit.client.0.smithi073.stderr: -257> 2024-09-12T00:50:39.947+0000 7faf4dcfa640 10 monclient(hunting): get_auth_request con 0x55de54dc2af0 auth_method 0 2024-09-12T00:50:40.249 INFO:tasks.workunit.client.0.smithi073.stderr: -256> 2024-09-12T00:50:39.947+0000 7faf4dcfa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:40.249 INFO:tasks.workunit.client.0.smithi073.stderr: -255> 2024-09-12T00:50:39.947+0000 7faf4dcfa640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:40.249 INFO:tasks.workunit.client.0.smithi073.stderr: -254> 2024-09-12T00:50:39.947+0000 7faf4dcfa640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:40.249 INFO:tasks.workunit.client.0.smithi073.stderr: -253> 2024-09-12T00:50:39.947+0000 7faf4ccf8640 10 monclient(hunting): handle_auth_done global_id 6704 payload 274 2024-09-12T00:50:40.249 INFO:tasks.workunit.client.0.smithi073.stderr: -252> 2024-09-12T00:50:39.947+0000 7faf4ccf8640 10 monclient: _finish_hunting 0 2024-09-12T00:50:40.249 INFO:tasks.workunit.client.0.smithi073.stderr: -251> 2024-09-12T00:50:39.947+0000 7faf4ccf8640 1 monclient: found mon.noname-c 2024-09-12T00:50:40.249 INFO:tasks.workunit.client.0.smithi073.stderr: -250> 2024-09-12T00:50:39.947+0000 7faf4ccf8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.73:3301/0 2024-09-12T00:50:40.249 INFO:tasks.workunit.client.0.smithi073.stderr: -249> 2024-09-12T00:50:39.947+0000 7fae30ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:40.249 INFO:tasks.workunit.client.0.smithi073.stderr: -248> 2024-09-12T00:50:39.947+0000 7fae30ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:50:40.249 INFO:tasks.workunit.client.0.smithi073.stderr: -247> 2024-09-12T00:50:39.947+0000 7fae30ff9640 10 monclient: dump: 2024-09-12T00:50:40.249 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:50:40.250 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:50:40.250 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:40.250 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:40.250 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:40.250 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:50:40.250 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:50:40.250 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:50:40.250 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:50:40.250 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:40.250 INFO:tasks.workunit.client.0.smithi073.stderr: -246> 2024-09-12T00:50:39.947+0000 7fae30ff9640 10 monclient: _finish_auth 0 2024-09-12T00:50:40.250 INFO:tasks.workunit.client.0.smithi073.stderr: -245> 2024-09-12T00:50:39.947+0000 7fae30ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:50:40.250 INFO:tasks.workunit.client.0.smithi073.stderr: -244> 2024-09-12T00:50:39.947+0000 7fae30ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:40.250 INFO:tasks.workunit.client.0.smithi073.stderr: -243> 2024-09-12T00:50:39.947+0000 7fae30ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:40.251 INFO:tasks.workunit.client.0.smithi073.stderr: -242> 2024-09-12T00:50:39.947+0000 7fae30ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:50:40.251 INFO:tasks.workunit.client.0.smithi073.stderr: -241> 2024-09-12T00:50:39.947+0000 7fae30ff9640 10 monclient: dump: 2024-09-12T00:50:40.251 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:50:40.251 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:50:40.251 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:40.251 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:40.251 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:40.251 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:50:40.251 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:50:40.251 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:50:40.251 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:50:40.251 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:40.251 INFO:tasks.workunit.client.0.smithi073.stderr: -240> 2024-09-12T00:50:39.947+0000 7faf4fa0f800 5 monclient: authenticate success, global_id 6704 2024-09-12T00:50:40.251 INFO:tasks.workunit.client.0.smithi073.stderr: -239> 2024-09-12T00:50:39.947+0000 7faf4fa0f800 10 monclient: get_monmap_and_config success 2024-09-12T00:50:40.252 INFO:tasks.workunit.client.0.smithi073.stderr: -238> 2024-09-12T00:50:39.947+0000 7faf4fa0f800 4 set_mon_vals no callback set 2024-09-12T00:50:40.252 INFO:tasks.workunit.client.0.smithi073.stderr: -237> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 10 monclient: shutdown 2024-09-12T00:50:40.252 INFO:tasks.workunit.client.0.smithi073.stderr: -236> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 10 monclient: build_initial_monmap 2024-09-12T00:50:40.252 INFO:tasks.workunit.client.0.smithi073.stderr: -235> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 1 build_initial for_mkfs: 0 2024-09-12T00:50:40.252 INFO:tasks.workunit.client.0.smithi073.stderr: -234> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 10 monclient: monmap: 2024-09-12T00:50:40.252 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:50:40.252 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:40.252 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:50:40.252 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:50:40.252 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:40.252 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:50:40.252 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:50:40.252 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:50:40.253 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:50:40.253 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:40.253 INFO:tasks.workunit.client.0.smithi073.stderr: -233> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54dc36d0) adding auth protocol: cephx 2024-09-12T00:50:40.253 INFO:tasks.workunit.client.0.smithi073.stderr: -232> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54dc36d0) adding auth protocol: cephx 2024-09-12T00:50:40.253 INFO:tasks.workunit.client.0.smithi073.stderr: -231> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54dc36d0) adding auth protocol: cephx 2024-09-12T00:50:40.253 INFO:tasks.workunit.client.0.smithi073.stderr: -230> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54dc36d0) adding con mode: secure 2024-09-12T00:50:40.253 INFO:tasks.workunit.client.0.smithi073.stderr: -229> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54dc36d0) adding con mode: crc 2024-09-12T00:50:40.253 INFO:tasks.workunit.client.0.smithi073.stderr: -228> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54dc36d0) adding con mode: secure 2024-09-12T00:50:40.253 INFO:tasks.workunit.client.0.smithi073.stderr: -227> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54dc36d0) adding con mode: crc 2024-09-12T00:50:40.253 INFO:tasks.workunit.client.0.smithi073.stderr: -226> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54dc36d0) adding con mode: secure 2024-09-12T00:50:40.253 INFO:tasks.workunit.client.0.smithi073.stderr: -225> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54dc36d0) adding con mode: crc 2024-09-12T00:50:40.253 INFO:tasks.workunit.client.0.smithi073.stderr: -224> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54dc36d0) adding con mode: crc 2024-09-12T00:50:40.253 INFO:tasks.workunit.client.0.smithi073.stderr: -223> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54dc36d0) adding con mode: secure 2024-09-12T00:50:40.254 INFO:tasks.workunit.client.0.smithi073.stderr: -222> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54dc36d0) adding con mode: crc 2024-09-12T00:50:40.254 INFO:tasks.workunit.client.0.smithi073.stderr: -221> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54dc36d0) adding con mode: secure 2024-09-12T00:50:40.254 INFO:tasks.workunit.client.0.smithi073.stderr: -220> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54dc36d0) adding con mode: crc 2024-09-12T00:50:40.254 INFO:tasks.workunit.client.0.smithi073.stderr: -219> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54dc36d0) adding con mode: secure 2024-09-12T00:50:40.254 INFO:tasks.workunit.client.0.smithi073.stderr: -218> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:40.254 INFO:tasks.workunit.client.0.smithi073.stderr: -217> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 1 librados: starting msgr at 2024-09-12T00:50:40.254 INFO:tasks.workunit.client.0.smithi073.stderr: -216> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 1 librados: starting objecter 2024-09-12T00:50:40.254 INFO:tasks.workunit.client.0.smithi073.stderr: -215> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 asok(0x55de54ad7630) register_command objecter_requests cmddesc objecter_requests hook 0x55de54d75570 EEXIST 2024-09-12T00:50:40.254 INFO:tasks.workunit.client.0.smithi073.stderr: -214> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 1 librados: setting wanted keys 2024-09-12T00:50:40.254 INFO:tasks.workunit.client.0.smithi073.stderr: -213> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 1 librados: calling monclient init 2024-09-12T00:50:40.254 INFO:tasks.workunit.client.0.smithi073.stderr: -212> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 10 monclient: init 2024-09-12T00:50:40.254 INFO:tasks.workunit.client.0.smithi073.stderr: -211> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d87fe0) adding auth protocol: cephx 2024-09-12T00:50:40.254 INFO:tasks.workunit.client.0.smithi073.stderr: -210> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d87fe0) adding auth protocol: cephx 2024-09-12T00:50:40.255 INFO:tasks.workunit.client.0.smithi073.stderr: -209> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d87fe0) adding auth protocol: cephx 2024-09-12T00:50:40.255 INFO:tasks.workunit.client.0.smithi073.stderr: -208> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d87fe0) adding con mode: secure 2024-09-12T00:50:40.255 INFO:tasks.workunit.client.0.smithi073.stderr: -207> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d87fe0) adding con mode: crc 2024-09-12T00:50:40.255 INFO:tasks.workunit.client.0.smithi073.stderr: -206> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d87fe0) adding con mode: secure 2024-09-12T00:50:40.255 INFO:tasks.workunit.client.0.smithi073.stderr: -205> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d87fe0) adding con mode: crc 2024-09-12T00:50:40.255 INFO:tasks.workunit.client.0.smithi073.stderr: -204> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d87fe0) adding con mode: secure 2024-09-12T00:50:40.255 INFO:tasks.workunit.client.0.smithi073.stderr: -203> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d87fe0) adding con mode: crc 2024-09-12T00:50:40.255 INFO:tasks.workunit.client.0.smithi073.stderr: -202> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d87fe0) adding con mode: crc 2024-09-12T00:50:40.255 INFO:tasks.workunit.client.0.smithi073.stderr: -201> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d87fe0) adding con mode: secure 2024-09-12T00:50:40.255 INFO:tasks.workunit.client.0.smithi073.stderr: -200> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d87fe0) adding con mode: crc 2024-09-12T00:50:40.255 INFO:tasks.workunit.client.0.smithi073.stderr: -199> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d87fe0) adding con mode: secure 2024-09-12T00:50:40.255 INFO:tasks.workunit.client.0.smithi073.stderr: -198> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d87fe0) adding con mode: crc 2024-09-12T00:50:40.256 INFO:tasks.workunit.client.0.smithi073.stderr: -197> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d87fe0) adding con mode: secure 2024-09-12T00:50:40.256 INFO:tasks.workunit.client.0.smithi073.stderr: -196> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:40.256 INFO:tasks.workunit.client.0.smithi073.stderr: -195> 2024-09-12T00:50:39.949+0000 7faf4fa0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:40.256 INFO:tasks.workunit.client.0.smithi073.stderr: -194> 2024-09-12T00:50:39.949+0000 7faf4fa0f800 5 asok(0x55de54ad7630) register_command rotate-key cmddesc rotate-key hook 0x55de54d88128 EEXIST 2024-09-12T00:50:40.256 INFO:tasks.workunit.client.0.smithi073.stderr: -193> 2024-09-12T00:50:39.949+0000 7faf4fa0f800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:40.256 INFO:tasks.workunit.client.0.smithi073.stderr: -192> 2024-09-12T00:50:39.949+0000 7faf4fa0f800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:50:40.256 INFO:tasks.workunit.client.0.smithi073.stderr: -191> 2024-09-12T00:50:39.949+0000 7faf4fa0f800 10 monclient(hunting): picked mon.noname-b con 0x55de54d98620 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:50:40.256 INFO:tasks.workunit.client.0.smithi073.stderr: -190> 2024-09-12T00:50:39.949+0000 7faf4fa0f800 10 monclient(hunting): picked mon.noname-a con 0x55de54dc2af0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:50:40.256 INFO:tasks.workunit.client.0.smithi073.stderr: -189> 2024-09-12T00:50:39.949+0000 7faf4fa0f800 10 monclient(hunting): picked mon.noname-c con 0x55de54dc7610 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:50:40.256 INFO:tasks.workunit.client.0.smithi073.stderr: -188> 2024-09-12T00:50:39.949+0000 7faf4fa0f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:40.256 INFO:tasks.workunit.client.0.smithi073.stderr: -187> 2024-09-12T00:50:39.949+0000 7faf4fa0f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:40.256 INFO:tasks.workunit.client.0.smithi073.stderr: -186> 2024-09-12T00:50:39.949+0000 7faf4fa0f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:40.256 INFO:tasks.workunit.client.0.smithi073.stderr: -185> 2024-09-12T00:50:39.949+0000 7faf4fa0f800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:40.257 INFO:tasks.workunit.client.0.smithi073.stderr: -184> 2024-09-12T00:50:39.949+0000 7faf4fa0f800 10 monclient(hunting): authenticate will time out at 2100.619246s 2024-09-12T00:50:40.257 INFO:tasks.workunit.client.0.smithi073.stderr: -183> 2024-09-12T00:50:39.949+0000 7faf4dcfa640 10 monclient(hunting): get_auth_request con 0x55de54dc7610 auth_method 0 2024-09-12T00:50:40.257 INFO:tasks.workunit.client.0.smithi073.stderr: -182> 2024-09-12T00:50:39.949+0000 7faf4dcfa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:40.257 INFO:tasks.workunit.client.0.smithi073.stderr: -181> 2024-09-12T00:50:39.949+0000 7faf4dcfa640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:40.257 INFO:tasks.workunit.client.0.smithi073.stderr: -180> 2024-09-12T00:50:39.949+0000 7faf4dcfa640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:40.257 INFO:tasks.workunit.client.0.smithi073.stderr: -179> 2024-09-12T00:50:39.949+0000 7faf4ccf8640 10 monclient(hunting): get_auth_request con 0x55de54dc2af0 auth_method 0 2024-09-12T00:50:40.257 INFO:tasks.workunit.client.0.smithi073.stderr: -178> 2024-09-12T00:50:39.949+0000 7faf4ccf8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:40.257 INFO:tasks.workunit.client.0.smithi073.stderr: -177> 2024-09-12T00:50:39.949+0000 7faf4ccf8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:40.257 INFO:tasks.workunit.client.0.smithi073.stderr: -176> 2024-09-12T00:50:39.949+0000 7faf4ccf8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:40.257 INFO:tasks.workunit.client.0.smithi073.stderr: -175> 2024-09-12T00:50:39.949+0000 7faf4dcfa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:40.257 INFO:tasks.workunit.client.0.smithi073.stderr: -174> 2024-09-12T00:50:39.949+0000 7faf4dcfa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:40.257 INFO:tasks.workunit.client.0.smithi073.stderr: -173> 2024-09-12T00:50:39.949+0000 7faf4dcfa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:40.257 INFO:tasks.workunit.client.0.smithi073.stderr: -172> 2024-09-12T00:50:39.949+0000 7faf4ccf8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:40.258 INFO:tasks.workunit.client.0.smithi073.stderr: -171> 2024-09-12T00:50:39.949+0000 7faf4ccf8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:40.258 INFO:tasks.workunit.client.0.smithi073.stderr: -170> 2024-09-12T00:50:39.949+0000 7faf4ccf8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:40.258 INFO:tasks.workunit.client.0.smithi073.stderr: -169> 2024-09-12T00:50:39.949+0000 7faf4d4f9640 10 monclient(hunting): get_auth_request con 0x55de54d98620 auth_method 0 2024-09-12T00:50:40.258 INFO:tasks.workunit.client.0.smithi073.stderr: -168> 2024-09-12T00:50:39.949+0000 7faf4d4f9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:40.258 INFO:tasks.workunit.client.0.smithi073.stderr: -167> 2024-09-12T00:50:39.949+0000 7faf4d4f9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:40.258 INFO:tasks.workunit.client.0.smithi073.stderr: -166> 2024-09-12T00:50:39.949+0000 7faf4d4f9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:40.258 INFO:tasks.workunit.client.0.smithi073.stderr: -165> 2024-09-12T00:50:39.949+0000 7faf4dcfa640 10 monclient(hunting): handle_auth_done global_id 6707 payload 824 2024-09-12T00:50:40.258 INFO:tasks.workunit.client.0.smithi073.stderr: -164> 2024-09-12T00:50:39.949+0000 7faf4dcfa640 10 monclient: _finish_hunting 0 2024-09-12T00:50:40.258 INFO:tasks.workunit.client.0.smithi073.stderr: -163> 2024-09-12T00:50:39.949+0000 7faf4dcfa640 1 monclient: found mon.noname-c 2024-09-12T00:50:40.258 INFO:tasks.workunit.client.0.smithi073.stderr: -162> 2024-09-12T00:50:39.949+0000 7faf4dcfa640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.73:3301/0 2024-09-12T00:50:40.258 INFO:tasks.workunit.client.0.smithi073.stderr: -161> 2024-09-12T00:50:39.949+0000 7fae1effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:40.258 INFO:tasks.workunit.client.0.smithi073.stderr: -160> 2024-09-12T00:50:39.949+0000 7fae1effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:50:40.259 INFO:tasks.workunit.client.0.smithi073.stderr: -159> 2024-09-12T00:50:39.949+0000 7fae1effd640 10 monclient: dump: 2024-09-12T00:50:40.259 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:50:40.259 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:50:40.259 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:40.259 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:40.259 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:40.259 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:50:40.259 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:50:40.259 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:50:40.259 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:50:40.259 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:40.259 INFO:tasks.workunit.client.0.smithi073.stderr: -158> 2024-09-12T00:50:39.949+0000 7fae1effd640 10 monclient: _finish_auth 0 2024-09-12T00:50:40.259 INFO:tasks.workunit.client.0.smithi073.stderr: -157> 2024-09-12T00:50:39.949+0000 7fae1effd640 10 monclient: _check_auth_tickets 2024-09-12T00:50:40.259 INFO:tasks.workunit.client.0.smithi073.stderr: -156> 2024-09-12T00:50:39.949+0000 7fae1effd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:40.260 INFO:tasks.workunit.client.0.smithi073.stderr: -155> 2024-09-12T00:50:39.949+0000 7fae1effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:40.260 INFO:tasks.workunit.client.0.smithi073.stderr: -154> 2024-09-12T00:50:39.949+0000 7fae1effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:50:40.260 INFO:tasks.workunit.client.0.smithi073.stderr: -153> 2024-09-12T00:50:39.949+0000 7fae1effd640 10 monclient: dump: 2024-09-12T00:50:40.260 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:50:40.260 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:50:40.260 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:40.260 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:40.260 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:40.260 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:50:40.260 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:50:40.260 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:50:40.260 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:50:40.260 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:40.261 INFO:tasks.workunit.client.0.smithi073.stderr: -152> 2024-09-12T00:50:39.949+0000 7faf4fa0f800 5 monclient: authenticate success, global_id 6707 2024-09-12T00:50:40.261 INFO:tasks.workunit.client.0.smithi073.stderr: -151> 2024-09-12T00:50:39.949+0000 7faf4fa0f800 10 monclient: _renew_subs 2024-09-12T00:50:40.261 INFO:tasks.workunit.client.0.smithi073.stderr: -150> 2024-09-12T00:50:39.949+0000 7fae30ff9640 4 set_mon_vals no callback set 2024-09-12T00:50:40.261 INFO:tasks.workunit.client.0.smithi073.stderr: -149> 2024-09-12T00:50:39.949+0000 7faf4fa0f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:50:40.261 INFO:tasks.workunit.client.0.smithi073.stderr: -148> 2024-09-12T00:50:39.950+0000 7faf4fa0f800 10 monclient: _renew_subs 2024-09-12T00:50:40.261 INFO:tasks.workunit.client.0.smithi073.stderr: -147> 2024-09-12T00:50:39.950+0000 7faf4fa0f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:50:40.261 INFO:tasks.workunit.client.0.smithi073.stderr: -146> 2024-09-12T00:50:39.950+0000 7faf4fa0f800 1 librados: init done 2024-09-12T00:50:40.261 INFO:tasks.workunit.client.0.smithi073.stderr: -145> 2024-09-12T00:50:39.950+0000 7faf4fa0f800 5 asok(0x55de54ad7630) register_command cr dump hook 0x7faf380973f8 2024-09-12T00:50:40.261 INFO:tasks.workunit.client.0.smithi073.stderr: -144> 2024-09-12T00:50:39.951+0000 7faf4fa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.261 INFO:tasks.workunit.client.0.smithi073.stderr: -143> 2024-09-12T00:50:39.952+0000 7fae1effd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:50:40.261 INFO:tasks.workunit.client.0.smithi073.stderr: -142> 2024-09-12T00:50:39.952+0000 7fae1effd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:50:40.261 INFO:tasks.workunit.client.0.smithi073.stderr: -141> 2024-09-12T00:50:39.952+0000 7fae1effd640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:50:40.262 INFO:tasks.workunit.client.0.smithi073.stderr: -140> 2024-09-12T00:50:39.952+0000 7faf4d4f9640 10 monclient: get_auth_request con 0x7fae180764a0 auth_method 0 2024-09-12T00:50:40.262 INFO:tasks.workunit.client.0.smithi073.stderr: -139> 2024-09-12T00:50:39.953+0000 7faf4ccf8640 10 monclient: get_auth_request con 0x55de54de1740 auth_method 0 2024-09-12T00:50:40.262 INFO:tasks.workunit.client.0.smithi073.stderr: -138> 2024-09-12T00:50:39.953+0000 7faf4fa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:40.262 INFO:tasks.workunit.client.0.smithi073.stderr: -137> 2024-09-12T00:50:39.953+0000 7faf4fa0f800 20 realm 2024-09-12T00:50:40.262 INFO:tasks.workunit.client.0.smithi073.stderr: -136> 2024-09-12T00:50:39.953+0000 7faf4fa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.262 INFO:tasks.workunit.client.0.smithi073.stderr: -135> 2024-09-12T00:50:39.953+0000 7faf4fa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:40.262 INFO:tasks.workunit.client.0.smithi073.stderr: -134> 2024-09-12T00:50:39.953+0000 7faf4fa0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:40.262 INFO:tasks.workunit.client.0.smithi073.stderr: -133> 2024-09-12T00:50:39.953+0000 7faf4fa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.262 INFO:tasks.workunit.client.0.smithi073.stderr: -132> 2024-09-12T00:50:39.953+0000 7faf4fa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:40.262 INFO:tasks.workunit.client.0.smithi073.stderr: -131> 2024-09-12T00:50:39.953+0000 7faf4fa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.262 INFO:tasks.workunit.client.0.smithi073.stderr: -130> 2024-09-12T00:50:39.954+0000 7faf4d4f9640 10 monclient: get_auth_request con 0x55de54de58c0 auth_method 0 2024-09-12T00:50:40.262 INFO:tasks.workunit.client.0.smithi073.stderr: -129> 2024-09-12T00:50:39.954+0000 7faf4fa0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:40.262 INFO:tasks.workunit.client.0.smithi073.stderr: -128> 2024-09-12T00:50:39.954+0000 7faf4fa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.263 INFO:tasks.workunit.client.0.smithi073.stderr: -127> 2024-09-12T00:50:39.954+0000 7faf4ccf8640 10 monclient: get_auth_request con 0x55de54de9170 auth_method 0 2024-09-12T00:50:40.263 INFO:tasks.workunit.client.0.smithi073.stderr: -126> 2024-09-12T00:50:39.955+0000 7faf4fa0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:40.263 INFO:tasks.workunit.client.0.smithi073.stderr: -125> 2024-09-12T00:50:39.955+0000 7faf4fa0f800 20 searching for the correct realm 2024-09-12T00:50:40.263 INFO:tasks.workunit.client.0.smithi073.stderr: -124> 2024-09-12T00:50:39.955+0000 7faf4dcfa640 10 monclient: get_auth_request con 0x55de54dedeb0 auth_method 0 2024-09-12T00:50:40.263 INFO:tasks.workunit.client.0.smithi073.stderr: -123> 2024-09-12T00:50:39.956+0000 7faf4d4f9640 10 monclient: get_auth_request con 0x7faf4807f060 auth_method 0 2024-09-12T00:50:40.263 INFO:tasks.workunit.client.0.smithi073.stderr: -122> 2024-09-12T00:50:39.957+0000 7faf4ccf8640 10 monclient: get_auth_request con 0x7faf40016070 auth_method 0 2024-09-12T00:50:40.263 INFO:tasks.workunit.client.0.smithi073.stderr: -121> 2024-09-12T00:50:39.957+0000 7faf4dcfa640 10 monclient: get_auth_request con 0x7faf3807f1e0 auth_method 0 2024-09-12T00:50:40.263 INFO:tasks.workunit.client.0.smithi073.stderr: -120> 2024-09-12T00:50:39.957+0000 7faf4dcfa640 0 -- 172.21.15.73:0/3481744197 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7faf3807f1e0 msgr2=0x7faf38093680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:40.263 INFO:tasks.workunit.client.0.smithi073.stderr: -119> 2024-09-12T00:50:40.158+0000 7faf4dcfa640 10 monclient: get_auth_request con 0x7faf3807f1e0 auth_method 0 2024-09-12T00:50:40.263 INFO:tasks.workunit.client.0.smithi073.stderr: -118> 2024-09-12T00:50:40.162+0000 7faf4d4f9640 10 monclient: get_auth_request con 0x7faf480a8710 auth_method 0 2024-09-12T00:50:40.263 INFO:tasks.workunit.client.0.smithi073.stderr: -117> 2024-09-12T00:50:40.163+0000 7faf4dcfa640 0 -- 172.21.15.73:0/3481744197 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7faf3807f1e0 msgr2=0x7faf38093680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:40.263 INFO:tasks.workunit.client.0.smithi073.stderr: -116> 2024-09-12T00:50:40.163+0000 7fae1effd640 1 client.6707.objecter ms_handle_reset 0x7faf3807f1e0 session 0x7faf3804ce90 osd.4 2024-09-12T00:50:40.264 INFO:tasks.workunit.client.0.smithi073.stderr: -115> 2024-09-12T00:50:40.163+0000 7fae1effd640 10 monclient: _renew_subs 2024-09-12T00:50:40.264 INFO:tasks.workunit.client.0.smithi073.stderr: -114> 2024-09-12T00:50:40.163+0000 7fae1effd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:50:40.264 INFO:tasks.workunit.client.0.smithi073.stderr: -113> 2024-09-12T00:50:40.164+0000 7faf4dcfa640 10 monclient: get_auth_request con 0x7fae18086340 auth_method 0 2024-09-12T00:50:40.264 INFO:tasks.workunit.client.0.smithi073.stderr: -112> 2024-09-12T00:50:40.167+0000 7faf4fa0f800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:50:40.264 INFO:tasks.workunit.client.0.smithi073.stderr: -111> 2024-09-12T00:50:40.167+0000 7faf4fa0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:40.264 INFO:tasks.workunit.client.0.smithi073.stderr: -110> 2024-09-12T00:50:40.167+0000 7faf4fa0f800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:50:40.264 INFO:tasks.workunit.client.0.smithi073.stderr: -109> 2024-09-12T00:50:40.167+0000 7faf4fa0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:40.264 INFO:tasks.workunit.client.0.smithi073.stderr: -108> 2024-09-12T00:50:40.167+0000 7faf4fa0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:40.264 INFO:tasks.workunit.client.0.smithi073.stderr: -107> 2024-09-12T00:50:40.167+0000 7faf4fa0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:40.264 INFO:tasks.workunit.client.0.smithi073.stderr: -106> 2024-09-12T00:50:40.167+0000 7faf4fa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.264 INFO:tasks.workunit.client.0.smithi073.stderr: -105> 2024-09-12T00:50:40.168+0000 7faf4fa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:40.264 INFO:tasks.workunit.client.0.smithi073.stderr: -104> 2024-09-12T00:50:40.168+0000 7faf4fa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.264 INFO:tasks.workunit.client.0.smithi073.stderr: -103> 2024-09-12T00:50:40.168+0000 7faf4fa0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:40.265 INFO:tasks.workunit.client.0.smithi073.stderr: -102> 2024-09-12T00:50:40.168+0000 7faf4fa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.265 INFO:tasks.workunit.client.0.smithi073.stderr: -101> 2024-09-12T00:50:40.168+0000 7faf4fa0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:40.265 INFO:tasks.workunit.client.0.smithi073.stderr: -100> 2024-09-12T00:50:40.168+0000 7faf4fa0f800 20 zone default found 2024-09-12T00:50:40.265 INFO:tasks.workunit.client.0.smithi073.stderr: -99> 2024-09-12T00:50:40.168+0000 7faf4fa0f800 4 Realm: () 2024-09-12T00:50:40.265 INFO:tasks.workunit.client.0.smithi073.stderr: -98> 2024-09-12T00:50:40.168+0000 7faf4fa0f800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:50:40.265 INFO:tasks.workunit.client.0.smithi073.stderr: -97> 2024-09-12T00:50:40.168+0000 7faf4fa0f800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:50:40.265 INFO:tasks.workunit.client.0.smithi073.stderr: -96> 2024-09-12T00:50:40.168+0000 7faf4fa0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:40.265 INFO:tasks.workunit.client.0.smithi073.stderr: -95> 2024-09-12T00:50:40.168+0000 7faf4fa0f800 20 zonegroup default 2024-09-12T00:50:40.265 INFO:tasks.workunit.client.0.smithi073.stderr: -94> 2024-09-12T00:50:40.168+0000 7faf4fa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.265 INFO:tasks.workunit.client.0.smithi073.stderr: -93> 2024-09-12T00:50:40.168+0000 7faf4fa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:40.265 INFO:tasks.workunit.client.0.smithi073.stderr: -92> 2024-09-12T00:50:40.168+0000 7faf4fa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.265 INFO:tasks.workunit.client.0.smithi073.stderr: -91> 2024-09-12T00:50:40.169+0000 7faf4fa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:40.265 INFO:tasks.workunit.client.0.smithi073.stderr: -90> 2024-09-12T00:50:40.169+0000 7faf4fa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.266 INFO:tasks.workunit.client.0.smithi073.stderr: -89> 2024-09-12T00:50:40.169+0000 7faf4fa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:40.266 INFO:tasks.workunit.client.0.smithi073.stderr: -88> 2024-09-12T00:50:40.169+0000 7faf4fa0f800 20 started sync module instance, tier type = 2024-09-12T00:50:40.266 INFO:tasks.workunit.client.0.smithi073.stderr: -87> 2024-09-12T00:50:40.169+0000 7faf4fa0f800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:50:40.266 INFO:tasks.workunit.client.0.smithi073.stderr: -86> 2024-09-12T00:50:40.180+0000 7faf4fa0f800 20 add_watcher() i=0 2024-09-12T00:50:40.266 INFO:tasks.workunit.client.0.smithi073.stderr: -85> 2024-09-12T00:50:40.180+0000 7faf4fa0f800 20 add_watcher() i=1 2024-09-12T00:50:40.266 INFO:tasks.workunit.client.0.smithi073.stderr: -84> 2024-09-12T00:50:40.180+0000 7faf4fa0f800 20 add_watcher() i=2 2024-09-12T00:50:40.266 INFO:tasks.workunit.client.0.smithi073.stderr: -83> 2024-09-12T00:50:40.180+0000 7faf4fa0f800 20 add_watcher() i=3 2024-09-12T00:50:40.266 INFO:tasks.workunit.client.0.smithi073.stderr: -82> 2024-09-12T00:50:40.180+0000 7faf4fa0f800 20 add_watcher() i=4 2024-09-12T00:50:40.266 INFO:tasks.workunit.client.0.smithi073.stderr: -81> 2024-09-12T00:50:40.180+0000 7faf4fa0f800 20 add_watcher() i=5 2024-09-12T00:50:40.266 INFO:tasks.workunit.client.0.smithi073.stderr: -80> 2024-09-12T00:50:40.180+0000 7faf4fa0f800 20 add_watcher() i=6 2024-09-12T00:50:40.266 INFO:tasks.workunit.client.0.smithi073.stderr: -79> 2024-09-12T00:50:40.181+0000 7faf4fa0f800 20 add_watcher() i=7 2024-09-12T00:50:40.266 INFO:tasks.workunit.client.0.smithi073.stderr: -78> 2024-09-12T00:50:40.181+0000 7faf4fa0f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:40.267 INFO:tasks.workunit.client.0.smithi073.stderr: -77> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f3a050) adding auth protocol: cephx 2024-09-12T00:50:40.267 INFO:tasks.workunit.client.0.smithi073.stderr: -76> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f3a050) adding auth protocol: cephx 2024-09-12T00:50:40.267 INFO:tasks.workunit.client.0.smithi073.stderr: -75> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f3a050) adding auth protocol: cephx 2024-09-12T00:50:40.267 INFO:tasks.workunit.client.0.smithi073.stderr: -74> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f3a050) adding con mode: secure 2024-09-12T00:50:40.267 INFO:tasks.workunit.client.0.smithi073.stderr: -73> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f3a050) adding con mode: crc 2024-09-12T00:50:40.267 INFO:tasks.workunit.client.0.smithi073.stderr: -72> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f3a050) adding con mode: secure 2024-09-12T00:50:40.267 INFO:tasks.workunit.client.0.smithi073.stderr: -71> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f3a050) adding con mode: crc 2024-09-12T00:50:40.267 INFO:tasks.workunit.client.0.smithi073.stderr: -70> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f3a050) adding con mode: secure 2024-09-12T00:50:40.267 INFO:tasks.workunit.client.0.smithi073.stderr: -69> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f3a050) adding con mode: crc 2024-09-12T00:50:40.267 INFO:tasks.workunit.client.0.smithi073.stderr: -68> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f3a050) adding con mode: crc 2024-09-12T00:50:40.267 INFO:tasks.workunit.client.0.smithi073.stderr: -67> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f3a050) adding con mode: secure 2024-09-12T00:50:40.267 INFO:tasks.workunit.client.0.smithi073.stderr: -66> 2024-09-12T00:50:40.183+0000 7fae037e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:40.267 INFO:tasks.workunit.client.0.smithi073.stderr: -65> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f3a050) adding con mode: crc 2024-09-12T00:50:40.268 INFO:tasks.workunit.client.0.smithi073.stderr: -64> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f3a050) adding con mode: secure 2024-09-12T00:50:40.268 INFO:tasks.workunit.client.0.smithi073.stderr: -63> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f3a050) adding con mode: crc 2024-09-12T00:50:40.268 INFO:tasks.workunit.client.0.smithi073.stderr: -62> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f3a050) adding con mode: secure 2024-09-12T00:50:40.268 INFO:tasks.workunit.client.0.smithi073.stderr: -61> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:40.268 INFO:tasks.workunit.client.0.smithi073.stderr: -60> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:40.268 INFO:tasks.workunit.client.0.smithi073.stderr: -59> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:40.268 INFO:tasks.workunit.client.0.smithi073.stderr: -58> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 5 asok(0x55de54ad7630) register_command cache list hook 0x55de54dbe8c0 2024-09-12T00:50:40.268 INFO:tasks.workunit.client.0.smithi073.stderr: -57> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 5 asok(0x55de54ad7630) register_command cache inspect hook 0x55de54dbe8c0 2024-09-12T00:50:40.268 INFO:tasks.workunit.client.0.smithi073.stderr: -56> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 5 asok(0x55de54ad7630) register_command cache erase hook 0x55de54dbe8c0 2024-09-12T00:50:40.268 INFO:tasks.workunit.client.0.smithi073.stderr: -55> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 5 asok(0x55de54ad7630) register_command cache zap hook 0x55de54dbe8c0 2024-09-12T00:50:40.268 INFO:tasks.workunit.client.0.smithi073.stderr: -54> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 5 note: GC not initialized 2024-09-12T00:50:40.268 INFO:tasks.workunit.client.0.smithi073.stderr: -53> 2024-09-12T00:50:40.183+0000 7fae027e4640 20 reqs_thread_entry: start 2024-09-12T00:50:40.268 INFO:tasks.workunit.client.0.smithi073.stderr: -52> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 5 asok(0x55de54ad7630) register_command sync trace show hook 0x7faf38079030 2024-09-12T00:50:40.269 INFO:tasks.workunit.client.0.smithi073.stderr: -51> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 5 asok(0x55de54ad7630) register_command sync trace history hook 0x7faf38079030 2024-09-12T00:50:40.269 INFO:tasks.workunit.client.0.smithi073.stderr: -50> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 5 asok(0x55de54ad7630) register_command sync trace active hook 0x7faf38079030 2024-09-12T00:50:40.269 INFO:tasks.workunit.client.0.smithi073.stderr: -49> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 5 asok(0x55de54ad7630) register_command sync trace active_short hook 0x7faf38079030 2024-09-12T00:50:40.269 INFO:tasks.workunit.client.0.smithi073.stderr: -48> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:40.269 INFO:tasks.workunit.client.0.smithi073.stderr: -47> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 20 Filter name: none 2024-09-12T00:50:40.269 INFO:tasks.workunit.client.0.smithi073.stderr: -46> 2024-09-12T00:50:40.184+0000 7fad73fff640 20 reqs_thread_entry: start 2024-09-12T00:50:40.269 INFO:tasks.workunit.client.0.smithi073.stderr: -45> 2024-09-12T00:50:40.184+0000 7faf4fa0f800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:50:40.269 INFO:tasks.workunit.client.0.smithi073.stderr: -44> 2024-09-12T00:50:40.184+0000 7faf4fa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.269 INFO:tasks.workunit.client.0.smithi073.stderr: -43> 2024-09-12T00:50:40.184+0000 7faf4fa0f800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:50:40.269 INFO:tasks.workunit.client.0.smithi073.stderr: -42> 2024-09-12T00:50:40.184+0000 7faf4fa0f800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:50:40.269 INFO:tasks.workunit.client.0.smithi073.stderr: -41> 2024-09-12T00:50:40.184+0000 7faf4fa0f800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:50:40.269 INFO:tasks.workunit.client.0.smithi073.stderr: -40> 2024-09-12T00:50:40.184+0000 7faf4fa0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 : miss 2024-09-12T00:50:40.269 INFO:tasks.workunit.client.0.smithi073.stderr: -39> 2024-09-12T00:50:40.184+0000 7faf4fa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.269 INFO:tasks.workunit.client.0.smithi073.stderr: -38> 2024-09-12T00:50:40.184+0000 7faf4fa0f800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:50:40.270 INFO:tasks.workunit.client.0.smithi073.stderr: -37> 2024-09-12T00:50:40.184+0000 7faf4fa0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 info.flags=0x17 2024-09-12T00:50:40.270 INFO:tasks.workunit.client.0.smithi073.stderr: -36> 2024-09-12T00:50:40.184+0000 7faf4fa0f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 to cache LRU end 2024-09-12T00:50:40.270 INFO:tasks.workunit.client.0.smithi073.stderr: -35> 2024-09-12T00:50:40.184+0000 7faf4fa0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:40.270 INFO:tasks.workunit.client.0.smithi073.stderr: -34> 2024-09-12T00:50:40.184+0000 7faf4fa0f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:40.270 INFO:tasks.workunit.client.0.smithi073.stderr: -33> 2024-09-12T00:50:40.184+0000 7faf4fa0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 2024-09-12T00:50:40.270 INFO:tasks.workunit.client.0.smithi073.stderr: -32> 2024-09-12T00:50:40.188+0000 7faf4fa0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 info.flags=0x17 2024-09-12T00:50:40.270 INFO:tasks.workunit.client.0.smithi073.stderr: -31> 2024-09-12T00:50:40.188+0000 7faf4fa0f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 to cache LRU end 2024-09-12T00:50:40.270 INFO:tasks.workunit.client.0.smithi073.stderr: -30> 2024-09-12T00:50:40.188+0000 7faf4fa0f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:40.270 INFO:tasks.workunit.client.0.smithi073.stderr: -29> 2024-09-12T00:50:40.188+0000 7faf4fa0f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29, ofs0, ns] 2024-09-12T00:50:40.270 INFO:tasks.workunit.client.0.smithi073.stderr: -28> 2024-09-12T00:50:40.188+0000 7fae30ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497049 cookie 94413395019920 notifier 6707 bl.length()=915 2024-09-12T00:50:40.270 INFO:tasks.workunit.client.0.smithi073.stderr: -27> 2024-09-12T00:50:40.188+0000 7fae30ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 info.flags=0x17 2024-09-12T00:50:40.270 INFO:tasks.workunit.client.0.smithi073.stderr: -26> 2024-09-12T00:50:40.188+0000 7fae30ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 to cache LRU end 2024-09-12T00:50:40.271 INFO:tasks.workunit.client.0.smithi073.stderr: -25> 2024-09-12T00:50:40.188+0000 7fae30ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:40.271 INFO:tasks.workunit.client.0.smithi073.stderr: -24> 2024-09-12T00:50:40.190+0000 7faf4fa0f800 20 handle_bi_update(): bucket=:abort-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29]): orig_sources= new_sources= 2024-09-12T00:50:40.271 INFO:tasks.workunit.client.0.smithi073.stderr: -23> 2024-09-12T00:50:40.190+0000 7faf4fa0f800 20 handle_bi_update(): bucket=:abort-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29]): potential sources added=[] removed=[] 2024-09-12T00:50:40.271 INFO:tasks.workunit.client.0.smithi073.stderr: -22> 2024-09-12T00:50:40.190+0000 7faf4fa0f800 20 handle_bi_update(): bucket=:abort-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29]): orig_dests= new_dests= 2024-09-12T00:50:40.271 INFO:tasks.workunit.client.0.smithi073.stderr: -21> 2024-09-12T00:50:40.190+0000 7faf4fa0f800 20 handle_bi_update(): bucket=:abort-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29]): potential dests added=[] removed=[] 2024-09-12T00:50:40.271 INFO:tasks.workunit.client.0.smithi073.stderr: -20> 2024-09-12T00:50:40.194+0000 7faf4fa0f800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29.1.0 2024-09-12T00:50:40.271 INFO:tasks.workunit.client.0.smithi073.stderr: -19> 2024-09-12T00:50:40.194+0000 7faf4fa0f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29.1.0 2024-09-12T00:50:40.271 INFO:tasks.workunit.client.0.smithi073.stderr: -18> 2024-09-12T00:50:40.194+0000 7faf4fa0f800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29.1.1 2024-09-12T00:50:40.271 INFO:tasks.workunit.client.0.smithi073.stderr: -17> 2024-09-12T00:50:40.194+0000 7faf4fa0f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29.1.1 2024-09-12T00:50:40.271 INFO:tasks.workunit.client.0.smithi073.stderr: -16> 2024-09-12T00:50:40.194+0000 7faf4fa0f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29.0 2024-09-12T00:50:40.271 INFO:tasks.workunit.client.0.smithi073.stderr: -15> 2024-09-12T00:50:40.197+0000 7faf4fa0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:50:40.271 INFO:tasks.workunit.client.0.smithi073.stderr: -14> 2024-09-12T00:50:40.197+0000 7faf4fa0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 2024-09-12T00:50:40.272 INFO:tasks.workunit.client.0.smithi073.stderr: -13> 2024-09-12T00:50:40.198+0000 7faf4fa0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 info.flags=0x17 2024-09-12T00:50:40.272 INFO:tasks.workunit.client.0.smithi073.stderr: -12> 2024-09-12T00:50:40.198+0000 7faf4fa0f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 to cache LRU end 2024-09-12T00:50:40.272 INFO:tasks.workunit.client.0.smithi073.stderr: -11> 2024-09-12T00:50:40.198+0000 7faf4fa0f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:40.272 INFO:tasks.workunit.client.0.smithi073.stderr: -10> 2024-09-12T00:50:40.198+0000 7faf4fa0f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29, ofs0, ns] 2024-09-12T00:50:40.272 INFO:tasks.workunit.client.0.smithi073.stderr: -9> 2024-09-12T00:50:40.198+0000 7fae1ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497050 cookie 94413395019920 notifier 6707 bl.length()=915 2024-09-12T00:50:40.272 INFO:tasks.workunit.client.0.smithi073.stderr: -8> 2024-09-12T00:50:40.198+0000 7fae1ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 info.flags=0x17 2024-09-12T00:50:40.272 INFO:tasks.workunit.client.0.smithi073.stderr: -7> 2024-09-12T00:50:40.198+0000 7fae1ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 to cache LRU end 2024-09-12T00:50:40.272 INFO:tasks.workunit.client.0.smithi073.stderr: -6> 2024-09-12T00:50:40.198+0000 7fae1ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:40.272 INFO:tasks.workunit.client.0.smithi073.stderr: -5> 2024-09-12T00:50:40.200+0000 7faf4fa0f800 20 handle_bi_update(): bucket=:abort-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29]): orig_sources= new_sources= 2024-09-12T00:50:40.272 INFO:tasks.workunit.client.0.smithi073.stderr: -4> 2024-09-12T00:50:40.200+0000 7faf4fa0f800 20 handle_bi_update(): bucket=:abort-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29]): potential sources added=[] removed=[] 2024-09-12T00:50:40.272 INFO:tasks.workunit.client.0.smithi073.stderr: -3> 2024-09-12T00:50:40.200+0000 7faf4fa0f800 20 handle_bi_update(): bucket=:abort-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29]): orig_dests= new_dests= 2024-09-12T00:50:40.272 INFO:tasks.workunit.client.0.smithi073.stderr: -2> 2024-09-12T00:50:40.200+0000 7faf4fa0f800 20 handle_bi_update(): bucket=:abort-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29]): potential dests added=[] removed=[] 2024-09-12T00:50:40.272 INFO:tasks.workunit.client.0.smithi073.stderr: -1> 2024-09-12T00:50:40.200+0000 7faf4fa0f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7faf4fa0f800 time 2024-09-12T00:50:40.200882+0000 2024-09-12T00:50:40.273 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:50:40.273 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:40.273 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:40.273 INFO:tasks.workunit.client.0.smithi073.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7faf52f8c71a] 2024-09-12T00:50:40.273 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7faf52f8c8d8] 2024-09-12T00:50:40.273 INFO:tasks.workunit.client.0.smithi073.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55de52b34641] 2024-09-12T00:50:40.273 INFO:tasks.workunit.client.0.smithi073.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x55de52b43582] 2024-09-12T00:50:40.273 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55de52b443e4] 2024-09-12T00:50:40.273 INFO:tasks.workunit.client.0.smithi073.stderr: 6: main() 2024-09-12T00:50:40.273 INFO:tasks.workunit.client.0.smithi073.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7faf51c29590] 2024-09-12T00:50:40.273 INFO:tasks.workunit.client.0.smithi073.stderr: 8: __libc_start_main() 2024-09-12T00:50:40.273 INFO:tasks.workunit.client.0.smithi073.stderr: 9: _start() 2024-09-12T00:50:40.273 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:40.274 INFO:tasks.workunit.client.0.smithi073.stderr: 0> 2024-09-12T00:50:40.201+0000 7faf4fa0f800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:50:40.274 INFO:tasks.workunit.client.0.smithi073.stderr: in thread 7faf4fa0f800 thread_name:radosgw-admin 2024-09-12T00:50:40.274 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:40.274 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:40.274 INFO:tasks.workunit.client.0.smithi073.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7faf51c3e6f0] 2024-09-12T00:50:40.274 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7faf51c8b99c] 2024-09-12T00:50:40.274 INFO:tasks.workunit.client.0.smithi073.stderr: 3: raise() 2024-09-12T00:50:40.274 INFO:tasks.workunit.client.0.smithi073.stderr: 4: abort() 2024-09-12T00:50:40.274 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7faf52f8c774] 2024-09-12T00:50:40.274 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7faf52f8c8d8] 2024-09-12T00:50:40.274 INFO:tasks.workunit.client.0.smithi073.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55de52b34641] 2024-09-12T00:50:40.274 INFO:tasks.workunit.client.0.smithi073.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x55de52b43582] 2024-09-12T00:50:40.274 INFO:tasks.workunit.client.0.smithi073.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55de52b443e4] 2024-09-12T00:50:40.275 INFO:tasks.workunit.client.0.smithi073.stderr: 10: main() 2024-09-12T00:50:40.275 INFO:tasks.workunit.client.0.smithi073.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7faf51c29590] 2024-09-12T00:50:40.275 INFO:tasks.workunit.client.0.smithi073.stderr: 12: __libc_start_main() 2024-09-12T00:50:40.275 INFO:tasks.workunit.client.0.smithi073.stderr: 13: _start() 2024-09-12T00:50:40.275 INFO:tasks.workunit.client.0.smithi073.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:50:40.275 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:40.275 INFO:tasks.workunit.client.0.smithi073.stderr:--- logging levels --- 2024-09-12T00:50:40.275 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 none 2024-09-12T00:50:40.275 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 lockdep 2024-09-12T00:50:40.275 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 context 2024-09-12T00:50:40.275 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 crush 2024-09-12T00:50:40.275 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds 2024-09-12T00:50:40.275 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_balancer 2024-09-12T00:50:40.276 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_locker 2024-09-12T00:50:40.276 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_log 2024-09-12T00:50:40.276 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_log_expire 2024-09-12T00:50:40.276 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_migrator 2024-09-12T00:50:40.276 INFO:tasks.workunit.client.0.smithi073.stderr: 3/ 5 mds_quiesce 2024-09-12T00:50:40.276 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 buffer 2024-09-12T00:50:40.276 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 timer 2024-09-12T00:50:40.276 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 filer 2024-09-12T00:50:40.276 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 striper 2024-09-12T00:50:40.276 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 objecter 2024-09-12T00:50:40.276 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rados 2024-09-12T00:50:40.276 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd 2024-09-12T00:50:40.276 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_mirror 2024-09-12T00:50:40.277 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_replay 2024-09-12T00:50:40.277 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_pwl 2024-09-12T00:50:40.277 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 journaler 2024-09-12T00:50:40.277 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 objectcacher 2024-09-12T00:50:40.277 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:50:40.277 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 client 2024-09-12T00:50:40.277 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 osd 2024-09-12T00:50:40.277 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 optracker 2024-09-12T00:50:40.277 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 objclass 2024-09-12T00:50:40.277 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 filestore 2024-09-12T00:50:40.277 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 journal 2024-09-12T00:50:40.277 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 0 ms 2024-09-12T00:50:40.277 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mon 2024-09-12T00:50:40.278 INFO:tasks.workunit.client.0.smithi073.stderr: 0/10 monc 2024-09-12T00:50:40.278 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 paxos 2024-09-12T00:50:40.278 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 tp 2024-09-12T00:50:40.278 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 auth 2024-09-12T00:50:40.278 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 crypto 2024-09-12T00:50:40.278 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 finisher 2024-09-12T00:50:40.278 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 reserver 2024-09-12T00:50:40.278 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 heartbeatmap 2024-09-12T00:50:40.278 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 perfcounter 2024-09-12T00:50:40.278 INFO:tasks.workunit.client.0.smithi073.stderr: 20/20 rgw 2024-09-12T00:50:40.278 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_sync 2024-09-12T00:50:40.278 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_datacache 2024-09-12T00:50:40.278 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_access 2024-09-12T00:50:40.279 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:50:40.279 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_flight 2024-09-12T00:50:40.279 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:50:40.279 INFO:tasks.workunit.client.0.smithi073.stderr: 20/20 rgw_notification 2024-09-12T00:50:40.279 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 javaclient 2024-09-12T00:50:40.279 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 asok 2024-09-12T00:50:40.279 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 throttle 2024-09-12T00:50:40.279 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 0 refs 2024-09-12T00:50:40.279 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 compressor 2024-09-12T00:50:40.279 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 bluestore 2024-09-12T00:50:40.279 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 bluefs 2024-09-12T00:50:40.279 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 bdev 2024-09-12T00:50:40.279 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 kstore 2024-09-12T00:50:40.280 INFO:tasks.workunit.client.0.smithi073.stderr: 4/ 5 rocksdb 2024-09-12T00:50:40.280 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 fuse 2024-09-12T00:50:40.280 INFO:tasks.workunit.client.0.smithi073.stderr: 2/ 5 mgr 2024-09-12T00:50:40.280 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mgrc 2024-09-12T00:50:40.280 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 dpdk 2024-09-12T00:50:40.280 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 eventtrace 2024-09-12T00:50:40.280 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 prioritycache 2024-09-12T00:50:40.280 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 test 2024-09-12T00:50:40.280 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:50:40.280 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cephsqlite 2024-09-12T00:50:40.280 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:50:40.280 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore 2024-09-12T00:50:40.280 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_onode 2024-09-12T00:50:40.281 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_odata 2024-09-12T00:50:40.281 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_omap 2024-09-12T00:50:40.281 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_tm 2024-09-12T00:50:40.281 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_t 2024-09-12T00:50:40.281 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:50:40.281 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_epm 2024-09-12T00:50:40.281 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_lba 2024-09-12T00:50:40.281 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:50:40.281 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_cache 2024-09-12T00:50:40.281 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_journal 2024-09-12T00:50:40.281 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_device 2024-09-12T00:50:40.281 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_backref 2024-09-12T00:50:40.282 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 alienstore 2024-09-12T00:50:40.282 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mclock 2024-09-12T00:50:40.282 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cyanstore 2024-09-12T00:50:40.282 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 ceph_exporter 2024-09-12T00:50:40.282 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 memstore 2024-09-12T00:50:40.282 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 trace 2024-09-12T00:50:40.282 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 ceph_dedup 2024-09-12T00:50:40.282 INFO:tasks.workunit.client.0.smithi073.stderr: -2/-2 (syslog threshold) 2024-09-12T00:50:40.282 INFO:tasks.workunit.client.0.smithi073.stderr: 99/99 (stderr threshold) 2024-09-12T00:50:40.282 INFO:tasks.workunit.client.0.smithi073.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:50:40.282 INFO:tasks.workunit.client.0.smithi073.stderr: 7fad73fff640 / http_manager 2024-09-12T00:50:40.282 INFO:tasks.workunit.client.0.smithi073.stderr: 7fae027e4640 / http_manager 2024-09-12T00:50:40.282 INFO:tasks.workunit.client.0.smithi073.stderr: 7fae037e6640 / rgw_dt_lg_renew 2024-09-12T00:50:40.283 INFO:tasks.workunit.client.0.smithi073.stderr: 7fae1effd640 / ms_dispatch 2024-09-12T00:50:40.283 INFO:tasks.workunit.client.0.smithi073.stderr: 7fae1ffff640 / io_context_pool 2024-09-12T00:50:40.283 INFO:tasks.workunit.client.0.smithi073.stderr: 7fae30ff9640 / io_context_pool 2024-09-12T00:50:40.283 INFO:tasks.workunit.client.0.smithi073.stderr: 7fae32ffd640 / ms_dispatch 2024-09-12T00:50:40.283 INFO:tasks.workunit.client.0.smithi073.stderr: 7fae39e03640 / ms_dispatch 2024-09-12T00:50:40.283 INFO:tasks.workunit.client.0.smithi073.stderr: 7fae3b606640 / io_context_pool 2024-09-12T00:50:40.283 INFO:tasks.workunit.client.0.smithi073.stderr: 7faf4ccf8640 / msgr-worker-2 2024-09-12T00:50:40.283 INFO:tasks.workunit.client.0.smithi073.stderr: 7faf4d4f9640 / msgr-worker-1 2024-09-12T00:50:40.283 INFO:tasks.workunit.client.0.smithi073.stderr: 7faf4dcfa640 / msgr-worker-0 2024-09-12T00:50:40.283 INFO:tasks.workunit.client.0.smithi073.stderr: 7faf4e4fb640 / io_context_pool 2024-09-12T00:50:40.283 INFO:tasks.workunit.client.0.smithi073.stderr: 7faf4fa0f800 / radosgw-admin 2024-09-12T00:50:40.283 INFO:tasks.workunit.client.0.smithi073.stderr: max_recent 500 2024-09-12T00:50:40.283 INFO:tasks.workunit.client.0.smithi073.stderr: max_new 1000 2024-09-12T00:50:40.283 INFO:tasks.workunit.client.0.smithi073.stderr: log_file /var/log/ceph/ceph-client.admin.113660.log 2024-09-12T00:50:40.284 INFO:tasks.workunit.client.0.smithi073.stderr:--- end dump of recent events --- 2024-09-12T00:50:40.284 INFO:tasks.workunit.client.0.smithi073.stderr:--- begin dump of recent events --- 2024-09-12T00:50:40.284 INFO:tasks.workunit.client.0.smithi073.stderr: -499> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 5 AuthRegistry(0x55de54cf98d0) adding con mode: crc 2024-09-12T00:50:40.284 INFO:tasks.workunit.client.0.smithi073.stderr: -498> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 5 AuthRegistry(0x55de54cf98d0) adding con mode: secure 2024-09-12T00:50:40.284 INFO:tasks.workunit.client.0.smithi073.stderr: -497> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 5 AuthRegistry(0x55de54cf98d0) adding con mode: crc 2024-09-12T00:50:40.284 INFO:tasks.workunit.client.0.smithi073.stderr: -496> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 5 AuthRegistry(0x55de54cf98d0) adding con mode: crc 2024-09-12T00:50:40.284 INFO:tasks.workunit.client.0.smithi073.stderr: -495> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 5 AuthRegistry(0x55de54cf98d0) adding con mode: secure 2024-09-12T00:50:40.284 INFO:tasks.workunit.client.0.smithi073.stderr: -494> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 5 AuthRegistry(0x55de54cf98d0) adding con mode: crc 2024-09-12T00:50:40.284 INFO:tasks.workunit.client.0.smithi073.stderr: -493> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 5 AuthRegistry(0x55de54cf98d0) adding con mode: secure 2024-09-12T00:50:40.284 INFO:tasks.workunit.client.0.smithi073.stderr: -492> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 5 AuthRegistry(0x55de54cf98d0) adding con mode: crc 2024-09-12T00:50:40.284 INFO:tasks.workunit.client.0.smithi073.stderr: -491> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 5 AuthRegistry(0x55de54cf98d0) adding con mode: secure 2024-09-12T00:50:40.284 INFO:tasks.workunit.client.0.smithi073.stderr: -490> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:40.284 INFO:tasks.workunit.client.0.smithi073.stderr: -489> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 1 librados: starting msgr at 2024-09-12T00:50:40.285 INFO:tasks.workunit.client.0.smithi073.stderr: -488> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 1 librados: starting objecter 2024-09-12T00:50:40.285 INFO:tasks.workunit.client.0.smithi073.stderr: -487> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 5 asok(0x55de54ad7630) register_command objecter_requests hook 0x55de54cfcc80 2024-09-12T00:50:40.285 INFO:tasks.workunit.client.0.smithi073.stderr: -486> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 1 librados: setting wanted keys 2024-09-12T00:50:40.285 INFO:tasks.workunit.client.0.smithi073.stderr: -485> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 1 librados: calling monclient init 2024-09-12T00:50:40.285 INFO:tasks.workunit.client.0.smithi073.stderr: -484> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 10 monclient: init 2024-09-12T00:50:40.285 INFO:tasks.workunit.client.0.smithi073.stderr: -483> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 5 AuthRegistry(0x55de54cf75d0) adding auth protocol: cephx 2024-09-12T00:50:40.285 INFO:tasks.workunit.client.0.smithi073.stderr: -482> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 5 AuthRegistry(0x55de54cf75d0) adding auth protocol: cephx 2024-09-12T00:50:40.285 INFO:tasks.workunit.client.0.smithi073.stderr: -481> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 5 AuthRegistry(0x55de54cf75d0) adding auth protocol: cephx 2024-09-12T00:50:40.285 INFO:tasks.workunit.client.0.smithi073.stderr: -480> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 5 AuthRegistry(0x55de54cf75d0) adding con mode: secure 2024-09-12T00:50:40.285 INFO:tasks.workunit.client.0.smithi073.stderr: -479> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 5 AuthRegistry(0x55de54cf75d0) adding con mode: crc 2024-09-12T00:50:40.285 INFO:tasks.workunit.client.0.smithi073.stderr: -478> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 5 AuthRegistry(0x55de54cf75d0) adding con mode: secure 2024-09-12T00:50:40.285 INFO:tasks.workunit.client.0.smithi073.stderr: -477> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 5 AuthRegistry(0x55de54cf75d0) adding con mode: crc 2024-09-12T00:50:40.285 INFO:tasks.workunit.client.0.smithi073.stderr: -476> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 5 AuthRegistry(0x55de54cf75d0) adding con mode: secure 2024-09-12T00:50:40.286 INFO:tasks.workunit.client.0.smithi073.stderr: -475> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 5 AuthRegistry(0x55de54cf75d0) adding con mode: crc 2024-09-12T00:50:40.286 INFO:tasks.workunit.client.0.smithi073.stderr: -474> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 5 AuthRegistry(0x55de54cf75d0) adding con mode: crc 2024-09-12T00:50:40.286 INFO:tasks.workunit.client.0.smithi073.stderr: -473> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 5 AuthRegistry(0x55de54cf75d0) adding con mode: secure 2024-09-12T00:50:40.286 INFO:tasks.workunit.client.0.smithi073.stderr: -472> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 5 AuthRegistry(0x55de54cf75d0) adding con mode: crc 2024-09-12T00:50:40.286 INFO:tasks.workunit.client.0.smithi073.stderr: -471> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 5 AuthRegistry(0x55de54cf75d0) adding con mode: secure 2024-09-12T00:50:40.286 INFO:tasks.workunit.client.0.smithi073.stderr: -470> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 5 AuthRegistry(0x55de54cf75d0) adding con mode: crc 2024-09-12T00:50:40.286 INFO:tasks.workunit.client.0.smithi073.stderr: -469> 2024-09-12T00:50:39.935+0000 7faf4fa0f800 5 AuthRegistry(0x55de54cf75d0) adding con mode: secure 2024-09-12T00:50:40.286 INFO:tasks.workunit.client.0.smithi073.stderr: -468> 2024-09-12T00:50:39.936+0000 7faf4fa0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:40.286 INFO:tasks.workunit.client.0.smithi073.stderr: -467> 2024-09-12T00:50:39.936+0000 7faf4fa0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:40.286 INFO:tasks.workunit.client.0.smithi073.stderr: -466> 2024-09-12T00:50:39.936+0000 7faf4fa0f800 5 asok(0x55de54ad7630) register_command rotate-key hook 0x55de54cf7718 2024-09-12T00:50:40.286 INFO:tasks.workunit.client.0.smithi073.stderr: -465> 2024-09-12T00:50:39.936+0000 7faf4fa0f800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:40.286 INFO:tasks.workunit.client.0.smithi073.stderr: -464> 2024-09-12T00:50:39.936+0000 7faf4fa0f800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:50:40.286 INFO:tasks.workunit.client.0.smithi073.stderr: -463> 2024-09-12T00:50:39.936+0000 7faf4fa0f800 10 monclient(hunting): picked mon.noname-b con 0x55de54b6e230 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:50:40.286 INFO:tasks.workunit.client.0.smithi073.stderr: -462> 2024-09-12T00:50:39.936+0000 7faf4fa0f800 10 monclient(hunting): picked mon.noname-a con 0x55de54ba23b0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:50:40.287 INFO:tasks.workunit.client.0.smithi073.stderr: -461> 2024-09-12T00:50:39.936+0000 7faf4fa0f800 10 monclient(hunting): picked mon.noname-c con 0x55de54c3ad00 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:50:40.287 INFO:tasks.workunit.client.0.smithi073.stderr: -460> 2024-09-12T00:50:39.936+0000 7faf4fa0f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:40.287 INFO:tasks.workunit.client.0.smithi073.stderr: -459> 2024-09-12T00:50:39.936+0000 7faf4fa0f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:40.287 INFO:tasks.workunit.client.0.smithi073.stderr: -458> 2024-09-12T00:50:39.936+0000 7faf4fa0f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:40.287 INFO:tasks.workunit.client.0.smithi073.stderr: -457> 2024-09-12T00:50:39.936+0000 7faf4fa0f800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:40.287 INFO:tasks.workunit.client.0.smithi073.stderr: -456> 2024-09-12T00:50:39.936+0000 7faf4fa0f800 10 monclient(hunting): authenticate will time out at 2100.606382s 2024-09-12T00:50:40.287 INFO:tasks.workunit.client.0.smithi073.stderr: -455> 2024-09-12T00:50:39.936+0000 7faf4dcfa640 10 monclient(hunting): get_auth_request con 0x55de54c3ad00 auth_method 0 2024-09-12T00:50:40.287 INFO:tasks.workunit.client.0.smithi073.stderr: -454> 2024-09-12T00:50:39.936+0000 7faf4dcfa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:40.287 INFO:tasks.workunit.client.0.smithi073.stderr: -453> 2024-09-12T00:50:39.936+0000 7faf4dcfa640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:40.287 INFO:tasks.workunit.client.0.smithi073.stderr: -452> 2024-09-12T00:50:39.936+0000 7faf4dcfa640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:40.287 INFO:tasks.workunit.client.0.smithi073.stderr: -451> 2024-09-12T00:50:39.936+0000 7faf4ccf8640 10 monclient(hunting): get_auth_request con 0x55de54ba23b0 auth_method 0 2024-09-12T00:50:40.287 INFO:tasks.workunit.client.0.smithi073.stderr: -450> 2024-09-12T00:50:39.936+0000 7faf4ccf8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:40.288 INFO:tasks.workunit.client.0.smithi073.stderr: -449> 2024-09-12T00:50:39.936+0000 7faf4ccf8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:40.288 INFO:tasks.workunit.client.0.smithi073.stderr: -448> 2024-09-12T00:50:39.936+0000 7faf4ccf8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:40.288 INFO:tasks.workunit.client.0.smithi073.stderr: -447> 2024-09-12T00:50:39.936+0000 7faf4ccf8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:40.288 INFO:tasks.workunit.client.0.smithi073.stderr: -446> 2024-09-12T00:50:39.936+0000 7faf4ccf8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:40.288 INFO:tasks.workunit.client.0.smithi073.stderr: -445> 2024-09-12T00:50:39.936+0000 7faf4ccf8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:40.288 INFO:tasks.workunit.client.0.smithi073.stderr: -444> 2024-09-12T00:50:39.936+0000 7faf4dcfa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:40.288 INFO:tasks.workunit.client.0.smithi073.stderr: -443> 2024-09-12T00:50:39.936+0000 7faf4dcfa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:40.288 INFO:tasks.workunit.client.0.smithi073.stderr: -442> 2024-09-12T00:50:39.936+0000 7faf4dcfa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:40.288 INFO:tasks.workunit.client.0.smithi073.stderr: -441> 2024-09-12T00:50:39.936+0000 7faf4d4f9640 10 monclient(hunting): get_auth_request con 0x55de54b6e230 auth_method 0 2024-09-12T00:50:40.288 INFO:tasks.workunit.client.0.smithi073.stderr: -440> 2024-09-12T00:50:39.936+0000 7faf4d4f9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:40.288 INFO:tasks.workunit.client.0.smithi073.stderr: -439> 2024-09-12T00:50:39.936+0000 7faf4d4f9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:40.288 INFO:tasks.workunit.client.0.smithi073.stderr: -438> 2024-09-12T00:50:39.936+0000 7faf4d4f9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:40.288 INFO:tasks.workunit.client.0.smithi073.stderr: -437> 2024-09-12T00:50:39.936+0000 7faf4ccf8640 10 monclient(hunting): handle_auth_done global_id 7092 payload 824 2024-09-12T00:50:40.289 INFO:tasks.workunit.client.0.smithi073.stderr: -436> 2024-09-12T00:50:39.936+0000 7faf4ccf8640 10 monclient: _finish_hunting 0 2024-09-12T00:50:40.289 INFO:tasks.workunit.client.0.smithi073.stderr: -435> 2024-09-12T00:50:39.936+0000 7faf4ccf8640 1 monclient: found mon.noname-a 2024-09-12T00:50:40.289 INFO:tasks.workunit.client.0.smithi073.stderr: -434> 2024-09-12T00:50:39.936+0000 7faf4ccf8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:50:40.289 INFO:tasks.workunit.client.0.smithi073.stderr: -433> 2024-09-12T00:50:39.936+0000 7fae39e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:40.289 INFO:tasks.workunit.client.0.smithi073.stderr: -432> 2024-09-12T00:50:39.936+0000 7fae39e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:50:40.289 INFO:tasks.workunit.client.0.smithi073.stderr: -431> 2024-09-12T00:50:39.936+0000 7fae39e03640 10 monclient: dump: 2024-09-12T00:50:40.289 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:50:40.289 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:50:40.289 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:40.289 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:40.289 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:40.289 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:50:40.290 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:50:40.290 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:50:40.290 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:50:40.290 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:40.290 INFO:tasks.workunit.client.0.smithi073.stderr: -430> 2024-09-12T00:50:39.937+0000 7fae39e03640 10 monclient: _finish_auth 0 2024-09-12T00:50:40.290 INFO:tasks.workunit.client.0.smithi073.stderr: -429> 2024-09-12T00:50:39.937+0000 7fae39e03640 10 monclient: _check_auth_tickets 2024-09-12T00:50:40.290 INFO:tasks.workunit.client.0.smithi073.stderr: -428> 2024-09-12T00:50:39.937+0000 7fae39e03640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:40.290 INFO:tasks.workunit.client.0.smithi073.stderr: -427> 2024-09-12T00:50:39.937+0000 7fae39e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:40.290 INFO:tasks.workunit.client.0.smithi073.stderr: -426> 2024-09-12T00:50:39.937+0000 7fae39e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:50:40.290 INFO:tasks.workunit.client.0.smithi073.stderr: -425> 2024-09-12T00:50:39.937+0000 7fae39e03640 10 monclient: dump: 2024-09-12T00:50:40.290 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:50:40.290 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:50:40.290 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:40.291 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:40.291 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:40.291 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:50:40.291 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:50:40.291 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:50:40.291 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:50:40.291 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:40.291 INFO:tasks.workunit.client.0.smithi073.stderr: -424> 2024-09-12T00:50:39.937+0000 7faf4fa0f800 5 monclient: authenticate success, global_id 7092 2024-09-12T00:50:40.291 INFO:tasks.workunit.client.0.smithi073.stderr: -423> 2024-09-12T00:50:39.937+0000 7faf4fa0f800 10 monclient: _renew_subs 2024-09-12T00:50:40.291 INFO:tasks.workunit.client.0.smithi073.stderr: -422> 2024-09-12T00:50:39.937+0000 7faf4fa0f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:50:40.291 INFO:tasks.workunit.client.0.smithi073.stderr: -421> 2024-09-12T00:50:39.937+0000 7fae3b606640 4 set_mon_vals no callback set 2024-09-12T00:50:40.291 INFO:tasks.workunit.client.0.smithi073.stderr: -420> 2024-09-12T00:50:39.937+0000 7faf4fa0f800 10 monclient: _renew_subs 2024-09-12T00:50:40.291 INFO:tasks.workunit.client.0.smithi073.stderr: -419> 2024-09-12T00:50:39.937+0000 7faf4fa0f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:50:40.292 INFO:tasks.workunit.client.0.smithi073.stderr: -418> 2024-09-12T00:50:39.937+0000 7faf4fa0f800 1 librados: init done 2024-09-12T00:50:40.292 INFO:tasks.workunit.client.0.smithi073.stderr: -417> 2024-09-12T00:50:39.938+0000 7fae39e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:50:40.292 INFO:tasks.workunit.client.0.smithi073.stderr: -416> 2024-09-12T00:50:39.938+0000 7fae39e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:50:40.292 INFO:tasks.workunit.client.0.smithi073.stderr: -415> 2024-09-12T00:50:39.938+0000 7fae39e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:50:40.292 INFO:tasks.workunit.client.0.smithi073.stderr: -414> 2024-09-12T00:50:39.939+0000 7faf4d4f9640 10 monclient: get_auth_request con 0x7fae340764a0 auth_method 0 2024-09-12T00:50:40.292 INFO:tasks.workunit.client.0.smithi073.stderr: -413> 2024-09-12T00:50:39.939+0000 7faf4dcfa640 10 monclient: get_auth_request con 0x55de54d1fd90 auth_method 0 2024-09-12T00:50:40.292 INFO:tasks.workunit.client.0.smithi073.stderr: -412> 2024-09-12T00:50:39.940+0000 7faf4d4f9640 10 monclient: get_auth_request con 0x55de54d42c30 auth_method 0 2024-09-12T00:50:40.292 INFO:tasks.workunit.client.0.smithi073.stderr: -411> 2024-09-12T00:50:39.941+0000 7faf4ccf8640 10 monclient: get_auth_request con 0x55de54d47030 auth_method 0 2024-09-12T00:50:40.292 INFO:tasks.workunit.client.0.smithi073.stderr: -410> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 10 monclient: build_initial_monmap 2024-09-12T00:50:40.292 INFO:tasks.workunit.client.0.smithi073.stderr: -409> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 1 build_initial for_mkfs: 0 2024-09-12T00:50:40.292 INFO:tasks.workunit.client.0.smithi073.stderr: -408> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 10 monclient: monmap: 2024-09-12T00:50:40.292 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:50:40.293 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:40.293 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:50:40.293 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:50:40.293 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:40.293 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:50:40.293 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:50:40.293 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:50:40.293 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:50:40.293 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:40.293 INFO:tasks.workunit.client.0.smithi073.stderr: -407> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4bef0) adding auth protocol: cephx 2024-09-12T00:50:40.293 INFO:tasks.workunit.client.0.smithi073.stderr: -406> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4bef0) adding auth protocol: cephx 2024-09-12T00:50:40.293 INFO:tasks.workunit.client.0.smithi073.stderr: -405> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4bef0) adding auth protocol: cephx 2024-09-12T00:50:40.293 INFO:tasks.workunit.client.0.smithi073.stderr: -404> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4bef0) adding con mode: secure 2024-09-12T00:50:40.294 INFO:tasks.workunit.client.0.smithi073.stderr: -403> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4bef0) adding con mode: crc 2024-09-12T00:50:40.294 INFO:tasks.workunit.client.0.smithi073.stderr: -402> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4bef0) adding con mode: secure 2024-09-12T00:50:40.294 INFO:tasks.workunit.client.0.smithi073.stderr: -401> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4bef0) adding con mode: crc 2024-09-12T00:50:40.294 INFO:tasks.workunit.client.0.smithi073.stderr: -400> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4bef0) adding con mode: secure 2024-09-12T00:50:40.294 INFO:tasks.workunit.client.0.smithi073.stderr: -399> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4bef0) adding con mode: crc 2024-09-12T00:50:40.294 INFO:tasks.workunit.client.0.smithi073.stderr: -398> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4bef0) adding con mode: crc 2024-09-12T00:50:40.294 INFO:tasks.workunit.client.0.smithi073.stderr: -397> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4bef0) adding con mode: secure 2024-09-12T00:50:40.294 INFO:tasks.workunit.client.0.smithi073.stderr: -396> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4bef0) adding con mode: crc 2024-09-12T00:50:40.294 INFO:tasks.workunit.client.0.smithi073.stderr: -395> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4bef0) adding con mode: secure 2024-09-12T00:50:40.294 INFO:tasks.workunit.client.0.smithi073.stderr: -394> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4bef0) adding con mode: crc 2024-09-12T00:50:40.294 INFO:tasks.workunit.client.0.smithi073.stderr: -393> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4bef0) adding con mode: secure 2024-09-12T00:50:40.294 INFO:tasks.workunit.client.0.smithi073.stderr: -392> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:40.294 INFO:tasks.workunit.client.0.smithi073.stderr: -391> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 asok(0x55de54ad7630) register_command objecter_requests cmddesc objecter_requests hook 0x55de54d4f400 EEXIST 2024-09-12T00:50:40.294 INFO:tasks.workunit.client.0.smithi073.stderr: -390> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 10 monclient: init 2024-09-12T00:50:40.295 INFO:tasks.workunit.client.0.smithi073.stderr: -389> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4a5c8) adding auth protocol: cephx 2024-09-12T00:50:40.295 INFO:tasks.workunit.client.0.smithi073.stderr: -388> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4a5c8) adding auth protocol: cephx 2024-09-12T00:50:40.295 INFO:tasks.workunit.client.0.smithi073.stderr: -387> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4a5c8) adding auth protocol: cephx 2024-09-12T00:50:40.295 INFO:tasks.workunit.client.0.smithi073.stderr: -386> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4a5c8) adding con mode: secure 2024-09-12T00:50:40.295 INFO:tasks.workunit.client.0.smithi073.stderr: -385> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4a5c8) adding con mode: crc 2024-09-12T00:50:40.295 INFO:tasks.workunit.client.0.smithi073.stderr: -384> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4a5c8) adding con mode: secure 2024-09-12T00:50:40.295 INFO:tasks.workunit.client.0.smithi073.stderr: -383> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4a5c8) adding con mode: crc 2024-09-12T00:50:40.295 INFO:tasks.workunit.client.0.smithi073.stderr: -382> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4a5c8) adding con mode: secure 2024-09-12T00:50:40.295 INFO:tasks.workunit.client.0.smithi073.stderr: -381> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4a5c8) adding con mode: crc 2024-09-12T00:50:40.295 INFO:tasks.workunit.client.0.smithi073.stderr: -380> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4a5c8) adding con mode: crc 2024-09-12T00:50:40.295 INFO:tasks.workunit.client.0.smithi073.stderr: -379> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4a5c8) adding con mode: secure 2024-09-12T00:50:40.295 INFO:tasks.workunit.client.0.smithi073.stderr: -378> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4a5c8) adding con mode: crc 2024-09-12T00:50:40.295 INFO:tasks.workunit.client.0.smithi073.stderr: -377> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4a5c8) adding con mode: secure 2024-09-12T00:50:40.295 INFO:tasks.workunit.client.0.smithi073.stderr: -376> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4a5c8) adding con mode: crc 2024-09-12T00:50:40.296 INFO:tasks.workunit.client.0.smithi073.stderr: -375> 2024-09-12T00:50:39.942+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d4a5c8) adding con mode: secure 2024-09-12T00:50:40.296 INFO:tasks.workunit.client.0.smithi073.stderr: -374> 2024-09-12T00:50:39.943+0000 7faf4fa0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:40.296 INFO:tasks.workunit.client.0.smithi073.stderr: -373> 2024-09-12T00:50:39.943+0000 7faf4fa0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:40.296 INFO:tasks.workunit.client.0.smithi073.stderr: -372> 2024-09-12T00:50:39.943+0000 7faf4fa0f800 5 asok(0x55de54ad7630) register_command rotate-key cmddesc rotate-key hook 0x55de54d4a710 EEXIST 2024-09-12T00:50:40.296 INFO:tasks.workunit.client.0.smithi073.stderr: -371> 2024-09-12T00:50:39.943+0000 7faf4fa0f800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:40.296 INFO:tasks.workunit.client.0.smithi073.stderr: -370> 2024-09-12T00:50:39.943+0000 7faf4fa0f800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:50:40.296 INFO:tasks.workunit.client.0.smithi073.stderr: -369> 2024-09-12T00:50:39.943+0000 7faf4fa0f800 10 monclient(hunting): picked mon.noname-a con 0x55de54d73720 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:50:40.296 INFO:tasks.workunit.client.0.smithi073.stderr: -368> 2024-09-12T00:50:39.943+0000 7faf4fa0f800 10 monclient(hunting): picked mon.noname-c con 0x55de54d73b00 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:50:40.296 INFO:tasks.workunit.client.0.smithi073.stderr: -367> 2024-09-12T00:50:39.943+0000 7faf4fa0f800 10 monclient(hunting): picked mon.noname-b con 0x55de54d72430 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:50:40.296 INFO:tasks.workunit.client.0.smithi073.stderr: -366> 2024-09-12T00:50:39.943+0000 7faf4fa0f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:40.296 INFO:tasks.workunit.client.0.smithi073.stderr: -365> 2024-09-12T00:50:39.943+0000 7faf4fa0f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:40.296 INFO:tasks.workunit.client.0.smithi073.stderr: -364> 2024-09-12T00:50:39.943+0000 7faf4fa0f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:40.296 INFO:tasks.workunit.client.0.smithi073.stderr: -363> 2024-09-12T00:50:39.943+0000 7faf4fa0f800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:40.296 INFO:tasks.workunit.client.0.smithi073.stderr: -362> 2024-09-12T00:50:39.943+0000 7faf4fa0f800 10 monclient(hunting): authenticate will time out at 2100.613425s 2024-09-12T00:50:40.297 INFO:tasks.workunit.client.0.smithi073.stderr: -361> 2024-09-12T00:50:39.943+0000 7faf4d4f9640 10 monclient(hunting): get_auth_request con 0x55de54d73720 auth_method 0 2024-09-12T00:50:40.297 INFO:tasks.workunit.client.0.smithi073.stderr: -360> 2024-09-12T00:50:39.943+0000 7faf4d4f9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:40.297 INFO:tasks.workunit.client.0.smithi073.stderr: -359> 2024-09-12T00:50:39.943+0000 7faf4d4f9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:40.297 INFO:tasks.workunit.client.0.smithi073.stderr: -358> 2024-09-12T00:50:39.943+0000 7faf4d4f9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:40.297 INFO:tasks.workunit.client.0.smithi073.stderr: -357> 2024-09-12T00:50:39.943+0000 7faf4ccf8640 10 monclient(hunting): get_auth_request con 0x55de54d73b00 auth_method 0 2024-09-12T00:50:40.297 INFO:tasks.workunit.client.0.smithi073.stderr: -356> 2024-09-12T00:50:39.943+0000 7faf4ccf8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:40.297 INFO:tasks.workunit.client.0.smithi073.stderr: -355> 2024-09-12T00:50:39.943+0000 7faf4ccf8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:40.297 INFO:tasks.workunit.client.0.smithi073.stderr: -354> 2024-09-12T00:50:39.943+0000 7faf4ccf8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:40.297 INFO:tasks.workunit.client.0.smithi073.stderr: -353> 2024-09-12T00:50:39.943+0000 7faf4d4f9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:40.297 INFO:tasks.workunit.client.0.smithi073.stderr: -352> 2024-09-12T00:50:39.943+0000 7faf4d4f9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:40.297 INFO:tasks.workunit.client.0.smithi073.stderr: -351> 2024-09-12T00:50:39.943+0000 7faf4d4f9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:40.297 INFO:tasks.workunit.client.0.smithi073.stderr: -350> 2024-09-12T00:50:39.943+0000 7faf4ccf8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:40.298 INFO:tasks.workunit.client.0.smithi073.stderr: -349> 2024-09-12T00:50:39.943+0000 7faf4ccf8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:40.298 INFO:tasks.workunit.client.0.smithi073.stderr: -348> 2024-09-12T00:50:39.943+0000 7faf4ccf8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:40.298 INFO:tasks.workunit.client.0.smithi073.stderr: -347> 2024-09-12T00:50:39.943+0000 7faf4dcfa640 10 monclient(hunting): get_auth_request con 0x55de54d72430 auth_method 0 2024-09-12T00:50:40.298 INFO:tasks.workunit.client.0.smithi073.stderr: -346> 2024-09-12T00:50:39.943+0000 7faf4dcfa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:40.298 INFO:tasks.workunit.client.0.smithi073.stderr: -345> 2024-09-12T00:50:39.943+0000 7faf4dcfa640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:40.298 INFO:tasks.workunit.client.0.smithi073.stderr: -344> 2024-09-12T00:50:39.943+0000 7faf4dcfa640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:40.298 INFO:tasks.workunit.client.0.smithi073.stderr: -343> 2024-09-12T00:50:39.943+0000 7faf4ccf8640 10 monclient(hunting): handle_auth_done global_id 6701 payload 824 2024-09-12T00:50:40.298 INFO:tasks.workunit.client.0.smithi073.stderr: -342> 2024-09-12T00:50:39.943+0000 7faf4ccf8640 10 monclient: _finish_hunting 0 2024-09-12T00:50:40.298 INFO:tasks.workunit.client.0.smithi073.stderr: -341> 2024-09-12T00:50:39.943+0000 7faf4ccf8640 1 monclient: found mon.noname-c 2024-09-12T00:50:40.298 INFO:tasks.workunit.client.0.smithi073.stderr: -340> 2024-09-12T00:50:39.943+0000 7faf4ccf8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.73:3301/0 2024-09-12T00:50:40.298 INFO:tasks.workunit.client.0.smithi073.stderr: -339> 2024-09-12T00:50:39.943+0000 7fae32ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:40.298 INFO:tasks.workunit.client.0.smithi073.stderr: -338> 2024-09-12T00:50:39.944+0000 7fae32ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:50:40.298 INFO:tasks.workunit.client.0.smithi073.stderr: -337> 2024-09-12T00:50:39.944+0000 7fae32ffd640 10 monclient: dump: 2024-09-12T00:50:40.298 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:50:40.299 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:50:40.299 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:40.299 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:40.299 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:40.299 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:50:40.299 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:50:40.299 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:50:40.299 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:50:40.299 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:40.299 INFO:tasks.workunit.client.0.smithi073.stderr: -336> 2024-09-12T00:50:39.944+0000 7fae32ffd640 10 monclient: _finish_auth 0 2024-09-12T00:50:40.299 INFO:tasks.workunit.client.0.smithi073.stderr: -335> 2024-09-12T00:50:39.944+0000 7fae32ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:50:40.299 INFO:tasks.workunit.client.0.smithi073.stderr: -334> 2024-09-12T00:50:39.944+0000 7fae32ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:40.300 INFO:tasks.workunit.client.0.smithi073.stderr: -333> 2024-09-12T00:50:39.944+0000 7fae32ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:40.300 INFO:tasks.workunit.client.0.smithi073.stderr: -332> 2024-09-12T00:50:39.944+0000 7fae32ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:50:40.300 INFO:tasks.workunit.client.0.smithi073.stderr: -331> 2024-09-12T00:50:39.944+0000 7fae32ffd640 10 monclient: dump: 2024-09-12T00:50:40.300 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:50:40.300 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:50:40.300 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:40.300 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:40.300 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:40.300 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:50:40.300 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:50:40.300 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:50:40.300 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:50:40.300 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:40.301 INFO:tasks.workunit.client.0.smithi073.stderr: -330> 2024-09-12T00:50:39.944+0000 7faf4fa0f800 5 monclient: authenticate success, global_id 6701 2024-09-12T00:50:40.301 INFO:tasks.workunit.client.0.smithi073.stderr: -329> 2024-09-12T00:50:39.944+0000 7faf4e4fb640 4 set_mon_vals no callback set 2024-09-12T00:50:40.301 INFO:tasks.workunit.client.0.smithi073.stderr: -328> 2024-09-12T00:50:39.944+0000 7faf4fa0f800 10 monclient: _renew_subs 2024-09-12T00:50:40.301 INFO:tasks.workunit.client.0.smithi073.stderr: -327> 2024-09-12T00:50:39.944+0000 7faf4fa0f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:50:40.301 INFO:tasks.workunit.client.0.smithi073.stderr: -326> 2024-09-12T00:50:39.944+0000 7faf4fa0f800 10 monclient: _renew_subs 2024-09-12T00:50:40.301 INFO:tasks.workunit.client.0.smithi073.stderr: -325> 2024-09-12T00:50:39.944+0000 7faf4fa0f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:50:40.301 INFO:tasks.workunit.client.0.smithi073.stderr: -324> 2024-09-12T00:50:39.945+0000 7fae32ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:50:40.301 INFO:tasks.workunit.client.0.smithi073.stderr: -323> 2024-09-12T00:50:39.945+0000 7fae32ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:50:40.301 INFO:tasks.workunit.client.0.smithi073.stderr: -322> 2024-09-12T00:50:39.945+0000 7fae32ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:50:40.301 INFO:tasks.workunit.client.0.smithi073.stderr: -321> 2024-09-12T00:50:39.945+0000 7faf4d4f9640 10 monclient: get_auth_request con 0x7fae28076380 auth_method 0 2024-09-12T00:50:40.301 INFO:tasks.workunit.client.0.smithi073.stderr: -320> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 10 monclient: get_monmap_and_config 2024-09-12T00:50:40.301 INFO:tasks.workunit.client.0.smithi073.stderr: -319> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 10 monclient: build_initial_monmap 2024-09-12T00:50:40.301 INFO:tasks.workunit.client.0.smithi073.stderr: -318> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 1 build_initial for_mkfs: 0 2024-09-12T00:50:40.302 INFO:tasks.workunit.client.0.smithi073.stderr: -317> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 10 monclient: monmap: 2024-09-12T00:50:40.302 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:50:40.302 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:40.302 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:50:40.302 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:50:40.302 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:40.302 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:50:40.302 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:50:40.302 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:50:40.302 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:50:40.302 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:40.302 INFO:tasks.workunit.client.0.smithi073.stderr: -316> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d92fd0) adding auth protocol: cephx 2024-09-12T00:50:40.302 INFO:tasks.workunit.client.0.smithi073.stderr: -315> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d92fd0) adding auth protocol: cephx 2024-09-12T00:50:40.303 INFO:tasks.workunit.client.0.smithi073.stderr: -314> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d92fd0) adding auth protocol: cephx 2024-09-12T00:50:40.303 INFO:tasks.workunit.client.0.smithi073.stderr: -313> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d92fd0) adding con mode: secure 2024-09-12T00:50:40.303 INFO:tasks.workunit.client.0.smithi073.stderr: -312> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d92fd0) adding con mode: crc 2024-09-12T00:50:40.303 INFO:tasks.workunit.client.0.smithi073.stderr: -311> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d92fd0) adding con mode: secure 2024-09-12T00:50:40.303 INFO:tasks.workunit.client.0.smithi073.stderr: -310> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d92fd0) adding con mode: crc 2024-09-12T00:50:40.303 INFO:tasks.workunit.client.0.smithi073.stderr: -309> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d92fd0) adding con mode: secure 2024-09-12T00:50:40.303 INFO:tasks.workunit.client.0.smithi073.stderr: -308> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d92fd0) adding con mode: crc 2024-09-12T00:50:40.303 INFO:tasks.workunit.client.0.smithi073.stderr: -307> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d92fd0) adding con mode: crc 2024-09-12T00:50:40.303 INFO:tasks.workunit.client.0.smithi073.stderr: -306> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d92fd0) adding con mode: secure 2024-09-12T00:50:40.303 INFO:tasks.workunit.client.0.smithi073.stderr: -305> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d92fd0) adding con mode: crc 2024-09-12T00:50:40.303 INFO:tasks.workunit.client.0.smithi073.stderr: -304> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d92fd0) adding con mode: secure 2024-09-12T00:50:40.303 INFO:tasks.workunit.client.0.smithi073.stderr: -303> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d92fd0) adding con mode: crc 2024-09-12T00:50:40.303 INFO:tasks.workunit.client.0.smithi073.stderr: -302> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d92fd0) adding con mode: secure 2024-09-12T00:50:40.304 INFO:tasks.workunit.client.0.smithi073.stderr: -301> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:40.304 INFO:tasks.workunit.client.0.smithi073.stderr: -300> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 10 monclient: init 2024-09-12T00:50:40.304 INFO:tasks.workunit.client.0.smithi073.stderr: -299> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f39b70) adding auth protocol: cephx 2024-09-12T00:50:40.304 INFO:tasks.workunit.client.0.smithi073.stderr: -298> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f39b70) adding auth protocol: cephx 2024-09-12T00:50:40.304 INFO:tasks.workunit.client.0.smithi073.stderr: -297> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f39b70) adding auth protocol: cephx 2024-09-12T00:50:40.304 INFO:tasks.workunit.client.0.smithi073.stderr: -296> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f39b70) adding con mode: secure 2024-09-12T00:50:40.304 INFO:tasks.workunit.client.0.smithi073.stderr: -295> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f39b70) adding con mode: crc 2024-09-12T00:50:40.304 INFO:tasks.workunit.client.0.smithi073.stderr: -294> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f39b70) adding con mode: secure 2024-09-12T00:50:40.304 INFO:tasks.workunit.client.0.smithi073.stderr: -293> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f39b70) adding con mode: crc 2024-09-12T00:50:40.304 INFO:tasks.workunit.client.0.smithi073.stderr: -292> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f39b70) adding con mode: secure 2024-09-12T00:50:40.304 INFO:tasks.workunit.client.0.smithi073.stderr: -291> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f39b70) adding con mode: crc 2024-09-12T00:50:40.304 INFO:tasks.workunit.client.0.smithi073.stderr: -290> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f39b70) adding con mode: crc 2024-09-12T00:50:40.305 INFO:tasks.workunit.client.0.smithi073.stderr: -289> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f39b70) adding con mode: secure 2024-09-12T00:50:40.305 INFO:tasks.workunit.client.0.smithi073.stderr: -288> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f39b70) adding con mode: crc 2024-09-12T00:50:40.305 INFO:tasks.workunit.client.0.smithi073.stderr: -287> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f39b70) adding con mode: secure 2024-09-12T00:50:40.305 INFO:tasks.workunit.client.0.smithi073.stderr: -286> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f39b70) adding con mode: crc 2024-09-12T00:50:40.305 INFO:tasks.workunit.client.0.smithi073.stderr: -285> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f39b70) adding con mode: secure 2024-09-12T00:50:40.305 INFO:tasks.workunit.client.0.smithi073.stderr: -284> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:40.305 INFO:tasks.workunit.client.0.smithi073.stderr: -283> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:40.305 INFO:tasks.workunit.client.0.smithi073.stderr: -282> 2024-09-12T00:50:39.946+0000 7faf4fa0f800 5 asok(0x55de54ad7630) register_command rotate-key cmddesc rotate-key hook 0x7ffce9f39cb8 EEXIST 2024-09-12T00:50:40.305 INFO:tasks.workunit.client.0.smithi073.stderr: -281> 2024-09-12T00:50:39.947+0000 7faf4fa0f800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:40.305 INFO:tasks.workunit.client.0.smithi073.stderr: -280> 2024-09-12T00:50:39.947+0000 7faf4fa0f800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:50:40.305 INFO:tasks.workunit.client.0.smithi073.stderr: -279> 2024-09-12T00:50:39.947+0000 7faf4fa0f800 10 monclient(hunting): picked mon.noname-a con 0x55de54dc7610 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:50:40.305 INFO:tasks.workunit.client.0.smithi073.stderr: -278> 2024-09-12T00:50:39.947+0000 7faf4fa0f800 10 monclient(hunting): picked mon.noname-c con 0x55de54d98620 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:50:40.306 INFO:tasks.workunit.client.0.smithi073.stderr: -277> 2024-09-12T00:50:39.947+0000 7faf4fa0f800 10 monclient(hunting): picked mon.noname-b con 0x55de54dc2af0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:50:40.306 INFO:tasks.workunit.client.0.smithi073.stderr: -276> 2024-09-12T00:50:39.947+0000 7faf4fa0f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:40.306 INFO:tasks.workunit.client.0.smithi073.stderr: -275> 2024-09-12T00:50:39.947+0000 7faf4fa0f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:40.306 INFO:tasks.workunit.client.0.smithi073.stderr: -274> 2024-09-12T00:50:39.947+0000 7faf4fa0f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:40.306 INFO:tasks.workunit.client.0.smithi073.stderr: -273> 2024-09-12T00:50:39.947+0000 7faf4fa0f800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:40.306 INFO:tasks.workunit.client.0.smithi073.stderr: -272> 2024-09-12T00:50:39.947+0000 7faf4fa0f800 10 monclient(hunting): authenticate will time out at 2100.617070s 2024-09-12T00:50:40.306 INFO:tasks.workunit.client.0.smithi073.stderr: -271> 2024-09-12T00:50:39.947+0000 7faf4ccf8640 10 monclient(hunting): get_auth_request con 0x55de54d98620 auth_method 0 2024-09-12T00:50:40.306 INFO:tasks.workunit.client.0.smithi073.stderr: -270> 2024-09-12T00:50:39.947+0000 7faf4ccf8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:40.306 INFO:tasks.workunit.client.0.smithi073.stderr: -269> 2024-09-12T00:50:39.947+0000 7faf4ccf8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:40.306 INFO:tasks.workunit.client.0.smithi073.stderr: -268> 2024-09-12T00:50:39.947+0000 7faf4ccf8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:40.306 INFO:tasks.workunit.client.0.smithi073.stderr: -267> 2024-09-12T00:50:39.947+0000 7faf4d4f9640 10 monclient(hunting): get_auth_request con 0x55de54dc7610 auth_method 0 2024-09-12T00:50:40.306 INFO:tasks.workunit.client.0.smithi073.stderr: -266> 2024-09-12T00:50:39.947+0000 7faf4d4f9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:40.306 INFO:tasks.workunit.client.0.smithi073.stderr: -265> 2024-09-12T00:50:39.947+0000 7faf4d4f9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:40.307 INFO:tasks.workunit.client.0.smithi073.stderr: -264> 2024-09-12T00:50:39.947+0000 7faf4d4f9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:40.307 INFO:tasks.workunit.client.0.smithi073.stderr: -263> 2024-09-12T00:50:39.947+0000 7faf4ccf8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:40.307 INFO:tasks.workunit.client.0.smithi073.stderr: -262> 2024-09-12T00:50:39.947+0000 7faf4ccf8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:40.307 INFO:tasks.workunit.client.0.smithi073.stderr: -261> 2024-09-12T00:50:39.947+0000 7faf4ccf8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:40.307 INFO:tasks.workunit.client.0.smithi073.stderr: -260> 2024-09-12T00:50:39.947+0000 7faf4d4f9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:40.307 INFO:tasks.workunit.client.0.smithi073.stderr: -259> 2024-09-12T00:50:39.947+0000 7faf4d4f9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:40.307 INFO:tasks.workunit.client.0.smithi073.stderr: -258> 2024-09-12T00:50:39.947+0000 7faf4d4f9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:40.307 INFO:tasks.workunit.client.0.smithi073.stderr: -257> 2024-09-12T00:50:39.947+0000 7faf4dcfa640 10 monclient(hunting): get_auth_request con 0x55de54dc2af0 auth_method 0 2024-09-12T00:50:40.307 INFO:tasks.workunit.client.0.smithi073.stderr: -256> 2024-09-12T00:50:39.947+0000 7faf4dcfa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:40.307 INFO:tasks.workunit.client.0.smithi073.stderr: -255> 2024-09-12T00:50:39.947+0000 7faf4dcfa640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:40.307 INFO:tasks.workunit.client.0.smithi073.stderr: -254> 2024-09-12T00:50:39.947+0000 7faf4dcfa640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:40.307 INFO:tasks.workunit.client.0.smithi073.stderr: -253> 2024-09-12T00:50:39.947+0000 7faf4ccf8640 10 monclient(hunting): handle_auth_done global_id 6704 payload 274 2024-09-12T00:50:40.307 INFO:tasks.workunit.client.0.smithi073.stderr: -252> 2024-09-12T00:50:39.947+0000 7faf4ccf8640 10 monclient: _finish_hunting 0 2024-09-12T00:50:40.308 INFO:tasks.workunit.client.0.smithi073.stderr: -251> 2024-09-12T00:50:39.947+0000 7faf4ccf8640 1 monclient: found mon.noname-c 2024-09-12T00:50:40.308 INFO:tasks.workunit.client.0.smithi073.stderr: -250> 2024-09-12T00:50:39.947+0000 7faf4ccf8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.73:3301/0 2024-09-12T00:50:40.308 INFO:tasks.workunit.client.0.smithi073.stderr: -249> 2024-09-12T00:50:39.947+0000 7fae30ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:40.308 INFO:tasks.workunit.client.0.smithi073.stderr: -248> 2024-09-12T00:50:39.947+0000 7fae30ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:50:40.308 INFO:tasks.workunit.client.0.smithi073.stderr: -247> 2024-09-12T00:50:39.947+0000 7fae30ff9640 10 monclient: dump: 2024-09-12T00:50:40.308 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:50:40.308 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:50:40.308 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:40.308 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:40.308 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:40.308 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:50:40.308 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:50:40.309 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:50:40.309 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:50:40.309 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:40.309 INFO:tasks.workunit.client.0.smithi073.stderr: -246> 2024-09-12T00:50:39.947+0000 7fae30ff9640 10 monclient: _finish_auth 0 2024-09-12T00:50:40.309 INFO:tasks.workunit.client.0.smithi073.stderr: -245> 2024-09-12T00:50:39.947+0000 7fae30ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:50:40.309 INFO:tasks.workunit.client.0.smithi073.stderr: -244> 2024-09-12T00:50:39.947+0000 7fae30ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:40.309 INFO:tasks.workunit.client.0.smithi073.stderr: -243> 2024-09-12T00:50:39.947+0000 7fae30ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:40.309 INFO:tasks.workunit.client.0.smithi073.stderr: -242> 2024-09-12T00:50:39.947+0000 7fae30ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:50:40.309 INFO:tasks.workunit.client.0.smithi073.stderr: -241> 2024-09-12T00:50:39.947+0000 7fae30ff9640 10 monclient: dump: 2024-09-12T00:50:40.309 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:50:40.309 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:50:40.309 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:40.309 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:40.310 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:40.310 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:50:40.310 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:50:40.310 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:50:40.310 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:50:40.310 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:40.310 INFO:tasks.workunit.client.0.smithi073.stderr: -240> 2024-09-12T00:50:39.947+0000 7faf4fa0f800 5 monclient: authenticate success, global_id 6704 2024-09-12T00:50:40.310 INFO:tasks.workunit.client.0.smithi073.stderr: -239> 2024-09-12T00:50:39.947+0000 7faf4fa0f800 10 monclient: get_monmap_and_config success 2024-09-12T00:50:40.310 INFO:tasks.workunit.client.0.smithi073.stderr: -238> 2024-09-12T00:50:39.947+0000 7faf4fa0f800 4 set_mon_vals no callback set 2024-09-12T00:50:40.310 INFO:tasks.workunit.client.0.smithi073.stderr: -237> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 10 monclient: shutdown 2024-09-12T00:50:40.310 INFO:tasks.workunit.client.0.smithi073.stderr: -236> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 10 monclient: build_initial_monmap 2024-09-12T00:50:40.310 INFO:tasks.workunit.client.0.smithi073.stderr: -235> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 1 build_initial for_mkfs: 0 2024-09-12T00:50:40.311 INFO:tasks.workunit.client.0.smithi073.stderr: -234> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 10 monclient: monmap: 2024-09-12T00:50:40.311 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:50:40.311 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:40.311 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:50:40.311 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:50:40.311 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:40.311 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:50:40.311 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:50:40.311 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:50:40.311 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:50:40.311 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:40.311 INFO:tasks.workunit.client.0.smithi073.stderr: -233> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54dc36d0) adding auth protocol: cephx 2024-09-12T00:50:40.311 INFO:tasks.workunit.client.0.smithi073.stderr: -232> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54dc36d0) adding auth protocol: cephx 2024-09-12T00:50:40.312 INFO:tasks.workunit.client.0.smithi073.stderr: -231> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54dc36d0) adding auth protocol: cephx 2024-09-12T00:50:40.312 INFO:tasks.workunit.client.0.smithi073.stderr: -230> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54dc36d0) adding con mode: secure 2024-09-12T00:50:40.312 INFO:tasks.workunit.client.0.smithi073.stderr: -229> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54dc36d0) adding con mode: crc 2024-09-12T00:50:40.312 INFO:tasks.workunit.client.0.smithi073.stderr: -228> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54dc36d0) adding con mode: secure 2024-09-12T00:50:40.312 INFO:tasks.workunit.client.0.smithi073.stderr: -227> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54dc36d0) adding con mode: crc 2024-09-12T00:50:40.312 INFO:tasks.workunit.client.0.smithi073.stderr: -226> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54dc36d0) adding con mode: secure 2024-09-12T00:50:40.312 INFO:tasks.workunit.client.0.smithi073.stderr: -225> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54dc36d0) adding con mode: crc 2024-09-12T00:50:40.312 INFO:tasks.workunit.client.0.smithi073.stderr: -224> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54dc36d0) adding con mode: crc 2024-09-12T00:50:40.312 INFO:tasks.workunit.client.0.smithi073.stderr: -223> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54dc36d0) adding con mode: secure 2024-09-12T00:50:40.312 INFO:tasks.workunit.client.0.smithi073.stderr: -222> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54dc36d0) adding con mode: crc 2024-09-12T00:50:40.312 INFO:tasks.workunit.client.0.smithi073.stderr: -221> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54dc36d0) adding con mode: secure 2024-09-12T00:50:40.312 INFO:tasks.workunit.client.0.smithi073.stderr: -220> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54dc36d0) adding con mode: crc 2024-09-12T00:50:40.313 INFO:tasks.workunit.client.0.smithi073.stderr: -219> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54dc36d0) adding con mode: secure 2024-09-12T00:50:40.313 INFO:tasks.workunit.client.0.smithi073.stderr: -218> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:40.313 INFO:tasks.workunit.client.0.smithi073.stderr: -217> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 1 librados: starting msgr at 2024-09-12T00:50:40.313 INFO:tasks.workunit.client.0.smithi073.stderr: -216> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 1 librados: starting objecter 2024-09-12T00:50:40.313 INFO:tasks.workunit.client.0.smithi073.stderr: -215> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 asok(0x55de54ad7630) register_command objecter_requests cmddesc objecter_requests hook 0x55de54d75570 EEXIST 2024-09-12T00:50:40.313 INFO:tasks.workunit.client.0.smithi073.stderr: -214> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 1 librados: setting wanted keys 2024-09-12T00:50:40.313 INFO:tasks.workunit.client.0.smithi073.stderr: -213> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 1 librados: calling monclient init 2024-09-12T00:50:40.313 INFO:tasks.workunit.client.0.smithi073.stderr: -212> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 10 monclient: init 2024-09-12T00:50:40.313 INFO:tasks.workunit.client.0.smithi073.stderr: -211> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d87fe0) adding auth protocol: cephx 2024-09-12T00:50:40.313 INFO:tasks.workunit.client.0.smithi073.stderr: -210> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d87fe0) adding auth protocol: cephx 2024-09-12T00:50:40.313 INFO:tasks.workunit.client.0.smithi073.stderr: -209> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d87fe0) adding auth protocol: cephx 2024-09-12T00:50:40.313 INFO:tasks.workunit.client.0.smithi073.stderr: -208> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d87fe0) adding con mode: secure 2024-09-12T00:50:40.313 INFO:tasks.workunit.client.0.smithi073.stderr: -207> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d87fe0) adding con mode: crc 2024-09-12T00:50:40.314 INFO:tasks.workunit.client.0.smithi073.stderr: -206> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d87fe0) adding con mode: secure 2024-09-12T00:50:40.314 INFO:tasks.workunit.client.0.smithi073.stderr: -205> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d87fe0) adding con mode: crc 2024-09-12T00:50:40.314 INFO:tasks.workunit.client.0.smithi073.stderr: -204> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d87fe0) adding con mode: secure 2024-09-12T00:50:40.314 INFO:tasks.workunit.client.0.smithi073.stderr: -203> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d87fe0) adding con mode: crc 2024-09-12T00:50:40.314 INFO:tasks.workunit.client.0.smithi073.stderr: -202> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d87fe0) adding con mode: crc 2024-09-12T00:50:40.314 INFO:tasks.workunit.client.0.smithi073.stderr: -201> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d87fe0) adding con mode: secure 2024-09-12T00:50:40.314 INFO:tasks.workunit.client.0.smithi073.stderr: -200> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d87fe0) adding con mode: crc 2024-09-12T00:50:40.314 INFO:tasks.workunit.client.0.smithi073.stderr: -199> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d87fe0) adding con mode: secure 2024-09-12T00:50:40.314 INFO:tasks.workunit.client.0.smithi073.stderr: -198> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d87fe0) adding con mode: crc 2024-09-12T00:50:40.314 INFO:tasks.workunit.client.0.smithi073.stderr: -197> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 5 AuthRegistry(0x55de54d87fe0) adding con mode: secure 2024-09-12T00:50:40.314 INFO:tasks.workunit.client.0.smithi073.stderr: -196> 2024-09-12T00:50:39.948+0000 7faf4fa0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:40.314 INFO:tasks.workunit.client.0.smithi073.stderr: -195> 2024-09-12T00:50:39.949+0000 7faf4fa0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:40.314 INFO:tasks.workunit.client.0.smithi073.stderr: -194> 2024-09-12T00:50:39.949+0000 7faf4fa0f800 5 asok(0x55de54ad7630) register_command rotate-key cmddesc rotate-key hook 0x55de54d88128 EEXIST 2024-09-12T00:50:40.315 INFO:tasks.workunit.client.0.smithi073.stderr: -193> 2024-09-12T00:50:39.949+0000 7faf4fa0f800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:40.315 INFO:tasks.workunit.client.0.smithi073.stderr: -192> 2024-09-12T00:50:39.949+0000 7faf4fa0f800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:50:40.315 INFO:tasks.workunit.client.0.smithi073.stderr: -191> 2024-09-12T00:50:39.949+0000 7faf4fa0f800 10 monclient(hunting): picked mon.noname-b con 0x55de54d98620 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:50:40.315 INFO:tasks.workunit.client.0.smithi073.stderr: -190> 2024-09-12T00:50:39.949+0000 7faf4fa0f800 10 monclient(hunting): picked mon.noname-a con 0x55de54dc2af0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:50:40.315 INFO:tasks.workunit.client.0.smithi073.stderr: -189> 2024-09-12T00:50:39.949+0000 7faf4fa0f800 10 monclient(hunting): picked mon.noname-c con 0x55de54dc7610 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:50:40.315 INFO:tasks.workunit.client.0.smithi073.stderr: -188> 2024-09-12T00:50:39.949+0000 7faf4fa0f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:40.315 INFO:tasks.workunit.client.0.smithi073.stderr: -187> 2024-09-12T00:50:39.949+0000 7faf4fa0f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:40.315 INFO:tasks.workunit.client.0.smithi073.stderr: -186> 2024-09-12T00:50:39.949+0000 7faf4fa0f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:40.315 INFO:tasks.workunit.client.0.smithi073.stderr: -185> 2024-09-12T00:50:39.949+0000 7faf4fa0f800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:40.315 INFO:tasks.workunit.client.0.smithi073.stderr: -184> 2024-09-12T00:50:39.949+0000 7faf4fa0f800 10 monclient(hunting): authenticate will time out at 2100.619246s 2024-09-12T00:50:40.315 INFO:tasks.workunit.client.0.smithi073.stderr: -183> 2024-09-12T00:50:39.949+0000 7faf4dcfa640 10 monclient(hunting): get_auth_request con 0x55de54dc7610 auth_method 0 2024-09-12T00:50:40.315 INFO:tasks.workunit.client.0.smithi073.stderr: -182> 2024-09-12T00:50:39.949+0000 7faf4dcfa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:40.315 INFO:tasks.workunit.client.0.smithi073.stderr: -181> 2024-09-12T00:50:39.949+0000 7faf4dcfa640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:40.315 INFO:tasks.workunit.client.0.smithi073.stderr: -180> 2024-09-12T00:50:39.949+0000 7faf4dcfa640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:40.316 INFO:tasks.workunit.client.0.smithi073.stderr: -179> 2024-09-12T00:50:39.949+0000 7faf4ccf8640 10 monclient(hunting): get_auth_request con 0x55de54dc2af0 auth_method 0 2024-09-12T00:50:40.316 INFO:tasks.workunit.client.0.smithi073.stderr: -178> 2024-09-12T00:50:39.949+0000 7faf4ccf8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:40.316 INFO:tasks.workunit.client.0.smithi073.stderr: -177> 2024-09-12T00:50:39.949+0000 7faf4ccf8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:40.316 INFO:tasks.workunit.client.0.smithi073.stderr: -176> 2024-09-12T00:50:39.949+0000 7faf4ccf8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:40.316 INFO:tasks.workunit.client.0.smithi073.stderr: -175> 2024-09-12T00:50:39.949+0000 7faf4dcfa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:40.316 INFO:tasks.workunit.client.0.smithi073.stderr: -174> 2024-09-12T00:50:39.949+0000 7faf4dcfa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:40.316 INFO:tasks.workunit.client.0.smithi073.stderr: -173> 2024-09-12T00:50:39.949+0000 7faf4dcfa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:40.316 INFO:tasks.workunit.client.0.smithi073.stderr: -172> 2024-09-12T00:50:39.949+0000 7faf4ccf8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:40.316 INFO:tasks.workunit.client.0.smithi073.stderr: -171> 2024-09-12T00:50:39.949+0000 7faf4ccf8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:40.316 INFO:tasks.workunit.client.0.smithi073.stderr: -170> 2024-09-12T00:50:39.949+0000 7faf4ccf8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:40.316 INFO:tasks.workunit.client.0.smithi073.stderr: -169> 2024-09-12T00:50:39.949+0000 7faf4d4f9640 10 monclient(hunting): get_auth_request con 0x55de54d98620 auth_method 0 2024-09-12T00:50:40.316 INFO:tasks.workunit.client.0.smithi073.stderr: -168> 2024-09-12T00:50:39.949+0000 7faf4d4f9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:40.317 INFO:tasks.workunit.client.0.smithi073.stderr: -167> 2024-09-12T00:50:39.949+0000 7faf4d4f9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:40.317 INFO:tasks.workunit.client.0.smithi073.stderr: -166> 2024-09-12T00:50:39.949+0000 7faf4d4f9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:40.317 INFO:tasks.workunit.client.0.smithi073.stderr: -165> 2024-09-12T00:50:39.949+0000 7faf4dcfa640 10 monclient(hunting): handle_auth_done global_id 6707 payload 824 2024-09-12T00:50:40.317 INFO:tasks.workunit.client.0.smithi073.stderr: -164> 2024-09-12T00:50:39.949+0000 7faf4dcfa640 10 monclient: _finish_hunting 0 2024-09-12T00:50:40.317 INFO:tasks.workunit.client.0.smithi073.stderr: -163> 2024-09-12T00:50:39.949+0000 7faf4dcfa640 1 monclient: found mon.noname-c 2024-09-12T00:50:40.317 INFO:tasks.workunit.client.0.smithi073.stderr: -162> 2024-09-12T00:50:39.949+0000 7faf4dcfa640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.73:3301/0 2024-09-12T00:50:40.317 INFO:tasks.workunit.client.0.smithi073.stderr: -161> 2024-09-12T00:50:39.949+0000 7fae1effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:40.317 INFO:tasks.workunit.client.0.smithi073.stderr: -160> 2024-09-12T00:50:39.949+0000 7fae1effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:50:40.317 INFO:tasks.workunit.client.0.smithi073.stderr: -159> 2024-09-12T00:50:39.949+0000 7fae1effd640 10 monclient: dump: 2024-09-12T00:50:40.317 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:50:40.317 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:50:40.317 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:40.318 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:40.318 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:40.318 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:50:40.318 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:50:40.318 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:50:40.318 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:50:40.318 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:40.318 INFO:tasks.workunit.client.0.smithi073.stderr: -158> 2024-09-12T00:50:39.949+0000 7fae1effd640 10 monclient: _finish_auth 0 2024-09-12T00:50:40.318 INFO:tasks.workunit.client.0.smithi073.stderr: -157> 2024-09-12T00:50:39.949+0000 7fae1effd640 10 monclient: _check_auth_tickets 2024-09-12T00:50:40.318 INFO:tasks.workunit.client.0.smithi073.stderr: -156> 2024-09-12T00:50:39.949+0000 7fae1effd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:40.318 INFO:tasks.workunit.client.0.smithi073.stderr: -155> 2024-09-12T00:50:39.949+0000 7fae1effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:40.318 INFO:tasks.workunit.client.0.smithi073.stderr: -154> 2024-09-12T00:50:39.949+0000 7fae1effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:50:40.318 INFO:tasks.workunit.client.0.smithi073.stderr: -153> 2024-09-12T00:50:39.949+0000 7fae1effd640 10 monclient: dump: 2024-09-12T00:50:40.319 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:50:40.319 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:50:40.319 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:40.319 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:50:40.319 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:40.319 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:50:40.319 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:50:40.319 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:50:40.319 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:50:40.319 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:40.319 INFO:tasks.workunit.client.0.smithi073.stderr: -152> 2024-09-12T00:50:39.949+0000 7faf4fa0f800 5 monclient: authenticate success, global_id 6707 2024-09-12T00:50:40.319 INFO:tasks.workunit.client.0.smithi073.stderr: -151> 2024-09-12T00:50:39.949+0000 7faf4fa0f800 10 monclient: _renew_subs 2024-09-12T00:50:40.320 INFO:tasks.workunit.client.0.smithi073.stderr: -150> 2024-09-12T00:50:39.949+0000 7fae30ff9640 4 set_mon_vals no callback set 2024-09-12T00:50:40.320 INFO:tasks.workunit.client.0.smithi073.stderr: -149> 2024-09-12T00:50:39.949+0000 7faf4fa0f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:50:40.320 INFO:tasks.workunit.client.0.smithi073.stderr: -148> 2024-09-12T00:50:39.950+0000 7faf4fa0f800 10 monclient: _renew_subs 2024-09-12T00:50:40.320 INFO:tasks.workunit.client.0.smithi073.stderr: -147> 2024-09-12T00:50:39.950+0000 7faf4fa0f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:50:40.320 INFO:tasks.workunit.client.0.smithi073.stderr: -146> 2024-09-12T00:50:39.950+0000 7faf4fa0f800 1 librados: init done 2024-09-12T00:50:40.320 INFO:tasks.workunit.client.0.smithi073.stderr: -145> 2024-09-12T00:50:39.950+0000 7faf4fa0f800 5 asok(0x55de54ad7630) register_command cr dump hook 0x7faf380973f8 2024-09-12T00:50:40.320 INFO:tasks.workunit.client.0.smithi073.stderr: -144> 2024-09-12T00:50:39.951+0000 7faf4fa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.320 INFO:tasks.workunit.client.0.smithi073.stderr: -143> 2024-09-12T00:50:39.952+0000 7fae1effd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:50:40.320 INFO:tasks.workunit.client.0.smithi073.stderr: -142> 2024-09-12T00:50:39.952+0000 7fae1effd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:50:40.320 INFO:tasks.workunit.client.0.smithi073.stderr: -141> 2024-09-12T00:50:39.952+0000 7fae1effd640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:50:40.320 INFO:tasks.workunit.client.0.smithi073.stderr: -140> 2024-09-12T00:50:39.952+0000 7faf4d4f9640 10 monclient: get_auth_request con 0x7fae180764a0 auth_method 0 2024-09-12T00:50:40.320 INFO:tasks.workunit.client.0.smithi073.stderr: -139> 2024-09-12T00:50:39.953+0000 7faf4ccf8640 10 monclient: get_auth_request con 0x55de54de1740 auth_method 0 2024-09-12T00:50:40.321 INFO:tasks.workunit.client.0.smithi073.stderr: -138> 2024-09-12T00:50:39.953+0000 7faf4fa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:40.385 INFO:tasks.workunit.client.0.smithi073.stderr: -137> 2024-09-12T00:50:39.953+0000 7faf4fa0f800 20 realm 2024-09-12T00:50:40.385 INFO:tasks.workunit.client.0.smithi073.stderr: -136> 2024-09-12T00:50:39.953+0000 7faf4fa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.385 INFO:tasks.workunit.client.0.smithi073.stderr: -135> 2024-09-12T00:50:39.953+0000 7faf4fa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:40.385 INFO:tasks.workunit.client.0.smithi073.stderr: -134> 2024-09-12T00:50:39.953+0000 7faf4fa0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:40.386 INFO:tasks.workunit.client.0.smithi073.stderr: -133> 2024-09-12T00:50:39.953+0000 7faf4fa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.386 INFO:tasks.workunit.client.0.smithi073.stderr: -132> 2024-09-12T00:50:39.953+0000 7faf4fa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:40.386 INFO:tasks.workunit.client.0.smithi073.stderr: -131> 2024-09-12T00:50:39.953+0000 7faf4fa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.386 INFO:tasks.workunit.client.0.smithi073.stderr: -130> 2024-09-12T00:50:39.954+0000 7faf4d4f9640 10 monclient: get_auth_request con 0x55de54de58c0 auth_method 0 2024-09-12T00:50:40.386 INFO:tasks.workunit.client.0.smithi073.stderr: -129> 2024-09-12T00:50:39.954+0000 7faf4fa0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:40.386 INFO:tasks.workunit.client.0.smithi073.stderr: -128> 2024-09-12T00:50:39.954+0000 7faf4fa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.386 INFO:tasks.workunit.client.0.smithi073.stderr: -127> 2024-09-12T00:50:39.954+0000 7faf4ccf8640 10 monclient: get_auth_request con 0x55de54de9170 auth_method 0 2024-09-12T00:50:40.386 INFO:tasks.workunit.client.0.smithi073.stderr: -126> 2024-09-12T00:50:39.955+0000 7faf4fa0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:40.386 INFO:tasks.workunit.client.0.smithi073.stderr: -125> 2024-09-12T00:50:39.955+0000 7faf4fa0f800 20 searching for the correct realm 2024-09-12T00:50:40.386 INFO:tasks.workunit.client.0.smithi073.stderr: -124> 2024-09-12T00:50:39.955+0000 7faf4dcfa640 10 monclient: get_auth_request con 0x55de54dedeb0 auth_method 0 2024-09-12T00:50:40.386 INFO:tasks.workunit.client.0.smithi073.stderr: -123> 2024-09-12T00:50:39.956+0000 7faf4d4f9640 10 monclient: get_auth_request con 0x7faf4807f060 auth_method 0 2024-09-12T00:50:40.386 INFO:tasks.workunit.client.0.smithi073.stderr: -122> 2024-09-12T00:50:39.957+0000 7faf4ccf8640 10 monclient: get_auth_request con 0x7faf40016070 auth_method 0 2024-09-12T00:50:40.387 INFO:tasks.workunit.client.0.smithi073.stderr: -121> 2024-09-12T00:50:39.957+0000 7faf4dcfa640 10 monclient: get_auth_request con 0x7faf3807f1e0 auth_method 0 2024-09-12T00:50:40.387 INFO:tasks.workunit.client.0.smithi073.stderr: -120> 2024-09-12T00:50:39.957+0000 7faf4dcfa640 0 -- 172.21.15.73:0/3481744197 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7faf3807f1e0 msgr2=0x7faf38093680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:40.387 INFO:tasks.workunit.client.0.smithi073.stderr: -119> 2024-09-12T00:50:40.158+0000 7faf4dcfa640 10 monclient: get_auth_request con 0x7faf3807f1e0 auth_method 0 2024-09-12T00:50:40.387 INFO:tasks.workunit.client.0.smithi073.stderr: -118> 2024-09-12T00:50:40.162+0000 7faf4d4f9640 10 monclient: get_auth_request con 0x7faf480a8710 auth_method 0 2024-09-12T00:50:40.387 INFO:tasks.workunit.client.0.smithi073.stderr: -117> 2024-09-12T00:50:40.163+0000 7faf4dcfa640 0 -- 172.21.15.73:0/3481744197 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7faf3807f1e0 msgr2=0x7faf38093680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:40.387 INFO:tasks.workunit.client.0.smithi073.stderr: -116> 2024-09-12T00:50:40.163+0000 7fae1effd640 1 client.6707.objecter ms_handle_reset 0x7faf3807f1e0 session 0x7faf3804ce90 osd.4 2024-09-12T00:50:40.387 INFO:tasks.workunit.client.0.smithi073.stderr: -115> 2024-09-12T00:50:40.163+0000 7fae1effd640 10 monclient: _renew_subs 2024-09-12T00:50:40.387 INFO:tasks.workunit.client.0.smithi073.stderr: -114> 2024-09-12T00:50:40.163+0000 7fae1effd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:50:40.387 INFO:tasks.workunit.client.0.smithi073.stderr: -113> 2024-09-12T00:50:40.164+0000 7faf4dcfa640 10 monclient: get_auth_request con 0x7fae18086340 auth_method 0 2024-09-12T00:50:40.387 INFO:tasks.workunit.client.0.smithi073.stderr: -112> 2024-09-12T00:50:40.167+0000 7faf4fa0f800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:50:40.387 INFO:tasks.workunit.client.0.smithi073.stderr: -111> 2024-09-12T00:50:40.167+0000 7faf4fa0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:40.387 INFO:tasks.workunit.client.0.smithi073.stderr: -110> 2024-09-12T00:50:40.167+0000 7faf4fa0f800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:50:40.387 INFO:tasks.workunit.client.0.smithi073.stderr: -109> 2024-09-12T00:50:40.167+0000 7faf4fa0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:40.388 INFO:tasks.workunit.client.0.smithi073.stderr: -108> 2024-09-12T00:50:40.167+0000 7faf4fa0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:40.388 INFO:tasks.workunit.client.0.smithi073.stderr: -107> 2024-09-12T00:50:40.167+0000 7faf4fa0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:40.388 INFO:tasks.workunit.client.0.smithi073.stderr: -106> 2024-09-12T00:50:40.167+0000 7faf4fa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.388 INFO:tasks.workunit.client.0.smithi073.stderr: -105> 2024-09-12T00:50:40.168+0000 7faf4fa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:40.388 INFO:tasks.workunit.client.0.smithi073.stderr: -104> 2024-09-12T00:50:40.168+0000 7faf4fa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.388 INFO:tasks.workunit.client.0.smithi073.stderr: -103> 2024-09-12T00:50:40.168+0000 7faf4fa0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:40.388 INFO:tasks.workunit.client.0.smithi073.stderr: -102> 2024-09-12T00:50:40.168+0000 7faf4fa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.388 INFO:tasks.workunit.client.0.smithi073.stderr: -101> 2024-09-12T00:50:40.168+0000 7faf4fa0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:40.388 INFO:tasks.workunit.client.0.smithi073.stderr: -100> 2024-09-12T00:50:40.168+0000 7faf4fa0f800 20 zone default found 2024-09-12T00:50:40.388 INFO:tasks.workunit.client.0.smithi073.stderr: -99> 2024-09-12T00:50:40.168+0000 7faf4fa0f800 4 Realm: () 2024-09-12T00:50:40.388 INFO:tasks.workunit.client.0.smithi073.stderr: -98> 2024-09-12T00:50:40.168+0000 7faf4fa0f800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:50:40.388 INFO:tasks.workunit.client.0.smithi073.stderr: -97> 2024-09-12T00:50:40.168+0000 7faf4fa0f800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:50:40.388 INFO:tasks.workunit.client.0.smithi073.stderr: -96> 2024-09-12T00:50:40.168+0000 7faf4fa0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:40.389 INFO:tasks.workunit.client.0.smithi073.stderr: -95> 2024-09-12T00:50:40.168+0000 7faf4fa0f800 20 zonegroup default 2024-09-12T00:50:40.389 INFO:tasks.workunit.client.0.smithi073.stderr: -94> 2024-09-12T00:50:40.168+0000 7faf4fa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.389 INFO:tasks.workunit.client.0.smithi073.stderr: -93> 2024-09-12T00:50:40.168+0000 7faf4fa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:40.389 INFO:tasks.workunit.client.0.smithi073.stderr: -92> 2024-09-12T00:50:40.168+0000 7faf4fa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.389 INFO:tasks.workunit.client.0.smithi073.stderr: -91> 2024-09-12T00:50:40.169+0000 7faf4fa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:40.389 INFO:tasks.workunit.client.0.smithi073.stderr: -90> 2024-09-12T00:50:40.169+0000 7faf4fa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.389 INFO:tasks.workunit.client.0.smithi073.stderr: -89> 2024-09-12T00:50:40.169+0000 7faf4fa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:40.389 INFO:tasks.workunit.client.0.smithi073.stderr: -88> 2024-09-12T00:50:40.169+0000 7faf4fa0f800 20 started sync module instance, tier type = 2024-09-12T00:50:40.389 INFO:tasks.workunit.client.0.smithi073.stderr: -87> 2024-09-12T00:50:40.169+0000 7faf4fa0f800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:50:40.389 INFO:tasks.workunit.client.0.smithi073.stderr: -86> 2024-09-12T00:50:40.180+0000 7faf4fa0f800 20 add_watcher() i=0 2024-09-12T00:50:40.389 INFO:tasks.workunit.client.0.smithi073.stderr: -85> 2024-09-12T00:50:40.180+0000 7faf4fa0f800 20 add_watcher() i=1 2024-09-12T00:50:40.389 INFO:tasks.workunit.client.0.smithi073.stderr: -84> 2024-09-12T00:50:40.180+0000 7faf4fa0f800 20 add_watcher() i=2 2024-09-12T00:50:40.389 INFO:tasks.workunit.client.0.smithi073.stderr: -83> 2024-09-12T00:50:40.180+0000 7faf4fa0f800 20 add_watcher() i=3 2024-09-12T00:50:40.390 INFO:tasks.workunit.client.0.smithi073.stderr: -82> 2024-09-12T00:50:40.180+0000 7faf4fa0f800 20 add_watcher() i=4 2024-09-12T00:50:40.390 INFO:tasks.workunit.client.0.smithi073.stderr: -81> 2024-09-12T00:50:40.180+0000 7faf4fa0f800 20 add_watcher() i=5 2024-09-12T00:50:40.390 INFO:tasks.workunit.client.0.smithi073.stderr: -80> 2024-09-12T00:50:40.180+0000 7faf4fa0f800 20 add_watcher() i=6 2024-09-12T00:50:40.390 INFO:tasks.workunit.client.0.smithi073.stderr: -79> 2024-09-12T00:50:40.181+0000 7faf4fa0f800 20 add_watcher() i=7 2024-09-12T00:50:40.390 INFO:tasks.workunit.client.0.smithi073.stderr: -78> 2024-09-12T00:50:40.181+0000 7faf4fa0f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:40.390 INFO:tasks.workunit.client.0.smithi073.stderr: -77> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f3a050) adding auth protocol: cephx 2024-09-12T00:50:40.390 INFO:tasks.workunit.client.0.smithi073.stderr: -76> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f3a050) adding auth protocol: cephx 2024-09-12T00:50:40.390 INFO:tasks.workunit.client.0.smithi073.stderr: -75> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f3a050) adding auth protocol: cephx 2024-09-12T00:50:40.390 INFO:tasks.workunit.client.0.smithi073.stderr: -74> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f3a050) adding con mode: secure 2024-09-12T00:50:40.390 INFO:tasks.workunit.client.0.smithi073.stderr: -73> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f3a050) adding con mode: crc 2024-09-12T00:50:40.390 INFO:tasks.workunit.client.0.smithi073.stderr: -72> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f3a050) adding con mode: secure 2024-09-12T00:50:40.390 INFO:tasks.workunit.client.0.smithi073.stderr: -71> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f3a050) adding con mode: crc 2024-09-12T00:50:40.390 INFO:tasks.workunit.client.0.smithi073.stderr: -70> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f3a050) adding con mode: secure 2024-09-12T00:50:40.391 INFO:tasks.workunit.client.0.smithi073.stderr: -69> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f3a050) adding con mode: crc 2024-09-12T00:50:40.391 INFO:tasks.workunit.client.0.smithi073.stderr: -68> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f3a050) adding con mode: crc 2024-09-12T00:50:40.391 INFO:tasks.workunit.client.0.smithi073.stderr: -67> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f3a050) adding con mode: secure 2024-09-12T00:50:40.391 INFO:tasks.workunit.client.0.smithi073.stderr: -66> 2024-09-12T00:50:40.183+0000 7fae037e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:40.391 INFO:tasks.workunit.client.0.smithi073.stderr: -65> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f3a050) adding con mode: crc 2024-09-12T00:50:40.391 INFO:tasks.workunit.client.0.smithi073.stderr: -64> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f3a050) adding con mode: secure 2024-09-12T00:50:40.391 INFO:tasks.workunit.client.0.smithi073.stderr: -63> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f3a050) adding con mode: crc 2024-09-12T00:50:40.391 INFO:tasks.workunit.client.0.smithi073.stderr: -62> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 5 AuthRegistry(0x7ffce9f3a050) adding con mode: secure 2024-09-12T00:50:40.391 INFO:tasks.workunit.client.0.smithi073.stderr: -61> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:40.391 INFO:tasks.workunit.client.0.smithi073.stderr: -60> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:40.391 INFO:tasks.workunit.client.0.smithi073.stderr: -59> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:40.391 INFO:tasks.workunit.client.0.smithi073.stderr: -58> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 5 asok(0x55de54ad7630) register_command cache list hook 0x55de54dbe8c0 2024-09-12T00:50:40.391 INFO:tasks.workunit.client.0.smithi073.stderr: -57> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 5 asok(0x55de54ad7630) register_command cache inspect hook 0x55de54dbe8c0 2024-09-12T00:50:40.391 INFO:tasks.workunit.client.0.smithi073.stderr: -56> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 5 asok(0x55de54ad7630) register_command cache erase hook 0x55de54dbe8c0 2024-09-12T00:50:40.392 INFO:tasks.workunit.client.0.smithi073.stderr: -55> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 5 asok(0x55de54ad7630) register_command cache zap hook 0x55de54dbe8c0 2024-09-12T00:50:40.392 INFO:tasks.workunit.client.0.smithi073.stderr: -54> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 5 note: GC not initialized 2024-09-12T00:50:40.392 INFO:tasks.workunit.client.0.smithi073.stderr: -53> 2024-09-12T00:50:40.183+0000 7fae027e4640 20 reqs_thread_entry: start 2024-09-12T00:50:40.392 INFO:tasks.workunit.client.0.smithi073.stderr: -52> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 5 asok(0x55de54ad7630) register_command sync trace show hook 0x7faf38079030 2024-09-12T00:50:40.392 INFO:tasks.workunit.client.0.smithi073.stderr: -51> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 5 asok(0x55de54ad7630) register_command sync trace history hook 0x7faf38079030 2024-09-12T00:50:40.392 INFO:tasks.workunit.client.0.smithi073.stderr: -50> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 5 asok(0x55de54ad7630) register_command sync trace active hook 0x7faf38079030 2024-09-12T00:50:40.392 INFO:tasks.workunit.client.0.smithi073.stderr: -49> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 5 asok(0x55de54ad7630) register_command sync trace active_short hook 0x7faf38079030 2024-09-12T00:50:40.392 INFO:tasks.workunit.client.0.smithi073.stderr: -48> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:40.392 INFO:tasks.workunit.client.0.smithi073.stderr: -47> 2024-09-12T00:50:40.183+0000 7faf4fa0f800 20 Filter name: none 2024-09-12T00:50:40.392 INFO:tasks.workunit.client.0.smithi073.stderr: -46> 2024-09-12T00:50:40.184+0000 7fad73fff640 20 reqs_thread_entry: start 2024-09-12T00:50:40.392 INFO:tasks.workunit.client.0.smithi073.stderr: -45> 2024-09-12T00:50:40.184+0000 7faf4fa0f800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:50:40.392 INFO:tasks.workunit.client.0.smithi073.stderr: -44> 2024-09-12T00:50:40.184+0000 7faf4fa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.393 INFO:tasks.workunit.client.0.smithi073.stderr: -43> 2024-09-12T00:50:40.184+0000 7faf4fa0f800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:50:40.393 INFO:tasks.workunit.client.0.smithi073.stderr: -42> 2024-09-12T00:50:40.184+0000 7faf4fa0f800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:50:40.393 INFO:tasks.workunit.client.0.smithi073.stderr: -41> 2024-09-12T00:50:40.184+0000 7faf4fa0f800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:50:40.393 INFO:tasks.workunit.client.0.smithi073.stderr: -40> 2024-09-12T00:50:40.184+0000 7faf4fa0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 : miss 2024-09-12T00:50:40.393 INFO:tasks.workunit.client.0.smithi073.stderr: -39> 2024-09-12T00:50:40.184+0000 7faf4fa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.393 INFO:tasks.workunit.client.0.smithi073.stderr: -38> 2024-09-12T00:50:40.184+0000 7faf4fa0f800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:50:40.393 INFO:tasks.workunit.client.0.smithi073.stderr: -37> 2024-09-12T00:50:40.184+0000 7faf4fa0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 info.flags=0x17 2024-09-12T00:50:40.393 INFO:tasks.workunit.client.0.smithi073.stderr: -36> 2024-09-12T00:50:40.184+0000 7faf4fa0f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 to cache LRU end 2024-09-12T00:50:40.393 INFO:tasks.workunit.client.0.smithi073.stderr: -35> 2024-09-12T00:50:40.184+0000 7faf4fa0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:40.393 INFO:tasks.workunit.client.0.smithi073.stderr: -34> 2024-09-12T00:50:40.184+0000 7faf4fa0f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:40.393 INFO:tasks.workunit.client.0.smithi073.stderr: -33> 2024-09-12T00:50:40.184+0000 7faf4fa0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 2024-09-12T00:50:40.393 INFO:tasks.workunit.client.0.smithi073.stderr: -32> 2024-09-12T00:50:40.188+0000 7faf4fa0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 info.flags=0x17 2024-09-12T00:50:40.393 INFO:tasks.workunit.client.0.smithi073.stderr: -31> 2024-09-12T00:50:40.188+0000 7faf4fa0f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 to cache LRU end 2024-09-12T00:50:40.394 INFO:tasks.workunit.client.0.smithi073.stderr: -30> 2024-09-12T00:50:40.188+0000 7faf4fa0f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:40.394 INFO:tasks.workunit.client.0.smithi073.stderr: -29> 2024-09-12T00:50:40.188+0000 7faf4fa0f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29, ofs0, ns] 2024-09-12T00:50:40.394 INFO:tasks.workunit.client.0.smithi073.stderr: -28> 2024-09-12T00:50:40.188+0000 7fae30ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497049 cookie 94413395019920 notifier 6707 bl.length()=915 2024-09-12T00:50:40.394 INFO:tasks.workunit.client.0.smithi073.stderr: -27> 2024-09-12T00:50:40.188+0000 7fae30ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 info.flags=0x17 2024-09-12T00:50:40.394 INFO:tasks.workunit.client.0.smithi073.stderr: -26> 2024-09-12T00:50:40.188+0000 7fae30ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 to cache LRU end 2024-09-12T00:50:40.394 INFO:tasks.workunit.client.0.smithi073.stderr: -25> 2024-09-12T00:50:40.188+0000 7fae30ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:40.394 INFO:tasks.workunit.client.0.smithi073.stderr: -24> 2024-09-12T00:50:40.190+0000 7faf4fa0f800 20 handle_bi_update(): bucket=:abort-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29]): orig_sources= new_sources= 2024-09-12T00:50:40.394 INFO:tasks.workunit.client.0.smithi073.stderr: -23> 2024-09-12T00:50:40.190+0000 7faf4fa0f800 20 handle_bi_update(): bucket=:abort-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29]): potential sources added=[] removed=[] 2024-09-12T00:50:40.394 INFO:tasks.workunit.client.0.smithi073.stderr: -22> 2024-09-12T00:50:40.190+0000 7faf4fa0f800 20 handle_bi_update(): bucket=:abort-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29]): orig_dests= new_dests= 2024-09-12T00:50:40.394 INFO:tasks.workunit.client.0.smithi073.stderr: -21> 2024-09-12T00:50:40.190+0000 7faf4fa0f800 20 handle_bi_update(): bucket=:abort-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29]): potential dests added=[] removed=[] 2024-09-12T00:50:40.394 INFO:tasks.workunit.client.0.smithi073.stderr: -20> 2024-09-12T00:50:40.194+0000 7faf4fa0f800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29.1.0 2024-09-12T00:50:40.394 INFO:tasks.workunit.client.0.smithi073.stderr: -19> 2024-09-12T00:50:40.194+0000 7faf4fa0f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29.1.0 2024-09-12T00:50:40.394 INFO:tasks.workunit.client.0.smithi073.stderr: -18> 2024-09-12T00:50:40.194+0000 7faf4fa0f800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29.1.1 2024-09-12T00:50:40.395 INFO:tasks.workunit.client.0.smithi073.stderr: -17> 2024-09-12T00:50:40.194+0000 7faf4fa0f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29.1.1 2024-09-12T00:50:40.395 INFO:tasks.workunit.client.0.smithi073.stderr: -16> 2024-09-12T00:50:40.194+0000 7faf4fa0f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29.0 2024-09-12T00:50:40.395 INFO:tasks.workunit.client.0.smithi073.stderr: -15> 2024-09-12T00:50:40.197+0000 7faf4fa0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:50:40.395 INFO:tasks.workunit.client.0.smithi073.stderr: -14> 2024-09-12T00:50:40.197+0000 7faf4fa0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 2024-09-12T00:50:40.395 INFO:tasks.workunit.client.0.smithi073.stderr: -13> 2024-09-12T00:50:40.198+0000 7faf4fa0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 info.flags=0x17 2024-09-12T00:50:40.395 INFO:tasks.workunit.client.0.smithi073.stderr: -12> 2024-09-12T00:50:40.198+0000 7faf4fa0f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 to cache LRU end 2024-09-12T00:50:40.395 INFO:tasks.workunit.client.0.smithi073.stderr: -11> 2024-09-12T00:50:40.198+0000 7faf4fa0f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:40.395 INFO:tasks.workunit.client.0.smithi073.stderr: -10> 2024-09-12T00:50:40.198+0000 7faf4fa0f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29, ofs0, ns] 2024-09-12T00:50:40.395 INFO:tasks.workunit.client.0.smithi073.stderr: -9> 2024-09-12T00:50:40.198+0000 7fae1ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497050 cookie 94413395019920 notifier 6707 bl.length()=915 2024-09-12T00:50:40.395 INFO:tasks.workunit.client.0.smithi073.stderr: -8> 2024-09-12T00:50:40.198+0000 7fae1ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 info.flags=0x17 2024-09-12T00:50:40.395 INFO:tasks.workunit.client.0.smithi073.stderr: -7> 2024-09-12T00:50:40.198+0000 7fae1ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 to cache LRU end 2024-09-12T00:50:40.395 INFO:tasks.workunit.client.0.smithi073.stderr: -6> 2024-09-12T00:50:40.198+0000 7fae1ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:40.395 INFO:tasks.workunit.client.0.smithi073.stderr: -5> 2024-09-12T00:50:40.200+0000 7faf4fa0f800 20 handle_bi_update(): bucket=:abort-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29]): orig_sources= new_sources= 2024-09-12T00:50:40.396 INFO:tasks.workunit.client.0.smithi073.stderr: -4> 2024-09-12T00:50:40.200+0000 7faf4fa0f800 20 handle_bi_update(): bucket=:abort-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29]): potential sources added=[] removed=[] 2024-09-12T00:50:40.396 INFO:tasks.workunit.client.0.smithi073.stderr: -3> 2024-09-12T00:50:40.200+0000 7faf4fa0f800 20 handle_bi_update(): bucket=:abort-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29]): orig_dests= new_dests= 2024-09-12T00:50:40.396 INFO:tasks.workunit.client.0.smithi073.stderr: -2> 2024-09-12T00:50:40.200+0000 7faf4fa0f800 20 handle_bi_update(): bucket=:abort-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29]): potential dests added=[] removed=[] 2024-09-12T00:50:40.396 INFO:tasks.workunit.client.0.smithi073.stderr: -1> 2024-09-12T00:50:40.200+0000 7faf4fa0f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7faf4fa0f800 time 2024-09-12T00:50:40.200882+0000 2024-09-12T00:50:40.396 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:50:40.396 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:40.396 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:40.396 INFO:tasks.workunit.client.0.smithi073.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7faf52f8c71a] 2024-09-12T00:50:40.396 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7faf52f8c8d8] 2024-09-12T00:50:40.396 INFO:tasks.workunit.client.0.smithi073.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55de52b34641] 2024-09-12T00:50:40.396 INFO:tasks.workunit.client.0.smithi073.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x55de52b43582] 2024-09-12T00:50:40.396 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55de52b443e4] 2024-09-12T00:50:40.397 INFO:tasks.workunit.client.0.smithi073.stderr: 6: main() 2024-09-12T00:50:40.397 INFO:tasks.workunit.client.0.smithi073.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7faf51c29590] 2024-09-12T00:50:40.397 INFO:tasks.workunit.client.0.smithi073.stderr: 8: __libc_start_main() 2024-09-12T00:50:40.397 INFO:tasks.workunit.client.0.smithi073.stderr: 9: _start() 2024-09-12T00:50:40.397 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:40.397 INFO:tasks.workunit.client.0.smithi073.stderr: 0> 2024-09-12T00:50:40.201+0000 7faf4fa0f800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:50:40.397 INFO:tasks.workunit.client.0.smithi073.stderr: in thread 7faf4fa0f800 thread_name:radosgw-admin 2024-09-12T00:50:40.397 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:40.397 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:40.397 INFO:tasks.workunit.client.0.smithi073.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7faf51c3e6f0] 2024-09-12T00:50:40.397 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7faf51c8b99c] 2024-09-12T00:50:40.397 INFO:tasks.workunit.client.0.smithi073.stderr: 3: raise() 2024-09-12T00:50:40.397 INFO:tasks.workunit.client.0.smithi073.stderr: 4: abort() 2024-09-12T00:50:40.398 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7faf52f8c774] 2024-09-12T00:50:40.398 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7faf52f8c8d8] 2024-09-12T00:50:40.398 INFO:tasks.workunit.client.0.smithi073.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55de52b34641] 2024-09-12T00:50:40.398 INFO:tasks.workunit.client.0.smithi073.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x55de52b43582] 2024-09-12T00:50:40.398 INFO:tasks.workunit.client.0.smithi073.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55de52b443e4] 2024-09-12T00:50:40.398 INFO:tasks.workunit.client.0.smithi073.stderr: 10: main() 2024-09-12T00:50:40.398 INFO:tasks.workunit.client.0.smithi073.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7faf51c29590] 2024-09-12T00:50:40.398 INFO:tasks.workunit.client.0.smithi073.stderr: 12: __libc_start_main() 2024-09-12T00:50:40.398 INFO:tasks.workunit.client.0.smithi073.stderr: 13: _start() 2024-09-12T00:50:40.398 INFO:tasks.workunit.client.0.smithi073.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:50:40.398 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:40.398 INFO:tasks.workunit.client.0.smithi073.stderr:--- logging levels --- 2024-09-12T00:50:40.398 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 none 2024-09-12T00:50:40.399 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 lockdep 2024-09-12T00:50:40.399 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 context 2024-09-12T00:50:40.399 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 crush 2024-09-12T00:50:40.399 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds 2024-09-12T00:50:40.399 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_balancer 2024-09-12T00:50:40.399 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_locker 2024-09-12T00:50:40.399 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_log 2024-09-12T00:50:40.399 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_log_expire 2024-09-12T00:50:40.399 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_migrator 2024-09-12T00:50:40.399 INFO:tasks.workunit.client.0.smithi073.stderr: 3/ 5 mds_quiesce 2024-09-12T00:50:40.399 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 buffer 2024-09-12T00:50:40.399 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 timer 2024-09-12T00:50:40.399 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 filer 2024-09-12T00:50:40.400 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 striper 2024-09-12T00:50:40.400 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 objecter 2024-09-12T00:50:40.400 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rados 2024-09-12T00:50:40.400 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd 2024-09-12T00:50:40.400 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_mirror 2024-09-12T00:50:40.400 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_replay 2024-09-12T00:50:40.400 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_pwl 2024-09-12T00:50:40.400 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 journaler 2024-09-12T00:50:40.400 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 objectcacher 2024-09-12T00:50:40.400 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:50:40.400 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 client 2024-09-12T00:50:40.400 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 osd 2024-09-12T00:50:40.400 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 optracker 2024-09-12T00:50:40.401 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 objclass 2024-09-12T00:50:40.401 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 filestore 2024-09-12T00:50:40.401 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 journal 2024-09-12T00:50:40.401 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 0 ms 2024-09-12T00:50:40.401 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mon 2024-09-12T00:50:40.401 INFO:tasks.workunit.client.0.smithi073.stderr: 0/10 monc 2024-09-12T00:50:40.401 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 paxos 2024-09-12T00:50:40.401 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 tp 2024-09-12T00:50:40.401 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 auth 2024-09-12T00:50:40.401 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 crypto 2024-09-12T00:50:40.401 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 finisher 2024-09-12T00:50:40.401 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 reserver 2024-09-12T00:50:40.401 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 heartbeatmap 2024-09-12T00:50:40.402 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 perfcounter 2024-09-12T00:50:40.402 INFO:tasks.workunit.client.0.smithi073.stderr: 20/20 rgw 2024-09-12T00:50:40.402 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_sync 2024-09-12T00:50:40.402 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_datacache 2024-09-12T00:50:40.402 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_access 2024-09-12T00:50:40.402 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:50:40.402 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_flight 2024-09-12T00:50:40.402 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:50:40.402 INFO:tasks.workunit.client.0.smithi073.stderr: 20/20 rgw_notification 2024-09-12T00:50:40.402 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 javaclient 2024-09-12T00:50:40.402 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 asok 2024-09-12T00:50:40.402 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 throttle 2024-09-12T00:50:40.402 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 0 refs 2024-09-12T00:50:40.402 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 compressor 2024-09-12T00:50:40.403 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 bluestore 2024-09-12T00:50:40.403 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 bluefs 2024-09-12T00:50:40.403 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 bdev 2024-09-12T00:50:40.403 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 kstore 2024-09-12T00:50:40.403 INFO:tasks.workunit.client.0.smithi073.stderr: 4/ 5 rocksdb 2024-09-12T00:50:40.403 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 fuse 2024-09-12T00:50:40.403 INFO:tasks.workunit.client.0.smithi073.stderr: 2/ 5 mgr 2024-09-12T00:50:40.403 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mgrc 2024-09-12T00:50:40.403 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 dpdk 2024-09-12T00:50:40.403 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 eventtrace 2024-09-12T00:50:40.403 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 prioritycache 2024-09-12T00:50:40.403 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 test 2024-09-12T00:50:40.403 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:50:40.404 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cephsqlite 2024-09-12T00:50:40.404 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:50:40.404 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore 2024-09-12T00:50:40.404 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_onode 2024-09-12T00:50:40.404 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_odata 2024-09-12T00:50:40.404 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_omap 2024-09-12T00:50:40.404 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_tm 2024-09-12T00:50:40.404 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_t 2024-09-12T00:50:40.404 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:50:40.404 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_epm 2024-09-12T00:50:40.404 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_lba 2024-09-12T00:50:40.404 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:50:40.404 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_cache 2024-09-12T00:50:40.405 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_journal 2024-09-12T00:50:40.405 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_device 2024-09-12T00:50:40.405 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_backref 2024-09-12T00:50:40.405 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 alienstore 2024-09-12T00:50:40.405 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mclock 2024-09-12T00:50:40.405 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cyanstore 2024-09-12T00:50:40.405 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 ceph_exporter 2024-09-12T00:50:40.405 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 memstore 2024-09-12T00:50:40.405 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 trace 2024-09-12T00:50:40.405 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 ceph_dedup 2024-09-12T00:50:40.405 INFO:tasks.workunit.client.0.smithi073.stderr: -2/-2 (syslog threshold) 2024-09-12T00:50:40.405 INFO:tasks.workunit.client.0.smithi073.stderr: 99/99 (stderr threshold) 2024-09-12T00:50:40.405 INFO:tasks.workunit.client.0.smithi073.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:50:40.405 INFO:tasks.workunit.client.0.smithi073.stderr: 7fad73fff640 / http_manager 2024-09-12T00:50:40.406 INFO:tasks.workunit.client.0.smithi073.stderr: 7fae027e4640 / http_manager 2024-09-12T00:50:40.406 INFO:tasks.workunit.client.0.smithi073.stderr: 7fae037e6640 / rgw_dt_lg_renew 2024-09-12T00:50:40.406 INFO:tasks.workunit.client.0.smithi073.stderr: 7fae1effd640 / ms_dispatch 2024-09-12T00:50:40.406 INFO:tasks.workunit.client.0.smithi073.stderr: 7fae1ffff640 / io_context_pool 2024-09-12T00:50:40.406 INFO:tasks.workunit.client.0.smithi073.stderr: 7fae30ff9640 / io_context_pool 2024-09-12T00:50:40.406 INFO:tasks.workunit.client.0.smithi073.stderr: 7fae32ffd640 / ms_dispatch 2024-09-12T00:50:40.406 INFO:tasks.workunit.client.0.smithi073.stderr: 7fae39e03640 / ms_dispatch 2024-09-12T00:50:40.406 INFO:tasks.workunit.client.0.smithi073.stderr: 7fae3b606640 / io_context_pool 2024-09-12T00:50:40.406 INFO:tasks.workunit.client.0.smithi073.stderr: 7faf4ccf8640 / msgr-worker-2 2024-09-12T00:50:40.406 INFO:tasks.workunit.client.0.smithi073.stderr: 7faf4d4f9640 / msgr-worker-1 2024-09-12T00:50:40.406 INFO:tasks.workunit.client.0.smithi073.stderr: 7faf4dcfa640 / msgr-worker-0 2024-09-12T00:50:40.406 INFO:tasks.workunit.client.0.smithi073.stderr: 7faf4e4fb640 / io_context_pool 2024-09-12T00:50:40.407 INFO:tasks.workunit.client.0.smithi073.stderr: 7faf4fa0f800 / radosgw-admin 2024-09-12T00:50:40.407 INFO:tasks.workunit.client.0.smithi073.stderr: max_recent 500 2024-09-12T00:50:40.407 INFO:tasks.workunit.client.0.smithi073.stderr: max_new 1000 2024-09-12T00:50:40.407 INFO:tasks.workunit.client.0.smithi073.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:50:40.202501Z_1578e9b8-862d-4a69-a76c-2569b2256bbc/log 2024-09-12T00:50:40.407 INFO:tasks.workunit.client.0.smithi073.stderr:--- end dump of recent events --- 2024-09-12T00:50:40.407 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T00:50:40.409 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:40.409 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:40.409 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.275+0000 7f348b011800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.409 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.277+0000 7f348b011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:40.409 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.277+0000 7f348b011800 20 realm 2024-09-12T00:50:40.409 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.277+0000 7f348b011800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.409 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.277+0000 7f348b011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:40.409 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.277+0000 7f348b011800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:40.409 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.277+0000 7f348b011800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.409 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.277+0000 7f348b011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:40.409 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.277+0000 7f348b011800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.409 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.278+0000 7f348b011800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:40.410 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.278+0000 7f348b011800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.410 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.279+0000 7f348b011800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:40.410 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.279+0000 7f348b011800 20 searching for the correct realm 2024-09-12T00:50:40.410 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.282+0000 7f3486f93640 0 -- 172.21.15.73:0/3027403241 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f347008eb60 msgr2=0x7f3470078460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:50:40.488 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.489+0000 7f3486f93640 0 -- 172.21.15.73:0/3027403241 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f347008eb60 msgr2=0x7f3470078460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:40.492 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.493+0000 7f348b011800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:50:40.492 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.493+0000 7f348b011800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:40.492 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.493+0000 7f348b011800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:50:40.492 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.493+0000 7f348b011800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:40.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.493+0000 7f348b011800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:40.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.493+0000 7f348b011800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:40.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.493+0000 7f348b011800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.494+0000 7f348b011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:40.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.494+0000 7f348b011800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.494 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.494+0000 7f348b011800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:40.494 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.494+0000 7f348b011800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.494 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.494+0000 7f348b011800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:40.494 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.494+0000 7f348b011800 20 zone default found 2024-09-12T00:50:40.494 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.494+0000 7f348b011800 4 Realm: () 2024-09-12T00:50:40.495 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.494+0000 7f348b011800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:50:40.495 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.494+0000 7f348b011800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:50:40.495 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.494+0000 7f348b011800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:40.495 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.494+0000 7f348b011800 20 zonegroup default 2024-09-12T00:50:40.495 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.494+0000 7f348b011800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.495 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.495+0000 7f348b011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:40.495 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.495+0000 7f348b011800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.495 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.495+0000 7f348b011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:40.495 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.495+0000 7f348b011800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.495 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.495+0000 7f348b011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:40.495 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.495+0000 7f348b011800 20 started sync module instance, tier type = 2024-09-12T00:50:40.495 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.495+0000 7f348b011800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:50:40.504 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.505+0000 7f348b011800 20 add_watcher() i=0 2024-09-12T00:50:40.504 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.505+0000 7f348b011800 20 add_watcher() i=1 2024-09-12T00:50:40.504 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.505+0000 7f348b011800 20 add_watcher() i=2 2024-09-12T00:50:40.504 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.505+0000 7f348b011800 20 add_watcher() i=3 2024-09-12T00:50:40.504 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.505+0000 7f348b011800 20 add_watcher() i=4 2024-09-12T00:50:40.504 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.505+0000 7f348b011800 20 add_watcher() i=5 2024-09-12T00:50:40.504 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.505+0000 7f348b011800 20 add_watcher() i=6 2024-09-12T00:50:40.504 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.506+0000 7f348b011800 20 add_watcher() i=7 2024-09-12T00:50:40.505 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.506+0000 7f348b011800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:40.506 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.507+0000 7f333cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:40.507 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.507+0000 7f348b011800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:40.507 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.507+0000 7f348b011800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:40.507 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.508+0000 7f348b011800 5 note: GC not initialized 2024-09-12T00:50:40.507 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.508+0000 7f32b77fe640 20 reqs_thread_entry: start 2024-09-12T00:50:40.507 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.508+0000 7f348b011800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:40.507 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.508+0000 7f348b011800 20 Filter name: none 2024-09-12T00:50:40.507 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.508+0000 7f32b57fa640 20 reqs_thread_entry: start 2024-09-12T00:50:40.508 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.508+0000 7f348b011800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.508 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.508+0000 7f348b011800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:50:40.508 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.508+0000 7f348b011800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.509 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.509+0000 7f348b011800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:50:40.509 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.509+0000 7f348b011800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:40.509 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.509+0000 7f348b011800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.509 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.509+0000 7f348b011800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:50:40.509 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.509+0000 7f348b011800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.509 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.509+0000 7f348b011800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:50:40.509 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.509+0000 7f348b011800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:40.510 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.511+0000 7f333cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:40.512 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.513+0000 7f348b011800 20 remove_watcher() i=0 2024-09-12T00:50:40.512 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.513+0000 7f348b011800 2 removed watcher, disabling cache 2024-09-12T00:50:40.513 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.514+0000 7f348b011800 20 remove_watcher() i=1 2024-09-12T00:50:40.514 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.516+0000 7f348b011800 20 remove_watcher() i=2 2024-09-12T00:50:40.515 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.517+0000 7f348b011800 20 remove_watcher() i=3 2024-09-12T00:50:40.516 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.518+0000 7f348b011800 20 remove_watcher() i=4 2024-09-12T00:50:40.517 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.518+0000 7f348b011800 20 remove_watcher() i=5 2024-09-12T00:50:40.518 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.519+0000 7f348b011800 20 remove_watcher() i=6 2024-09-12T00:50:40.519 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.520+0000 7f348b011800 20 remove_watcher() i=7 2024-09-12T00:50:40.529 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:40.529 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:50:40.529 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: abort-at-block-writes id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:50:40.529 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:50:40.532 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:40.532 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:40.563 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:40.564 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:50:40.621 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:50:40.652 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:40.652 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:40.689 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.690+0000 7ff63692c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.690 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.691+0000 7ff63692c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:40.690 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.691+0000 7ff63692c800 20 realm 2024-09-12T00:50:40.691 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.691+0000 7ff63692c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.691 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.692+0000 7ff63692c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:40.691 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.692+0000 7ff63692c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:40.691 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.692+0000 7ff63692c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.691 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.692+0000 7ff63692c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:40.691 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.692+0000 7ff63692c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.692 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.693+0000 7ff63692c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:40.692 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.693+0000 7ff63692c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.693 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.694+0000 7ff63692c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:40.693 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.694+0000 7ff63692c800 20 searching for the correct realm 2024-09-12T00:50:40.695 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.697+0000 7ff632d46640 0 -- 172.21.15.73:0/1332534829 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7ff628062040 msgr2=0x7ff6280aba40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:40.903 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.905+0000 7ff632d46640 0 -- 172.21.15.73:0/1332534829 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7ff628062040 msgr2=0x7ff6280aba40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:40.909 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.909+0000 7ff63692c800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:50:40.909 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.909+0000 7ff63692c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:40.909 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.909+0000 7ff63692c800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:50:40.909 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.909+0000 7ff63692c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:40.909 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.909+0000 7ff63692c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:40.909 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.909+0000 7ff63692c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:40.909 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.909+0000 7ff63692c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.909 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.909+0000 7ff63692c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:40.910 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.909+0000 7ff63692c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.910 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.909+0000 7ff63692c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:40.910 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.909+0000 7ff63692c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.910 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.910+0000 7ff63692c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:40.910 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.910+0000 7ff63692c800 20 zone default found 2024-09-12T00:50:40.910 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.910+0000 7ff63692c800 4 Realm: () 2024-09-12T00:50:40.910 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.910+0000 7ff63692c800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:50:40.910 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.910+0000 7ff63692c800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:50:40.910 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.910+0000 7ff63692c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:40.910 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.910+0000 7ff63692c800 20 zonegroup default 2024-09-12T00:50:40.911 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.910+0000 7ff63692c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.911 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.910+0000 7ff63692c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:40.911 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.910+0000 7ff63692c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.911 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.910+0000 7ff63692c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:40.912 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.910+0000 7ff63692c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.912 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.911+0000 7ff63692c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:40.912 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.911+0000 7ff63692c800 20 started sync module instance, tier type = 2024-09-12T00:50:40.912 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.911+0000 7ff63692c800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:50:40.919 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.920+0000 7ff63692c800 20 add_watcher() i=0 2024-09-12T00:50:40.919 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.920+0000 7ff63692c800 20 add_watcher() i=1 2024-09-12T00:50:40.919 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.920+0000 7ff63692c800 20 add_watcher() i=2 2024-09-12T00:50:40.919 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.920+0000 7ff63692c800 20 add_watcher() i=3 2024-09-12T00:50:40.919 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.920+0000 7ff63692c800 20 add_watcher() i=4 2024-09-12T00:50:40.919 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.920+0000 7ff63692c800 20 add_watcher() i=5 2024-09-12T00:50:40.919 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.920+0000 7ff63692c800 20 add_watcher() i=6 2024-09-12T00:50:40.920 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.921+0000 7ff63692c800 20 add_watcher() i=7 2024-09-12T00:50:40.920 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.921+0000 7ff63692c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:40.921 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.922+0000 7ff4e8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:40.923 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.923+0000 7ff63692c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:40.923 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.923+0000 7ff63692c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:40.923 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.923+0000 7ff63692c800 5 note: GC not initialized 2024-09-12T00:50:40.923 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.923+0000 7ff4637fe640 20 reqs_thread_entry: start 2024-09-12T00:50:40.923 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.923+0000 7ff63692c800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:40.923 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.923+0000 7ff63692c800 20 Filter name: none 2024-09-12T00:50:40.923 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.923+0000 7ff4617fa640 20 reqs_thread_entry: start 2024-09-12T00:50:40.923 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.923+0000 7ff63692c800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:50:40.923 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.923+0000 7ff63692c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.924 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.924+0000 7ff63692c800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:50:40.924 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.924+0000 7ff63692c800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:50:40.924 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.924+0000 7ff63692c800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:50:40.924 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.924+0000 7ff63692c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 : miss 2024-09-12T00:50:40.924 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.924+0000 7ff63692c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.924 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.924+0000 7ff63692c800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:50:40.924 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.924+0000 7ff63692c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 info.flags=0x17 2024-09-12T00:50:40.924 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.924+0000 7ff63692c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 to cache LRU end 2024-09-12T00:50:40.924 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.924+0000 7ff63692c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:40.924 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.924+0000 7ff63692c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:40.925 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.924+0000 7ff63692c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 2024-09-12T00:50:40.925 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.925+0000 7ff63692c800 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 to be held by another RGW process; skipping for now 2024-09-12T00:50:40.925 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.926+0000 7ff4e8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:40.927 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.928+0000 7ff63692c800 20 remove_watcher() i=0 2024-09-12T00:50:40.927 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.928+0000 7ff63692c800 2 removed watcher, disabling cache 2024-09-12T00:50:40.928 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.929+0000 7ff63692c800 20 remove_watcher() i=1 2024-09-12T00:50:40.929 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.930+0000 7ff63692c800 20 remove_watcher() i=2 2024-09-12T00:50:40.930 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.931+0000 7ff63692c800 20 remove_watcher() i=3 2024-09-12T00:50:40.931 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.932+0000 7ff63692c800 20 remove_watcher() i=4 2024-09-12T00:50:40.932 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.933+0000 7ff63692c800 20 remove_watcher() i=5 2024-09-12T00:50:40.933 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.934+0000 7ff63692c800 20 remove_watcher() i=6 2024-09-12T00:50:40.934 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:50:40.935+0000 7ff63692c800 20 remove_watcher() i=7 2024-09-12T00:50:40.944 INFO:tasks.workunit.client.0.smithi073.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:51:10.977 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:51:11.013 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:11.013 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:11.055 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.057+0000 7f3eb4f2e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:11.057 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.058+0000 7f3eb4f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:11.057 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.058+0000 7f3eb4f2e800 20 realm 2024-09-12T00:51:11.057 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.058+0000 7f3eb4f2e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:11.058 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.059+0000 7f3eb4f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:11.058 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.059+0000 7f3eb4f2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:11.058 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.059+0000 7f3eb4f2e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:11.058 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.059+0000 7f3eb4f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:11.058 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.059+0000 7f3eb4f2e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:11.059 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.060+0000 7f3eb4f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:11.059 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.060+0000 7f3eb4f2e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:11.059 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.061+0000 7f3eb4f2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:11.059 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.061+0000 7f3eb4f2e800 20 searching for the correct realm 2024-09-12T00:51:11.062 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.063+0000 7f3eb14de640 0 -- 172.21.15.73:0/164011862 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f3ea407b040 msgr2=0x7f3ea407b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:11.269 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.271+0000 7f3eb14de640 0 -- 172.21.15.73:0/164011862 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f3ea407b040 msgr2=0x7f3ea407b420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:11.274 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.275+0000 7f3eb4f2e800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:51:11.274 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.275+0000 7f3eb4f2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:11.274 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.275+0000 7f3eb4f2e800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:51:11.274 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.275+0000 7f3eb4f2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:11.275 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.275+0000 7f3eb4f2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:11.275 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.275+0000 7f3eb4f2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:11.275 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.275+0000 7f3eb4f2e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:11.275 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.275+0000 7f3eb4f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:11.275 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.275+0000 7f3eb4f2e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:11.276 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.276+0000 7f3eb4f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:11.276 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.276+0000 7f3eb4f2e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:11.276 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.276+0000 7f3eb4f2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:11.277 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.276+0000 7f3eb4f2e800 20 zone default found 2024-09-12T00:51:11.277 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.276+0000 7f3eb4f2e800 4 Realm: () 2024-09-12T00:51:11.277 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.276+0000 7f3eb4f2e800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:51:11.277 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.276+0000 7f3eb4f2e800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:51:11.277 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.276+0000 7f3eb4f2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:11.277 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.276+0000 7f3eb4f2e800 20 zonegroup default 2024-09-12T00:51:11.277 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.276+0000 7f3eb4f2e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:11.277 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.277+0000 7f3eb4f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:11.277 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.277+0000 7f3eb4f2e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:11.277 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.277+0000 7f3eb4f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:11.277 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.277+0000 7f3eb4f2e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:11.277 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.277+0000 7f3eb4f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:11.278 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.277+0000 7f3eb4f2e800 20 started sync module instance, tier type = 2024-09-12T00:51:11.278 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.277+0000 7f3eb4f2e800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:51:11.286 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.287+0000 7f3eb4f2e800 20 add_watcher() i=0 2024-09-12T00:51:11.286 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.287+0000 7f3eb4f2e800 20 add_watcher() i=1 2024-09-12T00:51:11.286 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.287+0000 7f3eb4f2e800 20 add_watcher() i=2 2024-09-12T00:51:11.286 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.287+0000 7f3eb4f2e800 20 add_watcher() i=3 2024-09-12T00:51:11.286 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.287+0000 7f3eb4f2e800 20 add_watcher() i=4 2024-09-12T00:51:11.286 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.287+0000 7f3eb4f2e800 20 add_watcher() i=5 2024-09-12T00:51:11.286 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.287+0000 7f3eb4f2e800 20 add_watcher() i=6 2024-09-12T00:51:11.287 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.288+0000 7f3eb4f2e800 20 add_watcher() i=7 2024-09-12T00:51:11.287 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.288+0000 7f3eb4f2e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:11.289 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.290+0000 7f3d677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:11.289 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.290+0000 7f3eb4f2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:11.289 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.290+0000 7f3eb4f2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:11.289 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.290+0000 7f3eb4f2e800 5 note: GC not initialized 2024-09-12T00:51:11.290 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.291+0000 7f3d667e4640 20 reqs_thread_entry: start 2024-09-12T00:51:11.290 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.291+0000 7f3eb4f2e800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:11.290 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.291+0000 7f3eb4f2e800 20 Filter name: none 2024-09-12T00:51:11.290 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.291+0000 7f3d5f7fe640 20 reqs_thread_entry: start 2024-09-12T00:51:11.290 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.291+0000 7f3eb4f2e800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:51:11.291 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.291+0000 7f3eb4f2e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:11.291 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.292+0000 7f3eb4f2e800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:51:11.292 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.292+0000 7f3eb4f2e800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:51:11.292 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.292+0000 7f3eb4f2e800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:51:11.292 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.292+0000 7f3eb4f2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 : miss 2024-09-12T00:51:11.292 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.292+0000 7f3eb4f2e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:11.292 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.292+0000 7f3eb4f2e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:51:11.292 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.292+0000 7f3eb4f2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 info.flags=0x17 2024-09-12T00:51:11.292 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.292+0000 7f3eb4f2e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 to cache LRU end 2024-09-12T00:51:11.292 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.292+0000 7f3eb4f2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:51:11.292 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.292+0000 7f3eb4f2e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:11.292 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.292+0000 7f3eb4f2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 2024-09-12T00:51:11.293 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.294+0000 7f3eb4f2e800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:51:11.297 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.298+0000 7f3eb4f2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 info.flags=0x17 2024-09-12T00:51:11.297 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.298+0000 7f3eb4f2e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 to cache LRU end 2024-09-12T00:51:11.297 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.298+0000 7f3eb4f2e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:11.297 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.298+0000 7f3eb4f2e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29, ofs0, ns] 2024-09-12T00:51:11.297 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.299+0000 7f3d87fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497051 cookie 94858815570672 notifier 6758 bl.length()=915 2024-09-12T00:51:11.297 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.299+0000 7f3d87fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 info.flags=0x17 2024-09-12T00:51:11.298 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.299+0000 7f3d87fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 to cache LRU end 2024-09-12T00:51:11.298 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.299+0000 7f3d87fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:11.299 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.300+0000 7f3eb4f2e800 20 handle_bi_update(): bucket=:abort-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29]): orig_sources= new_sources= 2024-09-12T00:51:11.299 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.300+0000 7f3eb4f2e800 20 handle_bi_update(): bucket=:abort-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29]): potential sources added=[] removed=[] 2024-09-12T00:51:11.299 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.300+0000 7f3eb4f2e800 20 handle_bi_update(): bucket=:abort-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29]): orig_dests= new_dests= 2024-09-12T00:51:11.299 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.300+0000 7f3eb4f2e800 20 handle_bi_update(): bucket=:abort-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29]): potential dests added=[] removed=[] 2024-09-12T00:51:11.303 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.305+0000 7f3eb4f2e800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29.2.0 2024-09-12T00:51:11.303 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.305+0000 7f3eb4f2e800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29.2.0 2024-09-12T00:51:11.304 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.305+0000 7f3eb4f2e800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29.2.1 2024-09-12T00:51:11.304 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.305+0000 7f3eb4f2e800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29.2.1 2024-09-12T00:51:11.304 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.305+0000 7f3eb4f2e800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29.0 2024-09-12T00:51:11.306 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.307+0000 7f3eb4f2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:51:11.306 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.307+0000 7f3eb4f2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 2024-09-12T00:51:11.307 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.309+0000 7f3eb4f2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 info.flags=0x17 2024-09-12T00:51:11.307 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.309+0000 7f3eb4f2e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 to cache LRU end 2024-09-12T00:51:11.308 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.309+0000 7f3eb4f2e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:11.308 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.309+0000 7f3eb4f2e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29, ofs0, ns] 2024-09-12T00:51:11.308 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.309+0000 7f3d877fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497052 cookie 94858815570672 notifier 6758 bl.length()=915 2024-09-12T00:51:11.308 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.309+0000 7f3d877fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 info.flags=0x17 2024-09-12T00:51:11.308 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.309+0000 7f3d877fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 to cache LRU end 2024-09-12T00:51:11.308 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.309+0000 7f3d877fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:11.310 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.311+0000 7f3eb4f2e800 20 handle_bi_update(): bucket=:abort-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29]): orig_sources= new_sources= 2024-09-12T00:51:11.310 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.311+0000 7f3eb4f2e800 20 handle_bi_update(): bucket=:abort-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29]): potential sources added=[] removed=[] 2024-09-12T00:51:11.310 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.311+0000 7f3eb4f2e800 20 handle_bi_update(): bucket=:abort-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29]): orig_dests= new_dests= 2024-09-12T00:51:11.310 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.311+0000 7f3eb4f2e800 20 handle_bi_update(): bucket=:abort-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29]): potential dests added=[] removed=[] 2024-09-12T00:51:11.311 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.312+0000 7f3eb4f2e800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29.0 2024-09-12T00:51:11.311 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.313+0000 7f3eb4f2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:51:11.311 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.313+0000 7f3eb4f2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 2024-09-12T00:51:11.313 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.314+0000 7f3eb4f2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 info.flags=0x17 2024-09-12T00:51:11.313 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.314+0000 7f3eb4f2e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 to cache LRU end 2024-09-12T00:51:11.313 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.314+0000 7f3eb4f2e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:11.313 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.314+0000 7f3eb4f2e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29, ofs0, ns] 2024-09-12T00:51:11.313 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.314+0000 7f3d87fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497053 cookie 94858815570672 notifier 6758 bl.length()=883 2024-09-12T00:51:11.313 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.314+0000 7f3d87fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 info.flags=0x17 2024-09-12T00:51:11.313 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.314+0000 7f3d87fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 to cache LRU end 2024-09-12T00:51:11.313 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.314+0000 7f3d87fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:11.315 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.316+0000 7f3eb4f2e800 20 handle_bi_update(): bucket=:abort-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29]): orig_sources= new_sources= 2024-09-12T00:51:11.315 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.316+0000 7f3eb4f2e800 20 handle_bi_update(): bucket=:abort-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29]): potential sources added=[] removed=[] 2024-09-12T00:51:11.315 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.316+0000 7f3eb4f2e800 20 handle_bi_update(): bucket=:abort-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29]): orig_dests= new_dests= 2024-09-12T00:51:11.315 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.316+0000 7f3eb4f2e800 20 handle_bi_update(): bucket=:abort-at-block-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29]): potential dests added=[] removed=[] 2024-09-12T00:51:11.315 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.317+0000 7f3eb4f2e800 1 execute INFO: reshard of bucket "abort-at-block-writes" from 1 shards to 2 shards completed successfully 2024-09-12T00:51:11.317 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.319+0000 7f3d677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:11.320 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.321+0000 7f3eb4f2e800 20 remove_watcher() i=0 2024-09-12T00:51:11.320 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.321+0000 7f3eb4f2e800 2 removed watcher, disabling cache 2024-09-12T00:51:11.321 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.322+0000 7f3eb4f2e800 20 remove_watcher() i=1 2024-09-12T00:51:11.322 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.323+0000 7f3eb4f2e800 20 remove_watcher() i=2 2024-09-12T00:51:11.323 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.324+0000 7f3eb4f2e800 20 remove_watcher() i=3 2024-09-12T00:51:11.324 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.325+0000 7f3eb4f2e800 20 remove_watcher() i=4 2024-09-12T00:51:11.325 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.326+0000 7f3eb4f2e800 20 remove_watcher() i=5 2024-09-12T00:51:11.326 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.327+0000 7f3eb4f2e800 20 remove_watcher() i=6 2024-09-12T00:51:11.327 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.328+0000 7f3eb4f2e800 20 remove_watcher() i=7 2024-09-12T00:51:11.340 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T00:51:11.369 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:11.369 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:11.405 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.407+0000 7f223a926800 20 rados->read ofs=0 len=0 2024-09-12T00:51:11.408 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.409+0000 7f223a926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:11.408 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.409+0000 7f223a926800 20 realm 2024-09-12T00:51:11.408 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.409+0000 7f223a926800 20 rados->read ofs=0 len=0 2024-09-12T00:51:11.408 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.409+0000 7f223a926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:11.408 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.409+0000 7f223a926800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:11.408 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.409+0000 7f223a926800 20 rados->read ofs=0 len=0 2024-09-12T00:51:11.408 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.409+0000 7f223a926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:11.408 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.409+0000 7f223a926800 20 rados->read ofs=0 len=0 2024-09-12T00:51:11.409 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.410+0000 7f223a926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:11.409 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.410+0000 7f223a926800 20 rados->read ofs=0 len=0 2024-09-12T00:51:11.410 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.411+0000 7f223a926800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:11.410 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.411+0000 7f223a926800 20 searching for the correct realm 2024-09-12T00:51:11.413 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.414+0000 7f222dd5c640 0 -- 172.21.15.73:0/207078512 >> [v2:172.21.15.73:6818/153097326,v1:172.21.15.73:6819/153097326] conn(0x5628f7f40280 msgr2=0x5628f7f42690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:51:11.418 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.419+0000 7f222dd5c640 0 -- 172.21.15.73:0/207078512 >> [v2:172.21.15.73:6818/153097326,v1:172.21.15.73:6819/153097326] conn(0x7f2100086340 msgr2=0x7f2100088770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:11.421 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.422+0000 7f223a926800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:51:11.421 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.422+0000 7f223a926800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:11.421 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.422+0000 7f223a926800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:51:11.421 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.422+0000 7f223a926800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:11.422 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.422+0000 7f223a926800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:11.422 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.422+0000 7f223a926800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:11.422 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.422+0000 7f223a926800 20 rados->read ofs=0 len=0 2024-09-12T00:51:11.422 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.422+0000 7f223a926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:11.422 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.422+0000 7f223a926800 20 rados->read ofs=0 len=0 2024-09-12T00:51:11.422 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.423+0000 7f223a926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:11.422 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.423+0000 7f223a926800 20 rados->read ofs=0 len=0 2024-09-12T00:51:11.423 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.423+0000 7f223a926800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:11.423 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.423+0000 7f223a926800 20 zone default found 2024-09-12T00:51:11.423 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.423+0000 7f223a926800 4 Realm: () 2024-09-12T00:51:11.423 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.423+0000 7f223a926800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:51:11.423 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.423+0000 7f223a926800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:51:11.424 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.423+0000 7f223a926800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:11.424 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.423+0000 7f223a926800 20 zonegroup default 2024-09-12T00:51:11.424 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.423+0000 7f223a926800 20 rados->read ofs=0 len=0 2024-09-12T00:51:11.424 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.423+0000 7f223a926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:11.424 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.423+0000 7f223a926800 20 rados->read ofs=0 len=0 2024-09-12T00:51:11.424 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.424+0000 7f223a926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:11.424 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.424+0000 7f223a926800 20 rados->read ofs=0 len=0 2024-09-12T00:51:11.424 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.424+0000 7f223a926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:11.424 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.424+0000 7f223a926800 20 started sync module instance, tier type = 2024-09-12T00:51:11.425 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.424+0000 7f223a926800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:51:11.431 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.432+0000 7f223a926800 20 add_watcher() i=0 2024-09-12T00:51:11.431 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.432+0000 7f223a926800 20 add_watcher() i=1 2024-09-12T00:51:11.431 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.432+0000 7f223a926800 20 add_watcher() i=2 2024-09-12T00:51:11.432 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.432+0000 7f223a926800 20 add_watcher() i=3 2024-09-12T00:51:11.432 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.432+0000 7f223a926800 20 add_watcher() i=4 2024-09-12T00:51:11.432 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.432+0000 7f223a926800 20 add_watcher() i=5 2024-09-12T00:51:11.432 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.432+0000 7f223a926800 20 add_watcher() i=6 2024-09-12T00:51:11.432 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.433+0000 7f223a926800 20 add_watcher() i=7 2024-09-12T00:51:11.432 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.433+0000 7f223a926800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:11.433 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.435+0000 7f20ecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:11.434 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.435+0000 7f223a926800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:11.435 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.435+0000 7f223a926800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:11.435 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.435+0000 7f223a926800 5 note: GC not initialized 2024-09-12T00:51:11.435 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.435+0000 7f20677fe640 20 reqs_thread_entry: start 2024-09-12T00:51:11.435 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.435+0000 7f223a926800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:11.435 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.435+0000 7f223a926800 20 Filter name: none 2024-09-12T00:51:11.435 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.436+0000 7f20657fa640 20 reqs_thread_entry: start 2024-09-12T00:51:11.435 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.436+0000 7f223a926800 20 rados->read ofs=0 len=0 2024-09-12T00:51:11.435 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.436+0000 7f223a926800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:51:11.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.436+0000 7f223a926800 20 rados->read ofs=0 len=0 2024-09-12T00:51:11.437 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.436+0000 7f223a926800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:51:11.437 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.436+0000 7f223a926800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:11.437 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.436+0000 7f223a926800 20 rados->read ofs=0 len=0 2024-09-12T00:51:11.437 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.437+0000 7f223a926800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:51:11.437 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.437+0000 7f223a926800 20 rados->read ofs=0 len=0 2024-09-12T00:51:11.437 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.437+0000 7f223a926800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:51:11.437 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.437+0000 7f223a926800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:11.437 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.438+0000 7f20ecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:11.439 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.440+0000 7f223a926800 20 remove_watcher() i=0 2024-09-12T00:51:11.439 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.440+0000 7f223a926800 2 removed watcher, disabling cache 2024-09-12T00:51:11.440 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.441+0000 7f223a926800 20 remove_watcher() i=1 2024-09-12T00:51:11.441 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.442+0000 7f223a926800 20 remove_watcher() i=2 2024-09-12T00:51:11.442 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.443+0000 7f223a926800 20 remove_watcher() i=3 2024-09-12T00:51:11.443 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.444+0000 7f223a926800 20 remove_watcher() i=4 2024-09-12T00:51:11.444 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.445+0000 7f223a926800 20 remove_watcher() i=5 2024-09-12T00:51:11.445 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.446+0000 7f223a926800 20 remove_watcher() i=6 2024-09-12T00:51:11.445 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:11.447+0000 7f223a926800 20 remove_watcher() i=7 2024-09-12T00:51:11.456 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:11.456 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:51:11.456 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: abort-at-block-writes id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:51:11.456 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:11.458 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:11.458 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:11.477 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:11.477 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:11.686 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:11.686 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:11.747 INFO:tasks.workunit.client.0.smithi073.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2024-09-12T00:51:11.747 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:11.748 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:11.749 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:11.789 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:11.789 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:11.845 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:11.845 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:11.881 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:11.881 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:11.913 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:11.913 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:11.948 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:11.948 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:11.984 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:11.985 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:12.018 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:12.018 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:12.053 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:12.053 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:12.086 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:12.086 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:12.122 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:12.122 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:12.159 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:12.159 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:12.197 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:12.197 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:12.232 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:12.233 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:12.265 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:12.265 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:12.299 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:12.299 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:12.334 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:12.334 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:12.368 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:12.368 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:12.402 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:12.402 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:12.437 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:12.437 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:12.473 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:12.473 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:12.509 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:12.509 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:12.544 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:51:12.573 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:12.573 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:12.610 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.611+0000 7f404e420800 20 rados->read ofs=0 len=0 2024-09-12T00:51:12.612 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.613+0000 7f404e420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:12.612 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.613+0000 7f404e420800 20 realm 2024-09-12T00:51:12.612 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.613+0000 7f404e420800 20 rados->read ofs=0 len=0 2024-09-12T00:51:12.612 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.613+0000 7f404e420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:12.612 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.613+0000 7f404e420800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:12.613 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.613+0000 7f404e420800 20 rados->read ofs=0 len=0 2024-09-12T00:51:12.613 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.613+0000 7f404e420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:12.613 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.613+0000 7f404e420800 20 rados->read ofs=0 len=0 2024-09-12T00:51:12.614 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.614+0000 7f404e420800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:12.614 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.614+0000 7f404e420800 20 rados->read ofs=0 len=0 2024-09-12T00:51:12.614 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.615+0000 7f404e420800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:12.614 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.615+0000 7f404e420800 20 searching for the correct realm 2024-09-12T00:51:12.616 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.617+0000 7f404c70b640 0 -- 172.21.15.73:0/1174374026 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f404006d070 msgr2=0x7f4040067a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:51:12.822 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.823+0000 7f404c70b640 0 -- 172.21.15.73:0/1174374026 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f404006d070 msgr2=0x7f4040067a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:12.827 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.827+0000 7f404e420800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:51:12.827 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.827+0000 7f404e420800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:12.828 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.827+0000 7f404e420800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:51:12.828 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.827+0000 7f404e420800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:12.828 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.827+0000 7f404e420800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:12.828 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.827+0000 7f404e420800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:12.828 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.827+0000 7f404e420800 20 rados->read ofs=0 len=0 2024-09-12T00:51:12.828 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.827+0000 7f404e420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:12.828 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.827+0000 7f404e420800 20 rados->read ofs=0 len=0 2024-09-12T00:51:12.828 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.828+0000 7f404e420800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:12.828 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.828+0000 7f404e420800 20 rados->read ofs=0 len=0 2024-09-12T00:51:12.828 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.828+0000 7f404e420800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:12.830 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.828+0000 7f404e420800 20 zone default found 2024-09-12T00:51:12.830 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.828+0000 7f404e420800 4 Realm: () 2024-09-12T00:51:12.830 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.828+0000 7f404e420800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:51:12.830 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.828+0000 7f404e420800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:51:12.830 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.828+0000 7f404e420800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:12.830 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.828+0000 7f404e420800 20 zonegroup default 2024-09-12T00:51:12.830 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.828+0000 7f404e420800 20 rados->read ofs=0 len=0 2024-09-12T00:51:12.830 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.828+0000 7f404e420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:12.830 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.828+0000 7f404e420800 20 rados->read ofs=0 len=0 2024-09-12T00:51:12.831 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.829+0000 7f404e420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:12.831 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.829+0000 7f404e420800 20 rados->read ofs=0 len=0 2024-09-12T00:51:12.831 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.829+0000 7f404e420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:12.831 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.829+0000 7f404e420800 20 started sync module instance, tier type = 2024-09-12T00:51:12.831 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.829+0000 7f404e420800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:51:12.837 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.838+0000 7f404e420800 20 add_watcher() i=0 2024-09-12T00:51:12.837 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.838+0000 7f404e420800 20 add_watcher() i=1 2024-09-12T00:51:12.837 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.838+0000 7f404e420800 20 add_watcher() i=2 2024-09-12T00:51:12.837 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.838+0000 7f404e420800 20 add_watcher() i=3 2024-09-12T00:51:12.837 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.838+0000 7f404e420800 20 add_watcher() i=4 2024-09-12T00:51:12.837 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.838+0000 7f404e420800 20 add_watcher() i=5 2024-09-12T00:51:12.837 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.838+0000 7f404e420800 20 add_watcher() i=6 2024-09-12T00:51:12.838 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.839+0000 7f404e420800 20 add_watcher() i=7 2024-09-12T00:51:12.838 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.839+0000 7f404e420800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:12.840 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.841+0000 7f3f01fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:12.840 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.841+0000 7f404e420800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:12.841 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.841+0000 7f404e420800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:12.841 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.841+0000 7f404e420800 5 note: GC not initialized 2024-09-12T00:51:12.841 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.841+0000 7f3f00fe1640 20 reqs_thread_entry: start 2024-09-12T00:51:12.841 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.841+0000 7f404e420800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:12.841 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.841+0000 7f404e420800 20 Filter name: none 2024-09-12T00:51:12.841 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.842+0000 7f3e7a7fc640 20 reqs_thread_entry: start 2024-09-12T00:51:12.841 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.842+0000 7f404e420800 20 rados->read ofs=0 len=0 2024-09-12T00:51:12.842 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.842+0000 7f404e420800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:51:12.842 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.842+0000 7f404e420800 20 rados->read ofs=0 len=0 2024-09-12T00:51:12.842 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.843+0000 7f404e420800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:51:12.842 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.843+0000 7f404e420800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:12.842 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.843+0000 7f404e420800 20 rados->read ofs=0 len=0 2024-09-12T00:51:12.843 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.843+0000 7f404e420800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:51:12.843 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.843+0000 7f404e420800 20 rados->read ofs=0 len=0 2024-09-12T00:51:12.843 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.844+0000 7f404e420800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:51:12.843 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.844+0000 7f404e420800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:12.844 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.845+0000 7f3f01fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:12.846 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.847+0000 7f404e420800 20 remove_watcher() i=0 2024-09-12T00:51:12.846 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.847+0000 7f404e420800 2 removed watcher, disabling cache 2024-09-12T00:51:12.848 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.849+0000 7f404e420800 20 remove_watcher() i=1 2024-09-12T00:51:12.849 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.850+0000 7f404e420800 20 remove_watcher() i=2 2024-09-12T00:51:12.850 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.851+0000 7f404e420800 20 remove_watcher() i=3 2024-09-12T00:51:12.851 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.852+0000 7f404e420800 20 remove_watcher() i=4 2024-09-12T00:51:12.852 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.853+0000 7f404e420800 20 remove_watcher() i=5 2024-09-12T00:51:12.853 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.854+0000 7f404e420800 20 remove_watcher() i=6 2024-09-12T00:51:12.854 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:12.855+0000 7f404e420800 20 remove_watcher() i=7 2024-09-12T00:51:12.864 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:12.864 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:51:12.864 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: error-at-commit-target-layout id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:51:12.864 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:12.866 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2024-09-12T00:51:12.900 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:12.900 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:13.137 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.138+0000 7f0c7b472640 0 --2- 172.21.15.73:0/3923577860 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560b377d0000 0x560b377e26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T00:51:13.139 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.141+0000 7f0c87f2b800 20 rados->read ofs=0 len=0 2024-09-12T00:51:13.141 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.142+0000 7f0c87f2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:13.141 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.142+0000 7f0c87f2b800 20 realm 2024-09-12T00:51:13.141 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.142+0000 7f0c87f2b800 20 rados->read ofs=0 len=0 2024-09-12T00:51:13.141 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.142+0000 7f0c87f2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:13.142 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.142+0000 7f0c87f2b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:13.142 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.142+0000 7f0c87f2b800 20 rados->read ofs=0 len=0 2024-09-12T00:51:13.142 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.142+0000 7f0c87f2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:13.142 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.142+0000 7f0c87f2b800 20 rados->read ofs=0 len=0 2024-09-12T00:51:13.142 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.143+0000 7f0c87f2b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:13.142 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.143+0000 7f0c87f2b800 20 rados->read ofs=0 len=0 2024-09-12T00:51:13.143 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.144+0000 7f0c87f2b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:13.143 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.144+0000 7f0c87f2b800 20 searching for the correct realm 2024-09-12T00:51:13.144 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.146+0000 7f0c7b472640 0 -- 172.21.15.73:0/3923577860 >> [v2:172.21.15.73:6826/269690776,v1:172.21.15.73:6827/269690776] conn(0x7f0c740b4be0 msgr2=0x7f0c740b33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:13.351 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.352+0000 7f0c83c73640 0 -- 172.21.15.73:0/3923577860 >> [v2:172.21.15.73:6810/1807760270,v1:172.21.15.73:6811/1807760270] conn(0x7f0c7c043040 msgr2=0x7f0c7c014430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:13.557 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.559+0000 7f0c87f2b800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:51:13.558 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.559+0000 7f0c87f2b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:13.558 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.559+0000 7f0c87f2b800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:51:13.558 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.559+0000 7f0c87f2b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:13.558 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.559+0000 7f0c87f2b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:13.558 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.559+0000 7f0c87f2b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:13.558 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.559+0000 7f0c87f2b800 20 rados->read ofs=0 len=0 2024-09-12T00:51:13.558 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.559+0000 7f0c87f2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:13.558 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.559+0000 7f0c87f2b800 20 rados->read ofs=0 len=0 2024-09-12T00:51:13.560 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.559+0000 7f0c87f2b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:13.560 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.559+0000 7f0c87f2b800 20 rados->read ofs=0 len=0 2024-09-12T00:51:13.560 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.560+0000 7f0c87f2b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:13.560 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.560+0000 7f0c87f2b800 20 zone default found 2024-09-12T00:51:13.560 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.560+0000 7f0c87f2b800 4 Realm: () 2024-09-12T00:51:13.560 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.560+0000 7f0c87f2b800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:51:13.560 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.560+0000 7f0c87f2b800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:51:13.561 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.560+0000 7f0c87f2b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:13.561 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.560+0000 7f0c87f2b800 20 zonegroup default 2024-09-12T00:51:13.561 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.560+0000 7f0c87f2b800 20 rados->read ofs=0 len=0 2024-09-12T00:51:13.561 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.560+0000 7f0c87f2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:13.561 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.560+0000 7f0c87f2b800 20 rados->read ofs=0 len=0 2024-09-12T00:51:13.561 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.560+0000 7f0c87f2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:13.561 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.560+0000 7f0c87f2b800 20 rados->read ofs=0 len=0 2024-09-12T00:51:13.561 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.560+0000 7f0c87f2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:13.561 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.560+0000 7f0c87f2b800 20 started sync module instance, tier type = 2024-09-12T00:51:13.561 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.560+0000 7f0c87f2b800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:51:13.569 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.570+0000 7f0c87f2b800 20 add_watcher() i=0 2024-09-12T00:51:13.569 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.570+0000 7f0c87f2b800 20 add_watcher() i=1 2024-09-12T00:51:13.569 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.570+0000 7f0c87f2b800 20 add_watcher() i=2 2024-09-12T00:51:13.569 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.570+0000 7f0c87f2b800 20 add_watcher() i=3 2024-09-12T00:51:13.569 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.570+0000 7f0c87f2b800 20 add_watcher() i=4 2024-09-12T00:51:13.569 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.570+0000 7f0c87f2b800 20 add_watcher() i=5 2024-09-12T00:51:13.569 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.570+0000 7f0c87f2b800 20 add_watcher() i=6 2024-09-12T00:51:13.570 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.571+0000 7f0c87f2b800 20 add_watcher() i=7 2024-09-12T00:51:13.570 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.571+0000 7f0c87f2b800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:13.572 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.573+0000 7f0b39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:13.572 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.573+0000 7f0c87f2b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:13.572 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.573+0000 7f0c87f2b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:13.572 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.573+0000 7f0c87f2b800 5 note: GC not initialized 2024-09-12T00:51:13.573 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.573+0000 7f0b38fe1640 20 reqs_thread_entry: start 2024-09-12T00:51:13.573 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.573+0000 7f0c87f2b800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:13.574 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.574+0000 7f0c87f2b800 20 Filter name: none 2024-09-12T00:51:13.574 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.574+0000 7f0ab27fc640 20 reqs_thread_entry: start 2024-09-12T00:51:13.574 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.574+0000 7f0c87f2b800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T00:51:13.574 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.574+0000 7f0c87f2b800 20 rados->read ofs=0 len=0 2024-09-12T00:51:13.574 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.574+0000 7f0c87f2b800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:51:13.574 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.574+0000 7f0c87f2b800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T00:51:13.576 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.574+0000 7f0c87f2b800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T00:51:13.576 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.574+0000 7f0c87f2b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30 : miss 2024-09-12T00:51:13.576 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.574+0000 7f0c87f2b800 20 rados->read ofs=0 len=0 2024-09-12T00:51:13.576 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.575+0000 7f0c87f2b800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:51:13.576 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.575+0000 7f0c87f2b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30 info.flags=0x17 2024-09-12T00:51:13.576 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.575+0000 7f0c87f2b800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30 to cache LRU end 2024-09-12T00:51:13.577 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.575+0000 7f0c87f2b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:51:13.577 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.575+0000 7f0c87f2b800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:13.577 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.575+0000 7f0c87f2b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30 2024-09-12T00:51:13.577 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.578+0000 7f0c87f2b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30 info.flags=0x17 2024-09-12T00:51:13.577 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.578+0000 7f0c87f2b800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30 to cache LRU end 2024-09-12T00:51:13.578 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.578+0000 7f0c87f2b800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:13.578 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.578+0000 7f0c87f2b800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30, ofs0, ns] 2024-09-12T00:51:13.578 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.579+0000 7f0b62ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496999 cookie 94606175754128 notifier 7215 bl.length()=931 2024-09-12T00:51:13.578 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.579+0000 7f0b62ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30 info.flags=0x17 2024-09-12T00:51:13.578 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.579+0000 7f0b62ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30 to cache LRU end 2024-09-12T00:51:13.578 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.579+0000 7f0b62ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:13.579 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.580+0000 7f0c87f2b800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30]): orig_sources= new_sources= 2024-09-12T00:51:13.579 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.580+0000 7f0c87f2b800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30]): potential sources added=[] removed=[] 2024-09-12T00:51:13.579 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.580+0000 7f0c87f2b800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30]): orig_dests= new_dests= 2024-09-12T00:51:13.579 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.580+0000 7f0c87f2b800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30]): potential dests added=[] removed=[] 2024-09-12T00:51:13.581 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.582+0000 7f0c87f2b800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30.1.0 2024-09-12T00:51:13.582 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.582+0000 7f0c87f2b800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30.1.0 2024-09-12T00:51:13.582 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.582+0000 7f0c87f2b800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30.1.1 2024-09-12T00:51:13.582 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.582+0000 7f0c87f2b800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30.1.1 2024-09-12T00:51:13.582 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.582+0000 7f0c87f2b800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30.0 2024-09-12T00:51:13.584 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.585+0000 7f0c87f2b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30 : hit (requested=0x17, cached=0x17) 2024-09-12T00:51:13.584 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.585+0000 7f0c87f2b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30 2024-09-12T00:51:13.586 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.587+0000 7f0c87f2b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30 info.flags=0x17 2024-09-12T00:51:13.586 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.587+0000 7f0c87f2b800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30 to cache LRU end 2024-09-12T00:51:13.586 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.587+0000 7f0c87f2b800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:13.586 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.587+0000 7f0c87f2b800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30, ofs0, ns] 2024-09-12T00:51:13.586 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.587+0000 7f0b627fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497000 cookie 94606175754128 notifier 7215 bl.length()=931 2024-09-12T00:51:13.586 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.587+0000 7f0b627fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30 info.flags=0x17 2024-09-12T00:51:13.586 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.587+0000 7f0b627fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30 to cache LRU end 2024-09-12T00:51:13.586 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.587+0000 7f0b627fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:13.587 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.588+0000 7f0c87f2b800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30]): orig_sources= new_sources= 2024-09-12T00:51:13.587 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.588+0000 7f0c87f2b800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30]): potential sources added=[] removed=[] 2024-09-12T00:51:13.587 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.588+0000 7f0c87f2b800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30]): orig_dests= new_dests= 2024-09-12T00:51:13.587 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.588+0000 7f0c87f2b800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30]): potential dests added=[] removed=[] 2024-09-12T00:51:13.589 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.589+0000 7f0c87f2b800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30.0 2024-09-12T00:51:13.589 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.590+0000 7f0c87f2b800 -1 Injecting error=-5 at location=commit_target_layout 2024-09-12T00:51:13.589 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.590+0000 7f0c87f2b800 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2024-09-12T00:51:13.591 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.592+0000 7f0b39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:13.593 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.595+0000 7f0c87f2b800 20 remove_watcher() i=0 2024-09-12T00:51:13.593 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.595+0000 7f0c87f2b800 2 removed watcher, disabling cache 2024-09-12T00:51:13.594 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.596+0000 7f0c87f2b800 20 remove_watcher() i=1 2024-09-12T00:51:13.595 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.597+0000 7f0c87f2b800 20 remove_watcher() i=2 2024-09-12T00:51:13.596 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.598+0000 7f0c87f2b800 20 remove_watcher() i=3 2024-09-12T00:51:13.597 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.599+0000 7f0c87f2b800 20 remove_watcher() i=4 2024-09-12T00:51:13.598 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.600+0000 7f0c87f2b800 20 remove_watcher() i=5 2024-09-12T00:51:13.599 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.601+0000 7f0c87f2b800 20 remove_watcher() i=6 2024-09-12T00:51:13.600 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.602+0000 7f0c87f2b800 20 remove_watcher() i=7 2024-09-12T00:51:13.612 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:51:13.640 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:13.640 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:13.677 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.678+0000 7f4af9213800 20 rados->read ofs=0 len=0 2024-09-12T00:51:13.678 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.679+0000 7f4af9213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:13.678 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.679+0000 7f4af9213800 20 realm 2024-09-12T00:51:13.679 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.679+0000 7f4af9213800 20 rados->read ofs=0 len=0 2024-09-12T00:51:13.679 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.680+0000 7f4af9213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:13.679 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.680+0000 7f4af9213800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:13.679 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.680+0000 7f4af9213800 20 rados->read ofs=0 len=0 2024-09-12T00:51:13.679 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.680+0000 7f4af9213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:13.679 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.680+0000 7f4af9213800 20 rados->read ofs=0 len=0 2024-09-12T00:51:13.679 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.681+0000 7f4af9213800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:13.680 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.681+0000 7f4af9213800 20 rados->read ofs=0 len=0 2024-09-12T00:51:13.680 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.682+0000 7f4af9213800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:13.681 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.682+0000 7f4af9213800 20 searching for the correct realm 2024-09-12T00:51:13.683 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.685+0000 7f4af5149640 0 -- 172.21.15.73:0/441714535 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f4adc030070 msgr2=0x7f4adc067b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:13.687 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.688+0000 7f4aec147640 0 -- 172.21.15.73:0/441714535 >> [v2:172.21.15.117:6800/110688882,v1:172.21.15.117:6801/110688882] conn(0x556c7c3a83b0 msgr2=0x556c7c3aa7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:51:13.691 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.692+0000 7f4af9213800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:51:13.692 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.692+0000 7f4af9213800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:13.692 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.692+0000 7f4af9213800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:51:13.692 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.692+0000 7f4af9213800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:13.692 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.692+0000 7f4af9213800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:13.692 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.692+0000 7f4af9213800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:13.692 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.692+0000 7f4af9213800 20 rados->read ofs=0 len=0 2024-09-12T00:51:13.692 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.693+0000 7f4af9213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:13.692 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.693+0000 7f4af9213800 20 rados->read ofs=0 len=0 2024-09-12T00:51:13.692 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.693+0000 7f4af9213800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:13.692 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.693+0000 7f4af9213800 20 rados->read ofs=0 len=0 2024-09-12T00:51:13.693 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.693+0000 7f4af9213800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:13.693 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.693+0000 7f4af9213800 20 zone default found 2024-09-12T00:51:13.694 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.693+0000 7f4af9213800 4 Realm: () 2024-09-12T00:51:13.694 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.693+0000 7f4af9213800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:51:13.694 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.693+0000 7f4af9213800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:51:13.694 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.693+0000 7f4af9213800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:13.694 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.693+0000 7f4af9213800 20 zonegroup default 2024-09-12T00:51:13.694 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.693+0000 7f4af9213800 20 rados->read ofs=0 len=0 2024-09-12T00:51:13.694 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.693+0000 7f4af9213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:13.694 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.694+0000 7f4af9213800 20 rados->read ofs=0 len=0 2024-09-12T00:51:13.694 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.694+0000 7f4af9213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:13.694 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.694+0000 7f4af9213800 20 rados->read ofs=0 len=0 2024-09-12T00:51:13.694 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.694+0000 7f4af9213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:13.694 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.694+0000 7f4af9213800 20 started sync module instance, tier type = 2024-09-12T00:51:13.695 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.694+0000 7f4af9213800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:51:13.702 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.703+0000 7f4af9213800 20 add_watcher() i=0 2024-09-12T00:51:13.702 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.703+0000 7f4af9213800 20 add_watcher() i=1 2024-09-12T00:51:13.702 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.703+0000 7f4af9213800 20 add_watcher() i=2 2024-09-12T00:51:13.702 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.703+0000 7f4af9213800 20 add_watcher() i=3 2024-09-12T00:51:13.703 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.703+0000 7f4af9213800 20 add_watcher() i=4 2024-09-12T00:51:13.703 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.703+0000 7f4af9213800 20 add_watcher() i=5 2024-09-12T00:51:13.703 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.703+0000 7f4af9213800 20 add_watcher() i=6 2024-09-12T00:51:13.703 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.704+0000 7f4af9213800 20 add_watcher() i=7 2024-09-12T00:51:13.703 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.704+0000 7f4af9213800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:13.704 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.706+0000 7f49aafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:13.705 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.706+0000 7f4af9213800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:13.705 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.706+0000 7f4af9213800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:13.706 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.706+0000 7f4af9213800 5 note: GC not initialized 2024-09-12T00:51:13.706 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.706+0000 7f49a9fe3640 20 reqs_thread_entry: start 2024-09-12T00:51:13.706 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.706+0000 7f4af9213800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:13.706 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.706+0000 7f4af9213800 20 Filter name: none 2024-09-12T00:51:13.706 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.707+0000 7f491b7fe640 20 reqs_thread_entry: start 2024-09-12T00:51:13.706 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.707+0000 7f4af9213800 20 rados->read ofs=0 len=0 2024-09-12T00:51:13.707 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.707+0000 7f4af9213800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:51:13.707 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.707+0000 7f4af9213800 20 rados->read ofs=0 len=0 2024-09-12T00:51:13.707 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.708+0000 7f4af9213800 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:51:13.707 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.708+0000 7f4af9213800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:13.707 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.708+0000 7f4af9213800 20 rados->read ofs=0 len=0 2024-09-12T00:51:13.707 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.708+0000 7f4af9213800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:51:13.707 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.708+0000 7f4af9213800 20 rados->read ofs=0 len=0 2024-09-12T00:51:13.708 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.709+0000 7f4af9213800 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:51:13.708 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.709+0000 7f4af9213800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:13.708 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.710+0000 7f49aafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:13.711 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.712+0000 7f4af9213800 20 remove_watcher() i=0 2024-09-12T00:51:13.711 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.712+0000 7f4af9213800 2 removed watcher, disabling cache 2024-09-12T00:51:13.712 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.713+0000 7f4af9213800 20 remove_watcher() i=1 2024-09-12T00:51:13.713 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.714+0000 7f4af9213800 20 remove_watcher() i=2 2024-09-12T00:51:13.714 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.715+0000 7f4af9213800 20 remove_watcher() i=3 2024-09-12T00:51:13.715 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.716+0000 7f4af9213800 20 remove_watcher() i=4 2024-09-12T00:51:13.716 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.717+0000 7f4af9213800 20 remove_watcher() i=5 2024-09-12T00:51:13.717 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.718+0000 7f4af9213800 20 remove_watcher() i=6 2024-09-12T00:51:13.718 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.719+0000 7f4af9213800 20 remove_watcher() i=7 2024-09-12T00:51:13.728 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:13.728 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:51:13.728 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: error-at-commit-target-layout id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:51:13.728 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:13.730 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:13.730 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:13.762 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:13.762 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:13.819 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:51:13.849 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:13.849 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:13.885 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.887+0000 7fc49c326800 20 rados->read ofs=0 len=0 2024-09-12T00:51:13.887 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.888+0000 7fc49c326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:13.887 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.888+0000 7fc49c326800 20 realm 2024-09-12T00:51:13.888 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.888+0000 7fc49c326800 20 rados->read ofs=0 len=0 2024-09-12T00:51:13.888 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.888+0000 7fc49c326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:13.888 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.888+0000 7fc49c326800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:13.888 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.888+0000 7fc49c326800 20 rados->read ofs=0 len=0 2024-09-12T00:51:13.888 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.888+0000 7fc49c326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:13.888 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.888+0000 7fc49c326800 20 rados->read ofs=0 len=0 2024-09-12T00:51:13.889 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.889+0000 7fc49c326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:13.889 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.889+0000 7fc49c326800 20 rados->read ofs=0 len=0 2024-09-12T00:51:13.889 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.890+0000 7fc49c326800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:13.889 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.890+0000 7fc49c326800 20 searching for the correct realm 2024-09-12T00:51:13.891 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:13.893+0000 7fc49875e640 0 -- 172.21.15.73:0/1138685722 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fc480077410 msgr2=0x7fc480077890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:14.098 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.100+0000 7fc49875e640 0 -- 172.21.15.73:0/1138685722 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fc480077410 msgr2=0x7fc480077890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:14.102 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.104+0000 7fc49c326800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:51:14.103 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.104+0000 7fc49c326800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:14.103 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.104+0000 7fc49c326800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:51:14.103 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.104+0000 7fc49c326800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:14.103 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.104+0000 7fc49c326800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:14.103 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.104+0000 7fc49c326800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:14.103 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.104+0000 7fc49c326800 20 rados->read ofs=0 len=0 2024-09-12T00:51:14.103 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.104+0000 7fc49c326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:14.103 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.104+0000 7fc49c326800 20 rados->read ofs=0 len=0 2024-09-12T00:51:14.105 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.104+0000 7fc49c326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:14.105 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.104+0000 7fc49c326800 20 rados->read ofs=0 len=0 2024-09-12T00:51:14.105 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.105+0000 7fc49c326800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:14.105 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.105+0000 7fc49c326800 20 zone default found 2024-09-12T00:51:14.105 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.105+0000 7fc49c326800 4 Realm: () 2024-09-12T00:51:14.105 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.105+0000 7fc49c326800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:51:14.105 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.105+0000 7fc49c326800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:51:14.105 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.105+0000 7fc49c326800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:14.105 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.105+0000 7fc49c326800 20 zonegroup default 2024-09-12T00:51:14.105 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.105+0000 7fc49c326800 20 rados->read ofs=0 len=0 2024-09-12T00:51:14.105 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.105+0000 7fc49c326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:14.106 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.105+0000 7fc49c326800 20 rados->read ofs=0 len=0 2024-09-12T00:51:14.106 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.105+0000 7fc49c326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:14.106 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.105+0000 7fc49c326800 20 rados->read ofs=0 len=0 2024-09-12T00:51:14.106 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.106+0000 7fc49c326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:14.106 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.106+0000 7fc49c326800 20 started sync module instance, tier type = 2024-09-12T00:51:14.106 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.106+0000 7fc49c326800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:51:14.114 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.115+0000 7fc49c326800 20 add_watcher() i=0 2024-09-12T00:51:14.114 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.115+0000 7fc49c326800 20 add_watcher() i=1 2024-09-12T00:51:14.114 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.115+0000 7fc49c326800 20 add_watcher() i=2 2024-09-12T00:51:14.114 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.115+0000 7fc49c326800 20 add_watcher() i=3 2024-09-12T00:51:14.114 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.115+0000 7fc49c326800 20 add_watcher() i=4 2024-09-12T00:51:14.114 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.115+0000 7fc49c326800 20 add_watcher() i=5 2024-09-12T00:51:14.114 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.115+0000 7fc49c326800 20 add_watcher() i=6 2024-09-12T00:51:14.115 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.116+0000 7fc49c326800 20 add_watcher() i=7 2024-09-12T00:51:14.115 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.116+0000 7fc49c326800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:14.117 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.118+0000 7fc34dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:14.118 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.118+0000 7fc49c326800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:14.119 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.118+0000 7fc49c326800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:14.119 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.118+0000 7fc49c326800 5 note: GC not initialized 2024-09-12T00:51:14.119 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.119+0000 7fc34cfe1640 20 reqs_thread_entry: start 2024-09-12T00:51:14.119 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.119+0000 7fc49c326800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:14.119 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.119+0000 7fc49c326800 20 Filter name: none 2024-09-12T00:51:14.119 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.119+0000 7fc2c67fc640 20 reqs_thread_entry: start 2024-09-12T00:51:14.119 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.119+0000 7fc49c326800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T00:51:14.119 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.119+0000 7fc49c326800 20 rados->read ofs=0 len=0 2024-09-12T00:51:14.119 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.119+0000 7fc49c326800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:51:14.120 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.119+0000 7fc49c326800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T00:51:14.120 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.119+0000 7fc49c326800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T00:51:14.120 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.119+0000 7fc49c326800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30 : miss 2024-09-12T00:51:14.120 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.119+0000 7fc49c326800 20 rados->read ofs=0 len=0 2024-09-12T00:51:14.120 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.120+0000 7fc49c326800 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:51:14.120 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.120+0000 7fc49c326800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30 info.flags=0x17 2024-09-12T00:51:14.120 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.120+0000 7fc49c326800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30 to cache LRU end 2024-09-12T00:51:14.120 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.120+0000 7fc49c326800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:51:14.120 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.120+0000 7fc49c326800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:14.120 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.120+0000 7fc49c326800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30 2024-09-12T00:51:14.121 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.121+0000 7fc49c326800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:51:14.124 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.125+0000 7fc49c326800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30 info.flags=0x17 2024-09-12T00:51:14.124 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.125+0000 7fc49c326800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30 to cache LRU end 2024-09-12T00:51:14.124 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.125+0000 7fc49c326800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:14.124 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.125+0000 7fc49c326800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30, ofs0, ns] 2024-09-12T00:51:14.124 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.125+0000 7fc376ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497001 cookie 94395197143408 notifier 7257 bl.length()=931 2024-09-12T00:51:14.124 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.125+0000 7fc376ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30 info.flags=0x17 2024-09-12T00:51:14.124 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.125+0000 7fc376ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30 to cache LRU end 2024-09-12T00:51:14.124 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.125+0000 7fc376ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:14.125 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.127+0000 7fc49c326800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30]): orig_sources= new_sources= 2024-09-12T00:51:14.125 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.127+0000 7fc49c326800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30]): potential sources added=[] removed=[] 2024-09-12T00:51:14.125 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.127+0000 7fc49c326800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30]): orig_dests= new_dests= 2024-09-12T00:51:14.126 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.127+0000 7fc49c326800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30]): potential dests added=[] removed=[] 2024-09-12T00:51:14.128 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.129+0000 7fc49c326800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30.2.0 2024-09-12T00:51:14.128 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.129+0000 7fc49c326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30.2.0 2024-09-12T00:51:14.128 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.129+0000 7fc49c326800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30.2.1 2024-09-12T00:51:14.128 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.129+0000 7fc49c326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30.2.1 2024-09-12T00:51:14.128 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.129+0000 7fc49c326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30.0 2024-09-12T00:51:14.130 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.131+0000 7fc49c326800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30 : hit (requested=0x17, cached=0x17) 2024-09-12T00:51:14.130 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.131+0000 7fc49c326800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30 2024-09-12T00:51:14.132 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.133+0000 7fc49c326800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30 info.flags=0x17 2024-09-12T00:51:14.132 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.133+0000 7fc49c326800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30 to cache LRU end 2024-09-12T00:51:14.132 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.133+0000 7fc49c326800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:14.132 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.133+0000 7fc49c326800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30, ofs0, ns] 2024-09-12T00:51:14.132 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.133+0000 7fc376ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497002 cookie 94395197143408 notifier 7257 bl.length()=931 2024-09-12T00:51:14.132 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.133+0000 7fc376ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30 info.flags=0x17 2024-09-12T00:51:14.132 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.133+0000 7fc376ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30 to cache LRU end 2024-09-12T00:51:14.132 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.133+0000 7fc376ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:14.133 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.134+0000 7fc49c326800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30]): orig_sources= new_sources= 2024-09-12T00:51:14.133 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.134+0000 7fc49c326800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30]): potential sources added=[] removed=[] 2024-09-12T00:51:14.133 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.134+0000 7fc49c326800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30]): orig_dests= new_dests= 2024-09-12T00:51:14.133 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.134+0000 7fc49c326800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30]): potential dests added=[] removed=[] 2024-09-12T00:51:14.134 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.135+0000 7fc49c326800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30.0 2024-09-12T00:51:14.134 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.136+0000 7fc49c326800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30 : hit (requested=0x17, cached=0x17) 2024-09-12T00:51:14.135 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.136+0000 7fc49c326800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30 2024-09-12T00:51:14.136 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.137+0000 7fc49c326800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30 info.flags=0x17 2024-09-12T00:51:14.136 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.137+0000 7fc49c326800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30 to cache LRU end 2024-09-12T00:51:14.137 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.137+0000 7fc49c326800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:14.137 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.137+0000 7fc49c326800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30, ofs0, ns] 2024-09-12T00:51:14.137 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.138+0000 7fc3767fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497003 cookie 94395197143408 notifier 7257 bl.length()=899 2024-09-12T00:51:14.137 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.138+0000 7fc3767fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30 info.flags=0x17 2024-09-12T00:51:14.137 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.138+0000 7fc3767fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30 to cache LRU end 2024-09-12T00:51:14.137 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.138+0000 7fc3767fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:14.137 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.139+0000 7fc49c326800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30]): orig_sources= new_sources= 2024-09-12T00:51:14.138 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.139+0000 7fc49c326800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30]): potential sources added=[] removed=[] 2024-09-12T00:51:14.138 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.139+0000 7fc49c326800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30]): orig_dests= new_dests= 2024-09-12T00:51:14.138 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.139+0000 7fc49c326800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30]): potential dests added=[] removed=[] 2024-09-12T00:51:14.138 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.140+0000 7fc49c326800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T00:51:14.140 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.142+0000 7fc34dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:14.143 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.144+0000 7fc49c326800 20 remove_watcher() i=0 2024-09-12T00:51:14.143 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.144+0000 7fc49c326800 2 removed watcher, disabling cache 2024-09-12T00:51:14.144 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.145+0000 7fc49c326800 20 remove_watcher() i=1 2024-09-12T00:51:14.145 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.146+0000 7fc49c326800 20 remove_watcher() i=2 2024-09-12T00:51:14.146 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.147+0000 7fc49c326800 20 remove_watcher() i=3 2024-09-12T00:51:14.147 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.149+0000 7fc49c326800 20 remove_watcher() i=4 2024-09-12T00:51:14.148 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.149+0000 7fc49c326800 20 remove_watcher() i=5 2024-09-12T00:51:14.149 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.150+0000 7fc49c326800 20 remove_watcher() i=6 2024-09-12T00:51:14.150 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.151+0000 7fc49c326800 20 remove_watcher() i=7 2024-09-12T00:51:14.162 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:51:14.192 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:14.192 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:14.226 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.228+0000 7f5ff0735800 20 rados->read ofs=0 len=0 2024-09-12T00:51:14.229 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.229+0000 7f5ff0735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:14.229 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.229+0000 7f5ff0735800 20 realm 2024-09-12T00:51:14.229 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.229+0000 7f5ff0735800 20 rados->read ofs=0 len=0 2024-09-12T00:51:14.229 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.230+0000 7f5ff0735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:14.229 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.230+0000 7f5ff0735800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:14.229 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.230+0000 7f5ff0735800 20 rados->read ofs=0 len=0 2024-09-12T00:51:14.229 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.230+0000 7f5ff0735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:14.229 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.230+0000 7f5ff0735800 20 rados->read ofs=0 len=0 2024-09-12T00:51:14.230 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.231+0000 7f5ff0735800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:14.230 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.231+0000 7f5ff0735800 20 rados->read ofs=0 len=0 2024-09-12T00:51:14.230 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.232+0000 7f5ff0735800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:14.230 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.232+0000 7f5ff0735800 20 searching for the correct realm 2024-09-12T00:51:14.233 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.234+0000 7f5fecce5640 0 -- 172.21.15.73:0/2160839434 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f5fe0056a00 msgr2=0x7f5fe00a59a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:14.237 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.239+0000 7f5fecce5640 0 -- 172.21.15.73:0/2160839434 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f5eb40863a0 msgr2=0x7f5eb40887d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:14.242 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.242+0000 7f5ff0735800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:51:14.242 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.242+0000 7f5ff0735800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:14.242 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.242+0000 7f5ff0735800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:51:14.242 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.242+0000 7f5ff0735800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:14.242 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.242+0000 7f5ff0735800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:14.243 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.242+0000 7f5ff0735800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:14.243 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.242+0000 7f5ff0735800 20 rados->read ofs=0 len=0 2024-09-12T00:51:14.243 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.243+0000 7f5ff0735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:14.243 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.243+0000 7f5ff0735800 20 rados->read ofs=0 len=0 2024-09-12T00:51:14.243 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.243+0000 7f5ff0735800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:14.243 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.243+0000 7f5ff0735800 20 rados->read ofs=0 len=0 2024-09-12T00:51:14.243 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.243+0000 7f5ff0735800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:14.243 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.243+0000 7f5ff0735800 20 zone default found 2024-09-12T00:51:14.243 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.243+0000 7f5ff0735800 4 Realm: () 2024-09-12T00:51:14.243 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.243+0000 7f5ff0735800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:51:14.243 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.243+0000 7f5ff0735800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:51:14.243 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.243+0000 7f5ff0735800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:14.243 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.243+0000 7f5ff0735800 20 zonegroup default 2024-09-12T00:51:14.243 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.243+0000 7f5ff0735800 20 rados->read ofs=0 len=0 2024-09-12T00:51:14.244 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.243+0000 7f5ff0735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:14.244 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.243+0000 7f5ff0735800 20 rados->read ofs=0 len=0 2024-09-12T00:51:14.245 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.244+0000 7f5ff0735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:14.245 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.244+0000 7f5ff0735800 20 rados->read ofs=0 len=0 2024-09-12T00:51:14.245 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.244+0000 7f5ff0735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:14.245 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.244+0000 7f5ff0735800 20 started sync module instance, tier type = 2024-09-12T00:51:14.245 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.244+0000 7f5ff0735800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:51:14.251 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.252+0000 7f5ff0735800 20 add_watcher() i=0 2024-09-12T00:51:14.251 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.252+0000 7f5ff0735800 20 add_watcher() i=1 2024-09-12T00:51:14.251 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.252+0000 7f5ff0735800 20 add_watcher() i=2 2024-09-12T00:51:14.251 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.252+0000 7f5ff0735800 20 add_watcher() i=3 2024-09-12T00:51:14.251 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.252+0000 7f5ff0735800 20 add_watcher() i=4 2024-09-12T00:51:14.252 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.252+0000 7f5ff0735800 20 add_watcher() i=5 2024-09-12T00:51:14.252 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.252+0000 7f5ff0735800 20 add_watcher() i=6 2024-09-12T00:51:14.252 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.253+0000 7f5ff0735800 20 add_watcher() i=7 2024-09-12T00:51:14.252 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.253+0000 7f5ff0735800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:14.254 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.255+0000 7f5ea2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:14.254 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.255+0000 7f5ff0735800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:14.255 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.255+0000 7f5ff0735800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:14.255 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.255+0000 7f5ff0735800 5 note: GC not initialized 2024-09-12T00:51:14.255 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.255+0000 7f5ea1fdb640 20 reqs_thread_entry: start 2024-09-12T00:51:14.255 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.255+0000 7f5ff0735800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:14.255 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.256+0000 7f5ff0735800 20 Filter name: none 2024-09-12T00:51:14.255 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.256+0000 7f5e137fe640 20 reqs_thread_entry: start 2024-09-12T00:51:14.255 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.256+0000 7f5ff0735800 20 rados->read ofs=0 len=0 2024-09-12T00:51:14.256 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.256+0000 7f5ff0735800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:51:14.256 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.256+0000 7f5ff0735800 20 rados->read ofs=0 len=0 2024-09-12T00:51:14.256 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.257+0000 7f5ff0735800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:51:14.256 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.257+0000 7f5ff0735800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:14.256 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.257+0000 7f5ff0735800 20 rados->read ofs=0 len=0 2024-09-12T00:51:14.256 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.257+0000 7f5ff0735800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:51:14.257 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.257+0000 7f5ff0735800 20 rados->read ofs=0 len=0 2024-09-12T00:51:14.257 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.258+0000 7f5ff0735800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:51:14.257 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.258+0000 7f5ff0735800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:14.257 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.259+0000 7f5ea2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:14.260 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.261+0000 7f5ff0735800 20 remove_watcher() i=0 2024-09-12T00:51:14.260 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.261+0000 7f5ff0735800 2 removed watcher, disabling cache 2024-09-12T00:51:14.261 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.262+0000 7f5ff0735800 20 remove_watcher() i=1 2024-09-12T00:51:14.262 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.264+0000 7f5ff0735800 20 remove_watcher() i=2 2024-09-12T00:51:14.263 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.265+0000 7f5ff0735800 20 remove_watcher() i=3 2024-09-12T00:51:14.265 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.266+0000 7f5ff0735800 20 remove_watcher() i=4 2024-09-12T00:51:14.265 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.267+0000 7f5ff0735800 20 remove_watcher() i=5 2024-09-12T00:51:14.266 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.268+0000 7f5ff0735800 20 remove_watcher() i=6 2024-09-12T00:51:14.267 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:14.269+0000 7f5ff0735800 20 remove_watcher() i=7 2024-09-12T00:51:14.278 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:14.278 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:51:14.278 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: error-at-commit-target-layout id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:51:14.278 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:14.280 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:14.280 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:14.301 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:14.301 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:14.508 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:14.509 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:14.570 INFO:tasks.workunit.client.0.smithi073.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2024-09-12T00:51:14.570 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:14.571 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:14.571 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:14.612 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:14.612 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:14.668 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:14.668 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:14.705 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:14.705 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:14.739 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:14.739 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:14.772 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:14.772 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:14.807 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:14.807 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:14.843 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:14.843 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:14.877 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:14.877 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:14.911 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:14.911 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:14.946 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:14.946 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:14.981 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:14.981 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:15.015 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:15.016 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:15.050 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:15.050 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:15.084 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:15.084 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:15.119 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:15.119 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:15.154 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:15.155 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:15.189 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:15.189 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:15.225 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:15.225 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:15.259 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:15.259 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:15.294 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:15.295 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:15.329 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:15.329 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:15.365 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:51:15.393 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:15.393 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:15.429 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.431+0000 7fd023975800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.432 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.432+0000 7fd023975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:15.432 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.432+0000 7fd023975800 20 realm 2024-09-12T00:51:15.432 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.432+0000 7fd023975800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.432 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.433+0000 7fd023975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:15.432 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.433+0000 7fd023975800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:15.432 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.433+0000 7fd023975800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.432 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.433+0000 7fd023975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:15.432 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.433+0000 7fd023975800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.433 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.434+0000 7fd023975800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:15.433 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.434+0000 7fd023975800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.433 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.434+0000 7fd023975800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:15.433 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.434+0000 7fd023975800 20 searching for the correct realm 2024-09-12T00:51:15.434 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.435+0000 7fd02145f640 0 -- 172.21.15.73:0/2599215776 >> [v2:172.21.15.117:6816/1460498570,v1:172.21.15.117:6817/1460498570] conn(0x7fd010003b20 msgr2=0x7fd01c00f940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:15.639 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.640+0000 7fd01bfff640 0 -- 172.21.15.73:0/2599215776 >> [v2:172.21.15.73:6826/269690776,v1:172.21.15.73:6827/269690776] conn(0x7fd014065c20 msgr2=0x7fd01406e490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:15.646 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.646+0000 7fd023975800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:51:15.646 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.646+0000 7fd023975800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:15.646 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.646+0000 7fd023975800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:51:15.646 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.646+0000 7fd023975800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:15.646 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.646+0000 7fd023975800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:15.646 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.646+0000 7fd023975800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:15.646 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.646+0000 7fd023975800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.646 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.647+0000 7fd023975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:15.646 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.647+0000 7fd023975800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.646 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.647+0000 7fd023975800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:15.646 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.647+0000 7fd023975800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.647 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.647+0000 7fd023975800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:15.648 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.647+0000 7fd023975800 20 zone default found 2024-09-12T00:51:15.648 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.647+0000 7fd023975800 4 Realm: () 2024-09-12T00:51:15.648 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.647+0000 7fd023975800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:51:15.648 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.647+0000 7fd023975800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:51:15.648 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.647+0000 7fd023975800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:15.648 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.647+0000 7fd023975800 20 zonegroup default 2024-09-12T00:51:15.648 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.647+0000 7fd023975800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.648 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.648+0000 7fd023975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:15.648 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.648+0000 7fd023975800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.648 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.648+0000 7fd023975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:15.648 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.648+0000 7fd023975800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.648 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.648+0000 7fd023975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:15.649 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.648+0000 7fd023975800 20 started sync module instance, tier type = 2024-09-12T00:51:15.649 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.648+0000 7fd023975800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:51:15.655 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.657+0000 7fd023975800 20 add_watcher() i=0 2024-09-12T00:51:15.655 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.657+0000 7fd023975800 20 add_watcher() i=1 2024-09-12T00:51:15.656 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.657+0000 7fd023975800 20 add_watcher() i=2 2024-09-12T00:51:15.656 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.657+0000 7fd023975800 20 add_watcher() i=3 2024-09-12T00:51:15.656 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.657+0000 7fd023975800 20 add_watcher() i=4 2024-09-12T00:51:15.656 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.657+0000 7fd023975800 20 add_watcher() i=5 2024-09-12T00:51:15.656 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.657+0000 7fd023975800 20 add_watcher() i=6 2024-09-12T00:51:15.656 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.658+0000 7fd023975800 20 add_watcher() i=7 2024-09-12T00:51:15.656 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.658+0000 7fd023975800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:15.659 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.659+0000 7fced7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:15.659 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.659+0000 7fd023975800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:15.659 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.659+0000 7fd023975800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:15.659 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.660+0000 7fd023975800 5 note: GC not initialized 2024-09-12T00:51:15.659 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.660+0000 7fced6fe5640 20 reqs_thread_entry: start 2024-09-12T00:51:15.659 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.660+0000 7fd023975800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:15.659 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.660+0000 7fd023975800 20 Filter name: none 2024-09-12T00:51:15.659 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.660+0000 7fced4fe1640 20 reqs_thread_entry: start 2024-09-12T00:51:15.659 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.660+0000 7fd023975800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.661 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.661+0000 7fd023975800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:51:15.661 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.661+0000 7fd023975800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.661 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.661+0000 7fd023975800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:51:15.661 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.661+0000 7fd023975800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:15.661 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.661+0000 7fd023975800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.661 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.662+0000 7fd023975800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:51:15.661 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.662+0000 7fd023975800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.661 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.662+0000 7fd023975800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:51:15.661 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.662+0000 7fd023975800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:15.662 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.663+0000 7fced7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:15.664 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.665+0000 7fd023975800 20 remove_watcher() i=0 2024-09-12T00:51:15.664 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.665+0000 7fd023975800 2 removed watcher, disabling cache 2024-09-12T00:51:15.665 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.666+0000 7fd023975800 20 remove_watcher() i=1 2024-09-12T00:51:15.666 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.667+0000 7fd023975800 20 remove_watcher() i=2 2024-09-12T00:51:15.667 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.668+0000 7fd023975800 20 remove_watcher() i=3 2024-09-12T00:51:15.668 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.669+0000 7fd023975800 20 remove_watcher() i=4 2024-09-12T00:51:15.669 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.670+0000 7fd023975800 20 remove_watcher() i=5 2024-09-12T00:51:15.670 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.671+0000 7fd023975800 20 remove_watcher() i=6 2024-09-12T00:51:15.671 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.672+0000 7fd023975800 20 remove_watcher() i=7 2024-09-12T00:51:15.681 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:15.681 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:51:15.681 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: error-at-commit-target-layout id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:51:15.681 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:15.682 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2024-09-12T00:51:15.718 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:15.718 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:15.756 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.757+0000 7fdc6ee98800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.758 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.758+0000 7fdc6ee98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:15.758 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.758+0000 7fdc6ee98800 20 realm 2024-09-12T00:51:15.758 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.758+0000 7fdc6ee98800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.758 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.759+0000 7fdc6ee98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:15.758 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.759+0000 7fdc6ee98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:15.758 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.759+0000 7fdc6ee98800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.758 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.759+0000 7fdc6ee98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:15.758 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.759+0000 7fdc6ee98800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.759 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.760+0000 7fdc6ee98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:15.759 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.760+0000 7fdc6ee98800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.759 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.760+0000 7fdc6ee98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:15.759 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.761+0000 7fdc6ee98800 20 searching for the correct realm 2024-09-12T00:51:15.760 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.761+0000 7fdc6c982640 0 -- 172.21.15.73:0/3244352525 >> [v2:172.21.15.117:6816/1460498570,v1:172.21.15.117:6817/1460498570] conn(0x7fdc68064070 msgr2=0x7fdc68067450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:51:15.965 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.966+0000 7fdc64181640 0 -- 172.21.15.73:0/3244352525 >> [v2:172.21.15.73:6826/269690776,v1:172.21.15.73:6827/269690776] conn(0x7fdc5c01bad0 msgr2=0x7fdc5c062850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:15.971 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.972+0000 7fdc6ee98800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:51:15.971 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.972+0000 7fdc6ee98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:15.971 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.972+0000 7fdc6ee98800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:51:15.971 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.972+0000 7fdc6ee98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:15.972 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.972+0000 7fdc6ee98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:15.972 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.972+0000 7fdc6ee98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:15.972 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.972+0000 7fdc6ee98800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.972 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.972+0000 7fdc6ee98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:15.972 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.972+0000 7fdc6ee98800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.973 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.973+0000 7fdc6ee98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:15.973 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.973+0000 7fdc6ee98800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.973 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.973+0000 7fdc6ee98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:15.974 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.973+0000 7fdc6ee98800 20 zone default found 2024-09-12T00:51:15.974 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.973+0000 7fdc6ee98800 4 Realm: () 2024-09-12T00:51:15.974 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.973+0000 7fdc6ee98800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:51:15.974 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.973+0000 7fdc6ee98800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:51:15.974 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.973+0000 7fdc6ee98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:15.974 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.973+0000 7fdc6ee98800 20 zonegroup default 2024-09-12T00:51:15.974 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.973+0000 7fdc6ee98800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.974 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.973+0000 7fdc6ee98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:15.974 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.973+0000 7fdc6ee98800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.974 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.974+0000 7fdc6ee98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:15.974 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.974+0000 7fdc6ee98800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.974 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.974+0000 7fdc6ee98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:15.975 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.974+0000 7fdc6ee98800 20 started sync module instance, tier type = 2024-09-12T00:51:15.975 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.974+0000 7fdc6ee98800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:51:15.981 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.983+0000 7fdc6ee98800 20 add_watcher() i=0 2024-09-12T00:51:15.982 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.983+0000 7fdc6ee98800 20 add_watcher() i=1 2024-09-12T00:51:15.982 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.983+0000 7fdc6ee98800 20 add_watcher() i=2 2024-09-12T00:51:15.982 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.983+0000 7fdc6ee98800 20 add_watcher() i=3 2024-09-12T00:51:15.982 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.983+0000 7fdc6ee98800 20 add_watcher() i=4 2024-09-12T00:51:15.982 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.983+0000 7fdc6ee98800 20 add_watcher() i=5 2024-09-12T00:51:15.982 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.983+0000 7fdc6ee98800 20 add_watcher() i=6 2024-09-12T00:51:15.982 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.984+0000 7fdc6ee98800 20 add_watcher() i=7 2024-09-12T00:51:15.983 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.984+0000 7fdc6ee98800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:15.985 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.985+0000 7fdb237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:15.985 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.985+0000 7fdc6ee98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:15.985 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.985+0000 7fdc6ee98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:15.985 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.986+0000 7fdc6ee98800 5 note: GC not initialized 2024-09-12T00:51:15.985 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.986+0000 7fdb227e4640 20 reqs_thread_entry: start 2024-09-12T00:51:15.986 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.986+0000 7fdc6ee98800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:15.986 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.986+0000 7fdc6ee98800 20 Filter name: none 2024-09-12T00:51:15.986 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.986+0000 7fdb1bfff640 20 reqs_thread_entry: start 2024-09-12T00:51:15.986 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.986+0000 7fdc6ee98800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T00:51:15.986 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.986+0000 7fdc6ee98800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.987 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.987+0000 7fdc6ee98800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:51:15.987 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.987+0000 7fdc6ee98800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T00:51:15.987 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.987+0000 7fdc6ee98800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T00:51:15.988 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.987+0000 7fdc6ee98800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31 : miss 2024-09-12T00:51:15.988 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.987+0000 7fdc6ee98800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.988 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.987+0000 7fdc6ee98800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:51:15.988 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.987+0000 7fdc6ee98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31 info.flags=0x17 2024-09-12T00:51:15.988 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.987+0000 7fdc6ee98800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31 to cache LRU end 2024-09-12T00:51:15.988 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.987+0000 7fdc6ee98800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:51:15.988 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.987+0000 7fdc6ee98800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:15.988 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.987+0000 7fdc6ee98800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31 2024-09-12T00:51:15.990 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.991+0000 7fdc6ee98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31 info.flags=0x17 2024-09-12T00:51:15.990 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.991+0000 7fdc6ee98800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31 to cache LRU end 2024-09-12T00:51:15.990 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.991+0000 7fdc6ee98800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:15.990 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.991+0000 7fdc6ee98800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31, ofs0, ns] 2024-09-12T00:51:15.990 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.991+0000 7fdb43fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497006 cookie 94155996267392 notifier 7311 bl.length()=931 2024-09-12T00:51:15.991 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.991+0000 7fdb43fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31 info.flags=0x17 2024-09-12T00:51:15.991 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.991+0000 7fdb43fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31 to cache LRU end 2024-09-12T00:51:15.991 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.991+0000 7fdb43fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:15.991 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.993+0000 7fdc6ee98800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31]): orig_sources= new_sources= 2024-09-12T00:51:15.991 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.993+0000 7fdc6ee98800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31]): potential sources added=[] removed=[] 2024-09-12T00:51:15.991 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.993+0000 7fdc6ee98800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31]): orig_dests= new_dests= 2024-09-12T00:51:15.992 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.993+0000 7fdc6ee98800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31]): potential dests added=[] removed=[] 2024-09-12T00:51:15.994 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.995+0000 7fdc6ee98800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31.1.0 2024-09-12T00:51:15.994 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.995+0000 7fdc6ee98800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31.1.0 2024-09-12T00:51:15.994 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.995+0000 7fdc6ee98800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31.1.1 2024-09-12T00:51:15.994 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.995+0000 7fdc6ee98800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31.1.1 2024-09-12T00:51:15.994 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.995+0000 7fdc6ee98800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31.0 2024-09-12T00:51:15.996 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.997+0000 7fdc6ee98800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31 : hit (requested=0x17, cached=0x17) 2024-09-12T00:51:15.996 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.997+0000 7fdc6ee98800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31 2024-09-12T00:51:15.997 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.998+0000 7fdc6ee98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31 info.flags=0x17 2024-09-12T00:51:15.997 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.998+0000 7fdc6ee98800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31 to cache LRU end 2024-09-12T00:51:15.997 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.998+0000 7fdc6ee98800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:15.997 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.998+0000 7fdc6ee98800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31, ofs0, ns] 2024-09-12T00:51:15.998 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.999+0000 7fdb43fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497007 cookie 94155996267392 notifier 7311 bl.length()=931 2024-09-12T00:51:15.998 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.999+0000 7fdb43fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31 info.flags=0x17 2024-09-12T00:51:15.998 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.999+0000 7fdb43fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31 to cache LRU end 2024-09-12T00:51:15.998 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:15.999+0000 7fdb43fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:15.999 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.000+0000 7fdc6ee98800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31]): orig_sources= new_sources= 2024-09-12T00:51:15.999 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.000+0000 7fdc6ee98800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31]): potential sources added=[] removed=[] 2024-09-12T00:51:15.999 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.000+0000 7fdc6ee98800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31]): orig_dests= new_dests= 2024-09-12T00:51:15.999 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.000+0000 7fdc6ee98800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31]): potential dests added=[] removed=[] 2024-09-12T00:51:16.000 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.001+0000 7fdc6ee98800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31.0 2024-09-12T00:51:16.000 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.002+0000 7fdc6ee98800 -1 Injecting error=-125 at location=commit_target_layout 2024-09-12T00:51:16.001 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.002+0000 7fdc6ee98800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31 : hit (requested=0x17, cached=0x17) 2024-09-12T00:51:16.001 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.002+0000 7fdc6ee98800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31 2024-09-12T00:51:16.002 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.003+0000 7fdc6ee98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31 info.flags=0x17 2024-09-12T00:51:16.002 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.003+0000 7fdc6ee98800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31 to cache LRU end 2024-09-12T00:51:16.002 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.003+0000 7fdc6ee98800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:16.002 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.003+0000 7fdc6ee98800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31, ofs0, ns] 2024-09-12T00:51:16.002 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.003+0000 7fdb437fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497008 cookie 94155996267392 notifier 7311 bl.length()=899 2024-09-12T00:51:16.002 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.003+0000 7fdb437fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31 info.flags=0x17 2024-09-12T00:51:16.002 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.003+0000 7fdb437fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31 to cache LRU end 2024-09-12T00:51:16.002 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.003+0000 7fdb437fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:16.003 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.004+0000 7fdc6ee98800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31]): orig_sources= new_sources= 2024-09-12T00:51:16.003 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.004+0000 7fdc6ee98800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31]): potential sources added=[] removed=[] 2024-09-12T00:51:16.003 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.004+0000 7fdc6ee98800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31]): orig_dests= new_dests= 2024-09-12T00:51:16.003 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.004+0000 7fdc6ee98800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31]): potential dests added=[] removed=[] 2024-09-12T00:51:16.004 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.005+0000 7fdc6ee98800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T00:51:16.006 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.007+0000 7fdb237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:16.008 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.010+0000 7fdc6ee98800 20 remove_watcher() i=0 2024-09-12T00:51:16.008 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.010+0000 7fdc6ee98800 2 removed watcher, disabling cache 2024-09-12T00:51:16.009 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.010+0000 7fdc6ee98800 20 remove_watcher() i=1 2024-09-12T00:51:16.010 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.011+0000 7fdc6ee98800 20 remove_watcher() i=2 2024-09-12T00:51:16.011 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.012+0000 7fdc6ee98800 20 remove_watcher() i=3 2024-09-12T00:51:16.012 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.013+0000 7fdc6ee98800 20 remove_watcher() i=4 2024-09-12T00:51:16.013 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.014+0000 7fdc6ee98800 20 remove_watcher() i=5 2024-09-12T00:51:16.014 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.015+0000 7fdc6ee98800 20 remove_watcher() i=6 2024-09-12T00:51:16.015 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.016+0000 7fdc6ee98800 20 remove_watcher() i=7 2024-09-12T00:51:16.027 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:51:16.055 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:16.055 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:16.091 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.093+0000 7f5591040800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.093 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.094+0000 7f5591040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:16.094 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.094+0000 7f5591040800 20 realm 2024-09-12T00:51:16.094 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.094+0000 7f5591040800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.094 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.095+0000 7f5591040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:16.094 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.095+0000 7f5591040800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:16.094 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.095+0000 7f5591040800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.094 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.095+0000 7f5591040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:16.094 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.095+0000 7f5591040800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.094 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.096+0000 7f5591040800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:16.095 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.096+0000 7f5591040800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.095 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.096+0000 7f5591040800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:16.095 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.096+0000 7f5591040800 20 searching for the correct realm 2024-09-12T00:51:16.097 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.099+0000 7f558f32b640 0 -- 172.21.15.73:0/1234862354 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f5578029060 msgr2=0x7f55780684a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:51:16.304 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.305+0000 7f558f32b640 0 -- 172.21.15.73:0/1234862354 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f5578029060 msgr2=0x7f55780684a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:16.308 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.309+0000 7f5591040800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:51:16.308 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.309+0000 7f5591040800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:16.308 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.309+0000 7f5591040800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:51:16.308 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.309+0000 7f5591040800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:16.308 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.309+0000 7f5591040800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:16.308 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.309+0000 7f5591040800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:16.308 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.309+0000 7f5591040800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.308 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.309+0000 7f5591040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:16.309 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.309+0000 7f5591040800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.310 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.309+0000 7f5591040800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:16.310 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.309+0000 7f5591040800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.310 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.310+0000 7f5591040800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:16.310 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.310+0000 7f5591040800 20 zone default found 2024-09-12T00:51:16.310 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.310+0000 7f5591040800 4 Realm: () 2024-09-12T00:51:16.310 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.310+0000 7f5591040800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:51:16.310 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.310+0000 7f5591040800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:51:16.310 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.310+0000 7f5591040800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:16.311 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.310+0000 7f5591040800 20 zonegroup default 2024-09-12T00:51:16.311 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.310+0000 7f5591040800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.311 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.310+0000 7f5591040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:16.311 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.310+0000 7f5591040800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.311 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.310+0000 7f5591040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:16.311 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.310+0000 7f5591040800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.311 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.311+0000 7f5591040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:16.311 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.311+0000 7f5591040800 20 started sync module instance, tier type = 2024-09-12T00:51:16.311 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.311+0000 7f5591040800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:51:16.319 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.320+0000 7f5591040800 20 add_watcher() i=0 2024-09-12T00:51:16.319 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.320+0000 7f5591040800 20 add_watcher() i=1 2024-09-12T00:51:16.319 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.320+0000 7f5591040800 20 add_watcher() i=2 2024-09-12T00:51:16.319 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.320+0000 7f5591040800 20 add_watcher() i=3 2024-09-12T00:51:16.319 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.320+0000 7f5591040800 20 add_watcher() i=4 2024-09-12T00:51:16.319 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.320+0000 7f5591040800 20 add_watcher() i=5 2024-09-12T00:51:16.319 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.320+0000 7f5591040800 20 add_watcher() i=6 2024-09-12T00:51:16.320 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.321+0000 7f5591040800 20 add_watcher() i=7 2024-09-12T00:51:16.320 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.321+0000 7f5591040800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:16.322 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.323+0000 7f54457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:16.322 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.323+0000 7f5591040800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:16.322 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.323+0000 7f5591040800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:16.322 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.323+0000 7f5591040800 5 note: GC not initialized 2024-09-12T00:51:16.323 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.323+0000 7f53bffff640 20 reqs_thread_entry: start 2024-09-12T00:51:16.323 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.323+0000 7f5591040800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:16.323 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.323+0000 7f5591040800 20 Filter name: none 2024-09-12T00:51:16.323 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.323+0000 7f53bdffb640 20 reqs_thread_entry: start 2024-09-12T00:51:16.323 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.324+0000 7f5591040800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.324 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.324+0000 7f5591040800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:51:16.324 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.324+0000 7f5591040800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.324 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.325+0000 7f5591040800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:51:16.324 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.325+0000 7f5591040800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:16.324 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.325+0000 7f5591040800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.324 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.325+0000 7f5591040800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:51:16.324 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.325+0000 7f5591040800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.325 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.325+0000 7f5591040800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:51:16.325 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.326+0000 7f5591040800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:16.325 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.327+0000 7f54457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:16.328 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.329+0000 7f5591040800 20 remove_watcher() i=0 2024-09-12T00:51:16.328 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.329+0000 7f5591040800 2 removed watcher, disabling cache 2024-09-12T00:51:16.329 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.330+0000 7f5591040800 20 remove_watcher() i=1 2024-09-12T00:51:16.330 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.331+0000 7f5591040800 20 remove_watcher() i=2 2024-09-12T00:51:16.331 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.332+0000 7f5591040800 20 remove_watcher() i=3 2024-09-12T00:51:16.332 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.333+0000 7f5591040800 20 remove_watcher() i=4 2024-09-12T00:51:16.332 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.334+0000 7f5591040800 20 remove_watcher() i=5 2024-09-12T00:51:16.334 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.335+0000 7f5591040800 20 remove_watcher() i=6 2024-09-12T00:51:16.334 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:16.336+0000 7f5591040800 20 remove_watcher() i=7 2024-09-12T00:51:16.345 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:16.345 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:51:16.345 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: error-at-commit-target-layout id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-12T00:51:16.345 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:16.347 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:16.347 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:16.367 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:16.367 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:16.582 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:16.582 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:16.644 INFO:tasks.workunit.client.0.smithi073.stderr:TEST: reshard bucket with abort at commit_target_layout 2024-09-12T00:51:16.644 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:16.648 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:16.648 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:16.685 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:16.685 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:16.741 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:16.742 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:16.778 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:16.778 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:16.812 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:16.812 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:16.846 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:16.847 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:16.881 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:16.881 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:16.915 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:16.915 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:16.950 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:16.950 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:16.985 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:16.985 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:17.020 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:17.020 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:17.056 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:17.057 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:17.089 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:17.089 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:17.122 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:17.122 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:17.160 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:17.160 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:17.197 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:17.197 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:17.230 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:17.231 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:17.267 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:17.267 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:17.301 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:17.302 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:17.337 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:17.337 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:17.371 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:17.371 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:17.405 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:17.405 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:17.440 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T00:51:17.468 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:17.468 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:17.506 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.507+0000 7f3650328800 20 rados->read ofs=0 len=0 2024-09-12T00:51:17.507 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.508+0000 7f3650328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:17.508 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.508+0000 7f3650328800 20 realm 2024-09-12T00:51:17.508 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.508+0000 7f3650328800 20 rados->read ofs=0 len=0 2024-09-12T00:51:17.508 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.508+0000 7f3650328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:17.508 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.508+0000 7f3650328800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:17.508 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.508+0000 7f3650328800 20 rados->read ofs=0 len=0 2024-09-12T00:51:17.508 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.508+0000 7f3650328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:17.509 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.508+0000 7f3650328800 20 rados->read ofs=0 len=0 2024-09-12T00:51:17.510 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.509+0000 7f3650328800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:17.510 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.509+0000 7f3650328800 20 rados->read ofs=0 len=0 2024-09-12T00:51:17.510 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.510+0000 7f3650328800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:17.510 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.510+0000 7f3650328800 20 searching for the correct realm 2024-09-12T00:51:17.511 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.511+0000 7f364c06f640 0 -- 172.21.15.73:0/966773517 >> [v2:172.21.15.117:6816/1460498570,v1:172.21.15.117:6817/1460498570] conn(0x564a55543670 msgr2=0x7f36440a7f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:17.715 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.716+0000 7f364b86e640 0 -- 172.21.15.73:0/966773517 >> [v2:172.21.15.73:6826/269690776,v1:172.21.15.73:6827/269690776] conn(0x7f363c03f070 msgr2=0x7f363c05b430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:17.721 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.722+0000 7f3650328800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:51:17.721 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.722+0000 7f3650328800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:17.721 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.722+0000 7f3650328800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:51:17.721 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.722+0000 7f3650328800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:17.722 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.722+0000 7f3650328800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:17.722 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.722+0000 7f3650328800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:17.722 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.722+0000 7f3650328800 20 rados->read ofs=0 len=0 2024-09-12T00:51:17.722 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.722+0000 7f3650328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:17.722 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.722+0000 7f3650328800 20 rados->read ofs=0 len=0 2024-09-12T00:51:17.722 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.723+0000 7f3650328800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:17.722 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.723+0000 7f3650328800 20 rados->read ofs=0 len=0 2024-09-12T00:51:17.723 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.723+0000 7f3650328800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:17.723 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.723+0000 7f3650328800 20 zone default found 2024-09-12T00:51:17.723 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.723+0000 7f3650328800 4 Realm: () 2024-09-12T00:51:17.723 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.723+0000 7f3650328800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:51:17.723 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.723+0000 7f3650328800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:51:17.723 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.723+0000 7f3650328800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:17.723 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.723+0000 7f3650328800 20 zonegroup default 2024-09-12T00:51:17.724 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.723+0000 7f3650328800 20 rados->read ofs=0 len=0 2024-09-12T00:51:17.724 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.723+0000 7f3650328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:17.724 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.723+0000 7f3650328800 20 rados->read ofs=0 len=0 2024-09-12T00:51:17.724 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.723+0000 7f3650328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:17.724 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.723+0000 7f3650328800 20 rados->read ofs=0 len=0 2024-09-12T00:51:17.724 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.724+0000 7f3650328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:17.724 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.724+0000 7f3650328800 20 started sync module instance, tier type = 2024-09-12T00:51:17.724 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.724+0000 7f3650328800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:51:17.731 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.733+0000 7f3650328800 20 add_watcher() i=0 2024-09-12T00:51:17.732 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.733+0000 7f3650328800 20 add_watcher() i=1 2024-09-12T00:51:17.732 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.733+0000 7f3650328800 20 add_watcher() i=2 2024-09-12T00:51:17.732 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.733+0000 7f3650328800 20 add_watcher() i=3 2024-09-12T00:51:17.732 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.733+0000 7f3650328800 20 add_watcher() i=4 2024-09-12T00:51:17.732 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.733+0000 7f3650328800 20 add_watcher() i=5 2024-09-12T00:51:17.732 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.733+0000 7f3650328800 20 add_watcher() i=6 2024-09-12T00:51:17.732 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.734+0000 7f3650328800 20 add_watcher() i=7 2024-09-12T00:51:17.733 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.734+0000 7f3650328800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:17.734 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.735+0000 7f35027e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:17.734 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.735+0000 7f3650328800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:17.735 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.735+0000 7f3650328800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:17.735 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.735+0000 7f3650328800 5 note: GC not initialized 2024-09-12T00:51:17.735 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.736+0000 7f35017e2640 20 reqs_thread_entry: start 2024-09-12T00:51:17.735 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.736+0000 7f3650328800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:17.735 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.736+0000 7f3650328800 20 Filter name: none 2024-09-12T00:51:17.736 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.736+0000 7f3472ffd640 20 reqs_thread_entry: start 2024-09-12T00:51:17.736 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.736+0000 7f3650328800 20 rados->read ofs=0 len=0 2024-09-12T00:51:17.738 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.736+0000 7f3650328800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:51:17.738 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.736+0000 7f3650328800 20 rados->read ofs=0 len=0 2024-09-12T00:51:17.739 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.737+0000 7f3650328800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:51:17.739 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.737+0000 7f3650328800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:17.739 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.737+0000 7f3650328800 20 rados->read ofs=0 len=0 2024-09-12T00:51:17.739 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.737+0000 7f3650328800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:51:17.739 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.737+0000 7f3650328800 20 rados->read ofs=0 len=0 2024-09-12T00:51:17.740 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.738+0000 7f3650328800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:51:17.740 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.738+0000 7f3650328800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:17.740 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.739+0000 7f35027e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:17.741 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.741+0000 7f3650328800 20 remove_watcher() i=0 2024-09-12T00:51:17.741 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.741+0000 7f3650328800 2 removed watcher, disabling cache 2024-09-12T00:51:17.741 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.742+0000 7f3650328800 20 remove_watcher() i=1 2024-09-12T00:51:17.742 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.743+0000 7f3650328800 20 remove_watcher() i=2 2024-09-12T00:51:17.743 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.744+0000 7f3650328800 20 remove_watcher() i=3 2024-09-12T00:51:17.744 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.745+0000 7f3650328800 20 remove_watcher() i=4 2024-09-12T00:51:17.745 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.746+0000 7f3650328800 20 remove_watcher() i=5 2024-09-12T00:51:17.746 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.747+0000 7f3650328800 20 remove_watcher() i=6 2024-09-12T00:51:17.747 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.748+0000 7f3650328800 20 remove_watcher() i=7 2024-09-12T00:51:17.757 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:17.757 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:51:17.757 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: abort-at-commit-target-layout id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:51:17.757 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:17.758 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2024-09-12T00:51:17.792 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:17.792 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:17.829 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.830+0000 7feaf54b7800 20 rados->read ofs=0 len=0 2024-09-12T00:51:17.830 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.831+0000 7feaf54b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:17.831 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.831+0000 7feaf54b7800 20 realm 2024-09-12T00:51:17.831 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.831+0000 7feaf54b7800 20 rados->read ofs=0 len=0 2024-09-12T00:51:17.831 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.832+0000 7feaf54b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:17.831 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.832+0000 7feaf54b7800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:17.831 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.832+0000 7feaf54b7800 20 rados->read ofs=0 len=0 2024-09-12T00:51:17.831 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.832+0000 7feaf54b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:17.831 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.832+0000 7feaf54b7800 20 rados->read ofs=0 len=0 2024-09-12T00:51:17.832 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.833+0000 7feaf54b7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:17.832 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.833+0000 7feaf54b7800 20 rados->read ofs=0 len=0 2024-09-12T00:51:17.832 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.834+0000 7feaf54b7800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:17.832 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:17.834+0000 7feaf54b7800 20 searching for the correct realm 2024-09-12T00:51:18.035 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.036+0000 7feaebfff640 0 -- 172.21.15.73:0/2458859785 >> [v2:172.21.15.73:6826/269690776,v1:172.21.15.73:6827/269690776] conn(0x7feae4049430 msgr2=0x7feae4049850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:51:18.440 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.442+0000 7feaf2fa1640 0 -- 172.21.15.73:0/2458859785 >> [v2:172.21.15.73:6810/1807760270,v1:172.21.15.73:6811/1807760270] conn(0x7feaec0b50b0 msgr2=0x7feaec0e1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:51:18.649 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.649+0000 7feaf54b7800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:51:18.649 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.649+0000 7feaf54b7800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:18.649 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.649+0000 7feaf54b7800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:51:18.649 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.649+0000 7feaf54b7800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:18.649 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.650+0000 7feaf54b7800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:18.649 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.650+0000 7feaf54b7800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:18.650 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.650+0000 7feaf54b7800 20 rados->read ofs=0 len=0 2024-09-12T00:51:18.650 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.650+0000 7feaf54b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:18.650 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.650+0000 7feaf54b7800 20 rados->read ofs=0 len=0 2024-09-12T00:51:18.651 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.651+0000 7feaf54b7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:18.651 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.651+0000 7feaf54b7800 20 rados->read ofs=0 len=0 2024-09-12T00:51:18.651 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.651+0000 7feaf54b7800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:18.651 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.651+0000 7feaf54b7800 20 zone default found 2024-09-12T00:51:18.651 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.651+0000 7feaf54b7800 4 Realm: () 2024-09-12T00:51:18.652 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.651+0000 7feaf54b7800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:51:18.652 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.651+0000 7feaf54b7800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:51:18.652 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.651+0000 7feaf54b7800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:18.652 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.651+0000 7feaf54b7800 20 zonegroup default 2024-09-12T00:51:18.652 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.651+0000 7feaf54b7800 20 rados->read ofs=0 len=0 2024-09-12T00:51:18.652 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.651+0000 7feaf54b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:18.652 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.651+0000 7feaf54b7800 20 rados->read ofs=0 len=0 2024-09-12T00:51:18.652 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.652+0000 7feaf54b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:18.652 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.652+0000 7feaf54b7800 20 rados->read ofs=0 len=0 2024-09-12T00:51:18.652 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.652+0000 7feaf54b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:18.652 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.652+0000 7feaf54b7800 20 started sync module instance, tier type = 2024-09-12T00:51:18.653 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.652+0000 7feaf54b7800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:51:18.661 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.662+0000 7feaf54b7800 20 add_watcher() i=0 2024-09-12T00:51:18.661 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.662+0000 7feaf54b7800 20 add_watcher() i=1 2024-09-12T00:51:18.661 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.662+0000 7feaf54b7800 20 add_watcher() i=2 2024-09-12T00:51:18.661 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.662+0000 7feaf54b7800 20 add_watcher() i=3 2024-09-12T00:51:18.661 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.662+0000 7feaf54b7800 20 add_watcher() i=4 2024-09-12T00:51:18.661 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.662+0000 7feaf54b7800 20 add_watcher() i=5 2024-09-12T00:51:18.662 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.662+0000 7feaf54b7800 20 add_watcher() i=6 2024-09-12T00:51:18.662 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.663+0000 7feaf54b7800 20 add_watcher() i=7 2024-09-12T00:51:18.662 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.663+0000 7feaf54b7800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:18.664 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.665+0000 7fe9a97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:18.667 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.666+0000 7feaf54b7800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:18.667 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.666+0000 7feaf54b7800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:18.667 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.666+0000 7feaf54b7800 5 note: GC not initialized 2024-09-12T00:51:18.667 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.666+0000 7fe923fff640 20 reqs_thread_entry: start 2024-09-12T00:51:18.667 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.666+0000 7feaf54b7800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:18.668 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.666+0000 7feaf54b7800 20 Filter name: none 2024-09-12T00:51:18.668 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.666+0000 7fe921ffb640 20 reqs_thread_entry: start 2024-09-12T00:51:18.668 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.666+0000 7feaf54b7800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T00:51:18.668 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.666+0000 7feaf54b7800 20 rados->read ofs=0 len=0 2024-09-12T00:51:18.668 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.667+0000 7feaf54b7800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:51:18.668 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.667+0000 7feaf54b7800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T00:51:18.669 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.667+0000 7feaf54b7800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T00:51:18.669 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.667+0000 7feaf54b7800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 : miss 2024-09-12T00:51:18.669 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.667+0000 7feaf54b7800 20 rados->read ofs=0 len=0 2024-09-12T00:51:18.669 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.667+0000 7feaf54b7800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:51:18.669 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.667+0000 7feaf54b7800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 info.flags=0x17 2024-09-12T00:51:18.669 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.667+0000 7feaf54b7800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 to cache LRU end 2024-09-12T00:51:18.670 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.667+0000 7feaf54b7800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:51:18.670 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.667+0000 7feaf54b7800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:18.670 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.667+0000 7feaf54b7800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 2024-09-12T00:51:18.671 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.672+0000 7feaf54b7800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 info.flags=0x17 2024-09-12T00:51:18.671 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.672+0000 7feaf54b7800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 to cache LRU end 2024-09-12T00:51:18.671 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.672+0000 7feaf54b7800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:18.672 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.672+0000 7feaf54b7800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32, ofs0, ns] 2024-09-12T00:51:18.672 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.672+0000 7fe9d67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497011 cookie 94145809976816 notifier 7365 bl.length()=931 2024-09-12T00:51:18.672 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.672+0000 7fe9d67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 info.flags=0x17 2024-09-12T00:51:18.672 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.672+0000 7fe9d67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 to cache LRU end 2024-09-12T00:51:18.672 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.672+0000 7fe9d67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:18.673 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.674+0000 7feaf54b7800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32]): orig_sources= new_sources= 2024-09-12T00:51:18.673 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.674+0000 7feaf54b7800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32]): potential sources added=[] removed=[] 2024-09-12T00:51:18.673 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.674+0000 7feaf54b7800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32]): orig_dests= new_dests= 2024-09-12T00:51:18.673 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.674+0000 7feaf54b7800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32]): potential dests added=[] removed=[] 2024-09-12T00:51:18.675 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.677+0000 7feaf54b7800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32.1.0 2024-09-12T00:51:18.676 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.677+0000 7feaf54b7800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32.1.0 2024-09-12T00:51:18.676 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.677+0000 7feaf54b7800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32.1.1 2024-09-12T00:51:18.676 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.677+0000 7feaf54b7800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32.1.1 2024-09-12T00:51:18.676 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.677+0000 7feaf54b7800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32.0 2024-09-12T00:51:18.678 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.680+0000 7feaf54b7800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 : hit (requested=0x17, cached=0x17) 2024-09-12T00:51:18.678 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.680+0000 7feaf54b7800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 2024-09-12T00:51:18.680 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.681+0000 7feaf54b7800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 info.flags=0x17 2024-09-12T00:51:18.680 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.681+0000 7feaf54b7800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 to cache LRU end 2024-09-12T00:51:18.680 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.681+0000 7feaf54b7800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:18.680 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.681+0000 7feaf54b7800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32, ofs0, ns] 2024-09-12T00:51:18.680 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.681+0000 7fe9d67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497012 cookie 94145809976816 notifier 7365 bl.length()=931 2024-09-12T00:51:18.680 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.681+0000 7fe9d67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 info.flags=0x17 2024-09-12T00:51:18.680 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.681+0000 7fe9d67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 to cache LRU end 2024-09-12T00:51:18.680 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.681+0000 7fe9d67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:18.681 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.683+0000 7feaf54b7800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32]): orig_sources= new_sources= 2024-09-12T00:51:18.681 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.683+0000 7feaf54b7800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32]): potential sources added=[] removed=[] 2024-09-12T00:51:18.681 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.683+0000 7feaf54b7800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32]): orig_dests= new_dests= 2024-09-12T00:51:18.681 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.683+0000 7feaf54b7800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32]): potential dests added=[] removed=[] 2024-09-12T00:51:18.682 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.684+0000 7feaf54b7800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32.0 2024-09-12T00:51:18.683 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7feaf54b7800 time 2024-09-12T00:51:18.685377+0000 2024-09-12T00:51:18.683 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:51:18.684 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:18.684 INFO:tasks.workunit.client.0.smithi073.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7feaf898c71a] 2024-09-12T00:51:18.684 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7feaf898c8d8] 2024-09-12T00:51:18.684 INFO:tasks.workunit.client.0.smithi073.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a004e0f641] 2024-09-12T00:51:18.684 INFO:tasks.workunit.client.0.smithi073.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55a004e1f637] 2024-09-12T00:51:18.685 INFO:tasks.workunit.client.0.smithi073.stderr: 5: main() 2024-09-12T00:51:18.685 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7feaf7629590] 2024-09-12T00:51:18.685 INFO:tasks.workunit.client.0.smithi073.stderr: 7: __libc_start_main() 2024-09-12T00:51:18.685 INFO:tasks.workunit.client.0.smithi073.stderr: 8: _start() 2024-09-12T00:51:18.685 INFO:tasks.workunit.client.0.smithi073.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:51:18.685 INFO:tasks.workunit.client.0.smithi073.stderr: in thread 7feaf54b7800 thread_name:radosgw-admin 2024-09-12T00:51:18.688 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.685+0000 7feaf54b7800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7feaf54b7800 time 2024-09-12T00:51:18.685377+0000 2024-09-12T00:51:18.688 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:51:18.688 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:18.689 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:18.689 INFO:tasks.workunit.client.0.smithi073.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7feaf898c71a] 2024-09-12T00:51:18.689 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7feaf898c8d8] 2024-09-12T00:51:18.689 INFO:tasks.workunit.client.0.smithi073.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a004e0f641] 2024-09-12T00:51:18.689 INFO:tasks.workunit.client.0.smithi073.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55a004e1f637] 2024-09-12T00:51:18.689 INFO:tasks.workunit.client.0.smithi073.stderr: 5: main() 2024-09-12T00:51:18.689 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7feaf7629590] 2024-09-12T00:51:18.689 INFO:tasks.workunit.client.0.smithi073.stderr: 7: __libc_start_main() 2024-09-12T00:51:18.689 INFO:tasks.workunit.client.0.smithi073.stderr: 8: _start() 2024-09-12T00:51:18.689 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:18.711 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:18.712 INFO:tasks.workunit.client.0.smithi073.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7feaf763e6f0] 2024-09-12T00:51:18.712 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7feaf768b99c] 2024-09-12T00:51:18.712 INFO:tasks.workunit.client.0.smithi073.stderr: 3: raise() 2024-09-12T00:51:18.712 INFO:tasks.workunit.client.0.smithi073.stderr: 4: abort() 2024-09-12T00:51:18.712 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7feaf898c774] 2024-09-12T00:51:18.712 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7feaf898c8d8] 2024-09-12T00:51:18.713 INFO:tasks.workunit.client.0.smithi073.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a004e0f641] 2024-09-12T00:51:18.713 INFO:tasks.workunit.client.0.smithi073.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55a004e1f637] 2024-09-12T00:51:18.713 INFO:tasks.workunit.client.0.smithi073.stderr: 9: main() 2024-09-12T00:51:18.713 INFO:tasks.workunit.client.0.smithi073.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7feaf7629590] 2024-09-12T00:51:18.713 INFO:tasks.workunit.client.0.smithi073.stderr: 11: __libc_start_main() 2024-09-12T00:51:18.713 INFO:tasks.workunit.client.0.smithi073.stderr: 12: _start() 2024-09-12T00:51:18.713 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.686+0000 7feaf54b7800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:51:18.713 INFO:tasks.workunit.client.0.smithi073.stderr: in thread 7feaf54b7800 thread_name:radosgw-admin 2024-09-12T00:51:18.713 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:18.713 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:18.714 INFO:tasks.workunit.client.0.smithi073.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7feaf763e6f0] 2024-09-12T00:51:18.714 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7feaf768b99c] 2024-09-12T00:51:18.714 INFO:tasks.workunit.client.0.smithi073.stderr: 3: raise() 2024-09-12T00:51:18.714 INFO:tasks.workunit.client.0.smithi073.stderr: 4: abort() 2024-09-12T00:51:18.714 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7feaf898c774] 2024-09-12T00:51:18.714 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7feaf898c8d8] 2024-09-12T00:51:18.714 INFO:tasks.workunit.client.0.smithi073.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a004e0f641] 2024-09-12T00:51:18.714 INFO:tasks.workunit.client.0.smithi073.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55a004e1f637] 2024-09-12T00:51:18.714 INFO:tasks.workunit.client.0.smithi073.stderr: 9: main() 2024-09-12T00:51:18.714 INFO:tasks.workunit.client.0.smithi073.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7feaf7629590] 2024-09-12T00:51:18.714 INFO:tasks.workunit.client.0.smithi073.stderr: 11: __libc_start_main() 2024-09-12T00:51:18.715 INFO:tasks.workunit.client.0.smithi073.stderr: 12: _start() 2024-09-12T00:51:18.715 INFO:tasks.workunit.client.0.smithi073.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:51:18.715 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:18.715 INFO:tasks.workunit.client.0.smithi073.stderr:--- begin dump of recent events --- 2024-09-12T00:51:18.715 INFO:tasks.workunit.client.0.smithi073.stderr: -499> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 AuthRegistry(0x55a0077ff560) adding con mode: secure 2024-09-12T00:51:18.715 INFO:tasks.workunit.client.0.smithi073.stderr: -498> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 AuthRegistry(0x55a0077ff560) adding con mode: crc 2024-09-12T00:51:18.715 INFO:tasks.workunit.client.0.smithi073.stderr: -497> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 AuthRegistry(0x55a0077ff560) adding con mode: secure 2024-09-12T00:51:18.715 INFO:tasks.workunit.client.0.smithi073.stderr: -496> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 AuthRegistry(0x55a0077ff560) adding con mode: crc 2024-09-12T00:51:18.715 INFO:tasks.workunit.client.0.smithi073.stderr: -495> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 AuthRegistry(0x55a0077ff560) adding con mode: secure 2024-09-12T00:51:18.715 INFO:tasks.workunit.client.0.smithi073.stderr: -494> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 AuthRegistry(0x55a0077ff560) adding con mode: crc 2024-09-12T00:51:18.715 INFO:tasks.workunit.client.0.smithi073.stderr: -493> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 AuthRegistry(0x55a0077ff560) adding con mode: crc 2024-09-12T00:51:18.715 INFO:tasks.workunit.client.0.smithi073.stderr: -492> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 AuthRegistry(0x55a0077ff560) adding con mode: secure 2024-09-12T00:51:18.715 INFO:tasks.workunit.client.0.smithi073.stderr: -491> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 AuthRegistry(0x55a0077ff560) adding con mode: crc 2024-09-12T00:51:18.716 INFO:tasks.workunit.client.0.smithi073.stderr: -490> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 AuthRegistry(0x55a0077ff560) adding con mode: secure 2024-09-12T00:51:18.716 INFO:tasks.workunit.client.0.smithi073.stderr: -489> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 AuthRegistry(0x55a0077ff560) adding con mode: crc 2024-09-12T00:51:18.716 INFO:tasks.workunit.client.0.smithi073.stderr: -488> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 AuthRegistry(0x55a0077ff560) adding con mode: secure 2024-09-12T00:51:18.716 INFO:tasks.workunit.client.0.smithi073.stderr: -487> 2024-09-12T00:51:17.814+0000 7feaf54b7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:18.716 INFO:tasks.workunit.client.0.smithi073.stderr: -486> 2024-09-12T00:51:17.814+0000 7feaf54b7800 1 librados: starting msgr at 2024-09-12T00:51:18.716 INFO:tasks.workunit.client.0.smithi073.stderr: -485> 2024-09-12T00:51:17.814+0000 7feaf54b7800 1 librados: starting objecter 2024-09-12T00:51:18.716 INFO:tasks.workunit.client.0.smithi073.stderr: -484> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 asok(0x55a0075d7630) register_command objecter_requests hook 0x55a0076836c0 2024-09-12T00:51:18.716 INFO:tasks.workunit.client.0.smithi073.stderr: -483> 2024-09-12T00:51:17.814+0000 7feaf54b7800 1 librados: setting wanted keys 2024-09-12T00:51:18.716 INFO:tasks.workunit.client.0.smithi073.stderr: -482> 2024-09-12T00:51:17.814+0000 7feaf54b7800 1 librados: calling monclient init 2024-09-12T00:51:18.716 INFO:tasks.workunit.client.0.smithi073.stderr: -481> 2024-09-12T00:51:17.814+0000 7feaf54b7800 10 monclient: init 2024-09-12T00:51:18.717 INFO:tasks.workunit.client.0.smithi073.stderr: -480> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 AuthRegistry(0x55a0077f9a00) adding auth protocol: cephx 2024-09-12T00:51:18.717 INFO:tasks.workunit.client.0.smithi073.stderr: -479> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 AuthRegistry(0x55a0077f9a00) adding auth protocol: cephx 2024-09-12T00:51:18.717 INFO:tasks.workunit.client.0.smithi073.stderr: -478> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 AuthRegistry(0x55a0077f9a00) adding auth protocol: cephx 2024-09-12T00:51:18.717 INFO:tasks.workunit.client.0.smithi073.stderr: -477> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 AuthRegistry(0x55a0077f9a00) adding con mode: secure 2024-09-12T00:51:18.717 INFO:tasks.workunit.client.0.smithi073.stderr: -476> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 AuthRegistry(0x55a0077f9a00) adding con mode: crc 2024-09-12T00:51:18.717 INFO:tasks.workunit.client.0.smithi073.stderr: -475> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 AuthRegistry(0x55a0077f9a00) adding con mode: secure 2024-09-12T00:51:18.717 INFO:tasks.workunit.client.0.smithi073.stderr: -474> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 AuthRegistry(0x55a0077f9a00) adding con mode: crc 2024-09-12T00:51:18.717 INFO:tasks.workunit.client.0.smithi073.stderr: -473> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 AuthRegistry(0x55a0077f9a00) adding con mode: secure 2024-09-12T00:51:18.717 INFO:tasks.workunit.client.0.smithi073.stderr: -472> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 AuthRegistry(0x55a0077f9a00) adding con mode: crc 2024-09-12T00:51:18.717 INFO:tasks.workunit.client.0.smithi073.stderr: -471> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 AuthRegistry(0x55a0077f9a00) adding con mode: crc 2024-09-12T00:51:18.717 INFO:tasks.workunit.client.0.smithi073.stderr: -470> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 AuthRegistry(0x55a0077f9a00) adding con mode: secure 2024-09-12T00:51:18.717 INFO:tasks.workunit.client.0.smithi073.stderr: -469> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 AuthRegistry(0x55a0077f9a00) adding con mode: crc 2024-09-12T00:51:18.718 INFO:tasks.workunit.client.0.smithi073.stderr: -468> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 AuthRegistry(0x55a0077f9a00) adding con mode: secure 2024-09-12T00:51:18.718 INFO:tasks.workunit.client.0.smithi073.stderr: -467> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 AuthRegistry(0x55a0077f9a00) adding con mode: crc 2024-09-12T00:51:18.718 INFO:tasks.workunit.client.0.smithi073.stderr: -466> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 AuthRegistry(0x55a0077f9a00) adding con mode: secure 2024-09-12T00:51:18.718 INFO:tasks.workunit.client.0.smithi073.stderr: -465> 2024-09-12T00:51:17.815+0000 7feaf54b7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:18.718 INFO:tasks.workunit.client.0.smithi073.stderr: -464> 2024-09-12T00:51:17.815+0000 7feaf54b7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:18.718 INFO:tasks.workunit.client.0.smithi073.stderr: -463> 2024-09-12T00:51:17.815+0000 7feaf54b7800 5 asok(0x55a0075d7630) register_command rotate-key hook 0x55a0077f9b48 2024-09-12T00:51:18.718 INFO:tasks.workunit.client.0.smithi073.stderr: -462> 2024-09-12T00:51:17.815+0000 7feaf54b7800 10 monclient: _reopen_session rank -1 2024-09-12T00:51:18.718 INFO:tasks.workunit.client.0.smithi073.stderr: -461> 2024-09-12T00:51:17.815+0000 7feaf54b7800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:51:18.718 INFO:tasks.workunit.client.0.smithi073.stderr: -460> 2024-09-12T00:51:17.815+0000 7feaf54b7800 10 monclient(hunting): picked mon.noname-b con 0x55a0077396c0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:51:18.718 INFO:tasks.workunit.client.0.smithi073.stderr: -459> 2024-09-12T00:51:17.815+0000 7feaf54b7800 10 monclient(hunting): picked mon.noname-a con 0x55a00773f8a0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:51:18.718 INFO:tasks.workunit.client.0.smithi073.stderr: -458> 2024-09-12T00:51:17.815+0000 7feaf54b7800 10 monclient(hunting): picked mon.noname-c con 0x55a0077481a0 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:51:18.718 INFO:tasks.workunit.client.0.smithi073.stderr: -457> 2024-09-12T00:51:17.815+0000 7feaf54b7800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:18.718 INFO:tasks.workunit.client.0.smithi073.stderr: -456> 2024-09-12T00:51:17.815+0000 7feaf54b7800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:18.718 INFO:tasks.workunit.client.0.smithi073.stderr: -455> 2024-09-12T00:51:17.815+0000 7feaf54b7800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:18.719 INFO:tasks.workunit.client.0.smithi073.stderr: -454> 2024-09-12T00:51:17.815+0000 7feaf54b7800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:18.719 INFO:tasks.workunit.client.0.smithi073.stderr: -453> 2024-09-12T00:51:17.815+0000 7feaf54b7800 10 monclient(hunting): authenticate will time out at 2138.485438s 2024-09-12T00:51:18.719 INFO:tasks.workunit.client.0.smithi073.stderr: -452> 2024-09-12T00:51:17.815+0000 7feaebfff640 10 monclient(hunting): get_auth_request con 0x55a00773f8a0 auth_method 0 2024-09-12T00:51:18.719 INFO:tasks.workunit.client.0.smithi073.stderr: -451> 2024-09-12T00:51:17.815+0000 7feaebfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:18.719 INFO:tasks.workunit.client.0.smithi073.stderr: -450> 2024-09-12T00:51:17.815+0000 7feaebfff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:18.719 INFO:tasks.workunit.client.0.smithi073.stderr: -449> 2024-09-12T00:51:17.815+0000 7feaebfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:18.719 INFO:tasks.workunit.client.0.smithi073.stderr: -448> 2024-09-12T00:51:17.815+0000 7feaf37a2640 10 monclient(hunting): get_auth_request con 0x55a0077481a0 auth_method 0 2024-09-12T00:51:18.719 INFO:tasks.workunit.client.0.smithi073.stderr: -447> 2024-09-12T00:51:17.815+0000 7feaf37a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:18.719 INFO:tasks.workunit.client.0.smithi073.stderr: -446> 2024-09-12T00:51:17.815+0000 7feaf37a2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:18.719 INFO:tasks.workunit.client.0.smithi073.stderr: -445> 2024-09-12T00:51:17.815+0000 7feaf37a2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:18.719 INFO:tasks.workunit.client.0.smithi073.stderr: -444> 2024-09-12T00:51:17.815+0000 7feaebfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:18.720 INFO:tasks.workunit.client.0.smithi073.stderr: -443> 2024-09-12T00:51:17.815+0000 7feaebfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:18.720 INFO:tasks.workunit.client.0.smithi073.stderr: -442> 2024-09-12T00:51:17.815+0000 7feaebfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:18.720 INFO:tasks.workunit.client.0.smithi073.stderr: -441> 2024-09-12T00:51:17.815+0000 7feaf37a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:18.720 INFO:tasks.workunit.client.0.smithi073.stderr: -440> 2024-09-12T00:51:17.815+0000 7feaf37a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:18.720 INFO:tasks.workunit.client.0.smithi073.stderr: -439> 2024-09-12T00:51:17.815+0000 7feaf37a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:18.720 INFO:tasks.workunit.client.0.smithi073.stderr: -438> 2024-09-12T00:51:17.815+0000 7feaebfff640 10 monclient(hunting): handle_auth_done global_id 7356 payload 824 2024-09-12T00:51:18.720 INFO:tasks.workunit.client.0.smithi073.stderr: -437> 2024-09-12T00:51:17.815+0000 7feaebfff640 10 monclient: _finish_hunting 0 2024-09-12T00:51:18.720 INFO:tasks.workunit.client.0.smithi073.stderr: -436> 2024-09-12T00:51:17.815+0000 7feaebfff640 1 monclient: found mon.noname-a 2024-09-12T00:51:18.720 INFO:tasks.workunit.client.0.smithi073.stderr: -435> 2024-09-12T00:51:17.815+0000 7feaebfff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:51:18.720 INFO:tasks.workunit.client.0.smithi073.stderr: -434> 2024-09-12T00:51:17.815+0000 7fe9df606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:18.720 INFO:tasks.workunit.client.0.smithi073.stderr: -433> 2024-09-12T00:51:17.815+0000 7fe9df606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:51:18.720 INFO:tasks.workunit.client.0.smithi073.stderr: -432> 2024-09-12T00:51:17.816+0000 7fe9df606640 10 monclient: dump: 2024-09-12T00:51:18.721 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:51:18.721 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:51:18.721 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:18.721 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:18.721 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:18.721 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:51:18.721 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:51:18.721 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:51:18.721 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:51:18.721 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:18.721 INFO:tasks.workunit.client.0.smithi073.stderr: -431> 2024-09-12T00:51:17.816+0000 7fe9df606640 10 monclient: _finish_auth 0 2024-09-12T00:51:18.721 INFO:tasks.workunit.client.0.smithi073.stderr: -430> 2024-09-12T00:51:17.816+0000 7fe9df606640 10 monclient: _check_auth_tickets 2024-09-12T00:51:18.721 INFO:tasks.workunit.client.0.smithi073.stderr: -429> 2024-09-12T00:51:17.816+0000 7fe9df606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:18.722 INFO:tasks.workunit.client.0.smithi073.stderr: -428> 2024-09-12T00:51:17.816+0000 7fe9df606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:18.722 INFO:tasks.workunit.client.0.smithi073.stderr: -427> 2024-09-12T00:51:17.816+0000 7fe9df606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:51:18.722 INFO:tasks.workunit.client.0.smithi073.stderr: -426> 2024-09-12T00:51:17.816+0000 7fe9df606640 10 monclient: dump: 2024-09-12T00:51:18.722 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:51:18.722 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:51:18.722 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:18.722 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:18.722 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:18.722 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:51:18.722 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:51:18.722 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:51:18.722 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:51:18.722 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:18.723 INFO:tasks.workunit.client.0.smithi073.stderr: -425> 2024-09-12T00:51:17.816+0000 7feaf54b7800 5 monclient: authenticate success, global_id 7356 2024-09-12T00:51:18.723 INFO:tasks.workunit.client.0.smithi073.stderr: -424> 2024-09-12T00:51:17.816+0000 7feaf54b7800 10 monclient: _renew_subs 2024-09-12T00:51:18.723 INFO:tasks.workunit.client.0.smithi073.stderr: -423> 2024-09-12T00:51:17.816+0000 7fe9e0e09640 4 set_mon_vals no callback set 2024-09-12T00:51:18.723 INFO:tasks.workunit.client.0.smithi073.stderr: -422> 2024-09-12T00:51:17.816+0000 7feaf54b7800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:51:18.723 INFO:tasks.workunit.client.0.smithi073.stderr: -421> 2024-09-12T00:51:17.816+0000 7feaf54b7800 10 monclient: _renew_subs 2024-09-12T00:51:18.723 INFO:tasks.workunit.client.0.smithi073.stderr: -420> 2024-09-12T00:51:17.816+0000 7feaf54b7800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:51:18.723 INFO:tasks.workunit.client.0.smithi073.stderr: -419> 2024-09-12T00:51:17.816+0000 7feaf54b7800 1 librados: init done 2024-09-12T00:51:18.723 INFO:tasks.workunit.client.0.smithi073.stderr: -418> 2024-09-12T00:51:17.818+0000 7fe9df606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:51:18.723 INFO:tasks.workunit.client.0.smithi073.stderr: -417> 2024-09-12T00:51:17.818+0000 7fe9df606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:51:18.723 INFO:tasks.workunit.client.0.smithi073.stderr: -416> 2024-09-12T00:51:17.818+0000 7fe9df606640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:51:18.723 INFO:tasks.workunit.client.0.smithi073.stderr: -415> 2024-09-12T00:51:17.818+0000 7feaf2fa1640 10 monclient: get_auth_request con 0x7fe9d8076470 auth_method 0 2024-09-12T00:51:18.723 INFO:tasks.workunit.client.0.smithi073.stderr: -414> 2024-09-12T00:51:17.818+0000 7feaf37a2640 10 monclient: get_auth_request con 0x55a007821d90 auth_method 0 2024-09-12T00:51:18.723 INFO:tasks.workunit.client.0.smithi073.stderr: -413> 2024-09-12T00:51:17.819+0000 7feaf2fa1640 10 monclient: get_auth_request con 0x55a007844fe0 auth_method 0 2024-09-12T00:51:18.724 INFO:tasks.workunit.client.0.smithi073.stderr: -412> 2024-09-12T00:51:17.819+0000 7feaebfff640 10 monclient: get_auth_request con 0x55a007849470 auth_method 0 2024-09-12T00:51:18.724 INFO:tasks.workunit.client.0.smithi073.stderr: -411> 2024-09-12T00:51:17.821+0000 7feaf54b7800 10 monclient: build_initial_monmap 2024-09-12T00:51:18.724 INFO:tasks.workunit.client.0.smithi073.stderr: -410> 2024-09-12T00:51:17.821+0000 7feaf54b7800 1 build_initial for_mkfs: 0 2024-09-12T00:51:18.724 INFO:tasks.workunit.client.0.smithi073.stderr: -409> 2024-09-12T00:51:17.821+0000 7feaf54b7800 10 monclient: monmap: 2024-09-12T00:51:18.724 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:51:18.724 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:51:18.724 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:51:18.724 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:51:18.724 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:51:18.724 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:51:18.724 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:51:18.724 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:51:18.725 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:51:18.725 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:18.725 INFO:tasks.workunit.client.0.smithi073.stderr: -408> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784e3e0) adding auth protocol: cephx 2024-09-12T00:51:18.725 INFO:tasks.workunit.client.0.smithi073.stderr: -407> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784e3e0) adding auth protocol: cephx 2024-09-12T00:51:18.725 INFO:tasks.workunit.client.0.smithi073.stderr: -406> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784e3e0) adding auth protocol: cephx 2024-09-12T00:51:18.725 INFO:tasks.workunit.client.0.smithi073.stderr: -405> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784e3e0) adding con mode: secure 2024-09-12T00:51:18.726 INFO:tasks.workunit.client.0.smithi073.stderr: -404> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784e3e0) adding con mode: crc 2024-09-12T00:51:18.726 INFO:tasks.workunit.client.0.smithi073.stderr: -403> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784e3e0) adding con mode: secure 2024-09-12T00:51:18.726 INFO:tasks.workunit.client.0.smithi073.stderr: -402> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784e3e0) adding con mode: crc 2024-09-12T00:51:18.726 INFO:tasks.workunit.client.0.smithi073.stderr: -401> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784e3e0) adding con mode: secure 2024-09-12T00:51:18.726 INFO:tasks.workunit.client.0.smithi073.stderr: -400> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784e3e0) adding con mode: crc 2024-09-12T00:51:18.726 INFO:tasks.workunit.client.0.smithi073.stderr: -399> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784e3e0) adding con mode: crc 2024-09-12T00:51:18.727 INFO:tasks.workunit.client.0.smithi073.stderr: -398> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784e3e0) adding con mode: secure 2024-09-12T00:51:18.727 INFO:tasks.workunit.client.0.smithi073.stderr: -397> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784e3e0) adding con mode: crc 2024-09-12T00:51:18.727 INFO:tasks.workunit.client.0.smithi073.stderr: -396> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784e3e0) adding con mode: secure 2024-09-12T00:51:18.727 INFO:tasks.workunit.client.0.smithi073.stderr: -395> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784e3e0) adding con mode: crc 2024-09-12T00:51:18.727 INFO:tasks.workunit.client.0.smithi073.stderr: -394> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784e3e0) adding con mode: secure 2024-09-12T00:51:18.727 INFO:tasks.workunit.client.0.smithi073.stderr: -393> 2024-09-12T00:51:17.821+0000 7feaf54b7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:18.728 INFO:tasks.workunit.client.0.smithi073.stderr: -392> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 asok(0x55a0075d7630) register_command objecter_requests cmddesc objecter_requests hook 0x55a007851850 EEXIST 2024-09-12T00:51:18.728 INFO:tasks.workunit.client.0.smithi073.stderr: -391> 2024-09-12T00:51:17.821+0000 7feaf54b7800 10 monclient: init 2024-09-12T00:51:18.728 INFO:tasks.workunit.client.0.smithi073.stderr: -390> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784ca08) adding auth protocol: cephx 2024-09-12T00:51:18.728 INFO:tasks.workunit.client.0.smithi073.stderr: -389> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784ca08) adding auth protocol: cephx 2024-09-12T00:51:18.728 INFO:tasks.workunit.client.0.smithi073.stderr: -388> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784ca08) adding auth protocol: cephx 2024-09-12T00:51:18.728 INFO:tasks.workunit.client.0.smithi073.stderr: -387> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784ca08) adding con mode: secure 2024-09-12T00:51:18.729 INFO:tasks.workunit.client.0.smithi073.stderr: -386> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784ca08) adding con mode: crc 2024-09-12T00:51:18.729 INFO:tasks.workunit.client.0.smithi073.stderr: -385> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784ca08) adding con mode: secure 2024-09-12T00:51:18.729 INFO:tasks.workunit.client.0.smithi073.stderr: -384> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784ca08) adding con mode: crc 2024-09-12T00:51:18.729 INFO:tasks.workunit.client.0.smithi073.stderr: -383> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784ca08) adding con mode: secure 2024-09-12T00:51:18.729 INFO:tasks.workunit.client.0.smithi073.stderr: -382> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784ca08) adding con mode: crc 2024-09-12T00:51:18.730 INFO:tasks.workunit.client.0.smithi073.stderr: -381> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784ca08) adding con mode: crc 2024-09-12T00:51:18.730 INFO:tasks.workunit.client.0.smithi073.stderr: -380> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784ca08) adding con mode: secure 2024-09-12T00:51:18.730 INFO:tasks.workunit.client.0.smithi073.stderr: -379> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784ca08) adding con mode: crc 2024-09-12T00:51:18.730 INFO:tasks.workunit.client.0.smithi073.stderr: -378> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784ca08) adding con mode: secure 2024-09-12T00:51:18.730 INFO:tasks.workunit.client.0.smithi073.stderr: -377> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784ca08) adding con mode: crc 2024-09-12T00:51:18.730 INFO:tasks.workunit.client.0.smithi073.stderr: -376> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784ca08) adding con mode: secure 2024-09-12T00:51:18.731 INFO:tasks.workunit.client.0.smithi073.stderr: -375> 2024-09-12T00:51:17.822+0000 7feaf54b7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:18.731 INFO:tasks.workunit.client.0.smithi073.stderr: -374> 2024-09-12T00:51:17.822+0000 7feaf54b7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:18.731 INFO:tasks.workunit.client.0.smithi073.stderr: -373> 2024-09-12T00:51:17.822+0000 7feaf54b7800 5 asok(0x55a0075d7630) register_command rotate-key cmddesc rotate-key hook 0x55a00784cb50 EEXIST 2024-09-12T00:51:18.731 INFO:tasks.workunit.client.0.smithi073.stderr: -372> 2024-09-12T00:51:17.822+0000 7feaf54b7800 10 monclient: _reopen_session rank -1 2024-09-12T00:51:18.731 INFO:tasks.workunit.client.0.smithi073.stderr: -371> 2024-09-12T00:51:17.822+0000 7feaf54b7800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:51:18.731 INFO:tasks.workunit.client.0.smithi073.stderr: -370> 2024-09-12T00:51:17.822+0000 7feaf54b7800 10 monclient(hunting): picked mon.noname-c con 0x55a007875b70 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:51:18.732 INFO:tasks.workunit.client.0.smithi073.stderr: -369> 2024-09-12T00:51:17.822+0000 7feaf54b7800 10 monclient(hunting): picked mon.noname-b con 0x55a007875f50 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:51:18.732 INFO:tasks.workunit.client.0.smithi073.stderr: -368> 2024-09-12T00:51:17.822+0000 7feaf54b7800 10 monclient(hunting): picked mon.noname-a con 0x55a007874880 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:51:18.732 INFO:tasks.workunit.client.0.smithi073.stderr: -367> 2024-09-12T00:51:17.822+0000 7feaf54b7800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:18.732 INFO:tasks.workunit.client.0.smithi073.stderr: -366> 2024-09-12T00:51:17.822+0000 7feaf54b7800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:18.732 INFO:tasks.workunit.client.0.smithi073.stderr: -365> 2024-09-12T00:51:17.822+0000 7feaf54b7800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:18.733 INFO:tasks.workunit.client.0.smithi073.stderr: -364> 2024-09-12T00:51:17.822+0000 7feaf54b7800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:18.733 INFO:tasks.workunit.client.0.smithi073.stderr: -363> 2024-09-12T00:51:17.822+0000 7feaf54b7800 10 monclient(hunting): authenticate will time out at 2138.492424s 2024-09-12T00:51:18.733 INFO:tasks.workunit.client.0.smithi073.stderr: -362> 2024-09-12T00:51:17.822+0000 7feaf2fa1640 10 monclient(hunting): get_auth_request con 0x55a007875b70 auth_method 0 2024-09-12T00:51:18.733 INFO:tasks.workunit.client.0.smithi073.stderr: -361> 2024-09-12T00:51:17.822+0000 7feaf2fa1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:18.733 INFO:tasks.workunit.client.0.smithi073.stderr: -360> 2024-09-12T00:51:17.822+0000 7feaf2fa1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:18.733 INFO:tasks.workunit.client.0.smithi073.stderr: -359> 2024-09-12T00:51:17.822+0000 7feaf2fa1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:18.734 INFO:tasks.workunit.client.0.smithi073.stderr: -358> 2024-09-12T00:51:17.822+0000 7feaf37a2640 10 monclient(hunting): get_auth_request con 0x55a007874880 auth_method 0 2024-09-12T00:51:18.734 INFO:tasks.workunit.client.0.smithi073.stderr: -357> 2024-09-12T00:51:17.822+0000 7feaf37a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:18.734 INFO:tasks.workunit.client.0.smithi073.stderr: -356> 2024-09-12T00:51:17.822+0000 7feaf37a2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:18.734 INFO:tasks.workunit.client.0.smithi073.stderr: -355> 2024-09-12T00:51:17.822+0000 7feaf37a2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:18.734 INFO:tasks.workunit.client.0.smithi073.stderr: -354> 2024-09-12T00:51:17.822+0000 7feaebfff640 10 monclient(hunting): get_auth_request con 0x55a007875f50 auth_method 0 2024-09-12T00:51:18.735 INFO:tasks.workunit.client.0.smithi073.stderr: -353> 2024-09-12T00:51:17.822+0000 7feaebfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:18.735 INFO:tasks.workunit.client.0.smithi073.stderr: -352> 2024-09-12T00:51:17.822+0000 7feaebfff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:18.735 INFO:tasks.workunit.client.0.smithi073.stderr: -351> 2024-09-12T00:51:17.822+0000 7feaebfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:18.735 INFO:tasks.workunit.client.0.smithi073.stderr: -350> 2024-09-12T00:51:17.822+0000 7feaf2fa1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:18.735 INFO:tasks.workunit.client.0.smithi073.stderr: -349> 2024-09-12T00:51:17.822+0000 7feaf2fa1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:18.736 INFO:tasks.workunit.client.0.smithi073.stderr: -348> 2024-09-12T00:51:17.822+0000 7feaf2fa1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:18.736 INFO:tasks.workunit.client.0.smithi073.stderr: -347> 2024-09-12T00:51:17.822+0000 7feaf37a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:18.736 INFO:tasks.workunit.client.0.smithi073.stderr: -346> 2024-09-12T00:51:17.822+0000 7feaf37a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:18.736 INFO:tasks.workunit.client.0.smithi073.stderr: -345> 2024-09-12T00:51:17.822+0000 7feaf37a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:18.736 INFO:tasks.workunit.client.0.smithi073.stderr: -344> 2024-09-12T00:51:17.822+0000 7feaebfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:18.737 INFO:tasks.workunit.client.0.smithi073.stderr: -343> 2024-09-12T00:51:17.822+0000 7feaebfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:18.737 INFO:tasks.workunit.client.0.smithi073.stderr: -342> 2024-09-12T00:51:17.822+0000 7feaebfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:18.737 INFO:tasks.workunit.client.0.smithi073.stderr: -341> 2024-09-12T00:51:17.822+0000 7feaf37a2640 10 monclient(hunting): handle_auth_done global_id 7359 payload 824 2024-09-12T00:51:18.737 INFO:tasks.workunit.client.0.smithi073.stderr: -340> 2024-09-12T00:51:17.822+0000 7feaf37a2640 10 monclient: _finish_hunting 0 2024-09-12T00:51:18.737 INFO:tasks.workunit.client.0.smithi073.stderr: -339> 2024-09-12T00:51:17.822+0000 7feaf37a2640 1 monclient: found mon.noname-a 2024-09-12T00:51:18.738 INFO:tasks.workunit.client.0.smithi073.stderr: -338> 2024-09-12T00:51:17.822+0000 7feaf37a2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:51:18.738 INFO:tasks.workunit.client.0.smithi073.stderr: -337> 2024-09-12T00:51:17.823+0000 7fe9dce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:18.738 INFO:tasks.workunit.client.0.smithi073.stderr: -336> 2024-09-12T00:51:17.823+0000 7fe9dce01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:51:18.738 INFO:tasks.workunit.client.0.smithi073.stderr: -335> 2024-09-12T00:51:17.823+0000 7fe9dce01640 10 monclient: dump: 2024-09-12T00:51:18.738 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:51:18.738 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:51:18.739 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:18.739 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:18.739 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:18.739 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:51:18.739 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:51:18.739 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:51:18.740 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:51:18.740 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:18.740 INFO:tasks.workunit.client.0.smithi073.stderr: -334> 2024-09-12T00:51:17.823+0000 7fe9dce01640 10 monclient: _finish_auth 0 2024-09-12T00:51:18.740 INFO:tasks.workunit.client.0.smithi073.stderr: -333> 2024-09-12T00:51:17.823+0000 7fe9dce01640 10 monclient: _check_auth_tickets 2024-09-12T00:51:18.740 INFO:tasks.workunit.client.0.smithi073.stderr: -332> 2024-09-12T00:51:17.823+0000 7fe9dce01640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:18.740 INFO:tasks.workunit.client.0.smithi073.stderr: -331> 2024-09-12T00:51:17.823+0000 7fe9dce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:18.740 INFO:tasks.workunit.client.0.smithi073.stderr: -330> 2024-09-12T00:51:17.823+0000 7fe9dce01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:51:18.741 INFO:tasks.workunit.client.0.smithi073.stderr: -329> 2024-09-12T00:51:17.823+0000 7fe9dce01640 10 monclient: dump: 2024-09-12T00:51:18.741 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:51:18.741 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:51:18.741 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:18.741 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:18.742 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:18.742 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:51:18.742 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:51:18.742 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:51:18.742 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:51:18.742 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:18.742 INFO:tasks.workunit.client.0.smithi073.stderr: -328> 2024-09-12T00:51:17.823+0000 7feaf54b7800 5 monclient: authenticate success, global_id 7359 2024-09-12T00:51:18.742 INFO:tasks.workunit.client.0.smithi073.stderr: -327> 2024-09-12T00:51:17.823+0000 7feaf54b7800 10 monclient: _renew_subs 2024-09-12T00:51:18.743 INFO:tasks.workunit.client.0.smithi073.stderr: -326> 2024-09-12T00:51:17.823+0000 7feaf54b7800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:51:18.743 INFO:tasks.workunit.client.0.smithi073.stderr: -325> 2024-09-12T00:51:17.823+0000 7feaf3fa3640 4 set_mon_vals no callback set 2024-09-12T00:51:18.743 INFO:tasks.workunit.client.0.smithi073.stderr: -324> 2024-09-12T00:51:17.823+0000 7feaf54b7800 10 monclient: _renew_subs 2024-09-12T00:51:18.743 INFO:tasks.workunit.client.0.smithi073.stderr: -323> 2024-09-12T00:51:17.823+0000 7feaf54b7800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:51:18.743 INFO:tasks.workunit.client.0.smithi073.stderr: -322> 2024-09-12T00:51:17.824+0000 7fe9dce01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:51:18.743 INFO:tasks.workunit.client.0.smithi073.stderr: -321> 2024-09-12T00:51:17.824+0000 7fe9dce01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:51:18.743 INFO:tasks.workunit.client.0.smithi073.stderr: -320> 2024-09-12T00:51:17.824+0000 7fe9dce01640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:51:18.743 INFO:tasks.workunit.client.0.smithi073.stderr: -319> 2024-09-12T00:51:17.825+0000 7feaf2fa1640 10 monclient: get_auth_request con 0x7fe9cc076380 auth_method 0 2024-09-12T00:51:18.743 INFO:tasks.workunit.client.0.smithi073.stderr: -318> 2024-09-12T00:51:17.825+0000 7feaf54b7800 10 monclient: get_monmap_and_config 2024-09-12T00:51:18.743 INFO:tasks.workunit.client.0.smithi073.stderr: -317> 2024-09-12T00:51:17.825+0000 7feaf54b7800 10 monclient: build_initial_monmap 2024-09-12T00:51:18.743 INFO:tasks.workunit.client.0.smithi073.stderr: -316> 2024-09-12T00:51:17.825+0000 7feaf54b7800 1 build_initial for_mkfs: 0 2024-09-12T00:51:18.743 INFO:tasks.workunit.client.0.smithi073.stderr: -315> 2024-09-12T00:51:17.825+0000 7feaf54b7800 10 monclient: monmap: 2024-09-12T00:51:18.743 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:51:18.743 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:51:18.744 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:51:18.744 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:51:18.744 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:51:18.744 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:51:18.744 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:51:18.744 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:51:18.744 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:51:18.744 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:18.744 INFO:tasks.workunit.client.0.smithi073.stderr: -314> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x55a0078958a0) adding auth protocol: cephx 2024-09-12T00:51:18.744 INFO:tasks.workunit.client.0.smithi073.stderr: -313> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x55a0078958a0) adding auth protocol: cephx 2024-09-12T00:51:18.744 INFO:tasks.workunit.client.0.smithi073.stderr: -312> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x55a0078958a0) adding auth protocol: cephx 2024-09-12T00:51:18.745 INFO:tasks.workunit.client.0.smithi073.stderr: -311> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x55a0078958a0) adding con mode: secure 2024-09-12T00:51:18.745 INFO:tasks.workunit.client.0.smithi073.stderr: -310> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x55a0078958a0) adding con mode: crc 2024-09-12T00:51:18.745 INFO:tasks.workunit.client.0.smithi073.stderr: -309> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x55a0078958a0) adding con mode: secure 2024-09-12T00:51:18.745 INFO:tasks.workunit.client.0.smithi073.stderr: -308> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x55a0078958a0) adding con mode: crc 2024-09-12T00:51:18.745 INFO:tasks.workunit.client.0.smithi073.stderr: -307> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x55a0078958a0) adding con mode: secure 2024-09-12T00:51:18.745 INFO:tasks.workunit.client.0.smithi073.stderr: -306> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x55a0078958a0) adding con mode: crc 2024-09-12T00:51:18.745 INFO:tasks.workunit.client.0.smithi073.stderr: -305> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x55a0078958a0) adding con mode: crc 2024-09-12T00:51:18.745 INFO:tasks.workunit.client.0.smithi073.stderr: -304> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x55a0078958a0) adding con mode: secure 2024-09-12T00:51:18.745 INFO:tasks.workunit.client.0.smithi073.stderr: -303> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x55a0078958a0) adding con mode: crc 2024-09-12T00:51:18.745 INFO:tasks.workunit.client.0.smithi073.stderr: -302> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x55a0078958a0) adding con mode: secure 2024-09-12T00:51:18.745 INFO:tasks.workunit.client.0.smithi073.stderr: -301> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x55a0078958a0) adding con mode: crc 2024-09-12T00:51:18.745 INFO:tasks.workunit.client.0.smithi073.stderr: -300> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x55a0078958a0) adding con mode: secure 2024-09-12T00:51:18.745 INFO:tasks.workunit.client.0.smithi073.stderr: -299> 2024-09-12T00:51:17.825+0000 7feaf54b7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:18.746 INFO:tasks.workunit.client.0.smithi073.stderr: -298> 2024-09-12T00:51:17.825+0000 7feaf54b7800 10 monclient: init 2024-09-12T00:51:18.746 INFO:tasks.workunit.client.0.smithi073.stderr: -297> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436840) adding auth protocol: cephx 2024-09-12T00:51:18.746 INFO:tasks.workunit.client.0.smithi073.stderr: -296> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436840) adding auth protocol: cephx 2024-09-12T00:51:18.746 INFO:tasks.workunit.client.0.smithi073.stderr: -295> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436840) adding auth protocol: cephx 2024-09-12T00:51:18.746 INFO:tasks.workunit.client.0.smithi073.stderr: -294> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436840) adding con mode: secure 2024-09-12T00:51:18.746 INFO:tasks.workunit.client.0.smithi073.stderr: -293> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436840) adding con mode: crc 2024-09-12T00:51:18.746 INFO:tasks.workunit.client.0.smithi073.stderr: -292> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436840) adding con mode: secure 2024-09-12T00:51:18.746 INFO:tasks.workunit.client.0.smithi073.stderr: -291> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436840) adding con mode: crc 2024-09-12T00:51:18.746 INFO:tasks.workunit.client.0.smithi073.stderr: -290> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436840) adding con mode: secure 2024-09-12T00:51:18.746 INFO:tasks.workunit.client.0.smithi073.stderr: -289> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436840) adding con mode: crc 2024-09-12T00:51:18.746 INFO:tasks.workunit.client.0.smithi073.stderr: -288> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436840) adding con mode: crc 2024-09-12T00:51:18.746 INFO:tasks.workunit.client.0.smithi073.stderr: -287> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436840) adding con mode: secure 2024-09-12T00:51:18.747 INFO:tasks.workunit.client.0.smithi073.stderr: -286> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436840) adding con mode: crc 2024-09-12T00:51:18.747 INFO:tasks.workunit.client.0.smithi073.stderr: -285> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436840) adding con mode: secure 2024-09-12T00:51:18.747 INFO:tasks.workunit.client.0.smithi073.stderr: -284> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436840) adding con mode: crc 2024-09-12T00:51:18.747 INFO:tasks.workunit.client.0.smithi073.stderr: -283> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436840) adding con mode: secure 2024-09-12T00:51:18.747 INFO:tasks.workunit.client.0.smithi073.stderr: -282> 2024-09-12T00:51:17.825+0000 7feaf54b7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:18.747 INFO:tasks.workunit.client.0.smithi073.stderr: -281> 2024-09-12T00:51:17.826+0000 7feaf54b7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:18.747 INFO:tasks.workunit.client.0.smithi073.stderr: -280> 2024-09-12T00:51:17.826+0000 7feaf54b7800 5 asok(0x55a0075d7630) register_command rotate-key cmddesc rotate-key hook 0x7ffda8436988 EEXIST 2024-09-12T00:51:18.747 INFO:tasks.workunit.client.0.smithi073.stderr: -279> 2024-09-12T00:51:17.826+0000 7feaf54b7800 10 monclient: _reopen_session rank -1 2024-09-12T00:51:18.747 INFO:tasks.workunit.client.0.smithi073.stderr: -278> 2024-09-12T00:51:17.826+0000 7feaf54b7800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:51:18.747 INFO:tasks.workunit.client.0.smithi073.stderr: -277> 2024-09-12T00:51:17.826+0000 7feaf54b7800 10 monclient(hunting): picked mon.noname-c con 0x55a0078999b0 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:51:18.747 INFO:tasks.workunit.client.0.smithi073.stderr: -276> 2024-09-12T00:51:17.826+0000 7feaf54b7800 10 monclient(hunting): picked mon.noname-b con 0x55a0078c4420 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:51:18.747 INFO:tasks.workunit.client.0.smithi073.stderr: -275> 2024-09-12T00:51:17.826+0000 7feaf54b7800 10 monclient(hunting): picked mon.noname-a con 0x55a0078c57d0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:51:18.747 INFO:tasks.workunit.client.0.smithi073.stderr: -274> 2024-09-12T00:51:17.826+0000 7feaf54b7800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:18.748 INFO:tasks.workunit.client.0.smithi073.stderr: -273> 2024-09-12T00:51:17.826+0000 7feaf54b7800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:18.748 INFO:tasks.workunit.client.0.smithi073.stderr: -272> 2024-09-12T00:51:17.826+0000 7feaf54b7800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:18.748 INFO:tasks.workunit.client.0.smithi073.stderr: -271> 2024-09-12T00:51:17.826+0000 7feaf54b7800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:18.748 INFO:tasks.workunit.client.0.smithi073.stderr: -270> 2024-09-12T00:51:17.826+0000 7feaf54b7800 10 monclient(hunting): authenticate will time out at 2138.496212s 2024-09-12T00:51:18.748 INFO:tasks.workunit.client.0.smithi073.stderr: -269> 2024-09-12T00:51:17.826+0000 7feaf2fa1640 10 monclient(hunting): get_auth_request con 0x55a0078999b0 auth_method 0 2024-09-12T00:51:18.748 INFO:tasks.workunit.client.0.smithi073.stderr: -268> 2024-09-12T00:51:17.826+0000 7feaf2fa1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:18.748 INFO:tasks.workunit.client.0.smithi073.stderr: -267> 2024-09-12T00:51:17.826+0000 7feaf2fa1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:18.748 INFO:tasks.workunit.client.0.smithi073.stderr: -266> 2024-09-12T00:51:17.826+0000 7feaf2fa1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:18.748 INFO:tasks.workunit.client.0.smithi073.stderr: -265> 2024-09-12T00:51:17.826+0000 7feaf37a2640 10 monclient(hunting): get_auth_request con 0x55a0078c57d0 auth_method 0 2024-09-12T00:51:18.748 INFO:tasks.workunit.client.0.smithi073.stderr: -264> 2024-09-12T00:51:17.826+0000 7feaf37a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:18.748 INFO:tasks.workunit.client.0.smithi073.stderr: -263> 2024-09-12T00:51:17.826+0000 7feaf37a2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:18.748 INFO:tasks.workunit.client.0.smithi073.stderr: -262> 2024-09-12T00:51:17.826+0000 7feaf37a2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:18.749 INFO:tasks.workunit.client.0.smithi073.stderr: -261> 2024-09-12T00:51:17.826+0000 7feaf37a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:18.749 INFO:tasks.workunit.client.0.smithi073.stderr: -260> 2024-09-12T00:51:17.826+0000 7feaf37a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:18.749 INFO:tasks.workunit.client.0.smithi073.stderr: -259> 2024-09-12T00:51:17.826+0000 7feaf37a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:18.749 INFO:tasks.workunit.client.0.smithi073.stderr: -258> 2024-09-12T00:51:17.826+0000 7feaf2fa1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:18.749 INFO:tasks.workunit.client.0.smithi073.stderr: -257> 2024-09-12T00:51:17.826+0000 7feaf2fa1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:18.749 INFO:tasks.workunit.client.0.smithi073.stderr: -256> 2024-09-12T00:51:17.826+0000 7feaf2fa1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:18.749 INFO:tasks.workunit.client.0.smithi073.stderr: -255> 2024-09-12T00:51:17.826+0000 7feaebfff640 10 monclient(hunting): get_auth_request con 0x55a0078c4420 auth_method 0 2024-09-12T00:51:18.749 INFO:tasks.workunit.client.0.smithi073.stderr: -254> 2024-09-12T00:51:17.826+0000 7feaebfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:18.749 INFO:tasks.workunit.client.0.smithi073.stderr: -253> 2024-09-12T00:51:17.826+0000 7feaebfff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:18.749 INFO:tasks.workunit.client.0.smithi073.stderr: -252> 2024-09-12T00:51:17.826+0000 7feaebfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:18.749 INFO:tasks.workunit.client.0.smithi073.stderr: -251> 2024-09-12T00:51:17.826+0000 7feaf37a2640 10 monclient(hunting): handle_auth_done global_id 7362 payload 274 2024-09-12T00:51:18.749 INFO:tasks.workunit.client.0.smithi073.stderr: -250> 2024-09-12T00:51:17.826+0000 7feaf37a2640 10 monclient: _finish_hunting 0 2024-09-12T00:51:18.749 INFO:tasks.workunit.client.0.smithi073.stderr: -249> 2024-09-12T00:51:17.826+0000 7feaf37a2640 1 monclient: found mon.noname-a 2024-09-12T00:51:18.750 INFO:tasks.workunit.client.0.smithi073.stderr: -248> 2024-09-12T00:51:17.826+0000 7feaf37a2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:51:18.750 INFO:tasks.workunit.client.0.smithi073.stderr: -247> 2024-09-12T00:51:17.826+0000 7fe9d67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:18.750 INFO:tasks.workunit.client.0.smithi073.stderr: -246> 2024-09-12T00:51:17.826+0000 7fe9d67fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:51:18.750 INFO:tasks.workunit.client.0.smithi073.stderr: -245> 2024-09-12T00:51:17.826+0000 7fe9d67fc640 10 monclient: dump: 2024-09-12T00:51:18.750 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:51:18.750 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:51:18.750 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:18.750 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:18.750 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:18.750 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:51:18.750 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:51:18.750 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:51:18.750 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:51:18.751 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:18.751 INFO:tasks.workunit.client.0.smithi073.stderr: -244> 2024-09-12T00:51:17.826+0000 7fe9d67fc640 10 monclient: _finish_auth 0 2024-09-12T00:51:18.751 INFO:tasks.workunit.client.0.smithi073.stderr: -243> 2024-09-12T00:51:17.826+0000 7fe9d67fc640 10 monclient: _check_auth_tickets 2024-09-12T00:51:18.751 INFO:tasks.workunit.client.0.smithi073.stderr: -242> 2024-09-12T00:51:17.826+0000 7fe9d67fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:18.751 INFO:tasks.workunit.client.0.smithi073.stderr: -241> 2024-09-12T00:51:17.826+0000 7fe9d67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:18.751 INFO:tasks.workunit.client.0.smithi073.stderr: -240> 2024-09-12T00:51:17.826+0000 7fe9d67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:51:18.751 INFO:tasks.workunit.client.0.smithi073.stderr: -239> 2024-09-12T00:51:17.826+0000 7fe9d67fc640 10 monclient: dump: 2024-09-12T00:51:18.751 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:51:18.751 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:51:18.751 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:18.751 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:18.751 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:18.752 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:51:18.752 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:51:18.752 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:51:18.752 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:51:18.752 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:18.752 INFO:tasks.workunit.client.0.smithi073.stderr: -238> 2024-09-12T00:51:17.826+0000 7feaf54b7800 5 monclient: authenticate success, global_id 7362 2024-09-12T00:51:18.752 INFO:tasks.workunit.client.0.smithi073.stderr: -237> 2024-09-12T00:51:17.826+0000 7feaf54b7800 10 monclient: get_monmap_and_config success 2024-09-12T00:51:18.752 INFO:tasks.workunit.client.0.smithi073.stderr: -236> 2024-09-12T00:51:17.826+0000 7feaf54b7800 4 set_mon_vals no callback set 2024-09-12T00:51:18.752 INFO:tasks.workunit.client.0.smithi073.stderr: -235> 2024-09-12T00:51:17.827+0000 7feaf54b7800 10 monclient: shutdown 2024-09-12T00:51:18.752 INFO:tasks.workunit.client.0.smithi073.stderr: -234> 2024-09-12T00:51:17.827+0000 7feaf54b7800 10 monclient: build_initial_monmap 2024-09-12T00:51:18.752 INFO:tasks.workunit.client.0.smithi073.stderr: -233> 2024-09-12T00:51:17.827+0000 7feaf54b7800 1 build_initial for_mkfs: 0 2024-09-12T00:51:18.752 INFO:tasks.workunit.client.0.smithi073.stderr: -232> 2024-09-12T00:51:17.827+0000 7feaf54b7800 10 monclient: monmap: 2024-09-12T00:51:18.752 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:51:18.753 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:51:18.753 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:51:18.753 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:51:18.753 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:51:18.753 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:51:18.753 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:51:18.753 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:51:18.753 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:51:18.753 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:18.753 INFO:tasks.workunit.client.0.smithi073.stderr: -231> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a0078ba5d0) adding auth protocol: cephx 2024-09-12T00:51:18.753 INFO:tasks.workunit.client.0.smithi073.stderr: -230> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a0078ba5d0) adding auth protocol: cephx 2024-09-12T00:51:18.753 INFO:tasks.workunit.client.0.smithi073.stderr: -229> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a0078ba5d0) adding auth protocol: cephx 2024-09-12T00:51:18.753 INFO:tasks.workunit.client.0.smithi073.stderr: -228> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a0078ba5d0) adding con mode: secure 2024-09-12T00:51:18.754 INFO:tasks.workunit.client.0.smithi073.stderr: -227> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a0078ba5d0) adding con mode: crc 2024-09-12T00:51:18.754 INFO:tasks.workunit.client.0.smithi073.stderr: -226> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a0078ba5d0) adding con mode: secure 2024-09-12T00:51:18.754 INFO:tasks.workunit.client.0.smithi073.stderr: -225> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a0078ba5d0) adding con mode: crc 2024-09-12T00:51:18.754 INFO:tasks.workunit.client.0.smithi073.stderr: -224> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a0078ba5d0) adding con mode: secure 2024-09-12T00:51:18.754 INFO:tasks.workunit.client.0.smithi073.stderr: -223> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a0078ba5d0) adding con mode: crc 2024-09-12T00:51:18.754 INFO:tasks.workunit.client.0.smithi073.stderr: -222> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a0078ba5d0) adding con mode: crc 2024-09-12T00:51:18.754 INFO:tasks.workunit.client.0.smithi073.stderr: -221> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a0078ba5d0) adding con mode: secure 2024-09-12T00:51:18.754 INFO:tasks.workunit.client.0.smithi073.stderr: -220> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a0078ba5d0) adding con mode: crc 2024-09-12T00:51:18.754 INFO:tasks.workunit.client.0.smithi073.stderr: -219> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a0078ba5d0) adding con mode: secure 2024-09-12T00:51:18.754 INFO:tasks.workunit.client.0.smithi073.stderr: -218> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a0078ba5d0) adding con mode: crc 2024-09-12T00:51:18.754 INFO:tasks.workunit.client.0.smithi073.stderr: -217> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a0078ba5d0) adding con mode: secure 2024-09-12T00:51:18.754 INFO:tasks.workunit.client.0.smithi073.stderr: -216> 2024-09-12T00:51:17.827+0000 7feaf54b7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:18.754 INFO:tasks.workunit.client.0.smithi073.stderr: -215> 2024-09-12T00:51:17.827+0000 7feaf54b7800 1 librados: starting msgr at 2024-09-12T00:51:18.755 INFO:tasks.workunit.client.0.smithi073.stderr: -214> 2024-09-12T00:51:17.827+0000 7feaf54b7800 1 librados: starting objecter 2024-09-12T00:51:18.755 INFO:tasks.workunit.client.0.smithi073.stderr: -213> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 asok(0x55a0075d7630) register_command objecter_requests cmddesc objecter_requests hook 0x55a007875030 EEXIST 2024-09-12T00:51:18.755 INFO:tasks.workunit.client.0.smithi073.stderr: -212> 2024-09-12T00:51:17.827+0000 7feaf54b7800 1 librados: setting wanted keys 2024-09-12T00:51:18.755 INFO:tasks.workunit.client.0.smithi073.stderr: -211> 2024-09-12T00:51:17.827+0000 7feaf54b7800 1 librados: calling monclient init 2024-09-12T00:51:18.755 INFO:tasks.workunit.client.0.smithi073.stderr: -210> 2024-09-12T00:51:17.827+0000 7feaf54b7800 10 monclient: init 2024-09-12T00:51:18.755 INFO:tasks.workunit.client.0.smithi073.stderr: -209> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a00788a430) adding auth protocol: cephx 2024-09-12T00:51:18.755 INFO:tasks.workunit.client.0.smithi073.stderr: -208> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a00788a430) adding auth protocol: cephx 2024-09-12T00:51:18.755 INFO:tasks.workunit.client.0.smithi073.stderr: -207> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a00788a430) adding auth protocol: cephx 2024-09-12T00:51:18.755 INFO:tasks.workunit.client.0.smithi073.stderr: -206> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a00788a430) adding con mode: secure 2024-09-12T00:51:18.755 INFO:tasks.workunit.client.0.smithi073.stderr: -205> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a00788a430) adding con mode: crc 2024-09-12T00:51:18.755 INFO:tasks.workunit.client.0.smithi073.stderr: -204> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a00788a430) adding con mode: secure 2024-09-12T00:51:18.756 INFO:tasks.workunit.client.0.smithi073.stderr: -203> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a00788a430) adding con mode: crc 2024-09-12T00:51:18.756 INFO:tasks.workunit.client.0.smithi073.stderr: -202> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a00788a430) adding con mode: secure 2024-09-12T00:51:18.756 INFO:tasks.workunit.client.0.smithi073.stderr: -201> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a00788a430) adding con mode: crc 2024-09-12T00:51:18.756 INFO:tasks.workunit.client.0.smithi073.stderr: -200> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a00788a430) adding con mode: crc 2024-09-12T00:51:18.756 INFO:tasks.workunit.client.0.smithi073.stderr: -199> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a00788a430) adding con mode: secure 2024-09-12T00:51:18.756 INFO:tasks.workunit.client.0.smithi073.stderr: -198> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a00788a430) adding con mode: crc 2024-09-12T00:51:18.756 INFO:tasks.workunit.client.0.smithi073.stderr: -197> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a00788a430) adding con mode: secure 2024-09-12T00:51:18.756 INFO:tasks.workunit.client.0.smithi073.stderr: -196> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a00788a430) adding con mode: crc 2024-09-12T00:51:18.756 INFO:tasks.workunit.client.0.smithi073.stderr: -195> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a00788a430) adding con mode: secure 2024-09-12T00:51:18.756 INFO:tasks.workunit.client.0.smithi073.stderr: -194> 2024-09-12T00:51:17.828+0000 7feaf54b7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:18.756 INFO:tasks.workunit.client.0.smithi073.stderr: -193> 2024-09-12T00:51:17.828+0000 7feaf54b7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:18.756 INFO:tasks.workunit.client.0.smithi073.stderr: -192> 2024-09-12T00:51:17.828+0000 7feaf54b7800 5 asok(0x55a0075d7630) register_command rotate-key cmddesc rotate-key hook 0x55a00788a578 EEXIST 2024-09-12T00:51:18.757 INFO:tasks.workunit.client.0.smithi073.stderr: -191> 2024-09-12T00:51:17.828+0000 7feaf54b7800 10 monclient: _reopen_session rank -1 2024-09-12T00:51:18.757 INFO:tasks.workunit.client.0.smithi073.stderr: -190> 2024-09-12T00:51:17.828+0000 7feaf54b7800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:51:18.757 INFO:tasks.workunit.client.0.smithi073.stderr: -189> 2024-09-12T00:51:17.828+0000 7feaf54b7800 10 monclient(hunting): picked mon.noname-c con 0x55a0078999b0 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:51:18.757 INFO:tasks.workunit.client.0.smithi073.stderr: -188> 2024-09-12T00:51:17.828+0000 7feaf54b7800 10 monclient(hunting): picked mon.noname-b con 0x55a0078c57d0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:51:18.757 INFO:tasks.workunit.client.0.smithi073.stderr: -187> 2024-09-12T00:51:17.828+0000 7feaf54b7800 10 monclient(hunting): picked mon.noname-a con 0x55a007895a70 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:51:18.757 INFO:tasks.workunit.client.0.smithi073.stderr: -186> 2024-09-12T00:51:17.828+0000 7feaf54b7800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:18.757 INFO:tasks.workunit.client.0.smithi073.stderr: -185> 2024-09-12T00:51:17.828+0000 7feaf54b7800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:18.757 INFO:tasks.workunit.client.0.smithi073.stderr: -184> 2024-09-12T00:51:17.828+0000 7feaf54b7800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:18.757 INFO:tasks.workunit.client.0.smithi073.stderr: -183> 2024-09-12T00:51:17.828+0000 7feaf54b7800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:18.757 INFO:tasks.workunit.client.0.smithi073.stderr: -182> 2024-09-12T00:51:17.828+0000 7feaf54b7800 10 monclient(hunting): authenticate will time out at 2138.498483s 2024-09-12T00:51:18.757 INFO:tasks.workunit.client.0.smithi073.stderr: -181> 2024-09-12T00:51:17.828+0000 7feaf37a2640 10 monclient(hunting): get_auth_request con 0x55a007895a70 auth_method 0 2024-09-12T00:51:18.757 INFO:tasks.workunit.client.0.smithi073.stderr: -180> 2024-09-12T00:51:17.828+0000 7feaf37a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:18.758 INFO:tasks.workunit.client.0.smithi073.stderr: -179> 2024-09-12T00:51:17.828+0000 7feaf37a2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:18.758 INFO:tasks.workunit.client.0.smithi073.stderr: -178> 2024-09-12T00:51:17.828+0000 7feaf37a2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:18.758 INFO:tasks.workunit.client.0.smithi073.stderr: -177> 2024-09-12T00:51:17.828+0000 7feaf2fa1640 10 monclient(hunting): get_auth_request con 0x55a0078999b0 auth_method 0 2024-09-12T00:51:18.758 INFO:tasks.workunit.client.0.smithi073.stderr: -176> 2024-09-12T00:51:17.828+0000 7feaf2fa1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:18.758 INFO:tasks.workunit.client.0.smithi073.stderr: -175> 2024-09-12T00:51:17.828+0000 7feaf2fa1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:18.758 INFO:tasks.workunit.client.0.smithi073.stderr: -174> 2024-09-12T00:51:17.828+0000 7feaf2fa1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:18.758 INFO:tasks.workunit.client.0.smithi073.stderr: -173> 2024-09-12T00:51:17.828+0000 7feaf37a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:18.758 INFO:tasks.workunit.client.0.smithi073.stderr: -172> 2024-09-12T00:51:17.828+0000 7feaf37a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:18.758 INFO:tasks.workunit.client.0.smithi073.stderr: -171> 2024-09-12T00:51:17.828+0000 7feaf37a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:18.758 INFO:tasks.workunit.client.0.smithi073.stderr: -170> 2024-09-12T00:51:17.828+0000 7feaf2fa1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:18.758 INFO:tasks.workunit.client.0.smithi073.stderr: -169> 2024-09-12T00:51:17.828+0000 7feaf2fa1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:18.758 INFO:tasks.workunit.client.0.smithi073.stderr: -168> 2024-09-12T00:51:17.828+0000 7feaf2fa1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:18.758 INFO:tasks.workunit.client.0.smithi073.stderr: -167> 2024-09-12T00:51:17.828+0000 7feaebfff640 10 monclient(hunting): get_auth_request con 0x55a0078c57d0 auth_method 0 2024-09-12T00:51:18.758 INFO:tasks.workunit.client.0.smithi073.stderr: -166> 2024-09-12T00:51:17.828+0000 7feaebfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:18.759 INFO:tasks.workunit.client.0.smithi073.stderr: -165> 2024-09-12T00:51:17.828+0000 7feaebfff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:18.759 INFO:tasks.workunit.client.0.smithi073.stderr: -164> 2024-09-12T00:51:17.828+0000 7feaebfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:18.759 INFO:tasks.workunit.client.0.smithi073.stderr: -163> 2024-09-12T00:51:17.828+0000 7feaf37a2640 10 monclient(hunting): handle_auth_done global_id 7365 payload 824 2024-09-12T00:51:18.759 INFO:tasks.workunit.client.0.smithi073.stderr: -162> 2024-09-12T00:51:17.828+0000 7feaf37a2640 10 monclient: _finish_hunting 0 2024-09-12T00:51:18.759 INFO:tasks.workunit.client.0.smithi073.stderr: -161> 2024-09-12T00:51:17.828+0000 7feaf37a2640 1 monclient: found mon.noname-a 2024-09-12T00:51:18.759 INFO:tasks.workunit.client.0.smithi073.stderr: -160> 2024-09-12T00:51:17.828+0000 7feaf37a2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:51:18.759 INFO:tasks.workunit.client.0.smithi073.stderr: -159> 2024-09-12T00:51:17.828+0000 7fe9d4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:18.759 INFO:tasks.workunit.client.0.smithi073.stderr: -158> 2024-09-12T00:51:17.829+0000 7fe9d4ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:51:18.759 INFO:tasks.workunit.client.0.smithi073.stderr: -157> 2024-09-12T00:51:17.829+0000 7fe9d4ff9640 10 monclient: dump: 2024-09-12T00:51:18.759 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:51:18.759 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:51:18.759 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:18.759 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:18.759 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:18.760 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:51:18.760 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:51:18.760 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:51:18.760 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:51:18.760 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:18.760 INFO:tasks.workunit.client.0.smithi073.stderr: -156> 2024-09-12T00:51:17.829+0000 7fe9d4ff9640 10 monclient: _finish_auth 0 2024-09-12T00:51:18.760 INFO:tasks.workunit.client.0.smithi073.stderr: -155> 2024-09-12T00:51:17.829+0000 7fe9d4ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:51:18.760 INFO:tasks.workunit.client.0.smithi073.stderr: -154> 2024-09-12T00:51:17.829+0000 7fe9d4ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:18.760 INFO:tasks.workunit.client.0.smithi073.stderr: -153> 2024-09-12T00:51:17.829+0000 7fe9d4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:18.760 INFO:tasks.workunit.client.0.smithi073.stderr: -152> 2024-09-12T00:51:17.829+0000 7fe9d4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:51:18.760 INFO:tasks.workunit.client.0.smithi073.stderr: -151> 2024-09-12T00:51:17.829+0000 7fe9d4ff9640 10 monclient: dump: 2024-09-12T00:51:18.760 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:51:18.760 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:51:18.761 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:18.761 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:18.761 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:18.761 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:51:18.761 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:51:18.761 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:51:18.761 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:51:18.761 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:18.761 INFO:tasks.workunit.client.0.smithi073.stderr: -150> 2024-09-12T00:51:17.829+0000 7feaf54b7800 5 monclient: authenticate success, global_id 7365 2024-09-12T00:51:18.761 INFO:tasks.workunit.client.0.smithi073.stderr: -149> 2024-09-12T00:51:17.829+0000 7fe9d67fc640 4 set_mon_vals no callback set 2024-09-12T00:51:18.761 INFO:tasks.workunit.client.0.smithi073.stderr: -148> 2024-09-12T00:51:17.829+0000 7feaf54b7800 10 monclient: _renew_subs 2024-09-12T00:51:18.761 INFO:tasks.workunit.client.0.smithi073.stderr: -147> 2024-09-12T00:51:17.829+0000 7feaf54b7800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:51:18.761 INFO:tasks.workunit.client.0.smithi073.stderr: -146> 2024-09-12T00:51:17.829+0000 7feaf54b7800 10 monclient: _renew_subs 2024-09-12T00:51:18.762 INFO:tasks.workunit.client.0.smithi073.stderr: -145> 2024-09-12T00:51:17.829+0000 7feaf54b7800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:51:18.762 INFO:tasks.workunit.client.0.smithi073.stderr: -144> 2024-09-12T00:51:17.829+0000 7feaf54b7800 1 librados: init done 2024-09-12T00:51:18.762 INFO:tasks.workunit.client.0.smithi073.stderr: -143> 2024-09-12T00:51:17.829+0000 7feaf54b7800 5 asok(0x55a0075d7630) register_command cr dump hook 0x55a0078c3fd8 2024-09-12T00:51:18.762 INFO:tasks.workunit.client.0.smithi073.stderr: -142> 2024-09-12T00:51:17.830+0000 7feaf54b7800 20 rados->read ofs=0 len=0 2024-09-12T00:51:18.762 INFO:tasks.workunit.client.0.smithi073.stderr: -141> 2024-09-12T00:51:17.830+0000 7fe9d4ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:51:18.762 INFO:tasks.workunit.client.0.smithi073.stderr: -140> 2024-09-12T00:51:17.830+0000 7fe9d4ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:51:18.762 INFO:tasks.workunit.client.0.smithi073.stderr: -139> 2024-09-12T00:51:17.830+0000 7fe9d4ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:51:18.762 INFO:tasks.workunit.client.0.smithi073.stderr: -138> 2024-09-12T00:51:17.831+0000 7feaf2fa1640 10 monclient: get_auth_request con 0x7fe9bc076470 auth_method 0 2024-09-12T00:51:18.762 INFO:tasks.workunit.client.0.smithi073.stderr: -137> 2024-09-12T00:51:17.831+0000 7feaebfff640 10 monclient: get_auth_request con 0x55a0078e39c0 auth_method 0 2024-09-12T00:51:18.763 INFO:tasks.workunit.client.0.smithi073.stderr: -136> 2024-09-12T00:51:17.831+0000 7feaf54b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:18.763 INFO:tasks.workunit.client.0.smithi073.stderr: -135> 2024-09-12T00:51:17.831+0000 7feaf54b7800 20 realm 2024-09-12T00:51:18.763 INFO:tasks.workunit.client.0.smithi073.stderr: -134> 2024-09-12T00:51:17.831+0000 7feaf54b7800 20 rados->read ofs=0 len=0 2024-09-12T00:51:18.763 INFO:tasks.workunit.client.0.smithi073.stderr: -133> 2024-09-12T00:51:17.832+0000 7feaf54b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:18.763 INFO:tasks.workunit.client.0.smithi073.stderr: -132> 2024-09-12T00:51:17.832+0000 7feaf54b7800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:18.763 INFO:tasks.workunit.client.0.smithi073.stderr: -131> 2024-09-12T00:51:17.832+0000 7feaf54b7800 20 rados->read ofs=0 len=0 2024-09-12T00:51:18.763 INFO:tasks.workunit.client.0.smithi073.stderr: -130> 2024-09-12T00:51:17.832+0000 7feaf54b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:18.763 INFO:tasks.workunit.client.0.smithi073.stderr: -129> 2024-09-12T00:51:17.832+0000 7feaf54b7800 20 rados->read ofs=0 len=0 2024-09-12T00:51:18.763 INFO:tasks.workunit.client.0.smithi073.stderr: -128> 2024-09-12T00:51:17.832+0000 7feaf2fa1640 10 monclient: get_auth_request con 0x55a0078e7ad0 auth_method 0 2024-09-12T00:51:18.763 INFO:tasks.workunit.client.0.smithi073.stderr: -127> 2024-09-12T00:51:17.833+0000 7feaf54b7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:18.763 INFO:tasks.workunit.client.0.smithi073.stderr: -126> 2024-09-12T00:51:17.833+0000 7feaf54b7800 20 rados->read ofs=0 len=0 2024-09-12T00:51:18.763 INFO:tasks.workunit.client.0.smithi073.stderr: -125> 2024-09-12T00:51:17.833+0000 7feaebfff640 10 monclient: get_auth_request con 0x55a0078eb360 auth_method 0 2024-09-12T00:51:18.764 INFO:tasks.workunit.client.0.smithi073.stderr: -124> 2024-09-12T00:51:17.834+0000 7feaf54b7800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:18.764 INFO:tasks.workunit.client.0.smithi073.stderr: -123> 2024-09-12T00:51:17.834+0000 7feaf54b7800 20 searching for the correct realm 2024-09-12T00:51:18.764 INFO:tasks.workunit.client.0.smithi073.stderr: -122> 2024-09-12T00:51:17.834+0000 7feaf37a2640 10 monclient: get_auth_request con 0x55a0078f0060 auth_method 0 2024-09-12T00:51:18.764 INFO:tasks.workunit.client.0.smithi073.stderr: -121> 2024-09-12T00:51:17.835+0000 7feaf2fa1640 10 monclient: get_auth_request con 0x7feaec069040 auth_method 0 2024-09-12T00:51:18.764 INFO:tasks.workunit.client.0.smithi073.stderr: -120> 2024-09-12T00:51:17.835+0000 7feaebfff640 10 monclient: get_auth_request con 0x7feae4049430 auth_method 0 2024-09-12T00:51:18.764 INFO:tasks.workunit.client.0.smithi073.stderr: -119> 2024-09-12T00:51:18.036+0000 7feaebfff640 10 monclient: get_auth_request con 0x7feae4049430 auth_method 0 2024-09-12T00:51:18.764 INFO:tasks.workunit.client.0.smithi073.stderr: -118> 2024-09-12T00:51:18.036+0000 7feaebfff640 0 -- 172.21.15.73:0/2458859785 >> [v2:172.21.15.73:6826/269690776,v1:172.21.15.73:6827/269690776] conn(0x7feae4049430 msgr2=0x7feae4049850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:51:18.764 INFO:tasks.workunit.client.0.smithi073.stderr: -117> 2024-09-12T00:51:18.437+0000 7feaebfff640 10 monclient: get_auth_request con 0x7feae4049430 auth_method 0 2024-09-12T00:51:18.764 INFO:tasks.workunit.client.0.smithi073.stderr: -116> 2024-09-12T00:51:18.438+0000 7feaf37a2640 10 monclient: get_auth_request con 0x7feadc018070 auth_method 0 2024-09-12T00:51:18.764 INFO:tasks.workunit.client.0.smithi073.stderr: -115> 2024-09-12T00:51:18.442+0000 7feaf2fa1640 0 -- 172.21.15.73:0/2458859785 >> [v2:172.21.15.73:6810/1807760270,v1:172.21.15.73:6811/1807760270] conn(0x7feaec0b50b0 msgr2=0x7feaec0e1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:51:18.765 INFO:tasks.workunit.client.0.smithi073.stderr: -114> 2024-09-12T00:51:18.643+0000 7feaf2fa1640 10 monclient: get_auth_request con 0x7feaec0b50b0 auth_method 0 2024-09-12T00:51:18.765 INFO:tasks.workunit.client.0.smithi073.stderr: -113> 2024-09-12T00:51:18.649+0000 7feaf54b7800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:51:18.765 INFO:tasks.workunit.client.0.smithi073.stderr: -112> 2024-09-12T00:51:18.649+0000 7feaf54b7800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:18.765 INFO:tasks.workunit.client.0.smithi073.stderr: -111> 2024-09-12T00:51:18.649+0000 7feaf54b7800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:51:18.765 INFO:tasks.workunit.client.0.smithi073.stderr: -110> 2024-09-12T00:51:18.649+0000 7feaf54b7800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:18.765 INFO:tasks.workunit.client.0.smithi073.stderr: -109> 2024-09-12T00:51:18.650+0000 7feaf54b7800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:18.765 INFO:tasks.workunit.client.0.smithi073.stderr: -108> 2024-09-12T00:51:18.650+0000 7feaf54b7800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:18.765 INFO:tasks.workunit.client.0.smithi073.stderr: -107> 2024-09-12T00:51:18.650+0000 7feaf54b7800 20 rados->read ofs=0 len=0 2024-09-12T00:51:18.765 INFO:tasks.workunit.client.0.smithi073.stderr: -106> 2024-09-12T00:51:18.650+0000 7feaf54b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:18.765 INFO:tasks.workunit.client.0.smithi073.stderr: -105> 2024-09-12T00:51:18.650+0000 7feaf54b7800 20 rados->read ofs=0 len=0 2024-09-12T00:51:18.765 INFO:tasks.workunit.client.0.smithi073.stderr: -104> 2024-09-12T00:51:18.651+0000 7feaf54b7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:18.765 INFO:tasks.workunit.client.0.smithi073.stderr: -103> 2024-09-12T00:51:18.651+0000 7feaf54b7800 20 rados->read ofs=0 len=0 2024-09-12T00:51:18.766 INFO:tasks.workunit.client.0.smithi073.stderr: -102> 2024-09-12T00:51:18.651+0000 7feaf54b7800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:18.766 INFO:tasks.workunit.client.0.smithi073.stderr: -101> 2024-09-12T00:51:18.651+0000 7feaf54b7800 20 zone default found 2024-09-12T00:51:18.766 INFO:tasks.workunit.client.0.smithi073.stderr: -100> 2024-09-12T00:51:18.651+0000 7feaf54b7800 4 Realm: () 2024-09-12T00:51:18.766 INFO:tasks.workunit.client.0.smithi073.stderr: -99> 2024-09-12T00:51:18.651+0000 7feaf54b7800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:51:18.766 INFO:tasks.workunit.client.0.smithi073.stderr: -98> 2024-09-12T00:51:18.651+0000 7feaf54b7800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:51:18.766 INFO:tasks.workunit.client.0.smithi073.stderr: -97> 2024-09-12T00:51:18.651+0000 7feaf54b7800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:18.766 INFO:tasks.workunit.client.0.smithi073.stderr: -96> 2024-09-12T00:51:18.651+0000 7feaf54b7800 20 zonegroup default 2024-09-12T00:51:18.766 INFO:tasks.workunit.client.0.smithi073.stderr: -95> 2024-09-12T00:51:18.651+0000 7feaf54b7800 20 rados->read ofs=0 len=0 2024-09-12T00:51:18.766 INFO:tasks.workunit.client.0.smithi073.stderr: -94> 2024-09-12T00:51:18.651+0000 7feaf54b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:18.766 INFO:tasks.workunit.client.0.smithi073.stderr: -93> 2024-09-12T00:51:18.651+0000 7feaf54b7800 20 rados->read ofs=0 len=0 2024-09-12T00:51:18.766 INFO:tasks.workunit.client.0.smithi073.stderr: -92> 2024-09-12T00:51:18.652+0000 7feaf54b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:18.766 INFO:tasks.workunit.client.0.smithi073.stderr: -91> 2024-09-12T00:51:18.652+0000 7feaf54b7800 20 rados->read ofs=0 len=0 2024-09-12T00:51:18.767 INFO:tasks.workunit.client.0.smithi073.stderr: -90> 2024-09-12T00:51:18.652+0000 7feaf54b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:18.767 INFO:tasks.workunit.client.0.smithi073.stderr: -89> 2024-09-12T00:51:18.652+0000 7feaf54b7800 20 started sync module instance, tier type = 2024-09-12T00:51:18.767 INFO:tasks.workunit.client.0.smithi073.stderr: -88> 2024-09-12T00:51:18.652+0000 7feaf54b7800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:51:18.767 INFO:tasks.workunit.client.0.smithi073.stderr: -87> 2024-09-12T00:51:18.662+0000 7feaf54b7800 20 add_watcher() i=0 2024-09-12T00:51:18.767 INFO:tasks.workunit.client.0.smithi073.stderr: -86> 2024-09-12T00:51:18.662+0000 7feaf54b7800 20 add_watcher() i=1 2024-09-12T00:51:18.767 INFO:tasks.workunit.client.0.smithi073.stderr: -85> 2024-09-12T00:51:18.662+0000 7feaf54b7800 20 add_watcher() i=2 2024-09-12T00:51:18.767 INFO:tasks.workunit.client.0.smithi073.stderr: -84> 2024-09-12T00:51:18.662+0000 7feaf54b7800 20 add_watcher() i=3 2024-09-12T00:51:18.767 INFO:tasks.workunit.client.0.smithi073.stderr: -83> 2024-09-12T00:51:18.662+0000 7feaf54b7800 20 add_watcher() i=4 2024-09-12T00:51:18.767 INFO:tasks.workunit.client.0.smithi073.stderr: -82> 2024-09-12T00:51:18.662+0000 7feaf54b7800 20 add_watcher() i=5 2024-09-12T00:51:18.767 INFO:tasks.workunit.client.0.smithi073.stderr: -81> 2024-09-12T00:51:18.662+0000 7feaf54b7800 20 add_watcher() i=6 2024-09-12T00:51:18.767 INFO:tasks.workunit.client.0.smithi073.stderr: -80> 2024-09-12T00:51:18.663+0000 7feaf54b7800 20 add_watcher() i=7 2024-09-12T00:51:18.767 INFO:tasks.workunit.client.0.smithi073.stderr: -79> 2024-09-12T00:51:18.663+0000 7feaf54b7800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:18.767 INFO:tasks.workunit.client.0.smithi073.stderr: -78> 2024-09-12T00:51:18.665+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436d20) adding auth protocol: cephx 2024-09-12T00:51:18.768 INFO:tasks.workunit.client.0.smithi073.stderr: -77> 2024-09-12T00:51:18.665+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436d20) adding auth protocol: cephx 2024-09-12T00:51:18.768 INFO:tasks.workunit.client.0.smithi073.stderr: -76> 2024-09-12T00:51:18.665+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436d20) adding auth protocol: cephx 2024-09-12T00:51:18.768 INFO:tasks.workunit.client.0.smithi073.stderr: -75> 2024-09-12T00:51:18.665+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436d20) adding con mode: secure 2024-09-12T00:51:18.768 INFO:tasks.workunit.client.0.smithi073.stderr: -74> 2024-09-12T00:51:18.665+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436d20) adding con mode: crc 2024-09-12T00:51:18.768 INFO:tasks.workunit.client.0.smithi073.stderr: -73> 2024-09-12T00:51:18.665+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436d20) adding con mode: secure 2024-09-12T00:51:18.768 INFO:tasks.workunit.client.0.smithi073.stderr: -72> 2024-09-12T00:51:18.665+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436d20) adding con mode: crc 2024-09-12T00:51:18.768 INFO:tasks.workunit.client.0.smithi073.stderr: -71> 2024-09-12T00:51:18.665+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436d20) adding con mode: secure 2024-09-12T00:51:18.768 INFO:tasks.workunit.client.0.smithi073.stderr: -70> 2024-09-12T00:51:18.665+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436d20) adding con mode: crc 2024-09-12T00:51:18.768 INFO:tasks.workunit.client.0.smithi073.stderr: -69> 2024-09-12T00:51:18.665+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436d20) adding con mode: crc 2024-09-12T00:51:18.768 INFO:tasks.workunit.client.0.smithi073.stderr: -68> 2024-09-12T00:51:18.665+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436d20) adding con mode: secure 2024-09-12T00:51:18.769 INFO:tasks.workunit.client.0.smithi073.stderr: -67> 2024-09-12T00:51:18.665+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436d20) adding con mode: crc 2024-09-12T00:51:18.769 INFO:tasks.workunit.client.0.smithi073.stderr: -66> 2024-09-12T00:51:18.665+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436d20) adding con mode: secure 2024-09-12T00:51:18.769 INFO:tasks.workunit.client.0.smithi073.stderr: -65> 2024-09-12T00:51:18.665+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436d20) adding con mode: crc 2024-09-12T00:51:18.769 INFO:tasks.workunit.client.0.smithi073.stderr: -64> 2024-09-12T00:51:18.665+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436d20) adding con mode: secure 2024-09-12T00:51:18.769 INFO:tasks.workunit.client.0.smithi073.stderr: -63> 2024-09-12T00:51:18.665+0000 7fe9a97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:18.769 INFO:tasks.workunit.client.0.smithi073.stderr: -62> 2024-09-12T00:51:18.666+0000 7feaf54b7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:18.769 INFO:tasks.workunit.client.0.smithi073.stderr: -61> 2024-09-12T00:51:18.666+0000 7feaf54b7800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:18.769 INFO:tasks.workunit.client.0.smithi073.stderr: -60> 2024-09-12T00:51:18.666+0000 7feaf54b7800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:18.769 INFO:tasks.workunit.client.0.smithi073.stderr: -59> 2024-09-12T00:51:18.666+0000 7feaf54b7800 5 asok(0x55a0075d7630) register_command cache list hook 0x55a007895810 2024-09-12T00:51:18.769 INFO:tasks.workunit.client.0.smithi073.stderr: -58> 2024-09-12T00:51:18.666+0000 7feaf54b7800 5 asok(0x55a0075d7630) register_command cache inspect hook 0x55a007895810 2024-09-12T00:51:18.769 INFO:tasks.workunit.client.0.smithi073.stderr: -57> 2024-09-12T00:51:18.666+0000 7feaf54b7800 5 asok(0x55a0075d7630) register_command cache erase hook 0x55a007895810 2024-09-12T00:51:18.769 INFO:tasks.workunit.client.0.smithi073.stderr: -56> 2024-09-12T00:51:18.666+0000 7feaf54b7800 5 asok(0x55a0075d7630) register_command cache zap hook 0x55a007895810 2024-09-12T00:51:18.770 INFO:tasks.workunit.client.0.smithi073.stderr: -55> 2024-09-12T00:51:18.666+0000 7feaf54b7800 5 note: GC not initialized 2024-09-12T00:51:18.770 INFO:tasks.workunit.client.0.smithi073.stderr: -54> 2024-09-12T00:51:18.666+0000 7fe923fff640 20 reqs_thread_entry: start 2024-09-12T00:51:18.770 INFO:tasks.workunit.client.0.smithi073.stderr: -53> 2024-09-12T00:51:18.666+0000 7feaf54b7800 5 asok(0x55a0075d7630) register_command sync trace show hook 0x7feae4004740 2024-09-12T00:51:18.770 INFO:tasks.workunit.client.0.smithi073.stderr: -52> 2024-09-12T00:51:18.666+0000 7feaf54b7800 5 asok(0x55a0075d7630) register_command sync trace history hook 0x7feae4004740 2024-09-12T00:51:18.770 INFO:tasks.workunit.client.0.smithi073.stderr: -51> 2024-09-12T00:51:18.666+0000 7feaf54b7800 5 asok(0x55a0075d7630) register_command sync trace active hook 0x7feae4004740 2024-09-12T00:51:18.770 INFO:tasks.workunit.client.0.smithi073.stderr: -50> 2024-09-12T00:51:18.666+0000 7feaf54b7800 5 asok(0x55a0075d7630) register_command sync trace active_short hook 0x7feae4004740 2024-09-12T00:51:18.770 INFO:tasks.workunit.client.0.smithi073.stderr: -49> 2024-09-12T00:51:18.666+0000 7feaf54b7800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:18.770 INFO:tasks.workunit.client.0.smithi073.stderr: -48> 2024-09-12T00:51:18.666+0000 7feaf54b7800 20 Filter name: none 2024-09-12T00:51:18.770 INFO:tasks.workunit.client.0.smithi073.stderr: -47> 2024-09-12T00:51:18.666+0000 7fe921ffb640 20 reqs_thread_entry: start 2024-09-12T00:51:18.770 INFO:tasks.workunit.client.0.smithi073.stderr: -46> 2024-09-12T00:51:18.666+0000 7feaf54b7800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T00:51:18.770 INFO:tasks.workunit.client.0.smithi073.stderr: -45> 2024-09-12T00:51:18.666+0000 7feaf54b7800 20 rados->read ofs=0 len=0 2024-09-12T00:51:18.770 INFO:tasks.workunit.client.0.smithi073.stderr: -44> 2024-09-12T00:51:18.667+0000 7feaf54b7800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:51:18.770 INFO:tasks.workunit.client.0.smithi073.stderr: -43> 2024-09-12T00:51:18.667+0000 7feaf54b7800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T00:51:18.771 INFO:tasks.workunit.client.0.smithi073.stderr: -42> 2024-09-12T00:51:18.667+0000 7feaf54b7800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T00:51:18.771 INFO:tasks.workunit.client.0.smithi073.stderr: -41> 2024-09-12T00:51:18.667+0000 7feaf54b7800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 : miss 2024-09-12T00:51:18.771 INFO:tasks.workunit.client.0.smithi073.stderr: -40> 2024-09-12T00:51:18.667+0000 7feaf54b7800 20 rados->read ofs=0 len=0 2024-09-12T00:51:18.771 INFO:tasks.workunit.client.0.smithi073.stderr: -39> 2024-09-12T00:51:18.667+0000 7feaf54b7800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:51:18.771 INFO:tasks.workunit.client.0.smithi073.stderr: -38> 2024-09-12T00:51:18.667+0000 7feaf54b7800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 info.flags=0x17 2024-09-12T00:51:18.771 INFO:tasks.workunit.client.0.smithi073.stderr: -37> 2024-09-12T00:51:18.667+0000 7feaf54b7800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 to cache LRU end 2024-09-12T00:51:18.771 INFO:tasks.workunit.client.0.smithi073.stderr: -36> 2024-09-12T00:51:18.667+0000 7feaf54b7800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:51:18.771 INFO:tasks.workunit.client.0.smithi073.stderr: -35> 2024-09-12T00:51:18.667+0000 7feaf54b7800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:18.771 INFO:tasks.workunit.client.0.smithi073.stderr: -34> 2024-09-12T00:51:18.667+0000 7feaf54b7800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 2024-09-12T00:51:18.771 INFO:tasks.workunit.client.0.smithi073.stderr: -33> 2024-09-12T00:51:18.672+0000 7feaf54b7800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 info.flags=0x17 2024-09-12T00:51:18.771 INFO:tasks.workunit.client.0.smithi073.stderr: -32> 2024-09-12T00:51:18.672+0000 7feaf54b7800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 to cache LRU end 2024-09-12T00:51:18.772 INFO:tasks.workunit.client.0.smithi073.stderr: -31> 2024-09-12T00:51:18.672+0000 7feaf54b7800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:18.772 INFO:tasks.workunit.client.0.smithi073.stderr: -30> 2024-09-12T00:51:18.672+0000 7feaf54b7800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32, ofs0, ns] 2024-09-12T00:51:18.772 INFO:tasks.workunit.client.0.smithi073.stderr: -29> 2024-09-12T00:51:18.672+0000 7fe9d67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497011 cookie 94145809976816 notifier 7365 bl.length()=931 2024-09-12T00:51:18.772 INFO:tasks.workunit.client.0.smithi073.stderr: -28> 2024-09-12T00:51:18.672+0000 7fe9d67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 info.flags=0x17 2024-09-12T00:51:18.772 INFO:tasks.workunit.client.0.smithi073.stderr: -27> 2024-09-12T00:51:18.672+0000 7fe9d67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 to cache LRU end 2024-09-12T00:51:18.772 INFO:tasks.workunit.client.0.smithi073.stderr: -26> 2024-09-12T00:51:18.672+0000 7fe9d67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:18.772 INFO:tasks.workunit.client.0.smithi073.stderr: -25> 2024-09-12T00:51:18.674+0000 7feaf54b7800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32]): orig_sources= new_sources= 2024-09-12T00:51:18.772 INFO:tasks.workunit.client.0.smithi073.stderr: -24> 2024-09-12T00:51:18.674+0000 7feaf54b7800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32]): potential sources added=[] removed=[] 2024-09-12T00:51:18.772 INFO:tasks.workunit.client.0.smithi073.stderr: -23> 2024-09-12T00:51:18.674+0000 7feaf54b7800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32]): orig_dests= new_dests= 2024-09-12T00:51:18.772 INFO:tasks.workunit.client.0.smithi073.stderr: -22> 2024-09-12T00:51:18.674+0000 7feaf54b7800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32]): potential dests added=[] removed=[] 2024-09-12T00:51:18.772 INFO:tasks.workunit.client.0.smithi073.stderr: -21> 2024-09-12T00:51:18.677+0000 7feaf54b7800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32.1.0 2024-09-12T00:51:18.773 INFO:tasks.workunit.client.0.smithi073.stderr: -20> 2024-09-12T00:51:18.677+0000 7feaf54b7800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32.1.0 2024-09-12T00:51:18.773 INFO:tasks.workunit.client.0.smithi073.stderr: -19> 2024-09-12T00:51:18.677+0000 7feaf54b7800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32.1.1 2024-09-12T00:51:18.773 INFO:tasks.workunit.client.0.smithi073.stderr: -18> 2024-09-12T00:51:18.677+0000 7feaf54b7800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32.1.1 2024-09-12T00:51:18.773 INFO:tasks.workunit.client.0.smithi073.stderr: -17> 2024-09-12T00:51:18.677+0000 7feaf54b7800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32.0 2024-09-12T00:51:18.773 INFO:tasks.workunit.client.0.smithi073.stderr: -16> 2024-09-12T00:51:18.680+0000 7feaf54b7800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 : hit (requested=0x17, cached=0x17) 2024-09-12T00:51:18.773 INFO:tasks.workunit.client.0.smithi073.stderr: -15> 2024-09-12T00:51:18.680+0000 7feaf54b7800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 2024-09-12T00:51:18.773 INFO:tasks.workunit.client.0.smithi073.stderr: -14> 2024-09-12T00:51:18.681+0000 7feaf54b7800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 info.flags=0x17 2024-09-12T00:51:18.773 INFO:tasks.workunit.client.0.smithi073.stderr: -13> 2024-09-12T00:51:18.681+0000 7feaf54b7800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 to cache LRU end 2024-09-12T00:51:18.773 INFO:tasks.workunit.client.0.smithi073.stderr: -12> 2024-09-12T00:51:18.681+0000 7feaf54b7800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:18.773 INFO:tasks.workunit.client.0.smithi073.stderr: -11> 2024-09-12T00:51:18.681+0000 7feaf54b7800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32, ofs0, ns] 2024-09-12T00:51:18.773 INFO:tasks.workunit.client.0.smithi073.stderr: -10> 2024-09-12T00:51:18.681+0000 7fe9d67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497012 cookie 94145809976816 notifier 7365 bl.length()=931 2024-09-12T00:51:18.773 INFO:tasks.workunit.client.0.smithi073.stderr: -9> 2024-09-12T00:51:18.681+0000 7fe9d67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 info.flags=0x17 2024-09-12T00:51:18.774 INFO:tasks.workunit.client.0.smithi073.stderr: -8> 2024-09-12T00:51:18.681+0000 7fe9d67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 to cache LRU end 2024-09-12T00:51:18.774 INFO:tasks.workunit.client.0.smithi073.stderr: -7> 2024-09-12T00:51:18.681+0000 7fe9d67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:18.774 INFO:tasks.workunit.client.0.smithi073.stderr: -6> 2024-09-12T00:51:18.683+0000 7feaf54b7800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32]): orig_sources= new_sources= 2024-09-12T00:51:18.774 INFO:tasks.workunit.client.0.smithi073.stderr: -5> 2024-09-12T00:51:18.683+0000 7feaf54b7800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32]): potential sources added=[] removed=[] 2024-09-12T00:51:18.774 INFO:tasks.workunit.client.0.smithi073.stderr: -4> 2024-09-12T00:51:18.683+0000 7feaf54b7800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32]): orig_dests= new_dests= 2024-09-12T00:51:18.774 INFO:tasks.workunit.client.0.smithi073.stderr: -3> 2024-09-12T00:51:18.683+0000 7feaf54b7800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32]): potential dests added=[] removed=[] 2024-09-12T00:51:18.774 INFO:tasks.workunit.client.0.smithi073.stderr: -2> 2024-09-12T00:51:18.684+0000 7feaf54b7800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32.0 2024-09-12T00:51:18.774 INFO:tasks.workunit.client.0.smithi073.stderr: -1> 2024-09-12T00:51:18.685+0000 7feaf54b7800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7feaf54b7800 time 2024-09-12T00:51:18.685377+0000 2024-09-12T00:51:18.774 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:51:18.774 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:18.774 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:18.774 INFO:tasks.workunit.client.0.smithi073.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7feaf898c71a] 2024-09-12T00:51:18.774 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7feaf898c8d8] 2024-09-12T00:51:18.774 INFO:tasks.workunit.client.0.smithi073.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a004e0f641] 2024-09-12T00:51:18.775 INFO:tasks.workunit.client.0.smithi073.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55a004e1f637] 2024-09-12T00:51:18.775 INFO:tasks.workunit.client.0.smithi073.stderr: 5: main() 2024-09-12T00:51:18.775 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7feaf7629590] 2024-09-12T00:51:18.775 INFO:tasks.workunit.client.0.smithi073.stderr: 7: __libc_start_main() 2024-09-12T00:51:18.775 INFO:tasks.workunit.client.0.smithi073.stderr: 8: _start() 2024-09-12T00:51:18.775 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:18.775 INFO:tasks.workunit.client.0.smithi073.stderr: 0> 2024-09-12T00:51:18.686+0000 7feaf54b7800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:51:18.775 INFO:tasks.workunit.client.0.smithi073.stderr: in thread 7feaf54b7800 thread_name:radosgw-admin 2024-09-12T00:51:18.775 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:18.775 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:18.775 INFO:tasks.workunit.client.0.smithi073.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7feaf763e6f0] 2024-09-12T00:51:18.776 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7feaf768b99c] 2024-09-12T00:51:18.776 INFO:tasks.workunit.client.0.smithi073.stderr: 3: raise() 2024-09-12T00:51:18.776 INFO:tasks.workunit.client.0.smithi073.stderr: 4: abort() 2024-09-12T00:51:18.776 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7feaf898c774] 2024-09-12T00:51:18.776 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7feaf898c8d8] 2024-09-12T00:51:18.776 INFO:tasks.workunit.client.0.smithi073.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a004e0f641] 2024-09-12T00:51:18.776 INFO:tasks.workunit.client.0.smithi073.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55a004e1f637] 2024-09-12T00:51:18.776 INFO:tasks.workunit.client.0.smithi073.stderr: 9: main() 2024-09-12T00:51:18.776 INFO:tasks.workunit.client.0.smithi073.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7feaf7629590] 2024-09-12T00:51:18.776 INFO:tasks.workunit.client.0.smithi073.stderr: 11: __libc_start_main() 2024-09-12T00:51:18.776 INFO:tasks.workunit.client.0.smithi073.stderr: 12: _start() 2024-09-12T00:51:18.776 INFO:tasks.workunit.client.0.smithi073.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:51:18.777 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:18.777 INFO:tasks.workunit.client.0.smithi073.stderr:--- logging levels --- 2024-09-12T00:51:18.777 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 none 2024-09-12T00:51:18.777 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 lockdep 2024-09-12T00:51:18.777 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 context 2024-09-12T00:51:18.777 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 crush 2024-09-12T00:51:18.777 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds 2024-09-12T00:51:18.777 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_balancer 2024-09-12T00:51:18.777 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_locker 2024-09-12T00:51:18.777 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_log 2024-09-12T00:51:18.777 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_log_expire 2024-09-12T00:51:18.777 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_migrator 2024-09-12T00:51:18.777 INFO:tasks.workunit.client.0.smithi073.stderr: 3/ 5 mds_quiesce 2024-09-12T00:51:18.778 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 buffer 2024-09-12T00:51:18.778 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 timer 2024-09-12T00:51:18.778 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 filer 2024-09-12T00:51:18.778 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 striper 2024-09-12T00:51:18.778 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 objecter 2024-09-12T00:51:18.778 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rados 2024-09-12T00:51:18.778 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd 2024-09-12T00:51:18.778 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_mirror 2024-09-12T00:51:18.778 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_replay 2024-09-12T00:51:18.778 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_pwl 2024-09-12T00:51:18.779 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 journaler 2024-09-12T00:51:18.779 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 objectcacher 2024-09-12T00:51:18.779 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:51:18.779 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 client 2024-09-12T00:51:18.779 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 osd 2024-09-12T00:51:18.779 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 optracker 2024-09-12T00:51:18.779 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 objclass 2024-09-12T00:51:18.780 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 filestore 2024-09-12T00:51:18.780 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 journal 2024-09-12T00:51:18.780 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 0 ms 2024-09-12T00:51:18.780 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mon 2024-09-12T00:51:18.780 INFO:tasks.workunit.client.0.smithi073.stderr: 0/10 monc 2024-09-12T00:51:18.780 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 paxos 2024-09-12T00:51:18.780 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 tp 2024-09-12T00:51:18.780 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 auth 2024-09-12T00:51:18.780 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 crypto 2024-09-12T00:51:18.780 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 finisher 2024-09-12T00:51:18.780 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 reserver 2024-09-12T00:51:18.780 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 heartbeatmap 2024-09-12T00:51:18.781 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 perfcounter 2024-09-12T00:51:18.781 INFO:tasks.workunit.client.0.smithi073.stderr: 20/20 rgw 2024-09-12T00:51:18.781 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_sync 2024-09-12T00:51:18.781 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_datacache 2024-09-12T00:51:18.781 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_access 2024-09-12T00:51:18.781 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:51:18.781 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_flight 2024-09-12T00:51:18.781 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:51:18.781 INFO:tasks.workunit.client.0.smithi073.stderr: 20/20 rgw_notification 2024-09-12T00:51:18.781 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 javaclient 2024-09-12T00:51:18.782 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 asok 2024-09-12T00:51:18.782 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 throttle 2024-09-12T00:51:18.782 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 0 refs 2024-09-12T00:51:18.782 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 compressor 2024-09-12T00:51:18.782 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 bluestore 2024-09-12T00:51:18.782 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 bluefs 2024-09-12T00:51:18.782 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 bdev 2024-09-12T00:51:18.782 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 kstore 2024-09-12T00:51:18.782 INFO:tasks.workunit.client.0.smithi073.stderr: 4/ 5 rocksdb 2024-09-12T00:51:18.782 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 fuse 2024-09-12T00:51:18.782 INFO:tasks.workunit.client.0.smithi073.stderr: 2/ 5 mgr 2024-09-12T00:51:18.782 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mgrc 2024-09-12T00:51:18.782 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 dpdk 2024-09-12T00:51:18.783 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 eventtrace 2024-09-12T00:51:18.783 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 prioritycache 2024-09-12T00:51:18.783 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 test 2024-09-12T00:51:18.783 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:51:18.783 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cephsqlite 2024-09-12T00:51:18.783 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:51:18.783 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore 2024-09-12T00:51:18.783 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_onode 2024-09-12T00:51:18.783 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_odata 2024-09-12T00:51:18.783 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_omap 2024-09-12T00:51:18.783 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_tm 2024-09-12T00:51:18.783 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_t 2024-09-12T00:51:18.784 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:51:18.784 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_epm 2024-09-12T00:51:18.784 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_lba 2024-09-12T00:51:18.784 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:51:18.784 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_cache 2024-09-12T00:51:18.784 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_journal 2024-09-12T00:51:18.784 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_device 2024-09-12T00:51:18.784 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_backref 2024-09-12T00:51:18.784 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 alienstore 2024-09-12T00:51:18.784 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mclock 2024-09-12T00:51:18.784 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cyanstore 2024-09-12T00:51:18.785 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 ceph_exporter 2024-09-12T00:51:18.785 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 memstore 2024-09-12T00:51:18.785 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 trace 2024-09-12T00:51:18.785 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 ceph_dedup 2024-09-12T00:51:18.785 INFO:tasks.workunit.client.0.smithi073.stderr: -2/-2 (syslog threshold) 2024-09-12T00:51:18.785 INFO:tasks.workunit.client.0.smithi073.stderr: 99/99 (stderr threshold) 2024-09-12T00:51:18.785 INFO:tasks.workunit.client.0.smithi073.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:51:18.785 INFO:tasks.workunit.client.0.smithi073.stderr: 7fe921ffb640 / http_manager 2024-09-12T00:51:18.786 INFO:tasks.workunit.client.0.smithi073.stderr: 7fe923fff640 / http_manager 2024-09-12T00:51:18.786 INFO:tasks.workunit.client.0.smithi073.stderr: 7fe9a97e2640 / rgw_dt_lg_renew 2024-09-12T00:51:18.786 INFO:tasks.workunit.client.0.smithi073.stderr: 7fe9d4ff9640 / ms_dispatch 2024-09-12T00:51:18.786 INFO:tasks.workunit.client.0.smithi073.stderr: 7fe9d67fc640 / io_context_pool 2024-09-12T00:51:18.786 INFO:tasks.workunit.client.0.smithi073.stderr: 7fe9dce01640 / ms_dispatch 2024-09-12T00:51:18.786 INFO:tasks.workunit.client.0.smithi073.stderr: 7fe9df606640 / ms_dispatch 2024-09-12T00:51:18.786 INFO:tasks.workunit.client.0.smithi073.stderr: 7fe9e0e09640 / io_context_pool 2024-09-12T00:51:18.786 INFO:tasks.workunit.client.0.smithi073.stderr: 7feaebfff640 / msgr-worker-2 2024-09-12T00:51:18.786 INFO:tasks.workunit.client.0.smithi073.stderr: 7feaf2fa1640 / msgr-worker-1 2024-09-12T00:51:18.786 INFO:tasks.workunit.client.0.smithi073.stderr: 7feaf37a2640 / msgr-worker-0 2024-09-12T00:51:18.786 INFO:tasks.workunit.client.0.smithi073.stderr: 7feaf3fa3640 / io_context_pool 2024-09-12T00:51:18.786 INFO:tasks.workunit.client.0.smithi073.stderr: 7feaf54b7800 / radosgw-admin 2024-09-12T00:51:18.786 INFO:tasks.workunit.client.0.smithi073.stderr: max_recent 500 2024-09-12T00:51:18.787 INFO:tasks.workunit.client.0.smithi073.stderr: max_new 1000 2024-09-12T00:51:18.787 INFO:tasks.workunit.client.0.smithi073.stderr: log_file /var/log/ceph/ceph-client.admin.121923.log 2024-09-12T00:51:18.787 INFO:tasks.workunit.client.0.smithi073.stderr:--- end dump of recent events --- 2024-09-12T00:51:18.787 INFO:tasks.workunit.client.0.smithi073.stderr:--- begin dump of recent events --- 2024-09-12T00:51:18.787 INFO:tasks.workunit.client.0.smithi073.stderr: -499> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 AuthRegistry(0x55a0077ff560) adding con mode: secure 2024-09-12T00:51:18.787 INFO:tasks.workunit.client.0.smithi073.stderr: -498> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 AuthRegistry(0x55a0077ff560) adding con mode: crc 2024-09-12T00:51:18.787 INFO:tasks.workunit.client.0.smithi073.stderr: -497> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 AuthRegistry(0x55a0077ff560) adding con mode: secure 2024-09-12T00:51:18.787 INFO:tasks.workunit.client.0.smithi073.stderr: -496> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 AuthRegistry(0x55a0077ff560) adding con mode: crc 2024-09-12T00:51:18.787 INFO:tasks.workunit.client.0.smithi073.stderr: -495> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 AuthRegistry(0x55a0077ff560) adding con mode: secure 2024-09-12T00:51:18.787 INFO:tasks.workunit.client.0.smithi073.stderr: -494> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 AuthRegistry(0x55a0077ff560) adding con mode: crc 2024-09-12T00:51:18.787 INFO:tasks.workunit.client.0.smithi073.stderr: -493> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 AuthRegistry(0x55a0077ff560) adding con mode: crc 2024-09-12T00:51:18.787 INFO:tasks.workunit.client.0.smithi073.stderr: -492> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 AuthRegistry(0x55a0077ff560) adding con mode: secure 2024-09-12T00:51:18.787 INFO:tasks.workunit.client.0.smithi073.stderr: -491> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 AuthRegistry(0x55a0077ff560) adding con mode: crc 2024-09-12T00:51:18.788 INFO:tasks.workunit.client.0.smithi073.stderr: -490> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 AuthRegistry(0x55a0077ff560) adding con mode: secure 2024-09-12T00:51:18.788 INFO:tasks.workunit.client.0.smithi073.stderr: -489> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 AuthRegistry(0x55a0077ff560) adding con mode: crc 2024-09-12T00:51:18.788 INFO:tasks.workunit.client.0.smithi073.stderr: -488> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 AuthRegistry(0x55a0077ff560) adding con mode: secure 2024-09-12T00:51:18.788 INFO:tasks.workunit.client.0.smithi073.stderr: -487> 2024-09-12T00:51:17.814+0000 7feaf54b7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:18.788 INFO:tasks.workunit.client.0.smithi073.stderr: -486> 2024-09-12T00:51:17.814+0000 7feaf54b7800 1 librados: starting msgr at 2024-09-12T00:51:18.788 INFO:tasks.workunit.client.0.smithi073.stderr: -485> 2024-09-12T00:51:17.814+0000 7feaf54b7800 1 librados: starting objecter 2024-09-12T00:51:18.788 INFO:tasks.workunit.client.0.smithi073.stderr: -484> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 asok(0x55a0075d7630) register_command objecter_requests hook 0x55a0076836c0 2024-09-12T00:51:18.788 INFO:tasks.workunit.client.0.smithi073.stderr: -483> 2024-09-12T00:51:17.814+0000 7feaf54b7800 1 librados: setting wanted keys 2024-09-12T00:51:18.788 INFO:tasks.workunit.client.0.smithi073.stderr: -482> 2024-09-12T00:51:17.814+0000 7feaf54b7800 1 librados: calling monclient init 2024-09-12T00:51:18.788 INFO:tasks.workunit.client.0.smithi073.stderr: -481> 2024-09-12T00:51:17.814+0000 7feaf54b7800 10 monclient: init 2024-09-12T00:51:18.788 INFO:tasks.workunit.client.0.smithi073.stderr: -480> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 AuthRegistry(0x55a0077f9a00) adding auth protocol: cephx 2024-09-12T00:51:18.788 INFO:tasks.workunit.client.0.smithi073.stderr: -479> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 AuthRegistry(0x55a0077f9a00) adding auth protocol: cephx 2024-09-12T00:51:18.788 INFO:tasks.workunit.client.0.smithi073.stderr: -478> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 AuthRegistry(0x55a0077f9a00) adding auth protocol: cephx 2024-09-12T00:51:18.789 INFO:tasks.workunit.client.0.smithi073.stderr: -477> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 AuthRegistry(0x55a0077f9a00) adding con mode: secure 2024-09-12T00:51:18.789 INFO:tasks.workunit.client.0.smithi073.stderr: -476> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 AuthRegistry(0x55a0077f9a00) adding con mode: crc 2024-09-12T00:51:18.789 INFO:tasks.workunit.client.0.smithi073.stderr: -475> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 AuthRegistry(0x55a0077f9a00) adding con mode: secure 2024-09-12T00:51:18.789 INFO:tasks.workunit.client.0.smithi073.stderr: -474> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 AuthRegistry(0x55a0077f9a00) adding con mode: crc 2024-09-12T00:51:18.789 INFO:tasks.workunit.client.0.smithi073.stderr: -473> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 AuthRegistry(0x55a0077f9a00) adding con mode: secure 2024-09-12T00:51:18.789 INFO:tasks.workunit.client.0.smithi073.stderr: -472> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 AuthRegistry(0x55a0077f9a00) adding con mode: crc 2024-09-12T00:51:18.789 INFO:tasks.workunit.client.0.smithi073.stderr: -471> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 AuthRegistry(0x55a0077f9a00) adding con mode: crc 2024-09-12T00:51:18.789 INFO:tasks.workunit.client.0.smithi073.stderr: -470> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 AuthRegistry(0x55a0077f9a00) adding con mode: secure 2024-09-12T00:51:18.789 INFO:tasks.workunit.client.0.smithi073.stderr: -469> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 AuthRegistry(0x55a0077f9a00) adding con mode: crc 2024-09-12T00:51:18.789 INFO:tasks.workunit.client.0.smithi073.stderr: -468> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 AuthRegistry(0x55a0077f9a00) adding con mode: secure 2024-09-12T00:51:18.790 INFO:tasks.workunit.client.0.smithi073.stderr: -467> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 AuthRegistry(0x55a0077f9a00) adding con mode: crc 2024-09-12T00:51:18.790 INFO:tasks.workunit.client.0.smithi073.stderr: -466> 2024-09-12T00:51:17.814+0000 7feaf54b7800 5 AuthRegistry(0x55a0077f9a00) adding con mode: secure 2024-09-12T00:51:18.790 INFO:tasks.workunit.client.0.smithi073.stderr: -465> 2024-09-12T00:51:17.815+0000 7feaf54b7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:18.790 INFO:tasks.workunit.client.0.smithi073.stderr: -464> 2024-09-12T00:51:17.815+0000 7feaf54b7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:18.790 INFO:tasks.workunit.client.0.smithi073.stderr: -463> 2024-09-12T00:51:17.815+0000 7feaf54b7800 5 asok(0x55a0075d7630) register_command rotate-key hook 0x55a0077f9b48 2024-09-12T00:51:18.790 INFO:tasks.workunit.client.0.smithi073.stderr: -462> 2024-09-12T00:51:17.815+0000 7feaf54b7800 10 monclient: _reopen_session rank -1 2024-09-12T00:51:18.790 INFO:tasks.workunit.client.0.smithi073.stderr: -461> 2024-09-12T00:51:17.815+0000 7feaf54b7800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:51:18.790 INFO:tasks.workunit.client.0.smithi073.stderr: -460> 2024-09-12T00:51:17.815+0000 7feaf54b7800 10 monclient(hunting): picked mon.noname-b con 0x55a0077396c0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:51:18.790 INFO:tasks.workunit.client.0.smithi073.stderr: -459> 2024-09-12T00:51:17.815+0000 7feaf54b7800 10 monclient(hunting): picked mon.noname-a con 0x55a00773f8a0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:51:18.790 INFO:tasks.workunit.client.0.smithi073.stderr: -458> 2024-09-12T00:51:17.815+0000 7feaf54b7800 10 monclient(hunting): picked mon.noname-c con 0x55a0077481a0 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:51:18.790 INFO:tasks.workunit.client.0.smithi073.stderr: -457> 2024-09-12T00:51:17.815+0000 7feaf54b7800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:18.790 INFO:tasks.workunit.client.0.smithi073.stderr: -456> 2024-09-12T00:51:17.815+0000 7feaf54b7800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:18.790 INFO:tasks.workunit.client.0.smithi073.stderr: -455> 2024-09-12T00:51:17.815+0000 7feaf54b7800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:18.791 INFO:tasks.workunit.client.0.smithi073.stderr: -454> 2024-09-12T00:51:17.815+0000 7feaf54b7800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:18.791 INFO:tasks.workunit.client.0.smithi073.stderr: -453> 2024-09-12T00:51:17.815+0000 7feaf54b7800 10 monclient(hunting): authenticate will time out at 2138.485438s 2024-09-12T00:51:18.791 INFO:tasks.workunit.client.0.smithi073.stderr: -452> 2024-09-12T00:51:17.815+0000 7feaebfff640 10 monclient(hunting): get_auth_request con 0x55a00773f8a0 auth_method 0 2024-09-12T00:51:18.791 INFO:tasks.workunit.client.0.smithi073.stderr: -451> 2024-09-12T00:51:17.815+0000 7feaebfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:18.791 INFO:tasks.workunit.client.0.smithi073.stderr: -450> 2024-09-12T00:51:17.815+0000 7feaebfff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:18.791 INFO:tasks.workunit.client.0.smithi073.stderr: -449> 2024-09-12T00:51:17.815+0000 7feaebfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:18.791 INFO:tasks.workunit.client.0.smithi073.stderr: -448> 2024-09-12T00:51:17.815+0000 7feaf37a2640 10 monclient(hunting): get_auth_request con 0x55a0077481a0 auth_method 0 2024-09-12T00:51:18.791 INFO:tasks.workunit.client.0.smithi073.stderr: -447> 2024-09-12T00:51:17.815+0000 7feaf37a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:18.791 INFO:tasks.workunit.client.0.smithi073.stderr: -446> 2024-09-12T00:51:17.815+0000 7feaf37a2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:18.791 INFO:tasks.workunit.client.0.smithi073.stderr: -445> 2024-09-12T00:51:17.815+0000 7feaf37a2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:18.791 INFO:tasks.workunit.client.0.smithi073.stderr: -444> 2024-09-12T00:51:17.815+0000 7feaebfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:18.791 INFO:tasks.workunit.client.0.smithi073.stderr: -443> 2024-09-12T00:51:17.815+0000 7feaebfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:18.791 INFO:tasks.workunit.client.0.smithi073.stderr: -442> 2024-09-12T00:51:17.815+0000 7feaebfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:18.792 INFO:tasks.workunit.client.0.smithi073.stderr: -441> 2024-09-12T00:51:17.815+0000 7feaf37a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:18.792 INFO:tasks.workunit.client.0.smithi073.stderr: -440> 2024-09-12T00:51:17.815+0000 7feaf37a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:18.792 INFO:tasks.workunit.client.0.smithi073.stderr: -439> 2024-09-12T00:51:17.815+0000 7feaf37a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:18.792 INFO:tasks.workunit.client.0.smithi073.stderr: -438> 2024-09-12T00:51:17.815+0000 7feaebfff640 10 monclient(hunting): handle_auth_done global_id 7356 payload 824 2024-09-12T00:51:18.792 INFO:tasks.workunit.client.0.smithi073.stderr: -437> 2024-09-12T00:51:17.815+0000 7feaebfff640 10 monclient: _finish_hunting 0 2024-09-12T00:51:18.792 INFO:tasks.workunit.client.0.smithi073.stderr: -436> 2024-09-12T00:51:17.815+0000 7feaebfff640 1 monclient: found mon.noname-a 2024-09-12T00:51:18.792 INFO:tasks.workunit.client.0.smithi073.stderr: -435> 2024-09-12T00:51:17.815+0000 7feaebfff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:51:18.792 INFO:tasks.workunit.client.0.smithi073.stderr: -434> 2024-09-12T00:51:17.815+0000 7fe9df606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:18.792 INFO:tasks.workunit.client.0.smithi073.stderr: -433> 2024-09-12T00:51:17.815+0000 7fe9df606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:51:18.793 INFO:tasks.workunit.client.0.smithi073.stderr: -432> 2024-09-12T00:51:17.816+0000 7fe9df606640 10 monclient: dump: 2024-09-12T00:51:18.793 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:51:18.793 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:51:18.793 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:18.793 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:18.793 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:18.793 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:51:18.793 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:51:18.793 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:51:18.793 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:51:18.793 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:18.794 INFO:tasks.workunit.client.0.smithi073.stderr: -431> 2024-09-12T00:51:17.816+0000 7fe9df606640 10 monclient: _finish_auth 0 2024-09-12T00:51:18.794 INFO:tasks.workunit.client.0.smithi073.stderr: -430> 2024-09-12T00:51:17.816+0000 7fe9df606640 10 monclient: _check_auth_tickets 2024-09-12T00:51:18.794 INFO:tasks.workunit.client.0.smithi073.stderr: -429> 2024-09-12T00:51:17.816+0000 7fe9df606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:18.794 INFO:tasks.workunit.client.0.smithi073.stderr: -428> 2024-09-12T00:51:17.816+0000 7fe9df606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:18.794 INFO:tasks.workunit.client.0.smithi073.stderr: -427> 2024-09-12T00:51:17.816+0000 7fe9df606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:51:18.794 INFO:tasks.workunit.client.0.smithi073.stderr: -426> 2024-09-12T00:51:17.816+0000 7fe9df606640 10 monclient: dump: 2024-09-12T00:51:18.794 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:51:18.794 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:51:18.794 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:18.794 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:18.794 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:18.794 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:51:18.795 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:51:18.795 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:51:18.795 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:51:18.795 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:18.795 INFO:tasks.workunit.client.0.smithi073.stderr: -425> 2024-09-12T00:51:17.816+0000 7feaf54b7800 5 monclient: authenticate success, global_id 7356 2024-09-12T00:51:18.795 INFO:tasks.workunit.client.0.smithi073.stderr: -424> 2024-09-12T00:51:17.816+0000 7feaf54b7800 10 monclient: _renew_subs 2024-09-12T00:51:18.795 INFO:tasks.workunit.client.0.smithi073.stderr: -423> 2024-09-12T00:51:17.816+0000 7fe9e0e09640 4 set_mon_vals no callback set 2024-09-12T00:51:18.795 INFO:tasks.workunit.client.0.smithi073.stderr: -422> 2024-09-12T00:51:17.816+0000 7feaf54b7800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:51:18.795 INFO:tasks.workunit.client.0.smithi073.stderr: -421> 2024-09-12T00:51:17.816+0000 7feaf54b7800 10 monclient: _renew_subs 2024-09-12T00:51:18.795 INFO:tasks.workunit.client.0.smithi073.stderr: -420> 2024-09-12T00:51:17.816+0000 7feaf54b7800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:51:18.795 INFO:tasks.workunit.client.0.smithi073.stderr: -419> 2024-09-12T00:51:17.816+0000 7feaf54b7800 1 librados: init done 2024-09-12T00:51:18.795 INFO:tasks.workunit.client.0.smithi073.stderr: -418> 2024-09-12T00:51:17.818+0000 7fe9df606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:51:18.795 INFO:tasks.workunit.client.0.smithi073.stderr: -417> 2024-09-12T00:51:17.818+0000 7fe9df606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:51:18.796 INFO:tasks.workunit.client.0.smithi073.stderr: -416> 2024-09-12T00:51:17.818+0000 7fe9df606640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:51:18.796 INFO:tasks.workunit.client.0.smithi073.stderr: -415> 2024-09-12T00:51:17.818+0000 7feaf2fa1640 10 monclient: get_auth_request con 0x7fe9d8076470 auth_method 0 2024-09-12T00:51:18.796 INFO:tasks.workunit.client.0.smithi073.stderr: -414> 2024-09-12T00:51:17.818+0000 7feaf37a2640 10 monclient: get_auth_request con 0x55a007821d90 auth_method 0 2024-09-12T00:51:18.796 INFO:tasks.workunit.client.0.smithi073.stderr: -413> 2024-09-12T00:51:17.819+0000 7feaf2fa1640 10 monclient: get_auth_request con 0x55a007844fe0 auth_method 0 2024-09-12T00:51:18.796 INFO:tasks.workunit.client.0.smithi073.stderr: -412> 2024-09-12T00:51:17.819+0000 7feaebfff640 10 monclient: get_auth_request con 0x55a007849470 auth_method 0 2024-09-12T00:51:18.796 INFO:tasks.workunit.client.0.smithi073.stderr: -411> 2024-09-12T00:51:17.821+0000 7feaf54b7800 10 monclient: build_initial_monmap 2024-09-12T00:51:18.796 INFO:tasks.workunit.client.0.smithi073.stderr: -410> 2024-09-12T00:51:17.821+0000 7feaf54b7800 1 build_initial for_mkfs: 0 2024-09-12T00:51:18.796 INFO:tasks.workunit.client.0.smithi073.stderr: -409> 2024-09-12T00:51:17.821+0000 7feaf54b7800 10 monclient: monmap: 2024-09-12T00:51:18.796 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:51:18.796 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:51:18.796 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:51:18.796 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:51:18.796 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:51:18.797 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:51:18.797 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:51:18.797 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:51:18.797 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:51:18.797 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:18.797 INFO:tasks.workunit.client.0.smithi073.stderr: -408> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784e3e0) adding auth protocol: cephx 2024-09-12T00:51:18.797 INFO:tasks.workunit.client.0.smithi073.stderr: -407> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784e3e0) adding auth protocol: cephx 2024-09-12T00:51:18.797 INFO:tasks.workunit.client.0.smithi073.stderr: -406> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784e3e0) adding auth protocol: cephx 2024-09-12T00:51:18.797 INFO:tasks.workunit.client.0.smithi073.stderr: -405> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784e3e0) adding con mode: secure 2024-09-12T00:51:18.797 INFO:tasks.workunit.client.0.smithi073.stderr: -404> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784e3e0) adding con mode: crc 2024-09-12T00:51:18.797 INFO:tasks.workunit.client.0.smithi073.stderr: -403> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784e3e0) adding con mode: secure 2024-09-12T00:51:18.797 INFO:tasks.workunit.client.0.smithi073.stderr: -402> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784e3e0) adding con mode: crc 2024-09-12T00:51:18.798 INFO:tasks.workunit.client.0.smithi073.stderr: -401> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784e3e0) adding con mode: secure 2024-09-12T00:51:18.798 INFO:tasks.workunit.client.0.smithi073.stderr: -400> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784e3e0) adding con mode: crc 2024-09-12T00:51:18.798 INFO:tasks.workunit.client.0.smithi073.stderr: -399> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784e3e0) adding con mode: crc 2024-09-12T00:51:18.798 INFO:tasks.workunit.client.0.smithi073.stderr: -398> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784e3e0) adding con mode: secure 2024-09-12T00:51:18.798 INFO:tasks.workunit.client.0.smithi073.stderr: -397> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784e3e0) adding con mode: crc 2024-09-12T00:51:18.798 INFO:tasks.workunit.client.0.smithi073.stderr: -396> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784e3e0) adding con mode: secure 2024-09-12T00:51:18.798 INFO:tasks.workunit.client.0.smithi073.stderr: -395> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784e3e0) adding con mode: crc 2024-09-12T00:51:18.798 INFO:tasks.workunit.client.0.smithi073.stderr: -394> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784e3e0) adding con mode: secure 2024-09-12T00:51:18.798 INFO:tasks.workunit.client.0.smithi073.stderr: -393> 2024-09-12T00:51:17.821+0000 7feaf54b7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:18.798 INFO:tasks.workunit.client.0.smithi073.stderr: -392> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 asok(0x55a0075d7630) register_command objecter_requests cmddesc objecter_requests hook 0x55a007851850 EEXIST 2024-09-12T00:51:18.798 INFO:tasks.workunit.client.0.smithi073.stderr: -391> 2024-09-12T00:51:17.821+0000 7feaf54b7800 10 monclient: init 2024-09-12T00:51:18.798 INFO:tasks.workunit.client.0.smithi073.stderr: -390> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784ca08) adding auth protocol: cephx 2024-09-12T00:51:18.798 INFO:tasks.workunit.client.0.smithi073.stderr: -389> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784ca08) adding auth protocol: cephx 2024-09-12T00:51:18.799 INFO:tasks.workunit.client.0.smithi073.stderr: -388> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784ca08) adding auth protocol: cephx 2024-09-12T00:51:18.799 INFO:tasks.workunit.client.0.smithi073.stderr: -387> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784ca08) adding con mode: secure 2024-09-12T00:51:18.799 INFO:tasks.workunit.client.0.smithi073.stderr: -386> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784ca08) adding con mode: crc 2024-09-12T00:51:18.799 INFO:tasks.workunit.client.0.smithi073.stderr: -385> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784ca08) adding con mode: secure 2024-09-12T00:51:18.799 INFO:tasks.workunit.client.0.smithi073.stderr: -384> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784ca08) adding con mode: crc 2024-09-12T00:51:18.799 INFO:tasks.workunit.client.0.smithi073.stderr: -383> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784ca08) adding con mode: secure 2024-09-12T00:51:18.799 INFO:tasks.workunit.client.0.smithi073.stderr: -382> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784ca08) adding con mode: crc 2024-09-12T00:51:18.799 INFO:tasks.workunit.client.0.smithi073.stderr: -381> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784ca08) adding con mode: crc 2024-09-12T00:51:18.799 INFO:tasks.workunit.client.0.smithi073.stderr: -380> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784ca08) adding con mode: secure 2024-09-12T00:51:18.799 INFO:tasks.workunit.client.0.smithi073.stderr: -379> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784ca08) adding con mode: crc 2024-09-12T00:51:18.799 INFO:tasks.workunit.client.0.smithi073.stderr: -378> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784ca08) adding con mode: secure 2024-09-12T00:51:18.799 INFO:tasks.workunit.client.0.smithi073.stderr: -377> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784ca08) adding con mode: crc 2024-09-12T00:51:18.800 INFO:tasks.workunit.client.0.smithi073.stderr: -376> 2024-09-12T00:51:17.821+0000 7feaf54b7800 5 AuthRegistry(0x55a00784ca08) adding con mode: secure 2024-09-12T00:51:18.800 INFO:tasks.workunit.client.0.smithi073.stderr: -375> 2024-09-12T00:51:17.822+0000 7feaf54b7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:18.800 INFO:tasks.workunit.client.0.smithi073.stderr: -374> 2024-09-12T00:51:17.822+0000 7feaf54b7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:18.800 INFO:tasks.workunit.client.0.smithi073.stderr: -373> 2024-09-12T00:51:17.822+0000 7feaf54b7800 5 asok(0x55a0075d7630) register_command rotate-key cmddesc rotate-key hook 0x55a00784cb50 EEXIST 2024-09-12T00:51:18.800 INFO:tasks.workunit.client.0.smithi073.stderr: -372> 2024-09-12T00:51:17.822+0000 7feaf54b7800 10 monclient: _reopen_session rank -1 2024-09-12T00:51:18.800 INFO:tasks.workunit.client.0.smithi073.stderr: -371> 2024-09-12T00:51:17.822+0000 7feaf54b7800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:51:18.800 INFO:tasks.workunit.client.0.smithi073.stderr: -370> 2024-09-12T00:51:17.822+0000 7feaf54b7800 10 monclient(hunting): picked mon.noname-c con 0x55a007875b70 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:51:18.800 INFO:tasks.workunit.client.0.smithi073.stderr: -369> 2024-09-12T00:51:17.822+0000 7feaf54b7800 10 monclient(hunting): picked mon.noname-b con 0x55a007875f50 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:51:18.800 INFO:tasks.workunit.client.0.smithi073.stderr: -368> 2024-09-12T00:51:17.822+0000 7feaf54b7800 10 monclient(hunting): picked mon.noname-a con 0x55a007874880 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:51:18.800 INFO:tasks.workunit.client.0.smithi073.stderr: -367> 2024-09-12T00:51:17.822+0000 7feaf54b7800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:18.800 INFO:tasks.workunit.client.0.smithi073.stderr: -366> 2024-09-12T00:51:17.822+0000 7feaf54b7800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:18.800 INFO:tasks.workunit.client.0.smithi073.stderr: -365> 2024-09-12T00:51:17.822+0000 7feaf54b7800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:18.801 INFO:tasks.workunit.client.0.smithi073.stderr: -364> 2024-09-12T00:51:17.822+0000 7feaf54b7800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:18.801 INFO:tasks.workunit.client.0.smithi073.stderr: -363> 2024-09-12T00:51:17.822+0000 7feaf54b7800 10 monclient(hunting): authenticate will time out at 2138.492424s 2024-09-12T00:51:18.801 INFO:tasks.workunit.client.0.smithi073.stderr: -362> 2024-09-12T00:51:17.822+0000 7feaf2fa1640 10 monclient(hunting): get_auth_request con 0x55a007875b70 auth_method 0 2024-09-12T00:51:18.801 INFO:tasks.workunit.client.0.smithi073.stderr: -361> 2024-09-12T00:51:17.822+0000 7feaf2fa1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:18.801 INFO:tasks.workunit.client.0.smithi073.stderr: -360> 2024-09-12T00:51:17.822+0000 7feaf2fa1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:18.801 INFO:tasks.workunit.client.0.smithi073.stderr: -359> 2024-09-12T00:51:17.822+0000 7feaf2fa1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:18.801 INFO:tasks.workunit.client.0.smithi073.stderr: -358> 2024-09-12T00:51:17.822+0000 7feaf37a2640 10 monclient(hunting): get_auth_request con 0x55a007874880 auth_method 0 2024-09-12T00:51:18.801 INFO:tasks.workunit.client.0.smithi073.stderr: -357> 2024-09-12T00:51:17.822+0000 7feaf37a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:18.801 INFO:tasks.workunit.client.0.smithi073.stderr: -356> 2024-09-12T00:51:17.822+0000 7feaf37a2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:18.801 INFO:tasks.workunit.client.0.smithi073.stderr: -355> 2024-09-12T00:51:17.822+0000 7feaf37a2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:18.801 INFO:tasks.workunit.client.0.smithi073.stderr: -354> 2024-09-12T00:51:17.822+0000 7feaebfff640 10 monclient(hunting): get_auth_request con 0x55a007875f50 auth_method 0 2024-09-12T00:51:18.801 INFO:tasks.workunit.client.0.smithi073.stderr: -353> 2024-09-12T00:51:17.822+0000 7feaebfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:18.802 INFO:tasks.workunit.client.0.smithi073.stderr: -352> 2024-09-12T00:51:17.822+0000 7feaebfff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:18.802 INFO:tasks.workunit.client.0.smithi073.stderr: -351> 2024-09-12T00:51:17.822+0000 7feaebfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:18.802 INFO:tasks.workunit.client.0.smithi073.stderr: -350> 2024-09-12T00:51:17.822+0000 7feaf2fa1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:18.802 INFO:tasks.workunit.client.0.smithi073.stderr: -349> 2024-09-12T00:51:17.822+0000 7feaf2fa1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:18.802 INFO:tasks.workunit.client.0.smithi073.stderr: -348> 2024-09-12T00:51:17.822+0000 7feaf2fa1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:18.802 INFO:tasks.workunit.client.0.smithi073.stderr: -347> 2024-09-12T00:51:17.822+0000 7feaf37a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:18.802 INFO:tasks.workunit.client.0.smithi073.stderr: -346> 2024-09-12T00:51:17.822+0000 7feaf37a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:18.802 INFO:tasks.workunit.client.0.smithi073.stderr: -345> 2024-09-12T00:51:17.822+0000 7feaf37a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:18.802 INFO:tasks.workunit.client.0.smithi073.stderr: -344> 2024-09-12T00:51:17.822+0000 7feaebfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:18.802 INFO:tasks.workunit.client.0.smithi073.stderr: -343> 2024-09-12T00:51:17.822+0000 7feaebfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:18.802 INFO:tasks.workunit.client.0.smithi073.stderr: -342> 2024-09-12T00:51:17.822+0000 7feaebfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:18.802 INFO:tasks.workunit.client.0.smithi073.stderr: -341> 2024-09-12T00:51:17.822+0000 7feaf37a2640 10 monclient(hunting): handle_auth_done global_id 7359 payload 824 2024-09-12T00:51:18.802 INFO:tasks.workunit.client.0.smithi073.stderr: -340> 2024-09-12T00:51:17.822+0000 7feaf37a2640 10 monclient: _finish_hunting 0 2024-09-12T00:51:18.802 INFO:tasks.workunit.client.0.smithi073.stderr: -339> 2024-09-12T00:51:17.822+0000 7feaf37a2640 1 monclient: found mon.noname-a 2024-09-12T00:51:18.803 INFO:tasks.workunit.client.0.smithi073.stderr: -338> 2024-09-12T00:51:17.822+0000 7feaf37a2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:51:18.803 INFO:tasks.workunit.client.0.smithi073.stderr: -337> 2024-09-12T00:51:17.823+0000 7fe9dce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:18.803 INFO:tasks.workunit.client.0.smithi073.stderr: -336> 2024-09-12T00:51:17.823+0000 7fe9dce01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:51:18.803 INFO:tasks.workunit.client.0.smithi073.stderr: -335> 2024-09-12T00:51:17.823+0000 7fe9dce01640 10 monclient: dump: 2024-09-12T00:51:18.803 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:51:18.803 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:51:18.803 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:18.803 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:18.803 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:18.803 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:51:18.803 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:51:18.803 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:51:18.804 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:51:18.804 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:18.804 INFO:tasks.workunit.client.0.smithi073.stderr: -334> 2024-09-12T00:51:17.823+0000 7fe9dce01640 10 monclient: _finish_auth 0 2024-09-12T00:51:18.804 INFO:tasks.workunit.client.0.smithi073.stderr: -333> 2024-09-12T00:51:17.823+0000 7fe9dce01640 10 monclient: _check_auth_tickets 2024-09-12T00:51:18.804 INFO:tasks.workunit.client.0.smithi073.stderr: -332> 2024-09-12T00:51:17.823+0000 7fe9dce01640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:18.804 INFO:tasks.workunit.client.0.smithi073.stderr: -331> 2024-09-12T00:51:17.823+0000 7fe9dce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:18.804 INFO:tasks.workunit.client.0.smithi073.stderr: -330> 2024-09-12T00:51:17.823+0000 7fe9dce01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:51:18.804 INFO:tasks.workunit.client.0.smithi073.stderr: -329> 2024-09-12T00:51:17.823+0000 7fe9dce01640 10 monclient: dump: 2024-09-12T00:51:18.804 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:51:18.804 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:51:18.804 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:18.804 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:18.804 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:18.805 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:51:18.805 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:51:18.805 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:51:18.805 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:51:18.805 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:18.805 INFO:tasks.workunit.client.0.smithi073.stderr: -328> 2024-09-12T00:51:17.823+0000 7feaf54b7800 5 monclient: authenticate success, global_id 7359 2024-09-12T00:51:18.805 INFO:tasks.workunit.client.0.smithi073.stderr: -327> 2024-09-12T00:51:17.823+0000 7feaf54b7800 10 monclient: _renew_subs 2024-09-12T00:51:18.805 INFO:tasks.workunit.client.0.smithi073.stderr: -326> 2024-09-12T00:51:17.823+0000 7feaf54b7800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:51:18.805 INFO:tasks.workunit.client.0.smithi073.stderr: -325> 2024-09-12T00:51:17.823+0000 7feaf3fa3640 4 set_mon_vals no callback set 2024-09-12T00:51:18.805 INFO:tasks.workunit.client.0.smithi073.stderr: -324> 2024-09-12T00:51:17.823+0000 7feaf54b7800 10 monclient: _renew_subs 2024-09-12T00:51:18.805 INFO:tasks.workunit.client.0.smithi073.stderr: -323> 2024-09-12T00:51:17.823+0000 7feaf54b7800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:51:18.805 INFO:tasks.workunit.client.0.smithi073.stderr: -322> 2024-09-12T00:51:17.824+0000 7fe9dce01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:51:18.805 INFO:tasks.workunit.client.0.smithi073.stderr: -321> 2024-09-12T00:51:17.824+0000 7fe9dce01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:51:18.806 INFO:tasks.workunit.client.0.smithi073.stderr: -320> 2024-09-12T00:51:17.824+0000 7fe9dce01640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:51:18.806 INFO:tasks.workunit.client.0.smithi073.stderr: -319> 2024-09-12T00:51:17.825+0000 7feaf2fa1640 10 monclient: get_auth_request con 0x7fe9cc076380 auth_method 0 2024-09-12T00:51:18.806 INFO:tasks.workunit.client.0.smithi073.stderr: -318> 2024-09-12T00:51:17.825+0000 7feaf54b7800 10 monclient: get_monmap_and_config 2024-09-12T00:51:18.806 INFO:tasks.workunit.client.0.smithi073.stderr: -317> 2024-09-12T00:51:17.825+0000 7feaf54b7800 10 monclient: build_initial_monmap 2024-09-12T00:51:18.806 INFO:tasks.workunit.client.0.smithi073.stderr: -316> 2024-09-12T00:51:17.825+0000 7feaf54b7800 1 build_initial for_mkfs: 0 2024-09-12T00:51:18.806 INFO:tasks.workunit.client.0.smithi073.stderr: -315> 2024-09-12T00:51:17.825+0000 7feaf54b7800 10 monclient: monmap: 2024-09-12T00:51:18.806 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:51:18.806 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:51:18.806 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:51:18.806 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:51:18.806 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:51:18.806 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:51:18.806 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:51:18.806 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:51:18.807 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:51:18.807 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:18.807 INFO:tasks.workunit.client.0.smithi073.stderr: -314> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x55a0078958a0) adding auth protocol: cephx 2024-09-12T00:51:18.807 INFO:tasks.workunit.client.0.smithi073.stderr: -313> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x55a0078958a0) adding auth protocol: cephx 2024-09-12T00:51:18.807 INFO:tasks.workunit.client.0.smithi073.stderr: -312> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x55a0078958a0) adding auth protocol: cephx 2024-09-12T00:51:18.807 INFO:tasks.workunit.client.0.smithi073.stderr: -311> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x55a0078958a0) adding con mode: secure 2024-09-12T00:51:18.807 INFO:tasks.workunit.client.0.smithi073.stderr: -310> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x55a0078958a0) adding con mode: crc 2024-09-12T00:51:18.807 INFO:tasks.workunit.client.0.smithi073.stderr: -309> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x55a0078958a0) adding con mode: secure 2024-09-12T00:51:18.807 INFO:tasks.workunit.client.0.smithi073.stderr: -308> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x55a0078958a0) adding con mode: crc 2024-09-12T00:51:18.807 INFO:tasks.workunit.client.0.smithi073.stderr: -307> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x55a0078958a0) adding con mode: secure 2024-09-12T00:51:18.807 INFO:tasks.workunit.client.0.smithi073.stderr: -306> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x55a0078958a0) adding con mode: crc 2024-09-12T00:51:18.807 INFO:tasks.workunit.client.0.smithi073.stderr: -305> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x55a0078958a0) adding con mode: crc 2024-09-12T00:51:18.807 INFO:tasks.workunit.client.0.smithi073.stderr: -304> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x55a0078958a0) adding con mode: secure 2024-09-12T00:51:18.808 INFO:tasks.workunit.client.0.smithi073.stderr: -303> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x55a0078958a0) adding con mode: crc 2024-09-12T00:51:18.808 INFO:tasks.workunit.client.0.smithi073.stderr: -302> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x55a0078958a0) adding con mode: secure 2024-09-12T00:51:18.808 INFO:tasks.workunit.client.0.smithi073.stderr: -301> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x55a0078958a0) adding con mode: crc 2024-09-12T00:51:18.808 INFO:tasks.workunit.client.0.smithi073.stderr: -300> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x55a0078958a0) adding con mode: secure 2024-09-12T00:51:18.808 INFO:tasks.workunit.client.0.smithi073.stderr: -299> 2024-09-12T00:51:17.825+0000 7feaf54b7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:18.808 INFO:tasks.workunit.client.0.smithi073.stderr: -298> 2024-09-12T00:51:17.825+0000 7feaf54b7800 10 monclient: init 2024-09-12T00:51:18.808 INFO:tasks.workunit.client.0.smithi073.stderr: -297> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436840) adding auth protocol: cephx 2024-09-12T00:51:18.808 INFO:tasks.workunit.client.0.smithi073.stderr: -296> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436840) adding auth protocol: cephx 2024-09-12T00:51:18.808 INFO:tasks.workunit.client.0.smithi073.stderr: -295> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436840) adding auth protocol: cephx 2024-09-12T00:51:18.808 INFO:tasks.workunit.client.0.smithi073.stderr: -294> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436840) adding con mode: secure 2024-09-12T00:51:18.808 INFO:tasks.workunit.client.0.smithi073.stderr: -293> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436840) adding con mode: crc 2024-09-12T00:51:18.808 INFO:tasks.workunit.client.0.smithi073.stderr: -292> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436840) adding con mode: secure 2024-09-12T00:51:18.809 INFO:tasks.workunit.client.0.smithi073.stderr: -291> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436840) adding con mode: crc 2024-09-12T00:51:18.809 INFO:tasks.workunit.client.0.smithi073.stderr: -290> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436840) adding con mode: secure 2024-09-12T00:51:18.809 INFO:tasks.workunit.client.0.smithi073.stderr: -289> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436840) adding con mode: crc 2024-09-12T00:51:18.809 INFO:tasks.workunit.client.0.smithi073.stderr: -288> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436840) adding con mode: crc 2024-09-12T00:51:18.809 INFO:tasks.workunit.client.0.smithi073.stderr: -287> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436840) adding con mode: secure 2024-09-12T00:51:18.809 INFO:tasks.workunit.client.0.smithi073.stderr: -286> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436840) adding con mode: crc 2024-09-12T00:51:18.809 INFO:tasks.workunit.client.0.smithi073.stderr: -285> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436840) adding con mode: secure 2024-09-12T00:51:18.809 INFO:tasks.workunit.client.0.smithi073.stderr: -284> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436840) adding con mode: crc 2024-09-12T00:51:18.809 INFO:tasks.workunit.client.0.smithi073.stderr: -283> 2024-09-12T00:51:17.825+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436840) adding con mode: secure 2024-09-12T00:51:18.809 INFO:tasks.workunit.client.0.smithi073.stderr: -282> 2024-09-12T00:51:17.825+0000 7feaf54b7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:18.809 INFO:tasks.workunit.client.0.smithi073.stderr: -281> 2024-09-12T00:51:17.826+0000 7feaf54b7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:18.809 INFO:tasks.workunit.client.0.smithi073.stderr: -280> 2024-09-12T00:51:17.826+0000 7feaf54b7800 5 asok(0x55a0075d7630) register_command rotate-key cmddesc rotate-key hook 0x7ffda8436988 EEXIST 2024-09-12T00:51:18.809 INFO:tasks.workunit.client.0.smithi073.stderr: -279> 2024-09-12T00:51:17.826+0000 7feaf54b7800 10 monclient: _reopen_session rank -1 2024-09-12T00:51:18.810 INFO:tasks.workunit.client.0.smithi073.stderr: -278> 2024-09-12T00:51:17.826+0000 7feaf54b7800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:51:18.810 INFO:tasks.workunit.client.0.smithi073.stderr: -277> 2024-09-12T00:51:17.826+0000 7feaf54b7800 10 monclient(hunting): picked mon.noname-c con 0x55a0078999b0 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:51:18.810 INFO:tasks.workunit.client.0.smithi073.stderr: -276> 2024-09-12T00:51:17.826+0000 7feaf54b7800 10 monclient(hunting): picked mon.noname-b con 0x55a0078c4420 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:51:18.810 INFO:tasks.workunit.client.0.smithi073.stderr: -275> 2024-09-12T00:51:17.826+0000 7feaf54b7800 10 monclient(hunting): picked mon.noname-a con 0x55a0078c57d0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:51:18.810 INFO:tasks.workunit.client.0.smithi073.stderr: -274> 2024-09-12T00:51:17.826+0000 7feaf54b7800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:18.810 INFO:tasks.workunit.client.0.smithi073.stderr: -273> 2024-09-12T00:51:17.826+0000 7feaf54b7800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:18.810 INFO:tasks.workunit.client.0.smithi073.stderr: -272> 2024-09-12T00:51:17.826+0000 7feaf54b7800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:18.810 INFO:tasks.workunit.client.0.smithi073.stderr: -271> 2024-09-12T00:51:17.826+0000 7feaf54b7800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:18.810 INFO:tasks.workunit.client.0.smithi073.stderr: -270> 2024-09-12T00:51:17.826+0000 7feaf54b7800 10 monclient(hunting): authenticate will time out at 2138.496212s 2024-09-12T00:51:18.810 INFO:tasks.workunit.client.0.smithi073.stderr: -269> 2024-09-12T00:51:17.826+0000 7feaf2fa1640 10 monclient(hunting): get_auth_request con 0x55a0078999b0 auth_method 0 2024-09-12T00:51:18.810 INFO:tasks.workunit.client.0.smithi073.stderr: -268> 2024-09-12T00:51:17.826+0000 7feaf2fa1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:18.810 INFO:tasks.workunit.client.0.smithi073.stderr: -267> 2024-09-12T00:51:17.826+0000 7feaf2fa1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:18.810 INFO:tasks.workunit.client.0.smithi073.stderr: -266> 2024-09-12T00:51:17.826+0000 7feaf2fa1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:18.810 INFO:tasks.workunit.client.0.smithi073.stderr: -265> 2024-09-12T00:51:17.826+0000 7feaf37a2640 10 monclient(hunting): get_auth_request con 0x55a0078c57d0 auth_method 0 2024-09-12T00:51:18.811 INFO:tasks.workunit.client.0.smithi073.stderr: -264> 2024-09-12T00:51:17.826+0000 7feaf37a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:18.811 INFO:tasks.workunit.client.0.smithi073.stderr: -263> 2024-09-12T00:51:17.826+0000 7feaf37a2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:18.811 INFO:tasks.workunit.client.0.smithi073.stderr: -262> 2024-09-12T00:51:17.826+0000 7feaf37a2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:18.811 INFO:tasks.workunit.client.0.smithi073.stderr: -261> 2024-09-12T00:51:17.826+0000 7feaf37a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:18.811 INFO:tasks.workunit.client.0.smithi073.stderr: -260> 2024-09-12T00:51:17.826+0000 7feaf37a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:18.811 INFO:tasks.workunit.client.0.smithi073.stderr: -259> 2024-09-12T00:51:17.826+0000 7feaf37a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:18.811 INFO:tasks.workunit.client.0.smithi073.stderr: -258> 2024-09-12T00:51:17.826+0000 7feaf2fa1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:18.811 INFO:tasks.workunit.client.0.smithi073.stderr: -257> 2024-09-12T00:51:17.826+0000 7feaf2fa1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:18.811 INFO:tasks.workunit.client.0.smithi073.stderr: -256> 2024-09-12T00:51:17.826+0000 7feaf2fa1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:18.811 INFO:tasks.workunit.client.0.smithi073.stderr: -255> 2024-09-12T00:51:17.826+0000 7feaebfff640 10 monclient(hunting): get_auth_request con 0x55a0078c4420 auth_method 0 2024-09-12T00:51:18.811 INFO:tasks.workunit.client.0.smithi073.stderr: -254> 2024-09-12T00:51:17.826+0000 7feaebfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:18.811 INFO:tasks.workunit.client.0.smithi073.stderr: -253> 2024-09-12T00:51:17.826+0000 7feaebfff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:18.811 INFO:tasks.workunit.client.0.smithi073.stderr: -252> 2024-09-12T00:51:17.826+0000 7feaebfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:18.812 INFO:tasks.workunit.client.0.smithi073.stderr: -251> 2024-09-12T00:51:17.826+0000 7feaf37a2640 10 monclient(hunting): handle_auth_done global_id 7362 payload 274 2024-09-12T00:51:18.812 INFO:tasks.workunit.client.0.smithi073.stderr: -250> 2024-09-12T00:51:17.826+0000 7feaf37a2640 10 monclient: _finish_hunting 0 2024-09-12T00:51:18.812 INFO:tasks.workunit.client.0.smithi073.stderr: -249> 2024-09-12T00:51:17.826+0000 7feaf37a2640 1 monclient: found mon.noname-a 2024-09-12T00:51:18.812 INFO:tasks.workunit.client.0.smithi073.stderr: -248> 2024-09-12T00:51:17.826+0000 7feaf37a2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:51:18.812 INFO:tasks.workunit.client.0.smithi073.stderr: -247> 2024-09-12T00:51:17.826+0000 7fe9d67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:18.812 INFO:tasks.workunit.client.0.smithi073.stderr: -246> 2024-09-12T00:51:17.826+0000 7fe9d67fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:51:18.812 INFO:tasks.workunit.client.0.smithi073.stderr: -245> 2024-09-12T00:51:17.826+0000 7fe9d67fc640 10 monclient: dump: 2024-09-12T00:51:18.812 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:51:18.812 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:51:18.812 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:18.812 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:18.812 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:18.812 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:51:18.812 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:51:18.813 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:51:18.813 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:51:18.813 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:18.813 INFO:tasks.workunit.client.0.smithi073.stderr: -244> 2024-09-12T00:51:17.826+0000 7fe9d67fc640 10 monclient: _finish_auth 0 2024-09-12T00:51:18.813 INFO:tasks.workunit.client.0.smithi073.stderr: -243> 2024-09-12T00:51:17.826+0000 7fe9d67fc640 10 monclient: _check_auth_tickets 2024-09-12T00:51:18.813 INFO:tasks.workunit.client.0.smithi073.stderr: -242> 2024-09-12T00:51:17.826+0000 7fe9d67fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:18.813 INFO:tasks.workunit.client.0.smithi073.stderr: -241> 2024-09-12T00:51:17.826+0000 7fe9d67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:18.813 INFO:tasks.workunit.client.0.smithi073.stderr: -240> 2024-09-12T00:51:17.826+0000 7fe9d67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:51:18.813 INFO:tasks.workunit.client.0.smithi073.stderr: -239> 2024-09-12T00:51:17.826+0000 7fe9d67fc640 10 monclient: dump: 2024-09-12T00:51:18.813 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:51:18.813 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:51:18.813 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:18.813 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:18.814 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:18.814 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:51:18.814 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:51:18.814 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:51:18.814 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:51:18.814 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:18.814 INFO:tasks.workunit.client.0.smithi073.stderr: -238> 2024-09-12T00:51:17.826+0000 7feaf54b7800 5 monclient: authenticate success, global_id 7362 2024-09-12T00:51:18.814 INFO:tasks.workunit.client.0.smithi073.stderr: -237> 2024-09-12T00:51:17.826+0000 7feaf54b7800 10 monclient: get_monmap_and_config success 2024-09-12T00:51:18.814 INFO:tasks.workunit.client.0.smithi073.stderr: -236> 2024-09-12T00:51:17.826+0000 7feaf54b7800 4 set_mon_vals no callback set 2024-09-12T00:51:18.814 INFO:tasks.workunit.client.0.smithi073.stderr: -235> 2024-09-12T00:51:17.827+0000 7feaf54b7800 10 monclient: shutdown 2024-09-12T00:51:18.814 INFO:tasks.workunit.client.0.smithi073.stderr: -234> 2024-09-12T00:51:17.827+0000 7feaf54b7800 10 monclient: build_initial_monmap 2024-09-12T00:51:18.814 INFO:tasks.workunit.client.0.smithi073.stderr: -233> 2024-09-12T00:51:17.827+0000 7feaf54b7800 1 build_initial for_mkfs: 0 2024-09-12T00:51:18.814 INFO:tasks.workunit.client.0.smithi073.stderr: -232> 2024-09-12T00:51:17.827+0000 7feaf54b7800 10 monclient: monmap: 2024-09-12T00:51:18.815 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:51:18.815 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:51:18.815 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:51:18.815 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:51:18.815 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:51:18.815 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:51:18.815 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:51:18.815 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:51:18.815 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:51:18.815 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:18.815 INFO:tasks.workunit.client.0.smithi073.stderr: -231> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a0078ba5d0) adding auth protocol: cephx 2024-09-12T00:51:18.815 INFO:tasks.workunit.client.0.smithi073.stderr: -230> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a0078ba5d0) adding auth protocol: cephx 2024-09-12T00:51:18.815 INFO:tasks.workunit.client.0.smithi073.stderr: -229> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a0078ba5d0) adding auth protocol: cephx 2024-09-12T00:51:18.815 INFO:tasks.workunit.client.0.smithi073.stderr: -228> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a0078ba5d0) adding con mode: secure 2024-09-12T00:51:18.816 INFO:tasks.workunit.client.0.smithi073.stderr: -227> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a0078ba5d0) adding con mode: crc 2024-09-12T00:51:18.816 INFO:tasks.workunit.client.0.smithi073.stderr: -226> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a0078ba5d0) adding con mode: secure 2024-09-12T00:51:18.816 INFO:tasks.workunit.client.0.smithi073.stderr: -225> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a0078ba5d0) adding con mode: crc 2024-09-12T00:51:18.816 INFO:tasks.workunit.client.0.smithi073.stderr: -224> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a0078ba5d0) adding con mode: secure 2024-09-12T00:51:18.816 INFO:tasks.workunit.client.0.smithi073.stderr: -223> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a0078ba5d0) adding con mode: crc 2024-09-12T00:51:18.816 INFO:tasks.workunit.client.0.smithi073.stderr: -222> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a0078ba5d0) adding con mode: crc 2024-09-12T00:51:18.816 INFO:tasks.workunit.client.0.smithi073.stderr: -221> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a0078ba5d0) adding con mode: secure 2024-09-12T00:51:18.816 INFO:tasks.workunit.client.0.smithi073.stderr: -220> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a0078ba5d0) adding con mode: crc 2024-09-12T00:51:18.816 INFO:tasks.workunit.client.0.smithi073.stderr: -219> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a0078ba5d0) adding con mode: secure 2024-09-12T00:51:18.816 INFO:tasks.workunit.client.0.smithi073.stderr: -218> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a0078ba5d0) adding con mode: crc 2024-09-12T00:51:18.817 INFO:tasks.workunit.client.0.smithi073.stderr: -217> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a0078ba5d0) adding con mode: secure 2024-09-12T00:51:18.817 INFO:tasks.workunit.client.0.smithi073.stderr: -216> 2024-09-12T00:51:17.827+0000 7feaf54b7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:18.817 INFO:tasks.workunit.client.0.smithi073.stderr: -215> 2024-09-12T00:51:17.827+0000 7feaf54b7800 1 librados: starting msgr at 2024-09-12T00:51:18.817 INFO:tasks.workunit.client.0.smithi073.stderr: -214> 2024-09-12T00:51:17.827+0000 7feaf54b7800 1 librados: starting objecter 2024-09-12T00:51:18.817 INFO:tasks.workunit.client.0.smithi073.stderr: -213> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 asok(0x55a0075d7630) register_command objecter_requests cmddesc objecter_requests hook 0x55a007875030 EEXIST 2024-09-12T00:51:18.817 INFO:tasks.workunit.client.0.smithi073.stderr: -212> 2024-09-12T00:51:17.827+0000 7feaf54b7800 1 librados: setting wanted keys 2024-09-12T00:51:18.817 INFO:tasks.workunit.client.0.smithi073.stderr: -211> 2024-09-12T00:51:17.827+0000 7feaf54b7800 1 librados: calling monclient init 2024-09-12T00:51:18.817 INFO:tasks.workunit.client.0.smithi073.stderr: -210> 2024-09-12T00:51:17.827+0000 7feaf54b7800 10 monclient: init 2024-09-12T00:51:18.817 INFO:tasks.workunit.client.0.smithi073.stderr: -209> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a00788a430) adding auth protocol: cephx 2024-09-12T00:51:18.817 INFO:tasks.workunit.client.0.smithi073.stderr: -208> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a00788a430) adding auth protocol: cephx 2024-09-12T00:51:18.818 INFO:tasks.workunit.client.0.smithi073.stderr: -207> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a00788a430) adding auth protocol: cephx 2024-09-12T00:51:18.818 INFO:tasks.workunit.client.0.smithi073.stderr: -206> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a00788a430) adding con mode: secure 2024-09-12T00:51:18.818 INFO:tasks.workunit.client.0.smithi073.stderr: -205> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a00788a430) adding con mode: crc 2024-09-12T00:51:18.818 INFO:tasks.workunit.client.0.smithi073.stderr: -204> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a00788a430) adding con mode: secure 2024-09-12T00:51:18.818 INFO:tasks.workunit.client.0.smithi073.stderr: -203> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a00788a430) adding con mode: crc 2024-09-12T00:51:18.818 INFO:tasks.workunit.client.0.smithi073.stderr: -202> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a00788a430) adding con mode: secure 2024-09-12T00:51:18.818 INFO:tasks.workunit.client.0.smithi073.stderr: -201> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a00788a430) adding con mode: crc 2024-09-12T00:51:18.818 INFO:tasks.workunit.client.0.smithi073.stderr: -200> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a00788a430) adding con mode: crc 2024-09-12T00:51:18.818 INFO:tasks.workunit.client.0.smithi073.stderr: -199> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a00788a430) adding con mode: secure 2024-09-12T00:51:18.818 INFO:tasks.workunit.client.0.smithi073.stderr: -198> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a00788a430) adding con mode: crc 2024-09-12T00:51:18.818 INFO:tasks.workunit.client.0.smithi073.stderr: -197> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a00788a430) adding con mode: secure 2024-09-12T00:51:18.818 INFO:tasks.workunit.client.0.smithi073.stderr: -196> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a00788a430) adding con mode: crc 2024-09-12T00:51:18.818 INFO:tasks.workunit.client.0.smithi073.stderr: -195> 2024-09-12T00:51:17.827+0000 7feaf54b7800 5 AuthRegistry(0x55a00788a430) adding con mode: secure 2024-09-12T00:51:18.819 INFO:tasks.workunit.client.0.smithi073.stderr: -194> 2024-09-12T00:51:17.828+0000 7feaf54b7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:18.819 INFO:tasks.workunit.client.0.smithi073.stderr: -193> 2024-09-12T00:51:17.828+0000 7feaf54b7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:18.819 INFO:tasks.workunit.client.0.smithi073.stderr: -192> 2024-09-12T00:51:17.828+0000 7feaf54b7800 5 asok(0x55a0075d7630) register_command rotate-key cmddesc rotate-key hook 0x55a00788a578 EEXIST 2024-09-12T00:51:18.819 INFO:tasks.workunit.client.0.smithi073.stderr: -191> 2024-09-12T00:51:17.828+0000 7feaf54b7800 10 monclient: _reopen_session rank -1 2024-09-12T00:51:18.819 INFO:tasks.workunit.client.0.smithi073.stderr: -190> 2024-09-12T00:51:17.828+0000 7feaf54b7800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:51:18.819 INFO:tasks.workunit.client.0.smithi073.stderr: -189> 2024-09-12T00:51:17.828+0000 7feaf54b7800 10 monclient(hunting): picked mon.noname-c con 0x55a0078999b0 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:51:18.819 INFO:tasks.workunit.client.0.smithi073.stderr: -188> 2024-09-12T00:51:17.828+0000 7feaf54b7800 10 monclient(hunting): picked mon.noname-b con 0x55a0078c57d0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:51:18.819 INFO:tasks.workunit.client.0.smithi073.stderr: -187> 2024-09-12T00:51:17.828+0000 7feaf54b7800 10 monclient(hunting): picked mon.noname-a con 0x55a007895a70 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:51:18.819 INFO:tasks.workunit.client.0.smithi073.stderr: -186> 2024-09-12T00:51:17.828+0000 7feaf54b7800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:18.819 INFO:tasks.workunit.client.0.smithi073.stderr: -185> 2024-09-12T00:51:17.828+0000 7feaf54b7800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:18.819 INFO:tasks.workunit.client.0.smithi073.stderr: -184> 2024-09-12T00:51:17.828+0000 7feaf54b7800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:18.819 INFO:tasks.workunit.client.0.smithi073.stderr: -183> 2024-09-12T00:51:17.828+0000 7feaf54b7800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:18.820 INFO:tasks.workunit.client.0.smithi073.stderr: -182> 2024-09-12T00:51:17.828+0000 7feaf54b7800 10 monclient(hunting): authenticate will time out at 2138.498483s 2024-09-12T00:51:18.820 INFO:tasks.workunit.client.0.smithi073.stderr: -181> 2024-09-12T00:51:17.828+0000 7feaf37a2640 10 monclient(hunting): get_auth_request con 0x55a007895a70 auth_method 0 2024-09-12T00:51:18.820 INFO:tasks.workunit.client.0.smithi073.stderr: -180> 2024-09-12T00:51:17.828+0000 7feaf37a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:18.820 INFO:tasks.workunit.client.0.smithi073.stderr: -179> 2024-09-12T00:51:17.828+0000 7feaf37a2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:18.820 INFO:tasks.workunit.client.0.smithi073.stderr: -178> 2024-09-12T00:51:17.828+0000 7feaf37a2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:18.820 INFO:tasks.workunit.client.0.smithi073.stderr: -177> 2024-09-12T00:51:17.828+0000 7feaf2fa1640 10 monclient(hunting): get_auth_request con 0x55a0078999b0 auth_method 0 2024-09-12T00:51:18.820 INFO:tasks.workunit.client.0.smithi073.stderr: -176> 2024-09-12T00:51:17.828+0000 7feaf2fa1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:18.820 INFO:tasks.workunit.client.0.smithi073.stderr: -175> 2024-09-12T00:51:17.828+0000 7feaf2fa1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:18.820 INFO:tasks.workunit.client.0.smithi073.stderr: -174> 2024-09-12T00:51:17.828+0000 7feaf2fa1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:18.820 INFO:tasks.workunit.client.0.smithi073.stderr: -173> 2024-09-12T00:51:17.828+0000 7feaf37a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:18.820 INFO:tasks.workunit.client.0.smithi073.stderr: -172> 2024-09-12T00:51:17.828+0000 7feaf37a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:18.820 INFO:tasks.workunit.client.0.smithi073.stderr: -171> 2024-09-12T00:51:17.828+0000 7feaf37a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:18.820 INFO:tasks.workunit.client.0.smithi073.stderr: -170> 2024-09-12T00:51:17.828+0000 7feaf2fa1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:18.821 INFO:tasks.workunit.client.0.smithi073.stderr: -169> 2024-09-12T00:51:17.828+0000 7feaf2fa1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:18.821 INFO:tasks.workunit.client.0.smithi073.stderr: -168> 2024-09-12T00:51:17.828+0000 7feaf2fa1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:18.821 INFO:tasks.workunit.client.0.smithi073.stderr: -167> 2024-09-12T00:51:17.828+0000 7feaebfff640 10 monclient(hunting): get_auth_request con 0x55a0078c57d0 auth_method 0 2024-09-12T00:51:18.821 INFO:tasks.workunit.client.0.smithi073.stderr: -166> 2024-09-12T00:51:17.828+0000 7feaebfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:18.821 INFO:tasks.workunit.client.0.smithi073.stderr: -165> 2024-09-12T00:51:17.828+0000 7feaebfff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:18.821 INFO:tasks.workunit.client.0.smithi073.stderr: -164> 2024-09-12T00:51:17.828+0000 7feaebfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:18.821 INFO:tasks.workunit.client.0.smithi073.stderr: -163> 2024-09-12T00:51:17.828+0000 7feaf37a2640 10 monclient(hunting): handle_auth_done global_id 7365 payload 824 2024-09-12T00:51:18.821 INFO:tasks.workunit.client.0.smithi073.stderr: -162> 2024-09-12T00:51:17.828+0000 7feaf37a2640 10 monclient: _finish_hunting 0 2024-09-12T00:51:18.821 INFO:tasks.workunit.client.0.smithi073.stderr: -161> 2024-09-12T00:51:17.828+0000 7feaf37a2640 1 monclient: found mon.noname-a 2024-09-12T00:51:18.821 INFO:tasks.workunit.client.0.smithi073.stderr: -160> 2024-09-12T00:51:17.828+0000 7feaf37a2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:51:18.822 INFO:tasks.workunit.client.0.smithi073.stderr: -159> 2024-09-12T00:51:17.828+0000 7fe9d4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:18.822 INFO:tasks.workunit.client.0.smithi073.stderr: -158> 2024-09-12T00:51:17.829+0000 7fe9d4ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:51:18.822 INFO:tasks.workunit.client.0.smithi073.stderr: -157> 2024-09-12T00:51:17.829+0000 7fe9d4ff9640 10 monclient: dump: 2024-09-12T00:51:18.822 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:51:18.822 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:51:18.822 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:18.822 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:18.822 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:18.822 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:51:18.822 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:51:18.822 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:51:18.822 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:51:18.822 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:18.823 INFO:tasks.workunit.client.0.smithi073.stderr: -156> 2024-09-12T00:51:17.829+0000 7fe9d4ff9640 10 monclient: _finish_auth 0 2024-09-12T00:51:18.823 INFO:tasks.workunit.client.0.smithi073.stderr: -155> 2024-09-12T00:51:17.829+0000 7fe9d4ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:51:18.823 INFO:tasks.workunit.client.0.smithi073.stderr: -154> 2024-09-12T00:51:17.829+0000 7fe9d4ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:18.823 INFO:tasks.workunit.client.0.smithi073.stderr: -153> 2024-09-12T00:51:17.829+0000 7fe9d4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:18.823 INFO:tasks.workunit.client.0.smithi073.stderr: -152> 2024-09-12T00:51:17.829+0000 7fe9d4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:51:18.823 INFO:tasks.workunit.client.0.smithi073.stderr: -151> 2024-09-12T00:51:17.829+0000 7fe9d4ff9640 10 monclient: dump: 2024-09-12T00:51:18.823 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:51:18.823 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:51:18.823 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:18.823 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:18.823 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:18.823 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:51:18.823 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:51:18.823 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:51:18.824 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:51:18.824 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:18.824 INFO:tasks.workunit.client.0.smithi073.stderr: -150> 2024-09-12T00:51:17.829+0000 7feaf54b7800 5 monclient: authenticate success, global_id 7365 2024-09-12T00:51:18.824 INFO:tasks.workunit.client.0.smithi073.stderr: -149> 2024-09-12T00:51:17.829+0000 7fe9d67fc640 4 set_mon_vals no callback set 2024-09-12T00:51:18.824 INFO:tasks.workunit.client.0.smithi073.stderr: -148> 2024-09-12T00:51:17.829+0000 7feaf54b7800 10 monclient: _renew_subs 2024-09-12T00:51:18.824 INFO:tasks.workunit.client.0.smithi073.stderr: -147> 2024-09-12T00:51:17.829+0000 7feaf54b7800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:51:18.824 INFO:tasks.workunit.client.0.smithi073.stderr: -146> 2024-09-12T00:51:17.829+0000 7feaf54b7800 10 monclient: _renew_subs 2024-09-12T00:51:18.824 INFO:tasks.workunit.client.0.smithi073.stderr: -145> 2024-09-12T00:51:17.829+0000 7feaf54b7800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:51:18.824 INFO:tasks.workunit.client.0.smithi073.stderr: -144> 2024-09-12T00:51:17.829+0000 7feaf54b7800 1 librados: init done 2024-09-12T00:51:18.824 INFO:tasks.workunit.client.0.smithi073.stderr: -143> 2024-09-12T00:51:17.829+0000 7feaf54b7800 5 asok(0x55a0075d7630) register_command cr dump hook 0x55a0078c3fd8 2024-09-12T00:51:18.824 INFO:tasks.workunit.client.0.smithi073.stderr: -142> 2024-09-12T00:51:17.830+0000 7feaf54b7800 20 rados->read ofs=0 len=0 2024-09-12T00:51:18.824 INFO:tasks.workunit.client.0.smithi073.stderr: -141> 2024-09-12T00:51:17.830+0000 7fe9d4ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:51:18.824 INFO:tasks.workunit.client.0.smithi073.stderr: -140> 2024-09-12T00:51:17.830+0000 7fe9d4ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:51:18.825 INFO:tasks.workunit.client.0.smithi073.stderr: -139> 2024-09-12T00:51:17.830+0000 7fe9d4ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:51:18.825 INFO:tasks.workunit.client.0.smithi073.stderr: -138> 2024-09-12T00:51:17.831+0000 7feaf2fa1640 10 monclient: get_auth_request con 0x7fe9bc076470 auth_method 0 2024-09-12T00:51:18.825 INFO:tasks.workunit.client.0.smithi073.stderr: -137> 2024-09-12T00:51:17.831+0000 7feaebfff640 10 monclient: get_auth_request con 0x55a0078e39c0 auth_method 0 2024-09-12T00:51:18.825 INFO:tasks.workunit.client.0.smithi073.stderr: -136> 2024-09-12T00:51:17.831+0000 7feaf54b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:18.825 INFO:tasks.workunit.client.0.smithi073.stderr: -135> 2024-09-12T00:51:17.831+0000 7feaf54b7800 20 realm 2024-09-12T00:51:18.825 INFO:tasks.workunit.client.0.smithi073.stderr: -134> 2024-09-12T00:51:17.831+0000 7feaf54b7800 20 rados->read ofs=0 len=0 2024-09-12T00:51:18.825 INFO:tasks.workunit.client.0.smithi073.stderr: -133> 2024-09-12T00:51:17.832+0000 7feaf54b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:18.825 INFO:tasks.workunit.client.0.smithi073.stderr: -132> 2024-09-12T00:51:17.832+0000 7feaf54b7800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:18.825 INFO:tasks.workunit.client.0.smithi073.stderr: -131> 2024-09-12T00:51:17.832+0000 7feaf54b7800 20 rados->read ofs=0 len=0 2024-09-12T00:51:18.825 INFO:tasks.workunit.client.0.smithi073.stderr: -130> 2024-09-12T00:51:17.832+0000 7feaf54b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:18.825 INFO:tasks.workunit.client.0.smithi073.stderr: -129> 2024-09-12T00:51:17.832+0000 7feaf54b7800 20 rados->read ofs=0 len=0 2024-09-12T00:51:18.825 INFO:tasks.workunit.client.0.smithi073.stderr: -128> 2024-09-12T00:51:17.832+0000 7feaf2fa1640 10 monclient: get_auth_request con 0x55a0078e7ad0 auth_method 0 2024-09-12T00:51:18.825 INFO:tasks.workunit.client.0.smithi073.stderr: -127> 2024-09-12T00:51:17.833+0000 7feaf54b7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:18.826 INFO:tasks.workunit.client.0.smithi073.stderr: -126> 2024-09-12T00:51:17.833+0000 7feaf54b7800 20 rados->read ofs=0 len=0 2024-09-12T00:51:18.826 INFO:tasks.workunit.client.0.smithi073.stderr: -125> 2024-09-12T00:51:17.833+0000 7feaebfff640 10 monclient: get_auth_request con 0x55a0078eb360 auth_method 0 2024-09-12T00:51:18.826 INFO:tasks.workunit.client.0.smithi073.stderr: -124> 2024-09-12T00:51:17.834+0000 7feaf54b7800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:18.826 INFO:tasks.workunit.client.0.smithi073.stderr: -123> 2024-09-12T00:51:17.834+0000 7feaf54b7800 20 searching for the correct realm 2024-09-12T00:51:18.826 INFO:tasks.workunit.client.0.smithi073.stderr: -122> 2024-09-12T00:51:17.834+0000 7feaf37a2640 10 monclient: get_auth_request con 0x55a0078f0060 auth_method 0 2024-09-12T00:51:18.826 INFO:tasks.workunit.client.0.smithi073.stderr: -121> 2024-09-12T00:51:17.835+0000 7feaf2fa1640 10 monclient: get_auth_request con 0x7feaec069040 auth_method 0 2024-09-12T00:51:18.826 INFO:tasks.workunit.client.0.smithi073.stderr: -120> 2024-09-12T00:51:17.835+0000 7feaebfff640 10 monclient: get_auth_request con 0x7feae4049430 auth_method 0 2024-09-12T00:51:18.826 INFO:tasks.workunit.client.0.smithi073.stderr: -119> 2024-09-12T00:51:18.036+0000 7feaebfff640 10 monclient: get_auth_request con 0x7feae4049430 auth_method 0 2024-09-12T00:51:18.826 INFO:tasks.workunit.client.0.smithi073.stderr: -118> 2024-09-12T00:51:18.036+0000 7feaebfff640 0 -- 172.21.15.73:0/2458859785 >> [v2:172.21.15.73:6826/269690776,v1:172.21.15.73:6827/269690776] conn(0x7feae4049430 msgr2=0x7feae4049850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:51:18.826 INFO:tasks.workunit.client.0.smithi073.stderr: -117> 2024-09-12T00:51:18.437+0000 7feaebfff640 10 monclient: get_auth_request con 0x7feae4049430 auth_method 0 2024-09-12T00:51:18.826 INFO:tasks.workunit.client.0.smithi073.stderr: -116> 2024-09-12T00:51:18.438+0000 7feaf37a2640 10 monclient: get_auth_request con 0x7feadc018070 auth_method 0 2024-09-12T00:51:18.826 INFO:tasks.workunit.client.0.smithi073.stderr: -115> 2024-09-12T00:51:18.442+0000 7feaf2fa1640 0 -- 172.21.15.73:0/2458859785 >> [v2:172.21.15.73:6810/1807760270,v1:172.21.15.73:6811/1807760270] conn(0x7feaec0b50b0 msgr2=0x7feaec0e1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:51:18.826 INFO:tasks.workunit.client.0.smithi073.stderr: -114> 2024-09-12T00:51:18.643+0000 7feaf2fa1640 10 monclient: get_auth_request con 0x7feaec0b50b0 auth_method 0 2024-09-12T00:51:18.826 INFO:tasks.workunit.client.0.smithi073.stderr: -113> 2024-09-12T00:51:18.649+0000 7feaf54b7800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:51:18.826 INFO:tasks.workunit.client.0.smithi073.stderr: -112> 2024-09-12T00:51:18.649+0000 7feaf54b7800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:18.827 INFO:tasks.workunit.client.0.smithi073.stderr: -111> 2024-09-12T00:51:18.649+0000 7feaf54b7800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:51:18.827 INFO:tasks.workunit.client.0.smithi073.stderr: -110> 2024-09-12T00:51:18.649+0000 7feaf54b7800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:18.827 INFO:tasks.workunit.client.0.smithi073.stderr: -109> 2024-09-12T00:51:18.650+0000 7feaf54b7800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:18.827 INFO:tasks.workunit.client.0.smithi073.stderr: -108> 2024-09-12T00:51:18.650+0000 7feaf54b7800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:18.827 INFO:tasks.workunit.client.0.smithi073.stderr: -107> 2024-09-12T00:51:18.650+0000 7feaf54b7800 20 rados->read ofs=0 len=0 2024-09-12T00:51:18.827 INFO:tasks.workunit.client.0.smithi073.stderr: -106> 2024-09-12T00:51:18.650+0000 7feaf54b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:18.827 INFO:tasks.workunit.client.0.smithi073.stderr: -105> 2024-09-12T00:51:18.650+0000 7feaf54b7800 20 rados->read ofs=0 len=0 2024-09-12T00:51:18.827 INFO:tasks.workunit.client.0.smithi073.stderr: -104> 2024-09-12T00:51:18.651+0000 7feaf54b7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:18.827 INFO:tasks.workunit.client.0.smithi073.stderr: -103> 2024-09-12T00:51:18.651+0000 7feaf54b7800 20 rados->read ofs=0 len=0 2024-09-12T00:51:18.827 INFO:tasks.workunit.client.0.smithi073.stderr: -102> 2024-09-12T00:51:18.651+0000 7feaf54b7800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:18.827 INFO:tasks.workunit.client.0.smithi073.stderr: -101> 2024-09-12T00:51:18.651+0000 7feaf54b7800 20 zone default found 2024-09-12T00:51:18.827 INFO:tasks.workunit.client.0.smithi073.stderr: -100> 2024-09-12T00:51:18.651+0000 7feaf54b7800 4 Realm: () 2024-09-12T00:51:18.827 INFO:tasks.workunit.client.0.smithi073.stderr: -99> 2024-09-12T00:51:18.651+0000 7feaf54b7800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:51:18.827 INFO:tasks.workunit.client.0.smithi073.stderr: -98> 2024-09-12T00:51:18.651+0000 7feaf54b7800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:51:18.828 INFO:tasks.workunit.client.0.smithi073.stderr: -97> 2024-09-12T00:51:18.651+0000 7feaf54b7800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:18.828 INFO:tasks.workunit.client.0.smithi073.stderr: -96> 2024-09-12T00:51:18.651+0000 7feaf54b7800 20 zonegroup default 2024-09-12T00:51:18.828 INFO:tasks.workunit.client.0.smithi073.stderr: -95> 2024-09-12T00:51:18.651+0000 7feaf54b7800 20 rados->read ofs=0 len=0 2024-09-12T00:51:18.828 INFO:tasks.workunit.client.0.smithi073.stderr: -94> 2024-09-12T00:51:18.651+0000 7feaf54b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:18.828 INFO:tasks.workunit.client.0.smithi073.stderr: -93> 2024-09-12T00:51:18.651+0000 7feaf54b7800 20 rados->read ofs=0 len=0 2024-09-12T00:51:18.828 INFO:tasks.workunit.client.0.smithi073.stderr: -92> 2024-09-12T00:51:18.652+0000 7feaf54b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:18.828 INFO:tasks.workunit.client.0.smithi073.stderr: -91> 2024-09-12T00:51:18.652+0000 7feaf54b7800 20 rados->read ofs=0 len=0 2024-09-12T00:51:18.828 INFO:tasks.workunit.client.0.smithi073.stderr: -90> 2024-09-12T00:51:18.652+0000 7feaf54b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:18.828 INFO:tasks.workunit.client.0.smithi073.stderr: -89> 2024-09-12T00:51:18.652+0000 7feaf54b7800 20 started sync module instance, tier type = 2024-09-12T00:51:18.828 INFO:tasks.workunit.client.0.smithi073.stderr: -88> 2024-09-12T00:51:18.652+0000 7feaf54b7800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:51:18.828 INFO:tasks.workunit.client.0.smithi073.stderr: -87> 2024-09-12T00:51:18.662+0000 7feaf54b7800 20 add_watcher() i=0 2024-09-12T00:51:18.828 INFO:tasks.workunit.client.0.smithi073.stderr: -86> 2024-09-12T00:51:18.662+0000 7feaf54b7800 20 add_watcher() i=1 2024-09-12T00:51:18.829 INFO:tasks.workunit.client.0.smithi073.stderr: -85> 2024-09-12T00:51:18.662+0000 7feaf54b7800 20 add_watcher() i=2 2024-09-12T00:51:18.829 INFO:tasks.workunit.client.0.smithi073.stderr: -84> 2024-09-12T00:51:18.662+0000 7feaf54b7800 20 add_watcher() i=3 2024-09-12T00:51:18.829 INFO:tasks.workunit.client.0.smithi073.stderr: -83> 2024-09-12T00:51:18.662+0000 7feaf54b7800 20 add_watcher() i=4 2024-09-12T00:51:18.829 INFO:tasks.workunit.client.0.smithi073.stderr: -82> 2024-09-12T00:51:18.662+0000 7feaf54b7800 20 add_watcher() i=5 2024-09-12T00:51:18.829 INFO:tasks.workunit.client.0.smithi073.stderr: -81> 2024-09-12T00:51:18.662+0000 7feaf54b7800 20 add_watcher() i=6 2024-09-12T00:51:18.829 INFO:tasks.workunit.client.0.smithi073.stderr: -80> 2024-09-12T00:51:18.663+0000 7feaf54b7800 20 add_watcher() i=7 2024-09-12T00:51:18.829 INFO:tasks.workunit.client.0.smithi073.stderr: -79> 2024-09-12T00:51:18.663+0000 7feaf54b7800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:18.829 INFO:tasks.workunit.client.0.smithi073.stderr: -78> 2024-09-12T00:51:18.665+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436d20) adding auth protocol: cephx 2024-09-12T00:51:18.829 INFO:tasks.workunit.client.0.smithi073.stderr: -77> 2024-09-12T00:51:18.665+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436d20) adding auth protocol: cephx 2024-09-12T00:51:18.829 INFO:tasks.workunit.client.0.smithi073.stderr: -76> 2024-09-12T00:51:18.665+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436d20) adding auth protocol: cephx 2024-09-12T00:51:18.829 INFO:tasks.workunit.client.0.smithi073.stderr: -75> 2024-09-12T00:51:18.665+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436d20) adding con mode: secure 2024-09-12T00:51:18.829 INFO:tasks.workunit.client.0.smithi073.stderr: -74> 2024-09-12T00:51:18.665+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436d20) adding con mode: crc 2024-09-12T00:51:18.830 INFO:tasks.workunit.client.0.smithi073.stderr: -73> 2024-09-12T00:51:18.665+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436d20) adding con mode: secure 2024-09-12T00:51:18.830 INFO:tasks.workunit.client.0.smithi073.stderr: -72> 2024-09-12T00:51:18.665+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436d20) adding con mode: crc 2024-09-12T00:51:18.830 INFO:tasks.workunit.client.0.smithi073.stderr: -71> 2024-09-12T00:51:18.665+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436d20) adding con mode: secure 2024-09-12T00:51:18.830 INFO:tasks.workunit.client.0.smithi073.stderr: -70> 2024-09-12T00:51:18.665+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436d20) adding con mode: crc 2024-09-12T00:51:18.830 INFO:tasks.workunit.client.0.smithi073.stderr: -69> 2024-09-12T00:51:18.665+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436d20) adding con mode: crc 2024-09-12T00:51:18.830 INFO:tasks.workunit.client.0.smithi073.stderr: -68> 2024-09-12T00:51:18.665+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436d20) adding con mode: secure 2024-09-12T00:51:18.830 INFO:tasks.workunit.client.0.smithi073.stderr: -67> 2024-09-12T00:51:18.665+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436d20) adding con mode: crc 2024-09-12T00:51:18.830 INFO:tasks.workunit.client.0.smithi073.stderr: -66> 2024-09-12T00:51:18.665+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436d20) adding con mode: secure 2024-09-12T00:51:18.830 INFO:tasks.workunit.client.0.smithi073.stderr: -65> 2024-09-12T00:51:18.665+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436d20) adding con mode: crc 2024-09-12T00:51:18.830 INFO:tasks.workunit.client.0.smithi073.stderr: -64> 2024-09-12T00:51:18.665+0000 7feaf54b7800 5 AuthRegistry(0x7ffda8436d20) adding con mode: secure 2024-09-12T00:51:18.830 INFO:tasks.workunit.client.0.smithi073.stderr: -63> 2024-09-12T00:51:18.665+0000 7fe9a97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:18.830 INFO:tasks.workunit.client.0.smithi073.stderr: -62> 2024-09-12T00:51:18.666+0000 7feaf54b7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:18.830 INFO:tasks.workunit.client.0.smithi073.stderr: -61> 2024-09-12T00:51:18.666+0000 7feaf54b7800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:18.831 INFO:tasks.workunit.client.0.smithi073.stderr: -60> 2024-09-12T00:51:18.666+0000 7feaf54b7800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:18.831 INFO:tasks.workunit.client.0.smithi073.stderr: -59> 2024-09-12T00:51:18.666+0000 7feaf54b7800 5 asok(0x55a0075d7630) register_command cache list hook 0x55a007895810 2024-09-12T00:51:18.831 INFO:tasks.workunit.client.0.smithi073.stderr: -58> 2024-09-12T00:51:18.666+0000 7feaf54b7800 5 asok(0x55a0075d7630) register_command cache inspect hook 0x55a007895810 2024-09-12T00:51:18.831 INFO:tasks.workunit.client.0.smithi073.stderr: -57> 2024-09-12T00:51:18.666+0000 7feaf54b7800 5 asok(0x55a0075d7630) register_command cache erase hook 0x55a007895810 2024-09-12T00:51:18.831 INFO:tasks.workunit.client.0.smithi073.stderr: -56> 2024-09-12T00:51:18.666+0000 7feaf54b7800 5 asok(0x55a0075d7630) register_command cache zap hook 0x55a007895810 2024-09-12T00:51:18.831 INFO:tasks.workunit.client.0.smithi073.stderr: -55> 2024-09-12T00:51:18.666+0000 7feaf54b7800 5 note: GC not initialized 2024-09-12T00:51:18.831 INFO:tasks.workunit.client.0.smithi073.stderr: -54> 2024-09-12T00:51:18.666+0000 7fe923fff640 20 reqs_thread_entry: start 2024-09-12T00:51:18.831 INFO:tasks.workunit.client.0.smithi073.stderr: -53> 2024-09-12T00:51:18.666+0000 7feaf54b7800 5 asok(0x55a0075d7630) register_command sync trace show hook 0x7feae4004740 2024-09-12T00:51:18.831 INFO:tasks.workunit.client.0.smithi073.stderr: -52> 2024-09-12T00:51:18.666+0000 7feaf54b7800 5 asok(0x55a0075d7630) register_command sync trace history hook 0x7feae4004740 2024-09-12T00:51:18.831 INFO:tasks.workunit.client.0.smithi073.stderr: -51> 2024-09-12T00:51:18.666+0000 7feaf54b7800 5 asok(0x55a0075d7630) register_command sync trace active hook 0x7feae4004740 2024-09-12T00:51:18.831 INFO:tasks.workunit.client.0.smithi073.stderr: -50> 2024-09-12T00:51:18.666+0000 7feaf54b7800 5 asok(0x55a0075d7630) register_command sync trace active_short hook 0x7feae4004740 2024-09-12T00:51:18.831 INFO:tasks.workunit.client.0.smithi073.stderr: -49> 2024-09-12T00:51:18.666+0000 7feaf54b7800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:18.831 INFO:tasks.workunit.client.0.smithi073.stderr: -48> 2024-09-12T00:51:18.666+0000 7feaf54b7800 20 Filter name: none 2024-09-12T00:51:18.832 INFO:tasks.workunit.client.0.smithi073.stderr: -47> 2024-09-12T00:51:18.666+0000 7fe921ffb640 20 reqs_thread_entry: start 2024-09-12T00:51:18.832 INFO:tasks.workunit.client.0.smithi073.stderr: -46> 2024-09-12T00:51:18.666+0000 7feaf54b7800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T00:51:18.832 INFO:tasks.workunit.client.0.smithi073.stderr: -45> 2024-09-12T00:51:18.666+0000 7feaf54b7800 20 rados->read ofs=0 len=0 2024-09-12T00:51:18.832 INFO:tasks.workunit.client.0.smithi073.stderr: -44> 2024-09-12T00:51:18.667+0000 7feaf54b7800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:51:18.832 INFO:tasks.workunit.client.0.smithi073.stderr: -43> 2024-09-12T00:51:18.667+0000 7feaf54b7800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T00:51:18.832 INFO:tasks.workunit.client.0.smithi073.stderr: -42> 2024-09-12T00:51:18.667+0000 7feaf54b7800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T00:51:18.832 INFO:tasks.workunit.client.0.smithi073.stderr: -41> 2024-09-12T00:51:18.667+0000 7feaf54b7800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 : miss 2024-09-12T00:51:18.832 INFO:tasks.workunit.client.0.smithi073.stderr: -40> 2024-09-12T00:51:18.667+0000 7feaf54b7800 20 rados->read ofs=0 len=0 2024-09-12T00:51:18.832 INFO:tasks.workunit.client.0.smithi073.stderr: -39> 2024-09-12T00:51:18.667+0000 7feaf54b7800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:51:18.832 INFO:tasks.workunit.client.0.smithi073.stderr: -38> 2024-09-12T00:51:18.667+0000 7feaf54b7800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 info.flags=0x17 2024-09-12T00:51:18.832 INFO:tasks.workunit.client.0.smithi073.stderr: -37> 2024-09-12T00:51:18.667+0000 7feaf54b7800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 to cache LRU end 2024-09-12T00:51:18.832 INFO:tasks.workunit.client.0.smithi073.stderr: -36> 2024-09-12T00:51:18.667+0000 7feaf54b7800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:51:18.832 INFO:tasks.workunit.client.0.smithi073.stderr: -35> 2024-09-12T00:51:18.667+0000 7feaf54b7800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:18.833 INFO:tasks.workunit.client.0.smithi073.stderr: -34> 2024-09-12T00:51:18.667+0000 7feaf54b7800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 2024-09-12T00:51:18.833 INFO:tasks.workunit.client.0.smithi073.stderr: -33> 2024-09-12T00:51:18.672+0000 7feaf54b7800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 info.flags=0x17 2024-09-12T00:51:18.833 INFO:tasks.workunit.client.0.smithi073.stderr: -32> 2024-09-12T00:51:18.672+0000 7feaf54b7800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 to cache LRU end 2024-09-12T00:51:18.833 INFO:tasks.workunit.client.0.smithi073.stderr: -31> 2024-09-12T00:51:18.672+0000 7feaf54b7800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:18.833 INFO:tasks.workunit.client.0.smithi073.stderr: -30> 2024-09-12T00:51:18.672+0000 7feaf54b7800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32, ofs0, ns] 2024-09-12T00:51:18.833 INFO:tasks.workunit.client.0.smithi073.stderr: -29> 2024-09-12T00:51:18.672+0000 7fe9d67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497011 cookie 94145809976816 notifier 7365 bl.length()=931 2024-09-12T00:51:18.833 INFO:tasks.workunit.client.0.smithi073.stderr: -28> 2024-09-12T00:51:18.672+0000 7fe9d67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 info.flags=0x17 2024-09-12T00:51:18.833 INFO:tasks.workunit.client.0.smithi073.stderr: -27> 2024-09-12T00:51:18.672+0000 7fe9d67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 to cache LRU end 2024-09-12T00:51:18.833 INFO:tasks.workunit.client.0.smithi073.stderr: -26> 2024-09-12T00:51:18.672+0000 7fe9d67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:18.833 INFO:tasks.workunit.client.0.smithi073.stderr: -25> 2024-09-12T00:51:18.674+0000 7feaf54b7800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32]): orig_sources= new_sources= 2024-09-12T00:51:18.833 INFO:tasks.workunit.client.0.smithi073.stderr: -24> 2024-09-12T00:51:18.674+0000 7feaf54b7800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32]): potential sources added=[] removed=[] 2024-09-12T00:51:18.834 INFO:tasks.workunit.client.0.smithi073.stderr: -23> 2024-09-12T00:51:18.674+0000 7feaf54b7800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32]): orig_dests= new_dests= 2024-09-12T00:51:18.834 INFO:tasks.workunit.client.0.smithi073.stderr: -22> 2024-09-12T00:51:18.674+0000 7feaf54b7800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32]): potential dests added=[] removed=[] 2024-09-12T00:51:18.834 INFO:tasks.workunit.client.0.smithi073.stderr: -21> 2024-09-12T00:51:18.677+0000 7feaf54b7800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32.1.0 2024-09-12T00:51:18.834 INFO:tasks.workunit.client.0.smithi073.stderr: -20> 2024-09-12T00:51:18.677+0000 7feaf54b7800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32.1.0 2024-09-12T00:51:18.834 INFO:tasks.workunit.client.0.smithi073.stderr: -19> 2024-09-12T00:51:18.677+0000 7feaf54b7800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32.1.1 2024-09-12T00:51:18.834 INFO:tasks.workunit.client.0.smithi073.stderr: -18> 2024-09-12T00:51:18.677+0000 7feaf54b7800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32.1.1 2024-09-12T00:51:18.835 INFO:tasks.workunit.client.0.smithi073.stderr: -17> 2024-09-12T00:51:18.677+0000 7feaf54b7800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32.0 2024-09-12T00:51:18.835 INFO:tasks.workunit.client.0.smithi073.stderr: -16> 2024-09-12T00:51:18.680+0000 7feaf54b7800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 : hit (requested=0x17, cached=0x17) 2024-09-12T00:51:18.835 INFO:tasks.workunit.client.0.smithi073.stderr: -15> 2024-09-12T00:51:18.680+0000 7feaf54b7800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 2024-09-12T00:51:18.835 INFO:tasks.workunit.client.0.smithi073.stderr: -14> 2024-09-12T00:51:18.681+0000 7feaf54b7800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 info.flags=0x17 2024-09-12T00:51:18.835 INFO:tasks.workunit.client.0.smithi073.stderr: -13> 2024-09-12T00:51:18.681+0000 7feaf54b7800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 to cache LRU end 2024-09-12T00:51:18.835 INFO:tasks.workunit.client.0.smithi073.stderr: -12> 2024-09-12T00:51:18.681+0000 7feaf54b7800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:18.835 INFO:tasks.workunit.client.0.smithi073.stderr: -11> 2024-09-12T00:51:18.681+0000 7feaf54b7800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32, ofs0, ns] 2024-09-12T00:51:18.835 INFO:tasks.workunit.client.0.smithi073.stderr: -10> 2024-09-12T00:51:18.681+0000 7fe9d67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497012 cookie 94145809976816 notifier 7365 bl.length()=931 2024-09-12T00:51:18.835 INFO:tasks.workunit.client.0.smithi073.stderr: -9> 2024-09-12T00:51:18.681+0000 7fe9d67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 info.flags=0x17 2024-09-12T00:51:18.836 INFO:tasks.workunit.client.0.smithi073.stderr: -8> 2024-09-12T00:51:18.681+0000 7fe9d67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 to cache LRU end 2024-09-12T00:51:18.836 INFO:tasks.workunit.client.0.smithi073.stderr: -7> 2024-09-12T00:51:18.681+0000 7fe9d67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:18.836 INFO:tasks.workunit.client.0.smithi073.stderr: -6> 2024-09-12T00:51:18.683+0000 7feaf54b7800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32]): orig_sources= new_sources= 2024-09-12T00:51:18.836 INFO:tasks.workunit.client.0.smithi073.stderr: -5> 2024-09-12T00:51:18.683+0000 7feaf54b7800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32]): potential sources added=[] removed=[] 2024-09-12T00:51:18.836 INFO:tasks.workunit.client.0.smithi073.stderr: -4> 2024-09-12T00:51:18.683+0000 7feaf54b7800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32]): orig_dests= new_dests= 2024-09-12T00:51:18.836 INFO:tasks.workunit.client.0.smithi073.stderr: -3> 2024-09-12T00:51:18.683+0000 7feaf54b7800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32]): potential dests added=[] removed=[] 2024-09-12T00:51:18.836 INFO:tasks.workunit.client.0.smithi073.stderr: -2> 2024-09-12T00:51:18.684+0000 7feaf54b7800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32.0 2024-09-12T00:51:18.836 INFO:tasks.workunit.client.0.smithi073.stderr: -1> 2024-09-12T00:51:18.685+0000 7feaf54b7800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7feaf54b7800 time 2024-09-12T00:51:18.685377+0000 2024-09-12T00:51:18.836 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:51:18.836 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:18.836 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:18.836 INFO:tasks.workunit.client.0.smithi073.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7feaf898c71a] 2024-09-12T00:51:18.836 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7feaf898c8d8] 2024-09-12T00:51:18.837 INFO:tasks.workunit.client.0.smithi073.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a004e0f641] 2024-09-12T00:51:18.837 INFO:tasks.workunit.client.0.smithi073.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55a004e1f637] 2024-09-12T00:51:18.837 INFO:tasks.workunit.client.0.smithi073.stderr: 5: main() 2024-09-12T00:51:18.837 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7feaf7629590] 2024-09-12T00:51:18.837 INFO:tasks.workunit.client.0.smithi073.stderr: 7: __libc_start_main() 2024-09-12T00:51:18.837 INFO:tasks.workunit.client.0.smithi073.stderr: 8: _start() 2024-09-12T00:51:18.837 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:18.837 INFO:tasks.workunit.client.0.smithi073.stderr: 0> 2024-09-12T00:51:18.686+0000 7feaf54b7800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:51:18.837 INFO:tasks.workunit.client.0.smithi073.stderr: in thread 7feaf54b7800 thread_name:radosgw-admin 2024-09-12T00:51:18.837 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:18.837 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:18.837 INFO:tasks.workunit.client.0.smithi073.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7feaf763e6f0] 2024-09-12T00:51:18.838 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7feaf768b99c] 2024-09-12T00:51:18.838 INFO:tasks.workunit.client.0.smithi073.stderr: 3: raise() 2024-09-12T00:51:18.838 INFO:tasks.workunit.client.0.smithi073.stderr: 4: abort() 2024-09-12T00:51:18.838 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7feaf898c774] 2024-09-12T00:51:18.838 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7feaf898c8d8] 2024-09-12T00:51:18.838 INFO:tasks.workunit.client.0.smithi073.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a004e0f641] 2024-09-12T00:51:18.838 INFO:tasks.workunit.client.0.smithi073.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55a004e1f637] 2024-09-12T00:51:18.838 INFO:tasks.workunit.client.0.smithi073.stderr: 9: main() 2024-09-12T00:51:18.838 INFO:tasks.workunit.client.0.smithi073.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7feaf7629590] 2024-09-12T00:51:18.838 INFO:tasks.workunit.client.0.smithi073.stderr: 11: __libc_start_main() 2024-09-12T00:51:18.838 INFO:tasks.workunit.client.0.smithi073.stderr: 12: _start() 2024-09-12T00:51:18.838 INFO:tasks.workunit.client.0.smithi073.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:51:18.838 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:18.838 INFO:tasks.workunit.client.0.smithi073.stderr:--- logging levels --- 2024-09-12T00:51:18.839 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 none 2024-09-12T00:51:18.839 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 lockdep 2024-09-12T00:51:18.839 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 context 2024-09-12T00:51:18.839 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 crush 2024-09-12T00:51:18.839 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds 2024-09-12T00:51:18.839 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_balancer 2024-09-12T00:51:18.839 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_locker 2024-09-12T00:51:18.839 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_log 2024-09-12T00:51:18.839 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_log_expire 2024-09-12T00:51:18.839 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_migrator 2024-09-12T00:51:18.839 INFO:tasks.workunit.client.0.smithi073.stderr: 3/ 5 mds_quiesce 2024-09-12T00:51:18.839 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 buffer 2024-09-12T00:51:18.839 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 timer 2024-09-12T00:51:18.839 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 filer 2024-09-12T00:51:18.839 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 striper 2024-09-12T00:51:18.840 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 objecter 2024-09-12T00:51:18.840 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rados 2024-09-12T00:51:18.840 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd 2024-09-12T00:51:18.840 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_mirror 2024-09-12T00:51:18.840 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_replay 2024-09-12T00:51:18.840 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_pwl 2024-09-12T00:51:18.840 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 journaler 2024-09-12T00:51:18.840 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 objectcacher 2024-09-12T00:51:18.840 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:51:18.840 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 client 2024-09-12T00:51:18.840 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 osd 2024-09-12T00:51:18.840 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 optracker 2024-09-12T00:51:18.840 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 objclass 2024-09-12T00:51:18.841 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 filestore 2024-09-12T00:51:18.841 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 journal 2024-09-12T00:51:18.841 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 0 ms 2024-09-12T00:51:18.841 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mon 2024-09-12T00:51:18.841 INFO:tasks.workunit.client.0.smithi073.stderr: 0/10 monc 2024-09-12T00:51:18.841 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 paxos 2024-09-12T00:51:18.841 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 tp 2024-09-12T00:51:18.841 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 auth 2024-09-12T00:51:18.841 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 crypto 2024-09-12T00:51:18.841 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 finisher 2024-09-12T00:51:18.841 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 reserver 2024-09-12T00:51:18.841 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 heartbeatmap 2024-09-12T00:51:18.842 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 perfcounter 2024-09-12T00:51:18.842 INFO:tasks.workunit.client.0.smithi073.stderr: 20/20 rgw 2024-09-12T00:51:18.842 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_sync 2024-09-12T00:51:18.842 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_datacache 2024-09-12T00:51:18.842 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_access 2024-09-12T00:51:18.842 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:51:18.842 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_flight 2024-09-12T00:51:18.842 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:51:18.842 INFO:tasks.workunit.client.0.smithi073.stderr: 20/20 rgw_notification 2024-09-12T00:51:18.842 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 javaclient 2024-09-12T00:51:18.842 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 asok 2024-09-12T00:51:18.842 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 throttle 2024-09-12T00:51:18.842 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 0 refs 2024-09-12T00:51:18.843 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 compressor 2024-09-12T00:51:18.843 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 bluestore 2024-09-12T00:51:18.843 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 bluefs 2024-09-12T00:51:18.843 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 bdev 2024-09-12T00:51:18.843 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 kstore 2024-09-12T00:51:18.843 INFO:tasks.workunit.client.0.smithi073.stderr: 4/ 5 rocksdb 2024-09-12T00:51:18.843 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 fuse 2024-09-12T00:51:18.843 INFO:tasks.workunit.client.0.smithi073.stderr: 2/ 5 mgr 2024-09-12T00:51:18.843 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mgrc 2024-09-12T00:51:18.843 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 dpdk 2024-09-12T00:51:18.843 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 eventtrace 2024-09-12T00:51:18.843 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 prioritycache 2024-09-12T00:51:18.843 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 test 2024-09-12T00:51:18.843 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:51:18.844 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cephsqlite 2024-09-12T00:51:18.844 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:51:18.844 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore 2024-09-12T00:51:18.844 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_onode 2024-09-12T00:51:18.844 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_odata 2024-09-12T00:51:18.844 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_omap 2024-09-12T00:51:18.844 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_tm 2024-09-12T00:51:18.844 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_t 2024-09-12T00:51:18.844 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:51:18.844 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_epm 2024-09-12T00:51:18.844 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_lba 2024-09-12T00:51:18.844 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:51:18.844 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_cache 2024-09-12T00:51:18.845 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_journal 2024-09-12T00:51:18.845 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_device 2024-09-12T00:51:18.845 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_backref 2024-09-12T00:51:18.845 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 alienstore 2024-09-12T00:51:18.845 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mclock 2024-09-12T00:51:18.845 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cyanstore 2024-09-12T00:51:18.845 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 ceph_exporter 2024-09-12T00:51:18.845 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 memstore 2024-09-12T00:51:18.845 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 trace 2024-09-12T00:51:18.845 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 ceph_dedup 2024-09-12T00:51:18.845 INFO:tasks.workunit.client.0.smithi073.stderr: -2/-2 (syslog threshold) 2024-09-12T00:51:18.845 INFO:tasks.workunit.client.0.smithi073.stderr: 99/99 (stderr threshold) 2024-09-12T00:51:18.845 INFO:tasks.workunit.client.0.smithi073.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:51:18.846 INFO:tasks.workunit.client.0.smithi073.stderr: 7fe921ffb640 / http_manager 2024-09-12T00:51:18.846 INFO:tasks.workunit.client.0.smithi073.stderr: 7fe923fff640 / http_manager 2024-09-12T00:51:18.846 INFO:tasks.workunit.client.0.smithi073.stderr: 7fe9a97e2640 / rgw_dt_lg_renew 2024-09-12T00:51:18.846 INFO:tasks.workunit.client.0.smithi073.stderr: 7fe9d4ff9640 / ms_dispatch 2024-09-12T00:51:18.846 INFO:tasks.workunit.client.0.smithi073.stderr: 7fe9d67fc640 / io_context_pool 2024-09-12T00:51:18.846 INFO:tasks.workunit.client.0.smithi073.stderr: 7fe9dce01640 / ms_dispatch 2024-09-12T00:51:18.846 INFO:tasks.workunit.client.0.smithi073.stderr: 7fe9df606640 / ms_dispatch 2024-09-12T00:51:18.846 INFO:tasks.workunit.client.0.smithi073.stderr: 7fe9e0e09640 / io_context_pool 2024-09-12T00:51:18.846 INFO:tasks.workunit.client.0.smithi073.stderr: 7feaebfff640 / msgr-worker-2 2024-09-12T00:51:18.846 INFO:tasks.workunit.client.0.smithi073.stderr: 7feaf2fa1640 / msgr-worker-1 2024-09-12T00:51:18.846 INFO:tasks.workunit.client.0.smithi073.stderr: 7feaf37a2640 / msgr-worker-0 2024-09-12T00:51:18.846 INFO:tasks.workunit.client.0.smithi073.stderr: 7feaf3fa3640 / io_context_pool 2024-09-12T00:51:18.846 INFO:tasks.workunit.client.0.smithi073.stderr: 7feaf54b7800 / radosgw-admin 2024-09-12T00:51:18.847 INFO:tasks.workunit.client.0.smithi073.stderr: max_recent 500 2024-09-12T00:51:18.847 INFO:tasks.workunit.client.0.smithi073.stderr: max_new 1000 2024-09-12T00:51:18.847 INFO:tasks.workunit.client.0.smithi073.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:51:18.686821Z_99ba0d09-98e3-47d2-8b18-95a3e42c6648/log 2024-09-12T00:51:18.847 INFO:tasks.workunit.client.0.smithi073.stderr:--- end dump of recent events --- 2024-09-12T00:51:18.847 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T00:51:18.848 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:18.849 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:18.849 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.763+0000 7f25ac326800 20 rados->read ofs=0 len=0 2024-09-12T00:51:18.849 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.765+0000 7f25ac326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:18.849 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.765+0000 7f25ac326800 20 realm 2024-09-12T00:51:18.849 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.765+0000 7f25ac326800 20 rados->read ofs=0 len=0 2024-09-12T00:51:18.849 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.765+0000 7f25ac326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:18.849 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.765+0000 7f25ac326800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:18.849 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.765+0000 7f25ac326800 20 rados->read ofs=0 len=0 2024-09-12T00:51:18.850 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.765+0000 7f25ac326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:18.850 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.765+0000 7f25ac326800 20 rados->read ofs=0 len=0 2024-09-12T00:51:18.850 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.766+0000 7f25ac326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:18.850 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.766+0000 7f25ac326800 20 rados->read ofs=0 len=0 2024-09-12T00:51:18.850 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.767+0000 7f25ac326800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:18.850 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.767+0000 7f25ac326800 20 searching for the correct realm 2024-09-12T00:51:18.850 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.769+0000 7f25a7708640 0 -- 172.21.15.73:0/2311958337 >> [v2:172.21.15.73:6826/269690776,v1:172.21.15.73:6827/269690776] conn(0x7f2598010910 msgr2=0x7f2598048a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:18.850 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.773+0000 7f25a7f09640 0 -- 172.21.15.73:0/2311958337 >> [v2:172.21.15.73:6810/1807760270,v1:172.21.15.73:6811/1807760270] conn(0x7f25a003d910 msgr2=0x7f25a002f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:51:18.981 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.979+0000 7f25ac326800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:51:18.981 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.979+0000 7f25ac326800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:18.981 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.979+0000 7f25ac326800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:51:18.981 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.979+0000 7f25ac326800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:18.981 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.979+0000 7f25ac326800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:18.981 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.979+0000 7f25ac326800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:18.981 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.979+0000 7f25ac326800 20 rados->read ofs=0 len=0 2024-09-12T00:51:18.981 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.979+0000 7f25ac326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:18.982 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.979+0000 7f25ac326800 20 rados->read ofs=0 len=0 2024-09-12T00:51:18.982 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.980+0000 7f25ac326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:18.982 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.980+0000 7f25ac326800 20 rados->read ofs=0 len=0 2024-09-12T00:51:18.982 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.980+0000 7f25ac326800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:18.982 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.980+0000 7f25ac326800 20 zone default found 2024-09-12T00:51:18.982 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.980+0000 7f25ac326800 4 Realm: () 2024-09-12T00:51:18.982 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.980+0000 7f25ac326800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:51:18.982 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.980+0000 7f25ac326800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:51:18.982 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.980+0000 7f25ac326800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:18.982 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.980+0000 7f25ac326800 20 zonegroup default 2024-09-12T00:51:18.982 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.980+0000 7f25ac326800 20 rados->read ofs=0 len=0 2024-09-12T00:51:18.982 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.980+0000 7f25ac326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:18.983 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.980+0000 7f25ac326800 20 rados->read ofs=0 len=0 2024-09-12T00:51:18.983 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.981+0000 7f25ac326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:18.983 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.981+0000 7f25ac326800 20 rados->read ofs=0 len=0 2024-09-12T00:51:18.983 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.981+0000 7f25ac326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:18.983 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.981+0000 7f25ac326800 20 started sync module instance, tier type = 2024-09-12T00:51:18.983 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.981+0000 7f25ac326800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:51:18.989 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.991+0000 7f25ac326800 20 add_watcher() i=0 2024-09-12T00:51:18.990 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.991+0000 7f25ac326800 20 add_watcher() i=1 2024-09-12T00:51:18.990 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.991+0000 7f25ac326800 20 add_watcher() i=2 2024-09-12T00:51:18.990 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.991+0000 7f25ac326800 20 add_watcher() i=3 2024-09-12T00:51:18.990 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.991+0000 7f25ac326800 20 add_watcher() i=4 2024-09-12T00:51:18.990 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.991+0000 7f25ac326800 20 add_watcher() i=5 2024-09-12T00:51:18.990 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.991+0000 7f25ac326800 20 add_watcher() i=6 2024-09-12T00:51:18.990 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.992+0000 7f25ac326800 20 add_watcher() i=7 2024-09-12T00:51:18.990 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.992+0000 7f25ac326800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:18.992 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.993+0000 7f245dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:18.993 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.993+0000 7f25ac326800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:18.993 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.993+0000 7f25ac326800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:18.993 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.993+0000 7f25ac326800 5 note: GC not initialized 2024-09-12T00:51:18.993 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.994+0000 7f245cfe1640 20 reqs_thread_entry: start 2024-09-12T00:51:18.993 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.994+0000 7f25ac326800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:18.994 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.994+0000 7f25ac326800 20 Filter name: none 2024-09-12T00:51:18.994 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.994+0000 7f23d67fc640 20 reqs_thread_entry: start 2024-09-12T00:51:18.994 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.994+0000 7f25ac326800 20 rados->read ofs=0 len=0 2024-09-12T00:51:18.994 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.994+0000 7f25ac326800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:51:18.994 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.994+0000 7f25ac326800 20 rados->read ofs=0 len=0 2024-09-12T00:51:18.995 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.995+0000 7f25ac326800 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:51:18.995 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.995+0000 7f25ac326800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:18.995 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.995+0000 7f25ac326800 20 rados->read ofs=0 len=0 2024-09-12T00:51:18.995 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.995+0000 7f25ac326800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:51:18.995 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.995+0000 7f25ac326800 20 rados->read ofs=0 len=0 2024-09-12T00:51:18.995 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.995+0000 7f25ac326800 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:51:18.995 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.995+0000 7f25ac326800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:18.996 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.997+0000 7f245dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:18.998 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.999+0000 7f25ac326800 20 remove_watcher() i=0 2024-09-12T00:51:18.998 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:18.999+0000 7f25ac326800 2 removed watcher, disabling cache 2024-09-12T00:51:18.999 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:19.000+0000 7f25ac326800 20 remove_watcher() i=1 2024-09-12T00:51:19.001 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:19.002+0000 7f25ac326800 20 remove_watcher() i=2 2024-09-12T00:51:19.001 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:19.003+0000 7f25ac326800 20 remove_watcher() i=3 2024-09-12T00:51:19.002 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:19.004+0000 7f25ac326800 20 remove_watcher() i=4 2024-09-12T00:51:19.003 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:19.005+0000 7f25ac326800 20 remove_watcher() i=5 2024-09-12T00:51:19.004 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:19.006+0000 7f25ac326800 20 remove_watcher() i=6 2024-09-12T00:51:19.005 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:19.007+0000 7f25ac326800 20 remove_watcher() i=7 2024-09-12T00:51:19.015 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:19.015 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:51:19.015 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: abort-at-commit-target-layout id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:51:19.016 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:19.017 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:19.017 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:49.152 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:49.152 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:49.209 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:51:49.243 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:49.243 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:49.281 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.282+0000 7fd406535800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.283 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.283+0000 7fd406535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:49.283 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.283+0000 7fd406535800 20 realm 2024-09-12T00:51:49.283 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.283+0000 7fd406535800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.283 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.283+0000 7fd406535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:49.283 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.283+0000 7fd406535800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:49.283 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.283+0000 7fd406535800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.284 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.283+0000 7fd406535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:49.284 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.284+0000 7fd406535800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.284 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.285+0000 7fd406535800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:49.284 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.285+0000 7fd406535800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.285 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.285+0000 7fd406535800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:49.285 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.285+0000 7fd406535800 20 searching for the correct realm 2024-09-12T00:51:49.287 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.288+0000 7fd402ae5640 0 -- 172.21.15.73:0/2373842336 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fd3f80bc0a0 msgr2=0x7fd3f80c6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:49.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.494+0000 7fd402ae5640 0 -- 172.21.15.73:0/2373842336 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fd3f80bc0a0 msgr2=0x7fd3f80c6350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:49.498 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.498+0000 7fd406535800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:51:49.498 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.498+0000 7fd406535800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:49.498 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.498+0000 7fd406535800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:51:49.498 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.498+0000 7fd406535800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:49.498 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.498+0000 7fd406535800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:49.498 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.498+0000 7fd406535800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:49.498 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.498+0000 7fd406535800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.498 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.498+0000 7fd406535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:49.498 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.498+0000 7fd406535800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.500 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.498+0000 7fd406535800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:49.500 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.498+0000 7fd406535800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.500 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.499+0000 7fd406535800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:49.500 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.499+0000 7fd406535800 20 zone default found 2024-09-12T00:51:49.500 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.499+0000 7fd406535800 4 Realm: () 2024-09-12T00:51:49.500 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.499+0000 7fd406535800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:51:49.500 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.499+0000 7fd406535800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:51:49.500 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.499+0000 7fd406535800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:49.500 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.499+0000 7fd406535800 20 zonegroup default 2024-09-12T00:51:49.500 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.499+0000 7fd406535800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.501 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.499+0000 7fd406535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:49.501 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.499+0000 7fd406535800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.501 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.499+0000 7fd406535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:49.501 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.499+0000 7fd406535800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.501 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.500+0000 7fd406535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:49.501 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.500+0000 7fd406535800 20 started sync module instance, tier type = 2024-09-12T00:51:49.501 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.500+0000 7fd406535800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:51:49.509 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.510+0000 7fd406535800 20 add_watcher() i=0 2024-09-12T00:51:49.509 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.510+0000 7fd406535800 20 add_watcher() i=1 2024-09-12T00:51:49.509 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.510+0000 7fd406535800 20 add_watcher() i=2 2024-09-12T00:51:49.510 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.510+0000 7fd406535800 20 add_watcher() i=3 2024-09-12T00:51:49.510 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.510+0000 7fd406535800 20 add_watcher() i=4 2024-09-12T00:51:49.510 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.510+0000 7fd406535800 20 add_watcher() i=5 2024-09-12T00:51:49.510 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.510+0000 7fd406535800 20 add_watcher() i=6 2024-09-12T00:51:49.510 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.511+0000 7fd406535800 20 add_watcher() i=7 2024-09-12T00:51:49.510 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.511+0000 7fd406535800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:49.512 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.512+0000 7fd2b8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:49.513 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.513+0000 7fd406535800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:49.514 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.513+0000 7fd406535800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:49.514 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.513+0000 7fd406535800 5 note: GC not initialized 2024-09-12T00:51:49.514 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.513+0000 7fd2337fe640 20 reqs_thread_entry: start 2024-09-12T00:51:49.514 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.513+0000 7fd406535800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:49.514 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.513+0000 7fd406535800 20 Filter name: none 2024-09-12T00:51:49.514 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.513+0000 7fd2317fa640 20 reqs_thread_entry: start 2024-09-12T00:51:49.514 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.513+0000 7fd406535800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T00:51:49.514 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.513+0000 7fd406535800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.514 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.514+0000 7fd406535800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:51:49.514 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.514+0000 7fd406535800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T00:51:49.514 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.514+0000 7fd406535800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T00:51:49.514 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.514+0000 7fd406535800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 : miss 2024-09-12T00:51:49.514 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.514+0000 7fd406535800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.515 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.514+0000 7fd406535800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:51:49.515 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.514+0000 7fd406535800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 info.flags=0x17 2024-09-12T00:51:49.515 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.514+0000 7fd406535800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 to cache LRU end 2024-09-12T00:51:49.515 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.514+0000 7fd406535800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:51:49.515 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.514+0000 7fd406535800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:49.516 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.514+0000 7fd406535800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 2024-09-12T00:51:49.518 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.518+0000 7fd406535800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 info.flags=0x17 2024-09-12T00:51:49.518 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.518+0000 7fd406535800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 to cache LRU end 2024-09-12T00:51:49.518 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.518+0000 7fd406535800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:49.518 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.518+0000 7fd406535800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32, ofs0, ns] 2024-09-12T00:51:49.518 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.518+0000 7fd2e5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497014 cookie 93991252498800 notifier 7404 bl.length()=931 2024-09-12T00:51:49.518 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.518+0000 7fd2e5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 info.flags=0x17 2024-09-12T00:51:49.519 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.518+0000 7fd2e5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 to cache LRU end 2024-09-12T00:51:49.519 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.518+0000 7fd2e5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:49.519 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.520+0000 7fd406535800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32]): orig_sources= new_sources= 2024-09-12T00:51:49.520 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.520+0000 7fd406535800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32]): potential sources added=[] removed=[] 2024-09-12T00:51:49.520 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.520+0000 7fd406535800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32]): orig_dests= new_dests= 2024-09-12T00:51:49.520 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.520+0000 7fd406535800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32]): potential dests added=[] removed=[] 2024-09-12T00:51:49.522 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.523+0000 7fd406535800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32.1.0 2024-09-12T00:51:49.522 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.523+0000 7fd406535800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32.1.0 2024-09-12T00:51:49.523 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.523+0000 7fd406535800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32.1.1 2024-09-12T00:51:49.523 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.523+0000 7fd406535800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32.1.1 2024-09-12T00:51:49.523 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.523+0000 7fd406535800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32.0 2024-09-12T00:51:49.525 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.525+0000 7fd406535800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 : hit (requested=0x17, cached=0x17) 2024-09-12T00:51:49.525 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.525+0000 7fd406535800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 2024-09-12T00:51:49.527 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.527+0000 7fd406535800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 info.flags=0x17 2024-09-12T00:51:49.527 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.527+0000 7fd406535800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 to cache LRU end 2024-09-12T00:51:49.527 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.527+0000 7fd406535800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:49.527 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.527+0000 7fd406535800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32, ofs0, ns] 2024-09-12T00:51:49.527 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.527+0000 7fd2e5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497015 cookie 93991252498800 notifier 7404 bl.length()=931 2024-09-12T00:51:49.527 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.527+0000 7fd2e5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 info.flags=0x17 2024-09-12T00:51:49.527 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.527+0000 7fd2e5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 to cache LRU end 2024-09-12T00:51:49.527 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.527+0000 7fd2e5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:49.528 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.528+0000 7fd406535800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32]): orig_sources= new_sources= 2024-09-12T00:51:49.528 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.528+0000 7fd406535800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32]): potential sources added=[] removed=[] 2024-09-12T00:51:49.528 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.528+0000 7fd406535800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32]): orig_dests= new_dests= 2024-09-12T00:51:49.528 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.528+0000 7fd406535800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32]): potential dests added=[] removed=[] 2024-09-12T00:51:49.529 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.529+0000 7fd406535800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32.0 2024-09-12T00:51:49.529 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.530+0000 7fd406535800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 : hit (requested=0x17, cached=0x17) 2024-09-12T00:51:49.529 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.530+0000 7fd406535800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 2024-09-12T00:51:49.531 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.531+0000 7fd406535800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 info.flags=0x17 2024-09-12T00:51:49.531 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.531+0000 7fd406535800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 to cache LRU end 2024-09-12T00:51:49.531 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.531+0000 7fd406535800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:49.531 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.531+0000 7fd406535800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32, ofs0, ns] 2024-09-12T00:51:49.531 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.531+0000 7fd2e57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497016 cookie 93991252498800 notifier 7404 bl.length()=899 2024-09-12T00:51:49.531 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.531+0000 7fd2e57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 info.flags=0x17 2024-09-12T00:51:49.531 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.531+0000 7fd2e57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 to cache LRU end 2024-09-12T00:51:49.532 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.531+0000 7fd2e57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:49.532 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.532+0000 7fd406535800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32]): orig_sources= new_sources= 2024-09-12T00:51:49.532 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.532+0000 7fd406535800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32]): potential sources added=[] removed=[] 2024-09-12T00:51:49.532 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.532+0000 7fd406535800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32]): orig_dests= new_dests= 2024-09-12T00:51:49.532 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.532+0000 7fd406535800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32]): potential dests added=[] removed=[] 2024-09-12T00:51:49.536 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.534+0000 7fd406535800 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T00:51:49.537 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.536+0000 7fd2b8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:49.538 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.538+0000 7fd406535800 20 remove_watcher() i=0 2024-09-12T00:51:49.538 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.538+0000 7fd406535800 2 removed watcher, disabling cache 2024-09-12T00:51:49.539 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.539+0000 7fd406535800 20 remove_watcher() i=1 2024-09-12T00:51:49.540 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.540+0000 7fd406535800 20 remove_watcher() i=2 2024-09-12T00:51:49.541 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.542+0000 7fd406535800 20 remove_watcher() i=3 2024-09-12T00:51:49.542 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.543+0000 7fd406535800 20 remove_watcher() i=4 2024-09-12T00:51:49.543 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.543+0000 7fd406535800 20 remove_watcher() i=5 2024-09-12T00:51:49.544 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.544+0000 7fd406535800 20 remove_watcher() i=6 2024-09-12T00:51:49.545 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.546+0000 7fd406535800 20 remove_watcher() i=7 2024-09-12T00:51:49.557 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T00:51:49.586 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:49.586 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:49.623 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.623+0000 7fc3ce80f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.625 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.625+0000 7fc3ce80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:49.625 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.625+0000 7fc3ce80f800 20 realm 2024-09-12T00:51:49.625 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.625+0000 7fc3ce80f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.625 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.625+0000 7fc3ce80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:49.625 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.625+0000 7fc3ce80f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:49.625 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.625+0000 7fc3ce80f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.625 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.625+0000 7fc3ce80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:49.625 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.625+0000 7fc3ce80f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.626 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.626+0000 7fc3ce80f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:49.626 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.626+0000 7fc3ce80f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.626 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.627+0000 7fc3ce80f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:49.627 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.627+0000 7fc3ce80f800 20 searching for the correct realm 2024-09-12T00:51:49.627 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.628+0000 7fc3cc2f9640 0 -- 172.21.15.73:0/2415143653 >> [v2:172.21.15.117:6816/1460498570,v1:172.21.15.117:6817/1460498570] conn(0x5568793e7d60 msgr2=0x7fc3c4062440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:49.834 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.834+0000 7fc3c3fff640 0 -- 172.21.15.73:0/2415143653 >> [v2:172.21.15.73:6826/269690776,v1:172.21.15.73:6827/269690776] conn(0x7fc3bc01a070 msgr2=0x7fc3bc085050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:49.841 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.841+0000 7fc3ce80f800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:51:49.841 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.841+0000 7fc3ce80f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:49.841 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.841+0000 7fc3ce80f800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:51:49.841 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.841+0000 7fc3ce80f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:49.841 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.841+0000 7fc3ce80f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:49.841 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.841+0000 7fc3ce80f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:49.841 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.841+0000 7fc3ce80f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.841 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.841+0000 7fc3ce80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:49.841 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.841+0000 7fc3ce80f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.841 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.841+0000 7fc3ce80f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:49.842 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.841+0000 7fc3ce80f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.843 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.841+0000 7fc3ce80f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:49.843 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.841+0000 7fc3ce80f800 20 zone default found 2024-09-12T00:51:49.843 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.841+0000 7fc3ce80f800 4 Realm: () 2024-09-12T00:51:49.843 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.841+0000 7fc3ce80f800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:51:49.843 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.841+0000 7fc3ce80f800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:51:49.843 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.841+0000 7fc3ce80f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:49.843 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.841+0000 7fc3ce80f800 20 zonegroup default 2024-09-12T00:51:49.843 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.841+0000 7fc3ce80f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.843 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.842+0000 7fc3ce80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:49.843 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.842+0000 7fc3ce80f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.843 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.842+0000 7fc3ce80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:49.843 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.842+0000 7fc3ce80f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.844 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.842+0000 7fc3ce80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:49.844 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.842+0000 7fc3ce80f800 20 started sync module instance, tier type = 2024-09-12T00:51:49.844 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.842+0000 7fc3ce80f800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:51:49.851 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.852+0000 7fc3ce80f800 20 add_watcher() i=0 2024-09-12T00:51:49.851 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.852+0000 7fc3ce80f800 20 add_watcher() i=1 2024-09-12T00:51:49.851 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.852+0000 7fc3ce80f800 20 add_watcher() i=2 2024-09-12T00:51:49.851 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.852+0000 7fc3ce80f800 20 add_watcher() i=3 2024-09-12T00:51:49.852 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.852+0000 7fc3ce80f800 20 add_watcher() i=4 2024-09-12T00:51:49.852 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.852+0000 7fc3ce80f800 20 add_watcher() i=5 2024-09-12T00:51:49.852 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.852+0000 7fc3ce80f800 20 add_watcher() i=6 2024-09-12T00:51:49.852 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.852+0000 7fc3ce80f800 20 add_watcher() i=7 2024-09-12T00:51:49.852 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.852+0000 7fc3ce80f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:49.854 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.854+0000 7fc282fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:49.855 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.855+0000 7fc3ce80f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:49.855 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.855+0000 7fc3ce80f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:49.855 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.855+0000 7fc3ce80f800 5 note: GC not initialized 2024-09-12T00:51:49.855 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.855+0000 7fc281fdb640 20 reqs_thread_entry: start 2024-09-12T00:51:49.855 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.855+0000 7fc3ce80f800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:49.855 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.855+0000 7fc3ce80f800 20 Filter name: none 2024-09-12T00:51:49.855 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.855+0000 7fc1f37fe640 20 reqs_thread_entry: start 2024-09-12T00:51:49.856 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.855+0000 7fc3ce80f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.856 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.856+0000 7fc3ce80f800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:51:49.856 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.856+0000 7fc3ce80f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.856 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.856+0000 7fc3ce80f800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:51:49.857 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.856+0000 7fc3ce80f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:49.857 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.856+0000 7fc3ce80f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.857 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.856+0000 7fc3ce80f800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:51:49.857 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.856+0000 7fc3ce80f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.857 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.857+0000 7fc3ce80f800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:51:49.857 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.857+0000 7fc3ce80f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:49.858 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.858+0000 7fc282fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:49.860 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.861+0000 7fc3ce80f800 20 remove_watcher() i=0 2024-09-12T00:51:49.860 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.861+0000 7fc3ce80f800 2 removed watcher, disabling cache 2024-09-12T00:51:49.862 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.862+0000 7fc3ce80f800 20 remove_watcher() i=1 2024-09-12T00:51:49.863 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.863+0000 7fc3ce80f800 20 remove_watcher() i=2 2024-09-12T00:51:49.863 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.864+0000 7fc3ce80f800 20 remove_watcher() i=3 2024-09-12T00:51:49.865 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.865+0000 7fc3ce80f800 20 remove_watcher() i=4 2024-09-12T00:51:49.866 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.866+0000 7fc3ce80f800 20 remove_watcher() i=5 2024-09-12T00:51:49.866 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.867+0000 7fc3ce80f800 20 remove_watcher() i=6 2024-09-12T00:51:49.867 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:49.868+0000 7fc3ce80f800 20 remove_watcher() i=7 2024-09-12T00:51:49.877 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:49.878 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:51:49.878 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: abort-at-commit-target-layout id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:51:49.878 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:49.880 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:49.880 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:49.898 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:49.898 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:50.098 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:50.098 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:50.160 INFO:tasks.workunit.client.0.smithi073.stderr:TEST: reshard bucket with EIO injected at do_reshard 2024-09-12T00:51:50.160 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:50.161 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:50.162 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:50.202 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:50.202 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:50.258 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:50.258 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:50.295 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:50.295 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:50.331 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:50.331 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:50.366 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:50.366 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:50.401 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:50.401 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:50.435 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:50.436 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:50.471 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:50.471 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:50.506 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:50.506 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:50.576 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:50.576 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:50.610 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:50.610 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:50.644 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:50.644 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:50.679 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:50.679 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:50.714 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:50.714 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:50.749 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:50.749 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:50.782 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:50.783 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:50.817 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:50.817 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:50.851 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:50.851 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:50.885 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:50.885 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:50.921 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:50.921 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:50.955 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:50.956 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:50.991 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T00:51:51.020 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:51.020 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:51.057 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.057+0000 7f2f18e0f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:51.058 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.058+0000 7f2f18e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:51.058 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.058+0000 7f2f18e0f800 20 realm 2024-09-12T00:51:51.059 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.058+0000 7f2f18e0f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:51.059 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.059+0000 7f2f18e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:51.059 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.059+0000 7f2f18e0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:51.059 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.059+0000 7f2f18e0f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:51.059 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.059+0000 7f2f18e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:51.059 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.059+0000 7f2f18e0f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:51.059 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.059+0000 7f2f18e0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:51.060 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.059+0000 7f2f18e0f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:51.060 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.060+0000 7f2f18e0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:51.060 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.060+0000 7f2f18e0f800 20 searching for the correct realm 2024-09-12T00:51:51.062 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.063+0000 7f2f170fa640 0 -- 172.21.15.73:0/1227710654 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f2f0c076410 msgr2=0x7f2f0c076890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:51.066 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.067+0000 7f2f160f8640 0 -- 172.21.15.73:0/1227710654 >> [v2:172.21.15.117:6800/110688882,v1:172.21.15.117:6801/110688882] conn(0x559fe49d0080 msgr2=0x559fe49d2470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:51.070 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.070+0000 7f2f18e0f800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:51:51.070 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.070+0000 7f2f18e0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:51.070 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.070+0000 7f2f18e0f800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:51:51.070 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.070+0000 7f2f18e0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:51.070 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.070+0000 7f2f18e0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:51.070 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.070+0000 7f2f18e0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:51.070 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.070+0000 7f2f18e0f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:51.070 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.070+0000 7f2f18e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:51.071 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.070+0000 7f2f18e0f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:51.071 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.070+0000 7f2f18e0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:51.071 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.070+0000 7f2f18e0f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:51.072 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.071+0000 7f2f18e0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:51.072 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.071+0000 7f2f18e0f800 20 zone default found 2024-09-12T00:51:51.072 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.071+0000 7f2f18e0f800 4 Realm: () 2024-09-12T00:51:51.072 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.071+0000 7f2f18e0f800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:51:51.072 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.071+0000 7f2f18e0f800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:51:51.072 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.071+0000 7f2f18e0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:51.072 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.071+0000 7f2f18e0f800 20 zonegroup default 2024-09-12T00:51:51.072 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.071+0000 7f2f18e0f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:51.072 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.071+0000 7f2f18e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:51.073 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.071+0000 7f2f18e0f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:51.073 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.071+0000 7f2f18e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:51.073 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.071+0000 7f2f18e0f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:51.073 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.071+0000 7f2f18e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:51.073 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.071+0000 7f2f18e0f800 20 started sync module instance, tier type = 2024-09-12T00:51:51.073 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.071+0000 7f2f18e0f800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:51:51.080 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.080+0000 7f2f18e0f800 20 add_watcher() i=0 2024-09-12T00:51:51.080 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.080+0000 7f2f18e0f800 20 add_watcher() i=1 2024-09-12T00:51:51.080 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.080+0000 7f2f18e0f800 20 add_watcher() i=2 2024-09-12T00:51:51.080 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.080+0000 7f2f18e0f800 20 add_watcher() i=3 2024-09-12T00:51:51.080 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.080+0000 7f2f18e0f800 20 add_watcher() i=4 2024-09-12T00:51:51.080 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.080+0000 7f2f18e0f800 20 add_watcher() i=5 2024-09-12T00:51:51.080 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.080+0000 7f2f18e0f800 20 add_watcher() i=6 2024-09-12T00:51:51.081 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.081+0000 7f2f18e0f800 20 add_watcher() i=7 2024-09-12T00:51:51.081 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.081+0000 7f2f18e0f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:51.082 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.082+0000 7f2dcd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:51.083 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.083+0000 7f2f18e0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:51.083 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.083+0000 7f2f18e0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:51.083 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.083+0000 7f2f18e0f800 5 note: GC not initialized 2024-09-12T00:51:51.083 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.083+0000 7f2d47fff640 20 reqs_thread_entry: start 2024-09-12T00:51:51.083 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.083+0000 7f2f18e0f800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:51.083 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.083+0000 7f2f18e0f800 20 Filter name: none 2024-09-12T00:51:51.083 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.083+0000 7f2d45ffb640 20 reqs_thread_entry: start 2024-09-12T00:51:51.084 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.083+0000 7f2f18e0f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:51.085 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.084+0000 7f2f18e0f800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:51:51.085 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.084+0000 7f2f18e0f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:51.085 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.084+0000 7f2f18e0f800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:51:51.085 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.084+0000 7f2f18e0f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:51.085 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.084+0000 7f2f18e0f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:51.085 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.085+0000 7f2f18e0f800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:51:51.085 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.085+0000 7f2f18e0f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:51.085 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.085+0000 7f2f18e0f800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:51:51.085 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.085+0000 7f2f18e0f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:51.086 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.086+0000 7f2dcd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:51.089 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.089+0000 7f2f18e0f800 20 remove_watcher() i=0 2024-09-12T00:51:51.089 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.089+0000 7f2f18e0f800 2 removed watcher, disabling cache 2024-09-12T00:51:51.090 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.091+0000 7f2f18e0f800 20 remove_watcher() i=1 2024-09-12T00:51:51.091 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.092+0000 7f2f18e0f800 20 remove_watcher() i=2 2024-09-12T00:51:51.092 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.093+0000 7f2f18e0f800 20 remove_watcher() i=3 2024-09-12T00:51:51.093 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.094+0000 7f2f18e0f800 20 remove_watcher() i=4 2024-09-12T00:51:51.094 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.095+0000 7f2f18e0f800 20 remove_watcher() i=5 2024-09-12T00:51:51.095 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.096+0000 7f2f18e0f800 20 remove_watcher() i=6 2024-09-12T00:51:51.096 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.097+0000 7f2f18e0f800 20 remove_watcher() i=7 2024-09-12T00:51:51.106 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:51.106 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:51:51.106 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: error-at-do-reshard id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:51:51.107 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:51.108 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2024-09-12T00:51:51.142 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:51.142 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:51.178 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.179+0000 7fbec5a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:51.180 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.180+0000 7fbec5a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:51.180 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.180+0000 7fbec5a0e800 20 realm 2024-09-12T00:51:51.180 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.180+0000 7fbec5a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:51.180 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.180+0000 7fbec5a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:51.180 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.180+0000 7fbec5a0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:51.180 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.180+0000 7fbec5a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:51.181 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.180+0000 7fbec5a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:51.181 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.180+0000 7fbec5a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:51.181 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.181+0000 7fbec5a0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:51.181 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.181+0000 7fbec5a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:51.182 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.182+0000 7fbec5a0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:51.182 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.182+0000 7fbec5a0e800 20 searching for the correct realm 2024-09-12T00:51:51.184 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.184+0000 7fbec0858640 0 -- 172.21.15.73:0/3592483050 >> [v2:172.21.15.73:6826/269690776,v1:172.21.15.73:6827/269690776] conn(0x7fbeb402c060 msgr2=0x7fbeb4068b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:51.390 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.390+0000 7fbec1059640 0 -- 172.21.15.73:0/3592483050 >> [v2:172.21.15.73:6810/1807760270,v1:172.21.15.73:6811/1807760270] conn(0x7fbebc065180 msgr2=0x7fbebc07ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:51.597 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.596+0000 7fbec5a0e800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:51:51.597 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.596+0000 7fbec5a0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:51.597 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.596+0000 7fbec5a0e800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:51:51.597 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.596+0000 7fbec5a0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:51.597 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.596+0000 7fbec5a0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:51.598 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.596+0000 7fbec5a0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:51.598 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.596+0000 7fbec5a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:51.598 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.596+0000 7fbec5a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:51.598 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.596+0000 7fbec5a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:51.598 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.597+0000 7fbec5a0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:51.598 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.597+0000 7fbec5a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:51.598 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.597+0000 7fbec5a0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:51.598 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.597+0000 7fbec5a0e800 20 zone default found 2024-09-12T00:51:51.598 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.597+0000 7fbec5a0e800 4 Realm: () 2024-09-12T00:51:51.598 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.597+0000 7fbec5a0e800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:51:51.598 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.597+0000 7fbec5a0e800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:51:51.598 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.597+0000 7fbec5a0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:51.598 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.597+0000 7fbec5a0e800 20 zonegroup default 2024-09-12T00:51:51.599 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.597+0000 7fbec5a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:51.599 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.597+0000 7fbec5a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:51.599 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.597+0000 7fbec5a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:51.599 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.598+0000 7fbec5a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:51.599 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.598+0000 7fbec5a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:51.600 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.598+0000 7fbec5a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:51.600 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.598+0000 7fbec5a0e800 20 started sync module instance, tier type = 2024-09-12T00:51:51.600 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.598+0000 7fbec5a0e800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:51:51.607 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.607+0000 7fbec5a0e800 20 add_watcher() i=0 2024-09-12T00:51:51.607 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.607+0000 7fbec5a0e800 20 add_watcher() i=1 2024-09-12T00:51:51.607 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.607+0000 7fbec5a0e800 20 add_watcher() i=2 2024-09-12T00:51:51.608 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.607+0000 7fbec5a0e800 20 add_watcher() i=3 2024-09-12T00:51:51.608 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.607+0000 7fbec5a0e800 20 add_watcher() i=4 2024-09-12T00:51:51.608 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.607+0000 7fbec5a0e800 20 add_watcher() i=5 2024-09-12T00:51:51.608 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.607+0000 7fbec5a0e800 20 add_watcher() i=6 2024-09-12T00:51:51.608 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.608+0000 7fbec5a0e800 20 add_watcher() i=7 2024-09-12T00:51:51.609 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.608+0000 7fbec5a0e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:51.610 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.610+0000 7fbd77fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:51.611 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.611+0000 7fbec5a0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:51.611 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.611+0000 7fbec5a0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:51.611 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.611+0000 7fbec5a0e800 5 note: GC not initialized 2024-09-12T00:51:51.611 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.611+0000 7fbd76fe5640 20 reqs_thread_entry: start 2024-09-12T00:51:51.611 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.611+0000 7fbec5a0e800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:51.611 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.611+0000 7fbec5a0e800 20 Filter name: none 2024-09-12T00:51:51.611 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.611+0000 7fbd74fe1640 20 reqs_thread_entry: start 2024-09-12T00:51:51.611 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.611+0000 7fbec5a0e800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-12T00:51:51.612 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.611+0000 7fbec5a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:51.612 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.612+0000 7fbec5a0e800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:51:51.613 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.612+0000 7fbec5a0e800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-12T00:51:51.613 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.612+0000 7fbec5a0e800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-12T00:51:51.613 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.612+0000 7fbec5a0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33 : miss 2024-09-12T00:51:51.613 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.612+0000 7fbec5a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:51.613 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.612+0000 7fbec5a0e800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:51:51.613 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.612+0000 7fbec5a0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33 info.flags=0x17 2024-09-12T00:51:51.613 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.612+0000 7fbec5a0e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33 to cache LRU end 2024-09-12T00:51:51.613 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.612+0000 7fbec5a0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:51:51.613 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.612+0000 7fbec5a0e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:51.613 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.612+0000 7fbec5a0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33 2024-09-12T00:51:51.616 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.616+0000 7fbec5a0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33 info.flags=0x17 2024-09-12T00:51:51.616 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.616+0000 7fbec5a0e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33 to cache LRU end 2024-09-12T00:51:51.616 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.616+0000 7fbec5a0e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:51.616 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.616+0000 7fbec5a0e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33, ofs0, ns] 2024-09-12T00:51:51.617 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.617+0000 7fbda4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497056 cookie 93977333155824 notifier 7458 bl.length()=911 2024-09-12T00:51:51.617 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.617+0000 7fbda4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33 info.flags=0x17 2024-09-12T00:51:51.617 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.617+0000 7fbda4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33 to cache LRU end 2024-09-12T00:51:51.617 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.617+0000 7fbda4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:51.618 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.618+0000 7fbec5a0e800 20 handle_bi_update(): bucket=:error-at-do-reshard[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33]): orig_sources= new_sources= 2024-09-12T00:51:51.618 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.618+0000 7fbec5a0e800 20 handle_bi_update(): bucket=:error-at-do-reshard[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33]): potential sources added=[] removed=[] 2024-09-12T00:51:51.618 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.618+0000 7fbec5a0e800 20 handle_bi_update(): bucket=:error-at-do-reshard[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33]): orig_dests= new_dests= 2024-09-12T00:51:51.618 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.618+0000 7fbec5a0e800 20 handle_bi_update(): bucket=:error-at-do-reshard[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33]): potential dests added=[] removed=[] 2024-09-12T00:51:51.620 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.621+0000 7fbec5a0e800 -1 Injecting error=-5 at location=do_reshard 2024-09-12T00:51:51.623 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.624+0000 7fbec5a0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33 : hit (requested=0x17, cached=0x17) 2024-09-12T00:51:51.624 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.624+0000 7fbec5a0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33 2024-09-12T00:51:51.625 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.625+0000 7fbec5a0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33 info.flags=0x17 2024-09-12T00:51:51.625 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.625+0000 7fbec5a0e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33 to cache LRU end 2024-09-12T00:51:51.625 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.625+0000 7fbec5a0e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:51.625 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.625+0000 7fbec5a0e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33, ofs0, ns] 2024-09-12T00:51:51.625 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.625+0000 7fbd93fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497057 cookie 93977333155824 notifier 7458 bl.length()=879 2024-09-12T00:51:51.625 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.625+0000 7fbd93fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33 info.flags=0x17 2024-09-12T00:51:51.625 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.625+0000 7fbd93fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33 to cache LRU end 2024-09-12T00:51:51.626 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.625+0000 7fbd93fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:51.626 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.627+0000 7fbec5a0e800 20 handle_bi_update(): bucket=:error-at-do-reshard[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33]): orig_sources= new_sources= 2024-09-12T00:51:51.626 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.627+0000 7fbec5a0e800 20 handle_bi_update(): bucket=:error-at-do-reshard[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33]): potential sources added=[] removed=[] 2024-09-12T00:51:51.627 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.627+0000 7fbec5a0e800 20 handle_bi_update(): bucket=:error-at-do-reshard[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33]): orig_dests= new_dests= 2024-09-12T00:51:51.627 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.627+0000 7fbec5a0e800 20 handle_bi_update(): bucket=:error-at-do-reshard[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33]): potential dests added=[] removed=[] 2024-09-12T00:51:51.627 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.627+0000 7fbec5a0e800 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2024-09-12T00:51:51.628 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.628+0000 7fbd77fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:51.630 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.631+0000 7fbec5a0e800 20 remove_watcher() i=0 2024-09-12T00:51:51.630 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.631+0000 7fbec5a0e800 2 removed watcher, disabling cache 2024-09-12T00:51:51.631 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.632+0000 7fbec5a0e800 20 remove_watcher() i=1 2024-09-12T00:51:51.632 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.633+0000 7fbec5a0e800 20 remove_watcher() i=2 2024-09-12T00:51:51.633 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.634+0000 7fbec5a0e800 20 remove_watcher() i=3 2024-09-12T00:51:51.634 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.635+0000 7fbec5a0e800 20 remove_watcher() i=4 2024-09-12T00:51:51.635 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.636+0000 7fbec5a0e800 20 remove_watcher() i=5 2024-09-12T00:51:51.637 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.637+0000 7fbec5a0e800 20 remove_watcher() i=6 2024-09-12T00:51:51.638 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.638+0000 7fbec5a0e800 20 remove_watcher() i=7 2024-09-12T00:51:51.650 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T00:51:51.679 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:51.679 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:51.716 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.716+0000 7f5f76775800 20 rados->read ofs=0 len=0 2024-09-12T00:51:51.718 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.718+0000 7f5f76775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:51.718 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.718+0000 7f5f76775800 20 realm 2024-09-12T00:51:51.718 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.718+0000 7f5f76775800 20 rados->read ofs=0 len=0 2024-09-12T00:51:51.718 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.718+0000 7f5f76775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:51.718 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.718+0000 7f5f76775800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:51.719 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.718+0000 7f5f76775800 20 rados->read ofs=0 len=0 2024-09-12T00:51:51.719 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.718+0000 7f5f76775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:51.719 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.718+0000 7f5f76775800 20 rados->read ofs=0 len=0 2024-09-12T00:51:51.719 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.719+0000 7f5f76775800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:51.719 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.719+0000 7f5f76775800 20 rados->read ofs=0 len=0 2024-09-12T00:51:51.720 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.720+0000 7f5f76775800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:51.720 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.720+0000 7f5f76775800 20 searching for the correct realm 2024-09-12T00:51:51.722 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.722+0000 7f5f74a60640 0 -- 172.21.15.73:0/2726959243 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f5f5c0c8040 msgr2=0x7f5f5c0a31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:51.928 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.928+0000 7f5f74a60640 0 -- 172.21.15.73:0/2726959243 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f5f5c0c8040 msgr2=0x7f5f5c0a31f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:51.932 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.932+0000 7f5f76775800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:51:51.933 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.932+0000 7f5f76775800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:51.933 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.932+0000 7f5f76775800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:51:51.933 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.932+0000 7f5f76775800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:51.933 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.932+0000 7f5f76775800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:51.933 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.932+0000 7f5f76775800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:51.933 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.932+0000 7f5f76775800 20 rados->read ofs=0 len=0 2024-09-12T00:51:51.933 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.933+0000 7f5f76775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:51.933 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.933+0000 7f5f76775800 20 rados->read ofs=0 len=0 2024-09-12T00:51:51.933 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.933+0000 7f5f76775800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:51.933 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.933+0000 7f5f76775800 20 rados->read ofs=0 len=0 2024-09-12T00:51:51.934 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.933+0000 7f5f76775800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:51.935 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.933+0000 7f5f76775800 20 zone default found 2024-09-12T00:51:51.935 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.933+0000 7f5f76775800 4 Realm: () 2024-09-12T00:51:51.935 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.933+0000 7f5f76775800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:51:51.935 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.933+0000 7f5f76775800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:51:51.935 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.933+0000 7f5f76775800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:51.935 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.933+0000 7f5f76775800 20 zonegroup default 2024-09-12T00:51:51.935 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.933+0000 7f5f76775800 20 rados->read ofs=0 len=0 2024-09-12T00:51:51.935 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.933+0000 7f5f76775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:51.935 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.933+0000 7f5f76775800 20 rados->read ofs=0 len=0 2024-09-12T00:51:51.935 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.934+0000 7f5f76775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:51.935 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.934+0000 7f5f76775800 20 rados->read ofs=0 len=0 2024-09-12T00:51:51.935 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.934+0000 7f5f76775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:51.935 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.934+0000 7f5f76775800 20 started sync module instance, tier type = 2024-09-12T00:51:51.936 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.934+0000 7f5f76775800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:51:51.944 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.944+0000 7f5f76775800 20 add_watcher() i=0 2024-09-12T00:51:51.944 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.944+0000 7f5f76775800 20 add_watcher() i=1 2024-09-12T00:51:51.944 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.944+0000 7f5f76775800 20 add_watcher() i=2 2024-09-12T00:51:51.944 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.944+0000 7f5f76775800 20 add_watcher() i=3 2024-09-12T00:51:51.944 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.944+0000 7f5f76775800 20 add_watcher() i=4 2024-09-12T00:51:51.944 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.944+0000 7f5f76775800 20 add_watcher() i=5 2024-09-12T00:51:51.944 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.944+0000 7f5f76775800 20 add_watcher() i=6 2024-09-12T00:51:51.945 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.945+0000 7f5f76775800 20 add_watcher() i=7 2024-09-12T00:51:51.945 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.945+0000 7f5f76775800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:51.946 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.946+0000 7f5e2a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:51.947 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.947+0000 7f5f76775800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:51.947 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.947+0000 7f5f76775800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:51.947 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.947+0000 7f5f76775800 5 note: GC not initialized 2024-09-12T00:51:51.947 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.947+0000 7f5e297e2640 20 reqs_thread_entry: start 2024-09-12T00:51:51.947 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.947+0000 7f5f76775800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:51.947 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.947+0000 7f5f76775800 20 Filter name: none 2024-09-12T00:51:51.947 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.947+0000 7f5d9affd640 20 reqs_thread_entry: start 2024-09-12T00:51:51.948 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.947+0000 7f5f76775800 20 rados->read ofs=0 len=0 2024-09-12T00:51:51.949 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.948+0000 7f5f76775800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:51:51.949 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.948+0000 7f5f76775800 20 rados->read ofs=0 len=0 2024-09-12T00:51:51.949 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.948+0000 7f5f76775800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:51:51.949 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.948+0000 7f5f76775800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:51.949 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.948+0000 7f5f76775800 20 rados->read ofs=0 len=0 2024-09-12T00:51:51.949 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.948+0000 7f5f76775800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:51:51.949 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.948+0000 7f5f76775800 20 rados->read ofs=0 len=0 2024-09-12T00:51:51.949 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.949+0000 7f5f76775800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:51:51.949 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.949+0000 7f5f76775800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:51.950 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.950+0000 7f5e2a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:51.952 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.952+0000 7f5f76775800 20 remove_watcher() i=0 2024-09-12T00:51:51.952 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.952+0000 7f5f76775800 2 removed watcher, disabling cache 2024-09-12T00:51:51.953 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.953+0000 7f5f76775800 20 remove_watcher() i=1 2024-09-12T00:51:51.954 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.955+0000 7f5f76775800 20 remove_watcher() i=2 2024-09-12T00:51:51.956 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.956+0000 7f5f76775800 20 remove_watcher() i=3 2024-09-12T00:51:51.957 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.957+0000 7f5f76775800 20 remove_watcher() i=4 2024-09-12T00:51:51.958 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.958+0000 7f5f76775800 20 remove_watcher() i=5 2024-09-12T00:51:51.959 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.959+0000 7f5f76775800 20 remove_watcher() i=6 2024-09-12T00:51:51.960 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:51.960+0000 7f5f76775800 20 remove_watcher() i=7 2024-09-12T00:51:51.970 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:51.970 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:51:51.970 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: error-at-do-reshard id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:51:51.970 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:51.971 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:51.971 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:52.003 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:52.003 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:52.060 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:51:52.092 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:52.092 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:52.129 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.129+0000 7ff030b2e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:52.130 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.130+0000 7ff030b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:52.130 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.130+0000 7ff030b2e800 20 realm 2024-09-12T00:51:52.130 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.130+0000 7ff030b2e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:52.131 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.130+0000 7ff030b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:52.131 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.131+0000 7ff030b2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:52.131 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.131+0000 7ff030b2e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:52.131 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.131+0000 7ff030b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:52.131 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.131+0000 7ff030b2e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:52.131 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.132+0000 7ff030b2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:52.131 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.132+0000 7ff030b2e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:52.132 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.132+0000 7ff030b2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:52.132 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.132+0000 7ff030b2e800 20 searching for the correct realm 2024-09-12T00:51:52.134 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.134+0000 7ff02cf65640 0 -- 172.21.15.73:0/535500008 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7ff02008d040 msgr2=0x7ff02008f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:52.342 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.342+0000 7ff02cf65640 0 -- 172.21.15.73:0/535500008 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7ff02008d040 msgr2=0x7ff02008f950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:52.346 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.346+0000 7ff030b2e800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:51:52.346 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.346+0000 7ff030b2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:52.346 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.346+0000 7ff030b2e800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:51:52.346 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.346+0000 7ff030b2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:52.347 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.346+0000 7ff030b2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:52.347 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.346+0000 7ff030b2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:52.347 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.346+0000 7ff030b2e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:52.347 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.347+0000 7ff030b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:52.347 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.347+0000 7ff030b2e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:52.348 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.347+0000 7ff030b2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:52.348 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.347+0000 7ff030b2e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:52.348 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.347+0000 7ff030b2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:52.348 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.347+0000 7ff030b2e800 20 zone default found 2024-09-12T00:51:52.348 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.347+0000 7ff030b2e800 4 Realm: () 2024-09-12T00:51:52.349 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.347+0000 7ff030b2e800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:51:52.349 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.347+0000 7ff030b2e800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:51:52.349 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.347+0000 7ff030b2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:52.349 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.347+0000 7ff030b2e800 20 zonegroup default 2024-09-12T00:51:52.349 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.347+0000 7ff030b2e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:52.349 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.348+0000 7ff030b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:52.349 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.348+0000 7ff030b2e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:52.349 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.348+0000 7ff030b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:52.349 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.348+0000 7ff030b2e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:52.349 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.348+0000 7ff030b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:52.349 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.348+0000 7ff030b2e800 20 started sync module instance, tier type = 2024-09-12T00:51:52.349 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.348+0000 7ff030b2e800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:51:52.358 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.358+0000 7ff030b2e800 20 add_watcher() i=0 2024-09-12T00:51:52.358 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.358+0000 7ff030b2e800 20 add_watcher() i=1 2024-09-12T00:51:52.358 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.358+0000 7ff030b2e800 20 add_watcher() i=2 2024-09-12T00:51:52.358 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.358+0000 7ff030b2e800 20 add_watcher() i=3 2024-09-12T00:51:52.358 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.358+0000 7ff030b2e800 20 add_watcher() i=4 2024-09-12T00:51:52.358 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.358+0000 7ff030b2e800 20 add_watcher() i=5 2024-09-12T00:51:52.358 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.358+0000 7ff030b2e800 20 add_watcher() i=6 2024-09-12T00:51:52.358 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.359+0000 7ff030b2e800 20 add_watcher() i=7 2024-09-12T00:51:52.359 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.359+0000 7ff030b2e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:52.360 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.360+0000 7feee27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:52.362 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.361+0000 7ff030b2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:52.362 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.361+0000 7ff030b2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:52.362 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.361+0000 7ff030b2e800 5 note: GC not initialized 2024-09-12T00:51:52.362 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.361+0000 7feee17e2640 20 reqs_thread_entry: start 2024-09-12T00:51:52.362 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.361+0000 7ff030b2e800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:52.362 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.361+0000 7ff030b2e800 20 Filter name: none 2024-09-12T00:51:52.363 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.361+0000 7fee5affd640 20 reqs_thread_entry: start 2024-09-12T00:51:52.363 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.361+0000 7ff030b2e800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-12T00:51:52.363 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.361+0000 7ff030b2e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:52.363 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.362+0000 7ff030b2e800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:51:52.363 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.362+0000 7ff030b2e800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-12T00:51:52.363 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.362+0000 7ff030b2e800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-12T00:51:52.363 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.362+0000 7ff030b2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33 : miss 2024-09-12T00:51:52.363 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.362+0000 7ff030b2e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:52.363 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.362+0000 7ff030b2e800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:51:52.363 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.362+0000 7ff030b2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33 info.flags=0x17 2024-09-12T00:51:52.364 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.362+0000 7ff030b2e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33 to cache LRU end 2024-09-12T00:51:52.364 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.362+0000 7ff030b2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:51:52.364 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.362+0000 7ff030b2e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:52.364 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.362+0000 7ff030b2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33 2024-09-12T00:51:52.366 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.366+0000 7ff030b2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33 info.flags=0x17 2024-09-12T00:51:52.366 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.366+0000 7ff030b2e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33 to cache LRU end 2024-09-12T00:51:52.366 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.366+0000 7ff030b2e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:52.366 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.366+0000 7ff030b2e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33, ofs0, ns] 2024-09-12T00:51:52.366 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.366+0000 7fef0b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497058 cookie 94850209178320 notifier 7491 bl.length()=911 2024-09-12T00:51:52.366 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.366+0000 7fef0b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33 info.flags=0x17 2024-09-12T00:51:52.366 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.366+0000 7fef0b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33 to cache LRU end 2024-09-12T00:51:52.366 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.366+0000 7fef0b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:52.368 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.368+0000 7ff030b2e800 20 handle_bi_update(): bucket=:error-at-do-reshard[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33]): orig_sources= new_sources= 2024-09-12T00:51:52.368 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.368+0000 7ff030b2e800 20 handle_bi_update(): bucket=:error-at-do-reshard[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33]): potential sources added=[] removed=[] 2024-09-12T00:51:52.368 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.368+0000 7ff030b2e800 20 handle_bi_update(): bucket=:error-at-do-reshard[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33]): orig_dests= new_dests= 2024-09-12T00:51:52.368 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.368+0000 7ff030b2e800 20 handle_bi_update(): bucket=:error-at-do-reshard[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33]): potential dests added=[] removed=[] 2024-09-12T00:51:52.370 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.370+0000 7ff030b2e800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33.1.0 2024-09-12T00:51:52.370 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.370+0000 7ff030b2e800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33.1.0 2024-09-12T00:51:52.370 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.370+0000 7ff030b2e800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33.1.1 2024-09-12T00:51:52.370 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.370+0000 7ff030b2e800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33.1.1 2024-09-12T00:51:52.370 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.370+0000 7ff030b2e800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33.0 2024-09-12T00:51:52.373 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.373+0000 7ff030b2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33 : hit (requested=0x17, cached=0x17) 2024-09-12T00:51:52.373 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.373+0000 7ff030b2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33 2024-09-12T00:51:52.374 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.374+0000 7ff030b2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33 info.flags=0x17 2024-09-12T00:51:52.374 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.374+0000 7ff030b2e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33 to cache LRU end 2024-09-12T00:51:52.374 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.374+0000 7ff030b2e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:52.375 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.374+0000 7ff030b2e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33, ofs0, ns] 2024-09-12T00:51:52.375 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.375+0000 7fef0b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497059 cookie 94850209178320 notifier 7491 bl.length()=911 2024-09-12T00:51:52.375 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.375+0000 7fef0b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33 info.flags=0x17 2024-09-12T00:51:52.375 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.375+0000 7fef0b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33 to cache LRU end 2024-09-12T00:51:52.375 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.375+0000 7fef0b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:52.376 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.376+0000 7ff030b2e800 20 handle_bi_update(): bucket=:error-at-do-reshard[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33]): orig_sources= new_sources= 2024-09-12T00:51:52.376 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.376+0000 7ff030b2e800 20 handle_bi_update(): bucket=:error-at-do-reshard[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33]): potential sources added=[] removed=[] 2024-09-12T00:51:52.376 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.376+0000 7ff030b2e800 20 handle_bi_update(): bucket=:error-at-do-reshard[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33]): orig_dests= new_dests= 2024-09-12T00:51:52.376 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.376+0000 7ff030b2e800 20 handle_bi_update(): bucket=:error-at-do-reshard[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33]): potential dests added=[] removed=[] 2024-09-12T00:51:52.377 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.377+0000 7ff030b2e800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33.0 2024-09-12T00:51:52.377 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.378+0000 7ff030b2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33 : hit (requested=0x17, cached=0x17) 2024-09-12T00:51:52.377 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.378+0000 7ff030b2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33 2024-09-12T00:51:52.379 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.379+0000 7ff030b2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33 info.flags=0x17 2024-09-12T00:51:52.379 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.379+0000 7ff030b2e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33 to cache LRU end 2024-09-12T00:51:52.379 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.379+0000 7ff030b2e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:52.379 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.379+0000 7ff030b2e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33, ofs0, ns] 2024-09-12T00:51:52.379 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.379+0000 7fef0affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497060 cookie 94850209178320 notifier 7491 bl.length()=879 2024-09-12T00:51:52.379 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.379+0000 7fef0affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33 info.flags=0x17 2024-09-12T00:51:52.379 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.379+0000 7fef0affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33 to cache LRU end 2024-09-12T00:51:52.379 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.379+0000 7fef0affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:52.380 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.381+0000 7ff030b2e800 20 handle_bi_update(): bucket=:error-at-do-reshard[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33]): orig_sources= new_sources= 2024-09-12T00:51:52.380 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.381+0000 7ff030b2e800 20 handle_bi_update(): bucket=:error-at-do-reshard[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33]): potential sources added=[] removed=[] 2024-09-12T00:51:52.380 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.381+0000 7ff030b2e800 20 handle_bi_update(): bucket=:error-at-do-reshard[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33]): orig_dests= new_dests= 2024-09-12T00:51:52.381 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.381+0000 7ff030b2e800 20 handle_bi_update(): bucket=:error-at-do-reshard[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33]): potential dests added=[] removed=[] 2024-09-12T00:51:52.381 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.382+0000 7ff030b2e800 1 execute INFO: reshard of bucket "error-at-do-reshard" from 1 shards to 2 shards completed successfully 2024-09-12T00:51:52.384 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.384+0000 7feee27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:52.386 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.387+0000 7ff030b2e800 20 remove_watcher() i=0 2024-09-12T00:51:52.386 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.387+0000 7ff030b2e800 2 removed watcher, disabling cache 2024-09-12T00:51:52.387 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.388+0000 7ff030b2e800 20 remove_watcher() i=1 2024-09-12T00:51:52.388 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.389+0000 7ff030b2e800 20 remove_watcher() i=2 2024-09-12T00:51:52.390 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.390+0000 7ff030b2e800 20 remove_watcher() i=3 2024-09-12T00:51:52.391 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.391+0000 7ff030b2e800 20 remove_watcher() i=4 2024-09-12T00:51:52.392 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.392+0000 7ff030b2e800 20 remove_watcher() i=5 2024-09-12T00:51:52.392 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.393+0000 7ff030b2e800 20 remove_watcher() i=6 2024-09-12T00:51:52.393 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.394+0000 7ff030b2e800 20 remove_watcher() i=7 2024-09-12T00:51:52.406 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T00:51:52.434 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:52.434 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:52.471 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.471+0000 7f68d8f26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:52.473 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.473+0000 7f68d8f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:52.473 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.473+0000 7f68d8f26800 20 realm 2024-09-12T00:51:52.473 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.473+0000 7f68d8f26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:52.473 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.473+0000 7f68d8f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:52.473 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.473+0000 7f68d8f26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:52.473 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.473+0000 7f68d8f26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:52.473 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.473+0000 7f68d8f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:52.473 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.473+0000 7f68d8f26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:52.474 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.474+0000 7f68d8f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:52.474 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.474+0000 7f68d8f26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:52.475 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.475+0000 7f68d8f26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:52.475 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.475+0000 7f68d8f26800 20 searching for the correct realm 2024-09-12T00:51:52.477 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.477+0000 7f68d530a640 0 -- 172.21.15.73:0/3741479053 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f68bc095060 msgr2=0x7f68bc066040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:52.481 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.482+0000 7f68d530a640 0 -- 172.21.15.73:0/3741479053 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f67a0086310 msgr2=0x7f67a0088740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:52.485 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.485+0000 7f68d8f26800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:51:52.485 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.485+0000 7f68d8f26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:52.485 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.485+0000 7f68d8f26800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:51:52.486 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.485+0000 7f68d8f26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:52.486 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.485+0000 7f68d8f26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:52.486 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.485+0000 7f68d8f26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:52.486 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.485+0000 7f68d8f26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:52.486 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.485+0000 7f68d8f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:52.486 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.485+0000 7f68d8f26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:52.486 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.486+0000 7f68d8f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:52.486 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.486+0000 7f68d8f26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:52.487 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.486+0000 7f68d8f26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:52.488 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.486+0000 7f68d8f26800 20 zone default found 2024-09-12T00:51:52.488 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.486+0000 7f68d8f26800 4 Realm: () 2024-09-12T00:51:52.488 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.486+0000 7f68d8f26800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:51:52.488 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.486+0000 7f68d8f26800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:51:52.488 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.486+0000 7f68d8f26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:52.488 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.486+0000 7f68d8f26800 20 zonegroup default 2024-09-12T00:51:52.489 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.486+0000 7f68d8f26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:52.489 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.486+0000 7f68d8f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:52.489 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.486+0000 7f68d8f26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:52.489 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.486+0000 7f68d8f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:52.489 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.486+0000 7f68d8f26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:52.489 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.487+0000 7f68d8f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:52.489 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.487+0000 7f68d8f26800 20 started sync module instance, tier type = 2024-09-12T00:51:52.489 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.487+0000 7f68d8f26800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:51:52.495 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.495+0000 7f68d8f26800 20 add_watcher() i=0 2024-09-12T00:51:52.495 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.495+0000 7f68d8f26800 20 add_watcher() i=1 2024-09-12T00:51:52.495 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.495+0000 7f68d8f26800 20 add_watcher() i=2 2024-09-12T00:51:52.495 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.495+0000 7f68d8f26800 20 add_watcher() i=3 2024-09-12T00:51:52.495 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.495+0000 7f68d8f26800 20 add_watcher() i=4 2024-09-12T00:51:52.496 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.495+0000 7f68d8f26800 20 add_watcher() i=5 2024-09-12T00:51:52.496 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.495+0000 7f68d8f26800 20 add_watcher() i=6 2024-09-12T00:51:52.496 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.496+0000 7f68d8f26800 20 add_watcher() i=7 2024-09-12T00:51:52.496 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.496+0000 7f68d8f26800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:52.498 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.498+0000 7f678afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:52.500 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.498+0000 7f68d8f26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:52.500 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.498+0000 7f68d8f26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:52.500 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.498+0000 7f68d8f26800 5 note: GC not initialized 2024-09-12T00:51:52.500 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.499+0000 7f6789fe3640 20 reqs_thread_entry: start 2024-09-12T00:51:52.500 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.499+0000 7f68d8f26800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:52.500 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.499+0000 7f68d8f26800 20 Filter name: none 2024-09-12T00:51:52.500 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.499+0000 7f66fb7fe640 20 reqs_thread_entry: start 2024-09-12T00:51:52.501 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.499+0000 7f68d8f26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:52.501 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.499+0000 7f68d8f26800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:51:52.501 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.499+0000 7f68d8f26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:52.501 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.500+0000 7f68d8f26800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:51:52.501 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.500+0000 7f68d8f26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:52.501 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.500+0000 7f68d8f26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:52.501 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.500+0000 7f68d8f26800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:51:52.501 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.500+0000 7f68d8f26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:52.501 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.500+0000 7f68d8f26800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:51:52.501 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.500+0000 7f68d8f26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:52.502 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.502+0000 7f678afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:52.503 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.504+0000 7f68d8f26800 20 remove_watcher() i=0 2024-09-12T00:51:52.503 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.504+0000 7f68d8f26800 2 removed watcher, disabling cache 2024-09-12T00:51:52.504 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.505+0000 7f68d8f26800 20 remove_watcher() i=1 2024-09-12T00:51:52.505 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.506+0000 7f68d8f26800 20 remove_watcher() i=2 2024-09-12T00:51:52.506 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.507+0000 7f68d8f26800 20 remove_watcher() i=3 2024-09-12T00:51:52.508 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.508+0000 7f68d8f26800 20 remove_watcher() i=4 2024-09-12T00:51:52.508 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.509+0000 7f68d8f26800 20 remove_watcher() i=5 2024-09-12T00:51:52.509 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.510+0000 7f68d8f26800 20 remove_watcher() i=6 2024-09-12T00:51:52.511 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:52.511+0000 7f68d8f26800 20 remove_watcher() i=7 2024-09-12T00:51:52.521 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:52.521 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:51:52.521 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: error-at-do-reshard id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:51:52.521 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:52.523 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:52.523 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:52.543 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:52.544 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:52.781 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:52.781 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:52.844 INFO:tasks.workunit.client.0.smithi073.stderr:TEST: reshard bucket with abort at do_reshard 2024-09-12T00:51:52.844 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:52.845 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:52.845 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:52.887 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:52.887 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:52.943 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:52.943 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:52.980 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:52.980 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:53.014 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:53.014 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:53.047 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:53.047 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:53.081 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:53.081 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:53.115 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:53.115 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:53.149 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:53.149 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:53.184 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:53.184 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:53.219 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:53.219 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:53.254 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:53.254 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:53.289 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:53.289 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:53.324 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:53.324 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:53.360 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:53.361 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:53.395 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:53.395 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:53.430 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:53.430 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:53.465 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:53.465 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:53.503 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:53.503 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:53.537 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:53.537 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:53.571 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:53.571 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:53.605 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:53.605 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:53.638 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T00:51:53.666 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:53.666 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:53.703 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.703+0000 7f4b7132c800 20 rados->read ofs=0 len=0 2024-09-12T00:51:53.705 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.705+0000 7f4b7132c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:53.705 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.705+0000 7f4b7132c800 20 realm 2024-09-12T00:51:53.705 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.705+0000 7f4b7132c800 20 rados->read ofs=0 len=0 2024-09-12T00:51:53.705 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.706+0000 7f4b7132c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:53.706 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.706+0000 7f4b7132c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:53.706 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.706+0000 7f4b7132c800 20 rados->read ofs=0 len=0 2024-09-12T00:51:53.706 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.706+0000 7f4b7132c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:53.706 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.706+0000 7f4b7132c800 20 rados->read ofs=0 len=0 2024-09-12T00:51:53.706 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.707+0000 7f4b7132c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:53.706 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.707+0000 7f4b7132c800 20 rados->read ofs=0 len=0 2024-09-12T00:51:53.707 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.707+0000 7f4b7132c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:53.707 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.707+0000 7f4b7132c800 20 searching for the correct realm 2024-09-12T00:51:53.709 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.709+0000 7f4b6d762640 0 -- 172.21.15.73:0/3925990345 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f4b54090040 msgr2=0x7f4b54066930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:53.915 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.915+0000 7f4b6d762640 0 -- 172.21.15.73:0/3925990345 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f4b54090040 msgr2=0x7f4b54066930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:53.919 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.919+0000 7f4b7132c800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:51:53.919 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.919+0000 7f4b7132c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:53.919 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.919+0000 7f4b7132c800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:51:53.919 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.919+0000 7f4b7132c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:53.919 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.919+0000 7f4b7132c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:53.919 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.919+0000 7f4b7132c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:53.919 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.919+0000 7f4b7132c800 20 rados->read ofs=0 len=0 2024-09-12T00:51:53.919 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.919+0000 7f4b7132c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:53.919 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.919+0000 7f4b7132c800 20 rados->read ofs=0 len=0 2024-09-12T00:51:53.921 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.919+0000 7f4b7132c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:53.921 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.919+0000 7f4b7132c800 20 rados->read ofs=0 len=0 2024-09-12T00:51:53.921 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.920+0000 7f4b7132c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:53.921 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.920+0000 7f4b7132c800 20 zone default found 2024-09-12T00:51:53.921 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.920+0000 7f4b7132c800 4 Realm: () 2024-09-12T00:51:53.921 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.920+0000 7f4b7132c800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:51:53.921 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.920+0000 7f4b7132c800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:51:53.921 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.920+0000 7f4b7132c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:53.921 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.920+0000 7f4b7132c800 20 zonegroup default 2024-09-12T00:51:53.921 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.920+0000 7f4b7132c800 20 rados->read ofs=0 len=0 2024-09-12T00:51:53.922 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.920+0000 7f4b7132c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:53.922 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.920+0000 7f4b7132c800 20 rados->read ofs=0 len=0 2024-09-12T00:51:53.922 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.920+0000 7f4b7132c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:53.922 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.920+0000 7f4b7132c800 20 rados->read ofs=0 len=0 2024-09-12T00:51:53.922 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.921+0000 7f4b7132c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:53.922 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.921+0000 7f4b7132c800 20 started sync module instance, tier type = 2024-09-12T00:51:53.922 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.921+0000 7f4b7132c800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:51:53.931 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.931+0000 7f4b7132c800 20 add_watcher() i=0 2024-09-12T00:51:53.931 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.931+0000 7f4b7132c800 20 add_watcher() i=1 2024-09-12T00:51:53.931 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.931+0000 7f4b7132c800 20 add_watcher() i=2 2024-09-12T00:51:53.931 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.931+0000 7f4b7132c800 20 add_watcher() i=3 2024-09-12T00:51:53.931 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.931+0000 7f4b7132c800 20 add_watcher() i=4 2024-09-12T00:51:53.931 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.931+0000 7f4b7132c800 20 add_watcher() i=5 2024-09-12T00:51:53.931 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.931+0000 7f4b7132c800 20 add_watcher() i=6 2024-09-12T00:51:53.932 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.932+0000 7f4b7132c800 20 add_watcher() i=7 2024-09-12T00:51:53.932 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.932+0000 7f4b7132c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:53.933 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.934+0000 7f4a22fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:53.934 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.934+0000 7f4b7132c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:53.934 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.934+0000 7f4b7132c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:53.934 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.934+0000 7f4b7132c800 5 note: GC not initialized 2024-09-12T00:51:53.934 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.934+0000 7f4a21fe3640 20 reqs_thread_entry: start 2024-09-12T00:51:53.934 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.934+0000 7f4b7132c800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:53.934 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.934+0000 7f4b7132c800 20 Filter name: none 2024-09-12T00:51:53.935 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.934+0000 7f49937fe640 20 reqs_thread_entry: start 2024-09-12T00:51:53.935 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.934+0000 7f4b7132c800 20 rados->read ofs=0 len=0 2024-09-12T00:51:53.936 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.935+0000 7f4b7132c800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:51:53.936 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.935+0000 7f4b7132c800 20 rados->read ofs=0 len=0 2024-09-12T00:51:53.936 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.936+0000 7f4b7132c800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:51:53.936 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.936+0000 7f4b7132c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:53.936 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.936+0000 7f4b7132c800 20 rados->read ofs=0 len=0 2024-09-12T00:51:53.936 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.936+0000 7f4b7132c800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:51:53.936 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.936+0000 7f4b7132c800 20 rados->read ofs=0 len=0 2024-09-12T00:51:53.936 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.936+0000 7f4b7132c800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:51:53.937 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.936+0000 7f4b7132c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:53.937 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.938+0000 7f4a22fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:53.939 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.940+0000 7f4b7132c800 20 remove_watcher() i=0 2024-09-12T00:51:53.939 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.940+0000 7f4b7132c800 2 removed watcher, disabling cache 2024-09-12T00:51:53.940 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.941+0000 7f4b7132c800 20 remove_watcher() i=1 2024-09-12T00:51:53.941 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.942+0000 7f4b7132c800 20 remove_watcher() i=2 2024-09-12T00:51:53.942 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.943+0000 7f4b7132c800 20 remove_watcher() i=3 2024-09-12T00:51:53.943 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.944+0000 7f4b7132c800 20 remove_watcher() i=4 2024-09-12T00:51:53.944 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.945+0000 7f4b7132c800 20 remove_watcher() i=5 2024-09-12T00:51:53.945 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.945+0000 7f4b7132c800 20 remove_watcher() i=6 2024-09-12T00:51:53.946 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:53.946+0000 7f4b7132c800 20 remove_watcher() i=7 2024-09-12T00:51:53.956 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:53.956 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:51:53.956 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: abort-at-do-reshard id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:51:53.957 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:53.958 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T00:51:53.992 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:53.992 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:54.029 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.029+0000 7ff965f26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.030 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.031+0000 7ff965f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:54.031 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.031+0000 7ff965f26800 20 realm 2024-09-12T00:51:54.031 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.031+0000 7ff965f26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.031 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.031+0000 7ff965f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:54.031 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.031+0000 7ff965f26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:54.031 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.031+0000 7ff965f26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.031 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.031+0000 7ff965f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:54.031 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.031+0000 7ff965f26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.032 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.032+0000 7ff965f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:54.032 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.032+0000 7ff965f26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.032 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.032+0000 7ff965f26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:54.032 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.032+0000 7ff965f26800 20 searching for the correct realm 2024-09-12T00:51:54.034 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.035+0000 7ff9623da640 0 -- 172.21.15.73:0/2312579535 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7ff958082f50 msgr2=0x7ff958060c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:51:54.239 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.239+0000 7ff9623da640 0 -- 172.21.15.73:0/2312579535 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7ff958082f50 msgr2=0x7ff958060c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:54.243 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.243+0000 7ff965f26800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:51:54.243 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.243+0000 7ff965f26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:54.243 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.243+0000 7ff965f26800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:51:54.243 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.243+0000 7ff965f26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:54.243 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.243+0000 7ff965f26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:54.243 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.243+0000 7ff965f26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:54.243 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.243+0000 7ff965f26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.243 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.243+0000 7ff965f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:54.243 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.243+0000 7ff965f26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.244 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.244+0000 7ff965f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:54.245 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.244+0000 7ff965f26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.245 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.244+0000 7ff965f26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:54.245 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.244+0000 7ff965f26800 20 zone default found 2024-09-12T00:51:54.245 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.244+0000 7ff965f26800 4 Realm: () 2024-09-12T00:51:54.245 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.244+0000 7ff965f26800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:51:54.245 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.244+0000 7ff965f26800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:51:54.245 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.244+0000 7ff965f26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:54.245 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.244+0000 7ff965f26800 20 zonegroup default 2024-09-12T00:51:54.245 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.244+0000 7ff965f26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.245 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.244+0000 7ff965f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:54.245 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.244+0000 7ff965f26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.245 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.244+0000 7ff965f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:54.245 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.244+0000 7ff965f26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.246 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.245+0000 7ff965f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:54.246 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.245+0000 7ff965f26800 20 started sync module instance, tier type = 2024-09-12T00:51:54.246 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.245+0000 7ff965f26800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:51:54.253 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.253+0000 7ff965f26800 20 add_watcher() i=0 2024-09-12T00:51:54.253 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.253+0000 7ff965f26800 20 add_watcher() i=1 2024-09-12T00:51:54.253 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.253+0000 7ff965f26800 20 add_watcher() i=2 2024-09-12T00:51:54.253 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.253+0000 7ff965f26800 20 add_watcher() i=3 2024-09-12T00:51:54.254 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.253+0000 7ff965f26800 20 add_watcher() i=4 2024-09-12T00:51:54.254 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.253+0000 7ff965f26800 20 add_watcher() i=5 2024-09-12T00:51:54.254 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.253+0000 7ff965f26800 20 add_watcher() i=6 2024-09-12T00:51:54.254 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.254+0000 7ff965f26800 20 add_watcher() i=7 2024-09-12T00:51:54.254 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.254+0000 7ff965f26800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:54.255 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.256+0000 7ff813fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:54.256 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.256+0000 7ff965f26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:54.257 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.256+0000 7ff965f26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:54.257 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.256+0000 7ff965f26800 5 note: GC not initialized 2024-09-12T00:51:54.257 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.257+0000 7ff812ffd640 20 reqs_thread_entry: start 2024-09-12T00:51:54.257 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.257+0000 7ff965f26800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:54.257 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.257+0000 7ff965f26800 20 Filter name: none 2024-09-12T00:51:54.257 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.257+0000 7ff810ff9640 20 reqs_thread_entry: start 2024-09-12T00:51:54.257 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.257+0000 7ff965f26800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:51:54.257 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.257+0000 7ff965f26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.258 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.257+0000 7ff965f26800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:51:54.258 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.257+0000 7ff965f26800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:51:54.258 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.257+0000 7ff965f26800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:51:54.258 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.257+0000 7ff965f26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34 : miss 2024-09-12T00:51:54.259 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.257+0000 7ff965f26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.259 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.258+0000 7ff965f26800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:51:54.259 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.258+0000 7ff965f26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34 info.flags=0x17 2024-09-12T00:51:54.259 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.258+0000 7ff965f26800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34 to cache LRU end 2024-09-12T00:51:54.259 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.258+0000 7ff965f26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:51:54.259 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.258+0000 7ff965f26800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:54.259 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.258+0000 7ff965f26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34 2024-09-12T00:51:54.261 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.261+0000 7ff965f26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34 info.flags=0x17 2024-09-12T00:51:54.261 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.261+0000 7ff965f26800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34 to cache LRU end 2024-09-12T00:51:54.261 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.261+0000 7ff965f26800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:54.261 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.261+0000 7ff965f26800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34, ofs0, ns] 2024-09-12T00:51:54.261 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.261+0000 7ff844ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497020 cookie 94833540308976 notifier 7551 bl.length()=911 2024-09-12T00:51:54.262 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.262+0000 7ff844ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34 info.flags=0x17 2024-09-12T00:51:54.262 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.262+0000 7ff844ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34 to cache LRU end 2024-09-12T00:51:54.262 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.262+0000 7ff844ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:54.263 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.263+0000 7ff965f26800 20 handle_bi_update(): bucket=:abort-at-do-reshard[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34]): orig_sources= new_sources= 2024-09-12T00:51:54.263 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.263+0000 7ff965f26800 20 handle_bi_update(): bucket=:abort-at-do-reshard[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34]): potential sources added=[] removed=[] 2024-09-12T00:51:54.263 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.263+0000 7ff965f26800 20 handle_bi_update(): bucket=:abort-at-do-reshard[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34]): orig_dests= new_dests= 2024-09-12T00:51:54.263 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.263+0000 7ff965f26800 20 handle_bi_update(): bucket=:abort-at-do-reshard[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34]): potential dests added=[] removed=[] 2024-09-12T00:51:54.265 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff965f26800 time 2024-09-12T00:51:54.267545+0000 2024-09-12T00:51:54.265 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:51:54.266 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:54.266 INFO:tasks.workunit.client.0.smithi073.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff96758c71a] 2024-09-12T00:51:54.266 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff96758c8d8] 2024-09-12T00:51:54.266 INFO:tasks.workunit.client.0.smithi073.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564026a00641] 2024-09-12T00:51:54.266 INFO:tasks.workunit.client.0.smithi073.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564026a1038a] 2024-09-12T00:51:54.266 INFO:tasks.workunit.client.0.smithi073.stderr: 5: main() 2024-09-12T00:51:54.266 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7ff966229590] 2024-09-12T00:51:54.266 INFO:tasks.workunit.client.0.smithi073.stderr: 7: __libc_start_main() 2024-09-12T00:51:54.266 INFO:tasks.workunit.client.0.smithi073.stderr: 8: _start() 2024-09-12T00:51:54.266 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.266+0000 7ff965f26800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff965f26800 time 2024-09-12T00:51:54.267545+0000 2024-09-12T00:51:54.267 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:51:54.267 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:54.267 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:54.267 INFO:tasks.workunit.client.0.smithi073.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff96758c71a] 2024-09-12T00:51:54.267 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff96758c8d8] 2024-09-12T00:51:54.267 INFO:tasks.workunit.client.0.smithi073.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564026a00641] 2024-09-12T00:51:54.267 INFO:tasks.workunit.client.0.smithi073.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564026a1038a] 2024-09-12T00:51:54.267 INFO:tasks.workunit.client.0.smithi073.stderr: 5: main() 2024-09-12T00:51:54.267 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7ff966229590] 2024-09-12T00:51:54.267 INFO:tasks.workunit.client.0.smithi073.stderr: 7: __libc_start_main() 2024-09-12T00:51:54.267 INFO:tasks.workunit.client.0.smithi073.stderr: 8: _start() 2024-09-12T00:51:54.267 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:54.268 INFO:tasks.workunit.client.0.smithi073.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:51:54.268 INFO:tasks.workunit.client.0.smithi073.stderr: in thread 7ff965f26800 thread_name:radosgw-admin 2024-09-12T00:51:54.287 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:54.287 INFO:tasks.workunit.client.0.smithi073.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff96623e6f0] 2024-09-12T00:51:54.287 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff96628b99c] 2024-09-12T00:51:54.288 INFO:tasks.workunit.client.0.smithi073.stderr: 3: raise() 2024-09-12T00:51:54.288 INFO:tasks.workunit.client.0.smithi073.stderr: 4: abort() 2024-09-12T00:51:54.288 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff96758c774] 2024-09-12T00:51:54.288 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff96758c8d8] 2024-09-12T00:51:54.288 INFO:tasks.workunit.client.0.smithi073.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564026a00641] 2024-09-12T00:51:54.288 INFO:tasks.workunit.client.0.smithi073.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564026a1038a] 2024-09-12T00:51:54.288 INFO:tasks.workunit.client.0.smithi073.stderr: 9: main() 2024-09-12T00:51:54.288 INFO:tasks.workunit.client.0.smithi073.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7ff966229590] 2024-09-12T00:51:54.288 INFO:tasks.workunit.client.0.smithi073.stderr: 11: __libc_start_main() 2024-09-12T00:51:54.288 INFO:tasks.workunit.client.0.smithi073.stderr: 12: _start() 2024-09-12T00:51:54.288 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.267+0000 7ff965f26800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:51:54.289 INFO:tasks.workunit.client.0.smithi073.stderr: in thread 7ff965f26800 thread_name:radosgw-admin 2024-09-12T00:51:54.289 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:54.289 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:54.289 INFO:tasks.workunit.client.0.smithi073.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff96623e6f0] 2024-09-12T00:51:54.289 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff96628b99c] 2024-09-12T00:51:54.289 INFO:tasks.workunit.client.0.smithi073.stderr: 3: raise() 2024-09-12T00:51:54.289 INFO:tasks.workunit.client.0.smithi073.stderr: 4: abort() 2024-09-12T00:51:54.289 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff96758c774] 2024-09-12T00:51:54.289 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff96758c8d8] 2024-09-12T00:51:54.289 INFO:tasks.workunit.client.0.smithi073.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564026a00641] 2024-09-12T00:51:54.289 INFO:tasks.workunit.client.0.smithi073.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564026a1038a] 2024-09-12T00:51:54.289 INFO:tasks.workunit.client.0.smithi073.stderr: 9: main() 2024-09-12T00:51:54.289 INFO:tasks.workunit.client.0.smithi073.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7ff966229590] 2024-09-12T00:51:54.290 INFO:tasks.workunit.client.0.smithi073.stderr: 11: __libc_start_main() 2024-09-12T00:51:54.290 INFO:tasks.workunit.client.0.smithi073.stderr: 12: _start() 2024-09-12T00:51:54.290 INFO:tasks.workunit.client.0.smithi073.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:51:54.290 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:54.290 INFO:tasks.workunit.client.0.smithi073.stderr:--- begin dump of recent events --- 2024-09-12T00:51:54.290 INFO:tasks.workunit.client.0.smithi073.stderr: -499> 2024-09-12T00:51:54.012+0000 7ff9613d8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.73:3301/0 2024-09-12T00:51:54.290 INFO:tasks.workunit.client.0.smithi073.stderr: -498> 2024-09-12T00:51:54.012+0000 7ff84fe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:54.290 INFO:tasks.workunit.client.0.smithi073.stderr: -497> 2024-09-12T00:51:54.012+0000 7ff84fe07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:51:54.290 INFO:tasks.workunit.client.0.smithi073.stderr: -496> 2024-09-12T00:51:54.012+0000 7ff84fe07640 10 monclient: dump: 2024-09-12T00:51:54.290 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:51:54.290 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:51:54.290 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:54.291 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:54.291 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:54.291 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:51:54.291 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:51:54.291 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:51:54.291 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:51:54.291 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:54.291 INFO:tasks.workunit.client.0.smithi073.stderr: -495> 2024-09-12T00:51:54.012+0000 7ff84fe07640 10 monclient: _finish_auth 0 2024-09-12T00:51:54.291 INFO:tasks.workunit.client.0.smithi073.stderr: -494> 2024-09-12T00:51:54.012+0000 7ff84fe07640 10 monclient: _check_auth_tickets 2024-09-12T00:51:54.291 INFO:tasks.workunit.client.0.smithi073.stderr: -493> 2024-09-12T00:51:54.012+0000 7ff84fe07640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:54.291 INFO:tasks.workunit.client.0.smithi073.stderr: -492> 2024-09-12T00:51:54.012+0000 7ff84fe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:54.291 INFO:tasks.workunit.client.0.smithi073.stderr: -491> 2024-09-12T00:51:54.012+0000 7ff84fe07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:51:54.292 INFO:tasks.workunit.client.0.smithi073.stderr: -490> 2024-09-12T00:51:54.012+0000 7ff84fe07640 10 monclient: dump: 2024-09-12T00:51:54.292 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:51:54.292 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:51:54.292 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:54.292 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:54.292 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:54.292 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:51:54.292 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:51:54.292 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:51:54.292 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:51:54.292 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:54.292 INFO:tasks.workunit.client.0.smithi073.stderr: -489> 2024-09-12T00:51:54.012+0000 7ff965f26800 5 monclient: authenticate success, global_id 7091 2024-09-12T00:51:54.292 INFO:tasks.workunit.client.0.smithi073.stderr: -488> 2024-09-12T00:51:54.012+0000 7ff965f26800 10 monclient: get_monmap_and_config success 2024-09-12T00:51:54.293 INFO:tasks.workunit.client.0.smithi073.stderr: -487> 2024-09-12T00:51:54.012+0000 7ff965f26800 4 set_mon_vals no callback set 2024-09-12T00:51:54.293 INFO:tasks.workunit.client.0.smithi073.stderr: -486> 2024-09-12T00:51:54.013+0000 7ff965f26800 10 monclient: shutdown 2024-09-12T00:51:54.293 INFO:tasks.workunit.client.0.smithi073.stderr: -485> 2024-09-12T00:51:54.013+0000 7ff965f26800 5 asok(0x56402749b630) unregister_commands rotate-key 2024-09-12T00:51:54.293 INFO:tasks.workunit.client.0.smithi073.stderr: -484> 2024-09-12T00:51:54.013+0000 7ff965f26800 10 monclient: build_initial_monmap 2024-09-12T00:51:54.293 INFO:tasks.workunit.client.0.smithi073.stderr: -483> 2024-09-12T00:51:54.013+0000 7ff965f26800 1 build_initial for_mkfs: 0 2024-09-12T00:51:54.293 INFO:tasks.workunit.client.0.smithi073.stderr: -482> 2024-09-12T00:51:54.013+0000 7ff965f26800 10 monclient: monmap: 2024-09-12T00:51:54.293 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:51:54.293 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:51:54.293 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:51:54.293 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:51:54.293 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:51:54.293 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:51:54.294 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:51:54.294 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:51:54.294 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:51:54.294 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:54.294 INFO:tasks.workunit.client.0.smithi073.stderr: -481> 2024-09-12T00:51:54.013+0000 7ff965f26800 5 AuthRegistry(0x5640276c34c0) adding auth protocol: cephx 2024-09-12T00:51:54.294 INFO:tasks.workunit.client.0.smithi073.stderr: -480> 2024-09-12T00:51:54.013+0000 7ff965f26800 5 AuthRegistry(0x5640276c34c0) adding auth protocol: cephx 2024-09-12T00:51:54.294 INFO:tasks.workunit.client.0.smithi073.stderr: -479> 2024-09-12T00:51:54.013+0000 7ff965f26800 5 AuthRegistry(0x5640276c34c0) adding auth protocol: cephx 2024-09-12T00:51:54.294 INFO:tasks.workunit.client.0.smithi073.stderr: -478> 2024-09-12T00:51:54.013+0000 7ff965f26800 5 AuthRegistry(0x5640276c34c0) adding con mode: secure 2024-09-12T00:51:54.294 INFO:tasks.workunit.client.0.smithi073.stderr: -477> 2024-09-12T00:51:54.013+0000 7ff965f26800 5 AuthRegistry(0x5640276c34c0) adding con mode: crc 2024-09-12T00:51:54.294 INFO:tasks.workunit.client.0.smithi073.stderr: -476> 2024-09-12T00:51:54.013+0000 7ff965f26800 5 AuthRegistry(0x5640276c34c0) adding con mode: secure 2024-09-12T00:51:54.294 INFO:tasks.workunit.client.0.smithi073.stderr: -475> 2024-09-12T00:51:54.013+0000 7ff965f26800 5 AuthRegistry(0x5640276c34c0) adding con mode: crc 2024-09-12T00:51:54.294 INFO:tasks.workunit.client.0.smithi073.stderr: -474> 2024-09-12T00:51:54.013+0000 7ff965f26800 5 AuthRegistry(0x5640276c34c0) adding con mode: secure 2024-09-12T00:51:54.294 INFO:tasks.workunit.client.0.smithi073.stderr: -473> 2024-09-12T00:51:54.013+0000 7ff965f26800 5 AuthRegistry(0x5640276c34c0) adding con mode: crc 2024-09-12T00:51:54.295 INFO:tasks.workunit.client.0.smithi073.stderr: -472> 2024-09-12T00:51:54.013+0000 7ff965f26800 5 AuthRegistry(0x5640276c34c0) adding con mode: crc 2024-09-12T00:51:54.295 INFO:tasks.workunit.client.0.smithi073.stderr: -471> 2024-09-12T00:51:54.013+0000 7ff965f26800 5 AuthRegistry(0x5640276c34c0) adding con mode: secure 2024-09-12T00:51:54.295 INFO:tasks.workunit.client.0.smithi073.stderr: -470> 2024-09-12T00:51:54.013+0000 7ff965f26800 5 AuthRegistry(0x5640276c34c0) adding con mode: crc 2024-09-12T00:51:54.295 INFO:tasks.workunit.client.0.smithi073.stderr: -469> 2024-09-12T00:51:54.013+0000 7ff965f26800 5 AuthRegistry(0x5640276c34c0) adding con mode: secure 2024-09-12T00:51:54.295 INFO:tasks.workunit.client.0.smithi073.stderr: -468> 2024-09-12T00:51:54.013+0000 7ff965f26800 5 AuthRegistry(0x5640276c34c0) adding con mode: crc 2024-09-12T00:51:54.295 INFO:tasks.workunit.client.0.smithi073.stderr: -467> 2024-09-12T00:51:54.013+0000 7ff965f26800 5 AuthRegistry(0x5640276c34c0) adding con mode: secure 2024-09-12T00:51:54.295 INFO:tasks.workunit.client.0.smithi073.stderr: -466> 2024-09-12T00:51:54.014+0000 7ff965f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:54.295 INFO:tasks.workunit.client.0.smithi073.stderr: -465> 2024-09-12T00:51:54.014+0000 7ff965f26800 1 librados: starting msgr at 2024-09-12T00:51:54.295 INFO:tasks.workunit.client.0.smithi073.stderr: -464> 2024-09-12T00:51:54.014+0000 7ff965f26800 1 librados: starting objecter 2024-09-12T00:51:54.295 INFO:tasks.workunit.client.0.smithi073.stderr: -463> 2024-09-12T00:51:54.014+0000 7ff965f26800 5 asok(0x56402749b630) register_command objecter_requests hook 0x5640276ec670 2024-09-12T00:51:54.295 INFO:tasks.workunit.client.0.smithi073.stderr: -462> 2024-09-12T00:51:54.014+0000 7ff965f26800 1 librados: setting wanted keys 2024-09-12T00:51:54.295 INFO:tasks.workunit.client.0.smithi073.stderr: -461> 2024-09-12T00:51:54.014+0000 7ff965f26800 1 librados: calling monclient init 2024-09-12T00:51:54.295 INFO:tasks.workunit.client.0.smithi073.stderr: -460> 2024-09-12T00:51:54.014+0000 7ff965f26800 10 monclient: init 2024-09-12T00:51:54.296 INFO:tasks.workunit.client.0.smithi073.stderr: -459> 2024-09-12T00:51:54.014+0000 7ff965f26800 5 AuthRegistry(0x5640276bd8b0) adding auth protocol: cephx 2024-09-12T00:51:54.296 INFO:tasks.workunit.client.0.smithi073.stderr: -458> 2024-09-12T00:51:54.014+0000 7ff965f26800 5 AuthRegistry(0x5640276bd8b0) adding auth protocol: cephx 2024-09-12T00:51:54.296 INFO:tasks.workunit.client.0.smithi073.stderr: -457> 2024-09-12T00:51:54.014+0000 7ff965f26800 5 AuthRegistry(0x5640276bd8b0) adding auth protocol: cephx 2024-09-12T00:51:54.296 INFO:tasks.workunit.client.0.smithi073.stderr: -456> 2024-09-12T00:51:54.014+0000 7ff965f26800 5 AuthRegistry(0x5640276bd8b0) adding con mode: secure 2024-09-12T00:51:54.296 INFO:tasks.workunit.client.0.smithi073.stderr: -455> 2024-09-12T00:51:54.014+0000 7ff965f26800 5 AuthRegistry(0x5640276bd8b0) adding con mode: crc 2024-09-12T00:51:54.296 INFO:tasks.workunit.client.0.smithi073.stderr: -454> 2024-09-12T00:51:54.014+0000 7ff965f26800 5 AuthRegistry(0x5640276bd8b0) adding con mode: secure 2024-09-12T00:51:54.296 INFO:tasks.workunit.client.0.smithi073.stderr: -453> 2024-09-12T00:51:54.014+0000 7ff965f26800 5 AuthRegistry(0x5640276bd8b0) adding con mode: crc 2024-09-12T00:51:54.296 INFO:tasks.workunit.client.0.smithi073.stderr: -452> 2024-09-12T00:51:54.014+0000 7ff965f26800 5 AuthRegistry(0x5640276bd8b0) adding con mode: secure 2024-09-12T00:51:54.296 INFO:tasks.workunit.client.0.smithi073.stderr: -451> 2024-09-12T00:51:54.014+0000 7ff965f26800 5 AuthRegistry(0x5640276bd8b0) adding con mode: crc 2024-09-12T00:51:54.296 INFO:tasks.workunit.client.0.smithi073.stderr: -450> 2024-09-12T00:51:54.014+0000 7ff965f26800 5 AuthRegistry(0x5640276bd8b0) adding con mode: crc 2024-09-12T00:51:54.296 INFO:tasks.workunit.client.0.smithi073.stderr: -449> 2024-09-12T00:51:54.014+0000 7ff965f26800 5 AuthRegistry(0x5640276bd8b0) adding con mode: secure 2024-09-12T00:51:54.296 INFO:tasks.workunit.client.0.smithi073.stderr: -448> 2024-09-12T00:51:54.014+0000 7ff965f26800 5 AuthRegistry(0x5640276bd8b0) adding con mode: crc 2024-09-12T00:51:54.296 INFO:tasks.workunit.client.0.smithi073.stderr: -447> 2024-09-12T00:51:54.014+0000 7ff965f26800 5 AuthRegistry(0x5640276bd8b0) adding con mode: secure 2024-09-12T00:51:54.297 INFO:tasks.workunit.client.0.smithi073.stderr: -446> 2024-09-12T00:51:54.014+0000 7ff965f26800 5 AuthRegistry(0x5640276bd8b0) adding con mode: crc 2024-09-12T00:51:54.297 INFO:tasks.workunit.client.0.smithi073.stderr: -445> 2024-09-12T00:51:54.014+0000 7ff965f26800 5 AuthRegistry(0x5640276bd8b0) adding con mode: secure 2024-09-12T00:51:54.297 INFO:tasks.workunit.client.0.smithi073.stderr: -444> 2024-09-12T00:51:54.014+0000 7ff965f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:54.297 INFO:tasks.workunit.client.0.smithi073.stderr: -443> 2024-09-12T00:51:54.014+0000 7ff965f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:54.297 INFO:tasks.workunit.client.0.smithi073.stderr: -442> 2024-09-12T00:51:54.014+0000 7ff965f26800 5 asok(0x56402749b630) register_command rotate-key hook 0x5640276bd9f8 2024-09-12T00:51:54.297 INFO:tasks.workunit.client.0.smithi073.stderr: -441> 2024-09-12T00:51:54.014+0000 7ff965f26800 10 monclient: _reopen_session rank -1 2024-09-12T00:51:54.297 INFO:tasks.workunit.client.0.smithi073.stderr: -440> 2024-09-12T00:51:54.014+0000 7ff965f26800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:51:54.297 INFO:tasks.workunit.client.0.smithi073.stderr: -439> 2024-09-12T00:51:54.014+0000 7ff965f26800 10 monclient(hunting): picked mon.noname-c con 0x5640275fd6c0 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:51:54.297 INFO:tasks.workunit.client.0.smithi073.stderr: -438> 2024-09-12T00:51:54.014+0000 7ff965f26800 10 monclient(hunting): picked mon.noname-a con 0x5640276038a0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:51:54.297 INFO:tasks.workunit.client.0.smithi073.stderr: -437> 2024-09-12T00:51:54.014+0000 7ff965f26800 10 monclient(hunting): picked mon.noname-b con 0x56402760d1b0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:51:54.297 INFO:tasks.workunit.client.0.smithi073.stderr: -436> 2024-09-12T00:51:54.014+0000 7ff965f26800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:54.297 INFO:tasks.workunit.client.0.smithi073.stderr: -435> 2024-09-12T00:51:54.014+0000 7ff965f26800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:54.297 INFO:tasks.workunit.client.0.smithi073.stderr: -434> 2024-09-12T00:51:54.014+0000 7ff965f26800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:54.298 INFO:tasks.workunit.client.0.smithi073.stderr: -433> 2024-09-12T00:51:54.014+0000 7ff965f26800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:54.298 INFO:tasks.workunit.client.0.smithi073.stderr: -432> 2024-09-12T00:51:54.014+0000 7ff965f26800 10 monclient(hunting): authenticate will time out at 2174.685722s 2024-09-12T00:51:54.298 INFO:tasks.workunit.client.0.smithi073.stderr: -431> 2024-09-12T00:51:54.014+0000 7ff9613d8640 10 monclient(hunting): get_auth_request con 0x5640276038a0 auth_method 0 2024-09-12T00:51:54.298 INFO:tasks.workunit.client.0.smithi073.stderr: -430> 2024-09-12T00:51:54.014+0000 7ff9613d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:54.298 INFO:tasks.workunit.client.0.smithi073.stderr: -429> 2024-09-12T00:51:54.014+0000 7ff9613d8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:54.298 INFO:tasks.workunit.client.0.smithi073.stderr: -428> 2024-09-12T00:51:54.014+0000 7ff9613d8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:54.298 INFO:tasks.workunit.client.0.smithi073.stderr: -427> 2024-09-12T00:51:54.014+0000 7ff961bd9640 10 monclient(hunting): get_auth_request con 0x5640275fd6c0 auth_method 0 2024-09-12T00:51:54.298 INFO:tasks.workunit.client.0.smithi073.stderr: -426> 2024-09-12T00:51:54.014+0000 7ff961bd9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:54.298 INFO:tasks.workunit.client.0.smithi073.stderr: -425> 2024-09-12T00:51:54.014+0000 7ff961bd9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:54.298 INFO:tasks.workunit.client.0.smithi073.stderr: -424> 2024-09-12T00:51:54.014+0000 7ff961bd9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:54.298 INFO:tasks.workunit.client.0.smithi073.stderr: -423> 2024-09-12T00:51:54.014+0000 7ff9613d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:54.298 INFO:tasks.workunit.client.0.smithi073.stderr: -422> 2024-09-12T00:51:54.014+0000 7ff9613d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:54.298 INFO:tasks.workunit.client.0.smithi073.stderr: -421> 2024-09-12T00:51:54.014+0000 7ff9613d8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:54.298 INFO:tasks.workunit.client.0.smithi073.stderr: -420> 2024-09-12T00:51:54.014+0000 7ff961bd9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:54.299 INFO:tasks.workunit.client.0.smithi073.stderr: -419> 2024-09-12T00:51:54.014+0000 7ff961bd9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:54.299 INFO:tasks.workunit.client.0.smithi073.stderr: -418> 2024-09-12T00:51:54.014+0000 7ff961bd9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:54.299 INFO:tasks.workunit.client.0.smithi073.stderr: -417> 2024-09-12T00:51:54.014+0000 7ff9623da640 10 monclient(hunting): get_auth_request con 0x56402760d1b0 auth_method 0 2024-09-12T00:51:54.299 INFO:tasks.workunit.client.0.smithi073.stderr: -416> 2024-09-12T00:51:54.014+0000 7ff9623da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:54.299 INFO:tasks.workunit.client.0.smithi073.stderr: -415> 2024-09-12T00:51:54.014+0000 7ff9623da640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:54.299 INFO:tasks.workunit.client.0.smithi073.stderr: -414> 2024-09-12T00:51:54.014+0000 7ff9623da640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:54.299 INFO:tasks.workunit.client.0.smithi073.stderr: -413> 2024-09-12T00:51:54.015+0000 7ff9613d8640 10 monclient(hunting): handle_auth_done global_id 7542 payload 824 2024-09-12T00:51:54.299 INFO:tasks.workunit.client.0.smithi073.stderr: -412> 2024-09-12T00:51:54.015+0000 7ff9613d8640 10 monclient: _finish_hunting 0 2024-09-12T00:51:54.299 INFO:tasks.workunit.client.0.smithi073.stderr: -411> 2024-09-12T00:51:54.015+0000 7ff9613d8640 1 monclient: found mon.noname-a 2024-09-12T00:51:54.299 INFO:tasks.workunit.client.0.smithi073.stderr: -410> 2024-09-12T00:51:54.015+0000 7ff9613d8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:51:54.299 INFO:tasks.workunit.client.0.smithi073.stderr: -409> 2024-09-12T00:51:54.015+0000 7ff84e604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:54.299 INFO:tasks.workunit.client.0.smithi073.stderr: -408> 2024-09-12T00:51:54.015+0000 7ff84e604640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:51:54.299 INFO:tasks.workunit.client.0.smithi073.stderr: -407> 2024-09-12T00:51:54.015+0000 7ff84e604640 10 monclient: dump: 2024-09-12T00:51:54.299 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:51:54.299 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:51:54.300 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:54.300 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:54.300 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:54.300 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:51:54.300 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:51:54.300 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:51:54.300 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:51:54.300 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:54.300 INFO:tasks.workunit.client.0.smithi073.stderr: -406> 2024-09-12T00:51:54.015+0000 7ff84e604640 10 monclient: _finish_auth 0 2024-09-12T00:51:54.300 INFO:tasks.workunit.client.0.smithi073.stderr: -405> 2024-09-12T00:51:54.015+0000 7ff84e604640 10 monclient: _check_auth_tickets 2024-09-12T00:51:54.300 INFO:tasks.workunit.client.0.smithi073.stderr: -404> 2024-09-12T00:51:54.015+0000 7ff84e604640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:54.300 INFO:tasks.workunit.client.0.smithi073.stderr: -403> 2024-09-12T00:51:54.015+0000 7ff84e604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:54.300 INFO:tasks.workunit.client.0.smithi073.stderr: -402> 2024-09-12T00:51:54.015+0000 7ff84e604640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:51:54.300 INFO:tasks.workunit.client.0.smithi073.stderr: -401> 2024-09-12T00:51:54.015+0000 7ff84e604640 10 monclient: dump: 2024-09-12T00:51:54.301 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:51:54.301 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:51:54.301 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:54.301 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:54.301 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:54.301 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:51:54.301 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:51:54.301 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:51:54.301 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:51:54.301 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:54.301 INFO:tasks.workunit.client.0.smithi073.stderr: -400> 2024-09-12T00:51:54.015+0000 7ff965f26800 5 monclient: authenticate success, global_id 7542 2024-09-12T00:51:54.301 INFO:tasks.workunit.client.0.smithi073.stderr: -399> 2024-09-12T00:51:54.015+0000 7ff965f26800 10 monclient: _renew_subs 2024-09-12T00:51:54.301 INFO:tasks.workunit.client.0.smithi073.stderr: -398> 2024-09-12T00:51:54.015+0000 7ff84fe07640 4 set_mon_vals no callback set 2024-09-12T00:51:54.302 INFO:tasks.workunit.client.0.smithi073.stderr: -397> 2024-09-12T00:51:54.015+0000 7ff965f26800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:51:54.302 INFO:tasks.workunit.client.0.smithi073.stderr: -396> 2024-09-12T00:51:54.015+0000 7ff965f26800 10 monclient: _renew_subs 2024-09-12T00:51:54.302 INFO:tasks.workunit.client.0.smithi073.stderr: -395> 2024-09-12T00:51:54.015+0000 7ff965f26800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:51:54.302 INFO:tasks.workunit.client.0.smithi073.stderr: -394> 2024-09-12T00:51:54.015+0000 7ff965f26800 1 librados: init done 2024-09-12T00:51:54.302 INFO:tasks.workunit.client.0.smithi073.stderr: -393> 2024-09-12T00:51:54.017+0000 7ff84e604640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:51:54.302 INFO:tasks.workunit.client.0.smithi073.stderr: -392> 2024-09-12T00:51:54.017+0000 7ff84e604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:51:54.302 INFO:tasks.workunit.client.0.smithi073.stderr: -391> 2024-09-12T00:51:54.017+0000 7ff84e604640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:51:54.302 INFO:tasks.workunit.client.0.smithi073.stderr: -390> 2024-09-12T00:51:54.017+0000 7ff961bd9640 10 monclient: get_auth_request con 0x7ff8480764a0 auth_method 0 2024-09-12T00:51:54.302 INFO:tasks.workunit.client.0.smithi073.stderr: -389> 2024-09-12T00:51:54.017+0000 7ff9623da640 10 monclient: get_auth_request con 0x5640276f1a80 auth_method 0 2024-09-12T00:51:54.302 INFO:tasks.workunit.client.0.smithi073.stderr: -388> 2024-09-12T00:51:54.018+0000 7ff961bd9640 10 monclient: get_auth_request con 0x564027708ee0 auth_method 0 2024-09-12T00:51:54.302 INFO:tasks.workunit.client.0.smithi073.stderr: -387> 2024-09-12T00:51:54.019+0000 7ff9613d8640 10 monclient: get_auth_request con 0x56402770d240 auth_method 0 2024-09-12T00:51:54.302 INFO:tasks.workunit.client.0.smithi073.stderr: -386> 2024-09-12T00:51:54.020+0000 7ff965f26800 10 monclient: build_initial_monmap 2024-09-12T00:51:54.302 INFO:tasks.workunit.client.0.smithi073.stderr: -385> 2024-09-12T00:51:54.020+0000 7ff965f26800 1 build_initial for_mkfs: 0 2024-09-12T00:51:54.303 INFO:tasks.workunit.client.0.smithi073.stderr: -384> 2024-09-12T00:51:54.020+0000 7ff965f26800 10 monclient: monmap: 2024-09-12T00:51:54.303 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:51:54.303 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:51:54.303 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:51:54.303 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:51:54.303 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:51:54.303 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:51:54.303 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:51:54.303 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:51:54.303 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:51:54.303 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:54.303 INFO:tasks.workunit.client.0.smithi073.stderr: -383> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277121b0) adding auth protocol: cephx 2024-09-12T00:51:54.304 INFO:tasks.workunit.client.0.smithi073.stderr: -382> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277121b0) adding auth protocol: cephx 2024-09-12T00:51:54.304 INFO:tasks.workunit.client.0.smithi073.stderr: -381> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277121b0) adding auth protocol: cephx 2024-09-12T00:51:54.304 INFO:tasks.workunit.client.0.smithi073.stderr: -380> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277121b0) adding con mode: secure 2024-09-12T00:51:54.304 INFO:tasks.workunit.client.0.smithi073.stderr: -379> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277121b0) adding con mode: crc 2024-09-12T00:51:54.304 INFO:tasks.workunit.client.0.smithi073.stderr: -378> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277121b0) adding con mode: secure 2024-09-12T00:51:54.304 INFO:tasks.workunit.client.0.smithi073.stderr: -377> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277121b0) adding con mode: crc 2024-09-12T00:51:54.304 INFO:tasks.workunit.client.0.smithi073.stderr: -376> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277121b0) adding con mode: secure 2024-09-12T00:51:54.304 INFO:tasks.workunit.client.0.smithi073.stderr: -375> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277121b0) adding con mode: crc 2024-09-12T00:51:54.304 INFO:tasks.workunit.client.0.smithi073.stderr: -374> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277121b0) adding con mode: crc 2024-09-12T00:51:54.304 INFO:tasks.workunit.client.0.smithi073.stderr: -373> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277121b0) adding con mode: secure 2024-09-12T00:51:54.304 INFO:tasks.workunit.client.0.smithi073.stderr: -372> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277121b0) adding con mode: crc 2024-09-12T00:51:54.304 INFO:tasks.workunit.client.0.smithi073.stderr: -371> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277121b0) adding con mode: secure 2024-09-12T00:51:54.305 INFO:tasks.workunit.client.0.smithi073.stderr: -370> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277121b0) adding con mode: crc 2024-09-12T00:51:54.305 INFO:tasks.workunit.client.0.smithi073.stderr: -369> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277121b0) adding con mode: secure 2024-09-12T00:51:54.305 INFO:tasks.workunit.client.0.smithi073.stderr: -368> 2024-09-12T00:51:54.020+0000 7ff965f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:54.305 INFO:tasks.workunit.client.0.smithi073.stderr: -367> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 asok(0x56402749b630) register_command objecter_requests cmddesc objecter_requests hook 0x564027715640 EEXIST 2024-09-12T00:51:54.305 INFO:tasks.workunit.client.0.smithi073.stderr: -366> 2024-09-12T00:51:54.020+0000 7ff965f26800 10 monclient: init 2024-09-12T00:51:54.305 INFO:tasks.workunit.client.0.smithi073.stderr: -365> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277107d8) adding auth protocol: cephx 2024-09-12T00:51:54.305 INFO:tasks.workunit.client.0.smithi073.stderr: -364> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277107d8) adding auth protocol: cephx 2024-09-12T00:51:54.305 INFO:tasks.workunit.client.0.smithi073.stderr: -363> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277107d8) adding auth protocol: cephx 2024-09-12T00:51:54.305 INFO:tasks.workunit.client.0.smithi073.stderr: -362> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277107d8) adding con mode: secure 2024-09-12T00:51:54.305 INFO:tasks.workunit.client.0.smithi073.stderr: -361> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277107d8) adding con mode: crc 2024-09-12T00:51:54.305 INFO:tasks.workunit.client.0.smithi073.stderr: -360> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277107d8) adding con mode: secure 2024-09-12T00:51:54.305 INFO:tasks.workunit.client.0.smithi073.stderr: -359> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277107d8) adding con mode: crc 2024-09-12T00:51:54.305 INFO:tasks.workunit.client.0.smithi073.stderr: -358> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277107d8) adding con mode: secure 2024-09-12T00:51:54.305 INFO:tasks.workunit.client.0.smithi073.stderr: -357> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277107d8) adding con mode: crc 2024-09-12T00:51:54.306 INFO:tasks.workunit.client.0.smithi073.stderr: -356> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277107d8) adding con mode: crc 2024-09-12T00:51:54.306 INFO:tasks.workunit.client.0.smithi073.stderr: -355> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277107d8) adding con mode: secure 2024-09-12T00:51:54.306 INFO:tasks.workunit.client.0.smithi073.stderr: -354> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277107d8) adding con mode: crc 2024-09-12T00:51:54.306 INFO:tasks.workunit.client.0.smithi073.stderr: -353> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277107d8) adding con mode: secure 2024-09-12T00:51:54.306 INFO:tasks.workunit.client.0.smithi073.stderr: -352> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277107d8) adding con mode: crc 2024-09-12T00:51:54.306 INFO:tasks.workunit.client.0.smithi073.stderr: -351> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277107d8) adding con mode: secure 2024-09-12T00:51:54.306 INFO:tasks.workunit.client.0.smithi073.stderr: -350> 2024-09-12T00:51:54.021+0000 7ff965f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:54.306 INFO:tasks.workunit.client.0.smithi073.stderr: -349> 2024-09-12T00:51:54.021+0000 7ff965f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:54.306 INFO:tasks.workunit.client.0.smithi073.stderr: -348> 2024-09-12T00:51:54.021+0000 7ff965f26800 5 asok(0x56402749b630) register_command rotate-key cmddesc rotate-key hook 0x564027710920 EEXIST 2024-09-12T00:51:54.306 INFO:tasks.workunit.client.0.smithi073.stderr: -347> 2024-09-12T00:51:54.021+0000 7ff965f26800 10 monclient: _reopen_session rank -1 2024-09-12T00:51:54.306 INFO:tasks.workunit.client.0.smithi073.stderr: -346> 2024-09-12T00:51:54.021+0000 7ff965f26800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:51:54.306 INFO:tasks.workunit.client.0.smithi073.stderr: -345> 2024-09-12T00:51:54.021+0000 7ff965f26800 10 monclient(hunting): picked mon.noname-b con 0x564027739960 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:51:54.306 INFO:tasks.workunit.client.0.smithi073.stderr: -344> 2024-09-12T00:51:54.021+0000 7ff965f26800 10 monclient(hunting): picked mon.noname-a con 0x564027739d40 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:51:54.306 INFO:tasks.workunit.client.0.smithi073.stderr: -343> 2024-09-12T00:51:54.021+0000 7ff965f26800 10 monclient(hunting): picked mon.noname-c con 0x564027738670 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:51:54.306 INFO:tasks.workunit.client.0.smithi073.stderr: -342> 2024-09-12T00:51:54.021+0000 7ff965f26800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:54.307 INFO:tasks.workunit.client.0.smithi073.stderr: -341> 2024-09-12T00:51:54.021+0000 7ff965f26800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:54.307 INFO:tasks.workunit.client.0.smithi073.stderr: -340> 2024-09-12T00:51:54.021+0000 7ff965f26800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:54.307 INFO:tasks.workunit.client.0.smithi073.stderr: -339> 2024-09-12T00:51:54.021+0000 7ff965f26800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:54.307 INFO:tasks.workunit.client.0.smithi073.stderr: -338> 2024-09-12T00:51:54.021+0000 7ff965f26800 10 monclient(hunting): authenticate will time out at 2174.692479s 2024-09-12T00:51:54.307 INFO:tasks.workunit.client.0.smithi073.stderr: -337> 2024-09-12T00:51:54.021+0000 7ff9613d8640 10 monclient(hunting): get_auth_request con 0x564027739d40 auth_method 0 2024-09-12T00:51:54.307 INFO:tasks.workunit.client.0.smithi073.stderr: -336> 2024-09-12T00:51:54.021+0000 7ff9613d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:54.307 INFO:tasks.workunit.client.0.smithi073.stderr: -335> 2024-09-12T00:51:54.021+0000 7ff9613d8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:54.307 INFO:tasks.workunit.client.0.smithi073.stderr: -334> 2024-09-12T00:51:54.021+0000 7ff9613d8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:54.307 INFO:tasks.workunit.client.0.smithi073.stderr: -333> 2024-09-12T00:51:54.021+0000 7ff9623da640 10 monclient(hunting): get_auth_request con 0x564027738670 auth_method 0 2024-09-12T00:51:54.307 INFO:tasks.workunit.client.0.smithi073.stderr: -332> 2024-09-12T00:51:54.021+0000 7ff9623da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:54.307 INFO:tasks.workunit.client.0.smithi073.stderr: -331> 2024-09-12T00:51:54.021+0000 7ff9623da640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:54.307 INFO:tasks.workunit.client.0.smithi073.stderr: -330> 2024-09-12T00:51:54.021+0000 7ff9623da640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:54.307 INFO:tasks.workunit.client.0.smithi073.stderr: -329> 2024-09-12T00:51:54.021+0000 7ff9613d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:54.307 INFO:tasks.workunit.client.0.smithi073.stderr: -328> 2024-09-12T00:51:54.021+0000 7ff9613d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:54.307 INFO:tasks.workunit.client.0.smithi073.stderr: -327> 2024-09-12T00:51:54.021+0000 7ff9613d8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:54.308 INFO:tasks.workunit.client.0.smithi073.stderr: -326> 2024-09-12T00:51:54.021+0000 7ff9623da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:54.308 INFO:tasks.workunit.client.0.smithi073.stderr: -325> 2024-09-12T00:51:54.021+0000 7ff9623da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:54.308 INFO:tasks.workunit.client.0.smithi073.stderr: -324> 2024-09-12T00:51:54.021+0000 7ff9623da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:54.308 INFO:tasks.workunit.client.0.smithi073.stderr: -323> 2024-09-12T00:51:54.021+0000 7ff961bd9640 10 monclient(hunting): get_auth_request con 0x564027739960 auth_method 0 2024-09-12T00:51:54.308 INFO:tasks.workunit.client.0.smithi073.stderr: -322> 2024-09-12T00:51:54.021+0000 7ff961bd9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:54.308 INFO:tasks.workunit.client.0.smithi073.stderr: -321> 2024-09-12T00:51:54.021+0000 7ff961bd9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:54.308 INFO:tasks.workunit.client.0.smithi073.stderr: -320> 2024-09-12T00:51:54.021+0000 7ff961bd9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:54.308 INFO:tasks.workunit.client.0.smithi073.stderr: -319> 2024-09-12T00:51:54.021+0000 7ff9623da640 10 monclient(hunting): handle_auth_done global_id 7097 payload 824 2024-09-12T00:51:54.308 INFO:tasks.workunit.client.0.smithi073.stderr: -318> 2024-09-12T00:51:54.021+0000 7ff9623da640 10 monclient: _finish_hunting 0 2024-09-12T00:51:54.308 INFO:tasks.workunit.client.0.smithi073.stderr: -317> 2024-09-12T00:51:54.021+0000 7ff9623da640 1 monclient: found mon.noname-c 2024-09-12T00:51:54.308 INFO:tasks.workunit.client.0.smithi073.stderr: -316> 2024-09-12T00:51:54.021+0000 7ff9623da640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.73:3301/0 2024-09-12T00:51:54.308 INFO:tasks.workunit.client.0.smithi073.stderr: -315> 2024-09-12T00:51:54.022+0000 7ff8477fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:54.309 INFO:tasks.workunit.client.0.smithi073.stderr: -314> 2024-09-12T00:51:54.022+0000 7ff8477fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:51:54.309 INFO:tasks.workunit.client.0.smithi073.stderr: -313> 2024-09-12T00:51:54.022+0000 7ff8477fe640 10 monclient: dump: 2024-09-12T00:51:54.309 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:51:54.309 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:51:54.309 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:54.309 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:54.309 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:54.309 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:51:54.309 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:51:54.309 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:51:54.309 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:51:54.309 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:54.309 INFO:tasks.workunit.client.0.smithi073.stderr: -312> 2024-09-12T00:51:54.022+0000 7ff8477fe640 10 monclient: _finish_auth 0 2024-09-12T00:51:54.310 INFO:tasks.workunit.client.0.smithi073.stderr: -311> 2024-09-12T00:51:54.022+0000 7ff8477fe640 10 monclient: _check_auth_tickets 2024-09-12T00:51:54.310 INFO:tasks.workunit.client.0.smithi073.stderr: -310> 2024-09-12T00:51:54.022+0000 7ff8477fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:54.310 INFO:tasks.workunit.client.0.smithi073.stderr: -309> 2024-09-12T00:51:54.022+0000 7ff8477fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:54.310 INFO:tasks.workunit.client.0.smithi073.stderr: -308> 2024-09-12T00:51:54.022+0000 7ff8477fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:51:54.310 INFO:tasks.workunit.client.0.smithi073.stderr: -307> 2024-09-12T00:51:54.022+0000 7ff8477fe640 10 monclient: dump: 2024-09-12T00:51:54.310 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:51:54.310 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:51:54.310 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:54.310 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:54.310 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:54.310 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:51:54.310 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:51:54.310 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:51:54.311 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:51:54.311 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:54.311 INFO:tasks.workunit.client.0.smithi073.stderr: -306> 2024-09-12T00:51:54.022+0000 7ff965f26800 5 monclient: authenticate success, global_id 7097 2024-09-12T00:51:54.311 INFO:tasks.workunit.client.0.smithi073.stderr: -305> 2024-09-12T00:51:54.022+0000 7ff965f26800 10 monclient: _renew_subs 2024-09-12T00:51:54.311 INFO:tasks.workunit.client.0.smithi073.stderr: -304> 2024-09-12T00:51:54.022+0000 7ff962bdb640 4 set_mon_vals no callback set 2024-09-12T00:51:54.311 INFO:tasks.workunit.client.0.smithi073.stderr: -303> 2024-09-12T00:51:54.022+0000 7ff965f26800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:51:54.311 INFO:tasks.workunit.client.0.smithi073.stderr: -302> 2024-09-12T00:51:54.022+0000 7ff965f26800 10 monclient: _renew_subs 2024-09-12T00:51:54.311 INFO:tasks.workunit.client.0.smithi073.stderr: -301> 2024-09-12T00:51:54.022+0000 7ff965f26800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:51:54.311 INFO:tasks.workunit.client.0.smithi073.stderr: -300> 2024-09-12T00:51:54.023+0000 7ff8477fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:51:54.311 INFO:tasks.workunit.client.0.smithi073.stderr: -299> 2024-09-12T00:51:54.023+0000 7ff8477fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:51:54.311 INFO:tasks.workunit.client.0.smithi073.stderr: -298> 2024-09-12T00:51:54.023+0000 7ff8477fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:51:54.311 INFO:tasks.workunit.client.0.smithi073.stderr: -297> 2024-09-12T00:51:54.024+0000 7ff961bd9640 10 monclient: get_auth_request con 0x7ff83c076380 auth_method 0 2024-09-12T00:51:54.311 INFO:tasks.workunit.client.0.smithi073.stderr: -296> 2024-09-12T00:51:54.024+0000 7ff965f26800 10 monclient: get_monmap_and_config 2024-09-12T00:51:54.312 INFO:tasks.workunit.client.0.smithi073.stderr: -295> 2024-09-12T00:51:54.024+0000 7ff965f26800 10 monclient: build_initial_monmap 2024-09-12T00:51:54.312 INFO:tasks.workunit.client.0.smithi073.stderr: -294> 2024-09-12T00:51:54.024+0000 7ff965f26800 1 build_initial for_mkfs: 0 2024-09-12T00:51:54.312 INFO:tasks.workunit.client.0.smithi073.stderr: -293> 2024-09-12T00:51:54.024+0000 7ff965f26800 10 monclient: monmap: 2024-09-12T00:51:54.312 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:51:54.312 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:51:54.312 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:51:54.312 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:51:54.312 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:51:54.312 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:51:54.312 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:51:54.312 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:51:54.312 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:51:54.312 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:54.313 INFO:tasks.workunit.client.0.smithi073.stderr: -292> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x564027759810) adding auth protocol: cephx 2024-09-12T00:51:54.313 INFO:tasks.workunit.client.0.smithi073.stderr: -291> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x564027759810) adding auth protocol: cephx 2024-09-12T00:51:54.313 INFO:tasks.workunit.client.0.smithi073.stderr: -290> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x564027759810) adding auth protocol: cephx 2024-09-12T00:51:54.313 INFO:tasks.workunit.client.0.smithi073.stderr: -289> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x564027759810) adding con mode: secure 2024-09-12T00:51:54.313 INFO:tasks.workunit.client.0.smithi073.stderr: -288> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x564027759810) adding con mode: crc 2024-09-12T00:51:54.313 INFO:tasks.workunit.client.0.smithi073.stderr: -287> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x564027759810) adding con mode: secure 2024-09-12T00:51:54.313 INFO:tasks.workunit.client.0.smithi073.stderr: -286> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x564027759810) adding con mode: crc 2024-09-12T00:51:54.313 INFO:tasks.workunit.client.0.smithi073.stderr: -285> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x564027759810) adding con mode: secure 2024-09-12T00:51:54.313 INFO:tasks.workunit.client.0.smithi073.stderr: -284> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x564027759810) adding con mode: crc 2024-09-12T00:51:54.313 INFO:tasks.workunit.client.0.smithi073.stderr: -283> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x564027759810) adding con mode: crc 2024-09-12T00:51:54.313 INFO:tasks.workunit.client.0.smithi073.stderr: -282> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x564027759810) adding con mode: secure 2024-09-12T00:51:54.313 INFO:tasks.workunit.client.0.smithi073.stderr: -281> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x564027759810) adding con mode: crc 2024-09-12T00:51:54.313 INFO:tasks.workunit.client.0.smithi073.stderr: -280> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x564027759810) adding con mode: secure 2024-09-12T00:51:54.314 INFO:tasks.workunit.client.0.smithi073.stderr: -279> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x564027759810) adding con mode: crc 2024-09-12T00:51:54.314 INFO:tasks.workunit.client.0.smithi073.stderr: -278> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x564027759810) adding con mode: secure 2024-09-12T00:51:54.314 INFO:tasks.workunit.client.0.smithi073.stderr: -277> 2024-09-12T00:51:54.024+0000 7ff965f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:54.314 INFO:tasks.workunit.client.0.smithi073.stderr: -276> 2024-09-12T00:51:54.024+0000 7ff965f26800 10 monclient: init 2024-09-12T00:51:54.314 INFO:tasks.workunit.client.0.smithi073.stderr: -275> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f240) adding auth protocol: cephx 2024-09-12T00:51:54.314 INFO:tasks.workunit.client.0.smithi073.stderr: -274> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f240) adding auth protocol: cephx 2024-09-12T00:51:54.314 INFO:tasks.workunit.client.0.smithi073.stderr: -273> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f240) adding auth protocol: cephx 2024-09-12T00:51:54.314 INFO:tasks.workunit.client.0.smithi073.stderr: -272> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f240) adding con mode: secure 2024-09-12T00:51:54.314 INFO:tasks.workunit.client.0.smithi073.stderr: -271> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f240) adding con mode: crc 2024-09-12T00:51:54.314 INFO:tasks.workunit.client.0.smithi073.stderr: -270> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f240) adding con mode: secure 2024-09-12T00:51:54.314 INFO:tasks.workunit.client.0.smithi073.stderr: -269> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f240) adding con mode: crc 2024-09-12T00:51:54.314 INFO:tasks.workunit.client.0.smithi073.stderr: -268> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f240) adding con mode: secure 2024-09-12T00:51:54.314 INFO:tasks.workunit.client.0.smithi073.stderr: -267> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f240) adding con mode: crc 2024-09-12T00:51:54.315 INFO:tasks.workunit.client.0.smithi073.stderr: -266> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f240) adding con mode: crc 2024-09-12T00:51:54.315 INFO:tasks.workunit.client.0.smithi073.stderr: -265> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f240) adding con mode: secure 2024-09-12T00:51:54.315 INFO:tasks.workunit.client.0.smithi073.stderr: -264> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f240) adding con mode: crc 2024-09-12T00:51:54.315 INFO:tasks.workunit.client.0.smithi073.stderr: -263> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f240) adding con mode: secure 2024-09-12T00:51:54.315 INFO:tasks.workunit.client.0.smithi073.stderr: -262> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f240) adding con mode: crc 2024-09-12T00:51:54.315 INFO:tasks.workunit.client.0.smithi073.stderr: -261> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f240) adding con mode: secure 2024-09-12T00:51:54.315 INFO:tasks.workunit.client.0.smithi073.stderr: -260> 2024-09-12T00:51:54.024+0000 7ff965f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:54.315 INFO:tasks.workunit.client.0.smithi073.stderr: -259> 2024-09-12T00:51:54.025+0000 7ff965f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:54.315 INFO:tasks.workunit.client.0.smithi073.stderr: -258> 2024-09-12T00:51:54.025+0000 7ff965f26800 5 asok(0x56402749b630) register_command rotate-key cmddesc rotate-key hook 0x7ffe3617f388 EEXIST 2024-09-12T00:51:54.315 INFO:tasks.workunit.client.0.smithi073.stderr: -257> 2024-09-12T00:51:54.025+0000 7ff965f26800 10 monclient: _reopen_session rank -1 2024-09-12T00:51:54.315 INFO:tasks.workunit.client.0.smithi073.stderr: -256> 2024-09-12T00:51:54.025+0000 7ff965f26800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:51:54.315 INFO:tasks.workunit.client.0.smithi073.stderr: -255> 2024-09-12T00:51:54.025+0000 7ff965f26800 10 monclient(hunting): picked mon.noname-a con 0x56402778de10 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:51:54.315 INFO:tasks.workunit.client.0.smithi073.stderr: -254> 2024-09-12T00:51:54.025+0000 7ff965f26800 10 monclient(hunting): picked mon.noname-b con 0x56402777e760 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:51:54.316 INFO:tasks.workunit.client.0.smithi073.stderr: -253> 2024-09-12T00:51:54.025+0000 7ff965f26800 10 monclient(hunting): picked mon.noname-c con 0x564027789240 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:51:54.316 INFO:tasks.workunit.client.0.smithi073.stderr: -252> 2024-09-12T00:51:54.025+0000 7ff965f26800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:54.316 INFO:tasks.workunit.client.0.smithi073.stderr: -251> 2024-09-12T00:51:54.025+0000 7ff965f26800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:54.316 INFO:tasks.workunit.client.0.smithi073.stderr: -250> 2024-09-12T00:51:54.025+0000 7ff965f26800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:54.316 INFO:tasks.workunit.client.0.smithi073.stderr: -249> 2024-09-12T00:51:54.025+0000 7ff965f26800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:54.316 INFO:tasks.workunit.client.0.smithi073.stderr: -248> 2024-09-12T00:51:54.025+0000 7ff965f26800 10 monclient(hunting): authenticate will time out at 2174.696280s 2024-09-12T00:51:54.316 INFO:tasks.workunit.client.0.smithi073.stderr: -247> 2024-09-12T00:51:54.025+0000 7ff961bd9640 10 monclient(hunting): get_auth_request con 0x56402778de10 auth_method 0 2024-09-12T00:51:54.316 INFO:tasks.workunit.client.0.smithi073.stderr: -246> 2024-09-12T00:51:54.025+0000 7ff961bd9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:54.316 INFO:tasks.workunit.client.0.smithi073.stderr: -245> 2024-09-12T00:51:54.025+0000 7ff961bd9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:54.316 INFO:tasks.workunit.client.0.smithi073.stderr: -244> 2024-09-12T00:51:54.025+0000 7ff961bd9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:54.316 INFO:tasks.workunit.client.0.smithi073.stderr: -243> 2024-09-12T00:51:54.025+0000 7ff9623da640 10 monclient(hunting): get_auth_request con 0x564027789240 auth_method 0 2024-09-12T00:51:54.316 INFO:tasks.workunit.client.0.smithi073.stderr: -242> 2024-09-12T00:51:54.025+0000 7ff9623da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:54.317 INFO:tasks.workunit.client.0.smithi073.stderr: -241> 2024-09-12T00:51:54.025+0000 7ff9623da640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:54.317 INFO:tasks.workunit.client.0.smithi073.stderr: -240> 2024-09-12T00:51:54.025+0000 7ff9623da640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:54.317 INFO:tasks.workunit.client.0.smithi073.stderr: -239> 2024-09-12T00:51:54.025+0000 7ff961bd9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:54.317 INFO:tasks.workunit.client.0.smithi073.stderr: -238> 2024-09-12T00:51:54.025+0000 7ff961bd9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:54.317 INFO:tasks.workunit.client.0.smithi073.stderr: -237> 2024-09-12T00:51:54.025+0000 7ff961bd9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:54.317 INFO:tasks.workunit.client.0.smithi073.stderr: -236> 2024-09-12T00:51:54.025+0000 7ff9623da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:54.317 INFO:tasks.workunit.client.0.smithi073.stderr: -235> 2024-09-12T00:51:54.025+0000 7ff9623da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:54.317 INFO:tasks.workunit.client.0.smithi073.stderr: -234> 2024-09-12T00:51:54.025+0000 7ff9623da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:54.317 INFO:tasks.workunit.client.0.smithi073.stderr: -233> 2024-09-12T00:51:54.025+0000 7ff961bd9640 10 monclient(hunting): handle_auth_done global_id 7548 payload 274 2024-09-12T00:51:54.317 INFO:tasks.workunit.client.0.smithi073.stderr: -232> 2024-09-12T00:51:54.025+0000 7ff961bd9640 10 monclient: _finish_hunting 0 2024-09-12T00:51:54.317 INFO:tasks.workunit.client.0.smithi073.stderr: -231> 2024-09-12T00:51:54.025+0000 7ff961bd9640 1 monclient: found mon.noname-a 2024-09-12T00:51:54.317 INFO:tasks.workunit.client.0.smithi073.stderr: -230> 2024-09-12T00:51:54.025+0000 7ff961bd9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:51:54.317 INFO:tasks.workunit.client.0.smithi073.stderr: -229> 2024-09-12T00:51:54.025+0000 7ff8457fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:54.318 INFO:tasks.workunit.client.0.smithi073.stderr: -228> 2024-09-12T00:51:54.025+0000 7ff8457fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:51:54.318 INFO:tasks.workunit.client.0.smithi073.stderr: -227> 2024-09-12T00:51:54.025+0000 7ff8457fa640 10 monclient: dump: 2024-09-12T00:51:54.318 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:51:54.318 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:51:54.318 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:54.318 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:54.318 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:54.318 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:51:54.318 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:51:54.318 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:51:54.318 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:51:54.318 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:54.319 INFO:tasks.workunit.client.0.smithi073.stderr: -226> 2024-09-12T00:51:54.025+0000 7ff8457fa640 10 monclient: _finish_auth 0 2024-09-12T00:51:54.319 INFO:tasks.workunit.client.0.smithi073.stderr: -225> 2024-09-12T00:51:54.025+0000 7ff8457fa640 10 monclient: _check_auth_tickets 2024-09-12T00:51:54.319 INFO:tasks.workunit.client.0.smithi073.stderr: -224> 2024-09-12T00:51:54.025+0000 7ff8457fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:54.319 INFO:tasks.workunit.client.0.smithi073.stderr: -223> 2024-09-12T00:51:54.025+0000 7ff8457fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:54.319 INFO:tasks.workunit.client.0.smithi073.stderr: -222> 2024-09-12T00:51:54.025+0000 7ff8457fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:51:54.319 INFO:tasks.workunit.client.0.smithi073.stderr: -221> 2024-09-12T00:51:54.025+0000 7ff8457fa640 10 monclient: dump: 2024-09-12T00:51:54.319 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:51:54.319 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:51:54.319 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:54.319 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:54.319 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:54.319 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:51:54.319 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:51:54.320 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:51:54.320 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:51:54.320 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:54.320 INFO:tasks.workunit.client.0.smithi073.stderr: -220> 2024-09-12T00:51:54.025+0000 7ff965f26800 5 monclient: authenticate success, global_id 7548 2024-09-12T00:51:54.320 INFO:tasks.workunit.client.0.smithi073.stderr: -219> 2024-09-12T00:51:54.025+0000 7ff965f26800 10 monclient: get_monmap_and_config success 2024-09-12T00:51:54.320 INFO:tasks.workunit.client.0.smithi073.stderr: -218> 2024-09-12T00:51:54.025+0000 7ff965f26800 4 set_mon_vals no callback set 2024-09-12T00:51:54.320 INFO:tasks.workunit.client.0.smithi073.stderr: -217> 2024-09-12T00:51:54.026+0000 7ff965f26800 10 monclient: shutdown 2024-09-12T00:51:54.320 INFO:tasks.workunit.client.0.smithi073.stderr: -216> 2024-09-12T00:51:54.026+0000 7ff965f26800 10 monclient: build_initial_monmap 2024-09-12T00:51:54.320 INFO:tasks.workunit.client.0.smithi073.stderr: -215> 2024-09-12T00:51:54.026+0000 7ff965f26800 1 build_initial for_mkfs: 0 2024-09-12T00:51:54.320 INFO:tasks.workunit.client.0.smithi073.stderr: -214> 2024-09-12T00:51:54.026+0000 7ff965f26800 10 monclient: monmap: 2024-09-12T00:51:54.320 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:51:54.320 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:51:54.320 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:51:54.321 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:51:54.321 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:51:54.321 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:51:54.321 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:51:54.321 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:51:54.321 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:51:54.321 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:54.321 INFO:tasks.workunit.client.0.smithi073.stderr: -213> 2024-09-12T00:51:54.026+0000 7ff965f26800 5 AuthRegistry(0x56402775d370) adding auth protocol: cephx 2024-09-12T00:51:54.321 INFO:tasks.workunit.client.0.smithi073.stderr: -212> 2024-09-12T00:51:54.026+0000 7ff965f26800 5 AuthRegistry(0x56402775d370) adding auth protocol: cephx 2024-09-12T00:51:54.321 INFO:tasks.workunit.client.0.smithi073.stderr: -211> 2024-09-12T00:51:54.026+0000 7ff965f26800 5 AuthRegistry(0x56402775d370) adding auth protocol: cephx 2024-09-12T00:51:54.321 INFO:tasks.workunit.client.0.smithi073.stderr: -210> 2024-09-12T00:51:54.026+0000 7ff965f26800 5 AuthRegistry(0x56402775d370) adding con mode: secure 2024-09-12T00:51:54.321 INFO:tasks.workunit.client.0.smithi073.stderr: -209> 2024-09-12T00:51:54.026+0000 7ff965f26800 5 AuthRegistry(0x56402775d370) adding con mode: crc 2024-09-12T00:51:54.321 INFO:tasks.workunit.client.0.smithi073.stderr: -208> 2024-09-12T00:51:54.026+0000 7ff965f26800 5 AuthRegistry(0x56402775d370) adding con mode: secure 2024-09-12T00:51:54.322 INFO:tasks.workunit.client.0.smithi073.stderr: -207> 2024-09-12T00:51:54.026+0000 7ff965f26800 5 AuthRegistry(0x56402775d370) adding con mode: crc 2024-09-12T00:51:54.322 INFO:tasks.workunit.client.0.smithi073.stderr: -206> 2024-09-12T00:51:54.026+0000 7ff965f26800 5 AuthRegistry(0x56402775d370) adding con mode: secure 2024-09-12T00:51:54.322 INFO:tasks.workunit.client.0.smithi073.stderr: -205> 2024-09-12T00:51:54.026+0000 7ff965f26800 5 AuthRegistry(0x56402775d370) adding con mode: crc 2024-09-12T00:51:54.322 INFO:tasks.workunit.client.0.smithi073.stderr: -204> 2024-09-12T00:51:54.026+0000 7ff965f26800 5 AuthRegistry(0x56402775d370) adding con mode: crc 2024-09-12T00:51:54.322 INFO:tasks.workunit.client.0.smithi073.stderr: -203> 2024-09-12T00:51:54.026+0000 7ff965f26800 5 AuthRegistry(0x56402775d370) adding con mode: secure 2024-09-12T00:51:54.322 INFO:tasks.workunit.client.0.smithi073.stderr: -202> 2024-09-12T00:51:54.026+0000 7ff965f26800 5 AuthRegistry(0x56402775d370) adding con mode: crc 2024-09-12T00:51:54.322 INFO:tasks.workunit.client.0.smithi073.stderr: -201> 2024-09-12T00:51:54.026+0000 7ff965f26800 5 AuthRegistry(0x56402775d370) adding con mode: secure 2024-09-12T00:51:54.322 INFO:tasks.workunit.client.0.smithi073.stderr: -200> 2024-09-12T00:51:54.026+0000 7ff965f26800 5 AuthRegistry(0x56402775d370) adding con mode: crc 2024-09-12T00:51:54.322 INFO:tasks.workunit.client.0.smithi073.stderr: -199> 2024-09-12T00:51:54.026+0000 7ff965f26800 5 AuthRegistry(0x56402775d370) adding con mode: secure 2024-09-12T00:51:54.322 INFO:tasks.workunit.client.0.smithi073.stderr: -198> 2024-09-12T00:51:54.026+0000 7ff965f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:54.322 INFO:tasks.workunit.client.0.smithi073.stderr: -197> 2024-09-12T00:51:54.026+0000 7ff965f26800 1 librados: starting msgr at 2024-09-12T00:51:54.322 INFO:tasks.workunit.client.0.smithi073.stderr: -196> 2024-09-12T00:51:54.026+0000 7ff965f26800 1 librados: starting objecter 2024-09-12T00:51:54.323 INFO:tasks.workunit.client.0.smithi073.stderr: -195> 2024-09-12T00:51:54.026+0000 7ff965f26800 5 asok(0x56402749b630) register_command objecter_requests cmddesc objecter_requests hook 0x564027780ca0 EEXIST 2024-09-12T00:51:54.323 INFO:tasks.workunit.client.0.smithi073.stderr: -194> 2024-09-12T00:51:54.026+0000 7ff965f26800 1 librados: setting wanted keys 2024-09-12T00:51:54.323 INFO:tasks.workunit.client.0.smithi073.stderr: -193> 2024-09-12T00:51:54.026+0000 7ff965f26800 1 librados: calling monclient init 2024-09-12T00:51:54.323 INFO:tasks.workunit.client.0.smithi073.stderr: -192> 2024-09-12T00:51:54.026+0000 7ff965f26800 10 monclient: init 2024-09-12T00:51:54.323 INFO:tasks.workunit.client.0.smithi073.stderr: -191> 2024-09-12T00:51:54.026+0000 7ff965f26800 5 AuthRegistry(0x56402774e220) adding auth protocol: cephx 2024-09-12T00:51:54.323 INFO:tasks.workunit.client.0.smithi073.stderr: -190> 2024-09-12T00:51:54.026+0000 7ff965f26800 5 AuthRegistry(0x56402774e220) adding auth protocol: cephx 2024-09-12T00:51:54.323 INFO:tasks.workunit.client.0.smithi073.stderr: -189> 2024-09-12T00:51:54.026+0000 7ff965f26800 5 AuthRegistry(0x56402774e220) adding auth protocol: cephx 2024-09-12T00:51:54.323 INFO:tasks.workunit.client.0.smithi073.stderr: -188> 2024-09-12T00:51:54.026+0000 7ff965f26800 5 AuthRegistry(0x56402774e220) adding con mode: secure 2024-09-12T00:51:54.323 INFO:tasks.workunit.client.0.smithi073.stderr: -187> 2024-09-12T00:51:54.027+0000 7ff965f26800 5 AuthRegistry(0x56402774e220) adding con mode: crc 2024-09-12T00:51:54.323 INFO:tasks.workunit.client.0.smithi073.stderr: -186> 2024-09-12T00:51:54.027+0000 7ff965f26800 5 AuthRegistry(0x56402774e220) adding con mode: secure 2024-09-12T00:51:54.323 INFO:tasks.workunit.client.0.smithi073.stderr: -185> 2024-09-12T00:51:54.027+0000 7ff965f26800 5 AuthRegistry(0x56402774e220) adding con mode: crc 2024-09-12T00:51:54.323 INFO:tasks.workunit.client.0.smithi073.stderr: -184> 2024-09-12T00:51:54.027+0000 7ff965f26800 5 AuthRegistry(0x56402774e220) adding con mode: secure 2024-09-12T00:51:54.323 INFO:tasks.workunit.client.0.smithi073.stderr: -183> 2024-09-12T00:51:54.027+0000 7ff965f26800 5 AuthRegistry(0x56402774e220) adding con mode: crc 2024-09-12T00:51:54.323 INFO:tasks.workunit.client.0.smithi073.stderr: -182> 2024-09-12T00:51:54.027+0000 7ff965f26800 5 AuthRegistry(0x56402774e220) adding con mode: crc 2024-09-12T00:51:54.324 INFO:tasks.workunit.client.0.smithi073.stderr: -181> 2024-09-12T00:51:54.027+0000 7ff965f26800 5 AuthRegistry(0x56402774e220) adding con mode: secure 2024-09-12T00:51:54.324 INFO:tasks.workunit.client.0.smithi073.stderr: -180> 2024-09-12T00:51:54.027+0000 7ff965f26800 5 AuthRegistry(0x56402774e220) adding con mode: crc 2024-09-12T00:51:54.324 INFO:tasks.workunit.client.0.smithi073.stderr: -179> 2024-09-12T00:51:54.027+0000 7ff965f26800 5 AuthRegistry(0x56402774e220) adding con mode: secure 2024-09-12T00:51:54.324 INFO:tasks.workunit.client.0.smithi073.stderr: -178> 2024-09-12T00:51:54.027+0000 7ff965f26800 5 AuthRegistry(0x56402774e220) adding con mode: crc 2024-09-12T00:51:54.324 INFO:tasks.workunit.client.0.smithi073.stderr: -177> 2024-09-12T00:51:54.027+0000 7ff965f26800 5 AuthRegistry(0x56402774e220) adding con mode: secure 2024-09-12T00:51:54.324 INFO:tasks.workunit.client.0.smithi073.stderr: -176> 2024-09-12T00:51:54.027+0000 7ff965f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:54.324 INFO:tasks.workunit.client.0.smithi073.stderr: -175> 2024-09-12T00:51:54.027+0000 7ff965f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:54.324 INFO:tasks.workunit.client.0.smithi073.stderr: -174> 2024-09-12T00:51:54.027+0000 7ff965f26800 5 asok(0x56402749b630) register_command rotate-key cmddesc rotate-key hook 0x56402774e368 EEXIST 2024-09-12T00:51:54.324 INFO:tasks.workunit.client.0.smithi073.stderr: -173> 2024-09-12T00:51:54.027+0000 7ff965f26800 10 monclient: _reopen_session rank -1 2024-09-12T00:51:54.324 INFO:tasks.workunit.client.0.smithi073.stderr: -172> 2024-09-12T00:51:54.027+0000 7ff965f26800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:51:54.324 INFO:tasks.workunit.client.0.smithi073.stderr: -171> 2024-09-12T00:51:54.027+0000 7ff965f26800 10 monclient(hunting): picked mon.noname-b con 0x56402777e760 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:51:54.324 INFO:tasks.workunit.client.0.smithi073.stderr: -170> 2024-09-12T00:51:54.027+0000 7ff965f26800 10 monclient(hunting): picked mon.noname-a con 0x564027789240 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:51:54.325 INFO:tasks.workunit.client.0.smithi073.stderr: -169> 2024-09-12T00:51:54.027+0000 7ff965f26800 10 monclient(hunting): picked mon.noname-c con 0x56402778de10 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:51:54.325 INFO:tasks.workunit.client.0.smithi073.stderr: -168> 2024-09-12T00:51:54.027+0000 7ff965f26800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:54.325 INFO:tasks.workunit.client.0.smithi073.stderr: -167> 2024-09-12T00:51:54.027+0000 7ff965f26800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:54.325 INFO:tasks.workunit.client.0.smithi073.stderr: -166> 2024-09-12T00:51:54.027+0000 7ff965f26800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:54.325 INFO:tasks.workunit.client.0.smithi073.stderr: -165> 2024-09-12T00:51:54.027+0000 7ff965f26800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:54.325 INFO:tasks.workunit.client.0.smithi073.stderr: -164> 2024-09-12T00:51:54.027+0000 7ff965f26800 10 monclient(hunting): authenticate will time out at 2174.698507s 2024-09-12T00:51:54.325 INFO:tasks.workunit.client.0.smithi073.stderr: -163> 2024-09-12T00:51:54.027+0000 7ff9613d8640 10 monclient(hunting): get_auth_request con 0x564027789240 auth_method 0 2024-09-12T00:51:54.325 INFO:tasks.workunit.client.0.smithi073.stderr: -162> 2024-09-12T00:51:54.027+0000 7ff9613d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:54.325 INFO:tasks.workunit.client.0.smithi073.stderr: -161> 2024-09-12T00:51:54.027+0000 7ff9613d8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:54.325 INFO:tasks.workunit.client.0.smithi073.stderr: -160> 2024-09-12T00:51:54.027+0000 7ff9613d8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:54.325 INFO:tasks.workunit.client.0.smithi073.stderr: -159> 2024-09-12T00:51:54.027+0000 7ff9623da640 10 monclient(hunting): get_auth_request con 0x56402778de10 auth_method 0 2024-09-12T00:51:54.325 INFO:tasks.workunit.client.0.smithi073.stderr: -158> 2024-09-12T00:51:54.027+0000 7ff9623da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:54.325 INFO:tasks.workunit.client.0.smithi073.stderr: -157> 2024-09-12T00:51:54.027+0000 7ff9623da640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:54.326 INFO:tasks.workunit.client.0.smithi073.stderr: -156> 2024-09-12T00:51:54.027+0000 7ff9623da640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:54.326 INFO:tasks.workunit.client.0.smithi073.stderr: -155> 2024-09-12T00:51:54.027+0000 7ff9613d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:54.326 INFO:tasks.workunit.client.0.smithi073.stderr: -154> 2024-09-12T00:51:54.027+0000 7ff9613d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:54.326 INFO:tasks.workunit.client.0.smithi073.stderr: -153> 2024-09-12T00:51:54.027+0000 7ff9613d8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:54.326 INFO:tasks.workunit.client.0.smithi073.stderr: -152> 2024-09-12T00:51:54.027+0000 7ff9623da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:54.326 INFO:tasks.workunit.client.0.smithi073.stderr: -151> 2024-09-12T00:51:54.027+0000 7ff9623da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:54.326 INFO:tasks.workunit.client.0.smithi073.stderr: -150> 2024-09-12T00:51:54.027+0000 7ff9623da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:54.326 INFO:tasks.workunit.client.0.smithi073.stderr: -149> 2024-09-12T00:51:54.027+0000 7ff961bd9640 10 monclient(hunting): get_auth_request con 0x56402777e760 auth_method 0 2024-09-12T00:51:54.326 INFO:tasks.workunit.client.0.smithi073.stderr: -148> 2024-09-12T00:51:54.027+0000 7ff961bd9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:54.326 INFO:tasks.workunit.client.0.smithi073.stderr: -147> 2024-09-12T00:51:54.027+0000 7ff961bd9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:54.326 INFO:tasks.workunit.client.0.smithi073.stderr: -146> 2024-09-12T00:51:54.027+0000 7ff961bd9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:54.326 INFO:tasks.workunit.client.0.smithi073.stderr: -145> 2024-09-12T00:51:54.027+0000 7ff9613d8640 10 monclient(hunting): handle_auth_done global_id 7551 payload 824 2024-09-12T00:51:54.326 INFO:tasks.workunit.client.0.smithi073.stderr: -144> 2024-09-12T00:51:54.027+0000 7ff9613d8640 10 monclient: _finish_hunting 0 2024-09-12T00:51:54.326 INFO:tasks.workunit.client.0.smithi073.stderr: -143> 2024-09-12T00:51:54.027+0000 7ff9613d8640 1 monclient: found mon.noname-a 2024-09-12T00:51:54.326 INFO:tasks.workunit.client.0.smithi073.stderr: -142> 2024-09-12T00:51:54.027+0000 7ff9613d8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:51:54.327 INFO:tasks.workunit.client.0.smithi073.stderr: -141> 2024-09-12T00:51:54.028+0000 7ff8337fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:54.327 INFO:tasks.workunit.client.0.smithi073.stderr: -140> 2024-09-12T00:51:54.028+0000 7ff8337fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:51:54.327 INFO:tasks.workunit.client.0.smithi073.stderr: -139> 2024-09-12T00:51:54.028+0000 7ff8337fe640 10 monclient: dump: 2024-09-12T00:51:54.327 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:51:54.327 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:51:54.327 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:54.327 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:54.327 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:54.327 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:51:54.327 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:51:54.327 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:51:54.327 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:51:54.327 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:54.327 INFO:tasks.workunit.client.0.smithi073.stderr: -138> 2024-09-12T00:51:54.028+0000 7ff8337fe640 10 monclient: _finish_auth 0 2024-09-12T00:51:54.327 INFO:tasks.workunit.client.0.smithi073.stderr: -137> 2024-09-12T00:51:54.028+0000 7ff8337fe640 10 monclient: _check_auth_tickets 2024-09-12T00:51:54.328 INFO:tasks.workunit.client.0.smithi073.stderr: -136> 2024-09-12T00:51:54.028+0000 7ff8337fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:54.328 INFO:tasks.workunit.client.0.smithi073.stderr: -135> 2024-09-12T00:51:54.028+0000 7ff8337fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:54.328 INFO:tasks.workunit.client.0.smithi073.stderr: -134> 2024-09-12T00:51:54.028+0000 7ff8337fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:51:54.328 INFO:tasks.workunit.client.0.smithi073.stderr: -133> 2024-09-12T00:51:54.028+0000 7ff8337fe640 10 monclient: dump: 2024-09-12T00:51:54.328 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:51:54.328 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:51:54.328 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:54.328 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:54.328 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:54.328 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:51:54.328 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:51:54.328 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:51:54.328 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:51:54.329 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:54.329 INFO:tasks.workunit.client.0.smithi073.stderr: -132> 2024-09-12T00:51:54.028+0000 7ff965f26800 5 monclient: authenticate success, global_id 7551 2024-09-12T00:51:54.329 INFO:tasks.workunit.client.0.smithi073.stderr: -131> 2024-09-12T00:51:54.028+0000 7ff965f26800 10 monclient: _renew_subs 2024-09-12T00:51:54.329 INFO:tasks.workunit.client.0.smithi073.stderr: -130> 2024-09-12T00:51:54.028+0000 7ff8457fa640 4 set_mon_vals no callback set 2024-09-12T00:51:54.329 INFO:tasks.workunit.client.0.smithi073.stderr: -129> 2024-09-12T00:51:54.028+0000 7ff965f26800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:51:54.329 INFO:tasks.workunit.client.0.smithi073.stderr: -128> 2024-09-12T00:51:54.028+0000 7ff965f26800 10 monclient: _renew_subs 2024-09-12T00:51:54.329 INFO:tasks.workunit.client.0.smithi073.stderr: -127> 2024-09-12T00:51:54.028+0000 7ff965f26800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:51:54.329 INFO:tasks.workunit.client.0.smithi073.stderr: -126> 2024-09-12T00:51:54.028+0000 7ff965f26800 1 librados: init done 2024-09-12T00:51:54.329 INFO:tasks.workunit.client.0.smithi073.stderr: -125> 2024-09-12T00:51:54.028+0000 7ff965f26800 5 asok(0x56402749b630) register_command cr dump hook 0x564027782538 2024-09-12T00:51:54.329 INFO:tasks.workunit.client.0.smithi073.stderr: -124> 2024-09-12T00:51:54.029+0000 7ff965f26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.329 INFO:tasks.workunit.client.0.smithi073.stderr: -123> 2024-09-12T00:51:54.030+0000 7ff8337fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:51:54.329 INFO:tasks.workunit.client.0.smithi073.stderr: -122> 2024-09-12T00:51:54.030+0000 7ff8337fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:51:54.329 INFO:tasks.workunit.client.0.smithi073.stderr: -121> 2024-09-12T00:51:54.030+0000 7ff8337fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:51:54.329 INFO:tasks.workunit.client.0.smithi073.stderr: -120> 2024-09-12T00:51:54.030+0000 7ff961bd9640 10 monclient: get_auth_request con 0x7ff82c076470 auth_method 0 2024-09-12T00:51:54.330 INFO:tasks.workunit.client.0.smithi073.stderr: -119> 2024-09-12T00:51:54.030+0000 7ff9623da640 10 monclient: get_auth_request con 0x5640277a7d50 auth_method 0 2024-09-12T00:51:54.330 INFO:tasks.workunit.client.0.smithi073.stderr: -118> 2024-09-12T00:51:54.031+0000 7ff965f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:54.330 INFO:tasks.workunit.client.0.smithi073.stderr: -117> 2024-09-12T00:51:54.031+0000 7ff965f26800 20 realm 2024-09-12T00:51:54.330 INFO:tasks.workunit.client.0.smithi073.stderr: -116> 2024-09-12T00:51:54.031+0000 7ff965f26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.330 INFO:tasks.workunit.client.0.smithi073.stderr: -115> 2024-09-12T00:51:54.031+0000 7ff965f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:54.330 INFO:tasks.workunit.client.0.smithi073.stderr: -114> 2024-09-12T00:51:54.031+0000 7ff965f26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:54.330 INFO:tasks.workunit.client.0.smithi073.stderr: -113> 2024-09-12T00:51:54.031+0000 7ff965f26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.330 INFO:tasks.workunit.client.0.smithi073.stderr: -112> 2024-09-12T00:51:54.031+0000 7ff965f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:54.330 INFO:tasks.workunit.client.0.smithi073.stderr: -111> 2024-09-12T00:51:54.031+0000 7ff965f26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.330 INFO:tasks.workunit.client.0.smithi073.stderr: -110> 2024-09-12T00:51:54.031+0000 7ff961bd9640 10 monclient: get_auth_request con 0x5640277ac010 auth_method 0 2024-09-12T00:51:54.330 INFO:tasks.workunit.client.0.smithi073.stderr: -109> 2024-09-12T00:51:54.032+0000 7ff965f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:54.330 INFO:tasks.workunit.client.0.smithi073.stderr: -108> 2024-09-12T00:51:54.032+0000 7ff965f26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.330 INFO:tasks.workunit.client.0.smithi073.stderr: -107> 2024-09-12T00:51:54.032+0000 7ff9613d8640 10 monclient: get_auth_request con 0x5640277af870 auth_method 0 2024-09-12T00:51:54.330 INFO:tasks.workunit.client.0.smithi073.stderr: -106> 2024-09-12T00:51:54.032+0000 7ff965f26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:54.331 INFO:tasks.workunit.client.0.smithi073.stderr: -105> 2024-09-12T00:51:54.032+0000 7ff965f26800 20 searching for the correct realm 2024-09-12T00:51:54.331 INFO:tasks.workunit.client.0.smithi073.stderr: -104> 2024-09-12T00:51:54.033+0000 7ff9623da640 10 monclient: get_auth_request con 0x5640277b45f0 auth_method 0 2024-09-12T00:51:54.331 INFO:tasks.workunit.client.0.smithi073.stderr: -103> 2024-09-12T00:51:54.033+0000 7ff961bd9640 10 monclient: get_auth_request con 0x7ff95c0aec20 auth_method 0 2024-09-12T00:51:54.331 INFO:tasks.workunit.client.0.smithi073.stderr: -102> 2024-09-12T00:51:54.034+0000 7ff9613d8640 10 monclient: get_auth_request con 0x7ff954043400 auth_method 0 2024-09-12T00:51:54.331 INFO:tasks.workunit.client.0.smithi073.stderr: -101> 2024-09-12T00:51:54.035+0000 7ff9623da640 0 -- 172.21.15.73:0/2312579535 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7ff958082f50 msgr2=0x7ff958060c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:51:54.331 INFO:tasks.workunit.client.0.smithi073.stderr: -100> 2024-09-12T00:51:54.236+0000 7ff9623da640 10 monclient: get_auth_request con 0x7ff958082f50 auth_method 0 2024-09-12T00:51:54.331 INFO:tasks.workunit.client.0.smithi073.stderr: -99> 2024-09-12T00:51:54.239+0000 7ff961bd9640 10 monclient: get_auth_request con 0x7ff95c0b2020 auth_method 0 2024-09-12T00:51:54.331 INFO:tasks.workunit.client.0.smithi073.stderr: -98> 2024-09-12T00:51:54.239+0000 7ff9623da640 0 -- 172.21.15.73:0/2312579535 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7ff958082f50 msgr2=0x7ff958060c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:54.331 INFO:tasks.workunit.client.0.smithi073.stderr: -97> 2024-09-12T00:51:54.239+0000 7ff8337fe640 1 client.7551.objecter ms_handle_reset 0x7ff958082f50 session 0x7ff9580824c0 osd.4 2024-09-12T00:51:54.331 INFO:tasks.workunit.client.0.smithi073.stderr: -96> 2024-09-12T00:51:54.239+0000 7ff8337fe640 10 monclient: _renew_subs 2024-09-12T00:51:54.331 INFO:tasks.workunit.client.0.smithi073.stderr: -95> 2024-09-12T00:51:54.239+0000 7ff8337fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:51:54.331 INFO:tasks.workunit.client.0.smithi073.stderr: -94> 2024-09-12T00:51:54.240+0000 7ff9623da640 10 monclient: get_auth_request con 0x7ff82c086310 auth_method 0 2024-09-12T00:51:54.331 INFO:tasks.workunit.client.0.smithi073.stderr: -93> 2024-09-12T00:51:54.243+0000 7ff965f26800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:51:54.332 INFO:tasks.workunit.client.0.smithi073.stderr: -92> 2024-09-12T00:51:54.243+0000 7ff965f26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:54.332 INFO:tasks.workunit.client.0.smithi073.stderr: -91> 2024-09-12T00:51:54.243+0000 7ff965f26800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:51:54.332 INFO:tasks.workunit.client.0.smithi073.stderr: -90> 2024-09-12T00:51:54.243+0000 7ff965f26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:54.332 INFO:tasks.workunit.client.0.smithi073.stderr: -89> 2024-09-12T00:51:54.243+0000 7ff965f26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:54.332 INFO:tasks.workunit.client.0.smithi073.stderr: -88> 2024-09-12T00:51:54.243+0000 7ff965f26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:54.332 INFO:tasks.workunit.client.0.smithi073.stderr: -87> 2024-09-12T00:51:54.243+0000 7ff965f26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.332 INFO:tasks.workunit.client.0.smithi073.stderr: -86> 2024-09-12T00:51:54.243+0000 7ff965f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:54.332 INFO:tasks.workunit.client.0.smithi073.stderr: -85> 2024-09-12T00:51:54.243+0000 7ff965f26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.332 INFO:tasks.workunit.client.0.smithi073.stderr: -84> 2024-09-12T00:51:54.244+0000 7ff965f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:54.332 INFO:tasks.workunit.client.0.smithi073.stderr: -83> 2024-09-12T00:51:54.244+0000 7ff965f26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.332 INFO:tasks.workunit.client.0.smithi073.stderr: -82> 2024-09-12T00:51:54.244+0000 7ff965f26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:54.332 INFO:tasks.workunit.client.0.smithi073.stderr: -81> 2024-09-12T00:51:54.244+0000 7ff965f26800 20 zone default found 2024-09-12T00:51:54.332 INFO:tasks.workunit.client.0.smithi073.stderr: -80> 2024-09-12T00:51:54.244+0000 7ff965f26800 4 Realm: () 2024-09-12T00:51:54.333 INFO:tasks.workunit.client.0.smithi073.stderr: -79> 2024-09-12T00:51:54.244+0000 7ff965f26800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:51:54.333 INFO:tasks.workunit.client.0.smithi073.stderr: -78> 2024-09-12T00:51:54.244+0000 7ff965f26800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:51:54.333 INFO:tasks.workunit.client.0.smithi073.stderr: -77> 2024-09-12T00:51:54.244+0000 7ff965f26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:54.333 INFO:tasks.workunit.client.0.smithi073.stderr: -76> 2024-09-12T00:51:54.244+0000 7ff965f26800 20 zonegroup default 2024-09-12T00:51:54.333 INFO:tasks.workunit.client.0.smithi073.stderr: -75> 2024-09-12T00:51:54.244+0000 7ff965f26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.333 INFO:tasks.workunit.client.0.smithi073.stderr: -74> 2024-09-12T00:51:54.244+0000 7ff965f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:54.333 INFO:tasks.workunit.client.0.smithi073.stderr: -73> 2024-09-12T00:51:54.244+0000 7ff965f26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.333 INFO:tasks.workunit.client.0.smithi073.stderr: -72> 2024-09-12T00:51:54.244+0000 7ff965f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:54.333 INFO:tasks.workunit.client.0.smithi073.stderr: -71> 2024-09-12T00:51:54.244+0000 7ff965f26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.333 INFO:tasks.workunit.client.0.smithi073.stderr: -70> 2024-09-12T00:51:54.245+0000 7ff965f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:54.333 INFO:tasks.workunit.client.0.smithi073.stderr: -69> 2024-09-12T00:51:54.245+0000 7ff965f26800 20 started sync module instance, tier type = 2024-09-12T00:51:54.333 INFO:tasks.workunit.client.0.smithi073.stderr: -68> 2024-09-12T00:51:54.245+0000 7ff965f26800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:51:54.333 INFO:tasks.workunit.client.0.smithi073.stderr: -67> 2024-09-12T00:51:54.253+0000 7ff965f26800 20 add_watcher() i=0 2024-09-12T00:51:54.333 INFO:tasks.workunit.client.0.smithi073.stderr: -66> 2024-09-12T00:51:54.253+0000 7ff965f26800 20 add_watcher() i=1 2024-09-12T00:51:54.334 INFO:tasks.workunit.client.0.smithi073.stderr: -65> 2024-09-12T00:51:54.253+0000 7ff965f26800 20 add_watcher() i=2 2024-09-12T00:51:54.334 INFO:tasks.workunit.client.0.smithi073.stderr: -64> 2024-09-12T00:51:54.253+0000 7ff965f26800 20 add_watcher() i=3 2024-09-12T00:51:54.334 INFO:tasks.workunit.client.0.smithi073.stderr: -63> 2024-09-12T00:51:54.253+0000 7ff965f26800 20 add_watcher() i=4 2024-09-12T00:51:54.334 INFO:tasks.workunit.client.0.smithi073.stderr: -62> 2024-09-12T00:51:54.253+0000 7ff965f26800 20 add_watcher() i=5 2024-09-12T00:51:54.334 INFO:tasks.workunit.client.0.smithi073.stderr: -61> 2024-09-12T00:51:54.253+0000 7ff965f26800 20 add_watcher() i=6 2024-09-12T00:51:54.334 INFO:tasks.workunit.client.0.smithi073.stderr: -60> 2024-09-12T00:51:54.254+0000 7ff965f26800 20 add_watcher() i=7 2024-09-12T00:51:54.334 INFO:tasks.workunit.client.0.smithi073.stderr: -59> 2024-09-12T00:51:54.254+0000 7ff965f26800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:54.334 INFO:tasks.workunit.client.0.smithi073.stderr: -58> 2024-09-12T00:51:54.256+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f720) adding auth protocol: cephx 2024-09-12T00:51:54.334 INFO:tasks.workunit.client.0.smithi073.stderr: -57> 2024-09-12T00:51:54.256+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f720) adding auth protocol: cephx 2024-09-12T00:51:54.334 INFO:tasks.workunit.client.0.smithi073.stderr: -56> 2024-09-12T00:51:54.256+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f720) adding auth protocol: cephx 2024-09-12T00:51:54.334 INFO:tasks.workunit.client.0.smithi073.stderr: -55> 2024-09-12T00:51:54.256+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f720) adding con mode: secure 2024-09-12T00:51:54.334 INFO:tasks.workunit.client.0.smithi073.stderr: -54> 2024-09-12T00:51:54.256+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f720) adding con mode: crc 2024-09-12T00:51:54.334 INFO:tasks.workunit.client.0.smithi073.stderr: -53> 2024-09-12T00:51:54.256+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f720) adding con mode: secure 2024-09-12T00:51:54.334 INFO:tasks.workunit.client.0.smithi073.stderr: -52> 2024-09-12T00:51:54.256+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f720) adding con mode: crc 2024-09-12T00:51:54.335 INFO:tasks.workunit.client.0.smithi073.stderr: -51> 2024-09-12T00:51:54.256+0000 7ff813fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:54.335 INFO:tasks.workunit.client.0.smithi073.stderr: -50> 2024-09-12T00:51:54.256+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f720) adding con mode: secure 2024-09-12T00:51:54.335 INFO:tasks.workunit.client.0.smithi073.stderr: -49> 2024-09-12T00:51:54.256+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f720) adding con mode: crc 2024-09-12T00:51:54.335 INFO:tasks.workunit.client.0.smithi073.stderr: -48> 2024-09-12T00:51:54.256+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f720) adding con mode: crc 2024-09-12T00:51:54.335 INFO:tasks.workunit.client.0.smithi073.stderr: -47> 2024-09-12T00:51:54.256+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f720) adding con mode: secure 2024-09-12T00:51:54.335 INFO:tasks.workunit.client.0.smithi073.stderr: -46> 2024-09-12T00:51:54.256+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f720) adding con mode: crc 2024-09-12T00:51:54.335 INFO:tasks.workunit.client.0.smithi073.stderr: -45> 2024-09-12T00:51:54.256+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f720) adding con mode: secure 2024-09-12T00:51:54.335 INFO:tasks.workunit.client.0.smithi073.stderr: -44> 2024-09-12T00:51:54.256+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f720) adding con mode: crc 2024-09-12T00:51:54.335 INFO:tasks.workunit.client.0.smithi073.stderr: -43> 2024-09-12T00:51:54.256+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f720) adding con mode: secure 2024-09-12T00:51:54.335 INFO:tasks.workunit.client.0.smithi073.stderr: -42> 2024-09-12T00:51:54.256+0000 7ff965f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:54.335 INFO:tasks.workunit.client.0.smithi073.stderr: -41> 2024-09-12T00:51:54.256+0000 7ff965f26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:54.335 INFO:tasks.workunit.client.0.smithi073.stderr: -40> 2024-09-12T00:51:54.256+0000 7ff965f26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:54.335 INFO:tasks.workunit.client.0.smithi073.stderr: -39> 2024-09-12T00:51:54.256+0000 7ff965f26800 5 asok(0x56402749b630) register_command cache list hook 0x564027786af0 2024-09-12T00:51:54.336 INFO:tasks.workunit.client.0.smithi073.stderr: -38> 2024-09-12T00:51:54.256+0000 7ff965f26800 5 asok(0x56402749b630) register_command cache inspect hook 0x564027786af0 2024-09-12T00:51:54.336 INFO:tasks.workunit.client.0.smithi073.stderr: -37> 2024-09-12T00:51:54.256+0000 7ff965f26800 5 asok(0x56402749b630) register_command cache erase hook 0x564027786af0 2024-09-12T00:51:54.336 INFO:tasks.workunit.client.0.smithi073.stderr: -36> 2024-09-12T00:51:54.256+0000 7ff965f26800 5 asok(0x56402749b630) register_command cache zap hook 0x564027786af0 2024-09-12T00:51:54.336 INFO:tasks.workunit.client.0.smithi073.stderr: -35> 2024-09-12T00:51:54.256+0000 7ff965f26800 5 note: GC not initialized 2024-09-12T00:51:54.336 INFO:tasks.workunit.client.0.smithi073.stderr: -34> 2024-09-12T00:51:54.257+0000 7ff812ffd640 20 reqs_thread_entry: start 2024-09-12T00:51:54.336 INFO:tasks.workunit.client.0.smithi073.stderr: -33> 2024-09-12T00:51:54.257+0000 7ff965f26800 5 asok(0x56402749b630) register_command sync trace show hook 0x7ff95400fdf0 2024-09-12T00:51:54.336 INFO:tasks.workunit.client.0.smithi073.stderr: -32> 2024-09-12T00:51:54.257+0000 7ff965f26800 5 asok(0x56402749b630) register_command sync trace history hook 0x7ff95400fdf0 2024-09-12T00:51:54.336 INFO:tasks.workunit.client.0.smithi073.stderr: -31> 2024-09-12T00:51:54.257+0000 7ff965f26800 5 asok(0x56402749b630) register_command sync trace active hook 0x7ff95400fdf0 2024-09-12T00:51:54.336 INFO:tasks.workunit.client.0.smithi073.stderr: -30> 2024-09-12T00:51:54.257+0000 7ff965f26800 5 asok(0x56402749b630) register_command sync trace active_short hook 0x7ff95400fdf0 2024-09-12T00:51:54.336 INFO:tasks.workunit.client.0.smithi073.stderr: -29> 2024-09-12T00:51:54.257+0000 7ff965f26800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:54.336 INFO:tasks.workunit.client.0.smithi073.stderr: -28> 2024-09-12T00:51:54.257+0000 7ff965f26800 20 Filter name: none 2024-09-12T00:51:54.336 INFO:tasks.workunit.client.0.smithi073.stderr: -27> 2024-09-12T00:51:54.257+0000 7ff810ff9640 20 reqs_thread_entry: start 2024-09-12T00:51:54.336 INFO:tasks.workunit.client.0.smithi073.stderr: -26> 2024-09-12T00:51:54.257+0000 7ff965f26800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:51:54.336 INFO:tasks.workunit.client.0.smithi073.stderr: -25> 2024-09-12T00:51:54.257+0000 7ff965f26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.337 INFO:tasks.workunit.client.0.smithi073.stderr: -24> 2024-09-12T00:51:54.257+0000 7ff965f26800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:51:54.337 INFO:tasks.workunit.client.0.smithi073.stderr: -23> 2024-09-12T00:51:54.257+0000 7ff965f26800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:51:54.337 INFO:tasks.workunit.client.0.smithi073.stderr: -22> 2024-09-12T00:51:54.257+0000 7ff965f26800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:51:54.337 INFO:tasks.workunit.client.0.smithi073.stderr: -21> 2024-09-12T00:51:54.257+0000 7ff965f26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34 : miss 2024-09-12T00:51:54.337 INFO:tasks.workunit.client.0.smithi073.stderr: -20> 2024-09-12T00:51:54.257+0000 7ff965f26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.337 INFO:tasks.workunit.client.0.smithi073.stderr: -19> 2024-09-12T00:51:54.258+0000 7ff965f26800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:51:54.337 INFO:tasks.workunit.client.0.smithi073.stderr: -18> 2024-09-12T00:51:54.258+0000 7ff965f26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34 info.flags=0x17 2024-09-12T00:51:54.337 INFO:tasks.workunit.client.0.smithi073.stderr: -17> 2024-09-12T00:51:54.258+0000 7ff965f26800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34 to cache LRU end 2024-09-12T00:51:54.337 INFO:tasks.workunit.client.0.smithi073.stderr: -16> 2024-09-12T00:51:54.258+0000 7ff965f26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:51:54.337 INFO:tasks.workunit.client.0.smithi073.stderr: -15> 2024-09-12T00:51:54.258+0000 7ff965f26800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:54.337 INFO:tasks.workunit.client.0.smithi073.stderr: -14> 2024-09-12T00:51:54.258+0000 7ff965f26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34 2024-09-12T00:51:54.337 INFO:tasks.workunit.client.0.smithi073.stderr: -13> 2024-09-12T00:51:54.261+0000 7ff965f26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34 info.flags=0x17 2024-09-12T00:51:54.337 INFO:tasks.workunit.client.0.smithi073.stderr: -12> 2024-09-12T00:51:54.261+0000 7ff965f26800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34 to cache LRU end 2024-09-12T00:51:54.338 INFO:tasks.workunit.client.0.smithi073.stderr: -11> 2024-09-12T00:51:54.261+0000 7ff965f26800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:54.338 INFO:tasks.workunit.client.0.smithi073.stderr: -10> 2024-09-12T00:51:54.261+0000 7ff965f26800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34, ofs0, ns] 2024-09-12T00:51:54.338 INFO:tasks.workunit.client.0.smithi073.stderr: -9> 2024-09-12T00:51:54.261+0000 7ff844ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497020 cookie 94833540308976 notifier 7551 bl.length()=911 2024-09-12T00:51:54.338 INFO:tasks.workunit.client.0.smithi073.stderr: -8> 2024-09-12T00:51:54.262+0000 7ff844ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34 info.flags=0x17 2024-09-12T00:51:54.338 INFO:tasks.workunit.client.0.smithi073.stderr: -7> 2024-09-12T00:51:54.262+0000 7ff844ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34 to cache LRU end 2024-09-12T00:51:54.338 INFO:tasks.workunit.client.0.smithi073.stderr: -6> 2024-09-12T00:51:54.262+0000 7ff844ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:54.338 INFO:tasks.workunit.client.0.smithi073.stderr: -5> 2024-09-12T00:51:54.263+0000 7ff965f26800 20 handle_bi_update(): bucket=:abort-at-do-reshard[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34]): orig_sources= new_sources= 2024-09-12T00:51:54.338 INFO:tasks.workunit.client.0.smithi073.stderr: -4> 2024-09-12T00:51:54.263+0000 7ff965f26800 20 handle_bi_update(): bucket=:abort-at-do-reshard[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34]): potential sources added=[] removed=[] 2024-09-12T00:51:54.338 INFO:tasks.workunit.client.0.smithi073.stderr: -3> 2024-09-12T00:51:54.263+0000 7ff965f26800 20 handle_bi_update(): bucket=:abort-at-do-reshard[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34]): orig_dests= new_dests= 2024-09-12T00:51:54.338 INFO:tasks.workunit.client.0.smithi073.stderr: -2> 2024-09-12T00:51:54.263+0000 7ff965f26800 20 handle_bi_update(): bucket=:abort-at-do-reshard[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34]): potential dests added=[] removed=[] 2024-09-12T00:51:54.338 INFO:tasks.workunit.client.0.smithi073.stderr: -1> 2024-09-12T00:51:54.266+0000 7ff965f26800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff965f26800 time 2024-09-12T00:51:54.267545+0000 2024-09-12T00:51:54.338 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:51:54.338 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:54.339 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:54.339 INFO:tasks.workunit.client.0.smithi073.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff96758c71a] 2024-09-12T00:51:54.339 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff96758c8d8] 2024-09-12T00:51:54.339 INFO:tasks.workunit.client.0.smithi073.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564026a00641] 2024-09-12T00:51:54.339 INFO:tasks.workunit.client.0.smithi073.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564026a1038a] 2024-09-12T00:51:54.339 INFO:tasks.workunit.client.0.smithi073.stderr: 5: main() 2024-09-12T00:51:54.339 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7ff966229590] 2024-09-12T00:51:54.339 INFO:tasks.workunit.client.0.smithi073.stderr: 7: __libc_start_main() 2024-09-12T00:51:54.339 INFO:tasks.workunit.client.0.smithi073.stderr: 8: _start() 2024-09-12T00:51:54.339 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:54.339 INFO:tasks.workunit.client.0.smithi073.stderr: 0> 2024-09-12T00:51:54.267+0000 7ff965f26800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:51:54.339 INFO:tasks.workunit.client.0.smithi073.stderr: in thread 7ff965f26800 thread_name:radosgw-admin 2024-09-12T00:51:54.339 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:54.340 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:54.340 INFO:tasks.workunit.client.0.smithi073.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff96623e6f0] 2024-09-12T00:51:54.340 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff96628b99c] 2024-09-12T00:51:54.340 INFO:tasks.workunit.client.0.smithi073.stderr: 3: raise() 2024-09-12T00:51:54.340 INFO:tasks.workunit.client.0.smithi073.stderr: 4: abort() 2024-09-12T00:51:54.340 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff96758c774] 2024-09-12T00:51:54.340 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff96758c8d8] 2024-09-12T00:51:54.340 INFO:tasks.workunit.client.0.smithi073.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564026a00641] 2024-09-12T00:51:54.340 INFO:tasks.workunit.client.0.smithi073.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564026a1038a] 2024-09-12T00:51:54.340 INFO:tasks.workunit.client.0.smithi073.stderr: 9: main() 2024-09-12T00:51:54.340 INFO:tasks.workunit.client.0.smithi073.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7ff966229590] 2024-09-12T00:51:54.340 INFO:tasks.workunit.client.0.smithi073.stderr: 11: __libc_start_main() 2024-09-12T00:51:54.340 INFO:tasks.workunit.client.0.smithi073.stderr: 12: _start() 2024-09-12T00:51:54.340 INFO:tasks.workunit.client.0.smithi073.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:51:54.341 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:54.341 INFO:tasks.workunit.client.0.smithi073.stderr:--- logging levels --- 2024-09-12T00:51:54.341 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 none 2024-09-12T00:51:54.341 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 lockdep 2024-09-12T00:51:54.341 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 context 2024-09-12T00:51:54.341 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 crush 2024-09-12T00:51:54.341 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds 2024-09-12T00:51:54.341 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_balancer 2024-09-12T00:51:54.341 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_locker 2024-09-12T00:51:54.341 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_log 2024-09-12T00:51:54.341 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_log_expire 2024-09-12T00:51:54.341 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_migrator 2024-09-12T00:51:54.341 INFO:tasks.workunit.client.0.smithi073.stderr: 3/ 5 mds_quiesce 2024-09-12T00:51:54.341 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 buffer 2024-09-12T00:51:54.342 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 timer 2024-09-12T00:51:54.342 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 filer 2024-09-12T00:51:54.342 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 striper 2024-09-12T00:51:54.342 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 objecter 2024-09-12T00:51:54.342 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rados 2024-09-12T00:51:54.342 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd 2024-09-12T00:51:54.342 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_mirror 2024-09-12T00:51:54.342 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_replay 2024-09-12T00:51:54.342 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_pwl 2024-09-12T00:51:54.342 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 journaler 2024-09-12T00:51:54.342 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 objectcacher 2024-09-12T00:51:54.342 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:51:54.342 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 client 2024-09-12T00:51:54.343 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 osd 2024-09-12T00:51:54.343 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 optracker 2024-09-12T00:51:54.343 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 objclass 2024-09-12T00:51:54.343 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 filestore 2024-09-12T00:51:54.343 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 journal 2024-09-12T00:51:54.343 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 0 ms 2024-09-12T00:51:54.343 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mon 2024-09-12T00:51:54.343 INFO:tasks.workunit.client.0.smithi073.stderr: 0/10 monc 2024-09-12T00:51:54.343 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 paxos 2024-09-12T00:51:54.343 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 tp 2024-09-12T00:51:54.343 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 auth 2024-09-12T00:51:54.343 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 crypto 2024-09-12T00:51:54.343 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 finisher 2024-09-12T00:51:54.343 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 reserver 2024-09-12T00:51:54.343 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 heartbeatmap 2024-09-12T00:51:54.344 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 perfcounter 2024-09-12T00:51:54.344 INFO:tasks.workunit.client.0.smithi073.stderr: 20/20 rgw 2024-09-12T00:51:54.344 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_sync 2024-09-12T00:51:54.344 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_datacache 2024-09-12T00:51:54.344 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_access 2024-09-12T00:51:54.344 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:51:54.344 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_flight 2024-09-12T00:51:54.344 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:51:54.344 INFO:tasks.workunit.client.0.smithi073.stderr: 20/20 rgw_notification 2024-09-12T00:51:54.344 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 javaclient 2024-09-12T00:51:54.344 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 asok 2024-09-12T00:51:54.344 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 throttle 2024-09-12T00:51:54.344 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 0 refs 2024-09-12T00:51:54.345 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 compressor 2024-09-12T00:51:54.345 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 bluestore 2024-09-12T00:51:54.345 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 bluefs 2024-09-12T00:51:54.345 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 bdev 2024-09-12T00:51:54.345 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 kstore 2024-09-12T00:51:54.345 INFO:tasks.workunit.client.0.smithi073.stderr: 4/ 5 rocksdb 2024-09-12T00:51:54.345 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 fuse 2024-09-12T00:51:54.345 INFO:tasks.workunit.client.0.smithi073.stderr: 2/ 5 mgr 2024-09-12T00:51:54.345 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mgrc 2024-09-12T00:51:54.345 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 dpdk 2024-09-12T00:51:54.345 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 eventtrace 2024-09-12T00:51:54.345 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 prioritycache 2024-09-12T00:51:54.346 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 test 2024-09-12T00:51:54.346 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:51:54.346 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cephsqlite 2024-09-12T00:51:54.346 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:51:54.346 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore 2024-09-12T00:51:54.346 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_onode 2024-09-12T00:51:54.346 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_odata 2024-09-12T00:51:54.346 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_omap 2024-09-12T00:51:54.346 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_tm 2024-09-12T00:51:54.346 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_t 2024-09-12T00:51:54.346 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:51:54.346 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_epm 2024-09-12T00:51:54.346 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_lba 2024-09-12T00:51:54.346 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:51:54.346 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_cache 2024-09-12T00:51:54.347 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_journal 2024-09-12T00:51:54.347 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_device 2024-09-12T00:51:54.347 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_backref 2024-09-12T00:51:54.347 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 alienstore 2024-09-12T00:51:54.347 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mclock 2024-09-12T00:51:54.347 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cyanstore 2024-09-12T00:51:54.347 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 ceph_exporter 2024-09-12T00:51:54.347 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 memstore 2024-09-12T00:51:54.347 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 trace 2024-09-12T00:51:54.347 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 ceph_dedup 2024-09-12T00:51:54.347 INFO:tasks.workunit.client.0.smithi073.stderr: -2/-2 (syslog threshold) 2024-09-12T00:51:54.347 INFO:tasks.workunit.client.0.smithi073.stderr: 99/99 (stderr threshold) 2024-09-12T00:51:54.347 INFO:tasks.workunit.client.0.smithi073.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:51:54.347 INFO:tasks.workunit.client.0.smithi073.stderr: 7ff810ff9640 / http_manager 2024-09-12T00:51:54.348 INFO:tasks.workunit.client.0.smithi073.stderr: 7ff812ffd640 / http_manager 2024-09-12T00:51:54.348 INFO:tasks.workunit.client.0.smithi073.stderr: 7ff813fff640 / rgw_dt_lg_renew 2024-09-12T00:51:54.348 INFO:tasks.workunit.client.0.smithi073.stderr: 7ff8337fe640 / ms_dispatch 2024-09-12T00:51:54.348 INFO:tasks.workunit.client.0.smithi073.stderr: 7ff844ff9640 / io_context_pool 2024-09-12T00:51:54.348 INFO:tasks.workunit.client.0.smithi073.stderr: 7ff8457fa640 / io_context_pool 2024-09-12T00:51:54.348 INFO:tasks.workunit.client.0.smithi073.stderr: 7ff8477fe640 / ms_dispatch 2024-09-12T00:51:54.348 INFO:tasks.workunit.client.0.smithi073.stderr: 7ff84e604640 / ms_dispatch 2024-09-12T00:51:54.348 INFO:tasks.workunit.client.0.smithi073.stderr: 7ff84fe07640 / io_context_pool 2024-09-12T00:51:54.348 INFO:tasks.workunit.client.0.smithi073.stderr: 7ff9613d8640 / msgr-worker-2 2024-09-12T00:51:54.348 INFO:tasks.workunit.client.0.smithi073.stderr: 7ff961bd9640 / msgr-worker-1 2024-09-12T00:51:54.348 INFO:tasks.workunit.client.0.smithi073.stderr: 7ff9623da640 / msgr-worker-0 2024-09-12T00:51:54.348 INFO:tasks.workunit.client.0.smithi073.stderr: 7ff962bdb640 / io_context_pool 2024-09-12T00:51:54.348 INFO:tasks.workunit.client.0.smithi073.stderr: 7ff965f26800 / radosgw-admin 2024-09-12T00:51:54.349 INFO:tasks.workunit.client.0.smithi073.stderr: max_recent 500 2024-09-12T00:51:54.349 INFO:tasks.workunit.client.0.smithi073.stderr: max_new 1000 2024-09-12T00:51:54.349 INFO:tasks.workunit.client.0.smithi073.stderr: log_file /var/log/ceph/ceph-client.admin.127813.log 2024-09-12T00:51:54.349 INFO:tasks.workunit.client.0.smithi073.stderr:--- end dump of recent events --- 2024-09-12T00:51:54.349 INFO:tasks.workunit.client.0.smithi073.stderr:--- begin dump of recent events --- 2024-09-12T00:51:54.349 INFO:tasks.workunit.client.0.smithi073.stderr: -499> 2024-09-12T00:51:54.012+0000 7ff9613d8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.73:3301/0 2024-09-12T00:51:54.349 INFO:tasks.workunit.client.0.smithi073.stderr: -498> 2024-09-12T00:51:54.012+0000 7ff84fe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:54.349 INFO:tasks.workunit.client.0.smithi073.stderr: -497> 2024-09-12T00:51:54.012+0000 7ff84fe07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:51:54.349 INFO:tasks.workunit.client.0.smithi073.stderr: -496> 2024-09-12T00:51:54.012+0000 7ff84fe07640 10 monclient: dump: 2024-09-12T00:51:54.349 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:51:54.349 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:51:54.349 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:54.349 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:54.350 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:54.350 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:51:54.350 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:51:54.350 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:51:54.350 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:51:54.350 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:54.350 INFO:tasks.workunit.client.0.smithi073.stderr: -495> 2024-09-12T00:51:54.012+0000 7ff84fe07640 10 monclient: _finish_auth 0 2024-09-12T00:51:54.350 INFO:tasks.workunit.client.0.smithi073.stderr: -494> 2024-09-12T00:51:54.012+0000 7ff84fe07640 10 monclient: _check_auth_tickets 2024-09-12T00:51:54.350 INFO:tasks.workunit.client.0.smithi073.stderr: -493> 2024-09-12T00:51:54.012+0000 7ff84fe07640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:54.350 INFO:tasks.workunit.client.0.smithi073.stderr: -492> 2024-09-12T00:51:54.012+0000 7ff84fe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:54.350 INFO:tasks.workunit.client.0.smithi073.stderr: -491> 2024-09-12T00:51:54.012+0000 7ff84fe07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:51:54.350 INFO:tasks.workunit.client.0.smithi073.stderr: -490> 2024-09-12T00:51:54.012+0000 7ff84fe07640 10 monclient: dump: 2024-09-12T00:51:54.350 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:51:54.351 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:51:54.351 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:54.351 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:54.351 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:54.351 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:51:54.351 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:51:54.351 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:51:54.351 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:51:54.351 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:54.351 INFO:tasks.workunit.client.0.smithi073.stderr: -489> 2024-09-12T00:51:54.012+0000 7ff965f26800 5 monclient: authenticate success, global_id 7091 2024-09-12T00:51:54.351 INFO:tasks.workunit.client.0.smithi073.stderr: -488> 2024-09-12T00:51:54.012+0000 7ff965f26800 10 monclient: get_monmap_and_config success 2024-09-12T00:51:54.351 INFO:tasks.workunit.client.0.smithi073.stderr: -487> 2024-09-12T00:51:54.012+0000 7ff965f26800 4 set_mon_vals no callback set 2024-09-12T00:51:54.351 INFO:tasks.workunit.client.0.smithi073.stderr: -486> 2024-09-12T00:51:54.013+0000 7ff965f26800 10 monclient: shutdown 2024-09-12T00:51:54.352 INFO:tasks.workunit.client.0.smithi073.stderr: -485> 2024-09-12T00:51:54.013+0000 7ff965f26800 5 asok(0x56402749b630) unregister_commands rotate-key 2024-09-12T00:51:54.352 INFO:tasks.workunit.client.0.smithi073.stderr: -484> 2024-09-12T00:51:54.013+0000 7ff965f26800 10 monclient: build_initial_monmap 2024-09-12T00:51:54.352 INFO:tasks.workunit.client.0.smithi073.stderr: -483> 2024-09-12T00:51:54.013+0000 7ff965f26800 1 build_initial for_mkfs: 0 2024-09-12T00:51:54.352 INFO:tasks.workunit.client.0.smithi073.stderr: -482> 2024-09-12T00:51:54.013+0000 7ff965f26800 10 monclient: monmap: 2024-09-12T00:51:54.352 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:51:54.352 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:51:54.352 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:51:54.352 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:51:54.352 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:51:54.352 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:51:54.352 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:51:54.352 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:51:54.352 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:51:54.353 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:54.353 INFO:tasks.workunit.client.0.smithi073.stderr: -481> 2024-09-12T00:51:54.013+0000 7ff965f26800 5 AuthRegistry(0x5640276c34c0) adding auth protocol: cephx 2024-09-12T00:51:54.353 INFO:tasks.workunit.client.0.smithi073.stderr: -480> 2024-09-12T00:51:54.013+0000 7ff965f26800 5 AuthRegistry(0x5640276c34c0) adding auth protocol: cephx 2024-09-12T00:51:54.353 INFO:tasks.workunit.client.0.smithi073.stderr: -479> 2024-09-12T00:51:54.013+0000 7ff965f26800 5 AuthRegistry(0x5640276c34c0) adding auth protocol: cephx 2024-09-12T00:51:54.353 INFO:tasks.workunit.client.0.smithi073.stderr: -478> 2024-09-12T00:51:54.013+0000 7ff965f26800 5 AuthRegistry(0x5640276c34c0) adding con mode: secure 2024-09-12T00:51:54.353 INFO:tasks.workunit.client.0.smithi073.stderr: -477> 2024-09-12T00:51:54.013+0000 7ff965f26800 5 AuthRegistry(0x5640276c34c0) adding con mode: crc 2024-09-12T00:51:54.353 INFO:tasks.workunit.client.0.smithi073.stderr: -476> 2024-09-12T00:51:54.013+0000 7ff965f26800 5 AuthRegistry(0x5640276c34c0) adding con mode: secure 2024-09-12T00:51:54.353 INFO:tasks.workunit.client.0.smithi073.stderr: -475> 2024-09-12T00:51:54.013+0000 7ff965f26800 5 AuthRegistry(0x5640276c34c0) adding con mode: crc 2024-09-12T00:51:54.353 INFO:tasks.workunit.client.0.smithi073.stderr: -474> 2024-09-12T00:51:54.013+0000 7ff965f26800 5 AuthRegistry(0x5640276c34c0) adding con mode: secure 2024-09-12T00:51:54.353 INFO:tasks.workunit.client.0.smithi073.stderr: -473> 2024-09-12T00:51:54.013+0000 7ff965f26800 5 AuthRegistry(0x5640276c34c0) adding con mode: crc 2024-09-12T00:51:54.353 INFO:tasks.workunit.client.0.smithi073.stderr: -472> 2024-09-12T00:51:54.013+0000 7ff965f26800 5 AuthRegistry(0x5640276c34c0) adding con mode: crc 2024-09-12T00:51:54.353 INFO:tasks.workunit.client.0.smithi073.stderr: -471> 2024-09-12T00:51:54.013+0000 7ff965f26800 5 AuthRegistry(0x5640276c34c0) adding con mode: secure 2024-09-12T00:51:54.353 INFO:tasks.workunit.client.0.smithi073.stderr: -470> 2024-09-12T00:51:54.013+0000 7ff965f26800 5 AuthRegistry(0x5640276c34c0) adding con mode: crc 2024-09-12T00:51:54.354 INFO:tasks.workunit.client.0.smithi073.stderr: -469> 2024-09-12T00:51:54.013+0000 7ff965f26800 5 AuthRegistry(0x5640276c34c0) adding con mode: secure 2024-09-12T00:51:54.354 INFO:tasks.workunit.client.0.smithi073.stderr: -468> 2024-09-12T00:51:54.013+0000 7ff965f26800 5 AuthRegistry(0x5640276c34c0) adding con mode: crc 2024-09-12T00:51:54.354 INFO:tasks.workunit.client.0.smithi073.stderr: -467> 2024-09-12T00:51:54.013+0000 7ff965f26800 5 AuthRegistry(0x5640276c34c0) adding con mode: secure 2024-09-12T00:51:54.354 INFO:tasks.workunit.client.0.smithi073.stderr: -466> 2024-09-12T00:51:54.014+0000 7ff965f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:54.354 INFO:tasks.workunit.client.0.smithi073.stderr: -465> 2024-09-12T00:51:54.014+0000 7ff965f26800 1 librados: starting msgr at 2024-09-12T00:51:54.354 INFO:tasks.workunit.client.0.smithi073.stderr: -464> 2024-09-12T00:51:54.014+0000 7ff965f26800 1 librados: starting objecter 2024-09-12T00:51:54.354 INFO:tasks.workunit.client.0.smithi073.stderr: -463> 2024-09-12T00:51:54.014+0000 7ff965f26800 5 asok(0x56402749b630) register_command objecter_requests hook 0x5640276ec670 2024-09-12T00:51:54.354 INFO:tasks.workunit.client.0.smithi073.stderr: -462> 2024-09-12T00:51:54.014+0000 7ff965f26800 1 librados: setting wanted keys 2024-09-12T00:51:54.354 INFO:tasks.workunit.client.0.smithi073.stderr: -461> 2024-09-12T00:51:54.014+0000 7ff965f26800 1 librados: calling monclient init 2024-09-12T00:51:54.354 INFO:tasks.workunit.client.0.smithi073.stderr: -460> 2024-09-12T00:51:54.014+0000 7ff965f26800 10 monclient: init 2024-09-12T00:51:54.354 INFO:tasks.workunit.client.0.smithi073.stderr: -459> 2024-09-12T00:51:54.014+0000 7ff965f26800 5 AuthRegistry(0x5640276bd8b0) adding auth protocol: cephx 2024-09-12T00:51:54.354 INFO:tasks.workunit.client.0.smithi073.stderr: -458> 2024-09-12T00:51:54.014+0000 7ff965f26800 5 AuthRegistry(0x5640276bd8b0) adding auth protocol: cephx 2024-09-12T00:51:54.354 INFO:tasks.workunit.client.0.smithi073.stderr: -457> 2024-09-12T00:51:54.014+0000 7ff965f26800 5 AuthRegistry(0x5640276bd8b0) adding auth protocol: cephx 2024-09-12T00:51:54.354 INFO:tasks.workunit.client.0.smithi073.stderr: -456> 2024-09-12T00:51:54.014+0000 7ff965f26800 5 AuthRegistry(0x5640276bd8b0) adding con mode: secure 2024-09-12T00:51:54.355 INFO:tasks.workunit.client.0.smithi073.stderr: -455> 2024-09-12T00:51:54.014+0000 7ff965f26800 5 AuthRegistry(0x5640276bd8b0) adding con mode: crc 2024-09-12T00:51:54.355 INFO:tasks.workunit.client.0.smithi073.stderr: -454> 2024-09-12T00:51:54.014+0000 7ff965f26800 5 AuthRegistry(0x5640276bd8b0) adding con mode: secure 2024-09-12T00:51:54.355 INFO:tasks.workunit.client.0.smithi073.stderr: -453> 2024-09-12T00:51:54.014+0000 7ff965f26800 5 AuthRegistry(0x5640276bd8b0) adding con mode: crc 2024-09-12T00:51:54.355 INFO:tasks.workunit.client.0.smithi073.stderr: -452> 2024-09-12T00:51:54.014+0000 7ff965f26800 5 AuthRegistry(0x5640276bd8b0) adding con mode: secure 2024-09-12T00:51:54.355 INFO:tasks.workunit.client.0.smithi073.stderr: -451> 2024-09-12T00:51:54.014+0000 7ff965f26800 5 AuthRegistry(0x5640276bd8b0) adding con mode: crc 2024-09-12T00:51:54.355 INFO:tasks.workunit.client.0.smithi073.stderr: -450> 2024-09-12T00:51:54.014+0000 7ff965f26800 5 AuthRegistry(0x5640276bd8b0) adding con mode: crc 2024-09-12T00:51:54.355 INFO:tasks.workunit.client.0.smithi073.stderr: -449> 2024-09-12T00:51:54.014+0000 7ff965f26800 5 AuthRegistry(0x5640276bd8b0) adding con mode: secure 2024-09-12T00:51:54.355 INFO:tasks.workunit.client.0.smithi073.stderr: -448> 2024-09-12T00:51:54.014+0000 7ff965f26800 5 AuthRegistry(0x5640276bd8b0) adding con mode: crc 2024-09-12T00:51:54.355 INFO:tasks.workunit.client.0.smithi073.stderr: -447> 2024-09-12T00:51:54.014+0000 7ff965f26800 5 AuthRegistry(0x5640276bd8b0) adding con mode: secure 2024-09-12T00:51:54.355 INFO:tasks.workunit.client.0.smithi073.stderr: -446> 2024-09-12T00:51:54.014+0000 7ff965f26800 5 AuthRegistry(0x5640276bd8b0) adding con mode: crc 2024-09-12T00:51:54.356 INFO:tasks.workunit.client.0.smithi073.stderr: -445> 2024-09-12T00:51:54.014+0000 7ff965f26800 5 AuthRegistry(0x5640276bd8b0) adding con mode: secure 2024-09-12T00:51:54.356 INFO:tasks.workunit.client.0.smithi073.stderr: -444> 2024-09-12T00:51:54.014+0000 7ff965f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:54.356 INFO:tasks.workunit.client.0.smithi073.stderr: -443> 2024-09-12T00:51:54.014+0000 7ff965f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:54.356 INFO:tasks.workunit.client.0.smithi073.stderr: -442> 2024-09-12T00:51:54.014+0000 7ff965f26800 5 asok(0x56402749b630) register_command rotate-key hook 0x5640276bd9f8 2024-09-12T00:51:54.356 INFO:tasks.workunit.client.0.smithi073.stderr: -441> 2024-09-12T00:51:54.014+0000 7ff965f26800 10 monclient: _reopen_session rank -1 2024-09-12T00:51:54.356 INFO:tasks.workunit.client.0.smithi073.stderr: -440> 2024-09-12T00:51:54.014+0000 7ff965f26800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:51:54.356 INFO:tasks.workunit.client.0.smithi073.stderr: -439> 2024-09-12T00:51:54.014+0000 7ff965f26800 10 monclient(hunting): picked mon.noname-c con 0x5640275fd6c0 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:51:54.356 INFO:tasks.workunit.client.0.smithi073.stderr: -438> 2024-09-12T00:51:54.014+0000 7ff965f26800 10 monclient(hunting): picked mon.noname-a con 0x5640276038a0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:51:54.356 INFO:tasks.workunit.client.0.smithi073.stderr: -437> 2024-09-12T00:51:54.014+0000 7ff965f26800 10 monclient(hunting): picked mon.noname-b con 0x56402760d1b0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:51:54.356 INFO:tasks.workunit.client.0.smithi073.stderr: -436> 2024-09-12T00:51:54.014+0000 7ff965f26800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:54.356 INFO:tasks.workunit.client.0.smithi073.stderr: -435> 2024-09-12T00:51:54.014+0000 7ff965f26800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:54.356 INFO:tasks.workunit.client.0.smithi073.stderr: -434> 2024-09-12T00:51:54.014+0000 7ff965f26800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:54.356 INFO:tasks.workunit.client.0.smithi073.stderr: -433> 2024-09-12T00:51:54.014+0000 7ff965f26800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:54.357 INFO:tasks.workunit.client.0.smithi073.stderr: -432> 2024-09-12T00:51:54.014+0000 7ff965f26800 10 monclient(hunting): authenticate will time out at 2174.685722s 2024-09-12T00:51:54.357 INFO:tasks.workunit.client.0.smithi073.stderr: -431> 2024-09-12T00:51:54.014+0000 7ff9613d8640 10 monclient(hunting): get_auth_request con 0x5640276038a0 auth_method 0 2024-09-12T00:51:54.357 INFO:tasks.workunit.client.0.smithi073.stderr: -430> 2024-09-12T00:51:54.014+0000 7ff9613d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:54.357 INFO:tasks.workunit.client.0.smithi073.stderr: -429> 2024-09-12T00:51:54.014+0000 7ff9613d8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:54.357 INFO:tasks.workunit.client.0.smithi073.stderr: -428> 2024-09-12T00:51:54.014+0000 7ff9613d8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:54.357 INFO:tasks.workunit.client.0.smithi073.stderr: -427> 2024-09-12T00:51:54.014+0000 7ff961bd9640 10 monclient(hunting): get_auth_request con 0x5640275fd6c0 auth_method 0 2024-09-12T00:51:54.357 INFO:tasks.workunit.client.0.smithi073.stderr: -426> 2024-09-12T00:51:54.014+0000 7ff961bd9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:54.357 INFO:tasks.workunit.client.0.smithi073.stderr: -425> 2024-09-12T00:51:54.014+0000 7ff961bd9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:54.357 INFO:tasks.workunit.client.0.smithi073.stderr: -424> 2024-09-12T00:51:54.014+0000 7ff961bd9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:54.357 INFO:tasks.workunit.client.0.smithi073.stderr: -423> 2024-09-12T00:51:54.014+0000 7ff9613d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:54.357 INFO:tasks.workunit.client.0.smithi073.stderr: -422> 2024-09-12T00:51:54.014+0000 7ff9613d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:54.357 INFO:tasks.workunit.client.0.smithi073.stderr: -421> 2024-09-12T00:51:54.014+0000 7ff9613d8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:54.358 INFO:tasks.workunit.client.0.smithi073.stderr: -420> 2024-09-12T00:51:54.014+0000 7ff961bd9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:54.358 INFO:tasks.workunit.client.0.smithi073.stderr: -419> 2024-09-12T00:51:54.014+0000 7ff961bd9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:54.358 INFO:tasks.workunit.client.0.smithi073.stderr: -418> 2024-09-12T00:51:54.014+0000 7ff961bd9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:54.358 INFO:tasks.workunit.client.0.smithi073.stderr: -417> 2024-09-12T00:51:54.014+0000 7ff9623da640 10 monclient(hunting): get_auth_request con 0x56402760d1b0 auth_method 0 2024-09-12T00:51:54.358 INFO:tasks.workunit.client.0.smithi073.stderr: -416> 2024-09-12T00:51:54.014+0000 7ff9623da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:54.358 INFO:tasks.workunit.client.0.smithi073.stderr: -415> 2024-09-12T00:51:54.014+0000 7ff9623da640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:54.358 INFO:tasks.workunit.client.0.smithi073.stderr: -414> 2024-09-12T00:51:54.014+0000 7ff9623da640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:54.358 INFO:tasks.workunit.client.0.smithi073.stderr: -413> 2024-09-12T00:51:54.015+0000 7ff9613d8640 10 monclient(hunting): handle_auth_done global_id 7542 payload 824 2024-09-12T00:51:54.358 INFO:tasks.workunit.client.0.smithi073.stderr: -412> 2024-09-12T00:51:54.015+0000 7ff9613d8640 10 monclient: _finish_hunting 0 2024-09-12T00:51:54.358 INFO:tasks.workunit.client.0.smithi073.stderr: -411> 2024-09-12T00:51:54.015+0000 7ff9613d8640 1 monclient: found mon.noname-a 2024-09-12T00:51:54.358 INFO:tasks.workunit.client.0.smithi073.stderr: -410> 2024-09-12T00:51:54.015+0000 7ff9613d8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:51:54.358 INFO:tasks.workunit.client.0.smithi073.stderr: -409> 2024-09-12T00:51:54.015+0000 7ff84e604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:54.358 INFO:tasks.workunit.client.0.smithi073.stderr: -408> 2024-09-12T00:51:54.015+0000 7ff84e604640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:51:54.358 INFO:tasks.workunit.client.0.smithi073.stderr: -407> 2024-09-12T00:51:54.015+0000 7ff84e604640 10 monclient: dump: 2024-09-12T00:51:54.359 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:51:54.359 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:51:54.359 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:54.359 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:54.359 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:54.359 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:51:54.359 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:51:54.359 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:51:54.359 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:51:54.359 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:54.359 INFO:tasks.workunit.client.0.smithi073.stderr: -406> 2024-09-12T00:51:54.015+0000 7ff84e604640 10 monclient: _finish_auth 0 2024-09-12T00:51:54.359 INFO:tasks.workunit.client.0.smithi073.stderr: -405> 2024-09-12T00:51:54.015+0000 7ff84e604640 10 monclient: _check_auth_tickets 2024-09-12T00:51:54.359 INFO:tasks.workunit.client.0.smithi073.stderr: -404> 2024-09-12T00:51:54.015+0000 7ff84e604640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:54.359 INFO:tasks.workunit.client.0.smithi073.stderr: -403> 2024-09-12T00:51:54.015+0000 7ff84e604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:54.360 INFO:tasks.workunit.client.0.smithi073.stderr: -402> 2024-09-12T00:51:54.015+0000 7ff84e604640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:51:54.360 INFO:tasks.workunit.client.0.smithi073.stderr: -401> 2024-09-12T00:51:54.015+0000 7ff84e604640 10 monclient: dump: 2024-09-12T00:51:54.360 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:51:54.360 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:51:54.360 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:54.360 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:54.360 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:54.360 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:51:54.360 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:51:54.360 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:51:54.360 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:51:54.360 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:54.360 INFO:tasks.workunit.client.0.smithi073.stderr: -400> 2024-09-12T00:51:54.015+0000 7ff965f26800 5 monclient: authenticate success, global_id 7542 2024-09-12T00:51:54.360 INFO:tasks.workunit.client.0.smithi073.stderr: -399> 2024-09-12T00:51:54.015+0000 7ff965f26800 10 monclient: _renew_subs 2024-09-12T00:51:54.361 INFO:tasks.workunit.client.0.smithi073.stderr: -398> 2024-09-12T00:51:54.015+0000 7ff84fe07640 4 set_mon_vals no callback set 2024-09-12T00:51:54.361 INFO:tasks.workunit.client.0.smithi073.stderr: -397> 2024-09-12T00:51:54.015+0000 7ff965f26800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:51:54.361 INFO:tasks.workunit.client.0.smithi073.stderr: -396> 2024-09-12T00:51:54.015+0000 7ff965f26800 10 monclient: _renew_subs 2024-09-12T00:51:54.361 INFO:tasks.workunit.client.0.smithi073.stderr: -395> 2024-09-12T00:51:54.015+0000 7ff965f26800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:51:54.361 INFO:tasks.workunit.client.0.smithi073.stderr: -394> 2024-09-12T00:51:54.015+0000 7ff965f26800 1 librados: init done 2024-09-12T00:51:54.361 INFO:tasks.workunit.client.0.smithi073.stderr: -393> 2024-09-12T00:51:54.017+0000 7ff84e604640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:51:54.361 INFO:tasks.workunit.client.0.smithi073.stderr: -392> 2024-09-12T00:51:54.017+0000 7ff84e604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:51:54.361 INFO:tasks.workunit.client.0.smithi073.stderr: -391> 2024-09-12T00:51:54.017+0000 7ff84e604640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:51:54.361 INFO:tasks.workunit.client.0.smithi073.stderr: -390> 2024-09-12T00:51:54.017+0000 7ff961bd9640 10 monclient: get_auth_request con 0x7ff8480764a0 auth_method 0 2024-09-12T00:51:54.361 INFO:tasks.workunit.client.0.smithi073.stderr: -389> 2024-09-12T00:51:54.017+0000 7ff9623da640 10 monclient: get_auth_request con 0x5640276f1a80 auth_method 0 2024-09-12T00:51:54.361 INFO:tasks.workunit.client.0.smithi073.stderr: -388> 2024-09-12T00:51:54.018+0000 7ff961bd9640 10 monclient: get_auth_request con 0x564027708ee0 auth_method 0 2024-09-12T00:51:54.361 INFO:tasks.workunit.client.0.smithi073.stderr: -387> 2024-09-12T00:51:54.019+0000 7ff9613d8640 10 monclient: get_auth_request con 0x56402770d240 auth_method 0 2024-09-12T00:51:54.362 INFO:tasks.workunit.client.0.smithi073.stderr: -386> 2024-09-12T00:51:54.020+0000 7ff965f26800 10 monclient: build_initial_monmap 2024-09-12T00:51:54.362 INFO:tasks.workunit.client.0.smithi073.stderr: -385> 2024-09-12T00:51:54.020+0000 7ff965f26800 1 build_initial for_mkfs: 0 2024-09-12T00:51:54.362 INFO:tasks.workunit.client.0.smithi073.stderr: -384> 2024-09-12T00:51:54.020+0000 7ff965f26800 10 monclient: monmap: 2024-09-12T00:51:54.362 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:51:54.362 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:51:54.362 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:51:54.362 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:51:54.362 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:51:54.362 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:51:54.362 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:51:54.362 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:51:54.362 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:51:54.362 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:54.363 INFO:tasks.workunit.client.0.smithi073.stderr: -383> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277121b0) adding auth protocol: cephx 2024-09-12T00:51:54.363 INFO:tasks.workunit.client.0.smithi073.stderr: -382> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277121b0) adding auth protocol: cephx 2024-09-12T00:51:54.363 INFO:tasks.workunit.client.0.smithi073.stderr: -381> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277121b0) adding auth protocol: cephx 2024-09-12T00:51:54.363 INFO:tasks.workunit.client.0.smithi073.stderr: -380> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277121b0) adding con mode: secure 2024-09-12T00:51:54.363 INFO:tasks.workunit.client.0.smithi073.stderr: -379> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277121b0) adding con mode: crc 2024-09-12T00:51:54.363 INFO:tasks.workunit.client.0.smithi073.stderr: -378> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277121b0) adding con mode: secure 2024-09-12T00:51:54.363 INFO:tasks.workunit.client.0.smithi073.stderr: -377> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277121b0) adding con mode: crc 2024-09-12T00:51:54.363 INFO:tasks.workunit.client.0.smithi073.stderr: -376> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277121b0) adding con mode: secure 2024-09-12T00:51:54.363 INFO:tasks.workunit.client.0.smithi073.stderr: -375> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277121b0) adding con mode: crc 2024-09-12T00:51:54.363 INFO:tasks.workunit.client.0.smithi073.stderr: -374> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277121b0) adding con mode: crc 2024-09-12T00:51:54.363 INFO:tasks.workunit.client.0.smithi073.stderr: -373> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277121b0) adding con mode: secure 2024-09-12T00:51:54.363 INFO:tasks.workunit.client.0.smithi073.stderr: -372> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277121b0) adding con mode: crc 2024-09-12T00:51:54.363 INFO:tasks.workunit.client.0.smithi073.stderr: -371> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277121b0) adding con mode: secure 2024-09-12T00:51:54.364 INFO:tasks.workunit.client.0.smithi073.stderr: -370> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277121b0) adding con mode: crc 2024-09-12T00:51:54.364 INFO:tasks.workunit.client.0.smithi073.stderr: -369> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277121b0) adding con mode: secure 2024-09-12T00:51:54.364 INFO:tasks.workunit.client.0.smithi073.stderr: -368> 2024-09-12T00:51:54.020+0000 7ff965f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:54.364 INFO:tasks.workunit.client.0.smithi073.stderr: -367> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 asok(0x56402749b630) register_command objecter_requests cmddesc objecter_requests hook 0x564027715640 EEXIST 2024-09-12T00:51:54.364 INFO:tasks.workunit.client.0.smithi073.stderr: -366> 2024-09-12T00:51:54.020+0000 7ff965f26800 10 monclient: init 2024-09-12T00:51:54.364 INFO:tasks.workunit.client.0.smithi073.stderr: -365> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277107d8) adding auth protocol: cephx 2024-09-12T00:51:54.364 INFO:tasks.workunit.client.0.smithi073.stderr: -364> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277107d8) adding auth protocol: cephx 2024-09-12T00:51:54.364 INFO:tasks.workunit.client.0.smithi073.stderr: -363> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277107d8) adding auth protocol: cephx 2024-09-12T00:51:54.364 INFO:tasks.workunit.client.0.smithi073.stderr: -362> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277107d8) adding con mode: secure 2024-09-12T00:51:54.364 INFO:tasks.workunit.client.0.smithi073.stderr: -361> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277107d8) adding con mode: crc 2024-09-12T00:51:54.364 INFO:tasks.workunit.client.0.smithi073.stderr: -360> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277107d8) adding con mode: secure 2024-09-12T00:51:54.364 INFO:tasks.workunit.client.0.smithi073.stderr: -359> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277107d8) adding con mode: crc 2024-09-12T00:51:54.364 INFO:tasks.workunit.client.0.smithi073.stderr: -358> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277107d8) adding con mode: secure 2024-09-12T00:51:54.365 INFO:tasks.workunit.client.0.smithi073.stderr: -357> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277107d8) adding con mode: crc 2024-09-12T00:51:54.365 INFO:tasks.workunit.client.0.smithi073.stderr: -356> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277107d8) adding con mode: crc 2024-09-12T00:51:54.365 INFO:tasks.workunit.client.0.smithi073.stderr: -355> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277107d8) adding con mode: secure 2024-09-12T00:51:54.365 INFO:tasks.workunit.client.0.smithi073.stderr: -354> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277107d8) adding con mode: crc 2024-09-12T00:51:54.365 INFO:tasks.workunit.client.0.smithi073.stderr: -353> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277107d8) adding con mode: secure 2024-09-12T00:51:54.365 INFO:tasks.workunit.client.0.smithi073.stderr: -352> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277107d8) adding con mode: crc 2024-09-12T00:51:54.365 INFO:tasks.workunit.client.0.smithi073.stderr: -351> 2024-09-12T00:51:54.020+0000 7ff965f26800 5 AuthRegistry(0x5640277107d8) adding con mode: secure 2024-09-12T00:51:54.365 INFO:tasks.workunit.client.0.smithi073.stderr: -350> 2024-09-12T00:51:54.021+0000 7ff965f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:54.365 INFO:tasks.workunit.client.0.smithi073.stderr: -349> 2024-09-12T00:51:54.021+0000 7ff965f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:54.365 INFO:tasks.workunit.client.0.smithi073.stderr: -348> 2024-09-12T00:51:54.021+0000 7ff965f26800 5 asok(0x56402749b630) register_command rotate-key cmddesc rotate-key hook 0x564027710920 EEXIST 2024-09-12T00:51:54.365 INFO:tasks.workunit.client.0.smithi073.stderr: -347> 2024-09-12T00:51:54.021+0000 7ff965f26800 10 monclient: _reopen_session rank -1 2024-09-12T00:51:54.365 INFO:tasks.workunit.client.0.smithi073.stderr: -346> 2024-09-12T00:51:54.021+0000 7ff965f26800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:51:54.365 INFO:tasks.workunit.client.0.smithi073.stderr: -345> 2024-09-12T00:51:54.021+0000 7ff965f26800 10 monclient(hunting): picked mon.noname-b con 0x564027739960 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:51:54.366 INFO:tasks.workunit.client.0.smithi073.stderr: -344> 2024-09-12T00:51:54.021+0000 7ff965f26800 10 monclient(hunting): picked mon.noname-a con 0x564027739d40 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:51:54.366 INFO:tasks.workunit.client.0.smithi073.stderr: -343> 2024-09-12T00:51:54.021+0000 7ff965f26800 10 monclient(hunting): picked mon.noname-c con 0x564027738670 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:51:54.366 INFO:tasks.workunit.client.0.smithi073.stderr: -342> 2024-09-12T00:51:54.021+0000 7ff965f26800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:54.366 INFO:tasks.workunit.client.0.smithi073.stderr: -341> 2024-09-12T00:51:54.021+0000 7ff965f26800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:54.366 INFO:tasks.workunit.client.0.smithi073.stderr: -340> 2024-09-12T00:51:54.021+0000 7ff965f26800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:54.366 INFO:tasks.workunit.client.0.smithi073.stderr: -339> 2024-09-12T00:51:54.021+0000 7ff965f26800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:54.366 INFO:tasks.workunit.client.0.smithi073.stderr: -338> 2024-09-12T00:51:54.021+0000 7ff965f26800 10 monclient(hunting): authenticate will time out at 2174.692479s 2024-09-12T00:51:54.366 INFO:tasks.workunit.client.0.smithi073.stderr: -337> 2024-09-12T00:51:54.021+0000 7ff9613d8640 10 monclient(hunting): get_auth_request con 0x564027739d40 auth_method 0 2024-09-12T00:51:54.366 INFO:tasks.workunit.client.0.smithi073.stderr: -336> 2024-09-12T00:51:54.021+0000 7ff9613d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:54.366 INFO:tasks.workunit.client.0.smithi073.stderr: -335> 2024-09-12T00:51:54.021+0000 7ff9613d8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:54.366 INFO:tasks.workunit.client.0.smithi073.stderr: -334> 2024-09-12T00:51:54.021+0000 7ff9613d8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:54.366 INFO:tasks.workunit.client.0.smithi073.stderr: -333> 2024-09-12T00:51:54.021+0000 7ff9623da640 10 monclient(hunting): get_auth_request con 0x564027738670 auth_method 0 2024-09-12T00:51:54.366 INFO:tasks.workunit.client.0.smithi073.stderr: -332> 2024-09-12T00:51:54.021+0000 7ff9623da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:54.367 INFO:tasks.workunit.client.0.smithi073.stderr: -331> 2024-09-12T00:51:54.021+0000 7ff9623da640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:54.367 INFO:tasks.workunit.client.0.smithi073.stderr: -330> 2024-09-12T00:51:54.021+0000 7ff9623da640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:54.367 INFO:tasks.workunit.client.0.smithi073.stderr: -329> 2024-09-12T00:51:54.021+0000 7ff9613d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:54.367 INFO:tasks.workunit.client.0.smithi073.stderr: -328> 2024-09-12T00:51:54.021+0000 7ff9613d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:54.367 INFO:tasks.workunit.client.0.smithi073.stderr: -327> 2024-09-12T00:51:54.021+0000 7ff9613d8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:54.367 INFO:tasks.workunit.client.0.smithi073.stderr: -326> 2024-09-12T00:51:54.021+0000 7ff9623da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:54.367 INFO:tasks.workunit.client.0.smithi073.stderr: -325> 2024-09-12T00:51:54.021+0000 7ff9623da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:54.367 INFO:tasks.workunit.client.0.smithi073.stderr: -324> 2024-09-12T00:51:54.021+0000 7ff9623da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:54.367 INFO:tasks.workunit.client.0.smithi073.stderr: -323> 2024-09-12T00:51:54.021+0000 7ff961bd9640 10 monclient(hunting): get_auth_request con 0x564027739960 auth_method 0 2024-09-12T00:51:54.367 INFO:tasks.workunit.client.0.smithi073.stderr: -322> 2024-09-12T00:51:54.021+0000 7ff961bd9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:54.367 INFO:tasks.workunit.client.0.smithi073.stderr: -321> 2024-09-12T00:51:54.021+0000 7ff961bd9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:54.367 INFO:tasks.workunit.client.0.smithi073.stderr: -320> 2024-09-12T00:51:54.021+0000 7ff961bd9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:54.367 INFO:tasks.workunit.client.0.smithi073.stderr: -319> 2024-09-12T00:51:54.021+0000 7ff9623da640 10 monclient(hunting): handle_auth_done global_id 7097 payload 824 2024-09-12T00:51:54.368 INFO:tasks.workunit.client.0.smithi073.stderr: -318> 2024-09-12T00:51:54.021+0000 7ff9623da640 10 monclient: _finish_hunting 0 2024-09-12T00:51:54.368 INFO:tasks.workunit.client.0.smithi073.stderr: -317> 2024-09-12T00:51:54.021+0000 7ff9623da640 1 monclient: found mon.noname-c 2024-09-12T00:51:54.368 INFO:tasks.workunit.client.0.smithi073.stderr: -316> 2024-09-12T00:51:54.021+0000 7ff9623da640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.73:3301/0 2024-09-12T00:51:54.368 INFO:tasks.workunit.client.0.smithi073.stderr: -315> 2024-09-12T00:51:54.022+0000 7ff8477fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:54.368 INFO:tasks.workunit.client.0.smithi073.stderr: -314> 2024-09-12T00:51:54.022+0000 7ff8477fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:51:54.368 INFO:tasks.workunit.client.0.smithi073.stderr: -313> 2024-09-12T00:51:54.022+0000 7ff8477fe640 10 monclient: dump: 2024-09-12T00:51:54.368 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:51:54.368 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:51:54.368 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:54.368 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:54.368 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:54.368 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:51:54.368 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:51:54.369 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:51:54.369 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:51:54.369 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:54.369 INFO:tasks.workunit.client.0.smithi073.stderr: -312> 2024-09-12T00:51:54.022+0000 7ff8477fe640 10 monclient: _finish_auth 0 2024-09-12T00:51:54.369 INFO:tasks.workunit.client.0.smithi073.stderr: -311> 2024-09-12T00:51:54.022+0000 7ff8477fe640 10 monclient: _check_auth_tickets 2024-09-12T00:51:54.369 INFO:tasks.workunit.client.0.smithi073.stderr: -310> 2024-09-12T00:51:54.022+0000 7ff8477fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:54.369 INFO:tasks.workunit.client.0.smithi073.stderr: -309> 2024-09-12T00:51:54.022+0000 7ff8477fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:54.369 INFO:tasks.workunit.client.0.smithi073.stderr: -308> 2024-09-12T00:51:54.022+0000 7ff8477fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:51:54.369 INFO:tasks.workunit.client.0.smithi073.stderr: -307> 2024-09-12T00:51:54.022+0000 7ff8477fe640 10 monclient: dump: 2024-09-12T00:51:54.369 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:51:54.369 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:51:54.369 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:54.369 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:54.369 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:54.370 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:51:54.370 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:51:54.370 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:51:54.370 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:51:54.370 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:54.370 INFO:tasks.workunit.client.0.smithi073.stderr: -306> 2024-09-12T00:51:54.022+0000 7ff965f26800 5 monclient: authenticate success, global_id 7097 2024-09-12T00:51:54.370 INFO:tasks.workunit.client.0.smithi073.stderr: -305> 2024-09-12T00:51:54.022+0000 7ff965f26800 10 monclient: _renew_subs 2024-09-12T00:51:54.370 INFO:tasks.workunit.client.0.smithi073.stderr: -304> 2024-09-12T00:51:54.022+0000 7ff962bdb640 4 set_mon_vals no callback set 2024-09-12T00:51:54.370 INFO:tasks.workunit.client.0.smithi073.stderr: -303> 2024-09-12T00:51:54.022+0000 7ff965f26800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:51:54.370 INFO:tasks.workunit.client.0.smithi073.stderr: -302> 2024-09-12T00:51:54.022+0000 7ff965f26800 10 monclient: _renew_subs 2024-09-12T00:51:54.370 INFO:tasks.workunit.client.0.smithi073.stderr: -301> 2024-09-12T00:51:54.022+0000 7ff965f26800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:51:54.370 INFO:tasks.workunit.client.0.smithi073.stderr: -300> 2024-09-12T00:51:54.023+0000 7ff8477fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:51:54.370 INFO:tasks.workunit.client.0.smithi073.stderr: -299> 2024-09-12T00:51:54.023+0000 7ff8477fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:51:54.371 INFO:tasks.workunit.client.0.smithi073.stderr: -298> 2024-09-12T00:51:54.023+0000 7ff8477fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:51:54.371 INFO:tasks.workunit.client.0.smithi073.stderr: -297> 2024-09-12T00:51:54.024+0000 7ff961bd9640 10 monclient: get_auth_request con 0x7ff83c076380 auth_method 0 2024-09-12T00:51:54.371 INFO:tasks.workunit.client.0.smithi073.stderr: -296> 2024-09-12T00:51:54.024+0000 7ff965f26800 10 monclient: get_monmap_and_config 2024-09-12T00:51:54.371 INFO:tasks.workunit.client.0.smithi073.stderr: -295> 2024-09-12T00:51:54.024+0000 7ff965f26800 10 monclient: build_initial_monmap 2024-09-12T00:51:54.371 INFO:tasks.workunit.client.0.smithi073.stderr: -294> 2024-09-12T00:51:54.024+0000 7ff965f26800 1 build_initial for_mkfs: 0 2024-09-12T00:51:54.371 INFO:tasks.workunit.client.0.smithi073.stderr: -293> 2024-09-12T00:51:54.024+0000 7ff965f26800 10 monclient: monmap: 2024-09-12T00:51:54.371 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:51:54.371 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:51:54.371 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:51:54.371 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:51:54.371 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:51:54.371 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:51:54.371 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:51:54.371 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:51:54.372 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:51:54.372 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:54.372 INFO:tasks.workunit.client.0.smithi073.stderr: -292> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x564027759810) adding auth protocol: cephx 2024-09-12T00:51:54.372 INFO:tasks.workunit.client.0.smithi073.stderr: -291> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x564027759810) adding auth protocol: cephx 2024-09-12T00:51:54.372 INFO:tasks.workunit.client.0.smithi073.stderr: -290> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x564027759810) adding auth protocol: cephx 2024-09-12T00:51:54.372 INFO:tasks.workunit.client.0.smithi073.stderr: -289> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x564027759810) adding con mode: secure 2024-09-12T00:51:54.372 INFO:tasks.workunit.client.0.smithi073.stderr: -288> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x564027759810) adding con mode: crc 2024-09-12T00:51:54.372 INFO:tasks.workunit.client.0.smithi073.stderr: -287> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x564027759810) adding con mode: secure 2024-09-12T00:51:54.372 INFO:tasks.workunit.client.0.smithi073.stderr: -286> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x564027759810) adding con mode: crc 2024-09-12T00:51:54.372 INFO:tasks.workunit.client.0.smithi073.stderr: -285> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x564027759810) adding con mode: secure 2024-09-12T00:51:54.372 INFO:tasks.workunit.client.0.smithi073.stderr: -284> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x564027759810) adding con mode: crc 2024-09-12T00:51:54.372 INFO:tasks.workunit.client.0.smithi073.stderr: -283> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x564027759810) adding con mode: crc 2024-09-12T00:51:54.373 INFO:tasks.workunit.client.0.smithi073.stderr: -282> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x564027759810) adding con mode: secure 2024-09-12T00:51:54.373 INFO:tasks.workunit.client.0.smithi073.stderr: -281> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x564027759810) adding con mode: crc 2024-09-12T00:51:54.373 INFO:tasks.workunit.client.0.smithi073.stderr: -280> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x564027759810) adding con mode: secure 2024-09-12T00:51:54.373 INFO:tasks.workunit.client.0.smithi073.stderr: -279> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x564027759810) adding con mode: crc 2024-09-12T00:51:54.373 INFO:tasks.workunit.client.0.smithi073.stderr: -278> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x564027759810) adding con mode: secure 2024-09-12T00:51:54.373 INFO:tasks.workunit.client.0.smithi073.stderr: -277> 2024-09-12T00:51:54.024+0000 7ff965f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:54.373 INFO:tasks.workunit.client.0.smithi073.stderr: -276> 2024-09-12T00:51:54.024+0000 7ff965f26800 10 monclient: init 2024-09-12T00:51:54.373 INFO:tasks.workunit.client.0.smithi073.stderr: -275> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f240) adding auth protocol: cephx 2024-09-12T00:51:54.373 INFO:tasks.workunit.client.0.smithi073.stderr: -274> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f240) adding auth protocol: cephx 2024-09-12T00:51:54.373 INFO:tasks.workunit.client.0.smithi073.stderr: -273> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f240) adding auth protocol: cephx 2024-09-12T00:51:54.373 INFO:tasks.workunit.client.0.smithi073.stderr: -272> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f240) adding con mode: secure 2024-09-12T00:51:54.373 INFO:tasks.workunit.client.0.smithi073.stderr: -271> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f240) adding con mode: crc 2024-09-12T00:51:54.373 INFO:tasks.workunit.client.0.smithi073.stderr: -270> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f240) adding con mode: secure 2024-09-12T00:51:54.374 INFO:tasks.workunit.client.0.smithi073.stderr: -269> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f240) adding con mode: crc 2024-09-12T00:51:54.374 INFO:tasks.workunit.client.0.smithi073.stderr: -268> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f240) adding con mode: secure 2024-09-12T00:51:54.374 INFO:tasks.workunit.client.0.smithi073.stderr: -267> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f240) adding con mode: crc 2024-09-12T00:51:54.374 INFO:tasks.workunit.client.0.smithi073.stderr: -266> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f240) adding con mode: crc 2024-09-12T00:51:54.374 INFO:tasks.workunit.client.0.smithi073.stderr: -265> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f240) adding con mode: secure 2024-09-12T00:51:54.374 INFO:tasks.workunit.client.0.smithi073.stderr: -264> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f240) adding con mode: crc 2024-09-12T00:51:54.374 INFO:tasks.workunit.client.0.smithi073.stderr: -263> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f240) adding con mode: secure 2024-09-12T00:51:54.374 INFO:tasks.workunit.client.0.smithi073.stderr: -262> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f240) adding con mode: crc 2024-09-12T00:51:54.374 INFO:tasks.workunit.client.0.smithi073.stderr: -261> 2024-09-12T00:51:54.024+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f240) adding con mode: secure 2024-09-12T00:51:54.374 INFO:tasks.workunit.client.0.smithi073.stderr: -260> 2024-09-12T00:51:54.024+0000 7ff965f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:54.374 INFO:tasks.workunit.client.0.smithi073.stderr: -259> 2024-09-12T00:51:54.025+0000 7ff965f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:54.374 INFO:tasks.workunit.client.0.smithi073.stderr: -258> 2024-09-12T00:51:54.025+0000 7ff965f26800 5 asok(0x56402749b630) register_command rotate-key cmddesc rotate-key hook 0x7ffe3617f388 EEXIST 2024-09-12T00:51:54.374 INFO:tasks.workunit.client.0.smithi073.stderr: -257> 2024-09-12T00:51:54.025+0000 7ff965f26800 10 monclient: _reopen_session rank -1 2024-09-12T00:51:54.374 INFO:tasks.workunit.client.0.smithi073.stderr: -256> 2024-09-12T00:51:54.025+0000 7ff965f26800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:51:54.375 INFO:tasks.workunit.client.0.smithi073.stderr: -255> 2024-09-12T00:51:54.025+0000 7ff965f26800 10 monclient(hunting): picked mon.noname-a con 0x56402778de10 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:51:54.375 INFO:tasks.workunit.client.0.smithi073.stderr: -254> 2024-09-12T00:51:54.025+0000 7ff965f26800 10 monclient(hunting): picked mon.noname-b con 0x56402777e760 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:51:54.375 INFO:tasks.workunit.client.0.smithi073.stderr: -253> 2024-09-12T00:51:54.025+0000 7ff965f26800 10 monclient(hunting): picked mon.noname-c con 0x564027789240 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:51:54.375 INFO:tasks.workunit.client.0.smithi073.stderr: -252> 2024-09-12T00:51:54.025+0000 7ff965f26800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:54.375 INFO:tasks.workunit.client.0.smithi073.stderr: -251> 2024-09-12T00:51:54.025+0000 7ff965f26800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:54.375 INFO:tasks.workunit.client.0.smithi073.stderr: -250> 2024-09-12T00:51:54.025+0000 7ff965f26800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:54.375 INFO:tasks.workunit.client.0.smithi073.stderr: -249> 2024-09-12T00:51:54.025+0000 7ff965f26800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:54.375 INFO:tasks.workunit.client.0.smithi073.stderr: -248> 2024-09-12T00:51:54.025+0000 7ff965f26800 10 monclient(hunting): authenticate will time out at 2174.696280s 2024-09-12T00:51:54.375 INFO:tasks.workunit.client.0.smithi073.stderr: -247> 2024-09-12T00:51:54.025+0000 7ff961bd9640 10 monclient(hunting): get_auth_request con 0x56402778de10 auth_method 0 2024-09-12T00:51:54.375 INFO:tasks.workunit.client.0.smithi073.stderr: -246> 2024-09-12T00:51:54.025+0000 7ff961bd9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:54.375 INFO:tasks.workunit.client.0.smithi073.stderr: -245> 2024-09-12T00:51:54.025+0000 7ff961bd9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:54.375 INFO:tasks.workunit.client.0.smithi073.stderr: -244> 2024-09-12T00:51:54.025+0000 7ff961bd9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:54.375 INFO:tasks.workunit.client.0.smithi073.stderr: -243> 2024-09-12T00:51:54.025+0000 7ff9623da640 10 monclient(hunting): get_auth_request con 0x564027789240 auth_method 0 2024-09-12T00:51:54.376 INFO:tasks.workunit.client.0.smithi073.stderr: -242> 2024-09-12T00:51:54.025+0000 7ff9623da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:54.376 INFO:tasks.workunit.client.0.smithi073.stderr: -241> 2024-09-12T00:51:54.025+0000 7ff9623da640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:54.376 INFO:tasks.workunit.client.0.smithi073.stderr: -240> 2024-09-12T00:51:54.025+0000 7ff9623da640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:54.376 INFO:tasks.workunit.client.0.smithi073.stderr: -239> 2024-09-12T00:51:54.025+0000 7ff961bd9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:54.376 INFO:tasks.workunit.client.0.smithi073.stderr: -238> 2024-09-12T00:51:54.025+0000 7ff961bd9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:54.376 INFO:tasks.workunit.client.0.smithi073.stderr: -237> 2024-09-12T00:51:54.025+0000 7ff961bd9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:54.376 INFO:tasks.workunit.client.0.smithi073.stderr: -236> 2024-09-12T00:51:54.025+0000 7ff9623da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:54.376 INFO:tasks.workunit.client.0.smithi073.stderr: -235> 2024-09-12T00:51:54.025+0000 7ff9623da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:54.376 INFO:tasks.workunit.client.0.smithi073.stderr: -234> 2024-09-12T00:51:54.025+0000 7ff9623da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:54.376 INFO:tasks.workunit.client.0.smithi073.stderr: -233> 2024-09-12T00:51:54.025+0000 7ff961bd9640 10 monclient(hunting): handle_auth_done global_id 7548 payload 274 2024-09-12T00:51:54.376 INFO:tasks.workunit.client.0.smithi073.stderr: -232> 2024-09-12T00:51:54.025+0000 7ff961bd9640 10 monclient: _finish_hunting 0 2024-09-12T00:51:54.376 INFO:tasks.workunit.client.0.smithi073.stderr: -231> 2024-09-12T00:51:54.025+0000 7ff961bd9640 1 monclient: found mon.noname-a 2024-09-12T00:51:54.376 INFO:tasks.workunit.client.0.smithi073.stderr: -230> 2024-09-12T00:51:54.025+0000 7ff961bd9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:51:54.377 INFO:tasks.workunit.client.0.smithi073.stderr: -229> 2024-09-12T00:51:54.025+0000 7ff8457fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:54.377 INFO:tasks.workunit.client.0.smithi073.stderr: -228> 2024-09-12T00:51:54.025+0000 7ff8457fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:51:54.377 INFO:tasks.workunit.client.0.smithi073.stderr: -227> 2024-09-12T00:51:54.025+0000 7ff8457fa640 10 monclient: dump: 2024-09-12T00:51:54.377 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:51:54.377 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:51:54.377 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:54.377 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:54.377 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:54.377 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:51:54.377 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:51:54.377 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:51:54.377 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:51:54.377 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:54.377 INFO:tasks.workunit.client.0.smithi073.stderr: -226> 2024-09-12T00:51:54.025+0000 7ff8457fa640 10 monclient: _finish_auth 0 2024-09-12T00:51:54.378 INFO:tasks.workunit.client.0.smithi073.stderr: -225> 2024-09-12T00:51:54.025+0000 7ff8457fa640 10 monclient: _check_auth_tickets 2024-09-12T00:51:54.378 INFO:tasks.workunit.client.0.smithi073.stderr: -224> 2024-09-12T00:51:54.025+0000 7ff8457fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:54.378 INFO:tasks.workunit.client.0.smithi073.stderr: -223> 2024-09-12T00:51:54.025+0000 7ff8457fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:54.378 INFO:tasks.workunit.client.0.smithi073.stderr: -222> 2024-09-12T00:51:54.025+0000 7ff8457fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:51:54.378 INFO:tasks.workunit.client.0.smithi073.stderr: -221> 2024-09-12T00:51:54.025+0000 7ff8457fa640 10 monclient: dump: 2024-09-12T00:51:54.378 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:51:54.378 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:51:54.378 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:54.378 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:54.378 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:54.378 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:51:54.378 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:51:54.378 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:51:54.379 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:51:54.379 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:54.379 INFO:tasks.workunit.client.0.smithi073.stderr: -220> 2024-09-12T00:51:54.025+0000 7ff965f26800 5 monclient: authenticate success, global_id 7548 2024-09-12T00:51:54.379 INFO:tasks.workunit.client.0.smithi073.stderr: -219> 2024-09-12T00:51:54.025+0000 7ff965f26800 10 monclient: get_monmap_and_config success 2024-09-12T00:51:54.379 INFO:tasks.workunit.client.0.smithi073.stderr: -218> 2024-09-12T00:51:54.025+0000 7ff965f26800 4 set_mon_vals no callback set 2024-09-12T00:51:54.379 INFO:tasks.workunit.client.0.smithi073.stderr: -217> 2024-09-12T00:51:54.026+0000 7ff965f26800 10 monclient: shutdown 2024-09-12T00:51:54.379 INFO:tasks.workunit.client.0.smithi073.stderr: -216> 2024-09-12T00:51:54.026+0000 7ff965f26800 10 monclient: build_initial_monmap 2024-09-12T00:51:54.379 INFO:tasks.workunit.client.0.smithi073.stderr: -215> 2024-09-12T00:51:54.026+0000 7ff965f26800 1 build_initial for_mkfs: 0 2024-09-12T00:51:54.379 INFO:tasks.workunit.client.0.smithi073.stderr: -214> 2024-09-12T00:51:54.026+0000 7ff965f26800 10 monclient: monmap: 2024-09-12T00:51:54.379 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:51:54.379 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:51:54.379 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:51:54.379 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:51:54.380 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:51:54.380 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:51:54.380 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:51:54.380 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:51:54.380 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:51:54.380 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:54.380 INFO:tasks.workunit.client.0.smithi073.stderr: -213> 2024-09-12T00:51:54.026+0000 7ff965f26800 5 AuthRegistry(0x56402775d370) adding auth protocol: cephx 2024-09-12T00:51:54.380 INFO:tasks.workunit.client.0.smithi073.stderr: -212> 2024-09-12T00:51:54.026+0000 7ff965f26800 5 AuthRegistry(0x56402775d370) adding auth protocol: cephx 2024-09-12T00:51:54.380 INFO:tasks.workunit.client.0.smithi073.stderr: -211> 2024-09-12T00:51:54.026+0000 7ff965f26800 5 AuthRegistry(0x56402775d370) adding auth protocol: cephx 2024-09-12T00:51:54.380 INFO:tasks.workunit.client.0.smithi073.stderr: -210> 2024-09-12T00:51:54.026+0000 7ff965f26800 5 AuthRegistry(0x56402775d370) adding con mode: secure 2024-09-12T00:51:54.380 INFO:tasks.workunit.client.0.smithi073.stderr: -209> 2024-09-12T00:51:54.026+0000 7ff965f26800 5 AuthRegistry(0x56402775d370) adding con mode: crc 2024-09-12T00:51:54.380 INFO:tasks.workunit.client.0.smithi073.stderr: -208> 2024-09-12T00:51:54.026+0000 7ff965f26800 5 AuthRegistry(0x56402775d370) adding con mode: secure 2024-09-12T00:51:54.380 INFO:tasks.workunit.client.0.smithi073.stderr: -207> 2024-09-12T00:51:54.026+0000 7ff965f26800 5 AuthRegistry(0x56402775d370) adding con mode: crc 2024-09-12T00:51:54.381 INFO:tasks.workunit.client.0.smithi073.stderr: -206> 2024-09-12T00:51:54.026+0000 7ff965f26800 5 AuthRegistry(0x56402775d370) adding con mode: secure 2024-09-12T00:51:54.381 INFO:tasks.workunit.client.0.smithi073.stderr: -205> 2024-09-12T00:51:54.026+0000 7ff965f26800 5 AuthRegistry(0x56402775d370) adding con mode: crc 2024-09-12T00:51:54.381 INFO:tasks.workunit.client.0.smithi073.stderr: -204> 2024-09-12T00:51:54.026+0000 7ff965f26800 5 AuthRegistry(0x56402775d370) adding con mode: crc 2024-09-12T00:51:54.381 INFO:tasks.workunit.client.0.smithi073.stderr: -203> 2024-09-12T00:51:54.026+0000 7ff965f26800 5 AuthRegistry(0x56402775d370) adding con mode: secure 2024-09-12T00:51:54.381 INFO:tasks.workunit.client.0.smithi073.stderr: -202> 2024-09-12T00:51:54.026+0000 7ff965f26800 5 AuthRegistry(0x56402775d370) adding con mode: crc 2024-09-12T00:51:54.381 INFO:tasks.workunit.client.0.smithi073.stderr: -201> 2024-09-12T00:51:54.026+0000 7ff965f26800 5 AuthRegistry(0x56402775d370) adding con mode: secure 2024-09-12T00:51:54.381 INFO:tasks.workunit.client.0.smithi073.stderr: -200> 2024-09-12T00:51:54.026+0000 7ff965f26800 5 AuthRegistry(0x56402775d370) adding con mode: crc 2024-09-12T00:51:54.381 INFO:tasks.workunit.client.0.smithi073.stderr: -199> 2024-09-12T00:51:54.026+0000 7ff965f26800 5 AuthRegistry(0x56402775d370) adding con mode: secure 2024-09-12T00:51:54.381 INFO:tasks.workunit.client.0.smithi073.stderr: -198> 2024-09-12T00:51:54.026+0000 7ff965f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:54.381 INFO:tasks.workunit.client.0.smithi073.stderr: -197> 2024-09-12T00:51:54.026+0000 7ff965f26800 1 librados: starting msgr at 2024-09-12T00:51:54.381 INFO:tasks.workunit.client.0.smithi073.stderr: -196> 2024-09-12T00:51:54.026+0000 7ff965f26800 1 librados: starting objecter 2024-09-12T00:51:54.381 INFO:tasks.workunit.client.0.smithi073.stderr: -195> 2024-09-12T00:51:54.026+0000 7ff965f26800 5 asok(0x56402749b630) register_command objecter_requests cmddesc objecter_requests hook 0x564027780ca0 EEXIST 2024-09-12T00:51:54.381 INFO:tasks.workunit.client.0.smithi073.stderr: -194> 2024-09-12T00:51:54.026+0000 7ff965f26800 1 librados: setting wanted keys 2024-09-12T00:51:54.382 INFO:tasks.workunit.client.0.smithi073.stderr: -193> 2024-09-12T00:51:54.026+0000 7ff965f26800 1 librados: calling monclient init 2024-09-12T00:51:54.382 INFO:tasks.workunit.client.0.smithi073.stderr: -192> 2024-09-12T00:51:54.026+0000 7ff965f26800 10 monclient: init 2024-09-12T00:51:54.382 INFO:tasks.workunit.client.0.smithi073.stderr: -191> 2024-09-12T00:51:54.026+0000 7ff965f26800 5 AuthRegistry(0x56402774e220) adding auth protocol: cephx 2024-09-12T00:51:54.382 INFO:tasks.workunit.client.0.smithi073.stderr: -190> 2024-09-12T00:51:54.026+0000 7ff965f26800 5 AuthRegistry(0x56402774e220) adding auth protocol: cephx 2024-09-12T00:51:54.382 INFO:tasks.workunit.client.0.smithi073.stderr: -189> 2024-09-12T00:51:54.026+0000 7ff965f26800 5 AuthRegistry(0x56402774e220) adding auth protocol: cephx 2024-09-12T00:51:54.382 INFO:tasks.workunit.client.0.smithi073.stderr: -188> 2024-09-12T00:51:54.026+0000 7ff965f26800 5 AuthRegistry(0x56402774e220) adding con mode: secure 2024-09-12T00:51:54.382 INFO:tasks.workunit.client.0.smithi073.stderr: -187> 2024-09-12T00:51:54.027+0000 7ff965f26800 5 AuthRegistry(0x56402774e220) adding con mode: crc 2024-09-12T00:51:54.382 INFO:tasks.workunit.client.0.smithi073.stderr: -186> 2024-09-12T00:51:54.027+0000 7ff965f26800 5 AuthRegistry(0x56402774e220) adding con mode: secure 2024-09-12T00:51:54.382 INFO:tasks.workunit.client.0.smithi073.stderr: -185> 2024-09-12T00:51:54.027+0000 7ff965f26800 5 AuthRegistry(0x56402774e220) adding con mode: crc 2024-09-12T00:51:54.382 INFO:tasks.workunit.client.0.smithi073.stderr: -184> 2024-09-12T00:51:54.027+0000 7ff965f26800 5 AuthRegistry(0x56402774e220) adding con mode: secure 2024-09-12T00:51:54.382 INFO:tasks.workunit.client.0.smithi073.stderr: -183> 2024-09-12T00:51:54.027+0000 7ff965f26800 5 AuthRegistry(0x56402774e220) adding con mode: crc 2024-09-12T00:51:54.382 INFO:tasks.workunit.client.0.smithi073.stderr: -182> 2024-09-12T00:51:54.027+0000 7ff965f26800 5 AuthRegistry(0x56402774e220) adding con mode: crc 2024-09-12T00:51:54.382 INFO:tasks.workunit.client.0.smithi073.stderr: -181> 2024-09-12T00:51:54.027+0000 7ff965f26800 5 AuthRegistry(0x56402774e220) adding con mode: secure 2024-09-12T00:51:54.383 INFO:tasks.workunit.client.0.smithi073.stderr: -180> 2024-09-12T00:51:54.027+0000 7ff965f26800 5 AuthRegistry(0x56402774e220) adding con mode: crc 2024-09-12T00:51:54.383 INFO:tasks.workunit.client.0.smithi073.stderr: -179> 2024-09-12T00:51:54.027+0000 7ff965f26800 5 AuthRegistry(0x56402774e220) adding con mode: secure 2024-09-12T00:51:54.383 INFO:tasks.workunit.client.0.smithi073.stderr: -178> 2024-09-12T00:51:54.027+0000 7ff965f26800 5 AuthRegistry(0x56402774e220) adding con mode: crc 2024-09-12T00:51:54.383 INFO:tasks.workunit.client.0.smithi073.stderr: -177> 2024-09-12T00:51:54.027+0000 7ff965f26800 5 AuthRegistry(0x56402774e220) adding con mode: secure 2024-09-12T00:51:54.383 INFO:tasks.workunit.client.0.smithi073.stderr: -176> 2024-09-12T00:51:54.027+0000 7ff965f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:54.383 INFO:tasks.workunit.client.0.smithi073.stderr: -175> 2024-09-12T00:51:54.027+0000 7ff965f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:54.383 INFO:tasks.workunit.client.0.smithi073.stderr: -174> 2024-09-12T00:51:54.027+0000 7ff965f26800 5 asok(0x56402749b630) register_command rotate-key cmddesc rotate-key hook 0x56402774e368 EEXIST 2024-09-12T00:51:54.383 INFO:tasks.workunit.client.0.smithi073.stderr: -173> 2024-09-12T00:51:54.027+0000 7ff965f26800 10 monclient: _reopen_session rank -1 2024-09-12T00:51:54.383 INFO:tasks.workunit.client.0.smithi073.stderr: -172> 2024-09-12T00:51:54.027+0000 7ff965f26800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:51:54.383 INFO:tasks.workunit.client.0.smithi073.stderr: -171> 2024-09-12T00:51:54.027+0000 7ff965f26800 10 monclient(hunting): picked mon.noname-b con 0x56402777e760 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:51:54.383 INFO:tasks.workunit.client.0.smithi073.stderr: -170> 2024-09-12T00:51:54.027+0000 7ff965f26800 10 monclient(hunting): picked mon.noname-a con 0x564027789240 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:51:54.383 INFO:tasks.workunit.client.0.smithi073.stderr: -169> 2024-09-12T00:51:54.027+0000 7ff965f26800 10 monclient(hunting): picked mon.noname-c con 0x56402778de10 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:51:54.383 INFO:tasks.workunit.client.0.smithi073.stderr: -168> 2024-09-12T00:51:54.027+0000 7ff965f26800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:54.384 INFO:tasks.workunit.client.0.smithi073.stderr: -167> 2024-09-12T00:51:54.027+0000 7ff965f26800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:54.384 INFO:tasks.workunit.client.0.smithi073.stderr: -166> 2024-09-12T00:51:54.027+0000 7ff965f26800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:54.384 INFO:tasks.workunit.client.0.smithi073.stderr: -165> 2024-09-12T00:51:54.027+0000 7ff965f26800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:54.384 INFO:tasks.workunit.client.0.smithi073.stderr: -164> 2024-09-12T00:51:54.027+0000 7ff965f26800 10 monclient(hunting): authenticate will time out at 2174.698507s 2024-09-12T00:51:54.384 INFO:tasks.workunit.client.0.smithi073.stderr: -163> 2024-09-12T00:51:54.027+0000 7ff9613d8640 10 monclient(hunting): get_auth_request con 0x564027789240 auth_method 0 2024-09-12T00:51:54.384 INFO:tasks.workunit.client.0.smithi073.stderr: -162> 2024-09-12T00:51:54.027+0000 7ff9613d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:54.384 INFO:tasks.workunit.client.0.smithi073.stderr: -161> 2024-09-12T00:51:54.027+0000 7ff9613d8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:54.384 INFO:tasks.workunit.client.0.smithi073.stderr: -160> 2024-09-12T00:51:54.027+0000 7ff9613d8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:54.384 INFO:tasks.workunit.client.0.smithi073.stderr: -159> 2024-09-12T00:51:54.027+0000 7ff9623da640 10 monclient(hunting): get_auth_request con 0x56402778de10 auth_method 0 2024-09-12T00:51:54.384 INFO:tasks.workunit.client.0.smithi073.stderr: -158> 2024-09-12T00:51:54.027+0000 7ff9623da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:54.384 INFO:tasks.workunit.client.0.smithi073.stderr: -157> 2024-09-12T00:51:54.027+0000 7ff9623da640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:54.385 INFO:tasks.workunit.client.0.smithi073.stderr: -156> 2024-09-12T00:51:54.027+0000 7ff9623da640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:54.385 INFO:tasks.workunit.client.0.smithi073.stderr: -155> 2024-09-12T00:51:54.027+0000 7ff9613d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:54.385 INFO:tasks.workunit.client.0.smithi073.stderr: -154> 2024-09-12T00:51:54.027+0000 7ff9613d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:54.385 INFO:tasks.workunit.client.0.smithi073.stderr: -153> 2024-09-12T00:51:54.027+0000 7ff9613d8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:54.385 INFO:tasks.workunit.client.0.smithi073.stderr: -152> 2024-09-12T00:51:54.027+0000 7ff9623da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:54.385 INFO:tasks.workunit.client.0.smithi073.stderr: -151> 2024-09-12T00:51:54.027+0000 7ff9623da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:54.385 INFO:tasks.workunit.client.0.smithi073.stderr: -150> 2024-09-12T00:51:54.027+0000 7ff9623da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:54.385 INFO:tasks.workunit.client.0.smithi073.stderr: -149> 2024-09-12T00:51:54.027+0000 7ff961bd9640 10 monclient(hunting): get_auth_request con 0x56402777e760 auth_method 0 2024-09-12T00:51:54.385 INFO:tasks.workunit.client.0.smithi073.stderr: -148> 2024-09-12T00:51:54.027+0000 7ff961bd9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:54.385 INFO:tasks.workunit.client.0.smithi073.stderr: -147> 2024-09-12T00:51:54.027+0000 7ff961bd9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:54.385 INFO:tasks.workunit.client.0.smithi073.stderr: -146> 2024-09-12T00:51:54.027+0000 7ff961bd9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:54.385 INFO:tasks.workunit.client.0.smithi073.stderr: -145> 2024-09-12T00:51:54.027+0000 7ff9613d8640 10 monclient(hunting): handle_auth_done global_id 7551 payload 824 2024-09-12T00:51:54.385 INFO:tasks.workunit.client.0.smithi073.stderr: -144> 2024-09-12T00:51:54.027+0000 7ff9613d8640 10 monclient: _finish_hunting 0 2024-09-12T00:51:54.386 INFO:tasks.workunit.client.0.smithi073.stderr: -143> 2024-09-12T00:51:54.027+0000 7ff9613d8640 1 monclient: found mon.noname-a 2024-09-12T00:51:54.386 INFO:tasks.workunit.client.0.smithi073.stderr: -142> 2024-09-12T00:51:54.027+0000 7ff9613d8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:51:54.386 INFO:tasks.workunit.client.0.smithi073.stderr: -141> 2024-09-12T00:51:54.028+0000 7ff8337fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:54.386 INFO:tasks.workunit.client.0.smithi073.stderr: -140> 2024-09-12T00:51:54.028+0000 7ff8337fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:51:54.386 INFO:tasks.workunit.client.0.smithi073.stderr: -139> 2024-09-12T00:51:54.028+0000 7ff8337fe640 10 monclient: dump: 2024-09-12T00:51:54.386 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:51:54.386 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:51:54.386 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:54.386 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:54.386 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:54.386 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:51:54.386 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:51:54.386 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:51:54.386 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:51:54.387 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:54.387 INFO:tasks.workunit.client.0.smithi073.stderr: -138> 2024-09-12T00:51:54.028+0000 7ff8337fe640 10 monclient: _finish_auth 0 2024-09-12T00:51:54.387 INFO:tasks.workunit.client.0.smithi073.stderr: -137> 2024-09-12T00:51:54.028+0000 7ff8337fe640 10 monclient: _check_auth_tickets 2024-09-12T00:51:54.387 INFO:tasks.workunit.client.0.smithi073.stderr: -136> 2024-09-12T00:51:54.028+0000 7ff8337fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:54.387 INFO:tasks.workunit.client.0.smithi073.stderr: -135> 2024-09-12T00:51:54.028+0000 7ff8337fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:54.387 INFO:tasks.workunit.client.0.smithi073.stderr: -134> 2024-09-12T00:51:54.028+0000 7ff8337fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:51:54.387 INFO:tasks.workunit.client.0.smithi073.stderr: -133> 2024-09-12T00:51:54.028+0000 7ff8337fe640 10 monclient: dump: 2024-09-12T00:51:54.387 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:51:54.387 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:51:54.387 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:54.387 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:51:54.387 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:54.387 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:51:54.388 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:51:54.388 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:51:54.388 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:51:54.388 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:54.388 INFO:tasks.workunit.client.0.smithi073.stderr: -132> 2024-09-12T00:51:54.028+0000 7ff965f26800 5 monclient: authenticate success, global_id 7551 2024-09-12T00:51:54.388 INFO:tasks.workunit.client.0.smithi073.stderr: -131> 2024-09-12T00:51:54.028+0000 7ff965f26800 10 monclient: _renew_subs 2024-09-12T00:51:54.388 INFO:tasks.workunit.client.0.smithi073.stderr: -130> 2024-09-12T00:51:54.028+0000 7ff8457fa640 4 set_mon_vals no callback set 2024-09-12T00:51:54.388 INFO:tasks.workunit.client.0.smithi073.stderr: -129> 2024-09-12T00:51:54.028+0000 7ff965f26800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:51:54.388 INFO:tasks.workunit.client.0.smithi073.stderr: -128> 2024-09-12T00:51:54.028+0000 7ff965f26800 10 monclient: _renew_subs 2024-09-12T00:51:54.388 INFO:tasks.workunit.client.0.smithi073.stderr: -127> 2024-09-12T00:51:54.028+0000 7ff965f26800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:51:54.388 INFO:tasks.workunit.client.0.smithi073.stderr: -126> 2024-09-12T00:51:54.028+0000 7ff965f26800 1 librados: init done 2024-09-12T00:51:54.388 INFO:tasks.workunit.client.0.smithi073.stderr: -125> 2024-09-12T00:51:54.028+0000 7ff965f26800 5 asok(0x56402749b630) register_command cr dump hook 0x564027782538 2024-09-12T00:51:54.388 INFO:tasks.workunit.client.0.smithi073.stderr: -124> 2024-09-12T00:51:54.029+0000 7ff965f26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.389 INFO:tasks.workunit.client.0.smithi073.stderr: -123> 2024-09-12T00:51:54.030+0000 7ff8337fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:51:54.389 INFO:tasks.workunit.client.0.smithi073.stderr: -122> 2024-09-12T00:51:54.030+0000 7ff8337fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:51:54.389 INFO:tasks.workunit.client.0.smithi073.stderr: -121> 2024-09-12T00:51:54.030+0000 7ff8337fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:51:54.389 INFO:tasks.workunit.client.0.smithi073.stderr: -120> 2024-09-12T00:51:54.030+0000 7ff961bd9640 10 monclient: get_auth_request con 0x7ff82c076470 auth_method 0 2024-09-12T00:51:54.389 INFO:tasks.workunit.client.0.smithi073.stderr: -119> 2024-09-12T00:51:54.030+0000 7ff9623da640 10 monclient: get_auth_request con 0x5640277a7d50 auth_method 0 2024-09-12T00:51:54.389 INFO:tasks.workunit.client.0.smithi073.stderr: -118> 2024-09-12T00:51:54.031+0000 7ff965f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:54.389 INFO:tasks.workunit.client.0.smithi073.stderr: -117> 2024-09-12T00:51:54.031+0000 7ff965f26800 20 realm 2024-09-12T00:51:54.389 INFO:tasks.workunit.client.0.smithi073.stderr: -116> 2024-09-12T00:51:54.031+0000 7ff965f26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.389 INFO:tasks.workunit.client.0.smithi073.stderr: -115> 2024-09-12T00:51:54.031+0000 7ff965f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:54.389 INFO:tasks.workunit.client.0.smithi073.stderr: -114> 2024-09-12T00:51:54.031+0000 7ff965f26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:54.389 INFO:tasks.workunit.client.0.smithi073.stderr: -113> 2024-09-12T00:51:54.031+0000 7ff965f26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.389 INFO:tasks.workunit.client.0.smithi073.stderr: -112> 2024-09-12T00:51:54.031+0000 7ff965f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:54.389 INFO:tasks.workunit.client.0.smithi073.stderr: -111> 2024-09-12T00:51:54.031+0000 7ff965f26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.390 INFO:tasks.workunit.client.0.smithi073.stderr: -110> 2024-09-12T00:51:54.031+0000 7ff961bd9640 10 monclient: get_auth_request con 0x5640277ac010 auth_method 0 2024-09-12T00:51:54.390 INFO:tasks.workunit.client.0.smithi073.stderr: -109> 2024-09-12T00:51:54.032+0000 7ff965f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:54.390 INFO:tasks.workunit.client.0.smithi073.stderr: -108> 2024-09-12T00:51:54.032+0000 7ff965f26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.390 INFO:tasks.workunit.client.0.smithi073.stderr: -107> 2024-09-12T00:51:54.032+0000 7ff9613d8640 10 monclient: get_auth_request con 0x5640277af870 auth_method 0 2024-09-12T00:51:54.390 INFO:tasks.workunit.client.0.smithi073.stderr: -106> 2024-09-12T00:51:54.032+0000 7ff965f26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:54.390 INFO:tasks.workunit.client.0.smithi073.stderr: -105> 2024-09-12T00:51:54.032+0000 7ff965f26800 20 searching for the correct realm 2024-09-12T00:51:54.390 INFO:tasks.workunit.client.0.smithi073.stderr: -104> 2024-09-12T00:51:54.033+0000 7ff9623da640 10 monclient: get_auth_request con 0x5640277b45f0 auth_method 0 2024-09-12T00:51:54.390 INFO:tasks.workunit.client.0.smithi073.stderr: -103> 2024-09-12T00:51:54.033+0000 7ff961bd9640 10 monclient: get_auth_request con 0x7ff95c0aec20 auth_method 0 2024-09-12T00:51:54.390 INFO:tasks.workunit.client.0.smithi073.stderr: -102> 2024-09-12T00:51:54.034+0000 7ff9613d8640 10 monclient: get_auth_request con 0x7ff954043400 auth_method 0 2024-09-12T00:51:54.390 INFO:tasks.workunit.client.0.smithi073.stderr: -101> 2024-09-12T00:51:54.035+0000 7ff9623da640 0 -- 172.21.15.73:0/2312579535 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7ff958082f50 msgr2=0x7ff958060c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:51:54.390 INFO:tasks.workunit.client.0.smithi073.stderr: -100> 2024-09-12T00:51:54.236+0000 7ff9623da640 10 monclient: get_auth_request con 0x7ff958082f50 auth_method 0 2024-09-12T00:51:54.390 INFO:tasks.workunit.client.0.smithi073.stderr: -99> 2024-09-12T00:51:54.239+0000 7ff961bd9640 10 monclient: get_auth_request con 0x7ff95c0b2020 auth_method 0 2024-09-12T00:51:54.390 INFO:tasks.workunit.client.0.smithi073.stderr: -98> 2024-09-12T00:51:54.239+0000 7ff9623da640 0 -- 172.21.15.73:0/2312579535 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7ff958082f50 msgr2=0x7ff958060c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:54.390 INFO:tasks.workunit.client.0.smithi073.stderr: -97> 2024-09-12T00:51:54.239+0000 7ff8337fe640 1 client.7551.objecter ms_handle_reset 0x7ff958082f50 session 0x7ff9580824c0 osd.4 2024-09-12T00:51:54.391 INFO:tasks.workunit.client.0.smithi073.stderr: -96> 2024-09-12T00:51:54.239+0000 7ff8337fe640 10 monclient: _renew_subs 2024-09-12T00:51:54.391 INFO:tasks.workunit.client.0.smithi073.stderr: -95> 2024-09-12T00:51:54.239+0000 7ff8337fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:51:54.391 INFO:tasks.workunit.client.0.smithi073.stderr: -94> 2024-09-12T00:51:54.240+0000 7ff9623da640 10 monclient: get_auth_request con 0x7ff82c086310 auth_method 0 2024-09-12T00:51:54.391 INFO:tasks.workunit.client.0.smithi073.stderr: -93> 2024-09-12T00:51:54.243+0000 7ff965f26800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:51:54.391 INFO:tasks.workunit.client.0.smithi073.stderr: -92> 2024-09-12T00:51:54.243+0000 7ff965f26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:54.391 INFO:tasks.workunit.client.0.smithi073.stderr: -91> 2024-09-12T00:51:54.243+0000 7ff965f26800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:51:54.391 INFO:tasks.workunit.client.0.smithi073.stderr: -90> 2024-09-12T00:51:54.243+0000 7ff965f26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:54.391 INFO:tasks.workunit.client.0.smithi073.stderr: -89> 2024-09-12T00:51:54.243+0000 7ff965f26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:54.391 INFO:tasks.workunit.client.0.smithi073.stderr: -88> 2024-09-12T00:51:54.243+0000 7ff965f26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:54.391 INFO:tasks.workunit.client.0.smithi073.stderr: -87> 2024-09-12T00:51:54.243+0000 7ff965f26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.391 INFO:tasks.workunit.client.0.smithi073.stderr: -86> 2024-09-12T00:51:54.243+0000 7ff965f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:54.391 INFO:tasks.workunit.client.0.smithi073.stderr: -85> 2024-09-12T00:51:54.243+0000 7ff965f26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.392 INFO:tasks.workunit.client.0.smithi073.stderr: -84> 2024-09-12T00:51:54.244+0000 7ff965f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:54.392 INFO:tasks.workunit.client.0.smithi073.stderr: -83> 2024-09-12T00:51:54.244+0000 7ff965f26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.392 INFO:tasks.workunit.client.0.smithi073.stderr: -82> 2024-09-12T00:51:54.244+0000 7ff965f26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:54.392 INFO:tasks.workunit.client.0.smithi073.stderr: -81> 2024-09-12T00:51:54.244+0000 7ff965f26800 20 zone default found 2024-09-12T00:51:54.392 INFO:tasks.workunit.client.0.smithi073.stderr: -80> 2024-09-12T00:51:54.244+0000 7ff965f26800 4 Realm: () 2024-09-12T00:51:54.392 INFO:tasks.workunit.client.0.smithi073.stderr: -79> 2024-09-12T00:51:54.244+0000 7ff965f26800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:51:54.392 INFO:tasks.workunit.client.0.smithi073.stderr: -78> 2024-09-12T00:51:54.244+0000 7ff965f26800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:51:54.392 INFO:tasks.workunit.client.0.smithi073.stderr: -77> 2024-09-12T00:51:54.244+0000 7ff965f26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:54.392 INFO:tasks.workunit.client.0.smithi073.stderr: -76> 2024-09-12T00:51:54.244+0000 7ff965f26800 20 zonegroup default 2024-09-12T00:51:54.392 INFO:tasks.workunit.client.0.smithi073.stderr: -75> 2024-09-12T00:51:54.244+0000 7ff965f26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.392 INFO:tasks.workunit.client.0.smithi073.stderr: -74> 2024-09-12T00:51:54.244+0000 7ff965f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:54.392 INFO:tasks.workunit.client.0.smithi073.stderr: -73> 2024-09-12T00:51:54.244+0000 7ff965f26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.392 INFO:tasks.workunit.client.0.smithi073.stderr: -72> 2024-09-12T00:51:54.244+0000 7ff965f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:54.393 INFO:tasks.workunit.client.0.smithi073.stderr: -71> 2024-09-12T00:51:54.244+0000 7ff965f26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.393 INFO:tasks.workunit.client.0.smithi073.stderr: -70> 2024-09-12T00:51:54.245+0000 7ff965f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:54.393 INFO:tasks.workunit.client.0.smithi073.stderr: -69> 2024-09-12T00:51:54.245+0000 7ff965f26800 20 started sync module instance, tier type = 2024-09-12T00:51:54.393 INFO:tasks.workunit.client.0.smithi073.stderr: -68> 2024-09-12T00:51:54.245+0000 7ff965f26800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:51:54.393 INFO:tasks.workunit.client.0.smithi073.stderr: -67> 2024-09-12T00:51:54.253+0000 7ff965f26800 20 add_watcher() i=0 2024-09-12T00:51:54.393 INFO:tasks.workunit.client.0.smithi073.stderr: -66> 2024-09-12T00:51:54.253+0000 7ff965f26800 20 add_watcher() i=1 2024-09-12T00:51:54.393 INFO:tasks.workunit.client.0.smithi073.stderr: -65> 2024-09-12T00:51:54.253+0000 7ff965f26800 20 add_watcher() i=2 2024-09-12T00:51:54.393 INFO:tasks.workunit.client.0.smithi073.stderr: -64> 2024-09-12T00:51:54.253+0000 7ff965f26800 20 add_watcher() i=3 2024-09-12T00:51:54.393 INFO:tasks.workunit.client.0.smithi073.stderr: -63> 2024-09-12T00:51:54.253+0000 7ff965f26800 20 add_watcher() i=4 2024-09-12T00:51:54.393 INFO:tasks.workunit.client.0.smithi073.stderr: -62> 2024-09-12T00:51:54.253+0000 7ff965f26800 20 add_watcher() i=5 2024-09-12T00:51:54.393 INFO:tasks.workunit.client.0.smithi073.stderr: -61> 2024-09-12T00:51:54.253+0000 7ff965f26800 20 add_watcher() i=6 2024-09-12T00:51:54.393 INFO:tasks.workunit.client.0.smithi073.stderr: -60> 2024-09-12T00:51:54.254+0000 7ff965f26800 20 add_watcher() i=7 2024-09-12T00:51:54.393 INFO:tasks.workunit.client.0.smithi073.stderr: -59> 2024-09-12T00:51:54.254+0000 7ff965f26800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:54.394 INFO:tasks.workunit.client.0.smithi073.stderr: -58> 2024-09-12T00:51:54.256+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f720) adding auth protocol: cephx 2024-09-12T00:51:54.394 INFO:tasks.workunit.client.0.smithi073.stderr: -57> 2024-09-12T00:51:54.256+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f720) adding auth protocol: cephx 2024-09-12T00:51:54.394 INFO:tasks.workunit.client.0.smithi073.stderr: -56> 2024-09-12T00:51:54.256+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f720) adding auth protocol: cephx 2024-09-12T00:51:54.394 INFO:tasks.workunit.client.0.smithi073.stderr: -55> 2024-09-12T00:51:54.256+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f720) adding con mode: secure 2024-09-12T00:51:54.394 INFO:tasks.workunit.client.0.smithi073.stderr: -54> 2024-09-12T00:51:54.256+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f720) adding con mode: crc 2024-09-12T00:51:54.394 INFO:tasks.workunit.client.0.smithi073.stderr: -53> 2024-09-12T00:51:54.256+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f720) adding con mode: secure 2024-09-12T00:51:54.394 INFO:tasks.workunit.client.0.smithi073.stderr: -52> 2024-09-12T00:51:54.256+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f720) adding con mode: crc 2024-09-12T00:51:54.394 INFO:tasks.workunit.client.0.smithi073.stderr: -51> 2024-09-12T00:51:54.256+0000 7ff813fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:54.394 INFO:tasks.workunit.client.0.smithi073.stderr: -50> 2024-09-12T00:51:54.256+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f720) adding con mode: secure 2024-09-12T00:51:54.394 INFO:tasks.workunit.client.0.smithi073.stderr: -49> 2024-09-12T00:51:54.256+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f720) adding con mode: crc 2024-09-12T00:51:54.394 INFO:tasks.workunit.client.0.smithi073.stderr: -48> 2024-09-12T00:51:54.256+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f720) adding con mode: crc 2024-09-12T00:51:54.394 INFO:tasks.workunit.client.0.smithi073.stderr: -47> 2024-09-12T00:51:54.256+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f720) adding con mode: secure 2024-09-12T00:51:54.394 INFO:tasks.workunit.client.0.smithi073.stderr: -46> 2024-09-12T00:51:54.256+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f720) adding con mode: crc 2024-09-12T00:51:54.395 INFO:tasks.workunit.client.0.smithi073.stderr: -45> 2024-09-12T00:51:54.256+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f720) adding con mode: secure 2024-09-12T00:51:54.395 INFO:tasks.workunit.client.0.smithi073.stderr: -44> 2024-09-12T00:51:54.256+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f720) adding con mode: crc 2024-09-12T00:51:54.395 INFO:tasks.workunit.client.0.smithi073.stderr: -43> 2024-09-12T00:51:54.256+0000 7ff965f26800 5 AuthRegistry(0x7ffe3617f720) adding con mode: secure 2024-09-12T00:51:54.395 INFO:tasks.workunit.client.0.smithi073.stderr: -42> 2024-09-12T00:51:54.256+0000 7ff965f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:54.395 INFO:tasks.workunit.client.0.smithi073.stderr: -41> 2024-09-12T00:51:54.256+0000 7ff965f26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:54.395 INFO:tasks.workunit.client.0.smithi073.stderr: -40> 2024-09-12T00:51:54.256+0000 7ff965f26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:54.395 INFO:tasks.workunit.client.0.smithi073.stderr: -39> 2024-09-12T00:51:54.256+0000 7ff965f26800 5 asok(0x56402749b630) register_command cache list hook 0x564027786af0 2024-09-12T00:51:54.395 INFO:tasks.workunit.client.0.smithi073.stderr: -38> 2024-09-12T00:51:54.256+0000 7ff965f26800 5 asok(0x56402749b630) register_command cache inspect hook 0x564027786af0 2024-09-12T00:51:54.395 INFO:tasks.workunit.client.0.smithi073.stderr: -37> 2024-09-12T00:51:54.256+0000 7ff965f26800 5 asok(0x56402749b630) register_command cache erase hook 0x564027786af0 2024-09-12T00:51:54.395 INFO:tasks.workunit.client.0.smithi073.stderr: -36> 2024-09-12T00:51:54.256+0000 7ff965f26800 5 asok(0x56402749b630) register_command cache zap hook 0x564027786af0 2024-09-12T00:51:54.395 INFO:tasks.workunit.client.0.smithi073.stderr: -35> 2024-09-12T00:51:54.256+0000 7ff965f26800 5 note: GC not initialized 2024-09-12T00:51:54.395 INFO:tasks.workunit.client.0.smithi073.stderr: -34> 2024-09-12T00:51:54.257+0000 7ff812ffd640 20 reqs_thread_entry: start 2024-09-12T00:51:54.395 INFO:tasks.workunit.client.0.smithi073.stderr: -33> 2024-09-12T00:51:54.257+0000 7ff965f26800 5 asok(0x56402749b630) register_command sync trace show hook 0x7ff95400fdf0 2024-09-12T00:51:54.395 INFO:tasks.workunit.client.0.smithi073.stderr: -32> 2024-09-12T00:51:54.257+0000 7ff965f26800 5 asok(0x56402749b630) register_command sync trace history hook 0x7ff95400fdf0 2024-09-12T00:51:54.396 INFO:tasks.workunit.client.0.smithi073.stderr: -31> 2024-09-12T00:51:54.257+0000 7ff965f26800 5 asok(0x56402749b630) register_command sync trace active hook 0x7ff95400fdf0 2024-09-12T00:51:54.396 INFO:tasks.workunit.client.0.smithi073.stderr: -30> 2024-09-12T00:51:54.257+0000 7ff965f26800 5 asok(0x56402749b630) register_command sync trace active_short hook 0x7ff95400fdf0 2024-09-12T00:51:54.396 INFO:tasks.workunit.client.0.smithi073.stderr: -29> 2024-09-12T00:51:54.257+0000 7ff965f26800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:54.396 INFO:tasks.workunit.client.0.smithi073.stderr: -28> 2024-09-12T00:51:54.257+0000 7ff965f26800 20 Filter name: none 2024-09-12T00:51:54.396 INFO:tasks.workunit.client.0.smithi073.stderr: -27> 2024-09-12T00:51:54.257+0000 7ff810ff9640 20 reqs_thread_entry: start 2024-09-12T00:51:54.396 INFO:tasks.workunit.client.0.smithi073.stderr: -26> 2024-09-12T00:51:54.257+0000 7ff965f26800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:51:54.396 INFO:tasks.workunit.client.0.smithi073.stderr: -25> 2024-09-12T00:51:54.257+0000 7ff965f26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.396 INFO:tasks.workunit.client.0.smithi073.stderr: -24> 2024-09-12T00:51:54.257+0000 7ff965f26800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:51:54.396 INFO:tasks.workunit.client.0.smithi073.stderr: -23> 2024-09-12T00:51:54.257+0000 7ff965f26800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:51:54.396 INFO:tasks.workunit.client.0.smithi073.stderr: -22> 2024-09-12T00:51:54.257+0000 7ff965f26800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:51:54.396 INFO:tasks.workunit.client.0.smithi073.stderr: -21> 2024-09-12T00:51:54.257+0000 7ff965f26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34 : miss 2024-09-12T00:51:54.396 INFO:tasks.workunit.client.0.smithi073.stderr: -20> 2024-09-12T00:51:54.257+0000 7ff965f26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.396 INFO:tasks.workunit.client.0.smithi073.stderr: -19> 2024-09-12T00:51:54.258+0000 7ff965f26800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:51:54.396 INFO:tasks.workunit.client.0.smithi073.stderr: -18> 2024-09-12T00:51:54.258+0000 7ff965f26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34 info.flags=0x17 2024-09-12T00:51:54.397 INFO:tasks.workunit.client.0.smithi073.stderr: -17> 2024-09-12T00:51:54.258+0000 7ff965f26800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34 to cache LRU end 2024-09-12T00:51:54.397 INFO:tasks.workunit.client.0.smithi073.stderr: -16> 2024-09-12T00:51:54.258+0000 7ff965f26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:51:54.397 INFO:tasks.workunit.client.0.smithi073.stderr: -15> 2024-09-12T00:51:54.258+0000 7ff965f26800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:54.397 INFO:tasks.workunit.client.0.smithi073.stderr: -14> 2024-09-12T00:51:54.258+0000 7ff965f26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34 2024-09-12T00:51:54.397 INFO:tasks.workunit.client.0.smithi073.stderr: -13> 2024-09-12T00:51:54.261+0000 7ff965f26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34 info.flags=0x17 2024-09-12T00:51:54.397 INFO:tasks.workunit.client.0.smithi073.stderr: -12> 2024-09-12T00:51:54.261+0000 7ff965f26800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34 to cache LRU end 2024-09-12T00:51:54.397 INFO:tasks.workunit.client.0.smithi073.stderr: -11> 2024-09-12T00:51:54.261+0000 7ff965f26800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:54.397 INFO:tasks.workunit.client.0.smithi073.stderr: -10> 2024-09-12T00:51:54.261+0000 7ff965f26800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34, ofs0, ns] 2024-09-12T00:51:54.397 INFO:tasks.workunit.client.0.smithi073.stderr: -9> 2024-09-12T00:51:54.261+0000 7ff844ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497020 cookie 94833540308976 notifier 7551 bl.length()=911 2024-09-12T00:51:54.397 INFO:tasks.workunit.client.0.smithi073.stderr: -8> 2024-09-12T00:51:54.262+0000 7ff844ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34 info.flags=0x17 2024-09-12T00:51:54.397 INFO:tasks.workunit.client.0.smithi073.stderr: -7> 2024-09-12T00:51:54.262+0000 7ff844ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34 to cache LRU end 2024-09-12T00:51:54.397 INFO:tasks.workunit.client.0.smithi073.stderr: -6> 2024-09-12T00:51:54.262+0000 7ff844ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:54.397 INFO:tasks.workunit.client.0.smithi073.stderr: -5> 2024-09-12T00:51:54.263+0000 7ff965f26800 20 handle_bi_update(): bucket=:abort-at-do-reshard[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34]): orig_sources= new_sources= 2024-09-12T00:51:54.398 INFO:tasks.workunit.client.0.smithi073.stderr: -4> 2024-09-12T00:51:54.263+0000 7ff965f26800 20 handle_bi_update(): bucket=:abort-at-do-reshard[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34]): potential sources added=[] removed=[] 2024-09-12T00:51:54.398 INFO:tasks.workunit.client.0.smithi073.stderr: -3> 2024-09-12T00:51:54.263+0000 7ff965f26800 20 handle_bi_update(): bucket=:abort-at-do-reshard[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34]): orig_dests= new_dests= 2024-09-12T00:51:54.398 INFO:tasks.workunit.client.0.smithi073.stderr: -2> 2024-09-12T00:51:54.263+0000 7ff965f26800 20 handle_bi_update(): bucket=:abort-at-do-reshard[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34]): potential dests added=[] removed=[] 2024-09-12T00:51:54.398 INFO:tasks.workunit.client.0.smithi073.stderr: -1> 2024-09-12T00:51:54.266+0000 7ff965f26800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff965f26800 time 2024-09-12T00:51:54.267545+0000 2024-09-12T00:51:54.398 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:51:54.398 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:54.398 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:54.398 INFO:tasks.workunit.client.0.smithi073.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff96758c71a] 2024-09-12T00:51:54.398 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff96758c8d8] 2024-09-12T00:51:54.398 INFO:tasks.workunit.client.0.smithi073.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564026a00641] 2024-09-12T00:51:54.398 INFO:tasks.workunit.client.0.smithi073.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564026a1038a] 2024-09-12T00:51:54.398 INFO:tasks.workunit.client.0.smithi073.stderr: 5: main() 2024-09-12T00:51:54.398 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7ff966229590] 2024-09-12T00:51:54.398 INFO:tasks.workunit.client.0.smithi073.stderr: 7: __libc_start_main() 2024-09-12T00:51:54.399 INFO:tasks.workunit.client.0.smithi073.stderr: 8: _start() 2024-09-12T00:51:54.399 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:54.399 INFO:tasks.workunit.client.0.smithi073.stderr: 0> 2024-09-12T00:51:54.267+0000 7ff965f26800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:51:54.399 INFO:tasks.workunit.client.0.smithi073.stderr: in thread 7ff965f26800 thread_name:radosgw-admin 2024-09-12T00:51:54.399 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:54.399 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:54.399 INFO:tasks.workunit.client.0.smithi073.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff96623e6f0] 2024-09-12T00:51:54.399 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff96628b99c] 2024-09-12T00:51:54.399 INFO:tasks.workunit.client.0.smithi073.stderr: 3: raise() 2024-09-12T00:51:54.399 INFO:tasks.workunit.client.0.smithi073.stderr: 4: abort() 2024-09-12T00:51:54.399 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff96758c774] 2024-09-12T00:51:54.399 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff96758c8d8] 2024-09-12T00:51:54.399 INFO:tasks.workunit.client.0.smithi073.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564026a00641] 2024-09-12T00:51:54.400 INFO:tasks.workunit.client.0.smithi073.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564026a1038a] 2024-09-12T00:51:54.400 INFO:tasks.workunit.client.0.smithi073.stderr: 9: main() 2024-09-12T00:51:54.400 INFO:tasks.workunit.client.0.smithi073.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7ff966229590] 2024-09-12T00:51:54.400 INFO:tasks.workunit.client.0.smithi073.stderr: 11: __libc_start_main() 2024-09-12T00:51:54.400 INFO:tasks.workunit.client.0.smithi073.stderr: 12: _start() 2024-09-12T00:51:54.400 INFO:tasks.workunit.client.0.smithi073.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:51:54.400 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:54.400 INFO:tasks.workunit.client.0.smithi073.stderr:--- logging levels --- 2024-09-12T00:51:54.400 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 none 2024-09-12T00:51:54.400 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 lockdep 2024-09-12T00:51:54.400 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 context 2024-09-12T00:51:54.400 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 crush 2024-09-12T00:51:54.400 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds 2024-09-12T00:51:54.401 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_balancer 2024-09-12T00:51:54.401 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_locker 2024-09-12T00:51:54.401 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_log 2024-09-12T00:51:54.401 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_log_expire 2024-09-12T00:51:54.401 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_migrator 2024-09-12T00:51:54.401 INFO:tasks.workunit.client.0.smithi073.stderr: 3/ 5 mds_quiesce 2024-09-12T00:51:54.401 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 buffer 2024-09-12T00:51:54.401 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 timer 2024-09-12T00:51:54.401 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 filer 2024-09-12T00:51:54.401 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 striper 2024-09-12T00:51:54.401 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 objecter 2024-09-12T00:51:54.401 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rados 2024-09-12T00:51:54.401 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd 2024-09-12T00:51:54.402 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_mirror 2024-09-12T00:51:54.402 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_replay 2024-09-12T00:51:54.402 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_pwl 2024-09-12T00:51:54.402 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 journaler 2024-09-12T00:51:54.402 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 objectcacher 2024-09-12T00:51:54.402 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:51:54.402 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 client 2024-09-12T00:51:54.402 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 osd 2024-09-12T00:51:54.402 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 optracker 2024-09-12T00:51:54.402 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 objclass 2024-09-12T00:51:54.402 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 filestore 2024-09-12T00:51:54.402 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 journal 2024-09-12T00:51:54.402 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 0 ms 2024-09-12T00:51:54.403 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mon 2024-09-12T00:51:54.403 INFO:tasks.workunit.client.0.smithi073.stderr: 0/10 monc 2024-09-12T00:51:54.403 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 paxos 2024-09-12T00:51:54.403 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 tp 2024-09-12T00:51:54.403 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 auth 2024-09-12T00:51:54.403 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 crypto 2024-09-12T00:51:54.403 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 finisher 2024-09-12T00:51:54.403 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 reserver 2024-09-12T00:51:54.403 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 heartbeatmap 2024-09-12T00:51:54.403 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 perfcounter 2024-09-12T00:51:54.403 INFO:tasks.workunit.client.0.smithi073.stderr: 20/20 rgw 2024-09-12T00:51:54.403 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_sync 2024-09-12T00:51:54.403 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_datacache 2024-09-12T00:51:54.403 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_access 2024-09-12T00:51:54.404 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:51:54.404 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_flight 2024-09-12T00:51:54.404 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:51:54.404 INFO:tasks.workunit.client.0.smithi073.stderr: 20/20 rgw_notification 2024-09-12T00:51:54.404 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 javaclient 2024-09-12T00:51:54.404 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 asok 2024-09-12T00:51:54.404 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 throttle 2024-09-12T00:51:54.404 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 0 refs 2024-09-12T00:51:54.404 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 compressor 2024-09-12T00:51:54.404 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 bluestore 2024-09-12T00:51:54.404 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 bluefs 2024-09-12T00:51:54.404 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 bdev 2024-09-12T00:51:54.404 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 kstore 2024-09-12T00:51:54.405 INFO:tasks.workunit.client.0.smithi073.stderr: 4/ 5 rocksdb 2024-09-12T00:51:54.405 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 fuse 2024-09-12T00:51:54.405 INFO:tasks.workunit.client.0.smithi073.stderr: 2/ 5 mgr 2024-09-12T00:51:54.405 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mgrc 2024-09-12T00:51:54.405 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 dpdk 2024-09-12T00:51:54.405 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 eventtrace 2024-09-12T00:51:54.405 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 prioritycache 2024-09-12T00:51:54.405 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 test 2024-09-12T00:51:54.405 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:51:54.405 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cephsqlite 2024-09-12T00:51:54.405 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:51:54.405 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore 2024-09-12T00:51:54.405 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_onode 2024-09-12T00:51:54.405 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_odata 2024-09-12T00:51:54.406 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_omap 2024-09-12T00:51:54.406 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_tm 2024-09-12T00:51:54.406 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_t 2024-09-12T00:51:54.406 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:51:54.406 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_epm 2024-09-12T00:51:54.406 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_lba 2024-09-12T00:51:54.406 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:51:54.406 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_cache 2024-09-12T00:51:54.406 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_journal 2024-09-12T00:51:54.406 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_device 2024-09-12T00:51:54.406 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_backref 2024-09-12T00:51:54.406 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 alienstore 2024-09-12T00:51:54.406 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mclock 2024-09-12T00:51:54.406 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cyanstore 2024-09-12T00:51:54.407 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 ceph_exporter 2024-09-12T00:51:54.407 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 memstore 2024-09-12T00:51:54.407 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 trace 2024-09-12T00:51:54.407 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 ceph_dedup 2024-09-12T00:51:54.407 INFO:tasks.workunit.client.0.smithi073.stderr: -2/-2 (syslog threshold) 2024-09-12T00:51:54.407 INFO:tasks.workunit.client.0.smithi073.stderr: 99/99 (stderr threshold) 2024-09-12T00:51:54.407 INFO:tasks.workunit.client.0.smithi073.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:51:54.407 INFO:tasks.workunit.client.0.smithi073.stderr: 7ff810ff9640 / http_manager 2024-09-12T00:51:54.407 INFO:tasks.workunit.client.0.smithi073.stderr: 7ff812ffd640 / http_manager 2024-09-12T00:51:54.407 INFO:tasks.workunit.client.0.smithi073.stderr: 7ff813fff640 / rgw_dt_lg_renew 2024-09-12T00:51:54.407 INFO:tasks.workunit.client.0.smithi073.stderr: 7ff8337fe640 / ms_dispatch 2024-09-12T00:51:54.407 INFO:tasks.workunit.client.0.smithi073.stderr: 7ff844ff9640 / io_context_pool 2024-09-12T00:51:54.407 INFO:tasks.workunit.client.0.smithi073.stderr: 7ff8457fa640 / io_context_pool 2024-09-12T00:51:54.407 INFO:tasks.workunit.client.0.smithi073.stderr: 7ff8477fe640 / ms_dispatch 2024-09-12T00:51:54.408 INFO:tasks.workunit.client.0.smithi073.stderr: 7ff84e604640 / ms_dispatch 2024-09-12T00:51:54.408 INFO:tasks.workunit.client.0.smithi073.stderr: 7ff84fe07640 / io_context_pool 2024-09-12T00:51:54.408 INFO:tasks.workunit.client.0.smithi073.stderr: 7ff9613d8640 / msgr-worker-2 2024-09-12T00:51:54.408 INFO:tasks.workunit.client.0.smithi073.stderr: 7ff961bd9640 / msgr-worker-1 2024-09-12T00:51:54.408 INFO:tasks.workunit.client.0.smithi073.stderr: 7ff9623da640 / msgr-worker-0 2024-09-12T00:51:54.408 INFO:tasks.workunit.client.0.smithi073.stderr: 7ff962bdb640 / io_context_pool 2024-09-12T00:51:54.408 INFO:tasks.workunit.client.0.smithi073.stderr: 7ff965f26800 / radosgw-admin 2024-09-12T00:51:54.408 INFO:tasks.workunit.client.0.smithi073.stderr: max_recent 500 2024-09-12T00:51:54.408 INFO:tasks.workunit.client.0.smithi073.stderr: max_new 1000 2024-09-12T00:51:54.408 INFO:tasks.workunit.client.0.smithi073.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:51:54.268924Z_bab8042d-d836-49e2-9735-a915924c126b/log 2024-09-12T00:51:54.408 INFO:tasks.workunit.client.0.smithi073.stderr:--- end dump of recent events --- 2024-09-12T00:51:54.408 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T00:51:54.410 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:54.410 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:54.410 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.341+0000 7f182591f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.410 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.343+0000 7f182591f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:54.410 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.343+0000 7f182591f800 20 realm 2024-09-12T00:51:54.410 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.343+0000 7f182591f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.411 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.343+0000 7f182591f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:54.411 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.343+0000 7f182591f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:54.411 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.343+0000 7f182591f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.411 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.343+0000 7f182591f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:54.411 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.343+0000 7f182591f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.411 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.344+0000 7f182591f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:54.411 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.344+0000 7f182591f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.411 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.345+0000 7f182591f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:54.411 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.345+0000 7f182591f800 20 searching for the correct realm 2024-09-12T00:51:54.411 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.347+0000 7f1821ea3640 0 -- 172.21.15.73:0/2420801436 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f180c083900 msgr2=0x7f180c0614e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:54.552 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.552+0000 7f1821ea3640 0 -- 172.21.15.73:0/2420801436 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f180c083900 msgr2=0x7f180c0614e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:54.555 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.555+0000 7f182591f800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:51:54.555 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.555+0000 7f182591f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:54.555 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.555+0000 7f182591f800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:51:54.556 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.555+0000 7f182591f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:54.556 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.555+0000 7f182591f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:54.556 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.555+0000 7f182591f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:54.556 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.555+0000 7f182591f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.556 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.556+0000 7f182591f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:54.556 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.556+0000 7f182591f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.557 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.556+0000 7f182591f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:54.557 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.556+0000 7f182591f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.557 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.556+0000 7f182591f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:54.557 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.556+0000 7f182591f800 20 zone default found 2024-09-12T00:51:54.557 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.556+0000 7f182591f800 4 Realm: () 2024-09-12T00:51:54.557 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.556+0000 7f182591f800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:51:54.557 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.556+0000 7f182591f800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:51:54.557 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.556+0000 7f182591f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:54.558 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.556+0000 7f182591f800 20 zonegroup default 2024-09-12T00:51:54.558 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.556+0000 7f182591f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.558 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.556+0000 7f182591f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:54.558 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.556+0000 7f182591f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.558 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.557+0000 7f182591f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:54.558 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.557+0000 7f182591f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.558 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.557+0000 7f182591f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:54.558 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.557+0000 7f182591f800 20 started sync module instance, tier type = 2024-09-12T00:51:54.558 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.557+0000 7f182591f800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:51:54.566 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.566+0000 7f182591f800 20 add_watcher() i=0 2024-09-12T00:51:54.566 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.566+0000 7f182591f800 20 add_watcher() i=1 2024-09-12T00:51:54.566 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.566+0000 7f182591f800 20 add_watcher() i=2 2024-09-12T00:51:54.566 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.566+0000 7f182591f800 20 add_watcher() i=3 2024-09-12T00:51:54.566 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.566+0000 7f182591f800 20 add_watcher() i=4 2024-09-12T00:51:54.566 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.566+0000 7f182591f800 20 add_watcher() i=5 2024-09-12T00:51:54.566 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.566+0000 7f182591f800 20 add_watcher() i=6 2024-09-12T00:51:54.566 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.567+0000 7f182591f800 20 add_watcher() i=7 2024-09-12T00:51:54.567 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.567+0000 7f182591f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:54.569 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.568+0000 7f16d77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:54.569 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.569+0000 7f182591f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:54.569 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.569+0000 7f182591f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:54.569 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.569+0000 7f182591f800 5 note: GC not initialized 2024-09-12T00:51:54.569 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.569+0000 7f16d67e4640 20 reqs_thread_entry: start 2024-09-12T00:51:54.569 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.569+0000 7f182591f800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:54.569 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.569+0000 7f182591f800 20 Filter name: none 2024-09-12T00:51:54.569 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.569+0000 7f1647fff640 20 reqs_thread_entry: start 2024-09-12T00:51:54.569 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.569+0000 7f182591f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.570 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.570+0000 7f182591f800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:51:54.571 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.570+0000 7f182591f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.571 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.570+0000 7f182591f800 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T00:51:54.571 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.570+0000 7f182591f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:54.571 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.570+0000 7f182591f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.571 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.571+0000 7f182591f800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:51:54.571 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.571+0000 7f182591f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.571 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.571+0000 7f182591f800 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T00:51:54.571 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.571+0000 7f182591f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:54.571 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.572+0000 7f16d77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:54.573 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.574+0000 7f182591f800 20 remove_watcher() i=0 2024-09-12T00:51:54.574 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.574+0000 7f182591f800 2 removed watcher, disabling cache 2024-09-12T00:51:54.575 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.575+0000 7f182591f800 20 remove_watcher() i=1 2024-09-12T00:51:54.576 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.576+0000 7f182591f800 20 remove_watcher() i=2 2024-09-12T00:51:54.577 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.577+0000 7f182591f800 20 remove_watcher() i=3 2024-09-12T00:51:54.578 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.578+0000 7f182591f800 20 remove_watcher() i=4 2024-09-12T00:51:54.579 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.579+0000 7f182591f800 20 remove_watcher() i=5 2024-09-12T00:51:54.580 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.580+0000 7f182591f800 20 remove_watcher() i=6 2024-09-12T00:51:54.580 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.581+0000 7f182591f800 20 remove_watcher() i=7 2024-09-12T00:51:54.591 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:54.591 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:51:54.591 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: abort-at-do-reshard id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:51:54.591 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:51:54.593 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:54.593 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:54.624 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:54.624 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:51:54.680 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:51:54.711 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:54.711 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:54.749 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.749+0000 7fe1c1212800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.751 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.751+0000 7fe1c1212800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:54.751 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.751+0000 7fe1c1212800 20 realm 2024-09-12T00:51:54.751 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.751+0000 7fe1c1212800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.751 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.751+0000 7fe1c1212800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:54.751 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.751+0000 7fe1c1212800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:54.751 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.751+0000 7fe1c1212800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.752 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.751+0000 7fe1c1212800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:54.752 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.751+0000 7fe1c1212800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.752 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.752+0000 7fe1c1212800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:54.752 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.752+0000 7fe1c1212800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.753 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.753+0000 7fe1c1212800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:54.753 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.753+0000 7fe1c1212800 20 searching for the correct realm 2024-09-12T00:51:54.754 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.755+0000 7fe1bd1e1640 0 -- 172.21.15.73:0/3760212965 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fe1a8017070 msgr2=0x7fe1a8060c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:51:54.960 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.960+0000 7fe1bd1e1640 0 -- 172.21.15.73:0/3760212965 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fe1a8017070 msgr2=0x7fe1a8060c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:54.964 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.964+0000 7fe1c1212800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:51:54.964 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.964+0000 7fe1c1212800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:54.964 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.964+0000 7fe1c1212800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:51:54.964 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.964+0000 7fe1c1212800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:54.964 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.964+0000 7fe1c1212800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:54.964 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.964+0000 7fe1c1212800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:54.965 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.964+0000 7fe1c1212800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.965 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.964+0000 7fe1c1212800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:54.965 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.964+0000 7fe1c1212800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.965 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.964+0000 7fe1c1212800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:54.965 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.964+0000 7fe1c1212800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.966 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.965+0000 7fe1c1212800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:54.966 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.965+0000 7fe1c1212800 20 zone default found 2024-09-12T00:51:54.966 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.965+0000 7fe1c1212800 4 Realm: () 2024-09-12T00:51:54.966 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.965+0000 7fe1c1212800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:51:54.966 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.965+0000 7fe1c1212800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:51:54.966 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.965+0000 7fe1c1212800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:54.967 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.965+0000 7fe1c1212800 20 zonegroup default 2024-09-12T00:51:54.967 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.965+0000 7fe1c1212800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.967 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.965+0000 7fe1c1212800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:54.967 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.965+0000 7fe1c1212800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.967 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.965+0000 7fe1c1212800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:54.967 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.965+0000 7fe1c1212800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.967 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.966+0000 7fe1c1212800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:54.967 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.966+0000 7fe1c1212800 20 started sync module instance, tier type = 2024-09-12T00:51:54.967 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.966+0000 7fe1c1212800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:51:54.976 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.976+0000 7fe1c1212800 20 add_watcher() i=0 2024-09-12T00:51:54.976 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.976+0000 7fe1c1212800 20 add_watcher() i=1 2024-09-12T00:51:54.976 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.976+0000 7fe1c1212800 20 add_watcher() i=2 2024-09-12T00:51:54.976 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.976+0000 7fe1c1212800 20 add_watcher() i=3 2024-09-12T00:51:54.976 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.976+0000 7fe1c1212800 20 add_watcher() i=4 2024-09-12T00:51:54.976 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.976+0000 7fe1c1212800 20 add_watcher() i=5 2024-09-12T00:51:54.976 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.976+0000 7fe1c1212800 20 add_watcher() i=6 2024-09-12T00:51:54.976 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.977+0000 7fe1c1212800 20 add_watcher() i=7 2024-09-12T00:51:54.977 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.977+0000 7fe1c1212800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:54.978 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.978+0000 7fe0737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:54.979 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.979+0000 7fe1c1212800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:54.979 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.979+0000 7fe1c1212800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:54.979 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.979+0000 7fe1c1212800 5 note: GC not initialized 2024-09-12T00:51:54.979 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.979+0000 7fe0727e4640 20 reqs_thread_entry: start 2024-09-12T00:51:54.979 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.979+0000 7fe1c1212800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:54.979 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.979+0000 7fe1c1212800 20 Filter name: none 2024-09-12T00:51:54.979 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.979+0000 7fe06b7fe640 20 reqs_thread_entry: start 2024-09-12T00:51:54.979 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.979+0000 7fe1c1212800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:51:54.980 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.979+0000 7fe1c1212800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.980 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.980+0000 7fe1c1212800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:51:54.981 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.980+0000 7fe1c1212800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:51:54.981 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.980+0000 7fe1c1212800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:51:54.981 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.980+0000 7fe1c1212800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34 : miss 2024-09-12T00:51:54.981 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.980+0000 7fe1c1212800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.981 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.980+0000 7fe1c1212800 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T00:51:54.981 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.980+0000 7fe1c1212800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34 info.flags=0x17 2024-09-12T00:51:54.981 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.980+0000 7fe1c1212800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34 to cache LRU end 2024-09-12T00:51:54.981 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.980+0000 7fe1c1212800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:51:54.981 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.980+0000 7fe1c1212800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:54.981 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.980+0000 7fe1c1212800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34 2024-09-12T00:51:54.982 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.982+0000 7fe1c1212800 0 INFO: RGWReshardLock::lock found lock on abort-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34 to be held by another RGW process; skipping for now 2024-09-12T00:51:54.982 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.983+0000 7fe0737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:54.984 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.985+0000 7fe1c1212800 20 remove_watcher() i=0 2024-09-12T00:51:54.985 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.985+0000 7fe1c1212800 2 removed watcher, disabling cache 2024-09-12T00:51:54.985 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.986+0000 7fe1c1212800 20 remove_watcher() i=1 2024-09-12T00:51:54.986 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.987+0000 7fe1c1212800 20 remove_watcher() i=2 2024-09-12T00:51:54.987 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.988+0000 7fe1c1212800 20 remove_watcher() i=3 2024-09-12T00:51:54.988 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.989+0000 7fe1c1212800 20 remove_watcher() i=4 2024-09-12T00:51:54.989 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.990+0000 7fe1c1212800 20 remove_watcher() i=5 2024-09-12T00:51:54.990 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.990+0000 7fe1c1212800 20 remove_watcher() i=6 2024-09-12T00:51:54.991 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:51:54.991+0000 7fe1c1212800 20 remove_watcher() i=7 2024-09-12T00:51:55.002 INFO:tasks.workunit.client.0.smithi073.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:52:25.017 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:52:25.052 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:25.052 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:25.095 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.096+0000 7f4098f3d800 20 rados->read ofs=0 len=0 2024-09-12T00:52:25.097 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.098+0000 7f4098f3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:25.097 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.098+0000 7f4098f3d800 20 realm 2024-09-12T00:52:25.097 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.098+0000 7f4098f3d800 20 rados->read ofs=0 len=0 2024-09-12T00:52:25.098 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.098+0000 7f4098f3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:25.098 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.098+0000 7f4098f3d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:25.098 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.098+0000 7f4098f3d800 20 rados->read ofs=0 len=0 2024-09-12T00:52:25.098 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.098+0000 7f4098f3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:25.098 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.098+0000 7f4098f3d800 20 rados->read ofs=0 len=0 2024-09-12T00:52:25.099 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.100+0000 7f4098f3d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:25.099 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.100+0000 7f4098f3d800 20 rados->read ofs=0 len=0 2024-09-12T00:52:25.099 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.101+0000 7f4098f3d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:25.099 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.101+0000 7f4098f3d800 20 searching for the correct realm 2024-09-12T00:52:25.102 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.103+0000 7f409542b640 0 -- 172.21.15.73:0/500227078 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f408002c070 msgr2=0x7f4080066f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:25.309 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.311+0000 7f409542b640 0 -- 172.21.15.73:0/500227078 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f408002c070 msgr2=0x7f4080066f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:25.314 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.315+0000 7f4098f3d800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:52:25.314 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.315+0000 7f4098f3d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:25.315 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.315+0000 7f4098f3d800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:52:25.315 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.315+0000 7f4098f3d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:25.315 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.315+0000 7f4098f3d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:25.315 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.315+0000 7f4098f3d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:25.315 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.315+0000 7f4098f3d800 20 rados->read ofs=0 len=0 2024-09-12T00:52:25.315 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.315+0000 7f4098f3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:25.315 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.315+0000 7f4098f3d800 20 rados->read ofs=0 len=0 2024-09-12T00:52:25.315 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.316+0000 7f4098f3d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:25.315 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.316+0000 7f4098f3d800 20 rados->read ofs=0 len=0 2024-09-12T00:52:25.317 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.316+0000 7f4098f3d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:25.317 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.316+0000 7f4098f3d800 20 zone default found 2024-09-12T00:52:25.317 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.316+0000 7f4098f3d800 4 Realm: () 2024-09-12T00:52:25.317 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.316+0000 7f4098f3d800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:52:25.317 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.316+0000 7f4098f3d800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:52:25.317 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.316+0000 7f4098f3d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:25.317 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.316+0000 7f4098f3d800 20 zonegroup default 2024-09-12T00:52:25.317 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.316+0000 7f4098f3d800 20 rados->read ofs=0 len=0 2024-09-12T00:52:25.317 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.316+0000 7f4098f3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:25.317 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.316+0000 7f4098f3d800 20 rados->read ofs=0 len=0 2024-09-12T00:52:25.317 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.317+0000 7f4098f3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:25.318 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.317+0000 7f4098f3d800 20 rados->read ofs=0 len=0 2024-09-12T00:52:25.318 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.317+0000 7f4098f3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:25.318 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.317+0000 7f4098f3d800 20 started sync module instance, tier type = 2024-09-12T00:52:25.318 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.317+0000 7f4098f3d800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:52:25.325 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.326+0000 7f4098f3d800 20 add_watcher() i=0 2024-09-12T00:52:25.325 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.326+0000 7f4098f3d800 20 add_watcher() i=1 2024-09-12T00:52:25.325 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.326+0000 7f4098f3d800 20 add_watcher() i=2 2024-09-12T00:52:25.325 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.326+0000 7f4098f3d800 20 add_watcher() i=3 2024-09-12T00:52:25.325 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.326+0000 7f4098f3d800 20 add_watcher() i=4 2024-09-12T00:52:25.326 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.326+0000 7f4098f3d800 20 add_watcher() i=5 2024-09-12T00:52:25.326 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.326+0000 7f4098f3d800 20 add_watcher() i=6 2024-09-12T00:52:25.326 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.327+0000 7f4098f3d800 20 add_watcher() i=7 2024-09-12T00:52:25.326 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.327+0000 7f4098f3d800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:25.327 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.329+0000 7f3f4b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:25.328 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.329+0000 7f4098f3d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:25.329 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.329+0000 7f4098f3d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:25.329 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.329+0000 7f4098f3d800 5 note: GC not initialized 2024-09-12T00:52:25.329 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.330+0000 7f3f4a7e4640 20 reqs_thread_entry: start 2024-09-12T00:52:25.329 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.330+0000 7f4098f3d800 20 init_complete bucket index max shards: 1 2024-09-12T00:52:25.329 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.330+0000 7f4098f3d800 20 Filter name: none 2024-09-12T00:52:25.329 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.330+0000 7f3f43fff640 20 reqs_thread_entry: start 2024-09-12T00:52:25.329 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.330+0000 7f4098f3d800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:52:25.329 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.330+0000 7f4098f3d800 20 rados->read ofs=0 len=0 2024-09-12T00:52:25.330 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.331+0000 7f4098f3d800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:52:25.330 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.331+0000 7f4098f3d800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:52:25.330 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.331+0000 7f4098f3d800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:52:25.330 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.331+0000 7f4098f3d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34 : miss 2024-09-12T00:52:25.330 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.331+0000 7f4098f3d800 20 rados->read ofs=0 len=0 2024-09-12T00:52:25.330 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.331+0000 7f4098f3d800 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T00:52:25.331 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.331+0000 7f4098f3d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34 info.flags=0x17 2024-09-12T00:52:25.331 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.331+0000 7f4098f3d800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34 to cache LRU end 2024-09-12T00:52:25.331 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.331+0000 7f4098f3d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:52:25.331 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.331+0000 7f4098f3d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:25.331 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.331+0000 7f4098f3d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34 2024-09-12T00:52:25.331 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.332+0000 7f4098f3d800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:52:25.335 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.336+0000 7f4098f3d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34 info.flags=0x17 2024-09-12T00:52:25.335 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.336+0000 7f4098f3d800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34 to cache LRU end 2024-09-12T00:52:25.335 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.336+0000 7f4098f3d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:25.335 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.336+0000 7f4098f3d800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34, ofs0, ns] 2024-09-12T00:52:25.335 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.336+0000 7f3f6bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497021 cookie 93909463307696 notifier 7151 bl.length()=911 2024-09-12T00:52:25.335 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.336+0000 7f3f6bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34 info.flags=0x17 2024-09-12T00:52:25.335 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.336+0000 7f3f6bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34 to cache LRU end 2024-09-12T00:52:25.335 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.336+0000 7f3f6bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:25.337 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.338+0000 7f4098f3d800 20 handle_bi_update(): bucket=:abort-at-do-reshard[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34]): orig_sources= new_sources= 2024-09-12T00:52:25.337 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.338+0000 7f4098f3d800 20 handle_bi_update(): bucket=:abort-at-do-reshard[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34]): potential sources added=[] removed=[] 2024-09-12T00:52:25.337 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.338+0000 7f4098f3d800 20 handle_bi_update(): bucket=:abort-at-do-reshard[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34]): orig_dests= new_dests= 2024-09-12T00:52:25.337 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.338+0000 7f4098f3d800 20 handle_bi_update(): bucket=:abort-at-do-reshard[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34]): potential dests added=[] removed=[] 2024-09-12T00:52:25.340 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.341+0000 7f4098f3d800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34.2.0 2024-09-12T00:52:25.340 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.341+0000 7f4098f3d800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34.2.0 2024-09-12T00:52:25.340 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.341+0000 7f4098f3d800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34.2.1 2024-09-12T00:52:25.340 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.341+0000 7f4098f3d800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34.2.1 2024-09-12T00:52:25.340 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.341+0000 7f4098f3d800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34.0 2024-09-12T00:52:25.342 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.344+0000 7f4098f3d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34 : hit (requested=0x17, cached=0x17) 2024-09-12T00:52:25.343 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.344+0000 7f4098f3d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34 2024-09-12T00:52:25.344 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.345+0000 7f4098f3d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34 info.flags=0x17 2024-09-12T00:52:25.344 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.345+0000 7f4098f3d800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34 to cache LRU end 2024-09-12T00:52:25.344 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.345+0000 7f4098f3d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:25.344 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.345+0000 7f4098f3d800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34, ofs0, ns] 2024-09-12T00:52:25.344 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.345+0000 7f3f6b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497022 cookie 93909463307696 notifier 7151 bl.length()=911 2024-09-12T00:52:25.345 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.345+0000 7f3f6b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34 info.flags=0x17 2024-09-12T00:52:25.345 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.345+0000 7f3f6b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34 to cache LRU end 2024-09-12T00:52:25.345 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.345+0000 7f3f6b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:25.346 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.347+0000 7f4098f3d800 20 handle_bi_update(): bucket=:abort-at-do-reshard[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34]): orig_sources= new_sources= 2024-09-12T00:52:25.346 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.347+0000 7f4098f3d800 20 handle_bi_update(): bucket=:abort-at-do-reshard[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34]): potential sources added=[] removed=[] 2024-09-12T00:52:25.346 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.347+0000 7f4098f3d800 20 handle_bi_update(): bucket=:abort-at-do-reshard[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34]): orig_dests= new_dests= 2024-09-12T00:52:25.346 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.347+0000 7f4098f3d800 20 handle_bi_update(): bucket=:abort-at-do-reshard[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34]): potential dests added=[] removed=[] 2024-09-12T00:52:25.347 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.348+0000 7f4098f3d800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34.0 2024-09-12T00:52:25.347 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.348+0000 7f4098f3d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34 : hit (requested=0x17, cached=0x17) 2024-09-12T00:52:25.347 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.348+0000 7f4098f3d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34 2024-09-12T00:52:25.349 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.350+0000 7f4098f3d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34 info.flags=0x17 2024-09-12T00:52:25.349 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.350+0000 7f4098f3d800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34 to cache LRU end 2024-09-12T00:52:25.349 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.350+0000 7f4098f3d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:25.349 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.350+0000 7f4098f3d800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34, ofs0, ns] 2024-09-12T00:52:25.349 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.350+0000 7f3f6bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497023 cookie 93909463307696 notifier 7151 bl.length()=879 2024-09-12T00:52:25.349 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.350+0000 7f3f6bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34 info.flags=0x17 2024-09-12T00:52:25.349 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.350+0000 7f3f6bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34 to cache LRU end 2024-09-12T00:52:25.349 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.350+0000 7f3f6bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:25.350 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.351+0000 7f4098f3d800 20 handle_bi_update(): bucket=:abort-at-do-reshard[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34]): orig_sources= new_sources= 2024-09-12T00:52:25.350 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.351+0000 7f4098f3d800 20 handle_bi_update(): bucket=:abort-at-do-reshard[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34]): potential sources added=[] removed=[] 2024-09-12T00:52:25.350 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.351+0000 7f4098f3d800 20 handle_bi_update(): bucket=:abort-at-do-reshard[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34]): orig_dests= new_dests= 2024-09-12T00:52:25.350 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.351+0000 7f4098f3d800 20 handle_bi_update(): bucket=:abort-at-do-reshard[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34]): potential dests added=[] removed=[] 2024-09-12T00:52:25.351 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.353+0000 7f4098f3d800 1 execute INFO: reshard of bucket "abort-at-do-reshard" from 1 shards to 2 shards completed successfully 2024-09-12T00:52:25.353 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.354+0000 7f3f4b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:25.355 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.357+0000 7f4098f3d800 20 remove_watcher() i=0 2024-09-12T00:52:25.355 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.357+0000 7f4098f3d800 2 removed watcher, disabling cache 2024-09-12T00:52:25.356 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.358+0000 7f4098f3d800 20 remove_watcher() i=1 2024-09-12T00:52:25.357 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.359+0000 7f4098f3d800 20 remove_watcher() i=2 2024-09-12T00:52:25.358 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.360+0000 7f4098f3d800 20 remove_watcher() i=3 2024-09-12T00:52:25.359 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.361+0000 7f4098f3d800 20 remove_watcher() i=4 2024-09-12T00:52:25.360 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.362+0000 7f4098f3d800 20 remove_watcher() i=5 2024-09-12T00:52:25.361 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.363+0000 7f4098f3d800 20 remove_watcher() i=6 2024-09-12T00:52:25.362 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.364+0000 7f4098f3d800 20 remove_watcher() i=7 2024-09-12T00:52:25.375 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T00:52:25.403 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:25.404 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:25.440 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.441+0000 7f7df5415800 20 rados->read ofs=0 len=0 2024-09-12T00:52:25.442 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.443+0000 7f7df5415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:25.442 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.443+0000 7f7df5415800 20 realm 2024-09-12T00:52:25.442 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.443+0000 7f7df5415800 20 rados->read ofs=0 len=0 2024-09-12T00:52:25.442 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.443+0000 7f7df5415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:25.442 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.443+0000 7f7df5415800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:25.442 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.443+0000 7f7df5415800 20 rados->read ofs=0 len=0 2024-09-12T00:52:25.442 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.443+0000 7f7df5415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:25.442 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.443+0000 7f7df5415800 20 rados->read ofs=0 len=0 2024-09-12T00:52:25.443 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.444+0000 7f7df5415800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:25.443 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.444+0000 7f7df5415800 20 rados->read ofs=0 len=0 2024-09-12T00:52:25.443 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.445+0000 7f7df5415800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:25.443 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.445+0000 7f7df5415800 20 searching for the correct realm 2024-09-12T00:52:25.446 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.447+0000 7f7df1393640 0 -- 172.21.15.73:0/2141036139 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f7dd807a040 msgr2=0x7f7dd809fa80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:52:25.651 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.652+0000 7f7df1393640 0 -- 172.21.15.73:0/2141036139 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f7dd807a040 msgr2=0x7f7dd809fa80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:25.655 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.656+0000 7f7df5415800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:52:25.655 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.656+0000 7f7df5415800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:25.655 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.656+0000 7f7df5415800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:52:25.656 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.656+0000 7f7df5415800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:25.656 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.656+0000 7f7df5415800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:25.656 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.656+0000 7f7df5415800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:25.656 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.656+0000 7f7df5415800 20 rados->read ofs=0 len=0 2024-09-12T00:52:25.656 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.657+0000 7f7df5415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:25.656 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.657+0000 7f7df5415800 20 rados->read ofs=0 len=0 2024-09-12T00:52:25.657 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.657+0000 7f7df5415800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:25.657 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.657+0000 7f7df5415800 20 rados->read ofs=0 len=0 2024-09-12T00:52:25.657 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.657+0000 7f7df5415800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:25.657 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.657+0000 7f7df5415800 20 zone default found 2024-09-12T00:52:25.657 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.657+0000 7f7df5415800 4 Realm: () 2024-09-12T00:52:25.658 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.657+0000 7f7df5415800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:52:25.658 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.657+0000 7f7df5415800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:52:25.658 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.657+0000 7f7df5415800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:25.658 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.657+0000 7f7df5415800 20 zonegroup default 2024-09-12T00:52:25.658 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.657+0000 7f7df5415800 20 rados->read ofs=0 len=0 2024-09-12T00:52:25.658 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.658+0000 7f7df5415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:25.658 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.658+0000 7f7df5415800 20 rados->read ofs=0 len=0 2024-09-12T00:52:25.658 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.658+0000 7f7df5415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:25.658 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.658+0000 7f7df5415800 20 rados->read ofs=0 len=0 2024-09-12T00:52:25.658 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.658+0000 7f7df5415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:25.658 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.658+0000 7f7df5415800 20 started sync module instance, tier type = 2024-09-12T00:52:25.658 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.658+0000 7f7df5415800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:52:25.666 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.667+0000 7f7df5415800 20 add_watcher() i=0 2024-09-12T00:52:25.666 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.667+0000 7f7df5415800 20 add_watcher() i=1 2024-09-12T00:52:25.666 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.667+0000 7f7df5415800 20 add_watcher() i=2 2024-09-12T00:52:25.666 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.667+0000 7f7df5415800 20 add_watcher() i=3 2024-09-12T00:52:25.666 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.667+0000 7f7df5415800 20 add_watcher() i=4 2024-09-12T00:52:25.666 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.667+0000 7f7df5415800 20 add_watcher() i=5 2024-09-12T00:52:25.666 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.667+0000 7f7df5415800 20 add_watcher() i=6 2024-09-12T00:52:25.667 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.668+0000 7f7df5415800 20 add_watcher() i=7 2024-09-12T00:52:25.667 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.668+0000 7f7df5415800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:25.669 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.670+0000 7f7ca77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:25.669 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.670+0000 7f7df5415800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:25.669 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.670+0000 7f7df5415800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:25.669 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.670+0000 7f7df5415800 5 note: GC not initialized 2024-09-12T00:52:25.670 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.671+0000 7f7ca67e4640 20 reqs_thread_entry: start 2024-09-12T00:52:25.670 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.671+0000 7f7df5415800 20 init_complete bucket index max shards: 1 2024-09-12T00:52:25.670 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.671+0000 7f7df5415800 20 Filter name: none 2024-09-12T00:52:25.670 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.671+0000 7f7c9f7fe640 20 reqs_thread_entry: start 2024-09-12T00:52:25.671 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.671+0000 7f7df5415800 20 rados->read ofs=0 len=0 2024-09-12T00:52:25.671 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.671+0000 7f7df5415800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:52:25.671 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.671+0000 7f7df5415800 20 rados->read ofs=0 len=0 2024-09-12T00:52:25.671 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.672+0000 7f7df5415800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:52:25.672 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.672+0000 7f7df5415800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:52:25.672 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.672+0000 7f7df5415800 20 rados->read ofs=0 len=0 2024-09-12T00:52:25.672 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.673+0000 7f7df5415800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:52:25.672 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.673+0000 7f7df5415800 20 rados->read ofs=0 len=0 2024-09-12T00:52:25.673 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.673+0000 7f7df5415800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:52:25.673 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.673+0000 7f7df5415800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:52:25.673 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.674+0000 7f7ca77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:25.675 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.677+0000 7f7df5415800 20 remove_watcher() i=0 2024-09-12T00:52:25.676 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.677+0000 7f7df5415800 2 removed watcher, disabling cache 2024-09-12T00:52:25.676 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.678+0000 7f7df5415800 20 remove_watcher() i=1 2024-09-12T00:52:25.677 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.679+0000 7f7df5415800 20 remove_watcher() i=2 2024-09-12T00:52:25.678 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.680+0000 7f7df5415800 20 remove_watcher() i=3 2024-09-12T00:52:25.679 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.681+0000 7f7df5415800 20 remove_watcher() i=4 2024-09-12T00:52:25.680 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.682+0000 7f7df5415800 20 remove_watcher() i=5 2024-09-12T00:52:25.681 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.683+0000 7f7df5415800 20 remove_watcher() i=6 2024-09-12T00:52:25.682 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:25.683+0000 7f7df5415800 20 remove_watcher() i=7 2024-09-12T00:52:25.692 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:52:25.692 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:52:25.693 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: abort-at-do-reshard id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:52:25.693 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:52:25.694 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:25.694 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:52:25.711 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:25.712 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:52:25.920 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:25.920 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:52:25.981 INFO:tasks.workunit.client.0.smithi073.stderr:TEST: reshard bucket with EIO injected at logrecord_writes 2024-09-12T00:52:25.981 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:52:25.983 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:25.983 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:52:26.234 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:26.234 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:52:26.290 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:26.290 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:52:26.326 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:26.326 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:52:26.361 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:26.361 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:52:26.395 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:26.396 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:52:26.430 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:26.431 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:52:26.464 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:26.464 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:52:26.498 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:26.498 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:52:26.532 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:26.532 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:52:26.566 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:26.566 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:52:26.602 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:26.602 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:52:26.635 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:26.635 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:52:26.668 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:26.669 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:52:26.703 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:26.703 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:52:26.737 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:26.738 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:52:26.771 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:26.771 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:52:26.806 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:26.806 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:52:26.840 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:26.840 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:52:26.874 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:26.874 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:52:26.908 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:26.909 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:52:26.942 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:26.942 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:52:26.976 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T00:52:27.005 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:27.005 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:27.042 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.043+0000 7f4033d31800 20 rados->read ofs=0 len=0 2024-09-12T00:52:27.044 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.045+0000 7f4033d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:27.044 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.045+0000 7f4033d31800 20 realm 2024-09-12T00:52:27.044 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.045+0000 7f4033d31800 20 rados->read ofs=0 len=0 2024-09-12T00:52:27.044 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.045+0000 7f4033d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:27.044 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.045+0000 7f4033d31800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:27.044 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.045+0000 7f4033d31800 20 rados->read ofs=0 len=0 2024-09-12T00:52:27.045 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.045+0000 7f4033d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:27.045 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.045+0000 7f4033d31800 20 rados->read ofs=0 len=0 2024-09-12T00:52:27.045 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.046+0000 7f4033d31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:27.045 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.046+0000 7f4033d31800 20 rados->read ofs=0 len=0 2024-09-12T00:52:27.046 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.047+0000 7f4033d31800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:27.046 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.047+0000 7f4033d31800 20 searching for the correct realm 2024-09-12T00:52:27.048 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.048+0000 7f402fa76640 0 -- 172.21.15.73:0/588141775 >> [v2:172.21.15.117:6816/1460498570,v1:172.21.15.117:6817/1460498570] conn(0x7f402007fc20 msgr2=0x7f402009a740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:52:27.251 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.252+0000 7f402f275640 0 -- 172.21.15.73:0/588141775 >> [v2:172.21.15.73:6826/269690776,v1:172.21.15.73:6827/269690776] conn(0x7f4028018070 msgr2=0x7f4028068910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:27.259 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.258+0000 7f4033d31800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:52:27.260 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.258+0000 7f4033d31800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:27.260 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.258+0000 7f4033d31800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:52:27.260 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.258+0000 7f4033d31800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:27.260 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.258+0000 7f4033d31800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:27.260 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.258+0000 7f4033d31800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:27.261 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.258+0000 7f4033d31800 20 rados->read ofs=0 len=0 2024-09-12T00:52:27.261 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.258+0000 7f4033d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:27.261 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.258+0000 7f4033d31800 20 rados->read ofs=0 len=0 2024-09-12T00:52:27.261 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.258+0000 7f4033d31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:27.261 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.258+0000 7f4033d31800 20 rados->read ofs=0 len=0 2024-09-12T00:52:27.261 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.259+0000 7f4033d31800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:27.262 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.259+0000 7f4033d31800 20 zone default found 2024-09-12T00:52:27.262 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.259+0000 7f4033d31800 4 Realm: () 2024-09-12T00:52:27.262 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.259+0000 7f4033d31800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:52:27.262 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.259+0000 7f4033d31800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:52:27.262 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.259+0000 7f4033d31800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:27.262 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.259+0000 7f4033d31800 20 zonegroup default 2024-09-12T00:52:27.263 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.259+0000 7f4033d31800 20 rados->read ofs=0 len=0 2024-09-12T00:52:27.263 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.259+0000 7f4033d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:27.263 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.259+0000 7f4033d31800 20 rados->read ofs=0 len=0 2024-09-12T00:52:27.263 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.259+0000 7f4033d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:27.263 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.259+0000 7f4033d31800 20 rados->read ofs=0 len=0 2024-09-12T00:52:27.263 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.259+0000 7f4033d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:27.264 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.259+0000 7f4033d31800 20 started sync module instance, tier type = 2024-09-12T00:52:27.264 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.259+0000 7f4033d31800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:52:27.267 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.268+0000 7f4033d31800 20 add_watcher() i=0 2024-09-12T00:52:27.267 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.268+0000 7f4033d31800 20 add_watcher() i=1 2024-09-12T00:52:27.267 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.268+0000 7f4033d31800 20 add_watcher() i=2 2024-09-12T00:52:27.268 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.268+0000 7f4033d31800 20 add_watcher() i=3 2024-09-12T00:52:27.268 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.268+0000 7f4033d31800 20 add_watcher() i=4 2024-09-12T00:52:27.268 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.268+0000 7f4033d31800 20 add_watcher() i=5 2024-09-12T00:52:27.268 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.268+0000 7f4033d31800 20 add_watcher() i=6 2024-09-12T00:52:27.269 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.269+0000 7f4033d31800 20 add_watcher() i=7 2024-09-12T00:52:27.269 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.269+0000 7f4033d31800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:27.271 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.271+0000 7f3ee1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:27.271 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.271+0000 7f4033d31800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:27.272 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.271+0000 7f4033d31800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:27.272 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.271+0000 7f4033d31800 5 note: GC not initialized 2024-09-12T00:52:27.272 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.271+0000 7f3ee0fe1640 20 reqs_thread_entry: start 2024-09-12T00:52:27.272 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.271+0000 7f4033d31800 20 init_complete bucket index max shards: 1 2024-09-12T00:52:27.272 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.271+0000 7f4033d31800 20 Filter name: none 2024-09-12T00:52:27.273 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.272+0000 7f3e5a7fc640 20 reqs_thread_entry: start 2024-09-12T00:52:27.273 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.272+0000 7f4033d31800 20 rados->read ofs=0 len=0 2024-09-12T00:52:27.273 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.272+0000 7f4033d31800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:52:27.273 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.272+0000 7f4033d31800 20 rados->read ofs=0 len=0 2024-09-12T00:52:27.275 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.273+0000 7f4033d31800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:52:27.275 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.273+0000 7f4033d31800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:52:27.276 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.273+0000 7f4033d31800 20 rados->read ofs=0 len=0 2024-09-12T00:52:27.276 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.273+0000 7f4033d31800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:52:27.276 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.273+0000 7f4033d31800 20 rados->read ofs=0 len=0 2024-09-12T00:52:27.276 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.274+0000 7f4033d31800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:52:27.277 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.274+0000 7f4033d31800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:52:27.277 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.275+0000 7f3ee1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:27.278 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.277+0000 7f4033d31800 20 remove_watcher() i=0 2024-09-12T00:52:27.278 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.277+0000 7f4033d31800 2 removed watcher, disabling cache 2024-09-12T00:52:27.278 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.278+0000 7f4033d31800 20 remove_watcher() i=1 2024-09-12T00:52:27.279 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.279+0000 7f4033d31800 20 remove_watcher() i=2 2024-09-12T00:52:27.279 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.280+0000 7f4033d31800 20 remove_watcher() i=3 2024-09-12T00:52:27.280 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.281+0000 7f4033d31800 20 remove_watcher() i=4 2024-09-12T00:52:27.281 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.282+0000 7f4033d31800 20 remove_watcher() i=5 2024-09-12T00:52:27.282 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.283+0000 7f4033d31800 20 remove_watcher() i=6 2024-09-12T00:52:27.283 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.284+0000 7f4033d31800 20 remove_watcher() i=7 2024-09-12T00:52:27.293 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:52:27.293 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:52:27.293 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: error-at-logrecord-writes id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:52:27.293 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:52:27.294 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at logrecord_writes 2024-09-12T00:52:27.329 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:27.329 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:27.366 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.367+0000 7f2f92326800 20 rados->read ofs=0 len=0 2024-09-12T00:52:27.367 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.368+0000 7f2f92326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:27.368 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.368+0000 7f2f92326800 20 realm 2024-09-12T00:52:27.368 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.368+0000 7f2f92326800 20 rados->read ofs=0 len=0 2024-09-12T00:52:27.368 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.369+0000 7f2f92326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:27.368 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.369+0000 7f2f92326800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:27.368 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.369+0000 7f2f92326800 20 rados->read ofs=0 len=0 2024-09-12T00:52:27.368 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.369+0000 7f2f92326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:27.368 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.369+0000 7f2f92326800 20 rados->read ofs=0 len=0 2024-09-12T00:52:27.369 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.370+0000 7f2f92326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:27.369 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.370+0000 7f2f92326800 20 rados->read ofs=0 len=0 2024-09-12T00:52:27.369 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.370+0000 7f2f92326800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:27.369 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.370+0000 7f2f92326800 20 searching for the correct realm 2024-09-12T00:52:27.371 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.372+0000 7f2f8e84c640 0 -- 172.21.15.73:0/3726670303 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f2f78089420 msgr2=0x7f2f78089860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:27.576 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.577+0000 7f2f8e84c640 0 -- 172.21.15.73:0/3726670303 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f2f78089420 msgr2=0x7f2f78089860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:27.581 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.581+0000 7f2f92326800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:52:27.581 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.581+0000 7f2f92326800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:27.581 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.581+0000 7f2f92326800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:52:27.581 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.581+0000 7f2f92326800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:27.581 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.581+0000 7f2f92326800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:27.581 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.581+0000 7f2f92326800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:27.581 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.581+0000 7f2f92326800 20 rados->read ofs=0 len=0 2024-09-12T00:52:27.581 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.581+0000 7f2f92326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:27.581 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.581+0000 7f2f92326800 20 rados->read ofs=0 len=0 2024-09-12T00:52:27.581 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.581+0000 7f2f92326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:27.581 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.581+0000 7f2f92326800 20 rados->read ofs=0 len=0 2024-09-12T00:52:27.581 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.582+0000 7f2f92326800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:27.582 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.582+0000 7f2f92326800 20 zone default found 2024-09-12T00:52:27.582 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.582+0000 7f2f92326800 4 Realm: () 2024-09-12T00:52:27.582 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.582+0000 7f2f92326800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:52:27.582 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.582+0000 7f2f92326800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:52:27.582 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.582+0000 7f2f92326800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:27.582 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.582+0000 7f2f92326800 20 zonegroup default 2024-09-12T00:52:27.582 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.582+0000 7f2f92326800 20 rados->read ofs=0 len=0 2024-09-12T00:52:27.582 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.582+0000 7f2f92326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:27.582 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.582+0000 7f2f92326800 20 rados->read ofs=0 len=0 2024-09-12T00:52:27.583 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.582+0000 7f2f92326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:27.583 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.582+0000 7f2f92326800 20 rados->read ofs=0 len=0 2024-09-12T00:52:27.583 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.583+0000 7f2f92326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:27.583 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.583+0000 7f2f92326800 20 started sync module instance, tier type = 2024-09-12T00:52:27.583 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.583+0000 7f2f92326800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:52:27.590 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.591+0000 7f2f92326800 20 add_watcher() i=0 2024-09-12T00:52:27.590 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.591+0000 7f2f92326800 20 add_watcher() i=1 2024-09-12T00:52:27.590 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.591+0000 7f2f92326800 20 add_watcher() i=2 2024-09-12T00:52:27.590 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.591+0000 7f2f92326800 20 add_watcher() i=3 2024-09-12T00:52:27.590 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.591+0000 7f2f92326800 20 add_watcher() i=4 2024-09-12T00:52:27.590 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.591+0000 7f2f92326800 20 add_watcher() i=5 2024-09-12T00:52:27.590 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.591+0000 7f2f92326800 20 add_watcher() i=6 2024-09-12T00:52:27.591 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.592+0000 7f2f92326800 20 add_watcher() i=7 2024-09-12T00:52:27.591 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.592+0000 7f2f92326800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:27.592 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.593+0000 7f2e44fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:27.593 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.594+0000 7f2f92326800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:27.593 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.594+0000 7f2f92326800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:27.593 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.594+0000 7f2f92326800 5 note: GC not initialized 2024-09-12T00:52:27.593 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.594+0000 7f2dbf7fe640 20 reqs_thread_entry: start 2024-09-12T00:52:27.593 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.594+0000 7f2f92326800 20 init_complete bucket index max shards: 1 2024-09-12T00:52:27.594 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.594+0000 7f2f92326800 20 Filter name: none 2024-09-12T00:52:27.594 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.594+0000 7f2dbd7fa640 20 reqs_thread_entry: start 2024-09-12T00:52:27.594 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.594+0000 7f2f92326800 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-12T00:52:27.594 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.594+0000 7f2f92326800 20 rados->read ofs=0 len=0 2024-09-12T00:52:27.595 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.595+0000 7f2f92326800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:52:27.595 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.595+0000 7f2f92326800 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-12T00:52:27.595 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.595+0000 7f2f92326800 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-12T00:52:27.595 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.595+0000 7f2f92326800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35 : miss 2024-09-12T00:52:27.595 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.595+0000 7f2f92326800 20 rados->read ofs=0 len=0 2024-09-12T00:52:27.595 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.595+0000 7f2f92326800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:52:27.595 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.595+0000 7f2f92326800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35 info.flags=0x17 2024-09-12T00:52:27.595 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.595+0000 7f2f92326800 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35 to cache LRU end 2024-09-12T00:52:27.595 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.595+0000 7f2f92326800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:52:27.595 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.595+0000 7f2f92326800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:27.595 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.595+0000 7f2f92326800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35 2024-09-12T00:52:27.598 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.599+0000 7f2f92326800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35 info.flags=0x17 2024-09-12T00:52:27.598 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.599+0000 7f2f92326800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35 to cache LRU end 2024-09-12T00:52:27.598 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.599+0000 7f2f92326800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:27.598 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.599+0000 7f2f92326800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35, ofs0, ns] 2024-09-12T00:52:27.598 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.600+0000 7f2e71ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497021 cookie 94871175506272 notifier 7202 bl.length()=923 2024-09-12T00:52:27.598 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.600+0000 7f2e71ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35 info.flags=0x17 2024-09-12T00:52:27.599 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.600+0000 7f2e71ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35 to cache LRU end 2024-09-12T00:52:27.599 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.600+0000 7f2e71ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:27.600 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.601+0000 7f2f92326800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35]): orig_sources= new_sources= 2024-09-12T00:52:27.600 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.601+0000 7f2f92326800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35]): potential sources added=[] removed=[] 2024-09-12T00:52:27.600 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.601+0000 7f2f92326800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35]): orig_dests= new_dests= 2024-09-12T00:52:27.600 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.601+0000 7f2f92326800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35]): potential dests added=[] removed=[] 2024-09-12T00:52:27.601 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.602+0000 7f2f92326800 -1 Injecting error=-5 at location=logrecord_writes 2024-09-12T00:52:27.601 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.602+0000 7f2f92326800 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2024-09-12T00:52:27.603 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.605+0000 7f2f92326800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35 : hit (requested=0x17, cached=0x17) 2024-09-12T00:52:27.603 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.605+0000 7f2f92326800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35 2024-09-12T00:52:27.605 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.606+0000 7f2f92326800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35 info.flags=0x17 2024-09-12T00:52:27.605 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.606+0000 7f2f92326800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35 to cache LRU end 2024-09-12T00:52:27.605 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.606+0000 7f2f92326800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:27.605 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.606+0000 7f2f92326800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35, ofs0, ns] 2024-09-12T00:52:27.605 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.606+0000 7f2e717fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497022 cookie 94871175506272 notifier 7202 bl.length()=891 2024-09-12T00:52:27.605 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.606+0000 7f2e717fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35 info.flags=0x17 2024-09-12T00:52:27.605 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.606+0000 7f2e717fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35 to cache LRU end 2024-09-12T00:52:27.605 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.606+0000 7f2e717fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:27.606 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.607+0000 7f2f92326800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35]): orig_sources= new_sources= 2024-09-12T00:52:27.606 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.607+0000 7f2f92326800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35]): potential sources added=[] removed=[] 2024-09-12T00:52:27.606 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.607+0000 7f2f92326800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35]): orig_dests= new_dests= 2024-09-12T00:52:27.606 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.607+0000 7f2f92326800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35]): potential dests added=[] removed=[] 2024-09-12T00:52:27.608 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.609+0000 7f2e44fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:27.610 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.611+0000 7f2f92326800 20 remove_watcher() i=0 2024-09-12T00:52:27.610 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.611+0000 7f2f92326800 2 removed watcher, disabling cache 2024-09-12T00:52:27.611 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.612+0000 7f2f92326800 20 remove_watcher() i=1 2024-09-12T00:52:27.612 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.613+0000 7f2f92326800 20 remove_watcher() i=2 2024-09-12T00:52:27.613 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.614+0000 7f2f92326800 20 remove_watcher() i=3 2024-09-12T00:52:27.614 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.615+0000 7f2f92326800 20 remove_watcher() i=4 2024-09-12T00:52:27.615 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.616+0000 7f2f92326800 20 remove_watcher() i=5 2024-09-12T00:52:27.616 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.617+0000 7f2f92326800 20 remove_watcher() i=6 2024-09-12T00:52:27.616 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.618+0000 7f2f92326800 20 remove_watcher() i=7 2024-09-12T00:52:27.629 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T00:52:27.657 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:27.657 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:27.694 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.695+0000 7fa33ed25800 20 rados->read ofs=0 len=0 2024-09-12T00:52:27.695 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.696+0000 7fa33ed25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:27.695 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.696+0000 7fa33ed25800 20 realm 2024-09-12T00:52:27.696 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.696+0000 7fa33ed25800 20 rados->read ofs=0 len=0 2024-09-12T00:52:27.696 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.697+0000 7fa33ed25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:27.696 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.697+0000 7fa33ed25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:27.696 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.697+0000 7fa33ed25800 20 rados->read ofs=0 len=0 2024-09-12T00:52:27.696 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.697+0000 7fa33ed25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:27.696 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.697+0000 7fa33ed25800 20 rados->read ofs=0 len=0 2024-09-12T00:52:27.696 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.698+0000 7fa33ed25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:27.696 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.698+0000 7fa33ed25800 20 rados->read ofs=0 len=0 2024-09-12T00:52:27.697 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.698+0000 7fa33ed25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:27.697 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.698+0000 7fa33ed25800 20 searching for the correct realm 2024-09-12T00:52:27.699 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.700+0000 7fa33b134640 0 -- 172.21.15.73:0/4124499797 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fa32403e920 msgr2=0x7fa32400a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:27.904 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:27.905+0000 7fa33a933640 0 -- 172.21.15.73:0/4124499797 >> [v2:172.21.15.73:6810/1807760270,v1:172.21.15.73:6811/1807760270] conn(0x7fa334039960 msgr2=0x7fa3340383e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:28.110 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.111+0000 7fa33ed25800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:52:28.110 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.111+0000 7fa33ed25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:28.111 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.111+0000 7fa33ed25800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:52:28.111 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.111+0000 7fa33ed25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:28.111 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.111+0000 7fa33ed25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:28.111 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.111+0000 7fa33ed25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:28.111 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.111+0000 7fa33ed25800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.111 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.111+0000 7fa33ed25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:28.111 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.111+0000 7fa33ed25800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.111 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.112+0000 7fa33ed25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:28.111 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.112+0000 7fa33ed25800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.112 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.112+0000 7fa33ed25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:28.112 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.112+0000 7fa33ed25800 20 zone default found 2024-09-12T00:52:28.112 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.112+0000 7fa33ed25800 4 Realm: () 2024-09-12T00:52:28.112 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.112+0000 7fa33ed25800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:52:28.113 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.112+0000 7fa33ed25800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:52:28.113 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.112+0000 7fa33ed25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:28.113 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.112+0000 7fa33ed25800 20 zonegroup default 2024-09-12T00:52:28.113 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.112+0000 7fa33ed25800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.113 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.112+0000 7fa33ed25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:28.113 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.112+0000 7fa33ed25800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.113 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.113+0000 7fa33ed25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:28.113 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.113+0000 7fa33ed25800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.113 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.113+0000 7fa33ed25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:28.113 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.113+0000 7fa33ed25800 20 started sync module instance, tier type = 2024-09-12T00:52:28.113 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.113+0000 7fa33ed25800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:52:28.120 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.122+0000 7fa33ed25800 20 add_watcher() i=0 2024-09-12T00:52:28.120 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.122+0000 7fa33ed25800 20 add_watcher() i=1 2024-09-12T00:52:28.121 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.122+0000 7fa33ed25800 20 add_watcher() i=2 2024-09-12T00:52:28.121 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.122+0000 7fa33ed25800 20 add_watcher() i=3 2024-09-12T00:52:28.121 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.122+0000 7fa33ed25800 20 add_watcher() i=4 2024-09-12T00:52:28.121 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.122+0000 7fa33ed25800 20 add_watcher() i=5 2024-09-12T00:52:28.121 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.122+0000 7fa33ed25800 20 add_watcher() i=6 2024-09-12T00:52:28.121 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.123+0000 7fa33ed25800 20 add_watcher() i=7 2024-09-12T00:52:28.121 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.123+0000 7fa33ed25800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:28.123 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.124+0000 7fa1f17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:28.124 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.124+0000 7fa33ed25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:28.124 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.124+0000 7fa33ed25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:28.124 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.124+0000 7fa33ed25800 5 note: GC not initialized 2024-09-12T00:52:28.124 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.125+0000 7fa16bfff640 20 reqs_thread_entry: start 2024-09-12T00:52:28.124 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.125+0000 7fa33ed25800 20 init_complete bucket index max shards: 1 2024-09-12T00:52:28.124 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.125+0000 7fa33ed25800 20 Filter name: none 2024-09-12T00:52:28.124 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.125+0000 7fa169ffb640 20 reqs_thread_entry: start 2024-09-12T00:52:28.124 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.125+0000 7fa33ed25800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.125 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.125+0000 7fa33ed25800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:52:28.125 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.125+0000 7fa33ed25800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.125 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.126+0000 7fa33ed25800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:52:28.126 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.126+0000 7fa33ed25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:52:28.126 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.126+0000 7fa33ed25800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.126 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.126+0000 7fa33ed25800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:52:28.126 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.126+0000 7fa33ed25800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.126 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.127+0000 7fa33ed25800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:52:28.126 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.127+0000 7fa33ed25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:52:28.126 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.128+0000 7fa1f17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:28.129 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.130+0000 7fa33ed25800 20 remove_watcher() i=0 2024-09-12T00:52:28.129 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.130+0000 7fa33ed25800 2 removed watcher, disabling cache 2024-09-12T00:52:28.130 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.131+0000 7fa33ed25800 20 remove_watcher() i=1 2024-09-12T00:52:28.131 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.132+0000 7fa33ed25800 20 remove_watcher() i=2 2024-09-12T00:52:28.132 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.133+0000 7fa33ed25800 20 remove_watcher() i=3 2024-09-12T00:52:28.133 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.134+0000 7fa33ed25800 20 remove_watcher() i=4 2024-09-12T00:52:28.134 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.135+0000 7fa33ed25800 20 remove_watcher() i=5 2024-09-12T00:52:28.134 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.136+0000 7fa33ed25800 20 remove_watcher() i=6 2024-09-12T00:52:28.135 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.137+0000 7fa33ed25800 20 remove_watcher() i=7 2024-09-12T00:52:28.146 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:52:28.146 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:52:28.146 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: error-at-logrecord-writes id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:52:28.147 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:52:28.147 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:28.147 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:52:28.180 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:28.180 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:52:28.237 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:52:28.268 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:28.268 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:28.304 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.306+0000 7f71e7240800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.306 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.307+0000 7f71e7240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:28.306 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.307+0000 7f71e7240800 20 realm 2024-09-12T00:52:28.306 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.307+0000 7f71e7240800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.306 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.307+0000 7f71e7240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:28.307 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.307+0000 7f71e7240800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:28.307 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.307+0000 7f71e7240800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.307 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.308+0000 7f71e7240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:28.307 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.308+0000 7f71e7240800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.307 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.309+0000 7f71e7240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:28.307 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.309+0000 7f71e7240800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.308 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.309+0000 7f71e7240800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:28.308 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.309+0000 7f71e7240800 20 searching for the correct realm 2024-09-12T00:52:28.310 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.311+0000 7f71e552b640 0 -- 172.21.15.73:0/4010742544 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f71d006b020 msgr2=0x7f71d00bee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:28.515 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.516+0000 7f71e552b640 0 -- 172.21.15.73:0/4010742544 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f71d006b020 msgr2=0x7f71d00bee80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:28.521 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.520+0000 7f71e7240800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:52:28.521 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.520+0000 7f71e7240800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:28.521 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.520+0000 7f71e7240800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:52:28.521 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.520+0000 7f71e7240800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:28.521 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.520+0000 7f71e7240800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:28.521 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.520+0000 7f71e7240800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:28.521 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.520+0000 7f71e7240800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.521 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.521+0000 7f71e7240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:28.521 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.521+0000 7f71e7240800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.521 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.521+0000 7f71e7240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:28.522 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.521+0000 7f71e7240800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.522 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.521+0000 7f71e7240800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:28.522 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.521+0000 7f71e7240800 20 zone default found 2024-09-12T00:52:28.522 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.521+0000 7f71e7240800 4 Realm: () 2024-09-12T00:52:28.522 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.521+0000 7f71e7240800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:52:28.522 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.521+0000 7f71e7240800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:52:28.522 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.521+0000 7f71e7240800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:28.522 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.521+0000 7f71e7240800 20 zonegroup default 2024-09-12T00:52:28.522 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.521+0000 7f71e7240800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.522 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.521+0000 7f71e7240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:28.522 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.521+0000 7f71e7240800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.522 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.522+0000 7f71e7240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:28.522 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.522+0000 7f71e7240800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.523 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.522+0000 7f71e7240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:28.523 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.522+0000 7f71e7240800 20 started sync module instance, tier type = 2024-09-12T00:52:28.523 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.522+0000 7f71e7240800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:52:28.530 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.531+0000 7f71e7240800 20 add_watcher() i=0 2024-09-12T00:52:28.530 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.531+0000 7f71e7240800 20 add_watcher() i=1 2024-09-12T00:52:28.530 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.531+0000 7f71e7240800 20 add_watcher() i=2 2024-09-12T00:52:28.530 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.531+0000 7f71e7240800 20 add_watcher() i=3 2024-09-12T00:52:28.530 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.531+0000 7f71e7240800 20 add_watcher() i=4 2024-09-12T00:52:28.531 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.531+0000 7f71e7240800 20 add_watcher() i=5 2024-09-12T00:52:28.531 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.531+0000 7f71e7240800 20 add_watcher() i=6 2024-09-12T00:52:28.531 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.532+0000 7f71e7240800 20 add_watcher() i=7 2024-09-12T00:52:28.531 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.532+0000 7f71e7240800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:28.532 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.534+0000 7f709b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:28.534 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.534+0000 7f71e7240800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:28.534 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.534+0000 7f71e7240800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:28.535 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.534+0000 7f71e7240800 5 note: GC not initialized 2024-09-12T00:52:28.535 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.534+0000 7f709a7e4640 20 reqs_thread_entry: start 2024-09-12T00:52:28.535 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.535+0000 7f71e7240800 20 init_complete bucket index max shards: 1 2024-09-12T00:52:28.535 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.535+0000 7f71e7240800 20 Filter name: none 2024-09-12T00:52:28.535 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.535+0000 7f70937fe640 20 reqs_thread_entry: start 2024-09-12T00:52:28.535 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.535+0000 7f71e7240800 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-12T00:52:28.535 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.535+0000 7f71e7240800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.535 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.535+0000 7f71e7240800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:52:28.535 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.535+0000 7f71e7240800 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-12T00:52:28.535 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.535+0000 7f71e7240800 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-12T00:52:28.535 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.535+0000 7f71e7240800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35 : miss 2024-09-12T00:52:28.535 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.535+0000 7f71e7240800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.535 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.536+0000 7f71e7240800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:52:28.536 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.536+0000 7f71e7240800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35 info.flags=0x17 2024-09-12T00:52:28.536 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.536+0000 7f71e7240800 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35 to cache LRU end 2024-09-12T00:52:28.536 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.536+0000 7f71e7240800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:52:28.536 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.536+0000 7f71e7240800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:28.536 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.536+0000 7f71e7240800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35 2024-09-12T00:52:28.538 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.539+0000 7f71e7240800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35 info.flags=0x17 2024-09-12T00:52:28.538 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.539+0000 7f71e7240800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35 to cache LRU end 2024-09-12T00:52:28.538 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.539+0000 7f71e7240800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:28.539 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.539+0000 7f71e7240800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35, ofs0, ns] 2024-09-12T00:52:28.539 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.540+0000 7f70bbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497023 cookie 94867018770816 notifier 7701 bl.length()=923 2024-09-12T00:52:28.539 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.540+0000 7f70bbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35 info.flags=0x17 2024-09-12T00:52:28.539 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.540+0000 7f70bbfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35 to cache LRU end 2024-09-12T00:52:28.539 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.540+0000 7f70bbfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:28.540 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.541+0000 7f71e7240800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35]): orig_sources= new_sources= 2024-09-12T00:52:28.540 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.541+0000 7f71e7240800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35]): potential sources added=[] removed=[] 2024-09-12T00:52:28.540 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.541+0000 7f71e7240800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35]): orig_dests= new_dests= 2024-09-12T00:52:28.540 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.541+0000 7f71e7240800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35]): potential dests added=[] removed=[] 2024-09-12T00:52:28.543 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.544+0000 7f71e7240800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35.1.0 2024-09-12T00:52:28.543 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.544+0000 7f71e7240800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35.1.0 2024-09-12T00:52:28.543 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.544+0000 7f71e7240800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35.1.1 2024-09-12T00:52:28.543 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.544+0000 7f71e7240800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35.1.1 2024-09-12T00:52:28.543 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.544+0000 7f71e7240800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35.0 2024-09-12T00:52:28.545 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.547+0000 7f71e7240800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35 : hit (requested=0x17, cached=0x17) 2024-09-12T00:52:28.545 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.547+0000 7f71e7240800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35 2024-09-12T00:52:28.547 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.548+0000 7f71e7240800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35 info.flags=0x17 2024-09-12T00:52:28.547 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.548+0000 7f71e7240800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35 to cache LRU end 2024-09-12T00:52:28.547 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.548+0000 7f71e7240800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:28.547 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.548+0000 7f71e7240800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35, ofs0, ns] 2024-09-12T00:52:28.547 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.548+0000 7f70bbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497024 cookie 94867018770816 notifier 7701 bl.length()=923 2024-09-12T00:52:28.547 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.548+0000 7f70bbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35 info.flags=0x17 2024-09-12T00:52:28.547 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.548+0000 7f70bbfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35 to cache LRU end 2024-09-12T00:52:28.547 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.548+0000 7f70bbfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:28.548 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.550+0000 7f71e7240800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35]): orig_sources= new_sources= 2024-09-12T00:52:28.548 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.550+0000 7f71e7240800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35]): potential sources added=[] removed=[] 2024-09-12T00:52:28.548 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.550+0000 7f71e7240800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35]): orig_dests= new_dests= 2024-09-12T00:52:28.548 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.550+0000 7f71e7240800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35]): potential dests added=[] removed=[] 2024-09-12T00:52:28.549 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.551+0000 7f71e7240800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35.0 2024-09-12T00:52:28.550 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.551+0000 7f71e7240800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35 : hit (requested=0x17, cached=0x17) 2024-09-12T00:52:28.550 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.551+0000 7f71e7240800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35 2024-09-12T00:52:28.551 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.552+0000 7f71e7240800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35 info.flags=0x17 2024-09-12T00:52:28.552 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.552+0000 7f71e7240800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35 to cache LRU end 2024-09-12T00:52:28.552 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.552+0000 7f71e7240800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:28.552 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.552+0000 7f71e7240800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35, ofs0, ns] 2024-09-12T00:52:28.552 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.552+0000 7f70bb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497025 cookie 94867018770816 notifier 7701 bl.length()=891 2024-09-12T00:52:28.552 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.552+0000 7f70bb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35 info.flags=0x17 2024-09-12T00:52:28.552 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.552+0000 7f70bb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35 to cache LRU end 2024-09-12T00:52:28.552 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.552+0000 7f70bb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:28.552 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.554+0000 7f71e7240800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35]): orig_sources= new_sources= 2024-09-12T00:52:28.553 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.554+0000 7f71e7240800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35]): potential sources added=[] removed=[] 2024-09-12T00:52:28.553 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.554+0000 7f71e7240800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35]): orig_dests= new_dests= 2024-09-12T00:52:28.553 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.554+0000 7f71e7240800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35]): potential dests added=[] removed=[] 2024-09-12T00:52:28.554 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.555+0000 7f71e7240800 1 execute INFO: reshard of bucket "error-at-logrecord-writes" from 1 shards to 2 shards completed successfully 2024-09-12T00:52:28.556 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.557+0000 7f709b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:28.558 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.559+0000 7f71e7240800 20 remove_watcher() i=0 2024-09-12T00:52:28.558 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.559+0000 7f71e7240800 2 removed watcher, disabling cache 2024-09-12T00:52:28.559 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.560+0000 7f71e7240800 20 remove_watcher() i=1 2024-09-12T00:52:28.560 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.561+0000 7f71e7240800 20 remove_watcher() i=2 2024-09-12T00:52:28.561 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.562+0000 7f71e7240800 20 remove_watcher() i=3 2024-09-12T00:52:28.562 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.563+0000 7f71e7240800 20 remove_watcher() i=4 2024-09-12T00:52:28.563 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.564+0000 7f71e7240800 20 remove_watcher() i=5 2024-09-12T00:52:28.564 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.565+0000 7f71e7240800 20 remove_watcher() i=6 2024-09-12T00:52:28.565 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.566+0000 7f71e7240800 20 remove_watcher() i=7 2024-09-12T00:52:28.577 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T00:52:28.606 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:28.606 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:28.642 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.643+0000 7faa8cc10800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.644 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.645+0000 7faa8cc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:28.644 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.645+0000 7faa8cc10800 20 realm 2024-09-12T00:52:28.644 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.645+0000 7faa8cc10800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.645 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.646+0000 7faa8cc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:28.645 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.646+0000 7faa8cc10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:28.645 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.646+0000 7faa8cc10800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.645 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.646+0000 7faa8cc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:28.645 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.646+0000 7faa8cc10800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.645 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.646+0000 7faa8cc10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:28.645 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.646+0000 7faa8cc10800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.646 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.647+0000 7faa8cc10800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:28.646 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.647+0000 7faa8cc10800 20 searching for the correct realm 2024-09-12T00:52:28.648 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.649+0000 7faa88bbd640 0 -- 172.21.15.73:0/3424920946 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7faa70001c20 msgr2=0x7faa7006bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:52:28.853 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.854+0000 7faa88bbd640 0 -- 172.21.15.73:0/3424920946 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7faa70001c20 msgr2=0x7faa7006bda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:28.858 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.858+0000 7faa8cc10800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:52:28.858 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.858+0000 7faa8cc10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:28.858 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.858+0000 7faa8cc10800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:52:28.858 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.858+0000 7faa8cc10800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:28.858 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.858+0000 7faa8cc10800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:28.858 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.858+0000 7faa8cc10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:28.858 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.858+0000 7faa8cc10800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.858 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.858+0000 7faa8cc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:28.858 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.858+0000 7faa8cc10800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.858 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.858+0000 7faa8cc10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:28.858 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.858+0000 7faa8cc10800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.859 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.859+0000 7faa8cc10800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:28.859 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.859+0000 7faa8cc10800 20 zone default found 2024-09-12T00:52:28.859 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.859+0000 7faa8cc10800 4 Realm: () 2024-09-12T00:52:28.859 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.859+0000 7faa8cc10800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:52:28.859 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.859+0000 7faa8cc10800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:52:28.859 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.859+0000 7faa8cc10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:28.859 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.859+0000 7faa8cc10800 20 zonegroup default 2024-09-12T00:52:28.859 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.859+0000 7faa8cc10800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.859 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.859+0000 7faa8cc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:28.859 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.859+0000 7faa8cc10800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.859 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.859+0000 7faa8cc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:28.859 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.859+0000 7faa8cc10800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.860 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.859+0000 7faa8cc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:28.860 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.860+0000 7faa8cc10800 20 started sync module instance, tier type = 2024-09-12T00:52:28.860 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.860+0000 7faa8cc10800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:52:28.867 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.869+0000 7faa8cc10800 20 add_watcher() i=0 2024-09-12T00:52:28.868 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.869+0000 7faa8cc10800 20 add_watcher() i=1 2024-09-12T00:52:28.868 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.869+0000 7faa8cc10800 20 add_watcher() i=2 2024-09-12T00:52:28.868 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.869+0000 7faa8cc10800 20 add_watcher() i=3 2024-09-12T00:52:28.868 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.869+0000 7faa8cc10800 20 add_watcher() i=4 2024-09-12T00:52:28.868 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.869+0000 7faa8cc10800 20 add_watcher() i=5 2024-09-12T00:52:28.868 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.869+0000 7faa8cc10800 20 add_watcher() i=6 2024-09-12T00:52:28.869 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.870+0000 7faa8cc10800 20 add_watcher() i=7 2024-09-12T00:52:28.869 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.870+0000 7faa8cc10800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:28.871 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.871+0000 7fa93efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:28.871 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.872+0000 7faa8cc10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:28.871 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.872+0000 7faa8cc10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:28.871 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.872+0000 7faa8cc10800 5 note: GC not initialized 2024-09-12T00:52:28.871 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.872+0000 7fa93dfdb640 20 reqs_thread_entry: start 2024-09-12T00:52:28.871 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.872+0000 7faa8cc10800 20 init_complete bucket index max shards: 1 2024-09-12T00:52:28.871 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.872+0000 7faa8cc10800 20 Filter name: none 2024-09-12T00:52:28.871 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.872+0000 7fa8af7fe640 20 reqs_thread_entry: start 2024-09-12T00:52:28.871 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.872+0000 7faa8cc10800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.872 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.873+0000 7faa8cc10800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:52:28.873 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.873+0000 7faa8cc10800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.873 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.873+0000 7faa8cc10800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:52:28.873 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.873+0000 7faa8cc10800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:52:28.873 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.873+0000 7faa8cc10800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.873 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.874+0000 7faa8cc10800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:52:28.873 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.874+0000 7faa8cc10800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.873 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.874+0000 7faa8cc10800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:52:28.873 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.874+0000 7faa8cc10800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:52:28.874 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.875+0000 7fa93efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:28.876 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.877+0000 7faa8cc10800 20 remove_watcher() i=0 2024-09-12T00:52:28.876 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.877+0000 7faa8cc10800 2 removed watcher, disabling cache 2024-09-12T00:52:28.877 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.878+0000 7faa8cc10800 20 remove_watcher() i=1 2024-09-12T00:52:28.878 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.879+0000 7faa8cc10800 20 remove_watcher() i=2 2024-09-12T00:52:28.879 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.880+0000 7faa8cc10800 20 remove_watcher() i=3 2024-09-12T00:52:28.880 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.881+0000 7faa8cc10800 20 remove_watcher() i=4 2024-09-12T00:52:28.881 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.882+0000 7faa8cc10800 20 remove_watcher() i=5 2024-09-12T00:52:28.882 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.883+0000 7faa8cc10800 20 remove_watcher() i=6 2024-09-12T00:52:28.883 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:28.884+0000 7faa8cc10800 20 remove_watcher() i=7 2024-09-12T00:52:28.893 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:52:28.893 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:52:28.893 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: error-at-logrecord-writes id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:52:28.893 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:52:28.895 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:28.895 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:52:28.915 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:28.915 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:52:29.123 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:29.124 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:52:29.185 INFO:tasks.workunit.client.0.smithi073.stderr:TEST: reshard bucket with abort at logrecord_writes 2024-09-12T00:52:29.185 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:52:29.186 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:29.186 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:52:29.226 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:29.226 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:52:29.282 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:29.283 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:52:29.319 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:29.320 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:52:29.352 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:29.352 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:52:29.389 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:29.389 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:52:29.422 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:29.422 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:52:29.456 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:29.456 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:52:29.490 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:29.490 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:52:29.525 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:29.525 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:52:29.558 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:29.558 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:52:29.592 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:29.592 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:52:29.628 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:29.628 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:52:29.661 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:29.661 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:52:29.696 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:29.696 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:52:29.729 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:29.729 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:52:29.766 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:29.766 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:52:29.800 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:29.801 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:52:29.834 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:29.834 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:52:29.868 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:29.868 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:52:29.903 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:29.903 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:52:29.938 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:29.938 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:52:29.972 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T00:52:30.001 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:30.001 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:30.037 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.037+0000 7f7cbd742800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.039 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.039+0000 7f7cbd742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.039 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.039+0000 7f7cbd742800 20 realm 2024-09-12T00:52:30.039 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.039+0000 7f7cbd742800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.039 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.039+0000 7f7cbd742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.039 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.039+0000 7f7cbd742800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:30.039 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.039+0000 7f7cbd742800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.039 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.039+0000 7f7cbd742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.039 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.039+0000 7f7cbd742800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.040 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.040+0000 7f7cbd742800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:30.040 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.040+0000 7f7cbd742800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.041 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.041+0000 7f7cbd742800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:30.041 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.041+0000 7f7cbd742800 20 searching for the correct realm 2024-09-12T00:52:30.043 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.043+0000 7f7cb9c87640 0 -- 172.21.15.73:0/1612579787 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f7cb0017070 msgr2=0x7f7cb0069ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:52:30.248 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.248+0000 7f7cb9c87640 0 -- 172.21.15.73:0/1612579787 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f7cb0017070 msgr2=0x7f7cb0069ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:30.252 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.252+0000 7f7cbd742800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:52:30.252 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.252+0000 7f7cbd742800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:30.252 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.252+0000 7f7cbd742800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:52:30.252 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.252+0000 7f7cbd742800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:30.252 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.252+0000 7f7cbd742800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:30.252 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.252+0000 7f7cbd742800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:30.252 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.252+0000 7f7cbd742800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.252 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.252+0000 7f7cbd742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.252 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.252+0000 7f7cbd742800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.253 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.252+0000 7f7cbd742800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:30.253 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.252+0000 7f7cbd742800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.254 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.252+0000 7f7cbd742800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:30.254 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.253+0000 7f7cbd742800 20 zone default found 2024-09-12T00:52:30.254 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.253+0000 7f7cbd742800 4 Realm: () 2024-09-12T00:52:30.254 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.253+0000 7f7cbd742800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:52:30.254 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.253+0000 7f7cbd742800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:52:30.254 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.253+0000 7f7cbd742800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:30.254 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.253+0000 7f7cbd742800 20 zonegroup default 2024-09-12T00:52:30.254 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.253+0000 7f7cbd742800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.254 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.253+0000 7f7cbd742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.254 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.253+0000 7f7cbd742800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.254 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.253+0000 7f7cbd742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.254 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.253+0000 7f7cbd742800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.254 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.253+0000 7f7cbd742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.255 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.253+0000 7f7cbd742800 20 started sync module instance, tier type = 2024-09-12T00:52:30.255 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.253+0000 7f7cbd742800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:52:30.263 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.263+0000 7f7cbd742800 20 add_watcher() i=0 2024-09-12T00:52:30.263 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.263+0000 7f7cbd742800 20 add_watcher() i=1 2024-09-12T00:52:30.263 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.263+0000 7f7cbd742800 20 add_watcher() i=2 2024-09-12T00:52:30.263 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.263+0000 7f7cbd742800 20 add_watcher() i=3 2024-09-12T00:52:30.263 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.263+0000 7f7cbd742800 20 add_watcher() i=4 2024-09-12T00:52:30.263 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.263+0000 7f7cbd742800 20 add_watcher() i=5 2024-09-12T00:52:30.263 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.263+0000 7f7cbd742800 20 add_watcher() i=6 2024-09-12T00:52:30.264 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.264+0000 7f7cbd742800 20 add_watcher() i=7 2024-09-12T00:52:30.264 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.264+0000 7f7cbd742800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:30.265 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.265+0000 7f7b6ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:30.266 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.266+0000 7f7cbd742800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:30.266 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.266+0000 7f7cbd742800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:30.266 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.266+0000 7f7cbd742800 5 note: GC not initialized 2024-09-12T00:52:30.267 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.266+0000 7f7b6efe5640 20 reqs_thread_entry: start 2024-09-12T00:52:30.267 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.266+0000 7f7cbd742800 20 init_complete bucket index max shards: 1 2024-09-12T00:52:30.267 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.266+0000 7f7cbd742800 20 Filter name: none 2024-09-12T00:52:30.267 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.266+0000 7f7b6cfe1640 20 reqs_thread_entry: start 2024-09-12T00:52:30.267 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.266+0000 7f7cbd742800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.268 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.267+0000 7f7cbd742800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:52:30.269 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.267+0000 7f7cbd742800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.269 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.267+0000 7f7cbd742800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:52:30.269 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.267+0000 7f7cbd742800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:52:30.269 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.267+0000 7f7cbd742800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.269 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.268+0000 7f7cbd742800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:52:30.269 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.268+0000 7f7cbd742800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.269 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.268+0000 7f7cbd742800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:52:30.269 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.268+0000 7f7cbd742800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:52:30.269 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.269+0000 7f7b6ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:30.271 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.271+0000 7f7cbd742800 20 remove_watcher() i=0 2024-09-12T00:52:30.271 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.271+0000 7f7cbd742800 2 removed watcher, disabling cache 2024-09-12T00:52:30.272 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.273+0000 7f7cbd742800 20 remove_watcher() i=1 2024-09-12T00:52:30.273 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.273+0000 7f7cbd742800 20 remove_watcher() i=2 2024-09-12T00:52:30.274 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.274+0000 7f7cbd742800 20 remove_watcher() i=3 2024-09-12T00:52:30.275 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.275+0000 7f7cbd742800 20 remove_watcher() i=4 2024-09-12T00:52:30.276 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.277+0000 7f7cbd742800 20 remove_watcher() i=5 2024-09-12T00:52:30.277 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.278+0000 7f7cbd742800 20 remove_watcher() i=6 2024-09-12T00:52:30.278 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.279+0000 7f7cbd742800 20 remove_watcher() i=7 2024-09-12T00:52:30.289 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:52:30.289 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:52:30.289 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: abort-at-logrecord-writes id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:52:30.289 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:52:30.290 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-12T00:52:30.325 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:30.325 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:30.362 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.362+0000 7fd400740800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.364 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.363+0000 7fd400740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.364 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.363+0000 7fd400740800 20 realm 2024-09-12T00:52:30.364 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.363+0000 7fd400740800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.364 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.363+0000 7fd400740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.364 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.363+0000 7fd400740800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:30.364 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.364+0000 7fd400740800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.364 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.364+0000 7fd400740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.364 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.364+0000 7fd400740800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.365 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.365+0000 7fd400740800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:30.365 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.365+0000 7fd400740800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.365 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.365+0000 7fd400740800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:30.365 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.365+0000 7fd400740800 20 searching for the correct realm 2024-09-12T00:52:30.367 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.367+0000 7fd3fccc1640 0 -- 172.21.15.73:0/3795595100 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fd3e4017040 msgr2=0x7fd3e4067870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:52:30.572 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.573+0000 7fd3fccc1640 0 -- 172.21.15.73:0/3795595100 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fd3e4017040 msgr2=0x7fd3e4067870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:30.576 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.576+0000 7fd400740800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:52:30.576 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.576+0000 7fd400740800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:30.576 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.576+0000 7fd400740800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:52:30.576 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.576+0000 7fd400740800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:30.576 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.576+0000 7fd400740800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:30.576 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.576+0000 7fd400740800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:30.576 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.576+0000 7fd400740800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.577 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.576+0000 7fd400740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.577 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.576+0000 7fd400740800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.577 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.576+0000 7fd400740800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:30.577 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.576+0000 7fd400740800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.578 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.577+0000 7fd400740800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:30.578 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.577+0000 7fd400740800 20 zone default found 2024-09-12T00:52:30.578 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.577+0000 7fd400740800 4 Realm: () 2024-09-12T00:52:30.578 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.577+0000 7fd400740800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:52:30.578 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.577+0000 7fd400740800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:52:30.578 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.577+0000 7fd400740800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:30.578 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.577+0000 7fd400740800 20 zonegroup default 2024-09-12T00:52:30.578 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.577+0000 7fd400740800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.578 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.577+0000 7fd400740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.579 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.577+0000 7fd400740800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.579 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.577+0000 7fd400740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.579 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.577+0000 7fd400740800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.579 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.577+0000 7fd400740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.579 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.577+0000 7fd400740800 20 started sync module instance, tier type = 2024-09-12T00:52:30.579 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.577+0000 7fd400740800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:52:30.585 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.586+0000 7fd400740800 20 add_watcher() i=0 2024-09-12T00:52:30.586 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.586+0000 7fd400740800 20 add_watcher() i=1 2024-09-12T00:52:30.586 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.586+0000 7fd400740800 20 add_watcher() i=2 2024-09-12T00:52:30.586 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.586+0000 7fd400740800 20 add_watcher() i=3 2024-09-12T00:52:30.586 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.586+0000 7fd400740800 20 add_watcher() i=4 2024-09-12T00:52:30.586 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.586+0000 7fd400740800 20 add_watcher() i=5 2024-09-12T00:52:30.586 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.586+0000 7fd400740800 20 add_watcher() i=6 2024-09-12T00:52:30.586 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.587+0000 7fd400740800 20 add_watcher() i=7 2024-09-12T00:52:30.586 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.587+0000 7fd400740800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:30.588 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.589+0000 7fd2b2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:30.589 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.589+0000 7fd400740800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:30.589 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.589+0000 7fd400740800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:30.589 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.589+0000 7fd400740800 5 note: GC not initialized 2024-09-12T00:52:30.589 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.589+0000 7fd2b1fdb640 20 reqs_thread_entry: start 2024-09-12T00:52:30.589 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.589+0000 7fd400740800 20 init_complete bucket index max shards: 1 2024-09-12T00:52:30.589 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.589+0000 7fd400740800 20 Filter name: none 2024-09-12T00:52:30.590 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.589+0000 7fd2237fe640 20 reqs_thread_entry: start 2024-09-12T00:52:30.590 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.589+0000 7fd400740800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:52:30.590 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.589+0000 7fd400740800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.590 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.590+0000 7fd400740800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:52:30.591 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.590+0000 7fd400740800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:52:30.591 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.590+0000 7fd400740800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:52:30.591 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.590+0000 7fd400740800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36 : miss 2024-09-12T00:52:30.591 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.590+0000 7fd400740800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.591 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.590+0000 7fd400740800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:52:30.591 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.590+0000 7fd400740800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36 info.flags=0x17 2024-09-12T00:52:30.591 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.590+0000 7fd400740800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36 to cache LRU end 2024-09-12T00:52:30.591 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.590+0000 7fd400740800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:52:30.591 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.590+0000 7fd400740800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:30.591 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.590+0000 7fd400740800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36 2024-09-12T00:52:30.594 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.594+0000 7fd400740800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36 info.flags=0x17 2024-09-12T00:52:30.594 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.594+0000 7fd400740800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36 to cache LRU end 2024-09-12T00:52:30.594 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.594+0000 7fd400740800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:30.594 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.594+0000 7fd400740800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36, ofs0, ns] 2024-09-12T00:52:30.594 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.594+0000 7fd2d37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497011 cookie 94853157291808 notifier 7758 bl.length()=923 2024-09-12T00:52:30.594 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.594+0000 7fd2d37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36 info.flags=0x17 2024-09-12T00:52:30.594 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.594+0000 7fd2d37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36 to cache LRU end 2024-09-12T00:52:30.594 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.594+0000 7fd2d37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:30.595 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.596+0000 7fd400740800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36]): orig_sources= new_sources= 2024-09-12T00:52:30.595 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.596+0000 7fd400740800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36]): potential sources added=[] removed=[] 2024-09-12T00:52:30.596 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.596+0000 7fd400740800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36]): orig_dests= new_dests= 2024-09-12T00:52:30.596 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.596+0000 7fd400740800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36]): potential dests added=[] removed=[] 2024-09-12T00:52:30.596 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd400740800 time 2024-09-12T00:52:30.599126+0000 2024-09-12T00:52:30.597 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:52:30.597 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:52:30.597 INFO:tasks.workunit.client.0.smithi073.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd401f8c71a] 2024-09-12T00:52:30.597 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd401f8c8d8] 2024-09-12T00:52:30.598 INFO:tasks.workunit.client.0.smithi073.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5644b6cc1641] 2024-09-12T00:52:30.598 INFO:tasks.workunit.client.0.smithi073.stderr: 4: radosgw-admin(+0xd8854c) [0x5644b71d454c] 2024-09-12T00:52:30.598 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5644b6cd131d] 2024-09-12T00:52:30.598 INFO:tasks.workunit.client.0.smithi073.stderr: 6: main() 2024-09-12T00:52:30.598 INFO:tasks.workunit.client.0.smithi073.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fd400c29590] 2024-09-12T00:52:30.598 INFO:tasks.workunit.client.0.smithi073.stderr: 8: __libc_start_main() 2024-09-12T00:52:30.598 INFO:tasks.workunit.client.0.smithi073.stderr: 9: _start() 2024-09-12T00:52:30.598 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.598+0000 7fd400740800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd400740800 time 2024-09-12T00:52:30.599126+0000 2024-09-12T00:52:30.598 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:52:30.598 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:52:30.598 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:52:30.598 INFO:tasks.workunit.client.0.smithi073.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd401f8c71a] 2024-09-12T00:52:30.598 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd401f8c8d8] 2024-09-12T00:52:30.599 INFO:tasks.workunit.client.0.smithi073.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5644b6cc1641] 2024-09-12T00:52:30.599 INFO:tasks.workunit.client.0.smithi073.stderr: 4: radosgw-admin(+0xd8854c) [0x5644b71d454c] 2024-09-12T00:52:30.599 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5644b6cd131d] 2024-09-12T00:52:30.599 INFO:tasks.workunit.client.0.smithi073.stderr: 6: main() 2024-09-12T00:52:30.599 INFO:tasks.workunit.client.0.smithi073.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fd400c29590] 2024-09-12T00:52:30.599 INFO:tasks.workunit.client.0.smithi073.stderr: 8: __libc_start_main() 2024-09-12T00:52:30.599 INFO:tasks.workunit.client.0.smithi073.stderr: 9: _start() 2024-09-12T00:52:30.599 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:52:30.599 INFO:tasks.workunit.client.0.smithi073.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:52:30.599 INFO:tasks.workunit.client.0.smithi073.stderr: in thread 7fd400740800 thread_name:radosgw-admin 2024-09-12T00:52:30.619 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:52:30.619 INFO:tasks.workunit.client.0.smithi073.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd400c3e6f0] 2024-09-12T00:52:30.619 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd400c8b99c] 2024-09-12T00:52:30.619 INFO:tasks.workunit.client.0.smithi073.stderr: 3: raise() 2024-09-12T00:52:30.619 INFO:tasks.workunit.client.0.smithi073.stderr: 4: abort() 2024-09-12T00:52:30.619 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd401f8c774] 2024-09-12T00:52:30.619 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd401f8c8d8] 2024-09-12T00:52:30.619 INFO:tasks.workunit.client.0.smithi073.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5644b6cc1641] 2024-09-12T00:52:30.619 INFO:tasks.workunit.client.0.smithi073.stderr: 8: radosgw-admin(+0xd8854c) [0x5644b71d454c] 2024-09-12T00:52:30.619 INFO:tasks.workunit.client.0.smithi073.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5644b6cd131d] 2024-09-12T00:52:30.619 INFO:tasks.workunit.client.0.smithi073.stderr: 10: main() 2024-09-12T00:52:30.620 INFO:tasks.workunit.client.0.smithi073.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fd400c29590] 2024-09-12T00:52:30.620 INFO:tasks.workunit.client.0.smithi073.stderr: 12: __libc_start_main() 2024-09-12T00:52:30.620 INFO:tasks.workunit.client.0.smithi073.stderr: 13: _start() 2024-09-12T00:52:30.620 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.599+0000 7fd400740800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:52:30.620 INFO:tasks.workunit.client.0.smithi073.stderr: in thread 7fd400740800 thread_name:radosgw-admin 2024-09-12T00:52:30.620 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:52:30.620 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:52:30.620 INFO:tasks.workunit.client.0.smithi073.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd400c3e6f0] 2024-09-12T00:52:30.620 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd400c8b99c] 2024-09-12T00:52:30.620 INFO:tasks.workunit.client.0.smithi073.stderr: 3: raise() 2024-09-12T00:52:30.620 INFO:tasks.workunit.client.0.smithi073.stderr: 4: abort() 2024-09-12T00:52:30.620 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd401f8c774] 2024-09-12T00:52:30.621 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd401f8c8d8] 2024-09-12T00:52:30.621 INFO:tasks.workunit.client.0.smithi073.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5644b6cc1641] 2024-09-12T00:52:30.621 INFO:tasks.workunit.client.0.smithi073.stderr: 8: radosgw-admin(+0xd8854c) [0x5644b71d454c] 2024-09-12T00:52:30.621 INFO:tasks.workunit.client.0.smithi073.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5644b6cd131d] 2024-09-12T00:52:30.621 INFO:tasks.workunit.client.0.smithi073.stderr: 10: main() 2024-09-12T00:52:30.621 INFO:tasks.workunit.client.0.smithi073.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fd400c29590] 2024-09-12T00:52:30.621 INFO:tasks.workunit.client.0.smithi073.stderr: 12: __libc_start_main() 2024-09-12T00:52:30.621 INFO:tasks.workunit.client.0.smithi073.stderr: 13: _start() 2024-09-12T00:52:30.621 INFO:tasks.workunit.client.0.smithi073.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:52:30.621 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:52:30.621 INFO:tasks.workunit.client.0.smithi073.stderr:--- begin dump of recent events --- 2024-09-12T00:52:30.621 INFO:tasks.workunit.client.0.smithi073.stderr: -499> 2024-09-12T00:52:30.344+0000 7fd2ea60c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:52:30.621 INFO:tasks.workunit.client.0.smithi073.stderr: -498> 2024-09-12T00:52:30.344+0000 7fd2ea60c640 10 monclient: dump: 2024-09-12T00:52:30.622 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:52:30.622 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:52:30.622 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:52:30.622 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:52:30.622 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:30.622 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:52:30.622 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:52:30.622 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:52:30.622 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:52:30.622 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:52:30.622 INFO:tasks.workunit.client.0.smithi073.stderr: -497> 2024-09-12T00:52:30.345+0000 7fd400740800 10 monclient: shutdown 2024-09-12T00:52:30.622 INFO:tasks.workunit.client.0.smithi073.stderr: -496> 2024-09-12T00:52:30.345+0000 7fd400740800 5 asok(0x5644b88d1630) unregister_commands rotate-key 2024-09-12T00:52:30.623 INFO:tasks.workunit.client.0.smithi073.stderr: -495> 2024-09-12T00:52:30.345+0000 7fd400740800 10 monclient: build_initial_monmap 2024-09-12T00:52:30.623 INFO:tasks.workunit.client.0.smithi073.stderr: -494> 2024-09-12T00:52:30.345+0000 7fd400740800 1 build_initial for_mkfs: 0 2024-09-12T00:52:30.623 INFO:tasks.workunit.client.0.smithi073.stderr: -493> 2024-09-12T00:52:30.345+0000 7fd400740800 10 monclient: monmap: 2024-09-12T00:52:30.623 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:52:30.623 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:52:30.623 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:52:30.623 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:52:30.623 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:52:30.623 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:52:30.623 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:52:30.623 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:52:30.623 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:52:30.623 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:52:30.623 INFO:tasks.workunit.client.0.smithi073.stderr: -492> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af6390) adding auth protocol: cephx 2024-09-12T00:52:30.624 INFO:tasks.workunit.client.0.smithi073.stderr: -491> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af6390) adding auth protocol: cephx 2024-09-12T00:52:30.624 INFO:tasks.workunit.client.0.smithi073.stderr: -490> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af6390) adding auth protocol: cephx 2024-09-12T00:52:30.624 INFO:tasks.workunit.client.0.smithi073.stderr: -489> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af6390) adding con mode: secure 2024-09-12T00:52:30.624 INFO:tasks.workunit.client.0.smithi073.stderr: -488> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af6390) adding con mode: crc 2024-09-12T00:52:30.624 INFO:tasks.workunit.client.0.smithi073.stderr: -487> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af6390) adding con mode: secure 2024-09-12T00:52:30.624 INFO:tasks.workunit.client.0.smithi073.stderr: -486> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af6390) adding con mode: crc 2024-09-12T00:52:30.624 INFO:tasks.workunit.client.0.smithi073.stderr: -485> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af6390) adding con mode: secure 2024-09-12T00:52:30.624 INFO:tasks.workunit.client.0.smithi073.stderr: -484> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af6390) adding con mode: crc 2024-09-12T00:52:30.624 INFO:tasks.workunit.client.0.smithi073.stderr: -483> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af6390) adding con mode: crc 2024-09-12T00:52:30.624 INFO:tasks.workunit.client.0.smithi073.stderr: -482> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af6390) adding con mode: secure 2024-09-12T00:52:30.624 INFO:tasks.workunit.client.0.smithi073.stderr: -481> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af6390) adding con mode: crc 2024-09-12T00:52:30.624 INFO:tasks.workunit.client.0.smithi073.stderr: -480> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af6390) adding con mode: secure 2024-09-12T00:52:30.625 INFO:tasks.workunit.client.0.smithi073.stderr: -479> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af6390) adding con mode: crc 2024-09-12T00:52:30.625 INFO:tasks.workunit.client.0.smithi073.stderr: -478> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af6390) adding con mode: secure 2024-09-12T00:52:30.625 INFO:tasks.workunit.client.0.smithi073.stderr: -477> 2024-09-12T00:52:30.345+0000 7fd400740800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:30.625 INFO:tasks.workunit.client.0.smithi073.stderr: -476> 2024-09-12T00:52:30.345+0000 7fd400740800 1 librados: starting msgr at 2024-09-12T00:52:30.625 INFO:tasks.workunit.client.0.smithi073.stderr: -475> 2024-09-12T00:52:30.345+0000 7fd400740800 1 librados: starting objecter 2024-09-12T00:52:30.625 INFO:tasks.workunit.client.0.smithi073.stderr: -474> 2024-09-12T00:52:30.345+0000 7fd400740800 5 asok(0x5644b88d1630) register_command objecter_requests hook 0x5644b8af2e40 2024-09-12T00:52:30.625 INFO:tasks.workunit.client.0.smithi073.stderr: -473> 2024-09-12T00:52:30.345+0000 7fd400740800 1 librados: setting wanted keys 2024-09-12T00:52:30.625 INFO:tasks.workunit.client.0.smithi073.stderr: -472> 2024-09-12T00:52:30.345+0000 7fd400740800 1 librados: calling monclient init 2024-09-12T00:52:30.625 INFO:tasks.workunit.client.0.smithi073.stderr: -471> 2024-09-12T00:52:30.345+0000 7fd400740800 10 monclient: init 2024-09-12T00:52:30.625 INFO:tasks.workunit.client.0.smithi073.stderr: -470> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af0870) adding auth protocol: cephx 2024-09-12T00:52:30.626 INFO:tasks.workunit.client.0.smithi073.stderr: -469> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af0870) adding auth protocol: cephx 2024-09-12T00:52:30.626 INFO:tasks.workunit.client.0.smithi073.stderr: -468> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af0870) adding auth protocol: cephx 2024-09-12T00:52:30.626 INFO:tasks.workunit.client.0.smithi073.stderr: -467> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af0870) adding con mode: secure 2024-09-12T00:52:30.626 INFO:tasks.workunit.client.0.smithi073.stderr: -466> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af0870) adding con mode: crc 2024-09-12T00:52:30.626 INFO:tasks.workunit.client.0.smithi073.stderr: -465> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af0870) adding con mode: secure 2024-09-12T00:52:30.626 INFO:tasks.workunit.client.0.smithi073.stderr: -464> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af0870) adding con mode: crc 2024-09-12T00:52:30.626 INFO:tasks.workunit.client.0.smithi073.stderr: -463> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af0870) adding con mode: secure 2024-09-12T00:52:30.626 INFO:tasks.workunit.client.0.smithi073.stderr: -462> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af0870) adding con mode: crc 2024-09-12T00:52:30.626 INFO:tasks.workunit.client.0.smithi073.stderr: -461> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af0870) adding con mode: crc 2024-09-12T00:52:30.626 INFO:tasks.workunit.client.0.smithi073.stderr: -460> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af0870) adding con mode: secure 2024-09-12T00:52:30.626 INFO:tasks.workunit.client.0.smithi073.stderr: -459> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af0870) adding con mode: crc 2024-09-12T00:52:30.626 INFO:tasks.workunit.client.0.smithi073.stderr: -458> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af0870) adding con mode: secure 2024-09-12T00:52:30.627 INFO:tasks.workunit.client.0.smithi073.stderr: -457> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af0870) adding con mode: crc 2024-09-12T00:52:30.627 INFO:tasks.workunit.client.0.smithi073.stderr: -456> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af0870) adding con mode: secure 2024-09-12T00:52:30.627 INFO:tasks.workunit.client.0.smithi073.stderr: -455> 2024-09-12T00:52:30.346+0000 7fd400740800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:30.627 INFO:tasks.workunit.client.0.smithi073.stderr: -454> 2024-09-12T00:52:30.346+0000 7fd400740800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:30.627 INFO:tasks.workunit.client.0.smithi073.stderr: -453> 2024-09-12T00:52:30.346+0000 7fd400740800 5 asok(0x5644b88d1630) register_command rotate-key hook 0x5644b8af09b8 2024-09-12T00:52:30.627 INFO:tasks.workunit.client.0.smithi073.stderr: -452> 2024-09-12T00:52:30.346+0000 7fd400740800 10 monclient: _reopen_session rank -1 2024-09-12T00:52:30.627 INFO:tasks.workunit.client.0.smithi073.stderr: -451> 2024-09-12T00:52:30.346+0000 7fd400740800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:52:30.627 INFO:tasks.workunit.client.0.smithi073.stderr: -450> 2024-09-12T00:52:30.346+0000 7fd400740800 10 monclient(hunting): picked mon.noname-c con 0x5644b89a68b0 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:52:30.627 INFO:tasks.workunit.client.0.smithi073.stderr: -449> 2024-09-12T00:52:30.346+0000 7fd400740800 10 monclient(hunting): picked mon.noname-b con 0x5644b89a9b00 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:52:30.627 INFO:tasks.workunit.client.0.smithi073.stderr: -448> 2024-09-12T00:52:30.346+0000 7fd400740800 10 monclient(hunting): picked mon.noname-a con 0x5644b8b22760 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:52:30.627 INFO:tasks.workunit.client.0.smithi073.stderr: -447> 2024-09-12T00:52:30.346+0000 7fd400740800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:30.628 INFO:tasks.workunit.client.0.smithi073.stderr: -446> 2024-09-12T00:52:30.346+0000 7fd400740800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:30.628 INFO:tasks.workunit.client.0.smithi073.stderr: -445> 2024-09-12T00:52:30.346+0000 7fd400740800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:30.628 INFO:tasks.workunit.client.0.smithi073.stderr: -444> 2024-09-12T00:52:30.346+0000 7fd400740800 10 monclient(hunting): _renew_subs 2024-09-12T00:52:30.628 INFO:tasks.workunit.client.0.smithi073.stderr: -443> 2024-09-12T00:52:30.346+0000 7fd400740800 10 monclient(hunting): authenticate will time out at 2211.017517s 2024-09-12T00:52:30.628 INFO:tasks.workunit.client.0.smithi073.stderr: -442> 2024-09-12T00:52:30.346+0000 7fd3fc4c0640 10 monclient(hunting): get_auth_request con 0x5644b89a68b0 auth_method 0 2024-09-12T00:52:30.628 INFO:tasks.workunit.client.0.smithi073.stderr: -441> 2024-09-12T00:52:30.346+0000 7fd3fc4c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:30.628 INFO:tasks.workunit.client.0.smithi073.stderr: -440> 2024-09-12T00:52:30.346+0000 7fd3fc4c0640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:30.628 INFO:tasks.workunit.client.0.smithi073.stderr: -439> 2024-09-12T00:52:30.346+0000 7fd3fc4c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:30.628 INFO:tasks.workunit.client.0.smithi073.stderr: -438> 2024-09-12T00:52:30.346+0000 7fd3fccc1640 10 monclient(hunting): get_auth_request con 0x5644b8b22760 auth_method 0 2024-09-12T00:52:30.628 INFO:tasks.workunit.client.0.smithi073.stderr: -437> 2024-09-12T00:52:30.346+0000 7fd3fccc1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:30.628 INFO:tasks.workunit.client.0.smithi073.stderr: -436> 2024-09-12T00:52:30.346+0000 7fd3fccc1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:30.628 INFO:tasks.workunit.client.0.smithi073.stderr: -435> 2024-09-12T00:52:30.346+0000 7fd3fccc1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:30.628 INFO:tasks.workunit.client.0.smithi073.stderr: -434> 2024-09-12T00:52:30.346+0000 7fd3fccc1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:30.629 INFO:tasks.workunit.client.0.smithi073.stderr: -433> 2024-09-12T00:52:30.346+0000 7fd3fccc1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:30.629 INFO:tasks.workunit.client.0.smithi073.stderr: -432> 2024-09-12T00:52:30.346+0000 7fd3fccc1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:30.629 INFO:tasks.workunit.client.0.smithi073.stderr: -431> 2024-09-12T00:52:30.346+0000 7fd3fc4c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:30.629 INFO:tasks.workunit.client.0.smithi073.stderr: -430> 2024-09-12T00:52:30.346+0000 7fd3fc4c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:30.629 INFO:tasks.workunit.client.0.smithi073.stderr: -429> 2024-09-12T00:52:30.346+0000 7fd3fc4c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:30.629 INFO:tasks.workunit.client.0.smithi073.stderr: -428> 2024-09-12T00:52:30.346+0000 7fd3f3fff640 10 monclient(hunting): get_auth_request con 0x5644b89a9b00 auth_method 0 2024-09-12T00:52:30.629 INFO:tasks.workunit.client.0.smithi073.stderr: -427> 2024-09-12T00:52:30.346+0000 7fd3f3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:30.629 INFO:tasks.workunit.client.0.smithi073.stderr: -426> 2024-09-12T00:52:30.346+0000 7fd3f3fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:30.629 INFO:tasks.workunit.client.0.smithi073.stderr: -425> 2024-09-12T00:52:30.346+0000 7fd3f3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:30.629 INFO:tasks.workunit.client.0.smithi073.stderr: -424> 2024-09-12T00:52:30.346+0000 7fd3fccc1640 10 monclient(hunting): handle_auth_done global_id 7749 payload 824 2024-09-12T00:52:30.629 INFO:tasks.workunit.client.0.smithi073.stderr: -423> 2024-09-12T00:52:30.346+0000 7fd3fccc1640 10 monclient: _finish_hunting 0 2024-09-12T00:52:30.629 INFO:tasks.workunit.client.0.smithi073.stderr: -422> 2024-09-12T00:52:30.346+0000 7fd3fccc1640 1 monclient: found mon.noname-a 2024-09-12T00:52:30.630 INFO:tasks.workunit.client.0.smithi073.stderr: -421> 2024-09-12T00:52:30.346+0000 7fd3fccc1640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:52:30.630 INFO:tasks.workunit.client.0.smithi073.stderr: -420> 2024-09-12T00:52:30.347+0000 7fd2e8e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:30.630 INFO:tasks.workunit.client.0.smithi073.stderr: -419> 2024-09-12T00:52:30.347+0000 7fd2e8e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:52:30.630 INFO:tasks.workunit.client.0.smithi073.stderr: -418> 2024-09-12T00:52:30.347+0000 7fd2e8e09640 10 monclient: dump: 2024-09-12T00:52:30.630 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:52:30.630 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:52:30.630 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:52:30.630 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:52:30.630 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:30.630 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:52:30.630 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:52:30.630 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:52:30.630 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:52:30.630 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:52:30.631 INFO:tasks.workunit.client.0.smithi073.stderr: -417> 2024-09-12T00:52:30.347+0000 7fd2e8e09640 10 monclient: _finish_auth 0 2024-09-12T00:52:30.631 INFO:tasks.workunit.client.0.smithi073.stderr: -416> 2024-09-12T00:52:30.347+0000 7fd2e8e09640 10 monclient: _check_auth_tickets 2024-09-12T00:52:30.631 INFO:tasks.workunit.client.0.smithi073.stderr: -415> 2024-09-12T00:52:30.347+0000 7fd2e8e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:52:30.631 INFO:tasks.workunit.client.0.smithi073.stderr: -414> 2024-09-12T00:52:30.347+0000 7fd2e8e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:30.631 INFO:tasks.workunit.client.0.smithi073.stderr: -413> 2024-09-12T00:52:30.347+0000 7fd2e8e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:52:30.631 INFO:tasks.workunit.client.0.smithi073.stderr: -412> 2024-09-12T00:52:30.347+0000 7fd2e8e09640 10 monclient: dump: 2024-09-12T00:52:30.631 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:52:30.631 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:52:30.631 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:52:30.631 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:52:30.631 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:30.631 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:52:30.632 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:52:30.632 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:52:30.632 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:52:30.632 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:52:30.632 INFO:tasks.workunit.client.0.smithi073.stderr: -411> 2024-09-12T00:52:30.347+0000 7fd400740800 5 monclient: authenticate success, global_id 7749 2024-09-12T00:52:30.632 INFO:tasks.workunit.client.0.smithi073.stderr: -410> 2024-09-12T00:52:30.347+0000 7fd400740800 10 monclient: _renew_subs 2024-09-12T00:52:30.632 INFO:tasks.workunit.client.0.smithi073.stderr: -409> 2024-09-12T00:52:30.347+0000 7fd400740800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:52:30.632 INFO:tasks.workunit.client.0.smithi073.stderr: -408> 2024-09-12T00:52:30.347+0000 7fd2ea60c640 4 set_mon_vals no callback set 2024-09-12T00:52:30.632 INFO:tasks.workunit.client.0.smithi073.stderr: -407> 2024-09-12T00:52:30.347+0000 7fd400740800 10 monclient: _renew_subs 2024-09-12T00:52:30.632 INFO:tasks.workunit.client.0.smithi073.stderr: -406> 2024-09-12T00:52:30.347+0000 7fd400740800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:52:30.632 INFO:tasks.workunit.client.0.smithi073.stderr: -405> 2024-09-12T00:52:30.347+0000 7fd400740800 1 librados: init done 2024-09-12T00:52:30.632 INFO:tasks.workunit.client.0.smithi073.stderr: -404> 2024-09-12T00:52:30.349+0000 7fd2e8e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:52:30.632 INFO:tasks.workunit.client.0.smithi073.stderr: -403> 2024-09-12T00:52:30.349+0000 7fd2e8e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:52:30.633 INFO:tasks.workunit.client.0.smithi073.stderr: -402> 2024-09-12T00:52:30.349+0000 7fd2e8e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:52:30.633 INFO:tasks.workunit.client.0.smithi073.stderr: -401> 2024-09-12T00:52:30.349+0000 7fd3fc4c0640 10 monclient: get_auth_request con 0x7fd2e4076470 auth_method 0 2024-09-12T00:52:30.633 INFO:tasks.workunit.client.0.smithi073.stderr: -400> 2024-09-12T00:52:30.349+0000 7fd3f3fff640 10 monclient: get_auth_request con 0x5644b8b19440 auth_method 0 2024-09-12T00:52:30.633 INFO:tasks.workunit.client.0.smithi073.stderr: -399> 2024-09-12T00:52:30.350+0000 7fd3fc4c0640 10 monclient: get_auth_request con 0x5644b8b3d410 auth_method 0 2024-09-12T00:52:30.633 INFO:tasks.workunit.client.0.smithi073.stderr: -398> 2024-09-12T00:52:30.351+0000 7fd3f3fff640 10 monclient: get_auth_request con 0x5644b8b41770 auth_method 0 2024-09-12T00:52:30.633 INFO:tasks.workunit.client.0.smithi073.stderr: -397> 2024-09-12T00:52:30.352+0000 7fd400740800 10 monclient: build_initial_monmap 2024-09-12T00:52:30.633 INFO:tasks.workunit.client.0.smithi073.stderr: -396> 2024-09-12T00:52:30.352+0000 7fd400740800 1 build_initial for_mkfs: 0 2024-09-12T00:52:30.633 INFO:tasks.workunit.client.0.smithi073.stderr: -395> 2024-09-12T00:52:30.352+0000 7fd400740800 10 monclient: monmap: 2024-09-12T00:52:30.633 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:52:30.633 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:52:30.633 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:52:30.633 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:52:30.633 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:52:30.634 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:52:30.634 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:52:30.634 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:52:30.634 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:52:30.634 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:52:30.634 INFO:tasks.workunit.client.0.smithi073.stderr: -394> 2024-09-12T00:52:30.352+0000 7fd400740800 5 AuthRegistry(0x5644b8b46520) adding auth protocol: cephx 2024-09-12T00:52:30.634 INFO:tasks.workunit.client.0.smithi073.stderr: -393> 2024-09-12T00:52:30.352+0000 7fd400740800 5 AuthRegistry(0x5644b8b46520) adding auth protocol: cephx 2024-09-12T00:52:30.634 INFO:tasks.workunit.client.0.smithi073.stderr: -392> 2024-09-12T00:52:30.352+0000 7fd400740800 5 AuthRegistry(0x5644b8b46520) adding auth protocol: cephx 2024-09-12T00:52:30.634 INFO:tasks.workunit.client.0.smithi073.stderr: -391> 2024-09-12T00:52:30.352+0000 7fd400740800 5 AuthRegistry(0x5644b8b46520) adding con mode: secure 2024-09-12T00:52:30.634 INFO:tasks.workunit.client.0.smithi073.stderr: -390> 2024-09-12T00:52:30.352+0000 7fd400740800 5 AuthRegistry(0x5644b8b46520) adding con mode: crc 2024-09-12T00:52:30.634 INFO:tasks.workunit.client.0.smithi073.stderr: -389> 2024-09-12T00:52:30.352+0000 7fd400740800 5 AuthRegistry(0x5644b8b46520) adding con mode: secure 2024-09-12T00:52:30.634 INFO:tasks.workunit.client.0.smithi073.stderr: -388> 2024-09-12T00:52:30.352+0000 7fd400740800 5 AuthRegistry(0x5644b8b46520) adding con mode: crc 2024-09-12T00:52:30.634 INFO:tasks.workunit.client.0.smithi073.stderr: -387> 2024-09-12T00:52:30.352+0000 7fd400740800 5 AuthRegistry(0x5644b8b46520) adding con mode: secure 2024-09-12T00:52:30.635 INFO:tasks.workunit.client.0.smithi073.stderr: -386> 2024-09-12T00:52:30.352+0000 7fd400740800 5 AuthRegistry(0x5644b8b46520) adding con mode: crc 2024-09-12T00:52:30.635 INFO:tasks.workunit.client.0.smithi073.stderr: -385> 2024-09-12T00:52:30.352+0000 7fd400740800 5 AuthRegistry(0x5644b8b46520) adding con mode: crc 2024-09-12T00:52:30.635 INFO:tasks.workunit.client.0.smithi073.stderr: -384> 2024-09-12T00:52:30.352+0000 7fd400740800 5 AuthRegistry(0x5644b8b46520) adding con mode: secure 2024-09-12T00:52:30.635 INFO:tasks.workunit.client.0.smithi073.stderr: -383> 2024-09-12T00:52:30.352+0000 7fd400740800 5 AuthRegistry(0x5644b8b46520) adding con mode: crc 2024-09-12T00:52:30.635 INFO:tasks.workunit.client.0.smithi073.stderr: -382> 2024-09-12T00:52:30.352+0000 7fd400740800 5 AuthRegistry(0x5644b8b46520) adding con mode: secure 2024-09-12T00:52:30.635 INFO:tasks.workunit.client.0.smithi073.stderr: -381> 2024-09-12T00:52:30.352+0000 7fd400740800 5 AuthRegistry(0x5644b8b46520) adding con mode: crc 2024-09-12T00:52:30.635 INFO:tasks.workunit.client.0.smithi073.stderr: -380> 2024-09-12T00:52:30.352+0000 7fd400740800 5 AuthRegistry(0x5644b8b46520) adding con mode: secure 2024-09-12T00:52:30.635 INFO:tasks.workunit.client.0.smithi073.stderr: -379> 2024-09-12T00:52:30.353+0000 7fd400740800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:30.635 INFO:tasks.workunit.client.0.smithi073.stderr: -378> 2024-09-12T00:52:30.353+0000 7fd400740800 5 asok(0x5644b88d1630) register_command objecter_requests cmddesc objecter_requests hook 0x5644b8b49f50 EEXIST 2024-09-12T00:52:30.636 INFO:tasks.workunit.client.0.smithi073.stderr: -377> 2024-09-12T00:52:30.353+0000 7fd400740800 10 monclient: init 2024-09-12T00:52:30.636 INFO:tasks.workunit.client.0.smithi073.stderr: -376> 2024-09-12T00:52:30.353+0000 7fd400740800 5 AuthRegistry(0x5644b8b44c98) adding auth protocol: cephx 2024-09-12T00:52:30.636 INFO:tasks.workunit.client.0.smithi073.stderr: -375> 2024-09-12T00:52:30.353+0000 7fd400740800 5 AuthRegistry(0x5644b8b44c98) adding auth protocol: cephx 2024-09-12T00:52:30.636 INFO:tasks.workunit.client.0.smithi073.stderr: -374> 2024-09-12T00:52:30.353+0000 7fd400740800 5 AuthRegistry(0x5644b8b44c98) adding auth protocol: cephx 2024-09-12T00:52:30.636 INFO:tasks.workunit.client.0.smithi073.stderr: -373> 2024-09-12T00:52:30.353+0000 7fd400740800 5 AuthRegistry(0x5644b8b44c98) adding con mode: secure 2024-09-12T00:52:30.636 INFO:tasks.workunit.client.0.smithi073.stderr: -372> 2024-09-12T00:52:30.353+0000 7fd400740800 5 AuthRegistry(0x5644b8b44c98) adding con mode: crc 2024-09-12T00:52:30.636 INFO:tasks.workunit.client.0.smithi073.stderr: -371> 2024-09-12T00:52:30.353+0000 7fd400740800 5 AuthRegistry(0x5644b8b44c98) adding con mode: secure 2024-09-12T00:52:30.636 INFO:tasks.workunit.client.0.smithi073.stderr: -370> 2024-09-12T00:52:30.353+0000 7fd400740800 5 AuthRegistry(0x5644b8b44c98) adding con mode: crc 2024-09-12T00:52:30.636 INFO:tasks.workunit.client.0.smithi073.stderr: -369> 2024-09-12T00:52:30.353+0000 7fd400740800 5 AuthRegistry(0x5644b8b44c98) adding con mode: secure 2024-09-12T00:52:30.636 INFO:tasks.workunit.client.0.smithi073.stderr: -368> 2024-09-12T00:52:30.353+0000 7fd400740800 5 AuthRegistry(0x5644b8b44c98) adding con mode: crc 2024-09-12T00:52:30.636 INFO:tasks.workunit.client.0.smithi073.stderr: -367> 2024-09-12T00:52:30.353+0000 7fd400740800 5 AuthRegistry(0x5644b8b44c98) adding con mode: crc 2024-09-12T00:52:30.636 INFO:tasks.workunit.client.0.smithi073.stderr: -366> 2024-09-12T00:52:30.353+0000 7fd400740800 5 AuthRegistry(0x5644b8b44c98) adding con mode: secure 2024-09-12T00:52:30.637 INFO:tasks.workunit.client.0.smithi073.stderr: -365> 2024-09-12T00:52:30.353+0000 7fd400740800 5 AuthRegistry(0x5644b8b44c98) adding con mode: crc 2024-09-12T00:52:30.637 INFO:tasks.workunit.client.0.smithi073.stderr: -364> 2024-09-12T00:52:30.353+0000 7fd400740800 5 AuthRegistry(0x5644b8b44c98) adding con mode: secure 2024-09-12T00:52:30.637 INFO:tasks.workunit.client.0.smithi073.stderr: -363> 2024-09-12T00:52:30.353+0000 7fd400740800 5 AuthRegistry(0x5644b8b44c98) adding con mode: crc 2024-09-12T00:52:30.637 INFO:tasks.workunit.client.0.smithi073.stderr: -362> 2024-09-12T00:52:30.353+0000 7fd400740800 5 AuthRegistry(0x5644b8b44c98) adding con mode: secure 2024-09-12T00:52:30.637 INFO:tasks.workunit.client.0.smithi073.stderr: -361> 2024-09-12T00:52:30.353+0000 7fd400740800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:30.637 INFO:tasks.workunit.client.0.smithi073.stderr: -360> 2024-09-12T00:52:30.353+0000 7fd400740800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:30.637 INFO:tasks.workunit.client.0.smithi073.stderr: -359> 2024-09-12T00:52:30.353+0000 7fd400740800 5 asok(0x5644b88d1630) register_command rotate-key cmddesc rotate-key hook 0x5644b8b44de0 EEXIST 2024-09-12T00:52:30.637 INFO:tasks.workunit.client.0.smithi073.stderr: -358> 2024-09-12T00:52:30.353+0000 7fd400740800 10 monclient: _reopen_session rank -1 2024-09-12T00:52:30.637 INFO:tasks.workunit.client.0.smithi073.stderr: -357> 2024-09-12T00:52:30.353+0000 7fd400740800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:52:30.637 INFO:tasks.workunit.client.0.smithi073.stderr: -356> 2024-09-12T00:52:30.353+0000 7fd400740800 10 monclient(hunting): picked mon.noname-c con 0x5644b8b6dc40 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:52:30.637 INFO:tasks.workunit.client.0.smithi073.stderr: -355> 2024-09-12T00:52:30.353+0000 7fd400740800 10 monclient(hunting): picked mon.noname-a con 0x5644b8b6ff10 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:52:30.637 INFO:tasks.workunit.client.0.smithi073.stderr: -354> 2024-09-12T00:52:30.353+0000 7fd400740800 10 monclient(hunting): picked mon.noname-b con 0x5644b8b6c410 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:52:30.637 INFO:tasks.workunit.client.0.smithi073.stderr: -353> 2024-09-12T00:52:30.353+0000 7fd400740800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:30.638 INFO:tasks.workunit.client.0.smithi073.stderr: -352> 2024-09-12T00:52:30.353+0000 7fd400740800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:30.638 INFO:tasks.workunit.client.0.smithi073.stderr: -351> 2024-09-12T00:52:30.353+0000 7fd400740800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:30.638 INFO:tasks.workunit.client.0.smithi073.stderr: -350> 2024-09-12T00:52:30.353+0000 7fd400740800 10 monclient(hunting): _renew_subs 2024-09-12T00:52:30.638 INFO:tasks.workunit.client.0.smithi073.stderr: -349> 2024-09-12T00:52:30.353+0000 7fd400740800 10 monclient(hunting): authenticate will time out at 2211.024950s 2024-09-12T00:52:30.638 INFO:tasks.workunit.client.0.smithi073.stderr: -348> 2024-09-12T00:52:30.354+0000 7fd3fc4c0640 10 monclient(hunting): get_auth_request con 0x5644b8b6dc40 auth_method 0 2024-09-12T00:52:30.638 INFO:tasks.workunit.client.0.smithi073.stderr: -347> 2024-09-12T00:52:30.354+0000 7fd3fc4c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:30.638 INFO:tasks.workunit.client.0.smithi073.stderr: -346> 2024-09-12T00:52:30.354+0000 7fd3fc4c0640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:30.638 INFO:tasks.workunit.client.0.smithi073.stderr: -345> 2024-09-12T00:52:30.354+0000 7fd3fc4c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:30.638 INFO:tasks.workunit.client.0.smithi073.stderr: -344> 2024-09-12T00:52:30.354+0000 7fd3fccc1640 10 monclient(hunting): get_auth_request con 0x5644b8b6c410 auth_method 0 2024-09-12T00:52:30.638 INFO:tasks.workunit.client.0.smithi073.stderr: -343> 2024-09-12T00:52:30.354+0000 7fd3fccc1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:30.638 INFO:tasks.workunit.client.0.smithi073.stderr: -342> 2024-09-12T00:52:30.354+0000 7fd3fccc1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:30.638 INFO:tasks.workunit.client.0.smithi073.stderr: -341> 2024-09-12T00:52:30.354+0000 7fd3fccc1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:30.638 INFO:tasks.workunit.client.0.smithi073.stderr: -340> 2024-09-12T00:52:30.354+0000 7fd3f3fff640 10 monclient(hunting): get_auth_request con 0x5644b8b6ff10 auth_method 0 2024-09-12T00:52:30.639 INFO:tasks.workunit.client.0.smithi073.stderr: -339> 2024-09-12T00:52:30.354+0000 7fd3f3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:30.639 INFO:tasks.workunit.client.0.smithi073.stderr: -338> 2024-09-12T00:52:30.354+0000 7fd3f3fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:30.639 INFO:tasks.workunit.client.0.smithi073.stderr: -337> 2024-09-12T00:52:30.354+0000 7fd3f3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:30.639 INFO:tasks.workunit.client.0.smithi073.stderr: -336> 2024-09-12T00:52:30.354+0000 7fd3fc4c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:30.639 INFO:tasks.workunit.client.0.smithi073.stderr: -335> 2024-09-12T00:52:30.354+0000 7fd3fc4c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:30.639 INFO:tasks.workunit.client.0.smithi073.stderr: -334> 2024-09-12T00:52:30.354+0000 7fd3fc4c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:30.639 INFO:tasks.workunit.client.0.smithi073.stderr: -333> 2024-09-12T00:52:30.354+0000 7fd3fccc1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:30.639 INFO:tasks.workunit.client.0.smithi073.stderr: -332> 2024-09-12T00:52:30.354+0000 7fd3fccc1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:30.639 INFO:tasks.workunit.client.0.smithi073.stderr: -331> 2024-09-12T00:52:30.354+0000 7fd3fccc1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:30.639 INFO:tasks.workunit.client.0.smithi073.stderr: -330> 2024-09-12T00:52:30.354+0000 7fd3f3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:30.639 INFO:tasks.workunit.client.0.smithi073.stderr: -329> 2024-09-12T00:52:30.354+0000 7fd3f3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:30.639 INFO:tasks.workunit.client.0.smithi073.stderr: -328> 2024-09-12T00:52:30.354+0000 7fd3f3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:30.639 INFO:tasks.workunit.client.0.smithi073.stderr: -327> 2024-09-12T00:52:30.354+0000 7fd3f3fff640 10 monclient(hunting): handle_auth_done global_id 7752 payload 824 2024-09-12T00:52:30.639 INFO:tasks.workunit.client.0.smithi073.stderr: -326> 2024-09-12T00:52:30.354+0000 7fd3f3fff640 10 monclient: _finish_hunting 0 2024-09-12T00:52:30.640 INFO:tasks.workunit.client.0.smithi073.stderr: -325> 2024-09-12T00:52:30.354+0000 7fd3f3fff640 1 monclient: found mon.noname-a 2024-09-12T00:52:30.640 INFO:tasks.workunit.client.0.smithi073.stderr: -324> 2024-09-12T00:52:30.354+0000 7fd3f3fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:52:30.640 INFO:tasks.workunit.client.0.smithi073.stderr: -323> 2024-09-12T00:52:30.354+0000 7fd2e1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:30.640 INFO:tasks.workunit.client.0.smithi073.stderr: -322> 2024-09-12T00:52:30.354+0000 7fd2e1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:52:30.640 INFO:tasks.workunit.client.0.smithi073.stderr: -321> 2024-09-12T00:52:30.354+0000 7fd2e1ffb640 10 monclient: dump: 2024-09-12T00:52:30.640 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:52:30.640 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:52:30.640 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:52:30.640 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:52:30.640 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:30.640 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:52:30.640 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:52:30.640 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:52:30.640 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:52:30.641 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:52:30.641 INFO:tasks.workunit.client.0.smithi073.stderr: -320> 2024-09-12T00:52:30.354+0000 7fd2e1ffb640 10 monclient: _finish_auth 0 2024-09-12T00:52:30.641 INFO:tasks.workunit.client.0.smithi073.stderr: -319> 2024-09-12T00:52:30.354+0000 7fd2e1ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:52:30.641 INFO:tasks.workunit.client.0.smithi073.stderr: -318> 2024-09-12T00:52:30.354+0000 7fd2e1ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:52:30.641 INFO:tasks.workunit.client.0.smithi073.stderr: -317> 2024-09-12T00:52:30.354+0000 7fd2e1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:30.641 INFO:tasks.workunit.client.0.smithi073.stderr: -316> 2024-09-12T00:52:30.354+0000 7fd2e1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:52:30.641 INFO:tasks.workunit.client.0.smithi073.stderr: -315> 2024-09-12T00:52:30.354+0000 7fd2e1ffb640 10 monclient: dump: 2024-09-12T00:52:30.641 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:52:30.641 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:52:30.641 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:52:30.641 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:52:30.641 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:30.642 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:52:30.642 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:52:30.642 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:52:30.642 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:52:30.642 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:52:30.642 INFO:tasks.workunit.client.0.smithi073.stderr: -314> 2024-09-12T00:52:30.354+0000 7fd400740800 5 monclient: authenticate success, global_id 7752 2024-09-12T00:52:30.642 INFO:tasks.workunit.client.0.smithi073.stderr: -313> 2024-09-12T00:52:30.354+0000 7fd3fd4c2640 4 set_mon_vals no callback set 2024-09-12T00:52:30.642 INFO:tasks.workunit.client.0.smithi073.stderr: -312> 2024-09-12T00:52:30.354+0000 7fd400740800 10 monclient: _renew_subs 2024-09-12T00:52:30.642 INFO:tasks.workunit.client.0.smithi073.stderr: -311> 2024-09-12T00:52:30.354+0000 7fd400740800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:52:30.642 INFO:tasks.workunit.client.0.smithi073.stderr: -310> 2024-09-12T00:52:30.354+0000 7fd400740800 10 monclient: _renew_subs 2024-09-12T00:52:30.642 INFO:tasks.workunit.client.0.smithi073.stderr: -309> 2024-09-12T00:52:30.354+0000 7fd400740800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:52:30.643 INFO:tasks.workunit.client.0.smithi073.stderr: -308> 2024-09-12T00:52:30.356+0000 7fd2e1ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:52:30.643 INFO:tasks.workunit.client.0.smithi073.stderr: -307> 2024-09-12T00:52:30.356+0000 7fd2e1ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:52:30.643 INFO:tasks.workunit.client.0.smithi073.stderr: -306> 2024-09-12T00:52:30.356+0000 7fd2e1ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:52:30.643 INFO:tasks.workunit.client.0.smithi073.stderr: -305> 2024-09-12T00:52:30.356+0000 7fd3fc4c0640 10 monclient: get_auth_request con 0x7fd2d4076380 auth_method 0 2024-09-12T00:52:30.643 INFO:tasks.workunit.client.0.smithi073.stderr: -304> 2024-09-12T00:52:30.356+0000 7fd400740800 10 monclient: get_monmap_and_config 2024-09-12T00:52:30.643 INFO:tasks.workunit.client.0.smithi073.stderr: -303> 2024-09-12T00:52:30.356+0000 7fd400740800 10 monclient: build_initial_monmap 2024-09-12T00:52:30.643 INFO:tasks.workunit.client.0.smithi073.stderr: -302> 2024-09-12T00:52:30.356+0000 7fd400740800 1 build_initial for_mkfs: 0 2024-09-12T00:52:30.643 INFO:tasks.workunit.client.0.smithi073.stderr: -301> 2024-09-12T00:52:30.356+0000 7fd400740800 10 monclient: monmap: 2024-09-12T00:52:30.643 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:52:30.643 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:52:30.643 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:52:30.643 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:52:30.643 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:52:30.644 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:52:30.644 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:52:30.644 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:52:30.644 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:52:30.644 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:52:30.644 INFO:tasks.workunit.client.0.smithi073.stderr: -300> 2024-09-12T00:52:30.356+0000 7fd400740800 5 AuthRegistry(0x5644b8b8db00) adding auth protocol: cephx 2024-09-12T00:52:30.644 INFO:tasks.workunit.client.0.smithi073.stderr: -299> 2024-09-12T00:52:30.356+0000 7fd400740800 5 AuthRegistry(0x5644b8b8db00) adding auth protocol: cephx 2024-09-12T00:52:30.644 INFO:tasks.workunit.client.0.smithi073.stderr: -298> 2024-09-12T00:52:30.356+0000 7fd400740800 5 AuthRegistry(0x5644b8b8db00) adding auth protocol: cephx 2024-09-12T00:52:30.644 INFO:tasks.workunit.client.0.smithi073.stderr: -297> 2024-09-12T00:52:30.356+0000 7fd400740800 5 AuthRegistry(0x5644b8b8db00) adding con mode: secure 2024-09-12T00:52:30.644 INFO:tasks.workunit.client.0.smithi073.stderr: -296> 2024-09-12T00:52:30.356+0000 7fd400740800 5 AuthRegistry(0x5644b8b8db00) adding con mode: crc 2024-09-12T00:52:30.644 INFO:tasks.workunit.client.0.smithi073.stderr: -295> 2024-09-12T00:52:30.357+0000 7fd400740800 5 AuthRegistry(0x5644b8b8db00) adding con mode: secure 2024-09-12T00:52:30.644 INFO:tasks.workunit.client.0.smithi073.stderr: -294> 2024-09-12T00:52:30.357+0000 7fd400740800 5 AuthRegistry(0x5644b8b8db00) adding con mode: crc 2024-09-12T00:52:30.644 INFO:tasks.workunit.client.0.smithi073.stderr: -293> 2024-09-12T00:52:30.357+0000 7fd400740800 5 AuthRegistry(0x5644b8b8db00) adding con mode: secure 2024-09-12T00:52:30.645 INFO:tasks.workunit.client.0.smithi073.stderr: -292> 2024-09-12T00:52:30.357+0000 7fd400740800 5 AuthRegistry(0x5644b8b8db00) adding con mode: crc 2024-09-12T00:52:30.645 INFO:tasks.workunit.client.0.smithi073.stderr: -291> 2024-09-12T00:52:30.357+0000 7fd400740800 5 AuthRegistry(0x5644b8b8db00) adding con mode: crc 2024-09-12T00:52:30.645 INFO:tasks.workunit.client.0.smithi073.stderr: -290> 2024-09-12T00:52:30.357+0000 7fd400740800 5 AuthRegistry(0x5644b8b8db00) adding con mode: secure 2024-09-12T00:52:30.645 INFO:tasks.workunit.client.0.smithi073.stderr: -289> 2024-09-12T00:52:30.357+0000 7fd400740800 5 AuthRegistry(0x5644b8b8db00) adding con mode: crc 2024-09-12T00:52:30.645 INFO:tasks.workunit.client.0.smithi073.stderr: -288> 2024-09-12T00:52:30.357+0000 7fd400740800 5 AuthRegistry(0x5644b8b8db00) adding con mode: secure 2024-09-12T00:52:30.645 INFO:tasks.workunit.client.0.smithi073.stderr: -287> 2024-09-12T00:52:30.357+0000 7fd400740800 5 AuthRegistry(0x5644b8b8db00) adding con mode: crc 2024-09-12T00:52:30.645 INFO:tasks.workunit.client.0.smithi073.stderr: -286> 2024-09-12T00:52:30.357+0000 7fd400740800 5 AuthRegistry(0x5644b8b8db00) adding con mode: secure 2024-09-12T00:52:30.645 INFO:tasks.workunit.client.0.smithi073.stderr: -285> 2024-09-12T00:52:30.357+0000 7fd400740800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:30.645 INFO:tasks.workunit.client.0.smithi073.stderr: -284> 2024-09-12T00:52:30.357+0000 7fd400740800 10 monclient: init 2024-09-12T00:52:30.645 INFO:tasks.workunit.client.0.smithi073.stderr: -283> 2024-09-12T00:52:30.357+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2520) adding auth protocol: cephx 2024-09-12T00:52:30.645 INFO:tasks.workunit.client.0.smithi073.stderr: -282> 2024-09-12T00:52:30.357+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2520) adding auth protocol: cephx 2024-09-12T00:52:30.645 INFO:tasks.workunit.client.0.smithi073.stderr: -281> 2024-09-12T00:52:30.357+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2520) adding auth protocol: cephx 2024-09-12T00:52:30.645 INFO:tasks.workunit.client.0.smithi073.stderr: -280> 2024-09-12T00:52:30.357+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2520) adding con mode: secure 2024-09-12T00:52:30.646 INFO:tasks.workunit.client.0.smithi073.stderr: -279> 2024-09-12T00:52:30.357+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2520) adding con mode: crc 2024-09-12T00:52:30.646 INFO:tasks.workunit.client.0.smithi073.stderr: -278> 2024-09-12T00:52:30.357+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2520) adding con mode: secure 2024-09-12T00:52:30.646 INFO:tasks.workunit.client.0.smithi073.stderr: -277> 2024-09-12T00:52:30.357+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2520) adding con mode: crc 2024-09-12T00:52:30.646 INFO:tasks.workunit.client.0.smithi073.stderr: -276> 2024-09-12T00:52:30.357+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2520) adding con mode: secure 2024-09-12T00:52:30.646 INFO:tasks.workunit.client.0.smithi073.stderr: -275> 2024-09-12T00:52:30.357+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2520) adding con mode: crc 2024-09-12T00:52:30.646 INFO:tasks.workunit.client.0.smithi073.stderr: -274> 2024-09-12T00:52:30.357+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2520) adding con mode: crc 2024-09-12T00:52:30.646 INFO:tasks.workunit.client.0.smithi073.stderr: -273> 2024-09-12T00:52:30.357+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2520) adding con mode: secure 2024-09-12T00:52:30.646 INFO:tasks.workunit.client.0.smithi073.stderr: -272> 2024-09-12T00:52:30.357+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2520) adding con mode: crc 2024-09-12T00:52:30.646 INFO:tasks.workunit.client.0.smithi073.stderr: -271> 2024-09-12T00:52:30.357+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2520) adding con mode: secure 2024-09-12T00:52:30.646 INFO:tasks.workunit.client.0.smithi073.stderr: -270> 2024-09-12T00:52:30.357+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2520) adding con mode: crc 2024-09-12T00:52:30.646 INFO:tasks.workunit.client.0.smithi073.stderr: -269> 2024-09-12T00:52:30.357+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2520) adding con mode: secure 2024-09-12T00:52:30.646 INFO:tasks.workunit.client.0.smithi073.stderr: -268> 2024-09-12T00:52:30.357+0000 7fd400740800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:30.646 INFO:tasks.workunit.client.0.smithi073.stderr: -267> 2024-09-12T00:52:30.357+0000 7fd400740800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:30.647 INFO:tasks.workunit.client.0.smithi073.stderr: -266> 2024-09-12T00:52:30.357+0000 7fd400740800 5 asok(0x5644b88d1630) register_command rotate-key cmddesc rotate-key hook 0x7fffff7c2668 EEXIST 2024-09-12T00:52:30.647 INFO:tasks.workunit.client.0.smithi073.stderr: -265> 2024-09-12T00:52:30.357+0000 7fd400740800 10 monclient: _reopen_session rank -1 2024-09-12T00:52:30.647 INFO:tasks.workunit.client.0.smithi073.stderr: -264> 2024-09-12T00:52:30.357+0000 7fd400740800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:52:30.647 INFO:tasks.workunit.client.0.smithi073.stderr: -263> 2024-09-12T00:52:30.357+0000 7fd400740800 10 monclient(hunting): picked mon.noname-c con 0x5644b8bc2100 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:52:30.647 INFO:tasks.workunit.client.0.smithi073.stderr: -262> 2024-09-12T00:52:30.357+0000 7fd400740800 10 monclient(hunting): picked mon.noname-b con 0x5644b8bb2a50 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:52:30.647 INFO:tasks.workunit.client.0.smithi073.stderr: -261> 2024-09-12T00:52:30.357+0000 7fd400740800 10 monclient(hunting): picked mon.noname-a con 0x5644b8bbd530 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:52:30.647 INFO:tasks.workunit.client.0.smithi073.stderr: -260> 2024-09-12T00:52:30.357+0000 7fd400740800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:30.647 INFO:tasks.workunit.client.0.smithi073.stderr: -259> 2024-09-12T00:52:30.357+0000 7fd400740800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:30.647 INFO:tasks.workunit.client.0.smithi073.stderr: -258> 2024-09-12T00:52:30.357+0000 7fd400740800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:30.647 INFO:tasks.workunit.client.0.smithi073.stderr: -257> 2024-09-12T00:52:30.357+0000 7fd400740800 10 monclient(hunting): _renew_subs 2024-09-12T00:52:30.647 INFO:tasks.workunit.client.0.smithi073.stderr: -256> 2024-09-12T00:52:30.357+0000 7fd400740800 10 monclient(hunting): authenticate will time out at 2211.028988s 2024-09-12T00:52:30.647 INFO:tasks.workunit.client.0.smithi073.stderr: -255> 2024-09-12T00:52:30.358+0000 7fd3fccc1640 10 monclient(hunting): get_auth_request con 0x5644b8bbd530 auth_method 0 2024-09-12T00:52:30.647 INFO:tasks.workunit.client.0.smithi073.stderr: -254> 2024-09-12T00:52:30.358+0000 7fd3fccc1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:30.647 INFO:tasks.workunit.client.0.smithi073.stderr: -253> 2024-09-12T00:52:30.358+0000 7fd3fccc1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:30.648 INFO:tasks.workunit.client.0.smithi073.stderr: -252> 2024-09-12T00:52:30.358+0000 7fd3fccc1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:30.648 INFO:tasks.workunit.client.0.smithi073.stderr: -251> 2024-09-12T00:52:30.358+0000 7fd3fc4c0640 10 monclient(hunting): get_auth_request con 0x5644b8bc2100 auth_method 0 2024-09-12T00:52:30.648 INFO:tasks.workunit.client.0.smithi073.stderr: -250> 2024-09-12T00:52:30.358+0000 7fd3fc4c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:30.648 INFO:tasks.workunit.client.0.smithi073.stderr: -249> 2024-09-12T00:52:30.358+0000 7fd3fc4c0640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:30.648 INFO:tasks.workunit.client.0.smithi073.stderr: -248> 2024-09-12T00:52:30.358+0000 7fd3fc4c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:30.648 INFO:tasks.workunit.client.0.smithi073.stderr: -247> 2024-09-12T00:52:30.358+0000 7fd3fccc1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:30.648 INFO:tasks.workunit.client.0.smithi073.stderr: -246> 2024-09-12T00:52:30.358+0000 7fd3fccc1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:30.648 INFO:tasks.workunit.client.0.smithi073.stderr: -245> 2024-09-12T00:52:30.358+0000 7fd3fccc1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:30.648 INFO:tasks.workunit.client.0.smithi073.stderr: -244> 2024-09-12T00:52:30.358+0000 7fd3fc4c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:30.649 INFO:tasks.workunit.client.0.smithi073.stderr: -243> 2024-09-12T00:52:30.358+0000 7fd3fc4c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:30.649 INFO:tasks.workunit.client.0.smithi073.stderr: -242> 2024-09-12T00:52:30.358+0000 7fd3fc4c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:30.649 INFO:tasks.workunit.client.0.smithi073.stderr: -241> 2024-09-12T00:52:30.358+0000 7fd3f3fff640 10 monclient(hunting): get_auth_request con 0x5644b8bb2a50 auth_method 0 2024-09-12T00:52:30.649 INFO:tasks.workunit.client.0.smithi073.stderr: -240> 2024-09-12T00:52:30.358+0000 7fd3f3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:30.649 INFO:tasks.workunit.client.0.smithi073.stderr: -239> 2024-09-12T00:52:30.358+0000 7fd3f3fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:30.649 INFO:tasks.workunit.client.0.smithi073.stderr: -238> 2024-09-12T00:52:30.358+0000 7fd3f3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:30.649 INFO:tasks.workunit.client.0.smithi073.stderr: -237> 2024-09-12T00:52:30.358+0000 7fd3fccc1640 10 monclient(hunting): handle_auth_done global_id 7755 payload 274 2024-09-12T00:52:30.649 INFO:tasks.workunit.client.0.smithi073.stderr: -236> 2024-09-12T00:52:30.358+0000 7fd3fccc1640 10 monclient: _finish_hunting 0 2024-09-12T00:52:30.649 INFO:tasks.workunit.client.0.smithi073.stderr: -235> 2024-09-12T00:52:30.358+0000 7fd3fccc1640 1 monclient: found mon.noname-a 2024-09-12T00:52:30.649 INFO:tasks.workunit.client.0.smithi073.stderr: -234> 2024-09-12T00:52:30.358+0000 7fd3fccc1640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:52:30.649 INFO:tasks.workunit.client.0.smithi073.stderr: -233> 2024-09-12T00:52:30.358+0000 7fd2d37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:30.649 INFO:tasks.workunit.client.0.smithi073.stderr: -232> 2024-09-12T00:52:30.358+0000 7fd2d37fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:52:30.649 INFO:tasks.workunit.client.0.smithi073.stderr: -231> 2024-09-12T00:52:30.358+0000 7fd2d37fe640 10 monclient: dump: 2024-09-12T00:52:30.650 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:52:30.650 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:52:30.650 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:52:30.650 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:52:30.650 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:30.650 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:52:30.650 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:52:30.650 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:52:30.650 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:52:30.650 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:52:30.650 INFO:tasks.workunit.client.0.smithi073.stderr: -230> 2024-09-12T00:52:30.358+0000 7fd2d37fe640 10 monclient: _finish_auth 0 2024-09-12T00:52:30.650 INFO:tasks.workunit.client.0.smithi073.stderr: -229> 2024-09-12T00:52:30.358+0000 7fd2d37fe640 10 monclient: _check_auth_tickets 2024-09-12T00:52:30.650 INFO:tasks.workunit.client.0.smithi073.stderr: -228> 2024-09-12T00:52:30.358+0000 7fd2d37fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:52:30.650 INFO:tasks.workunit.client.0.smithi073.stderr: -227> 2024-09-12T00:52:30.358+0000 7fd2d37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:30.651 INFO:tasks.workunit.client.0.smithi073.stderr: -226> 2024-09-12T00:52:30.358+0000 7fd2d37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:52:30.651 INFO:tasks.workunit.client.0.smithi073.stderr: -225> 2024-09-12T00:52:30.358+0000 7fd2d37fe640 10 monclient: dump: 2024-09-12T00:52:30.651 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:52:30.651 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:52:30.651 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:52:30.651 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:52:30.651 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:30.651 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:52:30.651 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:52:30.651 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:52:30.651 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:52:30.651 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:52:30.651 INFO:tasks.workunit.client.0.smithi073.stderr: -224> 2024-09-12T00:52:30.358+0000 7fd400740800 5 monclient: authenticate success, global_id 7755 2024-09-12T00:52:30.652 INFO:tasks.workunit.client.0.smithi073.stderr: -223> 2024-09-12T00:52:30.358+0000 7fd400740800 10 monclient: get_monmap_and_config success 2024-09-12T00:52:30.652 INFO:tasks.workunit.client.0.smithi073.stderr: -222> 2024-09-12T00:52:30.358+0000 7fd400740800 4 set_mon_vals no callback set 2024-09-12T00:52:30.652 INFO:tasks.workunit.client.0.smithi073.stderr: -221> 2024-09-12T00:52:30.359+0000 7fd400740800 10 monclient: shutdown 2024-09-12T00:52:30.652 INFO:tasks.workunit.client.0.smithi073.stderr: -220> 2024-09-12T00:52:30.359+0000 7fd400740800 10 monclient: build_initial_monmap 2024-09-12T00:52:30.652 INFO:tasks.workunit.client.0.smithi073.stderr: -219> 2024-09-12T00:52:30.359+0000 7fd400740800 1 build_initial for_mkfs: 0 2024-09-12T00:52:30.652 INFO:tasks.workunit.client.0.smithi073.stderr: -218> 2024-09-12T00:52:30.359+0000 7fd400740800 10 monclient: monmap: 2024-09-12T00:52:30.652 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:52:30.652 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:52:30.652 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:52:30.652 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:52:30.652 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:52:30.652 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:52:30.652 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:52:30.653 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:52:30.653 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:52:30.653 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:52:30.653 INFO:tasks.workunit.client.0.smithi073.stderr: -217> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b91660) adding auth protocol: cephx 2024-09-12T00:52:30.653 INFO:tasks.workunit.client.0.smithi073.stderr: -216> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b91660) adding auth protocol: cephx 2024-09-12T00:52:30.653 INFO:tasks.workunit.client.0.smithi073.stderr: -215> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b91660) adding auth protocol: cephx 2024-09-12T00:52:30.653 INFO:tasks.workunit.client.0.smithi073.stderr: -214> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b91660) adding con mode: secure 2024-09-12T00:52:30.653 INFO:tasks.workunit.client.0.smithi073.stderr: -213> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b91660) adding con mode: crc 2024-09-12T00:52:30.653 INFO:tasks.workunit.client.0.smithi073.stderr: -212> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b91660) adding con mode: secure 2024-09-12T00:52:30.653 INFO:tasks.workunit.client.0.smithi073.stderr: -211> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b91660) adding con mode: crc 2024-09-12T00:52:30.653 INFO:tasks.workunit.client.0.smithi073.stderr: -210> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b91660) adding con mode: secure 2024-09-12T00:52:30.653 INFO:tasks.workunit.client.0.smithi073.stderr: -209> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b91660) adding con mode: crc 2024-09-12T00:52:30.653 INFO:tasks.workunit.client.0.smithi073.stderr: -208> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b91660) adding con mode: crc 2024-09-12T00:52:30.654 INFO:tasks.workunit.client.0.smithi073.stderr: -207> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b91660) adding con mode: secure 2024-09-12T00:52:30.654 INFO:tasks.workunit.client.0.smithi073.stderr: -206> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b91660) adding con mode: crc 2024-09-12T00:52:30.654 INFO:tasks.workunit.client.0.smithi073.stderr: -205> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b91660) adding con mode: secure 2024-09-12T00:52:30.654 INFO:tasks.workunit.client.0.smithi073.stderr: -204> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b91660) adding con mode: crc 2024-09-12T00:52:30.654 INFO:tasks.workunit.client.0.smithi073.stderr: -203> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b91660) adding con mode: secure 2024-09-12T00:52:30.654 INFO:tasks.workunit.client.0.smithi073.stderr: -202> 2024-09-12T00:52:30.359+0000 7fd400740800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:30.654 INFO:tasks.workunit.client.0.smithi073.stderr: -201> 2024-09-12T00:52:30.359+0000 7fd400740800 1 librados: starting msgr at 2024-09-12T00:52:30.654 INFO:tasks.workunit.client.0.smithi073.stderr: -200> 2024-09-12T00:52:30.359+0000 7fd400740800 1 librados: starting objecter 2024-09-12T00:52:30.654 INFO:tasks.workunit.client.0.smithi073.stderr: -199> 2024-09-12T00:52:30.359+0000 7fd400740800 5 asok(0x5644b88d1630) register_command objecter_requests cmddesc objecter_requests hook 0x5644b8bbc820 EEXIST 2024-09-12T00:52:30.654 INFO:tasks.workunit.client.0.smithi073.stderr: -198> 2024-09-12T00:52:30.359+0000 7fd400740800 1 librados: setting wanted keys 2024-09-12T00:52:30.654 INFO:tasks.workunit.client.0.smithi073.stderr: -197> 2024-09-12T00:52:30.359+0000 7fd400740800 1 librados: calling monclient init 2024-09-12T00:52:30.654 INFO:tasks.workunit.client.0.smithi073.stderr: -196> 2024-09-12T00:52:30.359+0000 7fd400740800 10 monclient: init 2024-09-12T00:52:30.655 INFO:tasks.workunit.client.0.smithi073.stderr: -195> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b859f0) adding auth protocol: cephx 2024-09-12T00:52:30.655 INFO:tasks.workunit.client.0.smithi073.stderr: -194> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b859f0) adding auth protocol: cephx 2024-09-12T00:52:30.655 INFO:tasks.workunit.client.0.smithi073.stderr: -193> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b859f0) adding auth protocol: cephx 2024-09-12T00:52:30.655 INFO:tasks.workunit.client.0.smithi073.stderr: -192> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b859f0) adding con mode: secure 2024-09-12T00:52:30.655 INFO:tasks.workunit.client.0.smithi073.stderr: -191> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b859f0) adding con mode: crc 2024-09-12T00:52:30.655 INFO:tasks.workunit.client.0.smithi073.stderr: -190> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b859f0) adding con mode: secure 2024-09-12T00:52:30.655 INFO:tasks.workunit.client.0.smithi073.stderr: -189> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b859f0) adding con mode: crc 2024-09-12T00:52:30.655 INFO:tasks.workunit.client.0.smithi073.stderr: -188> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b859f0) adding con mode: secure 2024-09-12T00:52:30.655 INFO:tasks.workunit.client.0.smithi073.stderr: -187> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b859f0) adding con mode: crc 2024-09-12T00:52:30.655 INFO:tasks.workunit.client.0.smithi073.stderr: -186> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b859f0) adding con mode: crc 2024-09-12T00:52:30.655 INFO:tasks.workunit.client.0.smithi073.stderr: -185> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b859f0) adding con mode: secure 2024-09-12T00:52:30.655 INFO:tasks.workunit.client.0.smithi073.stderr: -184> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b859f0) adding con mode: crc 2024-09-12T00:52:30.655 INFO:tasks.workunit.client.0.smithi073.stderr: -183> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b859f0) adding con mode: secure 2024-09-12T00:52:30.655 INFO:tasks.workunit.client.0.smithi073.stderr: -182> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b859f0) adding con mode: crc 2024-09-12T00:52:30.656 INFO:tasks.workunit.client.0.smithi073.stderr: -181> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b859f0) adding con mode: secure 2024-09-12T00:52:30.656 INFO:tasks.workunit.client.0.smithi073.stderr: -180> 2024-09-12T00:52:30.359+0000 7fd400740800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:30.656 INFO:tasks.workunit.client.0.smithi073.stderr: -179> 2024-09-12T00:52:30.360+0000 7fd400740800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:30.656 INFO:tasks.workunit.client.0.smithi073.stderr: -178> 2024-09-12T00:52:30.360+0000 7fd400740800 5 asok(0x5644b88d1630) register_command rotate-key cmddesc rotate-key hook 0x5644b8b85b38 EEXIST 2024-09-12T00:52:30.656 INFO:tasks.workunit.client.0.smithi073.stderr: -177> 2024-09-12T00:52:30.360+0000 7fd400740800 10 monclient: _reopen_session rank -1 2024-09-12T00:52:30.656 INFO:tasks.workunit.client.0.smithi073.stderr: -176> 2024-09-12T00:52:30.360+0000 7fd400740800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:52:30.656 INFO:tasks.workunit.client.0.smithi073.stderr: -175> 2024-09-12T00:52:30.360+0000 7fd400740800 10 monclient(hunting): picked mon.noname-c con 0x5644b8bb2a50 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:52:30.656 INFO:tasks.workunit.client.0.smithi073.stderr: -174> 2024-09-12T00:52:30.360+0000 7fd400740800 10 monclient(hunting): picked mon.noname-b con 0x5644b8bbd530 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:52:30.656 INFO:tasks.workunit.client.0.smithi073.stderr: -173> 2024-09-12T00:52:30.360+0000 7fd400740800 10 monclient(hunting): picked mon.noname-a con 0x5644b8bc2100 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:52:30.656 INFO:tasks.workunit.client.0.smithi073.stderr: -172> 2024-09-12T00:52:30.360+0000 7fd400740800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:30.656 INFO:tasks.workunit.client.0.smithi073.stderr: -171> 2024-09-12T00:52:30.360+0000 7fd400740800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:30.656 INFO:tasks.workunit.client.0.smithi073.stderr: -170> 2024-09-12T00:52:30.360+0000 7fd400740800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:30.656 INFO:tasks.workunit.client.0.smithi073.stderr: -169> 2024-09-12T00:52:30.360+0000 7fd400740800 10 monclient(hunting): _renew_subs 2024-09-12T00:52:30.657 INFO:tasks.workunit.client.0.smithi073.stderr: -168> 2024-09-12T00:52:30.360+0000 7fd400740800 10 monclient(hunting): authenticate will time out at 2211.031256s 2024-09-12T00:52:30.657 INFO:tasks.workunit.client.0.smithi073.stderr: -167> 2024-09-12T00:52:30.360+0000 7fd3fccc1640 10 monclient(hunting): get_auth_request con 0x5644b8bc2100 auth_method 0 2024-09-12T00:52:30.657 INFO:tasks.workunit.client.0.smithi073.stderr: -166> 2024-09-12T00:52:30.360+0000 7fd3fccc1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:30.657 INFO:tasks.workunit.client.0.smithi073.stderr: -165> 2024-09-12T00:52:30.360+0000 7fd3fccc1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:30.657 INFO:tasks.workunit.client.0.smithi073.stderr: -164> 2024-09-12T00:52:30.360+0000 7fd3fccc1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:30.657 INFO:tasks.workunit.client.0.smithi073.stderr: -163> 2024-09-12T00:52:30.360+0000 7fd3fc4c0640 10 monclient(hunting): get_auth_request con 0x5644b8bb2a50 auth_method 0 2024-09-12T00:52:30.657 INFO:tasks.workunit.client.0.smithi073.stderr: -162> 2024-09-12T00:52:30.360+0000 7fd3fc4c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:30.657 INFO:tasks.workunit.client.0.smithi073.stderr: -161> 2024-09-12T00:52:30.360+0000 7fd3fc4c0640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:30.657 INFO:tasks.workunit.client.0.smithi073.stderr: -160> 2024-09-12T00:52:30.360+0000 7fd3fc4c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:30.657 INFO:tasks.workunit.client.0.smithi073.stderr: -159> 2024-09-12T00:52:30.360+0000 7fd3f3fff640 10 monclient(hunting): get_auth_request con 0x5644b8bbd530 auth_method 0 2024-09-12T00:52:30.657 INFO:tasks.workunit.client.0.smithi073.stderr: -158> 2024-09-12T00:52:30.360+0000 7fd3f3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:30.657 INFO:tasks.workunit.client.0.smithi073.stderr: -157> 2024-09-12T00:52:30.360+0000 7fd3f3fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:30.657 INFO:tasks.workunit.client.0.smithi073.stderr: -156> 2024-09-12T00:52:30.360+0000 7fd3f3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:30.658 INFO:tasks.workunit.client.0.smithi073.stderr: -155> 2024-09-12T00:52:30.360+0000 7fd3fccc1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:30.658 INFO:tasks.workunit.client.0.smithi073.stderr: -154> 2024-09-12T00:52:30.360+0000 7fd3fccc1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:30.658 INFO:tasks.workunit.client.0.smithi073.stderr: -153> 2024-09-12T00:52:30.360+0000 7fd3fccc1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:30.658 INFO:tasks.workunit.client.0.smithi073.stderr: -152> 2024-09-12T00:52:30.360+0000 7fd3fc4c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:30.658 INFO:tasks.workunit.client.0.smithi073.stderr: -151> 2024-09-12T00:52:30.360+0000 7fd3fc4c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:30.658 INFO:tasks.workunit.client.0.smithi073.stderr: -150> 2024-09-12T00:52:30.360+0000 7fd3fc4c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:30.658 INFO:tasks.workunit.client.0.smithi073.stderr: -149> 2024-09-12T00:52:30.360+0000 7fd3f3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:30.658 INFO:tasks.workunit.client.0.smithi073.stderr: -148> 2024-09-12T00:52:30.360+0000 7fd3f3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:30.658 INFO:tasks.workunit.client.0.smithi073.stderr: -147> 2024-09-12T00:52:30.360+0000 7fd3f3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:30.658 INFO:tasks.workunit.client.0.smithi073.stderr: -146> 2024-09-12T00:52:30.360+0000 7fd3fccc1640 10 monclient(hunting): handle_auth_done global_id 7758 payload 824 2024-09-12T00:52:30.658 INFO:tasks.workunit.client.0.smithi073.stderr: -145> 2024-09-12T00:52:30.360+0000 7fd3fccc1640 10 monclient: _finish_hunting 0 2024-09-12T00:52:30.658 INFO:tasks.workunit.client.0.smithi073.stderr: -144> 2024-09-12T00:52:30.360+0000 7fd3fccc1640 1 monclient: found mon.noname-a 2024-09-12T00:52:30.658 INFO:tasks.workunit.client.0.smithi073.stderr: -143> 2024-09-12T00:52:30.360+0000 7fd3fccc1640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:52:30.659 INFO:tasks.workunit.client.0.smithi073.stderr: -142> 2024-09-12T00:52:30.360+0000 7fd2d1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:30.659 INFO:tasks.workunit.client.0.smithi073.stderr: -141> 2024-09-12T00:52:30.360+0000 7fd2d1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:52:30.659 INFO:tasks.workunit.client.0.smithi073.stderr: -140> 2024-09-12T00:52:30.360+0000 7fd2d1ffb640 10 monclient: dump: 2024-09-12T00:52:30.659 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:52:30.659 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:52:30.659 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:52:30.659 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:52:30.659 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:30.659 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:52:30.659 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:52:30.659 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:52:30.659 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:52:30.659 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:52:30.659 INFO:tasks.workunit.client.0.smithi073.stderr: -139> 2024-09-12T00:52:30.360+0000 7fd2d1ffb640 10 monclient: _finish_auth 0 2024-09-12T00:52:30.660 INFO:tasks.workunit.client.0.smithi073.stderr: -138> 2024-09-12T00:52:30.360+0000 7fd2d1ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:52:30.660 INFO:tasks.workunit.client.0.smithi073.stderr: -137> 2024-09-12T00:52:30.360+0000 7fd2d1ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:52:30.660 INFO:tasks.workunit.client.0.smithi073.stderr: -136> 2024-09-12T00:52:30.360+0000 7fd2d1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:30.660 INFO:tasks.workunit.client.0.smithi073.stderr: -135> 2024-09-12T00:52:30.360+0000 7fd2d1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:52:30.660 INFO:tasks.workunit.client.0.smithi073.stderr: -134> 2024-09-12T00:52:30.360+0000 7fd2d1ffb640 10 monclient: dump: 2024-09-12T00:52:30.660 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:52:30.660 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:52:30.660 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:52:30.660 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:52:30.660 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:30.660 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:52:30.660 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:52:30.660 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:52:30.661 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:52:30.661 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:52:30.661 INFO:tasks.workunit.client.0.smithi073.stderr: -133> 2024-09-12T00:52:30.360+0000 7fd400740800 5 monclient: authenticate success, global_id 7758 2024-09-12T00:52:30.661 INFO:tasks.workunit.client.0.smithi073.stderr: -132> 2024-09-12T00:52:30.360+0000 7fd400740800 10 monclient: _renew_subs 2024-09-12T00:52:30.661 INFO:tasks.workunit.client.0.smithi073.stderr: -131> 2024-09-12T00:52:30.360+0000 7fd2d37fe640 4 set_mon_vals no callback set 2024-09-12T00:52:30.661 INFO:tasks.workunit.client.0.smithi073.stderr: -130> 2024-09-12T00:52:30.360+0000 7fd400740800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:52:30.661 INFO:tasks.workunit.client.0.smithi073.stderr: -129> 2024-09-12T00:52:30.360+0000 7fd400740800 10 monclient: _renew_subs 2024-09-12T00:52:30.661 INFO:tasks.workunit.client.0.smithi073.stderr: -128> 2024-09-12T00:52:30.360+0000 7fd400740800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:52:30.661 INFO:tasks.workunit.client.0.smithi073.stderr: -127> 2024-09-12T00:52:30.360+0000 7fd400740800 1 librados: init done 2024-09-12T00:52:30.661 INFO:tasks.workunit.client.0.smithi073.stderr: -126> 2024-09-12T00:52:30.361+0000 7fd400740800 5 asok(0x5644b88d1630) register_command cr dump hook 0x5644b8bd0298 2024-09-12T00:52:30.661 INFO:tasks.workunit.client.0.smithi073.stderr: -125> 2024-09-12T00:52:30.362+0000 7fd400740800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.661 INFO:tasks.workunit.client.0.smithi073.stderr: -124> 2024-09-12T00:52:30.362+0000 7fd2d1ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:52:30.661 INFO:tasks.workunit.client.0.smithi073.stderr: -123> 2024-09-12T00:52:30.362+0000 7fd2d1ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:52:30.662 INFO:tasks.workunit.client.0.smithi073.stderr: -122> 2024-09-12T00:52:30.362+0000 7fd2d1ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:52:30.662 INFO:tasks.workunit.client.0.smithi073.stderr: -121> 2024-09-12T00:52:30.362+0000 7fd3fc4c0640 10 monclient: get_auth_request con 0x7fd2c4076470 auth_method 0 2024-09-12T00:52:30.662 INFO:tasks.workunit.client.0.smithi073.stderr: -120> 2024-09-12T00:52:30.363+0000 7fd3f3fff640 10 monclient: get_auth_request con 0x5644b8bdc7f0 auth_method 0 2024-09-12T00:52:30.662 INFO:tasks.workunit.client.0.smithi073.stderr: -119> 2024-09-12T00:52:30.363+0000 7fd400740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.662 INFO:tasks.workunit.client.0.smithi073.stderr: -118> 2024-09-12T00:52:30.363+0000 7fd400740800 20 realm 2024-09-12T00:52:30.662 INFO:tasks.workunit.client.0.smithi073.stderr: -117> 2024-09-12T00:52:30.363+0000 7fd400740800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.662 INFO:tasks.workunit.client.0.smithi073.stderr: -116> 2024-09-12T00:52:30.363+0000 7fd400740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.662 INFO:tasks.workunit.client.0.smithi073.stderr: -115> 2024-09-12T00:52:30.363+0000 7fd400740800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:30.662 INFO:tasks.workunit.client.0.smithi073.stderr: -114> 2024-09-12T00:52:30.364+0000 7fd400740800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.662 INFO:tasks.workunit.client.0.smithi073.stderr: -113> 2024-09-12T00:52:30.364+0000 7fd400740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.662 INFO:tasks.workunit.client.0.smithi073.stderr: -112> 2024-09-12T00:52:30.364+0000 7fd400740800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.662 INFO:tasks.workunit.client.0.smithi073.stderr: -111> 2024-09-12T00:52:30.364+0000 7fd3fc4c0640 10 monclient: get_auth_request con 0x5644b8be0a50 auth_method 0 2024-09-12T00:52:30.662 INFO:tasks.workunit.client.0.smithi073.stderr: -110> 2024-09-12T00:52:30.365+0000 7fd400740800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:30.662 INFO:tasks.workunit.client.0.smithi073.stderr: -109> 2024-09-12T00:52:30.365+0000 7fd400740800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.663 INFO:tasks.workunit.client.0.smithi073.stderr: -108> 2024-09-12T00:52:30.365+0000 7fd3f3fff640 10 monclient: get_auth_request con 0x5644b8be4320 auth_method 0 2024-09-12T00:52:30.663 INFO:tasks.workunit.client.0.smithi073.stderr: -107> 2024-09-12T00:52:30.365+0000 7fd400740800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:30.663 INFO:tasks.workunit.client.0.smithi073.stderr: -106> 2024-09-12T00:52:30.365+0000 7fd400740800 20 searching for the correct realm 2024-09-12T00:52:30.663 INFO:tasks.workunit.client.0.smithi073.stderr: -105> 2024-09-12T00:52:30.365+0000 7fd3fccc1640 10 monclient: get_auth_request con 0x5644b8be9040 auth_method 0 2024-09-12T00:52:30.663 INFO:tasks.workunit.client.0.smithi073.stderr: -104> 2024-09-12T00:52:30.366+0000 7fd3fc4c0640 10 monclient: get_auth_request con 0x7fd3f4042740 auth_method 0 2024-09-12T00:52:30.663 INFO:tasks.workunit.client.0.smithi073.stderr: -103> 2024-09-12T00:52:30.367+0000 7fd3f3fff640 10 monclient: get_auth_request con 0x7fd3ec07c070 auth_method 0 2024-09-12T00:52:30.663 INFO:tasks.workunit.client.0.smithi073.stderr: -102> 2024-09-12T00:52:30.367+0000 7fd3fccc1640 10 monclient: get_auth_request con 0x7fd3e4017040 auth_method 0 2024-09-12T00:52:30.663 INFO:tasks.workunit.client.0.smithi073.stderr: -101> 2024-09-12T00:52:30.367+0000 7fd3fccc1640 0 -- 172.21.15.73:0/3795595100 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fd3e4017040 msgr2=0x7fd3e4067870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:52:30.663 INFO:tasks.workunit.client.0.smithi073.stderr: -100> 2024-09-12T00:52:30.569+0000 7fd3fccc1640 10 monclient: get_auth_request con 0x7fd3e4017040 auth_method 0 2024-09-12T00:52:30.663 INFO:tasks.workunit.client.0.smithi073.stderr: -99> 2024-09-12T00:52:30.572+0000 7fd3fc4c0640 10 monclient: get_auth_request con 0x7fd3f405c6d0 auth_method 0 2024-09-12T00:52:30.663 INFO:tasks.workunit.client.0.smithi073.stderr: -98> 2024-09-12T00:52:30.573+0000 7fd3fccc1640 0 -- 172.21.15.73:0/3795595100 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fd3e4017040 msgr2=0x7fd3e4067870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:30.663 INFO:tasks.workunit.client.0.smithi073.stderr: -97> 2024-09-12T00:52:30.573+0000 7fd2d1ffb640 1 client.7758.objecter ms_handle_reset 0x7fd3e4017040 session 0x7fd3e4071d80 osd.4 2024-09-12T00:52:30.663 INFO:tasks.workunit.client.0.smithi073.stderr: -96> 2024-09-12T00:52:30.573+0000 7fd2d1ffb640 10 monclient: _renew_subs 2024-09-12T00:52:30.664 INFO:tasks.workunit.client.0.smithi073.stderr: -95> 2024-09-12T00:52:30.573+0000 7fd2d1ffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:52:30.664 INFO:tasks.workunit.client.0.smithi073.stderr: -94> 2024-09-12T00:52:30.573+0000 7fd3fccc1640 10 monclient: get_auth_request con 0x7fd2c4086310 auth_method 0 2024-09-12T00:52:30.664 INFO:tasks.workunit.client.0.smithi073.stderr: -93> 2024-09-12T00:52:30.576+0000 7fd400740800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:52:30.664 INFO:tasks.workunit.client.0.smithi073.stderr: -92> 2024-09-12T00:52:30.576+0000 7fd400740800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:30.664 INFO:tasks.workunit.client.0.smithi073.stderr: -91> 2024-09-12T00:52:30.576+0000 7fd400740800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:52:30.664 INFO:tasks.workunit.client.0.smithi073.stderr: -90> 2024-09-12T00:52:30.576+0000 7fd400740800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:30.664 INFO:tasks.workunit.client.0.smithi073.stderr: -89> 2024-09-12T00:52:30.576+0000 7fd400740800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:30.664 INFO:tasks.workunit.client.0.smithi073.stderr: -88> 2024-09-12T00:52:30.576+0000 7fd400740800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:30.664 INFO:tasks.workunit.client.0.smithi073.stderr: -87> 2024-09-12T00:52:30.576+0000 7fd400740800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.664 INFO:tasks.workunit.client.0.smithi073.stderr: -86> 2024-09-12T00:52:30.576+0000 7fd400740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.664 INFO:tasks.workunit.client.0.smithi073.stderr: -85> 2024-09-12T00:52:30.576+0000 7fd400740800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.664 INFO:tasks.workunit.client.0.smithi073.stderr: -84> 2024-09-12T00:52:30.576+0000 7fd400740800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:30.664 INFO:tasks.workunit.client.0.smithi073.stderr: -83> 2024-09-12T00:52:30.576+0000 7fd400740800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.665 INFO:tasks.workunit.client.0.smithi073.stderr: -82> 2024-09-12T00:52:30.577+0000 7fd400740800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:30.665 INFO:tasks.workunit.client.0.smithi073.stderr: -81> 2024-09-12T00:52:30.577+0000 7fd400740800 20 zone default found 2024-09-12T00:52:30.665 INFO:tasks.workunit.client.0.smithi073.stderr: -80> 2024-09-12T00:52:30.577+0000 7fd400740800 4 Realm: () 2024-09-12T00:52:30.665 INFO:tasks.workunit.client.0.smithi073.stderr: -79> 2024-09-12T00:52:30.577+0000 7fd400740800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:52:30.665 INFO:tasks.workunit.client.0.smithi073.stderr: -78> 2024-09-12T00:52:30.577+0000 7fd400740800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:52:30.665 INFO:tasks.workunit.client.0.smithi073.stderr: -77> 2024-09-12T00:52:30.577+0000 7fd400740800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:30.665 INFO:tasks.workunit.client.0.smithi073.stderr: -76> 2024-09-12T00:52:30.577+0000 7fd400740800 20 zonegroup default 2024-09-12T00:52:30.665 INFO:tasks.workunit.client.0.smithi073.stderr: -75> 2024-09-12T00:52:30.577+0000 7fd400740800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.665 INFO:tasks.workunit.client.0.smithi073.stderr: -74> 2024-09-12T00:52:30.577+0000 7fd400740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.665 INFO:tasks.workunit.client.0.smithi073.stderr: -73> 2024-09-12T00:52:30.577+0000 7fd400740800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.665 INFO:tasks.workunit.client.0.smithi073.stderr: -72> 2024-09-12T00:52:30.577+0000 7fd400740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.665 INFO:tasks.workunit.client.0.smithi073.stderr: -71> 2024-09-12T00:52:30.577+0000 7fd400740800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.665 INFO:tasks.workunit.client.0.smithi073.stderr: -70> 2024-09-12T00:52:30.577+0000 7fd400740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.665 INFO:tasks.workunit.client.0.smithi073.stderr: -69> 2024-09-12T00:52:30.577+0000 7fd400740800 20 started sync module instance, tier type = 2024-09-12T00:52:30.666 INFO:tasks.workunit.client.0.smithi073.stderr: -68> 2024-09-12T00:52:30.577+0000 7fd400740800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:52:30.666 INFO:tasks.workunit.client.0.smithi073.stderr: -67> 2024-09-12T00:52:30.586+0000 7fd400740800 20 add_watcher() i=0 2024-09-12T00:52:30.666 INFO:tasks.workunit.client.0.smithi073.stderr: -66> 2024-09-12T00:52:30.586+0000 7fd400740800 20 add_watcher() i=1 2024-09-12T00:52:30.666 INFO:tasks.workunit.client.0.smithi073.stderr: -65> 2024-09-12T00:52:30.586+0000 7fd400740800 20 add_watcher() i=2 2024-09-12T00:52:30.666 INFO:tasks.workunit.client.0.smithi073.stderr: -64> 2024-09-12T00:52:30.586+0000 7fd400740800 20 add_watcher() i=3 2024-09-12T00:52:30.666 INFO:tasks.workunit.client.0.smithi073.stderr: -63> 2024-09-12T00:52:30.586+0000 7fd400740800 20 add_watcher() i=4 2024-09-12T00:52:30.666 INFO:tasks.workunit.client.0.smithi073.stderr: -62> 2024-09-12T00:52:30.586+0000 7fd400740800 20 add_watcher() i=5 2024-09-12T00:52:30.666 INFO:tasks.workunit.client.0.smithi073.stderr: -61> 2024-09-12T00:52:30.586+0000 7fd400740800 20 add_watcher() i=6 2024-09-12T00:52:30.666 INFO:tasks.workunit.client.0.smithi073.stderr: -60> 2024-09-12T00:52:30.587+0000 7fd400740800 20 add_watcher() i=7 2024-09-12T00:52:30.666 INFO:tasks.workunit.client.0.smithi073.stderr: -59> 2024-09-12T00:52:30.587+0000 7fd400740800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:30.666 INFO:tasks.workunit.client.0.smithi073.stderr: -58> 2024-09-12T00:52:30.589+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2a00) adding auth protocol: cephx 2024-09-12T00:52:30.666 INFO:tasks.workunit.client.0.smithi073.stderr: -57> 2024-09-12T00:52:30.589+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2a00) adding auth protocol: cephx 2024-09-12T00:52:30.666 INFO:tasks.workunit.client.0.smithi073.stderr: -56> 2024-09-12T00:52:30.589+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2a00) adding auth protocol: cephx 2024-09-12T00:52:30.667 INFO:tasks.workunit.client.0.smithi073.stderr: -55> 2024-09-12T00:52:30.589+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2a00) adding con mode: secure 2024-09-12T00:52:30.667 INFO:tasks.workunit.client.0.smithi073.stderr: -54> 2024-09-12T00:52:30.589+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2a00) adding con mode: crc 2024-09-12T00:52:30.667 INFO:tasks.workunit.client.0.smithi073.stderr: -53> 2024-09-12T00:52:30.589+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2a00) adding con mode: secure 2024-09-12T00:52:30.667 INFO:tasks.workunit.client.0.smithi073.stderr: -52> 2024-09-12T00:52:30.589+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2a00) adding con mode: crc 2024-09-12T00:52:30.667 INFO:tasks.workunit.client.0.smithi073.stderr: -51> 2024-09-12T00:52:30.589+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2a00) adding con mode: secure 2024-09-12T00:52:30.667 INFO:tasks.workunit.client.0.smithi073.stderr: -50> 2024-09-12T00:52:30.589+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2a00) adding con mode: crc 2024-09-12T00:52:30.667 INFO:tasks.workunit.client.0.smithi073.stderr: -49> 2024-09-12T00:52:30.589+0000 7fd2b2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:30.667 INFO:tasks.workunit.client.0.smithi073.stderr: -48> 2024-09-12T00:52:30.589+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2a00) adding con mode: crc 2024-09-12T00:52:30.667 INFO:tasks.workunit.client.0.smithi073.stderr: -47> 2024-09-12T00:52:30.589+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2a00) adding con mode: secure 2024-09-12T00:52:30.667 INFO:tasks.workunit.client.0.smithi073.stderr: -46> 2024-09-12T00:52:30.589+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2a00) adding con mode: crc 2024-09-12T00:52:30.667 INFO:tasks.workunit.client.0.smithi073.stderr: -45> 2024-09-12T00:52:30.589+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2a00) adding con mode: secure 2024-09-12T00:52:30.667 INFO:tasks.workunit.client.0.smithi073.stderr: -44> 2024-09-12T00:52:30.589+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2a00) adding con mode: crc 2024-09-12T00:52:30.667 INFO:tasks.workunit.client.0.smithi073.stderr: -43> 2024-09-12T00:52:30.589+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2a00) adding con mode: secure 2024-09-12T00:52:30.668 INFO:tasks.workunit.client.0.smithi073.stderr: -42> 2024-09-12T00:52:30.589+0000 7fd400740800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:30.668 INFO:tasks.workunit.client.0.smithi073.stderr: -41> 2024-09-12T00:52:30.589+0000 7fd400740800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:30.668 INFO:tasks.workunit.client.0.smithi073.stderr: -40> 2024-09-12T00:52:30.589+0000 7fd400740800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:30.668 INFO:tasks.workunit.client.0.smithi073.stderr: -39> 2024-09-12T00:52:30.589+0000 7fd400740800 5 asok(0x5644b88d1630) register_command cache list hook 0x5644b8bc2910 2024-09-12T00:52:30.668 INFO:tasks.workunit.client.0.smithi073.stderr: -38> 2024-09-12T00:52:30.589+0000 7fd400740800 5 asok(0x5644b88d1630) register_command cache inspect hook 0x5644b8bc2910 2024-09-12T00:52:30.668 INFO:tasks.workunit.client.0.smithi073.stderr: -37> 2024-09-12T00:52:30.589+0000 7fd400740800 5 asok(0x5644b88d1630) register_command cache erase hook 0x5644b8bc2910 2024-09-12T00:52:30.668 INFO:tasks.workunit.client.0.smithi073.stderr: -36> 2024-09-12T00:52:30.589+0000 7fd400740800 5 asok(0x5644b88d1630) register_command cache zap hook 0x5644b8bc2910 2024-09-12T00:52:30.668 INFO:tasks.workunit.client.0.smithi073.stderr: -35> 2024-09-12T00:52:30.589+0000 7fd400740800 5 note: GC not initialized 2024-09-12T00:52:30.668 INFO:tasks.workunit.client.0.smithi073.stderr: -34> 2024-09-12T00:52:30.589+0000 7fd2b1fdb640 20 reqs_thread_entry: start 2024-09-12T00:52:30.668 INFO:tasks.workunit.client.0.smithi073.stderr: -33> 2024-09-12T00:52:30.589+0000 7fd400740800 5 asok(0x5644b88d1630) register_command sync trace show hook 0x7fd3f4004720 2024-09-12T00:52:30.668 INFO:tasks.workunit.client.0.smithi073.stderr: -32> 2024-09-12T00:52:30.589+0000 7fd400740800 5 asok(0x5644b88d1630) register_command sync trace history hook 0x7fd3f4004720 2024-09-12T00:52:30.668 INFO:tasks.workunit.client.0.smithi073.stderr: -31> 2024-09-12T00:52:30.589+0000 7fd400740800 5 asok(0x5644b88d1630) register_command sync trace active hook 0x7fd3f4004720 2024-09-12T00:52:30.668 INFO:tasks.workunit.client.0.smithi073.stderr: -30> 2024-09-12T00:52:30.589+0000 7fd400740800 5 asok(0x5644b88d1630) register_command sync trace active_short hook 0x7fd3f4004720 2024-09-12T00:52:30.669 INFO:tasks.workunit.client.0.smithi073.stderr: -29> 2024-09-12T00:52:30.589+0000 7fd400740800 20 init_complete bucket index max shards: 1 2024-09-12T00:52:30.669 INFO:tasks.workunit.client.0.smithi073.stderr: -28> 2024-09-12T00:52:30.589+0000 7fd400740800 20 Filter name: none 2024-09-12T00:52:30.669 INFO:tasks.workunit.client.0.smithi073.stderr: -27> 2024-09-12T00:52:30.589+0000 7fd2237fe640 20 reqs_thread_entry: start 2024-09-12T00:52:30.669 INFO:tasks.workunit.client.0.smithi073.stderr: -26> 2024-09-12T00:52:30.589+0000 7fd400740800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:52:30.669 INFO:tasks.workunit.client.0.smithi073.stderr: -25> 2024-09-12T00:52:30.589+0000 7fd400740800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.669 INFO:tasks.workunit.client.0.smithi073.stderr: -24> 2024-09-12T00:52:30.590+0000 7fd400740800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:52:30.669 INFO:tasks.workunit.client.0.smithi073.stderr: -23> 2024-09-12T00:52:30.590+0000 7fd400740800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:52:30.669 INFO:tasks.workunit.client.0.smithi073.stderr: -22> 2024-09-12T00:52:30.590+0000 7fd400740800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:52:30.669 INFO:tasks.workunit.client.0.smithi073.stderr: -21> 2024-09-12T00:52:30.590+0000 7fd400740800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36 : miss 2024-09-12T00:52:30.669 INFO:tasks.workunit.client.0.smithi073.stderr: -20> 2024-09-12T00:52:30.590+0000 7fd400740800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.669 INFO:tasks.workunit.client.0.smithi073.stderr: -19> 2024-09-12T00:52:30.590+0000 7fd400740800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:52:30.669 INFO:tasks.workunit.client.0.smithi073.stderr: -18> 2024-09-12T00:52:30.590+0000 7fd400740800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36 info.flags=0x17 2024-09-12T00:52:30.669 INFO:tasks.workunit.client.0.smithi073.stderr: -17> 2024-09-12T00:52:30.590+0000 7fd400740800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36 to cache LRU end 2024-09-12T00:52:30.669 INFO:tasks.workunit.client.0.smithi073.stderr: -16> 2024-09-12T00:52:30.590+0000 7fd400740800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:52:30.670 INFO:tasks.workunit.client.0.smithi073.stderr: -15> 2024-09-12T00:52:30.590+0000 7fd400740800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:30.670 INFO:tasks.workunit.client.0.smithi073.stderr: -14> 2024-09-12T00:52:30.590+0000 7fd400740800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36 2024-09-12T00:52:30.670 INFO:tasks.workunit.client.0.smithi073.stderr: -13> 2024-09-12T00:52:30.594+0000 7fd400740800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36 info.flags=0x17 2024-09-12T00:52:30.670 INFO:tasks.workunit.client.0.smithi073.stderr: -12> 2024-09-12T00:52:30.594+0000 7fd400740800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36 to cache LRU end 2024-09-12T00:52:30.670 INFO:tasks.workunit.client.0.smithi073.stderr: -11> 2024-09-12T00:52:30.594+0000 7fd400740800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:30.670 INFO:tasks.workunit.client.0.smithi073.stderr: -10> 2024-09-12T00:52:30.594+0000 7fd400740800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36, ofs0, ns] 2024-09-12T00:52:30.670 INFO:tasks.workunit.client.0.smithi073.stderr: -9> 2024-09-12T00:52:30.594+0000 7fd2d37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497011 cookie 94853157291808 notifier 7758 bl.length()=923 2024-09-12T00:52:30.670 INFO:tasks.workunit.client.0.smithi073.stderr: -8> 2024-09-12T00:52:30.594+0000 7fd2d37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36 info.flags=0x17 2024-09-12T00:52:30.670 INFO:tasks.workunit.client.0.smithi073.stderr: -7> 2024-09-12T00:52:30.594+0000 7fd2d37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36 to cache LRU end 2024-09-12T00:52:30.670 INFO:tasks.workunit.client.0.smithi073.stderr: -6> 2024-09-12T00:52:30.594+0000 7fd2d37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:30.670 INFO:tasks.workunit.client.0.smithi073.stderr: -5> 2024-09-12T00:52:30.596+0000 7fd400740800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36]): orig_sources= new_sources= 2024-09-12T00:52:30.670 INFO:tasks.workunit.client.0.smithi073.stderr: -4> 2024-09-12T00:52:30.596+0000 7fd400740800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36]): potential sources added=[] removed=[] 2024-09-12T00:52:30.670 INFO:tasks.workunit.client.0.smithi073.stderr: -3> 2024-09-12T00:52:30.596+0000 7fd400740800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36]): orig_dests= new_dests= 2024-09-12T00:52:30.671 INFO:tasks.workunit.client.0.smithi073.stderr: -2> 2024-09-12T00:52:30.596+0000 7fd400740800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36]): potential dests added=[] removed=[] 2024-09-12T00:52:30.671 INFO:tasks.workunit.client.0.smithi073.stderr: -1> 2024-09-12T00:52:30.598+0000 7fd400740800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd400740800 time 2024-09-12T00:52:30.599126+0000 2024-09-12T00:52:30.671 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:52:30.671 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:52:30.671 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:52:30.671 INFO:tasks.workunit.client.0.smithi073.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd401f8c71a] 2024-09-12T00:52:30.671 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd401f8c8d8] 2024-09-12T00:52:30.671 INFO:tasks.workunit.client.0.smithi073.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5644b6cc1641] 2024-09-12T00:52:30.671 INFO:tasks.workunit.client.0.smithi073.stderr: 4: radosgw-admin(+0xd8854c) [0x5644b71d454c] 2024-09-12T00:52:30.671 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5644b6cd131d] 2024-09-12T00:52:30.671 INFO:tasks.workunit.client.0.smithi073.stderr: 6: main() 2024-09-12T00:52:30.671 INFO:tasks.workunit.client.0.smithi073.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fd400c29590] 2024-09-12T00:52:30.671 INFO:tasks.workunit.client.0.smithi073.stderr: 8: __libc_start_main() 2024-09-12T00:52:30.672 INFO:tasks.workunit.client.0.smithi073.stderr: 9: _start() 2024-09-12T00:52:30.672 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:52:30.672 INFO:tasks.workunit.client.0.smithi073.stderr: 0> 2024-09-12T00:52:30.599+0000 7fd400740800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:52:30.672 INFO:tasks.workunit.client.0.smithi073.stderr: in thread 7fd400740800 thread_name:radosgw-admin 2024-09-12T00:52:30.672 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:52:30.672 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:52:30.672 INFO:tasks.workunit.client.0.smithi073.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd400c3e6f0] 2024-09-12T00:52:30.672 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd400c8b99c] 2024-09-12T00:52:30.672 INFO:tasks.workunit.client.0.smithi073.stderr: 3: raise() 2024-09-12T00:52:30.672 INFO:tasks.workunit.client.0.smithi073.stderr: 4: abort() 2024-09-12T00:52:30.672 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd401f8c774] 2024-09-12T00:52:30.672 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd401f8c8d8] 2024-09-12T00:52:30.672 INFO:tasks.workunit.client.0.smithi073.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5644b6cc1641] 2024-09-12T00:52:30.672 INFO:tasks.workunit.client.0.smithi073.stderr: 8: radosgw-admin(+0xd8854c) [0x5644b71d454c] 2024-09-12T00:52:30.673 INFO:tasks.workunit.client.0.smithi073.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5644b6cd131d] 2024-09-12T00:52:30.673 INFO:tasks.workunit.client.0.smithi073.stderr: 10: main() 2024-09-12T00:52:30.673 INFO:tasks.workunit.client.0.smithi073.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fd400c29590] 2024-09-12T00:52:30.673 INFO:tasks.workunit.client.0.smithi073.stderr: 12: __libc_start_main() 2024-09-12T00:52:30.673 INFO:tasks.workunit.client.0.smithi073.stderr: 13: _start() 2024-09-12T00:52:30.673 INFO:tasks.workunit.client.0.smithi073.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:52:30.673 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:52:30.673 INFO:tasks.workunit.client.0.smithi073.stderr:--- logging levels --- 2024-09-12T00:52:30.673 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 none 2024-09-12T00:52:30.673 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 lockdep 2024-09-12T00:52:30.673 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 context 2024-09-12T00:52:30.673 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 crush 2024-09-12T00:52:30.673 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds 2024-09-12T00:52:30.674 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_balancer 2024-09-12T00:52:30.674 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_locker 2024-09-12T00:52:30.674 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_log 2024-09-12T00:52:30.674 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_log_expire 2024-09-12T00:52:30.674 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_migrator 2024-09-12T00:52:30.674 INFO:tasks.workunit.client.0.smithi073.stderr: 3/ 5 mds_quiesce 2024-09-12T00:52:30.674 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 buffer 2024-09-12T00:52:30.674 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 timer 2024-09-12T00:52:30.674 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 filer 2024-09-12T00:52:30.674 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 striper 2024-09-12T00:52:30.674 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 objecter 2024-09-12T00:52:30.674 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rados 2024-09-12T00:52:30.674 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd 2024-09-12T00:52:30.674 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_mirror 2024-09-12T00:52:30.674 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_replay 2024-09-12T00:52:30.675 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_pwl 2024-09-12T00:52:30.675 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 journaler 2024-09-12T00:52:30.675 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 objectcacher 2024-09-12T00:52:30.675 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:52:30.675 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 client 2024-09-12T00:52:30.675 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 osd 2024-09-12T00:52:30.675 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 optracker 2024-09-12T00:52:30.675 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 objclass 2024-09-12T00:52:30.675 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 filestore 2024-09-12T00:52:30.675 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 journal 2024-09-12T00:52:30.675 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 0 ms 2024-09-12T00:52:30.675 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mon 2024-09-12T00:52:30.675 INFO:tasks.workunit.client.0.smithi073.stderr: 0/10 monc 2024-09-12T00:52:30.676 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 paxos 2024-09-12T00:52:30.676 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 tp 2024-09-12T00:52:30.676 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 auth 2024-09-12T00:52:30.676 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 crypto 2024-09-12T00:52:30.676 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 finisher 2024-09-12T00:52:30.676 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 reserver 2024-09-12T00:52:30.676 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 heartbeatmap 2024-09-12T00:52:30.676 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 perfcounter 2024-09-12T00:52:30.676 INFO:tasks.workunit.client.0.smithi073.stderr: 20/20 rgw 2024-09-12T00:52:30.676 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_sync 2024-09-12T00:52:30.676 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_datacache 2024-09-12T00:52:30.676 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_access 2024-09-12T00:52:30.676 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:52:30.677 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_flight 2024-09-12T00:52:30.677 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:52:30.677 INFO:tasks.workunit.client.0.smithi073.stderr: 20/20 rgw_notification 2024-09-12T00:52:30.677 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 javaclient 2024-09-12T00:52:30.677 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 asok 2024-09-12T00:52:30.677 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 throttle 2024-09-12T00:52:30.677 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 0 refs 2024-09-12T00:52:30.677 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 compressor 2024-09-12T00:52:30.677 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 bluestore 2024-09-12T00:52:30.677 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 bluefs 2024-09-12T00:52:30.677 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 bdev 2024-09-12T00:52:30.677 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 kstore 2024-09-12T00:52:30.677 INFO:tasks.workunit.client.0.smithi073.stderr: 4/ 5 rocksdb 2024-09-12T00:52:30.677 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 fuse 2024-09-12T00:52:30.678 INFO:tasks.workunit.client.0.smithi073.stderr: 2/ 5 mgr 2024-09-12T00:52:30.678 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mgrc 2024-09-12T00:52:30.678 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 dpdk 2024-09-12T00:52:30.678 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 eventtrace 2024-09-12T00:52:30.678 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 prioritycache 2024-09-12T00:52:30.678 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 test 2024-09-12T00:52:30.678 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:52:30.678 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cephsqlite 2024-09-12T00:52:30.678 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:52:30.678 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore 2024-09-12T00:52:30.678 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_onode 2024-09-12T00:52:30.678 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_odata 2024-09-12T00:52:30.678 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_omap 2024-09-12T00:52:30.678 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_tm 2024-09-12T00:52:30.679 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_t 2024-09-12T00:52:30.679 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:52:30.679 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_epm 2024-09-12T00:52:30.679 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_lba 2024-09-12T00:52:30.679 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:52:30.679 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_cache 2024-09-12T00:52:30.679 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_journal 2024-09-12T00:52:30.679 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_device 2024-09-12T00:52:30.679 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_backref 2024-09-12T00:52:30.679 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 alienstore 2024-09-12T00:52:30.679 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mclock 2024-09-12T00:52:30.679 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cyanstore 2024-09-12T00:52:30.679 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 ceph_exporter 2024-09-12T00:52:30.679 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 memstore 2024-09-12T00:52:30.680 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 trace 2024-09-12T00:52:30.680 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 ceph_dedup 2024-09-12T00:52:30.680 INFO:tasks.workunit.client.0.smithi073.stderr: -2/-2 (syslog threshold) 2024-09-12T00:52:30.680 INFO:tasks.workunit.client.0.smithi073.stderr: 99/99 (stderr threshold) 2024-09-12T00:52:30.680 INFO:tasks.workunit.client.0.smithi073.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:52:30.680 INFO:tasks.workunit.client.0.smithi073.stderr: 7fd2237fe640 / http_manager 2024-09-12T00:52:30.680 INFO:tasks.workunit.client.0.smithi073.stderr: 7fd2b1fdb640 / http_manager 2024-09-12T00:52:30.680 INFO:tasks.workunit.client.0.smithi073.stderr: 7fd2b2fdd640 / rgw_dt_lg_renew 2024-09-12T00:52:30.680 INFO:tasks.workunit.client.0.smithi073.stderr: 7fd2d1ffb640 / ms_dispatch 2024-09-12T00:52:30.680 INFO:tasks.workunit.client.0.smithi073.stderr: 7fd2d37fe640 / io_context_pool 2024-09-12T00:52:30.680 INFO:tasks.workunit.client.0.smithi073.stderr: 7fd2e1ffb640 / ms_dispatch 2024-09-12T00:52:30.680 INFO:tasks.workunit.client.0.smithi073.stderr: 7fd2e8e09640 / ms_dispatch 2024-09-12T00:52:30.680 INFO:tasks.workunit.client.0.smithi073.stderr: 7fd2ea60c640 / io_context_pool 2024-09-12T00:52:30.680 INFO:tasks.workunit.client.0.smithi073.stderr: 7fd3f3fff640 / msgr-worker-2 2024-09-12T00:52:30.681 INFO:tasks.workunit.client.0.smithi073.stderr: 7fd3fc4c0640 / msgr-worker-1 2024-09-12T00:52:30.681 INFO:tasks.workunit.client.0.smithi073.stderr: 7fd3fccc1640 / msgr-worker-0 2024-09-12T00:52:30.681 INFO:tasks.workunit.client.0.smithi073.stderr: 7fd3fd4c2640 / io_context_pool 2024-09-12T00:52:30.681 INFO:tasks.workunit.client.0.smithi073.stderr: 7fd400740800 / radosgw-admin 2024-09-12T00:52:30.681 INFO:tasks.workunit.client.0.smithi073.stderr: max_recent 500 2024-09-12T00:52:30.681 INFO:tasks.workunit.client.0.smithi073.stderr: max_new 1000 2024-09-12T00:52:30.681 INFO:tasks.workunit.client.0.smithi073.stderr: log_file /var/log/ceph/ceph-client.admin.134292.log 2024-09-12T00:52:30.681 INFO:tasks.workunit.client.0.smithi073.stderr:--- end dump of recent events --- 2024-09-12T00:52:30.681 INFO:tasks.workunit.client.0.smithi073.stderr:--- begin dump of recent events --- 2024-09-12T00:52:30.681 INFO:tasks.workunit.client.0.smithi073.stderr: -499> 2024-09-12T00:52:30.344+0000 7fd2ea60c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:52:30.681 INFO:tasks.workunit.client.0.smithi073.stderr: -498> 2024-09-12T00:52:30.344+0000 7fd2ea60c640 10 monclient: dump: 2024-09-12T00:52:30.681 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:52:30.681 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:52:30.682 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:52:30.682 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:52:30.682 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:30.682 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:52:30.682 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:52:30.682 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:52:30.682 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:52:30.682 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:52:30.682 INFO:tasks.workunit.client.0.smithi073.stderr: -497> 2024-09-12T00:52:30.345+0000 7fd400740800 10 monclient: shutdown 2024-09-12T00:52:30.682 INFO:tasks.workunit.client.0.smithi073.stderr: -496> 2024-09-12T00:52:30.345+0000 7fd400740800 5 asok(0x5644b88d1630) unregister_commands rotate-key 2024-09-12T00:52:30.682 INFO:tasks.workunit.client.0.smithi073.stderr: -495> 2024-09-12T00:52:30.345+0000 7fd400740800 10 monclient: build_initial_monmap 2024-09-12T00:52:30.682 INFO:tasks.workunit.client.0.smithi073.stderr: -494> 2024-09-12T00:52:30.345+0000 7fd400740800 1 build_initial for_mkfs: 0 2024-09-12T00:52:30.682 INFO:tasks.workunit.client.0.smithi073.stderr: -493> 2024-09-12T00:52:30.345+0000 7fd400740800 10 monclient: monmap: 2024-09-12T00:52:30.683 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:52:30.683 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:52:30.683 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:52:30.683 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:52:30.683 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:52:30.683 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:52:30.683 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:52:30.683 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:52:30.683 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:52:30.683 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:52:30.683 INFO:tasks.workunit.client.0.smithi073.stderr: -492> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af6390) adding auth protocol: cephx 2024-09-12T00:52:30.683 INFO:tasks.workunit.client.0.smithi073.stderr: -491> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af6390) adding auth protocol: cephx 2024-09-12T00:52:30.683 INFO:tasks.workunit.client.0.smithi073.stderr: -490> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af6390) adding auth protocol: cephx 2024-09-12T00:52:30.684 INFO:tasks.workunit.client.0.smithi073.stderr: -489> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af6390) adding con mode: secure 2024-09-12T00:52:30.684 INFO:tasks.workunit.client.0.smithi073.stderr: -488> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af6390) adding con mode: crc 2024-09-12T00:52:30.684 INFO:tasks.workunit.client.0.smithi073.stderr: -487> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af6390) adding con mode: secure 2024-09-12T00:52:30.684 INFO:tasks.workunit.client.0.smithi073.stderr: -486> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af6390) adding con mode: crc 2024-09-12T00:52:30.684 INFO:tasks.workunit.client.0.smithi073.stderr: -485> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af6390) adding con mode: secure 2024-09-12T00:52:30.684 INFO:tasks.workunit.client.0.smithi073.stderr: -484> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af6390) adding con mode: crc 2024-09-12T00:52:30.684 INFO:tasks.workunit.client.0.smithi073.stderr: -483> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af6390) adding con mode: crc 2024-09-12T00:52:30.684 INFO:tasks.workunit.client.0.smithi073.stderr: -482> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af6390) adding con mode: secure 2024-09-12T00:52:30.684 INFO:tasks.workunit.client.0.smithi073.stderr: -481> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af6390) adding con mode: crc 2024-09-12T00:52:30.684 INFO:tasks.workunit.client.0.smithi073.stderr: -480> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af6390) adding con mode: secure 2024-09-12T00:52:30.684 INFO:tasks.workunit.client.0.smithi073.stderr: -479> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af6390) adding con mode: crc 2024-09-12T00:52:30.684 INFO:tasks.workunit.client.0.smithi073.stderr: -478> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af6390) adding con mode: secure 2024-09-12T00:52:30.684 INFO:tasks.workunit.client.0.smithi073.stderr: -477> 2024-09-12T00:52:30.345+0000 7fd400740800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:30.685 INFO:tasks.workunit.client.0.smithi073.stderr: -476> 2024-09-12T00:52:30.345+0000 7fd400740800 1 librados: starting msgr at 2024-09-12T00:52:30.685 INFO:tasks.workunit.client.0.smithi073.stderr: -475> 2024-09-12T00:52:30.345+0000 7fd400740800 1 librados: starting objecter 2024-09-12T00:52:30.685 INFO:tasks.workunit.client.0.smithi073.stderr: -474> 2024-09-12T00:52:30.345+0000 7fd400740800 5 asok(0x5644b88d1630) register_command objecter_requests hook 0x5644b8af2e40 2024-09-12T00:52:30.685 INFO:tasks.workunit.client.0.smithi073.stderr: -473> 2024-09-12T00:52:30.345+0000 7fd400740800 1 librados: setting wanted keys 2024-09-12T00:52:30.685 INFO:tasks.workunit.client.0.smithi073.stderr: -472> 2024-09-12T00:52:30.345+0000 7fd400740800 1 librados: calling monclient init 2024-09-12T00:52:30.685 INFO:tasks.workunit.client.0.smithi073.stderr: -471> 2024-09-12T00:52:30.345+0000 7fd400740800 10 monclient: init 2024-09-12T00:52:30.685 INFO:tasks.workunit.client.0.smithi073.stderr: -470> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af0870) adding auth protocol: cephx 2024-09-12T00:52:30.685 INFO:tasks.workunit.client.0.smithi073.stderr: -469> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af0870) adding auth protocol: cephx 2024-09-12T00:52:30.685 INFO:tasks.workunit.client.0.smithi073.stderr: -468> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af0870) adding auth protocol: cephx 2024-09-12T00:52:30.685 INFO:tasks.workunit.client.0.smithi073.stderr: -467> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af0870) adding con mode: secure 2024-09-12T00:52:30.685 INFO:tasks.workunit.client.0.smithi073.stderr: -466> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af0870) adding con mode: crc 2024-09-12T00:52:30.685 INFO:tasks.workunit.client.0.smithi073.stderr: -465> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af0870) adding con mode: secure 2024-09-12T00:52:30.685 INFO:tasks.workunit.client.0.smithi073.stderr: -464> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af0870) adding con mode: crc 2024-09-12T00:52:30.686 INFO:tasks.workunit.client.0.smithi073.stderr: -463> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af0870) adding con mode: secure 2024-09-12T00:52:30.686 INFO:tasks.workunit.client.0.smithi073.stderr: -462> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af0870) adding con mode: crc 2024-09-12T00:52:30.686 INFO:tasks.workunit.client.0.smithi073.stderr: -461> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af0870) adding con mode: crc 2024-09-12T00:52:30.686 INFO:tasks.workunit.client.0.smithi073.stderr: -460> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af0870) adding con mode: secure 2024-09-12T00:52:30.686 INFO:tasks.workunit.client.0.smithi073.stderr: -459> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af0870) adding con mode: crc 2024-09-12T00:52:30.686 INFO:tasks.workunit.client.0.smithi073.stderr: -458> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af0870) adding con mode: secure 2024-09-12T00:52:30.686 INFO:tasks.workunit.client.0.smithi073.stderr: -457> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af0870) adding con mode: crc 2024-09-12T00:52:30.686 INFO:tasks.workunit.client.0.smithi073.stderr: -456> 2024-09-12T00:52:30.345+0000 7fd400740800 5 AuthRegistry(0x5644b8af0870) adding con mode: secure 2024-09-12T00:52:30.686 INFO:tasks.workunit.client.0.smithi073.stderr: -455> 2024-09-12T00:52:30.346+0000 7fd400740800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:30.686 INFO:tasks.workunit.client.0.smithi073.stderr: -454> 2024-09-12T00:52:30.346+0000 7fd400740800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:30.686 INFO:tasks.workunit.client.0.smithi073.stderr: -453> 2024-09-12T00:52:30.346+0000 7fd400740800 5 asok(0x5644b88d1630) register_command rotate-key hook 0x5644b8af09b8 2024-09-12T00:52:30.686 INFO:tasks.workunit.client.0.smithi073.stderr: -452> 2024-09-12T00:52:30.346+0000 7fd400740800 10 monclient: _reopen_session rank -1 2024-09-12T00:52:30.686 INFO:tasks.workunit.client.0.smithi073.stderr: -451> 2024-09-12T00:52:30.346+0000 7fd400740800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:52:30.687 INFO:tasks.workunit.client.0.smithi073.stderr: -450> 2024-09-12T00:52:30.346+0000 7fd400740800 10 monclient(hunting): picked mon.noname-c con 0x5644b89a68b0 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:52:30.687 INFO:tasks.workunit.client.0.smithi073.stderr: -449> 2024-09-12T00:52:30.346+0000 7fd400740800 10 monclient(hunting): picked mon.noname-b con 0x5644b89a9b00 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:52:30.687 INFO:tasks.workunit.client.0.smithi073.stderr: -448> 2024-09-12T00:52:30.346+0000 7fd400740800 10 monclient(hunting): picked mon.noname-a con 0x5644b8b22760 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:52:30.687 INFO:tasks.workunit.client.0.smithi073.stderr: -447> 2024-09-12T00:52:30.346+0000 7fd400740800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:30.687 INFO:tasks.workunit.client.0.smithi073.stderr: -446> 2024-09-12T00:52:30.346+0000 7fd400740800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:30.687 INFO:tasks.workunit.client.0.smithi073.stderr: -445> 2024-09-12T00:52:30.346+0000 7fd400740800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:30.687 INFO:tasks.workunit.client.0.smithi073.stderr: -444> 2024-09-12T00:52:30.346+0000 7fd400740800 10 monclient(hunting): _renew_subs 2024-09-12T00:52:30.687 INFO:tasks.workunit.client.0.smithi073.stderr: -443> 2024-09-12T00:52:30.346+0000 7fd400740800 10 monclient(hunting): authenticate will time out at 2211.017517s 2024-09-12T00:52:30.687 INFO:tasks.workunit.client.0.smithi073.stderr: -442> 2024-09-12T00:52:30.346+0000 7fd3fc4c0640 10 monclient(hunting): get_auth_request con 0x5644b89a68b0 auth_method 0 2024-09-12T00:52:30.687 INFO:tasks.workunit.client.0.smithi073.stderr: -441> 2024-09-12T00:52:30.346+0000 7fd3fc4c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:30.687 INFO:tasks.workunit.client.0.smithi073.stderr: -440> 2024-09-12T00:52:30.346+0000 7fd3fc4c0640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:30.687 INFO:tasks.workunit.client.0.smithi073.stderr: -439> 2024-09-12T00:52:30.346+0000 7fd3fc4c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:30.687 INFO:tasks.workunit.client.0.smithi073.stderr: -438> 2024-09-12T00:52:30.346+0000 7fd3fccc1640 10 monclient(hunting): get_auth_request con 0x5644b8b22760 auth_method 0 2024-09-12T00:52:30.688 INFO:tasks.workunit.client.0.smithi073.stderr: -437> 2024-09-12T00:52:30.346+0000 7fd3fccc1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:30.688 INFO:tasks.workunit.client.0.smithi073.stderr: -436> 2024-09-12T00:52:30.346+0000 7fd3fccc1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:30.688 INFO:tasks.workunit.client.0.smithi073.stderr: -435> 2024-09-12T00:52:30.346+0000 7fd3fccc1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:30.688 INFO:tasks.workunit.client.0.smithi073.stderr: -434> 2024-09-12T00:52:30.346+0000 7fd3fccc1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:30.688 INFO:tasks.workunit.client.0.smithi073.stderr: -433> 2024-09-12T00:52:30.346+0000 7fd3fccc1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:30.688 INFO:tasks.workunit.client.0.smithi073.stderr: -432> 2024-09-12T00:52:30.346+0000 7fd3fccc1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:30.688 INFO:tasks.workunit.client.0.smithi073.stderr: -431> 2024-09-12T00:52:30.346+0000 7fd3fc4c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:30.688 INFO:tasks.workunit.client.0.smithi073.stderr: -430> 2024-09-12T00:52:30.346+0000 7fd3fc4c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:30.688 INFO:tasks.workunit.client.0.smithi073.stderr: -429> 2024-09-12T00:52:30.346+0000 7fd3fc4c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:30.688 INFO:tasks.workunit.client.0.smithi073.stderr: -428> 2024-09-12T00:52:30.346+0000 7fd3f3fff640 10 monclient(hunting): get_auth_request con 0x5644b89a9b00 auth_method 0 2024-09-12T00:52:30.688 INFO:tasks.workunit.client.0.smithi073.stderr: -427> 2024-09-12T00:52:30.346+0000 7fd3f3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:30.688 INFO:tasks.workunit.client.0.smithi073.stderr: -426> 2024-09-12T00:52:30.346+0000 7fd3f3fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:30.689 INFO:tasks.workunit.client.0.smithi073.stderr: -425> 2024-09-12T00:52:30.346+0000 7fd3f3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:30.689 INFO:tasks.workunit.client.0.smithi073.stderr: -424> 2024-09-12T00:52:30.346+0000 7fd3fccc1640 10 monclient(hunting): handle_auth_done global_id 7749 payload 824 2024-09-12T00:52:30.689 INFO:tasks.workunit.client.0.smithi073.stderr: -423> 2024-09-12T00:52:30.346+0000 7fd3fccc1640 10 monclient: _finish_hunting 0 2024-09-12T00:52:30.689 INFO:tasks.workunit.client.0.smithi073.stderr: -422> 2024-09-12T00:52:30.346+0000 7fd3fccc1640 1 monclient: found mon.noname-a 2024-09-12T00:52:30.689 INFO:tasks.workunit.client.0.smithi073.stderr: -421> 2024-09-12T00:52:30.346+0000 7fd3fccc1640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:52:30.689 INFO:tasks.workunit.client.0.smithi073.stderr: -420> 2024-09-12T00:52:30.347+0000 7fd2e8e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:30.689 INFO:tasks.workunit.client.0.smithi073.stderr: -419> 2024-09-12T00:52:30.347+0000 7fd2e8e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:52:30.689 INFO:tasks.workunit.client.0.smithi073.stderr: -418> 2024-09-12T00:52:30.347+0000 7fd2e8e09640 10 monclient: dump: 2024-09-12T00:52:30.689 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:52:30.689 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:52:30.689 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:52:30.689 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:52:30.689 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:30.689 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:52:30.690 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:52:30.690 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:52:30.690 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:52:30.690 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:52:30.690 INFO:tasks.workunit.client.0.smithi073.stderr: -417> 2024-09-12T00:52:30.347+0000 7fd2e8e09640 10 monclient: _finish_auth 0 2024-09-12T00:52:30.690 INFO:tasks.workunit.client.0.smithi073.stderr: -416> 2024-09-12T00:52:30.347+0000 7fd2e8e09640 10 monclient: _check_auth_tickets 2024-09-12T00:52:30.690 INFO:tasks.workunit.client.0.smithi073.stderr: -415> 2024-09-12T00:52:30.347+0000 7fd2e8e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:52:30.690 INFO:tasks.workunit.client.0.smithi073.stderr: -414> 2024-09-12T00:52:30.347+0000 7fd2e8e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:30.690 INFO:tasks.workunit.client.0.smithi073.stderr: -413> 2024-09-12T00:52:30.347+0000 7fd2e8e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:52:30.690 INFO:tasks.workunit.client.0.smithi073.stderr: -412> 2024-09-12T00:52:30.347+0000 7fd2e8e09640 10 monclient: dump: 2024-09-12T00:52:30.690 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:52:30.690 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:52:30.690 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:52:30.691 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:52:30.691 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:30.691 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:52:30.691 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:52:30.691 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:52:30.691 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:52:30.691 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:52:30.691 INFO:tasks.workunit.client.0.smithi073.stderr: -411> 2024-09-12T00:52:30.347+0000 7fd400740800 5 monclient: authenticate success, global_id 7749 2024-09-12T00:52:30.691 INFO:tasks.workunit.client.0.smithi073.stderr: -410> 2024-09-12T00:52:30.347+0000 7fd400740800 10 monclient: _renew_subs 2024-09-12T00:52:30.691 INFO:tasks.workunit.client.0.smithi073.stderr: -409> 2024-09-12T00:52:30.347+0000 7fd400740800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:52:30.691 INFO:tasks.workunit.client.0.smithi073.stderr: -408> 2024-09-12T00:52:30.347+0000 7fd2ea60c640 4 set_mon_vals no callback set 2024-09-12T00:52:30.691 INFO:tasks.workunit.client.0.smithi073.stderr: -407> 2024-09-12T00:52:30.347+0000 7fd400740800 10 monclient: _renew_subs 2024-09-12T00:52:30.691 INFO:tasks.workunit.client.0.smithi073.stderr: -406> 2024-09-12T00:52:30.347+0000 7fd400740800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:52:30.691 INFO:tasks.workunit.client.0.smithi073.stderr: -405> 2024-09-12T00:52:30.347+0000 7fd400740800 1 librados: init done 2024-09-12T00:52:30.692 INFO:tasks.workunit.client.0.smithi073.stderr: -404> 2024-09-12T00:52:30.349+0000 7fd2e8e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:52:30.692 INFO:tasks.workunit.client.0.smithi073.stderr: -403> 2024-09-12T00:52:30.349+0000 7fd2e8e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:52:30.692 INFO:tasks.workunit.client.0.smithi073.stderr: -402> 2024-09-12T00:52:30.349+0000 7fd2e8e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:52:30.692 INFO:tasks.workunit.client.0.smithi073.stderr: -401> 2024-09-12T00:52:30.349+0000 7fd3fc4c0640 10 monclient: get_auth_request con 0x7fd2e4076470 auth_method 0 2024-09-12T00:52:30.692 INFO:tasks.workunit.client.0.smithi073.stderr: -400> 2024-09-12T00:52:30.349+0000 7fd3f3fff640 10 monclient: get_auth_request con 0x5644b8b19440 auth_method 0 2024-09-12T00:52:30.692 INFO:tasks.workunit.client.0.smithi073.stderr: -399> 2024-09-12T00:52:30.350+0000 7fd3fc4c0640 10 monclient: get_auth_request con 0x5644b8b3d410 auth_method 0 2024-09-12T00:52:30.692 INFO:tasks.workunit.client.0.smithi073.stderr: -398> 2024-09-12T00:52:30.351+0000 7fd3f3fff640 10 monclient: get_auth_request con 0x5644b8b41770 auth_method 0 2024-09-12T00:52:30.692 INFO:tasks.workunit.client.0.smithi073.stderr: -397> 2024-09-12T00:52:30.352+0000 7fd400740800 10 monclient: build_initial_monmap 2024-09-12T00:52:30.692 INFO:tasks.workunit.client.0.smithi073.stderr: -396> 2024-09-12T00:52:30.352+0000 7fd400740800 1 build_initial for_mkfs: 0 2024-09-12T00:52:30.692 INFO:tasks.workunit.client.0.smithi073.stderr: -395> 2024-09-12T00:52:30.352+0000 7fd400740800 10 monclient: monmap: 2024-09-12T00:52:30.692 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:52:30.692 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:52:30.692 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:52:30.693 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:52:30.693 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:52:30.693 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:52:30.693 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:52:30.693 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:52:30.693 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:52:30.693 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:52:30.693 INFO:tasks.workunit.client.0.smithi073.stderr: -394> 2024-09-12T00:52:30.352+0000 7fd400740800 5 AuthRegistry(0x5644b8b46520) adding auth protocol: cephx 2024-09-12T00:52:30.693 INFO:tasks.workunit.client.0.smithi073.stderr: -393> 2024-09-12T00:52:30.352+0000 7fd400740800 5 AuthRegistry(0x5644b8b46520) adding auth protocol: cephx 2024-09-12T00:52:30.693 INFO:tasks.workunit.client.0.smithi073.stderr: -392> 2024-09-12T00:52:30.352+0000 7fd400740800 5 AuthRegistry(0x5644b8b46520) adding auth protocol: cephx 2024-09-12T00:52:30.693 INFO:tasks.workunit.client.0.smithi073.stderr: -391> 2024-09-12T00:52:30.352+0000 7fd400740800 5 AuthRegistry(0x5644b8b46520) adding con mode: secure 2024-09-12T00:52:30.693 INFO:tasks.workunit.client.0.smithi073.stderr: -390> 2024-09-12T00:52:30.352+0000 7fd400740800 5 AuthRegistry(0x5644b8b46520) adding con mode: crc 2024-09-12T00:52:30.693 INFO:tasks.workunit.client.0.smithi073.stderr: -389> 2024-09-12T00:52:30.352+0000 7fd400740800 5 AuthRegistry(0x5644b8b46520) adding con mode: secure 2024-09-12T00:52:30.694 INFO:tasks.workunit.client.0.smithi073.stderr: -388> 2024-09-12T00:52:30.352+0000 7fd400740800 5 AuthRegistry(0x5644b8b46520) adding con mode: crc 2024-09-12T00:52:30.694 INFO:tasks.workunit.client.0.smithi073.stderr: -387> 2024-09-12T00:52:30.352+0000 7fd400740800 5 AuthRegistry(0x5644b8b46520) adding con mode: secure 2024-09-12T00:52:30.694 INFO:tasks.workunit.client.0.smithi073.stderr: -386> 2024-09-12T00:52:30.352+0000 7fd400740800 5 AuthRegistry(0x5644b8b46520) adding con mode: crc 2024-09-12T00:52:30.694 INFO:tasks.workunit.client.0.smithi073.stderr: -385> 2024-09-12T00:52:30.352+0000 7fd400740800 5 AuthRegistry(0x5644b8b46520) adding con mode: crc 2024-09-12T00:52:30.694 INFO:tasks.workunit.client.0.smithi073.stderr: -384> 2024-09-12T00:52:30.352+0000 7fd400740800 5 AuthRegistry(0x5644b8b46520) adding con mode: secure 2024-09-12T00:52:30.694 INFO:tasks.workunit.client.0.smithi073.stderr: -383> 2024-09-12T00:52:30.352+0000 7fd400740800 5 AuthRegistry(0x5644b8b46520) adding con mode: crc 2024-09-12T00:52:30.694 INFO:tasks.workunit.client.0.smithi073.stderr: -382> 2024-09-12T00:52:30.352+0000 7fd400740800 5 AuthRegistry(0x5644b8b46520) adding con mode: secure 2024-09-12T00:52:30.694 INFO:tasks.workunit.client.0.smithi073.stderr: -381> 2024-09-12T00:52:30.352+0000 7fd400740800 5 AuthRegistry(0x5644b8b46520) adding con mode: crc 2024-09-12T00:52:30.694 INFO:tasks.workunit.client.0.smithi073.stderr: -380> 2024-09-12T00:52:30.352+0000 7fd400740800 5 AuthRegistry(0x5644b8b46520) adding con mode: secure 2024-09-12T00:52:30.694 INFO:tasks.workunit.client.0.smithi073.stderr: -379> 2024-09-12T00:52:30.353+0000 7fd400740800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:30.694 INFO:tasks.workunit.client.0.smithi073.stderr: -378> 2024-09-12T00:52:30.353+0000 7fd400740800 5 asok(0x5644b88d1630) register_command objecter_requests cmddesc objecter_requests hook 0x5644b8b49f50 EEXIST 2024-09-12T00:52:30.694 INFO:tasks.workunit.client.0.smithi073.stderr: -377> 2024-09-12T00:52:30.353+0000 7fd400740800 10 monclient: init 2024-09-12T00:52:30.694 INFO:tasks.workunit.client.0.smithi073.stderr: -376> 2024-09-12T00:52:30.353+0000 7fd400740800 5 AuthRegistry(0x5644b8b44c98) adding auth protocol: cephx 2024-09-12T00:52:30.695 INFO:tasks.workunit.client.0.smithi073.stderr: -375> 2024-09-12T00:52:30.353+0000 7fd400740800 5 AuthRegistry(0x5644b8b44c98) adding auth protocol: cephx 2024-09-12T00:52:30.695 INFO:tasks.workunit.client.0.smithi073.stderr: -374> 2024-09-12T00:52:30.353+0000 7fd400740800 5 AuthRegistry(0x5644b8b44c98) adding auth protocol: cephx 2024-09-12T00:52:30.695 INFO:tasks.workunit.client.0.smithi073.stderr: -373> 2024-09-12T00:52:30.353+0000 7fd400740800 5 AuthRegistry(0x5644b8b44c98) adding con mode: secure 2024-09-12T00:52:30.695 INFO:tasks.workunit.client.0.smithi073.stderr: -372> 2024-09-12T00:52:30.353+0000 7fd400740800 5 AuthRegistry(0x5644b8b44c98) adding con mode: crc 2024-09-12T00:52:30.695 INFO:tasks.workunit.client.0.smithi073.stderr: -371> 2024-09-12T00:52:30.353+0000 7fd400740800 5 AuthRegistry(0x5644b8b44c98) adding con mode: secure 2024-09-12T00:52:30.695 INFO:tasks.workunit.client.0.smithi073.stderr: -370> 2024-09-12T00:52:30.353+0000 7fd400740800 5 AuthRegistry(0x5644b8b44c98) adding con mode: crc 2024-09-12T00:52:30.695 INFO:tasks.workunit.client.0.smithi073.stderr: -369> 2024-09-12T00:52:30.353+0000 7fd400740800 5 AuthRegistry(0x5644b8b44c98) adding con mode: secure 2024-09-12T00:52:30.695 INFO:tasks.workunit.client.0.smithi073.stderr: -368> 2024-09-12T00:52:30.353+0000 7fd400740800 5 AuthRegistry(0x5644b8b44c98) adding con mode: crc 2024-09-12T00:52:30.695 INFO:tasks.workunit.client.0.smithi073.stderr: -367> 2024-09-12T00:52:30.353+0000 7fd400740800 5 AuthRegistry(0x5644b8b44c98) adding con mode: crc 2024-09-12T00:52:30.695 INFO:tasks.workunit.client.0.smithi073.stderr: -366> 2024-09-12T00:52:30.353+0000 7fd400740800 5 AuthRegistry(0x5644b8b44c98) adding con mode: secure 2024-09-12T00:52:30.695 INFO:tasks.workunit.client.0.smithi073.stderr: -365> 2024-09-12T00:52:30.353+0000 7fd400740800 5 AuthRegistry(0x5644b8b44c98) adding con mode: crc 2024-09-12T00:52:30.695 INFO:tasks.workunit.client.0.smithi073.stderr: -364> 2024-09-12T00:52:30.353+0000 7fd400740800 5 AuthRegistry(0x5644b8b44c98) adding con mode: secure 2024-09-12T00:52:30.695 INFO:tasks.workunit.client.0.smithi073.stderr: -363> 2024-09-12T00:52:30.353+0000 7fd400740800 5 AuthRegistry(0x5644b8b44c98) adding con mode: crc 2024-09-12T00:52:30.696 INFO:tasks.workunit.client.0.smithi073.stderr: -362> 2024-09-12T00:52:30.353+0000 7fd400740800 5 AuthRegistry(0x5644b8b44c98) adding con mode: secure 2024-09-12T00:52:30.696 INFO:tasks.workunit.client.0.smithi073.stderr: -361> 2024-09-12T00:52:30.353+0000 7fd400740800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:30.696 INFO:tasks.workunit.client.0.smithi073.stderr: -360> 2024-09-12T00:52:30.353+0000 7fd400740800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:30.696 INFO:tasks.workunit.client.0.smithi073.stderr: -359> 2024-09-12T00:52:30.353+0000 7fd400740800 5 asok(0x5644b88d1630) register_command rotate-key cmddesc rotate-key hook 0x5644b8b44de0 EEXIST 2024-09-12T00:52:30.696 INFO:tasks.workunit.client.0.smithi073.stderr: -358> 2024-09-12T00:52:30.353+0000 7fd400740800 10 monclient: _reopen_session rank -1 2024-09-12T00:52:30.696 INFO:tasks.workunit.client.0.smithi073.stderr: -357> 2024-09-12T00:52:30.353+0000 7fd400740800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:52:30.696 INFO:tasks.workunit.client.0.smithi073.stderr: -356> 2024-09-12T00:52:30.353+0000 7fd400740800 10 monclient(hunting): picked mon.noname-c con 0x5644b8b6dc40 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:52:30.696 INFO:tasks.workunit.client.0.smithi073.stderr: -355> 2024-09-12T00:52:30.353+0000 7fd400740800 10 monclient(hunting): picked mon.noname-a con 0x5644b8b6ff10 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:52:30.696 INFO:tasks.workunit.client.0.smithi073.stderr: -354> 2024-09-12T00:52:30.353+0000 7fd400740800 10 monclient(hunting): picked mon.noname-b con 0x5644b8b6c410 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:52:30.696 INFO:tasks.workunit.client.0.smithi073.stderr: -353> 2024-09-12T00:52:30.353+0000 7fd400740800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:30.696 INFO:tasks.workunit.client.0.smithi073.stderr: -352> 2024-09-12T00:52:30.353+0000 7fd400740800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:30.696 INFO:tasks.workunit.client.0.smithi073.stderr: -351> 2024-09-12T00:52:30.353+0000 7fd400740800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:30.696 INFO:tasks.workunit.client.0.smithi073.stderr: -350> 2024-09-12T00:52:30.353+0000 7fd400740800 10 monclient(hunting): _renew_subs 2024-09-12T00:52:30.696 INFO:tasks.workunit.client.0.smithi073.stderr: -349> 2024-09-12T00:52:30.353+0000 7fd400740800 10 monclient(hunting): authenticate will time out at 2211.024950s 2024-09-12T00:52:30.697 INFO:tasks.workunit.client.0.smithi073.stderr: -348> 2024-09-12T00:52:30.354+0000 7fd3fc4c0640 10 monclient(hunting): get_auth_request con 0x5644b8b6dc40 auth_method 0 2024-09-12T00:52:30.697 INFO:tasks.workunit.client.0.smithi073.stderr: -347> 2024-09-12T00:52:30.354+0000 7fd3fc4c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:30.697 INFO:tasks.workunit.client.0.smithi073.stderr: -346> 2024-09-12T00:52:30.354+0000 7fd3fc4c0640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:30.697 INFO:tasks.workunit.client.0.smithi073.stderr: -345> 2024-09-12T00:52:30.354+0000 7fd3fc4c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:30.697 INFO:tasks.workunit.client.0.smithi073.stderr: -344> 2024-09-12T00:52:30.354+0000 7fd3fccc1640 10 monclient(hunting): get_auth_request con 0x5644b8b6c410 auth_method 0 2024-09-12T00:52:30.697 INFO:tasks.workunit.client.0.smithi073.stderr: -343> 2024-09-12T00:52:30.354+0000 7fd3fccc1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:30.697 INFO:tasks.workunit.client.0.smithi073.stderr: -342> 2024-09-12T00:52:30.354+0000 7fd3fccc1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:30.697 INFO:tasks.workunit.client.0.smithi073.stderr: -341> 2024-09-12T00:52:30.354+0000 7fd3fccc1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:30.697 INFO:tasks.workunit.client.0.smithi073.stderr: -340> 2024-09-12T00:52:30.354+0000 7fd3f3fff640 10 monclient(hunting): get_auth_request con 0x5644b8b6ff10 auth_method 0 2024-09-12T00:52:30.697 INFO:tasks.workunit.client.0.smithi073.stderr: -339> 2024-09-12T00:52:30.354+0000 7fd3f3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:30.697 INFO:tasks.workunit.client.0.smithi073.stderr: -338> 2024-09-12T00:52:30.354+0000 7fd3f3fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:30.697 INFO:tasks.workunit.client.0.smithi073.stderr: -337> 2024-09-12T00:52:30.354+0000 7fd3f3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:30.697 INFO:tasks.workunit.client.0.smithi073.stderr: -336> 2024-09-12T00:52:30.354+0000 7fd3fc4c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:30.698 INFO:tasks.workunit.client.0.smithi073.stderr: -335> 2024-09-12T00:52:30.354+0000 7fd3fc4c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:30.698 INFO:tasks.workunit.client.0.smithi073.stderr: -334> 2024-09-12T00:52:30.354+0000 7fd3fc4c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:30.698 INFO:tasks.workunit.client.0.smithi073.stderr: -333> 2024-09-12T00:52:30.354+0000 7fd3fccc1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:30.698 INFO:tasks.workunit.client.0.smithi073.stderr: -332> 2024-09-12T00:52:30.354+0000 7fd3fccc1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:30.698 INFO:tasks.workunit.client.0.smithi073.stderr: -331> 2024-09-12T00:52:30.354+0000 7fd3fccc1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:30.698 INFO:tasks.workunit.client.0.smithi073.stderr: -330> 2024-09-12T00:52:30.354+0000 7fd3f3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:30.698 INFO:tasks.workunit.client.0.smithi073.stderr: -329> 2024-09-12T00:52:30.354+0000 7fd3f3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:30.698 INFO:tasks.workunit.client.0.smithi073.stderr: -328> 2024-09-12T00:52:30.354+0000 7fd3f3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:30.698 INFO:tasks.workunit.client.0.smithi073.stderr: -327> 2024-09-12T00:52:30.354+0000 7fd3f3fff640 10 monclient(hunting): handle_auth_done global_id 7752 payload 824 2024-09-12T00:52:30.698 INFO:tasks.workunit.client.0.smithi073.stderr: -326> 2024-09-12T00:52:30.354+0000 7fd3f3fff640 10 monclient: _finish_hunting 0 2024-09-12T00:52:30.698 INFO:tasks.workunit.client.0.smithi073.stderr: -325> 2024-09-12T00:52:30.354+0000 7fd3f3fff640 1 monclient: found mon.noname-a 2024-09-12T00:52:30.698 INFO:tasks.workunit.client.0.smithi073.stderr: -324> 2024-09-12T00:52:30.354+0000 7fd3f3fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:52:30.698 INFO:tasks.workunit.client.0.smithi073.stderr: -323> 2024-09-12T00:52:30.354+0000 7fd2e1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:30.699 INFO:tasks.workunit.client.0.smithi073.stderr: -322> 2024-09-12T00:52:30.354+0000 7fd2e1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:52:30.699 INFO:tasks.workunit.client.0.smithi073.stderr: -321> 2024-09-12T00:52:30.354+0000 7fd2e1ffb640 10 monclient: dump: 2024-09-12T00:52:30.699 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:52:30.699 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:52:30.699 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:52:30.699 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:52:30.699 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:30.699 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:52:30.699 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:52:30.699 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:52:30.699 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:52:30.699 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:52:30.699 INFO:tasks.workunit.client.0.smithi073.stderr: -320> 2024-09-12T00:52:30.354+0000 7fd2e1ffb640 10 monclient: _finish_auth 0 2024-09-12T00:52:30.699 INFO:tasks.workunit.client.0.smithi073.stderr: -319> 2024-09-12T00:52:30.354+0000 7fd2e1ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:52:30.699 INFO:tasks.workunit.client.0.smithi073.stderr: -318> 2024-09-12T00:52:30.354+0000 7fd2e1ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:52:30.700 INFO:tasks.workunit.client.0.smithi073.stderr: -317> 2024-09-12T00:52:30.354+0000 7fd2e1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:30.700 INFO:tasks.workunit.client.0.smithi073.stderr: -316> 2024-09-12T00:52:30.354+0000 7fd2e1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:52:30.700 INFO:tasks.workunit.client.0.smithi073.stderr: -315> 2024-09-12T00:52:30.354+0000 7fd2e1ffb640 10 monclient: dump: 2024-09-12T00:52:30.700 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:52:30.700 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:52:30.700 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:52:30.700 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:52:30.700 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:30.700 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:52:30.700 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:52:30.700 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:52:30.700 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:52:30.700 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:52:30.701 INFO:tasks.workunit.client.0.smithi073.stderr: -314> 2024-09-12T00:52:30.354+0000 7fd400740800 5 monclient: authenticate success, global_id 7752 2024-09-12T00:52:30.701 INFO:tasks.workunit.client.0.smithi073.stderr: -313> 2024-09-12T00:52:30.354+0000 7fd3fd4c2640 4 set_mon_vals no callback set 2024-09-12T00:52:30.701 INFO:tasks.workunit.client.0.smithi073.stderr: -312> 2024-09-12T00:52:30.354+0000 7fd400740800 10 monclient: _renew_subs 2024-09-12T00:52:30.701 INFO:tasks.workunit.client.0.smithi073.stderr: -311> 2024-09-12T00:52:30.354+0000 7fd400740800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:52:30.701 INFO:tasks.workunit.client.0.smithi073.stderr: -310> 2024-09-12T00:52:30.354+0000 7fd400740800 10 monclient: _renew_subs 2024-09-12T00:52:30.701 INFO:tasks.workunit.client.0.smithi073.stderr: -309> 2024-09-12T00:52:30.354+0000 7fd400740800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:52:30.701 INFO:tasks.workunit.client.0.smithi073.stderr: -308> 2024-09-12T00:52:30.356+0000 7fd2e1ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:52:30.701 INFO:tasks.workunit.client.0.smithi073.stderr: -307> 2024-09-12T00:52:30.356+0000 7fd2e1ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:52:30.701 INFO:tasks.workunit.client.0.smithi073.stderr: -306> 2024-09-12T00:52:30.356+0000 7fd2e1ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:52:30.701 INFO:tasks.workunit.client.0.smithi073.stderr: -305> 2024-09-12T00:52:30.356+0000 7fd3fc4c0640 10 monclient: get_auth_request con 0x7fd2d4076380 auth_method 0 2024-09-12T00:52:30.701 INFO:tasks.workunit.client.0.smithi073.stderr: -304> 2024-09-12T00:52:30.356+0000 7fd400740800 10 monclient: get_monmap_and_config 2024-09-12T00:52:30.701 INFO:tasks.workunit.client.0.smithi073.stderr: -303> 2024-09-12T00:52:30.356+0000 7fd400740800 10 monclient: build_initial_monmap 2024-09-12T00:52:30.701 INFO:tasks.workunit.client.0.smithi073.stderr: -302> 2024-09-12T00:52:30.356+0000 7fd400740800 1 build_initial for_mkfs: 0 2024-09-12T00:52:30.702 INFO:tasks.workunit.client.0.smithi073.stderr: -301> 2024-09-12T00:52:30.356+0000 7fd400740800 10 monclient: monmap: 2024-09-12T00:52:30.702 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:52:30.702 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:52:30.702 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:52:30.702 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:52:30.702 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:52:30.702 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:52:30.702 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:52:30.702 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:52:30.702 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:52:30.702 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:52:30.702 INFO:tasks.workunit.client.0.smithi073.stderr: -300> 2024-09-12T00:52:30.356+0000 7fd400740800 5 AuthRegistry(0x5644b8b8db00) adding auth protocol: cephx 2024-09-12T00:52:30.702 INFO:tasks.workunit.client.0.smithi073.stderr: -299> 2024-09-12T00:52:30.356+0000 7fd400740800 5 AuthRegistry(0x5644b8b8db00) adding auth protocol: cephx 2024-09-12T00:52:30.703 INFO:tasks.workunit.client.0.smithi073.stderr: -298> 2024-09-12T00:52:30.356+0000 7fd400740800 5 AuthRegistry(0x5644b8b8db00) adding auth protocol: cephx 2024-09-12T00:52:30.703 INFO:tasks.workunit.client.0.smithi073.stderr: -297> 2024-09-12T00:52:30.356+0000 7fd400740800 5 AuthRegistry(0x5644b8b8db00) adding con mode: secure 2024-09-12T00:52:30.703 INFO:tasks.workunit.client.0.smithi073.stderr: -296> 2024-09-12T00:52:30.356+0000 7fd400740800 5 AuthRegistry(0x5644b8b8db00) adding con mode: crc 2024-09-12T00:52:30.703 INFO:tasks.workunit.client.0.smithi073.stderr: -295> 2024-09-12T00:52:30.357+0000 7fd400740800 5 AuthRegistry(0x5644b8b8db00) adding con mode: secure 2024-09-12T00:52:30.703 INFO:tasks.workunit.client.0.smithi073.stderr: -294> 2024-09-12T00:52:30.357+0000 7fd400740800 5 AuthRegistry(0x5644b8b8db00) adding con mode: crc 2024-09-12T00:52:30.703 INFO:tasks.workunit.client.0.smithi073.stderr: -293> 2024-09-12T00:52:30.357+0000 7fd400740800 5 AuthRegistry(0x5644b8b8db00) adding con mode: secure 2024-09-12T00:52:30.703 INFO:tasks.workunit.client.0.smithi073.stderr: -292> 2024-09-12T00:52:30.357+0000 7fd400740800 5 AuthRegistry(0x5644b8b8db00) adding con mode: crc 2024-09-12T00:52:30.703 INFO:tasks.workunit.client.0.smithi073.stderr: -291> 2024-09-12T00:52:30.357+0000 7fd400740800 5 AuthRegistry(0x5644b8b8db00) adding con mode: crc 2024-09-12T00:52:30.703 INFO:tasks.workunit.client.0.smithi073.stderr: -290> 2024-09-12T00:52:30.357+0000 7fd400740800 5 AuthRegistry(0x5644b8b8db00) adding con mode: secure 2024-09-12T00:52:30.703 INFO:tasks.workunit.client.0.smithi073.stderr: -289> 2024-09-12T00:52:30.357+0000 7fd400740800 5 AuthRegistry(0x5644b8b8db00) adding con mode: crc 2024-09-12T00:52:30.703 INFO:tasks.workunit.client.0.smithi073.stderr: -288> 2024-09-12T00:52:30.357+0000 7fd400740800 5 AuthRegistry(0x5644b8b8db00) adding con mode: secure 2024-09-12T00:52:30.703 INFO:tasks.workunit.client.0.smithi073.stderr: -287> 2024-09-12T00:52:30.357+0000 7fd400740800 5 AuthRegistry(0x5644b8b8db00) adding con mode: crc 2024-09-12T00:52:30.703 INFO:tasks.workunit.client.0.smithi073.stderr: -286> 2024-09-12T00:52:30.357+0000 7fd400740800 5 AuthRegistry(0x5644b8b8db00) adding con mode: secure 2024-09-12T00:52:30.703 INFO:tasks.workunit.client.0.smithi073.stderr: -285> 2024-09-12T00:52:30.357+0000 7fd400740800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:30.704 INFO:tasks.workunit.client.0.smithi073.stderr: -284> 2024-09-12T00:52:30.357+0000 7fd400740800 10 monclient: init 2024-09-12T00:52:30.704 INFO:tasks.workunit.client.0.smithi073.stderr: -283> 2024-09-12T00:52:30.357+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2520) adding auth protocol: cephx 2024-09-12T00:52:30.704 INFO:tasks.workunit.client.0.smithi073.stderr: -282> 2024-09-12T00:52:30.357+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2520) adding auth protocol: cephx 2024-09-12T00:52:30.704 INFO:tasks.workunit.client.0.smithi073.stderr: -281> 2024-09-12T00:52:30.357+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2520) adding auth protocol: cephx 2024-09-12T00:52:30.704 INFO:tasks.workunit.client.0.smithi073.stderr: -280> 2024-09-12T00:52:30.357+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2520) adding con mode: secure 2024-09-12T00:52:30.704 INFO:tasks.workunit.client.0.smithi073.stderr: -279> 2024-09-12T00:52:30.357+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2520) adding con mode: crc 2024-09-12T00:52:30.704 INFO:tasks.workunit.client.0.smithi073.stderr: -278> 2024-09-12T00:52:30.357+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2520) adding con mode: secure 2024-09-12T00:52:30.704 INFO:tasks.workunit.client.0.smithi073.stderr: -277> 2024-09-12T00:52:30.357+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2520) adding con mode: crc 2024-09-12T00:52:30.704 INFO:tasks.workunit.client.0.smithi073.stderr: -276> 2024-09-12T00:52:30.357+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2520) adding con mode: secure 2024-09-12T00:52:30.704 INFO:tasks.workunit.client.0.smithi073.stderr: -275> 2024-09-12T00:52:30.357+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2520) adding con mode: crc 2024-09-12T00:52:30.704 INFO:tasks.workunit.client.0.smithi073.stderr: -274> 2024-09-12T00:52:30.357+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2520) adding con mode: crc 2024-09-12T00:52:30.704 INFO:tasks.workunit.client.0.smithi073.stderr: -273> 2024-09-12T00:52:30.357+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2520) adding con mode: secure 2024-09-12T00:52:30.704 INFO:tasks.workunit.client.0.smithi073.stderr: -272> 2024-09-12T00:52:30.357+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2520) adding con mode: crc 2024-09-12T00:52:30.705 INFO:tasks.workunit.client.0.smithi073.stderr: -271> 2024-09-12T00:52:30.357+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2520) adding con mode: secure 2024-09-12T00:52:30.705 INFO:tasks.workunit.client.0.smithi073.stderr: -270> 2024-09-12T00:52:30.357+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2520) adding con mode: crc 2024-09-12T00:52:30.705 INFO:tasks.workunit.client.0.smithi073.stderr: -269> 2024-09-12T00:52:30.357+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2520) adding con mode: secure 2024-09-12T00:52:30.705 INFO:tasks.workunit.client.0.smithi073.stderr: -268> 2024-09-12T00:52:30.357+0000 7fd400740800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:30.705 INFO:tasks.workunit.client.0.smithi073.stderr: -267> 2024-09-12T00:52:30.357+0000 7fd400740800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:30.705 INFO:tasks.workunit.client.0.smithi073.stderr: -266> 2024-09-12T00:52:30.357+0000 7fd400740800 5 asok(0x5644b88d1630) register_command rotate-key cmddesc rotate-key hook 0x7fffff7c2668 EEXIST 2024-09-12T00:52:30.705 INFO:tasks.workunit.client.0.smithi073.stderr: -265> 2024-09-12T00:52:30.357+0000 7fd400740800 10 monclient: _reopen_session rank -1 2024-09-12T00:52:30.705 INFO:tasks.workunit.client.0.smithi073.stderr: -264> 2024-09-12T00:52:30.357+0000 7fd400740800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:52:30.705 INFO:tasks.workunit.client.0.smithi073.stderr: -263> 2024-09-12T00:52:30.357+0000 7fd400740800 10 monclient(hunting): picked mon.noname-c con 0x5644b8bc2100 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:52:30.705 INFO:tasks.workunit.client.0.smithi073.stderr: -262> 2024-09-12T00:52:30.357+0000 7fd400740800 10 monclient(hunting): picked mon.noname-b con 0x5644b8bb2a50 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:52:30.705 INFO:tasks.workunit.client.0.smithi073.stderr: -261> 2024-09-12T00:52:30.357+0000 7fd400740800 10 monclient(hunting): picked mon.noname-a con 0x5644b8bbd530 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:52:30.705 INFO:tasks.workunit.client.0.smithi073.stderr: -260> 2024-09-12T00:52:30.357+0000 7fd400740800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:30.705 INFO:tasks.workunit.client.0.smithi073.stderr: -259> 2024-09-12T00:52:30.357+0000 7fd400740800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:30.706 INFO:tasks.workunit.client.0.smithi073.stderr: -258> 2024-09-12T00:52:30.357+0000 7fd400740800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:30.706 INFO:tasks.workunit.client.0.smithi073.stderr: -257> 2024-09-12T00:52:30.357+0000 7fd400740800 10 monclient(hunting): _renew_subs 2024-09-12T00:52:30.706 INFO:tasks.workunit.client.0.smithi073.stderr: -256> 2024-09-12T00:52:30.357+0000 7fd400740800 10 monclient(hunting): authenticate will time out at 2211.028988s 2024-09-12T00:52:30.706 INFO:tasks.workunit.client.0.smithi073.stderr: -255> 2024-09-12T00:52:30.358+0000 7fd3fccc1640 10 monclient(hunting): get_auth_request con 0x5644b8bbd530 auth_method 0 2024-09-12T00:52:30.706 INFO:tasks.workunit.client.0.smithi073.stderr: -254> 2024-09-12T00:52:30.358+0000 7fd3fccc1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:30.706 INFO:tasks.workunit.client.0.smithi073.stderr: -253> 2024-09-12T00:52:30.358+0000 7fd3fccc1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:30.706 INFO:tasks.workunit.client.0.smithi073.stderr: -252> 2024-09-12T00:52:30.358+0000 7fd3fccc1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:30.706 INFO:tasks.workunit.client.0.smithi073.stderr: -251> 2024-09-12T00:52:30.358+0000 7fd3fc4c0640 10 monclient(hunting): get_auth_request con 0x5644b8bc2100 auth_method 0 2024-09-12T00:52:30.706 INFO:tasks.workunit.client.0.smithi073.stderr: -250> 2024-09-12T00:52:30.358+0000 7fd3fc4c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:30.706 INFO:tasks.workunit.client.0.smithi073.stderr: -249> 2024-09-12T00:52:30.358+0000 7fd3fc4c0640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:30.706 INFO:tasks.workunit.client.0.smithi073.stderr: -248> 2024-09-12T00:52:30.358+0000 7fd3fc4c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:30.706 INFO:tasks.workunit.client.0.smithi073.stderr: -247> 2024-09-12T00:52:30.358+0000 7fd3fccc1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:30.706 INFO:tasks.workunit.client.0.smithi073.stderr: -246> 2024-09-12T00:52:30.358+0000 7fd3fccc1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:30.706 INFO:tasks.workunit.client.0.smithi073.stderr: -245> 2024-09-12T00:52:30.358+0000 7fd3fccc1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:30.707 INFO:tasks.workunit.client.0.smithi073.stderr: -244> 2024-09-12T00:52:30.358+0000 7fd3fc4c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:30.707 INFO:tasks.workunit.client.0.smithi073.stderr: -243> 2024-09-12T00:52:30.358+0000 7fd3fc4c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:30.707 INFO:tasks.workunit.client.0.smithi073.stderr: -242> 2024-09-12T00:52:30.358+0000 7fd3fc4c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:30.707 INFO:tasks.workunit.client.0.smithi073.stderr: -241> 2024-09-12T00:52:30.358+0000 7fd3f3fff640 10 monclient(hunting): get_auth_request con 0x5644b8bb2a50 auth_method 0 2024-09-12T00:52:30.707 INFO:tasks.workunit.client.0.smithi073.stderr: -240> 2024-09-12T00:52:30.358+0000 7fd3f3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:30.707 INFO:tasks.workunit.client.0.smithi073.stderr: -239> 2024-09-12T00:52:30.358+0000 7fd3f3fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:30.707 INFO:tasks.workunit.client.0.smithi073.stderr: -238> 2024-09-12T00:52:30.358+0000 7fd3f3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:30.707 INFO:tasks.workunit.client.0.smithi073.stderr: -237> 2024-09-12T00:52:30.358+0000 7fd3fccc1640 10 monclient(hunting): handle_auth_done global_id 7755 payload 274 2024-09-12T00:52:30.707 INFO:tasks.workunit.client.0.smithi073.stderr: -236> 2024-09-12T00:52:30.358+0000 7fd3fccc1640 10 monclient: _finish_hunting 0 2024-09-12T00:52:30.707 INFO:tasks.workunit.client.0.smithi073.stderr: -235> 2024-09-12T00:52:30.358+0000 7fd3fccc1640 1 monclient: found mon.noname-a 2024-09-12T00:52:30.707 INFO:tasks.workunit.client.0.smithi073.stderr: -234> 2024-09-12T00:52:30.358+0000 7fd3fccc1640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:52:30.707 INFO:tasks.workunit.client.0.smithi073.stderr: -233> 2024-09-12T00:52:30.358+0000 7fd2d37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:30.707 INFO:tasks.workunit.client.0.smithi073.stderr: -232> 2024-09-12T00:52:30.358+0000 7fd2d37fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:52:30.708 INFO:tasks.workunit.client.0.smithi073.stderr: -231> 2024-09-12T00:52:30.358+0000 7fd2d37fe640 10 monclient: dump: 2024-09-12T00:52:30.708 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:52:30.708 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:52:30.708 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:52:30.708 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:52:30.708 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:30.708 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:52:30.708 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:52:30.708 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:52:30.708 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:52:30.708 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:52:30.708 INFO:tasks.workunit.client.0.smithi073.stderr: -230> 2024-09-12T00:52:30.358+0000 7fd2d37fe640 10 monclient: _finish_auth 0 2024-09-12T00:52:30.708 INFO:tasks.workunit.client.0.smithi073.stderr: -229> 2024-09-12T00:52:30.358+0000 7fd2d37fe640 10 monclient: _check_auth_tickets 2024-09-12T00:52:30.709 INFO:tasks.workunit.client.0.smithi073.stderr: -228> 2024-09-12T00:52:30.358+0000 7fd2d37fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:52:30.709 INFO:tasks.workunit.client.0.smithi073.stderr: -227> 2024-09-12T00:52:30.358+0000 7fd2d37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:30.709 INFO:tasks.workunit.client.0.smithi073.stderr: -226> 2024-09-12T00:52:30.358+0000 7fd2d37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:52:30.709 INFO:tasks.workunit.client.0.smithi073.stderr: -225> 2024-09-12T00:52:30.358+0000 7fd2d37fe640 10 monclient: dump: 2024-09-12T00:52:30.709 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:52:30.709 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:52:30.709 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:52:30.709 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:52:30.709 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:30.709 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:52:30.709 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:52:30.709 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:52:30.709 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:52:30.709 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:52:30.710 INFO:tasks.workunit.client.0.smithi073.stderr: -224> 2024-09-12T00:52:30.358+0000 7fd400740800 5 monclient: authenticate success, global_id 7755 2024-09-12T00:52:30.710 INFO:tasks.workunit.client.0.smithi073.stderr: -223> 2024-09-12T00:52:30.358+0000 7fd400740800 10 monclient: get_monmap_and_config success 2024-09-12T00:52:30.710 INFO:tasks.workunit.client.0.smithi073.stderr: -222> 2024-09-12T00:52:30.358+0000 7fd400740800 4 set_mon_vals no callback set 2024-09-12T00:52:30.710 INFO:tasks.workunit.client.0.smithi073.stderr: -221> 2024-09-12T00:52:30.359+0000 7fd400740800 10 monclient: shutdown 2024-09-12T00:52:30.710 INFO:tasks.workunit.client.0.smithi073.stderr: -220> 2024-09-12T00:52:30.359+0000 7fd400740800 10 monclient: build_initial_monmap 2024-09-12T00:52:30.710 INFO:tasks.workunit.client.0.smithi073.stderr: -219> 2024-09-12T00:52:30.359+0000 7fd400740800 1 build_initial for_mkfs: 0 2024-09-12T00:52:30.710 INFO:tasks.workunit.client.0.smithi073.stderr: -218> 2024-09-12T00:52:30.359+0000 7fd400740800 10 monclient: monmap: 2024-09-12T00:52:30.710 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:52:30.710 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:52:30.710 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:52:30.710 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:52:30.710 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:52:30.710 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:52:30.711 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:52:30.711 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:52:30.711 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:52:30.711 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:52:30.711 INFO:tasks.workunit.client.0.smithi073.stderr: -217> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b91660) adding auth protocol: cephx 2024-09-12T00:52:30.711 INFO:tasks.workunit.client.0.smithi073.stderr: -216> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b91660) adding auth protocol: cephx 2024-09-12T00:52:30.711 INFO:tasks.workunit.client.0.smithi073.stderr: -215> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b91660) adding auth protocol: cephx 2024-09-12T00:52:30.711 INFO:tasks.workunit.client.0.smithi073.stderr: -214> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b91660) adding con mode: secure 2024-09-12T00:52:30.711 INFO:tasks.workunit.client.0.smithi073.stderr: -213> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b91660) adding con mode: crc 2024-09-12T00:52:30.711 INFO:tasks.workunit.client.0.smithi073.stderr: -212> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b91660) adding con mode: secure 2024-09-12T00:52:30.711 INFO:tasks.workunit.client.0.smithi073.stderr: -211> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b91660) adding con mode: crc 2024-09-12T00:52:30.711 INFO:tasks.workunit.client.0.smithi073.stderr: -210> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b91660) adding con mode: secure 2024-09-12T00:52:30.711 INFO:tasks.workunit.client.0.smithi073.stderr: -209> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b91660) adding con mode: crc 2024-09-12T00:52:30.711 INFO:tasks.workunit.client.0.smithi073.stderr: -208> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b91660) adding con mode: crc 2024-09-12T00:52:30.712 INFO:tasks.workunit.client.0.smithi073.stderr: -207> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b91660) adding con mode: secure 2024-09-12T00:52:30.712 INFO:tasks.workunit.client.0.smithi073.stderr: -206> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b91660) adding con mode: crc 2024-09-12T00:52:30.712 INFO:tasks.workunit.client.0.smithi073.stderr: -205> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b91660) adding con mode: secure 2024-09-12T00:52:30.712 INFO:tasks.workunit.client.0.smithi073.stderr: -204> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b91660) adding con mode: crc 2024-09-12T00:52:30.712 INFO:tasks.workunit.client.0.smithi073.stderr: -203> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b91660) adding con mode: secure 2024-09-12T00:52:30.712 INFO:tasks.workunit.client.0.smithi073.stderr: -202> 2024-09-12T00:52:30.359+0000 7fd400740800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:30.712 INFO:tasks.workunit.client.0.smithi073.stderr: -201> 2024-09-12T00:52:30.359+0000 7fd400740800 1 librados: starting msgr at 2024-09-12T00:52:30.712 INFO:tasks.workunit.client.0.smithi073.stderr: -200> 2024-09-12T00:52:30.359+0000 7fd400740800 1 librados: starting objecter 2024-09-12T00:52:30.712 INFO:tasks.workunit.client.0.smithi073.stderr: -199> 2024-09-12T00:52:30.359+0000 7fd400740800 5 asok(0x5644b88d1630) register_command objecter_requests cmddesc objecter_requests hook 0x5644b8bbc820 EEXIST 2024-09-12T00:52:30.712 INFO:tasks.workunit.client.0.smithi073.stderr: -198> 2024-09-12T00:52:30.359+0000 7fd400740800 1 librados: setting wanted keys 2024-09-12T00:52:30.712 INFO:tasks.workunit.client.0.smithi073.stderr: -197> 2024-09-12T00:52:30.359+0000 7fd400740800 1 librados: calling monclient init 2024-09-12T00:52:30.712 INFO:tasks.workunit.client.0.smithi073.stderr: -196> 2024-09-12T00:52:30.359+0000 7fd400740800 10 monclient: init 2024-09-12T00:52:30.712 INFO:tasks.workunit.client.0.smithi073.stderr: -195> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b859f0) adding auth protocol: cephx 2024-09-12T00:52:30.713 INFO:tasks.workunit.client.0.smithi073.stderr: -194> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b859f0) adding auth protocol: cephx 2024-09-12T00:52:30.713 INFO:tasks.workunit.client.0.smithi073.stderr: -193> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b859f0) adding auth protocol: cephx 2024-09-12T00:52:30.713 INFO:tasks.workunit.client.0.smithi073.stderr: -192> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b859f0) adding con mode: secure 2024-09-12T00:52:30.713 INFO:tasks.workunit.client.0.smithi073.stderr: -191> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b859f0) adding con mode: crc 2024-09-12T00:52:30.713 INFO:tasks.workunit.client.0.smithi073.stderr: -190> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b859f0) adding con mode: secure 2024-09-12T00:52:30.713 INFO:tasks.workunit.client.0.smithi073.stderr: -189> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b859f0) adding con mode: crc 2024-09-12T00:52:30.713 INFO:tasks.workunit.client.0.smithi073.stderr: -188> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b859f0) adding con mode: secure 2024-09-12T00:52:30.713 INFO:tasks.workunit.client.0.smithi073.stderr: -187> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b859f0) adding con mode: crc 2024-09-12T00:52:30.713 INFO:tasks.workunit.client.0.smithi073.stderr: -186> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b859f0) adding con mode: crc 2024-09-12T00:52:30.713 INFO:tasks.workunit.client.0.smithi073.stderr: -185> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b859f0) adding con mode: secure 2024-09-12T00:52:30.713 INFO:tasks.workunit.client.0.smithi073.stderr: -184> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b859f0) adding con mode: crc 2024-09-12T00:52:30.713 INFO:tasks.workunit.client.0.smithi073.stderr: -183> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b859f0) adding con mode: secure 2024-09-12T00:52:30.713 INFO:tasks.workunit.client.0.smithi073.stderr: -182> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b859f0) adding con mode: crc 2024-09-12T00:52:30.714 INFO:tasks.workunit.client.0.smithi073.stderr: -181> 2024-09-12T00:52:30.359+0000 7fd400740800 5 AuthRegistry(0x5644b8b859f0) adding con mode: secure 2024-09-12T00:52:30.714 INFO:tasks.workunit.client.0.smithi073.stderr: -180> 2024-09-12T00:52:30.359+0000 7fd400740800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:30.714 INFO:tasks.workunit.client.0.smithi073.stderr: -179> 2024-09-12T00:52:30.360+0000 7fd400740800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:30.714 INFO:tasks.workunit.client.0.smithi073.stderr: -178> 2024-09-12T00:52:30.360+0000 7fd400740800 5 asok(0x5644b88d1630) register_command rotate-key cmddesc rotate-key hook 0x5644b8b85b38 EEXIST 2024-09-12T00:52:30.714 INFO:tasks.workunit.client.0.smithi073.stderr: -177> 2024-09-12T00:52:30.360+0000 7fd400740800 10 monclient: _reopen_session rank -1 2024-09-12T00:52:30.714 INFO:tasks.workunit.client.0.smithi073.stderr: -176> 2024-09-12T00:52:30.360+0000 7fd400740800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:52:30.714 INFO:tasks.workunit.client.0.smithi073.stderr: -175> 2024-09-12T00:52:30.360+0000 7fd400740800 10 monclient(hunting): picked mon.noname-c con 0x5644b8bb2a50 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:52:30.714 INFO:tasks.workunit.client.0.smithi073.stderr: -174> 2024-09-12T00:52:30.360+0000 7fd400740800 10 monclient(hunting): picked mon.noname-b con 0x5644b8bbd530 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:52:30.714 INFO:tasks.workunit.client.0.smithi073.stderr: -173> 2024-09-12T00:52:30.360+0000 7fd400740800 10 monclient(hunting): picked mon.noname-a con 0x5644b8bc2100 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:52:30.714 INFO:tasks.workunit.client.0.smithi073.stderr: -172> 2024-09-12T00:52:30.360+0000 7fd400740800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:30.714 INFO:tasks.workunit.client.0.smithi073.stderr: -171> 2024-09-12T00:52:30.360+0000 7fd400740800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:30.714 INFO:tasks.workunit.client.0.smithi073.stderr: -170> 2024-09-12T00:52:30.360+0000 7fd400740800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:30.714 INFO:tasks.workunit.client.0.smithi073.stderr: -169> 2024-09-12T00:52:30.360+0000 7fd400740800 10 monclient(hunting): _renew_subs 2024-09-12T00:52:30.714 INFO:tasks.workunit.client.0.smithi073.stderr: -168> 2024-09-12T00:52:30.360+0000 7fd400740800 10 monclient(hunting): authenticate will time out at 2211.031256s 2024-09-12T00:52:30.715 INFO:tasks.workunit.client.0.smithi073.stderr: -167> 2024-09-12T00:52:30.360+0000 7fd3fccc1640 10 monclient(hunting): get_auth_request con 0x5644b8bc2100 auth_method 0 2024-09-12T00:52:30.715 INFO:tasks.workunit.client.0.smithi073.stderr: -166> 2024-09-12T00:52:30.360+0000 7fd3fccc1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:30.715 INFO:tasks.workunit.client.0.smithi073.stderr: -165> 2024-09-12T00:52:30.360+0000 7fd3fccc1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:30.715 INFO:tasks.workunit.client.0.smithi073.stderr: -164> 2024-09-12T00:52:30.360+0000 7fd3fccc1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:30.715 INFO:tasks.workunit.client.0.smithi073.stderr: -163> 2024-09-12T00:52:30.360+0000 7fd3fc4c0640 10 monclient(hunting): get_auth_request con 0x5644b8bb2a50 auth_method 0 2024-09-12T00:52:30.715 INFO:tasks.workunit.client.0.smithi073.stderr: -162> 2024-09-12T00:52:30.360+0000 7fd3fc4c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:30.715 INFO:tasks.workunit.client.0.smithi073.stderr: -161> 2024-09-12T00:52:30.360+0000 7fd3fc4c0640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:30.715 INFO:tasks.workunit.client.0.smithi073.stderr: -160> 2024-09-12T00:52:30.360+0000 7fd3fc4c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:30.715 INFO:tasks.workunit.client.0.smithi073.stderr: -159> 2024-09-12T00:52:30.360+0000 7fd3f3fff640 10 monclient(hunting): get_auth_request con 0x5644b8bbd530 auth_method 0 2024-09-12T00:52:30.715 INFO:tasks.workunit.client.0.smithi073.stderr: -158> 2024-09-12T00:52:30.360+0000 7fd3f3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:30.715 INFO:tasks.workunit.client.0.smithi073.stderr: -157> 2024-09-12T00:52:30.360+0000 7fd3f3fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:30.715 INFO:tasks.workunit.client.0.smithi073.stderr: -156> 2024-09-12T00:52:30.360+0000 7fd3f3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:30.715 INFO:tasks.workunit.client.0.smithi073.stderr: -155> 2024-09-12T00:52:30.360+0000 7fd3fccc1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:30.716 INFO:tasks.workunit.client.0.smithi073.stderr: -154> 2024-09-12T00:52:30.360+0000 7fd3fccc1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:30.716 INFO:tasks.workunit.client.0.smithi073.stderr: -153> 2024-09-12T00:52:30.360+0000 7fd3fccc1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:30.716 INFO:tasks.workunit.client.0.smithi073.stderr: -152> 2024-09-12T00:52:30.360+0000 7fd3fc4c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:30.716 INFO:tasks.workunit.client.0.smithi073.stderr: -151> 2024-09-12T00:52:30.360+0000 7fd3fc4c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:30.716 INFO:tasks.workunit.client.0.smithi073.stderr: -150> 2024-09-12T00:52:30.360+0000 7fd3fc4c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:30.716 INFO:tasks.workunit.client.0.smithi073.stderr: -149> 2024-09-12T00:52:30.360+0000 7fd3f3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:30.716 INFO:tasks.workunit.client.0.smithi073.stderr: -148> 2024-09-12T00:52:30.360+0000 7fd3f3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:30.716 INFO:tasks.workunit.client.0.smithi073.stderr: -147> 2024-09-12T00:52:30.360+0000 7fd3f3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:30.716 INFO:tasks.workunit.client.0.smithi073.stderr: -146> 2024-09-12T00:52:30.360+0000 7fd3fccc1640 10 monclient(hunting): handle_auth_done global_id 7758 payload 824 2024-09-12T00:52:30.716 INFO:tasks.workunit.client.0.smithi073.stderr: -145> 2024-09-12T00:52:30.360+0000 7fd3fccc1640 10 monclient: _finish_hunting 0 2024-09-12T00:52:30.716 INFO:tasks.workunit.client.0.smithi073.stderr: -144> 2024-09-12T00:52:30.360+0000 7fd3fccc1640 1 monclient: found mon.noname-a 2024-09-12T00:52:30.716 INFO:tasks.workunit.client.0.smithi073.stderr: -143> 2024-09-12T00:52:30.360+0000 7fd3fccc1640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:52:30.716 INFO:tasks.workunit.client.0.smithi073.stderr: -142> 2024-09-12T00:52:30.360+0000 7fd2d1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:30.717 INFO:tasks.workunit.client.0.smithi073.stderr: -141> 2024-09-12T00:52:30.360+0000 7fd2d1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:52:30.717 INFO:tasks.workunit.client.0.smithi073.stderr: -140> 2024-09-12T00:52:30.360+0000 7fd2d1ffb640 10 monclient: dump: 2024-09-12T00:52:30.717 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:52:30.717 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:52:30.717 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:52:30.717 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:52:30.717 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:30.717 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:52:30.717 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:52:30.717 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:52:30.717 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:52:30.717 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:52:30.717 INFO:tasks.workunit.client.0.smithi073.stderr: -139> 2024-09-12T00:52:30.360+0000 7fd2d1ffb640 10 monclient: _finish_auth 0 2024-09-12T00:52:30.717 INFO:tasks.workunit.client.0.smithi073.stderr: -138> 2024-09-12T00:52:30.360+0000 7fd2d1ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:52:30.718 INFO:tasks.workunit.client.0.smithi073.stderr: -137> 2024-09-12T00:52:30.360+0000 7fd2d1ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:52:30.718 INFO:tasks.workunit.client.0.smithi073.stderr: -136> 2024-09-12T00:52:30.360+0000 7fd2d1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:30.718 INFO:tasks.workunit.client.0.smithi073.stderr: -135> 2024-09-12T00:52:30.360+0000 7fd2d1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:52:30.718 INFO:tasks.workunit.client.0.smithi073.stderr: -134> 2024-09-12T00:52:30.360+0000 7fd2d1ffb640 10 monclient: dump: 2024-09-12T00:52:30.718 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:52:30.718 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:52:30.718 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:52:30.718 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:52:30.718 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:30.718 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:52:30.718 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:52:30.718 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:52:30.718 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:52:30.719 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:52:30.719 INFO:tasks.workunit.client.0.smithi073.stderr: -133> 2024-09-12T00:52:30.360+0000 7fd400740800 5 monclient: authenticate success, global_id 7758 2024-09-12T00:52:30.719 INFO:tasks.workunit.client.0.smithi073.stderr: -132> 2024-09-12T00:52:30.360+0000 7fd400740800 10 monclient: _renew_subs 2024-09-12T00:52:30.719 INFO:tasks.workunit.client.0.smithi073.stderr: -131> 2024-09-12T00:52:30.360+0000 7fd2d37fe640 4 set_mon_vals no callback set 2024-09-12T00:52:30.719 INFO:tasks.workunit.client.0.smithi073.stderr: -130> 2024-09-12T00:52:30.360+0000 7fd400740800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:52:30.719 INFO:tasks.workunit.client.0.smithi073.stderr: -129> 2024-09-12T00:52:30.360+0000 7fd400740800 10 monclient: _renew_subs 2024-09-12T00:52:30.719 INFO:tasks.workunit.client.0.smithi073.stderr: -128> 2024-09-12T00:52:30.360+0000 7fd400740800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:52:30.719 INFO:tasks.workunit.client.0.smithi073.stderr: -127> 2024-09-12T00:52:30.360+0000 7fd400740800 1 librados: init done 2024-09-12T00:52:30.719 INFO:tasks.workunit.client.0.smithi073.stderr: -126> 2024-09-12T00:52:30.361+0000 7fd400740800 5 asok(0x5644b88d1630) register_command cr dump hook 0x5644b8bd0298 2024-09-12T00:52:30.719 INFO:tasks.workunit.client.0.smithi073.stderr: -125> 2024-09-12T00:52:30.362+0000 7fd400740800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.719 INFO:tasks.workunit.client.0.smithi073.stderr: -124> 2024-09-12T00:52:30.362+0000 7fd2d1ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:52:30.719 INFO:tasks.workunit.client.0.smithi073.stderr: -123> 2024-09-12T00:52:30.362+0000 7fd2d1ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:52:30.719 INFO:tasks.workunit.client.0.smithi073.stderr: -122> 2024-09-12T00:52:30.362+0000 7fd2d1ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:52:30.719 INFO:tasks.workunit.client.0.smithi073.stderr: -121> 2024-09-12T00:52:30.362+0000 7fd3fc4c0640 10 monclient: get_auth_request con 0x7fd2c4076470 auth_method 0 2024-09-12T00:52:30.720 INFO:tasks.workunit.client.0.smithi073.stderr: -120> 2024-09-12T00:52:30.363+0000 7fd3f3fff640 10 monclient: get_auth_request con 0x5644b8bdc7f0 auth_method 0 2024-09-12T00:52:30.720 INFO:tasks.workunit.client.0.smithi073.stderr: -119> 2024-09-12T00:52:30.363+0000 7fd400740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.720 INFO:tasks.workunit.client.0.smithi073.stderr: -118> 2024-09-12T00:52:30.363+0000 7fd400740800 20 realm 2024-09-12T00:52:30.720 INFO:tasks.workunit.client.0.smithi073.stderr: -117> 2024-09-12T00:52:30.363+0000 7fd400740800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.720 INFO:tasks.workunit.client.0.smithi073.stderr: -116> 2024-09-12T00:52:30.363+0000 7fd400740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.720 INFO:tasks.workunit.client.0.smithi073.stderr: -115> 2024-09-12T00:52:30.363+0000 7fd400740800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:30.720 INFO:tasks.workunit.client.0.smithi073.stderr: -114> 2024-09-12T00:52:30.364+0000 7fd400740800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.720 INFO:tasks.workunit.client.0.smithi073.stderr: -113> 2024-09-12T00:52:30.364+0000 7fd400740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.720 INFO:tasks.workunit.client.0.smithi073.stderr: -112> 2024-09-12T00:52:30.364+0000 7fd400740800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.720 INFO:tasks.workunit.client.0.smithi073.stderr: -111> 2024-09-12T00:52:30.364+0000 7fd3fc4c0640 10 monclient: get_auth_request con 0x5644b8be0a50 auth_method 0 2024-09-12T00:52:30.720 INFO:tasks.workunit.client.0.smithi073.stderr: -110> 2024-09-12T00:52:30.365+0000 7fd400740800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:30.720 INFO:tasks.workunit.client.0.smithi073.stderr: -109> 2024-09-12T00:52:30.365+0000 7fd400740800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.720 INFO:tasks.workunit.client.0.smithi073.stderr: -108> 2024-09-12T00:52:30.365+0000 7fd3f3fff640 10 monclient: get_auth_request con 0x5644b8be4320 auth_method 0 2024-09-12T00:52:30.721 INFO:tasks.workunit.client.0.smithi073.stderr: -107> 2024-09-12T00:52:30.365+0000 7fd400740800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:30.721 INFO:tasks.workunit.client.0.smithi073.stderr: -106> 2024-09-12T00:52:30.365+0000 7fd400740800 20 searching for the correct realm 2024-09-12T00:52:30.721 INFO:tasks.workunit.client.0.smithi073.stderr: -105> 2024-09-12T00:52:30.365+0000 7fd3fccc1640 10 monclient: get_auth_request con 0x5644b8be9040 auth_method 0 2024-09-12T00:52:30.721 INFO:tasks.workunit.client.0.smithi073.stderr: -104> 2024-09-12T00:52:30.366+0000 7fd3fc4c0640 10 monclient: get_auth_request con 0x7fd3f4042740 auth_method 0 2024-09-12T00:52:30.721 INFO:tasks.workunit.client.0.smithi073.stderr: -103> 2024-09-12T00:52:30.367+0000 7fd3f3fff640 10 monclient: get_auth_request con 0x7fd3ec07c070 auth_method 0 2024-09-12T00:52:30.721 INFO:tasks.workunit.client.0.smithi073.stderr: -102> 2024-09-12T00:52:30.367+0000 7fd3fccc1640 10 monclient: get_auth_request con 0x7fd3e4017040 auth_method 0 2024-09-12T00:52:30.721 INFO:tasks.workunit.client.0.smithi073.stderr: -101> 2024-09-12T00:52:30.367+0000 7fd3fccc1640 0 -- 172.21.15.73:0/3795595100 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fd3e4017040 msgr2=0x7fd3e4067870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:52:30.721 INFO:tasks.workunit.client.0.smithi073.stderr: -100> 2024-09-12T00:52:30.569+0000 7fd3fccc1640 10 monclient: get_auth_request con 0x7fd3e4017040 auth_method 0 2024-09-12T00:52:30.721 INFO:tasks.workunit.client.0.smithi073.stderr: -99> 2024-09-12T00:52:30.572+0000 7fd3fc4c0640 10 monclient: get_auth_request con 0x7fd3f405c6d0 auth_method 0 2024-09-12T00:52:30.721 INFO:tasks.workunit.client.0.smithi073.stderr: -98> 2024-09-12T00:52:30.573+0000 7fd3fccc1640 0 -- 172.21.15.73:0/3795595100 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fd3e4017040 msgr2=0x7fd3e4067870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:30.721 INFO:tasks.workunit.client.0.smithi073.stderr: -97> 2024-09-12T00:52:30.573+0000 7fd2d1ffb640 1 client.7758.objecter ms_handle_reset 0x7fd3e4017040 session 0x7fd3e4071d80 osd.4 2024-09-12T00:52:30.721 INFO:tasks.workunit.client.0.smithi073.stderr: -96> 2024-09-12T00:52:30.573+0000 7fd2d1ffb640 10 monclient: _renew_subs 2024-09-12T00:52:30.721 INFO:tasks.workunit.client.0.smithi073.stderr: -95> 2024-09-12T00:52:30.573+0000 7fd2d1ffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:52:30.721 INFO:tasks.workunit.client.0.smithi073.stderr: -94> 2024-09-12T00:52:30.573+0000 7fd3fccc1640 10 monclient: get_auth_request con 0x7fd2c4086310 auth_method 0 2024-09-12T00:52:30.722 INFO:tasks.workunit.client.0.smithi073.stderr: -93> 2024-09-12T00:52:30.576+0000 7fd400740800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:52:30.722 INFO:tasks.workunit.client.0.smithi073.stderr: -92> 2024-09-12T00:52:30.576+0000 7fd400740800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:30.722 INFO:tasks.workunit.client.0.smithi073.stderr: -91> 2024-09-12T00:52:30.576+0000 7fd400740800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:52:30.722 INFO:tasks.workunit.client.0.smithi073.stderr: -90> 2024-09-12T00:52:30.576+0000 7fd400740800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:30.722 INFO:tasks.workunit.client.0.smithi073.stderr: -89> 2024-09-12T00:52:30.576+0000 7fd400740800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:30.722 INFO:tasks.workunit.client.0.smithi073.stderr: -88> 2024-09-12T00:52:30.576+0000 7fd400740800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:30.722 INFO:tasks.workunit.client.0.smithi073.stderr: -87> 2024-09-12T00:52:30.576+0000 7fd400740800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.722 INFO:tasks.workunit.client.0.smithi073.stderr: -86> 2024-09-12T00:52:30.576+0000 7fd400740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.722 INFO:tasks.workunit.client.0.smithi073.stderr: -85> 2024-09-12T00:52:30.576+0000 7fd400740800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.722 INFO:tasks.workunit.client.0.smithi073.stderr: -84> 2024-09-12T00:52:30.576+0000 7fd400740800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:30.722 INFO:tasks.workunit.client.0.smithi073.stderr: -83> 2024-09-12T00:52:30.576+0000 7fd400740800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.722 INFO:tasks.workunit.client.0.smithi073.stderr: -82> 2024-09-12T00:52:30.577+0000 7fd400740800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:30.722 INFO:tasks.workunit.client.0.smithi073.stderr: -81> 2024-09-12T00:52:30.577+0000 7fd400740800 20 zone default found 2024-09-12T00:52:30.723 INFO:tasks.workunit.client.0.smithi073.stderr: -80> 2024-09-12T00:52:30.577+0000 7fd400740800 4 Realm: () 2024-09-12T00:52:30.723 INFO:tasks.workunit.client.0.smithi073.stderr: -79> 2024-09-12T00:52:30.577+0000 7fd400740800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:52:30.723 INFO:tasks.workunit.client.0.smithi073.stderr: -78> 2024-09-12T00:52:30.577+0000 7fd400740800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:52:30.723 INFO:tasks.workunit.client.0.smithi073.stderr: -77> 2024-09-12T00:52:30.577+0000 7fd400740800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:30.723 INFO:tasks.workunit.client.0.smithi073.stderr: -76> 2024-09-12T00:52:30.577+0000 7fd400740800 20 zonegroup default 2024-09-12T00:52:30.723 INFO:tasks.workunit.client.0.smithi073.stderr: -75> 2024-09-12T00:52:30.577+0000 7fd400740800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.723 INFO:tasks.workunit.client.0.smithi073.stderr: -74> 2024-09-12T00:52:30.577+0000 7fd400740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.723 INFO:tasks.workunit.client.0.smithi073.stderr: -73> 2024-09-12T00:52:30.577+0000 7fd400740800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.723 INFO:tasks.workunit.client.0.smithi073.stderr: -72> 2024-09-12T00:52:30.577+0000 7fd400740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.723 INFO:tasks.workunit.client.0.smithi073.stderr: -71> 2024-09-12T00:52:30.577+0000 7fd400740800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.723 INFO:tasks.workunit.client.0.smithi073.stderr: -70> 2024-09-12T00:52:30.577+0000 7fd400740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.723 INFO:tasks.workunit.client.0.smithi073.stderr: -69> 2024-09-12T00:52:30.577+0000 7fd400740800 20 started sync module instance, tier type = 2024-09-12T00:52:30.723 INFO:tasks.workunit.client.0.smithi073.stderr: -68> 2024-09-12T00:52:30.577+0000 7fd400740800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:52:30.723 INFO:tasks.workunit.client.0.smithi073.stderr: -67> 2024-09-12T00:52:30.586+0000 7fd400740800 20 add_watcher() i=0 2024-09-12T00:52:30.724 INFO:tasks.workunit.client.0.smithi073.stderr: -66> 2024-09-12T00:52:30.586+0000 7fd400740800 20 add_watcher() i=1 2024-09-12T00:52:30.724 INFO:tasks.workunit.client.0.smithi073.stderr: -65> 2024-09-12T00:52:30.586+0000 7fd400740800 20 add_watcher() i=2 2024-09-12T00:52:30.724 INFO:tasks.workunit.client.0.smithi073.stderr: -64> 2024-09-12T00:52:30.586+0000 7fd400740800 20 add_watcher() i=3 2024-09-12T00:52:30.724 INFO:tasks.workunit.client.0.smithi073.stderr: -63> 2024-09-12T00:52:30.586+0000 7fd400740800 20 add_watcher() i=4 2024-09-12T00:52:30.724 INFO:tasks.workunit.client.0.smithi073.stderr: -62> 2024-09-12T00:52:30.586+0000 7fd400740800 20 add_watcher() i=5 2024-09-12T00:52:30.724 INFO:tasks.workunit.client.0.smithi073.stderr: -61> 2024-09-12T00:52:30.586+0000 7fd400740800 20 add_watcher() i=6 2024-09-12T00:52:30.724 INFO:tasks.workunit.client.0.smithi073.stderr: -60> 2024-09-12T00:52:30.587+0000 7fd400740800 20 add_watcher() i=7 2024-09-12T00:52:30.724 INFO:tasks.workunit.client.0.smithi073.stderr: -59> 2024-09-12T00:52:30.587+0000 7fd400740800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:30.724 INFO:tasks.workunit.client.0.smithi073.stderr: -58> 2024-09-12T00:52:30.589+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2a00) adding auth protocol: cephx 2024-09-12T00:52:30.724 INFO:tasks.workunit.client.0.smithi073.stderr: -57> 2024-09-12T00:52:30.589+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2a00) adding auth protocol: cephx 2024-09-12T00:52:30.724 INFO:tasks.workunit.client.0.smithi073.stderr: -56> 2024-09-12T00:52:30.589+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2a00) adding auth protocol: cephx 2024-09-12T00:52:30.724 INFO:tasks.workunit.client.0.smithi073.stderr: -55> 2024-09-12T00:52:30.589+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2a00) adding con mode: secure 2024-09-12T00:52:30.724 INFO:tasks.workunit.client.0.smithi073.stderr: -54> 2024-09-12T00:52:30.589+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2a00) adding con mode: crc 2024-09-12T00:52:30.725 INFO:tasks.workunit.client.0.smithi073.stderr: -53> 2024-09-12T00:52:30.589+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2a00) adding con mode: secure 2024-09-12T00:52:30.725 INFO:tasks.workunit.client.0.smithi073.stderr: -52> 2024-09-12T00:52:30.589+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2a00) adding con mode: crc 2024-09-12T00:52:30.725 INFO:tasks.workunit.client.0.smithi073.stderr: -51> 2024-09-12T00:52:30.589+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2a00) adding con mode: secure 2024-09-12T00:52:30.725 INFO:tasks.workunit.client.0.smithi073.stderr: -50> 2024-09-12T00:52:30.589+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2a00) adding con mode: crc 2024-09-12T00:52:30.725 INFO:tasks.workunit.client.0.smithi073.stderr: -49> 2024-09-12T00:52:30.589+0000 7fd2b2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:30.725 INFO:tasks.workunit.client.0.smithi073.stderr: -48> 2024-09-12T00:52:30.589+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2a00) adding con mode: crc 2024-09-12T00:52:30.725 INFO:tasks.workunit.client.0.smithi073.stderr: -47> 2024-09-12T00:52:30.589+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2a00) adding con mode: secure 2024-09-12T00:52:30.725 INFO:tasks.workunit.client.0.smithi073.stderr: -46> 2024-09-12T00:52:30.589+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2a00) adding con mode: crc 2024-09-12T00:52:30.725 INFO:tasks.workunit.client.0.smithi073.stderr: -45> 2024-09-12T00:52:30.589+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2a00) adding con mode: secure 2024-09-12T00:52:30.725 INFO:tasks.workunit.client.0.smithi073.stderr: -44> 2024-09-12T00:52:30.589+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2a00) adding con mode: crc 2024-09-12T00:52:30.725 INFO:tasks.workunit.client.0.smithi073.stderr: -43> 2024-09-12T00:52:30.589+0000 7fd400740800 5 AuthRegistry(0x7fffff7c2a00) adding con mode: secure 2024-09-12T00:52:30.725 INFO:tasks.workunit.client.0.smithi073.stderr: -42> 2024-09-12T00:52:30.589+0000 7fd400740800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:30.725 INFO:tasks.workunit.client.0.smithi073.stderr: -41> 2024-09-12T00:52:30.589+0000 7fd400740800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:30.725 INFO:tasks.workunit.client.0.smithi073.stderr: -40> 2024-09-12T00:52:30.589+0000 7fd400740800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:30.726 INFO:tasks.workunit.client.0.smithi073.stderr: -39> 2024-09-12T00:52:30.589+0000 7fd400740800 5 asok(0x5644b88d1630) register_command cache list hook 0x5644b8bc2910 2024-09-12T00:52:30.726 INFO:tasks.workunit.client.0.smithi073.stderr: -38> 2024-09-12T00:52:30.589+0000 7fd400740800 5 asok(0x5644b88d1630) register_command cache inspect hook 0x5644b8bc2910 2024-09-12T00:52:30.726 INFO:tasks.workunit.client.0.smithi073.stderr: -37> 2024-09-12T00:52:30.589+0000 7fd400740800 5 asok(0x5644b88d1630) register_command cache erase hook 0x5644b8bc2910 2024-09-12T00:52:30.726 INFO:tasks.workunit.client.0.smithi073.stderr: -36> 2024-09-12T00:52:30.589+0000 7fd400740800 5 asok(0x5644b88d1630) register_command cache zap hook 0x5644b8bc2910 2024-09-12T00:52:30.726 INFO:tasks.workunit.client.0.smithi073.stderr: -35> 2024-09-12T00:52:30.589+0000 7fd400740800 5 note: GC not initialized 2024-09-12T00:52:30.726 INFO:tasks.workunit.client.0.smithi073.stderr: -34> 2024-09-12T00:52:30.589+0000 7fd2b1fdb640 20 reqs_thread_entry: start 2024-09-12T00:52:30.726 INFO:tasks.workunit.client.0.smithi073.stderr: -33> 2024-09-12T00:52:30.589+0000 7fd400740800 5 asok(0x5644b88d1630) register_command sync trace show hook 0x7fd3f4004720 2024-09-12T00:52:30.726 INFO:tasks.workunit.client.0.smithi073.stderr: -32> 2024-09-12T00:52:30.589+0000 7fd400740800 5 asok(0x5644b88d1630) register_command sync trace history hook 0x7fd3f4004720 2024-09-12T00:52:30.726 INFO:tasks.workunit.client.0.smithi073.stderr: -31> 2024-09-12T00:52:30.589+0000 7fd400740800 5 asok(0x5644b88d1630) register_command sync trace active hook 0x7fd3f4004720 2024-09-12T00:52:30.726 INFO:tasks.workunit.client.0.smithi073.stderr: -30> 2024-09-12T00:52:30.589+0000 7fd400740800 5 asok(0x5644b88d1630) register_command sync trace active_short hook 0x7fd3f4004720 2024-09-12T00:52:30.726 INFO:tasks.workunit.client.0.smithi073.stderr: -29> 2024-09-12T00:52:30.589+0000 7fd400740800 20 init_complete bucket index max shards: 1 2024-09-12T00:52:30.726 INFO:tasks.workunit.client.0.smithi073.stderr: -28> 2024-09-12T00:52:30.589+0000 7fd400740800 20 Filter name: none 2024-09-12T00:52:30.726 INFO:tasks.workunit.client.0.smithi073.stderr: -27> 2024-09-12T00:52:30.589+0000 7fd2237fe640 20 reqs_thread_entry: start 2024-09-12T00:52:30.727 INFO:tasks.workunit.client.0.smithi073.stderr: -26> 2024-09-12T00:52:30.589+0000 7fd400740800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:52:30.727 INFO:tasks.workunit.client.0.smithi073.stderr: -25> 2024-09-12T00:52:30.589+0000 7fd400740800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.727 INFO:tasks.workunit.client.0.smithi073.stderr: -24> 2024-09-12T00:52:30.590+0000 7fd400740800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:52:30.727 INFO:tasks.workunit.client.0.smithi073.stderr: -23> 2024-09-12T00:52:30.590+0000 7fd400740800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:52:30.727 INFO:tasks.workunit.client.0.smithi073.stderr: -22> 2024-09-12T00:52:30.590+0000 7fd400740800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:52:30.727 INFO:tasks.workunit.client.0.smithi073.stderr: -21> 2024-09-12T00:52:30.590+0000 7fd400740800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36 : miss 2024-09-12T00:52:30.727 INFO:tasks.workunit.client.0.smithi073.stderr: -20> 2024-09-12T00:52:30.590+0000 7fd400740800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.727 INFO:tasks.workunit.client.0.smithi073.stderr: -19> 2024-09-12T00:52:30.590+0000 7fd400740800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:52:30.727 INFO:tasks.workunit.client.0.smithi073.stderr: -18> 2024-09-12T00:52:30.590+0000 7fd400740800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36 info.flags=0x17 2024-09-12T00:52:30.727 INFO:tasks.workunit.client.0.smithi073.stderr: -17> 2024-09-12T00:52:30.590+0000 7fd400740800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36 to cache LRU end 2024-09-12T00:52:30.727 INFO:tasks.workunit.client.0.smithi073.stderr: -16> 2024-09-12T00:52:30.590+0000 7fd400740800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:52:30.727 INFO:tasks.workunit.client.0.smithi073.stderr: -15> 2024-09-12T00:52:30.590+0000 7fd400740800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:30.727 INFO:tasks.workunit.client.0.smithi073.stderr: -14> 2024-09-12T00:52:30.590+0000 7fd400740800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36 2024-09-12T00:52:30.727 INFO:tasks.workunit.client.0.smithi073.stderr: -13> 2024-09-12T00:52:30.594+0000 7fd400740800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36 info.flags=0x17 2024-09-12T00:52:30.728 INFO:tasks.workunit.client.0.smithi073.stderr: -12> 2024-09-12T00:52:30.594+0000 7fd400740800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36 to cache LRU end 2024-09-12T00:52:30.728 INFO:tasks.workunit.client.0.smithi073.stderr: -11> 2024-09-12T00:52:30.594+0000 7fd400740800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:30.728 INFO:tasks.workunit.client.0.smithi073.stderr: -10> 2024-09-12T00:52:30.594+0000 7fd400740800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36, ofs0, ns] 2024-09-12T00:52:30.728 INFO:tasks.workunit.client.0.smithi073.stderr: -9> 2024-09-12T00:52:30.594+0000 7fd2d37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497011 cookie 94853157291808 notifier 7758 bl.length()=923 2024-09-12T00:52:30.728 INFO:tasks.workunit.client.0.smithi073.stderr: -8> 2024-09-12T00:52:30.594+0000 7fd2d37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36 info.flags=0x17 2024-09-12T00:52:30.728 INFO:tasks.workunit.client.0.smithi073.stderr: -7> 2024-09-12T00:52:30.594+0000 7fd2d37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36 to cache LRU end 2024-09-12T00:52:30.728 INFO:tasks.workunit.client.0.smithi073.stderr: -6> 2024-09-12T00:52:30.594+0000 7fd2d37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:30.728 INFO:tasks.workunit.client.0.smithi073.stderr: -5> 2024-09-12T00:52:30.596+0000 7fd400740800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36]): orig_sources= new_sources= 2024-09-12T00:52:30.728 INFO:tasks.workunit.client.0.smithi073.stderr: -4> 2024-09-12T00:52:30.596+0000 7fd400740800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36]): potential sources added=[] removed=[] 2024-09-12T00:52:30.728 INFO:tasks.workunit.client.0.smithi073.stderr: -3> 2024-09-12T00:52:30.596+0000 7fd400740800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36]): orig_dests= new_dests= 2024-09-12T00:52:30.728 INFO:tasks.workunit.client.0.smithi073.stderr: -2> 2024-09-12T00:52:30.596+0000 7fd400740800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36]): potential dests added=[] removed=[] 2024-09-12T00:52:30.728 INFO:tasks.workunit.client.0.smithi073.stderr: -1> 2024-09-12T00:52:30.598+0000 7fd400740800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd400740800 time 2024-09-12T00:52:30.599126+0000 2024-09-12T00:52:30.728 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:52:30.729 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:52:30.729 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:52:30.729 INFO:tasks.workunit.client.0.smithi073.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd401f8c71a] 2024-09-12T00:52:30.729 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd401f8c8d8] 2024-09-12T00:52:30.729 INFO:tasks.workunit.client.0.smithi073.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5644b6cc1641] 2024-09-12T00:52:30.729 INFO:tasks.workunit.client.0.smithi073.stderr: 4: radosgw-admin(+0xd8854c) [0x5644b71d454c] 2024-09-12T00:52:30.729 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5644b6cd131d] 2024-09-12T00:52:30.729 INFO:tasks.workunit.client.0.smithi073.stderr: 6: main() 2024-09-12T00:52:30.729 INFO:tasks.workunit.client.0.smithi073.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fd400c29590] 2024-09-12T00:52:30.729 INFO:tasks.workunit.client.0.smithi073.stderr: 8: __libc_start_main() 2024-09-12T00:52:30.729 INFO:tasks.workunit.client.0.smithi073.stderr: 9: _start() 2024-09-12T00:52:30.729 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:52:30.729 INFO:tasks.workunit.client.0.smithi073.stderr: 0> 2024-09-12T00:52:30.599+0000 7fd400740800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:52:30.729 INFO:tasks.workunit.client.0.smithi073.stderr: in thread 7fd400740800 thread_name:radosgw-admin 2024-09-12T00:52:30.730 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:52:30.730 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:52:30.730 INFO:tasks.workunit.client.0.smithi073.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd400c3e6f0] 2024-09-12T00:52:30.730 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd400c8b99c] 2024-09-12T00:52:30.730 INFO:tasks.workunit.client.0.smithi073.stderr: 3: raise() 2024-09-12T00:52:30.730 INFO:tasks.workunit.client.0.smithi073.stderr: 4: abort() 2024-09-12T00:52:30.730 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd401f8c774] 2024-09-12T00:52:30.730 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd401f8c8d8] 2024-09-12T00:52:30.730 INFO:tasks.workunit.client.0.smithi073.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5644b6cc1641] 2024-09-12T00:52:30.730 INFO:tasks.workunit.client.0.smithi073.stderr: 8: radosgw-admin(+0xd8854c) [0x5644b71d454c] 2024-09-12T00:52:30.730 INFO:tasks.workunit.client.0.smithi073.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5644b6cd131d] 2024-09-12T00:52:30.730 INFO:tasks.workunit.client.0.smithi073.stderr: 10: main() 2024-09-12T00:52:30.730 INFO:tasks.workunit.client.0.smithi073.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fd400c29590] 2024-09-12T00:52:30.731 INFO:tasks.workunit.client.0.smithi073.stderr: 12: __libc_start_main() 2024-09-12T00:52:30.731 INFO:tasks.workunit.client.0.smithi073.stderr: 13: _start() 2024-09-12T00:52:30.731 INFO:tasks.workunit.client.0.smithi073.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:52:30.731 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:52:30.731 INFO:tasks.workunit.client.0.smithi073.stderr:--- logging levels --- 2024-09-12T00:52:30.731 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 none 2024-09-12T00:52:30.731 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 lockdep 2024-09-12T00:52:30.731 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 context 2024-09-12T00:52:30.731 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 crush 2024-09-12T00:52:30.731 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds 2024-09-12T00:52:30.731 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_balancer 2024-09-12T00:52:30.731 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_locker 2024-09-12T00:52:30.731 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_log 2024-09-12T00:52:30.731 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_log_expire 2024-09-12T00:52:30.732 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_migrator 2024-09-12T00:52:30.732 INFO:tasks.workunit.client.0.smithi073.stderr: 3/ 5 mds_quiesce 2024-09-12T00:52:30.732 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 buffer 2024-09-12T00:52:30.732 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 timer 2024-09-12T00:52:30.732 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 filer 2024-09-12T00:52:30.732 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 striper 2024-09-12T00:52:30.732 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 objecter 2024-09-12T00:52:30.732 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rados 2024-09-12T00:52:30.732 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd 2024-09-12T00:52:30.732 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_mirror 2024-09-12T00:52:30.732 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_replay 2024-09-12T00:52:30.732 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_pwl 2024-09-12T00:52:30.732 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 journaler 2024-09-12T00:52:30.732 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 objectcacher 2024-09-12T00:52:30.733 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:52:30.733 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 client 2024-09-12T00:52:30.733 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 osd 2024-09-12T00:52:30.733 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 optracker 2024-09-12T00:52:30.733 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 objclass 2024-09-12T00:52:30.733 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 filestore 2024-09-12T00:52:30.733 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 journal 2024-09-12T00:52:30.733 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 0 ms 2024-09-12T00:52:30.733 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mon 2024-09-12T00:52:30.733 INFO:tasks.workunit.client.0.smithi073.stderr: 0/10 monc 2024-09-12T00:52:30.733 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 paxos 2024-09-12T00:52:30.733 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 tp 2024-09-12T00:52:30.733 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 auth 2024-09-12T00:52:30.733 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 crypto 2024-09-12T00:52:30.734 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 finisher 2024-09-12T00:52:30.734 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 reserver 2024-09-12T00:52:30.734 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 heartbeatmap 2024-09-12T00:52:30.734 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 perfcounter 2024-09-12T00:52:30.734 INFO:tasks.workunit.client.0.smithi073.stderr: 20/20 rgw 2024-09-12T00:52:30.734 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_sync 2024-09-12T00:52:30.734 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_datacache 2024-09-12T00:52:30.736 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_access 2024-09-12T00:52:30.736 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:52:30.736 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_flight 2024-09-12T00:52:30.736 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:52:30.736 INFO:tasks.workunit.client.0.smithi073.stderr: 20/20 rgw_notification 2024-09-12T00:52:30.736 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 javaclient 2024-09-12T00:52:30.736 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 asok 2024-09-12T00:52:30.736 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 throttle 2024-09-12T00:52:30.736 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 0 refs 2024-09-12T00:52:30.736 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 compressor 2024-09-12T00:52:30.737 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 bluestore 2024-09-12T00:52:30.737 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 bluefs 2024-09-12T00:52:30.737 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 bdev 2024-09-12T00:52:30.737 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 kstore 2024-09-12T00:52:30.737 INFO:tasks.workunit.client.0.smithi073.stderr: 4/ 5 rocksdb 2024-09-12T00:52:30.737 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 fuse 2024-09-12T00:52:30.737 INFO:tasks.workunit.client.0.smithi073.stderr: 2/ 5 mgr 2024-09-12T00:52:30.737 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mgrc 2024-09-12T00:52:30.737 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 dpdk 2024-09-12T00:52:30.737 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 eventtrace 2024-09-12T00:52:30.737 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 prioritycache 2024-09-12T00:52:30.737 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 test 2024-09-12T00:52:30.737 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:52:30.737 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cephsqlite 2024-09-12T00:52:30.738 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:52:30.738 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore 2024-09-12T00:52:30.738 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_onode 2024-09-12T00:52:30.738 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_odata 2024-09-12T00:52:30.738 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_omap 2024-09-12T00:52:30.738 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_tm 2024-09-12T00:52:30.738 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_t 2024-09-12T00:52:30.738 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:52:30.738 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_epm 2024-09-12T00:52:30.738 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_lba 2024-09-12T00:52:30.738 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:52:30.738 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_cache 2024-09-12T00:52:30.738 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_journal 2024-09-12T00:52:30.738 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_device 2024-09-12T00:52:30.739 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_backref 2024-09-12T00:52:30.739 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 alienstore 2024-09-12T00:52:30.739 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mclock 2024-09-12T00:52:30.739 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cyanstore 2024-09-12T00:52:30.739 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 ceph_exporter 2024-09-12T00:52:30.739 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 memstore 2024-09-12T00:52:30.739 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 trace 2024-09-12T00:52:30.739 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 ceph_dedup 2024-09-12T00:52:30.739 INFO:tasks.workunit.client.0.smithi073.stderr: -2/-2 (syslog threshold) 2024-09-12T00:52:30.739 INFO:tasks.workunit.client.0.smithi073.stderr: 99/99 (stderr threshold) 2024-09-12T00:52:30.739 INFO:tasks.workunit.client.0.smithi073.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:52:30.739 INFO:tasks.workunit.client.0.smithi073.stderr: 7fd2237fe640 / http_manager 2024-09-12T00:52:30.739 INFO:tasks.workunit.client.0.smithi073.stderr: 7fd2b1fdb640 / http_manager 2024-09-12T00:52:30.739 INFO:tasks.workunit.client.0.smithi073.stderr: 7fd2b2fdd640 / rgw_dt_lg_renew 2024-09-12T00:52:30.740 INFO:tasks.workunit.client.0.smithi073.stderr: 7fd2d1ffb640 / ms_dispatch 2024-09-12T00:52:30.740 INFO:tasks.workunit.client.0.smithi073.stderr: 7fd2d37fe640 / io_context_pool 2024-09-12T00:52:30.740 INFO:tasks.workunit.client.0.smithi073.stderr: 7fd2e1ffb640 / ms_dispatch 2024-09-12T00:52:30.740 INFO:tasks.workunit.client.0.smithi073.stderr: 7fd2e8e09640 / ms_dispatch 2024-09-12T00:52:30.740 INFO:tasks.workunit.client.0.smithi073.stderr: 7fd2ea60c640 / io_context_pool 2024-09-12T00:52:30.740 INFO:tasks.workunit.client.0.smithi073.stderr: 7fd3f3fff640 / msgr-worker-2 2024-09-12T00:52:30.740 INFO:tasks.workunit.client.0.smithi073.stderr: 7fd3fc4c0640 / msgr-worker-1 2024-09-12T00:52:30.740 INFO:tasks.workunit.client.0.smithi073.stderr: 7fd3fccc1640 / msgr-worker-0 2024-09-12T00:52:30.740 INFO:tasks.workunit.client.0.smithi073.stderr: 7fd3fd4c2640 / io_context_pool 2024-09-12T00:52:30.740 INFO:tasks.workunit.client.0.smithi073.stderr: 7fd400740800 / radosgw-admin 2024-09-12T00:52:30.740 INFO:tasks.workunit.client.0.smithi073.stderr: max_recent 500 2024-09-12T00:52:30.740 INFO:tasks.workunit.client.0.smithi073.stderr: max_new 1000 2024-09-12T00:52:30.740 INFO:tasks.workunit.client.0.smithi073.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:52:30.600770Z_26099896-02ed-44ae-8165-9a1bda125532/log 2024-09-12T00:52:30.741 INFO:tasks.workunit.client.0.smithi073.stderr:--- end dump of recent events --- 2024-09-12T00:52:30.741 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T00:52:30.742 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:30.743 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:30.743 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.672+0000 7f98e8b26800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.743 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.674+0000 7f98e8b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.743 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.674+0000 7f98e8b26800 20 realm 2024-09-12T00:52:30.743 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.674+0000 7f98e8b26800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.743 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.674+0000 7f98e8b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.743 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.674+0000 7f98e8b26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:30.743 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.674+0000 7f98e8b26800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.743 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.674+0000 7f98e8b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.743 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.674+0000 7f98e8b26800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.743 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.675+0000 7f98e8b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:30.743 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.675+0000 7f98e8b26800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.744 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.676+0000 7f98e8b26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:30.744 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.676+0000 7f98e8b26800 20 searching for the correct realm 2024-09-12T00:52:30.744 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.678+0000 7f98dbfd8640 0 -- 172.21.15.73:0/3786025274 >> [v2:172.21.15.73:6826/269690776,v1:172.21.15.73:6827/269690776] conn(0x7f98d4094040 msgr2=0x7f98d4094930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:30.744 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.681+0000 7f98e47d9640 0 -- 172.21.15.73:0/3786025274 >> [v2:172.21.15.73:6810/1807760270,v1:172.21.15.73:6811/1807760270] conn(0x7f98dc08e730 msgr2=0x7f98dc09c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:30.887 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.886+0000 7f98e8b26800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:52:30.887 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.886+0000 7f98e8b26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:30.887 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.886+0000 7f98e8b26800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:52:30.887 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.886+0000 7f98e8b26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:30.887 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.886+0000 7f98e8b26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:30.887 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.886+0000 7f98e8b26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:30.887 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.886+0000 7f98e8b26800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.887 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.887+0000 7f98e8b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.887 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.887+0000 7f98e8b26800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.887 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.887+0000 7f98e8b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:30.888 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.887+0000 7f98e8b26800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.889 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.887+0000 7f98e8b26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:30.889 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.887+0000 7f98e8b26800 20 zone default found 2024-09-12T00:52:30.889 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.887+0000 7f98e8b26800 4 Realm: () 2024-09-12T00:52:30.889 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.887+0000 7f98e8b26800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:52:30.889 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.887+0000 7f98e8b26800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:52:30.889 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.887+0000 7f98e8b26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:30.889 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.887+0000 7f98e8b26800 20 zonegroup default 2024-09-12T00:52:30.889 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.887+0000 7f98e8b26800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.890 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.887+0000 7f98e8b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.890 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.888+0000 7f98e8b26800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.890 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.888+0000 7f98e8b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.890 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.888+0000 7f98e8b26800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.890 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.888+0000 7f98e8b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.890 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.888+0000 7f98e8b26800 20 started sync module instance, tier type = 2024-09-12T00:52:30.891 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.888+0000 7f98e8b26800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:52:30.897 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.897+0000 7f98e8b26800 20 add_watcher() i=0 2024-09-12T00:52:30.897 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.897+0000 7f98e8b26800 20 add_watcher() i=1 2024-09-12T00:52:30.897 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.897+0000 7f98e8b26800 20 add_watcher() i=2 2024-09-12T00:52:30.897 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.897+0000 7f98e8b26800 20 add_watcher() i=3 2024-09-12T00:52:30.897 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.897+0000 7f98e8b26800 20 add_watcher() i=4 2024-09-12T00:52:30.897 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.897+0000 7f98e8b26800 20 add_watcher() i=5 2024-09-12T00:52:30.897 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.897+0000 7f98e8b26800 20 add_watcher() i=6 2024-09-12T00:52:30.898 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.898+0000 7f98e8b26800 20 add_watcher() i=7 2024-09-12T00:52:30.898 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.898+0000 7f98e8b26800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:30.899 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.899+0000 7f979afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:30.900 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.900+0000 7f98e8b26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:30.900 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.900+0000 7f98e8b26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:30.900 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.900+0000 7f98e8b26800 5 note: GC not initialized 2024-09-12T00:52:30.900 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.900+0000 7f9799fdb640 20 reqs_thread_entry: start 2024-09-12T00:52:30.900 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.900+0000 7f98e8b26800 20 init_complete bucket index max shards: 1 2024-09-12T00:52:30.900 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.900+0000 7f98e8b26800 20 Filter name: none 2024-09-12T00:52:30.901 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.900+0000 7f970b7fe640 20 reqs_thread_entry: start 2024-09-12T00:52:30.901 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.900+0000 7f98e8b26800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.902 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.901+0000 7f98e8b26800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:52:30.902 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.901+0000 7f98e8b26800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.902 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.901+0000 7f98e8b26800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:52:30.902 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.901+0000 7f98e8b26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:52:30.902 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.901+0000 7f98e8b26800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.902 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.902+0000 7f98e8b26800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:52:30.902 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.902+0000 7f98e8b26800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.902 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.902+0000 7f98e8b26800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:52:30.902 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.902+0000 7f98e8b26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:52:30.903 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.903+0000 7f979afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:30.905 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.905+0000 7f98e8b26800 20 remove_watcher() i=0 2024-09-12T00:52:30.905 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.905+0000 7f98e8b26800 2 removed watcher, disabling cache 2024-09-12T00:52:30.906 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.906+0000 7f98e8b26800 20 remove_watcher() i=1 2024-09-12T00:52:30.907 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.907+0000 7f98e8b26800 20 remove_watcher() i=2 2024-09-12T00:52:30.908 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.908+0000 7f98e8b26800 20 remove_watcher() i=3 2024-09-12T00:52:30.909 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.909+0000 7f98e8b26800 20 remove_watcher() i=4 2024-09-12T00:52:30.910 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.910+0000 7f98e8b26800 20 remove_watcher() i=5 2024-09-12T00:52:30.911 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.911+0000 7f98e8b26800 20 remove_watcher() i=6 2024-09-12T00:52:30.912 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:30.912+0000 7f98e8b26800 20 remove_watcher() i=7 2024-09-12T00:52:30.922 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:52:30.922 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:52:30.922 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: abort-at-logrecord-writes id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:52:30.922 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:52:30.924 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:30.924 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:52:30.955 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:30.955 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:52:31.011 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:52:31.043 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:31.043 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:31.080 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.080+0000 7fad7ad44800 20 rados->read ofs=0 len=0 2024-09-12T00:52:31.081 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.081+0000 7fad7ad44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:31.081 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.081+0000 7fad7ad44800 20 realm 2024-09-12T00:52:31.081 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.081+0000 7fad7ad44800 20 rados->read ofs=0 len=0 2024-09-12T00:52:31.081 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.081+0000 7fad7ad44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:31.082 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.081+0000 7fad7ad44800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:31.082 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.081+0000 7fad7ad44800 20 rados->read ofs=0 len=0 2024-09-12T00:52:31.082 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.082+0000 7fad7ad44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:31.082 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.082+0000 7fad7ad44800 20 rados->read ofs=0 len=0 2024-09-12T00:52:31.082 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.082+0000 7fad7ad44800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:31.082 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.082+0000 7fad7ad44800 20 rados->read ofs=0 len=0 2024-09-12T00:52:31.083 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.083+0000 7fad7ad44800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:31.083 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.083+0000 7fad7ad44800 20 searching for the correct realm 2024-09-12T00:52:31.085 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.086+0000 7fad772f5640 0 -- 172.21.15.73:0/2265018822 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fad60030040 msgr2=0x7fad60031940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:52:31.291 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.291+0000 7fad772f5640 0 -- 172.21.15.73:0/2265018822 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fad60030040 msgr2=0x7fad60031940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:31.295 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.295+0000 7fad7ad44800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:52:31.295 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.295+0000 7fad7ad44800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:31.295 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.295+0000 7fad7ad44800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:52:31.295 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.295+0000 7fad7ad44800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:31.295 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.295+0000 7fad7ad44800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:31.295 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.295+0000 7fad7ad44800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:31.295 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.295+0000 7fad7ad44800 20 rados->read ofs=0 len=0 2024-09-12T00:52:31.295 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.295+0000 7fad7ad44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:31.295 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.295+0000 7fad7ad44800 20 rados->read ofs=0 len=0 2024-09-12T00:52:31.297 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.296+0000 7fad7ad44800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:31.297 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.296+0000 7fad7ad44800 20 rados->read ofs=0 len=0 2024-09-12T00:52:31.297 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.296+0000 7fad7ad44800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:31.297 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.296+0000 7fad7ad44800 20 zone default found 2024-09-12T00:52:31.297 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.296+0000 7fad7ad44800 4 Realm: () 2024-09-12T00:52:31.297 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.296+0000 7fad7ad44800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:52:31.297 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.296+0000 7fad7ad44800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:52:31.297 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.296+0000 7fad7ad44800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:31.297 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.296+0000 7fad7ad44800 20 zonegroup default 2024-09-12T00:52:31.297 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.296+0000 7fad7ad44800 20 rados->read ofs=0 len=0 2024-09-12T00:52:31.297 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.296+0000 7fad7ad44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:31.297 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.296+0000 7fad7ad44800 20 rados->read ofs=0 len=0 2024-09-12T00:52:31.297 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.296+0000 7fad7ad44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:31.298 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.296+0000 7fad7ad44800 20 rados->read ofs=0 len=0 2024-09-12T00:52:31.298 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.297+0000 7fad7ad44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:31.298 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.297+0000 7fad7ad44800 20 started sync module instance, tier type = 2024-09-12T00:52:31.298 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.297+0000 7fad7ad44800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:52:31.305 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.306+0000 7fad7ad44800 20 add_watcher() i=0 2024-09-12T00:52:31.305 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.306+0000 7fad7ad44800 20 add_watcher() i=1 2024-09-12T00:52:31.306 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.306+0000 7fad7ad44800 20 add_watcher() i=2 2024-09-12T00:52:31.306 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.306+0000 7fad7ad44800 20 add_watcher() i=3 2024-09-12T00:52:31.306 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.306+0000 7fad7ad44800 20 add_watcher() i=4 2024-09-12T00:52:31.306 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.306+0000 7fad7ad44800 20 add_watcher() i=5 2024-09-12T00:52:31.306 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.306+0000 7fad7ad44800 20 add_watcher() i=6 2024-09-12T00:52:31.306 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.306+0000 7fad7ad44800 20 add_watcher() i=7 2024-09-12T00:52:31.306 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.306+0000 7fad7ad44800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:31.307 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.308+0000 7fac2d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:31.308 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.308+0000 7fad7ad44800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:31.309 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.308+0000 7fad7ad44800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:31.309 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.308+0000 7fad7ad44800 5 note: GC not initialized 2024-09-12T00:52:31.309 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.308+0000 7faba7fff640 20 reqs_thread_entry: start 2024-09-12T00:52:31.309 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.309+0000 7fad7ad44800 20 init_complete bucket index max shards: 1 2024-09-12T00:52:31.309 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.309+0000 7fad7ad44800 20 Filter name: none 2024-09-12T00:52:31.309 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.309+0000 7faba5ffb640 20 reqs_thread_entry: start 2024-09-12T00:52:31.309 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.309+0000 7fad7ad44800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:52:31.309 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.309+0000 7fad7ad44800 20 rados->read ofs=0 len=0 2024-09-12T00:52:31.310 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.309+0000 7fad7ad44800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:52:31.310 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.309+0000 7fad7ad44800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:52:31.310 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.309+0000 7fad7ad44800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:52:31.310 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.309+0000 7fad7ad44800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36 : miss 2024-09-12T00:52:31.310 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.309+0000 7fad7ad44800 20 rados->read ofs=0 len=0 2024-09-12T00:52:31.310 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.310+0000 7fad7ad44800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:52:31.311 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.310+0000 7fad7ad44800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36 info.flags=0x17 2024-09-12T00:52:31.311 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.310+0000 7fad7ad44800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36 to cache LRU end 2024-09-12T00:52:31.311 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.310+0000 7fad7ad44800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:52:31.311 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.310+0000 7fad7ad44800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:31.311 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.310+0000 7fad7ad44800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36 2024-09-12T00:52:31.311 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.311+0000 7fad7ad44800 0 INFO: RGWReshardLock::lock found lock on abort-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36 to be held by another RGW process; skipping for now 2024-09-12T00:52:31.311 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.311+0000 7fac2d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:31.313 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.313+0000 7fad7ad44800 20 remove_watcher() i=0 2024-09-12T00:52:31.313 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.313+0000 7fad7ad44800 2 removed watcher, disabling cache 2024-09-12T00:52:31.314 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.314+0000 7fad7ad44800 20 remove_watcher() i=1 2024-09-12T00:52:31.315 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.315+0000 7fad7ad44800 20 remove_watcher() i=2 2024-09-12T00:52:31.316 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.316+0000 7fad7ad44800 20 remove_watcher() i=3 2024-09-12T00:52:31.317 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.317+0000 7fad7ad44800 20 remove_watcher() i=4 2024-09-12T00:52:31.318 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.318+0000 7fad7ad44800 20 remove_watcher() i=5 2024-09-12T00:52:31.319 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.319+0000 7fad7ad44800 20 remove_watcher() i=6 2024-09-12T00:52:31.320 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:52:31.320+0000 7fad7ad44800 20 remove_watcher() i=7 2024-09-12T00:52:31.330 INFO:tasks.workunit.client.0.smithi073.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:53:01.357 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:53:01.392 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:01.392 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:01.435 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.436+0000 7fb59ad1f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.437 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.438+0000 7fb59ad1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.437 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.438+0000 7fb59ad1f800 20 realm 2024-09-12T00:53:01.437 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.438+0000 7fb59ad1f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.437 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.438+0000 7fb59ad1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.437 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.438+0000 7fb59ad1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:01.438 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.438+0000 7fb59ad1f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.438 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.438+0000 7fb59ad1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.438 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.438+0000 7fb59ad1f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.439 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.439+0000 7fb59ad1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:01.439 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.439+0000 7fb59ad1f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.439 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.440+0000 7fb59ad1f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:01.439 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.440+0000 7fb59ad1f800 20 searching for the correct realm 2024-09-12T00:53:01.441 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.442+0000 7fb5972a3640 0 -- 172.21.15.73:0/2461702025 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fb580008070 msgr2=0x7fb580068e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:01.648 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.649+0000 7fb5972a3640 0 -- 172.21.15.73:0/2461702025 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fb580008070 msgr2=0x7fb580068e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:01.652 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.653+0000 7fb59ad1f800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:53:01.652 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.653+0000 7fb59ad1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:01.653 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.653+0000 7fb59ad1f800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:53:01.653 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.653+0000 7fb59ad1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:01.653 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.653+0000 7fb59ad1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:01.653 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.653+0000 7fb59ad1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:01.653 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.653+0000 7fb59ad1f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.653 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.654+0000 7fb59ad1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.653 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.654+0000 7fb59ad1f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.655 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.654+0000 7fb59ad1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:01.655 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.654+0000 7fb59ad1f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.656 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.654+0000 7fb59ad1f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:01.656 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.654+0000 7fb59ad1f800 20 zone default found 2024-09-12T00:53:01.656 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.654+0000 7fb59ad1f800 4 Realm: () 2024-09-12T00:53:01.656 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.654+0000 7fb59ad1f800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:53:01.656 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.654+0000 7fb59ad1f800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:53:01.656 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.654+0000 7fb59ad1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:01.656 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.654+0000 7fb59ad1f800 20 zonegroup default 2024-09-12T00:53:01.656 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.654+0000 7fb59ad1f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.656 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.655+0000 7fb59ad1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.656 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.655+0000 7fb59ad1f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.850 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.851+0000 7fb59ad1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.850 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.851+0000 7fb59ad1f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.850 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.851+0000 7fb59ad1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.850 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.851+0000 7fb59ad1f800 20 started sync module instance, tier type = 2024-09-12T00:53:01.850 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.851+0000 7fb59ad1f800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:53:01.860 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.861+0000 7fb59ad1f800 20 add_watcher() i=0 2024-09-12T00:53:01.860 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.861+0000 7fb59ad1f800 20 add_watcher() i=1 2024-09-12T00:53:01.860 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.861+0000 7fb59ad1f800 20 add_watcher() i=2 2024-09-12T00:53:01.860 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.861+0000 7fb59ad1f800 20 add_watcher() i=3 2024-09-12T00:53:01.860 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.861+0000 7fb59ad1f800 20 add_watcher() i=4 2024-09-12T00:53:01.861 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.861+0000 7fb59ad1f800 20 add_watcher() i=5 2024-09-12T00:53:01.861 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.861+0000 7fb59ad1f800 20 add_watcher() i=6 2024-09-12T00:53:01.861 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.863+0000 7fb59ad1f800 20 add_watcher() i=7 2024-09-12T00:53:01.861 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.863+0000 7fb59ad1f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:01.863 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.865+0000 7fb44d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:01.864 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.865+0000 7fb59ad1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:01.865 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.865+0000 7fb59ad1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:01.865 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.865+0000 7fb59ad1f800 5 note: GC not initialized 2024-09-12T00:53:01.865 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.865+0000 7fb3c7fff640 20 reqs_thread_entry: start 2024-09-12T00:53:01.865 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.866+0000 7fb59ad1f800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:01.865 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.866+0000 7fb59ad1f800 20 Filter name: none 2024-09-12T00:53:01.865 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.866+0000 7fb3c5ffb640 20 reqs_thread_entry: start 2024-09-12T00:53:01.865 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.866+0000 7fb59ad1f800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:53:01.865 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.866+0000 7fb59ad1f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.866 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.867+0000 7fb59ad1f800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:53:01.866 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.867+0000 7fb59ad1f800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:53:01.866 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.867+0000 7fb59ad1f800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:53:01.866 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.867+0000 7fb59ad1f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36 : miss 2024-09-12T00:53:01.867 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.867+0000 7fb59ad1f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.867 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.867+0000 7fb59ad1f800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:53:01.867 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.867+0000 7fb59ad1f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36 info.flags=0x17 2024-09-12T00:53:01.867 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.867+0000 7fb59ad1f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36 to cache LRU end 2024-09-12T00:53:01.867 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.867+0000 7fb59ad1f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:53:01.867 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.867+0000 7fb59ad1f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:01.867 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.867+0000 7fb59ad1f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36 2024-09-12T00:53:01.867 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.869+0000 7fb59ad1f800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:53:01.872 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.873+0000 7fb59ad1f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36 info.flags=0x17 2024-09-12T00:53:01.873 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.873+0000 7fb59ad1f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36 to cache LRU end 2024-09-12T00:53:01.873 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.873+0000 7fb59ad1f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:01.873 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.873+0000 7fb59ad1f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36, ofs0, ns] 2024-09-12T00:53:01.873 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.874+0000 7fb47a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497012 cookie 94799287327072 notifier 7818 bl.length()=923 2024-09-12T00:53:01.873 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.874+0000 7fb47a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36 info.flags=0x17 2024-09-12T00:53:01.873 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.874+0000 7fb47a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36 to cache LRU end 2024-09-12T00:53:01.873 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.874+0000 7fb47a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:01.875 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.876+0000 7fb59ad1f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36]): orig_sources= new_sources= 2024-09-12T00:53:01.875 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.876+0000 7fb59ad1f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36]): potential sources added=[] removed=[] 2024-09-12T00:53:01.875 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.876+0000 7fb59ad1f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36]): orig_dests= new_dests= 2024-09-12T00:53:01.875 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.876+0000 7fb59ad1f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36]): potential dests added=[] removed=[] 2024-09-12T00:53:01.877 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.879+0000 7fb59ad1f800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36.2.0 2024-09-12T00:53:01.877 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.879+0000 7fb59ad1f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36.2.0 2024-09-12T00:53:01.877 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.879+0000 7fb59ad1f800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36.2.1 2024-09-12T00:53:01.878 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.879+0000 7fb59ad1f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36.2.1 2024-09-12T00:53:01.878 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.879+0000 7fb59ad1f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36.0 2024-09-12T00:53:01.880 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.881+0000 7fb59ad1f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36 : hit (requested=0x17, cached=0x17) 2024-09-12T00:53:01.880 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.881+0000 7fb59ad1f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36 2024-09-12T00:53:01.883 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.884+0000 7fb59ad1f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36 info.flags=0x17 2024-09-12T00:53:01.883 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.884+0000 7fb59ad1f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36 to cache LRU end 2024-09-12T00:53:01.883 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.884+0000 7fb59ad1f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:01.883 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.884+0000 7fb59ad1f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36, ofs0, ns] 2024-09-12T00:53:01.883 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.885+0000 7fb47a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497013 cookie 94799287327072 notifier 7818 bl.length()=923 2024-09-12T00:53:01.884 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.885+0000 7fb47a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36 info.flags=0x17 2024-09-12T00:53:01.884 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.885+0000 7fb47a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36 to cache LRU end 2024-09-12T00:53:01.884 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.885+0000 7fb47a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:01.885 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.886+0000 7fb59ad1f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36]): orig_sources= new_sources= 2024-09-12T00:53:01.885 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.886+0000 7fb59ad1f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36]): potential sources added=[] removed=[] 2024-09-12T00:53:01.885 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.886+0000 7fb59ad1f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36]): orig_dests= new_dests= 2024-09-12T00:53:01.886 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.886+0000 7fb59ad1f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36]): potential dests added=[] removed=[] 2024-09-12T00:53:01.886 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.888+0000 7fb59ad1f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36.0 2024-09-12T00:53:01.887 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.888+0000 7fb59ad1f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36 : hit (requested=0x17, cached=0x17) 2024-09-12T00:53:01.887 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.888+0000 7fb59ad1f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36 2024-09-12T00:53:01.889 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.890+0000 7fb59ad1f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36 info.flags=0x17 2024-09-12T00:53:01.889 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.890+0000 7fb59ad1f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36 to cache LRU end 2024-09-12T00:53:01.889 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.890+0000 7fb59ad1f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:01.889 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.890+0000 7fb59ad1f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36, ofs0, ns] 2024-09-12T00:53:01.889 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.890+0000 7fb479ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497014 cookie 94799287327072 notifier 7818 bl.length()=891 2024-09-12T00:53:01.889 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.890+0000 7fb479ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36 info.flags=0x17 2024-09-12T00:53:01.889 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.890+0000 7fb479ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36 to cache LRU end 2024-09-12T00:53:01.890 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.890+0000 7fb479ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:01.891 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.892+0000 7fb59ad1f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36]): orig_sources= new_sources= 2024-09-12T00:53:01.891 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.892+0000 7fb59ad1f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36]): potential sources added=[] removed=[] 2024-09-12T00:53:01.891 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.892+0000 7fb59ad1f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36]): orig_dests= new_dests= 2024-09-12T00:53:01.891 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.892+0000 7fb59ad1f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36]): potential dests added=[] removed=[] 2024-09-12T00:53:01.892 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.894+0000 7fb59ad1f800 1 execute INFO: reshard of bucket "abort-at-logrecord-writes" from 1 shards to 2 shards completed successfully 2024-09-12T00:53:01.894 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.896+0000 7fb44d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:01.897 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.898+0000 7fb59ad1f800 20 remove_watcher() i=0 2024-09-12T00:53:01.897 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.898+0000 7fb59ad1f800 2 removed watcher, disabling cache 2024-09-12T00:53:01.898 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.900+0000 7fb59ad1f800 20 remove_watcher() i=1 2024-09-12T00:53:01.900 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.901+0000 7fb59ad1f800 20 remove_watcher() i=2 2024-09-12T00:53:01.901 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.902+0000 7fb59ad1f800 20 remove_watcher() i=3 2024-09-12T00:53:01.903 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.904+0000 7fb59ad1f800 20 remove_watcher() i=4 2024-09-12T00:53:01.904 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.905+0000 7fb59ad1f800 20 remove_watcher() i=5 2024-09-12T00:53:01.905 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.906+0000 7fb59ad1f800 20 remove_watcher() i=6 2024-09-12T00:53:01.906 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.907+0000 7fb59ad1f800 20 remove_watcher() i=7 2024-09-12T00:53:01.918 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T00:53:01.948 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:01.948 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:01.986 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.987+0000 7f7927526800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.988 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.989+0000 7f7927526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.988 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.989+0000 7f7927526800 20 realm 2024-09-12T00:53:01.988 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.989+0000 7f7927526800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.988 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.989+0000 7f7927526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.988 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.989+0000 7f7927526800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:01.988 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.989+0000 7f7927526800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.989 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.989+0000 7f7927526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.989 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.989+0000 7f7927526800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.989 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.990+0000 7f7927526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:01.989 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:01.990+0000 7f7927526800 20 rados->read ofs=0 len=0 2024-09-12T00:53:02.192 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.193+0000 7f7927526800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:02.192 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.193+0000 7f7927526800 20 searching for the correct realm 2024-09-12T00:53:02.194 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.195+0000 7f791bfff640 0 -- 172.21.15.73:0/1028181087 >> [v2:172.21.15.73:6826/269690776,v1:172.21.15.73:6827/269690776] conn(0x7f791409a400 msgr2=0x7f791409a840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:02.400 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.402+0000 7f7923109640 0 -- 172.21.15.73:0/1028181087 >> [v2:172.21.15.73:6810/1807760270,v1:172.21.15.73:6811/1807760270] conn(0x7f791c030020 msgr2=0x7f791c0800d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:02.608 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.609+0000 7f7927526800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:53:02.608 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.609+0000 7f7927526800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:02.608 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.609+0000 7f7927526800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:53:02.608 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.609+0000 7f7927526800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:02.609 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.609+0000 7f7927526800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:02.609 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.609+0000 7f7927526800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:02.609 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.609+0000 7f7927526800 20 rados->read ofs=0 len=0 2024-09-12T00:53:02.609 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.609+0000 7f7927526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:02.609 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.609+0000 7f7927526800 20 rados->read ofs=0 len=0 2024-09-12T00:53:02.609 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.610+0000 7f7927526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:02.609 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.610+0000 7f7927526800 20 rados->read ofs=0 len=0 2024-09-12T00:53:02.610 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.610+0000 7f7927526800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:02.610 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.610+0000 7f7927526800 20 zone default found 2024-09-12T00:53:02.610 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.610+0000 7f7927526800 4 Realm: () 2024-09-12T00:53:02.610 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.610+0000 7f7927526800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:53:02.611 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.610+0000 7f7927526800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:53:02.611 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.610+0000 7f7927526800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:02.611 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.610+0000 7f7927526800 20 zonegroup default 2024-09-12T00:53:02.611 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.610+0000 7f7927526800 20 rados->read ofs=0 len=0 2024-09-12T00:53:02.611 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.610+0000 7f7927526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:02.611 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.610+0000 7f7927526800 20 rados->read ofs=0 len=0 2024-09-12T00:53:02.611 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.610+0000 7f7927526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:02.611 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.610+0000 7f7927526800 20 rados->read ofs=0 len=0 2024-09-12T00:53:02.611 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.611+0000 7f7927526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:02.612 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.611+0000 7f7927526800 20 started sync module instance, tier type = 2024-09-12T00:53:02.612 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.611+0000 7f7927526800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:53:02.619 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.620+0000 7f7927526800 20 add_watcher() i=0 2024-09-12T00:53:02.619 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.620+0000 7f7927526800 20 add_watcher() i=1 2024-09-12T00:53:02.619 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.620+0000 7f7927526800 20 add_watcher() i=2 2024-09-12T00:53:02.620 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.620+0000 7f7927526800 20 add_watcher() i=3 2024-09-12T00:53:02.620 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.620+0000 7f7927526800 20 add_watcher() i=4 2024-09-12T00:53:02.620 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.620+0000 7f7927526800 20 add_watcher() i=5 2024-09-12T00:53:02.620 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.620+0000 7f7927526800 20 add_watcher() i=6 2024-09-12T00:53:02.621 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.621+0000 7f7927526800 20 add_watcher() i=7 2024-09-12T00:53:02.621 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.621+0000 7f7927526800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:02.622 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.623+0000 7f77d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:02.623 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.623+0000 7f7927526800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:02.623 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.623+0000 7f7927526800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:02.623 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.623+0000 7f7927526800 5 note: GC not initialized 2024-09-12T00:53:02.623 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.624+0000 7f77d8fe1640 20 reqs_thread_entry: start 2024-09-12T00:53:02.623 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.624+0000 7f7927526800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:02.623 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.624+0000 7f7927526800 20 Filter name: none 2024-09-12T00:53:02.623 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.624+0000 7f77527fc640 20 reqs_thread_entry: start 2024-09-12T00:53:02.623 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.624+0000 7f7927526800 20 rados->read ofs=0 len=0 2024-09-12T00:53:02.624 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.625+0000 7f7927526800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:53:02.624 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.625+0000 7f7927526800 20 rados->read ofs=0 len=0 2024-09-12T00:53:02.624 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.625+0000 7f7927526800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:53:02.624 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.625+0000 7f7927526800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:02.625 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.625+0000 7f7927526800 20 rados->read ofs=0 len=0 2024-09-12T00:53:02.625 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.626+0000 7f7927526800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:53:02.625 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.626+0000 7f7927526800 20 rados->read ofs=0 len=0 2024-09-12T00:53:02.625 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.626+0000 7f7927526800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:53:02.625 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.626+0000 7f7927526800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:02.626 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.627+0000 7f77d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:02.628 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.630+0000 7f7927526800 20 remove_watcher() i=0 2024-09-12T00:53:02.628 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.630+0000 7f7927526800 2 removed watcher, disabling cache 2024-09-12T00:53:02.629 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.631+0000 7f7927526800 20 remove_watcher() i=1 2024-09-12T00:53:02.631 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.632+0000 7f7927526800 20 remove_watcher() i=2 2024-09-12T00:53:02.632 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.633+0000 7f7927526800 20 remove_watcher() i=3 2024-09-12T00:53:02.633 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.634+0000 7f7927526800 20 remove_watcher() i=4 2024-09-12T00:53:02.634 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.635+0000 7f7927526800 20 remove_watcher() i=5 2024-09-12T00:53:02.635 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.636+0000 7f7927526800 20 remove_watcher() i=6 2024-09-12T00:53:02.636 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:02.637+0000 7f7927526800 20 remove_watcher() i=7 2024-09-12T00:53:02.646 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:02.647 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:53:02.647 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: abort-at-logrecord-writes id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:53:02.647 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:02.649 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:02.649 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:02.668 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:02.668 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:02.871 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:02.872 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:02.935 INFO:tasks.workunit.client.0.smithi073.stderr:TEST: reshard bucket with EIO injected at change_reshard_state 2024-09-12T00:53:02.935 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:02.936 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:02.936 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:02.981 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:02.981 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:03.037 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:03.037 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:03.073 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:03.074 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:03.108 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:03.108 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:03.143 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:03.143 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:03.179 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:03.179 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:03.214 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:03.214 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:03.248 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:03.249 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:03.282 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:03.282 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:03.316 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:03.317 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:03.351 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:03.351 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:03.385 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:03.385 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:03.421 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:03.421 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:03.456 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:03.456 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:03.489 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:03.489 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:03.524 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:03.524 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:03.559 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:03.559 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:03.594 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:03.594 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:03.629 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:03.629 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:03.666 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:03.666 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:03.701 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:03.701 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:03.736 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:53:03.764 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:03.764 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:03.801 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:03.802+0000 7f295db40800 20 rados->read ofs=0 len=0 2024-09-12T00:53:03.803 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:03.804+0000 7f295db40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:03.803 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:03.804+0000 7f295db40800 20 realm 2024-09-12T00:53:03.803 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:03.804+0000 7f295db40800 20 rados->read ofs=0 len=0 2024-09-12T00:53:03.804 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:03.804+0000 7f295db40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:03.804 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:03.804+0000 7f295db40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:03.804 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:03.804+0000 7f295db40800 20 rados->read ofs=0 len=0 2024-09-12T00:53:03.804 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:03.804+0000 7f295db40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:03.804 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:03.804+0000 7f295db40800 20 rados->read ofs=0 len=0 2024-09-12T00:53:03.805 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:03.805+0000 7f295db40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:03.806 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:03.805+0000 7f295db40800 20 rados->read ofs=0 len=0 2024-09-12T00:53:03.806 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:03.806+0000 7f295db40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:03.806 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:03.806+0000 7f295db40800 20 searching for the correct realm 2024-09-12T00:53:03.807 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:03.808+0000 7f295a0ee640 0 -- 172.21.15.73:0/364816489 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f2944018070 msgr2=0x7f294407a170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:04.013 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.015+0000 7f295a0ee640 0 -- 172.21.15.73:0/364816489 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f2944018070 msgr2=0x7f294407a170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:04.017 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.019+0000 7f295db40800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:53:04.018 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.019+0000 7f295db40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:04.018 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.019+0000 7f295db40800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:53:04.018 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.019+0000 7f295db40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:04.018 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.019+0000 7f295db40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:04.018 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.019+0000 7f295db40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:04.018 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.019+0000 7f295db40800 20 rados->read ofs=0 len=0 2024-09-12T00:53:04.018 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.019+0000 7f295db40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:04.018 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.019+0000 7f295db40800 20 rados->read ofs=0 len=0 2024-09-12T00:53:04.019 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.019+0000 7f295db40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:04.019 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.019+0000 7f295db40800 20 rados->read ofs=0 len=0 2024-09-12T00:53:04.020 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.020+0000 7f295db40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:04.020 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.020+0000 7f295db40800 20 zone default found 2024-09-12T00:53:04.020 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.020+0000 7f295db40800 4 Realm: () 2024-09-12T00:53:04.020 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.020+0000 7f295db40800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:53:04.020 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.020+0000 7f295db40800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:53:04.020 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.020+0000 7f295db40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:04.020 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.020+0000 7f295db40800 20 zonegroup default 2024-09-12T00:53:04.020 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.020+0000 7f295db40800 20 rados->read ofs=0 len=0 2024-09-12T00:53:04.020 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.020+0000 7f295db40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:04.020 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.020+0000 7f295db40800 20 rados->read ofs=0 len=0 2024-09-12T00:53:04.020 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.020+0000 7f295db40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:04.021 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.020+0000 7f295db40800 20 rados->read ofs=0 len=0 2024-09-12T00:53:04.021 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.021+0000 7f295db40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:04.021 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.021+0000 7f295db40800 20 started sync module instance, tier type = 2024-09-12T00:53:04.021 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.021+0000 7f295db40800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:53:04.029 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.030+0000 7f295db40800 20 add_watcher() i=0 2024-09-12T00:53:04.029 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.030+0000 7f295db40800 20 add_watcher() i=1 2024-09-12T00:53:04.029 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.030+0000 7f295db40800 20 add_watcher() i=2 2024-09-12T00:53:04.029 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.030+0000 7f295db40800 20 add_watcher() i=3 2024-09-12T00:53:04.029 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.030+0000 7f295db40800 20 add_watcher() i=4 2024-09-12T00:53:04.029 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.030+0000 7f295db40800 20 add_watcher() i=5 2024-09-12T00:53:04.029 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.030+0000 7f295db40800 20 add_watcher() i=6 2024-09-12T00:53:04.029 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.031+0000 7f295db40800 20 add_watcher() i=7 2024-09-12T00:53:04.030 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.031+0000 7f295db40800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:04.032 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.032+0000 7f280b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:04.032 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.033+0000 7f295db40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:04.032 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.033+0000 7f295db40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:04.032 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.033+0000 7f295db40800 5 note: GC not initialized 2024-09-12T00:53:04.032 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.033+0000 7f280a7fc640 20 reqs_thread_entry: start 2024-09-12T00:53:04.032 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.033+0000 7f295db40800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:04.032 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.033+0000 7f295db40800 20 Filter name: none 2024-09-12T00:53:04.032 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.033+0000 7f277bfff640 20 reqs_thread_entry: start 2024-09-12T00:53:04.033 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.033+0000 7f295db40800 20 rados->read ofs=0 len=0 2024-09-12T00:53:04.034 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.034+0000 7f295db40800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:53:04.034 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.034+0000 7f295db40800 20 rados->read ofs=0 len=0 2024-09-12T00:53:04.034 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.034+0000 7f295db40800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:53:04.034 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.034+0000 7f295db40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:04.034 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.034+0000 7f295db40800 20 rados->read ofs=0 len=0 2024-09-12T00:53:04.034 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.035+0000 7f295db40800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:53:04.034 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.035+0000 7f295db40800 20 rados->read ofs=0 len=0 2024-09-12T00:53:04.034 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.035+0000 7f295db40800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:53:04.035 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.035+0000 7f295db40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:04.035 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.036+0000 7f280b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:04.037 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.039+0000 7f295db40800 20 remove_watcher() i=0 2024-09-12T00:53:04.037 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.039+0000 7f295db40800 2 removed watcher, disabling cache 2024-09-12T00:53:04.038 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.040+0000 7f295db40800 20 remove_watcher() i=1 2024-09-12T00:53:04.039 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.041+0000 7f295db40800 20 remove_watcher() i=2 2024-09-12T00:53:04.040 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.042+0000 7f295db40800 20 remove_watcher() i=3 2024-09-12T00:53:04.041 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.043+0000 7f295db40800 20 remove_watcher() i=4 2024-09-12T00:53:04.042 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.044+0000 7f295db40800 20 remove_watcher() i=5 2024-09-12T00:53:04.043 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.045+0000 7f295db40800 20 remove_watcher() i=6 2024-09-12T00:53:04.044 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.046+0000 7f295db40800 20 remove_watcher() i=7 2024-09-12T00:53:04.054 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:04.054 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:53:04.055 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: error-at-change-reshard-state id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:53:04.055 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:04.056 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state 2024-09-12T00:53:04.090 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:04.090 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:04.127 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.128+0000 7f0999cbb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:04.128 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.129+0000 7f0999cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:04.129 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.129+0000 7f0999cbb800 20 realm 2024-09-12T00:53:04.129 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.129+0000 7f0999cbb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:04.129 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.130+0000 7f0999cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:04.129 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.130+0000 7f0999cbb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:04.129 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.130+0000 7f0999cbb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:04.129 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.130+0000 7f0999cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:04.129 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.130+0000 7f0999cbb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:04.130 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.131+0000 7f0999cbb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:04.130 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.131+0000 7f0999cbb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:04.130 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.132+0000 7f0999cbb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:04.130 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.132+0000 7f0999cbb800 20 searching for the correct realm 2024-09-12T00:53:04.134 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.135+0000 7f0997fa6640 0 -- 172.21.15.73:0/2197408394 >> [v2:172.21.15.73:6800/2864081714,v1:172.21.15.73:6801/2864081714] conn(0x55a517998e10 msgr2=0x55a51799b2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:04.138 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.139+0000 7f09977a5640 0 -- 172.21.15.73:0/2197408394 >> [v2:172.21.15.117:6816/1460498570,v1:172.21.15.117:6817/1460498570] conn(0x7f0990018930 msgr2=0x7f09900163a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:04.141 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.142+0000 7f0999cbb800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:53:04.141 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.142+0000 7f0999cbb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:04.141 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.142+0000 7f0999cbb800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:53:04.141 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.142+0000 7f0999cbb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:04.142 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.142+0000 7f0999cbb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:04.142 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.142+0000 7f0999cbb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:04.142 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.142+0000 7f0999cbb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:04.142 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.142+0000 7f0999cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:04.142 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.142+0000 7f0999cbb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:04.143 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.143+0000 7f0999cbb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:04.143 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.143+0000 7f0999cbb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:04.143 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.143+0000 7f0999cbb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:04.143 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.143+0000 7f0999cbb800 20 zone default found 2024-09-12T00:53:04.143 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.143+0000 7f0999cbb800 4 Realm: () 2024-09-12T00:53:04.144 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.143+0000 7f0999cbb800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:53:04.144 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.143+0000 7f0999cbb800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:53:04.144 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.143+0000 7f0999cbb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:04.144 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.143+0000 7f0999cbb800 20 zonegroup default 2024-09-12T00:53:04.144 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.143+0000 7f0999cbb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:04.144 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.143+0000 7f0999cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:04.144 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.143+0000 7f0999cbb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:04.144 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.144+0000 7f0999cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:04.144 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.144+0000 7f0999cbb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:04.144 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.144+0000 7f0999cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:04.145 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.144+0000 7f0999cbb800 20 started sync module instance, tier type = 2024-09-12T00:53:04.145 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.144+0000 7f0999cbb800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:53:04.152 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.153+0000 7f0999cbb800 20 add_watcher() i=0 2024-09-12T00:53:04.152 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.153+0000 7f0999cbb800 20 add_watcher() i=1 2024-09-12T00:53:04.152 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.153+0000 7f0999cbb800 20 add_watcher() i=2 2024-09-12T00:53:04.152 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.153+0000 7f0999cbb800 20 add_watcher() i=3 2024-09-12T00:53:04.152 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.153+0000 7f0999cbb800 20 add_watcher() i=4 2024-09-12T00:53:04.152 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.153+0000 7f0999cbb800 20 add_watcher() i=5 2024-09-12T00:53:04.152 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.153+0000 7f0999cbb800 20 add_watcher() i=6 2024-09-12T00:53:04.153 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.154+0000 7f0999cbb800 20 add_watcher() i=7 2024-09-12T00:53:04.153 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.154+0000 7f0999cbb800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:04.154 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.156+0000 7f084e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:04.155 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.156+0000 7f0999cbb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:04.155 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.156+0000 7f0999cbb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:04.156 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.156+0000 7f0999cbb800 5 note: GC not initialized 2024-09-12T00:53:04.156 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.156+0000 7f084d7e2640 20 reqs_thread_entry: start 2024-09-12T00:53:04.156 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.156+0000 7f0999cbb800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:04.156 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.156+0000 7f0999cbb800 20 Filter name: none 2024-09-12T00:53:04.156 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.157+0000 7f08467fc640 20 reqs_thread_entry: start 2024-09-12T00:53:04.156 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.157+0000 7f0999cbb800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T00:53:04.156 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.157+0000 7f0999cbb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:04.157 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.157+0000 7f0999cbb800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:53:04.157 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.157+0000 7f0999cbb800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T00:53:04.157 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.157+0000 7f0999cbb800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T00:53:04.157 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.157+0000 7f0999cbb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37 : miss 2024-09-12T00:53:04.157 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.157+0000 7f0999cbb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:04.157 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.157+0000 7f0999cbb800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:53:04.157 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.157+0000 7f0999cbb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37 info.flags=0x17 2024-09-12T00:53:04.157 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.157+0000 7f0999cbb800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37 to cache LRU end 2024-09-12T00:53:04.157 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.157+0000 7f0999cbb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:53:04.158 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.157+0000 7f0999cbb800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:04.158 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.157+0000 7f0999cbb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37 2024-09-12T00:53:04.160 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.161+0000 7f0999cbb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37 info.flags=0x17 2024-09-12T00:53:04.160 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.161+0000 7f0999cbb800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37 to cache LRU end 2024-09-12T00:53:04.160 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.161+0000 7f0999cbb800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:04.160 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.161+0000 7f0999cbb800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37, ofs0, ns] 2024-09-12T00:53:04.160 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.161+0000 7f087affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497030 cookie 94167553930736 notifier 7872 bl.length()=931 2024-09-12T00:53:04.160 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.161+0000 7f087affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37 info.flags=0x17 2024-09-12T00:53:04.160 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.161+0000 7f087affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37 to cache LRU end 2024-09-12T00:53:04.160 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.161+0000 7f087affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:04.161 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.163+0000 7f0999cbb800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37]): orig_sources= new_sources= 2024-09-12T00:53:04.162 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.163+0000 7f0999cbb800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37]): potential sources added=[] removed=[] 2024-09-12T00:53:04.162 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.163+0000 7f0999cbb800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37]): orig_dests= new_dests= 2024-09-12T00:53:04.162 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.163+0000 7f0999cbb800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37]): potential dests added=[] removed=[] 2024-09-12T00:53:04.163 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.165+0000 7f0999cbb800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37.1.0 2024-09-12T00:53:04.164 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.165+0000 7f0999cbb800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37.1.0 2024-09-12T00:53:04.164 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.165+0000 7f0999cbb800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37.1.1 2024-09-12T00:53:04.164 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.165+0000 7f0999cbb800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37.1.1 2024-09-12T00:53:04.164 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.165+0000 7f0999cbb800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37.0 2024-09-12T00:53:04.166 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.167+0000 7f0999cbb800 -1 Injecting error=-5 at location=change_reshard_state 2024-09-12T00:53:04.166 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.167+0000 7f0999cbb800 0 ERROR: change_reshard_state failed to commit target index layout: (5) Input/output error 2024-09-12T00:53:04.170 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.171+0000 7f0999cbb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37 : hit (requested=0x17, cached=0x17) 2024-09-12T00:53:04.170 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.171+0000 7f0999cbb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37 2024-09-12T00:53:04.171 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.172+0000 7f0999cbb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37 info.flags=0x17 2024-09-12T00:53:04.172 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.172+0000 7f0999cbb800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37 to cache LRU end 2024-09-12T00:53:04.172 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.172+0000 7f0999cbb800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:04.172 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.172+0000 7f0999cbb800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37, ofs0, ns] 2024-09-12T00:53:04.172 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.173+0000 7f087a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497031 cookie 94167553930736 notifier 7872 bl.length()=899 2024-09-12T00:53:04.172 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.173+0000 7f087a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37 info.flags=0x17 2024-09-12T00:53:04.172 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.173+0000 7f087a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37 to cache LRU end 2024-09-12T00:53:04.172 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.173+0000 7f087a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:04.173 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.174+0000 7f0999cbb800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37]): orig_sources= new_sources= 2024-09-12T00:53:04.173 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.174+0000 7f0999cbb800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37]): potential sources added=[] removed=[] 2024-09-12T00:53:04.173 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.174+0000 7f0999cbb800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37]): orig_dests= new_dests= 2024-09-12T00:53:04.173 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.174+0000 7f0999cbb800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37]): potential dests added=[] removed=[] 2024-09-12T00:53:04.173 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.174+0000 7f0999cbb800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" canceled due to errors 2024-09-12T00:53:04.176 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.177+0000 7f084e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:04.178 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.179+0000 7f0999cbb800 20 remove_watcher() i=0 2024-09-12T00:53:04.178 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.179+0000 7f0999cbb800 2 removed watcher, disabling cache 2024-09-12T00:53:04.179 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.180+0000 7f0999cbb800 20 remove_watcher() i=1 2024-09-12T00:53:04.180 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.181+0000 7f0999cbb800 20 remove_watcher() i=2 2024-09-12T00:53:04.181 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.183+0000 7f0999cbb800 20 remove_watcher() i=3 2024-09-12T00:53:04.182 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.184+0000 7f0999cbb800 20 remove_watcher() i=4 2024-09-12T00:53:04.183 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.185+0000 7f0999cbb800 20 remove_watcher() i=5 2024-09-12T00:53:04.184 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.186+0000 7f0999cbb800 20 remove_watcher() i=6 2024-09-12T00:53:04.185 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.186+0000 7f0999cbb800 20 remove_watcher() i=7 2024-09-12T00:53:04.197 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:53:04.226 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:04.226 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:04.262 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.263+0000 7f1e5bb2d800 20 rados->read ofs=0 len=0 2024-09-12T00:53:04.264 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.265+0000 7f1e5bb2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:04.264 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.265+0000 7f1e5bb2d800 20 realm 2024-09-12T00:53:04.265 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.265+0000 7f1e5bb2d800 20 rados->read ofs=0 len=0 2024-09-12T00:53:04.265 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.266+0000 7f1e5bb2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:04.265 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.266+0000 7f1e5bb2d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:04.265 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.266+0000 7f1e5bb2d800 20 rados->read ofs=0 len=0 2024-09-12T00:53:04.265 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.266+0000 7f1e5bb2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:04.265 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.266+0000 7f1e5bb2d800 20 rados->read ofs=0 len=0 2024-09-12T00:53:04.265 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.267+0000 7f1e5bb2d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:04.266 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.267+0000 7f1e5bb2d800 20 rados->read ofs=0 len=0 2024-09-12T00:53:04.266 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.268+0000 7f1e5bb2d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:04.266 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.268+0000 7f1e5bb2d800 20 searching for the correct realm 2024-09-12T00:53:04.268 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.270+0000 7f1e58077640 0 -- 172.21.15.73:0/1524790164 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f1e4007a040 msgr2=0x7f1e40061400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:04.475 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.477+0000 7f1e58077640 0 -- 172.21.15.73:0/1524790164 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f1e4007a040 msgr2=0x7f1e40061400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:04.479 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.480+0000 7f1e5bb2d800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:53:04.479 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.480+0000 7f1e5bb2d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:04.479 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.480+0000 7f1e5bb2d800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:53:04.479 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.480+0000 7f1e5bb2d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:04.479 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.480+0000 7f1e5bb2d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:04.479 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.480+0000 7f1e5bb2d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:04.479 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.480+0000 7f1e5bb2d800 20 rados->read ofs=0 len=0 2024-09-12T00:53:04.479 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.480+0000 7f1e5bb2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:04.480 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.480+0000 7f1e5bb2d800 20 rados->read ofs=0 len=0 2024-09-12T00:53:04.481 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.481+0000 7f1e5bb2d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:04.481 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.481+0000 7f1e5bb2d800 20 rados->read ofs=0 len=0 2024-09-12T00:53:04.481 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.481+0000 7f1e5bb2d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:04.481 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.481+0000 7f1e5bb2d800 20 zone default found 2024-09-12T00:53:04.481 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.481+0000 7f1e5bb2d800 4 Realm: () 2024-09-12T00:53:04.481 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.481+0000 7f1e5bb2d800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:53:04.481 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.481+0000 7f1e5bb2d800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:53:04.481 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.481+0000 7f1e5bb2d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:04.481 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.481+0000 7f1e5bb2d800 20 zonegroup default 2024-09-12T00:53:04.482 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.481+0000 7f1e5bb2d800 20 rados->read ofs=0 len=0 2024-09-12T00:53:04.482 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.481+0000 7f1e5bb2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:04.482 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.481+0000 7f1e5bb2d800 20 rados->read ofs=0 len=0 2024-09-12T00:53:04.482 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.482+0000 7f1e5bb2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:04.482 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.482+0000 7f1e5bb2d800 20 rados->read ofs=0 len=0 2024-09-12T00:53:04.482 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.482+0000 7f1e5bb2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:04.482 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.482+0000 7f1e5bb2d800 20 started sync module instance, tier type = 2024-09-12T00:53:04.482 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.482+0000 7f1e5bb2d800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:53:04.489 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.491+0000 7f1e5bb2d800 20 add_watcher() i=0 2024-09-12T00:53:04.489 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.491+0000 7f1e5bb2d800 20 add_watcher() i=1 2024-09-12T00:53:04.489 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.491+0000 7f1e5bb2d800 20 add_watcher() i=2 2024-09-12T00:53:04.489 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.491+0000 7f1e5bb2d800 20 add_watcher() i=3 2024-09-12T00:53:04.490 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.491+0000 7f1e5bb2d800 20 add_watcher() i=4 2024-09-12T00:53:04.490 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.491+0000 7f1e5bb2d800 20 add_watcher() i=5 2024-09-12T00:53:04.490 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.491+0000 7f1e5bb2d800 20 add_watcher() i=6 2024-09-12T00:53:04.490 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.491+0000 7f1e5bb2d800 20 add_watcher() i=7 2024-09-12T00:53:04.490 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.491+0000 7f1e5bb2d800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:04.491 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.493+0000 7f1d0dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:04.492 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.493+0000 7f1e5bb2d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:04.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.493+0000 7f1e5bb2d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:04.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.493+0000 7f1e5bb2d800 5 note: GC not initialized 2024-09-12T00:53:04.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.494+0000 7f1d0cfe1640 20 reqs_thread_entry: start 2024-09-12T00:53:04.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.494+0000 7f1e5bb2d800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:04.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.494+0000 7f1e5bb2d800 20 Filter name: none 2024-09-12T00:53:04.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.494+0000 7f1c867fc640 20 reqs_thread_entry: start 2024-09-12T00:53:04.493 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.494+0000 7f1e5bb2d800 20 rados->read ofs=0 len=0 2024-09-12T00:53:04.494 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.494+0000 7f1e5bb2d800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:53:04.494 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.494+0000 7f1e5bb2d800 20 rados->read ofs=0 len=0 2024-09-12T00:53:04.495 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.495+0000 7f1e5bb2d800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:53:04.495 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.495+0000 7f1e5bb2d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:04.495 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.495+0000 7f1e5bb2d800 20 rados->read ofs=0 len=0 2024-09-12T00:53:04.495 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.495+0000 7f1e5bb2d800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:53:04.495 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.495+0000 7f1e5bb2d800 20 rados->read ofs=0 len=0 2024-09-12T00:53:04.495 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.495+0000 7f1e5bb2d800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:53:04.495 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.495+0000 7f1e5bb2d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:04.495 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.497+0000 7f1d0dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:04.500 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.499+0000 7f1e5bb2d800 20 remove_watcher() i=0 2024-09-12T00:53:04.500 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.499+0000 7f1e5bb2d800 2 removed watcher, disabling cache 2024-09-12T00:53:04.500 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.500+0000 7f1e5bb2d800 20 remove_watcher() i=1 2024-09-12T00:53:04.500 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.501+0000 7f1e5bb2d800 20 remove_watcher() i=2 2024-09-12T00:53:04.501 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.502+0000 7f1e5bb2d800 20 remove_watcher() i=3 2024-09-12T00:53:04.501 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.503+0000 7f1e5bb2d800 20 remove_watcher() i=4 2024-09-12T00:53:04.502 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.504+0000 7f1e5bb2d800 20 remove_watcher() i=5 2024-09-12T00:53:04.503 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.505+0000 7f1e5bb2d800 20 remove_watcher() i=6 2024-09-12T00:53:04.504 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.506+0000 7f1e5bb2d800 20 remove_watcher() i=7 2024-09-12T00:53:04.514 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:04.514 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:53:04.514 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: error-at-change-reshard-state id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:53:04.514 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:04.516 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:04.516 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:04.548 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:04.548 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:04.605 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:53:04.636 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:04.636 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:04.673 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.675+0000 7f0f2e420800 20 rados->read ofs=0 len=0 2024-09-12T00:53:04.675 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.676+0000 7f0f2e420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:04.675 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.676+0000 7f0f2e420800 20 realm 2024-09-12T00:53:04.675 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.676+0000 7f0f2e420800 20 rados->read ofs=0 len=0 2024-09-12T00:53:04.675 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.676+0000 7f0f2e420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:04.675 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.676+0000 7f0f2e420800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:04.675 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.676+0000 7f0f2e420800 20 rados->read ofs=0 len=0 2024-09-12T00:53:04.675 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.676+0000 7f0f2e420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:04.675 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.676+0000 7f0f2e420800 20 rados->read ofs=0 len=0 2024-09-12T00:53:04.676 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.677+0000 7f0f2e420800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:04.676 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.677+0000 7f0f2e420800 20 rados->read ofs=0 len=0 2024-09-12T00:53:04.677 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.678+0000 7f0f2e420800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:04.677 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.678+0000 7f0f2e420800 20 searching for the correct realm 2024-09-12T00:53:04.679 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.680+0000 7f0f2c70b640 0 -- 172.21.15.73:0/3102688386 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f0f14009040 msgr2=0x7f0f14066400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:53:04.885 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.886+0000 7f0f2c70b640 0 -- 172.21.15.73:0/3102688386 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f0f14009040 msgr2=0x7f0f14066400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:04.889 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.890+0000 7f0f2e420800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:53:04.889 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.890+0000 7f0f2e420800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:04.889 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.890+0000 7f0f2e420800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:53:04.889 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.890+0000 7f0f2e420800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:04.890 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.890+0000 7f0f2e420800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:04.890 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.890+0000 7f0f2e420800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:04.890 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.890+0000 7f0f2e420800 20 rados->read ofs=0 len=0 2024-09-12T00:53:04.890 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.890+0000 7f0f2e420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:04.890 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.890+0000 7f0f2e420800 20 rados->read ofs=0 len=0 2024-09-12T00:53:04.891 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.891+0000 7f0f2e420800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:04.891 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.891+0000 7f0f2e420800 20 rados->read ofs=0 len=0 2024-09-12T00:53:04.891 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.891+0000 7f0f2e420800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:04.891 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.891+0000 7f0f2e420800 20 zone default found 2024-09-12T00:53:04.891 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.891+0000 7f0f2e420800 4 Realm: () 2024-09-12T00:53:04.892 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.891+0000 7f0f2e420800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:53:04.892 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.891+0000 7f0f2e420800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:53:04.892 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.891+0000 7f0f2e420800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:04.892 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.891+0000 7f0f2e420800 20 zonegroup default 2024-09-12T00:53:04.892 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.891+0000 7f0f2e420800 20 rados->read ofs=0 len=0 2024-09-12T00:53:04.892 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.891+0000 7f0f2e420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:04.892 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.891+0000 7f0f2e420800 20 rados->read ofs=0 len=0 2024-09-12T00:53:04.892 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.892+0000 7f0f2e420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:04.892 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.892+0000 7f0f2e420800 20 rados->read ofs=0 len=0 2024-09-12T00:53:04.892 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.892+0000 7f0f2e420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:04.892 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.892+0000 7f0f2e420800 20 started sync module instance, tier type = 2024-09-12T00:53:04.892 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.892+0000 7f0f2e420800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:53:04.900 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.901+0000 7f0f2e420800 20 add_watcher() i=0 2024-09-12T00:53:04.900 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.901+0000 7f0f2e420800 20 add_watcher() i=1 2024-09-12T00:53:04.900 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.901+0000 7f0f2e420800 20 add_watcher() i=2 2024-09-12T00:53:04.900 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.901+0000 7f0f2e420800 20 add_watcher() i=3 2024-09-12T00:53:04.900 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.901+0000 7f0f2e420800 20 add_watcher() i=4 2024-09-12T00:53:04.900 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.901+0000 7f0f2e420800 20 add_watcher() i=5 2024-09-12T00:53:04.900 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.901+0000 7f0f2e420800 20 add_watcher() i=6 2024-09-12T00:53:04.901 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.902+0000 7f0f2e420800 20 add_watcher() i=7 2024-09-12T00:53:04.901 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.902+0000 7f0f2e420800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:04.903 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.904+0000 7f0de1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:04.904 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.904+0000 7f0f2e420800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:04.904 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.904+0000 7f0f2e420800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:04.904 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.904+0000 7f0f2e420800 5 note: GC not initialized 2024-09-12T00:53:04.904 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.904+0000 7f0de0fe1640 20 reqs_thread_entry: start 2024-09-12T00:53:04.904 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.904+0000 7f0f2e420800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:04.904 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.905+0000 7f0f2e420800 20 Filter name: none 2024-09-12T00:53:04.904 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.905+0000 7f0d5a7fc640 20 reqs_thread_entry: start 2024-09-12T00:53:04.904 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.905+0000 7f0f2e420800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T00:53:04.904 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.905+0000 7f0f2e420800 20 rados->read ofs=0 len=0 2024-09-12T00:53:04.905 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.905+0000 7f0f2e420800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:53:04.905 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.905+0000 7f0f2e420800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T00:53:04.905 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.905+0000 7f0f2e420800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T00:53:04.905 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.905+0000 7f0f2e420800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37 : miss 2024-09-12T00:53:04.905 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.905+0000 7f0f2e420800 20 rados->read ofs=0 len=0 2024-09-12T00:53:04.905 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.906+0000 7f0f2e420800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:53:04.905 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.906+0000 7f0f2e420800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37 info.flags=0x17 2024-09-12T00:53:04.905 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.906+0000 7f0f2e420800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37 to cache LRU end 2024-09-12T00:53:04.906 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.906+0000 7f0f2e420800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:53:04.906 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.906+0000 7f0f2e420800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:04.906 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.906+0000 7f0f2e420800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37 2024-09-12T00:53:04.908 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.909+0000 7f0f2e420800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37 info.flags=0x17 2024-09-12T00:53:04.908 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.909+0000 7f0f2e420800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37 to cache LRU end 2024-09-12T00:53:04.908 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.909+0000 7f0f2e420800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:04.909 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.909+0000 7f0f2e420800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37, ofs0, ns] 2024-09-12T00:53:04.909 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.910+0000 7f0e0affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497032 cookie 94329065731472 notifier 7427 bl.length()=931 2024-09-12T00:53:04.909 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.910+0000 7f0e0affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37 info.flags=0x17 2024-09-12T00:53:04.909 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.910+0000 7f0e0affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37 to cache LRU end 2024-09-12T00:53:04.909 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.910+0000 7f0e0affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:04.910 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.911+0000 7f0e0a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497033 cookie 94329065731472 notifier 7427 bl.length()=931 2024-09-12T00:53:04.910 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.911+0000 7f0e0a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37 info.flags=0x17 2024-09-12T00:53:04.910 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.911+0000 7f0e0a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37 to cache LRU end 2024-09-12T00:53:04.910 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.911+0000 7f0e0a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:04.911 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.913+0000 7f0f2e420800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37]): orig_sources= new_sources= 2024-09-12T00:53:04.911 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.913+0000 7f0f2e420800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37]): potential sources added=[] removed=[] 2024-09-12T00:53:04.911 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.913+0000 7f0f2e420800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37]): orig_dests= new_dests= 2024-09-12T00:53:04.911 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.913+0000 7f0f2e420800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37]): potential dests added=[] removed=[] 2024-09-12T00:53:04.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.915+0000 7f0f2e420800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37.1.0 2024-09-12T00:53:04.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.915+0000 7f0f2e420800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37.1.0 2024-09-12T00:53:04.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.915+0000 7f0f2e420800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37.1.1 2024-09-12T00:53:04.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.915+0000 7f0f2e420800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37.1.1 2024-09-12T00:53:04.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.915+0000 7f0f2e420800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37.0 2024-09-12T00:53:04.916 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.918+0000 7f0f2e420800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37 : hit (requested=0x17, cached=0x17) 2024-09-12T00:53:04.916 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.918+0000 7f0f2e420800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37 2024-09-12T00:53:04.918 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.919+0000 7f0f2e420800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37 info.flags=0x17 2024-09-12T00:53:04.918 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.919+0000 7f0f2e420800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37 to cache LRU end 2024-09-12T00:53:04.918 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.919+0000 7f0f2e420800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:04.918 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.919+0000 7f0f2e420800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37, ofs0, ns] 2024-09-12T00:53:04.918 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.919+0000 7f0e0a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497034 cookie 94329065731472 notifier 7427 bl.length()=931 2024-09-12T00:53:04.918 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.919+0000 7f0e0a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37 info.flags=0x17 2024-09-12T00:53:04.918 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.919+0000 7f0e0a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37 to cache LRU end 2024-09-12T00:53:04.918 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.919+0000 7f0e0a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:04.919 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.921+0000 7f0f2e420800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37]): orig_sources= new_sources= 2024-09-12T00:53:04.919 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.921+0000 7f0f2e420800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37]): potential sources added=[] removed=[] 2024-09-12T00:53:04.919 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.921+0000 7f0f2e420800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37]): orig_dests= new_dests= 2024-09-12T00:53:04.919 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.921+0000 7f0f2e420800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37]): potential dests added=[] removed=[] 2024-09-12T00:53:04.920 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.922+0000 7f0f2e420800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37.0 2024-09-12T00:53:04.921 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.922+0000 7f0f2e420800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37 : hit (requested=0x17, cached=0x17) 2024-09-12T00:53:04.921 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.922+0000 7f0f2e420800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37 2024-09-12T00:53:04.922 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.923+0000 7f0f2e420800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37 info.flags=0x17 2024-09-12T00:53:04.922 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.923+0000 7f0f2e420800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37 to cache LRU end 2024-09-12T00:53:04.922 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.923+0000 7f0f2e420800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:04.922 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.923+0000 7f0f2e420800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37, ofs0, ns] 2024-09-12T00:53:04.923 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.924+0000 7f0e0a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497035 cookie 94329065731472 notifier 7427 bl.length()=899 2024-09-12T00:53:04.923 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.924+0000 7f0e0a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37 info.flags=0x17 2024-09-12T00:53:04.923 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.924+0000 7f0e0a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37 to cache LRU end 2024-09-12T00:53:04.923 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.924+0000 7f0e0a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:04.923 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.925+0000 7f0f2e420800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37]): orig_sources= new_sources= 2024-09-12T00:53:04.923 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.925+0000 7f0f2e420800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37]): potential sources added=[] removed=[] 2024-09-12T00:53:04.924 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.925+0000 7f0f2e420800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37]): orig_dests= new_dests= 2024-09-12T00:53:04.924 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.925+0000 7f0f2e420800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37]): potential dests added=[] removed=[] 2024-09-12T00:53:04.925 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.926+0000 7f0f2e420800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 1 shards to 2 shards completed successfully 2024-09-12T00:53:04.927 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.928+0000 7f0de1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:04.929 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.931+0000 7f0f2e420800 20 remove_watcher() i=0 2024-09-12T00:53:04.929 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.931+0000 7f0f2e420800 2 removed watcher, disabling cache 2024-09-12T00:53:04.930 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.932+0000 7f0f2e420800 20 remove_watcher() i=1 2024-09-12T00:53:04.931 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.933+0000 7f0f2e420800 20 remove_watcher() i=2 2024-09-12T00:53:04.932 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.934+0000 7f0f2e420800 20 remove_watcher() i=3 2024-09-12T00:53:04.934 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.935+0000 7f0f2e420800 20 remove_watcher() i=4 2024-09-12T00:53:04.934 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.936+0000 7f0f2e420800 20 remove_watcher() i=5 2024-09-12T00:53:04.935 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.937+0000 7f0f2e420800 20 remove_watcher() i=6 2024-09-12T00:53:04.936 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:04.938+0000 7f0f2e420800 20 remove_watcher() i=7 2024-09-12T00:53:04.948 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:53:04.977 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:04.977 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:05.013 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.014+0000 7f0f67e13800 20 rados->read ofs=0 len=0 2024-09-12T00:53:05.015 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.016+0000 7f0f67e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:05.015 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.016+0000 7f0f67e13800 20 realm 2024-09-12T00:53:05.015 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.016+0000 7f0f67e13800 20 rados->read ofs=0 len=0 2024-09-12T00:53:05.015 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.016+0000 7f0f67e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:05.015 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.016+0000 7f0f67e13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:05.015 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.016+0000 7f0f67e13800 20 rados->read ofs=0 len=0 2024-09-12T00:53:05.016 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.016+0000 7f0f67e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:05.016 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.016+0000 7f0f67e13800 20 rados->read ofs=0 len=0 2024-09-12T00:53:05.016 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.017+0000 7f0f67e13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:05.016 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.017+0000 7f0f67e13800 20 rados->read ofs=0 len=0 2024-09-12T00:53:05.017 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.018+0000 7f0f67e13800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:05.017 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.018+0000 7f0f67e13800 20 searching for the correct realm 2024-09-12T00:53:05.020 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.021+0000 7f0f63d23640 0 -- 172.21.15.73:0/4264210876 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f0f4c022040 msgr2=0x7f0f4c037430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:05.023 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.025+0000 7f0f5bfff640 0 -- 172.21.15.73:0/4264210876 >> [v2:172.21.15.117:6800/110688882,v1:172.21.15.117:6801/110688882] conn(0x55ba4b096480 msgr2=0x55ba4b098870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:05.027 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.028+0000 7f0f67e13800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:53:05.027 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.028+0000 7f0f67e13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:05.027 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.028+0000 7f0f67e13800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:53:05.027 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.028+0000 7f0f67e13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:05.027 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.028+0000 7f0f67e13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:05.028 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.028+0000 7f0f67e13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:05.028 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.028+0000 7f0f67e13800 20 rados->read ofs=0 len=0 2024-09-12T00:53:05.028 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.028+0000 7f0f67e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:05.028 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.028+0000 7f0f67e13800 20 rados->read ofs=0 len=0 2024-09-12T00:53:05.028 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.029+0000 7f0f67e13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:05.028 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.029+0000 7f0f67e13800 20 rados->read ofs=0 len=0 2024-09-12T00:53:05.029 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.029+0000 7f0f67e13800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:05.029 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.029+0000 7f0f67e13800 20 zone default found 2024-09-12T00:53:05.029 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.029+0000 7f0f67e13800 4 Realm: () 2024-09-12T00:53:05.029 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.029+0000 7f0f67e13800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:53:05.029 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.029+0000 7f0f67e13800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:53:05.029 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.029+0000 7f0f67e13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:05.030 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.029+0000 7f0f67e13800 20 zonegroup default 2024-09-12T00:53:05.030 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.029+0000 7f0f67e13800 20 rados->read ofs=0 len=0 2024-09-12T00:53:05.030 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.029+0000 7f0f67e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:05.030 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.029+0000 7f0f67e13800 20 rados->read ofs=0 len=0 2024-09-12T00:53:05.030 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.030+0000 7f0f67e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:05.030 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.030+0000 7f0f67e13800 20 rados->read ofs=0 len=0 2024-09-12T00:53:05.030 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.030+0000 7f0f67e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:05.030 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.030+0000 7f0f67e13800 20 started sync module instance, tier type = 2024-09-12T00:53:05.030 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.030+0000 7f0f67e13800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:53:05.037 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.039+0000 7f0f67e13800 20 add_watcher() i=0 2024-09-12T00:53:05.037 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.039+0000 7f0f67e13800 20 add_watcher() i=1 2024-09-12T00:53:05.037 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.039+0000 7f0f67e13800 20 add_watcher() i=2 2024-09-12T00:53:05.037 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.039+0000 7f0f67e13800 20 add_watcher() i=3 2024-09-12T00:53:05.037 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.039+0000 7f0f67e13800 20 add_watcher() i=4 2024-09-12T00:53:05.038 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.039+0000 7f0f67e13800 20 add_watcher() i=5 2024-09-12T00:53:05.038 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.039+0000 7f0f67e13800 20 add_watcher() i=6 2024-09-12T00:53:05.038 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.039+0000 7f0f67e13800 20 add_watcher() i=7 2024-09-12T00:53:05.038 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.039+0000 7f0f67e13800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:05.040 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.041+0000 7f0e19fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:05.041 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.041+0000 7f0f67e13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:05.041 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.041+0000 7f0f67e13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:05.041 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.041+0000 7f0f67e13800 5 note: GC not initialized 2024-09-12T00:53:05.041 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.042+0000 7f0e18fe1640 20 reqs_thread_entry: start 2024-09-12T00:53:05.041 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.042+0000 7f0f67e13800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:05.041 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.042+0000 7f0f67e13800 20 Filter name: none 2024-09-12T00:53:05.041 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.042+0000 7f0d927fc640 20 reqs_thread_entry: start 2024-09-12T00:53:05.041 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.042+0000 7f0f67e13800 20 rados->read ofs=0 len=0 2024-09-12T00:53:05.042 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.042+0000 7f0f67e13800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:53:05.042 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.042+0000 7f0f67e13800 20 rados->read ofs=0 len=0 2024-09-12T00:53:05.043 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.043+0000 7f0f67e13800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:53:05.043 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.043+0000 7f0f67e13800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:05.043 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.043+0000 7f0f67e13800 20 rados->read ofs=0 len=0 2024-09-12T00:53:05.043 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.043+0000 7f0f67e13800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:53:05.043 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.043+0000 7f0f67e13800 20 rados->read ofs=0 len=0 2024-09-12T00:53:05.043 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.044+0000 7f0f67e13800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:53:05.043 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.044+0000 7f0f67e13800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:05.043 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.045+0000 7f0e19fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:05.046 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.047+0000 7f0f67e13800 20 remove_watcher() i=0 2024-09-12T00:53:05.046 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.047+0000 7f0f67e13800 2 removed watcher, disabling cache 2024-09-12T00:53:05.047 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.048+0000 7f0f67e13800 20 remove_watcher() i=1 2024-09-12T00:53:05.047 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.049+0000 7f0f67e13800 20 remove_watcher() i=2 2024-09-12T00:53:05.049 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.050+0000 7f0f67e13800 20 remove_watcher() i=3 2024-09-12T00:53:05.050 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.051+0000 7f0f67e13800 20 remove_watcher() i=4 2024-09-12T00:53:05.050 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.052+0000 7f0f67e13800 20 remove_watcher() i=5 2024-09-12T00:53:05.051 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.053+0000 7f0f67e13800 20 remove_watcher() i=6 2024-09-12T00:53:05.052 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:05.054+0000 7f0f67e13800 20 remove_watcher() i=7 2024-09-12T00:53:05.063 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:05.063 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:53:05.063 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: error-at-change-reshard-state id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:53:05.063 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:05.064 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:05.064 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:05.082 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:05.082 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:05.298 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:05.298 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:05.359 INFO:tasks.workunit.client.0.smithi073.stderr:TEST: reshard bucket with ECANCELED injected at change_reshard_state 2024-09-12T00:53:05.360 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:05.360 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:05.360 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:05.400 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:05.400 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:05.456 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:05.456 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:05.489 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:05.489 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:05.524 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:05.524 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:05.560 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:05.560 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:05.596 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:05.596 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:05.628 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:05.628 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:05.663 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:05.664 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:05.699 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:05.699 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:05.734 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:05.734 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:05.768 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:05.769 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:05.803 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:05.803 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:05.838 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:05.839 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:05.874 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:05.874 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:05.910 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:05.910 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:05.944 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:05.944 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:05.978 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:05.978 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:06.015 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:06.015 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:06.049 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:06.049 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:06.083 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:06.083 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:06.120 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:06.120 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:06.153 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:53:06.180 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:06.180 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:06.217 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.218+0000 7f4a51320800 20 rados->read ofs=0 len=0 2024-09-12T00:53:06.219 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.220+0000 7f4a51320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:06.219 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.220+0000 7f4a51320800 20 realm 2024-09-12T00:53:06.219 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.220+0000 7f4a51320800 20 rados->read ofs=0 len=0 2024-09-12T00:53:06.219 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.220+0000 7f4a51320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:06.219 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.220+0000 7f4a51320800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:06.219 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.220+0000 7f4a51320800 20 rados->read ofs=0 len=0 2024-09-12T00:53:06.219 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.220+0000 7f4a51320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:06.219 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.220+0000 7f4a51320800 20 rados->read ofs=0 len=0 2024-09-12T00:53:06.220 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.221+0000 7f4a51320800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:06.220 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.221+0000 7f4a51320800 20 rados->read ofs=0 len=0 2024-09-12T00:53:06.221 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.222+0000 7f4a51320800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:06.221 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.222+0000 7f4a51320800 20 searching for the correct realm 2024-09-12T00:53:06.223 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.224+0000 7f4a47fff640 0 -- 172.21.15.73:0/3830565569 >> [v2:172.21.15.73:6826/269690776,v1:172.21.15.73:6827/269690776] conn(0x7f4a4007c030 msgr2=0x7f4a4009b400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:06.226 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.228+0000 7f4a4cf02640 0 -- 172.21.15.73:0/3830565569 >> [v2:172.21.15.73:6810/1807760270,v1:172.21.15.73:6811/1807760270] conn(0x7f4a48085b60 msgr2=0x7f4a480218a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:06.433 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.434+0000 7f4a51320800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:53:06.433 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.434+0000 7f4a51320800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:06.433 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.434+0000 7f4a51320800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:53:06.434 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.434+0000 7f4a51320800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:06.434 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.434+0000 7f4a51320800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:06.434 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.434+0000 7f4a51320800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:06.434 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.434+0000 7f4a51320800 20 rados->read ofs=0 len=0 2024-09-12T00:53:06.434 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.435+0000 7f4a51320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:06.434 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.435+0000 7f4a51320800 20 rados->read ofs=0 len=0 2024-09-12T00:53:06.435 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.435+0000 7f4a51320800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:06.435 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.435+0000 7f4a51320800 20 rados->read ofs=0 len=0 2024-09-12T00:53:06.435 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.435+0000 7f4a51320800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:06.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.435+0000 7f4a51320800 20 zone default found 2024-09-12T00:53:06.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.435+0000 7f4a51320800 4 Realm: () 2024-09-12T00:53:06.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.435+0000 7f4a51320800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:53:06.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.435+0000 7f4a51320800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:53:06.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.435+0000 7f4a51320800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:06.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.435+0000 7f4a51320800 20 zonegroup default 2024-09-12T00:53:06.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.435+0000 7f4a51320800 20 rados->read ofs=0 len=0 2024-09-12T00:53:06.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.435+0000 7f4a51320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:06.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.435+0000 7f4a51320800 20 rados->read ofs=0 len=0 2024-09-12T00:53:06.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.436+0000 7f4a51320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:06.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.436+0000 7f4a51320800 20 rados->read ofs=0 len=0 2024-09-12T00:53:06.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.436+0000 7f4a51320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:06.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.436+0000 7f4a51320800 20 started sync module instance, tier type = 2024-09-12T00:53:06.437 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.436+0000 7f4a51320800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:53:06.444 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.445+0000 7f4a51320800 20 add_watcher() i=0 2024-09-12T00:53:06.444 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.445+0000 7f4a51320800 20 add_watcher() i=1 2024-09-12T00:53:06.444 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.445+0000 7f4a51320800 20 add_watcher() i=2 2024-09-12T00:53:06.444 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.445+0000 7f4a51320800 20 add_watcher() i=3 2024-09-12T00:53:06.444 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.445+0000 7f4a51320800 20 add_watcher() i=4 2024-09-12T00:53:06.444 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.445+0000 7f4a51320800 20 add_watcher() i=5 2024-09-12T00:53:06.444 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.445+0000 7f4a51320800 20 add_watcher() i=6 2024-09-12T00:53:06.445 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.446+0000 7f4a51320800 20 add_watcher() i=7 2024-09-12T00:53:06.445 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.446+0000 7f4a51320800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:06.447 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.448+0000 7f4902fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:06.448 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.448+0000 7f4a51320800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:06.448 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.448+0000 7f4a51320800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:06.448 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.448+0000 7f4a51320800 5 note: GC not initialized 2024-09-12T00:53:06.448 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.448+0000 7f4901fe3640 20 reqs_thread_entry: start 2024-09-12T00:53:06.448 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.448+0000 7f4a51320800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:06.448 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.449+0000 7f4a51320800 20 Filter name: none 2024-09-12T00:53:06.448 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.449+0000 7f48737fe640 20 reqs_thread_entry: start 2024-09-12T00:53:06.448 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.449+0000 7f4a51320800 20 rados->read ofs=0 len=0 2024-09-12T00:53:06.449 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.449+0000 7f4a51320800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:53:06.449 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.449+0000 7f4a51320800 20 rados->read ofs=0 len=0 2024-09-12T00:53:06.450 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.450+0000 7f4a51320800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:53:06.450 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.450+0000 7f4a51320800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:06.450 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.450+0000 7f4a51320800 20 rados->read ofs=0 len=0 2024-09-12T00:53:06.450 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.450+0000 7f4a51320800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:53:06.450 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.450+0000 7f4a51320800 20 rados->read ofs=0 len=0 2024-09-12T00:53:06.450 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.451+0000 7f4a51320800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:53:06.450 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.451+0000 7f4a51320800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:06.451 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.452+0000 7f4902fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:06.453 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.454+0000 7f4a51320800 20 remove_watcher() i=0 2024-09-12T00:53:06.453 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.454+0000 7f4a51320800 2 removed watcher, disabling cache 2024-09-12T00:53:06.454 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.455+0000 7f4a51320800 20 remove_watcher() i=1 2024-09-12T00:53:06.455 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.456+0000 7f4a51320800 20 remove_watcher() i=2 2024-09-12T00:53:06.456 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.457+0000 7f4a51320800 20 remove_watcher() i=3 2024-09-12T00:53:06.457 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.458+0000 7f4a51320800 20 remove_watcher() i=4 2024-09-12T00:53:06.458 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.459+0000 7f4a51320800 20 remove_watcher() i=5 2024-09-12T00:53:06.459 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.460+0000 7f4a51320800 20 remove_watcher() i=6 2024-09-12T00:53:06.460 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.461+0000 7f4a51320800 20 remove_watcher() i=7 2024-09-12T00:53:06.470 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:06.470 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:53:06.470 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: error-at-change-reshard-state id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:53:06.470 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:06.472 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state --inject-error-code 125 2024-09-12T00:53:06.507 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:06.508 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:06.544 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.545+0000 7f3e7f375800 20 rados->read ofs=0 len=0 2024-09-12T00:53:06.546 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.547+0000 7f3e7f375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:06.546 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.547+0000 7f3e7f375800 20 realm 2024-09-12T00:53:06.546 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.547+0000 7f3e7f375800 20 rados->read ofs=0 len=0 2024-09-12T00:53:06.547 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.547+0000 7f3e7f375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:06.547 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.547+0000 7f3e7f375800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:06.547 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.547+0000 7f3e7f375800 20 rados->read ofs=0 len=0 2024-09-12T00:53:06.547 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.548+0000 7f3e7f375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:06.547 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.548+0000 7f3e7f375800 20 rados->read ofs=0 len=0 2024-09-12T00:53:06.547 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.549+0000 7f3e7f375800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:06.548 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.549+0000 7f3e7f375800 20 rados->read ofs=0 len=0 2024-09-12T00:53:06.548 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.549+0000 7f3e7f375800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:06.548 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.549+0000 7f3e7f375800 20 searching for the correct realm 2024-09-12T00:53:06.551 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.552+0000 7f3e7d660640 0 -- 172.21.15.73:0/2860817117 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f3e680c2040 msgr2=0x7f3e680a3480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:06.555 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.556+0000 7f3e77fff640 0 -- 172.21.15.73:0/2860817117 >> [v2:172.21.15.117:6800/110688882,v1:172.21.15.117:6801/110688882] conn(0x564ff8e547e0 msgr2=0x564ff8e56bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:06.559 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.560+0000 7f3e7f375800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:53:06.560 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.560+0000 7f3e7f375800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:06.560 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.560+0000 7f3e7f375800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:53:06.560 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.560+0000 7f3e7f375800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:06.560 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.560+0000 7f3e7f375800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:06.560 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.560+0000 7f3e7f375800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:06.560 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.560+0000 7f3e7f375800 20 rados->read ofs=0 len=0 2024-09-12T00:53:06.560 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.560+0000 7f3e7f375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:06.560 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.560+0000 7f3e7f375800 20 rados->read ofs=0 len=0 2024-09-12T00:53:06.560 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.560+0000 7f3e7f375800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:06.560 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.560+0000 7f3e7f375800 20 rados->read ofs=0 len=0 2024-09-12T00:53:06.560 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.561+0000 7f3e7f375800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:06.561 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.561+0000 7f3e7f375800 20 zone default found 2024-09-12T00:53:06.561 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.561+0000 7f3e7f375800 4 Realm: () 2024-09-12T00:53:06.561 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.561+0000 7f3e7f375800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:53:06.561 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.561+0000 7f3e7f375800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:53:06.561 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.561+0000 7f3e7f375800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:06.561 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.561+0000 7f3e7f375800 20 zonegroup default 2024-09-12T00:53:06.561 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.561+0000 7f3e7f375800 20 rados->read ofs=0 len=0 2024-09-12T00:53:06.561 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.561+0000 7f3e7f375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:06.561 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.561+0000 7f3e7f375800 20 rados->read ofs=0 len=0 2024-09-12T00:53:06.562 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.561+0000 7f3e7f375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:06.562 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.561+0000 7f3e7f375800 20 rados->read ofs=0 len=0 2024-09-12T00:53:06.562 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.561+0000 7f3e7f375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:06.562 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.562+0000 7f3e7f375800 20 started sync module instance, tier type = 2024-09-12T00:53:06.562 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.562+0000 7f3e7f375800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:53:06.570 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.571+0000 7f3e7f375800 20 add_watcher() i=0 2024-09-12T00:53:06.570 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.571+0000 7f3e7f375800 20 add_watcher() i=1 2024-09-12T00:53:06.570 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.571+0000 7f3e7f375800 20 add_watcher() i=2 2024-09-12T00:53:06.570 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.571+0000 7f3e7f375800 20 add_watcher() i=3 2024-09-12T00:53:06.570 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.571+0000 7f3e7f375800 20 add_watcher() i=4 2024-09-12T00:53:06.570 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.571+0000 7f3e7f375800 20 add_watcher() i=5 2024-09-12T00:53:06.570 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.571+0000 7f3e7f375800 20 add_watcher() i=6 2024-09-12T00:53:06.571 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.572+0000 7f3e7f375800 20 add_watcher() i=7 2024-09-12T00:53:06.571 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.572+0000 7f3e7f375800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:06.572 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.573+0000 7f3d337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:06.573 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.573+0000 7f3e7f375800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:06.573 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.573+0000 7f3e7f375800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:06.573 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.574+0000 7f3e7f375800 5 note: GC not initialized 2024-09-12T00:53:06.573 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.574+0000 7f3d327e4640 20 reqs_thread_entry: start 2024-09-12T00:53:06.573 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.574+0000 7f3e7f375800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:06.573 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.574+0000 7f3e7f375800 20 Filter name: none 2024-09-12T00:53:06.573 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.574+0000 7f3d2bfff640 20 reqs_thread_entry: start 2024-09-12T00:53:06.573 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.574+0000 7f3e7f375800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T00:53:06.574 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.574+0000 7f3e7f375800 20 rados->read ofs=0 len=0 2024-09-12T00:53:06.574 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.575+0000 7f3e7f375800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:53:06.574 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.575+0000 7f3e7f375800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T00:53:06.574 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.575+0000 7f3e7f375800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T00:53:06.575 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.575+0000 7f3e7f375800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38 : miss 2024-09-12T00:53:06.575 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.575+0000 7f3e7f375800 20 rados->read ofs=0 len=0 2024-09-12T00:53:06.575 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.575+0000 7f3e7f375800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:53:06.575 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.575+0000 7f3e7f375800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38 info.flags=0x17 2024-09-12T00:53:06.575 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.575+0000 7f3e7f375800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38 to cache LRU end 2024-09-12T00:53:06.575 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.575+0000 7f3e7f375800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:53:06.575 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.575+0000 7f3e7f375800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:06.575 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.575+0000 7f3e7f375800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38 2024-09-12T00:53:06.577 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.579+0000 7f3e7f375800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38 info.flags=0x17 2024-09-12T00:53:06.577 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.579+0000 7f3e7f375800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38 to cache LRU end 2024-09-12T00:53:06.577 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.579+0000 7f3e7f375800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:06.577 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.579+0000 7f3e7f375800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38, ofs0, ns] 2024-09-12T00:53:06.578 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.579+0000 7f3d53fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497038 cookie 94901478189024 notifier 7965 bl.length()=931 2024-09-12T00:53:06.578 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.579+0000 7f3d53fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38 info.flags=0x17 2024-09-12T00:53:06.578 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.579+0000 7f3d53fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38 to cache LRU end 2024-09-12T00:53:06.578 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.579+0000 7f3d53fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:06.579 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.581+0000 7f3e7f375800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38]): orig_sources= new_sources= 2024-09-12T00:53:06.579 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.581+0000 7f3e7f375800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38]): potential sources added=[] removed=[] 2024-09-12T00:53:06.579 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.581+0000 7f3e7f375800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38]): orig_dests= new_dests= 2024-09-12T00:53:06.579 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.581+0000 7f3e7f375800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38]): potential dests added=[] removed=[] 2024-09-12T00:53:06.581 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.583+0000 7f3e7f375800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38.1.0 2024-09-12T00:53:06.581 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.583+0000 7f3e7f375800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38.1.0 2024-09-12T00:53:06.582 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.583+0000 7f3e7f375800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38.1.1 2024-09-12T00:53:06.582 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.583+0000 7f3e7f375800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38.1.1 2024-09-12T00:53:06.582 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.583+0000 7f3e7f375800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38.0 2024-09-12T00:53:06.584 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.585+0000 7f3e7f375800 -1 Injecting error=-125 at location=change_reshard_state 2024-09-12T00:53:06.584 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.585+0000 7f3e7f375800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38 : hit (requested=0x17, cached=0x17) 2024-09-12T00:53:06.584 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.585+0000 7f3e7f375800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38 2024-09-12T00:53:06.585 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.586+0000 7f3e7f375800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38 info.flags=0x17 2024-09-12T00:53:06.585 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.586+0000 7f3e7f375800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38 to cache LRU end 2024-09-12T00:53:06.585 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.586+0000 7f3e7f375800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:06.585 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.586+0000 7f3e7f375800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38, ofs0, ns] 2024-09-12T00:53:06.585 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.586+0000 7f3d53fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497039 cookie 94901478189024 notifier 7965 bl.length()=931 2024-09-12T00:53:06.585 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.587+0000 7f3d53fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38 info.flags=0x17 2024-09-12T00:53:06.586 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.587+0000 7f3d53fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38 to cache LRU end 2024-09-12T00:53:06.586 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.587+0000 7f3d53fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:06.586 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.588+0000 7f3e7f375800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38]): orig_sources= new_sources= 2024-09-12T00:53:06.586 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.588+0000 7f3e7f375800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38]): potential sources added=[] removed=[] 2024-09-12T00:53:06.587 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.588+0000 7f3e7f375800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38]): orig_dests= new_dests= 2024-09-12T00:53:06.587 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.588+0000 7f3e7f375800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38]): potential dests added=[] removed=[] 2024-09-12T00:53:06.587 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.589+0000 7f3e7f375800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38.0 2024-09-12T00:53:06.588 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.589+0000 7f3e7f375800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38 : hit (requested=0x17, cached=0x17) 2024-09-12T00:53:06.588 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.589+0000 7f3e7f375800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38 2024-09-12T00:53:06.589 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.590+0000 7f3e7f375800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38 info.flags=0x17 2024-09-12T00:53:06.589 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.590+0000 7f3e7f375800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38 to cache LRU end 2024-09-12T00:53:06.589 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.590+0000 7f3e7f375800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:06.589 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.590+0000 7f3e7f375800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38, ofs0, ns] 2024-09-12T00:53:06.590 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.591+0000 7f3d537fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497040 cookie 94901478189024 notifier 7965 bl.length()=899 2024-09-12T00:53:06.590 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.591+0000 7f3d537fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38 info.flags=0x17 2024-09-12T00:53:06.590 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.591+0000 7f3d537fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38 to cache LRU end 2024-09-12T00:53:06.590 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.591+0000 7f3d537fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:06.591 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.592+0000 7f3e7f375800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38]): orig_sources= new_sources= 2024-09-12T00:53:06.591 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.592+0000 7f3e7f375800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38]): potential sources added=[] removed=[] 2024-09-12T00:53:06.591 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.592+0000 7f3e7f375800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38]): orig_dests= new_dests= 2024-09-12T00:53:06.591 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.592+0000 7f3e7f375800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38]): potential dests added=[] removed=[] 2024-09-12T00:53:06.592 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.593+0000 7f3e7f375800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 1 shards to 2 shards completed successfully 2024-09-12T00:53:06.593 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.595+0000 7f3d337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:06.596 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.597+0000 7f3e7f375800 20 remove_watcher() i=0 2024-09-12T00:53:06.596 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.597+0000 7f3e7f375800 2 removed watcher, disabling cache 2024-09-12T00:53:06.597 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.598+0000 7f3e7f375800 20 remove_watcher() i=1 2024-09-12T00:53:06.598 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.599+0000 7f3e7f375800 20 remove_watcher() i=2 2024-09-12T00:53:06.599 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.600+0000 7f3e7f375800 20 remove_watcher() i=3 2024-09-12T00:53:06.599 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.601+0000 7f3e7f375800 20 remove_watcher() i=4 2024-09-12T00:53:06.600 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.602+0000 7f3e7f375800 20 remove_watcher() i=5 2024-09-12T00:53:06.601 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.603+0000 7f3e7f375800 20 remove_watcher() i=6 2024-09-12T00:53:06.602 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.604+0000 7f3e7f375800 20 remove_watcher() i=7 2024-09-12T00:53:06.614 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:53:06.643 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:06.643 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:06.680 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.681+0000 7fa4ed013800 20 rados->read ofs=0 len=0 2024-09-12T00:53:06.681 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.682+0000 7fa4ed013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:06.682 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.683+0000 7fa4ed013800 20 realm 2024-09-12T00:53:06.682 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.683+0000 7fa4ed013800 20 rados->read ofs=0 len=0 2024-09-12T00:53:06.682 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.683+0000 7fa4ed013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:06.682 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.683+0000 7fa4ed013800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:06.682 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.683+0000 7fa4ed013800 20 rados->read ofs=0 len=0 2024-09-12T00:53:06.682 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.683+0000 7fa4ed013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:06.682 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.683+0000 7fa4ed013800 20 rados->read ofs=0 len=0 2024-09-12T00:53:06.682 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.684+0000 7fa4ed013800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:06.682 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.684+0000 7fa4ed013800 20 rados->read ofs=0 len=0 2024-09-12T00:53:06.683 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.685+0000 7fa4ed013800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:06.683 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.685+0000 7fa4ed013800 20 searching for the correct realm 2024-09-12T00:53:06.887 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:06.889+0000 7fa4e8f23640 0 -- 172.21.15.73:0/561723902 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fa4d000b040 msgr2=0x7fa4d0054410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:53:07.094 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.095+0000 7fa4e8f23640 0 -- 172.21.15.73:0/561723902 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fa4d000b040 msgr2=0x7fa4d0054410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:07.098 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.100+0000 7fa4ed013800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:53:07.099 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.100+0000 7fa4ed013800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:07.099 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.100+0000 7fa4ed013800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:53:07.099 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.100+0000 7fa4ed013800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:07.099 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.100+0000 7fa4ed013800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:07.099 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.100+0000 7fa4ed013800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:07.099 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.100+0000 7fa4ed013800 20 rados->read ofs=0 len=0 2024-09-12T00:53:07.099 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.100+0000 7fa4ed013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:07.099 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.100+0000 7fa4ed013800 20 rados->read ofs=0 len=0 2024-09-12T00:53:07.100 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.100+0000 7fa4ed013800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:07.101 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.100+0000 7fa4ed013800 20 rados->read ofs=0 len=0 2024-09-12T00:53:07.101 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.100+0000 7fa4ed013800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:07.101 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.100+0000 7fa4ed013800 20 zone default found 2024-09-12T00:53:07.101 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.101+0000 7fa4ed013800 4 Realm: () 2024-09-12T00:53:07.101 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.101+0000 7fa4ed013800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:53:07.101 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.101+0000 7fa4ed013800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:53:07.101 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.101+0000 7fa4ed013800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:07.101 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.101+0000 7fa4ed013800 20 zonegroup default 2024-09-12T00:53:07.101 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.101+0000 7fa4ed013800 20 rados->read ofs=0 len=0 2024-09-12T00:53:07.101 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.101+0000 7fa4ed013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:07.101 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.101+0000 7fa4ed013800 20 rados->read ofs=0 len=0 2024-09-12T00:53:07.101 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.101+0000 7fa4ed013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:07.101 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.101+0000 7fa4ed013800 20 rados->read ofs=0 len=0 2024-09-12T00:53:07.102 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.101+0000 7fa4ed013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:07.102 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.101+0000 7fa4ed013800 20 started sync module instance, tier type = 2024-09-12T00:53:07.102 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.101+0000 7fa4ed013800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:53:07.110 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.111+0000 7fa4ed013800 20 add_watcher() i=0 2024-09-12T00:53:07.110 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.111+0000 7fa4ed013800 20 add_watcher() i=1 2024-09-12T00:53:07.110 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.111+0000 7fa4ed013800 20 add_watcher() i=2 2024-09-12T00:53:07.110 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.111+0000 7fa4ed013800 20 add_watcher() i=3 2024-09-12T00:53:07.110 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.111+0000 7fa4ed013800 20 add_watcher() i=4 2024-09-12T00:53:07.110 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.111+0000 7fa4ed013800 20 add_watcher() i=5 2024-09-12T00:53:07.110 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.111+0000 7fa4ed013800 20 add_watcher() i=6 2024-09-12T00:53:07.111 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.112+0000 7fa4ed013800 20 add_watcher() i=7 2024-09-12T00:53:07.111 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.112+0000 7fa4ed013800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:07.112 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.114+0000 7fa39efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:07.113 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.114+0000 7fa4ed013800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:07.114 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.114+0000 7fa4ed013800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:07.114 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.114+0000 7fa4ed013800 5 note: GC not initialized 2024-09-12T00:53:07.114 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.114+0000 7fa39dfdb640 20 reqs_thread_entry: start 2024-09-12T00:53:07.114 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.114+0000 7fa4ed013800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:07.114 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.115+0000 7fa4ed013800 20 Filter name: none 2024-09-12T00:53:07.114 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.115+0000 7fa30f7fe640 20 reqs_thread_entry: start 2024-09-12T00:53:07.114 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.115+0000 7fa4ed013800 20 rados->read ofs=0 len=0 2024-09-12T00:53:07.115 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.115+0000 7fa4ed013800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:53:07.115 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.115+0000 7fa4ed013800 20 rados->read ofs=0 len=0 2024-09-12T00:53:07.115 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.116+0000 7fa4ed013800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:53:07.115 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.116+0000 7fa4ed013800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:07.115 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.116+0000 7fa4ed013800 20 rados->read ofs=0 len=0 2024-09-12T00:53:07.115 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.116+0000 7fa4ed013800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:53:07.116 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.116+0000 7fa4ed013800 20 rados->read ofs=0 len=0 2024-09-12T00:53:07.116 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.117+0000 7fa4ed013800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:53:07.116 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.117+0000 7fa4ed013800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:07.116 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.118+0000 7fa39efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:07.119 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.120+0000 7fa4ed013800 20 remove_watcher() i=0 2024-09-12T00:53:07.119 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.120+0000 7fa4ed013800 2 removed watcher, disabling cache 2024-09-12T00:53:07.120 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.121+0000 7fa4ed013800 20 remove_watcher() i=1 2024-09-12T00:53:07.121 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.122+0000 7fa4ed013800 20 remove_watcher() i=2 2024-09-12T00:53:07.122 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.124+0000 7fa4ed013800 20 remove_watcher() i=3 2024-09-12T00:53:07.123 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.125+0000 7fa4ed013800 20 remove_watcher() i=4 2024-09-12T00:53:07.124 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.126+0000 7fa4ed013800 20 remove_watcher() i=5 2024-09-12T00:53:07.125 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.127+0000 7fa4ed013800 20 remove_watcher() i=6 2024-09-12T00:53:07.126 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:07.128+0000 7fa4ed013800 20 remove_watcher() i=7 2024-09-12T00:53:07.137 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:07.137 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:53:07.137 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: error-at-change-reshard-state id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-12T00:53:07.137 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:07.139 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:07.139 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:07.159 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:07.159 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:07.380 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:07.381 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:07.443 INFO:tasks.workunit.client.0.smithi073.stderr:TEST: reshard bucket with abort at change_reshard_state 2024-09-12T00:53:07.443 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:07.445 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:07.445 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:07.485 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:07.486 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:07.541 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:07.541 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:07.578 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:07.578 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:07.611 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:07.611 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:07.646 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:07.646 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:07.681 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:07.681 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:07.716 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:07.716 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:07.752 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:07.752 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:07.788 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:07.788 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:07.823 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:07.823 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:07.859 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:07.859 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:07.894 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:07.894 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:07.929 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:07.929 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:07.966 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:07.966 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:08.001 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:08.001 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:08.036 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:08.036 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:08.072 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:08.072 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:08.111 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:08.111 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:08.153 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:08.154 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:08.194 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:08.195 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:08.229 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:08.229 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:08.264 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T00:53:08.291 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:08.291 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:08.329 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.330+0000 7f93be535800 20 rados->read ofs=0 len=0 2024-09-12T00:53:08.331 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.332+0000 7f93be535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:08.331 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.332+0000 7f93be535800 20 realm 2024-09-12T00:53:08.331 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.332+0000 7f93be535800 20 rados->read ofs=0 len=0 2024-09-12T00:53:08.331 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.332+0000 7f93be535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:08.331 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.332+0000 7f93be535800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:08.331 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.332+0000 7f93be535800 20 rados->read ofs=0 len=0 2024-09-12T00:53:08.331 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.332+0000 7f93be535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:08.331 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.332+0000 7f93be535800 20 rados->read ofs=0 len=0 2024-09-12T00:53:08.332 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.333+0000 7f93be535800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:08.332 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.333+0000 7f93be535800 20 rados->read ofs=0 len=0 2024-09-12T00:53:08.333 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.334+0000 7f93be535800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:08.333 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.334+0000 7f93be535800 20 searching for the correct realm 2024-09-12T00:53:08.335 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.337+0000 7f93baae5640 0 -- 172.21.15.73:0/1414075829 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f93b0097b10 msgr2=0x7f93b0061950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:08.543 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.544+0000 7f93baae5640 0 -- 172.21.15.73:0/1414075829 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f93b0097b10 msgr2=0x7f93b0061950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:08.547 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.549+0000 7f93be535800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:53:08.547 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.549+0000 7f93be535800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:08.548 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.549+0000 7f93be535800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:53:08.548 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.549+0000 7f93be535800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:08.548 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.549+0000 7f93be535800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:08.548 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.549+0000 7f93be535800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:08.548 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.549+0000 7f93be535800 20 rados->read ofs=0 len=0 2024-09-12T00:53:08.549 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.549+0000 7f93be535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:08.549 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.549+0000 7f93be535800 20 rados->read ofs=0 len=0 2024-09-12T00:53:08.549 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.550+0000 7f93be535800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:08.549 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.550+0000 7f93be535800 20 rados->read ofs=0 len=0 2024-09-12T00:53:08.549 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.550+0000 7f93be535800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:08.549 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.550+0000 7f93be535800 20 zone default found 2024-09-12T00:53:08.549 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.550+0000 7f93be535800 4 Realm: () 2024-09-12T00:53:08.550 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.550+0000 7f93be535800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:53:08.550 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.550+0000 7f93be535800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:53:08.550 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.550+0000 7f93be535800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:08.550 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.550+0000 7f93be535800 20 zonegroup default 2024-09-12T00:53:08.550 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.550+0000 7f93be535800 20 rados->read ofs=0 len=0 2024-09-12T00:53:08.550 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.550+0000 7f93be535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:08.550 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.550+0000 7f93be535800 20 rados->read ofs=0 len=0 2024-09-12T00:53:08.550 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.550+0000 7f93be535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:08.550 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.551+0000 7f93be535800 20 rados->read ofs=0 len=0 2024-09-12T00:53:08.551 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.551+0000 7f93be535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:08.551 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.551+0000 7f93be535800 20 started sync module instance, tier type = 2024-09-12T00:53:08.551 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.551+0000 7f93be535800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:53:08.559 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.560+0000 7f93be535800 20 add_watcher() i=0 2024-09-12T00:53:08.559 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.560+0000 7f93be535800 20 add_watcher() i=1 2024-09-12T00:53:08.559 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.560+0000 7f93be535800 20 add_watcher() i=2 2024-09-12T00:53:08.559 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.560+0000 7f93be535800 20 add_watcher() i=3 2024-09-12T00:53:08.560 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.560+0000 7f93be535800 20 add_watcher() i=4 2024-09-12T00:53:08.560 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.560+0000 7f93be535800 20 add_watcher() i=5 2024-09-12T00:53:08.560 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.560+0000 7f93be535800 20 add_watcher() i=6 2024-09-12T00:53:08.560 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.561+0000 7f93be535800 20 add_watcher() i=7 2024-09-12T00:53:08.560 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.561+0000 7f93be535800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:08.562 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.563+0000 7f9270fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:08.563 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.563+0000 7f93be535800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:08.563 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.563+0000 7f93be535800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:08.563 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.564+0000 7f93be535800 5 note: GC not initialized 2024-09-12T00:53:08.563 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.564+0000 7f91eb7fe640 20 reqs_thread_entry: start 2024-09-12T00:53:08.563 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.564+0000 7f93be535800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:08.563 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.564+0000 7f93be535800 20 Filter name: none 2024-09-12T00:53:08.563 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.564+0000 7f91e97fa640 20 reqs_thread_entry: start 2024-09-12T00:53:08.563 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.564+0000 7f93be535800 20 rados->read ofs=0 len=0 2024-09-12T00:53:08.564 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.565+0000 7f93be535800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:53:08.564 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.565+0000 7f93be535800 20 rados->read ofs=0 len=0 2024-09-12T00:53:08.565 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.565+0000 7f93be535800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:53:08.565 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.565+0000 7f93be535800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:08.565 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.565+0000 7f93be535800 20 rados->read ofs=0 len=0 2024-09-12T00:53:08.565 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.565+0000 7f93be535800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:53:08.565 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.565+0000 7f93be535800 20 rados->read ofs=0 len=0 2024-09-12T00:53:08.565 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.566+0000 7f93be535800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:53:08.565 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.566+0000 7f93be535800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:08.565 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.567+0000 7f9270fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:08.568 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.569+0000 7f93be535800 20 remove_watcher() i=0 2024-09-12T00:53:08.568 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.569+0000 7f93be535800 2 removed watcher, disabling cache 2024-09-12T00:53:08.569 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.570+0000 7f93be535800 20 remove_watcher() i=1 2024-09-12T00:53:08.570 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.572+0000 7f93be535800 20 remove_watcher() i=2 2024-09-12T00:53:08.571 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.573+0000 7f93be535800 20 remove_watcher() i=3 2024-09-12T00:53:08.572 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.574+0000 7f93be535800 20 remove_watcher() i=4 2024-09-12T00:53:08.573 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.574+0000 7f93be535800 20 remove_watcher() i=5 2024-09-12T00:53:08.574 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.576+0000 7f93be535800 20 remove_watcher() i=6 2024-09-12T00:53:08.575 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.576+0000 7f93be535800 20 remove_watcher() i=7 2024-09-12T00:53:08.585 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:08.585 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:53:08.586 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: abort-at-change-reshard-state id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:53:08.586 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:08.587 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-12T00:53:08.621 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:08.621 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:08.658 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.659+0000 7f8690098800 20 rados->read ofs=0 len=0 2024-09-12T00:53:08.659 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.660+0000 7f8690098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:08.659 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.660+0000 7f8690098800 20 realm 2024-09-12T00:53:08.659 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.660+0000 7f8690098800 20 rados->read ofs=0 len=0 2024-09-12T00:53:08.659 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.660+0000 7f8690098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:08.659 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.661+0000 7f8690098800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:08.660 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.661+0000 7f8690098800 20 rados->read ofs=0 len=0 2024-09-12T00:53:08.660 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.661+0000 7f8690098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:08.660 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.661+0000 7f8690098800 20 rados->read ofs=0 len=0 2024-09-12T00:53:08.660 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.662+0000 7f8690098800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:08.660 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.662+0000 7f8690098800 20 rados->read ofs=0 len=0 2024-09-12T00:53:08.661 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.663+0000 7f8690098800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:08.661 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.663+0000 7f8690098800 20 searching for the correct realm 2024-09-12T00:53:08.664 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.665+0000 7f868e383640 0 -- 172.21.15.73:0/3338039331 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f867806d060 msgr2=0x7f86780c6050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:08.870 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.871+0000 7f868e383640 0 -- 172.21.15.73:0/3338039331 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f867806d060 msgr2=0x7f86780c6050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:08.896 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.875+0000 7f8690098800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:53:08.896 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.875+0000 7f8690098800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:08.896 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.875+0000 7f8690098800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:53:08.896 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.875+0000 7f8690098800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:08.896 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.875+0000 7f8690098800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:08.897 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.875+0000 7f8690098800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:08.897 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.875+0000 7f8690098800 20 rados->read ofs=0 len=0 2024-09-12T00:53:08.897 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.876+0000 7f8690098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:08.897 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.876+0000 7f8690098800 20 rados->read ofs=0 len=0 2024-09-12T00:53:08.897 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.876+0000 7f8690098800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:08.897 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.876+0000 7f8690098800 20 rados->read ofs=0 len=0 2024-09-12T00:53:08.897 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.876+0000 7f8690098800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:08.898 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.876+0000 7f8690098800 20 zone default found 2024-09-12T00:53:08.898 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.876+0000 7f8690098800 4 Realm: () 2024-09-12T00:53:08.898 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.876+0000 7f8690098800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:53:08.898 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.876+0000 7f8690098800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:53:08.898 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.876+0000 7f8690098800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:08.898 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.876+0000 7f8690098800 20 zonegroup default 2024-09-12T00:53:08.898 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.876+0000 7f8690098800 20 rados->read ofs=0 len=0 2024-09-12T00:53:08.898 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.876+0000 7f8690098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:08.898 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.876+0000 7f8690098800 20 rados->read ofs=0 len=0 2024-09-12T00:53:08.898 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.877+0000 7f8690098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:08.898 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.877+0000 7f8690098800 20 rados->read ofs=0 len=0 2024-09-12T00:53:08.898 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.877+0000 7f8690098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:08.898 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.877+0000 7f8690098800 20 started sync module instance, tier type = 2024-09-12T00:53:08.899 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.877+0000 7f8690098800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:53:08.899 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.887+0000 7f8690098800 20 add_watcher() i=0 2024-09-12T00:53:08.899 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.887+0000 7f8690098800 20 add_watcher() i=1 2024-09-12T00:53:08.899 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.887+0000 7f8690098800 20 add_watcher() i=2 2024-09-12T00:53:08.899 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.887+0000 7f8690098800 20 add_watcher() i=3 2024-09-12T00:53:08.899 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.887+0000 7f8690098800 20 add_watcher() i=4 2024-09-12T00:53:08.899 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.887+0000 7f8690098800 20 add_watcher() i=5 2024-09-12T00:53:08.899 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.887+0000 7f8690098800 20 add_watcher() i=6 2024-09-12T00:53:08.899 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.888+0000 7f8690098800 20 add_watcher() i=7 2024-09-12T00:53:08.899 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.888+0000 7f8690098800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:08.899 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.889+0000 7f853ffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:08.899 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.890+0000 7f8690098800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:08.900 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.890+0000 7f8690098800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:08.900 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.890+0000 7f8690098800 5 note: GC not initialized 2024-09-12T00:53:08.900 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.890+0000 7f853effd640 20 reqs_thread_entry: start 2024-09-12T00:53:08.900 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.890+0000 7f8690098800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:08.900 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.890+0000 7f8690098800 20 Filter name: none 2024-09-12T00:53:08.900 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.890+0000 7f853cff9640 20 reqs_thread_entry: start 2024-09-12T00:53:08.900 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.890+0000 7f8690098800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:53:08.900 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.890+0000 7f8690098800 20 rados->read ofs=0 len=0 2024-09-12T00:53:08.900 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.891+0000 7f8690098800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:53:08.900 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.891+0000 7f8690098800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:53:08.900 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.891+0000 7f8690098800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:53:08.900 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.891+0000 7f8690098800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39 : miss 2024-09-12T00:53:08.900 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.891+0000 7f8690098800 20 rados->read ofs=0 len=0 2024-09-12T00:53:08.901 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.891+0000 7f8690098800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:53:08.901 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.891+0000 7f8690098800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39 info.flags=0x17 2024-09-12T00:53:08.901 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.891+0000 7f8690098800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39 to cache LRU end 2024-09-12T00:53:08.901 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.891+0000 7f8690098800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:53:08.901 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.891+0000 7f8690098800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:08.901 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.891+0000 7f8690098800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39 2024-09-12T00:53:08.901 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.895+0000 7f8690098800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39 info.flags=0x17 2024-09-12T00:53:08.901 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.895+0000 7f8690098800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39 to cache LRU end 2024-09-12T00:53:08.901 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.895+0000 7f8690098800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:08.901 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.895+0000 7f8690098800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39, ofs0, ns] 2024-09-12T00:53:08.901 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.895+0000 7f85717fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497017 cookie 94708937056128 notifier 7526 bl.length()=931 2024-09-12T00:53:08.901 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.895+0000 7f85717fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39 info.flags=0x17 2024-09-12T00:53:08.901 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.895+0000 7f85717fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39 to cache LRU end 2024-09-12T00:53:08.902 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.895+0000 7f85717fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:08.902 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.897+0000 7f8690098800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39]): orig_sources= new_sources= 2024-09-12T00:53:08.902 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.897+0000 7f8690098800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39]): potential sources added=[] removed=[] 2024-09-12T00:53:08.902 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.897+0000 7f8690098800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39]): orig_dests= new_dests= 2024-09-12T00:53:08.902 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.897+0000 7f8690098800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39]): potential dests added=[] removed=[] 2024-09-12T00:53:08.923 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.899+0000 7f8690098800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39.1.0 2024-09-12T00:53:08.923 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.899+0000 7f8690098800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39.1.0 2024-09-12T00:53:08.923 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.899+0000 7f8690098800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39.1.1 2024-09-12T00:53:08.923 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.899+0000 7f8690098800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39.1.1 2024-09-12T00:53:08.923 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.899+0000 7f8690098800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39.0 2024-09-12T00:53:08.923 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8690098800 time 2024-09-12T00:53:08.902856+0000 2024-09-12T00:53:08.923 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:53:08.924 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:53:08.924 INFO:tasks.workunit.client.0.smithi073.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f869358c71a] 2024-09-12T00:53:08.924 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f869358c8d8] 2024-09-12T00:53:08.924 INFO:tasks.workunit.client.0.smithi073.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5623222e3641] 2024-09-12T00:53:08.924 INFO:tasks.workunit.client.0.smithi073.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5623222f251b] 2024-09-12T00:53:08.924 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5623222f33e4] 2024-09-12T00:53:08.924 INFO:tasks.workunit.client.0.smithi073.stderr: 6: main() 2024-09-12T00:53:08.925 INFO:tasks.workunit.client.0.smithi073.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f8692229590] 2024-09-12T00:53:08.925 INFO:tasks.workunit.client.0.smithi073.stderr: 8: __libc_start_main() 2024-09-12T00:53:08.925 INFO:tasks.workunit.client.0.smithi073.stderr: 9: _start() 2024-09-12T00:53:08.925 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.902+0000 7f8690098800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8690098800 time 2024-09-12T00:53:08.902856+0000 2024-09-12T00:53:08.925 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:53:08.925 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:08.925 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:53:08.925 INFO:tasks.workunit.client.0.smithi073.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f869358c71a] 2024-09-12T00:53:08.925 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f869358c8d8] 2024-09-12T00:53:08.925 INFO:tasks.workunit.client.0.smithi073.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5623222e3641] 2024-09-12T00:53:08.925 INFO:tasks.workunit.client.0.smithi073.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5623222f251b] 2024-09-12T00:53:08.925 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5623222f33e4] 2024-09-12T00:53:08.925 INFO:tasks.workunit.client.0.smithi073.stderr: 6: main() 2024-09-12T00:53:08.926 INFO:tasks.workunit.client.0.smithi073.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f8692229590] 2024-09-12T00:53:08.926 INFO:tasks.workunit.client.0.smithi073.stderr: 8: __libc_start_main() 2024-09-12T00:53:08.926 INFO:tasks.workunit.client.0.smithi073.stderr: 9: _start() 2024-09-12T00:53:08.926 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:08.926 INFO:tasks.workunit.client.0.smithi073.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:53:08.926 INFO:tasks.workunit.client.0.smithi073.stderr: in thread 7f8690098800 thread_name:radosgw-admin 2024-09-12T00:53:08.926 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:53:08.926 INFO:tasks.workunit.client.0.smithi073.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f869223e6f0] 2024-09-12T00:53:08.926 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f869228b99c] 2024-09-12T00:53:08.926 INFO:tasks.workunit.client.0.smithi073.stderr: 3: raise() 2024-09-12T00:53:08.926 INFO:tasks.workunit.client.0.smithi073.stderr: 4: abort() 2024-09-12T00:53:08.926 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f869358c774] 2024-09-12T00:53:08.926 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f869358c8d8] 2024-09-12T00:53:08.927 INFO:tasks.workunit.client.0.smithi073.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5623222e3641] 2024-09-12T00:53:08.927 INFO:tasks.workunit.client.0.smithi073.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5623222f251b] 2024-09-12T00:53:08.927 INFO:tasks.workunit.client.0.smithi073.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5623222f33e4] 2024-09-12T00:53:08.927 INFO:tasks.workunit.client.0.smithi073.stderr: 10: main() 2024-09-12T00:53:08.927 INFO:tasks.workunit.client.0.smithi073.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f8692229590] 2024-09-12T00:53:08.927 INFO:tasks.workunit.client.0.smithi073.stderr: 12: __libc_start_main() 2024-09-12T00:53:08.927 INFO:tasks.workunit.client.0.smithi073.stderr: 13: _start() 2024-09-12T00:53:08.927 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.903+0000 7f8690098800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:53:08.927 INFO:tasks.workunit.client.0.smithi073.stderr: in thread 7f8690098800 thread_name:radosgw-admin 2024-09-12T00:53:08.927 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:08.927 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:53:08.927 INFO:tasks.workunit.client.0.smithi073.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f869223e6f0] 2024-09-12T00:53:08.927 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f869228b99c] 2024-09-12T00:53:08.928 INFO:tasks.workunit.client.0.smithi073.stderr: 3: raise() 2024-09-12T00:53:08.928 INFO:tasks.workunit.client.0.smithi073.stderr: 4: abort() 2024-09-12T00:53:08.928 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f869358c774] 2024-09-12T00:53:08.928 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f869358c8d8] 2024-09-12T00:53:08.928 INFO:tasks.workunit.client.0.smithi073.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5623222e3641] 2024-09-12T00:53:08.928 INFO:tasks.workunit.client.0.smithi073.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5623222f251b] 2024-09-12T00:53:08.928 INFO:tasks.workunit.client.0.smithi073.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5623222f33e4] 2024-09-12T00:53:08.928 INFO:tasks.workunit.client.0.smithi073.stderr: 10: main() 2024-09-12T00:53:08.928 INFO:tasks.workunit.client.0.smithi073.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f8692229590] 2024-09-12T00:53:08.929 INFO:tasks.workunit.client.0.smithi073.stderr: 12: __libc_start_main() 2024-09-12T00:53:08.929 INFO:tasks.workunit.client.0.smithi073.stderr: 13: _start() 2024-09-12T00:53:08.929 INFO:tasks.workunit.client.0.smithi073.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:53:08.929 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:08.929 INFO:tasks.workunit.client.0.smithi073.stderr:--- begin dump of recent events --- 2024-09-12T00:53:08.929 INFO:tasks.workunit.client.0.smithi073.stderr: -499> 2024-09-12T00:53:08.642+0000 7f857be07640 10 monclient: _check_auth_tickets 2024-09-12T00:53:08.929 INFO:tasks.workunit.client.0.smithi073.stderr: -498> 2024-09-12T00:53:08.642+0000 7f8690098800 5 monclient: authenticate success, global_id 8010 2024-09-12T00:53:08.929 INFO:tasks.workunit.client.0.smithi073.stderr: -497> 2024-09-12T00:53:08.642+0000 7f857be07640 10 monclient: handle_config config(0 keys) 2024-09-12T00:53:08.929 INFO:tasks.workunit.client.0.smithi073.stderr: -496> 2024-09-12T00:53:08.642+0000 7f8690098800 10 monclient: get_monmap_and_config success 2024-09-12T00:53:08.929 INFO:tasks.workunit.client.0.smithi073.stderr: -495> 2024-09-12T00:53:08.642+0000 7f8690098800 4 set_mon_vals no callback set 2024-09-12T00:53:08.930 INFO:tasks.workunit.client.0.smithi073.stderr: -494> 2024-09-12T00:53:08.642+0000 7f857be07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:08.930 INFO:tasks.workunit.client.0.smithi073.stderr: -493> 2024-09-12T00:53:08.642+0000 7f857be07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:53:08.930 INFO:tasks.workunit.client.0.smithi073.stderr: -492> 2024-09-12T00:53:08.642+0000 7f857be07640 10 monclient: dump: 2024-09-12T00:53:08.930 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:53:08.930 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:53:08.930 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:08.930 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:08.930 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:08.930 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:53:08.930 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:53:08.931 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:53:08.931 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:53:08.931 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:08.931 INFO:tasks.workunit.client.0.smithi073.stderr: -491> 2024-09-12T00:53:08.643+0000 7f8690098800 10 monclient: shutdown 2024-09-12T00:53:08.931 INFO:tasks.workunit.client.0.smithi073.stderr: -490> 2024-09-12T00:53:08.643+0000 7f8690098800 5 asok(0x5623245ad630) unregister_commands rotate-key 2024-09-12T00:53:08.931 INFO:tasks.workunit.client.0.smithi073.stderr: -489> 2024-09-12T00:53:08.643+0000 7f8690098800 10 monclient: build_initial_monmap 2024-09-12T00:53:08.931 INFO:tasks.workunit.client.0.smithi073.stderr: -488> 2024-09-12T00:53:08.643+0000 7f8690098800 1 build_initial for_mkfs: 0 2024-09-12T00:53:08.931 INFO:tasks.workunit.client.0.smithi073.stderr: -487> 2024-09-12T00:53:08.643+0000 7f8690098800 10 monclient: monmap: 2024-09-12T00:53:08.931 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:53:08.931 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:53:08.931 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:53:08.931 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:53:08.931 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:53:08.932 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:53:08.932 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:53:08.932 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:53:08.932 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:53:08.932 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:08.932 INFO:tasks.workunit.client.0.smithi073.stderr: -486> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247f7cc0) adding auth protocol: cephx 2024-09-12T00:53:08.932 INFO:tasks.workunit.client.0.smithi073.stderr: -485> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247f7cc0) adding auth protocol: cephx 2024-09-12T00:53:08.932 INFO:tasks.workunit.client.0.smithi073.stderr: -484> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247f7cc0) adding auth protocol: cephx 2024-09-12T00:53:08.932 INFO:tasks.workunit.client.0.smithi073.stderr: -483> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247f7cc0) adding con mode: secure 2024-09-12T00:53:08.932 INFO:tasks.workunit.client.0.smithi073.stderr: -482> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247f7cc0) adding con mode: crc 2024-09-12T00:53:08.932 INFO:tasks.workunit.client.0.smithi073.stderr: -481> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247f7cc0) adding con mode: secure 2024-09-12T00:53:08.933 INFO:tasks.workunit.client.0.smithi073.stderr: -480> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247f7cc0) adding con mode: crc 2024-09-12T00:53:08.933 INFO:tasks.workunit.client.0.smithi073.stderr: -479> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247f7cc0) adding con mode: secure 2024-09-12T00:53:08.933 INFO:tasks.workunit.client.0.smithi073.stderr: -478> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247f7cc0) adding con mode: crc 2024-09-12T00:53:08.933 INFO:tasks.workunit.client.0.smithi073.stderr: -477> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247f7cc0) adding con mode: crc 2024-09-12T00:53:08.933 INFO:tasks.workunit.client.0.smithi073.stderr: -476> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247f7cc0) adding con mode: secure 2024-09-12T00:53:08.933 INFO:tasks.workunit.client.0.smithi073.stderr: -475> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247f7cc0) adding con mode: crc 2024-09-12T00:53:08.933 INFO:tasks.workunit.client.0.smithi073.stderr: -474> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247f7cc0) adding con mode: secure 2024-09-12T00:53:08.933 INFO:tasks.workunit.client.0.smithi073.stderr: -473> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247f7cc0) adding con mode: crc 2024-09-12T00:53:08.933 INFO:tasks.workunit.client.0.smithi073.stderr: -472> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247f7cc0) adding con mode: secure 2024-09-12T00:53:08.933 INFO:tasks.workunit.client.0.smithi073.stderr: -471> 2024-09-12T00:53:08.643+0000 7f8690098800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:08.933 INFO:tasks.workunit.client.0.smithi073.stderr: -470> 2024-09-12T00:53:08.643+0000 7f8690098800 1 librados: starting msgr at 2024-09-12T00:53:08.934 INFO:tasks.workunit.client.0.smithi073.stderr: -469> 2024-09-12T00:53:08.643+0000 7f8690098800 1 librados: starting objecter 2024-09-12T00:53:08.934 INFO:tasks.workunit.client.0.smithi073.stderr: -468> 2024-09-12T00:53:08.643+0000 7f8690098800 5 asok(0x5623245ad630) register_command objecter_requests hook 0x5623247f8880 2024-09-12T00:53:08.934 INFO:tasks.workunit.client.0.smithi073.stderr: -467> 2024-09-12T00:53:08.643+0000 7f8690098800 1 librados: setting wanted keys 2024-09-12T00:53:08.934 INFO:tasks.workunit.client.0.smithi073.stderr: -466> 2024-09-12T00:53:08.643+0000 7f8690098800 1 librados: calling monclient init 2024-09-12T00:53:08.934 INFO:tasks.workunit.client.0.smithi073.stderr: -465> 2024-09-12T00:53:08.643+0000 7f8690098800 10 monclient: init 2024-09-12T00:53:08.934 INFO:tasks.workunit.client.0.smithi073.stderr: -464> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247cd960) adding auth protocol: cephx 2024-09-12T00:53:08.934 INFO:tasks.workunit.client.0.smithi073.stderr: -463> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247cd960) adding auth protocol: cephx 2024-09-12T00:53:08.934 INFO:tasks.workunit.client.0.smithi073.stderr: -462> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247cd960) adding auth protocol: cephx 2024-09-12T00:53:08.934 INFO:tasks.workunit.client.0.smithi073.stderr: -461> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247cd960) adding con mode: secure 2024-09-12T00:53:08.934 INFO:tasks.workunit.client.0.smithi073.stderr: -460> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247cd960) adding con mode: crc 2024-09-12T00:53:08.934 INFO:tasks.workunit.client.0.smithi073.stderr: -459> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247cd960) adding con mode: secure 2024-09-12T00:53:08.935 INFO:tasks.workunit.client.0.smithi073.stderr: -458> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247cd960) adding con mode: crc 2024-09-12T00:53:08.935 INFO:tasks.workunit.client.0.smithi073.stderr: -457> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247cd960) adding con mode: secure 2024-09-12T00:53:08.935 INFO:tasks.workunit.client.0.smithi073.stderr: -456> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247cd960) adding con mode: crc 2024-09-12T00:53:08.935 INFO:tasks.workunit.client.0.smithi073.stderr: -455> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247cd960) adding con mode: crc 2024-09-12T00:53:08.935 INFO:tasks.workunit.client.0.smithi073.stderr: -454> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247cd960) adding con mode: secure 2024-09-12T00:53:08.935 INFO:tasks.workunit.client.0.smithi073.stderr: -453> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247cd960) adding con mode: crc 2024-09-12T00:53:08.935 INFO:tasks.workunit.client.0.smithi073.stderr: -452> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247cd960) adding con mode: secure 2024-09-12T00:53:08.935 INFO:tasks.workunit.client.0.smithi073.stderr: -451> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247cd960) adding con mode: crc 2024-09-12T00:53:08.935 INFO:tasks.workunit.client.0.smithi073.stderr: -450> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247cd960) adding con mode: secure 2024-09-12T00:53:08.935 INFO:tasks.workunit.client.0.smithi073.stderr: -449> 2024-09-12T00:53:08.643+0000 7f8690098800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:08.935 INFO:tasks.workunit.client.0.smithi073.stderr: -448> 2024-09-12T00:53:08.644+0000 7f8690098800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:08.935 INFO:tasks.workunit.client.0.smithi073.stderr: -447> 2024-09-12T00:53:08.644+0000 7f8690098800 5 asok(0x5623245ad630) register_command rotate-key hook 0x5623247cdaa8 2024-09-12T00:53:08.935 INFO:tasks.workunit.client.0.smithi073.stderr: -446> 2024-09-12T00:53:08.644+0000 7f8690098800 10 monclient: _reopen_session rank -1 2024-09-12T00:53:08.936 INFO:tasks.workunit.client.0.smithi073.stderr: -445> 2024-09-12T00:53:08.644+0000 7f8690098800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:53:08.936 INFO:tasks.workunit.client.0.smithi073.stderr: -444> 2024-09-12T00:53:08.644+0000 7f8690098800 10 monclient(hunting): picked mon.noname-b con 0x562324685da0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:53:08.936 INFO:tasks.workunit.client.0.smithi073.stderr: -443> 2024-09-12T00:53:08.644+0000 7f8690098800 10 monclient(hunting): picked mon.noname-c con 0x562324713690 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:53:08.936 INFO:tasks.workunit.client.0.smithi073.stderr: -442> 2024-09-12T00:53:08.644+0000 7f8690098800 10 monclient(hunting): picked mon.noname-a con 0x56232471bf90 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:53:08.936 INFO:tasks.workunit.client.0.smithi073.stderr: -441> 2024-09-12T00:53:08.644+0000 7f8690098800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:08.936 INFO:tasks.workunit.client.0.smithi073.stderr: -440> 2024-09-12T00:53:08.644+0000 7f8690098800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:08.936 INFO:tasks.workunit.client.0.smithi073.stderr: -439> 2024-09-12T00:53:08.644+0000 7f8690098800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:08.936 INFO:tasks.workunit.client.0.smithi073.stderr: -438> 2024-09-12T00:53:08.644+0000 7f8690098800 10 monclient(hunting): _renew_subs 2024-09-12T00:53:08.936 INFO:tasks.workunit.client.0.smithi073.stderr: -437> 2024-09-12T00:53:08.644+0000 7f8690098800 10 monclient(hunting): authenticate will time out at 2249.314250s 2024-09-12T00:53:08.936 INFO:tasks.workunit.client.0.smithi073.stderr: -436> 2024-09-12T00:53:08.644+0000 7f868d381640 10 monclient(hunting): get_auth_request con 0x562324713690 auth_method 0 2024-09-12T00:53:08.936 INFO:tasks.workunit.client.0.smithi073.stderr: -435> 2024-09-12T00:53:08.644+0000 7f868d381640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:08.936 INFO:tasks.workunit.client.0.smithi073.stderr: -434> 2024-09-12T00:53:08.644+0000 7f868d381640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:08.937 INFO:tasks.workunit.client.0.smithi073.stderr: -433> 2024-09-12T00:53:08.644+0000 7f868d381640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:08.937 INFO:tasks.workunit.client.0.smithi073.stderr: -432> 2024-09-12T00:53:08.644+0000 7f868e383640 10 monclient(hunting): get_auth_request con 0x56232471bf90 auth_method 0 2024-09-12T00:53:08.937 INFO:tasks.workunit.client.0.smithi073.stderr: -431> 2024-09-12T00:53:08.644+0000 7f868e383640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:08.937 INFO:tasks.workunit.client.0.smithi073.stderr: -430> 2024-09-12T00:53:08.644+0000 7f868e383640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:08.937 INFO:tasks.workunit.client.0.smithi073.stderr: -429> 2024-09-12T00:53:08.644+0000 7f868e383640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:08.937 INFO:tasks.workunit.client.0.smithi073.stderr: -428> 2024-09-12T00:53:08.644+0000 7f868d381640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:08.937 INFO:tasks.workunit.client.0.smithi073.stderr: -427> 2024-09-12T00:53:08.644+0000 7f868d381640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:08.937 INFO:tasks.workunit.client.0.smithi073.stderr: -426> 2024-09-12T00:53:08.644+0000 7f868d381640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:08.937 INFO:tasks.workunit.client.0.smithi073.stderr: -425> 2024-09-12T00:53:08.644+0000 7f868e383640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:08.937 INFO:tasks.workunit.client.0.smithi073.stderr: -424> 2024-09-12T00:53:08.644+0000 7f868e383640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:08.937 INFO:tasks.workunit.client.0.smithi073.stderr: -423> 2024-09-12T00:53:08.644+0000 7f868e383640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:08.937 INFO:tasks.workunit.client.0.smithi073.stderr: -422> 2024-09-12T00:53:08.644+0000 7f868db82640 10 monclient(hunting): get_auth_request con 0x562324685da0 auth_method 0 2024-09-12T00:53:08.937 INFO:tasks.workunit.client.0.smithi073.stderr: -421> 2024-09-12T00:53:08.644+0000 7f868db82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:08.938 INFO:tasks.workunit.client.0.smithi073.stderr: -420> 2024-09-12T00:53:08.644+0000 7f868db82640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:08.938 INFO:tasks.workunit.client.0.smithi073.stderr: -419> 2024-09-12T00:53:08.644+0000 7f868db82640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:08.938 INFO:tasks.workunit.client.0.smithi073.stderr: -418> 2024-09-12T00:53:08.644+0000 7f868d381640 10 monclient(hunting): handle_auth_done global_id 7517 payload 824 2024-09-12T00:53:08.938 INFO:tasks.workunit.client.0.smithi073.stderr: -417> 2024-09-12T00:53:08.644+0000 7f868d381640 10 monclient: _finish_hunting 0 2024-09-12T00:53:08.938 INFO:tasks.workunit.client.0.smithi073.stderr: -416> 2024-09-12T00:53:08.644+0000 7f868d381640 1 monclient: found mon.noname-c 2024-09-12T00:53:08.938 INFO:tasks.workunit.client.0.smithi073.stderr: -415> 2024-09-12T00:53:08.644+0000 7f868d381640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.73:3301/0 2024-09-12T00:53:08.938 INFO:tasks.workunit.client.0.smithi073.stderr: -414> 2024-09-12T00:53:08.644+0000 7f857a604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:08.939 INFO:tasks.workunit.client.0.smithi073.stderr: -413> 2024-09-12T00:53:08.644+0000 7f857a604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:53:08.939 INFO:tasks.workunit.client.0.smithi073.stderr: -412> 2024-09-12T00:53:08.644+0000 7f857a604640 10 monclient: dump: 2024-09-12T00:53:08.939 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:53:08.939 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:53:08.939 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:08.939 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:08.939 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:08.939 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:53:08.939 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:53:08.939 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:53:08.939 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:53:08.939 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:08.939 INFO:tasks.workunit.client.0.smithi073.stderr: -411> 2024-09-12T00:53:08.644+0000 7f857a604640 10 monclient: _finish_auth 0 2024-09-12T00:53:08.940 INFO:tasks.workunit.client.0.smithi073.stderr: -410> 2024-09-12T00:53:08.644+0000 7f857a604640 10 monclient: _check_auth_tickets 2024-09-12T00:53:08.940 INFO:tasks.workunit.client.0.smithi073.stderr: -409> 2024-09-12T00:53:08.644+0000 7f8690098800 5 monclient: authenticate success, global_id 7517 2024-09-12T00:53:08.940 INFO:tasks.workunit.client.0.smithi073.stderr: -408> 2024-09-12T00:53:08.644+0000 7f8690098800 10 monclient: _renew_subs 2024-09-12T00:53:08.940 INFO:tasks.workunit.client.0.smithi073.stderr: -407> 2024-09-12T00:53:08.644+0000 7f8690098800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:53:08.940 INFO:tasks.workunit.client.0.smithi073.stderr: -406> 2024-09-12T00:53:08.644+0000 7f857a604640 10 monclient: handle_config config(0 keys) 2024-09-12T00:53:08.940 INFO:tasks.workunit.client.0.smithi073.stderr: -405> 2024-09-12T00:53:08.644+0000 7f857a604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:08.940 INFO:tasks.workunit.client.0.smithi073.stderr: -404> 2024-09-12T00:53:08.644+0000 7f857a604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:53:08.940 INFO:tasks.workunit.client.0.smithi073.stderr: -403> 2024-09-12T00:53:08.644+0000 7f857a604640 10 monclient: dump: 2024-09-12T00:53:08.941 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:53:08.941 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:53:08.941 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:08.941 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:08.941 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:08.941 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:53:08.941 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:53:08.941 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:53:08.941 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:53:08.942 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:08.942 INFO:tasks.workunit.client.0.smithi073.stderr: -402> 2024-09-12T00:53:08.644+0000 7f857be07640 4 set_mon_vals no callback set 2024-09-12T00:53:08.942 INFO:tasks.workunit.client.0.smithi073.stderr: -401> 2024-09-12T00:53:08.644+0000 7f8690098800 10 monclient: _renew_subs 2024-09-12T00:53:08.942 INFO:tasks.workunit.client.0.smithi073.stderr: -400> 2024-09-12T00:53:08.644+0000 7f8690098800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:53:08.942 INFO:tasks.workunit.client.0.smithi073.stderr: -399> 2024-09-12T00:53:08.644+0000 7f8690098800 1 librados: init done 2024-09-12T00:53:08.942 INFO:tasks.workunit.client.0.smithi073.stderr: -398> 2024-09-12T00:53:08.646+0000 7f857a604640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:53:08.942 INFO:tasks.workunit.client.0.smithi073.stderr: -397> 2024-09-12T00:53:08.646+0000 7f857a604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:53:08.942 INFO:tasks.workunit.client.0.smithi073.stderr: -396> 2024-09-12T00:53:08.646+0000 7f857a604640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:53:08.942 INFO:tasks.workunit.client.0.smithi073.stderr: -395> 2024-09-12T00:53:08.647+0000 7f868db82640 10 monclient: get_auth_request con 0x7f8574076470 auth_method 0 2024-09-12T00:53:08.942 INFO:tasks.workunit.client.0.smithi073.stderr: -394> 2024-09-12T00:53:08.647+0000 7f868e383640 10 monclient: get_auth_request con 0x5623247f69c0 auth_method 0 2024-09-12T00:53:08.942 INFO:tasks.workunit.client.0.smithi073.stderr: -393> 2024-09-12T00:53:08.648+0000 7f868db82640 10 monclient: get_auth_request con 0x562324819400 auth_method 0 2024-09-12T00:53:08.942 INFO:tasks.workunit.client.0.smithi073.stderr: -392> 2024-09-12T00:53:08.648+0000 7f868d381640 10 monclient: get_auth_request con 0x56232481d5f0 auth_method 0 2024-09-12T00:53:08.942 INFO:tasks.workunit.client.0.smithi073.stderr: -391> 2024-09-12T00:53:08.650+0000 7f8690098800 10 monclient: build_initial_monmap 2024-09-12T00:53:08.943 INFO:tasks.workunit.client.0.smithi073.stderr: -390> 2024-09-12T00:53:08.650+0000 7f8690098800 1 build_initial for_mkfs: 0 2024-09-12T00:53:08.943 INFO:tasks.workunit.client.0.smithi073.stderr: -389> 2024-09-12T00:53:08.650+0000 7f8690098800 10 monclient: monmap: 2024-09-12T00:53:08.943 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:53:08.943 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:53:08.943 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:53:08.943 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:53:08.943 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:53:08.943 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:53:08.943 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:53:08.943 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:53:08.943 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:53:08.943 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:08.943 INFO:tasks.workunit.client.0.smithi073.stderr: -388> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x5623248224f0) adding auth protocol: cephx 2024-09-12T00:53:08.944 INFO:tasks.workunit.client.0.smithi073.stderr: -387> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x5623248224f0) adding auth protocol: cephx 2024-09-12T00:53:08.944 INFO:tasks.workunit.client.0.smithi073.stderr: -386> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x5623248224f0) adding auth protocol: cephx 2024-09-12T00:53:08.944 INFO:tasks.workunit.client.0.smithi073.stderr: -385> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x5623248224f0) adding con mode: secure 2024-09-12T00:53:08.944 INFO:tasks.workunit.client.0.smithi073.stderr: -384> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x5623248224f0) adding con mode: crc 2024-09-12T00:53:08.944 INFO:tasks.workunit.client.0.smithi073.stderr: -383> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x5623248224f0) adding con mode: secure 2024-09-12T00:53:08.944 INFO:tasks.workunit.client.0.smithi073.stderr: -382> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x5623248224f0) adding con mode: crc 2024-09-12T00:53:08.944 INFO:tasks.workunit.client.0.smithi073.stderr: -381> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x5623248224f0) adding con mode: secure 2024-09-12T00:53:08.944 INFO:tasks.workunit.client.0.smithi073.stderr: -380> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x5623248224f0) adding con mode: crc 2024-09-12T00:53:08.944 INFO:tasks.workunit.client.0.smithi073.stderr: -379> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x5623248224f0) adding con mode: crc 2024-09-12T00:53:08.944 INFO:tasks.workunit.client.0.smithi073.stderr: -378> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x5623248224f0) adding con mode: secure 2024-09-12T00:53:08.944 INFO:tasks.workunit.client.0.smithi073.stderr: -377> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x5623248224f0) adding con mode: crc 2024-09-12T00:53:08.944 INFO:tasks.workunit.client.0.smithi073.stderr: -376> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x5623248224f0) adding con mode: secure 2024-09-12T00:53:08.944 INFO:tasks.workunit.client.0.smithi073.stderr: -375> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x5623248224f0) adding con mode: crc 2024-09-12T00:53:08.945 INFO:tasks.workunit.client.0.smithi073.stderr: -374> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x5623248224f0) adding con mode: secure 2024-09-12T00:53:08.945 INFO:tasks.workunit.client.0.smithi073.stderr: -373> 2024-09-12T00:53:08.650+0000 7f8690098800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:08.945 INFO:tasks.workunit.client.0.smithi073.stderr: -372> 2024-09-12T00:53:08.650+0000 7f8690098800 5 asok(0x5623245ad630) register_command objecter_requests cmddesc objecter_requests hook 0x562324825ea0 EEXIST 2024-09-12T00:53:08.945 INFO:tasks.workunit.client.0.smithi073.stderr: -371> 2024-09-12T00:53:08.650+0000 7f8690098800 10 monclient: init 2024-09-12T00:53:08.945 INFO:tasks.workunit.client.0.smithi073.stderr: -370> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x562324820b18) adding auth protocol: cephx 2024-09-12T00:53:08.945 INFO:tasks.workunit.client.0.smithi073.stderr: -369> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x562324820b18) adding auth protocol: cephx 2024-09-12T00:53:08.945 INFO:tasks.workunit.client.0.smithi073.stderr: -368> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x562324820b18) adding auth protocol: cephx 2024-09-12T00:53:08.945 INFO:tasks.workunit.client.0.smithi073.stderr: -367> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x562324820b18) adding con mode: secure 2024-09-12T00:53:08.945 INFO:tasks.workunit.client.0.smithi073.stderr: -366> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x562324820b18) adding con mode: crc 2024-09-12T00:53:08.945 INFO:tasks.workunit.client.0.smithi073.stderr: -365> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x562324820b18) adding con mode: secure 2024-09-12T00:53:08.945 INFO:tasks.workunit.client.0.smithi073.stderr: -364> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x562324820b18) adding con mode: crc 2024-09-12T00:53:08.945 INFO:tasks.workunit.client.0.smithi073.stderr: -363> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x562324820b18) adding con mode: secure 2024-09-12T00:53:08.945 INFO:tasks.workunit.client.0.smithi073.stderr: -362> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x562324820b18) adding con mode: crc 2024-09-12T00:53:08.946 INFO:tasks.workunit.client.0.smithi073.stderr: -361> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x562324820b18) adding con mode: crc 2024-09-12T00:53:08.946 INFO:tasks.workunit.client.0.smithi073.stderr: -360> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x562324820b18) adding con mode: secure 2024-09-12T00:53:08.946 INFO:tasks.workunit.client.0.smithi073.stderr: -359> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x562324820b18) adding con mode: crc 2024-09-12T00:53:08.946 INFO:tasks.workunit.client.0.smithi073.stderr: -358> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x562324820b18) adding con mode: secure 2024-09-12T00:53:08.946 INFO:tasks.workunit.client.0.smithi073.stderr: -357> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x562324820b18) adding con mode: crc 2024-09-12T00:53:08.946 INFO:tasks.workunit.client.0.smithi073.stderr: -356> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x562324820b18) adding con mode: secure 2024-09-12T00:53:08.946 INFO:tasks.workunit.client.0.smithi073.stderr: -355> 2024-09-12T00:53:08.651+0000 7f8690098800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:08.946 INFO:tasks.workunit.client.0.smithi073.stderr: -354> 2024-09-12T00:53:08.651+0000 7f8690098800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:08.946 INFO:tasks.workunit.client.0.smithi073.stderr: -353> 2024-09-12T00:53:08.651+0000 7f8690098800 5 asok(0x5623245ad630) register_command rotate-key cmddesc rotate-key hook 0x562324820c60 EEXIST 2024-09-12T00:53:08.946 INFO:tasks.workunit.client.0.smithi073.stderr: -352> 2024-09-12T00:53:08.651+0000 7f8690098800 10 monclient: _reopen_session rank -1 2024-09-12T00:53:08.946 INFO:tasks.workunit.client.0.smithi073.stderr: -351> 2024-09-12T00:53:08.651+0000 7f8690098800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:53:08.947 INFO:tasks.workunit.client.0.smithi073.stderr: -350> 2024-09-12T00:53:08.651+0000 7f8690098800 10 monclient(hunting): picked mon.noname-c con 0x562324849b90 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:53:08.947 INFO:tasks.workunit.client.0.smithi073.stderr: -349> 2024-09-12T00:53:08.651+0000 7f8690098800 10 monclient(hunting): picked mon.noname-a con 0x56232484be60 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:53:08.947 INFO:tasks.workunit.client.0.smithi073.stderr: -348> 2024-09-12T00:53:08.651+0000 7f8690098800 10 monclient(hunting): picked mon.noname-b con 0x562324848360 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:53:08.947 INFO:tasks.workunit.client.0.smithi073.stderr: -347> 2024-09-12T00:53:08.651+0000 7f8690098800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:08.947 INFO:tasks.workunit.client.0.smithi073.stderr: -346> 2024-09-12T00:53:08.651+0000 7f8690098800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:08.947 INFO:tasks.workunit.client.0.smithi073.stderr: -345> 2024-09-12T00:53:08.651+0000 7f8690098800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:08.947 INFO:tasks.workunit.client.0.smithi073.stderr: -344> 2024-09-12T00:53:08.651+0000 7f8690098800 10 monclient(hunting): _renew_subs 2024-09-12T00:53:08.947 INFO:tasks.workunit.client.0.smithi073.stderr: -343> 2024-09-12T00:53:08.651+0000 7f8690098800 10 monclient(hunting): authenticate will time out at 2249.321452s 2024-09-12T00:53:08.947 INFO:tasks.workunit.client.0.smithi073.stderr: -342> 2024-09-12T00:53:08.651+0000 7f868db82640 10 monclient(hunting): get_auth_request con 0x562324849b90 auth_method 0 2024-09-12T00:53:08.947 INFO:tasks.workunit.client.0.smithi073.stderr: -341> 2024-09-12T00:53:08.651+0000 7f868db82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:08.947 INFO:tasks.workunit.client.0.smithi073.stderr: -340> 2024-09-12T00:53:08.651+0000 7f868db82640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:08.947 INFO:tasks.workunit.client.0.smithi073.stderr: -339> 2024-09-12T00:53:08.651+0000 7f868db82640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:08.947 INFO:tasks.workunit.client.0.smithi073.stderr: -338> 2024-09-12T00:53:08.651+0000 7f868d381640 10 monclient(hunting): get_auth_request con 0x56232484be60 auth_method 0 2024-09-12T00:53:08.948 INFO:tasks.workunit.client.0.smithi073.stderr: -337> 2024-09-12T00:53:08.651+0000 7f868d381640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:08.948 INFO:tasks.workunit.client.0.smithi073.stderr: -336> 2024-09-12T00:53:08.651+0000 7f868d381640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:08.948 INFO:tasks.workunit.client.0.smithi073.stderr: -335> 2024-09-12T00:53:08.651+0000 7f868d381640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:08.948 INFO:tasks.workunit.client.0.smithi073.stderr: -334> 2024-09-12T00:53:08.651+0000 7f868db82640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:08.948 INFO:tasks.workunit.client.0.smithi073.stderr: -333> 2024-09-12T00:53:08.651+0000 7f868db82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:08.948 INFO:tasks.workunit.client.0.smithi073.stderr: -332> 2024-09-12T00:53:08.651+0000 7f868db82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:08.948 INFO:tasks.workunit.client.0.smithi073.stderr: -331> 2024-09-12T00:53:08.651+0000 7f868d381640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:08.948 INFO:tasks.workunit.client.0.smithi073.stderr: -330> 2024-09-12T00:53:08.651+0000 7f868d381640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:08.948 INFO:tasks.workunit.client.0.smithi073.stderr: -329> 2024-09-12T00:53:08.651+0000 7f868d381640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:08.948 INFO:tasks.workunit.client.0.smithi073.stderr: -328> 2024-09-12T00:53:08.651+0000 7f868e383640 10 monclient(hunting): get_auth_request con 0x562324848360 auth_method 0 2024-09-12T00:53:08.948 INFO:tasks.workunit.client.0.smithi073.stderr: -327> 2024-09-12T00:53:08.651+0000 7f868e383640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:08.948 INFO:tasks.workunit.client.0.smithi073.stderr: -326> 2024-09-12T00:53:08.651+0000 7f868e383640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:08.948 INFO:tasks.workunit.client.0.smithi073.stderr: -325> 2024-09-12T00:53:08.651+0000 7f868e383640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:08.949 INFO:tasks.workunit.client.0.smithi073.stderr: -324> 2024-09-12T00:53:08.651+0000 7f868e383640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:08.949 INFO:tasks.workunit.client.0.smithi073.stderr: -323> 2024-09-12T00:53:08.651+0000 7f868e383640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:08.949 INFO:tasks.workunit.client.0.smithi073.stderr: -322> 2024-09-12T00:53:08.651+0000 7f868e383640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:08.949 INFO:tasks.workunit.client.0.smithi073.stderr: -321> 2024-09-12T00:53:08.651+0000 7f868db82640 10 monclient(hunting): handle_auth_done global_id 7520 payload 824 2024-09-12T00:53:08.949 INFO:tasks.workunit.client.0.smithi073.stderr: -320> 2024-09-12T00:53:08.651+0000 7f868db82640 10 monclient: _finish_hunting 0 2024-09-12T00:53:08.949 INFO:tasks.workunit.client.0.smithi073.stderr: -319> 2024-09-12T00:53:08.651+0000 7f868db82640 1 monclient: found mon.noname-c 2024-09-12T00:53:08.949 INFO:tasks.workunit.client.0.smithi073.stderr: -318> 2024-09-12T00:53:08.651+0000 7f868db82640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.73:3301/0 2024-09-12T00:53:08.949 INFO:tasks.workunit.client.0.smithi073.stderr: -317> 2024-09-12T00:53:08.652+0000 7f85737fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:08.949 INFO:tasks.workunit.client.0.smithi073.stderr: -316> 2024-09-12T00:53:08.652+0000 7f85737fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:53:08.949 INFO:tasks.workunit.client.0.smithi073.stderr: -315> 2024-09-12T00:53:08.652+0000 7f85737fe640 10 monclient: dump: 2024-09-12T00:53:08.949 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:53:08.950 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:53:08.950 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:08.950 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:08.950 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:08.950 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:53:08.950 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:53:08.950 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:53:08.950 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:53:08.950 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:08.950 INFO:tasks.workunit.client.0.smithi073.stderr: -314> 2024-09-12T00:53:08.652+0000 7f85737fe640 10 monclient: _finish_auth 0 2024-09-12T00:53:08.950 INFO:tasks.workunit.client.0.smithi073.stderr: -313> 2024-09-12T00:53:08.652+0000 7f85737fe640 10 monclient: _check_auth_tickets 2024-09-12T00:53:08.951 INFO:tasks.workunit.client.0.smithi073.stderr: -312> 2024-09-12T00:53:08.652+0000 7f8690098800 5 monclient: authenticate success, global_id 7520 2024-09-12T00:53:08.951 INFO:tasks.workunit.client.0.smithi073.stderr: -311> 2024-09-12T00:53:08.652+0000 7f8690098800 10 monclient: _renew_subs 2024-09-12T00:53:08.951 INFO:tasks.workunit.client.0.smithi073.stderr: -310> 2024-09-12T00:53:08.652+0000 7f8690098800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:53:08.951 INFO:tasks.workunit.client.0.smithi073.stderr: -309> 2024-09-12T00:53:08.652+0000 7f85737fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:53:08.951 INFO:tasks.workunit.client.0.smithi073.stderr: -308> 2024-09-12T00:53:08.652+0000 7f85737fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:08.951 INFO:tasks.workunit.client.0.smithi073.stderr: -307> 2024-09-12T00:53:08.652+0000 7f85737fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:53:08.951 INFO:tasks.workunit.client.0.smithi073.stderr: -306> 2024-09-12T00:53:08.652+0000 7f85737fe640 10 monclient: dump: 2024-09-12T00:53:08.951 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:53:08.951 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:53:08.952 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:08.952 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:08.952 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:08.952 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:53:08.952 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:53:08.952 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:53:08.952 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:53:08.952 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:08.952 INFO:tasks.workunit.client.0.smithi073.stderr: -305> 2024-09-12T00:53:08.652+0000 7f868eb84640 4 set_mon_vals no callback set 2024-09-12T00:53:08.952 INFO:tasks.workunit.client.0.smithi073.stderr: -304> 2024-09-12T00:53:08.652+0000 7f8690098800 10 monclient: _renew_subs 2024-09-12T00:53:08.953 INFO:tasks.workunit.client.0.smithi073.stderr: -303> 2024-09-12T00:53:08.652+0000 7f8690098800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:53:08.953 INFO:tasks.workunit.client.0.smithi073.stderr: -302> 2024-09-12T00:53:08.653+0000 7f85737fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:53:08.953 INFO:tasks.workunit.client.0.smithi073.stderr: -301> 2024-09-12T00:53:08.653+0000 7f85737fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:53:08.953 INFO:tasks.workunit.client.0.smithi073.stderr: -300> 2024-09-12T00:53:08.653+0000 7f85737fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:53:08.953 INFO:tasks.workunit.client.0.smithi073.stderr: -299> 2024-09-12T00:53:08.654+0000 7f868d381640 10 monclient: get_auth_request con 0x7f8568076380 auth_method 0 2024-09-12T00:53:08.953 INFO:tasks.workunit.client.0.smithi073.stderr: -298> 2024-09-12T00:53:08.654+0000 7f8690098800 10 monclient: get_monmap_and_config 2024-09-12T00:53:08.953 INFO:tasks.workunit.client.0.smithi073.stderr: -297> 2024-09-12T00:53:08.654+0000 7f8690098800 10 monclient: build_initial_monmap 2024-09-12T00:53:08.953 INFO:tasks.workunit.client.0.smithi073.stderr: -296> 2024-09-12T00:53:08.654+0000 7f8690098800 1 build_initial for_mkfs: 0 2024-09-12T00:53:08.953 INFO:tasks.workunit.client.0.smithi073.stderr: -295> 2024-09-12T00:53:08.654+0000 7f8690098800 10 monclient: monmap: 2024-09-12T00:53:08.953 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:53:08.953 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:53:08.953 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:53:08.953 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:53:08.954 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:53:08.954 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:53:08.954 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:53:08.954 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:53:08.954 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:53:08.954 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:08.954 INFO:tasks.workunit.client.0.smithi073.stderr: -294> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x562324869a30) adding auth protocol: cephx 2024-09-12T00:53:08.954 INFO:tasks.workunit.client.0.smithi073.stderr: -293> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x562324869a30) adding auth protocol: cephx 2024-09-12T00:53:08.954 INFO:tasks.workunit.client.0.smithi073.stderr: -292> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x562324869a30) adding auth protocol: cephx 2024-09-12T00:53:08.954 INFO:tasks.workunit.client.0.smithi073.stderr: -291> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x562324869a30) adding con mode: secure 2024-09-12T00:53:08.955 INFO:tasks.workunit.client.0.smithi073.stderr: -290> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x562324869a30) adding con mode: crc 2024-09-12T00:53:08.955 INFO:tasks.workunit.client.0.smithi073.stderr: -289> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x562324869a30) adding con mode: secure 2024-09-12T00:53:08.955 INFO:tasks.workunit.client.0.smithi073.stderr: -288> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x562324869a30) adding con mode: crc 2024-09-12T00:53:08.955 INFO:tasks.workunit.client.0.smithi073.stderr: -287> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x562324869a30) adding con mode: secure 2024-09-12T00:53:08.955 INFO:tasks.workunit.client.0.smithi073.stderr: -286> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x562324869a30) adding con mode: crc 2024-09-12T00:53:08.955 INFO:tasks.workunit.client.0.smithi073.stderr: -285> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x562324869a30) adding con mode: crc 2024-09-12T00:53:08.955 INFO:tasks.workunit.client.0.smithi073.stderr: -284> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x562324869a30) adding con mode: secure 2024-09-12T00:53:08.955 INFO:tasks.workunit.client.0.smithi073.stderr: -283> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x562324869a30) adding con mode: crc 2024-09-12T00:53:08.955 INFO:tasks.workunit.client.0.smithi073.stderr: -282> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x562324869a30) adding con mode: secure 2024-09-12T00:53:08.955 INFO:tasks.workunit.client.0.smithi073.stderr: -281> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x562324869a30) adding con mode: crc 2024-09-12T00:53:08.956 INFO:tasks.workunit.client.0.smithi073.stderr: -280> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x562324869a30) adding con mode: secure 2024-09-12T00:53:08.956 INFO:tasks.workunit.client.0.smithi073.stderr: -279> 2024-09-12T00:53:08.654+0000 7f8690098800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:08.956 INFO:tasks.workunit.client.0.smithi073.stderr: -278> 2024-09-12T00:53:08.654+0000 7f8690098800 10 monclient: init 2024-09-12T00:53:08.956 INFO:tasks.workunit.client.0.smithi073.stderr: -277> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x7ffece801aa0) adding auth protocol: cephx 2024-09-12T00:53:08.956 INFO:tasks.workunit.client.0.smithi073.stderr: -276> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x7ffece801aa0) adding auth protocol: cephx 2024-09-12T00:53:08.956 INFO:tasks.workunit.client.0.smithi073.stderr: -275> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x7ffece801aa0) adding auth protocol: cephx 2024-09-12T00:53:08.956 INFO:tasks.workunit.client.0.smithi073.stderr: -274> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x7ffece801aa0) adding con mode: secure 2024-09-12T00:53:08.956 INFO:tasks.workunit.client.0.smithi073.stderr: -273> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x7ffece801aa0) adding con mode: crc 2024-09-12T00:53:08.956 INFO:tasks.workunit.client.0.smithi073.stderr: -272> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x7ffece801aa0) adding con mode: secure 2024-09-12T00:53:08.956 INFO:tasks.workunit.client.0.smithi073.stderr: -271> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x7ffece801aa0) adding con mode: crc 2024-09-12T00:53:08.956 INFO:tasks.workunit.client.0.smithi073.stderr: -270> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x7ffece801aa0) adding con mode: secure 2024-09-12T00:53:08.956 INFO:tasks.workunit.client.0.smithi073.stderr: -269> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x7ffece801aa0) adding con mode: crc 2024-09-12T00:53:08.957 INFO:tasks.workunit.client.0.smithi073.stderr: -268> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x7ffece801aa0) adding con mode: crc 2024-09-12T00:53:08.957 INFO:tasks.workunit.client.0.smithi073.stderr: -267> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x7ffece801aa0) adding con mode: secure 2024-09-12T00:53:08.957 INFO:tasks.workunit.client.0.smithi073.stderr: -266> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x7ffece801aa0) adding con mode: crc 2024-09-12T00:53:08.957 INFO:tasks.workunit.client.0.smithi073.stderr: -265> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x7ffece801aa0) adding con mode: secure 2024-09-12T00:53:08.957 INFO:tasks.workunit.client.0.smithi073.stderr: -264> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x7ffece801aa0) adding con mode: crc 2024-09-12T00:53:08.957 INFO:tasks.workunit.client.0.smithi073.stderr: -263> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x7ffece801aa0) adding con mode: secure 2024-09-12T00:53:08.957 INFO:tasks.workunit.client.0.smithi073.stderr: -262> 2024-09-12T00:53:08.654+0000 7f8690098800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:08.957 INFO:tasks.workunit.client.0.smithi073.stderr: -261> 2024-09-12T00:53:08.655+0000 7f8690098800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:08.957 INFO:tasks.workunit.client.0.smithi073.stderr: -260> 2024-09-12T00:53:08.655+0000 7f8690098800 5 asok(0x5623245ad630) register_command rotate-key cmddesc rotate-key hook 0x7ffece801be8 EEXIST 2024-09-12T00:53:08.957 INFO:tasks.workunit.client.0.smithi073.stderr: -259> 2024-09-12T00:53:08.655+0000 7f8690098800 10 monclient: _reopen_session rank -1 2024-09-12T00:53:08.957 INFO:tasks.workunit.client.0.smithi073.stderr: -258> 2024-09-12T00:53:08.655+0000 7f8690098800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:53:08.957 INFO:tasks.workunit.client.0.smithi073.stderr: -257> 2024-09-12T00:53:08.655+0000 7f8690098800 10 monclient(hunting): picked mon.noname-c con 0x56232489dcf0 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:53:08.957 INFO:tasks.workunit.client.0.smithi073.stderr: -256> 2024-09-12T00:53:08.655+0000 7f8690098800 10 monclient(hunting): picked mon.noname-b con 0x56232489e0d0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:53:08.957 INFO:tasks.workunit.client.0.smithi073.stderr: -255> 2024-09-12T00:53:08.655+0000 7f8690098800 10 monclient(hunting): picked mon.noname-a con 0x5623248a3820 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:53:08.958 INFO:tasks.workunit.client.0.smithi073.stderr: -254> 2024-09-12T00:53:08.655+0000 7f8690098800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:08.958 INFO:tasks.workunit.client.0.smithi073.stderr: -253> 2024-09-12T00:53:08.655+0000 7f8690098800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:08.958 INFO:tasks.workunit.client.0.smithi073.stderr: -252> 2024-09-12T00:53:08.655+0000 7f8690098800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:08.958 INFO:tasks.workunit.client.0.smithi073.stderr: -251> 2024-09-12T00:53:08.655+0000 7f8690098800 10 monclient(hunting): _renew_subs 2024-09-12T00:53:08.958 INFO:tasks.workunit.client.0.smithi073.stderr: -250> 2024-09-12T00:53:08.655+0000 7f8690098800 10 monclient(hunting): authenticate will time out at 2249.325210s 2024-09-12T00:53:08.958 INFO:tasks.workunit.client.0.smithi073.stderr: -249> 2024-09-12T00:53:08.655+0000 7f868db82640 10 monclient(hunting): get_auth_request con 0x56232489dcf0 auth_method 0 2024-09-12T00:53:08.958 INFO:tasks.workunit.client.0.smithi073.stderr: -248> 2024-09-12T00:53:08.655+0000 7f868db82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:08.958 INFO:tasks.workunit.client.0.smithi073.stderr: -247> 2024-09-12T00:53:08.655+0000 7f868db82640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:08.958 INFO:tasks.workunit.client.0.smithi073.stderr: -246> 2024-09-12T00:53:08.655+0000 7f868db82640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:08.958 INFO:tasks.workunit.client.0.smithi073.stderr: -245> 2024-09-12T00:53:08.655+0000 7f868e383640 10 monclient(hunting): get_auth_request con 0x5623248a3820 auth_method 0 2024-09-12T00:53:08.958 INFO:tasks.workunit.client.0.smithi073.stderr: -244> 2024-09-12T00:53:08.655+0000 7f868e383640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:08.958 INFO:tasks.workunit.client.0.smithi073.stderr: -243> 2024-09-12T00:53:08.655+0000 7f868e383640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:08.958 INFO:tasks.workunit.client.0.smithi073.stderr: -242> 2024-09-12T00:53:08.655+0000 7f868e383640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:08.958 INFO:tasks.workunit.client.0.smithi073.stderr: -241> 2024-09-12T00:53:08.655+0000 7f868e383640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:08.959 INFO:tasks.workunit.client.0.smithi073.stderr: -240> 2024-09-12T00:53:08.655+0000 7f868e383640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:08.959 INFO:tasks.workunit.client.0.smithi073.stderr: -239> 2024-09-12T00:53:08.655+0000 7f868e383640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:08.959 INFO:tasks.workunit.client.0.smithi073.stderr: -238> 2024-09-12T00:53:08.655+0000 7f868db82640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:08.959 INFO:tasks.workunit.client.0.smithi073.stderr: -237> 2024-09-12T00:53:08.655+0000 7f868db82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:08.959 INFO:tasks.workunit.client.0.smithi073.stderr: -236> 2024-09-12T00:53:08.655+0000 7f868db82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:08.959 INFO:tasks.workunit.client.0.smithi073.stderr: -235> 2024-09-12T00:53:08.655+0000 7f868e383640 10 monclient(hunting): handle_auth_done global_id 8019 payload 274 2024-09-12T00:53:08.959 INFO:tasks.workunit.client.0.smithi073.stderr: -234> 2024-09-12T00:53:08.655+0000 7f868e383640 10 monclient: _finish_hunting 0 2024-09-12T00:53:08.959 INFO:tasks.workunit.client.0.smithi073.stderr: -233> 2024-09-12T00:53:08.655+0000 7f868e383640 1 monclient: found mon.noname-a 2024-09-12T00:53:08.959 INFO:tasks.workunit.client.0.smithi073.stderr: -232> 2024-09-12T00:53:08.655+0000 7f868e383640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:53:08.960 INFO:tasks.workunit.client.0.smithi073.stderr: -231> 2024-09-12T00:53:08.655+0000 7f85717fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:08.960 INFO:tasks.workunit.client.0.smithi073.stderr: -230> 2024-09-12T00:53:08.655+0000 7f85717fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:53:08.960 INFO:tasks.workunit.client.0.smithi073.stderr: -229> 2024-09-12T00:53:08.655+0000 7f85717fa640 10 monclient: dump: 2024-09-12T00:53:08.960 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:53:08.960 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:53:08.960 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:08.960 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:08.960 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:08.960 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:53:08.960 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:53:08.960 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:53:08.960 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:53:08.960 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:08.960 INFO:tasks.workunit.client.0.smithi073.stderr: -228> 2024-09-12T00:53:08.655+0000 7f85717fa640 10 monclient: _finish_auth 0 2024-09-12T00:53:08.961 INFO:tasks.workunit.client.0.smithi073.stderr: -227> 2024-09-12T00:53:08.655+0000 7f85717fa640 10 monclient: _check_auth_tickets 2024-09-12T00:53:08.961 INFO:tasks.workunit.client.0.smithi073.stderr: -226> 2024-09-12T00:53:08.655+0000 7f85717fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:53:08.961 INFO:tasks.workunit.client.0.smithi073.stderr: -225> 2024-09-12T00:53:08.655+0000 7f85717fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:08.961 INFO:tasks.workunit.client.0.smithi073.stderr: -224> 2024-09-12T00:53:08.655+0000 7f85717fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:53:08.961 INFO:tasks.workunit.client.0.smithi073.stderr: -223> 2024-09-12T00:53:08.655+0000 7f85717fa640 10 monclient: dump: 2024-09-12T00:53:08.961 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:53:08.961 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:53:08.961 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:08.961 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:08.961 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:08.961 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:53:08.961 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:53:08.961 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:53:08.961 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:53:08.962 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:08.962 INFO:tasks.workunit.client.0.smithi073.stderr: -222> 2024-09-12T00:53:08.655+0000 7f8690098800 5 monclient: authenticate success, global_id 8019 2024-09-12T00:53:08.962 INFO:tasks.workunit.client.0.smithi073.stderr: -221> 2024-09-12T00:53:08.655+0000 7f8690098800 10 monclient: get_monmap_and_config success 2024-09-12T00:53:08.962 INFO:tasks.workunit.client.0.smithi073.stderr: -220> 2024-09-12T00:53:08.655+0000 7f8690098800 4 set_mon_vals no callback set 2024-09-12T00:53:08.962 INFO:tasks.workunit.client.0.smithi073.stderr: -219> 2024-09-12T00:53:08.656+0000 7f8690098800 10 monclient: shutdown 2024-09-12T00:53:08.962 INFO:tasks.workunit.client.0.smithi073.stderr: -218> 2024-09-12T00:53:08.656+0000 7f8690098800 10 monclient: build_initial_monmap 2024-09-12T00:53:08.962 INFO:tasks.workunit.client.0.smithi073.stderr: -217> 2024-09-12T00:53:08.656+0000 7f8690098800 1 build_initial for_mkfs: 0 2024-09-12T00:53:08.962 INFO:tasks.workunit.client.0.smithi073.stderr: -216> 2024-09-12T00:53:08.656+0000 7f8690098800 10 monclient: monmap: 2024-09-12T00:53:08.962 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:53:08.962 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:53:08.962 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:53:08.962 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:53:08.962 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:53:08.963 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:53:08.963 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:53:08.963 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:53:08.963 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:53:08.963 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:08.963 INFO:tasks.workunit.client.0.smithi073.stderr: -215> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x5623248995f0) adding auth protocol: cephx 2024-09-12T00:53:08.963 INFO:tasks.workunit.client.0.smithi073.stderr: -214> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x5623248995f0) adding auth protocol: cephx 2024-09-12T00:53:08.963 INFO:tasks.workunit.client.0.smithi073.stderr: -213> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x5623248995f0) adding auth protocol: cephx 2024-09-12T00:53:08.963 INFO:tasks.workunit.client.0.smithi073.stderr: -212> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x5623248995f0) adding con mode: secure 2024-09-12T00:53:08.963 INFO:tasks.workunit.client.0.smithi073.stderr: -211> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x5623248995f0) adding con mode: crc 2024-09-12T00:53:08.963 INFO:tasks.workunit.client.0.smithi073.stderr: -210> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x5623248995f0) adding con mode: secure 2024-09-12T00:53:08.963 INFO:tasks.workunit.client.0.smithi073.stderr: -209> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x5623248995f0) adding con mode: crc 2024-09-12T00:53:08.963 INFO:tasks.workunit.client.0.smithi073.stderr: -208> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x5623248995f0) adding con mode: secure 2024-09-12T00:53:08.964 INFO:tasks.workunit.client.0.smithi073.stderr: -207> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x5623248995f0) adding con mode: crc 2024-09-12T00:53:08.964 INFO:tasks.workunit.client.0.smithi073.stderr: -206> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x5623248995f0) adding con mode: crc 2024-09-12T00:53:08.964 INFO:tasks.workunit.client.0.smithi073.stderr: -205> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x5623248995f0) adding con mode: secure 2024-09-12T00:53:08.964 INFO:tasks.workunit.client.0.smithi073.stderr: -204> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x5623248995f0) adding con mode: crc 2024-09-12T00:53:08.964 INFO:tasks.workunit.client.0.smithi073.stderr: -203> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x5623248995f0) adding con mode: secure 2024-09-12T00:53:08.964 INFO:tasks.workunit.client.0.smithi073.stderr: -202> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x5623248995f0) adding con mode: crc 2024-09-12T00:53:08.964 INFO:tasks.workunit.client.0.smithi073.stderr: -201> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x5623248995f0) adding con mode: secure 2024-09-12T00:53:08.964 INFO:tasks.workunit.client.0.smithi073.stderr: -200> 2024-09-12T00:53:08.656+0000 7f8690098800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:08.964 INFO:tasks.workunit.client.0.smithi073.stderr: -199> 2024-09-12T00:53:08.656+0000 7f8690098800 1 librados: starting msgr at 2024-09-12T00:53:08.964 INFO:tasks.workunit.client.0.smithi073.stderr: -198> 2024-09-12T00:53:08.656+0000 7f8690098800 1 librados: starting objecter 2024-09-12T00:53:08.964 INFO:tasks.workunit.client.0.smithi073.stderr: -197> 2024-09-12T00:53:08.656+0000 7f8690098800 5 asok(0x5623245ad630) register_command objecter_requests cmddesc objecter_requests hook 0x562324848f70 EEXIST 2024-09-12T00:53:08.964 INFO:tasks.workunit.client.0.smithi073.stderr: -196> 2024-09-12T00:53:08.656+0000 7f8690098800 1 librados: setting wanted keys 2024-09-12T00:53:08.964 INFO:tasks.workunit.client.0.smithi073.stderr: -195> 2024-09-12T00:53:08.656+0000 7f8690098800 1 librados: calling monclient init 2024-09-12T00:53:08.965 INFO:tasks.workunit.client.0.smithi073.stderr: -194> 2024-09-12T00:53:08.656+0000 7f8690098800 10 monclient: init 2024-09-12T00:53:08.965 INFO:tasks.workunit.client.0.smithi073.stderr: -193> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x562324861940) adding auth protocol: cephx 2024-09-12T00:53:08.965 INFO:tasks.workunit.client.0.smithi073.stderr: -192> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x562324861940) adding auth protocol: cephx 2024-09-12T00:53:08.965 INFO:tasks.workunit.client.0.smithi073.stderr: -191> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x562324861940) adding auth protocol: cephx 2024-09-12T00:53:08.965 INFO:tasks.workunit.client.0.smithi073.stderr: -190> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x562324861940) adding con mode: secure 2024-09-12T00:53:08.965 INFO:tasks.workunit.client.0.smithi073.stderr: -189> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x562324861940) adding con mode: crc 2024-09-12T00:53:08.965 INFO:tasks.workunit.client.0.smithi073.stderr: -188> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x562324861940) adding con mode: secure 2024-09-12T00:53:08.965 INFO:tasks.workunit.client.0.smithi073.stderr: -187> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x562324861940) adding con mode: crc 2024-09-12T00:53:08.965 INFO:tasks.workunit.client.0.smithi073.stderr: -186> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x562324861940) adding con mode: secure 2024-09-12T00:53:08.965 INFO:tasks.workunit.client.0.smithi073.stderr: -185> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x562324861940) adding con mode: crc 2024-09-12T00:53:08.965 INFO:tasks.workunit.client.0.smithi073.stderr: -184> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x562324861940) adding con mode: crc 2024-09-12T00:53:08.965 INFO:tasks.workunit.client.0.smithi073.stderr: -183> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x562324861940) adding con mode: secure 2024-09-12T00:53:08.965 INFO:tasks.workunit.client.0.smithi073.stderr: -182> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x562324861940) adding con mode: crc 2024-09-12T00:53:08.965 INFO:tasks.workunit.client.0.smithi073.stderr: -181> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x562324861940) adding con mode: secure 2024-09-12T00:53:08.966 INFO:tasks.workunit.client.0.smithi073.stderr: -180> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x562324861940) adding con mode: crc 2024-09-12T00:53:08.966 INFO:tasks.workunit.client.0.smithi073.stderr: -179> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x562324861940) adding con mode: secure 2024-09-12T00:53:08.966 INFO:tasks.workunit.client.0.smithi073.stderr: -178> 2024-09-12T00:53:08.657+0000 7f8690098800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:08.966 INFO:tasks.workunit.client.0.smithi073.stderr: -177> 2024-09-12T00:53:08.657+0000 7f8690098800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:08.966 INFO:tasks.workunit.client.0.smithi073.stderr: -176> 2024-09-12T00:53:08.657+0000 7f8690098800 5 asok(0x5623245ad630) register_command rotate-key cmddesc rotate-key hook 0x562324861a88 EEXIST 2024-09-12T00:53:08.966 INFO:tasks.workunit.client.0.smithi073.stderr: -175> 2024-09-12T00:53:08.657+0000 7f8690098800 10 monclient: _reopen_session rank -1 2024-09-12T00:53:08.966 INFO:tasks.workunit.client.0.smithi073.stderr: -174> 2024-09-12T00:53:08.657+0000 7f8690098800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:53:08.966 INFO:tasks.workunit.client.0.smithi073.stderr: -173> 2024-09-12T00:53:08.657+0000 7f8690098800 10 monclient(hunting): picked mon.noname-b con 0x56232489dcf0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:53:08.966 INFO:tasks.workunit.client.0.smithi073.stderr: -172> 2024-09-12T00:53:08.657+0000 7f8690098800 10 monclient(hunting): picked mon.noname-c con 0x5623248a3820 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:53:08.966 INFO:tasks.workunit.client.0.smithi073.stderr: -171> 2024-09-12T00:53:08.657+0000 7f8690098800 10 monclient(hunting): picked mon.noname-a con 0x5623248939b0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:53:08.966 INFO:tasks.workunit.client.0.smithi073.stderr: -170> 2024-09-12T00:53:08.657+0000 7f8690098800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:08.966 INFO:tasks.workunit.client.0.smithi073.stderr: -169> 2024-09-12T00:53:08.657+0000 7f8690098800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:08.966 INFO:tasks.workunit.client.0.smithi073.stderr: -168> 2024-09-12T00:53:08.657+0000 7f8690098800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:08.967 INFO:tasks.workunit.client.0.smithi073.stderr: -167> 2024-09-12T00:53:08.657+0000 7f8690098800 10 monclient(hunting): _renew_subs 2024-09-12T00:53:08.967 INFO:tasks.workunit.client.0.smithi073.stderr: -166> 2024-09-12T00:53:08.657+0000 7f8690098800 10 monclient(hunting): authenticate will time out at 2249.327432s 2024-09-12T00:53:08.967 INFO:tasks.workunit.client.0.smithi073.stderr: -165> 2024-09-12T00:53:08.657+0000 7f868d381640 10 monclient(hunting): get_auth_request con 0x5623248a3820 auth_method 0 2024-09-12T00:53:08.967 INFO:tasks.workunit.client.0.smithi073.stderr: -164> 2024-09-12T00:53:08.657+0000 7f868d381640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:08.967 INFO:tasks.workunit.client.0.smithi073.stderr: -163> 2024-09-12T00:53:08.657+0000 7f868d381640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:08.967 INFO:tasks.workunit.client.0.smithi073.stderr: -162> 2024-09-12T00:53:08.657+0000 7f868d381640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:08.967 INFO:tasks.workunit.client.0.smithi073.stderr: -161> 2024-09-12T00:53:08.657+0000 7f868e383640 10 monclient(hunting): get_auth_request con 0x5623248939b0 auth_method 0 2024-09-12T00:53:08.967 INFO:tasks.workunit.client.0.smithi073.stderr: -160> 2024-09-12T00:53:08.657+0000 7f868e383640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:08.967 INFO:tasks.workunit.client.0.smithi073.stderr: -159> 2024-09-12T00:53:08.657+0000 7f868e383640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:08.967 INFO:tasks.workunit.client.0.smithi073.stderr: -158> 2024-09-12T00:53:08.657+0000 7f868e383640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:08.967 INFO:tasks.workunit.client.0.smithi073.stderr: -157> 2024-09-12T00:53:08.657+0000 7f868d381640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:08.967 INFO:tasks.workunit.client.0.smithi073.stderr: -156> 2024-09-12T00:53:08.657+0000 7f868d381640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:08.967 INFO:tasks.workunit.client.0.smithi073.stderr: -155> 2024-09-12T00:53:08.657+0000 7f868d381640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:08.968 INFO:tasks.workunit.client.0.smithi073.stderr: -154> 2024-09-12T00:53:08.657+0000 7f868e383640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:08.968 INFO:tasks.workunit.client.0.smithi073.stderr: -153> 2024-09-12T00:53:08.657+0000 7f868e383640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:08.968 INFO:tasks.workunit.client.0.smithi073.stderr: -152> 2024-09-12T00:53:08.657+0000 7f868e383640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:08.968 INFO:tasks.workunit.client.0.smithi073.stderr: -151> 2024-09-12T00:53:08.657+0000 7f868d381640 10 monclient(hunting): handle_auth_done global_id 7526 payload 824 2024-09-12T00:53:08.968 INFO:tasks.workunit.client.0.smithi073.stderr: -150> 2024-09-12T00:53:08.657+0000 7f868d381640 10 monclient: _finish_hunting 0 2024-09-12T00:53:08.968 INFO:tasks.workunit.client.0.smithi073.stderr: -149> 2024-09-12T00:53:08.657+0000 7f868d381640 1 monclient: found mon.noname-c 2024-09-12T00:53:08.968 INFO:tasks.workunit.client.0.smithi073.stderr: -148> 2024-09-12T00:53:08.657+0000 7f868d381640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.73:3301/0 2024-09-12T00:53:08.968 INFO:tasks.workunit.client.0.smithi073.stderr: -147> 2024-09-12T00:53:08.657+0000 7f855f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:08.968 INFO:tasks.workunit.client.0.smithi073.stderr: -146> 2024-09-12T00:53:08.657+0000 7f855f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:53:08.968 INFO:tasks.workunit.client.0.smithi073.stderr: -145> 2024-09-12T00:53:08.657+0000 7f855f7fe640 10 monclient: dump: 2024-09-12T00:53:08.968 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:53:08.968 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:53:08.968 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:08.969 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:08.969 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:08.969 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:53:08.969 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:53:08.969 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:53:08.969 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:53:08.969 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:08.969 INFO:tasks.workunit.client.0.smithi073.stderr: -144> 2024-09-12T00:53:08.657+0000 7f855f7fe640 10 monclient: _finish_auth 0 2024-09-12T00:53:08.969 INFO:tasks.workunit.client.0.smithi073.stderr: -143> 2024-09-12T00:53:08.658+0000 7f855f7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:53:08.969 INFO:tasks.workunit.client.0.smithi073.stderr: -142> 2024-09-12T00:53:08.658+0000 7f855f7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:53:08.969 INFO:tasks.workunit.client.0.smithi073.stderr: -141> 2024-09-12T00:53:08.658+0000 7f855f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:08.969 INFO:tasks.workunit.client.0.smithi073.stderr: -140> 2024-09-12T00:53:08.658+0000 7f855f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:53:08.969 INFO:tasks.workunit.client.0.smithi073.stderr: -139> 2024-09-12T00:53:08.658+0000 7f855f7fe640 10 monclient: dump: 2024-09-12T00:53:08.970 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:53:08.970 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:53:08.970 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:08.970 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:08.970 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:08.970 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:53:08.970 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:53:08.970 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:53:08.970 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:53:08.970 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:08.970 INFO:tasks.workunit.client.0.smithi073.stderr: -138> 2024-09-12T00:53:08.658+0000 7f8690098800 5 monclient: authenticate success, global_id 7526 2024-09-12T00:53:08.970 INFO:tasks.workunit.client.0.smithi073.stderr: -137> 2024-09-12T00:53:08.658+0000 7f8690098800 10 monclient: _renew_subs 2024-09-12T00:53:08.970 INFO:tasks.workunit.client.0.smithi073.stderr: -136> 2024-09-12T00:53:08.658+0000 7f85717fa640 4 set_mon_vals no callback set 2024-09-12T00:53:08.970 INFO:tasks.workunit.client.0.smithi073.stderr: -135> 2024-09-12T00:53:08.658+0000 7f8690098800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:53:08.971 INFO:tasks.workunit.client.0.smithi073.stderr: -134> 2024-09-12T00:53:08.658+0000 7f8690098800 10 monclient: _renew_subs 2024-09-12T00:53:08.971 INFO:tasks.workunit.client.0.smithi073.stderr: -133> 2024-09-12T00:53:08.658+0000 7f8690098800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:53:08.971 INFO:tasks.workunit.client.0.smithi073.stderr: -132> 2024-09-12T00:53:08.658+0000 7f8690098800 1 librados: init done 2024-09-12T00:53:08.971 INFO:tasks.workunit.client.0.smithi073.stderr: -131> 2024-09-12T00:53:08.658+0000 7f8690098800 5 asok(0x5623245ad630) register_command cr dump hook 0x56232486be68 2024-09-12T00:53:08.971 INFO:tasks.workunit.client.0.smithi073.stderr: -130> 2024-09-12T00:53:08.659+0000 7f8690098800 20 rados->read ofs=0 len=0 2024-09-12T00:53:08.971 INFO:tasks.workunit.client.0.smithi073.stderr: -129> 2024-09-12T00:53:08.659+0000 7f855f7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:53:08.971 INFO:tasks.workunit.client.0.smithi073.stderr: -128> 2024-09-12T00:53:08.659+0000 7f855f7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:53:08.971 INFO:tasks.workunit.client.0.smithi073.stderr: -127> 2024-09-12T00:53:08.659+0000 7f855f7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:53:08.971 INFO:tasks.workunit.client.0.smithi073.stderr: -126> 2024-09-12T00:53:08.660+0000 7f868db82640 10 monclient: get_auth_request con 0x7f85580764a0 auth_method 0 2024-09-12T00:53:08.971 INFO:tasks.workunit.client.0.smithi073.stderr: -125> 2024-09-12T00:53:08.660+0000 7f868e383640 10 monclient: get_auth_request con 0x5623248b8d90 auth_method 0 2024-09-12T00:53:08.971 INFO:tasks.workunit.client.0.smithi073.stderr: -124> 2024-09-12T00:53:08.660+0000 7f8690098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:08.971 INFO:tasks.workunit.client.0.smithi073.stderr: -123> 2024-09-12T00:53:08.660+0000 7f8690098800 20 realm 2024-09-12T00:53:08.971 INFO:tasks.workunit.client.0.smithi073.stderr: -122> 2024-09-12T00:53:08.660+0000 7f8690098800 20 rados->read ofs=0 len=0 2024-09-12T00:53:08.972 INFO:tasks.workunit.client.0.smithi073.stderr: -121> 2024-09-12T00:53:08.660+0000 7f8690098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:08.972 INFO:tasks.workunit.client.0.smithi073.stderr: -120> 2024-09-12T00:53:08.661+0000 7f8690098800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:08.972 INFO:tasks.workunit.client.0.smithi073.stderr: -119> 2024-09-12T00:53:08.661+0000 7f8690098800 20 rados->read ofs=0 len=0 2024-09-12T00:53:08.972 INFO:tasks.workunit.client.0.smithi073.stderr: -118> 2024-09-12T00:53:08.661+0000 7f8690098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:08.972 INFO:tasks.workunit.client.0.smithi073.stderr: -117> 2024-09-12T00:53:08.661+0000 7f8690098800 20 rados->read ofs=0 len=0 2024-09-12T00:53:08.972 INFO:tasks.workunit.client.0.smithi073.stderr: -116> 2024-09-12T00:53:08.661+0000 7f868db82640 10 monclient: get_auth_request con 0x5623248bcfc0 auth_method 0 2024-09-12T00:53:08.972 INFO:tasks.workunit.client.0.smithi073.stderr: -115> 2024-09-12T00:53:08.662+0000 7f8690098800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:08.972 INFO:tasks.workunit.client.0.smithi073.stderr: -114> 2024-09-12T00:53:08.662+0000 7f8690098800 20 rados->read ofs=0 len=0 2024-09-12T00:53:08.972 INFO:tasks.workunit.client.0.smithi073.stderr: -113> 2024-09-12T00:53:08.662+0000 7f868d381640 10 monclient: get_auth_request con 0x5623248c0820 auth_method 0 2024-09-12T00:53:08.972 INFO:tasks.workunit.client.0.smithi073.stderr: -112> 2024-09-12T00:53:08.663+0000 7f8690098800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:08.972 INFO:tasks.workunit.client.0.smithi073.stderr: -111> 2024-09-12T00:53:08.663+0000 7f8690098800 20 searching for the correct realm 2024-09-12T00:53:08.972 INFO:tasks.workunit.client.0.smithi073.stderr: -110> 2024-09-12T00:53:08.663+0000 7f868e383640 10 monclient: get_auth_request con 0x5623248c55e0 auth_method 0 2024-09-12T00:53:08.972 INFO:tasks.workunit.client.0.smithi073.stderr: -109> 2024-09-12T00:53:08.664+0000 7f868db82640 10 monclient: get_auth_request con 0x7f8688032970 auth_method 0 2024-09-12T00:53:08.973 INFO:tasks.workunit.client.0.smithi073.stderr: -108> 2024-09-12T00:53:08.664+0000 7f868d381640 10 monclient: get_auth_request con 0x7f8680040060 auth_method 0 2024-09-12T00:53:08.973 INFO:tasks.workunit.client.0.smithi073.stderr: -107> 2024-09-12T00:53:08.665+0000 7f868e383640 10 monclient: get_auth_request con 0x7f867806d060 auth_method 0 2024-09-12T00:53:08.973 INFO:tasks.workunit.client.0.smithi073.stderr: -106> 2024-09-12T00:53:08.665+0000 7f868e383640 0 -- 172.21.15.73:0/3338039331 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f867806d060 msgr2=0x7f86780c6050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:08.973 INFO:tasks.workunit.client.0.smithi073.stderr: -105> 2024-09-12T00:53:08.866+0000 7f868e383640 10 monclient: get_auth_request con 0x7f867806d060 auth_method 0 2024-09-12T00:53:08.973 INFO:tasks.workunit.client.0.smithi073.stderr: -104> 2024-09-12T00:53:08.870+0000 7f868db82640 10 monclient: get_auth_request con 0x7f8688044040 auth_method 0 2024-09-12T00:53:08.973 INFO:tasks.workunit.client.0.smithi073.stderr: -103> 2024-09-12T00:53:08.871+0000 7f868e383640 0 -- 172.21.15.73:0/3338039331 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f867806d060 msgr2=0x7f86780c6050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:08.973 INFO:tasks.workunit.client.0.smithi073.stderr: -102> 2024-09-12T00:53:08.871+0000 7f855f7fe640 1 client.7526.objecter ms_handle_reset 0x7f867806d060 session 0x7f86780be040 osd.4 2024-09-12T00:53:08.973 INFO:tasks.workunit.client.0.smithi073.stderr: -101> 2024-09-12T00:53:08.871+0000 7f855f7fe640 10 monclient: _renew_subs 2024-09-12T00:53:08.973 INFO:tasks.workunit.client.0.smithi073.stderr: -100> 2024-09-12T00:53:08.871+0000 7f855f7fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:53:08.973 INFO:tasks.workunit.client.0.smithi073.stderr: -99> 2024-09-12T00:53:08.871+0000 7f868e383640 10 monclient: get_auth_request con 0x7f85580863a0 auth_method 0 2024-09-12T00:53:08.973 INFO:tasks.workunit.client.0.smithi073.stderr: -98> 2024-09-12T00:53:08.875+0000 7f8690098800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:53:08.973 INFO:tasks.workunit.client.0.smithi073.stderr: -97> 2024-09-12T00:53:08.875+0000 7f8690098800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:08.973 INFO:tasks.workunit.client.0.smithi073.stderr: -96> 2024-09-12T00:53:08.875+0000 7f8690098800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:53:08.974 INFO:tasks.workunit.client.0.smithi073.stderr: -95> 2024-09-12T00:53:08.875+0000 7f8690098800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:08.974 INFO:tasks.workunit.client.0.smithi073.stderr: -94> 2024-09-12T00:53:08.875+0000 7f8690098800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:08.974 INFO:tasks.workunit.client.0.smithi073.stderr: -93> 2024-09-12T00:53:08.875+0000 7f8690098800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:08.974 INFO:tasks.workunit.client.0.smithi073.stderr: -92> 2024-09-12T00:53:08.875+0000 7f8690098800 20 rados->read ofs=0 len=0 2024-09-12T00:53:08.974 INFO:tasks.workunit.client.0.smithi073.stderr: -91> 2024-09-12T00:53:08.876+0000 7f8690098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:08.974 INFO:tasks.workunit.client.0.smithi073.stderr: -90> 2024-09-12T00:53:08.876+0000 7f8690098800 20 rados->read ofs=0 len=0 2024-09-12T00:53:08.974 INFO:tasks.workunit.client.0.smithi073.stderr: -89> 2024-09-12T00:53:08.876+0000 7f8690098800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:08.974 INFO:tasks.workunit.client.0.smithi073.stderr: -88> 2024-09-12T00:53:08.876+0000 7f8690098800 20 rados->read ofs=0 len=0 2024-09-12T00:53:08.974 INFO:tasks.workunit.client.0.smithi073.stderr: -87> 2024-09-12T00:53:08.876+0000 7f8690098800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:08.974 INFO:tasks.workunit.client.0.smithi073.stderr: -86> 2024-09-12T00:53:08.876+0000 7f8690098800 20 zone default found 2024-09-12T00:53:08.974 INFO:tasks.workunit.client.0.smithi073.stderr: -85> 2024-09-12T00:53:08.876+0000 7f8690098800 4 Realm: () 2024-09-12T00:53:08.974 INFO:tasks.workunit.client.0.smithi073.stderr: -84> 2024-09-12T00:53:08.876+0000 7f8690098800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:53:08.974 INFO:tasks.workunit.client.0.smithi073.stderr: -83> 2024-09-12T00:53:08.876+0000 7f8690098800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:53:08.974 INFO:tasks.workunit.client.0.smithi073.stderr: -82> 2024-09-12T00:53:08.876+0000 7f8690098800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:08.975 INFO:tasks.workunit.client.0.smithi073.stderr: -81> 2024-09-12T00:53:08.876+0000 7f8690098800 20 zonegroup default 2024-09-12T00:53:08.975 INFO:tasks.workunit.client.0.smithi073.stderr: -80> 2024-09-12T00:53:08.876+0000 7f8690098800 20 rados->read ofs=0 len=0 2024-09-12T00:53:08.975 INFO:tasks.workunit.client.0.smithi073.stderr: -79> 2024-09-12T00:53:08.876+0000 7f8690098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:08.975 INFO:tasks.workunit.client.0.smithi073.stderr: -78> 2024-09-12T00:53:08.876+0000 7f8690098800 20 rados->read ofs=0 len=0 2024-09-12T00:53:08.975 INFO:tasks.workunit.client.0.smithi073.stderr: -77> 2024-09-12T00:53:08.877+0000 7f8690098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:08.975 INFO:tasks.workunit.client.0.smithi073.stderr: -76> 2024-09-12T00:53:08.877+0000 7f8690098800 20 rados->read ofs=0 len=0 2024-09-12T00:53:08.975 INFO:tasks.workunit.client.0.smithi073.stderr: -75> 2024-09-12T00:53:08.877+0000 7f8690098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:08.975 INFO:tasks.workunit.client.0.smithi073.stderr: -74> 2024-09-12T00:53:08.877+0000 7f8690098800 20 started sync module instance, tier type = 2024-09-12T00:53:08.975 INFO:tasks.workunit.client.0.smithi073.stderr: -73> 2024-09-12T00:53:08.877+0000 7f8690098800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:53:08.975 INFO:tasks.workunit.client.0.smithi073.stderr: -72> 2024-09-12T00:53:08.887+0000 7f8690098800 20 add_watcher() i=0 2024-09-12T00:53:08.975 INFO:tasks.workunit.client.0.smithi073.stderr: -71> 2024-09-12T00:53:08.887+0000 7f8690098800 20 add_watcher() i=1 2024-09-12T00:53:08.975 INFO:tasks.workunit.client.0.smithi073.stderr: -70> 2024-09-12T00:53:08.887+0000 7f8690098800 20 add_watcher() i=2 2024-09-12T00:53:08.975 INFO:tasks.workunit.client.0.smithi073.stderr: -69> 2024-09-12T00:53:08.887+0000 7f8690098800 20 add_watcher() i=3 2024-09-12T00:53:08.976 INFO:tasks.workunit.client.0.smithi073.stderr: -68> 2024-09-12T00:53:08.887+0000 7f8690098800 20 add_watcher() i=4 2024-09-12T00:53:08.976 INFO:tasks.workunit.client.0.smithi073.stderr: -67> 2024-09-12T00:53:08.887+0000 7f8690098800 20 add_watcher() i=5 2024-09-12T00:53:08.976 INFO:tasks.workunit.client.0.smithi073.stderr: -66> 2024-09-12T00:53:08.887+0000 7f8690098800 20 add_watcher() i=6 2024-09-12T00:53:08.976 INFO:tasks.workunit.client.0.smithi073.stderr: -65> 2024-09-12T00:53:08.888+0000 7f8690098800 20 add_watcher() i=7 2024-09-12T00:53:08.976 INFO:tasks.workunit.client.0.smithi073.stderr: -64> 2024-09-12T00:53:08.888+0000 7f8690098800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:08.976 INFO:tasks.workunit.client.0.smithi073.stderr: -63> 2024-09-12T00:53:08.889+0000 7f8690098800 5 AuthRegistry(0x7ffece801f80) adding auth protocol: cephx 2024-09-12T00:53:08.976 INFO:tasks.workunit.client.0.smithi073.stderr: -62> 2024-09-12T00:53:08.889+0000 7f8690098800 5 AuthRegistry(0x7ffece801f80) adding auth protocol: cephx 2024-09-12T00:53:08.976 INFO:tasks.workunit.client.0.smithi073.stderr: -61> 2024-09-12T00:53:08.889+0000 7f8690098800 5 AuthRegistry(0x7ffece801f80) adding auth protocol: cephx 2024-09-12T00:53:08.976 INFO:tasks.workunit.client.0.smithi073.stderr: -60> 2024-09-12T00:53:08.889+0000 7f8690098800 5 AuthRegistry(0x7ffece801f80) adding con mode: secure 2024-09-12T00:53:08.976 INFO:tasks.workunit.client.0.smithi073.stderr: -59> 2024-09-12T00:53:08.889+0000 7f8690098800 5 AuthRegistry(0x7ffece801f80) adding con mode: crc 2024-09-12T00:53:08.976 INFO:tasks.workunit.client.0.smithi073.stderr: -58> 2024-09-12T00:53:08.889+0000 7f8690098800 5 AuthRegistry(0x7ffece801f80) adding con mode: secure 2024-09-12T00:53:08.976 INFO:tasks.workunit.client.0.smithi073.stderr: -57> 2024-09-12T00:53:08.889+0000 7f8690098800 5 AuthRegistry(0x7ffece801f80) adding con mode: crc 2024-09-12T00:53:08.976 INFO:tasks.workunit.client.0.smithi073.stderr: -56> 2024-09-12T00:53:08.889+0000 7f8690098800 5 AuthRegistry(0x7ffece801f80) adding con mode: secure 2024-09-12T00:53:08.976 INFO:tasks.workunit.client.0.smithi073.stderr: -55> 2024-09-12T00:53:08.889+0000 7f8690098800 5 AuthRegistry(0x7ffece801f80) adding con mode: crc 2024-09-12T00:53:08.977 INFO:tasks.workunit.client.0.smithi073.stderr: -54> 2024-09-12T00:53:08.889+0000 7f8690098800 5 AuthRegistry(0x7ffece801f80) adding con mode: crc 2024-09-12T00:53:08.977 INFO:tasks.workunit.client.0.smithi073.stderr: -53> 2024-09-12T00:53:08.889+0000 7f8690098800 5 AuthRegistry(0x7ffece801f80) adding con mode: secure 2024-09-12T00:53:08.977 INFO:tasks.workunit.client.0.smithi073.stderr: -52> 2024-09-12T00:53:08.889+0000 7f8690098800 5 AuthRegistry(0x7ffece801f80) adding con mode: crc 2024-09-12T00:53:08.977 INFO:tasks.workunit.client.0.smithi073.stderr: -51> 2024-09-12T00:53:08.889+0000 7f8690098800 5 AuthRegistry(0x7ffece801f80) adding con mode: secure 2024-09-12T00:53:08.977 INFO:tasks.workunit.client.0.smithi073.stderr: -50> 2024-09-12T00:53:08.889+0000 7f8690098800 5 AuthRegistry(0x7ffece801f80) adding con mode: crc 2024-09-12T00:53:08.977 INFO:tasks.workunit.client.0.smithi073.stderr: -49> 2024-09-12T00:53:08.889+0000 7f8690098800 5 AuthRegistry(0x7ffece801f80) adding con mode: secure 2024-09-12T00:53:08.977 INFO:tasks.workunit.client.0.smithi073.stderr: -48> 2024-09-12T00:53:08.889+0000 7f853ffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:08.977 INFO:tasks.workunit.client.0.smithi073.stderr: -47> 2024-09-12T00:53:08.890+0000 7f8690098800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:08.977 INFO:tasks.workunit.client.0.smithi073.stderr: -46> 2024-09-12T00:53:08.890+0000 7f8690098800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:08.977 INFO:tasks.workunit.client.0.smithi073.stderr: -45> 2024-09-12T00:53:08.890+0000 7f8690098800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:08.977 INFO:tasks.workunit.client.0.smithi073.stderr: -44> 2024-09-12T00:53:08.890+0000 7f8690098800 5 asok(0x5623245ad630) register_command cache list hook 0x562324893d90 2024-09-12T00:53:08.977 INFO:tasks.workunit.client.0.smithi073.stderr: -43> 2024-09-12T00:53:08.890+0000 7f8690098800 5 asok(0x5623245ad630) register_command cache inspect hook 0x562324893d90 2024-09-12T00:53:08.977 INFO:tasks.workunit.client.0.smithi073.stderr: -42> 2024-09-12T00:53:08.890+0000 7f8690098800 5 asok(0x5623245ad630) register_command cache erase hook 0x562324893d90 2024-09-12T00:53:08.978 INFO:tasks.workunit.client.0.smithi073.stderr: -41> 2024-09-12T00:53:08.890+0000 7f8690098800 5 asok(0x5623245ad630) register_command cache zap hook 0x562324893d90 2024-09-12T00:53:08.978 INFO:tasks.workunit.client.0.smithi073.stderr: -40> 2024-09-12T00:53:08.890+0000 7f8690098800 5 note: GC not initialized 2024-09-12T00:53:08.978 INFO:tasks.workunit.client.0.smithi073.stderr: -39> 2024-09-12T00:53:08.890+0000 7f853effd640 20 reqs_thread_entry: start 2024-09-12T00:53:08.978 INFO:tasks.workunit.client.0.smithi073.stderr: -38> 2024-09-12T00:53:08.890+0000 7f8690098800 5 asok(0x5623245ad630) register_command sync trace show hook 0x7f86880092d0 2024-09-12T00:53:08.978 INFO:tasks.workunit.client.0.smithi073.stderr: -37> 2024-09-12T00:53:08.890+0000 7f8690098800 5 asok(0x5623245ad630) register_command sync trace history hook 0x7f86880092d0 2024-09-12T00:53:08.978 INFO:tasks.workunit.client.0.smithi073.stderr: -36> 2024-09-12T00:53:08.890+0000 7f8690098800 5 asok(0x5623245ad630) register_command sync trace active hook 0x7f86880092d0 2024-09-12T00:53:08.978 INFO:tasks.workunit.client.0.smithi073.stderr: -35> 2024-09-12T00:53:08.890+0000 7f8690098800 5 asok(0x5623245ad630) register_command sync trace active_short hook 0x7f86880092d0 2024-09-12T00:53:08.978 INFO:tasks.workunit.client.0.smithi073.stderr: -34> 2024-09-12T00:53:08.890+0000 7f8690098800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:08.978 INFO:tasks.workunit.client.0.smithi073.stderr: -33> 2024-09-12T00:53:08.890+0000 7f8690098800 20 Filter name: none 2024-09-12T00:53:08.978 INFO:tasks.workunit.client.0.smithi073.stderr: -32> 2024-09-12T00:53:08.890+0000 7f853cff9640 20 reqs_thread_entry: start 2024-09-12T00:53:08.978 INFO:tasks.workunit.client.0.smithi073.stderr: -31> 2024-09-12T00:53:08.890+0000 7f8690098800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:53:08.978 INFO:tasks.workunit.client.0.smithi073.stderr: -30> 2024-09-12T00:53:08.890+0000 7f8690098800 20 rados->read ofs=0 len=0 2024-09-12T00:53:08.978 INFO:tasks.workunit.client.0.smithi073.stderr: -29> 2024-09-12T00:53:08.891+0000 7f8690098800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:53:08.978 INFO:tasks.workunit.client.0.smithi073.stderr: -28> 2024-09-12T00:53:08.891+0000 7f8690098800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:53:08.979 INFO:tasks.workunit.client.0.smithi073.stderr: -27> 2024-09-12T00:53:08.891+0000 7f8690098800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:53:08.979 INFO:tasks.workunit.client.0.smithi073.stderr: -26> 2024-09-12T00:53:08.891+0000 7f8690098800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39 : miss 2024-09-12T00:53:08.979 INFO:tasks.workunit.client.0.smithi073.stderr: -25> 2024-09-12T00:53:08.891+0000 7f8690098800 20 rados->read ofs=0 len=0 2024-09-12T00:53:08.979 INFO:tasks.workunit.client.0.smithi073.stderr: -24> 2024-09-12T00:53:08.891+0000 7f8690098800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:53:08.979 INFO:tasks.workunit.client.0.smithi073.stderr: -23> 2024-09-12T00:53:08.891+0000 7f8690098800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39 info.flags=0x17 2024-09-12T00:53:08.979 INFO:tasks.workunit.client.0.smithi073.stderr: -22> 2024-09-12T00:53:08.891+0000 7f8690098800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39 to cache LRU end 2024-09-12T00:53:08.979 INFO:tasks.workunit.client.0.smithi073.stderr: -21> 2024-09-12T00:53:08.891+0000 7f8690098800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:53:08.979 INFO:tasks.workunit.client.0.smithi073.stderr: -20> 2024-09-12T00:53:08.891+0000 7f8690098800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:08.979 INFO:tasks.workunit.client.0.smithi073.stderr: -19> 2024-09-12T00:53:08.891+0000 7f8690098800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39 2024-09-12T00:53:08.979 INFO:tasks.workunit.client.0.smithi073.stderr: -18> 2024-09-12T00:53:08.895+0000 7f8690098800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39 info.flags=0x17 2024-09-12T00:53:08.979 INFO:tasks.workunit.client.0.smithi073.stderr: -17> 2024-09-12T00:53:08.895+0000 7f8690098800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39 to cache LRU end 2024-09-12T00:53:08.979 INFO:tasks.workunit.client.0.smithi073.stderr: -16> 2024-09-12T00:53:08.895+0000 7f8690098800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:08.979 INFO:tasks.workunit.client.0.smithi073.stderr: -15> 2024-09-12T00:53:08.895+0000 7f8690098800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39, ofs0, ns] 2024-09-12T00:53:08.979 INFO:tasks.workunit.client.0.smithi073.stderr: -14> 2024-09-12T00:53:08.895+0000 7f85717fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497017 cookie 94708937056128 notifier 7526 bl.length()=931 2024-09-12T00:53:08.980 INFO:tasks.workunit.client.0.smithi073.stderr: -13> 2024-09-12T00:53:08.895+0000 7f85717fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39 info.flags=0x17 2024-09-12T00:53:08.980 INFO:tasks.workunit.client.0.smithi073.stderr: -12> 2024-09-12T00:53:08.895+0000 7f85717fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39 to cache LRU end 2024-09-12T00:53:08.980 INFO:tasks.workunit.client.0.smithi073.stderr: -11> 2024-09-12T00:53:08.895+0000 7f85717fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:08.980 INFO:tasks.workunit.client.0.smithi073.stderr: -10> 2024-09-12T00:53:08.897+0000 7f8690098800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39]): orig_sources= new_sources= 2024-09-12T00:53:08.980 INFO:tasks.workunit.client.0.smithi073.stderr: -9> 2024-09-12T00:53:08.897+0000 7f8690098800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39]): potential sources added=[] removed=[] 2024-09-12T00:53:08.980 INFO:tasks.workunit.client.0.smithi073.stderr: -8> 2024-09-12T00:53:08.897+0000 7f8690098800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39]): orig_dests= new_dests= 2024-09-12T00:53:08.980 INFO:tasks.workunit.client.0.smithi073.stderr: -7> 2024-09-12T00:53:08.897+0000 7f8690098800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39]): potential dests added=[] removed=[] 2024-09-12T00:53:08.980 INFO:tasks.workunit.client.0.smithi073.stderr: -6> 2024-09-12T00:53:08.899+0000 7f8690098800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39.1.0 2024-09-12T00:53:08.980 INFO:tasks.workunit.client.0.smithi073.stderr: -5> 2024-09-12T00:53:08.899+0000 7f8690098800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39.1.0 2024-09-12T00:53:08.980 INFO:tasks.workunit.client.0.smithi073.stderr: -4> 2024-09-12T00:53:08.899+0000 7f8690098800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39.1.1 2024-09-12T00:53:08.980 INFO:tasks.workunit.client.0.smithi073.stderr: -3> 2024-09-12T00:53:08.899+0000 7f8690098800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39.1.1 2024-09-12T00:53:08.980 INFO:tasks.workunit.client.0.smithi073.stderr: -2> 2024-09-12T00:53:08.899+0000 7f8690098800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39.0 2024-09-12T00:53:08.980 INFO:tasks.workunit.client.0.smithi073.stderr: -1> 2024-09-12T00:53:08.902+0000 7f8690098800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8690098800 time 2024-09-12T00:53:08.902856+0000 2024-09-12T00:53:08.981 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:53:08.981 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:08.981 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:53:08.981 INFO:tasks.workunit.client.0.smithi073.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f869358c71a] 2024-09-12T00:53:08.981 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f869358c8d8] 2024-09-12T00:53:08.981 INFO:tasks.workunit.client.0.smithi073.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5623222e3641] 2024-09-12T00:53:08.981 INFO:tasks.workunit.client.0.smithi073.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5623222f251b] 2024-09-12T00:53:08.981 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5623222f33e4] 2024-09-12T00:53:08.981 INFO:tasks.workunit.client.0.smithi073.stderr: 6: main() 2024-09-12T00:53:08.981 INFO:tasks.workunit.client.0.smithi073.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f8692229590] 2024-09-12T00:53:08.981 INFO:tasks.workunit.client.0.smithi073.stderr: 8: __libc_start_main() 2024-09-12T00:53:08.981 INFO:tasks.workunit.client.0.smithi073.stderr: 9: _start() 2024-09-12T00:53:08.981 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:08.982 INFO:tasks.workunit.client.0.smithi073.stderr: 0> 2024-09-12T00:53:08.903+0000 7f8690098800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:53:08.982 INFO:tasks.workunit.client.0.smithi073.stderr: in thread 7f8690098800 thread_name:radosgw-admin 2024-09-12T00:53:08.982 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:08.982 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:53:08.982 INFO:tasks.workunit.client.0.smithi073.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f869223e6f0] 2024-09-12T00:53:08.982 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f869228b99c] 2024-09-12T00:53:08.982 INFO:tasks.workunit.client.0.smithi073.stderr: 3: raise() 2024-09-12T00:53:08.982 INFO:tasks.workunit.client.0.smithi073.stderr: 4: abort() 2024-09-12T00:53:08.982 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f869358c774] 2024-09-12T00:53:08.982 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f869358c8d8] 2024-09-12T00:53:08.982 INFO:tasks.workunit.client.0.smithi073.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5623222e3641] 2024-09-12T00:53:08.982 INFO:tasks.workunit.client.0.smithi073.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5623222f251b] 2024-09-12T00:53:08.982 INFO:tasks.workunit.client.0.smithi073.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5623222f33e4] 2024-09-12T00:53:08.982 INFO:tasks.workunit.client.0.smithi073.stderr: 10: main() 2024-09-12T00:53:08.983 INFO:tasks.workunit.client.0.smithi073.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f8692229590] 2024-09-12T00:53:08.983 INFO:tasks.workunit.client.0.smithi073.stderr: 12: __libc_start_main() 2024-09-12T00:53:08.983 INFO:tasks.workunit.client.0.smithi073.stderr: 13: _start() 2024-09-12T00:53:08.983 INFO:tasks.workunit.client.0.smithi073.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:53:08.983 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:08.983 INFO:tasks.workunit.client.0.smithi073.stderr:--- logging levels --- 2024-09-12T00:53:08.983 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 none 2024-09-12T00:53:08.983 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 lockdep 2024-09-12T00:53:08.983 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 context 2024-09-12T00:53:08.983 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 crush 2024-09-12T00:53:08.983 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds 2024-09-12T00:53:08.983 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_balancer 2024-09-12T00:53:08.983 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_locker 2024-09-12T00:53:08.984 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_log 2024-09-12T00:53:08.984 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_log_expire 2024-09-12T00:53:08.984 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_migrator 2024-09-12T00:53:08.984 INFO:tasks.workunit.client.0.smithi073.stderr: 3/ 5 mds_quiesce 2024-09-12T00:53:08.984 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 buffer 2024-09-12T00:53:08.984 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 timer 2024-09-12T00:53:08.984 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 filer 2024-09-12T00:53:08.984 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 striper 2024-09-12T00:53:08.984 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 objecter 2024-09-12T00:53:08.984 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rados 2024-09-12T00:53:08.984 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd 2024-09-12T00:53:08.984 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_mirror 2024-09-12T00:53:08.984 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_replay 2024-09-12T00:53:08.984 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_pwl 2024-09-12T00:53:08.985 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 journaler 2024-09-12T00:53:08.985 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 objectcacher 2024-09-12T00:53:08.985 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:53:08.985 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 client 2024-09-12T00:53:08.985 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 osd 2024-09-12T00:53:08.985 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 optracker 2024-09-12T00:53:08.985 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 objclass 2024-09-12T00:53:08.985 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 filestore 2024-09-12T00:53:08.985 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 journal 2024-09-12T00:53:08.986 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 0 ms 2024-09-12T00:53:08.986 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mon 2024-09-12T00:53:08.986 INFO:tasks.workunit.client.0.smithi073.stderr: 0/10 monc 2024-09-12T00:53:08.986 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 paxos 2024-09-12T00:53:08.986 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 tp 2024-09-12T00:53:08.986 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 auth 2024-09-12T00:53:08.986 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 crypto 2024-09-12T00:53:08.986 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 finisher 2024-09-12T00:53:08.986 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 reserver 2024-09-12T00:53:08.986 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 heartbeatmap 2024-09-12T00:53:08.986 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 perfcounter 2024-09-12T00:53:08.986 INFO:tasks.workunit.client.0.smithi073.stderr: 20/20 rgw 2024-09-12T00:53:08.986 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_sync 2024-09-12T00:53:08.986 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_datacache 2024-09-12T00:53:08.987 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_access 2024-09-12T00:53:08.987 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:53:08.987 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_flight 2024-09-12T00:53:08.987 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:53:08.987 INFO:tasks.workunit.client.0.smithi073.stderr: 20/20 rgw_notification 2024-09-12T00:53:08.987 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 javaclient 2024-09-12T00:53:08.987 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 asok 2024-09-12T00:53:08.987 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 throttle 2024-09-12T00:53:08.987 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 0 refs 2024-09-12T00:53:08.987 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 compressor 2024-09-12T00:53:08.987 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 bluestore 2024-09-12T00:53:08.987 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 bluefs 2024-09-12T00:53:08.987 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 bdev 2024-09-12T00:53:08.987 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 kstore 2024-09-12T00:53:08.988 INFO:tasks.workunit.client.0.smithi073.stderr: 4/ 5 rocksdb 2024-09-12T00:53:08.988 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 fuse 2024-09-12T00:53:08.988 INFO:tasks.workunit.client.0.smithi073.stderr: 2/ 5 mgr 2024-09-12T00:53:08.988 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mgrc 2024-09-12T00:53:08.988 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 dpdk 2024-09-12T00:53:08.988 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 eventtrace 2024-09-12T00:53:08.988 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 prioritycache 2024-09-12T00:53:08.988 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 test 2024-09-12T00:53:08.988 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:53:08.988 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cephsqlite 2024-09-12T00:53:08.988 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:53:08.988 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore 2024-09-12T00:53:08.988 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_onode 2024-09-12T00:53:08.989 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_odata 2024-09-12T00:53:08.989 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_omap 2024-09-12T00:53:08.989 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_tm 2024-09-12T00:53:08.989 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_t 2024-09-12T00:53:08.989 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:53:08.989 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_epm 2024-09-12T00:53:08.989 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_lba 2024-09-12T00:53:08.989 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:53:08.989 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_cache 2024-09-12T00:53:08.989 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_journal 2024-09-12T00:53:08.989 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_device 2024-09-12T00:53:08.989 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_backref 2024-09-12T00:53:08.989 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 alienstore 2024-09-12T00:53:08.990 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mclock 2024-09-12T00:53:08.990 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cyanstore 2024-09-12T00:53:08.990 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 ceph_exporter 2024-09-12T00:53:08.990 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 memstore 2024-09-12T00:53:08.990 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 trace 2024-09-12T00:53:08.990 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 ceph_dedup 2024-09-12T00:53:08.990 INFO:tasks.workunit.client.0.smithi073.stderr: -2/-2 (syslog threshold) 2024-09-12T00:53:08.990 INFO:tasks.workunit.client.0.smithi073.stderr: 99/99 (stderr threshold) 2024-09-12T00:53:08.990 INFO:tasks.workunit.client.0.smithi073.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:53:08.990 INFO:tasks.workunit.client.0.smithi073.stderr: 7f853cff9640 / http_manager 2024-09-12T00:53:08.990 INFO:tasks.workunit.client.0.smithi073.stderr: 7f853effd640 / http_manager 2024-09-12T00:53:08.990 INFO:tasks.workunit.client.0.smithi073.stderr: 7f853ffff640 / rgw_dt_lg_renew 2024-09-12T00:53:08.990 INFO:tasks.workunit.client.0.smithi073.stderr: 7f855f7fe640 / ms_dispatch 2024-09-12T00:53:08.990 INFO:tasks.workunit.client.0.smithi073.stderr: 7f85717fa640 / io_context_pool 2024-09-12T00:53:08.991 INFO:tasks.workunit.client.0.smithi073.stderr: 7f85737fe640 / ms_dispatch 2024-09-12T00:53:08.991 INFO:tasks.workunit.client.0.smithi073.stderr: 7f857a604640 / ms_dispatch 2024-09-12T00:53:08.991 INFO:tasks.workunit.client.0.smithi073.stderr: 7f857be07640 / io_context_pool 2024-09-12T00:53:08.991 INFO:tasks.workunit.client.0.smithi073.stderr: 7f868d381640 / msgr-worker-2 2024-09-12T00:53:08.991 INFO:tasks.workunit.client.0.smithi073.stderr: 7f868db82640 / msgr-worker-1 2024-09-12T00:53:08.991 INFO:tasks.workunit.client.0.smithi073.stderr: 7f868e383640 / msgr-worker-0 2024-09-12T00:53:08.991 INFO:tasks.workunit.client.0.smithi073.stderr: 7f868eb84640 / io_context_pool 2024-09-12T00:53:08.991 INFO:tasks.workunit.client.0.smithi073.stderr: 7f8690098800 / radosgw-admin 2024-09-12T00:53:08.991 INFO:tasks.workunit.client.0.smithi073.stderr: max_recent 500 2024-09-12T00:53:08.991 INFO:tasks.workunit.client.0.smithi073.stderr: max_new 1000 2024-09-12T00:53:08.991 INFO:tasks.workunit.client.0.smithi073.stderr: log_file /var/log/ceph/ceph-client.admin.142538.log 2024-09-12T00:53:08.991 INFO:tasks.workunit.client.0.smithi073.stderr:--- end dump of recent events --- 2024-09-12T00:53:08.991 INFO:tasks.workunit.client.0.smithi073.stderr:--- begin dump of recent events --- 2024-09-12T00:53:08.991 INFO:tasks.workunit.client.0.smithi073.stderr: -499> 2024-09-12T00:53:08.642+0000 7f857be07640 10 monclient: _check_auth_tickets 2024-09-12T00:53:08.992 INFO:tasks.workunit.client.0.smithi073.stderr: -498> 2024-09-12T00:53:08.642+0000 7f8690098800 5 monclient: authenticate success, global_id 8010 2024-09-12T00:53:08.992 INFO:tasks.workunit.client.0.smithi073.stderr: -497> 2024-09-12T00:53:08.642+0000 7f857be07640 10 monclient: handle_config config(0 keys) 2024-09-12T00:53:08.992 INFO:tasks.workunit.client.0.smithi073.stderr: -496> 2024-09-12T00:53:08.642+0000 7f8690098800 10 monclient: get_monmap_and_config success 2024-09-12T00:53:08.992 INFO:tasks.workunit.client.0.smithi073.stderr: -495> 2024-09-12T00:53:08.642+0000 7f8690098800 4 set_mon_vals no callback set 2024-09-12T00:53:08.992 INFO:tasks.workunit.client.0.smithi073.stderr: -494> 2024-09-12T00:53:08.642+0000 7f857be07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:08.992 INFO:tasks.workunit.client.0.smithi073.stderr: -493> 2024-09-12T00:53:08.642+0000 7f857be07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:53:08.992 INFO:tasks.workunit.client.0.smithi073.stderr: -492> 2024-09-12T00:53:08.642+0000 7f857be07640 10 monclient: dump: 2024-09-12T00:53:08.992 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:53:08.992 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:53:08.992 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:08.992 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:08.992 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:08.992 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:53:08.993 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:53:08.993 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:53:08.993 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:53:08.993 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:08.993 INFO:tasks.workunit.client.0.smithi073.stderr: -491> 2024-09-12T00:53:08.643+0000 7f8690098800 10 monclient: shutdown 2024-09-12T00:53:08.993 INFO:tasks.workunit.client.0.smithi073.stderr: -490> 2024-09-12T00:53:08.643+0000 7f8690098800 5 asok(0x5623245ad630) unregister_commands rotate-key 2024-09-12T00:53:08.993 INFO:tasks.workunit.client.0.smithi073.stderr: -489> 2024-09-12T00:53:08.643+0000 7f8690098800 10 monclient: build_initial_monmap 2024-09-12T00:53:08.993 INFO:tasks.workunit.client.0.smithi073.stderr: -488> 2024-09-12T00:53:08.643+0000 7f8690098800 1 build_initial for_mkfs: 0 2024-09-12T00:53:08.993 INFO:tasks.workunit.client.0.smithi073.stderr: -487> 2024-09-12T00:53:08.643+0000 7f8690098800 10 monclient: monmap: 2024-09-12T00:53:08.993 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:53:08.993 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:53:08.993 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:53:08.993 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:53:08.993 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:53:08.994 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:53:08.994 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:53:08.994 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:53:08.994 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:53:08.994 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:08.994 INFO:tasks.workunit.client.0.smithi073.stderr: -486> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247f7cc0) adding auth protocol: cephx 2024-09-12T00:53:08.994 INFO:tasks.workunit.client.0.smithi073.stderr: -485> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247f7cc0) adding auth protocol: cephx 2024-09-12T00:53:08.994 INFO:tasks.workunit.client.0.smithi073.stderr: -484> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247f7cc0) adding auth protocol: cephx 2024-09-12T00:53:08.994 INFO:tasks.workunit.client.0.smithi073.stderr: -483> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247f7cc0) adding con mode: secure 2024-09-12T00:53:08.994 INFO:tasks.workunit.client.0.smithi073.stderr: -482> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247f7cc0) adding con mode: crc 2024-09-12T00:53:08.994 INFO:tasks.workunit.client.0.smithi073.stderr: -481> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247f7cc0) adding con mode: secure 2024-09-12T00:53:08.994 INFO:tasks.workunit.client.0.smithi073.stderr: -480> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247f7cc0) adding con mode: crc 2024-09-12T00:53:08.994 INFO:tasks.workunit.client.0.smithi073.stderr: -479> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247f7cc0) adding con mode: secure 2024-09-12T00:53:08.994 INFO:tasks.workunit.client.0.smithi073.stderr: -478> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247f7cc0) adding con mode: crc 2024-09-12T00:53:08.995 INFO:tasks.workunit.client.0.smithi073.stderr: -477> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247f7cc0) adding con mode: crc 2024-09-12T00:53:08.995 INFO:tasks.workunit.client.0.smithi073.stderr: -476> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247f7cc0) adding con mode: secure 2024-09-12T00:53:08.995 INFO:tasks.workunit.client.0.smithi073.stderr: -475> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247f7cc0) adding con mode: crc 2024-09-12T00:53:08.995 INFO:tasks.workunit.client.0.smithi073.stderr: -474> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247f7cc0) adding con mode: secure 2024-09-12T00:53:08.995 INFO:tasks.workunit.client.0.smithi073.stderr: -473> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247f7cc0) adding con mode: crc 2024-09-12T00:53:08.995 INFO:tasks.workunit.client.0.smithi073.stderr: -472> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247f7cc0) adding con mode: secure 2024-09-12T00:53:08.995 INFO:tasks.workunit.client.0.smithi073.stderr: -471> 2024-09-12T00:53:08.643+0000 7f8690098800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:08.995 INFO:tasks.workunit.client.0.smithi073.stderr: -470> 2024-09-12T00:53:08.643+0000 7f8690098800 1 librados: starting msgr at 2024-09-12T00:53:08.995 INFO:tasks.workunit.client.0.smithi073.stderr: -469> 2024-09-12T00:53:08.643+0000 7f8690098800 1 librados: starting objecter 2024-09-12T00:53:08.995 INFO:tasks.workunit.client.0.smithi073.stderr: -468> 2024-09-12T00:53:08.643+0000 7f8690098800 5 asok(0x5623245ad630) register_command objecter_requests hook 0x5623247f8880 2024-09-12T00:53:08.995 INFO:tasks.workunit.client.0.smithi073.stderr: -467> 2024-09-12T00:53:08.643+0000 7f8690098800 1 librados: setting wanted keys 2024-09-12T00:53:08.995 INFO:tasks.workunit.client.0.smithi073.stderr: -466> 2024-09-12T00:53:08.643+0000 7f8690098800 1 librados: calling monclient init 2024-09-12T00:53:08.995 INFO:tasks.workunit.client.0.smithi073.stderr: -465> 2024-09-12T00:53:08.643+0000 7f8690098800 10 monclient: init 2024-09-12T00:53:08.996 INFO:tasks.workunit.client.0.smithi073.stderr: -464> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247cd960) adding auth protocol: cephx 2024-09-12T00:53:08.996 INFO:tasks.workunit.client.0.smithi073.stderr: -463> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247cd960) adding auth protocol: cephx 2024-09-12T00:53:08.996 INFO:tasks.workunit.client.0.smithi073.stderr: -462> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247cd960) adding auth protocol: cephx 2024-09-12T00:53:08.996 INFO:tasks.workunit.client.0.smithi073.stderr: -461> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247cd960) adding con mode: secure 2024-09-12T00:53:08.996 INFO:tasks.workunit.client.0.smithi073.stderr: -460> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247cd960) adding con mode: crc 2024-09-12T00:53:08.996 INFO:tasks.workunit.client.0.smithi073.stderr: -459> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247cd960) adding con mode: secure 2024-09-12T00:53:08.996 INFO:tasks.workunit.client.0.smithi073.stderr: -458> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247cd960) adding con mode: crc 2024-09-12T00:53:08.996 INFO:tasks.workunit.client.0.smithi073.stderr: -457> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247cd960) adding con mode: secure 2024-09-12T00:53:08.996 INFO:tasks.workunit.client.0.smithi073.stderr: -456> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247cd960) adding con mode: crc 2024-09-12T00:53:08.996 INFO:tasks.workunit.client.0.smithi073.stderr: -455> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247cd960) adding con mode: crc 2024-09-12T00:53:08.996 INFO:tasks.workunit.client.0.smithi073.stderr: -454> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247cd960) adding con mode: secure 2024-09-12T00:53:08.996 INFO:tasks.workunit.client.0.smithi073.stderr: -453> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247cd960) adding con mode: crc 2024-09-12T00:53:08.996 INFO:tasks.workunit.client.0.smithi073.stderr: -452> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247cd960) adding con mode: secure 2024-09-12T00:53:08.996 INFO:tasks.workunit.client.0.smithi073.stderr: -451> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247cd960) adding con mode: crc 2024-09-12T00:53:08.997 INFO:tasks.workunit.client.0.smithi073.stderr: -450> 2024-09-12T00:53:08.643+0000 7f8690098800 5 AuthRegistry(0x5623247cd960) adding con mode: secure 2024-09-12T00:53:08.997 INFO:tasks.workunit.client.0.smithi073.stderr: -449> 2024-09-12T00:53:08.643+0000 7f8690098800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:08.997 INFO:tasks.workunit.client.0.smithi073.stderr: -448> 2024-09-12T00:53:08.644+0000 7f8690098800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:08.997 INFO:tasks.workunit.client.0.smithi073.stderr: -447> 2024-09-12T00:53:08.644+0000 7f8690098800 5 asok(0x5623245ad630) register_command rotate-key hook 0x5623247cdaa8 2024-09-12T00:53:08.997 INFO:tasks.workunit.client.0.smithi073.stderr: -446> 2024-09-12T00:53:08.644+0000 7f8690098800 10 monclient: _reopen_session rank -1 2024-09-12T00:53:08.997 INFO:tasks.workunit.client.0.smithi073.stderr: -445> 2024-09-12T00:53:08.644+0000 7f8690098800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:53:08.997 INFO:tasks.workunit.client.0.smithi073.stderr: -444> 2024-09-12T00:53:08.644+0000 7f8690098800 10 monclient(hunting): picked mon.noname-b con 0x562324685da0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:53:08.997 INFO:tasks.workunit.client.0.smithi073.stderr: -443> 2024-09-12T00:53:08.644+0000 7f8690098800 10 monclient(hunting): picked mon.noname-c con 0x562324713690 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:53:08.997 INFO:tasks.workunit.client.0.smithi073.stderr: -442> 2024-09-12T00:53:08.644+0000 7f8690098800 10 monclient(hunting): picked mon.noname-a con 0x56232471bf90 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:53:08.997 INFO:tasks.workunit.client.0.smithi073.stderr: -441> 2024-09-12T00:53:08.644+0000 7f8690098800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:08.998 INFO:tasks.workunit.client.0.smithi073.stderr: -440> 2024-09-12T00:53:08.644+0000 7f8690098800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:08.998 INFO:tasks.workunit.client.0.smithi073.stderr: -439> 2024-09-12T00:53:08.644+0000 7f8690098800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:08.998 INFO:tasks.workunit.client.0.smithi073.stderr: -438> 2024-09-12T00:53:08.644+0000 7f8690098800 10 monclient(hunting): _renew_subs 2024-09-12T00:53:08.998 INFO:tasks.workunit.client.0.smithi073.stderr: -437> 2024-09-12T00:53:08.644+0000 7f8690098800 10 monclient(hunting): authenticate will time out at 2249.314250s 2024-09-12T00:53:08.998 INFO:tasks.workunit.client.0.smithi073.stderr: -436> 2024-09-12T00:53:08.644+0000 7f868d381640 10 monclient(hunting): get_auth_request con 0x562324713690 auth_method 0 2024-09-12T00:53:08.998 INFO:tasks.workunit.client.0.smithi073.stderr: -435> 2024-09-12T00:53:08.644+0000 7f868d381640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:08.998 INFO:tasks.workunit.client.0.smithi073.stderr: -434> 2024-09-12T00:53:08.644+0000 7f868d381640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:08.998 INFO:tasks.workunit.client.0.smithi073.stderr: -433> 2024-09-12T00:53:08.644+0000 7f868d381640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:08.998 INFO:tasks.workunit.client.0.smithi073.stderr: -432> 2024-09-12T00:53:08.644+0000 7f868e383640 10 monclient(hunting): get_auth_request con 0x56232471bf90 auth_method 0 2024-09-12T00:53:08.998 INFO:tasks.workunit.client.0.smithi073.stderr: -431> 2024-09-12T00:53:08.644+0000 7f868e383640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:08.998 INFO:tasks.workunit.client.0.smithi073.stderr: -430> 2024-09-12T00:53:08.644+0000 7f868e383640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:08.998 INFO:tasks.workunit.client.0.smithi073.stderr: -429> 2024-09-12T00:53:08.644+0000 7f868e383640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:08.998 INFO:tasks.workunit.client.0.smithi073.stderr: -428> 2024-09-12T00:53:08.644+0000 7f868d381640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:08.999 INFO:tasks.workunit.client.0.smithi073.stderr: -427> 2024-09-12T00:53:08.644+0000 7f868d381640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:08.999 INFO:tasks.workunit.client.0.smithi073.stderr: -426> 2024-09-12T00:53:08.644+0000 7f868d381640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:08.999 INFO:tasks.workunit.client.0.smithi073.stderr: -425> 2024-09-12T00:53:08.644+0000 7f868e383640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:08.999 INFO:tasks.workunit.client.0.smithi073.stderr: -424> 2024-09-12T00:53:08.644+0000 7f868e383640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:08.999 INFO:tasks.workunit.client.0.smithi073.stderr: -423> 2024-09-12T00:53:08.644+0000 7f868e383640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:08.999 INFO:tasks.workunit.client.0.smithi073.stderr: -422> 2024-09-12T00:53:08.644+0000 7f868db82640 10 monclient(hunting): get_auth_request con 0x562324685da0 auth_method 0 2024-09-12T00:53:08.999 INFO:tasks.workunit.client.0.smithi073.stderr: -421> 2024-09-12T00:53:08.644+0000 7f868db82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:08.999 INFO:tasks.workunit.client.0.smithi073.stderr: -420> 2024-09-12T00:53:08.644+0000 7f868db82640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:08.999 INFO:tasks.workunit.client.0.smithi073.stderr: -419> 2024-09-12T00:53:08.644+0000 7f868db82640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:08.999 INFO:tasks.workunit.client.0.smithi073.stderr: -418> 2024-09-12T00:53:08.644+0000 7f868d381640 10 monclient(hunting): handle_auth_done global_id 7517 payload 824 2024-09-12T00:53:08.999 INFO:tasks.workunit.client.0.smithi073.stderr: -417> 2024-09-12T00:53:08.644+0000 7f868d381640 10 monclient: _finish_hunting 0 2024-09-12T00:53:08.999 INFO:tasks.workunit.client.0.smithi073.stderr: -416> 2024-09-12T00:53:08.644+0000 7f868d381640 1 monclient: found mon.noname-c 2024-09-12T00:53:08.999 INFO:tasks.workunit.client.0.smithi073.stderr: -415> 2024-09-12T00:53:08.644+0000 7f868d381640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.73:3301/0 2024-09-12T00:53:08.999 INFO:tasks.workunit.client.0.smithi073.stderr: -414> 2024-09-12T00:53:08.644+0000 7f857a604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:09.000 INFO:tasks.workunit.client.0.smithi073.stderr: -413> 2024-09-12T00:53:08.644+0000 7f857a604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:53:09.000 INFO:tasks.workunit.client.0.smithi073.stderr: -412> 2024-09-12T00:53:08.644+0000 7f857a604640 10 monclient: dump: 2024-09-12T00:53:09.000 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:53:09.000 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:53:09.000 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:09.000 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:09.000 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:09.000 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:53:09.000 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:53:09.000 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:53:09.000 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:53:09.000 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:09.000 INFO:tasks.workunit.client.0.smithi073.stderr: -411> 2024-09-12T00:53:08.644+0000 7f857a604640 10 monclient: _finish_auth 0 2024-09-12T00:53:09.001 INFO:tasks.workunit.client.0.smithi073.stderr: -410> 2024-09-12T00:53:08.644+0000 7f857a604640 10 monclient: _check_auth_tickets 2024-09-12T00:53:09.001 INFO:tasks.workunit.client.0.smithi073.stderr: -409> 2024-09-12T00:53:08.644+0000 7f8690098800 5 monclient: authenticate success, global_id 7517 2024-09-12T00:53:09.001 INFO:tasks.workunit.client.0.smithi073.stderr: -408> 2024-09-12T00:53:08.644+0000 7f8690098800 10 monclient: _renew_subs 2024-09-12T00:53:09.001 INFO:tasks.workunit.client.0.smithi073.stderr: -407> 2024-09-12T00:53:08.644+0000 7f8690098800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:53:09.001 INFO:tasks.workunit.client.0.smithi073.stderr: -406> 2024-09-12T00:53:08.644+0000 7f857a604640 10 monclient: handle_config config(0 keys) 2024-09-12T00:53:09.001 INFO:tasks.workunit.client.0.smithi073.stderr: -405> 2024-09-12T00:53:08.644+0000 7f857a604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:09.001 INFO:tasks.workunit.client.0.smithi073.stderr: -404> 2024-09-12T00:53:08.644+0000 7f857a604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:53:09.001 INFO:tasks.workunit.client.0.smithi073.stderr: -403> 2024-09-12T00:53:08.644+0000 7f857a604640 10 monclient: dump: 2024-09-12T00:53:09.001 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:53:09.001 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:53:09.001 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:09.001 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:09.001 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:09.001 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:53:09.002 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:53:09.002 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:53:09.002 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:53:09.002 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:09.002 INFO:tasks.workunit.client.0.smithi073.stderr: -402> 2024-09-12T00:53:08.644+0000 7f857be07640 4 set_mon_vals no callback set 2024-09-12T00:53:09.002 INFO:tasks.workunit.client.0.smithi073.stderr: -401> 2024-09-12T00:53:08.644+0000 7f8690098800 10 monclient: _renew_subs 2024-09-12T00:53:09.002 INFO:tasks.workunit.client.0.smithi073.stderr: -400> 2024-09-12T00:53:08.644+0000 7f8690098800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:53:09.002 INFO:tasks.workunit.client.0.smithi073.stderr: -399> 2024-09-12T00:53:08.644+0000 7f8690098800 1 librados: init done 2024-09-12T00:53:09.002 INFO:tasks.workunit.client.0.smithi073.stderr: -398> 2024-09-12T00:53:08.646+0000 7f857a604640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:53:09.002 INFO:tasks.workunit.client.0.smithi073.stderr: -397> 2024-09-12T00:53:08.646+0000 7f857a604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:53:09.002 INFO:tasks.workunit.client.0.smithi073.stderr: -396> 2024-09-12T00:53:08.646+0000 7f857a604640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:53:09.002 INFO:tasks.workunit.client.0.smithi073.stderr: -395> 2024-09-12T00:53:08.647+0000 7f868db82640 10 monclient: get_auth_request con 0x7f8574076470 auth_method 0 2024-09-12T00:53:09.002 INFO:tasks.workunit.client.0.smithi073.stderr: -394> 2024-09-12T00:53:08.647+0000 7f868e383640 10 monclient: get_auth_request con 0x5623247f69c0 auth_method 0 2024-09-12T00:53:09.002 INFO:tasks.workunit.client.0.smithi073.stderr: -393> 2024-09-12T00:53:08.648+0000 7f868db82640 10 monclient: get_auth_request con 0x562324819400 auth_method 0 2024-09-12T00:53:09.003 INFO:tasks.workunit.client.0.smithi073.stderr: -392> 2024-09-12T00:53:08.648+0000 7f868d381640 10 monclient: get_auth_request con 0x56232481d5f0 auth_method 0 2024-09-12T00:53:09.003 INFO:tasks.workunit.client.0.smithi073.stderr: -391> 2024-09-12T00:53:08.650+0000 7f8690098800 10 monclient: build_initial_monmap 2024-09-12T00:53:09.003 INFO:tasks.workunit.client.0.smithi073.stderr: -390> 2024-09-12T00:53:08.650+0000 7f8690098800 1 build_initial for_mkfs: 0 2024-09-12T00:53:09.003 INFO:tasks.workunit.client.0.smithi073.stderr: -389> 2024-09-12T00:53:08.650+0000 7f8690098800 10 monclient: monmap: 2024-09-12T00:53:09.003 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:53:09.003 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:53:09.003 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:53:09.003 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:53:09.003 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:53:09.003 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:53:09.003 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:53:09.003 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:53:09.003 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:53:09.003 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:09.004 INFO:tasks.workunit.client.0.smithi073.stderr: -388> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x5623248224f0) adding auth protocol: cephx 2024-09-12T00:53:09.004 INFO:tasks.workunit.client.0.smithi073.stderr: -387> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x5623248224f0) adding auth protocol: cephx 2024-09-12T00:53:09.004 INFO:tasks.workunit.client.0.smithi073.stderr: -386> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x5623248224f0) adding auth protocol: cephx 2024-09-12T00:53:09.004 INFO:tasks.workunit.client.0.smithi073.stderr: -385> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x5623248224f0) adding con mode: secure 2024-09-12T00:53:09.004 INFO:tasks.workunit.client.0.smithi073.stderr: -384> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x5623248224f0) adding con mode: crc 2024-09-12T00:53:09.004 INFO:tasks.workunit.client.0.smithi073.stderr: -383> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x5623248224f0) adding con mode: secure 2024-09-12T00:53:09.004 INFO:tasks.workunit.client.0.smithi073.stderr: -382> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x5623248224f0) adding con mode: crc 2024-09-12T00:53:09.004 INFO:tasks.workunit.client.0.smithi073.stderr: -381> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x5623248224f0) adding con mode: secure 2024-09-12T00:53:09.004 INFO:tasks.workunit.client.0.smithi073.stderr: -380> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x5623248224f0) adding con mode: crc 2024-09-12T00:53:09.004 INFO:tasks.workunit.client.0.smithi073.stderr: -379> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x5623248224f0) adding con mode: crc 2024-09-12T00:53:09.004 INFO:tasks.workunit.client.0.smithi073.stderr: -378> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x5623248224f0) adding con mode: secure 2024-09-12T00:53:09.004 INFO:tasks.workunit.client.0.smithi073.stderr: -377> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x5623248224f0) adding con mode: crc 2024-09-12T00:53:09.004 INFO:tasks.workunit.client.0.smithi073.stderr: -376> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x5623248224f0) adding con mode: secure 2024-09-12T00:53:09.005 INFO:tasks.workunit.client.0.smithi073.stderr: -375> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x5623248224f0) adding con mode: crc 2024-09-12T00:53:09.005 INFO:tasks.workunit.client.0.smithi073.stderr: -374> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x5623248224f0) adding con mode: secure 2024-09-12T00:53:09.005 INFO:tasks.workunit.client.0.smithi073.stderr: -373> 2024-09-12T00:53:08.650+0000 7f8690098800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:09.005 INFO:tasks.workunit.client.0.smithi073.stderr: -372> 2024-09-12T00:53:08.650+0000 7f8690098800 5 asok(0x5623245ad630) register_command objecter_requests cmddesc objecter_requests hook 0x562324825ea0 EEXIST 2024-09-12T00:53:09.005 INFO:tasks.workunit.client.0.smithi073.stderr: -371> 2024-09-12T00:53:08.650+0000 7f8690098800 10 monclient: init 2024-09-12T00:53:09.005 INFO:tasks.workunit.client.0.smithi073.stderr: -370> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x562324820b18) adding auth protocol: cephx 2024-09-12T00:53:09.005 INFO:tasks.workunit.client.0.smithi073.stderr: -369> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x562324820b18) adding auth protocol: cephx 2024-09-12T00:53:09.005 INFO:tasks.workunit.client.0.smithi073.stderr: -368> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x562324820b18) adding auth protocol: cephx 2024-09-12T00:53:09.005 INFO:tasks.workunit.client.0.smithi073.stderr: -367> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x562324820b18) adding con mode: secure 2024-09-12T00:53:09.005 INFO:tasks.workunit.client.0.smithi073.stderr: -366> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x562324820b18) adding con mode: crc 2024-09-12T00:53:09.005 INFO:tasks.workunit.client.0.smithi073.stderr: -365> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x562324820b18) adding con mode: secure 2024-09-12T00:53:09.005 INFO:tasks.workunit.client.0.smithi073.stderr: -364> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x562324820b18) adding con mode: crc 2024-09-12T00:53:09.005 INFO:tasks.workunit.client.0.smithi073.stderr: -363> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x562324820b18) adding con mode: secure 2024-09-12T00:53:09.005 INFO:tasks.workunit.client.0.smithi073.stderr: -362> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x562324820b18) adding con mode: crc 2024-09-12T00:53:09.006 INFO:tasks.workunit.client.0.smithi073.stderr: -361> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x562324820b18) adding con mode: crc 2024-09-12T00:53:09.006 INFO:tasks.workunit.client.0.smithi073.stderr: -360> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x562324820b18) adding con mode: secure 2024-09-12T00:53:09.006 INFO:tasks.workunit.client.0.smithi073.stderr: -359> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x562324820b18) adding con mode: crc 2024-09-12T00:53:09.006 INFO:tasks.workunit.client.0.smithi073.stderr: -358> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x562324820b18) adding con mode: secure 2024-09-12T00:53:09.006 INFO:tasks.workunit.client.0.smithi073.stderr: -357> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x562324820b18) adding con mode: crc 2024-09-12T00:53:09.006 INFO:tasks.workunit.client.0.smithi073.stderr: -356> 2024-09-12T00:53:08.650+0000 7f8690098800 5 AuthRegistry(0x562324820b18) adding con mode: secure 2024-09-12T00:53:09.006 INFO:tasks.workunit.client.0.smithi073.stderr: -355> 2024-09-12T00:53:08.651+0000 7f8690098800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:09.006 INFO:tasks.workunit.client.0.smithi073.stderr: -354> 2024-09-12T00:53:08.651+0000 7f8690098800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:09.006 INFO:tasks.workunit.client.0.smithi073.stderr: -353> 2024-09-12T00:53:08.651+0000 7f8690098800 5 asok(0x5623245ad630) register_command rotate-key cmddesc rotate-key hook 0x562324820c60 EEXIST 2024-09-12T00:53:09.006 INFO:tasks.workunit.client.0.smithi073.stderr: -352> 2024-09-12T00:53:08.651+0000 7f8690098800 10 monclient: _reopen_session rank -1 2024-09-12T00:53:09.006 INFO:tasks.workunit.client.0.smithi073.stderr: -351> 2024-09-12T00:53:08.651+0000 7f8690098800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:53:09.006 INFO:tasks.workunit.client.0.smithi073.stderr: -350> 2024-09-12T00:53:08.651+0000 7f8690098800 10 monclient(hunting): picked mon.noname-c con 0x562324849b90 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:53:09.006 INFO:tasks.workunit.client.0.smithi073.stderr: -349> 2024-09-12T00:53:08.651+0000 7f8690098800 10 monclient(hunting): picked mon.noname-a con 0x56232484be60 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:53:09.007 INFO:tasks.workunit.client.0.smithi073.stderr: -348> 2024-09-12T00:53:08.651+0000 7f8690098800 10 monclient(hunting): picked mon.noname-b con 0x562324848360 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:53:09.007 INFO:tasks.workunit.client.0.smithi073.stderr: -347> 2024-09-12T00:53:08.651+0000 7f8690098800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:09.007 INFO:tasks.workunit.client.0.smithi073.stderr: -346> 2024-09-12T00:53:08.651+0000 7f8690098800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:09.007 INFO:tasks.workunit.client.0.smithi073.stderr: -345> 2024-09-12T00:53:08.651+0000 7f8690098800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:09.007 INFO:tasks.workunit.client.0.smithi073.stderr: -344> 2024-09-12T00:53:08.651+0000 7f8690098800 10 monclient(hunting): _renew_subs 2024-09-12T00:53:09.007 INFO:tasks.workunit.client.0.smithi073.stderr: -343> 2024-09-12T00:53:08.651+0000 7f8690098800 10 monclient(hunting): authenticate will time out at 2249.321452s 2024-09-12T00:53:09.007 INFO:tasks.workunit.client.0.smithi073.stderr: -342> 2024-09-12T00:53:08.651+0000 7f868db82640 10 monclient(hunting): get_auth_request con 0x562324849b90 auth_method 0 2024-09-12T00:53:09.007 INFO:tasks.workunit.client.0.smithi073.stderr: -341> 2024-09-12T00:53:08.651+0000 7f868db82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:09.007 INFO:tasks.workunit.client.0.smithi073.stderr: -340> 2024-09-12T00:53:08.651+0000 7f868db82640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:09.007 INFO:tasks.workunit.client.0.smithi073.stderr: -339> 2024-09-12T00:53:08.651+0000 7f868db82640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:09.007 INFO:tasks.workunit.client.0.smithi073.stderr: -338> 2024-09-12T00:53:08.651+0000 7f868d381640 10 monclient(hunting): get_auth_request con 0x56232484be60 auth_method 0 2024-09-12T00:53:09.007 INFO:tasks.workunit.client.0.smithi073.stderr: -337> 2024-09-12T00:53:08.651+0000 7f868d381640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:09.007 INFO:tasks.workunit.client.0.smithi073.stderr: -336> 2024-09-12T00:53:08.651+0000 7f868d381640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:09.007 INFO:tasks.workunit.client.0.smithi073.stderr: -335> 2024-09-12T00:53:08.651+0000 7f868d381640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:09.008 INFO:tasks.workunit.client.0.smithi073.stderr: -334> 2024-09-12T00:53:08.651+0000 7f868db82640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:09.008 INFO:tasks.workunit.client.0.smithi073.stderr: -333> 2024-09-12T00:53:08.651+0000 7f868db82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:09.008 INFO:tasks.workunit.client.0.smithi073.stderr: -332> 2024-09-12T00:53:08.651+0000 7f868db82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:09.008 INFO:tasks.workunit.client.0.smithi073.stderr: -331> 2024-09-12T00:53:08.651+0000 7f868d381640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:09.008 INFO:tasks.workunit.client.0.smithi073.stderr: -330> 2024-09-12T00:53:08.651+0000 7f868d381640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:09.008 INFO:tasks.workunit.client.0.smithi073.stderr: -329> 2024-09-12T00:53:08.651+0000 7f868d381640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:09.008 INFO:tasks.workunit.client.0.smithi073.stderr: -328> 2024-09-12T00:53:08.651+0000 7f868e383640 10 monclient(hunting): get_auth_request con 0x562324848360 auth_method 0 2024-09-12T00:53:09.008 INFO:tasks.workunit.client.0.smithi073.stderr: -327> 2024-09-12T00:53:08.651+0000 7f868e383640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:09.008 INFO:tasks.workunit.client.0.smithi073.stderr: -326> 2024-09-12T00:53:08.651+0000 7f868e383640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:09.008 INFO:tasks.workunit.client.0.smithi073.stderr: -325> 2024-09-12T00:53:08.651+0000 7f868e383640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:09.008 INFO:tasks.workunit.client.0.smithi073.stderr: -324> 2024-09-12T00:53:08.651+0000 7f868e383640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:09.008 INFO:tasks.workunit.client.0.smithi073.stderr: -323> 2024-09-12T00:53:08.651+0000 7f868e383640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:09.008 INFO:tasks.workunit.client.0.smithi073.stderr: -322> 2024-09-12T00:53:08.651+0000 7f868e383640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:09.009 INFO:tasks.workunit.client.0.smithi073.stderr: -321> 2024-09-12T00:53:08.651+0000 7f868db82640 10 monclient(hunting): handle_auth_done global_id 7520 payload 824 2024-09-12T00:53:09.009 INFO:tasks.workunit.client.0.smithi073.stderr: -320> 2024-09-12T00:53:08.651+0000 7f868db82640 10 monclient: _finish_hunting 0 2024-09-12T00:53:09.009 INFO:tasks.workunit.client.0.smithi073.stderr: -319> 2024-09-12T00:53:08.651+0000 7f868db82640 1 monclient: found mon.noname-c 2024-09-12T00:53:09.009 INFO:tasks.workunit.client.0.smithi073.stderr: -318> 2024-09-12T00:53:08.651+0000 7f868db82640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.73:3301/0 2024-09-12T00:53:09.009 INFO:tasks.workunit.client.0.smithi073.stderr: -317> 2024-09-12T00:53:08.652+0000 7f85737fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:09.009 INFO:tasks.workunit.client.0.smithi073.stderr: -316> 2024-09-12T00:53:08.652+0000 7f85737fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:53:09.009 INFO:tasks.workunit.client.0.smithi073.stderr: -315> 2024-09-12T00:53:08.652+0000 7f85737fe640 10 monclient: dump: 2024-09-12T00:53:09.009 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:53:09.009 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:53:09.009 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:09.009 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:09.009 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:09.009 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:53:09.009 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:53:09.010 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:53:09.010 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:53:09.010 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:09.010 INFO:tasks.workunit.client.0.smithi073.stderr: -314> 2024-09-12T00:53:08.652+0000 7f85737fe640 10 monclient: _finish_auth 0 2024-09-12T00:53:09.010 INFO:tasks.workunit.client.0.smithi073.stderr: -313> 2024-09-12T00:53:08.652+0000 7f85737fe640 10 monclient: _check_auth_tickets 2024-09-12T00:53:09.010 INFO:tasks.workunit.client.0.smithi073.stderr: -312> 2024-09-12T00:53:08.652+0000 7f8690098800 5 monclient: authenticate success, global_id 7520 2024-09-12T00:53:09.010 INFO:tasks.workunit.client.0.smithi073.stderr: -311> 2024-09-12T00:53:08.652+0000 7f8690098800 10 monclient: _renew_subs 2024-09-12T00:53:09.010 INFO:tasks.workunit.client.0.smithi073.stderr: -310> 2024-09-12T00:53:08.652+0000 7f8690098800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:53:09.010 INFO:tasks.workunit.client.0.smithi073.stderr: -309> 2024-09-12T00:53:08.652+0000 7f85737fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:53:09.010 INFO:tasks.workunit.client.0.smithi073.stderr: -308> 2024-09-12T00:53:08.652+0000 7f85737fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:09.010 INFO:tasks.workunit.client.0.smithi073.stderr: -307> 2024-09-12T00:53:08.652+0000 7f85737fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:53:09.010 INFO:tasks.workunit.client.0.smithi073.stderr: -306> 2024-09-12T00:53:08.652+0000 7f85737fe640 10 monclient: dump: 2024-09-12T00:53:09.010 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:53:09.010 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:53:09.011 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:09.011 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:09.011 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:09.011 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:53:09.011 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:53:09.011 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:53:09.011 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:53:09.011 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:09.011 INFO:tasks.workunit.client.0.smithi073.stderr: -305> 2024-09-12T00:53:08.652+0000 7f868eb84640 4 set_mon_vals no callback set 2024-09-12T00:53:09.011 INFO:tasks.workunit.client.0.smithi073.stderr: -304> 2024-09-12T00:53:08.652+0000 7f8690098800 10 monclient: _renew_subs 2024-09-12T00:53:09.011 INFO:tasks.workunit.client.0.smithi073.stderr: -303> 2024-09-12T00:53:08.652+0000 7f8690098800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:53:09.011 INFO:tasks.workunit.client.0.smithi073.stderr: -302> 2024-09-12T00:53:08.653+0000 7f85737fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:53:09.011 INFO:tasks.workunit.client.0.smithi073.stderr: -301> 2024-09-12T00:53:08.653+0000 7f85737fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:53:09.011 INFO:tasks.workunit.client.0.smithi073.stderr: -300> 2024-09-12T00:53:08.653+0000 7f85737fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:53:09.012 INFO:tasks.workunit.client.0.smithi073.stderr: -299> 2024-09-12T00:53:08.654+0000 7f868d381640 10 monclient: get_auth_request con 0x7f8568076380 auth_method 0 2024-09-12T00:53:09.012 INFO:tasks.workunit.client.0.smithi073.stderr: -298> 2024-09-12T00:53:08.654+0000 7f8690098800 10 monclient: get_monmap_and_config 2024-09-12T00:53:09.012 INFO:tasks.workunit.client.0.smithi073.stderr: -297> 2024-09-12T00:53:08.654+0000 7f8690098800 10 monclient: build_initial_monmap 2024-09-12T00:53:09.012 INFO:tasks.workunit.client.0.smithi073.stderr: -296> 2024-09-12T00:53:08.654+0000 7f8690098800 1 build_initial for_mkfs: 0 2024-09-12T00:53:09.012 INFO:tasks.workunit.client.0.smithi073.stderr: -295> 2024-09-12T00:53:08.654+0000 7f8690098800 10 monclient: monmap: 2024-09-12T00:53:09.012 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:53:09.012 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:53:09.012 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:53:09.012 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:53:09.012 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:53:09.013 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:53:09.013 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:53:09.013 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:53:09.013 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:53:09.013 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:09.013 INFO:tasks.workunit.client.0.smithi073.stderr: -294> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x562324869a30) adding auth protocol: cephx 2024-09-12T00:53:09.013 INFO:tasks.workunit.client.0.smithi073.stderr: -293> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x562324869a30) adding auth protocol: cephx 2024-09-12T00:53:09.013 INFO:tasks.workunit.client.0.smithi073.stderr: -292> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x562324869a30) adding auth protocol: cephx 2024-09-12T00:53:09.013 INFO:tasks.workunit.client.0.smithi073.stderr: -291> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x562324869a30) adding con mode: secure 2024-09-12T00:53:09.013 INFO:tasks.workunit.client.0.smithi073.stderr: -290> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x562324869a30) adding con mode: crc 2024-09-12T00:53:09.014 INFO:tasks.workunit.client.0.smithi073.stderr: -289> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x562324869a30) adding con mode: secure 2024-09-12T00:53:09.014 INFO:tasks.workunit.client.0.smithi073.stderr: -288> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x562324869a30) adding con mode: crc 2024-09-12T00:53:09.014 INFO:tasks.workunit.client.0.smithi073.stderr: -287> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x562324869a30) adding con mode: secure 2024-09-12T00:53:09.014 INFO:tasks.workunit.client.0.smithi073.stderr: -286> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x562324869a30) adding con mode: crc 2024-09-12T00:53:09.014 INFO:tasks.workunit.client.0.smithi073.stderr: -285> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x562324869a30) adding con mode: crc 2024-09-12T00:53:09.014 INFO:tasks.workunit.client.0.smithi073.stderr: -284> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x562324869a30) adding con mode: secure 2024-09-12T00:53:09.014 INFO:tasks.workunit.client.0.smithi073.stderr: -283> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x562324869a30) adding con mode: crc 2024-09-12T00:53:09.014 INFO:tasks.workunit.client.0.smithi073.stderr: -282> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x562324869a30) adding con mode: secure 2024-09-12T00:53:09.014 INFO:tasks.workunit.client.0.smithi073.stderr: -281> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x562324869a30) adding con mode: crc 2024-09-12T00:53:09.014 INFO:tasks.workunit.client.0.smithi073.stderr: -280> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x562324869a30) adding con mode: secure 2024-09-12T00:53:09.014 INFO:tasks.workunit.client.0.smithi073.stderr: -279> 2024-09-12T00:53:08.654+0000 7f8690098800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:09.014 INFO:tasks.workunit.client.0.smithi073.stderr: -278> 2024-09-12T00:53:08.654+0000 7f8690098800 10 monclient: init 2024-09-12T00:53:09.014 INFO:tasks.workunit.client.0.smithi073.stderr: -277> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x7ffece801aa0) adding auth protocol: cephx 2024-09-12T00:53:09.015 INFO:tasks.workunit.client.0.smithi073.stderr: -276> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x7ffece801aa0) adding auth protocol: cephx 2024-09-12T00:53:09.015 INFO:tasks.workunit.client.0.smithi073.stderr: -275> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x7ffece801aa0) adding auth protocol: cephx 2024-09-12T00:53:09.015 INFO:tasks.workunit.client.0.smithi073.stderr: -274> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x7ffece801aa0) adding con mode: secure 2024-09-12T00:53:09.015 INFO:tasks.workunit.client.0.smithi073.stderr: -273> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x7ffece801aa0) adding con mode: crc 2024-09-12T00:53:09.015 INFO:tasks.workunit.client.0.smithi073.stderr: -272> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x7ffece801aa0) adding con mode: secure 2024-09-12T00:53:09.015 INFO:tasks.workunit.client.0.smithi073.stderr: -271> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x7ffece801aa0) adding con mode: crc 2024-09-12T00:53:09.015 INFO:tasks.workunit.client.0.smithi073.stderr: -270> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x7ffece801aa0) adding con mode: secure 2024-09-12T00:53:09.015 INFO:tasks.workunit.client.0.smithi073.stderr: -269> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x7ffece801aa0) adding con mode: crc 2024-09-12T00:53:09.015 INFO:tasks.workunit.client.0.smithi073.stderr: -268> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x7ffece801aa0) adding con mode: crc 2024-09-12T00:53:09.015 INFO:tasks.workunit.client.0.smithi073.stderr: -267> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x7ffece801aa0) adding con mode: secure 2024-09-12T00:53:09.015 INFO:tasks.workunit.client.0.smithi073.stderr: -266> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x7ffece801aa0) adding con mode: crc 2024-09-12T00:53:09.015 INFO:tasks.workunit.client.0.smithi073.stderr: -265> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x7ffece801aa0) adding con mode: secure 2024-09-12T00:53:09.016 INFO:tasks.workunit.client.0.smithi073.stderr: -264> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x7ffece801aa0) adding con mode: crc 2024-09-12T00:53:09.016 INFO:tasks.workunit.client.0.smithi073.stderr: -263> 2024-09-12T00:53:08.654+0000 7f8690098800 5 AuthRegistry(0x7ffece801aa0) adding con mode: secure 2024-09-12T00:53:09.016 INFO:tasks.workunit.client.0.smithi073.stderr: -262> 2024-09-12T00:53:08.654+0000 7f8690098800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:09.016 INFO:tasks.workunit.client.0.smithi073.stderr: -261> 2024-09-12T00:53:08.655+0000 7f8690098800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:09.016 INFO:tasks.workunit.client.0.smithi073.stderr: -260> 2024-09-12T00:53:08.655+0000 7f8690098800 5 asok(0x5623245ad630) register_command rotate-key cmddesc rotate-key hook 0x7ffece801be8 EEXIST 2024-09-12T00:53:09.016 INFO:tasks.workunit.client.0.smithi073.stderr: -259> 2024-09-12T00:53:08.655+0000 7f8690098800 10 monclient: _reopen_session rank -1 2024-09-12T00:53:09.016 INFO:tasks.workunit.client.0.smithi073.stderr: -258> 2024-09-12T00:53:08.655+0000 7f8690098800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:53:09.016 INFO:tasks.workunit.client.0.smithi073.stderr: -257> 2024-09-12T00:53:08.655+0000 7f8690098800 10 monclient(hunting): picked mon.noname-c con 0x56232489dcf0 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:53:09.016 INFO:tasks.workunit.client.0.smithi073.stderr: -256> 2024-09-12T00:53:08.655+0000 7f8690098800 10 monclient(hunting): picked mon.noname-b con 0x56232489e0d0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:53:09.016 INFO:tasks.workunit.client.0.smithi073.stderr: -255> 2024-09-12T00:53:08.655+0000 7f8690098800 10 monclient(hunting): picked mon.noname-a con 0x5623248a3820 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:53:09.016 INFO:tasks.workunit.client.0.smithi073.stderr: -254> 2024-09-12T00:53:08.655+0000 7f8690098800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:09.016 INFO:tasks.workunit.client.0.smithi073.stderr: -253> 2024-09-12T00:53:08.655+0000 7f8690098800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:09.016 INFO:tasks.workunit.client.0.smithi073.stderr: -252> 2024-09-12T00:53:08.655+0000 7f8690098800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:09.017 INFO:tasks.workunit.client.0.smithi073.stderr: -251> 2024-09-12T00:53:08.655+0000 7f8690098800 10 monclient(hunting): _renew_subs 2024-09-12T00:53:09.017 INFO:tasks.workunit.client.0.smithi073.stderr: -250> 2024-09-12T00:53:08.655+0000 7f8690098800 10 monclient(hunting): authenticate will time out at 2249.325210s 2024-09-12T00:53:09.017 INFO:tasks.workunit.client.0.smithi073.stderr: -249> 2024-09-12T00:53:08.655+0000 7f868db82640 10 monclient(hunting): get_auth_request con 0x56232489dcf0 auth_method 0 2024-09-12T00:53:09.017 INFO:tasks.workunit.client.0.smithi073.stderr: -248> 2024-09-12T00:53:08.655+0000 7f868db82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:09.017 INFO:tasks.workunit.client.0.smithi073.stderr: -247> 2024-09-12T00:53:08.655+0000 7f868db82640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:09.017 INFO:tasks.workunit.client.0.smithi073.stderr: -246> 2024-09-12T00:53:08.655+0000 7f868db82640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:09.017 INFO:tasks.workunit.client.0.smithi073.stderr: -245> 2024-09-12T00:53:08.655+0000 7f868e383640 10 monclient(hunting): get_auth_request con 0x5623248a3820 auth_method 0 2024-09-12T00:53:09.017 INFO:tasks.workunit.client.0.smithi073.stderr: -244> 2024-09-12T00:53:08.655+0000 7f868e383640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:09.017 INFO:tasks.workunit.client.0.smithi073.stderr: -243> 2024-09-12T00:53:08.655+0000 7f868e383640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:09.017 INFO:tasks.workunit.client.0.smithi073.stderr: -242> 2024-09-12T00:53:08.655+0000 7f868e383640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:09.018 INFO:tasks.workunit.client.0.smithi073.stderr: -241> 2024-09-12T00:53:08.655+0000 7f868e383640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:09.018 INFO:tasks.workunit.client.0.smithi073.stderr: -240> 2024-09-12T00:53:08.655+0000 7f868e383640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:09.018 INFO:tasks.workunit.client.0.smithi073.stderr: -239> 2024-09-12T00:53:08.655+0000 7f868e383640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:09.018 INFO:tasks.workunit.client.0.smithi073.stderr: -238> 2024-09-12T00:53:08.655+0000 7f868db82640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:09.018 INFO:tasks.workunit.client.0.smithi073.stderr: -237> 2024-09-12T00:53:08.655+0000 7f868db82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:09.018 INFO:tasks.workunit.client.0.smithi073.stderr: -236> 2024-09-12T00:53:08.655+0000 7f868db82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:09.018 INFO:tasks.workunit.client.0.smithi073.stderr: -235> 2024-09-12T00:53:08.655+0000 7f868e383640 10 monclient(hunting): handle_auth_done global_id 8019 payload 274 2024-09-12T00:53:09.018 INFO:tasks.workunit.client.0.smithi073.stderr: -234> 2024-09-12T00:53:08.655+0000 7f868e383640 10 monclient: _finish_hunting 0 2024-09-12T00:53:09.018 INFO:tasks.workunit.client.0.smithi073.stderr: -233> 2024-09-12T00:53:08.655+0000 7f868e383640 1 monclient: found mon.noname-a 2024-09-12T00:53:09.018 INFO:tasks.workunit.client.0.smithi073.stderr: -232> 2024-09-12T00:53:08.655+0000 7f868e383640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:53:09.019 INFO:tasks.workunit.client.0.smithi073.stderr: -231> 2024-09-12T00:53:08.655+0000 7f85717fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:09.019 INFO:tasks.workunit.client.0.smithi073.stderr: -230> 2024-09-12T00:53:08.655+0000 7f85717fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:53:09.019 INFO:tasks.workunit.client.0.smithi073.stderr: -229> 2024-09-12T00:53:08.655+0000 7f85717fa640 10 monclient: dump: 2024-09-12T00:53:09.019 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:53:09.019 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:53:09.019 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:09.019 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:09.020 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:09.020 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:53:09.020 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:53:09.020 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:53:09.020 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:53:09.020 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:09.020 INFO:tasks.workunit.client.0.smithi073.stderr: -228> 2024-09-12T00:53:08.655+0000 7f85717fa640 10 monclient: _finish_auth 0 2024-09-12T00:53:09.020 INFO:tasks.workunit.client.0.smithi073.stderr: -227> 2024-09-12T00:53:08.655+0000 7f85717fa640 10 monclient: _check_auth_tickets 2024-09-12T00:53:09.020 INFO:tasks.workunit.client.0.smithi073.stderr: -226> 2024-09-12T00:53:08.655+0000 7f85717fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:53:09.020 INFO:tasks.workunit.client.0.smithi073.stderr: -225> 2024-09-12T00:53:08.655+0000 7f85717fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:09.020 INFO:tasks.workunit.client.0.smithi073.stderr: -224> 2024-09-12T00:53:08.655+0000 7f85717fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:53:09.020 INFO:tasks.workunit.client.0.smithi073.stderr: -223> 2024-09-12T00:53:08.655+0000 7f85717fa640 10 monclient: dump: 2024-09-12T00:53:09.020 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:53:09.020 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:53:09.021 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:09.021 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:09.021 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:09.021 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:53:09.021 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:53:09.021 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:53:09.021 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:53:09.021 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:09.021 INFO:tasks.workunit.client.0.smithi073.stderr: -222> 2024-09-12T00:53:08.655+0000 7f8690098800 5 monclient: authenticate success, global_id 8019 2024-09-12T00:53:09.021 INFO:tasks.workunit.client.0.smithi073.stderr: -221> 2024-09-12T00:53:08.655+0000 7f8690098800 10 monclient: get_monmap_and_config success 2024-09-12T00:53:09.021 INFO:tasks.workunit.client.0.smithi073.stderr: -220> 2024-09-12T00:53:08.655+0000 7f8690098800 4 set_mon_vals no callback set 2024-09-12T00:53:09.021 INFO:tasks.workunit.client.0.smithi073.stderr: -219> 2024-09-12T00:53:08.656+0000 7f8690098800 10 monclient: shutdown 2024-09-12T00:53:09.021 INFO:tasks.workunit.client.0.smithi073.stderr: -218> 2024-09-12T00:53:08.656+0000 7f8690098800 10 monclient: build_initial_monmap 2024-09-12T00:53:09.022 INFO:tasks.workunit.client.0.smithi073.stderr: -217> 2024-09-12T00:53:08.656+0000 7f8690098800 1 build_initial for_mkfs: 0 2024-09-12T00:53:09.022 INFO:tasks.workunit.client.0.smithi073.stderr: -216> 2024-09-12T00:53:08.656+0000 7f8690098800 10 monclient: monmap: 2024-09-12T00:53:09.022 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:53:09.022 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:53:09.022 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:53:09.022 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:53:09.022 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:53:09.022 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:53:09.022 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:53:09.022 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:53:09.022 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:53:09.022 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:09.022 INFO:tasks.workunit.client.0.smithi073.stderr: -215> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x5623248995f0) adding auth protocol: cephx 2024-09-12T00:53:09.023 INFO:tasks.workunit.client.0.smithi073.stderr: -214> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x5623248995f0) adding auth protocol: cephx 2024-09-12T00:53:09.023 INFO:tasks.workunit.client.0.smithi073.stderr: -213> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x5623248995f0) adding auth protocol: cephx 2024-09-12T00:53:09.023 INFO:tasks.workunit.client.0.smithi073.stderr: -212> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x5623248995f0) adding con mode: secure 2024-09-12T00:53:09.023 INFO:tasks.workunit.client.0.smithi073.stderr: -211> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x5623248995f0) adding con mode: crc 2024-09-12T00:53:09.023 INFO:tasks.workunit.client.0.smithi073.stderr: -210> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x5623248995f0) adding con mode: secure 2024-09-12T00:53:09.023 INFO:tasks.workunit.client.0.smithi073.stderr: -209> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x5623248995f0) adding con mode: crc 2024-09-12T00:53:09.023 INFO:tasks.workunit.client.0.smithi073.stderr: -208> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x5623248995f0) adding con mode: secure 2024-09-12T00:53:09.023 INFO:tasks.workunit.client.0.smithi073.stderr: -207> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x5623248995f0) adding con mode: crc 2024-09-12T00:53:09.023 INFO:tasks.workunit.client.0.smithi073.stderr: -206> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x5623248995f0) adding con mode: crc 2024-09-12T00:53:09.023 INFO:tasks.workunit.client.0.smithi073.stderr: -205> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x5623248995f0) adding con mode: secure 2024-09-12T00:53:09.023 INFO:tasks.workunit.client.0.smithi073.stderr: -204> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x5623248995f0) adding con mode: crc 2024-09-12T00:53:09.023 INFO:tasks.workunit.client.0.smithi073.stderr: -203> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x5623248995f0) adding con mode: secure 2024-09-12T00:53:09.023 INFO:tasks.workunit.client.0.smithi073.stderr: -202> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x5623248995f0) adding con mode: crc 2024-09-12T00:53:09.023 INFO:tasks.workunit.client.0.smithi073.stderr: -201> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x5623248995f0) adding con mode: secure 2024-09-12T00:53:09.024 INFO:tasks.workunit.client.0.smithi073.stderr: -200> 2024-09-12T00:53:08.656+0000 7f8690098800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:09.024 INFO:tasks.workunit.client.0.smithi073.stderr: -199> 2024-09-12T00:53:08.656+0000 7f8690098800 1 librados: starting msgr at 2024-09-12T00:53:09.024 INFO:tasks.workunit.client.0.smithi073.stderr: -198> 2024-09-12T00:53:08.656+0000 7f8690098800 1 librados: starting objecter 2024-09-12T00:53:09.024 INFO:tasks.workunit.client.0.smithi073.stderr: -197> 2024-09-12T00:53:08.656+0000 7f8690098800 5 asok(0x5623245ad630) register_command objecter_requests cmddesc objecter_requests hook 0x562324848f70 EEXIST 2024-09-12T00:53:09.024 INFO:tasks.workunit.client.0.smithi073.stderr: -196> 2024-09-12T00:53:08.656+0000 7f8690098800 1 librados: setting wanted keys 2024-09-12T00:53:09.024 INFO:tasks.workunit.client.0.smithi073.stderr: -195> 2024-09-12T00:53:08.656+0000 7f8690098800 1 librados: calling monclient init 2024-09-12T00:53:09.024 INFO:tasks.workunit.client.0.smithi073.stderr: -194> 2024-09-12T00:53:08.656+0000 7f8690098800 10 monclient: init 2024-09-12T00:53:09.024 INFO:tasks.workunit.client.0.smithi073.stderr: -193> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x562324861940) adding auth protocol: cephx 2024-09-12T00:53:09.024 INFO:tasks.workunit.client.0.smithi073.stderr: -192> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x562324861940) adding auth protocol: cephx 2024-09-12T00:53:09.025 INFO:tasks.workunit.client.0.smithi073.stderr: -191> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x562324861940) adding auth protocol: cephx 2024-09-12T00:53:09.025 INFO:tasks.workunit.client.0.smithi073.stderr: -190> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x562324861940) adding con mode: secure 2024-09-12T00:53:09.025 INFO:tasks.workunit.client.0.smithi073.stderr: -189> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x562324861940) adding con mode: crc 2024-09-12T00:53:09.025 INFO:tasks.workunit.client.0.smithi073.stderr: -188> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x562324861940) adding con mode: secure 2024-09-12T00:53:09.025 INFO:tasks.workunit.client.0.smithi073.stderr: -187> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x562324861940) adding con mode: crc 2024-09-12T00:53:09.025 INFO:tasks.workunit.client.0.smithi073.stderr: -186> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x562324861940) adding con mode: secure 2024-09-12T00:53:09.025 INFO:tasks.workunit.client.0.smithi073.stderr: -185> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x562324861940) adding con mode: crc 2024-09-12T00:53:09.025 INFO:tasks.workunit.client.0.smithi073.stderr: -184> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x562324861940) adding con mode: crc 2024-09-12T00:53:09.025 INFO:tasks.workunit.client.0.smithi073.stderr: -183> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x562324861940) adding con mode: secure 2024-09-12T00:53:09.025 INFO:tasks.workunit.client.0.smithi073.stderr: -182> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x562324861940) adding con mode: crc 2024-09-12T00:53:09.025 INFO:tasks.workunit.client.0.smithi073.stderr: -181> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x562324861940) adding con mode: secure 2024-09-12T00:53:09.025 INFO:tasks.workunit.client.0.smithi073.stderr: -180> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x562324861940) adding con mode: crc 2024-09-12T00:53:09.025 INFO:tasks.workunit.client.0.smithi073.stderr: -179> 2024-09-12T00:53:08.656+0000 7f8690098800 5 AuthRegistry(0x562324861940) adding con mode: secure 2024-09-12T00:53:09.026 INFO:tasks.workunit.client.0.smithi073.stderr: -178> 2024-09-12T00:53:08.657+0000 7f8690098800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:09.026 INFO:tasks.workunit.client.0.smithi073.stderr: -177> 2024-09-12T00:53:08.657+0000 7f8690098800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:09.026 INFO:tasks.workunit.client.0.smithi073.stderr: -176> 2024-09-12T00:53:08.657+0000 7f8690098800 5 asok(0x5623245ad630) register_command rotate-key cmddesc rotate-key hook 0x562324861a88 EEXIST 2024-09-12T00:53:09.026 INFO:tasks.workunit.client.0.smithi073.stderr: -175> 2024-09-12T00:53:08.657+0000 7f8690098800 10 monclient: _reopen_session rank -1 2024-09-12T00:53:09.026 INFO:tasks.workunit.client.0.smithi073.stderr: -174> 2024-09-12T00:53:08.657+0000 7f8690098800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:53:09.026 INFO:tasks.workunit.client.0.smithi073.stderr: -173> 2024-09-12T00:53:08.657+0000 7f8690098800 10 monclient(hunting): picked mon.noname-b con 0x56232489dcf0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:53:09.026 INFO:tasks.workunit.client.0.smithi073.stderr: -172> 2024-09-12T00:53:08.657+0000 7f8690098800 10 monclient(hunting): picked mon.noname-c con 0x5623248a3820 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:53:09.026 INFO:tasks.workunit.client.0.smithi073.stderr: -171> 2024-09-12T00:53:08.657+0000 7f8690098800 10 monclient(hunting): picked mon.noname-a con 0x5623248939b0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:53:09.026 INFO:tasks.workunit.client.0.smithi073.stderr: -170> 2024-09-12T00:53:08.657+0000 7f8690098800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:09.026 INFO:tasks.workunit.client.0.smithi073.stderr: -169> 2024-09-12T00:53:08.657+0000 7f8690098800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:09.026 INFO:tasks.workunit.client.0.smithi073.stderr: -168> 2024-09-12T00:53:08.657+0000 7f8690098800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:09.026 INFO:tasks.workunit.client.0.smithi073.stderr: -167> 2024-09-12T00:53:08.657+0000 7f8690098800 10 monclient(hunting): _renew_subs 2024-09-12T00:53:09.026 INFO:tasks.workunit.client.0.smithi073.stderr: -166> 2024-09-12T00:53:08.657+0000 7f8690098800 10 monclient(hunting): authenticate will time out at 2249.327432s 2024-09-12T00:53:09.026 INFO:tasks.workunit.client.0.smithi073.stderr: -165> 2024-09-12T00:53:08.657+0000 7f868d381640 10 monclient(hunting): get_auth_request con 0x5623248a3820 auth_method 0 2024-09-12T00:53:09.027 INFO:tasks.workunit.client.0.smithi073.stderr: -164> 2024-09-12T00:53:08.657+0000 7f868d381640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:09.027 INFO:tasks.workunit.client.0.smithi073.stderr: -163> 2024-09-12T00:53:08.657+0000 7f868d381640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:09.027 INFO:tasks.workunit.client.0.smithi073.stderr: -162> 2024-09-12T00:53:08.657+0000 7f868d381640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:09.027 INFO:tasks.workunit.client.0.smithi073.stderr: -161> 2024-09-12T00:53:08.657+0000 7f868e383640 10 monclient(hunting): get_auth_request con 0x5623248939b0 auth_method 0 2024-09-12T00:53:09.027 INFO:tasks.workunit.client.0.smithi073.stderr: -160> 2024-09-12T00:53:08.657+0000 7f868e383640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:09.027 INFO:tasks.workunit.client.0.smithi073.stderr: -159> 2024-09-12T00:53:08.657+0000 7f868e383640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:09.027 INFO:tasks.workunit.client.0.smithi073.stderr: -158> 2024-09-12T00:53:08.657+0000 7f868e383640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:09.027 INFO:tasks.workunit.client.0.smithi073.stderr: -157> 2024-09-12T00:53:08.657+0000 7f868d381640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:09.027 INFO:tasks.workunit.client.0.smithi073.stderr: -156> 2024-09-12T00:53:08.657+0000 7f868d381640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:09.027 INFO:tasks.workunit.client.0.smithi073.stderr: -155> 2024-09-12T00:53:08.657+0000 7f868d381640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:09.027 INFO:tasks.workunit.client.0.smithi073.stderr: -154> 2024-09-12T00:53:08.657+0000 7f868e383640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:09.027 INFO:tasks.workunit.client.0.smithi073.stderr: -153> 2024-09-12T00:53:08.657+0000 7f868e383640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:09.027 INFO:tasks.workunit.client.0.smithi073.stderr: -152> 2024-09-12T00:53:08.657+0000 7f868e383640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:09.027 INFO:tasks.workunit.client.0.smithi073.stderr: -151> 2024-09-12T00:53:08.657+0000 7f868d381640 10 monclient(hunting): handle_auth_done global_id 7526 payload 824 2024-09-12T00:53:09.028 INFO:tasks.workunit.client.0.smithi073.stderr: -150> 2024-09-12T00:53:08.657+0000 7f868d381640 10 monclient: _finish_hunting 0 2024-09-12T00:53:09.028 INFO:tasks.workunit.client.0.smithi073.stderr: -149> 2024-09-12T00:53:08.657+0000 7f868d381640 1 monclient: found mon.noname-c 2024-09-12T00:53:09.028 INFO:tasks.workunit.client.0.smithi073.stderr: -148> 2024-09-12T00:53:08.657+0000 7f868d381640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.73:3301/0 2024-09-12T00:53:09.028 INFO:tasks.workunit.client.0.smithi073.stderr: -147> 2024-09-12T00:53:08.657+0000 7f855f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:09.028 INFO:tasks.workunit.client.0.smithi073.stderr: -146> 2024-09-12T00:53:08.657+0000 7f855f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:53:09.028 INFO:tasks.workunit.client.0.smithi073.stderr: -145> 2024-09-12T00:53:08.657+0000 7f855f7fe640 10 monclient: dump: 2024-09-12T00:53:09.028 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:53:09.028 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:53:09.028 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:09.028 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:09.028 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:09.028 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:53:09.029 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:53:09.029 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:53:09.029 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:53:09.029 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:09.029 INFO:tasks.workunit.client.0.smithi073.stderr: -144> 2024-09-12T00:53:08.657+0000 7f855f7fe640 10 monclient: _finish_auth 0 2024-09-12T00:53:09.029 INFO:tasks.workunit.client.0.smithi073.stderr: -143> 2024-09-12T00:53:08.658+0000 7f855f7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:53:09.029 INFO:tasks.workunit.client.0.smithi073.stderr: -142> 2024-09-12T00:53:08.658+0000 7f855f7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:53:09.029 INFO:tasks.workunit.client.0.smithi073.stderr: -141> 2024-09-12T00:53:08.658+0000 7f855f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:09.029 INFO:tasks.workunit.client.0.smithi073.stderr: -140> 2024-09-12T00:53:08.658+0000 7f855f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:53:09.029 INFO:tasks.workunit.client.0.smithi073.stderr: -139> 2024-09-12T00:53:08.658+0000 7f855f7fe640 10 monclient: dump: 2024-09-12T00:53:09.029 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:53:09.029 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:53:09.029 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:09.030 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:09.030 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:09.030 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:53:09.030 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:53:09.030 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:53:09.030 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:53:09.030 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:09.030 INFO:tasks.workunit.client.0.smithi073.stderr: -138> 2024-09-12T00:53:08.658+0000 7f8690098800 5 monclient: authenticate success, global_id 7526 2024-09-12T00:53:09.030 INFO:tasks.workunit.client.0.smithi073.stderr: -137> 2024-09-12T00:53:08.658+0000 7f8690098800 10 monclient: _renew_subs 2024-09-12T00:53:09.030 INFO:tasks.workunit.client.0.smithi073.stderr: -136> 2024-09-12T00:53:08.658+0000 7f85717fa640 4 set_mon_vals no callback set 2024-09-12T00:53:09.030 INFO:tasks.workunit.client.0.smithi073.stderr: -135> 2024-09-12T00:53:08.658+0000 7f8690098800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:53:09.030 INFO:tasks.workunit.client.0.smithi073.stderr: -134> 2024-09-12T00:53:08.658+0000 7f8690098800 10 monclient: _renew_subs 2024-09-12T00:53:09.030 INFO:tasks.workunit.client.0.smithi073.stderr: -133> 2024-09-12T00:53:08.658+0000 7f8690098800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:53:09.031 INFO:tasks.workunit.client.0.smithi073.stderr: -132> 2024-09-12T00:53:08.658+0000 7f8690098800 1 librados: init done 2024-09-12T00:53:09.031 INFO:tasks.workunit.client.0.smithi073.stderr: -131> 2024-09-12T00:53:08.658+0000 7f8690098800 5 asok(0x5623245ad630) register_command cr dump hook 0x56232486be68 2024-09-12T00:53:09.031 INFO:tasks.workunit.client.0.smithi073.stderr: -130> 2024-09-12T00:53:08.659+0000 7f8690098800 20 rados->read ofs=0 len=0 2024-09-12T00:53:09.031 INFO:tasks.workunit.client.0.smithi073.stderr: -129> 2024-09-12T00:53:08.659+0000 7f855f7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:53:09.031 INFO:tasks.workunit.client.0.smithi073.stderr: -128> 2024-09-12T00:53:08.659+0000 7f855f7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:53:09.031 INFO:tasks.workunit.client.0.smithi073.stderr: -127> 2024-09-12T00:53:08.659+0000 7f855f7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:53:09.031 INFO:tasks.workunit.client.0.smithi073.stderr: -126> 2024-09-12T00:53:08.660+0000 7f868db82640 10 monclient: get_auth_request con 0x7f85580764a0 auth_method 0 2024-09-12T00:53:09.031 INFO:tasks.workunit.client.0.smithi073.stderr: -125> 2024-09-12T00:53:08.660+0000 7f868e383640 10 monclient: get_auth_request con 0x5623248b8d90 auth_method 0 2024-09-12T00:53:09.031 INFO:tasks.workunit.client.0.smithi073.stderr: -124> 2024-09-12T00:53:08.660+0000 7f8690098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:09.031 INFO:tasks.workunit.client.0.smithi073.stderr: -123> 2024-09-12T00:53:08.660+0000 7f8690098800 20 realm 2024-09-12T00:53:09.031 INFO:tasks.workunit.client.0.smithi073.stderr: -122> 2024-09-12T00:53:08.660+0000 7f8690098800 20 rados->read ofs=0 len=0 2024-09-12T00:53:09.031 INFO:tasks.workunit.client.0.smithi073.stderr: -121> 2024-09-12T00:53:08.660+0000 7f8690098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:09.031 INFO:tasks.workunit.client.0.smithi073.stderr: -120> 2024-09-12T00:53:08.661+0000 7f8690098800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:09.032 INFO:tasks.workunit.client.0.smithi073.stderr: -119> 2024-09-12T00:53:08.661+0000 7f8690098800 20 rados->read ofs=0 len=0 2024-09-12T00:53:09.032 INFO:tasks.workunit.client.0.smithi073.stderr: -118> 2024-09-12T00:53:08.661+0000 7f8690098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:09.032 INFO:tasks.workunit.client.0.smithi073.stderr: -117> 2024-09-12T00:53:08.661+0000 7f8690098800 20 rados->read ofs=0 len=0 2024-09-12T00:53:09.032 INFO:tasks.workunit.client.0.smithi073.stderr: -116> 2024-09-12T00:53:08.661+0000 7f868db82640 10 monclient: get_auth_request con 0x5623248bcfc0 auth_method 0 2024-09-12T00:53:09.032 INFO:tasks.workunit.client.0.smithi073.stderr: -115> 2024-09-12T00:53:08.662+0000 7f8690098800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:09.032 INFO:tasks.workunit.client.0.smithi073.stderr: -114> 2024-09-12T00:53:08.662+0000 7f8690098800 20 rados->read ofs=0 len=0 2024-09-12T00:53:09.032 INFO:tasks.workunit.client.0.smithi073.stderr: -113> 2024-09-12T00:53:08.662+0000 7f868d381640 10 monclient: get_auth_request con 0x5623248c0820 auth_method 0 2024-09-12T00:53:09.032 INFO:tasks.workunit.client.0.smithi073.stderr: -112> 2024-09-12T00:53:08.663+0000 7f8690098800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:09.032 INFO:tasks.workunit.client.0.smithi073.stderr: -111> 2024-09-12T00:53:08.663+0000 7f8690098800 20 searching for the correct realm 2024-09-12T00:53:09.032 INFO:tasks.workunit.client.0.smithi073.stderr: -110> 2024-09-12T00:53:08.663+0000 7f868e383640 10 monclient: get_auth_request con 0x5623248c55e0 auth_method 0 2024-09-12T00:53:09.032 INFO:tasks.workunit.client.0.smithi073.stderr: -109> 2024-09-12T00:53:08.664+0000 7f868db82640 10 monclient: get_auth_request con 0x7f8688032970 auth_method 0 2024-09-12T00:53:09.032 INFO:tasks.workunit.client.0.smithi073.stderr: -108> 2024-09-12T00:53:08.664+0000 7f868d381640 10 monclient: get_auth_request con 0x7f8680040060 auth_method 0 2024-09-12T00:53:09.032 INFO:tasks.workunit.client.0.smithi073.stderr: -107> 2024-09-12T00:53:08.665+0000 7f868e383640 10 monclient: get_auth_request con 0x7f867806d060 auth_method 0 2024-09-12T00:53:09.033 INFO:tasks.workunit.client.0.smithi073.stderr: -106> 2024-09-12T00:53:08.665+0000 7f868e383640 0 -- 172.21.15.73:0/3338039331 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f867806d060 msgr2=0x7f86780c6050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:09.033 INFO:tasks.workunit.client.0.smithi073.stderr: -105> 2024-09-12T00:53:08.866+0000 7f868e383640 10 monclient: get_auth_request con 0x7f867806d060 auth_method 0 2024-09-12T00:53:09.033 INFO:tasks.workunit.client.0.smithi073.stderr: -104> 2024-09-12T00:53:08.870+0000 7f868db82640 10 monclient: get_auth_request con 0x7f8688044040 auth_method 0 2024-09-12T00:53:09.033 INFO:tasks.workunit.client.0.smithi073.stderr: -103> 2024-09-12T00:53:08.871+0000 7f868e383640 0 -- 172.21.15.73:0/3338039331 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f867806d060 msgr2=0x7f86780c6050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:09.033 INFO:tasks.workunit.client.0.smithi073.stderr: -102> 2024-09-12T00:53:08.871+0000 7f855f7fe640 1 client.7526.objecter ms_handle_reset 0x7f867806d060 session 0x7f86780be040 osd.4 2024-09-12T00:53:09.033 INFO:tasks.workunit.client.0.smithi073.stderr: -101> 2024-09-12T00:53:08.871+0000 7f855f7fe640 10 monclient: _renew_subs 2024-09-12T00:53:09.033 INFO:tasks.workunit.client.0.smithi073.stderr: -100> 2024-09-12T00:53:08.871+0000 7f855f7fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:53:09.033 INFO:tasks.workunit.client.0.smithi073.stderr: -99> 2024-09-12T00:53:08.871+0000 7f868e383640 10 monclient: get_auth_request con 0x7f85580863a0 auth_method 0 2024-09-12T00:53:09.033 INFO:tasks.workunit.client.0.smithi073.stderr: -98> 2024-09-12T00:53:08.875+0000 7f8690098800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:53:09.033 INFO:tasks.workunit.client.0.smithi073.stderr: -97> 2024-09-12T00:53:08.875+0000 7f8690098800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:09.033 INFO:tasks.workunit.client.0.smithi073.stderr: -96> 2024-09-12T00:53:08.875+0000 7f8690098800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:53:09.033 INFO:tasks.workunit.client.0.smithi073.stderr: -95> 2024-09-12T00:53:08.875+0000 7f8690098800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:09.033 INFO:tasks.workunit.client.0.smithi073.stderr: -94> 2024-09-12T00:53:08.875+0000 7f8690098800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:09.034 INFO:tasks.workunit.client.0.smithi073.stderr: -93> 2024-09-12T00:53:08.875+0000 7f8690098800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:09.034 INFO:tasks.workunit.client.0.smithi073.stderr: -92> 2024-09-12T00:53:08.875+0000 7f8690098800 20 rados->read ofs=0 len=0 2024-09-12T00:53:09.034 INFO:tasks.workunit.client.0.smithi073.stderr: -91> 2024-09-12T00:53:08.876+0000 7f8690098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:09.034 INFO:tasks.workunit.client.0.smithi073.stderr: -90> 2024-09-12T00:53:08.876+0000 7f8690098800 20 rados->read ofs=0 len=0 2024-09-12T00:53:09.034 INFO:tasks.workunit.client.0.smithi073.stderr: -89> 2024-09-12T00:53:08.876+0000 7f8690098800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:09.034 INFO:tasks.workunit.client.0.smithi073.stderr: -88> 2024-09-12T00:53:08.876+0000 7f8690098800 20 rados->read ofs=0 len=0 2024-09-12T00:53:09.034 INFO:tasks.workunit.client.0.smithi073.stderr: -87> 2024-09-12T00:53:08.876+0000 7f8690098800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:09.034 INFO:tasks.workunit.client.0.smithi073.stderr: -86> 2024-09-12T00:53:08.876+0000 7f8690098800 20 zone default found 2024-09-12T00:53:09.034 INFO:tasks.workunit.client.0.smithi073.stderr: -85> 2024-09-12T00:53:08.876+0000 7f8690098800 4 Realm: () 2024-09-12T00:53:09.034 INFO:tasks.workunit.client.0.smithi073.stderr: -84> 2024-09-12T00:53:08.876+0000 7f8690098800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:53:09.034 INFO:tasks.workunit.client.0.smithi073.stderr: -83> 2024-09-12T00:53:08.876+0000 7f8690098800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:53:09.034 INFO:tasks.workunit.client.0.smithi073.stderr: -82> 2024-09-12T00:53:08.876+0000 7f8690098800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:09.034 INFO:tasks.workunit.client.0.smithi073.stderr: -81> 2024-09-12T00:53:08.876+0000 7f8690098800 20 zonegroup default 2024-09-12T00:53:09.034 INFO:tasks.workunit.client.0.smithi073.stderr: -80> 2024-09-12T00:53:08.876+0000 7f8690098800 20 rados->read ofs=0 len=0 2024-09-12T00:53:09.034 INFO:tasks.workunit.client.0.smithi073.stderr: -79> 2024-09-12T00:53:08.876+0000 7f8690098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:09.035 INFO:tasks.workunit.client.0.smithi073.stderr: -78> 2024-09-12T00:53:08.876+0000 7f8690098800 20 rados->read ofs=0 len=0 2024-09-12T00:53:09.035 INFO:tasks.workunit.client.0.smithi073.stderr: -77> 2024-09-12T00:53:08.877+0000 7f8690098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:09.035 INFO:tasks.workunit.client.0.smithi073.stderr: -76> 2024-09-12T00:53:08.877+0000 7f8690098800 20 rados->read ofs=0 len=0 2024-09-12T00:53:09.035 INFO:tasks.workunit.client.0.smithi073.stderr: -75> 2024-09-12T00:53:08.877+0000 7f8690098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:09.035 INFO:tasks.workunit.client.0.smithi073.stderr: -74> 2024-09-12T00:53:08.877+0000 7f8690098800 20 started sync module instance, tier type = 2024-09-12T00:53:09.035 INFO:tasks.workunit.client.0.smithi073.stderr: -73> 2024-09-12T00:53:08.877+0000 7f8690098800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:53:09.035 INFO:tasks.workunit.client.0.smithi073.stderr: -72> 2024-09-12T00:53:08.887+0000 7f8690098800 20 add_watcher() i=0 2024-09-12T00:53:09.035 INFO:tasks.workunit.client.0.smithi073.stderr: -71> 2024-09-12T00:53:08.887+0000 7f8690098800 20 add_watcher() i=1 2024-09-12T00:53:09.035 INFO:tasks.workunit.client.0.smithi073.stderr: -70> 2024-09-12T00:53:08.887+0000 7f8690098800 20 add_watcher() i=2 2024-09-12T00:53:09.035 INFO:tasks.workunit.client.0.smithi073.stderr: -69> 2024-09-12T00:53:08.887+0000 7f8690098800 20 add_watcher() i=3 2024-09-12T00:53:09.035 INFO:tasks.workunit.client.0.smithi073.stderr: -68> 2024-09-12T00:53:08.887+0000 7f8690098800 20 add_watcher() i=4 2024-09-12T00:53:09.035 INFO:tasks.workunit.client.0.smithi073.stderr: -67> 2024-09-12T00:53:08.887+0000 7f8690098800 20 add_watcher() i=5 2024-09-12T00:53:09.035 INFO:tasks.workunit.client.0.smithi073.stderr: -66> 2024-09-12T00:53:08.887+0000 7f8690098800 20 add_watcher() i=6 2024-09-12T00:53:09.036 INFO:tasks.workunit.client.0.smithi073.stderr: -65> 2024-09-12T00:53:08.888+0000 7f8690098800 20 add_watcher() i=7 2024-09-12T00:53:09.036 INFO:tasks.workunit.client.0.smithi073.stderr: -64> 2024-09-12T00:53:08.888+0000 7f8690098800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:09.036 INFO:tasks.workunit.client.0.smithi073.stderr: -63> 2024-09-12T00:53:08.889+0000 7f8690098800 5 AuthRegistry(0x7ffece801f80) adding auth protocol: cephx 2024-09-12T00:53:09.036 INFO:tasks.workunit.client.0.smithi073.stderr: -62> 2024-09-12T00:53:08.889+0000 7f8690098800 5 AuthRegistry(0x7ffece801f80) adding auth protocol: cephx 2024-09-12T00:53:09.036 INFO:tasks.workunit.client.0.smithi073.stderr: -61> 2024-09-12T00:53:08.889+0000 7f8690098800 5 AuthRegistry(0x7ffece801f80) adding auth protocol: cephx 2024-09-12T00:53:09.036 INFO:tasks.workunit.client.0.smithi073.stderr: -60> 2024-09-12T00:53:08.889+0000 7f8690098800 5 AuthRegistry(0x7ffece801f80) adding con mode: secure 2024-09-12T00:53:09.036 INFO:tasks.workunit.client.0.smithi073.stderr: -59> 2024-09-12T00:53:08.889+0000 7f8690098800 5 AuthRegistry(0x7ffece801f80) adding con mode: crc 2024-09-12T00:53:09.036 INFO:tasks.workunit.client.0.smithi073.stderr: -58> 2024-09-12T00:53:08.889+0000 7f8690098800 5 AuthRegistry(0x7ffece801f80) adding con mode: secure 2024-09-12T00:53:09.036 INFO:tasks.workunit.client.0.smithi073.stderr: -57> 2024-09-12T00:53:08.889+0000 7f8690098800 5 AuthRegistry(0x7ffece801f80) adding con mode: crc 2024-09-12T00:53:09.036 INFO:tasks.workunit.client.0.smithi073.stderr: -56> 2024-09-12T00:53:08.889+0000 7f8690098800 5 AuthRegistry(0x7ffece801f80) adding con mode: secure 2024-09-12T00:53:09.036 INFO:tasks.workunit.client.0.smithi073.stderr: -55> 2024-09-12T00:53:08.889+0000 7f8690098800 5 AuthRegistry(0x7ffece801f80) adding con mode: crc 2024-09-12T00:53:09.036 INFO:tasks.workunit.client.0.smithi073.stderr: -54> 2024-09-12T00:53:08.889+0000 7f8690098800 5 AuthRegistry(0x7ffece801f80) adding con mode: crc 2024-09-12T00:53:09.036 INFO:tasks.workunit.client.0.smithi073.stderr: -53> 2024-09-12T00:53:08.889+0000 7f8690098800 5 AuthRegistry(0x7ffece801f80) adding con mode: secure 2024-09-12T00:53:09.037 INFO:tasks.workunit.client.0.smithi073.stderr: -52> 2024-09-12T00:53:08.889+0000 7f8690098800 5 AuthRegistry(0x7ffece801f80) adding con mode: crc 2024-09-12T00:53:09.037 INFO:tasks.workunit.client.0.smithi073.stderr: -51> 2024-09-12T00:53:08.889+0000 7f8690098800 5 AuthRegistry(0x7ffece801f80) adding con mode: secure 2024-09-12T00:53:09.037 INFO:tasks.workunit.client.0.smithi073.stderr: -50> 2024-09-12T00:53:08.889+0000 7f8690098800 5 AuthRegistry(0x7ffece801f80) adding con mode: crc 2024-09-12T00:53:09.037 INFO:tasks.workunit.client.0.smithi073.stderr: -49> 2024-09-12T00:53:08.889+0000 7f8690098800 5 AuthRegistry(0x7ffece801f80) adding con mode: secure 2024-09-12T00:53:09.037 INFO:tasks.workunit.client.0.smithi073.stderr: -48> 2024-09-12T00:53:08.889+0000 7f853ffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:09.037 INFO:tasks.workunit.client.0.smithi073.stderr: -47> 2024-09-12T00:53:08.890+0000 7f8690098800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:09.037 INFO:tasks.workunit.client.0.smithi073.stderr: -46> 2024-09-12T00:53:08.890+0000 7f8690098800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:09.037 INFO:tasks.workunit.client.0.smithi073.stderr: -45> 2024-09-12T00:53:08.890+0000 7f8690098800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:09.037 INFO:tasks.workunit.client.0.smithi073.stderr: -44> 2024-09-12T00:53:08.890+0000 7f8690098800 5 asok(0x5623245ad630) register_command cache list hook 0x562324893d90 2024-09-12T00:53:09.037 INFO:tasks.workunit.client.0.smithi073.stderr: -43> 2024-09-12T00:53:08.890+0000 7f8690098800 5 asok(0x5623245ad630) register_command cache inspect hook 0x562324893d90 2024-09-12T00:53:09.037 INFO:tasks.workunit.client.0.smithi073.stderr: -42> 2024-09-12T00:53:08.890+0000 7f8690098800 5 asok(0x5623245ad630) register_command cache erase hook 0x562324893d90 2024-09-12T00:53:09.037 INFO:tasks.workunit.client.0.smithi073.stderr: -41> 2024-09-12T00:53:08.890+0000 7f8690098800 5 asok(0x5623245ad630) register_command cache zap hook 0x562324893d90 2024-09-12T00:53:09.037 INFO:tasks.workunit.client.0.smithi073.stderr: -40> 2024-09-12T00:53:08.890+0000 7f8690098800 5 note: GC not initialized 2024-09-12T00:53:09.037 INFO:tasks.workunit.client.0.smithi073.stderr: -39> 2024-09-12T00:53:08.890+0000 7f853effd640 20 reqs_thread_entry: start 2024-09-12T00:53:09.038 INFO:tasks.workunit.client.0.smithi073.stderr: -38> 2024-09-12T00:53:08.890+0000 7f8690098800 5 asok(0x5623245ad630) register_command sync trace show hook 0x7f86880092d0 2024-09-12T00:53:09.038 INFO:tasks.workunit.client.0.smithi073.stderr: -37> 2024-09-12T00:53:08.890+0000 7f8690098800 5 asok(0x5623245ad630) register_command sync trace history hook 0x7f86880092d0 2024-09-12T00:53:09.038 INFO:tasks.workunit.client.0.smithi073.stderr: -36> 2024-09-12T00:53:08.890+0000 7f8690098800 5 asok(0x5623245ad630) register_command sync trace active hook 0x7f86880092d0 2024-09-12T00:53:09.038 INFO:tasks.workunit.client.0.smithi073.stderr: -35> 2024-09-12T00:53:08.890+0000 7f8690098800 5 asok(0x5623245ad630) register_command sync trace active_short hook 0x7f86880092d0 2024-09-12T00:53:09.038 INFO:tasks.workunit.client.0.smithi073.stderr: -34> 2024-09-12T00:53:08.890+0000 7f8690098800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:09.038 INFO:tasks.workunit.client.0.smithi073.stderr: -33> 2024-09-12T00:53:08.890+0000 7f8690098800 20 Filter name: none 2024-09-12T00:53:09.038 INFO:tasks.workunit.client.0.smithi073.stderr: -32> 2024-09-12T00:53:08.890+0000 7f853cff9640 20 reqs_thread_entry: start 2024-09-12T00:53:09.038 INFO:tasks.workunit.client.0.smithi073.stderr: -31> 2024-09-12T00:53:08.890+0000 7f8690098800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:53:09.038 INFO:tasks.workunit.client.0.smithi073.stderr: -30> 2024-09-12T00:53:08.890+0000 7f8690098800 20 rados->read ofs=0 len=0 2024-09-12T00:53:09.038 INFO:tasks.workunit.client.0.smithi073.stderr: -29> 2024-09-12T00:53:08.891+0000 7f8690098800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:53:09.038 INFO:tasks.workunit.client.0.smithi073.stderr: -28> 2024-09-12T00:53:08.891+0000 7f8690098800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:53:09.038 INFO:tasks.workunit.client.0.smithi073.stderr: -27> 2024-09-12T00:53:08.891+0000 7f8690098800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:53:09.038 INFO:tasks.workunit.client.0.smithi073.stderr: -26> 2024-09-12T00:53:08.891+0000 7f8690098800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39 : miss 2024-09-12T00:53:09.039 INFO:tasks.workunit.client.0.smithi073.stderr: -25> 2024-09-12T00:53:08.891+0000 7f8690098800 20 rados->read ofs=0 len=0 2024-09-12T00:53:09.039 INFO:tasks.workunit.client.0.smithi073.stderr: -24> 2024-09-12T00:53:08.891+0000 7f8690098800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:53:09.039 INFO:tasks.workunit.client.0.smithi073.stderr: -23> 2024-09-12T00:53:08.891+0000 7f8690098800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39 info.flags=0x17 2024-09-12T00:53:09.039 INFO:tasks.workunit.client.0.smithi073.stderr: -22> 2024-09-12T00:53:08.891+0000 7f8690098800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39 to cache LRU end 2024-09-12T00:53:09.039 INFO:tasks.workunit.client.0.smithi073.stderr: -21> 2024-09-12T00:53:08.891+0000 7f8690098800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:53:09.039 INFO:tasks.workunit.client.0.smithi073.stderr: -20> 2024-09-12T00:53:08.891+0000 7f8690098800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:09.039 INFO:tasks.workunit.client.0.smithi073.stderr: -19> 2024-09-12T00:53:08.891+0000 7f8690098800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39 2024-09-12T00:53:09.039 INFO:tasks.workunit.client.0.smithi073.stderr: -18> 2024-09-12T00:53:08.895+0000 7f8690098800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39 info.flags=0x17 2024-09-12T00:53:09.039 INFO:tasks.workunit.client.0.smithi073.stderr: -17> 2024-09-12T00:53:08.895+0000 7f8690098800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39 to cache LRU end 2024-09-12T00:53:09.039 INFO:tasks.workunit.client.0.smithi073.stderr: -16> 2024-09-12T00:53:08.895+0000 7f8690098800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:09.039 INFO:tasks.workunit.client.0.smithi073.stderr: -15> 2024-09-12T00:53:08.895+0000 7f8690098800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39, ofs0, ns] 2024-09-12T00:53:09.039 INFO:tasks.workunit.client.0.smithi073.stderr: -14> 2024-09-12T00:53:08.895+0000 7f85717fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497017 cookie 94708937056128 notifier 7526 bl.length()=931 2024-09-12T00:53:09.039 INFO:tasks.workunit.client.0.smithi073.stderr: -13> 2024-09-12T00:53:08.895+0000 7f85717fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39 info.flags=0x17 2024-09-12T00:53:09.039 INFO:tasks.workunit.client.0.smithi073.stderr: -12> 2024-09-12T00:53:08.895+0000 7f85717fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39 to cache LRU end 2024-09-12T00:53:09.040 INFO:tasks.workunit.client.0.smithi073.stderr: -11> 2024-09-12T00:53:08.895+0000 7f85717fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:09.040 INFO:tasks.workunit.client.0.smithi073.stderr: -10> 2024-09-12T00:53:08.897+0000 7f8690098800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39]): orig_sources= new_sources= 2024-09-12T00:53:09.040 INFO:tasks.workunit.client.0.smithi073.stderr: -9> 2024-09-12T00:53:08.897+0000 7f8690098800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39]): potential sources added=[] removed=[] 2024-09-12T00:53:09.040 INFO:tasks.workunit.client.0.smithi073.stderr: -8> 2024-09-12T00:53:08.897+0000 7f8690098800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39]): orig_dests= new_dests= 2024-09-12T00:53:09.040 INFO:tasks.workunit.client.0.smithi073.stderr: -7> 2024-09-12T00:53:08.897+0000 7f8690098800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39]): potential dests added=[] removed=[] 2024-09-12T00:53:09.040 INFO:tasks.workunit.client.0.smithi073.stderr: -6> 2024-09-12T00:53:08.899+0000 7f8690098800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39.1.0 2024-09-12T00:53:09.040 INFO:tasks.workunit.client.0.smithi073.stderr: -5> 2024-09-12T00:53:08.899+0000 7f8690098800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39.1.0 2024-09-12T00:53:09.040 INFO:tasks.workunit.client.0.smithi073.stderr: -4> 2024-09-12T00:53:08.899+0000 7f8690098800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39.1.1 2024-09-12T00:53:09.040 INFO:tasks.workunit.client.0.smithi073.stderr: -3> 2024-09-12T00:53:08.899+0000 7f8690098800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39.1.1 2024-09-12T00:53:09.040 INFO:tasks.workunit.client.0.smithi073.stderr: -2> 2024-09-12T00:53:08.899+0000 7f8690098800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39.0 2024-09-12T00:53:09.040 INFO:tasks.workunit.client.0.smithi073.stderr: -1> 2024-09-12T00:53:08.902+0000 7f8690098800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8690098800 time 2024-09-12T00:53:08.902856+0000 2024-09-12T00:53:09.040 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:53:09.041 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:09.041 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:53:09.041 INFO:tasks.workunit.client.0.smithi073.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f869358c71a] 2024-09-12T00:53:09.041 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f869358c8d8] 2024-09-12T00:53:09.041 INFO:tasks.workunit.client.0.smithi073.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5623222e3641] 2024-09-12T00:53:09.041 INFO:tasks.workunit.client.0.smithi073.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5623222f251b] 2024-09-12T00:53:09.041 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5623222f33e4] 2024-09-12T00:53:09.041 INFO:tasks.workunit.client.0.smithi073.stderr: 6: main() 2024-09-12T00:53:09.041 INFO:tasks.workunit.client.0.smithi073.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f8692229590] 2024-09-12T00:53:09.041 INFO:tasks.workunit.client.0.smithi073.stderr: 8: __libc_start_main() 2024-09-12T00:53:09.041 INFO:tasks.workunit.client.0.smithi073.stderr: 9: _start() 2024-09-12T00:53:09.041 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:09.041 INFO:tasks.workunit.client.0.smithi073.stderr: 0> 2024-09-12T00:53:08.903+0000 7f8690098800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:53:09.042 INFO:tasks.workunit.client.0.smithi073.stderr: in thread 7f8690098800 thread_name:radosgw-admin 2024-09-12T00:53:09.042 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:09.042 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:53:09.042 INFO:tasks.workunit.client.0.smithi073.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f869223e6f0] 2024-09-12T00:53:09.042 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f869228b99c] 2024-09-12T00:53:09.042 INFO:tasks.workunit.client.0.smithi073.stderr: 3: raise() 2024-09-12T00:53:09.042 INFO:tasks.workunit.client.0.smithi073.stderr: 4: abort() 2024-09-12T00:53:09.042 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f869358c774] 2024-09-12T00:53:09.042 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f869358c8d8] 2024-09-12T00:53:09.042 INFO:tasks.workunit.client.0.smithi073.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5623222e3641] 2024-09-12T00:53:09.042 INFO:tasks.workunit.client.0.smithi073.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5623222f251b] 2024-09-12T00:53:09.042 INFO:tasks.workunit.client.0.smithi073.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5623222f33e4] 2024-09-12T00:53:09.043 INFO:tasks.workunit.client.0.smithi073.stderr: 10: main() 2024-09-12T00:53:09.043 INFO:tasks.workunit.client.0.smithi073.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f8692229590] 2024-09-12T00:53:09.043 INFO:tasks.workunit.client.0.smithi073.stderr: 12: __libc_start_main() 2024-09-12T00:53:09.043 INFO:tasks.workunit.client.0.smithi073.stderr: 13: _start() 2024-09-12T00:53:09.043 INFO:tasks.workunit.client.0.smithi073.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:53:09.043 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:09.043 INFO:tasks.workunit.client.0.smithi073.stderr:--- logging levels --- 2024-09-12T00:53:09.043 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 none 2024-09-12T00:53:09.043 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 lockdep 2024-09-12T00:53:09.043 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 context 2024-09-12T00:53:09.043 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 crush 2024-09-12T00:53:09.043 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds 2024-09-12T00:53:09.043 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_balancer 2024-09-12T00:53:09.044 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_locker 2024-09-12T00:53:09.044 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_log 2024-09-12T00:53:09.044 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_log_expire 2024-09-12T00:53:09.044 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_migrator 2024-09-12T00:53:09.044 INFO:tasks.workunit.client.0.smithi073.stderr: 3/ 5 mds_quiesce 2024-09-12T00:53:09.044 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 buffer 2024-09-12T00:53:09.044 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 timer 2024-09-12T00:53:09.044 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 filer 2024-09-12T00:53:09.044 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 striper 2024-09-12T00:53:09.044 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 objecter 2024-09-12T00:53:09.044 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rados 2024-09-12T00:53:09.044 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd 2024-09-12T00:53:09.044 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_mirror 2024-09-12T00:53:09.045 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_replay 2024-09-12T00:53:09.045 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_pwl 2024-09-12T00:53:09.045 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 journaler 2024-09-12T00:53:09.045 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 objectcacher 2024-09-12T00:53:09.045 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:53:09.045 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 client 2024-09-12T00:53:09.045 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 osd 2024-09-12T00:53:09.045 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 optracker 2024-09-12T00:53:09.045 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 objclass 2024-09-12T00:53:09.045 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 filestore 2024-09-12T00:53:09.045 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 journal 2024-09-12T00:53:09.045 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 0 ms 2024-09-12T00:53:09.045 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mon 2024-09-12T00:53:09.046 INFO:tasks.workunit.client.0.smithi073.stderr: 0/10 monc 2024-09-12T00:53:09.046 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 paxos 2024-09-12T00:53:09.046 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 tp 2024-09-12T00:53:09.046 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 auth 2024-09-12T00:53:09.046 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 crypto 2024-09-12T00:53:09.046 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 finisher 2024-09-12T00:53:09.046 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 reserver 2024-09-12T00:53:09.046 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 heartbeatmap 2024-09-12T00:53:09.046 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 perfcounter 2024-09-12T00:53:09.046 INFO:tasks.workunit.client.0.smithi073.stderr: 20/20 rgw 2024-09-12T00:53:09.046 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_sync 2024-09-12T00:53:09.046 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_datacache 2024-09-12T00:53:09.046 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_access 2024-09-12T00:53:09.047 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:53:09.047 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_flight 2024-09-12T00:53:09.047 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:53:09.047 INFO:tasks.workunit.client.0.smithi073.stderr: 20/20 rgw_notification 2024-09-12T00:53:09.047 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 javaclient 2024-09-12T00:53:09.047 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 asok 2024-09-12T00:53:09.047 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 throttle 2024-09-12T00:53:09.047 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 0 refs 2024-09-12T00:53:09.047 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 compressor 2024-09-12T00:53:09.047 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 bluestore 2024-09-12T00:53:09.047 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 bluefs 2024-09-12T00:53:09.047 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 bdev 2024-09-12T00:53:09.047 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 kstore 2024-09-12T00:53:09.048 INFO:tasks.workunit.client.0.smithi073.stderr: 4/ 5 rocksdb 2024-09-12T00:53:09.048 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 fuse 2024-09-12T00:53:09.048 INFO:tasks.workunit.client.0.smithi073.stderr: 2/ 5 mgr 2024-09-12T00:53:09.048 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mgrc 2024-09-12T00:53:09.048 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 dpdk 2024-09-12T00:53:09.048 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 eventtrace 2024-09-12T00:53:09.048 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 prioritycache 2024-09-12T00:53:09.048 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 test 2024-09-12T00:53:09.048 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:53:09.048 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cephsqlite 2024-09-12T00:53:09.048 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:53:09.048 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore 2024-09-12T00:53:09.048 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_onode 2024-09-12T00:53:09.048 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_odata 2024-09-12T00:53:09.049 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_omap 2024-09-12T00:53:09.049 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_tm 2024-09-12T00:53:09.049 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_t 2024-09-12T00:53:09.049 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:53:09.049 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_epm 2024-09-12T00:53:09.049 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_lba 2024-09-12T00:53:09.049 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:53:09.049 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_cache 2024-09-12T00:53:09.049 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_journal 2024-09-12T00:53:09.049 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_device 2024-09-12T00:53:09.049 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_backref 2024-09-12T00:53:09.049 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 alienstore 2024-09-12T00:53:09.049 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mclock 2024-09-12T00:53:09.050 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cyanstore 2024-09-12T00:53:09.050 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 ceph_exporter 2024-09-12T00:53:09.050 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 memstore 2024-09-12T00:53:09.050 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 trace 2024-09-12T00:53:09.050 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 ceph_dedup 2024-09-12T00:53:09.050 INFO:tasks.workunit.client.0.smithi073.stderr: -2/-2 (syslog threshold) 2024-09-12T00:53:09.050 INFO:tasks.workunit.client.0.smithi073.stderr: 99/99 (stderr threshold) 2024-09-12T00:53:09.050 INFO:tasks.workunit.client.0.smithi073.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:53:09.050 INFO:tasks.workunit.client.0.smithi073.stderr: 7f853cff9640 / http_manager 2024-09-12T00:53:09.050 INFO:tasks.workunit.client.0.smithi073.stderr: 7f853effd640 / http_manager 2024-09-12T00:53:09.050 INFO:tasks.workunit.client.0.smithi073.stderr: 7f853ffff640 / rgw_dt_lg_renew 2024-09-12T00:53:09.050 INFO:tasks.workunit.client.0.smithi073.stderr: 7f855f7fe640 / ms_dispatch 2024-09-12T00:53:09.051 INFO:tasks.workunit.client.0.smithi073.stderr: 7f85717fa640 / io_context_pool 2024-09-12T00:53:09.051 INFO:tasks.workunit.client.0.smithi073.stderr: 7f85737fe640 / ms_dispatch 2024-09-12T00:53:09.051 INFO:tasks.workunit.client.0.smithi073.stderr: 7f857a604640 / ms_dispatch 2024-09-12T00:53:09.051 INFO:tasks.workunit.client.0.smithi073.stderr: 7f857be07640 / io_context_pool 2024-09-12T00:53:09.051 INFO:tasks.workunit.client.0.smithi073.stderr: 7f868d381640 / msgr-worker-2 2024-09-12T00:53:09.052 INFO:tasks.workunit.client.0.smithi073.stderr: 7f868db82640 / msgr-worker-1 2024-09-12T00:53:09.052 INFO:tasks.workunit.client.0.smithi073.stderr: 7f868e383640 / msgr-worker-0 2024-09-12T00:53:09.052 INFO:tasks.workunit.client.0.smithi073.stderr: 7f868eb84640 / io_context_pool 2024-09-12T00:53:09.052 INFO:tasks.workunit.client.0.smithi073.stderr: 7f8690098800 / radosgw-admin 2024-09-12T00:53:09.052 INFO:tasks.workunit.client.0.smithi073.stderr: max_recent 500 2024-09-12T00:53:09.052 INFO:tasks.workunit.client.0.smithi073.stderr: max_new 1000 2024-09-12T00:53:09.052 INFO:tasks.workunit.client.0.smithi073.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:53:08.904455Z_fbfd5f83-0e2f-46ab-8897-4a8908d174e0/log 2024-09-12T00:53:09.052 INFO:tasks.workunit.client.0.smithi073.stderr:--- end dump of recent events --- 2024-09-12T00:53:09.052 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T00:53:09.058 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:09.058 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:09.058 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.978+0000 7fdb1f82f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:09.058 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.980+0000 7fdb1f82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:09.058 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.980+0000 7fdb1f82f800 20 realm 2024-09-12T00:53:09.058 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.980+0000 7fdb1f82f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:09.058 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.980+0000 7fdb1f82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:09.059 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.980+0000 7fdb1f82f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:09.059 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.980+0000 7fdb1f82f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:09.059 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.980+0000 7fdb1f82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:09.059 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.980+0000 7fdb1f82f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:09.059 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.981+0000 7fdb1f82f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:09.059 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.981+0000 7fdb1f82f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:09.059 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.982+0000 7fdb1f82f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:09.059 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.982+0000 7fdb1f82f800 20 searching for the correct realm 2024-09-12T00:53:09.059 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.985+0000 7fdb1b38c640 0 -- 172.21.15.73:0/3267060812 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fdb0403a040 msgr2=0x7fdb0403b430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:09.059 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.990+0000 7fdb1b38c640 0 -- 172.21.15.73:0/3267060812 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fd9e4086310 msgr2=0x7fd9e4088740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:09.059 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.994+0000 7fdb1f82f800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:53:09.059 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.994+0000 7fdb1f82f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:09.059 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.994+0000 7fdb1f82f800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:53:09.060 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.994+0000 7fdb1f82f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:09.060 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.994+0000 7fdb1f82f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:09.060 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.994+0000 7fdb1f82f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:09.060 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.994+0000 7fdb1f82f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:09.060 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.994+0000 7fdb1f82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:09.060 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.994+0000 7fdb1f82f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:09.060 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.994+0000 7fdb1f82f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:09.060 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.994+0000 7fdb1f82f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:09.060 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.995+0000 7fdb1f82f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:09.060 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.995+0000 7fdb1f82f800 20 zone default found 2024-09-12T00:53:09.060 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.995+0000 7fdb1f82f800 4 Realm: () 2024-09-12T00:53:09.060 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.995+0000 7fdb1f82f800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:53:09.060 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.995+0000 7fdb1f82f800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:53:09.061 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.995+0000 7fdb1f82f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:09.061 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.995+0000 7fdb1f82f800 20 zonegroup default 2024-09-12T00:53:09.061 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.995+0000 7fdb1f82f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:09.061 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.995+0000 7fdb1f82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:09.061 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.995+0000 7fdb1f82f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:09.061 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.995+0000 7fdb1f82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:09.061 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.995+0000 7fdb1f82f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:09.061 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.995+0000 7fdb1f82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:09.061 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.995+0000 7fdb1f82f800 20 started sync module instance, tier type = 2024-09-12T00:53:09.061 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:08.995+0000 7fdb1f82f800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:53:09.061 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.005+0000 7fdb1f82f800 20 add_watcher() i=0 2024-09-12T00:53:09.061 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.005+0000 7fdb1f82f800 20 add_watcher() i=1 2024-09-12T00:53:09.061 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.005+0000 7fdb1f82f800 20 add_watcher() i=2 2024-09-12T00:53:09.062 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.005+0000 7fdb1f82f800 20 add_watcher() i=3 2024-09-12T00:53:09.062 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.005+0000 7fdb1f82f800 20 add_watcher() i=4 2024-09-12T00:53:09.062 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.005+0000 7fdb1f82f800 20 add_watcher() i=5 2024-09-12T00:53:09.062 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.005+0000 7fdb1f82f800 20 add_watcher() i=6 2024-09-12T00:53:09.062 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.006+0000 7fdb1f82f800 20 add_watcher() i=7 2024-09-12T00:53:09.062 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.006+0000 7fdb1f82f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:09.062 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.007+0000 7fd9d17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:09.062 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.007+0000 7fdb1f82f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:09.062 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.007+0000 7fdb1f82f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:09.062 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.007+0000 7fdb1f82f800 5 note: GC not initialized 2024-09-12T00:53:09.062 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.008+0000 7fd94bfff640 20 reqs_thread_entry: start 2024-09-12T00:53:09.062 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.008+0000 7fdb1f82f800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:09.062 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.008+0000 7fdb1f82f800 20 Filter name: none 2024-09-12T00:53:09.062 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.008+0000 7fd949ffb640 20 reqs_thread_entry: start 2024-09-12T00:53:09.063 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.008+0000 7fdb1f82f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:09.063 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.008+0000 7fdb1f82f800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:53:09.063 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.008+0000 7fdb1f82f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:09.063 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.009+0000 7fdb1f82f800 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:53:09.063 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.009+0000 7fdb1f82f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:09.063 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.009+0000 7fdb1f82f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:09.063 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.009+0000 7fdb1f82f800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:53:09.063 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.009+0000 7fdb1f82f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:09.063 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.009+0000 7fdb1f82f800 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:53:09.063 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.009+0000 7fdb1f82f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:09.063 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.011+0000 7fd9d17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:09.063 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.013+0000 7fdb1f82f800 20 remove_watcher() i=0 2024-09-12T00:53:09.063 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.013+0000 7fdb1f82f800 2 removed watcher, disabling cache 2024-09-12T00:53:09.063 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.014+0000 7fdb1f82f800 20 remove_watcher() i=1 2024-09-12T00:53:09.064 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.015+0000 7fdb1f82f800 20 remove_watcher() i=2 2024-09-12T00:53:09.064 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.016+0000 7fdb1f82f800 20 remove_watcher() i=3 2024-09-12T00:53:09.064 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.017+0000 7fdb1f82f800 20 remove_watcher() i=4 2024-09-12T00:53:09.064 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.018+0000 7fdb1f82f800 20 remove_watcher() i=5 2024-09-12T00:53:09.064 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.019+0000 7fdb1f82f800 20 remove_watcher() i=6 2024-09-12T00:53:09.064 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.020+0000 7fdb1f82f800 20 remove_watcher() i=7 2024-09-12T00:53:09.064 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:09.064 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:53:09.064 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: abort-at-change-reshard-state id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:53:09.064 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:09.064 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:09.064 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:09.065 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:09.065 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:09.119 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:53:09.151 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:09.151 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:09.188 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.189+0000 7fd5c0814800 20 rados->read ofs=0 len=0 2024-09-12T00:53:09.190 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.191+0000 7fd5c0814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:09.190 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.191+0000 7fd5c0814800 20 realm 2024-09-12T00:53:09.190 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.191+0000 7fd5c0814800 20 rados->read ofs=0 len=0 2024-09-12T00:53:09.190 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.191+0000 7fd5c0814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:09.190 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.191+0000 7fd5c0814800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:09.190 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.191+0000 7fd5c0814800 20 rados->read ofs=0 len=0 2024-09-12T00:53:09.190 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.191+0000 7fd5c0814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:09.190 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.191+0000 7fd5c0814800 20 rados->read ofs=0 len=0 2024-09-12T00:53:09.191 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.192+0000 7fd5c0814800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:09.191 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.192+0000 7fd5c0814800 20 rados->read ofs=0 len=0 2024-09-12T00:53:09.192 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.193+0000 7fd5c0814800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:09.192 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.193+0000 7fd5c0814800 20 searching for the correct realm 2024-09-12T00:53:09.194 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.196+0000 7fd5bc6cc640 0 -- 172.21.15.73:0/4115720835 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fd5a4048140 msgr2=0x7fd5a408e830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:09.198 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.199+0000 7fd5bc6cc640 0 -- 172.21.15.73:0/4115720835 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fd484086370 msgr2=0x7fd4840887a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:09.202 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.203+0000 7fd5c0814800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:53:09.202 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.203+0000 7fd5c0814800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:09.202 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.203+0000 7fd5c0814800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:53:09.202 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.203+0000 7fd5c0814800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:09.202 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.203+0000 7fd5c0814800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:09.202 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.203+0000 7fd5c0814800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:09.203 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.203+0000 7fd5c0814800 20 rados->read ofs=0 len=0 2024-09-12T00:53:09.203 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.203+0000 7fd5c0814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:09.203 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.203+0000 7fd5c0814800 20 rados->read ofs=0 len=0 2024-09-12T00:53:09.204 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.204+0000 7fd5c0814800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:09.204 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.204+0000 7fd5c0814800 20 rados->read ofs=0 len=0 2024-09-12T00:53:09.204 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.204+0000 7fd5c0814800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:09.204 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.204+0000 7fd5c0814800 20 zone default found 2024-09-12T00:53:09.204 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.204+0000 7fd5c0814800 4 Realm: () 2024-09-12T00:53:09.205 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.204+0000 7fd5c0814800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:53:09.205 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.204+0000 7fd5c0814800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:53:09.205 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.204+0000 7fd5c0814800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:09.205 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.204+0000 7fd5c0814800 20 zonegroup default 2024-09-12T00:53:09.205 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.204+0000 7fd5c0814800 20 rados->read ofs=0 len=0 2024-09-12T00:53:09.205 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.204+0000 7fd5c0814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:09.205 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.204+0000 7fd5c0814800 20 rados->read ofs=0 len=0 2024-09-12T00:53:09.205 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.205+0000 7fd5c0814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:09.205 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.205+0000 7fd5c0814800 20 rados->read ofs=0 len=0 2024-09-12T00:53:09.205 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.205+0000 7fd5c0814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:09.205 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.205+0000 7fd5c0814800 20 started sync module instance, tier type = 2024-09-12T00:53:09.205 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.205+0000 7fd5c0814800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:53:09.213 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.214+0000 7fd5c0814800 20 add_watcher() i=0 2024-09-12T00:53:09.213 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.214+0000 7fd5c0814800 20 add_watcher() i=1 2024-09-12T00:53:09.213 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.214+0000 7fd5c0814800 20 add_watcher() i=2 2024-09-12T00:53:09.213 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.214+0000 7fd5c0814800 20 add_watcher() i=3 2024-09-12T00:53:09.213 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.214+0000 7fd5c0814800 20 add_watcher() i=4 2024-09-12T00:53:09.213 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.214+0000 7fd5c0814800 20 add_watcher() i=5 2024-09-12T00:53:09.213 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.214+0000 7fd5c0814800 20 add_watcher() i=6 2024-09-12T00:53:09.214 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.215+0000 7fd5c0814800 20 add_watcher() i=7 2024-09-12T00:53:09.214 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.215+0000 7fd5c0814800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:09.215 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.217+0000 7fd471fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:09.217 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.217+0000 7fd5c0814800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:09.217 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.217+0000 7fd5c0814800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:09.217 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.217+0000 7fd5c0814800 5 note: GC not initialized 2024-09-12T00:53:09.218 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.217+0000 7fd470fe1640 20 reqs_thread_entry: start 2024-09-12T00:53:09.218 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.217+0000 7fd5c0814800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:09.218 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.217+0000 7fd5c0814800 20 Filter name: none 2024-09-12T00:53:09.218 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.217+0000 7fd3ea7fc640 20 reqs_thread_entry: start 2024-09-12T00:53:09.218 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.217+0000 7fd5c0814800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:53:09.218 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.217+0000 7fd5c0814800 20 rados->read ofs=0 len=0 2024-09-12T00:53:09.218 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.218+0000 7fd5c0814800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:53:09.218 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.218+0000 7fd5c0814800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:53:09.218 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.218+0000 7fd5c0814800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:53:09.218 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.218+0000 7fd5c0814800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39 : miss 2024-09-12T00:53:09.218 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.218+0000 7fd5c0814800 20 rados->read ofs=0 len=0 2024-09-12T00:53:09.218 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.218+0000 7fd5c0814800 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:53:09.219 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.218+0000 7fd5c0814800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39 info.flags=0x17 2024-09-12T00:53:09.219 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.218+0000 7fd5c0814800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39 to cache LRU end 2024-09-12T00:53:09.219 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.218+0000 7fd5c0814800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:53:09.219 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.218+0000 7fd5c0814800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:09.219 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.218+0000 7fd5c0814800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39 2024-09-12T00:53:09.220 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.219+0000 7fd5c0814800 0 INFO: RGWReshardLock::lock found lock on abort-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39 to be held by another RGW process; skipping for now 2024-09-12T00:53:09.220 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.220+0000 7fd471fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:09.221 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.222+0000 7fd5c0814800 20 remove_watcher() i=0 2024-09-12T00:53:09.221 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.222+0000 7fd5c0814800 2 removed watcher, disabling cache 2024-09-12T00:53:09.222 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.224+0000 7fd5c0814800 20 remove_watcher() i=1 2024-09-12T00:53:09.223 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.225+0000 7fd5c0814800 20 remove_watcher() i=2 2024-09-12T00:53:09.224 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.226+0000 7fd5c0814800 20 remove_watcher() i=3 2024-09-12T00:53:09.225 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.227+0000 7fd5c0814800 20 remove_watcher() i=4 2024-09-12T00:53:09.226 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.228+0000 7fd5c0814800 20 remove_watcher() i=5 2024-09-12T00:53:09.227 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.229+0000 7fd5c0814800 20 remove_watcher() i=6 2024-09-12T00:53:09.228 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:09.230+0000 7fd5c0814800 20 remove_watcher() i=7 2024-09-12T00:53:09.239 INFO:tasks.workunit.client.0.smithi073.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:53:39.271 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:53:39.306 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:39.306 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:39.348 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.350+0000 7fc64c31f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:39.350 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.351+0000 7fc64c31f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:39.350 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.351+0000 7fc64c31f800 20 realm 2024-09-12T00:53:39.350 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.351+0000 7fc64c31f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:39.351 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.351+0000 7fc64c31f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:39.351 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.351+0000 7fc64c31f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:39.351 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.351+0000 7fc64c31f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:39.351 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.352+0000 7fc64c31f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:39.351 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.352+0000 7fc64c31f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:39.351 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.353+0000 7fc64c31f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:39.351 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.353+0000 7fc64c31f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:39.352 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.354+0000 7fc64c31f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:39.352 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.354+0000 7fc64c31f800 20 searching for the correct realm 2024-09-12T00:53:39.355 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.356+0000 7fc6488a3640 0 -- 172.21.15.73:0/707568260 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fc63c070120 msgr2=0x7fc63c06aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:39.561 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.563+0000 7fc6488a3640 0 -- 172.21.15.73:0/707568260 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fc63c070120 msgr2=0x7fc63c06aa80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:39.567 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.567+0000 7fc64c31f800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:53:39.567 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.567+0000 7fc64c31f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:39.568 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.567+0000 7fc64c31f800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:53:39.568 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.567+0000 7fc64c31f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:39.568 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.567+0000 7fc64c31f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:39.568 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.567+0000 7fc64c31f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:39.568 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.567+0000 7fc64c31f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:39.568 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.568+0000 7fc64c31f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:39.568 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.568+0000 7fc64c31f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:39.568 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.568+0000 7fc64c31f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:39.568 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.568+0000 7fc64c31f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:39.568 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.568+0000 7fc64c31f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:39.568 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.568+0000 7fc64c31f800 20 zone default found 2024-09-12T00:53:39.568 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.568+0000 7fc64c31f800 4 Realm: () 2024-09-12T00:53:39.569 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.568+0000 7fc64c31f800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:53:39.569 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.568+0000 7fc64c31f800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:53:39.569 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.568+0000 7fc64c31f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:39.569 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.568+0000 7fc64c31f800 20 zonegroup default 2024-09-12T00:53:39.569 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.568+0000 7fc64c31f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:39.569 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.569+0000 7fc64c31f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:39.569 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.569+0000 7fc64c31f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:39.570 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.569+0000 7fc64c31f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:39.570 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.569+0000 7fc64c31f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:39.570 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.569+0000 7fc64c31f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:39.570 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.569+0000 7fc64c31f800 20 started sync module instance, tier type = 2024-09-12T00:53:39.570 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.569+0000 7fc64c31f800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:53:39.578 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.580+0000 7fc64c31f800 20 add_watcher() i=0 2024-09-12T00:53:39.578 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.580+0000 7fc64c31f800 20 add_watcher() i=1 2024-09-12T00:53:39.578 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.580+0000 7fc64c31f800 20 add_watcher() i=2 2024-09-12T00:53:39.579 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.580+0000 7fc64c31f800 20 add_watcher() i=3 2024-09-12T00:53:39.579 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.580+0000 7fc64c31f800 20 add_watcher() i=4 2024-09-12T00:53:39.579 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.580+0000 7fc64c31f800 20 add_watcher() i=5 2024-09-12T00:53:39.579 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.580+0000 7fc64c31f800 20 add_watcher() i=6 2024-09-12T00:53:39.579 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.581+0000 7fc64c31f800 20 add_watcher() i=7 2024-09-12T00:53:39.579 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.581+0000 7fc64c31f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:39.581 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.583+0000 7fc4fe7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:39.583 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.583+0000 7fc64c31f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:39.583 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.583+0000 7fc64c31f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:39.583 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.583+0000 7fc64c31f800 5 note: GC not initialized 2024-09-12T00:53:39.583 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.583+0000 7fc4fd7e2640 20 reqs_thread_entry: start 2024-09-12T00:53:39.583 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.583+0000 7fc64c31f800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:39.583 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.583+0000 7fc64c31f800 20 Filter name: none 2024-09-12T00:53:39.583 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.584+0000 7fc46effd640 20 reqs_thread_entry: start 2024-09-12T00:53:39.583 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.584+0000 7fc64c31f800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:53:39.583 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.584+0000 7fc64c31f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:39.583 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.584+0000 7fc64c31f800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:53:39.583 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.584+0000 7fc64c31f800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:53:39.583 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.584+0000 7fc64c31f800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:53:39.584 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.584+0000 7fc64c31f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39 : miss 2024-09-12T00:53:39.584 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.584+0000 7fc64c31f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:39.584 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.584+0000 7fc64c31f800 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:53:39.584 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.584+0000 7fc64c31f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39 info.flags=0x17 2024-09-12T00:53:39.585 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.584+0000 7fc64c31f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39 to cache LRU end 2024-09-12T00:53:39.585 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.584+0000 7fc64c31f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:53:39.585 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.584+0000 7fc64c31f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:39.585 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.584+0000 7fc64c31f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39 2024-09-12T00:53:39.585 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.586+0000 7fc64c31f800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:53:39.588 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.589+0000 7fc64c31f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39 info.flags=0x17 2024-09-12T00:53:39.588 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.589+0000 7fc64c31f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39 to cache LRU end 2024-09-12T00:53:39.588 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.589+0000 7fc64c31f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:39.589 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.589+0000 7fc64c31f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39, ofs0, ns] 2024-09-12T00:53:39.589 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.590+0000 7fc51f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497018 cookie 94595004220192 notifier 8076 bl.length()=931 2024-09-12T00:53:39.589 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.590+0000 7fc51f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39 info.flags=0x17 2024-09-12T00:53:39.589 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.590+0000 7fc51f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39 to cache LRU end 2024-09-12T00:53:39.589 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.590+0000 7fc51f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:39.590 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.592+0000 7fc64c31f800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39]): orig_sources= new_sources= 2024-09-12T00:53:39.590 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.592+0000 7fc64c31f800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39]): potential sources added=[] removed=[] 2024-09-12T00:53:39.590 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.592+0000 7fc64c31f800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39]): orig_dests= new_dests= 2024-09-12T00:53:39.591 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.592+0000 7fc64c31f800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39]): potential dests added=[] removed=[] 2024-09-12T00:53:39.594 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.595+0000 7fc64c31f800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39.2.0 2024-09-12T00:53:39.594 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.595+0000 7fc64c31f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39.2.0 2024-09-12T00:53:39.594 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.595+0000 7fc64c31f800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39.2.1 2024-09-12T00:53:39.594 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.595+0000 7fc64c31f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39.2.1 2024-09-12T00:53:39.594 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.595+0000 7fc64c31f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39.0 2024-09-12T00:53:39.596 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.598+0000 7fc64c31f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39 : hit (requested=0x17, cached=0x17) 2024-09-12T00:53:39.597 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.598+0000 7fc64c31f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39 2024-09-12T00:53:39.598 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.599+0000 7fc64c31f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39 info.flags=0x17 2024-09-12T00:53:39.598 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.599+0000 7fc64c31f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39 to cache LRU end 2024-09-12T00:53:39.598 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.599+0000 7fc64c31f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:39.598 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.599+0000 7fc64c31f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39, ofs0, ns] 2024-09-12T00:53:39.598 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.599+0000 7fc51effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497019 cookie 94595004220192 notifier 8076 bl.length()=931 2024-09-12T00:53:39.598 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.600+0000 7fc51effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39 info.flags=0x17 2024-09-12T00:53:39.599 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.600+0000 7fc51effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39 to cache LRU end 2024-09-12T00:53:39.599 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.600+0000 7fc51effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:39.600 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.601+0000 7fc64c31f800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39]): orig_sources= new_sources= 2024-09-12T00:53:39.600 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.601+0000 7fc64c31f800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39]): potential sources added=[] removed=[] 2024-09-12T00:53:39.600 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.601+0000 7fc64c31f800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39]): orig_dests= new_dests= 2024-09-12T00:53:39.601 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.601+0000 7fc64c31f800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39]): potential dests added=[] removed=[] 2024-09-12T00:53:39.602 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.602+0000 7fc64c31f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39.0 2024-09-12T00:53:39.602 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.603+0000 7fc64c31f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39 : hit (requested=0x17, cached=0x17) 2024-09-12T00:53:39.602 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.603+0000 7fc64c31f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39 2024-09-12T00:53:39.603 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.604+0000 7fc64c31f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39 info.flags=0x17 2024-09-12T00:53:39.603 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.604+0000 7fc64c31f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39 to cache LRU end 2024-09-12T00:53:39.603 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.604+0000 7fc64c31f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:39.603 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.604+0000 7fc64c31f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39, ofs0, ns] 2024-09-12T00:53:39.604 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.605+0000 7fc51f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497020 cookie 94595004220192 notifier 8076 bl.length()=899 2024-09-12T00:53:39.604 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.605+0000 7fc51f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39 info.flags=0x17 2024-09-12T00:53:39.604 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.605+0000 7fc51f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39 to cache LRU end 2024-09-12T00:53:39.604 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.605+0000 7fc51f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:39.605 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.606+0000 7fc64c31f800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39]): orig_sources= new_sources= 2024-09-12T00:53:39.605 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.606+0000 7fc64c31f800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39]): potential sources added=[] removed=[] 2024-09-12T00:53:39.605 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.606+0000 7fc64c31f800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39]): orig_dests= new_dests= 2024-09-12T00:53:39.605 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.606+0000 7fc64c31f800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39]): potential dests added=[] removed=[] 2024-09-12T00:53:39.606 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.608+0000 7fc64c31f800 1 execute INFO: reshard of bucket "abort-at-change-reshard-state" from 1 shards to 2 shards completed successfully 2024-09-12T00:53:39.608 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.610+0000 7fc4fe7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:39.610 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.612+0000 7fc64c31f800 20 remove_watcher() i=0 2024-09-12T00:53:39.610 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.612+0000 7fc64c31f800 2 removed watcher, disabling cache 2024-09-12T00:53:39.611 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.613+0000 7fc64c31f800 20 remove_watcher() i=1 2024-09-12T00:53:39.612 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.614+0000 7fc64c31f800 20 remove_watcher() i=2 2024-09-12T00:53:39.613 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.615+0000 7fc64c31f800 20 remove_watcher() i=3 2024-09-12T00:53:39.614 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.616+0000 7fc64c31f800 20 remove_watcher() i=4 2024-09-12T00:53:39.616 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.617+0000 7fc64c31f800 20 remove_watcher() i=5 2024-09-12T00:53:39.616 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.618+0000 7fc64c31f800 20 remove_watcher() i=6 2024-09-12T00:53:39.617 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.619+0000 7fc64c31f800 20 remove_watcher() i=7 2024-09-12T00:53:39.630 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T00:53:39.659 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:39.659 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:39.695 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.696+0000 7fdecaf46800 20 rados->read ofs=0 len=0 2024-09-12T00:53:39.697 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.698+0000 7fdecaf46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:39.698 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.698+0000 7fdecaf46800 20 realm 2024-09-12T00:53:39.698 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.698+0000 7fdecaf46800 20 rados->read ofs=0 len=0 2024-09-12T00:53:39.698 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.699+0000 7fdecaf46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:39.698 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.699+0000 7fdecaf46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:39.698 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.699+0000 7fdecaf46800 20 rados->read ofs=0 len=0 2024-09-12T00:53:39.698 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.699+0000 7fdecaf46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:39.698 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.699+0000 7fdecaf46800 20 rados->read ofs=0 len=0 2024-09-12T00:53:39.698 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.700+0000 7fdecaf46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:39.699 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.700+0000 7fdecaf46800 20 rados->read ofs=0 len=0 2024-09-12T00:53:39.699 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.700+0000 7fdecaf46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:39.699 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.700+0000 7fdecaf46800 20 searching for the correct realm 2024-09-12T00:53:39.702 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.703+0000 7fdec9238640 0 -- 172.21.15.73:0/2169929387 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fdebc098c20 msgr2=0x7fdebc07d470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:39.909 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.910+0000 7fdec9238640 0 -- 172.21.15.73:0/2169929387 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fdebc098c20 msgr2=0x7fdebc07d470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:39.913 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.914+0000 7fdecaf46800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:53:39.913 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.914+0000 7fdecaf46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:39.913 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.914+0000 7fdecaf46800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:53:39.913 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.914+0000 7fdecaf46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:39.913 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.914+0000 7fdecaf46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:39.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.914+0000 7fdecaf46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:39.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.914+0000 7fdecaf46800 20 rados->read ofs=0 len=0 2024-09-12T00:53:39.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.914+0000 7fdecaf46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:39.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.914+0000 7fdecaf46800 20 rados->read ofs=0 len=0 2024-09-12T00:53:39.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.915+0000 7fdecaf46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:39.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.915+0000 7fdecaf46800 20 rados->read ofs=0 len=0 2024-09-12T00:53:39.916 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.915+0000 7fdecaf46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:39.916 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.915+0000 7fdecaf46800 20 zone default found 2024-09-12T00:53:39.916 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.915+0000 7fdecaf46800 4 Realm: () 2024-09-12T00:53:39.916 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.915+0000 7fdecaf46800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:53:39.916 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.915+0000 7fdecaf46800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:53:39.916 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.915+0000 7fdecaf46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:39.916 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.915+0000 7fdecaf46800 20 zonegroup default 2024-09-12T00:53:39.916 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.915+0000 7fdecaf46800 20 rados->read ofs=0 len=0 2024-09-12T00:53:39.916 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.915+0000 7fdecaf46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:39.917 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.915+0000 7fdecaf46800 20 rados->read ofs=0 len=0 2024-09-12T00:53:39.917 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.915+0000 7fdecaf46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:39.917 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.915+0000 7fdecaf46800 20 rados->read ofs=0 len=0 2024-09-12T00:53:39.917 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.916+0000 7fdecaf46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:39.917 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.916+0000 7fdecaf46800 20 started sync module instance, tier type = 2024-09-12T00:53:39.917 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.916+0000 7fdecaf46800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:53:39.924 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.925+0000 7fdecaf46800 20 add_watcher() i=0 2024-09-12T00:53:39.924 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.925+0000 7fdecaf46800 20 add_watcher() i=1 2024-09-12T00:53:39.924 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.925+0000 7fdecaf46800 20 add_watcher() i=2 2024-09-12T00:53:39.924 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.925+0000 7fdecaf46800 20 add_watcher() i=3 2024-09-12T00:53:39.924 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.925+0000 7fdecaf46800 20 add_watcher() i=4 2024-09-12T00:53:39.924 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.925+0000 7fdecaf46800 20 add_watcher() i=5 2024-09-12T00:53:39.924 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.925+0000 7fdecaf46800 20 add_watcher() i=6 2024-09-12T00:53:39.925 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.926+0000 7fdecaf46800 20 add_watcher() i=7 2024-09-12T00:53:39.925 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.926+0000 7fdecaf46800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:39.928 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.928+0000 7fdd7efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:39.929 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.928+0000 7fdecaf46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:39.929 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.928+0000 7fdecaf46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:39.929 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.928+0000 7fdecaf46800 5 note: GC not initialized 2024-09-12T00:53:39.929 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.929+0000 7fdd7dfe3640 20 reqs_thread_entry: start 2024-09-12T00:53:39.929 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.929+0000 7fdecaf46800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:39.929 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.929+0000 7fdecaf46800 20 Filter name: none 2024-09-12T00:53:39.929 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.929+0000 7fdcef7fe640 20 reqs_thread_entry: start 2024-09-12T00:53:39.929 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.929+0000 7fdecaf46800 20 rados->read ofs=0 len=0 2024-09-12T00:53:39.929 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.929+0000 7fdecaf46800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:53:39.929 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.929+0000 7fdecaf46800 20 rados->read ofs=0 len=0 2024-09-12T00:53:39.930 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.930+0000 7fdecaf46800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:53:39.930 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.930+0000 7fdecaf46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:39.930 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.930+0000 7fdecaf46800 20 rados->read ofs=0 len=0 2024-09-12T00:53:39.930 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.930+0000 7fdecaf46800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:53:39.930 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.930+0000 7fdecaf46800 20 rados->read ofs=0 len=0 2024-09-12T00:53:39.931 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.930+0000 7fdecaf46800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:53:39.931 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.930+0000 7fdecaf46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:39.931 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.932+0000 7fdd7efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:39.932 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.934+0000 7fdecaf46800 20 remove_watcher() i=0 2024-09-12T00:53:39.932 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.934+0000 7fdecaf46800 2 removed watcher, disabling cache 2024-09-12T00:53:39.933 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.935+0000 7fdecaf46800 20 remove_watcher() i=1 2024-09-12T00:53:39.934 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.936+0000 7fdecaf46800 20 remove_watcher() i=2 2024-09-12T00:53:39.935 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.937+0000 7fdecaf46800 20 remove_watcher() i=3 2024-09-12T00:53:39.937 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.938+0000 7fdecaf46800 20 remove_watcher() i=4 2024-09-12T00:53:39.938 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.939+0000 7fdecaf46800 20 remove_watcher() i=5 2024-09-12T00:53:39.939 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.940+0000 7fdecaf46800 20 remove_watcher() i=6 2024-09-12T00:53:39.941 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:39.941+0000 7fdecaf46800 20 remove_watcher() i=7 2024-09-12T00:53:39.950 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:39.950 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:53:39.950 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: abort-at-change-reshard-state id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:53:39.950 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:39.952 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:39.952 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:39.972 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:39.972 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:40.175 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:40.176 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:40.238 INFO:tasks.workunit.client.0.smithi073.stderr: test: logrecord could be stopped after reshard failed 2024-09-12T00:53:40.239 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:53:40.267 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:40.267 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:40.304 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.305+0000 7fb39b92c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:40.306 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.307+0000 7fb39b92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:40.306 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.307+0000 7fb39b92c800 20 realm 2024-09-12T00:53:40.306 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.307+0000 7fb39b92c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:40.306 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.307+0000 7fb39b92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:40.306 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.307+0000 7fb39b92c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:40.306 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.307+0000 7fb39b92c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:40.306 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.307+0000 7fb39b92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:40.306 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.307+0000 7fb39b92c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:40.306 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.308+0000 7fb39b92c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:40.307 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.308+0000 7fb39b92c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:40.307 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.309+0000 7fb39b92c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:40.307 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.309+0000 7fb39b92c800 20 searching for the correct realm 2024-09-12T00:53:40.310 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.311+0000 7fb397d3f640 0 -- 172.21.15.73:0/1612979821 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fb380063b00 msgr2=0x7fb380048c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:40.314 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.315+0000 7fb397d3f640 0 -- 172.21.15.73:0/1612979821 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fb260086310 msgr2=0x7fb260088740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:40.318 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.319+0000 7fb39b92c800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:53:40.318 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.319+0000 7fb39b92c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:40.318 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.319+0000 7fb39b92c800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:53:40.318 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.319+0000 7fb39b92c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:40.318 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.319+0000 7fb39b92c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:40.318 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.319+0000 7fb39b92c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:40.318 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.319+0000 7fb39b92c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:40.319 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.319+0000 7fb39b92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:40.319 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.319+0000 7fb39b92c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:40.320 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.320+0000 7fb39b92c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:40.320 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.320+0000 7fb39b92c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:40.320 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.320+0000 7fb39b92c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:40.320 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.320+0000 7fb39b92c800 20 zone default found 2024-09-12T00:53:40.320 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.320+0000 7fb39b92c800 4 Realm: () 2024-09-12T00:53:40.320 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.320+0000 7fb39b92c800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:53:40.321 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.320+0000 7fb39b92c800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:53:40.321 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.320+0000 7fb39b92c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:40.321 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.320+0000 7fb39b92c800 20 zonegroup default 2024-09-12T00:53:40.321 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.320+0000 7fb39b92c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:40.321 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.320+0000 7fb39b92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:40.321 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.320+0000 7fb39b92c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:40.321 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.321+0000 7fb39b92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:40.321 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.321+0000 7fb39b92c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:40.321 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.321+0000 7fb39b92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:40.321 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.321+0000 7fb39b92c800 20 started sync module instance, tier type = 2024-09-12T00:53:40.321 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.321+0000 7fb39b92c800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:53:40.329 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.330+0000 7fb39b92c800 20 add_watcher() i=0 2024-09-12T00:53:40.329 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.330+0000 7fb39b92c800 20 add_watcher() i=1 2024-09-12T00:53:40.329 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.330+0000 7fb39b92c800 20 add_watcher() i=2 2024-09-12T00:53:40.329 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.330+0000 7fb39b92c800 20 add_watcher() i=3 2024-09-12T00:53:40.329 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.330+0000 7fb39b92c800 20 add_watcher() i=4 2024-09-12T00:53:40.329 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.330+0000 7fb39b92c800 20 add_watcher() i=5 2024-09-12T00:53:40.329 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.330+0000 7fb39b92c800 20 add_watcher() i=6 2024-09-12T00:53:40.329 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.331+0000 7fb39b92c800 20 add_watcher() i=7 2024-09-12T00:53:40.330 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.331+0000 7fb39b92c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:40.331 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.332+0000 7fb24dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:40.332 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.333+0000 7fb39b92c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:40.332 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.333+0000 7fb39b92c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:40.332 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.333+0000 7fb39b92c800 5 note: GC not initialized 2024-09-12T00:53:40.332 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.333+0000 7fb24cfe1640 20 reqs_thread_entry: start 2024-09-12T00:53:40.332 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.333+0000 7fb39b92c800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:40.332 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.333+0000 7fb39b92c800 20 Filter name: none 2024-09-12T00:53:40.333 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.333+0000 7fb1c67fc640 20 reqs_thread_entry: start 2024-09-12T00:53:40.333 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.333+0000 7fb39b92c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:40.333 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.334+0000 7fb39b92c800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:53:40.334 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.334+0000 7fb39b92c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:40.334 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.334+0000 7fb39b92c800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:53:40.334 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.334+0000 7fb39b92c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:40.334 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.334+0000 7fb39b92c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:40.334 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.335+0000 7fb39b92c800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:53:40.334 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.335+0000 7fb39b92c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:40.334 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.335+0000 7fb39b92c800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:53:40.334 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.335+0000 7fb39b92c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:40.334 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.336+0000 7fb24dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:40.340 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.338+0000 7fb39b92c800 20 remove_watcher() i=0 2024-09-12T00:53:40.340 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.338+0000 7fb39b92c800 2 removed watcher, disabling cache 2024-09-12T00:53:40.341 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.339+0000 7fb39b92c800 20 remove_watcher() i=1 2024-09-12T00:53:40.341 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.340+0000 7fb39b92c800 20 remove_watcher() i=2 2024-09-12T00:53:40.341 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.341+0000 7fb39b92c800 20 remove_watcher() i=3 2024-09-12T00:53:40.341 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.342+0000 7fb39b92c800 20 remove_watcher() i=4 2024-09-12T00:53:40.342 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.343+0000 7fb39b92c800 20 remove_watcher() i=5 2024-09-12T00:53:40.343 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.344+0000 7fb39b92c800 20 remove_watcher() i=6 2024-09-12T00:53:40.344 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.345+0000 7fb39b92c800 20 remove_watcher() i=7 2024-09-12T00:53:40.354 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:40.355 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:53:40.355 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: a-bucket id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 num_objects: 8 size_kb: 1 num_shards: 3 2024-09-12T00:53:40.355 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:40.356 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:53:40.385 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:40.385 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:40.422 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.423+0000 7f29559af800 20 rados->read ofs=0 len=0 2024-09-12T00:53:40.424 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.425+0000 7f29559af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:40.424 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.425+0000 7f29559af800 20 realm 2024-09-12T00:53:40.424 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.425+0000 7f29559af800 20 rados->read ofs=0 len=0 2024-09-12T00:53:40.424 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.425+0000 7f29559af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:40.424 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.425+0000 7f29559af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:40.424 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.425+0000 7f29559af800 20 rados->read ofs=0 len=0 2024-09-12T00:53:40.424 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.425+0000 7f29559af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:40.424 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.425+0000 7f29559af800 20 rados->read ofs=0 len=0 2024-09-12T00:53:40.425 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.426+0000 7f29559af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:40.425 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.426+0000 7f29559af800 20 rados->read ofs=0 len=0 2024-09-12T00:53:40.425 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.427+0000 7f29559af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:40.425 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.427+0000 7f29559af800 20 searching for the correct realm 2024-09-12T00:53:40.427 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.429+0000 7f2953ca1640 0 -- 172.21.15.73:0/752601424 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f293c0b44d0 msgr2=0x7f293c0aa3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:53:40.635 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.636+0000 7f2953ca1640 0 -- 172.21.15.73:0/752601424 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f293c0b44d0 msgr2=0x7f293c0aa3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:40.639 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.640+0000 7f29559af800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:53:40.639 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.640+0000 7f29559af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:40.639 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.640+0000 7f29559af800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:53:40.639 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.640+0000 7f29559af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:40.640 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.640+0000 7f29559af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:40.640 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.640+0000 7f29559af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:40.640 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.640+0000 7f29559af800 20 rados->read ofs=0 len=0 2024-09-12T00:53:40.640 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.640+0000 7f29559af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:40.640 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.640+0000 7f29559af800 20 rados->read ofs=0 len=0 2024-09-12T00:53:40.640 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.641+0000 7f29559af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:40.640 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.641+0000 7f29559af800 20 rados->read ofs=0 len=0 2024-09-12T00:53:40.641 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.641+0000 7f29559af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:40.641 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.641+0000 7f29559af800 20 zone default found 2024-09-12T00:53:40.641 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.641+0000 7f29559af800 4 Realm: () 2024-09-12T00:53:40.642 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.641+0000 7f29559af800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:53:40.642 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.641+0000 7f29559af800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:53:40.642 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.641+0000 7f29559af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:40.642 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.641+0000 7f29559af800 20 zonegroup default 2024-09-12T00:53:40.642 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.641+0000 7f29559af800 20 rados->read ofs=0 len=0 2024-09-12T00:53:40.642 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.641+0000 7f29559af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:40.642 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.641+0000 7f29559af800 20 rados->read ofs=0 len=0 2024-09-12T00:53:40.642 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.642+0000 7f29559af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:40.642 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.642+0000 7f29559af800 20 rados->read ofs=0 len=0 2024-09-12T00:53:40.642 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.642+0000 7f29559af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:40.642 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.642+0000 7f29559af800 20 started sync module instance, tier type = 2024-09-12T00:53:40.642 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.642+0000 7f29559af800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:53:40.650 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.651+0000 7f29559af800 20 add_watcher() i=0 2024-09-12T00:53:40.650 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.651+0000 7f29559af800 20 add_watcher() i=1 2024-09-12T00:53:40.650 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.651+0000 7f29559af800 20 add_watcher() i=2 2024-09-12T00:53:40.650 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.651+0000 7f29559af800 20 add_watcher() i=3 2024-09-12T00:53:40.650 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.651+0000 7f29559af800 20 add_watcher() i=4 2024-09-12T00:53:40.650 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.651+0000 7f29559af800 20 add_watcher() i=5 2024-09-12T00:53:40.650 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.651+0000 7f29559af800 20 add_watcher() i=6 2024-09-12T00:53:40.651 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.652+0000 7f29559af800 20 add_watcher() i=7 2024-09-12T00:53:40.651 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.652+0000 7f29559af800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:40.653 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.654+0000 7f2809fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:40.653 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.654+0000 7f29559af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:40.653 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.654+0000 7f29559af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:40.654 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.654+0000 7f29559af800 5 note: GC not initialized 2024-09-12T00:53:40.654 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.654+0000 7f2808fe1640 20 reqs_thread_entry: start 2024-09-12T00:53:40.654 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.654+0000 7f29559af800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:40.654 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.655+0000 7f29559af800 20 Filter name: none 2024-09-12T00:53:40.654 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.655+0000 7f27827fc640 20 reqs_thread_entry: start 2024-09-12T00:53:40.654 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.655+0000 7f29559af800 20 rados->read ofs=0 len=0 2024-09-12T00:53:40.655 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.655+0000 7f29559af800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:53:40.655 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.655+0000 7f29559af800 20 rados->read ofs=0 len=0 2024-09-12T00:53:40.655 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.655+0000 7f29559af800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:53:40.655 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.655+0000 7f29559af800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:40.655 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.655+0000 7f29559af800 20 rados->read ofs=0 len=0 2024-09-12T00:53:40.655 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.656+0000 7f29559af800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:53:40.655 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.656+0000 7f29559af800 20 rados->read ofs=0 len=0 2024-09-12T00:53:40.656 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.656+0000 7f29559af800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:53:40.656 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.656+0000 7f29559af800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:40.656 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.657+0000 7f2809fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:40.658 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.659+0000 7f29559af800 20 remove_watcher() i=0 2024-09-12T00:53:40.658 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.659+0000 7f29559af800 2 removed watcher, disabling cache 2024-09-12T00:53:40.659 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.661+0000 7f29559af800 20 remove_watcher() i=1 2024-09-12T00:53:40.660 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.662+0000 7f29559af800 20 remove_watcher() i=2 2024-09-12T00:53:40.662 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.663+0000 7f29559af800 20 remove_watcher() i=3 2024-09-12T00:53:40.662 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.664+0000 7f29559af800 20 remove_watcher() i=4 2024-09-12T00:53:40.663 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.665+0000 7f29559af800 20 remove_watcher() i=5 2024-09-12T00:53:40.664 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.666+0000 7f29559af800 20 remove_watcher() i=6 2024-09-12T00:53:40.665 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.667+0000 7f29559af800 20 remove_watcher() i=7 2024-09-12T00:53:40.677 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-12T00:53:40.711 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:40.711 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:40.951 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.952+0000 7fb9a7a20800 20 rados->read ofs=0 len=0 2024-09-12T00:53:40.953 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.954+0000 7fb9a7a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:40.953 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.954+0000 7fb9a7a20800 20 realm 2024-09-12T00:53:40.953 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.954+0000 7fb9a7a20800 20 rados->read ofs=0 len=0 2024-09-12T00:53:40.953 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.954+0000 7fb9a7a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:40.953 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.954+0000 7fb9a7a20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:40.953 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.954+0000 7fb9a7a20800 20 rados->read ofs=0 len=0 2024-09-12T00:53:40.953 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.954+0000 7fb9a7a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:40.953 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.954+0000 7fb9a7a20800 20 rados->read ofs=0 len=0 2024-09-12T00:53:40.954 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.955+0000 7fb9a7a20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:40.954 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.955+0000 7fb9a7a20800 20 rados->read ofs=0 len=0 2024-09-12T00:53:40.955 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.956+0000 7fb9a7a20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:40.955 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.956+0000 7fb9a7a20800 20 searching for the correct realm 2024-09-12T00:53:40.956 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:40.958+0000 7fb99cd09640 0 -- 172.21.15.73:0/825711095 >> [v2:172.21.15.73:6826/269690776,v1:172.21.15.73:6827/269690776] conn(0x7fb998017070 msgr2=0x7fb99804d3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:41.163 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.164+0000 7fb9a550a640 0 -- 172.21.15.73:0/825711095 >> [v2:172.21.15.73:6810/1807760270,v1:172.21.15.73:6811/1807760270] conn(0x7fb9a0048fa0 msgr2=0x7fb9a0063630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:41.371 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.372+0000 7fb9a7a20800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:53:41.371 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.372+0000 7fb9a7a20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:41.371 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.372+0000 7fb9a7a20800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:53:41.371 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.372+0000 7fb9a7a20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:41.371 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.372+0000 7fb9a7a20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:41.371 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.372+0000 7fb9a7a20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:41.372 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.372+0000 7fb9a7a20800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.372 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.372+0000 7fb9a7a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:41.372 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.372+0000 7fb9a7a20800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.372 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.372+0000 7fb9a7a20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:41.372 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.372+0000 7fb9a7a20800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.373 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.372+0000 7fb9a7a20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:41.373 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.372+0000 7fb9a7a20800 20 zone default found 2024-09-12T00:53:41.373 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.373+0000 7fb9a7a20800 4 Realm: () 2024-09-12T00:53:41.373 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.373+0000 7fb9a7a20800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:53:41.373 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.373+0000 7fb9a7a20800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:53:41.373 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.373+0000 7fb9a7a20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:41.374 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.373+0000 7fb9a7a20800 20 zonegroup default 2024-09-12T00:53:41.374 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.373+0000 7fb9a7a20800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.374 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.373+0000 7fb9a7a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:41.374 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.373+0000 7fb9a7a20800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.374 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.373+0000 7fb9a7a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:41.374 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.373+0000 7fb9a7a20800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.374 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.373+0000 7fb9a7a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:41.374 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.373+0000 7fb9a7a20800 20 started sync module instance, tier type = 2024-09-12T00:53:41.374 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.373+0000 7fb9a7a20800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:53:41.382 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.384+0000 7fb9a7a20800 20 add_watcher() i=0 2024-09-12T00:53:41.382 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.384+0000 7fb9a7a20800 20 add_watcher() i=1 2024-09-12T00:53:41.382 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.384+0000 7fb9a7a20800 20 add_watcher() i=2 2024-09-12T00:53:41.382 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.384+0000 7fb9a7a20800 20 add_watcher() i=3 2024-09-12T00:53:41.383 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.384+0000 7fb9a7a20800 20 add_watcher() i=4 2024-09-12T00:53:41.383 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.384+0000 7fb9a7a20800 20 add_watcher() i=5 2024-09-12T00:53:41.383 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.384+0000 7fb9a7a20800 20 add_watcher() i=6 2024-09-12T00:53:41.384 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.386+0000 7fb9a7a20800 20 add_watcher() i=7 2024-09-12T00:53:41.384 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.386+0000 7fb9a7a20800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:41.386 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.387+0000 7fb85b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:41.387 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.388+0000 7fb9a7a20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:41.388 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.388+0000 7fb9a7a20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:41.388 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.388+0000 7fb9a7a20800 5 note: GC not initialized 2024-09-12T00:53:41.388 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.388+0000 7fb85a7e4640 20 reqs_thread_entry: start 2024-09-12T00:53:41.388 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.388+0000 7fb9a7a20800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:41.388 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.388+0000 7fb9a7a20800 20 Filter name: none 2024-09-12T00:53:41.388 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.388+0000 7fb7cbfff640 20 reqs_thread_entry: start 2024-09-12T00:53:41.388 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.388+0000 7fb9a7a20800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:53:41.388 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.388+0000 7fb9a7a20800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.388 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.389+0000 7fb9a7a20800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:53:41.388 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.389+0000 7fb9a7a20800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:53:41.388 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.389+0000 7fb9a7a20800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:53:41.388 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.389+0000 7fb9a7a20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 : miss 2024-09-12T00:53:41.388 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.389+0000 7fb9a7a20800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.389 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.389+0000 7fb9a7a20800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:53:41.389 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.389+0000 7fb9a7a20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:53:41.389 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.389+0000 7fb9a7a20800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:53:41.389 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.389+0000 7fb9a7a20800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:53:41.389 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.389+0000 7fb9a7a20800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:53:41.389 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.389+0000 7fb9a7a20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 2024-09-12T00:53:41.392 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.393+0000 7fb9a7a20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:53:41.392 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.393+0000 7fb9a7a20800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:53:41.393 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.393+0000 7fb9a7a20800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:53:41.393 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.393+0000 7fb9a7a20800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17, ofs0, ns] 2024-09-12T00:53:41.393 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.394+0000 7fb888ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497044 cookie 94225400489776 notifier 7640 bl.length()=827 2024-09-12T00:53:41.393 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.394+0000 7fb888ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:53:41.393 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.394+0000 7fb888ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:53:41.393 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.394+0000 7fb888ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:53:41.394 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.395+0000 7fb9a7a20800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): orig_sources= new_sources= 2024-09-12T00:53:41.394 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.395+0000 7fb9a7a20800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): potential sources added=[] removed=[] 2024-09-12T00:53:41.394 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.395+0000 7fb9a7a20800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): orig_dests= new_dests= 2024-09-12T00:53:41.394 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.395+0000 7fb9a7a20800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): potential dests added=[] removed=[] 2024-09-12T00:53:41.397 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.398+0000 7fb9a7a20800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.3.0 2024-09-12T00:53:41.397 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.398+0000 7fb9a7a20800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.3.0 2024-09-12T00:53:41.397 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.398+0000 7fb9a7a20800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.3.1 2024-09-12T00:53:41.397 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.398+0000 7fb9a7a20800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.3.1 2024-09-12T00:53:41.397 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.398+0000 7fb9a7a20800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.3.2 2024-09-12T00:53:41.397 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.398+0000 7fb9a7a20800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.3.2 2024-09-12T00:53:41.397 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.398+0000 7fb9a7a20800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.3.3 2024-09-12T00:53:41.397 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.398+0000 7fb9a7a20800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.3.3 2024-09-12T00:53:41.397 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.398+0000 7fb9a7a20800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.0 2024-09-12T00:53:41.397 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.398+0000 7fb9a7a20800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.0 2024-09-12T00:53:41.398 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.399+0000 7fb9a7a20800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.1 2024-09-12T00:53:41.398 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.399+0000 7fb9a7a20800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.1 2024-09-12T00:53:41.398 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.399+0000 7fb9a7a20800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.2 2024-09-12T00:53:41.398 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.399+0000 7fb9a7a20800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.2 2024-09-12T00:53:41.399 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb9a7a20800 time 2024-09-12T00:53:41.402040+0000 2024-09-12T00:53:41.399 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:53:41.400 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:53:41.400 INFO:tasks.workunit.client.0.smithi073.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fb9aaf8c71a] 2024-09-12T00:53:41.400 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fb9aaf8c8d8] 2024-09-12T00:53:41.401 INFO:tasks.workunit.client.0.smithi073.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b28e43f641] 2024-09-12T00:53:41.401 INFO:tasks.workunit.client.0.smithi073.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55b28e44e51b] 2024-09-12T00:53:41.401 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55b28e44f3e4] 2024-09-12T00:53:41.401 INFO:tasks.workunit.client.0.smithi073.stderr: 6: main() 2024-09-12T00:53:41.402 INFO:tasks.workunit.client.0.smithi073.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fb9a9c29590] 2024-09-12T00:53:41.402 INFO:tasks.workunit.client.0.smithi073.stderr: 8: __libc_start_main() 2024-09-12T00:53:41.402 INFO:tasks.workunit.client.0.smithi073.stderr: 9: _start() 2024-09-12T00:53:41.402 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.402+0000 7fb9a7a20800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb9a7a20800 time 2024-09-12T00:53:41.402040+0000 2024-09-12T00:53:41.403 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:53:41.403 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:41.403 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:53:41.403 INFO:tasks.workunit.client.0.smithi073.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fb9aaf8c71a] 2024-09-12T00:53:41.403 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fb9aaf8c8d8] 2024-09-12T00:53:41.403 INFO:tasks.workunit.client.0.smithi073.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b28e43f641] 2024-09-12T00:53:41.403 INFO:tasks.workunit.client.0.smithi073.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55b28e44e51b] 2024-09-12T00:53:41.404 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55b28e44f3e4] 2024-09-12T00:53:41.404 INFO:tasks.workunit.client.0.smithi073.stderr: 6: main() 2024-09-12T00:53:41.404 INFO:tasks.workunit.client.0.smithi073.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fb9a9c29590] 2024-09-12T00:53:41.404 INFO:tasks.workunit.client.0.smithi073.stderr: 8: __libc_start_main() 2024-09-12T00:53:41.404 INFO:tasks.workunit.client.0.smithi073.stderr: 9: _start() 2024-09-12T00:53:41.404 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:41.404 INFO:tasks.workunit.client.0.smithi073.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:53:41.404 INFO:tasks.workunit.client.0.smithi073.stderr: in thread 7fb9a7a20800 thread_name:radosgw-admin 2024-09-12T00:53:41.426 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:53:41.426 INFO:tasks.workunit.client.0.smithi073.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fb9a9c3e6f0] 2024-09-12T00:53:41.426 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fb9a9c8b99c] 2024-09-12T00:53:41.426 INFO:tasks.workunit.client.0.smithi073.stderr: 3: raise() 2024-09-12T00:53:41.426 INFO:tasks.workunit.client.0.smithi073.stderr: 4: abort() 2024-09-12T00:53:41.426 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fb9aaf8c774] 2024-09-12T00:53:41.426 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fb9aaf8c8d8] 2024-09-12T00:53:41.426 INFO:tasks.workunit.client.0.smithi073.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b28e43f641] 2024-09-12T00:53:41.427 INFO:tasks.workunit.client.0.smithi073.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55b28e44e51b] 2024-09-12T00:53:41.427 INFO:tasks.workunit.client.0.smithi073.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55b28e44f3e4] 2024-09-12T00:53:41.427 INFO:tasks.workunit.client.0.smithi073.stderr: 10: main() 2024-09-12T00:53:41.427 INFO:tasks.workunit.client.0.smithi073.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fb9a9c29590] 2024-09-12T00:53:41.427 INFO:tasks.workunit.client.0.smithi073.stderr: 12: __libc_start_main() 2024-09-12T00:53:41.427 INFO:tasks.workunit.client.0.smithi073.stderr: 13: _start() 2024-09-12T00:53:41.427 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.402+0000 7fb9a7a20800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:53:41.427 INFO:tasks.workunit.client.0.smithi073.stderr: in thread 7fb9a7a20800 thread_name:radosgw-admin 2024-09-12T00:53:41.427 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:41.427 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:53:41.428 INFO:tasks.workunit.client.0.smithi073.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fb9a9c3e6f0] 2024-09-12T00:53:41.428 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fb9a9c8b99c] 2024-09-12T00:53:41.428 INFO:tasks.workunit.client.0.smithi073.stderr: 3: raise() 2024-09-12T00:53:41.428 INFO:tasks.workunit.client.0.smithi073.stderr: 4: abort() 2024-09-12T00:53:41.428 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fb9aaf8c774] 2024-09-12T00:53:41.428 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fb9aaf8c8d8] 2024-09-12T00:53:41.428 INFO:tasks.workunit.client.0.smithi073.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b28e43f641] 2024-09-12T00:53:41.428 INFO:tasks.workunit.client.0.smithi073.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55b28e44e51b] 2024-09-12T00:53:41.428 INFO:tasks.workunit.client.0.smithi073.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55b28e44f3e4] 2024-09-12T00:53:41.428 INFO:tasks.workunit.client.0.smithi073.stderr: 10: main() 2024-09-12T00:53:41.428 INFO:tasks.workunit.client.0.smithi073.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fb9a9c29590] 2024-09-12T00:53:41.428 INFO:tasks.workunit.client.0.smithi073.stderr: 12: __libc_start_main() 2024-09-12T00:53:41.429 INFO:tasks.workunit.client.0.smithi073.stderr: 13: _start() 2024-09-12T00:53:41.429 INFO:tasks.workunit.client.0.smithi073.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:53:41.429 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:41.429 INFO:tasks.workunit.client.0.smithi073.stderr:--- begin dump of recent events --- 2024-09-12T00:53:41.429 INFO:tasks.workunit.client.0.smithi073.stderr: -499> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f76e9c0) adding con mode: crc 2024-09-12T00:53:41.429 INFO:tasks.workunit.client.0.smithi073.stderr: -498> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f76e9c0) adding con mode: secure 2024-09-12T00:53:41.429 INFO:tasks.workunit.client.0.smithi073.stderr: -497> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f76e9c0) adding con mode: crc 2024-09-12T00:53:41.429 INFO:tasks.workunit.client.0.smithi073.stderr: -496> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f76e9c0) adding con mode: secure 2024-09-12T00:53:41.429 INFO:tasks.workunit.client.0.smithi073.stderr: -495> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f76e9c0) adding con mode: crc 2024-09-12T00:53:41.429 INFO:tasks.workunit.client.0.smithi073.stderr: -494> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f76e9c0) adding con mode: crc 2024-09-12T00:53:41.429 INFO:tasks.workunit.client.0.smithi073.stderr: -493> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f76e9c0) adding con mode: secure 2024-09-12T00:53:41.429 INFO:tasks.workunit.client.0.smithi073.stderr: -492> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f76e9c0) adding con mode: crc 2024-09-12T00:53:41.429 INFO:tasks.workunit.client.0.smithi073.stderr: -491> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f76e9c0) adding con mode: secure 2024-09-12T00:53:41.430 INFO:tasks.workunit.client.0.smithi073.stderr: -490> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f76e9c0) adding con mode: crc 2024-09-12T00:53:41.430 INFO:tasks.workunit.client.0.smithi073.stderr: -489> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f76e9c0) adding con mode: secure 2024-09-12T00:53:41.430 INFO:tasks.workunit.client.0.smithi073.stderr: -488> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:41.430 INFO:tasks.workunit.client.0.smithi073.stderr: -487> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 1 librados: starting msgr at 2024-09-12T00:53:41.430 INFO:tasks.workunit.client.0.smithi073.stderr: -486> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 1 librados: starting objecter 2024-09-12T00:53:41.430 INFO:tasks.workunit.client.0.smithi073.stderr: -485> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 5 asok(0x55b28f546630) register_command objecter_requests hook 0x55b28f770f60 2024-09-12T00:53:41.430 INFO:tasks.workunit.client.0.smithi073.stderr: -484> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 1 librados: setting wanted keys 2024-09-12T00:53:41.430 INFO:tasks.workunit.client.0.smithi073.stderr: -483> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 1 librados: calling monclient init 2024-09-12T00:53:41.430 INFO:tasks.workunit.client.0.smithi073.stderr: -482> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 10 monclient: init 2024-09-12T00:53:41.430 INFO:tasks.workunit.client.0.smithi073.stderr: -481> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f768d20) adding auth protocol: cephx 2024-09-12T00:53:41.430 INFO:tasks.workunit.client.0.smithi073.stderr: -480> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f768d20) adding auth protocol: cephx 2024-09-12T00:53:41.430 INFO:tasks.workunit.client.0.smithi073.stderr: -479> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f768d20) adding auth protocol: cephx 2024-09-12T00:53:41.430 INFO:tasks.workunit.client.0.smithi073.stderr: -478> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f768d20) adding con mode: secure 2024-09-12T00:53:41.430 INFO:tasks.workunit.client.0.smithi073.stderr: -477> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f768d20) adding con mode: crc 2024-09-12T00:53:41.431 INFO:tasks.workunit.client.0.smithi073.stderr: -476> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f768d20) adding con mode: secure 2024-09-12T00:53:41.431 INFO:tasks.workunit.client.0.smithi073.stderr: -475> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f768d20) adding con mode: crc 2024-09-12T00:53:41.431 INFO:tasks.workunit.client.0.smithi073.stderr: -474> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f768d20) adding con mode: secure 2024-09-12T00:53:41.431 INFO:tasks.workunit.client.0.smithi073.stderr: -473> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f768d20) adding con mode: crc 2024-09-12T00:53:41.431 INFO:tasks.workunit.client.0.smithi073.stderr: -472> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f768d20) adding con mode: crc 2024-09-12T00:53:41.431 INFO:tasks.workunit.client.0.smithi073.stderr: -471> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f768d20) adding con mode: secure 2024-09-12T00:53:41.431 INFO:tasks.workunit.client.0.smithi073.stderr: -470> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f768d20) adding con mode: crc 2024-09-12T00:53:41.431 INFO:tasks.workunit.client.0.smithi073.stderr: -469> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f768d20) adding con mode: secure 2024-09-12T00:53:41.431 INFO:tasks.workunit.client.0.smithi073.stderr: -468> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f768d20) adding con mode: crc 2024-09-12T00:53:41.431 INFO:tasks.workunit.client.0.smithi073.stderr: -467> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f768d20) adding con mode: secure 2024-09-12T00:53:41.431 INFO:tasks.workunit.client.0.smithi073.stderr: -466> 2024-09-12T00:53:40.734+0000 7fb9a7a20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:41.431 INFO:tasks.workunit.client.0.smithi073.stderr: -465> 2024-09-12T00:53:40.734+0000 7fb9a7a20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:41.431 INFO:tasks.workunit.client.0.smithi073.stderr: -464> 2024-09-12T00:53:40.734+0000 7fb9a7a20800 5 asok(0x55b28f546630) register_command rotate-key hook 0x55b28f768e68 2024-09-12T00:53:41.432 INFO:tasks.workunit.client.0.smithi073.stderr: -463> 2024-09-12T00:53:40.734+0000 7fb9a7a20800 10 monclient: _reopen_session rank -1 2024-09-12T00:53:41.432 INFO:tasks.workunit.client.0.smithi073.stderr: -462> 2024-09-12T00:53:40.734+0000 7fb9a7a20800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:53:41.432 INFO:tasks.workunit.client.0.smithi073.stderr: -461> 2024-09-12T00:53:40.734+0000 7fb9a7a20800 10 monclient(hunting): picked mon.noname-c con 0x55b28f5f0e80 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:53:41.432 INFO:tasks.workunit.client.0.smithi073.stderr: -460> 2024-09-12T00:53:40.734+0000 7fb9a7a20800 10 monclient(hunting): picked mon.noname-a con 0x55b28f61eda0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:53:41.432 INFO:tasks.workunit.client.0.smithi073.stderr: -459> 2024-09-12T00:53:40.734+0000 7fb9a7a20800 10 monclient(hunting): picked mon.noname-b con 0x55b28f6b20c0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:53:41.432 INFO:tasks.workunit.client.0.smithi073.stderr: -458> 2024-09-12T00:53:40.734+0000 7fb9a7a20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:41.432 INFO:tasks.workunit.client.0.smithi073.stderr: -457> 2024-09-12T00:53:40.734+0000 7fb9a7a20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:41.432 INFO:tasks.workunit.client.0.smithi073.stderr: -456> 2024-09-12T00:53:40.734+0000 7fb9a7a20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:41.432 INFO:tasks.workunit.client.0.smithi073.stderr: -455> 2024-09-12T00:53:40.734+0000 7fb9a7a20800 10 monclient(hunting): _renew_subs 2024-09-12T00:53:41.432 INFO:tasks.workunit.client.0.smithi073.stderr: -454> 2024-09-12T00:53:40.734+0000 7fb9a7a20800 10 monclient(hunting): authenticate will time out at 2281.404329s 2024-09-12T00:53:41.432 INFO:tasks.workunit.client.0.smithi073.stderr: -453> 2024-09-12T00:53:40.734+0000 7fb9a550a640 10 monclient(hunting): get_auth_request con 0x55b28f5f0e80 auth_method 0 2024-09-12T00:53:41.432 INFO:tasks.workunit.client.0.smithi073.stderr: -452> 2024-09-12T00:53:40.734+0000 7fb9a550a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:41.433 INFO:tasks.workunit.client.0.smithi073.stderr: -451> 2024-09-12T00:53:40.734+0000 7fb9a550a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:41.433 INFO:tasks.workunit.client.0.smithi073.stderr: -450> 2024-09-12T00:53:40.734+0000 7fb9a550a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:41.433 INFO:tasks.workunit.client.0.smithi073.stderr: -449> 2024-09-12T00:53:40.734+0000 7fb99cd09640 10 monclient(hunting): get_auth_request con 0x55b28f61eda0 auth_method 0 2024-09-12T00:53:41.433 INFO:tasks.workunit.client.0.smithi073.stderr: -448> 2024-09-12T00:53:40.734+0000 7fb99cd09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:41.433 INFO:tasks.workunit.client.0.smithi073.stderr: -447> 2024-09-12T00:53:40.734+0000 7fb99cd09640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:41.433 INFO:tasks.workunit.client.0.smithi073.stderr: -446> 2024-09-12T00:53:40.734+0000 7fb99cd09640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:41.433 INFO:tasks.workunit.client.0.smithi073.stderr: -445> 2024-09-12T00:53:40.734+0000 7fb9a550a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:41.433 INFO:tasks.workunit.client.0.smithi073.stderr: -444> 2024-09-12T00:53:40.734+0000 7fb9a550a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:41.433 INFO:tasks.workunit.client.0.smithi073.stderr: -443> 2024-09-12T00:53:40.734+0000 7fb9a550a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:41.433 INFO:tasks.workunit.client.0.smithi073.stderr: -442> 2024-09-12T00:53:40.734+0000 7fb99cd09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:41.433 INFO:tasks.workunit.client.0.smithi073.stderr: -441> 2024-09-12T00:53:40.734+0000 7fb99cd09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:41.433 INFO:tasks.workunit.client.0.smithi073.stderr: -440> 2024-09-12T00:53:40.734+0000 7fb99cd09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:41.434 INFO:tasks.workunit.client.0.smithi073.stderr: -439> 2024-09-12T00:53:40.734+0000 7fb9a5d0b640 10 monclient(hunting): get_auth_request con 0x55b28f6b20c0 auth_method 0 2024-09-12T00:53:41.434 INFO:tasks.workunit.client.0.smithi073.stderr: -438> 2024-09-12T00:53:40.734+0000 7fb9a5d0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:41.434 INFO:tasks.workunit.client.0.smithi073.stderr: -437> 2024-09-12T00:53:40.734+0000 7fb9a5d0b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:41.434 INFO:tasks.workunit.client.0.smithi073.stderr: -436> 2024-09-12T00:53:40.734+0000 7fb9a5d0b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:41.434 INFO:tasks.workunit.client.0.smithi073.stderr: -435> 2024-09-12T00:53:40.734+0000 7fb99cd09640 10 monclient(hunting): handle_auth_done global_id 8139 payload 824 2024-09-12T00:53:41.434 INFO:tasks.workunit.client.0.smithi073.stderr: -434> 2024-09-12T00:53:40.734+0000 7fb99cd09640 10 monclient: _finish_hunting 0 2024-09-12T00:53:41.434 INFO:tasks.workunit.client.0.smithi073.stderr: -433> 2024-09-12T00:53:40.734+0000 7fb99cd09640 1 monclient: found mon.noname-a 2024-09-12T00:53:41.434 INFO:tasks.workunit.client.0.smithi073.stderr: -432> 2024-09-12T00:53:40.734+0000 7fb99cd09640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:53:41.434 INFO:tasks.workunit.client.0.smithi073.stderr: -431> 2024-09-12T00:53:40.734+0000 7fb891e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:41.434 INFO:tasks.workunit.client.0.smithi073.stderr: -430> 2024-09-12T00:53:40.734+0000 7fb891e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:53:41.434 INFO:tasks.workunit.client.0.smithi073.stderr: -429> 2024-09-12T00:53:40.734+0000 7fb891e03640 10 monclient: dump: 2024-09-12T00:53:41.434 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:53:41.435 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:53:41.435 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:41.435 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:41.435 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:41.435 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:53:41.435 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:53:41.435 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:53:41.435 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:53:41.435 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:41.435 INFO:tasks.workunit.client.0.smithi073.stderr: -428> 2024-09-12T00:53:40.734+0000 7fb891e03640 10 monclient: _finish_auth 0 2024-09-12T00:53:41.435 INFO:tasks.workunit.client.0.smithi073.stderr: -427> 2024-09-12T00:53:40.734+0000 7fb891e03640 10 monclient: _check_auth_tickets 2024-09-12T00:53:41.435 INFO:tasks.workunit.client.0.smithi073.stderr: -426> 2024-09-12T00:53:40.734+0000 7fb891e03640 10 monclient: handle_config config(0 keys) 2024-09-12T00:53:41.435 INFO:tasks.workunit.client.0.smithi073.stderr: -425> 2024-09-12T00:53:40.734+0000 7fb891e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:41.435 INFO:tasks.workunit.client.0.smithi073.stderr: -424> 2024-09-12T00:53:40.734+0000 7fb891e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:53:41.436 INFO:tasks.workunit.client.0.smithi073.stderr: -423> 2024-09-12T00:53:40.734+0000 7fb891e03640 10 monclient: dump: 2024-09-12T00:53:41.436 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:53:41.436 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:53:41.436 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:41.436 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:41.436 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:41.436 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:53:41.436 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:53:41.436 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:53:41.436 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:53:41.436 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:41.436 INFO:tasks.workunit.client.0.smithi073.stderr: -422> 2024-09-12T00:53:40.734+0000 7fb9a7a20800 5 monclient: authenticate success, global_id 8139 2024-09-12T00:53:41.436 INFO:tasks.workunit.client.0.smithi073.stderr: -421> 2024-09-12T00:53:40.734+0000 7fb9a7a20800 10 monclient: _renew_subs 2024-09-12T00:53:41.437 INFO:tasks.workunit.client.0.smithi073.stderr: -420> 2024-09-12T00:53:40.734+0000 7fb9a7a20800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:53:41.437 INFO:tasks.workunit.client.0.smithi073.stderr: -419> 2024-09-12T00:53:40.734+0000 7fb893606640 4 set_mon_vals no callback set 2024-09-12T00:53:41.437 INFO:tasks.workunit.client.0.smithi073.stderr: -418> 2024-09-12T00:53:40.735+0000 7fb9a7a20800 10 monclient: _renew_subs 2024-09-12T00:53:41.437 INFO:tasks.workunit.client.0.smithi073.stderr: -417> 2024-09-12T00:53:40.735+0000 7fb9a7a20800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:53:41.437 INFO:tasks.workunit.client.0.smithi073.stderr: -416> 2024-09-12T00:53:40.735+0000 7fb9a7a20800 1 librados: init done 2024-09-12T00:53:41.437 INFO:tasks.workunit.client.0.smithi073.stderr: -415> 2024-09-12T00:53:40.736+0000 7fb891e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:53:41.437 INFO:tasks.workunit.client.0.smithi073.stderr: -414> 2024-09-12T00:53:40.736+0000 7fb891e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:53:41.437 INFO:tasks.workunit.client.0.smithi073.stderr: -413> 2024-09-12T00:53:40.736+0000 7fb891e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:53:41.437 INFO:tasks.workunit.client.0.smithi073.stderr: -412> 2024-09-12T00:53:40.737+0000 7fb9a550a640 10 monclient: get_auth_request con 0x7fb88c0764a0 auth_method 0 2024-09-12T00:53:41.437 INFO:tasks.workunit.client.0.smithi073.stderr: -411> 2024-09-12T00:53:40.737+0000 7fb9a5d0b640 10 monclient: get_auth_request con 0x55b28f7a7860 auth_method 0 2024-09-12T00:53:41.438 INFO:tasks.workunit.client.0.smithi073.stderr: -410> 2024-09-12T00:53:40.738+0000 7fb9a550a640 10 monclient: get_auth_request con 0x55b28f7b3c50 auth_method 0 2024-09-12T00:53:41.438 INFO:tasks.workunit.client.0.smithi073.stderr: -409> 2024-09-12T00:53:40.940+0000 7fb9a550a640 10 monclient: get_auth_request con 0x55b28f7b3c50 auth_method 0 2024-09-12T00:53:41.438 INFO:tasks.workunit.client.0.smithi073.stderr: -408> 2024-09-12T00:53:40.941+0000 7fb99cd09640 10 monclient: get_auth_request con 0x55b28f7b8040 auth_method 0 2024-09-12T00:53:41.438 INFO:tasks.workunit.client.0.smithi073.stderr: -407> 2024-09-12T00:53:40.942+0000 7fb9a7a20800 10 monclient: build_initial_monmap 2024-09-12T00:53:41.438 INFO:tasks.workunit.client.0.smithi073.stderr: -406> 2024-09-12T00:53:40.942+0000 7fb9a7a20800 1 build_initial for_mkfs: 0 2024-09-12T00:53:41.438 INFO:tasks.workunit.client.0.smithi073.stderr: -405> 2024-09-12T00:53:40.942+0000 7fb9a7a20800 10 monclient: monmap: 2024-09-12T00:53:41.438 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:53:41.438 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:53:41.438 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:53:41.439 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:53:41.439 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:53:41.439 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:53:41.439 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:53:41.439 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:53:41.439 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:53:41.439 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:41.439 INFO:tasks.workunit.client.0.smithi073.stderr: -404> 2024-09-12T00:53:40.942+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bcf90) adding auth protocol: cephx 2024-09-12T00:53:41.439 INFO:tasks.workunit.client.0.smithi073.stderr: -403> 2024-09-12T00:53:40.942+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bcf90) adding auth protocol: cephx 2024-09-12T00:53:41.439 INFO:tasks.workunit.client.0.smithi073.stderr: -402> 2024-09-12T00:53:40.942+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bcf90) adding auth protocol: cephx 2024-09-12T00:53:41.439 INFO:tasks.workunit.client.0.smithi073.stderr: -401> 2024-09-12T00:53:40.942+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bcf90) adding con mode: secure 2024-09-12T00:53:41.439 INFO:tasks.workunit.client.0.smithi073.stderr: -400> 2024-09-12T00:53:40.942+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bcf90) adding con mode: crc 2024-09-12T00:53:41.439 INFO:tasks.workunit.client.0.smithi073.stderr: -399> 2024-09-12T00:53:40.942+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bcf90) adding con mode: secure 2024-09-12T00:53:41.440 INFO:tasks.workunit.client.0.smithi073.stderr: -398> 2024-09-12T00:53:40.942+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bcf90) adding con mode: crc 2024-09-12T00:53:41.440 INFO:tasks.workunit.client.0.smithi073.stderr: -397> 2024-09-12T00:53:40.942+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bcf90) adding con mode: secure 2024-09-12T00:53:41.440 INFO:tasks.workunit.client.0.smithi073.stderr: -396> 2024-09-12T00:53:40.942+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bcf90) adding con mode: crc 2024-09-12T00:53:41.440 INFO:tasks.workunit.client.0.smithi073.stderr: -395> 2024-09-12T00:53:40.942+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bcf90) adding con mode: crc 2024-09-12T00:53:41.440 INFO:tasks.workunit.client.0.smithi073.stderr: -394> 2024-09-12T00:53:40.942+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bcf90) adding con mode: secure 2024-09-12T00:53:41.440 INFO:tasks.workunit.client.0.smithi073.stderr: -393> 2024-09-12T00:53:40.942+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bcf90) adding con mode: crc 2024-09-12T00:53:41.440 INFO:tasks.workunit.client.0.smithi073.stderr: -392> 2024-09-12T00:53:40.942+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bcf90) adding con mode: secure 2024-09-12T00:53:41.440 INFO:tasks.workunit.client.0.smithi073.stderr: -391> 2024-09-12T00:53:40.942+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bcf90) adding con mode: crc 2024-09-12T00:53:41.440 INFO:tasks.workunit.client.0.smithi073.stderr: -390> 2024-09-12T00:53:40.942+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bcf90) adding con mode: secure 2024-09-12T00:53:41.440 INFO:tasks.workunit.client.0.smithi073.stderr: -389> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:41.440 INFO:tasks.workunit.client.0.smithi073.stderr: -388> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 5 asok(0x55b28f546630) register_command objecter_requests cmddesc objecter_requests hook 0x55b28f7c09a0 EEXIST 2024-09-12T00:53:41.440 INFO:tasks.workunit.client.0.smithi073.stderr: -387> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 10 monclient: init 2024-09-12T00:53:41.441 INFO:tasks.workunit.client.0.smithi073.stderr: -386> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bb5a8) adding auth protocol: cephx 2024-09-12T00:53:41.441 INFO:tasks.workunit.client.0.smithi073.stderr: -385> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bb5a8) adding auth protocol: cephx 2024-09-12T00:53:41.441 INFO:tasks.workunit.client.0.smithi073.stderr: -384> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bb5a8) adding auth protocol: cephx 2024-09-12T00:53:41.441 INFO:tasks.workunit.client.0.smithi073.stderr: -383> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bb5a8) adding con mode: secure 2024-09-12T00:53:41.441 INFO:tasks.workunit.client.0.smithi073.stderr: -382> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bb5a8) adding con mode: crc 2024-09-12T00:53:41.441 INFO:tasks.workunit.client.0.smithi073.stderr: -381> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bb5a8) adding con mode: secure 2024-09-12T00:53:41.441 INFO:tasks.workunit.client.0.smithi073.stderr: -380> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bb5a8) adding con mode: crc 2024-09-12T00:53:41.441 INFO:tasks.workunit.client.0.smithi073.stderr: -379> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bb5a8) adding con mode: secure 2024-09-12T00:53:41.441 INFO:tasks.workunit.client.0.smithi073.stderr: -378> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bb5a8) adding con mode: crc 2024-09-12T00:53:41.441 INFO:tasks.workunit.client.0.smithi073.stderr: -377> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bb5a8) adding con mode: crc 2024-09-12T00:53:41.441 INFO:tasks.workunit.client.0.smithi073.stderr: -376> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bb5a8) adding con mode: secure 2024-09-12T00:53:41.441 INFO:tasks.workunit.client.0.smithi073.stderr: -375> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bb5a8) adding con mode: crc 2024-09-12T00:53:41.441 INFO:tasks.workunit.client.0.smithi073.stderr: -374> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bb5a8) adding con mode: secure 2024-09-12T00:53:41.441 INFO:tasks.workunit.client.0.smithi073.stderr: -373> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bb5a8) adding con mode: crc 2024-09-12T00:53:41.442 INFO:tasks.workunit.client.0.smithi073.stderr: -372> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bb5a8) adding con mode: secure 2024-09-12T00:53:41.442 INFO:tasks.workunit.client.0.smithi073.stderr: -371> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:41.442 INFO:tasks.workunit.client.0.smithi073.stderr: -370> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:41.442 INFO:tasks.workunit.client.0.smithi073.stderr: -369> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 5 asok(0x55b28f546630) register_command rotate-key cmddesc rotate-key hook 0x55b28f7bb6f0 EEXIST 2024-09-12T00:53:41.442 INFO:tasks.workunit.client.0.smithi073.stderr: -368> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 10 monclient: _reopen_session rank -1 2024-09-12T00:53:41.442 INFO:tasks.workunit.client.0.smithi073.stderr: -367> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:53:41.442 INFO:tasks.workunit.client.0.smithi073.stderr: -366> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 10 monclient(hunting): picked mon.noname-b con 0x55b28f7e4690 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:53:41.442 INFO:tasks.workunit.client.0.smithi073.stderr: -365> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 10 monclient(hunting): picked mon.noname-c con 0x55b28f7e6960 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:53:41.442 INFO:tasks.workunit.client.0.smithi073.stderr: -364> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 10 monclient(hunting): picked mon.noname-a con 0x55b28f7e2e60 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:53:41.442 INFO:tasks.workunit.client.0.smithi073.stderr: -363> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:41.442 INFO:tasks.workunit.client.0.smithi073.stderr: -362> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:41.442 INFO:tasks.workunit.client.0.smithi073.stderr: -361> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:41.443 INFO:tasks.workunit.client.0.smithi073.stderr: -360> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 10 monclient(hunting): _renew_subs 2024-09-12T00:53:41.443 INFO:tasks.workunit.client.0.smithi073.stderr: -359> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 10 monclient(hunting): authenticate will time out at 2281.613867s 2024-09-12T00:53:41.443 INFO:tasks.workunit.client.0.smithi073.stderr: -358> 2024-09-12T00:53:40.944+0000 7fb99cd09640 10 monclient(hunting): get_auth_request con 0x55b28f7e6960 auth_method 0 2024-09-12T00:53:41.443 INFO:tasks.workunit.client.0.smithi073.stderr: -357> 2024-09-12T00:53:40.944+0000 7fb99cd09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:41.443 INFO:tasks.workunit.client.0.smithi073.stderr: -356> 2024-09-12T00:53:40.944+0000 7fb99cd09640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:41.443 INFO:tasks.workunit.client.0.smithi073.stderr: -355> 2024-09-12T00:53:40.944+0000 7fb99cd09640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:41.443 INFO:tasks.workunit.client.0.smithi073.stderr: -354> 2024-09-12T00:53:40.944+0000 7fb9a5d0b640 10 monclient(hunting): get_auth_request con 0x55b28f7e2e60 auth_method 0 2024-09-12T00:53:41.443 INFO:tasks.workunit.client.0.smithi073.stderr: -353> 2024-09-12T00:53:40.944+0000 7fb9a5d0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:41.443 INFO:tasks.workunit.client.0.smithi073.stderr: -352> 2024-09-12T00:53:40.944+0000 7fb9a5d0b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:41.443 INFO:tasks.workunit.client.0.smithi073.stderr: -351> 2024-09-12T00:53:40.944+0000 7fb9a5d0b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:41.443 INFO:tasks.workunit.client.0.smithi073.stderr: -350> 2024-09-12T00:53:40.944+0000 7fb9a550a640 10 monclient(hunting): get_auth_request con 0x55b28f7e4690 auth_method 0 2024-09-12T00:53:41.444 INFO:tasks.workunit.client.0.smithi073.stderr: -349> 2024-09-12T00:53:40.944+0000 7fb9a550a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:41.444 INFO:tasks.workunit.client.0.smithi073.stderr: -348> 2024-09-12T00:53:40.944+0000 7fb9a550a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:41.444 INFO:tasks.workunit.client.0.smithi073.stderr: -347> 2024-09-12T00:53:40.944+0000 7fb9a550a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:41.444 INFO:tasks.workunit.client.0.smithi073.stderr: -346> 2024-09-12T00:53:40.944+0000 7fb99cd09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:41.444 INFO:tasks.workunit.client.0.smithi073.stderr: -345> 2024-09-12T00:53:40.944+0000 7fb99cd09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:41.444 INFO:tasks.workunit.client.0.smithi073.stderr: -344> 2024-09-12T00:53:40.944+0000 7fb99cd09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:41.444 INFO:tasks.workunit.client.0.smithi073.stderr: -343> 2024-09-12T00:53:40.944+0000 7fb9a5d0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:41.444 INFO:tasks.workunit.client.0.smithi073.stderr: -342> 2024-09-12T00:53:40.944+0000 7fb9a5d0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:41.444 INFO:tasks.workunit.client.0.smithi073.stderr: -341> 2024-09-12T00:53:40.944+0000 7fb9a5d0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:41.444 INFO:tasks.workunit.client.0.smithi073.stderr: -340> 2024-09-12T00:53:40.944+0000 7fb9a550a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:41.444 INFO:tasks.workunit.client.0.smithi073.stderr: -339> 2024-09-12T00:53:40.944+0000 7fb9a550a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:41.444 INFO:tasks.workunit.client.0.smithi073.stderr: -338> 2024-09-12T00:53:40.944+0000 7fb9a550a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:41.445 INFO:tasks.workunit.client.0.smithi073.stderr: -337> 2024-09-12T00:53:40.944+0000 7fb9a5d0b640 10 monclient(hunting): handle_auth_done global_id 8142 payload 824 2024-09-12T00:53:41.445 INFO:tasks.workunit.client.0.smithi073.stderr: -336> 2024-09-12T00:53:40.944+0000 7fb9a5d0b640 10 monclient: _finish_hunting 0 2024-09-12T00:53:41.445 INFO:tasks.workunit.client.0.smithi073.stderr: -335> 2024-09-12T00:53:40.944+0000 7fb9a5d0b640 1 monclient: found mon.noname-a 2024-09-12T00:53:41.445 INFO:tasks.workunit.client.0.smithi073.stderr: -334> 2024-09-12T00:53:40.944+0000 7fb9a5d0b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:53:41.445 INFO:tasks.workunit.client.0.smithi073.stderr: -333> 2024-09-12T00:53:40.944+0000 7fb88affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:41.445 INFO:tasks.workunit.client.0.smithi073.stderr: -332> 2024-09-12T00:53:40.944+0000 7fb88affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:53:41.445 INFO:tasks.workunit.client.0.smithi073.stderr: -331> 2024-09-12T00:53:40.944+0000 7fb88affd640 10 monclient: dump: 2024-09-12T00:53:41.445 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:53:41.445 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:53:41.445 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:41.445 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:41.445 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:41.445 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:53:41.446 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:53:41.446 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:53:41.446 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:53:41.446 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:41.446 INFO:tasks.workunit.client.0.smithi073.stderr: -330> 2024-09-12T00:53:40.944+0000 7fb88affd640 10 monclient: _finish_auth 0 2024-09-12T00:53:41.446 INFO:tasks.workunit.client.0.smithi073.stderr: -329> 2024-09-12T00:53:40.944+0000 7fb88affd640 10 monclient: _check_auth_tickets 2024-09-12T00:53:41.446 INFO:tasks.workunit.client.0.smithi073.stderr: -328> 2024-09-12T00:53:40.944+0000 7fb88affd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:53:41.446 INFO:tasks.workunit.client.0.smithi073.stderr: -327> 2024-09-12T00:53:40.944+0000 7fb88affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:41.446 INFO:tasks.workunit.client.0.smithi073.stderr: -326> 2024-09-12T00:53:40.944+0000 7fb88affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:53:41.446 INFO:tasks.workunit.client.0.smithi073.stderr: -325> 2024-09-12T00:53:40.944+0000 7fb88affd640 10 monclient: dump: 2024-09-12T00:53:41.446 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:53:41.446 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:53:41.447 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:41.447 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:41.447 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:41.447 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:53:41.447 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:53:41.447 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:53:41.447 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:53:41.447 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:41.447 INFO:tasks.workunit.client.0.smithi073.stderr: -324> 2024-09-12T00:53:40.944+0000 7fb9a7a20800 5 monclient: authenticate success, global_id 8142 2024-09-12T00:53:41.448 INFO:tasks.workunit.client.0.smithi073.stderr: -323> 2024-09-12T00:53:40.944+0000 7fb9a7a20800 10 monclient: _renew_subs 2024-09-12T00:53:41.448 INFO:tasks.workunit.client.0.smithi073.stderr: -322> 2024-09-12T00:53:40.944+0000 7fb9a7a20800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:53:41.448 INFO:tasks.workunit.client.0.smithi073.stderr: -321> 2024-09-12T00:53:40.944+0000 7fb9a650c640 4 set_mon_vals no callback set 2024-09-12T00:53:41.448 INFO:tasks.workunit.client.0.smithi073.stderr: -320> 2024-09-12T00:53:40.944+0000 7fb9a7a20800 10 monclient: _renew_subs 2024-09-12T00:53:41.448 INFO:tasks.workunit.client.0.smithi073.stderr: -319> 2024-09-12T00:53:40.944+0000 7fb9a7a20800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:53:41.448 INFO:tasks.workunit.client.0.smithi073.stderr: -318> 2024-09-12T00:53:40.946+0000 7fb88affd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:53:41.448 INFO:tasks.workunit.client.0.smithi073.stderr: -317> 2024-09-12T00:53:40.946+0000 7fb88affd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:53:41.448 INFO:tasks.workunit.client.0.smithi073.stderr: -316> 2024-09-12T00:53:40.946+0000 7fb88affd640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:53:41.448 INFO:tasks.workunit.client.0.smithi073.stderr: -315> 2024-09-12T00:53:40.946+0000 7fb9a550a640 10 monclient: get_auth_request con 0x7fb880076380 auth_method 0 2024-09-12T00:53:41.448 INFO:tasks.workunit.client.0.smithi073.stderr: -314> 2024-09-12T00:53:40.946+0000 7fb9a7a20800 10 monclient: get_monmap_and_config 2024-09-12T00:53:41.448 INFO:tasks.workunit.client.0.smithi073.stderr: -313> 2024-09-12T00:53:40.946+0000 7fb9a7a20800 10 monclient: build_initial_monmap 2024-09-12T00:53:41.449 INFO:tasks.workunit.client.0.smithi073.stderr: -312> 2024-09-12T00:53:40.946+0000 7fb9a7a20800 1 build_initial for_mkfs: 0 2024-09-12T00:53:41.449 INFO:tasks.workunit.client.0.smithi073.stderr: -311> 2024-09-12T00:53:40.946+0000 7fb9a7a20800 10 monclient: monmap: 2024-09-12T00:53:41.449 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:53:41.449 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:53:41.449 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:53:41.449 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:53:41.449 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:53:41.449 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:53:41.449 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:53:41.449 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:53:41.449 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:53:41.449 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:41.450 INFO:tasks.workunit.client.0.smithi073.stderr: -310> 2024-09-12T00:53:40.946+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f8044c0) adding auth protocol: cephx 2024-09-12T00:53:41.450 INFO:tasks.workunit.client.0.smithi073.stderr: -309> 2024-09-12T00:53:40.946+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f8044c0) adding auth protocol: cephx 2024-09-12T00:53:41.450 INFO:tasks.workunit.client.0.smithi073.stderr: -308> 2024-09-12T00:53:40.946+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f8044c0) adding auth protocol: cephx 2024-09-12T00:53:41.450 INFO:tasks.workunit.client.0.smithi073.stderr: -307> 2024-09-12T00:53:40.946+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f8044c0) adding con mode: secure 2024-09-12T00:53:41.450 INFO:tasks.workunit.client.0.smithi073.stderr: -306> 2024-09-12T00:53:40.946+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f8044c0) adding con mode: crc 2024-09-12T00:53:41.450 INFO:tasks.workunit.client.0.smithi073.stderr: -305> 2024-09-12T00:53:40.946+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f8044c0) adding con mode: secure 2024-09-12T00:53:41.450 INFO:tasks.workunit.client.0.smithi073.stderr: -304> 2024-09-12T00:53:40.946+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f8044c0) adding con mode: crc 2024-09-12T00:53:41.450 INFO:tasks.workunit.client.0.smithi073.stderr: -303> 2024-09-12T00:53:40.946+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f8044c0) adding con mode: secure 2024-09-12T00:53:41.450 INFO:tasks.workunit.client.0.smithi073.stderr: -302> 2024-09-12T00:53:40.946+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f8044c0) adding con mode: crc 2024-09-12T00:53:41.451 INFO:tasks.workunit.client.0.smithi073.stderr: -301> 2024-09-12T00:53:40.946+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f8044c0) adding con mode: crc 2024-09-12T00:53:41.451 INFO:tasks.workunit.client.0.smithi073.stderr: -300> 2024-09-12T00:53:40.946+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f8044c0) adding con mode: secure 2024-09-12T00:53:41.451 INFO:tasks.workunit.client.0.smithi073.stderr: -299> 2024-09-12T00:53:40.946+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f8044c0) adding con mode: crc 2024-09-12T00:53:41.451 INFO:tasks.workunit.client.0.smithi073.stderr: -298> 2024-09-12T00:53:40.946+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f8044c0) adding con mode: secure 2024-09-12T00:53:41.451 INFO:tasks.workunit.client.0.smithi073.stderr: -297> 2024-09-12T00:53:40.946+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f8044c0) adding con mode: crc 2024-09-12T00:53:41.451 INFO:tasks.workunit.client.0.smithi073.stderr: -296> 2024-09-12T00:53:40.946+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f8044c0) adding con mode: secure 2024-09-12T00:53:41.451 INFO:tasks.workunit.client.0.smithi073.stderr: -295> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:41.451 INFO:tasks.workunit.client.0.smithi073.stderr: -294> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 10 monclient: init 2024-09-12T00:53:41.451 INFO:tasks.workunit.client.0.smithi073.stderr: -293> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd56c0) adding auth protocol: cephx 2024-09-12T00:53:41.451 INFO:tasks.workunit.client.0.smithi073.stderr: -292> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd56c0) adding auth protocol: cephx 2024-09-12T00:53:41.451 INFO:tasks.workunit.client.0.smithi073.stderr: -291> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd56c0) adding auth protocol: cephx 2024-09-12T00:53:41.451 INFO:tasks.workunit.client.0.smithi073.stderr: -290> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd56c0) adding con mode: secure 2024-09-12T00:53:41.452 INFO:tasks.workunit.client.0.smithi073.stderr: -289> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd56c0) adding con mode: crc 2024-09-12T00:53:41.452 INFO:tasks.workunit.client.0.smithi073.stderr: -288> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd56c0) adding con mode: secure 2024-09-12T00:53:41.452 INFO:tasks.workunit.client.0.smithi073.stderr: -287> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd56c0) adding con mode: crc 2024-09-12T00:53:41.452 INFO:tasks.workunit.client.0.smithi073.stderr: -286> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd56c0) adding con mode: secure 2024-09-12T00:53:41.452 INFO:tasks.workunit.client.0.smithi073.stderr: -285> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd56c0) adding con mode: crc 2024-09-12T00:53:41.452 INFO:tasks.workunit.client.0.smithi073.stderr: -284> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd56c0) adding con mode: crc 2024-09-12T00:53:41.452 INFO:tasks.workunit.client.0.smithi073.stderr: -283> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd56c0) adding con mode: secure 2024-09-12T00:53:41.452 INFO:tasks.workunit.client.0.smithi073.stderr: -282> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd56c0) adding con mode: crc 2024-09-12T00:53:41.452 INFO:tasks.workunit.client.0.smithi073.stderr: -281> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd56c0) adding con mode: secure 2024-09-12T00:53:41.452 INFO:tasks.workunit.client.0.smithi073.stderr: -280> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd56c0) adding con mode: crc 2024-09-12T00:53:41.452 INFO:tasks.workunit.client.0.smithi073.stderr: -279> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd56c0) adding con mode: secure 2024-09-12T00:53:41.452 INFO:tasks.workunit.client.0.smithi073.stderr: -278> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:41.452 INFO:tasks.workunit.client.0.smithi073.stderr: -277> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:41.453 INFO:tasks.workunit.client.0.smithi073.stderr: -276> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 5 asok(0x55b28f546630) register_command rotate-key cmddesc rotate-key hook 0x7fff6cdd5808 EEXIST 2024-09-12T00:53:41.453 INFO:tasks.workunit.client.0.smithi073.stderr: -275> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 10 monclient: _reopen_session rank -1 2024-09-12T00:53:41.453 INFO:tasks.workunit.client.0.smithi073.stderr: -274> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:53:41.453 INFO:tasks.workunit.client.0.smithi073.stderr: -273> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 10 monclient(hunting): picked mon.noname-c con 0x55b28f838b10 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:53:41.453 INFO:tasks.workunit.client.0.smithi073.stderr: -272> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 10 monclient(hunting): picked mon.noname-a con 0x55b28f809a60 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:53:41.453 INFO:tasks.workunit.client.0.smithi073.stderr: -271> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 10 monclient(hunting): picked mon.noname-b con 0x55b28f8343b0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:53:41.453 INFO:tasks.workunit.client.0.smithi073.stderr: -270> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:41.453 INFO:tasks.workunit.client.0.smithi073.stderr: -269> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:41.453 INFO:tasks.workunit.client.0.smithi073.stderr: -268> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:41.453 INFO:tasks.workunit.client.0.smithi073.stderr: -267> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 10 monclient(hunting): _renew_subs 2024-09-12T00:53:41.453 INFO:tasks.workunit.client.0.smithi073.stderr: -266> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 10 monclient(hunting): authenticate will time out at 2281.617752s 2024-09-12T00:53:41.453 INFO:tasks.workunit.client.0.smithi073.stderr: -265> 2024-09-12T00:53:40.947+0000 7fb99cd09640 10 monclient(hunting): get_auth_request con 0x55b28f809a60 auth_method 0 2024-09-12T00:53:41.454 INFO:tasks.workunit.client.0.smithi073.stderr: -264> 2024-09-12T00:53:40.947+0000 7fb99cd09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:41.454 INFO:tasks.workunit.client.0.smithi073.stderr: -263> 2024-09-12T00:53:40.947+0000 7fb99cd09640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:41.454 INFO:tasks.workunit.client.0.smithi073.stderr: -262> 2024-09-12T00:53:40.947+0000 7fb99cd09640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:41.454 INFO:tasks.workunit.client.0.smithi073.stderr: -261> 2024-09-12T00:53:40.947+0000 7fb9a550a640 10 monclient(hunting): get_auth_request con 0x55b28f838b10 auth_method 0 2024-09-12T00:53:41.454 INFO:tasks.workunit.client.0.smithi073.stderr: -260> 2024-09-12T00:53:40.947+0000 7fb9a550a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:41.454 INFO:tasks.workunit.client.0.smithi073.stderr: -259> 2024-09-12T00:53:40.947+0000 7fb9a550a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:41.454 INFO:tasks.workunit.client.0.smithi073.stderr: -258> 2024-09-12T00:53:40.947+0000 7fb9a550a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:41.454 INFO:tasks.workunit.client.0.smithi073.stderr: -257> 2024-09-12T00:53:40.947+0000 7fb99cd09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:41.454 INFO:tasks.workunit.client.0.smithi073.stderr: -256> 2024-09-12T00:53:40.947+0000 7fb99cd09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:41.454 INFO:tasks.workunit.client.0.smithi073.stderr: -255> 2024-09-12T00:53:40.947+0000 7fb99cd09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:41.454 INFO:tasks.workunit.client.0.smithi073.stderr: -254> 2024-09-12T00:53:40.947+0000 7fb9a550a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:41.454 INFO:tasks.workunit.client.0.smithi073.stderr: -253> 2024-09-12T00:53:40.947+0000 7fb9a550a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:41.454 INFO:tasks.workunit.client.0.smithi073.stderr: -252> 2024-09-12T00:53:40.947+0000 7fb9a550a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:41.454 INFO:tasks.workunit.client.0.smithi073.stderr: -251> 2024-09-12T00:53:40.948+0000 7fb9a5d0b640 10 monclient(hunting): get_auth_request con 0x55b28f8343b0 auth_method 0 2024-09-12T00:53:41.455 INFO:tasks.workunit.client.0.smithi073.stderr: -250> 2024-09-12T00:53:40.948+0000 7fb9a5d0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:41.455 INFO:tasks.workunit.client.0.smithi073.stderr: -249> 2024-09-12T00:53:40.948+0000 7fb9a5d0b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:41.455 INFO:tasks.workunit.client.0.smithi073.stderr: -248> 2024-09-12T00:53:40.948+0000 7fb9a5d0b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:41.455 INFO:tasks.workunit.client.0.smithi073.stderr: -247> 2024-09-12T00:53:40.948+0000 7fb99cd09640 10 monclient(hunting): handle_auth_done global_id 8145 payload 274 2024-09-12T00:53:41.455 INFO:tasks.workunit.client.0.smithi073.stderr: -246> 2024-09-12T00:53:40.948+0000 7fb99cd09640 10 monclient: _finish_hunting 0 2024-09-12T00:53:41.455 INFO:tasks.workunit.client.0.smithi073.stderr: -245> 2024-09-12T00:53:40.948+0000 7fb99cd09640 1 monclient: found mon.noname-a 2024-09-12T00:53:41.455 INFO:tasks.workunit.client.0.smithi073.stderr: -244> 2024-09-12T00:53:40.948+0000 7fb99cd09640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:53:41.455 INFO:tasks.workunit.client.0.smithi073.stderr: -243> 2024-09-12T00:53:40.948+0000 7fb888ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:41.455 INFO:tasks.workunit.client.0.smithi073.stderr: -242> 2024-09-12T00:53:40.948+0000 7fb888ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:53:41.455 INFO:tasks.workunit.client.0.smithi073.stderr: -241> 2024-09-12T00:53:40.948+0000 7fb888ff9640 10 monclient: dump: 2024-09-12T00:53:41.455 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:53:41.455 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:53:41.455 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:41.456 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:41.456 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:41.456 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:53:41.456 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:53:41.456 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:53:41.456 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:53:41.456 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:41.456 INFO:tasks.workunit.client.0.smithi073.stderr: -240> 2024-09-12T00:53:40.948+0000 7fb888ff9640 10 monclient: _finish_auth 0 2024-09-12T00:53:41.456 INFO:tasks.workunit.client.0.smithi073.stderr: -239> 2024-09-12T00:53:40.948+0000 7fb888ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:53:41.456 INFO:tasks.workunit.client.0.smithi073.stderr: -238> 2024-09-12T00:53:40.948+0000 7fb888ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:53:41.456 INFO:tasks.workunit.client.0.smithi073.stderr: -237> 2024-09-12T00:53:40.948+0000 7fb888ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:41.456 INFO:tasks.workunit.client.0.smithi073.stderr: -236> 2024-09-12T00:53:40.948+0000 7fb888ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:53:41.456 INFO:tasks.workunit.client.0.smithi073.stderr: -235> 2024-09-12T00:53:40.948+0000 7fb888ff9640 10 monclient: dump: 2024-09-12T00:53:41.457 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:53:41.457 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:53:41.457 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:41.457 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:41.457 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:41.457 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:53:41.457 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:53:41.457 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:53:41.457 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:53:41.457 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:41.457 INFO:tasks.workunit.client.0.smithi073.stderr: -234> 2024-09-12T00:53:40.948+0000 7fb9a7a20800 5 monclient: authenticate success, global_id 8145 2024-09-12T00:53:41.457 INFO:tasks.workunit.client.0.smithi073.stderr: -233> 2024-09-12T00:53:40.948+0000 7fb9a7a20800 10 monclient: get_monmap_and_config success 2024-09-12T00:53:41.457 INFO:tasks.workunit.client.0.smithi073.stderr: -232> 2024-09-12T00:53:40.948+0000 7fb9a7a20800 4 set_mon_vals no callback set 2024-09-12T00:53:41.457 INFO:tasks.workunit.client.0.smithi073.stderr: -231> 2024-09-12T00:53:40.948+0000 7fb9a7a20800 10 monclient: shutdown 2024-09-12T00:53:41.458 INFO:tasks.workunit.client.0.smithi073.stderr: -230> 2024-09-12T00:53:40.948+0000 7fb9a7a20800 10 monclient: build_initial_monmap 2024-09-12T00:53:41.458 INFO:tasks.workunit.client.0.smithi073.stderr: -229> 2024-09-12T00:53:40.948+0000 7fb9a7a20800 1 build_initial for_mkfs: 0 2024-09-12T00:53:41.458 INFO:tasks.workunit.client.0.smithi073.stderr: -228> 2024-09-12T00:53:40.948+0000 7fb9a7a20800 10 monclient: monmap: 2024-09-12T00:53:41.458 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:53:41.458 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:53:41.458 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:53:41.458 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:53:41.458 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:53:41.458 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:53:41.458 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:53:41.458 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:53:41.458 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:53:41.458 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:41.459 INFO:tasks.workunit.client.0.smithi073.stderr: -227> 2024-09-12T00:53:40.948+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f82acb0) adding auth protocol: cephx 2024-09-12T00:53:41.459 INFO:tasks.workunit.client.0.smithi073.stderr: -226> 2024-09-12T00:53:40.948+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f82acb0) adding auth protocol: cephx 2024-09-12T00:53:41.459 INFO:tasks.workunit.client.0.smithi073.stderr: -225> 2024-09-12T00:53:40.948+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f82acb0) adding auth protocol: cephx 2024-09-12T00:53:41.459 INFO:tasks.workunit.client.0.smithi073.stderr: -224> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f82acb0) adding con mode: secure 2024-09-12T00:53:41.459 INFO:tasks.workunit.client.0.smithi073.stderr: -223> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f82acb0) adding con mode: crc 2024-09-12T00:53:41.459 INFO:tasks.workunit.client.0.smithi073.stderr: -222> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f82acb0) adding con mode: secure 2024-09-12T00:53:41.459 INFO:tasks.workunit.client.0.smithi073.stderr: -221> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f82acb0) adding con mode: crc 2024-09-12T00:53:41.459 INFO:tasks.workunit.client.0.smithi073.stderr: -220> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f82acb0) adding con mode: secure 2024-09-12T00:53:41.459 INFO:tasks.workunit.client.0.smithi073.stderr: -219> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f82acb0) adding con mode: crc 2024-09-12T00:53:41.459 INFO:tasks.workunit.client.0.smithi073.stderr: -218> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f82acb0) adding con mode: crc 2024-09-12T00:53:41.459 INFO:tasks.workunit.client.0.smithi073.stderr: -217> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f82acb0) adding con mode: secure 2024-09-12T00:53:41.459 INFO:tasks.workunit.client.0.smithi073.stderr: -216> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f82acb0) adding con mode: crc 2024-09-12T00:53:41.459 INFO:tasks.workunit.client.0.smithi073.stderr: -215> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f82acb0) adding con mode: secure 2024-09-12T00:53:41.460 INFO:tasks.workunit.client.0.smithi073.stderr: -214> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f82acb0) adding con mode: crc 2024-09-12T00:53:41.460 INFO:tasks.workunit.client.0.smithi073.stderr: -213> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f82acb0) adding con mode: secure 2024-09-12T00:53:41.460 INFO:tasks.workunit.client.0.smithi073.stderr: -212> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:41.460 INFO:tasks.workunit.client.0.smithi073.stderr: -211> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 1 librados: starting msgr at 2024-09-12T00:53:41.460 INFO:tasks.workunit.client.0.smithi073.stderr: -210> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 1 librados: starting objecter 2024-09-12T00:53:41.460 INFO:tasks.workunit.client.0.smithi073.stderr: -209> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 asok(0x55b28f546630) register_command objecter_requests cmddesc objecter_requests hook 0x55b28f8087f0 EEXIST 2024-09-12T00:53:41.460 INFO:tasks.workunit.client.0.smithi073.stderr: -208> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 1 librados: setting wanted keys 2024-09-12T00:53:41.460 INFO:tasks.workunit.client.0.smithi073.stderr: -207> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 1 librados: calling monclient init 2024-09-12T00:53:41.460 INFO:tasks.workunit.client.0.smithi073.stderr: -206> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 10 monclient: init 2024-09-12T00:53:41.460 INFO:tasks.workunit.client.0.smithi073.stderr: -205> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7fc440) adding auth protocol: cephx 2024-09-12T00:53:41.460 INFO:tasks.workunit.client.0.smithi073.stderr: -204> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7fc440) adding auth protocol: cephx 2024-09-12T00:53:41.460 INFO:tasks.workunit.client.0.smithi073.stderr: -203> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7fc440) adding auth protocol: cephx 2024-09-12T00:53:41.460 INFO:tasks.workunit.client.0.smithi073.stderr: -202> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7fc440) adding con mode: secure 2024-09-12T00:53:41.461 INFO:tasks.workunit.client.0.smithi073.stderr: -201> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7fc440) adding con mode: crc 2024-09-12T00:53:41.461 INFO:tasks.workunit.client.0.smithi073.stderr: -200> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7fc440) adding con mode: secure 2024-09-12T00:53:41.461 INFO:tasks.workunit.client.0.smithi073.stderr: -199> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7fc440) adding con mode: crc 2024-09-12T00:53:41.461 INFO:tasks.workunit.client.0.smithi073.stderr: -198> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7fc440) adding con mode: secure 2024-09-12T00:53:41.461 INFO:tasks.workunit.client.0.smithi073.stderr: -197> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7fc440) adding con mode: crc 2024-09-12T00:53:41.461 INFO:tasks.workunit.client.0.smithi073.stderr: -196> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7fc440) adding con mode: crc 2024-09-12T00:53:41.461 INFO:tasks.workunit.client.0.smithi073.stderr: -195> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7fc440) adding con mode: secure 2024-09-12T00:53:41.461 INFO:tasks.workunit.client.0.smithi073.stderr: -194> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7fc440) adding con mode: crc 2024-09-12T00:53:41.461 INFO:tasks.workunit.client.0.smithi073.stderr: -193> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7fc440) adding con mode: secure 2024-09-12T00:53:41.461 INFO:tasks.workunit.client.0.smithi073.stderr: -192> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7fc440) adding con mode: crc 2024-09-12T00:53:41.461 INFO:tasks.workunit.client.0.smithi073.stderr: -191> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7fc440) adding con mode: secure 2024-09-12T00:53:41.461 INFO:tasks.workunit.client.0.smithi073.stderr: -190> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:41.461 INFO:tasks.workunit.client.0.smithi073.stderr: -189> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:41.462 INFO:tasks.workunit.client.0.smithi073.stderr: -188> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 asok(0x55b28f546630) register_command rotate-key cmddesc rotate-key hook 0x55b28f7fc588 EEXIST 2024-09-12T00:53:41.462 INFO:tasks.workunit.client.0.smithi073.stderr: -187> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 10 monclient: _reopen_session rank -1 2024-09-12T00:53:41.462 INFO:tasks.workunit.client.0.smithi073.stderr: -186> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:53:41.462 INFO:tasks.workunit.client.0.smithi073.stderr: -185> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 10 monclient(hunting): picked mon.noname-a con 0x55b28f809a60 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:53:41.462 INFO:tasks.workunit.client.0.smithi073.stderr: -184> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 10 monclient(hunting): picked mon.noname-b con 0x55b28f8343b0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:53:41.462 INFO:tasks.workunit.client.0.smithi073.stderr: -183> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 10 monclient(hunting): picked mon.noname-c con 0x55b28f838b10 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:53:41.462 INFO:tasks.workunit.client.0.smithi073.stderr: -182> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:41.462 INFO:tasks.workunit.client.0.smithi073.stderr: -181> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:41.462 INFO:tasks.workunit.client.0.smithi073.stderr: -180> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:41.462 INFO:tasks.workunit.client.0.smithi073.stderr: -179> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 10 monclient(hunting): _renew_subs 2024-09-12T00:53:41.463 INFO:tasks.workunit.client.0.smithi073.stderr: -178> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 10 monclient(hunting): authenticate will time out at 2281.619954s 2024-09-12T00:53:41.463 INFO:tasks.workunit.client.0.smithi073.stderr: -177> 2024-09-12T00:53:40.950+0000 7fb9a550a640 10 monclient(hunting): get_auth_request con 0x55b28f809a60 auth_method 0 2024-09-12T00:53:41.463 INFO:tasks.workunit.client.0.smithi073.stderr: -176> 2024-09-12T00:53:40.950+0000 7fb9a550a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:41.463 INFO:tasks.workunit.client.0.smithi073.stderr: -175> 2024-09-12T00:53:40.950+0000 7fb9a550a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:41.463 INFO:tasks.workunit.client.0.smithi073.stderr: -174> 2024-09-12T00:53:40.950+0000 7fb9a550a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:41.463 INFO:tasks.workunit.client.0.smithi073.stderr: -173> 2024-09-12T00:53:40.950+0000 7fb9a5d0b640 10 monclient(hunting): get_auth_request con 0x55b28f838b10 auth_method 0 2024-09-12T00:53:41.463 INFO:tasks.workunit.client.0.smithi073.stderr: -172> 2024-09-12T00:53:40.950+0000 7fb9a5d0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:41.463 INFO:tasks.workunit.client.0.smithi073.stderr: -171> 2024-09-12T00:53:40.950+0000 7fb9a5d0b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:41.463 INFO:tasks.workunit.client.0.smithi073.stderr: -170> 2024-09-12T00:53:40.950+0000 7fb9a5d0b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:41.464 INFO:tasks.workunit.client.0.smithi073.stderr: -169> 2024-09-12T00:53:40.950+0000 7fb9a550a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:41.464 INFO:tasks.workunit.client.0.smithi073.stderr: -168> 2024-09-12T00:53:40.950+0000 7fb9a550a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:41.464 INFO:tasks.workunit.client.0.smithi073.stderr: -167> 2024-09-12T00:53:40.950+0000 7fb9a550a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:41.464 INFO:tasks.workunit.client.0.smithi073.stderr: -166> 2024-09-12T00:53:40.950+0000 7fb9a5d0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:41.464 INFO:tasks.workunit.client.0.smithi073.stderr: -165> 2024-09-12T00:53:40.950+0000 7fb9a5d0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:41.464 INFO:tasks.workunit.client.0.smithi073.stderr: -164> 2024-09-12T00:53:40.950+0000 7fb9a5d0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:41.464 INFO:tasks.workunit.client.0.smithi073.stderr: -163> 2024-09-12T00:53:40.950+0000 7fb99cd09640 10 monclient(hunting): get_auth_request con 0x55b28f8343b0 auth_method 0 2024-09-12T00:53:41.464 INFO:tasks.workunit.client.0.smithi073.stderr: -162> 2024-09-12T00:53:40.950+0000 7fb99cd09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:41.464 INFO:tasks.workunit.client.0.smithi073.stderr: -161> 2024-09-12T00:53:40.950+0000 7fb99cd09640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:41.464 INFO:tasks.workunit.client.0.smithi073.stderr: -160> 2024-09-12T00:53:40.950+0000 7fb99cd09640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:41.464 INFO:tasks.workunit.client.0.smithi073.stderr: -159> 2024-09-12T00:53:40.950+0000 7fb99cd09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:41.464 INFO:tasks.workunit.client.0.smithi073.stderr: -158> 2024-09-12T00:53:40.950+0000 7fb99cd09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:41.465 INFO:tasks.workunit.client.0.smithi073.stderr: -157> 2024-09-12T00:53:40.950+0000 7fb99cd09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:41.465 INFO:tasks.workunit.client.0.smithi073.stderr: -156> 2024-09-12T00:53:40.950+0000 7fb9a5d0b640 10 monclient(hunting): handle_auth_done global_id 7640 payload 824 2024-09-12T00:53:41.465 INFO:tasks.workunit.client.0.smithi073.stderr: -155> 2024-09-12T00:53:40.950+0000 7fb9a5d0b640 10 monclient: _finish_hunting 0 2024-09-12T00:53:41.465 INFO:tasks.workunit.client.0.smithi073.stderr: -154> 2024-09-12T00:53:40.950+0000 7fb9a5d0b640 1 monclient: found mon.noname-c 2024-09-12T00:53:41.465 INFO:tasks.workunit.client.0.smithi073.stderr: -153> 2024-09-12T00:53:40.950+0000 7fb9a5d0b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.73:3301/0 2024-09-12T00:53:41.465 INFO:tasks.workunit.client.0.smithi073.stderr: -152> 2024-09-12T00:53:40.950+0000 7fb876ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:41.465 INFO:tasks.workunit.client.0.smithi073.stderr: -151> 2024-09-12T00:53:40.950+0000 7fb876ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:53:41.465 INFO:tasks.workunit.client.0.smithi073.stderr: -150> 2024-09-12T00:53:40.950+0000 7fb876ffd640 10 monclient: dump: 2024-09-12T00:53:41.465 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:53:41.465 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:53:41.465 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:41.465 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:41.466 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:41.466 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:53:41.466 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:53:41.466 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:53:41.466 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:53:41.466 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:41.466 INFO:tasks.workunit.client.0.smithi073.stderr: -149> 2024-09-12T00:53:40.950+0000 7fb876ffd640 10 monclient: _finish_auth 0 2024-09-12T00:53:41.466 INFO:tasks.workunit.client.0.smithi073.stderr: -148> 2024-09-12T00:53:40.950+0000 7fb876ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:53:41.466 INFO:tasks.workunit.client.0.smithi073.stderr: -147> 2024-09-12T00:53:40.950+0000 7fb876ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:53:41.466 INFO:tasks.workunit.client.0.smithi073.stderr: -146> 2024-09-12T00:53:40.950+0000 7fb876ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:41.466 INFO:tasks.workunit.client.0.smithi073.stderr: -145> 2024-09-12T00:53:40.950+0000 7fb876ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:53:41.466 INFO:tasks.workunit.client.0.smithi073.stderr: -144> 2024-09-12T00:53:40.950+0000 7fb876ffd640 10 monclient: dump: 2024-09-12T00:53:41.466 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:53:41.467 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:53:41.467 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:41.467 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:41.467 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:41.467 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:53:41.467 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:53:41.467 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:53:41.467 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:53:41.467 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:41.467 INFO:tasks.workunit.client.0.smithi073.stderr: -143> 2024-09-12T00:53:40.950+0000 7fb9a7a20800 5 monclient: authenticate success, global_id 7640 2024-09-12T00:53:41.467 INFO:tasks.workunit.client.0.smithi073.stderr: -142> 2024-09-12T00:53:40.950+0000 7fb9a7a20800 10 monclient: _renew_subs 2024-09-12T00:53:41.467 INFO:tasks.workunit.client.0.smithi073.stderr: -141> 2024-09-12T00:53:40.950+0000 7fb888ff9640 4 set_mon_vals no callback set 2024-09-12T00:53:41.467 INFO:tasks.workunit.client.0.smithi073.stderr: -140> 2024-09-12T00:53:40.950+0000 7fb9a7a20800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:53:41.467 INFO:tasks.workunit.client.0.smithi073.stderr: -139> 2024-09-12T00:53:40.950+0000 7fb9a7a20800 10 monclient: _renew_subs 2024-09-12T00:53:41.468 INFO:tasks.workunit.client.0.smithi073.stderr: -138> 2024-09-12T00:53:40.950+0000 7fb9a7a20800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:53:41.468 INFO:tasks.workunit.client.0.smithi073.stderr: -137> 2024-09-12T00:53:40.950+0000 7fb9a7a20800 1 librados: init done 2024-09-12T00:53:41.468 INFO:tasks.workunit.client.0.smithi073.stderr: -136> 2024-09-12T00:53:40.950+0000 7fb9a7a20800 5 asok(0x55b28f546630) register_command cr dump hook 0x55b28f830c18 2024-09-12T00:53:41.468 INFO:tasks.workunit.client.0.smithi073.stderr: -135> 2024-09-12T00:53:40.952+0000 7fb9a7a20800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.468 INFO:tasks.workunit.client.0.smithi073.stderr: -134> 2024-09-12T00:53:40.953+0000 7fb876ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:53:41.468 INFO:tasks.workunit.client.0.smithi073.stderr: -133> 2024-09-12T00:53:40.953+0000 7fb876ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:53:41.468 INFO:tasks.workunit.client.0.smithi073.stderr: -132> 2024-09-12T00:53:40.953+0000 7fb876ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:53:41.468 INFO:tasks.workunit.client.0.smithi073.stderr: -131> 2024-09-12T00:53:40.953+0000 7fb9a550a640 10 monclient: get_auth_request con 0x7fb870076470 auth_method 0 2024-09-12T00:53:41.468 INFO:tasks.workunit.client.0.smithi073.stderr: -130> 2024-09-12T00:53:40.953+0000 7fb99cd09640 10 monclient: get_auth_request con 0x55b28f853370 auth_method 0 2024-09-12T00:53:41.468 INFO:tasks.workunit.client.0.smithi073.stderr: -129> 2024-09-12T00:53:40.954+0000 7fb9a7a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:41.468 INFO:tasks.workunit.client.0.smithi073.stderr: -128> 2024-09-12T00:53:40.954+0000 7fb9a7a20800 20 realm 2024-09-12T00:53:41.468 INFO:tasks.workunit.client.0.smithi073.stderr: -127> 2024-09-12T00:53:40.954+0000 7fb9a7a20800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.468 INFO:tasks.workunit.client.0.smithi073.stderr: -126> 2024-09-12T00:53:40.954+0000 7fb9a7a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:41.469 INFO:tasks.workunit.client.0.smithi073.stderr: -125> 2024-09-12T00:53:40.954+0000 7fb9a7a20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:41.469 INFO:tasks.workunit.client.0.smithi073.stderr: -124> 2024-09-12T00:53:40.954+0000 7fb9a7a20800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.469 INFO:tasks.workunit.client.0.smithi073.stderr: -123> 2024-09-12T00:53:40.954+0000 7fb9a7a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:41.469 INFO:tasks.workunit.client.0.smithi073.stderr: -122> 2024-09-12T00:53:40.954+0000 7fb9a7a20800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.469 INFO:tasks.workunit.client.0.smithi073.stderr: -121> 2024-09-12T00:53:40.955+0000 7fb9a550a640 10 monclient: get_auth_request con 0x55b28f857720 auth_method 0 2024-09-12T00:53:41.469 INFO:tasks.workunit.client.0.smithi073.stderr: -120> 2024-09-12T00:53:40.955+0000 7fb9a7a20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:41.469 INFO:tasks.workunit.client.0.smithi073.stderr: -119> 2024-09-12T00:53:40.955+0000 7fb9a7a20800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.469 INFO:tasks.workunit.client.0.smithi073.stderr: -118> 2024-09-12T00:53:40.955+0000 7fb99cd09640 10 monclient: get_auth_request con 0x55b28f85ae90 auth_method 0 2024-09-12T00:53:41.470 INFO:tasks.workunit.client.0.smithi073.stderr: -117> 2024-09-12T00:53:40.956+0000 7fb9a7a20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:41.470 INFO:tasks.workunit.client.0.smithi073.stderr: -116> 2024-09-12T00:53:40.956+0000 7fb9a7a20800 20 searching for the correct realm 2024-09-12T00:53:41.470 INFO:tasks.workunit.client.0.smithi073.stderr: -115> 2024-09-12T00:53:40.956+0000 7fb9a5d0b640 10 monclient: get_auth_request con 0x55b28f85fb90 auth_method 0 2024-09-12T00:53:41.470 INFO:tasks.workunit.client.0.smithi073.stderr: -114> 2024-09-12T00:53:40.957+0000 7fb9a550a640 10 monclient: get_auth_request con 0x7fb9a008e1d0 auth_method 0 2024-09-12T00:53:41.470 INFO:tasks.workunit.client.0.smithi073.stderr: -113> 2024-09-12T00:53:40.958+0000 7fb99cd09640 10 monclient: get_auth_request con 0x7fb998017070 auth_method 0 2024-09-12T00:53:41.470 INFO:tasks.workunit.client.0.smithi073.stderr: -112> 2024-09-12T00:53:40.958+0000 7fb99cd09640 0 -- 172.21.15.73:0/825711095 >> [v2:172.21.15.73:6826/269690776,v1:172.21.15.73:6827/269690776] conn(0x7fb998017070 msgr2=0x7fb99804d3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:41.470 INFO:tasks.workunit.client.0.smithi073.stderr: -111> 2024-09-12T00:53:41.160+0000 7fb99cd09640 10 monclient: get_auth_request con 0x7fb998017070 auth_method 0 2024-09-12T00:53:41.470 INFO:tasks.workunit.client.0.smithi073.stderr: -110> 2024-09-12T00:53:41.160+0000 7fb9a5d0b640 10 monclient: get_auth_request con 0x7fb990073030 auth_method 0 2024-09-12T00:53:41.470 INFO:tasks.workunit.client.0.smithi073.stderr: -109> 2024-09-12T00:53:41.164+0000 7fb9a550a640 0 -- 172.21.15.73:0/825711095 >> [v2:172.21.15.73:6810/1807760270,v1:172.21.15.73:6811/1807760270] conn(0x7fb9a0048fa0 msgr2=0x7fb9a0063630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:41.470 INFO:tasks.workunit.client.0.smithi073.stderr: -108> 2024-09-12T00:53:41.366+0000 7fb9a550a640 10 monclient: get_auth_request con 0x7fb9a0048fa0 auth_method 0 2024-09-12T00:53:41.470 INFO:tasks.workunit.client.0.smithi073.stderr: -107> 2024-09-12T00:53:41.372+0000 7fb9a7a20800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:53:41.470 INFO:tasks.workunit.client.0.smithi073.stderr: -106> 2024-09-12T00:53:41.372+0000 7fb9a7a20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:41.471 INFO:tasks.workunit.client.0.smithi073.stderr: -105> 2024-09-12T00:53:41.372+0000 7fb9a7a20800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:53:41.471 INFO:tasks.workunit.client.0.smithi073.stderr: -104> 2024-09-12T00:53:41.372+0000 7fb9a7a20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:41.471 INFO:tasks.workunit.client.0.smithi073.stderr: -103> 2024-09-12T00:53:41.372+0000 7fb9a7a20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:41.471 INFO:tasks.workunit.client.0.smithi073.stderr: -102> 2024-09-12T00:53:41.372+0000 7fb9a7a20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:41.471 INFO:tasks.workunit.client.0.smithi073.stderr: -101> 2024-09-12T00:53:41.372+0000 7fb9a7a20800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.471 INFO:tasks.workunit.client.0.smithi073.stderr: -100> 2024-09-12T00:53:41.372+0000 7fb9a7a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:41.471 INFO:tasks.workunit.client.0.smithi073.stderr: -99> 2024-09-12T00:53:41.372+0000 7fb9a7a20800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.471 INFO:tasks.workunit.client.0.smithi073.stderr: -98> 2024-09-12T00:53:41.372+0000 7fb9a7a20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:41.471 INFO:tasks.workunit.client.0.smithi073.stderr: -97> 2024-09-12T00:53:41.372+0000 7fb9a7a20800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.471 INFO:tasks.workunit.client.0.smithi073.stderr: -96> 2024-09-12T00:53:41.372+0000 7fb9a7a20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:41.471 INFO:tasks.workunit.client.0.smithi073.stderr: -95> 2024-09-12T00:53:41.372+0000 7fb9a7a20800 20 zone default found 2024-09-12T00:53:41.472 INFO:tasks.workunit.client.0.smithi073.stderr: -94> 2024-09-12T00:53:41.373+0000 7fb9a7a20800 4 Realm: () 2024-09-12T00:53:41.472 INFO:tasks.workunit.client.0.smithi073.stderr: -93> 2024-09-12T00:53:41.373+0000 7fb9a7a20800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:53:41.472 INFO:tasks.workunit.client.0.smithi073.stderr: -92> 2024-09-12T00:53:41.373+0000 7fb9a7a20800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:53:41.472 INFO:tasks.workunit.client.0.smithi073.stderr: -91> 2024-09-12T00:53:41.373+0000 7fb9a7a20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:41.472 INFO:tasks.workunit.client.0.smithi073.stderr: -90> 2024-09-12T00:53:41.373+0000 7fb9a7a20800 20 zonegroup default 2024-09-12T00:53:41.472 INFO:tasks.workunit.client.0.smithi073.stderr: -89> 2024-09-12T00:53:41.373+0000 7fb9a7a20800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.472 INFO:tasks.workunit.client.0.smithi073.stderr: -88> 2024-09-12T00:53:41.373+0000 7fb9a7a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:41.472 INFO:tasks.workunit.client.0.smithi073.stderr: -87> 2024-09-12T00:53:41.373+0000 7fb9a7a20800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.472 INFO:tasks.workunit.client.0.smithi073.stderr: -86> 2024-09-12T00:53:41.373+0000 7fb9a7a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:41.473 INFO:tasks.workunit.client.0.smithi073.stderr: -85> 2024-09-12T00:53:41.373+0000 7fb9a7a20800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.473 INFO:tasks.workunit.client.0.smithi073.stderr: -84> 2024-09-12T00:53:41.373+0000 7fb9a7a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:41.473 INFO:tasks.workunit.client.0.smithi073.stderr: -83> 2024-09-12T00:53:41.373+0000 7fb9a7a20800 20 started sync module instance, tier type = 2024-09-12T00:53:41.473 INFO:tasks.workunit.client.0.smithi073.stderr: -82> 2024-09-12T00:53:41.373+0000 7fb9a7a20800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:53:41.473 INFO:tasks.workunit.client.0.smithi073.stderr: -81> 2024-09-12T00:53:41.384+0000 7fb9a7a20800 20 add_watcher() i=0 2024-09-12T00:53:41.473 INFO:tasks.workunit.client.0.smithi073.stderr: -80> 2024-09-12T00:53:41.384+0000 7fb9a7a20800 20 add_watcher() i=1 2024-09-12T00:53:41.473 INFO:tasks.workunit.client.0.smithi073.stderr: -79> 2024-09-12T00:53:41.384+0000 7fb9a7a20800 20 add_watcher() i=2 2024-09-12T00:53:41.473 INFO:tasks.workunit.client.0.smithi073.stderr: -78> 2024-09-12T00:53:41.384+0000 7fb9a7a20800 20 add_watcher() i=3 2024-09-12T00:53:41.473 INFO:tasks.workunit.client.0.smithi073.stderr: -77> 2024-09-12T00:53:41.384+0000 7fb9a7a20800 20 add_watcher() i=4 2024-09-12T00:53:41.473 INFO:tasks.workunit.client.0.smithi073.stderr: -76> 2024-09-12T00:53:41.384+0000 7fb9a7a20800 20 add_watcher() i=5 2024-09-12T00:53:41.473 INFO:tasks.workunit.client.0.smithi073.stderr: -75> 2024-09-12T00:53:41.384+0000 7fb9a7a20800 20 add_watcher() i=6 2024-09-12T00:53:41.473 INFO:tasks.workunit.client.0.smithi073.stderr: -74> 2024-09-12T00:53:41.386+0000 7fb9a7a20800 20 add_watcher() i=7 2024-09-12T00:53:41.473 INFO:tasks.workunit.client.0.smithi073.stderr: -73> 2024-09-12T00:53:41.386+0000 7fb9a7a20800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:41.474 INFO:tasks.workunit.client.0.smithi073.stderr: -72> 2024-09-12T00:53:41.387+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd5ba0) adding auth protocol: cephx 2024-09-12T00:53:41.474 INFO:tasks.workunit.client.0.smithi073.stderr: -71> 2024-09-12T00:53:41.387+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd5ba0) adding auth protocol: cephx 2024-09-12T00:53:41.474 INFO:tasks.workunit.client.0.smithi073.stderr: -70> 2024-09-12T00:53:41.387+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd5ba0) adding auth protocol: cephx 2024-09-12T00:53:41.474 INFO:tasks.workunit.client.0.smithi073.stderr: -69> 2024-09-12T00:53:41.387+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd5ba0) adding con mode: secure 2024-09-12T00:53:41.474 INFO:tasks.workunit.client.0.smithi073.stderr: -68> 2024-09-12T00:53:41.387+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd5ba0) adding con mode: crc 2024-09-12T00:53:41.474 INFO:tasks.workunit.client.0.smithi073.stderr: -67> 2024-09-12T00:53:41.387+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd5ba0) adding con mode: secure 2024-09-12T00:53:41.474 INFO:tasks.workunit.client.0.smithi073.stderr: -66> 2024-09-12T00:53:41.387+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd5ba0) adding con mode: crc 2024-09-12T00:53:41.474 INFO:tasks.workunit.client.0.smithi073.stderr: -65> 2024-09-12T00:53:41.387+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd5ba0) adding con mode: secure 2024-09-12T00:53:41.474 INFO:tasks.workunit.client.0.smithi073.stderr: -64> 2024-09-12T00:53:41.387+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd5ba0) adding con mode: crc 2024-09-12T00:53:41.474 INFO:tasks.workunit.client.0.smithi073.stderr: -63> 2024-09-12T00:53:41.387+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd5ba0) adding con mode: crc 2024-09-12T00:53:41.474 INFO:tasks.workunit.client.0.smithi073.stderr: -62> 2024-09-12T00:53:41.387+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd5ba0) adding con mode: secure 2024-09-12T00:53:41.475 INFO:tasks.workunit.client.0.smithi073.stderr: -61> 2024-09-12T00:53:41.387+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd5ba0) adding con mode: crc 2024-09-12T00:53:41.475 INFO:tasks.workunit.client.0.smithi073.stderr: -60> 2024-09-12T00:53:41.387+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd5ba0) adding con mode: secure 2024-09-12T00:53:41.475 INFO:tasks.workunit.client.0.smithi073.stderr: -59> 2024-09-12T00:53:41.387+0000 7fb85b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:41.475 INFO:tasks.workunit.client.0.smithi073.stderr: -58> 2024-09-12T00:53:41.387+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd5ba0) adding con mode: crc 2024-09-12T00:53:41.475 INFO:tasks.workunit.client.0.smithi073.stderr: -57> 2024-09-12T00:53:41.387+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd5ba0) adding con mode: secure 2024-09-12T00:53:41.475 INFO:tasks.workunit.client.0.smithi073.stderr: -56> 2024-09-12T00:53:41.388+0000 7fb9a7a20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:41.475 INFO:tasks.workunit.client.0.smithi073.stderr: -55> 2024-09-12T00:53:41.388+0000 7fb9a7a20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:41.475 INFO:tasks.workunit.client.0.smithi073.stderr: -54> 2024-09-12T00:53:41.388+0000 7fb9a7a20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:41.475 INFO:tasks.workunit.client.0.smithi073.stderr: -53> 2024-09-12T00:53:41.388+0000 7fb9a7a20800 5 asok(0x55b28f546630) register_command cache list hook 0x55b28f831100 2024-09-12T00:53:41.475 INFO:tasks.workunit.client.0.smithi073.stderr: -52> 2024-09-12T00:53:41.388+0000 7fb9a7a20800 5 asok(0x55b28f546630) register_command cache inspect hook 0x55b28f831100 2024-09-12T00:53:41.475 INFO:tasks.workunit.client.0.smithi073.stderr: -51> 2024-09-12T00:53:41.388+0000 7fb9a7a20800 5 asok(0x55b28f546630) register_command cache erase hook 0x55b28f831100 2024-09-12T00:53:41.475 INFO:tasks.workunit.client.0.smithi073.stderr: -50> 2024-09-12T00:53:41.388+0000 7fb9a7a20800 5 asok(0x55b28f546630) register_command cache zap hook 0x55b28f831100 2024-09-12T00:53:41.476 INFO:tasks.workunit.client.0.smithi073.stderr: -49> 2024-09-12T00:53:41.388+0000 7fb9a7a20800 5 note: GC not initialized 2024-09-12T00:53:41.476 INFO:tasks.workunit.client.0.smithi073.stderr: -48> 2024-09-12T00:53:41.388+0000 7fb85a7e4640 20 reqs_thread_entry: start 2024-09-12T00:53:41.476 INFO:tasks.workunit.client.0.smithi073.stderr: -47> 2024-09-12T00:53:41.388+0000 7fb9a7a20800 5 asok(0x55b28f546630) register_command sync trace show hook 0x7fb998004e30 2024-09-12T00:53:41.476 INFO:tasks.workunit.client.0.smithi073.stderr: -46> 2024-09-12T00:53:41.388+0000 7fb9a7a20800 5 asok(0x55b28f546630) register_command sync trace history hook 0x7fb998004e30 2024-09-12T00:53:41.476 INFO:tasks.workunit.client.0.smithi073.stderr: -45> 2024-09-12T00:53:41.388+0000 7fb9a7a20800 5 asok(0x55b28f546630) register_command sync trace active hook 0x7fb998004e30 2024-09-12T00:53:41.476 INFO:tasks.workunit.client.0.smithi073.stderr: -44> 2024-09-12T00:53:41.388+0000 7fb9a7a20800 5 asok(0x55b28f546630) register_command sync trace active_short hook 0x7fb998004e30 2024-09-12T00:53:41.476 INFO:tasks.workunit.client.0.smithi073.stderr: -43> 2024-09-12T00:53:41.388+0000 7fb9a7a20800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:41.476 INFO:tasks.workunit.client.0.smithi073.stderr: -42> 2024-09-12T00:53:41.388+0000 7fb9a7a20800 20 Filter name: none 2024-09-12T00:53:41.476 INFO:tasks.workunit.client.0.smithi073.stderr: -41> 2024-09-12T00:53:41.388+0000 7fb7cbfff640 20 reqs_thread_entry: start 2024-09-12T00:53:41.476 INFO:tasks.workunit.client.0.smithi073.stderr: -40> 2024-09-12T00:53:41.388+0000 7fb9a7a20800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:53:41.476 INFO:tasks.workunit.client.0.smithi073.stderr: -39> 2024-09-12T00:53:41.388+0000 7fb9a7a20800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.476 INFO:tasks.workunit.client.0.smithi073.stderr: -38> 2024-09-12T00:53:41.389+0000 7fb9a7a20800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:53:41.477 INFO:tasks.workunit.client.0.smithi073.stderr: -37> 2024-09-12T00:53:41.389+0000 7fb9a7a20800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:53:41.477 INFO:tasks.workunit.client.0.smithi073.stderr: -36> 2024-09-12T00:53:41.389+0000 7fb9a7a20800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:53:41.477 INFO:tasks.workunit.client.0.smithi073.stderr: -35> 2024-09-12T00:53:41.389+0000 7fb9a7a20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 : miss 2024-09-12T00:53:41.477 INFO:tasks.workunit.client.0.smithi073.stderr: -34> 2024-09-12T00:53:41.389+0000 7fb9a7a20800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.477 INFO:tasks.workunit.client.0.smithi073.stderr: -33> 2024-09-12T00:53:41.389+0000 7fb9a7a20800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:53:41.477 INFO:tasks.workunit.client.0.smithi073.stderr: -32> 2024-09-12T00:53:41.389+0000 7fb9a7a20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:53:41.477 INFO:tasks.workunit.client.0.smithi073.stderr: -31> 2024-09-12T00:53:41.389+0000 7fb9a7a20800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:53:41.477 INFO:tasks.workunit.client.0.smithi073.stderr: -30> 2024-09-12T00:53:41.389+0000 7fb9a7a20800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:53:41.477 INFO:tasks.workunit.client.0.smithi073.stderr: -29> 2024-09-12T00:53:41.389+0000 7fb9a7a20800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:53:41.477 INFO:tasks.workunit.client.0.smithi073.stderr: -28> 2024-09-12T00:53:41.389+0000 7fb9a7a20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 2024-09-12T00:53:41.477 INFO:tasks.workunit.client.0.smithi073.stderr: -27> 2024-09-12T00:53:41.393+0000 7fb9a7a20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:53:41.477 INFO:tasks.workunit.client.0.smithi073.stderr: -26> 2024-09-12T00:53:41.393+0000 7fb9a7a20800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:53:41.478 INFO:tasks.workunit.client.0.smithi073.stderr: -25> 2024-09-12T00:53:41.393+0000 7fb9a7a20800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:53:41.478 INFO:tasks.workunit.client.0.smithi073.stderr: -24> 2024-09-12T00:53:41.393+0000 7fb9a7a20800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17, ofs0, ns] 2024-09-12T00:53:41.478 INFO:tasks.workunit.client.0.smithi073.stderr: -23> 2024-09-12T00:53:41.394+0000 7fb888ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497044 cookie 94225400489776 notifier 7640 bl.length()=827 2024-09-12T00:53:41.478 INFO:tasks.workunit.client.0.smithi073.stderr: -22> 2024-09-12T00:53:41.394+0000 7fb888ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:53:41.478 INFO:tasks.workunit.client.0.smithi073.stderr: -21> 2024-09-12T00:53:41.394+0000 7fb888ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:53:41.478 INFO:tasks.workunit.client.0.smithi073.stderr: -20> 2024-09-12T00:53:41.394+0000 7fb888ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:53:41.478 INFO:tasks.workunit.client.0.smithi073.stderr: -19> 2024-09-12T00:53:41.395+0000 7fb9a7a20800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): orig_sources= new_sources= 2024-09-12T00:53:41.478 INFO:tasks.workunit.client.0.smithi073.stderr: -18> 2024-09-12T00:53:41.395+0000 7fb9a7a20800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): potential sources added=[] removed=[] 2024-09-12T00:53:41.478 INFO:tasks.workunit.client.0.smithi073.stderr: -17> 2024-09-12T00:53:41.395+0000 7fb9a7a20800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): orig_dests= new_dests= 2024-09-12T00:53:41.478 INFO:tasks.workunit.client.0.smithi073.stderr: -16> 2024-09-12T00:53:41.395+0000 7fb9a7a20800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): potential dests added=[] removed=[] 2024-09-12T00:53:41.478 INFO:tasks.workunit.client.0.smithi073.stderr: -15> 2024-09-12T00:53:41.398+0000 7fb9a7a20800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.3.0 2024-09-12T00:53:41.478 INFO:tasks.workunit.client.0.smithi073.stderr: -14> 2024-09-12T00:53:41.398+0000 7fb9a7a20800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.3.0 2024-09-12T00:53:41.479 INFO:tasks.workunit.client.0.smithi073.stderr: -13> 2024-09-12T00:53:41.398+0000 7fb9a7a20800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.3.1 2024-09-12T00:53:41.479 INFO:tasks.workunit.client.0.smithi073.stderr: -12> 2024-09-12T00:53:41.398+0000 7fb9a7a20800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.3.1 2024-09-12T00:53:41.479 INFO:tasks.workunit.client.0.smithi073.stderr: -11> 2024-09-12T00:53:41.398+0000 7fb9a7a20800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.3.2 2024-09-12T00:53:41.479 INFO:tasks.workunit.client.0.smithi073.stderr: -10> 2024-09-12T00:53:41.398+0000 7fb9a7a20800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.3.2 2024-09-12T00:53:41.479 INFO:tasks.workunit.client.0.smithi073.stderr: -9> 2024-09-12T00:53:41.398+0000 7fb9a7a20800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.3.3 2024-09-12T00:53:41.479 INFO:tasks.workunit.client.0.smithi073.stderr: -8> 2024-09-12T00:53:41.398+0000 7fb9a7a20800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.3.3 2024-09-12T00:53:41.479 INFO:tasks.workunit.client.0.smithi073.stderr: -7> 2024-09-12T00:53:41.398+0000 7fb9a7a20800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.0 2024-09-12T00:53:41.479 INFO:tasks.workunit.client.0.smithi073.stderr: -6> 2024-09-12T00:53:41.398+0000 7fb9a7a20800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.0 2024-09-12T00:53:41.479 INFO:tasks.workunit.client.0.smithi073.stderr: -5> 2024-09-12T00:53:41.399+0000 7fb9a7a20800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.1 2024-09-12T00:53:41.479 INFO:tasks.workunit.client.0.smithi073.stderr: -4> 2024-09-12T00:53:41.399+0000 7fb9a7a20800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.1 2024-09-12T00:53:41.479 INFO:tasks.workunit.client.0.smithi073.stderr: -3> 2024-09-12T00:53:41.399+0000 7fb9a7a20800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.2 2024-09-12T00:53:41.480 INFO:tasks.workunit.client.0.smithi073.stderr: -2> 2024-09-12T00:53:41.399+0000 7fb9a7a20800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.2 2024-09-12T00:53:41.480 INFO:tasks.workunit.client.0.smithi073.stderr: -1> 2024-09-12T00:53:41.402+0000 7fb9a7a20800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb9a7a20800 time 2024-09-12T00:53:41.402040+0000 2024-09-12T00:53:41.480 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:53:41.480 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:41.480 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:53:41.480 INFO:tasks.workunit.client.0.smithi073.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fb9aaf8c71a] 2024-09-12T00:53:41.480 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fb9aaf8c8d8] 2024-09-12T00:53:41.480 INFO:tasks.workunit.client.0.smithi073.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b28e43f641] 2024-09-12T00:53:41.480 INFO:tasks.workunit.client.0.smithi073.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55b28e44e51b] 2024-09-12T00:53:41.480 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55b28e44f3e4] 2024-09-12T00:53:41.480 INFO:tasks.workunit.client.0.smithi073.stderr: 6: main() 2024-09-12T00:53:41.480 INFO:tasks.workunit.client.0.smithi073.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fb9a9c29590] 2024-09-12T00:53:41.480 INFO:tasks.workunit.client.0.smithi073.stderr: 8: __libc_start_main() 2024-09-12T00:53:41.481 INFO:tasks.workunit.client.0.smithi073.stderr: 9: _start() 2024-09-12T00:53:41.481 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:41.481 INFO:tasks.workunit.client.0.smithi073.stderr: 0> 2024-09-12T00:53:41.402+0000 7fb9a7a20800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:53:41.481 INFO:tasks.workunit.client.0.smithi073.stderr: in thread 7fb9a7a20800 thread_name:radosgw-admin 2024-09-12T00:53:41.481 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:41.481 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:53:41.481 INFO:tasks.workunit.client.0.smithi073.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fb9a9c3e6f0] 2024-09-12T00:53:41.481 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fb9a9c8b99c] 2024-09-12T00:53:41.481 INFO:tasks.workunit.client.0.smithi073.stderr: 3: raise() 2024-09-12T00:53:41.481 INFO:tasks.workunit.client.0.smithi073.stderr: 4: abort() 2024-09-12T00:53:41.481 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fb9aaf8c774] 2024-09-12T00:53:41.481 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fb9aaf8c8d8] 2024-09-12T00:53:41.481 INFO:tasks.workunit.client.0.smithi073.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b28e43f641] 2024-09-12T00:53:41.482 INFO:tasks.workunit.client.0.smithi073.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55b28e44e51b] 2024-09-12T00:53:41.482 INFO:tasks.workunit.client.0.smithi073.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55b28e44f3e4] 2024-09-12T00:53:41.482 INFO:tasks.workunit.client.0.smithi073.stderr: 10: main() 2024-09-12T00:53:41.482 INFO:tasks.workunit.client.0.smithi073.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fb9a9c29590] 2024-09-12T00:53:41.482 INFO:tasks.workunit.client.0.smithi073.stderr: 12: __libc_start_main() 2024-09-12T00:53:41.482 INFO:tasks.workunit.client.0.smithi073.stderr: 13: _start() 2024-09-12T00:53:41.482 INFO:tasks.workunit.client.0.smithi073.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:53:41.482 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:41.482 INFO:tasks.workunit.client.0.smithi073.stderr:--- logging levels --- 2024-09-12T00:53:41.482 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 none 2024-09-12T00:53:41.482 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 lockdep 2024-09-12T00:53:41.483 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 context 2024-09-12T00:53:41.483 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 crush 2024-09-12T00:53:41.483 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds 2024-09-12T00:53:41.483 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_balancer 2024-09-12T00:53:41.483 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_locker 2024-09-12T00:53:41.483 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_log 2024-09-12T00:53:41.483 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_log_expire 2024-09-12T00:53:41.483 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_migrator 2024-09-12T00:53:41.483 INFO:tasks.workunit.client.0.smithi073.stderr: 3/ 5 mds_quiesce 2024-09-12T00:53:41.483 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 buffer 2024-09-12T00:53:41.483 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 timer 2024-09-12T00:53:41.483 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 filer 2024-09-12T00:53:41.484 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 striper 2024-09-12T00:53:41.484 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 objecter 2024-09-12T00:53:41.484 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rados 2024-09-12T00:53:41.484 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd 2024-09-12T00:53:41.484 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_mirror 2024-09-12T00:53:41.484 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_replay 2024-09-12T00:53:41.484 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_pwl 2024-09-12T00:53:41.484 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 journaler 2024-09-12T00:53:41.484 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 objectcacher 2024-09-12T00:53:41.484 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:53:41.484 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 client 2024-09-12T00:53:41.484 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 osd 2024-09-12T00:53:41.484 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 optracker 2024-09-12T00:53:41.485 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 objclass 2024-09-12T00:53:41.485 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 filestore 2024-09-12T00:53:41.485 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 journal 2024-09-12T00:53:41.485 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 0 ms 2024-09-12T00:53:41.485 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mon 2024-09-12T00:53:41.485 INFO:tasks.workunit.client.0.smithi073.stderr: 0/10 monc 2024-09-12T00:53:41.485 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 paxos 2024-09-12T00:53:41.485 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 tp 2024-09-12T00:53:41.485 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 auth 2024-09-12T00:53:41.485 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 crypto 2024-09-12T00:53:41.485 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 finisher 2024-09-12T00:53:41.485 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 reserver 2024-09-12T00:53:41.485 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 heartbeatmap 2024-09-12T00:53:41.486 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 perfcounter 2024-09-12T00:53:41.486 INFO:tasks.workunit.client.0.smithi073.stderr: 20/20 rgw 2024-09-12T00:53:41.486 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_sync 2024-09-12T00:53:41.486 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_datacache 2024-09-12T00:53:41.486 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_access 2024-09-12T00:53:41.486 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:53:41.486 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_flight 2024-09-12T00:53:41.486 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:53:41.486 INFO:tasks.workunit.client.0.smithi073.stderr: 20/20 rgw_notification 2024-09-12T00:53:41.486 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 javaclient 2024-09-12T00:53:41.486 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 asok 2024-09-12T00:53:41.486 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 throttle 2024-09-12T00:53:41.486 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 0 refs 2024-09-12T00:53:41.487 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 compressor 2024-09-12T00:53:41.487 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 bluestore 2024-09-12T00:53:41.487 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 bluefs 2024-09-12T00:53:41.487 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 bdev 2024-09-12T00:53:41.487 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 kstore 2024-09-12T00:53:41.487 INFO:tasks.workunit.client.0.smithi073.stderr: 4/ 5 rocksdb 2024-09-12T00:53:41.487 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 fuse 2024-09-12T00:53:41.487 INFO:tasks.workunit.client.0.smithi073.stderr: 2/ 5 mgr 2024-09-12T00:53:41.487 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mgrc 2024-09-12T00:53:41.487 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 dpdk 2024-09-12T00:53:41.487 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 eventtrace 2024-09-12T00:53:41.487 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 prioritycache 2024-09-12T00:53:41.488 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 test 2024-09-12T00:53:41.488 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:53:41.488 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cephsqlite 2024-09-12T00:53:41.488 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:53:41.488 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore 2024-09-12T00:53:41.488 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_onode 2024-09-12T00:53:41.488 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_odata 2024-09-12T00:53:41.488 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_omap 2024-09-12T00:53:41.488 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_tm 2024-09-12T00:53:41.489 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_t 2024-09-12T00:53:41.489 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:53:41.489 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_epm 2024-09-12T00:53:41.489 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_lba 2024-09-12T00:53:41.489 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:53:41.489 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_cache 2024-09-12T00:53:41.489 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_journal 2024-09-12T00:53:41.489 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_device 2024-09-12T00:53:41.489 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_backref 2024-09-12T00:53:41.489 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 alienstore 2024-09-12T00:53:41.489 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mclock 2024-09-12T00:53:41.490 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cyanstore 2024-09-12T00:53:41.490 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 ceph_exporter 2024-09-12T00:53:41.490 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 memstore 2024-09-12T00:53:41.490 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 trace 2024-09-12T00:53:41.490 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 ceph_dedup 2024-09-12T00:53:41.490 INFO:tasks.workunit.client.0.smithi073.stderr: -2/-2 (syslog threshold) 2024-09-12T00:53:41.490 INFO:tasks.workunit.client.0.smithi073.stderr: 99/99 (stderr threshold) 2024-09-12T00:53:41.490 INFO:tasks.workunit.client.0.smithi073.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:53:41.490 INFO:tasks.workunit.client.0.smithi073.stderr: 7fb7cbfff640 / http_manager 2024-09-12T00:53:41.490 INFO:tasks.workunit.client.0.smithi073.stderr: 7fb85a7e4640 / http_manager 2024-09-12T00:53:41.490 INFO:tasks.workunit.client.0.smithi073.stderr: 7fb85b7e6640 / rgw_dt_lg_renew 2024-09-12T00:53:41.490 INFO:tasks.workunit.client.0.smithi073.stderr: 7fb876ffd640 / ms_dispatch 2024-09-12T00:53:41.491 INFO:tasks.workunit.client.0.smithi073.stderr: 7fb888ff9640 / io_context_pool 2024-09-12T00:53:41.491 INFO:tasks.workunit.client.0.smithi073.stderr: 7fb88affd640 / ms_dispatch 2024-09-12T00:53:41.491 INFO:tasks.workunit.client.0.smithi073.stderr: 7fb891e03640 / ms_dispatch 2024-09-12T00:53:41.491 INFO:tasks.workunit.client.0.smithi073.stderr: 7fb893606640 / io_context_pool 2024-09-12T00:53:41.491 INFO:tasks.workunit.client.0.smithi073.stderr: 7fb99cd09640 / msgr-worker-2 2024-09-12T00:53:41.491 INFO:tasks.workunit.client.0.smithi073.stderr: 7fb9a550a640 / msgr-worker-1 2024-09-12T00:53:41.491 INFO:tasks.workunit.client.0.smithi073.stderr: 7fb9a5d0b640 / msgr-worker-0 2024-09-12T00:53:41.491 INFO:tasks.workunit.client.0.smithi073.stderr: 7fb9a650c640 / io_context_pool 2024-09-12T00:53:41.491 INFO:tasks.workunit.client.0.smithi073.stderr: 7fb9a7a20800 / radosgw-admin 2024-09-12T00:53:41.491 INFO:tasks.workunit.client.0.smithi073.stderr: max_recent 500 2024-09-12T00:53:41.491 INFO:tasks.workunit.client.0.smithi073.stderr: max_new 1000 2024-09-12T00:53:41.491 INFO:tasks.workunit.client.0.smithi073.stderr: log_file /var/log/ceph/ceph-client.admin.146661.log 2024-09-12T00:53:41.491 INFO:tasks.workunit.client.0.smithi073.stderr:--- end dump of recent events --- 2024-09-12T00:53:41.492 INFO:tasks.workunit.client.0.smithi073.stderr:--- begin dump of recent events --- 2024-09-12T00:53:41.492 INFO:tasks.workunit.client.0.smithi073.stderr: -499> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f76e9c0) adding con mode: crc 2024-09-12T00:53:41.492 INFO:tasks.workunit.client.0.smithi073.stderr: -498> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f76e9c0) adding con mode: secure 2024-09-12T00:53:41.492 INFO:tasks.workunit.client.0.smithi073.stderr: -497> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f76e9c0) adding con mode: crc 2024-09-12T00:53:41.492 INFO:tasks.workunit.client.0.smithi073.stderr: -496> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f76e9c0) adding con mode: secure 2024-09-12T00:53:41.492 INFO:tasks.workunit.client.0.smithi073.stderr: -495> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f76e9c0) adding con mode: crc 2024-09-12T00:53:41.492 INFO:tasks.workunit.client.0.smithi073.stderr: -494> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f76e9c0) adding con mode: crc 2024-09-12T00:53:41.492 INFO:tasks.workunit.client.0.smithi073.stderr: -493> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f76e9c0) adding con mode: secure 2024-09-12T00:53:41.492 INFO:tasks.workunit.client.0.smithi073.stderr: -492> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f76e9c0) adding con mode: crc 2024-09-12T00:53:41.492 INFO:tasks.workunit.client.0.smithi073.stderr: -491> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f76e9c0) adding con mode: secure 2024-09-12T00:53:41.492 INFO:tasks.workunit.client.0.smithi073.stderr: -490> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f76e9c0) adding con mode: crc 2024-09-12T00:53:41.492 INFO:tasks.workunit.client.0.smithi073.stderr: -489> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f76e9c0) adding con mode: secure 2024-09-12T00:53:41.492 INFO:tasks.workunit.client.0.smithi073.stderr: -488> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:41.493 INFO:tasks.workunit.client.0.smithi073.stderr: -487> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 1 librados: starting msgr at 2024-09-12T00:53:41.493 INFO:tasks.workunit.client.0.smithi073.stderr: -486> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 1 librados: starting objecter 2024-09-12T00:53:41.493 INFO:tasks.workunit.client.0.smithi073.stderr: -485> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 5 asok(0x55b28f546630) register_command objecter_requests hook 0x55b28f770f60 2024-09-12T00:53:41.493 INFO:tasks.workunit.client.0.smithi073.stderr: -484> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 1 librados: setting wanted keys 2024-09-12T00:53:41.493 INFO:tasks.workunit.client.0.smithi073.stderr: -483> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 1 librados: calling monclient init 2024-09-12T00:53:41.493 INFO:tasks.workunit.client.0.smithi073.stderr: -482> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 10 monclient: init 2024-09-12T00:53:41.493 INFO:tasks.workunit.client.0.smithi073.stderr: -481> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f768d20) adding auth protocol: cephx 2024-09-12T00:53:41.493 INFO:tasks.workunit.client.0.smithi073.stderr: -480> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f768d20) adding auth protocol: cephx 2024-09-12T00:53:41.493 INFO:tasks.workunit.client.0.smithi073.stderr: -479> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f768d20) adding auth protocol: cephx 2024-09-12T00:53:41.493 INFO:tasks.workunit.client.0.smithi073.stderr: -478> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f768d20) adding con mode: secure 2024-09-12T00:53:41.493 INFO:tasks.workunit.client.0.smithi073.stderr: -477> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f768d20) adding con mode: crc 2024-09-12T00:53:41.493 INFO:tasks.workunit.client.0.smithi073.stderr: -476> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f768d20) adding con mode: secure 2024-09-12T00:53:41.494 INFO:tasks.workunit.client.0.smithi073.stderr: -475> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f768d20) adding con mode: crc 2024-09-12T00:53:41.494 INFO:tasks.workunit.client.0.smithi073.stderr: -474> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f768d20) adding con mode: secure 2024-09-12T00:53:41.494 INFO:tasks.workunit.client.0.smithi073.stderr: -473> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f768d20) adding con mode: crc 2024-09-12T00:53:41.494 INFO:tasks.workunit.client.0.smithi073.stderr: -472> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f768d20) adding con mode: crc 2024-09-12T00:53:41.494 INFO:tasks.workunit.client.0.smithi073.stderr: -471> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f768d20) adding con mode: secure 2024-09-12T00:53:41.494 INFO:tasks.workunit.client.0.smithi073.stderr: -470> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f768d20) adding con mode: crc 2024-09-12T00:53:41.494 INFO:tasks.workunit.client.0.smithi073.stderr: -469> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f768d20) adding con mode: secure 2024-09-12T00:53:41.494 INFO:tasks.workunit.client.0.smithi073.stderr: -468> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f768d20) adding con mode: crc 2024-09-12T00:53:41.494 INFO:tasks.workunit.client.0.smithi073.stderr: -467> 2024-09-12T00:53:40.733+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f768d20) adding con mode: secure 2024-09-12T00:53:41.494 INFO:tasks.workunit.client.0.smithi073.stderr: -466> 2024-09-12T00:53:40.734+0000 7fb9a7a20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:41.494 INFO:tasks.workunit.client.0.smithi073.stderr: -465> 2024-09-12T00:53:40.734+0000 7fb9a7a20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:41.494 INFO:tasks.workunit.client.0.smithi073.stderr: -464> 2024-09-12T00:53:40.734+0000 7fb9a7a20800 5 asok(0x55b28f546630) register_command rotate-key hook 0x55b28f768e68 2024-09-12T00:53:41.495 INFO:tasks.workunit.client.0.smithi073.stderr: -463> 2024-09-12T00:53:40.734+0000 7fb9a7a20800 10 monclient: _reopen_session rank -1 2024-09-12T00:53:41.495 INFO:tasks.workunit.client.0.smithi073.stderr: -462> 2024-09-12T00:53:40.734+0000 7fb9a7a20800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:53:41.495 INFO:tasks.workunit.client.0.smithi073.stderr: -461> 2024-09-12T00:53:40.734+0000 7fb9a7a20800 10 monclient(hunting): picked mon.noname-c con 0x55b28f5f0e80 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:53:41.495 INFO:tasks.workunit.client.0.smithi073.stderr: -460> 2024-09-12T00:53:40.734+0000 7fb9a7a20800 10 monclient(hunting): picked mon.noname-a con 0x55b28f61eda0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:53:41.495 INFO:tasks.workunit.client.0.smithi073.stderr: -459> 2024-09-12T00:53:40.734+0000 7fb9a7a20800 10 monclient(hunting): picked mon.noname-b con 0x55b28f6b20c0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:53:41.495 INFO:tasks.workunit.client.0.smithi073.stderr: -458> 2024-09-12T00:53:40.734+0000 7fb9a7a20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:41.495 INFO:tasks.workunit.client.0.smithi073.stderr: -457> 2024-09-12T00:53:40.734+0000 7fb9a7a20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:41.495 INFO:tasks.workunit.client.0.smithi073.stderr: -456> 2024-09-12T00:53:40.734+0000 7fb9a7a20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:41.495 INFO:tasks.workunit.client.0.smithi073.stderr: -455> 2024-09-12T00:53:40.734+0000 7fb9a7a20800 10 monclient(hunting): _renew_subs 2024-09-12T00:53:41.495 INFO:tasks.workunit.client.0.smithi073.stderr: -454> 2024-09-12T00:53:40.734+0000 7fb9a7a20800 10 monclient(hunting): authenticate will time out at 2281.404329s 2024-09-12T00:53:41.495 INFO:tasks.workunit.client.0.smithi073.stderr: -453> 2024-09-12T00:53:40.734+0000 7fb9a550a640 10 monclient(hunting): get_auth_request con 0x55b28f5f0e80 auth_method 0 2024-09-12T00:53:41.495 INFO:tasks.workunit.client.0.smithi073.stderr: -452> 2024-09-12T00:53:40.734+0000 7fb9a550a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:41.495 INFO:tasks.workunit.client.0.smithi073.stderr: -451> 2024-09-12T00:53:40.734+0000 7fb9a550a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:41.496 INFO:tasks.workunit.client.0.smithi073.stderr: -450> 2024-09-12T00:53:40.734+0000 7fb9a550a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:41.496 INFO:tasks.workunit.client.0.smithi073.stderr: -449> 2024-09-12T00:53:40.734+0000 7fb99cd09640 10 monclient(hunting): get_auth_request con 0x55b28f61eda0 auth_method 0 2024-09-12T00:53:41.496 INFO:tasks.workunit.client.0.smithi073.stderr: -448> 2024-09-12T00:53:40.734+0000 7fb99cd09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:41.496 INFO:tasks.workunit.client.0.smithi073.stderr: -447> 2024-09-12T00:53:40.734+0000 7fb99cd09640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:41.496 INFO:tasks.workunit.client.0.smithi073.stderr: -446> 2024-09-12T00:53:40.734+0000 7fb99cd09640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:41.496 INFO:tasks.workunit.client.0.smithi073.stderr: -445> 2024-09-12T00:53:40.734+0000 7fb9a550a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:41.496 INFO:tasks.workunit.client.0.smithi073.stderr: -444> 2024-09-12T00:53:40.734+0000 7fb9a550a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:41.496 INFO:tasks.workunit.client.0.smithi073.stderr: -443> 2024-09-12T00:53:40.734+0000 7fb9a550a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:41.496 INFO:tasks.workunit.client.0.smithi073.stderr: -442> 2024-09-12T00:53:40.734+0000 7fb99cd09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:41.496 INFO:tasks.workunit.client.0.smithi073.stderr: -441> 2024-09-12T00:53:40.734+0000 7fb99cd09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:41.496 INFO:tasks.workunit.client.0.smithi073.stderr: -440> 2024-09-12T00:53:40.734+0000 7fb99cd09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:41.496 INFO:tasks.workunit.client.0.smithi073.stderr: -439> 2024-09-12T00:53:40.734+0000 7fb9a5d0b640 10 monclient(hunting): get_auth_request con 0x55b28f6b20c0 auth_method 0 2024-09-12T00:53:41.497 INFO:tasks.workunit.client.0.smithi073.stderr: -438> 2024-09-12T00:53:40.734+0000 7fb9a5d0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:41.497 INFO:tasks.workunit.client.0.smithi073.stderr: -437> 2024-09-12T00:53:40.734+0000 7fb9a5d0b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:41.497 INFO:tasks.workunit.client.0.smithi073.stderr: -436> 2024-09-12T00:53:40.734+0000 7fb9a5d0b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:41.497 INFO:tasks.workunit.client.0.smithi073.stderr: -435> 2024-09-12T00:53:40.734+0000 7fb99cd09640 10 monclient(hunting): handle_auth_done global_id 8139 payload 824 2024-09-12T00:53:41.497 INFO:tasks.workunit.client.0.smithi073.stderr: -434> 2024-09-12T00:53:40.734+0000 7fb99cd09640 10 monclient: _finish_hunting 0 2024-09-12T00:53:41.497 INFO:tasks.workunit.client.0.smithi073.stderr: -433> 2024-09-12T00:53:40.734+0000 7fb99cd09640 1 monclient: found mon.noname-a 2024-09-12T00:53:41.497 INFO:tasks.workunit.client.0.smithi073.stderr: -432> 2024-09-12T00:53:40.734+0000 7fb99cd09640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:53:41.497 INFO:tasks.workunit.client.0.smithi073.stderr: -431> 2024-09-12T00:53:40.734+0000 7fb891e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:41.497 INFO:tasks.workunit.client.0.smithi073.stderr: -430> 2024-09-12T00:53:40.734+0000 7fb891e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:53:41.497 INFO:tasks.workunit.client.0.smithi073.stderr: -429> 2024-09-12T00:53:40.734+0000 7fb891e03640 10 monclient: dump: 2024-09-12T00:53:41.497 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:53:41.497 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:53:41.498 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:41.498 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:41.498 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:41.498 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:53:41.498 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:53:41.498 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:53:41.498 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:53:41.498 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:41.498 INFO:tasks.workunit.client.0.smithi073.stderr: -428> 2024-09-12T00:53:40.734+0000 7fb891e03640 10 monclient: _finish_auth 0 2024-09-12T00:53:41.498 INFO:tasks.workunit.client.0.smithi073.stderr: -427> 2024-09-12T00:53:40.734+0000 7fb891e03640 10 monclient: _check_auth_tickets 2024-09-12T00:53:41.498 INFO:tasks.workunit.client.0.smithi073.stderr: -426> 2024-09-12T00:53:40.734+0000 7fb891e03640 10 monclient: handle_config config(0 keys) 2024-09-12T00:53:41.499 INFO:tasks.workunit.client.0.smithi073.stderr: -425> 2024-09-12T00:53:40.734+0000 7fb891e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:41.499 INFO:tasks.workunit.client.0.smithi073.stderr: -424> 2024-09-12T00:53:40.734+0000 7fb891e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:53:41.499 INFO:tasks.workunit.client.0.smithi073.stderr: -423> 2024-09-12T00:53:40.734+0000 7fb891e03640 10 monclient: dump: 2024-09-12T00:53:41.499 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:53:41.499 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:53:41.499 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:41.499 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:41.499 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:41.499 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:53:41.499 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:53:41.499 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:53:41.499 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:53:41.499 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:41.499 INFO:tasks.workunit.client.0.smithi073.stderr: -422> 2024-09-12T00:53:40.734+0000 7fb9a7a20800 5 monclient: authenticate success, global_id 8139 2024-09-12T00:53:41.500 INFO:tasks.workunit.client.0.smithi073.stderr: -421> 2024-09-12T00:53:40.734+0000 7fb9a7a20800 10 monclient: _renew_subs 2024-09-12T00:53:41.500 INFO:tasks.workunit.client.0.smithi073.stderr: -420> 2024-09-12T00:53:40.734+0000 7fb9a7a20800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:53:41.500 INFO:tasks.workunit.client.0.smithi073.stderr: -419> 2024-09-12T00:53:40.734+0000 7fb893606640 4 set_mon_vals no callback set 2024-09-12T00:53:41.500 INFO:tasks.workunit.client.0.smithi073.stderr: -418> 2024-09-12T00:53:40.735+0000 7fb9a7a20800 10 monclient: _renew_subs 2024-09-12T00:53:41.500 INFO:tasks.workunit.client.0.smithi073.stderr: -417> 2024-09-12T00:53:40.735+0000 7fb9a7a20800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:53:41.500 INFO:tasks.workunit.client.0.smithi073.stderr: -416> 2024-09-12T00:53:40.735+0000 7fb9a7a20800 1 librados: init done 2024-09-12T00:53:41.500 INFO:tasks.workunit.client.0.smithi073.stderr: -415> 2024-09-12T00:53:40.736+0000 7fb891e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:53:41.500 INFO:tasks.workunit.client.0.smithi073.stderr: -414> 2024-09-12T00:53:40.736+0000 7fb891e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:53:41.500 INFO:tasks.workunit.client.0.smithi073.stderr: -413> 2024-09-12T00:53:40.736+0000 7fb891e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:53:41.500 INFO:tasks.workunit.client.0.smithi073.stderr: -412> 2024-09-12T00:53:40.737+0000 7fb9a550a640 10 monclient: get_auth_request con 0x7fb88c0764a0 auth_method 0 2024-09-12T00:53:41.500 INFO:tasks.workunit.client.0.smithi073.stderr: -411> 2024-09-12T00:53:40.737+0000 7fb9a5d0b640 10 monclient: get_auth_request con 0x55b28f7a7860 auth_method 0 2024-09-12T00:53:41.500 INFO:tasks.workunit.client.0.smithi073.stderr: -410> 2024-09-12T00:53:40.738+0000 7fb9a550a640 10 monclient: get_auth_request con 0x55b28f7b3c50 auth_method 0 2024-09-12T00:53:41.500 INFO:tasks.workunit.client.0.smithi073.stderr: -409> 2024-09-12T00:53:40.940+0000 7fb9a550a640 10 monclient: get_auth_request con 0x55b28f7b3c50 auth_method 0 2024-09-12T00:53:41.501 INFO:tasks.workunit.client.0.smithi073.stderr: -408> 2024-09-12T00:53:40.941+0000 7fb99cd09640 10 monclient: get_auth_request con 0x55b28f7b8040 auth_method 0 2024-09-12T00:53:41.501 INFO:tasks.workunit.client.0.smithi073.stderr: -407> 2024-09-12T00:53:40.942+0000 7fb9a7a20800 10 monclient: build_initial_monmap 2024-09-12T00:53:41.501 INFO:tasks.workunit.client.0.smithi073.stderr: -406> 2024-09-12T00:53:40.942+0000 7fb9a7a20800 1 build_initial for_mkfs: 0 2024-09-12T00:53:41.501 INFO:tasks.workunit.client.0.smithi073.stderr: -405> 2024-09-12T00:53:40.942+0000 7fb9a7a20800 10 monclient: monmap: 2024-09-12T00:53:41.501 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:53:41.501 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:53:41.501 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:53:41.501 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:53:41.501 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:53:41.501 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:53:41.501 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:53:41.501 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:53:41.502 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:53:41.502 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:41.502 INFO:tasks.workunit.client.0.smithi073.stderr: -404> 2024-09-12T00:53:40.942+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bcf90) adding auth protocol: cephx 2024-09-12T00:53:41.502 INFO:tasks.workunit.client.0.smithi073.stderr: -403> 2024-09-12T00:53:40.942+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bcf90) adding auth protocol: cephx 2024-09-12T00:53:41.502 INFO:tasks.workunit.client.0.smithi073.stderr: -402> 2024-09-12T00:53:40.942+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bcf90) adding auth protocol: cephx 2024-09-12T00:53:41.502 INFO:tasks.workunit.client.0.smithi073.stderr: -401> 2024-09-12T00:53:40.942+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bcf90) adding con mode: secure 2024-09-12T00:53:41.502 INFO:tasks.workunit.client.0.smithi073.stderr: -400> 2024-09-12T00:53:40.942+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bcf90) adding con mode: crc 2024-09-12T00:53:41.502 INFO:tasks.workunit.client.0.smithi073.stderr: -399> 2024-09-12T00:53:40.942+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bcf90) adding con mode: secure 2024-09-12T00:53:41.502 INFO:tasks.workunit.client.0.smithi073.stderr: -398> 2024-09-12T00:53:40.942+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bcf90) adding con mode: crc 2024-09-12T00:53:41.502 INFO:tasks.workunit.client.0.smithi073.stderr: -397> 2024-09-12T00:53:40.942+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bcf90) adding con mode: secure 2024-09-12T00:53:41.502 INFO:tasks.workunit.client.0.smithi073.stderr: -396> 2024-09-12T00:53:40.942+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bcf90) adding con mode: crc 2024-09-12T00:53:41.502 INFO:tasks.workunit.client.0.smithi073.stderr: -395> 2024-09-12T00:53:40.942+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bcf90) adding con mode: crc 2024-09-12T00:53:41.502 INFO:tasks.workunit.client.0.smithi073.stderr: -394> 2024-09-12T00:53:40.942+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bcf90) adding con mode: secure 2024-09-12T00:53:41.503 INFO:tasks.workunit.client.0.smithi073.stderr: -393> 2024-09-12T00:53:40.942+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bcf90) adding con mode: crc 2024-09-12T00:53:41.503 INFO:tasks.workunit.client.0.smithi073.stderr: -392> 2024-09-12T00:53:40.942+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bcf90) adding con mode: secure 2024-09-12T00:53:41.503 INFO:tasks.workunit.client.0.smithi073.stderr: -391> 2024-09-12T00:53:40.942+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bcf90) adding con mode: crc 2024-09-12T00:53:41.503 INFO:tasks.workunit.client.0.smithi073.stderr: -390> 2024-09-12T00:53:40.942+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bcf90) adding con mode: secure 2024-09-12T00:53:41.503 INFO:tasks.workunit.client.0.smithi073.stderr: -389> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:41.503 INFO:tasks.workunit.client.0.smithi073.stderr: -388> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 5 asok(0x55b28f546630) register_command objecter_requests cmddesc objecter_requests hook 0x55b28f7c09a0 EEXIST 2024-09-12T00:53:41.503 INFO:tasks.workunit.client.0.smithi073.stderr: -387> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 10 monclient: init 2024-09-12T00:53:41.503 INFO:tasks.workunit.client.0.smithi073.stderr: -386> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bb5a8) adding auth protocol: cephx 2024-09-12T00:53:41.503 INFO:tasks.workunit.client.0.smithi073.stderr: -385> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bb5a8) adding auth protocol: cephx 2024-09-12T00:53:41.503 INFO:tasks.workunit.client.0.smithi073.stderr: -384> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bb5a8) adding auth protocol: cephx 2024-09-12T00:53:41.503 INFO:tasks.workunit.client.0.smithi073.stderr: -383> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bb5a8) adding con mode: secure 2024-09-12T00:53:41.503 INFO:tasks.workunit.client.0.smithi073.stderr: -382> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bb5a8) adding con mode: crc 2024-09-12T00:53:41.503 INFO:tasks.workunit.client.0.smithi073.stderr: -381> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bb5a8) adding con mode: secure 2024-09-12T00:53:41.504 INFO:tasks.workunit.client.0.smithi073.stderr: -380> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bb5a8) adding con mode: crc 2024-09-12T00:53:41.504 INFO:tasks.workunit.client.0.smithi073.stderr: -379> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bb5a8) adding con mode: secure 2024-09-12T00:53:41.504 INFO:tasks.workunit.client.0.smithi073.stderr: -378> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bb5a8) adding con mode: crc 2024-09-12T00:53:41.504 INFO:tasks.workunit.client.0.smithi073.stderr: -377> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bb5a8) adding con mode: crc 2024-09-12T00:53:41.504 INFO:tasks.workunit.client.0.smithi073.stderr: -376> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bb5a8) adding con mode: secure 2024-09-12T00:53:41.504 INFO:tasks.workunit.client.0.smithi073.stderr: -375> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bb5a8) adding con mode: crc 2024-09-12T00:53:41.504 INFO:tasks.workunit.client.0.smithi073.stderr: -374> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bb5a8) adding con mode: secure 2024-09-12T00:53:41.504 INFO:tasks.workunit.client.0.smithi073.stderr: -373> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bb5a8) adding con mode: crc 2024-09-12T00:53:41.504 INFO:tasks.workunit.client.0.smithi073.stderr: -372> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7bb5a8) adding con mode: secure 2024-09-12T00:53:41.504 INFO:tasks.workunit.client.0.smithi073.stderr: -371> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:41.504 INFO:tasks.workunit.client.0.smithi073.stderr: -370> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:41.504 INFO:tasks.workunit.client.0.smithi073.stderr: -369> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 5 asok(0x55b28f546630) register_command rotate-key cmddesc rotate-key hook 0x55b28f7bb6f0 EEXIST 2024-09-12T00:53:41.505 INFO:tasks.workunit.client.0.smithi073.stderr: -368> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 10 monclient: _reopen_session rank -1 2024-09-12T00:53:41.505 INFO:tasks.workunit.client.0.smithi073.stderr: -367> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:53:41.505 INFO:tasks.workunit.client.0.smithi073.stderr: -366> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 10 monclient(hunting): picked mon.noname-b con 0x55b28f7e4690 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:53:41.505 INFO:tasks.workunit.client.0.smithi073.stderr: -365> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 10 monclient(hunting): picked mon.noname-c con 0x55b28f7e6960 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:53:41.505 INFO:tasks.workunit.client.0.smithi073.stderr: -364> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 10 monclient(hunting): picked mon.noname-a con 0x55b28f7e2e60 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:53:41.505 INFO:tasks.workunit.client.0.smithi073.stderr: -363> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:41.505 INFO:tasks.workunit.client.0.smithi073.stderr: -362> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:41.505 INFO:tasks.workunit.client.0.smithi073.stderr: -361> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:41.505 INFO:tasks.workunit.client.0.smithi073.stderr: -360> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 10 monclient(hunting): _renew_subs 2024-09-12T00:53:41.505 INFO:tasks.workunit.client.0.smithi073.stderr: -359> 2024-09-12T00:53:40.943+0000 7fb9a7a20800 10 monclient(hunting): authenticate will time out at 2281.613867s 2024-09-12T00:53:41.505 INFO:tasks.workunit.client.0.smithi073.stderr: -358> 2024-09-12T00:53:40.944+0000 7fb99cd09640 10 monclient(hunting): get_auth_request con 0x55b28f7e6960 auth_method 0 2024-09-12T00:53:41.505 INFO:tasks.workunit.client.0.smithi073.stderr: -357> 2024-09-12T00:53:40.944+0000 7fb99cd09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:41.505 INFO:tasks.workunit.client.0.smithi073.stderr: -356> 2024-09-12T00:53:40.944+0000 7fb99cd09640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:41.506 INFO:tasks.workunit.client.0.smithi073.stderr: -355> 2024-09-12T00:53:40.944+0000 7fb99cd09640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:41.506 INFO:tasks.workunit.client.0.smithi073.stderr: -354> 2024-09-12T00:53:40.944+0000 7fb9a5d0b640 10 monclient(hunting): get_auth_request con 0x55b28f7e2e60 auth_method 0 2024-09-12T00:53:41.506 INFO:tasks.workunit.client.0.smithi073.stderr: -353> 2024-09-12T00:53:40.944+0000 7fb9a5d0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:41.506 INFO:tasks.workunit.client.0.smithi073.stderr: -352> 2024-09-12T00:53:40.944+0000 7fb9a5d0b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:41.506 INFO:tasks.workunit.client.0.smithi073.stderr: -351> 2024-09-12T00:53:40.944+0000 7fb9a5d0b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:41.506 INFO:tasks.workunit.client.0.smithi073.stderr: -350> 2024-09-12T00:53:40.944+0000 7fb9a550a640 10 monclient(hunting): get_auth_request con 0x55b28f7e4690 auth_method 0 2024-09-12T00:53:41.506 INFO:tasks.workunit.client.0.smithi073.stderr: -349> 2024-09-12T00:53:40.944+0000 7fb9a550a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:41.506 INFO:tasks.workunit.client.0.smithi073.stderr: -348> 2024-09-12T00:53:40.944+0000 7fb9a550a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:41.506 INFO:tasks.workunit.client.0.smithi073.stderr: -347> 2024-09-12T00:53:40.944+0000 7fb9a550a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:41.506 INFO:tasks.workunit.client.0.smithi073.stderr: -346> 2024-09-12T00:53:40.944+0000 7fb99cd09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:41.506 INFO:tasks.workunit.client.0.smithi073.stderr: -345> 2024-09-12T00:53:40.944+0000 7fb99cd09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:41.506 INFO:tasks.workunit.client.0.smithi073.stderr: -344> 2024-09-12T00:53:40.944+0000 7fb99cd09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:41.506 INFO:tasks.workunit.client.0.smithi073.stderr: -343> 2024-09-12T00:53:40.944+0000 7fb9a5d0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:41.507 INFO:tasks.workunit.client.0.smithi073.stderr: -342> 2024-09-12T00:53:40.944+0000 7fb9a5d0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:41.507 INFO:tasks.workunit.client.0.smithi073.stderr: -341> 2024-09-12T00:53:40.944+0000 7fb9a5d0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:41.507 INFO:tasks.workunit.client.0.smithi073.stderr: -340> 2024-09-12T00:53:40.944+0000 7fb9a550a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:41.507 INFO:tasks.workunit.client.0.smithi073.stderr: -339> 2024-09-12T00:53:40.944+0000 7fb9a550a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:41.507 INFO:tasks.workunit.client.0.smithi073.stderr: -338> 2024-09-12T00:53:40.944+0000 7fb9a550a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:41.507 INFO:tasks.workunit.client.0.smithi073.stderr: -337> 2024-09-12T00:53:40.944+0000 7fb9a5d0b640 10 monclient(hunting): handle_auth_done global_id 8142 payload 824 2024-09-12T00:53:41.507 INFO:tasks.workunit.client.0.smithi073.stderr: -336> 2024-09-12T00:53:40.944+0000 7fb9a5d0b640 10 monclient: _finish_hunting 0 2024-09-12T00:53:41.507 INFO:tasks.workunit.client.0.smithi073.stderr: -335> 2024-09-12T00:53:40.944+0000 7fb9a5d0b640 1 monclient: found mon.noname-a 2024-09-12T00:53:41.507 INFO:tasks.workunit.client.0.smithi073.stderr: -334> 2024-09-12T00:53:40.944+0000 7fb9a5d0b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:53:41.507 INFO:tasks.workunit.client.0.smithi073.stderr: -333> 2024-09-12T00:53:40.944+0000 7fb88affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:41.507 INFO:tasks.workunit.client.0.smithi073.stderr: -332> 2024-09-12T00:53:40.944+0000 7fb88affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:53:41.507 INFO:tasks.workunit.client.0.smithi073.stderr: -331> 2024-09-12T00:53:40.944+0000 7fb88affd640 10 monclient: dump: 2024-09-12T00:53:41.507 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:53:41.508 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:53:41.508 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:41.508 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:41.508 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:41.508 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:53:41.508 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:53:41.508 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:53:41.508 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:53:41.508 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:41.508 INFO:tasks.workunit.client.0.smithi073.stderr: -330> 2024-09-12T00:53:40.944+0000 7fb88affd640 10 monclient: _finish_auth 0 2024-09-12T00:53:41.508 INFO:tasks.workunit.client.0.smithi073.stderr: -329> 2024-09-12T00:53:40.944+0000 7fb88affd640 10 monclient: _check_auth_tickets 2024-09-12T00:53:41.508 INFO:tasks.workunit.client.0.smithi073.stderr: -328> 2024-09-12T00:53:40.944+0000 7fb88affd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:53:41.508 INFO:tasks.workunit.client.0.smithi073.stderr: -327> 2024-09-12T00:53:40.944+0000 7fb88affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:41.509 INFO:tasks.workunit.client.0.smithi073.stderr: -326> 2024-09-12T00:53:40.944+0000 7fb88affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:53:41.509 INFO:tasks.workunit.client.0.smithi073.stderr: -325> 2024-09-12T00:53:40.944+0000 7fb88affd640 10 monclient: dump: 2024-09-12T00:53:41.509 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:53:41.509 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:53:41.509 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:41.509 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:41.509 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:41.509 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:53:41.509 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:53:41.509 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:53:41.509 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:53:41.509 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:41.509 INFO:tasks.workunit.client.0.smithi073.stderr: -324> 2024-09-12T00:53:40.944+0000 7fb9a7a20800 5 monclient: authenticate success, global_id 8142 2024-09-12T00:53:41.510 INFO:tasks.workunit.client.0.smithi073.stderr: -323> 2024-09-12T00:53:40.944+0000 7fb9a7a20800 10 monclient: _renew_subs 2024-09-12T00:53:41.510 INFO:tasks.workunit.client.0.smithi073.stderr: -322> 2024-09-12T00:53:40.944+0000 7fb9a7a20800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:53:41.510 INFO:tasks.workunit.client.0.smithi073.stderr: -321> 2024-09-12T00:53:40.944+0000 7fb9a650c640 4 set_mon_vals no callback set 2024-09-12T00:53:41.510 INFO:tasks.workunit.client.0.smithi073.stderr: -320> 2024-09-12T00:53:40.944+0000 7fb9a7a20800 10 monclient: _renew_subs 2024-09-12T00:53:41.510 INFO:tasks.workunit.client.0.smithi073.stderr: -319> 2024-09-12T00:53:40.944+0000 7fb9a7a20800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:53:41.510 INFO:tasks.workunit.client.0.smithi073.stderr: -318> 2024-09-12T00:53:40.946+0000 7fb88affd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:53:41.510 INFO:tasks.workunit.client.0.smithi073.stderr: -317> 2024-09-12T00:53:40.946+0000 7fb88affd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:53:41.510 INFO:tasks.workunit.client.0.smithi073.stderr: -316> 2024-09-12T00:53:40.946+0000 7fb88affd640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:53:41.510 INFO:tasks.workunit.client.0.smithi073.stderr: -315> 2024-09-12T00:53:40.946+0000 7fb9a550a640 10 monclient: get_auth_request con 0x7fb880076380 auth_method 0 2024-09-12T00:53:41.510 INFO:tasks.workunit.client.0.smithi073.stderr: -314> 2024-09-12T00:53:40.946+0000 7fb9a7a20800 10 monclient: get_monmap_and_config 2024-09-12T00:53:41.510 INFO:tasks.workunit.client.0.smithi073.stderr: -313> 2024-09-12T00:53:40.946+0000 7fb9a7a20800 10 monclient: build_initial_monmap 2024-09-12T00:53:41.510 INFO:tasks.workunit.client.0.smithi073.stderr: -312> 2024-09-12T00:53:40.946+0000 7fb9a7a20800 1 build_initial for_mkfs: 0 2024-09-12T00:53:41.510 INFO:tasks.workunit.client.0.smithi073.stderr: -311> 2024-09-12T00:53:40.946+0000 7fb9a7a20800 10 monclient: monmap: 2024-09-12T00:53:41.511 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:53:41.511 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:53:41.511 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:53:41.511 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:53:41.511 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:53:41.511 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:53:41.511 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:53:41.511 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:53:41.511 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:53:41.511 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:41.511 INFO:tasks.workunit.client.0.smithi073.stderr: -310> 2024-09-12T00:53:40.946+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f8044c0) adding auth protocol: cephx 2024-09-12T00:53:41.511 INFO:tasks.workunit.client.0.smithi073.stderr: -309> 2024-09-12T00:53:40.946+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f8044c0) adding auth protocol: cephx 2024-09-12T00:53:41.511 INFO:tasks.workunit.client.0.smithi073.stderr: -308> 2024-09-12T00:53:40.946+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f8044c0) adding auth protocol: cephx 2024-09-12T00:53:41.512 INFO:tasks.workunit.client.0.smithi073.stderr: -307> 2024-09-12T00:53:40.946+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f8044c0) adding con mode: secure 2024-09-12T00:53:41.512 INFO:tasks.workunit.client.0.smithi073.stderr: -306> 2024-09-12T00:53:40.946+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f8044c0) adding con mode: crc 2024-09-12T00:53:41.512 INFO:tasks.workunit.client.0.smithi073.stderr: -305> 2024-09-12T00:53:40.946+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f8044c0) adding con mode: secure 2024-09-12T00:53:41.512 INFO:tasks.workunit.client.0.smithi073.stderr: -304> 2024-09-12T00:53:40.946+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f8044c0) adding con mode: crc 2024-09-12T00:53:41.512 INFO:tasks.workunit.client.0.smithi073.stderr: -303> 2024-09-12T00:53:40.946+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f8044c0) adding con mode: secure 2024-09-12T00:53:41.512 INFO:tasks.workunit.client.0.smithi073.stderr: -302> 2024-09-12T00:53:40.946+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f8044c0) adding con mode: crc 2024-09-12T00:53:41.512 INFO:tasks.workunit.client.0.smithi073.stderr: -301> 2024-09-12T00:53:40.946+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f8044c0) adding con mode: crc 2024-09-12T00:53:41.512 INFO:tasks.workunit.client.0.smithi073.stderr: -300> 2024-09-12T00:53:40.946+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f8044c0) adding con mode: secure 2024-09-12T00:53:41.512 INFO:tasks.workunit.client.0.smithi073.stderr: -299> 2024-09-12T00:53:40.946+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f8044c0) adding con mode: crc 2024-09-12T00:53:41.512 INFO:tasks.workunit.client.0.smithi073.stderr: -298> 2024-09-12T00:53:40.946+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f8044c0) adding con mode: secure 2024-09-12T00:53:41.512 INFO:tasks.workunit.client.0.smithi073.stderr: -297> 2024-09-12T00:53:40.946+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f8044c0) adding con mode: crc 2024-09-12T00:53:41.512 INFO:tasks.workunit.client.0.smithi073.stderr: -296> 2024-09-12T00:53:40.946+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f8044c0) adding con mode: secure 2024-09-12T00:53:41.512 INFO:tasks.workunit.client.0.smithi073.stderr: -295> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:41.513 INFO:tasks.workunit.client.0.smithi073.stderr: -294> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 10 monclient: init 2024-09-12T00:53:41.513 INFO:tasks.workunit.client.0.smithi073.stderr: -293> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd56c0) adding auth protocol: cephx 2024-09-12T00:53:41.513 INFO:tasks.workunit.client.0.smithi073.stderr: -292> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd56c0) adding auth protocol: cephx 2024-09-12T00:53:41.513 INFO:tasks.workunit.client.0.smithi073.stderr: -291> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd56c0) adding auth protocol: cephx 2024-09-12T00:53:41.513 INFO:tasks.workunit.client.0.smithi073.stderr: -290> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd56c0) adding con mode: secure 2024-09-12T00:53:41.513 INFO:tasks.workunit.client.0.smithi073.stderr: -289> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd56c0) adding con mode: crc 2024-09-12T00:53:41.513 INFO:tasks.workunit.client.0.smithi073.stderr: -288> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd56c0) adding con mode: secure 2024-09-12T00:53:41.513 INFO:tasks.workunit.client.0.smithi073.stderr: -287> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd56c0) adding con mode: crc 2024-09-12T00:53:41.513 INFO:tasks.workunit.client.0.smithi073.stderr: -286> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd56c0) adding con mode: secure 2024-09-12T00:53:41.513 INFO:tasks.workunit.client.0.smithi073.stderr: -285> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd56c0) adding con mode: crc 2024-09-12T00:53:41.513 INFO:tasks.workunit.client.0.smithi073.stderr: -284> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd56c0) adding con mode: crc 2024-09-12T00:53:41.513 INFO:tasks.workunit.client.0.smithi073.stderr: -283> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd56c0) adding con mode: secure 2024-09-12T00:53:41.513 INFO:tasks.workunit.client.0.smithi073.stderr: -282> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd56c0) adding con mode: crc 2024-09-12T00:53:41.513 INFO:tasks.workunit.client.0.smithi073.stderr: -281> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd56c0) adding con mode: secure 2024-09-12T00:53:41.514 INFO:tasks.workunit.client.0.smithi073.stderr: -280> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd56c0) adding con mode: crc 2024-09-12T00:53:41.514 INFO:tasks.workunit.client.0.smithi073.stderr: -279> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd56c0) adding con mode: secure 2024-09-12T00:53:41.514 INFO:tasks.workunit.client.0.smithi073.stderr: -278> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:41.514 INFO:tasks.workunit.client.0.smithi073.stderr: -277> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:41.514 INFO:tasks.workunit.client.0.smithi073.stderr: -276> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 5 asok(0x55b28f546630) register_command rotate-key cmddesc rotate-key hook 0x7fff6cdd5808 EEXIST 2024-09-12T00:53:41.514 INFO:tasks.workunit.client.0.smithi073.stderr: -275> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 10 monclient: _reopen_session rank -1 2024-09-12T00:53:41.514 INFO:tasks.workunit.client.0.smithi073.stderr: -274> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:53:41.514 INFO:tasks.workunit.client.0.smithi073.stderr: -273> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 10 monclient(hunting): picked mon.noname-c con 0x55b28f838b10 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:53:41.514 INFO:tasks.workunit.client.0.smithi073.stderr: -272> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 10 monclient(hunting): picked mon.noname-a con 0x55b28f809a60 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:53:41.514 INFO:tasks.workunit.client.0.smithi073.stderr: -271> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 10 monclient(hunting): picked mon.noname-b con 0x55b28f8343b0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:53:41.514 INFO:tasks.workunit.client.0.smithi073.stderr: -270> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:41.514 INFO:tasks.workunit.client.0.smithi073.stderr: -269> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:41.514 INFO:tasks.workunit.client.0.smithi073.stderr: -268> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:41.514 INFO:tasks.workunit.client.0.smithi073.stderr: -267> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 10 monclient(hunting): _renew_subs 2024-09-12T00:53:41.514 INFO:tasks.workunit.client.0.smithi073.stderr: -266> 2024-09-12T00:53:40.947+0000 7fb9a7a20800 10 monclient(hunting): authenticate will time out at 2281.617752s 2024-09-12T00:53:41.515 INFO:tasks.workunit.client.0.smithi073.stderr: -265> 2024-09-12T00:53:40.947+0000 7fb99cd09640 10 monclient(hunting): get_auth_request con 0x55b28f809a60 auth_method 0 2024-09-12T00:53:41.515 INFO:tasks.workunit.client.0.smithi073.stderr: -264> 2024-09-12T00:53:40.947+0000 7fb99cd09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:41.515 INFO:tasks.workunit.client.0.smithi073.stderr: -263> 2024-09-12T00:53:40.947+0000 7fb99cd09640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:41.515 INFO:tasks.workunit.client.0.smithi073.stderr: -262> 2024-09-12T00:53:40.947+0000 7fb99cd09640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:41.515 INFO:tasks.workunit.client.0.smithi073.stderr: -261> 2024-09-12T00:53:40.947+0000 7fb9a550a640 10 monclient(hunting): get_auth_request con 0x55b28f838b10 auth_method 0 2024-09-12T00:53:41.515 INFO:tasks.workunit.client.0.smithi073.stderr: -260> 2024-09-12T00:53:40.947+0000 7fb9a550a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:41.515 INFO:tasks.workunit.client.0.smithi073.stderr: -259> 2024-09-12T00:53:40.947+0000 7fb9a550a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:41.515 INFO:tasks.workunit.client.0.smithi073.stderr: -258> 2024-09-12T00:53:40.947+0000 7fb9a550a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:41.515 INFO:tasks.workunit.client.0.smithi073.stderr: -257> 2024-09-12T00:53:40.947+0000 7fb99cd09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:41.515 INFO:tasks.workunit.client.0.smithi073.stderr: -256> 2024-09-12T00:53:40.947+0000 7fb99cd09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:41.515 INFO:tasks.workunit.client.0.smithi073.stderr: -255> 2024-09-12T00:53:40.947+0000 7fb99cd09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:41.515 INFO:tasks.workunit.client.0.smithi073.stderr: -254> 2024-09-12T00:53:40.947+0000 7fb9a550a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:41.516 INFO:tasks.workunit.client.0.smithi073.stderr: -253> 2024-09-12T00:53:40.947+0000 7fb9a550a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:41.516 INFO:tasks.workunit.client.0.smithi073.stderr: -252> 2024-09-12T00:53:40.947+0000 7fb9a550a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:41.516 INFO:tasks.workunit.client.0.smithi073.stderr: -251> 2024-09-12T00:53:40.948+0000 7fb9a5d0b640 10 monclient(hunting): get_auth_request con 0x55b28f8343b0 auth_method 0 2024-09-12T00:53:41.516 INFO:tasks.workunit.client.0.smithi073.stderr: -250> 2024-09-12T00:53:40.948+0000 7fb9a5d0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:41.516 INFO:tasks.workunit.client.0.smithi073.stderr: -249> 2024-09-12T00:53:40.948+0000 7fb9a5d0b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:41.516 INFO:tasks.workunit.client.0.smithi073.stderr: -248> 2024-09-12T00:53:40.948+0000 7fb9a5d0b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:41.516 INFO:tasks.workunit.client.0.smithi073.stderr: -247> 2024-09-12T00:53:40.948+0000 7fb99cd09640 10 monclient(hunting): handle_auth_done global_id 8145 payload 274 2024-09-12T00:53:41.516 INFO:tasks.workunit.client.0.smithi073.stderr: -246> 2024-09-12T00:53:40.948+0000 7fb99cd09640 10 monclient: _finish_hunting 0 2024-09-12T00:53:41.516 INFO:tasks.workunit.client.0.smithi073.stderr: -245> 2024-09-12T00:53:40.948+0000 7fb99cd09640 1 monclient: found mon.noname-a 2024-09-12T00:53:41.516 INFO:tasks.workunit.client.0.smithi073.stderr: -244> 2024-09-12T00:53:40.948+0000 7fb99cd09640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:53:41.516 INFO:tasks.workunit.client.0.smithi073.stderr: -243> 2024-09-12T00:53:40.948+0000 7fb888ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:41.517 INFO:tasks.workunit.client.0.smithi073.stderr: -242> 2024-09-12T00:53:40.948+0000 7fb888ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:53:41.517 INFO:tasks.workunit.client.0.smithi073.stderr: -241> 2024-09-12T00:53:40.948+0000 7fb888ff9640 10 monclient: dump: 2024-09-12T00:53:41.517 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:53:41.517 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:53:41.517 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:41.517 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:41.517 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:41.517 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:53:41.517 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:53:41.517 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:53:41.517 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:53:41.518 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:41.518 INFO:tasks.workunit.client.0.smithi073.stderr: -240> 2024-09-12T00:53:40.948+0000 7fb888ff9640 10 monclient: _finish_auth 0 2024-09-12T00:53:41.518 INFO:tasks.workunit.client.0.smithi073.stderr: -239> 2024-09-12T00:53:40.948+0000 7fb888ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:53:41.518 INFO:tasks.workunit.client.0.smithi073.stderr: -238> 2024-09-12T00:53:40.948+0000 7fb888ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:53:41.518 INFO:tasks.workunit.client.0.smithi073.stderr: -237> 2024-09-12T00:53:40.948+0000 7fb888ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:41.518 INFO:tasks.workunit.client.0.smithi073.stderr: -236> 2024-09-12T00:53:40.948+0000 7fb888ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:53:41.518 INFO:tasks.workunit.client.0.smithi073.stderr: -235> 2024-09-12T00:53:40.948+0000 7fb888ff9640 10 monclient: dump: 2024-09-12T00:53:41.518 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:53:41.518 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:53:41.518 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:41.518 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:41.518 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:41.518 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:53:41.519 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:53:41.519 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:53:41.519 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:53:41.519 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:41.519 INFO:tasks.workunit.client.0.smithi073.stderr: -234> 2024-09-12T00:53:40.948+0000 7fb9a7a20800 5 monclient: authenticate success, global_id 8145 2024-09-12T00:53:41.519 INFO:tasks.workunit.client.0.smithi073.stderr: -233> 2024-09-12T00:53:40.948+0000 7fb9a7a20800 10 monclient: get_monmap_and_config success 2024-09-12T00:53:41.519 INFO:tasks.workunit.client.0.smithi073.stderr: -232> 2024-09-12T00:53:40.948+0000 7fb9a7a20800 4 set_mon_vals no callback set 2024-09-12T00:53:41.519 INFO:tasks.workunit.client.0.smithi073.stderr: -231> 2024-09-12T00:53:40.948+0000 7fb9a7a20800 10 monclient: shutdown 2024-09-12T00:53:41.519 INFO:tasks.workunit.client.0.smithi073.stderr: -230> 2024-09-12T00:53:40.948+0000 7fb9a7a20800 10 monclient: build_initial_monmap 2024-09-12T00:53:41.519 INFO:tasks.workunit.client.0.smithi073.stderr: -229> 2024-09-12T00:53:40.948+0000 7fb9a7a20800 1 build_initial for_mkfs: 0 2024-09-12T00:53:41.519 INFO:tasks.workunit.client.0.smithi073.stderr: -228> 2024-09-12T00:53:40.948+0000 7fb9a7a20800 10 monclient: monmap: 2024-09-12T00:53:41.519 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:53:41.519 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:53:41.519 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:53:41.520 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:53:41.520 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:53:41.520 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:53:41.520 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:53:41.520 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:53:41.520 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:53:41.520 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:41.520 INFO:tasks.workunit.client.0.smithi073.stderr: -227> 2024-09-12T00:53:40.948+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f82acb0) adding auth protocol: cephx 2024-09-12T00:53:41.520 INFO:tasks.workunit.client.0.smithi073.stderr: -226> 2024-09-12T00:53:40.948+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f82acb0) adding auth protocol: cephx 2024-09-12T00:53:41.520 INFO:tasks.workunit.client.0.smithi073.stderr: -225> 2024-09-12T00:53:40.948+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f82acb0) adding auth protocol: cephx 2024-09-12T00:53:41.520 INFO:tasks.workunit.client.0.smithi073.stderr: -224> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f82acb0) adding con mode: secure 2024-09-12T00:53:41.520 INFO:tasks.workunit.client.0.smithi073.stderr: -223> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f82acb0) adding con mode: crc 2024-09-12T00:53:41.520 INFO:tasks.workunit.client.0.smithi073.stderr: -222> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f82acb0) adding con mode: secure 2024-09-12T00:53:41.521 INFO:tasks.workunit.client.0.smithi073.stderr: -221> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f82acb0) adding con mode: crc 2024-09-12T00:53:41.521 INFO:tasks.workunit.client.0.smithi073.stderr: -220> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f82acb0) adding con mode: secure 2024-09-12T00:53:41.521 INFO:tasks.workunit.client.0.smithi073.stderr: -219> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f82acb0) adding con mode: crc 2024-09-12T00:53:41.521 INFO:tasks.workunit.client.0.smithi073.stderr: -218> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f82acb0) adding con mode: crc 2024-09-12T00:53:41.521 INFO:tasks.workunit.client.0.smithi073.stderr: -217> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f82acb0) adding con mode: secure 2024-09-12T00:53:41.521 INFO:tasks.workunit.client.0.smithi073.stderr: -216> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f82acb0) adding con mode: crc 2024-09-12T00:53:41.521 INFO:tasks.workunit.client.0.smithi073.stderr: -215> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f82acb0) adding con mode: secure 2024-09-12T00:53:41.521 INFO:tasks.workunit.client.0.smithi073.stderr: -214> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f82acb0) adding con mode: crc 2024-09-12T00:53:41.521 INFO:tasks.workunit.client.0.smithi073.stderr: -213> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f82acb0) adding con mode: secure 2024-09-12T00:53:41.521 INFO:tasks.workunit.client.0.smithi073.stderr: -212> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:41.521 INFO:tasks.workunit.client.0.smithi073.stderr: -211> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 1 librados: starting msgr at 2024-09-12T00:53:41.522 INFO:tasks.workunit.client.0.smithi073.stderr: -210> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 1 librados: starting objecter 2024-09-12T00:53:41.522 INFO:tasks.workunit.client.0.smithi073.stderr: -209> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 asok(0x55b28f546630) register_command objecter_requests cmddesc objecter_requests hook 0x55b28f8087f0 EEXIST 2024-09-12T00:53:41.522 INFO:tasks.workunit.client.0.smithi073.stderr: -208> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 1 librados: setting wanted keys 2024-09-12T00:53:41.522 INFO:tasks.workunit.client.0.smithi073.stderr: -207> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 1 librados: calling monclient init 2024-09-12T00:53:41.522 INFO:tasks.workunit.client.0.smithi073.stderr: -206> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 10 monclient: init 2024-09-12T00:53:41.522 INFO:tasks.workunit.client.0.smithi073.stderr: -205> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7fc440) adding auth protocol: cephx 2024-09-12T00:53:41.522 INFO:tasks.workunit.client.0.smithi073.stderr: -204> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7fc440) adding auth protocol: cephx 2024-09-12T00:53:41.522 INFO:tasks.workunit.client.0.smithi073.stderr: -203> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7fc440) adding auth protocol: cephx 2024-09-12T00:53:41.522 INFO:tasks.workunit.client.0.smithi073.stderr: -202> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7fc440) adding con mode: secure 2024-09-12T00:53:41.522 INFO:tasks.workunit.client.0.smithi073.stderr: -201> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7fc440) adding con mode: crc 2024-09-12T00:53:41.522 INFO:tasks.workunit.client.0.smithi073.stderr: -200> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7fc440) adding con mode: secure 2024-09-12T00:53:41.522 INFO:tasks.workunit.client.0.smithi073.stderr: -199> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7fc440) adding con mode: crc 2024-09-12T00:53:41.523 INFO:tasks.workunit.client.0.smithi073.stderr: -198> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7fc440) adding con mode: secure 2024-09-12T00:53:41.523 INFO:tasks.workunit.client.0.smithi073.stderr: -197> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7fc440) adding con mode: crc 2024-09-12T00:53:41.523 INFO:tasks.workunit.client.0.smithi073.stderr: -196> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7fc440) adding con mode: crc 2024-09-12T00:53:41.523 INFO:tasks.workunit.client.0.smithi073.stderr: -195> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7fc440) adding con mode: secure 2024-09-12T00:53:41.523 INFO:tasks.workunit.client.0.smithi073.stderr: -194> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7fc440) adding con mode: crc 2024-09-12T00:53:41.523 INFO:tasks.workunit.client.0.smithi073.stderr: -193> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7fc440) adding con mode: secure 2024-09-12T00:53:41.523 INFO:tasks.workunit.client.0.smithi073.stderr: -192> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7fc440) adding con mode: crc 2024-09-12T00:53:41.523 INFO:tasks.workunit.client.0.smithi073.stderr: -191> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 AuthRegistry(0x55b28f7fc440) adding con mode: secure 2024-09-12T00:53:41.523 INFO:tasks.workunit.client.0.smithi073.stderr: -190> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:41.523 INFO:tasks.workunit.client.0.smithi073.stderr: -189> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:41.523 INFO:tasks.workunit.client.0.smithi073.stderr: -188> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 5 asok(0x55b28f546630) register_command rotate-key cmddesc rotate-key hook 0x55b28f7fc588 EEXIST 2024-09-12T00:53:41.523 INFO:tasks.workunit.client.0.smithi073.stderr: -187> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 10 monclient: _reopen_session rank -1 2024-09-12T00:53:41.524 INFO:tasks.workunit.client.0.smithi073.stderr: -186> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:53:41.524 INFO:tasks.workunit.client.0.smithi073.stderr: -185> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 10 monclient(hunting): picked mon.noname-a con 0x55b28f809a60 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:53:41.524 INFO:tasks.workunit.client.0.smithi073.stderr: -184> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 10 monclient(hunting): picked mon.noname-b con 0x55b28f8343b0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:53:41.524 INFO:tasks.workunit.client.0.smithi073.stderr: -183> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 10 monclient(hunting): picked mon.noname-c con 0x55b28f838b10 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:53:41.524 INFO:tasks.workunit.client.0.smithi073.stderr: -182> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:41.524 INFO:tasks.workunit.client.0.smithi073.stderr: -181> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:41.524 INFO:tasks.workunit.client.0.smithi073.stderr: -180> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:41.524 INFO:tasks.workunit.client.0.smithi073.stderr: -179> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 10 monclient(hunting): _renew_subs 2024-09-12T00:53:41.524 INFO:tasks.workunit.client.0.smithi073.stderr: -178> 2024-09-12T00:53:40.949+0000 7fb9a7a20800 10 monclient(hunting): authenticate will time out at 2281.619954s 2024-09-12T00:53:41.524 INFO:tasks.workunit.client.0.smithi073.stderr: -177> 2024-09-12T00:53:40.950+0000 7fb9a550a640 10 monclient(hunting): get_auth_request con 0x55b28f809a60 auth_method 0 2024-09-12T00:53:41.524 INFO:tasks.workunit.client.0.smithi073.stderr: -176> 2024-09-12T00:53:40.950+0000 7fb9a550a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:41.524 INFO:tasks.workunit.client.0.smithi073.stderr: -175> 2024-09-12T00:53:40.950+0000 7fb9a550a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:41.524 INFO:tasks.workunit.client.0.smithi073.stderr: -174> 2024-09-12T00:53:40.950+0000 7fb9a550a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:41.525 INFO:tasks.workunit.client.0.smithi073.stderr: -173> 2024-09-12T00:53:40.950+0000 7fb9a5d0b640 10 monclient(hunting): get_auth_request con 0x55b28f838b10 auth_method 0 2024-09-12T00:53:41.525 INFO:tasks.workunit.client.0.smithi073.stderr: -172> 2024-09-12T00:53:40.950+0000 7fb9a5d0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:41.525 INFO:tasks.workunit.client.0.smithi073.stderr: -171> 2024-09-12T00:53:40.950+0000 7fb9a5d0b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:41.525 INFO:tasks.workunit.client.0.smithi073.stderr: -170> 2024-09-12T00:53:40.950+0000 7fb9a5d0b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:41.525 INFO:tasks.workunit.client.0.smithi073.stderr: -169> 2024-09-12T00:53:40.950+0000 7fb9a550a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:41.525 INFO:tasks.workunit.client.0.smithi073.stderr: -168> 2024-09-12T00:53:40.950+0000 7fb9a550a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:41.525 INFO:tasks.workunit.client.0.smithi073.stderr: -167> 2024-09-12T00:53:40.950+0000 7fb9a550a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:41.525 INFO:tasks.workunit.client.0.smithi073.stderr: -166> 2024-09-12T00:53:40.950+0000 7fb9a5d0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:41.525 INFO:tasks.workunit.client.0.smithi073.stderr: -165> 2024-09-12T00:53:40.950+0000 7fb9a5d0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:41.525 INFO:tasks.workunit.client.0.smithi073.stderr: -164> 2024-09-12T00:53:40.950+0000 7fb9a5d0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:41.525 INFO:tasks.workunit.client.0.smithi073.stderr: -163> 2024-09-12T00:53:40.950+0000 7fb99cd09640 10 monclient(hunting): get_auth_request con 0x55b28f8343b0 auth_method 0 2024-09-12T00:53:41.525 INFO:tasks.workunit.client.0.smithi073.stderr: -162> 2024-09-12T00:53:40.950+0000 7fb99cd09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:41.525 INFO:tasks.workunit.client.0.smithi073.stderr: -161> 2024-09-12T00:53:40.950+0000 7fb99cd09640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:41.525 INFO:tasks.workunit.client.0.smithi073.stderr: -160> 2024-09-12T00:53:40.950+0000 7fb99cd09640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:41.526 INFO:tasks.workunit.client.0.smithi073.stderr: -159> 2024-09-12T00:53:40.950+0000 7fb99cd09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:41.526 INFO:tasks.workunit.client.0.smithi073.stderr: -158> 2024-09-12T00:53:40.950+0000 7fb99cd09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:41.526 INFO:tasks.workunit.client.0.smithi073.stderr: -157> 2024-09-12T00:53:40.950+0000 7fb99cd09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:41.526 INFO:tasks.workunit.client.0.smithi073.stderr: -156> 2024-09-12T00:53:40.950+0000 7fb9a5d0b640 10 monclient(hunting): handle_auth_done global_id 7640 payload 824 2024-09-12T00:53:41.526 INFO:tasks.workunit.client.0.smithi073.stderr: -155> 2024-09-12T00:53:40.950+0000 7fb9a5d0b640 10 monclient: _finish_hunting 0 2024-09-12T00:53:41.526 INFO:tasks.workunit.client.0.smithi073.stderr: -154> 2024-09-12T00:53:40.950+0000 7fb9a5d0b640 1 monclient: found mon.noname-c 2024-09-12T00:53:41.526 INFO:tasks.workunit.client.0.smithi073.stderr: -153> 2024-09-12T00:53:40.950+0000 7fb9a5d0b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.73:3301/0 2024-09-12T00:53:41.526 INFO:tasks.workunit.client.0.smithi073.stderr: -152> 2024-09-12T00:53:40.950+0000 7fb876ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:41.526 INFO:tasks.workunit.client.0.smithi073.stderr: -151> 2024-09-12T00:53:40.950+0000 7fb876ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:53:41.526 INFO:tasks.workunit.client.0.smithi073.stderr: -150> 2024-09-12T00:53:40.950+0000 7fb876ffd640 10 monclient: dump: 2024-09-12T00:53:41.526 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:53:41.526 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:53:41.526 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:41.526 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:41.527 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:41.527 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:53:41.527 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:53:41.527 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:53:41.527 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:53:41.527 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:41.527 INFO:tasks.workunit.client.0.smithi073.stderr: -149> 2024-09-12T00:53:40.950+0000 7fb876ffd640 10 monclient: _finish_auth 0 2024-09-12T00:53:41.527 INFO:tasks.workunit.client.0.smithi073.stderr: -148> 2024-09-12T00:53:40.950+0000 7fb876ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:53:41.527 INFO:tasks.workunit.client.0.smithi073.stderr: -147> 2024-09-12T00:53:40.950+0000 7fb876ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:53:41.527 INFO:tasks.workunit.client.0.smithi073.stderr: -146> 2024-09-12T00:53:40.950+0000 7fb876ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:41.527 INFO:tasks.workunit.client.0.smithi073.stderr: -145> 2024-09-12T00:53:40.950+0000 7fb876ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:53:41.527 INFO:tasks.workunit.client.0.smithi073.stderr: -144> 2024-09-12T00:53:40.950+0000 7fb876ffd640 10 monclient: dump: 2024-09-12T00:53:41.527 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:53:41.528 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:53:41.528 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:41.528 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:53:41.528 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:41.528 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:53:41.528 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:53:41.528 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:53:41.528 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:53:41.529 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:41.529 INFO:tasks.workunit.client.0.smithi073.stderr: -143> 2024-09-12T00:53:40.950+0000 7fb9a7a20800 5 monclient: authenticate success, global_id 7640 2024-09-12T00:53:41.529 INFO:tasks.workunit.client.0.smithi073.stderr: -142> 2024-09-12T00:53:40.950+0000 7fb9a7a20800 10 monclient: _renew_subs 2024-09-12T00:53:41.529 INFO:tasks.workunit.client.0.smithi073.stderr: -141> 2024-09-12T00:53:40.950+0000 7fb888ff9640 4 set_mon_vals no callback set 2024-09-12T00:53:41.529 INFO:tasks.workunit.client.0.smithi073.stderr: -140> 2024-09-12T00:53:40.950+0000 7fb9a7a20800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:53:41.529 INFO:tasks.workunit.client.0.smithi073.stderr: -139> 2024-09-12T00:53:40.950+0000 7fb9a7a20800 10 monclient: _renew_subs 2024-09-12T00:53:41.529 INFO:tasks.workunit.client.0.smithi073.stderr: -138> 2024-09-12T00:53:40.950+0000 7fb9a7a20800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:53:41.529 INFO:tasks.workunit.client.0.smithi073.stderr: -137> 2024-09-12T00:53:40.950+0000 7fb9a7a20800 1 librados: init done 2024-09-12T00:53:41.529 INFO:tasks.workunit.client.0.smithi073.stderr: -136> 2024-09-12T00:53:40.950+0000 7fb9a7a20800 5 asok(0x55b28f546630) register_command cr dump hook 0x55b28f830c18 2024-09-12T00:53:41.529 INFO:tasks.workunit.client.0.smithi073.stderr: -135> 2024-09-12T00:53:40.952+0000 7fb9a7a20800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.530 INFO:tasks.workunit.client.0.smithi073.stderr: -134> 2024-09-12T00:53:40.953+0000 7fb876ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:53:41.530 INFO:tasks.workunit.client.0.smithi073.stderr: -133> 2024-09-12T00:53:40.953+0000 7fb876ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:53:41.530 INFO:tasks.workunit.client.0.smithi073.stderr: -132> 2024-09-12T00:53:40.953+0000 7fb876ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:53:41.530 INFO:tasks.workunit.client.0.smithi073.stderr: -131> 2024-09-12T00:53:40.953+0000 7fb9a550a640 10 monclient: get_auth_request con 0x7fb870076470 auth_method 0 2024-09-12T00:53:41.530 INFO:tasks.workunit.client.0.smithi073.stderr: -130> 2024-09-12T00:53:40.953+0000 7fb99cd09640 10 monclient: get_auth_request con 0x55b28f853370 auth_method 0 2024-09-12T00:53:41.530 INFO:tasks.workunit.client.0.smithi073.stderr: -129> 2024-09-12T00:53:40.954+0000 7fb9a7a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:41.530 INFO:tasks.workunit.client.0.smithi073.stderr: -128> 2024-09-12T00:53:40.954+0000 7fb9a7a20800 20 realm 2024-09-12T00:53:41.530 INFO:tasks.workunit.client.0.smithi073.stderr: -127> 2024-09-12T00:53:40.954+0000 7fb9a7a20800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.530 INFO:tasks.workunit.client.0.smithi073.stderr: -126> 2024-09-12T00:53:40.954+0000 7fb9a7a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:41.530 INFO:tasks.workunit.client.0.smithi073.stderr: -125> 2024-09-12T00:53:40.954+0000 7fb9a7a20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:41.530 INFO:tasks.workunit.client.0.smithi073.stderr: -124> 2024-09-12T00:53:40.954+0000 7fb9a7a20800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.530 INFO:tasks.workunit.client.0.smithi073.stderr: -123> 2024-09-12T00:53:40.954+0000 7fb9a7a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:41.530 INFO:tasks.workunit.client.0.smithi073.stderr: -122> 2024-09-12T00:53:40.954+0000 7fb9a7a20800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.531 INFO:tasks.workunit.client.0.smithi073.stderr: -121> 2024-09-12T00:53:40.955+0000 7fb9a550a640 10 monclient: get_auth_request con 0x55b28f857720 auth_method 0 2024-09-12T00:53:41.531 INFO:tasks.workunit.client.0.smithi073.stderr: -120> 2024-09-12T00:53:40.955+0000 7fb9a7a20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:41.531 INFO:tasks.workunit.client.0.smithi073.stderr: -119> 2024-09-12T00:53:40.955+0000 7fb9a7a20800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.531 INFO:tasks.workunit.client.0.smithi073.stderr: -118> 2024-09-12T00:53:40.955+0000 7fb99cd09640 10 monclient: get_auth_request con 0x55b28f85ae90 auth_method 0 2024-09-12T00:53:41.531 INFO:tasks.workunit.client.0.smithi073.stderr: -117> 2024-09-12T00:53:40.956+0000 7fb9a7a20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:41.531 INFO:tasks.workunit.client.0.smithi073.stderr: -116> 2024-09-12T00:53:40.956+0000 7fb9a7a20800 20 searching for the correct realm 2024-09-12T00:53:41.531 INFO:tasks.workunit.client.0.smithi073.stderr: -115> 2024-09-12T00:53:40.956+0000 7fb9a5d0b640 10 monclient: get_auth_request con 0x55b28f85fb90 auth_method 0 2024-09-12T00:53:41.531 INFO:tasks.workunit.client.0.smithi073.stderr: -114> 2024-09-12T00:53:40.957+0000 7fb9a550a640 10 monclient: get_auth_request con 0x7fb9a008e1d0 auth_method 0 2024-09-12T00:53:41.531 INFO:tasks.workunit.client.0.smithi073.stderr: -113> 2024-09-12T00:53:40.958+0000 7fb99cd09640 10 monclient: get_auth_request con 0x7fb998017070 auth_method 0 2024-09-12T00:53:41.531 INFO:tasks.workunit.client.0.smithi073.stderr: -112> 2024-09-12T00:53:40.958+0000 7fb99cd09640 0 -- 172.21.15.73:0/825711095 >> [v2:172.21.15.73:6826/269690776,v1:172.21.15.73:6827/269690776] conn(0x7fb998017070 msgr2=0x7fb99804d3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:41.531 INFO:tasks.workunit.client.0.smithi073.stderr: -111> 2024-09-12T00:53:41.160+0000 7fb99cd09640 10 monclient: get_auth_request con 0x7fb998017070 auth_method 0 2024-09-12T00:53:41.531 INFO:tasks.workunit.client.0.smithi073.stderr: -110> 2024-09-12T00:53:41.160+0000 7fb9a5d0b640 10 monclient: get_auth_request con 0x7fb990073030 auth_method 0 2024-09-12T00:53:41.531 INFO:tasks.workunit.client.0.smithi073.stderr: -109> 2024-09-12T00:53:41.164+0000 7fb9a550a640 0 -- 172.21.15.73:0/825711095 >> [v2:172.21.15.73:6810/1807760270,v1:172.21.15.73:6811/1807760270] conn(0x7fb9a0048fa0 msgr2=0x7fb9a0063630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:41.532 INFO:tasks.workunit.client.0.smithi073.stderr: -108> 2024-09-12T00:53:41.366+0000 7fb9a550a640 10 monclient: get_auth_request con 0x7fb9a0048fa0 auth_method 0 2024-09-12T00:53:41.532 INFO:tasks.workunit.client.0.smithi073.stderr: -107> 2024-09-12T00:53:41.372+0000 7fb9a7a20800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:53:41.532 INFO:tasks.workunit.client.0.smithi073.stderr: -106> 2024-09-12T00:53:41.372+0000 7fb9a7a20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:41.532 INFO:tasks.workunit.client.0.smithi073.stderr: -105> 2024-09-12T00:53:41.372+0000 7fb9a7a20800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:53:41.532 INFO:tasks.workunit.client.0.smithi073.stderr: -104> 2024-09-12T00:53:41.372+0000 7fb9a7a20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:41.532 INFO:tasks.workunit.client.0.smithi073.stderr: -103> 2024-09-12T00:53:41.372+0000 7fb9a7a20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:41.532 INFO:tasks.workunit.client.0.smithi073.stderr: -102> 2024-09-12T00:53:41.372+0000 7fb9a7a20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:41.532 INFO:tasks.workunit.client.0.smithi073.stderr: -101> 2024-09-12T00:53:41.372+0000 7fb9a7a20800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.532 INFO:tasks.workunit.client.0.smithi073.stderr: -100> 2024-09-12T00:53:41.372+0000 7fb9a7a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:41.532 INFO:tasks.workunit.client.0.smithi073.stderr: -99> 2024-09-12T00:53:41.372+0000 7fb9a7a20800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.532 INFO:tasks.workunit.client.0.smithi073.stderr: -98> 2024-09-12T00:53:41.372+0000 7fb9a7a20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:41.532 INFO:tasks.workunit.client.0.smithi073.stderr: -97> 2024-09-12T00:53:41.372+0000 7fb9a7a20800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.532 INFO:tasks.workunit.client.0.smithi073.stderr: -96> 2024-09-12T00:53:41.372+0000 7fb9a7a20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:41.533 INFO:tasks.workunit.client.0.smithi073.stderr: -95> 2024-09-12T00:53:41.372+0000 7fb9a7a20800 20 zone default found 2024-09-12T00:53:41.533 INFO:tasks.workunit.client.0.smithi073.stderr: -94> 2024-09-12T00:53:41.373+0000 7fb9a7a20800 4 Realm: () 2024-09-12T00:53:41.533 INFO:tasks.workunit.client.0.smithi073.stderr: -93> 2024-09-12T00:53:41.373+0000 7fb9a7a20800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:53:41.533 INFO:tasks.workunit.client.0.smithi073.stderr: -92> 2024-09-12T00:53:41.373+0000 7fb9a7a20800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:53:41.533 INFO:tasks.workunit.client.0.smithi073.stderr: -91> 2024-09-12T00:53:41.373+0000 7fb9a7a20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:41.533 INFO:tasks.workunit.client.0.smithi073.stderr: -90> 2024-09-12T00:53:41.373+0000 7fb9a7a20800 20 zonegroup default 2024-09-12T00:53:41.533 INFO:tasks.workunit.client.0.smithi073.stderr: -89> 2024-09-12T00:53:41.373+0000 7fb9a7a20800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.533 INFO:tasks.workunit.client.0.smithi073.stderr: -88> 2024-09-12T00:53:41.373+0000 7fb9a7a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:41.533 INFO:tasks.workunit.client.0.smithi073.stderr: -87> 2024-09-12T00:53:41.373+0000 7fb9a7a20800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.533 INFO:tasks.workunit.client.0.smithi073.stderr: -86> 2024-09-12T00:53:41.373+0000 7fb9a7a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:41.533 INFO:tasks.workunit.client.0.smithi073.stderr: -85> 2024-09-12T00:53:41.373+0000 7fb9a7a20800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.533 INFO:tasks.workunit.client.0.smithi073.stderr: -84> 2024-09-12T00:53:41.373+0000 7fb9a7a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:41.533 INFO:tasks.workunit.client.0.smithi073.stderr: -83> 2024-09-12T00:53:41.373+0000 7fb9a7a20800 20 started sync module instance, tier type = 2024-09-12T00:53:41.534 INFO:tasks.workunit.client.0.smithi073.stderr: -82> 2024-09-12T00:53:41.373+0000 7fb9a7a20800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:53:41.534 INFO:tasks.workunit.client.0.smithi073.stderr: -81> 2024-09-12T00:53:41.384+0000 7fb9a7a20800 20 add_watcher() i=0 2024-09-12T00:53:41.534 INFO:tasks.workunit.client.0.smithi073.stderr: -80> 2024-09-12T00:53:41.384+0000 7fb9a7a20800 20 add_watcher() i=1 2024-09-12T00:53:41.534 INFO:tasks.workunit.client.0.smithi073.stderr: -79> 2024-09-12T00:53:41.384+0000 7fb9a7a20800 20 add_watcher() i=2 2024-09-12T00:53:41.534 INFO:tasks.workunit.client.0.smithi073.stderr: -78> 2024-09-12T00:53:41.384+0000 7fb9a7a20800 20 add_watcher() i=3 2024-09-12T00:53:41.534 INFO:tasks.workunit.client.0.smithi073.stderr: -77> 2024-09-12T00:53:41.384+0000 7fb9a7a20800 20 add_watcher() i=4 2024-09-12T00:53:41.534 INFO:tasks.workunit.client.0.smithi073.stderr: -76> 2024-09-12T00:53:41.384+0000 7fb9a7a20800 20 add_watcher() i=5 2024-09-12T00:53:41.534 INFO:tasks.workunit.client.0.smithi073.stderr: -75> 2024-09-12T00:53:41.384+0000 7fb9a7a20800 20 add_watcher() i=6 2024-09-12T00:53:41.534 INFO:tasks.workunit.client.0.smithi073.stderr: -74> 2024-09-12T00:53:41.386+0000 7fb9a7a20800 20 add_watcher() i=7 2024-09-12T00:53:41.534 INFO:tasks.workunit.client.0.smithi073.stderr: -73> 2024-09-12T00:53:41.386+0000 7fb9a7a20800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:41.534 INFO:tasks.workunit.client.0.smithi073.stderr: -72> 2024-09-12T00:53:41.387+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd5ba0) adding auth protocol: cephx 2024-09-12T00:53:41.534 INFO:tasks.workunit.client.0.smithi073.stderr: -71> 2024-09-12T00:53:41.387+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd5ba0) adding auth protocol: cephx 2024-09-12T00:53:41.534 INFO:tasks.workunit.client.0.smithi073.stderr: -70> 2024-09-12T00:53:41.387+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd5ba0) adding auth protocol: cephx 2024-09-12T00:53:41.535 INFO:tasks.workunit.client.0.smithi073.stderr: -69> 2024-09-12T00:53:41.387+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd5ba0) adding con mode: secure 2024-09-12T00:53:41.535 INFO:tasks.workunit.client.0.smithi073.stderr: -68> 2024-09-12T00:53:41.387+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd5ba0) adding con mode: crc 2024-09-12T00:53:41.535 INFO:tasks.workunit.client.0.smithi073.stderr: -67> 2024-09-12T00:53:41.387+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd5ba0) adding con mode: secure 2024-09-12T00:53:41.535 INFO:tasks.workunit.client.0.smithi073.stderr: -66> 2024-09-12T00:53:41.387+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd5ba0) adding con mode: crc 2024-09-12T00:53:41.535 INFO:tasks.workunit.client.0.smithi073.stderr: -65> 2024-09-12T00:53:41.387+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd5ba0) adding con mode: secure 2024-09-12T00:53:41.535 INFO:tasks.workunit.client.0.smithi073.stderr: -64> 2024-09-12T00:53:41.387+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd5ba0) adding con mode: crc 2024-09-12T00:53:41.535 INFO:tasks.workunit.client.0.smithi073.stderr: -63> 2024-09-12T00:53:41.387+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd5ba0) adding con mode: crc 2024-09-12T00:53:41.535 INFO:tasks.workunit.client.0.smithi073.stderr: -62> 2024-09-12T00:53:41.387+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd5ba0) adding con mode: secure 2024-09-12T00:53:41.535 INFO:tasks.workunit.client.0.smithi073.stderr: -61> 2024-09-12T00:53:41.387+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd5ba0) adding con mode: crc 2024-09-12T00:53:41.535 INFO:tasks.workunit.client.0.smithi073.stderr: -60> 2024-09-12T00:53:41.387+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd5ba0) adding con mode: secure 2024-09-12T00:53:41.535 INFO:tasks.workunit.client.0.smithi073.stderr: -59> 2024-09-12T00:53:41.387+0000 7fb85b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:41.535 INFO:tasks.workunit.client.0.smithi073.stderr: -58> 2024-09-12T00:53:41.387+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd5ba0) adding con mode: crc 2024-09-12T00:53:41.535 INFO:tasks.workunit.client.0.smithi073.stderr: -57> 2024-09-12T00:53:41.387+0000 7fb9a7a20800 5 AuthRegistry(0x7fff6cdd5ba0) adding con mode: secure 2024-09-12T00:53:41.535 INFO:tasks.workunit.client.0.smithi073.stderr: -56> 2024-09-12T00:53:41.388+0000 7fb9a7a20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:41.535 INFO:tasks.workunit.client.0.smithi073.stderr: -55> 2024-09-12T00:53:41.388+0000 7fb9a7a20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:41.535 INFO:tasks.workunit.client.0.smithi073.stderr: -54> 2024-09-12T00:53:41.388+0000 7fb9a7a20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:41.536 INFO:tasks.workunit.client.0.smithi073.stderr: -53> 2024-09-12T00:53:41.388+0000 7fb9a7a20800 5 asok(0x55b28f546630) register_command cache list hook 0x55b28f831100 2024-09-12T00:53:41.536 INFO:tasks.workunit.client.0.smithi073.stderr: -52> 2024-09-12T00:53:41.388+0000 7fb9a7a20800 5 asok(0x55b28f546630) register_command cache inspect hook 0x55b28f831100 2024-09-12T00:53:41.536 INFO:tasks.workunit.client.0.smithi073.stderr: -51> 2024-09-12T00:53:41.388+0000 7fb9a7a20800 5 asok(0x55b28f546630) register_command cache erase hook 0x55b28f831100 2024-09-12T00:53:41.536 INFO:tasks.workunit.client.0.smithi073.stderr: -50> 2024-09-12T00:53:41.388+0000 7fb9a7a20800 5 asok(0x55b28f546630) register_command cache zap hook 0x55b28f831100 2024-09-12T00:53:41.536 INFO:tasks.workunit.client.0.smithi073.stderr: -49> 2024-09-12T00:53:41.388+0000 7fb9a7a20800 5 note: GC not initialized 2024-09-12T00:53:41.536 INFO:tasks.workunit.client.0.smithi073.stderr: -48> 2024-09-12T00:53:41.388+0000 7fb85a7e4640 20 reqs_thread_entry: start 2024-09-12T00:53:41.536 INFO:tasks.workunit.client.0.smithi073.stderr: -47> 2024-09-12T00:53:41.388+0000 7fb9a7a20800 5 asok(0x55b28f546630) register_command sync trace show hook 0x7fb998004e30 2024-09-12T00:53:41.536 INFO:tasks.workunit.client.0.smithi073.stderr: -46> 2024-09-12T00:53:41.388+0000 7fb9a7a20800 5 asok(0x55b28f546630) register_command sync trace history hook 0x7fb998004e30 2024-09-12T00:53:41.536 INFO:tasks.workunit.client.0.smithi073.stderr: -45> 2024-09-12T00:53:41.388+0000 7fb9a7a20800 5 asok(0x55b28f546630) register_command sync trace active hook 0x7fb998004e30 2024-09-12T00:53:41.536 INFO:tasks.workunit.client.0.smithi073.stderr: -44> 2024-09-12T00:53:41.388+0000 7fb9a7a20800 5 asok(0x55b28f546630) register_command sync trace active_short hook 0x7fb998004e30 2024-09-12T00:53:41.536 INFO:tasks.workunit.client.0.smithi073.stderr: -43> 2024-09-12T00:53:41.388+0000 7fb9a7a20800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:41.536 INFO:tasks.workunit.client.0.smithi073.stderr: -42> 2024-09-12T00:53:41.388+0000 7fb9a7a20800 20 Filter name: none 2024-09-12T00:53:41.536 INFO:tasks.workunit.client.0.smithi073.stderr: -41> 2024-09-12T00:53:41.388+0000 7fb7cbfff640 20 reqs_thread_entry: start 2024-09-12T00:53:41.536 INFO:tasks.workunit.client.0.smithi073.stderr: -40> 2024-09-12T00:53:41.388+0000 7fb9a7a20800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:53:41.537 INFO:tasks.workunit.client.0.smithi073.stderr: -39> 2024-09-12T00:53:41.388+0000 7fb9a7a20800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.537 INFO:tasks.workunit.client.0.smithi073.stderr: -38> 2024-09-12T00:53:41.389+0000 7fb9a7a20800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:53:41.537 INFO:tasks.workunit.client.0.smithi073.stderr: -37> 2024-09-12T00:53:41.389+0000 7fb9a7a20800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:53:41.537 INFO:tasks.workunit.client.0.smithi073.stderr: -36> 2024-09-12T00:53:41.389+0000 7fb9a7a20800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:53:41.537 INFO:tasks.workunit.client.0.smithi073.stderr: -35> 2024-09-12T00:53:41.389+0000 7fb9a7a20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 : miss 2024-09-12T00:53:41.537 INFO:tasks.workunit.client.0.smithi073.stderr: -34> 2024-09-12T00:53:41.389+0000 7fb9a7a20800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.537 INFO:tasks.workunit.client.0.smithi073.stderr: -33> 2024-09-12T00:53:41.389+0000 7fb9a7a20800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:53:41.537 INFO:tasks.workunit.client.0.smithi073.stderr: -32> 2024-09-12T00:53:41.389+0000 7fb9a7a20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:53:41.537 INFO:tasks.workunit.client.0.smithi073.stderr: -31> 2024-09-12T00:53:41.389+0000 7fb9a7a20800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:53:41.537 INFO:tasks.workunit.client.0.smithi073.stderr: -30> 2024-09-12T00:53:41.389+0000 7fb9a7a20800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:53:41.537 INFO:tasks.workunit.client.0.smithi073.stderr: -29> 2024-09-12T00:53:41.389+0000 7fb9a7a20800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:53:41.537 INFO:tasks.workunit.client.0.smithi073.stderr: -28> 2024-09-12T00:53:41.389+0000 7fb9a7a20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 2024-09-12T00:53:41.537 INFO:tasks.workunit.client.0.smithi073.stderr: -27> 2024-09-12T00:53:41.393+0000 7fb9a7a20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:53:41.538 INFO:tasks.workunit.client.0.smithi073.stderr: -26> 2024-09-12T00:53:41.393+0000 7fb9a7a20800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:53:41.538 INFO:tasks.workunit.client.0.smithi073.stderr: -25> 2024-09-12T00:53:41.393+0000 7fb9a7a20800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:53:41.538 INFO:tasks.workunit.client.0.smithi073.stderr: -24> 2024-09-12T00:53:41.393+0000 7fb9a7a20800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17, ofs0, ns] 2024-09-12T00:53:41.538 INFO:tasks.workunit.client.0.smithi073.stderr: -23> 2024-09-12T00:53:41.394+0000 7fb888ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497044 cookie 94225400489776 notifier 7640 bl.length()=827 2024-09-12T00:53:41.538 INFO:tasks.workunit.client.0.smithi073.stderr: -22> 2024-09-12T00:53:41.394+0000 7fb888ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:53:41.538 INFO:tasks.workunit.client.0.smithi073.stderr: -21> 2024-09-12T00:53:41.394+0000 7fb888ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:53:41.538 INFO:tasks.workunit.client.0.smithi073.stderr: -20> 2024-09-12T00:53:41.394+0000 7fb888ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:53:41.538 INFO:tasks.workunit.client.0.smithi073.stderr: -19> 2024-09-12T00:53:41.395+0000 7fb9a7a20800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): orig_sources= new_sources= 2024-09-12T00:53:41.538 INFO:tasks.workunit.client.0.smithi073.stderr: -18> 2024-09-12T00:53:41.395+0000 7fb9a7a20800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): potential sources added=[] removed=[] 2024-09-12T00:53:41.538 INFO:tasks.workunit.client.0.smithi073.stderr: -17> 2024-09-12T00:53:41.395+0000 7fb9a7a20800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): orig_dests= new_dests= 2024-09-12T00:53:41.538 INFO:tasks.workunit.client.0.smithi073.stderr: -16> 2024-09-12T00:53:41.395+0000 7fb9a7a20800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): potential dests added=[] removed=[] 2024-09-12T00:53:41.538 INFO:tasks.workunit.client.0.smithi073.stderr: -15> 2024-09-12T00:53:41.398+0000 7fb9a7a20800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.3.0 2024-09-12T00:53:41.538 INFO:tasks.workunit.client.0.smithi073.stderr: -14> 2024-09-12T00:53:41.398+0000 7fb9a7a20800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.3.0 2024-09-12T00:53:41.539 INFO:tasks.workunit.client.0.smithi073.stderr: -13> 2024-09-12T00:53:41.398+0000 7fb9a7a20800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.3.1 2024-09-12T00:53:41.539 INFO:tasks.workunit.client.0.smithi073.stderr: -12> 2024-09-12T00:53:41.398+0000 7fb9a7a20800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.3.1 2024-09-12T00:53:41.539 INFO:tasks.workunit.client.0.smithi073.stderr: -11> 2024-09-12T00:53:41.398+0000 7fb9a7a20800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.3.2 2024-09-12T00:53:41.539 INFO:tasks.workunit.client.0.smithi073.stderr: -10> 2024-09-12T00:53:41.398+0000 7fb9a7a20800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.3.2 2024-09-12T00:53:41.539 INFO:tasks.workunit.client.0.smithi073.stderr: -9> 2024-09-12T00:53:41.398+0000 7fb9a7a20800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.3.3 2024-09-12T00:53:41.539 INFO:tasks.workunit.client.0.smithi073.stderr: -8> 2024-09-12T00:53:41.398+0000 7fb9a7a20800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.3.3 2024-09-12T00:53:41.539 INFO:tasks.workunit.client.0.smithi073.stderr: -7> 2024-09-12T00:53:41.398+0000 7fb9a7a20800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.0 2024-09-12T00:53:41.539 INFO:tasks.workunit.client.0.smithi073.stderr: -6> 2024-09-12T00:53:41.398+0000 7fb9a7a20800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.0 2024-09-12T00:53:41.539 INFO:tasks.workunit.client.0.smithi073.stderr: -5> 2024-09-12T00:53:41.399+0000 7fb9a7a20800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.1 2024-09-12T00:53:41.539 INFO:tasks.workunit.client.0.smithi073.stderr: -4> 2024-09-12T00:53:41.399+0000 7fb9a7a20800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.1 2024-09-12T00:53:41.539 INFO:tasks.workunit.client.0.smithi073.stderr: -3> 2024-09-12T00:53:41.399+0000 7fb9a7a20800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.2 2024-09-12T00:53:41.539 INFO:tasks.workunit.client.0.smithi073.stderr: -2> 2024-09-12T00:53:41.399+0000 7fb9a7a20800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.2 2024-09-12T00:53:41.539 INFO:tasks.workunit.client.0.smithi073.stderr: -1> 2024-09-12T00:53:41.402+0000 7fb9a7a20800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb9a7a20800 time 2024-09-12T00:53:41.402040+0000 2024-09-12T00:53:41.540 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:53:41.540 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:41.540 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:53:41.540 INFO:tasks.workunit.client.0.smithi073.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fb9aaf8c71a] 2024-09-12T00:53:41.540 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fb9aaf8c8d8] 2024-09-12T00:53:41.540 INFO:tasks.workunit.client.0.smithi073.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b28e43f641] 2024-09-12T00:53:41.540 INFO:tasks.workunit.client.0.smithi073.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55b28e44e51b] 2024-09-12T00:53:41.540 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55b28e44f3e4] 2024-09-12T00:53:41.540 INFO:tasks.workunit.client.0.smithi073.stderr: 6: main() 2024-09-12T00:53:41.540 INFO:tasks.workunit.client.0.smithi073.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fb9a9c29590] 2024-09-12T00:53:41.540 INFO:tasks.workunit.client.0.smithi073.stderr: 8: __libc_start_main() 2024-09-12T00:53:41.541 INFO:tasks.workunit.client.0.smithi073.stderr: 9: _start() 2024-09-12T00:53:41.541 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:41.541 INFO:tasks.workunit.client.0.smithi073.stderr: 0> 2024-09-12T00:53:41.402+0000 7fb9a7a20800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:53:41.541 INFO:tasks.workunit.client.0.smithi073.stderr: in thread 7fb9a7a20800 thread_name:radosgw-admin 2024-09-12T00:53:41.541 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:41.541 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:53:41.541 INFO:tasks.workunit.client.0.smithi073.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fb9a9c3e6f0] 2024-09-12T00:53:41.541 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fb9a9c8b99c] 2024-09-12T00:53:41.541 INFO:tasks.workunit.client.0.smithi073.stderr: 3: raise() 2024-09-12T00:53:41.541 INFO:tasks.workunit.client.0.smithi073.stderr: 4: abort() 2024-09-12T00:53:41.541 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fb9aaf8c774] 2024-09-12T00:53:41.541 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fb9aaf8c8d8] 2024-09-12T00:53:41.541 INFO:tasks.workunit.client.0.smithi073.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b28e43f641] 2024-09-12T00:53:41.541 INFO:tasks.workunit.client.0.smithi073.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55b28e44e51b] 2024-09-12T00:53:41.542 INFO:tasks.workunit.client.0.smithi073.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55b28e44f3e4] 2024-09-12T00:53:41.542 INFO:tasks.workunit.client.0.smithi073.stderr: 10: main() 2024-09-12T00:53:41.542 INFO:tasks.workunit.client.0.smithi073.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fb9a9c29590] 2024-09-12T00:53:41.542 INFO:tasks.workunit.client.0.smithi073.stderr: 12: __libc_start_main() 2024-09-12T00:53:41.542 INFO:tasks.workunit.client.0.smithi073.stderr: 13: _start() 2024-09-12T00:53:41.542 INFO:tasks.workunit.client.0.smithi073.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:53:41.542 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:53:41.542 INFO:tasks.workunit.client.0.smithi073.stderr:--- logging levels --- 2024-09-12T00:53:41.542 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 none 2024-09-12T00:53:41.542 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 lockdep 2024-09-12T00:53:41.542 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 context 2024-09-12T00:53:41.542 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 crush 2024-09-12T00:53:41.542 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds 2024-09-12T00:53:41.542 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_balancer 2024-09-12T00:53:41.542 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_locker 2024-09-12T00:53:41.543 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_log 2024-09-12T00:53:41.543 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_log_expire 2024-09-12T00:53:41.543 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_migrator 2024-09-12T00:53:41.543 INFO:tasks.workunit.client.0.smithi073.stderr: 3/ 5 mds_quiesce 2024-09-12T00:53:41.543 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 buffer 2024-09-12T00:53:41.543 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 timer 2024-09-12T00:53:41.543 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 filer 2024-09-12T00:53:41.543 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 striper 2024-09-12T00:53:41.543 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 objecter 2024-09-12T00:53:41.543 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rados 2024-09-12T00:53:41.543 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd 2024-09-12T00:53:41.543 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_mirror 2024-09-12T00:53:41.543 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_replay 2024-09-12T00:53:41.543 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_pwl 2024-09-12T00:53:41.543 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 journaler 2024-09-12T00:53:41.544 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 objectcacher 2024-09-12T00:53:41.544 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:53:41.544 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 client 2024-09-12T00:53:41.544 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 osd 2024-09-12T00:53:41.544 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 optracker 2024-09-12T00:53:41.544 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 objclass 2024-09-12T00:53:41.544 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 filestore 2024-09-12T00:53:41.544 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 journal 2024-09-12T00:53:41.544 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 0 ms 2024-09-12T00:53:41.544 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mon 2024-09-12T00:53:41.544 INFO:tasks.workunit.client.0.smithi073.stderr: 0/10 monc 2024-09-12T00:53:41.544 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 paxos 2024-09-12T00:53:41.544 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 tp 2024-09-12T00:53:41.544 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 auth 2024-09-12T00:53:41.545 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 crypto 2024-09-12T00:53:41.545 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 finisher 2024-09-12T00:53:41.545 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 reserver 2024-09-12T00:53:41.545 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 heartbeatmap 2024-09-12T00:53:41.545 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 perfcounter 2024-09-12T00:53:41.545 INFO:tasks.workunit.client.0.smithi073.stderr: 20/20 rgw 2024-09-12T00:53:41.545 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_sync 2024-09-12T00:53:41.545 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_datacache 2024-09-12T00:53:41.545 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_access 2024-09-12T00:53:41.545 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:53:41.545 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_flight 2024-09-12T00:53:41.545 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:53:41.545 INFO:tasks.workunit.client.0.smithi073.stderr: 20/20 rgw_notification 2024-09-12T00:53:41.545 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 javaclient 2024-09-12T00:53:41.545 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 asok 2024-09-12T00:53:41.546 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 throttle 2024-09-12T00:53:41.546 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 0 refs 2024-09-12T00:53:41.546 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 compressor 2024-09-12T00:53:41.546 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 bluestore 2024-09-12T00:53:41.546 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 bluefs 2024-09-12T00:53:41.546 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 bdev 2024-09-12T00:53:41.546 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 kstore 2024-09-12T00:53:41.546 INFO:tasks.workunit.client.0.smithi073.stderr: 4/ 5 rocksdb 2024-09-12T00:53:41.546 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 fuse 2024-09-12T00:53:41.546 INFO:tasks.workunit.client.0.smithi073.stderr: 2/ 5 mgr 2024-09-12T00:53:41.546 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mgrc 2024-09-12T00:53:41.546 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 dpdk 2024-09-12T00:53:41.546 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 eventtrace 2024-09-12T00:53:41.546 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 prioritycache 2024-09-12T00:53:41.546 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 test 2024-09-12T00:53:41.546 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:53:41.547 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cephsqlite 2024-09-12T00:53:41.547 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:53:41.547 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore 2024-09-12T00:53:41.547 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_onode 2024-09-12T00:53:41.547 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_odata 2024-09-12T00:53:41.547 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_omap 2024-09-12T00:53:41.547 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_tm 2024-09-12T00:53:41.547 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_t 2024-09-12T00:53:41.547 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:53:41.547 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_epm 2024-09-12T00:53:41.547 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_lba 2024-09-12T00:53:41.547 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:53:41.547 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_cache 2024-09-12T00:53:41.547 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_journal 2024-09-12T00:53:41.547 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_device 2024-09-12T00:53:41.547 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_backref 2024-09-12T00:53:41.548 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 alienstore 2024-09-12T00:53:41.548 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mclock 2024-09-12T00:53:41.548 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cyanstore 2024-09-12T00:53:41.548 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 ceph_exporter 2024-09-12T00:53:41.548 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 memstore 2024-09-12T00:53:41.548 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 trace 2024-09-12T00:53:41.548 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 ceph_dedup 2024-09-12T00:53:41.548 INFO:tasks.workunit.client.0.smithi073.stderr: -2/-2 (syslog threshold) 2024-09-12T00:53:41.548 INFO:tasks.workunit.client.0.smithi073.stderr: 99/99 (stderr threshold) 2024-09-12T00:53:41.548 INFO:tasks.workunit.client.0.smithi073.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:53:41.548 INFO:tasks.workunit.client.0.smithi073.stderr: 7fb7cbfff640 / http_manager 2024-09-12T00:53:41.548 INFO:tasks.workunit.client.0.smithi073.stderr: 7fb85a7e4640 / http_manager 2024-09-12T00:53:41.548 INFO:tasks.workunit.client.0.smithi073.stderr: 7fb85b7e6640 / rgw_dt_lg_renew 2024-09-12T00:53:41.549 INFO:tasks.workunit.client.0.smithi073.stderr: 7fb876ffd640 / ms_dispatch 2024-09-12T00:53:41.549 INFO:tasks.workunit.client.0.smithi073.stderr: 7fb888ff9640 / io_context_pool 2024-09-12T00:53:41.549 INFO:tasks.workunit.client.0.smithi073.stderr: 7fb88affd640 / ms_dispatch 2024-09-12T00:53:41.549 INFO:tasks.workunit.client.0.smithi073.stderr: 7fb891e03640 / ms_dispatch 2024-09-12T00:53:41.549 INFO:tasks.workunit.client.0.smithi073.stderr: 7fb893606640 / io_context_pool 2024-09-12T00:53:41.549 INFO:tasks.workunit.client.0.smithi073.stderr: 7fb99cd09640 / msgr-worker-2 2024-09-12T00:53:41.549 INFO:tasks.workunit.client.0.smithi073.stderr: 7fb9a550a640 / msgr-worker-1 2024-09-12T00:53:41.549 INFO:tasks.workunit.client.0.smithi073.stderr: 7fb9a5d0b640 / msgr-worker-0 2024-09-12T00:53:41.549 INFO:tasks.workunit.client.0.smithi073.stderr: 7fb9a650c640 / io_context_pool 2024-09-12T00:53:41.549 INFO:tasks.workunit.client.0.smithi073.stderr: 7fb9a7a20800 / radosgw-admin 2024-09-12T00:53:41.549 INFO:tasks.workunit.client.0.smithi073.stderr: max_recent 500 2024-09-12T00:53:41.550 INFO:tasks.workunit.client.0.smithi073.stderr: max_new 1000 2024-09-12T00:53:41.550 INFO:tasks.workunit.client.0.smithi073.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:53:41.403653Z_3cea0b0b-bd05-420e-b191-b0d9fd4fc01e/log 2024-09-12T00:53:41.550 INFO:tasks.workunit.client.0.smithi073.stderr:--- end dump of recent events --- 2024-09-12T00:53:41.550 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:53:41.551 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:41.552 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:41.552 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.477+0000 7fe415617800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.552 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.479+0000 7fe415617800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:41.552 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.479+0000 7fe415617800 20 realm 2024-09-12T00:53:41.552 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.479+0000 7fe415617800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.552 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.479+0000 7fe415617800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:41.552 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.479+0000 7fe415617800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:41.552 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.479+0000 7fe415617800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.552 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.479+0000 7fe415617800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:41.552 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.479+0000 7fe415617800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.552 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.480+0000 7fe415617800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:41.553 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.480+0000 7fe415617800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.553 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.481+0000 7fe415617800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:41.553 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.481+0000 7fe415617800 20 searching for the correct realm 2024-09-12T00:53:41.553 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.484+0000 7fe4115e8640 0 -- 172.21.15.73:0/658121593 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fe3f8076b20 msgr2=0x7fe3f808d390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:53:41.690 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.691+0000 7fe4115e8640 0 -- 172.21.15.73:0/658121593 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fe3f8076b20 msgr2=0x7fe3f808d390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:41.694 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.695+0000 7fe415617800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:53:41.694 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.695+0000 7fe415617800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:41.694 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.695+0000 7fe415617800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:53:41.694 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.695+0000 7fe415617800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:41.694 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.695+0000 7fe415617800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:41.694 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.695+0000 7fe415617800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:41.694 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.695+0000 7fe415617800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.695 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.695+0000 7fe415617800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:41.695 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.695+0000 7fe415617800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.696 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.696+0000 7fe415617800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:41.696 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.696+0000 7fe415617800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.696 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.696+0000 7fe415617800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:41.697 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.696+0000 7fe415617800 20 zone default found 2024-09-12T00:53:41.697 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.696+0000 7fe415617800 4 Realm: () 2024-09-12T00:53:41.697 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.696+0000 7fe415617800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:53:41.697 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.696+0000 7fe415617800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:53:41.697 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.696+0000 7fe415617800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:41.697 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.696+0000 7fe415617800 20 zonegroup default 2024-09-12T00:53:41.697 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.696+0000 7fe415617800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.697 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.696+0000 7fe415617800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:41.697 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.696+0000 7fe415617800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.697 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.697+0000 7fe415617800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:41.697 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.697+0000 7fe415617800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.697 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.697+0000 7fe415617800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:41.698 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.697+0000 7fe415617800 20 started sync module instance, tier type = 2024-09-12T00:53:41.698 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.697+0000 7fe415617800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:53:41.705 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.706+0000 7fe415617800 20 add_watcher() i=0 2024-09-12T00:53:41.705 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.706+0000 7fe415617800 20 add_watcher() i=1 2024-09-12T00:53:41.705 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.706+0000 7fe415617800 20 add_watcher() i=2 2024-09-12T00:53:41.705 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.706+0000 7fe415617800 20 add_watcher() i=3 2024-09-12T00:53:41.705 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.706+0000 7fe415617800 20 add_watcher() i=4 2024-09-12T00:53:41.706 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.706+0000 7fe415617800 20 add_watcher() i=5 2024-09-12T00:53:41.706 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.706+0000 7fe415617800 20 add_watcher() i=6 2024-09-12T00:53:41.706 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.707+0000 7fe415617800 20 add_watcher() i=7 2024-09-12T00:53:41.706 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.707+0000 7fe415617800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:41.708 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.709+0000 7fe2c6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:41.709 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.710+0000 7fe415617800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:41.709 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.710+0000 7fe415617800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:41.709 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.710+0000 7fe415617800 5 note: GC not initialized 2024-09-12T00:53:41.710 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.710+0000 7fe2c5fe3640 20 reqs_thread_entry: start 2024-09-12T00:53:41.710 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.710+0000 7fe415617800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:41.710 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.710+0000 7fe415617800 20 Filter name: none 2024-09-12T00:53:41.710 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.710+0000 7fe2377fe640 20 reqs_thread_entry: start 2024-09-12T00:53:41.710 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.710+0000 7fe415617800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.710 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.711+0000 7fe415617800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:53:41.710 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.711+0000 7fe415617800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.711 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.711+0000 7fe415617800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:53:41.711 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.711+0000 7fe415617800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:41.711 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.711+0000 7fe415617800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.711 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.712+0000 7fe415617800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:53:41.711 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.712+0000 7fe415617800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.711 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.712+0000 7fe415617800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:53:41.711 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.712+0000 7fe415617800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:41.712 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.713+0000 7fe2c6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:41.714 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.716+0000 7fe415617800 20 remove_watcher() i=0 2024-09-12T00:53:41.714 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.716+0000 7fe415617800 2 removed watcher, disabling cache 2024-09-12T00:53:41.716 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.717+0000 7fe415617800 20 remove_watcher() i=1 2024-09-12T00:53:41.717 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.718+0000 7fe415617800 20 remove_watcher() i=2 2024-09-12T00:53:41.718 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.719+0000 7fe415617800 20 remove_watcher() i=3 2024-09-12T00:53:41.719 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.720+0000 7fe415617800 20 remove_watcher() i=4 2024-09-12T00:53:41.720 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.721+0000 7fe415617800 20 remove_watcher() i=5 2024-09-12T00:53:41.720 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.722+0000 7fe415617800 20 remove_watcher() i=6 2024-09-12T00:53:41.721 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.723+0000 7fe415617800 20 remove_watcher() i=7 2024-09-12T00:53:41.734 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:41.734 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:53:41.770 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:53:41.798 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:41.798 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:41.836 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.837+0000 7fbd3cf39800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.837 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.838+0000 7fbd3cf39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:41.837 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.838+0000 7fbd3cf39800 20 realm 2024-09-12T00:53:41.837 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.838+0000 7fbd3cf39800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.838 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.839+0000 7fbd3cf39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:41.838 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.839+0000 7fbd3cf39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:41.838 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.839+0000 7fbd3cf39800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.838 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.839+0000 7fbd3cf39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:41.838 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.839+0000 7fbd3cf39800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.838 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.840+0000 7fbd3cf39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:41.839 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.840+0000 7fbd3cf39800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.839 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.841+0000 7fbd3cf39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:41.839 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.841+0000 7fbd3cf39800 20 searching for the correct realm 2024-09-12T00:53:41.842 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.843+0000 7fbd393c8640 0 -- 172.21.15.73:0/2710005589 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fbd24069310 msgr2=0x7fbd24067d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:41.846 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.847+0000 7fbd393c8640 0 -- 172.21.15.73:0/2710005589 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fbc04086310 msgr2=0x7fbc04088740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:41.850 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.851+0000 7fbd3cf39800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:53:41.850 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.851+0000 7fbd3cf39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:41.850 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.851+0000 7fbd3cf39800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:53:41.850 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.851+0000 7fbd3cf39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:41.850 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.851+0000 7fbd3cf39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:41.851 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.851+0000 7fbd3cf39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:41.851 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.851+0000 7fbd3cf39800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.851 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.851+0000 7fbd3cf39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:41.851 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.851+0000 7fbd3cf39800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.851 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.851+0000 7fbd3cf39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:41.851 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.851+0000 7fbd3cf39800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.851 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.851+0000 7fbd3cf39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:41.851 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.851+0000 7fbd3cf39800 20 zone default found 2024-09-12T00:53:41.851 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.851+0000 7fbd3cf39800 4 Realm: () 2024-09-12T00:53:41.851 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.851+0000 7fbd3cf39800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:53:41.851 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.851+0000 7fbd3cf39800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:53:41.851 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.851+0000 7fbd3cf39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:41.852 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.851+0000 7fbd3cf39800 20 zonegroup default 2024-09-12T00:53:41.852 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.851+0000 7fbd3cf39800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.852 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.852+0000 7fbd3cf39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:41.852 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.852+0000 7fbd3cf39800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.853 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.852+0000 7fbd3cf39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:41.853 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.852+0000 7fbd3cf39800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.853 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.852+0000 7fbd3cf39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:41.853 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.852+0000 7fbd3cf39800 20 started sync module instance, tier type = 2024-09-12T00:53:41.853 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.852+0000 7fbd3cf39800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:53:41.861 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.862+0000 7fbd3cf39800 20 add_watcher() i=0 2024-09-12T00:53:41.861 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.862+0000 7fbd3cf39800 20 add_watcher() i=1 2024-09-12T00:53:41.861 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.862+0000 7fbd3cf39800 20 add_watcher() i=2 2024-09-12T00:53:41.861 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.862+0000 7fbd3cf39800 20 add_watcher() i=3 2024-09-12T00:53:41.861 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.862+0000 7fbd3cf39800 20 add_watcher() i=4 2024-09-12T00:53:41.861 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.862+0000 7fbd3cf39800 20 add_watcher() i=5 2024-09-12T00:53:41.861 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.862+0000 7fbd3cf39800 20 add_watcher() i=6 2024-09-12T00:53:41.862 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.863+0000 7fbd3cf39800 20 add_watcher() i=7 2024-09-12T00:53:41.862 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.863+0000 7fbd3cf39800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:41.863 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.865+0000 7fbbeefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:41.865 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.865+0000 7fbd3cf39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:41.865 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.865+0000 7fbd3cf39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:41.865 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.865+0000 7fbd3cf39800 5 note: GC not initialized 2024-09-12T00:53:41.865 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.865+0000 7fbbedfe3640 20 reqs_thread_entry: start 2024-09-12T00:53:41.865 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.865+0000 7fbd3cf39800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:41.866 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.865+0000 7fbd3cf39800 20 Filter name: none 2024-09-12T00:53:41.866 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.865+0000 7fbb5f7fe640 20 reqs_thread_entry: start 2024-09-12T00:53:41.866 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.866+0000 7fbd3cf39800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:53:41.866 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.866+0000 7fbd3cf39800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.866 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.866+0000 7fbd3cf39800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:53:41.866 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.866+0000 7fbd3cf39800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:53:41.866 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.866+0000 7fbd3cf39800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:53:41.866 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.866+0000 7fbd3cf39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 : miss 2024-09-12T00:53:41.866 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.866+0000 7fbd3cf39800 20 rados->read ofs=0 len=0 2024-09-12T00:53:41.866 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.866+0000 7fbd3cf39800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:53:41.866 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.866+0000 7fbd3cf39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:53:41.866 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.866+0000 7fbd3cf39800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:53:41.867 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.866+0000 7fbd3cf39800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:53:41.867 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.866+0000 7fbd3cf39800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:53:41.867 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.866+0000 7fbd3cf39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 2024-09-12T00:53:41.867 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.866+0000 7fbd3cf39800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.0 2024-09-12T00:53:41.867 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.866+0000 7fbd3cf39800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.0 2024-09-12T00:53:41.867 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.867+0000 7fbd3cf39800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.1 2024-09-12T00:53:41.868 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.867+0000 7fbd3cf39800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.1 2024-09-12T00:53:41.868 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.867+0000 7fbd3cf39800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.2 2024-09-12T00:53:41.868 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.867+0000 7fbd3cf39800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.2 2024-09-12T00:53:41.868 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.868+0000 7fbbeefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:41.869 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.871+0000 7fbd3cf39800 20 remove_watcher() i=0 2024-09-12T00:53:41.870 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.871+0000 7fbd3cf39800 2 removed watcher, disabling cache 2024-09-12T00:53:41.870 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.872+0000 7fbd3cf39800 20 remove_watcher() i=1 2024-09-12T00:53:41.871 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.873+0000 7fbd3cf39800 20 remove_watcher() i=2 2024-09-12T00:53:41.872 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.874+0000 7fbd3cf39800 20 remove_watcher() i=3 2024-09-12T00:53:41.873 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.875+0000 7fbd3cf39800 20 remove_watcher() i=4 2024-09-12T00:53:41.874 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.875+0000 7fbd3cf39800 20 remove_watcher() i=5 2024-09-12T00:53:41.875 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.876+0000 7fbd3cf39800 20 remove_watcher() i=6 2024-09-12T00:53:41.876 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:53:41.877+0000 7fbd3cf39800 20 remove_watcher() i=7 2024-09-12T00:54:11.917 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:54:11.949 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:11.949 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:11.990 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:11.992+0000 7f3aea135800 20 rados->read ofs=0 len=0 2024-09-12T00:54:11.992 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:11.993+0000 7f3aea135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:11.992 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:11.993+0000 7f3aea135800 20 realm 2024-09-12T00:54:11.992 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:11.993+0000 7f3aea135800 20 rados->read ofs=0 len=0 2024-09-12T00:54:11.992 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:11.994+0000 7f3aea135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:11.992 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:11.994+0000 7f3aea135800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:11.993 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:11.994+0000 7f3aea135800 20 rados->read ofs=0 len=0 2024-09-12T00:54:11.993 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:11.994+0000 7f3aea135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:11.993 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:11.994+0000 7f3aea135800 20 rados->read ofs=0 len=0 2024-09-12T00:54:11.993 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:11.995+0000 7f3aea135800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:11.993 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:11.995+0000 7f3aea135800 20 rados->read ofs=0 len=0 2024-09-12T00:54:11.994 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:11.996+0000 7f3aea135800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:11.994 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:11.996+0000 7f3aea135800 20 searching for the correct realm 2024-09-12T00:54:11.997 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:11.998+0000 7f3ae66e5640 0 -- 172.21.15.73:0/1940623866 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f3adc049ba0 msgr2=0x7f3adc041950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:12.204 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.205+0000 7f3ae66e5640 0 -- 172.21.15.73:0/1940623866 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f3adc049ba0 msgr2=0x7f3adc041950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:12.209 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.210+0000 7f3aea135800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:54:12.209 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.210+0000 7f3aea135800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:12.209 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.210+0000 7f3aea135800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:54:12.209 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.210+0000 7f3aea135800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:12.209 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.210+0000 7f3aea135800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:12.209 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.210+0000 7f3aea135800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:12.209 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.210+0000 7f3aea135800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.209 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.210+0000 7f3aea135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.209 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.210+0000 7f3aea135800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.210 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.211+0000 7f3aea135800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:12.210 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.211+0000 7f3aea135800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.210 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.211+0000 7f3aea135800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:12.210 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.211+0000 7f3aea135800 20 zone default found 2024-09-12T00:54:12.210 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.211+0000 7f3aea135800 4 Realm: () 2024-09-12T00:54:12.210 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.211+0000 7f3aea135800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:54:12.211 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.211+0000 7f3aea135800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:54:12.211 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.211+0000 7f3aea135800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:12.211 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.211+0000 7f3aea135800 20 zonegroup default 2024-09-12T00:54:12.211 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.211+0000 7f3aea135800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.211 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.211+0000 7f3aea135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.211 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.211+0000 7f3aea135800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.211 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.212+0000 7f3aea135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.211 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.212+0000 7f3aea135800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.212 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.212+0000 7f3aea135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.212 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.212+0000 7f3aea135800 20 started sync module instance, tier type = 2024-09-12T00:54:12.212 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.212+0000 7f3aea135800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:54:12.224 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.225+0000 7f3aea135800 20 add_watcher() i=0 2024-09-12T00:54:12.224 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.225+0000 7f3aea135800 20 add_watcher() i=1 2024-09-12T00:54:12.224 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.225+0000 7f3aea135800 20 add_watcher() i=2 2024-09-12T00:54:12.224 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.225+0000 7f3aea135800 20 add_watcher() i=3 2024-09-12T00:54:12.224 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.225+0000 7f3aea135800 20 add_watcher() i=4 2024-09-12T00:54:12.224 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.225+0000 7f3aea135800 20 add_watcher() i=5 2024-09-12T00:54:12.224 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.225+0000 7f3aea135800 20 add_watcher() i=6 2024-09-12T00:54:12.225 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.226+0000 7f3aea135800 20 add_watcher() i=7 2024-09-12T00:54:12.225 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.226+0000 7f3aea135800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:12.227 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.228+0000 7f3997fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:12.228 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.229+0000 7f3aea135800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:12.228 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.229+0000 7f3aea135800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:12.228 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.229+0000 7f3aea135800 5 note: GC not initialized 2024-09-12T00:54:12.228 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.229+0000 7f3996ffd640 20 reqs_thread_entry: start 2024-09-12T00:54:12.228 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.229+0000 7f3aea135800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:12.228 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.229+0000 7f3aea135800 20 Filter name: none 2024-09-12T00:54:12.228 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.229+0000 7f3994ff9640 20 reqs_thread_entry: start 2024-09-12T00:54:12.228 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.229+0000 7f3aea135800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.229 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.230+0000 7f3aea135800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:54:12.229 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.230+0000 7f3aea135800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.229 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.230+0000 7f3aea135800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:54:12.229 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.230+0000 7f3aea135800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:12.229 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.230+0000 7f3aea135800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.230 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.231+0000 7f3aea135800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:54:12.230 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.231+0000 7f3aea135800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.230 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.231+0000 7f3aea135800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:54:12.230 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.231+0000 7f3aea135800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:12.231 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.233+0000 7f3997fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:12.233 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.235+0000 7f3aea135800 20 remove_watcher() i=0 2024-09-12T00:54:12.233 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.235+0000 7f3aea135800 2 removed watcher, disabling cache 2024-09-12T00:54:12.234 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.236+0000 7f3aea135800 20 remove_watcher() i=1 2024-09-12T00:54:12.236 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.237+0000 7f3aea135800 20 remove_watcher() i=2 2024-09-12T00:54:12.237 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.238+0000 7f3aea135800 20 remove_watcher() i=3 2024-09-12T00:54:12.238 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.239+0000 7f3aea135800 20 remove_watcher() i=4 2024-09-12T00:54:12.239 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.240+0000 7f3aea135800 20 remove_watcher() i=5 2024-09-12T00:54:12.240 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.241+0000 7f3aea135800 20 remove_watcher() i=6 2024-09-12T00:54:12.241 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.242+0000 7f3aea135800 20 remove_watcher() i=7 2024-09-12T00:54:12.254 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:54:12.255 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:54:12.324 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:54:12.353 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:12.353 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:12.390 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.391+0000 7f99e792c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.391 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.392+0000 7f99e792c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.392 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.392+0000 7f99e792c800 20 realm 2024-09-12T00:54:12.392 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.392+0000 7f99e792c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.392 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.393+0000 7f99e792c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.392 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.393+0000 7f99e792c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:12.392 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.393+0000 7f99e792c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.392 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.393+0000 7f99e792c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.392 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.393+0000 7f99e792c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.392 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.394+0000 7f99e792c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:12.393 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.394+0000 7f99e792c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.393 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.394+0000 7f99e792c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:12.393 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.394+0000 7f99e792c800 20 searching for the correct realm 2024-09-12T00:54:12.396 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.397+0000 7f99e3eae640 0 -- 172.21.15.73:0/3635861089 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f99cc0612d0 msgr2=0x7f99cc069010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:12.400 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.401+0000 7f99e3eae640 0 -- 172.21.15.73:0/3635861089 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f98ac086210 msgr2=0x7f98ac088640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:12.404 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.405+0000 7f99e792c800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:54:12.404 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.405+0000 7f99e792c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:12.404 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.405+0000 7f99e792c800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:54:12.404 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.405+0000 7f99e792c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:12.404 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.405+0000 7f99e792c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:12.404 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.405+0000 7f99e792c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:12.404 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.405+0000 7f99e792c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.404 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.405+0000 7f99e792c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.404 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.405+0000 7f99e792c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.406 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.406+0000 7f99e792c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:12.406 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.406+0000 7f99e792c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.406 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.406+0000 7f99e792c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:12.406 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.406+0000 7f99e792c800 20 zone default found 2024-09-12T00:54:12.406 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.406+0000 7f99e792c800 4 Realm: () 2024-09-12T00:54:12.406 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.406+0000 7f99e792c800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:54:12.406 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.406+0000 7f99e792c800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:54:12.406 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.406+0000 7f99e792c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:12.406 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.406+0000 7f99e792c800 20 zonegroup default 2024-09-12T00:54:12.406 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.406+0000 7f99e792c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.407 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.406+0000 7f99e792c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.407 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.406+0000 7f99e792c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.407 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.407+0000 7f99e792c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.407 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.407+0000 7f99e792c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.407 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.407+0000 7f99e792c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.407 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.407+0000 7f99e792c800 20 started sync module instance, tier type = 2024-09-12T00:54:12.407 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.407+0000 7f99e792c800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:54:12.415 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.416+0000 7f99e792c800 20 add_watcher() i=0 2024-09-12T00:54:12.415 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.416+0000 7f99e792c800 20 add_watcher() i=1 2024-09-12T00:54:12.415 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.416+0000 7f99e792c800 20 add_watcher() i=2 2024-09-12T00:54:12.415 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.416+0000 7f99e792c800 20 add_watcher() i=3 2024-09-12T00:54:12.415 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.416+0000 7f99e792c800 20 add_watcher() i=4 2024-09-12T00:54:12.415 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.416+0000 7f99e792c800 20 add_watcher() i=5 2024-09-12T00:54:12.416 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.416+0000 7f99e792c800 20 add_watcher() i=6 2024-09-12T00:54:12.416 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.417+0000 7f99e792c800 20 add_watcher() i=7 2024-09-12T00:54:12.416 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.417+0000 7f99e792c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:12.418 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.419+0000 7f9899fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:12.418 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.419+0000 7f99e792c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:12.419 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.419+0000 7f99e792c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:12.419 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.419+0000 7f99e792c800 5 note: GC not initialized 2024-09-12T00:54:12.419 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.420+0000 7f9898fe1640 20 reqs_thread_entry: start 2024-09-12T00:54:12.419 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.420+0000 7f99e792c800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:12.419 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.420+0000 7f99e792c800 20 Filter name: none 2024-09-12T00:54:12.419 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.420+0000 7f98127fc640 20 reqs_thread_entry: start 2024-09-12T00:54:12.419 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.420+0000 7f99e792c800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:54:12.419 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.420+0000 7f99e792c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.420 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.420+0000 7f99e792c800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:54:12.420 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.420+0000 7f99e792c800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:54:12.420 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.420+0000 7f99e792c800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:54:12.420 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.420+0000 7f99e792c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 : miss 2024-09-12T00:54:12.421 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.420+0000 7f99e792c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.421 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.421+0000 7f99e792c800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:54:12.421 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.421+0000 7f99e792c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:54:12.421 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.421+0000 7f99e792c800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:54:12.421 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.421+0000 7f99e792c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:54:12.421 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.421+0000 7f99e792c800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:54:12.421 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.421+0000 7f99e792c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 2024-09-12T00:54:12.421 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.421+0000 7f99e792c800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.0 2024-09-12T00:54:12.421 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.421+0000 7f99e792c800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.0 2024-09-12T00:54:12.421 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.421+0000 7f99e792c800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.1 2024-09-12T00:54:12.421 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.421+0000 7f99e792c800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.1 2024-09-12T00:54:12.421 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.422+0000 7f99e792c800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.2 2024-09-12T00:54:12.422 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.422+0000 7f99e792c800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.2 2024-09-12T00:54:12.422 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.423+0000 7f9899fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:12.424 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.426+0000 7f99e792c800 20 remove_watcher() i=0 2024-09-12T00:54:12.424 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.426+0000 7f99e792c800 2 removed watcher, disabling cache 2024-09-12T00:54:12.425 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.427+0000 7f99e792c800 20 remove_watcher() i=1 2024-09-12T00:54:12.426 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.428+0000 7f99e792c800 20 remove_watcher() i=2 2024-09-12T00:54:12.427 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.429+0000 7f99e792c800 20 remove_watcher() i=3 2024-09-12T00:54:12.428 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.430+0000 7f99e792c800 20 remove_watcher() i=4 2024-09-12T00:54:12.429 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.431+0000 7f99e792c800 20 remove_watcher() i=5 2024-09-12T00:54:12.430 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.432+0000 7f99e792c800 20 remove_watcher() i=6 2024-09-12T00:54:12.431 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.432+0000 7f99e792c800 20 remove_watcher() i=7 2024-09-12T00:54:12.442 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:54:12.471 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:12.471 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:12.508 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.509+0000 7f8e6c928800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.510 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.511+0000 7f8e6c928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.510 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.511+0000 7f8e6c928800 20 realm 2024-09-12T00:54:12.510 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.511+0000 7f8e6c928800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.510 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.511+0000 7f8e6c928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.510 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.511+0000 7f8e6c928800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:12.510 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.511+0000 7f8e6c928800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.511 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.512+0000 7f8e6c928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.511 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.512+0000 7f8e6c928800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.511 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.512+0000 7f8e6c928800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:12.511 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.512+0000 7f8e6c928800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.512 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.513+0000 7f8e6c928800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:12.512 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.513+0000 7f8e6c928800 20 searching for the correct realm 2024-09-12T00:54:12.513 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.514+0000 7f8e6866f640 0 -- 172.21.15.73:0/3866853745 >> [v2:172.21.15.117:6816/1460498570,v1:172.21.15.117:6817/1460498570] conn(0x55b183ab04e0 msgr2=0x7f8e6002f920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:12.718 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.719+0000 7f8e67e6e640 0 -- 172.21.15.73:0/3866853745 >> [v2:172.21.15.73:6826/269690776,v1:172.21.15.73:6827/269690776] conn(0x7f8e58009960 msgr2=0x7f8e580a2950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:12.724 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.725+0000 7f8e6c928800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:54:12.724 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.725+0000 7f8e6c928800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:12.725 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.725+0000 7f8e6c928800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:54:12.725 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.725+0000 7f8e6c928800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:12.725 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.725+0000 7f8e6c928800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:12.725 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.725+0000 7f8e6c928800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:12.725 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.725+0000 7f8e6c928800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.725 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.725+0000 7f8e6c928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.725 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.725+0000 7f8e6c928800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.725 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.726+0000 7f8e6c928800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:12.725 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.726+0000 7f8e6c928800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.726 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.726+0000 7f8e6c928800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:12.726 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.726+0000 7f8e6c928800 20 zone default found 2024-09-12T00:54:12.727 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.726+0000 7f8e6c928800 4 Realm: () 2024-09-12T00:54:12.727 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.726+0000 7f8e6c928800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:54:12.727 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.726+0000 7f8e6c928800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:54:12.727 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.726+0000 7f8e6c928800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:12.727 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.726+0000 7f8e6c928800 20 zonegroup default 2024-09-12T00:54:12.727 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.726+0000 7f8e6c928800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.727 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.727+0000 7f8e6c928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.727 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.727+0000 7f8e6c928800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.727 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.727+0000 7f8e6c928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.727 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.727+0000 7f8e6c928800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.727 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.727+0000 7f8e6c928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.727 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.727+0000 7f8e6c928800 20 started sync module instance, tier type = 2024-09-12T00:54:12.727 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.727+0000 7f8e6c928800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:54:12.735 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.736+0000 7f8e6c928800 20 add_watcher() i=0 2024-09-12T00:54:12.735 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.736+0000 7f8e6c928800 20 add_watcher() i=1 2024-09-12T00:54:12.735 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.736+0000 7f8e6c928800 20 add_watcher() i=2 2024-09-12T00:54:12.735 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.736+0000 7f8e6c928800 20 add_watcher() i=3 2024-09-12T00:54:12.735 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.736+0000 7f8e6c928800 20 add_watcher() i=4 2024-09-12T00:54:12.735 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.736+0000 7f8e6c928800 20 add_watcher() i=5 2024-09-12T00:54:12.735 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.736+0000 7f8e6c928800 20 add_watcher() i=6 2024-09-12T00:54:12.736 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.737+0000 7f8e6c928800 20 add_watcher() i=7 2024-09-12T00:54:12.736 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.737+0000 7f8e6c928800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:12.738 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.739+0000 7f8d1efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:12.738 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.739+0000 7f8e6c928800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:12.738 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.739+0000 7f8e6c928800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:12.738 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.739+0000 7f8e6c928800 5 note: GC not initialized 2024-09-12T00:54:12.739 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.740+0000 7f8d1dfdb640 20 reqs_thread_entry: start 2024-09-12T00:54:12.739 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.740+0000 7f8e6c928800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:12.740 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.740+0000 7f8e6c928800 20 Filter name: none 2024-09-12T00:54:12.740 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.740+0000 7f8c8f7fe640 20 reqs_thread_entry: start 2024-09-12T00:54:12.740 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.740+0000 7f8e6c928800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.740 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.740+0000 7f8e6c928800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:54:12.740 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.740+0000 7f8e6c928800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.740 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.741+0000 7f8e6c928800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:54:12.740 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.741+0000 7f8e6c928800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:12.740 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.741+0000 7f8e6c928800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.741 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.741+0000 7f8e6c928800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:54:12.741 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.741+0000 7f8e6c928800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.741 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.742+0000 7f8e6c928800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:54:12.741 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.742+0000 7f8e6c928800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:12.741 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.743+0000 7f8d1efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:12.745 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.747+0000 7f8e6c928800 20 remove_watcher() i=0 2024-09-12T00:54:12.745 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.747+0000 7f8e6c928800 2 removed watcher, disabling cache 2024-09-12T00:54:12.746 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.747+0000 7f8e6c928800 20 remove_watcher() i=1 2024-09-12T00:54:12.747 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.748+0000 7f8e6c928800 20 remove_watcher() i=2 2024-09-12T00:54:12.748 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.750+0000 7f8e6c928800 20 remove_watcher() i=3 2024-09-12T00:54:12.749 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.751+0000 7f8e6c928800 20 remove_watcher() i=4 2024-09-12T00:54:12.750 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.751+0000 7f8e6c928800 20 remove_watcher() i=5 2024-09-12T00:54:12.751 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.752+0000 7f8e6c928800 20 remove_watcher() i=6 2024-09-12T00:54:12.752 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.753+0000 7f8e6c928800 20 remove_watcher() i=7 2024-09-12T00:54:12.762 INFO:tasks.workunit.client.0.smithi073.stderr: test: duplicated entries should be purged before reshard 2024-09-12T00:54:12.763 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:54:12.792 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:12.792 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:12.829 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.830+0000 7fb962526800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.830 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.831+0000 7fb962526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.830 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.831+0000 7fb962526800 20 realm 2024-09-12T00:54:12.830 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.831+0000 7fb962526800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.830 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.832+0000 7fb962526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.831 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.832+0000 7fb962526800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:12.831 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.832+0000 7fb962526800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.831 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.832+0000 7fb962526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.831 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.832+0000 7fb962526800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.831 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.833+0000 7fb962526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:12.831 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.833+0000 7fb962526800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.832 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.833+0000 7fb962526800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:12.832 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.833+0000 7fb962526800 20 searching for the correct realm 2024-09-12T00:54:12.835 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.836+0000 7fb95e90a640 0 -- 172.21.15.73:0/4243311897 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fb94801e040 msgr2=0x7fb948039920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:12.839 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.840+0000 7fb95e90a640 0 -- 172.21.15.73:0/4243311897 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fb828086390 msgr2=0x7fb8280887c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:12.843 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.844+0000 7fb962526800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:54:12.843 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.844+0000 7fb962526800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:12.843 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.844+0000 7fb962526800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:54:12.843 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.844+0000 7fb962526800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:12.843 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.844+0000 7fb962526800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:12.843 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.844+0000 7fb962526800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:12.843 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.844+0000 7fb962526800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.843 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.844+0000 7fb962526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.843 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.844+0000 7fb962526800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.845 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.845+0000 7fb962526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:12.845 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.845+0000 7fb962526800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.845 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.845+0000 7fb962526800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:12.845 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.845+0000 7fb962526800 20 zone default found 2024-09-12T00:54:12.845 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.845+0000 7fb962526800 4 Realm: () 2024-09-12T00:54:12.846 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.845+0000 7fb962526800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:54:12.846 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.845+0000 7fb962526800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:54:12.846 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.845+0000 7fb962526800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:12.846 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.845+0000 7fb962526800 20 zonegroup default 2024-09-12T00:54:12.846 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.845+0000 7fb962526800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.846 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.845+0000 7fb962526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.846 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.845+0000 7fb962526800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.846 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.845+0000 7fb962526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.846 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.845+0000 7fb962526800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.846 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.846+0000 7fb962526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.846 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.846+0000 7fb962526800 20 started sync module instance, tier type = 2024-09-12T00:54:12.847 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.846+0000 7fb962526800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:54:12.853 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.855+0000 7fb962526800 20 add_watcher() i=0 2024-09-12T00:54:12.853 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.855+0000 7fb962526800 20 add_watcher() i=1 2024-09-12T00:54:12.854 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.855+0000 7fb962526800 20 add_watcher() i=2 2024-09-12T00:54:12.854 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.855+0000 7fb962526800 20 add_watcher() i=3 2024-09-12T00:54:12.854 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.855+0000 7fb962526800 20 add_watcher() i=4 2024-09-12T00:54:12.854 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.855+0000 7fb962526800 20 add_watcher() i=5 2024-09-12T00:54:12.854 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.855+0000 7fb962526800 20 add_watcher() i=6 2024-09-12T00:54:12.854 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.856+0000 7fb962526800 20 add_watcher() i=7 2024-09-12T00:54:12.854 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.856+0000 7fb962526800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:12.856 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.857+0000 7fb814fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:12.856 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.857+0000 7fb962526800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:12.856 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.857+0000 7fb962526800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:12.857 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.857+0000 7fb962526800 5 note: GC not initialized 2024-09-12T00:54:12.857 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.857+0000 7fb78f7fe640 20 reqs_thread_entry: start 2024-09-12T00:54:12.857 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.858+0000 7fb962526800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:12.857 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.858+0000 7fb962526800 20 Filter name: none 2024-09-12T00:54:12.857 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.858+0000 7fb78d7fa640 20 reqs_thread_entry: start 2024-09-12T00:54:12.857 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.858+0000 7fb962526800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.858 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.858+0000 7fb962526800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:54:12.858 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.858+0000 7fb962526800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.858 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.859+0000 7fb962526800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:54:12.858 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.859+0000 7fb962526800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:12.858 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.859+0000 7fb962526800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.858 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.859+0000 7fb962526800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:54:12.858 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.859+0000 7fb962526800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.858 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.859+0000 7fb962526800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:54:12.859 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.859+0000 7fb962526800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:12.859 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.861+0000 7fb814fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:12.861 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.863+0000 7fb962526800 20 remove_watcher() i=0 2024-09-12T00:54:12.861 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.863+0000 7fb962526800 2 removed watcher, disabling cache 2024-09-12T00:54:12.862 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.864+0000 7fb962526800 20 remove_watcher() i=1 2024-09-12T00:54:12.864 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.865+0000 7fb962526800 20 remove_watcher() i=2 2024-09-12T00:54:12.864 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.866+0000 7fb962526800 20 remove_watcher() i=3 2024-09-12T00:54:12.865 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.867+0000 7fb962526800 20 remove_watcher() i=4 2024-09-12T00:54:12.866 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.868+0000 7fb962526800 20 remove_watcher() i=5 2024-09-12T00:54:12.867 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.869+0000 7fb962526800 20 remove_watcher() i=6 2024-09-12T00:54:12.868 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.870+0000 7fb962526800 20 remove_watcher() i=7 2024-09-12T00:54:12.879 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:12.879 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:54:12.879 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: a-bucket id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 num_objects: 10 size_kb: 1 num_shards: 3 2024-09-12T00:54:12.879 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:12.881 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T00:54:12.914 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:12.914 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:12.951 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.953+0000 7f7bc6c20800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.953 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.954+0000 7f7bc6c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.953 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.954+0000 7f7bc6c20800 20 realm 2024-09-12T00:54:12.953 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.954+0000 7f7bc6c20800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.953 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.954+0000 7f7bc6c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.953 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.954+0000 7f7bc6c20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:12.953 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.954+0000 7f7bc6c20800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.953 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.954+0000 7f7bc6c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.953 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.954+0000 7f7bc6c20800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.954 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.955+0000 7f7bc6c20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:12.954 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.955+0000 7f7bc6c20800 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.954 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.956+0000 7f7bc6c20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:12.955 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.956+0000 7f7bc6c20800 20 searching for the correct realm 2024-09-12T00:54:12.957 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:12.958+0000 7f7bc4f0b640 0 -- 172.21.15.73:0/2314965784 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f7bac02b800 msgr2=0x7f7bac0023e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:13.163 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.165+0000 7f7bc4f0b640 0 -- 172.21.15.73:0/2314965784 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f7bac02b800 msgr2=0x7f7bac0023e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:13.167 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.169+0000 7f7bc6c20800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:54:13.167 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.169+0000 7f7bc6c20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:13.168 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.169+0000 7f7bc6c20800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:54:13.168 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.169+0000 7f7bc6c20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:13.168 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.169+0000 7f7bc6c20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:13.168 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.169+0000 7f7bc6c20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:13.168 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.169+0000 7f7bc6c20800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.168 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.169+0000 7f7bc6c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:13.168 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.169+0000 7f7bc6c20800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.169 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.169+0000 7f7bc6c20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:13.169 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.169+0000 7f7bc6c20800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.169 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.169+0000 7f7bc6c20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:13.169 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.169+0000 7f7bc6c20800 20 zone default found 2024-09-12T00:54:13.170 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.169+0000 7f7bc6c20800 4 Realm: () 2024-09-12T00:54:13.170 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.169+0000 7f7bc6c20800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:54:13.170 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.169+0000 7f7bc6c20800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:54:13.170 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.169+0000 7f7bc6c20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:13.170 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.169+0000 7f7bc6c20800 20 zonegroup default 2024-09-12T00:54:13.170 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.169+0000 7f7bc6c20800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.170 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.170+0000 7f7bc6c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:13.170 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.170+0000 7f7bc6c20800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.170 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.170+0000 7f7bc6c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:13.170 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.170+0000 7f7bc6c20800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.170 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.171+0000 7f7bc6c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:13.170 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.171+0000 7f7bc6c20800 20 started sync module instance, tier type = 2024-09-12T00:54:13.171 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.171+0000 7f7bc6c20800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:54:13.178 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.180+0000 7f7bc6c20800 20 add_watcher() i=0 2024-09-12T00:54:13.179 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.180+0000 7f7bc6c20800 20 add_watcher() i=1 2024-09-12T00:54:13.179 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.180+0000 7f7bc6c20800 20 add_watcher() i=2 2024-09-12T00:54:13.179 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.180+0000 7f7bc6c20800 20 add_watcher() i=3 2024-09-12T00:54:13.179 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.180+0000 7f7bc6c20800 20 add_watcher() i=4 2024-09-12T00:54:13.179 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.180+0000 7f7bc6c20800 20 add_watcher() i=5 2024-09-12T00:54:13.179 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.180+0000 7f7bc6c20800 20 add_watcher() i=6 2024-09-12T00:54:13.180 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.181+0000 7f7bc6c20800 20 add_watcher() i=7 2024-09-12T00:54:13.180 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.181+0000 7f7bc6c20800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:13.181 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.183+0000 7f7a7afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:13.182 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.183+0000 7f7bc6c20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:13.182 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.183+0000 7f7bc6c20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:13.182 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.183+0000 7f7bc6c20800 5 note: GC not initialized 2024-09-12T00:54:13.182 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.183+0000 7f7a79fdb640 20 reqs_thread_entry: start 2024-09-12T00:54:13.182 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.183+0000 7f7bc6c20800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:13.182 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.183+0000 7f7bc6c20800 20 Filter name: none 2024-09-12T00:54:13.182 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.183+0000 7f79eb7fe640 20 reqs_thread_entry: start 2024-09-12T00:54:13.182 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.183+0000 7f7bc6c20800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:54:13.183 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.183+0000 7f7bc6c20800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.183 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.184+0000 7f7bc6c20800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:54:13.183 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.184+0000 7f7bc6c20800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:54:13.184 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.184+0000 7f7bc6c20800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:54:13.184 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.184+0000 7f7bc6c20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 : miss 2024-09-12T00:54:13.184 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.184+0000 7f7bc6c20800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.184 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.184+0000 7f7bc6c20800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:54:13.184 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.184+0000 7f7bc6c20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:54:13.184 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.184+0000 7f7bc6c20800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:54:13.184 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.184+0000 7f7bc6c20800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:54:13.184 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.184+0000 7f7bc6c20800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:54:13.184 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.184+0000 7f7bc6c20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 2024-09-12T00:54:13.187 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.188+0000 7f7bc6c20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:54:13.187 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.188+0000 7f7bc6c20800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:54:13.187 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.188+0000 7f7bc6c20800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:54:13.187 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.188+0000 7f7bc6c20800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17, ofs0, ns] 2024-09-12T00:54:13.187 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.188+0000 7f7a9affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497046 cookie 94263431640736 notifier 8271 bl.length()=827 2024-09-12T00:54:13.187 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.188+0000 7f7a9affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:54:13.187 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.188+0000 7f7a9affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:54:13.187 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.188+0000 7f7a9affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:54:13.188 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.190+0000 7f7bc6c20800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): orig_sources= new_sources= 2024-09-12T00:54:13.188 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.190+0000 7f7bc6c20800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): potential sources added=[] removed=[] 2024-09-12T00:54:13.189 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.190+0000 7f7bc6c20800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): orig_dests= new_dests= 2024-09-12T00:54:13.189 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.190+0000 7f7bc6c20800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): potential dests added=[] removed=[] 2024-09-12T00:54:13.191 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7bc6c20800 time 2024-09-12T00:54:13.193686+0000 2024-09-12T00:54:13.191 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:54:13.192 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:13.192 INFO:tasks.workunit.client.0.smithi073.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f7bca18c71a] 2024-09-12T00:54:13.192 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f7bca18c8d8] 2024-09-12T00:54:13.192 INFO:tasks.workunit.client.0.smithi073.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bb681d8641] 2024-09-12T00:54:13.192 INFO:tasks.workunit.client.0.smithi073.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55bb681e838a] 2024-09-12T00:54:13.192 INFO:tasks.workunit.client.0.smithi073.stderr: 5: main() 2024-09-12T00:54:13.192 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f7bc8e29590] 2024-09-12T00:54:13.192 INFO:tasks.workunit.client.0.smithi073.stderr: 7: __libc_start_main() 2024-09-12T00:54:13.193 INFO:tasks.workunit.client.0.smithi073.stderr: 8: _start() 2024-09-12T00:54:13.193 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.193+0000 7f7bc6c20800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7bc6c20800 time 2024-09-12T00:54:13.193686+0000 2024-09-12T00:54:13.193 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:54:13.193 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:13.193 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:13.193 INFO:tasks.workunit.client.0.smithi073.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f7bca18c71a] 2024-09-12T00:54:13.193 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f7bca18c8d8] 2024-09-12T00:54:13.193 INFO:tasks.workunit.client.0.smithi073.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bb681d8641] 2024-09-12T00:54:13.193 INFO:tasks.workunit.client.0.smithi073.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55bb681e838a] 2024-09-12T00:54:13.193 INFO:tasks.workunit.client.0.smithi073.stderr: 5: main() 2024-09-12T00:54:13.193 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f7bc8e29590] 2024-09-12T00:54:13.193 INFO:tasks.workunit.client.0.smithi073.stderr: 7: __libc_start_main() 2024-09-12T00:54:13.193 INFO:tasks.workunit.client.0.smithi073.stderr: 8: _start() 2024-09-12T00:54:13.193 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:13.194 INFO:tasks.workunit.client.0.smithi073.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:54:13.194 INFO:tasks.workunit.client.0.smithi073.stderr: in thread 7f7bc6c20800 thread_name:radosgw-admin 2024-09-12T00:54:13.208 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:13.209 INFO:tasks.workunit.client.0.smithi073.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f7bc8e3e6f0] 2024-09-12T00:54:13.209 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f7bc8e8b99c] 2024-09-12T00:54:13.209 INFO:tasks.workunit.client.0.smithi073.stderr: 3: raise() 2024-09-12T00:54:13.209 INFO:tasks.workunit.client.0.smithi073.stderr: 4: abort() 2024-09-12T00:54:13.209 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f7bca18c774] 2024-09-12T00:54:13.209 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f7bca18c8d8] 2024-09-12T00:54:13.209 INFO:tasks.workunit.client.0.smithi073.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bb681d8641] 2024-09-12T00:54:13.209 INFO:tasks.workunit.client.0.smithi073.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55bb681e838a] 2024-09-12T00:54:13.209 INFO:tasks.workunit.client.0.smithi073.stderr: 9: main() 2024-09-12T00:54:13.209 INFO:tasks.workunit.client.0.smithi073.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f7bc8e29590] 2024-09-12T00:54:13.209 INFO:tasks.workunit.client.0.smithi073.stderr: 11: __libc_start_main() 2024-09-12T00:54:13.209 INFO:tasks.workunit.client.0.smithi073.stderr: 12: _start() 2024-09-12T00:54:13.210 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.194+0000 7f7bc6c20800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:54:13.210 INFO:tasks.workunit.client.0.smithi073.stderr: in thread 7f7bc6c20800 thread_name:radosgw-admin 2024-09-12T00:54:13.210 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:13.210 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:13.210 INFO:tasks.workunit.client.0.smithi073.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f7bc8e3e6f0] 2024-09-12T00:54:13.210 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f7bc8e8b99c] 2024-09-12T00:54:13.210 INFO:tasks.workunit.client.0.smithi073.stderr: 3: raise() 2024-09-12T00:54:13.210 INFO:tasks.workunit.client.0.smithi073.stderr: 4: abort() 2024-09-12T00:54:13.210 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f7bca18c774] 2024-09-12T00:54:13.210 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f7bca18c8d8] 2024-09-12T00:54:13.210 INFO:tasks.workunit.client.0.smithi073.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bb681d8641] 2024-09-12T00:54:13.210 INFO:tasks.workunit.client.0.smithi073.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55bb681e838a] 2024-09-12T00:54:13.210 INFO:tasks.workunit.client.0.smithi073.stderr: 9: main() 2024-09-12T00:54:13.211 INFO:tasks.workunit.client.0.smithi073.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f7bc8e29590] 2024-09-12T00:54:13.211 INFO:tasks.workunit.client.0.smithi073.stderr: 11: __libc_start_main() 2024-09-12T00:54:13.211 INFO:tasks.workunit.client.0.smithi073.stderr: 12: _start() 2024-09-12T00:54:13.211 INFO:tasks.workunit.client.0.smithi073.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:54:13.211 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:13.211 INFO:tasks.workunit.client.0.smithi073.stderr:--- begin dump of recent events --- 2024-09-12T00:54:13.211 INFO:tasks.workunit.client.0.smithi073.stderr: -499> 2024-09-12T00:54:12.936+0000 7f7bc6c20800 10 monclient: monmap: 2024-09-12T00:54:13.211 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:54:13.211 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:54:13.211 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:54:13.211 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:54:13.211 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:54:13.211 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:54:13.212 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:54:13.212 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:54:13.212 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:54:13.212 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:13.212 INFO:tasks.workunit.client.0.smithi073.stderr: -498> 2024-09-12T00:54:12.936+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4c22d0) adding auth protocol: cephx 2024-09-12T00:54:13.212 INFO:tasks.workunit.client.0.smithi073.stderr: -497> 2024-09-12T00:54:12.936+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4c22d0) adding auth protocol: cephx 2024-09-12T00:54:13.212 INFO:tasks.workunit.client.0.smithi073.stderr: -496> 2024-09-12T00:54:12.936+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4c22d0) adding auth protocol: cephx 2024-09-12T00:54:13.212 INFO:tasks.workunit.client.0.smithi073.stderr: -495> 2024-09-12T00:54:12.936+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4c22d0) adding con mode: secure 2024-09-12T00:54:13.212 INFO:tasks.workunit.client.0.smithi073.stderr: -494> 2024-09-12T00:54:12.936+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4c22d0) adding con mode: crc 2024-09-12T00:54:13.212 INFO:tasks.workunit.client.0.smithi073.stderr: -493> 2024-09-12T00:54:12.936+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4c22d0) adding con mode: secure 2024-09-12T00:54:13.212 INFO:tasks.workunit.client.0.smithi073.stderr: -492> 2024-09-12T00:54:12.936+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4c22d0) adding con mode: crc 2024-09-12T00:54:13.212 INFO:tasks.workunit.client.0.smithi073.stderr: -491> 2024-09-12T00:54:12.936+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4c22d0) adding con mode: secure 2024-09-12T00:54:13.212 INFO:tasks.workunit.client.0.smithi073.stderr: -490> 2024-09-12T00:54:12.936+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4c22d0) adding con mode: crc 2024-09-12T00:54:13.213 INFO:tasks.workunit.client.0.smithi073.stderr: -489> 2024-09-12T00:54:12.936+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4c22d0) adding con mode: crc 2024-09-12T00:54:13.213 INFO:tasks.workunit.client.0.smithi073.stderr: -488> 2024-09-12T00:54:12.936+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4c22d0) adding con mode: secure 2024-09-12T00:54:13.213 INFO:tasks.workunit.client.0.smithi073.stderr: -487> 2024-09-12T00:54:12.936+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4c22d0) adding con mode: crc 2024-09-12T00:54:13.213 INFO:tasks.workunit.client.0.smithi073.stderr: -486> 2024-09-12T00:54:12.936+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4c22d0) adding con mode: secure 2024-09-12T00:54:13.213 INFO:tasks.workunit.client.0.smithi073.stderr: -485> 2024-09-12T00:54:12.936+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4c22d0) adding con mode: crc 2024-09-12T00:54:13.213 INFO:tasks.workunit.client.0.smithi073.stderr: -484> 2024-09-12T00:54:12.936+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4c22d0) adding con mode: secure 2024-09-12T00:54:13.213 INFO:tasks.workunit.client.0.smithi073.stderr: -483> 2024-09-12T00:54:12.936+0000 7f7bc6c20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:13.213 INFO:tasks.workunit.client.0.smithi073.stderr: -482> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 1 librados: starting msgr at 2024-09-12T00:54:13.213 INFO:tasks.workunit.client.0.smithi073.stderr: -481> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 1 librados: starting objecter 2024-09-12T00:54:13.213 INFO:tasks.workunit.client.0.smithi073.stderr: -480> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 5 asok(0x55bb6a29c630) register_command objecter_requests hook 0x55bb6a4edb40 2024-09-12T00:54:13.213 INFO:tasks.workunit.client.0.smithi073.stderr: -479> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 1 librados: setting wanted keys 2024-09-12T00:54:13.213 INFO:tasks.workunit.client.0.smithi073.stderr: -478> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 1 librados: calling monclient init 2024-09-12T00:54:13.213 INFO:tasks.workunit.client.0.smithi073.stderr: -477> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 10 monclient: init 2024-09-12T00:54:13.214 INFO:tasks.workunit.client.0.smithi073.stderr: -476> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4bc630) adding auth protocol: cephx 2024-09-12T00:54:13.214 INFO:tasks.workunit.client.0.smithi073.stderr: -475> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4bc630) adding auth protocol: cephx 2024-09-12T00:54:13.214 INFO:tasks.workunit.client.0.smithi073.stderr: -474> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4bc630) adding auth protocol: cephx 2024-09-12T00:54:13.214 INFO:tasks.workunit.client.0.smithi073.stderr: -473> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4bc630) adding con mode: secure 2024-09-12T00:54:13.214 INFO:tasks.workunit.client.0.smithi073.stderr: -472> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4bc630) adding con mode: crc 2024-09-12T00:54:13.214 INFO:tasks.workunit.client.0.smithi073.stderr: -471> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4bc630) adding con mode: secure 2024-09-12T00:54:13.214 INFO:tasks.workunit.client.0.smithi073.stderr: -470> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4bc630) adding con mode: crc 2024-09-12T00:54:13.214 INFO:tasks.workunit.client.0.smithi073.stderr: -469> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4bc630) adding con mode: secure 2024-09-12T00:54:13.214 INFO:tasks.workunit.client.0.smithi073.stderr: -468> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4bc630) adding con mode: crc 2024-09-12T00:54:13.214 INFO:tasks.workunit.client.0.smithi073.stderr: -467> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4bc630) adding con mode: crc 2024-09-12T00:54:13.214 INFO:tasks.workunit.client.0.smithi073.stderr: -466> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4bc630) adding con mode: secure 2024-09-12T00:54:13.214 INFO:tasks.workunit.client.0.smithi073.stderr: -465> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4bc630) adding con mode: crc 2024-09-12T00:54:13.214 INFO:tasks.workunit.client.0.smithi073.stderr: -464> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4bc630) adding con mode: secure 2024-09-12T00:54:13.214 INFO:tasks.workunit.client.0.smithi073.stderr: -463> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4bc630) adding con mode: crc 2024-09-12T00:54:13.215 INFO:tasks.workunit.client.0.smithi073.stderr: -462> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4bc630) adding con mode: secure 2024-09-12T00:54:13.215 INFO:tasks.workunit.client.0.smithi073.stderr: -461> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:13.215 INFO:tasks.workunit.client.0.smithi073.stderr: -460> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:13.215 INFO:tasks.workunit.client.0.smithi073.stderr: -459> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 5 asok(0x55bb6a29c630) register_command rotate-key hook 0x55bb6a4bc778 2024-09-12T00:54:13.215 INFO:tasks.workunit.client.0.smithi073.stderr: -458> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 10 monclient: _reopen_session rank -1 2024-09-12T00:54:13.215 INFO:tasks.workunit.client.0.smithi073.stderr: -457> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:54:13.215 INFO:tasks.workunit.client.0.smithi073.stderr: -456> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 10 monclient(hunting): picked mon.noname-a con 0x55bb6a3692d0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:54:13.215 INFO:tasks.workunit.client.0.smithi073.stderr: -455> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 10 monclient(hunting): picked mon.noname-c con 0x55bb6a375c20 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:54:13.215 INFO:tasks.workunit.client.0.smithi073.stderr: -454> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 10 monclient(hunting): picked mon.noname-b con 0x55bb6a4e6dd0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:54:13.215 INFO:tasks.workunit.client.0.smithi073.stderr: -453> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:13.215 INFO:tasks.workunit.client.0.smithi073.stderr: -452> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:13.215 INFO:tasks.workunit.client.0.smithi073.stderr: -451> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:13.215 INFO:tasks.workunit.client.0.smithi073.stderr: -450> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 10 monclient(hunting): _renew_subs 2024-09-12T00:54:13.216 INFO:tasks.workunit.client.0.smithi073.stderr: -449> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 10 monclient(hunting): authenticate will time out at 2313.607707s 2024-09-12T00:54:13.216 INFO:tasks.workunit.client.0.smithi073.stderr: -448> 2024-09-12T00:54:12.937+0000 7f7bbbf09640 10 monclient(hunting): get_auth_request con 0x55bb6a375c20 auth_method 0 2024-09-12T00:54:13.216 INFO:tasks.workunit.client.0.smithi073.stderr: -447> 2024-09-12T00:54:12.937+0000 7f7bbbf09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:13.216 INFO:tasks.workunit.client.0.smithi073.stderr: -446> 2024-09-12T00:54:12.937+0000 7f7bbbf09640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:13.216 INFO:tasks.workunit.client.0.smithi073.stderr: -445> 2024-09-12T00:54:12.937+0000 7f7bbbf09640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:13.216 INFO:tasks.workunit.client.0.smithi073.stderr: -444> 2024-09-12T00:54:12.937+0000 7f7bc470a640 10 monclient(hunting): get_auth_request con 0x55bb6a3692d0 auth_method 0 2024-09-12T00:54:13.216 INFO:tasks.workunit.client.0.smithi073.stderr: -443> 2024-09-12T00:54:12.937+0000 7f7bc470a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:13.216 INFO:tasks.workunit.client.0.smithi073.stderr: -442> 2024-09-12T00:54:12.937+0000 7f7bc470a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:13.216 INFO:tasks.workunit.client.0.smithi073.stderr: -441> 2024-09-12T00:54:12.937+0000 7f7bc470a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:13.216 INFO:tasks.workunit.client.0.smithi073.stderr: -440> 2024-09-12T00:54:12.937+0000 7f7bbbf09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:13.216 INFO:tasks.workunit.client.0.smithi073.stderr: -439> 2024-09-12T00:54:12.937+0000 7f7bbbf09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:13.216 INFO:tasks.workunit.client.0.smithi073.stderr: -438> 2024-09-12T00:54:12.937+0000 7f7bbbf09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:13.216 INFO:tasks.workunit.client.0.smithi073.stderr: -437> 2024-09-12T00:54:12.937+0000 7f7bc470a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:13.217 INFO:tasks.workunit.client.0.smithi073.stderr: -436> 2024-09-12T00:54:12.937+0000 7f7bc470a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:13.217 INFO:tasks.workunit.client.0.smithi073.stderr: -435> 2024-09-12T00:54:12.937+0000 7f7bc470a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:13.217 INFO:tasks.workunit.client.0.smithi073.stderr: -434> 2024-09-12T00:54:12.937+0000 7f7bc4f0b640 10 monclient(hunting): get_auth_request con 0x55bb6a4e6dd0 auth_method 0 2024-09-12T00:54:13.217 INFO:tasks.workunit.client.0.smithi073.stderr: -433> 2024-09-12T00:54:12.937+0000 7f7bc4f0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:13.217 INFO:tasks.workunit.client.0.smithi073.stderr: -432> 2024-09-12T00:54:12.937+0000 7f7bc4f0b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:13.217 INFO:tasks.workunit.client.0.smithi073.stderr: -431> 2024-09-12T00:54:12.937+0000 7f7bc4f0b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:13.217 INFO:tasks.workunit.client.0.smithi073.stderr: -430> 2024-09-12T00:54:12.938+0000 7f7bc4f0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:13.217 INFO:tasks.workunit.client.0.smithi073.stderr: -429> 2024-09-12T00:54:12.938+0000 7f7bc4f0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:13.217 INFO:tasks.workunit.client.0.smithi073.stderr: -428> 2024-09-12T00:54:12.938+0000 7f7bc4f0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:13.217 INFO:tasks.workunit.client.0.smithi073.stderr: -427> 2024-09-12T00:54:12.938+0000 7f7bc470a640 10 monclient(hunting): handle_auth_done global_id 8262 payload 824 2024-09-12T00:54:13.217 INFO:tasks.workunit.client.0.smithi073.stderr: -426> 2024-09-12T00:54:12.938+0000 7f7bc470a640 10 monclient: _finish_hunting 0 2024-09-12T00:54:13.217 INFO:tasks.workunit.client.0.smithi073.stderr: -425> 2024-09-12T00:54:12.938+0000 7f7bc470a640 1 monclient: found mon.noname-a 2024-09-12T00:54:13.217 INFO:tasks.workunit.client.0.smithi073.stderr: -424> 2024-09-12T00:54:12.938+0000 7f7bc470a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:54:13.217 INFO:tasks.workunit.client.0.smithi073.stderr: -423> 2024-09-12T00:54:12.938+0000 7f7ab0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:13.218 INFO:tasks.workunit.client.0.smithi073.stderr: -422> 2024-09-12T00:54:12.938+0000 7f7ab0e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:54:13.218 INFO:tasks.workunit.client.0.smithi073.stderr: -421> 2024-09-12T00:54:12.938+0000 7f7ab0e09640 10 monclient: dump: 2024-09-12T00:54:13.218 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:54:13.218 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:54:13.218 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:13.218 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:13.218 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:13.218 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:54:13.218 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:54:13.218 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:54:13.218 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:54:13.218 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:13.218 INFO:tasks.workunit.client.0.smithi073.stderr: -420> 2024-09-12T00:54:12.938+0000 7f7ab0e09640 10 monclient: _finish_auth 0 2024-09-12T00:54:13.219 INFO:tasks.workunit.client.0.smithi073.stderr: -419> 2024-09-12T00:54:12.938+0000 7f7ab0e09640 10 monclient: _check_auth_tickets 2024-09-12T00:54:13.219 INFO:tasks.workunit.client.0.smithi073.stderr: -418> 2024-09-12T00:54:12.938+0000 7f7ab0e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:13.219 INFO:tasks.workunit.client.0.smithi073.stderr: -417> 2024-09-12T00:54:12.938+0000 7f7ab0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:13.219 INFO:tasks.workunit.client.0.smithi073.stderr: -416> 2024-09-12T00:54:12.938+0000 7f7ab0e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:54:13.219 INFO:tasks.workunit.client.0.smithi073.stderr: -415> 2024-09-12T00:54:12.938+0000 7f7ab0e09640 10 monclient: dump: 2024-09-12T00:54:13.219 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:54:13.219 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:54:13.219 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:13.219 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:13.219 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:13.219 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:54:13.219 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:54:13.219 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:54:13.219 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:54:13.220 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:13.220 INFO:tasks.workunit.client.0.smithi073.stderr: -414> 2024-09-12T00:54:12.938+0000 7f7bc6c20800 5 monclient: authenticate success, global_id 8262 2024-09-12T00:54:13.220 INFO:tasks.workunit.client.0.smithi073.stderr: -413> 2024-09-12T00:54:12.938+0000 7f7bc6c20800 10 monclient: _renew_subs 2024-09-12T00:54:13.220 INFO:tasks.workunit.client.0.smithi073.stderr: -412> 2024-09-12T00:54:12.938+0000 7f7bc6c20800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:54:13.220 INFO:tasks.workunit.client.0.smithi073.stderr: -411> 2024-09-12T00:54:12.938+0000 7f7ab260c640 4 set_mon_vals no callback set 2024-09-12T00:54:13.220 INFO:tasks.workunit.client.0.smithi073.stderr: -410> 2024-09-12T00:54:12.938+0000 7f7bc6c20800 10 monclient: _renew_subs 2024-09-12T00:54:13.220 INFO:tasks.workunit.client.0.smithi073.stderr: -409> 2024-09-12T00:54:12.938+0000 7f7bc6c20800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:54:13.220 INFO:tasks.workunit.client.0.smithi073.stderr: -408> 2024-09-12T00:54:12.938+0000 7f7bc6c20800 1 librados: init done 2024-09-12T00:54:13.220 INFO:tasks.workunit.client.0.smithi073.stderr: -407> 2024-09-12T00:54:12.940+0000 7f7ab0e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:54:13.220 INFO:tasks.workunit.client.0.smithi073.stderr: -406> 2024-09-12T00:54:12.940+0000 7f7ab0e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:54:13.220 INFO:tasks.workunit.client.0.smithi073.stderr: -405> 2024-09-12T00:54:12.940+0000 7f7ab0e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:54:13.220 INFO:tasks.workunit.client.0.smithi073.stderr: -404> 2024-09-12T00:54:12.940+0000 7f7bbbf09640 10 monclient: get_auth_request con 0x7f7aac076470 auth_method 0 2024-09-12T00:54:13.220 INFO:tasks.workunit.client.0.smithi073.stderr: -403> 2024-09-12T00:54:12.940+0000 7f7bc4f0b640 10 monclient: get_auth_request con 0x55bb6a4e4f00 auth_method 0 2024-09-12T00:54:13.221 INFO:tasks.workunit.client.0.smithi073.stderr: -402> 2024-09-12T00:54:12.941+0000 7f7bc470a640 10 monclient: get_auth_request con 0x55bb6a508040 auth_method 0 2024-09-12T00:54:13.221 INFO:tasks.workunit.client.0.smithi073.stderr: -401> 2024-09-12T00:54:12.942+0000 7f7bbbf09640 10 monclient: get_auth_request con 0x55bb6a50c6e0 auth_method 0 2024-09-12T00:54:13.221 INFO:tasks.workunit.client.0.smithi073.stderr: -400> 2024-09-12T00:54:12.943+0000 7f7bc6c20800 10 monclient: build_initial_monmap 2024-09-12T00:54:13.221 INFO:tasks.workunit.client.0.smithi073.stderr: -399> 2024-09-12T00:54:12.943+0000 7f7bc6c20800 1 build_initial for_mkfs: 0 2024-09-12T00:54:13.221 INFO:tasks.workunit.client.0.smithi073.stderr: -398> 2024-09-12T00:54:12.943+0000 7f7bc6c20800 10 monclient: monmap: 2024-09-12T00:54:13.221 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:54:13.221 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:54:13.221 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:54:13.221 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:54:13.221 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:54:13.221 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:54:13.221 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:54:13.221 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:54:13.221 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:54:13.222 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:13.222 INFO:tasks.workunit.client.0.smithi073.stderr: -397> 2024-09-12T00:54:12.943+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a511460) adding auth protocol: cephx 2024-09-12T00:54:13.222 INFO:tasks.workunit.client.0.smithi073.stderr: -396> 2024-09-12T00:54:12.943+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a511460) adding auth protocol: cephx 2024-09-12T00:54:13.222 INFO:tasks.workunit.client.0.smithi073.stderr: -395> 2024-09-12T00:54:12.943+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a511460) adding auth protocol: cephx 2024-09-12T00:54:13.222 INFO:tasks.workunit.client.0.smithi073.stderr: -394> 2024-09-12T00:54:12.943+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a511460) adding con mode: secure 2024-09-12T00:54:13.222 INFO:tasks.workunit.client.0.smithi073.stderr: -393> 2024-09-12T00:54:12.943+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a511460) adding con mode: crc 2024-09-12T00:54:13.222 INFO:tasks.workunit.client.0.smithi073.stderr: -392> 2024-09-12T00:54:12.943+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a511460) adding con mode: secure 2024-09-12T00:54:13.222 INFO:tasks.workunit.client.0.smithi073.stderr: -391> 2024-09-12T00:54:12.943+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a511460) adding con mode: crc 2024-09-12T00:54:13.222 INFO:tasks.workunit.client.0.smithi073.stderr: -390> 2024-09-12T00:54:12.943+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a511460) adding con mode: secure 2024-09-12T00:54:13.222 INFO:tasks.workunit.client.0.smithi073.stderr: -389> 2024-09-12T00:54:12.943+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a511460) adding con mode: crc 2024-09-12T00:54:13.222 INFO:tasks.workunit.client.0.smithi073.stderr: -388> 2024-09-12T00:54:12.943+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a511460) adding con mode: crc 2024-09-12T00:54:13.222 INFO:tasks.workunit.client.0.smithi073.stderr: -387> 2024-09-12T00:54:12.943+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a511460) adding con mode: secure 2024-09-12T00:54:13.222 INFO:tasks.workunit.client.0.smithi073.stderr: -386> 2024-09-12T00:54:12.943+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a511460) adding con mode: crc 2024-09-12T00:54:13.223 INFO:tasks.workunit.client.0.smithi073.stderr: -385> 2024-09-12T00:54:12.943+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a511460) adding con mode: secure 2024-09-12T00:54:13.223 INFO:tasks.workunit.client.0.smithi073.stderr: -384> 2024-09-12T00:54:12.943+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a511460) adding con mode: crc 2024-09-12T00:54:13.223 INFO:tasks.workunit.client.0.smithi073.stderr: -383> 2024-09-12T00:54:12.943+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a511460) adding con mode: secure 2024-09-12T00:54:13.223 INFO:tasks.workunit.client.0.smithi073.stderr: -382> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:13.223 INFO:tasks.workunit.client.0.smithi073.stderr: -381> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 5 asok(0x55bb6a29c630) register_command objecter_requests cmddesc objecter_requests hook 0x55bb6a514920 EEXIST 2024-09-12T00:54:13.223 INFO:tasks.workunit.client.0.smithi073.stderr: -380> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 10 monclient: init 2024-09-12T00:54:13.223 INFO:tasks.workunit.client.0.smithi073.stderr: -379> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a50fae8) adding auth protocol: cephx 2024-09-12T00:54:13.223 INFO:tasks.workunit.client.0.smithi073.stderr: -378> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a50fae8) adding auth protocol: cephx 2024-09-12T00:54:13.223 INFO:tasks.workunit.client.0.smithi073.stderr: -377> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a50fae8) adding auth protocol: cephx 2024-09-12T00:54:13.223 INFO:tasks.workunit.client.0.smithi073.stderr: -376> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a50fae8) adding con mode: secure 2024-09-12T00:54:13.223 INFO:tasks.workunit.client.0.smithi073.stderr: -375> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a50fae8) adding con mode: crc 2024-09-12T00:54:13.223 INFO:tasks.workunit.client.0.smithi073.stderr: -374> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a50fae8) adding con mode: secure 2024-09-12T00:54:13.224 INFO:tasks.workunit.client.0.smithi073.stderr: -373> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a50fae8) adding con mode: crc 2024-09-12T00:54:13.224 INFO:tasks.workunit.client.0.smithi073.stderr: -372> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a50fae8) adding con mode: secure 2024-09-12T00:54:13.224 INFO:tasks.workunit.client.0.smithi073.stderr: -371> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a50fae8) adding con mode: crc 2024-09-12T00:54:13.224 INFO:tasks.workunit.client.0.smithi073.stderr: -370> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a50fae8) adding con mode: crc 2024-09-12T00:54:13.224 INFO:tasks.workunit.client.0.smithi073.stderr: -369> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a50fae8) adding con mode: secure 2024-09-12T00:54:13.224 INFO:tasks.workunit.client.0.smithi073.stderr: -368> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a50fae8) adding con mode: crc 2024-09-12T00:54:13.224 INFO:tasks.workunit.client.0.smithi073.stderr: -367> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a50fae8) adding con mode: secure 2024-09-12T00:54:13.224 INFO:tasks.workunit.client.0.smithi073.stderr: -366> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a50fae8) adding con mode: crc 2024-09-12T00:54:13.224 INFO:tasks.workunit.client.0.smithi073.stderr: -365> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a50fae8) adding con mode: secure 2024-09-12T00:54:13.224 INFO:tasks.workunit.client.0.smithi073.stderr: -364> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:13.224 INFO:tasks.workunit.client.0.smithi073.stderr: -363> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:13.224 INFO:tasks.workunit.client.0.smithi073.stderr: -362> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 5 asok(0x55bb6a29c630) register_command rotate-key cmddesc rotate-key hook 0x55bb6a50fc30 EEXIST 2024-09-12T00:54:13.225 INFO:tasks.workunit.client.0.smithi073.stderr: -361> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 10 monclient: _reopen_session rank -1 2024-09-12T00:54:13.225 INFO:tasks.workunit.client.0.smithi073.stderr: -360> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:54:13.225 INFO:tasks.workunit.client.0.smithi073.stderr: -359> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 10 monclient(hunting): picked mon.noname-b con 0x55bb6a538c40 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:54:13.225 INFO:tasks.workunit.client.0.smithi073.stderr: -358> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 10 monclient(hunting): picked mon.noname-c con 0x55bb6a539020 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:54:13.225 INFO:tasks.workunit.client.0.smithi073.stderr: -357> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 10 monclient(hunting): picked mon.noname-a con 0x55bb6a537950 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:54:13.225 INFO:tasks.workunit.client.0.smithi073.stderr: -356> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:13.225 INFO:tasks.workunit.client.0.smithi073.stderr: -355> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:13.225 INFO:tasks.workunit.client.0.smithi073.stderr: -354> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:13.225 INFO:tasks.workunit.client.0.smithi073.stderr: -353> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 10 monclient(hunting): _renew_subs 2024-09-12T00:54:13.225 INFO:tasks.workunit.client.0.smithi073.stderr: -352> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 10 monclient(hunting): authenticate will time out at 2313.614838s 2024-09-12T00:54:13.225 INFO:tasks.workunit.client.0.smithi073.stderr: -351> 2024-09-12T00:54:12.944+0000 7f7bbbf09640 10 monclient(hunting): get_auth_request con 0x55bb6a539020 auth_method 0 2024-09-12T00:54:13.225 INFO:tasks.workunit.client.0.smithi073.stderr: -350> 2024-09-12T00:54:12.944+0000 7f7bbbf09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:13.225 INFO:tasks.workunit.client.0.smithi073.stderr: -349> 2024-09-12T00:54:12.944+0000 7f7bbbf09640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:13.226 INFO:tasks.workunit.client.0.smithi073.stderr: -348> 2024-09-12T00:54:12.944+0000 7f7bbbf09640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:13.226 INFO:tasks.workunit.client.0.smithi073.stderr: -347> 2024-09-12T00:54:12.944+0000 7f7bc4f0b640 10 monclient(hunting): get_auth_request con 0x55bb6a537950 auth_method 0 2024-09-12T00:54:13.226 INFO:tasks.workunit.client.0.smithi073.stderr: -346> 2024-09-12T00:54:12.944+0000 7f7bc4f0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:13.226 INFO:tasks.workunit.client.0.smithi073.stderr: -345> 2024-09-12T00:54:12.944+0000 7f7bc4f0b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:13.226 INFO:tasks.workunit.client.0.smithi073.stderr: -344> 2024-09-12T00:54:12.944+0000 7f7bc4f0b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:13.226 INFO:tasks.workunit.client.0.smithi073.stderr: -343> 2024-09-12T00:54:12.944+0000 7f7bc470a640 10 monclient(hunting): get_auth_request con 0x55bb6a538c40 auth_method 0 2024-09-12T00:54:13.226 INFO:tasks.workunit.client.0.smithi073.stderr: -342> 2024-09-12T00:54:12.945+0000 7f7bc470a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:13.226 INFO:tasks.workunit.client.0.smithi073.stderr: -341> 2024-09-12T00:54:12.945+0000 7f7bc470a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:13.226 INFO:tasks.workunit.client.0.smithi073.stderr: -340> 2024-09-12T00:54:12.945+0000 7f7bc470a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:13.226 INFO:tasks.workunit.client.0.smithi073.stderr: -339> 2024-09-12T00:54:12.945+0000 7f7bbbf09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:13.226 INFO:tasks.workunit.client.0.smithi073.stderr: -338> 2024-09-12T00:54:12.945+0000 7f7bbbf09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:13.226 INFO:tasks.workunit.client.0.smithi073.stderr: -337> 2024-09-12T00:54:12.945+0000 7f7bbbf09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:13.226 INFO:tasks.workunit.client.0.smithi073.stderr: -336> 2024-09-12T00:54:12.945+0000 7f7bc4f0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:13.227 INFO:tasks.workunit.client.0.smithi073.stderr: -335> 2024-09-12T00:54:12.945+0000 7f7bc4f0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:13.227 INFO:tasks.workunit.client.0.smithi073.stderr: -334> 2024-09-12T00:54:12.945+0000 7f7bc4f0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:13.227 INFO:tasks.workunit.client.0.smithi073.stderr: -333> 2024-09-12T00:54:12.945+0000 7f7bc470a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:13.227 INFO:tasks.workunit.client.0.smithi073.stderr: -332> 2024-09-12T00:54:12.945+0000 7f7bc470a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:13.227 INFO:tasks.workunit.client.0.smithi073.stderr: -331> 2024-09-12T00:54:12.945+0000 7f7bc470a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:13.227 INFO:tasks.workunit.client.0.smithi073.stderr: -330> 2024-09-12T00:54:12.945+0000 7f7bbbf09640 10 monclient(hunting): handle_auth_done global_id 7748 payload 824 2024-09-12T00:54:13.227 INFO:tasks.workunit.client.0.smithi073.stderr: -329> 2024-09-12T00:54:12.945+0000 7f7bbbf09640 10 monclient: _finish_hunting 0 2024-09-12T00:54:13.227 INFO:tasks.workunit.client.0.smithi073.stderr: -328> 2024-09-12T00:54:12.945+0000 7f7bbbf09640 1 monclient: found mon.noname-c 2024-09-12T00:54:13.227 INFO:tasks.workunit.client.0.smithi073.stderr: -327> 2024-09-12T00:54:12.945+0000 7f7bbbf09640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.73:3301/0 2024-09-12T00:54:13.227 INFO:tasks.workunit.client.0.smithi073.stderr: -326> 2024-09-12T00:54:12.945+0000 7f7aa9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:13.227 INFO:tasks.workunit.client.0.smithi073.stderr: -325> 2024-09-12T00:54:12.945+0000 7f7aa9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:54:13.227 INFO:tasks.workunit.client.0.smithi073.stderr: -324> 2024-09-12T00:54:12.945+0000 7f7aa9ffb640 10 monclient: dump: 2024-09-12T00:54:13.227 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:54:13.228 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:54:13.228 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:13.228 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:13.228 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:13.228 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:54:13.228 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:54:13.228 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:54:13.228 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:54:13.228 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:13.228 INFO:tasks.workunit.client.0.smithi073.stderr: -323> 2024-09-12T00:54:12.945+0000 7f7aa9ffb640 10 monclient: _finish_auth 0 2024-09-12T00:54:13.228 INFO:tasks.workunit.client.0.smithi073.stderr: -322> 2024-09-12T00:54:12.945+0000 7f7aa9ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:54:13.228 INFO:tasks.workunit.client.0.smithi073.stderr: -321> 2024-09-12T00:54:12.945+0000 7f7aa9ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:13.228 INFO:tasks.workunit.client.0.smithi073.stderr: -320> 2024-09-12T00:54:12.945+0000 7f7aa9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:13.229 INFO:tasks.workunit.client.0.smithi073.stderr: -319> 2024-09-12T00:54:12.945+0000 7f7aa9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:54:13.229 INFO:tasks.workunit.client.0.smithi073.stderr: -318> 2024-09-12T00:54:12.945+0000 7f7aa9ffb640 10 monclient: dump: 2024-09-12T00:54:13.229 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:54:13.229 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:54:13.229 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:13.229 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:13.229 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:13.229 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:54:13.229 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:54:13.229 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:54:13.229 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:54:13.229 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:13.229 INFO:tasks.workunit.client.0.smithi073.stderr: -317> 2024-09-12T00:54:12.945+0000 7f7bc6c20800 5 monclient: authenticate success, global_id 7748 2024-09-12T00:54:13.229 INFO:tasks.workunit.client.0.smithi073.stderr: -316> 2024-09-12T00:54:12.945+0000 7f7bc6c20800 10 monclient: _renew_subs 2024-09-12T00:54:13.230 INFO:tasks.workunit.client.0.smithi073.stderr: -315> 2024-09-12T00:54:12.945+0000 7f7bc570c640 4 set_mon_vals no callback set 2024-09-12T00:54:13.230 INFO:tasks.workunit.client.0.smithi073.stderr: -314> 2024-09-12T00:54:12.945+0000 7f7bc6c20800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:54:13.230 INFO:tasks.workunit.client.0.smithi073.stderr: -313> 2024-09-12T00:54:12.945+0000 7f7bc6c20800 10 monclient: _renew_subs 2024-09-12T00:54:13.230 INFO:tasks.workunit.client.0.smithi073.stderr: -312> 2024-09-12T00:54:12.945+0000 7f7bc6c20800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:54:13.230 INFO:tasks.workunit.client.0.smithi073.stderr: -311> 2024-09-12T00:54:12.947+0000 7f7aa9ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:54:13.230 INFO:tasks.workunit.client.0.smithi073.stderr: -310> 2024-09-12T00:54:12.947+0000 7f7aa9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:54:13.230 INFO:tasks.workunit.client.0.smithi073.stderr: -309> 2024-09-12T00:54:12.947+0000 7f7aa9ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:54:13.230 INFO:tasks.workunit.client.0.smithi073.stderr: -308> 2024-09-12T00:54:12.947+0000 7f7bc470a640 10 monclient: get_auth_request con 0x7f7a9c076380 auth_method 0 2024-09-12T00:54:13.230 INFO:tasks.workunit.client.0.smithi073.stderr: -307> 2024-09-12T00:54:12.947+0000 7f7bc6c20800 10 monclient: get_monmap_and_config 2024-09-12T00:54:13.230 INFO:tasks.workunit.client.0.smithi073.stderr: -306> 2024-09-12T00:54:12.947+0000 7f7bc6c20800 10 monclient: build_initial_monmap 2024-09-12T00:54:13.230 INFO:tasks.workunit.client.0.smithi073.stderr: -305> 2024-09-12T00:54:12.947+0000 7f7bc6c20800 1 build_initial for_mkfs: 0 2024-09-12T00:54:13.230 INFO:tasks.workunit.client.0.smithi073.stderr: -304> 2024-09-12T00:54:12.947+0000 7f7bc6c20800 10 monclient: monmap: 2024-09-12T00:54:13.230 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:54:13.231 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:54:13.231 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:54:13.231 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:54:13.231 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:54:13.231 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:54:13.231 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:54:13.231 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:54:13.231 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:54:13.231 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:13.231 INFO:tasks.workunit.client.0.smithi073.stderr: -303> 2024-09-12T00:54:12.947+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a558960) adding auth protocol: cephx 2024-09-12T00:54:13.231 INFO:tasks.workunit.client.0.smithi073.stderr: -302> 2024-09-12T00:54:12.947+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a558960) adding auth protocol: cephx 2024-09-12T00:54:13.231 INFO:tasks.workunit.client.0.smithi073.stderr: -301> 2024-09-12T00:54:12.947+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a558960) adding auth protocol: cephx 2024-09-12T00:54:13.231 INFO:tasks.workunit.client.0.smithi073.stderr: -300> 2024-09-12T00:54:12.947+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a558960) adding con mode: secure 2024-09-12T00:54:13.231 INFO:tasks.workunit.client.0.smithi073.stderr: -299> 2024-09-12T00:54:12.947+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a558960) adding con mode: crc 2024-09-12T00:54:13.232 INFO:tasks.workunit.client.0.smithi073.stderr: -298> 2024-09-12T00:54:12.947+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a558960) adding con mode: secure 2024-09-12T00:54:13.232 INFO:tasks.workunit.client.0.smithi073.stderr: -297> 2024-09-12T00:54:12.947+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a558960) adding con mode: crc 2024-09-12T00:54:13.232 INFO:tasks.workunit.client.0.smithi073.stderr: -296> 2024-09-12T00:54:12.947+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a558960) adding con mode: secure 2024-09-12T00:54:13.232 INFO:tasks.workunit.client.0.smithi073.stderr: -295> 2024-09-12T00:54:12.947+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a558960) adding con mode: crc 2024-09-12T00:54:13.232 INFO:tasks.workunit.client.0.smithi073.stderr: -294> 2024-09-12T00:54:12.947+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a558960) adding con mode: crc 2024-09-12T00:54:13.232 INFO:tasks.workunit.client.0.smithi073.stderr: -293> 2024-09-12T00:54:12.947+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a558960) adding con mode: secure 2024-09-12T00:54:13.232 INFO:tasks.workunit.client.0.smithi073.stderr: -292> 2024-09-12T00:54:12.947+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a558960) adding con mode: crc 2024-09-12T00:54:13.232 INFO:tasks.workunit.client.0.smithi073.stderr: -291> 2024-09-12T00:54:12.947+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a558960) adding con mode: secure 2024-09-12T00:54:13.232 INFO:tasks.workunit.client.0.smithi073.stderr: -290> 2024-09-12T00:54:12.947+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a558960) adding con mode: crc 2024-09-12T00:54:13.232 INFO:tasks.workunit.client.0.smithi073.stderr: -289> 2024-09-12T00:54:12.947+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a558960) adding con mode: secure 2024-09-12T00:54:13.232 INFO:tasks.workunit.client.0.smithi073.stderr: -288> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:13.232 INFO:tasks.workunit.client.0.smithi073.stderr: -287> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 10 monclient: init 2024-09-12T00:54:13.232 INFO:tasks.workunit.client.0.smithi073.stderr: -286> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad1f40) adding auth protocol: cephx 2024-09-12T00:54:13.233 INFO:tasks.workunit.client.0.smithi073.stderr: -285> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad1f40) adding auth protocol: cephx 2024-09-12T00:54:13.233 INFO:tasks.workunit.client.0.smithi073.stderr: -284> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad1f40) adding auth protocol: cephx 2024-09-12T00:54:13.233 INFO:tasks.workunit.client.0.smithi073.stderr: -283> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad1f40) adding con mode: secure 2024-09-12T00:54:13.233 INFO:tasks.workunit.client.0.smithi073.stderr: -282> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad1f40) adding con mode: crc 2024-09-12T00:54:13.233 INFO:tasks.workunit.client.0.smithi073.stderr: -281> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad1f40) adding con mode: secure 2024-09-12T00:54:13.233 INFO:tasks.workunit.client.0.smithi073.stderr: -280> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad1f40) adding con mode: crc 2024-09-12T00:54:13.233 INFO:tasks.workunit.client.0.smithi073.stderr: -279> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad1f40) adding con mode: secure 2024-09-12T00:54:13.233 INFO:tasks.workunit.client.0.smithi073.stderr: -278> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad1f40) adding con mode: crc 2024-09-12T00:54:13.233 INFO:tasks.workunit.client.0.smithi073.stderr: -277> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad1f40) adding con mode: crc 2024-09-12T00:54:13.233 INFO:tasks.workunit.client.0.smithi073.stderr: -276> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad1f40) adding con mode: secure 2024-09-12T00:54:13.233 INFO:tasks.workunit.client.0.smithi073.stderr: -275> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad1f40) adding con mode: crc 2024-09-12T00:54:13.233 INFO:tasks.workunit.client.0.smithi073.stderr: -274> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad1f40) adding con mode: secure 2024-09-12T00:54:13.233 INFO:tasks.workunit.client.0.smithi073.stderr: -273> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad1f40) adding con mode: crc 2024-09-12T00:54:13.234 INFO:tasks.workunit.client.0.smithi073.stderr: -272> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad1f40) adding con mode: secure 2024-09-12T00:54:13.234 INFO:tasks.workunit.client.0.smithi073.stderr: -271> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:13.234 INFO:tasks.workunit.client.0.smithi073.stderr: -270> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:13.234 INFO:tasks.workunit.client.0.smithi073.stderr: -269> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 5 asok(0x55bb6a29c630) register_command rotate-key cmddesc rotate-key hook 0x7ffcf9ad2088 EEXIST 2024-09-12T00:54:13.234 INFO:tasks.workunit.client.0.smithi073.stderr: -268> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 10 monclient: _reopen_session rank -1 2024-09-12T00:54:13.234 INFO:tasks.workunit.client.0.smithi073.stderr: -267> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:54:13.234 INFO:tasks.workunit.client.0.smithi073.stderr: -266> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 10 monclient(hunting): picked mon.noname-b con 0x55bb6a58cfc0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:54:13.234 INFO:tasks.workunit.client.0.smithi073.stderr: -265> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 10 monclient(hunting): picked mon.noname-a con 0x55bb6a55dfd0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:54:13.234 INFO:tasks.workunit.client.0.smithi073.stderr: -264> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 10 monclient(hunting): picked mon.noname-c con 0x55bb6a5884a0 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:54:13.234 INFO:tasks.workunit.client.0.smithi073.stderr: -263> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:13.234 INFO:tasks.workunit.client.0.smithi073.stderr: -262> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:13.234 INFO:tasks.workunit.client.0.smithi073.stderr: -261> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:13.234 INFO:tasks.workunit.client.0.smithi073.stderr: -260> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 10 monclient(hunting): _renew_subs 2024-09-12T00:54:13.235 INFO:tasks.workunit.client.0.smithi073.stderr: -259> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 10 monclient(hunting): authenticate will time out at 2313.618733s 2024-09-12T00:54:13.235 INFO:tasks.workunit.client.0.smithi073.stderr: -258> 2024-09-12T00:54:12.948+0000 7f7bc4f0b640 10 monclient(hunting): get_auth_request con 0x55bb6a5884a0 auth_method 0 2024-09-12T00:54:13.235 INFO:tasks.workunit.client.0.smithi073.stderr: -257> 2024-09-12T00:54:12.948+0000 7f7bc4f0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:13.235 INFO:tasks.workunit.client.0.smithi073.stderr: -256> 2024-09-12T00:54:12.948+0000 7f7bc4f0b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:13.235 INFO:tasks.workunit.client.0.smithi073.stderr: -255> 2024-09-12T00:54:12.948+0000 7f7bc4f0b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:13.235 INFO:tasks.workunit.client.0.smithi073.stderr: -254> 2024-09-12T00:54:12.948+0000 7f7bbbf09640 10 monclient(hunting): get_auth_request con 0x55bb6a55dfd0 auth_method 0 2024-09-12T00:54:13.235 INFO:tasks.workunit.client.0.smithi073.stderr: -253> 2024-09-12T00:54:12.948+0000 7f7bbbf09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:13.235 INFO:tasks.workunit.client.0.smithi073.stderr: -252> 2024-09-12T00:54:12.948+0000 7f7bbbf09640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:13.235 INFO:tasks.workunit.client.0.smithi073.stderr: -251> 2024-09-12T00:54:12.948+0000 7f7bbbf09640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:13.235 INFO:tasks.workunit.client.0.smithi073.stderr: -250> 2024-09-12T00:54:12.948+0000 7f7bc470a640 10 monclient(hunting): get_auth_request con 0x55bb6a58cfc0 auth_method 0 2024-09-12T00:54:13.235 INFO:tasks.workunit.client.0.smithi073.stderr: -249> 2024-09-12T00:54:12.948+0000 7f7bc470a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:13.235 INFO:tasks.workunit.client.0.smithi073.stderr: -248> 2024-09-12T00:54:12.948+0000 7f7bc470a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:13.235 INFO:tasks.workunit.client.0.smithi073.stderr: -247> 2024-09-12T00:54:12.948+0000 7f7bc470a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:13.236 INFO:tasks.workunit.client.0.smithi073.stderr: -246> 2024-09-12T00:54:12.948+0000 7f7bbbf09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:13.236 INFO:tasks.workunit.client.0.smithi073.stderr: -245> 2024-09-12T00:54:12.948+0000 7f7bbbf09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:13.236 INFO:tasks.workunit.client.0.smithi073.stderr: -244> 2024-09-12T00:54:12.948+0000 7f7bbbf09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:13.236 INFO:tasks.workunit.client.0.smithi073.stderr: -243> 2024-09-12T00:54:12.948+0000 7f7bc4f0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:13.236 INFO:tasks.workunit.client.0.smithi073.stderr: -242> 2024-09-12T00:54:12.948+0000 7f7bc4f0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:13.236 INFO:tasks.workunit.client.0.smithi073.stderr: -241> 2024-09-12T00:54:12.948+0000 7f7bc4f0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:13.236 INFO:tasks.workunit.client.0.smithi073.stderr: -240> 2024-09-12T00:54:12.948+0000 7f7bc470a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:13.236 INFO:tasks.workunit.client.0.smithi073.stderr: -239> 2024-09-12T00:54:12.948+0000 7f7bc470a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:13.236 INFO:tasks.workunit.client.0.smithi073.stderr: -238> 2024-09-12T00:54:12.948+0000 7f7bc470a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:13.236 INFO:tasks.workunit.client.0.smithi073.stderr: -237> 2024-09-12T00:54:12.949+0000 7f7bbbf09640 10 monclient(hunting): handle_auth_done global_id 8268 payload 274 2024-09-12T00:54:13.236 INFO:tasks.workunit.client.0.smithi073.stderr: -236> 2024-09-12T00:54:12.949+0000 7f7bbbf09640 10 monclient: _finish_hunting 0 2024-09-12T00:54:13.236 INFO:tasks.workunit.client.0.smithi073.stderr: -235> 2024-09-12T00:54:12.949+0000 7f7bbbf09640 1 monclient: found mon.noname-a 2024-09-12T00:54:13.237 INFO:tasks.workunit.client.0.smithi073.stderr: -234> 2024-09-12T00:54:12.949+0000 7f7bbbf09640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:54:13.237 INFO:tasks.workunit.client.0.smithi073.stderr: -233> 2024-09-12T00:54:12.949+0000 7f7a9b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:13.237 INFO:tasks.workunit.client.0.smithi073.stderr: -232> 2024-09-12T00:54:12.949+0000 7f7a9b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:54:13.237 INFO:tasks.workunit.client.0.smithi073.stderr: -231> 2024-09-12T00:54:12.949+0000 7f7a9b7fe640 10 monclient: dump: 2024-09-12T00:54:13.237 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:54:13.237 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:54:13.237 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:13.237 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:13.237 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:13.237 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:54:13.237 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:54:13.237 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:54:13.237 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:54:13.238 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:13.238 INFO:tasks.workunit.client.0.smithi073.stderr: -230> 2024-09-12T00:54:12.949+0000 7f7a9b7fe640 10 monclient: _finish_auth 0 2024-09-12T00:54:13.238 INFO:tasks.workunit.client.0.smithi073.stderr: -229> 2024-09-12T00:54:12.949+0000 7f7a9b7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:54:13.238 INFO:tasks.workunit.client.0.smithi073.stderr: -228> 2024-09-12T00:54:12.949+0000 7f7a9b7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:13.238 INFO:tasks.workunit.client.0.smithi073.stderr: -227> 2024-09-12T00:54:12.949+0000 7f7a9b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:13.238 INFO:tasks.workunit.client.0.smithi073.stderr: -226> 2024-09-12T00:54:12.949+0000 7f7a9b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:54:13.238 INFO:tasks.workunit.client.0.smithi073.stderr: -225> 2024-09-12T00:54:12.949+0000 7f7a9b7fe640 10 monclient: dump: 2024-09-12T00:54:13.238 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:54:13.238 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:54:13.238 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:13.238 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:13.238 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:13.238 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:54:13.239 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:54:13.239 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:54:13.239 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:54:13.239 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:13.239 INFO:tasks.workunit.client.0.smithi073.stderr: -224> 2024-09-12T00:54:12.949+0000 7f7bc6c20800 5 monclient: authenticate success, global_id 8268 2024-09-12T00:54:13.239 INFO:tasks.workunit.client.0.smithi073.stderr: -223> 2024-09-12T00:54:12.949+0000 7f7bc6c20800 10 monclient: get_monmap_and_config success 2024-09-12T00:54:13.239 INFO:tasks.workunit.client.0.smithi073.stderr: -222> 2024-09-12T00:54:12.949+0000 7f7bc6c20800 4 set_mon_vals no callback set 2024-09-12T00:54:13.239 INFO:tasks.workunit.client.0.smithi073.stderr: -221> 2024-09-12T00:54:12.949+0000 7f7bc6c20800 10 monclient: shutdown 2024-09-12T00:54:13.239 INFO:tasks.workunit.client.0.smithi073.stderr: -220> 2024-09-12T00:54:12.949+0000 7f7bc6c20800 10 monclient: build_initial_monmap 2024-09-12T00:54:13.239 INFO:tasks.workunit.client.0.smithi073.stderr: -219> 2024-09-12T00:54:12.949+0000 7f7bc6c20800 1 build_initial for_mkfs: 0 2024-09-12T00:54:13.239 INFO:tasks.workunit.client.0.smithi073.stderr: -218> 2024-09-12T00:54:12.949+0000 7f7bc6c20800 10 monclient: monmap: 2024-09-12T00:54:13.239 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:54:13.239 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:54:13.239 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:54:13.240 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:54:13.240 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:54:13.240 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:54:13.240 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:54:13.240 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:54:13.240 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:54:13.240 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:13.240 INFO:tasks.workunit.client.0.smithi073.stderr: -217> 2024-09-12T00:54:12.949+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a57ebf0) adding auth protocol: cephx 2024-09-12T00:54:13.240 INFO:tasks.workunit.client.0.smithi073.stderr: -216> 2024-09-12T00:54:12.949+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a57ebf0) adding auth protocol: cephx 2024-09-12T00:54:13.240 INFO:tasks.workunit.client.0.smithi073.stderr: -215> 2024-09-12T00:54:12.949+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a57ebf0) adding auth protocol: cephx 2024-09-12T00:54:13.240 INFO:tasks.workunit.client.0.smithi073.stderr: -214> 2024-09-12T00:54:12.949+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a57ebf0) adding con mode: secure 2024-09-12T00:54:13.241 INFO:tasks.workunit.client.0.smithi073.stderr: -213> 2024-09-12T00:54:12.949+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a57ebf0) adding con mode: crc 2024-09-12T00:54:13.241 INFO:tasks.workunit.client.0.smithi073.stderr: -212> 2024-09-12T00:54:12.949+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a57ebf0) adding con mode: secure 2024-09-12T00:54:13.241 INFO:tasks.workunit.client.0.smithi073.stderr: -211> 2024-09-12T00:54:12.949+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a57ebf0) adding con mode: crc 2024-09-12T00:54:13.241 INFO:tasks.workunit.client.0.smithi073.stderr: -210> 2024-09-12T00:54:12.949+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a57ebf0) adding con mode: secure 2024-09-12T00:54:13.241 INFO:tasks.workunit.client.0.smithi073.stderr: -209> 2024-09-12T00:54:12.949+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a57ebf0) adding con mode: crc 2024-09-12T00:54:13.241 INFO:tasks.workunit.client.0.smithi073.stderr: -208> 2024-09-12T00:54:12.949+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a57ebf0) adding con mode: crc 2024-09-12T00:54:13.241 INFO:tasks.workunit.client.0.smithi073.stderr: -207> 2024-09-12T00:54:12.949+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a57ebf0) adding con mode: secure 2024-09-12T00:54:13.241 INFO:tasks.workunit.client.0.smithi073.stderr: -206> 2024-09-12T00:54:12.949+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a57ebf0) adding con mode: crc 2024-09-12T00:54:13.241 INFO:tasks.workunit.client.0.smithi073.stderr: -205> 2024-09-12T00:54:12.949+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a57ebf0) adding con mode: secure 2024-09-12T00:54:13.241 INFO:tasks.workunit.client.0.smithi073.stderr: -204> 2024-09-12T00:54:12.949+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a57ebf0) adding con mode: crc 2024-09-12T00:54:13.241 INFO:tasks.workunit.client.0.smithi073.stderr: -203> 2024-09-12T00:54:12.949+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a57ebf0) adding con mode: secure 2024-09-12T00:54:13.241 INFO:tasks.workunit.client.0.smithi073.stderr: -202> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:13.241 INFO:tasks.workunit.client.0.smithi073.stderr: -201> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 1 librados: starting msgr at 2024-09-12T00:54:13.242 INFO:tasks.workunit.client.0.smithi073.stderr: -200> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 1 librados: starting objecter 2024-09-12T00:54:13.242 INFO:tasks.workunit.client.0.smithi073.stderr: -199> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 5 asok(0x55bb6a29c630) register_command objecter_requests cmddesc objecter_requests hook 0x55bb6a58d6e0 EEXIST 2024-09-12T00:54:13.242 INFO:tasks.workunit.client.0.smithi073.stderr: -198> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 1 librados: setting wanted keys 2024-09-12T00:54:13.242 INFO:tasks.workunit.client.0.smithi073.stderr: -197> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 1 librados: calling monclient init 2024-09-12T00:54:13.242 INFO:tasks.workunit.client.0.smithi073.stderr: -196> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 10 monclient: init 2024-09-12T00:54:13.242 INFO:tasks.workunit.client.0.smithi073.stderr: -195> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a54d500) adding auth protocol: cephx 2024-09-12T00:54:13.242 INFO:tasks.workunit.client.0.smithi073.stderr: -194> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a54d500) adding auth protocol: cephx 2024-09-12T00:54:13.242 INFO:tasks.workunit.client.0.smithi073.stderr: -193> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a54d500) adding auth protocol: cephx 2024-09-12T00:54:13.242 INFO:tasks.workunit.client.0.smithi073.stderr: -192> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a54d500) adding con mode: secure 2024-09-12T00:54:13.242 INFO:tasks.workunit.client.0.smithi073.stderr: -191> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a54d500) adding con mode: crc 2024-09-12T00:54:13.242 INFO:tasks.workunit.client.0.smithi073.stderr: -190> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a54d500) adding con mode: secure 2024-09-12T00:54:13.242 INFO:tasks.workunit.client.0.smithi073.stderr: -189> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a54d500) adding con mode: crc 2024-09-12T00:54:13.242 INFO:tasks.workunit.client.0.smithi073.stderr: -188> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a54d500) adding con mode: secure 2024-09-12T00:54:13.243 INFO:tasks.workunit.client.0.smithi073.stderr: -187> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a54d500) adding con mode: crc 2024-09-12T00:54:13.243 INFO:tasks.workunit.client.0.smithi073.stderr: -186> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a54d500) adding con mode: crc 2024-09-12T00:54:13.243 INFO:tasks.workunit.client.0.smithi073.stderr: -185> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a54d500) adding con mode: secure 2024-09-12T00:54:13.243 INFO:tasks.workunit.client.0.smithi073.stderr: -184> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a54d500) adding con mode: crc 2024-09-12T00:54:13.243 INFO:tasks.workunit.client.0.smithi073.stderr: -183> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a54d500) adding con mode: secure 2024-09-12T00:54:13.243 INFO:tasks.workunit.client.0.smithi073.stderr: -182> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a54d500) adding con mode: crc 2024-09-12T00:54:13.243 INFO:tasks.workunit.client.0.smithi073.stderr: -181> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a54d500) adding con mode: secure 2024-09-12T00:54:13.243 INFO:tasks.workunit.client.0.smithi073.stderr: -180> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:13.243 INFO:tasks.workunit.client.0.smithi073.stderr: -179> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:13.243 INFO:tasks.workunit.client.0.smithi073.stderr: -178> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 5 asok(0x55bb6a29c630) register_command rotate-key cmddesc rotate-key hook 0x55bb6a54d648 EEXIST 2024-09-12T00:54:13.243 INFO:tasks.workunit.client.0.smithi073.stderr: -177> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 10 monclient: _reopen_session rank -1 2024-09-12T00:54:13.243 INFO:tasks.workunit.client.0.smithi073.stderr: -176> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:54:13.243 INFO:tasks.workunit.client.0.smithi073.stderr: -175> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 10 monclient(hunting): picked mon.noname-c con 0x55bb6a55dfd0 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:54:13.244 INFO:tasks.workunit.client.0.smithi073.stderr: -174> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 10 monclient(hunting): picked mon.noname-a con 0x55bb6a5884a0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:54:13.244 INFO:tasks.workunit.client.0.smithi073.stderr: -173> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 10 monclient(hunting): picked mon.noname-b con 0x55bb6a58cfc0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:54:13.244 INFO:tasks.workunit.client.0.smithi073.stderr: -172> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:13.244 INFO:tasks.workunit.client.0.smithi073.stderr: -171> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:13.244 INFO:tasks.workunit.client.0.smithi073.stderr: -170> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:13.244 INFO:tasks.workunit.client.0.smithi073.stderr: -169> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 10 monclient(hunting): _renew_subs 2024-09-12T00:54:13.244 INFO:tasks.workunit.client.0.smithi073.stderr: -168> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 10 monclient(hunting): authenticate will time out at 2313.620913s 2024-09-12T00:54:13.244 INFO:tasks.workunit.client.0.smithi073.stderr: -167> 2024-09-12T00:54:12.951+0000 7f7bc470a640 10 monclient(hunting): get_auth_request con 0x55bb6a55dfd0 auth_method 0 2024-09-12T00:54:13.244 INFO:tasks.workunit.client.0.smithi073.stderr: -166> 2024-09-12T00:54:12.951+0000 7f7bc470a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:13.244 INFO:tasks.workunit.client.0.smithi073.stderr: -165> 2024-09-12T00:54:12.951+0000 7f7bc470a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:13.244 INFO:tasks.workunit.client.0.smithi073.stderr: -164> 2024-09-12T00:54:12.951+0000 7f7bc470a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:13.244 INFO:tasks.workunit.client.0.smithi073.stderr: -163> 2024-09-12T00:54:12.951+0000 7f7bbbf09640 10 monclient(hunting): get_auth_request con 0x55bb6a5884a0 auth_method 0 2024-09-12T00:54:13.244 INFO:tasks.workunit.client.0.smithi073.stderr: -162> 2024-09-12T00:54:12.951+0000 7f7bbbf09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:13.245 INFO:tasks.workunit.client.0.smithi073.stderr: -161> 2024-09-12T00:54:12.951+0000 7f7bbbf09640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:13.245 INFO:tasks.workunit.client.0.smithi073.stderr: -160> 2024-09-12T00:54:12.951+0000 7f7bbbf09640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:13.245 INFO:tasks.workunit.client.0.smithi073.stderr: -159> 2024-09-12T00:54:12.951+0000 7f7bc4f0b640 10 monclient(hunting): get_auth_request con 0x55bb6a58cfc0 auth_method 0 2024-09-12T00:54:13.245 INFO:tasks.workunit.client.0.smithi073.stderr: -158> 2024-09-12T00:54:12.951+0000 7f7bc4f0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:13.245 INFO:tasks.workunit.client.0.smithi073.stderr: -157> 2024-09-12T00:54:12.951+0000 7f7bc4f0b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:13.245 INFO:tasks.workunit.client.0.smithi073.stderr: -156> 2024-09-12T00:54:12.951+0000 7f7bc4f0b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:13.245 INFO:tasks.workunit.client.0.smithi073.stderr: -155> 2024-09-12T00:54:12.951+0000 7f7bc470a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:13.245 INFO:tasks.workunit.client.0.smithi073.stderr: -154> 2024-09-12T00:54:12.951+0000 7f7bc470a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:13.245 INFO:tasks.workunit.client.0.smithi073.stderr: -153> 2024-09-12T00:54:12.951+0000 7f7bc470a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:13.245 INFO:tasks.workunit.client.0.smithi073.stderr: -152> 2024-09-12T00:54:12.951+0000 7f7bbbf09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:13.245 INFO:tasks.workunit.client.0.smithi073.stderr: -151> 2024-09-12T00:54:12.951+0000 7f7bbbf09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:13.245 INFO:tasks.workunit.client.0.smithi073.stderr: -150> 2024-09-12T00:54:12.951+0000 7f7bbbf09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:13.245 INFO:tasks.workunit.client.0.smithi073.stderr: -149> 2024-09-12T00:54:12.951+0000 7f7bc4f0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:13.245 INFO:tasks.workunit.client.0.smithi073.stderr: -148> 2024-09-12T00:54:12.951+0000 7f7bc4f0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:13.246 INFO:tasks.workunit.client.0.smithi073.stderr: -147> 2024-09-12T00:54:12.951+0000 7f7bc4f0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:13.246 INFO:tasks.workunit.client.0.smithi073.stderr: -146> 2024-09-12T00:54:12.951+0000 7f7bbbf09640 10 monclient(hunting): handle_auth_done global_id 8271 payload 824 2024-09-12T00:54:13.246 INFO:tasks.workunit.client.0.smithi073.stderr: -145> 2024-09-12T00:54:12.951+0000 7f7bbbf09640 10 monclient: _finish_hunting 0 2024-09-12T00:54:13.246 INFO:tasks.workunit.client.0.smithi073.stderr: -144> 2024-09-12T00:54:12.951+0000 7f7bbbf09640 1 monclient: found mon.noname-a 2024-09-12T00:54:13.246 INFO:tasks.workunit.client.0.smithi073.stderr: -143> 2024-09-12T00:54:12.951+0000 7f7bbbf09640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:54:13.246 INFO:tasks.workunit.client.0.smithi073.stderr: -142> 2024-09-12T00:54:12.951+0000 7f7a99ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:13.246 INFO:tasks.workunit.client.0.smithi073.stderr: -141> 2024-09-12T00:54:12.951+0000 7f7a99ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:54:13.246 INFO:tasks.workunit.client.0.smithi073.stderr: -140> 2024-09-12T00:54:12.951+0000 7f7a99ffb640 10 monclient: dump: 2024-09-12T00:54:13.246 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:54:13.246 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:54:13.246 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:13.246 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:13.246 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:13.247 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:54:13.247 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:54:13.247 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:54:13.247 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:54:13.247 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:13.247 INFO:tasks.workunit.client.0.smithi073.stderr: -139> 2024-09-12T00:54:12.951+0000 7f7a99ffb640 10 monclient: _finish_auth 0 2024-09-12T00:54:13.247 INFO:tasks.workunit.client.0.smithi073.stderr: -138> 2024-09-12T00:54:12.951+0000 7f7a99ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:54:13.247 INFO:tasks.workunit.client.0.smithi073.stderr: -137> 2024-09-12T00:54:12.951+0000 7f7a99ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:13.247 INFO:tasks.workunit.client.0.smithi073.stderr: -136> 2024-09-12T00:54:12.951+0000 7f7a99ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:13.247 INFO:tasks.workunit.client.0.smithi073.stderr: -135> 2024-09-12T00:54:12.951+0000 7f7a99ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:54:13.247 INFO:tasks.workunit.client.0.smithi073.stderr: -134> 2024-09-12T00:54:12.951+0000 7f7a99ffb640 10 monclient: dump: 2024-09-12T00:54:13.247 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:54:13.247 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:54:13.248 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:13.248 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:13.248 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:13.248 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:54:13.248 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:54:13.248 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:54:13.248 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:54:13.248 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:13.248 INFO:tasks.workunit.client.0.smithi073.stderr: -133> 2024-09-12T00:54:12.951+0000 7f7bc6c20800 5 monclient: authenticate success, global_id 8271 2024-09-12T00:54:13.248 INFO:tasks.workunit.client.0.smithi073.stderr: -132> 2024-09-12T00:54:12.951+0000 7f7bc6c20800 10 monclient: _renew_subs 2024-09-12T00:54:13.248 INFO:tasks.workunit.client.0.smithi073.stderr: -131> 2024-09-12T00:54:12.951+0000 7f7a9b7fe640 4 set_mon_vals no callback set 2024-09-12T00:54:13.248 INFO:tasks.workunit.client.0.smithi073.stderr: -130> 2024-09-12T00:54:12.951+0000 7f7bc6c20800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:54:13.248 INFO:tasks.workunit.client.0.smithi073.stderr: -129> 2024-09-12T00:54:12.951+0000 7f7bc6c20800 10 monclient: _renew_subs 2024-09-12T00:54:13.248 INFO:tasks.workunit.client.0.smithi073.stderr: -128> 2024-09-12T00:54:12.951+0000 7f7bc6c20800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:54:13.249 INFO:tasks.workunit.client.0.smithi073.stderr: -127> 2024-09-12T00:54:12.951+0000 7f7bc6c20800 1 librados: init done 2024-09-12T00:54:13.249 INFO:tasks.workunit.client.0.smithi073.stderr: -126> 2024-09-12T00:54:12.951+0000 7f7bc6c20800 5 asok(0x55bb6a29c630) register_command cr dump hook 0x55bb6a55d0b8 2024-09-12T00:54:13.249 INFO:tasks.workunit.client.0.smithi073.stderr: -125> 2024-09-12T00:54:12.953+0000 7f7bc6c20800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.249 INFO:tasks.workunit.client.0.smithi073.stderr: -124> 2024-09-12T00:54:12.953+0000 7f7a99ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:54:13.249 INFO:tasks.workunit.client.0.smithi073.stderr: -123> 2024-09-12T00:54:12.953+0000 7f7a99ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:54:13.249 INFO:tasks.workunit.client.0.smithi073.stderr: -122> 2024-09-12T00:54:12.953+0000 7f7a99ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:54:13.249 INFO:tasks.workunit.client.0.smithi073.stderr: -121> 2024-09-12T00:54:12.953+0000 7f7bc470a640 10 monclient: get_auth_request con 0x7f7a8c0764a0 auth_method 0 2024-09-12T00:54:13.249 INFO:tasks.workunit.client.0.smithi073.stderr: -120> 2024-09-12T00:54:12.953+0000 7f7bc4f0b640 10 monclient: get_auth_request con 0x55bb6a5a6bc0 auth_method 0 2024-09-12T00:54:13.249 INFO:tasks.workunit.client.0.smithi073.stderr: -119> 2024-09-12T00:54:12.954+0000 7f7bc6c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:13.249 INFO:tasks.workunit.client.0.smithi073.stderr: -118> 2024-09-12T00:54:12.954+0000 7f7bc6c20800 20 realm 2024-09-12T00:54:13.249 INFO:tasks.workunit.client.0.smithi073.stderr: -117> 2024-09-12T00:54:12.954+0000 7f7bc6c20800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.249 INFO:tasks.workunit.client.0.smithi073.stderr: -116> 2024-09-12T00:54:12.954+0000 7f7bc6c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:13.250 INFO:tasks.workunit.client.0.smithi073.stderr: -115> 2024-09-12T00:54:12.954+0000 7f7bc6c20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:13.250 INFO:tasks.workunit.client.0.smithi073.stderr: -114> 2024-09-12T00:54:12.954+0000 7f7bc6c20800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.250 INFO:tasks.workunit.client.0.smithi073.stderr: -113> 2024-09-12T00:54:12.954+0000 7f7bc6c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:13.250 INFO:tasks.workunit.client.0.smithi073.stderr: -112> 2024-09-12T00:54:12.954+0000 7f7bc6c20800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.250 INFO:tasks.workunit.client.0.smithi073.stderr: -111> 2024-09-12T00:54:12.954+0000 7f7bc470a640 10 monclient: get_auth_request con 0x55bb6a5aaef0 auth_method 0 2024-09-12T00:54:13.250 INFO:tasks.workunit.client.0.smithi073.stderr: -110> 2024-09-12T00:54:12.955+0000 7f7bc6c20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:13.250 INFO:tasks.workunit.client.0.smithi073.stderr: -109> 2024-09-12T00:54:12.955+0000 7f7bc6c20800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.250 INFO:tasks.workunit.client.0.smithi073.stderr: -108> 2024-09-12T00:54:12.955+0000 7f7bbbf09640 10 monclient: get_auth_request con 0x55bb6a5ae610 auth_method 0 2024-09-12T00:54:13.250 INFO:tasks.workunit.client.0.smithi073.stderr: -107> 2024-09-12T00:54:12.956+0000 7f7bc6c20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:13.250 INFO:tasks.workunit.client.0.smithi073.stderr: -106> 2024-09-12T00:54:12.956+0000 7f7bc6c20800 20 searching for the correct realm 2024-09-12T00:54:13.250 INFO:tasks.workunit.client.0.smithi073.stderr: -105> 2024-09-12T00:54:12.956+0000 7f7bc4f0b640 10 monclient: get_auth_request con 0x55bb6a5b3390 auth_method 0 2024-09-12T00:54:13.250 INFO:tasks.workunit.client.0.smithi073.stderr: -104> 2024-09-12T00:54:12.957+0000 7f7bc470a640 10 monclient: get_auth_request con 0x7f7bbc062940 auth_method 0 2024-09-12T00:54:13.250 INFO:tasks.workunit.client.0.smithi073.stderr: -103> 2024-09-12T00:54:12.957+0000 7f7bbbf09640 10 monclient: get_auth_request con 0x7f7bb4009040 auth_method 0 2024-09-12T00:54:13.251 INFO:tasks.workunit.client.0.smithi073.stderr: -102> 2024-09-12T00:54:12.958+0000 7f7bc4f0b640 10 monclient: get_auth_request con 0x7f7bac02b800 auth_method 0 2024-09-12T00:54:13.251 INFO:tasks.workunit.client.0.smithi073.stderr: -101> 2024-09-12T00:54:12.958+0000 7f7bc4f0b640 0 -- 172.21.15.73:0/2314965784 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f7bac02b800 msgr2=0x7f7bac0023e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:13.251 INFO:tasks.workunit.client.0.smithi073.stderr: -100> 2024-09-12T00:54:13.160+0000 7f7bc4f0b640 10 monclient: get_auth_request con 0x7f7bac02b800 auth_method 0 2024-09-12T00:54:13.251 INFO:tasks.workunit.client.0.smithi073.stderr: -99> 2024-09-12T00:54:13.164+0000 7f7bc470a640 10 monclient: get_auth_request con 0x7f7bbc086040 auth_method 0 2024-09-12T00:54:13.251 INFO:tasks.workunit.client.0.smithi073.stderr: -98> 2024-09-12T00:54:13.165+0000 7f7bc4f0b640 0 -- 172.21.15.73:0/2314965784 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f7bac02b800 msgr2=0x7f7bac0023e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:13.251 INFO:tasks.workunit.client.0.smithi073.stderr: -97> 2024-09-12T00:54:13.165+0000 7f7a99ffb640 1 client.8271.objecter ms_handle_reset 0x7f7bac02b800 session 0x7f7bac027e90 osd.4 2024-09-12T00:54:13.251 INFO:tasks.workunit.client.0.smithi073.stderr: -96> 2024-09-12T00:54:13.165+0000 7f7a99ffb640 10 monclient: _renew_subs 2024-09-12T00:54:13.251 INFO:tasks.workunit.client.0.smithi073.stderr: -95> 2024-09-12T00:54:13.165+0000 7f7a99ffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:54:13.251 INFO:tasks.workunit.client.0.smithi073.stderr: -94> 2024-09-12T00:54:13.165+0000 7f7bc4f0b640 10 monclient: get_auth_request con 0x7f7a8c0863a0 auth_method 0 2024-09-12T00:54:13.251 INFO:tasks.workunit.client.0.smithi073.stderr: -93> 2024-09-12T00:54:13.169+0000 7f7bc6c20800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:54:13.251 INFO:tasks.workunit.client.0.smithi073.stderr: -92> 2024-09-12T00:54:13.169+0000 7f7bc6c20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:13.251 INFO:tasks.workunit.client.0.smithi073.stderr: -91> 2024-09-12T00:54:13.169+0000 7f7bc6c20800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:54:13.251 INFO:tasks.workunit.client.0.smithi073.stderr: -90> 2024-09-12T00:54:13.169+0000 7f7bc6c20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:13.251 INFO:tasks.workunit.client.0.smithi073.stderr: -89> 2024-09-12T00:54:13.169+0000 7f7bc6c20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:13.252 INFO:tasks.workunit.client.0.smithi073.stderr: -88> 2024-09-12T00:54:13.169+0000 7f7bc6c20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:13.252 INFO:tasks.workunit.client.0.smithi073.stderr: -87> 2024-09-12T00:54:13.169+0000 7f7bc6c20800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.252 INFO:tasks.workunit.client.0.smithi073.stderr: -86> 2024-09-12T00:54:13.169+0000 7f7bc6c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:13.252 INFO:tasks.workunit.client.0.smithi073.stderr: -85> 2024-09-12T00:54:13.169+0000 7f7bc6c20800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.252 INFO:tasks.workunit.client.0.smithi073.stderr: -84> 2024-09-12T00:54:13.169+0000 7f7bc6c20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:13.252 INFO:tasks.workunit.client.0.smithi073.stderr: -83> 2024-09-12T00:54:13.169+0000 7f7bc6c20800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.252 INFO:tasks.workunit.client.0.smithi073.stderr: -82> 2024-09-12T00:54:13.169+0000 7f7bc6c20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:13.252 INFO:tasks.workunit.client.0.smithi073.stderr: -81> 2024-09-12T00:54:13.169+0000 7f7bc6c20800 20 zone default found 2024-09-12T00:54:13.252 INFO:tasks.workunit.client.0.smithi073.stderr: -80> 2024-09-12T00:54:13.169+0000 7f7bc6c20800 4 Realm: () 2024-09-12T00:54:13.252 INFO:tasks.workunit.client.0.smithi073.stderr: -79> 2024-09-12T00:54:13.169+0000 7f7bc6c20800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:54:13.252 INFO:tasks.workunit.client.0.smithi073.stderr: -78> 2024-09-12T00:54:13.169+0000 7f7bc6c20800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:54:13.252 INFO:tasks.workunit.client.0.smithi073.stderr: -77> 2024-09-12T00:54:13.169+0000 7f7bc6c20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:13.252 INFO:tasks.workunit.client.0.smithi073.stderr: -76> 2024-09-12T00:54:13.169+0000 7f7bc6c20800 20 zonegroup default 2024-09-12T00:54:13.253 INFO:tasks.workunit.client.0.smithi073.stderr: -75> 2024-09-12T00:54:13.169+0000 7f7bc6c20800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.253 INFO:tasks.workunit.client.0.smithi073.stderr: -74> 2024-09-12T00:54:13.170+0000 7f7bc6c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:13.253 INFO:tasks.workunit.client.0.smithi073.stderr: -73> 2024-09-12T00:54:13.170+0000 7f7bc6c20800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.253 INFO:tasks.workunit.client.0.smithi073.stderr: -72> 2024-09-12T00:54:13.170+0000 7f7bc6c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:13.253 INFO:tasks.workunit.client.0.smithi073.stderr: -71> 2024-09-12T00:54:13.170+0000 7f7bc6c20800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.253 INFO:tasks.workunit.client.0.smithi073.stderr: -70> 2024-09-12T00:54:13.171+0000 7f7bc6c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:13.253 INFO:tasks.workunit.client.0.smithi073.stderr: -69> 2024-09-12T00:54:13.171+0000 7f7bc6c20800 20 started sync module instance, tier type = 2024-09-12T00:54:13.253 INFO:tasks.workunit.client.0.smithi073.stderr: -68> 2024-09-12T00:54:13.171+0000 7f7bc6c20800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:54:13.253 INFO:tasks.workunit.client.0.smithi073.stderr: -67> 2024-09-12T00:54:13.180+0000 7f7bc6c20800 20 add_watcher() i=0 2024-09-12T00:54:13.253 INFO:tasks.workunit.client.0.smithi073.stderr: -66> 2024-09-12T00:54:13.180+0000 7f7bc6c20800 20 add_watcher() i=1 2024-09-12T00:54:13.253 INFO:tasks.workunit.client.0.smithi073.stderr: -65> 2024-09-12T00:54:13.180+0000 7f7bc6c20800 20 add_watcher() i=2 2024-09-12T00:54:13.253 INFO:tasks.workunit.client.0.smithi073.stderr: -64> 2024-09-12T00:54:13.180+0000 7f7bc6c20800 20 add_watcher() i=3 2024-09-12T00:54:13.253 INFO:tasks.workunit.client.0.smithi073.stderr: -63> 2024-09-12T00:54:13.180+0000 7f7bc6c20800 20 add_watcher() i=4 2024-09-12T00:54:13.253 INFO:tasks.workunit.client.0.smithi073.stderr: -62> 2024-09-12T00:54:13.180+0000 7f7bc6c20800 20 add_watcher() i=5 2024-09-12T00:54:13.254 INFO:tasks.workunit.client.0.smithi073.stderr: -61> 2024-09-12T00:54:13.180+0000 7f7bc6c20800 20 add_watcher() i=6 2024-09-12T00:54:13.254 INFO:tasks.workunit.client.0.smithi073.stderr: -60> 2024-09-12T00:54:13.181+0000 7f7bc6c20800 20 add_watcher() i=7 2024-09-12T00:54:13.254 INFO:tasks.workunit.client.0.smithi073.stderr: -59> 2024-09-12T00:54:13.181+0000 7f7bc6c20800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:13.254 INFO:tasks.workunit.client.0.smithi073.stderr: -58> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad2420) adding auth protocol: cephx 2024-09-12T00:54:13.254 INFO:tasks.workunit.client.0.smithi073.stderr: -57> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad2420) adding auth protocol: cephx 2024-09-12T00:54:13.254 INFO:tasks.workunit.client.0.smithi073.stderr: -56> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad2420) adding auth protocol: cephx 2024-09-12T00:54:13.254 INFO:tasks.workunit.client.0.smithi073.stderr: -55> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad2420) adding con mode: secure 2024-09-12T00:54:13.254 INFO:tasks.workunit.client.0.smithi073.stderr: -54> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad2420) adding con mode: crc 2024-09-12T00:54:13.254 INFO:tasks.workunit.client.0.smithi073.stderr: -53> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad2420) adding con mode: secure 2024-09-12T00:54:13.254 INFO:tasks.workunit.client.0.smithi073.stderr: -52> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad2420) adding con mode: crc 2024-09-12T00:54:13.254 INFO:tasks.workunit.client.0.smithi073.stderr: -51> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad2420) adding con mode: secure 2024-09-12T00:54:13.254 INFO:tasks.workunit.client.0.smithi073.stderr: -50> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad2420) adding con mode: crc 2024-09-12T00:54:13.254 INFO:tasks.workunit.client.0.smithi073.stderr: -49> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad2420) adding con mode: crc 2024-09-12T00:54:13.255 INFO:tasks.workunit.client.0.smithi073.stderr: -48> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad2420) adding con mode: secure 2024-09-12T00:54:13.255 INFO:tasks.workunit.client.0.smithi073.stderr: -47> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad2420) adding con mode: crc 2024-09-12T00:54:13.255 INFO:tasks.workunit.client.0.smithi073.stderr: -46> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad2420) adding con mode: secure 2024-09-12T00:54:13.255 INFO:tasks.workunit.client.0.smithi073.stderr: -45> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad2420) adding con mode: crc 2024-09-12T00:54:13.255 INFO:tasks.workunit.client.0.smithi073.stderr: -44> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad2420) adding con mode: secure 2024-09-12T00:54:13.255 INFO:tasks.workunit.client.0.smithi073.stderr: -43> 2024-09-12T00:54:13.183+0000 7f7a7afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:13.255 INFO:tasks.workunit.client.0.smithi073.stderr: -42> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:13.255 INFO:tasks.workunit.client.0.smithi073.stderr: -41> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:13.255 INFO:tasks.workunit.client.0.smithi073.stderr: -40> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:13.255 INFO:tasks.workunit.client.0.smithi073.stderr: -39> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 5 asok(0x55bb6a29c630) register_command cache list hook 0x55bb6a585c30 2024-09-12T00:54:13.255 INFO:tasks.workunit.client.0.smithi073.stderr: -38> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 5 asok(0x55bb6a29c630) register_command cache inspect hook 0x55bb6a585c30 2024-09-12T00:54:13.255 INFO:tasks.workunit.client.0.smithi073.stderr: -37> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 5 asok(0x55bb6a29c630) register_command cache erase hook 0x55bb6a585c30 2024-09-12T00:54:13.255 INFO:tasks.workunit.client.0.smithi073.stderr: -36> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 5 asok(0x55bb6a29c630) register_command cache zap hook 0x55bb6a585c30 2024-09-12T00:54:13.255 INFO:tasks.workunit.client.0.smithi073.stderr: -35> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 5 note: GC not initialized 2024-09-12T00:54:13.256 INFO:tasks.workunit.client.0.smithi073.stderr: -34> 2024-09-12T00:54:13.183+0000 7f7a79fdb640 20 reqs_thread_entry: start 2024-09-12T00:54:13.256 INFO:tasks.workunit.client.0.smithi073.stderr: -33> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 5 asok(0x55bb6a29c630) register_command sync trace show hook 0x7f7bac01bf20 2024-09-12T00:54:13.256 INFO:tasks.workunit.client.0.smithi073.stderr: -32> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 5 asok(0x55bb6a29c630) register_command sync trace history hook 0x7f7bac01bf20 2024-09-12T00:54:13.256 INFO:tasks.workunit.client.0.smithi073.stderr: -31> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 5 asok(0x55bb6a29c630) register_command sync trace active hook 0x7f7bac01bf20 2024-09-12T00:54:13.256 INFO:tasks.workunit.client.0.smithi073.stderr: -30> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 5 asok(0x55bb6a29c630) register_command sync trace active_short hook 0x7f7bac01bf20 2024-09-12T00:54:13.256 INFO:tasks.workunit.client.0.smithi073.stderr: -29> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:13.256 INFO:tasks.workunit.client.0.smithi073.stderr: -28> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 20 Filter name: none 2024-09-12T00:54:13.256 INFO:tasks.workunit.client.0.smithi073.stderr: -27> 2024-09-12T00:54:13.183+0000 7f79eb7fe640 20 reqs_thread_entry: start 2024-09-12T00:54:13.256 INFO:tasks.workunit.client.0.smithi073.stderr: -26> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:54:13.256 INFO:tasks.workunit.client.0.smithi073.stderr: -25> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.256 INFO:tasks.workunit.client.0.smithi073.stderr: -24> 2024-09-12T00:54:13.184+0000 7f7bc6c20800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:54:13.256 INFO:tasks.workunit.client.0.smithi073.stderr: -23> 2024-09-12T00:54:13.184+0000 7f7bc6c20800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:54:13.256 INFO:tasks.workunit.client.0.smithi073.stderr: -22> 2024-09-12T00:54:13.184+0000 7f7bc6c20800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:54:13.257 INFO:tasks.workunit.client.0.smithi073.stderr: -21> 2024-09-12T00:54:13.184+0000 7f7bc6c20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 : miss 2024-09-12T00:54:13.257 INFO:tasks.workunit.client.0.smithi073.stderr: -20> 2024-09-12T00:54:13.184+0000 7f7bc6c20800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.257 INFO:tasks.workunit.client.0.smithi073.stderr: -19> 2024-09-12T00:54:13.184+0000 7f7bc6c20800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:54:13.257 INFO:tasks.workunit.client.0.smithi073.stderr: -18> 2024-09-12T00:54:13.184+0000 7f7bc6c20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:54:13.257 INFO:tasks.workunit.client.0.smithi073.stderr: -17> 2024-09-12T00:54:13.184+0000 7f7bc6c20800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:54:13.257 INFO:tasks.workunit.client.0.smithi073.stderr: -16> 2024-09-12T00:54:13.184+0000 7f7bc6c20800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:54:13.257 INFO:tasks.workunit.client.0.smithi073.stderr: -15> 2024-09-12T00:54:13.184+0000 7f7bc6c20800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:54:13.257 INFO:tasks.workunit.client.0.smithi073.stderr: -14> 2024-09-12T00:54:13.184+0000 7f7bc6c20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 2024-09-12T00:54:13.257 INFO:tasks.workunit.client.0.smithi073.stderr: -13> 2024-09-12T00:54:13.188+0000 7f7bc6c20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:54:13.257 INFO:tasks.workunit.client.0.smithi073.stderr: -12> 2024-09-12T00:54:13.188+0000 7f7bc6c20800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:54:13.257 INFO:tasks.workunit.client.0.smithi073.stderr: -11> 2024-09-12T00:54:13.188+0000 7f7bc6c20800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:54:13.257 INFO:tasks.workunit.client.0.smithi073.stderr: -10> 2024-09-12T00:54:13.188+0000 7f7bc6c20800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17, ofs0, ns] 2024-09-12T00:54:13.257 INFO:tasks.workunit.client.0.smithi073.stderr: -9> 2024-09-12T00:54:13.188+0000 7f7a9affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497046 cookie 94263431640736 notifier 8271 bl.length()=827 2024-09-12T00:54:13.257 INFO:tasks.workunit.client.0.smithi073.stderr: -8> 2024-09-12T00:54:13.188+0000 7f7a9affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:54:13.258 INFO:tasks.workunit.client.0.smithi073.stderr: -7> 2024-09-12T00:54:13.188+0000 7f7a9affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:54:13.258 INFO:tasks.workunit.client.0.smithi073.stderr: -6> 2024-09-12T00:54:13.188+0000 7f7a9affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:54:13.258 INFO:tasks.workunit.client.0.smithi073.stderr: -5> 2024-09-12T00:54:13.190+0000 7f7bc6c20800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): orig_sources= new_sources= 2024-09-12T00:54:13.258 INFO:tasks.workunit.client.0.smithi073.stderr: -4> 2024-09-12T00:54:13.190+0000 7f7bc6c20800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): potential sources added=[] removed=[] 2024-09-12T00:54:13.258 INFO:tasks.workunit.client.0.smithi073.stderr: -3> 2024-09-12T00:54:13.190+0000 7f7bc6c20800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): orig_dests= new_dests= 2024-09-12T00:54:13.258 INFO:tasks.workunit.client.0.smithi073.stderr: -2> 2024-09-12T00:54:13.190+0000 7f7bc6c20800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): potential dests added=[] removed=[] 2024-09-12T00:54:13.258 INFO:tasks.workunit.client.0.smithi073.stderr: -1> 2024-09-12T00:54:13.193+0000 7f7bc6c20800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7bc6c20800 time 2024-09-12T00:54:13.193686+0000 2024-09-12T00:54:13.258 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:54:13.258 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:13.258 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:13.258 INFO:tasks.workunit.client.0.smithi073.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f7bca18c71a] 2024-09-12T00:54:13.258 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f7bca18c8d8] 2024-09-12T00:54:13.258 INFO:tasks.workunit.client.0.smithi073.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bb681d8641] 2024-09-12T00:54:13.259 INFO:tasks.workunit.client.0.smithi073.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55bb681e838a] 2024-09-12T00:54:13.259 INFO:tasks.workunit.client.0.smithi073.stderr: 5: main() 2024-09-12T00:54:13.259 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f7bc8e29590] 2024-09-12T00:54:13.259 INFO:tasks.workunit.client.0.smithi073.stderr: 7: __libc_start_main() 2024-09-12T00:54:13.259 INFO:tasks.workunit.client.0.smithi073.stderr: 8: _start() 2024-09-12T00:54:13.259 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:13.259 INFO:tasks.workunit.client.0.smithi073.stderr: 0> 2024-09-12T00:54:13.194+0000 7f7bc6c20800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:54:13.259 INFO:tasks.workunit.client.0.smithi073.stderr: in thread 7f7bc6c20800 thread_name:radosgw-admin 2024-09-12T00:54:13.259 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:13.259 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:13.259 INFO:tasks.workunit.client.0.smithi073.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f7bc8e3e6f0] 2024-09-12T00:54:13.259 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f7bc8e8b99c] 2024-09-12T00:54:13.259 INFO:tasks.workunit.client.0.smithi073.stderr: 3: raise() 2024-09-12T00:54:13.260 INFO:tasks.workunit.client.0.smithi073.stderr: 4: abort() 2024-09-12T00:54:13.260 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f7bca18c774] 2024-09-12T00:54:13.260 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f7bca18c8d8] 2024-09-12T00:54:13.260 INFO:tasks.workunit.client.0.smithi073.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bb681d8641] 2024-09-12T00:54:13.260 INFO:tasks.workunit.client.0.smithi073.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55bb681e838a] 2024-09-12T00:54:13.260 INFO:tasks.workunit.client.0.smithi073.stderr: 9: main() 2024-09-12T00:54:13.260 INFO:tasks.workunit.client.0.smithi073.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f7bc8e29590] 2024-09-12T00:54:13.260 INFO:tasks.workunit.client.0.smithi073.stderr: 11: __libc_start_main() 2024-09-12T00:54:13.260 INFO:tasks.workunit.client.0.smithi073.stderr: 12: _start() 2024-09-12T00:54:13.260 INFO:tasks.workunit.client.0.smithi073.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:54:13.260 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:13.260 INFO:tasks.workunit.client.0.smithi073.stderr:--- logging levels --- 2024-09-12T00:54:13.261 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 none 2024-09-12T00:54:13.261 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 lockdep 2024-09-12T00:54:13.261 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 context 2024-09-12T00:54:13.261 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 crush 2024-09-12T00:54:13.261 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds 2024-09-12T00:54:13.261 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_balancer 2024-09-12T00:54:13.261 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_locker 2024-09-12T00:54:13.261 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_log 2024-09-12T00:54:13.261 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_log_expire 2024-09-12T00:54:13.261 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_migrator 2024-09-12T00:54:13.261 INFO:tasks.workunit.client.0.smithi073.stderr: 3/ 5 mds_quiesce 2024-09-12T00:54:13.261 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 buffer 2024-09-12T00:54:13.261 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 timer 2024-09-12T00:54:13.261 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 filer 2024-09-12T00:54:13.262 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 striper 2024-09-12T00:54:13.262 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 objecter 2024-09-12T00:54:13.262 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rados 2024-09-12T00:54:13.262 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd 2024-09-12T00:54:13.262 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_mirror 2024-09-12T00:54:13.262 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_replay 2024-09-12T00:54:13.262 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_pwl 2024-09-12T00:54:13.262 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 journaler 2024-09-12T00:54:13.262 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 objectcacher 2024-09-12T00:54:13.262 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:54:13.262 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 client 2024-09-12T00:54:13.262 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 osd 2024-09-12T00:54:13.262 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 optracker 2024-09-12T00:54:13.263 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 objclass 2024-09-12T00:54:13.263 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 filestore 2024-09-12T00:54:13.263 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 journal 2024-09-12T00:54:13.263 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 0 ms 2024-09-12T00:54:13.263 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mon 2024-09-12T00:54:13.263 INFO:tasks.workunit.client.0.smithi073.stderr: 0/10 monc 2024-09-12T00:54:13.263 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 paxos 2024-09-12T00:54:13.263 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 tp 2024-09-12T00:54:13.263 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 auth 2024-09-12T00:54:13.263 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 crypto 2024-09-12T00:54:13.263 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 finisher 2024-09-12T00:54:13.263 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 reserver 2024-09-12T00:54:13.263 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 heartbeatmap 2024-09-12T00:54:13.263 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 perfcounter 2024-09-12T00:54:13.264 INFO:tasks.workunit.client.0.smithi073.stderr: 20/20 rgw 2024-09-12T00:54:13.264 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_sync 2024-09-12T00:54:13.264 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_datacache 2024-09-12T00:54:13.264 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_access 2024-09-12T00:54:13.264 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:54:13.264 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_flight 2024-09-12T00:54:13.264 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:54:13.264 INFO:tasks.workunit.client.0.smithi073.stderr: 20/20 rgw_notification 2024-09-12T00:54:13.264 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 javaclient 2024-09-12T00:54:13.264 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 asok 2024-09-12T00:54:13.264 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 throttle 2024-09-12T00:54:13.264 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 0 refs 2024-09-12T00:54:13.264 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 compressor 2024-09-12T00:54:13.265 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 bluestore 2024-09-12T00:54:13.265 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 bluefs 2024-09-12T00:54:13.265 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 bdev 2024-09-12T00:54:13.265 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 kstore 2024-09-12T00:54:13.265 INFO:tasks.workunit.client.0.smithi073.stderr: 4/ 5 rocksdb 2024-09-12T00:54:13.265 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 fuse 2024-09-12T00:54:13.265 INFO:tasks.workunit.client.0.smithi073.stderr: 2/ 5 mgr 2024-09-12T00:54:13.265 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mgrc 2024-09-12T00:54:13.265 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 dpdk 2024-09-12T00:54:13.265 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 eventtrace 2024-09-12T00:54:13.265 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 prioritycache 2024-09-12T00:54:13.265 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 test 2024-09-12T00:54:13.265 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:54:13.266 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cephsqlite 2024-09-12T00:54:13.266 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:54:13.266 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore 2024-09-12T00:54:13.266 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_onode 2024-09-12T00:54:13.266 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_odata 2024-09-12T00:54:13.266 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_omap 2024-09-12T00:54:13.266 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_tm 2024-09-12T00:54:13.266 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_t 2024-09-12T00:54:13.266 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:54:13.266 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_epm 2024-09-12T00:54:13.266 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_lba 2024-09-12T00:54:13.266 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:54:13.266 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_cache 2024-09-12T00:54:13.267 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_journal 2024-09-12T00:54:13.267 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_device 2024-09-12T00:54:13.267 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_backref 2024-09-12T00:54:13.267 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 alienstore 2024-09-12T00:54:13.267 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mclock 2024-09-12T00:54:13.267 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cyanstore 2024-09-12T00:54:13.267 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 ceph_exporter 2024-09-12T00:54:13.267 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 memstore 2024-09-12T00:54:13.267 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 trace 2024-09-12T00:54:13.267 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 ceph_dedup 2024-09-12T00:54:13.267 INFO:tasks.workunit.client.0.smithi073.stderr: -2/-2 (syslog threshold) 2024-09-12T00:54:13.267 INFO:tasks.workunit.client.0.smithi073.stderr: 99/99 (stderr threshold) 2024-09-12T00:54:13.267 INFO:tasks.workunit.client.0.smithi073.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:54:13.267 INFO:tasks.workunit.client.0.smithi073.stderr: 7f79eb7fe640 / http_manager 2024-09-12T00:54:13.268 INFO:tasks.workunit.client.0.smithi073.stderr: 7f7a79fdb640 / http_manager 2024-09-12T00:54:13.268 INFO:tasks.workunit.client.0.smithi073.stderr: 7f7a7afdd640 / rgw_dt_lg_renew 2024-09-12T00:54:13.268 INFO:tasks.workunit.client.0.smithi073.stderr: 7f7a99ffb640 / ms_dispatch 2024-09-12T00:54:13.268 INFO:tasks.workunit.client.0.smithi073.stderr: 7f7a9affd640 / io_context_pool 2024-09-12T00:54:13.268 INFO:tasks.workunit.client.0.smithi073.stderr: 7f7a9b7fe640 / io_context_pool 2024-09-12T00:54:13.268 INFO:tasks.workunit.client.0.smithi073.stderr: 7f7aa9ffb640 / ms_dispatch 2024-09-12T00:54:13.268 INFO:tasks.workunit.client.0.smithi073.stderr: 7f7ab0e09640 / ms_dispatch 2024-09-12T00:54:13.268 INFO:tasks.workunit.client.0.smithi073.stderr: 7f7ab260c640 / io_context_pool 2024-09-12T00:54:13.268 INFO:tasks.workunit.client.0.smithi073.stderr: 7f7bbbf09640 / msgr-worker-2 2024-09-12T00:54:13.268 INFO:tasks.workunit.client.0.smithi073.stderr: 7f7bc470a640 / msgr-worker-1 2024-09-12T00:54:13.268 INFO:tasks.workunit.client.0.smithi073.stderr: 7f7bc4f0b640 / msgr-worker-0 2024-09-12T00:54:13.268 INFO:tasks.workunit.client.0.smithi073.stderr: 7f7bc570c640 / io_context_pool 2024-09-12T00:54:13.268 INFO:tasks.workunit.client.0.smithi073.stderr: 7f7bc6c20800 / radosgw-admin 2024-09-12T00:54:13.269 INFO:tasks.workunit.client.0.smithi073.stderr: max_recent 500 2024-09-12T00:54:13.269 INFO:tasks.workunit.client.0.smithi073.stderr: max_new 1000 2024-09-12T00:54:13.269 INFO:tasks.workunit.client.0.smithi073.stderr: log_file /var/log/ceph/ceph-client.admin.150785.log 2024-09-12T00:54:13.269 INFO:tasks.workunit.client.0.smithi073.stderr:--- end dump of recent events --- 2024-09-12T00:54:13.269 INFO:tasks.workunit.client.0.smithi073.stderr:--- begin dump of recent events --- 2024-09-12T00:54:13.269 INFO:tasks.workunit.client.0.smithi073.stderr: -499> 2024-09-12T00:54:12.936+0000 7f7bc6c20800 10 monclient: monmap: 2024-09-12T00:54:13.269 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:54:13.269 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:54:13.269 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:54:13.269 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:54:13.269 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:54:13.269 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:54:13.269 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:54:13.270 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:54:13.270 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:54:13.270 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:13.270 INFO:tasks.workunit.client.0.smithi073.stderr: -498> 2024-09-12T00:54:12.936+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4c22d0) adding auth protocol: cephx 2024-09-12T00:54:13.270 INFO:tasks.workunit.client.0.smithi073.stderr: -497> 2024-09-12T00:54:12.936+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4c22d0) adding auth protocol: cephx 2024-09-12T00:54:13.270 INFO:tasks.workunit.client.0.smithi073.stderr: -496> 2024-09-12T00:54:12.936+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4c22d0) adding auth protocol: cephx 2024-09-12T00:54:13.270 INFO:tasks.workunit.client.0.smithi073.stderr: -495> 2024-09-12T00:54:12.936+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4c22d0) adding con mode: secure 2024-09-12T00:54:13.270 INFO:tasks.workunit.client.0.smithi073.stderr: -494> 2024-09-12T00:54:12.936+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4c22d0) adding con mode: crc 2024-09-12T00:54:13.270 INFO:tasks.workunit.client.0.smithi073.stderr: -493> 2024-09-12T00:54:12.936+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4c22d0) adding con mode: secure 2024-09-12T00:54:13.270 INFO:tasks.workunit.client.0.smithi073.stderr: -492> 2024-09-12T00:54:12.936+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4c22d0) adding con mode: crc 2024-09-12T00:54:13.270 INFO:tasks.workunit.client.0.smithi073.stderr: -491> 2024-09-12T00:54:12.936+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4c22d0) adding con mode: secure 2024-09-12T00:54:13.270 INFO:tasks.workunit.client.0.smithi073.stderr: -490> 2024-09-12T00:54:12.936+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4c22d0) adding con mode: crc 2024-09-12T00:54:13.270 INFO:tasks.workunit.client.0.smithi073.stderr: -489> 2024-09-12T00:54:12.936+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4c22d0) adding con mode: crc 2024-09-12T00:54:13.271 INFO:tasks.workunit.client.0.smithi073.stderr: -488> 2024-09-12T00:54:12.936+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4c22d0) adding con mode: secure 2024-09-12T00:54:13.271 INFO:tasks.workunit.client.0.smithi073.stderr: -487> 2024-09-12T00:54:12.936+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4c22d0) adding con mode: crc 2024-09-12T00:54:13.271 INFO:tasks.workunit.client.0.smithi073.stderr: -486> 2024-09-12T00:54:12.936+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4c22d0) adding con mode: secure 2024-09-12T00:54:13.271 INFO:tasks.workunit.client.0.smithi073.stderr: -485> 2024-09-12T00:54:12.936+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4c22d0) adding con mode: crc 2024-09-12T00:54:13.271 INFO:tasks.workunit.client.0.smithi073.stderr: -484> 2024-09-12T00:54:12.936+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4c22d0) adding con mode: secure 2024-09-12T00:54:13.271 INFO:tasks.workunit.client.0.smithi073.stderr: -483> 2024-09-12T00:54:12.936+0000 7f7bc6c20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:13.271 INFO:tasks.workunit.client.0.smithi073.stderr: -482> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 1 librados: starting msgr at 2024-09-12T00:54:13.271 INFO:tasks.workunit.client.0.smithi073.stderr: -481> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 1 librados: starting objecter 2024-09-12T00:54:13.271 INFO:tasks.workunit.client.0.smithi073.stderr: -480> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 5 asok(0x55bb6a29c630) register_command objecter_requests hook 0x55bb6a4edb40 2024-09-12T00:54:13.271 INFO:tasks.workunit.client.0.smithi073.stderr: -479> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 1 librados: setting wanted keys 2024-09-12T00:54:13.271 INFO:tasks.workunit.client.0.smithi073.stderr: -478> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 1 librados: calling monclient init 2024-09-12T00:54:13.272 INFO:tasks.workunit.client.0.smithi073.stderr: -477> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 10 monclient: init 2024-09-12T00:54:13.272 INFO:tasks.workunit.client.0.smithi073.stderr: -476> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4bc630) adding auth protocol: cephx 2024-09-12T00:54:13.272 INFO:tasks.workunit.client.0.smithi073.stderr: -475> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4bc630) adding auth protocol: cephx 2024-09-12T00:54:13.272 INFO:tasks.workunit.client.0.smithi073.stderr: -474> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4bc630) adding auth protocol: cephx 2024-09-12T00:54:13.272 INFO:tasks.workunit.client.0.smithi073.stderr: -473> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4bc630) adding con mode: secure 2024-09-12T00:54:13.272 INFO:tasks.workunit.client.0.smithi073.stderr: -472> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4bc630) adding con mode: crc 2024-09-12T00:54:13.272 INFO:tasks.workunit.client.0.smithi073.stderr: -471> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4bc630) adding con mode: secure 2024-09-12T00:54:13.272 INFO:tasks.workunit.client.0.smithi073.stderr: -470> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4bc630) adding con mode: crc 2024-09-12T00:54:13.272 INFO:tasks.workunit.client.0.smithi073.stderr: -469> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4bc630) adding con mode: secure 2024-09-12T00:54:13.272 INFO:tasks.workunit.client.0.smithi073.stderr: -468> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4bc630) adding con mode: crc 2024-09-12T00:54:13.272 INFO:tasks.workunit.client.0.smithi073.stderr: -467> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4bc630) adding con mode: crc 2024-09-12T00:54:13.272 INFO:tasks.workunit.client.0.smithi073.stderr: -466> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4bc630) adding con mode: secure 2024-09-12T00:54:13.273 INFO:tasks.workunit.client.0.smithi073.stderr: -465> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4bc630) adding con mode: crc 2024-09-12T00:54:13.273 INFO:tasks.workunit.client.0.smithi073.stderr: -464> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4bc630) adding con mode: secure 2024-09-12T00:54:13.273 INFO:tasks.workunit.client.0.smithi073.stderr: -463> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4bc630) adding con mode: crc 2024-09-12T00:54:13.273 INFO:tasks.workunit.client.0.smithi073.stderr: -462> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a4bc630) adding con mode: secure 2024-09-12T00:54:13.273 INFO:tasks.workunit.client.0.smithi073.stderr: -461> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:13.273 INFO:tasks.workunit.client.0.smithi073.stderr: -460> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:13.273 INFO:tasks.workunit.client.0.smithi073.stderr: -459> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 5 asok(0x55bb6a29c630) register_command rotate-key hook 0x55bb6a4bc778 2024-09-12T00:54:13.273 INFO:tasks.workunit.client.0.smithi073.stderr: -458> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 10 monclient: _reopen_session rank -1 2024-09-12T00:54:13.273 INFO:tasks.workunit.client.0.smithi073.stderr: -457> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:54:13.273 INFO:tasks.workunit.client.0.smithi073.stderr: -456> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 10 monclient(hunting): picked mon.noname-a con 0x55bb6a3692d0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:54:13.273 INFO:tasks.workunit.client.0.smithi073.stderr: -455> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 10 monclient(hunting): picked mon.noname-c con 0x55bb6a375c20 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:54:13.273 INFO:tasks.workunit.client.0.smithi073.stderr: -454> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 10 monclient(hunting): picked mon.noname-b con 0x55bb6a4e6dd0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:54:13.274 INFO:tasks.workunit.client.0.smithi073.stderr: -453> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:13.274 INFO:tasks.workunit.client.0.smithi073.stderr: -452> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:13.274 INFO:tasks.workunit.client.0.smithi073.stderr: -451> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:13.274 INFO:tasks.workunit.client.0.smithi073.stderr: -450> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 10 monclient(hunting): _renew_subs 2024-09-12T00:54:13.274 INFO:tasks.workunit.client.0.smithi073.stderr: -449> 2024-09-12T00:54:12.937+0000 7f7bc6c20800 10 monclient(hunting): authenticate will time out at 2313.607707s 2024-09-12T00:54:13.274 INFO:tasks.workunit.client.0.smithi073.stderr: -448> 2024-09-12T00:54:12.937+0000 7f7bbbf09640 10 monclient(hunting): get_auth_request con 0x55bb6a375c20 auth_method 0 2024-09-12T00:54:13.274 INFO:tasks.workunit.client.0.smithi073.stderr: -447> 2024-09-12T00:54:12.937+0000 7f7bbbf09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:13.274 INFO:tasks.workunit.client.0.smithi073.stderr: -446> 2024-09-12T00:54:12.937+0000 7f7bbbf09640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:13.274 INFO:tasks.workunit.client.0.smithi073.stderr: -445> 2024-09-12T00:54:12.937+0000 7f7bbbf09640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:13.274 INFO:tasks.workunit.client.0.smithi073.stderr: -444> 2024-09-12T00:54:12.937+0000 7f7bc470a640 10 monclient(hunting): get_auth_request con 0x55bb6a3692d0 auth_method 0 2024-09-12T00:54:13.274 INFO:tasks.workunit.client.0.smithi073.stderr: -443> 2024-09-12T00:54:12.937+0000 7f7bc470a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:13.274 INFO:tasks.workunit.client.0.smithi073.stderr: -442> 2024-09-12T00:54:12.937+0000 7f7bc470a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:13.274 INFO:tasks.workunit.client.0.smithi073.stderr: -441> 2024-09-12T00:54:12.937+0000 7f7bc470a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:13.275 INFO:tasks.workunit.client.0.smithi073.stderr: -440> 2024-09-12T00:54:12.937+0000 7f7bbbf09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:13.275 INFO:tasks.workunit.client.0.smithi073.stderr: -439> 2024-09-12T00:54:12.937+0000 7f7bbbf09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:13.275 INFO:tasks.workunit.client.0.smithi073.stderr: -438> 2024-09-12T00:54:12.937+0000 7f7bbbf09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:13.275 INFO:tasks.workunit.client.0.smithi073.stderr: -437> 2024-09-12T00:54:12.937+0000 7f7bc470a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:13.275 INFO:tasks.workunit.client.0.smithi073.stderr: -436> 2024-09-12T00:54:12.937+0000 7f7bc470a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:13.275 INFO:tasks.workunit.client.0.smithi073.stderr: -435> 2024-09-12T00:54:12.937+0000 7f7bc470a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:13.275 INFO:tasks.workunit.client.0.smithi073.stderr: -434> 2024-09-12T00:54:12.937+0000 7f7bc4f0b640 10 monclient(hunting): get_auth_request con 0x55bb6a4e6dd0 auth_method 0 2024-09-12T00:54:13.275 INFO:tasks.workunit.client.0.smithi073.stderr: -433> 2024-09-12T00:54:12.937+0000 7f7bc4f0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:13.275 INFO:tasks.workunit.client.0.smithi073.stderr: -432> 2024-09-12T00:54:12.937+0000 7f7bc4f0b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:13.275 INFO:tasks.workunit.client.0.smithi073.stderr: -431> 2024-09-12T00:54:12.937+0000 7f7bc4f0b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:13.275 INFO:tasks.workunit.client.0.smithi073.stderr: -430> 2024-09-12T00:54:12.938+0000 7f7bc4f0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:13.275 INFO:tasks.workunit.client.0.smithi073.stderr: -429> 2024-09-12T00:54:12.938+0000 7f7bc4f0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:13.275 INFO:tasks.workunit.client.0.smithi073.stderr: -428> 2024-09-12T00:54:12.938+0000 7f7bc4f0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:13.276 INFO:tasks.workunit.client.0.smithi073.stderr: -427> 2024-09-12T00:54:12.938+0000 7f7bc470a640 10 monclient(hunting): handle_auth_done global_id 8262 payload 824 2024-09-12T00:54:13.276 INFO:tasks.workunit.client.0.smithi073.stderr: -426> 2024-09-12T00:54:12.938+0000 7f7bc470a640 10 monclient: _finish_hunting 0 2024-09-12T00:54:13.276 INFO:tasks.workunit.client.0.smithi073.stderr: -425> 2024-09-12T00:54:12.938+0000 7f7bc470a640 1 monclient: found mon.noname-a 2024-09-12T00:54:13.276 INFO:tasks.workunit.client.0.smithi073.stderr: -424> 2024-09-12T00:54:12.938+0000 7f7bc470a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:54:13.276 INFO:tasks.workunit.client.0.smithi073.stderr: -423> 2024-09-12T00:54:12.938+0000 7f7ab0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:13.276 INFO:tasks.workunit.client.0.smithi073.stderr: -422> 2024-09-12T00:54:12.938+0000 7f7ab0e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:54:13.276 INFO:tasks.workunit.client.0.smithi073.stderr: -421> 2024-09-12T00:54:12.938+0000 7f7ab0e09640 10 monclient: dump: 2024-09-12T00:54:13.276 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:54:13.276 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:54:13.276 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:13.276 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:13.276 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:13.276 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:54:13.277 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:54:13.277 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:54:13.277 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:54:13.277 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:13.277 INFO:tasks.workunit.client.0.smithi073.stderr: -420> 2024-09-12T00:54:12.938+0000 7f7ab0e09640 10 monclient: _finish_auth 0 2024-09-12T00:54:13.277 INFO:tasks.workunit.client.0.smithi073.stderr: -419> 2024-09-12T00:54:12.938+0000 7f7ab0e09640 10 monclient: _check_auth_tickets 2024-09-12T00:54:13.277 INFO:tasks.workunit.client.0.smithi073.stderr: -418> 2024-09-12T00:54:12.938+0000 7f7ab0e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:13.277 INFO:tasks.workunit.client.0.smithi073.stderr: -417> 2024-09-12T00:54:12.938+0000 7f7ab0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:13.277 INFO:tasks.workunit.client.0.smithi073.stderr: -416> 2024-09-12T00:54:12.938+0000 7f7ab0e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:54:13.277 INFO:tasks.workunit.client.0.smithi073.stderr: -415> 2024-09-12T00:54:12.938+0000 7f7ab0e09640 10 monclient: dump: 2024-09-12T00:54:13.277 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:54:13.277 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:54:13.278 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:13.278 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:13.278 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:13.278 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:54:13.278 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:54:13.278 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:54:13.278 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:54:13.278 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:13.278 INFO:tasks.workunit.client.0.smithi073.stderr: -414> 2024-09-12T00:54:12.938+0000 7f7bc6c20800 5 monclient: authenticate success, global_id 8262 2024-09-12T00:54:13.278 INFO:tasks.workunit.client.0.smithi073.stderr: -413> 2024-09-12T00:54:12.938+0000 7f7bc6c20800 10 monclient: _renew_subs 2024-09-12T00:54:13.278 INFO:tasks.workunit.client.0.smithi073.stderr: -412> 2024-09-12T00:54:12.938+0000 7f7bc6c20800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:54:13.278 INFO:tasks.workunit.client.0.smithi073.stderr: -411> 2024-09-12T00:54:12.938+0000 7f7ab260c640 4 set_mon_vals no callback set 2024-09-12T00:54:13.278 INFO:tasks.workunit.client.0.smithi073.stderr: -410> 2024-09-12T00:54:12.938+0000 7f7bc6c20800 10 monclient: _renew_subs 2024-09-12T00:54:13.279 INFO:tasks.workunit.client.0.smithi073.stderr: -409> 2024-09-12T00:54:12.938+0000 7f7bc6c20800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:54:13.279 INFO:tasks.workunit.client.0.smithi073.stderr: -408> 2024-09-12T00:54:12.938+0000 7f7bc6c20800 1 librados: init done 2024-09-12T00:54:13.279 INFO:tasks.workunit.client.0.smithi073.stderr: -407> 2024-09-12T00:54:12.940+0000 7f7ab0e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:54:13.279 INFO:tasks.workunit.client.0.smithi073.stderr: -406> 2024-09-12T00:54:12.940+0000 7f7ab0e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:54:13.279 INFO:tasks.workunit.client.0.smithi073.stderr: -405> 2024-09-12T00:54:12.940+0000 7f7ab0e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:54:13.279 INFO:tasks.workunit.client.0.smithi073.stderr: -404> 2024-09-12T00:54:12.940+0000 7f7bbbf09640 10 monclient: get_auth_request con 0x7f7aac076470 auth_method 0 2024-09-12T00:54:13.279 INFO:tasks.workunit.client.0.smithi073.stderr: -403> 2024-09-12T00:54:12.940+0000 7f7bc4f0b640 10 monclient: get_auth_request con 0x55bb6a4e4f00 auth_method 0 2024-09-12T00:54:13.279 INFO:tasks.workunit.client.0.smithi073.stderr: -402> 2024-09-12T00:54:12.941+0000 7f7bc470a640 10 monclient: get_auth_request con 0x55bb6a508040 auth_method 0 2024-09-12T00:54:13.279 INFO:tasks.workunit.client.0.smithi073.stderr: -401> 2024-09-12T00:54:12.942+0000 7f7bbbf09640 10 monclient: get_auth_request con 0x55bb6a50c6e0 auth_method 0 2024-09-12T00:54:13.279 INFO:tasks.workunit.client.0.smithi073.stderr: -400> 2024-09-12T00:54:12.943+0000 7f7bc6c20800 10 monclient: build_initial_monmap 2024-09-12T00:54:13.279 INFO:tasks.workunit.client.0.smithi073.stderr: -399> 2024-09-12T00:54:12.943+0000 7f7bc6c20800 1 build_initial for_mkfs: 0 2024-09-12T00:54:13.279 INFO:tasks.workunit.client.0.smithi073.stderr: -398> 2024-09-12T00:54:12.943+0000 7f7bc6c20800 10 monclient: monmap: 2024-09-12T00:54:13.279 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:54:13.280 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:54:13.280 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:54:13.280 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:54:13.280 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:54:13.280 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:54:13.280 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:54:13.280 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:54:13.280 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:54:13.280 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:13.280 INFO:tasks.workunit.client.0.smithi073.stderr: -397> 2024-09-12T00:54:12.943+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a511460) adding auth protocol: cephx 2024-09-12T00:54:13.280 INFO:tasks.workunit.client.0.smithi073.stderr: -396> 2024-09-12T00:54:12.943+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a511460) adding auth protocol: cephx 2024-09-12T00:54:13.280 INFO:tasks.workunit.client.0.smithi073.stderr: -395> 2024-09-12T00:54:12.943+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a511460) adding auth protocol: cephx 2024-09-12T00:54:13.280 INFO:tasks.workunit.client.0.smithi073.stderr: -394> 2024-09-12T00:54:12.943+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a511460) adding con mode: secure 2024-09-12T00:54:13.281 INFO:tasks.workunit.client.0.smithi073.stderr: -393> 2024-09-12T00:54:12.943+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a511460) adding con mode: crc 2024-09-12T00:54:13.281 INFO:tasks.workunit.client.0.smithi073.stderr: -392> 2024-09-12T00:54:12.943+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a511460) adding con mode: secure 2024-09-12T00:54:13.281 INFO:tasks.workunit.client.0.smithi073.stderr: -391> 2024-09-12T00:54:12.943+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a511460) adding con mode: crc 2024-09-12T00:54:13.281 INFO:tasks.workunit.client.0.smithi073.stderr: -390> 2024-09-12T00:54:12.943+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a511460) adding con mode: secure 2024-09-12T00:54:13.281 INFO:tasks.workunit.client.0.smithi073.stderr: -389> 2024-09-12T00:54:12.943+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a511460) adding con mode: crc 2024-09-12T00:54:13.281 INFO:tasks.workunit.client.0.smithi073.stderr: -388> 2024-09-12T00:54:12.943+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a511460) adding con mode: crc 2024-09-12T00:54:13.284 INFO:tasks.workunit.client.0.smithi073.stderr: -387> 2024-09-12T00:54:12.943+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a511460) adding con mode: secure 2024-09-12T00:54:13.284 INFO:tasks.workunit.client.0.smithi073.stderr: -386> 2024-09-12T00:54:12.943+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a511460) adding con mode: crc 2024-09-12T00:54:13.284 INFO:tasks.workunit.client.0.smithi073.stderr: -385> 2024-09-12T00:54:12.943+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a511460) adding con mode: secure 2024-09-12T00:54:13.284 INFO:tasks.workunit.client.0.smithi073.stderr: -384> 2024-09-12T00:54:12.943+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a511460) adding con mode: crc 2024-09-12T00:54:13.284 INFO:tasks.workunit.client.0.smithi073.stderr: -383> 2024-09-12T00:54:12.943+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a511460) adding con mode: secure 2024-09-12T00:54:13.284 INFO:tasks.workunit.client.0.smithi073.stderr: -382> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:13.284 INFO:tasks.workunit.client.0.smithi073.stderr: -381> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 5 asok(0x55bb6a29c630) register_command objecter_requests cmddesc objecter_requests hook 0x55bb6a514920 EEXIST 2024-09-12T00:54:13.284 INFO:tasks.workunit.client.0.smithi073.stderr: -380> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 10 monclient: init 2024-09-12T00:54:13.284 INFO:tasks.workunit.client.0.smithi073.stderr: -379> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a50fae8) adding auth protocol: cephx 2024-09-12T00:54:13.284 INFO:tasks.workunit.client.0.smithi073.stderr: -378> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a50fae8) adding auth protocol: cephx 2024-09-12T00:54:13.285 INFO:tasks.workunit.client.0.smithi073.stderr: -377> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a50fae8) adding auth protocol: cephx 2024-09-12T00:54:13.285 INFO:tasks.workunit.client.0.smithi073.stderr: -376> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a50fae8) adding con mode: secure 2024-09-12T00:54:13.285 INFO:tasks.workunit.client.0.smithi073.stderr: -375> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a50fae8) adding con mode: crc 2024-09-12T00:54:13.285 INFO:tasks.workunit.client.0.smithi073.stderr: -374> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a50fae8) adding con mode: secure 2024-09-12T00:54:13.285 INFO:tasks.workunit.client.0.smithi073.stderr: -373> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a50fae8) adding con mode: crc 2024-09-12T00:54:13.285 INFO:tasks.workunit.client.0.smithi073.stderr: -372> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a50fae8) adding con mode: secure 2024-09-12T00:54:13.285 INFO:tasks.workunit.client.0.smithi073.stderr: -371> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a50fae8) adding con mode: crc 2024-09-12T00:54:13.285 INFO:tasks.workunit.client.0.smithi073.stderr: -370> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a50fae8) adding con mode: crc 2024-09-12T00:54:13.285 INFO:tasks.workunit.client.0.smithi073.stderr: -369> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a50fae8) adding con mode: secure 2024-09-12T00:54:13.285 INFO:tasks.workunit.client.0.smithi073.stderr: -368> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a50fae8) adding con mode: crc 2024-09-12T00:54:13.285 INFO:tasks.workunit.client.0.smithi073.stderr: -367> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a50fae8) adding con mode: secure 2024-09-12T00:54:13.285 INFO:tasks.workunit.client.0.smithi073.stderr: -366> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a50fae8) adding con mode: crc 2024-09-12T00:54:13.285 INFO:tasks.workunit.client.0.smithi073.stderr: -365> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a50fae8) adding con mode: secure 2024-09-12T00:54:13.286 INFO:tasks.workunit.client.0.smithi073.stderr: -364> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:13.286 INFO:tasks.workunit.client.0.smithi073.stderr: -363> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:13.286 INFO:tasks.workunit.client.0.smithi073.stderr: -362> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 5 asok(0x55bb6a29c630) register_command rotate-key cmddesc rotate-key hook 0x55bb6a50fc30 EEXIST 2024-09-12T00:54:13.286 INFO:tasks.workunit.client.0.smithi073.stderr: -361> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 10 monclient: _reopen_session rank -1 2024-09-12T00:54:13.286 INFO:tasks.workunit.client.0.smithi073.stderr: -360> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:54:13.286 INFO:tasks.workunit.client.0.smithi073.stderr: -359> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 10 monclient(hunting): picked mon.noname-b con 0x55bb6a538c40 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:54:13.286 INFO:tasks.workunit.client.0.smithi073.stderr: -358> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 10 monclient(hunting): picked mon.noname-c con 0x55bb6a539020 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:54:13.286 INFO:tasks.workunit.client.0.smithi073.stderr: -357> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 10 monclient(hunting): picked mon.noname-a con 0x55bb6a537950 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:54:13.286 INFO:tasks.workunit.client.0.smithi073.stderr: -356> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:13.286 INFO:tasks.workunit.client.0.smithi073.stderr: -355> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:13.286 INFO:tasks.workunit.client.0.smithi073.stderr: -354> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:13.286 INFO:tasks.workunit.client.0.smithi073.stderr: -353> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 10 monclient(hunting): _renew_subs 2024-09-12T00:54:13.286 INFO:tasks.workunit.client.0.smithi073.stderr: -352> 2024-09-12T00:54:12.944+0000 7f7bc6c20800 10 monclient(hunting): authenticate will time out at 2313.614838s 2024-09-12T00:54:13.287 INFO:tasks.workunit.client.0.smithi073.stderr: -351> 2024-09-12T00:54:12.944+0000 7f7bbbf09640 10 monclient(hunting): get_auth_request con 0x55bb6a539020 auth_method 0 2024-09-12T00:54:13.287 INFO:tasks.workunit.client.0.smithi073.stderr: -350> 2024-09-12T00:54:12.944+0000 7f7bbbf09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:13.287 INFO:tasks.workunit.client.0.smithi073.stderr: -349> 2024-09-12T00:54:12.944+0000 7f7bbbf09640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:13.287 INFO:tasks.workunit.client.0.smithi073.stderr: -348> 2024-09-12T00:54:12.944+0000 7f7bbbf09640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:13.287 INFO:tasks.workunit.client.0.smithi073.stderr: -347> 2024-09-12T00:54:12.944+0000 7f7bc4f0b640 10 monclient(hunting): get_auth_request con 0x55bb6a537950 auth_method 0 2024-09-12T00:54:13.287 INFO:tasks.workunit.client.0.smithi073.stderr: -346> 2024-09-12T00:54:12.944+0000 7f7bc4f0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:13.287 INFO:tasks.workunit.client.0.smithi073.stderr: -345> 2024-09-12T00:54:12.944+0000 7f7bc4f0b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:13.287 INFO:tasks.workunit.client.0.smithi073.stderr: -344> 2024-09-12T00:54:12.944+0000 7f7bc4f0b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:13.287 INFO:tasks.workunit.client.0.smithi073.stderr: -343> 2024-09-12T00:54:12.944+0000 7f7bc470a640 10 monclient(hunting): get_auth_request con 0x55bb6a538c40 auth_method 0 2024-09-12T00:54:13.287 INFO:tasks.workunit.client.0.smithi073.stderr: -342> 2024-09-12T00:54:12.945+0000 7f7bc470a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:13.287 INFO:tasks.workunit.client.0.smithi073.stderr: -341> 2024-09-12T00:54:12.945+0000 7f7bc470a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:13.287 INFO:tasks.workunit.client.0.smithi073.stderr: -340> 2024-09-12T00:54:12.945+0000 7f7bc470a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:13.287 INFO:tasks.workunit.client.0.smithi073.stderr: -339> 2024-09-12T00:54:12.945+0000 7f7bbbf09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:13.288 INFO:tasks.workunit.client.0.smithi073.stderr: -338> 2024-09-12T00:54:12.945+0000 7f7bbbf09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:13.288 INFO:tasks.workunit.client.0.smithi073.stderr: -337> 2024-09-12T00:54:12.945+0000 7f7bbbf09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:13.288 INFO:tasks.workunit.client.0.smithi073.stderr: -336> 2024-09-12T00:54:12.945+0000 7f7bc4f0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:13.288 INFO:tasks.workunit.client.0.smithi073.stderr: -335> 2024-09-12T00:54:12.945+0000 7f7bc4f0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:13.288 INFO:tasks.workunit.client.0.smithi073.stderr: -334> 2024-09-12T00:54:12.945+0000 7f7bc4f0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:13.288 INFO:tasks.workunit.client.0.smithi073.stderr: -333> 2024-09-12T00:54:12.945+0000 7f7bc470a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:13.288 INFO:tasks.workunit.client.0.smithi073.stderr: -332> 2024-09-12T00:54:12.945+0000 7f7bc470a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:13.288 INFO:tasks.workunit.client.0.smithi073.stderr: -331> 2024-09-12T00:54:12.945+0000 7f7bc470a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:13.288 INFO:tasks.workunit.client.0.smithi073.stderr: -330> 2024-09-12T00:54:12.945+0000 7f7bbbf09640 10 monclient(hunting): handle_auth_done global_id 7748 payload 824 2024-09-12T00:54:13.288 INFO:tasks.workunit.client.0.smithi073.stderr: -329> 2024-09-12T00:54:12.945+0000 7f7bbbf09640 10 monclient: _finish_hunting 0 2024-09-12T00:54:13.288 INFO:tasks.workunit.client.0.smithi073.stderr: -328> 2024-09-12T00:54:12.945+0000 7f7bbbf09640 1 monclient: found mon.noname-c 2024-09-12T00:54:13.289 INFO:tasks.workunit.client.0.smithi073.stderr: -327> 2024-09-12T00:54:12.945+0000 7f7bbbf09640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.73:3301/0 2024-09-12T00:54:13.289 INFO:tasks.workunit.client.0.smithi073.stderr: -326> 2024-09-12T00:54:12.945+0000 7f7aa9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:13.289 INFO:tasks.workunit.client.0.smithi073.stderr: -325> 2024-09-12T00:54:12.945+0000 7f7aa9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:54:13.289 INFO:tasks.workunit.client.0.smithi073.stderr: -324> 2024-09-12T00:54:12.945+0000 7f7aa9ffb640 10 monclient: dump: 2024-09-12T00:54:13.289 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:54:13.289 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:54:13.289 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:13.289 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:13.289 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:13.289 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:54:13.289 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:54:13.289 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:54:13.290 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:54:13.290 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:13.290 INFO:tasks.workunit.client.0.smithi073.stderr: -323> 2024-09-12T00:54:12.945+0000 7f7aa9ffb640 10 monclient: _finish_auth 0 2024-09-12T00:54:13.290 INFO:tasks.workunit.client.0.smithi073.stderr: -322> 2024-09-12T00:54:12.945+0000 7f7aa9ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:54:13.290 INFO:tasks.workunit.client.0.smithi073.stderr: -321> 2024-09-12T00:54:12.945+0000 7f7aa9ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:13.290 INFO:tasks.workunit.client.0.smithi073.stderr: -320> 2024-09-12T00:54:12.945+0000 7f7aa9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:13.290 INFO:tasks.workunit.client.0.smithi073.stderr: -319> 2024-09-12T00:54:12.945+0000 7f7aa9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:54:13.290 INFO:tasks.workunit.client.0.smithi073.stderr: -318> 2024-09-12T00:54:12.945+0000 7f7aa9ffb640 10 monclient: dump: 2024-09-12T00:54:13.290 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:54:13.290 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:54:13.290 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:13.290 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:13.290 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:13.291 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:54:13.291 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:54:13.291 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:54:13.291 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:54:13.291 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:13.291 INFO:tasks.workunit.client.0.smithi073.stderr: -317> 2024-09-12T00:54:12.945+0000 7f7bc6c20800 5 monclient: authenticate success, global_id 7748 2024-09-12T00:54:13.291 INFO:tasks.workunit.client.0.smithi073.stderr: -316> 2024-09-12T00:54:12.945+0000 7f7bc6c20800 10 monclient: _renew_subs 2024-09-12T00:54:13.291 INFO:tasks.workunit.client.0.smithi073.stderr: -315> 2024-09-12T00:54:12.945+0000 7f7bc570c640 4 set_mon_vals no callback set 2024-09-12T00:54:13.291 INFO:tasks.workunit.client.0.smithi073.stderr: -314> 2024-09-12T00:54:12.945+0000 7f7bc6c20800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:54:13.291 INFO:tasks.workunit.client.0.smithi073.stderr: -313> 2024-09-12T00:54:12.945+0000 7f7bc6c20800 10 monclient: _renew_subs 2024-09-12T00:54:13.291 INFO:tasks.workunit.client.0.smithi073.stderr: -312> 2024-09-12T00:54:12.945+0000 7f7bc6c20800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:54:13.291 INFO:tasks.workunit.client.0.smithi073.stderr: -311> 2024-09-12T00:54:12.947+0000 7f7aa9ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:54:13.291 INFO:tasks.workunit.client.0.smithi073.stderr: -310> 2024-09-12T00:54:12.947+0000 7f7aa9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:54:13.292 INFO:tasks.workunit.client.0.smithi073.stderr: -309> 2024-09-12T00:54:12.947+0000 7f7aa9ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:54:13.292 INFO:tasks.workunit.client.0.smithi073.stderr: -308> 2024-09-12T00:54:12.947+0000 7f7bc470a640 10 monclient: get_auth_request con 0x7f7a9c076380 auth_method 0 2024-09-12T00:54:13.292 INFO:tasks.workunit.client.0.smithi073.stderr: -307> 2024-09-12T00:54:12.947+0000 7f7bc6c20800 10 monclient: get_monmap_and_config 2024-09-12T00:54:13.292 INFO:tasks.workunit.client.0.smithi073.stderr: -306> 2024-09-12T00:54:12.947+0000 7f7bc6c20800 10 monclient: build_initial_monmap 2024-09-12T00:54:13.292 INFO:tasks.workunit.client.0.smithi073.stderr: -305> 2024-09-12T00:54:12.947+0000 7f7bc6c20800 1 build_initial for_mkfs: 0 2024-09-12T00:54:13.292 INFO:tasks.workunit.client.0.smithi073.stderr: -304> 2024-09-12T00:54:12.947+0000 7f7bc6c20800 10 monclient: monmap: 2024-09-12T00:54:13.292 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:54:13.292 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:54:13.292 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:54:13.292 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:54:13.292 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:54:13.293 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:54:13.293 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:54:13.293 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:54:13.293 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:54:13.293 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:13.293 INFO:tasks.workunit.client.0.smithi073.stderr: -303> 2024-09-12T00:54:12.947+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a558960) adding auth protocol: cephx 2024-09-12T00:54:13.293 INFO:tasks.workunit.client.0.smithi073.stderr: -302> 2024-09-12T00:54:12.947+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a558960) adding auth protocol: cephx 2024-09-12T00:54:13.293 INFO:tasks.workunit.client.0.smithi073.stderr: -301> 2024-09-12T00:54:12.947+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a558960) adding auth protocol: cephx 2024-09-12T00:54:13.293 INFO:tasks.workunit.client.0.smithi073.stderr: -300> 2024-09-12T00:54:12.947+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a558960) adding con mode: secure 2024-09-12T00:54:13.293 INFO:tasks.workunit.client.0.smithi073.stderr: -299> 2024-09-12T00:54:12.947+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a558960) adding con mode: crc 2024-09-12T00:54:13.293 INFO:tasks.workunit.client.0.smithi073.stderr: -298> 2024-09-12T00:54:12.947+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a558960) adding con mode: secure 2024-09-12T00:54:13.294 INFO:tasks.workunit.client.0.smithi073.stderr: -297> 2024-09-12T00:54:12.947+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a558960) adding con mode: crc 2024-09-12T00:54:13.294 INFO:tasks.workunit.client.0.smithi073.stderr: -296> 2024-09-12T00:54:12.947+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a558960) adding con mode: secure 2024-09-12T00:54:13.294 INFO:tasks.workunit.client.0.smithi073.stderr: -295> 2024-09-12T00:54:12.947+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a558960) adding con mode: crc 2024-09-12T00:54:13.294 INFO:tasks.workunit.client.0.smithi073.stderr: -294> 2024-09-12T00:54:12.947+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a558960) adding con mode: crc 2024-09-12T00:54:13.294 INFO:tasks.workunit.client.0.smithi073.stderr: -293> 2024-09-12T00:54:12.947+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a558960) adding con mode: secure 2024-09-12T00:54:13.294 INFO:tasks.workunit.client.0.smithi073.stderr: -292> 2024-09-12T00:54:12.947+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a558960) adding con mode: crc 2024-09-12T00:54:13.294 INFO:tasks.workunit.client.0.smithi073.stderr: -291> 2024-09-12T00:54:12.947+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a558960) adding con mode: secure 2024-09-12T00:54:13.294 INFO:tasks.workunit.client.0.smithi073.stderr: -290> 2024-09-12T00:54:12.947+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a558960) adding con mode: crc 2024-09-12T00:54:13.294 INFO:tasks.workunit.client.0.smithi073.stderr: -289> 2024-09-12T00:54:12.947+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a558960) adding con mode: secure 2024-09-12T00:54:13.294 INFO:tasks.workunit.client.0.smithi073.stderr: -288> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:13.294 INFO:tasks.workunit.client.0.smithi073.stderr: -287> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 10 monclient: init 2024-09-12T00:54:13.294 INFO:tasks.workunit.client.0.smithi073.stderr: -286> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad1f40) adding auth protocol: cephx 2024-09-12T00:54:13.294 INFO:tasks.workunit.client.0.smithi073.stderr: -285> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad1f40) adding auth protocol: cephx 2024-09-12T00:54:13.295 INFO:tasks.workunit.client.0.smithi073.stderr: -284> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad1f40) adding auth protocol: cephx 2024-09-12T00:54:13.295 INFO:tasks.workunit.client.0.smithi073.stderr: -283> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad1f40) adding con mode: secure 2024-09-12T00:54:13.295 INFO:tasks.workunit.client.0.smithi073.stderr: -282> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad1f40) adding con mode: crc 2024-09-12T00:54:13.295 INFO:tasks.workunit.client.0.smithi073.stderr: -281> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad1f40) adding con mode: secure 2024-09-12T00:54:13.295 INFO:tasks.workunit.client.0.smithi073.stderr: -280> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad1f40) adding con mode: crc 2024-09-12T00:54:13.295 INFO:tasks.workunit.client.0.smithi073.stderr: -279> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad1f40) adding con mode: secure 2024-09-12T00:54:13.295 INFO:tasks.workunit.client.0.smithi073.stderr: -278> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad1f40) adding con mode: crc 2024-09-12T00:54:13.295 INFO:tasks.workunit.client.0.smithi073.stderr: -277> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad1f40) adding con mode: crc 2024-09-12T00:54:13.295 INFO:tasks.workunit.client.0.smithi073.stderr: -276> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad1f40) adding con mode: secure 2024-09-12T00:54:13.295 INFO:tasks.workunit.client.0.smithi073.stderr: -275> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad1f40) adding con mode: crc 2024-09-12T00:54:13.295 INFO:tasks.workunit.client.0.smithi073.stderr: -274> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad1f40) adding con mode: secure 2024-09-12T00:54:13.295 INFO:tasks.workunit.client.0.smithi073.stderr: -273> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad1f40) adding con mode: crc 2024-09-12T00:54:13.296 INFO:tasks.workunit.client.0.smithi073.stderr: -272> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad1f40) adding con mode: secure 2024-09-12T00:54:13.296 INFO:tasks.workunit.client.0.smithi073.stderr: -271> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:13.296 INFO:tasks.workunit.client.0.smithi073.stderr: -270> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:13.296 INFO:tasks.workunit.client.0.smithi073.stderr: -269> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 5 asok(0x55bb6a29c630) register_command rotate-key cmddesc rotate-key hook 0x7ffcf9ad2088 EEXIST 2024-09-12T00:54:13.296 INFO:tasks.workunit.client.0.smithi073.stderr: -268> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 10 monclient: _reopen_session rank -1 2024-09-12T00:54:13.296 INFO:tasks.workunit.client.0.smithi073.stderr: -267> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:54:13.296 INFO:tasks.workunit.client.0.smithi073.stderr: -266> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 10 monclient(hunting): picked mon.noname-b con 0x55bb6a58cfc0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:54:13.296 INFO:tasks.workunit.client.0.smithi073.stderr: -265> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 10 monclient(hunting): picked mon.noname-a con 0x55bb6a55dfd0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:54:13.296 INFO:tasks.workunit.client.0.smithi073.stderr: -264> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 10 monclient(hunting): picked mon.noname-c con 0x55bb6a5884a0 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:54:13.296 INFO:tasks.workunit.client.0.smithi073.stderr: -263> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:13.296 INFO:tasks.workunit.client.0.smithi073.stderr: -262> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:13.296 INFO:tasks.workunit.client.0.smithi073.stderr: -261> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:13.296 INFO:tasks.workunit.client.0.smithi073.stderr: -260> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 10 monclient(hunting): _renew_subs 2024-09-12T00:54:13.297 INFO:tasks.workunit.client.0.smithi073.stderr: -259> 2024-09-12T00:54:12.948+0000 7f7bc6c20800 10 monclient(hunting): authenticate will time out at 2313.618733s 2024-09-12T00:54:13.297 INFO:tasks.workunit.client.0.smithi073.stderr: -258> 2024-09-12T00:54:12.948+0000 7f7bc4f0b640 10 monclient(hunting): get_auth_request con 0x55bb6a5884a0 auth_method 0 2024-09-12T00:54:13.297 INFO:tasks.workunit.client.0.smithi073.stderr: -257> 2024-09-12T00:54:12.948+0000 7f7bc4f0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:13.297 INFO:tasks.workunit.client.0.smithi073.stderr: -256> 2024-09-12T00:54:12.948+0000 7f7bc4f0b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:13.297 INFO:tasks.workunit.client.0.smithi073.stderr: -255> 2024-09-12T00:54:12.948+0000 7f7bc4f0b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:13.297 INFO:tasks.workunit.client.0.smithi073.stderr: -254> 2024-09-12T00:54:12.948+0000 7f7bbbf09640 10 monclient(hunting): get_auth_request con 0x55bb6a55dfd0 auth_method 0 2024-09-12T00:54:13.297 INFO:tasks.workunit.client.0.smithi073.stderr: -253> 2024-09-12T00:54:12.948+0000 7f7bbbf09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:13.297 INFO:tasks.workunit.client.0.smithi073.stderr: -252> 2024-09-12T00:54:12.948+0000 7f7bbbf09640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:13.297 INFO:tasks.workunit.client.0.smithi073.stderr: -251> 2024-09-12T00:54:12.948+0000 7f7bbbf09640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:13.297 INFO:tasks.workunit.client.0.smithi073.stderr: -250> 2024-09-12T00:54:12.948+0000 7f7bc470a640 10 monclient(hunting): get_auth_request con 0x55bb6a58cfc0 auth_method 0 2024-09-12T00:54:13.297 INFO:tasks.workunit.client.0.smithi073.stderr: -249> 2024-09-12T00:54:12.948+0000 7f7bc470a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:13.297 INFO:tasks.workunit.client.0.smithi073.stderr: -248> 2024-09-12T00:54:12.948+0000 7f7bc470a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:13.297 INFO:tasks.workunit.client.0.smithi073.stderr: -247> 2024-09-12T00:54:12.948+0000 7f7bc470a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:13.297 INFO:tasks.workunit.client.0.smithi073.stderr: -246> 2024-09-12T00:54:12.948+0000 7f7bbbf09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:13.298 INFO:tasks.workunit.client.0.smithi073.stderr: -245> 2024-09-12T00:54:12.948+0000 7f7bbbf09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:13.298 INFO:tasks.workunit.client.0.smithi073.stderr: -244> 2024-09-12T00:54:12.948+0000 7f7bbbf09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:13.298 INFO:tasks.workunit.client.0.smithi073.stderr: -243> 2024-09-12T00:54:12.948+0000 7f7bc4f0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:13.298 INFO:tasks.workunit.client.0.smithi073.stderr: -242> 2024-09-12T00:54:12.948+0000 7f7bc4f0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:13.298 INFO:tasks.workunit.client.0.smithi073.stderr: -241> 2024-09-12T00:54:12.948+0000 7f7bc4f0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:13.298 INFO:tasks.workunit.client.0.smithi073.stderr: -240> 2024-09-12T00:54:12.948+0000 7f7bc470a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:13.298 INFO:tasks.workunit.client.0.smithi073.stderr: -239> 2024-09-12T00:54:12.948+0000 7f7bc470a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:13.298 INFO:tasks.workunit.client.0.smithi073.stderr: -238> 2024-09-12T00:54:12.948+0000 7f7bc470a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:13.298 INFO:tasks.workunit.client.0.smithi073.stderr: -237> 2024-09-12T00:54:12.949+0000 7f7bbbf09640 10 monclient(hunting): handle_auth_done global_id 8268 payload 274 2024-09-12T00:54:13.298 INFO:tasks.workunit.client.0.smithi073.stderr: -236> 2024-09-12T00:54:12.949+0000 7f7bbbf09640 10 monclient: _finish_hunting 0 2024-09-12T00:54:13.298 INFO:tasks.workunit.client.0.smithi073.stderr: -235> 2024-09-12T00:54:12.949+0000 7f7bbbf09640 1 monclient: found mon.noname-a 2024-09-12T00:54:13.298 INFO:tasks.workunit.client.0.smithi073.stderr: -234> 2024-09-12T00:54:12.949+0000 7f7bbbf09640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:54:13.298 INFO:tasks.workunit.client.0.smithi073.stderr: -233> 2024-09-12T00:54:12.949+0000 7f7a9b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:13.299 INFO:tasks.workunit.client.0.smithi073.stderr: -232> 2024-09-12T00:54:12.949+0000 7f7a9b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:54:13.299 INFO:tasks.workunit.client.0.smithi073.stderr: -231> 2024-09-12T00:54:12.949+0000 7f7a9b7fe640 10 monclient: dump: 2024-09-12T00:54:13.299 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:54:13.299 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:54:13.299 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:13.299 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:13.299 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:13.299 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:54:13.299 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:54:13.299 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:54:13.299 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:54:13.299 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:13.299 INFO:tasks.workunit.client.0.smithi073.stderr: -230> 2024-09-12T00:54:12.949+0000 7f7a9b7fe640 10 monclient: _finish_auth 0 2024-09-12T00:54:13.300 INFO:tasks.workunit.client.0.smithi073.stderr: -229> 2024-09-12T00:54:12.949+0000 7f7a9b7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:54:13.300 INFO:tasks.workunit.client.0.smithi073.stderr: -228> 2024-09-12T00:54:12.949+0000 7f7a9b7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:13.300 INFO:tasks.workunit.client.0.smithi073.stderr: -227> 2024-09-12T00:54:12.949+0000 7f7a9b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:13.300 INFO:tasks.workunit.client.0.smithi073.stderr: -226> 2024-09-12T00:54:12.949+0000 7f7a9b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:54:13.300 INFO:tasks.workunit.client.0.smithi073.stderr: -225> 2024-09-12T00:54:12.949+0000 7f7a9b7fe640 10 monclient: dump: 2024-09-12T00:54:13.300 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:54:13.300 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:54:13.300 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:13.300 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:13.300 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:13.300 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:54:13.300 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:54:13.300 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:54:13.301 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:54:13.301 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:13.301 INFO:tasks.workunit.client.0.smithi073.stderr: -224> 2024-09-12T00:54:12.949+0000 7f7bc6c20800 5 monclient: authenticate success, global_id 8268 2024-09-12T00:54:13.301 INFO:tasks.workunit.client.0.smithi073.stderr: -223> 2024-09-12T00:54:12.949+0000 7f7bc6c20800 10 monclient: get_monmap_and_config success 2024-09-12T00:54:13.301 INFO:tasks.workunit.client.0.smithi073.stderr: -222> 2024-09-12T00:54:12.949+0000 7f7bc6c20800 4 set_mon_vals no callback set 2024-09-12T00:54:13.301 INFO:tasks.workunit.client.0.smithi073.stderr: -221> 2024-09-12T00:54:12.949+0000 7f7bc6c20800 10 monclient: shutdown 2024-09-12T00:54:13.301 INFO:tasks.workunit.client.0.smithi073.stderr: -220> 2024-09-12T00:54:12.949+0000 7f7bc6c20800 10 monclient: build_initial_monmap 2024-09-12T00:54:13.301 INFO:tasks.workunit.client.0.smithi073.stderr: -219> 2024-09-12T00:54:12.949+0000 7f7bc6c20800 1 build_initial for_mkfs: 0 2024-09-12T00:54:13.301 INFO:tasks.workunit.client.0.smithi073.stderr: -218> 2024-09-12T00:54:12.949+0000 7f7bc6c20800 10 monclient: monmap: 2024-09-12T00:54:13.301 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:54:13.301 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:54:13.301 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:54:13.301 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:54:13.301 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:54:13.302 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:54:13.302 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:54:13.302 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:54:13.302 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:54:13.302 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:13.302 INFO:tasks.workunit.client.0.smithi073.stderr: -217> 2024-09-12T00:54:12.949+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a57ebf0) adding auth protocol: cephx 2024-09-12T00:54:13.302 INFO:tasks.workunit.client.0.smithi073.stderr: -216> 2024-09-12T00:54:12.949+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a57ebf0) adding auth protocol: cephx 2024-09-12T00:54:13.302 INFO:tasks.workunit.client.0.smithi073.stderr: -215> 2024-09-12T00:54:12.949+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a57ebf0) adding auth protocol: cephx 2024-09-12T00:54:13.302 INFO:tasks.workunit.client.0.smithi073.stderr: -214> 2024-09-12T00:54:12.949+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a57ebf0) adding con mode: secure 2024-09-12T00:54:13.302 INFO:tasks.workunit.client.0.smithi073.stderr: -213> 2024-09-12T00:54:12.949+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a57ebf0) adding con mode: crc 2024-09-12T00:54:13.302 INFO:tasks.workunit.client.0.smithi073.stderr: -212> 2024-09-12T00:54:12.949+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a57ebf0) adding con mode: secure 2024-09-12T00:54:13.302 INFO:tasks.workunit.client.0.smithi073.stderr: -211> 2024-09-12T00:54:12.949+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a57ebf0) adding con mode: crc 2024-09-12T00:54:13.302 INFO:tasks.workunit.client.0.smithi073.stderr: -210> 2024-09-12T00:54:12.949+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a57ebf0) adding con mode: secure 2024-09-12T00:54:13.302 INFO:tasks.workunit.client.0.smithi073.stderr: -209> 2024-09-12T00:54:12.949+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a57ebf0) adding con mode: crc 2024-09-12T00:54:13.303 INFO:tasks.workunit.client.0.smithi073.stderr: -208> 2024-09-12T00:54:12.949+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a57ebf0) adding con mode: crc 2024-09-12T00:54:13.303 INFO:tasks.workunit.client.0.smithi073.stderr: -207> 2024-09-12T00:54:12.949+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a57ebf0) adding con mode: secure 2024-09-12T00:54:13.303 INFO:tasks.workunit.client.0.smithi073.stderr: -206> 2024-09-12T00:54:12.949+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a57ebf0) adding con mode: crc 2024-09-12T00:54:13.303 INFO:tasks.workunit.client.0.smithi073.stderr: -205> 2024-09-12T00:54:12.949+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a57ebf0) adding con mode: secure 2024-09-12T00:54:13.303 INFO:tasks.workunit.client.0.smithi073.stderr: -204> 2024-09-12T00:54:12.949+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a57ebf0) adding con mode: crc 2024-09-12T00:54:13.303 INFO:tasks.workunit.client.0.smithi073.stderr: -203> 2024-09-12T00:54:12.949+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a57ebf0) adding con mode: secure 2024-09-12T00:54:13.303 INFO:tasks.workunit.client.0.smithi073.stderr: -202> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:13.303 INFO:tasks.workunit.client.0.smithi073.stderr: -201> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 1 librados: starting msgr at 2024-09-12T00:54:13.303 INFO:tasks.workunit.client.0.smithi073.stderr: -200> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 1 librados: starting objecter 2024-09-12T00:54:13.303 INFO:tasks.workunit.client.0.smithi073.stderr: -199> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 5 asok(0x55bb6a29c630) register_command objecter_requests cmddesc objecter_requests hook 0x55bb6a58d6e0 EEXIST 2024-09-12T00:54:13.303 INFO:tasks.workunit.client.0.smithi073.stderr: -198> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 1 librados: setting wanted keys 2024-09-12T00:54:13.303 INFO:tasks.workunit.client.0.smithi073.stderr: -197> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 1 librados: calling monclient init 2024-09-12T00:54:13.303 INFO:tasks.workunit.client.0.smithi073.stderr: -196> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 10 monclient: init 2024-09-12T00:54:13.304 INFO:tasks.workunit.client.0.smithi073.stderr: -195> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a54d500) adding auth protocol: cephx 2024-09-12T00:54:13.304 INFO:tasks.workunit.client.0.smithi073.stderr: -194> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a54d500) adding auth protocol: cephx 2024-09-12T00:54:13.304 INFO:tasks.workunit.client.0.smithi073.stderr: -193> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a54d500) adding auth protocol: cephx 2024-09-12T00:54:13.304 INFO:tasks.workunit.client.0.smithi073.stderr: -192> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a54d500) adding con mode: secure 2024-09-12T00:54:13.304 INFO:tasks.workunit.client.0.smithi073.stderr: -191> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a54d500) adding con mode: crc 2024-09-12T00:54:13.304 INFO:tasks.workunit.client.0.smithi073.stderr: -190> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a54d500) adding con mode: secure 2024-09-12T00:54:13.304 INFO:tasks.workunit.client.0.smithi073.stderr: -189> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a54d500) adding con mode: crc 2024-09-12T00:54:13.304 INFO:tasks.workunit.client.0.smithi073.stderr: -188> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a54d500) adding con mode: secure 2024-09-12T00:54:13.304 INFO:tasks.workunit.client.0.smithi073.stderr: -187> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a54d500) adding con mode: crc 2024-09-12T00:54:13.304 INFO:tasks.workunit.client.0.smithi073.stderr: -186> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a54d500) adding con mode: crc 2024-09-12T00:54:13.304 INFO:tasks.workunit.client.0.smithi073.stderr: -185> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a54d500) adding con mode: secure 2024-09-12T00:54:13.304 INFO:tasks.workunit.client.0.smithi073.stderr: -184> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a54d500) adding con mode: crc 2024-09-12T00:54:13.304 INFO:tasks.workunit.client.0.smithi073.stderr: -183> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a54d500) adding con mode: secure 2024-09-12T00:54:13.304 INFO:tasks.workunit.client.0.smithi073.stderr: -182> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a54d500) adding con mode: crc 2024-09-12T00:54:13.305 INFO:tasks.workunit.client.0.smithi073.stderr: -181> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 5 AuthRegistry(0x55bb6a54d500) adding con mode: secure 2024-09-12T00:54:13.305 INFO:tasks.workunit.client.0.smithi073.stderr: -180> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:13.305 INFO:tasks.workunit.client.0.smithi073.stderr: -179> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:13.305 INFO:tasks.workunit.client.0.smithi073.stderr: -178> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 5 asok(0x55bb6a29c630) register_command rotate-key cmddesc rotate-key hook 0x55bb6a54d648 EEXIST 2024-09-12T00:54:13.305 INFO:tasks.workunit.client.0.smithi073.stderr: -177> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 10 monclient: _reopen_session rank -1 2024-09-12T00:54:13.305 INFO:tasks.workunit.client.0.smithi073.stderr: -176> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:54:13.305 INFO:tasks.workunit.client.0.smithi073.stderr: -175> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 10 monclient(hunting): picked mon.noname-c con 0x55bb6a55dfd0 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:54:13.305 INFO:tasks.workunit.client.0.smithi073.stderr: -174> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 10 monclient(hunting): picked mon.noname-a con 0x55bb6a5884a0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:54:13.305 INFO:tasks.workunit.client.0.smithi073.stderr: -173> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 10 monclient(hunting): picked mon.noname-b con 0x55bb6a58cfc0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:54:13.305 INFO:tasks.workunit.client.0.smithi073.stderr: -172> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:13.305 INFO:tasks.workunit.client.0.smithi073.stderr: -171> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:13.305 INFO:tasks.workunit.client.0.smithi073.stderr: -170> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:13.305 INFO:tasks.workunit.client.0.smithi073.stderr: -169> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 10 monclient(hunting): _renew_subs 2024-09-12T00:54:13.305 INFO:tasks.workunit.client.0.smithi073.stderr: -168> 2024-09-12T00:54:12.950+0000 7f7bc6c20800 10 monclient(hunting): authenticate will time out at 2313.620913s 2024-09-12T00:54:13.306 INFO:tasks.workunit.client.0.smithi073.stderr: -167> 2024-09-12T00:54:12.951+0000 7f7bc470a640 10 monclient(hunting): get_auth_request con 0x55bb6a55dfd0 auth_method 0 2024-09-12T00:54:13.306 INFO:tasks.workunit.client.0.smithi073.stderr: -166> 2024-09-12T00:54:12.951+0000 7f7bc470a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:13.306 INFO:tasks.workunit.client.0.smithi073.stderr: -165> 2024-09-12T00:54:12.951+0000 7f7bc470a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:13.306 INFO:tasks.workunit.client.0.smithi073.stderr: -164> 2024-09-12T00:54:12.951+0000 7f7bc470a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:13.306 INFO:tasks.workunit.client.0.smithi073.stderr: -163> 2024-09-12T00:54:12.951+0000 7f7bbbf09640 10 monclient(hunting): get_auth_request con 0x55bb6a5884a0 auth_method 0 2024-09-12T00:54:13.306 INFO:tasks.workunit.client.0.smithi073.stderr: -162> 2024-09-12T00:54:12.951+0000 7f7bbbf09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:13.306 INFO:tasks.workunit.client.0.smithi073.stderr: -161> 2024-09-12T00:54:12.951+0000 7f7bbbf09640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:13.306 INFO:tasks.workunit.client.0.smithi073.stderr: -160> 2024-09-12T00:54:12.951+0000 7f7bbbf09640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:13.306 INFO:tasks.workunit.client.0.smithi073.stderr: -159> 2024-09-12T00:54:12.951+0000 7f7bc4f0b640 10 monclient(hunting): get_auth_request con 0x55bb6a58cfc0 auth_method 0 2024-09-12T00:54:13.306 INFO:tasks.workunit.client.0.smithi073.stderr: -158> 2024-09-12T00:54:12.951+0000 7f7bc4f0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:13.306 INFO:tasks.workunit.client.0.smithi073.stderr: -157> 2024-09-12T00:54:12.951+0000 7f7bc4f0b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:13.306 INFO:tasks.workunit.client.0.smithi073.stderr: -156> 2024-09-12T00:54:12.951+0000 7f7bc4f0b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:13.306 INFO:tasks.workunit.client.0.smithi073.stderr: -155> 2024-09-12T00:54:12.951+0000 7f7bc470a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:13.307 INFO:tasks.workunit.client.0.smithi073.stderr: -154> 2024-09-12T00:54:12.951+0000 7f7bc470a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:13.307 INFO:tasks.workunit.client.0.smithi073.stderr: -153> 2024-09-12T00:54:12.951+0000 7f7bc470a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:13.307 INFO:tasks.workunit.client.0.smithi073.stderr: -152> 2024-09-12T00:54:12.951+0000 7f7bbbf09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:13.307 INFO:tasks.workunit.client.0.smithi073.stderr: -151> 2024-09-12T00:54:12.951+0000 7f7bbbf09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:13.307 INFO:tasks.workunit.client.0.smithi073.stderr: -150> 2024-09-12T00:54:12.951+0000 7f7bbbf09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:13.307 INFO:tasks.workunit.client.0.smithi073.stderr: -149> 2024-09-12T00:54:12.951+0000 7f7bc4f0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:13.307 INFO:tasks.workunit.client.0.smithi073.stderr: -148> 2024-09-12T00:54:12.951+0000 7f7bc4f0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:13.307 INFO:tasks.workunit.client.0.smithi073.stderr: -147> 2024-09-12T00:54:12.951+0000 7f7bc4f0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:13.307 INFO:tasks.workunit.client.0.smithi073.stderr: -146> 2024-09-12T00:54:12.951+0000 7f7bbbf09640 10 monclient(hunting): handle_auth_done global_id 8271 payload 824 2024-09-12T00:54:13.307 INFO:tasks.workunit.client.0.smithi073.stderr: -145> 2024-09-12T00:54:12.951+0000 7f7bbbf09640 10 monclient: _finish_hunting 0 2024-09-12T00:54:13.307 INFO:tasks.workunit.client.0.smithi073.stderr: -144> 2024-09-12T00:54:12.951+0000 7f7bbbf09640 1 monclient: found mon.noname-a 2024-09-12T00:54:13.307 INFO:tasks.workunit.client.0.smithi073.stderr: -143> 2024-09-12T00:54:12.951+0000 7f7bbbf09640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:54:13.307 INFO:tasks.workunit.client.0.smithi073.stderr: -142> 2024-09-12T00:54:12.951+0000 7f7a99ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:13.307 INFO:tasks.workunit.client.0.smithi073.stderr: -141> 2024-09-12T00:54:12.951+0000 7f7a99ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:54:13.308 INFO:tasks.workunit.client.0.smithi073.stderr: -140> 2024-09-12T00:54:12.951+0000 7f7a99ffb640 10 monclient: dump: 2024-09-12T00:54:13.308 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:54:13.308 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:54:13.308 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:13.308 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:13.308 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:13.308 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:54:13.308 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:54:13.308 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:54:13.308 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:54:13.308 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:13.308 INFO:tasks.workunit.client.0.smithi073.stderr: -139> 2024-09-12T00:54:12.951+0000 7f7a99ffb640 10 monclient: _finish_auth 0 2024-09-12T00:54:13.308 INFO:tasks.workunit.client.0.smithi073.stderr: -138> 2024-09-12T00:54:12.951+0000 7f7a99ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:54:13.309 INFO:tasks.workunit.client.0.smithi073.stderr: -137> 2024-09-12T00:54:12.951+0000 7f7a99ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:13.309 INFO:tasks.workunit.client.0.smithi073.stderr: -136> 2024-09-12T00:54:12.951+0000 7f7a99ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:13.309 INFO:tasks.workunit.client.0.smithi073.stderr: -135> 2024-09-12T00:54:12.951+0000 7f7a99ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:54:13.309 INFO:tasks.workunit.client.0.smithi073.stderr: -134> 2024-09-12T00:54:12.951+0000 7f7a99ffb640 10 monclient: dump: 2024-09-12T00:54:13.309 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:54:13.309 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:54:13.309 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:13.309 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:13.309 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:13.309 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:54:13.309 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:54:13.309 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:54:13.309 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:54:13.310 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:13.310 INFO:tasks.workunit.client.0.smithi073.stderr: -133> 2024-09-12T00:54:12.951+0000 7f7bc6c20800 5 monclient: authenticate success, global_id 8271 2024-09-12T00:54:13.310 INFO:tasks.workunit.client.0.smithi073.stderr: -132> 2024-09-12T00:54:12.951+0000 7f7bc6c20800 10 monclient: _renew_subs 2024-09-12T00:54:13.310 INFO:tasks.workunit.client.0.smithi073.stderr: -131> 2024-09-12T00:54:12.951+0000 7f7a9b7fe640 4 set_mon_vals no callback set 2024-09-12T00:54:13.310 INFO:tasks.workunit.client.0.smithi073.stderr: -130> 2024-09-12T00:54:12.951+0000 7f7bc6c20800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:54:13.310 INFO:tasks.workunit.client.0.smithi073.stderr: -129> 2024-09-12T00:54:12.951+0000 7f7bc6c20800 10 monclient: _renew_subs 2024-09-12T00:54:13.310 INFO:tasks.workunit.client.0.smithi073.stderr: -128> 2024-09-12T00:54:12.951+0000 7f7bc6c20800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:54:13.310 INFO:tasks.workunit.client.0.smithi073.stderr: -127> 2024-09-12T00:54:12.951+0000 7f7bc6c20800 1 librados: init done 2024-09-12T00:54:13.310 INFO:tasks.workunit.client.0.smithi073.stderr: -126> 2024-09-12T00:54:12.951+0000 7f7bc6c20800 5 asok(0x55bb6a29c630) register_command cr dump hook 0x55bb6a55d0b8 2024-09-12T00:54:13.310 INFO:tasks.workunit.client.0.smithi073.stderr: -125> 2024-09-12T00:54:12.953+0000 7f7bc6c20800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.310 INFO:tasks.workunit.client.0.smithi073.stderr: -124> 2024-09-12T00:54:12.953+0000 7f7a99ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:54:13.310 INFO:tasks.workunit.client.0.smithi073.stderr: -123> 2024-09-12T00:54:12.953+0000 7f7a99ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:54:13.310 INFO:tasks.workunit.client.0.smithi073.stderr: -122> 2024-09-12T00:54:12.953+0000 7f7a99ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:54:13.311 INFO:tasks.workunit.client.0.smithi073.stderr: -121> 2024-09-12T00:54:12.953+0000 7f7bc470a640 10 monclient: get_auth_request con 0x7f7a8c0764a0 auth_method 0 2024-09-12T00:54:13.311 INFO:tasks.workunit.client.0.smithi073.stderr: -120> 2024-09-12T00:54:12.953+0000 7f7bc4f0b640 10 monclient: get_auth_request con 0x55bb6a5a6bc0 auth_method 0 2024-09-12T00:54:13.311 INFO:tasks.workunit.client.0.smithi073.stderr: -119> 2024-09-12T00:54:12.954+0000 7f7bc6c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:13.311 INFO:tasks.workunit.client.0.smithi073.stderr: -118> 2024-09-12T00:54:12.954+0000 7f7bc6c20800 20 realm 2024-09-12T00:54:13.311 INFO:tasks.workunit.client.0.smithi073.stderr: -117> 2024-09-12T00:54:12.954+0000 7f7bc6c20800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.311 INFO:tasks.workunit.client.0.smithi073.stderr: -116> 2024-09-12T00:54:12.954+0000 7f7bc6c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:13.311 INFO:tasks.workunit.client.0.smithi073.stderr: -115> 2024-09-12T00:54:12.954+0000 7f7bc6c20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:13.311 INFO:tasks.workunit.client.0.smithi073.stderr: -114> 2024-09-12T00:54:12.954+0000 7f7bc6c20800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.311 INFO:tasks.workunit.client.0.smithi073.stderr: -113> 2024-09-12T00:54:12.954+0000 7f7bc6c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:13.311 INFO:tasks.workunit.client.0.smithi073.stderr: -112> 2024-09-12T00:54:12.954+0000 7f7bc6c20800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.311 INFO:tasks.workunit.client.0.smithi073.stderr: -111> 2024-09-12T00:54:12.954+0000 7f7bc470a640 10 monclient: get_auth_request con 0x55bb6a5aaef0 auth_method 0 2024-09-12T00:54:13.311 INFO:tasks.workunit.client.0.smithi073.stderr: -110> 2024-09-12T00:54:12.955+0000 7f7bc6c20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:13.311 INFO:tasks.workunit.client.0.smithi073.stderr: -109> 2024-09-12T00:54:12.955+0000 7f7bc6c20800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.311 INFO:tasks.workunit.client.0.smithi073.stderr: -108> 2024-09-12T00:54:12.955+0000 7f7bbbf09640 10 monclient: get_auth_request con 0x55bb6a5ae610 auth_method 0 2024-09-12T00:54:13.312 INFO:tasks.workunit.client.0.smithi073.stderr: -107> 2024-09-12T00:54:12.956+0000 7f7bc6c20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:13.312 INFO:tasks.workunit.client.0.smithi073.stderr: -106> 2024-09-12T00:54:12.956+0000 7f7bc6c20800 20 searching for the correct realm 2024-09-12T00:54:13.312 INFO:tasks.workunit.client.0.smithi073.stderr: -105> 2024-09-12T00:54:12.956+0000 7f7bc4f0b640 10 monclient: get_auth_request con 0x55bb6a5b3390 auth_method 0 2024-09-12T00:54:13.312 INFO:tasks.workunit.client.0.smithi073.stderr: -104> 2024-09-12T00:54:12.957+0000 7f7bc470a640 10 monclient: get_auth_request con 0x7f7bbc062940 auth_method 0 2024-09-12T00:54:13.312 INFO:tasks.workunit.client.0.smithi073.stderr: -103> 2024-09-12T00:54:12.957+0000 7f7bbbf09640 10 monclient: get_auth_request con 0x7f7bb4009040 auth_method 0 2024-09-12T00:54:13.312 INFO:tasks.workunit.client.0.smithi073.stderr: -102> 2024-09-12T00:54:12.958+0000 7f7bc4f0b640 10 monclient: get_auth_request con 0x7f7bac02b800 auth_method 0 2024-09-12T00:54:13.312 INFO:tasks.workunit.client.0.smithi073.stderr: -101> 2024-09-12T00:54:12.958+0000 7f7bc4f0b640 0 -- 172.21.15.73:0/2314965784 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f7bac02b800 msgr2=0x7f7bac0023e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:13.312 INFO:tasks.workunit.client.0.smithi073.stderr: -100> 2024-09-12T00:54:13.160+0000 7f7bc4f0b640 10 monclient: get_auth_request con 0x7f7bac02b800 auth_method 0 2024-09-12T00:54:13.312 INFO:tasks.workunit.client.0.smithi073.stderr: -99> 2024-09-12T00:54:13.164+0000 7f7bc470a640 10 monclient: get_auth_request con 0x7f7bbc086040 auth_method 0 2024-09-12T00:54:13.312 INFO:tasks.workunit.client.0.smithi073.stderr: -98> 2024-09-12T00:54:13.165+0000 7f7bc4f0b640 0 -- 172.21.15.73:0/2314965784 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f7bac02b800 msgr2=0x7f7bac0023e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:13.312 INFO:tasks.workunit.client.0.smithi073.stderr: -97> 2024-09-12T00:54:13.165+0000 7f7a99ffb640 1 client.8271.objecter ms_handle_reset 0x7f7bac02b800 session 0x7f7bac027e90 osd.4 2024-09-12T00:54:13.312 INFO:tasks.workunit.client.0.smithi073.stderr: -96> 2024-09-12T00:54:13.165+0000 7f7a99ffb640 10 monclient: _renew_subs 2024-09-12T00:54:13.312 INFO:tasks.workunit.client.0.smithi073.stderr: -95> 2024-09-12T00:54:13.165+0000 7f7a99ffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:54:13.313 INFO:tasks.workunit.client.0.smithi073.stderr: -94> 2024-09-12T00:54:13.165+0000 7f7bc4f0b640 10 monclient: get_auth_request con 0x7f7a8c0863a0 auth_method 0 2024-09-12T00:54:13.313 INFO:tasks.workunit.client.0.smithi073.stderr: -93> 2024-09-12T00:54:13.169+0000 7f7bc6c20800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:54:13.313 INFO:tasks.workunit.client.0.smithi073.stderr: -92> 2024-09-12T00:54:13.169+0000 7f7bc6c20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:13.313 INFO:tasks.workunit.client.0.smithi073.stderr: -91> 2024-09-12T00:54:13.169+0000 7f7bc6c20800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:54:13.313 INFO:tasks.workunit.client.0.smithi073.stderr: -90> 2024-09-12T00:54:13.169+0000 7f7bc6c20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:13.313 INFO:tasks.workunit.client.0.smithi073.stderr: -89> 2024-09-12T00:54:13.169+0000 7f7bc6c20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:13.313 INFO:tasks.workunit.client.0.smithi073.stderr: -88> 2024-09-12T00:54:13.169+0000 7f7bc6c20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:13.313 INFO:tasks.workunit.client.0.smithi073.stderr: -87> 2024-09-12T00:54:13.169+0000 7f7bc6c20800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.313 INFO:tasks.workunit.client.0.smithi073.stderr: -86> 2024-09-12T00:54:13.169+0000 7f7bc6c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:13.313 INFO:tasks.workunit.client.0.smithi073.stderr: -85> 2024-09-12T00:54:13.169+0000 7f7bc6c20800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.313 INFO:tasks.workunit.client.0.smithi073.stderr: -84> 2024-09-12T00:54:13.169+0000 7f7bc6c20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:13.313 INFO:tasks.workunit.client.0.smithi073.stderr: -83> 2024-09-12T00:54:13.169+0000 7f7bc6c20800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.313 INFO:tasks.workunit.client.0.smithi073.stderr: -82> 2024-09-12T00:54:13.169+0000 7f7bc6c20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:13.314 INFO:tasks.workunit.client.0.smithi073.stderr: -81> 2024-09-12T00:54:13.169+0000 7f7bc6c20800 20 zone default found 2024-09-12T00:54:13.314 INFO:tasks.workunit.client.0.smithi073.stderr: -80> 2024-09-12T00:54:13.169+0000 7f7bc6c20800 4 Realm: () 2024-09-12T00:54:13.314 INFO:tasks.workunit.client.0.smithi073.stderr: -79> 2024-09-12T00:54:13.169+0000 7f7bc6c20800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:54:13.314 INFO:tasks.workunit.client.0.smithi073.stderr: -78> 2024-09-12T00:54:13.169+0000 7f7bc6c20800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:54:13.314 INFO:tasks.workunit.client.0.smithi073.stderr: -77> 2024-09-12T00:54:13.169+0000 7f7bc6c20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:13.314 INFO:tasks.workunit.client.0.smithi073.stderr: -76> 2024-09-12T00:54:13.169+0000 7f7bc6c20800 20 zonegroup default 2024-09-12T00:54:13.314 INFO:tasks.workunit.client.0.smithi073.stderr: -75> 2024-09-12T00:54:13.169+0000 7f7bc6c20800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.314 INFO:tasks.workunit.client.0.smithi073.stderr: -74> 2024-09-12T00:54:13.170+0000 7f7bc6c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:13.314 INFO:tasks.workunit.client.0.smithi073.stderr: -73> 2024-09-12T00:54:13.170+0000 7f7bc6c20800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.314 INFO:tasks.workunit.client.0.smithi073.stderr: -72> 2024-09-12T00:54:13.170+0000 7f7bc6c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:13.314 INFO:tasks.workunit.client.0.smithi073.stderr: -71> 2024-09-12T00:54:13.170+0000 7f7bc6c20800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.314 INFO:tasks.workunit.client.0.smithi073.stderr: -70> 2024-09-12T00:54:13.171+0000 7f7bc6c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:13.314 INFO:tasks.workunit.client.0.smithi073.stderr: -69> 2024-09-12T00:54:13.171+0000 7f7bc6c20800 20 started sync module instance, tier type = 2024-09-12T00:54:13.315 INFO:tasks.workunit.client.0.smithi073.stderr: -68> 2024-09-12T00:54:13.171+0000 7f7bc6c20800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:54:13.315 INFO:tasks.workunit.client.0.smithi073.stderr: -67> 2024-09-12T00:54:13.180+0000 7f7bc6c20800 20 add_watcher() i=0 2024-09-12T00:54:13.315 INFO:tasks.workunit.client.0.smithi073.stderr: -66> 2024-09-12T00:54:13.180+0000 7f7bc6c20800 20 add_watcher() i=1 2024-09-12T00:54:13.315 INFO:tasks.workunit.client.0.smithi073.stderr: -65> 2024-09-12T00:54:13.180+0000 7f7bc6c20800 20 add_watcher() i=2 2024-09-12T00:54:13.315 INFO:tasks.workunit.client.0.smithi073.stderr: -64> 2024-09-12T00:54:13.180+0000 7f7bc6c20800 20 add_watcher() i=3 2024-09-12T00:54:13.315 INFO:tasks.workunit.client.0.smithi073.stderr: -63> 2024-09-12T00:54:13.180+0000 7f7bc6c20800 20 add_watcher() i=4 2024-09-12T00:54:13.315 INFO:tasks.workunit.client.0.smithi073.stderr: -62> 2024-09-12T00:54:13.180+0000 7f7bc6c20800 20 add_watcher() i=5 2024-09-12T00:54:13.315 INFO:tasks.workunit.client.0.smithi073.stderr: -61> 2024-09-12T00:54:13.180+0000 7f7bc6c20800 20 add_watcher() i=6 2024-09-12T00:54:13.315 INFO:tasks.workunit.client.0.smithi073.stderr: -60> 2024-09-12T00:54:13.181+0000 7f7bc6c20800 20 add_watcher() i=7 2024-09-12T00:54:13.315 INFO:tasks.workunit.client.0.smithi073.stderr: -59> 2024-09-12T00:54:13.181+0000 7f7bc6c20800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:13.315 INFO:tasks.workunit.client.0.smithi073.stderr: -58> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad2420) adding auth protocol: cephx 2024-09-12T00:54:13.315 INFO:tasks.workunit.client.0.smithi073.stderr: -57> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad2420) adding auth protocol: cephx 2024-09-12T00:54:13.315 INFO:tasks.workunit.client.0.smithi073.stderr: -56> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad2420) adding auth protocol: cephx 2024-09-12T00:54:13.315 INFO:tasks.workunit.client.0.smithi073.stderr: -55> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad2420) adding con mode: secure 2024-09-12T00:54:13.316 INFO:tasks.workunit.client.0.smithi073.stderr: -54> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad2420) adding con mode: crc 2024-09-12T00:54:13.316 INFO:tasks.workunit.client.0.smithi073.stderr: -53> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad2420) adding con mode: secure 2024-09-12T00:54:13.316 INFO:tasks.workunit.client.0.smithi073.stderr: -52> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad2420) adding con mode: crc 2024-09-12T00:54:13.316 INFO:tasks.workunit.client.0.smithi073.stderr: -51> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad2420) adding con mode: secure 2024-09-12T00:54:13.316 INFO:tasks.workunit.client.0.smithi073.stderr: -50> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad2420) adding con mode: crc 2024-09-12T00:54:13.316 INFO:tasks.workunit.client.0.smithi073.stderr: -49> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad2420) adding con mode: crc 2024-09-12T00:54:13.316 INFO:tasks.workunit.client.0.smithi073.stderr: -48> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad2420) adding con mode: secure 2024-09-12T00:54:13.316 INFO:tasks.workunit.client.0.smithi073.stderr: -47> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad2420) adding con mode: crc 2024-09-12T00:54:13.316 INFO:tasks.workunit.client.0.smithi073.stderr: -46> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad2420) adding con mode: secure 2024-09-12T00:54:13.316 INFO:tasks.workunit.client.0.smithi073.stderr: -45> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad2420) adding con mode: crc 2024-09-12T00:54:13.316 INFO:tasks.workunit.client.0.smithi073.stderr: -44> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 5 AuthRegistry(0x7ffcf9ad2420) adding con mode: secure 2024-09-12T00:54:13.316 INFO:tasks.workunit.client.0.smithi073.stderr: -43> 2024-09-12T00:54:13.183+0000 7f7a7afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:13.316 INFO:tasks.workunit.client.0.smithi073.stderr: -42> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:13.317 INFO:tasks.workunit.client.0.smithi073.stderr: -41> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:13.317 INFO:tasks.workunit.client.0.smithi073.stderr: -40> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:13.317 INFO:tasks.workunit.client.0.smithi073.stderr: -39> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 5 asok(0x55bb6a29c630) register_command cache list hook 0x55bb6a585c30 2024-09-12T00:54:13.317 INFO:tasks.workunit.client.0.smithi073.stderr: -38> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 5 asok(0x55bb6a29c630) register_command cache inspect hook 0x55bb6a585c30 2024-09-12T00:54:13.317 INFO:tasks.workunit.client.0.smithi073.stderr: -37> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 5 asok(0x55bb6a29c630) register_command cache erase hook 0x55bb6a585c30 2024-09-12T00:54:13.317 INFO:tasks.workunit.client.0.smithi073.stderr: -36> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 5 asok(0x55bb6a29c630) register_command cache zap hook 0x55bb6a585c30 2024-09-12T00:54:13.317 INFO:tasks.workunit.client.0.smithi073.stderr: -35> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 5 note: GC not initialized 2024-09-12T00:54:13.317 INFO:tasks.workunit.client.0.smithi073.stderr: -34> 2024-09-12T00:54:13.183+0000 7f7a79fdb640 20 reqs_thread_entry: start 2024-09-12T00:54:13.317 INFO:tasks.workunit.client.0.smithi073.stderr: -33> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 5 asok(0x55bb6a29c630) register_command sync trace show hook 0x7f7bac01bf20 2024-09-12T00:54:13.317 INFO:tasks.workunit.client.0.smithi073.stderr: -32> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 5 asok(0x55bb6a29c630) register_command sync trace history hook 0x7f7bac01bf20 2024-09-12T00:54:13.317 INFO:tasks.workunit.client.0.smithi073.stderr: -31> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 5 asok(0x55bb6a29c630) register_command sync trace active hook 0x7f7bac01bf20 2024-09-12T00:54:13.317 INFO:tasks.workunit.client.0.smithi073.stderr: -30> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 5 asok(0x55bb6a29c630) register_command sync trace active_short hook 0x7f7bac01bf20 2024-09-12T00:54:13.318 INFO:tasks.workunit.client.0.smithi073.stderr: -29> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:13.318 INFO:tasks.workunit.client.0.smithi073.stderr: -28> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 20 Filter name: none 2024-09-12T00:54:13.318 INFO:tasks.workunit.client.0.smithi073.stderr: -27> 2024-09-12T00:54:13.183+0000 7f79eb7fe640 20 reqs_thread_entry: start 2024-09-12T00:54:13.318 INFO:tasks.workunit.client.0.smithi073.stderr: -26> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:54:13.318 INFO:tasks.workunit.client.0.smithi073.stderr: -25> 2024-09-12T00:54:13.183+0000 7f7bc6c20800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.318 INFO:tasks.workunit.client.0.smithi073.stderr: -24> 2024-09-12T00:54:13.184+0000 7f7bc6c20800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:54:13.318 INFO:tasks.workunit.client.0.smithi073.stderr: -23> 2024-09-12T00:54:13.184+0000 7f7bc6c20800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:54:13.318 INFO:tasks.workunit.client.0.smithi073.stderr: -22> 2024-09-12T00:54:13.184+0000 7f7bc6c20800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:54:13.318 INFO:tasks.workunit.client.0.smithi073.stderr: -21> 2024-09-12T00:54:13.184+0000 7f7bc6c20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 : miss 2024-09-12T00:54:13.318 INFO:tasks.workunit.client.0.smithi073.stderr: -20> 2024-09-12T00:54:13.184+0000 7f7bc6c20800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.318 INFO:tasks.workunit.client.0.smithi073.stderr: -19> 2024-09-12T00:54:13.184+0000 7f7bc6c20800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:54:13.318 INFO:tasks.workunit.client.0.smithi073.stderr: -18> 2024-09-12T00:54:13.184+0000 7f7bc6c20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:54:13.318 INFO:tasks.workunit.client.0.smithi073.stderr: -17> 2024-09-12T00:54:13.184+0000 7f7bc6c20800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:54:13.318 INFO:tasks.workunit.client.0.smithi073.stderr: -16> 2024-09-12T00:54:13.184+0000 7f7bc6c20800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:54:13.319 INFO:tasks.workunit.client.0.smithi073.stderr: -15> 2024-09-12T00:54:13.184+0000 7f7bc6c20800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:54:13.319 INFO:tasks.workunit.client.0.smithi073.stderr: -14> 2024-09-12T00:54:13.184+0000 7f7bc6c20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 2024-09-12T00:54:13.319 INFO:tasks.workunit.client.0.smithi073.stderr: -13> 2024-09-12T00:54:13.188+0000 7f7bc6c20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:54:13.319 INFO:tasks.workunit.client.0.smithi073.stderr: -12> 2024-09-12T00:54:13.188+0000 7f7bc6c20800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:54:13.319 INFO:tasks.workunit.client.0.smithi073.stderr: -11> 2024-09-12T00:54:13.188+0000 7f7bc6c20800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:54:13.319 INFO:tasks.workunit.client.0.smithi073.stderr: -10> 2024-09-12T00:54:13.188+0000 7f7bc6c20800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17, ofs0, ns] 2024-09-12T00:54:13.319 INFO:tasks.workunit.client.0.smithi073.stderr: -9> 2024-09-12T00:54:13.188+0000 7f7a9affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497046 cookie 94263431640736 notifier 8271 bl.length()=827 2024-09-12T00:54:13.319 INFO:tasks.workunit.client.0.smithi073.stderr: -8> 2024-09-12T00:54:13.188+0000 7f7a9affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:54:13.319 INFO:tasks.workunit.client.0.smithi073.stderr: -7> 2024-09-12T00:54:13.188+0000 7f7a9affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:54:13.319 INFO:tasks.workunit.client.0.smithi073.stderr: -6> 2024-09-12T00:54:13.188+0000 7f7a9affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:54:13.319 INFO:tasks.workunit.client.0.smithi073.stderr: -5> 2024-09-12T00:54:13.190+0000 7f7bc6c20800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): orig_sources= new_sources= 2024-09-12T00:54:13.319 INFO:tasks.workunit.client.0.smithi073.stderr: -4> 2024-09-12T00:54:13.190+0000 7f7bc6c20800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): potential sources added=[] removed=[] 2024-09-12T00:54:13.320 INFO:tasks.workunit.client.0.smithi073.stderr: -3> 2024-09-12T00:54:13.190+0000 7f7bc6c20800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): orig_dests= new_dests= 2024-09-12T00:54:13.320 INFO:tasks.workunit.client.0.smithi073.stderr: -2> 2024-09-12T00:54:13.190+0000 7f7bc6c20800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): potential dests added=[] removed=[] 2024-09-12T00:54:13.320 INFO:tasks.workunit.client.0.smithi073.stderr: -1> 2024-09-12T00:54:13.193+0000 7f7bc6c20800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7bc6c20800 time 2024-09-12T00:54:13.193686+0000 2024-09-12T00:54:13.320 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:54:13.320 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:13.320 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:13.320 INFO:tasks.workunit.client.0.smithi073.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f7bca18c71a] 2024-09-12T00:54:13.320 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f7bca18c8d8] 2024-09-12T00:54:13.320 INFO:tasks.workunit.client.0.smithi073.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bb681d8641] 2024-09-12T00:54:13.320 INFO:tasks.workunit.client.0.smithi073.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55bb681e838a] 2024-09-12T00:54:13.320 INFO:tasks.workunit.client.0.smithi073.stderr: 5: main() 2024-09-12T00:54:13.321 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f7bc8e29590] 2024-09-12T00:54:13.321 INFO:tasks.workunit.client.0.smithi073.stderr: 7: __libc_start_main() 2024-09-12T00:54:13.321 INFO:tasks.workunit.client.0.smithi073.stderr: 8: _start() 2024-09-12T00:54:13.321 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:13.321 INFO:tasks.workunit.client.0.smithi073.stderr: 0> 2024-09-12T00:54:13.194+0000 7f7bc6c20800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:54:13.321 INFO:tasks.workunit.client.0.smithi073.stderr: in thread 7f7bc6c20800 thread_name:radosgw-admin 2024-09-12T00:54:13.321 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:13.321 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:13.321 INFO:tasks.workunit.client.0.smithi073.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f7bc8e3e6f0] 2024-09-12T00:54:13.321 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f7bc8e8b99c] 2024-09-12T00:54:13.321 INFO:tasks.workunit.client.0.smithi073.stderr: 3: raise() 2024-09-12T00:54:13.321 INFO:tasks.workunit.client.0.smithi073.stderr: 4: abort() 2024-09-12T00:54:13.322 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f7bca18c774] 2024-09-12T00:54:13.322 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f7bca18c8d8] 2024-09-12T00:54:13.322 INFO:tasks.workunit.client.0.smithi073.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bb681d8641] 2024-09-12T00:54:13.322 INFO:tasks.workunit.client.0.smithi073.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55bb681e838a] 2024-09-12T00:54:13.322 INFO:tasks.workunit.client.0.smithi073.stderr: 9: main() 2024-09-12T00:54:13.322 INFO:tasks.workunit.client.0.smithi073.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f7bc8e29590] 2024-09-12T00:54:13.322 INFO:tasks.workunit.client.0.smithi073.stderr: 11: __libc_start_main() 2024-09-12T00:54:13.322 INFO:tasks.workunit.client.0.smithi073.stderr: 12: _start() 2024-09-12T00:54:13.322 INFO:tasks.workunit.client.0.smithi073.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:54:13.322 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:13.322 INFO:tasks.workunit.client.0.smithi073.stderr:--- logging levels --- 2024-09-12T00:54:13.322 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 none 2024-09-12T00:54:13.322 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 lockdep 2024-09-12T00:54:13.323 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 context 2024-09-12T00:54:13.323 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 crush 2024-09-12T00:54:13.323 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds 2024-09-12T00:54:13.323 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_balancer 2024-09-12T00:54:13.323 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_locker 2024-09-12T00:54:13.323 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_log 2024-09-12T00:54:13.323 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_log_expire 2024-09-12T00:54:13.323 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_migrator 2024-09-12T00:54:13.323 INFO:tasks.workunit.client.0.smithi073.stderr: 3/ 5 mds_quiesce 2024-09-12T00:54:13.323 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 buffer 2024-09-12T00:54:13.323 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 timer 2024-09-12T00:54:13.323 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 filer 2024-09-12T00:54:13.323 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 striper 2024-09-12T00:54:13.323 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 objecter 2024-09-12T00:54:13.324 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rados 2024-09-12T00:54:13.324 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd 2024-09-12T00:54:13.324 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_mirror 2024-09-12T00:54:13.324 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_replay 2024-09-12T00:54:13.324 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_pwl 2024-09-12T00:54:13.324 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 journaler 2024-09-12T00:54:13.324 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 objectcacher 2024-09-12T00:54:13.324 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:54:13.324 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 client 2024-09-12T00:54:13.324 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 osd 2024-09-12T00:54:13.324 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 optracker 2024-09-12T00:54:13.324 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 objclass 2024-09-12T00:54:13.324 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 filestore 2024-09-12T00:54:13.325 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 journal 2024-09-12T00:54:13.325 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 0 ms 2024-09-12T00:54:13.325 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mon 2024-09-12T00:54:13.325 INFO:tasks.workunit.client.0.smithi073.stderr: 0/10 monc 2024-09-12T00:54:13.325 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 paxos 2024-09-12T00:54:13.325 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 tp 2024-09-12T00:54:13.325 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 auth 2024-09-12T00:54:13.325 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 crypto 2024-09-12T00:54:13.325 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 finisher 2024-09-12T00:54:13.325 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 reserver 2024-09-12T00:54:13.325 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 heartbeatmap 2024-09-12T00:54:13.325 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 perfcounter 2024-09-12T00:54:13.325 INFO:tasks.workunit.client.0.smithi073.stderr: 20/20 rgw 2024-09-12T00:54:13.325 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_sync 2024-09-12T00:54:13.326 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_datacache 2024-09-12T00:54:13.326 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_access 2024-09-12T00:54:13.326 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:54:13.326 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_flight 2024-09-12T00:54:13.326 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:54:13.326 INFO:tasks.workunit.client.0.smithi073.stderr: 20/20 rgw_notification 2024-09-12T00:54:13.326 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 javaclient 2024-09-12T00:54:13.326 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 asok 2024-09-12T00:54:13.326 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 throttle 2024-09-12T00:54:13.326 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 0 refs 2024-09-12T00:54:13.326 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 compressor 2024-09-12T00:54:13.326 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 bluestore 2024-09-12T00:54:13.326 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 bluefs 2024-09-12T00:54:13.327 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 bdev 2024-09-12T00:54:13.327 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 kstore 2024-09-12T00:54:13.327 INFO:tasks.workunit.client.0.smithi073.stderr: 4/ 5 rocksdb 2024-09-12T00:54:13.327 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 fuse 2024-09-12T00:54:13.327 INFO:tasks.workunit.client.0.smithi073.stderr: 2/ 5 mgr 2024-09-12T00:54:13.327 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mgrc 2024-09-12T00:54:13.327 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 dpdk 2024-09-12T00:54:13.327 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 eventtrace 2024-09-12T00:54:13.327 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 prioritycache 2024-09-12T00:54:13.327 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 test 2024-09-12T00:54:13.327 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:54:13.327 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cephsqlite 2024-09-12T00:54:13.327 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:54:13.328 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore 2024-09-12T00:54:13.328 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_onode 2024-09-12T00:54:13.328 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_odata 2024-09-12T00:54:13.328 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_omap 2024-09-12T00:54:13.328 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_tm 2024-09-12T00:54:13.328 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_t 2024-09-12T00:54:13.328 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:54:13.328 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_epm 2024-09-12T00:54:13.328 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_lba 2024-09-12T00:54:13.328 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:54:13.328 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_cache 2024-09-12T00:54:13.328 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_journal 2024-09-12T00:54:13.328 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_device 2024-09-12T00:54:13.328 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_backref 2024-09-12T00:54:13.329 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 alienstore 2024-09-12T00:54:13.329 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mclock 2024-09-12T00:54:13.329 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cyanstore 2024-09-12T00:54:13.329 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 ceph_exporter 2024-09-12T00:54:13.329 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 memstore 2024-09-12T00:54:13.329 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 trace 2024-09-12T00:54:13.329 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 ceph_dedup 2024-09-12T00:54:13.329 INFO:tasks.workunit.client.0.smithi073.stderr: -2/-2 (syslog threshold) 2024-09-12T00:54:13.329 INFO:tasks.workunit.client.0.smithi073.stderr: 99/99 (stderr threshold) 2024-09-12T00:54:13.329 INFO:tasks.workunit.client.0.smithi073.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:54:13.329 INFO:tasks.workunit.client.0.smithi073.stderr: 7f79eb7fe640 / http_manager 2024-09-12T00:54:13.329 INFO:tasks.workunit.client.0.smithi073.stderr: 7f7a79fdb640 / http_manager 2024-09-12T00:54:13.329 INFO:tasks.workunit.client.0.smithi073.stderr: 7f7a7afdd640 / rgw_dt_lg_renew 2024-09-12T00:54:13.330 INFO:tasks.workunit.client.0.smithi073.stderr: 7f7a99ffb640 / ms_dispatch 2024-09-12T00:54:13.330 INFO:tasks.workunit.client.0.smithi073.stderr: 7f7a9affd640 / io_context_pool 2024-09-12T00:54:13.330 INFO:tasks.workunit.client.0.smithi073.stderr: 7f7a9b7fe640 / io_context_pool 2024-09-12T00:54:13.330 INFO:tasks.workunit.client.0.smithi073.stderr: 7f7aa9ffb640 / ms_dispatch 2024-09-12T00:54:13.330 INFO:tasks.workunit.client.0.smithi073.stderr: 7f7ab0e09640 / ms_dispatch 2024-09-12T00:54:13.330 INFO:tasks.workunit.client.0.smithi073.stderr: 7f7ab260c640 / io_context_pool 2024-09-12T00:54:13.330 INFO:tasks.workunit.client.0.smithi073.stderr: 7f7bbbf09640 / msgr-worker-2 2024-09-12T00:54:13.330 INFO:tasks.workunit.client.0.smithi073.stderr: 7f7bc470a640 / msgr-worker-1 2024-09-12T00:54:13.330 INFO:tasks.workunit.client.0.smithi073.stderr: 7f7bc4f0b640 / msgr-worker-0 2024-09-12T00:54:13.330 INFO:tasks.workunit.client.0.smithi073.stderr: 7f7bc570c640 / io_context_pool 2024-09-12T00:54:13.330 INFO:tasks.workunit.client.0.smithi073.stderr: 7f7bc6c20800 / radosgw-admin 2024-09-12T00:54:13.330 INFO:tasks.workunit.client.0.smithi073.stderr: max_recent 500 2024-09-12T00:54:13.330 INFO:tasks.workunit.client.0.smithi073.stderr: max_new 1000 2024-09-12T00:54:13.330 INFO:tasks.workunit.client.0.smithi073.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:54:13.195086Z_3cd7c434-7f3b-4384-bcac-2c4c9989ad62/log 2024-09-12T00:54:13.331 INFO:tasks.workunit.client.0.smithi073.stderr:--- end dump of recent events --- 2024-09-12T00:54:13.331 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:54:13.332 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:13.332 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:13.332 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.269+0000 7f92e2e20800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.332 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.271+0000 7f92e2e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:13.333 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.271+0000 7f92e2e20800 20 realm 2024-09-12T00:54:13.333 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.271+0000 7f92e2e20800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.333 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.271+0000 7f92e2e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:13.333 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.271+0000 7f92e2e20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:13.333 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.271+0000 7f92e2e20800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.333 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.271+0000 7f92e2e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:13.333 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.271+0000 7f92e2e20800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.333 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.272+0000 7f92e2e20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:13.333 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.272+0000 7f92e2e20800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.333 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.273+0000 7f92e2e20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:13.333 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.273+0000 7f92e2e20800 20 searching for the correct realm 2024-09-12T00:54:13.333 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.275+0000 7f92e110b640 0 -- 172.21.15.73:0/121088210 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f92c8018070 msgr2=0x7f92c808d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:13.480 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.482+0000 7f92e110b640 0 -- 172.21.15.73:0/121088210 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f92c8018070 msgr2=0x7f92c808d7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:13.484 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.485+0000 7f92e2e20800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:54:13.484 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.485+0000 7f92e2e20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:13.484 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.485+0000 7f92e2e20800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:54:13.484 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.485+0000 7f92e2e20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:13.484 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.485+0000 7f92e2e20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:13.484 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.485+0000 7f92e2e20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:13.485 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.485+0000 7f92e2e20800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.486 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.486+0000 7f92e2e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:13.486 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.486+0000 7f92e2e20800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.486 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.486+0000 7f92e2e20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:13.486 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.486+0000 7f92e2e20800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.486 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.486+0000 7f92e2e20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:13.486 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.486+0000 7f92e2e20800 20 zone default found 2024-09-12T00:54:13.486 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.486+0000 7f92e2e20800 4 Realm: () 2024-09-12T00:54:13.487 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.486+0000 7f92e2e20800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:54:13.487 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.486+0000 7f92e2e20800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:54:13.487 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.486+0000 7f92e2e20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:13.487 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.486+0000 7f92e2e20800 20 zonegroup default 2024-09-12T00:54:13.487 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.486+0000 7f92e2e20800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.487 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.487+0000 7f92e2e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:13.487 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.487+0000 7f92e2e20800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.487 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.487+0000 7f92e2e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:13.487 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.487+0000 7f92e2e20800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.487 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.487+0000 7f92e2e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:13.487 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.487+0000 7f92e2e20800 20 started sync module instance, tier type = 2024-09-12T00:54:13.487 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.487+0000 7f92e2e20800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:54:13.495 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.496+0000 7f92e2e20800 20 add_watcher() i=0 2024-09-12T00:54:13.495 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.496+0000 7f92e2e20800 20 add_watcher() i=1 2024-09-12T00:54:13.495 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.496+0000 7f92e2e20800 20 add_watcher() i=2 2024-09-12T00:54:13.495 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.496+0000 7f92e2e20800 20 add_watcher() i=3 2024-09-12T00:54:13.495 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.496+0000 7f92e2e20800 20 add_watcher() i=4 2024-09-12T00:54:13.495 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.496+0000 7f92e2e20800 20 add_watcher() i=5 2024-09-12T00:54:13.495 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.496+0000 7f92e2e20800 20 add_watcher() i=6 2024-09-12T00:54:13.496 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.497+0000 7f92e2e20800 20 add_watcher() i=7 2024-09-12T00:54:13.496 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.497+0000 7f92e2e20800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:13.498 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.499+0000 7f9196fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:13.499 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.499+0000 7f92e2e20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:13.499 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.499+0000 7f92e2e20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:13.499 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.499+0000 7f92e2e20800 5 note: GC not initialized 2024-09-12T00:54:13.499 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.499+0000 7f9195fe3640 20 reqs_thread_entry: start 2024-09-12T00:54:13.499 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.500+0000 7f92e2e20800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:13.499 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.500+0000 7f92e2e20800 20 Filter name: none 2024-09-12T00:54:13.499 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.500+0000 7f91077fe640 20 reqs_thread_entry: start 2024-09-12T00:54:13.499 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.500+0000 7f92e2e20800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.500 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.500+0000 7f92e2e20800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:54:13.500 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.500+0000 7f92e2e20800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.500 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.501+0000 7f92e2e20800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:54:13.500 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.501+0000 7f92e2e20800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:13.501 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.501+0000 7f92e2e20800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.501 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.501+0000 7f92e2e20800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:54:13.501 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.501+0000 7f92e2e20800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.501 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.502+0000 7f92e2e20800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:54:13.501 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.502+0000 7f92e2e20800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:13.501 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.503+0000 7f9196fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:13.503 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.505+0000 7f92e2e20800 20 remove_watcher() i=0 2024-09-12T00:54:13.504 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.505+0000 7f92e2e20800 2 removed watcher, disabling cache 2024-09-12T00:54:13.504 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.506+0000 7f92e2e20800 20 remove_watcher() i=1 2024-09-12T00:54:13.505 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.507+0000 7f92e2e20800 20 remove_watcher() i=2 2024-09-12T00:54:13.507 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.508+0000 7f92e2e20800 20 remove_watcher() i=3 2024-09-12T00:54:13.508 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.509+0000 7f92e2e20800 20 remove_watcher() i=4 2024-09-12T00:54:13.509 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.510+0000 7f92e2e20800 20 remove_watcher() i=5 2024-09-12T00:54:13.510 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.511+0000 7f92e2e20800 20 remove_watcher() i=6 2024-09-12T00:54:13.510 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.512+0000 7f92e2e20800 20 remove_watcher() i=7 2024-09-12T00:54:13.524 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:54:13.524 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:54:13.558 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:54:13.586 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:13.586 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:13.623 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.624+0000 7f9f6a0bb800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.624 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.626+0000 7f9f6a0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:13.625 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.626+0000 7f9f6a0bb800 20 realm 2024-09-12T00:54:13.625 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.626+0000 7f9f6a0bb800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.625 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.626+0000 7f9f6a0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:13.625 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.626+0000 7f9f6a0bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:13.625 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.626+0000 7f9f6a0bb800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.625 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.626+0000 7f9f6a0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:13.625 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.626+0000 7f9f6a0bb800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.625 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.627+0000 7f9f6a0bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:13.626 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.627+0000 7f9f6a0bb800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.626 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.628+0000 7f9f6a0bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:13.626 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.628+0000 7f9f6a0bb800 20 searching for the correct realm 2024-09-12T00:54:13.629 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.630+0000 7f9f683a6640 0 -- 172.21.15.73:0/2425161968 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f9f5003e040 msgr2=0x7f9f5002f420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:13.633 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.634+0000 7f9f67ba5640 0 -- 172.21.15.73:0/2425161968 >> [v2:172.21.15.73:6810/1807760270,v1:172.21.15.73:6811/1807760270] conn(0x7f9f60061f40 msgr2=0x7f9f6007b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:13.839 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.840+0000 7f9f6a0bb800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:54:13.839 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.840+0000 7f9f6a0bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:13.839 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.840+0000 7f9f6a0bb800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:54:13.839 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.840+0000 7f9f6a0bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:13.840 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.840+0000 7f9f6a0bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:13.840 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.840+0000 7f9f6a0bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:13.840 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.840+0000 7f9f6a0bb800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.840 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.840+0000 7f9f6a0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:13.840 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.840+0000 7f9f6a0bb800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.840 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.841+0000 7f9f6a0bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:13.840 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.841+0000 7f9f6a0bb800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.841 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.841+0000 7f9f6a0bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:13.841 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.841+0000 7f9f6a0bb800 20 zone default found 2024-09-12T00:54:13.841 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.841+0000 7f9f6a0bb800 4 Realm: () 2024-09-12T00:54:13.842 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.841+0000 7f9f6a0bb800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:54:13.842 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.841+0000 7f9f6a0bb800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:54:13.842 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.841+0000 7f9f6a0bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:13.842 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.841+0000 7f9f6a0bb800 20 zonegroup default 2024-09-12T00:54:13.842 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.841+0000 7f9f6a0bb800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.842 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.841+0000 7f9f6a0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:13.842 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.841+0000 7f9f6a0bb800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.842 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.842+0000 7f9f6a0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:13.842 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.842+0000 7f9f6a0bb800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.842 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.842+0000 7f9f6a0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:13.842 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.842+0000 7f9f6a0bb800 20 started sync module instance, tier type = 2024-09-12T00:54:13.842 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.842+0000 7f9f6a0bb800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:54:13.849 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.851+0000 7f9f6a0bb800 20 add_watcher() i=0 2024-09-12T00:54:13.849 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.851+0000 7f9f6a0bb800 20 add_watcher() i=1 2024-09-12T00:54:13.849 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.851+0000 7f9f6a0bb800 20 add_watcher() i=2 2024-09-12T00:54:13.849 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.851+0000 7f9f6a0bb800 20 add_watcher() i=3 2024-09-12T00:54:13.849 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.851+0000 7f9f6a0bb800 20 add_watcher() i=4 2024-09-12T00:54:13.850 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.851+0000 7f9f6a0bb800 20 add_watcher() i=5 2024-09-12T00:54:13.850 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.851+0000 7f9f6a0bb800 20 add_watcher() i=6 2024-09-12T00:54:13.850 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.851+0000 7f9f6a0bb800 20 add_watcher() i=7 2024-09-12T00:54:13.850 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.851+0000 7f9f6a0bb800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:13.852 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.853+0000 7f9e1dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:13.853 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.853+0000 7f9f6a0bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:13.853 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.853+0000 7f9f6a0bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:13.853 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.854+0000 7f9f6a0bb800 5 note: GC not initialized 2024-09-12T00:54:13.853 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.854+0000 7f9e1cfe1640 20 reqs_thread_entry: start 2024-09-12T00:54:13.853 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.854+0000 7f9f6a0bb800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:13.853 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.854+0000 7f9f6a0bb800 20 Filter name: none 2024-09-12T00:54:13.853 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.854+0000 7f9d967fc640 20 reqs_thread_entry: start 2024-09-12T00:54:13.854 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.854+0000 7f9f6a0bb800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:54:13.854 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.854+0000 7f9f6a0bb800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.855 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.855+0000 7f9f6a0bb800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:54:13.855 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.855+0000 7f9f6a0bb800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:54:13.855 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.855+0000 7f9f6a0bb800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:54:13.855 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.855+0000 7f9f6a0bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 : miss 2024-09-12T00:54:13.855 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.855+0000 7f9f6a0bb800 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.855 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.855+0000 7f9f6a0bb800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:54:13.855 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.855+0000 7f9f6a0bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:54:13.856 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.855+0000 7f9f6a0bb800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:54:13.856 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.855+0000 7f9f6a0bb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:54:13.856 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.855+0000 7f9f6a0bb800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:54:13.856 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.855+0000 7f9f6a0bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 2024-09-12T00:54:13.856 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.855+0000 7f9f6a0bb800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.0 2024-09-12T00:54:13.856 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.855+0000 7f9f6a0bb800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.0 2024-09-12T00:54:13.856 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.856+0000 7f9f6a0bb800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.1 2024-09-12T00:54:13.856 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.856+0000 7f9f6a0bb800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.1 2024-09-12T00:54:13.856 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.856+0000 7f9f6a0bb800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.2 2024-09-12T00:54:13.856 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.856+0000 7f9f6a0bb800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.2 2024-09-12T00:54:13.857 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.857+0000 7f9e1dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:13.858 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.859+0000 7f9f6a0bb800 20 remove_watcher() i=0 2024-09-12T00:54:13.858 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.859+0000 7f9f6a0bb800 2 removed watcher, disabling cache 2024-09-12T00:54:13.859 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.861+0000 7f9f6a0bb800 20 remove_watcher() i=1 2024-09-12T00:54:13.860 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.862+0000 7f9f6a0bb800 20 remove_watcher() i=2 2024-09-12T00:54:13.861 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.863+0000 7f9f6a0bb800 20 remove_watcher() i=3 2024-09-12T00:54:13.862 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.864+0000 7f9f6a0bb800 20 remove_watcher() i=4 2024-09-12T00:54:13.863 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.864+0000 7f9f6a0bb800 20 remove_watcher() i=5 2024-09-12T00:54:13.864 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.865+0000 7f9f6a0bb800 20 remove_watcher() i=6 2024-09-12T00:54:13.865 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:13.866+0000 7f9f6a0bb800 20 remove_watcher() i=7 2024-09-12T00:54:43.891 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-12T00:54:43.928 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:43.928 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:43.972 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:43.973+0000 7f073df25800 20 rados->read ofs=0 len=0 2024-09-12T00:54:43.974 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:43.975+0000 7f073df25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:43.974 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:43.975+0000 7f073df25800 20 realm 2024-09-12T00:54:43.974 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:43.975+0000 7f073df25800 20 rados->read ofs=0 len=0 2024-09-12T00:54:43.974 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:43.975+0000 7f073df25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:43.974 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:43.975+0000 7f073df25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:43.974 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:43.975+0000 7f073df25800 20 rados->read ofs=0 len=0 2024-09-12T00:54:43.974 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:43.975+0000 7f073df25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:43.974 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:43.975+0000 7f073df25800 20 rados->read ofs=0 len=0 2024-09-12T00:54:43.975 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:43.976+0000 7f073df25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:43.975 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:43.976+0000 7f073df25800 20 rados->read ofs=0 len=0 2024-09-12T00:54:43.976 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:43.977+0000 7f073df25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:43.976 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:43.977+0000 7f073df25800 20 searching for the correct realm 2024-09-12T00:54:43.977 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:43.978+0000 7f0739b33640 0 -- 172.21.15.73:0/2445320828 >> [v2:172.21.15.117:6816/1460498570,v1:172.21.15.117:6817/1460498570] conn(0x7f0734081070 msgr2=0x7f07340a7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:44.182 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.184+0000 7f0739332640 0 -- 172.21.15.73:0/2445320828 >> [v2:172.21.15.73:6826/269690776,v1:172.21.15.73:6827/269690776] conn(0x7f072c05a040 msgr2=0x7f072c030400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:44.189 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.190+0000 7f073df25800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:54:44.189 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.190+0000 7f073df25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:44.189 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.190+0000 7f073df25800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:54:44.189 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.190+0000 7f073df25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:44.190 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.190+0000 7f073df25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:44.190 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.190+0000 7f073df25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:44.190 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.190+0000 7f073df25800 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.190 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.190+0000 7f073df25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:44.190 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.190+0000 7f073df25800 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.190 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.191+0000 7f073df25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:44.190 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.191+0000 7f073df25800 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.191 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.191+0000 7f073df25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:44.192 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.191+0000 7f073df25800 20 zone default found 2024-09-12T00:54:44.192 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.191+0000 7f073df25800 4 Realm: () 2024-09-12T00:54:44.192 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.191+0000 7f073df25800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:54:44.192 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.191+0000 7f073df25800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:54:44.192 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.191+0000 7f073df25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:44.192 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.191+0000 7f073df25800 20 zonegroup default 2024-09-12T00:54:44.192 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.191+0000 7f073df25800 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.192 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.191+0000 7f073df25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:44.192 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.191+0000 7f073df25800 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.192 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.192+0000 7f073df25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:44.192 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.192+0000 7f073df25800 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.192 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.192+0000 7f073df25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:44.193 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.192+0000 7f073df25800 20 started sync module instance, tier type = 2024-09-12T00:54:44.193 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.192+0000 7f073df25800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:54:44.200 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.202+0000 7f073df25800 20 add_watcher() i=0 2024-09-12T00:54:44.200 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.202+0000 7f073df25800 20 add_watcher() i=1 2024-09-12T00:54:44.200 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.202+0000 7f073df25800 20 add_watcher() i=2 2024-09-12T00:54:44.201 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.202+0000 7f073df25800 20 add_watcher() i=3 2024-09-12T00:54:44.201 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.202+0000 7f073df25800 20 add_watcher() i=4 2024-09-12T00:54:44.201 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.202+0000 7f073df25800 20 add_watcher() i=5 2024-09-12T00:54:44.201 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.202+0000 7f073df25800 20 add_watcher() i=6 2024-09-12T00:54:44.201 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.203+0000 7f073df25800 20 add_watcher() i=7 2024-09-12T00:54:44.201 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.203+0000 7f073df25800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:44.203 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.204+0000 7f05eb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:44.205 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.205+0000 7f073df25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:44.205 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.205+0000 7f073df25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:44.205 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.205+0000 7f073df25800 5 note: GC not initialized 2024-09-12T00:54:44.205 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.205+0000 7f05ea7fc640 20 reqs_thread_entry: start 2024-09-12T00:54:44.205 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.205+0000 7f073df25800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:44.205 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.205+0000 7f073df25800 20 Filter name: none 2024-09-12T00:54:44.205 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.205+0000 7f055ffff640 20 reqs_thread_entry: start 2024-09-12T00:54:44.205 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.205+0000 7f073df25800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:54:44.205 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.205+0000 7f073df25800 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.206 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.206+0000 7f073df25800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:54:44.206 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.206+0000 7f073df25800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:54:44.206 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.206+0000 7f073df25800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:54:44.206 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.206+0000 7f073df25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 : miss 2024-09-12T00:54:44.206 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.206+0000 7f073df25800 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.207 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.206+0000 7f073df25800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:54:44.207 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.206+0000 7f073df25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:54:44.207 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.206+0000 7f073df25800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:54:44.207 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.206+0000 7f073df25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:54:44.207 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.206+0000 7f073df25800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:54:44.207 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.206+0000 7f073df25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 2024-09-12T00:54:44.208 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.207+0000 7f073df25800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:54:44.210 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.212+0000 7f073df25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:54:44.210 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.212+0000 7f073df25800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:54:44.210 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.212+0000 7f073df25800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:54:44.210 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.212+0000 7f073df25800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17, ofs0, ns] 2024-09-12T00:54:44.211 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.212+0000 7f061d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497047 cookie 94380772763360 notifier 8325 bl.length()=827 2024-09-12T00:54:44.211 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.212+0000 7f061d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:54:44.211 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.212+0000 7f061d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:54:44.211 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.212+0000 7f061d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:54:44.212 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.214+0000 7f073df25800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): orig_sources= new_sources= 2024-09-12T00:54:44.212 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.214+0000 7f073df25800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): potential sources added=[] removed=[] 2024-09-12T00:54:44.212 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.214+0000 7f073df25800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): orig_dests= new_dests= 2024-09-12T00:54:44.212 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.214+0000 7f073df25800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): potential dests added=[] removed=[] 2024-09-12T00:54:44.215 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f073df25800 time 2024-09-12T00:54:44.217611+0000 2024-09-12T00:54:44.215 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:54:44.216 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:44.216 INFO:tasks.workunit.client.0.smithi073.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f073f58c71a] 2024-09-12T00:54:44.216 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f073f58c8d8] 2024-09-12T00:54:44.216 INFO:tasks.workunit.client.0.smithi073.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d6bb761641] 2024-09-12T00:54:44.216 INFO:tasks.workunit.client.0.smithi073.stderr: 4: radosgw-admin(+0xd8854c) [0x55d6bbc7454c] 2024-09-12T00:54:44.216 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d6bb77131d] 2024-09-12T00:54:44.216 INFO:tasks.workunit.client.0.smithi073.stderr: 6: main() 2024-09-12T00:54:44.217 INFO:tasks.workunit.client.0.smithi073.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f073e229590] 2024-09-12T00:54:44.217 INFO:tasks.workunit.client.0.smithi073.stderr: 8: __libc_start_main() 2024-09-12T00:54:44.217 INFO:tasks.workunit.client.0.smithi073.stderr: 9: _start() 2024-09-12T00:54:44.217 INFO:tasks.workunit.client.0.smithi073.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:54:44.217 INFO:tasks.workunit.client.0.smithi073.stderr: in thread 7f073df25800 thread_name:radosgw-admin 2024-09-12T00:54:44.217 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.217+0000 7f073df25800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f073df25800 time 2024-09-12T00:54:44.217611+0000 2024-09-12T00:54:44.217 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:54:44.217 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:44.217 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:44.217 INFO:tasks.workunit.client.0.smithi073.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f073f58c71a] 2024-09-12T00:54:44.217 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f073f58c8d8] 2024-09-12T00:54:44.217 INFO:tasks.workunit.client.0.smithi073.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d6bb761641] 2024-09-12T00:54:44.218 INFO:tasks.workunit.client.0.smithi073.stderr: 4: radosgw-admin(+0xd8854c) [0x55d6bbc7454c] 2024-09-12T00:54:44.218 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d6bb77131d] 2024-09-12T00:54:44.218 INFO:tasks.workunit.client.0.smithi073.stderr: 6: main() 2024-09-12T00:54:44.218 INFO:tasks.workunit.client.0.smithi073.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f073e229590] 2024-09-12T00:54:44.218 INFO:tasks.workunit.client.0.smithi073.stderr: 8: __libc_start_main() 2024-09-12T00:54:44.218 INFO:tasks.workunit.client.0.smithi073.stderr: 9: _start() 2024-09-12T00:54:44.218 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:44.236 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:44.236 INFO:tasks.workunit.client.0.smithi073.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f073e23e6f0] 2024-09-12T00:54:44.236 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f073e28b99c] 2024-09-12T00:54:44.236 INFO:tasks.workunit.client.0.smithi073.stderr: 3: raise() 2024-09-12T00:54:44.236 INFO:tasks.workunit.client.0.smithi073.stderr: 4: abort() 2024-09-12T00:54:44.236 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f073f58c774] 2024-09-12T00:54:44.236 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f073f58c8d8] 2024-09-12T00:54:44.236 INFO:tasks.workunit.client.0.smithi073.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d6bb761641] 2024-09-12T00:54:44.236 INFO:tasks.workunit.client.0.smithi073.stderr: 8: radosgw-admin(+0xd8854c) [0x55d6bbc7454c] 2024-09-12T00:54:44.236 INFO:tasks.workunit.client.0.smithi073.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d6bb77131d] 2024-09-12T00:54:44.237 INFO:tasks.workunit.client.0.smithi073.stderr: 10: main() 2024-09-12T00:54:44.237 INFO:tasks.workunit.client.0.smithi073.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f073e229590] 2024-09-12T00:54:44.237 INFO:tasks.workunit.client.0.smithi073.stderr: 12: __libc_start_main() 2024-09-12T00:54:44.237 INFO:tasks.workunit.client.0.smithi073.stderr: 13: _start() 2024-09-12T00:54:44.237 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.218+0000 7f073df25800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:54:44.237 INFO:tasks.workunit.client.0.smithi073.stderr: in thread 7f073df25800 thread_name:radosgw-admin 2024-09-12T00:54:44.237 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:44.237 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:44.237 INFO:tasks.workunit.client.0.smithi073.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f073e23e6f0] 2024-09-12T00:54:44.237 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f073e28b99c] 2024-09-12T00:54:44.237 INFO:tasks.workunit.client.0.smithi073.stderr: 3: raise() 2024-09-12T00:54:44.237 INFO:tasks.workunit.client.0.smithi073.stderr: 4: abort() 2024-09-12T00:54:44.237 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f073f58c774] 2024-09-12T00:54:44.238 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f073f58c8d8] 2024-09-12T00:54:44.238 INFO:tasks.workunit.client.0.smithi073.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d6bb761641] 2024-09-12T00:54:44.238 INFO:tasks.workunit.client.0.smithi073.stderr: 8: radosgw-admin(+0xd8854c) [0x55d6bbc7454c] 2024-09-12T00:54:44.238 INFO:tasks.workunit.client.0.smithi073.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d6bb77131d] 2024-09-12T00:54:44.238 INFO:tasks.workunit.client.0.smithi073.stderr: 10: main() 2024-09-12T00:54:44.238 INFO:tasks.workunit.client.0.smithi073.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f073e229590] 2024-09-12T00:54:44.238 INFO:tasks.workunit.client.0.smithi073.stderr: 12: __libc_start_main() 2024-09-12T00:54:44.238 INFO:tasks.workunit.client.0.smithi073.stderr: 13: _start() 2024-09-12T00:54:44.238 INFO:tasks.workunit.client.0.smithi073.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:54:44.238 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:44.238 INFO:tasks.workunit.client.0.smithi073.stderr:--- begin dump of recent events --- 2024-09-12T00:54:44.238 INFO:tasks.workunit.client.0.smithi073.stderr: -499> 2024-09-12T00:54:43.954+0000 7f073df25800 5 AuthRegistry(0x55d6bc5fa330) adding auth protocol: cephx 2024-09-12T00:54:44.238 INFO:tasks.workunit.client.0.smithi073.stderr: -498> 2024-09-12T00:54:43.954+0000 7f073df25800 5 AuthRegistry(0x55d6bc5fa330) adding auth protocol: cephx 2024-09-12T00:54:44.239 INFO:tasks.workunit.client.0.smithi073.stderr: -497> 2024-09-12T00:54:43.954+0000 7f073df25800 5 AuthRegistry(0x55d6bc5fa330) adding auth protocol: cephx 2024-09-12T00:54:44.239 INFO:tasks.workunit.client.0.smithi073.stderr: -496> 2024-09-12T00:54:43.954+0000 7f073df25800 5 AuthRegistry(0x55d6bc5fa330) adding con mode: secure 2024-09-12T00:54:44.239 INFO:tasks.workunit.client.0.smithi073.stderr: -495> 2024-09-12T00:54:43.954+0000 7f073df25800 5 AuthRegistry(0x55d6bc5fa330) adding con mode: crc 2024-09-12T00:54:44.239 INFO:tasks.workunit.client.0.smithi073.stderr: -494> 2024-09-12T00:54:43.954+0000 7f073df25800 5 AuthRegistry(0x55d6bc5fa330) adding con mode: secure 2024-09-12T00:54:44.239 INFO:tasks.workunit.client.0.smithi073.stderr: -493> 2024-09-12T00:54:43.954+0000 7f073df25800 5 AuthRegistry(0x55d6bc5fa330) adding con mode: crc 2024-09-12T00:54:44.239 INFO:tasks.workunit.client.0.smithi073.stderr: -492> 2024-09-12T00:54:43.954+0000 7f073df25800 5 AuthRegistry(0x55d6bc5fa330) adding con mode: secure 2024-09-12T00:54:44.239 INFO:tasks.workunit.client.0.smithi073.stderr: -491> 2024-09-12T00:54:43.954+0000 7f073df25800 5 AuthRegistry(0x55d6bc5fa330) adding con mode: crc 2024-09-12T00:54:44.239 INFO:tasks.workunit.client.0.smithi073.stderr: -490> 2024-09-12T00:54:43.954+0000 7f073df25800 5 AuthRegistry(0x55d6bc5fa330) adding con mode: crc 2024-09-12T00:54:44.239 INFO:tasks.workunit.client.0.smithi073.stderr: -489> 2024-09-12T00:54:43.954+0000 7f073df25800 5 AuthRegistry(0x55d6bc5fa330) adding con mode: secure 2024-09-12T00:54:44.239 INFO:tasks.workunit.client.0.smithi073.stderr: -488> 2024-09-12T00:54:43.954+0000 7f073df25800 5 AuthRegistry(0x55d6bc5fa330) adding con mode: crc 2024-09-12T00:54:44.239 INFO:tasks.workunit.client.0.smithi073.stderr: -487> 2024-09-12T00:54:43.954+0000 7f073df25800 5 AuthRegistry(0x55d6bc5fa330) adding con mode: secure 2024-09-12T00:54:44.239 INFO:tasks.workunit.client.0.smithi073.stderr: -486> 2024-09-12T00:54:43.954+0000 7f073df25800 5 AuthRegistry(0x55d6bc5fa330) adding con mode: crc 2024-09-12T00:54:44.239 INFO:tasks.workunit.client.0.smithi073.stderr: -485> 2024-09-12T00:54:43.954+0000 7f073df25800 5 AuthRegistry(0x55d6bc5fa330) adding con mode: secure 2024-09-12T00:54:44.239 INFO:tasks.workunit.client.0.smithi073.stderr: -484> 2024-09-12T00:54:43.954+0000 7f073df25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:44.240 INFO:tasks.workunit.client.0.smithi073.stderr: -483> 2024-09-12T00:54:43.954+0000 7f073df25800 1 librados: starting msgr at 2024-09-12T00:54:44.240 INFO:tasks.workunit.client.0.smithi073.stderr: -482> 2024-09-12T00:54:43.954+0000 7f073df25800 1 librados: starting objecter 2024-09-12T00:54:44.240 INFO:tasks.workunit.client.0.smithi073.stderr: -481> 2024-09-12T00:54:43.955+0000 7f073df25800 5 asok(0x55d6bc3d5630) register_command objecter_requests hook 0x55d6bc5f7e90 2024-09-12T00:54:44.240 INFO:tasks.workunit.client.0.smithi073.stderr: -480> 2024-09-12T00:54:43.955+0000 7f073df25800 1 librados: setting wanted keys 2024-09-12T00:54:44.240 INFO:tasks.workunit.client.0.smithi073.stderr: -479> 2024-09-12T00:54:43.955+0000 7f073df25800 1 librados: calling monclient init 2024-09-12T00:54:44.240 INFO:tasks.workunit.client.0.smithi073.stderr: -478> 2024-09-12T00:54:43.955+0000 7f073df25800 10 monclient: init 2024-09-12T00:54:44.240 INFO:tasks.workunit.client.0.smithi073.stderr: -477> 2024-09-12T00:54:43.955+0000 7f073df25800 5 AuthRegistry(0x55d6bc5f4890) adding auth protocol: cephx 2024-09-12T00:54:44.240 INFO:tasks.workunit.client.0.smithi073.stderr: -476> 2024-09-12T00:54:43.955+0000 7f073df25800 5 AuthRegistry(0x55d6bc5f4890) adding auth protocol: cephx 2024-09-12T00:54:44.240 INFO:tasks.workunit.client.0.smithi073.stderr: -475> 2024-09-12T00:54:43.955+0000 7f073df25800 5 AuthRegistry(0x55d6bc5f4890) adding auth protocol: cephx 2024-09-12T00:54:44.240 INFO:tasks.workunit.client.0.smithi073.stderr: -474> 2024-09-12T00:54:43.955+0000 7f073df25800 5 AuthRegistry(0x55d6bc5f4890) adding con mode: secure 2024-09-12T00:54:44.240 INFO:tasks.workunit.client.0.smithi073.stderr: -473> 2024-09-12T00:54:43.955+0000 7f073df25800 5 AuthRegistry(0x55d6bc5f4890) adding con mode: crc 2024-09-12T00:54:44.240 INFO:tasks.workunit.client.0.smithi073.stderr: -472> 2024-09-12T00:54:43.955+0000 7f073df25800 5 AuthRegistry(0x55d6bc5f4890) adding con mode: secure 2024-09-12T00:54:44.240 INFO:tasks.workunit.client.0.smithi073.stderr: -471> 2024-09-12T00:54:43.955+0000 7f073df25800 5 AuthRegistry(0x55d6bc5f4890) adding con mode: crc 2024-09-12T00:54:44.241 INFO:tasks.workunit.client.0.smithi073.stderr: -470> 2024-09-12T00:54:43.955+0000 7f073df25800 5 AuthRegistry(0x55d6bc5f4890) adding con mode: secure 2024-09-12T00:54:44.241 INFO:tasks.workunit.client.0.smithi073.stderr: -469> 2024-09-12T00:54:43.955+0000 7f073df25800 5 AuthRegistry(0x55d6bc5f4890) adding con mode: crc 2024-09-12T00:54:44.241 INFO:tasks.workunit.client.0.smithi073.stderr: -468> 2024-09-12T00:54:43.955+0000 7f073df25800 5 AuthRegistry(0x55d6bc5f4890) adding con mode: crc 2024-09-12T00:54:44.241 INFO:tasks.workunit.client.0.smithi073.stderr: -467> 2024-09-12T00:54:43.955+0000 7f073df25800 5 AuthRegistry(0x55d6bc5f4890) adding con mode: secure 2024-09-12T00:54:44.241 INFO:tasks.workunit.client.0.smithi073.stderr: -466> 2024-09-12T00:54:43.955+0000 7f073df25800 5 AuthRegistry(0x55d6bc5f4890) adding con mode: crc 2024-09-12T00:54:44.241 INFO:tasks.workunit.client.0.smithi073.stderr: -465> 2024-09-12T00:54:43.955+0000 7f073df25800 5 AuthRegistry(0x55d6bc5f4890) adding con mode: secure 2024-09-12T00:54:44.241 INFO:tasks.workunit.client.0.smithi073.stderr: -464> 2024-09-12T00:54:43.955+0000 7f073df25800 5 AuthRegistry(0x55d6bc5f4890) adding con mode: crc 2024-09-12T00:54:44.241 INFO:tasks.workunit.client.0.smithi073.stderr: -463> 2024-09-12T00:54:43.955+0000 7f073df25800 5 AuthRegistry(0x55d6bc5f4890) adding con mode: secure 2024-09-12T00:54:44.241 INFO:tasks.workunit.client.0.smithi073.stderr: -462> 2024-09-12T00:54:43.955+0000 7f073df25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:44.241 INFO:tasks.workunit.client.0.smithi073.stderr: -461> 2024-09-12T00:54:43.955+0000 7f073df25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:44.241 INFO:tasks.workunit.client.0.smithi073.stderr: -460> 2024-09-12T00:54:43.955+0000 7f073df25800 5 asok(0x55d6bc3d5630) register_command rotate-key hook 0x55d6bc5f49d8 2024-09-12T00:54:44.241 INFO:tasks.workunit.client.0.smithi073.stderr: -459> 2024-09-12T00:54:43.955+0000 7f073df25800 10 monclient: _reopen_session rank -1 2024-09-12T00:54:44.241 INFO:tasks.workunit.client.0.smithi073.stderr: -458> 2024-09-12T00:54:43.955+0000 7f073df25800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:54:44.241 INFO:tasks.workunit.client.0.smithi073.stderr: -457> 2024-09-12T00:54:43.955+0000 7f073df25800 10 monclient(hunting): picked mon.noname-b con 0x55d6bc4adb00 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:54:44.242 INFO:tasks.workunit.client.0.smithi073.stderr: -456> 2024-09-12T00:54:43.955+0000 7f073df25800 10 monclient(hunting): picked mon.noname-c con 0x55d6bc626700 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:54:44.242 INFO:tasks.workunit.client.0.smithi073.stderr: -455> 2024-09-12T00:54:43.955+0000 7f073df25800 10 monclient(hunting): picked mon.noname-a con 0x7f0620006db0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:54:44.242 INFO:tasks.workunit.client.0.smithi073.stderr: -454> 2024-09-12T00:54:43.955+0000 7f073df25800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:44.242 INFO:tasks.workunit.client.0.smithi073.stderr: -453> 2024-09-12T00:54:43.955+0000 7f073df25800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:44.242 INFO:tasks.workunit.client.0.smithi073.stderr: -452> 2024-09-12T00:54:43.955+0000 7f073df25800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:44.242 INFO:tasks.workunit.client.0.smithi073.stderr: -451> 2024-09-12T00:54:43.955+0000 7f073df25800 10 monclient(hunting): _renew_subs 2024-09-12T00:54:44.242 INFO:tasks.workunit.client.0.smithi073.stderr: -450> 2024-09-12T00:54:43.955+0000 7f073df25800 10 monclient(hunting): authenticate will time out at 2344.625822s 2024-09-12T00:54:44.242 INFO:tasks.workunit.client.0.smithi073.stderr: -449> 2024-09-12T00:54:43.955+0000 7f0739332640 10 monclient(hunting): get_auth_request con 0x55d6bc626700 auth_method 0 2024-09-12T00:54:44.242 INFO:tasks.workunit.client.0.smithi073.stderr: -448> 2024-09-12T00:54:43.955+0000 7f0739332640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:44.242 INFO:tasks.workunit.client.0.smithi073.stderr: -447> 2024-09-12T00:54:43.955+0000 7f0739332640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:44.242 INFO:tasks.workunit.client.0.smithi073.stderr: -446> 2024-09-12T00:54:43.955+0000 7f0739332640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:44.242 INFO:tasks.workunit.client.0.smithi073.stderr: -445> 2024-09-12T00:54:43.955+0000 7f073a334640 10 monclient(hunting): get_auth_request con 0x7f0620006db0 auth_method 0 2024-09-12T00:54:44.242 INFO:tasks.workunit.client.0.smithi073.stderr: -444> 2024-09-12T00:54:43.955+0000 7f073a334640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:44.243 INFO:tasks.workunit.client.0.smithi073.stderr: -443> 2024-09-12T00:54:43.955+0000 7f073a334640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:44.243 INFO:tasks.workunit.client.0.smithi073.stderr: -442> 2024-09-12T00:54:43.955+0000 7f073a334640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:44.243 INFO:tasks.workunit.client.0.smithi073.stderr: -441> 2024-09-12T00:54:43.955+0000 7f0739332640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:44.243 INFO:tasks.workunit.client.0.smithi073.stderr: -440> 2024-09-12T00:54:43.955+0000 7f0739332640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:44.243 INFO:tasks.workunit.client.0.smithi073.stderr: -439> 2024-09-12T00:54:43.955+0000 7f0739332640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:44.243 INFO:tasks.workunit.client.0.smithi073.stderr: -438> 2024-09-12T00:54:43.955+0000 7f073a334640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:44.243 INFO:tasks.workunit.client.0.smithi073.stderr: -437> 2024-09-12T00:54:43.955+0000 7f073a334640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:44.243 INFO:tasks.workunit.client.0.smithi073.stderr: -436> 2024-09-12T00:54:43.955+0000 7f073a334640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:44.243 INFO:tasks.workunit.client.0.smithi073.stderr: -435> 2024-09-12T00:54:43.955+0000 7f0739b33640 10 monclient(hunting): get_auth_request con 0x55d6bc4adb00 auth_method 0 2024-09-12T00:54:44.243 INFO:tasks.workunit.client.0.smithi073.stderr: -434> 2024-09-12T00:54:43.955+0000 7f0739b33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:44.243 INFO:tasks.workunit.client.0.smithi073.stderr: -433> 2024-09-12T00:54:43.955+0000 7f0739b33640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:44.243 INFO:tasks.workunit.client.0.smithi073.stderr: -432> 2024-09-12T00:54:43.955+0000 7f0739b33640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:44.243 INFO:tasks.workunit.client.0.smithi073.stderr: -431> 2024-09-12T00:54:43.956+0000 7f0739b33640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:44.243 INFO:tasks.workunit.client.0.smithi073.stderr: -430> 2024-09-12T00:54:43.956+0000 7f0739b33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:44.244 INFO:tasks.workunit.client.0.smithi073.stderr: -429> 2024-09-12T00:54:43.956+0000 7f0739b33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:44.244 INFO:tasks.workunit.client.0.smithi073.stderr: -428> 2024-09-12T00:54:43.956+0000 7f0739332640 10 monclient(hunting): handle_auth_done global_id 7796 payload 824 2024-09-12T00:54:44.244 INFO:tasks.workunit.client.0.smithi073.stderr: -427> 2024-09-12T00:54:43.956+0000 7f0739332640 10 monclient: _finish_hunting 0 2024-09-12T00:54:44.244 INFO:tasks.workunit.client.0.smithi073.stderr: -426> 2024-09-12T00:54:43.956+0000 7f0739332640 1 monclient: found mon.noname-c 2024-09-12T00:54:44.244 INFO:tasks.workunit.client.0.smithi073.stderr: -425> 2024-09-12T00:54:43.956+0000 7f0739332640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.73:3301/0 2024-09-12T00:54:44.244 INFO:tasks.workunit.client.0.smithi073.stderr: -424> 2024-09-12T00:54:43.956+0000 7f0626604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:44.244 INFO:tasks.workunit.client.0.smithi073.stderr: -423> 2024-09-12T00:54:43.956+0000 7f0626604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:54:44.244 INFO:tasks.workunit.client.0.smithi073.stderr: -422> 2024-09-12T00:54:43.956+0000 7f0626604640 10 monclient: dump: 2024-09-12T00:54:44.244 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:54:44.244 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:54:44.244 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:44.244 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:44.244 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:44.245 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:54:44.245 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:54:44.245 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:54:44.245 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:54:44.245 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:44.245 INFO:tasks.workunit.client.0.smithi073.stderr: -421> 2024-09-12T00:54:43.956+0000 7f0626604640 10 monclient: _finish_auth 0 2024-09-12T00:54:44.245 INFO:tasks.workunit.client.0.smithi073.stderr: -420> 2024-09-12T00:54:43.956+0000 7f0626604640 10 monclient: _check_auth_tickets 2024-09-12T00:54:44.245 INFO:tasks.workunit.client.0.smithi073.stderr: -419> 2024-09-12T00:54:43.956+0000 7f073df25800 5 monclient: authenticate success, global_id 7796 2024-09-12T00:54:44.245 INFO:tasks.workunit.client.0.smithi073.stderr: -418> 2024-09-12T00:54:43.956+0000 7f073df25800 10 monclient: _renew_subs 2024-09-12T00:54:44.245 INFO:tasks.workunit.client.0.smithi073.stderr: -417> 2024-09-12T00:54:43.956+0000 7f073df25800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:54:44.245 INFO:tasks.workunit.client.0.smithi073.stderr: -416> 2024-09-12T00:54:43.956+0000 7f0626604640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:44.245 INFO:tasks.workunit.client.0.smithi073.stderr: -415> 2024-09-12T00:54:43.956+0000 7f0626604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:44.245 INFO:tasks.workunit.client.0.smithi073.stderr: -414> 2024-09-12T00:54:43.956+0000 7f0626604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:54:44.246 INFO:tasks.workunit.client.0.smithi073.stderr: -413> 2024-09-12T00:54:43.956+0000 7f0626604640 10 monclient: dump: 2024-09-12T00:54:44.246 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:54:44.246 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:54:44.246 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:44.246 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:44.246 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:44.246 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:54:44.246 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:54:44.246 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:54:44.246 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:54:44.246 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:44.246 INFO:tasks.workunit.client.0.smithi073.stderr: -412> 2024-09-12T00:54:43.956+0000 7f0627e07640 4 set_mon_vals no callback set 2024-09-12T00:54:44.246 INFO:tasks.workunit.client.0.smithi073.stderr: -411> 2024-09-12T00:54:43.956+0000 7f073df25800 10 monclient: _renew_subs 2024-09-12T00:54:44.247 INFO:tasks.workunit.client.0.smithi073.stderr: -410> 2024-09-12T00:54:43.956+0000 7f073df25800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:54:44.247 INFO:tasks.workunit.client.0.smithi073.stderr: -409> 2024-09-12T00:54:43.956+0000 7f073df25800 1 librados: init done 2024-09-12T00:54:44.247 INFO:tasks.workunit.client.0.smithi073.stderr: -408> 2024-09-12T00:54:43.958+0000 7f0626604640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:54:44.247 INFO:tasks.workunit.client.0.smithi073.stderr: -407> 2024-09-12T00:54:43.958+0000 7f0626604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:54:44.247 INFO:tasks.workunit.client.0.smithi073.stderr: -406> 2024-09-12T00:54:43.958+0000 7f0626604640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:54:44.247 INFO:tasks.workunit.client.0.smithi073.stderr: -405> 2024-09-12T00:54:43.958+0000 7f0739b33640 10 monclient: get_auth_request con 0x7f0620079820 auth_method 0 2024-09-12T00:54:44.247 INFO:tasks.workunit.client.0.smithi073.stderr: -404> 2024-09-12T00:54:43.958+0000 7f073a334640 10 monclient: get_auth_request con 0x55d6bc6357c0 auth_method 0 2024-09-12T00:54:44.247 INFO:tasks.workunit.client.0.smithi073.stderr: -403> 2024-09-12T00:54:43.960+0000 7f0739b33640 10 monclient: get_auth_request con 0x55d6bc63ed90 auth_method 0 2024-09-12T00:54:44.247 INFO:tasks.workunit.client.0.smithi073.stderr: -402> 2024-09-12T00:54:43.961+0000 7f0739332640 10 monclient: get_auth_request con 0x55d6bc6430f0 auth_method 0 2024-09-12T00:54:44.247 INFO:tasks.workunit.client.0.smithi073.stderr: -401> 2024-09-12T00:54:43.962+0000 7f073df25800 10 monclient: build_initial_monmap 2024-09-12T00:54:44.247 INFO:tasks.workunit.client.0.smithi073.stderr: -400> 2024-09-12T00:54:43.962+0000 7f073df25800 1 build_initial for_mkfs: 0 2024-09-12T00:54:44.247 INFO:tasks.workunit.client.0.smithi073.stderr: -399> 2024-09-12T00:54:43.962+0000 7f073df25800 10 monclient: monmap: 2024-09-12T00:54:44.247 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:54:44.247 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:54:44.248 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:54:44.248 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:54:44.248 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:54:44.248 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:54:44.248 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:54:44.248 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:54:44.248 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:54:44.248 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:44.248 INFO:tasks.workunit.client.0.smithi073.stderr: -398> 2024-09-12T00:54:43.962+0000 7f073df25800 5 AuthRegistry(0x55d6bc647f30) adding auth protocol: cephx 2024-09-12T00:54:44.248 INFO:tasks.workunit.client.0.smithi073.stderr: -397> 2024-09-12T00:54:43.962+0000 7f073df25800 5 AuthRegistry(0x55d6bc647f30) adding auth protocol: cephx 2024-09-12T00:54:44.248 INFO:tasks.workunit.client.0.smithi073.stderr: -396> 2024-09-12T00:54:43.962+0000 7f073df25800 5 AuthRegistry(0x55d6bc647f30) adding auth protocol: cephx 2024-09-12T00:54:44.248 INFO:tasks.workunit.client.0.smithi073.stderr: -395> 2024-09-12T00:54:43.962+0000 7f073df25800 5 AuthRegistry(0x55d6bc647f30) adding con mode: secure 2024-09-12T00:54:44.248 INFO:tasks.workunit.client.0.smithi073.stderr: -394> 2024-09-12T00:54:43.962+0000 7f073df25800 5 AuthRegistry(0x55d6bc647f30) adding con mode: crc 2024-09-12T00:54:44.249 INFO:tasks.workunit.client.0.smithi073.stderr: -393> 2024-09-12T00:54:43.962+0000 7f073df25800 5 AuthRegistry(0x55d6bc647f30) adding con mode: secure 2024-09-12T00:54:44.249 INFO:tasks.workunit.client.0.smithi073.stderr: -392> 2024-09-12T00:54:43.962+0000 7f073df25800 5 AuthRegistry(0x55d6bc647f30) adding con mode: crc 2024-09-12T00:54:44.249 INFO:tasks.workunit.client.0.smithi073.stderr: -391> 2024-09-12T00:54:43.962+0000 7f073df25800 5 AuthRegistry(0x55d6bc647f30) adding con mode: secure 2024-09-12T00:54:44.249 INFO:tasks.workunit.client.0.smithi073.stderr: -390> 2024-09-12T00:54:43.962+0000 7f073df25800 5 AuthRegistry(0x55d6bc647f30) adding con mode: crc 2024-09-12T00:54:44.249 INFO:tasks.workunit.client.0.smithi073.stderr: -389> 2024-09-12T00:54:43.962+0000 7f073df25800 5 AuthRegistry(0x55d6bc647f30) adding con mode: crc 2024-09-12T00:54:44.249 INFO:tasks.workunit.client.0.smithi073.stderr: -388> 2024-09-12T00:54:43.962+0000 7f073df25800 5 AuthRegistry(0x55d6bc647f30) adding con mode: secure 2024-09-12T00:54:44.249 INFO:tasks.workunit.client.0.smithi073.stderr: -387> 2024-09-12T00:54:43.962+0000 7f073df25800 5 AuthRegistry(0x55d6bc647f30) adding con mode: crc 2024-09-12T00:54:44.249 INFO:tasks.workunit.client.0.smithi073.stderr: -386> 2024-09-12T00:54:43.962+0000 7f073df25800 5 AuthRegistry(0x55d6bc647f30) adding con mode: secure 2024-09-12T00:54:44.249 INFO:tasks.workunit.client.0.smithi073.stderr: -385> 2024-09-12T00:54:43.962+0000 7f073df25800 5 AuthRegistry(0x55d6bc647f30) adding con mode: crc 2024-09-12T00:54:44.249 INFO:tasks.workunit.client.0.smithi073.stderr: -384> 2024-09-12T00:54:43.962+0000 7f073df25800 5 AuthRegistry(0x55d6bc647f30) adding con mode: secure 2024-09-12T00:54:44.249 INFO:tasks.workunit.client.0.smithi073.stderr: -383> 2024-09-12T00:54:43.962+0000 7f073df25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:44.249 INFO:tasks.workunit.client.0.smithi073.stderr: -382> 2024-09-12T00:54:43.963+0000 7f073df25800 5 asok(0x55d6bc3d5630) register_command objecter_requests cmddesc objecter_requests hook 0x55d6bc64b940 EEXIST 2024-09-12T00:54:44.249 INFO:tasks.workunit.client.0.smithi073.stderr: -381> 2024-09-12T00:54:43.963+0000 7f073df25800 10 monclient: init 2024-09-12T00:54:44.250 INFO:tasks.workunit.client.0.smithi073.stderr: -380> 2024-09-12T00:54:43.963+0000 7f073df25800 5 AuthRegistry(0x55d6bc6465b8) adding auth protocol: cephx 2024-09-12T00:54:44.250 INFO:tasks.workunit.client.0.smithi073.stderr: -379> 2024-09-12T00:54:43.963+0000 7f073df25800 5 AuthRegistry(0x55d6bc6465b8) adding auth protocol: cephx 2024-09-12T00:54:44.250 INFO:tasks.workunit.client.0.smithi073.stderr: -378> 2024-09-12T00:54:43.963+0000 7f073df25800 5 AuthRegistry(0x55d6bc6465b8) adding auth protocol: cephx 2024-09-12T00:54:44.250 INFO:tasks.workunit.client.0.smithi073.stderr: -377> 2024-09-12T00:54:43.963+0000 7f073df25800 5 AuthRegistry(0x55d6bc6465b8) adding con mode: secure 2024-09-12T00:54:44.250 INFO:tasks.workunit.client.0.smithi073.stderr: -376> 2024-09-12T00:54:43.963+0000 7f073df25800 5 AuthRegistry(0x55d6bc6465b8) adding con mode: crc 2024-09-12T00:54:44.250 INFO:tasks.workunit.client.0.smithi073.stderr: -375> 2024-09-12T00:54:43.963+0000 7f073df25800 5 AuthRegistry(0x55d6bc6465b8) adding con mode: secure 2024-09-12T00:54:44.250 INFO:tasks.workunit.client.0.smithi073.stderr: -374> 2024-09-12T00:54:43.963+0000 7f073df25800 5 AuthRegistry(0x55d6bc6465b8) adding con mode: crc 2024-09-12T00:54:44.250 INFO:tasks.workunit.client.0.smithi073.stderr: -373> 2024-09-12T00:54:43.963+0000 7f073df25800 5 AuthRegistry(0x55d6bc6465b8) adding con mode: secure 2024-09-12T00:54:44.250 INFO:tasks.workunit.client.0.smithi073.stderr: -372> 2024-09-12T00:54:43.963+0000 7f073df25800 5 AuthRegistry(0x55d6bc6465b8) adding con mode: crc 2024-09-12T00:54:44.250 INFO:tasks.workunit.client.0.smithi073.stderr: -371> 2024-09-12T00:54:43.963+0000 7f073df25800 5 AuthRegistry(0x55d6bc6465b8) adding con mode: crc 2024-09-12T00:54:44.250 INFO:tasks.workunit.client.0.smithi073.stderr: -370> 2024-09-12T00:54:43.963+0000 7f073df25800 5 AuthRegistry(0x55d6bc6465b8) adding con mode: secure 2024-09-12T00:54:44.250 INFO:tasks.workunit.client.0.smithi073.stderr: -369> 2024-09-12T00:54:43.963+0000 7f073df25800 5 AuthRegistry(0x55d6bc6465b8) adding con mode: crc 2024-09-12T00:54:44.250 INFO:tasks.workunit.client.0.smithi073.stderr: -368> 2024-09-12T00:54:43.963+0000 7f073df25800 5 AuthRegistry(0x55d6bc6465b8) adding con mode: secure 2024-09-12T00:54:44.251 INFO:tasks.workunit.client.0.smithi073.stderr: -367> 2024-09-12T00:54:43.963+0000 7f073df25800 5 AuthRegistry(0x55d6bc6465b8) adding con mode: crc 2024-09-12T00:54:44.251 INFO:tasks.workunit.client.0.smithi073.stderr: -366> 2024-09-12T00:54:43.963+0000 7f073df25800 5 AuthRegistry(0x55d6bc6465b8) adding con mode: secure 2024-09-12T00:54:44.251 INFO:tasks.workunit.client.0.smithi073.stderr: -365> 2024-09-12T00:54:43.963+0000 7f073df25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:44.251 INFO:tasks.workunit.client.0.smithi073.stderr: -364> 2024-09-12T00:54:43.963+0000 7f073df25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:44.251 INFO:tasks.workunit.client.0.smithi073.stderr: -363> 2024-09-12T00:54:43.963+0000 7f073df25800 5 asok(0x55d6bc3d5630) register_command rotate-key cmddesc rotate-key hook 0x55d6bc646700 EEXIST 2024-09-12T00:54:44.251 INFO:tasks.workunit.client.0.smithi073.stderr: -362> 2024-09-12T00:54:43.963+0000 7f073df25800 10 monclient: _reopen_session rank -1 2024-09-12T00:54:44.251 INFO:tasks.workunit.client.0.smithi073.stderr: -361> 2024-09-12T00:54:43.963+0000 7f073df25800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:54:44.251 INFO:tasks.workunit.client.0.smithi073.stderr: -360> 2024-09-12T00:54:43.963+0000 7f073df25800 10 monclient(hunting): picked mon.noname-b con 0x55d6bc66f630 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:54:44.251 INFO:tasks.workunit.client.0.smithi073.stderr: -359> 2024-09-12T00:54:43.963+0000 7f073df25800 10 monclient(hunting): picked mon.noname-c con 0x55d6bc671900 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:54:44.251 INFO:tasks.workunit.client.0.smithi073.stderr: -358> 2024-09-12T00:54:43.963+0000 7f073df25800 10 monclient(hunting): picked mon.noname-a con 0x55d6bc66de00 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:54:44.251 INFO:tasks.workunit.client.0.smithi073.stderr: -357> 2024-09-12T00:54:43.963+0000 7f073df25800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:44.251 INFO:tasks.workunit.client.0.smithi073.stderr: -356> 2024-09-12T00:54:43.963+0000 7f073df25800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:44.251 INFO:tasks.workunit.client.0.smithi073.stderr: -355> 2024-09-12T00:54:43.963+0000 7f073df25800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:44.252 INFO:tasks.workunit.client.0.smithi073.stderr: -354> 2024-09-12T00:54:43.963+0000 7f073df25800 10 monclient(hunting): _renew_subs 2024-09-12T00:54:44.252 INFO:tasks.workunit.client.0.smithi073.stderr: -353> 2024-09-12T00:54:43.963+0000 7f073df25800 10 monclient(hunting): authenticate will time out at 2344.633795s 2024-09-12T00:54:44.252 INFO:tasks.workunit.client.0.smithi073.stderr: -352> 2024-09-12T00:54:43.963+0000 7f0739332640 10 monclient(hunting): get_auth_request con 0x55d6bc671900 auth_method 0 2024-09-12T00:54:44.252 INFO:tasks.workunit.client.0.smithi073.stderr: -351> 2024-09-12T00:54:43.963+0000 7f0739332640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:44.252 INFO:tasks.workunit.client.0.smithi073.stderr: -350> 2024-09-12T00:54:43.963+0000 7f0739332640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:44.252 INFO:tasks.workunit.client.0.smithi073.stderr: -349> 2024-09-12T00:54:43.963+0000 7f0739332640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:44.252 INFO:tasks.workunit.client.0.smithi073.stderr: -348> 2024-09-12T00:54:43.963+0000 7f073a334640 10 monclient(hunting): get_auth_request con 0x55d6bc66de00 auth_method 0 2024-09-12T00:54:44.252 INFO:tasks.workunit.client.0.smithi073.stderr: -347> 2024-09-12T00:54:43.963+0000 7f073a334640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:44.252 INFO:tasks.workunit.client.0.smithi073.stderr: -346> 2024-09-12T00:54:43.963+0000 7f073a334640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:44.252 INFO:tasks.workunit.client.0.smithi073.stderr: -345> 2024-09-12T00:54:43.963+0000 7f073a334640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:44.252 INFO:tasks.workunit.client.0.smithi073.stderr: -344> 2024-09-12T00:54:43.963+0000 7f0739332640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:44.252 INFO:tasks.workunit.client.0.smithi073.stderr: -343> 2024-09-12T00:54:43.963+0000 7f0739332640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:44.252 INFO:tasks.workunit.client.0.smithi073.stderr: -342> 2024-09-12T00:54:43.964+0000 7f0739332640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:44.253 INFO:tasks.workunit.client.0.smithi073.stderr: -341> 2024-09-12T00:54:43.964+0000 7f0739b33640 10 monclient(hunting): get_auth_request con 0x55d6bc66f630 auth_method 0 2024-09-12T00:54:44.253 INFO:tasks.workunit.client.0.smithi073.stderr: -340> 2024-09-12T00:54:43.964+0000 7f0739b33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:44.253 INFO:tasks.workunit.client.0.smithi073.stderr: -339> 2024-09-12T00:54:43.964+0000 7f0739b33640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:44.253 INFO:tasks.workunit.client.0.smithi073.stderr: -338> 2024-09-12T00:54:43.964+0000 7f0739b33640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:44.253 INFO:tasks.workunit.client.0.smithi073.stderr: -337> 2024-09-12T00:54:43.964+0000 7f073a334640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:44.253 INFO:tasks.workunit.client.0.smithi073.stderr: -336> 2024-09-12T00:54:43.964+0000 7f073a334640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:44.253 INFO:tasks.workunit.client.0.smithi073.stderr: -335> 2024-09-12T00:54:43.964+0000 7f073a334640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:44.253 INFO:tasks.workunit.client.0.smithi073.stderr: -334> 2024-09-12T00:54:43.964+0000 7f0739b33640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:44.253 INFO:tasks.workunit.client.0.smithi073.stderr: -333> 2024-09-12T00:54:43.964+0000 7f0739b33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:44.253 INFO:tasks.workunit.client.0.smithi073.stderr: -332> 2024-09-12T00:54:43.964+0000 7f0739b33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:44.253 INFO:tasks.workunit.client.0.smithi073.stderr: -331> 2024-09-12T00:54:43.964+0000 7f0739332640 10 monclient(hunting): handle_auth_done global_id 7799 payload 824 2024-09-12T00:54:44.253 INFO:tasks.workunit.client.0.smithi073.stderr: -330> 2024-09-12T00:54:43.964+0000 7f0739332640 10 monclient: _finish_hunting 0 2024-09-12T00:54:44.253 INFO:tasks.workunit.client.0.smithi073.stderr: -329> 2024-09-12T00:54:43.964+0000 7f0739332640 1 monclient: found mon.noname-c 2024-09-12T00:54:44.253 INFO:tasks.workunit.client.0.smithi073.stderr: -328> 2024-09-12T00:54:43.964+0000 7f0739332640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.73:3301/0 2024-09-12T00:54:44.254 INFO:tasks.workunit.client.0.smithi073.stderr: -327> 2024-09-12T00:54:43.964+0000 7f061f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:44.254 INFO:tasks.workunit.client.0.smithi073.stderr: -326> 2024-09-12T00:54:43.964+0000 7f061f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:54:44.254 INFO:tasks.workunit.client.0.smithi073.stderr: -325> 2024-09-12T00:54:43.964+0000 7f061f7fe640 10 monclient: dump: 2024-09-12T00:54:44.254 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:54:44.254 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:54:44.254 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:44.254 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:44.254 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:44.254 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:54:44.254 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:54:44.254 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:54:44.254 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:54:44.254 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:44.255 INFO:tasks.workunit.client.0.smithi073.stderr: -324> 2024-09-12T00:54:43.964+0000 7f061f7fe640 10 monclient: _finish_auth 0 2024-09-12T00:54:44.255 INFO:tasks.workunit.client.0.smithi073.stderr: -323> 2024-09-12T00:54:43.964+0000 7f061f7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:54:44.255 INFO:tasks.workunit.client.0.smithi073.stderr: -322> 2024-09-12T00:54:43.964+0000 7f061f7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:44.255 INFO:tasks.workunit.client.0.smithi073.stderr: -321> 2024-09-12T00:54:43.964+0000 7f061f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:44.255 INFO:tasks.workunit.client.0.smithi073.stderr: -320> 2024-09-12T00:54:43.964+0000 7f061f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:54:44.255 INFO:tasks.workunit.client.0.smithi073.stderr: -319> 2024-09-12T00:54:43.964+0000 7f061f7fe640 10 monclient: dump: 2024-09-12T00:54:44.255 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:54:44.255 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:54:44.255 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:44.255 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:44.255 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:44.255 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:54:44.255 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:54:44.255 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:54:44.256 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:54:44.256 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:44.256 INFO:tasks.workunit.client.0.smithi073.stderr: -318> 2024-09-12T00:54:43.964+0000 7f073df25800 5 monclient: authenticate success, global_id 7799 2024-09-12T00:54:44.256 INFO:tasks.workunit.client.0.smithi073.stderr: -317> 2024-09-12T00:54:43.964+0000 7f073ab35640 4 set_mon_vals no callback set 2024-09-12T00:54:44.256 INFO:tasks.workunit.client.0.smithi073.stderr: -316> 2024-09-12T00:54:43.964+0000 7f073df25800 10 monclient: _renew_subs 2024-09-12T00:54:44.256 INFO:tasks.workunit.client.0.smithi073.stderr: -315> 2024-09-12T00:54:43.964+0000 7f073df25800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:54:44.256 INFO:tasks.workunit.client.0.smithi073.stderr: -314> 2024-09-12T00:54:43.964+0000 7f073df25800 10 monclient: _renew_subs 2024-09-12T00:54:44.256 INFO:tasks.workunit.client.0.smithi073.stderr: -313> 2024-09-12T00:54:43.964+0000 7f073df25800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:54:44.256 INFO:tasks.workunit.client.0.smithi073.stderr: -312> 2024-09-12T00:54:43.966+0000 7f061f7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:54:44.256 INFO:tasks.workunit.client.0.smithi073.stderr: -311> 2024-09-12T00:54:43.966+0000 7f061f7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:54:44.256 INFO:tasks.workunit.client.0.smithi073.stderr: -310> 2024-09-12T00:54:43.966+0000 7f061f7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:54:44.257 INFO:tasks.workunit.client.0.smithi073.stderr: -309> 2024-09-12T00:54:43.967+0000 7f0739b33640 10 monclient: get_auth_request con 0x7f0614076380 auth_method 0 2024-09-12T00:54:44.257 INFO:tasks.workunit.client.0.smithi073.stderr: -308> 2024-09-12T00:54:43.967+0000 7f073df25800 10 monclient: get_monmap_and_config 2024-09-12T00:54:44.257 INFO:tasks.workunit.client.0.smithi073.stderr: -307> 2024-09-12T00:54:43.967+0000 7f073df25800 10 monclient: build_initial_monmap 2024-09-12T00:54:44.257 INFO:tasks.workunit.client.0.smithi073.stderr: -306> 2024-09-12T00:54:43.967+0000 7f073df25800 1 build_initial for_mkfs: 0 2024-09-12T00:54:44.257 INFO:tasks.workunit.client.0.smithi073.stderr: -305> 2024-09-12T00:54:43.967+0000 7f073df25800 10 monclient: monmap: 2024-09-12T00:54:44.257 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:54:44.257 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:54:44.257 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:54:44.257 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:54:44.257 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:54:44.257 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:54:44.257 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:54:44.257 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:54:44.258 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:54:44.258 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:44.258 INFO:tasks.workunit.client.0.smithi073.stderr: -304> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x55d6bc68ef70) adding auth protocol: cephx 2024-09-12T00:54:44.258 INFO:tasks.workunit.client.0.smithi073.stderr: -303> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x55d6bc68ef70) adding auth protocol: cephx 2024-09-12T00:54:44.258 INFO:tasks.workunit.client.0.smithi073.stderr: -302> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x55d6bc68ef70) adding auth protocol: cephx 2024-09-12T00:54:44.258 INFO:tasks.workunit.client.0.smithi073.stderr: -301> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x55d6bc68ef70) adding con mode: secure 2024-09-12T00:54:44.258 INFO:tasks.workunit.client.0.smithi073.stderr: -300> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x55d6bc68ef70) adding con mode: crc 2024-09-12T00:54:44.258 INFO:tasks.workunit.client.0.smithi073.stderr: -299> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x55d6bc68ef70) adding con mode: secure 2024-09-12T00:54:44.258 INFO:tasks.workunit.client.0.smithi073.stderr: -298> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x55d6bc68ef70) adding con mode: crc 2024-09-12T00:54:44.258 INFO:tasks.workunit.client.0.smithi073.stderr: -297> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x55d6bc68ef70) adding con mode: secure 2024-09-12T00:54:44.258 INFO:tasks.workunit.client.0.smithi073.stderr: -296> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x55d6bc68ef70) adding con mode: crc 2024-09-12T00:54:44.258 INFO:tasks.workunit.client.0.smithi073.stderr: -295> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x55d6bc68ef70) adding con mode: crc 2024-09-12T00:54:44.258 INFO:tasks.workunit.client.0.smithi073.stderr: -294> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x55d6bc68ef70) adding con mode: secure 2024-09-12T00:54:44.258 INFO:tasks.workunit.client.0.smithi073.stderr: -293> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x55d6bc68ef70) adding con mode: crc 2024-09-12T00:54:44.259 INFO:tasks.workunit.client.0.smithi073.stderr: -292> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x55d6bc68ef70) adding con mode: secure 2024-09-12T00:54:44.259 INFO:tasks.workunit.client.0.smithi073.stderr: -291> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x55d6bc68ef70) adding con mode: crc 2024-09-12T00:54:44.259 INFO:tasks.workunit.client.0.smithi073.stderr: -290> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x55d6bc68ef70) adding con mode: secure 2024-09-12T00:54:44.259 INFO:tasks.workunit.client.0.smithi073.stderr: -289> 2024-09-12T00:54:43.967+0000 7f073df25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:44.259 INFO:tasks.workunit.client.0.smithi073.stderr: -288> 2024-09-12T00:54:43.967+0000 7f073df25800 10 monclient: init 2024-09-12T00:54:44.259 INFO:tasks.workunit.client.0.smithi073.stderr: -287> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x7ffef781bd70) adding auth protocol: cephx 2024-09-12T00:54:44.259 INFO:tasks.workunit.client.0.smithi073.stderr: -286> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x7ffef781bd70) adding auth protocol: cephx 2024-09-12T00:54:44.259 INFO:tasks.workunit.client.0.smithi073.stderr: -285> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x7ffef781bd70) adding auth protocol: cephx 2024-09-12T00:54:44.259 INFO:tasks.workunit.client.0.smithi073.stderr: -284> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x7ffef781bd70) adding con mode: secure 2024-09-12T00:54:44.259 INFO:tasks.workunit.client.0.smithi073.stderr: -283> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x7ffef781bd70) adding con mode: crc 2024-09-12T00:54:44.259 INFO:tasks.workunit.client.0.smithi073.stderr: -282> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x7ffef781bd70) adding con mode: secure 2024-09-12T00:54:44.259 INFO:tasks.workunit.client.0.smithi073.stderr: -281> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x7ffef781bd70) adding con mode: crc 2024-09-12T00:54:44.259 INFO:tasks.workunit.client.0.smithi073.stderr: -280> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x7ffef781bd70) adding con mode: secure 2024-09-12T00:54:44.260 INFO:tasks.workunit.client.0.smithi073.stderr: -279> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x7ffef781bd70) adding con mode: crc 2024-09-12T00:54:44.260 INFO:tasks.workunit.client.0.smithi073.stderr: -278> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x7ffef781bd70) adding con mode: crc 2024-09-12T00:54:44.260 INFO:tasks.workunit.client.0.smithi073.stderr: -277> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x7ffef781bd70) adding con mode: secure 2024-09-12T00:54:44.260 INFO:tasks.workunit.client.0.smithi073.stderr: -276> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x7ffef781bd70) adding con mode: crc 2024-09-12T00:54:44.260 INFO:tasks.workunit.client.0.smithi073.stderr: -275> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x7ffef781bd70) adding con mode: secure 2024-09-12T00:54:44.260 INFO:tasks.workunit.client.0.smithi073.stderr: -274> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x7ffef781bd70) adding con mode: crc 2024-09-12T00:54:44.260 INFO:tasks.workunit.client.0.smithi073.stderr: -273> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x7ffef781bd70) adding con mode: secure 2024-09-12T00:54:44.260 INFO:tasks.workunit.client.0.smithi073.stderr: -272> 2024-09-12T00:54:43.968+0000 7f073df25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:44.260 INFO:tasks.workunit.client.0.smithi073.stderr: -271> 2024-09-12T00:54:43.968+0000 7f073df25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:44.260 INFO:tasks.workunit.client.0.smithi073.stderr: -270> 2024-09-12T00:54:43.968+0000 7f073df25800 5 asok(0x55d6bc3d5630) register_command rotate-key cmddesc rotate-key hook 0x7ffef781beb8 EEXIST 2024-09-12T00:54:44.260 INFO:tasks.workunit.client.0.smithi073.stderr: -269> 2024-09-12T00:54:43.968+0000 7f073df25800 10 monclient: _reopen_session rank -1 2024-09-12T00:54:44.260 INFO:tasks.workunit.client.0.smithi073.stderr: -268> 2024-09-12T00:54:43.968+0000 7f073df25800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:54:44.261 INFO:tasks.workunit.client.0.smithi073.stderr: -267> 2024-09-12T00:54:43.968+0000 7f073df25800 10 monclient(hunting): picked mon.noname-b con 0x55d6bc6c34b0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:54:44.261 INFO:tasks.workunit.client.0.smithi073.stderr: -266> 2024-09-12T00:54:43.968+0000 7f073df25800 10 monclient(hunting): picked mon.noname-a con 0x55d6bc6bda50 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:54:44.261 INFO:tasks.workunit.client.0.smithi073.stderr: -265> 2024-09-12T00:54:43.968+0000 7f073df25800 10 monclient(hunting): picked mon.noname-c con 0x55d6bc6932f0 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:54:44.261 INFO:tasks.workunit.client.0.smithi073.stderr: -264> 2024-09-12T00:54:43.968+0000 7f073df25800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:44.261 INFO:tasks.workunit.client.0.smithi073.stderr: -263> 2024-09-12T00:54:43.968+0000 7f073df25800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:44.261 INFO:tasks.workunit.client.0.smithi073.stderr: -262> 2024-09-12T00:54:43.968+0000 7f073df25800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:44.261 INFO:tasks.workunit.client.0.smithi073.stderr: -261> 2024-09-12T00:54:43.968+0000 7f073df25800 10 monclient(hunting): _renew_subs 2024-09-12T00:54:44.261 INFO:tasks.workunit.client.0.smithi073.stderr: -260> 2024-09-12T00:54:43.968+0000 7f073df25800 10 monclient(hunting): authenticate will time out at 2344.638587s 2024-09-12T00:54:44.261 INFO:tasks.workunit.client.0.smithi073.stderr: -259> 2024-09-12T00:54:43.968+0000 7f0739332640 10 monclient(hunting): get_auth_request con 0x55d6bc6bda50 auth_method 0 2024-09-12T00:54:44.261 INFO:tasks.workunit.client.0.smithi073.stderr: -258> 2024-09-12T00:54:43.968+0000 7f0739332640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:44.261 INFO:tasks.workunit.client.0.smithi073.stderr: -257> 2024-09-12T00:54:43.968+0000 7f0739332640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:44.261 INFO:tasks.workunit.client.0.smithi073.stderr: -256> 2024-09-12T00:54:43.968+0000 7f0739332640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:44.261 INFO:tasks.workunit.client.0.smithi073.stderr: -255> 2024-09-12T00:54:43.968+0000 7f0739b33640 10 monclient(hunting): get_auth_request con 0x55d6bc6c34b0 auth_method 0 2024-09-12T00:54:44.262 INFO:tasks.workunit.client.0.smithi073.stderr: -254> 2024-09-12T00:54:43.968+0000 7f0739b33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:44.262 INFO:tasks.workunit.client.0.smithi073.stderr: -253> 2024-09-12T00:54:43.968+0000 7f0739b33640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:44.262 INFO:tasks.workunit.client.0.smithi073.stderr: -252> 2024-09-12T00:54:43.968+0000 7f0739b33640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:44.262 INFO:tasks.workunit.client.0.smithi073.stderr: -251> 2024-09-12T00:54:43.968+0000 7f0739332640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:44.262 INFO:tasks.workunit.client.0.smithi073.stderr: -250> 2024-09-12T00:54:43.968+0000 7f0739332640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:44.262 INFO:tasks.workunit.client.0.smithi073.stderr: -249> 2024-09-12T00:54:43.968+0000 7f0739332640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:44.262 INFO:tasks.workunit.client.0.smithi073.stderr: -248> 2024-09-12T00:54:43.968+0000 7f073a334640 10 monclient(hunting): get_auth_request con 0x55d6bc6932f0 auth_method 0 2024-09-12T00:54:44.262 INFO:tasks.workunit.client.0.smithi073.stderr: -247> 2024-09-12T00:54:43.968+0000 7f073a334640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:44.262 INFO:tasks.workunit.client.0.smithi073.stderr: -246> 2024-09-12T00:54:43.968+0000 7f073a334640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:44.262 INFO:tasks.workunit.client.0.smithi073.stderr: -245> 2024-09-12T00:54:43.968+0000 7f073a334640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:44.262 INFO:tasks.workunit.client.0.smithi073.stderr: -244> 2024-09-12T00:54:43.968+0000 7f073a334640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:44.262 INFO:tasks.workunit.client.0.smithi073.stderr: -243> 2024-09-12T00:54:43.968+0000 7f073a334640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:44.262 INFO:tasks.workunit.client.0.smithi073.stderr: -242> 2024-09-12T00:54:43.968+0000 7f073a334640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:44.263 INFO:tasks.workunit.client.0.smithi073.stderr: -241> 2024-09-12T00:54:43.968+0000 7f0739b33640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:44.263 INFO:tasks.workunit.client.0.smithi073.stderr: -240> 2024-09-12T00:54:43.968+0000 7f0739b33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:44.263 INFO:tasks.workunit.client.0.smithi073.stderr: -239> 2024-09-12T00:54:43.968+0000 7f0739b33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:44.263 INFO:tasks.workunit.client.0.smithi073.stderr: -238> 2024-09-12T00:54:43.968+0000 7f0739332640 10 monclient(hunting): handle_auth_done global_id 8322 payload 274 2024-09-12T00:54:44.263 INFO:tasks.workunit.client.0.smithi073.stderr: -237> 2024-09-12T00:54:43.968+0000 7f0739332640 10 monclient: _finish_hunting 0 2024-09-12T00:54:44.263 INFO:tasks.workunit.client.0.smithi073.stderr: -236> 2024-09-12T00:54:43.968+0000 7f0739332640 1 monclient: found mon.noname-a 2024-09-12T00:54:44.263 INFO:tasks.workunit.client.0.smithi073.stderr: -235> 2024-09-12T00:54:43.968+0000 7f0739332640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:54:44.263 INFO:tasks.workunit.client.0.smithi073.stderr: -234> 2024-09-12T00:54:43.969+0000 7f061d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:44.263 INFO:tasks.workunit.client.0.smithi073.stderr: -233> 2024-09-12T00:54:43.969+0000 7f061d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:54:44.263 INFO:tasks.workunit.client.0.smithi073.stderr: -232> 2024-09-12T00:54:43.969+0000 7f061d7fa640 10 monclient: dump: 2024-09-12T00:54:44.263 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:54:44.263 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:54:44.264 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:44.264 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:44.264 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:44.264 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:54:44.264 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:54:44.264 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:54:44.264 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:54:44.264 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:44.264 INFO:tasks.workunit.client.0.smithi073.stderr: -231> 2024-09-12T00:54:43.969+0000 7f061d7fa640 10 monclient: _finish_auth 0 2024-09-12T00:54:44.264 INFO:tasks.workunit.client.0.smithi073.stderr: -230> 2024-09-12T00:54:43.969+0000 7f061d7fa640 10 monclient: _check_auth_tickets 2024-09-12T00:54:44.264 INFO:tasks.workunit.client.0.smithi073.stderr: -229> 2024-09-12T00:54:43.969+0000 7f061d7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:44.264 INFO:tasks.workunit.client.0.smithi073.stderr: -228> 2024-09-12T00:54:43.969+0000 7f061d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:44.264 INFO:tasks.workunit.client.0.smithi073.stderr: -227> 2024-09-12T00:54:43.969+0000 7f061d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:54:44.265 INFO:tasks.workunit.client.0.smithi073.stderr: -226> 2024-09-12T00:54:43.969+0000 7f061d7fa640 10 monclient: dump: 2024-09-12T00:54:44.265 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:54:44.265 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:54:44.265 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:44.265 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:44.265 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:44.265 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:54:44.265 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:54:44.265 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:54:44.265 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:54:44.265 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:44.265 INFO:tasks.workunit.client.0.smithi073.stderr: -225> 2024-09-12T00:54:43.969+0000 7f073df25800 5 monclient: authenticate success, global_id 8322 2024-09-12T00:54:44.265 INFO:tasks.workunit.client.0.smithi073.stderr: -224> 2024-09-12T00:54:43.969+0000 7f073df25800 10 monclient: get_monmap_and_config success 2024-09-12T00:54:44.266 INFO:tasks.workunit.client.0.smithi073.stderr: -223> 2024-09-12T00:54:43.969+0000 7f073df25800 4 set_mon_vals no callback set 2024-09-12T00:54:44.266 INFO:tasks.workunit.client.0.smithi073.stderr: -222> 2024-09-12T00:54:43.969+0000 7f073df25800 10 monclient: shutdown 2024-09-12T00:54:44.266 INFO:tasks.workunit.client.0.smithi073.stderr: -221> 2024-09-12T00:54:43.969+0000 7f073df25800 10 monclient: build_initial_monmap 2024-09-12T00:54:44.266 INFO:tasks.workunit.client.0.smithi073.stderr: -220> 2024-09-12T00:54:43.969+0000 7f073df25800 1 build_initial for_mkfs: 0 2024-09-12T00:54:44.266 INFO:tasks.workunit.client.0.smithi073.stderr: -219> 2024-09-12T00:54:43.969+0000 7f073df25800 10 monclient: monmap: 2024-09-12T00:54:44.266 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:54:44.266 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:54:44.266 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:54:44.266 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:54:44.266 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:54:44.266 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:54:44.266 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:54:44.266 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:54:44.267 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:54:44.267 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:44.267 INFO:tasks.workunit.client.0.smithi073.stderr: -218> 2024-09-12T00:54:43.969+0000 7f073df25800 5 AuthRegistry(0x55d6bc6be960) adding auth protocol: cephx 2024-09-12T00:54:44.267 INFO:tasks.workunit.client.0.smithi073.stderr: -217> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6be960) adding auth protocol: cephx 2024-09-12T00:54:44.267 INFO:tasks.workunit.client.0.smithi073.stderr: -216> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6be960) adding auth protocol: cephx 2024-09-12T00:54:44.267 INFO:tasks.workunit.client.0.smithi073.stderr: -215> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6be960) adding con mode: secure 2024-09-12T00:54:44.267 INFO:tasks.workunit.client.0.smithi073.stderr: -214> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6be960) adding con mode: crc 2024-09-12T00:54:44.267 INFO:tasks.workunit.client.0.smithi073.stderr: -213> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6be960) adding con mode: secure 2024-09-12T00:54:44.267 INFO:tasks.workunit.client.0.smithi073.stderr: -212> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6be960) adding con mode: crc 2024-09-12T00:54:44.267 INFO:tasks.workunit.client.0.smithi073.stderr: -211> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6be960) adding con mode: secure 2024-09-12T00:54:44.267 INFO:tasks.workunit.client.0.smithi073.stderr: -210> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6be960) adding con mode: crc 2024-09-12T00:54:44.267 INFO:tasks.workunit.client.0.smithi073.stderr: -209> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6be960) adding con mode: crc 2024-09-12T00:54:44.267 INFO:tasks.workunit.client.0.smithi073.stderr: -208> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6be960) adding con mode: secure 2024-09-12T00:54:44.268 INFO:tasks.workunit.client.0.smithi073.stderr: -207> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6be960) adding con mode: crc 2024-09-12T00:54:44.268 INFO:tasks.workunit.client.0.smithi073.stderr: -206> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6be960) adding con mode: secure 2024-09-12T00:54:44.268 INFO:tasks.workunit.client.0.smithi073.stderr: -205> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6be960) adding con mode: crc 2024-09-12T00:54:44.268 INFO:tasks.workunit.client.0.smithi073.stderr: -204> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6be960) adding con mode: secure 2024-09-12T00:54:44.268 INFO:tasks.workunit.client.0.smithi073.stderr: -203> 2024-09-12T00:54:43.970+0000 7f073df25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:44.268 INFO:tasks.workunit.client.0.smithi073.stderr: -202> 2024-09-12T00:54:43.970+0000 7f073df25800 1 librados: starting msgr at 2024-09-12T00:54:44.268 INFO:tasks.workunit.client.0.smithi073.stderr: -201> 2024-09-12T00:54:43.970+0000 7f073df25800 1 librados: starting objecter 2024-09-12T00:54:44.268 INFO:tasks.workunit.client.0.smithi073.stderr: -200> 2024-09-12T00:54:43.970+0000 7f073df25800 5 asok(0x55d6bc3d5630) register_command objecter_requests cmddesc objecter_requests hook 0x55d6bc6b4ca0 EEXIST 2024-09-12T00:54:44.268 INFO:tasks.workunit.client.0.smithi073.stderr: -199> 2024-09-12T00:54:43.970+0000 7f073df25800 1 librados: setting wanted keys 2024-09-12T00:54:44.268 INFO:tasks.workunit.client.0.smithi073.stderr: -198> 2024-09-12T00:54:43.970+0000 7f073df25800 1 librados: calling monclient init 2024-09-12T00:54:44.268 INFO:tasks.workunit.client.0.smithi073.stderr: -197> 2024-09-12T00:54:43.970+0000 7f073df25800 10 monclient: init 2024-09-12T00:54:44.268 INFO:tasks.workunit.client.0.smithi073.stderr: -196> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6873e0) adding auth protocol: cephx 2024-09-12T00:54:44.268 INFO:tasks.workunit.client.0.smithi073.stderr: -195> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6873e0) adding auth protocol: cephx 2024-09-12T00:54:44.269 INFO:tasks.workunit.client.0.smithi073.stderr: -194> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6873e0) adding auth protocol: cephx 2024-09-12T00:54:44.269 INFO:tasks.workunit.client.0.smithi073.stderr: -193> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6873e0) adding con mode: secure 2024-09-12T00:54:44.269 INFO:tasks.workunit.client.0.smithi073.stderr: -192> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6873e0) adding con mode: crc 2024-09-12T00:54:44.269 INFO:tasks.workunit.client.0.smithi073.stderr: -191> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6873e0) adding con mode: secure 2024-09-12T00:54:44.269 INFO:tasks.workunit.client.0.smithi073.stderr: -190> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6873e0) adding con mode: crc 2024-09-12T00:54:44.269 INFO:tasks.workunit.client.0.smithi073.stderr: -189> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6873e0) adding con mode: secure 2024-09-12T00:54:44.269 INFO:tasks.workunit.client.0.smithi073.stderr: -188> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6873e0) adding con mode: crc 2024-09-12T00:54:44.269 INFO:tasks.workunit.client.0.smithi073.stderr: -187> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6873e0) adding con mode: crc 2024-09-12T00:54:44.269 INFO:tasks.workunit.client.0.smithi073.stderr: -186> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6873e0) adding con mode: secure 2024-09-12T00:54:44.269 INFO:tasks.workunit.client.0.smithi073.stderr: -185> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6873e0) adding con mode: crc 2024-09-12T00:54:44.269 INFO:tasks.workunit.client.0.smithi073.stderr: -184> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6873e0) adding con mode: secure 2024-09-12T00:54:44.269 INFO:tasks.workunit.client.0.smithi073.stderr: -183> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6873e0) adding con mode: crc 2024-09-12T00:54:44.269 INFO:tasks.workunit.client.0.smithi073.stderr: -182> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6873e0) adding con mode: secure 2024-09-12T00:54:44.269 INFO:tasks.workunit.client.0.smithi073.stderr: -181> 2024-09-12T00:54:43.970+0000 7f073df25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:44.270 INFO:tasks.workunit.client.0.smithi073.stderr: -180> 2024-09-12T00:54:43.970+0000 7f073df25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:44.270 INFO:tasks.workunit.client.0.smithi073.stderr: -179> 2024-09-12T00:54:43.970+0000 7f073df25800 5 asok(0x55d6bc3d5630) register_command rotate-key cmddesc rotate-key hook 0x55d6bc687528 EEXIST 2024-09-12T00:54:44.270 INFO:tasks.workunit.client.0.smithi073.stderr: -178> 2024-09-12T00:54:43.970+0000 7f073df25800 10 monclient: _reopen_session rank -1 2024-09-12T00:54:44.270 INFO:tasks.workunit.client.0.smithi073.stderr: -177> 2024-09-12T00:54:43.970+0000 7f073df25800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:54:44.270 INFO:tasks.workunit.client.0.smithi073.stderr: -176> 2024-09-12T00:54:43.970+0000 7f073df25800 10 monclient(hunting): picked mon.noname-b con 0x55d6bc6932f0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:54:44.270 INFO:tasks.workunit.client.0.smithi073.stderr: -175> 2024-09-12T00:54:43.970+0000 7f073df25800 10 monclient(hunting): picked mon.noname-c con 0x55d6bc6bda50 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:54:44.270 INFO:tasks.workunit.client.0.smithi073.stderr: -174> 2024-09-12T00:54:43.970+0000 7f073df25800 10 monclient(hunting): picked mon.noname-a con 0x55d6bc6c34b0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:54:44.270 INFO:tasks.workunit.client.0.smithi073.stderr: -173> 2024-09-12T00:54:43.970+0000 7f073df25800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:44.270 INFO:tasks.workunit.client.0.smithi073.stderr: -172> 2024-09-12T00:54:43.970+0000 7f073df25800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:44.270 INFO:tasks.workunit.client.0.smithi073.stderr: -171> 2024-09-12T00:54:43.970+0000 7f073df25800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:44.270 INFO:tasks.workunit.client.0.smithi073.stderr: -170> 2024-09-12T00:54:43.970+0000 7f073df25800 10 monclient(hunting): _renew_subs 2024-09-12T00:54:44.270 INFO:tasks.workunit.client.0.smithi073.stderr: -169> 2024-09-12T00:54:43.970+0000 7f073df25800 10 monclient(hunting): authenticate will time out at 2344.640991s 2024-09-12T00:54:44.270 INFO:tasks.workunit.client.0.smithi073.stderr: -168> 2024-09-12T00:54:43.971+0000 7f073a334640 10 monclient(hunting): get_auth_request con 0x55d6bc6c34b0 auth_method 0 2024-09-12T00:54:44.271 INFO:tasks.workunit.client.0.smithi073.stderr: -167> 2024-09-12T00:54:43.971+0000 7f073a334640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:44.271 INFO:tasks.workunit.client.0.smithi073.stderr: -166> 2024-09-12T00:54:43.971+0000 7f073a334640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:44.271 INFO:tasks.workunit.client.0.smithi073.stderr: -165> 2024-09-12T00:54:43.971+0000 7f073a334640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:44.271 INFO:tasks.workunit.client.0.smithi073.stderr: -164> 2024-09-12T00:54:43.971+0000 7f0739332640 10 monclient(hunting): get_auth_request con 0x55d6bc6bda50 auth_method 0 2024-09-12T00:54:44.271 INFO:tasks.workunit.client.0.smithi073.stderr: -163> 2024-09-12T00:54:43.971+0000 7f0739332640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:44.271 INFO:tasks.workunit.client.0.smithi073.stderr: -162> 2024-09-12T00:54:43.971+0000 7f0739332640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:44.271 INFO:tasks.workunit.client.0.smithi073.stderr: -161> 2024-09-12T00:54:43.971+0000 7f0739332640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:44.271 INFO:tasks.workunit.client.0.smithi073.stderr: -160> 2024-09-12T00:54:43.971+0000 7f0739b33640 10 monclient(hunting): get_auth_request con 0x55d6bc6932f0 auth_method 0 2024-09-12T00:54:44.271 INFO:tasks.workunit.client.0.smithi073.stderr: -159> 2024-09-12T00:54:43.971+0000 7f0739b33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:44.271 INFO:tasks.workunit.client.0.smithi073.stderr: -158> 2024-09-12T00:54:43.971+0000 7f0739b33640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:44.271 INFO:tasks.workunit.client.0.smithi073.stderr: -157> 2024-09-12T00:54:43.971+0000 7f0739b33640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:44.271 INFO:tasks.workunit.client.0.smithi073.stderr: -156> 2024-09-12T00:54:43.971+0000 7f073a334640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:44.271 INFO:tasks.workunit.client.0.smithi073.stderr: -155> 2024-09-12T00:54:43.971+0000 7f073a334640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:44.271 INFO:tasks.workunit.client.0.smithi073.stderr: -154> 2024-09-12T00:54:43.971+0000 7f073a334640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:44.272 INFO:tasks.workunit.client.0.smithi073.stderr: -153> 2024-09-12T00:54:43.971+0000 7f0739332640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:44.272 INFO:tasks.workunit.client.0.smithi073.stderr: -152> 2024-09-12T00:54:43.971+0000 7f0739332640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:44.272 INFO:tasks.workunit.client.0.smithi073.stderr: -151> 2024-09-12T00:54:43.971+0000 7f0739332640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:44.272 INFO:tasks.workunit.client.0.smithi073.stderr: -150> 2024-09-12T00:54:43.971+0000 7f0739b33640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:44.272 INFO:tasks.workunit.client.0.smithi073.stderr: -149> 2024-09-12T00:54:43.971+0000 7f0739b33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:44.272 INFO:tasks.workunit.client.0.smithi073.stderr: -148> 2024-09-12T00:54:43.971+0000 7f0739b33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:44.272 INFO:tasks.workunit.client.0.smithi073.stderr: -147> 2024-09-12T00:54:43.971+0000 7f073a334640 10 monclient(hunting): handle_auth_done global_id 8325 payload 824 2024-09-12T00:54:44.272 INFO:tasks.workunit.client.0.smithi073.stderr: -146> 2024-09-12T00:54:43.971+0000 7f073a334640 10 monclient: _finish_hunting 0 2024-09-12T00:54:44.272 INFO:tasks.workunit.client.0.smithi073.stderr: -145> 2024-09-12T00:54:43.971+0000 7f073a334640 1 monclient: found mon.noname-a 2024-09-12T00:54:44.272 INFO:tasks.workunit.client.0.smithi073.stderr: -144> 2024-09-12T00:54:43.971+0000 7f073a334640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:54:44.272 INFO:tasks.workunit.client.0.smithi073.stderr: -143> 2024-09-12T00:54:43.971+0000 7f060b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:44.272 INFO:tasks.workunit.client.0.smithi073.stderr: -142> 2024-09-12T00:54:43.971+0000 7f060b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:54:44.272 INFO:tasks.workunit.client.0.smithi073.stderr: -141> 2024-09-12T00:54:43.971+0000 7f060b7fe640 10 monclient: dump: 2024-09-12T00:54:44.273 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:54:44.273 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:54:44.273 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:44.273 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:44.273 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:44.273 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:54:44.273 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:54:44.273 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:54:44.273 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:54:44.273 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:44.273 INFO:tasks.workunit.client.0.smithi073.stderr: -140> 2024-09-12T00:54:43.971+0000 7f060b7fe640 10 monclient: _finish_auth 0 2024-09-12T00:54:44.273 INFO:tasks.workunit.client.0.smithi073.stderr: -139> 2024-09-12T00:54:43.971+0000 7f060b7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:54:44.273 INFO:tasks.workunit.client.0.smithi073.stderr: -138> 2024-09-12T00:54:43.971+0000 7f060b7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:44.273 INFO:tasks.workunit.client.0.smithi073.stderr: -137> 2024-09-12T00:54:43.971+0000 7f060b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:44.274 INFO:tasks.workunit.client.0.smithi073.stderr: -136> 2024-09-12T00:54:43.971+0000 7f060b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:54:44.274 INFO:tasks.workunit.client.0.smithi073.stderr: -135> 2024-09-12T00:54:43.971+0000 7f060b7fe640 10 monclient: dump: 2024-09-12T00:54:44.274 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:54:44.274 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:54:44.274 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:44.274 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:44.274 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:44.274 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:54:44.274 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:54:44.274 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:54:44.274 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:54:44.274 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:44.274 INFO:tasks.workunit.client.0.smithi073.stderr: -134> 2024-09-12T00:54:43.971+0000 7f073df25800 5 monclient: authenticate success, global_id 8325 2024-09-12T00:54:44.274 INFO:tasks.workunit.client.0.smithi073.stderr: -133> 2024-09-12T00:54:43.971+0000 7f073df25800 10 monclient: _renew_subs 2024-09-12T00:54:44.275 INFO:tasks.workunit.client.0.smithi073.stderr: -132> 2024-09-12T00:54:43.971+0000 7f061d7fa640 4 set_mon_vals no callback set 2024-09-12T00:54:44.275 INFO:tasks.workunit.client.0.smithi073.stderr: -131> 2024-09-12T00:54:43.971+0000 7f073df25800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:54:44.275 INFO:tasks.workunit.client.0.smithi073.stderr: -130> 2024-09-12T00:54:43.971+0000 7f073df25800 10 monclient: _renew_subs 2024-09-12T00:54:44.275 INFO:tasks.workunit.client.0.smithi073.stderr: -129> 2024-09-12T00:54:43.971+0000 7f073df25800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:54:44.275 INFO:tasks.workunit.client.0.smithi073.stderr: -128> 2024-09-12T00:54:43.971+0000 7f073df25800 1 librados: init done 2024-09-12T00:54:44.275 INFO:tasks.workunit.client.0.smithi073.stderr: -127> 2024-09-12T00:54:43.971+0000 7f073df25800 5 asok(0x55d6bc3d5630) register_command cr dump hook 0x55d6bc6c11b8 2024-09-12T00:54:44.275 INFO:tasks.workunit.client.0.smithi073.stderr: -126> 2024-09-12T00:54:43.973+0000 7f073df25800 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.275 INFO:tasks.workunit.client.0.smithi073.stderr: -125> 2024-09-12T00:54:43.974+0000 7f060b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:54:44.275 INFO:tasks.workunit.client.0.smithi073.stderr: -124> 2024-09-12T00:54:43.974+0000 7f060b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:54:44.275 INFO:tasks.workunit.client.0.smithi073.stderr: -123> 2024-09-12T00:54:43.974+0000 7f060b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:54:44.275 INFO:tasks.workunit.client.0.smithi073.stderr: -122> 2024-09-12T00:54:43.974+0000 7f0739b33640 10 monclient: get_auth_request con 0x7f0604076470 auth_method 0 2024-09-12T00:54:44.275 INFO:tasks.workunit.client.0.smithi073.stderr: -121> 2024-09-12T00:54:43.974+0000 7f0739332640 10 monclient: get_auth_request con 0x55d6bc6dd570 auth_method 0 2024-09-12T00:54:44.275 INFO:tasks.workunit.client.0.smithi073.stderr: -120> 2024-09-12T00:54:43.975+0000 7f073df25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:44.276 INFO:tasks.workunit.client.0.smithi073.stderr: -119> 2024-09-12T00:54:43.975+0000 7f073df25800 20 realm 2024-09-12T00:54:44.276 INFO:tasks.workunit.client.0.smithi073.stderr: -118> 2024-09-12T00:54:43.975+0000 7f073df25800 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.276 INFO:tasks.workunit.client.0.smithi073.stderr: -117> 2024-09-12T00:54:43.975+0000 7f073df25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:44.276 INFO:tasks.workunit.client.0.smithi073.stderr: -116> 2024-09-12T00:54:43.975+0000 7f073df25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:44.276 INFO:tasks.workunit.client.0.smithi073.stderr: -115> 2024-09-12T00:54:43.975+0000 7f073df25800 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.276 INFO:tasks.workunit.client.0.smithi073.stderr: -114> 2024-09-12T00:54:43.975+0000 7f073df25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:44.276 INFO:tasks.workunit.client.0.smithi073.stderr: -113> 2024-09-12T00:54:43.975+0000 7f073df25800 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.276 INFO:tasks.workunit.client.0.smithi073.stderr: -112> 2024-09-12T00:54:43.975+0000 7f0739b33640 10 monclient: get_auth_request con 0x55d6bc6e17d0 auth_method 0 2024-09-12T00:54:44.276 INFO:tasks.workunit.client.0.smithi073.stderr: -111> 2024-09-12T00:54:43.976+0000 7f073df25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:44.276 INFO:tasks.workunit.client.0.smithi073.stderr: -110> 2024-09-12T00:54:43.976+0000 7f073df25800 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.276 INFO:tasks.workunit.client.0.smithi073.stderr: -109> 2024-09-12T00:54:43.976+0000 7f0739332640 10 monclient: get_auth_request con 0x55d6bc6e5030 auth_method 0 2024-09-12T00:54:44.276 INFO:tasks.workunit.client.0.smithi073.stderr: -108> 2024-09-12T00:54:43.977+0000 7f073df25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:44.276 INFO:tasks.workunit.client.0.smithi073.stderr: -107> 2024-09-12T00:54:43.977+0000 7f073df25800 20 searching for the correct realm 2024-09-12T00:54:44.277 INFO:tasks.workunit.client.0.smithi073.stderr: -106> 2024-09-12T00:54:43.977+0000 7f073a334640 10 monclient: get_auth_request con 0x55d6bc6e9d80 auth_method 0 2024-09-12T00:54:44.277 INFO:tasks.workunit.client.0.smithi073.stderr: -105> 2024-09-12T00:54:43.978+0000 7f0739b33640 10 monclient: get_auth_request con 0x7f0734081070 auth_method 0 2024-09-12T00:54:44.277 INFO:tasks.workunit.client.0.smithi073.stderr: -104> 2024-09-12T00:54:43.978+0000 7f0739b33640 0 -- 172.21.15.73:0/2445320828 >> [v2:172.21.15.117:6816/1460498570,v1:172.21.15.117:6817/1460498570] conn(0x7f0734081070 msgr2=0x7f07340a7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:44.277 INFO:tasks.workunit.client.0.smithi073.stderr: -103> 2024-09-12T00:54:44.179+0000 7f0739b33640 10 monclient: get_auth_request con 0x7f0734081070 auth_method 0 2024-09-12T00:54:44.277 INFO:tasks.workunit.client.0.smithi073.stderr: -102> 2024-09-12T00:54:44.180+0000 7f0739332640 10 monclient: get_auth_request con 0x7f072c05a040 auth_method 0 2024-09-12T00:54:44.277 INFO:tasks.workunit.client.0.smithi073.stderr: -101> 2024-09-12T00:54:44.181+0000 7f073a334640 10 monclient: get_auth_request con 0x7f073002b060 auth_method 0 2024-09-12T00:54:44.277 INFO:tasks.workunit.client.0.smithi073.stderr: -100> 2024-09-12T00:54:44.184+0000 7f0739332640 0 -- 172.21.15.73:0/2445320828 >> [v2:172.21.15.73:6826/269690776,v1:172.21.15.73:6827/269690776] conn(0x7f072c05a040 msgr2=0x7f072c030400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:44.277 INFO:tasks.workunit.client.0.smithi073.stderr: -99> 2024-09-12T00:54:44.184+0000 7f060b7fe640 1 client.8325.objecter ms_handle_reset 0x7f072c05a040 session 0x7f072c045040 osd.2 2024-09-12T00:54:44.277 INFO:tasks.workunit.client.0.smithi073.stderr: -98> 2024-09-12T00:54:44.184+0000 7f060b7fe640 10 monclient: _renew_subs 2024-09-12T00:54:44.277 INFO:tasks.workunit.client.0.smithi073.stderr: -97> 2024-09-12T00:54:44.184+0000 7f060b7fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:54:44.277 INFO:tasks.workunit.client.0.smithi073.stderr: -96> 2024-09-12T00:54:44.184+0000 7f0739332640 10 monclient: get_auth_request con 0x7f0604086310 auth_method 0 2024-09-12T00:54:44.277 INFO:tasks.workunit.client.0.smithi073.stderr: -95> 2024-09-12T00:54:44.185+0000 7f0739b33640 10 monclient: get_auth_request con 0x7f0734065040 auth_method 0 2024-09-12T00:54:44.277 INFO:tasks.workunit.client.0.smithi073.stderr: -94> 2024-09-12T00:54:44.190+0000 7f073df25800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:54:44.278 INFO:tasks.workunit.client.0.smithi073.stderr: -93> 2024-09-12T00:54:44.190+0000 7f073df25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:44.278 INFO:tasks.workunit.client.0.smithi073.stderr: -92> 2024-09-12T00:54:44.190+0000 7f073df25800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:54:44.278 INFO:tasks.workunit.client.0.smithi073.stderr: -91> 2024-09-12T00:54:44.190+0000 7f073df25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:44.278 INFO:tasks.workunit.client.0.smithi073.stderr: -90> 2024-09-12T00:54:44.190+0000 7f073df25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:44.278 INFO:tasks.workunit.client.0.smithi073.stderr: -89> 2024-09-12T00:54:44.190+0000 7f073df25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:44.278 INFO:tasks.workunit.client.0.smithi073.stderr: -88> 2024-09-12T00:54:44.190+0000 7f073df25800 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.278 INFO:tasks.workunit.client.0.smithi073.stderr: -87> 2024-09-12T00:54:44.190+0000 7f073df25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:44.278 INFO:tasks.workunit.client.0.smithi073.stderr: -86> 2024-09-12T00:54:44.190+0000 7f073df25800 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.278 INFO:tasks.workunit.client.0.smithi073.stderr: -85> 2024-09-12T00:54:44.191+0000 7f073df25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:44.278 INFO:tasks.workunit.client.0.smithi073.stderr: -84> 2024-09-12T00:54:44.191+0000 7f073df25800 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.279 INFO:tasks.workunit.client.0.smithi073.stderr: -83> 2024-09-12T00:54:44.191+0000 7f073df25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:44.279 INFO:tasks.workunit.client.0.smithi073.stderr: -82> 2024-09-12T00:54:44.191+0000 7f073df25800 20 zone default found 2024-09-12T00:54:44.279 INFO:tasks.workunit.client.0.smithi073.stderr: -81> 2024-09-12T00:54:44.191+0000 7f073df25800 4 Realm: () 2024-09-12T00:54:44.279 INFO:tasks.workunit.client.0.smithi073.stderr: -80> 2024-09-12T00:54:44.191+0000 7f073df25800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:54:44.279 INFO:tasks.workunit.client.0.smithi073.stderr: -79> 2024-09-12T00:54:44.191+0000 7f073df25800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:54:44.279 INFO:tasks.workunit.client.0.smithi073.stderr: -78> 2024-09-12T00:54:44.191+0000 7f073df25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:44.279 INFO:tasks.workunit.client.0.smithi073.stderr: -77> 2024-09-12T00:54:44.191+0000 7f073df25800 20 zonegroup default 2024-09-12T00:54:44.279 INFO:tasks.workunit.client.0.smithi073.stderr: -76> 2024-09-12T00:54:44.191+0000 7f073df25800 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.279 INFO:tasks.workunit.client.0.smithi073.stderr: -75> 2024-09-12T00:54:44.191+0000 7f073df25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:44.279 INFO:tasks.workunit.client.0.smithi073.stderr: -74> 2024-09-12T00:54:44.191+0000 7f073df25800 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.279 INFO:tasks.workunit.client.0.smithi073.stderr: -73> 2024-09-12T00:54:44.192+0000 7f073df25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:44.279 INFO:tasks.workunit.client.0.smithi073.stderr: -72> 2024-09-12T00:54:44.192+0000 7f073df25800 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.279 INFO:tasks.workunit.client.0.smithi073.stderr: -71> 2024-09-12T00:54:44.192+0000 7f073df25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:44.279 INFO:tasks.workunit.client.0.smithi073.stderr: -70> 2024-09-12T00:54:44.192+0000 7f073df25800 20 started sync module instance, tier type = 2024-09-12T00:54:44.280 INFO:tasks.workunit.client.0.smithi073.stderr: -69> 2024-09-12T00:54:44.192+0000 7f073df25800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:54:44.280 INFO:tasks.workunit.client.0.smithi073.stderr: -68> 2024-09-12T00:54:44.202+0000 7f073df25800 20 add_watcher() i=0 2024-09-12T00:54:44.280 INFO:tasks.workunit.client.0.smithi073.stderr: -67> 2024-09-12T00:54:44.202+0000 7f073df25800 20 add_watcher() i=1 2024-09-12T00:54:44.280 INFO:tasks.workunit.client.0.smithi073.stderr: -66> 2024-09-12T00:54:44.202+0000 7f073df25800 20 add_watcher() i=2 2024-09-12T00:54:44.280 INFO:tasks.workunit.client.0.smithi073.stderr: -65> 2024-09-12T00:54:44.202+0000 7f073df25800 20 add_watcher() i=3 2024-09-12T00:54:44.280 INFO:tasks.workunit.client.0.smithi073.stderr: -64> 2024-09-12T00:54:44.202+0000 7f073df25800 20 add_watcher() i=4 2024-09-12T00:54:44.280 INFO:tasks.workunit.client.0.smithi073.stderr: -63> 2024-09-12T00:54:44.202+0000 7f073df25800 20 add_watcher() i=5 2024-09-12T00:54:44.280 INFO:tasks.workunit.client.0.smithi073.stderr: -62> 2024-09-12T00:54:44.202+0000 7f073df25800 20 add_watcher() i=6 2024-09-12T00:54:44.280 INFO:tasks.workunit.client.0.smithi073.stderr: -61> 2024-09-12T00:54:44.203+0000 7f073df25800 20 add_watcher() i=7 2024-09-12T00:54:44.280 INFO:tasks.workunit.client.0.smithi073.stderr: -60> 2024-09-12T00:54:44.203+0000 7f073df25800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:44.280 INFO:tasks.workunit.client.0.smithi073.stderr: -59> 2024-09-12T00:54:44.204+0000 7f073df25800 5 AuthRegistry(0x7ffef781c250) adding auth protocol: cephx 2024-09-12T00:54:44.280 INFO:tasks.workunit.client.0.smithi073.stderr: -58> 2024-09-12T00:54:44.204+0000 7f073df25800 5 AuthRegistry(0x7ffef781c250) adding auth protocol: cephx 2024-09-12T00:54:44.281 INFO:tasks.workunit.client.0.smithi073.stderr: -57> 2024-09-12T00:54:44.204+0000 7f073df25800 5 AuthRegistry(0x7ffef781c250) adding auth protocol: cephx 2024-09-12T00:54:44.281 INFO:tasks.workunit.client.0.smithi073.stderr: -56> 2024-09-12T00:54:44.204+0000 7f073df25800 5 AuthRegistry(0x7ffef781c250) adding con mode: secure 2024-09-12T00:54:44.281 INFO:tasks.workunit.client.0.smithi073.stderr: -55> 2024-09-12T00:54:44.204+0000 7f073df25800 5 AuthRegistry(0x7ffef781c250) adding con mode: crc 2024-09-12T00:54:44.281 INFO:tasks.workunit.client.0.smithi073.stderr: -54> 2024-09-12T00:54:44.204+0000 7f073df25800 5 AuthRegistry(0x7ffef781c250) adding con mode: secure 2024-09-12T00:54:44.281 INFO:tasks.workunit.client.0.smithi073.stderr: -53> 2024-09-12T00:54:44.204+0000 7f073df25800 5 AuthRegistry(0x7ffef781c250) adding con mode: crc 2024-09-12T00:54:44.281 INFO:tasks.workunit.client.0.smithi073.stderr: -52> 2024-09-12T00:54:44.204+0000 7f073df25800 5 AuthRegistry(0x7ffef781c250) adding con mode: secure 2024-09-12T00:54:44.281 INFO:tasks.workunit.client.0.smithi073.stderr: -51> 2024-09-12T00:54:44.204+0000 7f073df25800 5 AuthRegistry(0x7ffef781c250) adding con mode: crc 2024-09-12T00:54:44.281 INFO:tasks.workunit.client.0.smithi073.stderr: -50> 2024-09-12T00:54:44.204+0000 7f073df25800 5 AuthRegistry(0x7ffef781c250) adding con mode: crc 2024-09-12T00:54:44.281 INFO:tasks.workunit.client.0.smithi073.stderr: -49> 2024-09-12T00:54:44.204+0000 7f073df25800 5 AuthRegistry(0x7ffef781c250) adding con mode: secure 2024-09-12T00:54:44.281 INFO:tasks.workunit.client.0.smithi073.stderr: -48> 2024-09-12T00:54:44.204+0000 7f073df25800 5 AuthRegistry(0x7ffef781c250) adding con mode: crc 2024-09-12T00:54:44.281 INFO:tasks.workunit.client.0.smithi073.stderr: -47> 2024-09-12T00:54:44.204+0000 7f073df25800 5 AuthRegistry(0x7ffef781c250) adding con mode: secure 2024-09-12T00:54:44.281 INFO:tasks.workunit.client.0.smithi073.stderr: -46> 2024-09-12T00:54:44.204+0000 7f05eb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:44.281 INFO:tasks.workunit.client.0.smithi073.stderr: -45> 2024-09-12T00:54:44.204+0000 7f073df25800 5 AuthRegistry(0x7ffef781c250) adding con mode: crc 2024-09-12T00:54:44.281 INFO:tasks.workunit.client.0.smithi073.stderr: -44> 2024-09-12T00:54:44.204+0000 7f073df25800 5 AuthRegistry(0x7ffef781c250) adding con mode: secure 2024-09-12T00:54:44.282 INFO:tasks.workunit.client.0.smithi073.stderr: -43> 2024-09-12T00:54:44.205+0000 7f073df25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:44.282 INFO:tasks.workunit.client.0.smithi073.stderr: -42> 2024-09-12T00:54:44.205+0000 7f073df25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:44.282 INFO:tasks.workunit.client.0.smithi073.stderr: -41> 2024-09-12T00:54:44.205+0000 7f073df25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:44.282 INFO:tasks.workunit.client.0.smithi073.stderr: -40> 2024-09-12T00:54:44.205+0000 7f073df25800 5 asok(0x55d6bc3d5630) register_command cache list hook 0x55d6bc6b9a40 2024-09-12T00:54:44.282 INFO:tasks.workunit.client.0.smithi073.stderr: -39> 2024-09-12T00:54:44.205+0000 7f073df25800 5 asok(0x55d6bc3d5630) register_command cache inspect hook 0x55d6bc6b9a40 2024-09-12T00:54:44.282 INFO:tasks.workunit.client.0.smithi073.stderr: -38> 2024-09-12T00:54:44.205+0000 7f073df25800 5 asok(0x55d6bc3d5630) register_command cache erase hook 0x55d6bc6b9a40 2024-09-12T00:54:44.282 INFO:tasks.workunit.client.0.smithi073.stderr: -37> 2024-09-12T00:54:44.205+0000 7f073df25800 5 asok(0x55d6bc3d5630) register_command cache zap hook 0x55d6bc6b9a40 2024-09-12T00:54:44.282 INFO:tasks.workunit.client.0.smithi073.stderr: -36> 2024-09-12T00:54:44.205+0000 7f073df25800 5 note: GC not initialized 2024-09-12T00:54:44.282 INFO:tasks.workunit.client.0.smithi073.stderr: -35> 2024-09-12T00:54:44.205+0000 7f05ea7fc640 20 reqs_thread_entry: start 2024-09-12T00:54:44.282 INFO:tasks.workunit.client.0.smithi073.stderr: -34> 2024-09-12T00:54:44.205+0000 7f073df25800 5 asok(0x55d6bc3d5630) register_command sync trace show hook 0x7f0734068040 2024-09-12T00:54:44.282 INFO:tasks.workunit.client.0.smithi073.stderr: -33> 2024-09-12T00:54:44.205+0000 7f073df25800 5 asok(0x55d6bc3d5630) register_command sync trace history hook 0x7f0734068040 2024-09-12T00:54:44.282 INFO:tasks.workunit.client.0.smithi073.stderr: -32> 2024-09-12T00:54:44.205+0000 7f073df25800 5 asok(0x55d6bc3d5630) register_command sync trace active hook 0x7f0734068040 2024-09-12T00:54:44.282 INFO:tasks.workunit.client.0.smithi073.stderr: -31> 2024-09-12T00:54:44.205+0000 7f073df25800 5 asok(0x55d6bc3d5630) register_command sync trace active_short hook 0x7f0734068040 2024-09-12T00:54:44.282 INFO:tasks.workunit.client.0.smithi073.stderr: -30> 2024-09-12T00:54:44.205+0000 7f073df25800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:44.283 INFO:tasks.workunit.client.0.smithi073.stderr: -29> 2024-09-12T00:54:44.205+0000 7f073df25800 20 Filter name: none 2024-09-12T00:54:44.283 INFO:tasks.workunit.client.0.smithi073.stderr: -28> 2024-09-12T00:54:44.205+0000 7f055ffff640 20 reqs_thread_entry: start 2024-09-12T00:54:44.283 INFO:tasks.workunit.client.0.smithi073.stderr: -27> 2024-09-12T00:54:44.205+0000 7f073df25800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:54:44.283 INFO:tasks.workunit.client.0.smithi073.stderr: -26> 2024-09-12T00:54:44.205+0000 7f073df25800 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.283 INFO:tasks.workunit.client.0.smithi073.stderr: -25> 2024-09-12T00:54:44.206+0000 7f073df25800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:54:44.283 INFO:tasks.workunit.client.0.smithi073.stderr: -24> 2024-09-12T00:54:44.206+0000 7f073df25800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:54:44.283 INFO:tasks.workunit.client.0.smithi073.stderr: -23> 2024-09-12T00:54:44.206+0000 7f073df25800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:54:44.283 INFO:tasks.workunit.client.0.smithi073.stderr: -22> 2024-09-12T00:54:44.206+0000 7f073df25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 : miss 2024-09-12T00:54:44.283 INFO:tasks.workunit.client.0.smithi073.stderr: -21> 2024-09-12T00:54:44.206+0000 7f073df25800 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.283 INFO:tasks.workunit.client.0.smithi073.stderr: -20> 2024-09-12T00:54:44.206+0000 7f073df25800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:54:44.283 INFO:tasks.workunit.client.0.smithi073.stderr: -19> 2024-09-12T00:54:44.206+0000 7f073df25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:54:44.283 INFO:tasks.workunit.client.0.smithi073.stderr: -18> 2024-09-12T00:54:44.206+0000 7f073df25800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:54:44.284 INFO:tasks.workunit.client.0.smithi073.stderr: -17> 2024-09-12T00:54:44.206+0000 7f073df25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:54:44.284 INFO:tasks.workunit.client.0.smithi073.stderr: -16> 2024-09-12T00:54:44.206+0000 7f073df25800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:54:44.284 INFO:tasks.workunit.client.0.smithi073.stderr: -15> 2024-09-12T00:54:44.206+0000 7f073df25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 2024-09-12T00:54:44.284 INFO:tasks.workunit.client.0.smithi073.stderr: -14> 2024-09-12T00:54:44.207+0000 7f073df25800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:54:44.284 INFO:tasks.workunit.client.0.smithi073.stderr: -13> 2024-09-12T00:54:44.212+0000 7f073df25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:54:44.284 INFO:tasks.workunit.client.0.smithi073.stderr: -12> 2024-09-12T00:54:44.212+0000 7f073df25800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:54:44.284 INFO:tasks.workunit.client.0.smithi073.stderr: -11> 2024-09-12T00:54:44.212+0000 7f073df25800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:54:44.284 INFO:tasks.workunit.client.0.smithi073.stderr: -10> 2024-09-12T00:54:44.212+0000 7f073df25800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17, ofs0, ns] 2024-09-12T00:54:44.284 INFO:tasks.workunit.client.0.smithi073.stderr: -9> 2024-09-12T00:54:44.212+0000 7f061d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497047 cookie 94380772763360 notifier 8325 bl.length()=827 2024-09-12T00:54:44.284 INFO:tasks.workunit.client.0.smithi073.stderr: -8> 2024-09-12T00:54:44.212+0000 7f061d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:54:44.284 INFO:tasks.workunit.client.0.smithi073.stderr: -7> 2024-09-12T00:54:44.212+0000 7f061d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:54:44.284 INFO:tasks.workunit.client.0.smithi073.stderr: -6> 2024-09-12T00:54:44.212+0000 7f061d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:54:44.284 INFO:tasks.workunit.client.0.smithi073.stderr: -5> 2024-09-12T00:54:44.214+0000 7f073df25800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): orig_sources= new_sources= 2024-09-12T00:54:44.284 INFO:tasks.workunit.client.0.smithi073.stderr: -4> 2024-09-12T00:54:44.214+0000 7f073df25800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): potential sources added=[] removed=[] 2024-09-12T00:54:44.285 INFO:tasks.workunit.client.0.smithi073.stderr: -3> 2024-09-12T00:54:44.214+0000 7f073df25800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): orig_dests= new_dests= 2024-09-12T00:54:44.285 INFO:tasks.workunit.client.0.smithi073.stderr: -2> 2024-09-12T00:54:44.214+0000 7f073df25800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): potential dests added=[] removed=[] 2024-09-12T00:54:44.285 INFO:tasks.workunit.client.0.smithi073.stderr: -1> 2024-09-12T00:54:44.217+0000 7f073df25800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f073df25800 time 2024-09-12T00:54:44.217611+0000 2024-09-12T00:54:44.285 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:54:44.285 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:44.285 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:44.285 INFO:tasks.workunit.client.0.smithi073.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f073f58c71a] 2024-09-12T00:54:44.285 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f073f58c8d8] 2024-09-12T00:54:44.285 INFO:tasks.workunit.client.0.smithi073.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d6bb761641] 2024-09-12T00:54:44.285 INFO:tasks.workunit.client.0.smithi073.stderr: 4: radosgw-admin(+0xd8854c) [0x55d6bbc7454c] 2024-09-12T00:54:44.285 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d6bb77131d] 2024-09-12T00:54:44.285 INFO:tasks.workunit.client.0.smithi073.stderr: 6: main() 2024-09-12T00:54:44.286 INFO:tasks.workunit.client.0.smithi073.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f073e229590] 2024-09-12T00:54:44.286 INFO:tasks.workunit.client.0.smithi073.stderr: 8: __libc_start_main() 2024-09-12T00:54:44.286 INFO:tasks.workunit.client.0.smithi073.stderr: 9: _start() 2024-09-12T00:54:44.286 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:44.286 INFO:tasks.workunit.client.0.smithi073.stderr: 0> 2024-09-12T00:54:44.218+0000 7f073df25800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:54:44.286 INFO:tasks.workunit.client.0.smithi073.stderr: in thread 7f073df25800 thread_name:radosgw-admin 2024-09-12T00:54:44.286 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:44.286 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:44.286 INFO:tasks.workunit.client.0.smithi073.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f073e23e6f0] 2024-09-12T00:54:44.286 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f073e28b99c] 2024-09-12T00:54:44.286 INFO:tasks.workunit.client.0.smithi073.stderr: 3: raise() 2024-09-12T00:54:44.286 INFO:tasks.workunit.client.0.smithi073.stderr: 4: abort() 2024-09-12T00:54:44.286 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f073f58c774] 2024-09-12T00:54:44.286 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f073f58c8d8] 2024-09-12T00:54:44.287 INFO:tasks.workunit.client.0.smithi073.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d6bb761641] 2024-09-12T00:54:44.287 INFO:tasks.workunit.client.0.smithi073.stderr: 8: radosgw-admin(+0xd8854c) [0x55d6bbc7454c] 2024-09-12T00:54:44.287 INFO:tasks.workunit.client.0.smithi073.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d6bb77131d] 2024-09-12T00:54:44.287 INFO:tasks.workunit.client.0.smithi073.stderr: 10: main() 2024-09-12T00:54:44.287 INFO:tasks.workunit.client.0.smithi073.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f073e229590] 2024-09-12T00:54:44.287 INFO:tasks.workunit.client.0.smithi073.stderr: 12: __libc_start_main() 2024-09-12T00:54:44.287 INFO:tasks.workunit.client.0.smithi073.stderr: 13: _start() 2024-09-12T00:54:44.287 INFO:tasks.workunit.client.0.smithi073.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:54:44.287 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:44.287 INFO:tasks.workunit.client.0.smithi073.stderr:--- logging levels --- 2024-09-12T00:54:44.287 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 none 2024-09-12T00:54:44.287 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 lockdep 2024-09-12T00:54:44.287 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 context 2024-09-12T00:54:44.288 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 crush 2024-09-12T00:54:44.288 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds 2024-09-12T00:54:44.288 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_balancer 2024-09-12T00:54:44.288 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_locker 2024-09-12T00:54:44.288 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_log 2024-09-12T00:54:44.288 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_log_expire 2024-09-12T00:54:44.288 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_migrator 2024-09-12T00:54:44.288 INFO:tasks.workunit.client.0.smithi073.stderr: 3/ 5 mds_quiesce 2024-09-12T00:54:44.288 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 buffer 2024-09-12T00:54:44.288 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 timer 2024-09-12T00:54:44.289 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 filer 2024-09-12T00:54:44.289 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 striper 2024-09-12T00:54:44.289 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 objecter 2024-09-12T00:54:44.289 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rados 2024-09-12T00:54:44.289 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd 2024-09-12T00:54:44.289 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_mirror 2024-09-12T00:54:44.289 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_replay 2024-09-12T00:54:44.289 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_pwl 2024-09-12T00:54:44.289 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 journaler 2024-09-12T00:54:44.289 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 objectcacher 2024-09-12T00:54:44.289 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:54:44.289 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 client 2024-09-12T00:54:44.289 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 osd 2024-09-12T00:54:44.289 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 optracker 2024-09-12T00:54:44.290 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 objclass 2024-09-12T00:54:44.290 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 filestore 2024-09-12T00:54:44.290 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 journal 2024-09-12T00:54:44.290 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 0 ms 2024-09-12T00:54:44.290 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mon 2024-09-12T00:54:44.290 INFO:tasks.workunit.client.0.smithi073.stderr: 0/10 monc 2024-09-12T00:54:44.290 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 paxos 2024-09-12T00:54:44.290 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 tp 2024-09-12T00:54:44.290 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 auth 2024-09-12T00:54:44.290 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 crypto 2024-09-12T00:54:44.290 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 finisher 2024-09-12T00:54:44.290 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 reserver 2024-09-12T00:54:44.290 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 heartbeatmap 2024-09-12T00:54:44.291 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 perfcounter 2024-09-12T00:54:44.291 INFO:tasks.workunit.client.0.smithi073.stderr: 20/20 rgw 2024-09-12T00:54:44.291 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_sync 2024-09-12T00:54:44.291 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_datacache 2024-09-12T00:54:44.291 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_access 2024-09-12T00:54:44.291 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:54:44.291 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_flight 2024-09-12T00:54:44.291 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:54:44.291 INFO:tasks.workunit.client.0.smithi073.stderr: 20/20 rgw_notification 2024-09-12T00:54:44.291 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 javaclient 2024-09-12T00:54:44.291 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 asok 2024-09-12T00:54:44.291 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 throttle 2024-09-12T00:54:44.291 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 0 refs 2024-09-12T00:54:44.291 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 compressor 2024-09-12T00:54:44.292 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 bluestore 2024-09-12T00:54:44.292 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 bluefs 2024-09-12T00:54:44.292 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 bdev 2024-09-12T00:54:44.292 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 kstore 2024-09-12T00:54:44.292 INFO:tasks.workunit.client.0.smithi073.stderr: 4/ 5 rocksdb 2024-09-12T00:54:44.292 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 fuse 2024-09-12T00:54:44.292 INFO:tasks.workunit.client.0.smithi073.stderr: 2/ 5 mgr 2024-09-12T00:54:44.292 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mgrc 2024-09-12T00:54:44.292 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 dpdk 2024-09-12T00:54:44.292 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 eventtrace 2024-09-12T00:54:44.292 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 prioritycache 2024-09-12T00:54:44.292 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 test 2024-09-12T00:54:44.292 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:54:44.292 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cephsqlite 2024-09-12T00:54:44.293 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:54:44.293 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore 2024-09-12T00:54:44.293 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_onode 2024-09-12T00:54:44.293 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_odata 2024-09-12T00:54:44.293 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_omap 2024-09-12T00:54:44.293 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_tm 2024-09-12T00:54:44.293 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_t 2024-09-12T00:54:44.293 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:54:44.293 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_epm 2024-09-12T00:54:44.293 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_lba 2024-09-12T00:54:44.293 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:54:44.293 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_cache 2024-09-12T00:54:44.293 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_journal 2024-09-12T00:54:44.294 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_device 2024-09-12T00:54:44.294 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_backref 2024-09-12T00:54:44.294 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 alienstore 2024-09-12T00:54:44.294 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mclock 2024-09-12T00:54:44.294 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cyanstore 2024-09-12T00:54:44.294 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 ceph_exporter 2024-09-12T00:54:44.294 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 memstore 2024-09-12T00:54:44.294 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 trace 2024-09-12T00:54:44.294 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 ceph_dedup 2024-09-12T00:54:44.294 INFO:tasks.workunit.client.0.smithi073.stderr: -2/-2 (syslog threshold) 2024-09-12T00:54:44.294 INFO:tasks.workunit.client.0.smithi073.stderr: 99/99 (stderr threshold) 2024-09-12T00:54:44.294 INFO:tasks.workunit.client.0.smithi073.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:54:44.294 INFO:tasks.workunit.client.0.smithi073.stderr: 7f055ffff640 / http_manager 2024-09-12T00:54:44.294 INFO:tasks.workunit.client.0.smithi073.stderr: 7f05ea7fc640 / http_manager 2024-09-12T00:54:44.295 INFO:tasks.workunit.client.0.smithi073.stderr: 7f05eb7fe640 / rgw_dt_lg_renew 2024-09-12T00:54:44.295 INFO:tasks.workunit.client.0.smithi073.stderr: 7f060b7fe640 / ms_dispatch 2024-09-12T00:54:44.295 INFO:tasks.workunit.client.0.smithi073.stderr: 7f061d7fa640 / io_context_pool 2024-09-12T00:54:44.295 INFO:tasks.workunit.client.0.smithi073.stderr: 7f061f7fe640 / ms_dispatch 2024-09-12T00:54:44.295 INFO:tasks.workunit.client.0.smithi073.stderr: 7f0626604640 / ms_dispatch 2024-09-12T00:54:44.295 INFO:tasks.workunit.client.0.smithi073.stderr: 7f0627e07640 / io_context_pool 2024-09-12T00:54:44.295 INFO:tasks.workunit.client.0.smithi073.stderr: 7f0739332640 / msgr-worker-2 2024-09-12T00:54:44.295 INFO:tasks.workunit.client.0.smithi073.stderr: 7f0739b33640 / msgr-worker-1 2024-09-12T00:54:44.295 INFO:tasks.workunit.client.0.smithi073.stderr: 7f073a334640 / msgr-worker-0 2024-09-12T00:54:44.295 INFO:tasks.workunit.client.0.smithi073.stderr: 7f073ab35640 / io_context_pool 2024-09-12T00:54:44.295 INFO:tasks.workunit.client.0.smithi073.stderr: 7f073df25800 / radosgw-admin 2024-09-12T00:54:44.295 INFO:tasks.workunit.client.0.smithi073.stderr: max_recent 500 2024-09-12T00:54:44.295 INFO:tasks.workunit.client.0.smithi073.stderr: max_new 1000 2024-09-12T00:54:44.295 INFO:tasks.workunit.client.0.smithi073.stderr: log_file /var/log/ceph/ceph-client.admin.152552.log 2024-09-12T00:54:44.296 INFO:tasks.workunit.client.0.smithi073.stderr:--- end dump of recent events --- 2024-09-12T00:54:44.296 INFO:tasks.workunit.client.0.smithi073.stderr:--- begin dump of recent events --- 2024-09-12T00:54:44.296 INFO:tasks.workunit.client.0.smithi073.stderr: -499> 2024-09-12T00:54:43.954+0000 7f073df25800 5 AuthRegistry(0x55d6bc5fa330) adding auth protocol: cephx 2024-09-12T00:54:44.296 INFO:tasks.workunit.client.0.smithi073.stderr: -498> 2024-09-12T00:54:43.954+0000 7f073df25800 5 AuthRegistry(0x55d6bc5fa330) adding auth protocol: cephx 2024-09-12T00:54:44.296 INFO:tasks.workunit.client.0.smithi073.stderr: -497> 2024-09-12T00:54:43.954+0000 7f073df25800 5 AuthRegistry(0x55d6bc5fa330) adding auth protocol: cephx 2024-09-12T00:54:44.296 INFO:tasks.workunit.client.0.smithi073.stderr: -496> 2024-09-12T00:54:43.954+0000 7f073df25800 5 AuthRegistry(0x55d6bc5fa330) adding con mode: secure 2024-09-12T00:54:44.296 INFO:tasks.workunit.client.0.smithi073.stderr: -495> 2024-09-12T00:54:43.954+0000 7f073df25800 5 AuthRegistry(0x55d6bc5fa330) adding con mode: crc 2024-09-12T00:54:44.296 INFO:tasks.workunit.client.0.smithi073.stderr: -494> 2024-09-12T00:54:43.954+0000 7f073df25800 5 AuthRegistry(0x55d6bc5fa330) adding con mode: secure 2024-09-12T00:54:44.296 INFO:tasks.workunit.client.0.smithi073.stderr: -493> 2024-09-12T00:54:43.954+0000 7f073df25800 5 AuthRegistry(0x55d6bc5fa330) adding con mode: crc 2024-09-12T00:54:44.296 INFO:tasks.workunit.client.0.smithi073.stderr: -492> 2024-09-12T00:54:43.954+0000 7f073df25800 5 AuthRegistry(0x55d6bc5fa330) adding con mode: secure 2024-09-12T00:54:44.296 INFO:tasks.workunit.client.0.smithi073.stderr: -491> 2024-09-12T00:54:43.954+0000 7f073df25800 5 AuthRegistry(0x55d6bc5fa330) adding con mode: crc 2024-09-12T00:54:44.296 INFO:tasks.workunit.client.0.smithi073.stderr: -490> 2024-09-12T00:54:43.954+0000 7f073df25800 5 AuthRegistry(0x55d6bc5fa330) adding con mode: crc 2024-09-12T00:54:44.296 INFO:tasks.workunit.client.0.smithi073.stderr: -489> 2024-09-12T00:54:43.954+0000 7f073df25800 5 AuthRegistry(0x55d6bc5fa330) adding con mode: secure 2024-09-12T00:54:44.297 INFO:tasks.workunit.client.0.smithi073.stderr: -488> 2024-09-12T00:54:43.954+0000 7f073df25800 5 AuthRegistry(0x55d6bc5fa330) adding con mode: crc 2024-09-12T00:54:44.297 INFO:tasks.workunit.client.0.smithi073.stderr: -487> 2024-09-12T00:54:43.954+0000 7f073df25800 5 AuthRegistry(0x55d6bc5fa330) adding con mode: secure 2024-09-12T00:54:44.297 INFO:tasks.workunit.client.0.smithi073.stderr: -486> 2024-09-12T00:54:43.954+0000 7f073df25800 5 AuthRegistry(0x55d6bc5fa330) adding con mode: crc 2024-09-12T00:54:44.297 INFO:tasks.workunit.client.0.smithi073.stderr: -485> 2024-09-12T00:54:43.954+0000 7f073df25800 5 AuthRegistry(0x55d6bc5fa330) adding con mode: secure 2024-09-12T00:54:44.297 INFO:tasks.workunit.client.0.smithi073.stderr: -484> 2024-09-12T00:54:43.954+0000 7f073df25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:44.297 INFO:tasks.workunit.client.0.smithi073.stderr: -483> 2024-09-12T00:54:43.954+0000 7f073df25800 1 librados: starting msgr at 2024-09-12T00:54:44.297 INFO:tasks.workunit.client.0.smithi073.stderr: -482> 2024-09-12T00:54:43.954+0000 7f073df25800 1 librados: starting objecter 2024-09-12T00:54:44.297 INFO:tasks.workunit.client.0.smithi073.stderr: -481> 2024-09-12T00:54:43.955+0000 7f073df25800 5 asok(0x55d6bc3d5630) register_command objecter_requests hook 0x55d6bc5f7e90 2024-09-12T00:54:44.297 INFO:tasks.workunit.client.0.smithi073.stderr: -480> 2024-09-12T00:54:43.955+0000 7f073df25800 1 librados: setting wanted keys 2024-09-12T00:54:44.297 INFO:tasks.workunit.client.0.smithi073.stderr: -479> 2024-09-12T00:54:43.955+0000 7f073df25800 1 librados: calling monclient init 2024-09-12T00:54:44.297 INFO:tasks.workunit.client.0.smithi073.stderr: -478> 2024-09-12T00:54:43.955+0000 7f073df25800 10 monclient: init 2024-09-12T00:54:44.297 INFO:tasks.workunit.client.0.smithi073.stderr: -477> 2024-09-12T00:54:43.955+0000 7f073df25800 5 AuthRegistry(0x55d6bc5f4890) adding auth protocol: cephx 2024-09-12T00:54:44.297 INFO:tasks.workunit.client.0.smithi073.stderr: -476> 2024-09-12T00:54:43.955+0000 7f073df25800 5 AuthRegistry(0x55d6bc5f4890) adding auth protocol: cephx 2024-09-12T00:54:44.298 INFO:tasks.workunit.client.0.smithi073.stderr: -475> 2024-09-12T00:54:43.955+0000 7f073df25800 5 AuthRegistry(0x55d6bc5f4890) adding auth protocol: cephx 2024-09-12T00:54:44.298 INFO:tasks.workunit.client.0.smithi073.stderr: -474> 2024-09-12T00:54:43.955+0000 7f073df25800 5 AuthRegistry(0x55d6bc5f4890) adding con mode: secure 2024-09-12T00:54:44.298 INFO:tasks.workunit.client.0.smithi073.stderr: -473> 2024-09-12T00:54:43.955+0000 7f073df25800 5 AuthRegistry(0x55d6bc5f4890) adding con mode: crc 2024-09-12T00:54:44.298 INFO:tasks.workunit.client.0.smithi073.stderr: -472> 2024-09-12T00:54:43.955+0000 7f073df25800 5 AuthRegistry(0x55d6bc5f4890) adding con mode: secure 2024-09-12T00:54:44.298 INFO:tasks.workunit.client.0.smithi073.stderr: -471> 2024-09-12T00:54:43.955+0000 7f073df25800 5 AuthRegistry(0x55d6bc5f4890) adding con mode: crc 2024-09-12T00:54:44.298 INFO:tasks.workunit.client.0.smithi073.stderr: -470> 2024-09-12T00:54:43.955+0000 7f073df25800 5 AuthRegistry(0x55d6bc5f4890) adding con mode: secure 2024-09-12T00:54:44.298 INFO:tasks.workunit.client.0.smithi073.stderr: -469> 2024-09-12T00:54:43.955+0000 7f073df25800 5 AuthRegistry(0x55d6bc5f4890) adding con mode: crc 2024-09-12T00:54:44.298 INFO:tasks.workunit.client.0.smithi073.stderr: -468> 2024-09-12T00:54:43.955+0000 7f073df25800 5 AuthRegistry(0x55d6bc5f4890) adding con mode: crc 2024-09-12T00:54:44.298 INFO:tasks.workunit.client.0.smithi073.stderr: -467> 2024-09-12T00:54:43.955+0000 7f073df25800 5 AuthRegistry(0x55d6bc5f4890) adding con mode: secure 2024-09-12T00:54:44.298 INFO:tasks.workunit.client.0.smithi073.stderr: -466> 2024-09-12T00:54:43.955+0000 7f073df25800 5 AuthRegistry(0x55d6bc5f4890) adding con mode: crc 2024-09-12T00:54:44.298 INFO:tasks.workunit.client.0.smithi073.stderr: -465> 2024-09-12T00:54:43.955+0000 7f073df25800 5 AuthRegistry(0x55d6bc5f4890) adding con mode: secure 2024-09-12T00:54:44.298 INFO:tasks.workunit.client.0.smithi073.stderr: -464> 2024-09-12T00:54:43.955+0000 7f073df25800 5 AuthRegistry(0x55d6bc5f4890) adding con mode: crc 2024-09-12T00:54:44.298 INFO:tasks.workunit.client.0.smithi073.stderr: -463> 2024-09-12T00:54:43.955+0000 7f073df25800 5 AuthRegistry(0x55d6bc5f4890) adding con mode: secure 2024-09-12T00:54:44.298 INFO:tasks.workunit.client.0.smithi073.stderr: -462> 2024-09-12T00:54:43.955+0000 7f073df25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:44.299 INFO:tasks.workunit.client.0.smithi073.stderr: -461> 2024-09-12T00:54:43.955+0000 7f073df25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:44.299 INFO:tasks.workunit.client.0.smithi073.stderr: -460> 2024-09-12T00:54:43.955+0000 7f073df25800 5 asok(0x55d6bc3d5630) register_command rotate-key hook 0x55d6bc5f49d8 2024-09-12T00:54:44.299 INFO:tasks.workunit.client.0.smithi073.stderr: -459> 2024-09-12T00:54:43.955+0000 7f073df25800 10 monclient: _reopen_session rank -1 2024-09-12T00:54:44.299 INFO:tasks.workunit.client.0.smithi073.stderr: -458> 2024-09-12T00:54:43.955+0000 7f073df25800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:54:44.299 INFO:tasks.workunit.client.0.smithi073.stderr: -457> 2024-09-12T00:54:43.955+0000 7f073df25800 10 monclient(hunting): picked mon.noname-b con 0x55d6bc4adb00 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:54:44.299 INFO:tasks.workunit.client.0.smithi073.stderr: -456> 2024-09-12T00:54:43.955+0000 7f073df25800 10 monclient(hunting): picked mon.noname-c con 0x55d6bc626700 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:54:44.299 INFO:tasks.workunit.client.0.smithi073.stderr: -455> 2024-09-12T00:54:43.955+0000 7f073df25800 10 monclient(hunting): picked mon.noname-a con 0x7f0620006db0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:54:44.299 INFO:tasks.workunit.client.0.smithi073.stderr: -454> 2024-09-12T00:54:43.955+0000 7f073df25800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:44.299 INFO:tasks.workunit.client.0.smithi073.stderr: -453> 2024-09-12T00:54:43.955+0000 7f073df25800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:44.299 INFO:tasks.workunit.client.0.smithi073.stderr: -452> 2024-09-12T00:54:43.955+0000 7f073df25800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:44.299 INFO:tasks.workunit.client.0.smithi073.stderr: -451> 2024-09-12T00:54:43.955+0000 7f073df25800 10 monclient(hunting): _renew_subs 2024-09-12T00:54:44.299 INFO:tasks.workunit.client.0.smithi073.stderr: -450> 2024-09-12T00:54:43.955+0000 7f073df25800 10 monclient(hunting): authenticate will time out at 2344.625822s 2024-09-12T00:54:44.299 INFO:tasks.workunit.client.0.smithi073.stderr: -449> 2024-09-12T00:54:43.955+0000 7f0739332640 10 monclient(hunting): get_auth_request con 0x55d6bc626700 auth_method 0 2024-09-12T00:54:44.299 INFO:tasks.workunit.client.0.smithi073.stderr: -448> 2024-09-12T00:54:43.955+0000 7f0739332640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:44.300 INFO:tasks.workunit.client.0.smithi073.stderr: -447> 2024-09-12T00:54:43.955+0000 7f0739332640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:44.300 INFO:tasks.workunit.client.0.smithi073.stderr: -446> 2024-09-12T00:54:43.955+0000 7f0739332640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:44.300 INFO:tasks.workunit.client.0.smithi073.stderr: -445> 2024-09-12T00:54:43.955+0000 7f073a334640 10 monclient(hunting): get_auth_request con 0x7f0620006db0 auth_method 0 2024-09-12T00:54:44.300 INFO:tasks.workunit.client.0.smithi073.stderr: -444> 2024-09-12T00:54:43.955+0000 7f073a334640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:44.300 INFO:tasks.workunit.client.0.smithi073.stderr: -443> 2024-09-12T00:54:43.955+0000 7f073a334640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:44.300 INFO:tasks.workunit.client.0.smithi073.stderr: -442> 2024-09-12T00:54:43.955+0000 7f073a334640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:44.300 INFO:tasks.workunit.client.0.smithi073.stderr: -441> 2024-09-12T00:54:43.955+0000 7f0739332640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:44.300 INFO:tasks.workunit.client.0.smithi073.stderr: -440> 2024-09-12T00:54:43.955+0000 7f0739332640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:44.300 INFO:tasks.workunit.client.0.smithi073.stderr: -439> 2024-09-12T00:54:43.955+0000 7f0739332640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:44.300 INFO:tasks.workunit.client.0.smithi073.stderr: -438> 2024-09-12T00:54:43.955+0000 7f073a334640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:44.300 INFO:tasks.workunit.client.0.smithi073.stderr: -437> 2024-09-12T00:54:43.955+0000 7f073a334640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:44.300 INFO:tasks.workunit.client.0.smithi073.stderr: -436> 2024-09-12T00:54:43.955+0000 7f073a334640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:44.300 INFO:tasks.workunit.client.0.smithi073.stderr: -435> 2024-09-12T00:54:43.955+0000 7f0739b33640 10 monclient(hunting): get_auth_request con 0x55d6bc4adb00 auth_method 0 2024-09-12T00:54:44.301 INFO:tasks.workunit.client.0.smithi073.stderr: -434> 2024-09-12T00:54:43.955+0000 7f0739b33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:44.301 INFO:tasks.workunit.client.0.smithi073.stderr: -433> 2024-09-12T00:54:43.955+0000 7f0739b33640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:44.301 INFO:tasks.workunit.client.0.smithi073.stderr: -432> 2024-09-12T00:54:43.955+0000 7f0739b33640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:44.301 INFO:tasks.workunit.client.0.smithi073.stderr: -431> 2024-09-12T00:54:43.956+0000 7f0739b33640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:44.301 INFO:tasks.workunit.client.0.smithi073.stderr: -430> 2024-09-12T00:54:43.956+0000 7f0739b33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:44.301 INFO:tasks.workunit.client.0.smithi073.stderr: -429> 2024-09-12T00:54:43.956+0000 7f0739b33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:44.301 INFO:tasks.workunit.client.0.smithi073.stderr: -428> 2024-09-12T00:54:43.956+0000 7f0739332640 10 monclient(hunting): handle_auth_done global_id 7796 payload 824 2024-09-12T00:54:44.301 INFO:tasks.workunit.client.0.smithi073.stderr: -427> 2024-09-12T00:54:43.956+0000 7f0739332640 10 monclient: _finish_hunting 0 2024-09-12T00:54:44.301 INFO:tasks.workunit.client.0.smithi073.stderr: -426> 2024-09-12T00:54:43.956+0000 7f0739332640 1 monclient: found mon.noname-c 2024-09-12T00:54:44.301 INFO:tasks.workunit.client.0.smithi073.stderr: -425> 2024-09-12T00:54:43.956+0000 7f0739332640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.73:3301/0 2024-09-12T00:54:44.301 INFO:tasks.workunit.client.0.smithi073.stderr: -424> 2024-09-12T00:54:43.956+0000 7f0626604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:44.302 INFO:tasks.workunit.client.0.smithi073.stderr: -423> 2024-09-12T00:54:43.956+0000 7f0626604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:54:44.302 INFO:tasks.workunit.client.0.smithi073.stderr: -422> 2024-09-12T00:54:43.956+0000 7f0626604640 10 monclient: dump: 2024-09-12T00:54:44.302 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:54:44.302 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:54:44.302 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:44.302 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:44.302 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:44.302 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:54:44.302 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:54:44.302 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:54:44.302 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:54:44.303 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:44.303 INFO:tasks.workunit.client.0.smithi073.stderr: -421> 2024-09-12T00:54:43.956+0000 7f0626604640 10 monclient: _finish_auth 0 2024-09-12T00:54:44.303 INFO:tasks.workunit.client.0.smithi073.stderr: -420> 2024-09-12T00:54:43.956+0000 7f0626604640 10 monclient: _check_auth_tickets 2024-09-12T00:54:44.303 INFO:tasks.workunit.client.0.smithi073.stderr: -419> 2024-09-12T00:54:43.956+0000 7f073df25800 5 monclient: authenticate success, global_id 7796 2024-09-12T00:54:44.303 INFO:tasks.workunit.client.0.smithi073.stderr: -418> 2024-09-12T00:54:43.956+0000 7f073df25800 10 monclient: _renew_subs 2024-09-12T00:54:44.303 INFO:tasks.workunit.client.0.smithi073.stderr: -417> 2024-09-12T00:54:43.956+0000 7f073df25800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:54:44.303 INFO:tasks.workunit.client.0.smithi073.stderr: -416> 2024-09-12T00:54:43.956+0000 7f0626604640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:44.303 INFO:tasks.workunit.client.0.smithi073.stderr: -415> 2024-09-12T00:54:43.956+0000 7f0626604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:44.303 INFO:tasks.workunit.client.0.smithi073.stderr: -414> 2024-09-12T00:54:43.956+0000 7f0626604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:54:44.303 INFO:tasks.workunit.client.0.smithi073.stderr: -413> 2024-09-12T00:54:43.956+0000 7f0626604640 10 monclient: dump: 2024-09-12T00:54:44.303 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:54:44.303 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:54:44.303 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:44.304 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:44.304 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:44.304 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:54:44.304 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:54:44.304 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:54:44.304 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:54:44.304 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:44.304 INFO:tasks.workunit.client.0.smithi073.stderr: -412> 2024-09-12T00:54:43.956+0000 7f0627e07640 4 set_mon_vals no callback set 2024-09-12T00:54:44.304 INFO:tasks.workunit.client.0.smithi073.stderr: -411> 2024-09-12T00:54:43.956+0000 7f073df25800 10 monclient: _renew_subs 2024-09-12T00:54:44.304 INFO:tasks.workunit.client.0.smithi073.stderr: -410> 2024-09-12T00:54:43.956+0000 7f073df25800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:54:44.304 INFO:tasks.workunit.client.0.smithi073.stderr: -409> 2024-09-12T00:54:43.956+0000 7f073df25800 1 librados: init done 2024-09-12T00:54:44.304 INFO:tasks.workunit.client.0.smithi073.stderr: -408> 2024-09-12T00:54:43.958+0000 7f0626604640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:54:44.304 INFO:tasks.workunit.client.0.smithi073.stderr: -407> 2024-09-12T00:54:43.958+0000 7f0626604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:54:44.305 INFO:tasks.workunit.client.0.smithi073.stderr: -406> 2024-09-12T00:54:43.958+0000 7f0626604640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:54:44.305 INFO:tasks.workunit.client.0.smithi073.stderr: -405> 2024-09-12T00:54:43.958+0000 7f0739b33640 10 monclient: get_auth_request con 0x7f0620079820 auth_method 0 2024-09-12T00:54:44.305 INFO:tasks.workunit.client.0.smithi073.stderr: -404> 2024-09-12T00:54:43.958+0000 7f073a334640 10 monclient: get_auth_request con 0x55d6bc6357c0 auth_method 0 2024-09-12T00:54:44.305 INFO:tasks.workunit.client.0.smithi073.stderr: -403> 2024-09-12T00:54:43.960+0000 7f0739b33640 10 monclient: get_auth_request con 0x55d6bc63ed90 auth_method 0 2024-09-12T00:54:44.305 INFO:tasks.workunit.client.0.smithi073.stderr: -402> 2024-09-12T00:54:43.961+0000 7f0739332640 10 monclient: get_auth_request con 0x55d6bc6430f0 auth_method 0 2024-09-12T00:54:44.305 INFO:tasks.workunit.client.0.smithi073.stderr: -401> 2024-09-12T00:54:43.962+0000 7f073df25800 10 monclient: build_initial_monmap 2024-09-12T00:54:44.305 INFO:tasks.workunit.client.0.smithi073.stderr: -400> 2024-09-12T00:54:43.962+0000 7f073df25800 1 build_initial for_mkfs: 0 2024-09-12T00:54:44.305 INFO:tasks.workunit.client.0.smithi073.stderr: -399> 2024-09-12T00:54:43.962+0000 7f073df25800 10 monclient: monmap: 2024-09-12T00:54:44.305 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:54:44.305 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:54:44.305 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:54:44.305 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:54:44.306 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:54:44.306 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:54:44.306 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:54:44.306 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:54:44.306 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:54:44.306 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:44.306 INFO:tasks.workunit.client.0.smithi073.stderr: -398> 2024-09-12T00:54:43.962+0000 7f073df25800 5 AuthRegistry(0x55d6bc647f30) adding auth protocol: cephx 2024-09-12T00:54:44.306 INFO:tasks.workunit.client.0.smithi073.stderr: -397> 2024-09-12T00:54:43.962+0000 7f073df25800 5 AuthRegistry(0x55d6bc647f30) adding auth protocol: cephx 2024-09-12T00:54:44.306 INFO:tasks.workunit.client.0.smithi073.stderr: -396> 2024-09-12T00:54:43.962+0000 7f073df25800 5 AuthRegistry(0x55d6bc647f30) adding auth protocol: cephx 2024-09-12T00:54:44.306 INFO:tasks.workunit.client.0.smithi073.stderr: -395> 2024-09-12T00:54:43.962+0000 7f073df25800 5 AuthRegistry(0x55d6bc647f30) adding con mode: secure 2024-09-12T00:54:44.306 INFO:tasks.workunit.client.0.smithi073.stderr: -394> 2024-09-12T00:54:43.962+0000 7f073df25800 5 AuthRegistry(0x55d6bc647f30) adding con mode: crc 2024-09-12T00:54:44.306 INFO:tasks.workunit.client.0.smithi073.stderr: -393> 2024-09-12T00:54:43.962+0000 7f073df25800 5 AuthRegistry(0x55d6bc647f30) adding con mode: secure 2024-09-12T00:54:44.306 INFO:tasks.workunit.client.0.smithi073.stderr: -392> 2024-09-12T00:54:43.962+0000 7f073df25800 5 AuthRegistry(0x55d6bc647f30) adding con mode: crc 2024-09-12T00:54:44.307 INFO:tasks.workunit.client.0.smithi073.stderr: -391> 2024-09-12T00:54:43.962+0000 7f073df25800 5 AuthRegistry(0x55d6bc647f30) adding con mode: secure 2024-09-12T00:54:44.307 INFO:tasks.workunit.client.0.smithi073.stderr: -390> 2024-09-12T00:54:43.962+0000 7f073df25800 5 AuthRegistry(0x55d6bc647f30) adding con mode: crc 2024-09-12T00:54:44.307 INFO:tasks.workunit.client.0.smithi073.stderr: -389> 2024-09-12T00:54:43.962+0000 7f073df25800 5 AuthRegistry(0x55d6bc647f30) adding con mode: crc 2024-09-12T00:54:44.307 INFO:tasks.workunit.client.0.smithi073.stderr: -388> 2024-09-12T00:54:43.962+0000 7f073df25800 5 AuthRegistry(0x55d6bc647f30) adding con mode: secure 2024-09-12T00:54:44.307 INFO:tasks.workunit.client.0.smithi073.stderr: -387> 2024-09-12T00:54:43.962+0000 7f073df25800 5 AuthRegistry(0x55d6bc647f30) adding con mode: crc 2024-09-12T00:54:44.307 INFO:tasks.workunit.client.0.smithi073.stderr: -386> 2024-09-12T00:54:43.962+0000 7f073df25800 5 AuthRegistry(0x55d6bc647f30) adding con mode: secure 2024-09-12T00:54:44.307 INFO:tasks.workunit.client.0.smithi073.stderr: -385> 2024-09-12T00:54:43.962+0000 7f073df25800 5 AuthRegistry(0x55d6bc647f30) adding con mode: crc 2024-09-12T00:54:44.307 INFO:tasks.workunit.client.0.smithi073.stderr: -384> 2024-09-12T00:54:43.962+0000 7f073df25800 5 AuthRegistry(0x55d6bc647f30) adding con mode: secure 2024-09-12T00:54:44.307 INFO:tasks.workunit.client.0.smithi073.stderr: -383> 2024-09-12T00:54:43.962+0000 7f073df25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:44.307 INFO:tasks.workunit.client.0.smithi073.stderr: -382> 2024-09-12T00:54:43.963+0000 7f073df25800 5 asok(0x55d6bc3d5630) register_command objecter_requests cmddesc objecter_requests hook 0x55d6bc64b940 EEXIST 2024-09-12T00:54:44.307 INFO:tasks.workunit.client.0.smithi073.stderr: -381> 2024-09-12T00:54:43.963+0000 7f073df25800 10 monclient: init 2024-09-12T00:54:44.307 INFO:tasks.workunit.client.0.smithi073.stderr: -380> 2024-09-12T00:54:43.963+0000 7f073df25800 5 AuthRegistry(0x55d6bc6465b8) adding auth protocol: cephx 2024-09-12T00:54:44.307 INFO:tasks.workunit.client.0.smithi073.stderr: -379> 2024-09-12T00:54:43.963+0000 7f073df25800 5 AuthRegistry(0x55d6bc6465b8) adding auth protocol: cephx 2024-09-12T00:54:44.307 INFO:tasks.workunit.client.0.smithi073.stderr: -378> 2024-09-12T00:54:43.963+0000 7f073df25800 5 AuthRegistry(0x55d6bc6465b8) adding auth protocol: cephx 2024-09-12T00:54:44.308 INFO:tasks.workunit.client.0.smithi073.stderr: -377> 2024-09-12T00:54:43.963+0000 7f073df25800 5 AuthRegistry(0x55d6bc6465b8) adding con mode: secure 2024-09-12T00:54:44.308 INFO:tasks.workunit.client.0.smithi073.stderr: -376> 2024-09-12T00:54:43.963+0000 7f073df25800 5 AuthRegistry(0x55d6bc6465b8) adding con mode: crc 2024-09-12T00:54:44.308 INFO:tasks.workunit.client.0.smithi073.stderr: -375> 2024-09-12T00:54:43.963+0000 7f073df25800 5 AuthRegistry(0x55d6bc6465b8) adding con mode: secure 2024-09-12T00:54:44.308 INFO:tasks.workunit.client.0.smithi073.stderr: -374> 2024-09-12T00:54:43.963+0000 7f073df25800 5 AuthRegistry(0x55d6bc6465b8) adding con mode: crc 2024-09-12T00:54:44.308 INFO:tasks.workunit.client.0.smithi073.stderr: -373> 2024-09-12T00:54:43.963+0000 7f073df25800 5 AuthRegistry(0x55d6bc6465b8) adding con mode: secure 2024-09-12T00:54:44.308 INFO:tasks.workunit.client.0.smithi073.stderr: -372> 2024-09-12T00:54:43.963+0000 7f073df25800 5 AuthRegistry(0x55d6bc6465b8) adding con mode: crc 2024-09-12T00:54:44.308 INFO:tasks.workunit.client.0.smithi073.stderr: -371> 2024-09-12T00:54:43.963+0000 7f073df25800 5 AuthRegistry(0x55d6bc6465b8) adding con mode: crc 2024-09-12T00:54:44.308 INFO:tasks.workunit.client.0.smithi073.stderr: -370> 2024-09-12T00:54:43.963+0000 7f073df25800 5 AuthRegistry(0x55d6bc6465b8) adding con mode: secure 2024-09-12T00:54:44.308 INFO:tasks.workunit.client.0.smithi073.stderr: -369> 2024-09-12T00:54:43.963+0000 7f073df25800 5 AuthRegistry(0x55d6bc6465b8) adding con mode: crc 2024-09-12T00:54:44.308 INFO:tasks.workunit.client.0.smithi073.stderr: -368> 2024-09-12T00:54:43.963+0000 7f073df25800 5 AuthRegistry(0x55d6bc6465b8) adding con mode: secure 2024-09-12T00:54:44.308 INFO:tasks.workunit.client.0.smithi073.stderr: -367> 2024-09-12T00:54:43.963+0000 7f073df25800 5 AuthRegistry(0x55d6bc6465b8) adding con mode: crc 2024-09-12T00:54:44.308 INFO:tasks.workunit.client.0.smithi073.stderr: -366> 2024-09-12T00:54:43.963+0000 7f073df25800 5 AuthRegistry(0x55d6bc6465b8) adding con mode: secure 2024-09-12T00:54:44.309 INFO:tasks.workunit.client.0.smithi073.stderr: -365> 2024-09-12T00:54:43.963+0000 7f073df25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:44.309 INFO:tasks.workunit.client.0.smithi073.stderr: -364> 2024-09-12T00:54:43.963+0000 7f073df25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:44.309 INFO:tasks.workunit.client.0.smithi073.stderr: -363> 2024-09-12T00:54:43.963+0000 7f073df25800 5 asok(0x55d6bc3d5630) register_command rotate-key cmddesc rotate-key hook 0x55d6bc646700 EEXIST 2024-09-12T00:54:44.309 INFO:tasks.workunit.client.0.smithi073.stderr: -362> 2024-09-12T00:54:43.963+0000 7f073df25800 10 monclient: _reopen_session rank -1 2024-09-12T00:54:44.309 INFO:tasks.workunit.client.0.smithi073.stderr: -361> 2024-09-12T00:54:43.963+0000 7f073df25800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:54:44.309 INFO:tasks.workunit.client.0.smithi073.stderr: -360> 2024-09-12T00:54:43.963+0000 7f073df25800 10 monclient(hunting): picked mon.noname-b con 0x55d6bc66f630 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:54:44.309 INFO:tasks.workunit.client.0.smithi073.stderr: -359> 2024-09-12T00:54:43.963+0000 7f073df25800 10 monclient(hunting): picked mon.noname-c con 0x55d6bc671900 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:54:44.309 INFO:tasks.workunit.client.0.smithi073.stderr: -358> 2024-09-12T00:54:43.963+0000 7f073df25800 10 monclient(hunting): picked mon.noname-a con 0x55d6bc66de00 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:54:44.309 INFO:tasks.workunit.client.0.smithi073.stderr: -357> 2024-09-12T00:54:43.963+0000 7f073df25800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:44.309 INFO:tasks.workunit.client.0.smithi073.stderr: -356> 2024-09-12T00:54:43.963+0000 7f073df25800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:44.309 INFO:tasks.workunit.client.0.smithi073.stderr: -355> 2024-09-12T00:54:43.963+0000 7f073df25800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:44.309 INFO:tasks.workunit.client.0.smithi073.stderr: -354> 2024-09-12T00:54:43.963+0000 7f073df25800 10 monclient(hunting): _renew_subs 2024-09-12T00:54:44.309 INFO:tasks.workunit.client.0.smithi073.stderr: -353> 2024-09-12T00:54:43.963+0000 7f073df25800 10 monclient(hunting): authenticate will time out at 2344.633795s 2024-09-12T00:54:44.310 INFO:tasks.workunit.client.0.smithi073.stderr: -352> 2024-09-12T00:54:43.963+0000 7f0739332640 10 monclient(hunting): get_auth_request con 0x55d6bc671900 auth_method 0 2024-09-12T00:54:44.310 INFO:tasks.workunit.client.0.smithi073.stderr: -351> 2024-09-12T00:54:43.963+0000 7f0739332640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:44.310 INFO:tasks.workunit.client.0.smithi073.stderr: -350> 2024-09-12T00:54:43.963+0000 7f0739332640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:44.310 INFO:tasks.workunit.client.0.smithi073.stderr: -349> 2024-09-12T00:54:43.963+0000 7f0739332640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:44.310 INFO:tasks.workunit.client.0.smithi073.stderr: -348> 2024-09-12T00:54:43.963+0000 7f073a334640 10 monclient(hunting): get_auth_request con 0x55d6bc66de00 auth_method 0 2024-09-12T00:54:44.310 INFO:tasks.workunit.client.0.smithi073.stderr: -347> 2024-09-12T00:54:43.963+0000 7f073a334640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:44.310 INFO:tasks.workunit.client.0.smithi073.stderr: -346> 2024-09-12T00:54:43.963+0000 7f073a334640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:44.310 INFO:tasks.workunit.client.0.smithi073.stderr: -345> 2024-09-12T00:54:43.963+0000 7f073a334640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:44.310 INFO:tasks.workunit.client.0.smithi073.stderr: -344> 2024-09-12T00:54:43.963+0000 7f0739332640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:44.310 INFO:tasks.workunit.client.0.smithi073.stderr: -343> 2024-09-12T00:54:43.963+0000 7f0739332640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:44.310 INFO:tasks.workunit.client.0.smithi073.stderr: -342> 2024-09-12T00:54:43.964+0000 7f0739332640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:44.310 INFO:tasks.workunit.client.0.smithi073.stderr: -341> 2024-09-12T00:54:43.964+0000 7f0739b33640 10 monclient(hunting): get_auth_request con 0x55d6bc66f630 auth_method 0 2024-09-12T00:54:44.310 INFO:tasks.workunit.client.0.smithi073.stderr: -340> 2024-09-12T00:54:43.964+0000 7f0739b33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:44.311 INFO:tasks.workunit.client.0.smithi073.stderr: -339> 2024-09-12T00:54:43.964+0000 7f0739b33640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:44.311 INFO:tasks.workunit.client.0.smithi073.stderr: -338> 2024-09-12T00:54:43.964+0000 7f0739b33640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:44.311 INFO:tasks.workunit.client.0.smithi073.stderr: -337> 2024-09-12T00:54:43.964+0000 7f073a334640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:44.311 INFO:tasks.workunit.client.0.smithi073.stderr: -336> 2024-09-12T00:54:43.964+0000 7f073a334640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:44.311 INFO:tasks.workunit.client.0.smithi073.stderr: -335> 2024-09-12T00:54:43.964+0000 7f073a334640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:44.311 INFO:tasks.workunit.client.0.smithi073.stderr: -334> 2024-09-12T00:54:43.964+0000 7f0739b33640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:44.311 INFO:tasks.workunit.client.0.smithi073.stderr: -333> 2024-09-12T00:54:43.964+0000 7f0739b33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:44.311 INFO:tasks.workunit.client.0.smithi073.stderr: -332> 2024-09-12T00:54:43.964+0000 7f0739b33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:44.311 INFO:tasks.workunit.client.0.smithi073.stderr: -331> 2024-09-12T00:54:43.964+0000 7f0739332640 10 monclient(hunting): handle_auth_done global_id 7799 payload 824 2024-09-12T00:54:44.311 INFO:tasks.workunit.client.0.smithi073.stderr: -330> 2024-09-12T00:54:43.964+0000 7f0739332640 10 monclient: _finish_hunting 0 2024-09-12T00:54:44.311 INFO:tasks.workunit.client.0.smithi073.stderr: -329> 2024-09-12T00:54:43.964+0000 7f0739332640 1 monclient: found mon.noname-c 2024-09-12T00:54:44.311 INFO:tasks.workunit.client.0.smithi073.stderr: -328> 2024-09-12T00:54:43.964+0000 7f0739332640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.73:3301/0 2024-09-12T00:54:44.311 INFO:tasks.workunit.client.0.smithi073.stderr: -327> 2024-09-12T00:54:43.964+0000 7f061f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:44.312 INFO:tasks.workunit.client.0.smithi073.stderr: -326> 2024-09-12T00:54:43.964+0000 7f061f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:54:44.312 INFO:tasks.workunit.client.0.smithi073.stderr: -325> 2024-09-12T00:54:43.964+0000 7f061f7fe640 10 monclient: dump: 2024-09-12T00:54:44.312 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:54:44.312 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:54:44.312 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:44.312 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:44.312 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:44.312 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:54:44.312 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:54:44.312 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:54:44.312 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:54:44.312 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:44.313 INFO:tasks.workunit.client.0.smithi073.stderr: -324> 2024-09-12T00:54:43.964+0000 7f061f7fe640 10 monclient: _finish_auth 0 2024-09-12T00:54:44.313 INFO:tasks.workunit.client.0.smithi073.stderr: -323> 2024-09-12T00:54:43.964+0000 7f061f7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:54:44.313 INFO:tasks.workunit.client.0.smithi073.stderr: -322> 2024-09-12T00:54:43.964+0000 7f061f7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:44.313 INFO:tasks.workunit.client.0.smithi073.stderr: -321> 2024-09-12T00:54:43.964+0000 7f061f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:44.313 INFO:tasks.workunit.client.0.smithi073.stderr: -320> 2024-09-12T00:54:43.964+0000 7f061f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:54:44.313 INFO:tasks.workunit.client.0.smithi073.stderr: -319> 2024-09-12T00:54:43.964+0000 7f061f7fe640 10 monclient: dump: 2024-09-12T00:54:44.313 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:54:44.313 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:54:44.313 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:44.313 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:44.313 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:44.313 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:54:44.313 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:54:44.314 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:54:44.314 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:54:44.314 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:44.314 INFO:tasks.workunit.client.0.smithi073.stderr: -318> 2024-09-12T00:54:43.964+0000 7f073df25800 5 monclient: authenticate success, global_id 7799 2024-09-12T00:54:44.314 INFO:tasks.workunit.client.0.smithi073.stderr: -317> 2024-09-12T00:54:43.964+0000 7f073ab35640 4 set_mon_vals no callback set 2024-09-12T00:54:44.314 INFO:tasks.workunit.client.0.smithi073.stderr: -316> 2024-09-12T00:54:43.964+0000 7f073df25800 10 monclient: _renew_subs 2024-09-12T00:54:44.314 INFO:tasks.workunit.client.0.smithi073.stderr: -315> 2024-09-12T00:54:43.964+0000 7f073df25800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:54:44.314 INFO:tasks.workunit.client.0.smithi073.stderr: -314> 2024-09-12T00:54:43.964+0000 7f073df25800 10 monclient: _renew_subs 2024-09-12T00:54:44.314 INFO:tasks.workunit.client.0.smithi073.stderr: -313> 2024-09-12T00:54:43.964+0000 7f073df25800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.73:3301/0 2024-09-12T00:54:44.314 INFO:tasks.workunit.client.0.smithi073.stderr: -312> 2024-09-12T00:54:43.966+0000 7f061f7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:54:44.314 INFO:tasks.workunit.client.0.smithi073.stderr: -311> 2024-09-12T00:54:43.966+0000 7f061f7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:54:44.314 INFO:tasks.workunit.client.0.smithi073.stderr: -310> 2024-09-12T00:54:43.966+0000 7f061f7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:54:44.314 INFO:tasks.workunit.client.0.smithi073.stderr: -309> 2024-09-12T00:54:43.967+0000 7f0739b33640 10 monclient: get_auth_request con 0x7f0614076380 auth_method 0 2024-09-12T00:54:44.315 INFO:tasks.workunit.client.0.smithi073.stderr: -308> 2024-09-12T00:54:43.967+0000 7f073df25800 10 monclient: get_monmap_and_config 2024-09-12T00:54:44.315 INFO:tasks.workunit.client.0.smithi073.stderr: -307> 2024-09-12T00:54:43.967+0000 7f073df25800 10 monclient: build_initial_monmap 2024-09-12T00:54:44.315 INFO:tasks.workunit.client.0.smithi073.stderr: -306> 2024-09-12T00:54:43.967+0000 7f073df25800 1 build_initial for_mkfs: 0 2024-09-12T00:54:44.315 INFO:tasks.workunit.client.0.smithi073.stderr: -305> 2024-09-12T00:54:43.967+0000 7f073df25800 10 monclient: monmap: 2024-09-12T00:54:44.315 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:54:44.315 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:54:44.315 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:54:44.315 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:54:44.315 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:54:44.315 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:54:44.315 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:54:44.315 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:54:44.315 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:54:44.316 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:44.316 INFO:tasks.workunit.client.0.smithi073.stderr: -304> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x55d6bc68ef70) adding auth protocol: cephx 2024-09-12T00:54:44.316 INFO:tasks.workunit.client.0.smithi073.stderr: -303> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x55d6bc68ef70) adding auth protocol: cephx 2024-09-12T00:54:44.316 INFO:tasks.workunit.client.0.smithi073.stderr: -302> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x55d6bc68ef70) adding auth protocol: cephx 2024-09-12T00:54:44.316 INFO:tasks.workunit.client.0.smithi073.stderr: -301> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x55d6bc68ef70) adding con mode: secure 2024-09-12T00:54:44.316 INFO:tasks.workunit.client.0.smithi073.stderr: -300> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x55d6bc68ef70) adding con mode: crc 2024-09-12T00:54:44.316 INFO:tasks.workunit.client.0.smithi073.stderr: -299> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x55d6bc68ef70) adding con mode: secure 2024-09-12T00:54:44.316 INFO:tasks.workunit.client.0.smithi073.stderr: -298> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x55d6bc68ef70) adding con mode: crc 2024-09-12T00:54:44.316 INFO:tasks.workunit.client.0.smithi073.stderr: -297> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x55d6bc68ef70) adding con mode: secure 2024-09-12T00:54:44.316 INFO:tasks.workunit.client.0.smithi073.stderr: -296> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x55d6bc68ef70) adding con mode: crc 2024-09-12T00:54:44.316 INFO:tasks.workunit.client.0.smithi073.stderr: -295> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x55d6bc68ef70) adding con mode: crc 2024-09-12T00:54:44.316 INFO:tasks.workunit.client.0.smithi073.stderr: -294> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x55d6bc68ef70) adding con mode: secure 2024-09-12T00:54:44.317 INFO:tasks.workunit.client.0.smithi073.stderr: -293> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x55d6bc68ef70) adding con mode: crc 2024-09-12T00:54:44.317 INFO:tasks.workunit.client.0.smithi073.stderr: -292> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x55d6bc68ef70) adding con mode: secure 2024-09-12T00:54:44.317 INFO:tasks.workunit.client.0.smithi073.stderr: -291> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x55d6bc68ef70) adding con mode: crc 2024-09-12T00:54:44.317 INFO:tasks.workunit.client.0.smithi073.stderr: -290> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x55d6bc68ef70) adding con mode: secure 2024-09-12T00:54:44.317 INFO:tasks.workunit.client.0.smithi073.stderr: -289> 2024-09-12T00:54:43.967+0000 7f073df25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:44.317 INFO:tasks.workunit.client.0.smithi073.stderr: -288> 2024-09-12T00:54:43.967+0000 7f073df25800 10 monclient: init 2024-09-12T00:54:44.317 INFO:tasks.workunit.client.0.smithi073.stderr: -287> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x7ffef781bd70) adding auth protocol: cephx 2024-09-12T00:54:44.317 INFO:tasks.workunit.client.0.smithi073.stderr: -286> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x7ffef781bd70) adding auth protocol: cephx 2024-09-12T00:54:44.317 INFO:tasks.workunit.client.0.smithi073.stderr: -285> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x7ffef781bd70) adding auth protocol: cephx 2024-09-12T00:54:44.317 INFO:tasks.workunit.client.0.smithi073.stderr: -284> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x7ffef781bd70) adding con mode: secure 2024-09-12T00:54:44.317 INFO:tasks.workunit.client.0.smithi073.stderr: -283> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x7ffef781bd70) adding con mode: crc 2024-09-12T00:54:44.317 INFO:tasks.workunit.client.0.smithi073.stderr: -282> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x7ffef781bd70) adding con mode: secure 2024-09-12T00:54:44.317 INFO:tasks.workunit.client.0.smithi073.stderr: -281> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x7ffef781bd70) adding con mode: crc 2024-09-12T00:54:44.318 INFO:tasks.workunit.client.0.smithi073.stderr: -280> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x7ffef781bd70) adding con mode: secure 2024-09-12T00:54:44.318 INFO:tasks.workunit.client.0.smithi073.stderr: -279> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x7ffef781bd70) adding con mode: crc 2024-09-12T00:54:44.318 INFO:tasks.workunit.client.0.smithi073.stderr: -278> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x7ffef781bd70) adding con mode: crc 2024-09-12T00:54:44.318 INFO:tasks.workunit.client.0.smithi073.stderr: -277> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x7ffef781bd70) adding con mode: secure 2024-09-12T00:54:44.318 INFO:tasks.workunit.client.0.smithi073.stderr: -276> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x7ffef781bd70) adding con mode: crc 2024-09-12T00:54:44.318 INFO:tasks.workunit.client.0.smithi073.stderr: -275> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x7ffef781bd70) adding con mode: secure 2024-09-12T00:54:44.318 INFO:tasks.workunit.client.0.smithi073.stderr: -274> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x7ffef781bd70) adding con mode: crc 2024-09-12T00:54:44.318 INFO:tasks.workunit.client.0.smithi073.stderr: -273> 2024-09-12T00:54:43.967+0000 7f073df25800 5 AuthRegistry(0x7ffef781bd70) adding con mode: secure 2024-09-12T00:54:44.318 INFO:tasks.workunit.client.0.smithi073.stderr: -272> 2024-09-12T00:54:43.968+0000 7f073df25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:44.318 INFO:tasks.workunit.client.0.smithi073.stderr: -271> 2024-09-12T00:54:43.968+0000 7f073df25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:44.318 INFO:tasks.workunit.client.0.smithi073.stderr: -270> 2024-09-12T00:54:43.968+0000 7f073df25800 5 asok(0x55d6bc3d5630) register_command rotate-key cmddesc rotate-key hook 0x7ffef781beb8 EEXIST 2024-09-12T00:54:44.318 INFO:tasks.workunit.client.0.smithi073.stderr: -269> 2024-09-12T00:54:43.968+0000 7f073df25800 10 monclient: _reopen_session rank -1 2024-09-12T00:54:44.318 INFO:tasks.workunit.client.0.smithi073.stderr: -268> 2024-09-12T00:54:43.968+0000 7f073df25800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:54:44.318 INFO:tasks.workunit.client.0.smithi073.stderr: -267> 2024-09-12T00:54:43.968+0000 7f073df25800 10 monclient(hunting): picked mon.noname-b con 0x55d6bc6c34b0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:54:44.319 INFO:tasks.workunit.client.0.smithi073.stderr: -266> 2024-09-12T00:54:43.968+0000 7f073df25800 10 monclient(hunting): picked mon.noname-a con 0x55d6bc6bda50 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:54:44.319 INFO:tasks.workunit.client.0.smithi073.stderr: -265> 2024-09-12T00:54:43.968+0000 7f073df25800 10 monclient(hunting): picked mon.noname-c con 0x55d6bc6932f0 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:54:44.319 INFO:tasks.workunit.client.0.smithi073.stderr: -264> 2024-09-12T00:54:43.968+0000 7f073df25800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:44.319 INFO:tasks.workunit.client.0.smithi073.stderr: -263> 2024-09-12T00:54:43.968+0000 7f073df25800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:44.319 INFO:tasks.workunit.client.0.smithi073.stderr: -262> 2024-09-12T00:54:43.968+0000 7f073df25800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:44.319 INFO:tasks.workunit.client.0.smithi073.stderr: -261> 2024-09-12T00:54:43.968+0000 7f073df25800 10 monclient(hunting): _renew_subs 2024-09-12T00:54:44.319 INFO:tasks.workunit.client.0.smithi073.stderr: -260> 2024-09-12T00:54:43.968+0000 7f073df25800 10 monclient(hunting): authenticate will time out at 2344.638587s 2024-09-12T00:54:44.319 INFO:tasks.workunit.client.0.smithi073.stderr: -259> 2024-09-12T00:54:43.968+0000 7f0739332640 10 monclient(hunting): get_auth_request con 0x55d6bc6bda50 auth_method 0 2024-09-12T00:54:44.319 INFO:tasks.workunit.client.0.smithi073.stderr: -258> 2024-09-12T00:54:43.968+0000 7f0739332640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:44.319 INFO:tasks.workunit.client.0.smithi073.stderr: -257> 2024-09-12T00:54:43.968+0000 7f0739332640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:44.319 INFO:tasks.workunit.client.0.smithi073.stderr: -256> 2024-09-12T00:54:43.968+0000 7f0739332640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:44.319 INFO:tasks.workunit.client.0.smithi073.stderr: -255> 2024-09-12T00:54:43.968+0000 7f0739b33640 10 monclient(hunting): get_auth_request con 0x55d6bc6c34b0 auth_method 0 2024-09-12T00:54:44.319 INFO:tasks.workunit.client.0.smithi073.stderr: -254> 2024-09-12T00:54:43.968+0000 7f0739b33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:44.320 INFO:tasks.workunit.client.0.smithi073.stderr: -253> 2024-09-12T00:54:43.968+0000 7f0739b33640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:44.320 INFO:tasks.workunit.client.0.smithi073.stderr: -252> 2024-09-12T00:54:43.968+0000 7f0739b33640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:44.320 INFO:tasks.workunit.client.0.smithi073.stderr: -251> 2024-09-12T00:54:43.968+0000 7f0739332640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:44.320 INFO:tasks.workunit.client.0.smithi073.stderr: -250> 2024-09-12T00:54:43.968+0000 7f0739332640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:44.320 INFO:tasks.workunit.client.0.smithi073.stderr: -249> 2024-09-12T00:54:43.968+0000 7f0739332640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:44.320 INFO:tasks.workunit.client.0.smithi073.stderr: -248> 2024-09-12T00:54:43.968+0000 7f073a334640 10 monclient(hunting): get_auth_request con 0x55d6bc6932f0 auth_method 0 2024-09-12T00:54:44.320 INFO:tasks.workunit.client.0.smithi073.stderr: -247> 2024-09-12T00:54:43.968+0000 7f073a334640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:44.320 INFO:tasks.workunit.client.0.smithi073.stderr: -246> 2024-09-12T00:54:43.968+0000 7f073a334640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:44.320 INFO:tasks.workunit.client.0.smithi073.stderr: -245> 2024-09-12T00:54:43.968+0000 7f073a334640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:44.320 INFO:tasks.workunit.client.0.smithi073.stderr: -244> 2024-09-12T00:54:43.968+0000 7f073a334640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:44.320 INFO:tasks.workunit.client.0.smithi073.stderr: -243> 2024-09-12T00:54:43.968+0000 7f073a334640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:44.320 INFO:tasks.workunit.client.0.smithi073.stderr: -242> 2024-09-12T00:54:43.968+0000 7f073a334640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:44.320 INFO:tasks.workunit.client.0.smithi073.stderr: -241> 2024-09-12T00:54:43.968+0000 7f0739b33640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:44.321 INFO:tasks.workunit.client.0.smithi073.stderr: -240> 2024-09-12T00:54:43.968+0000 7f0739b33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:44.321 INFO:tasks.workunit.client.0.smithi073.stderr: -239> 2024-09-12T00:54:43.968+0000 7f0739b33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:44.321 INFO:tasks.workunit.client.0.smithi073.stderr: -238> 2024-09-12T00:54:43.968+0000 7f0739332640 10 monclient(hunting): handle_auth_done global_id 8322 payload 274 2024-09-12T00:54:44.321 INFO:tasks.workunit.client.0.smithi073.stderr: -237> 2024-09-12T00:54:43.968+0000 7f0739332640 10 monclient: _finish_hunting 0 2024-09-12T00:54:44.321 INFO:tasks.workunit.client.0.smithi073.stderr: -236> 2024-09-12T00:54:43.968+0000 7f0739332640 1 monclient: found mon.noname-a 2024-09-12T00:54:44.321 INFO:tasks.workunit.client.0.smithi073.stderr: -235> 2024-09-12T00:54:43.968+0000 7f0739332640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:54:44.321 INFO:tasks.workunit.client.0.smithi073.stderr: -234> 2024-09-12T00:54:43.969+0000 7f061d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:44.321 INFO:tasks.workunit.client.0.smithi073.stderr: -233> 2024-09-12T00:54:43.969+0000 7f061d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:54:44.321 INFO:tasks.workunit.client.0.smithi073.stderr: -232> 2024-09-12T00:54:43.969+0000 7f061d7fa640 10 monclient: dump: 2024-09-12T00:54:44.321 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:54:44.321 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:54:44.321 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:44.321 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:44.322 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:44.322 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:54:44.322 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:54:44.322 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:54:44.322 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:54:44.322 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:44.322 INFO:tasks.workunit.client.0.smithi073.stderr: -231> 2024-09-12T00:54:43.969+0000 7f061d7fa640 10 monclient: _finish_auth 0 2024-09-12T00:54:44.322 INFO:tasks.workunit.client.0.smithi073.stderr: -230> 2024-09-12T00:54:43.969+0000 7f061d7fa640 10 monclient: _check_auth_tickets 2024-09-12T00:54:44.322 INFO:tasks.workunit.client.0.smithi073.stderr: -229> 2024-09-12T00:54:43.969+0000 7f061d7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:44.322 INFO:tasks.workunit.client.0.smithi073.stderr: -228> 2024-09-12T00:54:43.969+0000 7f061d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:44.322 INFO:tasks.workunit.client.0.smithi073.stderr: -227> 2024-09-12T00:54:43.969+0000 7f061d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:54:44.322 INFO:tasks.workunit.client.0.smithi073.stderr: -226> 2024-09-12T00:54:43.969+0000 7f061d7fa640 10 monclient: dump: 2024-09-12T00:54:44.322 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:54:44.322 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:54:44.322 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:44.323 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:44.323 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:44.323 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:54:44.323 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:54:44.323 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:54:44.323 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:54:44.323 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:44.323 INFO:tasks.workunit.client.0.smithi073.stderr: -225> 2024-09-12T00:54:43.969+0000 7f073df25800 5 monclient: authenticate success, global_id 8322 2024-09-12T00:54:44.323 INFO:tasks.workunit.client.0.smithi073.stderr: -224> 2024-09-12T00:54:43.969+0000 7f073df25800 10 monclient: get_monmap_and_config success 2024-09-12T00:54:44.323 INFO:tasks.workunit.client.0.smithi073.stderr: -223> 2024-09-12T00:54:43.969+0000 7f073df25800 4 set_mon_vals no callback set 2024-09-12T00:54:44.323 INFO:tasks.workunit.client.0.smithi073.stderr: -222> 2024-09-12T00:54:43.969+0000 7f073df25800 10 monclient: shutdown 2024-09-12T00:54:44.323 INFO:tasks.workunit.client.0.smithi073.stderr: -221> 2024-09-12T00:54:43.969+0000 7f073df25800 10 monclient: build_initial_monmap 2024-09-12T00:54:44.323 INFO:tasks.workunit.client.0.smithi073.stderr: -220> 2024-09-12T00:54:43.969+0000 7f073df25800 1 build_initial for_mkfs: 0 2024-09-12T00:54:44.324 INFO:tasks.workunit.client.0.smithi073.stderr: -219> 2024-09-12T00:54:43.969+0000 7f073df25800 10 monclient: monmap: 2024-09-12T00:54:44.324 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:54:44.324 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:54:44.324 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:54:44.324 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:54:44.324 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:54:44.324 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:54:44.324 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:54:44.324 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:54:44.324 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:54:44.324 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:44.324 INFO:tasks.workunit.client.0.smithi073.stderr: -218> 2024-09-12T00:54:43.969+0000 7f073df25800 5 AuthRegistry(0x55d6bc6be960) adding auth protocol: cephx 2024-09-12T00:54:44.324 INFO:tasks.workunit.client.0.smithi073.stderr: -217> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6be960) adding auth protocol: cephx 2024-09-12T00:54:44.325 INFO:tasks.workunit.client.0.smithi073.stderr: -216> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6be960) adding auth protocol: cephx 2024-09-12T00:54:44.325 INFO:tasks.workunit.client.0.smithi073.stderr: -215> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6be960) adding con mode: secure 2024-09-12T00:54:44.325 INFO:tasks.workunit.client.0.smithi073.stderr: -214> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6be960) adding con mode: crc 2024-09-12T00:54:44.325 INFO:tasks.workunit.client.0.smithi073.stderr: -213> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6be960) adding con mode: secure 2024-09-12T00:54:44.325 INFO:tasks.workunit.client.0.smithi073.stderr: -212> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6be960) adding con mode: crc 2024-09-12T00:54:44.325 INFO:tasks.workunit.client.0.smithi073.stderr: -211> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6be960) adding con mode: secure 2024-09-12T00:54:44.325 INFO:tasks.workunit.client.0.smithi073.stderr: -210> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6be960) adding con mode: crc 2024-09-12T00:54:44.325 INFO:tasks.workunit.client.0.smithi073.stderr: -209> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6be960) adding con mode: crc 2024-09-12T00:54:44.325 INFO:tasks.workunit.client.0.smithi073.stderr: -208> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6be960) adding con mode: secure 2024-09-12T00:54:44.325 INFO:tasks.workunit.client.0.smithi073.stderr: -207> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6be960) adding con mode: crc 2024-09-12T00:54:44.325 INFO:tasks.workunit.client.0.smithi073.stderr: -206> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6be960) adding con mode: secure 2024-09-12T00:54:44.325 INFO:tasks.workunit.client.0.smithi073.stderr: -205> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6be960) adding con mode: crc 2024-09-12T00:54:44.325 INFO:tasks.workunit.client.0.smithi073.stderr: -204> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6be960) adding con mode: secure 2024-09-12T00:54:44.326 INFO:tasks.workunit.client.0.smithi073.stderr: -203> 2024-09-12T00:54:43.970+0000 7f073df25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:44.326 INFO:tasks.workunit.client.0.smithi073.stderr: -202> 2024-09-12T00:54:43.970+0000 7f073df25800 1 librados: starting msgr at 2024-09-12T00:54:44.326 INFO:tasks.workunit.client.0.smithi073.stderr: -201> 2024-09-12T00:54:43.970+0000 7f073df25800 1 librados: starting objecter 2024-09-12T00:54:44.326 INFO:tasks.workunit.client.0.smithi073.stderr: -200> 2024-09-12T00:54:43.970+0000 7f073df25800 5 asok(0x55d6bc3d5630) register_command objecter_requests cmddesc objecter_requests hook 0x55d6bc6b4ca0 EEXIST 2024-09-12T00:54:44.326 INFO:tasks.workunit.client.0.smithi073.stderr: -199> 2024-09-12T00:54:43.970+0000 7f073df25800 1 librados: setting wanted keys 2024-09-12T00:54:44.326 INFO:tasks.workunit.client.0.smithi073.stderr: -198> 2024-09-12T00:54:43.970+0000 7f073df25800 1 librados: calling monclient init 2024-09-12T00:54:44.326 INFO:tasks.workunit.client.0.smithi073.stderr: -197> 2024-09-12T00:54:43.970+0000 7f073df25800 10 monclient: init 2024-09-12T00:54:44.326 INFO:tasks.workunit.client.0.smithi073.stderr: -196> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6873e0) adding auth protocol: cephx 2024-09-12T00:54:44.326 INFO:tasks.workunit.client.0.smithi073.stderr: -195> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6873e0) adding auth protocol: cephx 2024-09-12T00:54:44.326 INFO:tasks.workunit.client.0.smithi073.stderr: -194> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6873e0) adding auth protocol: cephx 2024-09-12T00:54:44.326 INFO:tasks.workunit.client.0.smithi073.stderr: -193> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6873e0) adding con mode: secure 2024-09-12T00:54:44.326 INFO:tasks.workunit.client.0.smithi073.stderr: -192> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6873e0) adding con mode: crc 2024-09-12T00:54:44.326 INFO:tasks.workunit.client.0.smithi073.stderr: -191> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6873e0) adding con mode: secure 2024-09-12T00:54:44.326 INFO:tasks.workunit.client.0.smithi073.stderr: -190> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6873e0) adding con mode: crc 2024-09-12T00:54:44.327 INFO:tasks.workunit.client.0.smithi073.stderr: -189> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6873e0) adding con mode: secure 2024-09-12T00:54:44.327 INFO:tasks.workunit.client.0.smithi073.stderr: -188> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6873e0) adding con mode: crc 2024-09-12T00:54:44.327 INFO:tasks.workunit.client.0.smithi073.stderr: -187> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6873e0) adding con mode: crc 2024-09-12T00:54:44.327 INFO:tasks.workunit.client.0.smithi073.stderr: -186> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6873e0) adding con mode: secure 2024-09-12T00:54:44.327 INFO:tasks.workunit.client.0.smithi073.stderr: -185> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6873e0) adding con mode: crc 2024-09-12T00:54:44.327 INFO:tasks.workunit.client.0.smithi073.stderr: -184> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6873e0) adding con mode: secure 2024-09-12T00:54:44.327 INFO:tasks.workunit.client.0.smithi073.stderr: -183> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6873e0) adding con mode: crc 2024-09-12T00:54:44.327 INFO:tasks.workunit.client.0.smithi073.stderr: -182> 2024-09-12T00:54:43.970+0000 7f073df25800 5 AuthRegistry(0x55d6bc6873e0) adding con mode: secure 2024-09-12T00:54:44.327 INFO:tasks.workunit.client.0.smithi073.stderr: -181> 2024-09-12T00:54:43.970+0000 7f073df25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:44.327 INFO:tasks.workunit.client.0.smithi073.stderr: -180> 2024-09-12T00:54:43.970+0000 7f073df25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:44.327 INFO:tasks.workunit.client.0.smithi073.stderr: -179> 2024-09-12T00:54:43.970+0000 7f073df25800 5 asok(0x55d6bc3d5630) register_command rotate-key cmddesc rotate-key hook 0x55d6bc687528 EEXIST 2024-09-12T00:54:44.327 INFO:tasks.workunit.client.0.smithi073.stderr: -178> 2024-09-12T00:54:43.970+0000 7f073df25800 10 monclient: _reopen_session rank -1 2024-09-12T00:54:44.327 INFO:tasks.workunit.client.0.smithi073.stderr: -177> 2024-09-12T00:54:43.970+0000 7f073df25800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:54:44.327 INFO:tasks.workunit.client.0.smithi073.stderr: -176> 2024-09-12T00:54:43.970+0000 7f073df25800 10 monclient(hunting): picked mon.noname-b con 0x55d6bc6932f0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:54:44.328 INFO:tasks.workunit.client.0.smithi073.stderr: -175> 2024-09-12T00:54:43.970+0000 7f073df25800 10 monclient(hunting): picked mon.noname-c con 0x55d6bc6bda50 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:54:44.328 INFO:tasks.workunit.client.0.smithi073.stderr: -174> 2024-09-12T00:54:43.970+0000 7f073df25800 10 monclient(hunting): picked mon.noname-a con 0x55d6bc6c34b0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:54:44.328 INFO:tasks.workunit.client.0.smithi073.stderr: -173> 2024-09-12T00:54:43.970+0000 7f073df25800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:44.328 INFO:tasks.workunit.client.0.smithi073.stderr: -172> 2024-09-12T00:54:43.970+0000 7f073df25800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:44.328 INFO:tasks.workunit.client.0.smithi073.stderr: -171> 2024-09-12T00:54:43.970+0000 7f073df25800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:44.328 INFO:tasks.workunit.client.0.smithi073.stderr: -170> 2024-09-12T00:54:43.970+0000 7f073df25800 10 monclient(hunting): _renew_subs 2024-09-12T00:54:44.328 INFO:tasks.workunit.client.0.smithi073.stderr: -169> 2024-09-12T00:54:43.970+0000 7f073df25800 10 monclient(hunting): authenticate will time out at 2344.640991s 2024-09-12T00:54:44.328 INFO:tasks.workunit.client.0.smithi073.stderr: -168> 2024-09-12T00:54:43.971+0000 7f073a334640 10 monclient(hunting): get_auth_request con 0x55d6bc6c34b0 auth_method 0 2024-09-12T00:54:44.328 INFO:tasks.workunit.client.0.smithi073.stderr: -167> 2024-09-12T00:54:43.971+0000 7f073a334640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:44.328 INFO:tasks.workunit.client.0.smithi073.stderr: -166> 2024-09-12T00:54:43.971+0000 7f073a334640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:44.328 INFO:tasks.workunit.client.0.smithi073.stderr: -165> 2024-09-12T00:54:43.971+0000 7f073a334640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:44.328 INFO:tasks.workunit.client.0.smithi073.stderr: -164> 2024-09-12T00:54:43.971+0000 7f0739332640 10 monclient(hunting): get_auth_request con 0x55d6bc6bda50 auth_method 0 2024-09-12T00:54:44.328 INFO:tasks.workunit.client.0.smithi073.stderr: -163> 2024-09-12T00:54:43.971+0000 7f0739332640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:44.329 INFO:tasks.workunit.client.0.smithi073.stderr: -162> 2024-09-12T00:54:43.971+0000 7f0739332640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:44.329 INFO:tasks.workunit.client.0.smithi073.stderr: -161> 2024-09-12T00:54:43.971+0000 7f0739332640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:44.329 INFO:tasks.workunit.client.0.smithi073.stderr: -160> 2024-09-12T00:54:43.971+0000 7f0739b33640 10 monclient(hunting): get_auth_request con 0x55d6bc6932f0 auth_method 0 2024-09-12T00:54:44.329 INFO:tasks.workunit.client.0.smithi073.stderr: -159> 2024-09-12T00:54:43.971+0000 7f0739b33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:44.329 INFO:tasks.workunit.client.0.smithi073.stderr: -158> 2024-09-12T00:54:43.971+0000 7f0739b33640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:44.329 INFO:tasks.workunit.client.0.smithi073.stderr: -157> 2024-09-12T00:54:43.971+0000 7f0739b33640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:44.329 INFO:tasks.workunit.client.0.smithi073.stderr: -156> 2024-09-12T00:54:43.971+0000 7f073a334640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:44.329 INFO:tasks.workunit.client.0.smithi073.stderr: -155> 2024-09-12T00:54:43.971+0000 7f073a334640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:44.329 INFO:tasks.workunit.client.0.smithi073.stderr: -154> 2024-09-12T00:54:43.971+0000 7f073a334640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:44.329 INFO:tasks.workunit.client.0.smithi073.stderr: -153> 2024-09-12T00:54:43.971+0000 7f0739332640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:44.329 INFO:tasks.workunit.client.0.smithi073.stderr: -152> 2024-09-12T00:54:43.971+0000 7f0739332640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:44.329 INFO:tasks.workunit.client.0.smithi073.stderr: -151> 2024-09-12T00:54:43.971+0000 7f0739332640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:44.330 INFO:tasks.workunit.client.0.smithi073.stderr: -150> 2024-09-12T00:54:43.971+0000 7f0739b33640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:44.330 INFO:tasks.workunit.client.0.smithi073.stderr: -149> 2024-09-12T00:54:43.971+0000 7f0739b33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:44.330 INFO:tasks.workunit.client.0.smithi073.stderr: -148> 2024-09-12T00:54:43.971+0000 7f0739b33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:44.330 INFO:tasks.workunit.client.0.smithi073.stderr: -147> 2024-09-12T00:54:43.971+0000 7f073a334640 10 monclient(hunting): handle_auth_done global_id 8325 payload 824 2024-09-12T00:54:44.330 INFO:tasks.workunit.client.0.smithi073.stderr: -146> 2024-09-12T00:54:43.971+0000 7f073a334640 10 monclient: _finish_hunting 0 2024-09-12T00:54:44.330 INFO:tasks.workunit.client.0.smithi073.stderr: -145> 2024-09-12T00:54:43.971+0000 7f073a334640 1 monclient: found mon.noname-a 2024-09-12T00:54:44.330 INFO:tasks.workunit.client.0.smithi073.stderr: -144> 2024-09-12T00:54:43.971+0000 7f073a334640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:54:44.330 INFO:tasks.workunit.client.0.smithi073.stderr: -143> 2024-09-12T00:54:43.971+0000 7f060b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:44.330 INFO:tasks.workunit.client.0.smithi073.stderr: -142> 2024-09-12T00:54:43.971+0000 7f060b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:54:44.330 INFO:tasks.workunit.client.0.smithi073.stderr: -141> 2024-09-12T00:54:43.971+0000 7f060b7fe640 10 monclient: dump: 2024-09-12T00:54:44.330 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:54:44.330 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:54:44.330 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:44.331 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:44.331 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:44.331 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:54:44.331 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:54:44.331 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:54:44.331 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:54:44.331 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:44.331 INFO:tasks.workunit.client.0.smithi073.stderr: -140> 2024-09-12T00:54:43.971+0000 7f060b7fe640 10 monclient: _finish_auth 0 2024-09-12T00:54:44.331 INFO:tasks.workunit.client.0.smithi073.stderr: -139> 2024-09-12T00:54:43.971+0000 7f060b7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:54:44.331 INFO:tasks.workunit.client.0.smithi073.stderr: -138> 2024-09-12T00:54:43.971+0000 7f060b7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:44.331 INFO:tasks.workunit.client.0.smithi073.stderr: -137> 2024-09-12T00:54:43.971+0000 7f060b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:44.331 INFO:tasks.workunit.client.0.smithi073.stderr: -136> 2024-09-12T00:54:43.971+0000 7f060b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:54:44.331 INFO:tasks.workunit.client.0.smithi073.stderr: -135> 2024-09-12T00:54:43.971+0000 7f060b7fe640 10 monclient: dump: 2024-09-12T00:54:44.331 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:54:44.332 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:54:44.332 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:44.332 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:54:44.332 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:44.332 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:54:44.332 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:54:44.332 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:54:44.332 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:54:44.332 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:44.332 INFO:tasks.workunit.client.0.smithi073.stderr: -134> 2024-09-12T00:54:43.971+0000 7f073df25800 5 monclient: authenticate success, global_id 8325 2024-09-12T00:54:44.332 INFO:tasks.workunit.client.0.smithi073.stderr: -133> 2024-09-12T00:54:43.971+0000 7f073df25800 10 monclient: _renew_subs 2024-09-12T00:54:44.332 INFO:tasks.workunit.client.0.smithi073.stderr: -132> 2024-09-12T00:54:43.971+0000 7f061d7fa640 4 set_mon_vals no callback set 2024-09-12T00:54:44.333 INFO:tasks.workunit.client.0.smithi073.stderr: -131> 2024-09-12T00:54:43.971+0000 7f073df25800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:54:44.333 INFO:tasks.workunit.client.0.smithi073.stderr: -130> 2024-09-12T00:54:43.971+0000 7f073df25800 10 monclient: _renew_subs 2024-09-12T00:54:44.333 INFO:tasks.workunit.client.0.smithi073.stderr: -129> 2024-09-12T00:54:43.971+0000 7f073df25800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:54:44.333 INFO:tasks.workunit.client.0.smithi073.stderr: -128> 2024-09-12T00:54:43.971+0000 7f073df25800 1 librados: init done 2024-09-12T00:54:44.333 INFO:tasks.workunit.client.0.smithi073.stderr: -127> 2024-09-12T00:54:43.971+0000 7f073df25800 5 asok(0x55d6bc3d5630) register_command cr dump hook 0x55d6bc6c11b8 2024-09-12T00:54:44.333 INFO:tasks.workunit.client.0.smithi073.stderr: -126> 2024-09-12T00:54:43.973+0000 7f073df25800 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.333 INFO:tasks.workunit.client.0.smithi073.stderr: -125> 2024-09-12T00:54:43.974+0000 7f060b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:54:44.333 INFO:tasks.workunit.client.0.smithi073.stderr: -124> 2024-09-12T00:54:43.974+0000 7f060b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:54:44.333 INFO:tasks.workunit.client.0.smithi073.stderr: -123> 2024-09-12T00:54:43.974+0000 7f060b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:54:44.333 INFO:tasks.workunit.client.0.smithi073.stderr: -122> 2024-09-12T00:54:43.974+0000 7f0739b33640 10 monclient: get_auth_request con 0x7f0604076470 auth_method 0 2024-09-12T00:54:44.333 INFO:tasks.workunit.client.0.smithi073.stderr: -121> 2024-09-12T00:54:43.974+0000 7f0739332640 10 monclient: get_auth_request con 0x55d6bc6dd570 auth_method 0 2024-09-12T00:54:44.333 INFO:tasks.workunit.client.0.smithi073.stderr: -120> 2024-09-12T00:54:43.975+0000 7f073df25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:44.333 INFO:tasks.workunit.client.0.smithi073.stderr: -119> 2024-09-12T00:54:43.975+0000 7f073df25800 20 realm 2024-09-12T00:54:44.333 INFO:tasks.workunit.client.0.smithi073.stderr: -118> 2024-09-12T00:54:43.975+0000 7f073df25800 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.334 INFO:tasks.workunit.client.0.smithi073.stderr: -117> 2024-09-12T00:54:43.975+0000 7f073df25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:44.334 INFO:tasks.workunit.client.0.smithi073.stderr: -116> 2024-09-12T00:54:43.975+0000 7f073df25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:44.334 INFO:tasks.workunit.client.0.smithi073.stderr: -115> 2024-09-12T00:54:43.975+0000 7f073df25800 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.334 INFO:tasks.workunit.client.0.smithi073.stderr: -114> 2024-09-12T00:54:43.975+0000 7f073df25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:44.334 INFO:tasks.workunit.client.0.smithi073.stderr: -113> 2024-09-12T00:54:43.975+0000 7f073df25800 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.334 INFO:tasks.workunit.client.0.smithi073.stderr: -112> 2024-09-12T00:54:43.975+0000 7f0739b33640 10 monclient: get_auth_request con 0x55d6bc6e17d0 auth_method 0 2024-09-12T00:54:44.334 INFO:tasks.workunit.client.0.smithi073.stderr: -111> 2024-09-12T00:54:43.976+0000 7f073df25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:44.334 INFO:tasks.workunit.client.0.smithi073.stderr: -110> 2024-09-12T00:54:43.976+0000 7f073df25800 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.334 INFO:tasks.workunit.client.0.smithi073.stderr: -109> 2024-09-12T00:54:43.976+0000 7f0739332640 10 monclient: get_auth_request con 0x55d6bc6e5030 auth_method 0 2024-09-12T00:54:44.334 INFO:tasks.workunit.client.0.smithi073.stderr: -108> 2024-09-12T00:54:43.977+0000 7f073df25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:44.334 INFO:tasks.workunit.client.0.smithi073.stderr: -107> 2024-09-12T00:54:43.977+0000 7f073df25800 20 searching for the correct realm 2024-09-12T00:54:44.334 INFO:tasks.workunit.client.0.smithi073.stderr: -106> 2024-09-12T00:54:43.977+0000 7f073a334640 10 monclient: get_auth_request con 0x55d6bc6e9d80 auth_method 0 2024-09-12T00:54:44.334 INFO:tasks.workunit.client.0.smithi073.stderr: -105> 2024-09-12T00:54:43.978+0000 7f0739b33640 10 monclient: get_auth_request con 0x7f0734081070 auth_method 0 2024-09-12T00:54:44.334 INFO:tasks.workunit.client.0.smithi073.stderr: -104> 2024-09-12T00:54:43.978+0000 7f0739b33640 0 -- 172.21.15.73:0/2445320828 >> [v2:172.21.15.117:6816/1460498570,v1:172.21.15.117:6817/1460498570] conn(0x7f0734081070 msgr2=0x7f07340a7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:44.335 INFO:tasks.workunit.client.0.smithi073.stderr: -103> 2024-09-12T00:54:44.179+0000 7f0739b33640 10 monclient: get_auth_request con 0x7f0734081070 auth_method 0 2024-09-12T00:54:44.335 INFO:tasks.workunit.client.0.smithi073.stderr: -102> 2024-09-12T00:54:44.180+0000 7f0739332640 10 monclient: get_auth_request con 0x7f072c05a040 auth_method 0 2024-09-12T00:54:44.335 INFO:tasks.workunit.client.0.smithi073.stderr: -101> 2024-09-12T00:54:44.181+0000 7f073a334640 10 monclient: get_auth_request con 0x7f073002b060 auth_method 0 2024-09-12T00:54:44.335 INFO:tasks.workunit.client.0.smithi073.stderr: -100> 2024-09-12T00:54:44.184+0000 7f0739332640 0 -- 172.21.15.73:0/2445320828 >> [v2:172.21.15.73:6826/269690776,v1:172.21.15.73:6827/269690776] conn(0x7f072c05a040 msgr2=0x7f072c030400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:44.335 INFO:tasks.workunit.client.0.smithi073.stderr: -99> 2024-09-12T00:54:44.184+0000 7f060b7fe640 1 client.8325.objecter ms_handle_reset 0x7f072c05a040 session 0x7f072c045040 osd.2 2024-09-12T00:54:44.335 INFO:tasks.workunit.client.0.smithi073.stderr: -98> 2024-09-12T00:54:44.184+0000 7f060b7fe640 10 monclient: _renew_subs 2024-09-12T00:54:44.335 INFO:tasks.workunit.client.0.smithi073.stderr: -97> 2024-09-12T00:54:44.184+0000 7f060b7fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:54:44.335 INFO:tasks.workunit.client.0.smithi073.stderr: -96> 2024-09-12T00:54:44.184+0000 7f0739332640 10 monclient: get_auth_request con 0x7f0604086310 auth_method 0 2024-09-12T00:54:44.335 INFO:tasks.workunit.client.0.smithi073.stderr: -95> 2024-09-12T00:54:44.185+0000 7f0739b33640 10 monclient: get_auth_request con 0x7f0734065040 auth_method 0 2024-09-12T00:54:44.335 INFO:tasks.workunit.client.0.smithi073.stderr: -94> 2024-09-12T00:54:44.190+0000 7f073df25800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:54:44.335 INFO:tasks.workunit.client.0.smithi073.stderr: -93> 2024-09-12T00:54:44.190+0000 7f073df25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:44.335 INFO:tasks.workunit.client.0.smithi073.stderr: -92> 2024-09-12T00:54:44.190+0000 7f073df25800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:54:44.335 INFO:tasks.workunit.client.0.smithi073.stderr: -91> 2024-09-12T00:54:44.190+0000 7f073df25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:44.336 INFO:tasks.workunit.client.0.smithi073.stderr: -90> 2024-09-12T00:54:44.190+0000 7f073df25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:44.336 INFO:tasks.workunit.client.0.smithi073.stderr: -89> 2024-09-12T00:54:44.190+0000 7f073df25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:44.336 INFO:tasks.workunit.client.0.smithi073.stderr: -88> 2024-09-12T00:54:44.190+0000 7f073df25800 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.336 INFO:tasks.workunit.client.0.smithi073.stderr: -87> 2024-09-12T00:54:44.190+0000 7f073df25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:44.336 INFO:tasks.workunit.client.0.smithi073.stderr: -86> 2024-09-12T00:54:44.190+0000 7f073df25800 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.336 INFO:tasks.workunit.client.0.smithi073.stderr: -85> 2024-09-12T00:54:44.191+0000 7f073df25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:44.336 INFO:tasks.workunit.client.0.smithi073.stderr: -84> 2024-09-12T00:54:44.191+0000 7f073df25800 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.336 INFO:tasks.workunit.client.0.smithi073.stderr: -83> 2024-09-12T00:54:44.191+0000 7f073df25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:44.336 INFO:tasks.workunit.client.0.smithi073.stderr: -82> 2024-09-12T00:54:44.191+0000 7f073df25800 20 zone default found 2024-09-12T00:54:44.336 INFO:tasks.workunit.client.0.smithi073.stderr: -81> 2024-09-12T00:54:44.191+0000 7f073df25800 4 Realm: () 2024-09-12T00:54:44.336 INFO:tasks.workunit.client.0.smithi073.stderr: -80> 2024-09-12T00:54:44.191+0000 7f073df25800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:54:44.336 INFO:tasks.workunit.client.0.smithi073.stderr: -79> 2024-09-12T00:54:44.191+0000 7f073df25800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:54:44.336 INFO:tasks.workunit.client.0.smithi073.stderr: -78> 2024-09-12T00:54:44.191+0000 7f073df25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:44.337 INFO:tasks.workunit.client.0.smithi073.stderr: -77> 2024-09-12T00:54:44.191+0000 7f073df25800 20 zonegroup default 2024-09-12T00:54:44.337 INFO:tasks.workunit.client.0.smithi073.stderr: -76> 2024-09-12T00:54:44.191+0000 7f073df25800 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.337 INFO:tasks.workunit.client.0.smithi073.stderr: -75> 2024-09-12T00:54:44.191+0000 7f073df25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:44.337 INFO:tasks.workunit.client.0.smithi073.stderr: -74> 2024-09-12T00:54:44.191+0000 7f073df25800 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.337 INFO:tasks.workunit.client.0.smithi073.stderr: -73> 2024-09-12T00:54:44.192+0000 7f073df25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:44.337 INFO:tasks.workunit.client.0.smithi073.stderr: -72> 2024-09-12T00:54:44.192+0000 7f073df25800 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.337 INFO:tasks.workunit.client.0.smithi073.stderr: -71> 2024-09-12T00:54:44.192+0000 7f073df25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:44.337 INFO:tasks.workunit.client.0.smithi073.stderr: -70> 2024-09-12T00:54:44.192+0000 7f073df25800 20 started sync module instance, tier type = 2024-09-12T00:54:44.337 INFO:tasks.workunit.client.0.smithi073.stderr: -69> 2024-09-12T00:54:44.192+0000 7f073df25800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:54:44.337 INFO:tasks.workunit.client.0.smithi073.stderr: -68> 2024-09-12T00:54:44.202+0000 7f073df25800 20 add_watcher() i=0 2024-09-12T00:54:44.337 INFO:tasks.workunit.client.0.smithi073.stderr: -67> 2024-09-12T00:54:44.202+0000 7f073df25800 20 add_watcher() i=1 2024-09-12T00:54:44.337 INFO:tasks.workunit.client.0.smithi073.stderr: -66> 2024-09-12T00:54:44.202+0000 7f073df25800 20 add_watcher() i=2 2024-09-12T00:54:44.337 INFO:tasks.workunit.client.0.smithi073.stderr: -65> 2024-09-12T00:54:44.202+0000 7f073df25800 20 add_watcher() i=3 2024-09-12T00:54:44.338 INFO:tasks.workunit.client.0.smithi073.stderr: -64> 2024-09-12T00:54:44.202+0000 7f073df25800 20 add_watcher() i=4 2024-09-12T00:54:44.338 INFO:tasks.workunit.client.0.smithi073.stderr: -63> 2024-09-12T00:54:44.202+0000 7f073df25800 20 add_watcher() i=5 2024-09-12T00:54:44.338 INFO:tasks.workunit.client.0.smithi073.stderr: -62> 2024-09-12T00:54:44.202+0000 7f073df25800 20 add_watcher() i=6 2024-09-12T00:54:44.338 INFO:tasks.workunit.client.0.smithi073.stderr: -61> 2024-09-12T00:54:44.203+0000 7f073df25800 20 add_watcher() i=7 2024-09-12T00:54:44.338 INFO:tasks.workunit.client.0.smithi073.stderr: -60> 2024-09-12T00:54:44.203+0000 7f073df25800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:44.338 INFO:tasks.workunit.client.0.smithi073.stderr: -59> 2024-09-12T00:54:44.204+0000 7f073df25800 5 AuthRegistry(0x7ffef781c250) adding auth protocol: cephx 2024-09-12T00:54:44.338 INFO:tasks.workunit.client.0.smithi073.stderr: -58> 2024-09-12T00:54:44.204+0000 7f073df25800 5 AuthRegistry(0x7ffef781c250) adding auth protocol: cephx 2024-09-12T00:54:44.338 INFO:tasks.workunit.client.0.smithi073.stderr: -57> 2024-09-12T00:54:44.204+0000 7f073df25800 5 AuthRegistry(0x7ffef781c250) adding auth protocol: cephx 2024-09-12T00:54:44.338 INFO:tasks.workunit.client.0.smithi073.stderr: -56> 2024-09-12T00:54:44.204+0000 7f073df25800 5 AuthRegistry(0x7ffef781c250) adding con mode: secure 2024-09-12T00:54:44.338 INFO:tasks.workunit.client.0.smithi073.stderr: -55> 2024-09-12T00:54:44.204+0000 7f073df25800 5 AuthRegistry(0x7ffef781c250) adding con mode: crc 2024-09-12T00:54:44.338 INFO:tasks.workunit.client.0.smithi073.stderr: -54> 2024-09-12T00:54:44.204+0000 7f073df25800 5 AuthRegistry(0x7ffef781c250) adding con mode: secure 2024-09-12T00:54:44.338 INFO:tasks.workunit.client.0.smithi073.stderr: -53> 2024-09-12T00:54:44.204+0000 7f073df25800 5 AuthRegistry(0x7ffef781c250) adding con mode: crc 2024-09-12T00:54:44.338 INFO:tasks.workunit.client.0.smithi073.stderr: -52> 2024-09-12T00:54:44.204+0000 7f073df25800 5 AuthRegistry(0x7ffef781c250) adding con mode: secure 2024-09-12T00:54:44.338 INFO:tasks.workunit.client.0.smithi073.stderr: -51> 2024-09-12T00:54:44.204+0000 7f073df25800 5 AuthRegistry(0x7ffef781c250) adding con mode: crc 2024-09-12T00:54:44.339 INFO:tasks.workunit.client.0.smithi073.stderr: -50> 2024-09-12T00:54:44.204+0000 7f073df25800 5 AuthRegistry(0x7ffef781c250) adding con mode: crc 2024-09-12T00:54:44.339 INFO:tasks.workunit.client.0.smithi073.stderr: -49> 2024-09-12T00:54:44.204+0000 7f073df25800 5 AuthRegistry(0x7ffef781c250) adding con mode: secure 2024-09-12T00:54:44.339 INFO:tasks.workunit.client.0.smithi073.stderr: -48> 2024-09-12T00:54:44.204+0000 7f073df25800 5 AuthRegistry(0x7ffef781c250) adding con mode: crc 2024-09-12T00:54:44.339 INFO:tasks.workunit.client.0.smithi073.stderr: -47> 2024-09-12T00:54:44.204+0000 7f073df25800 5 AuthRegistry(0x7ffef781c250) adding con mode: secure 2024-09-12T00:54:44.339 INFO:tasks.workunit.client.0.smithi073.stderr: -46> 2024-09-12T00:54:44.204+0000 7f05eb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:44.339 INFO:tasks.workunit.client.0.smithi073.stderr: -45> 2024-09-12T00:54:44.204+0000 7f073df25800 5 AuthRegistry(0x7ffef781c250) adding con mode: crc 2024-09-12T00:54:44.339 INFO:tasks.workunit.client.0.smithi073.stderr: -44> 2024-09-12T00:54:44.204+0000 7f073df25800 5 AuthRegistry(0x7ffef781c250) adding con mode: secure 2024-09-12T00:54:44.339 INFO:tasks.workunit.client.0.smithi073.stderr: -43> 2024-09-12T00:54:44.205+0000 7f073df25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:44.339 INFO:tasks.workunit.client.0.smithi073.stderr: -42> 2024-09-12T00:54:44.205+0000 7f073df25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:44.339 INFO:tasks.workunit.client.0.smithi073.stderr: -41> 2024-09-12T00:54:44.205+0000 7f073df25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:44.339 INFO:tasks.workunit.client.0.smithi073.stderr: -40> 2024-09-12T00:54:44.205+0000 7f073df25800 5 asok(0x55d6bc3d5630) register_command cache list hook 0x55d6bc6b9a40 2024-09-12T00:54:44.339 INFO:tasks.workunit.client.0.smithi073.stderr: -39> 2024-09-12T00:54:44.205+0000 7f073df25800 5 asok(0x55d6bc3d5630) register_command cache inspect hook 0x55d6bc6b9a40 2024-09-12T00:54:44.339 INFO:tasks.workunit.client.0.smithi073.stderr: -38> 2024-09-12T00:54:44.205+0000 7f073df25800 5 asok(0x55d6bc3d5630) register_command cache erase hook 0x55d6bc6b9a40 2024-09-12T00:54:44.340 INFO:tasks.workunit.client.0.smithi073.stderr: -37> 2024-09-12T00:54:44.205+0000 7f073df25800 5 asok(0x55d6bc3d5630) register_command cache zap hook 0x55d6bc6b9a40 2024-09-12T00:54:44.340 INFO:tasks.workunit.client.0.smithi073.stderr: -36> 2024-09-12T00:54:44.205+0000 7f073df25800 5 note: GC not initialized 2024-09-12T00:54:44.340 INFO:tasks.workunit.client.0.smithi073.stderr: -35> 2024-09-12T00:54:44.205+0000 7f05ea7fc640 20 reqs_thread_entry: start 2024-09-12T00:54:44.340 INFO:tasks.workunit.client.0.smithi073.stderr: -34> 2024-09-12T00:54:44.205+0000 7f073df25800 5 asok(0x55d6bc3d5630) register_command sync trace show hook 0x7f0734068040 2024-09-12T00:54:44.340 INFO:tasks.workunit.client.0.smithi073.stderr: -33> 2024-09-12T00:54:44.205+0000 7f073df25800 5 asok(0x55d6bc3d5630) register_command sync trace history hook 0x7f0734068040 2024-09-12T00:54:44.340 INFO:tasks.workunit.client.0.smithi073.stderr: -32> 2024-09-12T00:54:44.205+0000 7f073df25800 5 asok(0x55d6bc3d5630) register_command sync trace active hook 0x7f0734068040 2024-09-12T00:54:44.340 INFO:tasks.workunit.client.0.smithi073.stderr: -31> 2024-09-12T00:54:44.205+0000 7f073df25800 5 asok(0x55d6bc3d5630) register_command sync trace active_short hook 0x7f0734068040 2024-09-12T00:54:44.340 INFO:tasks.workunit.client.0.smithi073.stderr: -30> 2024-09-12T00:54:44.205+0000 7f073df25800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:44.340 INFO:tasks.workunit.client.0.smithi073.stderr: -29> 2024-09-12T00:54:44.205+0000 7f073df25800 20 Filter name: none 2024-09-12T00:54:44.340 INFO:tasks.workunit.client.0.smithi073.stderr: -28> 2024-09-12T00:54:44.205+0000 7f055ffff640 20 reqs_thread_entry: start 2024-09-12T00:54:44.340 INFO:tasks.workunit.client.0.smithi073.stderr: -27> 2024-09-12T00:54:44.205+0000 7f073df25800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:54:44.340 INFO:tasks.workunit.client.0.smithi073.stderr: -26> 2024-09-12T00:54:44.205+0000 7f073df25800 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.340 INFO:tasks.workunit.client.0.smithi073.stderr: -25> 2024-09-12T00:54:44.206+0000 7f073df25800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:54:44.341 INFO:tasks.workunit.client.0.smithi073.stderr: -24> 2024-09-12T00:54:44.206+0000 7f073df25800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:54:44.341 INFO:tasks.workunit.client.0.smithi073.stderr: -23> 2024-09-12T00:54:44.206+0000 7f073df25800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:54:44.341 INFO:tasks.workunit.client.0.smithi073.stderr: -22> 2024-09-12T00:54:44.206+0000 7f073df25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 : miss 2024-09-12T00:54:44.341 INFO:tasks.workunit.client.0.smithi073.stderr: -21> 2024-09-12T00:54:44.206+0000 7f073df25800 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.341 INFO:tasks.workunit.client.0.smithi073.stderr: -20> 2024-09-12T00:54:44.206+0000 7f073df25800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:54:44.341 INFO:tasks.workunit.client.0.smithi073.stderr: -19> 2024-09-12T00:54:44.206+0000 7f073df25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:54:44.341 INFO:tasks.workunit.client.0.smithi073.stderr: -18> 2024-09-12T00:54:44.206+0000 7f073df25800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:54:44.341 INFO:tasks.workunit.client.0.smithi073.stderr: -17> 2024-09-12T00:54:44.206+0000 7f073df25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:54:44.341 INFO:tasks.workunit.client.0.smithi073.stderr: -16> 2024-09-12T00:54:44.206+0000 7f073df25800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:54:44.341 INFO:tasks.workunit.client.0.smithi073.stderr: -15> 2024-09-12T00:54:44.206+0000 7f073df25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 2024-09-12T00:54:44.341 INFO:tasks.workunit.client.0.smithi073.stderr: -14> 2024-09-12T00:54:44.207+0000 7f073df25800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:54:44.341 INFO:tasks.workunit.client.0.smithi073.stderr: -13> 2024-09-12T00:54:44.212+0000 7f073df25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:54:44.341 INFO:tasks.workunit.client.0.smithi073.stderr: -12> 2024-09-12T00:54:44.212+0000 7f073df25800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:54:44.342 INFO:tasks.workunit.client.0.smithi073.stderr: -11> 2024-09-12T00:54:44.212+0000 7f073df25800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:54:44.342 INFO:tasks.workunit.client.0.smithi073.stderr: -10> 2024-09-12T00:54:44.212+0000 7f073df25800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17, ofs0, ns] 2024-09-12T00:54:44.342 INFO:tasks.workunit.client.0.smithi073.stderr: -9> 2024-09-12T00:54:44.212+0000 7f061d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497047 cookie 94380772763360 notifier 8325 bl.length()=827 2024-09-12T00:54:44.342 INFO:tasks.workunit.client.0.smithi073.stderr: -8> 2024-09-12T00:54:44.212+0000 7f061d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:54:44.342 INFO:tasks.workunit.client.0.smithi073.stderr: -7> 2024-09-12T00:54:44.212+0000 7f061d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:54:44.342 INFO:tasks.workunit.client.0.smithi073.stderr: -6> 2024-09-12T00:54:44.212+0000 7f061d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:54:44.342 INFO:tasks.workunit.client.0.smithi073.stderr: -5> 2024-09-12T00:54:44.214+0000 7f073df25800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): orig_sources= new_sources= 2024-09-12T00:54:44.342 INFO:tasks.workunit.client.0.smithi073.stderr: -4> 2024-09-12T00:54:44.214+0000 7f073df25800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): potential sources added=[] removed=[] 2024-09-12T00:54:44.342 INFO:tasks.workunit.client.0.smithi073.stderr: -3> 2024-09-12T00:54:44.214+0000 7f073df25800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): orig_dests= new_dests= 2024-09-12T00:54:44.342 INFO:tasks.workunit.client.0.smithi073.stderr: -2> 2024-09-12T00:54:44.214+0000 7f073df25800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): potential dests added=[] removed=[] 2024-09-12T00:54:44.342 INFO:tasks.workunit.client.0.smithi073.stderr: -1> 2024-09-12T00:54:44.217+0000 7f073df25800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f073df25800 time 2024-09-12T00:54:44.217611+0000 2024-09-12T00:54:44.342 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:54:44.342 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:44.342 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:44.343 INFO:tasks.workunit.client.0.smithi073.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f073f58c71a] 2024-09-12T00:54:44.343 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f073f58c8d8] 2024-09-12T00:54:44.343 INFO:tasks.workunit.client.0.smithi073.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d6bb761641] 2024-09-12T00:54:44.343 INFO:tasks.workunit.client.0.smithi073.stderr: 4: radosgw-admin(+0xd8854c) [0x55d6bbc7454c] 2024-09-12T00:54:44.343 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d6bb77131d] 2024-09-12T00:54:44.343 INFO:tasks.workunit.client.0.smithi073.stderr: 6: main() 2024-09-12T00:54:44.343 INFO:tasks.workunit.client.0.smithi073.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f073e229590] 2024-09-12T00:54:44.343 INFO:tasks.workunit.client.0.smithi073.stderr: 8: __libc_start_main() 2024-09-12T00:54:44.343 INFO:tasks.workunit.client.0.smithi073.stderr: 9: _start() 2024-09-12T00:54:44.343 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:44.343 INFO:tasks.workunit.client.0.smithi073.stderr: 0> 2024-09-12T00:54:44.218+0000 7f073df25800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:54:44.343 INFO:tasks.workunit.client.0.smithi073.stderr: in thread 7f073df25800 thread_name:radosgw-admin 2024-09-12T00:54:44.343 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:44.344 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:44.344 INFO:tasks.workunit.client.0.smithi073.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f073e23e6f0] 2024-09-12T00:54:44.344 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f073e28b99c] 2024-09-12T00:54:44.344 INFO:tasks.workunit.client.0.smithi073.stderr: 3: raise() 2024-09-12T00:54:44.344 INFO:tasks.workunit.client.0.smithi073.stderr: 4: abort() 2024-09-12T00:54:44.344 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f073f58c774] 2024-09-12T00:54:44.344 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f073f58c8d8] 2024-09-12T00:54:44.344 INFO:tasks.workunit.client.0.smithi073.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d6bb761641] 2024-09-12T00:54:44.344 INFO:tasks.workunit.client.0.smithi073.stderr: 8: radosgw-admin(+0xd8854c) [0x55d6bbc7454c] 2024-09-12T00:54:44.344 INFO:tasks.workunit.client.0.smithi073.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d6bb77131d] 2024-09-12T00:54:44.344 INFO:tasks.workunit.client.0.smithi073.stderr: 10: main() 2024-09-12T00:54:44.344 INFO:tasks.workunit.client.0.smithi073.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f073e229590] 2024-09-12T00:54:44.344 INFO:tasks.workunit.client.0.smithi073.stderr: 12: __libc_start_main() 2024-09-12T00:54:44.345 INFO:tasks.workunit.client.0.smithi073.stderr: 13: _start() 2024-09-12T00:54:44.345 INFO:tasks.workunit.client.0.smithi073.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:54:44.345 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:54:44.345 INFO:tasks.workunit.client.0.smithi073.stderr:--- logging levels --- 2024-09-12T00:54:44.345 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 none 2024-09-12T00:54:44.345 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 lockdep 2024-09-12T00:54:44.345 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 context 2024-09-12T00:54:44.345 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 crush 2024-09-12T00:54:44.345 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds 2024-09-12T00:54:44.345 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_balancer 2024-09-12T00:54:44.345 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_locker 2024-09-12T00:54:44.345 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_log 2024-09-12T00:54:44.345 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_log_expire 2024-09-12T00:54:44.346 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_migrator 2024-09-12T00:54:44.346 INFO:tasks.workunit.client.0.smithi073.stderr: 3/ 5 mds_quiesce 2024-09-12T00:54:44.346 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 buffer 2024-09-12T00:54:44.346 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 timer 2024-09-12T00:54:44.346 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 filer 2024-09-12T00:54:44.346 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 striper 2024-09-12T00:54:44.346 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 objecter 2024-09-12T00:54:44.346 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rados 2024-09-12T00:54:44.346 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd 2024-09-12T00:54:44.346 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_mirror 2024-09-12T00:54:44.346 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_replay 2024-09-12T00:54:44.346 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_pwl 2024-09-12T00:54:44.346 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 journaler 2024-09-12T00:54:44.346 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 objectcacher 2024-09-12T00:54:44.347 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:54:44.347 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 client 2024-09-12T00:54:44.347 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 osd 2024-09-12T00:54:44.347 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 optracker 2024-09-12T00:54:44.347 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 objclass 2024-09-12T00:54:44.347 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 filestore 2024-09-12T00:54:44.347 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 journal 2024-09-12T00:54:44.347 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 0 ms 2024-09-12T00:54:44.347 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mon 2024-09-12T00:54:44.347 INFO:tasks.workunit.client.0.smithi073.stderr: 0/10 monc 2024-09-12T00:54:44.347 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 paxos 2024-09-12T00:54:44.347 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 tp 2024-09-12T00:54:44.347 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 auth 2024-09-12T00:54:44.347 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 crypto 2024-09-12T00:54:44.348 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 finisher 2024-09-12T00:54:44.348 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 reserver 2024-09-12T00:54:44.348 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 heartbeatmap 2024-09-12T00:54:44.348 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 perfcounter 2024-09-12T00:54:44.348 INFO:tasks.workunit.client.0.smithi073.stderr: 20/20 rgw 2024-09-12T00:54:44.348 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_sync 2024-09-12T00:54:44.348 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_datacache 2024-09-12T00:54:44.348 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_access 2024-09-12T00:54:44.348 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:54:44.348 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_flight 2024-09-12T00:54:44.348 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:54:44.348 INFO:tasks.workunit.client.0.smithi073.stderr: 20/20 rgw_notification 2024-09-12T00:54:44.348 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 javaclient 2024-09-12T00:54:44.349 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 asok 2024-09-12T00:54:44.349 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 throttle 2024-09-12T00:54:44.349 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 0 refs 2024-09-12T00:54:44.349 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 compressor 2024-09-12T00:54:44.349 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 bluestore 2024-09-12T00:54:44.349 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 bluefs 2024-09-12T00:54:44.349 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 bdev 2024-09-12T00:54:44.349 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 kstore 2024-09-12T00:54:44.349 INFO:tasks.workunit.client.0.smithi073.stderr: 4/ 5 rocksdb 2024-09-12T00:54:44.349 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 fuse 2024-09-12T00:54:44.349 INFO:tasks.workunit.client.0.smithi073.stderr: 2/ 5 mgr 2024-09-12T00:54:44.349 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mgrc 2024-09-12T00:54:44.349 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 dpdk 2024-09-12T00:54:44.349 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 eventtrace 2024-09-12T00:54:44.350 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 prioritycache 2024-09-12T00:54:44.350 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 test 2024-09-12T00:54:44.350 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:54:44.350 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cephsqlite 2024-09-12T00:54:44.350 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:54:44.350 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore 2024-09-12T00:54:44.350 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_onode 2024-09-12T00:54:44.350 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_odata 2024-09-12T00:54:44.350 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_omap 2024-09-12T00:54:44.350 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_tm 2024-09-12T00:54:44.350 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_t 2024-09-12T00:54:44.350 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:54:44.350 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_epm 2024-09-12T00:54:44.350 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_lba 2024-09-12T00:54:44.351 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:54:44.351 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_cache 2024-09-12T00:54:44.351 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_journal 2024-09-12T00:54:44.351 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_device 2024-09-12T00:54:44.351 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_backref 2024-09-12T00:54:44.351 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 alienstore 2024-09-12T00:54:44.351 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mclock 2024-09-12T00:54:44.351 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cyanstore 2024-09-12T00:54:44.351 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 ceph_exporter 2024-09-12T00:54:44.351 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 memstore 2024-09-12T00:54:44.351 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 trace 2024-09-12T00:54:44.351 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 ceph_dedup 2024-09-12T00:54:44.351 INFO:tasks.workunit.client.0.smithi073.stderr: -2/-2 (syslog threshold) 2024-09-12T00:54:44.352 INFO:tasks.workunit.client.0.smithi073.stderr: 99/99 (stderr threshold) 2024-09-12T00:54:44.352 INFO:tasks.workunit.client.0.smithi073.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:54:44.352 INFO:tasks.workunit.client.0.smithi073.stderr: 7f055ffff640 / http_manager 2024-09-12T00:54:44.352 INFO:tasks.workunit.client.0.smithi073.stderr: 7f05ea7fc640 / http_manager 2024-09-12T00:54:44.352 INFO:tasks.workunit.client.0.smithi073.stderr: 7f05eb7fe640 / rgw_dt_lg_renew 2024-09-12T00:54:44.352 INFO:tasks.workunit.client.0.smithi073.stderr: 7f060b7fe640 / ms_dispatch 2024-09-12T00:54:44.352 INFO:tasks.workunit.client.0.smithi073.stderr: 7f061d7fa640 / io_context_pool 2024-09-12T00:54:44.352 INFO:tasks.workunit.client.0.smithi073.stderr: 7f061f7fe640 / ms_dispatch 2024-09-12T00:54:44.352 INFO:tasks.workunit.client.0.smithi073.stderr: 7f0626604640 / ms_dispatch 2024-09-12T00:54:44.352 INFO:tasks.workunit.client.0.smithi073.stderr: 7f0627e07640 / io_context_pool 2024-09-12T00:54:44.352 INFO:tasks.workunit.client.0.smithi073.stderr: 7f0739332640 / msgr-worker-2 2024-09-12T00:54:44.352 INFO:tasks.workunit.client.0.smithi073.stderr: 7f0739b33640 / msgr-worker-1 2024-09-12T00:54:44.352 INFO:tasks.workunit.client.0.smithi073.stderr: 7f073a334640 / msgr-worker-0 2024-09-12T00:54:44.352 INFO:tasks.workunit.client.0.smithi073.stderr: 7f073ab35640 / io_context_pool 2024-09-12T00:54:44.353 INFO:tasks.workunit.client.0.smithi073.stderr: 7f073df25800 / radosgw-admin 2024-09-12T00:54:44.353 INFO:tasks.workunit.client.0.smithi073.stderr: max_recent 500 2024-09-12T00:54:44.353 INFO:tasks.workunit.client.0.smithi073.stderr: max_new 1000 2024-09-12T00:54:44.353 INFO:tasks.workunit.client.0.smithi073.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:54:44.219301Z_663983be-054e-493b-b225-bbffad4daa85/log 2024-09-12T00:54:44.353 INFO:tasks.workunit.client.0.smithi073.stderr:--- end dump of recent events --- 2024-09-12T00:54:44.353 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:54:44.355 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:44.355 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:44.355 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.295+0000 7efea1935800 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.355 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.297+0000 7efea1935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:44.355 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.297+0000 7efea1935800 20 realm 2024-09-12T00:54:44.355 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.297+0000 7efea1935800 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.355 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.297+0000 7efea1935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:44.355 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.297+0000 7efea1935800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:44.355 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.297+0000 7efea1935800 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.355 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.297+0000 7efea1935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:44.355 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.297+0000 7efea1935800 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.355 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.298+0000 7efea1935800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:44.356 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.298+0000 7efea1935800 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.356 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.299+0000 7efea1935800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:44.356 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.299+0000 7efea1935800 20 searching for the correct realm 2024-09-12T00:54:44.356 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.301+0000 7efe9de7e640 0 -- 172.21.15.73:0/3471458204 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7efe88095940 msgr2=0x7efe88064460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:44.506 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.507+0000 7efe9de7e640 0 -- 172.21.15.73:0/3471458204 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7efe88095940 msgr2=0x7efe88064460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:44.511 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.512+0000 7efea1935800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:54:44.511 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.512+0000 7efea1935800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:44.511 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.512+0000 7efea1935800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:54:44.511 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.512+0000 7efea1935800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:44.512 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.512+0000 7efea1935800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:44.512 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.512+0000 7efea1935800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:44.512 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.512+0000 7efea1935800 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.512 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.512+0000 7efea1935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:44.512 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.512+0000 7efea1935800 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.512 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.512+0000 7efea1935800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:44.512 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.512+0000 7efea1935800 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.512 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.512+0000 7efea1935800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:44.512 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.512+0000 7efea1935800 20 zone default found 2024-09-12T00:54:44.512 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.512+0000 7efea1935800 4 Realm: () 2024-09-12T00:54:44.512 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.512+0000 7efea1935800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:54:44.512 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.512+0000 7efea1935800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:54:44.512 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.512+0000 7efea1935800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:44.512 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.512+0000 7efea1935800 20 zonegroup default 2024-09-12T00:54:44.513 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.512+0000 7efea1935800 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.513 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.513+0000 7efea1935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:44.513 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.513+0000 7efea1935800 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.513 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.513+0000 7efea1935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:44.513 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.513+0000 7efea1935800 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.513 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.513+0000 7efea1935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:44.514 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.513+0000 7efea1935800 20 started sync module instance, tier type = 2024-09-12T00:54:44.514 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.513+0000 7efea1935800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:54:44.521 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.522+0000 7efea1935800 20 add_watcher() i=0 2024-09-12T00:54:44.521 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.522+0000 7efea1935800 20 add_watcher() i=1 2024-09-12T00:54:44.521 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.522+0000 7efea1935800 20 add_watcher() i=2 2024-09-12T00:54:44.521 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.522+0000 7efea1935800 20 add_watcher() i=3 2024-09-12T00:54:44.521 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.522+0000 7efea1935800 20 add_watcher() i=4 2024-09-12T00:54:44.521 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.522+0000 7efea1935800 20 add_watcher() i=5 2024-09-12T00:54:44.521 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.522+0000 7efea1935800 20 add_watcher() i=6 2024-09-12T00:54:44.522 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.523+0000 7efea1935800 20 add_watcher() i=7 2024-09-12T00:54:44.522 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.523+0000 7efea1935800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:44.523 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.525+0000 7efd537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:44.525 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.525+0000 7efea1935800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:44.525 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.525+0000 7efea1935800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:44.525 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.525+0000 7efea1935800 5 note: GC not initialized 2024-09-12T00:54:44.525 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.526+0000 7efd527e4640 20 reqs_thread_entry: start 2024-09-12T00:54:44.525 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.526+0000 7efea1935800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:44.525 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.526+0000 7efea1935800 20 Filter name: none 2024-09-12T00:54:44.525 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.526+0000 7efcc3fff640 20 reqs_thread_entry: start 2024-09-12T00:54:44.525 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.526+0000 7efea1935800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:54:44.525 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.526+0000 7efea1935800 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.526 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.527+0000 7efea1935800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:54:44.526 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.527+0000 7efea1935800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:54:44.526 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.527+0000 7efea1935800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:54:44.526 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.527+0000 7efea1935800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 : miss 2024-09-12T00:54:44.526 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.527+0000 7efea1935800 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.527 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.527+0000 7efea1935800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:54:44.527 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.527+0000 7efea1935800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:54:44.527 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.527+0000 7efea1935800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:54:44.527 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.527+0000 7efea1935800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:54:44.527 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.527+0000 7efea1935800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:54:44.527 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.527+0000 7efea1935800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 2024-09-12T00:54:44.527 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.527+0000 7efea1935800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.0 2024-09-12T00:54:44.527 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.527+0000 7efea1935800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.0 2024-09-12T00:54:44.527 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.528+0000 7efea1935800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.1 2024-09-12T00:54:44.527 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.528+0000 7efea1935800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.1 2024-09-12T00:54:44.528 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.528+0000 7efea1935800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.2 2024-09-12T00:54:44.528 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.528+0000 7efea1935800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.2 2024-09-12T00:54:44.528 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.529+0000 7efd537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:44.530 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.531+0000 7efea1935800 20 remove_watcher() i=0 2024-09-12T00:54:44.530 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.531+0000 7efea1935800 2 removed watcher, disabling cache 2024-09-12T00:54:44.531 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.532+0000 7efea1935800 20 remove_watcher() i=1 2024-09-12T00:54:44.532 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.534+0000 7efea1935800 20 remove_watcher() i=2 2024-09-12T00:54:44.533 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.535+0000 7efea1935800 20 remove_watcher() i=3 2024-09-12T00:54:44.534 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.536+0000 7efea1935800 20 remove_watcher() i=4 2024-09-12T00:54:44.535 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.537+0000 7efea1935800 20 remove_watcher() i=5 2024-09-12T00:54:44.536 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.538+0000 7efea1935800 20 remove_watcher() i=6 2024-09-12T00:54:44.537 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:54:44.538+0000 7efea1935800 20 remove_watcher() i=7 2024-09-12T00:54:44.547 INFO:tasks.workunit.client.0.smithi073.stderr: test: duplicated entries can be purged manually 2024-09-12T00:55:14.580 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:55:14.612 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:14.612 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:14.654 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.655+0000 7fbedef0c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:14.655 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.656+0000 7fbedef0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:14.656 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.656+0000 7fbedef0c800 20 realm 2024-09-12T00:55:14.656 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.656+0000 7fbedef0c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:14.656 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.657+0000 7fbedef0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:14.656 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.657+0000 7fbedef0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:14.656 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.657+0000 7fbedef0c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:14.656 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.657+0000 7fbedef0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:14.656 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.657+0000 7fbedef0c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:14.656 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.658+0000 7fbedef0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:14.657 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.658+0000 7fbedef0c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:14.658 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.659+0000 7fbedef0c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:14.658 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.659+0000 7fbedef0c800 20 searching for the correct realm 2024-09-12T00:55:14.660 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.661+0000 7fbedd1f7640 0 -- 172.21.15.73:0/2617380236 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fbed001a040 msgr2=0x7fbed0054040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:14.866 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.867+0000 7fbedd1f7640 0 -- 172.21.15.73:0/2617380236 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fbed001a040 msgr2=0x7fbed0054040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:14.870 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.871+0000 7fbedef0c800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:55:14.871 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.871+0000 7fbedef0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:14.871 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.871+0000 7fbedef0c800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:55:14.871 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.871+0000 7fbedef0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:14.871 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.871+0000 7fbedef0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:14.871 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.871+0000 7fbedef0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:14.871 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.871+0000 7fbedef0c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:14.871 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.872+0000 7fbedef0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:14.871 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.872+0000 7fbedef0c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:14.871 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.872+0000 7fbedef0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:14.871 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.872+0000 7fbedef0c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:14.872 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.872+0000 7fbedef0c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:14.872 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.872+0000 7fbedef0c800 20 zone default found 2024-09-12T00:55:14.872 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.872+0000 7fbedef0c800 4 Realm: () 2024-09-12T00:55:14.873 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.872+0000 7fbedef0c800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:55:14.873 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.872+0000 7fbedef0c800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:55:14.873 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.872+0000 7fbedef0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:14.873 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.872+0000 7fbedef0c800 20 zonegroup default 2024-09-12T00:55:14.873 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.872+0000 7fbedef0c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:14.873 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.873+0000 7fbedef0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:14.873 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.873+0000 7fbedef0c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:14.873 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.873+0000 7fbedef0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:14.873 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.873+0000 7fbedef0c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:14.873 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.873+0000 7fbedef0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:14.873 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.873+0000 7fbedef0c800 20 started sync module instance, tier type = 2024-09-12T00:55:14.873 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.873+0000 7fbedef0c800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:55:14.882 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.883+0000 7fbedef0c800 20 add_watcher() i=0 2024-09-12T00:55:14.882 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.883+0000 7fbedef0c800 20 add_watcher() i=1 2024-09-12T00:55:14.882 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.883+0000 7fbedef0c800 20 add_watcher() i=2 2024-09-12T00:55:14.882 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.883+0000 7fbedef0c800 20 add_watcher() i=3 2024-09-12T00:55:14.882 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.883+0000 7fbedef0c800 20 add_watcher() i=4 2024-09-12T00:55:14.882 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.883+0000 7fbedef0c800 20 add_watcher() i=5 2024-09-12T00:55:14.882 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.883+0000 7fbedef0c800 20 add_watcher() i=6 2024-09-12T00:55:14.883 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.884+0000 7fbedef0c800 20 add_watcher() i=7 2024-09-12T00:55:14.883 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.884+0000 7fbedef0c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:14.884 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.886+0000 7fbd92fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:14.885 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.886+0000 7fbedef0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:14.885 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.886+0000 7fbedef0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:14.886 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.886+0000 7fbedef0c800 5 note: GC not initialized 2024-09-12T00:55:14.886 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.886+0000 7fbd91fe3640 20 reqs_thread_entry: start 2024-09-12T00:55:14.886 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.887+0000 7fbedef0c800 20 init_complete bucket index max shards: 1 2024-09-12T00:55:14.886 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.887+0000 7fbedef0c800 20 Filter name: none 2024-09-12T00:55:14.886 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.887+0000 7fbd037fe640 20 reqs_thread_entry: start 2024-09-12T00:55:14.886 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.887+0000 7fbedef0c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:14.887 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.887+0000 7fbedef0c800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:55:14.887 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.887+0000 7fbedef0c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:14.887 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.888+0000 7fbedef0c800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:55:14.887 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.888+0000 7fbedef0c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:14.887 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.888+0000 7fbedef0c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:14.887 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.888+0000 7fbedef0c800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:55:14.887 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.888+0000 7fbedef0c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:14.888 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.889+0000 7fbedef0c800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:55:14.888 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.889+0000 7fbedef0c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:14.888 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.890+0000 7fbd92fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:14.891 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.892+0000 7fbedef0c800 20 remove_watcher() i=0 2024-09-12T00:55:14.891 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.892+0000 7fbedef0c800 2 removed watcher, disabling cache 2024-09-12T00:55:14.892 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.893+0000 7fbedef0c800 20 remove_watcher() i=1 2024-09-12T00:55:14.893 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.894+0000 7fbedef0c800 20 remove_watcher() i=2 2024-09-12T00:55:14.894 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.896+0000 7fbedef0c800 20 remove_watcher() i=3 2024-09-12T00:55:14.895 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.897+0000 7fbedef0c800 20 remove_watcher() i=4 2024-09-12T00:55:14.896 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.898+0000 7fbedef0c800 20 remove_watcher() i=5 2024-09-12T00:55:14.897 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.899+0000 7fbedef0c800 20 remove_watcher() i=6 2024-09-12T00:55:14.898 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.900+0000 7fbedef0c800 20 remove_watcher() i=7 2024-09-12T00:55:14.909 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:55:14.909 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:55:14.909 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: a-bucket id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 num_objects: 11 size_kb: 1 num_shards: 3 2024-09-12T00:55:14.909 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:55:14.910 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T00:55:14.945 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:14.945 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:14.982 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.983+0000 7f904cd46800 20 rados->read ofs=0 len=0 2024-09-12T00:55:14.984 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.985+0000 7f904cd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:14.984 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.985+0000 7f904cd46800 20 realm 2024-09-12T00:55:14.984 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.985+0000 7f904cd46800 20 rados->read ofs=0 len=0 2024-09-12T00:55:14.984 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.985+0000 7f904cd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:14.984 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.985+0000 7f904cd46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:14.985 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.985+0000 7f904cd46800 20 rados->read ofs=0 len=0 2024-09-12T00:55:14.985 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.986+0000 7f904cd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:14.985 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.986+0000 7f904cd46800 20 rados->read ofs=0 len=0 2024-09-12T00:55:14.985 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.987+0000 7f904cd46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:14.985 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.987+0000 7f904cd46800 20 rados->read ofs=0 len=0 2024-09-12T00:55:14.986 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.987+0000 7f904cd46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:14.986 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.987+0000 7f904cd46800 20 searching for the correct realm 2024-09-12T00:55:14.988 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:14.990+0000 7f904b038640 0 -- 172.21.15.73:0/1030248242 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f90340b5550 msgr2=0x7f90340ab4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:15.195 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.196+0000 7f904b038640 0 -- 172.21.15.73:0/1030248242 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f90340b5550 msgr2=0x7f90340ab4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:15.199 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.200+0000 7f904cd46800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:55:15.199 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.200+0000 7f904cd46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:15.199 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.200+0000 7f904cd46800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:55:15.199 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.200+0000 7f904cd46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:15.200 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.200+0000 7f904cd46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:15.200 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.200+0000 7f904cd46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:15.200 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.200+0000 7f904cd46800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.200 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.201+0000 7f904cd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:15.200 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.201+0000 7f904cd46800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.201 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.201+0000 7f904cd46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:15.201 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.201+0000 7f904cd46800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.201 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.201+0000 7f904cd46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:15.201 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.201+0000 7f904cd46800 20 zone default found 2024-09-12T00:55:15.201 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.201+0000 7f904cd46800 4 Realm: () 2024-09-12T00:55:15.202 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.201+0000 7f904cd46800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:55:15.202 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.201+0000 7f904cd46800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:55:15.202 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.201+0000 7f904cd46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:15.202 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.201+0000 7f904cd46800 20 zonegroup default 2024-09-12T00:55:15.202 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.201+0000 7f904cd46800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.202 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.202+0000 7f904cd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:15.202 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.202+0000 7f904cd46800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.202 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.202+0000 7f904cd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:15.202 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.202+0000 7f904cd46800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.202 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.202+0000 7f904cd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:15.202 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.202+0000 7f904cd46800 20 started sync module instance, tier type = 2024-09-12T00:55:15.202 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.202+0000 7f904cd46800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:55:15.210 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.212+0000 7f904cd46800 20 add_watcher() i=0 2024-09-12T00:55:15.210 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.212+0000 7f904cd46800 20 add_watcher() i=1 2024-09-12T00:55:15.211 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.212+0000 7f904cd46800 20 add_watcher() i=2 2024-09-12T00:55:15.211 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.212+0000 7f904cd46800 20 add_watcher() i=3 2024-09-12T00:55:15.211 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.212+0000 7f904cd46800 20 add_watcher() i=4 2024-09-12T00:55:15.211 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.212+0000 7f904cd46800 20 add_watcher() i=5 2024-09-12T00:55:15.211 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.212+0000 7f904cd46800 20 add_watcher() i=6 2024-09-12T00:55:15.211 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.213+0000 7f904cd46800 20 add_watcher() i=7 2024-09-12T00:55:15.211 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.213+0000 7f904cd46800 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:15.213 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.214+0000 7f8f017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:15.214 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.215+0000 7f904cd46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:15.214 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.215+0000 7f904cd46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:15.214 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.215+0000 7f904cd46800 5 note: GC not initialized 2024-09-12T00:55:15.214 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.215+0000 7f8e7bfff640 20 reqs_thread_entry: start 2024-09-12T00:55:15.214 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.215+0000 7f904cd46800 20 init_complete bucket index max shards: 1 2024-09-12T00:55:15.214 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.215+0000 7f904cd46800 20 Filter name: none 2024-09-12T00:55:15.214 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.215+0000 7f8e79ffb640 20 reqs_thread_entry: start 2024-09-12T00:55:15.214 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.215+0000 7f904cd46800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:55:15.214 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.215+0000 7f904cd46800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.215 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.216+0000 7f904cd46800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:55:15.215 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.216+0000 7f904cd46800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:55:15.215 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.216+0000 7f904cd46800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:55:15.215 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.216+0000 7f904cd46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 : miss 2024-09-12T00:55:15.215 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.216+0000 7f904cd46800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.215 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.216+0000 7f904cd46800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:55:15.215 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.216+0000 7f904cd46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:55:15.216 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.216+0000 7f904cd46800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:55:15.216 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.216+0000 7f904cd46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:55:15.216 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.216+0000 7f904cd46800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:55:15.216 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.216+0000 7f904cd46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 2024-09-12T00:55:15.216 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.217+0000 7f904cd46800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:55:15.220 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.221+0000 7f904cd46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:55:15.220 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.221+0000 7f904cd46800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:55:15.220 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.221+0000 7f904cd46800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:55:15.220 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.221+0000 7f904cd46800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17, ofs0, ns] 2024-09-12T00:55:15.221 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.222+0000 7f8f2e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497048 cookie 94642679376048 notifier 8376 bl.length()=827 2024-09-12T00:55:15.221 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.222+0000 7f8f2e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:55:15.221 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.222+0000 7f8f2e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:55:15.221 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.222+0000 7f8f2e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:55:15.222 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.223+0000 7f904cd46800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): orig_sources= new_sources= 2024-09-12T00:55:15.222 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.223+0000 7f904cd46800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): potential sources added=[] removed=[] 2024-09-12T00:55:15.222 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.223+0000 7f904cd46800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): orig_dests= new_dests= 2024-09-12T00:55:15.222 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.223+0000 7f904cd46800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): potential dests added=[] removed=[] 2024-09-12T00:55:15.224 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f904cd46800 time 2024-09-12T00:55:15.226949+0000 2024-09-12T00:55:15.224 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:55:15.225 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:55:15.225 INFO:tasks.workunit.client.0.smithi073.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f905038c71a] 2024-09-12T00:55:15.225 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f905038c8d8] 2024-09-12T00:55:15.225 INFO:tasks.workunit.client.0.smithi073.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5613b5098641] 2024-09-12T00:55:15.225 INFO:tasks.workunit.client.0.smithi073.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5613b50a838a] 2024-09-12T00:55:15.225 INFO:tasks.workunit.client.0.smithi073.stderr: 5: main() 2024-09-12T00:55:15.226 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f904f029590] 2024-09-12T00:55:15.226 INFO:tasks.workunit.client.0.smithi073.stderr: 7: __libc_start_main() 2024-09-12T00:55:15.226 INFO:tasks.workunit.client.0.smithi073.stderr: 8: _start() 2024-09-12T00:55:15.226 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.226+0000 7f904cd46800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f904cd46800 time 2024-09-12T00:55:15.226949+0000 2024-09-12T00:55:15.226 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:55:15.226 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:55:15.226 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:55:15.226 INFO:tasks.workunit.client.0.smithi073.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f905038c71a] 2024-09-12T00:55:15.226 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f905038c8d8] 2024-09-12T00:55:15.226 INFO:tasks.workunit.client.0.smithi073.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5613b5098641] 2024-09-12T00:55:15.226 INFO:tasks.workunit.client.0.smithi073.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5613b50a838a] 2024-09-12T00:55:15.226 INFO:tasks.workunit.client.0.smithi073.stderr: 5: main() 2024-09-12T00:55:15.227 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f904f029590] 2024-09-12T00:55:15.227 INFO:tasks.workunit.client.0.smithi073.stderr: 7: __libc_start_main() 2024-09-12T00:55:15.227 INFO:tasks.workunit.client.0.smithi073.stderr: 8: _start() 2024-09-12T00:55:15.227 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:55:15.227 INFO:tasks.workunit.client.0.smithi073.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:55:15.227 INFO:tasks.workunit.client.0.smithi073.stderr: in thread 7f904cd46800 thread_name:radosgw-admin 2024-09-12T00:55:15.247 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:55:15.247 INFO:tasks.workunit.client.0.smithi073.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f904f03e6f0] 2024-09-12T00:55:15.247 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f904f08b99c] 2024-09-12T00:55:15.248 INFO:tasks.workunit.client.0.smithi073.stderr: 3: raise() 2024-09-12T00:55:15.248 INFO:tasks.workunit.client.0.smithi073.stderr: 4: abort() 2024-09-12T00:55:15.248 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f905038c774] 2024-09-12T00:55:15.248 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f905038c8d8] 2024-09-12T00:55:15.248 INFO:tasks.workunit.client.0.smithi073.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5613b5098641] 2024-09-12T00:55:15.248 INFO:tasks.workunit.client.0.smithi073.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5613b50a838a] 2024-09-12T00:55:15.248 INFO:tasks.workunit.client.0.smithi073.stderr: 9: main() 2024-09-12T00:55:15.248 INFO:tasks.workunit.client.0.smithi073.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f904f029590] 2024-09-12T00:55:15.248 INFO:tasks.workunit.client.0.smithi073.stderr: 11: __libc_start_main() 2024-09-12T00:55:15.248 INFO:tasks.workunit.client.0.smithi073.stderr: 12: _start() 2024-09-12T00:55:15.248 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.227+0000 7f904cd46800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:55:15.248 INFO:tasks.workunit.client.0.smithi073.stderr: in thread 7f904cd46800 thread_name:radosgw-admin 2024-09-12T00:55:15.249 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:55:15.249 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:55:15.249 INFO:tasks.workunit.client.0.smithi073.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f904f03e6f0] 2024-09-12T00:55:15.249 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f904f08b99c] 2024-09-12T00:55:15.249 INFO:tasks.workunit.client.0.smithi073.stderr: 3: raise() 2024-09-12T00:55:15.249 INFO:tasks.workunit.client.0.smithi073.stderr: 4: abort() 2024-09-12T00:55:15.249 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f905038c774] 2024-09-12T00:55:15.249 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f905038c8d8] 2024-09-12T00:55:15.249 INFO:tasks.workunit.client.0.smithi073.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5613b5098641] 2024-09-12T00:55:15.249 INFO:tasks.workunit.client.0.smithi073.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5613b50a838a] 2024-09-12T00:55:15.249 INFO:tasks.workunit.client.0.smithi073.stderr: 9: main() 2024-09-12T00:55:15.249 INFO:tasks.workunit.client.0.smithi073.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f904f029590] 2024-09-12T00:55:15.250 INFO:tasks.workunit.client.0.smithi073.stderr: 11: __libc_start_main() 2024-09-12T00:55:15.250 INFO:tasks.workunit.client.0.smithi073.stderr: 12: _start() 2024-09-12T00:55:15.250 INFO:tasks.workunit.client.0.smithi073.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:55:15.250 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:55:15.250 INFO:tasks.workunit.client.0.smithi073.stderr:--- begin dump of recent events --- 2024-09-12T00:55:15.250 INFO:tasks.workunit.client.0.smithi073.stderr: -499> 2024-09-12T00:55:14.966+0000 7f8f38e09640 10 monclient: _finish_auth 0 2024-09-12T00:55:15.250 INFO:tasks.workunit.client.0.smithi073.stderr: -498> 2024-09-12T00:55:14.966+0000 7f8f38e09640 10 monclient: _check_auth_tickets 2024-09-12T00:55:15.250 INFO:tasks.workunit.client.0.smithi073.stderr: -497> 2024-09-12T00:55:14.966+0000 7f8f38e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:55:15.250 INFO:tasks.workunit.client.0.smithi073.stderr: -496> 2024-09-12T00:55:14.966+0000 7f8f38e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:15.250 INFO:tasks.workunit.client.0.smithi073.stderr: -495> 2024-09-12T00:55:14.966+0000 7f8f38e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:55:15.250 INFO:tasks.workunit.client.0.smithi073.stderr: -494> 2024-09-12T00:55:14.966+0000 7f8f38e09640 10 monclient: dump: 2024-09-12T00:55:15.250 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:55:15.251 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:55:15.251 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:55:15.251 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:55:15.251 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:15.251 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:55:15.251 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:55:15.251 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:55:15.251 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:55:15.252 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:55:15.252 INFO:tasks.workunit.client.0.smithi073.stderr: -493> 2024-09-12T00:55:14.966+0000 7f904cd46800 5 monclient: authenticate success, global_id 8364 2024-09-12T00:55:15.252 INFO:tasks.workunit.client.0.smithi073.stderr: -492> 2024-09-12T00:55:14.966+0000 7f904cd46800 10 monclient: get_monmap_and_config success 2024-09-12T00:55:15.252 INFO:tasks.workunit.client.0.smithi073.stderr: -491> 2024-09-12T00:55:14.966+0000 7f904cd46800 4 set_mon_vals no callback set 2024-09-12T00:55:15.252 INFO:tasks.workunit.client.0.smithi073.stderr: -490> 2024-09-12T00:55:14.966+0000 7f904cd46800 10 monclient: shutdown 2024-09-12T00:55:15.252 INFO:tasks.workunit.client.0.smithi073.stderr: -489> 2024-09-12T00:55:14.966+0000 7f904cd46800 5 asok(0x5613b716e630) unregister_commands rotate-key 2024-09-12T00:55:15.252 INFO:tasks.workunit.client.0.smithi073.stderr: -488> 2024-09-12T00:55:14.966+0000 7f904cd46800 10 monclient: build_initial_monmap 2024-09-12T00:55:15.252 INFO:tasks.workunit.client.0.smithi073.stderr: -487> 2024-09-12T00:55:14.966+0000 7f904cd46800 1 build_initial for_mkfs: 0 2024-09-12T00:55:15.252 INFO:tasks.workunit.client.0.smithi073.stderr: -486> 2024-09-12T00:55:14.966+0000 7f904cd46800 10 monclient: monmap: 2024-09-12T00:55:15.252 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:55:15.252 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:55:15.252 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:55:15.252 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:55:15.253 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:55:15.253 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:55:15.253 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:55:15.253 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:55:15.253 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:55:15.253 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:55:15.253 INFO:tasks.workunit.client.0.smithi073.stderr: -485> 2024-09-12T00:55:14.966+0000 7f904cd46800 5 AuthRegistry(0x5613b73933b0) adding auth protocol: cephx 2024-09-12T00:55:15.253 INFO:tasks.workunit.client.0.smithi073.stderr: -484> 2024-09-12T00:55:14.966+0000 7f904cd46800 5 AuthRegistry(0x5613b73933b0) adding auth protocol: cephx 2024-09-12T00:55:15.253 INFO:tasks.workunit.client.0.smithi073.stderr: -483> 2024-09-12T00:55:14.966+0000 7f904cd46800 5 AuthRegistry(0x5613b73933b0) adding auth protocol: cephx 2024-09-12T00:55:15.253 INFO:tasks.workunit.client.0.smithi073.stderr: -482> 2024-09-12T00:55:14.966+0000 7f904cd46800 5 AuthRegistry(0x5613b73933b0) adding con mode: secure 2024-09-12T00:55:15.253 INFO:tasks.workunit.client.0.smithi073.stderr: -481> 2024-09-12T00:55:14.966+0000 7f904cd46800 5 AuthRegistry(0x5613b73933b0) adding con mode: crc 2024-09-12T00:55:15.253 INFO:tasks.workunit.client.0.smithi073.stderr: -480> 2024-09-12T00:55:14.966+0000 7f904cd46800 5 AuthRegistry(0x5613b73933b0) adding con mode: secure 2024-09-12T00:55:15.253 INFO:tasks.workunit.client.0.smithi073.stderr: -479> 2024-09-12T00:55:14.966+0000 7f904cd46800 5 AuthRegistry(0x5613b73933b0) adding con mode: crc 2024-09-12T00:55:15.254 INFO:tasks.workunit.client.0.smithi073.stderr: -478> 2024-09-12T00:55:14.966+0000 7f904cd46800 5 AuthRegistry(0x5613b73933b0) adding con mode: secure 2024-09-12T00:55:15.254 INFO:tasks.workunit.client.0.smithi073.stderr: -477> 2024-09-12T00:55:14.966+0000 7f904cd46800 5 AuthRegistry(0x5613b73933b0) adding con mode: crc 2024-09-12T00:55:15.254 INFO:tasks.workunit.client.0.smithi073.stderr: -476> 2024-09-12T00:55:14.966+0000 7f904cd46800 5 AuthRegistry(0x5613b73933b0) adding con mode: crc 2024-09-12T00:55:15.254 INFO:tasks.workunit.client.0.smithi073.stderr: -475> 2024-09-12T00:55:14.966+0000 7f904cd46800 5 AuthRegistry(0x5613b73933b0) adding con mode: secure 2024-09-12T00:55:15.254 INFO:tasks.workunit.client.0.smithi073.stderr: -474> 2024-09-12T00:55:14.966+0000 7f904cd46800 5 AuthRegistry(0x5613b73933b0) adding con mode: crc 2024-09-12T00:55:15.254 INFO:tasks.workunit.client.0.smithi073.stderr: -473> 2024-09-12T00:55:14.966+0000 7f904cd46800 5 AuthRegistry(0x5613b73933b0) adding con mode: secure 2024-09-12T00:55:15.254 INFO:tasks.workunit.client.0.smithi073.stderr: -472> 2024-09-12T00:55:14.966+0000 7f904cd46800 5 AuthRegistry(0x5613b73933b0) adding con mode: crc 2024-09-12T00:55:15.254 INFO:tasks.workunit.client.0.smithi073.stderr: -471> 2024-09-12T00:55:14.966+0000 7f904cd46800 5 AuthRegistry(0x5613b73933b0) adding con mode: secure 2024-09-12T00:55:15.254 INFO:tasks.workunit.client.0.smithi073.stderr: -470> 2024-09-12T00:55:14.967+0000 7f904cd46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:15.254 INFO:tasks.workunit.client.0.smithi073.stderr: -469> 2024-09-12T00:55:14.967+0000 7f904cd46800 1 librados: starting msgr at 2024-09-12T00:55:15.254 INFO:tasks.workunit.client.0.smithi073.stderr: -468> 2024-09-12T00:55:14.967+0000 7f904cd46800 1 librados: starting objecter 2024-09-12T00:55:15.254 INFO:tasks.workunit.client.0.smithi073.stderr: -467> 2024-09-12T00:55:14.967+0000 7f904cd46800 5 asok(0x5613b716e630) register_command objecter_requests hook 0x5613b7391340 2024-09-12T00:55:15.254 INFO:tasks.workunit.client.0.smithi073.stderr: -466> 2024-09-12T00:55:14.967+0000 7f904cd46800 1 librados: setting wanted keys 2024-09-12T00:55:15.255 INFO:tasks.workunit.client.0.smithi073.stderr: -465> 2024-09-12T00:55:14.967+0000 7f904cd46800 1 librados: calling monclient init 2024-09-12T00:55:15.255 INFO:tasks.workunit.client.0.smithi073.stderr: -464> 2024-09-12T00:55:14.967+0000 7f904cd46800 10 monclient: init 2024-09-12T00:55:15.255 INFO:tasks.workunit.client.0.smithi073.stderr: -463> 2024-09-12T00:55:14.967+0000 7f904cd46800 5 AuthRegistry(0x5613b738d800) adding auth protocol: cephx 2024-09-12T00:55:15.255 INFO:tasks.workunit.client.0.smithi073.stderr: -462> 2024-09-12T00:55:14.967+0000 7f904cd46800 5 AuthRegistry(0x5613b738d800) adding auth protocol: cephx 2024-09-12T00:55:15.255 INFO:tasks.workunit.client.0.smithi073.stderr: -461> 2024-09-12T00:55:14.967+0000 7f904cd46800 5 AuthRegistry(0x5613b738d800) adding auth protocol: cephx 2024-09-12T00:55:15.255 INFO:tasks.workunit.client.0.smithi073.stderr: -460> 2024-09-12T00:55:14.967+0000 7f904cd46800 5 AuthRegistry(0x5613b738d800) adding con mode: secure 2024-09-12T00:55:15.255 INFO:tasks.workunit.client.0.smithi073.stderr: -459> 2024-09-12T00:55:14.967+0000 7f904cd46800 5 AuthRegistry(0x5613b738d800) adding con mode: crc 2024-09-12T00:55:15.255 INFO:tasks.workunit.client.0.smithi073.stderr: -458> 2024-09-12T00:55:14.967+0000 7f904cd46800 5 AuthRegistry(0x5613b738d800) adding con mode: secure 2024-09-12T00:55:15.255 INFO:tasks.workunit.client.0.smithi073.stderr: -457> 2024-09-12T00:55:14.967+0000 7f904cd46800 5 AuthRegistry(0x5613b738d800) adding con mode: crc 2024-09-12T00:55:15.255 INFO:tasks.workunit.client.0.smithi073.stderr: -456> 2024-09-12T00:55:14.967+0000 7f904cd46800 5 AuthRegistry(0x5613b738d800) adding con mode: secure 2024-09-12T00:55:15.255 INFO:tasks.workunit.client.0.smithi073.stderr: -455> 2024-09-12T00:55:14.967+0000 7f904cd46800 5 AuthRegistry(0x5613b738d800) adding con mode: crc 2024-09-12T00:55:15.255 INFO:tasks.workunit.client.0.smithi073.stderr: -454> 2024-09-12T00:55:14.967+0000 7f904cd46800 5 AuthRegistry(0x5613b738d800) adding con mode: crc 2024-09-12T00:55:15.255 INFO:tasks.workunit.client.0.smithi073.stderr: -453> 2024-09-12T00:55:14.967+0000 7f904cd46800 5 AuthRegistry(0x5613b738d800) adding con mode: secure 2024-09-12T00:55:15.256 INFO:tasks.workunit.client.0.smithi073.stderr: -452> 2024-09-12T00:55:14.967+0000 7f904cd46800 5 AuthRegistry(0x5613b738d800) adding con mode: crc 2024-09-12T00:55:15.256 INFO:tasks.workunit.client.0.smithi073.stderr: -451> 2024-09-12T00:55:14.967+0000 7f904cd46800 5 AuthRegistry(0x5613b738d800) adding con mode: secure 2024-09-12T00:55:15.256 INFO:tasks.workunit.client.0.smithi073.stderr: -450> 2024-09-12T00:55:14.967+0000 7f904cd46800 5 AuthRegistry(0x5613b738d800) adding con mode: crc 2024-09-12T00:55:15.256 INFO:tasks.workunit.client.0.smithi073.stderr: -449> 2024-09-12T00:55:14.967+0000 7f904cd46800 5 AuthRegistry(0x5613b738d800) adding con mode: secure 2024-09-12T00:55:15.256 INFO:tasks.workunit.client.0.smithi073.stderr: -448> 2024-09-12T00:55:14.967+0000 7f904cd46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:15.256 INFO:tasks.workunit.client.0.smithi073.stderr: -447> 2024-09-12T00:55:14.967+0000 7f904cd46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:15.256 INFO:tasks.workunit.client.0.smithi073.stderr: -446> 2024-09-12T00:55:14.967+0000 7f904cd46800 5 asok(0x5613b716e630) register_command rotate-key hook 0x5613b738d948 2024-09-12T00:55:15.256 INFO:tasks.workunit.client.0.smithi073.stderr: -445> 2024-09-12T00:55:14.967+0000 7f904cd46800 10 monclient: _reopen_session rank -1 2024-09-12T00:55:15.256 INFO:tasks.workunit.client.0.smithi073.stderr: -444> 2024-09-12T00:55:14.967+0000 7f904cd46800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:55:15.256 INFO:tasks.workunit.client.0.smithi073.stderr: -443> 2024-09-12T00:55:14.967+0000 7f904cd46800 10 monclient(hunting): picked mon.noname-b con 0x5613b7246b00 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:55:15.256 INFO:tasks.workunit.client.0.smithi073.stderr: -442> 2024-09-12T00:55:14.967+0000 7f904cd46800 10 monclient(hunting): picked mon.noname-c con 0x5613b72d7130 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:55:15.256 INFO:tasks.workunit.client.0.smithi073.stderr: -441> 2024-09-12T00:55:14.967+0000 7f904cd46800 10 monclient(hunting): picked mon.noname-a con 0x5613b7390d30 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:55:15.256 INFO:tasks.workunit.client.0.smithi073.stderr: -440> 2024-09-12T00:55:14.967+0000 7f904cd46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:15.257 INFO:tasks.workunit.client.0.smithi073.stderr: -439> 2024-09-12T00:55:14.967+0000 7f904cd46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:15.257 INFO:tasks.workunit.client.0.smithi073.stderr: -438> 2024-09-12T00:55:14.967+0000 7f904cd46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:15.257 INFO:tasks.workunit.client.0.smithi073.stderr: -437> 2024-09-12T00:55:14.967+0000 7f904cd46800 10 monclient(hunting): _renew_subs 2024-09-12T00:55:15.257 INFO:tasks.workunit.client.0.smithi073.stderr: -436> 2024-09-12T00:55:14.967+0000 7f904cd46800 10 monclient(hunting): authenticate will time out at 2375.637903s 2024-09-12T00:55:15.257 INFO:tasks.workunit.client.0.smithi073.stderr: -435> 2024-09-12T00:55:14.968+0000 7f904a036640 10 monclient(hunting): get_auth_request con 0x5613b72d7130 auth_method 0 2024-09-12T00:55:15.257 INFO:tasks.workunit.client.0.smithi073.stderr: -434> 2024-09-12T00:55:14.968+0000 7f904a036640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:15.257 INFO:tasks.workunit.client.0.smithi073.stderr: -433> 2024-09-12T00:55:14.968+0000 7f904a036640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:15.257 INFO:tasks.workunit.client.0.smithi073.stderr: -432> 2024-09-12T00:55:14.968+0000 7f904a036640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:15.257 INFO:tasks.workunit.client.0.smithi073.stderr: -431> 2024-09-12T00:55:14.968+0000 7f904b038640 10 monclient(hunting): get_auth_request con 0x5613b7390d30 auth_method 0 2024-09-12T00:55:15.257 INFO:tasks.workunit.client.0.smithi073.stderr: -430> 2024-09-12T00:55:14.968+0000 7f904b038640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:15.257 INFO:tasks.workunit.client.0.smithi073.stderr: -429> 2024-09-12T00:55:14.968+0000 7f904b038640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:15.257 INFO:tasks.workunit.client.0.smithi073.stderr: -428> 2024-09-12T00:55:14.968+0000 7f904b038640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:15.258 INFO:tasks.workunit.client.0.smithi073.stderr: -427> 2024-09-12T00:55:14.968+0000 7f904a837640 10 monclient(hunting): get_auth_request con 0x5613b7246b00 auth_method 0 2024-09-12T00:55:15.258 INFO:tasks.workunit.client.0.smithi073.stderr: -426> 2024-09-12T00:55:14.968+0000 7f904a837640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:15.258 INFO:tasks.workunit.client.0.smithi073.stderr: -425> 2024-09-12T00:55:14.968+0000 7f904a837640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:15.258 INFO:tasks.workunit.client.0.smithi073.stderr: -424> 2024-09-12T00:55:14.968+0000 7f904a837640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:15.258 INFO:tasks.workunit.client.0.smithi073.stderr: -423> 2024-09-12T00:55:14.968+0000 7f904a036640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:15.258 INFO:tasks.workunit.client.0.smithi073.stderr: -422> 2024-09-12T00:55:14.968+0000 7f904a036640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:15.258 INFO:tasks.workunit.client.0.smithi073.stderr: -421> 2024-09-12T00:55:14.968+0000 7f904a036640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:15.258 INFO:tasks.workunit.client.0.smithi073.stderr: -420> 2024-09-12T00:55:14.968+0000 7f904b038640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:15.258 INFO:tasks.workunit.client.0.smithi073.stderr: -419> 2024-09-12T00:55:14.968+0000 7f904b038640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:15.258 INFO:tasks.workunit.client.0.smithi073.stderr: -418> 2024-09-12T00:55:14.968+0000 7f904b038640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:15.258 INFO:tasks.workunit.client.0.smithi073.stderr: -417> 2024-09-12T00:55:14.968+0000 7f904a837640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:15.258 INFO:tasks.workunit.client.0.smithi073.stderr: -416> 2024-09-12T00:55:14.968+0000 7f904a837640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:15.258 INFO:tasks.workunit.client.0.smithi073.stderr: -415> 2024-09-12T00:55:14.968+0000 7f904a837640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:15.258 INFO:tasks.workunit.client.0.smithi073.stderr: -414> 2024-09-12T00:55:14.968+0000 7f904b038640 10 monclient(hunting): handle_auth_done global_id 8367 payload 824 2024-09-12T00:55:15.259 INFO:tasks.workunit.client.0.smithi073.stderr: -413> 2024-09-12T00:55:14.968+0000 7f904b038640 10 monclient: _finish_hunting 0 2024-09-12T00:55:15.259 INFO:tasks.workunit.client.0.smithi073.stderr: -412> 2024-09-12T00:55:14.968+0000 7f904b038640 1 monclient: found mon.noname-a 2024-09-12T00:55:15.259 INFO:tasks.workunit.client.0.smithi073.stderr: -411> 2024-09-12T00:55:14.968+0000 7f904b038640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:55:15.259 INFO:tasks.workunit.client.0.smithi073.stderr: -410> 2024-09-12T00:55:14.968+0000 7f8f37606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:15.259 INFO:tasks.workunit.client.0.smithi073.stderr: -409> 2024-09-12T00:55:14.968+0000 7f8f37606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:55:15.259 INFO:tasks.workunit.client.0.smithi073.stderr: -408> 2024-09-12T00:55:14.968+0000 7f8f37606640 10 monclient: dump: 2024-09-12T00:55:15.259 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:55:15.259 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:55:15.259 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:55:15.259 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:55:15.259 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:15.259 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:55:15.259 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:55:15.260 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:55:15.260 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:55:15.260 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:55:15.260 INFO:tasks.workunit.client.0.smithi073.stderr: -407> 2024-09-12T00:55:14.968+0000 7f8f37606640 10 monclient: _finish_auth 0 2024-09-12T00:55:15.260 INFO:tasks.workunit.client.0.smithi073.stderr: -406> 2024-09-12T00:55:14.968+0000 7f8f37606640 10 monclient: _check_auth_tickets 2024-09-12T00:55:15.260 INFO:tasks.workunit.client.0.smithi073.stderr: -405> 2024-09-12T00:55:14.968+0000 7f904cd46800 5 monclient: authenticate success, global_id 8367 2024-09-12T00:55:15.260 INFO:tasks.workunit.client.0.smithi073.stderr: -404> 2024-09-12T00:55:14.968+0000 7f904cd46800 10 monclient: _renew_subs 2024-09-12T00:55:15.260 INFO:tasks.workunit.client.0.smithi073.stderr: -403> 2024-09-12T00:55:14.968+0000 7f904cd46800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:55:15.260 INFO:tasks.workunit.client.0.smithi073.stderr: -402> 2024-09-12T00:55:14.968+0000 7f8f37606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:55:15.260 INFO:tasks.workunit.client.0.smithi073.stderr: -401> 2024-09-12T00:55:14.968+0000 7f8f37606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:15.260 INFO:tasks.workunit.client.0.smithi073.stderr: -400> 2024-09-12T00:55:14.968+0000 7f8f37606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:55:15.260 INFO:tasks.workunit.client.0.smithi073.stderr: -399> 2024-09-12T00:55:14.968+0000 7f8f37606640 10 monclient: dump: 2024-09-12T00:55:15.260 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:55:15.261 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:55:15.261 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:55:15.261 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:55:15.261 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:15.261 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:55:15.261 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:55:15.261 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:55:15.261 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:55:15.261 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:55:15.261 INFO:tasks.workunit.client.0.smithi073.stderr: -398> 2024-09-12T00:55:14.968+0000 7f8f38e09640 4 set_mon_vals no callback set 2024-09-12T00:55:15.261 INFO:tasks.workunit.client.0.smithi073.stderr: -397> 2024-09-12T00:55:14.968+0000 7f904cd46800 10 monclient: _renew_subs 2024-09-12T00:55:15.261 INFO:tasks.workunit.client.0.smithi073.stderr: -396> 2024-09-12T00:55:14.968+0000 7f904cd46800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:55:15.262 INFO:tasks.workunit.client.0.smithi073.stderr: -395> 2024-09-12T00:55:14.968+0000 7f904cd46800 1 librados: init done 2024-09-12T00:55:15.262 INFO:tasks.workunit.client.0.smithi073.stderr: -394> 2024-09-12T00:55:14.970+0000 7f8f37606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:55:15.262 INFO:tasks.workunit.client.0.smithi073.stderr: -393> 2024-09-12T00:55:14.970+0000 7f8f37606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:55:15.262 INFO:tasks.workunit.client.0.smithi073.stderr: -392> 2024-09-12T00:55:14.970+0000 7f8f37606640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:55:15.262 INFO:tasks.workunit.client.0.smithi073.stderr: -391> 2024-09-12T00:55:14.970+0000 7f904a837640 10 monclient: get_auth_request con 0x7f8f30076470 auth_method 0 2024-09-12T00:55:15.262 INFO:tasks.workunit.client.0.smithi073.stderr: -390> 2024-09-12T00:55:14.970+0000 7f904a036640 10 monclient: get_auth_request con 0x5613b73cfab0 auth_method 0 2024-09-12T00:55:15.262 INFO:tasks.workunit.client.0.smithi073.stderr: -389> 2024-09-12T00:55:14.971+0000 7f904a837640 10 monclient: get_auth_request con 0x5613b73d9470 auth_method 0 2024-09-12T00:55:15.262 INFO:tasks.workunit.client.0.smithi073.stderr: -388> 2024-09-12T00:55:14.972+0000 7f904a036640 10 monclient: get_auth_request con 0x5613b73dd660 auth_method 0 2024-09-12T00:55:15.262 INFO:tasks.workunit.client.0.smithi073.stderr: -387> 2024-09-12T00:55:14.974+0000 7f904cd46800 10 monclient: build_initial_monmap 2024-09-12T00:55:15.262 INFO:tasks.workunit.client.0.smithi073.stderr: -386> 2024-09-12T00:55:14.974+0000 7f904cd46800 1 build_initial for_mkfs: 0 2024-09-12T00:55:15.262 INFO:tasks.workunit.client.0.smithi073.stderr: -385> 2024-09-12T00:55:14.974+0000 7f904cd46800 10 monclient: monmap: 2024-09-12T00:55:15.262 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:55:15.263 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:55:15.263 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:55:15.263 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:55:15.263 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:55:15.263 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:55:15.263 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:55:15.263 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:55:15.263 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:55:15.263 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:55:15.263 INFO:tasks.workunit.client.0.smithi073.stderr: -384> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e24d0) adding auth protocol: cephx 2024-09-12T00:55:15.263 INFO:tasks.workunit.client.0.smithi073.stderr: -383> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e24d0) adding auth protocol: cephx 2024-09-12T00:55:15.263 INFO:tasks.workunit.client.0.smithi073.stderr: -382> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e24d0) adding auth protocol: cephx 2024-09-12T00:55:15.263 INFO:tasks.workunit.client.0.smithi073.stderr: -381> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e24d0) adding con mode: secure 2024-09-12T00:55:15.263 INFO:tasks.workunit.client.0.smithi073.stderr: -380> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e24d0) adding con mode: crc 2024-09-12T00:55:15.264 INFO:tasks.workunit.client.0.smithi073.stderr: -379> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e24d0) adding con mode: secure 2024-09-12T00:55:15.264 INFO:tasks.workunit.client.0.smithi073.stderr: -378> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e24d0) adding con mode: crc 2024-09-12T00:55:15.264 INFO:tasks.workunit.client.0.smithi073.stderr: -377> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e24d0) adding con mode: secure 2024-09-12T00:55:15.264 INFO:tasks.workunit.client.0.smithi073.stderr: -376> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e24d0) adding con mode: crc 2024-09-12T00:55:15.264 INFO:tasks.workunit.client.0.smithi073.stderr: -375> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e24d0) adding con mode: crc 2024-09-12T00:55:15.264 INFO:tasks.workunit.client.0.smithi073.stderr: -374> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e24d0) adding con mode: secure 2024-09-12T00:55:15.264 INFO:tasks.workunit.client.0.smithi073.stderr: -373> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e24d0) adding con mode: crc 2024-09-12T00:55:15.264 INFO:tasks.workunit.client.0.smithi073.stderr: -372> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e24d0) adding con mode: secure 2024-09-12T00:55:15.264 INFO:tasks.workunit.client.0.smithi073.stderr: -371> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e24d0) adding con mode: crc 2024-09-12T00:55:15.264 INFO:tasks.workunit.client.0.smithi073.stderr: -370> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e24d0) adding con mode: secure 2024-09-12T00:55:15.264 INFO:tasks.workunit.client.0.smithi073.stderr: -369> 2024-09-12T00:55:14.974+0000 7f904cd46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:15.264 INFO:tasks.workunit.client.0.smithi073.stderr: -368> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 asok(0x5613b716e630) register_command objecter_requests cmddesc objecter_requests hook 0x5613b73e5ea0 EEXIST 2024-09-12T00:55:15.264 INFO:tasks.workunit.client.0.smithi073.stderr: -367> 2024-09-12T00:55:14.974+0000 7f904cd46800 10 monclient: init 2024-09-12T00:55:15.264 INFO:tasks.workunit.client.0.smithi073.stderr: -366> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e0ba8) adding auth protocol: cephx 2024-09-12T00:55:15.265 INFO:tasks.workunit.client.0.smithi073.stderr: -365> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e0ba8) adding auth protocol: cephx 2024-09-12T00:55:15.265 INFO:tasks.workunit.client.0.smithi073.stderr: -364> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e0ba8) adding auth protocol: cephx 2024-09-12T00:55:15.265 INFO:tasks.workunit.client.0.smithi073.stderr: -363> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e0ba8) adding con mode: secure 2024-09-12T00:55:15.265 INFO:tasks.workunit.client.0.smithi073.stderr: -362> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e0ba8) adding con mode: crc 2024-09-12T00:55:15.265 INFO:tasks.workunit.client.0.smithi073.stderr: -361> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e0ba8) adding con mode: secure 2024-09-12T00:55:15.265 INFO:tasks.workunit.client.0.smithi073.stderr: -360> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e0ba8) adding con mode: crc 2024-09-12T00:55:15.265 INFO:tasks.workunit.client.0.smithi073.stderr: -359> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e0ba8) adding con mode: secure 2024-09-12T00:55:15.265 INFO:tasks.workunit.client.0.smithi073.stderr: -358> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e0ba8) adding con mode: crc 2024-09-12T00:55:15.265 INFO:tasks.workunit.client.0.smithi073.stderr: -357> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e0ba8) adding con mode: crc 2024-09-12T00:55:15.265 INFO:tasks.workunit.client.0.smithi073.stderr: -356> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e0ba8) adding con mode: secure 2024-09-12T00:55:15.265 INFO:tasks.workunit.client.0.smithi073.stderr: -355> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e0ba8) adding con mode: crc 2024-09-12T00:55:15.265 INFO:tasks.workunit.client.0.smithi073.stderr: -354> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e0ba8) adding con mode: secure 2024-09-12T00:55:15.265 INFO:tasks.workunit.client.0.smithi073.stderr: -353> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e0ba8) adding con mode: crc 2024-09-12T00:55:15.266 INFO:tasks.workunit.client.0.smithi073.stderr: -352> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e0ba8) adding con mode: secure 2024-09-12T00:55:15.266 INFO:tasks.workunit.client.0.smithi073.stderr: -351> 2024-09-12T00:55:14.974+0000 7f904cd46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:15.266 INFO:tasks.workunit.client.0.smithi073.stderr: -350> 2024-09-12T00:55:14.975+0000 7f904cd46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:15.266 INFO:tasks.workunit.client.0.smithi073.stderr: -349> 2024-09-12T00:55:14.975+0000 7f904cd46800 5 asok(0x5613b716e630) register_command rotate-key cmddesc rotate-key hook 0x5613b73e0cf0 EEXIST 2024-09-12T00:55:15.266 INFO:tasks.workunit.client.0.smithi073.stderr: -348> 2024-09-12T00:55:14.975+0000 7f904cd46800 10 monclient: _reopen_session rank -1 2024-09-12T00:55:15.266 INFO:tasks.workunit.client.0.smithi073.stderr: -347> 2024-09-12T00:55:14.975+0000 7f904cd46800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:55:15.266 INFO:tasks.workunit.client.0.smithi073.stderr: -346> 2024-09-12T00:55:14.975+0000 7f904cd46800 10 monclient(hunting): picked mon.noname-c con 0x5613b740fae0 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:55:15.266 INFO:tasks.workunit.client.0.smithi073.stderr: -345> 2024-09-12T00:55:14.975+0000 7f904cd46800 10 monclient(hunting): picked mon.noname-a con 0x5613b74084d0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:55:15.266 INFO:tasks.workunit.client.0.smithi073.stderr: -344> 2024-09-12T00:55:14.975+0000 7f904cd46800 10 monclient(hunting): picked mon.noname-b con 0x5613b740afe0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:55:15.266 INFO:tasks.workunit.client.0.smithi073.stderr: -343> 2024-09-12T00:55:14.975+0000 7f904cd46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:15.266 INFO:tasks.workunit.client.0.smithi073.stderr: -342> 2024-09-12T00:55:14.975+0000 7f904cd46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:15.266 INFO:tasks.workunit.client.0.smithi073.stderr: -341> 2024-09-12T00:55:14.975+0000 7f904cd46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:15.266 INFO:tasks.workunit.client.0.smithi073.stderr: -340> 2024-09-12T00:55:14.975+0000 7f904cd46800 10 monclient(hunting): _renew_subs 2024-09-12T00:55:15.266 INFO:tasks.workunit.client.0.smithi073.stderr: -339> 2024-09-12T00:55:14.975+0000 7f904cd46800 10 monclient(hunting): authenticate will time out at 2375.645283s 2024-09-12T00:55:15.267 INFO:tasks.workunit.client.0.smithi073.stderr: -338> 2024-09-12T00:55:14.975+0000 7f904a036640 10 monclient(hunting): get_auth_request con 0x5613b74084d0 auth_method 0 2024-09-12T00:55:15.267 INFO:tasks.workunit.client.0.smithi073.stderr: -337> 2024-09-12T00:55:14.975+0000 7f904a036640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:15.267 INFO:tasks.workunit.client.0.smithi073.stderr: -336> 2024-09-12T00:55:14.975+0000 7f904a036640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:15.267 INFO:tasks.workunit.client.0.smithi073.stderr: -335> 2024-09-12T00:55:14.975+0000 7f904a036640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:15.267 INFO:tasks.workunit.client.0.smithi073.stderr: -334> 2024-09-12T00:55:14.975+0000 7f904a837640 10 monclient(hunting): get_auth_request con 0x5613b740fae0 auth_method 0 2024-09-12T00:55:15.267 INFO:tasks.workunit.client.0.smithi073.stderr: -333> 2024-09-12T00:55:14.975+0000 7f904a837640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:15.267 INFO:tasks.workunit.client.0.smithi073.stderr: -332> 2024-09-12T00:55:14.975+0000 7f904a837640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:15.267 INFO:tasks.workunit.client.0.smithi073.stderr: -331> 2024-09-12T00:55:14.975+0000 7f904a837640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:15.267 INFO:tasks.workunit.client.0.smithi073.stderr: -330> 2024-09-12T00:55:14.975+0000 7f904a036640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:15.267 INFO:tasks.workunit.client.0.smithi073.stderr: -329> 2024-09-12T00:55:14.975+0000 7f904a036640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:15.267 INFO:tasks.workunit.client.0.smithi073.stderr: -328> 2024-09-12T00:55:14.975+0000 7f904a036640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:15.267 INFO:tasks.workunit.client.0.smithi073.stderr: -327> 2024-09-12T00:55:14.975+0000 7f904b038640 10 monclient(hunting): get_auth_request con 0x5613b740afe0 auth_method 0 2024-09-12T00:55:15.267 INFO:tasks.workunit.client.0.smithi073.stderr: -326> 2024-09-12T00:55:14.975+0000 7f904b038640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:15.267 INFO:tasks.workunit.client.0.smithi073.stderr: -325> 2024-09-12T00:55:14.975+0000 7f904b038640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:15.268 INFO:tasks.workunit.client.0.smithi073.stderr: -324> 2024-09-12T00:55:14.975+0000 7f904b038640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:15.268 INFO:tasks.workunit.client.0.smithi073.stderr: -323> 2024-09-12T00:55:14.975+0000 7f904a837640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:15.268 INFO:tasks.workunit.client.0.smithi073.stderr: -322> 2024-09-12T00:55:14.975+0000 7f904a837640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:15.268 INFO:tasks.workunit.client.0.smithi073.stderr: -321> 2024-09-12T00:55:14.975+0000 7f904a837640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:15.268 INFO:tasks.workunit.client.0.smithi073.stderr: -320> 2024-09-12T00:55:14.975+0000 7f904b038640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:15.268 INFO:tasks.workunit.client.0.smithi073.stderr: -319> 2024-09-12T00:55:14.975+0000 7f904b038640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:15.268 INFO:tasks.workunit.client.0.smithi073.stderr: -318> 2024-09-12T00:55:14.975+0000 7f904b038640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:15.268 INFO:tasks.workunit.client.0.smithi073.stderr: -317> 2024-09-12T00:55:14.975+0000 7f904a036640 10 monclient(hunting): handle_auth_done global_id 8370 payload 824 2024-09-12T00:55:15.268 INFO:tasks.workunit.client.0.smithi073.stderr: -316> 2024-09-12T00:55:14.975+0000 7f904a036640 10 monclient: _finish_hunting 0 2024-09-12T00:55:15.268 INFO:tasks.workunit.client.0.smithi073.stderr: -315> 2024-09-12T00:55:14.975+0000 7f904a036640 1 monclient: found mon.noname-a 2024-09-12T00:55:15.268 INFO:tasks.workunit.client.0.smithi073.stderr: -314> 2024-09-12T00:55:14.975+0000 7f904a036640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:55:15.268 INFO:tasks.workunit.client.0.smithi073.stderr: -313> 2024-09-12T00:55:14.975+0000 7f8f34e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:15.268 INFO:tasks.workunit.client.0.smithi073.stderr: -312> 2024-09-12T00:55:14.975+0000 7f8f34e01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:55:15.269 INFO:tasks.workunit.client.0.smithi073.stderr: -311> 2024-09-12T00:55:14.975+0000 7f8f34e01640 10 monclient: dump: 2024-09-12T00:55:15.269 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:55:15.269 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:55:15.269 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:55:15.269 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:55:15.269 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:15.269 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:55:15.269 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:55:15.269 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:55:15.269 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:55:15.269 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:55:15.269 INFO:tasks.workunit.client.0.smithi073.stderr: -310> 2024-09-12T00:55:14.975+0000 7f8f34e01640 10 monclient: _finish_auth 0 2024-09-12T00:55:15.269 INFO:tasks.workunit.client.0.smithi073.stderr: -309> 2024-09-12T00:55:14.975+0000 7f8f34e01640 10 monclient: _check_auth_tickets 2024-09-12T00:55:15.269 INFO:tasks.workunit.client.0.smithi073.stderr: -308> 2024-09-12T00:55:14.975+0000 7f8f34e01640 10 monclient: handle_config config(0 keys) 2024-09-12T00:55:15.270 INFO:tasks.workunit.client.0.smithi073.stderr: -307> 2024-09-12T00:55:14.975+0000 7f8f34e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:15.270 INFO:tasks.workunit.client.0.smithi073.stderr: -306> 2024-09-12T00:55:14.975+0000 7f8f34e01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:55:15.270 INFO:tasks.workunit.client.0.smithi073.stderr: -305> 2024-09-12T00:55:14.975+0000 7f8f34e01640 10 monclient: dump: 2024-09-12T00:55:15.270 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:55:15.270 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:55:15.270 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:55:15.270 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:55:15.270 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:15.270 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:55:15.270 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:55:15.270 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:55:15.270 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:55:15.270 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:55:15.271 INFO:tasks.workunit.client.0.smithi073.stderr: -304> 2024-09-12T00:55:14.975+0000 7f904cd46800 5 monclient: authenticate success, global_id 8370 2024-09-12T00:55:15.271 INFO:tasks.workunit.client.0.smithi073.stderr: -303> 2024-09-12T00:55:14.975+0000 7f904cd46800 10 monclient: _renew_subs 2024-09-12T00:55:15.271 INFO:tasks.workunit.client.0.smithi073.stderr: -302> 2024-09-12T00:55:14.975+0000 7f904cd46800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:55:15.271 INFO:tasks.workunit.client.0.smithi073.stderr: -301> 2024-09-12T00:55:14.975+0000 7f904b839640 4 set_mon_vals no callback set 2024-09-12T00:55:15.271 INFO:tasks.workunit.client.0.smithi073.stderr: -300> 2024-09-12T00:55:14.976+0000 7f904cd46800 10 monclient: _renew_subs 2024-09-12T00:55:15.271 INFO:tasks.workunit.client.0.smithi073.stderr: -299> 2024-09-12T00:55:14.976+0000 7f904cd46800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:55:15.271 INFO:tasks.workunit.client.0.smithi073.stderr: -298> 2024-09-12T00:55:14.977+0000 7f8f34e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:55:15.271 INFO:tasks.workunit.client.0.smithi073.stderr: -297> 2024-09-12T00:55:14.977+0000 7f8f34e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:55:15.271 INFO:tasks.workunit.client.0.smithi073.stderr: -296> 2024-09-12T00:55:14.977+0000 7f8f34e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:55:15.271 INFO:tasks.workunit.client.0.smithi073.stderr: -295> 2024-09-12T00:55:14.977+0000 7f904a837640 10 monclient: get_auth_request con 0x7f8f240763b0 auth_method 0 2024-09-12T00:55:15.271 INFO:tasks.workunit.client.0.smithi073.stderr: -294> 2024-09-12T00:55:14.978+0000 7f904cd46800 10 monclient: get_monmap_and_config 2024-09-12T00:55:15.271 INFO:tasks.workunit.client.0.smithi073.stderr: -293> 2024-09-12T00:55:14.978+0000 7f904cd46800 10 monclient: build_initial_monmap 2024-09-12T00:55:15.271 INFO:tasks.workunit.client.0.smithi073.stderr: -292> 2024-09-12T00:55:14.978+0000 7f904cd46800 1 build_initial for_mkfs: 0 2024-09-12T00:55:15.271 INFO:tasks.workunit.client.0.smithi073.stderr: -291> 2024-09-12T00:55:14.978+0000 7f904cd46800 10 monclient: monmap: 2024-09-12T00:55:15.272 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:55:15.272 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:55:15.272 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:55:15.272 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:55:15.272 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:55:15.272 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:55:15.272 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:55:15.272 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:55:15.272 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:55:15.272 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:55:15.272 INFO:tasks.workunit.client.0.smithi073.stderr: -290> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x5613b742ab60) adding auth protocol: cephx 2024-09-12T00:55:15.272 INFO:tasks.workunit.client.0.smithi073.stderr: -289> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x5613b742ab60) adding auth protocol: cephx 2024-09-12T00:55:15.273 INFO:tasks.workunit.client.0.smithi073.stderr: -288> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x5613b742ab60) adding auth protocol: cephx 2024-09-12T00:55:15.273 INFO:tasks.workunit.client.0.smithi073.stderr: -287> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x5613b742ab60) adding con mode: secure 2024-09-12T00:55:15.273 INFO:tasks.workunit.client.0.smithi073.stderr: -286> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x5613b742ab60) adding con mode: crc 2024-09-12T00:55:15.273 INFO:tasks.workunit.client.0.smithi073.stderr: -285> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x5613b742ab60) adding con mode: secure 2024-09-12T00:55:15.273 INFO:tasks.workunit.client.0.smithi073.stderr: -284> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x5613b742ab60) adding con mode: crc 2024-09-12T00:55:15.273 INFO:tasks.workunit.client.0.smithi073.stderr: -283> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x5613b742ab60) adding con mode: secure 2024-09-12T00:55:15.273 INFO:tasks.workunit.client.0.smithi073.stderr: -282> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x5613b742ab60) adding con mode: crc 2024-09-12T00:55:15.273 INFO:tasks.workunit.client.0.smithi073.stderr: -281> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x5613b742ab60) adding con mode: crc 2024-09-12T00:55:15.273 INFO:tasks.workunit.client.0.smithi073.stderr: -280> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x5613b742ab60) adding con mode: secure 2024-09-12T00:55:15.273 INFO:tasks.workunit.client.0.smithi073.stderr: -279> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x5613b742ab60) adding con mode: crc 2024-09-12T00:55:15.273 INFO:tasks.workunit.client.0.smithi073.stderr: -278> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x5613b742ab60) adding con mode: secure 2024-09-12T00:55:15.273 INFO:tasks.workunit.client.0.smithi073.stderr: -277> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x5613b742ab60) adding con mode: crc 2024-09-12T00:55:15.273 INFO:tasks.workunit.client.0.smithi073.stderr: -276> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x5613b742ab60) adding con mode: secure 2024-09-12T00:55:15.274 INFO:tasks.workunit.client.0.smithi073.stderr: -275> 2024-09-12T00:55:14.978+0000 7f904cd46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:15.274 INFO:tasks.workunit.client.0.smithi073.stderr: -274> 2024-09-12T00:55:14.978+0000 7f904cd46800 10 monclient: init 2024-09-12T00:55:15.274 INFO:tasks.workunit.client.0.smithi073.stderr: -273> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc0de0) adding auth protocol: cephx 2024-09-12T00:55:15.274 INFO:tasks.workunit.client.0.smithi073.stderr: -272> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc0de0) adding auth protocol: cephx 2024-09-12T00:55:15.274 INFO:tasks.workunit.client.0.smithi073.stderr: -271> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc0de0) adding auth protocol: cephx 2024-09-12T00:55:15.274 INFO:tasks.workunit.client.0.smithi073.stderr: -270> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc0de0) adding con mode: secure 2024-09-12T00:55:15.274 INFO:tasks.workunit.client.0.smithi073.stderr: -269> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc0de0) adding con mode: crc 2024-09-12T00:55:15.274 INFO:tasks.workunit.client.0.smithi073.stderr: -268> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc0de0) adding con mode: secure 2024-09-12T00:55:15.274 INFO:tasks.workunit.client.0.smithi073.stderr: -267> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc0de0) adding con mode: crc 2024-09-12T00:55:15.274 INFO:tasks.workunit.client.0.smithi073.stderr: -266> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc0de0) adding con mode: secure 2024-09-12T00:55:15.274 INFO:tasks.workunit.client.0.smithi073.stderr: -265> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc0de0) adding con mode: crc 2024-09-12T00:55:15.274 INFO:tasks.workunit.client.0.smithi073.stderr: -264> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc0de0) adding con mode: crc 2024-09-12T00:55:15.274 INFO:tasks.workunit.client.0.smithi073.stderr: -263> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc0de0) adding con mode: secure 2024-09-12T00:55:15.275 INFO:tasks.workunit.client.0.smithi073.stderr: -262> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc0de0) adding con mode: crc 2024-09-12T00:55:15.275 INFO:tasks.workunit.client.0.smithi073.stderr: -261> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc0de0) adding con mode: secure 2024-09-12T00:55:15.275 INFO:tasks.workunit.client.0.smithi073.stderr: -260> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc0de0) adding con mode: crc 2024-09-12T00:55:15.275 INFO:tasks.workunit.client.0.smithi073.stderr: -259> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc0de0) adding con mode: secure 2024-09-12T00:55:15.275 INFO:tasks.workunit.client.0.smithi073.stderr: -258> 2024-09-12T00:55:14.978+0000 7f904cd46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:15.275 INFO:tasks.workunit.client.0.smithi073.stderr: -257> 2024-09-12T00:55:14.979+0000 7f904cd46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:15.275 INFO:tasks.workunit.client.0.smithi073.stderr: -256> 2024-09-12T00:55:14.979+0000 7f904cd46800 5 asok(0x5613b716e630) register_command rotate-key cmddesc rotate-key hook 0x7ffff1dc0f28 EEXIST 2024-09-12T00:55:15.275 INFO:tasks.workunit.client.0.smithi073.stderr: -255> 2024-09-12T00:55:14.979+0000 7f904cd46800 10 monclient: _reopen_session rank -1 2024-09-12T00:55:15.275 INFO:tasks.workunit.client.0.smithi073.stderr: -254> 2024-09-12T00:55:14.979+0000 7f904cd46800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:55:15.275 INFO:tasks.workunit.client.0.smithi073.stderr: -253> 2024-09-12T00:55:14.979+0000 7f904cd46800 10 monclient(hunting): picked mon.noname-b con 0x5613b745f110 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:55:15.275 INFO:tasks.workunit.client.0.smithi073.stderr: -252> 2024-09-12T00:55:14.979+0000 7f904cd46800 10 monclient(hunting): picked mon.noname-a con 0x5613b744fa60 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:55:15.275 INFO:tasks.workunit.client.0.smithi073.stderr: -251> 2024-09-12T00:55:14.979+0000 7f904cd46800 10 monclient(hunting): picked mon.noname-c con 0x5613b745a540 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:55:15.275 INFO:tasks.workunit.client.0.smithi073.stderr: -250> 2024-09-12T00:55:14.979+0000 7f904cd46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:15.275 INFO:tasks.workunit.client.0.smithi073.stderr: -249> 2024-09-12T00:55:14.979+0000 7f904cd46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:15.276 INFO:tasks.workunit.client.0.smithi073.stderr: -248> 2024-09-12T00:55:14.979+0000 7f904cd46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:15.276 INFO:tasks.workunit.client.0.smithi073.stderr: -247> 2024-09-12T00:55:14.979+0000 7f904cd46800 10 monclient(hunting): _renew_subs 2024-09-12T00:55:15.276 INFO:tasks.workunit.client.0.smithi073.stderr: -246> 2024-09-12T00:55:14.979+0000 7f904cd46800 10 monclient(hunting): authenticate will time out at 2375.649136s 2024-09-12T00:55:15.276 INFO:tasks.workunit.client.0.smithi073.stderr: -245> 2024-09-12T00:55:14.979+0000 7f904b038640 10 monclient(hunting): get_auth_request con 0x5613b745a540 auth_method 0 2024-09-12T00:55:15.276 INFO:tasks.workunit.client.0.smithi073.stderr: -244> 2024-09-12T00:55:14.979+0000 7f904b038640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:15.276 INFO:tasks.workunit.client.0.smithi073.stderr: -243> 2024-09-12T00:55:14.979+0000 7f904b038640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:15.276 INFO:tasks.workunit.client.0.smithi073.stderr: -242> 2024-09-12T00:55:14.979+0000 7f904b038640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:15.276 INFO:tasks.workunit.client.0.smithi073.stderr: -241> 2024-09-12T00:55:14.979+0000 7f904a036640 10 monclient(hunting): get_auth_request con 0x5613b744fa60 auth_method 0 2024-09-12T00:55:15.276 INFO:tasks.workunit.client.0.smithi073.stderr: -240> 2024-09-12T00:55:14.979+0000 7f904a036640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:15.276 INFO:tasks.workunit.client.0.smithi073.stderr: -239> 2024-09-12T00:55:14.979+0000 7f904a036640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:15.276 INFO:tasks.workunit.client.0.smithi073.stderr: -238> 2024-09-12T00:55:14.979+0000 7f904a036640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:15.276 INFO:tasks.workunit.client.0.smithi073.stderr: -237> 2024-09-12T00:55:14.979+0000 7f904b038640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:15.277 INFO:tasks.workunit.client.0.smithi073.stderr: -236> 2024-09-12T00:55:14.979+0000 7f904b038640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:15.277 INFO:tasks.workunit.client.0.smithi073.stderr: -235> 2024-09-12T00:55:14.979+0000 7f904b038640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:15.277 INFO:tasks.workunit.client.0.smithi073.stderr: -234> 2024-09-12T00:55:14.979+0000 7f904a036640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:15.277 INFO:tasks.workunit.client.0.smithi073.stderr: -233> 2024-09-12T00:55:14.979+0000 7f904a036640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:15.277 INFO:tasks.workunit.client.0.smithi073.stderr: -232> 2024-09-12T00:55:14.979+0000 7f904a036640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:15.277 INFO:tasks.workunit.client.0.smithi073.stderr: -231> 2024-09-12T00:55:14.979+0000 7f904b038640 10 monclient(hunting): handle_auth_done global_id 7856 payload 274 2024-09-12T00:55:15.277 INFO:tasks.workunit.client.0.smithi073.stderr: -230> 2024-09-12T00:55:14.979+0000 7f904b038640 10 monclient: _finish_hunting 0 2024-09-12T00:55:15.277 INFO:tasks.workunit.client.0.smithi073.stderr: -229> 2024-09-12T00:55:14.979+0000 7f904b038640 1 monclient: found mon.noname-c 2024-09-12T00:55:15.277 INFO:tasks.workunit.client.0.smithi073.stderr: -228> 2024-09-12T00:55:14.979+0000 7f904b038640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.73:3301/0 2024-09-12T00:55:15.277 INFO:tasks.workunit.client.0.smithi073.stderr: -227> 2024-09-12T00:55:14.979+0000 7f8f2e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:15.277 INFO:tasks.workunit.client.0.smithi073.stderr: -226> 2024-09-12T00:55:14.979+0000 7f8f2e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:55:15.277 INFO:tasks.workunit.client.0.smithi073.stderr: -225> 2024-09-12T00:55:14.979+0000 7f8f2e7fc640 10 monclient: dump: 2024-09-12T00:55:15.278 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:55:15.278 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:55:15.278 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:55:15.278 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:55:15.278 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:15.278 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:55:15.278 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:55:15.278 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:55:15.278 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:55:15.278 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:55:15.278 INFO:tasks.workunit.client.0.smithi073.stderr: -224> 2024-09-12T00:55:14.979+0000 7f8f2e7fc640 10 monclient: _finish_auth 0 2024-09-12T00:55:15.278 INFO:tasks.workunit.client.0.smithi073.stderr: -223> 2024-09-12T00:55:14.979+0000 7f8f2e7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:55:15.278 INFO:tasks.workunit.client.0.smithi073.stderr: -222> 2024-09-12T00:55:14.979+0000 7f8f2e7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:55:15.278 INFO:tasks.workunit.client.0.smithi073.stderr: -221> 2024-09-12T00:55:14.979+0000 7f904cd46800 5 monclient: authenticate success, global_id 7856 2024-09-12T00:55:15.279 INFO:tasks.workunit.client.0.smithi073.stderr: -220> 2024-09-12T00:55:14.979+0000 7f904cd46800 10 monclient: get_monmap_and_config success 2024-09-12T00:55:15.279 INFO:tasks.workunit.client.0.smithi073.stderr: -219> 2024-09-12T00:55:14.979+0000 7f904cd46800 4 set_mon_vals no callback set 2024-09-12T00:55:15.279 INFO:tasks.workunit.client.0.smithi073.stderr: -218> 2024-09-12T00:55:14.979+0000 7f8f2e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:15.279 INFO:tasks.workunit.client.0.smithi073.stderr: -217> 2024-09-12T00:55:14.979+0000 7f8f2e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:55:15.279 INFO:tasks.workunit.client.0.smithi073.stderr: -216> 2024-09-12T00:55:14.979+0000 7f8f2e7fc640 10 monclient: dump: 2024-09-12T00:55:15.279 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:55:15.279 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:55:15.279 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:55:15.279 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:55:15.279 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:15.279 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:55:15.279 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:55:15.279 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:55:15.279 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:55:15.280 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:55:15.280 INFO:tasks.workunit.client.0.smithi073.stderr: -215> 2024-09-12T00:55:14.980+0000 7f904cd46800 10 monclient: shutdown 2024-09-12T00:55:15.280 INFO:tasks.workunit.client.0.smithi073.stderr: -214> 2024-09-12T00:55:14.980+0000 7f904cd46800 10 monclient: build_initial_monmap 2024-09-12T00:55:15.280 INFO:tasks.workunit.client.0.smithi073.stderr: -213> 2024-09-12T00:55:14.980+0000 7f904cd46800 1 build_initial for_mkfs: 0 2024-09-12T00:55:15.280 INFO:tasks.workunit.client.0.smithi073.stderr: -212> 2024-09-12T00:55:14.980+0000 7f904cd46800 10 monclient: monmap: 2024-09-12T00:55:15.280 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:55:15.280 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:55:15.280 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:55:15.280 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:55:15.280 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:55:15.280 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:55:15.280 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:55:15.280 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:55:15.281 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:55:15.281 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:55:15.281 INFO:tasks.workunit.client.0.smithi073.stderr: -211> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b742e670) adding auth protocol: cephx 2024-09-12T00:55:15.281 INFO:tasks.workunit.client.0.smithi073.stderr: -210> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b742e670) adding auth protocol: cephx 2024-09-12T00:55:15.281 INFO:tasks.workunit.client.0.smithi073.stderr: -209> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b742e670) adding auth protocol: cephx 2024-09-12T00:55:15.281 INFO:tasks.workunit.client.0.smithi073.stderr: -208> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b742e670) adding con mode: secure 2024-09-12T00:55:15.281 INFO:tasks.workunit.client.0.smithi073.stderr: -207> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b742e670) adding con mode: crc 2024-09-12T00:55:15.281 INFO:tasks.workunit.client.0.smithi073.stderr: -206> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b742e670) adding con mode: secure 2024-09-12T00:55:15.281 INFO:tasks.workunit.client.0.smithi073.stderr: -205> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b742e670) adding con mode: crc 2024-09-12T00:55:15.281 INFO:tasks.workunit.client.0.smithi073.stderr: -204> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b742e670) adding con mode: secure 2024-09-12T00:55:15.281 INFO:tasks.workunit.client.0.smithi073.stderr: -203> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b742e670) adding con mode: crc 2024-09-12T00:55:15.281 INFO:tasks.workunit.client.0.smithi073.stderr: -202> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b742e670) adding con mode: crc 2024-09-12T00:55:15.282 INFO:tasks.workunit.client.0.smithi073.stderr: -201> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b742e670) adding con mode: secure 2024-09-12T00:55:15.282 INFO:tasks.workunit.client.0.smithi073.stderr: -200> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b742e670) adding con mode: crc 2024-09-12T00:55:15.282 INFO:tasks.workunit.client.0.smithi073.stderr: -199> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b742e670) adding con mode: secure 2024-09-12T00:55:15.282 INFO:tasks.workunit.client.0.smithi073.stderr: -198> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b742e670) adding con mode: crc 2024-09-12T00:55:15.284 INFO:tasks.workunit.client.0.smithi073.stderr: -197> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b742e670) adding con mode: secure 2024-09-12T00:55:15.284 INFO:tasks.workunit.client.0.smithi073.stderr: -196> 2024-09-12T00:55:14.980+0000 7f904cd46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:15.284 INFO:tasks.workunit.client.0.smithi073.stderr: -195> 2024-09-12T00:55:14.980+0000 7f904cd46800 1 librados: starting msgr at 2024-09-12T00:55:15.284 INFO:tasks.workunit.client.0.smithi073.stderr: -194> 2024-09-12T00:55:14.980+0000 7f904cd46800 1 librados: starting objecter 2024-09-12T00:55:15.284 INFO:tasks.workunit.client.0.smithi073.stderr: -193> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 asok(0x5613b716e630) register_command objecter_requests cmddesc objecter_requests hook 0x5613b742d560 EEXIST 2024-09-12T00:55:15.284 INFO:tasks.workunit.client.0.smithi073.stderr: -192> 2024-09-12T00:55:14.980+0000 7f904cd46800 1 librados: setting wanted keys 2024-09-12T00:55:15.284 INFO:tasks.workunit.client.0.smithi073.stderr: -191> 2024-09-12T00:55:14.980+0000 7f904cd46800 1 librados: calling monclient init 2024-09-12T00:55:15.284 INFO:tasks.workunit.client.0.smithi073.stderr: -190> 2024-09-12T00:55:14.980+0000 7f904cd46800 10 monclient: init 2024-09-12T00:55:15.284 INFO:tasks.workunit.client.0.smithi073.stderr: -189> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b7218500) adding auth protocol: cephx 2024-09-12T00:55:15.284 INFO:tasks.workunit.client.0.smithi073.stderr: -188> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b7218500) adding auth protocol: cephx 2024-09-12T00:55:15.284 INFO:tasks.workunit.client.0.smithi073.stderr: -187> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b7218500) adding auth protocol: cephx 2024-09-12T00:55:15.285 INFO:tasks.workunit.client.0.smithi073.stderr: -186> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b7218500) adding con mode: secure 2024-09-12T00:55:15.285 INFO:tasks.workunit.client.0.smithi073.stderr: -185> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b7218500) adding con mode: crc 2024-09-12T00:55:15.285 INFO:tasks.workunit.client.0.smithi073.stderr: -184> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b7218500) adding con mode: secure 2024-09-12T00:55:15.285 INFO:tasks.workunit.client.0.smithi073.stderr: -183> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b7218500) adding con mode: crc 2024-09-12T00:55:15.285 INFO:tasks.workunit.client.0.smithi073.stderr: -182> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b7218500) adding con mode: secure 2024-09-12T00:55:15.285 INFO:tasks.workunit.client.0.smithi073.stderr: -181> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b7218500) adding con mode: crc 2024-09-12T00:55:15.285 INFO:tasks.workunit.client.0.smithi073.stderr: -180> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b7218500) adding con mode: crc 2024-09-12T00:55:15.285 INFO:tasks.workunit.client.0.smithi073.stderr: -179> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b7218500) adding con mode: secure 2024-09-12T00:55:15.285 INFO:tasks.workunit.client.0.smithi073.stderr: -178> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b7218500) adding con mode: crc 2024-09-12T00:55:15.285 INFO:tasks.workunit.client.0.smithi073.stderr: -177> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b7218500) adding con mode: secure 2024-09-12T00:55:15.285 INFO:tasks.workunit.client.0.smithi073.stderr: -176> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b7218500) adding con mode: crc 2024-09-12T00:55:15.285 INFO:tasks.workunit.client.0.smithi073.stderr: -175> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b7218500) adding con mode: secure 2024-09-12T00:55:15.285 INFO:tasks.workunit.client.0.smithi073.stderr: -174> 2024-09-12T00:55:14.981+0000 7f904cd46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:15.285 INFO:tasks.workunit.client.0.smithi073.stderr: -173> 2024-09-12T00:55:14.981+0000 7f904cd46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:15.286 INFO:tasks.workunit.client.0.smithi073.stderr: -172> 2024-09-12T00:55:14.981+0000 7f904cd46800 5 asok(0x5613b716e630) register_command rotate-key cmddesc rotate-key hook 0x5613b7218648 EEXIST 2024-09-12T00:55:15.286 INFO:tasks.workunit.client.0.smithi073.stderr: -171> 2024-09-12T00:55:14.981+0000 7f904cd46800 10 monclient: _reopen_session rank -1 2024-09-12T00:55:15.286 INFO:tasks.workunit.client.0.smithi073.stderr: -170> 2024-09-12T00:55:14.981+0000 7f904cd46800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:55:15.286 INFO:tasks.workunit.client.0.smithi073.stderr: -169> 2024-09-12T00:55:14.981+0000 7f904cd46800 10 monclient(hunting): picked mon.noname-a con 0x5613b744fa60 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:55:15.286 INFO:tasks.workunit.client.0.smithi073.stderr: -168> 2024-09-12T00:55:14.981+0000 7f904cd46800 10 monclient(hunting): picked mon.noname-c con 0x5613b745a540 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:55:15.286 INFO:tasks.workunit.client.0.smithi073.stderr: -167> 2024-09-12T00:55:14.981+0000 7f904cd46800 10 monclient(hunting): picked mon.noname-b con 0x5613b745f110 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:55:15.286 INFO:tasks.workunit.client.0.smithi073.stderr: -166> 2024-09-12T00:55:14.981+0000 7f904cd46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:15.286 INFO:tasks.workunit.client.0.smithi073.stderr: -165> 2024-09-12T00:55:14.981+0000 7f904cd46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:15.286 INFO:tasks.workunit.client.0.smithi073.stderr: -164> 2024-09-12T00:55:14.981+0000 7f904cd46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:15.286 INFO:tasks.workunit.client.0.smithi073.stderr: -163> 2024-09-12T00:55:14.981+0000 7f904cd46800 10 monclient(hunting): _renew_subs 2024-09-12T00:55:15.286 INFO:tasks.workunit.client.0.smithi073.stderr: -162> 2024-09-12T00:55:14.981+0000 7f904cd46800 10 monclient(hunting): authenticate will time out at 2375.651439s 2024-09-12T00:55:15.286 INFO:tasks.workunit.client.0.smithi073.stderr: -161> 2024-09-12T00:55:14.981+0000 7f904a837640 10 monclient(hunting): get_auth_request con 0x5613b744fa60 auth_method 0 2024-09-12T00:55:15.287 INFO:tasks.workunit.client.0.smithi073.stderr: -160> 2024-09-12T00:55:14.981+0000 7f904a837640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:15.287 INFO:tasks.workunit.client.0.smithi073.stderr: -159> 2024-09-12T00:55:14.981+0000 7f904a837640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:15.287 INFO:tasks.workunit.client.0.smithi073.stderr: -158> 2024-09-12T00:55:14.981+0000 7f904a837640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:15.287 INFO:tasks.workunit.client.0.smithi073.stderr: -157> 2024-09-12T00:55:14.981+0000 7f904a036640 10 monclient(hunting): get_auth_request con 0x5613b745a540 auth_method 0 2024-09-12T00:55:15.287 INFO:tasks.workunit.client.0.smithi073.stderr: -156> 2024-09-12T00:55:14.981+0000 7f904a036640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:15.287 INFO:tasks.workunit.client.0.smithi073.stderr: -155> 2024-09-12T00:55:14.981+0000 7f904a036640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:15.287 INFO:tasks.workunit.client.0.smithi073.stderr: -154> 2024-09-12T00:55:14.981+0000 7f904a036640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:15.287 INFO:tasks.workunit.client.0.smithi073.stderr: -153> 2024-09-12T00:55:14.981+0000 7f904a837640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:15.287 INFO:tasks.workunit.client.0.smithi073.stderr: -152> 2024-09-12T00:55:14.981+0000 7f904a837640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:15.287 INFO:tasks.workunit.client.0.smithi073.stderr: -151> 2024-09-12T00:55:14.981+0000 7f904a837640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:15.287 INFO:tasks.workunit.client.0.smithi073.stderr: -150> 2024-09-12T00:55:14.981+0000 7f904a036640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:15.287 INFO:tasks.workunit.client.0.smithi073.stderr: -149> 2024-09-12T00:55:14.981+0000 7f904a036640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:15.287 INFO:tasks.workunit.client.0.smithi073.stderr: -148> 2024-09-12T00:55:14.981+0000 7f904a036640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:15.288 INFO:tasks.workunit.client.0.smithi073.stderr: -147> 2024-09-12T00:55:14.981+0000 7f904a837640 10 monclient(hunting): handle_auth_done global_id 8376 payload 824 2024-09-12T00:55:15.288 INFO:tasks.workunit.client.0.smithi073.stderr: -146> 2024-09-12T00:55:14.981+0000 7f904a837640 10 monclient: _finish_hunting 0 2024-09-12T00:55:15.288 INFO:tasks.workunit.client.0.smithi073.stderr: -145> 2024-09-12T00:55:14.981+0000 7f904a837640 1 monclient: found mon.noname-a 2024-09-12T00:55:15.288 INFO:tasks.workunit.client.0.smithi073.stderr: -144> 2024-09-12T00:55:14.981+0000 7f904a837640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:55:15.288 INFO:tasks.workunit.client.0.smithi073.stderr: -143> 2024-09-12T00:55:14.982+0000 7f8f2cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:15.288 INFO:tasks.workunit.client.0.smithi073.stderr: -142> 2024-09-12T00:55:14.982+0000 7f8f2cff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:55:15.288 INFO:tasks.workunit.client.0.smithi073.stderr: -141> 2024-09-12T00:55:14.982+0000 7f8f2cff9640 10 monclient: dump: 2024-09-12T00:55:15.288 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:55:15.288 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:55:15.288 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:55:15.288 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:55:15.288 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:15.289 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:55:15.289 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:55:15.289 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:55:15.289 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:55:15.289 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:55:15.289 INFO:tasks.workunit.client.0.smithi073.stderr: -140> 2024-09-12T00:55:14.982+0000 7f8f2cff9640 10 monclient: _finish_auth 0 2024-09-12T00:55:15.289 INFO:tasks.workunit.client.0.smithi073.stderr: -139> 2024-09-12T00:55:14.982+0000 7f8f2cff9640 10 monclient: _check_auth_tickets 2024-09-12T00:55:15.289 INFO:tasks.workunit.client.0.smithi073.stderr: -138> 2024-09-12T00:55:14.982+0000 7f8f2cff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:55:15.289 INFO:tasks.workunit.client.0.smithi073.stderr: -137> 2024-09-12T00:55:14.982+0000 7f8f2cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:15.289 INFO:tasks.workunit.client.0.smithi073.stderr: -136> 2024-09-12T00:55:14.982+0000 7f8f2cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:55:15.289 INFO:tasks.workunit.client.0.smithi073.stderr: -135> 2024-09-12T00:55:14.982+0000 7f8f2e7fc640 4 set_mon_vals no callback set 2024-09-12T00:55:15.289 INFO:tasks.workunit.client.0.smithi073.stderr: -134> 2024-09-12T00:55:14.982+0000 7f8f2cff9640 10 monclient: dump: 2024-09-12T00:55:15.289 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:55:15.289 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:55:15.289 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:55:15.290 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:55:15.290 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:15.290 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:55:15.290 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:55:15.290 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:55:15.290 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:55:15.290 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:55:15.290 INFO:tasks.workunit.client.0.smithi073.stderr: -133> 2024-09-12T00:55:14.982+0000 7f904cd46800 5 monclient: authenticate success, global_id 8376 2024-09-12T00:55:15.290 INFO:tasks.workunit.client.0.smithi073.stderr: -132> 2024-09-12T00:55:14.982+0000 7f904cd46800 10 monclient: _renew_subs 2024-09-12T00:55:15.290 INFO:tasks.workunit.client.0.smithi073.stderr: -131> 2024-09-12T00:55:14.982+0000 7f904cd46800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:55:15.290 INFO:tasks.workunit.client.0.smithi073.stderr: -130> 2024-09-12T00:55:14.982+0000 7f904cd46800 10 monclient: _renew_subs 2024-09-12T00:55:15.290 INFO:tasks.workunit.client.0.smithi073.stderr: -129> 2024-09-12T00:55:14.982+0000 7f904cd46800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:55:15.290 INFO:tasks.workunit.client.0.smithi073.stderr: -128> 2024-09-12T00:55:14.982+0000 7f904cd46800 1 librados: init done 2024-09-12T00:55:15.291 INFO:tasks.workunit.client.0.smithi073.stderr: -127> 2024-09-12T00:55:14.982+0000 7f904cd46800 5 asok(0x5613b716e630) register_command cr dump hook 0x5613b7458558 2024-09-12T00:55:15.291 INFO:tasks.workunit.client.0.smithi073.stderr: -126> 2024-09-12T00:55:14.983+0000 7f904cd46800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.291 INFO:tasks.workunit.client.0.smithi073.stderr: -125> 2024-09-12T00:55:14.984+0000 7f8f2cff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:55:15.291 INFO:tasks.workunit.client.0.smithi073.stderr: -124> 2024-09-12T00:55:14.984+0000 7f8f2cff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:55:15.291 INFO:tasks.workunit.client.0.smithi073.stderr: -123> 2024-09-12T00:55:14.984+0000 7f8f2cff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:55:15.291 INFO:tasks.workunit.client.0.smithi073.stderr: -122> 2024-09-12T00:55:14.984+0000 7f904a036640 10 monclient: get_auth_request con 0x7f8f14076470 auth_method 0 2024-09-12T00:55:15.291 INFO:tasks.workunit.client.0.smithi073.stderr: -121> 2024-09-12T00:55:14.985+0000 7f904b038640 10 monclient: get_auth_request con 0x5613b7479cb0 auth_method 0 2024-09-12T00:55:15.291 INFO:tasks.workunit.client.0.smithi073.stderr: -120> 2024-09-12T00:55:14.985+0000 7f904cd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:15.291 INFO:tasks.workunit.client.0.smithi073.stderr: -119> 2024-09-12T00:55:14.985+0000 7f904cd46800 20 realm 2024-09-12T00:55:15.291 INFO:tasks.workunit.client.0.smithi073.stderr: -118> 2024-09-12T00:55:14.985+0000 7f904cd46800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.291 INFO:tasks.workunit.client.0.smithi073.stderr: -117> 2024-09-12T00:55:14.985+0000 7f904cd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:15.291 INFO:tasks.workunit.client.0.smithi073.stderr: -116> 2024-09-12T00:55:14.985+0000 7f904cd46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:15.291 INFO:tasks.workunit.client.0.smithi073.stderr: -115> 2024-09-12T00:55:14.985+0000 7f904cd46800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.292 INFO:tasks.workunit.client.0.smithi073.stderr: -114> 2024-09-12T00:55:14.986+0000 7f904cd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:15.292 INFO:tasks.workunit.client.0.smithi073.stderr: -113> 2024-09-12T00:55:14.986+0000 7f904cd46800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.292 INFO:tasks.workunit.client.0.smithi073.stderr: -112> 2024-09-12T00:55:14.986+0000 7f904a837640 10 monclient: get_auth_request con 0x5613b747dea0 auth_method 0 2024-09-12T00:55:15.292 INFO:tasks.workunit.client.0.smithi073.stderr: -111> 2024-09-12T00:55:14.987+0000 7f904cd46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:15.292 INFO:tasks.workunit.client.0.smithi073.stderr: -110> 2024-09-12T00:55:14.987+0000 7f904cd46800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.292 INFO:tasks.workunit.client.0.smithi073.stderr: -109> 2024-09-12T00:55:14.987+0000 7f904a036640 10 monclient: get_auth_request con 0x5613b74816e0 auth_method 0 2024-09-12T00:55:15.292 INFO:tasks.workunit.client.0.smithi073.stderr: -108> 2024-09-12T00:55:14.987+0000 7f904cd46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:15.292 INFO:tasks.workunit.client.0.smithi073.stderr: -107> 2024-09-12T00:55:14.987+0000 7f904cd46800 20 searching for the correct realm 2024-09-12T00:55:15.292 INFO:tasks.workunit.client.0.smithi073.stderr: -106> 2024-09-12T00:55:14.988+0000 7f904b038640 10 monclient: get_auth_request con 0x5613b74864a0 auth_method 0 2024-09-12T00:55:15.292 INFO:tasks.workunit.client.0.smithi073.stderr: -105> 2024-09-12T00:55:14.988+0000 7f904a837640 10 monclient: get_auth_request con 0x7f904405c590 auth_method 0 2024-09-12T00:55:15.292 INFO:tasks.workunit.client.0.smithi073.stderr: -104> 2024-09-12T00:55:14.989+0000 7f904a036640 10 monclient: get_auth_request con 0x7f903c03f050 auth_method 0 2024-09-12T00:55:15.292 INFO:tasks.workunit.client.0.smithi073.stderr: -103> 2024-09-12T00:55:14.990+0000 7f904b038640 10 monclient: get_auth_request con 0x7f90340b5550 auth_method 0 2024-09-12T00:55:15.292 INFO:tasks.workunit.client.0.smithi073.stderr: -102> 2024-09-12T00:55:14.990+0000 7f904b038640 0 -- 172.21.15.73:0/1030248242 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f90340b5550 msgr2=0x7f90340ab4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:15.293 INFO:tasks.workunit.client.0.smithi073.stderr: -101> 2024-09-12T00:55:15.191+0000 7f904b038640 10 monclient: get_auth_request con 0x7f90340b5550 auth_method 0 2024-09-12T00:55:15.293 INFO:tasks.workunit.client.0.smithi073.stderr: -100> 2024-09-12T00:55:15.195+0000 7f904a837640 10 monclient: get_auth_request con 0x7f9044086b50 auth_method 0 2024-09-12T00:55:15.293 INFO:tasks.workunit.client.0.smithi073.stderr: -99> 2024-09-12T00:55:15.196+0000 7f904b038640 0 -- 172.21.15.73:0/1030248242 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f90340b5550 msgr2=0x7f90340ab4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:15.293 INFO:tasks.workunit.client.0.smithi073.stderr: -98> 2024-09-12T00:55:15.196+0000 7f8f2cff9640 1 client.8376.objecter ms_handle_reset 0x7f90340b5550 session 0x7f9034005040 osd.4 2024-09-12T00:55:15.293 INFO:tasks.workunit.client.0.smithi073.stderr: -97> 2024-09-12T00:55:15.196+0000 7f8f2cff9640 10 monclient: _renew_subs 2024-09-12T00:55:15.293 INFO:tasks.workunit.client.0.smithi073.stderr: -96> 2024-09-12T00:55:15.196+0000 7f8f2cff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:55:15.293 INFO:tasks.workunit.client.0.smithi073.stderr: -95> 2024-09-12T00:55:15.197+0000 7f904b038640 10 monclient: get_auth_request con 0x7f8f14086370 auth_method 0 2024-09-12T00:55:15.293 INFO:tasks.workunit.client.0.smithi073.stderr: -94> 2024-09-12T00:55:15.200+0000 7f904cd46800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:55:15.293 INFO:tasks.workunit.client.0.smithi073.stderr: -93> 2024-09-12T00:55:15.200+0000 7f904cd46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:15.293 INFO:tasks.workunit.client.0.smithi073.stderr: -92> 2024-09-12T00:55:15.200+0000 7f904cd46800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:55:15.293 INFO:tasks.workunit.client.0.smithi073.stderr: -91> 2024-09-12T00:55:15.200+0000 7f904cd46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:15.293 INFO:tasks.workunit.client.0.smithi073.stderr: -90> 2024-09-12T00:55:15.200+0000 7f904cd46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:15.293 INFO:tasks.workunit.client.0.smithi073.stderr: -89> 2024-09-12T00:55:15.200+0000 7f904cd46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:15.293 INFO:tasks.workunit.client.0.smithi073.stderr: -88> 2024-09-12T00:55:15.200+0000 7f904cd46800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.294 INFO:tasks.workunit.client.0.smithi073.stderr: -87> 2024-09-12T00:55:15.201+0000 7f904cd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:15.294 INFO:tasks.workunit.client.0.smithi073.stderr: -86> 2024-09-12T00:55:15.201+0000 7f904cd46800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.294 INFO:tasks.workunit.client.0.smithi073.stderr: -85> 2024-09-12T00:55:15.201+0000 7f904cd46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:15.294 INFO:tasks.workunit.client.0.smithi073.stderr: -84> 2024-09-12T00:55:15.201+0000 7f904cd46800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.294 INFO:tasks.workunit.client.0.smithi073.stderr: -83> 2024-09-12T00:55:15.201+0000 7f904cd46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:15.294 INFO:tasks.workunit.client.0.smithi073.stderr: -82> 2024-09-12T00:55:15.201+0000 7f904cd46800 20 zone default found 2024-09-12T00:55:15.294 INFO:tasks.workunit.client.0.smithi073.stderr: -81> 2024-09-12T00:55:15.201+0000 7f904cd46800 4 Realm: () 2024-09-12T00:55:15.294 INFO:tasks.workunit.client.0.smithi073.stderr: -80> 2024-09-12T00:55:15.201+0000 7f904cd46800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:55:15.294 INFO:tasks.workunit.client.0.smithi073.stderr: -79> 2024-09-12T00:55:15.201+0000 7f904cd46800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:55:15.294 INFO:tasks.workunit.client.0.smithi073.stderr: -78> 2024-09-12T00:55:15.201+0000 7f904cd46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:15.294 INFO:tasks.workunit.client.0.smithi073.stderr: -77> 2024-09-12T00:55:15.201+0000 7f904cd46800 20 zonegroup default 2024-09-12T00:55:15.294 INFO:tasks.workunit.client.0.smithi073.stderr: -76> 2024-09-12T00:55:15.201+0000 7f904cd46800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.294 INFO:tasks.workunit.client.0.smithi073.stderr: -75> 2024-09-12T00:55:15.202+0000 7f904cd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:15.295 INFO:tasks.workunit.client.0.smithi073.stderr: -74> 2024-09-12T00:55:15.202+0000 7f904cd46800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.295 INFO:tasks.workunit.client.0.smithi073.stderr: -73> 2024-09-12T00:55:15.202+0000 7f904cd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:15.295 INFO:tasks.workunit.client.0.smithi073.stderr: -72> 2024-09-12T00:55:15.202+0000 7f904cd46800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.295 INFO:tasks.workunit.client.0.smithi073.stderr: -71> 2024-09-12T00:55:15.202+0000 7f904cd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:15.295 INFO:tasks.workunit.client.0.smithi073.stderr: -70> 2024-09-12T00:55:15.202+0000 7f904cd46800 20 started sync module instance, tier type = 2024-09-12T00:55:15.295 INFO:tasks.workunit.client.0.smithi073.stderr: -69> 2024-09-12T00:55:15.202+0000 7f904cd46800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:55:15.295 INFO:tasks.workunit.client.0.smithi073.stderr: -68> 2024-09-12T00:55:15.212+0000 7f904cd46800 20 add_watcher() i=0 2024-09-12T00:55:15.295 INFO:tasks.workunit.client.0.smithi073.stderr: -67> 2024-09-12T00:55:15.212+0000 7f904cd46800 20 add_watcher() i=1 2024-09-12T00:55:15.295 INFO:tasks.workunit.client.0.smithi073.stderr: -66> 2024-09-12T00:55:15.212+0000 7f904cd46800 20 add_watcher() i=2 2024-09-12T00:55:15.295 INFO:tasks.workunit.client.0.smithi073.stderr: -65> 2024-09-12T00:55:15.212+0000 7f904cd46800 20 add_watcher() i=3 2024-09-12T00:55:15.295 INFO:tasks.workunit.client.0.smithi073.stderr: -64> 2024-09-12T00:55:15.212+0000 7f904cd46800 20 add_watcher() i=4 2024-09-12T00:55:15.295 INFO:tasks.workunit.client.0.smithi073.stderr: -63> 2024-09-12T00:55:15.212+0000 7f904cd46800 20 add_watcher() i=5 2024-09-12T00:55:15.295 INFO:tasks.workunit.client.0.smithi073.stderr: -62> 2024-09-12T00:55:15.212+0000 7f904cd46800 20 add_watcher() i=6 2024-09-12T00:55:15.295 INFO:tasks.workunit.client.0.smithi073.stderr: -61> 2024-09-12T00:55:15.213+0000 7f904cd46800 20 add_watcher() i=7 2024-09-12T00:55:15.296 INFO:tasks.workunit.client.0.smithi073.stderr: -60> 2024-09-12T00:55:15.213+0000 7f904cd46800 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:15.296 INFO:tasks.workunit.client.0.smithi073.stderr: -59> 2024-09-12T00:55:15.214+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc12c0) adding auth protocol: cephx 2024-09-12T00:55:15.296 INFO:tasks.workunit.client.0.smithi073.stderr: -58> 2024-09-12T00:55:15.214+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc12c0) adding auth protocol: cephx 2024-09-12T00:55:15.296 INFO:tasks.workunit.client.0.smithi073.stderr: -57> 2024-09-12T00:55:15.214+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc12c0) adding auth protocol: cephx 2024-09-12T00:55:15.296 INFO:tasks.workunit.client.0.smithi073.stderr: -56> 2024-09-12T00:55:15.214+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc12c0) adding con mode: secure 2024-09-12T00:55:15.296 INFO:tasks.workunit.client.0.smithi073.stderr: -55> 2024-09-12T00:55:15.214+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc12c0) adding con mode: crc 2024-09-12T00:55:15.296 INFO:tasks.workunit.client.0.smithi073.stderr: -54> 2024-09-12T00:55:15.214+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc12c0) adding con mode: secure 2024-09-12T00:55:15.296 INFO:tasks.workunit.client.0.smithi073.stderr: -53> 2024-09-12T00:55:15.214+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc12c0) adding con mode: crc 2024-09-12T00:55:15.296 INFO:tasks.workunit.client.0.smithi073.stderr: -52> 2024-09-12T00:55:15.214+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc12c0) adding con mode: secure 2024-09-12T00:55:15.296 INFO:tasks.workunit.client.0.smithi073.stderr: -51> 2024-09-12T00:55:15.214+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc12c0) adding con mode: crc 2024-09-12T00:55:15.296 INFO:tasks.workunit.client.0.smithi073.stderr: -50> 2024-09-12T00:55:15.214+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc12c0) adding con mode: crc 2024-09-12T00:55:15.296 INFO:tasks.workunit.client.0.smithi073.stderr: -49> 2024-09-12T00:55:15.214+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc12c0) adding con mode: secure 2024-09-12T00:55:15.296 INFO:tasks.workunit.client.0.smithi073.stderr: -48> 2024-09-12T00:55:15.214+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc12c0) adding con mode: crc 2024-09-12T00:55:15.297 INFO:tasks.workunit.client.0.smithi073.stderr: -47> 2024-09-12T00:55:15.214+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc12c0) adding con mode: secure 2024-09-12T00:55:15.297 INFO:tasks.workunit.client.0.smithi073.stderr: -46> 2024-09-12T00:55:15.214+0000 7f8f017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:15.297 INFO:tasks.workunit.client.0.smithi073.stderr: -45> 2024-09-12T00:55:15.214+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc12c0) adding con mode: crc 2024-09-12T00:55:15.297 INFO:tasks.workunit.client.0.smithi073.stderr: -44> 2024-09-12T00:55:15.214+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc12c0) adding con mode: secure 2024-09-12T00:55:15.297 INFO:tasks.workunit.client.0.smithi073.stderr: -43> 2024-09-12T00:55:15.215+0000 7f904cd46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:15.297 INFO:tasks.workunit.client.0.smithi073.stderr: -42> 2024-09-12T00:55:15.215+0000 7f904cd46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:15.297 INFO:tasks.workunit.client.0.smithi073.stderr: -41> 2024-09-12T00:55:15.215+0000 7f904cd46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:15.297 INFO:tasks.workunit.client.0.smithi073.stderr: -40> 2024-09-12T00:55:15.215+0000 7f904cd46800 5 asok(0x5613b716e630) register_command cache list hook 0x5613b7455810 2024-09-12T00:55:15.297 INFO:tasks.workunit.client.0.smithi073.stderr: -39> 2024-09-12T00:55:15.215+0000 7f904cd46800 5 asok(0x5613b716e630) register_command cache inspect hook 0x5613b7455810 2024-09-12T00:55:15.297 INFO:tasks.workunit.client.0.smithi073.stderr: -38> 2024-09-12T00:55:15.215+0000 7f904cd46800 5 asok(0x5613b716e630) register_command cache erase hook 0x5613b7455810 2024-09-12T00:55:15.297 INFO:tasks.workunit.client.0.smithi073.stderr: -37> 2024-09-12T00:55:15.215+0000 7f904cd46800 5 asok(0x5613b716e630) register_command cache zap hook 0x5613b7455810 2024-09-12T00:55:15.297 INFO:tasks.workunit.client.0.smithi073.stderr: -36> 2024-09-12T00:55:15.215+0000 7f904cd46800 5 note: GC not initialized 2024-09-12T00:55:15.297 INFO:tasks.workunit.client.0.smithi073.stderr: -35> 2024-09-12T00:55:15.215+0000 7f8e7bfff640 20 reqs_thread_entry: start 2024-09-12T00:55:15.298 INFO:tasks.workunit.client.0.smithi073.stderr: -34> 2024-09-12T00:55:15.215+0000 7f904cd46800 5 asok(0x5613b716e630) register_command sync trace show hook 0x7f9034004620 2024-09-12T00:55:15.298 INFO:tasks.workunit.client.0.smithi073.stderr: -33> 2024-09-12T00:55:15.215+0000 7f904cd46800 5 asok(0x5613b716e630) register_command sync trace history hook 0x7f9034004620 2024-09-12T00:55:15.298 INFO:tasks.workunit.client.0.smithi073.stderr: -32> 2024-09-12T00:55:15.215+0000 7f904cd46800 5 asok(0x5613b716e630) register_command sync trace active hook 0x7f9034004620 2024-09-12T00:55:15.298 INFO:tasks.workunit.client.0.smithi073.stderr: -31> 2024-09-12T00:55:15.215+0000 7f904cd46800 5 asok(0x5613b716e630) register_command sync trace active_short hook 0x7f9034004620 2024-09-12T00:55:15.298 INFO:tasks.workunit.client.0.smithi073.stderr: -30> 2024-09-12T00:55:15.215+0000 7f904cd46800 20 init_complete bucket index max shards: 1 2024-09-12T00:55:15.298 INFO:tasks.workunit.client.0.smithi073.stderr: -29> 2024-09-12T00:55:15.215+0000 7f904cd46800 20 Filter name: none 2024-09-12T00:55:15.298 INFO:tasks.workunit.client.0.smithi073.stderr: -28> 2024-09-12T00:55:15.215+0000 7f8e79ffb640 20 reqs_thread_entry: start 2024-09-12T00:55:15.298 INFO:tasks.workunit.client.0.smithi073.stderr: -27> 2024-09-12T00:55:15.215+0000 7f904cd46800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:55:15.298 INFO:tasks.workunit.client.0.smithi073.stderr: -26> 2024-09-12T00:55:15.215+0000 7f904cd46800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.298 INFO:tasks.workunit.client.0.smithi073.stderr: -25> 2024-09-12T00:55:15.216+0000 7f904cd46800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:55:15.298 INFO:tasks.workunit.client.0.smithi073.stderr: -24> 2024-09-12T00:55:15.216+0000 7f904cd46800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:55:15.298 INFO:tasks.workunit.client.0.smithi073.stderr: -23> 2024-09-12T00:55:15.216+0000 7f904cd46800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:55:15.298 INFO:tasks.workunit.client.0.smithi073.stderr: -22> 2024-09-12T00:55:15.216+0000 7f904cd46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 : miss 2024-09-12T00:55:15.299 INFO:tasks.workunit.client.0.smithi073.stderr: -21> 2024-09-12T00:55:15.216+0000 7f904cd46800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.299 INFO:tasks.workunit.client.0.smithi073.stderr: -20> 2024-09-12T00:55:15.216+0000 7f904cd46800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:55:15.299 INFO:tasks.workunit.client.0.smithi073.stderr: -19> 2024-09-12T00:55:15.216+0000 7f904cd46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:55:15.299 INFO:tasks.workunit.client.0.smithi073.stderr: -18> 2024-09-12T00:55:15.216+0000 7f904cd46800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:55:15.299 INFO:tasks.workunit.client.0.smithi073.stderr: -17> 2024-09-12T00:55:15.216+0000 7f904cd46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:55:15.299 INFO:tasks.workunit.client.0.smithi073.stderr: -16> 2024-09-12T00:55:15.216+0000 7f904cd46800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:55:15.299 INFO:tasks.workunit.client.0.smithi073.stderr: -15> 2024-09-12T00:55:15.216+0000 7f904cd46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 2024-09-12T00:55:15.299 INFO:tasks.workunit.client.0.smithi073.stderr: -14> 2024-09-12T00:55:15.217+0000 7f904cd46800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:55:15.299 INFO:tasks.workunit.client.0.smithi073.stderr: -13> 2024-09-12T00:55:15.221+0000 7f904cd46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:55:15.299 INFO:tasks.workunit.client.0.smithi073.stderr: -12> 2024-09-12T00:55:15.221+0000 7f904cd46800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:55:15.299 INFO:tasks.workunit.client.0.smithi073.stderr: -11> 2024-09-12T00:55:15.221+0000 7f904cd46800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:55:15.299 INFO:tasks.workunit.client.0.smithi073.stderr: -10> 2024-09-12T00:55:15.221+0000 7f904cd46800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17, ofs0, ns] 2024-09-12T00:55:15.299 INFO:tasks.workunit.client.0.smithi073.stderr: -9> 2024-09-12T00:55:15.222+0000 7f8f2e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497048 cookie 94642679376048 notifier 8376 bl.length()=827 2024-09-12T00:55:15.299 INFO:tasks.workunit.client.0.smithi073.stderr: -8> 2024-09-12T00:55:15.222+0000 7f8f2e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:55:15.300 INFO:tasks.workunit.client.0.smithi073.stderr: -7> 2024-09-12T00:55:15.222+0000 7f8f2e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:55:15.300 INFO:tasks.workunit.client.0.smithi073.stderr: -6> 2024-09-12T00:55:15.222+0000 7f8f2e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:55:15.300 INFO:tasks.workunit.client.0.smithi073.stderr: -5> 2024-09-12T00:55:15.223+0000 7f904cd46800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): orig_sources= new_sources= 2024-09-12T00:55:15.300 INFO:tasks.workunit.client.0.smithi073.stderr: -4> 2024-09-12T00:55:15.223+0000 7f904cd46800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): potential sources added=[] removed=[] 2024-09-12T00:55:15.300 INFO:tasks.workunit.client.0.smithi073.stderr: -3> 2024-09-12T00:55:15.223+0000 7f904cd46800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): orig_dests= new_dests= 2024-09-12T00:55:15.300 INFO:tasks.workunit.client.0.smithi073.stderr: -2> 2024-09-12T00:55:15.223+0000 7f904cd46800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): potential dests added=[] removed=[] 2024-09-12T00:55:15.300 INFO:tasks.workunit.client.0.smithi073.stderr: -1> 2024-09-12T00:55:15.226+0000 7f904cd46800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f904cd46800 time 2024-09-12T00:55:15.226949+0000 2024-09-12T00:55:15.300 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:55:15.300 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:55:15.300 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:55:15.300 INFO:tasks.workunit.client.0.smithi073.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f905038c71a] 2024-09-12T00:55:15.300 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f905038c8d8] 2024-09-12T00:55:15.300 INFO:tasks.workunit.client.0.smithi073.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5613b5098641] 2024-09-12T00:55:15.301 INFO:tasks.workunit.client.0.smithi073.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5613b50a838a] 2024-09-12T00:55:15.301 INFO:tasks.workunit.client.0.smithi073.stderr: 5: main() 2024-09-12T00:55:15.301 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f904f029590] 2024-09-12T00:55:15.301 INFO:tasks.workunit.client.0.smithi073.stderr: 7: __libc_start_main() 2024-09-12T00:55:15.301 INFO:tasks.workunit.client.0.smithi073.stderr: 8: _start() 2024-09-12T00:55:15.301 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:55:15.301 INFO:tasks.workunit.client.0.smithi073.stderr: 0> 2024-09-12T00:55:15.227+0000 7f904cd46800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:55:15.301 INFO:tasks.workunit.client.0.smithi073.stderr: in thread 7f904cd46800 thread_name:radosgw-admin 2024-09-12T00:55:15.301 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:55:15.301 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:55:15.301 INFO:tasks.workunit.client.0.smithi073.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f904f03e6f0] 2024-09-12T00:55:15.301 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f904f08b99c] 2024-09-12T00:55:15.301 INFO:tasks.workunit.client.0.smithi073.stderr: 3: raise() 2024-09-12T00:55:15.302 INFO:tasks.workunit.client.0.smithi073.stderr: 4: abort() 2024-09-12T00:55:15.302 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f905038c774] 2024-09-12T00:55:15.302 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f905038c8d8] 2024-09-12T00:55:15.302 INFO:tasks.workunit.client.0.smithi073.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5613b5098641] 2024-09-12T00:55:15.302 INFO:tasks.workunit.client.0.smithi073.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5613b50a838a] 2024-09-12T00:55:15.302 INFO:tasks.workunit.client.0.smithi073.stderr: 9: main() 2024-09-12T00:55:15.302 INFO:tasks.workunit.client.0.smithi073.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f904f029590] 2024-09-12T00:55:15.302 INFO:tasks.workunit.client.0.smithi073.stderr: 11: __libc_start_main() 2024-09-12T00:55:15.302 INFO:tasks.workunit.client.0.smithi073.stderr: 12: _start() 2024-09-12T00:55:15.302 INFO:tasks.workunit.client.0.smithi073.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:55:15.302 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:55:15.302 INFO:tasks.workunit.client.0.smithi073.stderr:--- logging levels --- 2024-09-12T00:55:15.302 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 none 2024-09-12T00:55:15.303 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 lockdep 2024-09-12T00:55:15.303 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 context 2024-09-12T00:55:15.303 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 crush 2024-09-12T00:55:15.303 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds 2024-09-12T00:55:15.303 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_balancer 2024-09-12T00:55:15.303 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_locker 2024-09-12T00:55:15.303 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_log 2024-09-12T00:55:15.303 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_log_expire 2024-09-12T00:55:15.303 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_migrator 2024-09-12T00:55:15.303 INFO:tasks.workunit.client.0.smithi073.stderr: 3/ 5 mds_quiesce 2024-09-12T00:55:15.303 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 buffer 2024-09-12T00:55:15.303 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 timer 2024-09-12T00:55:15.303 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 filer 2024-09-12T00:55:15.303 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 striper 2024-09-12T00:55:15.304 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 objecter 2024-09-12T00:55:15.304 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rados 2024-09-12T00:55:15.304 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd 2024-09-12T00:55:15.304 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_mirror 2024-09-12T00:55:15.304 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_replay 2024-09-12T00:55:15.304 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_pwl 2024-09-12T00:55:15.304 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 journaler 2024-09-12T00:55:15.304 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 objectcacher 2024-09-12T00:55:15.304 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:55:15.304 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 client 2024-09-12T00:55:15.304 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 osd 2024-09-12T00:55:15.304 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 optracker 2024-09-12T00:55:15.304 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 objclass 2024-09-12T00:55:15.305 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 filestore 2024-09-12T00:55:15.305 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 journal 2024-09-12T00:55:15.305 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 0 ms 2024-09-12T00:55:15.305 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mon 2024-09-12T00:55:15.305 INFO:tasks.workunit.client.0.smithi073.stderr: 0/10 monc 2024-09-12T00:55:15.305 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 paxos 2024-09-12T00:55:15.305 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 tp 2024-09-12T00:55:15.305 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 auth 2024-09-12T00:55:15.305 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 crypto 2024-09-12T00:55:15.305 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 finisher 2024-09-12T00:55:15.305 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 reserver 2024-09-12T00:55:15.305 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 heartbeatmap 2024-09-12T00:55:15.305 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 perfcounter 2024-09-12T00:55:15.305 INFO:tasks.workunit.client.0.smithi073.stderr: 20/20 rgw 2024-09-12T00:55:15.306 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_sync 2024-09-12T00:55:15.306 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_datacache 2024-09-12T00:55:15.306 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_access 2024-09-12T00:55:15.306 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:55:15.306 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_flight 2024-09-12T00:55:15.306 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:55:15.306 INFO:tasks.workunit.client.0.smithi073.stderr: 20/20 rgw_notification 2024-09-12T00:55:15.306 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 javaclient 2024-09-12T00:55:15.306 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 asok 2024-09-12T00:55:15.306 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 throttle 2024-09-12T00:55:15.306 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 0 refs 2024-09-12T00:55:15.306 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 compressor 2024-09-12T00:55:15.306 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 bluestore 2024-09-12T00:55:15.306 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 bluefs 2024-09-12T00:55:15.307 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 bdev 2024-09-12T00:55:15.307 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 kstore 2024-09-12T00:55:15.307 INFO:tasks.workunit.client.0.smithi073.stderr: 4/ 5 rocksdb 2024-09-12T00:55:15.307 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 fuse 2024-09-12T00:55:15.307 INFO:tasks.workunit.client.0.smithi073.stderr: 2/ 5 mgr 2024-09-12T00:55:15.307 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mgrc 2024-09-12T00:55:15.307 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 dpdk 2024-09-12T00:55:15.307 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 eventtrace 2024-09-12T00:55:15.307 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 prioritycache 2024-09-12T00:55:15.307 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 test 2024-09-12T00:55:15.307 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:55:15.307 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cephsqlite 2024-09-12T00:55:15.307 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:55:15.308 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore 2024-09-12T00:55:15.308 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_onode 2024-09-12T00:55:15.308 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_odata 2024-09-12T00:55:15.308 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_omap 2024-09-12T00:55:15.308 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_tm 2024-09-12T00:55:15.308 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_t 2024-09-12T00:55:15.308 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:55:15.308 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_epm 2024-09-12T00:55:15.308 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_lba 2024-09-12T00:55:15.308 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:55:15.308 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_cache 2024-09-12T00:55:15.308 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_journal 2024-09-12T00:55:15.308 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_device 2024-09-12T00:55:15.308 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_backref 2024-09-12T00:55:15.309 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 alienstore 2024-09-12T00:55:15.309 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mclock 2024-09-12T00:55:15.309 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cyanstore 2024-09-12T00:55:15.309 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 ceph_exporter 2024-09-12T00:55:15.309 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 memstore 2024-09-12T00:55:15.309 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 trace 2024-09-12T00:55:15.309 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 ceph_dedup 2024-09-12T00:55:15.309 INFO:tasks.workunit.client.0.smithi073.stderr: -2/-2 (syslog threshold) 2024-09-12T00:55:15.309 INFO:tasks.workunit.client.0.smithi073.stderr: 99/99 (stderr threshold) 2024-09-12T00:55:15.309 INFO:tasks.workunit.client.0.smithi073.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:55:15.309 INFO:tasks.workunit.client.0.smithi073.stderr: 7f8e79ffb640 / http_manager 2024-09-12T00:55:15.309 INFO:tasks.workunit.client.0.smithi073.stderr: 7f8e7bfff640 / http_manager 2024-09-12T00:55:15.310 INFO:tasks.workunit.client.0.smithi073.stderr: 7f8f017e2640 / rgw_dt_lg_renew 2024-09-12T00:55:15.310 INFO:tasks.workunit.client.0.smithi073.stderr: 7f8f2cff9640 / ms_dispatch 2024-09-12T00:55:15.310 INFO:tasks.workunit.client.0.smithi073.stderr: 7f8f2e7fc640 / io_context_pool 2024-09-12T00:55:15.310 INFO:tasks.workunit.client.0.smithi073.stderr: 7f8f34e01640 / ms_dispatch 2024-09-12T00:55:15.310 INFO:tasks.workunit.client.0.smithi073.stderr: 7f8f37606640 / ms_dispatch 2024-09-12T00:55:15.310 INFO:tasks.workunit.client.0.smithi073.stderr: 7f8f38e09640 / io_context_pool 2024-09-12T00:55:15.310 INFO:tasks.workunit.client.0.smithi073.stderr: 7f904a036640 / msgr-worker-2 2024-09-12T00:55:15.310 INFO:tasks.workunit.client.0.smithi073.stderr: 7f904a837640 / msgr-worker-1 2024-09-12T00:55:15.310 INFO:tasks.workunit.client.0.smithi073.stderr: 7f904b038640 / msgr-worker-0 2024-09-12T00:55:15.310 INFO:tasks.workunit.client.0.smithi073.stderr: 7f904b839640 / io_context_pool 2024-09-12T00:55:15.310 INFO:tasks.workunit.client.0.smithi073.stderr: 7f904cd46800 / radosgw-admin 2024-09-12T00:55:15.310 INFO:tasks.workunit.client.0.smithi073.stderr: max_recent 500 2024-09-12T00:55:15.311 INFO:tasks.workunit.client.0.smithi073.stderr: max_new 1000 2024-09-12T00:55:15.311 INFO:tasks.workunit.client.0.smithi073.stderr: log_file /var/log/ceph/ceph-client.admin.154321.log 2024-09-12T00:55:15.311 INFO:tasks.workunit.client.0.smithi073.stderr:--- end dump of recent events --- 2024-09-12T00:55:15.311 INFO:tasks.workunit.client.0.smithi073.stderr:--- begin dump of recent events --- 2024-09-12T00:55:15.311 INFO:tasks.workunit.client.0.smithi073.stderr: -499> 2024-09-12T00:55:14.966+0000 7f8f38e09640 10 monclient: _finish_auth 0 2024-09-12T00:55:15.311 INFO:tasks.workunit.client.0.smithi073.stderr: -498> 2024-09-12T00:55:14.966+0000 7f8f38e09640 10 monclient: _check_auth_tickets 2024-09-12T00:55:15.311 INFO:tasks.workunit.client.0.smithi073.stderr: -497> 2024-09-12T00:55:14.966+0000 7f8f38e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:55:15.311 INFO:tasks.workunit.client.0.smithi073.stderr: -496> 2024-09-12T00:55:14.966+0000 7f8f38e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:15.311 INFO:tasks.workunit.client.0.smithi073.stderr: -495> 2024-09-12T00:55:14.966+0000 7f8f38e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:55:15.311 INFO:tasks.workunit.client.0.smithi073.stderr: -494> 2024-09-12T00:55:14.966+0000 7f8f38e09640 10 monclient: dump: 2024-09-12T00:55:15.311 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:55:15.311 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:55:15.311 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:55:15.311 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:55:15.312 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:15.312 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:55:15.312 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:55:15.312 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:55:15.312 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:55:15.312 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:55:15.312 INFO:tasks.workunit.client.0.smithi073.stderr: -493> 2024-09-12T00:55:14.966+0000 7f904cd46800 5 monclient: authenticate success, global_id 8364 2024-09-12T00:55:15.312 INFO:tasks.workunit.client.0.smithi073.stderr: -492> 2024-09-12T00:55:14.966+0000 7f904cd46800 10 monclient: get_monmap_and_config success 2024-09-12T00:55:15.312 INFO:tasks.workunit.client.0.smithi073.stderr: -491> 2024-09-12T00:55:14.966+0000 7f904cd46800 4 set_mon_vals no callback set 2024-09-12T00:55:15.312 INFO:tasks.workunit.client.0.smithi073.stderr: -490> 2024-09-12T00:55:14.966+0000 7f904cd46800 10 monclient: shutdown 2024-09-12T00:55:15.312 INFO:tasks.workunit.client.0.smithi073.stderr: -489> 2024-09-12T00:55:14.966+0000 7f904cd46800 5 asok(0x5613b716e630) unregister_commands rotate-key 2024-09-12T00:55:15.312 INFO:tasks.workunit.client.0.smithi073.stderr: -488> 2024-09-12T00:55:14.966+0000 7f904cd46800 10 monclient: build_initial_monmap 2024-09-12T00:55:15.312 INFO:tasks.workunit.client.0.smithi073.stderr: -487> 2024-09-12T00:55:14.966+0000 7f904cd46800 1 build_initial for_mkfs: 0 2024-09-12T00:55:15.313 INFO:tasks.workunit.client.0.smithi073.stderr: -486> 2024-09-12T00:55:14.966+0000 7f904cd46800 10 monclient: monmap: 2024-09-12T00:55:15.313 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:55:15.313 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:55:15.313 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:55:15.313 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:55:15.313 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:55:15.313 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:55:15.313 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:55:15.313 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:55:15.313 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:55:15.313 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:55:15.313 INFO:tasks.workunit.client.0.smithi073.stderr: -485> 2024-09-12T00:55:14.966+0000 7f904cd46800 5 AuthRegistry(0x5613b73933b0) adding auth protocol: cephx 2024-09-12T00:55:15.313 INFO:tasks.workunit.client.0.smithi073.stderr: -484> 2024-09-12T00:55:14.966+0000 7f904cd46800 5 AuthRegistry(0x5613b73933b0) adding auth protocol: cephx 2024-09-12T00:55:15.313 INFO:tasks.workunit.client.0.smithi073.stderr: -483> 2024-09-12T00:55:14.966+0000 7f904cd46800 5 AuthRegistry(0x5613b73933b0) adding auth protocol: cephx 2024-09-12T00:55:15.314 INFO:tasks.workunit.client.0.smithi073.stderr: -482> 2024-09-12T00:55:14.966+0000 7f904cd46800 5 AuthRegistry(0x5613b73933b0) adding con mode: secure 2024-09-12T00:55:15.314 INFO:tasks.workunit.client.0.smithi073.stderr: -481> 2024-09-12T00:55:14.966+0000 7f904cd46800 5 AuthRegistry(0x5613b73933b0) adding con mode: crc 2024-09-12T00:55:15.314 INFO:tasks.workunit.client.0.smithi073.stderr: -480> 2024-09-12T00:55:14.966+0000 7f904cd46800 5 AuthRegistry(0x5613b73933b0) adding con mode: secure 2024-09-12T00:55:15.314 INFO:tasks.workunit.client.0.smithi073.stderr: -479> 2024-09-12T00:55:14.966+0000 7f904cd46800 5 AuthRegistry(0x5613b73933b0) adding con mode: crc 2024-09-12T00:55:15.314 INFO:tasks.workunit.client.0.smithi073.stderr: -478> 2024-09-12T00:55:14.966+0000 7f904cd46800 5 AuthRegistry(0x5613b73933b0) adding con mode: secure 2024-09-12T00:55:15.314 INFO:tasks.workunit.client.0.smithi073.stderr: -477> 2024-09-12T00:55:14.966+0000 7f904cd46800 5 AuthRegistry(0x5613b73933b0) adding con mode: crc 2024-09-12T00:55:15.314 INFO:tasks.workunit.client.0.smithi073.stderr: -476> 2024-09-12T00:55:14.966+0000 7f904cd46800 5 AuthRegistry(0x5613b73933b0) adding con mode: crc 2024-09-12T00:55:15.314 INFO:tasks.workunit.client.0.smithi073.stderr: -475> 2024-09-12T00:55:14.966+0000 7f904cd46800 5 AuthRegistry(0x5613b73933b0) adding con mode: secure 2024-09-12T00:55:15.314 INFO:tasks.workunit.client.0.smithi073.stderr: -474> 2024-09-12T00:55:14.966+0000 7f904cd46800 5 AuthRegistry(0x5613b73933b0) adding con mode: crc 2024-09-12T00:55:15.314 INFO:tasks.workunit.client.0.smithi073.stderr: -473> 2024-09-12T00:55:14.966+0000 7f904cd46800 5 AuthRegistry(0x5613b73933b0) adding con mode: secure 2024-09-12T00:55:15.314 INFO:tasks.workunit.client.0.smithi073.stderr: -472> 2024-09-12T00:55:14.966+0000 7f904cd46800 5 AuthRegistry(0x5613b73933b0) adding con mode: crc 2024-09-12T00:55:15.314 INFO:tasks.workunit.client.0.smithi073.stderr: -471> 2024-09-12T00:55:14.966+0000 7f904cd46800 5 AuthRegistry(0x5613b73933b0) adding con mode: secure 2024-09-12T00:55:15.314 INFO:tasks.workunit.client.0.smithi073.stderr: -470> 2024-09-12T00:55:14.967+0000 7f904cd46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:15.314 INFO:tasks.workunit.client.0.smithi073.stderr: -469> 2024-09-12T00:55:14.967+0000 7f904cd46800 1 librados: starting msgr at 2024-09-12T00:55:15.315 INFO:tasks.workunit.client.0.smithi073.stderr: -468> 2024-09-12T00:55:14.967+0000 7f904cd46800 1 librados: starting objecter 2024-09-12T00:55:15.315 INFO:tasks.workunit.client.0.smithi073.stderr: -467> 2024-09-12T00:55:14.967+0000 7f904cd46800 5 asok(0x5613b716e630) register_command objecter_requests hook 0x5613b7391340 2024-09-12T00:55:15.315 INFO:tasks.workunit.client.0.smithi073.stderr: -466> 2024-09-12T00:55:14.967+0000 7f904cd46800 1 librados: setting wanted keys 2024-09-12T00:55:15.315 INFO:tasks.workunit.client.0.smithi073.stderr: -465> 2024-09-12T00:55:14.967+0000 7f904cd46800 1 librados: calling monclient init 2024-09-12T00:55:15.315 INFO:tasks.workunit.client.0.smithi073.stderr: -464> 2024-09-12T00:55:14.967+0000 7f904cd46800 10 monclient: init 2024-09-12T00:55:15.315 INFO:tasks.workunit.client.0.smithi073.stderr: -463> 2024-09-12T00:55:14.967+0000 7f904cd46800 5 AuthRegistry(0x5613b738d800) adding auth protocol: cephx 2024-09-12T00:55:15.315 INFO:tasks.workunit.client.0.smithi073.stderr: -462> 2024-09-12T00:55:14.967+0000 7f904cd46800 5 AuthRegistry(0x5613b738d800) adding auth protocol: cephx 2024-09-12T00:55:15.315 INFO:tasks.workunit.client.0.smithi073.stderr: -461> 2024-09-12T00:55:14.967+0000 7f904cd46800 5 AuthRegistry(0x5613b738d800) adding auth protocol: cephx 2024-09-12T00:55:15.315 INFO:tasks.workunit.client.0.smithi073.stderr: -460> 2024-09-12T00:55:14.967+0000 7f904cd46800 5 AuthRegistry(0x5613b738d800) adding con mode: secure 2024-09-12T00:55:15.315 INFO:tasks.workunit.client.0.smithi073.stderr: -459> 2024-09-12T00:55:14.967+0000 7f904cd46800 5 AuthRegistry(0x5613b738d800) adding con mode: crc 2024-09-12T00:55:15.315 INFO:tasks.workunit.client.0.smithi073.stderr: -458> 2024-09-12T00:55:14.967+0000 7f904cd46800 5 AuthRegistry(0x5613b738d800) adding con mode: secure 2024-09-12T00:55:15.315 INFO:tasks.workunit.client.0.smithi073.stderr: -457> 2024-09-12T00:55:14.967+0000 7f904cd46800 5 AuthRegistry(0x5613b738d800) adding con mode: crc 2024-09-12T00:55:15.315 INFO:tasks.workunit.client.0.smithi073.stderr: -456> 2024-09-12T00:55:14.967+0000 7f904cd46800 5 AuthRegistry(0x5613b738d800) adding con mode: secure 2024-09-12T00:55:15.316 INFO:tasks.workunit.client.0.smithi073.stderr: -455> 2024-09-12T00:55:14.967+0000 7f904cd46800 5 AuthRegistry(0x5613b738d800) adding con mode: crc 2024-09-12T00:55:15.316 INFO:tasks.workunit.client.0.smithi073.stderr: -454> 2024-09-12T00:55:14.967+0000 7f904cd46800 5 AuthRegistry(0x5613b738d800) adding con mode: crc 2024-09-12T00:55:15.316 INFO:tasks.workunit.client.0.smithi073.stderr: -453> 2024-09-12T00:55:14.967+0000 7f904cd46800 5 AuthRegistry(0x5613b738d800) adding con mode: secure 2024-09-12T00:55:15.316 INFO:tasks.workunit.client.0.smithi073.stderr: -452> 2024-09-12T00:55:14.967+0000 7f904cd46800 5 AuthRegistry(0x5613b738d800) adding con mode: crc 2024-09-12T00:55:15.316 INFO:tasks.workunit.client.0.smithi073.stderr: -451> 2024-09-12T00:55:14.967+0000 7f904cd46800 5 AuthRegistry(0x5613b738d800) adding con mode: secure 2024-09-12T00:55:15.316 INFO:tasks.workunit.client.0.smithi073.stderr: -450> 2024-09-12T00:55:14.967+0000 7f904cd46800 5 AuthRegistry(0x5613b738d800) adding con mode: crc 2024-09-12T00:55:15.316 INFO:tasks.workunit.client.0.smithi073.stderr: -449> 2024-09-12T00:55:14.967+0000 7f904cd46800 5 AuthRegistry(0x5613b738d800) adding con mode: secure 2024-09-12T00:55:15.316 INFO:tasks.workunit.client.0.smithi073.stderr: -448> 2024-09-12T00:55:14.967+0000 7f904cd46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:15.316 INFO:tasks.workunit.client.0.smithi073.stderr: -447> 2024-09-12T00:55:14.967+0000 7f904cd46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:15.316 INFO:tasks.workunit.client.0.smithi073.stderr: -446> 2024-09-12T00:55:14.967+0000 7f904cd46800 5 asok(0x5613b716e630) register_command rotate-key hook 0x5613b738d948 2024-09-12T00:55:15.316 INFO:tasks.workunit.client.0.smithi073.stderr: -445> 2024-09-12T00:55:14.967+0000 7f904cd46800 10 monclient: _reopen_session rank -1 2024-09-12T00:55:15.316 INFO:tasks.workunit.client.0.smithi073.stderr: -444> 2024-09-12T00:55:14.967+0000 7f904cd46800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:55:15.316 INFO:tasks.workunit.client.0.smithi073.stderr: -443> 2024-09-12T00:55:14.967+0000 7f904cd46800 10 monclient(hunting): picked mon.noname-b con 0x5613b7246b00 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:55:15.317 INFO:tasks.workunit.client.0.smithi073.stderr: -442> 2024-09-12T00:55:14.967+0000 7f904cd46800 10 monclient(hunting): picked mon.noname-c con 0x5613b72d7130 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:55:15.317 INFO:tasks.workunit.client.0.smithi073.stderr: -441> 2024-09-12T00:55:14.967+0000 7f904cd46800 10 monclient(hunting): picked mon.noname-a con 0x5613b7390d30 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:55:15.317 INFO:tasks.workunit.client.0.smithi073.stderr: -440> 2024-09-12T00:55:14.967+0000 7f904cd46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:15.317 INFO:tasks.workunit.client.0.smithi073.stderr: -439> 2024-09-12T00:55:14.967+0000 7f904cd46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:15.317 INFO:tasks.workunit.client.0.smithi073.stderr: -438> 2024-09-12T00:55:14.967+0000 7f904cd46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:15.317 INFO:tasks.workunit.client.0.smithi073.stderr: -437> 2024-09-12T00:55:14.967+0000 7f904cd46800 10 monclient(hunting): _renew_subs 2024-09-12T00:55:15.317 INFO:tasks.workunit.client.0.smithi073.stderr: -436> 2024-09-12T00:55:14.967+0000 7f904cd46800 10 monclient(hunting): authenticate will time out at 2375.637903s 2024-09-12T00:55:15.317 INFO:tasks.workunit.client.0.smithi073.stderr: -435> 2024-09-12T00:55:14.968+0000 7f904a036640 10 monclient(hunting): get_auth_request con 0x5613b72d7130 auth_method 0 2024-09-12T00:55:15.317 INFO:tasks.workunit.client.0.smithi073.stderr: -434> 2024-09-12T00:55:14.968+0000 7f904a036640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:15.317 INFO:tasks.workunit.client.0.smithi073.stderr: -433> 2024-09-12T00:55:14.968+0000 7f904a036640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:15.317 INFO:tasks.workunit.client.0.smithi073.stderr: -432> 2024-09-12T00:55:14.968+0000 7f904a036640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:15.317 INFO:tasks.workunit.client.0.smithi073.stderr: -431> 2024-09-12T00:55:14.968+0000 7f904b038640 10 monclient(hunting): get_auth_request con 0x5613b7390d30 auth_method 0 2024-09-12T00:55:15.317 INFO:tasks.workunit.client.0.smithi073.stderr: -430> 2024-09-12T00:55:14.968+0000 7f904b038640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:15.318 INFO:tasks.workunit.client.0.smithi073.stderr: -429> 2024-09-12T00:55:14.968+0000 7f904b038640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:15.318 INFO:tasks.workunit.client.0.smithi073.stderr: -428> 2024-09-12T00:55:14.968+0000 7f904b038640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:15.318 INFO:tasks.workunit.client.0.smithi073.stderr: -427> 2024-09-12T00:55:14.968+0000 7f904a837640 10 monclient(hunting): get_auth_request con 0x5613b7246b00 auth_method 0 2024-09-12T00:55:15.318 INFO:tasks.workunit.client.0.smithi073.stderr: -426> 2024-09-12T00:55:14.968+0000 7f904a837640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:15.318 INFO:tasks.workunit.client.0.smithi073.stderr: -425> 2024-09-12T00:55:14.968+0000 7f904a837640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:15.318 INFO:tasks.workunit.client.0.smithi073.stderr: -424> 2024-09-12T00:55:14.968+0000 7f904a837640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:15.318 INFO:tasks.workunit.client.0.smithi073.stderr: -423> 2024-09-12T00:55:14.968+0000 7f904a036640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:15.318 INFO:tasks.workunit.client.0.smithi073.stderr: -422> 2024-09-12T00:55:14.968+0000 7f904a036640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:15.318 INFO:tasks.workunit.client.0.smithi073.stderr: -421> 2024-09-12T00:55:14.968+0000 7f904a036640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:15.318 INFO:tasks.workunit.client.0.smithi073.stderr: -420> 2024-09-12T00:55:14.968+0000 7f904b038640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:15.318 INFO:tasks.workunit.client.0.smithi073.stderr: -419> 2024-09-12T00:55:14.968+0000 7f904b038640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:15.318 INFO:tasks.workunit.client.0.smithi073.stderr: -418> 2024-09-12T00:55:14.968+0000 7f904b038640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:15.318 INFO:tasks.workunit.client.0.smithi073.stderr: -417> 2024-09-12T00:55:14.968+0000 7f904a837640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:15.319 INFO:tasks.workunit.client.0.smithi073.stderr: -416> 2024-09-12T00:55:14.968+0000 7f904a837640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:15.319 INFO:tasks.workunit.client.0.smithi073.stderr: -415> 2024-09-12T00:55:14.968+0000 7f904a837640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:15.319 INFO:tasks.workunit.client.0.smithi073.stderr: -414> 2024-09-12T00:55:14.968+0000 7f904b038640 10 monclient(hunting): handle_auth_done global_id 8367 payload 824 2024-09-12T00:55:15.319 INFO:tasks.workunit.client.0.smithi073.stderr: -413> 2024-09-12T00:55:14.968+0000 7f904b038640 10 monclient: _finish_hunting 0 2024-09-12T00:55:15.319 INFO:tasks.workunit.client.0.smithi073.stderr: -412> 2024-09-12T00:55:14.968+0000 7f904b038640 1 monclient: found mon.noname-a 2024-09-12T00:55:15.319 INFO:tasks.workunit.client.0.smithi073.stderr: -411> 2024-09-12T00:55:14.968+0000 7f904b038640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:55:15.319 INFO:tasks.workunit.client.0.smithi073.stderr: -410> 2024-09-12T00:55:14.968+0000 7f8f37606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:15.319 INFO:tasks.workunit.client.0.smithi073.stderr: -409> 2024-09-12T00:55:14.968+0000 7f8f37606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:55:15.319 INFO:tasks.workunit.client.0.smithi073.stderr: -408> 2024-09-12T00:55:14.968+0000 7f8f37606640 10 monclient: dump: 2024-09-12T00:55:15.319 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:55:15.319 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:55:15.319 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:55:15.319 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:55:15.320 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:15.320 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:55:15.320 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:55:15.320 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:55:15.320 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:55:15.320 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:55:15.320 INFO:tasks.workunit.client.0.smithi073.stderr: -407> 2024-09-12T00:55:14.968+0000 7f8f37606640 10 monclient: _finish_auth 0 2024-09-12T00:55:15.320 INFO:tasks.workunit.client.0.smithi073.stderr: -406> 2024-09-12T00:55:14.968+0000 7f8f37606640 10 monclient: _check_auth_tickets 2024-09-12T00:55:15.320 INFO:tasks.workunit.client.0.smithi073.stderr: -405> 2024-09-12T00:55:14.968+0000 7f904cd46800 5 monclient: authenticate success, global_id 8367 2024-09-12T00:55:15.320 INFO:tasks.workunit.client.0.smithi073.stderr: -404> 2024-09-12T00:55:14.968+0000 7f904cd46800 10 monclient: _renew_subs 2024-09-12T00:55:15.320 INFO:tasks.workunit.client.0.smithi073.stderr: -403> 2024-09-12T00:55:14.968+0000 7f904cd46800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:55:15.320 INFO:tasks.workunit.client.0.smithi073.stderr: -402> 2024-09-12T00:55:14.968+0000 7f8f37606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:55:15.320 INFO:tasks.workunit.client.0.smithi073.stderr: -401> 2024-09-12T00:55:14.968+0000 7f8f37606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:15.321 INFO:tasks.workunit.client.0.smithi073.stderr: -400> 2024-09-12T00:55:14.968+0000 7f8f37606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:55:15.321 INFO:tasks.workunit.client.0.smithi073.stderr: -399> 2024-09-12T00:55:14.968+0000 7f8f37606640 10 monclient: dump: 2024-09-12T00:55:15.321 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:55:15.321 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:55:15.321 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:55:15.321 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:55:15.321 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:15.321 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:55:15.321 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:55:15.321 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:55:15.321 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:55:15.321 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:55:15.321 INFO:tasks.workunit.client.0.smithi073.stderr: -398> 2024-09-12T00:55:14.968+0000 7f8f38e09640 4 set_mon_vals no callback set 2024-09-12T00:55:15.321 INFO:tasks.workunit.client.0.smithi073.stderr: -397> 2024-09-12T00:55:14.968+0000 7f904cd46800 10 monclient: _renew_subs 2024-09-12T00:55:15.322 INFO:tasks.workunit.client.0.smithi073.stderr: -396> 2024-09-12T00:55:14.968+0000 7f904cd46800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:55:15.322 INFO:tasks.workunit.client.0.smithi073.stderr: -395> 2024-09-12T00:55:14.968+0000 7f904cd46800 1 librados: init done 2024-09-12T00:55:15.322 INFO:tasks.workunit.client.0.smithi073.stderr: -394> 2024-09-12T00:55:14.970+0000 7f8f37606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:55:15.322 INFO:tasks.workunit.client.0.smithi073.stderr: -393> 2024-09-12T00:55:14.970+0000 7f8f37606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:55:15.322 INFO:tasks.workunit.client.0.smithi073.stderr: -392> 2024-09-12T00:55:14.970+0000 7f8f37606640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:55:15.322 INFO:tasks.workunit.client.0.smithi073.stderr: -391> 2024-09-12T00:55:14.970+0000 7f904a837640 10 monclient: get_auth_request con 0x7f8f30076470 auth_method 0 2024-09-12T00:55:15.322 INFO:tasks.workunit.client.0.smithi073.stderr: -390> 2024-09-12T00:55:14.970+0000 7f904a036640 10 monclient: get_auth_request con 0x5613b73cfab0 auth_method 0 2024-09-12T00:55:15.322 INFO:tasks.workunit.client.0.smithi073.stderr: -389> 2024-09-12T00:55:14.971+0000 7f904a837640 10 monclient: get_auth_request con 0x5613b73d9470 auth_method 0 2024-09-12T00:55:15.322 INFO:tasks.workunit.client.0.smithi073.stderr: -388> 2024-09-12T00:55:14.972+0000 7f904a036640 10 monclient: get_auth_request con 0x5613b73dd660 auth_method 0 2024-09-12T00:55:15.322 INFO:tasks.workunit.client.0.smithi073.stderr: -387> 2024-09-12T00:55:14.974+0000 7f904cd46800 10 monclient: build_initial_monmap 2024-09-12T00:55:15.322 INFO:tasks.workunit.client.0.smithi073.stderr: -386> 2024-09-12T00:55:14.974+0000 7f904cd46800 1 build_initial for_mkfs: 0 2024-09-12T00:55:15.322 INFO:tasks.workunit.client.0.smithi073.stderr: -385> 2024-09-12T00:55:14.974+0000 7f904cd46800 10 monclient: monmap: 2024-09-12T00:55:15.322 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:55:15.323 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:55:15.323 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:55:15.323 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:55:15.323 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:55:15.323 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:55:15.323 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:55:15.323 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:55:15.323 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:55:15.323 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:55:15.323 INFO:tasks.workunit.client.0.smithi073.stderr: -384> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e24d0) adding auth protocol: cephx 2024-09-12T00:55:15.323 INFO:tasks.workunit.client.0.smithi073.stderr: -383> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e24d0) adding auth protocol: cephx 2024-09-12T00:55:15.323 INFO:tasks.workunit.client.0.smithi073.stderr: -382> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e24d0) adding auth protocol: cephx 2024-09-12T00:55:15.323 INFO:tasks.workunit.client.0.smithi073.stderr: -381> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e24d0) adding con mode: secure 2024-09-12T00:55:15.324 INFO:tasks.workunit.client.0.smithi073.stderr: -380> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e24d0) adding con mode: crc 2024-09-12T00:55:15.324 INFO:tasks.workunit.client.0.smithi073.stderr: -379> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e24d0) adding con mode: secure 2024-09-12T00:55:15.324 INFO:tasks.workunit.client.0.smithi073.stderr: -378> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e24d0) adding con mode: crc 2024-09-12T00:55:15.324 INFO:tasks.workunit.client.0.smithi073.stderr: -377> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e24d0) adding con mode: secure 2024-09-12T00:55:15.324 INFO:tasks.workunit.client.0.smithi073.stderr: -376> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e24d0) adding con mode: crc 2024-09-12T00:55:15.324 INFO:tasks.workunit.client.0.smithi073.stderr: -375> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e24d0) adding con mode: crc 2024-09-12T00:55:15.324 INFO:tasks.workunit.client.0.smithi073.stderr: -374> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e24d0) adding con mode: secure 2024-09-12T00:55:15.324 INFO:tasks.workunit.client.0.smithi073.stderr: -373> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e24d0) adding con mode: crc 2024-09-12T00:55:15.324 INFO:tasks.workunit.client.0.smithi073.stderr: -372> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e24d0) adding con mode: secure 2024-09-12T00:55:15.324 INFO:tasks.workunit.client.0.smithi073.stderr: -371> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e24d0) adding con mode: crc 2024-09-12T00:55:15.324 INFO:tasks.workunit.client.0.smithi073.stderr: -370> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e24d0) adding con mode: secure 2024-09-12T00:55:15.325 INFO:tasks.workunit.client.0.smithi073.stderr: -369> 2024-09-12T00:55:14.974+0000 7f904cd46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:15.325 INFO:tasks.workunit.client.0.smithi073.stderr: -368> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 asok(0x5613b716e630) register_command objecter_requests cmddesc objecter_requests hook 0x5613b73e5ea0 EEXIST 2024-09-12T00:55:15.325 INFO:tasks.workunit.client.0.smithi073.stderr: -367> 2024-09-12T00:55:14.974+0000 7f904cd46800 10 monclient: init 2024-09-12T00:55:15.325 INFO:tasks.workunit.client.0.smithi073.stderr: -366> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e0ba8) adding auth protocol: cephx 2024-09-12T00:55:15.325 INFO:tasks.workunit.client.0.smithi073.stderr: -365> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e0ba8) adding auth protocol: cephx 2024-09-12T00:55:15.325 INFO:tasks.workunit.client.0.smithi073.stderr: -364> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e0ba8) adding auth protocol: cephx 2024-09-12T00:55:15.325 INFO:tasks.workunit.client.0.smithi073.stderr: -363> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e0ba8) adding con mode: secure 2024-09-12T00:55:15.325 INFO:tasks.workunit.client.0.smithi073.stderr: -362> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e0ba8) adding con mode: crc 2024-09-12T00:55:15.325 INFO:tasks.workunit.client.0.smithi073.stderr: -361> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e0ba8) adding con mode: secure 2024-09-12T00:55:15.325 INFO:tasks.workunit.client.0.smithi073.stderr: -360> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e0ba8) adding con mode: crc 2024-09-12T00:55:15.325 INFO:tasks.workunit.client.0.smithi073.stderr: -359> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e0ba8) adding con mode: secure 2024-09-12T00:55:15.325 INFO:tasks.workunit.client.0.smithi073.stderr: -358> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e0ba8) adding con mode: crc 2024-09-12T00:55:15.326 INFO:tasks.workunit.client.0.smithi073.stderr: -357> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e0ba8) adding con mode: crc 2024-09-12T00:55:15.326 INFO:tasks.workunit.client.0.smithi073.stderr: -356> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e0ba8) adding con mode: secure 2024-09-12T00:55:15.326 INFO:tasks.workunit.client.0.smithi073.stderr: -355> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e0ba8) adding con mode: crc 2024-09-12T00:55:15.326 INFO:tasks.workunit.client.0.smithi073.stderr: -354> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e0ba8) adding con mode: secure 2024-09-12T00:55:15.326 INFO:tasks.workunit.client.0.smithi073.stderr: -353> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e0ba8) adding con mode: crc 2024-09-12T00:55:15.326 INFO:tasks.workunit.client.0.smithi073.stderr: -352> 2024-09-12T00:55:14.974+0000 7f904cd46800 5 AuthRegistry(0x5613b73e0ba8) adding con mode: secure 2024-09-12T00:55:15.326 INFO:tasks.workunit.client.0.smithi073.stderr: -351> 2024-09-12T00:55:14.974+0000 7f904cd46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:15.326 INFO:tasks.workunit.client.0.smithi073.stderr: -350> 2024-09-12T00:55:14.975+0000 7f904cd46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:15.326 INFO:tasks.workunit.client.0.smithi073.stderr: -349> 2024-09-12T00:55:14.975+0000 7f904cd46800 5 asok(0x5613b716e630) register_command rotate-key cmddesc rotate-key hook 0x5613b73e0cf0 EEXIST 2024-09-12T00:55:15.326 INFO:tasks.workunit.client.0.smithi073.stderr: -348> 2024-09-12T00:55:14.975+0000 7f904cd46800 10 monclient: _reopen_session rank -1 2024-09-12T00:55:15.326 INFO:tasks.workunit.client.0.smithi073.stderr: -347> 2024-09-12T00:55:14.975+0000 7f904cd46800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:55:15.326 INFO:tasks.workunit.client.0.smithi073.stderr: -346> 2024-09-12T00:55:14.975+0000 7f904cd46800 10 monclient(hunting): picked mon.noname-c con 0x5613b740fae0 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:55:15.327 INFO:tasks.workunit.client.0.smithi073.stderr: -345> 2024-09-12T00:55:14.975+0000 7f904cd46800 10 monclient(hunting): picked mon.noname-a con 0x5613b74084d0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:55:15.327 INFO:tasks.workunit.client.0.smithi073.stderr: -344> 2024-09-12T00:55:14.975+0000 7f904cd46800 10 monclient(hunting): picked mon.noname-b con 0x5613b740afe0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:55:15.327 INFO:tasks.workunit.client.0.smithi073.stderr: -343> 2024-09-12T00:55:14.975+0000 7f904cd46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:15.327 INFO:tasks.workunit.client.0.smithi073.stderr: -342> 2024-09-12T00:55:14.975+0000 7f904cd46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:15.327 INFO:tasks.workunit.client.0.smithi073.stderr: -341> 2024-09-12T00:55:14.975+0000 7f904cd46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:15.327 INFO:tasks.workunit.client.0.smithi073.stderr: -340> 2024-09-12T00:55:14.975+0000 7f904cd46800 10 monclient(hunting): _renew_subs 2024-09-12T00:55:15.327 INFO:tasks.workunit.client.0.smithi073.stderr: -339> 2024-09-12T00:55:14.975+0000 7f904cd46800 10 monclient(hunting): authenticate will time out at 2375.645283s 2024-09-12T00:55:15.327 INFO:tasks.workunit.client.0.smithi073.stderr: -338> 2024-09-12T00:55:14.975+0000 7f904a036640 10 monclient(hunting): get_auth_request con 0x5613b74084d0 auth_method 0 2024-09-12T00:55:15.327 INFO:tasks.workunit.client.0.smithi073.stderr: -337> 2024-09-12T00:55:14.975+0000 7f904a036640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:15.327 INFO:tasks.workunit.client.0.smithi073.stderr: -336> 2024-09-12T00:55:14.975+0000 7f904a036640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:15.327 INFO:tasks.workunit.client.0.smithi073.stderr: -335> 2024-09-12T00:55:14.975+0000 7f904a036640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:15.327 INFO:tasks.workunit.client.0.smithi073.stderr: -334> 2024-09-12T00:55:14.975+0000 7f904a837640 10 monclient(hunting): get_auth_request con 0x5613b740fae0 auth_method 0 2024-09-12T00:55:15.327 INFO:tasks.workunit.client.0.smithi073.stderr: -333> 2024-09-12T00:55:14.975+0000 7f904a837640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:15.328 INFO:tasks.workunit.client.0.smithi073.stderr: -332> 2024-09-12T00:55:14.975+0000 7f904a837640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:15.328 INFO:tasks.workunit.client.0.smithi073.stderr: -331> 2024-09-12T00:55:14.975+0000 7f904a837640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:15.328 INFO:tasks.workunit.client.0.smithi073.stderr: -330> 2024-09-12T00:55:14.975+0000 7f904a036640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:15.328 INFO:tasks.workunit.client.0.smithi073.stderr: -329> 2024-09-12T00:55:14.975+0000 7f904a036640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:15.328 INFO:tasks.workunit.client.0.smithi073.stderr: -328> 2024-09-12T00:55:14.975+0000 7f904a036640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:15.328 INFO:tasks.workunit.client.0.smithi073.stderr: -327> 2024-09-12T00:55:14.975+0000 7f904b038640 10 monclient(hunting): get_auth_request con 0x5613b740afe0 auth_method 0 2024-09-12T00:55:15.328 INFO:tasks.workunit.client.0.smithi073.stderr: -326> 2024-09-12T00:55:14.975+0000 7f904b038640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:15.328 INFO:tasks.workunit.client.0.smithi073.stderr: -325> 2024-09-12T00:55:14.975+0000 7f904b038640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:15.328 INFO:tasks.workunit.client.0.smithi073.stderr: -324> 2024-09-12T00:55:14.975+0000 7f904b038640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:15.328 INFO:tasks.workunit.client.0.smithi073.stderr: -323> 2024-09-12T00:55:14.975+0000 7f904a837640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:15.328 INFO:tasks.workunit.client.0.smithi073.stderr: -322> 2024-09-12T00:55:14.975+0000 7f904a837640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:15.328 INFO:tasks.workunit.client.0.smithi073.stderr: -321> 2024-09-12T00:55:14.975+0000 7f904a837640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:15.328 INFO:tasks.workunit.client.0.smithi073.stderr: -320> 2024-09-12T00:55:14.975+0000 7f904b038640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:15.328 INFO:tasks.workunit.client.0.smithi073.stderr: -319> 2024-09-12T00:55:14.975+0000 7f904b038640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:15.329 INFO:tasks.workunit.client.0.smithi073.stderr: -318> 2024-09-12T00:55:14.975+0000 7f904b038640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:15.329 INFO:tasks.workunit.client.0.smithi073.stderr: -317> 2024-09-12T00:55:14.975+0000 7f904a036640 10 monclient(hunting): handle_auth_done global_id 8370 payload 824 2024-09-12T00:55:15.329 INFO:tasks.workunit.client.0.smithi073.stderr: -316> 2024-09-12T00:55:14.975+0000 7f904a036640 10 monclient: _finish_hunting 0 2024-09-12T00:55:15.329 INFO:tasks.workunit.client.0.smithi073.stderr: -315> 2024-09-12T00:55:14.975+0000 7f904a036640 1 monclient: found mon.noname-a 2024-09-12T00:55:15.329 INFO:tasks.workunit.client.0.smithi073.stderr: -314> 2024-09-12T00:55:14.975+0000 7f904a036640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:55:15.329 INFO:tasks.workunit.client.0.smithi073.stderr: -313> 2024-09-12T00:55:14.975+0000 7f8f34e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:15.329 INFO:tasks.workunit.client.0.smithi073.stderr: -312> 2024-09-12T00:55:14.975+0000 7f8f34e01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:55:15.329 INFO:tasks.workunit.client.0.smithi073.stderr: -311> 2024-09-12T00:55:14.975+0000 7f8f34e01640 10 monclient: dump: 2024-09-12T00:55:15.329 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:55:15.329 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:55:15.329 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:55:15.329 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:55:15.330 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:15.330 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:55:15.330 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:55:15.330 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:55:15.330 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:55:15.330 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:55:15.330 INFO:tasks.workunit.client.0.smithi073.stderr: -310> 2024-09-12T00:55:14.975+0000 7f8f34e01640 10 monclient: _finish_auth 0 2024-09-12T00:55:15.330 INFO:tasks.workunit.client.0.smithi073.stderr: -309> 2024-09-12T00:55:14.975+0000 7f8f34e01640 10 monclient: _check_auth_tickets 2024-09-12T00:55:15.330 INFO:tasks.workunit.client.0.smithi073.stderr: -308> 2024-09-12T00:55:14.975+0000 7f8f34e01640 10 monclient: handle_config config(0 keys) 2024-09-12T00:55:15.330 INFO:tasks.workunit.client.0.smithi073.stderr: -307> 2024-09-12T00:55:14.975+0000 7f8f34e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:15.330 INFO:tasks.workunit.client.0.smithi073.stderr: -306> 2024-09-12T00:55:14.975+0000 7f8f34e01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:55:15.330 INFO:tasks.workunit.client.0.smithi073.stderr: -305> 2024-09-12T00:55:14.975+0000 7f8f34e01640 10 monclient: dump: 2024-09-12T00:55:15.330 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:55:15.331 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:55:15.331 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:55:15.331 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:55:15.331 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:15.331 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:55:15.331 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:55:15.331 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:55:15.331 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:55:15.331 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:55:15.331 INFO:tasks.workunit.client.0.smithi073.stderr: -304> 2024-09-12T00:55:14.975+0000 7f904cd46800 5 monclient: authenticate success, global_id 8370 2024-09-12T00:55:15.331 INFO:tasks.workunit.client.0.smithi073.stderr: -303> 2024-09-12T00:55:14.975+0000 7f904cd46800 10 monclient: _renew_subs 2024-09-12T00:55:15.331 INFO:tasks.workunit.client.0.smithi073.stderr: -302> 2024-09-12T00:55:14.975+0000 7f904cd46800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:55:15.331 INFO:tasks.workunit.client.0.smithi073.stderr: -301> 2024-09-12T00:55:14.975+0000 7f904b839640 4 set_mon_vals no callback set 2024-09-12T00:55:15.331 INFO:tasks.workunit.client.0.smithi073.stderr: -300> 2024-09-12T00:55:14.976+0000 7f904cd46800 10 monclient: _renew_subs 2024-09-12T00:55:15.332 INFO:tasks.workunit.client.0.smithi073.stderr: -299> 2024-09-12T00:55:14.976+0000 7f904cd46800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:55:15.332 INFO:tasks.workunit.client.0.smithi073.stderr: -298> 2024-09-12T00:55:14.977+0000 7f8f34e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:55:15.332 INFO:tasks.workunit.client.0.smithi073.stderr: -297> 2024-09-12T00:55:14.977+0000 7f8f34e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:55:15.332 INFO:tasks.workunit.client.0.smithi073.stderr: -296> 2024-09-12T00:55:14.977+0000 7f8f34e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:55:15.332 INFO:tasks.workunit.client.0.smithi073.stderr: -295> 2024-09-12T00:55:14.977+0000 7f904a837640 10 monclient: get_auth_request con 0x7f8f240763b0 auth_method 0 2024-09-12T00:55:15.332 INFO:tasks.workunit.client.0.smithi073.stderr: -294> 2024-09-12T00:55:14.978+0000 7f904cd46800 10 monclient: get_monmap_and_config 2024-09-12T00:55:15.332 INFO:tasks.workunit.client.0.smithi073.stderr: -293> 2024-09-12T00:55:14.978+0000 7f904cd46800 10 monclient: build_initial_monmap 2024-09-12T00:55:15.332 INFO:tasks.workunit.client.0.smithi073.stderr: -292> 2024-09-12T00:55:14.978+0000 7f904cd46800 1 build_initial for_mkfs: 0 2024-09-12T00:55:15.332 INFO:tasks.workunit.client.0.smithi073.stderr: -291> 2024-09-12T00:55:14.978+0000 7f904cd46800 10 monclient: monmap: 2024-09-12T00:55:15.332 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:55:15.332 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:55:15.332 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:55:15.332 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:55:15.333 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:55:15.333 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:55:15.333 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:55:15.333 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:55:15.333 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:55:15.333 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:55:15.333 INFO:tasks.workunit.client.0.smithi073.stderr: -290> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x5613b742ab60) adding auth protocol: cephx 2024-09-12T00:55:15.333 INFO:tasks.workunit.client.0.smithi073.stderr: -289> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x5613b742ab60) adding auth protocol: cephx 2024-09-12T00:55:15.333 INFO:tasks.workunit.client.0.smithi073.stderr: -288> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x5613b742ab60) adding auth protocol: cephx 2024-09-12T00:55:15.333 INFO:tasks.workunit.client.0.smithi073.stderr: -287> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x5613b742ab60) adding con mode: secure 2024-09-12T00:55:15.333 INFO:tasks.workunit.client.0.smithi073.stderr: -286> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x5613b742ab60) adding con mode: crc 2024-09-12T00:55:15.333 INFO:tasks.workunit.client.0.smithi073.stderr: -285> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x5613b742ab60) adding con mode: secure 2024-09-12T00:55:15.333 INFO:tasks.workunit.client.0.smithi073.stderr: -284> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x5613b742ab60) adding con mode: crc 2024-09-12T00:55:15.334 INFO:tasks.workunit.client.0.smithi073.stderr: -283> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x5613b742ab60) adding con mode: secure 2024-09-12T00:55:15.334 INFO:tasks.workunit.client.0.smithi073.stderr: -282> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x5613b742ab60) adding con mode: crc 2024-09-12T00:55:15.334 INFO:tasks.workunit.client.0.smithi073.stderr: -281> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x5613b742ab60) adding con mode: crc 2024-09-12T00:55:15.334 INFO:tasks.workunit.client.0.smithi073.stderr: -280> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x5613b742ab60) adding con mode: secure 2024-09-12T00:55:15.334 INFO:tasks.workunit.client.0.smithi073.stderr: -279> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x5613b742ab60) adding con mode: crc 2024-09-12T00:55:15.334 INFO:tasks.workunit.client.0.smithi073.stderr: -278> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x5613b742ab60) adding con mode: secure 2024-09-12T00:55:15.334 INFO:tasks.workunit.client.0.smithi073.stderr: -277> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x5613b742ab60) adding con mode: crc 2024-09-12T00:55:15.334 INFO:tasks.workunit.client.0.smithi073.stderr: -276> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x5613b742ab60) adding con mode: secure 2024-09-12T00:55:15.334 INFO:tasks.workunit.client.0.smithi073.stderr: -275> 2024-09-12T00:55:14.978+0000 7f904cd46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:15.334 INFO:tasks.workunit.client.0.smithi073.stderr: -274> 2024-09-12T00:55:14.978+0000 7f904cd46800 10 monclient: init 2024-09-12T00:55:15.334 INFO:tasks.workunit.client.0.smithi073.stderr: -273> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc0de0) adding auth protocol: cephx 2024-09-12T00:55:15.334 INFO:tasks.workunit.client.0.smithi073.stderr: -272> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc0de0) adding auth protocol: cephx 2024-09-12T00:55:15.334 INFO:tasks.workunit.client.0.smithi073.stderr: -271> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc0de0) adding auth protocol: cephx 2024-09-12T00:55:15.335 INFO:tasks.workunit.client.0.smithi073.stderr: -270> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc0de0) adding con mode: secure 2024-09-12T00:55:15.335 INFO:tasks.workunit.client.0.smithi073.stderr: -269> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc0de0) adding con mode: crc 2024-09-12T00:55:15.335 INFO:tasks.workunit.client.0.smithi073.stderr: -268> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc0de0) adding con mode: secure 2024-09-12T00:55:15.335 INFO:tasks.workunit.client.0.smithi073.stderr: -267> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc0de0) adding con mode: crc 2024-09-12T00:55:15.335 INFO:tasks.workunit.client.0.smithi073.stderr: -266> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc0de0) adding con mode: secure 2024-09-12T00:55:15.335 INFO:tasks.workunit.client.0.smithi073.stderr: -265> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc0de0) adding con mode: crc 2024-09-12T00:55:15.335 INFO:tasks.workunit.client.0.smithi073.stderr: -264> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc0de0) adding con mode: crc 2024-09-12T00:55:15.335 INFO:tasks.workunit.client.0.smithi073.stderr: -263> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc0de0) adding con mode: secure 2024-09-12T00:55:15.335 INFO:tasks.workunit.client.0.smithi073.stderr: -262> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc0de0) adding con mode: crc 2024-09-12T00:55:15.335 INFO:tasks.workunit.client.0.smithi073.stderr: -261> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc0de0) adding con mode: secure 2024-09-12T00:55:15.335 INFO:tasks.workunit.client.0.smithi073.stderr: -260> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc0de0) adding con mode: crc 2024-09-12T00:55:15.335 INFO:tasks.workunit.client.0.smithi073.stderr: -259> 2024-09-12T00:55:14.978+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc0de0) adding con mode: secure 2024-09-12T00:55:15.335 INFO:tasks.workunit.client.0.smithi073.stderr: -258> 2024-09-12T00:55:14.978+0000 7f904cd46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:15.336 INFO:tasks.workunit.client.0.smithi073.stderr: -257> 2024-09-12T00:55:14.979+0000 7f904cd46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:15.336 INFO:tasks.workunit.client.0.smithi073.stderr: -256> 2024-09-12T00:55:14.979+0000 7f904cd46800 5 asok(0x5613b716e630) register_command rotate-key cmddesc rotate-key hook 0x7ffff1dc0f28 EEXIST 2024-09-12T00:55:15.336 INFO:tasks.workunit.client.0.smithi073.stderr: -255> 2024-09-12T00:55:14.979+0000 7f904cd46800 10 monclient: _reopen_session rank -1 2024-09-12T00:55:15.336 INFO:tasks.workunit.client.0.smithi073.stderr: -254> 2024-09-12T00:55:14.979+0000 7f904cd46800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:55:15.336 INFO:tasks.workunit.client.0.smithi073.stderr: -253> 2024-09-12T00:55:14.979+0000 7f904cd46800 10 monclient(hunting): picked mon.noname-b con 0x5613b745f110 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:55:15.336 INFO:tasks.workunit.client.0.smithi073.stderr: -252> 2024-09-12T00:55:14.979+0000 7f904cd46800 10 monclient(hunting): picked mon.noname-a con 0x5613b744fa60 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:55:15.336 INFO:tasks.workunit.client.0.smithi073.stderr: -251> 2024-09-12T00:55:14.979+0000 7f904cd46800 10 monclient(hunting): picked mon.noname-c con 0x5613b745a540 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:55:15.336 INFO:tasks.workunit.client.0.smithi073.stderr: -250> 2024-09-12T00:55:14.979+0000 7f904cd46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:15.336 INFO:tasks.workunit.client.0.smithi073.stderr: -249> 2024-09-12T00:55:14.979+0000 7f904cd46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:15.336 INFO:tasks.workunit.client.0.smithi073.stderr: -248> 2024-09-12T00:55:14.979+0000 7f904cd46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:15.336 INFO:tasks.workunit.client.0.smithi073.stderr: -247> 2024-09-12T00:55:14.979+0000 7f904cd46800 10 monclient(hunting): _renew_subs 2024-09-12T00:55:15.336 INFO:tasks.workunit.client.0.smithi073.stderr: -246> 2024-09-12T00:55:14.979+0000 7f904cd46800 10 monclient(hunting): authenticate will time out at 2375.649136s 2024-09-12T00:55:15.336 INFO:tasks.workunit.client.0.smithi073.stderr: -245> 2024-09-12T00:55:14.979+0000 7f904b038640 10 monclient(hunting): get_auth_request con 0x5613b745a540 auth_method 0 2024-09-12T00:55:15.336 INFO:tasks.workunit.client.0.smithi073.stderr: -244> 2024-09-12T00:55:14.979+0000 7f904b038640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:15.337 INFO:tasks.workunit.client.0.smithi073.stderr: -243> 2024-09-12T00:55:14.979+0000 7f904b038640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:15.337 INFO:tasks.workunit.client.0.smithi073.stderr: -242> 2024-09-12T00:55:14.979+0000 7f904b038640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:15.337 INFO:tasks.workunit.client.0.smithi073.stderr: -241> 2024-09-12T00:55:14.979+0000 7f904a036640 10 monclient(hunting): get_auth_request con 0x5613b744fa60 auth_method 0 2024-09-12T00:55:15.337 INFO:tasks.workunit.client.0.smithi073.stderr: -240> 2024-09-12T00:55:14.979+0000 7f904a036640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:15.337 INFO:tasks.workunit.client.0.smithi073.stderr: -239> 2024-09-12T00:55:14.979+0000 7f904a036640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:15.337 INFO:tasks.workunit.client.0.smithi073.stderr: -238> 2024-09-12T00:55:14.979+0000 7f904a036640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:15.337 INFO:tasks.workunit.client.0.smithi073.stderr: -237> 2024-09-12T00:55:14.979+0000 7f904b038640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:15.337 INFO:tasks.workunit.client.0.smithi073.stderr: -236> 2024-09-12T00:55:14.979+0000 7f904b038640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:15.337 INFO:tasks.workunit.client.0.smithi073.stderr: -235> 2024-09-12T00:55:14.979+0000 7f904b038640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:15.337 INFO:tasks.workunit.client.0.smithi073.stderr: -234> 2024-09-12T00:55:14.979+0000 7f904a036640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:15.337 INFO:tasks.workunit.client.0.smithi073.stderr: -233> 2024-09-12T00:55:14.979+0000 7f904a036640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:15.337 INFO:tasks.workunit.client.0.smithi073.stderr: -232> 2024-09-12T00:55:14.979+0000 7f904a036640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:15.337 INFO:tasks.workunit.client.0.smithi073.stderr: -231> 2024-09-12T00:55:14.979+0000 7f904b038640 10 monclient(hunting): handle_auth_done global_id 7856 payload 274 2024-09-12T00:55:15.338 INFO:tasks.workunit.client.0.smithi073.stderr: -230> 2024-09-12T00:55:14.979+0000 7f904b038640 10 monclient: _finish_hunting 0 2024-09-12T00:55:15.338 INFO:tasks.workunit.client.0.smithi073.stderr: -229> 2024-09-12T00:55:14.979+0000 7f904b038640 1 monclient: found mon.noname-c 2024-09-12T00:55:15.338 INFO:tasks.workunit.client.0.smithi073.stderr: -228> 2024-09-12T00:55:14.979+0000 7f904b038640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.73:3301/0 2024-09-12T00:55:15.338 INFO:tasks.workunit.client.0.smithi073.stderr: -227> 2024-09-12T00:55:14.979+0000 7f8f2e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:15.338 INFO:tasks.workunit.client.0.smithi073.stderr: -226> 2024-09-12T00:55:14.979+0000 7f8f2e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:55:15.338 INFO:tasks.workunit.client.0.smithi073.stderr: -225> 2024-09-12T00:55:14.979+0000 7f8f2e7fc640 10 monclient: dump: 2024-09-12T00:55:15.338 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:55:15.338 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:55:15.338 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:55:15.338 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:55:15.338 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:15.338 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:55:15.339 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:55:15.339 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:55:15.339 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:55:15.339 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:55:15.339 INFO:tasks.workunit.client.0.smithi073.stderr: -224> 2024-09-12T00:55:14.979+0000 7f8f2e7fc640 10 monclient: _finish_auth 0 2024-09-12T00:55:15.339 INFO:tasks.workunit.client.0.smithi073.stderr: -223> 2024-09-12T00:55:14.979+0000 7f8f2e7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:55:15.339 INFO:tasks.workunit.client.0.smithi073.stderr: -222> 2024-09-12T00:55:14.979+0000 7f8f2e7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:55:15.339 INFO:tasks.workunit.client.0.smithi073.stderr: -221> 2024-09-12T00:55:14.979+0000 7f904cd46800 5 monclient: authenticate success, global_id 7856 2024-09-12T00:55:15.339 INFO:tasks.workunit.client.0.smithi073.stderr: -220> 2024-09-12T00:55:14.979+0000 7f904cd46800 10 monclient: get_monmap_and_config success 2024-09-12T00:55:15.339 INFO:tasks.workunit.client.0.smithi073.stderr: -219> 2024-09-12T00:55:14.979+0000 7f904cd46800 4 set_mon_vals no callback set 2024-09-12T00:55:15.339 INFO:tasks.workunit.client.0.smithi073.stderr: -218> 2024-09-12T00:55:14.979+0000 7f8f2e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:15.339 INFO:tasks.workunit.client.0.smithi073.stderr: -217> 2024-09-12T00:55:14.979+0000 7f8f2e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:55:15.339 INFO:tasks.workunit.client.0.smithi073.stderr: -216> 2024-09-12T00:55:14.979+0000 7f8f2e7fc640 10 monclient: dump: 2024-09-12T00:55:15.339 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:55:15.339 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:55:15.340 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:55:15.340 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:55:15.340 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:15.340 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:55:15.340 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:55:15.340 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:55:15.340 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:55:15.340 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:55:15.340 INFO:tasks.workunit.client.0.smithi073.stderr: -215> 2024-09-12T00:55:14.980+0000 7f904cd46800 10 monclient: shutdown 2024-09-12T00:55:15.340 INFO:tasks.workunit.client.0.smithi073.stderr: -214> 2024-09-12T00:55:14.980+0000 7f904cd46800 10 monclient: build_initial_monmap 2024-09-12T00:55:15.340 INFO:tasks.workunit.client.0.smithi073.stderr: -213> 2024-09-12T00:55:14.980+0000 7f904cd46800 1 build_initial for_mkfs: 0 2024-09-12T00:55:15.340 INFO:tasks.workunit.client.0.smithi073.stderr: -212> 2024-09-12T00:55:14.980+0000 7f904cd46800 10 monclient: monmap: 2024-09-12T00:55:15.340 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 0 2024-09-12T00:55:15.341 INFO:tasks.workunit.client.0.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:55:15.341 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 0.000000 2024-09-12T00:55:15.341 INFO:tasks.workunit.client.0.smithi073.stderr:created 0.000000 2024-09-12T00:55:15.341 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-12T00:55:15.341 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:55:15.341 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-a 2024-09-12T00:55:15.341 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-12T00:55:15.341 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.noname-c 2024-09-12T00:55:15.341 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:55:15.341 INFO:tasks.workunit.client.0.smithi073.stderr: -211> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b742e670) adding auth protocol: cephx 2024-09-12T00:55:15.341 INFO:tasks.workunit.client.0.smithi073.stderr: -210> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b742e670) adding auth protocol: cephx 2024-09-12T00:55:15.341 INFO:tasks.workunit.client.0.smithi073.stderr: -209> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b742e670) adding auth protocol: cephx 2024-09-12T00:55:15.342 INFO:tasks.workunit.client.0.smithi073.stderr: -208> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b742e670) adding con mode: secure 2024-09-12T00:55:15.342 INFO:tasks.workunit.client.0.smithi073.stderr: -207> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b742e670) adding con mode: crc 2024-09-12T00:55:15.342 INFO:tasks.workunit.client.0.smithi073.stderr: -206> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b742e670) adding con mode: secure 2024-09-12T00:55:15.342 INFO:tasks.workunit.client.0.smithi073.stderr: -205> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b742e670) adding con mode: crc 2024-09-12T00:55:15.342 INFO:tasks.workunit.client.0.smithi073.stderr: -204> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b742e670) adding con mode: secure 2024-09-12T00:55:15.342 INFO:tasks.workunit.client.0.smithi073.stderr: -203> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b742e670) adding con mode: crc 2024-09-12T00:55:15.342 INFO:tasks.workunit.client.0.smithi073.stderr: -202> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b742e670) adding con mode: crc 2024-09-12T00:55:15.342 INFO:tasks.workunit.client.0.smithi073.stderr: -201> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b742e670) adding con mode: secure 2024-09-12T00:55:15.342 INFO:tasks.workunit.client.0.smithi073.stderr: -200> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b742e670) adding con mode: crc 2024-09-12T00:55:15.342 INFO:tasks.workunit.client.0.smithi073.stderr: -199> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b742e670) adding con mode: secure 2024-09-12T00:55:15.342 INFO:tasks.workunit.client.0.smithi073.stderr: -198> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b742e670) adding con mode: crc 2024-09-12T00:55:15.342 INFO:tasks.workunit.client.0.smithi073.stderr: -197> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b742e670) adding con mode: secure 2024-09-12T00:55:15.343 INFO:tasks.workunit.client.0.smithi073.stderr: -196> 2024-09-12T00:55:14.980+0000 7f904cd46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:15.343 INFO:tasks.workunit.client.0.smithi073.stderr: -195> 2024-09-12T00:55:14.980+0000 7f904cd46800 1 librados: starting msgr at 2024-09-12T00:55:15.343 INFO:tasks.workunit.client.0.smithi073.stderr: -194> 2024-09-12T00:55:14.980+0000 7f904cd46800 1 librados: starting objecter 2024-09-12T00:55:15.343 INFO:tasks.workunit.client.0.smithi073.stderr: -193> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 asok(0x5613b716e630) register_command objecter_requests cmddesc objecter_requests hook 0x5613b742d560 EEXIST 2024-09-12T00:55:15.343 INFO:tasks.workunit.client.0.smithi073.stderr: -192> 2024-09-12T00:55:14.980+0000 7f904cd46800 1 librados: setting wanted keys 2024-09-12T00:55:15.343 INFO:tasks.workunit.client.0.smithi073.stderr: -191> 2024-09-12T00:55:14.980+0000 7f904cd46800 1 librados: calling monclient init 2024-09-12T00:55:15.343 INFO:tasks.workunit.client.0.smithi073.stderr: -190> 2024-09-12T00:55:14.980+0000 7f904cd46800 10 monclient: init 2024-09-12T00:55:15.343 INFO:tasks.workunit.client.0.smithi073.stderr: -189> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b7218500) adding auth protocol: cephx 2024-09-12T00:55:15.343 INFO:tasks.workunit.client.0.smithi073.stderr: -188> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b7218500) adding auth protocol: cephx 2024-09-12T00:55:15.343 INFO:tasks.workunit.client.0.smithi073.stderr: -187> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b7218500) adding auth protocol: cephx 2024-09-12T00:55:15.343 INFO:tasks.workunit.client.0.smithi073.stderr: -186> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b7218500) adding con mode: secure 2024-09-12T00:55:15.343 INFO:tasks.workunit.client.0.smithi073.stderr: -185> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b7218500) adding con mode: crc 2024-09-12T00:55:15.343 INFO:tasks.workunit.client.0.smithi073.stderr: -184> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b7218500) adding con mode: secure 2024-09-12T00:55:15.344 INFO:tasks.workunit.client.0.smithi073.stderr: -183> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b7218500) adding con mode: crc 2024-09-12T00:55:15.344 INFO:tasks.workunit.client.0.smithi073.stderr: -182> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b7218500) adding con mode: secure 2024-09-12T00:55:15.344 INFO:tasks.workunit.client.0.smithi073.stderr: -181> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b7218500) adding con mode: crc 2024-09-12T00:55:15.344 INFO:tasks.workunit.client.0.smithi073.stderr: -180> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b7218500) adding con mode: crc 2024-09-12T00:55:15.344 INFO:tasks.workunit.client.0.smithi073.stderr: -179> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b7218500) adding con mode: secure 2024-09-12T00:55:15.344 INFO:tasks.workunit.client.0.smithi073.stderr: -178> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b7218500) adding con mode: crc 2024-09-12T00:55:15.344 INFO:tasks.workunit.client.0.smithi073.stderr: -177> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b7218500) adding con mode: secure 2024-09-12T00:55:15.344 INFO:tasks.workunit.client.0.smithi073.stderr: -176> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b7218500) adding con mode: crc 2024-09-12T00:55:15.344 INFO:tasks.workunit.client.0.smithi073.stderr: -175> 2024-09-12T00:55:14.980+0000 7f904cd46800 5 AuthRegistry(0x5613b7218500) adding con mode: secure 2024-09-12T00:55:15.344 INFO:tasks.workunit.client.0.smithi073.stderr: -174> 2024-09-12T00:55:14.981+0000 7f904cd46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:15.344 INFO:tasks.workunit.client.0.smithi073.stderr: -173> 2024-09-12T00:55:14.981+0000 7f904cd46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:15.344 INFO:tasks.workunit.client.0.smithi073.stderr: -172> 2024-09-12T00:55:14.981+0000 7f904cd46800 5 asok(0x5613b716e630) register_command rotate-key cmddesc rotate-key hook 0x5613b7218648 EEXIST 2024-09-12T00:55:15.344 INFO:tasks.workunit.client.0.smithi073.stderr: -171> 2024-09-12T00:55:14.981+0000 7f904cd46800 10 monclient: _reopen_session rank -1 2024-09-12T00:55:15.345 INFO:tasks.workunit.client.0.smithi073.stderr: -170> 2024-09-12T00:55:14.981+0000 7f904cd46800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:55:15.345 INFO:tasks.workunit.client.0.smithi073.stderr: -169> 2024-09-12T00:55:14.981+0000 7f904cd46800 10 monclient(hunting): picked mon.noname-a con 0x5613b744fa60 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-12T00:55:15.345 INFO:tasks.workunit.client.0.smithi073.stderr: -168> 2024-09-12T00:55:14.981+0000 7f904cd46800 10 monclient(hunting): picked mon.noname-c con 0x5613b745a540 addr [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] 2024-09-12T00:55:15.345 INFO:tasks.workunit.client.0.smithi073.stderr: -167> 2024-09-12T00:55:14.981+0000 7f904cd46800 10 monclient(hunting): picked mon.noname-b con 0x5613b745f110 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-12T00:55:15.345 INFO:tasks.workunit.client.0.smithi073.stderr: -166> 2024-09-12T00:55:14.981+0000 7f904cd46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:15.345 INFO:tasks.workunit.client.0.smithi073.stderr: -165> 2024-09-12T00:55:14.981+0000 7f904cd46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:15.345 INFO:tasks.workunit.client.0.smithi073.stderr: -164> 2024-09-12T00:55:14.981+0000 7f904cd46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:15.345 INFO:tasks.workunit.client.0.smithi073.stderr: -163> 2024-09-12T00:55:14.981+0000 7f904cd46800 10 monclient(hunting): _renew_subs 2024-09-12T00:55:15.345 INFO:tasks.workunit.client.0.smithi073.stderr: -162> 2024-09-12T00:55:14.981+0000 7f904cd46800 10 monclient(hunting): authenticate will time out at 2375.651439s 2024-09-12T00:55:15.345 INFO:tasks.workunit.client.0.smithi073.stderr: -161> 2024-09-12T00:55:14.981+0000 7f904a837640 10 monclient(hunting): get_auth_request con 0x5613b744fa60 auth_method 0 2024-09-12T00:55:15.345 INFO:tasks.workunit.client.0.smithi073.stderr: -160> 2024-09-12T00:55:14.981+0000 7f904a837640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:15.345 INFO:tasks.workunit.client.0.smithi073.stderr: -159> 2024-09-12T00:55:14.981+0000 7f904a837640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:15.345 INFO:tasks.workunit.client.0.smithi073.stderr: -158> 2024-09-12T00:55:14.981+0000 7f904a837640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:15.346 INFO:tasks.workunit.client.0.smithi073.stderr: -157> 2024-09-12T00:55:14.981+0000 7f904a036640 10 monclient(hunting): get_auth_request con 0x5613b745a540 auth_method 0 2024-09-12T00:55:15.346 INFO:tasks.workunit.client.0.smithi073.stderr: -156> 2024-09-12T00:55:14.981+0000 7f904a036640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:15.346 INFO:tasks.workunit.client.0.smithi073.stderr: -155> 2024-09-12T00:55:14.981+0000 7f904a036640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:15.346 INFO:tasks.workunit.client.0.smithi073.stderr: -154> 2024-09-12T00:55:14.981+0000 7f904a036640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:15.346 INFO:tasks.workunit.client.0.smithi073.stderr: -153> 2024-09-12T00:55:14.981+0000 7f904a837640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:15.346 INFO:tasks.workunit.client.0.smithi073.stderr: -152> 2024-09-12T00:55:14.981+0000 7f904a837640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:15.346 INFO:tasks.workunit.client.0.smithi073.stderr: -151> 2024-09-12T00:55:14.981+0000 7f904a837640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:15.346 INFO:tasks.workunit.client.0.smithi073.stderr: -150> 2024-09-12T00:55:14.981+0000 7f904a036640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:15.346 INFO:tasks.workunit.client.0.smithi073.stderr: -149> 2024-09-12T00:55:14.981+0000 7f904a036640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:15.346 INFO:tasks.workunit.client.0.smithi073.stderr: -148> 2024-09-12T00:55:14.981+0000 7f904a036640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:15.346 INFO:tasks.workunit.client.0.smithi073.stderr: -147> 2024-09-12T00:55:14.981+0000 7f904a837640 10 monclient(hunting): handle_auth_done global_id 8376 payload 824 2024-09-12T00:55:15.346 INFO:tasks.workunit.client.0.smithi073.stderr: -146> 2024-09-12T00:55:14.981+0000 7f904a837640 10 monclient: _finish_hunting 0 2024-09-12T00:55:15.346 INFO:tasks.workunit.client.0.smithi073.stderr: -145> 2024-09-12T00:55:14.981+0000 7f904a837640 1 monclient: found mon.noname-a 2024-09-12T00:55:15.346 INFO:tasks.workunit.client.0.smithi073.stderr: -144> 2024-09-12T00:55:14.981+0000 7f904a837640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.73:3300/0 2024-09-12T00:55:15.347 INFO:tasks.workunit.client.0.smithi073.stderr: -143> 2024-09-12T00:55:14.982+0000 7f8f2cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:15.347 INFO:tasks.workunit.client.0.smithi073.stderr: -142> 2024-09-12T00:55:14.982+0000 7f8f2cff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:55:15.347 INFO:tasks.workunit.client.0.smithi073.stderr: -141> 2024-09-12T00:55:14.982+0000 7f8f2cff9640 10 monclient: dump: 2024-09-12T00:55:15.347 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:55:15.347 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:55:15.347 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:55:15.347 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:55:15.347 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:15.347 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:55:15.347 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:55:15.347 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:55:15.347 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:55:15.347 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:55:15.348 INFO:tasks.workunit.client.0.smithi073.stderr: -140> 2024-09-12T00:55:14.982+0000 7f8f2cff9640 10 monclient: _finish_auth 0 2024-09-12T00:55:15.348 INFO:tasks.workunit.client.0.smithi073.stderr: -139> 2024-09-12T00:55:14.982+0000 7f8f2cff9640 10 monclient: _check_auth_tickets 2024-09-12T00:55:15.348 INFO:tasks.workunit.client.0.smithi073.stderr: -138> 2024-09-12T00:55:14.982+0000 7f8f2cff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:55:15.348 INFO:tasks.workunit.client.0.smithi073.stderr: -137> 2024-09-12T00:55:14.982+0000 7f8f2cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:15.348 INFO:tasks.workunit.client.0.smithi073.stderr: -136> 2024-09-12T00:55:14.982+0000 7f8f2cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:55:15.348 INFO:tasks.workunit.client.0.smithi073.stderr: -135> 2024-09-12T00:55:14.982+0000 7f8f2e7fc640 4 set_mon_vals no callback set 2024-09-12T00:55:15.348 INFO:tasks.workunit.client.0.smithi073.stderr: -134> 2024-09-12T00:55:14.982+0000 7f8f2cff9640 10 monclient: dump: 2024-09-12T00:55:15.348 INFO:tasks.workunit.client.0.smithi073.stderr:epoch 1 2024-09-12T00:55:15.348 INFO:tasks.workunit.client.0.smithi073.stderr:fsid f020195c-ad88-4fe3-a760-71957da35598 2024-09-12T00:55:15.348 INFO:tasks.workunit.client.0.smithi073.stderr:last_changed 2024-09-12T00:27:17.205181+0000 2024-09-12T00:55:15.348 INFO:tasks.workunit.client.0.smithi073.stderr:created 2024-09-12T00:27:17.205181+0000 2024-09-12T00:55:15.348 INFO:tasks.workunit.client.0.smithi073.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:15.348 INFO:tasks.workunit.client.0.smithi073.stderr:election_strategy: 1 2024-09-12T00:55:15.349 INFO:tasks.workunit.client.0.smithi073.stderr:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T00:55:15.349 INFO:tasks.workunit.client.0.smithi073.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T00:55:15.349 INFO:tasks.workunit.client.0.smithi073.stderr:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2024-09-12T00:55:15.349 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:55:15.349 INFO:tasks.workunit.client.0.smithi073.stderr: -133> 2024-09-12T00:55:14.982+0000 7f904cd46800 5 monclient: authenticate success, global_id 8376 2024-09-12T00:55:15.349 INFO:tasks.workunit.client.0.smithi073.stderr: -132> 2024-09-12T00:55:14.982+0000 7f904cd46800 10 monclient: _renew_subs 2024-09-12T00:55:15.349 INFO:tasks.workunit.client.0.smithi073.stderr: -131> 2024-09-12T00:55:14.982+0000 7f904cd46800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:55:15.349 INFO:tasks.workunit.client.0.smithi073.stderr: -130> 2024-09-12T00:55:14.982+0000 7f904cd46800 10 monclient: _renew_subs 2024-09-12T00:55:15.349 INFO:tasks.workunit.client.0.smithi073.stderr: -129> 2024-09-12T00:55:14.982+0000 7f904cd46800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:55:15.349 INFO:tasks.workunit.client.0.smithi073.stderr: -128> 2024-09-12T00:55:14.982+0000 7f904cd46800 1 librados: init done 2024-09-12T00:55:15.349 INFO:tasks.workunit.client.0.smithi073.stderr: -127> 2024-09-12T00:55:14.982+0000 7f904cd46800 5 asok(0x5613b716e630) register_command cr dump hook 0x5613b7458558 2024-09-12T00:55:15.349 INFO:tasks.workunit.client.0.smithi073.stderr: -126> 2024-09-12T00:55:14.983+0000 7f904cd46800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.350 INFO:tasks.workunit.client.0.smithi073.stderr: -125> 2024-09-12T00:55:14.984+0000 7f8f2cff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:55:15.350 INFO:tasks.workunit.client.0.smithi073.stderr: -124> 2024-09-12T00:55:14.984+0000 7f8f2cff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:55:15.350 INFO:tasks.workunit.client.0.smithi073.stderr: -123> 2024-09-12T00:55:14.984+0000 7f8f2cff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6808/351833213,v1:172.21.15.73:6809/351833213] 2024-09-12T00:55:15.350 INFO:tasks.workunit.client.0.smithi073.stderr: -122> 2024-09-12T00:55:14.984+0000 7f904a036640 10 monclient: get_auth_request con 0x7f8f14076470 auth_method 0 2024-09-12T00:55:15.350 INFO:tasks.workunit.client.0.smithi073.stderr: -121> 2024-09-12T00:55:14.985+0000 7f904b038640 10 monclient: get_auth_request con 0x5613b7479cb0 auth_method 0 2024-09-12T00:55:15.350 INFO:tasks.workunit.client.0.smithi073.stderr: -120> 2024-09-12T00:55:14.985+0000 7f904cd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:15.350 INFO:tasks.workunit.client.0.smithi073.stderr: -119> 2024-09-12T00:55:14.985+0000 7f904cd46800 20 realm 2024-09-12T00:55:15.350 INFO:tasks.workunit.client.0.smithi073.stderr: -118> 2024-09-12T00:55:14.985+0000 7f904cd46800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.350 INFO:tasks.workunit.client.0.smithi073.stderr: -117> 2024-09-12T00:55:14.985+0000 7f904cd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:15.350 INFO:tasks.workunit.client.0.smithi073.stderr: -116> 2024-09-12T00:55:14.985+0000 7f904cd46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:15.350 INFO:tasks.workunit.client.0.smithi073.stderr: -115> 2024-09-12T00:55:14.985+0000 7f904cd46800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.350 INFO:tasks.workunit.client.0.smithi073.stderr: -114> 2024-09-12T00:55:14.986+0000 7f904cd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:15.350 INFO:tasks.workunit.client.0.smithi073.stderr: -113> 2024-09-12T00:55:14.986+0000 7f904cd46800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.351 INFO:tasks.workunit.client.0.smithi073.stderr: -112> 2024-09-12T00:55:14.986+0000 7f904a837640 10 monclient: get_auth_request con 0x5613b747dea0 auth_method 0 2024-09-12T00:55:15.351 INFO:tasks.workunit.client.0.smithi073.stderr: -111> 2024-09-12T00:55:14.987+0000 7f904cd46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:15.351 INFO:tasks.workunit.client.0.smithi073.stderr: -110> 2024-09-12T00:55:14.987+0000 7f904cd46800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.351 INFO:tasks.workunit.client.0.smithi073.stderr: -109> 2024-09-12T00:55:14.987+0000 7f904a036640 10 monclient: get_auth_request con 0x5613b74816e0 auth_method 0 2024-09-12T00:55:15.351 INFO:tasks.workunit.client.0.smithi073.stderr: -108> 2024-09-12T00:55:14.987+0000 7f904cd46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:15.351 INFO:tasks.workunit.client.0.smithi073.stderr: -107> 2024-09-12T00:55:14.987+0000 7f904cd46800 20 searching for the correct realm 2024-09-12T00:55:15.351 INFO:tasks.workunit.client.0.smithi073.stderr: -106> 2024-09-12T00:55:14.988+0000 7f904b038640 10 monclient: get_auth_request con 0x5613b74864a0 auth_method 0 2024-09-12T00:55:15.351 INFO:tasks.workunit.client.0.smithi073.stderr: -105> 2024-09-12T00:55:14.988+0000 7f904a837640 10 monclient: get_auth_request con 0x7f904405c590 auth_method 0 2024-09-12T00:55:15.351 INFO:tasks.workunit.client.0.smithi073.stderr: -104> 2024-09-12T00:55:14.989+0000 7f904a036640 10 monclient: get_auth_request con 0x7f903c03f050 auth_method 0 2024-09-12T00:55:15.351 INFO:tasks.workunit.client.0.smithi073.stderr: -103> 2024-09-12T00:55:14.990+0000 7f904b038640 10 monclient: get_auth_request con 0x7f90340b5550 auth_method 0 2024-09-12T00:55:15.351 INFO:tasks.workunit.client.0.smithi073.stderr: -102> 2024-09-12T00:55:14.990+0000 7f904b038640 0 -- 172.21.15.73:0/1030248242 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f90340b5550 msgr2=0x7f90340ab4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:15.351 INFO:tasks.workunit.client.0.smithi073.stderr: -101> 2024-09-12T00:55:15.191+0000 7f904b038640 10 monclient: get_auth_request con 0x7f90340b5550 auth_method 0 2024-09-12T00:55:15.351 INFO:tasks.workunit.client.0.smithi073.stderr: -100> 2024-09-12T00:55:15.195+0000 7f904a837640 10 monclient: get_auth_request con 0x7f9044086b50 auth_method 0 2024-09-12T00:55:15.352 INFO:tasks.workunit.client.0.smithi073.stderr: -99> 2024-09-12T00:55:15.196+0000 7f904b038640 0 -- 172.21.15.73:0/1030248242 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f90340b5550 msgr2=0x7f90340ab4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:15.352 INFO:tasks.workunit.client.0.smithi073.stderr: -98> 2024-09-12T00:55:15.196+0000 7f8f2cff9640 1 client.8376.objecter ms_handle_reset 0x7f90340b5550 session 0x7f9034005040 osd.4 2024-09-12T00:55:15.352 INFO:tasks.workunit.client.0.smithi073.stderr: -97> 2024-09-12T00:55:15.196+0000 7f8f2cff9640 10 monclient: _renew_subs 2024-09-12T00:55:15.352 INFO:tasks.workunit.client.0.smithi073.stderr: -96> 2024-09-12T00:55:15.196+0000 7f8f2cff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.73:3300/0 2024-09-12T00:55:15.352 INFO:tasks.workunit.client.0.smithi073.stderr: -95> 2024-09-12T00:55:15.197+0000 7f904b038640 10 monclient: get_auth_request con 0x7f8f14086370 auth_method 0 2024-09-12T00:55:15.352 INFO:tasks.workunit.client.0.smithi073.stderr: -94> 2024-09-12T00:55:15.200+0000 7f904cd46800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:55:15.352 INFO:tasks.workunit.client.0.smithi073.stderr: -93> 2024-09-12T00:55:15.200+0000 7f904cd46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:15.352 INFO:tasks.workunit.client.0.smithi073.stderr: -92> 2024-09-12T00:55:15.200+0000 7f904cd46800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:55:15.352 INFO:tasks.workunit.client.0.smithi073.stderr: -91> 2024-09-12T00:55:15.200+0000 7f904cd46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:15.353 INFO:tasks.workunit.client.0.smithi073.stderr: -90> 2024-09-12T00:55:15.200+0000 7f904cd46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:15.353 INFO:tasks.workunit.client.0.smithi073.stderr: -89> 2024-09-12T00:55:15.200+0000 7f904cd46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:15.353 INFO:tasks.workunit.client.0.smithi073.stderr: -88> 2024-09-12T00:55:15.200+0000 7f904cd46800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.353 INFO:tasks.workunit.client.0.smithi073.stderr: -87> 2024-09-12T00:55:15.201+0000 7f904cd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:15.353 INFO:tasks.workunit.client.0.smithi073.stderr: -86> 2024-09-12T00:55:15.201+0000 7f904cd46800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.353 INFO:tasks.workunit.client.0.smithi073.stderr: -85> 2024-09-12T00:55:15.201+0000 7f904cd46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:15.353 INFO:tasks.workunit.client.0.smithi073.stderr: -84> 2024-09-12T00:55:15.201+0000 7f904cd46800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.353 INFO:tasks.workunit.client.0.smithi073.stderr: -83> 2024-09-12T00:55:15.201+0000 7f904cd46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:15.353 INFO:tasks.workunit.client.0.smithi073.stderr: -82> 2024-09-12T00:55:15.201+0000 7f904cd46800 20 zone default found 2024-09-12T00:55:15.353 INFO:tasks.workunit.client.0.smithi073.stderr: -81> 2024-09-12T00:55:15.201+0000 7f904cd46800 4 Realm: () 2024-09-12T00:55:15.353 INFO:tasks.workunit.client.0.smithi073.stderr: -80> 2024-09-12T00:55:15.201+0000 7f904cd46800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:55:15.353 INFO:tasks.workunit.client.0.smithi073.stderr: -79> 2024-09-12T00:55:15.201+0000 7f904cd46800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:55:15.353 INFO:tasks.workunit.client.0.smithi073.stderr: -78> 2024-09-12T00:55:15.201+0000 7f904cd46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:15.354 INFO:tasks.workunit.client.0.smithi073.stderr: -77> 2024-09-12T00:55:15.201+0000 7f904cd46800 20 zonegroup default 2024-09-12T00:55:15.354 INFO:tasks.workunit.client.0.smithi073.stderr: -76> 2024-09-12T00:55:15.201+0000 7f904cd46800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.354 INFO:tasks.workunit.client.0.smithi073.stderr: -75> 2024-09-12T00:55:15.202+0000 7f904cd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:15.354 INFO:tasks.workunit.client.0.smithi073.stderr: -74> 2024-09-12T00:55:15.202+0000 7f904cd46800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.354 INFO:tasks.workunit.client.0.smithi073.stderr: -73> 2024-09-12T00:55:15.202+0000 7f904cd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:15.354 INFO:tasks.workunit.client.0.smithi073.stderr: -72> 2024-09-12T00:55:15.202+0000 7f904cd46800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.354 INFO:tasks.workunit.client.0.smithi073.stderr: -71> 2024-09-12T00:55:15.202+0000 7f904cd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:15.354 INFO:tasks.workunit.client.0.smithi073.stderr: -70> 2024-09-12T00:55:15.202+0000 7f904cd46800 20 started sync module instance, tier type = 2024-09-12T00:55:15.354 INFO:tasks.workunit.client.0.smithi073.stderr: -69> 2024-09-12T00:55:15.202+0000 7f904cd46800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:55:15.354 INFO:tasks.workunit.client.0.smithi073.stderr: -68> 2024-09-12T00:55:15.212+0000 7f904cd46800 20 add_watcher() i=0 2024-09-12T00:55:15.354 INFO:tasks.workunit.client.0.smithi073.stderr: -67> 2024-09-12T00:55:15.212+0000 7f904cd46800 20 add_watcher() i=1 2024-09-12T00:55:15.354 INFO:tasks.workunit.client.0.smithi073.stderr: -66> 2024-09-12T00:55:15.212+0000 7f904cd46800 20 add_watcher() i=2 2024-09-12T00:55:15.354 INFO:tasks.workunit.client.0.smithi073.stderr: -65> 2024-09-12T00:55:15.212+0000 7f904cd46800 20 add_watcher() i=3 2024-09-12T00:55:15.355 INFO:tasks.workunit.client.0.smithi073.stderr: -64> 2024-09-12T00:55:15.212+0000 7f904cd46800 20 add_watcher() i=4 2024-09-12T00:55:15.355 INFO:tasks.workunit.client.0.smithi073.stderr: -63> 2024-09-12T00:55:15.212+0000 7f904cd46800 20 add_watcher() i=5 2024-09-12T00:55:15.355 INFO:tasks.workunit.client.0.smithi073.stderr: -62> 2024-09-12T00:55:15.212+0000 7f904cd46800 20 add_watcher() i=6 2024-09-12T00:55:15.355 INFO:tasks.workunit.client.0.smithi073.stderr: -61> 2024-09-12T00:55:15.213+0000 7f904cd46800 20 add_watcher() i=7 2024-09-12T00:55:15.355 INFO:tasks.workunit.client.0.smithi073.stderr: -60> 2024-09-12T00:55:15.213+0000 7f904cd46800 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:15.355 INFO:tasks.workunit.client.0.smithi073.stderr: -59> 2024-09-12T00:55:15.214+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc12c0) adding auth protocol: cephx 2024-09-12T00:55:15.355 INFO:tasks.workunit.client.0.smithi073.stderr: -58> 2024-09-12T00:55:15.214+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc12c0) adding auth protocol: cephx 2024-09-12T00:55:15.355 INFO:tasks.workunit.client.0.smithi073.stderr: -57> 2024-09-12T00:55:15.214+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc12c0) adding auth protocol: cephx 2024-09-12T00:55:15.355 INFO:tasks.workunit.client.0.smithi073.stderr: -56> 2024-09-12T00:55:15.214+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc12c0) adding con mode: secure 2024-09-12T00:55:15.355 INFO:tasks.workunit.client.0.smithi073.stderr: -55> 2024-09-12T00:55:15.214+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc12c0) adding con mode: crc 2024-09-12T00:55:15.355 INFO:tasks.workunit.client.0.smithi073.stderr: -54> 2024-09-12T00:55:15.214+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc12c0) adding con mode: secure 2024-09-12T00:55:15.355 INFO:tasks.workunit.client.0.smithi073.stderr: -53> 2024-09-12T00:55:15.214+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc12c0) adding con mode: crc 2024-09-12T00:55:15.355 INFO:tasks.workunit.client.0.smithi073.stderr: -52> 2024-09-12T00:55:15.214+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc12c0) adding con mode: secure 2024-09-12T00:55:15.355 INFO:tasks.workunit.client.0.smithi073.stderr: -51> 2024-09-12T00:55:15.214+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc12c0) adding con mode: crc 2024-09-12T00:55:15.356 INFO:tasks.workunit.client.0.smithi073.stderr: -50> 2024-09-12T00:55:15.214+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc12c0) adding con mode: crc 2024-09-12T00:55:15.356 INFO:tasks.workunit.client.0.smithi073.stderr: -49> 2024-09-12T00:55:15.214+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc12c0) adding con mode: secure 2024-09-12T00:55:15.356 INFO:tasks.workunit.client.0.smithi073.stderr: -48> 2024-09-12T00:55:15.214+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc12c0) adding con mode: crc 2024-09-12T00:55:15.356 INFO:tasks.workunit.client.0.smithi073.stderr: -47> 2024-09-12T00:55:15.214+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc12c0) adding con mode: secure 2024-09-12T00:55:15.356 INFO:tasks.workunit.client.0.smithi073.stderr: -46> 2024-09-12T00:55:15.214+0000 7f8f017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:15.356 INFO:tasks.workunit.client.0.smithi073.stderr: -45> 2024-09-12T00:55:15.214+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc12c0) adding con mode: crc 2024-09-12T00:55:15.356 INFO:tasks.workunit.client.0.smithi073.stderr: -44> 2024-09-12T00:55:15.214+0000 7f904cd46800 5 AuthRegistry(0x7ffff1dc12c0) adding con mode: secure 2024-09-12T00:55:15.356 INFO:tasks.workunit.client.0.smithi073.stderr: -43> 2024-09-12T00:55:15.215+0000 7f904cd46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:15.356 INFO:tasks.workunit.client.0.smithi073.stderr: -42> 2024-09-12T00:55:15.215+0000 7f904cd46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:15.356 INFO:tasks.workunit.client.0.smithi073.stderr: -41> 2024-09-12T00:55:15.215+0000 7f904cd46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:15.356 INFO:tasks.workunit.client.0.smithi073.stderr: -40> 2024-09-12T00:55:15.215+0000 7f904cd46800 5 asok(0x5613b716e630) register_command cache list hook 0x5613b7455810 2024-09-12T00:55:15.356 INFO:tasks.workunit.client.0.smithi073.stderr: -39> 2024-09-12T00:55:15.215+0000 7f904cd46800 5 asok(0x5613b716e630) register_command cache inspect hook 0x5613b7455810 2024-09-12T00:55:15.357 INFO:tasks.workunit.client.0.smithi073.stderr: -38> 2024-09-12T00:55:15.215+0000 7f904cd46800 5 asok(0x5613b716e630) register_command cache erase hook 0x5613b7455810 2024-09-12T00:55:15.357 INFO:tasks.workunit.client.0.smithi073.stderr: -37> 2024-09-12T00:55:15.215+0000 7f904cd46800 5 asok(0x5613b716e630) register_command cache zap hook 0x5613b7455810 2024-09-12T00:55:15.357 INFO:tasks.workunit.client.0.smithi073.stderr: -36> 2024-09-12T00:55:15.215+0000 7f904cd46800 5 note: GC not initialized 2024-09-12T00:55:15.357 INFO:tasks.workunit.client.0.smithi073.stderr: -35> 2024-09-12T00:55:15.215+0000 7f8e7bfff640 20 reqs_thread_entry: start 2024-09-12T00:55:15.357 INFO:tasks.workunit.client.0.smithi073.stderr: -34> 2024-09-12T00:55:15.215+0000 7f904cd46800 5 asok(0x5613b716e630) register_command sync trace show hook 0x7f9034004620 2024-09-12T00:55:15.357 INFO:tasks.workunit.client.0.smithi073.stderr: -33> 2024-09-12T00:55:15.215+0000 7f904cd46800 5 asok(0x5613b716e630) register_command sync trace history hook 0x7f9034004620 2024-09-12T00:55:15.357 INFO:tasks.workunit.client.0.smithi073.stderr: -32> 2024-09-12T00:55:15.215+0000 7f904cd46800 5 asok(0x5613b716e630) register_command sync trace active hook 0x7f9034004620 2024-09-12T00:55:15.357 INFO:tasks.workunit.client.0.smithi073.stderr: -31> 2024-09-12T00:55:15.215+0000 7f904cd46800 5 asok(0x5613b716e630) register_command sync trace active_short hook 0x7f9034004620 2024-09-12T00:55:15.357 INFO:tasks.workunit.client.0.smithi073.stderr: -30> 2024-09-12T00:55:15.215+0000 7f904cd46800 20 init_complete bucket index max shards: 1 2024-09-12T00:55:15.357 INFO:tasks.workunit.client.0.smithi073.stderr: -29> 2024-09-12T00:55:15.215+0000 7f904cd46800 20 Filter name: none 2024-09-12T00:55:15.357 INFO:tasks.workunit.client.0.smithi073.stderr: -28> 2024-09-12T00:55:15.215+0000 7f8e79ffb640 20 reqs_thread_entry: start 2024-09-12T00:55:15.357 INFO:tasks.workunit.client.0.smithi073.stderr: -27> 2024-09-12T00:55:15.215+0000 7f904cd46800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:55:15.357 INFO:tasks.workunit.client.0.smithi073.stderr: -26> 2024-09-12T00:55:15.215+0000 7f904cd46800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.358 INFO:tasks.workunit.client.0.smithi073.stderr: -25> 2024-09-12T00:55:15.216+0000 7f904cd46800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:55:15.358 INFO:tasks.workunit.client.0.smithi073.stderr: -24> 2024-09-12T00:55:15.216+0000 7f904cd46800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:55:15.358 INFO:tasks.workunit.client.0.smithi073.stderr: -23> 2024-09-12T00:55:15.216+0000 7f904cd46800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:55:15.358 INFO:tasks.workunit.client.0.smithi073.stderr: -22> 2024-09-12T00:55:15.216+0000 7f904cd46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 : miss 2024-09-12T00:55:15.358 INFO:tasks.workunit.client.0.smithi073.stderr: -21> 2024-09-12T00:55:15.216+0000 7f904cd46800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.358 INFO:tasks.workunit.client.0.smithi073.stderr: -20> 2024-09-12T00:55:15.216+0000 7f904cd46800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:55:15.358 INFO:tasks.workunit.client.0.smithi073.stderr: -19> 2024-09-12T00:55:15.216+0000 7f904cd46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:55:15.358 INFO:tasks.workunit.client.0.smithi073.stderr: -18> 2024-09-12T00:55:15.216+0000 7f904cd46800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:55:15.358 INFO:tasks.workunit.client.0.smithi073.stderr: -17> 2024-09-12T00:55:15.216+0000 7f904cd46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:55:15.358 INFO:tasks.workunit.client.0.smithi073.stderr: -16> 2024-09-12T00:55:15.216+0000 7f904cd46800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:55:15.358 INFO:tasks.workunit.client.0.smithi073.stderr: -15> 2024-09-12T00:55:15.216+0000 7f904cd46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 2024-09-12T00:55:15.358 INFO:tasks.workunit.client.0.smithi073.stderr: -14> 2024-09-12T00:55:15.217+0000 7f904cd46800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:55:15.358 INFO:tasks.workunit.client.0.smithi073.stderr: -13> 2024-09-12T00:55:15.221+0000 7f904cd46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:55:15.359 INFO:tasks.workunit.client.0.smithi073.stderr: -12> 2024-09-12T00:55:15.221+0000 7f904cd46800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:55:15.359 INFO:tasks.workunit.client.0.smithi073.stderr: -11> 2024-09-12T00:55:15.221+0000 7f904cd46800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:55:15.359 INFO:tasks.workunit.client.0.smithi073.stderr: -10> 2024-09-12T00:55:15.221+0000 7f904cd46800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17, ofs0, ns] 2024-09-12T00:55:15.359 INFO:tasks.workunit.client.0.smithi073.stderr: -9> 2024-09-12T00:55:15.222+0000 7f8f2e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497048 cookie 94642679376048 notifier 8376 bl.length()=827 2024-09-12T00:55:15.359 INFO:tasks.workunit.client.0.smithi073.stderr: -8> 2024-09-12T00:55:15.222+0000 7f8f2e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:55:15.359 INFO:tasks.workunit.client.0.smithi073.stderr: -7> 2024-09-12T00:55:15.222+0000 7f8f2e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:55:15.359 INFO:tasks.workunit.client.0.smithi073.stderr: -6> 2024-09-12T00:55:15.222+0000 7f8f2e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:55:15.359 INFO:tasks.workunit.client.0.smithi073.stderr: -5> 2024-09-12T00:55:15.223+0000 7f904cd46800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): orig_sources= new_sources= 2024-09-12T00:55:15.359 INFO:tasks.workunit.client.0.smithi073.stderr: -4> 2024-09-12T00:55:15.223+0000 7f904cd46800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): potential sources added=[] removed=[] 2024-09-12T00:55:15.359 INFO:tasks.workunit.client.0.smithi073.stderr: -3> 2024-09-12T00:55:15.223+0000 7f904cd46800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): orig_dests= new_dests= 2024-09-12T00:55:15.359 INFO:tasks.workunit.client.0.smithi073.stderr: -2> 2024-09-12T00:55:15.223+0000 7f904cd46800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): potential dests added=[] removed=[] 2024-09-12T00:55:15.359 INFO:tasks.workunit.client.0.smithi073.stderr: -1> 2024-09-12T00:55:15.226+0000 7f904cd46800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f904cd46800 time 2024-09-12T00:55:15.226949+0000 2024-09-12T00:55:15.359 INFO:tasks.workunit.client.0.smithi073.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:55:15.360 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:55:15.360 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:55:15.360 INFO:tasks.workunit.client.0.smithi073.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f905038c71a] 2024-09-12T00:55:15.360 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f905038c8d8] 2024-09-12T00:55:15.360 INFO:tasks.workunit.client.0.smithi073.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5613b5098641] 2024-09-12T00:55:15.360 INFO:tasks.workunit.client.0.smithi073.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5613b50a838a] 2024-09-12T00:55:15.360 INFO:tasks.workunit.client.0.smithi073.stderr: 5: main() 2024-09-12T00:55:15.360 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f904f029590] 2024-09-12T00:55:15.360 INFO:tasks.workunit.client.0.smithi073.stderr: 7: __libc_start_main() 2024-09-12T00:55:15.360 INFO:tasks.workunit.client.0.smithi073.stderr: 8: _start() 2024-09-12T00:55:15.360 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:55:15.360 INFO:tasks.workunit.client.0.smithi073.stderr: 0> 2024-09-12T00:55:15.227+0000 7f904cd46800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:55:15.361 INFO:tasks.workunit.client.0.smithi073.stderr: in thread 7f904cd46800 thread_name:radosgw-admin 2024-09-12T00:55:15.361 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:55:15.361 INFO:tasks.workunit.client.0.smithi073.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:55:15.361 INFO:tasks.workunit.client.0.smithi073.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f904f03e6f0] 2024-09-12T00:55:15.361 INFO:tasks.workunit.client.0.smithi073.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f904f08b99c] 2024-09-12T00:55:15.361 INFO:tasks.workunit.client.0.smithi073.stderr: 3: raise() 2024-09-12T00:55:15.361 INFO:tasks.workunit.client.0.smithi073.stderr: 4: abort() 2024-09-12T00:55:15.361 INFO:tasks.workunit.client.0.smithi073.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f905038c774] 2024-09-12T00:55:15.361 INFO:tasks.workunit.client.0.smithi073.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f905038c8d8] 2024-09-12T00:55:15.361 INFO:tasks.workunit.client.0.smithi073.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5613b5098641] 2024-09-12T00:55:15.361 INFO:tasks.workunit.client.0.smithi073.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5613b50a838a] 2024-09-12T00:55:15.361 INFO:tasks.workunit.client.0.smithi073.stderr: 9: main() 2024-09-12T00:55:15.361 INFO:tasks.workunit.client.0.smithi073.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f904f029590] 2024-09-12T00:55:15.362 INFO:tasks.workunit.client.0.smithi073.stderr: 11: __libc_start_main() 2024-09-12T00:55:15.362 INFO:tasks.workunit.client.0.smithi073.stderr: 12: _start() 2024-09-12T00:55:15.362 INFO:tasks.workunit.client.0.smithi073.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:55:15.362 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:55:15.362 INFO:tasks.workunit.client.0.smithi073.stderr:--- logging levels --- 2024-09-12T00:55:15.362 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 none 2024-09-12T00:55:15.362 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 lockdep 2024-09-12T00:55:15.362 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 context 2024-09-12T00:55:15.362 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 crush 2024-09-12T00:55:15.362 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds 2024-09-12T00:55:15.362 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_balancer 2024-09-12T00:55:15.362 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_locker 2024-09-12T00:55:15.362 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_log 2024-09-12T00:55:15.363 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_log_expire 2024-09-12T00:55:15.363 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mds_migrator 2024-09-12T00:55:15.363 INFO:tasks.workunit.client.0.smithi073.stderr: 3/ 5 mds_quiesce 2024-09-12T00:55:15.363 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 buffer 2024-09-12T00:55:15.363 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 timer 2024-09-12T00:55:15.363 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 filer 2024-09-12T00:55:15.363 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 striper 2024-09-12T00:55:15.363 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 1 objecter 2024-09-12T00:55:15.363 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rados 2024-09-12T00:55:15.363 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd 2024-09-12T00:55:15.363 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_mirror 2024-09-12T00:55:15.363 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_replay 2024-09-12T00:55:15.363 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 rbd_pwl 2024-09-12T00:55:15.363 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 journaler 2024-09-12T00:55:15.364 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 objectcacher 2024-09-12T00:55:15.364 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:55:15.364 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 client 2024-09-12T00:55:15.364 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 osd 2024-09-12T00:55:15.364 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 optracker 2024-09-12T00:55:15.364 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 objclass 2024-09-12T00:55:15.364 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 filestore 2024-09-12T00:55:15.364 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 journal 2024-09-12T00:55:15.364 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 0 ms 2024-09-12T00:55:15.364 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mon 2024-09-12T00:55:15.364 INFO:tasks.workunit.client.0.smithi073.stderr: 0/10 monc 2024-09-12T00:55:15.364 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 paxos 2024-09-12T00:55:15.364 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 tp 2024-09-12T00:55:15.365 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 auth 2024-09-12T00:55:15.365 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 crypto 2024-09-12T00:55:15.365 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 finisher 2024-09-12T00:55:15.365 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 reserver 2024-09-12T00:55:15.365 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 heartbeatmap 2024-09-12T00:55:15.365 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 perfcounter 2024-09-12T00:55:15.365 INFO:tasks.workunit.client.0.smithi073.stderr: 20/20 rgw 2024-09-12T00:55:15.365 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_sync 2024-09-12T00:55:15.365 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_datacache 2024-09-12T00:55:15.365 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_access 2024-09-12T00:55:15.365 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:55:15.365 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_flight 2024-09-12T00:55:15.365 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:55:15.365 INFO:tasks.workunit.client.0.smithi073.stderr: 20/20 rgw_notification 2024-09-12T00:55:15.366 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 javaclient 2024-09-12T00:55:15.366 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 asok 2024-09-12T00:55:15.366 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 1 throttle 2024-09-12T00:55:15.366 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 0 refs 2024-09-12T00:55:15.366 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 compressor 2024-09-12T00:55:15.366 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 bluestore 2024-09-12T00:55:15.366 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 bluefs 2024-09-12T00:55:15.366 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 3 bdev 2024-09-12T00:55:15.366 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 kstore 2024-09-12T00:55:15.366 INFO:tasks.workunit.client.0.smithi073.stderr: 4/ 5 rocksdb 2024-09-12T00:55:15.366 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 fuse 2024-09-12T00:55:15.366 INFO:tasks.workunit.client.0.smithi073.stderr: 2/ 5 mgr 2024-09-12T00:55:15.366 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mgrc 2024-09-12T00:55:15.366 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 dpdk 2024-09-12T00:55:15.367 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 eventtrace 2024-09-12T00:55:15.367 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 prioritycache 2024-09-12T00:55:15.367 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 test 2024-09-12T00:55:15.367 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:55:15.367 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cephsqlite 2024-09-12T00:55:15.367 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:55:15.367 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore 2024-09-12T00:55:15.367 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_onode 2024-09-12T00:55:15.367 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_odata 2024-09-12T00:55:15.367 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_omap 2024-09-12T00:55:15.367 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_tm 2024-09-12T00:55:15.367 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_t 2024-09-12T00:55:15.367 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:55:15.368 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_epm 2024-09-12T00:55:15.368 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_lba 2024-09-12T00:55:15.368 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:55:15.368 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_cache 2024-09-12T00:55:15.368 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_journal 2024-09-12T00:55:15.368 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_device 2024-09-12T00:55:15.368 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 seastore_backref 2024-09-12T00:55:15.368 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 alienstore 2024-09-12T00:55:15.368 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 mclock 2024-09-12T00:55:15.368 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 cyanstore 2024-09-12T00:55:15.368 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 ceph_exporter 2024-09-12T00:55:15.368 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 memstore 2024-09-12T00:55:15.368 INFO:tasks.workunit.client.0.smithi073.stderr: 1/ 5 trace 2024-09-12T00:55:15.368 INFO:tasks.workunit.client.0.smithi073.stderr: 0/ 5 ceph_dedup 2024-09-12T00:55:15.369 INFO:tasks.workunit.client.0.smithi073.stderr: -2/-2 (syslog threshold) 2024-09-12T00:55:15.369 INFO:tasks.workunit.client.0.smithi073.stderr: 99/99 (stderr threshold) 2024-09-12T00:55:15.369 INFO:tasks.workunit.client.0.smithi073.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:55:15.369 INFO:tasks.workunit.client.0.smithi073.stderr: 7f8e79ffb640 / http_manager 2024-09-12T00:55:15.369 INFO:tasks.workunit.client.0.smithi073.stderr: 7f8e7bfff640 / http_manager 2024-09-12T00:55:15.369 INFO:tasks.workunit.client.0.smithi073.stderr: 7f8f017e2640 / rgw_dt_lg_renew 2024-09-12T00:55:15.369 INFO:tasks.workunit.client.0.smithi073.stderr: 7f8f2cff9640 / ms_dispatch 2024-09-12T00:55:15.369 INFO:tasks.workunit.client.0.smithi073.stderr: 7f8f2e7fc640 / io_context_pool 2024-09-12T00:55:15.369 INFO:tasks.workunit.client.0.smithi073.stderr: 7f8f34e01640 / ms_dispatch 2024-09-12T00:55:15.369 INFO:tasks.workunit.client.0.smithi073.stderr: 7f8f37606640 / ms_dispatch 2024-09-12T00:55:15.369 INFO:tasks.workunit.client.0.smithi073.stderr: 7f8f38e09640 / io_context_pool 2024-09-12T00:55:15.369 INFO:tasks.workunit.client.0.smithi073.stderr: 7f904a036640 / msgr-worker-2 2024-09-12T00:55:15.369 INFO:tasks.workunit.client.0.smithi073.stderr: 7f904a837640 / msgr-worker-1 2024-09-12T00:55:15.369 INFO:tasks.workunit.client.0.smithi073.stderr: 7f904b038640 / msgr-worker-0 2024-09-12T00:55:15.370 INFO:tasks.workunit.client.0.smithi073.stderr: 7f904b839640 / io_context_pool 2024-09-12T00:55:15.370 INFO:tasks.workunit.client.0.smithi073.stderr: 7f904cd46800 / radosgw-admin 2024-09-12T00:55:15.370 INFO:tasks.workunit.client.0.smithi073.stderr: max_recent 500 2024-09-12T00:55:15.370 INFO:tasks.workunit.client.0.smithi073.stderr: max_new 1000 2024-09-12T00:55:15.370 INFO:tasks.workunit.client.0.smithi073.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:55:15.228354Z_4290d12c-b802-43a6-b454-8dfdba61ad69/log 2024-09-12T00:55:15.370 INFO:tasks.workunit.client.0.smithi073.stderr:--- end dump of recent events --- 2024-09-12T00:55:15.370 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:55:15.372 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:15.372 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:15.372 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.303+0000 7f3e5fd21800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.372 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.305+0000 7f3e5fd21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:15.372 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.305+0000 7f3e5fd21800 20 realm 2024-09-12T00:55:15.372 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.305+0000 7f3e5fd21800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.372 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.305+0000 7f3e5fd21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:15.372 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.305+0000 7f3e5fd21800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:15.372 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.305+0000 7f3e5fd21800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.372 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.305+0000 7f3e5fd21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:15.373 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.305+0000 7f3e5fd21800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.373 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.306+0000 7f3e5fd21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:15.373 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.306+0000 7f3e5fd21800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.373 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.307+0000 7f3e5fd21800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:15.373 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.307+0000 7f3e5fd21800 20 searching for the correct realm 2024-09-12T00:55:15.373 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.309+0000 7f3e5c157640 0 -- 172.21.15.73:0/3103582813 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f3e44093ba0 msgr2=0x7f3e44089930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:15.515 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.516+0000 7f3e5c157640 0 -- 172.21.15.73:0/3103582813 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f3e44093ba0 msgr2=0x7f3e44089930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:15.519 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.521+0000 7f3e5fd21800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:55:15.519 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.521+0000 7f3e5fd21800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:15.520 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.521+0000 7f3e5fd21800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:55:15.520 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.521+0000 7f3e5fd21800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:15.520 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.521+0000 7f3e5fd21800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:15.520 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.521+0000 7f3e5fd21800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:15.520 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.521+0000 7f3e5fd21800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.520 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.521+0000 7f3e5fd21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:15.520 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.521+0000 7f3e5fd21800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.521 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.521+0000 7f3e5fd21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:15.521 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.521+0000 7f3e5fd21800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.522 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.522+0000 7f3e5fd21800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:15.522 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.522+0000 7f3e5fd21800 20 zone default found 2024-09-12T00:55:15.522 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.522+0000 7f3e5fd21800 4 Realm: () 2024-09-12T00:55:15.522 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.522+0000 7f3e5fd21800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:55:15.522 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.522+0000 7f3e5fd21800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:55:15.522 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.522+0000 7f3e5fd21800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:15.522 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.522+0000 7f3e5fd21800 20 zonegroup default 2024-09-12T00:55:15.522 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.522+0000 7f3e5fd21800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.522 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.522+0000 7f3e5fd21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:15.522 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.522+0000 7f3e5fd21800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.522 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.522+0000 7f3e5fd21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:15.522 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.522+0000 7f3e5fd21800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.522 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.522+0000 7f3e5fd21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:15.523 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.522+0000 7f3e5fd21800 20 started sync module instance, tier type = 2024-09-12T00:55:15.523 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.522+0000 7f3e5fd21800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:55:15.530 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.532+0000 7f3e5fd21800 20 add_watcher() i=0 2024-09-12T00:55:15.530 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.532+0000 7f3e5fd21800 20 add_watcher() i=1 2024-09-12T00:55:15.531 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.532+0000 7f3e5fd21800 20 add_watcher() i=2 2024-09-12T00:55:15.531 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.532+0000 7f3e5fd21800 20 add_watcher() i=3 2024-09-12T00:55:15.531 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.532+0000 7f3e5fd21800 20 add_watcher() i=4 2024-09-12T00:55:15.531 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.532+0000 7f3e5fd21800 20 add_watcher() i=5 2024-09-12T00:55:15.531 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.532+0000 7f3e5fd21800 20 add_watcher() i=6 2024-09-12T00:55:15.531 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.533+0000 7f3e5fd21800 20 add_watcher() i=7 2024-09-12T00:55:15.531 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.533+0000 7f3e5fd21800 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:15.533 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.534+0000 7f3d11fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:15.534 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.535+0000 7f3e5fd21800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:15.534 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.535+0000 7f3e5fd21800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:15.534 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.535+0000 7f3e5fd21800 5 note: GC not initialized 2024-09-12T00:55:15.534 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.535+0000 7f3d10fe1640 20 reqs_thread_entry: start 2024-09-12T00:55:15.534 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.535+0000 7f3e5fd21800 20 init_complete bucket index max shards: 1 2024-09-12T00:55:15.534 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.535+0000 7f3e5fd21800 20 Filter name: none 2024-09-12T00:55:15.534 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.535+0000 7f3c8a7fc640 20 reqs_thread_entry: start 2024-09-12T00:55:15.534 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.535+0000 7f3e5fd21800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.535 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.536+0000 7f3e5fd21800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:55:15.536 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.536+0000 7f3e5fd21800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.536 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.536+0000 7f3e5fd21800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:55:15.536 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.536+0000 7f3e5fd21800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:15.536 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.536+0000 7f3e5fd21800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.536 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.536+0000 7f3e5fd21800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:55:15.536 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.536+0000 7f3e5fd21800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.536 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.537+0000 7f3e5fd21800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:55:15.536 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.537+0000 7f3e5fd21800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:15.538 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.538+0000 7f3d11fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:15.539 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.540+0000 7f3e5fd21800 20 remove_watcher() i=0 2024-09-12T00:55:15.539 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.540+0000 7f3e5fd21800 2 removed watcher, disabling cache 2024-09-12T00:55:15.540 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.542+0000 7f3e5fd21800 20 remove_watcher() i=1 2024-09-12T00:55:15.541 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.543+0000 7f3e5fd21800 20 remove_watcher() i=2 2024-09-12T00:55:15.542 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.544+0000 7f3e5fd21800 20 remove_watcher() i=3 2024-09-12T00:55:15.543 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.545+0000 7f3e5fd21800 20 remove_watcher() i=4 2024-09-12T00:55:15.544 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.546+0000 7f3e5fd21800 20 remove_watcher() i=5 2024-09-12T00:55:15.545 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.547+0000 7f3e5fd21800 20 remove_watcher() i=6 2024-09-12T00:55:15.546 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.548+0000 7f3e5fd21800 20 remove_watcher() i=7 2024-09-12T00:55:15.559 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:55:15.559 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:55:15.595 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:55:15.624 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:15.625 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:15.661 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.663+0000 7f5aaa240800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.663 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.664+0000 7f5aaa240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:15.663 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.664+0000 7f5aaa240800 20 realm 2024-09-12T00:55:15.663 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.664+0000 7f5aaa240800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.664 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.664+0000 7f5aaa240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:15.664 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.664+0000 7f5aaa240800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:15.664 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.664+0000 7f5aaa240800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.664 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.664+0000 7f5aaa240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:15.664 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.664+0000 7f5aaa240800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.664 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.665+0000 7f5aaa240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:15.665 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.665+0000 7f5aaa240800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.665 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.666+0000 7f5aaa240800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:15.665 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.666+0000 7f5aaa240800 20 searching for the correct realm 2024-09-12T00:55:15.667 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.669+0000 7f5aa8532640 0 -- 172.21.15.73:0/2082116386 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f5a9c028040 msgr2=0x7f5a9c045720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:15.875 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.876+0000 7f5aa8532640 0 -- 172.21.15.73:0/2082116386 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f5a9c028040 msgr2=0x7f5a9c045720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:15.879 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.880+0000 7f5aaa240800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:55:15.879 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.880+0000 7f5aaa240800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:15.879 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.880+0000 7f5aaa240800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:55:15.879 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.880+0000 7f5aaa240800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:15.879 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.880+0000 7f5aaa240800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:15.879 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.880+0000 7f5aaa240800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:15.879 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.880+0000 7f5aaa240800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.879 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.880+0000 7f5aaa240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:15.879 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.880+0000 7f5aaa240800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.881 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.881+0000 7f5aaa240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:15.881 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.881+0000 7f5aaa240800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.881 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.881+0000 7f5aaa240800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:15.881 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.881+0000 7f5aaa240800 20 zone default found 2024-09-12T00:55:15.881 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.881+0000 7f5aaa240800 4 Realm: () 2024-09-12T00:55:15.881 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.881+0000 7f5aaa240800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:55:15.882 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.881+0000 7f5aaa240800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:55:15.882 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.881+0000 7f5aaa240800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:15.882 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.881+0000 7f5aaa240800 20 zonegroup default 2024-09-12T00:55:15.882 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.881+0000 7f5aaa240800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.882 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.881+0000 7f5aaa240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:15.882 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.881+0000 7f5aaa240800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.882 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.881+0000 7f5aaa240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:15.882 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.881+0000 7f5aaa240800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.882 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.882+0000 7f5aaa240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:15.882 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.882+0000 7f5aaa240800 20 started sync module instance, tier type = 2024-09-12T00:55:15.882 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.882+0000 7f5aaa240800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:55:15.889 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.891+0000 7f5aaa240800 20 add_watcher() i=0 2024-09-12T00:55:15.890 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.891+0000 7f5aaa240800 20 add_watcher() i=1 2024-09-12T00:55:15.890 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.891+0000 7f5aaa240800 20 add_watcher() i=2 2024-09-12T00:55:15.890 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.891+0000 7f5aaa240800 20 add_watcher() i=3 2024-09-12T00:55:15.890 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.891+0000 7f5aaa240800 20 add_watcher() i=4 2024-09-12T00:55:15.890 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.891+0000 7f5aaa240800 20 add_watcher() i=5 2024-09-12T00:55:15.890 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.891+0000 7f5aaa240800 20 add_watcher() i=6 2024-09-12T00:55:15.890 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.892+0000 7f5aaa240800 20 add_watcher() i=7 2024-09-12T00:55:15.890 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.892+0000 7f5aaa240800 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:15.892 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.893+0000 7f595dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:15.892 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.894+0000 7f5aaa240800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:15.892 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.894+0000 7f5aaa240800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:15.892 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.894+0000 7f5aaa240800 5 note: GC not initialized 2024-09-12T00:55:15.894 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.894+0000 7f595cfe1640 20 reqs_thread_entry: start 2024-09-12T00:55:15.894 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.894+0000 7f5aaa240800 20 init_complete bucket index max shards: 1 2024-09-12T00:55:15.894 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.894+0000 7f5aaa240800 20 Filter name: none 2024-09-12T00:55:15.894 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.894+0000 7f58d67fc640 20 reqs_thread_entry: start 2024-09-12T00:55:15.895 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.894+0000 7f5aaa240800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:55:15.895 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.894+0000 7f5aaa240800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.895 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.895+0000 7f5aaa240800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:55:15.895 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.895+0000 7f5aaa240800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:55:15.895 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.895+0000 7f5aaa240800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:55:15.895 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.895+0000 7f5aaa240800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 : miss 2024-09-12T00:55:15.895 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.895+0000 7f5aaa240800 20 rados->read ofs=0 len=0 2024-09-12T00:55:15.895 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.895+0000 7f5aaa240800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:55:15.895 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.895+0000 7f5aaa240800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:55:15.895 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.895+0000 7f5aaa240800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:55:15.895 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.895+0000 7f5aaa240800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:55:15.895 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.895+0000 7f5aaa240800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:55:15.896 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.895+0000 7f5aaa240800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 2024-09-12T00:55:15.896 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.895+0000 7f5aaa240800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.0 2024-09-12T00:55:15.896 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.895+0000 7f5aaa240800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.0 2024-09-12T00:55:15.896 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.896+0000 7f5aaa240800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.1 2024-09-12T00:55:15.896 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.896+0000 7f5aaa240800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.1 2024-09-12T00:55:15.896 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.896+0000 7f5aaa240800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.2 2024-09-12T00:55:15.897 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.896+0000 7f5aaa240800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.2 2024-09-12T00:55:15.897 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.897+0000 7f595dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:15.900 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.899+0000 7f5aaa240800 20 remove_watcher() i=0 2024-09-12T00:55:15.900 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.899+0000 7f5aaa240800 2 removed watcher, disabling cache 2024-09-12T00:55:15.901 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.901+0000 7f5aaa240800 20 remove_watcher() i=1 2024-09-12T00:55:15.901 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.902+0000 7f5aaa240800 20 remove_watcher() i=2 2024-09-12T00:55:15.902 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.903+0000 7f5aaa240800 20 remove_watcher() i=3 2024-09-12T00:55:15.903 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.904+0000 7f5aaa240800 20 remove_watcher() i=4 2024-09-12T00:55:15.904 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.905+0000 7f5aaa240800 20 remove_watcher() i=5 2024-09-12T00:55:15.905 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.906+0000 7f5aaa240800 20 remove_watcher() i=6 2024-09-12T00:55:15.906 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:15.907+0000 7f5aaa240800 20 remove_watcher() i=7 2024-09-12T00:55:45.926 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin reshardlog purge --bucket a-bucket 2024-09-12T00:55:45.956 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:45.957 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:45.998 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:45.999+0000 7fca7080e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:46.000 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.001+0000 7fca7080e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:46.000 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.001+0000 7fca7080e800 20 realm 2024-09-12T00:55:46.000 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.001+0000 7fca7080e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:46.000 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.001+0000 7fca7080e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:46.000 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.001+0000 7fca7080e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:46.000 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.001+0000 7fca7080e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:46.000 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.001+0000 7fca7080e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:46.000 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.001+0000 7fca7080e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:46.001 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.002+0000 7fca7080e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:46.001 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.002+0000 7fca7080e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:46.002 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.003+0000 7fca7080e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:46.002 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.003+0000 7fca7080e800 20 searching for the correct realm 2024-09-12T00:55:46.004 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.006+0000 7fca6c65a640 0 -- 172.21.15.73:0/490366649 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fca54068cc0 msgr2=0x7fca54039450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:46.212 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.213+0000 7fca6c65a640 0 -- 172.21.15.73:0/490366649 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fca54068cc0 msgr2=0x7fca54039450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:46.216 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.217+0000 7fca7080e800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:55:46.216 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.217+0000 7fca7080e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:46.216 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.217+0000 7fca7080e800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:55:46.216 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.217+0000 7fca7080e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:46.216 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.217+0000 7fca7080e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:46.217 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.217+0000 7fca7080e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:46.217 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.217+0000 7fca7080e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:46.217 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.217+0000 7fca7080e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:46.217 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.217+0000 7fca7080e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:46.218 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.218+0000 7fca7080e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:46.218 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.218+0000 7fca7080e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:46.218 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.218+0000 7fca7080e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:46.219 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.218+0000 7fca7080e800 20 zone default found 2024-09-12T00:55:46.219 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.218+0000 7fca7080e800 4 Realm: () 2024-09-12T00:55:46.219 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.218+0000 7fca7080e800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:55:46.219 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.218+0000 7fca7080e800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:55:46.219 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.218+0000 7fca7080e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:46.219 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.218+0000 7fca7080e800 20 zonegroup default 2024-09-12T00:55:46.219 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.218+0000 7fca7080e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:46.219 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.219+0000 7fca7080e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:46.219 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.219+0000 7fca7080e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:46.219 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.219+0000 7fca7080e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:46.219 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.219+0000 7fca7080e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:46.219 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.219+0000 7fca7080e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:46.219 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.219+0000 7fca7080e800 20 started sync module instance, tier type = 2024-09-12T00:55:46.220 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.219+0000 7fca7080e800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:55:46.228 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.229+0000 7fca7080e800 20 add_watcher() i=0 2024-09-12T00:55:46.228 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.229+0000 7fca7080e800 20 add_watcher() i=1 2024-09-12T00:55:46.228 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.229+0000 7fca7080e800 20 add_watcher() i=2 2024-09-12T00:55:46.228 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.229+0000 7fca7080e800 20 add_watcher() i=3 2024-09-12T00:55:46.228 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.229+0000 7fca7080e800 20 add_watcher() i=4 2024-09-12T00:55:46.228 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.229+0000 7fca7080e800 20 add_watcher() i=5 2024-09-12T00:55:46.228 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.229+0000 7fca7080e800 20 add_watcher() i=6 2024-09-12T00:55:46.229 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.230+0000 7fca7080e800 20 add_watcher() i=7 2024-09-12T00:55:46.229 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.230+0000 7fca7080e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:46.230 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.232+0000 7fc9227e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:46.231 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.232+0000 7fca7080e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:46.231 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.232+0000 7fca7080e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:46.232 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.232+0000 7fca7080e800 5 note: GC not initialized 2024-09-12T00:55:46.232 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.232+0000 7fc9217e2640 20 reqs_thread_entry: start 2024-09-12T00:55:46.232 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.233+0000 7fca7080e800 20 init_complete bucket index max shards: 1 2024-09-12T00:55:46.232 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.233+0000 7fca7080e800 20 Filter name: none 2024-09-12T00:55:46.232 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.233+0000 7fc91a7fc640 20 reqs_thread_entry: start 2024-09-12T00:55:46.232 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.233+0000 7fca7080e800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:55:46.232 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.233+0000 7fca7080e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:46.233 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.233+0000 7fca7080e800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:55:46.233 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.233+0000 7fca7080e800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:55:46.233 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.233+0000 7fca7080e800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:55:46.233 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.233+0000 7fca7080e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 : miss 2024-09-12T00:55:46.233 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.233+0000 7fca7080e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:46.233 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.234+0000 7fca7080e800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:55:46.233 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.234+0000 7fca7080e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:55:46.233 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.234+0000 7fca7080e800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:55:46.234 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.234+0000 7fca7080e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:55:46.234 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.234+0000 7fca7080e800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:55:46.234 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.234+0000 7fca7080e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 2024-09-12T00:55:46.236 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.237+0000 7fc9227e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:46.238 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.239+0000 7fca7080e800 20 remove_watcher() i=0 2024-09-12T00:55:46.238 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.239+0000 7fca7080e800 2 removed watcher, disabling cache 2024-09-12T00:55:46.239 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.240+0000 7fca7080e800 20 remove_watcher() i=1 2024-09-12T00:55:46.240 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.242+0000 7fca7080e800 20 remove_watcher() i=2 2024-09-12T00:55:46.241 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.243+0000 7fca7080e800 20 remove_watcher() i=3 2024-09-12T00:55:46.242 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.244+0000 7fca7080e800 20 remove_watcher() i=4 2024-09-12T00:55:46.243 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.245+0000 7fca7080e800 20 remove_watcher() i=5 2024-09-12T00:55:46.244 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.246+0000 7fca7080e800 20 remove_watcher() i=6 2024-09-12T00:55:46.245 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.247+0000 7fca7080e800 20 remove_watcher() i=7 2024-09-12T00:55:46.258 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:55:46.287 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:46.287 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:46.324 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.325+0000 7fafc973a800 20 rados->read ofs=0 len=0 2024-09-12T00:55:46.326 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.327+0000 7fafc973a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:46.326 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.327+0000 7fafc973a800 20 realm 2024-09-12T00:55:46.326 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.327+0000 7fafc973a800 20 rados->read ofs=0 len=0 2024-09-12T00:55:46.326 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.327+0000 7fafc973a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:46.326 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.327+0000 7fafc973a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:46.326 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.327+0000 7fafc973a800 20 rados->read ofs=0 len=0 2024-09-12T00:55:46.326 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.327+0000 7fafc973a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:46.326 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.327+0000 7fafc973a800 20 rados->read ofs=0 len=0 2024-09-12T00:55:46.327 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.328+0000 7fafc973a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:46.327 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.328+0000 7fafc973a800 20 rados->read ofs=0 len=0 2024-09-12T00:55:46.327 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.329+0000 7fafc973a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:46.327 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.329+0000 7fafc973a800 20 searching for the correct realm 2024-09-12T00:55:46.330 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.331+0000 7fafc5c82640 0 -- 172.21.15.73:0/4225271199 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fafb003c040 msgr2=0x7fafb003c420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:55:46.537 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.538+0000 7fafc5c82640 0 -- 172.21.15.73:0/4225271199 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fafb003c040 msgr2=0x7fafb003c420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:46.541 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.542+0000 7fafc973a800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:55:46.541 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.542+0000 7fafc973a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:46.541 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.542+0000 7fafc973a800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:55:46.541 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.542+0000 7fafc973a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:46.541 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.542+0000 7fafc973a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:46.541 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.542+0000 7fafc973a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:46.541 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.542+0000 7fafc973a800 20 rados->read ofs=0 len=0 2024-09-12T00:55:46.541 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.542+0000 7fafc973a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:46.542 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.542+0000 7fafc973a800 20 rados->read ofs=0 len=0 2024-09-12T00:55:46.542 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.542+0000 7fafc973a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:46.542 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.542+0000 7fafc973a800 20 rados->read ofs=0 len=0 2024-09-12T00:55:46.543 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.543+0000 7fafc973a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:46.543 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.543+0000 7fafc973a800 20 zone default found 2024-09-12T00:55:46.543 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.543+0000 7fafc973a800 4 Realm: () 2024-09-12T00:55:46.543 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.543+0000 7fafc973a800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:55:46.543 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.543+0000 7fafc973a800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:55:46.543 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.543+0000 7fafc973a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:46.544 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.543+0000 7fafc973a800 20 zonegroup default 2024-09-12T00:55:46.544 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.543+0000 7fafc973a800 20 rados->read ofs=0 len=0 2024-09-12T00:55:46.544 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.543+0000 7fafc973a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:46.544 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.543+0000 7fafc973a800 20 rados->read ofs=0 len=0 2024-09-12T00:55:46.544 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.543+0000 7fafc973a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:46.544 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.543+0000 7fafc973a800 20 rados->read ofs=0 len=0 2024-09-12T00:55:46.544 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.544+0000 7fafc973a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:46.544 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.544+0000 7fafc973a800 20 started sync module instance, tier type = 2024-09-12T00:55:46.544 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.544+0000 7fafc973a800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:55:46.552 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.553+0000 7fafc973a800 20 add_watcher() i=0 2024-09-12T00:55:46.552 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.553+0000 7fafc973a800 20 add_watcher() i=1 2024-09-12T00:55:46.552 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.553+0000 7fafc973a800 20 add_watcher() i=2 2024-09-12T00:55:46.552 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.553+0000 7fafc973a800 20 add_watcher() i=3 2024-09-12T00:55:46.553 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.553+0000 7fafc973a800 20 add_watcher() i=4 2024-09-12T00:55:46.553 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.553+0000 7fafc973a800 20 add_watcher() i=5 2024-09-12T00:55:46.553 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.553+0000 7fafc973a800 20 add_watcher() i=6 2024-09-12T00:55:46.553 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.554+0000 7fafc973a800 20 add_watcher() i=7 2024-09-12T00:55:46.553 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.554+0000 7fafc973a800 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:46.555 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.556+0000 7fae7bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:46.556 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.557+0000 7fafc973a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:46.556 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.557+0000 7fafc973a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:46.556 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.557+0000 7fafc973a800 5 note: GC not initialized 2024-09-12T00:55:46.556 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.557+0000 7fae7afe5640 20 reqs_thread_entry: start 2024-09-12T00:55:46.556 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.557+0000 7fafc973a800 20 init_complete bucket index max shards: 1 2024-09-12T00:55:46.556 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.557+0000 7fafc973a800 20 Filter name: none 2024-09-12T00:55:46.556 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.557+0000 7fae78fe1640 20 reqs_thread_entry: start 2024-09-12T00:55:46.556 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.557+0000 7fafc973a800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:55:46.556 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.557+0000 7fafc973a800 20 rados->read ofs=0 len=0 2024-09-12T00:55:46.557 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.558+0000 7fafc973a800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:55:46.558 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.558+0000 7fafc973a800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:55:46.558 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.558+0000 7fafc973a800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:55:46.558 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.558+0000 7fafc973a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 : miss 2024-09-12T00:55:46.558 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.558+0000 7fafc973a800 20 rados->read ofs=0 len=0 2024-09-12T00:55:46.558 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.558+0000 7fafc973a800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:55:46.558 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.558+0000 7fafc973a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:55:46.558 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.558+0000 7fafc973a800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:55:46.558 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.558+0000 7fafc973a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:55:46.558 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.558+0000 7fafc973a800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:55:46.558 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.558+0000 7fafc973a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 2024-09-12T00:55:46.558 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.558+0000 7fafc973a800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.0 2024-09-12T00:55:46.558 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.558+0000 7fafc973a800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.0 2024-09-12T00:55:46.558 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.559+0000 7fafc973a800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.1 2024-09-12T00:55:46.558 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.559+0000 7fafc973a800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.1 2024-09-12T00:55:46.559 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.559+0000 7fafc973a800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.2 2024-09-12T00:55:46.559 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.559+0000 7fafc973a800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.2 2024-09-12T00:55:46.559 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.560+0000 7fae7bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:46.561 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.562+0000 7fafc973a800 20 remove_watcher() i=0 2024-09-12T00:55:46.561 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.562+0000 7fafc973a800 2 removed watcher, disabling cache 2024-09-12T00:55:46.562 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.563+0000 7fafc973a800 20 remove_watcher() i=1 2024-09-12T00:55:46.563 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.564+0000 7fafc973a800 20 remove_watcher() i=2 2024-09-12T00:55:46.564 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.565+0000 7fafc973a800 20 remove_watcher() i=3 2024-09-12T00:55:46.565 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.566+0000 7fafc973a800 20 remove_watcher() i=4 2024-09-12T00:55:46.566 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.567+0000 7fafc973a800 20 remove_watcher() i=5 2024-09-12T00:55:46.567 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.568+0000 7fafc973a800 20 remove_watcher() i=6 2024-09-12T00:55:46.568 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.569+0000 7fafc973a800 20 remove_watcher() i=7 2024-09-12T00:55:46.579 INFO:tasks.workunit.client.0.smithi073.stderr:check reshard logrecord successfully 2024-09-12T00:55:46.579 INFO:tasks.workunit.client.0.smithi073.stderr: test: reshard versioned bucket 2024-09-12T00:55:46.580 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T00:55:46.609 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:46.609 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:46.646 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.647+0000 7f86a133a800 20 rados->read ofs=0 len=0 2024-09-12T00:55:46.648 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.649+0000 7f86a133a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:46.648 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.649+0000 7f86a133a800 20 realm 2024-09-12T00:55:46.648 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.649+0000 7f86a133a800 20 rados->read ofs=0 len=0 2024-09-12T00:55:46.648 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.649+0000 7f86a133a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:46.648 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.649+0000 7f86a133a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:46.648 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.649+0000 7f86a133a800 20 rados->read ofs=0 len=0 2024-09-12T00:55:46.648 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.649+0000 7f86a133a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:46.648 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.649+0000 7f86a133a800 20 rados->read ofs=0 len=0 2024-09-12T00:55:46.649 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.650+0000 7f86a133a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:46.649 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.650+0000 7f86a133a800 20 rados->read ofs=0 len=0 2024-09-12T00:55:46.649 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.651+0000 7f86a133a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:46.650 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.651+0000 7f86a133a800 20 searching for the correct realm 2024-09-12T00:55:46.652 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.653+0000 7f869d882640 0 -- 172.21.15.73:0/1227983648 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f868802f060 msgr2=0x7f8688066990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:46.656 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.658+0000 7f869d882640 0 -- 172.21.15.73:0/1227983648 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f8568086310 msgr2=0x7f8568088740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:46.660 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.661+0000 7f86a133a800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:55:46.660 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.661+0000 7f86a133a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:46.660 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.661+0000 7f86a133a800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:55:46.660 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.661+0000 7f86a133a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:46.660 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.661+0000 7f86a133a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:46.661 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.661+0000 7f86a133a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:46.661 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.661+0000 7f86a133a800 20 rados->read ofs=0 len=0 2024-09-12T00:55:46.661 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.661+0000 7f86a133a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:46.661 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.661+0000 7f86a133a800 20 rados->read ofs=0 len=0 2024-09-12T00:55:46.661 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.662+0000 7f86a133a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:46.661 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.662+0000 7f86a133a800 20 rados->read ofs=0 len=0 2024-09-12T00:55:46.662 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.662+0000 7f86a133a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:46.662 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.662+0000 7f86a133a800 20 zone default found 2024-09-12T00:55:46.662 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.662+0000 7f86a133a800 4 Realm: () 2024-09-12T00:55:46.662 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.662+0000 7f86a133a800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:55:46.662 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.662+0000 7f86a133a800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:55:46.662 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.662+0000 7f86a133a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:46.662 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.662+0000 7f86a133a800 20 zonegroup default 2024-09-12T00:55:46.663 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.662+0000 7f86a133a800 20 rados->read ofs=0 len=0 2024-09-12T00:55:46.663 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.662+0000 7f86a133a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:46.663 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.662+0000 7f86a133a800 20 rados->read ofs=0 len=0 2024-09-12T00:55:46.663 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.662+0000 7f86a133a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:46.663 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.662+0000 7f86a133a800 20 rados->read ofs=0 len=0 2024-09-12T00:55:46.663 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.663+0000 7f86a133a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:46.663 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.663+0000 7f86a133a800 20 started sync module instance, tier type = 2024-09-12T00:55:46.663 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.663+0000 7f86a133a800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:55:46.670 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.671+0000 7f86a133a800 20 add_watcher() i=0 2024-09-12T00:55:46.670 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.671+0000 7f86a133a800 20 add_watcher() i=1 2024-09-12T00:55:46.670 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.671+0000 7f86a133a800 20 add_watcher() i=2 2024-09-12T00:55:46.670 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.671+0000 7f86a133a800 20 add_watcher() i=3 2024-09-12T00:55:46.671 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.671+0000 7f86a133a800 20 add_watcher() i=4 2024-09-12T00:55:46.671 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.671+0000 7f86a133a800 20 add_watcher() i=5 2024-09-12T00:55:46.671 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.671+0000 7f86a133a800 20 add_watcher() i=6 2024-09-12T00:55:46.671 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.672+0000 7f86a133a800 20 add_watcher() i=7 2024-09-12T00:55:46.671 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.672+0000 7f86a133a800 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:46.674 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.674+0000 7f8553fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:46.674 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.674+0000 7f86a133a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:46.674 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.674+0000 7f86a133a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:46.674 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.674+0000 7f86a133a800 5 note: GC not initialized 2024-09-12T00:55:46.674 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.674+0000 7f8552fe5640 20 reqs_thread_entry: start 2024-09-12T00:55:46.674 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.674+0000 7f86a133a800 20 init_complete bucket index max shards: 1 2024-09-12T00:55:46.674 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.674+0000 7f86a133a800 20 Filter name: none 2024-09-12T00:55:46.675 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.675+0000 7f8550fe1640 20 reqs_thread_entry: start 2024-09-12T00:55:46.675 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.675+0000 7f86a133a800 20 rados->read ofs=0 len=0 2024-09-12T00:55:46.675 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.675+0000 7f86a133a800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:55:46.675 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.675+0000 7f86a133a800 20 rados->read ofs=0 len=0 2024-09-12T00:55:46.676 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.676+0000 7f86a133a800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:55:46.676 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.676+0000 7f86a133a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:46.676 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.676+0000 7f86a133a800 20 rados->read ofs=0 len=0 2024-09-12T00:55:46.676 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.676+0000 7f86a133a800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:55:46.676 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.676+0000 7f86a133a800 20 rados->read ofs=0 len=0 2024-09-12T00:55:46.676 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.676+0000 7f86a133a800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:55:46.677 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.676+0000 7f86a133a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:46.677 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.677+0000 7f8553fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:46.678 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.680+0000 7f86a133a800 20 remove_watcher() i=0 2024-09-12T00:55:46.678 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.680+0000 7f86a133a800 2 removed watcher, disabling cache 2024-09-12T00:55:46.679 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.681+0000 7f86a133a800 20 remove_watcher() i=1 2024-09-12T00:55:46.681 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.682+0000 7f86a133a800 20 remove_watcher() i=2 2024-09-12T00:55:46.681 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.683+0000 7f86a133a800 20 remove_watcher() i=3 2024-09-12T00:55:46.682 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.684+0000 7f86a133a800 20 remove_watcher() i=4 2024-09-12T00:55:46.683 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.685+0000 7f86a133a800 20 remove_watcher() i=5 2024-09-12T00:55:46.684 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.686+0000 7f86a133a800 20 remove_watcher() i=6 2024-09-12T00:55:46.685 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.687+0000 7f86a133a800 20 remove_watcher() i=7 2024-09-12T00:55:46.695 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:55:46.696 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:55:46.696 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: myver id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 num_objects: 0 size_kb: 0 num_shards: 1 2024-09-12T00:55:46.696 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:55:46.697 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 2 2024-09-12T00:55:46.727 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:46.727 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:46.764 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.766+0000 7f875392c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:46.766 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.767+0000 7f875392c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:46.766 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.767+0000 7f875392c800 20 realm 2024-09-12T00:55:46.766 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.767+0000 7f875392c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:46.767 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.767+0000 7f875392c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:46.767 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.767+0000 7f875392c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:46.767 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.767+0000 7f875392c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:46.767 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.767+0000 7f875392c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:46.767 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.767+0000 7f875392c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:46.969 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.970+0000 7f875392c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:46.969 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.970+0000 7f875392c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:46.969 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.971+0000 7f875392c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:46.970 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.971+0000 7f875392c800 20 searching for the correct realm 2024-09-12T00:55:46.972 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:46.974+0000 7f874fd3f640 0 -- 172.21.15.73:0/1020672466 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f873803bb10 msgr2=0x7f8738017970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:47.179 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.181+0000 7f874fd3f640 0 -- 172.21.15.73:0/1020672466 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f873803bb10 msgr2=0x7f8738017970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:47.184 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.185+0000 7f875392c800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:55:47.184 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.185+0000 7f875392c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:47.184 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.185+0000 7f875392c800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:55:47.184 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.185+0000 7f875392c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:47.184 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.185+0000 7f875392c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:47.184 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.185+0000 7f875392c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:47.184 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.185+0000 7f875392c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:47.184 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.185+0000 7f875392c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:47.185 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.185+0000 7f875392c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:47.185 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.185+0000 7f875392c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:47.185 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.185+0000 7f875392c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:47.186 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.186+0000 7f875392c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:47.186 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.186+0000 7f875392c800 20 zone default found 2024-09-12T00:55:47.186 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.186+0000 7f875392c800 4 Realm: () 2024-09-12T00:55:47.186 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.186+0000 7f875392c800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:55:47.186 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.186+0000 7f875392c800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:55:47.186 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.186+0000 7f875392c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:47.186 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.186+0000 7f875392c800 20 zonegroup default 2024-09-12T00:55:47.186 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.186+0000 7f875392c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:47.186 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.186+0000 7f875392c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:47.186 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.186+0000 7f875392c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:47.186 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.186+0000 7f875392c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:47.186 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.186+0000 7f875392c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:47.186 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.187+0000 7f875392c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:47.187 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.187+0000 7f875392c800 20 started sync module instance, tier type = 2024-09-12T00:55:47.187 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.187+0000 7f875392c800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:55:47.195 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.196+0000 7f875392c800 20 add_watcher() i=0 2024-09-12T00:55:47.195 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.196+0000 7f875392c800 20 add_watcher() i=1 2024-09-12T00:55:47.195 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.196+0000 7f875392c800 20 add_watcher() i=2 2024-09-12T00:55:47.196 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.196+0000 7f875392c800 20 add_watcher() i=3 2024-09-12T00:55:47.196 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.196+0000 7f875392c800 20 add_watcher() i=4 2024-09-12T00:55:47.196 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.196+0000 7f875392c800 20 add_watcher() i=5 2024-09-12T00:55:47.196 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.196+0000 7f875392c800 20 add_watcher() i=6 2024-09-12T00:55:47.196 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.197+0000 7f875392c800 20 add_watcher() i=7 2024-09-12T00:55:47.196 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.197+0000 7f875392c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:47.198 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.200+0000 7f8605fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:47.199 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.200+0000 7f875392c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:47.199 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.200+0000 7f875392c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:47.199 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.200+0000 7f875392c800 5 note: GC not initialized 2024-09-12T00:55:47.199 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.200+0000 7f8604fe1640 20 reqs_thread_entry: start 2024-09-12T00:55:47.199 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.200+0000 7f875392c800 20 init_complete bucket index max shards: 1 2024-09-12T00:55:47.199 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.200+0000 7f875392c800 20 Filter name: none 2024-09-12T00:55:47.200 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.200+0000 7f857e7fc640 20 reqs_thread_entry: start 2024-09-12T00:55:47.200 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.200+0000 7f875392c800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T00:55:47.200 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.200+0000 7f875392c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:47.201 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.201+0000 7f875392c800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:55:47.201 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.201+0000 7f875392c800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T00:55:47.201 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.201+0000 7f875392c800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T00:55:47.201 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.201+0000 7f875392c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 : miss 2024-09-12T00:55:47.201 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.201+0000 7f875392c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:47.201 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.201+0000 7f875392c800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:55:47.201 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.201+0000 7f875392c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 info.flags=0x17 2024-09-12T00:55:47.201 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.201+0000 7f875392c800 10 adding default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 to cache LRU end 2024-09-12T00:55:47.201 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.201+0000 7f875392c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:55:47.201 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.201+0000 7f875392c800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:55:47.201 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.201+0000 7f875392c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 2024-09-12T00:55:47.205 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.206+0000 7f875392c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 info.flags=0x17 2024-09-12T00:55:47.205 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.206+0000 7f875392c800 10 moving default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 to cache LRU end 2024-09-12T00:55:47.205 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.206+0000 7f875392c800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:55:47.205 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.206+0000 7f875392c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18, ofs0, ns] 2024-09-12T00:55:47.205 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.206+0000 7f8632ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497049 cookie 94436198780944 notifier 8493 bl.length()=821 2024-09-12T00:55:47.205 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.206+0000 7f8632ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 info.flags=0x17 2024-09-12T00:55:47.205 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.206+0000 7f8632ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 to cache LRU end 2024-09-12T00:55:47.205 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.206+0000 7f8632ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:55:47.206 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.208+0000 7f875392c800 20 handle_bi_update(): bucket=:myver[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18]): orig_sources= new_sources= 2024-09-12T00:55:47.206 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.208+0000 7f875392c800 20 handle_bi_update(): bucket=:myver[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18]): potential sources added=[] removed=[] 2024-09-12T00:55:47.207 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.208+0000 7f875392c800 20 handle_bi_update(): bucket=:myver[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18]): orig_dests= new_dests= 2024-09-12T00:55:47.207 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.208+0000 7f875392c800 20 handle_bi_update(): bucket=:myver[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18]): potential dests added=[] removed=[] 2024-09-12T00:55:47.210 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.210+0000 7f875392c800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.1.0 2024-09-12T00:55:47.210 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.210+0000 7f875392c800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.1.0 2024-09-12T00:55:47.211 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.210+0000 7f875392c800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.1.1 2024-09-12T00:55:47.211 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.210+0000 7f875392c800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.1.1 2024-09-12T00:55:47.211 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.210+0000 7f875392c800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.0 2024-09-12T00:55:47.211 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.210+0000 7f875392c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:55:47.211 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.210+0000 7f875392c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 2024-09-12T00:55:47.212 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.212+0000 7f875392c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 info.flags=0x17 2024-09-12T00:55:47.212 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.212+0000 7f875392c800 10 moving default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 to cache LRU end 2024-09-12T00:55:47.212 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.212+0000 7f875392c800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:55:47.212 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.212+0000 7f875392c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18, ofs0, ns] 2024-09-12T00:55:47.212 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.212+0000 7f8632ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497050 cookie 94436198780944 notifier 8493 bl.length()=821 2024-09-12T00:55:47.212 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.212+0000 7f8632ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 info.flags=0x17 2024-09-12T00:55:47.212 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.212+0000 7f8632ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 to cache LRU end 2024-09-12T00:55:47.212 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.212+0000 7f8632ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:55:47.213 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.213+0000 7f875392c800 20 handle_bi_update(): bucket=:myver[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18]): orig_sources= new_sources= 2024-09-12T00:55:47.213 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.213+0000 7f875392c800 20 handle_bi_update(): bucket=:myver[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18]): potential sources added=[] removed=[] 2024-09-12T00:55:47.213 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.213+0000 7f875392c800 20 handle_bi_update(): bucket=:myver[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18]): orig_dests= new_dests= 2024-09-12T00:55:47.213 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.213+0000 7f875392c800 20 handle_bi_update(): bucket=:myver[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18]): potential dests added=[] removed=[] 2024-09-12T00:55:47.213 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.214+0000 7f875392c800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.0 2024-09-12T00:55:47.213 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.214+0000 7f875392c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:55:47.214 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.214+0000 7f875392c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 2024-09-12T00:55:47.214 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.216+0000 7f875392c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 info.flags=0x17 2024-09-12T00:55:47.214 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.216+0000 7f875392c800 10 moving default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 to cache LRU end 2024-09-12T00:55:47.215 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.216+0000 7f875392c800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:55:47.215 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.216+0000 7f875392c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18, ofs0, ns] 2024-09-12T00:55:47.215 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.216+0000 7f8632ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497051 cookie 94436198780944 notifier 8493 bl.length()=789 2024-09-12T00:55:47.215 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.216+0000 7f8632ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 info.flags=0x17 2024-09-12T00:55:47.215 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.216+0000 7f8632ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 to cache LRU end 2024-09-12T00:55:47.215 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.216+0000 7f8632ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:55:47.216 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.217+0000 7f875392c800 20 handle_bi_update(): bucket=:myver[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18]): orig_sources= new_sources= 2024-09-12T00:55:47.216 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.217+0000 7f875392c800 20 handle_bi_update(): bucket=:myver[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18]): potential sources added=[] removed=[] 2024-09-12T00:55:47.216 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.217+0000 7f875392c800 20 handle_bi_update(): bucket=:myver[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18]): orig_dests= new_dests= 2024-09-12T00:55:47.216 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.217+0000 7f875392c800 20 handle_bi_update(): bucket=:myver[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18]): potential dests added=[] removed=[] 2024-09-12T00:55:47.217 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.218+0000 7f875392c800 1 execute INFO: reshard of bucket "myver" from 1 shards to 2 shards completed successfully 2024-09-12T00:55:47.219 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.220+0000 7f8605fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:47.221 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.223+0000 7f875392c800 20 remove_watcher() i=0 2024-09-12T00:55:47.221 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.223+0000 7f875392c800 2 removed watcher, disabling cache 2024-09-12T00:55:47.225 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.224+0000 7f875392c800 20 remove_watcher() i=1 2024-09-12T00:55:47.225 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.225+0000 7f875392c800 20 remove_watcher() i=2 2024-09-12T00:55:47.225 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.226+0000 7f875392c800 20 remove_watcher() i=3 2024-09-12T00:55:47.226 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.227+0000 7f875392c800 20 remove_watcher() i=4 2024-09-12T00:55:47.228 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.228+0000 7f875392c800 20 remove_watcher() i=5 2024-09-12T00:55:47.228 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.229+0000 7f875392c800 20 remove_watcher() i=6 2024-09-12T00:55:47.229 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.230+0000 7f875392c800 20 remove_watcher() i=7 2024-09-12T00:55:47.242 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T00:55:47.270 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:47.270 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:47.307 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.308+0000 7f2980926800 20 rados->read ofs=0 len=0 2024-09-12T00:55:47.309 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.310+0000 7f2980926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:47.309 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.310+0000 7f2980926800 20 realm 2024-09-12T00:55:47.309 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.310+0000 7f2980926800 20 rados->read ofs=0 len=0 2024-09-12T00:55:47.309 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.310+0000 7f2980926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:47.309 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.310+0000 7f2980926800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:47.309 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.310+0000 7f2980926800 20 rados->read ofs=0 len=0 2024-09-12T00:55:47.309 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.310+0000 7f2980926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:47.310 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.310+0000 7f2980926800 20 rados->read ofs=0 len=0 2024-09-12T00:55:47.310 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.311+0000 7f2980926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:47.310 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.311+0000 7f2980926800 20 rados->read ofs=0 len=0 2024-09-12T00:55:47.310 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.312+0000 7f2980926800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:47.311 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.312+0000 7f2980926800 20 searching for the correct realm 2024-09-12T00:55:47.313 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.314+0000 7f297cd0a640 0 -- 172.21.15.73:0/3834310761 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f296405f950 msgr2=0x7f2964086a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:47.520 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.521+0000 7f297cd0a640 0 -- 172.21.15.73:0/3834310761 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f296405f950 msgr2=0x7f2964086a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:47.568 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.525+0000 7f2980926800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:55:47.568 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.525+0000 7f2980926800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:47.568 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.525+0000 7f2980926800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:55:47.568 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.525+0000 7f2980926800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:47.568 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.525+0000 7f2980926800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:47.568 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.525+0000 7f2980926800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:47.568 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.525+0000 7f2980926800 20 rados->read ofs=0 len=0 2024-09-12T00:55:47.568 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.525+0000 7f2980926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:47.568 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.525+0000 7f2980926800 20 rados->read ofs=0 len=0 2024-09-12T00:55:47.568 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.525+0000 7f2980926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:47.568 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.525+0000 7f2980926800 20 rados->read ofs=0 len=0 2024-09-12T00:55:47.569 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.526+0000 7f2980926800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:47.569 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.526+0000 7f2980926800 20 zone default found 2024-09-12T00:55:47.569 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.526+0000 7f2980926800 4 Realm: () 2024-09-12T00:55:47.569 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.526+0000 7f2980926800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:55:47.569 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.526+0000 7f2980926800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:55:47.569 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.526+0000 7f2980926800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:47.569 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.526+0000 7f2980926800 20 zonegroup default 2024-09-12T00:55:47.569 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.526+0000 7f2980926800 20 rados->read ofs=0 len=0 2024-09-12T00:55:47.569 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.526+0000 7f2980926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:47.569 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.526+0000 7f2980926800 20 rados->read ofs=0 len=0 2024-09-12T00:55:47.569 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.526+0000 7f2980926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:47.569 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.526+0000 7f2980926800 20 rados->read ofs=0 len=0 2024-09-12T00:55:47.570 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.527+0000 7f2980926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:47.570 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.527+0000 7f2980926800 20 started sync module instance, tier type = 2024-09-12T00:55:47.570 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.527+0000 7f2980926800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:55:47.570 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.536+0000 7f2980926800 20 add_watcher() i=0 2024-09-12T00:55:47.570 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.536+0000 7f2980926800 20 add_watcher() i=1 2024-09-12T00:55:47.570 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.536+0000 7f2980926800 20 add_watcher() i=2 2024-09-12T00:55:47.570 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.536+0000 7f2980926800 20 add_watcher() i=3 2024-09-12T00:55:47.570 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.536+0000 7f2980926800 20 add_watcher() i=4 2024-09-12T00:55:47.570 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.536+0000 7f2980926800 20 add_watcher() i=5 2024-09-12T00:55:47.570 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.536+0000 7f2980926800 20 add_watcher() i=6 2024-09-12T00:55:47.570 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.537+0000 7f2980926800 20 add_watcher() i=7 2024-09-12T00:55:47.570 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.537+0000 7f2980926800 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:47.570 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.538+0000 7f2832fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:47.570 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.539+0000 7f2980926800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:47.571 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.539+0000 7f2980926800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:47.571 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.539+0000 7f2980926800 5 note: GC not initialized 2024-09-12T00:55:47.571 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.539+0000 7f2831fe3640 20 reqs_thread_entry: start 2024-09-12T00:55:47.571 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.539+0000 7f2980926800 20 init_complete bucket index max shards: 1 2024-09-12T00:55:47.571 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.539+0000 7f2980926800 20 Filter name: none 2024-09-12T00:55:47.571 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.539+0000 7f282b7fe640 20 reqs_thread_entry: start 2024-09-12T00:55:47.571 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.539+0000 7f2980926800 20 rados->read ofs=0 len=0 2024-09-12T00:55:47.571 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.539+0000 7f2980926800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:55:47.571 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.539+0000 7f2980926800 20 rados->read ofs=0 len=0 2024-09-12T00:55:47.571 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.540+0000 7f2980926800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:55:47.571 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.540+0000 7f2980926800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:47.571 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.540+0000 7f2980926800 20 rados->read ofs=0 len=0 2024-09-12T00:55:47.571 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.540+0000 7f2980926800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:55:47.571 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.540+0000 7f2980926800 20 rados->read ofs=0 len=0 2024-09-12T00:55:47.572 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.540+0000 7f2980926800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:55:47.572 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.540+0000 7f2980926800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:47.572 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.542+0000 7f2832fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:47.572 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.544+0000 7f2980926800 20 remove_watcher() i=0 2024-09-12T00:55:47.572 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.544+0000 7f2980926800 2 removed watcher, disabling cache 2024-09-12T00:55:47.572 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.545+0000 7f2980926800 20 remove_watcher() i=1 2024-09-12T00:55:47.572 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.546+0000 7f2980926800 20 remove_watcher() i=2 2024-09-12T00:55:47.572 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.547+0000 7f2980926800 20 remove_watcher() i=3 2024-09-12T00:55:47.572 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.548+0000 7f2980926800 20 remove_watcher() i=4 2024-09-12T00:55:47.572 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.549+0000 7f2980926800 20 remove_watcher() i=5 2024-09-12T00:55:47.572 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.550+0000 7f2980926800 20 remove_watcher() i=6 2024-09-12T00:55:47.572 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.551+0000 7f2980926800 20 remove_watcher() i=7 2024-09-12T00:55:47.572 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:55:47.572 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:55:47.573 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: myver id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 num_objects: 0 size_kb: 0 num_shards: 2 2024-09-12T00:55:47.573 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:55:47.573 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:55:47.573 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:55:47.579 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:55:47.579 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:55:47.637 INFO:tasks.workunit.client.0.smithi073.stderr: test: reshard removes olh entries with empty name 2024-09-12T00:55:47.639 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:55:47.639 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:55:47.710 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:55:47.710 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:55:47.926 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:55:47.954 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:47.954 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:47.990 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.992+0000 7f97c3b26800 20 rados->read ofs=0 len=0 2024-09-12T00:55:47.992 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.994+0000 7f97c3b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:47.992 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.994+0000 7f97c3b26800 20 realm 2024-09-12T00:55:47.993 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.994+0000 7f97c3b26800 20 rados->read ofs=0 len=0 2024-09-12T00:55:47.993 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.994+0000 7f97c3b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:47.993 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.994+0000 7f97c3b26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:47.993 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.994+0000 7f97c3b26800 20 rados->read ofs=0 len=0 2024-09-12T00:55:47.993 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.994+0000 7f97c3b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:47.993 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.994+0000 7f97c3b26800 20 rados->read ofs=0 len=0 2024-09-12T00:55:47.993 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.995+0000 7f97c3b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:47.994 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.995+0000 7f97c3b26800 20 rados->read ofs=0 len=0 2024-09-12T00:55:47.994 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.996+0000 7f97c3b26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:47.994 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.996+0000 7f97c3b26800 20 searching for the correct realm 2024-09-12T00:55:47.996 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:47.998+0000 7f97bff0a640 0 -- 172.21.15.73:0/825381973 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f97b402c070 msgr2=0x7f97b402f590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:48.204 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.205+0000 7f97bff0a640 0 -- 172.21.15.73:0/825381973 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f97b402c070 msgr2=0x7f97b402f590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:48.208 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.209+0000 7f97c3b26800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:55:48.208 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.209+0000 7f97c3b26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:48.208 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.209+0000 7f97c3b26800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:55:48.208 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.209+0000 7f97c3b26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:48.208 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.209+0000 7f97c3b26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:48.208 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.209+0000 7f97c3b26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:48.208 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.209+0000 7f97c3b26800 20 rados->read ofs=0 len=0 2024-09-12T00:55:48.209 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.209+0000 7f97c3b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:48.209 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.209+0000 7f97c3b26800 20 rados->read ofs=0 len=0 2024-09-12T00:55:48.209 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.209+0000 7f97c3b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:48.209 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.209+0000 7f97c3b26800 20 rados->read ofs=0 len=0 2024-09-12T00:55:48.210 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.210+0000 7f97c3b26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:48.210 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.210+0000 7f97c3b26800 20 zone default found 2024-09-12T00:55:48.210 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.210+0000 7f97c3b26800 4 Realm: () 2024-09-12T00:55:48.210 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.210+0000 7f97c3b26800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:55:48.210 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.210+0000 7f97c3b26800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:55:48.210 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.210+0000 7f97c3b26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:48.211 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.210+0000 7f97c3b26800 20 zonegroup default 2024-09-12T00:55:48.211 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.210+0000 7f97c3b26800 20 rados->read ofs=0 len=0 2024-09-12T00:55:48.211 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.210+0000 7f97c3b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:48.211 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.210+0000 7f97c3b26800 20 rados->read ofs=0 len=0 2024-09-12T00:55:48.211 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.210+0000 7f97c3b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:48.211 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.210+0000 7f97c3b26800 20 rados->read ofs=0 len=0 2024-09-12T00:55:48.211 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.211+0000 7f97c3b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:48.211 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.211+0000 7f97c3b26800 20 started sync module instance, tier type = 2024-09-12T00:55:48.211 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.211+0000 7f97c3b26800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:55:48.218 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.220+0000 7f97c3b26800 20 add_watcher() i=0 2024-09-12T00:55:48.218 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.220+0000 7f97c3b26800 20 add_watcher() i=1 2024-09-12T00:55:48.218 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.220+0000 7f97c3b26800 20 add_watcher() i=2 2024-09-12T00:55:48.218 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.220+0000 7f97c3b26800 20 add_watcher() i=3 2024-09-12T00:55:48.219 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.220+0000 7f97c3b26800 20 add_watcher() i=4 2024-09-12T00:55:48.219 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.220+0000 7f97c3b26800 20 add_watcher() i=5 2024-09-12T00:55:48.219 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.220+0000 7f97c3b26800 20 add_watcher() i=6 2024-09-12T00:55:48.219 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.220+0000 7f97c3b26800 20 add_watcher() i=7 2024-09-12T00:55:48.219 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.220+0000 7f97c3b26800 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:48.220 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.222+0000 7f9675fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:48.222 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.222+0000 7f97c3b26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:48.222 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.222+0000 7f97c3b26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:48.222 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.222+0000 7f97c3b26800 5 note: GC not initialized 2024-09-12T00:55:48.222 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.223+0000 7f9674fe1640 20 reqs_thread_entry: start 2024-09-12T00:55:48.222 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.223+0000 7f97c3b26800 20 init_complete bucket index max shards: 1 2024-09-12T00:55:48.222 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.223+0000 7f97c3b26800 20 Filter name: none 2024-09-12T00:55:48.222 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.223+0000 7f95ee7fc640 20 reqs_thread_entry: start 2024-09-12T00:55:48.222 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.223+0000 7f97c3b26800 20 rados->read ofs=0 len=0 2024-09-12T00:55:48.222 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.223+0000 7f97c3b26800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:55:48.222 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.223+0000 7f97c3b26800 20 rados->read ofs=0 len=0 2024-09-12T00:55:48.223 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.224+0000 7f97c3b26800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:55:48.223 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.224+0000 7f97c3b26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:48.224 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.224+0000 7f97c3b26800 20 rados->read ofs=0 len=0 2024-09-12T00:55:48.224 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.224+0000 7f97c3b26800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:55:48.224 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.224+0000 7f97c3b26800 20 rados->read ofs=0 len=0 2024-09-12T00:55:48.224 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.225+0000 7f97c3b26800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:55:48.224 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.225+0000 7f97c3b26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:48.224 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.226+0000 7f9675fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:48.227 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.228+0000 7f97c3b26800 20 remove_watcher() i=0 2024-09-12T00:55:48.227 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.228+0000 7f97c3b26800 2 removed watcher, disabling cache 2024-09-12T00:55:48.227 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.229+0000 7f97c3b26800 20 remove_watcher() i=1 2024-09-12T00:55:48.228 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.230+0000 7f97c3b26800 20 remove_watcher() i=2 2024-09-12T00:55:48.230 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.231+0000 7f97c3b26800 20 remove_watcher() i=3 2024-09-12T00:55:48.230 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.232+0000 7f97c3b26800 20 remove_watcher() i=4 2024-09-12T00:55:48.231 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.233+0000 7f97c3b26800 20 remove_watcher() i=5 2024-09-12T00:55:48.232 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.234+0000 7f97c3b26800 20 remove_watcher() i=6 2024-09-12T00:55:48.233 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.235+0000 7f97c3b26800 20 remove_watcher() i=7 2024-09-12T00:55:48.246 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:55:48.246 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:55:48.246 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: a-bucket id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 num_objects: 0 size_kb: 0 num_shards: 3 2024-09-12T00:55:48.247 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:55:48.247 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket layout --bucket a-bucket 2024-09-12T00:55:48.274 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:48.274 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:48.311 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.313+0000 7f7ac3b24800 20 rados->read ofs=0 len=0 2024-09-12T00:55:48.313 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.314+0000 7f7ac3b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:48.313 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.314+0000 7f7ac3b24800 20 realm 2024-09-12T00:55:48.313 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.314+0000 7f7ac3b24800 20 rados->read ofs=0 len=0 2024-09-12T00:55:48.313 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.314+0000 7f7ac3b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:48.313 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.314+0000 7f7ac3b24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:48.313 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.314+0000 7f7ac3b24800 20 rados->read ofs=0 len=0 2024-09-12T00:55:48.313 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.314+0000 7f7ac3b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:48.313 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.314+0000 7f7ac3b24800 20 rados->read ofs=0 len=0 2024-09-12T00:55:48.314 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.315+0000 7f7ac3b24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:48.314 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.315+0000 7f7ac3b24800 20 rados->read ofs=0 len=0 2024-09-12T00:55:48.314 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.316+0000 7f7ac3b24800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:48.315 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.316+0000 7f7ac3b24800 20 searching for the correct realm 2024-09-12T00:55:48.317 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.319+0000 7f7abf868640 0 -- 172.21.15.73:0/362901614 >> [v2:172.21.15.117:6816/1460498570,v1:172.21.15.117:6817/1460498570] conn(0x7f7ab8033040 msgr2=0x7f7ab800e990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:48.321 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.322+0000 7f7abf868640 0 -- 172.21.15.73:0/362901614 >> [v2:172.21.15.117:6816/1460498570,v1:172.21.15.117:6817/1460498570] conn(0x7f798808a720 msgr2=0x7f798808cb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:48.324 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.325+0000 7f7ac3b24800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:55:48.324 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.325+0000 7f7ac3b24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:48.324 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.325+0000 7f7ac3b24800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:55:48.324 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.325+0000 7f7ac3b24800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:48.324 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.325+0000 7f7ac3b24800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:48.324 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.325+0000 7f7ac3b24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:48.324 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.325+0000 7f7ac3b24800 20 rados->read ofs=0 len=0 2024-09-12T00:55:48.325 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.325+0000 7f7ac3b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:48.325 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.325+0000 7f7ac3b24800 20 rados->read ofs=0 len=0 2024-09-12T00:55:48.326 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.326+0000 7f7ac3b24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:48.326 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.326+0000 7f7ac3b24800 20 rados->read ofs=0 len=0 2024-09-12T00:55:48.326 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.326+0000 7f7ac3b24800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:48.326 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.326+0000 7f7ac3b24800 20 zone default found 2024-09-12T00:55:48.326 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.326+0000 7f7ac3b24800 4 Realm: () 2024-09-12T00:55:48.326 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.326+0000 7f7ac3b24800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:55:48.326 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.326+0000 7f7ac3b24800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:55:48.327 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.326+0000 7f7ac3b24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:48.327 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.326+0000 7f7ac3b24800 20 zonegroup default 2024-09-12T00:55:48.327 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.326+0000 7f7ac3b24800 20 rados->read ofs=0 len=0 2024-09-12T00:55:48.327 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.326+0000 7f7ac3b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:48.327 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.326+0000 7f7ac3b24800 20 rados->read ofs=0 len=0 2024-09-12T00:55:48.327 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.327+0000 7f7ac3b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:48.327 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.327+0000 7f7ac3b24800 20 rados->read ofs=0 len=0 2024-09-12T00:55:48.327 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.327+0000 7f7ac3b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:48.327 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.327+0000 7f7ac3b24800 20 started sync module instance, tier type = 2024-09-12T00:55:48.327 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.327+0000 7f7ac3b24800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:55:48.334 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.335+0000 7f7ac3b24800 20 add_watcher() i=0 2024-09-12T00:55:48.334 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.335+0000 7f7ac3b24800 20 add_watcher() i=1 2024-09-12T00:55:48.334 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.335+0000 7f7ac3b24800 20 add_watcher() i=2 2024-09-12T00:55:48.334 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.335+0000 7f7ac3b24800 20 add_watcher() i=3 2024-09-12T00:55:48.334 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.335+0000 7f7ac3b24800 20 add_watcher() i=4 2024-09-12T00:55:48.334 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.335+0000 7f7ac3b24800 20 add_watcher() i=5 2024-09-12T00:55:48.334 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.335+0000 7f7ac3b24800 20 add_watcher() i=6 2024-09-12T00:55:48.335 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.336+0000 7f7ac3b24800 20 add_watcher() i=7 2024-09-12T00:55:48.335 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.336+0000 7f7ac3b24800 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:48.337 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.338+0000 7f7975fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:48.337 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.338+0000 7f7ac3b24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:48.337 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.338+0000 7f7ac3b24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:48.337 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.338+0000 7f7ac3b24800 5 note: GC not initialized 2024-09-12T00:55:48.337 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.338+0000 7f7974fe1640 20 reqs_thread_entry: start 2024-09-12T00:55:48.337 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.338+0000 7f7ac3b24800 20 init_complete bucket index max shards: 1 2024-09-12T00:55:48.337 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.338+0000 7f7ac3b24800 20 Filter name: none 2024-09-12T00:55:48.338 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.338+0000 7f78ee7fc640 20 reqs_thread_entry: start 2024-09-12T00:55:48.338 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.338+0000 7f7ac3b24800 20 rados->read ofs=0 len=0 2024-09-12T00:55:48.338 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.339+0000 7f7ac3b24800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:55:48.339 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.339+0000 7f7ac3b24800 20 rados->read ofs=0 len=0 2024-09-12T00:55:48.339 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.339+0000 7f7ac3b24800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:55:48.339 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.339+0000 7f7ac3b24800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:48.339 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.340+0000 7f7975fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:48.341 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.342+0000 7f7ac3b24800 20 remove_watcher() i=0 2024-09-12T00:55:48.341 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.342+0000 7f7ac3b24800 2 removed watcher, disabling cache 2024-09-12T00:55:48.342 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.343+0000 7f7ac3b24800 20 remove_watcher() i=1 2024-09-12T00:55:48.343 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.344+0000 7f7ac3b24800 20 remove_watcher() i=2 2024-09-12T00:55:48.344 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.345+0000 7f7ac3b24800 20 remove_watcher() i=3 2024-09-12T00:55:48.345 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.346+0000 7f7ac3b24800 20 remove_watcher() i=4 2024-09-12T00:55:48.346 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.347+0000 7f7ac3b24800 20 remove_watcher() i=5 2024-09-12T00:55:48.347 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.348+0000 7f7ac3b24800 20 remove_watcher() i=6 2024-09-12T00:55:48.347 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.349+0000 7f7ac3b24800 20 remove_watcher() i=7 2024-09-12T00:55:48.359 INFO:tasks.workunit.client.0.smithi073.stderr:rados -p default.rgw.buckets.index setomapval .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-09-12T00:55:48.386 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:48.386 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:48.401 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-12T00:55:48.430 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:48.430 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:48.466 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.467+0000 7f2f1240f800 20 rados->read ofs=0 len=0 2024-09-12T00:55:48.468 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.469+0000 7f2f1240f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:48.468 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.469+0000 7f2f1240f800 20 realm 2024-09-12T00:55:48.468 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.469+0000 7f2f1240f800 20 rados->read ofs=0 len=0 2024-09-12T00:55:48.468 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.469+0000 7f2f1240f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:48.469 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.469+0000 7f2f1240f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:48.469 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.469+0000 7f2f1240f800 20 rados->read ofs=0 len=0 2024-09-12T00:55:48.469 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.470+0000 7f2f1240f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:48.469 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.470+0000 7f2f1240f800 20 rados->read ofs=0 len=0 2024-09-12T00:55:48.469 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.470+0000 7f2f1240f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:48.469 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.470+0000 7f2f1240f800 20 rados->read ofs=0 len=0 2024-09-12T00:55:48.470 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.471+0000 7f2f1240f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:48.470 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.471+0000 7f2f1240f800 20 searching for the correct realm 2024-09-12T00:55:48.472 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.474+0000 7f2f0e323640 0 -- 172.21.15.73:0/3787623677 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f2ef806cc80 msgr2=0x7f2ef806b6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:48.679 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.680+0000 7f2f0e323640 0 -- 172.21.15.73:0/3787623677 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f2ef806cc80 msgr2=0x7f2ef806b6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:48.683 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.684+0000 7f2f1240f800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:55:48.683 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.684+0000 7f2f1240f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:48.683 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.684+0000 7f2f1240f800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:55:48.683 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.684+0000 7f2f1240f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:48.683 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.684+0000 7f2f1240f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:48.683 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.684+0000 7f2f1240f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:48.683 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.684+0000 7f2f1240f800 20 rados->read ofs=0 len=0 2024-09-12T00:55:48.683 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.684+0000 7f2f1240f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:48.683 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.684+0000 7f2f1240f800 20 rados->read ofs=0 len=0 2024-09-12T00:55:48.683 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.684+0000 7f2f1240f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:48.683 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.684+0000 7f2f1240f800 20 rados->read ofs=0 len=0 2024-09-12T00:55:48.685 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.685+0000 7f2f1240f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:48.685 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.685+0000 7f2f1240f800 20 zone default found 2024-09-12T00:55:48.685 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.685+0000 7f2f1240f800 4 Realm: () 2024-09-12T00:55:48.685 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.685+0000 7f2f1240f800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:55:48.685 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.685+0000 7f2f1240f800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:55:48.685 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.685+0000 7f2f1240f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:48.685 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.685+0000 7f2f1240f800 20 zonegroup default 2024-09-12T00:55:48.685 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.685+0000 7f2f1240f800 20 rados->read ofs=0 len=0 2024-09-12T00:55:48.685 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.685+0000 7f2f1240f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:48.686 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.685+0000 7f2f1240f800 20 rados->read ofs=0 len=0 2024-09-12T00:55:48.686 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.685+0000 7f2f1240f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:48.686 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.685+0000 7f2f1240f800 20 rados->read ofs=0 len=0 2024-09-12T00:55:48.686 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.685+0000 7f2f1240f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:48.686 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.685+0000 7f2f1240f800 20 started sync module instance, tier type = 2024-09-12T00:55:48.686 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.685+0000 7f2f1240f800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:55:48.694 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.695+0000 7f2f1240f800 20 add_watcher() i=0 2024-09-12T00:55:48.694 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.695+0000 7f2f1240f800 20 add_watcher() i=1 2024-09-12T00:55:48.694 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.695+0000 7f2f1240f800 20 add_watcher() i=2 2024-09-12T00:55:48.694 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.695+0000 7f2f1240f800 20 add_watcher() i=3 2024-09-12T00:55:48.694 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.695+0000 7f2f1240f800 20 add_watcher() i=4 2024-09-12T00:55:48.694 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.695+0000 7f2f1240f800 20 add_watcher() i=5 2024-09-12T00:55:48.694 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.695+0000 7f2f1240f800 20 add_watcher() i=6 2024-09-12T00:55:48.694 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.696+0000 7f2f1240f800 20 add_watcher() i=7 2024-09-12T00:55:48.695 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.696+0000 7f2f1240f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:48.696 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.697+0000 7f2dbf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:48.696 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.698+0000 7f2f1240f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:48.696 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.698+0000 7f2f1240f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:48.696 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.698+0000 7f2f1240f800 5 note: GC not initialized 2024-09-12T00:55:48.698 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.698+0000 7f2dbe7fc640 20 reqs_thread_entry: start 2024-09-12T00:55:48.698 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.698+0000 7f2f1240f800 20 init_complete bucket index max shards: 1 2024-09-12T00:55:48.698 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.698+0000 7f2f1240f800 20 Filter name: none 2024-09-12T00:55:48.698 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.698+0000 7f2d2ffff640 20 reqs_thread_entry: start 2024-09-12T00:55:48.698 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.698+0000 7f2f1240f800 20 rados->read ofs=0 len=0 2024-09-12T00:55:48.698 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.699+0000 7f2f1240f800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:55:48.698 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.699+0000 7f2f1240f800 20 rados->read ofs=0 len=0 2024-09-12T00:55:48.698 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.699+0000 7f2f1240f800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:55:48.698 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.699+0000 7f2f1240f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:48.698 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.699+0000 7f2f1240f800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-12T00:55:48.698 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.699+0000 7f2f1240f800 20 INFO: main: starting shard=0 2024-09-12T00:55:48.699 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.699+0000 7f2f1240f800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.0 2024-09-12T00:55:48.699 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.699+0000 7f2f1240f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.0 2024-09-12T00:55:48.700 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.700+0000 7f2f1240f800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:55:48.700 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.700+0000 7f2f1240f800 20 INFO: main: starting shard=1 2024-09-12T00:55:48.700 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.700+0000 7f2f1240f800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.1 2024-09-12T00:55:48.700 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.700+0000 7f2f1240f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.1 2024-09-12T00:55:48.700 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.700+0000 7f2f1240f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:55:48.700 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.700+0000 7f2f1240f800 20 INFO: main: starting shard=2 2024-09-12T00:55:48.700 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.700+0000 7f2f1240f800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.2 2024-09-12T00:55:48.700 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.700+0000 7f2f1240f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.2 2024-09-12T00:55:48.700 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.700+0000 7f2f1240f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:55:48.700 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.700+0000 7f2f1240f800 20 INFO: main: done 2024-09-12T00:55:48.700 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.701+0000 7f2dbf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:48.702 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.703+0000 7f2f1240f800 20 remove_watcher() i=0 2024-09-12T00:55:48.702 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.703+0000 7f2f1240f800 2 removed watcher, disabling cache 2024-09-12T00:55:48.703 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.704+0000 7f2f1240f800 20 remove_watcher() i=1 2024-09-12T00:55:48.704 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.705+0000 7f2f1240f800 20 remove_watcher() i=2 2024-09-12T00:55:48.705 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.706+0000 7f2f1240f800 20 remove_watcher() i=3 2024-09-12T00:55:48.706 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.707+0000 7f2f1240f800 20 remove_watcher() i=4 2024-09-12T00:55:48.707 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.708+0000 7f2f1240f800 20 remove_watcher() i=5 2024-09-12T00:55:48.708 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.709+0000 7f2f1240f800 20 remove_watcher() i=6 2024-09-12T00:55:48.709 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.710+0000 7f2f1240f800 20 remove_watcher() i=7 2024-09-12T00:55:48.720 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2024-09-12T00:55:48.752 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:48.752 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:48.789 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.790+0000 7fd9e5f2e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:48.790 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.792+0000 7fd9e5f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:48.791 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.792+0000 7fd9e5f2e800 20 realm 2024-09-12T00:55:48.791 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.792+0000 7fd9e5f2e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:48.791 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.792+0000 7fd9e5f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:48.791 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.792+0000 7fd9e5f2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:48.791 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.792+0000 7fd9e5f2e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:48.791 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.792+0000 7fd9e5f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:48.791 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.792+0000 7fd9e5f2e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:48.792 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.793+0000 7fd9e5f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:48.792 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.793+0000 7fd9e5f2e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:48.792 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.793+0000 7fd9e5f2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:48.792 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.793+0000 7fd9e5f2e800 20 searching for the correct realm 2024-09-12T00:55:48.794 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:48.795+0000 7fd9e24de640 0 -- 172.21.15.73:0/1012982903 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fd9cc024070 msgr2=0x7fd9cc046280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:49.001 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.002+0000 7fd9e24de640 0 -- 172.21.15.73:0/1012982903 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fd9cc024070 msgr2=0x7fd9cc046280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:49.004 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.006+0000 7fd9e5f2e800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:55:49.004 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.006+0000 7fd9e5f2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:49.005 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.006+0000 7fd9e5f2e800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:55:49.005 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.006+0000 7fd9e5f2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:49.005 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.006+0000 7fd9e5f2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:49.005 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.006+0000 7fd9e5f2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:49.005 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.006+0000 7fd9e5f2e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:49.005 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.006+0000 7fd9e5f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:49.005 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.006+0000 7fd9e5f2e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:49.006 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.006+0000 7fd9e5f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:49.006 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.006+0000 7fd9e5f2e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:49.007 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.006+0000 7fd9e5f2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:49.007 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.007+0000 7fd9e5f2e800 20 zone default found 2024-09-12T00:55:49.007 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.007+0000 7fd9e5f2e800 4 Realm: () 2024-09-12T00:55:49.007 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.007+0000 7fd9e5f2e800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:55:49.007 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.007+0000 7fd9e5f2e800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:55:49.007 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.007+0000 7fd9e5f2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:49.007 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.007+0000 7fd9e5f2e800 20 zonegroup default 2024-09-12T00:55:49.007 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.007+0000 7fd9e5f2e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:49.007 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.007+0000 7fd9e5f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:49.007 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.007+0000 7fd9e5f2e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:49.007 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.007+0000 7fd9e5f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:49.007 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.007+0000 7fd9e5f2e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:49.007 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.008+0000 7fd9e5f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:49.007 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.008+0000 7fd9e5f2e800 20 started sync module instance, tier type = 2024-09-12T00:55:49.008 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.008+0000 7fd9e5f2e800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:55:49.015 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.017+0000 7fd9e5f2e800 20 add_watcher() i=0 2024-09-12T00:55:49.016 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.017+0000 7fd9e5f2e800 20 add_watcher() i=1 2024-09-12T00:55:49.016 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.017+0000 7fd9e5f2e800 20 add_watcher() i=2 2024-09-12T00:55:49.016 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.017+0000 7fd9e5f2e800 20 add_watcher() i=3 2024-09-12T00:55:49.016 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.017+0000 7fd9e5f2e800 20 add_watcher() i=4 2024-09-12T00:55:49.016 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.017+0000 7fd9e5f2e800 20 add_watcher() i=5 2024-09-12T00:55:49.016 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.017+0000 7fd9e5f2e800 20 add_watcher() i=6 2024-09-12T00:55:49.016 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.018+0000 7fd9e5f2e800 20 add_watcher() i=7 2024-09-12T00:55:49.016 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.018+0000 7fd9e5f2e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:49.018 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.019+0000 7fd893fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:49.018 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.020+0000 7fd9e5f2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:49.019 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.020+0000 7fd9e5f2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:49.019 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.020+0000 7fd9e5f2e800 5 note: GC not initialized 2024-09-12T00:55:49.020 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.020+0000 7fd892ffd640 20 reqs_thread_entry: start 2024-09-12T00:55:49.020 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.020+0000 7fd9e5f2e800 20 init_complete bucket index max shards: 1 2024-09-12T00:55:49.020 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.020+0000 7fd9e5f2e800 20 Filter name: none 2024-09-12T00:55:49.020 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.020+0000 7fd890ff9640 20 reqs_thread_entry: start 2024-09-12T00:55:49.020 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.020+0000 7fd9e5f2e800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:55:49.020 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.020+0000 7fd9e5f2e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:49.020 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.021+0000 7fd9e5f2e800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:55:49.020 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.021+0000 7fd9e5f2e800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:55:49.021 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.021+0000 7fd9e5f2e800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:55:49.021 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.021+0000 7fd9e5f2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 : miss 2024-09-12T00:55:49.021 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.021+0000 7fd9e5f2e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:49.021 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.021+0000 7fd9e5f2e800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:55:49.021 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.021+0000 7fd9e5f2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:55:49.021 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.021+0000 7fd9e5f2e800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:55:49.021 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.021+0000 7fd9e5f2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:55:49.021 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.021+0000 7fd9e5f2e800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:55:49.021 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.021+0000 7fd9e5f2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 2024-09-12T00:55:49.023 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.024+0000 7fd9e5f2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:55:49.023 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.024+0000 7fd9e5f2e800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:55:49.023 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.024+0000 7fd9e5f2e800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:55:49.024 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.024+0000 7fd9e5f2e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17, ofs0, ns] 2024-09-12T00:55:49.024 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.025+0000 7fd8c4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497053 cookie 93847280475600 notifier 8042 bl.length()=827 2024-09-12T00:55:49.024 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.025+0000 7fd8c4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:55:49.024 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.025+0000 7fd8c4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:55:49.024 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.025+0000 7fd8c4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:55:49.025 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.026+0000 7fd9e5f2e800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): orig_sources= new_sources= 2024-09-12T00:55:49.025 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.026+0000 7fd9e5f2e800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): potential sources added=[] removed=[] 2024-09-12T00:55:49.025 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.026+0000 7fd9e5f2e800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): orig_dests= new_dests= 2024-09-12T00:55:49.025 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.026+0000 7fd9e5f2e800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): potential dests added=[] removed=[] 2024-09-12T00:55:49.027 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.029+0000 7fd9e5f2e800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.3.0 2024-09-12T00:55:49.027 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.029+0000 7fd9e5f2e800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.3.0 2024-09-12T00:55:49.027 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.029+0000 7fd9e5f2e800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.0 2024-09-12T00:55:49.027 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.029+0000 7fd9e5f2e800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.0 2024-09-12T00:55:49.028 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.029+0000 7fd9e5f2e800 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2024-09-12T00:55:49.028 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.029+0000 7fd9e5f2e800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.1 2024-09-12T00:55:49.028 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.029+0000 7fd9e5f2e800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.1 2024-09-12T00:55:49.028 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.030+0000 7fd9e5f2e800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.2 2024-09-12T00:55:49.028 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.030+0000 7fd9e5f2e800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.2 2024-09-12T00:55:49.029 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.030+0000 7fd9e5f2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 : hit (requested=0x17, cached=0x17) 2024-09-12T00:55:49.029 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.030+0000 7fd9e5f2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 2024-09-12T00:55:49.030 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.031+0000 7fd9e5f2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:55:49.030 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.031+0000 7fd9e5f2e800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:55:49.030 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.031+0000 7fd9e5f2e800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:55:49.030 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.031+0000 7fd9e5f2e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17, ofs0, ns] 2024-09-12T00:55:49.030 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.031+0000 7fd8c4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497054 cookie 93847280475600 notifier 8042 bl.length()=827 2024-09-12T00:55:49.030 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.031+0000 7fd8c4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:55:49.030 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.031+0000 7fd8c4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:55:49.031 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.031+0000 7fd8c4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:55:49.031 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.033+0000 7fd9e5f2e800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): orig_sources= new_sources= 2024-09-12T00:55:49.032 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.033+0000 7fd9e5f2e800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): potential sources added=[] removed=[] 2024-09-12T00:55:49.032 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.033+0000 7fd9e5f2e800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): orig_dests= new_dests= 2024-09-12T00:55:49.032 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.033+0000 7fd9e5f2e800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): potential dests added=[] removed=[] 2024-09-12T00:55:49.033 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.034+0000 7fd9e5f2e800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.0 2024-09-12T00:55:49.033 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.034+0000 7fd9e5f2e800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.0 2024-09-12T00:55:49.033 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.035+0000 7fd9e5f2e800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.1 2024-09-12T00:55:49.033 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.035+0000 7fd9e5f2e800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.1 2024-09-12T00:55:49.033 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.035+0000 7fd9e5f2e800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.2 2024-09-12T00:55:49.034 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.035+0000 7fd9e5f2e800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.2.2 2024-09-12T00:55:49.034 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.035+0000 7fd9e5f2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 : hit (requested=0x17, cached=0x17) 2024-09-12T00:55:49.034 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.035+0000 7fd9e5f2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 2024-09-12T00:55:49.035 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.036+0000 7fd9e5f2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:55:49.035 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.036+0000 7fd9e5f2e800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:55:49.035 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.036+0000 7fd9e5f2e800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:55:49.035 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.036+0000 7fd9e5f2e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17, ofs0, ns] 2024-09-12T00:55:49.035 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.036+0000 7fd8c4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497055 cookie 93847280475600 notifier 8042 bl.length()=795 2024-09-12T00:55:49.035 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.036+0000 7fd8c4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 info.flags=0x17 2024-09-12T00:55:49.035 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.036+0000 7fd8c4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17 to cache LRU end 2024-09-12T00:55:49.035 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.036+0000 7fd8c4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:55:49.036 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.038+0000 7fd9e5f2e800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): orig_sources= new_sources= 2024-09-12T00:55:49.036 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.038+0000 7fd9e5f2e800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): potential sources added=[] removed=[] 2024-09-12T00:55:49.036 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.038+0000 7fd9e5f2e800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): orig_dests= new_dests= 2024-09-12T00:55:49.036 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.038+0000 7fd9e5f2e800 20 handle_bi_update(): bucket=:a-bucket[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17]): potential dests added=[] removed=[] 2024-09-12T00:55:49.038 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.039+0000 7fd9e5f2e800 1 execute INFO: reshard of bucket "a-bucket" from 3 shards to 1 shards completed successfully 2024-09-12T00:55:49.039 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.041+0000 7fd893fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:49.041 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.043+0000 7fd9e5f2e800 20 remove_watcher() i=0 2024-09-12T00:55:49.041 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.043+0000 7fd9e5f2e800 2 removed watcher, disabling cache 2024-09-12T00:55:49.042 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.044+0000 7fd9e5f2e800 20 remove_watcher() i=1 2024-09-12T00:55:49.043 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.045+0000 7fd9e5f2e800 20 remove_watcher() i=2 2024-09-12T00:55:49.044 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.046+0000 7fd9e5f2e800 20 remove_watcher() i=3 2024-09-12T00:55:49.045 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.047+0000 7fd9e5f2e800 20 remove_watcher() i=4 2024-09-12T00:55:49.046 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.048+0000 7fd9e5f2e800 20 remove_watcher() i=5 2024-09-12T00:55:49.047 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.048+0000 7fd9e5f2e800 20 remove_watcher() i=6 2024-09-12T00:55:49.048 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.049+0000 7fd9e5f2e800 20 remove_watcher() i=7 2024-09-12T00:55:49.060 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-12T00:55:49.089 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:49.090 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:49.126 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.127+0000 7f2ea7a98800 20 rados->read ofs=0 len=0 2024-09-12T00:55:49.127 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.129+0000 7f2ea7a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:49.128 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.129+0000 7f2ea7a98800 20 realm 2024-09-12T00:55:49.128 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.129+0000 7f2ea7a98800 20 rados->read ofs=0 len=0 2024-09-12T00:55:49.128 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.129+0000 7f2ea7a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:49.128 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.129+0000 7f2ea7a98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:49.128 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.129+0000 7f2ea7a98800 20 rados->read ofs=0 len=0 2024-09-12T00:55:49.128 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.129+0000 7f2ea7a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:49.128 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.129+0000 7f2ea7a98800 20 rados->read ofs=0 len=0 2024-09-12T00:55:49.129 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.130+0000 7f2ea7a98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:49.129 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.130+0000 7f2ea7a98800 20 rados->read ofs=0 len=0 2024-09-12T00:55:49.129 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.131+0000 7f2ea7a98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:49.129 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.131+0000 7f2ea7a98800 20 searching for the correct realm 2024-09-12T00:55:49.132 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.133+0000 7f2ea5d83640 0 -- 172.21.15.73:0/1548686094 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f2e9c074020 msgr2=0x7f2e9c056a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:49.338 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.339+0000 7f2ea5d83640 0 -- 172.21.15.73:0/1548686094 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f2e9c074020 msgr2=0x7f2e9c056a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:49.342 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.343+0000 7f2ea7a98800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:55:49.342 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.343+0000 7f2ea7a98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:49.342 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.343+0000 7f2ea7a98800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:55:49.342 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.343+0000 7f2ea7a98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:49.342 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.343+0000 7f2ea7a98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:49.342 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.343+0000 7f2ea7a98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:49.342 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.343+0000 7f2ea7a98800 20 rados->read ofs=0 len=0 2024-09-12T00:55:49.342 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.343+0000 7f2ea7a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:49.342 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.343+0000 7f2ea7a98800 20 rados->read ofs=0 len=0 2024-09-12T00:55:49.342 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.343+0000 7f2ea7a98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:49.343 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.343+0000 7f2ea7a98800 20 rados->read ofs=0 len=0 2024-09-12T00:55:49.344 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.343+0000 7f2ea7a98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:49.344 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.344+0000 7f2ea7a98800 20 zone default found 2024-09-12T00:55:49.344 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.344+0000 7f2ea7a98800 4 Realm: () 2024-09-12T00:55:49.344 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.344+0000 7f2ea7a98800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:55:49.344 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.344+0000 7f2ea7a98800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:55:49.344 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.344+0000 7f2ea7a98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:49.344 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.344+0000 7f2ea7a98800 20 zonegroup default 2024-09-12T00:55:49.344 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.344+0000 7f2ea7a98800 20 rados->read ofs=0 len=0 2024-09-12T00:55:49.345 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.344+0000 7f2ea7a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:49.345 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.344+0000 7f2ea7a98800 20 rados->read ofs=0 len=0 2024-09-12T00:55:49.345 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.344+0000 7f2ea7a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:49.345 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.344+0000 7f2ea7a98800 20 rados->read ofs=0 len=0 2024-09-12T00:55:49.345 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.344+0000 7f2ea7a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:49.345 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.344+0000 7f2ea7a98800 20 started sync module instance, tier type = 2024-09-12T00:55:49.345 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.344+0000 7f2ea7a98800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:55:49.352 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.353+0000 7f2ea7a98800 20 add_watcher() i=0 2024-09-12T00:55:49.352 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.353+0000 7f2ea7a98800 20 add_watcher() i=1 2024-09-12T00:55:49.352 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.353+0000 7f2ea7a98800 20 add_watcher() i=2 2024-09-12T00:55:49.353 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.353+0000 7f2ea7a98800 20 add_watcher() i=3 2024-09-12T00:55:49.353 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.353+0000 7f2ea7a98800 20 add_watcher() i=4 2024-09-12T00:55:49.353 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.353+0000 7f2ea7a98800 20 add_watcher() i=5 2024-09-12T00:55:49.353 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.353+0000 7f2ea7a98800 20 add_watcher() i=6 2024-09-12T00:55:49.353 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.354+0000 7f2ea7a98800 20 add_watcher() i=7 2024-09-12T00:55:49.353 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.354+0000 7f2ea7a98800 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:49.354 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.355+0000 7f2d5b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:49.355 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.356+0000 7f2ea7a98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:49.355 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.356+0000 7f2ea7a98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:49.355 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.356+0000 7f2ea7a98800 5 note: GC not initialized 2024-09-12T00:55:49.355 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.356+0000 7f2d5a7e4640 20 reqs_thread_entry: start 2024-09-12T00:55:49.355 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.356+0000 7f2ea7a98800 20 init_complete bucket index max shards: 1 2024-09-12T00:55:49.356 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.356+0000 7f2ea7a98800 20 Filter name: none 2024-09-12T00:55:49.356 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.356+0000 7f2ccbfff640 20 reqs_thread_entry: start 2024-09-12T00:55:49.356 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.356+0000 7f2ea7a98800 20 rados->read ofs=0 len=0 2024-09-12T00:55:49.356 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.357+0000 7f2ea7a98800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:55:49.356 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.357+0000 7f2ea7a98800 20 rados->read ofs=0 len=0 2024-09-12T00:55:49.357 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.357+0000 7f2ea7a98800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:55:49.357 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.357+0000 7f2ea7a98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:49.357 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.357+0000 7f2ea7a98800 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2024-09-12T00:55:49.357 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.357+0000 7f2ea7a98800 20 INFO: main: starting shard=0 2024-09-12T00:55:49.357 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.357+0000 7f2ea7a98800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.3.0 2024-09-12T00:55:49.357 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.357+0000 7f2ea7a98800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17.3.0 2024-09-12T00:55:49.357 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.358+0000 7f2ea7a98800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:55:49.357 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.358+0000 7f2ea7a98800 20 INFO: main: done 2024-09-12T00:55:49.357 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.358+0000 7f2d5b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:49.359 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.360+0000 7f2ea7a98800 20 remove_watcher() i=0 2024-09-12T00:55:49.359 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.360+0000 7f2ea7a98800 2 removed watcher, disabling cache 2024-09-12T00:55:49.360 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.361+0000 7f2ea7a98800 20 remove_watcher() i=1 2024-09-12T00:55:49.361 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.362+0000 7f2ea7a98800 20 remove_watcher() i=2 2024-09-12T00:55:49.361 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.363+0000 7f2ea7a98800 20 remove_watcher() i=3 2024-09-12T00:55:49.363 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.364+0000 7f2ea7a98800 20 remove_watcher() i=4 2024-09-12T00:55:49.363 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.365+0000 7f2ea7a98800 20 remove_watcher() i=5 2024-09-12T00:55:49.364 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.366+0000 7f2ea7a98800 20 remove_watcher() i=6 2024-09-12T00:55:49.365 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.367+0000 7f2ea7a98800 20 remove_watcher() i=7 2024-09-12T00:55:49.375 INFO:tasks.workunit.client.0.smithi073.stderr: test: PUT succeeds during reshard 2024-09-12T00:55:49.377 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T00:55:49.405 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:49.406 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:49.442 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.444+0000 7f4feb93e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:49.444 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.445+0000 7f4feb93e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:49.444 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.445+0000 7f4feb93e800 20 realm 2024-09-12T00:55:49.444 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.445+0000 7f4feb93e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:49.445 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.445+0000 7f4feb93e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:49.445 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.445+0000 7f4feb93e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:49.445 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.445+0000 7f4feb93e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:49.445 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.446+0000 7f4feb93e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:49.445 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.446+0000 7f4feb93e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:49.445 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.446+0000 7f4feb93e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:49.445 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.446+0000 7f4feb93e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:49.446 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.447+0000 7f4feb93e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:49.446 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.447+0000 7f4feb93e800 20 searching for the correct realm 2024-09-12T00:55:49.448 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.449+0000 7f4fe7e87640 0 -- 172.21.15.73:0/2769876485 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f4fd0072260 msgr2=0x7f4fd0047fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:55:49.655 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.656+0000 7f4fe7e87640 0 -- 172.21.15.73:0/2769876485 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f4fd0072260 msgr2=0x7f4fd0047fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:49.659 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.660+0000 7f4feb93e800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:55:49.659 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.660+0000 7f4feb93e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:49.660 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.660+0000 7f4feb93e800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:55:49.660 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.660+0000 7f4feb93e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:49.660 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.660+0000 7f4feb93e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:49.660 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.660+0000 7f4feb93e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:49.660 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.660+0000 7f4feb93e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:49.660 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.660+0000 7f4feb93e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:49.660 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.660+0000 7f4feb93e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:49.660 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.660+0000 7f4feb93e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:49.660 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.660+0000 7f4feb93e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:49.660 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.661+0000 7f4feb93e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:49.661 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.661+0000 7f4feb93e800 20 zone default found 2024-09-12T00:55:49.661 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.661+0000 7f4feb93e800 4 Realm: () 2024-09-12T00:55:49.661 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.661+0000 7f4feb93e800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:55:49.661 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.661+0000 7f4feb93e800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:55:49.661 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.661+0000 7f4feb93e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:49.661 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.661+0000 7f4feb93e800 20 zonegroup default 2024-09-12T00:55:49.661 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.661+0000 7f4feb93e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:49.661 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.661+0000 7f4feb93e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:49.661 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.661+0000 7f4feb93e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:49.662 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.661+0000 7f4feb93e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:49.662 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.661+0000 7f4feb93e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:49.662 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.661+0000 7f4feb93e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:49.662 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.661+0000 7f4feb93e800 20 started sync module instance, tier type = 2024-09-12T00:55:49.662 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.661+0000 7f4feb93e800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:55:49.669 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.670+0000 7f4feb93e800 20 add_watcher() i=0 2024-09-12T00:55:49.669 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.670+0000 7f4feb93e800 20 add_watcher() i=1 2024-09-12T00:55:49.669 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.670+0000 7f4feb93e800 20 add_watcher() i=2 2024-09-12T00:55:49.669 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.670+0000 7f4feb93e800 20 add_watcher() i=3 2024-09-12T00:55:49.669 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.670+0000 7f4feb93e800 20 add_watcher() i=4 2024-09-12T00:55:49.669 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.670+0000 7f4feb93e800 20 add_watcher() i=5 2024-09-12T00:55:49.669 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.670+0000 7f4feb93e800 20 add_watcher() i=6 2024-09-12T00:55:49.670 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.671+0000 7f4feb93e800 20 add_watcher() i=7 2024-09-12T00:55:49.670 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.671+0000 7f4feb93e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:49.671 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.672+0000 7f4e9dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:49.672 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.673+0000 7f4feb93e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:49.672 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.673+0000 7f4feb93e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:49.672 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.673+0000 7f4feb93e800 5 note: GC not initialized 2024-09-12T00:55:49.673 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.673+0000 7f4e9cfe1640 20 reqs_thread_entry: start 2024-09-12T00:55:49.673 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.673+0000 7f4feb93e800 20 init_complete bucket index max shards: 1 2024-09-12T00:55:49.673 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.673+0000 7f4feb93e800 20 Filter name: none 2024-09-12T00:55:49.673 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.673+0000 7f4e167fc640 20 reqs_thread_entry: start 2024-09-12T00:55:49.673 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.673+0000 7f4feb93e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:49.673 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.674+0000 7f4feb93e800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:55:49.673 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.674+0000 7f4feb93e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:49.674 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.674+0000 7f4feb93e800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:55:49.674 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.674+0000 7f4feb93e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:49.674 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.674+0000 7f4feb93e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:49.674 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.674+0000 7f4feb93e800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:55:49.674 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.674+0000 7f4feb93e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:49.674 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.675+0000 7f4feb93e800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:55:49.674 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.675+0000 7f4feb93e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:49.675 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.676+0000 7f4e9dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:49.677 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.678+0000 7f4feb93e800 20 remove_watcher() i=0 2024-09-12T00:55:49.677 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.678+0000 7f4feb93e800 2 removed watcher, disabling cache 2024-09-12T00:55:49.678 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.679+0000 7f4feb93e800 20 remove_watcher() i=1 2024-09-12T00:55:49.679 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.680+0000 7f4feb93e800 20 remove_watcher() i=2 2024-09-12T00:55:49.680 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.681+0000 7f4feb93e800 20 remove_watcher() i=3 2024-09-12T00:55:49.681 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.682+0000 7f4feb93e800 20 remove_watcher() i=4 2024-09-12T00:55:49.682 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.683+0000 7f4feb93e800 20 remove_watcher() i=5 2024-09-12T00:55:49.683 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.684+0000 7f4feb93e800 20 remove_watcher() i=6 2024-09-12T00:55:49.684 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.685+0000 7f4feb93e800 20 remove_watcher() i=7 2024-09-12T00:55:49.694 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:55:49.694 INFO:tasks.workunit.client.0.smithi073.stderr:BUCKET_STATS: 2024-09-12T00:55:49.694 INFO:tasks.workunit.client.0.smithi073.stderr:bucket: myver id: f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 num_objects: 0 size_kb: 0 num_shards: 2 2024-09-12T00:55:49.694 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:55:49.695 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 3 2024-09-12T00:55:49.728 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:49.729 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:49.765 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.766+0000 7f477500f800 20 rados->read ofs=0 len=0 2024-09-12T00:55:49.767 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.768+0000 7f477500f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:49.767 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.768+0000 7f477500f800 20 realm 2024-09-12T00:55:49.767 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.768+0000 7f477500f800 20 rados->read ofs=0 len=0 2024-09-12T00:55:49.767 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.768+0000 7f477500f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:49.767 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.768+0000 7f477500f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:49.767 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.768+0000 7f477500f800 20 rados->read ofs=0 len=0 2024-09-12T00:55:49.767 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.768+0000 7f477500f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:49.768 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.768+0000 7f477500f800 20 rados->read ofs=0 len=0 2024-09-12T00:55:49.768 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.769+0000 7f477500f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:49.768 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.769+0000 7f477500f800 20 rados->read ofs=0 len=0 2024-09-12T00:55:49.769 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.770+0000 7f477500f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:49.769 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.770+0000 7f477500f800 20 searching for the correct realm 2024-09-12T00:55:49.771 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.772+0000 7f47732fa640 0 -- 172.21.15.73:0/321720144 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f475c027930 msgr2=0x7f475c018410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:49.977 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.979+0000 7f47732fa640 0 -- 172.21.15.73:0/321720144 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f475c027930 msgr2=0x7f475c018410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:49.982 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.982+0000 7f477500f800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:55:49.982 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.982+0000 7f477500f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:49.982 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.982+0000 7f477500f800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:55:49.982 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.982+0000 7f477500f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:49.982 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.982+0000 7f477500f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:49.983 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.982+0000 7f477500f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:49.983 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.982+0000 7f477500f800 20 rados->read ofs=0 len=0 2024-09-12T00:55:49.983 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.983+0000 7f477500f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:49.983 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.983+0000 7f477500f800 20 rados->read ofs=0 len=0 2024-09-12T00:55:49.983 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.983+0000 7f477500f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:49.983 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.983+0000 7f477500f800 20 rados->read ofs=0 len=0 2024-09-12T00:55:49.983 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.983+0000 7f477500f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:49.983 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.983+0000 7f477500f800 20 zone default found 2024-09-12T00:55:49.983 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.983+0000 7f477500f800 4 Realm: () 2024-09-12T00:55:49.983 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.983+0000 7f477500f800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:55:49.983 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.983+0000 7f477500f800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:55:49.983 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.983+0000 7f477500f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:49.983 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.983+0000 7f477500f800 20 zonegroup default 2024-09-12T00:55:49.983 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.983+0000 7f477500f800 20 rados->read ofs=0 len=0 2024-09-12T00:55:49.984 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.983+0000 7f477500f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:49.984 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.983+0000 7f477500f800 20 rados->read ofs=0 len=0 2024-09-12T00:55:49.984 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.984+0000 7f477500f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:49.984 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.984+0000 7f477500f800 20 rados->read ofs=0 len=0 2024-09-12T00:55:49.984 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.984+0000 7f477500f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:49.984 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.984+0000 7f477500f800 20 started sync module instance, tier type = 2024-09-12T00:55:49.985 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.984+0000 7f477500f800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:55:49.991 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.993+0000 7f477500f800 20 add_watcher() i=0 2024-09-12T00:55:49.992 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.993+0000 7f477500f800 20 add_watcher() i=1 2024-09-12T00:55:49.992 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.993+0000 7f477500f800 20 add_watcher() i=2 2024-09-12T00:55:49.992 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.993+0000 7f477500f800 20 add_watcher() i=3 2024-09-12T00:55:49.992 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.993+0000 7f477500f800 20 add_watcher() i=4 2024-09-12T00:55:49.992 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.993+0000 7f477500f800 20 add_watcher() i=5 2024-09-12T00:55:49.992 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.993+0000 7f477500f800 20 add_watcher() i=6 2024-09-12T00:55:49.992 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.994+0000 7f477500f800 20 add_watcher() i=7 2024-09-12T00:55:49.992 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.994+0000 7f477500f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:49.995 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.995+0000 7f46297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:49.995 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.996+0000 7f477500f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:49.995 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.996+0000 7f477500f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:49.995 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.996+0000 7f477500f800 5 note: GC not initialized 2024-09-12T00:55:49.995 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.996+0000 7f45a3fff640 20 reqs_thread_entry: start 2024-09-12T00:55:49.995 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.996+0000 7f477500f800 20 init_complete bucket index max shards: 1 2024-09-12T00:55:49.995 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.996+0000 7f477500f800 20 Filter name: none 2024-09-12T00:55:49.995 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.996+0000 7f45a1ffb640 20 reqs_thread_entry: start 2024-09-12T00:55:49.995 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.996+0000 7f477500f800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T00:55:49.995 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.996+0000 7f477500f800 20 rados->read ofs=0 len=0 2024-09-12T00:55:49.996 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.996+0000 7f477500f800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:55:49.996 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.996+0000 7f477500f800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T00:55:49.996 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.996+0000 7f477500f800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T00:55:49.996 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.996+0000 7f477500f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 : miss 2024-09-12T00:55:49.996 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.996+0000 7f477500f800 20 rados->read ofs=0 len=0 2024-09-12T00:55:49.996 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.997+0000 7f477500f800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:55:49.996 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.997+0000 7f477500f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 info.flags=0x17 2024-09-12T00:55:49.996 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.997+0000 7f477500f800 10 adding default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 to cache LRU end 2024-09-12T00:55:49.997 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.997+0000 7f477500f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:55:49.997 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.997+0000 7f477500f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:55:49.997 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:49.997+0000 7f477500f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 2024-09-12T00:55:49.999 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:50.000+0000 7f477500f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 info.flags=0x17 2024-09-12T00:55:49.999 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:50.000+0000 7f477500f800 10 moving default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 to cache LRU end 2024-09-12T00:55:49.999 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:50.000+0000 7f477500f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:55:49.999 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:50.000+0000 7f477500f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18, ofs0, ns] 2024-09-12T00:55:50.000 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:50.001+0000 7f46567fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497056 cookie 93903927908736 notifier 8093 bl.length()=821 2024-09-12T00:55:50.000 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:50.001+0000 7f46567fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 info.flags=0x17 2024-09-12T00:55:50.000 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:50.001+0000 7f46567fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 to cache LRU end 2024-09-12T00:55:50.000 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:50.001+0000 7f46567fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:55:50.001 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:50.002+0000 7f477500f800 20 handle_bi_update(): bucket=:myver[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18]): orig_sources= new_sources= 2024-09-12T00:55:50.001 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:50.002+0000 7f477500f800 20 handle_bi_update(): bucket=:myver[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18]): potential sources added=[] removed=[] 2024-09-12T00:55:50.001 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:50.002+0000 7f477500f800 20 handle_bi_update(): bucket=:myver[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18]): orig_dests= new_dests= 2024-09-12T00:55:50.001 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:50.002+0000 7f477500f800 20 handle_bi_update(): bucket=:myver[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18]): potential dests added=[] removed=[] 2024-09-12T00:55:50.003 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:50.005+0000 7f477500f800 -1 Injecting delay=5.000000000s at location=do_reshard 2024-09-12T00:55:50.699 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:55:50.700 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:55:50.756 INFO:tasks.workunit.client.0.smithi073.stderr:put object successful 2024-09-12T00:55:55.004 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:55.005+0000 7f477500f800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.2.0 2024-09-12T00:55:55.004 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:55.005+0000 7f477500f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.2.0 2024-09-12T00:55:55.005 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:55.005+0000 7f477500f800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.2.1 2024-09-12T00:55:55.005 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:55.005+0000 7f477500f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.2.1 2024-09-12T00:55:55.005 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:55.005+0000 7f477500f800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.2.2 2024-09-12T00:55:55.005 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:55.005+0000 7f477500f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.2.2 2024-09-12T00:55:55.005 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:55.005+0000 7f477500f800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.1.0 2024-09-12T00:55:55.005 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:55.005+0000 7f477500f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.1.0 2024-09-12T00:55:55.005 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:55.006+0000 7f477500f800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.1.1 2024-09-12T00:55:55.005 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:55.006+0000 7f477500f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.1.1 2024-09-12T00:55:55.007 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:55.009+0000 7f477500f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:55:55.007 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:55.009+0000 7f477500f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 2024-09-12T00:55:55.009 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:55.010+0000 7f477500f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 info.flags=0x17 2024-09-12T00:55:55.009 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:55.010+0000 7f477500f800 10 moving default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 to cache LRU end 2024-09-12T00:55:55.009 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:55.010+0000 7f477500f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:55:55.009 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:55.010+0000 7f477500f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18, ofs0, ns] 2024-09-12T00:55:55.009 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:55.011+0000 7f46567fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497057 cookie 93903927908736 notifier 8093 bl.length()=821 2024-09-12T00:55:55.010 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:55.011+0000 7f46567fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 info.flags=0x17 2024-09-12T00:55:55.010 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:55.011+0000 7f46567fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 to cache LRU end 2024-09-12T00:55:55.010 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:55.011+0000 7f46567fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:55:55.011 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:55.012+0000 7f477500f800 20 handle_bi_update(): bucket=:myver[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18]): orig_sources= new_sources= 2024-09-12T00:55:55.011 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:55.012+0000 7f477500f800 20 handle_bi_update(): bucket=:myver[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18]): potential sources added=[] removed=[] 2024-09-12T00:55:55.011 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:55.012+0000 7f477500f800 20 handle_bi_update(): bucket=:myver[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18]): orig_dests= new_dests= 2024-09-12T00:55:55.011 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:55.012+0000 7f477500f800 20 handle_bi_update(): bucket=:myver[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18]): potential dests added=[] removed=[] 2024-09-12T00:55:55.012 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:55.014+0000 7f477500f800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.1.0 2024-09-12T00:55:55.013 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:55.014+0000 7f477500f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.1.0 2024-09-12T00:55:55.013 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:55.014+0000 7f477500f800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.1.1 2024-09-12T00:55:55.013 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:55.014+0000 7f477500f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.1.1 2024-09-12T00:55:55.015 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:55.016+0000 7f477500f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:55:55.015 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:55.016+0000 7f477500f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 2024-09-12T00:55:55.016 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:55.018+0000 7f477500f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 info.flags=0x17 2024-09-12T00:55:55.017 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:55.018+0000 7f477500f800 10 moving default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 to cache LRU end 2024-09-12T00:55:55.017 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:55.018+0000 7f477500f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:55:55.017 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:55.018+0000 7f477500f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18, ofs0, ns] 2024-09-12T00:55:55.017 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:55.018+0000 7f46567fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497058 cookie 93903927908736 notifier 8093 bl.length()=789 2024-09-12T00:55:55.017 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:55.018+0000 7f46567fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 info.flags=0x17 2024-09-12T00:55:55.018 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:55.018+0000 7f46567fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 to cache LRU end 2024-09-12T00:55:55.018 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:55.018+0000 7f46567fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:55:55.018 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:55.020+0000 7f477500f800 20 handle_bi_update(): bucket=:myver[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18]): orig_sources= new_sources= 2024-09-12T00:55:55.018 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:55.020+0000 7f477500f800 20 handle_bi_update(): bucket=:myver[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18]): potential sources added=[] removed=[] 2024-09-12T00:55:55.018 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:55.020+0000 7f477500f800 20 handle_bi_update(): bucket=:myver[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18]): orig_dests= new_dests= 2024-09-12T00:55:55.018 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:55.020+0000 7f477500f800 20 handle_bi_update(): bucket=:myver[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18]): potential dests added=[] removed=[] 2024-09-12T00:55:55.020 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:55.021+0000 7f477500f800 1 execute INFO: reshard of bucket "myver" from 2 shards to 3 shards completed successfully 2024-09-12T00:55:55.022 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:55.024+0000 7f46297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:55.025 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:55.026+0000 7f477500f800 20 remove_watcher() i=0 2024-09-12T00:55:55.025 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:55.026+0000 7f477500f800 2 removed watcher, disabling cache 2024-09-12T00:55:55.026 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:55.028+0000 7f477500f800 20 remove_watcher() i=1 2024-09-12T00:55:55.027 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:55.029+0000 7f477500f800 20 remove_watcher() i=2 2024-09-12T00:55:55.029 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:55.030+0000 7f477500f800 20 remove_watcher() i=3 2024-09-12T00:55:55.030 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:55.031+0000 7f477500f800 20 remove_watcher() i=4 2024-09-12T00:55:55.031 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:55.032+0000 7f477500f800 20 remove_watcher() i=5 2024-09-12T00:55:55.032 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:55.034+0000 7f477500f800 20 remove_watcher() i=6 2024-09-12T00:55:55.034 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:55.035+0000 7f477500f800 20 remove_watcher() i=7 2024-09-12T00:55:55.761 INFO:tasks.workunit.client.0.smithi073.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2024-09-12T00:55:55.761 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T00:55:55.764 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:55:55.764 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:55:55.795 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:55:55.795 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:55:55.857 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:55:55.857 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:55:55.909 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:55:55.909 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:55:55.933 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:55:55.933 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:55:55.984 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:55:55.984 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:55:56.008 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:55:56.008 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:55:56.061 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:55:56.061 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:55:56.085 INFO:tasks.workunit.client.0.smithi073.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T00:55:56.478 INFO:tasks.workunit.client.0.smithi073.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T00:55:57.885 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:55:57.885 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:55:57.971 INFO:tasks.workunit.client.0.smithi073.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:55:57.972 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bi list --bucket myver --object x 2024-09-12T00:55:58.005 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:58.005 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:58.043 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.044+0000 7f641ae98800 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.044 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.046+0000 7f641ae98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.044 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.046+0000 7f641ae98800 20 realm 2024-09-12T00:55:58.045 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.046+0000 7f641ae98800 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.045 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.046+0000 7f641ae98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.045 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.046+0000 7f641ae98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:58.045 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.046+0000 7f641ae98800 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.045 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.046+0000 7f641ae98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.045 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.046+0000 7f641ae98800 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.045 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.047+0000 7f641ae98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:58.045 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.047+0000 7f641ae98800 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.046 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.048+0000 7f641ae98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:58.046 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.048+0000 7f641ae98800 20 searching for the correct realm 2024-09-12T00:55:58.049 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.051+0000 7f6418982640 0 -- 172.21.15.73:0/3318297173 >> [v2:172.21.15.117:6816/1460498570,v1:172.21.15.117:6817/1460498570] conn(0x7f6414009c20 msgr2=0x7f6414011900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:58.056 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.055+0000 7f6418982640 0 -- 172.21.15.73:0/3318297173 >> [v2:172.21.15.117:6816/1460498570,v1:172.21.15.117:6817/1460498570] conn(0x7f62e4086370 msgr2=0x7f62e40887a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:58.057 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.058+0000 7f641ae98800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:55:58.057 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.058+0000 7f641ae98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:58.057 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.058+0000 7f641ae98800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:55:58.058 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.058+0000 7f641ae98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:58.058 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.058+0000 7f641ae98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:58.058 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.058+0000 7f641ae98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:58.058 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.058+0000 7f641ae98800 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.058 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.058+0000 7f641ae98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.058 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.058+0000 7f641ae98800 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.059 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.059+0000 7f641ae98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:58.059 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.059+0000 7f641ae98800 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.060 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.059+0000 7f641ae98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:58.060 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.059+0000 7f641ae98800 20 zone default found 2024-09-12T00:55:58.060 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.059+0000 7f641ae98800 4 Realm: () 2024-09-12T00:55:58.060 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.059+0000 7f641ae98800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:55:58.061 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.059+0000 7f641ae98800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:55:58.061 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.059+0000 7f641ae98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:58.061 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.059+0000 7f641ae98800 20 zonegroup default 2024-09-12T00:55:58.061 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.059+0000 7f641ae98800 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.061 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.059+0000 7f641ae98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.061 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.059+0000 7f641ae98800 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.061 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.060+0000 7f641ae98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.061 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.060+0000 7f641ae98800 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.061 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.060+0000 7f641ae98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.062 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.060+0000 7f641ae98800 20 started sync module instance, tier type = 2024-09-12T00:55:58.062 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.060+0000 7f641ae98800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:55:58.068 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.069+0000 7f641ae98800 20 add_watcher() i=0 2024-09-12T00:55:58.068 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.069+0000 7f641ae98800 20 add_watcher() i=1 2024-09-12T00:55:58.068 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.069+0000 7f641ae98800 20 add_watcher() i=2 2024-09-12T00:55:58.068 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.069+0000 7f641ae98800 20 add_watcher() i=3 2024-09-12T00:55:58.069 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.069+0000 7f641ae98800 20 add_watcher() i=4 2024-09-12T00:55:58.069 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.069+0000 7f641ae98800 20 add_watcher() i=5 2024-09-12T00:55:58.069 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.069+0000 7f641ae98800 20 add_watcher() i=6 2024-09-12T00:55:58.069 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.070+0000 7f641ae98800 20 add_watcher() i=7 2024-09-12T00:55:58.069 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.070+0000 7f641ae98800 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:58.070 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.072+0000 7f62cefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:58.072 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.072+0000 7f641ae98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:58.072 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.072+0000 7f641ae98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:58.073 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.072+0000 7f641ae98800 5 note: GC not initialized 2024-09-12T00:55:58.073 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.072+0000 7f62cdfe3640 20 reqs_thread_entry: start 2024-09-12T00:55:58.073 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.072+0000 7f641ae98800 20 init_complete bucket index max shards: 1 2024-09-12T00:55:58.073 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.072+0000 7f641ae98800 20 Filter name: none 2024-09-12T00:55:58.073 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.073+0000 7f623f7fe640 20 reqs_thread_entry: start 2024-09-12T00:55:58.073 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.073+0000 7f641ae98800 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.073 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.073+0000 7f641ae98800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:55:58.073 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.073+0000 7f641ae98800 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.074 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.073+0000 7f641ae98800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:55:58.074 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.073+0000 7f641ae98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:58.074 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.074+0000 7f641ae98800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-12T00:55:58.074 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.074+0000 7f641ae98800 20 INFO: main: starting shard=0 2024-09-12T00:55:58.074 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.074+0000 7f641ae98800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.2.0 2024-09-12T00:55:58.074 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.074+0000 7f641ae98800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.2.0 2024-09-12T00:55:58.076 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.074+0000 7f641ae98800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:55:58.076 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.074+0000 7f641ae98800 20 INFO: main: starting shard=1 2024-09-12T00:55:58.076 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.074+0000 7f641ae98800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.2.1 2024-09-12T00:55:58.076 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.074+0000 7f641ae98800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.2.1 2024-09-12T00:55:58.076 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.075+0000 7f641ae98800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:55:58.077 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.075+0000 7f641ae98800 20 INFO: main: starting shard=2 2024-09-12T00:55:58.077 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.075+0000 7f641ae98800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.2.2 2024-09-12T00:55:58.077 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.075+0000 7f641ae98800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.2.2 2024-09-12T00:55:58.077 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.075+0000 7f641ae98800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:55:58.077 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.075+0000 7f641ae98800 20 INFO: main: done 2024-09-12T00:55:58.077 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.076+0000 7f62cefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:58.078 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.078+0000 7f641ae98800 20 remove_watcher() i=0 2024-09-12T00:55:58.078 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.078+0000 7f641ae98800 2 removed watcher, disabling cache 2024-09-12T00:55:58.078 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.079+0000 7f641ae98800 20 remove_watcher() i=1 2024-09-12T00:55:58.079 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.080+0000 7f641ae98800 20 remove_watcher() i=2 2024-09-12T00:55:58.080 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.082+0000 7f641ae98800 20 remove_watcher() i=3 2024-09-12T00:55:58.081 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.083+0000 7f641ae98800 20 remove_watcher() i=4 2024-09-12T00:55:58.082 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.084+0000 7f641ae98800 20 remove_watcher() i=5 2024-09-12T00:55:58.083 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.085+0000 7f641ae98800 20 remove_watcher() i=6 2024-09-12T00:55:58.084 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.085+0000 7f641ae98800 20 remove_watcher() i=7 2024-09-12T00:55:58.096 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:55:58.097 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:55:58.119 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:55:58.119 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:55:58.203 INFO:tasks.workunit.client.0.smithi073.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:55:58.204 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bi list --bucket myver --object y 2024-09-12T00:55:58.234 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:58.234 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:58.271 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.273+0000 7fc1d512e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.273 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.274+0000 7fc1d512e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.273 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.274+0000 7fc1d512e800 20 realm 2024-09-12T00:55:58.273 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.274+0000 7fc1d512e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.274 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.275+0000 7fc1d512e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.274 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.275+0000 7fc1d512e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:58.274 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.275+0000 7fc1d512e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.274 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.275+0000 7fc1d512e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.274 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.275+0000 7fc1d512e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.274 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.276+0000 7fc1d512e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:58.274 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.276+0000 7fc1d512e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.275 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.277+0000 7fc1d512e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:58.275 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.277+0000 7fc1d512e800 20 searching for the correct realm 2024-09-12T00:55:58.278 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.279+0000 7fc1d16de640 0 -- 172.21.15.73:0/2829356570 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fc1bc02d040 msgr2=0x7fc1bc02c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:58.484 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.485+0000 7fc1d16de640 0 -- 172.21.15.73:0/2829356570 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fc1bc02d040 msgr2=0x7fc1bc02c410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:58.488 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.490+0000 7fc1d512e800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:55:58.488 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.490+0000 7fc1d512e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:58.488 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.490+0000 7fc1d512e800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:55:58.489 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.490+0000 7fc1d512e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:58.489 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.490+0000 7fc1d512e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:58.489 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.490+0000 7fc1d512e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:58.489 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.490+0000 7fc1d512e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.489 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.490+0000 7fc1d512e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.489 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.490+0000 7fc1d512e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.490 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.490+0000 7fc1d512e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:58.490 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.490+0000 7fc1d512e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.490 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.490+0000 7fc1d512e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:58.490 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.490+0000 7fc1d512e800 20 zone default found 2024-09-12T00:55:58.490 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.490+0000 7fc1d512e800 4 Realm: () 2024-09-12T00:55:58.490 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.490+0000 7fc1d512e800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:55:58.491 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.490+0000 7fc1d512e800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:55:58.491 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.490+0000 7fc1d512e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:58.491 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.490+0000 7fc1d512e800 20 zonegroup default 2024-09-12T00:55:58.491 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.490+0000 7fc1d512e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.491 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.491+0000 7fc1d512e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.491 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.491+0000 7fc1d512e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.491 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.491+0000 7fc1d512e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.491 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.491+0000 7fc1d512e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.491 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.491+0000 7fc1d512e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.491 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.491+0000 7fc1d512e800 20 started sync module instance, tier type = 2024-09-12T00:55:58.491 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.491+0000 7fc1d512e800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:55:58.499 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.500+0000 7fc1d512e800 20 add_watcher() i=0 2024-09-12T00:55:58.499 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.500+0000 7fc1d512e800 20 add_watcher() i=1 2024-09-12T00:55:58.499 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.500+0000 7fc1d512e800 20 add_watcher() i=2 2024-09-12T00:55:58.499 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.500+0000 7fc1d512e800 20 add_watcher() i=3 2024-09-12T00:55:58.499 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.500+0000 7fc1d512e800 20 add_watcher() i=4 2024-09-12T00:55:58.500 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.500+0000 7fc1d512e800 20 add_watcher() i=5 2024-09-12T00:55:58.500 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.500+0000 7fc1d512e800 20 add_watcher() i=6 2024-09-12T00:55:58.500 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.501+0000 7fc1d512e800 20 add_watcher() i=7 2024-09-12T00:55:58.500 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.501+0000 7fc1d512e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:58.502 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.503+0000 7fc0877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:58.502 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.504+0000 7fc1d512e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:58.503 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.504+0000 7fc1d512e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:58.503 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.504+0000 7fc1d512e800 5 note: GC not initialized 2024-09-12T00:55:58.503 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.504+0000 7fc0867e4640 20 reqs_thread_entry: start 2024-09-12T00:55:58.503 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.504+0000 7fc1d512e800 20 init_complete bucket index max shards: 1 2024-09-12T00:55:58.503 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.504+0000 7fc1d512e800 20 Filter name: none 2024-09-12T00:55:58.503 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.504+0000 7fc07f7fe640 20 reqs_thread_entry: start 2024-09-12T00:55:58.503 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.504+0000 7fc1d512e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.504 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.504+0000 7fc1d512e800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:55:58.504 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.504+0000 7fc1d512e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.504 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.505+0000 7fc1d512e800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:55:58.504 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.505+0000 7fc1d512e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:58.504 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.505+0000 7fc1d512e800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-12T00:55:58.504 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.505+0000 7fc1d512e800 20 INFO: main: starting shard=0 2024-09-12T00:55:58.504 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.505+0000 7fc1d512e800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.2.0 2024-09-12T00:55:58.504 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.505+0000 7fc1d512e800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.2.0 2024-09-12T00:55:58.505 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.505+0000 7fc1d512e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:55:58.505 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.505+0000 7fc1d512e800 20 INFO: main: starting shard=1 2024-09-12T00:55:58.505 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.505+0000 7fc1d512e800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.2.1 2024-09-12T00:55:58.505 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.505+0000 7fc1d512e800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.2.1 2024-09-12T00:55:58.505 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.506+0000 7fc1d512e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:55:58.505 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.506+0000 7fc1d512e800 20 INFO: main: starting shard=2 2024-09-12T00:55:58.506 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.506+0000 7fc1d512e800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.2.2 2024-09-12T00:55:58.506 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.506+0000 7fc1d512e800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.2.2 2024-09-12T00:55:58.506 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.506+0000 7fc1d512e800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:55:58.506 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.506+0000 7fc1d512e800 20 INFO: main: done 2024-09-12T00:55:58.506 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.507+0000 7fc0877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:58.508 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.509+0000 7fc1d512e800 20 remove_watcher() i=0 2024-09-12T00:55:58.508 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.509+0000 7fc1d512e800 2 removed watcher, disabling cache 2024-09-12T00:55:58.509 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.510+0000 7fc1d512e800 20 remove_watcher() i=1 2024-09-12T00:55:58.510 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.511+0000 7fc1d512e800 20 remove_watcher() i=2 2024-09-12T00:55:58.511 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.512+0000 7fc1d512e800 20 remove_watcher() i=3 2024-09-12T00:55:58.512 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.513+0000 7fc1d512e800 20 remove_watcher() i=4 2024-09-12T00:55:58.513 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.514+0000 7fc1d512e800 20 remove_watcher() i=5 2024-09-12T00:55:58.514 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.515+0000 7fc1d512e800 20 remove_watcher() i=6 2024-09-12T00:55:58.514 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.516+0000 7fc1d512e800 20 remove_watcher() i=7 2024-09-12T00:55:58.527 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:55:58.527 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:55:58.550 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:55:58.550 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:55:58.633 INFO:tasks.workunit.client.0.smithi073.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:55:58.634 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bi list --bucket myver --object z 2024-09-12T00:55:58.665 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:58.665 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:58.701 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.702+0000 7f050eb26800 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.703 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.704+0000 7f050eb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.703 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.704+0000 7f050eb26800 20 realm 2024-09-12T00:55:58.703 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.704+0000 7f050eb26800 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.703 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.704+0000 7f050eb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.703 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.704+0000 7f050eb26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:58.703 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.704+0000 7f050eb26800 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.703 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.704+0000 7f050eb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.703 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.704+0000 7f050eb26800 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.704 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.705+0000 7f050eb26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:58.704 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.705+0000 7f050eb26800 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.705 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.706+0000 7f050eb26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:58.705 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.706+0000 7f050eb26800 20 searching for the correct realm 2024-09-12T00:55:58.707 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.709+0000 7f050af0a640 0 -- 172.21.15.73:0/986066302 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f050003eae0 msgr2=0x7f0500018440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:55:58.914 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.915+0000 7f050af0a640 0 -- 172.21.15.73:0/986066302 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f050003eae0 msgr2=0x7f0500018440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:58.918 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.919+0000 7f050eb26800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:55:58.918 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.919+0000 7f050eb26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:58.918 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.919+0000 7f050eb26800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:55:58.918 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.919+0000 7f050eb26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:58.918 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.919+0000 7f050eb26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:58.919 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.919+0000 7f050eb26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:58.919 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.919+0000 7f050eb26800 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.919 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.920+0000 7f050eb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.919 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.920+0000 7f050eb26800 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.920 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.920+0000 7f050eb26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:58.920 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.920+0000 7f050eb26800 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.920 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.920+0000 7f050eb26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:58.920 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.920+0000 7f050eb26800 20 zone default found 2024-09-12T00:55:58.920 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.920+0000 7f050eb26800 4 Realm: () 2024-09-12T00:55:58.920 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.920+0000 7f050eb26800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:55:58.920 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.920+0000 7f050eb26800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:55:58.921 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.920+0000 7f050eb26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:58.921 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.920+0000 7f050eb26800 20 zonegroup default 2024-09-12T00:55:58.921 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.920+0000 7f050eb26800 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.921 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.921+0000 7f050eb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.921 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.921+0000 7f050eb26800 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.921 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.921+0000 7f050eb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.921 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.921+0000 7f050eb26800 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.921 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.921+0000 7f050eb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.921 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.921+0000 7f050eb26800 20 started sync module instance, tier type = 2024-09-12T00:55:58.921 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.921+0000 7f050eb26800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:55:58.929 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.931+0000 7f050eb26800 20 add_watcher() i=0 2024-09-12T00:55:58.929 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.931+0000 7f050eb26800 20 add_watcher() i=1 2024-09-12T00:55:58.930 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.931+0000 7f050eb26800 20 add_watcher() i=2 2024-09-12T00:55:58.930 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.931+0000 7f050eb26800 20 add_watcher() i=3 2024-09-12T00:55:58.930 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.931+0000 7f050eb26800 20 add_watcher() i=4 2024-09-12T00:55:58.930 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.931+0000 7f050eb26800 20 add_watcher() i=5 2024-09-12T00:55:58.930 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.931+0000 7f050eb26800 20 add_watcher() i=6 2024-09-12T00:55:58.930 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.932+0000 7f050eb26800 20 add_watcher() i=7 2024-09-12T00:55:58.930 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.932+0000 7f050eb26800 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:58.932 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.933+0000 7f03c0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:58.933 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.934+0000 7f050eb26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:58.933 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.934+0000 7f050eb26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:58.933 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.934+0000 7f050eb26800 5 note: GC not initialized 2024-09-12T00:55:58.933 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.934+0000 7f033b7fe640 20 reqs_thread_entry: start 2024-09-12T00:55:58.933 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.934+0000 7f050eb26800 20 init_complete bucket index max shards: 1 2024-09-12T00:55:58.933 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.934+0000 7f050eb26800 20 Filter name: none 2024-09-12T00:55:58.933 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.934+0000 7f03397fa640 20 reqs_thread_entry: start 2024-09-12T00:55:58.933 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.934+0000 7f050eb26800 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.933 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.934+0000 7f050eb26800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:55:58.933 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.934+0000 7f050eb26800 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.934 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.935+0000 7f050eb26800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:55:58.934 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.935+0000 7f050eb26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:58.934 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.935+0000 7f050eb26800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-12T00:55:58.934 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.935+0000 7f050eb26800 20 INFO: main: starting shard=0 2024-09-12T00:55:58.935 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.935+0000 7f050eb26800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.2.0 2024-09-12T00:55:58.935 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.935+0000 7f050eb26800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.2.0 2024-09-12T00:55:58.935 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.936+0000 7f050eb26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:55:58.935 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.936+0000 7f050eb26800 20 INFO: main: starting shard=1 2024-09-12T00:55:58.935 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.936+0000 7f050eb26800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.2.1 2024-09-12T00:55:58.935 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.936+0000 7f050eb26800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.2.1 2024-09-12T00:55:58.935 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.936+0000 7f050eb26800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:55:58.936 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.936+0000 7f050eb26800 20 INFO: main: starting shard=2 2024-09-12T00:55:58.936 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.936+0000 7f050eb26800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.2.2 2024-09-12T00:55:58.936 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.936+0000 7f050eb26800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.2.2 2024-09-12T00:55:58.936 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.937+0000 7f050eb26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:55:58.936 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.937+0000 7f050eb26800 20 INFO: main: done 2024-09-12T00:55:58.936 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.938+0000 7f03c0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:58.939 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.940+0000 7f050eb26800 20 remove_watcher() i=0 2024-09-12T00:55:58.939 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.940+0000 7f050eb26800 2 removed watcher, disabling cache 2024-09-12T00:55:58.940 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.941+0000 7f050eb26800 20 remove_watcher() i=1 2024-09-12T00:55:58.941 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.942+0000 7f050eb26800 20 remove_watcher() i=2 2024-09-12T00:55:58.942 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.944+0000 7f050eb26800 20 remove_watcher() i=3 2024-09-12T00:55:58.943 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.945+0000 7f050eb26800 20 remove_watcher() i=4 2024-09-12T00:55:58.944 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.946+0000 7f050eb26800 20 remove_watcher() i=5 2024-09-12T00:55:58.945 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.947+0000 7f050eb26800 20 remove_watcher() i=6 2024-09-12T00:55:58.946 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:55:58.948+0000 7f050eb26800 20 remove_watcher() i=7 2024-09-12T00:55:58.959 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:55:58.959 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:55:58.982 INFO:tasks.workunit.client.0.smithi073.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T00:55:59.385 INFO:tasks.workunit.client.0.smithi073.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T00:55:59.787 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2024-09-12T00:55:59.818 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:59.818 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:56:00.057 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.058+0000 7fa32691f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:00.059 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.060+0000 7fa32691f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:00.059 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.060+0000 7fa32691f800 20 realm 2024-09-12T00:56:00.059 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.060+0000 7fa32691f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:00.059 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.060+0000 7fa32691f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:00.059 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.060+0000 7fa32691f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:00.059 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.060+0000 7fa32691f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:00.059 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.060+0000 7fa32691f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:00.059 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.060+0000 7fa32691f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:00.060 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.061+0000 7fa32691f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:00.060 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.061+0000 7fa32691f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:00.061 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.062+0000 7fa32691f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:00.061 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.062+0000 7fa32691f800 20 searching for the correct realm 2024-09-12T00:56:00.063 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.064+0000 7fa322ea3640 0 -- 172.21.15.73:0/3577923053 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fa30c06d060 msgr2=0x7fa30c0dbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:00.270 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.272+0000 7fa322ea3640 0 -- 172.21.15.73:0/3577923053 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fa30c06d060 msgr2=0x7fa30c0dbab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:00.275 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.276+0000 7fa32691f800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:56:00.275 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.276+0000 7fa32691f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:00.275 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.276+0000 7fa32691f800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:56:00.275 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.276+0000 7fa32691f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:00.275 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.276+0000 7fa32691f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:00.275 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.276+0000 7fa32691f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:00.275 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.276+0000 7fa32691f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:00.275 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.276+0000 7fa32691f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:00.275 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.276+0000 7fa32691f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:00.277 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.276+0000 7fa32691f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:00.277 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.276+0000 7fa32691f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:00.277 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.277+0000 7fa32691f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:00.277 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.277+0000 7fa32691f800 20 zone default found 2024-09-12T00:56:00.277 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.277+0000 7fa32691f800 4 Realm: () 2024-09-12T00:56:00.277 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.277+0000 7fa32691f800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:56:00.277 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.277+0000 7fa32691f800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:56:00.277 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.277+0000 7fa32691f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:00.277 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.277+0000 7fa32691f800 20 zonegroup default 2024-09-12T00:56:00.277 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.277+0000 7fa32691f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:00.277 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.277+0000 7fa32691f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:00.277 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.277+0000 7fa32691f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:00.278 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.278+0000 7fa32691f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:00.278 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.278+0000 7fa32691f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:00.278 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.278+0000 7fa32691f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:00.278 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.278+0000 7fa32691f800 20 started sync module instance, tier type = 2024-09-12T00:56:00.278 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.278+0000 7fa32691f800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:56:00.287 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.288+0000 7fa32691f800 20 add_watcher() i=0 2024-09-12T00:56:00.287 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.288+0000 7fa32691f800 20 add_watcher() i=1 2024-09-12T00:56:00.287 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.288+0000 7fa32691f800 20 add_watcher() i=2 2024-09-12T00:56:00.287 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.288+0000 7fa32691f800 20 add_watcher() i=3 2024-09-12T00:56:00.287 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.288+0000 7fa32691f800 20 add_watcher() i=4 2024-09-12T00:56:00.287 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.288+0000 7fa32691f800 20 add_watcher() i=5 2024-09-12T00:56:00.287 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.288+0000 7fa32691f800 20 add_watcher() i=6 2024-09-12T00:56:00.288 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.289+0000 7fa32691f800 20 add_watcher() i=7 2024-09-12T00:56:00.288 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.289+0000 7fa32691f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:00.289 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.291+0000 7fa1d8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:00.290 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.291+0000 7fa32691f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:00.290 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.291+0000 7fa32691f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:00.291 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.291+0000 7fa32691f800 5 note: GC not initialized 2024-09-12T00:56:00.291 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.291+0000 7fa1537fe640 20 reqs_thread_entry: start 2024-09-12T00:56:00.291 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.291+0000 7fa32691f800 20 init_complete bucket index max shards: 1 2024-09-12T00:56:00.291 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.291+0000 7fa32691f800 20 Filter name: none 2024-09-12T00:56:00.291 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.291+0000 7fa1517fa640 20 reqs_thread_entry: start 2024-09-12T00:56:00.291 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.292+0000 7fa32691f800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T00:56:00.291 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.292+0000 7fa32691f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:00.291 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.292+0000 7fa32691f800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:56:00.291 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.292+0000 7fa32691f800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T00:56:00.291 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.292+0000 7fa32691f800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T00:56:00.291 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.292+0000 7fa32691f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 : miss 2024-09-12T00:56:00.291 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.292+0000 7fa32691f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:00.292 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.292+0000 7fa32691f800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:56:00.292 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.292+0000 7fa32691f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 info.flags=0x17 2024-09-12T00:56:00.292 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.292+0000 7fa32691f800 10 adding default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 to cache LRU end 2024-09-12T00:56:00.292 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.292+0000 7fa32691f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:56:00.292 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.292+0000 7fa32691f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:56:00.292 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.292+0000 7fa32691f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 2024-09-12T00:56:00.298 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.300+0000 7fa32691f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 info.flags=0x17 2024-09-12T00:56:00.299 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.300+0000 7fa32691f800 10 moving default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 to cache LRU end 2024-09-12T00:56:00.299 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.300+0000 7fa32691f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:56:00.299 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.300+0000 7fa32691f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18, ofs0, ns] 2024-09-12T00:56:00.299 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.300+0000 7fa205ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497059 cookie 94273315331040 notifier 8748 bl.length()=821 2024-09-12T00:56:00.299 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.300+0000 7fa205ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 info.flags=0x17 2024-09-12T00:56:00.299 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.300+0000 7fa205ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 to cache LRU end 2024-09-12T00:56:00.299 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.300+0000 7fa205ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:56:00.300 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.302+0000 7fa32691f800 20 handle_bi_update(): bucket=:myver[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18]): orig_sources= new_sources= 2024-09-12T00:56:00.300 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.302+0000 7fa32691f800 20 handle_bi_update(): bucket=:myver[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18]): potential sources added=[] removed=[] 2024-09-12T00:56:00.300 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.302+0000 7fa32691f800 20 handle_bi_update(): bucket=:myver[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18]): orig_dests= new_dests= 2024-09-12T00:56:00.301 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.302+0000 7fa32691f800 20 handle_bi_update(): bucket=:myver[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18]): potential dests added=[] removed=[] 2024-09-12T00:56:00.304 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.305+0000 7fa32691f800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.0 2024-09-12T00:56:00.304 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.305+0000 7fa32691f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.0 2024-09-12T00:56:00.304 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.305+0000 7fa32691f800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.1 2024-09-12T00:56:00.304 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.305+0000 7fa32691f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.1 2024-09-12T00:56:00.305 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.305+0000 7fa32691f800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.2 2024-09-12T00:56:00.305 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.305+0000 7fa32691f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.2 2024-09-12T00:56:00.305 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.305+0000 7fa32691f800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.3 2024-09-12T00:56:00.305 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.305+0000 7fa32691f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.3 2024-09-12T00:56:00.305 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.305+0000 7fa32691f800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.4 2024-09-12T00:56:00.305 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.305+0000 7fa32691f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.4 2024-09-12T00:56:00.305 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.305+0000 7fa32691f800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.5 2024-09-12T00:56:00.305 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.305+0000 7fa32691f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.5 2024-09-12T00:56:00.305 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.305+0000 7fa32691f800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.6 2024-09-12T00:56:00.305 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.305+0000 7fa32691f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.6 2024-09-12T00:56:00.305 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.305+0000 7fa32691f800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.7 2024-09-12T00:56:00.305 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.305+0000 7fa32691f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.7 2024-09-12T00:56:00.305 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.305+0000 7fa32691f800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.8 2024-09-12T00:56:00.306 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.305+0000 7fa32691f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.8 2024-09-12T00:56:00.306 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.305+0000 7fa32691f800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.9 2024-09-12T00:56:00.306 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.305+0000 7fa32691f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.9 2024-09-12T00:56:00.306 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.305+0000 7fa32691f800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.10 2024-09-12T00:56:00.306 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.305+0000 7fa32691f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.10 2024-09-12T00:56:00.306 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.305+0000 7fa32691f800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.11 2024-09-12T00:56:00.306 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.305+0000 7fa32691f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.11 2024-09-12T00:56:00.306 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.305+0000 7fa32691f800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.12 2024-09-12T00:56:00.306 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.305+0000 7fa32691f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.12 2024-09-12T00:56:00.306 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.305+0000 7fa32691f800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.13 2024-09-12T00:56:00.306 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.305+0000 7fa32691f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.13 2024-09-12T00:56:00.306 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.305+0000 7fa32691f800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.14 2024-09-12T00:56:00.306 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.305+0000 7fa32691f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.14 2024-09-12T00:56:00.306 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.305+0000 7fa32691f800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.15 2024-09-12T00:56:00.307 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.305+0000 7fa32691f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.15 2024-09-12T00:56:00.307 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.305+0000 7fa32691f800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.16 2024-09-12T00:56:00.307 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.305+0000 7fa32691f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.16 2024-09-12T00:56:00.307 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.305+0000 7fa32691f800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.2.0 2024-09-12T00:56:00.307 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.305+0000 7fa32691f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.2.0 2024-09-12T00:56:00.307 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.306+0000 7fa32691f800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.2.1 2024-09-12T00:56:00.307 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.306+0000 7fa32691f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.2.1 2024-09-12T00:56:00.308 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.306+0000 7fa32691f800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.2.2 2024-09-12T00:56:00.308 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.306+0000 7fa32691f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.2.2 2024-09-12T00:56:00.308 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.308+0000 7fa32691f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:56:00.308 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.308+0000 7fa32691f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 2024-09-12T00:56:00.308 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.310+0000 7fa32691f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 info.flags=0x17 2024-09-12T00:56:00.308 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.310+0000 7fa32691f800 10 moving default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 to cache LRU end 2024-09-12T00:56:00.309 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.310+0000 7fa32691f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:56:00.309 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.310+0000 7fa32691f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18, ofs0, ns] 2024-09-12T00:56:00.309 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.310+0000 7fa205ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497060 cookie 94273315331040 notifier 8748 bl.length()=821 2024-09-12T00:56:00.309 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.310+0000 7fa205ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 info.flags=0x17 2024-09-12T00:56:00.309 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.310+0000 7fa205ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 to cache LRU end 2024-09-12T00:56:00.309 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.310+0000 7fa205ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:56:00.310 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.311+0000 7fa32691f800 20 handle_bi_update(): bucket=:myver[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18]): orig_sources= new_sources= 2024-09-12T00:56:00.310 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.311+0000 7fa32691f800 20 handle_bi_update(): bucket=:myver[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18]): potential sources added=[] removed=[] 2024-09-12T00:56:00.310 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.311+0000 7fa32691f800 20 handle_bi_update(): bucket=:myver[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18]): orig_dests= new_dests= 2024-09-12T00:56:00.310 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.311+0000 7fa32691f800 20 handle_bi_update(): bucket=:myver[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18]): potential dests added=[] removed=[] 2024-09-12T00:56:00.311 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.313+0000 7fa32691f800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.2.0 2024-09-12T00:56:00.311 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.313+0000 7fa32691f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.2.0 2024-09-12T00:56:00.312 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.313+0000 7fa32691f800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.2.1 2024-09-12T00:56:00.312 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.313+0000 7fa32691f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.2.1 2024-09-12T00:56:00.312 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.313+0000 7fa32691f800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.2.2 2024-09-12T00:56:00.312 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.313+0000 7fa32691f800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.2.2 2024-09-12T00:56:00.313 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.314+0000 7fa32691f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:56:00.313 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.314+0000 7fa32691f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 2024-09-12T00:56:00.314 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.315+0000 7fa32691f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 info.flags=0x17 2024-09-12T00:56:00.314 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.315+0000 7fa32691f800 10 moving default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 to cache LRU end 2024-09-12T00:56:00.314 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.315+0000 7fa32691f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:56:00.314 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.315+0000 7fa32691f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18, ofs0, ns] 2024-09-12T00:56:00.314 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.315+0000 7fa205ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497061 cookie 94273315331040 notifier 8748 bl.length()=789 2024-09-12T00:56:00.314 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.315+0000 7fa205ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 info.flags=0x17 2024-09-12T00:56:00.314 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.315+0000 7fa205ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 to cache LRU end 2024-09-12T00:56:00.314 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.315+0000 7fa205ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:56:00.315 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.316+0000 7fa32691f800 20 handle_bi_update(): bucket=:myver[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18]): orig_sources= new_sources= 2024-09-12T00:56:00.315 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.316+0000 7fa32691f800 20 handle_bi_update(): bucket=:myver[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18]): potential sources added=[] removed=[] 2024-09-12T00:56:00.315 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.316+0000 7fa32691f800 20 handle_bi_update(): bucket=:myver[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18]): orig_dests= new_dests= 2024-09-12T00:56:00.315 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.316+0000 7fa32691f800 20 handle_bi_update(): bucket=:myver[f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18]): potential dests added=[] removed=[] 2024-09-12T00:56:00.316 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.318+0000 7fa32691f800 1 execute INFO: reshard of bucket "myver" from 3 shards to 17 shards completed successfully 2024-09-12T00:56:00.318 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.320+0000 7fa1d8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:00.321 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.322+0000 7fa32691f800 20 remove_watcher() i=0 2024-09-12T00:56:00.321 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.322+0000 7fa32691f800 2 removed watcher, disabling cache 2024-09-12T00:56:00.322 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.323+0000 7fa32691f800 20 remove_watcher() i=1 2024-09-12T00:56:00.323 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.324+0000 7fa32691f800 20 remove_watcher() i=2 2024-09-12T00:56:00.324 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.325+0000 7fa32691f800 20 remove_watcher() i=3 2024-09-12T00:56:00.325 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.326+0000 7fa32691f800 20 remove_watcher() i=4 2024-09-12T00:56:00.326 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.327+0000 7fa32691f800 20 remove_watcher() i=5 2024-09-12T00:56:00.327 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.328+0000 7fa32691f800 20 remove_watcher() i=6 2024-09-12T00:56:00.328 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.329+0000 7fa32691f800 20 remove_watcher() i=7 2024-09-12T00:56:00.339 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T00:56:00.375 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:56:00.375 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:56:00.412 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.413+0000 7f80d2540800 20 rados->read ofs=0 len=0 2024-09-12T00:56:00.414 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.415+0000 7f80d2540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:00.414 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.415+0000 7f80d2540800 20 realm 2024-09-12T00:56:00.414 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.415+0000 7f80d2540800 20 rados->read ofs=0 len=0 2024-09-12T00:56:00.414 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.415+0000 7f80d2540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:00.414 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.415+0000 7f80d2540800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:00.414 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.415+0000 7f80d2540800 20 rados->read ofs=0 len=0 2024-09-12T00:56:00.414 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.415+0000 7f80d2540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:00.414 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.415+0000 7f80d2540800 20 rados->read ofs=0 len=0 2024-09-12T00:56:00.414 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.416+0000 7f80d2540800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:00.415 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.416+0000 7f80d2540800 20 rados->read ofs=0 len=0 2024-09-12T00:56:00.415 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.417+0000 7f80d2540800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:00.415 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.417+0000 7f80d2540800 20 searching for the correct realm 2024-09-12T00:56:00.418 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.420+0000 7f80ceac1640 0 -- 172.21.15.73:0/820940861 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f80b8048040 msgr2=0x7f80b8038940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:00.422 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.423+0000 7f80ceac1640 0 -- 172.21.15.73:0/820940861 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f7f98086310 msgr2=0x7f7f98088740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:00.426 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.427+0000 7f80d2540800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:56:00.426 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.427+0000 7f80d2540800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:00.426 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.427+0000 7f80d2540800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:56:00.426 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.427+0000 7f80d2540800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:00.427 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.427+0000 7f80d2540800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:00.427 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.427+0000 7f80d2540800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:00.427 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.427+0000 7f80d2540800 20 rados->read ofs=0 len=0 2024-09-12T00:56:00.427 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.427+0000 7f80d2540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:00.427 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.427+0000 7f80d2540800 20 rados->read ofs=0 len=0 2024-09-12T00:56:00.427 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.427+0000 7f80d2540800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:00.427 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.427+0000 7f80d2540800 20 rados->read ofs=0 len=0 2024-09-12T00:56:00.427 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.427+0000 7f80d2540800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:00.427 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.427+0000 7f80d2540800 20 zone default found 2024-09-12T00:56:00.427 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.427+0000 7f80d2540800 4 Realm: () 2024-09-12T00:56:00.427 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.427+0000 7f80d2540800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:56:00.427 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.427+0000 7f80d2540800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:56:00.428 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.427+0000 7f80d2540800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:00.428 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.428+0000 7f80d2540800 20 zonegroup default 2024-09-12T00:56:00.428 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.428+0000 7f80d2540800 20 rados->read ofs=0 len=0 2024-09-12T00:56:00.428 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.428+0000 7f80d2540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:00.428 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.428+0000 7f80d2540800 20 rados->read ofs=0 len=0 2024-09-12T00:56:00.428 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.428+0000 7f80d2540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:00.429 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.428+0000 7f80d2540800 20 rados->read ofs=0 len=0 2024-09-12T00:56:00.429 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.428+0000 7f80d2540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:00.429 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.428+0000 7f80d2540800 20 started sync module instance, tier type = 2024-09-12T00:56:00.429 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.428+0000 7f80d2540800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:56:00.435 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.437+0000 7f80d2540800 20 add_watcher() i=0 2024-09-12T00:56:00.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.437+0000 7f80d2540800 20 add_watcher() i=1 2024-09-12T00:56:00.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.437+0000 7f80d2540800 20 add_watcher() i=2 2024-09-12T00:56:00.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.437+0000 7f80d2540800 20 add_watcher() i=3 2024-09-12T00:56:00.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.437+0000 7f80d2540800 20 add_watcher() i=4 2024-09-12T00:56:00.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.437+0000 7f80d2540800 20 add_watcher() i=5 2024-09-12T00:56:00.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.437+0000 7f80d2540800 20 add_watcher() i=6 2024-09-12T00:56:00.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.438+0000 7f80d2540800 20 add_watcher() i=7 2024-09-12T00:56:00.436 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.438+0000 7f80d2540800 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:00.438 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.439+0000 7f7f84fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:00.438 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.439+0000 7f80d2540800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:00.439 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.439+0000 7f80d2540800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:00.439 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.439+0000 7f80d2540800 5 note: GC not initialized 2024-09-12T00:56:00.439 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.440+0000 7f7eff7fe640 20 reqs_thread_entry: start 2024-09-12T00:56:00.439 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.440+0000 7f80d2540800 20 init_complete bucket index max shards: 1 2024-09-12T00:56:00.439 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.440+0000 7f80d2540800 20 Filter name: none 2024-09-12T00:56:00.439 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.440+0000 7f7efd7fa640 20 reqs_thread_entry: start 2024-09-12T00:56:00.439 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.440+0000 7f80d2540800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T00:56:00.439 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.440+0000 7f80d2540800 20 rados->read ofs=0 len=0 2024-09-12T00:56:00.440 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.440+0000 7f80d2540800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:56:00.440 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.440+0000 7f80d2540800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T00:56:00.440 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.440+0000 7f80d2540800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T00:56:00.440 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.440+0000 7f80d2540800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 : miss 2024-09-12T00:56:00.440 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.440+0000 7f80d2540800 20 rados->read ofs=0 len=0 2024-09-12T00:56:00.441 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.441+0000 7f80d2540800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:56:00.441 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.441+0000 7f80d2540800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 info.flags=0x17 2024-09-12T00:56:00.441 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.441+0000 7f80d2540800 10 adding default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 to cache LRU end 2024-09-12T00:56:00.441 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.441+0000 7f80d2540800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:56:00.441 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.441+0000 7f80d2540800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:56:00.441 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.441+0000 7f80d2540800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18 2024-09-12T00:56:00.441 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.441+0000 7f80d2540800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.0 2024-09-12T00:56:00.441 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.441+0000 7f80d2540800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.0 2024-09-12T00:56:00.441 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.442+0000 7f80d2540800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T00:56:00.441 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.442+0000 7f80d2540800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.1 2024-09-12T00:56:00.441 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.442+0000 7f80d2540800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.1 2024-09-12T00:56:00.442 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.442+0000 7f80d2540800 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-12T00:56:00.442 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.442+0000 7f80d2540800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.2 2024-09-12T00:56:00.443 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.442+0000 7f80d2540800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.2 2024-09-12T00:56:00.443 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.442+0000 7f80d2540800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T00:56:00.443 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.442+0000 7f80d2540800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.3 2024-09-12T00:56:00.443 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.442+0000 7f80d2540800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.3 2024-09-12T00:56:00.443 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.443+0000 7f80d2540800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T00:56:00.443 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.443+0000 7f80d2540800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.4 2024-09-12T00:56:00.443 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.443+0000 7f80d2540800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.4 2024-09-12T00:56:00.443 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.443+0000 7f80d2540800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T00:56:00.443 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.443+0000 7f80d2540800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.5 2024-09-12T00:56:00.443 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.443+0000 7f80d2540800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.5 2024-09-12T00:56:00.443 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.443+0000 7f80d2540800 1 NOTICE: finished shard 5 (0 entries removed) 2024-09-12T00:56:00.443 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.443+0000 7f80d2540800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.6 2024-09-12T00:56:00.443 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.443+0000 7f80d2540800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.6 2024-09-12T00:56:00.444 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.444+0000 7f80d2540800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T00:56:00.444 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.444+0000 7f80d2540800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.7 2024-09-12T00:56:00.444 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.444+0000 7f80d2540800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.7 2024-09-12T00:56:00.444 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.445+0000 7f80d2540800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T00:56:00.444 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.445+0000 7f80d2540800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.8 2024-09-12T00:56:00.445 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.445+0000 7f80d2540800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.8 2024-09-12T00:56:00.445 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.445+0000 7f80d2540800 1 NOTICE: finished shard 8 (0 entries removed) 2024-09-12T00:56:00.445 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.445+0000 7f80d2540800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.9 2024-09-12T00:56:00.445 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.445+0000 7f80d2540800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.9 2024-09-12T00:56:00.445 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.446+0000 7f80d2540800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.10 2024-09-12T00:56:00.445 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.446+0000 7f80d2540800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.10 2024-09-12T00:56:00.446 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.446+0000 7f80d2540800 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-12T00:56:00.446 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.446+0000 7f80d2540800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.11 2024-09-12T00:56:00.446 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.446+0000 7f80d2540800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.11 2024-09-12T00:56:00.446 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.447+0000 7f80d2540800 1 NOTICE: finished shard 11 (0 entries removed) 2024-09-12T00:56:00.446 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.447+0000 7f80d2540800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.12 2024-09-12T00:56:00.446 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.447+0000 7f80d2540800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.12 2024-09-12T00:56:00.446 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.447+0000 7f80d2540800 1 NOTICE: finished shard 12 (0 entries removed) 2024-09-12T00:56:00.447 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.447+0000 7f80d2540800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.13 2024-09-12T00:56:00.447 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.447+0000 7f80d2540800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.13 2024-09-12T00:56:00.447 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.447+0000 7f80d2540800 1 NOTICE: finished shard 13 (0 entries removed) 2024-09-12T00:56:00.447 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.447+0000 7f80d2540800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.14 2024-09-12T00:56:00.447 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.447+0000 7f80d2540800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.14 2024-09-12T00:56:00.448 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.448+0000 7f80d2540800 1 NOTICE: finished shard 14 (0 entries removed) 2024-09-12T00:56:00.448 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.448+0000 7f80d2540800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.15 2024-09-12T00:56:00.448 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.448+0000 7f80d2540800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.15 2024-09-12T00:56:00.448 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.448+0000 7f80d2540800 1 NOTICE: finished shard 15 (0 entries removed) 2024-09-12T00:56:00.448 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.448+0000 7f80d2540800 10 bucket_obj is .dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.16 2024-09-12T00:56:00.448 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.448+0000 7f80d2540800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.16 2024-09-12T00:56:00.448 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.449+0000 7f80d2540800 1 NOTICE: finished shard 16 (0 entries removed) 2024-09-12T00:56:00.448 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.449+0000 7f80d2540800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.9 2024-09-12T00:56:00.449 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.449+0000 7f80d2540800 20 get_obj_state: octx=0x562a579dd690 obj=myver:x state=0x562a57ca9f68 s->prefetch_data=0 2024-09-12T00:56:00.449 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.449+0000 7f80d2540800 20 get_obj_state: setting s->obj_tag to 5j179p6860ovhwwbobohhx8nxwwk898h 2024-09-12T00:56:00.449 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.449+0000 7f80d2540800 20 get_obj_state_impl: setting s->olh_tag to 7aj7sj5htbbky01xlpzscw1da9m7nudt 2024-09-12T00:56:00.449 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.449+0000 7f80d2540800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=7aj7sj5htbbky01xlpzscw1da9m7nudt 2024-09-12T00:56:00.449 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.451+0000 7f80d2540800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.9 2024-09-12T00:56:00.451 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.452+0000 7f80d2540800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.9 2024-09-12T00:56:00.451 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.452+0000 7f80d2540800 20 olh_log_entry: epoch=2 op=2 key=x[] 2024-09-12T00:56:00.451 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.452+0000 7f80d2540800 20 olh_log_entry: epoch=2 op=3 key=x[KQYK6IM5TiteDWwrdSGOCv1SpkPHD7I] 2024-09-12T00:56:00.451 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.452+0000 7f80d2540800 20 get_obj_state: octx=0x562a579dd690 obj=myver:_:KQYK6IM5TiteDWwrdSGOCv1SpkPHD7I_x state=0x562a57ce6a38 s->prefetch_data=0 2024-09-12T00:56:00.451 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.453+0000 7f80d2540800 10 manifest: total_size = 11 2024-09-12T00:56:00.451 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.453+0000 7f80d2540800 20 get_obj_state: setting s->obj_tag to f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17063212214491328048 2024-09-12T00:56:00.452 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.453+0000 7f80d2540800 20 get_obj_state: octx=0x562a579dd690 obj=myver:_:KQYK6IM5TiteDWwrdSGOCv1SpkPHD7I_x state=0x562a57ce6a38 s->prefetch_data=0 2024-09-12T00:56:00.452 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.453+0000 7f80d2540800 20 prepare_atomic_modification: state is not atomic. state=0x562a57ce6a38 2024-09-12T00:56:00.452 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.453+0000 7f80d2540800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.9 2024-09-12T00:56:00.453 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.455+0000 7f80d2540800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:56:00.453 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.455+0000 7f80d2540800 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-12T00:56:00.453 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.455+0000 7f80d2540800 0 deleting objects inline since gc isn't initialized 2024-09-12T00:56:00.453 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.455+0000 7f80d2540800 5 delete_objs_inline: removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18__shadow:KQYK6IM5TiteDWwrdSGOCv1SpkPHD7I_.dNrHFS0cWwQQk0sXw3AGPAsWU8j9ZqM_0 2024-09-12T00:56:00.454 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.456+0000 7f80d2540800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:56:00.454 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.456+0000 7f7fb17fa640 20 handle_completion(): completion ok for obj=x[KQYK6IM5TiteDWwrdSGOCv1SpkPHD7I] 2024-09-12T00:56:00.455 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.457+0000 7f80d2540800 20 get_obj_state: octx=0x562a579dd690 obj=myver:x state=0x562a57ca9f68 s->prefetch_data=0 2024-09-12T00:56:00.456 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.457+0000 7f80d2540800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=7aj7sj5htbbky01xlpzscw1da9m7nudt 2024-09-12T00:56:00.458 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.459+0000 7f80d2540800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.9 2024-09-12T00:56:00.459 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.460+0000 7f80d2540800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.9 2024-09-12T00:56:00.459 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.461+0000 7f80d2540800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.9 2024-09-12T00:56:00.459 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.461+0000 7f80d2540800 20 get_obj_state: octx=0x562a579dd690 obj=myver:y state=0x562a57cab358 s->prefetch_data=0 2024-09-12T00:56:00.460 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.461+0000 7f80d2540800 20 get_obj_state: setting s->obj_tag to xpfaem2k4fdja3milto2wiiqupr9rq89 2024-09-12T00:56:00.460 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.461+0000 7f80d2540800 20 get_obj_state_impl: setting s->olh_tag to p465kc2hr44hvdjz3g5mi6amcrxw94n1 2024-09-12T00:56:00.460 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.461+0000 7f80d2540800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=p465kc2hr44hvdjz3g5mi6amcrxw94n1 2024-09-12T00:56:00.461 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.462+0000 7f80d2540800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.9 2024-09-12T00:56:00.462 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.463+0000 7f80d2540800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.9 2024-09-12T00:56:00.463 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.464+0000 7f80d2540800 20 olh_log_entry: epoch=2 op=2 key=y[] 2024-09-12T00:56:00.463 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.464+0000 7f80d2540800 20 olh_log_entry: epoch=2 op=3 key=y[-fVhQUxE2ZQ.1DF634pSAuJrAXZQTzZ] 2024-09-12T00:56:00.463 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.464+0000 7f80d2540800 20 get_obj_state: octx=0x562a579dd690 obj=myver:_:-fVhQUxE2ZQ.1DF634pSAuJrAXZQTzZ_y state=0x562a57ce5a28 s->prefetch_data=0 2024-09-12T00:56:00.463 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.464+0000 7f80d2540800 10 manifest: total_size = 12 2024-09-12T00:56:00.463 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.464+0000 7f80d2540800 20 get_obj_state: setting s->obj_tag to f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8318373181881373059 2024-09-12T00:56:00.463 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.464+0000 7f80d2540800 20 get_obj_state: octx=0x562a579dd690 obj=myver:_:-fVhQUxE2ZQ.1DF634pSAuJrAXZQTzZ_y state=0x562a57ce5a28 s->prefetch_data=0 2024-09-12T00:56:00.463 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.464+0000 7f80d2540800 20 prepare_atomic_modification: state is not atomic. state=0x562a57ce5a28 2024-09-12T00:56:00.463 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.464+0000 7f80d2540800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.9 2024-09-12T00:56:00.465 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.466+0000 7f80d2540800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:56:00.465 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.466+0000 7f80d2540800 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-12T00:56:00.465 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.466+0000 7f80d2540800 0 deleting objects inline since gc isn't initialized 2024-09-12T00:56:00.465 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.466+0000 7f80d2540800 5 delete_objs_inline: removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18__shadow:-fVhQUxE2ZQ.1DF634pSAuJrAXZQTzZ_.8zOPomOaWMY_M4nAvMy5GHLWu6G0lHq_0 2024-09-12T00:56:00.466 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.467+0000 7f7fb1ffb640 20 handle_completion(): completion ok for obj=y[-fVhQUxE2ZQ.1DF634pSAuJrAXZQTzZ] 2024-09-12T00:56:00.466 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.467+0000 7f80d2540800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:56:00.467 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.468+0000 7f80d2540800 20 get_obj_state: octx=0x562a579dd690 obj=myver:y state=0x562a57cab358 s->prefetch_data=0 2024-09-12T00:56:00.467 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.468+0000 7f80d2540800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=p465kc2hr44hvdjz3g5mi6amcrxw94n1 2024-09-12T00:56:00.468 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.470+0000 7f80d2540800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.9 2024-09-12T00:56:00.469 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.471+0000 7f80d2540800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.9 2024-09-12T00:56:00.470 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.471+0000 7f80d2540800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.9 2024-09-12T00:56:00.470 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.472+0000 7f80d2540800 20 get_obj_state: octx=0x562a579dd690 obj=myver:z state=0x562a57cab358 s->prefetch_data=0 2024-09-12T00:56:00.470 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.472+0000 7f80d2540800 20 get_obj_state: setting s->obj_tag to crqocxly32w5dxzngu9empz79pnt4s19 2024-09-12T00:56:00.470 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.472+0000 7f80d2540800 20 get_obj_state_impl: setting s->olh_tag to loebs6ogpbrn8bd2egf4u7s7kz5xawme 2024-09-12T00:56:00.470 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.472+0000 7f80d2540800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=loebs6ogpbrn8bd2egf4u7s7kz5xawme 2024-09-12T00:56:00.471 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.473+0000 7f80d2540800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.9 2024-09-12T00:56:00.472 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.474+0000 7f80d2540800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.9 2024-09-12T00:56:00.473 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.474+0000 7f80d2540800 20 olh_log_entry: epoch=2 op=2 key=z[] 2024-09-12T00:56:00.473 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.474+0000 7f80d2540800 20 olh_log_entry: epoch=2 op=3 key=z[yO8S.FjJDjdF-rHFnjTLW4.Xbe6aa2L] 2024-09-12T00:56:00.473 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.474+0000 7f80d2540800 20 get_obj_state: octx=0x562a579dd690 obj=myver:_:yO8S.FjJDjdF-rHFnjTLW4.Xbe6aa2L_z state=0x562a57ce5a28 s->prefetch_data=0 2024-09-12T00:56:00.473 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.475+0000 7f80d2540800 10 manifest: total_size = 12 2024-09-12T00:56:00.473 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.475+0000 7f80d2540800 20 get_obj_state: setting s->obj_tag to f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16261018503357626361 2024-09-12T00:56:00.473 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.475+0000 7f80d2540800 20 get_obj_state: octx=0x562a579dd690 obj=myver:_:yO8S.FjJDjdF-rHFnjTLW4.Xbe6aa2L_z state=0x562a57ce5a28 s->prefetch_data=0 2024-09-12T00:56:00.474 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.475+0000 7f80d2540800 20 prepare_atomic_modification: state is not atomic. state=0x562a57ce5a28 2024-09-12T00:56:00.474 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.475+0000 7f80d2540800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.9 2024-09-12T00:56:00.475 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.477+0000 7f80d2540800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:56:00.475 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.477+0000 7f80d2540800 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-12T00:56:00.475 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.477+0000 7f80d2540800 0 deleting objects inline since gc isn't initialized 2024-09-12T00:56:00.475 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.477+0000 7f80d2540800 5 delete_objs_inline: removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18__shadow:yO8S.FjJDjdF-rHFnjTLW4.Xbe6aa2L_.zbuoV_FMdWp64FrRLSEcwWfAv3Hp-MO_0 2024-09-12T00:56:00.476 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.478+0000 7f80d2540800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:56:00.476 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.478+0000 7f7fb17fa640 20 handle_completion(): completion ok for obj=z[yO8S.FjJDjdF-rHFnjTLW4.Xbe6aa2L] 2024-09-12T00:56:00.477 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.479+0000 7f80d2540800 20 get_obj_state: octx=0x562a579dd690 obj=myver:z state=0x562a57cab358 s->prefetch_data=0 2024-09-12T00:56:00.477 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.479+0000 7f80d2540800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=loebs6ogpbrn8bd2egf4u7s7kz5xawme 2024-09-12T00:56:00.479 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.481+0000 7f80d2540800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.9 2024-09-12T00:56:00.480 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.482+0000 7f80d2540800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18.3.9 2024-09-12T00:56:00.480 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.482+0000 7f80d2540800 1 NOTICE: finished shard 9 (3 entries removed) 2024-09-12T00:56:00.480 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.482+0000 7f80d2540800 1 NOTICE: finished all shards (3 entries removed) 2024-09-12T00:56:00.481 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.483+0000 7f7f84fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:00.483 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.485+0000 7f80d2540800 20 remove_watcher() i=0 2024-09-12T00:56:00.483 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.485+0000 7f80d2540800 2 removed watcher, disabling cache 2024-09-12T00:56:00.484 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.486+0000 7f80d2540800 20 remove_watcher() i=1 2024-09-12T00:56:00.485 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.487+0000 7f80d2540800 20 remove_watcher() i=2 2024-09-12T00:56:00.486 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.488+0000 7f80d2540800 20 remove_watcher() i=3 2024-09-12T00:56:00.487 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.489+0000 7f80d2540800 20 remove_watcher() i=4 2024-09-12T00:56:00.488 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.489+0000 7f80d2540800 20 remove_watcher() i=5 2024-09-12T00:56:00.489 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.491+0000 7f80d2540800 20 remove_watcher() i=6 2024-09-12T00:56:00.490 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.491+0000 7f80d2540800 20 remove_watcher() i=7 2024-09-12T00:56:00.502 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:56:00.502 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:56:00.540 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:56:00.541 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:56:00.637 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T00:56:00.665 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:56:00.665 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:56:00.701 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.703+0000 7f3355346800 20 rados->read ofs=0 len=0 2024-09-12T00:56:00.703 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.705+0000 7f3355346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:00.704 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.705+0000 7f3355346800 20 realm 2024-09-12T00:56:00.704 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.705+0000 7f3355346800 20 rados->read ofs=0 len=0 2024-09-12T00:56:00.704 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.705+0000 7f3355346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:00.704 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.705+0000 7f3355346800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:00.704 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.705+0000 7f3355346800 20 rados->read ofs=0 len=0 2024-09-12T00:56:00.704 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.705+0000 7f3355346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:00.704 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.705+0000 7f3355346800 20 rados->read ofs=0 len=0 2024-09-12T00:56:00.704 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.706+0000 7f3355346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:00.705 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.706+0000 7f3355346800 20 rados->read ofs=0 len=0 2024-09-12T00:56:00.705 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.707+0000 7f3355346800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:00.705 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.707+0000 7f3355346800 20 searching for the correct realm 2024-09-12T00:56:00.708 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.709+0000 7f3353638640 0 -- 172.21.15.73:0/2329055106 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f333c031040 msgr2=0x7f333c03a820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:00.711 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.713+0000 7f334a636640 0 -- 172.21.15.73:0/2329055106 >> [v2:172.21.15.117:6800/110688882,v1:172.21.15.117:6801/110688882] conn(0x55ca6be911a0 msgr2=0x55ca6be93590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:00.717 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.716+0000 7f3355346800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:56:00.717 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.716+0000 7f3355346800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:00.717 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.716+0000 7f3355346800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:56:00.717 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.716+0000 7f3355346800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:00.717 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.716+0000 7f3355346800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:00.717 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.716+0000 7f3355346800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:00.718 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.716+0000 7f3355346800 20 rados->read ofs=0 len=0 2024-09-12T00:56:00.718 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.716+0000 7f3355346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:00.718 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.716+0000 7f3355346800 20 rados->read ofs=0 len=0 2024-09-12T00:56:00.718 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.717+0000 7f3355346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:00.718 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.717+0000 7f3355346800 20 rados->read ofs=0 len=0 2024-09-12T00:56:00.718 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.717+0000 7f3355346800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:00.718 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.717+0000 7f3355346800 20 zone default found 2024-09-12T00:56:00.718 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.717+0000 7f3355346800 4 Realm: () 2024-09-12T00:56:00.718 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.717+0000 7f3355346800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:56:00.718 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.717+0000 7f3355346800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:56:00.718 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.717+0000 7f3355346800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:00.719 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.717+0000 7f3355346800 20 zonegroup default 2024-09-12T00:56:00.719 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.717+0000 7f3355346800 20 rados->read ofs=0 len=0 2024-09-12T00:56:00.719 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.717+0000 7f3355346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:00.719 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.717+0000 7f3355346800 20 rados->read ofs=0 len=0 2024-09-12T00:56:00.719 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.717+0000 7f3355346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:00.719 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.717+0000 7f3355346800 20 rados->read ofs=0 len=0 2024-09-12T00:56:00.720 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.718+0000 7f3355346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:00.720 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.718+0000 7f3355346800 20 started sync module instance, tier type = 2024-09-12T00:56:00.720 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.718+0000 7f3355346800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:56:00.725 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.727+0000 7f3355346800 20 add_watcher() i=0 2024-09-12T00:56:00.726 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.727+0000 7f3355346800 20 add_watcher() i=1 2024-09-12T00:56:00.726 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.727+0000 7f3355346800 20 add_watcher() i=2 2024-09-12T00:56:00.726 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.727+0000 7f3355346800 20 add_watcher() i=3 2024-09-12T00:56:00.726 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.727+0000 7f3355346800 20 add_watcher() i=4 2024-09-12T00:56:00.726 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.727+0000 7f3355346800 20 add_watcher() i=5 2024-09-12T00:56:00.726 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.727+0000 7f3355346800 20 add_watcher() i=6 2024-09-12T00:56:00.726 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.728+0000 7f3355346800 20 add_watcher() i=7 2024-09-12T00:56:00.727 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.728+0000 7f3355346800 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:00.728 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.729+0000 7f32097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:00.730 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.730+0000 7f3355346800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:00.730 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.730+0000 7f3355346800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:00.730 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.730+0000 7f3355346800 5 note: GC not initialized 2024-09-12T00:56:00.730 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.730+0000 7f3183fff640 20 reqs_thread_entry: start 2024-09-12T00:56:00.730 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.730+0000 7f3355346800 20 init_complete bucket index max shards: 1 2024-09-12T00:56:00.730 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.730+0000 7f3355346800 20 Filter name: none 2024-09-12T00:56:00.730 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.730+0000 7f3181ffb640 20 reqs_thread_entry: start 2024-09-12T00:56:00.730 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.730+0000 7f3355346800 20 rados->read ofs=0 len=0 2024-09-12T00:56:00.731 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.730+0000 7f3355346800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:56:00.731 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.731+0000 7f3355346800 20 rados->read ofs=0 len=0 2024-09-12T00:56:00.731 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.731+0000 7f3355346800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:56:00.731 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.731+0000 7f3355346800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:56:00.731 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.731+0000 7f3355346800 20 rados->read ofs=0 len=0 2024-09-12T00:56:00.731 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.731+0000 7f3355346800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:56:00.731 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.731+0000 7f3355346800 20 rados->read ofs=0 len=0 2024-09-12T00:56:00.732 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.731+0000 7f3355346800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:56:00.732 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.731+0000 7f3355346800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:56:00.733 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.733+0000 7f32097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:00.734 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.735+0000 7f3355346800 20 remove_watcher() i=0 2024-09-12T00:56:00.734 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.735+0000 7f3355346800 2 removed watcher, disabling cache 2024-09-12T00:56:00.735 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.736+0000 7f3355346800 20 remove_watcher() i=1 2024-09-12T00:56:00.736 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.738+0000 7f3355346800 20 remove_watcher() i=2 2024-09-12T00:56:00.737 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.739+0000 7f3355346800 20 remove_watcher() i=3 2024-09-12T00:56:00.738 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.740+0000 7f3355346800 20 remove_watcher() i=4 2024-09-12T00:56:00.739 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.740+0000 7f3355346800 20 remove_watcher() i=5 2024-09-12T00:56:00.740 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.741+0000 7f3355346800 20 remove_watcher() i=6 2024-09-12T00:56:00.742 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T00:56:00.743+0000 7f3355346800 20 remove_watcher() i=7 2024-09-12T00:56:00.753 INFO:tasks.workunit.client.0.smithi073.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-12T00:56:00.753 INFO:tasks.workunit.client.0.smithi073.stderr:Deleting bucket a-bucket 2024-09-12T00:56:00.754 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:56:00.754 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:56:00.777 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:56:00.778 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:56:00.832 INFO:tasks.workunit.client.0.smithi073.stderr:Deleting bucket myver 2024-09-12T00:56:00.833 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:56:00.833 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:56:00.905 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:56:00.905 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T00:56:01.068 INFO:tasks.workunit.client.0.smithi073.stderr:Completed resharding tests 2024-09-12T00:56:01.069 INFO:tasks.workunit.client.0.smithi073.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-12T00:56:01.069 INFO:tasks.workunit.client.0.smithi073.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-12T00:56:01.069 INFO:tasks.workunit.client.0.smithi073.stdout:connected to https://localhost:443 2024-09-12T00:56:01.148 INFO:tasks.workunit.client.0.smithi073.stderr:+ deactivate 2024-09-12T00:56:01.148 INFO:tasks.workunit.client.0.smithi073.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-12T00:56:01.148 INFO:tasks.workunit.client.0.smithi073.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T00:56:01.148 INFO:tasks.workunit.client.0.smithi073.stderr:+ export PATH 2024-09-12T00:56:01.148 INFO:tasks.workunit.client.0.smithi073.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T00:56:01.148 INFO:tasks.workunit.client.0.smithi073.stderr:+ '[' -n '' ']' 2024-09-12T00:56:01.148 INFO:tasks.workunit.client.0.smithi073.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:56:01.148 INFO:tasks.workunit.client.0.smithi073.stderr:+ hash -r 2024-09-12T00:56:01.149 INFO:tasks.workunit.client.0.smithi073.stderr:+ '[' -n '' ']' 2024-09-12T00:56:01.149 INFO:tasks.workunit.client.0.smithi073.stderr:+ unset VIRTUAL_ENV 2024-09-12T00:56:01.149 INFO:tasks.workunit.client.0.smithi073.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T00:56:01.149 INFO:tasks.workunit.client.0.smithi073.stderr:+ unset -f deactivate 2024-09-12T00:56:01.149 INFO:tasks.workunit.client.0.smithi073.stderr:+ echo OK. 2024-09-12T00:56:01.150 INFO:tasks.workunit.client.0.smithi073.stdout:OK. 2024-09-12T00:56:01.150 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:56:01.150 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:56:01.233 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2024-09-12T00:56:01.234 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:56:01.647 DEBUG:teuthology.parallel:result is None 2024-09-12T00:56:01.647 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:56:01.684 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:56:01.685 DEBUG:teuthology.orchestra.run.smithi073:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:56:01.753 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:56:01.753 INFO:teuthology.run_tasks:Running task s3tests-java... 2024-09-12T00:56:01.768 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2024-09-12T00:56:01.768 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2024-09-12T00:56:01.769 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2024-09-12T00:56:01.769 DEBUG:teuthology.orchestra.run.smithi073:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2024-09-12T00:56:01.822 INFO:teuthology.orchestra.run.smithi073.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2024-09-12T00:56:05.932 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2024-09-12T00:56:05.932 DEBUG:teuthology.orchestra.run.smithi073:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2024-09-12T00:56:07.819 INFO:teuthology.orchestra.run.smithi073.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required RPM packages. Installing via sudo. 2024-09-12T00:56:08.395 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:30:52 ago on Thu 12 Sep 2024 12:25:16 AM UTC. 2024-09-12T00:56:08.537 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-12T00:56:08.538 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-12T00:56:08.538 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-09-12T00:56:08.538 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-12T00:56:08.538 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-12T00:56:08.538 INFO:teuthology.orchestra.run.smithi073.stdout: java-1.8.0-openjdk x86_64 1:1.8.0.362.b09-4.el9 appstream 426 k 2024-09-12T00:56:08.538 INFO:teuthology.orchestra.run.smithi073.stdout: java-1.8.0-openjdk-devel x86_64 1:1.8.0.362.b09-4.el9 appstream 9.3 M 2024-09-12T00:56:08.538 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-09-12T00:56:08.539 INFO:teuthology.orchestra.run.smithi073.stdout: java-1.8.0-openjdk-headless x86_64 1:1.8.0.362.b09-4.el9 appstream 32 M 2024-09-12T00:56:08.539 INFO:teuthology.orchestra.run.smithi073.stdout:Installing weak dependencies: 2024-09-12T00:56:08.539 INFO:teuthology.orchestra.run.smithi073.stdout: gtk2 x86_64 2.24.33-8.el9 appstream 3.5 M 2024-09-12T00:56:08.539 INFO:teuthology.orchestra.run.smithi073.stdout: libcanberra-gtk2 x86_64 0.30-27.el9 appstream 26 k 2024-09-12T00:56:08.539 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:56:08.539 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-12T00:56:08.539 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-12T00:56:08.539 INFO:teuthology.orchestra.run.smithi073.stdout:Install 5 Packages 2024-09-12T00:56:08.539 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:56:08.540 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 46 M 2024-09-12T00:56:08.540 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 166 M 2024-09-12T00:56:08.540 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-12T00:56:08.901 INFO:teuthology.orchestra.run.smithi073.stdout:(1/5): java-1.8.0-openjdk-1.8.0.362.b09-4.el9.x 1.7 MB/s | 426 kB 00:00 2024-09-12T00:56:09.017 INFO:teuthology.orchestra.run.smithi073.stdout:(2/5): gtk2-2.24.33-8.el9.x86_64.rpm 9.8 MB/s | 3.5 MB 00:00 2024-09-12T00:56:09.059 INFO:teuthology.orchestra.run.smithi073.stdout:(3/5): libcanberra-gtk2-0.30-27.el9.x86_64.rpm 622 kB/s | 26 kB 00:00 2024-09-12T00:56:09.601 INFO:teuthology.orchestra.run.smithi073.stdout:(4/5): java-1.8.0-openjdk-headless-1.8.0.362.b0 46 MB/s | 32 MB 00:00 2024-09-12T00:56:09.735 INFO:teuthology.orchestra.run.smithi073.stdout:(5/5): java-1.8.0-openjdk-devel-1.8.0.362.b09-4 8.7 MB/s | 9.3 MB 00:01 2024-09-12T00:56:09.735 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-12T00:56:09.735 INFO:teuthology.orchestra.run.smithi073.stdout:Total 38 MB/s | 46 MB 00:01 2024-09-12T00:56:10.161 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-12T00:56:10.182 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-12T00:56:10.182 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-12T00:56:10.664 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-12T00:56:10.664 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-12T00:56:11.189 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 1/1 2024-09-12T00:56:11.334 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-12T00:56:11.523 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcanberra-gtk2-0.30-27.el9.x86_64 1/5 2024-09-12T00:56:12.125 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : gtk2-2.24.33-8.el9.x86_64 2/5 2024-09-12T00:56:12.163 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-09-12T00:56:12.392 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-09-12T00:56:12.423 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-09-12T00:56:12.651 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-09-12T00:56:12.686 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-12T00:56:12.693 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-12T00:56:12.703 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 5/5 2024-09-12T00:56:12.738 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 5/5 2024-09-12T00:56:15.700 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-12T00:56:15.700 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : gtk2-2.24.33-8.el9.x86_64 1/5 2024-09-12T00:56:15.701 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2/5 2024-09-12T00:56:15.701 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 3/5 2024-09-12T00:56:15.701 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 4/5 2024-09-12T00:56:16.061 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcanberra-gtk2-0.30-27.el9.x86_64 5/5 2024-09-12T00:56:16.061 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:56:16.061 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-12T00:56:16.061 INFO:teuthology.orchestra.run.smithi073.stdout: gtk2-2.24.33-8.el9.x86_64 2024-09-12T00:56:16.061 INFO:teuthology.orchestra.run.smithi073.stdout: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2024-09-12T00:56:16.062 INFO:teuthology.orchestra.run.smithi073.stdout: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_64 2024-09-12T00:56:16.062 INFO:teuthology.orchestra.run.smithi073.stdout: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x86_64 2024-09-12T00:56:16.062 INFO:teuthology.orchestra.run.smithi073.stdout: libcanberra-gtk2-0.30-27.el9.x86_64 2024-09-12T00:56:16.062 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:56:16.062 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-12T00:56:16.493 INFO:teuthology.orchestra.run.smithi073.stdout: Gradle will be installed under /opt/gradle 2024-09-12T00:56:16.567 INFO:teuthology.orchestra.run.smithi073.stderr:--2024-09-12 00:56:16-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2024-09-12T00:56:16.686 INFO:teuthology.orchestra.run.smithi073.stderr:Resolving services.gradle.org (services.gradle.org)... 104.16.72.101, 104.16.73.101, 2606:4700::6810:4865, ... 2024-09-12T00:56:16.694 INFO:teuthology.orchestra.run.smithi073.stderr:Connecting to services.gradle.org (services.gradle.org)|104.16.72.101|:443... connected. 2024-09-12T00:56:16.786 INFO:teuthology.orchestra.run.smithi073.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2024-09-12T00:56:16.786 INFO:teuthology.orchestra.run.smithi073.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2024-09-12T00:56:16.786 INFO:teuthology.orchestra.run.smithi073.stderr:--2024-09-12 00:56:16-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2024-09-12T00:56:16.801 INFO:teuthology.orchestra.run.smithi073.stderr:Resolving github.com (github.com)... 140.82.113.3 2024-09-12T00:56:16.809 INFO:teuthology.orchestra.run.smithi073.stderr:Connecting to github.com (github.com)|140.82.113.3|:443... connected. 2024-09-12T00:56:16.941 INFO:teuthology.orchestra.run.smithi073.stderr:HTTP request sent, awaiting response... 302 Found 2024-09-12T00:56:16.941 INFO:teuthology.orchestra.run.smithi073.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240912%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240912T005616Z&X-Amz-Expires=300&X-Amz-Signature=4c23fffcaf6a1b717b9bda84ed2c137044721c3983befb40e0b0734a53a11a6e&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2024-09-12T00:56:16.941 INFO:teuthology.orchestra.run.smithi073.stderr:--2024-09-12 00:56:16-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240912%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240912T005616Z&X-Amz-Expires=300&X-Amz-Signature=4c23fffcaf6a1b717b9bda84ed2c137044721c3983befb40e0b0734a53a11a6e&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2024-09-12T00:56:16.941 INFO:teuthology.orchestra.run.smithi073.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.110.133, 185.199.111.133, 185.199.108.133, ... 2024-09-12T00:56:16.954 INFO:teuthology.orchestra.run.smithi073.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.110.133|:443... connected. 2024-09-12T00:56:17.032 INFO:teuthology.orchestra.run.smithi073.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-12T00:56:17.032 INFO:teuthology.orchestra.run.smithi073.stderr:Length: 95129672 (91M) [application/octet-stream] 2024-09-12T00:56:17.032 INFO:teuthology.orchestra.run.smithi073.stderr:Saving to: ‘gradle-6.0.1-bin.zip’ 2024-09-12T00:56:17.032 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-12T00:56:17.056 INFO:teuthology.orchestra.run.smithi073.stderr: 0K .......... .......... .......... .......... .......... 0% 1.97M 46s 2024-09-12T00:56:17.061 INFO:teuthology.orchestra.run.smithi073.stderr: 50K .......... .......... .......... .......... .......... 0% 10.9M 27s 2024-09-12T00:56:17.069 INFO:teuthology.orchestra.run.smithi073.stderr: 100K .......... .......... .......... .......... .......... 0% 5.48M 24s 2024-09-12T00:56:17.072 INFO:teuthology.orchestra.run.smithi073.stderr: 150K .......... .......... .......... .......... .......... 0% 22.0M 19s 2024-09-12T00:56:17.073 INFO:teuthology.orchestra.run.smithi073.stderr: 200K .......... .......... .......... .......... .......... 0% 25.7M 16s 2024-09-12T00:56:17.081 INFO:teuthology.orchestra.run.smithi073.stderr: 250K .......... .......... .......... .......... .......... 0% 38.6M 13s 2024-09-12T00:56:17.083 INFO:teuthology.orchestra.run.smithi073.stderr: 300K .......... .......... .......... .......... .......... 0% 6.28M 14s 2024-09-12T00:56:17.084 INFO:teuthology.orchestra.run.smithi073.stderr: 350K .......... .......... .......... .......... .......... 0% 36.9M 12s 2024-09-12T00:56:17.090 INFO:teuthology.orchestra.run.smithi073.stderr: 400K .......... .......... .......... .......... .......... 0% 52.1M 11s 2024-09-12T00:56:17.090 INFO:teuthology.orchestra.run.smithi073.stderr: 450K .......... .......... .......... .......... .......... 0% 30.3M 10s 2024-09-12T00:56:17.090 INFO:teuthology.orchestra.run.smithi073.stderr: 500K .......... .......... .......... .......... .......... 0% 91.9M 9s 2024-09-12T00:56:17.094 INFO:teuthology.orchestra.run.smithi073.stderr: 550K .......... .......... .......... .......... .......... 0% 8.30M 9s 2024-09-12T00:56:17.094 INFO:teuthology.orchestra.run.smithi073.stderr: 600K .......... .......... .......... .......... .......... 0% 144M 9s 2024-09-12T00:56:17.103 INFO:teuthology.orchestra.run.smithi073.stderr: 650K .......... .......... .......... .......... .......... 0% 28.7M 8s 2024-09-12T00:56:17.103 INFO:teuthology.orchestra.run.smithi073.stderr: 700K .......... .......... .......... .......... .......... 0% 100M 8s 2024-09-12T00:56:17.103 INFO:teuthology.orchestra.run.smithi073.stderr: 750K .......... .......... .......... .......... .......... 0% 47.7M 8s 2024-09-12T00:56:17.103 INFO:teuthology.orchestra.run.smithi073.stderr: 800K .......... .......... .......... .......... .......... 0% 79.9M 7s 2024-09-12T00:56:17.103 INFO:teuthology.orchestra.run.smithi073.stderr: 850K .......... .......... .......... .......... .......... 0% 200M 7s 2024-09-12T00:56:17.103 INFO:teuthology.orchestra.run.smithi073.stderr: 900K .......... .......... .......... .......... .......... 1% 69.2M 6s 2024-09-12T00:56:17.103 INFO:teuthology.orchestra.run.smithi073.stderr: 950K .......... .......... .......... .......... .......... 1% 54.5M 6s 2024-09-12T00:56:17.103 INFO:teuthology.orchestra.run.smithi073.stderr: 1000K .......... .......... .......... .......... .......... 1% 110M 6s 2024-09-12T00:56:17.103 INFO:teuthology.orchestra.run.smithi073.stderr: 1050K .......... .......... .......... .......... .......... 1% 268M 6s 2024-09-12T00:56:17.104 INFO:teuthology.orchestra.run.smithi073.stderr: 1100K .......... .......... .......... .......... .......... 1% 66.5M 6s 2024-09-12T00:56:18.478 INFO:teuthology.orchestra.run.smithi073.stderr: 1150K .......... .......... .......... .......... .......... 1% 9.64M 6s 2024-09-12T00:56:18.479 INFO:teuthology.orchestra.run.smithi073.stderr: 1200K .......... .......... .......... .......... .......... 1% 262M 5s 2024-09-12T00:56:18.479 INFO:teuthology.orchestra.run.smithi073.stderr: 1250K .......... .......... .......... .......... .......... 1% 32.7M 5s 2024-09-12T00:56:18.479 INFO:teuthology.orchestra.run.smithi073.stderr: 1300K .......... .......... .......... .......... .......... 1% 195M 5s 2024-09-12T00:56:18.479 INFO:teuthology.orchestra.run.smithi073.stderr: 1350K .......... .......... .......... .......... .......... 1% 270M 5s 2024-09-12T00:56:18.479 INFO:teuthology.orchestra.run.smithi073.stderr: 1400K .......... .......... .......... .......... .......... 1% 107M 5s 2024-09-12T00:56:18.479 INFO:teuthology.orchestra.run.smithi073.stderr: 1450K .......... .......... .......... .......... .......... 1% 111M 5s 2024-09-12T00:56:18.479 INFO:teuthology.orchestra.run.smithi073.stderr: 1500K .......... .......... .......... .......... .......... 1% 115M 5s 2024-09-12T00:56:18.479 INFO:teuthology.orchestra.run.smithi073.stderr: 1550K .......... .......... .......... .......... .......... 1% 117M 4s 2024-09-12T00:56:18.479 INFO:teuthology.orchestra.run.smithi073.stderr: 1600K .......... .......... .......... .......... .......... 1% 232M 4s 2024-09-12T00:56:18.479 INFO:teuthology.orchestra.run.smithi073.stderr: 1650K .......... .......... .......... .......... .......... 1% 127M 4s 2024-09-12T00:56:18.479 INFO:teuthology.orchestra.run.smithi073.stderr: 1700K .......... .......... .......... .......... .......... 1% 111M 4s 2024-09-12T00:56:18.480 INFO:teuthology.orchestra.run.smithi073.stderr: 1750K .......... .......... .......... .......... .......... 1% 165M 4s 2024-09-12T00:56:18.480 INFO:teuthology.orchestra.run.smithi073.stderr: 1800K .......... .......... .......... .......... .......... 1% 238M 4s 2024-09-12T00:56:18.480 INFO:teuthology.orchestra.run.smithi073.stderr: 1850K .......... .......... .......... .......... .......... 2% 131M 4s 2024-09-12T00:56:18.480 INFO:teuthology.orchestra.run.smithi073.stderr: 1900K .......... .......... .......... .......... .......... 2% 131M 4s 2024-09-12T00:56:18.480 INFO:teuthology.orchestra.run.smithi073.stderr: 1950K .......... .......... .......... .......... .......... 2% 201M 4s 2024-09-12T00:56:18.480 INFO:teuthology.orchestra.run.smithi073.stderr: 2000K .......... .......... .......... .......... .......... 2% 158M 4s 2024-09-12T00:56:18.480 INFO:teuthology.orchestra.run.smithi073.stderr: 2050K .......... .......... .......... .......... .......... 2% 238M 4s 2024-09-12T00:56:18.480 INFO:teuthology.orchestra.run.smithi073.stderr: 2100K .......... .......... .......... .......... .......... 2% 135M 3s 2024-09-12T00:56:18.480 INFO:teuthology.orchestra.run.smithi073.stderr: 2150K .......... .......... .......... .......... .......... 2% 169M 3s 2024-09-12T00:56:18.480 INFO:teuthology.orchestra.run.smithi073.stderr: 2200K .......... .......... .......... .......... .......... 2% 169M 3s 2024-09-12T00:56:18.480 INFO:teuthology.orchestra.run.smithi073.stderr: 2250K .......... .......... .......... .......... .......... 2% 277M 3s 2024-09-12T00:56:18.481 INFO:teuthology.orchestra.run.smithi073.stderr: 2300K .......... .......... .......... .......... .......... 2% 11.7M 3s 2024-09-12T00:56:18.481 INFO:teuthology.orchestra.run.smithi073.stderr: 2350K .......... .......... .......... .......... .......... 2% 268M 3s 2024-09-12T00:56:18.481 INFO:teuthology.orchestra.run.smithi073.stderr: 2400K .......... .......... .......... .......... .......... 2% 266M 3s 2024-09-12T00:56:18.481 INFO:teuthology.orchestra.run.smithi073.stderr: 2450K .......... .......... .......... .......... .......... 2% 262M 3s 2024-09-12T00:56:18.481 INFO:teuthology.orchestra.run.smithi073.stderr: 2500K .......... .......... .......... .......... .......... 2% 228M 3s 2024-09-12T00:56:18.481 INFO:teuthology.orchestra.run.smithi073.stderr: 2550K .......... .......... .......... .......... .......... 2% 48.1M 3s 2024-09-12T00:56:18.481 INFO:teuthology.orchestra.run.smithi073.stderr: 2600K .......... .......... .......... .......... .......... 2% 269M 3s 2024-09-12T00:56:18.481 INFO:teuthology.orchestra.run.smithi073.stderr: 2650K .......... .......... .......... .......... .......... 2% 279M 3s 2024-09-12T00:56:18.481 INFO:teuthology.orchestra.run.smithi073.stderr: 2700K .......... .......... .......... .......... .......... 2% 185M 3s 2024-09-12T00:56:18.481 INFO:teuthology.orchestra.run.smithi073.stderr: 2750K .......... .......... .......... .......... .......... 3% 287M 3s 2024-09-12T00:56:18.481 INFO:teuthology.orchestra.run.smithi073.stderr: 2800K .......... .......... .......... .......... .......... 3% 227M 3s 2024-09-12T00:56:18.481 INFO:teuthology.orchestra.run.smithi073.stderr: 2850K .......... .......... .......... .......... .......... 3% 271M 3s 2024-09-12T00:56:18.481 INFO:teuthology.orchestra.run.smithi073.stderr: 2900K .......... .......... .......... .......... .......... 3% 199M 3s 2024-09-12T00:56:18.481 INFO:teuthology.orchestra.run.smithi073.stderr: 2950K .......... .......... .......... .......... .......... 3% 255M 3s 2024-09-12T00:56:18.482 INFO:teuthology.orchestra.run.smithi073.stderr: 3000K .......... .......... .......... .......... .......... 3% 267M 3s 2024-09-12T00:56:18.482 INFO:teuthology.orchestra.run.smithi073.stderr: 3050K .......... .......... .......... .......... .......... 3% 253M 3s 2024-09-12T00:56:18.482 INFO:teuthology.orchestra.run.smithi073.stderr: 3100K .......... .......... .......... .......... .......... 3% 201M 3s 2024-09-12T00:56:18.482 INFO:teuthology.orchestra.run.smithi073.stderr: 3150K .......... .......... .......... .......... .......... 3% 275M 3s 2024-09-12T00:56:18.482 INFO:teuthology.orchestra.run.smithi073.stderr: 3200K .......... .......... .......... .......... .......... 3% 263M 3s 2024-09-12T00:56:18.482 INFO:teuthology.orchestra.run.smithi073.stderr: 3250K .......... .......... .......... .......... .......... 3% 269M 2s 2024-09-12T00:56:18.482 INFO:teuthology.orchestra.run.smithi073.stderr: 3300K .......... .......... .......... .......... .......... 3% 229M 2s 2024-09-12T00:56:18.482 INFO:teuthology.orchestra.run.smithi073.stderr: 3350K .......... .......... .......... .......... .......... 3% 264M 2s 2024-09-12T00:56:18.482 INFO:teuthology.orchestra.run.smithi073.stderr: 3400K .......... .......... .......... .......... .......... 3% 271M 2s 2024-09-12T00:56:18.482 INFO:teuthology.orchestra.run.smithi073.stderr: 3450K .......... .......... .......... .......... .......... 3% 277M 2s 2024-09-12T00:56:18.482 INFO:teuthology.orchestra.run.smithi073.stderr: 3500K .......... .......... .......... .......... .......... 3% 224M 2s 2024-09-12T00:56:18.482 INFO:teuthology.orchestra.run.smithi073.stderr: 3550K .......... .......... .......... .......... .......... 3% 252M 2s 2024-09-12T00:56:18.482 INFO:teuthology.orchestra.run.smithi073.stderr: 3600K .......... .......... .......... .......... .......... 3% 269M 2s 2024-09-12T00:56:18.482 INFO:teuthology.orchestra.run.smithi073.stderr: 3650K .......... .......... .......... .......... .......... 3% 244M 2s 2024-09-12T00:56:18.483 INFO:teuthology.orchestra.run.smithi073.stderr: 3700K .......... .......... .......... .......... .......... 4% 207M 2s 2024-09-12T00:56:18.483 INFO:teuthology.orchestra.run.smithi073.stderr: 3750K .......... .......... .......... .......... .......... 4% 223M 2s 2024-09-12T00:56:18.483 INFO:teuthology.orchestra.run.smithi073.stderr: 3800K .......... .......... .......... .......... .......... 4% 211M 2s 2024-09-12T00:56:18.483 INFO:teuthology.orchestra.run.smithi073.stderr: 3850K .......... .......... .......... .......... .......... 4% 243M 2s 2024-09-12T00:56:18.483 INFO:teuthology.orchestra.run.smithi073.stderr: 3900K .......... .......... .......... .......... .......... 4% 224M 2s 2024-09-12T00:56:18.483 INFO:teuthology.orchestra.run.smithi073.stderr: 3950K .......... .......... .......... .......... .......... 4% 268M 2s 2024-09-12T00:56:18.483 INFO:teuthology.orchestra.run.smithi073.stderr: 4000K .......... .......... .......... .......... .......... 4% 269M 2s 2024-09-12T00:56:18.483 INFO:teuthology.orchestra.run.smithi073.stderr: 4050K .......... .......... .......... .......... .......... 4% 268M 2s 2024-09-12T00:56:18.483 INFO:teuthology.orchestra.run.smithi073.stderr: 4100K .......... .......... .......... .......... .......... 4% 241M 2s 2024-09-12T00:56:18.483 INFO:teuthology.orchestra.run.smithi073.stderr: 4150K .......... .......... .......... .......... .......... 4% 259M 2s 2024-09-12T00:56:18.483 INFO:teuthology.orchestra.run.smithi073.stderr: 4200K .......... .......... .......... .......... .......... 4% 264M 2s 2024-09-12T00:56:18.483 INFO:teuthology.orchestra.run.smithi073.stderr: 4250K .......... .......... .......... .......... .......... 4% 270M 2s 2024-09-12T00:56:18.483 INFO:teuthology.orchestra.run.smithi073.stderr: 4300K .......... .......... .......... .......... .......... 4% 226M 2s 2024-09-12T00:56:18.484 INFO:teuthology.orchestra.run.smithi073.stderr: 4350K .......... .......... .......... .......... .......... 4% 258M 2s 2024-09-12T00:56:18.484 INFO:teuthology.orchestra.run.smithi073.stderr: 4400K .......... .......... .......... .......... .......... 4% 293M 2s 2024-09-12T00:56:18.484 INFO:teuthology.orchestra.run.smithi073.stderr: 4450K .......... .......... .......... .......... .......... 4% 296M 2s 2024-09-12T00:56:18.484 INFO:teuthology.orchestra.run.smithi073.stderr: 4500K .......... .......... .......... .......... .......... 4% 270M 2s 2024-09-12T00:56:18.484 INFO:teuthology.orchestra.run.smithi073.stderr: 4550K .......... .......... .......... .......... .......... 4% 19.1M 2s 2024-09-12T00:56:18.484 INFO:teuthology.orchestra.run.smithi073.stderr: 4600K .......... .......... .......... .......... .......... 5% 247M 2s 2024-09-12T00:56:18.484 INFO:teuthology.orchestra.run.smithi073.stderr: 4650K .......... .......... .......... .......... .......... 5% 265M 2s 2024-09-12T00:56:18.484 INFO:teuthology.orchestra.run.smithi073.stderr: 4700K .......... .......... .......... .......... .......... 5% 215M 2s 2024-09-12T00:56:18.484 INFO:teuthology.orchestra.run.smithi073.stderr: 4750K .......... .......... .......... .......... .......... 5% 257M 2s 2024-09-12T00:56:18.484 INFO:teuthology.orchestra.run.smithi073.stderr: 4800K .......... .......... .......... .......... .......... 5% 257M 2s 2024-09-12T00:56:18.484 INFO:teuthology.orchestra.run.smithi073.stderr: 4850K .......... .......... .......... .......... .......... 5% 274M 2s 2024-09-12T00:56:18.484 INFO:teuthology.orchestra.run.smithi073.stderr: 4900K .......... .......... .......... .......... .......... 5% 251M 2s 2024-09-12T00:56:18.484 INFO:teuthology.orchestra.run.smithi073.stderr: 4950K .......... .......... .......... .......... .......... 5% 271M 2s 2024-09-12T00:56:18.485 INFO:teuthology.orchestra.run.smithi073.stderr: 5000K .......... .......... .......... .......... .......... 5% 253M 2s 2024-09-12T00:56:18.485 INFO:teuthology.orchestra.run.smithi073.stderr: 5050K .......... .......... .......... .......... .......... 5% 234M 2s 2024-09-12T00:56:18.485 INFO:teuthology.orchestra.run.smithi073.stderr: 5100K .......... .......... .......... .......... .......... 5% 231M 2s 2024-09-12T00:56:18.485 INFO:teuthology.orchestra.run.smithi073.stderr: 5150K .......... .......... .......... .......... .......... 5% 274M 2s 2024-09-12T00:56:18.485 INFO:teuthology.orchestra.run.smithi073.stderr: 5200K .......... .......... .......... .......... .......... 5% 261M 2s 2024-09-12T00:56:18.485 INFO:teuthology.orchestra.run.smithi073.stderr: 5250K .......... .......... .......... .......... .......... 5% 242M 2s 2024-09-12T00:56:18.485 INFO:teuthology.orchestra.run.smithi073.stderr: 5300K .......... .......... .......... .......... .......... 5% 244M 2s 2024-09-12T00:56:18.485 INFO:teuthology.orchestra.run.smithi073.stderr: 5350K .......... .......... .......... .......... .......... 5% 280M 2s 2024-09-12T00:56:18.485 INFO:teuthology.orchestra.run.smithi073.stderr: 5400K .......... .......... .......... .......... .......... 5% 259M 2s 2024-09-12T00:56:18.485 INFO:teuthology.orchestra.run.smithi073.stderr: 5450K .......... .......... .......... .......... .......... 5% 276M 2s 2024-09-12T00:56:18.485 INFO:teuthology.orchestra.run.smithi073.stderr: 5500K .......... .......... .......... .......... .......... 5% 214M 2s 2024-09-12T00:56:18.485 INFO:teuthology.orchestra.run.smithi073.stderr: 5550K .......... .......... .......... .......... .......... 6% 256M 2s 2024-09-12T00:56:18.485 INFO:teuthology.orchestra.run.smithi073.stderr: 5600K .......... .......... .......... .......... .......... 6% 270M 2s 2024-09-12T00:56:18.485 INFO:teuthology.orchestra.run.smithi073.stderr: 5650K .......... .......... .......... .......... .......... 6% 268M 2s 2024-09-12T00:56:18.486 INFO:teuthology.orchestra.run.smithi073.stderr: 5700K .......... .......... .......... .......... .......... 6% 249M 2s 2024-09-12T00:56:18.486 INFO:teuthology.orchestra.run.smithi073.stderr: 5750K .......... .......... .......... .......... .......... 6% 201M 2s 2024-09-12T00:56:18.486 INFO:teuthology.orchestra.run.smithi073.stderr: 5800K .......... .......... .......... .......... .......... 6% 206M 2s 2024-09-12T00:56:18.486 INFO:teuthology.orchestra.run.smithi073.stderr: 5850K .......... .......... .......... .......... .......... 6% 248M 2s 2024-09-12T00:56:18.486 INFO:teuthology.orchestra.run.smithi073.stderr: 5900K .......... .......... .......... .......... .......... 6% 195M 2s 2024-09-12T00:56:18.486 INFO:teuthology.orchestra.run.smithi073.stderr: 5950K .......... .......... .......... .......... .......... 6% 231M 2s 2024-09-12T00:56:18.486 INFO:teuthology.orchestra.run.smithi073.stderr: 6000K .......... .......... .......... .......... .......... 6% 240M 1s 2024-09-12T00:56:18.486 INFO:teuthology.orchestra.run.smithi073.stderr: 6050K .......... .......... .......... .......... .......... 6% 274M 1s 2024-09-12T00:56:18.486 INFO:teuthology.orchestra.run.smithi073.stderr: 6100K .......... .......... .......... .......... .......... 6% 247M 1s 2024-09-12T00:56:18.486 INFO:teuthology.orchestra.run.smithi073.stderr: 6150K .......... .......... .......... .......... .......... 6% 275M 1s 2024-09-12T00:56:18.486 INFO:teuthology.orchestra.run.smithi073.stderr: 6200K .......... .......... .......... .......... .......... 6% 264M 1s 2024-09-12T00:56:18.486 INFO:teuthology.orchestra.run.smithi073.stderr: 6250K .......... .......... .......... .......... .......... 6% 248M 1s 2024-09-12T00:56:18.486 INFO:teuthology.orchestra.run.smithi073.stderr: 6300K .......... .......... .......... .......... .......... 6% 226M 1s 2024-09-12T00:56:18.487 INFO:teuthology.orchestra.run.smithi073.stderr: 6350K .......... .......... .......... .......... .......... 6% 267M 1s 2024-09-12T00:56:18.487 INFO:teuthology.orchestra.run.smithi073.stderr: 6400K .......... .......... .......... .......... .......... 6% 276M 1s 2024-09-12T00:56:18.487 INFO:teuthology.orchestra.run.smithi073.stderr: 6450K .......... .......... .......... .......... .......... 6% 270M 1s 2024-09-12T00:56:18.487 INFO:teuthology.orchestra.run.smithi073.stderr: 6500K .......... .......... .......... .......... .......... 7% 247M 1s 2024-09-12T00:56:18.487 INFO:teuthology.orchestra.run.smithi073.stderr: 6550K .......... .......... .......... .......... .......... 7% 281M 1s 2024-09-12T00:56:18.487 INFO:teuthology.orchestra.run.smithi073.stderr: 6600K .......... .......... .......... .......... .......... 7% 237M 1s 2024-09-12T00:56:18.487 INFO:teuthology.orchestra.run.smithi073.stderr: 6650K .......... .......... .......... .......... .......... 7% 268M 1s 2024-09-12T00:56:18.487 INFO:teuthology.orchestra.run.smithi073.stderr: 6700K .......... .......... .......... .......... .......... 7% 225M 1s 2024-09-12T00:56:18.487 INFO:teuthology.orchestra.run.smithi073.stderr: 6750K .......... .......... .......... .......... .......... 7% 270M 1s 2024-09-12T00:56:18.487 INFO:teuthology.orchestra.run.smithi073.stderr: 6800K .......... .......... .......... .......... .......... 7% 262M 1s 2024-09-12T00:56:18.487 INFO:teuthology.orchestra.run.smithi073.stderr: 6850K .......... .......... .......... .......... .......... 7% 278M 1s 2024-09-12T00:56:18.487 INFO:teuthology.orchestra.run.smithi073.stderr: 6900K .......... .......... .......... .......... .......... 7% 223M 1s 2024-09-12T00:56:18.488 INFO:teuthology.orchestra.run.smithi073.stderr: 6950K .......... .......... .......... .......... .......... 7% 307M 1s 2024-09-12T00:56:18.488 INFO:teuthology.orchestra.run.smithi073.stderr: 7000K .......... .......... .......... .......... .......... 7% 294M 1s 2024-09-12T00:56:18.488 INFO:teuthology.orchestra.run.smithi073.stderr: 7050K .......... .......... .......... .......... .......... 7% 252M 1s 2024-09-12T00:56:18.488 INFO:teuthology.orchestra.run.smithi073.stderr: 7100K .......... .......... .......... .......... .......... 7% 219M 1s 2024-09-12T00:56:18.488 INFO:teuthology.orchestra.run.smithi073.stderr: 7150K .......... .......... .......... .......... .......... 7% 264M 1s 2024-09-12T00:56:18.488 INFO:teuthology.orchestra.run.smithi073.stderr: 7200K .......... .......... .......... .......... .......... 7% 295M 1s 2024-09-12T00:56:18.488 INFO:teuthology.orchestra.run.smithi073.stderr: 7250K .......... .......... .......... .......... .......... 7% 253M 1s 2024-09-12T00:56:18.488 INFO:teuthology.orchestra.run.smithi073.stderr: 7300K .......... .......... .......... .......... .......... 7% 224M 1s 2024-09-12T00:56:18.488 INFO:teuthology.orchestra.run.smithi073.stderr: 7350K .......... .......... .......... .......... .......... 7% 282M 1s 2024-09-12T00:56:18.488 INFO:teuthology.orchestra.run.smithi073.stderr: 7400K .......... .......... .......... .......... .......... 8% 241M 1s 2024-09-12T00:56:18.488 INFO:teuthology.orchestra.run.smithi073.stderr: 7450K .......... .......... .......... .......... .......... 8% 40.3M 1s 2024-09-12T00:56:18.488 INFO:teuthology.orchestra.run.smithi073.stderr: 7500K .......... .......... .......... .......... .......... 8% 173M 1s 2024-09-12T00:56:18.488 INFO:teuthology.orchestra.run.smithi073.stderr: 7550K .......... .......... .......... .......... .......... 8% 230M 1s 2024-09-12T00:56:18.489 INFO:teuthology.orchestra.run.smithi073.stderr: 7600K .......... .......... .......... .......... .......... 8% 272M 1s 2024-09-12T00:56:18.489 INFO:teuthology.orchestra.run.smithi073.stderr: 7650K .......... .......... .......... .......... .......... 8% 279M 1s 2024-09-12T00:56:18.489 INFO:teuthology.orchestra.run.smithi073.stderr: 7700K .......... .......... .......... .......... .......... 8% 231M 1s 2024-09-12T00:56:18.489 INFO:teuthology.orchestra.run.smithi073.stderr: 7750K .......... .......... .......... .......... .......... 8% 276M 1s 2024-09-12T00:56:18.489 INFO:teuthology.orchestra.run.smithi073.stderr: 7800K .......... .......... .......... .......... .......... 8% 275M 1s 2024-09-12T00:56:18.489 INFO:teuthology.orchestra.run.smithi073.stderr: 7850K .......... .......... .......... .......... .......... 8% 284M 1s 2024-09-12T00:56:18.489 INFO:teuthology.orchestra.run.smithi073.stderr: 7900K .......... .......... .......... .......... .......... 8% 232M 1s 2024-09-12T00:56:18.489 INFO:teuthology.orchestra.run.smithi073.stderr: 7950K .......... .......... .......... .......... .......... 8% 283M 1s 2024-09-12T00:56:18.489 INFO:teuthology.orchestra.run.smithi073.stderr: 8000K .......... .......... .......... .......... .......... 8% 278M 1s 2024-09-12T00:56:18.489 INFO:teuthology.orchestra.run.smithi073.stderr: 8050K .......... .......... .......... .......... .......... 8% 275M 1s 2024-09-12T00:56:18.489 INFO:teuthology.orchestra.run.smithi073.stderr: 8100K .......... .......... .......... .......... .......... 8% 251M 1s 2024-09-12T00:56:18.489 INFO:teuthology.orchestra.run.smithi073.stderr: 8150K .......... .......... .......... .......... .......... 8% 291M 1s 2024-09-12T00:56:18.489 INFO:teuthology.orchestra.run.smithi073.stderr: 8200K .......... .......... .......... .......... .......... 8% 294M 1s 2024-09-12T00:56:18.490 INFO:teuthology.orchestra.run.smithi073.stderr: 8250K .......... .......... .......... .......... .......... 8% 232M 1s 2024-09-12T00:56:18.490 INFO:teuthology.orchestra.run.smithi073.stderr: 8300K .......... .......... .......... .......... .......... 8% 232M 1s 2024-09-12T00:56:18.490 INFO:teuthology.orchestra.run.smithi073.stderr: 8350K .......... .......... .......... .......... .......... 9% 269M 1s 2024-09-12T00:56:18.490 INFO:teuthology.orchestra.run.smithi073.stderr: 8400K .......... .......... .......... .......... .......... 9% 280M 1s 2024-09-12T00:56:18.490 INFO:teuthology.orchestra.run.smithi073.stderr: 8450K .......... .......... .......... .......... .......... 9% 285M 1s 2024-09-12T00:56:18.490 INFO:teuthology.orchestra.run.smithi073.stderr: 8500K .......... .......... .......... .......... .......... 9% 258M 1s 2024-09-12T00:56:18.490 INFO:teuthology.orchestra.run.smithi073.stderr: 8550K .......... .......... .......... .......... .......... 9% 286M 1s 2024-09-12T00:56:18.490 INFO:teuthology.orchestra.run.smithi073.stderr: 8600K .......... .......... .......... .......... .......... 9% 284M 1s 2024-09-12T00:56:18.490 INFO:teuthology.orchestra.run.smithi073.stderr: 8650K .......... .......... .......... .......... .......... 9% 173M 1s 2024-09-12T00:56:18.490 INFO:teuthology.orchestra.run.smithi073.stderr: 8700K .......... .......... .......... .......... .......... 9% 219M 1s 2024-09-12T00:56:18.490 INFO:teuthology.orchestra.run.smithi073.stderr: 8750K .......... .......... .......... .......... .......... 9% 261M 1s 2024-09-12T00:56:18.490 INFO:teuthology.orchestra.run.smithi073.stderr: 8800K .......... .......... .......... .......... .......... 9% 218M 1s 2024-09-12T00:56:18.490 INFO:teuthology.orchestra.run.smithi073.stderr: 8850K .......... .......... .......... .......... .......... 9% 263M 1s 2024-09-12T00:56:18.490 INFO:teuthology.orchestra.run.smithi073.stderr: 8900K .......... .......... .......... .......... .......... 9% 201M 1s 2024-09-12T00:56:18.491 INFO:teuthology.orchestra.run.smithi073.stderr: 8950K .......... .......... .......... .......... .......... 9% 222M 1s 2024-09-12T00:56:18.491 INFO:teuthology.orchestra.run.smithi073.stderr: 9000K .......... .......... .......... .......... .......... 9% 249M 1s 2024-09-12T00:56:18.491 INFO:teuthology.orchestra.run.smithi073.stderr: 9050K .......... .......... .......... .......... .......... 9% 268M 1s 2024-09-12T00:56:18.491 INFO:teuthology.orchestra.run.smithi073.stderr: 9100K .......... .......... .......... .......... .......... 9% 215M 1s 2024-09-12T00:56:18.491 INFO:teuthology.orchestra.run.smithi073.stderr: 9150K .......... .......... .......... .......... .......... 9% 290M 1s 2024-09-12T00:56:18.491 INFO:teuthology.orchestra.run.smithi073.stderr: 9200K .......... .......... .......... .......... .......... 9% 283M 1s 2024-09-12T00:56:18.491 INFO:teuthology.orchestra.run.smithi073.stderr: 9250K .......... .......... .......... .......... .......... 10% 214M 1s 2024-09-12T00:56:18.491 INFO:teuthology.orchestra.run.smithi073.stderr: 9300K .......... .......... .......... .......... .......... 10% 254M 1s 2024-09-12T00:56:18.491 INFO:teuthology.orchestra.run.smithi073.stderr: 9350K .......... .......... .......... .......... .......... 10% 270M 1s 2024-09-12T00:56:18.491 INFO:teuthology.orchestra.run.smithi073.stderr: 9400K .......... .......... .......... .......... .......... 10% 276M 1s 2024-09-12T00:56:18.491 INFO:teuthology.orchestra.run.smithi073.stderr: 9450K .......... .......... .......... .......... .......... 10% 291M 1s 2024-09-12T00:56:18.491 INFO:teuthology.orchestra.run.smithi073.stderr: 9500K .......... .......... .......... .......... .......... 10% 242M 1s 2024-09-12T00:56:18.491 INFO:teuthology.orchestra.run.smithi073.stderr: 9550K .......... .......... .......... .......... .......... 10% 278M 1s 2024-09-12T00:56:18.492 INFO:teuthology.orchestra.run.smithi073.stderr: 9600K .......... .......... .......... .......... .......... 10% 207M 1s 2024-09-12T00:56:18.492 INFO:teuthology.orchestra.run.smithi073.stderr: 9650K .......... .......... .......... .......... .......... 10% 314M 1s 2024-09-12T00:56:18.492 INFO:teuthology.orchestra.run.smithi073.stderr: 9700K .......... .......... .......... .......... .......... 10% 295M 1s 2024-09-12T00:56:18.492 INFO:teuthology.orchestra.run.smithi073.stderr: 9750K .......... .......... .......... .......... .......... 10% 346M 1s 2024-09-12T00:56:18.492 INFO:teuthology.orchestra.run.smithi073.stderr: 9800K .......... .......... .......... .......... .......... 10% 373M 1s 2024-09-12T00:56:18.492 INFO:teuthology.orchestra.run.smithi073.stderr: 9850K .......... .......... .......... .......... .......... 10% 362M 1s 2024-09-12T00:56:18.492 INFO:teuthology.orchestra.run.smithi073.stderr: 9900K .......... .......... .......... .......... .......... 10% 292M 1s 2024-09-12T00:56:18.492 INFO:teuthology.orchestra.run.smithi073.stderr: 9950K .......... .......... .......... .......... .......... 10% 318M 1s 2024-09-12T00:56:18.492 INFO:teuthology.orchestra.run.smithi073.stderr: 10000K .......... .......... .......... .......... .......... 10% 340M 1s 2024-09-12T00:56:18.492 INFO:teuthology.orchestra.run.smithi073.stderr: 10050K .......... .......... .......... .......... .......... 10% 286M 1s 2024-09-12T00:56:18.492 INFO:teuthology.orchestra.run.smithi073.stderr: 10100K .......... .......... .......... .......... .......... 10% 284M 1s 2024-09-12T00:56:18.492 INFO:teuthology.orchestra.run.smithi073.stderr: 10150K .......... .......... .......... .......... .......... 10% 336M 1s 2024-09-12T00:56:18.492 INFO:teuthology.orchestra.run.smithi073.stderr: 10200K .......... .......... .......... .......... .......... 11% 316M 1s 2024-09-12T00:56:18.493 INFO:teuthology.orchestra.run.smithi073.stderr: 10250K .......... .......... .......... .......... .......... 11% 65.9M 1s 2024-09-12T00:56:18.493 INFO:teuthology.orchestra.run.smithi073.stderr: 10300K .......... .......... .......... .......... .......... 11% 34.1M 1s 2024-09-12T00:56:18.493 INFO:teuthology.orchestra.run.smithi073.stderr: 10350K .......... .......... .......... .......... .......... 11% 326M 1s 2024-09-12T00:56:18.493 INFO:teuthology.orchestra.run.smithi073.stderr: 10400K .......... .......... .......... .......... .......... 11% 426M 1s 2024-09-12T00:56:18.493 INFO:teuthology.orchestra.run.smithi073.stderr: 10450K .......... .......... .......... .......... .......... 11% 390M 1s 2024-09-12T00:56:18.493 INFO:teuthology.orchestra.run.smithi073.stderr: 10500K .......... .......... .......... .......... .......... 11% 364M 1s 2024-09-12T00:56:18.493 INFO:teuthology.orchestra.run.smithi073.stderr: 10550K .......... .......... .......... .......... .......... 11% 398M 1s 2024-09-12T00:56:18.493 INFO:teuthology.orchestra.run.smithi073.stderr: 10600K .......... .......... .......... .......... .......... 11% 434M 1s 2024-09-12T00:56:18.493 INFO:teuthology.orchestra.run.smithi073.stderr: 10650K .......... .......... .......... .......... .......... 11% 436M 1s 2024-09-12T00:56:18.493 INFO:teuthology.orchestra.run.smithi073.stderr: 10700K .......... .......... .......... .......... .......... 11% 329M 1s 2024-09-12T00:56:18.493 INFO:teuthology.orchestra.run.smithi073.stderr: 10750K .......... .......... .......... .......... .......... 11% 410M 1s 2024-09-12T00:56:18.493 INFO:teuthology.orchestra.run.smithi073.stderr: 10800K .......... .......... .......... .......... .......... 11% 429M 1s 2024-09-12T00:56:18.493 INFO:teuthology.orchestra.run.smithi073.stderr: 10850K .......... .......... .......... .......... .......... 11% 198M 1s 2024-09-12T00:56:18.494 INFO:teuthology.orchestra.run.smithi073.stderr: 10900K .......... .......... .......... .......... .......... 11% 277M 1s 2024-09-12T00:56:18.494 INFO:teuthology.orchestra.run.smithi073.stderr: 10950K .......... .......... .......... .......... .......... 11% 345M 1s 2024-09-12T00:56:18.494 INFO:teuthology.orchestra.run.smithi073.stderr: 11000K .......... .......... .......... .......... .......... 11% 360M 1s 2024-09-12T00:56:18.494 INFO:teuthology.orchestra.run.smithi073.stderr: 11050K .......... .......... .......... .......... .......... 11% 405M 1s 2024-09-12T00:56:18.494 INFO:teuthology.orchestra.run.smithi073.stderr: 11100K .......... .......... .......... .......... .......... 12% 256M 1s 2024-09-12T00:56:18.494 INFO:teuthology.orchestra.run.smithi073.stderr: 11150K .......... .......... .......... .......... .......... 12% 341M 1s 2024-09-12T00:56:18.494 INFO:teuthology.orchestra.run.smithi073.stderr: 11200K .......... .......... .......... .......... .......... 12% 62.5M 1s 2024-09-12T00:56:18.494 INFO:teuthology.orchestra.run.smithi073.stderr: 11250K .......... .......... .......... .......... .......... 12% 344M 1s 2024-09-12T00:56:18.494 INFO:teuthology.orchestra.run.smithi073.stderr: 11300K .......... .......... .......... .......... .......... 12% 311M 1s 2024-09-12T00:56:18.494 INFO:teuthology.orchestra.run.smithi073.stderr: 11350K .......... .......... .......... .......... .......... 12% 364M 1s 2024-09-12T00:56:18.494 INFO:teuthology.orchestra.run.smithi073.stderr: 11400K .......... .......... .......... .......... .......... 12% 361M 1s 2024-09-12T00:56:18.494 INFO:teuthology.orchestra.run.smithi073.stderr: 11450K .......... .......... .......... .......... .......... 12% 393M 1s 2024-09-12T00:56:18.494 INFO:teuthology.orchestra.run.smithi073.stderr: 11500K .......... .......... .......... .......... .......... 12% 346M 1s 2024-09-12T00:56:18.495 INFO:teuthology.orchestra.run.smithi073.stderr: 11550K .......... .......... .......... .......... .......... 12% 394M 1s 2024-09-12T00:56:18.495 INFO:teuthology.orchestra.run.smithi073.stderr: 11600K .......... .......... .......... .......... .......... 12% 426M 1s 2024-09-12T00:56:18.495 INFO:teuthology.orchestra.run.smithi073.stderr: 11650K .......... .......... .......... .......... .......... 12% 396M 1s 2024-09-12T00:56:18.495 INFO:teuthology.orchestra.run.smithi073.stderr: 11700K .......... .......... .......... .......... .......... 12% 328M 1s 2024-09-12T00:56:18.495 INFO:teuthology.orchestra.run.smithi073.stderr: 11750K .......... .......... .......... .......... .......... 12% 355M 1s 2024-09-12T00:56:18.495 INFO:teuthology.orchestra.run.smithi073.stderr: 11800K .......... .......... .......... .......... .......... 12% 380M 1s 2024-09-12T00:56:18.495 INFO:teuthology.orchestra.run.smithi073.stderr: 11850K .......... .......... .......... .......... .......... 12% 270M 1s 2024-09-12T00:56:18.495 INFO:teuthology.orchestra.run.smithi073.stderr: 11900K .......... .......... .......... .......... .......... 12% 256M 1s 2024-09-12T00:56:18.495 INFO:teuthology.orchestra.run.smithi073.stderr: 11950K .......... .......... .......... .......... .......... 12% 129M 1s 2024-09-12T00:56:18.495 INFO:teuthology.orchestra.run.smithi073.stderr: 12000K .......... .......... .......... .......... .......... 12% 156M 1s 2024-09-12T00:56:18.495 INFO:teuthology.orchestra.run.smithi073.stderr: 12050K .......... .......... .......... .......... .......... 13% 222M 1s 2024-09-12T00:56:18.495 INFO:teuthology.orchestra.run.smithi073.stderr: 12100K .......... .......... .......... .......... .......... 13% 261M 1s 2024-09-12T00:56:18.495 INFO:teuthology.orchestra.run.smithi073.stderr: 12150K .......... .......... .......... .......... .......... 13% 346M 1s 2024-09-12T00:56:18.496 INFO:teuthology.orchestra.run.smithi073.stderr: 12200K .......... .......... .......... .......... .......... 13% 342M 1s 2024-09-12T00:56:18.496 INFO:teuthology.orchestra.run.smithi073.stderr: 12250K .......... .......... .......... .......... .......... 13% 360M 1s 2024-09-12T00:56:18.496 INFO:teuthology.orchestra.run.smithi073.stderr: 12300K .......... .......... .......... .......... .......... 13% 150M 1s 2024-09-12T00:56:18.496 INFO:teuthology.orchestra.run.smithi073.stderr: 12350K .......... .......... .......... .......... .......... 13% 337M 1s 2024-09-12T00:56:18.496 INFO:teuthology.orchestra.run.smithi073.stderr: 12400K .......... .......... .......... .......... .......... 13% 141M 1s 2024-09-12T00:56:18.496 INFO:teuthology.orchestra.run.smithi073.stderr: 12450K .......... .......... .......... .......... .......... 13% 321M 1s 2024-09-12T00:56:18.496 INFO:teuthology.orchestra.run.smithi073.stderr: 12500K .......... .......... .......... .......... .......... 13% 340M 1s 2024-09-12T00:56:18.496 INFO:teuthology.orchestra.run.smithi073.stderr: 12550K .......... .......... .......... .......... .......... 13% 282M 1s 2024-09-12T00:56:18.496 INFO:teuthology.orchestra.run.smithi073.stderr: 12600K .......... .......... .......... .......... .......... 13% 324M 1s 2024-09-12T00:56:18.496 INFO:teuthology.orchestra.run.smithi073.stderr: 12650K .......... .......... .......... .......... .......... 13% 364M 1s 2024-09-12T00:56:18.496 INFO:teuthology.orchestra.run.smithi073.stderr: 12700K .......... .......... .......... .......... .......... 13% 342M 1s 2024-09-12T00:56:18.496 INFO:teuthology.orchestra.run.smithi073.stderr: 12750K .......... .......... .......... .......... .......... 13% 317M 1s 2024-09-12T00:56:18.496 INFO:teuthology.orchestra.run.smithi073.stderr: 12800K .......... .......... .......... .......... .......... 13% 292M 1s 2024-09-12T00:56:18.497 INFO:teuthology.orchestra.run.smithi073.stderr: 12850K .......... .......... .......... .......... .......... 13% 311M 1s 2024-09-12T00:56:18.497 INFO:teuthology.orchestra.run.smithi073.stderr: 12900K .......... .......... .......... .......... .......... 13% 302M 1s 2024-09-12T00:56:18.497 INFO:teuthology.orchestra.run.smithi073.stderr: 12950K .......... .......... .......... .......... .......... 13% 86.7M 1s 2024-09-12T00:56:18.497 INFO:teuthology.orchestra.run.smithi073.stderr: 13000K .......... .......... .......... .......... .......... 14% 353M 1s 2024-09-12T00:56:18.497 INFO:teuthology.orchestra.run.smithi073.stderr: 13050K .......... .......... .......... .......... .......... 14% 351M 1s 2024-09-12T00:56:18.497 INFO:teuthology.orchestra.run.smithi073.stderr: 13100K .......... .......... .......... .......... .......... 14% 235M 1s 2024-09-12T00:56:18.497 INFO:teuthology.orchestra.run.smithi073.stderr: 13150K .......... .......... .......... .......... .......... 14% 357M 1s 2024-09-12T00:56:18.497 INFO:teuthology.orchestra.run.smithi073.stderr: 13200K .......... .......... .......... .......... .......... 14% 155M 1s 2024-09-12T00:56:18.497 INFO:teuthology.orchestra.run.smithi073.stderr: 13250K .......... .......... .......... .......... .......... 14% 340M 1s 2024-09-12T00:56:18.497 INFO:teuthology.orchestra.run.smithi073.stderr: 13300K .......... .......... .......... .......... .......... 14% 297M 1s 2024-09-12T00:56:18.497 INFO:teuthology.orchestra.run.smithi073.stderr: 13350K .......... .......... .......... .......... .......... 14% 26.4M 1s 2024-09-12T00:56:18.497 INFO:teuthology.orchestra.run.smithi073.stderr: 13400K .......... .......... .......... .......... .......... 14% 250M 1s 2024-09-12T00:56:18.497 INFO:teuthology.orchestra.run.smithi073.stderr: 13450K .......... .......... .......... .......... .......... 14% 300M 1s 2024-09-12T00:56:18.498 INFO:teuthology.orchestra.run.smithi073.stderr: 13500K .......... .......... .......... .......... .......... 14% 269M 1s 2024-09-12T00:56:18.498 INFO:teuthology.orchestra.run.smithi073.stderr: 13550K .......... .......... .......... .......... .......... 14% 346M 1s 2024-09-12T00:56:18.498 INFO:teuthology.orchestra.run.smithi073.stderr: 13600K .......... .......... .......... .......... .......... 14% 359M 1s 2024-09-12T00:56:18.498 INFO:teuthology.orchestra.run.smithi073.stderr: 13650K .......... .......... .......... .......... .......... 14% 318M 1s 2024-09-12T00:56:18.498 INFO:teuthology.orchestra.run.smithi073.stderr: 13700K .......... .......... .......... .......... .......... 14% 311M 1s 2024-09-12T00:56:18.498 INFO:teuthology.orchestra.run.smithi073.stderr: 13750K .......... .......... .......... .......... .......... 14% 328M 1s 2024-09-12T00:56:18.498 INFO:teuthology.orchestra.run.smithi073.stderr: 13800K .......... .......... .......... .......... .......... 14% 335M 1s 2024-09-12T00:56:18.498 INFO:teuthology.orchestra.run.smithi073.stderr: 13850K .......... .......... .......... .......... .......... 14% 365M 1s 2024-09-12T00:56:18.498 INFO:teuthology.orchestra.run.smithi073.stderr: 13900K .......... .......... .......... .......... .......... 15% 281M 1s 2024-09-12T00:56:18.498 INFO:teuthology.orchestra.run.smithi073.stderr: 13950K .......... .......... .......... .......... .......... 15% 348M 1s 2024-09-12T00:56:18.498 INFO:teuthology.orchestra.run.smithi073.stderr: 14000K .......... .......... .......... .......... .......... 15% 355M 1s 2024-09-12T00:56:18.498 INFO:teuthology.orchestra.run.smithi073.stderr: 14050K .......... .......... .......... .......... .......... 15% 320M 1s 2024-09-12T00:56:18.498 INFO:teuthology.orchestra.run.smithi073.stderr: 14100K .......... .......... .......... .......... .......... 15% 326M 1s 2024-09-12T00:56:18.498 INFO:teuthology.orchestra.run.smithi073.stderr: 14150K .......... .......... .......... .......... .......... 15% 349M 1s 2024-09-12T00:56:18.499 INFO:teuthology.orchestra.run.smithi073.stderr: 14200K .......... .......... .......... .......... .......... 15% 377M 1s 2024-09-12T00:56:18.499 INFO:teuthology.orchestra.run.smithi073.stderr: 14250K .......... .......... .......... .......... .......... 15% 330M 1s 2024-09-12T00:56:18.499 INFO:teuthology.orchestra.run.smithi073.stderr: 14300K .......... .......... .......... .......... .......... 15% 179M 1s 2024-09-12T00:56:18.499 INFO:teuthology.orchestra.run.smithi073.stderr: 14350K .......... .......... .......... .......... .......... 15% 116M 1s 2024-09-12T00:56:18.499 INFO:teuthology.orchestra.run.smithi073.stderr: 14400K .......... .......... .......... .......... .......... 15% 269M 1s 2024-09-12T00:56:18.499 INFO:teuthology.orchestra.run.smithi073.stderr: 14450K .......... .......... .......... .......... .......... 15% 320M 1s 2024-09-12T00:56:18.499 INFO:teuthology.orchestra.run.smithi073.stderr: 14500K .......... .......... .......... .......... .......... 15% 331M 1s 2024-09-12T00:56:18.499 INFO:teuthology.orchestra.run.smithi073.stderr: 14550K .......... .......... .......... .......... .......... 15% 347M 1s 2024-09-12T00:56:18.499 INFO:teuthology.orchestra.run.smithi073.stderr: 14600K .......... .......... .......... .......... .......... 15% 358M 1s 2024-09-12T00:56:18.499 INFO:teuthology.orchestra.run.smithi073.stderr: 14650K .......... .......... .......... .......... .......... 15% 370M 1s 2024-09-12T00:56:18.499 INFO:teuthology.orchestra.run.smithi073.stderr: 14700K .......... .......... .......... .......... .......... 15% 302M 1s 2024-09-12T00:56:18.499 INFO:teuthology.orchestra.run.smithi073.stderr: 14750K .......... .......... .......... .......... .......... 15% 331M 1s 2024-09-12T00:56:18.500 INFO:teuthology.orchestra.run.smithi073.stderr: 14800K .......... .......... .......... .......... .......... 15% 349M 1s 2024-09-12T00:56:18.500 INFO:teuthology.orchestra.run.smithi073.stderr: 14850K .......... .......... .......... .......... .......... 16% 298M 1s 2024-09-12T00:56:18.500 INFO:teuthology.orchestra.run.smithi073.stderr: 14900K .......... .......... .......... .......... .......... 16% 319M 1s 2024-09-12T00:56:18.500 INFO:teuthology.orchestra.run.smithi073.stderr: 14950K .......... .......... .......... .......... .......... 16% 269M 1s 2024-09-12T00:56:18.500 INFO:teuthology.orchestra.run.smithi073.stderr: 15000K .......... .......... .......... .......... .......... 16% 360M 1s 2024-09-12T00:56:18.500 INFO:teuthology.orchestra.run.smithi073.stderr: 15050K .......... .......... .......... .......... .......... 16% 262M 1s 2024-09-12T00:56:18.500 INFO:teuthology.orchestra.run.smithi073.stderr: 15100K .......... .......... .......... .......... .......... 16% 297M 1s 2024-09-12T00:56:18.500 INFO:teuthology.orchestra.run.smithi073.stderr: 15150K .......... .......... .......... .......... .......... 16% 346M 1s 2024-09-12T00:56:18.500 INFO:teuthology.orchestra.run.smithi073.stderr: 15200K .......... .......... .......... .......... .......... 16% 310M 1s 2024-09-12T00:56:18.500 INFO:teuthology.orchestra.run.smithi073.stderr: 15250K .......... .......... .......... .......... .......... 16% 254M 1s 2024-09-12T00:56:18.500 INFO:teuthology.orchestra.run.smithi073.stderr: 15300K .......... .......... .......... .......... .......... 16% 98.1M 1s 2024-09-12T00:56:18.500 INFO:teuthology.orchestra.run.smithi073.stderr: 15350K .......... .......... .......... .......... .......... 16% 321M 1s 2024-09-12T00:56:18.500 INFO:teuthology.orchestra.run.smithi073.stderr: 15400K .......... .......... .......... .......... .......... 16% 394M 1s 2024-09-12T00:56:18.501 INFO:teuthology.orchestra.run.smithi073.stderr: 15450K .......... .......... .......... .......... .......... 16% 146M 1s 2024-09-12T00:56:18.501 INFO:teuthology.orchestra.run.smithi073.stderr: 15500K .......... .......... .......... .......... .......... 16% 295M 1s 2024-09-12T00:56:18.501 INFO:teuthology.orchestra.run.smithi073.stderr: 15550K .......... .......... .......... .......... .......... 16% 340M 1s 2024-09-12T00:56:18.501 INFO:teuthology.orchestra.run.smithi073.stderr: 15600K .......... .......... .......... .......... .......... 16% 366M 1s 2024-09-12T00:56:18.501 INFO:teuthology.orchestra.run.smithi073.stderr: 15650K .......... .......... .......... .......... .......... 16% 377M 1s 2024-09-12T00:56:18.501 INFO:teuthology.orchestra.run.smithi073.stderr: 15700K .......... .......... .......... .......... .......... 16% 318M 1s 2024-09-12T00:56:18.501 INFO:teuthology.orchestra.run.smithi073.stderr: 15750K .......... .......... .......... .......... .......... 17% 361M 1s 2024-09-12T00:56:18.501 INFO:teuthology.orchestra.run.smithi073.stderr: 15800K .......... .......... .......... .......... .......... 17% 337M 1s 2024-09-12T00:56:18.501 INFO:teuthology.orchestra.run.smithi073.stderr: 15850K .......... .......... .......... .......... .......... 17% 405M 1s 2024-09-12T00:56:18.501 INFO:teuthology.orchestra.run.smithi073.stderr: 15900K .......... .......... .......... .......... .......... 17% 294M 1s 2024-09-12T00:56:18.501 INFO:teuthology.orchestra.run.smithi073.stderr: 15950K .......... .......... .......... .......... .......... 17% 77.1M 1s 2024-09-12T00:56:18.501 INFO:teuthology.orchestra.run.smithi073.stderr: 16000K .......... .......... .......... .......... .......... 17% 344M 1s 2024-09-12T00:56:18.501 INFO:teuthology.orchestra.run.smithi073.stderr: 16050K .......... .......... .......... .......... .......... 17% 336M 1s 2024-09-12T00:56:18.501 INFO:teuthology.orchestra.run.smithi073.stderr: 16100K .......... .......... .......... .......... .......... 17% 332M 1s 2024-09-12T00:56:18.502 INFO:teuthology.orchestra.run.smithi073.stderr: 16150K .......... .......... .......... .......... .......... 17% 357M 1s 2024-09-12T00:56:18.502 INFO:teuthology.orchestra.run.smithi073.stderr: 16200K .......... .......... .......... .......... .......... 17% 208M 1s 2024-09-12T00:56:18.502 INFO:teuthology.orchestra.run.smithi073.stderr: 16250K .......... .......... .......... .......... .......... 17% 332M 1s 2024-09-12T00:56:18.502 INFO:teuthology.orchestra.run.smithi073.stderr: 16300K .......... .......... .......... .......... .......... 17% 292M 1s 2024-09-12T00:56:18.502 INFO:teuthology.orchestra.run.smithi073.stderr: 16350K .......... .......... .......... .......... .......... 17% 217M 1s 2024-09-12T00:56:18.502 INFO:teuthology.orchestra.run.smithi073.stderr: 16400K .......... .......... .......... .......... .......... 17% 70.1M 1s 2024-09-12T00:56:18.502 INFO:teuthology.orchestra.run.smithi073.stderr: 16450K .......... .......... .......... .......... .......... 17% 43.5M 1s 2024-09-12T00:56:18.502 INFO:teuthology.orchestra.run.smithi073.stderr: 16500K .......... .......... .......... .......... .......... 17% 266M 1s 2024-09-12T00:56:18.502 INFO:teuthology.orchestra.run.smithi073.stderr: 16550K .......... .......... .......... .......... .......... 17% 115M 1s 2024-09-12T00:56:18.502 INFO:teuthology.orchestra.run.smithi073.stderr: 16600K .......... .......... .......... .......... .......... 17% 319M 1s 2024-09-12T00:56:18.502 INFO:teuthology.orchestra.run.smithi073.stderr: 16650K .......... .......... .......... .......... .......... 17% 345M 1s 2024-09-12T00:56:18.502 INFO:teuthology.orchestra.run.smithi073.stderr: 16700K .......... .......... .......... .......... .......... 18% 297M 1s 2024-09-12T00:56:18.502 INFO:teuthology.orchestra.run.smithi073.stderr: 16750K .......... .......... .......... .......... .......... 18% 344M 1s 2024-09-12T00:56:18.503 INFO:teuthology.orchestra.run.smithi073.stderr: 16800K .......... .......... .......... .......... .......... 18% 382M 1s 2024-09-12T00:56:18.503 INFO:teuthology.orchestra.run.smithi073.stderr: 16850K .......... .......... .......... .......... .......... 18% 357M 1s 2024-09-12T00:56:18.503 INFO:teuthology.orchestra.run.smithi073.stderr: 16900K .......... .......... .......... .......... .......... 18% 320M 1s 2024-09-12T00:56:18.503 INFO:teuthology.orchestra.run.smithi073.stderr: 16950K .......... .......... .......... .......... .......... 18% 328M 1s 2024-09-12T00:56:18.503 INFO:teuthology.orchestra.run.smithi073.stderr: 17000K .......... .......... .......... .......... .......... 18% 353M 1s 2024-09-12T00:56:18.503 INFO:teuthology.orchestra.run.smithi073.stderr: 17050K .......... .......... .......... .......... .......... 18% 344M 1s 2024-09-12T00:56:18.503 INFO:teuthology.orchestra.run.smithi073.stderr: 17100K .......... .......... .......... .......... .......... 18% 288M 1s 2024-09-12T00:56:18.503 INFO:teuthology.orchestra.run.smithi073.stderr: 17150K .......... .......... .......... .......... .......... 18% 350M 1s 2024-09-12T00:56:18.503 INFO:teuthology.orchestra.run.smithi073.stderr: 17200K .......... .......... .......... .......... .......... 18% 339M 1s 2024-09-12T00:56:18.503 INFO:teuthology.orchestra.run.smithi073.stderr: 17250K .......... .......... .......... .......... .......... 18% 355M 1s 2024-09-12T00:56:18.503 INFO:teuthology.orchestra.run.smithi073.stderr: 17300K .......... .......... .......... .......... .......... 18% 268M 1s 2024-09-12T00:56:18.503 INFO:teuthology.orchestra.run.smithi073.stderr: 17350K .......... .......... .......... .......... .......... 18% 364M 1s 2024-09-12T00:56:18.503 INFO:teuthology.orchestra.run.smithi073.stderr: 17400K .......... .......... .......... .......... .......... 18% 118M 1s 2024-09-12T00:56:18.504 INFO:teuthology.orchestra.run.smithi073.stderr: 17450K .......... .......... .......... .......... .......... 18% 348M 1s 2024-09-12T00:56:18.504 INFO:teuthology.orchestra.run.smithi073.stderr: 17500K .......... .......... .......... .......... .......... 18% 239M 1s 2024-09-12T00:56:18.504 INFO:teuthology.orchestra.run.smithi073.stderr: 17550K .......... .......... .......... .......... .......... 18% 338M 1s 2024-09-12T00:56:18.504 INFO:teuthology.orchestra.run.smithi073.stderr: 17600K .......... .......... .......... .......... .......... 18% 305M 1s 2024-09-12T00:56:18.504 INFO:teuthology.orchestra.run.smithi073.stderr: 17650K .......... .......... .......... .......... .......... 19% 132M 1s 2024-09-12T00:56:18.504 INFO:teuthology.orchestra.run.smithi073.stderr: 17700K .......... .......... .......... .......... .......... 19% 325M 1s 2024-09-12T00:56:18.504 INFO:teuthology.orchestra.run.smithi073.stderr: 17750K .......... .......... .......... .......... .......... 19% 370M 1s 2024-09-12T00:56:18.504 INFO:teuthology.orchestra.run.smithi073.stderr: 17800K .......... .......... .......... .......... .......... 19% 338M 1s 2024-09-12T00:56:18.504 INFO:teuthology.orchestra.run.smithi073.stderr: 17850K .......... .......... .......... .......... .......... 19% 350M 1s 2024-09-12T00:56:18.504 INFO:teuthology.orchestra.run.smithi073.stderr: 17900K .......... .......... .......... .......... .......... 19% 213M 1s 2024-09-12T00:56:18.504 INFO:teuthology.orchestra.run.smithi073.stderr: 17950K .......... .......... .......... .......... .......... 19% 406M 1s 2024-09-12T00:56:18.504 INFO:teuthology.orchestra.run.smithi073.stderr: 18000K .......... .......... .......... .......... .......... 19% 347M 1s 2024-09-12T00:56:18.504 INFO:teuthology.orchestra.run.smithi073.stderr: 18050K .......... .......... .......... .......... .......... 19% 345M 1s 2024-09-12T00:56:18.505 INFO:teuthology.orchestra.run.smithi073.stderr: 18100K .......... .......... .......... .......... .......... 19% 285M 1s 2024-09-12T00:56:18.505 INFO:teuthology.orchestra.run.smithi073.stderr: 18150K .......... .......... .......... .......... .......... 19% 285M 1s 2024-09-12T00:56:18.505 INFO:teuthology.orchestra.run.smithi073.stderr: 18200K .......... .......... .......... .......... .......... 19% 361M 1s 2024-09-12T00:56:18.505 INFO:teuthology.orchestra.run.smithi073.stderr: 18250K .......... .......... .......... .......... .......... 19% 319M 1s 2024-09-12T00:56:18.505 INFO:teuthology.orchestra.run.smithi073.stderr: 18300K .......... .......... .......... .......... .......... 19% 308M 1s 2024-09-12T00:56:18.505 INFO:teuthology.orchestra.run.smithi073.stderr: 18350K .......... .......... .......... .......... .......... 19% 335M 1s 2024-09-12T00:56:18.505 INFO:teuthology.orchestra.run.smithi073.stderr: 18400K .......... .......... .......... .......... .......... 19% 342M 1s 2024-09-12T00:56:18.505 INFO:teuthology.orchestra.run.smithi073.stderr: 18450K .......... .......... .......... .......... .......... 19% 195M 1s 2024-09-12T00:56:18.505 INFO:teuthology.orchestra.run.smithi073.stderr: 18500K .......... .......... .......... .......... .......... 19% 102M 1s 2024-09-12T00:56:18.505 INFO:teuthology.orchestra.run.smithi073.stderr: 18550K .......... .......... .......... .......... .......... 20% 319M 1s 2024-09-12T00:56:18.505 INFO:teuthology.orchestra.run.smithi073.stderr: 18600K .......... .......... .......... .......... .......... 20% 384M 1s 2024-09-12T00:56:18.505 INFO:teuthology.orchestra.run.smithi073.stderr: 18650K .......... .......... .......... .......... .......... 20% 147M 1s 2024-09-12T00:56:18.505 INFO:teuthology.orchestra.run.smithi073.stderr: 18700K .......... .......... .......... .......... .......... 20% 257M 1s 2024-09-12T00:56:18.506 INFO:teuthology.orchestra.run.smithi073.stderr: 18750K .......... .......... .......... .......... .......... 20% 245M 1s 2024-09-12T00:56:18.506 INFO:teuthology.orchestra.run.smithi073.stderr: 18800K .......... .......... .......... .......... .......... 20% 264M 1s 2024-09-12T00:56:18.506 INFO:teuthology.orchestra.run.smithi073.stderr: 18850K .......... .......... .......... .......... .......... 20% 365M 1s 2024-09-12T00:56:18.506 INFO:teuthology.orchestra.run.smithi073.stderr: 18900K .......... .......... .......... .......... .......... 20% 324M 1s 2024-09-12T00:56:18.506 INFO:teuthology.orchestra.run.smithi073.stderr: 18950K .......... .......... .......... .......... .......... 20% 388M 1s 2024-09-12T00:56:18.506 INFO:teuthology.orchestra.run.smithi073.stderr: 19000K .......... .......... .......... .......... .......... 20% 394M 1s 2024-09-12T00:56:18.506 INFO:teuthology.orchestra.run.smithi073.stderr: 19050K .......... .......... .......... .......... .......... 20% 398M 1s 2024-09-12T00:56:18.506 INFO:teuthology.orchestra.run.smithi073.stderr: 19100K .......... .......... .......... .......... .......... 20% 360M 1s 2024-09-12T00:56:18.506 INFO:teuthology.orchestra.run.smithi073.stderr: 19150K .......... .......... .......... .......... .......... 20% 32.2M 1s 2024-09-12T00:56:18.506 INFO:teuthology.orchestra.run.smithi073.stderr: 19200K .......... .......... .......... .......... .......... 20% 380M 1s 2024-09-12T00:56:18.506 INFO:teuthology.orchestra.run.smithi073.stderr: 19250K .......... .......... .......... .......... .......... 20% 352M 1s 2024-09-12T00:56:18.506 INFO:teuthology.orchestra.run.smithi073.stderr: 19300K .......... .......... .......... .......... .......... 20% 380M 1s 2024-09-12T00:56:18.506 INFO:teuthology.orchestra.run.smithi073.stderr: 19350K .......... .......... .......... .......... .......... 20% 406M 1s 2024-09-12T00:56:18.507 INFO:teuthology.orchestra.run.smithi073.stderr: 19400K .......... .......... .......... .......... .......... 20% 395M 1s 2024-09-12T00:56:18.507 INFO:teuthology.orchestra.run.smithi073.stderr: 19450K .......... .......... .......... .......... .......... 20% 419M 1s 2024-09-12T00:56:18.507 INFO:teuthology.orchestra.run.smithi073.stderr: 19500K .......... .......... .......... .......... .......... 21% 85.6M 1s 2024-09-12T00:56:18.507 INFO:teuthology.orchestra.run.smithi073.stderr: 19550K .......... .......... .......... .......... .......... 21% 141M 1s 2024-09-12T00:56:18.507 INFO:teuthology.orchestra.run.smithi073.stderr: 19600K .......... .......... .......... .......... .......... 21% 143M 1s 2024-09-12T00:56:18.507 INFO:teuthology.orchestra.run.smithi073.stderr: 19650K .......... .......... .......... .......... .......... 21% 389M 1s 2024-09-12T00:56:18.507 INFO:teuthology.orchestra.run.smithi073.stderr: 19700K .......... .......... .......... .......... .......... 21% 231M 1s 2024-09-12T00:56:18.507 INFO:teuthology.orchestra.run.smithi073.stderr: 19750K .......... .......... .......... .......... .......... 21% 381M 1s 2024-09-12T00:56:18.507 INFO:teuthology.orchestra.run.smithi073.stderr: 19800K .......... .......... .......... .......... .......... 21% 368M 1s 2024-09-12T00:56:18.507 INFO:teuthology.orchestra.run.smithi073.stderr: 19850K .......... .......... .......... .......... .......... 21% 228M 1s 2024-09-12T00:56:18.507 INFO:teuthology.orchestra.run.smithi073.stderr: 19900K .......... .......... .......... .......... .......... 21% 131M 1s 2024-09-12T00:56:18.507 INFO:teuthology.orchestra.run.smithi073.stderr: 19950K .......... .......... .......... .......... .......... 21% 345M 1s 2024-09-12T00:56:18.507 INFO:teuthology.orchestra.run.smithi073.stderr: 20000K .......... .......... .......... .......... .......... 21% 359M 1s 2024-09-12T00:56:18.508 INFO:teuthology.orchestra.run.smithi073.stderr: 20050K .......... .......... .......... .......... .......... 21% 332M 1s 2024-09-12T00:56:18.508 INFO:teuthology.orchestra.run.smithi073.stderr: 20100K .......... .......... .......... .......... .......... 21% 359M 1s 2024-09-12T00:56:18.508 INFO:teuthology.orchestra.run.smithi073.stderr: 20150K .......... .......... .......... .......... .......... 21% 428M 1s 2024-09-12T00:56:18.508 INFO:teuthology.orchestra.run.smithi073.stderr: 20200K .......... .......... .......... .......... .......... 21% 353M 1s 2024-09-12T00:56:18.508 INFO:teuthology.orchestra.run.smithi073.stderr: 20250K .......... .......... .......... .......... .......... 21% 406M 1s 2024-09-12T00:56:18.508 INFO:teuthology.orchestra.run.smithi073.stderr: 20300K .......... .......... .......... .......... .......... 21% 343M 1s 2024-09-12T00:56:18.508 INFO:teuthology.orchestra.run.smithi073.stderr: 20350K .......... .......... .......... .......... .......... 21% 449M 1s 2024-09-12T00:56:18.508 INFO:teuthology.orchestra.run.smithi073.stderr: 20400K .......... .......... .......... .......... .......... 22% 98.8M 1s 2024-09-12T00:56:18.508 INFO:teuthology.orchestra.run.smithi073.stderr: 20450K .......... .......... .......... .......... .......... 22% 362M 1s 2024-09-12T00:56:18.508 INFO:teuthology.orchestra.run.smithi073.stderr: 20500K .......... .......... .......... .......... .......... 22% 436M 1s 2024-09-12T00:56:18.508 INFO:teuthology.orchestra.run.smithi073.stderr: 20550K .......... .......... .......... .......... .......... 22% 264M 1s 2024-09-12T00:56:18.508 INFO:teuthology.orchestra.run.smithi073.stderr: 20600K .......... .......... .......... .......... .......... 22% 349M 1s 2024-09-12T00:56:18.508 INFO:teuthology.orchestra.run.smithi073.stderr: 20650K .......... .......... .......... .......... .......... 22% 427M 1s 2024-09-12T00:56:18.509 INFO:teuthology.orchestra.run.smithi073.stderr: 20700K .......... .......... .......... .......... .......... 22% 291M 1s 2024-09-12T00:56:18.509 INFO:teuthology.orchestra.run.smithi073.stderr: 20750K .......... .......... .......... .......... .......... 22% 447M 1s 2024-09-12T00:56:18.509 INFO:teuthology.orchestra.run.smithi073.stderr: 20800K .......... .......... .......... .......... .......... 22% 152M 1s 2024-09-12T00:56:18.509 INFO:teuthology.orchestra.run.smithi073.stderr: 20850K .......... .......... .......... .......... .......... 22% 184M 1s 2024-09-12T00:56:18.509 INFO:teuthology.orchestra.run.smithi073.stderr: 20900K .......... .......... .......... .......... .......... 22% 354M 1s 2024-09-12T00:56:18.509 INFO:teuthology.orchestra.run.smithi073.stderr: 20950K .......... .......... .......... .......... .......... 22% 330M 1s 2024-09-12T00:56:18.509 INFO:teuthology.orchestra.run.smithi073.stderr: 21000K .......... .......... .......... .......... .......... 22% 372M 1s 2024-09-12T00:56:18.509 INFO:teuthology.orchestra.run.smithi073.stderr: 21050K .......... .......... .......... .......... .......... 22% 376M 1s 2024-09-12T00:56:18.509 INFO:teuthology.orchestra.run.smithi073.stderr: 21100K .......... .......... .......... .......... .......... 22% 210M 1s 2024-09-12T00:56:18.509 INFO:teuthology.orchestra.run.smithi073.stderr: 21150K .......... .......... .......... .......... .......... 22% 346M 1s 2024-09-12T00:56:18.509 INFO:teuthology.orchestra.run.smithi073.stderr: 21200K .......... .......... .......... .......... .......... 22% 425M 1s 2024-09-12T00:56:18.509 INFO:teuthology.orchestra.run.smithi073.stderr: 21250K .......... .......... .......... .......... .......... 22% 290M 1s 2024-09-12T00:56:18.509 INFO:teuthology.orchestra.run.smithi073.stderr: 21300K .......... .......... .......... .......... .......... 22% 381M 1s 2024-09-12T00:56:18.509 INFO:teuthology.orchestra.run.smithi073.stderr: 21350K .......... .......... .......... .......... .......... 23% 161M 1s 2024-09-12T00:56:18.510 INFO:teuthology.orchestra.run.smithi073.stderr: 21400K .......... .......... .......... .......... .......... 23% 399M 1s 2024-09-12T00:56:18.510 INFO:teuthology.orchestra.run.smithi073.stderr: 21450K .......... .......... .......... .......... .......... 23% 347M 1s 2024-09-12T00:56:18.510 INFO:teuthology.orchestra.run.smithi073.stderr: 21500K .......... .......... .......... .......... .......... 23% 362M 1s 2024-09-12T00:56:18.510 INFO:teuthology.orchestra.run.smithi073.stderr: 21550K .......... .......... .......... .......... .......... 23% 99.5M 1s 2024-09-12T00:56:18.510 INFO:teuthology.orchestra.run.smithi073.stderr: 21600K .......... .......... .......... .......... .......... 23% 393M 1s 2024-09-12T00:56:18.510 INFO:teuthology.orchestra.run.smithi073.stderr: 21650K .......... .......... .......... .......... .......... 23% 331M 1s 2024-09-12T00:56:18.510 INFO:teuthology.orchestra.run.smithi073.stderr: 21700K .......... .......... .......... .......... .......... 23% 108M 1s 2024-09-12T00:56:18.510 INFO:teuthology.orchestra.run.smithi073.stderr: 21750K .......... .......... .......... .......... .......... 23% 212M 1s 2024-09-12T00:56:18.510 INFO:teuthology.orchestra.run.smithi073.stderr: 21800K .......... .......... .......... .......... .......... 23% 206M 1s 2024-09-12T00:56:18.510 INFO:teuthology.orchestra.run.smithi073.stderr: 21850K .......... .......... .......... .......... .......... 23% 360M 1s 2024-09-12T00:56:18.510 INFO:teuthology.orchestra.run.smithi073.stderr: 21900K .......... .......... .......... .......... .......... 23% 307M 1s 2024-09-12T00:56:18.510 INFO:teuthology.orchestra.run.smithi073.stderr: 21950K .......... .......... .......... .......... .......... 23% 376M 1s 2024-09-12T00:56:18.510 INFO:teuthology.orchestra.run.smithi073.stderr: 22000K .......... .......... .......... .......... .......... 23% 307M 1s 2024-09-12T00:56:18.511 INFO:teuthology.orchestra.run.smithi073.stderr: 22050K .......... .......... .......... .......... .......... 23% 377M 1s 2024-09-12T00:56:18.511 INFO:teuthology.orchestra.run.smithi073.stderr: 22100K .......... .......... .......... .......... .......... 23% 360M 1s 2024-09-12T00:56:18.511 INFO:teuthology.orchestra.run.smithi073.stderr: 22150K .......... .......... .......... .......... .......... 23% 451M 1s 2024-09-12T00:56:18.511 INFO:teuthology.orchestra.run.smithi073.stderr: 22200K .......... .......... .......... .......... .......... 23% 65.3M 1s 2024-09-12T00:56:18.511 INFO:teuthology.orchestra.run.smithi073.stderr: 22250K .......... .......... .......... .......... .......... 24% 43.3M 1s 2024-09-12T00:56:18.511 INFO:teuthology.orchestra.run.smithi073.stderr: 22300K .......... .......... .......... .......... .......... 24% 290M 1s 2024-09-12T00:56:18.511 INFO:teuthology.orchestra.run.smithi073.stderr: 22350K .......... .......... .......... .......... .......... 24% 396M 1s 2024-09-12T00:56:18.511 INFO:teuthology.orchestra.run.smithi073.stderr: 22400K .......... .......... .......... .......... .......... 24% 370M 1s 2024-09-12T00:56:18.511 INFO:teuthology.orchestra.run.smithi073.stderr: 22450K .......... .......... .......... .......... .......... 24% 438M 1s 2024-09-12T00:56:18.511 INFO:teuthology.orchestra.run.smithi073.stderr: 22500K .......... .......... .......... .......... .......... 24% 112M 1s 2024-09-12T00:56:18.511 INFO:teuthology.orchestra.run.smithi073.stderr: 22550K .......... .......... .......... .......... .......... 24% 265M 1s 2024-09-12T00:56:18.511 INFO:teuthology.orchestra.run.smithi073.stderr: 22600K .......... .......... .......... .......... .......... 24% 331M 1s 2024-09-12T00:56:18.511 INFO:teuthology.orchestra.run.smithi073.stderr: 22650K .......... .......... .......... .......... .......... 24% 461M 1s 2024-09-12T00:56:18.511 INFO:teuthology.orchestra.run.smithi073.stderr: 22700K .......... .......... .......... .......... .......... 24% 297M 1s 2024-09-12T00:56:18.512 INFO:teuthology.orchestra.run.smithi073.stderr: 22750K .......... .......... .......... .......... .......... 24% 124M 1s 2024-09-12T00:56:18.512 INFO:teuthology.orchestra.run.smithi073.stderr: 22800K .......... .......... .......... .......... .......... 24% 377M 1s 2024-09-12T00:56:18.512 INFO:teuthology.orchestra.run.smithi073.stderr: 22850K .......... .......... .......... .......... .......... 24% 414M 1s 2024-09-12T00:56:18.512 INFO:teuthology.orchestra.run.smithi073.stderr: 22900K .......... .......... .......... .......... .......... 24% 382M 1s 2024-09-12T00:56:18.512 INFO:teuthology.orchestra.run.smithi073.stderr: 22950K .......... .......... .......... .......... .......... 24% 114M 1s 2024-09-12T00:56:18.512 INFO:teuthology.orchestra.run.smithi073.stderr: 23000K .......... .......... .......... .......... .......... 24% 393M 1s 2024-09-12T00:56:18.512 INFO:teuthology.orchestra.run.smithi073.stderr: 23050K .......... .......... .......... .......... .......... 24% 384M 1s 2024-09-12T00:56:18.512 INFO:teuthology.orchestra.run.smithi073.stderr: 23100K .......... .......... .......... .......... .......... 24% 343M 1s 2024-09-12T00:56:18.512 INFO:teuthology.orchestra.run.smithi073.stderr: 23150K .......... .......... .......... .......... .......... 24% 254M 1s 2024-09-12T00:56:18.512 INFO:teuthology.orchestra.run.smithi073.stderr: 23200K .......... .......... .......... .......... .......... 25% 367M 1s 2024-09-12T00:56:18.512 INFO:teuthology.orchestra.run.smithi073.stderr: 23250K .......... .......... .......... .......... .......... 25% 376M 1s 2024-09-12T00:56:18.512 INFO:teuthology.orchestra.run.smithi073.stderr: 23300K .......... .......... .......... .......... .......... 25% 376M 1s 2024-09-12T00:56:18.512 INFO:teuthology.orchestra.run.smithi073.stderr: 23350K .......... .......... .......... .......... .......... 25% 445M 1s 2024-09-12T00:56:18.513 INFO:teuthology.orchestra.run.smithi073.stderr: 23400K .......... .......... .......... .......... .......... 25% 162M 1s 2024-09-12T00:56:18.513 INFO:teuthology.orchestra.run.smithi073.stderr: 23450K .......... .......... .......... .......... .......... 25% 388M 1s 2024-09-12T00:56:18.513 INFO:teuthology.orchestra.run.smithi073.stderr: 23500K .......... .......... .......... .......... .......... 25% 281M 1s 2024-09-12T00:56:18.513 INFO:teuthology.orchestra.run.smithi073.stderr: 23550K .......... .......... .......... .......... .......... 25% 413M 1s 2024-09-12T00:56:18.513 INFO:teuthology.orchestra.run.smithi073.stderr: 23600K .......... .......... .......... .......... .......... 25% 431M 1s 2024-09-12T00:56:18.513 INFO:teuthology.orchestra.run.smithi073.stderr: 23650K .......... .......... .......... .......... .......... 25% 340M 1s 2024-09-12T00:56:18.513 INFO:teuthology.orchestra.run.smithi073.stderr: 23700K .......... .......... .......... .......... .......... 25% 329M 1s 2024-09-12T00:56:18.513 INFO:teuthology.orchestra.run.smithi073.stderr: 23750K .......... .......... .......... .......... .......... 25% 405M 1s 2024-09-12T00:56:18.513 INFO:teuthology.orchestra.run.smithi073.stderr: 23800K .......... .......... .......... .......... .......... 25% 457M 1s 2024-09-12T00:56:18.513 INFO:teuthology.orchestra.run.smithi073.stderr: 23850K .......... .......... .......... .......... .......... 25% 182M 1s 2024-09-12T00:56:18.513 INFO:teuthology.orchestra.run.smithi073.stderr: 23900K .......... .......... .......... .......... .......... 25% 97.5M 1s 2024-09-12T00:56:18.513 INFO:teuthology.orchestra.run.smithi073.stderr: 23950K .......... .......... .......... .......... .......... 25% 339M 1s 2024-09-12T00:56:18.513 INFO:teuthology.orchestra.run.smithi073.stderr: 24000K .......... .......... .......... .......... .......... 25% 385M 1s 2024-09-12T00:56:18.513 INFO:teuthology.orchestra.run.smithi073.stderr: 24050K .......... .......... .......... .......... .......... 25% 383M 1s 2024-09-12T00:56:18.514 INFO:teuthology.orchestra.run.smithi073.stderr: 24100K .......... .......... .......... .......... .......... 25% 359M 1s 2024-09-12T00:56:18.514 INFO:teuthology.orchestra.run.smithi073.stderr: 24150K .......... .......... .......... .......... .......... 26% 424M 1s 2024-09-12T00:56:18.514 INFO:teuthology.orchestra.run.smithi073.stderr: 24200K .......... .......... .......... .......... .......... 26% 415M 1s 2024-09-12T00:56:18.514 INFO:teuthology.orchestra.run.smithi073.stderr: 24250K .......... .......... .......... .......... .......... 26% 400M 1s 2024-09-12T00:56:18.514 INFO:teuthology.orchestra.run.smithi073.stderr: 24300K .......... .......... .......... .......... .......... 26% 315M 1s 2024-09-12T00:56:18.514 INFO:teuthology.orchestra.run.smithi073.stderr: 24350K .......... .......... .......... .......... .......... 26% 441M 1s 2024-09-12T00:56:18.514 INFO:teuthology.orchestra.run.smithi073.stderr: 24400K .......... .......... .......... .......... .......... 26% 323M 1s 2024-09-12T00:56:18.514 INFO:teuthology.orchestra.run.smithi073.stderr: 24450K .......... .......... .......... .......... .......... 26% 425M 1s 2024-09-12T00:56:18.514 INFO:teuthology.orchestra.run.smithi073.stderr: 24500K .......... .......... .......... .......... .......... 26% 193M 1s 2024-09-12T00:56:18.514 INFO:teuthology.orchestra.run.smithi073.stderr: 24550K .......... .......... .......... .......... .......... 26% 62.5M 1s 2024-09-12T00:56:18.514 INFO:teuthology.orchestra.run.smithi073.stderr: 24600K .......... .......... .......... .......... .......... 26% 416M 0s 2024-09-12T00:56:18.514 INFO:teuthology.orchestra.run.smithi073.stderr: 24650K .......... .......... .......... .......... .......... 26% 424M 0s 2024-09-12T00:56:18.514 INFO:teuthology.orchestra.run.smithi073.stderr: 24700K .......... .......... .......... .......... .......... 26% 373M 0s 2024-09-12T00:56:18.515 INFO:teuthology.orchestra.run.smithi073.stderr: 24750K .......... .......... .......... .......... .......... 26% 216M 0s 2024-09-12T00:56:18.515 INFO:teuthology.orchestra.run.smithi073.stderr: 24800K .......... .......... .......... .......... .......... 26% 140M 0s 2024-09-12T00:56:18.515 INFO:teuthology.orchestra.run.smithi073.stderr: 24850K .......... .......... .......... .......... .......... 26% 417M 0s 2024-09-12T00:56:18.515 INFO:teuthology.orchestra.run.smithi073.stderr: 24900K .......... .......... .......... .......... .......... 26% 384M 0s 2024-09-12T00:56:18.515 INFO:teuthology.orchestra.run.smithi073.stderr: 24950K .......... .......... .......... .......... .......... 26% 80.5M 0s 2024-09-12T00:56:18.515 INFO:teuthology.orchestra.run.smithi073.stderr: 25000K .......... .......... .......... .......... .......... 26% 384M 0s 2024-09-12T00:56:18.515 INFO:teuthology.orchestra.run.smithi073.stderr: 25050K .......... .......... .......... .......... .......... 27% 367M 0s 2024-09-12T00:56:18.515 INFO:teuthology.orchestra.run.smithi073.stderr: 25100K .......... .......... .......... .......... .......... 27% 366M 0s 2024-09-12T00:56:18.515 INFO:teuthology.orchestra.run.smithi073.stderr: 25150K .......... .......... .......... .......... .......... 27% 448M 0s 2024-09-12T00:56:18.515 INFO:teuthology.orchestra.run.smithi073.stderr: 25200K .......... .......... .......... .......... .......... 27% 83.6M 0s 2024-09-12T00:56:18.515 INFO:teuthology.orchestra.run.smithi073.stderr: 25250K .......... .......... .......... .......... .......... 27% 380M 0s 2024-09-12T00:56:18.515 INFO:teuthology.orchestra.run.smithi073.stderr: 25300K .......... .......... .......... .......... .......... 27% 52.5M 0s 2024-09-12T00:56:18.515 INFO:teuthology.orchestra.run.smithi073.stderr: 25350K .......... .......... .......... .......... .......... 27% 281M 0s 2024-09-12T00:56:18.515 INFO:teuthology.orchestra.run.smithi073.stderr: 25400K .......... .......... .......... .......... .......... 27% 80.8M 0s 2024-09-12T00:56:18.516 INFO:teuthology.orchestra.run.smithi073.stderr: 25450K .......... .......... .......... .......... .......... 27% 355M 0s 2024-09-12T00:56:18.516 INFO:teuthology.orchestra.run.smithi073.stderr: 25500K .......... .......... .......... .......... .......... 27% 368M 0s 2024-09-12T00:56:18.516 INFO:teuthology.orchestra.run.smithi073.stderr: 25550K .......... .......... .......... .......... .......... 27% 82.1M 0s 2024-09-12T00:56:18.516 INFO:teuthology.orchestra.run.smithi073.stderr: 25600K .......... .......... .......... .......... .......... 27% 281M 0s 2024-09-12T00:56:18.516 INFO:teuthology.orchestra.run.smithi073.stderr: 25650K .......... .......... .......... .......... .......... 27% 377M 0s 2024-09-12T00:56:18.516 INFO:teuthology.orchestra.run.smithi073.stderr: 25700K .......... .......... .......... .......... .......... 27% 309M 0s 2024-09-12T00:56:18.516 INFO:teuthology.orchestra.run.smithi073.stderr: 25750K .......... .......... .......... .......... .......... 27% 373M 0s 2024-09-12T00:56:18.516 INFO:teuthology.orchestra.run.smithi073.stderr: 25800K .......... .......... .......... .......... .......... 27% 339M 0s 2024-09-12T00:56:18.516 INFO:teuthology.orchestra.run.smithi073.stderr: 25850K .......... .......... .......... .......... .......... 27% 391M 0s 2024-09-12T00:56:18.516 INFO:teuthology.orchestra.run.smithi073.stderr: 25900K .......... .......... .......... .......... .......... 27% 287M 0s 2024-09-12T00:56:18.516 INFO:teuthology.orchestra.run.smithi073.stderr: 25950K .......... .......... .......... .......... .......... 27% 358M 0s 2024-09-12T00:56:18.516 INFO:teuthology.orchestra.run.smithi073.stderr: 26000K .......... .......... .......... .......... .......... 28% 369M 0s 2024-09-12T00:56:18.516 INFO:teuthology.orchestra.run.smithi073.stderr: 26050K .......... .......... .......... .......... .......... 28% 339M 0s 2024-09-12T00:56:18.517 INFO:teuthology.orchestra.run.smithi073.stderr: 26100K .......... .......... .......... .......... .......... 28% 293M 0s 2024-09-12T00:56:18.517 INFO:teuthology.orchestra.run.smithi073.stderr: 26150K .......... .......... .......... .......... .......... 28% 323M 0s 2024-09-12T00:56:18.517 INFO:teuthology.orchestra.run.smithi073.stderr: 26200K .......... .......... .......... .......... .......... 28% 302M 0s 2024-09-12T00:56:18.517 INFO:teuthology.orchestra.run.smithi073.stderr: 26250K .......... .......... .......... .......... .......... 28% 307M 0s 2024-09-12T00:56:18.517 INFO:teuthology.orchestra.run.smithi073.stderr: 26300K .......... .......... .......... .......... .......... 28% 323M 0s 2024-09-12T00:56:18.517 INFO:teuthology.orchestra.run.smithi073.stderr: 26350K .......... .......... .......... .......... .......... 28% 385M 0s 2024-09-12T00:56:18.517 INFO:teuthology.orchestra.run.smithi073.stderr: 26400K .......... .......... .......... .......... .......... 28% 121M 0s 2024-09-12T00:56:18.517 INFO:teuthology.orchestra.run.smithi073.stderr: 26450K .......... .......... .......... .......... .......... 28% 320M 0s 2024-09-12T00:56:18.517 INFO:teuthology.orchestra.run.smithi073.stderr: 26500K .......... .......... .......... .......... .......... 28% 311M 0s 2024-09-12T00:56:18.517 INFO:teuthology.orchestra.run.smithi073.stderr: 26550K .......... .......... .......... .......... .......... 28% 390M 0s 2024-09-12T00:56:18.517 INFO:teuthology.orchestra.run.smithi073.stderr: 26600K .......... .......... .......... .......... .......... 28% 358M 0s 2024-09-12T00:56:18.517 INFO:teuthology.orchestra.run.smithi073.stderr: 26650K .......... .......... .......... .......... .......... 28% 351M 0s 2024-09-12T00:56:18.517 INFO:teuthology.orchestra.run.smithi073.stderr: 26700K .......... .......... .......... .......... .......... 28% 214M 0s 2024-09-12T00:56:18.518 INFO:teuthology.orchestra.run.smithi073.stderr: 26750K .......... .......... .......... .......... .......... 28% 378M 0s 2024-09-12T00:56:18.518 INFO:teuthology.orchestra.run.smithi073.stderr: 26800K .......... .......... .......... .......... .......... 28% 327M 0s 2024-09-12T00:56:18.518 INFO:teuthology.orchestra.run.smithi073.stderr: 26850K .......... .......... .......... .......... .......... 28% 434M 0s 2024-09-12T00:56:18.518 INFO:teuthology.orchestra.run.smithi073.stderr: 26900K .......... .......... .......... .......... .......... 29% 394M 0s 2024-09-12T00:56:18.518 INFO:teuthology.orchestra.run.smithi073.stderr: 26950K .......... .......... .......... .......... .......... 29% 392M 0s 2024-09-12T00:56:18.518 INFO:teuthology.orchestra.run.smithi073.stderr: 27000K .......... .......... .......... .......... .......... 29% 405M 0s 2024-09-12T00:56:18.518 INFO:teuthology.orchestra.run.smithi073.stderr: 27050K .......... .......... .......... .......... .......... 29% 199M 0s 2024-09-12T00:56:18.518 INFO:teuthology.orchestra.run.smithi073.stderr: 27100K .......... .......... .......... .......... .......... 29% 336M 0s 2024-09-12T00:56:18.518 INFO:teuthology.orchestra.run.smithi073.stderr: 27150K .......... .......... .......... .......... .......... 29% 407M 0s 2024-09-12T00:56:18.518 INFO:teuthology.orchestra.run.smithi073.stderr: 27200K .......... .......... .......... .......... .......... 29% 439M 0s 2024-09-12T00:56:18.518 INFO:teuthology.orchestra.run.smithi073.stderr: 27250K .......... .......... .......... .......... .......... 29% 427M 0s 2024-09-12T00:56:18.518 INFO:teuthology.orchestra.run.smithi073.stderr: 27300K .......... .......... .......... .......... .......... 29% 405M 0s 2024-09-12T00:56:18.518 INFO:teuthology.orchestra.run.smithi073.stderr: 27350K .......... .......... .......... .......... .......... 29% 225M 0s 2024-09-12T00:56:18.518 INFO:teuthology.orchestra.run.smithi073.stderr: 27400K .......... .......... .......... .......... .......... 29% 407M 0s 2024-09-12T00:56:18.519 INFO:teuthology.orchestra.run.smithi073.stderr: 27450K .......... .......... .......... .......... .......... 29% 435M 0s 2024-09-12T00:56:18.519 INFO:teuthology.orchestra.run.smithi073.stderr: 27500K .......... .......... .......... .......... .......... 29% 342M 0s 2024-09-12T00:56:18.519 INFO:teuthology.orchestra.run.smithi073.stderr: 27550K .......... .......... .......... .......... .......... 29% 428M 0s 2024-09-12T00:56:18.519 INFO:teuthology.orchestra.run.smithi073.stderr: 27600K .......... .......... .......... .......... .......... 29% 45.0M 0s 2024-09-12T00:56:18.521 INFO:teuthology.orchestra.run.smithi073.stderr: 27650K .......... .......... .......... .......... .......... 29% 406M 0s 2024-09-12T00:56:18.521 INFO:teuthology.orchestra.run.smithi073.stderr: 27700K .......... .......... .......... .......... .......... 29% 356M 0s 2024-09-12T00:56:18.521 INFO:teuthology.orchestra.run.smithi073.stderr: 27750K .......... .......... .......... .......... .......... 29% 431M 0s 2024-09-12T00:56:18.522 INFO:teuthology.orchestra.run.smithi073.stderr: 27800K .......... .......... .......... .......... .......... 29% 451M 0s 2024-09-12T00:56:18.522 INFO:teuthology.orchestra.run.smithi073.stderr: 27850K .......... .......... .......... .......... .......... 30% 450M 0s 2024-09-12T00:56:18.522 INFO:teuthology.orchestra.run.smithi073.stderr: 27900K .......... .......... .......... .......... .......... 30% 282M 0s 2024-09-12T00:56:18.522 INFO:teuthology.orchestra.run.smithi073.stderr: 27950K .......... .......... .......... .......... .......... 30% 390M 0s 2024-09-12T00:56:18.522 INFO:teuthology.orchestra.run.smithi073.stderr: 28000K .......... .......... .......... .......... .......... 30% 78.4M 0s 2024-09-12T00:56:18.522 INFO:teuthology.orchestra.run.smithi073.stderr: 28050K .......... .......... .......... .......... .......... 30% 234M 0s 2024-09-12T00:56:18.522 INFO:teuthology.orchestra.run.smithi073.stderr: 28100K .......... .......... .......... .......... .......... 30% 250M 0s 2024-09-12T00:56:18.522 INFO:teuthology.orchestra.run.smithi073.stderr: 28150K .......... .......... .......... .......... .......... 30% 453M 0s 2024-09-12T00:56:18.522 INFO:teuthology.orchestra.run.smithi073.stderr: 28200K .......... .......... .......... .......... .......... 30% 94.0M 0s 2024-09-12T00:56:18.523 INFO:teuthology.orchestra.run.smithi073.stderr: 28250K .......... .......... .......... .......... .......... 30% 413M 0s 2024-09-12T00:56:18.523 INFO:teuthology.orchestra.run.smithi073.stderr: 28300K .......... .......... .......... .......... .......... 30% 328M 0s 2024-09-12T00:56:18.523 INFO:teuthology.orchestra.run.smithi073.stderr: 28350K .......... .......... .......... .......... .......... 30% 36.2M 0s 2024-09-12T00:56:18.523 INFO:teuthology.orchestra.run.smithi073.stderr: 28400K .......... .......... .......... .......... .......... 30% 137M 0s 2024-09-12T00:56:18.523 INFO:teuthology.orchestra.run.smithi073.stderr: 28450K .......... .......... .......... .......... .......... 30% 217M 0s 2024-09-12T00:56:18.523 INFO:teuthology.orchestra.run.smithi073.stderr: 28500K .......... .......... .......... .......... .......... 30% 149M 0s 2024-09-12T00:56:18.523 INFO:teuthology.orchestra.run.smithi073.stderr: 28550K .......... .......... .......... .......... .......... 30% 176M 0s 2024-09-12T00:56:18.523 INFO:teuthology.orchestra.run.smithi073.stderr: 28600K .......... .......... .......... .......... .......... 30% 249M 0s 2024-09-12T00:56:18.523 INFO:teuthology.orchestra.run.smithi073.stderr: 28650K .......... .......... .......... .......... .......... 30% 267M 0s 2024-09-12T00:56:18.523 INFO:teuthology.orchestra.run.smithi073.stderr: 28700K .......... .......... .......... .......... .......... 30% 221M 0s 2024-09-12T00:56:18.523 INFO:teuthology.orchestra.run.smithi073.stderr: 28750K .......... .......... .......... .......... .......... 31% 280M 0s 2024-09-12T00:56:18.524 INFO:teuthology.orchestra.run.smithi073.stderr: 28800K .......... .......... .......... .......... .......... 31% 271M 0s 2024-09-12T00:56:18.524 INFO:teuthology.orchestra.run.smithi073.stderr: 28850K .......... .......... .......... .......... .......... 31% 270M 0s 2024-09-12T00:56:18.524 INFO:teuthology.orchestra.run.smithi073.stderr: 28900K .......... .......... .......... .......... .......... 31% 240M 0s 2024-09-12T00:56:18.524 INFO:teuthology.orchestra.run.smithi073.stderr: 28950K .......... .......... .......... .......... .......... 31% 273M 0s 2024-09-12T00:56:18.524 INFO:teuthology.orchestra.run.smithi073.stderr: 29000K .......... .......... .......... .......... .......... 31% 261M 0s 2024-09-12T00:56:18.524 INFO:teuthology.orchestra.run.smithi073.stderr: 29050K .......... .......... .......... .......... .......... 31% 286M 0s 2024-09-12T00:56:18.524 INFO:teuthology.orchestra.run.smithi073.stderr: 29100K .......... .......... .......... .......... .......... 31% 232M 0s 2024-09-12T00:56:18.524 INFO:teuthology.orchestra.run.smithi073.stderr: 29150K .......... .......... .......... .......... .......... 31% 281M 0s 2024-09-12T00:56:18.524 INFO:teuthology.orchestra.run.smithi073.stderr: 29200K .......... .......... .......... .......... .......... 31% 286M 0s 2024-09-12T00:56:18.525 INFO:teuthology.orchestra.run.smithi073.stderr: 29250K .......... .......... .......... .......... .......... 31% 267M 0s 2024-09-12T00:56:18.525 INFO:teuthology.orchestra.run.smithi073.stderr: 29300K .......... .......... .......... .......... .......... 31% 237M 0s 2024-09-12T00:56:18.525 INFO:teuthology.orchestra.run.smithi073.stderr: 29350K .......... .......... .......... .......... .......... 31% 305M 0s 2024-09-12T00:56:18.525 INFO:teuthology.orchestra.run.smithi073.stderr: 29400K .......... .......... .......... .......... .......... 31% 289M 0s 2024-09-12T00:56:18.525 INFO:teuthology.orchestra.run.smithi073.stderr: 29450K .......... .......... .......... .......... .......... 31% 267M 0s 2024-09-12T00:56:18.525 INFO:teuthology.orchestra.run.smithi073.stderr: 29500K .......... .......... .......... .......... .......... 31% 229M 0s 2024-09-12T00:56:18.525 INFO:teuthology.orchestra.run.smithi073.stderr: 29550K .......... .......... .......... .......... .......... 31% 293M 0s 2024-09-12T00:56:18.525 INFO:teuthology.orchestra.run.smithi073.stderr: 29600K .......... .......... .......... .......... .......... 31% 291M 0s 2024-09-12T00:56:18.525 INFO:teuthology.orchestra.run.smithi073.stderr: 29650K .......... .......... .......... .......... .......... 31% 269M 0s 2024-09-12T00:56:18.525 INFO:teuthology.orchestra.run.smithi073.stderr: 29700K .......... .......... .......... .......... .......... 32% 243M 0s 2024-09-12T00:56:18.526 INFO:teuthology.orchestra.run.smithi073.stderr: 29750K .......... .......... .......... .......... .......... 32% 277M 0s 2024-09-12T00:56:18.526 INFO:teuthology.orchestra.run.smithi073.stderr: 29800K .......... .......... .......... .......... .......... 32% 272M 0s 2024-09-12T00:56:18.526 INFO:teuthology.orchestra.run.smithi073.stderr: 29850K .......... .......... .......... .......... .......... 32% 294M 0s 2024-09-12T00:56:18.526 INFO:teuthology.orchestra.run.smithi073.stderr: 29900K .......... .......... .......... .......... .......... 32% 239M 0s 2024-09-12T00:56:18.526 INFO:teuthology.orchestra.run.smithi073.stderr: 29950K .......... .......... .......... .......... .......... 32% 278M 0s 2024-09-12T00:56:18.526 INFO:teuthology.orchestra.run.smithi073.stderr: 30000K .......... .......... .......... .......... .......... 32% 290M 0s 2024-09-12T00:56:18.526 INFO:teuthology.orchestra.run.smithi073.stderr: 30050K .......... .......... .......... .......... .......... 32% 274M 0s 2024-09-12T00:56:18.526 INFO:teuthology.orchestra.run.smithi073.stderr: 30100K .......... .......... .......... .......... .......... 32% 256M 0s 2024-09-12T00:56:18.526 INFO:teuthology.orchestra.run.smithi073.stderr: 30150K .......... .......... .......... .......... .......... 32% 284M 0s 2024-09-12T00:56:18.526 INFO:teuthology.orchestra.run.smithi073.stderr: 30200K .......... .......... .......... .......... .......... 32% 289M 0s 2024-09-12T00:56:18.527 INFO:teuthology.orchestra.run.smithi073.stderr: 30250K .......... .......... .......... .......... .......... 32% 290M 0s 2024-09-12T00:56:18.527 INFO:teuthology.orchestra.run.smithi073.stderr: 30300K .......... .......... .......... .......... .......... 32% 245M 0s 2024-09-12T00:56:18.527 INFO:teuthology.orchestra.run.smithi073.stderr: 30350K .......... .......... .......... .......... .......... 32% 253M 0s 2024-09-12T00:56:18.527 INFO:teuthology.orchestra.run.smithi073.stderr: 30400K .......... .......... .......... .......... .......... 32% 291M 0s 2024-09-12T00:56:18.527 INFO:teuthology.orchestra.run.smithi073.stderr: 30450K .......... .......... .......... .......... .......... 32% 274M 0s 2024-09-12T00:56:18.527 INFO:teuthology.orchestra.run.smithi073.stderr: 30500K .......... .......... .......... .......... .......... 32% 230M 0s 2024-09-12T00:56:18.527 INFO:teuthology.orchestra.run.smithi073.stderr: 30550K .......... .......... .......... .......... .......... 32% 275M 0s 2024-09-12T00:56:18.527 INFO:teuthology.orchestra.run.smithi073.stderr: 30600K .......... .......... .......... .......... .......... 32% 260M 0s 2024-09-12T00:56:18.527 INFO:teuthology.orchestra.run.smithi073.stderr: 30650K .......... .......... .......... .......... .......... 33% 271M 0s 2024-09-12T00:56:18.527 INFO:teuthology.orchestra.run.smithi073.stderr: 30700K .......... .......... .......... .......... .......... 33% 280M 0s 2024-09-12T00:56:18.528 INFO:teuthology.orchestra.run.smithi073.stderr: 30750K .......... .......... .......... .......... .......... 33% 313M 0s 2024-09-12T00:56:18.528 INFO:teuthology.orchestra.run.smithi073.stderr: 30800K .......... .......... .......... .......... .......... 33% 244M 0s 2024-09-12T00:56:18.528 INFO:teuthology.orchestra.run.smithi073.stderr: 30850K .......... .......... .......... .......... .......... 33% 320M 0s 2024-09-12T00:56:18.528 INFO:teuthology.orchestra.run.smithi073.stderr: 30900K .......... .......... .......... .......... .......... 33% 305M 0s 2024-09-12T00:56:18.528 INFO:teuthology.orchestra.run.smithi073.stderr: 30950K .......... .......... .......... .......... .......... 33% 323M 0s 2024-09-12T00:56:18.528 INFO:teuthology.orchestra.run.smithi073.stderr: 31000K .......... .......... .......... .......... .......... 33% 274M 0s 2024-09-12T00:56:18.528 INFO:teuthology.orchestra.run.smithi073.stderr: 31050K .......... .......... .......... .......... .......... 33% 312M 0s 2024-09-12T00:56:18.528 INFO:teuthology.orchestra.run.smithi073.stderr: 31100K .......... .......... .......... .......... .......... 33% 310M 0s 2024-09-12T00:56:18.528 INFO:teuthology.orchestra.run.smithi073.stderr: 31150K .......... .......... .......... .......... .......... 33% 241M 0s 2024-09-12T00:56:18.528 INFO:teuthology.orchestra.run.smithi073.stderr: 31200K .......... .......... .......... .......... .......... 33% 271M 0s 2024-09-12T00:56:18.528 INFO:teuthology.orchestra.run.smithi073.stderr: 31250K .......... .......... .......... .......... .......... 33% 287M 0s 2024-09-12T00:56:18.529 INFO:teuthology.orchestra.run.smithi073.stderr: 31300K .......... .......... .......... .......... .......... 33% 286M 0s 2024-09-12T00:56:18.529 INFO:teuthology.orchestra.run.smithi073.stderr: 31350K .......... .......... .......... .......... .......... 33% 254M 0s 2024-09-12T00:56:18.529 INFO:teuthology.orchestra.run.smithi073.stderr: 31400K .......... .......... .......... .......... .......... 33% 76.7M 0s 2024-09-12T00:56:18.529 INFO:teuthology.orchestra.run.smithi073.stderr: 31450K .......... .......... .......... .......... .......... 33% 314M 0s 2024-09-12T00:56:18.529 INFO:teuthology.orchestra.run.smithi073.stderr: 31500K .......... .......... .......... .......... .......... 33% 69.7M 0s 2024-09-12T00:56:18.529 INFO:teuthology.orchestra.run.smithi073.stderr: 31550K .......... .......... .......... .......... .......... 34% 107M 0s 2024-09-12T00:56:18.529 INFO:teuthology.orchestra.run.smithi073.stderr: 31600K .......... .......... .......... .......... .......... 34% 208M 0s 2024-09-12T00:56:18.529 INFO:teuthology.orchestra.run.smithi073.stderr: 31650K .......... .......... .......... .......... .......... 34% 166M 0s 2024-09-12T00:56:18.529 INFO:teuthology.orchestra.run.smithi073.stderr: 31700K .......... .......... .......... .......... .......... 34% 271M 0s 2024-09-12T00:56:18.529 INFO:teuthology.orchestra.run.smithi073.stderr: 31750K .......... .......... .......... .......... .......... 34% 128M 0s 2024-09-12T00:56:18.529 INFO:teuthology.orchestra.run.smithi073.stderr: 31800K .......... .......... .......... .......... .......... 34% 273M 0s 2024-09-12T00:56:18.530 INFO:teuthology.orchestra.run.smithi073.stderr: 31850K .......... .......... .......... .......... .......... 34% 246M 0s 2024-09-12T00:56:18.530 INFO:teuthology.orchestra.run.smithi073.stderr: 31900K .......... .......... .......... .......... .......... 34% 273M 0s 2024-09-12T00:56:18.530 INFO:teuthology.orchestra.run.smithi073.stderr: 31950K .......... .......... .......... .......... .......... 34% 259M 0s 2024-09-12T00:56:18.530 INFO:teuthology.orchestra.run.smithi073.stderr: 32000K .......... .......... .......... .......... .......... 34% 266M 0s 2024-09-12T00:56:18.530 INFO:teuthology.orchestra.run.smithi073.stderr: 32050K .......... .......... .......... .......... .......... 34% 286M 0s 2024-09-12T00:56:18.530 INFO:teuthology.orchestra.run.smithi073.stderr: 32100K .......... .......... .......... .......... .......... 34% 234M 0s 2024-09-12T00:56:18.530 INFO:teuthology.orchestra.run.smithi073.stderr: 32150K .......... .......... .......... .......... .......... 34% 257M 0s 2024-09-12T00:56:18.530 INFO:teuthology.orchestra.run.smithi073.stderr: 32200K .......... .......... .......... .......... .......... 34% 254M 0s 2024-09-12T00:56:18.530 INFO:teuthology.orchestra.run.smithi073.stderr: 32250K .......... .......... .......... .......... .......... 34% 303M 0s 2024-09-12T00:56:18.530 INFO:teuthology.orchestra.run.smithi073.stderr: 32300K .......... .......... .......... .......... .......... 34% 273M 0s 2024-09-12T00:56:18.530 INFO:teuthology.orchestra.run.smithi073.stderr: 32350K .......... .......... .......... .......... .......... 34% 250M 0s 2024-09-12T00:56:18.530 INFO:teuthology.orchestra.run.smithi073.stderr: 32400K .......... .......... .......... .......... .......... 34% 268M 0s 2024-09-12T00:56:18.531 INFO:teuthology.orchestra.run.smithi073.stderr: 32450K .......... .......... .......... .......... .......... 34% 297M 0s 2024-09-12T00:56:18.531 INFO:teuthology.orchestra.run.smithi073.stderr: 32500K .......... .......... .......... .......... .......... 35% 275M 0s 2024-09-12T00:56:18.531 INFO:teuthology.orchestra.run.smithi073.stderr: 32550K .......... .......... .......... .......... .......... 35% 267M 0s 2024-09-12T00:56:18.531 INFO:teuthology.orchestra.run.smithi073.stderr: 32600K .......... .......... .......... .......... .......... 35% 294M 0s 2024-09-12T00:56:18.531 INFO:teuthology.orchestra.run.smithi073.stderr: 32650K .......... .......... .......... .......... .......... 35% 175M 0s 2024-09-12T00:56:18.531 INFO:teuthology.orchestra.run.smithi073.stderr: 32700K .......... .......... .......... .......... .......... 35% 278M 0s 2024-09-12T00:56:18.531 INFO:teuthology.orchestra.run.smithi073.stderr: 32750K .......... .......... .......... .......... .......... 35% 224M 0s 2024-09-12T00:56:18.531 INFO:teuthology.orchestra.run.smithi073.stderr: 32800K .......... .......... .......... .......... .......... 35% 278M 0s 2024-09-12T00:56:18.531 INFO:teuthology.orchestra.run.smithi073.stderr: 32850K .......... .......... .......... .......... .......... 35% 215M 0s 2024-09-12T00:56:18.531 INFO:teuthology.orchestra.run.smithi073.stderr: 32900K .......... .......... .......... .......... .......... 35% 266M 0s 2024-09-12T00:56:18.531 INFO:teuthology.orchestra.run.smithi073.stderr: 32950K .......... .......... .......... .......... .......... 35% 261M 0s 2024-09-12T00:56:18.532 INFO:teuthology.orchestra.run.smithi073.stderr: 33000K .......... .......... .......... .......... .......... 35% 304M 0s 2024-09-12T00:56:18.532 INFO:teuthology.orchestra.run.smithi073.stderr: 33050K .......... .......... .......... .......... .......... 35% 280M 0s 2024-09-12T00:56:18.532 INFO:teuthology.orchestra.run.smithi073.stderr: 33100K .......... .......... .......... .......... .......... 35% 15.8M 0s 2024-09-12T00:56:18.532 INFO:teuthology.orchestra.run.smithi073.stderr: 33150K .......... .......... .......... .......... .......... 35% 152M 0s 2024-09-12T00:56:18.532 INFO:teuthology.orchestra.run.smithi073.stderr: 33200K .......... .......... .......... .......... .......... 35% 257M 0s 2024-09-12T00:56:18.532 INFO:teuthology.orchestra.run.smithi073.stderr: 33250K .......... .......... .......... .......... .......... 35% 264M 0s 2024-09-12T00:56:18.532 INFO:teuthology.orchestra.run.smithi073.stderr: 33300K .......... .......... .......... .......... .......... 35% 312M 0s 2024-09-12T00:56:18.532 INFO:teuthology.orchestra.run.smithi073.stderr: 33350K .......... .......... .......... .......... .......... 35% 248M 0s 2024-09-12T00:56:18.532 INFO:teuthology.orchestra.run.smithi073.stderr: 33400K .......... .......... .......... .......... .......... 36% 261M 0s 2024-09-12T00:56:18.532 INFO:teuthology.orchestra.run.smithi073.stderr: 33450K .......... .......... .......... .......... .......... 36% 251M 0s 2024-09-12T00:56:18.532 INFO:teuthology.orchestra.run.smithi073.stderr: 33500K .......... .......... .......... .......... .......... 36% 259M 0s 2024-09-12T00:56:18.533 INFO:teuthology.orchestra.run.smithi073.stderr: 33550K .......... .......... .......... .......... .......... 36% 244M 0s 2024-09-12T00:56:18.533 INFO:teuthology.orchestra.run.smithi073.stderr: 33600K .......... .......... .......... .......... .......... 36% 269M 0s 2024-09-12T00:56:18.533 INFO:teuthology.orchestra.run.smithi073.stderr: 33650K .......... .......... .......... .......... .......... 36% 261M 0s 2024-09-12T00:56:18.533 INFO:teuthology.orchestra.run.smithi073.stderr: 33700K .......... .......... .......... .......... .......... 36% 281M 0s 2024-09-12T00:56:18.533 INFO:teuthology.orchestra.run.smithi073.stderr: 33750K .......... .......... .......... .......... .......... 36% 239M 0s 2024-09-12T00:56:18.533 INFO:teuthology.orchestra.run.smithi073.stderr: 33800K .......... .......... .......... .......... .......... 36% 238M 0s 2024-09-12T00:56:18.533 INFO:teuthology.orchestra.run.smithi073.stderr: 33850K .......... .......... .......... .......... .......... 36% 293M 0s 2024-09-12T00:56:18.533 INFO:teuthology.orchestra.run.smithi073.stderr: 33900K .......... .......... .......... .......... .......... 36% 282M 0s 2024-09-12T00:56:18.533 INFO:teuthology.orchestra.run.smithi073.stderr: 33950K .......... .......... .......... .......... .......... 36% 257M 0s 2024-09-12T00:56:18.533 INFO:teuthology.orchestra.run.smithi073.stderr: 34000K .......... .......... .......... .......... .......... 36% 275M 0s 2024-09-12T00:56:18.533 INFO:teuthology.orchestra.run.smithi073.stderr: 34050K .......... .......... .......... .......... .......... 36% 276M 0s 2024-09-12T00:56:18.533 INFO:teuthology.orchestra.run.smithi073.stderr: 34100K .......... .......... .......... .......... .......... 36% 266M 0s 2024-09-12T00:56:18.534 INFO:teuthology.orchestra.run.smithi073.stderr: 34150K .......... .......... .......... .......... .......... 36% 243M 0s 2024-09-12T00:56:18.534 INFO:teuthology.orchestra.run.smithi073.stderr: 34200K .......... .......... .......... .......... .......... 36% 286M 0s 2024-09-12T00:56:18.534 INFO:teuthology.orchestra.run.smithi073.stderr: 34250K .......... .......... .......... .......... .......... 36% 279M 0s 2024-09-12T00:56:18.534 INFO:teuthology.orchestra.run.smithi073.stderr: 34300K .......... .......... .......... .......... .......... 36% 289M 0s 2024-09-12T00:56:18.534 INFO:teuthology.orchestra.run.smithi073.stderr: 34350K .......... .......... .......... .......... .......... 37% 266M 0s 2024-09-12T00:56:18.534 INFO:teuthology.orchestra.run.smithi073.stderr: 34400K .......... .......... .......... .......... .......... 37% 288M 0s 2024-09-12T00:56:18.534 INFO:teuthology.orchestra.run.smithi073.stderr: 34450K .......... .......... .......... .......... .......... 37% 302M 0s 2024-09-12T00:56:18.534 INFO:teuthology.orchestra.run.smithi073.stderr: 34500K .......... .......... .......... .......... .......... 37% 286M 0s 2024-09-12T00:56:18.534 INFO:teuthology.orchestra.run.smithi073.stderr: 34550K .......... .......... .......... .......... .......... 37% 222M 0s 2024-09-12T00:56:18.534 INFO:teuthology.orchestra.run.smithi073.stderr: 34600K .......... .......... .......... .......... .......... 37% 231M 0s 2024-09-12T00:56:18.534 INFO:teuthology.orchestra.run.smithi073.stderr: 34650K .......... .......... .......... .......... .......... 37% 284M 0s 2024-09-12T00:56:18.535 INFO:teuthology.orchestra.run.smithi073.stderr: 34700K .......... .......... .......... .......... .......... 37% 281M 0s 2024-09-12T00:56:18.535 INFO:teuthology.orchestra.run.smithi073.stderr: 34750K .......... .......... .......... .......... .......... 37% 268M 0s 2024-09-12T00:56:18.535 INFO:teuthology.orchestra.run.smithi073.stderr: 34800K .......... .......... .......... .......... .......... 37% 238M 0s 2024-09-12T00:56:18.535 INFO:teuthology.orchestra.run.smithi073.stderr: 34850K .......... .......... .......... .......... .......... 37% 225M 0s 2024-09-12T00:56:18.535 INFO:teuthology.orchestra.run.smithi073.stderr: 34900K .......... .......... .......... .......... .......... 37% 267M 0s 2024-09-12T00:56:18.535 INFO:teuthology.orchestra.run.smithi073.stderr: 34950K .......... .......... .......... .......... .......... 37% 245M 0s 2024-09-12T00:56:18.535 INFO:teuthology.orchestra.run.smithi073.stderr: 35000K .......... .......... .......... .......... .......... 37% 293M 0s 2024-09-12T00:56:18.535 INFO:teuthology.orchestra.run.smithi073.stderr: 35050K .......... .......... .......... .......... .......... 37% 265M 0s 2024-09-12T00:56:18.535 INFO:teuthology.orchestra.run.smithi073.stderr: 35100K .......... .......... .......... .......... .......... 37% 286M 0s 2024-09-12T00:56:18.535 INFO:teuthology.orchestra.run.smithi073.stderr: 35150K .......... .......... .......... .......... .......... 37% 225M 0s 2024-09-12T00:56:18.535 INFO:teuthology.orchestra.run.smithi073.stderr: 35200K .......... .......... .......... .......... .......... 37% 287M 0s 2024-09-12T00:56:18.535 INFO:teuthology.orchestra.run.smithi073.stderr: 35250K .......... .......... .......... .......... .......... 37% 285M 0s 2024-09-12T00:56:18.536 INFO:teuthology.orchestra.run.smithi073.stderr: 35300K .......... .......... .......... .......... .......... 38% 290M 0s 2024-09-12T00:56:18.536 INFO:teuthology.orchestra.run.smithi073.stderr: 35350K .......... .......... .......... .......... .......... 38% 238M 0s 2024-09-12T00:56:18.536 INFO:teuthology.orchestra.run.smithi073.stderr: 35400K .......... .......... .......... .......... .......... 38% 294M 0s 2024-09-12T00:56:18.536 INFO:teuthology.orchestra.run.smithi073.stderr: 35450K .......... .......... .......... .......... .......... 38% 302M 0s 2024-09-12T00:56:18.536 INFO:teuthology.orchestra.run.smithi073.stderr: 35500K .......... .......... .......... .......... .......... 38% 296M 0s 2024-09-12T00:56:18.536 INFO:teuthology.orchestra.run.smithi073.stderr: 35550K .......... .......... .......... .......... .......... 38% 265M 0s 2024-09-12T00:56:18.536 INFO:teuthology.orchestra.run.smithi073.stderr: 35600K .......... .......... .......... .......... .......... 38% 292M 0s 2024-09-12T00:56:18.536 INFO:teuthology.orchestra.run.smithi073.stderr: 35650K .......... .......... .......... .......... .......... 38% 292M 0s 2024-09-12T00:56:18.536 INFO:teuthology.orchestra.run.smithi073.stderr: 35700K .......... .......... .......... .......... .......... 38% 297M 0s 2024-09-12T00:56:18.536 INFO:teuthology.orchestra.run.smithi073.stderr: 35750K .......... .......... .......... .......... .......... 38% 248M 0s 2024-09-12T00:56:18.536 INFO:teuthology.orchestra.run.smithi073.stderr: 35800K .......... .......... .......... .......... .......... 38% 291M 0s 2024-09-12T00:56:18.537 INFO:teuthology.orchestra.run.smithi073.stderr: 35850K .......... .......... .......... .......... .......... 38% 297M 0s 2024-09-12T00:56:18.537 INFO:teuthology.orchestra.run.smithi073.stderr: 35900K .......... .......... .......... .......... .......... 38% 293M 0s 2024-09-12T00:56:18.537 INFO:teuthology.orchestra.run.smithi073.stderr: 35950K .......... .......... .......... .......... .......... 38% 277M 0s 2024-09-12T00:56:18.537 INFO:teuthology.orchestra.run.smithi073.stderr: 36000K .......... .......... .......... .......... .......... 38% 23.3M 0s 2024-09-12T00:56:18.537 INFO:teuthology.orchestra.run.smithi073.stderr: 36050K .......... .......... .......... .......... .......... 38% 281M 0s 2024-09-12T00:56:18.537 INFO:teuthology.orchestra.run.smithi073.stderr: 36100K .......... .......... .......... .......... .......... 38% 286M 0s 2024-09-12T00:56:18.537 INFO:teuthology.orchestra.run.smithi073.stderr: 36150K .......... .......... .......... .......... .......... 38% 46.7M 0s 2024-09-12T00:56:18.537 INFO:teuthology.orchestra.run.smithi073.stderr: 36200K .......... .......... .......... .......... .......... 39% 44.5M 0s 2024-09-12T00:56:18.537 INFO:teuthology.orchestra.run.smithi073.stderr: 36250K .......... .......... .......... .......... .......... 39% 251M 0s 2024-09-12T00:56:18.537 INFO:teuthology.orchestra.run.smithi073.stderr: 36300K .......... .......... .......... .......... .......... 39% 147M 0s 2024-09-12T00:56:18.537 INFO:teuthology.orchestra.run.smithi073.stderr: 36350K .......... .......... .......... .......... .......... 39% 249M 0s 2024-09-12T00:56:18.538 INFO:teuthology.orchestra.run.smithi073.stderr: 36400K .......... .......... .......... .......... .......... 39% 274M 0s 2024-09-12T00:56:18.538 INFO:teuthology.orchestra.run.smithi073.stderr: 36450K .......... .......... .......... .......... .......... 39% 265M 0s 2024-09-12T00:56:18.538 INFO:teuthology.orchestra.run.smithi073.stderr: 36500K .......... .......... .......... .......... .......... 39% 281M 0s 2024-09-12T00:56:18.538 INFO:teuthology.orchestra.run.smithi073.stderr: 36550K .......... .......... .......... .......... .......... 39% 253M 0s 2024-09-12T00:56:18.538 INFO:teuthology.orchestra.run.smithi073.stderr: 36600K .......... .......... .......... .......... .......... 39% 292M 0s 2024-09-12T00:56:18.538 INFO:teuthology.orchestra.run.smithi073.stderr: 36650K .......... .......... .......... .......... .......... 39% 266M 0s 2024-09-12T00:56:18.538 INFO:teuthology.orchestra.run.smithi073.stderr: 36700K .......... .......... .......... .......... .......... 39% 275M 0s 2024-09-12T00:56:18.538 INFO:teuthology.orchestra.run.smithi073.stderr: 36750K .......... .......... .......... .......... .......... 39% 241M 0s 2024-09-12T00:56:18.538 INFO:teuthology.orchestra.run.smithi073.stderr: 36800K .......... .......... .......... .......... .......... 39% 235M 0s 2024-09-12T00:56:18.538 INFO:teuthology.orchestra.run.smithi073.stderr: 36850K .......... .......... .......... .......... .......... 39% 364M 0s 2024-09-12T00:56:18.538 INFO:teuthology.orchestra.run.smithi073.stderr: 36900K .......... .......... .......... .......... .......... 39% 362M 0s 2024-09-12T00:56:18.538 INFO:teuthology.orchestra.run.smithi073.stderr: 36950K .......... .......... .......... .......... .......... 39% 317M 0s 2024-09-12T00:56:18.539 INFO:teuthology.orchestra.run.smithi073.stderr: 37000K .......... .......... .......... .......... .......... 39% 395M 0s 2024-09-12T00:56:18.539 INFO:teuthology.orchestra.run.smithi073.stderr: 37050K .......... .......... .......... .......... .......... 39% 381M 0s 2024-09-12T00:56:18.539 INFO:teuthology.orchestra.run.smithi073.stderr: 37100K .......... .......... .......... .......... .......... 39% 379M 0s 2024-09-12T00:56:18.539 INFO:teuthology.orchestra.run.smithi073.stderr: 37150K .......... .......... .......... .......... .......... 40% 320M 0s 2024-09-12T00:56:18.539 INFO:teuthology.orchestra.run.smithi073.stderr: 37200K .......... .......... .......... .......... .......... 40% 377M 0s 2024-09-12T00:56:18.539 INFO:teuthology.orchestra.run.smithi073.stderr: 37250K .......... .......... .......... .......... .......... 40% 361M 0s 2024-09-12T00:56:18.539 INFO:teuthology.orchestra.run.smithi073.stderr: 37300K .......... .......... .......... .......... .......... 40% 365M 0s 2024-09-12T00:56:18.539 INFO:teuthology.orchestra.run.smithi073.stderr: 37350K .......... .......... .......... .......... .......... 40% 287M 0s 2024-09-12T00:56:18.539 INFO:teuthology.orchestra.run.smithi073.stderr: 37400K .......... .......... .......... .......... .......... 40% 372M 0s 2024-09-12T00:56:18.539 INFO:teuthology.orchestra.run.smithi073.stderr: 37450K .......... .......... .......... .......... .......... 40% 378M 0s 2024-09-12T00:56:18.539 INFO:teuthology.orchestra.run.smithi073.stderr: 37500K .......... .......... .......... .......... .......... 40% 327M 0s 2024-09-12T00:56:18.540 INFO:teuthology.orchestra.run.smithi073.stderr: 37550K .......... .......... .......... .......... .......... 40% 333M 0s 2024-09-12T00:56:18.540 INFO:teuthology.orchestra.run.smithi073.stderr: 37600K .......... .......... .......... .......... .......... 40% 373M 0s 2024-09-12T00:56:18.540 INFO:teuthology.orchestra.run.smithi073.stderr: 37650K .......... .......... .......... .......... .......... 40% 334M 0s 2024-09-12T00:56:18.540 INFO:teuthology.orchestra.run.smithi073.stderr: 37700K .......... .......... .......... .......... .......... 40% 388M 0s 2024-09-12T00:56:18.540 INFO:teuthology.orchestra.run.smithi073.stderr: 37750K .......... .......... .......... .......... .......... 40% 297M 0s 2024-09-12T00:56:18.540 INFO:teuthology.orchestra.run.smithi073.stderr: 37800K .......... .......... .......... .......... .......... 40% 397M 0s 2024-09-12T00:56:18.540 INFO:teuthology.orchestra.run.smithi073.stderr: 37850K .......... .......... .......... .......... .......... 40% 353M 0s 2024-09-12T00:56:18.540 INFO:teuthology.orchestra.run.smithi073.stderr: 37900K .......... .......... .......... .......... .......... 40% 369M 0s 2024-09-12T00:56:18.540 INFO:teuthology.orchestra.run.smithi073.stderr: 37950K .......... .......... .......... .......... .......... 40% 327M 0s 2024-09-12T00:56:18.540 INFO:teuthology.orchestra.run.smithi073.stderr: 38000K .......... .......... .......... .......... .......... 40% 375M 0s 2024-09-12T00:56:18.540 INFO:teuthology.orchestra.run.smithi073.stderr: 38050K .......... .......... .......... .......... .......... 41% 344M 0s 2024-09-12T00:56:18.541 INFO:teuthology.orchestra.run.smithi073.stderr: 38100K .......... .......... .......... .......... .......... 41% 331M 0s 2024-09-12T00:56:18.541 INFO:teuthology.orchestra.run.smithi073.stderr: 38150K .......... .......... .......... .......... .......... 41% 393M 0s 2024-09-12T00:56:18.541 INFO:teuthology.orchestra.run.smithi073.stderr: 38200K .......... .......... .......... .......... .......... 41% 367M 0s 2024-09-12T00:56:18.541 INFO:teuthology.orchestra.run.smithi073.stderr: 38250K .......... .......... .......... .......... .......... 41% 340M 0s 2024-09-12T00:56:18.541 INFO:teuthology.orchestra.run.smithi073.stderr: 38300K .......... .......... .......... .......... .......... 41% 390M 0s 2024-09-12T00:56:18.541 INFO:teuthology.orchestra.run.smithi073.stderr: 38350K .......... .......... .......... .......... .......... 41% 398M 0s 2024-09-12T00:56:18.541 INFO:teuthology.orchestra.run.smithi073.stderr: 38400K .......... .......... .......... .......... .......... 41% 385M 0s 2024-09-12T00:56:18.541 INFO:teuthology.orchestra.run.smithi073.stderr: 38450K .......... .......... .......... .......... .......... 41% 317M 0s 2024-09-12T00:56:18.541 INFO:teuthology.orchestra.run.smithi073.stderr: 38500K .......... .......... .......... .......... .......... 41% 393M 0s 2024-09-12T00:56:18.541 INFO:teuthology.orchestra.run.smithi073.stderr: 38550K .......... .......... .......... .......... .......... 41% 388M 0s 2024-09-12T00:56:18.541 INFO:teuthology.orchestra.run.smithi073.stderr: 38600K .......... .......... .......... .......... .......... 41% 37.1M 0s 2024-09-12T00:56:18.541 INFO:teuthology.orchestra.run.smithi073.stderr: 38650K .......... .......... .......... .......... .......... 41% 275M 0s 2024-09-12T00:56:18.542 INFO:teuthology.orchestra.run.smithi073.stderr: 38700K .......... .......... .......... .......... .......... 41% 370M 0s 2024-09-12T00:56:18.542 INFO:teuthology.orchestra.run.smithi073.stderr: 38750K .......... .......... .......... .......... .......... 41% 318M 0s 2024-09-12T00:56:18.542 INFO:teuthology.orchestra.run.smithi073.stderr: 38800K .......... .......... .......... .......... .......... 41% 384M 0s 2024-09-12T00:56:18.542 INFO:teuthology.orchestra.run.smithi073.stderr: 38850K .......... .......... .......... .......... .......... 41% 295M 0s 2024-09-12T00:56:18.542 INFO:teuthology.orchestra.run.smithi073.stderr: 38900K .......... .......... .......... .......... .......... 41% 363M 0s 2024-09-12T00:56:18.542 INFO:teuthology.orchestra.run.smithi073.stderr: 38950K .......... .......... .......... .......... .......... 41% 405M 0s 2024-09-12T00:56:18.542 INFO:teuthology.orchestra.run.smithi073.stderr: 39000K .......... .......... .......... .......... .......... 42% 388M 0s 2024-09-12T00:56:18.542 INFO:teuthology.orchestra.run.smithi073.stderr: 39050K .......... .......... .......... .......... .......... 42% 351M 0s 2024-09-12T00:56:18.542 INFO:teuthology.orchestra.run.smithi073.stderr: 39100K .......... .......... .......... .......... .......... 42% 191M 0s 2024-09-12T00:56:18.542 INFO:teuthology.orchestra.run.smithi073.stderr: 39150K .......... .......... .......... .......... .......... 42% 313M 0s 2024-09-12T00:56:18.542 INFO:teuthology.orchestra.run.smithi073.stderr: 39200K .......... .......... .......... .......... .......... 42% 43.3M 0s 2024-09-12T00:56:18.543 INFO:teuthology.orchestra.run.smithi073.stderr: 39250K .......... .......... .......... .......... .......... 42% 67.4M 0s 2024-09-12T00:56:18.543 INFO:teuthology.orchestra.run.smithi073.stderr: 39300K .......... .......... .......... .......... .......... 42% 61.2M 0s 2024-09-12T00:56:18.543 INFO:teuthology.orchestra.run.smithi073.stderr: 39350K .......... .......... .......... .......... .......... 42% 338M 0s 2024-09-12T00:56:18.543 INFO:teuthology.orchestra.run.smithi073.stderr: 39400K .......... .......... .......... .......... .......... 42% 343M 0s 2024-09-12T00:56:18.543 INFO:teuthology.orchestra.run.smithi073.stderr: 39450K .......... .......... .......... .......... .......... 42% 77.1M 0s 2024-09-12T00:56:18.543 INFO:teuthology.orchestra.run.smithi073.stderr: 39500K .......... .......... .......... .......... .......... 42% 357M 0s 2024-09-12T00:56:18.543 INFO:teuthology.orchestra.run.smithi073.stderr: 39550K .......... .......... .......... .......... .......... 42% 369M 0s 2024-09-12T00:56:18.543 INFO:teuthology.orchestra.run.smithi073.stderr: 39600K .......... .......... .......... .......... .......... 42% 366M 0s 2024-09-12T00:56:18.543 INFO:teuthology.orchestra.run.smithi073.stderr: 39650K .......... .......... .......... .......... .......... 42% 297M 0s 2024-09-12T00:56:18.543 INFO:teuthology.orchestra.run.smithi073.stderr: 39700K .......... .......... .......... .......... .......... 42% 386M 0s 2024-09-12T00:56:18.543 INFO:teuthology.orchestra.run.smithi073.stderr: 39750K .......... .......... .......... .......... .......... 42% 385M 0s 2024-09-12T00:56:18.543 INFO:teuthology.orchestra.run.smithi073.stderr: 39800K .......... .......... .......... .......... .......... 42% 386M 0s 2024-09-12T00:56:18.544 INFO:teuthology.orchestra.run.smithi073.stderr: 39850K .......... .......... .......... .......... .......... 42% 341M 0s 2024-09-12T00:56:18.544 INFO:teuthology.orchestra.run.smithi073.stderr: 39900K .......... .......... .......... .......... .......... 43% 394M 0s 2024-09-12T00:56:18.544 INFO:teuthology.orchestra.run.smithi073.stderr: 39950K .......... .......... .......... .......... .......... 43% 389M 0s 2024-09-12T00:56:18.544 INFO:teuthology.orchestra.run.smithi073.stderr: 40000K .......... .......... .......... .......... .......... 43% 105M 0s 2024-09-12T00:56:18.544 INFO:teuthology.orchestra.run.smithi073.stderr: 40050K .......... .......... .......... .......... .......... 43% 245M 0s 2024-09-12T00:56:18.544 INFO:teuthology.orchestra.run.smithi073.stderr: 40100K .......... .......... .......... .......... .......... 43% 374M 0s 2024-09-12T00:56:18.544 INFO:teuthology.orchestra.run.smithi073.stderr: 40150K .......... .......... .......... .......... .......... 43% 374M 0s 2024-09-12T00:56:18.544 INFO:teuthology.orchestra.run.smithi073.stderr: 40200K .......... .......... .......... .......... .......... 43% 392M 0s 2024-09-12T00:56:18.544 INFO:teuthology.orchestra.run.smithi073.stderr: 40250K .......... .......... .......... .......... .......... 43% 321M 0s 2024-09-12T00:56:18.544 INFO:teuthology.orchestra.run.smithi073.stderr: 40300K .......... .......... .......... .......... .......... 43% 374M 0s 2024-09-12T00:56:18.544 INFO:teuthology.orchestra.run.smithi073.stderr: 40350K .......... .......... .......... .......... .......... 43% 362M 0s 2024-09-12T00:56:18.545 INFO:teuthology.orchestra.run.smithi073.stderr: 40400K .......... .......... .......... .......... .......... 43% 400M 0s 2024-09-12T00:56:18.545 INFO:teuthology.orchestra.run.smithi073.stderr: 40450K .......... .......... .......... .......... .......... 43% 317M 0s 2024-09-12T00:56:18.545 INFO:teuthology.orchestra.run.smithi073.stderr: 40500K .......... .......... .......... .......... .......... 43% 389M 0s 2024-09-12T00:56:18.545 INFO:teuthology.orchestra.run.smithi073.stderr: 40550K .......... .......... .......... .......... .......... 43% 397M 0s 2024-09-12T00:56:18.545 INFO:teuthology.orchestra.run.smithi073.stderr: 40600K .......... .......... .......... .......... .......... 43% 384M 0s 2024-09-12T00:56:18.545 INFO:teuthology.orchestra.run.smithi073.stderr: 40650K .......... .......... .......... .......... .......... 43% 346M 0s 2024-09-12T00:56:18.545 INFO:teuthology.orchestra.run.smithi073.stderr: 40700K .......... .......... .......... .......... .......... 43% 360M 0s 2024-09-12T00:56:18.545 INFO:teuthology.orchestra.run.smithi073.stderr: 40750K .......... .......... .......... .......... .......... 43% 279M 0s 2024-09-12T00:56:18.545 INFO:teuthology.orchestra.run.smithi073.stderr: 40800K .......... .......... .......... .......... .......... 43% 347M 0s 2024-09-12T00:56:18.545 INFO:teuthology.orchestra.run.smithi073.stderr: 40850K .......... .......... .......... .......... .......... 44% 331M 0s 2024-09-12T00:56:18.545 INFO:teuthology.orchestra.run.smithi073.stderr: 40900K .......... .......... .......... .......... .......... 44% 409M 0s 2024-09-12T00:56:18.545 INFO:teuthology.orchestra.run.smithi073.stderr: 40950K .......... .......... .......... .......... .......... 44% 395M 0s 2024-09-12T00:56:18.546 INFO:teuthology.orchestra.run.smithi073.stderr: 41000K .......... .......... .......... .......... .......... 44% 318M 0s 2024-09-12T00:56:18.546 INFO:teuthology.orchestra.run.smithi073.stderr: 41050K .......... .......... .......... .......... .......... 44% 385M 0s 2024-09-12T00:56:18.546 INFO:teuthology.orchestra.run.smithi073.stderr: 41100K .......... .......... .......... .......... .......... 44% 396M 0s 2024-09-12T00:56:18.546 INFO:teuthology.orchestra.run.smithi073.stderr: 41150K .......... .......... .......... .......... .......... 44% 309M 0s 2024-09-12T00:56:18.546 INFO:teuthology.orchestra.run.smithi073.stderr: 41200K .......... .......... .......... .......... .......... 44% 365M 0s 2024-09-12T00:56:18.546 INFO:teuthology.orchestra.run.smithi073.stderr: 41250K .......... .......... .......... .......... .......... 44% 27.0M 0s 2024-09-12T00:56:18.546 INFO:teuthology.orchestra.run.smithi073.stderr: 41300K .......... .......... .......... .......... .......... 44% 304M 0s 2024-09-12T00:56:18.546 INFO:teuthology.orchestra.run.smithi073.stderr: 41350K .......... .......... .......... .......... .......... 44% 333M 0s 2024-09-12T00:56:18.546 INFO:teuthology.orchestra.run.smithi073.stderr: 41400K .......... .......... .......... .......... .......... 44% 380M 0s 2024-09-12T00:56:18.546 INFO:teuthology.orchestra.run.smithi073.stderr: 41450K .......... .......... .......... .......... .......... 44% 341M 0s 2024-09-12T00:56:18.546 INFO:teuthology.orchestra.run.smithi073.stderr: 41500K .......... .......... .......... .......... .......... 44% 386M 0s 2024-09-12T00:56:18.547 INFO:teuthology.orchestra.run.smithi073.stderr: 41550K .......... .......... .......... .......... .......... 44% 316M 0s 2024-09-12T00:56:18.547 INFO:teuthology.orchestra.run.smithi073.stderr: 41600K .......... .......... .......... .......... .......... 44% 388M 0s 2024-09-12T00:56:18.547 INFO:teuthology.orchestra.run.smithi073.stderr: 41650K .......... .......... .......... .......... .......... 44% 384M 0s 2024-09-12T00:56:18.547 INFO:teuthology.orchestra.run.smithi073.stderr: 41700K .......... .......... .......... .......... .......... 44% 385M 0s 2024-09-12T00:56:18.547 INFO:teuthology.orchestra.run.smithi073.stderr: 41750K .......... .......... .......... .......... .......... 44% 341M 0s 2024-09-12T00:56:18.547 INFO:teuthology.orchestra.run.smithi073.stderr: 41800K .......... .......... .......... .......... .......... 45% 385M 0s 2024-09-12T00:56:18.547 INFO:teuthology.orchestra.run.smithi073.stderr: 41850K .......... .......... .......... .......... .......... 45% 352M 0s 2024-09-12T00:56:18.547 INFO:teuthology.orchestra.run.smithi073.stderr: 41900K .......... .......... .......... .......... .......... 45% 415M 0s 2024-09-12T00:56:18.547 INFO:teuthology.orchestra.run.smithi073.stderr: 41950K .......... .......... .......... .......... .......... 45% 319M 0s 2024-09-12T00:56:18.547 INFO:teuthology.orchestra.run.smithi073.stderr: 42000K .......... .......... .......... .......... .......... 45% 378M 0s 2024-09-12T00:56:18.547 INFO:teuthology.orchestra.run.smithi073.stderr: 42050K .......... .......... .......... .......... .......... 45% 395M 0s 2024-09-12T00:56:18.548 INFO:teuthology.orchestra.run.smithi073.stderr: 42100K .......... .......... .......... .......... .......... 45% 397M 0s 2024-09-12T00:56:18.548 INFO:teuthology.orchestra.run.smithi073.stderr: 42150K .......... .......... .......... .......... .......... 45% 308M 0s 2024-09-12T00:56:18.548 INFO:teuthology.orchestra.run.smithi073.stderr: 42200K .......... .......... .......... .......... .......... 45% 386M 0s 2024-09-12T00:56:18.548 INFO:teuthology.orchestra.run.smithi073.stderr: 42250K .......... .......... .......... .......... .......... 45% 145M 0s 2024-09-12T00:56:18.548 INFO:teuthology.orchestra.run.smithi073.stderr: 42300K .......... .......... .......... .......... .......... 45% 87.2M 0s 2024-09-12T00:56:18.548 INFO:teuthology.orchestra.run.smithi073.stderr: 42350K .......... .......... .......... .......... .......... 45% 52.3M 0s 2024-09-12T00:56:18.548 INFO:teuthology.orchestra.run.smithi073.stderr: 42400K .......... .......... .......... .......... .......... 45% 52.9M 0s 2024-09-12T00:56:18.548 INFO:teuthology.orchestra.run.smithi073.stderr: 42450K .......... .......... .......... .......... .......... 45% 294M 0s 2024-09-12T00:56:18.548 INFO:teuthology.orchestra.run.smithi073.stderr: 42500K .......... .......... .......... .......... .......... 45% 370M 0s 2024-09-12T00:56:18.548 INFO:teuthology.orchestra.run.smithi073.stderr: 42550K .......... .......... .......... .......... .......... 45% 342M 0s 2024-09-12T00:56:18.548 INFO:teuthology.orchestra.run.smithi073.stderr: 42600K .......... .......... .......... .......... .......... 45% 379M 0s 2024-09-12T00:56:18.549 INFO:teuthology.orchestra.run.smithi073.stderr: 42650K .......... .......... .......... .......... .......... 45% 390M 0s 2024-09-12T00:56:18.549 INFO:teuthology.orchestra.run.smithi073.stderr: 42700K .......... .......... .......... .......... .......... 46% 376M 0s 2024-09-12T00:56:18.549 INFO:teuthology.orchestra.run.smithi073.stderr: 42750K .......... .......... .......... .......... .......... 46% 319M 0s 2024-09-12T00:56:18.549 INFO:teuthology.orchestra.run.smithi073.stderr: 42800K .......... .......... .......... .......... .......... 46% 385M 0s 2024-09-12T00:56:18.549 INFO:teuthology.orchestra.run.smithi073.stderr: 42850K .......... .......... .......... .......... .......... 46% 340M 0s 2024-09-12T00:56:18.549 INFO:teuthology.orchestra.run.smithi073.stderr: 42900K .......... .......... .......... .......... .......... 46% 385M 0s 2024-09-12T00:56:18.549 INFO:teuthology.orchestra.run.smithi073.stderr: 42950K .......... .......... .......... .......... .......... 46% 346M 0s 2024-09-12T00:56:18.549 INFO:teuthology.orchestra.run.smithi073.stderr: 43000K .......... .......... .......... .......... .......... 46% 77.5M 0s 2024-09-12T00:56:18.549 INFO:teuthology.orchestra.run.smithi073.stderr: 43050K .......... .......... .......... .......... .......... 46% 302M 0s 2024-09-12T00:56:18.549 INFO:teuthology.orchestra.run.smithi073.stderr: 43100K .......... .......... .......... .......... .......... 46% 401M 0s 2024-09-12T00:56:18.549 INFO:teuthology.orchestra.run.smithi073.stderr: 43150K .......... .......... .......... .......... .......... 46% 309M 0s 2024-09-12T00:56:18.550 INFO:teuthology.orchestra.run.smithi073.stderr: 43200K .......... .......... .......... .......... .......... 46% 362M 0s 2024-09-12T00:56:18.550 INFO:teuthology.orchestra.run.smithi073.stderr: 43250K .......... .......... .......... .......... .......... 46% 376M 0s 2024-09-12T00:56:18.550 INFO:teuthology.orchestra.run.smithi073.stderr: 43300K .......... .......... .......... .......... .......... 46% 388M 0s 2024-09-12T00:56:18.550 INFO:teuthology.orchestra.run.smithi073.stderr: 43350K .......... .......... .......... .......... .......... 46% 344M 0s 2024-09-12T00:56:18.550 INFO:teuthology.orchestra.run.smithi073.stderr: 43400K .......... .......... .......... .......... .......... 46% 370M 0s 2024-09-12T00:56:18.550 INFO:teuthology.orchestra.run.smithi073.stderr: 43450K .......... .......... .......... .......... .......... 46% 387M 0s 2024-09-12T00:56:18.550 INFO:teuthology.orchestra.run.smithi073.stderr: 43500K .......... .......... .......... .......... .......... 46% 394M 0s 2024-09-12T00:56:18.550 INFO:teuthology.orchestra.run.smithi073.stderr: 43550K .......... .......... .......... .......... .......... 46% 366M 0s 2024-09-12T00:56:18.550 INFO:teuthology.orchestra.run.smithi073.stderr: 43600K .......... .......... .......... .......... .......... 46% 463M 0s 2024-09-12T00:56:18.550 INFO:teuthology.orchestra.run.smithi073.stderr: 43650K .......... .......... .......... .......... .......... 47% 466M 0s 2024-09-12T00:56:18.550 INFO:teuthology.orchestra.run.smithi073.stderr: 43700K .......... .......... .......... .......... .......... 47% 403M 0s 2024-09-12T00:56:18.550 INFO:teuthology.orchestra.run.smithi073.stderr: 43750K .......... .......... .......... .......... .......... 47% 334M 0s 2024-09-12T00:56:18.551 INFO:teuthology.orchestra.run.smithi073.stderr: 43800K .......... .......... .......... .......... .......... 47% 272M 0s 2024-09-12T00:56:18.551 INFO:teuthology.orchestra.run.smithi073.stderr: 43850K .......... .......... .......... .......... .......... 47% 433M 0s 2024-09-12T00:56:18.551 INFO:teuthology.orchestra.run.smithi073.stderr: 43900K .......... .......... .......... .......... .......... 47% 456M 0s 2024-09-12T00:56:18.551 INFO:teuthology.orchestra.run.smithi073.stderr: 43950K .......... .......... .......... .......... .......... 47% 95.8M 0s 2024-09-12T00:56:18.551 INFO:teuthology.orchestra.run.smithi073.stderr: 44000K .......... .......... .......... .......... .......... 47% 302M 0s 2024-09-12T00:56:18.551 INFO:teuthology.orchestra.run.smithi073.stderr: 44050K .......... .......... .......... .......... .......... 47% 253M 0s 2024-09-12T00:56:18.551 INFO:teuthology.orchestra.run.smithi073.stderr: 44100K .......... .......... .......... .......... .......... 47% 445M 0s 2024-09-12T00:56:18.551 INFO:teuthology.orchestra.run.smithi073.stderr: 44150K .......... .......... .......... .......... .......... 47% 412M 0s 2024-09-12T00:56:18.551 INFO:teuthology.orchestra.run.smithi073.stderr: 44200K .......... .......... .......... .......... .......... 47% 35.8M 0s 2024-09-12T00:56:18.551 INFO:teuthology.orchestra.run.smithi073.stderr: 44250K .......... .......... .......... .......... .......... 47% 356M 0s 2024-09-12T00:56:18.551 INFO:teuthology.orchestra.run.smithi073.stderr: 44300K .......... .......... .......... .......... .......... 47% 373M 0s 2024-09-12T00:56:18.552 INFO:teuthology.orchestra.run.smithi073.stderr: 44350K .......... .......... .......... .......... .......... 47% 299M 0s 2024-09-12T00:56:18.552 INFO:teuthology.orchestra.run.smithi073.stderr: 44400K .......... .......... .......... .......... .......... 47% 378M 0s 2024-09-12T00:56:18.552 INFO:teuthology.orchestra.run.smithi073.stderr: 44450K .......... .......... .......... .......... .......... 47% 377M 0s 2024-09-12T00:56:18.552 INFO:teuthology.orchestra.run.smithi073.stderr: 44500K .......... .......... .......... .......... .......... 47% 372M 0s 2024-09-12T00:56:18.552 INFO:teuthology.orchestra.run.smithi073.stderr: 44550K .......... .......... .......... .......... .......... 48% 318M 0s 2024-09-12T00:56:18.552 INFO:teuthology.orchestra.run.smithi073.stderr: 44600K .......... .......... .......... .......... .......... 48% 70.7M 0s 2024-09-12T00:56:18.552 INFO:teuthology.orchestra.run.smithi073.stderr: 44650K .......... .......... .......... .......... .......... 48% 372M 0s 2024-09-12T00:56:18.552 INFO:teuthology.orchestra.run.smithi073.stderr: 44700K .......... .......... .......... .......... .......... 48% 407M 0s 2024-09-12T00:56:18.552 INFO:teuthology.orchestra.run.smithi073.stderr: 44750K .......... .......... .......... .......... .......... 48% 301M 0s 2024-09-12T00:56:18.552 INFO:teuthology.orchestra.run.smithi073.stderr: 44800K .......... .......... .......... .......... .......... 48% 204M 0s 2024-09-12T00:56:18.552 INFO:teuthology.orchestra.run.smithi073.stderr: 44850K .......... .......... .......... .......... .......... 48% 349M 0s 2024-09-12T00:56:18.553 INFO:teuthology.orchestra.run.smithi073.stderr: 44900K .......... .......... .......... .......... .......... 48% 383M 0s 2024-09-12T00:56:18.553 INFO:teuthology.orchestra.run.smithi073.stderr: 44950K .......... .......... .......... .......... .......... 48% 335M 0s 2024-09-12T00:56:18.553 INFO:teuthology.orchestra.run.smithi073.stderr: 45000K .......... .......... .......... .......... .......... 48% 378M 0s 2024-09-12T00:56:18.553 INFO:teuthology.orchestra.run.smithi073.stderr: 45050K .......... .......... .......... .......... .......... 48% 391M 0s 2024-09-12T00:56:18.553 INFO:teuthology.orchestra.run.smithi073.stderr: 45100K .......... .......... .......... .......... .......... 48% 369M 0s 2024-09-12T00:56:18.553 INFO:teuthology.orchestra.run.smithi073.stderr: 45150K .......... .......... .......... .......... .......... 48% 298M 0s 2024-09-12T00:56:18.553 INFO:teuthology.orchestra.run.smithi073.stderr: 45200K .......... .......... .......... .......... .......... 48% 387M 0s 2024-09-12T00:56:18.553 INFO:teuthology.orchestra.run.smithi073.stderr: 45250K .......... .......... .......... .......... .......... 48% 392M 0s 2024-09-12T00:56:18.553 INFO:teuthology.orchestra.run.smithi073.stderr: 45300K .......... .......... .......... .......... .......... 48% 392M 0s 2024-09-12T00:56:18.553 INFO:teuthology.orchestra.run.smithi073.stderr: 45350K .......... .......... .......... .......... .......... 48% 349M 0s 2024-09-12T00:56:18.553 INFO:teuthology.orchestra.run.smithi073.stderr: 45400K .......... .......... .......... .......... .......... 48% 64.9M 0s 2024-09-12T00:56:18.554 INFO:teuthology.orchestra.run.smithi073.stderr: 45450K .......... .......... .......... .......... .......... 48% 58.7M 0s 2024-09-12T00:56:18.554 INFO:teuthology.orchestra.run.smithi073.stderr: 45500K .......... .......... .......... .......... .......... 49% 375M 0s 2024-09-12T00:56:18.554 INFO:teuthology.orchestra.run.smithi073.stderr: 45550K .......... .......... .......... .......... .......... 49% 106M 0s 2024-09-12T00:56:18.554 INFO:teuthology.orchestra.run.smithi073.stderr: 45600K .......... .......... .......... .......... .......... 49% 339M 0s 2024-09-12T00:56:18.554 INFO:teuthology.orchestra.run.smithi073.stderr: 45650K .......... .......... .......... .......... .......... 49% 305M 0s 2024-09-12T00:56:18.554 INFO:teuthology.orchestra.run.smithi073.stderr: 45700K .......... .......... .......... .......... .......... 49% 382M 0s 2024-09-12T00:56:18.554 INFO:teuthology.orchestra.run.smithi073.stderr: 45750K .......... .......... .......... .......... .......... 49% 311M 0s 2024-09-12T00:56:18.554 INFO:teuthology.orchestra.run.smithi073.stderr: 45800K .......... .......... .......... .......... .......... 49% 396M 0s 2024-09-12T00:56:18.554 INFO:teuthology.orchestra.run.smithi073.stderr: 45850K .......... .......... .......... .......... .......... 49% 391M 0s 2024-09-12T00:56:18.554 INFO:teuthology.orchestra.run.smithi073.stderr: 45900K .......... .......... .......... .......... .......... 49% 380M 0s 2024-09-12T00:56:18.554 INFO:teuthology.orchestra.run.smithi073.stderr: 45950K .......... .......... .......... .......... .......... 49% 351M 0s 2024-09-12T00:56:18.554 INFO:teuthology.orchestra.run.smithi073.stderr: 46000K .......... .......... .......... .......... .......... 49% 112M 0s 2024-09-12T00:56:18.555 INFO:teuthology.orchestra.run.smithi073.stderr: 46050K .......... .......... .......... .......... .......... 49% 389M 0s 2024-09-12T00:56:18.555 INFO:teuthology.orchestra.run.smithi073.stderr: 46100K .......... .......... .......... .......... .......... 49% 171M 0s 2024-09-12T00:56:18.555 INFO:teuthology.orchestra.run.smithi073.stderr: 46150K .......... .......... .......... .......... .......... 49% 305M 0s 2024-09-12T00:56:18.555 INFO:teuthology.orchestra.run.smithi073.stderr: 46200K .......... .......... .......... .......... .......... 49% 371M 0s 2024-09-12T00:56:18.555 INFO:teuthology.orchestra.run.smithi073.stderr: 46250K .......... .......... .......... .......... .......... 49% 355M 0s 2024-09-12T00:56:18.555 INFO:teuthology.orchestra.run.smithi073.stderr: 46300K .......... .......... .......... .......... .......... 49% 371M 0s 2024-09-12T00:56:18.555 INFO:teuthology.orchestra.run.smithi073.stderr: 46350K .......... .......... .......... .......... .......... 49% 332M 0s 2024-09-12T00:56:18.555 INFO:teuthology.orchestra.run.smithi073.stderr: 46400K .......... .......... .......... .......... .......... 49% 369M 0s 2024-09-12T00:56:18.555 INFO:teuthology.orchestra.run.smithi073.stderr: 46450K .......... .......... .......... .......... .......... 50% 404M 0s 2024-09-12T00:56:18.555 INFO:teuthology.orchestra.run.smithi073.stderr: 46500K .......... .......... .......... .......... .......... 50% 380M 0s 2024-09-12T00:56:18.555 INFO:teuthology.orchestra.run.smithi073.stderr: 46550K .......... .......... .......... .......... .......... 50% 339M 0s 2024-09-12T00:56:18.555 INFO:teuthology.orchestra.run.smithi073.stderr: 46600K .......... .......... .......... .......... .......... 50% 341M 0s 2024-09-12T00:56:18.556 INFO:teuthology.orchestra.run.smithi073.stderr: 46650K .......... .......... .......... .......... .......... 50% 307M 0s 2024-09-12T00:56:18.556 INFO:teuthology.orchestra.run.smithi073.stderr: 46700K .......... .......... .......... .......... .......... 50% 327M 0s 2024-09-12T00:56:18.556 INFO:teuthology.orchestra.run.smithi073.stderr: 46750K .......... .......... .......... .......... .......... 50% 285M 0s 2024-09-12T00:56:18.556 INFO:teuthology.orchestra.run.smithi073.stderr: 46800K .......... .......... .......... .......... .......... 50% 339M 0s 2024-09-12T00:56:18.556 INFO:teuthology.orchestra.run.smithi073.stderr: 46850K .......... .......... .......... .......... .......... 50% 380M 0s 2024-09-12T00:56:18.556 INFO:teuthology.orchestra.run.smithi073.stderr: 46900K .......... .......... .......... .......... .......... 50% 441M 0s 2024-09-12T00:56:18.556 INFO:teuthology.orchestra.run.smithi073.stderr: 46950K .......... .......... .......... .......... .......... 50% 206M 0s 2024-09-12T00:56:18.556 INFO:teuthology.orchestra.run.smithi073.stderr: 47000K .......... .......... .......... .......... .......... 50% 228M 0s 2024-09-12T00:56:18.556 INFO:teuthology.orchestra.run.smithi073.stderr: 47050K .......... .......... .......... .......... .......... 50% 403M 0s 2024-09-12T00:56:18.556 INFO:teuthology.orchestra.run.smithi073.stderr: 47100K .......... .......... .......... .......... .......... 50% 394M 0s 2024-09-12T00:56:18.556 INFO:teuthology.orchestra.run.smithi073.stderr: 47150K .......... .......... .......... .......... .......... 50% 342M 0s 2024-09-12T00:56:18.556 INFO:teuthology.orchestra.run.smithi073.stderr: 47200K .......... .......... .......... .......... .......... 50% 30.8M 0s 2024-09-12T00:56:18.557 INFO:teuthology.orchestra.run.smithi073.stderr: 47250K .......... .......... .......... .......... .......... 50% 390M 0s 2024-09-12T00:56:18.557 INFO:teuthology.orchestra.run.smithi073.stderr: 47300K .......... .......... .......... .......... .......... 50% 398M 0s 2024-09-12T00:56:18.557 INFO:teuthology.orchestra.run.smithi073.stderr: 47350K .......... .......... .......... .......... .......... 51% 366M 0s 2024-09-12T00:56:18.557 INFO:teuthology.orchestra.run.smithi073.stderr: 47400K .......... .......... .......... .......... .......... 51% 442M 0s 2024-09-12T00:56:18.557 INFO:teuthology.orchestra.run.smithi073.stderr: 47450K .......... .......... .......... .......... .......... 51% 397M 0s 2024-09-12T00:56:18.557 INFO:teuthology.orchestra.run.smithi073.stderr: 47500K .......... .......... .......... .......... .......... 51% 407M 0s 2024-09-12T00:56:18.557 INFO:teuthology.orchestra.run.smithi073.stderr: 47550K .......... .......... .......... .......... .......... 51% 94.6M 0s 2024-09-12T00:56:18.557 INFO:teuthology.orchestra.run.smithi073.stderr: 47600K .......... .......... .......... .......... .......... 51% 278M 0s 2024-09-12T00:56:18.557 INFO:teuthology.orchestra.run.smithi073.stderr: 47650K .......... .......... .......... .......... .......... 51% 403M 0s 2024-09-12T00:56:18.557 INFO:teuthology.orchestra.run.smithi073.stderr: 47700K .......... .......... .......... .......... .......... 51% 399M 0s 2024-09-12T00:56:18.557 INFO:teuthology.orchestra.run.smithi073.stderr: 47750K .......... .......... .......... .......... .......... 51% 363M 0s 2024-09-12T00:56:18.558 INFO:teuthology.orchestra.run.smithi073.stderr: 47800K .......... .......... .......... .......... .......... 51% 429M 0s 2024-09-12T00:56:18.558 INFO:teuthology.orchestra.run.smithi073.stderr: 47850K .......... .......... .......... .......... .......... 51% 178M 0s 2024-09-12T00:56:18.558 INFO:teuthology.orchestra.run.smithi073.stderr: 47900K .......... .......... .......... .......... .......... 51% 417M 0s 2024-09-12T00:56:18.558 INFO:teuthology.orchestra.run.smithi073.stderr: 47950K .......... .......... .......... .......... .......... 51% 343M 0s 2024-09-12T00:56:18.558 INFO:teuthology.orchestra.run.smithi073.stderr: 48000K .......... .......... .......... .......... .......... 51% 421M 0s 2024-09-12T00:56:18.558 INFO:teuthology.orchestra.run.smithi073.stderr: 48050K .......... .......... .......... .......... .......... 51% 413M 0s 2024-09-12T00:56:18.558 INFO:teuthology.orchestra.run.smithi073.stderr: 48100K .......... .......... .......... .......... .......... 51% 411M 0s 2024-09-12T00:56:18.558 INFO:teuthology.orchestra.run.smithi073.stderr: 48150K .......... .......... .......... .......... .......... 51% 395M 0s 2024-09-12T00:56:18.558 INFO:teuthology.orchestra.run.smithi073.stderr: 48200K .......... .......... .......... .......... .......... 51% 426M 0s 2024-09-12T00:56:18.558 INFO:teuthology.orchestra.run.smithi073.stderr: 48250K .......... .......... .......... .......... .......... 51% 437M 0s 2024-09-12T00:56:18.558 INFO:teuthology.orchestra.run.smithi073.stderr: 48300K .......... .......... .......... .......... .......... 52% 303M 0s 2024-09-12T00:56:18.558 INFO:teuthology.orchestra.run.smithi073.stderr: 48350K .......... .......... .......... .......... .......... 52% 56.7M 0s 2024-09-12T00:56:18.559 INFO:teuthology.orchestra.run.smithi073.stderr: 48400K .......... .......... .......... .......... .......... 52% 336M 0s 2024-09-12T00:56:18.559 INFO:teuthology.orchestra.run.smithi073.stderr: 48450K .......... .......... .......... .......... .......... 52% 433M 0s 2024-09-12T00:56:18.559 INFO:teuthology.orchestra.run.smithi073.stderr: 48500K .......... .......... .......... .......... .......... 52% 438M 0s 2024-09-12T00:56:18.559 INFO:teuthology.orchestra.run.smithi073.stderr: 48550K .......... .......... .......... .......... .......... 52% 78.1M 0s 2024-09-12T00:56:18.559 INFO:teuthology.orchestra.run.smithi073.stderr: 48600K .......... .......... .......... .......... .......... 52% 69.0M 0s 2024-09-12T00:56:18.559 INFO:teuthology.orchestra.run.smithi073.stderr: 48650K .......... .......... .......... .......... .......... 52% 379M 0s 2024-09-12T00:56:18.559 INFO:teuthology.orchestra.run.smithi073.stderr: 48700K .......... .......... .......... .......... .......... 52% 352M 0s 2024-09-12T00:56:18.559 INFO:teuthology.orchestra.run.smithi073.stderr: 48750K .......... .......... .......... .......... .......... 52% 326M 0s 2024-09-12T00:56:18.559 INFO:teuthology.orchestra.run.smithi073.stderr: 48800K .......... .......... .......... .......... .......... 52% 114M 0s 2024-09-12T00:56:18.559 INFO:teuthology.orchestra.run.smithi073.stderr: 48850K .......... .......... .......... .......... .......... 52% 374M 0s 2024-09-12T00:56:18.559 INFO:teuthology.orchestra.run.smithi073.stderr: 48900K .......... .......... .......... .......... .......... 52% 397M 0s 2024-09-12T00:56:18.560 INFO:teuthology.orchestra.run.smithi073.stderr: 48950K .......... .......... .......... .......... .......... 52% 292M 0s 2024-09-12T00:56:18.560 INFO:teuthology.orchestra.run.smithi073.stderr: 49000K .......... .......... .......... .......... .......... 52% 392M 0s 2024-09-12T00:56:18.560 INFO:teuthology.orchestra.run.smithi073.stderr: 49050K .......... .......... .......... .......... .......... 52% 391M 0s 2024-09-12T00:56:18.560 INFO:teuthology.orchestra.run.smithi073.stderr: 49100K .......... .......... .......... .......... .......... 52% 368M 0s 2024-09-12T00:56:18.560 INFO:teuthology.orchestra.run.smithi073.stderr: 49150K .......... .......... .......... .......... .......... 52% 315M 0s 2024-09-12T00:56:18.560 INFO:teuthology.orchestra.run.smithi073.stderr: 49200K .......... .......... .......... .......... .......... 53% 90.2M 0s 2024-09-12T00:56:18.560 INFO:teuthology.orchestra.run.smithi073.stderr: 49250K .......... .......... .......... .......... .......... 53% 267M 0s 2024-09-12T00:56:18.560 INFO:teuthology.orchestra.run.smithi073.stderr: 49300K .......... .......... .......... .......... .......... 53% 396M 0s 2024-09-12T00:56:18.560 INFO:teuthology.orchestra.run.smithi073.stderr: 49350K .......... .......... .......... .......... .......... 53% 330M 0s 2024-09-12T00:56:18.560 INFO:teuthology.orchestra.run.smithi073.stderr: 49400K .......... .......... .......... .......... .......... 53% 374M 0s 2024-09-12T00:56:18.560 INFO:teuthology.orchestra.run.smithi073.stderr: 49450K .......... .......... .......... .......... .......... 53% 398M 0s 2024-09-12T00:56:18.561 INFO:teuthology.orchestra.run.smithi073.stderr: 49500K .......... .......... .......... .......... .......... 53% 106M 0s 2024-09-12T00:56:18.561 INFO:teuthology.orchestra.run.smithi073.stderr: 49550K .......... .......... .......... .......... .......... 53% 270M 0s 2024-09-12T00:56:18.561 INFO:teuthology.orchestra.run.smithi073.stderr: 49600K .......... .......... .......... .......... .......... 53% 368M 0s 2024-09-12T00:56:18.561 INFO:teuthology.orchestra.run.smithi073.stderr: 49650K .......... .......... .......... .......... .......... 53% 375M 0s 2024-09-12T00:56:18.561 INFO:teuthology.orchestra.run.smithi073.stderr: 49700K .......... .......... .......... .......... .......... 53% 379M 0s 2024-09-12T00:56:18.561 INFO:teuthology.orchestra.run.smithi073.stderr: 49750K .......... .......... .......... .......... .......... 53% 333M 0s 2024-09-12T00:56:18.561 INFO:teuthology.orchestra.run.smithi073.stderr: 49800K .......... .......... .......... .......... .......... 53% 369M 0s 2024-09-12T00:56:18.561 INFO:teuthology.orchestra.run.smithi073.stderr: 49850K .......... .......... .......... .......... .......... 53% 396M 0s 2024-09-12T00:56:18.561 INFO:teuthology.orchestra.run.smithi073.stderr: 49900K .......... .......... .......... .......... .......... 53% 380M 0s 2024-09-12T00:56:18.561 INFO:teuthology.orchestra.run.smithi073.stderr: 49950K .......... .......... .......... .......... .......... 53% 320M 0s 2024-09-12T00:56:18.561 INFO:teuthology.orchestra.run.smithi073.stderr: 50000K .......... .......... .......... .......... .......... 53% 358M 0s 2024-09-12T00:56:18.562 INFO:teuthology.orchestra.run.smithi073.stderr: 50050K .......... .......... .......... .......... .......... 53% 390M 0s 2024-09-12T00:56:18.562 INFO:teuthology.orchestra.run.smithi073.stderr: 50100K .......... .......... .......... .......... .......... 53% 341M 0s 2024-09-12T00:56:18.562 INFO:teuthology.orchestra.run.smithi073.stderr: 50150K .......... .......... .......... .......... .......... 54% 375M 0s 2024-09-12T00:56:18.562 INFO:teuthology.orchestra.run.smithi073.stderr: 50200K .......... .......... .......... .......... .......... 54% 80.8M 0s 2024-09-12T00:56:18.562 INFO:teuthology.orchestra.run.smithi073.stderr: 50250K .......... .......... .......... .......... .......... 54% 124M 0s 2024-09-12T00:56:18.562 INFO:teuthology.orchestra.run.smithi073.stderr: 50300K .......... .......... .......... .......... .......... 54% 98.0M 0s 2024-09-12T00:56:18.562 INFO:teuthology.orchestra.run.smithi073.stderr: 50350K .......... .......... .......... .......... .......... 54% 311M 0s 2024-09-12T00:56:18.562 INFO:teuthology.orchestra.run.smithi073.stderr: 50400K .......... .......... .......... .......... .......... 54% 375M 0s 2024-09-12T00:56:18.562 INFO:teuthology.orchestra.run.smithi073.stderr: 50450K .......... .......... .......... .......... .......... 54% 380M 0s 2024-09-12T00:56:18.562 INFO:teuthology.orchestra.run.smithi073.stderr: 50500K .......... .......... .......... .......... .......... 54% 377M 0s 2024-09-12T00:56:18.562 INFO:teuthology.orchestra.run.smithi073.stderr: 50550K .......... .......... .......... .......... .......... 54% 173M 0s 2024-09-12T00:56:18.563 INFO:teuthology.orchestra.run.smithi073.stderr: 50600K .......... .......... .......... .......... .......... 54% 389M 0s 2024-09-12T00:56:18.563 INFO:teuthology.orchestra.run.smithi073.stderr: 50650K .......... .......... .......... .......... .......... 54% 370M 0s 2024-09-12T00:56:18.563 INFO:teuthology.orchestra.run.smithi073.stderr: 50700K .......... .......... .......... .......... .......... 54% 119M 0s 2024-09-12T00:56:18.563 INFO:teuthology.orchestra.run.smithi073.stderr: 50750K .......... .......... .......... .......... .......... 54% 172M 0s 2024-09-12T00:56:18.563 INFO:teuthology.orchestra.run.smithi073.stderr: 50800K .......... .......... .......... .......... .......... 54% 388M 0s 2024-09-12T00:56:18.563 INFO:teuthology.orchestra.run.smithi073.stderr: 50850K .......... .......... .......... .......... .......... 54% 365M 0s 2024-09-12T00:56:18.563 INFO:teuthology.orchestra.run.smithi073.stderr: 50900K .......... .......... .......... .......... .......... 54% 381M 0s 2024-09-12T00:56:18.563 INFO:teuthology.orchestra.run.smithi073.stderr: 50950K .......... .......... .......... .......... .......... 54% 358M 0s 2024-09-12T00:56:18.563 INFO:teuthology.orchestra.run.smithi073.stderr: 51000K .......... .......... .......... .......... .......... 54% 382M 0s 2024-09-12T00:56:18.563 INFO:teuthology.orchestra.run.smithi073.stderr: 51050K .......... .......... .......... .......... .......... 55% 397M 0s 2024-09-12T00:56:18.563 INFO:teuthology.orchestra.run.smithi073.stderr: 51100K .......... .......... .......... .......... .......... 55% 398M 0s 2024-09-12T00:56:18.564 INFO:teuthology.orchestra.run.smithi073.stderr: 51150K .......... .......... .......... .......... .......... 55% 345M 0s 2024-09-12T00:56:18.564 INFO:teuthology.orchestra.run.smithi073.stderr: 51200K .......... .......... .......... .......... .......... 55% 372M 0s 2024-09-12T00:56:18.564 INFO:teuthology.orchestra.run.smithi073.stderr: 51250K .......... .......... .......... .......... .......... 55% 376M 0s 2024-09-12T00:56:18.564 INFO:teuthology.orchestra.run.smithi073.stderr: 51300K .......... .......... .......... .......... .......... 55% 364M 0s 2024-09-12T00:56:18.564 INFO:teuthology.orchestra.run.smithi073.stderr: 51350K .......... .......... .......... .......... .......... 55% 366M 0s 2024-09-12T00:56:18.564 INFO:teuthology.orchestra.run.smithi073.stderr: 51400K .......... .......... .......... .......... .......... 55% 92.3M 0s 2024-09-12T00:56:18.564 INFO:teuthology.orchestra.run.smithi073.stderr: 51450K .......... .......... .......... .......... .......... 55% 369M 0s 2024-09-12T00:56:18.564 INFO:teuthology.orchestra.run.smithi073.stderr: 51500K .......... .......... .......... .......... .......... 55% 76.7M 0s 2024-09-12T00:56:18.564 INFO:teuthology.orchestra.run.smithi073.stderr: 51550K .......... .......... .......... .......... .......... 55% 393M 0s 2024-09-12T00:56:18.564 INFO:teuthology.orchestra.run.smithi073.stderr: 51600K .......... .......... .......... .......... .......... 55% 383M 0s 2024-09-12T00:56:18.564 INFO:teuthology.orchestra.run.smithi073.stderr: 51650K .......... .......... .......... .......... .......... 55% 66.2M 0s 2024-09-12T00:56:18.565 INFO:teuthology.orchestra.run.smithi073.stderr: 51700K .......... .......... .......... .......... .......... 55% 294M 0s 2024-09-12T00:56:18.565 INFO:teuthology.orchestra.run.smithi073.stderr: 51750K .......... .......... .......... .......... .......... 55% 394M 0s 2024-09-12T00:56:18.565 INFO:teuthology.orchestra.run.smithi073.stderr: 51800K .......... .......... .......... .......... .......... 55% 120M 0s 2024-09-12T00:56:18.565 INFO:teuthology.orchestra.run.smithi073.stderr: 51850K .......... .......... .......... .......... .......... 55% 378M 0s 2024-09-12T00:56:18.565 INFO:teuthology.orchestra.run.smithi073.stderr: 51900K .......... .......... .......... .......... .......... 55% 292M 0s 2024-09-12T00:56:18.565 INFO:teuthology.orchestra.run.smithi073.stderr: 51950K .......... .......... .......... .......... .......... 55% 386M 0s 2024-09-12T00:56:18.565 INFO:teuthology.orchestra.run.smithi073.stderr: 52000K .......... .......... .......... .......... .......... 56% 425M 0s 2024-09-12T00:56:18.565 INFO:teuthology.orchestra.run.smithi073.stderr: 52050K .......... .......... .......... .......... .......... 56% 144M 0s 2024-09-12T00:56:18.565 INFO:teuthology.orchestra.run.smithi073.stderr: 52100K .......... .......... .......... .......... .......... 56% 365M 0s 2024-09-12T00:56:18.565 INFO:teuthology.orchestra.run.smithi073.stderr: 52150K .......... .......... .......... .......... .......... 56% 411M 0s 2024-09-12T00:56:18.565 INFO:teuthology.orchestra.run.smithi073.stderr: 52200K .......... .......... .......... .......... .......... 56% 405M 0s 2024-09-12T00:56:18.565 INFO:teuthology.orchestra.run.smithi073.stderr: 52250K .......... .......... .......... .......... .......... 56% 432M 0s 2024-09-12T00:56:18.566 INFO:teuthology.orchestra.run.smithi073.stderr: 52300K .......... .......... .......... .......... .......... 56% 181M 0s 2024-09-12T00:56:18.566 INFO:teuthology.orchestra.run.smithi073.stderr: 52350K .......... .......... .......... .......... .......... 56% 198M 0s 2024-09-12T00:56:18.566 INFO:teuthology.orchestra.run.smithi073.stderr: 52400K .......... .......... .......... .......... .......... 56% 421M 0s 2024-09-12T00:56:18.566 INFO:teuthology.orchestra.run.smithi073.stderr: 52450K .......... .......... .......... .......... .......... 56% 66.0M 0s 2024-09-12T00:56:18.566 INFO:teuthology.orchestra.run.smithi073.stderr: 52500K .......... .......... .......... .......... .......... 56% 372M 0s 2024-09-12T00:56:18.566 INFO:teuthology.orchestra.run.smithi073.stderr: 52550K .......... .......... .......... .......... .......... 56% 402M 0s 2024-09-12T00:56:18.566 INFO:teuthology.orchestra.run.smithi073.stderr: 52600K .......... .......... .......... .......... .......... 56% 385M 0s 2024-09-12T00:56:18.566 INFO:teuthology.orchestra.run.smithi073.stderr: 52650K .......... .......... .......... .......... .......... 56% 426M 0s 2024-09-12T00:56:18.566 INFO:teuthology.orchestra.run.smithi073.stderr: 52700K .......... .......... .......... .......... .......... 56% 335M 0s 2024-09-12T00:56:18.566 INFO:teuthology.orchestra.run.smithi073.stderr: 52750K .......... .......... .......... .......... .......... 56% 354M 0s 2024-09-12T00:56:18.566 INFO:teuthology.orchestra.run.smithi073.stderr: 52800K .......... .......... .......... .......... .......... 56% 418M 0s 2024-09-12T00:56:18.567 INFO:teuthology.orchestra.run.smithi073.stderr: 52850K .......... .......... .......... .......... .......... 56% 138M 0s 2024-09-12T00:56:18.567 INFO:teuthology.orchestra.run.smithi073.stderr: 52900K .......... .......... .......... .......... .......... 56% 372M 0s 2024-09-12T00:56:18.567 INFO:teuthology.orchestra.run.smithi073.stderr: 52950K .......... .......... .......... .......... .......... 57% 439M 0s 2024-09-12T00:56:18.567 INFO:teuthology.orchestra.run.smithi073.stderr: 53000K .......... .......... .......... .......... .......... 57% 383M 0s 2024-09-12T00:56:18.567 INFO:teuthology.orchestra.run.smithi073.stderr: 53050K .......... .......... .......... .......... .......... 57% 429M 0s 2024-09-12T00:56:18.567 INFO:teuthology.orchestra.run.smithi073.stderr: 53100K .......... .......... .......... .......... .......... 57% 361M 0s 2024-09-12T00:56:18.567 INFO:teuthology.orchestra.run.smithi073.stderr: 53150K .......... .......... .......... .......... .......... 57% 229M 0s 2024-09-12T00:56:18.567 INFO:teuthology.orchestra.run.smithi073.stderr: 53200K .......... .......... .......... .......... .......... 57% 425M 0s 2024-09-12T00:56:18.567 INFO:teuthology.orchestra.run.smithi073.stderr: 53250K .......... .......... .......... .......... .......... 57% 229M 0s 2024-09-12T00:56:18.567 INFO:teuthology.orchestra.run.smithi073.stderr: 53300K .......... .......... .......... .......... .......... 57% 166M 0s 2024-09-12T00:56:18.567 INFO:teuthology.orchestra.run.smithi073.stderr: 53350K .......... .......... .......... .......... .......... 57% 54.2M 0s 2024-09-12T00:56:18.567 INFO:teuthology.orchestra.run.smithi073.stderr: 53400K .......... .......... .......... .......... .......... 57% 303M 0s 2024-09-12T00:56:18.568 INFO:teuthology.orchestra.run.smithi073.stderr: 53450K .......... .......... .......... .......... .......... 57% 403M 0s 2024-09-12T00:56:18.568 INFO:teuthology.orchestra.run.smithi073.stderr: 53500K .......... .......... .......... .......... .......... 57% 330M 0s 2024-09-12T00:56:18.568 INFO:teuthology.orchestra.run.smithi073.stderr: 53550K .......... .......... .......... .......... .......... 57% 418M 0s 2024-09-12T00:56:18.568 INFO:teuthology.orchestra.run.smithi073.stderr: 53600K .......... .......... .......... .......... .......... 57% 425M 0s 2024-09-12T00:56:18.568 INFO:teuthology.orchestra.run.smithi073.stderr: 53650K .......... .......... .......... .......... .......... 57% 454M 0s 2024-09-12T00:56:18.568 INFO:teuthology.orchestra.run.smithi073.stderr: 53700K .......... .......... .......... .......... .......... 57% 96.4M 0s 2024-09-12T00:56:18.568 INFO:teuthology.orchestra.run.smithi073.stderr: 53750K .......... .......... .......... .......... .......... 57% 374M 0s 2024-09-12T00:56:18.568 INFO:teuthology.orchestra.run.smithi073.stderr: 53800K .......... .......... .......... .......... .......... 57% 408M 0s 2024-09-12T00:56:18.568 INFO:teuthology.orchestra.run.smithi073.stderr: 53850K .......... .......... .......... .......... .......... 58% 428M 0s 2024-09-12T00:56:18.568 INFO:teuthology.orchestra.run.smithi073.stderr: 53900K .......... .......... .......... .......... .......... 58% 146M 0s 2024-09-12T00:56:18.568 INFO:teuthology.orchestra.run.smithi073.stderr: 53950K .......... .......... .......... .......... .......... 58% 415M 0s 2024-09-12T00:56:18.569 INFO:teuthology.orchestra.run.smithi073.stderr: 54000K .......... .......... .......... .......... .......... 58% 395M 0s 2024-09-12T00:56:18.569 INFO:teuthology.orchestra.run.smithi073.stderr: 54050K .......... .......... .......... .......... .......... 58% 320M 0s 2024-09-12T00:56:18.569 INFO:teuthology.orchestra.run.smithi073.stderr: 54100K .......... .......... .......... .......... .......... 58% 351M 0s 2024-09-12T00:56:18.569 INFO:teuthology.orchestra.run.smithi073.stderr: 54150K .......... .......... .......... .......... .......... 58% 395M 0s 2024-09-12T00:56:18.569 INFO:teuthology.orchestra.run.smithi073.stderr: 54200K .......... .......... .......... .......... .......... 58% 412M 0s 2024-09-12T00:56:18.569 INFO:teuthology.orchestra.run.smithi073.stderr: 54250K .......... .......... .......... .......... .......... 58% 393M 0s 2024-09-12T00:56:18.569 INFO:teuthology.orchestra.run.smithi073.stderr: 54300K .......... .......... .......... .......... .......... 58% 339M 0s 2024-09-12T00:56:18.569 INFO:teuthology.orchestra.run.smithi073.stderr: 54350K .......... .......... .......... .......... .......... 58% 412M 0s 2024-09-12T00:56:18.569 INFO:teuthology.orchestra.run.smithi073.stderr: 54400K .......... .......... .......... .......... .......... 58% 110M 0s 2024-09-12T00:56:18.569 INFO:teuthology.orchestra.run.smithi073.stderr: 54450K .......... .......... .......... .......... .......... 58% 280M 0s 2024-09-12T00:56:18.569 INFO:teuthology.orchestra.run.smithi073.stderr: 54500K .......... .......... .......... .......... .......... 58% 376M 0s 2024-09-12T00:56:18.570 INFO:teuthology.orchestra.run.smithi073.stderr: 54550K .......... .......... .......... .......... .......... 58% 409M 0s 2024-09-12T00:56:18.570 INFO:teuthology.orchestra.run.smithi073.stderr: 54600K .......... .......... .......... .......... .......... 58% 191M 0s 2024-09-12T00:56:18.570 INFO:teuthology.orchestra.run.smithi073.stderr: 54650K .......... .......... .......... .......... .......... 58% 48.9M 0s 2024-09-12T00:56:18.570 INFO:teuthology.orchestra.run.smithi073.stderr: 54700K .......... .......... .......... .......... .......... 58% 268M 0s 2024-09-12T00:56:18.570 INFO:teuthology.orchestra.run.smithi073.stderr: 54750K .......... .......... .......... .......... .......... 58% 124M 0s 2024-09-12T00:56:18.570 INFO:teuthology.orchestra.run.smithi073.stderr: 54800K .......... .......... .......... .......... .......... 59% 390M 0s 2024-09-12T00:56:18.570 INFO:teuthology.orchestra.run.smithi073.stderr: 54850K .......... .......... .......... .......... .......... 59% 388M 0s 2024-09-12T00:56:18.570 INFO:teuthology.orchestra.run.smithi073.stderr: 54900K .......... .......... .......... .......... .......... 59% 247M 0s 2024-09-12T00:56:18.570 INFO:teuthology.orchestra.run.smithi073.stderr: 54950K .......... .......... .......... .......... .......... 59% 218M 0s 2024-09-12T00:56:18.570 INFO:teuthology.orchestra.run.smithi073.stderr: 55000K .......... .......... .......... .......... .......... 59% 415M 0s 2024-09-12T00:56:18.570 INFO:teuthology.orchestra.run.smithi073.stderr: 55050K .......... .......... .......... .......... .......... 59% 379M 0s 2024-09-12T00:56:18.570 INFO:teuthology.orchestra.run.smithi073.stderr: 55100K .......... .......... .......... .......... .......... 59% 225M 0s 2024-09-12T00:56:18.571 INFO:teuthology.orchestra.run.smithi073.stderr: 55150K .......... .......... .......... .......... .......... 59% 186M 0s 2024-09-12T00:56:18.571 INFO:teuthology.orchestra.run.smithi073.stderr: 55200K .......... .......... .......... .......... .......... 59% 379M 0s 2024-09-12T00:56:18.571 INFO:teuthology.orchestra.run.smithi073.stderr: 55250K .......... .......... .......... .......... .......... 59% 282M 0s 2024-09-12T00:56:18.571 INFO:teuthology.orchestra.run.smithi073.stderr: 55300K .......... .......... .......... .......... .......... 59% 267M 0s 2024-09-12T00:56:18.571 INFO:teuthology.orchestra.run.smithi073.stderr: 55350K .......... .......... .......... .......... .......... 59% 291M 0s 2024-09-12T00:56:18.571 INFO:teuthology.orchestra.run.smithi073.stderr: 55400K .......... .......... .......... .......... .......... 59% 406M 0s 2024-09-12T00:56:18.571 INFO:teuthology.orchestra.run.smithi073.stderr: 55450K .......... .......... .......... .......... .......... 59% 83.2M 0s 2024-09-12T00:56:18.571 INFO:teuthology.orchestra.run.smithi073.stderr: 55500K .......... .......... .......... .......... .......... 59% 226M 0s 2024-09-12T00:56:18.571 INFO:teuthology.orchestra.run.smithi073.stderr: 55550K .......... .......... .......... .......... .......... 59% 460M 0s 2024-09-12T00:56:18.571 INFO:teuthology.orchestra.run.smithi073.stderr: 55600K .......... .......... .......... .......... .......... 59% 369M 0s 2024-09-12T00:56:18.571 INFO:teuthology.orchestra.run.smithi073.stderr: 55650K .......... .......... .......... .......... .......... 59% 413M 0s 2024-09-12T00:56:18.572 INFO:teuthology.orchestra.run.smithi073.stderr: 55700K .......... .......... .......... .......... .......... 60% 96.7M 0s 2024-09-12T00:56:18.572 INFO:teuthology.orchestra.run.smithi073.stderr: 55750K .......... .......... .......... .......... .......... 60% 366M 0s 2024-09-12T00:56:18.572 INFO:teuthology.orchestra.run.smithi073.stderr: 55800K .......... .......... .......... .......... .......... 60% 396M 0s 2024-09-12T00:56:18.572 INFO:teuthology.orchestra.run.smithi073.stderr: 55850K .......... .......... .......... .......... .......... 60% 414M 0s 2024-09-12T00:56:18.572 INFO:teuthology.orchestra.run.smithi073.stderr: 55900K .......... .......... .......... .......... .......... 60% 343M 0s 2024-09-12T00:56:18.572 INFO:teuthology.orchestra.run.smithi073.stderr: 55950K .......... .......... .......... .......... .......... 60% 369M 0s 2024-09-12T00:56:18.572 INFO:teuthology.orchestra.run.smithi073.stderr: 56000K .......... .......... .......... .......... .......... 60% 417M 0s 2024-09-12T00:56:18.572 INFO:teuthology.orchestra.run.smithi073.stderr: 56050K .......... .......... .......... .......... .......... 60% 348M 0s 2024-09-12T00:56:18.572 INFO:teuthology.orchestra.run.smithi073.stderr: 56100K .......... .......... .......... .......... .......... 60% 365M 0s 2024-09-12T00:56:18.572 INFO:teuthology.orchestra.run.smithi073.stderr: 56150K .......... .......... .......... .......... .......... 60% 390M 0s 2024-09-12T00:56:18.572 INFO:teuthology.orchestra.run.smithi073.stderr: 56200K .......... .......... .......... .......... .......... 60% 413M 0s 2024-09-12T00:56:18.572 INFO:teuthology.orchestra.run.smithi073.stderr: 56250K .......... .......... .......... .......... .......... 60% 418M 0s 2024-09-12T00:56:18.573 INFO:teuthology.orchestra.run.smithi073.stderr: 56300K .......... .......... .......... .......... .......... 60% 166M 0s 2024-09-12T00:56:18.573 INFO:teuthology.orchestra.run.smithi073.stderr: 56350K .......... .......... .......... .......... .......... 60% 379M 0s 2024-09-12T00:56:18.573 INFO:teuthology.orchestra.run.smithi073.stderr: 56400K .......... .......... .......... .......... .......... 60% 56.8M 0s 2024-09-12T00:56:18.573 INFO:teuthology.orchestra.run.smithi073.stderr: 56450K .......... .......... .......... .......... .......... 60% 418M 0s 2024-09-12T00:56:18.573 INFO:teuthology.orchestra.run.smithi073.stderr: 56500K .......... .......... .......... .......... .......... 60% 236M 0s 2024-09-12T00:56:18.573 INFO:teuthology.orchestra.run.smithi073.stderr: 56550K .......... .......... .......... .......... .......... 60% 414M 0s 2024-09-12T00:56:18.573 INFO:teuthology.orchestra.run.smithi073.stderr: 56600K .......... .......... .......... .......... .......... 60% 420M 0s 2024-09-12T00:56:18.573 INFO:teuthology.orchestra.run.smithi073.stderr: 56650K .......... .......... .......... .......... .......... 61% 415M 0s 2024-09-12T00:56:18.573 INFO:teuthology.orchestra.run.smithi073.stderr: 56700K .......... .......... .......... .......... .......... 61% 360M 0s 2024-09-12T00:56:18.573 INFO:teuthology.orchestra.run.smithi073.stderr: 56750K .......... .......... .......... .......... .......... 61% 150M 0s 2024-09-12T00:56:18.573 INFO:teuthology.orchestra.run.smithi073.stderr: 56800K .......... .......... .......... .......... .......... 61% 301M 0s 2024-09-12T00:56:18.574 INFO:teuthology.orchestra.run.smithi073.stderr: 56850K .......... .......... .......... .......... .......... 61% 150M 0s 2024-09-12T00:56:18.574 INFO:teuthology.orchestra.run.smithi073.stderr: 56900K .......... .......... .......... .......... .......... 61% 376M 0s 2024-09-12T00:56:18.574 INFO:teuthology.orchestra.run.smithi073.stderr: 56950K .......... .......... .......... .......... .......... 61% 321M 0s 2024-09-12T00:56:18.574 INFO:teuthology.orchestra.run.smithi073.stderr: 57000K .......... .......... .......... .......... .......... 61% 219M 0s 2024-09-12T00:56:18.574 INFO:teuthology.orchestra.run.smithi073.stderr: 57050K .......... .......... .......... .......... .......... 61% 417M 0s 2024-09-12T00:56:18.574 INFO:teuthology.orchestra.run.smithi073.stderr: 57100K .......... .......... .......... .......... .......... 61% 326M 0s 2024-09-12T00:56:18.574 INFO:teuthology.orchestra.run.smithi073.stderr: 57150K .......... .......... .......... .......... .......... 61% 416M 0s 2024-09-12T00:56:18.574 INFO:teuthology.orchestra.run.smithi073.stderr: 57200K .......... .......... .......... .......... .......... 61% 418M 0s 2024-09-12T00:56:18.574 INFO:teuthology.orchestra.run.smithi073.stderr: 57250K .......... .......... .......... .......... .......... 61% 424M 0s 2024-09-12T00:56:18.574 INFO:teuthology.orchestra.run.smithi073.stderr: 57300K .......... .......... .......... .......... .......... 61% 234M 0s 2024-09-12T00:56:18.574 INFO:teuthology.orchestra.run.smithi073.stderr: 57350K .......... .......... .......... .......... .......... 61% 438M 0s 2024-09-12T00:56:18.575 INFO:teuthology.orchestra.run.smithi073.stderr: 57400K .......... .......... .......... .......... .......... 61% 68.9M 0s 2024-09-12T00:56:18.575 INFO:teuthology.orchestra.run.smithi073.stderr: 57450K .......... .......... .......... .......... .......... 61% 374M 0s 2024-09-12T00:56:18.575 INFO:teuthology.orchestra.run.smithi073.stderr: 57500K .......... .......... .......... .......... .......... 61% 320M 0s 2024-09-12T00:56:18.575 INFO:teuthology.orchestra.run.smithi073.stderr: 57550K .......... .......... .......... .......... .......... 62% 435M 0s 2024-09-12T00:56:18.575 INFO:teuthology.orchestra.run.smithi073.stderr: 57600K .......... .......... .......... .......... .......... 62% 403M 0s 2024-09-12T00:56:18.575 INFO:teuthology.orchestra.run.smithi073.stderr: 57650K .......... .......... .......... .......... .......... 62% 421M 0s 2024-09-12T00:56:18.575 INFO:teuthology.orchestra.run.smithi073.stderr: 57700K .......... .......... .......... .......... .......... 62% 60.8M 0s 2024-09-12T00:56:18.575 INFO:teuthology.orchestra.run.smithi073.stderr: 57750K .......... .......... .......... .......... .......... 62% 178M 0s 2024-09-12T00:56:18.575 INFO:teuthology.orchestra.run.smithi073.stderr: 57800K .......... .......... .......... .......... .......... 62% 142M 0s 2024-09-12T00:56:18.575 INFO:teuthology.orchestra.run.smithi073.stderr: 57850K .......... .......... .......... .......... .......... 62% 293M 0s 2024-09-12T00:56:18.575 INFO:teuthology.orchestra.run.smithi073.stderr: 57900K .......... .......... .......... .......... .......... 62% 332M 0s 2024-09-12T00:56:18.575 INFO:teuthology.orchestra.run.smithi073.stderr: 57950K .......... .......... .......... .......... .......... 62% 295M 0s 2024-09-12T00:56:18.576 INFO:teuthology.orchestra.run.smithi073.stderr: 58000K .......... .......... .......... .......... .......... 62% 406M 0s 2024-09-12T00:56:18.576 INFO:teuthology.orchestra.run.smithi073.stderr: 58050K .......... .......... .......... .......... .......... 62% 202M 0s 2024-09-12T00:56:18.576 INFO:teuthology.orchestra.run.smithi073.stderr: 58100K .......... .......... .......... .......... .......... 62% 293M 0s 2024-09-12T00:56:18.576 INFO:teuthology.orchestra.run.smithi073.stderr: 58150K .......... .......... .......... .......... .......... 62% 392M 0s 2024-09-12T00:56:18.576 INFO:teuthology.orchestra.run.smithi073.stderr: 58200K .......... .......... .......... .......... .......... 62% 331M 0s 2024-09-12T00:56:18.576 INFO:teuthology.orchestra.run.smithi073.stderr: 58250K .......... .......... .......... .......... .......... 62% 110M 0s 2024-09-12T00:56:18.576 INFO:teuthology.orchestra.run.smithi073.stderr: 58300K .......... .......... .......... .......... .......... 62% 304M 0s 2024-09-12T00:56:18.576 INFO:teuthology.orchestra.run.smithi073.stderr: 58350K .......... .......... .......... .......... .......... 62% 428M 0s 2024-09-12T00:56:18.576 INFO:teuthology.orchestra.run.smithi073.stderr: 58400K .......... .......... .......... .......... .......... 62% 172M 0s 2024-09-12T00:56:18.576 INFO:teuthology.orchestra.run.smithi073.stderr: 58450K .......... .......... .......... .......... .......... 62% 312M 0s 2024-09-12T00:56:18.576 INFO:teuthology.orchestra.run.smithi073.stderr: 58500K .......... .......... .......... .......... .......... 63% 138M 0s 2024-09-12T00:56:18.577 INFO:teuthology.orchestra.run.smithi073.stderr: 58550K .......... .......... .......... .......... .......... 63% 409M 0s 2024-09-12T00:56:18.577 INFO:teuthology.orchestra.run.smithi073.stderr: 58600K .......... .......... .......... .......... .......... 63% 418M 0s 2024-09-12T00:56:18.577 INFO:teuthology.orchestra.run.smithi073.stderr: 58650K .......... .......... .......... .......... .......... 63% 397M 0s 2024-09-12T00:56:18.577 INFO:teuthology.orchestra.run.smithi073.stderr: 58700K .......... .......... .......... .......... .......... 63% 272M 0s 2024-09-12T00:56:18.577 INFO:teuthology.orchestra.run.smithi073.stderr: 58750K .......... .......... .......... .......... .......... 63% 106M 0s 2024-09-12T00:56:18.577 INFO:teuthology.orchestra.run.smithi073.stderr: 58800K .......... .......... .......... .......... .......... 63% 412M 0s 2024-09-12T00:56:18.577 INFO:teuthology.orchestra.run.smithi073.stderr: 58850K .......... .......... .......... .......... .......... 63% 173M 0s 2024-09-12T00:56:18.577 INFO:teuthology.orchestra.run.smithi073.stderr: 58900K .......... .......... .......... .......... .......... 63% 370M 0s 2024-09-12T00:56:18.577 INFO:teuthology.orchestra.run.smithi073.stderr: 58950K .......... .......... .......... .......... .......... 63% 391M 0s 2024-09-12T00:56:18.577 INFO:teuthology.orchestra.run.smithi073.stderr: 59000K .......... .......... .......... .......... .......... 63% 405M 0s 2024-09-12T00:56:18.577 INFO:teuthology.orchestra.run.smithi073.stderr: 59050K .......... .......... .......... .......... .......... 63% 436M 0s 2024-09-12T00:56:18.577 INFO:teuthology.orchestra.run.smithi073.stderr: 59100K .......... .......... .......... .......... .......... 63% 192M 0s 2024-09-12T00:56:18.578 INFO:teuthology.orchestra.run.smithi073.stderr: 59150K .......... .......... .......... .......... .......... 63% 362M 0s 2024-09-12T00:56:18.578 INFO:teuthology.orchestra.run.smithi073.stderr: 59200K .......... .......... .......... .......... .......... 63% 374M 0s 2024-09-12T00:56:18.578 INFO:teuthology.orchestra.run.smithi073.stderr: 59250K .......... .......... .......... .......... .......... 63% 386M 0s 2024-09-12T00:56:18.578 INFO:teuthology.orchestra.run.smithi073.stderr: 59300K .......... .......... .......... .......... .......... 63% 371M 0s 2024-09-12T00:56:18.578 INFO:teuthology.orchestra.run.smithi073.stderr: 59350K .......... .......... .......... .......... .......... 63% 305M 0s 2024-09-12T00:56:18.578 INFO:teuthology.orchestra.run.smithi073.stderr: 59400K .......... .......... .......... .......... .......... 63% 339M 0s 2024-09-12T00:56:18.578 INFO:teuthology.orchestra.run.smithi073.stderr: 59450K .......... .......... .......... .......... .......... 64% 448M 0s 2024-09-12T00:56:18.578 INFO:teuthology.orchestra.run.smithi073.stderr: 59500K .......... .......... .......... .......... .......... 64% 82.8M 0s 2024-09-12T00:56:18.578 INFO:teuthology.orchestra.run.smithi073.stderr: 59550K .......... .......... .......... .......... .......... 64% 162M 0s 2024-09-12T00:56:18.578 INFO:teuthology.orchestra.run.smithi073.stderr: 59600K .......... .......... .......... .......... .......... 64% 415M 0s 2024-09-12T00:56:18.578 INFO:teuthology.orchestra.run.smithi073.stderr: 59650K .......... .......... .......... .......... .......... 64% 403M 0s 2024-09-12T00:56:18.578 INFO:teuthology.orchestra.run.smithi073.stderr: 59700K .......... .......... .......... .......... .......... 64% 377M 0s 2024-09-12T00:56:18.579 INFO:teuthology.orchestra.run.smithi073.stderr: 59750K .......... .......... .......... .......... .......... 64% 104M 0s 2024-09-12T00:56:18.579 INFO:teuthology.orchestra.run.smithi073.stderr: 59800K .......... .......... .......... .......... .......... 64% 354M 0s 2024-09-12T00:56:18.579 INFO:teuthology.orchestra.run.smithi073.stderr: 59850K .......... .......... .......... .......... .......... 64% 429M 0s 2024-09-12T00:56:18.579 INFO:teuthology.orchestra.run.smithi073.stderr: 59900K .......... .......... .......... .......... .......... 64% 302M 0s 2024-09-12T00:56:18.579 INFO:teuthology.orchestra.run.smithi073.stderr: 59950K .......... .......... .......... .......... .......... 64% 299M 0s 2024-09-12T00:56:18.579 INFO:teuthology.orchestra.run.smithi073.stderr: 60000K .......... .......... .......... .......... .......... 64% 296M 0s 2024-09-12T00:56:18.579 INFO:teuthology.orchestra.run.smithi073.stderr: 60050K .......... .......... .......... .......... .......... 64% 250M 0s 2024-09-12T00:56:18.579 INFO:teuthology.orchestra.run.smithi073.stderr: 60100K .......... .......... .......... .......... .......... 64% 270M 0s 2024-09-12T00:56:18.579 INFO:teuthology.orchestra.run.smithi073.stderr: 60150K .......... .......... .......... .......... .......... 64% 419M 0s 2024-09-12T00:56:18.579 INFO:teuthology.orchestra.run.smithi073.stderr: 60200K .......... .......... .......... .......... .......... 64% 373M 0s 2024-09-12T00:56:18.579 INFO:teuthology.orchestra.run.smithi073.stderr: 60250K .......... .......... .......... .......... .......... 64% 198M 0s 2024-09-12T00:56:18.580 INFO:teuthology.orchestra.run.smithi073.stderr: 60300K .......... .......... .......... .......... .......... 64% 309M 0s 2024-09-12T00:56:18.580 INFO:teuthology.orchestra.run.smithi073.stderr: 60350K .......... .......... .......... .......... .......... 65% 82.6M 0s 2024-09-12T00:56:18.580 INFO:teuthology.orchestra.run.smithi073.stderr: 60400K .......... .......... .......... .......... .......... 65% 401M 0s 2024-09-12T00:56:18.580 INFO:teuthology.orchestra.run.smithi073.stderr: 60450K .......... .......... .......... .......... .......... 65% 412M 0s 2024-09-12T00:56:18.580 INFO:teuthology.orchestra.run.smithi073.stderr: 60500K .......... .......... .......... .......... .......... 65% 148M 0s 2024-09-12T00:56:18.580 INFO:teuthology.orchestra.run.smithi073.stderr: 60550K .......... .......... .......... .......... .......... 65% 416M 0s 2024-09-12T00:56:18.580 INFO:teuthology.orchestra.run.smithi073.stderr: 60600K .......... .......... .......... .......... .......... 65% 48.5M 0s 2024-09-12T00:56:18.580 INFO:teuthology.orchestra.run.smithi073.stderr: 60650K .......... .......... .......... .......... .......... 65% 367M 0s 2024-09-12T00:56:18.580 INFO:teuthology.orchestra.run.smithi073.stderr: 60700K .......... .......... .......... .......... .......... 65% 328M 0s 2024-09-12T00:56:18.580 INFO:teuthology.orchestra.run.smithi073.stderr: 60750K .......... .......... .......... .......... .......... 65% 398M 0s 2024-09-12T00:56:18.580 INFO:teuthology.orchestra.run.smithi073.stderr: 60800K .......... .......... .......... .......... .......... 65% 403M 0s 2024-09-12T00:56:18.581 INFO:teuthology.orchestra.run.smithi073.stderr: 60850K .......... .......... .......... .......... .......... 65% 146M 0s 2024-09-12T00:56:18.581 INFO:teuthology.orchestra.run.smithi073.stderr: 60900K .......... .......... .......... .......... .......... 65% 362M 0s 2024-09-12T00:56:18.581 INFO:teuthology.orchestra.run.smithi073.stderr: 60950K .......... .......... .......... .......... .......... 65% 221M 0s 2024-09-12T00:56:18.581 INFO:teuthology.orchestra.run.smithi073.stderr: 61000K .......... .......... .......... .......... .......... 65% 417M 0s 2024-09-12T00:56:18.581 INFO:teuthology.orchestra.run.smithi073.stderr: 61050K .......... .......... .......... .......... .......... 65% 436M 0s 2024-09-12T00:56:18.581 INFO:teuthology.orchestra.run.smithi073.stderr: 61100K .......... .......... .......... .......... .......... 65% 197M 0s 2024-09-12T00:56:18.581 INFO:teuthology.orchestra.run.smithi073.stderr: 61150K .......... .......... .......... .......... .......... 65% 264M 0s 2024-09-12T00:56:18.581 INFO:teuthology.orchestra.run.smithi073.stderr: 61200K .......... .......... .......... .......... .......... 65% 381M 0s 2024-09-12T00:56:18.581 INFO:teuthology.orchestra.run.smithi073.stderr: 61250K .......... .......... .......... .......... .......... 65% 419M 0s 2024-09-12T00:56:18.581 INFO:teuthology.orchestra.run.smithi073.stderr: 61300K .......... .......... .......... .......... .......... 66% 112M 0s 2024-09-12T00:56:18.581 INFO:teuthology.orchestra.run.smithi073.stderr: 61350K .......... .......... .......... .......... .......... 66% 406M 0s 2024-09-12T00:56:18.581 INFO:teuthology.orchestra.run.smithi073.stderr: 61400K .......... .......... .......... .......... .......... 66% 424M 0s 2024-09-12T00:56:18.582 INFO:teuthology.orchestra.run.smithi073.stderr: 61450K .......... .......... .......... .......... .......... 66% 347M 0s 2024-09-12T00:56:18.582 INFO:teuthology.orchestra.run.smithi073.stderr: 61500K .......... .......... .......... .......... .......... 66% 167M 0s 2024-09-12T00:56:18.582 INFO:teuthology.orchestra.run.smithi073.stderr: 61550K .......... .......... .......... .......... .......... 66% 223M 0s 2024-09-12T00:56:18.582 INFO:teuthology.orchestra.run.smithi073.stderr: 61600K .......... .......... .......... .......... .......... 66% 298M 0s 2024-09-12T00:56:18.582 INFO:teuthology.orchestra.run.smithi073.stderr: 61650K .......... .......... .......... .......... .......... 66% 346M 0s 2024-09-12T00:56:18.582 INFO:teuthology.orchestra.run.smithi073.stderr: 61700K .......... .......... .......... .......... .......... 66% 436M 0s 2024-09-12T00:56:18.582 INFO:teuthology.orchestra.run.smithi073.stderr: 61750K .......... .......... .......... .......... .......... 66% 391M 0s 2024-09-12T00:56:18.582 INFO:teuthology.orchestra.run.smithi073.stderr: 61800K .......... .......... .......... .......... .......... 66% 429M 0s 2024-09-12T00:56:18.582 INFO:teuthology.orchestra.run.smithi073.stderr: 61850K .......... .......... .......... .......... .......... 66% 101M 0s 2024-09-12T00:56:18.582 INFO:teuthology.orchestra.run.smithi073.stderr: 61900K .......... .......... .......... .......... .......... 66% 211M 0s 2024-09-12T00:56:18.582 INFO:teuthology.orchestra.run.smithi073.stderr: 61950K .......... .......... .......... .......... .......... 66% 259M 0s 2024-09-12T00:56:18.582 INFO:teuthology.orchestra.run.smithi073.stderr: 62000K .......... .......... .......... .......... .......... 66% 118M 0s 2024-09-12T00:56:18.583 INFO:teuthology.orchestra.run.smithi073.stderr: 62050K .......... .......... .......... .......... .......... 66% 366M 0s 2024-09-12T00:56:18.583 INFO:teuthology.orchestra.run.smithi073.stderr: 62100K .......... .......... .......... .......... .......... 66% 423M 0s 2024-09-12T00:56:18.583 INFO:teuthology.orchestra.run.smithi073.stderr: 62150K .......... .......... .......... .......... .......... 66% 381M 0s 2024-09-12T00:56:18.583 INFO:teuthology.orchestra.run.smithi073.stderr: 62200K .......... .......... .......... .......... .......... 67% 426M 0s 2024-09-12T00:56:18.583 INFO:teuthology.orchestra.run.smithi073.stderr: 62250K .......... .......... .......... .......... .......... 67% 420M 0s 2024-09-12T00:56:18.583 INFO:teuthology.orchestra.run.smithi073.stderr: 62300K .......... .......... .......... .......... .......... 67% 334M 0s 2024-09-12T00:56:18.583 INFO:teuthology.orchestra.run.smithi073.stderr: 62350K .......... .......... .......... .......... .......... 67% 355M 0s 2024-09-12T00:56:18.583 INFO:teuthology.orchestra.run.smithi073.stderr: 62400K .......... .......... .......... .......... .......... 67% 451M 0s 2024-09-12T00:56:18.583 INFO:teuthology.orchestra.run.smithi073.stderr: 62450K .......... .......... .......... .......... .......... 67% 376M 0s 2024-09-12T00:56:18.583 INFO:teuthology.orchestra.run.smithi073.stderr: 62500K .......... .......... .......... .......... .......... 67% 417M 0s 2024-09-12T00:56:18.583 INFO:teuthology.orchestra.run.smithi073.stderr: 62550K .......... .......... .......... .......... .......... 67% 115M 0s 2024-09-12T00:56:18.583 INFO:teuthology.orchestra.run.smithi073.stderr: 62600K .......... .......... .......... .......... .......... 67% 264M 0s 2024-09-12T00:56:18.584 INFO:teuthology.orchestra.run.smithi073.stderr: 62650K .......... .......... .......... .......... .......... 67% 139M 0s 2024-09-12T00:56:18.584 INFO:teuthology.orchestra.run.smithi073.stderr: 62700K .......... .......... .......... .......... .......... 67% 392M 0s 2024-09-12T00:56:18.584 INFO:teuthology.orchestra.run.smithi073.stderr: 62750K .......... .......... .......... .......... .......... 67% 67.3M 0s 2024-09-12T00:56:18.584 INFO:teuthology.orchestra.run.smithi073.stderr: 62800K .......... .......... .......... .......... .......... 67% 417M 0s 2024-09-12T00:56:18.584 INFO:teuthology.orchestra.run.smithi073.stderr: 62850K .......... .......... .......... .......... .......... 67% 391M 0s 2024-09-12T00:56:18.584 INFO:teuthology.orchestra.run.smithi073.stderr: 62900K .......... .......... .......... .......... .......... 67% 405M 0s 2024-09-12T00:56:18.584 INFO:teuthology.orchestra.run.smithi073.stderr: 62950K .......... .......... .......... .......... .......... 67% 369M 0s 2024-09-12T00:56:18.584 INFO:teuthology.orchestra.run.smithi073.stderr: 63000K .......... .......... .......... .......... .......... 67% 419M 0s 2024-09-12T00:56:18.584 INFO:teuthology.orchestra.run.smithi073.stderr: 63050K .......... .......... .......... .......... .......... 67% 451M 0s 2024-09-12T00:56:18.584 INFO:teuthology.orchestra.run.smithi073.stderr: 63100K .......... .......... .......... .......... .......... 67% 393M 0s 2024-09-12T00:56:18.584 INFO:teuthology.orchestra.run.smithi073.stderr: 63150K .......... .......... .......... .......... .......... 68% 378M 0s 2024-09-12T00:56:18.585 INFO:teuthology.orchestra.run.smithi073.stderr: 63200K .......... .......... .......... .......... .......... 68% 403M 0s 2024-09-12T00:56:18.585 INFO:teuthology.orchestra.run.smithi073.stderr: 63250K .......... .......... .......... .......... .......... 68% 442M 0s 2024-09-12T00:56:18.585 INFO:teuthology.orchestra.run.smithi073.stderr: 63300K .......... .......... .......... .......... .......... 68% 417M 0s 2024-09-12T00:56:18.585 INFO:teuthology.orchestra.run.smithi073.stderr: 63350K .......... .......... .......... .......... .......... 68% 253M 0s 2024-09-12T00:56:18.585 INFO:teuthology.orchestra.run.smithi073.stderr: 63400K .......... .......... .......... .......... .......... 68% 72.5M 0s 2024-09-12T00:56:18.585 INFO:teuthology.orchestra.run.smithi073.stderr: 63450K .......... .......... .......... .......... .......... 68% 415M 0s 2024-09-12T00:56:18.585 INFO:teuthology.orchestra.run.smithi073.stderr: 63500K .......... .......... .......... .......... .......... 68% 436M 0s 2024-09-12T00:56:18.585 INFO:teuthology.orchestra.run.smithi073.stderr: 63550K .......... .......... .......... .......... .......... 68% 182M 0s 2024-09-12T00:56:18.585 INFO:teuthology.orchestra.run.smithi073.stderr: 63600K .......... .......... .......... .......... .......... 68% 43.8M 0s 2024-09-12T00:56:18.585 INFO:teuthology.orchestra.run.smithi073.stderr: 63650K .......... .......... .......... .......... .......... 68% 380M 0s 2024-09-12T00:56:18.585 INFO:teuthology.orchestra.run.smithi073.stderr: 63700K .......... .......... .......... .......... .......... 68% 419M 0s 2024-09-12T00:56:18.586 INFO:teuthology.orchestra.run.smithi073.stderr: 63750K .......... .......... .......... .......... .......... 68% 330M 0s 2024-09-12T00:56:18.586 INFO:teuthology.orchestra.run.smithi073.stderr: 63800K .......... .......... .......... .......... .......... 68% 405M 0s 2024-09-12T00:56:18.586 INFO:teuthology.orchestra.run.smithi073.stderr: 63850K .......... .......... .......... .......... .......... 68% 187M 0s 2024-09-12T00:56:18.586 INFO:teuthology.orchestra.run.smithi073.stderr: 63900K .......... .......... .......... .......... .......... 68% 374M 0s 2024-09-12T00:56:18.586 INFO:teuthology.orchestra.run.smithi073.stderr: 63950K .......... .......... .......... .......... .......... 68% 365M 0s 2024-09-12T00:56:18.586 INFO:teuthology.orchestra.run.smithi073.stderr: 64000K .......... .......... .......... .......... .......... 68% 284M 0s 2024-09-12T00:56:18.586 INFO:teuthology.orchestra.run.smithi073.stderr: 64050K .......... .......... .......... .......... .......... 68% 93.8M 0s 2024-09-12T00:56:18.586 INFO:teuthology.orchestra.run.smithi073.stderr: 64100K .......... .......... .......... .......... .......... 69% 136M 0s 2024-09-12T00:56:18.586 INFO:teuthology.orchestra.run.smithi073.stderr: 64150K .......... .......... .......... .......... .......... 69% 372M 0s 2024-09-12T00:56:18.586 INFO:teuthology.orchestra.run.smithi073.stderr: 64200K .......... .......... .......... .......... .......... 69% 445M 0s 2024-09-12T00:56:18.586 INFO:teuthology.orchestra.run.smithi073.stderr: 64250K .......... .......... .......... .......... .......... 69% 377M 0s 2024-09-12T00:56:18.586 INFO:teuthology.orchestra.run.smithi073.stderr: 64300K .......... .......... .......... .......... .......... 69% 223M 0s 2024-09-12T00:56:18.587 INFO:teuthology.orchestra.run.smithi073.stderr: 64350K .......... .......... .......... .......... .......... 69% 357M 0s 2024-09-12T00:56:18.587 INFO:teuthology.orchestra.run.smithi073.stderr: 64400K .......... .......... .......... .......... .......... 69% 387M 0s 2024-09-12T00:56:18.587 INFO:teuthology.orchestra.run.smithi073.stderr: 64450K .......... .......... .......... .......... .......... 69% 420M 0s 2024-09-12T00:56:18.587 INFO:teuthology.orchestra.run.smithi073.stderr: 64500K .......... .......... .......... .......... .......... 69% 437M 0s 2024-09-12T00:56:18.587 INFO:teuthology.orchestra.run.smithi073.stderr: 64550K .......... .......... .......... .......... .......... 69% 360M 0s 2024-09-12T00:56:18.587 INFO:teuthology.orchestra.run.smithi073.stderr: 64600K .......... .......... .......... .......... .......... 69% 425M 0s 2024-09-12T00:56:18.587 INFO:teuthology.orchestra.run.smithi073.stderr: 64650K .......... .......... .......... .......... .......... 69% 303M 0s 2024-09-12T00:56:18.587 INFO:teuthology.orchestra.run.smithi073.stderr: 64700K .......... .......... .......... .......... .......... 69% 140M 0s 2024-09-12T00:56:18.587 INFO:teuthology.orchestra.run.smithi073.stderr: 64750K .......... .......... .......... .......... .......... 69% 354M 0s 2024-09-12T00:56:18.587 INFO:teuthology.orchestra.run.smithi073.stderr: 64800K .......... .......... .......... .......... .......... 69% 409M 0s 2024-09-12T00:56:18.587 INFO:teuthology.orchestra.run.smithi073.stderr: 64850K .......... .......... .......... .......... .......... 69% 399M 0s 2024-09-12T00:56:18.587 INFO:teuthology.orchestra.run.smithi073.stderr: 64900K .......... .......... .......... .......... .......... 69% 262M 0s 2024-09-12T00:56:18.587 INFO:teuthology.orchestra.run.smithi073.stderr: 64950K .......... .......... .......... .......... .......... 69% 146M 0s 2024-09-12T00:56:18.588 INFO:teuthology.orchestra.run.smithi073.stderr: 65000K .......... .......... .......... .......... .......... 70% 174M 0s 2024-09-12T00:56:18.588 INFO:teuthology.orchestra.run.smithi073.stderr: 65050K .......... .......... .......... .......... .......... 70% 418M 0s 2024-09-12T00:56:18.588 INFO:teuthology.orchestra.run.smithi073.stderr: 65100K .......... .......... .......... .......... .......... 70% 126M 0s 2024-09-12T00:56:18.588 INFO:teuthology.orchestra.run.smithi073.stderr: 65150K .......... .......... .......... .......... .......... 70% 263M 0s 2024-09-12T00:56:18.588 INFO:teuthology.orchestra.run.smithi073.stderr: 65200K .......... .......... .......... .......... .......... 70% 409M 0s 2024-09-12T00:56:18.588 INFO:teuthology.orchestra.run.smithi073.stderr: 65250K .......... .......... .......... .......... .......... 70% 266M 0s 2024-09-12T00:56:18.588 INFO:teuthology.orchestra.run.smithi073.stderr: 65300K .......... .......... .......... .......... .......... 70% 297M 0s 2024-09-12T00:56:18.588 INFO:teuthology.orchestra.run.smithi073.stderr: 65350K .......... .......... .......... .......... .......... 70% 254M 0s 2024-09-12T00:56:18.588 INFO:teuthology.orchestra.run.smithi073.stderr: 65400K .......... .......... .......... .......... .......... 70% 315M 0s 2024-09-12T00:56:18.588 INFO:teuthology.orchestra.run.smithi073.stderr: 65450K .......... .......... .......... .......... .......... 70% 317M 0s 2024-09-12T00:56:18.588 INFO:teuthology.orchestra.run.smithi073.stderr: 65500K .......... .......... .......... .......... .......... 70% 405M 0s 2024-09-12T00:56:18.588 INFO:teuthology.orchestra.run.smithi073.stderr: 65550K .......... .......... .......... .......... .......... 70% 290M 0s 2024-09-12T00:56:18.589 INFO:teuthology.orchestra.run.smithi073.stderr: 65600K .......... .......... .......... .......... .......... 70% 414M 0s 2024-09-12T00:56:18.589 INFO:teuthology.orchestra.run.smithi073.stderr: 65650K .......... .......... .......... .......... .......... 70% 273M 0s 2024-09-12T00:56:18.589 INFO:teuthology.orchestra.run.smithi073.stderr: 65700K .......... .......... .......... .......... .......... 70% 108M 0s 2024-09-12T00:56:18.589 INFO:teuthology.orchestra.run.smithi073.stderr: 65750K .......... .......... .......... .......... .......... 70% 68.9M 0s 2024-09-12T00:56:18.589 INFO:teuthology.orchestra.run.smithi073.stderr: 65800K .......... .......... .......... .......... .......... 70% 344M 0s 2024-09-12T00:56:18.589 INFO:teuthology.orchestra.run.smithi073.stderr: 65850K .......... .......... .......... .......... .......... 70% 391M 0s 2024-09-12T00:56:18.589 INFO:teuthology.orchestra.run.smithi073.stderr: 65900K .......... .......... .......... .......... .......... 70% 236M 0s 2024-09-12T00:56:18.589 INFO:teuthology.orchestra.run.smithi073.stderr: 65950K .......... .......... .......... .......... .......... 71% 317M 0s 2024-09-12T00:56:18.589 INFO:teuthology.orchestra.run.smithi073.stderr: 66000K .......... .......... .......... .......... .......... 71% 384M 0s 2024-09-12T00:56:18.589 INFO:teuthology.orchestra.run.smithi073.stderr: 66050K .......... .......... .......... .......... .......... 71% 415M 0s 2024-09-12T00:56:18.589 INFO:teuthology.orchestra.run.smithi073.stderr: 66100K .......... .......... .......... .......... .......... 71% 424M 0s 2024-09-12T00:56:18.590 INFO:teuthology.orchestra.run.smithi073.stderr: 66150K .......... .......... .......... .......... .......... 71% 376M 0s 2024-09-12T00:56:18.590 INFO:teuthology.orchestra.run.smithi073.stderr: 66200K .......... .......... .......... .......... .......... 71% 427M 0s 2024-09-12T00:56:18.590 INFO:teuthology.orchestra.run.smithi073.stderr: 66250K .......... .......... .......... .......... .......... 71% 422M 0s 2024-09-12T00:56:18.590 INFO:teuthology.orchestra.run.smithi073.stderr: 66300K .......... .......... .......... .......... .......... 71% 338M 0s 2024-09-12T00:56:18.590 INFO:teuthology.orchestra.run.smithi073.stderr: 66350K .......... .......... .......... .......... .......... 71% 356M 0s 2024-09-12T00:56:18.590 INFO:teuthology.orchestra.run.smithi073.stderr: 66400K .......... .......... .......... .......... .......... 71% 417M 0s 2024-09-12T00:56:18.590 INFO:teuthology.orchestra.run.smithi073.stderr: 66450K .......... .......... .......... .......... .......... 71% 120M 0s 2024-09-12T00:56:18.590 INFO:teuthology.orchestra.run.smithi073.stderr: 66500K .......... .......... .......... .......... .......... 71% 376M 0s 2024-09-12T00:56:18.590 INFO:teuthology.orchestra.run.smithi073.stderr: 66550K .......... .......... .......... .......... .......... 71% 129M 0s 2024-09-12T00:56:18.590 INFO:teuthology.orchestra.run.smithi073.stderr: 66600K .......... .......... .......... .......... .......... 71% 371M 0s 2024-09-12T00:56:18.590 INFO:teuthology.orchestra.run.smithi073.stderr: 66650K .......... .......... .......... .......... .......... 71% 60.8M 0s 2024-09-12T00:56:18.590 INFO:teuthology.orchestra.run.smithi073.stderr: 66700K .......... .......... .......... .......... .......... 71% 361M 0s 2024-09-12T00:56:18.591 INFO:teuthology.orchestra.run.smithi073.stderr: 66750K .......... .......... .......... .......... .......... 71% 164M 0s 2024-09-12T00:56:18.591 INFO:teuthology.orchestra.run.smithi073.stderr: 66800K .......... .......... .......... .......... .......... 71% 308M 0s 2024-09-12T00:56:18.591 INFO:teuthology.orchestra.run.smithi073.stderr: 66850K .......... .......... .......... .......... .......... 72% 318M 0s 2024-09-12T00:56:18.591 INFO:teuthology.orchestra.run.smithi073.stderr: 66900K .......... .......... .......... .......... .......... 72% 258M 0s 2024-09-12T00:56:18.591 INFO:teuthology.orchestra.run.smithi073.stderr: 66950K .......... .......... .......... .......... .......... 72% 382M 0s 2024-09-12T00:56:18.591 INFO:teuthology.orchestra.run.smithi073.stderr: 67000K .......... .......... .......... .......... .......... 72% 182M 0s 2024-09-12T00:56:18.591 INFO:teuthology.orchestra.run.smithi073.stderr: 67050K .......... .......... .......... .......... .......... 72% 439M 0s 2024-09-12T00:56:18.591 INFO:teuthology.orchestra.run.smithi073.stderr: 67100K .......... .......... .......... .......... .......... 72% 141M 0s 2024-09-12T00:56:18.591 INFO:teuthology.orchestra.run.smithi073.stderr: 67150K .......... .......... .......... .......... .......... 72% 122M 0s 2024-09-12T00:56:18.591 INFO:teuthology.orchestra.run.smithi073.stderr: 67200K .......... .......... .......... .......... .......... 72% 308M 0s 2024-09-12T00:56:18.591 INFO:teuthology.orchestra.run.smithi073.stderr: 67250K .......... .......... .......... .......... .......... 72% 207M 0s 2024-09-12T00:56:18.592 INFO:teuthology.orchestra.run.smithi073.stderr: 67300K .......... .......... .......... .......... .......... 72% 181M 0s 2024-09-12T00:56:18.592 INFO:teuthology.orchestra.run.smithi073.stderr: 67350K .......... .......... .......... .......... .......... 72% 399M 0s 2024-09-12T00:56:18.592 INFO:teuthology.orchestra.run.smithi073.stderr: 67400K .......... .......... .......... .......... .......... 72% 401M 0s 2024-09-12T00:56:18.592 INFO:teuthology.orchestra.run.smithi073.stderr: 67450K .......... .......... .......... .......... .......... 72% 405M 0s 2024-09-12T00:56:18.592 INFO:teuthology.orchestra.run.smithi073.stderr: 67500K .......... .......... .......... .......... .......... 72% 435M 0s 2024-09-12T00:56:18.592 INFO:teuthology.orchestra.run.smithi073.stderr: 67550K .......... .......... .......... .......... .......... 72% 355M 0s 2024-09-12T00:56:18.592 INFO:teuthology.orchestra.run.smithi073.stderr: 67600K .......... .......... .......... .......... .......... 72% 392M 0s 2024-09-12T00:56:18.592 INFO:teuthology.orchestra.run.smithi073.stderr: 67650K .......... .......... .......... .......... .......... 72% 464M 0s 2024-09-12T00:56:18.592 INFO:teuthology.orchestra.run.smithi073.stderr: 67700K .......... .......... .......... .......... .......... 72% 269M 0s 2024-09-12T00:56:18.592 INFO:teuthology.orchestra.run.smithi073.stderr: 67750K .......... .......... .......... .......... .......... 72% 147M 0s 2024-09-12T00:56:18.592 INFO:teuthology.orchestra.run.smithi073.stderr: 67800K .......... .......... .......... .......... .......... 73% 397M 0s 2024-09-12T00:56:18.593 INFO:teuthology.orchestra.run.smithi073.stderr: 67850K .......... .......... .......... .......... .......... 73% 239M 0s 2024-09-12T00:56:18.593 INFO:teuthology.orchestra.run.smithi073.stderr: 67900K .......... .......... .......... .......... .......... 73% 398M 0s 2024-09-12T00:56:18.593 INFO:teuthology.orchestra.run.smithi073.stderr: 67950K .......... .......... .......... .......... .......... 73% 377M 0s 2024-09-12T00:56:18.593 INFO:teuthology.orchestra.run.smithi073.stderr: 68000K .......... .......... .......... .......... .......... 73% 203M 0s 2024-09-12T00:56:18.593 INFO:teuthology.orchestra.run.smithi073.stderr: 68050K .......... .......... .......... .......... .......... 73% 404M 0s 2024-09-12T00:56:18.593 INFO:teuthology.orchestra.run.smithi073.stderr: 68100K .......... .......... .......... .......... .......... 73% 45.2M 0s 2024-09-12T00:56:18.593 INFO:teuthology.orchestra.run.smithi073.stderr: 68150K .......... .......... .......... .......... .......... 73% 281M 0s 2024-09-12T00:56:18.593 INFO:teuthology.orchestra.run.smithi073.stderr: 68200K .......... .......... .......... .......... .......... 73% 384M 0s 2024-09-12T00:56:18.593 INFO:teuthology.orchestra.run.smithi073.stderr: 68250K .......... .......... .......... .......... .......... 73% 453M 0s 2024-09-12T00:56:18.593 INFO:teuthology.orchestra.run.smithi073.stderr: 68300K .......... .......... .......... .......... .......... 73% 453M 0s 2024-09-12T00:56:18.593 INFO:teuthology.orchestra.run.smithi073.stderr: 68350K .......... .......... .......... .......... .......... 73% 353M 0s 2024-09-12T00:56:18.593 INFO:teuthology.orchestra.run.smithi073.stderr: 68400K .......... .......... .......... .......... .......... 73% 456M 0s 2024-09-12T00:56:18.594 INFO:teuthology.orchestra.run.smithi073.stderr: 68450K .......... .......... .......... .......... .......... 73% 415M 0s 2024-09-12T00:56:18.594 INFO:teuthology.orchestra.run.smithi073.stderr: 68500K .......... .......... .......... .......... .......... 73% 428M 0s 2024-09-12T00:56:18.594 INFO:teuthology.orchestra.run.smithi073.stderr: 68550K .......... .......... .......... .......... .......... 73% 388M 0s 2024-09-12T00:56:18.594 INFO:teuthology.orchestra.run.smithi073.stderr: 68600K .......... .......... .......... .......... .......... 73% 436M 0s 2024-09-12T00:56:18.594 INFO:teuthology.orchestra.run.smithi073.stderr: 68650K .......... .......... .......... .......... .......... 73% 451M 0s 2024-09-12T00:56:18.594 INFO:teuthology.orchestra.run.smithi073.stderr: 68700K .......... .......... .......... .......... .......... 74% 392M 0s 2024-09-12T00:56:18.594 INFO:teuthology.orchestra.run.smithi073.stderr: 68750K .......... .......... .......... .......... .......... 74% 185M 0s 2024-09-12T00:56:18.594 INFO:teuthology.orchestra.run.smithi073.stderr: 68800K .......... .......... .......... .......... .......... 74% 66.6M 0s 2024-09-12T00:56:18.594 INFO:teuthology.orchestra.run.smithi073.stderr: 68850K .......... .......... .......... .......... .......... 74% 390M 0s 2024-09-12T00:56:18.594 INFO:teuthology.orchestra.run.smithi073.stderr: 68900K .......... .......... .......... .......... .......... 74% 407M 0s 2024-09-12T00:56:18.594 INFO:teuthology.orchestra.run.smithi073.stderr: 68950K .......... .......... .......... .......... .......... 74% 265M 0s 2024-09-12T00:56:18.594 INFO:teuthology.orchestra.run.smithi073.stderr: 69000K .......... .......... .......... .......... .......... 74% 114M 0s 2024-09-12T00:56:18.595 INFO:teuthology.orchestra.run.smithi073.stderr: 69050K .......... .......... .......... .......... .......... 74% 369M 0s 2024-09-12T00:56:18.595 INFO:teuthology.orchestra.run.smithi073.stderr: 69100K .......... .......... .......... .......... .......... 74% 383M 0s 2024-09-12T00:56:18.595 INFO:teuthology.orchestra.run.smithi073.stderr: 69150K .......... .......... .......... .......... .......... 74% 317M 0s 2024-09-12T00:56:18.595 INFO:teuthology.orchestra.run.smithi073.stderr: 69200K .......... .......... .......... .......... .......... 74% 362M 0s 2024-09-12T00:56:18.595 INFO:teuthology.orchestra.run.smithi073.stderr: 69250K .......... .......... .......... .......... .......... 74% 382M 0s 2024-09-12T00:56:18.595 INFO:teuthology.orchestra.run.smithi073.stderr: 69300K .......... .......... .......... .......... .......... 74% 404M 0s 2024-09-12T00:56:18.595 INFO:teuthology.orchestra.run.smithi073.stderr: 69350K .......... .......... .......... .......... .......... 74% 399M 0s 2024-09-12T00:56:18.595 INFO:teuthology.orchestra.run.smithi073.stderr: 69400K .......... .......... .......... .......... .......... 74% 76.2M 0s 2024-09-12T00:56:18.595 INFO:teuthology.orchestra.run.smithi073.stderr: 69450K .......... .......... .......... .......... .......... 74% 398M 0s 2024-09-12T00:56:18.595 INFO:teuthology.orchestra.run.smithi073.stderr: 69500K .......... .......... .......... .......... .......... 74% 349M 0s 2024-09-12T00:56:18.595 INFO:teuthology.orchestra.run.smithi073.stderr: 69550K .......... .......... .......... .......... .......... 74% 348M 0s 2024-09-12T00:56:18.596 INFO:teuthology.orchestra.run.smithi073.stderr: 69600K .......... .......... .......... .......... .......... 74% 427M 0s 2024-09-12T00:56:18.596 INFO:teuthology.orchestra.run.smithi073.stderr: 69650K .......... .......... .......... .......... .......... 75% 66.3M 0s 2024-09-12T00:56:18.596 INFO:teuthology.orchestra.run.smithi073.stderr: 69700K .......... .......... .......... .......... .......... 75% 419M 0s 2024-09-12T00:56:18.596 INFO:teuthology.orchestra.run.smithi073.stderr: 69750K .......... .......... .......... .......... .......... 75% 280M 0s 2024-09-12T00:56:18.596 INFO:teuthology.orchestra.run.smithi073.stderr: 69800K .......... .......... .......... .......... .......... 75% 356M 0s 2024-09-12T00:56:18.596 INFO:teuthology.orchestra.run.smithi073.stderr: 69850K .......... .......... .......... .......... .......... 75% 398M 0s 2024-09-12T00:56:18.596 INFO:teuthology.orchestra.run.smithi073.stderr: 69900K .......... .......... .......... .......... .......... 75% 234M 0s 2024-09-12T00:56:18.596 INFO:teuthology.orchestra.run.smithi073.stderr: 69950K .......... .......... .......... .......... .......... 75% 330M 0s 2024-09-12T00:56:18.596 INFO:teuthology.orchestra.run.smithi073.stderr: 70000K .......... .......... .......... .......... .......... 75% 411M 0s 2024-09-12T00:56:18.596 INFO:teuthology.orchestra.run.smithi073.stderr: 70050K .......... .......... .......... .......... .......... 75% 243M 0s 2024-09-12T00:56:18.596 INFO:teuthology.orchestra.run.smithi073.stderr: 70100K .......... .......... .......... .......... .......... 75% 84.9M 0s 2024-09-12T00:56:18.596 INFO:teuthology.orchestra.run.smithi073.stderr: 70150K .......... .......... .......... .......... .......... 75% 306M 0s 2024-09-12T00:56:18.597 INFO:teuthology.orchestra.run.smithi073.stderr: 70200K .......... .......... .......... .......... .......... 75% 444M 0s 2024-09-12T00:56:18.597 INFO:teuthology.orchestra.run.smithi073.stderr: 70250K .......... .......... .......... .......... .......... 75% 196M 0s 2024-09-12T00:56:18.597 INFO:teuthology.orchestra.run.smithi073.stderr: 70300K .......... .......... .......... .......... .......... 75% 226M 0s 2024-09-12T00:56:18.597 INFO:teuthology.orchestra.run.smithi073.stderr: 70350K .......... .......... .......... .......... .......... 75% 201M 0s 2024-09-12T00:56:18.597 INFO:teuthology.orchestra.run.smithi073.stderr: 70400K .......... .......... .......... .......... .......... 75% 333M 0s 2024-09-12T00:56:18.597 INFO:teuthology.orchestra.run.smithi073.stderr: 70450K .......... .......... .......... .......... .......... 75% 420M 0s 2024-09-12T00:56:18.597 INFO:teuthology.orchestra.run.smithi073.stderr: 70500K .......... .......... .......... .......... .......... 75% 362M 0s 2024-09-12T00:56:18.597 INFO:teuthology.orchestra.run.smithi073.stderr: 70550K .......... .......... .......... .......... .......... 75% 292M 0s 2024-09-12T00:56:18.597 INFO:teuthology.orchestra.run.smithi073.stderr: 70600K .......... .......... .......... .......... .......... 76% 293M 0s 2024-09-12T00:56:18.597 INFO:teuthology.orchestra.run.smithi073.stderr: 70650K .......... .......... .......... .......... .......... 76% 418M 0s 2024-09-12T00:56:18.597 INFO:teuthology.orchestra.run.smithi073.stderr: 70700K .......... .......... .......... .......... .......... 76% 376M 0s 2024-09-12T00:56:18.597 INFO:teuthology.orchestra.run.smithi073.stderr: 70750K .......... .......... .......... .......... .......... 76% 360M 0s 2024-09-12T00:56:18.598 INFO:teuthology.orchestra.run.smithi073.stderr: 70800K .......... .......... .......... .......... .......... 76% 230M 0s 2024-09-12T00:56:18.598 INFO:teuthology.orchestra.run.smithi073.stderr: 70850K .......... .......... .......... .......... .......... 76% 295M 0s 2024-09-12T00:56:18.598 INFO:teuthology.orchestra.run.smithi073.stderr: 70900K .......... .......... .......... .......... .......... 76% 291M 0s 2024-09-12T00:56:18.598 INFO:teuthology.orchestra.run.smithi073.stderr: 70950K .......... .......... .......... .......... .......... 76% 343M 0s 2024-09-12T00:56:18.598 INFO:teuthology.orchestra.run.smithi073.stderr: 71000K .......... .......... .......... .......... .......... 76% 126M 0s 2024-09-12T00:56:18.598 INFO:teuthology.orchestra.run.smithi073.stderr: 71050K .......... .......... .......... .......... .......... 76% 363M 0s 2024-09-12T00:56:18.598 INFO:teuthology.orchestra.run.smithi073.stderr: 71100K .......... .......... .......... .......... .......... 76% 415M 0s 2024-09-12T00:56:18.598 INFO:teuthology.orchestra.run.smithi073.stderr: 71150K .......... .......... .......... .......... .......... 76% 57.4M 0s 2024-09-12T00:56:18.598 INFO:teuthology.orchestra.run.smithi073.stderr: 71200K .......... .......... .......... .......... .......... 76% 373M 0s 2024-09-12T00:56:18.598 INFO:teuthology.orchestra.run.smithi073.stderr: 71250K .......... .......... .......... .......... .......... 76% 252M 0s 2024-09-12T00:56:18.598 INFO:teuthology.orchestra.run.smithi073.stderr: 71300K .......... .......... .......... .......... .......... 76% 398M 0s 2024-09-12T00:56:18.598 INFO:teuthology.orchestra.run.smithi073.stderr: 71350K .......... .......... .......... .......... .......... 76% 345M 0s 2024-09-12T00:56:18.599 INFO:teuthology.orchestra.run.smithi073.stderr: 71400K .......... .......... .......... .......... .......... 76% 321M 0s 2024-09-12T00:56:18.599 INFO:teuthology.orchestra.run.smithi073.stderr: 71450K .......... .......... .......... .......... .......... 76% 237M 0s 2024-09-12T00:56:18.599 INFO:teuthology.orchestra.run.smithi073.stderr: 71500K .......... .......... .......... .......... .......... 77% 244M 0s 2024-09-12T00:56:18.599 INFO:teuthology.orchestra.run.smithi073.stderr: 71550K .......... .......... .......... .......... .......... 77% 367M 0s 2024-09-12T00:56:18.599 INFO:teuthology.orchestra.run.smithi073.stderr: 71600K .......... .......... .......... .......... .......... 77% 439M 0s 2024-09-12T00:56:18.599 INFO:teuthology.orchestra.run.smithi073.stderr: 71650K .......... .......... .......... .......... .......... 77% 420M 0s 2024-09-12T00:56:18.599 INFO:teuthology.orchestra.run.smithi073.stderr: 71700K .......... .......... .......... .......... .......... 77% 474M 0s 2024-09-12T00:56:18.599 INFO:teuthology.orchestra.run.smithi073.stderr: 71750K .......... .......... .......... .......... .......... 77% 345M 0s 2024-09-12T00:56:18.599 INFO:teuthology.orchestra.run.smithi073.stderr: 71800K .......... .......... .......... .......... .......... 77% 394M 0s 2024-09-12T00:56:18.599 INFO:teuthology.orchestra.run.smithi073.stderr: 71850K .......... .......... .......... .......... .......... 77% 431M 0s 2024-09-12T00:56:18.599 INFO:teuthology.orchestra.run.smithi073.stderr: 71900K .......... .......... .......... .......... .......... 77% 94.3M 0s 2024-09-12T00:56:18.600 INFO:teuthology.orchestra.run.smithi073.stderr: 71950K .......... .......... .......... .......... .......... 77% 113M 0s 2024-09-12T00:56:18.600 INFO:teuthology.orchestra.run.smithi073.stderr: 72000K .......... .......... .......... .......... .......... 77% 267M 0s 2024-09-12T00:56:18.600 INFO:teuthology.orchestra.run.smithi073.stderr: 72050K .......... .......... .......... .......... .......... 77% 256M 0s 2024-09-12T00:56:18.600 INFO:teuthology.orchestra.run.smithi073.stderr: 72100K .......... .......... .......... .......... .......... 77% 253M 0s 2024-09-12T00:56:18.600 INFO:teuthology.orchestra.run.smithi073.stderr: 72150K .......... .......... .......... .......... .......... 77% 232M 0s 2024-09-12T00:56:18.600 INFO:teuthology.orchestra.run.smithi073.stderr: 72200K .......... .......... .......... .......... .......... 77% 239M 0s 2024-09-12T00:56:18.600 INFO:teuthology.orchestra.run.smithi073.stderr: 72250K .......... .......... .......... .......... .......... 77% 232M 0s 2024-09-12T00:56:18.600 INFO:teuthology.orchestra.run.smithi073.stderr: 72300K .......... .......... .......... .......... .......... 77% 236M 0s 2024-09-12T00:56:18.600 INFO:teuthology.orchestra.run.smithi073.stderr: 72350K .......... .......... .......... .......... .......... 77% 247M 0s 2024-09-12T00:56:18.600 INFO:teuthology.orchestra.run.smithi073.stderr: 72400K .......... .......... .......... .......... .......... 77% 114M 0s 2024-09-12T00:56:18.600 INFO:teuthology.orchestra.run.smithi073.stderr: 72450K .......... .......... .......... .......... .......... 78% 229M 0s 2024-09-12T00:56:18.601 INFO:teuthology.orchestra.run.smithi073.stderr: 72500K .......... .......... .......... .......... .......... 78% 290M 0s 2024-09-12T00:56:18.601 INFO:teuthology.orchestra.run.smithi073.stderr: 72550K .......... .......... .......... .......... .......... 78% 260M 0s 2024-09-12T00:56:18.601 INFO:teuthology.orchestra.run.smithi073.stderr: 72600K .......... .......... .......... .......... .......... 78% 287M 0s 2024-09-12T00:56:18.601 INFO:teuthology.orchestra.run.smithi073.stderr: 72650K .......... .......... .......... .......... .......... 78% 61.3M 0s 2024-09-12T00:56:18.601 INFO:teuthology.orchestra.run.smithi073.stderr: 72700K .......... .......... .......... .......... .......... 78% 427M 0s 2024-09-12T00:56:18.601 INFO:teuthology.orchestra.run.smithi073.stderr: 72750K .......... .......... .......... .......... .......... 78% 335M 0s 2024-09-12T00:56:18.601 INFO:teuthology.orchestra.run.smithi073.stderr: 72800K .......... .......... .......... .......... .......... 78% 435M 0s 2024-09-12T00:56:18.601 INFO:teuthology.orchestra.run.smithi073.stderr: 72850K .......... .......... .......... .......... .......... 78% 408M 0s 2024-09-12T00:56:18.601 INFO:teuthology.orchestra.run.smithi073.stderr: 72900K .......... .......... .......... .......... .......... 78% 445M 0s 2024-09-12T00:56:18.601 INFO:teuthology.orchestra.run.smithi073.stderr: 72950K .......... .......... .......... .......... .......... 78% 391M 0s 2024-09-12T00:56:18.601 INFO:teuthology.orchestra.run.smithi073.stderr: 73000K .......... .......... .......... .......... .......... 78% 432M 0s 2024-09-12T00:56:18.602 INFO:teuthology.orchestra.run.smithi073.stderr: 73050K .......... .......... .......... .......... .......... 78% 433M 0s 2024-09-12T00:56:18.602 INFO:teuthology.orchestra.run.smithi073.stderr: 73100K .......... .......... .......... .......... .......... 78% 433M 0s 2024-09-12T00:56:18.602 INFO:teuthology.orchestra.run.smithi073.stderr: 73150K .......... .......... .......... .......... .......... 78% 86.8M 0s 2024-09-12T00:56:18.602 INFO:teuthology.orchestra.run.smithi073.stderr: 73200K .......... .......... .......... .......... .......... 78% 245M 0s 2024-09-12T00:56:18.602 INFO:teuthology.orchestra.run.smithi073.stderr: 73250K .......... .......... .......... .......... .......... 78% 365M 0s 2024-09-12T00:56:18.602 INFO:teuthology.orchestra.run.smithi073.stderr: 73300K .......... .......... .......... .......... .......... 78% 442M 0s 2024-09-12T00:56:18.602 INFO:teuthology.orchestra.run.smithi073.stderr: 73350K .......... .......... .......... .......... .......... 79% 188M 0s 2024-09-12T00:56:18.602 INFO:teuthology.orchestra.run.smithi073.stderr: 73400K .......... .......... .......... .......... .......... 79% 426M 0s 2024-09-12T00:56:18.602 INFO:teuthology.orchestra.run.smithi073.stderr: 73450K .......... .......... .......... .......... .......... 79% 262M 0s 2024-09-12T00:56:18.602 INFO:teuthology.orchestra.run.smithi073.stderr: 73500K .......... .......... .......... .......... .......... 79% 232M 0s 2024-09-12T00:56:18.602 INFO:teuthology.orchestra.run.smithi073.stderr: 73550K .......... .......... .......... .......... .......... 79% 364M 0s 2024-09-12T00:56:18.603 INFO:teuthology.orchestra.run.smithi073.stderr: 73600K .......... .......... .......... .......... .......... 79% 232M 0s 2024-09-12T00:56:18.603 INFO:teuthology.orchestra.run.smithi073.stderr: 73650K .......... .......... .......... .......... .......... 79% 188M 0s 2024-09-12T00:56:18.603 INFO:teuthology.orchestra.run.smithi073.stderr: 73700K .......... .......... .......... .......... .......... 79% 424M 0s 2024-09-12T00:56:18.603 INFO:teuthology.orchestra.run.smithi073.stderr: 73750K .......... .......... .......... .......... .......... 79% 394M 0s 2024-09-12T00:56:18.603 INFO:teuthology.orchestra.run.smithi073.stderr: 73800K .......... .......... .......... .......... .......... 79% 432M 0s 2024-09-12T00:56:18.603 INFO:teuthology.orchestra.run.smithi073.stderr: 73850K .......... .......... .......... .......... .......... 79% 436M 0s 2024-09-12T00:56:18.603 INFO:teuthology.orchestra.run.smithi073.stderr: 73900K .......... .......... .......... .......... .......... 79% 399M 0s 2024-09-12T00:56:18.603 INFO:teuthology.orchestra.run.smithi073.stderr: 73950K .......... .......... .......... .......... .......... 79% 171M 0s 2024-09-12T00:56:18.603 INFO:teuthology.orchestra.run.smithi073.stderr: 74000K .......... .......... .......... .......... .......... 79% 252M 0s 2024-09-12T00:56:18.603 INFO:teuthology.orchestra.run.smithi073.stderr: 74050K .......... .......... .......... .......... .......... 79% 91.1M 0s 2024-09-12T00:56:18.603 INFO:teuthology.orchestra.run.smithi073.stderr: 74100K .......... .......... .......... .......... .......... 79% 365M 0s 2024-09-12T00:56:18.604 INFO:teuthology.orchestra.run.smithi073.stderr: 74150K .......... .......... .......... .......... .......... 79% 83.2M 0s 2024-09-12T00:56:18.604 INFO:teuthology.orchestra.run.smithi073.stderr: 74200K .......... .......... .......... .......... .......... 79% 229M 0s 2024-09-12T00:56:18.604 INFO:teuthology.orchestra.run.smithi073.stderr: 74250K .......... .......... .......... .......... .......... 79% 370M 0s 2024-09-12T00:56:18.604 INFO:teuthology.orchestra.run.smithi073.stderr: 74300K .......... .......... .......... .......... .......... 80% 399M 0s 2024-09-12T00:56:18.604 INFO:teuthology.orchestra.run.smithi073.stderr: 74350K .......... .......... .......... .......... .......... 80% 429M 0s 2024-09-12T00:56:18.604 INFO:teuthology.orchestra.run.smithi073.stderr: 74400K .......... .......... .......... .......... .......... 80% 435M 0s 2024-09-12T00:56:18.604 INFO:teuthology.orchestra.run.smithi073.stderr: 74450K .......... .......... .......... .......... .......... 80% 373M 0s 2024-09-12T00:56:18.604 INFO:teuthology.orchestra.run.smithi073.stderr: 74500K .......... .......... .......... .......... .......... 80% 438M 0s 2024-09-12T00:56:18.604 INFO:teuthology.orchestra.run.smithi073.stderr: 74550K .......... .......... .......... .......... .......... 80% 245M 0s 2024-09-12T00:56:18.604 INFO:teuthology.orchestra.run.smithi073.stderr: 74600K .......... .......... .......... .......... .......... 80% 172M 0s 2024-09-12T00:56:18.604 INFO:teuthology.orchestra.run.smithi073.stderr: 74650K .......... .......... .......... .......... .......... 80% 428M 0s 2024-09-12T00:56:18.604 INFO:teuthology.orchestra.run.smithi073.stderr: 74700K .......... .......... .......... .......... .......... 80% 393M 0s 2024-09-12T00:56:18.605 INFO:teuthology.orchestra.run.smithi073.stderr: 74750K .......... .......... .......... .......... .......... 80% 132M 0s 2024-09-12T00:56:18.605 INFO:teuthology.orchestra.run.smithi073.stderr: 74800K .......... .......... .......... .......... .......... 80% 188M 0s 2024-09-12T00:56:18.605 INFO:teuthology.orchestra.run.smithi073.stderr: 74850K .......... .......... .......... .......... .......... 80% 373M 0s 2024-09-12T00:56:18.605 INFO:teuthology.orchestra.run.smithi073.stderr: 74900K .......... .......... .......... .......... .......... 80% 394M 0s 2024-09-12T00:56:18.605 INFO:teuthology.orchestra.run.smithi073.stderr: 74950K .......... .......... .......... .......... .......... 80% 434M 0s 2024-09-12T00:56:18.605 INFO:teuthology.orchestra.run.smithi073.stderr: 75000K .......... .......... .......... .......... .......... 80% 120M 0s 2024-09-12T00:56:18.605 INFO:teuthology.orchestra.run.smithi073.stderr: 75050K .......... .......... .......... .......... .......... 80% 162M 0s 2024-09-12T00:56:18.605 INFO:teuthology.orchestra.run.smithi073.stderr: 75100K .......... .......... .......... .......... .......... 80% 410M 0s 2024-09-12T00:56:18.605 INFO:teuthology.orchestra.run.smithi073.stderr: 75150K .......... .......... .......... .......... .......... 80% 440M 0s 2024-09-12T00:56:18.605 INFO:teuthology.orchestra.run.smithi073.stderr: 75200K .......... .......... .......... .......... .......... 81% 448M 0s 2024-09-12T00:56:18.605 INFO:teuthology.orchestra.run.smithi073.stderr: 75250K .......... .......... .......... .......... .......... 81% 133M 0s 2024-09-12T00:56:18.606 INFO:teuthology.orchestra.run.smithi073.stderr: 75300K .......... .......... .......... .......... .......... 81% 327M 0s 2024-09-12T00:56:18.606 INFO:teuthology.orchestra.run.smithi073.stderr: 75350K .......... .......... .......... .......... .......... 81% 280M 0s 2024-09-12T00:56:18.606 INFO:teuthology.orchestra.run.smithi073.stderr: 75400K .......... .......... .......... .......... .......... 81% 425M 0s 2024-09-12T00:56:18.606 INFO:teuthology.orchestra.run.smithi073.stderr: 75450K .......... .......... .......... .......... .......... 81% 142M 0s 2024-09-12T00:56:18.606 INFO:teuthology.orchestra.run.smithi073.stderr: 75500K .......... .......... .......... .......... .......... 81% 198M 0s 2024-09-12T00:56:18.606 INFO:teuthology.orchestra.run.smithi073.stderr: 75550K .......... .......... .......... .......... .......... 81% 164M 0s 2024-09-12T00:56:18.606 INFO:teuthology.orchestra.run.smithi073.stderr: 75600K .......... .......... .......... .......... .......... 81% 313M 0s 2024-09-12T00:56:18.606 INFO:teuthology.orchestra.run.smithi073.stderr: 75650K .......... .......... .......... .......... .......... 81% 57.0M 0s 2024-09-12T00:56:18.606 INFO:teuthology.orchestra.run.smithi073.stderr: 75700K .......... .......... .......... .......... .......... 81% 429M 0s 2024-09-12T00:56:18.606 INFO:teuthology.orchestra.run.smithi073.stderr: 75750K .......... .......... .......... .......... .......... 81% 424M 0s 2024-09-12T00:56:18.607 INFO:teuthology.orchestra.run.smithi073.stderr: 75800K .......... .......... .......... .......... .......... 81% 409M 0s 2024-09-12T00:56:18.607 INFO:teuthology.orchestra.run.smithi073.stderr: 75850K .......... .......... .......... .......... .......... 81% 352M 0s 2024-09-12T00:56:18.607 INFO:teuthology.orchestra.run.smithi073.stderr: 75900K .......... .......... .......... .......... .......... 81% 438M 0s 2024-09-12T00:56:18.607 INFO:teuthology.orchestra.run.smithi073.stderr: 75950K .......... .......... .......... .......... .......... 81% 158M 0s 2024-09-12T00:56:18.607 INFO:teuthology.orchestra.run.smithi073.stderr: 76000K .......... .......... .......... .......... .......... 81% 417M 0s 2024-09-12T00:56:18.607 INFO:teuthology.orchestra.run.smithi073.stderr: 76050K .......... .......... .......... .......... .......... 81% 394M 0s 2024-09-12T00:56:18.607 INFO:teuthology.orchestra.run.smithi073.stderr: 76100K .......... .......... .......... .......... .......... 81% 443M 0s 2024-09-12T00:56:18.607 INFO:teuthology.orchestra.run.smithi073.stderr: 76150K .......... .......... .......... .......... .......... 82% 106M 0s 2024-09-12T00:56:18.607 INFO:teuthology.orchestra.run.smithi073.stderr: 76200K .......... .......... .......... .......... .......... 82% 234M 0s 2024-09-12T00:56:18.607 INFO:teuthology.orchestra.run.smithi073.stderr: 76250K .......... .......... .......... .......... .......... 82% 406M 0s 2024-09-12T00:56:18.607 INFO:teuthology.orchestra.run.smithi073.stderr: 76300K .......... .......... .......... .......... .......... 82% 372M 0s 2024-09-12T00:56:18.607 INFO:teuthology.orchestra.run.smithi073.stderr: 76350K .......... .......... .......... .......... .......... 82% 363M 0s 2024-09-12T00:56:18.608 INFO:teuthology.orchestra.run.smithi073.stderr: 76400K .......... .......... .......... .......... .......... 82% 189M 0s 2024-09-12T00:56:18.608 INFO:teuthology.orchestra.run.smithi073.stderr: 76450K .......... .......... .......... .......... .......... 82% 289M 0s 2024-09-12T00:56:18.608 INFO:teuthology.orchestra.run.smithi073.stderr: 76500K .......... .......... .......... .......... .......... 82% 404M 0s 2024-09-12T00:56:18.608 INFO:teuthology.orchestra.run.smithi073.stderr: 76550K .......... .......... .......... .......... .......... 82% 352M 0s 2024-09-12T00:56:18.608 INFO:teuthology.orchestra.run.smithi073.stderr: 76600K .......... .......... .......... .......... .......... 82% 235M 0s 2024-09-12T00:56:18.608 INFO:teuthology.orchestra.run.smithi073.stderr: 76650K .......... .......... .......... .......... .......... 82% 180M 0s 2024-09-12T00:56:18.608 INFO:teuthology.orchestra.run.smithi073.stderr: 76700K .......... .......... .......... .......... .......... 82% 255M 0s 2024-09-12T00:56:18.608 INFO:teuthology.orchestra.run.smithi073.stderr: 76750K .......... .......... .......... .......... .......... 82% 249M 0s 2024-09-12T00:56:18.608 INFO:teuthology.orchestra.run.smithi073.stderr: 76800K .......... .......... .......... .......... .......... 82% 349M 0s 2024-09-12T00:56:18.608 INFO:teuthology.orchestra.run.smithi073.stderr: 76850K .......... .......... .......... .......... .......... 82% 385M 0s 2024-09-12T00:56:18.608 INFO:teuthology.orchestra.run.smithi073.stderr: 76900K .......... .......... .......... .......... .......... 82% 412M 0s 2024-09-12T00:56:18.609 INFO:teuthology.orchestra.run.smithi073.stderr: 76950K .......... .......... .......... .......... .......... 82% 404M 0s 2024-09-12T00:56:18.609 INFO:teuthology.orchestra.run.smithi073.stderr: 77000K .......... .......... .......... .......... .......... 82% 435M 0s 2024-09-12T00:56:18.609 INFO:teuthology.orchestra.run.smithi073.stderr: 77050K .......... .......... .......... .......... .......... 82% 435M 0s 2024-09-12T00:56:18.609 INFO:teuthology.orchestra.run.smithi073.stderr: 77100K .......... .......... .......... .......... .......... 83% 139M 0s 2024-09-12T00:56:18.609 INFO:teuthology.orchestra.run.smithi073.stderr: 77150K .......... .......... .......... .......... .......... 83% 53.2M 0s 2024-09-12T00:56:18.609 INFO:teuthology.orchestra.run.smithi073.stderr: 77200K .......... .......... .......... .......... .......... 83% 417M 0s 2024-09-12T00:56:18.609 INFO:teuthology.orchestra.run.smithi073.stderr: 77250K .......... .......... .......... .......... .......... 83% 442M 0s 2024-09-12T00:56:18.609 INFO:teuthology.orchestra.run.smithi073.stderr: 77300K .......... .......... .......... .......... .......... 83% 147M 0s 2024-09-12T00:56:18.609 INFO:teuthology.orchestra.run.smithi073.stderr: 77350K .......... .......... .......... .......... .......... 83% 369M 0s 2024-09-12T00:56:18.609 INFO:teuthology.orchestra.run.smithi073.stderr: 77400K .......... .......... .......... .......... .......... 83% 417M 0s 2024-09-12T00:56:18.609 INFO:teuthology.orchestra.run.smithi073.stderr: 77450K .......... .......... .......... .......... .......... 83% 415M 0s 2024-09-12T00:56:18.609 INFO:teuthology.orchestra.run.smithi073.stderr: 77500K .......... .......... .......... .......... .......... 83% 444M 0s 2024-09-12T00:56:18.610 INFO:teuthology.orchestra.run.smithi073.stderr: 77550K .......... .......... .......... .......... .......... 83% 339M 0s 2024-09-12T00:56:18.610 INFO:teuthology.orchestra.run.smithi073.stderr: 77600K .......... .......... .......... .......... .......... 83% 436M 0s 2024-09-12T00:56:18.610 INFO:teuthology.orchestra.run.smithi073.stderr: 77650K .......... .......... .......... .......... .......... 83% 437M 0s 2024-09-12T00:56:18.610 INFO:teuthology.orchestra.run.smithi073.stderr: 77700K .......... .......... .......... .......... .......... 83% 460M 0s 2024-09-12T00:56:18.610 INFO:teuthology.orchestra.run.smithi073.stderr: 77750K .......... .......... .......... .......... .......... 83% 122M 0s 2024-09-12T00:56:18.610 INFO:teuthology.orchestra.run.smithi073.stderr: 77800K .......... .......... .......... .......... .......... 83% 313M 0s 2024-09-12T00:56:18.610 INFO:teuthology.orchestra.run.smithi073.stderr: 77850K .......... .......... .......... .......... .......... 83% 245M 0s 2024-09-12T00:56:18.610 INFO:teuthology.orchestra.run.smithi073.stderr: 77900K .......... .......... .......... .......... .......... 83% 293M 0s 2024-09-12T00:56:18.610 INFO:teuthology.orchestra.run.smithi073.stderr: 77950K .......... .......... .......... .......... .......... 83% 135M 0s 2024-09-12T00:56:18.610 INFO:teuthology.orchestra.run.smithi073.stderr: 78000K .......... .......... .......... .......... .......... 84% 244M 0s 2024-09-12T00:56:18.610 INFO:teuthology.orchestra.run.smithi073.stderr: 78050K .......... .......... .......... .......... .......... 84% 244M 0s 2024-09-12T00:56:18.610 INFO:teuthology.orchestra.run.smithi073.stderr: 78100K .......... .......... .......... .......... .......... 84% 375M 0s 2024-09-12T00:56:18.611 INFO:teuthology.orchestra.run.smithi073.stderr: 78150K .......... .......... .......... .......... .......... 84% 361M 0s 2024-09-12T00:56:18.611 INFO:teuthology.orchestra.run.smithi073.stderr: 78200K .......... .......... .......... .......... .......... 84% 400M 0s 2024-09-12T00:56:18.611 INFO:teuthology.orchestra.run.smithi073.stderr: 78250K .......... .......... .......... .......... .......... 84% 302M 0s 2024-09-12T00:56:18.611 INFO:teuthology.orchestra.run.smithi073.stderr: 78300K .......... .......... .......... .......... .......... 84% 222M 0s 2024-09-12T00:56:18.611 INFO:teuthology.orchestra.run.smithi073.stderr: 78350K .......... .......... .......... .......... .......... 84% 94.1M 0s 2024-09-12T00:56:18.611 INFO:teuthology.orchestra.run.smithi073.stderr: 78400K .......... .......... .......... .......... .......... 84% 275M 0s 2024-09-12T00:56:18.611 INFO:teuthology.orchestra.run.smithi073.stderr: 78450K .......... .......... .......... .......... .......... 84% 415M 0s 2024-09-12T00:56:18.611 INFO:teuthology.orchestra.run.smithi073.stderr: 78500K .......... .......... .......... .......... .......... 84% 422M 0s 2024-09-12T00:56:18.611 INFO:teuthology.orchestra.run.smithi073.stderr: 78550K .......... .......... .......... .......... .......... 84% 219M 0s 2024-09-12T00:56:18.611 INFO:teuthology.orchestra.run.smithi073.stderr: 78600K .......... .......... .......... .......... .......... 84% 390M 0s 2024-09-12T00:56:18.611 INFO:teuthology.orchestra.run.smithi073.stderr: 78650K .......... .......... .......... .......... .......... 84% 243M 0s 2024-09-12T00:56:18.612 INFO:teuthology.orchestra.run.smithi073.stderr: 78700K .......... .......... .......... .......... .......... 84% 51.9M 0s 2024-09-12T00:56:18.612 INFO:teuthology.orchestra.run.smithi073.stderr: 78750K .......... .......... .......... .......... .......... 84% 360M 0s 2024-09-12T00:56:18.612 INFO:teuthology.orchestra.run.smithi073.stderr: 78800K .......... .......... .......... .......... .......... 84% 414M 0s 2024-09-12T00:56:18.612 INFO:teuthology.orchestra.run.smithi073.stderr: 78850K .......... .......... .......... .......... .......... 84% 413M 0s 2024-09-12T00:56:18.612 INFO:teuthology.orchestra.run.smithi073.stderr: 78900K .......... .......... .......... .......... .......... 84% 257M 0s 2024-09-12T00:56:18.612 INFO:teuthology.orchestra.run.smithi073.stderr: 78950K .......... .......... .......... .......... .......... 85% 382M 0s 2024-09-12T00:56:18.612 INFO:teuthology.orchestra.run.smithi073.stderr: 79000K .......... .......... .......... .......... .......... 85% 225M 0s 2024-09-12T00:56:18.612 INFO:teuthology.orchestra.run.smithi073.stderr: 79050K .......... .......... .......... .......... .......... 85% 215M 0s 2024-09-12T00:56:18.612 INFO:teuthology.orchestra.run.smithi073.stderr: 79100K .......... .......... .......... .......... .......... 85% 393M 0s 2024-09-12T00:56:18.612 INFO:teuthology.orchestra.run.smithi073.stderr: 79150K .......... .......... .......... .......... .......... 85% 102M 0s 2024-09-12T00:56:18.612 INFO:teuthology.orchestra.run.smithi073.stderr: 79200K .......... .......... .......... .......... .......... 85% 441M 0s 2024-09-12T00:56:18.612 INFO:teuthology.orchestra.run.smithi073.stderr: 79250K .......... .......... .......... .......... .......... 85% 430M 0s 2024-09-12T00:56:18.613 INFO:teuthology.orchestra.run.smithi073.stderr: 79300K .......... .......... .......... .......... .......... 85% 444M 0s 2024-09-12T00:56:18.613 INFO:teuthology.orchestra.run.smithi073.stderr: 79350K .......... .......... .......... .......... .......... 85% 312M 0s 2024-09-12T00:56:18.613 INFO:teuthology.orchestra.run.smithi073.stderr: 79400K .......... .......... .......... .......... .......... 85% 442M 0s 2024-09-12T00:56:18.613 INFO:teuthology.orchestra.run.smithi073.stderr: 79450K .......... .......... .......... .......... .......... 85% 183M 0s 2024-09-12T00:56:18.613 INFO:teuthology.orchestra.run.smithi073.stderr: 79500K .......... .......... .......... .......... .......... 85% 136M 0s 2024-09-12T00:56:18.613 INFO:teuthology.orchestra.run.smithi073.stderr: 79550K .......... .......... .......... .......... .......... 85% 250M 0s 2024-09-12T00:56:18.613 INFO:teuthology.orchestra.run.smithi073.stderr: 79600K .......... .......... .......... .......... .......... 85% 428M 0s 2024-09-12T00:56:18.613 INFO:teuthology.orchestra.run.smithi073.stderr: 79650K .......... .......... .......... .......... .......... 85% 455M 0s 2024-09-12T00:56:18.613 INFO:teuthology.orchestra.run.smithi073.stderr: 79700K .......... .......... .......... .......... .......... 85% 442M 0s 2024-09-12T00:56:18.613 INFO:teuthology.orchestra.run.smithi073.stderr: 79750K .......... .......... .......... .......... .......... 85% 142M 0s 2024-09-12T00:56:18.613 INFO:teuthology.orchestra.run.smithi073.stderr: 79800K .......... .......... .......... .......... .......... 85% 437M 0s 2024-09-12T00:56:18.613 INFO:teuthology.orchestra.run.smithi073.stderr: 79850K .......... .......... .......... .......... .......... 86% 408M 0s 2024-09-12T00:56:18.614 INFO:teuthology.orchestra.run.smithi073.stderr: 79900K .......... .......... .......... .......... .......... 86% 154M 0s 2024-09-12T00:56:18.614 INFO:teuthology.orchestra.run.smithi073.stderr: 79950K .......... .......... .......... .......... .......... 86% 330M 0s 2024-09-12T00:56:18.614 INFO:teuthology.orchestra.run.smithi073.stderr: 80000K .......... .......... .......... .......... .......... 86% 368M 0s 2024-09-12T00:56:18.614 INFO:teuthology.orchestra.run.smithi073.stderr: 80050K .......... .......... .......... .......... .......... 86% 429M 0s 2024-09-12T00:56:18.614 INFO:teuthology.orchestra.run.smithi073.stderr: 80100K .......... .......... .......... .......... .......... 86% 205M 0s 2024-09-12T00:56:18.614 INFO:teuthology.orchestra.run.smithi073.stderr: 80150K .......... .......... .......... .......... .......... 86% 355M 0s 2024-09-12T00:56:18.614 INFO:teuthology.orchestra.run.smithi073.stderr: 80200K .......... .......... .......... .......... .......... 86% 55.9M 0s 2024-09-12T00:56:18.614 INFO:teuthology.orchestra.run.smithi073.stderr: 80250K .......... .......... .......... .......... .......... 86% 342M 0s 2024-09-12T00:56:18.614 INFO:teuthology.orchestra.run.smithi073.stderr: 80300K .......... .......... .......... .......... .......... 86% 215M 0s 2024-09-12T00:56:18.614 INFO:teuthology.orchestra.run.smithi073.stderr: 80350K .......... .......... .......... .......... .......... 86% 362M 0s 2024-09-12T00:56:18.614 INFO:teuthology.orchestra.run.smithi073.stderr: 80400K .......... .......... .......... .......... .......... 86% 429M 0s 2024-09-12T00:56:18.614 INFO:teuthology.orchestra.run.smithi073.stderr: 80450K .......... .......... .......... .......... .......... 86% 229M 0s 2024-09-12T00:56:18.614 INFO:teuthology.orchestra.run.smithi073.stderr: 80500K .......... .......... .......... .......... .......... 86% 428M 0s 2024-09-12T00:56:18.615 INFO:teuthology.orchestra.run.smithi073.stderr: 80550K .......... .......... .......... .......... .......... 86% 390M 0s 2024-09-12T00:56:18.615 INFO:teuthology.orchestra.run.smithi073.stderr: 80600K .......... .......... .......... .......... .......... 86% 448M 0s 2024-09-12T00:56:18.615 INFO:teuthology.orchestra.run.smithi073.stderr: 80650K .......... .......... .......... .......... .......... 86% 424M 0s 2024-09-12T00:56:18.615 INFO:teuthology.orchestra.run.smithi073.stderr: 80700K .......... .......... .......... .......... .......... 86% 443M 0s 2024-09-12T00:56:18.615 INFO:teuthology.orchestra.run.smithi073.stderr: 80750K .......... .......... .......... .......... .......... 86% 136M 0s 2024-09-12T00:56:18.615 INFO:teuthology.orchestra.run.smithi073.stderr: 80800K .......... .......... .......... .......... .......... 87% 452M 0s 2024-09-12T00:56:18.615 INFO:teuthology.orchestra.run.smithi073.stderr: 80850K .......... .......... .......... .......... .......... 87% 450M 0s 2024-09-12T00:56:18.615 INFO:teuthology.orchestra.run.smithi073.stderr: 80900K .......... .......... .......... .......... .......... 87% 292M 0s 2024-09-12T00:56:18.615 INFO:teuthology.orchestra.run.smithi073.stderr: 80950K .......... .......... .......... .......... .......... 87% 407M 0s 2024-09-12T00:56:18.615 INFO:teuthology.orchestra.run.smithi073.stderr: 81000K .......... .......... .......... .......... .......... 87% 199M 0s 2024-09-12T00:56:18.615 INFO:teuthology.orchestra.run.smithi073.stderr: 81050K .......... .......... .......... .......... .......... 87% 224M 0s 2024-09-12T00:56:18.615 INFO:teuthology.orchestra.run.smithi073.stderr: 81100K .......... .......... .......... .......... .......... 87% 119M 0s 2024-09-12T00:56:18.615 INFO:teuthology.orchestra.run.smithi073.stderr: 81150K .......... .......... .......... .......... .......... 87% 361M 0s 2024-09-12T00:56:18.616 INFO:teuthology.orchestra.run.smithi073.stderr: 81200K .......... .......... .......... .......... .......... 87% 445M 0s 2024-09-12T00:56:18.616 INFO:teuthology.orchestra.run.smithi073.stderr: 81250K .......... .......... .......... .......... .......... 87% 448M 0s 2024-09-12T00:56:18.616 INFO:teuthology.orchestra.run.smithi073.stderr: 81300K .......... .......... .......... .......... .......... 87% 412M 0s 2024-09-12T00:56:18.616 INFO:teuthology.orchestra.run.smithi073.stderr: 81350K .......... .......... .......... .......... .......... 87% 151M 0s 2024-09-12T00:56:18.616 INFO:teuthology.orchestra.run.smithi073.stderr: 81400K .......... .......... .......... .......... .......... 87% 305M 0s 2024-09-12T00:56:18.616 INFO:teuthology.orchestra.run.smithi073.stderr: 81450K .......... .......... .......... .......... .......... 87% 123M 0s 2024-09-12T00:56:18.616 INFO:teuthology.orchestra.run.smithi073.stderr: 81500K .......... .......... .......... .......... .......... 87% 413M 0s 2024-09-12T00:56:18.616 INFO:teuthology.orchestra.run.smithi073.stderr: 81550K .......... .......... .......... .......... .......... 87% 136M 0s 2024-09-12T00:56:18.616 INFO:teuthology.orchestra.run.smithi073.stderr: 81600K .......... .......... .......... .......... .......... 87% 436M 0s 2024-09-12T00:56:18.616 INFO:teuthology.orchestra.run.smithi073.stderr: 81650K .......... .......... .......... .......... .......... 87% 434M 0s 2024-09-12T00:56:18.616 INFO:teuthology.orchestra.run.smithi073.stderr: 81700K .......... .......... .......... .......... .......... 87% 378M 0s 2024-09-12T00:56:18.616 INFO:teuthology.orchestra.run.smithi073.stderr: 81750K .......... .......... .......... .......... .......... 88% 52.1M 0s 2024-09-12T00:56:18.616 INFO:teuthology.orchestra.run.smithi073.stderr: 81800K .......... .......... .......... .......... .......... 88% 360M 0s 2024-09-12T00:56:18.617 INFO:teuthology.orchestra.run.smithi073.stderr: 81850K .......... .......... .......... .......... .......... 88% 247M 0s 2024-09-12T00:56:18.617 INFO:teuthology.orchestra.run.smithi073.stderr: 81900K .......... .......... .......... .......... .......... 88% 400M 0s 2024-09-12T00:56:18.617 INFO:teuthology.orchestra.run.smithi073.stderr: 81950K .......... .......... .......... .......... .......... 88% 361M 0s 2024-09-12T00:56:18.617 INFO:teuthology.orchestra.run.smithi073.stderr: 82000K .......... .......... .......... .......... .......... 88% 249M 0s 2024-09-12T00:56:18.617 INFO:teuthology.orchestra.run.smithi073.stderr: 82050K .......... .......... .......... .......... .......... 88% 438M 0s 2024-09-12T00:56:18.617 INFO:teuthology.orchestra.run.smithi073.stderr: 82100K .......... .......... .......... .......... .......... 88% 167M 0s 2024-09-12T00:56:18.617 INFO:teuthology.orchestra.run.smithi073.stderr: 82150K .......... .......... .......... .......... .......... 88% 392M 0s 2024-09-12T00:56:18.617 INFO:teuthology.orchestra.run.smithi073.stderr: 82200K .......... .......... .......... .......... .......... 88% 115M 0s 2024-09-12T00:56:18.617 INFO:teuthology.orchestra.run.smithi073.stderr: 82250K .......... .......... .......... .......... .......... 88% 423M 0s 2024-09-12T00:56:18.617 INFO:teuthology.orchestra.run.smithi073.stderr: 82300K .......... .......... .......... .......... .......... 88% 213M 0s 2024-09-12T00:56:18.617 INFO:teuthology.orchestra.run.smithi073.stderr: 82350K .......... .......... .......... .......... .......... 88% 184M 0s 2024-09-12T00:56:18.618 INFO:teuthology.orchestra.run.smithi073.stderr: 82400K .......... .......... .......... .......... .......... 88% 339M 0s 2024-09-12T00:56:18.618 INFO:teuthology.orchestra.run.smithi073.stderr: 82450K .......... .......... .......... .......... .......... 88% 422M 0s 2024-09-12T00:56:18.618 INFO:teuthology.orchestra.run.smithi073.stderr: 82500K .......... .......... .......... .......... .......... 88% 428M 0s 2024-09-12T00:56:18.618 INFO:teuthology.orchestra.run.smithi073.stderr: 82550K .......... .......... .......... .......... .......... 88% 271M 0s 2024-09-12T00:56:18.618 INFO:teuthology.orchestra.run.smithi073.stderr: 82600K .......... .......... .......... .......... .......... 88% 432M 0s 2024-09-12T00:56:18.618 INFO:teuthology.orchestra.run.smithi073.stderr: 82650K .......... .......... .......... .......... .......... 89% 160M 0s 2024-09-12T00:56:18.618 INFO:teuthology.orchestra.run.smithi073.stderr: 82700K .......... .......... .......... .......... .......... 89% 362M 0s 2024-09-12T00:56:18.618 INFO:teuthology.orchestra.run.smithi073.stderr: 82750K .......... .......... .......... .......... .......... 89% 366M 0s 2024-09-12T00:56:18.618 INFO:teuthology.orchestra.run.smithi073.stderr: 82800K .......... .......... .......... .......... .......... 89% 343M 0s 2024-09-12T00:56:18.618 INFO:teuthology.orchestra.run.smithi073.stderr: 82850K .......... .......... .......... .......... .......... 89% 302M 0s 2024-09-12T00:56:18.618 INFO:teuthology.orchestra.run.smithi073.stderr: 82900K .......... .......... .......... .......... .......... 89% 287M 0s 2024-09-12T00:56:18.618 INFO:teuthology.orchestra.run.smithi073.stderr: 82950K .......... .......... .......... .......... .......... 89% 126M 0s 2024-09-12T00:56:18.619 INFO:teuthology.orchestra.run.smithi073.stderr: 83000K .......... .......... .......... .......... .......... 89% 225M 0s 2024-09-12T00:56:18.619 INFO:teuthology.orchestra.run.smithi073.stderr: 83050K .......... .......... .......... .......... .......... 89% 427M 0s 2024-09-12T00:56:18.619 INFO:teuthology.orchestra.run.smithi073.stderr: 83100K .......... .......... .......... .......... .......... 89% 420M 0s 2024-09-12T00:56:18.619 INFO:teuthology.orchestra.run.smithi073.stderr: 83150K .......... .......... .......... .......... .......... 89% 373M 0s 2024-09-12T00:56:18.619 INFO:teuthology.orchestra.run.smithi073.stderr: 83200K .......... .......... .......... .......... .......... 89% 440M 0s 2024-09-12T00:56:18.619 INFO:teuthology.orchestra.run.smithi073.stderr: 83250K .......... .......... .......... .......... .......... 89% 56.0M 0s 2024-09-12T00:56:18.619 INFO:teuthology.orchestra.run.smithi073.stderr: 83300K .......... .......... .......... .......... .......... 89% 235M 0s 2024-09-12T00:56:18.619 INFO:teuthology.orchestra.run.smithi073.stderr: 83350K .......... .......... .......... .......... .......... 89% 166M 0s 2024-09-12T00:56:18.619 INFO:teuthology.orchestra.run.smithi073.stderr: 83400K .......... .......... .......... .......... .......... 89% 294M 0s 2024-09-12T00:56:18.619 INFO:teuthology.orchestra.run.smithi073.stderr: 83450K .......... .......... .......... .......... .......... 89% 422M 0s 2024-09-12T00:56:18.619 INFO:teuthology.orchestra.run.smithi073.stderr: 83500K .......... .......... .......... .......... .......... 89% 443M 0s 2024-09-12T00:56:18.619 INFO:teuthology.orchestra.run.smithi073.stderr: 83550K .......... .......... .......... .......... .......... 89% 368M 0s 2024-09-12T00:56:18.620 INFO:teuthology.orchestra.run.smithi073.stderr: 83600K .......... .......... .......... .......... .......... 90% 166M 0s 2024-09-12T00:56:18.620 INFO:teuthology.orchestra.run.smithi073.stderr: 83650K .......... .......... .......... .......... .......... 90% 375M 0s 2024-09-12T00:56:18.620 INFO:teuthology.orchestra.run.smithi073.stderr: 83700K .......... .......... .......... .......... .......... 90% 426M 0s 2024-09-12T00:56:18.620 INFO:teuthology.orchestra.run.smithi073.stderr: 83750K .......... .......... .......... .......... .......... 90% 408M 0s 2024-09-12T00:56:18.620 INFO:teuthology.orchestra.run.smithi073.stderr: 83800K .......... .......... .......... .......... .......... 90% 351M 0s 2024-09-12T00:56:18.620 INFO:teuthology.orchestra.run.smithi073.stderr: 83850K .......... .......... .......... .......... .......... 90% 239M 0s 2024-09-12T00:56:18.620 INFO:teuthology.orchestra.run.smithi073.stderr: 83900K .......... .......... .......... .......... .......... 90% 423M 0s 2024-09-12T00:56:18.620 INFO:teuthology.orchestra.run.smithi073.stderr: 83950K .......... .......... .......... .......... .......... 90% 147M 0s 2024-09-12T00:56:18.620 INFO:teuthology.orchestra.run.smithi073.stderr: 84000K .......... .......... .......... .......... .......... 90% 420M 0s 2024-09-12T00:56:18.620 INFO:teuthology.orchestra.run.smithi073.stderr: 84050K .......... .......... .......... .......... .......... 90% 384M 0s 2024-09-12T00:56:18.620 INFO:teuthology.orchestra.run.smithi073.stderr: 84100K .......... .......... .......... .......... .......... 90% 444M 0s 2024-09-12T00:56:18.620 INFO:teuthology.orchestra.run.smithi073.stderr: 84150K .......... .......... .......... .......... .......... 90% 105M 0s 2024-09-12T00:56:18.621 INFO:teuthology.orchestra.run.smithi073.stderr: 84200K .......... .......... .......... .......... .......... 90% 421M 0s 2024-09-12T00:56:18.621 INFO:teuthology.orchestra.run.smithi073.stderr: 84250K .......... .......... .......... .......... .......... 90% 300M 0s 2024-09-12T00:56:18.621 INFO:teuthology.orchestra.run.smithi073.stderr: 84300K .......... .......... .......... .......... .......... 90% 430M 0s 2024-09-12T00:56:18.621 INFO:teuthology.orchestra.run.smithi073.stderr: 84350K .......... .......... .......... .......... .......... 90% 166M 0s 2024-09-12T00:56:18.621 INFO:teuthology.orchestra.run.smithi073.stderr: 84400K .......... .......... .......... .......... .......... 90% 419M 0s 2024-09-12T00:56:18.621 INFO:teuthology.orchestra.run.smithi073.stderr: 84450K .......... .......... .......... .......... .......... 90% 439M 0s 2024-09-12T00:56:18.621 INFO:teuthology.orchestra.run.smithi073.stderr: 84500K .......... .......... .......... .......... .......... 91% 358M 0s 2024-09-12T00:56:18.621 INFO:teuthology.orchestra.run.smithi073.stderr: 84550K .......... .......... .......... .......... .......... 91% 148M 0s 2024-09-12T00:56:18.621 INFO:teuthology.orchestra.run.smithi073.stderr: 84600K .......... .......... .......... .......... .......... 91% 160M 0s 2024-09-12T00:56:18.621 INFO:teuthology.orchestra.run.smithi073.stderr: 84650K .......... .......... .......... .......... .......... 91% 276M 0s 2024-09-12T00:56:18.621 INFO:teuthology.orchestra.run.smithi073.stderr: 84700K .......... .......... .......... .......... .......... 91% 426M 0s 2024-09-12T00:56:18.622 INFO:teuthology.orchestra.run.smithi073.stderr: 84750K .......... .......... .......... .......... .......... 91% 152M 0s 2024-09-12T00:56:18.622 INFO:teuthology.orchestra.run.smithi073.stderr: 84800K .......... .......... .......... .......... .......... 91% 66.9M 0s 2024-09-12T00:56:18.622 INFO:teuthology.orchestra.run.smithi073.stderr: 84850K .......... .......... .......... .......... .......... 91% 379M 0s 2024-09-12T00:56:18.622 INFO:teuthology.orchestra.run.smithi073.stderr: 84900K .......... .......... .......... .......... .......... 91% 220M 0s 2024-09-12T00:56:18.622 INFO:teuthology.orchestra.run.smithi073.stderr: 84950K .......... .......... .......... .......... .......... 91% 395M 0s 2024-09-12T00:56:18.622 INFO:teuthology.orchestra.run.smithi073.stderr: 85000K .......... .......... .......... .......... .......... 91% 440M 0s 2024-09-12T00:56:18.622 INFO:teuthology.orchestra.run.smithi073.stderr: 85050K .......... .......... .......... .......... .......... 91% 247M 0s 2024-09-12T00:56:18.622 INFO:teuthology.orchestra.run.smithi073.stderr: 85100K .......... .......... .......... .......... .......... 91% 295M 0s 2024-09-12T00:56:18.622 INFO:teuthology.orchestra.run.smithi073.stderr: 85150K .......... .......... .......... .......... .......... 91% 286M 0s 2024-09-12T00:56:18.622 INFO:teuthology.orchestra.run.smithi073.stderr: 85200K .......... .......... .......... .......... .......... 91% 286M 0s 2024-09-12T00:56:18.622 INFO:teuthology.orchestra.run.smithi073.stderr: 85250K .......... .......... .......... .......... .......... 91% 134M 0s 2024-09-12T00:56:18.622 INFO:teuthology.orchestra.run.smithi073.stderr: 85300K .......... .......... .......... .......... .......... 91% 95.7M 0s 2024-09-12T00:56:18.623 INFO:teuthology.orchestra.run.smithi073.stderr: 85350K .......... .......... .......... .......... .......... 91% 362M 0s 2024-09-12T00:56:18.623 INFO:teuthology.orchestra.run.smithi073.stderr: 85400K .......... .......... .......... .......... .......... 91% 399M 0s 2024-09-12T00:56:18.623 INFO:teuthology.orchestra.run.smithi073.stderr: 85450K .......... .......... .......... .......... .......... 92% 150M 0s 2024-09-12T00:56:18.623 INFO:teuthology.orchestra.run.smithi073.stderr: 85500K .......... .......... .......... .......... .......... 92% 427M 0s 2024-09-12T00:56:18.623 INFO:teuthology.orchestra.run.smithi073.stderr: 85550K .......... .......... .......... .......... .......... 92% 355M 0s 2024-09-12T00:56:18.623 INFO:teuthology.orchestra.run.smithi073.stderr: 85600K .......... .......... .......... .......... .......... 92% 404M 0s 2024-09-12T00:56:18.623 INFO:teuthology.orchestra.run.smithi073.stderr: 85650K .......... .......... .......... .......... .......... 92% 440M 0s 2024-09-12T00:56:18.623 INFO:teuthology.orchestra.run.smithi073.stderr: 85700K .......... .......... .......... .......... .......... 92% 433M 0s 2024-09-12T00:56:18.623 INFO:teuthology.orchestra.run.smithi073.stderr: 85750K .......... .......... .......... .......... .......... 92% 208M 0s 2024-09-12T00:56:18.624 INFO:teuthology.orchestra.run.smithi073.stderr: 85800K .......... .......... .......... .......... .......... 92% 419M 0s 2024-09-12T00:56:18.624 INFO:teuthology.orchestra.run.smithi073.stderr: 85850K .......... .......... .......... .......... .......... 92% 436M 0s 2024-09-12T00:56:18.624 INFO:teuthology.orchestra.run.smithi073.stderr: 85900K .......... .......... .......... .......... .......... 92% 177M 0s 2024-09-12T00:56:18.624 INFO:teuthology.orchestra.run.smithi073.stderr: 85950K .......... .......... .......... .......... .......... 92% 336M 0s 2024-09-12T00:56:18.624 INFO:teuthology.orchestra.run.smithi073.stderr: 86000K .......... .......... .......... .......... .......... 92% 184M 0s 2024-09-12T00:56:18.624 INFO:teuthology.orchestra.run.smithi073.stderr: 86050K .......... .......... .......... .......... .......... 92% 230M 0s 2024-09-12T00:56:18.624 INFO:teuthology.orchestra.run.smithi073.stderr: 86100K .......... .......... .......... .......... .......... 92% 451M 0s 2024-09-12T00:56:18.624 INFO:teuthology.orchestra.run.smithi073.stderr: 86150K .......... .......... .......... .......... .......... 92% 226M 0s 2024-09-12T00:56:18.624 INFO:teuthology.orchestra.run.smithi073.stderr: 86200K .......... .......... .......... .......... .......... 92% 414M 0s 2024-09-12T00:56:18.624 INFO:teuthology.orchestra.run.smithi073.stderr: 86250K .......... .......... .......... .......... .......... 92% 67.9M 0s 2024-09-12T00:56:18.624 INFO:teuthology.orchestra.run.smithi073.stderr: 86300K .......... .......... .......... .......... .......... 92% 425M 0s 2024-09-12T00:56:18.625 INFO:teuthology.orchestra.run.smithi073.stderr: 86350K .......... .......... .......... .......... .......... 93% 300M 0s 2024-09-12T00:56:18.625 INFO:teuthology.orchestra.run.smithi073.stderr: 86400K .......... .......... .......... .......... .......... 93% 231M 0s 2024-09-12T00:56:18.625 INFO:teuthology.orchestra.run.smithi073.stderr: 86450K .......... .......... .......... .......... .......... 93% 75.4M 0s 2024-09-12T00:56:18.625 INFO:teuthology.orchestra.run.smithi073.stderr: 86500K .......... .......... .......... .......... .......... 93% 298M 0s 2024-09-12T00:56:18.625 INFO:teuthology.orchestra.run.smithi073.stderr: 86550K .......... .......... .......... .......... .......... 93% 397M 0s 2024-09-12T00:56:18.625 INFO:teuthology.orchestra.run.smithi073.stderr: 86600K .......... .......... .......... .......... .......... 93% 435M 0s 2024-09-12T00:56:18.625 INFO:teuthology.orchestra.run.smithi073.stderr: 86650K .......... .......... .......... .......... .......... 93% 440M 0s 2024-09-12T00:56:18.625 INFO:teuthology.orchestra.run.smithi073.stderr: 86700K .......... .......... .......... .......... .......... 93% 437M 0s 2024-09-12T00:56:18.625 INFO:teuthology.orchestra.run.smithi073.stderr: 86750K .......... .......... .......... .......... .......... 93% 339M 0s 2024-09-12T00:56:18.625 INFO:teuthology.orchestra.run.smithi073.stderr: 86800K .......... .......... .......... .......... .......... 93% 436M 0s 2024-09-12T00:56:18.625 INFO:teuthology.orchestra.run.smithi073.stderr: 86850K .......... .......... .......... .......... .......... 93% 445M 0s 2024-09-12T00:56:18.625 INFO:teuthology.orchestra.run.smithi073.stderr: 86900K .......... .......... .......... .......... .......... 93% 421M 0s 2024-09-12T00:56:18.626 INFO:teuthology.orchestra.run.smithi073.stderr: 86950K .......... .......... .......... .......... .......... 93% 385M 0s 2024-09-12T00:56:18.626 INFO:teuthology.orchestra.run.smithi073.stderr: 87000K .......... .......... .......... .......... .......... 93% 151M 0s 2024-09-12T00:56:18.626 INFO:teuthology.orchestra.run.smithi073.stderr: 87050K .......... .......... .......... .......... .......... 93% 252M 0s 2024-09-12T00:56:18.626 INFO:teuthology.orchestra.run.smithi073.stderr: 87100K .......... .......... .......... .......... .......... 93% 436M 0s 2024-09-12T00:56:18.626 INFO:teuthology.orchestra.run.smithi073.stderr: 87150K .......... .......... .......... .......... .......... 93% 168M 0s 2024-09-12T00:56:18.626 INFO:teuthology.orchestra.run.smithi073.stderr: 87200K .......... .......... .......... .......... .......... 93% 404M 0s 2024-09-12T00:56:18.626 INFO:teuthology.orchestra.run.smithi073.stderr: 87250K .......... .......... .......... .......... .......... 93% 143M 0s 2024-09-12T00:56:18.626 INFO:teuthology.orchestra.run.smithi073.stderr: 87300K .......... .......... .......... .......... .......... 94% 398M 0s 2024-09-12T00:56:18.626 INFO:teuthology.orchestra.run.smithi073.stderr: 87350K .......... .......... .......... .......... .......... 94% 392M 0s 2024-09-12T00:56:18.626 INFO:teuthology.orchestra.run.smithi073.stderr: 87400K .......... .......... .......... .......... .......... 94% 265M 0s 2024-09-12T00:56:18.626 INFO:teuthology.orchestra.run.smithi073.stderr: 87450K .......... .......... .......... .......... .......... 94% 288M 0s 2024-09-12T00:56:18.627 INFO:teuthology.orchestra.run.smithi073.stderr: 87500K .......... .......... .......... .......... .......... 94% 433M 0s 2024-09-12T00:56:18.627 INFO:teuthology.orchestra.run.smithi073.stderr: 87550K .......... .......... .......... .......... .......... 94% 355M 0s 2024-09-12T00:56:18.627 INFO:teuthology.orchestra.run.smithi073.stderr: 87600K .......... .......... .......... .......... .......... 94% 441M 0s 2024-09-12T00:56:18.627 INFO:teuthology.orchestra.run.smithi073.stderr: 87650K .......... .......... .......... .......... .......... 94% 78.7M 0s 2024-09-12T00:56:18.627 INFO:teuthology.orchestra.run.smithi073.stderr: 87700K .......... .......... .......... .......... .......... 94% 426M 0s 2024-09-12T00:56:18.627 INFO:teuthology.orchestra.run.smithi073.stderr: 87750K .......... .......... .......... .......... .......... 94% 393M 0s 2024-09-12T00:56:18.627 INFO:teuthology.orchestra.run.smithi073.stderr: 87800K .......... .......... .......... .......... .......... 94% 451M 0s 2024-09-12T00:56:18.627 INFO:teuthology.orchestra.run.smithi073.stderr: 87850K .......... .......... .......... .......... .......... 94% 67.9M 0s 2024-09-12T00:56:18.627 INFO:teuthology.orchestra.run.smithi073.stderr: 87900K .......... .......... .......... .......... .......... 94% 403M 0s 2024-09-12T00:56:18.627 INFO:teuthology.orchestra.run.smithi073.stderr: 87950K .......... .......... .......... .......... .......... 94% 229M 0s 2024-09-12T00:56:18.627 INFO:teuthology.orchestra.run.smithi073.stderr: 88000K .......... .......... .......... .......... .......... 94% 419M 0s 2024-09-12T00:56:18.628 INFO:teuthology.orchestra.run.smithi073.stderr: 88050K .......... .......... .......... .......... .......... 94% 349M 0s 2024-09-12T00:56:18.628 INFO:teuthology.orchestra.run.smithi073.stderr: 88100K .......... .......... .......... .......... .......... 94% 126M 0s 2024-09-12T00:56:18.628 INFO:teuthology.orchestra.run.smithi073.stderr: 88150K .......... .......... .......... .......... .......... 94% 182M 0s 2024-09-12T00:56:18.628 INFO:teuthology.orchestra.run.smithi073.stderr: 88200K .......... .......... .......... .......... .......... 94% 410M 0s 2024-09-12T00:56:18.628 INFO:teuthology.orchestra.run.smithi073.stderr: 88250K .......... .......... .......... .......... .......... 95% 442M 0s 2024-09-12T00:56:18.628 INFO:teuthology.orchestra.run.smithi073.stderr: 88300K .......... .......... .......... .......... .......... 95% 431M 0s 2024-09-12T00:56:18.628 INFO:teuthology.orchestra.run.smithi073.stderr: 88350K .......... .......... .......... .......... .......... 95% 87.6M 0s 2024-09-12T00:56:18.628 INFO:teuthology.orchestra.run.smithi073.stderr: 88400K .......... .......... .......... .......... .......... 95% 149M 0s 2024-09-12T00:56:18.628 INFO:teuthology.orchestra.run.smithi073.stderr: 88450K .......... .......... .......... .......... .......... 95% 300M 0s 2024-09-12T00:56:18.628 INFO:teuthology.orchestra.run.smithi073.stderr: 88500K .......... .......... .......... .......... .......... 95% 421M 0s 2024-09-12T00:56:18.628 INFO:teuthology.orchestra.run.smithi073.stderr: 88550K .......... .......... .......... .......... .......... 95% 367M 0s 2024-09-12T00:56:18.629 INFO:teuthology.orchestra.run.smithi073.stderr: 88600K .......... .......... .......... .......... .......... 95% 444M 0s 2024-09-12T00:56:18.629 INFO:teuthology.orchestra.run.smithi073.stderr: 88650K .......... .......... .......... .......... .......... 95% 441M 0s 2024-09-12T00:56:18.629 INFO:teuthology.orchestra.run.smithi073.stderr: 88700K .......... .......... .......... .......... .......... 95% 284M 0s 2024-09-12T00:56:18.629 INFO:teuthology.orchestra.run.smithi073.stderr: 88750K .......... .......... .......... .......... .......... 95% 238M 0s 2024-09-12T00:56:18.629 INFO:teuthology.orchestra.run.smithi073.stderr: 88800K .......... .......... .......... .......... .......... 95% 336M 0s 2024-09-12T00:56:18.629 INFO:teuthology.orchestra.run.smithi073.stderr: 88850K .......... .......... .......... .......... .......... 95% 430M 0s 2024-09-12T00:56:18.629 INFO:teuthology.orchestra.run.smithi073.stderr: 88900K .......... .......... .......... .......... .......... 95% 427M 0s 2024-09-12T00:56:18.629 INFO:teuthology.orchestra.run.smithi073.stderr: 88950K .......... .......... .......... .......... .......... 95% 116M 0s 2024-09-12T00:56:18.629 INFO:teuthology.orchestra.run.smithi073.stderr: 89000K .......... .......... .......... .......... .......... 95% 436M 0s 2024-09-12T00:56:18.629 INFO:teuthology.orchestra.run.smithi073.stderr: 89050K .......... .......... .......... .......... .......... 95% 403M 0s 2024-09-12T00:56:18.629 INFO:teuthology.orchestra.run.smithi073.stderr: 89100K .......... .......... .......... .......... .......... 95% 441M 0s 2024-09-12T00:56:18.629 INFO:teuthology.orchestra.run.smithi073.stderr: 89150K .......... .......... .......... .......... .......... 96% 172M 0s 2024-09-12T00:56:18.630 INFO:teuthology.orchestra.run.smithi073.stderr: 89200K .......... .......... .......... .......... .......... 96% 160M 0s 2024-09-12T00:56:18.630 INFO:teuthology.orchestra.run.smithi073.stderr: 89250K .......... .......... .......... .......... .......... 96% 424M 0s 2024-09-12T00:56:18.630 INFO:teuthology.orchestra.run.smithi073.stderr: 89300K .......... .......... .......... .......... .......... 96% 70.6M 0s 2024-09-12T00:56:18.630 INFO:teuthology.orchestra.run.smithi073.stderr: 89350K .......... .......... .......... .......... .......... 96% 246M 0s 2024-09-12T00:56:18.630 INFO:teuthology.orchestra.run.smithi073.stderr: 89400K .......... .......... .......... .......... .......... 96% 450M 0s 2024-09-12T00:56:18.630 INFO:teuthology.orchestra.run.smithi073.stderr: 89450K .......... .......... .......... .......... .......... 96% 310M 0s 2024-09-12T00:56:18.630 INFO:teuthology.orchestra.run.smithi073.stderr: 89500K .......... .......... .......... .......... .......... 96% 76.5M 0s 2024-09-12T00:56:18.630 INFO:teuthology.orchestra.run.smithi073.stderr: 89550K .......... .......... .......... .......... .......... 96% 126M 0s 2024-09-12T00:56:18.630 INFO:teuthology.orchestra.run.smithi073.stderr: 89600K .......... .......... .......... .......... .......... 96% 403M 0s 2024-09-12T00:56:18.630 INFO:teuthology.orchestra.run.smithi073.stderr: 89650K .......... .......... .......... .......... .......... 96% 388M 0s 2024-09-12T00:56:18.631 INFO:teuthology.orchestra.run.smithi073.stderr: 89700K .......... .......... .......... .......... .......... 96% 391M 0s 2024-09-12T00:56:18.631 INFO:teuthology.orchestra.run.smithi073.stderr: 89750K .......... .......... .......... .......... .......... 96% 387M 0s 2024-09-12T00:56:18.631 INFO:teuthology.orchestra.run.smithi073.stderr: 89800K .......... .......... .......... .......... .......... 96% 438M 0s 2024-09-12T00:56:18.631 INFO:teuthology.orchestra.run.smithi073.stderr: 89850K .......... .......... .......... .......... .......... 96% 436M 0s 2024-09-12T00:56:18.631 INFO:teuthology.orchestra.run.smithi073.stderr: 89900K .......... .......... .......... .......... .......... 96% 419M 0s 2024-09-12T00:56:18.631 INFO:teuthology.orchestra.run.smithi073.stderr: 89950K .......... .......... .......... .......... .......... 96% 359M 0s 2024-09-12T00:56:18.631 INFO:teuthology.orchestra.run.smithi073.stderr: 90000K .......... .......... .......... .......... .......... 96% 427M 0s 2024-09-12T00:56:18.631 INFO:teuthology.orchestra.run.smithi073.stderr: 90050K .......... .......... .......... .......... .......... 96% 379M 0s 2024-09-12T00:56:18.631 INFO:teuthology.orchestra.run.smithi073.stderr: 90100K .......... .......... .......... .......... .......... 97% 420M 0s 2024-09-12T00:56:18.631 INFO:teuthology.orchestra.run.smithi073.stderr: 90150K .......... .......... .......... .......... .......... 97% 85.2M 0s 2024-09-12T00:56:18.631 INFO:teuthology.orchestra.run.smithi073.stderr: 90200K .......... .......... .......... .......... .......... 97% 421M 0s 2024-09-12T00:56:18.632 INFO:teuthology.orchestra.run.smithi073.stderr: 90250K .......... .......... .......... .......... .......... 97% 426M 0s 2024-09-12T00:56:18.632 INFO:teuthology.orchestra.run.smithi073.stderr: 90300K .......... .......... .......... .......... .......... 97% 426M 0s 2024-09-12T00:56:18.632 INFO:teuthology.orchestra.run.smithi073.stderr: 90350K .......... .......... .......... .......... .......... 97% 347M 0s 2024-09-12T00:56:18.632 INFO:teuthology.orchestra.run.smithi073.stderr: 90400K .......... .......... .......... .......... .......... 97% 358M 0s 2024-09-12T00:56:18.632 INFO:teuthology.orchestra.run.smithi073.stderr: 90450K .......... .......... .......... .......... .......... 97% 92.1M 0s 2024-09-12T00:56:18.632 INFO:teuthology.orchestra.run.smithi073.stderr: 90500K .......... .......... .......... .......... .......... 97% 424M 0s 2024-09-12T00:56:18.632 INFO:teuthology.orchestra.run.smithi073.stderr: 90550K .......... .......... .......... .......... .......... 97% 284M 0s 2024-09-12T00:56:18.632 INFO:teuthology.orchestra.run.smithi073.stderr: 90600K .......... .......... .......... .......... .......... 97% 437M 0s 2024-09-12T00:56:18.632 INFO:teuthology.orchestra.run.smithi073.stderr: 90650K .......... .......... .......... .......... .......... 97% 406M 0s 2024-09-12T00:56:18.632 INFO:teuthology.orchestra.run.smithi073.stderr: 90700K .......... .......... .......... .......... .......... 97% 423M 0s 2024-09-12T00:56:18.632 INFO:teuthology.orchestra.run.smithi073.stderr: 90750K .......... .......... .......... .......... .......... 97% 242M 0s 2024-09-12T00:56:18.633 INFO:teuthology.orchestra.run.smithi073.stderr: 90800K .......... .......... .......... .......... .......... 97% 365M 0s 2024-09-12T00:56:18.633 INFO:teuthology.orchestra.run.smithi073.stderr: 90850K .......... .......... .......... .......... .......... 97% 391M 0s 2024-09-12T00:56:18.633 INFO:teuthology.orchestra.run.smithi073.stderr: 90900K .......... .......... .......... .......... .......... 97% 80.9M 0s 2024-09-12T00:56:18.633 INFO:teuthology.orchestra.run.smithi073.stderr: 90950K .......... .......... .......... .......... .......... 97% 320M 0s 2024-09-12T00:56:18.633 INFO:teuthology.orchestra.run.smithi073.stderr: 91000K .......... .......... .......... .......... .......... 98% 420M 0s 2024-09-12T00:56:18.633 INFO:teuthology.orchestra.run.smithi073.stderr: 91050K .......... .......... .......... .......... .......... 98% 445M 0s 2024-09-12T00:56:18.633 INFO:teuthology.orchestra.run.smithi073.stderr: 91100K .......... .......... .......... .......... .......... 98% 253M 0s 2024-09-12T00:56:18.633 INFO:teuthology.orchestra.run.smithi073.stderr: 91150K .......... .......... .......... .......... .......... 98% 155M 0s 2024-09-12T00:56:18.633 INFO:teuthology.orchestra.run.smithi073.stderr: 91200K .......... .......... .......... .......... .......... 98% 122M 0s 2024-09-12T00:56:18.633 INFO:teuthology.orchestra.run.smithi073.stderr: 91250K .......... .......... .......... .......... .......... 98% 435M 0s 2024-09-12T00:56:18.633 INFO:teuthology.orchestra.run.smithi073.stderr: 91300K .......... .......... .......... .......... .......... 98% 271M 0s 2024-09-12T00:56:18.634 INFO:teuthology.orchestra.run.smithi073.stderr: 91350K .......... .......... .......... .......... .......... 98% 382M 0s 2024-09-12T00:56:18.634 INFO:teuthology.orchestra.run.smithi073.stderr: 91400K .......... .......... .......... .......... .......... 98% 149M 0s 2024-09-12T00:56:18.634 INFO:teuthology.orchestra.run.smithi073.stderr: 91450K .......... .......... .......... .......... .......... 98% 308M 0s 2024-09-12T00:56:18.634 INFO:teuthology.orchestra.run.smithi073.stderr: 91500K .......... .......... .......... .......... .......... 98% 159M 0s 2024-09-12T00:56:18.634 INFO:teuthology.orchestra.run.smithi073.stderr: 91550K .......... .......... .......... .......... .......... 98% 115M 0s 2024-09-12T00:56:18.634 INFO:teuthology.orchestra.run.smithi073.stderr: 91600K .......... .......... .......... .......... .......... 98% 412M 0s 2024-09-12T00:56:18.634 INFO:teuthology.orchestra.run.smithi073.stderr: 91650K .......... .......... .......... .......... .......... 98% 430M 0s 2024-09-12T00:56:18.634 INFO:teuthology.orchestra.run.smithi073.stderr: 91700K .......... .......... .......... .......... .......... 98% 389M 0s 2024-09-12T00:56:18.634 INFO:teuthology.orchestra.run.smithi073.stderr: 91750K .......... .......... .......... .......... .......... 98% 364M 0s 2024-09-12T00:56:18.634 INFO:teuthology.orchestra.run.smithi073.stderr: 91800K .......... .......... .......... .......... .......... 98% 416M 0s 2024-09-12T00:56:18.634 INFO:teuthology.orchestra.run.smithi073.stderr: 91850K .......... .......... .......... .......... .......... 98% 106M 0s 2024-09-12T00:56:18.635 INFO:teuthology.orchestra.run.smithi073.stderr: 91900K .......... .......... .......... .......... .......... 98% 270M 0s 2024-09-12T00:56:18.635 INFO:teuthology.orchestra.run.smithi073.stderr: 91950K .......... .......... .......... .......... .......... 99% 363M 0s 2024-09-12T00:56:18.635 INFO:teuthology.orchestra.run.smithi073.stderr: 92000K .......... .......... .......... .......... .......... 99% 444M 0s 2024-09-12T00:56:18.635 INFO:teuthology.orchestra.run.smithi073.stderr: 92050K .......... .......... .......... .......... .......... 99% 177M 0s 2024-09-12T00:56:18.635 INFO:teuthology.orchestra.run.smithi073.stderr: 92100K .......... .......... .......... .......... .......... 99% 421M 0s 2024-09-12T00:56:18.635 INFO:teuthology.orchestra.run.smithi073.stderr: 92150K .......... .......... .......... .......... .......... 99% 419M 0s 2024-09-12T00:56:18.635 INFO:teuthology.orchestra.run.smithi073.stderr: 92200K .......... .......... .......... .......... .......... 99% 392M 0s 2024-09-12T00:56:18.635 INFO:teuthology.orchestra.run.smithi073.stderr: 92250K .......... .......... .......... .......... .......... 99% 446M 0s 2024-09-12T00:56:18.635 INFO:teuthology.orchestra.run.smithi073.stderr: 92300K .......... .......... .......... .......... .......... 99% 431M 0s 2024-09-12T00:56:18.635 INFO:teuthology.orchestra.run.smithi073.stderr: 92350K .......... .......... .......... .......... .......... 99% 51.7M 0s 2024-09-12T00:56:18.635 INFO:teuthology.orchestra.run.smithi073.stderr: 92400K .......... .......... .......... .......... .......... 99% 402M 0s 2024-09-12T00:56:18.635 INFO:teuthology.orchestra.run.smithi073.stderr: 92450K .......... .......... .......... .......... .......... 99% 435M 0s 2024-09-12T00:56:18.636 INFO:teuthology.orchestra.run.smithi073.stderr: 92500K .......... .......... .......... .......... .......... 99% 425M 0s 2024-09-12T00:56:18.636 INFO:teuthology.orchestra.run.smithi073.stderr: 92550K .......... .......... .......... .......... .......... 99% 89.4M 0s 2024-09-12T00:56:18.636 INFO:teuthology.orchestra.run.smithi073.stderr: 92600K .......... .......... .......... .......... .......... 99% 95.4M 0s 2024-09-12T00:56:18.636 INFO:teuthology.orchestra.run.smithi073.stderr: 92650K .......... .......... .......... .......... .......... 99% 398M 0s 2024-09-12T00:56:18.636 INFO:teuthology.orchestra.run.smithi073.stderr: 92700K .......... .......... .......... .......... .......... 99% 423M 0s 2024-09-12T00:56:18.636 INFO:teuthology.orchestra.run.smithi073.stderr: 92750K .......... .......... .......... .......... .......... 99% 128M 0s 2024-09-12T00:56:18.636 INFO:teuthology.orchestra.run.smithi073.stderr: 92800K .......... .......... .......... .......... .......... 99% 429M 0s 2024-09-12T00:56:18.636 INFO:teuthology.orchestra.run.smithi073.stderr: 92850K .......... .......... .......... .......... .......... 99% 456M 0s 2024-09-12T00:56:18.636 INFO:teuthology.orchestra.run.smithi073.stderr: 92900K 100% 134G=0.5s 2024-09-12T00:56:18.636 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-12T00:56:18.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12 00:56:17 (194 MB/s) - ‘gradle-6.0.1-bin.zip’ saved [95129672/95129672] 2024-09-12T00:56:18.637 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-12T00:56:18.677 INFO:teuthology.orchestra.run.smithi073.stdout:Archive: gradle-6.0.1-bin.zip 2024-09-12T00:56:18.677 INFO:teuthology.orchestra.run.smithi073.stdout: creating: /opt/gradle/gradle-6.0.1/ 2024-09-12T00:56:18.678 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2024-09-12T00:56:18.678 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2024-09-12T00:56:18.678 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2024-09-12T00:56:18.678 INFO:teuthology.orchestra.run.smithi073.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2024-09-12T00:56:18.678 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2024-09-12T00:56:18.678 INFO:teuthology.orchestra.run.smithi073.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2024-09-12T00:56:18.678 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2024-09-12T00:56:18.678 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2024-09-12T00:56:18.678 INFO:teuthology.orchestra.run.smithi073.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2024-09-12T00:56:18.678 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2024-09-12T00:56:18.678 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2024-09-12T00:56:18.679 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2024-09-12T00:56:18.679 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2024-09-12T00:56:18.679 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2024-09-12T00:56:18.679 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2024-09-12T00:56:18.679 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2024-09-12T00:56:18.679 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2024-09-12T00:56:18.679 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2024-09-12T00:56:18.679 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2024-09-12T00:56:18.679 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2024-09-12T00:56:18.679 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2024-09-12T00:56:18.679 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2024-09-12T00:56:18.680 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2024-09-12T00:56:18.680 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2024-09-12T00:56:18.680 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2024-09-12T00:56:18.680 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2024-09-12T00:56:18.680 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2024-09-12T00:56:18.680 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2024-09-12T00:56:18.680 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2024-09-12T00:56:18.680 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2024-09-12T00:56:18.680 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2024-09-12T00:56:18.680 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2024-09-12T00:56:18.680 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2024-09-12T00:56:18.681 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2024-09-12T00:56:18.681 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2024-09-12T00:56:18.681 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2024-09-12T00:56:18.681 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2024-09-12T00:56:18.681 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2024-09-12T00:56:18.681 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2024-09-12T00:56:18.681 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2024-09-12T00:56:18.681 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2024-09-12T00:56:18.681 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2024-09-12T00:56:18.681 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2024-09-12T00:56:18.681 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2024-09-12T00:56:18.682 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2024-09-12T00:56:18.682 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2024-09-12T00:56:18.682 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2024-09-12T00:56:18.682 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2024-09-12T00:56:18.682 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2024-09-12T00:56:18.682 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2024-09-12T00:56:18.682 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2024-09-12T00:56:18.682 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2024-09-12T00:56:18.682 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2024-09-12T00:56:18.682 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2024-09-12T00:56:18.682 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2024-09-12T00:56:18.682 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2024-09-12T00:56:18.683 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2024-09-12T00:56:18.683 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2024-09-12T00:56:18.683 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2024-09-12T00:56:18.683 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2024-09-12T00:56:18.683 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2024-09-12T00:56:18.683 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2024-09-12T00:56:18.683 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2024-09-12T00:56:18.683 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2024-09-12T00:56:18.683 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2024-09-12T00:56:18.683 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2024-09-12T00:56:18.683 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2024-09-12T00:56:18.684 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2024-09-12T00:56:18.684 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2024-09-12T00:56:18.684 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2024-09-12T00:56:18.684 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2024-09-12T00:56:18.684 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2024-09-12T00:56:18.684 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2024-09-12T00:56:18.684 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2024-09-12T00:56:18.684 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2024-09-12T00:56:18.684 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2024-09-12T00:56:18.684 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2024-09-12T00:56:18.684 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2024-09-12T00:56:18.685 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2024-09-12T00:56:18.685 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2024-09-12T00:56:18.685 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2024-09-12T00:56:18.685 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2024-09-12T00:56:18.685 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2024-09-12T00:56:18.685 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2024-09-12T00:56:18.685 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2024-09-12T00:56:18.685 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2024-09-12T00:56:18.685 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2024-09-12T00:56:18.685 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2024-09-12T00:56:18.685 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2024-09-12T00:56:18.686 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2024-09-12T00:56:18.686 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2024-09-12T00:56:18.686 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2024-09-12T00:56:18.686 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2024-09-12T00:56:18.686 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2024-09-12T00:56:18.686 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2024-09-12T00:56:18.686 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2024-09-12T00:56:18.686 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2024-09-12T00:56:18.686 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2024-09-12T00:56:18.686 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2024-09-12T00:56:18.686 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2024-09-12T00:56:18.687 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2024-09-12T00:56:18.687 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2024-09-12T00:56:18.687 INFO:teuthology.orchestra.run.smithi073.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2024-09-12T00:56:18.687 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2024-09-12T00:56:18.687 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2024-09-12T00:56:18.687 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2024-09-12T00:56:18.687 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2024-09-12T00:56:18.687 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2024-09-12T00:56:18.687 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2024-09-12T00:56:18.687 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2024-09-12T00:56:18.687 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2024-09-12T00:56:18.688 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2024-09-12T00:56:18.688 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2024-09-12T00:56:18.688 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2024-09-12T00:56:18.688 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2024-09-12T00:56:18.688 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2024-09-12T00:56:18.688 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2024-09-12T00:56:18.688 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2024-09-12T00:56:18.688 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2024-09-12T00:56:18.688 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2024-09-12T00:56:18.688 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2024-09-12T00:56:18.689 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2024-09-12T00:56:18.689 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2024-09-12T00:56:18.689 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2024-09-12T00:56:18.689 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2024-09-12T00:56:18.689 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2024-09-12T00:56:18.689 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2024-09-12T00:56:18.689 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2024-09-12T00:56:18.689 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2024-09-12T00:56:18.689 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2024-09-12T00:56:18.689 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2024-09-12T00:56:18.689 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2024-09-12T00:56:18.690 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2024-09-12T00:56:18.690 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2024-09-12T00:56:18.690 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2024-09-12T00:56:18.690 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2024-09-12T00:56:18.690 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2024-09-12T00:56:18.690 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2024-09-12T00:56:18.690 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2024-09-12T00:56:18.690 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2024-09-12T00:56:18.690 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2024-09-12T00:56:18.690 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2024-09-12T00:56:18.690 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2024-09-12T00:56:18.690 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2024-09-12T00:56:18.691 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2024-09-12T00:56:18.691 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2024-09-12T00:56:18.691 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2024-09-12T00:56:18.691 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2024-09-12T00:56:18.691 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2024-09-12T00:56:18.691 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2024-09-12T00:56:18.691 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2024-09-12T00:56:18.691 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2024-09-12T00:56:18.691 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2024-09-12T00:56:18.691 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2024-09-12T00:56:18.691 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2024-09-12T00:56:18.692 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2024-09-12T00:56:18.692 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2024-09-12T00:56:18.692 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2024-09-12T00:56:18.692 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2024-09-12T00:56:18.692 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2024-09-12T00:56:18.692 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2024-09-12T00:56:18.692 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2024-09-12T00:56:18.692 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2024-09-12T00:56:18.692 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2024-09-12T00:56:18.692 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2024-09-12T00:56:18.692 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2024-09-12T00:56:18.693 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2024-09-12T00:56:18.693 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2024-09-12T00:56:18.693 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2024-09-12T00:56:18.693 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2024-09-12T00:56:18.693 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2024-09-12T00:56:18.693 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2024-09-12T00:56:18.693 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2024-09-12T00:56:18.693 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2024-09-12T00:56:18.693 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2024-09-12T00:56:18.693 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2024-09-12T00:56:18.693 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2024-09-12T00:56:18.694 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2024-09-12T00:56:18.694 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2024-09-12T00:56:18.694 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2024-09-12T00:56:18.694 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2024-09-12T00:56:18.694 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2024-09-12T00:56:18.694 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2024-09-12T00:56:18.694 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2024-09-12T00:56:18.694 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2024-09-12T00:56:18.694 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2024-09-12T00:56:18.694 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2024-09-12T00:56:18.694 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2024-09-12T00:56:18.694 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2024-09-12T00:56:18.695 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2024-09-12T00:56:18.695 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2024-09-12T00:56:18.695 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2024-09-12T00:56:18.695 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2024-09-12T00:56:18.695 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2024-09-12T00:56:18.695 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2024-09-12T00:56:18.695 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2024-09-12T00:56:18.695 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2024-09-12T00:56:18.695 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2024-09-12T00:56:18.695 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2024-09-12T00:56:18.695 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2024-09-12T00:56:18.696 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2024-09-12T00:56:18.696 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2024-09-12T00:56:18.696 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2024-09-12T00:56:18.696 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2024-09-12T00:56:18.696 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2024-09-12T00:56:18.696 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2024-09-12T00:56:18.696 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2024-09-12T00:56:18.696 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2024-09-12T00:56:18.696 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2024-09-12T00:56:18.696 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2024-09-12T00:56:18.696 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2024-09-12T00:56:18.697 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2024-09-12T00:56:18.697 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2024-09-12T00:56:18.697 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2024-09-12T00:56:18.697 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2024-09-12T00:56:18.697 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2024-09-12T00:56:18.697 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2024-09-12T00:56:18.697 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2024-09-12T00:56:18.697 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2024-09-12T00:56:18.697 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2024-09-12T00:56:18.697 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2024-09-12T00:56:18.697 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2024-09-12T00:56:18.697 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2024-09-12T00:56:18.698 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2024-09-12T00:56:18.698 INFO:teuthology.orchestra.run.smithi073.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2024-09-12T00:56:18.698 INFO:teuthology.orchestra.run.smithi073.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2024-09-12T00:56:18.698 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:56:18.698 INFO:teuthology.orchestra.run.smithi073.stdout:Welcome to Gradle 6.0.1! 2024-09-12T00:56:18.698 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:56:18.698 INFO:teuthology.orchestra.run.smithi073.stdout:Here are the highlights of this release: 2024-09-12T00:56:18.698 INFO:teuthology.orchestra.run.smithi073.stdout: - Substantial improvements in dependency management, including 2024-09-12T00:56:18.698 INFO:teuthology.orchestra.run.smithi073.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2024-09-12T00:56:18.698 INFO:teuthology.orchestra.run.smithi073.stdout: - Advanced control of transitive versions 2024-09-12T00:56:18.698 INFO:teuthology.orchestra.run.smithi073.stdout: - Support for optional features and dependencies 2024-09-12T00:56:18.698 INFO:teuthology.orchestra.run.smithi073.stdout: - Rules to tweak published metadata 2024-09-12T00:56:18.699 INFO:teuthology.orchestra.run.smithi073.stdout: - Support for Java 13 2024-09-12T00:56:18.699 INFO:teuthology.orchestra.run.smithi073.stdout: - Faster incremental Java and Groovy compilation 2024-09-12T00:56:18.699 INFO:teuthology.orchestra.run.smithi073.stdout: - New Zinc compiler for Scala 2024-09-12T00:56:18.699 INFO:teuthology.orchestra.run.smithi073.stdout: - VS2019 support 2024-09-12T00:56:18.699 INFO:teuthology.orchestra.run.smithi073.stdout: - Support for Gradle Enterprise plugin 3.0 2024-09-12T00:56:18.699 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:56:18.699 INFO:teuthology.orchestra.run.smithi073.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2024-09-12T00:56:18.699 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:56:18.699 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:56:18.699 INFO:teuthology.orchestra.run.smithi073.stdout:------------------------------------------------------------ 2024-09-12T00:56:18.699 INFO:teuthology.orchestra.run.smithi073.stdout:Gradle 6.0.1 2024-09-12T00:56:18.699 INFO:teuthology.orchestra.run.smithi073.stdout:------------------------------------------------------------ 2024-09-12T00:56:18.700 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:56:18.700 INFO:teuthology.orchestra.run.smithi073.stdout:Build time: 2019-11-18 20:25:01 UTC 2024-09-12T00:56:18.700 INFO:teuthology.orchestra.run.smithi073.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2024-09-12T00:56:18.700 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:56:18.700 INFO:teuthology.orchestra.run.smithi073.stdout:Kotlin: 1.3.50 2024-09-12T00:56:18.700 INFO:teuthology.orchestra.run.smithi073.stdout:Groovy: 2.5.8 2024-09-12T00:56:18.700 INFO:teuthology.orchestra.run.smithi073.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2024-09-12T00:56:18.700 INFO:teuthology.orchestra.run.smithi073.stdout:JVM: 11.0.20.1 (Red Hat, Inc. 11.0.20.1+1-LTS) 2024-09-12T00:56:18.700 INFO:teuthology.orchestra.run.smithi073.stdout:OS: Linux 5.14.0-505.el9.x86_64 amd64 2024-09-12T00:56:18.700 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:56:18.701 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2024-09-12T00:56:18.701 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-12T00:56:18.701 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi073.front.sepia.ceph.com 2024-09-12T00:56:18.701 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-12T00:56:18.701 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi117.front.sepia.ceph.com 2024-09-12T00:56:18.701 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2024-09-12T00:56:19.007 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2024-09-12T00:56:19.007 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2024-09-12T00:56:19.007 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'HJXABPZFKLHBDOCZIJOJ', 'access_secret': '54m6bcyGqNqFYhIuMHU1Qfz8CUGquaGHo2SECbXlgeFg6mXcrUY5Kg==', 'region': 'mexico', 'endpoint': 'smithi073.front.sepia.ceph.com:443', 'port': 443, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': True, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi073.front.sepia.ceph.com'} 2024-09-12T00:56:19.008 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2024-09-12T00:56:19.008 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'HJXABPZFKLHBDOCZIJOJ', '--secret', '54m6bcyGqNqFYhIuMHU1Qfz8CUGquaGHo2SECbXlgeFg6mXcrUY5Kg==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2024-09-12T00:56:19.008 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key HJXABPZFKLHBDOCZIJOJ --secret 54m6bcyGqNqFYhIuMHU1Qfz8CUGquaGHo2SECbXlgeFg6mXcrUY5Kg== --email tester.client.0_test@test.test --cluster ceph 2024-09-12T00:56:19.072 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:56:19.073 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:56:19.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.107+0000 7fb320b19800 20 rados->read ofs=0 len=0 2024-09-12T00:56:19.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.108+0000 7fb320b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:19.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.108+0000 7fb320b19800 20 realm 2024-09-12T00:56:19.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.108+0000 7fb320b19800 20 rados->read ofs=0 len=0 2024-09-12T00:56:19.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.108+0000 7fb320b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:19.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.108+0000 7fb320b19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:19.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.108+0000 7fb320b19800 20 rados->read ofs=0 len=0 2024-09-12T00:56:19.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.109+0000 7fb320b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:19.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.109+0000 7fb320b19800 20 rados->read ofs=0 len=0 2024-09-12T00:56:19.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.110+0000 7fb320b19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:19.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.110+0000 7fb320b19800 20 rados->read ofs=0 len=0 2024-09-12T00:56:19.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.110+0000 7fb320b19800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:19.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.110+0000 7fb320b19800 20 searching for the correct realm 2024-09-12T00:56:19.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.113+0000 7fb31ee04640 0 -- 172.21.15.73:0/3967984177 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fb3140810a0 msgr2=0x7fb314096a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:56:19.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.118+0000 7fb31ee04640 0 -- 172.21.15.73:0/3967984177 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fb1e80864b0 msgr2=0x7fb1e80888e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:19.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.122+0000 7fb320b19800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:56:19.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.122+0000 7fb320b19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:19.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.122+0000 7fb320b19800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:56:19.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.122+0000 7fb320b19800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:19.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.122+0000 7fb320b19800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:19.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.122+0000 7fb320b19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:19.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.122+0000 7fb320b19800 20 rados->read ofs=0 len=0 2024-09-12T00:56:19.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.122+0000 7fb320b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:19.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.122+0000 7fb320b19800 20 rados->read ofs=0 len=0 2024-09-12T00:56:19.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.122+0000 7fb320b19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:19.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.122+0000 7fb320b19800 20 rados->read ofs=0 len=0 2024-09-12T00:56:19.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.122+0000 7fb320b19800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:19.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.122+0000 7fb320b19800 20 zone default found 2024-09-12T00:56:19.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.122+0000 7fb320b19800 4 Realm: () 2024-09-12T00:56:19.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.122+0000 7fb320b19800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:56:19.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.122+0000 7fb320b19800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:56:19.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.122+0000 7fb320b19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:19.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.122+0000 7fb320b19800 20 zonegroup default 2024-09-12T00:56:19.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.122+0000 7fb320b19800 20 rados->read ofs=0 len=0 2024-09-12T00:56:19.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.123+0000 7fb320b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:19.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.123+0000 7fb320b19800 20 rados->read ofs=0 len=0 2024-09-12T00:56:19.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.123+0000 7fb320b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:19.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.123+0000 7fb320b19800 20 rados->read ofs=0 len=0 2024-09-12T00:56:19.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.123+0000 7fb320b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:19.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.123+0000 7fb320b19800 20 started sync module instance, tier type = 2024-09-12T00:56:19.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.123+0000 7fb320b19800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:56:19.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.132+0000 7fb320b19800 20 add_watcher() i=0 2024-09-12T00:56:19.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.132+0000 7fb320b19800 20 add_watcher() i=1 2024-09-12T00:56:19.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.132+0000 7fb320b19800 20 add_watcher() i=2 2024-09-12T00:56:19.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.132+0000 7fb320b19800 20 add_watcher() i=3 2024-09-12T00:56:19.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.132+0000 7fb320b19800 20 add_watcher() i=4 2024-09-12T00:56:19.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.132+0000 7fb320b19800 20 add_watcher() i=5 2024-09-12T00:56:19.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.132+0000 7fb320b19800 20 add_watcher() i=6 2024-09-12T00:56:19.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.133+0000 7fb320b19800 20 add_watcher() i=7 2024-09-12T00:56:19.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.133+0000 7fb320b19800 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:19.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.135+0000 7fb1d4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:19.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.135+0000 7fb320b19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:19.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.135+0000 7fb320b19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:19.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.135+0000 7fb320b19800 5 note: GC not initialized 2024-09-12T00:56:19.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.135+0000 7fb14f7fe640 20 reqs_thread_entry: start 2024-09-12T00:56:19.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.135+0000 7fb320b19800 20 init_complete bucket index max shards: 1 2024-09-12T00:56:19.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.135+0000 7fb320b19800 20 Filter name: none 2024-09-12T00:56:19.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.136+0000 7fb14d7fa640 20 reqs_thread_entry: start 2024-09-12T00:56:19.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.136+0000 7fb320b19800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-12T00:56:19.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.136+0000 7fb320b19800 20 rados->read ofs=0 len=0 2024-09-12T00:56:19.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.136+0000 7fb320b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:19.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.136+0000 7fb320b19800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2024-09-12T00:56:19.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.136+0000 7fb320b19800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T00:56:19.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.136+0000 7fb320b19800 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2024-09-12T00:56:19.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.136+0000 7fb320b19800 20 rados->read ofs=0 len=0 2024-09-12T00:56:19.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.136+0000 7fb320b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:19.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.136+0000 7fb320b19800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2024-09-12T00:56:19.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.136+0000 7fb320b19800 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T00:56:19.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.136+0000 7fb320b19800 10 cache get: name=default.rgw.meta+users.keys+HJXABPZFKLHBDOCZIJOJ : miss 2024-09-12T00:56:19.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.136+0000 7fb320b19800 20 rados->read ofs=0 len=0 2024-09-12T00:56:19.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.136+0000 7fb320b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:19.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.136+0000 7fb320b19800 10 cache put: name=default.rgw.meta+users.keys+HJXABPZFKLHBDOCZIJOJ info.flags=0x0 2024-09-12T00:56:19.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.136+0000 7fb320b19800 10 adding default.rgw.meta+users.keys+HJXABPZFKLHBDOCZIJOJ to cache LRU end 2024-09-12T00:56:19.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.136+0000 7fb320b19800 10 cache get: name=default.rgw.meta+users.keys+HJXABPZFKLHBDOCZIJOJ : hit (negative entry) 2024-09-12T00:56:19.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.137+0000 7fb320b19800 10 cache get: name=default.rgw.meta+users.keys+HJXABPZFKLHBDOCZIJOJ : hit (negative entry) 2024-09-12T00:56:19.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.138+0000 7fb320b19800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-12T00:56:19.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.138+0000 7fb320b19800 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T00:56:19.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.138+0000 7fb320b19800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-12T00:56:19.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.138+0000 7fb201ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497064 cookie 94213268139504 notifier 8799 bl.length()=670 2024-09-12T00:56:19.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.138+0000 7fb201ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-12T00:56:19.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.138+0000 7fb201ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T00:56:19.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.141+0000 7fb320b19800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-12T00:56:19.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.141+0000 7fb320b19800 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T00:56:19.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.141+0000 7fb320b19800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-12T00:56:19.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.141+0000 7fb201ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497010 cookie 94213268131376 notifier 8799 bl.length()=200 2024-09-12T00:56:19.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.141+0000 7fb201ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-12T00:56:19.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.141+0000 7fb201ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T00:56:19.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.143+0000 7fb320b19800 10 cache put: name=default.rgw.meta+users.keys+HJXABPZFKLHBDOCZIJOJ info.flags=0x7 2024-09-12T00:56:19.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.143+0000 7fb320b19800 10 moving default.rgw.meta+users.keys+HJXABPZFKLHBDOCZIJOJ to cache LRU end 2024-09-12T00:56:19.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.143+0000 7fb320b19800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:HJXABPZFKLHBDOCZIJOJ, ofs0, ns] 2024-09-12T00:56:19.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.143+0000 7fb2017fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497065 cookie 94213268124560 notifier 8799 bl.length()=189 2024-09-12T00:56:19.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.143+0000 7fb2017fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+HJXABPZFKLHBDOCZIJOJ info.flags=0x7 2024-09-12T00:56:19.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.143+0000 7fb2017fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+HJXABPZFKLHBDOCZIJOJ to cache LRU end 2024-09-12T00:56:19.144 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T00:56:19.144 INFO:teuthology.orchestra.run.smithi073.stdout: "user_id": "tester.client.0", 2024-09-12T00:56:19.144 INFO:teuthology.orchestra.run.smithi073.stdout: "display_name": "Ms. tester.client.0", 2024-09-12T00:56:19.144 INFO:teuthology.orchestra.run.smithi073.stdout: "email": "tester.client.0_test@test.test", 2024-09-12T00:56:19.144 INFO:teuthology.orchestra.run.smithi073.stdout: "suspended": 0, 2024-09-12T00:56:19.145 INFO:teuthology.orchestra.run.smithi073.stdout: "max_buckets": 1000, 2024-09-12T00:56:19.145 INFO:teuthology.orchestra.run.smithi073.stdout: "subusers": [], 2024-09-12T00:56:19.145 INFO:teuthology.orchestra.run.smithi073.stdout: "keys": [ 2024-09-12T00:56:19.145 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T00:56:19.145 INFO:teuthology.orchestra.run.smithi073.stdout: "user": "tester.client.0", 2024-09-12T00:56:19.145 INFO:teuthology.orchestra.run.smithi073.stdout: "access_key": "HJXABPZFKLHBDOCZIJOJ", 2024-09-12T00:56:19.145 INFO:teuthology.orchestra.run.smithi073.stdout: "secret_key": "54m6bcyGqNqFYhIuMHU1Qfz8CUGquaGHo2SECbXlgeFg6mXcrUY5Kg==", 2024-09-12T00:56:19.145 INFO:teuthology.orchestra.run.smithi073.stdout: "active": true, 2024-09-12T00:56:19.145 INFO:teuthology.orchestra.run.smithi073.stdout: "create_date": "2024-09-12T00:56:19.138744Z" 2024-09-12T00:56:19.145 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T00:56:19.145 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-12T00:56:19.145 INFO:teuthology.orchestra.run.smithi073.stdout: "swift_keys": [], 2024-09-12T00:56:19.146 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": [], 2024-09-12T00:56:19.146 INFO:teuthology.orchestra.run.smithi073.stdout: "op_mask": "read, write, delete", 2024-09-12T00:56:19.146 INFO:teuthology.orchestra.run.smithi073.stdout: "default_placement": "", 2024-09-12T00:56:19.146 INFO:teuthology.orchestra.run.smithi073.stdout: "default_storage_class": "", 2024-09-12T00:56:19.146 INFO:teuthology.orchestra.run.smithi073.stdout: "placement_tags": [], 2024-09-12T00:56:19.146 INFO:teuthology.orchestra.run.smithi073.stdout: "bucket_quota": { 2024-09-12T00:56:19.146 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": false, 2024-09-12T00:56:19.146 INFO:teuthology.orchestra.run.smithi073.stdout: "check_on_raw": false, 2024-09-12T00:56:19.146 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size": -1, 2024-09-12T00:56:19.146 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size_kb": 0, 2024-09-12T00:56:19.146 INFO:teuthology.orchestra.run.smithi073.stdout: "max_objects": -1 2024-09-12T00:56:19.146 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T00:56:19.146 INFO:teuthology.orchestra.run.smithi073.stdout: "user_quota": { 2024-09-12T00:56:19.146 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": false, 2024-09-12T00:56:19.147 INFO:teuthology.orchestra.run.smithi073.stdout: "check_on_raw": false, 2024-09-12T00:56:19.147 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size": -1, 2024-09-12T00:56:19.147 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size_kb": 0, 2024-09-12T00:56:19.147 INFO:teuthology.orchestra.run.smithi073.stdout: "max_objects": -1 2024-09-12T00:56:19.147 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T00:56:19.147 INFO:teuthology.orchestra.run.smithi073.stdout: "temp_url_keys": [], 2024-09-12T00:56:19.147 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "rgw", 2024-09-12T00:56:19.147 INFO:teuthology.orchestra.run.smithi073.stdout: "mfa_ids": [], 2024-09-12T00:56:19.147 INFO:teuthology.orchestra.run.smithi073.stdout: "account_id": "", 2024-09-12T00:56:19.147 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/", 2024-09-12T00:56:19.147 INFO:teuthology.orchestra.run.smithi073.stdout: "create_date": "2024-09-12T00:56:19.138729Z", 2024-09-12T00:56:19.147 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-12T00:56:19.147 INFO:teuthology.orchestra.run.smithi073.stdout: "group_ids": [] 2024-09-12T00:56:19.148 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T00:56:19.148 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:56:19.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.145+0000 7fb1d4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:19.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.148+0000 7fb320b19800 20 remove_watcher() i=0 2024-09-12T00:56:19.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.148+0000 7fb320b19800 2 removed watcher, disabling cache 2024-09-12T00:56:19.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.149+0000 7fb320b19800 20 remove_watcher() i=1 2024-09-12T00:56:19.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.150+0000 7fb320b19800 20 remove_watcher() i=2 2024-09-12T00:56:19.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.151+0000 7fb320b19800 20 remove_watcher() i=3 2024-09-12T00:56:19.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.152+0000 7fb320b19800 20 remove_watcher() i=4 2024-09-12T00:56:19.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.153+0000 7fb320b19800 20 remove_watcher() i=5 2024-09-12T00:56:19.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.154+0000 7fb320b19800 20 remove_watcher() i=6 2024-09-12T00:56:19.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.155+0000 7fb320b19800 20 remove_watcher() i=7 2024-09-12T00:56:19.166 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T00:56:19.166 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2024-09-12T00:56:19.198 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2024-09-12T00:56:19.198 DEBUG:teuthology.orchestra.run.smithi073:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2024-09-12T00:56:19.265 DEBUG:teuthology.orchestra.run.smithi073:> radosgw-admin gc process --include-all 2024-09-12T00:56:19.357 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:56:19.357 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:56:19.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.395+0000 7f73a1346800 20 rados->read ofs=0 len=0 2024-09-12T00:56:19.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.396+0000 7f73a1346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:19.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.396+0000 7f73a1346800 20 realm 2024-09-12T00:56:19.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.396+0000 7f73a1346800 20 rados->read ofs=0 len=0 2024-09-12T00:56:19.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.396+0000 7f73a1346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:19.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.396+0000 7f73a1346800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:19.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.396+0000 7f73a1346800 20 rados->read ofs=0 len=0 2024-09-12T00:56:19.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.396+0000 7f73a1346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:19.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.396+0000 7f73a1346800 20 rados->read ofs=0 len=0 2024-09-12T00:56:19.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.397+0000 7f73a1346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:19.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.397+0000 7f73a1346800 20 rados->read ofs=0 len=0 2024-09-12T00:56:19.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.398+0000 7f73a1346800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:19.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.398+0000 7f73a1346800 20 searching for the correct realm 2024-09-12T00:56:19.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.401+0000 7f739f638640 0 -- 172.21.15.73:0/817096300 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f7388039b80 msgr2=0x7f7388020990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:19.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.405+0000 7f7396636640 0 -- 172.21.15.73:0/817096300 >> [v2:172.21.15.117:6800/110688882,v1:172.21.15.117:6801/110688882] conn(0x55c410984940 msgr2=0x55c410986d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:19.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.409+0000 7f73a1346800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:56:19.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.409+0000 7f73a1346800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:19.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.409+0000 7f73a1346800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:56:19.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.409+0000 7f73a1346800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:19.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.409+0000 7f73a1346800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:19.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.409+0000 7f73a1346800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:19.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.409+0000 7f73a1346800 20 rados->read ofs=0 len=0 2024-09-12T00:56:19.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.409+0000 7f73a1346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:19.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.409+0000 7f73a1346800 20 rados->read ofs=0 len=0 2024-09-12T00:56:19.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.409+0000 7f73a1346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:19.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.409+0000 7f73a1346800 20 rados->read ofs=0 len=0 2024-09-12T00:56:19.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.410+0000 7f73a1346800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:19.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.410+0000 7f73a1346800 20 zone default found 2024-09-12T00:56:19.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.410+0000 7f73a1346800 4 Realm: () 2024-09-12T00:56:19.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.410+0000 7f73a1346800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:56:19.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.410+0000 7f73a1346800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:56:19.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.410+0000 7f73a1346800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:19.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.410+0000 7f73a1346800 20 zonegroup default 2024-09-12T00:56:19.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.410+0000 7f73a1346800 20 rados->read ofs=0 len=0 2024-09-12T00:56:19.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.410+0000 7f73a1346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:19.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.410+0000 7f73a1346800 20 rados->read ofs=0 len=0 2024-09-12T00:56:19.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.410+0000 7f73a1346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:19.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.410+0000 7f73a1346800 20 rados->read ofs=0 len=0 2024-09-12T00:56:19.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.410+0000 7f73a1346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:19.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.411+0000 7f73a1346800 20 started sync module instance, tier type = 2024-09-12T00:56:19.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.411+0000 7f73a1346800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:56:19.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.420+0000 7f73a1346800 20 add_watcher() i=0 2024-09-12T00:56:19.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.420+0000 7f73a1346800 20 add_watcher() i=1 2024-09-12T00:56:19.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.420+0000 7f73a1346800 20 add_watcher() i=2 2024-09-12T00:56:19.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.420+0000 7f73a1346800 20 add_watcher() i=3 2024-09-12T00:56:19.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.420+0000 7f73a1346800 20 add_watcher() i=4 2024-09-12T00:56:19.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.420+0000 7f73a1346800 20 add_watcher() i=5 2024-09-12T00:56:19.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.420+0000 7f73a1346800 20 add_watcher() i=6 2024-09-12T00:56:19.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.421+0000 7f73a1346800 20 add_watcher() i=7 2024-09-12T00:56:19.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.421+0000 7f73a1346800 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:19.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.423+0000 7f72557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:19.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.423+0000 7f73a1346800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:19.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.423+0000 7f73a1346800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:19.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.459+0000 7f71cffff640 20 reqs_thread_entry: start 2024-09-12T00:56:19.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.459+0000 7f73a1346800 20 init_complete bucket index max shards: 1 2024-09-12T00:56:19.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.459+0000 7f73a1346800 20 Filter name: none 2024-09-12T00:56:19.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.459+0000 7f71cdffb640 20 reqs_thread_entry: start 2024-09-12T00:56:19.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.459+0000 7f73a1346800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:56:19.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.460+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:19.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.461+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:19.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.461+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T00:56:19.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.461+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15828859719122824338', time=2024-09-12T02:47:27.424311+0000, chain.objs.size()=4 2024-09-12T00:56:19.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.461+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10__multipart_foo.2~kZIbosltDv1akiLT0-_K4jpAaug2Pe1.1 2024-09-12T00:56:19.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.461+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10__multipart_foo.2~kZIbosltDv1akiLT0-_K4jpAaug2Pe1.2 2024-09-12T00:56:19.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.461+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10__multipart_foo.2~kZIbosltDv1akiLT0-_K4jpAaug2Pe1.3 2024-09-12T00:56:19.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.461+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10__multipart_foo.2~kZIbosltDv1akiLT0-_K4jpAaug2Pe1.4 2024-09-12T00:56:19.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.461+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.537277653652835992', time=2024-09-12T02:47:27.584155+0000, chain.objs.size()=3 2024-09-12T00:56:19.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.461+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14__multipart_foo-LUKEWARM.2~VKazdSWUv_DN6_DA4N-MBk9RpkH5kCl.1 2024-09-12T00:56:19.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.461+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14__multipart_foo-LUKEWARM.2~VKazdSWUv_DN6_DA4N-MBk9RpkH5kCl.2 2024-09-12T00:56:19.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.461+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14__multipart_foo-LUKEWARM.2~VKazdSWUv_DN6_DA4N-MBk9RpkH5kCl.3 2024-09-12T00:56:19.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.461+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12551209114764895493', time=2024-09-12T02:49:19.490834+0000, chain.objs.size()=1 2024-09-12T00:56:19.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.461+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21__shadow_.nFDVgFcKAdFbsGRGowXtiLf7km5gurm_0 2024-09-12T00:56:19.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.461+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7553255136203289033', time=2024-09-12T02:49:57.936580+0000, chain.objs.size()=1 2024-09-12T00:56:19.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.461+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24__shadow_.BUAw6m85VBy9LgG8wxwYn1gSpd1lTYO_0 2024-09-12T00:56:19.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.461+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13060087258197791458', time=2024-09-12T02:50:00.388882+0000, chain.objs.size()=1 2024-09-12T00:56:19.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.461+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25__shadow_.z_67BVIrds1FWa_Sqm3H51CkOYg9lMR_0 2024-09-12T00:56:19.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.462+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3364292972587316227', time=2024-09-12T02:50:00.390199+0000, chain.objs.size()=1 2024-09-12T00:56:19.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.462+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25__shadow_.7KxqEHGivhaqyy0o87lbEpZKlI4Ad2m_0 2024-09-12T00:56:19.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.462+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11044708957219582958', time=2024-09-12T02:50:02.657869+0000, chain.objs.size()=1 2024-09-12T00:56:19.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.462+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.26__shadow_.kHhR5r8EYgcz2BOledrbhPr_Rm2TCz__0 2024-09-12T00:56:19.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.463+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16869074655922504192', time=2024-09-12T02:50:02.686783+0000, chain.objs.size()=1 2024-09-12T00:56:19.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.463+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.26__shadow_.GZ4MuC8f02nZDpW4X_IwHnFqbukAjo__0 2024-09-12T00:56:19.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.464+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11235607597622495117', time=2024-09-12T02:50:36.224611+0000, chain.objs.size()=1 2024-09-12T00:56:19.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.464+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27__shadow_.pZxHDONb_xA0FJp3oUGgVHS7wn5eX_b_0 2024-09-12T00:56:19.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.464+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15110527668076771300', time=2024-09-12T02:51:14.441632+0000, chain.objs.size()=1 2024-09-12T00:56:19.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.464+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30__shadow_.JnR9XdwpEdWybms1RzlZ2vYwvdNEqLZ_0 2024-09-12T00:56:19.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.464+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12995248500724048903', time=2024-09-12T02:51:50.043572+0000, chain.objs.size()=1 2024-09-12T00:56:19.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.464+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32__shadow_.JV0JnYkg59by4aCz0A3oJWKyOE8NMER_0 2024-09-12T00:56:19.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.464+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17085401574310877519', time=2024-09-12T02:52:25.842296+0000, chain.objs.size()=1 2024-09-12T00:56:19.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.464+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34__shadow_.x3Swmk4UcNTl3VWk5-Uo0STo662Afv0_0 2024-09-12T00:56:19.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.465+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13359059264782135798', time=2024-09-12T02:53:02.800393+0000, chain.objs.size()=1 2024-09-12T00:56:19.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.465+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36__shadow_.BAhGY9ZwAm21IQA94m9AIyaApvPXB-Z_0 2024-09-12T00:56:19.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.466+0000 7f73a1346800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:19.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.468+0000 7f73a1346800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:56:19.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.469+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:19.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.470+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:19.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.470+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T00:56:19.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.470+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11000351985317588353', time=2024-09-12T02:47:27.661964+0000, chain.objs.size()=1 2024-09-12T00:56:19.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.470+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7__shadow_.bkaDP3FYbNwdeXeTzM-VckWUVARE1U__0 2024-09-12T00:56:19.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.470+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8365475146845089361', time=2024-09-12T02:47:27.681175+0000, chain.objs.size()=1 2024-09-12T00:56:19.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.470+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8__shadow_.werUkgy-RkpUU0XkbkkW7Bn-1QGRQrA_0 2024-09-12T00:56:19.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.470+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10332648268926815982', time=2024-09-12T02:48:46.433957+0000, chain.objs.size()=1 2024-09-12T00:56:19.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.470+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.20__shadow_.OfFubBfUDfy7IcC8cINJAPRudFC3scA_0 2024-09-12T00:56:19.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.470+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.150736780571098802', time=2024-09-12T02:49:19.433405+0000, chain.objs.size()=1 2024-09-12T00:56:19.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.470+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21__shadow_.ABn_f1UIxg7m6iLEgJUPrz-9rn2OIdN_0 2024-09-12T00:56:19.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.470+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13877807951662774768', time=2024-09-12T02:49:21.931094+0000, chain.objs.size()=1 2024-09-12T00:56:19.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.470+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22__shadow_.kxII1_r0oJTwzkTq7BaI8XsOX10pSc6_0 2024-09-12T00:56:19.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.470+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6878716926605425416', time=2024-09-12T02:49:24.183885+0000, chain.objs.size()=1 2024-09-12T00:56:19.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.470+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23__shadow_.Rp9JJsjlLx4NiRLoWKOwS5epUvnOl5A_0 2024-09-12T00:56:19.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.470+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11411463699583866077', time=2024-09-12T02:49:57.931844+0000, chain.objs.size()=1 2024-09-12T00:56:19.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.470+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24__shadow_.x0FNeCqHPxml392iRhdUGQ0ptfFVraD_0 2024-09-12T00:56:19.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.470+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7614112311871909842', time=2024-09-12T02:49:57.932579+0000, chain.objs.size()=1 2024-09-12T00:56:19.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.470+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24__shadow_.o1gCrV5NLr9J45HdotElPIjbLhhN0jL_0 2024-09-12T00:56:19.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.470+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16085921489118929994', time=2024-09-12T02:49:57.967909+0000, chain.objs.size()=1 2024-09-12T00:56:19.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.470+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24__shadow_.yDsn80az1OK2S_XxRFeWX58PQ9WJPI5_0 2024-09-12T00:56:19.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.470+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3729888625204530355', time=2024-09-12T02:50:00.410167+0000, chain.objs.size()=1 2024-09-12T00:56:19.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.470+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25__shadow_.LjsLKL28Y-qzCwHjjg7nm6lUupt-Ez__0 2024-09-12T00:56:19.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.470+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3544020182488005254', time=2024-09-12T02:51:16.510888+0000, chain.objs.size()=1 2024-09-12T00:56:19.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.470+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31__shadow_.h0uf37EE0YKYhEvN9RyJbKey3ejP3yM_0 2024-09-12T00:56:19.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.470+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17424591642961390679', time=2024-09-12T02:51:16.511602+0000, chain.objs.size()=1 2024-09-12T00:56:19.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.470+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31__shadow_.kGICqnLeAfPejY4crIlRT0x7irSYGBv_0 2024-09-12T00:56:19.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.472+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13807152259711621380', time=2024-09-12T02:51:52.753681+0000, chain.objs.size()=1 2024-09-12T00:56:19.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.472+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33__shadow_.iROSN89u4liYejQ-_cDzkkIE0HXOSh0_0 2024-09-12T00:56:19.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.472+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15535961400022551057', time=2024-09-12T02:53:02.820623+0000, chain.objs.size()=1 2024-09-12T00:56:19.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.472+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36__shadow_.eH5kASjXoVUWMGnzxxOR1jvTqDDZKt__0 2024-09-12T00:56:19.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.472+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14591761221367386021', time=2024-09-12T02:53:07.306374+0000, chain.objs.size()=1 2024-09-12T00:56:19.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.473+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38__shadow_.MG5_kgH29h7vEdN899I-RYj-RECmJK9_0 2024-09-12T00:56:19.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.474+0000 7f73a1346800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:19.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.476+0000 7f73a1346800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:56:19.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.477+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:19.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.478+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:19.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.479+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T00:56:19.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.479+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='_yqWDITg8t1oIM_F7o3Vg3rkgilOculh', time=2024-09-12T02:47:27.492953+0000, chain.objs.size()=1 2024-09-12T00:56:19.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.479+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15__shadow_.4MX-UT4f4qDc1yvNvQK84T_ZEVCFs2N_0 2024-09-12T00:56:19.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.479+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='_bd35pSRvsyn1AOr76EE2QEYW9rxDBgA', time=2024-09-12T02:47:27.497983+0000, chain.objs.size()=1 2024-09-12T00:56:19.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.479+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15__shadow_.mLKkdxfB7vMcYf1x081Rov2_SZtcu1z_0 2024-09-12T00:56:19.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.479+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18186205859112665028', time=2024-09-12T02:47:27.523044+0000, chain.objs.size()=3 2024-09-12T00:56:19.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.479+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__multipart_foo-FROZEN.2~3vQreT-2Bj6sjzbLXNPzYMaxU5oWF1U.1 2024-09-12T00:56:19.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.479+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__multipart_foo-FROZEN.2~3vQreT-2Bj6sjzbLXNPzYMaxU5oWF1U.2 2024-09-12T00:56:19.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.479+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__multipart_foo-FROZEN.2~3vQreT-2Bj6sjzbLXNPzYMaxU5oWF1U.3 2024-09-12T00:56:19.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.479+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17570175494047696214', time=2024-09-12T02:48:44.393181+0000, chain.objs.size()=1 2024-09-12T00:56:19.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.479+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19__shadow_.f7_NdLCGHyf_Zd7pWW2ymwjUPNaANDr_0 2024-09-12T00:56:19.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.479+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7713036153587743281', time=2024-09-12T02:48:46.520791+0000, chain.objs.size()=1 2024-09-12T00:56:19.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.479+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.20__shadow_.lcN7cif6tiSQF6spdhxufmQMEIWhzAB_0 2024-09-12T00:56:19.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.479+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11078846047480160949', time=2024-09-12T02:49:19.508630+0000, chain.objs.size()=1 2024-09-12T00:56:19.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.479+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21__shadow_.nWgWI9_wTLK1YVWlsJ5mUYX8Al8IoA8_0 2024-09-12T00:56:19.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.479+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1824568805466617630', time=2024-09-12T02:50:36.243382+0000, chain.objs.size()=1 2024-09-12T00:56:19.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.479+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27__shadow_.gOAZAYQzWz2lbePJxzo9GACZUAuGK1__0 2024-09-12T00:56:19.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.479+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4413531878091092919', time=2024-09-12T02:50:38.484564+0000, chain.objs.size()=1 2024-09-12T00:56:19.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.479+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28__shadow_.z5nDdj_QSlWCd2Kg6HbtbUjgfsE0ve0_0 2024-09-12T00:56:19.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.479+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12030325455951353', time=2024-09-12T02:50:38.492327+0000, chain.objs.size()=1 2024-09-12T00:56:19.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.479+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28__shadow_.AcL8jUvbTp3RKQqQMS8bBii5fRN4Hmj_0 2024-09-12T00:56:19.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.479+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15692171452721033942', time=2024-09-12T02:51:11.603373+0000, chain.objs.size()=1 2024-09-12T00:56:19.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.479+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29__shadow_.wsOxl9hIKdY8jrlUGzsZujBqx_toUfh_0 2024-09-12T00:56:19.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.481+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1810591047142251474', time=2024-09-12T02:51:16.508204+0000, chain.objs.size()=1 2024-09-12T00:56:19.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.481+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31__shadow_.4fzO9gfOf7DnFdEhSCoFs1oJVgGLCV3_0 2024-09-12T00:56:19.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.481+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14678492223382986879', time=2024-09-12T02:52:25.855305+0000, chain.objs.size()=1 2024-09-12T00:56:19.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.481+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34__shadow_.Ty3VruQdmD2SwN92h1G23hyC-inPJJf_0 2024-09-12T00:56:19.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.481+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15080644548578807187', time=2024-09-12T02:52:25.907571+0000, chain.objs.size()=1 2024-09-12T00:56:19.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.481+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34__shadow_.iKwoitCDl33XKlkGCsvk17PjNn0wLu__0 2024-09-12T00:56:19.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.481+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3580462889365071177', time=2024-09-12T02:53:02.819887+0000, chain.objs.size()=1 2024-09-12T00:56:19.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.481+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36__shadow_.pzwj0bFfo9lBTE6W-16rBlP1vE_d9ic_0 2024-09-12T00:56:19.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.481+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1750827419506874096', time=2024-09-12T02:53:05.231740+0000, chain.objs.size()=1 2024-09-12T00:56:19.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.481+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37__shadow_.tDmmv-XXn0IXJdVj4jZi-6RvJ4r9Jfu_0 2024-09-12T00:56:19.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.481+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3184475331442551370', time=2024-09-12T02:55:47.887444+0000, chain.objs.size()=1 2024-09-12T00:56:19.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.481+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17__shadow_.7tat7iaDiVdQLHATUsFBVLIo620qs0H_0 2024-09-12T00:56:19.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.481+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13479649277224622065', time=2024-09-12T02:55:47.906966+0000, chain.objs.size()=1 2024-09-12T00:56:19.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.481+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17__shadow_.ZhmdZGd5yY3u13owSkjkBYo7KaDIgCn_0 2024-09-12T00:56:19.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.481+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14937607197087335753', time=2024-09-12T02:56:00.615439+0000, chain.objs.size()=1 2024-09-12T00:56:19.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.481+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18__shadow:sqYB4qPf6Fr3cuY8yHbfoIv3Q-lqrLy_.M0NIAcU_BRE42t2gYUQFfbQbE4a-p28_0 2024-09-12T00:56:19.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.483+0000 7f73a1346800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:19.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.485+0000 7f73a1346800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:56:19.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.486+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:19.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.487+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:19.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.488+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T00:56:19.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.488+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1383706163240260661', time=2024-09-12T02:48:44.401625+0000, chain.objs.size()=1 2024-09-12T00:56:19.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.488+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19__shadow_.wLFY3qiHAgYhWJnge_iyOEWU7eY-UjF_0 2024-09-12T00:56:19.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.488+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1817970644684379034', time=2024-09-12T02:49:19.451191+0000, chain.objs.size()=1 2024-09-12T00:56:19.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.488+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21__shadow_.lE_ozCnlKfDNpeemrzG1HFU6Fwyu9L6_0 2024-09-12T00:56:19.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.488+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10451271529586829064', time=2024-09-12T02:49:21.904920+0000, chain.objs.size()=1 2024-09-12T00:56:19.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.488+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22__shadow_.xoGV51HKaW9N-286xtDZhvs8d--XzgK_0 2024-09-12T00:56:19.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.488+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2190484195131294828', time=2024-09-12T02:49:21.908073+0000, chain.objs.size()=1 2024-09-12T00:56:19.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.488+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22__shadow_.myeBqCoWfLyngjuOVd64cgGVsK0Gp4x_0 2024-09-12T00:56:19.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.488+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7792090893758620541', time=2024-09-12T02:49:24.123618+0000, chain.objs.size()=1 2024-09-12T00:56:19.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.488+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23__shadow_.LT9xd-7r10sn9YAMTnQfrLSX5AJis3U_0 2024-09-12T00:56:19.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.488+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7964353054926656685', time=2024-09-12T02:49:24.172395+0000, chain.objs.size()=1 2024-09-12T00:56:19.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.488+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23__shadow_.7SqrE2ml6bRZKwQEf7w1LZ8BsMfWFZn_0 2024-09-12T00:56:19.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.488+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12965225611159084479', time=2024-09-12T02:50:38.439783+0000, chain.objs.size()=1 2024-09-12T00:56:19.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.488+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28__shadow_.ILlDzCXvAPbF1pn2pZ2IEfJ3h9ROAuT_0 2024-09-12T00:56:19.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.488+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2418531067177631971', time=2024-09-12T02:50:38.499403+0000, chain.objs.size()=1 2024-09-12T00:56:19.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.488+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28__shadow_.Sx8vT-Zx30zh4C7ZIXlvSeaEUnoLhdD_0 2024-09-12T00:56:19.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.488+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2482311751178114202', time=2024-09-12T02:51:11.629166+0000, chain.objs.size()=1 2024-09-12T00:56:19.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.488+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29__shadow_.6QYNDQRIr923GRW0cJ2_9RfL8LKZq4h_0 2024-09-12T00:56:19.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.488+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1016552892036893902', time=2024-09-12T02:51:16.503304+0000, chain.objs.size()=1 2024-09-12T00:56:19.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.488+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31__shadow_.BMvpGUg2hwprA_o3OUErrv_uuPcDoG-_0 2024-09-12T00:56:19.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.488+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2182332749418800949', time=2024-09-12T02:51:16.503979+0000, chain.objs.size()=1 2024-09-12T00:56:19.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.488+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31__shadow_.pzKzf_sSh3Yd-Nvlp9G98wIVbQQZe-j_0 2024-09-12T00:56:19.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.488+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9787167988183206568', time=2024-09-12T02:51:50.073471+0000, chain.objs.size()=1 2024-09-12T00:56:19.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.488+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32__shadow_.coXytoxHi4I9h-A2WlKLJcmS2R1WLmG_0 2024-09-12T00:56:19.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.490+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1585503675535384839', time=2024-09-12T02:52:25.882518+0000, chain.objs.size()=1 2024-09-12T00:56:19.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.490+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34__shadow_.VIYoGqv262lMUB3M1c2tnOpS-9WpUcz_0 2024-09-12T00:56:19.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.490+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3029253390947570975', time=2024-09-12T02:52:29.077584+0000, chain.objs.size()=1 2024-09-12T00:56:19.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.490+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35__shadow_.74hh-VpTdrz9J_idIupjj68JU2Ftc5M_0 2024-09-12T00:56:19.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.490+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18009615616941381976', time=2024-09-12T02:53:02.802226+0000, chain.objs.size()=1 2024-09-12T00:56:19.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.490+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36__shadow_.hCD22g9IsCqnub3x5QN6n-F9jsXMidw_0 2024-09-12T00:56:19.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.490+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15320190136638922827', time=2024-09-12T02:53:02.867711+0000, chain.objs.size()=1 2024-09-12T00:56:19.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.490+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36__shadow_.iHkjRNw_THATxiBN6KHFhDFmhr1qseq_0 2024-09-12T00:56:19.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.490+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5430503547748875411', time=2024-09-12T02:53:04.546082+0000, chain.objs.size()=1 2024-09-12T00:56:19.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.490+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37__shadow_.nvHw14ULW5tBlRbnO8ejhT6QQdaRHxH_0 2024-09-12T00:56:19.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.490+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17831343237665179994', time=2024-09-12T02:53:40.114949+0000, chain.objs.size()=1 2024-09-12T00:56:19.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.490+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39__shadow_.5tY3KWwmIZ6Bnnv7Ms39UPGu_A4m4xY_0 2024-09-12T00:56:19.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.490+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12702282460196990267', time=2024-09-12T02:53:40.115704+0000, chain.objs.size()=1 2024-09-12T00:56:19.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.490+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39__shadow_.uZ5mYqbbBB8tH8JjPmEaQwfeXqzkbe7_0 2024-09-12T00:56:19.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.491+0000 7f73a1346800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:19.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.494+0000 7f73a1346800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:56:19.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.495+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:19.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.496+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:19.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.496+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T00:56:19.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.496+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='_PR5LHb6bNBSe2nVzf1fmgzxIDeWLZNY', time=2024-09-12T02:47:27.541479+0000, chain.objs.size()=2 2024-09-12T00:56:19.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.496+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__shadow_.tJV3uEArRFPUzbZ4kJbuwa_k_0AEiDH_0 2024-09-12T00:56:19.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.496+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__shadow_.tJV3uEArRFPUzbZ4kJbuwa_k_0AEiDH_1 2024-09-12T00:56:19.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.496+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7490222662835670144', time=2024-09-12T02:49:57.986561+0000, chain.objs.size()=1 2024-09-12T00:56:19.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.496+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24__shadow_.DcPNrlY1vS5pRAuGYVD2VOgxKqKTRTP_0 2024-09-12T00:56:19.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.496+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14591154157349296557', time=2024-09-12T02:50:00.418280+0000, chain.objs.size()=1 2024-09-12T00:56:19.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.496+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25__shadow_.0WhiM6qmAi17A-xiIzrwOPBxsYkFRf4_0 2024-09-12T00:56:19.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.496+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7953420402852318976', time=2024-09-12T02:50:02.619188+0000, chain.objs.size()=1 2024-09-12T00:56:19.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.496+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.26__shadow_.SNatCMxJWnpd0fJqb3KOXojx4CJB3RH_0 2024-09-12T00:56:19.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.496+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8179711656770720082', time=2024-09-12T02:50:02.686572+0000, chain.objs.size()=1 2024-09-12T00:56:19.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.496+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.26__shadow_.dLxe-xOCVjV18EiIpbKaYmb4PgFcpHx_0 2024-09-12T00:56:19.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.496+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3551713643663856929', time=2024-09-12T02:50:36.180461+0000, chain.objs.size()=1 2024-09-12T00:56:19.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.496+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27__shadow_.MacaaQEiW-qtXIU5YUE7eRcpwuJiCLs_0 2024-09-12T00:56:19.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.496+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13568570368922341267', time=2024-09-12T02:50:36.186691+0000, chain.objs.size()=1 2024-09-12T00:56:19.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.496+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27__shadow_.5FwNArbruTycMZAQyG6LQ_AQRIkWS59_0 2024-09-12T00:56:19.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.496+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15652243419181044584', time=2024-09-12T02:51:52.705296+0000, chain.objs.size()=1 2024-09-12T00:56:19.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.496+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33__shadow_.CdzLifKp2z-ewv-4GMZhH5juVy5lA45_0 2024-09-12T00:56:19.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.497+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15843204957724724660', time=2024-09-12T02:53:02.800392+0000, chain.objs.size()=1 2024-09-12T00:56:19.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.497+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36__shadow_.PLBIdMr7k5z65HiUig80AK5F46IIMWj_0 2024-09-12T00:56:19.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.497+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8018147339977473821', time=2024-09-12T02:53:02.821074+0000, chain.objs.size()=1 2024-09-12T00:56:19.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.497+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36__shadow_.6yBJzxytBp-f1b-t5jaeckEHLdgcEyd_0 2024-09-12T00:56:19.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.497+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10081523588205966961', time=2024-09-12T02:53:05.233869+0000, chain.objs.size()=1 2024-09-12T00:56:19.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.497+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37__shadow_.VYoEyTaC7hIMc0Td71vKSCo9kMClA3n_0 2024-09-12T00:56:19.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.499+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3159109221447704099', time=2024-09-12T02:53:05.259348+0000, chain.objs.size()=1 2024-09-12T00:56:19.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.499+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37__shadow_.oWbakSCJrEPh4nhUOlzE7AhyUbb12Kc_0 2024-09-12T00:56:19.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.499+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13285230943709053918', time=2024-09-12T02:53:07.341562+0000, chain.objs.size()=1 2024-09-12T00:56:19.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.499+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38__shadow_._tThFunYKSqd3zUKRU8nUUK0qUn7MeA_0 2024-09-12T00:56:19.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.499+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11571620591825142074', time=2024-09-12T02:55:47.898109+0000, chain.objs.size()=1 2024-09-12T00:56:19.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.499+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17__shadow_.x4UwqUKLrjxeKNAzSu1PG3rITNP6hxA_0 2024-09-12T00:56:19.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.501+0000 7f73a1346800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:19.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.503+0000 7f73a1346800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:56:19.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.505+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:19.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.505+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:19.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.505+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T00:56:19.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.505+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9446003720218632413', time=2024-09-12T02:47:27.360505+0000, chain.objs.size()=1 2024-09-12T00:56:19.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.505+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4__shadow_.S0vvoNz6lTXzLW7Xsk2QqsZat8Tlku7_0 2024-09-12T00:56:19.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.505+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9323355929891938038', time=2024-09-12T02:48:44.364888+0000, chain.objs.size()=1 2024-09-12T00:56:19.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.505+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19__shadow_.tnBvKj2QzHSqsQpDVzCG8B83SZxAn0R_0 2024-09-12T00:56:19.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.505+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9512343760899160856', time=2024-09-12T02:49:24.219739+0000, chain.objs.size()=1 2024-09-12T00:56:19.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.505+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23__shadow_.WRoyMDsqrxfQwsF62q6Ua-1zH-vZGT1_0 2024-09-12T00:56:19.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.505+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18293915354964824536', time=2024-09-12T02:50:00.410125+0000, chain.objs.size()=1 2024-09-12T00:56:19.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.505+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25__shadow_.rqa_4tfpKxAHvzQCYBsANOPqlLLX7fR_0 2024-09-12T00:56:19.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.505+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2070259208373308142', time=2024-09-12T02:50:00.437416+0000, chain.objs.size()=1 2024-09-12T00:56:19.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.505+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25__shadow_.5X42oW7zlfgkmPQW8OMmHszNAedahMW_0 2024-09-12T00:56:19.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.505+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13151244417562327734', time=2024-09-12T02:50:02.612114+0000, chain.objs.size()=1 2024-09-12T00:56:19.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.505+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.26__shadow_.j88khIxUtz3pIQ87WZ7fLW0UTg0yJf3_0 2024-09-12T00:56:19.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.505+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2615619222649048197', time=2024-09-12T02:50:02.687240+0000, chain.objs.size()=1 2024-09-12T00:56:19.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.505+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.26__shadow_.AL9k5hwY-zjIAnE3UcG9dcduJHTU9YP_0 2024-09-12T00:56:19.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.505+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6357955952342691044', time=2024-09-12T02:51:11.624541+0000, chain.objs.size()=1 2024-09-12T00:56:19.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.505+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29__shadow_.SGf65I_eJhnxFSllRoD2SAq6DVV0JHZ_0 2024-09-12T00:56:19.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.506+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15162792625712386821', time=2024-09-12T02:51:52.753670+0000, chain.objs.size()=1 2024-09-12T00:56:19.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.506+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33__shadow_.QGSQC29puweAGLuRmz7mdUd-kXNqh9A_0 2024-09-12T00:56:19.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.506+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3252723351113172100', time=2024-09-12T02:52:25.838815+0000, chain.objs.size()=1 2024-09-12T00:56:19.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.506+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34__shadow_.9rSEqGGQWWm2q-ZsG_8MYaGZyvMctoe_0 2024-09-12T00:56:19.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.506+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11612443173121363553', time=2024-09-12T02:52:29.042209+0000, chain.objs.size()=1 2024-09-12T00:56:19.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.506+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35__shadow_.4wkuD-KyN92KOLpHVWXYsUVhockomBf_0 2024-09-12T00:56:19.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.506+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12629001526251909434', time=2024-09-12T02:53:02.841397+0000, chain.objs.size()=1 2024-09-12T00:56:19.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.506+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36__shadow_.s1fRCCZ8GEby2prHMqPJ6zabTjqbIfJ_0 2024-09-12T00:56:19.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.507+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11364618616476853988', time=2024-09-12T02:53:40.170697+0000, chain.objs.size()=1 2024-09-12T00:56:19.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.507+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39__shadow_.FM189am4SDUiFe-OUoWs2O9oIFH6ofP_0 2024-09-12T00:56:19.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.507+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3786111080427704033', time=2024-09-12T02:55:47.903297+0000, chain.objs.size()=1 2024-09-12T00:56:19.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.507+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17__shadow_.7GI9slAy3gKzFI1COVRkrwWlHvALmYb_0 2024-09-12T00:56:19.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.509+0000 7f73a1346800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:19.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.511+0000 7f73a1346800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:56:19.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.512+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:19.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.512+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:19.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.513+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-12T00:56:19.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.513+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6849704977173778872', time=2024-09-12T02:47:27.610698+0000, chain.objs.size()=1 2024-09-12T00:56:19.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.513+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13__shadow_.KhIEgt2jP4zxmtwymXt_rbOIIFcdAuV_0 2024-09-12T00:56:19.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.513+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15346624303836636419', time=2024-09-12T02:48:46.491221+0000, chain.objs.size()=1 2024-09-12T00:56:19.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.513+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.20__shadow_.LhFf_eUsjyQWnHHhozAmPbdB1ysVx8j_0 2024-09-12T00:56:19.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.513+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17307171291795206859', time=2024-09-12T02:49:21.904532+0000, chain.objs.size()=1 2024-09-12T00:56:19.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.513+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22__shadow_.83pgoJQG6FLn7i9aNXjyzpgRM1EvsIH_0 2024-09-12T00:56:19.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.513+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.566237904158560208', time=2024-09-12T02:49:57.934443+0000, chain.objs.size()=1 2024-09-12T00:56:19.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.513+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24__shadow_.QhmUT6bXHQZY7MrMPMvIgnMaxuAvW2w_0 2024-09-12T00:56:19.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.513+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7345666775118773420', time=2024-09-12T02:50:02.708974+0000, chain.objs.size()=1 2024-09-12T00:56:19.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.513+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.26__shadow_.cOwXexSGD9qGVdzbv6LJzD0vBxXKMqU_0 2024-09-12T00:56:19.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.513+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4165288451483208898', time=2024-09-12T02:50:38.466296+0000, chain.objs.size()=1 2024-09-12T00:56:19.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.513+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28__shadow_.CGEn9hd34_5ZWqFc-tapxz1w9f4IeaX_0 2024-09-12T00:56:19.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.513+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11435166617722773978', time=2024-09-12T02:50:40.561341+0000, chain.objs.size()=1 2024-09-12T00:56:19.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.513+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29__shadow_.u4N3iOEGG516Ctr0XTcGf2IiX7mM3G0_0 2024-09-12T00:56:19.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.513+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1230747555077865434', time=2024-09-12T02:52:29.076420+0000, chain.objs.size()=1 2024-09-12T00:56:19.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.513+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35__shadow_.gw06vAwqp8uACnmeFncdrjIv8BtPduc_0 2024-09-12T00:56:19.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.513+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8259441068568964958', time=2024-09-12T02:53:05.243058+0000, chain.objs.size()=1 2024-09-12T00:56:19.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.513+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37__shadow_.-nliH3BObcnieS-tRVe0YKiJLaSL6HN_0 2024-09-12T00:56:19.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.513+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9837510340203161225', time=2024-09-12T02:53:05.282560+0000, chain.objs.size()=1 2024-09-12T00:56:19.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.513+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37__shadow_.hT2n5DQTN-AiBFc8cRXtXwbJFVHCmsd_0 2024-09-12T00:56:19.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.515+0000 7f73a1346800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:19.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.517+0000 7f73a1346800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:56:19.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.519+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:19.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.519+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:19.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.519+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T00:56:19.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.519+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11736093612082126775', time=2024-09-12T02:47:27.367683+0000, chain.objs.size()=1 2024-09-12T00:56:19.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.519+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4__shadow_.NpKSR2gnY-v3tY2F937Qkd_W5phOVWy_0 2024-09-12T00:56:19.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.519+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8103039430912568584', time=2024-09-12T02:49:24.183130+0000, chain.objs.size()=1 2024-09-12T00:56:19.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.519+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23__shadow_.yZKak_RXdAmGMcqPe6rn2ZEwTnkh3Xt_0 2024-09-12T00:56:19.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.519+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10050423611198748157', time=2024-09-12T02:49:24.183736+0000, chain.objs.size()=1 2024-09-12T00:56:19.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.519+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23__shadow_.xaI3PJBMrLw6SD370AfvLJT3_j-ZinC_0 2024-09-12T00:56:19.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.519+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15285246174623107346', time=2024-09-12T02:50:02.667860+0000, chain.objs.size()=1 2024-09-12T00:56:19.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.519+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.26__shadow_.YKGQkIiVkz4mb-EZNI56W45M83wSfsl_0 2024-09-12T00:56:19.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.519+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6779580115122133902', time=2024-09-12T02:50:38.447367+0000, chain.objs.size()=1 2024-09-12T00:56:19.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.519+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28__shadow_.rR-sRlous_nYnWzYCL5J9MdNKoQmXuG_0 2024-09-12T00:56:19.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.519+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11405093270487182672', time=2024-09-12T02:51:11.637943+0000, chain.objs.size()=1 2024-09-12T00:56:19.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.519+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29__shadow_.7gLJNcHVr346SNuUCEFIrNwUcZfDnBL_0 2024-09-12T00:56:19.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.519+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14899226452656336902', time=2024-09-12T02:51:14.465850+0000, chain.objs.size()=1 2024-09-12T00:56:19.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.520+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30__shadow_.uY-_BLLI2sqmJRN6SNXKluUnRAglOZx_0 2024-09-12T00:56:19.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.520+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2251582447053268964', time=2024-09-12T02:51:50.074195+0000, chain.objs.size()=1 2024-09-12T00:56:19.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.520+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32__shadow_.Hjs_0G39K3yAudhrR4NH4ZvVDKNIweL_0 2024-09-12T00:56:19.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.520+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16790878119210209287', time=2024-09-12T02:52:25.855956+0000, chain.objs.size()=1 2024-09-12T00:56:19.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.520+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34__shadow_.hWuTk7kfJ6T89VQDXIkhwKPJDXi9iGf_0 2024-09-12T00:56:19.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.520+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5026368708117240092', time=2024-09-12T02:52:29.111691+0000, chain.objs.size()=1 2024-09-12T00:56:19.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.520+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35__shadow_.1l6JMdg9j_vhabMxaFUOHdCpId8MQLu_0 2024-09-12T00:56:19.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.520+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14967534645289650692', time=2024-09-12T02:52:29.120191+0000, chain.objs.size()=1 2024-09-12T00:56:19.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.520+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35__shadow_.9BMA5YmuWOUlEYAFsZr1Z578pDtyioj_0 2024-09-12T00:56:19.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.520+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12092091629904182851', time=2024-09-12T02:53:02.841967+0000, chain.objs.size()=1 2024-09-12T00:56:19.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.520+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36__shadow_.CZXS0Hq2IbKU6crjIsgiMippqfW1u_V_0 2024-09-12T00:56:19.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.522+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15472706235152956974', time=2024-09-12T02:53:05.231092+0000, chain.objs.size()=1 2024-09-12T00:56:19.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.522+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37__shadow_.1wqPjOwcbtP7qRQBWjhE4EuVYsy4yU1_0 2024-09-12T00:56:19.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.523+0000 7f73a1346800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:19.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.525+0000 7f73a1346800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:56:19.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.526+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:19.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.526+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:19.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.527+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T00:56:19.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.527+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='_NXG055-zbp9hnIimeiu-Zx69ijxc73v', time=2024-09-12T02:47:27.478176+0000, chain.objs.size()=1 2024-09-12T00:56:19.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.527+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15__shadow_.gw494sD7G-Jv1_xYfYo6qM5XhwYrAvx_0 2024-09-12T00:56:19.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.527+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='_XkAVz5trFvzaR83zVXZnrQe053B_a5q', time=2024-09-12T02:47:27.528786+0000, chain.objs.size()=2 2024-09-12T00:56:19.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.527+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__shadow_.ICXNd9yTTngyK0y_W14IHGNCCyJ1TBo_0 2024-09-12T00:56:19.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.527+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__shadow_.ICXNd9yTTngyK0y_W14IHGNCCyJ1TBo_1 2024-09-12T00:56:19.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.527+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6942076131429465990', time=2024-09-12T02:47:27.658406+0000, chain.objs.size()=1 2024-09-12T00:56:19.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.527+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7__shadow_.CwcpolRkhJVE6sJkkhPafRllt3_mmra_0 2024-09-12T00:56:19.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.527+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10067391491171527342', time=2024-09-12T02:48:46.491256+0000, chain.objs.size()=1 2024-09-12T00:56:19.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.527+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.20__shadow_.CgNDnyXpFl9yfMoJ1_4ww-tdho1m3fw_0 2024-09-12T00:56:19.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.527+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13236630792234221760', time=2024-09-12T02:49:21.845533+0000, chain.objs.size()=1 2024-09-12T00:56:19.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.527+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22__shadow_.wAy74x5BkdNmuiceHXcbG_3rJyIxTGa_0 2024-09-12T00:56:19.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.527+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8297512259399632059', time=2024-09-12T02:50:00.387063+0000, chain.objs.size()=1 2024-09-12T00:56:19.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.527+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25__shadow_.fmBVQLHwKb8Z03BPRRTwH5Hx8FgCan5_0 2024-09-12T00:56:19.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.527+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13436951681070261849', time=2024-09-12T02:50:00.388447+0000, chain.objs.size()=1 2024-09-12T00:56:19.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.527+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25__shadow_.WpGWDvRPFOb4wg7iOKUTgSiefUap-jI_0 2024-09-12T00:56:19.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.527+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5851721869450192164', time=2024-09-12T02:50:36.225626+0000, chain.objs.size()=1 2024-09-12T00:56:19.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.527+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27__shadow_.FI9ZC-g-4lqpiX4quSvnlttUchhZtBa_0 2024-09-12T00:56:19.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.527+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9748584966389538741', time=2024-09-12T02:50:36.226390+0000, chain.objs.size()=1 2024-09-12T00:56:19.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.527+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27__shadow_.cdkUzqjaNfI5y3xMbRox0j48aXL4Bb7_0 2024-09-12T00:56:19.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.527+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2413443758864181025', time=2024-09-12T02:50:36.263758+0000, chain.objs.size()=1 2024-09-12T00:56:19.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.527+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27__shadow_.ELjsl93E3-A3oi25SLUnxmzpnfzZpZn_0 2024-09-12T00:56:19.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.527+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10135151025356571909', time=2024-09-12T02:51:50.042712+0000, chain.objs.size()=1 2024-09-12T00:56:19.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.527+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32__shadow_.0T2hyF6PZXjyfpWDYJOnDhL-tfKjUkh_0 2024-09-12T00:56:19.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.530+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4202844343137660484', time=2024-09-12T02:51:50.074424+0000, chain.objs.size()=1 2024-09-12T00:56:19.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.530+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32__shadow_.oUCWuAORi-ucEyt3VpUQrbLEnFnnxGQ_0 2024-09-12T00:56:19.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.530+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1416983055014335460', time=2024-09-12T02:51:50.075261+0000, chain.objs.size()=1 2024-09-12T00:56:19.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.530+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32__shadow_.GkAHRjKksIS5stlAyck9CySn42hRXrw_0 2024-09-12T00:56:19.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.530+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14365244812763990130', time=2024-09-12T02:51:50.094127+0000, chain.objs.size()=1 2024-09-12T00:56:19.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.530+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32__shadow_.egAFeN-hqOzkvx-OA5Puo8fm9_mfk1V_0 2024-09-12T00:56:19.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.530+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10195732612292042422', time=2024-09-12T02:51:52.716372+0000, chain.objs.size()=1 2024-09-12T00:56:19.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.530+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33__shadow_.kL2Ovq9xDlmTMZwvIC_3q_Lpgr3m-4N_0 2024-09-12T00:56:19.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.530+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3895725359789264958', time=2024-09-12T02:51:52.750768+0000, chain.objs.size()=1 2024-09-12T00:56:19.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.530+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33__shadow_.FvKWJQu2HSvbHGx_uzwMPm8nOS7gGoU_0 2024-09-12T00:56:19.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.530+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10519606789315852466', time=2024-09-12T02:52:25.916023+0000, chain.objs.size()=1 2024-09-12T00:56:19.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.530+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34__shadow_.DiEgUTN_wriu81Oi4aQOKhsMOFzuN89_0 2024-09-12T00:56:19.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.530+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18269299298158229281', time=2024-09-12T02:53:02.801463+0000, chain.objs.size()=1 2024-09-12T00:56:19.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.530+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36__shadow_.ORLbBnRt9LvPqM1h9XpA0A4vBWL-B0B_0 2024-09-12T00:56:19.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.530+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18256105562184297501', time=2024-09-12T02:53:07.306752+0000, chain.objs.size()=1 2024-09-12T00:56:19.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.530+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38__shadow_.tgOLTawBeA0lx5UcnQYvI9rKL0pC39J_0 2024-09-12T00:56:19.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.530+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6613454464416437685', time=2024-09-12T02:53:07.341076+0000, chain.objs.size()=1 2024-09-12T00:56:19.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.530+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38__shadow_.EVf_1nBY6mp4NfjM-UlqC7jasZXrkT5_0 2024-09-12T00:56:19.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.532+0000 7f73a1346800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:19.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.534+0000 7f73a1346800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:56:19.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.535+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:19.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.536+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:19.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.536+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T00:56:19.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.536+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='_vyckHBFOi1nYdBPCsTU4kKr4Cvwzr7K', time=2024-09-12T02:47:27.560608+0000, chain.objs.size()=1 2024-09-12T00:56:19.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.536+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__shadow_.yFbI6YrD9OC9X9BIO2tOddQfG5SLnx8_0 2024-09-12T00:56:19.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.536+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14526118791914064140', time=2024-09-12T02:47:27.677675+0000, chain.objs.size()=1 2024-09-12T00:56:19.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.536+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8__shadow_.fakDfpA1UER1-AvDEg2flsSZLaWvIg3_0 2024-09-12T00:56:19.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.536+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8690751587977264304', time=2024-09-12T02:48:44.371998+0000, chain.objs.size()=1 2024-09-12T00:56:19.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.536+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19__shadow_.heChOvi9B3AmJa5AGdKfl-qPoGKHJVq_0 2024-09-12T00:56:19.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.536+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3064373763683115853', time=2024-09-12T02:49:58.003420+0000, chain.objs.size()=1 2024-09-12T00:56:19.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.536+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24__shadow_.YW7DZMG79NAEGKHGzrSpElwIW6C_kZv_0 2024-09-12T00:56:19.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.536+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13808746188235450141', time=2024-09-12T02:50:00.417736+0000, chain.objs.size()=1 2024-09-12T00:56:19.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.536+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25__shadow_.Ec2kGt50hhS5YpqrIGO-3ToWrw6z4WY_0 2024-09-12T00:56:19.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.536+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16415872759562512749', time=2024-09-12T02:51:11.626967+0000, chain.objs.size()=1 2024-09-12T00:56:19.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.536+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29__shadow_.eFwsOmq6Eik8F3dQGGW3faYEHlxi696_0 2024-09-12T00:56:19.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.536+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4383166391336360046', time=2024-09-12T02:51:14.482494+0000, chain.objs.size()=1 2024-09-12T00:56:19.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.536+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30__shadow_.dLDQMkw0k5yvto__g4UYVgK9I-P85-l_0 2024-09-12T00:56:19.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.536+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1196319130610815751', time=2024-09-12T02:52:25.824050+0000, chain.objs.size()=1 2024-09-12T00:56:19.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.536+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34__shadow_.xAy4aOeqERpgkzxXrst6pBscbGS0pUe_0 2024-09-12T00:56:19.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.536+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11814826154170021827', time=2024-09-12T02:52:25.835377+0000, chain.objs.size()=1 2024-09-12T00:56:19.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.536+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34__shadow_.-_BPjxztwDzMuNu1oAlzipDqhgRwwF5_0 2024-09-12T00:56:19.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.536+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1078886418432024463', time=2024-09-12T02:52:29.037124+0000, chain.objs.size()=1 2024-09-12T00:56:19.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.536+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35__shadow_.WZumqa68-i6MC8jgKa5bZbRiNkVMPkK_0 2024-09-12T00:56:19.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.536+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.573293607092347690', time=2024-09-12T02:52:29.077631+0000, chain.objs.size()=1 2024-09-12T00:56:19.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.536+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35__shadow_.CexcOhKh6eKL9sFxzhF3bKMTtcGFSg1_0 2024-09-12T00:56:19.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.536+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4001140760364850073', time=2024-09-12T02:53:05.262933+0000, chain.objs.size()=1 2024-09-12T00:56:19.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.536+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37__shadow_.1YOMu3aGlAl-PZ1kGbfGkJmTtnR0hep_0 2024-09-12T00:56:19.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.538+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12400894560700395992', time=2024-09-12T02:53:40.153529+0000, chain.objs.size()=1 2024-09-12T00:56:19.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.538+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39__shadow_.pioX2Km024C_BKJDGiHxKOHYxbc-Uyk_0 2024-09-12T00:56:19.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.538+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12906025532740134232', time=2024-09-12T02:55:47.903816+0000, chain.objs.size()=1 2024-09-12T00:56:19.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.538+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17__shadow_.8M92Y0Fm48fD5AfdQi1vjuymnxaeqvC_0 2024-09-12T00:56:19.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.539+0000 7f73a1346800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:19.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.541+0000 7f73a1346800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:56:19.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.542+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:19.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.543+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:19.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.543+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=22, truncated=0, next_marker='' 2024-09-12T00:56:19.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.543+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12644898477813733443', time=2024-09-12T02:47:27.364141+0000, chain.objs.size()=1 2024-09-12T00:56:19.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.543+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4__shadow_.yBdlkS6jVxsvpUsVq0HJ2ejCu68RDS-_0 2024-09-12T00:56:19.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.543+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13197240827817767882', time=2024-09-12T02:47:27.371826+0000, chain.objs.size()=1 2024-09-12T00:56:19.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.543+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4__shadow_.RPaK2lE1mYm5zEARllaUd0qAe_MsUgf_0 2024-09-12T00:56:19.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.543+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='_Dm3Y2RNqPbFbDKfJU458C5UE2gkoxgL', time=2024-09-12T02:47:27.485759+0000, chain.objs.size()=1 2024-09-12T00:56:19.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.543+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15__shadow_.5nAPTX9vR1cYx6UIohL5kzWbty6YlfO_0 2024-09-12T00:56:19.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.543+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2348924899500435515', time=2024-09-12T02:47:27.501853+0000, chain.objs.size()=1 2024-09-12T00:56:19.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.543+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15__shadow_.YSW08tBacgAGg43NOtRlJgDa2n4exnj_0 2024-09-12T00:56:19.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.543+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17008245754973181792', time=2024-09-12T02:47:27.651109+0000, chain.objs.size()=1 2024-09-12T00:56:19.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.543+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7__shadow_.lDHFuhqJvPhxRqflq2x9T6-MDjoNa_8_0 2024-09-12T00:56:19.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.543+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5910687835959758163', time=2024-09-12T02:47:27.654629+0000, chain.objs.size()=1 2024-09-12T00:56:19.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.543+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7__shadow_.Yss9QKrJFgQetzU5MRdQSuotyhNh4-s_0 2024-09-12T00:56:19.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.543+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3866740131705771899', time=2024-09-12T02:48:44.327726+0000, chain.objs.size()=1 2024-09-12T00:56:19.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.543+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19__shadow_.NCCCfxg7vfFMF2nveIYvYXyFUAG0PFt_0 2024-09-12T00:56:19.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.543+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2909606485541576871', time=2024-09-12T02:48:44.388624+0000, chain.objs.size()=1 2024-09-12T00:56:19.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.543+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19__shadow_.wjAgTx3Sf7y2Zs0dg-bcytRyJg0iLgh_0 2024-09-12T00:56:19.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.543+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4849081625671429911', time=2024-09-12T02:48:48.594188+0000, chain.objs.size()=1 2024-09-12T00:56:19.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.543+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21__shadow_.FwHrIET6HW8GX2yqaWFl_0gQdtRxW5__0 2024-09-12T00:56:19.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.543+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16908515954189786582', time=2024-09-12T02:49:19.452339+0000, chain.objs.size()=1 2024-09-12T00:56:19.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.543+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21__shadow_.9flwDcvAYCLFKBdVQ2a0jd3UI3gmJDD_0 2024-09-12T00:56:19.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.543+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.983001998532520380', time=2024-09-12T02:49:24.167637+0000, chain.objs.size()=1 2024-09-12T00:56:19.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.543+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23__shadow_.CK5s21Br2TcrNar7vmqHSoxRjmMwx-0_0 2024-09-12T00:56:19.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.543+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4245254444816358972', time=2024-09-12T02:51:11.626759+0000, chain.objs.size()=1 2024-09-12T00:56:19.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.543+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29__shadow_.Ve-YzLSzORuyQFo4jUtQ7XZApAy3QCE_0 2024-09-12T00:56:19.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.545+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17980608619645796856', time=2024-09-12T02:51:16.510740+0000, chain.objs.size()=1 2024-09-12T00:56:19.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.545+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31__shadow_.NntWZ5uJ7BfeHCTQ1qyRinWYRP6FIRl_0 2024-09-12T00:56:19.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.545+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17230910243553807171', time=2024-09-12T02:51:52.728858+0000, chain.objs.size()=1 2024-09-12T00:56:19.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.545+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33__shadow_.n0U-essbCl2MTPovQaDqkynaqEsc2KF_0 2024-09-12T00:56:19.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.546+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17192957206050563677', time=2024-09-12T02:51:52.747915+0000, chain.objs.size()=1 2024-09-12T00:56:19.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.546+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33__shadow_.1FoKxD_PJ1YycJhxSZwOSBbqUswFSu__0 2024-09-12T00:56:19.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.546+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10282787240478426733', time=2024-09-12T02:52:25.857156+0000, chain.objs.size()=1 2024-09-12T00:56:19.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.546+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34__shadow_.T9tcD-JHNzZ-93drtZKQUKVsoAhFFLf_0 2024-09-12T00:56:19.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.546+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13642036359423975275', time=2024-09-12T02:52:29.037945+0000, chain.objs.size()=1 2024-09-12T00:56:19.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.546+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35__shadow_.7UFUAr7nr8zJaDouTxtYPDzIFUsJUck_0 2024-09-12T00:56:19.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.546+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12996445734374164080', time=2024-09-12T02:52:29.052294+0000, chain.objs.size()=1 2024-09-12T00:56:19.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.546+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35__shadow_.Gvj7jJf_KohnFi5d-mWTggYNCyqDML0_0 2024-09-12T00:56:19.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.546+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9889232321676706161', time=2024-09-12T02:52:30.952458+0000, chain.objs.size()=1 2024-09-12T00:56:19.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.546+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36__shadow_.1SVDU2HJhRvHi7awS7dwDmYoVkCWju-_0 2024-09-12T00:56:19.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.546+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14062562419321747502', time=2024-09-12T02:53:02.802165+0000, chain.objs.size()=1 2024-09-12T00:56:19.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.546+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36__shadow_._6YCoj38OHLkX6D0VL7c7b7nR9WF_Mb_0 2024-09-12T00:56:19.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.546+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.807860707129484059', time=2024-09-12T02:55:47.896148+0000, chain.objs.size()=1 2024-09-12T00:56:19.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.546+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17__shadow_.Cek0ZbvVXxT8TFtooSlWm-lWwppjrF0_0 2024-09-12T00:56:19.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.546+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8682937729336015637', time=2024-09-12T02:55:47.922151+0000, chain.objs.size()=1 2024-09-12T00:56:19.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.546+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17__shadow_.PZVtJw6tokLDo382AVAinU9lNobA7Ct_0 2024-09-12T00:56:19.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.548+0000 7f73a1346800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:19.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.551+0000 7f73a1346800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:56:19.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.552+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:19.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.552+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:19.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.553+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-12T00:56:19.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.553+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8037276550306321580', time=2024-09-12T02:47:27.344375+0000, chain.objs.size()=1 2024-09-12T00:56:19.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.553+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4__shadow_.--rx3SYTklAfYxY01RzpadvHjYmb0ku_0 2024-09-12T00:56:19.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.553+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.792716896861580286', time=2024-09-12T02:49:24.180076+0000, chain.objs.size()=1 2024-09-12T00:56:19.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.553+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23__shadow_.HR6g-swFKVtL7b-iUZhhA5pXQ2uJsBT_0 2024-09-12T00:56:19.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.553+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11867978598580413617', time=2024-09-12T02:49:59.501275+0000, chain.objs.size()=1 2024-09-12T00:56:19.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.553+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25__shadow_.F8D4FuO6mf4pWfnBoGznW4h8cB0TElz_0 2024-09-12T00:56:19.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.553+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4985449856523194270', time=2024-09-12T02:50:36.220166+0000, chain.objs.size()=1 2024-09-12T00:56:19.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.553+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27__shadow_.MCIp8TCkUxKlvtHna0-VjSxMYkyR76b_0 2024-09-12T00:56:19.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.553+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7023178470332404138', time=2024-09-12T02:50:36.224572+0000, chain.objs.size()=1 2024-09-12T00:56:19.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.553+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27__shadow_.dj8P8W5fa25yrNiIjf6Z5FOUQJvzoND_0 2024-09-12T00:56:19.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.553+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12949459925562466901', time=2024-09-12T02:50:38.456608+0000, chain.objs.size()=1 2024-09-12T00:56:19.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.553+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28__shadow_.FGwPQRR39i63n8zStPWov3mSd3cfyU4_0 2024-09-12T00:56:19.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.553+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13071943036964406618', time=2024-09-12T02:51:14.441703+0000, chain.objs.size()=1 2024-09-12T00:56:19.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.553+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30__shadow_.51nhfDXIYd5M6CU_Gm8bnqA2UhKIRKq_0 2024-09-12T00:56:19.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.553+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12252372383529103335', time=2024-09-12T02:51:14.505869+0000, chain.objs.size()=1 2024-09-12T00:56:19.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.553+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30__shadow_.OpTFrP_TeoRB91fxKuW8emqJdLS3NcS_0 2024-09-12T00:56:19.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.553+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10596587991096697051', time=2024-09-12T02:51:16.497957+0000, chain.objs.size()=1 2024-09-12T00:56:19.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.553+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31__shadow_.lYKdBrKpsGC3qm-6AoZUzsDFA548D5C_0 2024-09-12T00:56:19.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.553+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.467654613064580315', time=2024-09-12T02:52:29.078839+0000, chain.objs.size()=1 2024-09-12T00:56:19.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.553+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35__shadow_.EdWEeR3eXSvy_tFg1Zak6xhuC8ZxK1r_0 2024-09-12T00:56:19.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.555+0000 7f73a1346800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:19.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.557+0000 7f73a1346800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:56:19.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.558+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:19.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.559+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:19.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.559+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T00:56:19.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.559+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7907179862597881335', time=2024-09-12T02:47:27.474224+0000, chain.objs.size()=1 2024-09-12T00:56:19.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.559+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15__shadow_.FQZRgj7kU-hpMCJLEyI7BIhl1X_wDmq_0 2024-09-12T00:56:19.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.559+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5508765108627386703', time=2024-09-12T02:48:44.313821+0000, chain.objs.size()=1 2024-09-12T00:56:19.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.559+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19__shadow_.wkTi9AJslKXXqiNEa6yn6BFtNrow5UE_0 2024-09-12T00:56:19.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.559+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9144604806192181088', time=2024-09-12T02:48:44.327745+0000, chain.objs.size()=1 2024-09-12T00:56:19.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.559+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19__shadow_.EhggxkgdqzmE52IEVGGVE2obI1fW0sF_0 2024-09-12T00:56:19.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.559+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17981925920046239263', time=2024-09-12T02:48:46.510587+0000, chain.objs.size()=1 2024-09-12T00:56:19.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.559+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.20__shadow_.LfSoY_3ws6C-i263Mu-4ztHy7MbmTWl_0 2024-09-12T00:56:19.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.559+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12288489117017373870', time=2024-09-12T02:49:19.409701+0000, chain.objs.size()=1 2024-09-12T00:56:19.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.559+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21__shadow_.h-9d0OAoQxEoan2TQC5vR2YrKn4NeTV_0 2024-09-12T00:56:19.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.559+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4437824229269387960', time=2024-09-12T02:49:19.473187+0000, chain.objs.size()=1 2024-09-12T00:56:19.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.559+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21__shadow_.bPyH1fwT4iHTaS2au3LSzTjC7jJohTn_0 2024-09-12T00:56:19.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.559+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8388458514892179658', time=2024-09-12T02:50:02.614856+0000, chain.objs.size()=1 2024-09-12T00:56:19.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.559+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.26__shadow_.R6V_Ip0x08y6gqUeBoD0M6pPQkRX2Pf_0 2024-09-12T00:56:19.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.559+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7514610732404156301', time=2024-09-12T02:50:38.428550+0000, chain.objs.size()=1 2024-09-12T00:56:19.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.559+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28__shadow_.TH_eKqDHCG-trTiycDGoLiWAilZPOzO_0 2024-09-12T00:56:19.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.559+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11433378578780499000', time=2024-09-12T02:51:52.646616+0000, chain.objs.size()=1 2024-09-12T00:56:19.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.559+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33__shadow_.lz8xnT1dw9XmrwOPPOteZjaQdFLn_91_0 2024-09-12T00:56:19.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.559+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2358294293652414209', time=2024-09-12T02:53:02.802201+0000, chain.objs.size()=1 2024-09-12T00:56:19.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.559+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36__shadow_.o0TsWcXBuSks6ApKKW0FzV2vVUp2KO2_0 2024-09-12T00:56:19.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.559+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3334663013327771278', time=2024-09-12T02:53:02.865226+0000, chain.objs.size()=1 2024-09-12T00:56:19.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.559+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36__shadow_.gRQxodCOZkIwcx14sHpBWm740V5akIf_0 2024-09-12T00:56:19.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.559+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12240148521037309910', time=2024-09-12T02:53:05.214875+0000, chain.objs.size()=1 2024-09-12T00:56:19.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.559+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37__shadow_.lAnc-eHDwRRh36nJlnPdzypF347lFor_0 2024-09-12T00:56:19.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.561+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4427909947679935511', time=2024-09-12T02:53:07.286246+0000, chain.objs.size()=1 2024-09-12T00:56:19.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.561+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38__shadow_.D8m1gv3ynIGEhLPEyj5YhZ4GbkKrjNT_0 2024-09-12T00:56:19.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.561+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5034306035149550347', time=2024-09-12T02:53:07.299654+0000, chain.objs.size()=1 2024-09-12T00:56:19.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.561+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38__shadow_.uYriEmnYzuauWSkqz7aGZkOEwCqNug5_0 2024-09-12T00:56:19.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.561+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13219837070253163163', time=2024-09-12T02:53:07.320064+0000, chain.objs.size()=1 2024-09-12T00:56:19.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.561+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38__shadow_.2vv4XppqRuNCWyKQrZM8FyJpCCYF0Xy_0 2024-09-12T00:56:19.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.561+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3445837494718563405', time=2024-09-12T02:53:40.149431+0000, chain.objs.size()=1 2024-09-12T00:56:19.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.561+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39__shadow_.WboD9nsJvH4G25G4U9nMaO9PiRsNApK_0 2024-09-12T00:56:19.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.563+0000 7f73a1346800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:19.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.565+0000 7f73a1346800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:56:19.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.566+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:19.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.567+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:19.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.567+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T00:56:19.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.567+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11395806791327694308', time=2024-09-12T02:47:27.404969+0000, chain.objs.size()=4 2024-09-12T00:56:19.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.567+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12__multipart_foo.2~HtpRUiqdFt-xF10uCKJ6o9MuGTOkubb.1 2024-09-12T00:56:19.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.567+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12__multipart_foo.2~HtpRUiqdFt-xF10uCKJ6o9MuGTOkubb.2 2024-09-12T00:56:19.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.567+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12__multipart_foo.2~HtpRUiqdFt-xF10uCKJ6o9MuGTOkubb.3 2024-09-12T00:56:19.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.567+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12__multipart_foo.2~HtpRUiqdFt-xF10uCKJ6o9MuGTOkubb.4 2024-09-12T00:56:19.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.567+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='_3a2TbOY7-6t-SU7ASR8NszI8-IpWjb2', time=2024-09-12T02:47:27.533071+0000, chain.objs.size()=2 2024-09-12T00:56:19.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.567+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__shadow_.gqR8mzMEa0uPAmpObwz0vr8Ln4MSQk9_0 2024-09-12T00:56:19.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.567+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__shadow_.gqR8mzMEa0uPAmpObwz0vr8Ln4MSQk9_1 2024-09-12T00:56:19.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.567+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13875997832120842044', time=2024-09-12T02:49:19.434464+0000, chain.objs.size()=1 2024-09-12T00:56:19.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.567+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21__shadow_.ZIDW_JRvvO8xWSKpNpkIMgnwjyWZdEK_0 2024-09-12T00:56:19.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.567+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15878532766119043426', time=2024-09-12T02:49:19.484676+0000, chain.objs.size()=1 2024-09-12T00:56:19.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.567+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21__shadow_.Os5PCQo4sk1xeNmlLPCvftpYGpv1bdN_0 2024-09-12T00:56:19.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.567+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1022245273635514381', time=2024-09-12T02:50:02.653411+0000, chain.objs.size()=1 2024-09-12T00:56:19.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.567+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.26__shadow_.S5QS4cWpUODHdXf8PM8w6t7Avs3F9p6_0 2024-09-12T00:56:19.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.567+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4720666604765326195', time=2024-09-12T02:50:38.499266+0000, chain.objs.size()=1 2024-09-12T00:56:19.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.567+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28__shadow_.LdjdcEpK7hL9wVXRdCD320O7O7or5lL_0 2024-09-12T00:56:19.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.567+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5411586723067345705', time=2024-09-12T02:51:11.624630+0000, chain.objs.size()=1 2024-09-12T00:56:19.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.567+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29__shadow_.YM6rh22K6Og8h06979CF9WzxDXTOPE__0 2024-09-12T00:56:19.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.567+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6356833423790834378', time=2024-09-12T02:51:11.670256+0000, chain.objs.size()=1 2024-09-12T00:56:19.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.567+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29__shadow_.hA2QL-Fnz8Z-2PloAPREtNQanhswM6m_0 2024-09-12T00:56:19.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.569+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14253261651422579087', time=2024-09-12T02:51:14.475282+0000, chain.objs.size()=1 2024-09-12T00:56:19.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.569+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30__shadow_.3kzXtWgSirUxQ7wovl7cPn7pO_VGdJN_0 2024-09-12T00:56:19.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.569+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5015525261064219550', time=2024-09-12T02:51:16.510081+0000, chain.objs.size()=1 2024-09-12T00:56:19.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.569+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31__shadow_.EoSy1ScYqJYIEmqDAmd3-KtJxvjN4H9_0 2024-09-12T00:56:19.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.569+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18411899457212461263', time=2024-09-12T02:51:16.570813+0000, chain.objs.size()=1 2024-09-12T00:56:19.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.569+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31__shadow_.U6jFE9k4Xdzzi5eW9xgNPFCZ0qr0tRk_0 2024-09-12T00:56:19.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.570+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10359492172768494227', time=2024-09-12T02:51:50.044187+0000, chain.objs.size()=1 2024-09-12T00:56:19.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.570+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32__shadow_.2-cZKdyqzlscI5yvn0Ibyd-t43yUzRl_0 2024-09-12T00:56:19.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.570+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18141336472127529675', time=2024-09-12T02:52:25.880205+0000, chain.objs.size()=1 2024-09-12T00:56:19.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.570+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34__shadow_.G_9od9y_7h5Qes1vDmKK5pzCrjX95Hv_0 2024-09-12T00:56:19.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.571+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5964960105218919486', time=2024-09-12T02:52:25.880898+0000, chain.objs.size()=1 2024-09-12T00:56:19.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.571+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34__shadow_.S8gCm57hhYTsSACyDagX-sizeJe7UTi_0 2024-09-12T00:56:19.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.571+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1555110288454749784', time=2024-09-12T02:52:29.086769+0000, chain.objs.size()=1 2024-09-12T00:56:19.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.571+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35__shadow_.uk9VpEmJw6SWiEkOJoanF6bGpjTsUxI_0 2024-09-12T00:56:19.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.571+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14242586149642502216', time=2024-09-12T02:53:40.113221+0000, chain.objs.size()=1 2024-09-12T00:56:19.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.571+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39__shadow_.hX2VFa74v3yvHvnkpDC2v8nSH_KTWzz_0 2024-09-12T00:56:19.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.572+0000 7f73a1346800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:19.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.575+0000 7f73a1346800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:56:19.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.576+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:19.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.577+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:19.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.577+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T00:56:19.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.577+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13104223196468160585', time=2024-09-12T02:47:27.587717+0000, chain.objs.size()=3 2024-09-12T00:56:19.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.577+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14__multipart_foo-STANDARD.2~am8BmrJtyXPwA0py_SVpMRvLgr0ID02.1 2024-09-12T00:56:19.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.577+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14__multipart_foo-STANDARD.2~am8BmrJtyXPwA0py_SVpMRvLgr0ID02.2 2024-09-12T00:56:19.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.577+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14__multipart_foo-STANDARD.2~am8BmrJtyXPwA0py_SVpMRvLgr0ID02.3 2024-09-12T00:56:19.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.577+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14587951471811011070', time=2024-09-12T02:48:44.408795+0000, chain.objs.size()=1 2024-09-12T00:56:19.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.577+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19__shadow_.rDCXvWpqpvjW0anNF6z23oXYtx7s1J2_0 2024-09-12T00:56:19.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.577+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17718739637672841397', time=2024-09-12T02:48:46.426387+0000, chain.objs.size()=1 2024-09-12T00:56:19.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.577+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.20__shadow_.LQBrPZwi1Iggj6Zj08nhrGltlKwYot-_0 2024-09-12T00:56:19.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.577+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6916043072218896897', time=2024-09-12T02:48:46.510602+0000, chain.objs.size()=1 2024-09-12T00:56:19.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.577+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.20__shadow_.IgFKOrAMKwJFhaq5bBw1aiyv9yiygxp_0 2024-09-12T00:56:19.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.577+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2754849206162147057', time=2024-09-12T02:49:57.934808+0000, chain.objs.size()=1 2024-09-12T00:56:19.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.577+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24__shadow_.0uMVyL8XBp_utZBFICPrEQTvyRcCP16_0 2024-09-12T00:56:19.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.577+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6045133282953307253', time=2024-09-12T02:50:36.226018+0000, chain.objs.size()=1 2024-09-12T00:56:19.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.577+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27__shadow_.y_PbPYi0yegPJMg5tBs7EuGd701gnmc_0 2024-09-12T00:56:19.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.577+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9188560914922116448', time=2024-09-12T02:51:11.596474+0000, chain.objs.size()=1 2024-09-12T00:56:19.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.578+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29__shadow_.VA4pczDLifq1LGsyDr13KAbLMtUmD4H_0 2024-09-12T00:56:19.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.578+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18142994355362366035', time=2024-09-12T02:51:11.626918+0000, chain.objs.size()=1 2024-09-12T00:56:19.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.578+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29__shadow_.rpOyzKEVoGNrcBwvR-1IA1sfp3mPagy_0 2024-09-12T00:56:19.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.578+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17677035790910655990', time=2024-09-12T02:51:14.471727+0000, chain.objs.size()=1 2024-09-12T00:56:19.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.578+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30__shadow_.tYICukTFPxCndfz4p0HgWUShE_DVcbQ_0 2024-09-12T00:56:19.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.578+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10460913737901372778', time=2024-09-12T02:51:14.472233+0000, chain.objs.size()=1 2024-09-12T00:56:19.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.578+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30__shadow_.o6Etj0GvQqoTY5Z67iPF1TskE7bPEI7_0 2024-09-12T00:56:19.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.579+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15654414127671574603', time=2024-09-12T02:51:16.574399+0000, chain.objs.size()=1 2024-09-12T00:56:19.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.579+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31__shadow_.gAUsLQvav1MIt0iBpo-JZ89Stl_7ng5_0 2024-09-12T00:56:19.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.579+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4867075755308256413', time=2024-09-12T02:51:54.621721+0000, chain.objs.size()=1 2024-09-12T00:56:19.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.579+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34__shadow_.W9FdEJBxEUnF5JYLBt5uSUAepEPyonn_0 2024-09-12T00:56:19.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.579+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1729314314022526102', time=2024-09-12T02:52:25.834974+0000, chain.objs.size()=1 2024-09-12T00:56:19.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.579+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34__shadow_.dQH9m9H5n-XCqCCzYEDEt-dQQi82-po_0 2024-09-12T00:56:19.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.579+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12367393145606459590', time=2024-09-12T02:52:29.044180+0000, chain.objs.size()=1 2024-09-12T00:56:19.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.579+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35__shadow_.VLAqBNYsXacuX3Yq0UCwJi36rKRvw6__0 2024-09-12T00:56:19.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.579+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14015942986972351647', time=2024-09-12T02:52:29.084576+0000, chain.objs.size()=1 2024-09-12T00:56:19.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.579+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35__shadow_.6wxvp3xnfdOOI5EDkVHY85fRonjSqp8_0 2024-09-12T00:56:19.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.580+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14111358276807862456', time=2024-09-12T02:53:07.332658+0000, chain.objs.size()=1 2024-09-12T00:56:19.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.580+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38__shadow_.8tS6o3BYaZcRhR9XrG_4rKrF7yhawXG_0 2024-09-12T00:56:19.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.580+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5070939929696945954', time=2024-09-12T02:53:07.375502+0000, chain.objs.size()=1 2024-09-12T00:56:19.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.580+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38__shadow_.5i8mJ7ykAjkUnmN7SVNM289yrKY-Gwh_0 2024-09-12T00:56:19.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.581+0000 7f73a1346800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:19.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.583+0000 7f73a1346800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:56:19.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.585+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:19.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.585+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:19.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.585+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T00:56:19.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.585+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.607235285549188140', time=2024-09-12T02:47:27.348657+0000, chain.objs.size()=1 2024-09-12T00:56:19.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.585+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4__shadow_.bxtALqRW-fUJj-h6zT1njWGtBh9NVYL_0 2024-09-12T00:56:19.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.585+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6673749372926418610', time=2024-09-12T02:47:27.607153+0000, chain.objs.size()=2 2024-09-12T00:56:19.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.585+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13__shadow_.jiTFT-iMDSoGjS7VeRuCS2qZx_Bcx3w_0 2024-09-12T00:56:19.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.585+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13__shadow_.jiTFT-iMDSoGjS7VeRuCS2qZx_Bcx3w_1 2024-09-12T00:56:19.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.585+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14515094093675309945', time=2024-09-12T02:48:44.313075+0000, chain.objs.size()=1 2024-09-12T00:56:19.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.585+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19__shadow_.2tcTNl3X8iGrT0OSUqH-vn8Bt3iyGLK_0 2024-09-12T00:56:19.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.585+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8664338053963903136', time=2024-09-12T02:48:46.484757+0000, chain.objs.size()=1 2024-09-12T00:56:19.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.585+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.20__shadow_.hncFBzQC3iU2pJMd8HBDfZwgqlp9gfq_0 2024-09-12T00:56:19.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.585+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6680982074995042805', time=2024-09-12T02:49:19.431883+0000, chain.objs.size()=1 2024-09-12T00:56:19.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.585+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21__shadow_.jkNVWwbhzx1pDvzCFTK7-XVE4deAfL__0 2024-09-12T00:56:19.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.585+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17032919375529419712', time=2024-09-12T02:49:19.474520+0000, chain.objs.size()=1 2024-09-12T00:56:19.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.585+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21__shadow_.H2WaSQV1FoZR6LSCp6lRcxRBJmTNvVt_0 2024-09-12T00:56:19.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.586+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13054917603979470227', time=2024-09-12T02:50:02.614432+0000, chain.objs.size()=1 2024-09-12T00:56:19.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.586+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.26__shadow_.VplgrPqY57VlLxXOZwcPl6fGebPyUBp_0 2024-09-12T00:56:19.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.586+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6296187598674313276', time=2024-09-12T02:50:38.438980+0000, chain.objs.size()=1 2024-09-12T00:56:19.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.586+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28__shadow_.jx2V1Miu8wSiMXHGFfV6eN3ADs2y-2w_0 2024-09-12T00:56:19.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.586+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11574916577668108599', time=2024-09-12T02:51:11.627514+0000, chain.objs.size()=1 2024-09-12T00:56:19.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.586+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29__shadow_.EeotkPPKr1bk3_hEV6aM932fUMUJpMT_0 2024-09-12T00:56:19.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.586+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5700448845130942932', time=2024-09-12T02:51:14.425743+0000, chain.objs.size()=1 2024-09-12T00:56:19.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.586+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30__shadow_.s8buFQo_tyyMJmESUszumQ0kgXuseEt_0 2024-09-12T00:56:19.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.586+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2964023646656335716', time=2024-09-12T02:51:14.468065+0000, chain.objs.size()=1 2024-09-12T00:56:19.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.586+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30__shadow_.kuATlavZHq3C5Y6EqxZF_0HgbEO52iJ_0 2024-09-12T00:56:19.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.587+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16105790803266431020', time=2024-09-12T02:51:50.029874+0000, chain.objs.size()=1 2024-09-12T00:56:19.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.587+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32__shadow_.P2pcSoqvoa_pZCnE07Ealacyvg3UgJi_0 2024-09-12T00:56:19.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.588+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11678847475605447568', time=2024-09-12T02:52:29.117992+0000, chain.objs.size()=1 2024-09-12T00:56:19.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.588+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35__shadow_.LK1cT8Uvk_zfgp0wmi4oNCmU3WstnNn_0 2024-09-12T00:56:19.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.588+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1185737854708131967', time=2024-09-12T02:53:05.293536+0000, chain.objs.size()=1 2024-09-12T00:56:19.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.588+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37__shadow_.PU-_Im8-VZ3Rypo-rF6S_WXw_rOBCjx_0 2024-09-12T00:56:19.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.588+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8065615793073515003', time=2024-09-12T02:53:07.306152+0000, chain.objs.size()=1 2024-09-12T00:56:19.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.588+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38__shadow_.aDhP5DXzLWQnVun82-hvsxuHC31Tevh_0 2024-09-12T00:56:19.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.590+0000 7f73a1346800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:19.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.593+0000 7f73a1346800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:56:19.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.594+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:19.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.595+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:19.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.595+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-12T00:56:19.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.595+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='_uB8n2X5sKqEu0gTSoNIplnYYAu3i3qH', time=2024-09-12T02:47:27.556821+0000, chain.objs.size()=1 2024-09-12T00:56:19.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.595+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__shadow_.XiKs-ej7nytBhpkPK-m4no_QlrgXzl2_0 2024-09-12T00:56:19.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.595+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15201155941029709124', time=2024-09-12T02:47:27.688835+0000, chain.objs.size()=1 2024-09-12T00:56:19.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.595+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8__shadow_.o_KCNKIobQ0mvOYJqpbmkNySfr-TTEW_0 2024-09-12T00:56:19.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.595+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2891900692200589673', time=2024-09-12T02:49:21.865544+0000, chain.objs.size()=1 2024-09-12T00:56:19.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.595+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22__shadow_.OQZV7csHA25kowdHzrgbZzWjPsBk-no_0 2024-09-12T00:56:19.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.595+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5598268477892966843', time=2024-09-12T02:50:02.609484+0000, chain.objs.size()=1 2024-09-12T00:56:19.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.595+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.26__shadow_.-A56JrwfU6L4u9O9-45nESttE2UetM3_0 2024-09-12T00:56:19.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.595+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11712383667321736658', time=2024-09-12T02:50:02.667860+0000, chain.objs.size()=1 2024-09-12T00:56:19.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.595+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.26__shadow_.rrDJUfnB0q3gntADhSARyEdlv7q819K_0 2024-09-12T00:56:19.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.595+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7451732148919016198', time=2024-09-12T02:50:02.668696+0000, chain.objs.size()=1 2024-09-12T00:56:19.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.595+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.26__shadow_.0EsquJvS7oF0nh6qUHTSChSzyxyY7vF_0 2024-09-12T00:56:19.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.595+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8856926888893450687', time=2024-09-12T02:50:38.447975+0000, chain.objs.size()=1 2024-09-12T00:56:19.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.595+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28__shadow_.05YtJN4JY92UGVZtKQPW4M-GZR1Q30q_0 2024-09-12T00:56:19.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.595+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15742022347114768678', time=2024-09-12T02:51:16.508938+0000, chain.objs.size()=1 2024-09-12T00:56:19.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.595+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31__shadow_.-Ii_lPLJqMpJKdK0eCmSeEMEVocRBef_0 2024-09-12T00:56:19.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.595+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7844738364174958034', time=2024-09-12T02:53:05.231129+0000, chain.objs.size()=1 2024-09-12T00:56:19.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.595+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37__shadow_.HGoqahgQt1nMLTw0EGecmx_irc1zkUH_0 2024-09-12T00:56:19.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.597+0000 7f73a1346800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:19.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.599+0000 7f73a1346800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:56:19.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.600+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:19.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.601+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:19.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.601+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T00:56:19.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.601+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1721424244885184565', time=2024-09-12T02:49:19.450579+0000, chain.objs.size()=1 2024-09-12T00:56:19.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.601+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21__shadow_.ZCjhZI461qR8pDcgqEQpBjudaqGoJeo_0 2024-09-12T00:56:19.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.601+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13291422597688009173', time=2024-09-12T02:49:19.485676+0000, chain.objs.size()=1 2024-09-12T00:56:19.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.601+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21__shadow_.FpRg-9rOsHuQCB9GpaLXQwQ9Fi9uUXs_0 2024-09-12T00:56:19.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.601+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9455106096311768734', time=2024-09-12T02:49:21.863154+0000, chain.objs.size()=1 2024-09-12T00:56:19.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.601+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22__shadow_.1mrhsS9DR37ok3TB8qoyxlenDZnWhHl_0 2024-09-12T00:56:19.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.601+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.936490926908482452', time=2024-09-12T02:49:24.177894+0000, chain.objs.size()=1 2024-09-12T00:56:19.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.601+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23__shadow_.P_EjnaY8LP-kwFbaXwOmi97N2wlC8kp_0 2024-09-12T00:56:19.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.601+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10431977401960676364', time=2024-09-12T02:49:26.284236+0000, chain.objs.size()=1 2024-09-12T00:56:19.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.601+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24__shadow_.nJ-DZ1B5qFU6LwGwOkaj1ZoiuyOhye0_0 2024-09-12T00:56:19.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.601+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7356898004918610790', time=2024-09-12T02:49:58.014581+0000, chain.objs.size()=1 2024-09-12T00:56:19.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.601+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24__shadow_.TJUTRNJYDO_7_rcPIdQeYsSYllrsvAd_0 2024-09-12T00:56:19.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.601+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.273697706528863725', time=2024-09-12T02:50:00.387813+0000, chain.objs.size()=1 2024-09-12T00:56:19.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.601+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25__shadow_.fAIiz-rXnx5LXAD7BD7ta_R2QF37AoH_0 2024-09-12T00:56:19.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.601+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.423866705160142533', time=2024-09-12T02:50:36.227282+0000, chain.objs.size()=1 2024-09-12T00:56:19.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.601+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27__shadow_.69VMoDjX3NgjkV8eg_SReQbLVCfrRDf_0 2024-09-12T00:56:19.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.601+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8332266766777983427', time=2024-09-12T02:51:11.628622+0000, chain.objs.size()=1 2024-09-12T00:56:19.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.601+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29__shadow_.4eMXTAS_rwXZnEGEnKd3WfwecG9JYjA_0 2024-09-12T00:56:19.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.601+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.920773079031955902', time=2024-09-12T02:52:25.881893+0000, chain.objs.size()=1 2024-09-12T00:56:19.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.601+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34__shadow_.HoG0icuh2pnyacsHVXuYu3XCnpZxHEo_0 2024-09-12T00:56:19.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.601+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18057350233391085237', time=2024-09-12T02:53:05.242997+0000, chain.objs.size()=1 2024-09-12T00:56:19.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.601+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37__shadow_.L9ctRvtH_tnBnsL9cau4YimkN2SnStt_0 2024-09-12T00:56:19.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.601+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2772642879516688727', time=2024-09-12T02:53:05.262700+0000, chain.objs.size()=1 2024-09-12T00:56:19.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.601+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37__shadow_.48s7ifBAsj_myrxHdmUAprmSdQ905Cn_0 2024-09-12T00:56:19.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.603+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.138285124116237049', time=2024-09-12T02:53:05.263325+0000, chain.objs.size()=1 2024-09-12T00:56:19.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.603+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37__shadow_.O6uiVSZQ3eisg4ix-XS4eQvug-wmp8z_0 2024-09-12T00:56:19.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.603+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14017492664101829084', time=2024-09-12T02:53:05.287227+0000, chain.objs.size()=1 2024-09-12T00:56:19.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.603+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37__shadow_.0i43mnZ4XzXrUQ7sO8mSH9rkunhGk1v_0 2024-09-12T00:56:19.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.603+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15899052994096400529', time=2024-09-12T02:53:40.152877+0000, chain.objs.size()=1 2024-09-12T00:56:19.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.603+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39__shadow_._knIpil16KDfKAOnH15EOLvS1IDZBWb_0 2024-09-12T00:56:19.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.604+0000 7f73a1346800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:19.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.606+0000 7f73a1346800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:56:19.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.608+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:19.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.608+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:19.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.608+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-12T00:56:19.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.608+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13582829744013629290', time=2024-09-12T02:47:27.356600+0000, chain.objs.size()=1 2024-09-12T00:56:19.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.608+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4__shadow_.-Ie1Oy5DuEU2-JSnj3Jv1e-vxC8d4k6_0 2024-09-12T00:56:19.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.608+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8869033989638097243', time=2024-09-12T02:49:19.484626+0000, chain.objs.size()=1 2024-09-12T00:56:19.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.608+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21__shadow_.0_5YR_UYmB7QRITc94r3zdubHEQjQbI_0 2024-09-12T00:56:19.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.608+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7917396993291234462', time=2024-09-12T02:49:21.877774+0000, chain.objs.size()=1 2024-09-12T00:56:19.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.608+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22__shadow_.DwGKmbSwxlpZeqb0ZGq-RD5VGixfqru_0 2024-09-12T00:56:19.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.608+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16041085944593433468', time=2024-09-12T02:49:24.219736+0000, chain.objs.size()=1 2024-09-12T00:56:19.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.608+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23__shadow_.Gmll8tihVlA0oPW-_hanS2QtCOpcE1v_0 2024-09-12T00:56:19.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.608+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7512941289174398248', time=2024-09-12T02:49:58.004479+0000, chain.objs.size()=1 2024-09-12T00:56:19.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.608+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24__shadow_.HiAuL0oTiTonT1lSxvVFibiYjpxjk6R_0 2024-09-12T00:56:19.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.608+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11011961018429637460', time=2024-09-12T02:50:37.957325+0000, chain.objs.size()=1 2024-09-12T00:56:19.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.608+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28__shadow_.ZFCgOJBYg-xfL030zBNf1YF7CiHApZn_0 2024-09-12T00:56:19.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.608+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13306639004208743417', time=2024-09-12T02:51:16.510039+0000, chain.objs.size()=1 2024-09-12T00:56:19.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.608+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31__shadow_.1I1rdq03uwh6SiEZCjIYMR-aLkI5dy__0 2024-09-12T00:56:19.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.608+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12272028225394057090', time=2024-09-12T02:51:50.068410+0000, chain.objs.size()=1 2024-09-12T00:56:19.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.608+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32__shadow_.bCq1Jy0OsTyv9akb7Bz8Wmsommm9j7X_0 2024-09-12T00:56:19.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.608+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12575818404797546539', time=2024-09-12T02:52:25.880173+0000, chain.objs.size()=1 2024-09-12T00:56:19.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.608+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34__shadow_.5rwEIjZxVJ9kvDw7v8wNavI8gIIfVzR_0 2024-09-12T00:56:19.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.608+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4847946461226907793', time=2024-09-12T02:53:07.305739+0000, chain.objs.size()=1 2024-09-12T00:56:19.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.608+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38__shadow_.11N-wJi3JtWU3YsKbnfyYNycyN7Pq_U_0 2024-09-12T00:56:19.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.608+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2432706657538729393', time=2024-09-12T02:53:40.113221+0000, chain.objs.size()=1 2024-09-12T00:56:19.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.608+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39__shadow_.WXxeeXHQLTETQFBtJCj4aSpkBVBjUDd_0 2024-09-12T00:56:19.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.611+0000 7f73a1346800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:19.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.613+0000 7f73a1346800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:56:19.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.614+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:19.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.614+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:19.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.615+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T00:56:19.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.615+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4703076284671197260', time=2024-09-12T02:47:27.459299+0000, chain.objs.size()=1 2024-09-12T00:56:19.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.615+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15__shadow_.oAW_hiSp3cXrD2rdh17i_UHpnognwQ1_0 2024-09-12T00:56:19.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.615+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7999983469757324940', time=2024-09-12T02:47:27.518936+0000, chain.objs.size()=3 2024-09-12T00:56:19.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.615+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__multipart_foo-FROZEN.2~3vQreT-2Bj6sjzbLXNPzYMaxU5oWF1U.1 2024-09-12T00:56:19.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.615+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__multipart_foo-FROZEN.2~3vQreT-2Bj6sjzbLXNPzYMaxU5oWF1U.2 2024-09-12T00:56:19.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.615+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__multipart_foo-FROZEN.2~3vQreT-2Bj6sjzbLXNPzYMaxU5oWF1U.3 2024-09-12T00:56:19.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.615+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8752860565282527826', time=2024-09-12T02:47:27.603104+0000, chain.objs.size()=2 2024-09-12T00:56:19.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.615+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13__shadow_.cGIWfHtZekWnOzDLGYdIQXYQ4FnL6mZ_0 2024-09-12T00:56:19.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.615+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13__shadow_.cGIWfHtZekWnOzDLGYdIQXYQ4FnL6mZ_1 2024-09-12T00:56:19.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.615+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5548216343379265124', time=2024-09-12T02:48:43.259758+0000, chain.objs.size()=1 2024-09-12T00:56:19.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.615+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19__shadow_.MHICC9KFuasYQ9e3-uvbb-gk0PM-HpG_0 2024-09-12T00:56:19.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.615+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18138422969000278780', time=2024-09-12T02:48:44.362343+0000, chain.objs.size()=1 2024-09-12T00:56:19.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.615+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19__shadow_.LMsf4RqIi4bZgaQDGrILPxcGDQfAdQr_0 2024-09-12T00:56:19.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.615+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14122103613155187240', time=2024-09-12T02:48:46.524497+0000, chain.objs.size()=1 2024-09-12T00:56:19.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.615+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.20__shadow_.Fnob1kqKClZWmW7KFIQNHqMpJd4z4WC_0 2024-09-12T00:56:19.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.615+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12054253578165194789', time=2024-09-12T02:49:21.861373+0000, chain.objs.size()=1 2024-09-12T00:56:19.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.615+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22__shadow_.92oKVLwqiZuxMumr-CAAXvdNtS8yfBH_0 2024-09-12T00:56:19.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.615+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7089168590846602596', time=2024-09-12T02:49:21.934814+0000, chain.objs.size()=1 2024-09-12T00:56:19.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.615+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22__shadow_.uLqf3UFr0R9a9PgjLAdchKpAdZHyZoL_0 2024-09-12T00:56:19.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.615+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10345149882684715874', time=2024-09-12T02:49:57.935886+0000, chain.objs.size()=1 2024-09-12T00:56:19.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.615+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24__shadow_.0a4NtKbj-ywM26LX603S_nLJpSYvh18_0 2024-09-12T00:56:19.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.617+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11173342535689306649', time=2024-09-12T02:50:00.439816+0000, chain.objs.size()=1 2024-09-12T00:56:19.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.617+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25__shadow_.YtemQk4lZDB1S6Uu0ybSb1c4AWuFM25_0 2024-09-12T00:56:19.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.618+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8603798429187301049', time=2024-09-12T02:50:36.266761+0000, chain.objs.size()=1 2024-09-12T00:56:19.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.618+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27__shadow_.TWfq7n-9K_n_u8ae3JYY5sM0YwUVx-J_0 2024-09-12T00:56:19.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.618+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8973510709175623828', time=2024-09-12T02:51:14.398035+0000, chain.objs.size()=1 2024-09-12T00:56:19.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.618+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30__shadow_.0P2Sm7z9qRp0nWnq1A9L90DfjKuiIkZ_0 2024-09-12T00:56:19.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.618+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14306092243497544796', time=2024-09-12T02:51:14.465366+0000, chain.objs.size()=1 2024-09-12T00:56:19.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.618+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30__shadow_.DWhXun0i-vOFf7-kiNJOcFkjoRD68ju_0 2024-09-12T00:56:19.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.618+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1771130704840951880', time=2024-09-12T02:51:52.705045+0000, chain.objs.size()=1 2024-09-12T00:56:19.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.618+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33__shadow_.MG4E8j5_4XHoJkvqHEU-TPLaFArpUmJ_0 2024-09-12T00:56:19.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.619+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11781291637504102883', time=2024-09-12T02:51:52.741915+0000, chain.objs.size()=1 2024-09-12T00:56:19.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.619+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33__shadow_.t1lzl9aGAExnzkbvzEmzFtulfhc0tTi_0 2024-09-12T00:56:19.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.619+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11712867013838711986', time=2024-09-12T02:52:25.875501+0000, chain.objs.size()=1 2024-09-12T00:56:19.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.619+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34__shadow_.YeWDOqujAK1PhpOr7cV8_4omwDkCuOB_0 2024-09-12T00:56:19.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.619+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5704750365848587136', time=2024-09-12T02:53:05.233158+0000, chain.objs.size()=1 2024-09-12T00:56:19.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.619+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37__shadow_.LO-NvT6wWXtpv107DnIFX6mVHD5jk_r_0 2024-09-12T00:56:19.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.619+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15415724181102000889', time=2024-09-12T02:55:47.899178+0000, chain.objs.size()=1 2024-09-12T00:56:19.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.619+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17__shadow_.XNJZhN7jE1DwRK08infdun3M6uNVp3h_0 2024-09-12T00:56:19.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.619+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3497317182305981357', time=2024-09-12T02:56:00.610734+0000, chain.objs.size()=1 2024-09-12T00:56:19.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.619+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18__shadow:9WBzscrVKXtVrGV7JuYND0eezbSGCIo_.dR_kPzOKE-sxhD7rR6prPBRSe79mMZt_0 2024-09-12T00:56:19.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.621+0000 7f73a1346800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:19.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.623+0000 7f73a1346800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:56:19.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.624+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:19.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.625+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:19.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.626+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T00:56:19.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.626+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10402148564831662732', time=2024-09-12T02:47:27.481768+0000, chain.objs.size()=1 2024-09-12T00:56:19.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.626+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15__shadow_.FQZRgj7kU-hpMCJLEyI7BIhl1X_wDmq_0 2024-09-12T00:56:19.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.626+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12253782986381744039', time=2024-09-12T02:48:46.439819+0000, chain.objs.size()=1 2024-09-12T00:56:19.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.626+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.20__shadow_.PCqkZfiDEcMnnq-jAeKiAkxt_-HQTmY_0 2024-09-12T00:56:19.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.626+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16547122371544221422', time=2024-09-12T02:49:21.907323+0000, chain.objs.size()=1 2024-09-12T00:56:19.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.626+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22__shadow_.s-0ySt85iCwguNoy8_gS1-ttbEBiGcF_0 2024-09-12T00:56:19.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.626+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9993932604601408664', time=2024-09-12T02:49:24.216101+0000, chain.objs.size()=1 2024-09-12T00:56:19.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.626+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23__shadow_.kn1n5Mhel57JT3M4G997QjvoTj3Dd-L_0 2024-09-12T00:56:19.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.626+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.672951509560576460', time=2024-09-12T02:49:57.970588+0000, chain.objs.size()=1 2024-09-12T00:56:19.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.626+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24__shadow_.hJ8LKiiRGtlpb8bRk0kNyQyUhXBULEJ_0 2024-09-12T00:56:19.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.626+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12698684179305239938', time=2024-09-12T02:50:38.403612+0000, chain.objs.size()=1 2024-09-12T00:56:19.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.626+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28__shadow_.-WJz3v4TWKVeLb-8l4aDGQabvLhF1P8_0 2024-09-12T00:56:19.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.626+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17409788868650442830', time=2024-09-12T02:50:38.439736+0000, chain.objs.size()=1 2024-09-12T00:56:19.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.626+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28__shadow_.YnKTRP0sEvvEvhwLq87NL-jiDdpF2dI_0 2024-09-12T00:56:19.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.626+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10084534815488848880', time=2024-09-12T02:51:14.443897+0000, chain.objs.size()=1 2024-09-12T00:56:19.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.626+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30__shadow_.n2y5bsqDEeeegBMooZ492OOBHm6pX6L_0 2024-09-12T00:56:19.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.626+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6089438190854319326', time=2024-09-12T02:51:16.560213+0000, chain.objs.size()=1 2024-09-12T00:56:19.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.626+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31__shadow_.cd6JXd8Cp3iayhnBVd0gMFTXc9WnlUZ_0 2024-09-12T00:56:19.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.626+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11022336714113955554', time=2024-09-12T02:51:50.087758+0000, chain.objs.size()=1 2024-09-12T00:56:19.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.626+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32__shadow_.fIRsYgL6X7CnJroSBu_niDzVjBkpLxx_0 2024-09-12T00:56:19.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.626+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2199551612064556762', time=2024-09-12T02:52:29.077604+0000, chain.objs.size()=1 2024-09-12T00:56:19.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.626+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35__shadow_.C-OZZ1QWMBl6vU7QqjL3GnvVhf3jLFP_0 2024-09-12T00:56:19.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.626+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2802017447284843845', time=2024-09-12T02:53:02.801278+0000, chain.objs.size()=1 2024-09-12T00:56:19.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.626+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36__shadow_.94-QGoFEVdQUCHR6lrDVMyZB4oRMnFy_0 2024-09-12T00:56:19.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.628+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4081108402978364857', time=2024-09-12T02:53:07.306773+0000, chain.objs.size()=1 2024-09-12T00:56:19.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.628+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38__shadow_.Kg46w5AKoEwAqQa42VZ_CObgr7zy2C8_0 2024-09-12T00:56:19.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.628+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18223650482326128519', time=2024-09-12T02:53:40.085496+0000, chain.objs.size()=1 2024-09-12T00:56:19.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.628+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39__shadow_.ls-vBjD7kPvMONX2Xal-jJoHw8LsFxu_0 2024-09-12T00:56:19.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.628+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11225137244413209689', time=2024-09-12T02:53:40.153529+0000, chain.objs.size()=1 2024-09-12T00:56:19.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.628+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39__shadow_.DFToalZQ_Wy30OK6Xt9bCpxgZ93t1cc_0 2024-09-12T00:56:19.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.628+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4915533110887966789', time=2024-09-12T02:55:47.903729+0000, chain.objs.size()=1 2024-09-12T00:56:19.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.628+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17__shadow_.hI23ADjBSYXLTRuhcqBE0sLLcsbq75n_0 2024-09-12T00:56:19.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.630+0000 7f73a1346800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:19.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.632+0000 7f73a1346800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:56:19.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.633+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:19.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.633+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:19.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.633+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T00:56:19.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.633+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9439554793537873693', time=2024-09-12T02:47:27.580126+0000, chain.objs.size()=3 2024-09-12T00:56:19.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.633+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14__multipart_foo-FROZEN.2~J_TyXqqtf60P_uYiwCoqdMvy4cayM-Z.1 2024-09-12T00:56:19.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.634+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14__multipart_foo-FROZEN.2~J_TyXqqtf60P_uYiwCoqdMvy4cayM-Z.2 2024-09-12T00:56:19.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.634+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14__multipart_foo-FROZEN.2~J_TyXqqtf60P_uYiwCoqdMvy4cayM-Z.3 2024-09-12T00:56:19.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.634+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18272488216071093779', time=2024-09-12T02:48:44.415035+0000, chain.objs.size()=1 2024-09-12T00:56:19.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.634+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19__shadow_.Szaty_ZjN13nySP_9jDfxsSmiwyczce_0 2024-09-12T00:56:19.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.634+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5551570988197105344', time=2024-09-12T02:48:46.490237+0000, chain.objs.size()=1 2024-09-12T00:56:19.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.634+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.20__shadow_.Iz3ET2WDrGLQZl-O9HebJBgdG_5a7n6_0 2024-09-12T00:56:19.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.634+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13271669212057462446', time=2024-09-12T02:49:21.877717+0000, chain.objs.size()=1 2024-09-12T00:56:19.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.634+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22__shadow_.p7CwBPkly3vMFZ1DWljbUxV1QPP51VX_0 2024-09-12T00:56:19.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.634+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17666692870378268388', time=2024-09-12T02:49:24.133123+0000, chain.objs.size()=1 2024-09-12T00:56:19.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.634+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23__shadow_.X-QuaRRHkkuKVy1CBZusS5qms91t4Ag_0 2024-09-12T00:56:19.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.634+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9662055535208957822', time=2024-09-12T02:49:24.133724+0000, chain.objs.size()=1 2024-09-12T00:56:19.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.634+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23__shadow_.7nvvgiIm33xyXuuOh9KY7m3RJ_9zOiR_0 2024-09-12T00:56:19.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.634+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11579044548136626802', time=2024-09-12T02:49:57.932555+0000, chain.objs.size()=1 2024-09-12T00:56:19.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.634+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24__shadow_.y8Q27eMHkIf7itWqa7setfKYfhYHimc_0 2024-09-12T00:56:19.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.634+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7645664264709503356', time=2024-09-12T02:50:00.445213+0000, chain.objs.size()=1 2024-09-12T00:56:19.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.634+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25__shadow_.PEDAAb40KbziEIjfpuAF4NrvIBSDvao_0 2024-09-12T00:56:19.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.634+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.992823847407474803', time=2024-09-12T02:50:02.653429+0000, chain.objs.size()=1 2024-09-12T00:56:19.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.634+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.26__shadow_.TG-99_ySydmYDJ2Rru9vFthqm_oUFMQ_0 2024-09-12T00:56:19.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.634+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4626324530428753007', time=2024-09-12T02:51:11.624583+0000, chain.objs.size()=1 2024-09-12T00:56:19.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.634+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29__shadow_.XbuBZYbIbxXSD4tQRhDcK6w0Q79ccP8_0 2024-09-12T00:56:19.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.636+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6967778849235351905', time=2024-09-12T02:51:11.647574+0000, chain.objs.size()=1 2024-09-12T00:56:19.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.636+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29__shadow_.srU2XNzQ8nXdZn12HMoAsACv0Bephfo_0 2024-09-12T00:56:19.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.636+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7754069585068475724', time=2024-09-12T02:51:11.681812+0000, chain.objs.size()=1 2024-09-12T00:56:19.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.636+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29__shadow_.zPAYq8EXKWbJ_RfhGp3OksD44n5Wde4_0 2024-09-12T00:56:19.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.636+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4065545961119620105', time=2024-09-12T02:51:50.008945+0000, chain.objs.size()=1 2024-09-12T00:56:19.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.636+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32__shadow_.ywwVquT5R9-Ij3fTV-97-joY1oR8yU1_0 2024-09-12T00:56:19.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.636+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3396301917816342659', time=2024-09-12T02:52:29.086787+0000, chain.objs.size()=1 2024-09-12T00:56:19.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.636+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35__shadow_.wgpqQgJDwydBkRFYKe_CnMKFo-CmhDv_0 2024-09-12T00:56:19.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.636+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13511516427293721007', time=2024-09-12T02:52:29.087532+0000, chain.objs.size()=1 2024-09-12T00:56:19.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.636+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35__shadow_.n9myYFKA9uMXieZO25_svE7hAVvfedU_0 2024-09-12T00:56:19.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.636+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17098469782440830090', time=2024-09-12T02:53:02.794847+0000, chain.objs.size()=1 2024-09-12T00:56:19.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.636+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36__shadow_._Sp-_JoDkTaadcgmMXVPpj5BHLc0qvC_0 2024-09-12T00:56:19.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.636+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3460477477757654783', time=2024-09-12T02:53:40.086430+0000, chain.objs.size()=1 2024-09-12T00:56:19.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.636+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39__shadow_.CzNOVhna9CjYnRZlxpoe-XvMqrkDUt0_0 2024-09-12T00:56:19.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.638+0000 7f73a1346800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:19.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.640+0000 7f73a1346800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:56:19.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.641+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:19.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.642+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:19.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.642+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T00:56:19.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.642+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13273558402566091436', time=2024-09-12T02:48:44.353832+0000, chain.objs.size()=1 2024-09-12T00:56:19.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.642+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19__shadow_.ijOo2q7czP4Pyx8-xCbEAFIHOwWHaOX_0 2024-09-12T00:56:19.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.642+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1393900167501235431', time=2024-09-12T02:48:44.394544+0000, chain.objs.size()=1 2024-09-12T00:56:19.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.642+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19__shadow_.refjp68WNkApR9rNCp_TTPYTQ-QtY3c_0 2024-09-12T00:56:19.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.642+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8070661334650655552', time=2024-09-12T02:49:24.129191+0000, chain.objs.size()=1 2024-09-12T00:56:19.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.642+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23__shadow_.4z6yNvsoLY-gbuvusmHt2KVdyJKaFNC_0 2024-09-12T00:56:19.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.642+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16448624102140676252', time=2024-09-12T02:49:24.167669+0000, chain.objs.size()=1 2024-09-12T00:56:19.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.642+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23__shadow_.3fdlAg-fvv6WMnXRv2MYQdWz8i6wT2C_0 2024-09-12T00:56:19.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.642+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14491060831984184801', time=2024-09-12T02:50:02.684854+0000, chain.objs.size()=1 2024-09-12T00:56:19.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.642+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.26__shadow_.jAmsI65lTHihita7cBcOPRnvEoSZCgD_0 2024-09-12T00:56:19.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.642+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18173041758644984648', time=2024-09-12T02:50:36.225961+0000, chain.objs.size()=1 2024-09-12T00:56:19.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.642+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27__shadow_.NECYWBXhs5JcMSLEOMgFPuwDy755O-I_0 2024-09-12T00:56:19.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.642+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5657984493295800758', time=2024-09-12T02:50:36.226690+0000, chain.objs.size()=1 2024-09-12T00:56:19.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.642+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27__shadow_.NChZ55fx-BVfitklM03_4_eV7H_HKcB_0 2024-09-12T00:56:19.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.642+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9649735750314430246', time=2024-09-12T02:50:38.466300+0000, chain.objs.size()=1 2024-09-12T00:56:19.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.642+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28__shadow_.sOseuITzCv-Bndjm4k_LoD0eRYN9KMl_0 2024-09-12T00:56:19.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.642+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.853838331050944557', time=2024-09-12T02:51:14.441022+0000, chain.objs.size()=1 2024-09-12T00:56:19.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.642+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30__shadow_.g-sCtRyWt4FEEmDJOWFX-gZlT7JCESa_0 2024-09-12T00:56:19.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.642+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11796210619507063921', time=2024-09-12T02:51:49.148423+0000, chain.objs.size()=1 2024-09-12T00:56:19.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.642+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32__shadow_._ofrjY6XL9Av22OsxhsOsizTl2N1VcK_0 2024-09-12T00:56:19.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.642+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3965175599606052731', time=2024-09-12T02:52:25.867168+0000, chain.objs.size()=1 2024-09-12T00:56:19.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.642+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34__shadow_.0yi32dZAweOT5O0aj8BL33LUPv7QQvR_0 2024-09-12T00:56:19.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.642+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9408306868781929554', time=2024-09-12T02:53:02.802136+0000, chain.objs.size()=1 2024-09-12T00:56:19.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.642+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36__shadow_.5vMtAUfHpWJZbxoXAbR1HtrsuxxRgJq_0 2024-09-12T00:56:19.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.643+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14078565268425909847', time=2024-09-12T02:53:40.149452+0000, chain.objs.size()=1 2024-09-12T00:56:19.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.643+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39__shadow_.MPsKZrVSDwpTKj42OXgBrFuuXIn9Kt8_0 2024-09-12T00:56:19.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.644+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7386123594137839939', time=2024-09-12T02:53:40.168358+0000, chain.objs.size()=1 2024-09-12T00:56:19.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.644+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39__shadow_.dTUbLR55T9FR93UpD76zUT7AvAn7hWg_0 2024-09-12T00:56:19.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.646+0000 7f73a1346800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:19.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.648+0000 7f73a1346800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:56:19.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.649+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:19.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.649+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:19.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.650+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T00:56:19.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.650+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7767853877224514757', time=2024-09-12T02:47:27.388669+0000, chain.objs.size()=4 2024-09-12T00:56:19.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.650+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11__multipart_foo.2~mkgUQzJYFGivMov6G8qxpRiwf_Glu1S.1 2024-09-12T00:56:19.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.650+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11__multipart_foo.2~mkgUQzJYFGivMov6G8qxpRiwf_Glu1S.2 2024-09-12T00:56:19.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.650+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11__multipart_foo.2~mkgUQzJYFGivMov6G8qxpRiwf_Glu1S.3 2024-09-12T00:56:19.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.650+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11__multipart_foo.2~mkgUQzJYFGivMov6G8qxpRiwf_Glu1S.4 2024-09-12T00:56:19.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.650+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2292370384872199453', time=2024-09-12T02:47:27.536697+0000, chain.objs.size()=3 2024-09-12T00:56:19.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.650+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__multipart_foo-LUKEWARM.2~KkLEbQ8XHe0ERbagNN62TPOj_lpltQP.1 2024-09-12T00:56:19.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.650+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__multipart_foo-LUKEWARM.2~KkLEbQ8XHe0ERbagNN62TPOj_lpltQP.2 2024-09-12T00:56:19.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.650+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__multipart_foo-LUKEWARM.2~KkLEbQ8XHe0ERbagNN62TPOj_lpltQP.3 2024-09-12T00:56:19.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.650+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4352067513849356372', time=2024-09-12T02:49:21.865527+0000, chain.objs.size()=1 2024-09-12T00:56:19.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.650+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22__shadow_.YFohe6BeEkZ09q2y_Zp44qvNZA6QMqU_0 2024-09-12T00:56:19.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.650+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16201410820762661290', time=2024-09-12T02:49:21.935278+0000, chain.objs.size()=1 2024-09-12T00:56:19.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.650+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22__shadow_.ttbvu3RbI0jE-tBXKmUntjQwNXBlD6b_0 2024-09-12T00:56:19.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.650+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8456451130186407839', time=2024-09-12T02:50:02.608380+0000, chain.objs.size()=1 2024-09-12T00:56:19.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.650+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.26__shadow_.mioS8BR5OQOcRu8K9je7OlFfJR3ywPC_0 2024-09-12T00:56:19.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.650+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13995763316059349449', time=2024-09-12T02:50:36.197672+0000, chain.objs.size()=1 2024-09-12T00:56:19.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.650+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27__shadow_.ZOsoHAzDKiLf84vrXFvD3TuSuCIXnE2_0 2024-09-12T00:56:19.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.650+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12149273826702374436', time=2024-09-12T02:51:11.602688+0000, chain.objs.size()=1 2024-09-12T00:56:19.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.650+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29__shadow_.IyXEnUACqLQVNdT67WHWMX8RfPDi-DI_0 2024-09-12T00:56:19.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.651+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4069450524968495459', time=2024-09-12T02:51:16.482862+0000, chain.objs.size()=1 2024-09-12T00:56:19.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.651+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31__shadow_.aHR-9m2cDPL8Ih-hND-C8Y4d-zmbYlq_0 2024-09-12T00:56:19.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.651+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8996559805769079096', time=2024-09-12T02:51:50.034469+0000, chain.objs.size()=1 2024-09-12T00:56:19.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.651+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32__shadow_.SNak7dmytYyzSOTyDjKXpP9_tRpFRdR_0 2024-09-12T00:56:19.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.652+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5395403640692647623', time=2024-09-12T02:51:50.074899+0000, chain.objs.size()=1 2024-09-12T00:56:19.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.652+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32__shadow_.mXNz1_tQ4_SCTMgy6NjOm22hLXvtRje_0 2024-09-12T00:56:19.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.652+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12473086971763293414', time=2024-09-12T02:51:52.752330+0000, chain.objs.size()=1 2024-09-12T00:56:19.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.652+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33__shadow_.MmmD7Io4tOlhdOEe1JOVqzbJFnH1gng_0 2024-09-12T00:56:19.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.652+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10291107194108982969', time=2024-09-12T02:51:52.776791+0000, chain.objs.size()=1 2024-09-12T00:56:19.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.652+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33__shadow_.xemWXahZUDNBR4xiR2cu3wkr6m5XiQ7_0 2024-09-12T00:56:19.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.652+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12210713587031420962', time=2024-09-12T02:51:52.777348+0000, chain.objs.size()=1 2024-09-12T00:56:19.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.652+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33__shadow_.UEq9HZ34JepGcDST6T5HUcHYXGEM-Yp_0 2024-09-12T00:56:19.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.652+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16137612995413546407', time=2024-09-12T02:53:02.819029+0000, chain.objs.size()=1 2024-09-12T00:56:19.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.652+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36__shadow_.2nyvc8sc5A1b3YrojeMM2o4Cy70n910_0 2024-09-12T00:56:19.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.652+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12808310001481752544', time=2024-09-12T02:53:40.150230+0000, chain.objs.size()=1 2024-09-12T00:56:19.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.652+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39__shadow_.fmy5v1ugYimQj4du3Ins00sLdTnGwvZ_0 2024-09-12T00:56:19.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.652+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4725071310732236596', time=2024-09-12T02:56:00.616130+0000, chain.objs.size()=1 2024-09-12T00:56:19.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.652+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18__shadow:rAaZttEDZzhu3oBL5vES7FIzM1RxTnu_.TxQdqjRJBLMyalqrH_dDIko2eQmhMY9_0 2024-09-12T00:56:19.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.654+0000 7f73a1346800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:19.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.656+0000 7f73a1346800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:56:19.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.658+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:19.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.658+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:19.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.659+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-12T00:56:19.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.659+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13777014496052425080', time=2024-09-12T02:48:46.529627+0000, chain.objs.size()=1 2024-09-12T00:56:19.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.659+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.20__shadow_.7iuKH3xIOEZ0VCd_1f2gBv6C10EkvnG_0 2024-09-12T00:56:19.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.659+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2061046577459414348', time=2024-09-12T02:49:21.184021+0000, chain.objs.size()=1 2024-09-12T00:56:19.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.659+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22__shadow_.Y5bGdMMarwNaeZkJ8EpHQVXUUnPDaFd_0 2024-09-12T00:56:19.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.659+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9423524291070378067', time=2024-09-12T02:50:38.456652+0000, chain.objs.size()=1 2024-09-12T00:56:19.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.659+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28__shadow_.z60qKbfSUxL1K-X5PN2I-gt-M6bwEH4_0 2024-09-12T00:56:19.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.659+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14729415407702997605', time=2024-09-12T02:51:16.497930+0000, chain.objs.size()=1 2024-09-12T00:56:19.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.659+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31__shadow_.WhI6kGFed4cHXrB8kRikPY81KwZ5V4v_0 2024-09-12T00:56:19.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.659+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12460738367412686578', time=2024-09-12T02:51:50.044076+0000, chain.objs.size()=1 2024-09-12T00:56:19.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.659+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32__shadow_.fOZ1Sjie15KpYGlNNFq-nlQ9XmIA1ob_0 2024-09-12T00:56:19.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.659+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13442137561802005948', time=2024-09-12T02:51:52.700567+0000, chain.objs.size()=1 2024-09-12T00:56:19.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.659+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33__shadow_.92B35kgBbJfCvbBMJ4GFAxCZgj1eMeP_0 2024-09-12T00:56:19.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.659+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6506517982827390475', time=2024-09-12T02:53:05.234515+0000, chain.objs.size()=1 2024-09-12T00:56:19.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.659+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37__shadow_.wnhDd_Pc_al5SSQ09FEmX4VsPj9ljhR_0 2024-09-12T00:56:19.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.659+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3164947852122174784', time=2024-09-12T02:53:07.316834+0000, chain.objs.size()=1 2024-09-12T00:56:19.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.659+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38__shadow_.eI6u-G_A_4m0zq3lnr3BGe6yD1Oy85Q_0 2024-09-12T00:56:19.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.659+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13948260801458623234', time=2024-09-12T02:53:07.317674+0000, chain.objs.size()=1 2024-09-12T00:56:19.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.659+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38__shadow_.8OZc48u54OIuuj4QL2txYG95sftUViR_0 2024-09-12T00:56:19.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.659+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14806326182206486055', time=2024-09-12T02:55:47.889615+0000, chain.objs.size()=1 2024-09-12T00:56:19.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.659+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17__shadow_.Wf_3XHjytEKE5f5gTxYMBTVyj2lfm5L_0 2024-09-12T00:56:19.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.661+0000 7f73a1346800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:19.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.663+0000 7f73a1346800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:56:19.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.664+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:19.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.664+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:19.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.665+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T00:56:19.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.665+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3670578218949790427', time=2024-09-12T02:47:27.442865+0000, chain.objs.size()=4 2024-09-12T00:56:19.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.665+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9__multipart_foo.2~S0iNao5b_n6YpUJx0D_u4kjruhB2d9j.1 2024-09-12T00:56:19.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.665+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9__multipart_foo.2~S0iNao5b_n6YpUJx0D_u4kjruhB2d9j.2 2024-09-12T00:56:19.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.665+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9__multipart_foo.2~S0iNao5b_n6YpUJx0D_u4kjruhB2d9j.3 2024-09-12T00:56:19.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.665+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9__multipart_foo.2~S0iNao5b_n6YpUJx0D_u4kjruhB2d9j.4 2024-09-12T00:56:19.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.665+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9077386875916417639', time=2024-09-12T02:47:27.463261+0000, chain.objs.size()=1 2024-09-12T00:56:19.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.665+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15__shadow_.oAW_hiSp3cXrD2rdh17i_UHpnognwQ1_0 2024-09-12T00:56:19.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.665+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15163698396306019932', time=2024-09-12T02:47:27.684887+0000, chain.objs.size()=1 2024-09-12T00:56:19.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.665+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8__shadow_.Vs5fmy6KejdOdKGQRs8xUsPrIXwUURP_0 2024-09-12T00:56:19.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.665+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7432154171125487317', time=2024-09-12T02:48:44.364913+0000, chain.objs.size()=1 2024-09-12T00:56:19.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.665+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19__shadow_.Dm1TF9K3LimyZuR_W4SgRDCfytPMKxV_0 2024-09-12T00:56:19.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.665+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10551744640407070676', time=2024-09-12T02:49:19.433412+0000, chain.objs.size()=1 2024-09-12T00:56:19.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.665+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21__shadow_.TnMx39wdtLqpqrHEc5DqgoNZ8mOoyIu_0 2024-09-12T00:56:19.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.665+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6570011140139704183', time=2024-09-12T02:49:21.877748+0000, chain.objs.size()=1 2024-09-12T00:56:19.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.665+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22__shadow_.fmr3hkULAXnKaKhxkKX7xUGoUpzd5lH_0 2024-09-12T00:56:19.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.665+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17795922902066343270', time=2024-09-12T02:49:57.967904+0000, chain.objs.size()=1 2024-09-12T00:56:19.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.665+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24__shadow_.nooH3RbolcTPf-lA_tlOJrjaGyHipP-_0 2024-09-12T00:56:19.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.665+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6699840665906788510', time=2024-09-12T02:50:00.410119+0000, chain.objs.size()=1 2024-09-12T00:56:19.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.665+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25__shadow_.Agjc0ODnNpCsXvRsy4XON2FXiEAswbG_0 2024-09-12T00:56:19.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.665+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8069154422845182351', time=2024-09-12T02:51:16.528700+0000, chain.objs.size()=1 2024-09-12T00:56:19.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.665+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31__shadow_.VKQqQqHaNFwcP3Klja8C7mjcM5FqR1O_0 2024-09-12T00:56:19.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.666+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16606766793576953223', time=2024-09-12T02:51:50.068410+0000, chain.objs.size()=1 2024-09-12T00:56:19.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.666+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32__shadow_.BccK26tqWIN8D1PZgtqW_oiGKWdNmPQ_0 2024-09-12T00:56:19.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.666+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9604803332043515696', time=2024-09-12T02:52:29.041992+0000, chain.objs.size()=1 2024-09-12T00:56:19.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.666+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35__shadow_.FmQGj8__MjgrYmjqLmckE_0TiMHmmIQ_0 2024-09-12T00:56:19.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.666+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8211816064837383723', time=2024-09-12T02:53:05.222635+0000, chain.objs.size()=1 2024-09-12T00:56:19.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.666+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37__shadow_.nlPY9VWeHc_54hpumW_CsTktV4BUHMy_0 2024-09-12T00:56:19.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.666+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6091957142313325537', time=2024-09-12T02:53:05.223401+0000, chain.objs.size()=1 2024-09-12T00:56:19.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.666+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37__shadow_.oIgsM2I5PBYwA5Drb8C_RaP5Algib36_0 2024-09-12T00:56:19.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.668+0000 7f73a1346800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:19.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.670+0000 7f73a1346800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:56:19.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.672+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:19.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.672+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:19.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.672+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T00:56:19.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.672+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15120334063538465935', time=2024-09-12T02:48:44.354050+0000, chain.objs.size()=1 2024-09-12T00:56:19.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.672+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19__shadow_.qIJPIJfzOpILQHun_FX87Uic9yYP_fS_0 2024-09-12T00:56:19.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.672+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18062251722785322193', time=2024-09-12T02:48:44.389101+0000, chain.objs.size()=1 2024-09-12T00:56:19.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.672+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19__shadow_.cwUicVf9HENONSjXJH31ZPnKe84ojpx_0 2024-09-12T00:56:19.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.672+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17877960885441699406', time=2024-09-12T02:48:46.427677+0000, chain.objs.size()=1 2024-09-12T00:56:19.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.672+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.20__shadow_.kxkm1Fv3q9xUePg55XT9Wg70-a0UO87_0 2024-09-12T00:56:19.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.672+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12742077885583990069', time=2024-09-12T02:48:46.428461+0000, chain.objs.size()=1 2024-09-12T00:56:19.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.672+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.20__shadow_.szQ-FVoXTC0KX4nn_ckBlR6uKp3tBjN_0 2024-09-12T00:56:19.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.672+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3904072417023038507', time=2024-09-12T02:49:19.474416+0000, chain.objs.size()=1 2024-09-12T00:56:19.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.672+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21__shadow_.U7x9gBfkOgF3DzjE2mMwLniCeDmQIWL_0 2024-09-12T00:56:19.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.672+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7529629246758129789', time=2024-09-12T02:49:21.903210+0000, chain.objs.size()=1 2024-09-12T00:56:19.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.672+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22__shadow_.xxItdsxG5ya8v4g47Or7cVu9UiQrS0C_0 2024-09-12T00:56:19.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.672+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13652254843042613792', time=2024-09-12T02:49:57.930693+0000, chain.objs.size()=1 2024-09-12T00:56:19.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.672+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24__shadow_._tg9BPzTdLtUQ_xV63smjQ1WJu5t8GG_0 2024-09-12T00:56:19.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.672+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16945347055851298438', time=2024-09-12T02:49:57.951971+0000, chain.objs.size()=1 2024-09-12T00:56:19.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.672+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24__shadow_.YoWYuRCdVRutBlCm7iSU9uskOia_QP3_0 2024-09-12T00:56:19.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.672+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12938848936843498603', time=2024-09-12T02:49:57.968358+0000, chain.objs.size()=1 2024-09-12T00:56:19.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.672+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24__shadow_.GugoX6RbbHbzrjAK_F1qqx1ZukZR1JB_0 2024-09-12T00:56:19.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.672+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13978707517418007638', time=2024-09-12T02:50:00.413430+0000, chain.objs.size()=1 2024-09-12T00:56:19.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.672+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25__shadow_.wIDTZH6ff7CuKpxMnHAAsC8xDUMiZ_U_0 2024-09-12T00:56:19.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.673+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10930234248672446437', time=2024-09-12T02:50:36.227171+0000, chain.objs.size()=1 2024-09-12T00:56:19.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.673+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27__shadow_.m0T8qeCaBOteGI8TtXzW7LF9sXr0AIQ_0 2024-09-12T00:56:19.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.673+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1525708561248365575', time=2024-09-12T02:50:36.227894+0000, chain.objs.size()=1 2024-09-12T00:56:19.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.673+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27__shadow_._gcFIrmzo--oJLGtdaXyDm3FsWObFHy_0 2024-09-12T00:56:19.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.674+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9665493217426830999', time=2024-09-12T02:50:36.270643+0000, chain.objs.size()=1 2024-09-12T00:56:19.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.674+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27__shadow_.V8SErsLRich4e6zVDiJfdapfVxs1W32_0 2024-09-12T00:56:19.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.674+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1425098970331817648', time=2024-09-12T02:50:38.395414+0000, chain.objs.size()=1 2024-09-12T00:56:19.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.674+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28__shadow_.qI3hyKl_PifWP_C0R9y-T2g9YU2tHRe_0 2024-09-12T00:56:19.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.674+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13619258133505175062', time=2024-09-12T02:50:38.457765+0000, chain.objs.size()=1 2024-09-12T00:56:19.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.674+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28__shadow_.gkJxDibaVkinOCKeQnR5tgIbgk_01H1_0 2024-09-12T00:56:19.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.674+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7092635878505704025', time=2024-09-12T02:51:11.627619+0000, chain.objs.size()=1 2024-09-12T00:56:19.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.674+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29__shadow_.ToRkkeh5QFFPFw99PIc6o-fbnvFm_Xj_0 2024-09-12T00:56:19.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.674+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12461586297229101781', time=2024-09-12T02:51:52.703752+0000, chain.objs.size()=1 2024-09-12T00:56:19.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.674+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33__shadow_.7-WoEdUsh6i8F2dUktHb92ERNif1CJt_0 2024-09-12T00:56:19.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.674+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14581248429254148407', time=2024-09-12T02:53:07.301847+0000, chain.objs.size()=1 2024-09-12T00:56:19.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.674+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38__shadow_.aM_Wctf4uLOIFXnkKMAZyNhIf_rVI3Z_0 2024-09-12T00:56:19.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.674+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15261711564684702867', time=2024-09-12T02:53:40.144298+0000, chain.objs.size()=1 2024-09-12T00:56:19.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.674+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39__shadow_.uLN8BWbM7f_ny5LX3LViAZ9QiX9xcFa_0 2024-09-12T00:56:19.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.676+0000 7f73a1346800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:19.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.678+0000 7f73a1346800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:56:19.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.680+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:19.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.680+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:19.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.680+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=22, truncated=0, next_marker='' 2024-09-12T00:56:19.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.680+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14705110757789608233', time=2024-09-12T02:47:27.564101+0000, chain.objs.size()=3 2024-09-12T00:56:19.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.680+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__multipart_foo-STANDARD.2~9RG2VEYRfif8VmTRB2IwKJXR8DE14Tv.1 2024-09-12T00:56:19.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.680+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__multipart_foo-STANDARD.2~9RG2VEYRfif8VmTRB2IwKJXR8DE14Tv.2 2024-09-12T00:56:19.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.680+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__multipart_foo-STANDARD.2~9RG2VEYRfif8VmTRB2IwKJXR8DE14Tv.3 2024-09-12T00:56:19.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.680+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7750999600025699272', time=2024-09-12T02:48:44.393229+0000, chain.objs.size()=1 2024-09-12T00:56:19.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.680+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19__shadow_.q1BRzAcQW7W_1s_Beo5KBG3tN5SCx8-_0 2024-09-12T00:56:19.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.680+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6437242676250020435', time=2024-09-12T02:48:46.456880+0000, chain.objs.size()=1 2024-09-12T00:56:19.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.680+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.20__shadow_.ppZGs9bbARuLjaYdtVM7TZl-6ROSLTx_0 2024-09-12T00:56:19.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.680+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16331899206111244182', time=2024-09-12T02:48:46.509825+0000, chain.objs.size()=1 2024-09-12T00:56:19.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.680+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.20__shadow_.GJ2UTSDw8UhuuI-CFNwgX0zLKVEEmr3_0 2024-09-12T00:56:19.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.680+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8070729058224941360', time=2024-09-12T02:49:19.492694+0000, chain.objs.size()=1 2024-09-12T00:56:19.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.680+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21__shadow_.gYlZjkCmpjurgWBb8GuP5JTTzIKqOJK_0 2024-09-12T00:56:19.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.680+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14898767351419459138', time=2024-09-12T02:49:21.868817+0000, chain.objs.size()=1 2024-09-12T00:56:19.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.680+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22__shadow_.wtBOpag_ey780PpbA9fc4fjLlYvk6F0_0 2024-09-12T00:56:19.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.680+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17225839778086425910', time=2024-09-12T02:49:21.908679+0000, chain.objs.size()=1 2024-09-12T00:56:19.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.680+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22__shadow_.UWfvEuKTGCUPvHO41WdxlIyX8eAt68Q_0 2024-09-12T00:56:19.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.680+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16398036748236540184', time=2024-09-12T02:50:00.376843+0000, chain.objs.size()=1 2024-09-12T00:56:19.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.680+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25__shadow_.0JjEE0oc4GhD5TCloY-ObJYv4wwpCuk_0 2024-09-12T00:56:19.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.680+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3784182979358367136', time=2024-09-12T02:50:38.447283+0000, chain.objs.size()=1 2024-09-12T00:56:19.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.680+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28__shadow_.jyCkPCnrtuRL_HJK72LgQ6j5T-njLna_0 2024-09-12T00:56:19.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.680+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4103718896226766246', time=2024-09-12T02:50:38.484523+0000, chain.objs.size()=1 2024-09-12T00:56:19.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.681+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.28__shadow_.G2ZMJ0LtscFsmLD_wGWdrP6qeZ0ce5W_0 2024-09-12T00:56:19.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.682+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15883934629561364353', time=2024-09-12T02:51:11.637892+0000, chain.objs.size()=1 2024-09-12T00:56:19.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.682+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29__shadow_.sXpkqc9cbFMTsvPg9pRrwgFy80Qsd2V_0 2024-09-12T00:56:19.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.682+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4690107677612254829', time=2024-09-12T02:51:14.465856+0000, chain.objs.size()=1 2024-09-12T00:56:19.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.682+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30__shadow_.2wcTxUaLHnNMCZ66Mk7go1RvTsNs477_0 2024-09-12T00:56:19.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.683+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5965250655587725833', time=2024-09-12T02:51:14.466662+0000, chain.objs.size()=1 2024-09-12T00:56:19.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.683+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30__shadow_.rxMokPCPtQ2oJ2As5KsoIK3_vdAun2Y_0 2024-09-12T00:56:19.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.683+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15874407226621038019', time=2024-09-12T02:51:16.508207+0000, chain.objs.size()=1 2024-09-12T00:56:19.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.683+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31__shadow_.FvJsO7_pLwUHKcjPJ4avbpc4YYnRe-h_0 2024-09-12T00:56:19.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.683+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17869224220085723979', time=2024-09-12T02:51:50.002503+0000, chain.objs.size()=1 2024-09-12T00:56:19.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.683+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32__shadow_.17sFZaVfPvUsFbnm61j0MbYnoMWSDly_0 2024-09-12T00:56:19.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.683+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10385277013139203315', time=2024-09-12T02:51:52.001291+0000, chain.objs.size()=1 2024-09-12T00:56:19.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.683+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33__shadow_.DFuF7Ez5nVLg82vsSai1lVuYMGJiraM_0 2024-09-12T00:56:19.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.683+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5298034151214777802', time=2024-09-12T02:51:52.752336+0000, chain.objs.size()=1 2024-09-12T00:56:19.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.683+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33__shadow_.WPYS5pXzaRbsRAimQI70c9YH7AEF8lU_0 2024-09-12T00:56:19.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.683+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11008846406179947215', time=2024-09-12T02:52:25.855318+0000, chain.objs.size()=1 2024-09-12T00:56:19.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.683+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34__shadow_.kkwIzdNJgGzn0kFD85vPCGiIrz1YQyy_0 2024-09-12T00:56:19.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.683+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1176269104300177969', time=2024-09-12T02:53:07.368561+0000, chain.objs.size()=1 2024-09-12T00:56:19.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.683+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38__shadow_.gGfPHjoh553CVvr4XpKMGQkP8CoahdK_0 2024-09-12T00:56:19.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.683+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1107880178534834097', time=2024-09-12T02:53:07.376894+0000, chain.objs.size()=1 2024-09-12T00:56:19.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.683+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38__shadow_.Xp0xsyHsxtTay8DOE5v5rMk8N1m4WzE_0 2024-09-12T00:56:19.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.683+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14782818057391185231', time=2024-09-12T02:53:09.061013+0000, chain.objs.size()=1 2024-09-12T00:56:19.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.683+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39__shadow_.Lg85rtrWXwuwbDWbmGE7LSJMrODJT8q_0 2024-09-12T00:56:19.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.684+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8010084029831088321', time=2024-09-12T02:55:55.843446+0000, chain.objs.size()=1 2024-09-12T00:56:19.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.684+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18__shadow:IkSI-ocN25GVl8JlH92ehkBJeTHtch-_.GwJiQzEDghO83B3Uy6Xdg2F31SZG4KW_0 2024-09-12T00:56:19.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.685+0000 7f73a1346800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:19.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.688+0000 7f73a1346800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:56:19.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.689+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:19.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.690+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:19.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.690+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T00:56:19.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.690+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16703532687249948369', time=2024-09-12T02:47:27.545103+0000, chain.objs.size()=3 2024-09-12T00:56:19.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.690+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__multipart_foo-LUKEWARM.2~KkLEbQ8XHe0ERbagNN62TPOj_lpltQP.1 2024-09-12T00:56:19.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.690+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__multipart_foo-LUKEWARM.2~KkLEbQ8XHe0ERbagNN62TPOj_lpltQP.2 2024-09-12T00:56:19.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.690+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__multipart_foo-LUKEWARM.2~KkLEbQ8XHe0ERbagNN62TPOj_lpltQP.3 2024-09-12T00:56:19.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.690+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15802879329508348717', time=2024-09-12T02:49:19.439475+0000, chain.objs.size()=1 2024-09-12T00:56:19.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.690+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21__shadow_.arZNAhCpKX0qHrZglFtNwr6dZ7p0KAZ_0 2024-09-12T00:56:19.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.690+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17932746544749190333', time=2024-09-12T02:49:19.509972+0000, chain.objs.size()=1 2024-09-12T00:56:19.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.690+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.21__shadow_.07scmNTQjFDrIeXEIy_r6Fjg1HjymTF_0 2024-09-12T00:56:19.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.690+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9164595456262793873', time=2024-09-12T02:50:00.390226+0000, chain.objs.size()=1 2024-09-12T00:56:19.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.690+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25__shadow_.Dt9dkc8gvL9OoKtKPSv88uhJvg7R6j5_0 2024-09-12T00:56:19.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.690+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7304272683821945539', time=2024-09-12T02:50:00.391607+0000, chain.objs.size()=1 2024-09-12T00:56:19.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.690+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25__shadow_.z3gY-90Tw_fLpqdj2pyGAjiGOhM4Ok5_0 2024-09-12T00:56:19.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.690+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.857534409113341312', time=2024-09-12T02:50:02.657852+0000, chain.objs.size()=1 2024-09-12T00:56:19.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.690+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.26__shadow_.jZXrRYCI7D4roVkRD-IKDuyU-EEE4t6_0 2024-09-12T00:56:19.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.690+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1085031624123698587', time=2024-09-12T02:50:04.551506+0000, chain.objs.size()=1 2024-09-12T00:56:19.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.690+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27__shadow_.JKTrCZVuVXjqilsDIZ6rgw3y0PvOAV7_0 2024-09-12T00:56:19.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.690+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2025266924232248505', time=2024-09-12T02:51:16.577725+0000, chain.objs.size()=1 2024-09-12T00:56:19.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.690+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31__shadow_.dlgH4U67hl6nkWxJwjaAmOBv4YmUOdK_0 2024-09-12T00:56:19.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.690+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3783457515050285164', time=2024-09-12T02:51:50.043967+0000, chain.objs.size()=1 2024-09-12T00:56:19.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.690+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32__shadow_.aEq7ZDKXC1mUX7OhjcHL6MI2w7LNV1j_0 2024-09-12T00:56:19.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.690+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3192248359657687148', time=2024-09-12T02:51:52.656818+0000, chain.objs.size()=1 2024-09-12T00:56:19.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.690+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33__shadow_.XDVjjlBLoj5gLb18W5AZoq1zOflYo2-_0 2024-09-12T00:56:19.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.693+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3513887789727458713', time=2024-09-12T02:51:52.768564+0000, chain.objs.size()=1 2024-09-12T00:56:19.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.693+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33__shadow_.ukkb6rISHemXu-5yULKeRmsJmcnN6pS_0 2024-09-12T00:56:19.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.693+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2148598706338276516', time=2024-09-12T02:53:05.234108+0000, chain.objs.size()=1 2024-09-12T00:56:19.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.693+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37__shadow_.LRE6G8H57GV6UfRd-LGVQFDX0uRmnSh_0 2024-09-12T00:56:19.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.693+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7397647208271870518', time=2024-09-12T02:53:07.267365+0000, chain.objs.size()=1 2024-09-12T00:56:19.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.693+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38__shadow_.f97NwDQEcuiAW5qDBASrGnE45TkvkZd_0 2024-09-12T00:56:19.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.693+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5576148997738157992', time=2024-09-12T02:53:40.155069+0000, chain.objs.size()=1 2024-09-12T00:56:19.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.693+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39__shadow_.2ih4RsZPJBI-by-PecDelBM7NjjOpdq_0 2024-09-12T00:56:19.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.693+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1597577736985561990', time=2024-09-12T02:55:47.890952+0000, chain.objs.size()=1 2024-09-12T00:56:19.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.693+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17__shadow_.d1BeOSLf4xbR3gIXLuywjBtStZoT-HB_0 2024-09-12T00:56:19.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.696+0000 7f73a1346800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:19.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.698+0000 7f73a1346800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:56:19.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.699+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:19.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.699+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:19.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.700+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T00:56:19.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.700+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2543924524881173479', time=2024-09-12T02:47:27.340374+0000, chain.objs.size()=1 2024-09-12T00:56:19.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.700+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4__shadow_.3pPdSyCMMpBuMpxvrJ2WMOXqqRXWDtm_0 2024-09-12T00:56:19.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.700+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10233233160712319745', time=2024-09-12T02:47:27.352876+0000, chain.objs.size()=1 2024-09-12T00:56:19.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.700+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4__shadow_.x0YCL93QBhEDB7fMu5CM7p3HLNFTn_6_0 2024-09-12T00:56:19.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.700+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='_4lY5R1e81rYGI2Wy6UT6VTCSR4iYXuy', time=2024-09-12T02:47:27.467169+0000, chain.objs.size()=1 2024-09-12T00:56:19.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.700+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15__shadow_.4yuRw8VhITgjJLoR4yoJ0ASJeVrxdiw_0 2024-09-12T00:56:19.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.700+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10571912184384997977', time=2024-09-12T02:47:27.489350+0000, chain.objs.size()=1 2024-09-12T00:56:19.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.700+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15__shadow_.YSW08tBacgAGg43NOtRlJgDa2n4exnj_0 2024-09-12T00:56:19.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.700+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='_WSFQyqpuQEyfJ86zv7RU_SDe_9cLR6n', time=2024-09-12T02:47:27.549696+0000, chain.objs.size()=2 2024-09-12T00:56:19.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.700+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__shadow_.iRISnhXyU2xuJrx7q797HxL2EIaxydp_0 2024-09-12T00:56:19.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.700+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__shadow_.iRISnhXyU2xuJrx7q797HxL2EIaxydp_1 2024-09-12T00:56:19.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.700+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10883047650715877405', time=2024-09-12T02:48:46.496645+0000, chain.objs.size()=1 2024-09-12T00:56:19.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.700+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.20__shadow_.eakQxl4kaLriVcM9YqURVZy8JRPIKeq_0 2024-09-12T00:56:19.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.700+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7382438481212756202', time=2024-09-12T02:49:24.179532+0000, chain.objs.size()=1 2024-09-12T00:56:19.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.700+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23__shadow_.ZE3AM4aivjmcCe6MPhxssoInGUFXyKh_0 2024-09-12T00:56:19.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.700+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4928916473299415728', time=2024-09-12T02:50:36.218861+0000, chain.objs.size()=1 2024-09-12T00:56:19.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.700+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.27__shadow_.1m3RKb2WhojxOrWpu6gUFyfPeh1dA0N_0 2024-09-12T00:56:19.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.700+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14541330482523786790', time=2024-09-12T02:51:13.759723+0000, chain.objs.size()=1 2024-09-12T00:56:19.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.700+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30__shadow_.iclu2g136KhPB6aRqYiVFw5ffO83FBw_0 2024-09-12T00:56:19.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.700+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3815362946462459284', time=2024-09-12T02:51:14.499706+0000, chain.objs.size()=1 2024-09-12T00:56:19.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.700+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30__shadow_.PZWaalCkL7r9o1hn1FLGrMR64tVgLBV_0 2024-09-12T00:56:19.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.700+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8401636492507787324', time=2024-09-12T02:51:16.523758+0000, chain.objs.size()=1 2024-09-12T00:56:19.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.700+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31__shadow_.skVpyz5f8XW4jlu5CnR5oSmAiTOL1cg_0 2024-09-12T00:56:19.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.702+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2561466577755120786', time=2024-09-12T02:52:25.913249+0000, chain.objs.size()=1 2024-09-12T00:56:19.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.702+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.34__shadow_.uHK-TWecnPuObfvrJ8vdTg1kFbGhKW2_0 2024-09-12T00:56:19.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.702+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8844400196625260661', time=2024-09-12T02:52:28.177506+0000, chain.objs.size()=1 2024-09-12T00:56:19.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.702+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35__shadow_.lJjiI73OPy1TWgrMlefXr037VkXzOiR_0 2024-09-12T00:56:19.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.703+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3216792704981655374', time=2024-09-12T02:52:29.051218+0000, chain.objs.size()=1 2024-09-12T00:56:19.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.703+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.35__shadow_.2G0OX6h5NHVerTy32w5wIsot1B7FD-Z_0 2024-09-12T00:56:19.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.703+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4269792390588960452', time=2024-09-12T02:53:07.317674+0000, chain.objs.size()=1 2024-09-12T00:56:19.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.703+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38__shadow_.6ykoeH81kfCf8aI8fAOIioPed_syi57_0 2024-09-12T00:56:19.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.703+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15923844587590024004', time=2024-09-12T02:53:40.105521+0000, chain.objs.size()=1 2024-09-12T00:56:19.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.703+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39__shadow_.CDahxbBqcvBdkpUcCiZxLSwKd7GV3xY_0 2024-09-12T00:56:19.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.703+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2168592659264586015', time=2024-09-12T02:53:40.155099+0000, chain.objs.size()=1 2024-09-12T00:56:19.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.703+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39__shadow_.A6I9GPXWzTe1hYgkMqsSvlrNSV70qDs_0 2024-09-12T00:56:19.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.705+0000 7f73a1346800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:19.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.707+0000 7f73a1346800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:56:19.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.709+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:19.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.709+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:19.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.710+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T00:56:19.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.710+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.394425412405412252', time=2024-09-12T02:48:44.383279+0000, chain.objs.size()=1 2024-09-12T00:56:19.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.710+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.19__shadow_.L--yit0lwUqQYt6PDTP3ZCZDcp79-tz_0 2024-09-12T00:56:19.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.710+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12708307057968206199', time=2024-09-12T02:48:46.459651+0000, chain.objs.size()=1 2024-09-12T00:56:19.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.710+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.20__shadow_.EtxZZzjkh6R6Bm0KNOBJgixbl9lpGhv_0 2024-09-12T00:56:19.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.710+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2396619589621716600', time=2024-09-12T02:49:21.872896+0000, chain.objs.size()=1 2024-09-12T00:56:19.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.710+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.22__shadow_.oSMD42JWRw3CnEqDOGyAVITxO1mQofC_0 2024-09-12T00:56:19.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.710+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18086827498925920527', time=2024-09-12T02:49:24.180156+0000, chain.objs.size()=1 2024-09-12T00:56:19.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.710+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23__shadow_.Dceyatrdeg3B64BYzOYyyZIxnkEc_Br_0 2024-09-12T00:56:19.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.710+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11304744783413229556', time=2024-09-12T02:49:57.970938+0000, chain.objs.size()=1 2024-09-12T00:56:19.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.710+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24__shadow_.0O5nSVgJ125USvssFm-6l0Gu1fNQOVJ_0 2024-09-12T00:56:19.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.710+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11392657621500697581', time=2024-09-12T02:50:02.699413+0000, chain.objs.size()=1 2024-09-12T00:56:19.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.710+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.26__shadow_.iKsrcKf8P9ohpJR0qC7ZgRoVstAtsoz_0 2024-09-12T00:56:19.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.710+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13208731707602393382', time=2024-09-12T02:50:02.703445+0000, chain.objs.size()=1 2024-09-12T00:56:19.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.710+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.26__shadow_.goTVmf22AkXMNJf7U1UUcCPt-YqCR-R_0 2024-09-12T00:56:19.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.710+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1980169191376445209', time=2024-09-12T02:51:11.677565+0000, chain.objs.size()=1 2024-09-12T00:56:19.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.710+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.29__shadow_.c4yUCj9-QUrCjSAFxVn87plKkK-55jh_0 2024-09-12T00:56:19.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.710+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6833043519745637351', time=2024-09-12T02:51:14.441770+0000, chain.objs.size()=1 2024-09-12T00:56:19.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.710+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30__shadow_.nHJvMiRFrgFUaD7-O8Kms4uUyRDW5UW_0 2024-09-12T00:56:19.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.710+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3504747576823824179', time=2024-09-12T02:51:14.499608+0000, chain.objs.size()=1 2024-09-12T00:56:19.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.710+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.30__shadow_.8zD58muq2oKpSrgMLxpmNId1SAUZMu__0 2024-09-12T00:56:19.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.710+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9477994134666233102', time=2024-09-12T02:51:16.523750+0000, chain.objs.size()=1 2024-09-12T00:56:19.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.710+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31__shadow_.PbUkT2U5JsjzEe0LsDsrtr9FoYqTP3K_0 2024-09-12T00:56:19.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.710+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10903775645067078158', time=2024-09-12T02:51:52.750147+0000, chain.objs.size()=1 2024-09-12T00:56:19.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.710+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.33__shadow_.Vx_IejnjAklS2P-m5_rW5KtqDR8cTh2_0 2024-09-12T00:56:19.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.712+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10663396582016096458', time=2024-09-12T02:53:02.859293+0000, chain.objs.size()=1 2024-09-12T00:56:19.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.712+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36__shadow_.15JVE71t3UsNJ64E2saWDxLu2YUFo0g_0 2024-09-12T00:56:19.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.712+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5058732081116047356', time=2024-09-12T02:53:07.359223+0000, chain.objs.size()=1 2024-09-12T00:56:19.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.712+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.38__shadow_.4J0XP6rvk_Rvp9XnC85lz43zNXYUZdy_0 2024-09-12T00:56:19.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.712+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17363098298201040897', time=2024-09-12T02:55:47.897416+0000, chain.objs.size()=1 2024-09-12T00:56:19.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.712+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17__shadow_.uRyeaJDdJXDUS4yDM4Y25XON1_dNsDf_0 2024-09-12T00:56:19.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.713+0000 7f73a1346800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:19.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.715+0000 7f73a1346800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:56:19.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.717+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:19.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.717+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:19.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.717+0000 7f73a1346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T00:56:19.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.717+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='_qPClndDhGbdoDUIcSHxDZXhmk5SvGk1', time=2024-09-12T02:47:27.470583+0000, chain.objs.size()=1 2024-09-12T00:56:19.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.717+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15__shadow_.tRDhGs81AZCXFB-jO4wLzC0PJHjqP54_0 2024-09-12T00:56:19.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.717+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10636927906633586803', time=2024-09-12T02:47:27.553336+0000, chain.objs.size()=3 2024-09-12T00:56:19.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.717+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__multipart_foo-STANDARD.2~9RG2VEYRfif8VmTRB2IwKJXR8DE14Tv.1 2024-09-12T00:56:19.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.717+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__multipart_foo-STANDARD.2~9RG2VEYRfif8VmTRB2IwKJXR8DE14Tv.2 2024-09-12T00:56:19.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.717+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16__multipart_foo-STANDARD.2~9RG2VEYRfif8VmTRB2IwKJXR8DE14Tv.3 2024-09-12T00:56:19.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.717+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16848543318925303720', time=2024-09-12T02:48:46.448639+0000, chain.objs.size()=1 2024-09-12T00:56:19.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.717+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.20__shadow_.fTQpGepdDQ9uPh5uqP3fbHUDW81kC8N_0 2024-09-12T00:56:19.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.717+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9157017204191261548', time=2024-09-12T02:48:46.533544+0000, chain.objs.size()=1 2024-09-12T00:56:19.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.717+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.20__shadow_.wO4H0IoOYN9CuNKsm08w4iC6YIjUGEd_0 2024-09-12T00:56:19.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.717+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5860982849189284800', time=2024-09-12T02:49:24.129241+0000, chain.objs.size()=1 2024-09-12T00:56:19.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.717+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23__shadow_.q0bX5i3pE-8AnAJ_W3Ot9Q6nrsUE-A3_0 2024-09-12T00:56:19.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.717+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14952937075384506064', time=2024-09-12T02:49:24.142301+0000, chain.objs.size()=1 2024-09-12T00:56:19.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.717+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23__shadow_.dmnMY0OhEl21hiAM27qcNThS7qVt_Jm_0 2024-09-12T00:56:19.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.717+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7341645067267687369', time=2024-09-12T02:49:24.208846+0000, chain.objs.size()=1 2024-09-12T00:56:19.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.717+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.23__shadow_.n8WeYXjVDiVwuFmwM2YbYkUlTnuYmz9_0 2024-09-12T00:56:19.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.717+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8025588394687565335', time=2024-09-12T02:49:58.008377+0000, chain.objs.size()=1 2024-09-12T00:56:19.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.717+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.24__shadow_.Adtq5Ss3Y-tcxrX-gTBbG9g0lRzuHhQ_0 2024-09-12T00:56:19.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.717+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2858139489681836149', time=2024-09-12T02:50:00.362443+0000, chain.objs.size()=1 2024-09-12T00:56:19.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.717+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25__shadow_.D8mQSojhXDJkHhWuzc-xG_rV7omZ9uj_0 2024-09-12T00:56:19.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.717+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1407187182304860525', time=2024-09-12T02:50:00.378021+0000, chain.objs.size()=1 2024-09-12T00:56:19.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.717+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.25__shadow_.ZSrQC6UID0OS1ktZTZhnNs6RWuW7CF3_0 2024-09-12T00:56:19.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.721+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12660800018584025513', time=2024-09-12T02:51:50.094001+0000, chain.objs.size()=1 2024-09-12T00:56:19.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.721+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.32__shadow_.LZlaCCBm8QWBEyjORpv7Za-1pAblUGl_0 2024-09-12T00:56:19.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.721+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7604260679313172762', time=2024-09-12T02:53:02.829970+0000, chain.objs.size()=1 2024-09-12T00:56:19.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.721+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.36__shadow_.NEIvgKh1odYBg5-VFoGtJVcpACg2mJB_0 2024-09-12T00:56:19.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.721+0000 7f73a1346800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13940718891537257028', time=2024-09-12T02:53:40.083477+0000, chain.objs.size()=1 2024-09-12T00:56:19.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.721+0000 7f73a1346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.39__shadow_.GtE_JCcEpY07gC9uuB4M1K6OMq9QAZK_0 2024-09-12T00:56:19.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.722+0000 7f73a1346800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:19.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.725+0000 7f72557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:19.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.727+0000 7f73a1346800 20 remove_watcher() i=0 2024-09-12T00:56:19.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.727+0000 7f73a1346800 2 removed watcher, disabling cache 2024-09-12T00:56:19.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.728+0000 7f73a1346800 20 remove_watcher() i=1 2024-09-12T00:56:19.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.729+0000 7f73a1346800 20 remove_watcher() i=2 2024-09-12T00:56:19.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.730+0000 7f73a1346800 20 remove_watcher() i=3 2024-09-12T00:56:19.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.731+0000 7f73a1346800 20 remove_watcher() i=4 2024-09-12T00:56:19.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.732+0000 7f73a1346800 20 remove_watcher() i=5 2024-09-12T00:56:19.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.733+0000 7f73a1346800 20 remove_watcher() i=6 2024-09-12T00:56:19.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.734+0000 7f73a1346800 20 remove_watcher() i=7 2024-09-12T00:56:19.744 DEBUG:teuthology.orchestra.run.smithi073:> radosgw-admin gc process --include-all 2024-09-12T00:56:19.837 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:56:19.837 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:56:19.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.875+0000 7f7d578bb800 20 rados->read ofs=0 len=0 2024-09-12T00:56:19.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.877+0000 7f7d578bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:19.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.877+0000 7f7d578bb800 20 realm 2024-09-12T00:56:19.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.877+0000 7f7d578bb800 20 rados->read ofs=0 len=0 2024-09-12T00:56:19.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.877+0000 7f7d578bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:19.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.877+0000 7f7d578bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:19.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.877+0000 7f7d578bb800 20 rados->read ofs=0 len=0 2024-09-12T00:56:19.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.877+0000 7f7d578bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:19.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.877+0000 7f7d578bb800 20 rados->read ofs=0 len=0 2024-09-12T00:56:19.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.878+0000 7f7d578bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:19.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.878+0000 7f7d578bb800 20 rados->read ofs=0 len=0 2024-09-12T00:56:19.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.879+0000 7f7d578bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:19.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.879+0000 7f7d578bb800 20 searching for the correct realm 2024-09-12T00:56:19.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:19.881+0000 7f7d55ba6640 0 -- 172.21.15.73:0/343621883 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f7d40027070 msgr2=0x7f7d4007dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:56:20.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.088+0000 7f7d55ba6640 0 -- 172.21.15.73:0/343621883 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f7d40027070 msgr2=0x7f7d4007dd60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:20.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.091+0000 7f7d578bb800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T00:56:20.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.091+0000 7f7d578bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:20.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.091+0000 7f7d578bb800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T00:56:20.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.091+0000 7f7d578bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:20.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.091+0000 7f7d578bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:20.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.091+0000 7f7d578bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:20.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.091+0000 7f7d578bb800 20 rados->read ofs=0 len=0 2024-09-12T00:56:20.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.091+0000 7f7d578bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:20.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.091+0000 7f7d578bb800 20 rados->read ofs=0 len=0 2024-09-12T00:56:20.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.092+0000 7f7d578bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:20.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.092+0000 7f7d578bb800 20 rados->read ofs=0 len=0 2024-09-12T00:56:20.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.092+0000 7f7d578bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:20.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.092+0000 7f7d578bb800 20 zone default found 2024-09-12T00:56:20.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.092+0000 7f7d578bb800 4 Realm: () 2024-09-12T00:56:20.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.092+0000 7f7d578bb800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T00:56:20.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.092+0000 7f7d578bb800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T00:56:20.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.092+0000 7f7d578bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:20.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.092+0000 7f7d578bb800 20 zonegroup default 2024-09-12T00:56:20.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.092+0000 7f7d578bb800 20 rados->read ofs=0 len=0 2024-09-12T00:56:20.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.092+0000 7f7d578bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:20.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.092+0000 7f7d578bb800 20 rados->read ofs=0 len=0 2024-09-12T00:56:20.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.093+0000 7f7d578bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:20.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.093+0000 7f7d578bb800 20 rados->read ofs=0 len=0 2024-09-12T00:56:20.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.093+0000 7f7d578bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:20.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.093+0000 7f7d578bb800 20 started sync module instance, tier type = 2024-09-12T00:56:20.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.093+0000 7f7d578bb800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T00:56:20.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.102+0000 7f7d578bb800 20 add_watcher() i=0 2024-09-12T00:56:20.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.102+0000 7f7d578bb800 20 add_watcher() i=1 2024-09-12T00:56:20.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.102+0000 7f7d578bb800 20 add_watcher() i=2 2024-09-12T00:56:20.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.102+0000 7f7d578bb800 20 add_watcher() i=3 2024-09-12T00:56:20.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.102+0000 7f7d578bb800 20 add_watcher() i=4 2024-09-12T00:56:20.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.102+0000 7f7d578bb800 20 add_watcher() i=5 2024-09-12T00:56:20.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.102+0000 7f7d578bb800 20 add_watcher() i=6 2024-09-12T00:56:20.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.103+0000 7f7d578bb800 20 add_watcher() i=7 2024-09-12T00:56:20.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.103+0000 7f7d578bb800 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:20.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.104+0000 7f7c0bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:20.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.105+0000 7f7d578bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:20.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.105+0000 7f7d578bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:20.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.139+0000 7f7c0afe5640 20 reqs_thread_entry: start 2024-09-12T00:56:20.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.139+0000 7f7d578bb800 20 init_complete bucket index max shards: 1 2024-09-12T00:56:20.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.139+0000 7f7d578bb800 20 Filter name: none 2024-09-12T00:56:20.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.139+0000 7f7c08fe1640 20 reqs_thread_entry: start 2024-09-12T00:56:20.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.139+0000 7f7d578bb800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:56:20.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.141+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.142+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:20.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.142+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.143+0000 7f7d578bb800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:56:20.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.144+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.144+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:20.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.145+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.146+0000 7f7d578bb800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:56:20.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.147+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.147+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:20.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.148+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.149+0000 7f7d578bb800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:56:20.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.150+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.151+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:20.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.151+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.152+0000 7f7d578bb800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:56:20.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.153+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.153+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:20.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.154+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.155+0000 7f7d578bb800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:56:20.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.156+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.156+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:20.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.157+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.158+0000 7f7d578bb800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:56:20.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.159+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.159+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:20.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.160+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.160+0000 7f7d578bb800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:56:20.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.162+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.162+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:20.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.162+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.163+0000 7f7d578bb800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:56:20.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.165+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.165+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:20.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.166+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.167+0000 7f7d578bb800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:56:20.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.168+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.168+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:20.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.168+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.169+0000 7f7d578bb800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:56:20.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.171+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.171+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:20.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.171+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.172+0000 7f7d578bb800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:56:20.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.173+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.174+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:20.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.174+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.175+0000 7f7d578bb800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:56:20.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.176+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.176+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:20.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.177+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.178+0000 7f7d578bb800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:56:20.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.179+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.180+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:20.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.180+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.181+0000 7f7d578bb800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:56:20.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.182+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.183+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:20.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.183+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.185+0000 7f7d578bb800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:56:20.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.186+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.187+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:20.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.187+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.188+0000 7f7d578bb800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:56:20.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.189+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.189+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:20.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.190+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.191+0000 7f7d578bb800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:56:20.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.192+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.192+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:20.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.193+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.194+0000 7f7d578bb800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:56:20.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.195+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.195+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:20.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.195+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.196+0000 7f7d578bb800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:56:20.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.198+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.199+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:20.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.199+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.201+0000 7f7d578bb800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:56:20.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.202+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.203+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:20.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.203+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.204+0000 7f7d578bb800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:56:20.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.205+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.206+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:20.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.206+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.207+0000 7f7d578bb800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:56:20.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.208+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.208+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:20.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.208+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.210+0000 7f7d578bb800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:56:20.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.211+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.212+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:20.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.212+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.213+0000 7f7d578bb800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:56:20.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.214+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.215+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:20.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.215+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.216+0000 7f7d578bb800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:56:20.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.217+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.218+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:20.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.218+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.219+0000 7f7d578bb800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:56:20.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.221+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.221+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:20.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.221+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.222+0000 7f7d578bb800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:56:20.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.223+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.224+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:20.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.224+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.225+0000 7f7d578bb800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:56:20.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.226+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.227+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:20.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.227+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.228+0000 7f7d578bb800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:56:20.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.229+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.230+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:20.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.230+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.231+0000 7f7d578bb800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:56:20.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.232+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.233+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:20.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.233+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.234+0000 7f7d578bb800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:56:20.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.236+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.236+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:20.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.236+0000 7f7d578bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:20.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.238+0000 7f7c0bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:20.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.240+0000 7f7d578bb800 20 remove_watcher() i=0 2024-09-12T00:56:20.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.240+0000 7f7d578bb800 2 removed watcher, disabling cache 2024-09-12T00:56:20.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.241+0000 7f7d578bb800 20 remove_watcher() i=1 2024-09-12T00:56:20.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.242+0000 7f7d578bb800 20 remove_watcher() i=2 2024-09-12T00:56:20.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.243+0000 7f7d578bb800 20 remove_watcher() i=3 2024-09-12T00:56:20.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.245+0000 7f7d578bb800 20 remove_watcher() i=4 2024-09-12T00:56:20.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.246+0000 7f7d578bb800 20 remove_watcher() i=5 2024-09-12T00:56:20.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.247+0000 7f7d578bb800 20 remove_watcher() i=6 2024-09-12T00:56:20.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T00:56:20.248+0000 7f7d578bb800 20 remove_watcher() i=7 2024-09-12T00:56:20.258 DEBUG:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2024-09-12T00:56:20.773 INFO:teuthology.orchestra.run.smithi073.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2024-09-12T00:56:24.174 INFO:teuthology.orchestra.run.smithi073.stdout:> Task :clean UP-TO-DATE 2024-09-12T00:56:41.572 INFO:teuthology.orchestra.run.smithi073.stdout:> Task :compileJava 2024-09-12T00:56:41.573 INFO:teuthology.orchestra.run.smithi073.stdout:> Task :processResources 2024-09-12T00:56:41.573 INFO:teuthology.orchestra.run.smithi073.stdout:> Task :classes 2024-09-12T00:56:42.272 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:56:42.273 INFO:teuthology.orchestra.run.smithi073.stdout:> Task :compileTestJava 2024-09-12T00:56:42.273 INFO:teuthology.orchestra.run.smithi073.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T00:56:42.273 INFO:teuthology.orchestra.run.smithi073.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T00:56:42.274 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:56:42.274 INFO:teuthology.orchestra.run.smithi073.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T00:56:42.274 INFO:teuthology.orchestra.run.smithi073.stdout:> Task :testClasses 2024-09-12T00:56:48.173 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:56:48.173 INFO:teuthology.orchestra.run.smithi073.stdout:> Task :test 2024-09-12T00:56:48.174 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:56:48.174 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2024-09-12T00:56:53.272 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:56:53.272 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2024-09-12T00:56:53.572 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:56:53.572 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2024-09-12T00:56:53.672 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:56:53.672 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2024-09-12T00:56:53.972 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:56:53.972 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2024-09-12T00:57:02.572 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:57:02.572 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2024-09-12T00:57:02.872 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:57:02.872 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2024-09-12T00:57:02.972 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:57:02.972 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2024-09-12T00:57:03.072 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:57:03.072 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2024-09-12T00:57:03.073 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:57:03.073 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2024-09-12T00:57:03.472 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:57:03.472 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2024-09-12T00:57:08.772 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:57:08.772 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2024-09-12T00:57:09.372 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:57:09.372 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2024-09-12T00:57:09.572 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:57:09.572 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STANDARD_OUT 2024-09-12T00:57:09.572 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12 00:57:09,516 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T00:57:59.973 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:57:59.973 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2024-09-12T00:58:00.472 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:58:00.472 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2024-09-12T00:58:00.572 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:58:00.572 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2024-09-12T00:58:00.872 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:58:00.872 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2024-09-12T00:58:00.972 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:58:00.972 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2024-09-12T00:58:01.472 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:58:01.472 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2024-09-12T00:58:06.672 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:58:06.672 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2024-09-12T00:58:07.072 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:58:07.072 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2024-09-12T00:58:07.072 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:58:07.072 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2024-09-12T00:58:07.272 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:58:07.272 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2024-09-12T00:58:23.372 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:58:23.372 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2024-09-12T00:58:25.272 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:58:25.272 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests STANDARD_OUT 2024-09-12T00:58:25.273 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12 00:58:25,197 [s3-transfer-manager-worker-9] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-12T00:58:25.273 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12 00:58:25,201 [s3-transfer-manager-worker-10] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-12T00:58:25.273 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12 00:58:25,205 [s3-transfer-manager-worker-1] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-12T00:58:25.472 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:58:25.472 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2024-09-12T00:58:35.972 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:58:35.973 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2024-09-12T00:58:36.472 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:58:36.472 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2024-09-12T00:58:43.072 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:58:43.072 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2024-09-12T00:58:43.372 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T00:58:43.372 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2024-09-12T01:00:08.172 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:00:08.173 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2024-09-12T01:00:08.472 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:00:08.472 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2024-09-12T01:00:25.372 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:00:25.372 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2024-09-12T01:00:25.672 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:00:25.672 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2024-09-12T01:00:31.072 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:00:31.072 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2024-09-12T01:00:31.372 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:00:31.372 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2024-09-12T01:00:33.372 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:00:33.372 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2024-09-12T01:00:38.972 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:00:38.972 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2024-09-12T01:00:39.072 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:00:39.072 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2024-09-12T01:00:39.373 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:00:39.374 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2024-09-12T01:00:39.472 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:00:40.090 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2024-09-12T01:00:40.091 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:00:40.091 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2024-09-12T01:00:40.092 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:00:40.092 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2024-09-12T01:00:40.272 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:00:40.272 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2024-09-12T01:00:40.273 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:00:40.273 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2024-09-12T01:00:40.672 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:00:40.672 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2024-09-12T01:00:40.772 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:00:40.772 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2024-09-12T01:00:41.072 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:00:41.072 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2024-09-12T01:00:41.172 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:00:41.172 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2024-09-12T01:00:41.472 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:00:41.472 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2024-09-12T01:00:41.572 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:00:41.572 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2024-09-12T01:00:41.872 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:00:41.872 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2024-09-12T01:00:53.572 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:00:53.572 INFO:teuthology.orchestra.run.smithi073.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2024-09-12T01:00:53.972 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:00:53.972 INFO:teuthology.orchestra.run.smithi073.stdout:---------------------------------------------------------------------- 2024-09-12T01:00:53.972 INFO:teuthology.orchestra.run.smithi073.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2024-09-12T01:00:53.973 INFO:teuthology.orchestra.run.smithi073.stdout:---------------------------------------------------------------------- 2024-09-12T01:00:54.017 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:00:54.017 INFO:teuthology.orchestra.run.smithi073.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T01:00:54.017 INFO:teuthology.orchestra.run.smithi073.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T01:00:54.017 INFO:teuthology.orchestra.run.smithi073.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T01:00:54.017 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:00:54.017 INFO:teuthology.orchestra.run.smithi073.stdout:BUILD SUCCESSFUL in 4m 33s 2024-09-12T01:00:54.017 INFO:teuthology.orchestra.run.smithi073.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2024-09-12T01:00:54.335 DEBUG:teuthology.orchestra.run.smithi073:> radosgw-admin gc process --include-all 2024-09-12T01:00:54.389 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:00:54.389 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:00:54.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.428+0000 7f882b52e800 20 rados->read ofs=0 len=0 2024-09-12T01:00:54.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.430+0000 7f882b52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:54.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.430+0000 7f882b52e800 20 realm 2024-09-12T01:00:54.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.430+0000 7f882b52e800 20 rados->read ofs=0 len=0 2024-09-12T01:00:54.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.430+0000 7f882b52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:54.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.430+0000 7f882b52e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:00:54.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.430+0000 7f882b52e800 20 rados->read ofs=0 len=0 2024-09-12T01:00:54.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.430+0000 7f882b52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:54.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.430+0000 7f882b52e800 20 rados->read ofs=0 len=0 2024-09-12T01:00:54.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.431+0000 7f882b52e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:54.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.431+0000 7f882b52e800 20 rados->read ofs=0 len=0 2024-09-12T01:00:54.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.432+0000 7f882b52e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:00:54.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.432+0000 7f882b52e800 20 searching for the correct realm 2024-09-12T01:00:54.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.435+0000 7f8827965640 0 -- 172.21.15.73:0/98882436 >> [v2:172.21.15.73:6800/2864081714,v1:172.21.15.73:6801/2864081714] conn(0x559d608d2680 msgr2=0x559d608d4b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:00:54.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.439+0000 7f8827164640 0 -- 172.21.15.73:0/98882436 >> [v2:172.21.15.117:6816/1460498570,v1:172.21.15.117:6817/1460498570] conn(0x7f8820061040 msgr2=0x7f88200a7d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:54.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.443+0000 7f882b52e800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T01:00:54.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.443+0000 7f882b52e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:00:54.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.443+0000 7f882b52e800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T01:00:54.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.443+0000 7f882b52e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:00:54.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.443+0000 7f882b52e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:00:54.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.443+0000 7f882b52e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:00:54.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.443+0000 7f882b52e800 20 rados->read ofs=0 len=0 2024-09-12T01:00:54.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.443+0000 7f882b52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:54.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.443+0000 7f882b52e800 20 rados->read ofs=0 len=0 2024-09-12T01:00:54.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.443+0000 7f882b52e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:54.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.443+0000 7f882b52e800 20 rados->read ofs=0 len=0 2024-09-12T01:00:54.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.444+0000 7f882b52e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:00:54.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.444+0000 7f882b52e800 20 zone default found 2024-09-12T01:00:54.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.444+0000 7f882b52e800 4 Realm: () 2024-09-12T01:00:54.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.444+0000 7f882b52e800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T01:00:54.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.444+0000 7f882b52e800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T01:00:54.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.444+0000 7f882b52e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:00:54.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.444+0000 7f882b52e800 20 zonegroup default 2024-09-12T01:00:54.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.444+0000 7f882b52e800 20 rados->read ofs=0 len=0 2024-09-12T01:00:54.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.444+0000 7f882b52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:54.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.444+0000 7f882b52e800 20 rados->read ofs=0 len=0 2024-09-12T01:00:54.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.444+0000 7f882b52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:54.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.444+0000 7f882b52e800 20 rados->read ofs=0 len=0 2024-09-12T01:00:54.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.445+0000 7f882b52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:54.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.445+0000 7f882b52e800 20 started sync module instance, tier type = 2024-09-12T01:00:54.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.445+0000 7f882b52e800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T01:00:54.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.454+0000 7f882b52e800 20 add_watcher() i=0 2024-09-12T01:00:54.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.454+0000 7f882b52e800 20 add_watcher() i=1 2024-09-12T01:00:54.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.454+0000 7f882b52e800 20 add_watcher() i=2 2024-09-12T01:00:54.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.454+0000 7f882b52e800 20 add_watcher() i=3 2024-09-12T01:00:54.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.454+0000 7f882b52e800 20 add_watcher() i=4 2024-09-12T01:00:54.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.454+0000 7f882b52e800 20 add_watcher() i=5 2024-09-12T01:00:54.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.454+0000 7f882b52e800 20 add_watcher() i=6 2024-09-12T01:00:54.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.455+0000 7f882b52e800 20 add_watcher() i=7 2024-09-12T01:00:54.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.455+0000 7f882b52e800 2 all 8 watchers are set, enabling cache 2024-09-12T01:00:54.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.456+0000 7f86ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:54.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.456+0000 7f882b52e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:00:54.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.456+0000 7f882b52e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:00:54.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.493+0000 7f86dcfe1640 20 reqs_thread_entry: start 2024-09-12T01:00:54.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.493+0000 7f882b52e800 20 init_complete bucket index max shards: 1 2024-09-12T01:00:54.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.494+0000 7f882b52e800 20 Filter name: none 2024-09-12T01:00:54.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.494+0000 7f86567fc640 20 reqs_thread_entry: start 2024-09-12T01:00:54.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.494+0000 7f882b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T01:00:54.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.495+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:54.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.495+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:54.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.496+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:00:54.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.496+0000 7f882b52e800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10153880727586129460', time=2024-09-12T02:57:02.667306+0000, chain.objs.size()=5 2024-09-12T01:00:54.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.496+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.42__multipart_key1.2~2TG78aEdrn1Hx6_uU6tr9lvc5aHoMCX.1 2024-09-12T01:00:54.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.496+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.42__multipart_key1.2~2TG78aEdrn1Hx6_uU6tr9lvc5aHoMCX.2 2024-09-12T01:00:54.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.496+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.42__multipart_key1.2~2TG78aEdrn1Hx6_uU6tr9lvc5aHoMCX.3 2024-09-12T01:00:54.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.496+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.42__multipart_key1.2~2TG78aEdrn1Hx6_uU6tr9lvc5aHoMCX.4 2024-09-12T01:00:54.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.496+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.42__multipart_key1.2~2TG78aEdrn1Hx6_uU6tr9lvc5aHoMCX.5 2024-09-12T01:00:54.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.499+0000 7f882b52e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:00:54.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.501+0000 7f882b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T01:00:54.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.502+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:54.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.502+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:54.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.503+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:54.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.504+0000 7f882b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T01:00:54.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.505+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:54.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.505+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:54.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.506+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:00:54.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.506+0000 7f882b52e800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1273227154166240714', time=2024-09-12T03:00:40.830074+0000, chain.objs.size()=1 2024-09-12T01:00:54.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.506+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.63__shadow_.vj2Q5zQ81FpwJS6PVk7K4a9E-JaMTgf_0 2024-09-12T01:00:54.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.507+0000 7f882b52e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:00:54.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.510+0000 7f882b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T01:00:54.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.511+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:54.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.512+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:54.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.512+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T01:00:54.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.512+0000 7f882b52e800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14750377932726170941', time=2024-09-12T02:57:53.733545+0000, chain.objs.size()=5 2024-09-12T01:00:54.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.512+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.47__multipart_key1.2~gJ-OqhgYRomf7zfjBC6R0XkpdKM_-Sl.1 2024-09-12T01:00:54.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.512+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.47__multipart_key1.2~gJ-OqhgYRomf7zfjBC6R0XkpdKM_-Sl.2 2024-09-12T01:00:54.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.512+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.47__multipart_key1.2~gJ-OqhgYRomf7zfjBC6R0XkpdKM_-Sl.3 2024-09-12T01:00:54.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.512+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.47__multipart_key1.2~gJ-OqhgYRomf7zfjBC6R0XkpdKM_-Sl.4 2024-09-12T01:00:54.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.512+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.47__multipart_key1.2~gJ-OqhgYRomf7zfjBC6R0XkpdKM_-Sl.5 2024-09-12T01:00:54.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.512+0000 7f882b52e800 20 garbage collection: RGWGC::process iterating over entry tag='2~m4gHI3sI7fqC1mZZscZFAfoExStAYIe', time=2024-09-12T02:58:43.252479+0000, chain.objs.size()=3 2024-09-12T01:00:54.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.512+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.54__multipart_key1.2~m4gHI3sI7fqC1mZZscZFAfoExStAYIe.7 2024-09-12T01:00:54.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.512+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.54__multipart_key1.2~m4gHI3sI7fqC1mZZscZFAfoExStAYIe.10 2024-09-12T01:00:54.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.513+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.54__multipart_key1.2~m4gHI3sI7fqC1mZZscZFAfoExStAYIe.13 2024-09-12T01:00:54.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.516+0000 7f882b52e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:00:54.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.519+0000 7f882b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T01:00:54.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.520+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:54.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.520+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:54.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.521+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:00:54.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.521+0000 7f882b52e800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6975394613844814040', time=2024-09-12T02:58:36.232781+0000, chain.objs.size()=1 2024-09-12T01:00:54.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.521+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.53__shadow_.Er3jlpSNmTdNJqIfd94AKzECkdWplR__0 2024-09-12T01:00:54.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.522+0000 7f882b52e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:00:54.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.524+0000 7f882b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T01:00:54.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.525+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:54.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.526+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:54.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.526+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T01:00:54.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.526+0000 7f882b52e800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7663201243039880224', time=2024-09-12T02:57:42.074047+0000, chain.objs.size()=5 2024-09-12T01:00:54.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.526+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.47__multipart_key1.2~5smqZSgCeniDeJiQxQbiJojN9FRbItQ.1 2024-09-12T01:00:54.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.526+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.47__multipart_key1.2~5smqZSgCeniDeJiQxQbiJojN9FRbItQ.2 2024-09-12T01:00:54.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.526+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.47__multipart_key1.2~5smqZSgCeniDeJiQxQbiJojN9FRbItQ.3 2024-09-12T01:00:54.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.526+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.47__multipart_key1.2~5smqZSgCeniDeJiQxQbiJojN9FRbItQ.4 2024-09-12T01:00:54.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.526+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.47__multipart_key1.2~5smqZSgCeniDeJiQxQbiJojN9FRbItQ.5 2024-09-12T01:00:54.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.526+0000 7f882b52e800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8760303048080420585', time=2024-09-12T02:57:59.814340+0000, chain.objs.size()=5 2024-09-12T01:00:54.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.526+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.47__multipart_key1.2~hYc0-k5Vx1d7pNuyODPkXbqI9SyJC9k.1 2024-09-12T01:00:54.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.526+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.47__shadow_key1.2~hYc0-k5Vx1d7pNuyODPkXbqI9SyJC9k.1_1 2024-09-12T01:00:54.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.526+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.47__multipart_key1.2~hYc0-k5Vx1d7pNuyODPkXbqI9SyJC9k.2 2024-09-12T01:00:54.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.526+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.47__shadow_key1.2~hYc0-k5Vx1d7pNuyODPkXbqI9SyJC9k.2_1 2024-09-12T01:00:54.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.526+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.47__multipart_key1.2~hYc0-k5Vx1d7pNuyODPkXbqI9SyJC9k.3 2024-09-12T01:00:54.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.526+0000 7f882b52e800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12163054672120186404', time=2024-09-12T02:59:05.641323+0000, chain.objs.size()=11 2024-09-12T01:00:54.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.526+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__multipart_key1.2~H-H4OygHN48lQo3_cCwS8nEOELpEPnC.1 2024-09-12T01:00:54.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.526+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__multipart_key1.2~H-H4OygHN48lQo3_cCwS8nEOELpEPnC.2 2024-09-12T01:00:54.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.530+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__multipart_key1.2~H-H4OygHN48lQo3_cCwS8nEOELpEPnC.3 2024-09-12T01:00:54.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.530+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__multipart_key1.2~H-H4OygHN48lQo3_cCwS8nEOELpEPnC.4 2024-09-12T01:00:54.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.530+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__multipart_key1.2~H-H4OygHN48lQo3_cCwS8nEOELpEPnC.5 2024-09-12T01:00:54.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.530+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__multipart_key1.2~H-H4OygHN48lQo3_cCwS8nEOELpEPnC.6 2024-09-12T01:00:54.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.530+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__multipart_key1.2~H-H4OygHN48lQo3_cCwS8nEOELpEPnC.7 2024-09-12T01:00:54.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.530+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__multipart_key1.2~H-H4OygHN48lQo3_cCwS8nEOELpEPnC.8 2024-09-12T01:00:54.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.531+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__multipart_key1.2~H-H4OygHN48lQo3_cCwS8nEOELpEPnC.9 2024-09-12T01:00:54.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.531+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__multipart_key1.2~H-H4OygHN48lQo3_cCwS8nEOELpEPnC.10 2024-09-12T01:00:54.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.531+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__multipart_key1.2~H-H4OygHN48lQo3_cCwS8nEOELpEPnC.11 2024-09-12T01:00:54.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.535+0000 7f882b52e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:00:54.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.537+0000 7f882b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T01:00:54.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.538+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:54.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.539+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:54.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.539+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:00:54.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.539+0000 7f882b52e800 20 garbage collection: RGWGC::process iterating over entry tag='2~4D9nsJPkJDnWC7Uz4yD05R7a3y9r9IH', time=2024-09-12T02:56:53.173098+0000, chain.objs.size()=5 2024-09-12T01:00:54.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.539+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.40__multipart_key1.2~4D9nsJPkJDnWC7Uz4yD05R7a3y9r9IH.1 2024-09-12T01:00:54.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.539+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.40__multipart_key1.2~4D9nsJPkJDnWC7Uz4yD05R7a3y9r9IH.2 2024-09-12T01:00:54.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.539+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.40__multipart_key1.2~4D9nsJPkJDnWC7Uz4yD05R7a3y9r9IH.3 2024-09-12T01:00:54.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.539+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.40__multipart_key1.2~4D9nsJPkJDnWC7Uz4yD05R7a3y9r9IH.4 2024-09-12T01:00:54.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.539+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.40__multipart_key1.2~4D9nsJPkJDnWC7Uz4yD05R7a3y9r9IH.5 2024-09-12T01:00:54.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.542+0000 7f882b52e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:00:54.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.544+0000 7f882b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T01:00:54.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.546+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:54.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.546+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:54.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.547+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T01:00:54.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.547+0000 7f882b52e800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14693665922562212312', time=2024-09-12T02:57:09.098158+0000, chain.objs.size()=5 2024-09-12T01:00:54.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.547+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.44__multipart_key1.2~KQAZwehyggLfRXY_TBG6VhKto5D_1O9.1 2024-09-12T01:00:54.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.547+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.44__multipart_key1.2~KQAZwehyggLfRXY_TBG6VhKto5D_1O9.2 2024-09-12T01:00:54.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.547+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.44__multipart_key1.2~KQAZwehyggLfRXY_TBG6VhKto5D_1O9.3 2024-09-12T01:00:54.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.547+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.44__multipart_key1.2~KQAZwehyggLfRXY_TBG6VhKto5D_1O9.4 2024-09-12T01:00:54.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.547+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.44__multipart_key1.2~KQAZwehyggLfRXY_TBG6VhKto5D_1O9.5 2024-09-12T01:00:54.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.547+0000 7f882b52e800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8987526480405508537', time=2024-09-12T02:57:38.517750+0000, chain.objs.size()=5 2024-09-12T01:00:54.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.547+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.47__multipart_key1.2~NDVxto_jwNg8t6JaksuAjtEmxLVQ8Km.1 2024-09-12T01:00:54.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.547+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.47__multipart_key1.2~NDVxto_jwNg8t6JaksuAjtEmxLVQ8Km.2 2024-09-12T01:00:54.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.547+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.47__multipart_key1.2~NDVxto_jwNg8t6JaksuAjtEmxLVQ8Km.3 2024-09-12T01:00:54.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.547+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.47__multipart_key1.2~NDVxto_jwNg8t6JaksuAjtEmxLVQ8Km.4 2024-09-12T01:00:54.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.547+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.47__multipart_key1.2~NDVxto_jwNg8t6JaksuAjtEmxLVQ8Km.5 2024-09-12T01:00:54.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.550+0000 7f882b52e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:00:54.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.552+0000 7f882b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T01:00:54.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.553+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:54.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.553+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:54.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.554+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:54.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.555+0000 7f882b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T01:00:54.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.556+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:54.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.556+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:54.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.557+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:54.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.557+0000 7f882b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T01:00:54.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.559+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:54.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.559+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:54.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.560+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:54.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.561+0000 7f882b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T01:00:54.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.562+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:54.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.562+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:54.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.562+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T01:00:54.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.562+0000 7f882b52e800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11117109557713913271', time=2024-09-12T02:58:36.128554+0000, chain.objs.size()=5 2024-09-12T01:00:54.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.562+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.53__multipart_file.mpg.2~bEjrym8QenDHxeW-Mu3TAATPx9x96bU.1 2024-09-12T01:00:54.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.562+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.53__multipart_file.mpg.2~bEjrym8QenDHxeW-Mu3TAATPx9x96bU.2 2024-09-12T01:00:54.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.562+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.53__multipart_file.mpg.2~bEjrym8QenDHxeW-Mu3TAATPx9x96bU.3 2024-09-12T01:00:54.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.562+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.53__multipart_file.mpg.2~bEjrym8QenDHxeW-Mu3TAATPx9x96bU.4 2024-09-12T01:00:54.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.562+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.53__multipart_file.mpg.2~bEjrym8QenDHxeW-Mu3TAATPx9x96bU.5 2024-09-12T01:00:54.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.562+0000 7f882b52e800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10727245015360869933', time=2024-09-12T03:00:31.161099+0000, chain.objs.size()=5 2024-09-12T01:00:54.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.562+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.57__multipart_key1.2~8dJTAA4gF_R_Ol-Jn5g-QAoXZkRUqrW.1 2024-09-12T01:00:54.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.562+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.57__multipart_key1.2~8dJTAA4gF_R_Ol-Jn5g-QAoXZkRUqrW.2 2024-09-12T01:00:54.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.562+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.57__multipart_key1.2~8dJTAA4gF_R_Ol-Jn5g-QAoXZkRUqrW.3 2024-09-12T01:00:54.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.562+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.57__multipart_key1.2~8dJTAA4gF_R_Ol-Jn5g-QAoXZkRUqrW.4 2024-09-12T01:00:54.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.562+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.57__multipart_key1.2~8dJTAA4gF_R_Ol-Jn5g-QAoXZkRUqrW.5 2024-09-12T01:00:54.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.567+0000 7f882b52e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:00:54.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.569+0000 7f882b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T01:00:54.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.570+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:54.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.570+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:54.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.571+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:00:54.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.571+0000 7f882b52e800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10377851811277455847', time=2024-09-12T03:00:39.983970+0000, chain.objs.size()=1 2024-09-12T01:00:54.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.571+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.61__shadow_.lTE4CwO67KFnztg27NRIQwi8f4pPuIm_0 2024-09-12T01:00:54.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.571+0000 7f882b52e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:00:54.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.573+0000 7f882b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T01:00:54.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.575+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:54.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.575+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:54.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.576+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T01:00:54.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.576+0000 7f882b52e800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8323177819005179715', time=2024-09-12T02:58:06.812071+0000, chain.objs.size()=5 2024-09-12T01:00:54.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.576+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.51__multipart_key1.2~v_dcQlktwFE8CZKLzi30NGja6F7m7mM.1 2024-09-12T01:00:54.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.576+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.51__multipart_key1.2~v_dcQlktwFE8CZKLzi30NGja6F7m7mM.2 2024-09-12T01:00:54.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.576+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.51__multipart_key1.2~v_dcQlktwFE8CZKLzi30NGja6F7m7mM.3 2024-09-12T01:00:54.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.576+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.51__multipart_key1.2~v_dcQlktwFE8CZKLzi30NGja6F7m7mM.4 2024-09-12T01:00:54.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.576+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.51__multipart_key1.2~v_dcQlktwFE8CZKLzi30NGja6F7m7mM.5 2024-09-12T01:00:54.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.576+0000 7f882b52e800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17486329974573435507', time=2024-09-12T02:58:25.175095+0000, chain.objs.size()=5 2024-09-12T01:00:54.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.576+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.52__multipart_key1.2~Dr6nYDQjUFZ8_T9Hh2BUj31TCiloxRS.1 2024-09-12T01:00:54.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.576+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.52__multipart_key1.2~Dr6nYDQjUFZ8_T9Hh2BUj31TCiloxRS.2 2024-09-12T01:00:54.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.576+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.52__multipart_key1.2~Dr6nYDQjUFZ8_T9Hh2BUj31TCiloxRS.3 2024-09-12T01:00:54.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.576+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.52__multipart_key1.2~Dr6nYDQjUFZ8_T9Hh2BUj31TCiloxRS.4 2024-09-12T01:00:54.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.576+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.52__multipart_key1.2~Dr6nYDQjUFZ8_T9Hh2BUj31TCiloxRS.5 2024-09-12T01:00:54.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.580+0000 7f882b52e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:00:54.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.582+0000 7f882b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T01:00:54.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.583+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:54.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.583+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:54.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.584+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:00:54.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.584+0000 7f882b52e800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13294809051282576035', time=2024-09-12T03:00:39.564997+0000, chain.objs.size()=1 2024-09-12T01:00:54.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.584+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.60__shadow_.TBg7k61YuO-5Py8gHMz_M3bbWPTfmzb_0 2024-09-12T01:00:54.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.585+0000 7f882b52e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:00:54.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.587+0000 7f882b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T01:00:54.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.589+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:54.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.589+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:54.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.590+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T01:00:54.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.590+0000 7f882b52e800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15377739270397033969', time=2024-09-12T02:59:37.770157+0000, chain.objs.size()=11 2024-09-12T01:00:54.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.590+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__multipart_key1.2~ZDgjwwXrPsnt482nNnQ4ieH0tmMJqWJ.1 2024-09-12T01:00:54.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.590+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__shadow_key1.2~ZDgjwwXrPsnt482nNnQ4ieH0tmMJqWJ.1_1 2024-09-12T01:00:54.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.590+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__multipart_key1.2~ZDgjwwXrPsnt482nNnQ4ieH0tmMJqWJ.2 2024-09-12T01:00:54.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.590+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__shadow_key1.2~ZDgjwwXrPsnt482nNnQ4ieH0tmMJqWJ.2_1 2024-09-12T01:00:54.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.590+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__multipart_key1.2~ZDgjwwXrPsnt482nNnQ4ieH0tmMJqWJ.3 2024-09-12T01:00:54.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.590+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__shadow_key1.2~ZDgjwwXrPsnt482nNnQ4ieH0tmMJqWJ.3_1 2024-09-12T01:00:54.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.590+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__multipart_key1.2~ZDgjwwXrPsnt482nNnQ4ieH0tmMJqWJ.4 2024-09-12T01:00:54.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.590+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__shadow_key1.2~ZDgjwwXrPsnt482nNnQ4ieH0tmMJqWJ.4_1 2024-09-12T01:00:54.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.590+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__multipart_key1.2~ZDgjwwXrPsnt482nNnQ4ieH0tmMJqWJ.5 2024-09-12T01:00:54.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.590+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__shadow_key1.2~ZDgjwwXrPsnt482nNnQ4ieH0tmMJqWJ.5_1 2024-09-12T01:00:54.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.590+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__multipart_key1.2~ZDgjwwXrPsnt482nNnQ4ieH0tmMJqWJ.6 2024-09-12T01:00:54.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.590+0000 7f882b52e800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9560174276129093285', time=2024-09-12T03:00:25.413158+0000, chain.objs.size()=5 2024-09-12T01:00:54.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.590+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.56__multipart_key1.2~rYKxtmc4c1QnMsEe5w7P4Uk6u8I-ycA.1 2024-09-12T01:00:54.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.593+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.56__multipart_key1.2~rYKxtmc4c1QnMsEe5w7P4Uk6u8I-ycA.2 2024-09-12T01:00:54.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.593+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.56__multipart_key1.2~rYKxtmc4c1QnMsEe5w7P4Uk6u8I-ycA.3 2024-09-12T01:00:54.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.593+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.56__multipart_key1.2~rYKxtmc4c1QnMsEe5w7P4Uk6u8I-ycA.4 2024-09-12T01:00:54.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.593+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.56__multipart_key1.2~rYKxtmc4c1QnMsEe5w7P4Uk6u8I-ycA.5 2024-09-12T01:00:54.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.597+0000 7f882b52e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:00:54.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.599+0000 7f882b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T01:00:54.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.600+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:54.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.601+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:54.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.601+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:54.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.602+0000 7f882b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T01:00:54.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.603+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:54.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.604+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:54.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.604+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:54.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.605+0000 7f882b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T01:00:54.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.606+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:54.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.607+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:54.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.607+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:00:54.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.607+0000 7f882b52e800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13398743696608205489', time=2024-09-12T02:57:08.869776+0000, chain.objs.size()=5 2024-09-12T01:00:54.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.607+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.44__multipart_key1.2~KQAZwehyggLfRXY_TBG6VhKto5D_1O9.1 2024-09-12T01:00:54.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.607+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.44__multipart_key1.2~KQAZwehyggLfRXY_TBG6VhKto5D_1O9.2 2024-09-12T01:00:54.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.607+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.44__multipart_key1.2~KQAZwehyggLfRXY_TBG6VhKto5D_1O9.3 2024-09-12T01:00:54.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.607+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.44__multipart_key1.2~KQAZwehyggLfRXY_TBG6VhKto5D_1O9.4 2024-09-12T01:00:54.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.607+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.44__multipart_key1.2~KQAZwehyggLfRXY_TBG6VhKto5D_1O9.5 2024-09-12T01:00:54.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.610+0000 7f882b52e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:00:54.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.612+0000 7f882b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T01:00:54.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.613+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:54.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.614+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:54.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.614+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-12T01:00:54.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.614+0000 7f882b52e800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8005674111880578489', time=2024-09-12T02:59:17.090423+0000, chain.objs.size()=11 2024-09-12T01:00:54.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.614+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__multipart_key1.2~M41_sqHbk1MQp69KVsJ_paQM6jXkE8g.1 2024-09-12T01:00:54.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.614+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__multipart_key1.2~M41_sqHbk1MQp69KVsJ_paQM6jXkE8g.2 2024-09-12T01:00:54.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.614+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__multipart_key1.2~M41_sqHbk1MQp69KVsJ_paQM6jXkE8g.3 2024-09-12T01:00:54.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.614+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__multipart_key1.2~M41_sqHbk1MQp69KVsJ_paQM6jXkE8g.4 2024-09-12T01:00:54.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.614+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__multipart_key1.2~M41_sqHbk1MQp69KVsJ_paQM6jXkE8g.5 2024-09-12T01:00:54.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.614+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__multipart_key1.2~M41_sqHbk1MQp69KVsJ_paQM6jXkE8g.6 2024-09-12T01:00:54.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.614+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__multipart_key1.2~M41_sqHbk1MQp69KVsJ_paQM6jXkE8g.7 2024-09-12T01:00:54.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.614+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__multipart_key1.2~M41_sqHbk1MQp69KVsJ_paQM6jXkE8g.8 2024-09-12T01:00:54.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.614+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__multipart_key1.2~M41_sqHbk1MQp69KVsJ_paQM6jXkE8g.9 2024-09-12T01:00:54.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.615+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__multipart_key1.2~M41_sqHbk1MQp69KVsJ_paQM6jXkE8g.10 2024-09-12T01:00:54.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.615+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__multipart_key1.2~M41_sqHbk1MQp69KVsJ_paQM6jXkE8g.11 2024-09-12T01:00:54.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.615+0000 7f882b52e800 20 garbage collection: RGWGC::process iterating over entry tag='2~mnrsP_jdEjpZsGgqy2A_Gy8jsv2WTtz', time=2024-09-12T03:00:35.978582+0000, chain.objs.size()=1 2024-09-12T01:00:54.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.615+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.58__multipart_key1.2~mnrsP_jdEjpZsGgqy2A_Gy8jsv2WTtz.12 2024-09-12T01:00:54.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.617+0000 7f882b52e800 20 garbage collection: RGWGC::process iterating over entry tag='2~mnrsP_jdEjpZsGgqy2A_Gy8jsv2WTtz', time=2024-09-12T03:00:36.102662+0000, chain.objs.size()=1 2024-09-12T01:00:54.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.617+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.58__multipart_key1.2~mnrsP_jdEjpZsGgqy2A_Gy8jsv2WTtz.13 2024-09-12T01:00:54.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.617+0000 7f882b52e800 20 garbage collection: RGWGC::process iterating over entry tag='2~mnrsP_jdEjpZsGgqy2A_Gy8jsv2WTtz', time=2024-09-12T03:00:36.274376+0000, chain.objs.size()=1 2024-09-12T01:00:54.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.617+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.58__multipart_key1.2~mnrsP_jdEjpZsGgqy2A_Gy8jsv2WTtz.14 2024-09-12T01:00:54.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.620+0000 7f882b52e800 20 garbage collection: RGWGC::process iterating over entry tag='2~mnrsP_jdEjpZsGgqy2A_Gy8jsv2WTtz', time=2024-09-12T03:00:36.354211+0000, chain.objs.size()=1 2024-09-12T01:00:54.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.620+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.58__multipart_key1.2~mnrsP_jdEjpZsGgqy2A_Gy8jsv2WTtz.15 2024-09-12T01:00:54.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.620+0000 7f882b52e800 20 garbage collection: RGWGC::process iterating over entry tag='2~mnrsP_jdEjpZsGgqy2A_Gy8jsv2WTtz', time=2024-09-12T03:00:36.438863+0000, chain.objs.size()=1 2024-09-12T01:00:54.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.620+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.58__multipart_key1.2~mnrsP_jdEjpZsGgqy2A_Gy8jsv2WTtz.16 2024-09-12T01:00:54.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.620+0000 7f882b52e800 20 garbage collection: RGWGC::process iterating over entry tag='2~mnrsP_jdEjpZsGgqy2A_Gy8jsv2WTtz', time=2024-09-12T03:00:36.591950+0000, chain.objs.size()=1 2024-09-12T01:00:54.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.620+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.58__multipart_key1.2~mnrsP_jdEjpZsGgqy2A_Gy8jsv2WTtz.17 2024-09-12T01:00:54.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.620+0000 7f882b52e800 20 garbage collection: RGWGC::process iterating over entry tag='2~mnrsP_jdEjpZsGgqy2A_Gy8jsv2WTtz', time=2024-09-12T03:00:36.898613+0000, chain.objs.size()=1 2024-09-12T01:00:54.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.620+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.58__multipart_key1.2~mnrsP_jdEjpZsGgqy2A_Gy8jsv2WTtz.18 2024-09-12T01:00:54.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.620+0000 7f882b52e800 20 garbage collection: RGWGC::process iterating over entry tag='2~mnrsP_jdEjpZsGgqy2A_Gy8jsv2WTtz', time=2024-09-12T03:00:36.922539+0000, chain.objs.size()=1 2024-09-12T01:00:54.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.620+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.58__multipart_key1.2~mnrsP_jdEjpZsGgqy2A_Gy8jsv2WTtz.19 2024-09-12T01:00:54.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.620+0000 7f882b52e800 20 garbage collection: RGWGC::process iterating over entry tag='2~mnrsP_jdEjpZsGgqy2A_Gy8jsv2WTtz', time=2024-09-12T03:00:37.055452+0000, chain.objs.size()=1 2024-09-12T01:00:54.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.620+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.58__multipart_key1.2~mnrsP_jdEjpZsGgqy2A_Gy8jsv2WTtz.20 2024-09-12T01:00:54.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.620+0000 7f882b52e800 20 garbage collection: RGWGC::process iterating over entry tag='2~mnrsP_jdEjpZsGgqy2A_Gy8jsv2WTtz', time=2024-09-12T03:00:37.270960+0000, chain.objs.size()=23 2024-09-12T01:00:54.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.620+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.58__multipart_key1.2~mnrsP_jdEjpZsGgqy2A_Gy8jsv2WTtz.1 2024-09-12T01:00:54.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.620+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.58__multipart_key1.2~mnrsP_jdEjpZsGgqy2A_Gy8jsv2WTtz.2 2024-09-12T01:00:54.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.620+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.58__multipart_key1.2~mnrsP_jdEjpZsGgqy2A_Gy8jsv2WTtz.3 2024-09-12T01:00:54.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.622+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.58__multipart_key1.2~mnrsP_jdEjpZsGgqy2A_Gy8jsv2WTtz.4 2024-09-12T01:00:54.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.622+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.58__multipart_key1.2~mnrsP_jdEjpZsGgqy2A_Gy8jsv2WTtz.5 2024-09-12T01:00:54.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.622+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.58__multipart_key1.2~mnrsP_jdEjpZsGgqy2A_Gy8jsv2WTtz.6 2024-09-12T01:00:54.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.622+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.58__multipart_key1.2~mnrsP_jdEjpZsGgqy2A_Gy8jsv2WTtz.7 2024-09-12T01:00:54.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.622+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.58__multipart_key1.2~mnrsP_jdEjpZsGgqy2A_Gy8jsv2WTtz.8 2024-09-12T01:00:54.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.622+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.58__multipart_key1.2~mnrsP_jdEjpZsGgqy2A_Gy8jsv2WTtz.9 2024-09-12T01:00:54.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.622+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.58__multipart_key1.2~mnrsP_jdEjpZsGgqy2A_Gy8jsv2WTtz.10 2024-09-12T01:00:54.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.622+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.58__multipart_key1.2~mnrsP_jdEjpZsGgqy2A_Gy8jsv2WTtz.11 2024-09-12T01:00:54.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.622+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.58__multipart_key1.WTau_ZoK2rfLvgMRxkG7na56K9NESCP0.12 2024-09-12T01:00:54.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.622+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.58__multipart_key1.sixsdjdm-66rg4gu8cJrAgaMOC8apGHz.13 2024-09-12T01:00:54.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.622+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.58__multipart_key1.rQCFGEHQj3VCONhKydZEW_CJqlJk2lIW.14 2024-09-12T01:00:54.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.624+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.58__multipart_key1.mNjuDMUn5sj7P6Ur27IuYzjLj_Vl0YUD.15 2024-09-12T01:00:54.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.624+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.58__multipart_key1.GxjlhZ_PeBv8j7Tszk-JPam_EbG7KclX.16 2024-09-12T01:00:54.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.624+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.58__multipart_key1._3BpYlSNF5F3no6uQANBtLhfh7DcbApX.17 2024-09-12T01:00:54.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.624+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.58__multipart_key1.TSEAwjhLou4oS0hvA3FsAknxx4zFlp-I.18 2024-09-12T01:00:54.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.624+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.58__multipart_key1.Yhq1LXnY9-l2SaS6JNTTYa17TlMk_kUr.19 2024-09-12T01:00:54.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.624+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.58__multipart_key1.ggVAQyTWNaKnCoAbNvA9r1t0hJEVl9kx.20 2024-09-12T01:00:54.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.625+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.58__multipart_key1.2~mnrsP_jdEjpZsGgqy2A_Gy8jsv2WTtz.21 2024-09-12T01:00:54.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.625+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.58__multipart_key1.2~mnrsP_jdEjpZsGgqy2A_Gy8jsv2WTtz.22 2024-09-12T01:00:54.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.625+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.58__multipart_key1.2~mnrsP_jdEjpZsGgqy2A_Gy8jsv2WTtz.23 2024-09-12T01:00:54.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.627+0000 7f882b52e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:00:54.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.629+0000 7f882b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T01:00:54.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.630+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:54.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.631+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:54.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.631+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T01:00:54.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.631+0000 7f882b52e800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16763876318250206958', time=2024-09-12T02:58:36.198985+0000, chain.objs.size()=5 2024-09-12T01:00:54.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.631+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.53__multipart_file2.mpg.2~goGVrgXJCmJt7lkxO25GCCdoW9J0yMB.1 2024-09-12T01:00:54.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.631+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.53__multipart_file2.mpg.2~goGVrgXJCmJt7lkxO25GCCdoW9J0yMB.2 2024-09-12T01:00:54.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.631+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.53__multipart_file2.mpg.2~goGVrgXJCmJt7lkxO25GCCdoW9J0yMB.3 2024-09-12T01:00:54.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.631+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.53__multipart_file2.mpg.2~goGVrgXJCmJt7lkxO25GCCdoW9J0yMB.4 2024-09-12T01:00:54.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.631+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.53__multipart_file2.mpg.2~goGVrgXJCmJt7lkxO25GCCdoW9J0yMB.5 2024-09-12T01:00:54.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.631+0000 7f882b52e800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15774315864071340305', time=2024-09-12T03:00:08.064280+0000, chain.objs.size()=11 2024-09-12T01:00:54.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.631+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__multipart_key1.2~-eqd2Wr4_KogokTyNDp3yZ7KeFQWNsS.1 2024-09-12T01:00:54.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.631+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__shadow_key1.2~-eqd2Wr4_KogokTyNDp3yZ7KeFQWNsS.1_1 2024-09-12T01:00:54.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.631+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__multipart_key1.2~-eqd2Wr4_KogokTyNDp3yZ7KeFQWNsS.2 2024-09-12T01:00:54.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.631+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__shadow_key1.2~-eqd2Wr4_KogokTyNDp3yZ7KeFQWNsS.2_1 2024-09-12T01:00:54.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.631+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__multipart_key1.2~-eqd2Wr4_KogokTyNDp3yZ7KeFQWNsS.3 2024-09-12T01:00:54.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.631+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__shadow_key1.2~-eqd2Wr4_KogokTyNDp3yZ7KeFQWNsS.3_1 2024-09-12T01:00:54.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.631+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__multipart_key1.2~-eqd2Wr4_KogokTyNDp3yZ7KeFQWNsS.4 2024-09-12T01:00:54.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.634+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__shadow_key1.2~-eqd2Wr4_KogokTyNDp3yZ7KeFQWNsS.4_1 2024-09-12T01:00:54.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.634+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__multipart_key1.2~-eqd2Wr4_KogokTyNDp3yZ7KeFQWNsS.5 2024-09-12T01:00:54.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.634+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__shadow_key1.2~-eqd2Wr4_KogokTyNDp3yZ7KeFQWNsS.5_1 2024-09-12T01:00:54.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.634+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__multipart_key1.2~-eqd2Wr4_KogokTyNDp3yZ7KeFQWNsS.6 2024-09-12T01:00:54.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.635+0000 7f882b52e800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13072208472315415130', time=2024-09-12T03:00:53.687219+0000, chain.objs.size()=11 2024-09-12T01:00:54.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.635+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.66__multipart_key1.2~wxvgxEVJxU8JlcQIDycL8Chyjs0cpKb.1 2024-09-12T01:00:54.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.635+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.66__multipart_key1.2~wxvgxEVJxU8JlcQIDycL8Chyjs0cpKb.2 2024-09-12T01:00:54.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.636+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.66__multipart_key1.2~wxvgxEVJxU8JlcQIDycL8Chyjs0cpKb.3 2024-09-12T01:00:54.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.636+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.66__multipart_key1.2~wxvgxEVJxU8JlcQIDycL8Chyjs0cpKb.4 2024-09-12T01:00:54.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.636+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.66__multipart_key1.2~wxvgxEVJxU8JlcQIDycL8Chyjs0cpKb.5 2024-09-12T01:00:54.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.637+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.66__multipart_key1.2~wxvgxEVJxU8JlcQIDycL8Chyjs0cpKb.6 2024-09-12T01:00:54.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.637+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.66__multipart_key1.2~wxvgxEVJxU8JlcQIDycL8Chyjs0cpKb.7 2024-09-12T01:00:54.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.637+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.66__multipart_key1.2~wxvgxEVJxU8JlcQIDycL8Chyjs0cpKb.8 2024-09-12T01:00:54.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.637+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.66__multipart_key1.2~wxvgxEVJxU8JlcQIDycL8Chyjs0cpKb.9 2024-09-12T01:00:54.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.638+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.66__multipart_key1.2~wxvgxEVJxU8JlcQIDycL8Chyjs0cpKb.10 2024-09-12T01:00:54.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.639+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.66__multipart_key1.2~wxvgxEVJxU8JlcQIDycL8Chyjs0cpKb.11 2024-09-12T01:00:54.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.641+0000 7f882b52e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:00:54.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.643+0000 7f882b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T01:00:54.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.644+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:54.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.645+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:54.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.645+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:54.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.646+0000 7f882b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T01:00:54.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.647+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:54.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.647+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:54.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.648+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:54.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.648+0000 7f882b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T01:00:54.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.650+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:54.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.650+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:54.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.650+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:00:54.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.650+0000 7f882b52e800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.325239068181808190', time=2024-09-12T03:00:39.134946+0000, chain.objs.size()=1 2024-09-12T01:00:54.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.650+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.59__shadow_.eXOccw0SCud3E-7I6RbwMTS6LWUwjGo_0 2024-09-12T01:00:54.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.652+0000 7f882b52e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:00:54.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.653+0000 7f882b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T01:00:54.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.655+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:54.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.655+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:54.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.655+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:00:54.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.655+0000 7f882b52e800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17008236336036194934', time=2024-09-12T03:00:40.409516+0000, chain.objs.size()=1 2024-09-12T01:00:54.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.655+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.62__shadow_.--no0WMO5euavG7pjHxknLJG40icZH6_0 2024-09-12T01:00:54.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.657+0000 7f882b52e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:00:54.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.658+0000 7f882b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T01:00:54.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.660+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:54.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.661+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:54.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.661+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:00:54.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.661+0000 7f882b52e800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11181081577562273249', time=2024-09-12T02:58:00.025008+0000, chain.objs.size()=5 2024-09-12T01:00:54.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.661+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.47__multipart_key1.2~o_5OijmjbqP0u27I5gHpWh59bxhvf3L.1 2024-09-12T01:00:54.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.661+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.47__shadow_key1.2~o_5OijmjbqP0u27I5gHpWh59bxhvf3L.1_1 2024-09-12T01:00:54.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.661+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.47__multipart_key1.2~o_5OijmjbqP0u27I5gHpWh59bxhvf3L.2 2024-09-12T01:00:54.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.661+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.47__shadow_key1.2~o_5OijmjbqP0u27I5gHpWh59bxhvf3L.2_1 2024-09-12T01:00:54.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.661+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.47__multipart_key1.2~o_5OijmjbqP0u27I5gHpWh59bxhvf3L.3 2024-09-12T01:00:54.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.663+0000 7f882b52e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:00:54.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.665+0000 7f882b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T01:00:54.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.667+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:54.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.667+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:54.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.667+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:00:54.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.667+0000 7f882b52e800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13143390931095219858', time=2024-09-12T02:57:56.842219+0000, chain.objs.size()=5 2024-09-12T01:00:54.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.667+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.47__multipart_key1.2~bXOi894Zrgp4i2AhIDa06XTNQdoDZrh.1 2024-09-12T01:00:54.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.667+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.47__shadow_key1.2~bXOi894Zrgp4i2AhIDa06XTNQdoDZrh.1_1 2024-09-12T01:00:54.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.667+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.47__multipart_key1.2~bXOi894Zrgp4i2AhIDa06XTNQdoDZrh.2 2024-09-12T01:00:54.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.667+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.47__shadow_key1.2~bXOi894Zrgp4i2AhIDa06XTNQdoDZrh.2_1 2024-09-12T01:00:54.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.667+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.47__multipart_key1.2~bXOi894Zrgp4i2AhIDa06XTNQdoDZrh.3 2024-09-12T01:00:54.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.670+0000 7f882b52e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:00:54.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.672+0000 7f882b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T01:00:54.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.673+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:54.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.674+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:54.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.674+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:00:54.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.674+0000 7f882b52e800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11200864186378984400', time=2024-09-12T03:00:08.275889+0000, chain.objs.size()=11 2024-09-12T01:00:54.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.674+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__multipart_key1.2~z8q0AgtZx_dkbg3CICCHq-6RA_zxEiI.1 2024-09-12T01:00:54.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.674+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__shadow_key1.2~z8q0AgtZx_dkbg3CICCHq-6RA_zxEiI.1_1 2024-09-12T01:00:54.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.674+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__multipart_key1.2~z8q0AgtZx_dkbg3CICCHq-6RA_zxEiI.2 2024-09-12T01:00:54.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.674+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__shadow_key1.2~z8q0AgtZx_dkbg3CICCHq-6RA_zxEiI.2_1 2024-09-12T01:00:54.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.674+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__multipart_key1.2~z8q0AgtZx_dkbg3CICCHq-6RA_zxEiI.3 2024-09-12T01:00:54.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.674+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__shadow_key1.2~z8q0AgtZx_dkbg3CICCHq-6RA_zxEiI.3_1 2024-09-12T01:00:54.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.674+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__multipart_key1.2~z8q0AgtZx_dkbg3CICCHq-6RA_zxEiI.4 2024-09-12T01:00:54.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.674+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__shadow_key1.2~z8q0AgtZx_dkbg3CICCHq-6RA_zxEiI.4_1 2024-09-12T01:00:54.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.674+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__multipart_key1.2~z8q0AgtZx_dkbg3CICCHq-6RA_zxEiI.5 2024-09-12T01:00:54.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.674+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__shadow_key1.2~z8q0AgtZx_dkbg3CICCHq-6RA_zxEiI.5_1 2024-09-12T01:00:54.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.674+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__multipart_key1.2~z8q0AgtZx_dkbg3CICCHq-6RA_zxEiI.6 2024-09-12T01:00:54.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.682+0000 7f882b52e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:00:54.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.685+0000 7f882b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T01:00:54.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.686+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:54.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.687+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:54.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.687+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T01:00:54.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.687+0000 7f882b52e800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4897602308891998804', time=2024-09-12T02:58:36.266582+0000, chain.objs.size()=1 2024-09-12T01:00:54.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.687+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.53__shadow_.1fo04jwOsTeUEis2cjN6X7s4aOP-k78_0 2024-09-12T01:00:54.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.687+0000 7f882b52e800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9580522070557559947', time=2024-09-12T02:59:27.462966+0000, chain.objs.size()=10 2024-09-12T01:00:54.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.687+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__multipart_key1.2~dbTSs_tZYwkuXEomxEYHdZ8JTs6Yc7y.1 2024-09-12T01:00:54.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.687+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__multipart_key1.2~dbTSs_tZYwkuXEomxEYHdZ8JTs6Yc7y.2 2024-09-12T01:00:54.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.687+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__multipart_key1.2~dbTSs_tZYwkuXEomxEYHdZ8JTs6Yc7y.3 2024-09-12T01:00:54.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.687+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__multipart_key1.2~dbTSs_tZYwkuXEomxEYHdZ8JTs6Yc7y.4 2024-09-12T01:00:54.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.687+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__multipart_key1.2~dbTSs_tZYwkuXEomxEYHdZ8JTs6Yc7y.5 2024-09-12T01:00:54.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.687+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__multipart_key1.2~dbTSs_tZYwkuXEomxEYHdZ8JTs6Yc7y.6 2024-09-12T01:00:54.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.687+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__multipart_key1.2~dbTSs_tZYwkuXEomxEYHdZ8JTs6Yc7y.7 2024-09-12T01:00:54.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.687+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__multipart_key1.2~dbTSs_tZYwkuXEomxEYHdZ8JTs6Yc7y.8 2024-09-12T01:00:54.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.687+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__multipart_key1.2~dbTSs_tZYwkuXEomxEYHdZ8JTs6Yc7y.9 2024-09-12T01:00:54.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.687+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.55__multipart_key1.2~dbTSs_tZYwkuXEomxEYHdZ8JTs6Yc7y.10 2024-09-12T01:00:54.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.687+0000 7f882b52e800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3311398885366456667', time=2024-09-12T03:00:21.921017+0000, chain.objs.size()=1 2024-09-12T01:00:54.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.687+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.56__shadow_.jXyWjV38Z20kMhx3GSdFXkHbTDJEGy0_0 2024-09-12T01:00:54.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.691+0000 7f882b52e800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1712391774226794300', time=2024-09-12T03:00:41.258423+0000, chain.objs.size()=1 2024-09-12T01:00:54.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.691+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.64__shadow_.Nb5PRiyXWtI2tNOmkjzfYTRTew_cvG4_0 2024-09-12T01:00:54.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.694+0000 7f882b52e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:00:54.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.697+0000 7f882b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T01:00:54.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.699+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:54.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.699+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:54.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.700+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:00:54.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.700+0000 7f882b52e800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1719845776217116951', time=2024-09-12T02:58:00.249564+0000, chain.objs.size()=4 2024-09-12T01:00:54.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.700+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.46__shadow_.wCT9V9au0Z_Rf4aK9EahyNPRNCZj72v_0 2024-09-12T01:00:54.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.700+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.46__shadow_.wCT9V9au0Z_Rf4aK9EahyNPRNCZj72v_1 2024-09-12T01:00:54.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.700+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.46__shadow_.wCT9V9au0Z_Rf4aK9EahyNPRNCZj72v_2 2024-09-12T01:00:54.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.700+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.46__shadow_.wCT9V9au0Z_Rf4aK9EahyNPRNCZj72v_3 2024-09-12T01:00:54.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.703+0000 7f882b52e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:00:54.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.704+0000 7f882b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T01:00:54.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.706+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:54.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.706+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:54.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.706+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:00:54.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.706+0000 7f882b52e800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3561389548408025472', time=2024-09-12T02:58:36.163417+0000, chain.objs.size()=1 2024-09-12T01:00:54.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.706+0000 7f882b52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.53__shadow_.0jC-GxuT1pDgMrX1a_zFTIk2zmWLudn_0 2024-09-12T01:00:54.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.708+0000 7f882b52e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:00:54.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.710+0000 7f882b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T01:00:54.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.711+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:54.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.711+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:54.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.711+0000 7f882b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:54.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.713+0000 7f86ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:54.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.715+0000 7f882b52e800 20 remove_watcher() i=0 2024-09-12T01:00:54.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.715+0000 7f882b52e800 2 removed watcher, disabling cache 2024-09-12T01:00:54.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.716+0000 7f882b52e800 20 remove_watcher() i=1 2024-09-12T01:00:54.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.717+0000 7f882b52e800 20 remove_watcher() i=2 2024-09-12T01:00:54.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.718+0000 7f882b52e800 20 remove_watcher() i=3 2024-09-12T01:00:54.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.719+0000 7f882b52e800 20 remove_watcher() i=4 2024-09-12T01:00:54.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.720+0000 7f882b52e800 20 remove_watcher() i=5 2024-09-12T01:00:54.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.721+0000 7f882b52e800 20 remove_watcher() i=6 2024-09-12T01:00:54.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.722+0000 7f882b52e800 20 remove_watcher() i=7 2024-09-12T01:00:54.731 DEBUG:teuthology.orchestra.run.smithi073:> radosgw-admin gc process --include-all 2024-09-12T01:00:54.782 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:00:54.783 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:00:54.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.821+0000 7f96b9c14800 20 rados->read ofs=0 len=0 2024-09-12T01:00:54.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.822+0000 7f96b9c14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:54.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.822+0000 7f96b9c14800 20 realm 2024-09-12T01:00:54.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.822+0000 7f96b9c14800 20 rados->read ofs=0 len=0 2024-09-12T01:00:54.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.822+0000 7f96b9c14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:54.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.822+0000 7f96b9c14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:00:54.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.822+0000 7f96b9c14800 20 rados->read ofs=0 len=0 2024-09-12T01:00:54.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.823+0000 7f96b9c14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:54.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.823+0000 7f96b9c14800 20 rados->read ofs=0 len=0 2024-09-12T01:00:54.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.823+0000 7f96b9c14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:54.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.823+0000 7f96b9c14800 20 rados->read ofs=0 len=0 2024-09-12T01:00:54.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.824+0000 7f96b9c14800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:00:54.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.824+0000 7f96b9c14800 20 searching for the correct realm 2024-09-12T01:00:54.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:54.826+0000 7f96b5acc640 0 -- 172.21.15.73:0/3417794399 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f96a006c700 msgr2=0x7f96a0086a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:55.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.031+0000 7f96b5acc640 0 -- 172.21.15.73:0/3417794399 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f96a006c700 msgr2=0x7f96a0086a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:55.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.035+0000 7f96b9c14800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T01:00:55.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.035+0000 7f96b9c14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:00:55.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.035+0000 7f96b9c14800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T01:00:55.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.035+0000 7f96b9c14800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:00:55.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.035+0000 7f96b9c14800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:00:55.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.035+0000 7f96b9c14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:00:55.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.035+0000 7f96b9c14800 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.036+0000 7f96b9c14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:55.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.036+0000 7f96b9c14800 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.036+0000 7f96b9c14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:55.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.036+0000 7f96b9c14800 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.036+0000 7f96b9c14800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:00:55.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.036+0000 7f96b9c14800 20 zone default found 2024-09-12T01:00:55.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.036+0000 7f96b9c14800 4 Realm: () 2024-09-12T01:00:55.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.036+0000 7f96b9c14800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T01:00:55.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.036+0000 7f96b9c14800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T01:00:55.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.036+0000 7f96b9c14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:00:55.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.036+0000 7f96b9c14800 20 zonegroup default 2024-09-12T01:00:55.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.036+0000 7f96b9c14800 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.036+0000 7f96b9c14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:55.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.036+0000 7f96b9c14800 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.037+0000 7f96b9c14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:55.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.037+0000 7f96b9c14800 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.037+0000 7f96b9c14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:55.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.037+0000 7f96b9c14800 20 started sync module instance, tier type = 2024-09-12T01:00:55.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.037+0000 7f96b9c14800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T01:00:55.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.045+0000 7f96b9c14800 20 add_watcher() i=0 2024-09-12T01:00:55.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.045+0000 7f96b9c14800 20 add_watcher() i=1 2024-09-12T01:00:55.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.045+0000 7f96b9c14800 20 add_watcher() i=2 2024-09-12T01:00:55.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.045+0000 7f96b9c14800 20 add_watcher() i=3 2024-09-12T01:00:55.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.045+0000 7f96b9c14800 20 add_watcher() i=4 2024-09-12T01:00:55.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.045+0000 7f96b9c14800 20 add_watcher() i=5 2024-09-12T01:00:55.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.045+0000 7f96b9c14800 20 add_watcher() i=6 2024-09-12T01:00:55.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.046+0000 7f96b9c14800 20 add_watcher() i=7 2024-09-12T01:00:55.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.046+0000 7f96b9c14800 2 all 8 watchers are set, enabling cache 2024-09-12T01:00:55.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.048+0000 7f956b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:55.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.048+0000 7f96b9c14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:00:55.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.048+0000 7f96b9c14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:00:55.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.083+0000 7f956a7e4640 20 reqs_thread_entry: start 2024-09-12T01:00:55.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.083+0000 7f96b9c14800 20 init_complete bucket index max shards: 1 2024-09-12T01:00:55.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.084+0000 7f96b9c14800 20 Filter name: none 2024-09-12T01:00:55.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.084+0000 7f94dbfff640 20 reqs_thread_entry: start 2024-09-12T01:00:55.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.084+0000 7f96b9c14800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T01:00:55.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.085+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.086+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.086+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.087+0000 7f96b9c14800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T01:00:55.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.088+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.088+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.089+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.090+0000 7f96b9c14800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T01:00:55.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.091+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.092+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.092+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.093+0000 7f96b9c14800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T01:00:55.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.094+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.095+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.095+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.096+0000 7f96b9c14800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T01:00:55.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.097+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.098+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.098+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.099+0000 7f96b9c14800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T01:00:55.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.100+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.101+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.101+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.102+0000 7f96b9c14800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T01:00:55.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.103+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.104+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.104+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.105+0000 7f96b9c14800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T01:00:55.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.106+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.107+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.107+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.108+0000 7f96b9c14800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T01:00:55.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.109+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.110+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.110+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.111+0000 7f96b9c14800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T01:00:55.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.112+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.113+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.113+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.115+0000 7f96b9c14800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T01:00:55.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.116+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.117+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.117+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.118+0000 7f96b9c14800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T01:00:55.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.119+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.119+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.120+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.121+0000 7f96b9c14800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T01:00:55.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.122+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.122+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.122+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.123+0000 7f96b9c14800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T01:00:55.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.125+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.125+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.126+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.127+0000 7f96b9c14800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T01:00:55.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.128+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.128+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.128+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.130+0000 7f96b9c14800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T01:00:55.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.131+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.131+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.132+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.133+0000 7f96b9c14800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T01:00:55.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.134+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.134+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.135+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.136+0000 7f96b9c14800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T01:00:55.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.137+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.137+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.137+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.139+0000 7f96b9c14800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T01:00:55.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.140+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.140+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.141+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.142+0000 7f96b9c14800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T01:00:55.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.143+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.144+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.144+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.145+0000 7f96b9c14800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T01:00:55.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.146+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.147+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.147+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.148+0000 7f96b9c14800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T01:00:55.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.149+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.150+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.150+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.152+0000 7f96b9c14800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T01:00:55.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.153+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.154+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.154+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.156+0000 7f96b9c14800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T01:00:55.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.157+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.157+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.157+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.158+0000 7f96b9c14800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T01:00:55.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.160+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.160+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.161+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.162+0000 7f96b9c14800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T01:00:55.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.163+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.164+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.164+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.166+0000 7f96b9c14800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T01:00:55.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.167+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.167+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.167+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.168+0000 7f96b9c14800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T01:00:55.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.169+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.170+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.170+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.171+0000 7f96b9c14800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T01:00:55.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.172+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.173+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.173+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.174+0000 7f96b9c14800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T01:00:55.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.175+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.176+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.176+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.177+0000 7f96b9c14800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T01:00:55.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.178+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.179+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.179+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.180+0000 7f96b9c14800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T01:00:55.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.181+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.182+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.182+0000 7f96b9c14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.184+0000 7f956b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:55.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.186+0000 7f96b9c14800 20 remove_watcher() i=0 2024-09-12T01:00:55.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.186+0000 7f96b9c14800 2 removed watcher, disabling cache 2024-09-12T01:00:55.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.187+0000 7f96b9c14800 20 remove_watcher() i=1 2024-09-12T01:00:55.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.188+0000 7f96b9c14800 20 remove_watcher() i=2 2024-09-12T01:00:55.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.189+0000 7f96b9c14800 20 remove_watcher() i=3 2024-09-12T01:00:55.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.190+0000 7f96b9c14800 20 remove_watcher() i=4 2024-09-12T01:00:55.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.191+0000 7f96b9c14800 20 remove_watcher() i=5 2024-09-12T01:00:55.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.192+0000 7f96b9c14800 20 remove_watcher() i=6 2024-09-12T01:00:55.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.193+0000 7f96b9c14800 20 remove_watcher() i=7 2024-09-12T01:00:55.202 DEBUG:teuthology.orchestra.run.smithi073:> radosgw-admin gc process --include-all 2024-09-12T01:00:55.254 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:00:55.254 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:00:55.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.293+0000 7feae3c0e800 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.294+0000 7feae3c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:55.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.294+0000 7feae3c0e800 20 realm 2024-09-12T01:00:55.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.294+0000 7feae3c0e800 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.295+0000 7feae3c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:55.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.295+0000 7feae3c0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:00:55.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.295+0000 7feae3c0e800 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.295+0000 7feae3c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:55.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.295+0000 7feae3c0e800 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.296+0000 7feae3c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:55.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.296+0000 7feae3c0e800 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.296+0000 7feae3c0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:00:55.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.296+0000 7feae3c0e800 20 searching for the correct realm 2024-09-12T01:00:55.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.298+0000 7feadfb6c640 0 -- 172.21.15.73:0/2000056371 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7feac803c990 msgr2=0x7feac80163c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:55.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.505+0000 7feadfb6c640 0 -- 172.21.15.73:0/2000056371 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7feac803c990 msgr2=0x7feac80163c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:55.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.509+0000 7feae3c0e800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T01:00:55.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.509+0000 7feae3c0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:00:55.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.509+0000 7feae3c0e800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T01:00:55.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.509+0000 7feae3c0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:00:55.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.509+0000 7feae3c0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:00:55.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.509+0000 7feae3c0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:00:55.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.509+0000 7feae3c0e800 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.509+0000 7feae3c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:55.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.509+0000 7feae3c0e800 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.509+0000 7feae3c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:55.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.509+0000 7feae3c0e800 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.510+0000 7feae3c0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:00:55.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.510+0000 7feae3c0e800 20 zone default found 2024-09-12T01:00:55.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.510+0000 7feae3c0e800 4 Realm: () 2024-09-12T01:00:55.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.510+0000 7feae3c0e800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T01:00:55.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.510+0000 7feae3c0e800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T01:00:55.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.510+0000 7feae3c0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:00:55.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.510+0000 7feae3c0e800 20 zonegroup default 2024-09-12T01:00:55.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.510+0000 7feae3c0e800 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.510+0000 7feae3c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:55.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.510+0000 7feae3c0e800 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.510+0000 7feae3c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:55.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.510+0000 7feae3c0e800 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.510+0000 7feae3c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:55.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.510+0000 7feae3c0e800 20 started sync module instance, tier type = 2024-09-12T01:00:55.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.510+0000 7feae3c0e800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T01:00:55.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.519+0000 7feae3c0e800 20 add_watcher() i=0 2024-09-12T01:00:55.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.519+0000 7feae3c0e800 20 add_watcher() i=1 2024-09-12T01:00:55.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.519+0000 7feae3c0e800 20 add_watcher() i=2 2024-09-12T01:00:55.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.519+0000 7feae3c0e800 20 add_watcher() i=3 2024-09-12T01:00:55.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.519+0000 7feae3c0e800 20 add_watcher() i=4 2024-09-12T01:00:55.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.519+0000 7feae3c0e800 20 add_watcher() i=5 2024-09-12T01:00:55.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.519+0000 7feae3c0e800 20 add_watcher() i=6 2024-09-12T01:00:55.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.520+0000 7feae3c0e800 20 add_watcher() i=7 2024-09-12T01:00:55.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.520+0000 7feae3c0e800 2 all 8 watchers are set, enabling cache 2024-09-12T01:00:55.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.521+0000 7fe995fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:55.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.522+0000 7feae3c0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:00:55.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.522+0000 7feae3c0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:00:55.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.553+0000 7fe994fe1640 20 reqs_thread_entry: start 2024-09-12T01:00:55.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.554+0000 7feae3c0e800 20 init_complete bucket index max shards: 1 2024-09-12T01:00:55.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.554+0000 7feae3c0e800 20 Filter name: none 2024-09-12T01:00:55.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.554+0000 7fe90e7fc640 20 reqs_thread_entry: start 2024-09-12T01:00:55.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.554+0000 7feae3c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T01:00:55.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.555+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.555+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.556+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.557+0000 7feae3c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T01:00:55.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.558+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.558+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.558+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.559+0000 7feae3c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T01:00:55.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.560+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.561+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.561+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.562+0000 7feae3c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T01:00:55.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.563+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.564+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.564+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.565+0000 7feae3c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T01:00:55.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.567+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.567+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.567+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.568+0000 7feae3c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T01:00:55.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.570+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.570+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.570+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.571+0000 7feae3c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T01:00:55.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.573+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.573+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.574+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.575+0000 7feae3c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T01:00:55.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.576+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.577+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.577+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.578+0000 7feae3c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T01:00:55.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.579+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.580+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.580+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.581+0000 7feae3c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T01:00:55.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.582+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.583+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.583+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.584+0000 7feae3c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T01:00:55.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.585+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.586+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.586+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.587+0000 7feae3c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T01:00:55.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.588+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.588+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.589+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.590+0000 7feae3c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T01:00:55.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.591+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.591+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.592+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.592+0000 7feae3c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T01:00:55.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.594+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.594+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.594+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.596+0000 7feae3c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T01:00:55.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.597+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.597+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.597+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.598+0000 7feae3c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T01:00:55.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.600+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.600+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.600+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.601+0000 7feae3c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T01:00:55.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.602+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.603+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.603+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.604+0000 7feae3c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T01:00:55.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.605+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.606+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.606+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.607+0000 7feae3c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T01:00:55.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.608+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.608+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.608+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.609+0000 7feae3c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T01:00:55.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.611+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.611+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.611+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.612+0000 7feae3c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T01:00:55.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.613+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.614+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.614+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.615+0000 7feae3c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T01:00:55.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.616+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.617+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.617+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.618+0000 7feae3c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T01:00:55.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.619+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.619+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.619+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.620+0000 7feae3c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T01:00:55.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.621+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.622+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.622+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.623+0000 7feae3c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T01:00:55.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.624+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.625+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.625+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.626+0000 7feae3c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T01:00:55.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.627+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.628+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.628+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.629+0000 7feae3c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T01:00:55.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.630+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.631+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.631+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.632+0000 7feae3c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T01:00:55.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.633+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.634+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.634+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.635+0000 7feae3c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T01:00:55.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.636+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.637+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.637+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.638+0000 7feae3c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T01:00:55.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.639+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.639+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.640+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.641+0000 7feae3c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T01:00:55.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.642+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.642+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.643+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.644+0000 7feae3c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T01:00:55.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.645+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.645+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:55.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.646+0000 7feae3c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:55.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.647+0000 7fe995fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:55.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.649+0000 7feae3c0e800 20 remove_watcher() i=0 2024-09-12T01:00:55.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.649+0000 7feae3c0e800 2 removed watcher, disabling cache 2024-09-12T01:00:55.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.651+0000 7feae3c0e800 20 remove_watcher() i=1 2024-09-12T01:00:55.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.651+0000 7feae3c0e800 20 remove_watcher() i=2 2024-09-12T01:00:55.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.652+0000 7feae3c0e800 20 remove_watcher() i=3 2024-09-12T01:00:55.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.654+0000 7feae3c0e800 20 remove_watcher() i=4 2024-09-12T01:00:55.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.655+0000 7feae3c0e800 20 remove_watcher() i=5 2024-09-12T01:00:55.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.655+0000 7feae3c0e800 20 remove_watcher() i=6 2024-09-12T01:00:55.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.656+0000 7feae3c0e800 20 remove_watcher() i=7 2024-09-12T01:00:55.665 DEBUG:teuthology.orchestra.run.smithi073:> radosgw-admin gc process --include-all 2024-09-12T01:00:55.717 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:00:55.717 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:00:55.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.956+0000 7fd1f8b19800 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.958+0000 7fd1f8b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:55.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.958+0000 7fd1f8b19800 20 realm 2024-09-12T01:00:55.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.958+0000 7fd1f8b19800 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.958+0000 7fd1f8b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:55.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.958+0000 7fd1f8b19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:00:55.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.958+0000 7fd1f8b19800 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.958+0000 7fd1f8b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:55.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.958+0000 7fd1f8b19800 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.959+0000 7fd1f8b19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:55.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.959+0000 7fd1f8b19800 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.960+0000 7fd1f8b19800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:00:55.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.960+0000 7fd1f8b19800 20 searching for the correct realm 2024-09-12T01:00:55.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:55.962+0000 7fd1f6e04640 0 -- 172.21.15.73:0/2817142517 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fd1ec0d3070 msgr2=0x7fd1ec0a35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:56.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.169+0000 7fd1f6e04640 0 -- 172.21.15.73:0/2817142517 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fd1ec0d3070 msgr2=0x7fd1ec0a35a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:56.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.173+0000 7fd1f8b19800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T01:00:56.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.173+0000 7fd1f8b19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:00:56.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.173+0000 7fd1f8b19800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T01:00:56.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.173+0000 7fd1f8b19800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:00:56.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.173+0000 7fd1f8b19800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:00:56.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.173+0000 7fd1f8b19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:00:56.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.173+0000 7fd1f8b19800 20 rados->read ofs=0 len=0 2024-09-12T01:00:56.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.173+0000 7fd1f8b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:56.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.173+0000 7fd1f8b19800 20 rados->read ofs=0 len=0 2024-09-12T01:00:56.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.173+0000 7fd1f8b19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:56.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.173+0000 7fd1f8b19800 20 rados->read ofs=0 len=0 2024-09-12T01:00:56.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.173+0000 7fd1f8b19800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:00:56.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.173+0000 7fd1f8b19800 20 zone default found 2024-09-12T01:00:56.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.173+0000 7fd1f8b19800 4 Realm: () 2024-09-12T01:00:56.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.173+0000 7fd1f8b19800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T01:00:56.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.173+0000 7fd1f8b19800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T01:00:56.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.173+0000 7fd1f8b19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:00:56.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.173+0000 7fd1f8b19800 20 zonegroup default 2024-09-12T01:00:56.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.173+0000 7fd1f8b19800 20 rados->read ofs=0 len=0 2024-09-12T01:00:56.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.174+0000 7fd1f8b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:56.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.174+0000 7fd1f8b19800 20 rados->read ofs=0 len=0 2024-09-12T01:00:56.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.174+0000 7fd1f8b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:56.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.174+0000 7fd1f8b19800 20 rados->read ofs=0 len=0 2024-09-12T01:00:56.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.174+0000 7fd1f8b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:56.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.174+0000 7fd1f8b19800 20 started sync module instance, tier type = 2024-09-12T01:00:56.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.174+0000 7fd1f8b19800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T01:00:56.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.183+0000 7fd1f8b19800 20 add_watcher() i=0 2024-09-12T01:00:56.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.183+0000 7fd1f8b19800 20 add_watcher() i=1 2024-09-12T01:00:56.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.183+0000 7fd1f8b19800 20 add_watcher() i=2 2024-09-12T01:00:56.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.183+0000 7fd1f8b19800 20 add_watcher() i=3 2024-09-12T01:00:56.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.183+0000 7fd1f8b19800 20 add_watcher() i=4 2024-09-12T01:00:56.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.183+0000 7fd1f8b19800 20 add_watcher() i=5 2024-09-12T01:00:56.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.183+0000 7fd1f8b19800 20 add_watcher() i=6 2024-09-12T01:00:56.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.184+0000 7fd1f8b19800 20 add_watcher() i=7 2024-09-12T01:00:56.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.184+0000 7fd1f8b19800 2 all 8 watchers are set, enabling cache 2024-09-12T01:00:56.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.186+0000 7fd0acfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:56.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.186+0000 7fd1f8b19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:00:56.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.186+0000 7fd1f8b19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:00:56.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.220+0000 7fd0277fe640 20 reqs_thread_entry: start 2024-09-12T01:00:56.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.220+0000 7fd1f8b19800 20 init_complete bucket index max shards: 1 2024-09-12T01:00:56.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.220+0000 7fd1f8b19800 20 Filter name: none 2024-09-12T01:00:56.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.220+0000 7fd0257fa640 20 reqs_thread_entry: start 2024-09-12T01:00:56.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.220+0000 7fd1f8b19800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T01:00:56.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.221+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.221+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:56.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.222+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.222+0000 7fd1f8b19800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T01:00:56.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.224+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.224+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:56.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.224+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.225+0000 7fd1f8b19800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T01:00:56.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.227+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.227+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:56.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.228+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.229+0000 7fd1f8b19800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T01:00:56.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.230+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.230+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:56.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.230+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.231+0000 7fd1f8b19800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T01:00:56.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.233+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.233+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:56.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.233+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.234+0000 7fd1f8b19800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T01:00:56.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.235+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.236+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:56.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.236+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.237+0000 7fd1f8b19800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T01:00:56.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.238+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.238+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:56.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.239+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.240+0000 7fd1f8b19800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T01:00:56.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.241+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.241+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:56.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.242+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.242+0000 7fd1f8b19800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T01:00:56.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.243+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.244+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:56.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.244+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.245+0000 7fd1f8b19800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T01:00:56.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.246+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.247+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:56.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.247+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.248+0000 7fd1f8b19800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T01:00:56.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.249+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.250+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:56.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.250+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.251+0000 7fd1f8b19800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T01:00:56.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.252+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.253+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:56.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.253+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.254+0000 7fd1f8b19800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T01:00:56.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.255+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.255+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:56.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.256+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.256+0000 7fd1f8b19800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T01:00:56.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.258+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.258+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:56.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.258+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.259+0000 7fd1f8b19800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T01:00:56.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.261+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.261+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:56.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.261+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.262+0000 7fd1f8b19800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T01:00:56.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.264+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.264+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:56.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.264+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.265+0000 7fd1f8b19800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T01:00:56.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.267+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.267+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:56.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.268+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.268+0000 7fd1f8b19800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T01:00:56.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.270+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.270+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:56.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.270+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.272+0000 7fd1f8b19800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T01:00:56.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.273+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.274+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:56.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.274+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.275+0000 7fd1f8b19800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T01:00:56.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.277+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.277+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:56.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.277+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.278+0000 7fd1f8b19800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T01:00:56.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.280+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.280+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:56.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.280+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.281+0000 7fd1f8b19800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T01:00:56.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.283+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.284+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:56.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.284+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.285+0000 7fd1f8b19800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T01:00:56.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.286+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.287+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:56.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.287+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.288+0000 7fd1f8b19800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T01:00:56.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.290+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.290+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:56.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.290+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.291+0000 7fd1f8b19800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T01:00:56.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.293+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.293+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:56.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.294+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.295+0000 7fd1f8b19800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T01:00:56.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.296+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.296+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:56.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.297+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.298+0000 7fd1f8b19800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T01:00:56.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.299+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.299+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:56.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.300+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.301+0000 7fd1f8b19800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T01:00:56.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.303+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.303+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:56.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.304+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.305+0000 7fd1f8b19800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T01:00:56.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.306+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.306+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:56.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.307+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.308+0000 7fd1f8b19800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T01:00:56.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.309+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.310+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:56.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.310+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.311+0000 7fd1f8b19800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T01:00:56.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.312+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.313+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:56.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.313+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.314+0000 7fd1f8b19800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T01:00:56.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.315+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.316+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:56.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.316+0000 7fd1f8b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:56.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.318+0000 7fd0acfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:56.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.320+0000 7fd1f8b19800 20 remove_watcher() i=0 2024-09-12T01:00:56.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.320+0000 7fd1f8b19800 2 removed watcher, disabling cache 2024-09-12T01:00:56.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.321+0000 7fd1f8b19800 20 remove_watcher() i=1 2024-09-12T01:00:56.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.322+0000 7fd1f8b19800 20 remove_watcher() i=2 2024-09-12T01:00:56.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.323+0000 7fd1f8b19800 20 remove_watcher() i=3 2024-09-12T01:00:56.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.324+0000 7fd1f8b19800 20 remove_watcher() i=4 2024-09-12T01:00:56.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.325+0000 7fd1f8b19800 20 remove_watcher() i=5 2024-09-12T01:00:56.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.326+0000 7fd1f8b19800 20 remove_watcher() i=6 2024-09-12T01:00:56.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:00:56.327+0000 7fd1f8b19800 20 remove_watcher() i=7 2024-09-12T01:00:56.337 DEBUG:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2024-09-12T01:00:56.836 INFO:teuthology.orchestra.run.smithi073.stdout:> Task :clean 2024-09-12T01:00:57.731 INFO:teuthology.orchestra.run.smithi073.stdout:> Task :compileJava 2024-09-12T01:00:57.731 INFO:teuthology.orchestra.run.smithi073.stdout:> Task :processResources 2024-09-12T01:00:57.731 INFO:teuthology.orchestra.run.smithi073.stdout:> Task :classes 2024-09-12T01:00:58.231 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:00:58.231 INFO:teuthology.orchestra.run.smithi073.stdout:> Task :compileTestJava 2024-09-12T01:00:58.231 INFO:teuthology.orchestra.run.smithi073.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T01:00:58.232 INFO:teuthology.orchestra.run.smithi073.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T01:00:58.232 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:00:58.232 INFO:teuthology.orchestra.run.smithi073.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T01:00:58.232 INFO:teuthology.orchestra.run.smithi073.stdout:> Task :testClasses 2024-09-12T01:01:00.231 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:00.231 INFO:teuthology.orchestra.run.smithi073.stdout:> Task :test 2024-09-12T01:01:00.231 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:00.231 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Bucket tests STANDARD_OUT 2024-09-12T01:01:00.231 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12 01:00:59,526 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T01:01:00.231 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:00.231 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2024-09-12T01:01:00.235 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:00.236 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2024-09-12T01:01:00.236 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:00.236 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2024-09-12T01:01:00.236 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:00.236 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2024-09-12T01:01:00.531 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:00.531 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2024-09-12T01:01:00.531 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:00.531 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2024-09-12T01:01:00.833 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:00.833 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2024-09-12T01:01:00.930 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:00.930 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2024-09-12T01:01:01.030 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:01.030 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2024-09-12T01:01:01.230 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:01.231 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2024-09-12T01:01:01.531 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:01.531 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2024-09-12T01:01:01.531 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:01.531 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2024-09-12T01:01:01.630 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:01.630 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2024-09-12T01:01:01.830 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:01.830 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2024-09-12T01:01:02.330 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:02.331 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2024-09-12T01:01:02.331 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:02.331 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2024-09-12T01:01:02.630 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:02.630 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2024-09-12T01:01:02.730 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:02.731 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2024-09-12T01:01:02.792 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:02.792 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------- 2024-09-12T01:01:02.792 INFO:teuthology.orchestra.run.smithi073.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2024-09-12T01:01:02.792 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------- 2024-09-12T01:01:02.792 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:02.792 INFO:teuthology.orchestra.run.smithi073.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T01:01:02.792 INFO:teuthology.orchestra.run.smithi073.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T01:01:02.792 INFO:teuthology.orchestra.run.smithi073.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T01:01:02.792 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:02.793 INFO:teuthology.orchestra.run.smithi073.stdout:BUILD SUCCESSFUL in 6s 2024-09-12T01:01:02.793 INFO:teuthology.orchestra.run.smithi073.stdout:5 actionable tasks: 5 executed 2024-09-12T01:01:02.796 DEBUG:teuthology.orchestra.run.smithi073:> radosgw-admin gc process --include-all 2024-09-12T01:01:02.847 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:01:02.847 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:01:02.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.886+0000 7f6840b25800 20 rados->read ofs=0 len=0 2024-09-12T01:01:02.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.888+0000 7f6840b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:02.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.888+0000 7f6840b25800 20 realm 2024-09-12T01:01:02.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.888+0000 7f6840b25800 20 rados->read ofs=0 len=0 2024-09-12T01:01:02.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.888+0000 7f6840b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:02.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.888+0000 7f6840b25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:01:02.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.888+0000 7f6840b25800 20 rados->read ofs=0 len=0 2024-09-12T01:01:02.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.888+0000 7f6840b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:02.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.888+0000 7f6840b25800 20 rados->read ofs=0 len=0 2024-09-12T01:01:02.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.889+0000 7f6840b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:01:02.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.889+0000 7f6840b25800 20 rados->read ofs=0 len=0 2024-09-12T01:01:02.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.890+0000 7f6840b25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:01:02.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.890+0000 7f6840b25800 20 searching for the correct realm 2024-09-12T01:01:02.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.893+0000 7f683cf34640 0 -- 172.21.15.73:0/63580630 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f6830039040 msgr2=0x7f6830015950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:01:02.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.898+0000 7f683cf34640 0 -- 172.21.15.73:0/63580630 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f6704086310 msgr2=0x7f6704088740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:01:02.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.901+0000 7f6840b25800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T01:01:02.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.901+0000 7f6840b25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:01:02.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.901+0000 7f6840b25800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T01:01:02.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.901+0000 7f6840b25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:01:02.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.901+0000 7f6840b25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:01:02.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.901+0000 7f6840b25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:01:02.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.901+0000 7f6840b25800 20 rados->read ofs=0 len=0 2024-09-12T01:01:02.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.902+0000 7f6840b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:02.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.902+0000 7f6840b25800 20 rados->read ofs=0 len=0 2024-09-12T01:01:02.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.902+0000 7f6840b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:01:02.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.902+0000 7f6840b25800 20 rados->read ofs=0 len=0 2024-09-12T01:01:02.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.902+0000 7f6840b25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:01:02.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.902+0000 7f6840b25800 20 zone default found 2024-09-12T01:01:02.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.902+0000 7f6840b25800 4 Realm: () 2024-09-12T01:01:02.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.902+0000 7f6840b25800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T01:01:02.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.902+0000 7f6840b25800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T01:01:02.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.902+0000 7f6840b25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:01:02.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.902+0000 7f6840b25800 20 zonegroup default 2024-09-12T01:01:02.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.902+0000 7f6840b25800 20 rados->read ofs=0 len=0 2024-09-12T01:01:02.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.902+0000 7f6840b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:02.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.902+0000 7f6840b25800 20 rados->read ofs=0 len=0 2024-09-12T01:01:02.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.903+0000 7f6840b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:02.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.903+0000 7f6840b25800 20 rados->read ofs=0 len=0 2024-09-12T01:01:02.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.903+0000 7f6840b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:02.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.903+0000 7f6840b25800 20 started sync module instance, tier type = 2024-09-12T01:01:02.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.903+0000 7f6840b25800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T01:01:02.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.912+0000 7f6840b25800 20 add_watcher() i=0 2024-09-12T01:01:02.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.912+0000 7f6840b25800 20 add_watcher() i=1 2024-09-12T01:01:02.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.912+0000 7f6840b25800 20 add_watcher() i=2 2024-09-12T01:01:02.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.912+0000 7f6840b25800 20 add_watcher() i=3 2024-09-12T01:01:02.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.912+0000 7f6840b25800 20 add_watcher() i=4 2024-09-12T01:01:02.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.912+0000 7f6840b25800 20 add_watcher() i=5 2024-09-12T01:01:02.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.912+0000 7f6840b25800 20 add_watcher() i=6 2024-09-12T01:01:02.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.913+0000 7f6840b25800 20 add_watcher() i=7 2024-09-12T01:01:02.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.913+0000 7f6840b25800 2 all 8 watchers are set, enabling cache 2024-09-12T01:01:02.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.915+0000 7f66f2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:01:02.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.915+0000 7f6840b25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:01:02.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.915+0000 7f6840b25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:01:02.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.951+0000 7f66f1fdb640 20 reqs_thread_entry: start 2024-09-12T01:01:02.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.951+0000 7f6840b25800 20 init_complete bucket index max shards: 1 2024-09-12T01:01:02.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.951+0000 7f6840b25800 20 Filter name: none 2024-09-12T01:01:02.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.951+0000 7f66637fe640 20 reqs_thread_entry: start 2024-09-12T01:01:02.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.951+0000 7f6840b25800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T01:01:02.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.953+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:02.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.953+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:02.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.954+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:01:02.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.954+0000 7f6840b25800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14349530600605713703', time=2024-09-12T03:01:01.282919+0000, chain.objs.size()=1 2024-09-12T01:01:02.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.954+0000 7f6840b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.71__shadow_.xiZmWfnxhOUB_uElqjaazlaB2j6DebB_0 2024-09-12T01:01:02.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.955+0000 7f6840b25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:02.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.957+0000 7f6840b25800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T01:01:02.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.958+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:02.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.959+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:02.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.959+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:02.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.960+0000 7f6840b25800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T01:01:02.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.961+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:02.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.962+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:02.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.962+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:02.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.963+0000 7f6840b25800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T01:01:02.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.964+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:02.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.965+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:02.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.965+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:02.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.966+0000 7f6840b25800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T01:01:02.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.968+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:02.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.968+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:02.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.968+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:02.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.969+0000 7f6840b25800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T01:01:02.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.971+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:02.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.971+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:02.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.971+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:02.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.972+0000 7f6840b25800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T01:01:02.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.974+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:02.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.974+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:02.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.974+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:02.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.975+0000 7f6840b25800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T01:01:02.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.977+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:02.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.977+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:02.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.978+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:02.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.979+0000 7f6840b25800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T01:01:02.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.980+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:02.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.981+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:02.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.981+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:02.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.982+0000 7f6840b25800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T01:01:02.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.983+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:02.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.983+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:02.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.984+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:02.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.985+0000 7f6840b25800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T01:01:02.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.986+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:02.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.986+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:02.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.987+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:02.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.988+0000 7f6840b25800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T01:01:02.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.989+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:02.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.990+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:02.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.990+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:02.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.991+0000 7f6840b25800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T01:01:02.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.992+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:02.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.993+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:02.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.993+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:02.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.994+0000 7f6840b25800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T01:01:02.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.995+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:02.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.996+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:02.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.996+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:02.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.997+0000 7f6840b25800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T01:01:02.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.998+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:02.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.999+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:02.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:02.999+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:02.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.000+0000 7f6840b25800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T01:01:03.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.001+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.002+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:03.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.002+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.003+0000 7f6840b25800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T01:01:03.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.004+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.004+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:03.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.004+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.005+0000 7f6840b25800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T01:01:03.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.007+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.008+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:03.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.008+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.009+0000 7f6840b25800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T01:01:03.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.010+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.011+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:03.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.011+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.012+0000 7f6840b25800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T01:01:03.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.014+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.014+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:03.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.015+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.016+0000 7f6840b25800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T01:01:03.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.017+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.018+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:03.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.018+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.019+0000 7f6840b25800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T01:01:03.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.020+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.020+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:03.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.021+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.022+0000 7f6840b25800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T01:01:03.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.023+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.023+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:03.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.023+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.024+0000 7f6840b25800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T01:01:03.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.026+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.026+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:03.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.026+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.027+0000 7f6840b25800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T01:01:03.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.028+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.029+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:03.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.029+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.030+0000 7f6840b25800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T01:01:03.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.032+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.032+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:03.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.032+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.034+0000 7f6840b25800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T01:01:03.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.035+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.035+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:03.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.035+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.036+0000 7f6840b25800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T01:01:03.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.038+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.038+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:03.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.039+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:01:03.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.039+0000 7f6840b25800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.729990813826109072', time=2024-09-12T03:01:01.899550+0000, chain.objs.size()=1 2024-09-12T01:01:03.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.039+0000 7f6840b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.72__shadow_.ZVwSIOrUvqleQ1og8yDjPXAsLW9uKkL_0 2024-09-12T01:01:03.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.040+0000 7f6840b25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:03.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.042+0000 7f6840b25800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T01:01:03.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.044+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.044+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:03.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.044+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.045+0000 7f6840b25800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T01:01:03.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.047+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.047+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:03.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.047+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.049+0000 7f6840b25800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T01:01:03.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.050+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.051+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:03.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.051+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.052+0000 7f6840b25800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T01:01:03.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.053+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.054+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:03.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.054+0000 7f6840b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.056+0000 7f66f2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:01:03.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.058+0000 7f6840b25800 20 remove_watcher() i=0 2024-09-12T01:01:03.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.058+0000 7f6840b25800 2 removed watcher, disabling cache 2024-09-12T01:01:03.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.059+0000 7f6840b25800 20 remove_watcher() i=1 2024-09-12T01:01:03.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.060+0000 7f6840b25800 20 remove_watcher() i=2 2024-09-12T01:01:03.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.061+0000 7f6840b25800 20 remove_watcher() i=3 2024-09-12T01:01:03.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.062+0000 7f6840b25800 20 remove_watcher() i=4 2024-09-12T01:01:03.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.063+0000 7f6840b25800 20 remove_watcher() i=5 2024-09-12T01:01:03.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.064+0000 7f6840b25800 20 remove_watcher() i=6 2024-09-12T01:01:03.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.065+0000 7f6840b25800 20 remove_watcher() i=7 2024-09-12T01:01:03.074 DEBUG:teuthology.orchestra.run.smithi073:> radosgw-admin gc process --include-all 2024-09-12T01:01:03.126 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:01:03.126 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:01:03.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.165+0000 7fe763125800 20 rados->read ofs=0 len=0 2024-09-12T01:01:03.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.167+0000 7fe763125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:03.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.167+0000 7fe763125800 20 realm 2024-09-12T01:01:03.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.167+0000 7fe763125800 20 rados->read ofs=0 len=0 2024-09-12T01:01:03.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.167+0000 7fe763125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:03.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.167+0000 7fe763125800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:01:03.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.167+0000 7fe763125800 20 rados->read ofs=0 len=0 2024-09-12T01:01:03.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.167+0000 7fe763125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:03.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.167+0000 7fe763125800 20 rados->read ofs=0 len=0 2024-09-12T01:01:03.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.168+0000 7fe763125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:01:03.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.168+0000 7fe763125800 20 rados->read ofs=0 len=0 2024-09-12T01:01:03.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.168+0000 7fe763125800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:01:03.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.168+0000 7fe763125800 20 searching for the correct realm 2024-09-12T01:01:03.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.170+0000 7fe757fff640 0 -- 172.21.15.73:0/2044847683 >> [v2:172.21.15.73:6826/269690776,v1:172.21.15.73:6827/269690776] conn(0x7fe750097af0 msgr2=0x7fe750061230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:01:03.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.376+0000 7fe75ed33640 0 -- 172.21.15.73:0/2044847683 >> [v2:172.21.15.73:6810/1807760270,v1:172.21.15.73:6811/1807760270] conn(0x562d2567c280 msgr2=0x7fe75803a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:01:03.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.583+0000 7fe763125800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T01:01:03.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.583+0000 7fe763125800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:01:03.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.583+0000 7fe763125800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T01:01:03.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.583+0000 7fe763125800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:01:03.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.583+0000 7fe763125800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:01:03.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.583+0000 7fe763125800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:01:03.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.583+0000 7fe763125800 20 rados->read ofs=0 len=0 2024-09-12T01:01:03.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.583+0000 7fe763125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:03.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.583+0000 7fe763125800 20 rados->read ofs=0 len=0 2024-09-12T01:01:03.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.583+0000 7fe763125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:01:03.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.584+0000 7fe763125800 20 rados->read ofs=0 len=0 2024-09-12T01:01:03.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.584+0000 7fe763125800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:01:03.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.584+0000 7fe763125800 20 zone default found 2024-09-12T01:01:03.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.584+0000 7fe763125800 4 Realm: () 2024-09-12T01:01:03.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.584+0000 7fe763125800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T01:01:03.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.584+0000 7fe763125800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T01:01:03.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.584+0000 7fe763125800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:01:03.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.584+0000 7fe763125800 20 zonegroup default 2024-09-12T01:01:03.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.584+0000 7fe763125800 20 rados->read ofs=0 len=0 2024-09-12T01:01:03.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.584+0000 7fe763125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:03.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.584+0000 7fe763125800 20 rados->read ofs=0 len=0 2024-09-12T01:01:03.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.584+0000 7fe763125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:03.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.584+0000 7fe763125800 20 rados->read ofs=0 len=0 2024-09-12T01:01:03.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.585+0000 7fe763125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:03.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.585+0000 7fe763125800 20 started sync module instance, tier type = 2024-09-12T01:01:03.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.585+0000 7fe763125800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T01:01:03.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.593+0000 7fe763125800 20 add_watcher() i=0 2024-09-12T01:01:03.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.593+0000 7fe763125800 20 add_watcher() i=1 2024-09-12T01:01:03.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.593+0000 7fe763125800 20 add_watcher() i=2 2024-09-12T01:01:03.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.593+0000 7fe763125800 20 add_watcher() i=3 2024-09-12T01:01:03.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.593+0000 7fe763125800 20 add_watcher() i=4 2024-09-12T01:01:03.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.593+0000 7fe763125800 20 add_watcher() i=5 2024-09-12T01:01:03.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.593+0000 7fe763125800 20 add_watcher() i=6 2024-09-12T01:01:03.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.594+0000 7fe763125800 20 add_watcher() i=7 2024-09-12T01:01:03.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.594+0000 7fe763125800 2 all 8 watchers are set, enabling cache 2024-09-12T01:01:03.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.596+0000 7fe6157e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:01:03.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.596+0000 7fe763125800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:01:03.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.596+0000 7fe763125800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:01:03.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.637+0000 7fe58ffff640 20 reqs_thread_entry: start 2024-09-12T01:01:03.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.637+0000 7fe763125800 20 init_complete bucket index max shards: 1 2024-09-12T01:01:03.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.637+0000 7fe763125800 20 Filter name: none 2024-09-12T01:01:03.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.637+0000 7fe58dffb640 20 reqs_thread_entry: start 2024-09-12T01:01:03.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.637+0000 7fe763125800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T01:01:03.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.639+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.639+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:03.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.639+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.640+0000 7fe763125800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T01:01:03.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.642+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.642+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:03.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.642+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.643+0000 7fe763125800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T01:01:03.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.644+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.645+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:03.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.645+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.646+0000 7fe763125800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T01:01:03.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.648+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.648+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:03.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.648+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.649+0000 7fe763125800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T01:01:03.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.651+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.651+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:03.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.652+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.652+0000 7fe763125800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T01:01:03.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.654+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.654+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:03.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.655+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.656+0000 7fe763125800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T01:01:03.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.657+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.657+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:03.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.658+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.658+0000 7fe763125800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T01:01:03.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.660+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.660+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:03.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.660+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.661+0000 7fe763125800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T01:01:03.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.663+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.664+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:03.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.664+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.665+0000 7fe763125800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T01:01:03.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.666+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.667+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:03.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.667+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.668+0000 7fe763125800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T01:01:03.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.669+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.670+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:03.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.670+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.671+0000 7fe763125800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T01:01:03.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.672+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.673+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:03.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.673+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.674+0000 7fe763125800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T01:01:03.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.675+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.676+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:03.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.676+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.677+0000 7fe763125800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T01:01:03.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.678+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.678+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:03.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.678+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.680+0000 7fe763125800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T01:01:03.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.681+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.682+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:03.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.682+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.683+0000 7fe763125800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T01:01:03.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.684+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.685+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:03.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.685+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.686+0000 7fe763125800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T01:01:03.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.687+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.688+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:03.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.688+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.689+0000 7fe763125800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T01:01:03.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.691+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.691+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:03.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.692+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.693+0000 7fe763125800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T01:01:03.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.694+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.694+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:03.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.694+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.695+0000 7fe763125800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T01:01:03.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.697+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.697+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:03.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.697+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.698+0000 7fe763125800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T01:01:03.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.699+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.700+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:03.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.700+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.701+0000 7fe763125800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T01:01:03.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.702+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.703+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:03.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.703+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.704+0000 7fe763125800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T01:01:03.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.705+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.705+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:03.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.706+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.707+0000 7fe763125800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T01:01:03.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.708+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.708+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:03.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.708+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.710+0000 7fe763125800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T01:01:03.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.711+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.711+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:03.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.711+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.713+0000 7fe763125800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T01:01:03.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.714+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.714+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:03.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.715+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.716+0000 7fe763125800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T01:01:03.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.717+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.717+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:03.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.717+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.718+0000 7fe763125800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T01:01:03.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.720+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.720+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:03.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.720+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.722+0000 7fe763125800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T01:01:03.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.723+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.723+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:03.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.723+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.725+0000 7fe763125800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T01:01:03.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.726+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.727+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:03.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.727+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.728+0000 7fe763125800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T01:01:03.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.729+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.730+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:03.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.730+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.732+0000 7fe763125800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T01:01:03.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.733+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.733+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:03.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.734+0000 7fe763125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:03.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.736+0000 7fe6157e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:01:03.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.738+0000 7fe763125800 20 remove_watcher() i=0 2024-09-12T01:01:03.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.738+0000 7fe763125800 2 removed watcher, disabling cache 2024-09-12T01:01:03.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.738+0000 7fe763125800 20 remove_watcher() i=1 2024-09-12T01:01:03.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.739+0000 7fe763125800 20 remove_watcher() i=2 2024-09-12T01:01:03.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.740+0000 7fe763125800 20 remove_watcher() i=3 2024-09-12T01:01:03.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.742+0000 7fe763125800 20 remove_watcher() i=4 2024-09-12T01:01:03.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.743+0000 7fe763125800 20 remove_watcher() i=5 2024-09-12T01:01:03.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.744+0000 7fe763125800 20 remove_watcher() i=6 2024-09-12T01:01:03.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.745+0000 7fe763125800 20 remove_watcher() i=7 2024-09-12T01:01:03.754 DEBUG:teuthology.orchestra.run.smithi073:> radosgw-admin gc process --include-all 2024-09-12T01:01:03.805 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:01:03.806 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:01:03.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.844+0000 7f3d5ffaf800 20 rados->read ofs=0 len=0 2024-09-12T01:01:03.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.845+0000 7f3d5ffaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:03.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.845+0000 7f3d5ffaf800 20 realm 2024-09-12T01:01:03.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.845+0000 7f3d5ffaf800 20 rados->read ofs=0 len=0 2024-09-12T01:01:03.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.846+0000 7f3d5ffaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:03.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.846+0000 7f3d5ffaf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:01:03.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.846+0000 7f3d5ffaf800 20 rados->read ofs=0 len=0 2024-09-12T01:01:03.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.846+0000 7f3d5ffaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:03.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.846+0000 7f3d5ffaf800 20 rados->read ofs=0 len=0 2024-09-12T01:01:03.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.847+0000 7f3d5ffaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:01:03.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.847+0000 7f3d5ffaf800 20 rados->read ofs=0 len=0 2024-09-12T01:01:03.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.847+0000 7f3d5ffaf800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:01:03.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.847+0000 7f3d5ffaf800 20 searching for the correct realm 2024-09-12T01:01:03.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:03.849+0000 7f3d5d298640 0 -- 172.21.15.73:0/1995056047 >> [v2:172.21.15.73:6826/269690776,v1:172.21.15.73:6827/269690776] conn(0x7f3d50028070 msgr2=0x7f3d5006ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:01:04.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.055+0000 7f3d5da99640 0 -- 172.21.15.73:0/1995056047 >> [v2:172.21.15.73:6810/1807760270,v1:172.21.15.73:6811/1807760270] conn(0x7f3d58061040 msgr2=0x7f3d58003430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:01:04.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.261+0000 7f3d5ffaf800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T01:01:04.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.261+0000 7f3d5ffaf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:01:04.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.261+0000 7f3d5ffaf800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T01:01:04.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.261+0000 7f3d5ffaf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:01:04.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.261+0000 7f3d5ffaf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:01:04.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.261+0000 7f3d5ffaf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:01:04.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.261+0000 7f3d5ffaf800 20 rados->read ofs=0 len=0 2024-09-12T01:01:04.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.261+0000 7f3d5ffaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:04.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.261+0000 7f3d5ffaf800 20 rados->read ofs=0 len=0 2024-09-12T01:01:04.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.261+0000 7f3d5ffaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:01:04.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.261+0000 7f3d5ffaf800 20 rados->read ofs=0 len=0 2024-09-12T01:01:04.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.262+0000 7f3d5ffaf800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:01:04.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.262+0000 7f3d5ffaf800 20 zone default found 2024-09-12T01:01:04.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.262+0000 7f3d5ffaf800 4 Realm: () 2024-09-12T01:01:04.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.262+0000 7f3d5ffaf800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T01:01:04.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.262+0000 7f3d5ffaf800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T01:01:04.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.262+0000 7f3d5ffaf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:01:04.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.262+0000 7f3d5ffaf800 20 zonegroup default 2024-09-12T01:01:04.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.262+0000 7f3d5ffaf800 20 rados->read ofs=0 len=0 2024-09-12T01:01:04.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.262+0000 7f3d5ffaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:04.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.262+0000 7f3d5ffaf800 20 rados->read ofs=0 len=0 2024-09-12T01:01:04.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.262+0000 7f3d5ffaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:04.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.262+0000 7f3d5ffaf800 20 rados->read ofs=0 len=0 2024-09-12T01:01:04.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.262+0000 7f3d5ffaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:04.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.262+0000 7f3d5ffaf800 20 started sync module instance, tier type = 2024-09-12T01:01:04.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.262+0000 7f3d5ffaf800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T01:01:04.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.271+0000 7f3d5ffaf800 20 add_watcher() i=0 2024-09-12T01:01:04.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.271+0000 7f3d5ffaf800 20 add_watcher() i=1 2024-09-12T01:01:04.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.271+0000 7f3d5ffaf800 20 add_watcher() i=2 2024-09-12T01:01:04.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.271+0000 7f3d5ffaf800 20 add_watcher() i=3 2024-09-12T01:01:04.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.271+0000 7f3d5ffaf800 20 add_watcher() i=4 2024-09-12T01:01:04.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.271+0000 7f3d5ffaf800 20 add_watcher() i=5 2024-09-12T01:01:04.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.271+0000 7f3d5ffaf800 20 add_watcher() i=6 2024-09-12T01:01:04.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.272+0000 7f3d5ffaf800 20 add_watcher() i=7 2024-09-12T01:01:04.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.272+0000 7f3d5ffaf800 2 all 8 watchers are set, enabling cache 2024-09-12T01:01:04.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.274+0000 7f3c0f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:01:04.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.274+0000 7f3d5ffaf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:01:04.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.274+0000 7f3d5ffaf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:01:04.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.308+0000 7f3c0e7fc640 20 reqs_thread_entry: start 2024-09-12T01:01:04.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.308+0000 7f3d5ffaf800 20 init_complete bucket index max shards: 1 2024-09-12T01:01:04.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.308+0000 7f3d5ffaf800 20 Filter name: none 2024-09-12T01:01:04.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.308+0000 7f3b7ffff640 20 reqs_thread_entry: start 2024-09-12T01:01:04.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.308+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T01:01:04.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.309+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.310+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.310+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.311+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T01:01:04.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.313+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.313+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.313+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.314+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T01:01:04.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.316+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.316+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.316+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.317+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T01:01:04.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.319+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.319+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.320+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.321+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T01:01:04.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.322+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.323+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.323+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.324+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T01:01:04.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.326+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.326+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.326+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.327+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T01:01:04.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.328+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.329+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.329+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.330+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T01:01:04.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.331+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.332+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.332+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.333+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T01:01:04.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.334+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.335+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.335+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.336+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T01:01:04.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.337+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.337+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.337+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.338+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T01:01:04.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.340+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.340+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.340+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.341+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T01:01:04.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.342+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.343+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.343+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.344+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T01:01:04.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.345+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.346+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.346+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.347+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T01:01:04.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.348+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.349+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.349+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.350+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T01:01:04.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.352+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.352+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.352+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.353+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T01:01:04.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.355+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.355+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.356+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.357+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T01:01:04.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.358+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.358+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.359+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.360+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T01:01:04.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.361+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.362+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.362+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.363+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T01:01:04.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.364+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.365+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.365+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.366+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T01:01:04.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.367+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.368+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.368+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.369+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T01:01:04.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.370+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.371+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.371+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.373+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T01:01:04.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.374+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.375+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.375+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.376+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T01:01:04.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.377+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.378+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.378+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.379+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T01:01:04.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.380+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.381+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.381+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.382+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T01:01:04.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.383+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.384+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.384+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.385+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T01:01:04.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.386+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.387+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.387+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.388+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T01:01:04.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.389+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.390+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.390+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.391+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T01:01:04.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.392+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.393+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.393+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.394+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T01:01:04.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.395+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.396+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.396+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.397+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T01:01:04.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.398+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.399+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.399+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.400+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T01:01:04.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.401+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.402+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.402+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.403+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T01:01:04.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.405+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.405+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.405+0000 7f3d5ffaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.407+0000 7f3c0f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:01:04.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.409+0000 7f3d5ffaf800 20 remove_watcher() i=0 2024-09-12T01:01:04.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.409+0000 7f3d5ffaf800 2 removed watcher, disabling cache 2024-09-12T01:01:04.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.410+0000 7f3d5ffaf800 20 remove_watcher() i=1 2024-09-12T01:01:04.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.411+0000 7f3d5ffaf800 20 remove_watcher() i=2 2024-09-12T01:01:04.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.412+0000 7f3d5ffaf800 20 remove_watcher() i=3 2024-09-12T01:01:04.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.413+0000 7f3d5ffaf800 20 remove_watcher() i=4 2024-09-12T01:01:04.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.414+0000 7f3d5ffaf800 20 remove_watcher() i=5 2024-09-12T01:01:04.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.415+0000 7f3d5ffaf800 20 remove_watcher() i=6 2024-09-12T01:01:04.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.416+0000 7f3d5ffaf800 20 remove_watcher() i=7 2024-09-12T01:01:04.425 DEBUG:teuthology.orchestra.run.smithi073:> radosgw-admin gc process --include-all 2024-09-12T01:01:04.477 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:01:04.477 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:01:04.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.516+0000 7fef7552e800 20 rados->read ofs=0 len=0 2024-09-12T01:01:04.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.517+0000 7fef7552e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:04.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.517+0000 7fef7552e800 20 realm 2024-09-12T01:01:04.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.517+0000 7fef7552e800 20 rados->read ofs=0 len=0 2024-09-12T01:01:04.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.517+0000 7fef7552e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:04.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.517+0000 7fef7552e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:01:04.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.517+0000 7fef7552e800 20 rados->read ofs=0 len=0 2024-09-12T01:01:04.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.518+0000 7fef7552e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:04.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.518+0000 7fef7552e800 20 rados->read ofs=0 len=0 2024-09-12T01:01:04.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.518+0000 7fef7552e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:01:04.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.518+0000 7fef7552e800 20 rados->read ofs=0 len=0 2024-09-12T01:01:04.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.519+0000 7fef7552e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:01:04.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.519+0000 7fef7552e800 20 searching for the correct realm 2024-09-12T01:01:04.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.521+0000 7fef71ab1640 0 -- 172.21.15.73:0/1583233527 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fef5c0682e0 msgr2=0x7fef5c066d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:01:04.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.726+0000 7fef71ab1640 0 -- 172.21.15.73:0/1583233527 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fef5c0682e0 msgr2=0x7fef5c066d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:01:04.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.730+0000 7fef7552e800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T01:01:04.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.730+0000 7fef7552e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:01:04.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.730+0000 7fef7552e800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T01:01:04.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.730+0000 7fef7552e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:01:04.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.730+0000 7fef7552e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:01:04.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.730+0000 7fef7552e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:01:04.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.730+0000 7fef7552e800 20 rados->read ofs=0 len=0 2024-09-12T01:01:04.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.730+0000 7fef7552e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:04.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.730+0000 7fef7552e800 20 rados->read ofs=0 len=0 2024-09-12T01:01:04.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.730+0000 7fef7552e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:01:04.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.730+0000 7fef7552e800 20 rados->read ofs=0 len=0 2024-09-12T01:01:04.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.731+0000 7fef7552e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:01:04.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.731+0000 7fef7552e800 20 zone default found 2024-09-12T01:01:04.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.731+0000 7fef7552e800 4 Realm: () 2024-09-12T01:01:04.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.731+0000 7fef7552e800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T01:01:04.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.731+0000 7fef7552e800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T01:01:04.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.731+0000 7fef7552e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:01:04.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.731+0000 7fef7552e800 20 zonegroup default 2024-09-12T01:01:04.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.731+0000 7fef7552e800 20 rados->read ofs=0 len=0 2024-09-12T01:01:04.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.731+0000 7fef7552e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:04.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.731+0000 7fef7552e800 20 rados->read ofs=0 len=0 2024-09-12T01:01:04.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.731+0000 7fef7552e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:04.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.731+0000 7fef7552e800 20 rados->read ofs=0 len=0 2024-09-12T01:01:04.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.731+0000 7fef7552e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:04.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.732+0000 7fef7552e800 20 started sync module instance, tier type = 2024-09-12T01:01:04.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.732+0000 7fef7552e800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T01:01:04.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.740+0000 7fef7552e800 20 add_watcher() i=0 2024-09-12T01:01:04.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.740+0000 7fef7552e800 20 add_watcher() i=1 2024-09-12T01:01:04.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.740+0000 7fef7552e800 20 add_watcher() i=2 2024-09-12T01:01:04.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.740+0000 7fef7552e800 20 add_watcher() i=3 2024-09-12T01:01:04.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.740+0000 7fef7552e800 20 add_watcher() i=4 2024-09-12T01:01:04.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.740+0000 7fef7552e800 20 add_watcher() i=5 2024-09-12T01:01:04.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.740+0000 7fef7552e800 20 add_watcher() i=6 2024-09-12T01:01:04.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.741+0000 7fef7552e800 20 add_watcher() i=7 2024-09-12T01:01:04.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.741+0000 7fef7552e800 2 all 8 watchers are set, enabling cache 2024-09-12T01:01:04.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.743+0000 7fee277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:01:04.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.743+0000 7fef7552e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:01:04.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.743+0000 7fef7552e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:01:04.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.776+0000 7fee267e4640 20 reqs_thread_entry: start 2024-09-12T01:01:04.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.776+0000 7fef7552e800 20 init_complete bucket index max shards: 1 2024-09-12T01:01:04.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.776+0000 7fef7552e800 20 Filter name: none 2024-09-12T01:01:04.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.776+0000 7fed97fff640 20 reqs_thread_entry: start 2024-09-12T01:01:04.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.776+0000 7fef7552e800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T01:01:04.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.777+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.777+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.778+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.778+0000 7fef7552e800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T01:01:04.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.780+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.780+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.780+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.781+0000 7fef7552e800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T01:01:04.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.782+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.783+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.783+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.784+0000 7fef7552e800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T01:01:04.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.785+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.786+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.786+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.787+0000 7fef7552e800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T01:01:04.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.788+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.788+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.789+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.790+0000 7fef7552e800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T01:01:04.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.791+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.791+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.792+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.793+0000 7fef7552e800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T01:01:04.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.794+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.794+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.795+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.796+0000 7fef7552e800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T01:01:04.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.797+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.797+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.797+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.798+0000 7fef7552e800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T01:01:04.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.799+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.800+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.800+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.801+0000 7fef7552e800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T01:01:04.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.802+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.803+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.803+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.804+0000 7fef7552e800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T01:01:04.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.806+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.806+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.807+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.808+0000 7fef7552e800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T01:01:04.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.809+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.809+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.810+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.811+0000 7fef7552e800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T01:01:04.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.813+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.813+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.813+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.814+0000 7fef7552e800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T01:01:04.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.816+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.816+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.817+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.818+0000 7fef7552e800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T01:01:04.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.819+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.819+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.820+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.821+0000 7fef7552e800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T01:01:04.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.822+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.822+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.822+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.823+0000 7fef7552e800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T01:01:04.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.825+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.825+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.825+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.826+0000 7fef7552e800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T01:01:04.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.828+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.828+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.828+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.829+0000 7fef7552e800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T01:01:04.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.830+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.831+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.831+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.832+0000 7fef7552e800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T01:01:04.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.833+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.834+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.834+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.835+0000 7fef7552e800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T01:01:04.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.836+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.837+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.837+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.838+0000 7fef7552e800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T01:01:04.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.839+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.840+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.840+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.841+0000 7fef7552e800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T01:01:04.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.842+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.843+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.843+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.844+0000 7fef7552e800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T01:01:04.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.845+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.846+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.846+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.847+0000 7fef7552e800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T01:01:04.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.848+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.849+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.849+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.850+0000 7fef7552e800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T01:01:04.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.851+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.852+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.852+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.853+0000 7fef7552e800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T01:01:04.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.854+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.854+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.855+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.856+0000 7fef7552e800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T01:01:04.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.857+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.857+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.858+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.859+0000 7fef7552e800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T01:01:04.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.860+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.861+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.861+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.862+0000 7fef7552e800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T01:01:04.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.863+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.864+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.864+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.865+0000 7fef7552e800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T01:01:04.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.866+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.866+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.866+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.868+0000 7fef7552e800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T01:01:04.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.869+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.869+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:04.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.869+0000 7fef7552e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:04.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.871+0000 7fee277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:01:04.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.873+0000 7fef7552e800 20 remove_watcher() i=0 2024-09-12T01:01:04.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.873+0000 7fef7552e800 2 removed watcher, disabling cache 2024-09-12T01:01:04.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.875+0000 7fef7552e800 20 remove_watcher() i=1 2024-09-12T01:01:04.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.875+0000 7fef7552e800 20 remove_watcher() i=2 2024-09-12T01:01:04.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.876+0000 7fef7552e800 20 remove_watcher() i=3 2024-09-12T01:01:04.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.877+0000 7fef7552e800 20 remove_watcher() i=4 2024-09-12T01:01:04.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.878+0000 7fef7552e800 20 remove_watcher() i=5 2024-09-12T01:01:04.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.879+0000 7fef7552e800 20 remove_watcher() i=6 2024-09-12T01:01:04.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:01:04.880+0000 7fef7552e800 20 remove_watcher() i=7 2024-09-12T01:01:04.889 DEBUG:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2024-09-12T01:01:05.391 INFO:teuthology.orchestra.run.smithi073.stdout:> Task :clean 2024-09-12T01:01:06.188 INFO:teuthology.orchestra.run.smithi073.stdout:> Task :compileJava 2024-09-12T01:01:06.188 INFO:teuthology.orchestra.run.smithi073.stdout:> Task :processResources 2024-09-12T01:01:06.188 INFO:teuthology.orchestra.run.smithi073.stdout:> Task :classes 2024-09-12T01:01:06.587 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:06.587 INFO:teuthology.orchestra.run.smithi073.stdout:> Task :compileTestJava 2024-09-12T01:01:06.588 INFO:teuthology.orchestra.run.smithi073.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T01:01:06.588 INFO:teuthology.orchestra.run.smithi073.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T01:01:06.589 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:06.589 INFO:teuthology.orchestra.run.smithi073.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T01:01:06.589 INFO:teuthology.orchestra.run.smithi073.stdout:> Task :testClasses 2024-09-12T01:01:08.588 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:08.589 INFO:teuthology.orchestra.run.smithi073.stdout:> Task :test 2024-09-12T01:01:08.589 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:08.589 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests STANDARD_OUT 2024-09-12T01:01:08.589 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12 01:01:07,885 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T01:01:08.589 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:08.589 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2024-09-12T01:01:08.589 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:08.589 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2024-09-12T01:01:08.787 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:08.787 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2024-09-12T01:01:08.887 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:08.887 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2024-09-12T01:01:09.187 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:09.187 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2024-09-12T01:01:09.287 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:09.288 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2024-09-12T01:01:09.487 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:09.487 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2024-09-12T01:01:14.787 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:14.788 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2024-09-12T01:01:15.087 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:15.087 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2024-09-12T01:01:15.187 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:15.188 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2024-09-12T01:01:15.488 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:15.488 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2024-09-12T01:01:15.687 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:15.687 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2024-09-12T01:01:15.988 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:15.988 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2024-09-12T01:01:15.988 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:15.988 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2024-09-12T01:01:16.087 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:16.088 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2024-09-12T01:01:16.088 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:16.088 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2024-09-12T01:01:16.387 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:16.387 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2024-09-12T01:01:21.487 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:21.488 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2024-09-12T01:01:21.787 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:21.787 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2024-09-12T01:01:21.987 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:21.987 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2024-09-12T01:01:22.287 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:22.287 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2024-09-12T01:01:22.387 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:22.387 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2024-09-12T01:01:22.687 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:22.687 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2024-09-12T01:01:22.787 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:22.787 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2024-09-12T01:01:23.087 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:23.087 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2024-09-12T01:01:23.187 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:23.187 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2024-09-12T01:01:23.387 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:23.387 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2024-09-12T01:01:23.487 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:23.487 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2024-09-12T01:01:23.787 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:23.788 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2024-09-12T01:01:23.887 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:23.887 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2024-09-12T01:01:24.087 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:24.087 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2024-09-12T01:01:24.287 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:24.287 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2024-09-12T01:01:24.587 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:24.587 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2024-09-12T01:01:29.887 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:29.888 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2024-09-12T01:01:30.387 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:01:30.388 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2024-09-12T01:02:01.987 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:02:01.988 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2024-09-12T01:02:02.487 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:02:02.487 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2024-09-12T01:02:02.587 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:02:02.587 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2024-09-12T01:02:02.887 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:02:02.888 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2024-09-12T01:02:02.888 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:02:02.888 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2024-09-12T01:02:03.387 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:02:03.387 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2024-09-12T01:02:17.188 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:02:17.188 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2024-09-12T01:02:17.487 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:02:17.488 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2024-09-12T01:02:17.488 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:02:17.488 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2024-09-12T01:02:17.587 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:02:17.587 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2024-09-12T01:02:24.987 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:02:24.987 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2024-09-12T01:02:26.287 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:02:26.288 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests STANDARD_OUT 2024-09-12T01:02:26.288 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12 01:02:26,248 [s3-transfer-manager-worker-9] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-12T01:02:26.687 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:02:26.687 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2024-09-12T01:02:36.287 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:02:36.287 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2024-09-12T01:02:36.687 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:02:36.687 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2024-09-12T01:02:41.787 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:02:41.787 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2024-09-12T01:02:42.087 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:02:42.087 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2024-09-12T01:03:19.588 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:19.588 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2024-09-12T01:03:19.887 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:19.888 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2024-09-12T01:03:28.087 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:28.087 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2024-09-12T01:03:28.287 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:28.287 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2024-09-12T01:03:33.088 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:33.088 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2024-09-12T01:03:33.387 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:33.387 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2024-09-12T01:03:35.187 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:35.187 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2024-09-12T01:03:40.787 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:40.787 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2024-09-12T01:03:41.087 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:41.087 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2024-09-12T01:03:41.787 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:41.787 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2024-09-12T01:03:41.887 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:41.887 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2024-09-12T01:03:42.187 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:42.188 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2024-09-12T01:03:42.287 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:42.288 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2024-09-12T01:03:42.487 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:42.488 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2024-09-12T01:03:42.587 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:42.587 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2024-09-12T01:03:42.887 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:42.887 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2024-09-12T01:03:42.987 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:42.987 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2024-09-12T01:03:43.287 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:43.287 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2024-09-12T01:03:43.387 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:43.387 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2024-09-12T01:03:43.587 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:43.588 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2024-09-12T01:03:43.687 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:43.688 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2024-09-12T01:03:43.987 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:43.987 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2024-09-12T01:03:44.187 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:44.187 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2024-09-12T01:03:44.587 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:44.587 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2024-09-12T01:03:44.787 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:44.787 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2024-09-12T01:03:45.187 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:45.187 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2024-09-12T01:03:45.387 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:45.387 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2024-09-12T01:03:45.787 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:45.787 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2024-09-12T01:03:45.987 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:45.987 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2024-09-12T01:03:46.387 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:46.387 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2024-09-12T01:03:46.587 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:46.587 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2024-09-12T01:03:46.887 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:46.887 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2024-09-12T01:03:47.187 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:47.188 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2024-09-12T01:03:47.487 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:47.487 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2024-09-12T01:03:47.687 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:47.687 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2024-09-12T01:03:48.087 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:48.087 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2024-09-12T01:03:48.287 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:48.287 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2024-09-12T01:03:48.687 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:48.687 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2024-09-12T01:03:48.887 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:48.887 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2024-09-12T01:03:49.287 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:49.287 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2024-09-12T01:03:49.487 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:49.487 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2024-09-12T01:03:49.887 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:49.887 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2024-09-12T01:03:50.087 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:50.087 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2024-09-12T01:03:50.387 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:50.387 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2024-09-12T01:03:50.587 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:50.587 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2024-09-12T01:03:50.987 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:50.987 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2024-09-12T01:03:51.187 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:51.187 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2024-09-12T01:03:51.487 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:51.487 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2024-09-12T01:03:51.687 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:51.688 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2024-09-12T01:03:52.087 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:52.087 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2024-09-12T01:03:52.287 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:52.287 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2024-09-12T01:03:52.687 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:52.687 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2024-09-12T01:03:52.887 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:52.887 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2024-09-12T01:03:53.287 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:53.287 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2024-09-12T01:03:53.487 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:53.487 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2024-09-12T01:03:53.787 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:53.787 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2024-09-12T01:03:53.987 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:53.987 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2024-09-12T01:03:54.387 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:54.387 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2024-09-12T01:03:54.587 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:54.587 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2024-09-12T01:03:54.888 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:54.888 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2024-09-12T01:03:55.087 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:55.087 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2024-09-12T01:03:55.487 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:55.487 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2024-09-12T01:03:55.587 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:55.587 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2024-09-12T01:03:55.987 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:55.987 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2024-09-12T01:03:56.187 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:56.187 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2024-09-12T01:03:56.487 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:56.487 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2024-09-12T01:03:56.587 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:56.587 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2024-09-12T01:03:56.887 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:56.888 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2024-09-12T01:03:56.987 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:56.987 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2024-09-12T01:03:57.187 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:57.187 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2024-09-12T01:03:57.287 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:57.288 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2024-09-12T01:03:57.587 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:57.588 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2024-09-12T01:03:57.687 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:57.688 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2024-09-12T01:03:57.987 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:57.987 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2024-09-12T01:03:58.287 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:58.287 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2024-09-12T01:03:58.587 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:58.587 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2024-09-12T01:03:58.587 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:58.587 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2024-09-12T01:03:58.687 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:58.687 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2024-09-12T01:03:58.887 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:58.887 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2024-09-12T01:03:59.187 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:59.187 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2024-09-12T01:03:59.287 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:59.287 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2024-09-12T01:03:59.587 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:59.587 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2024-09-12T01:03:59.787 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:03:59.787 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2024-09-12T01:04:00.087 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:04:00.087 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2024-09-12T01:04:00.187 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:04:00.187 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2024-09-12T01:04:00.387 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:04:00.387 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2024-09-12T01:04:05.587 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:04:05.588 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2024-09-12T01:04:05.887 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:04:05.887 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2024-09-12T01:04:10.787 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:04:10.787 INFO:teuthology.orchestra.run.smithi073.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2024-09-12T01:04:11.127 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:04:11.127 INFO:teuthology.orchestra.run.smithi073.stdout:---------------------------------------------------------------------- 2024-09-12T01:04:11.127 INFO:teuthology.orchestra.run.smithi073.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2024-09-12T01:04:11.127 INFO:teuthology.orchestra.run.smithi073.stdout:---------------------------------------------------------------------- 2024-09-12T01:04:11.128 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:04:11.128 INFO:teuthology.orchestra.run.smithi073.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T01:04:11.128 INFO:teuthology.orchestra.run.smithi073.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T01:04:11.128 INFO:teuthology.orchestra.run.smithi073.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T01:04:11.128 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:04:11.128 INFO:teuthology.orchestra.run.smithi073.stdout:BUILD SUCCESSFUL in 3m 6s 2024-09-12T01:04:11.128 INFO:teuthology.orchestra.run.smithi073.stdout:5 actionable tasks: 5 executed 2024-09-12T01:04:11.142 DEBUG:teuthology.orchestra.run.smithi073:> radosgw-admin gc process --include-all 2024-09-12T01:04:11.194 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:04:11.194 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:04:11.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.233+0000 7f3a45a2f800 20 rados->read ofs=0 len=0 2024-09-12T01:04:11.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.234+0000 7f3a45a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:11.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.234+0000 7f3a45a2f800 20 realm 2024-09-12T01:04:11.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.234+0000 7f3a45a2f800 20 rados->read ofs=0 len=0 2024-09-12T01:04:11.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.234+0000 7f3a45a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:11.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.234+0000 7f3a45a2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:04:11.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.234+0000 7f3a45a2f800 20 rados->read ofs=0 len=0 2024-09-12T01:04:11.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.234+0000 7f3a45a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:11.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.234+0000 7f3a45a2f800 20 rados->read ofs=0 len=0 2024-09-12T01:04:11.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.235+0000 7f3a45a2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:11.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.235+0000 7f3a45a2f800 20 rados->read ofs=0 len=0 2024-09-12T01:04:11.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.236+0000 7f3a45a2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:04:11.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.236+0000 7f3a45a2f800 20 searching for the correct realm 2024-09-12T01:04:11.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.239+0000 7f3a43d1a640 0 -- 172.21.15.73:0/3494639174 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f3a2c064040 msgr2=0x7f3a2c0c6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:11.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.446+0000 7f3a43d1a640 0 -- 172.21.15.73:0/3494639174 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f3a2c064040 msgr2=0x7f3a2c0c6a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:11.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.450+0000 7f3a45a2f800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T01:04:11.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.450+0000 7f3a45a2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:04:11.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.450+0000 7f3a45a2f800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T01:04:11.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.450+0000 7f3a45a2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:04:11.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.450+0000 7f3a45a2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:04:11.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.450+0000 7f3a45a2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:04:11.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.450+0000 7f3a45a2f800 20 rados->read ofs=0 len=0 2024-09-12T01:04:11.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.450+0000 7f3a45a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:11.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.450+0000 7f3a45a2f800 20 rados->read ofs=0 len=0 2024-09-12T01:04:11.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.451+0000 7f3a45a2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:11.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.451+0000 7f3a45a2f800 20 rados->read ofs=0 len=0 2024-09-12T01:04:11.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.451+0000 7f3a45a2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:04:11.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.451+0000 7f3a45a2f800 20 zone default found 2024-09-12T01:04:11.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.451+0000 7f3a45a2f800 4 Realm: () 2024-09-12T01:04:11.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.451+0000 7f3a45a2f800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T01:04:11.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.451+0000 7f3a45a2f800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T01:04:11.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.451+0000 7f3a45a2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:04:11.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.451+0000 7f3a45a2f800 20 zonegroup default 2024-09-12T01:04:11.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.451+0000 7f3a45a2f800 20 rados->read ofs=0 len=0 2024-09-12T01:04:11.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.451+0000 7f3a45a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:11.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.451+0000 7f3a45a2f800 20 rados->read ofs=0 len=0 2024-09-12T01:04:11.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.451+0000 7f3a45a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:11.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.451+0000 7f3a45a2f800 20 rados->read ofs=0 len=0 2024-09-12T01:04:11.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.452+0000 7f3a45a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:11.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.452+0000 7f3a45a2f800 20 started sync module instance, tier type = 2024-09-12T01:04:11.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.452+0000 7f3a45a2f800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T01:04:11.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.461+0000 7f3a45a2f800 20 add_watcher() i=0 2024-09-12T01:04:11.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.461+0000 7f3a45a2f800 20 add_watcher() i=1 2024-09-12T01:04:11.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.461+0000 7f3a45a2f800 20 add_watcher() i=2 2024-09-12T01:04:11.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.461+0000 7f3a45a2f800 20 add_watcher() i=3 2024-09-12T01:04:11.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.461+0000 7f3a45a2f800 20 add_watcher() i=4 2024-09-12T01:04:11.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.461+0000 7f3a45a2f800 20 add_watcher() i=5 2024-09-12T01:04:11.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.461+0000 7f3a45a2f800 20 add_watcher() i=6 2024-09-12T01:04:11.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.462+0000 7f3a45a2f800 20 add_watcher() i=7 2024-09-12T01:04:11.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.462+0000 7f3a45a2f800 2 all 8 watchers are set, enabling cache 2024-09-12T01:04:11.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.464+0000 7f38f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:11.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.464+0000 7f3a45a2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:04:11.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.464+0000 7f3a45a2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:04:11.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.499+0000 7f38f8fe1640 20 reqs_thread_entry: start 2024-09-12T01:04:11.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.499+0000 7f3a45a2f800 20 init_complete bucket index max shards: 1 2024-09-12T01:04:11.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.499+0000 7f3a45a2f800 20 Filter name: none 2024-09-12T01:04:11.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.499+0000 7f38727fc640 20 reqs_thread_entry: start 2024-09-12T01:04:11.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.499+0000 7f3a45a2f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T01:04:11.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.501+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:11.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.501+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:11.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.501+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T01:04:11.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.501+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2593184564590237995', time=2024-09-12T03:03:24.795469+0000, chain.objs.size()=1 2024-09-12T01:04:11.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.501+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.103__shadow_.GuGoyQrHU8qs6EpQrgBqWOSUwQylpX4_0 2024-09-12T01:04:11.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.501+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5840549790402832226', time=2024-09-12T03:03:28.109274+0000, chain.objs.size()=5 2024-09-12T01:04:11.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.501+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.103__multipart_key1.2~MnXlx0lRKKk7nBfAXth9p2pYCycX2Hp.1 2024-09-12T01:04:11.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.501+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.103__multipart_key1.2~MnXlx0lRKKk7nBfAXth9p2pYCycX2Hp.2 2024-09-12T01:04:11.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.501+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.103__multipart_key1.2~MnXlx0lRKKk7nBfAXth9p2pYCycX2Hp.3 2024-09-12T01:04:11.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.501+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.103__multipart_key1.2~MnXlx0lRKKk7nBfAXth9p2pYCycX2Hp.4 2024-09-12T01:04:11.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.502+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.103__multipart_key1.2~MnXlx0lRKKk7nBfAXth9p2pYCycX2Hp.5 2024-09-12T01:04:11.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.502+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12209567201897031919', time=2024-09-12T03:03:44.291712+0000, chain.objs.size()=1 2024-09-12T01:04:11.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.502+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.112__shadow_.ab-n2xVQqpiMxdJ9KAJbYWhXgzUkl_r_0 2024-09-12T01:04:11.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.502+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10816269103327832274', time=2024-09-12T03:03:44.873420+0000, chain.objs.size()=1 2024-09-12T01:04:11.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.502+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.113__shadow_.hk-owdcPWOAPOYxUkwG7iwB7x8bS3NH_0 2024-09-12T01:04:11.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.502+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17085426764491191209', time=2024-09-12T03:03:58.188760+0000, chain.objs.size()=1 2024-09-12T01:04:11.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.502+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.138__shadow_.isIFbSIj-EPPkFBX5VItRWTchf1qJWt_0 2024-09-12T01:04:11.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.502+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10292581979307662484', time=2024-09-12T03:04:10.881923+0000, chain.objs.size()=5 2024-09-12T01:04:11.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.502+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.144__multipart_key1/data/file.mpg.2~Ekdgx3LoBuJY44Um_5N6hgAopwYZi2W.1 2024-09-12T01:04:11.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.502+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.144__multipart_key1/data/file.mpg.2~Ekdgx3LoBuJY44Um_5N6hgAopwYZi2W.2 2024-09-12T01:04:11.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.502+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.144__multipart_key1/data/file.mpg.2~Ekdgx3LoBuJY44Um_5N6hgAopwYZi2W.3 2024-09-12T01:04:11.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.504+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.144__multipart_key1/data/file.mpg.2~Ekdgx3LoBuJY44Um_5N6hgAopwYZi2W.4 2024-09-12T01:04:11.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.507+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.144__multipart_key1/data/file.mpg.2~Ekdgx3LoBuJY44Um_5N6hgAopwYZi2W.5 2024-09-12T01:04:11.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.509+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:11.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.511+0000 7f3a45a2f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T01:04:11.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.512+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:11.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.513+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:11.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.513+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T01:04:11.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.513+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14297927893454828840', time=2024-09-12T03:03:41.955115+0000, chain.objs.size()=1 2024-09-12T01:04:11.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.513+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.106__shadow_.gtK_EYN_sjl_vX8pA2CStvQ5k53LhnR_0 2024-09-12T01:04:11.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.513+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8375391777800037392', time=2024-09-12T03:03:46.712905+0000, chain.objs.size()=1 2024-09-12T01:04:11.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.513+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.116__shadow_.KwpSHFy3MnLsLzpLFRNIxj7y0ONi8fx_0 2024-09-12T01:04:11.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.513+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16911807189761751071', time=2024-09-12T03:03:57.783742+0000, chain.objs.size()=1 2024-09-12T01:04:11.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.513+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.137__shadow_.KnwQp-Ipr5k1s4dtQxICzeOg_iC-s60_0 2024-09-12T01:04:11.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.513+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10336116108493550638', time=2024-09-12T03:03:59.342076+0000, chain.objs.size()=1 2024-09-12T01:04:11.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.513+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.140__shadow_.0j2VzC35htC0uqt-IYL5nH61uAxvdnv_0 2024-09-12T01:04:11.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.515+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:11.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.517+0000 7f3a45a2f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T01:04:11.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.518+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:11.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.518+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:11.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.519+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T01:04:11.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.519+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17367616804511973480', time=2024-09-12T03:01:52.998712+0000, chain.objs.size()=5 2024-09-12T01:04:11.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.519+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.94__multipart_key1.2~dUHTxBZoiUADcIfSZjZHV5vfV8JAOPy.1 2024-09-12T01:04:11.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.519+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.94__multipart_key1.2~dUHTxBZoiUADcIfSZjZHV5vfV8JAOPy.2 2024-09-12T01:04:11.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.519+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.94__multipart_key1.2~dUHTxBZoiUADcIfSZjZHV5vfV8JAOPy.3 2024-09-12T01:04:11.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.519+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.94__multipart_key1.2~dUHTxBZoiUADcIfSZjZHV5vfV8JAOPy.4 2024-09-12T01:04:11.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.519+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.94__multipart_key1.2~dUHTxBZoiUADcIfSZjZHV5vfV8JAOPy.5 2024-09-12T01:04:11.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.519+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16875449672080155205', time=2024-09-12T03:03:19.509854+0000, chain.objs.size()=5 2024-09-12T01:04:11.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.519+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.102__multipart_key1.2~EQyhHfmVQGeA1P3ECOr2wKojBm2Svuc.1 2024-09-12T01:04:11.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.519+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.102__shadow_key1.2~EQyhHfmVQGeA1P3ECOr2wKojBm2Svuc.1_1 2024-09-12T01:04:11.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.519+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.102__multipart_key1.2~EQyhHfmVQGeA1P3ECOr2wKojBm2Svuc.2 2024-09-12T01:04:11.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.519+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.102__shadow_key1.2~EQyhHfmVQGeA1P3ECOr2wKojBm2Svuc.2_1 2024-09-12T01:04:11.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.519+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.102__multipart_key1.2~EQyhHfmVQGeA1P3ECOr2wKojBm2Svuc.3 2024-09-12T01:04:11.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.519+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16219071007636528127', time=2024-09-12T03:03:53.588347+0000, chain.objs.size()=1 2024-09-12T01:04:11.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.519+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.128__shadow_.y9EuAKTTeN2LeF9tuorggYRaMjvUbpM_0 2024-09-12T01:04:11.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.519+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13240041888396469991', time=2024-09-12T03:03:54.658453+0000, chain.objs.size()=1 2024-09-12T01:04:11.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.519+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.130__shadow_.qq_pBLhkZCaEvcKaHvVTNOa9NxKal85_0 2024-09-12T01:04:11.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.522+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14940710434027126457', time=2024-09-12T03:03:55.213158+0000, chain.objs.size()=1 2024-09-12T01:04:11.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.522+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.131__shadow_.Pt1Zljimqexr4dylOIeClefNwEMg1IC_0 2024-09-12T01:04:11.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.524+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:11.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.526+0000 7f3a45a2f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T01:04:11.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.527+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:11.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.528+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:11.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.528+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-12T01:04:11.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.528+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11875491671865696939', time=2024-09-12T03:01:24.183697+0000, chain.objs.size()=1 2024-09-12T01:04:11.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.528+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.90__shadow_.ywUDR0nu_mZS0O9AES0ZMTypkOUKfwb_0 2024-09-12T01:04:11.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.528+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7225407862148647046', time=2024-09-12T03:02:36.340370+0000, chain.objs.size()=5 2024-09-12T01:04:11.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.528+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.100__multipart_file.mpg.2~ghb3jyH0bPOzJ8CdIAF_yOFSAy1D2x7.1 2024-09-12T01:04:11.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.528+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.100__multipart_file.mpg.2~ghb3jyH0bPOzJ8CdIAF_yOFSAy1D2x7.2 2024-09-12T01:04:11.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.528+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.100__multipart_file.mpg.2~ghb3jyH0bPOzJ8CdIAF_yOFSAy1D2x7.3 2024-09-12T01:04:11.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.528+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.100__multipart_file.mpg.2~ghb3jyH0bPOzJ8CdIAF_yOFSAy1D2x7.4 2024-09-12T01:04:11.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.528+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.100__multipart_file.mpg.2~ghb3jyH0bPOzJ8CdIAF_yOFSAy1D2x7.5 2024-09-12T01:04:11.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.528+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14723622233170615571', time=2024-09-12T03:03:44.925159+0000, chain.objs.size()=1 2024-09-12T01:04:11.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.528+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.113__shadow_.J48FJgrEgkWE0LzQrz_nbBIR-cFKjSW_0 2024-09-12T01:04:11.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.528+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15644503017940291235', time=2024-09-12T03:03:49.589109+0000, chain.objs.size()=1 2024-09-12T01:04:11.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.528+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.121__shadow_.SzmOyBMNlFyHAwVuUASrD8Vdvs1TXuh_0 2024-09-12T01:04:11.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.528+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3237594375778397651', time=2024-09-12T03:03:50.750733+0000, chain.objs.size()=1 2024-09-12T01:04:11.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.528+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.123__shadow_.cJZKxQI6xaxO_diYAuiAAZpsoepndE4_0 2024-09-12T01:04:11.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.528+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4505601877620753582', time=2024-09-12T03:03:51.234057+0000, chain.objs.size()=1 2024-09-12T01:04:11.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.528+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.124__shadow_.awT7VFBq8cRJzj44dw0INDZhMTFD8Uc_0 2024-09-12T01:04:11.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.528+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9080622401031630402', time=2024-09-12T03:03:53.011846+0000, chain.objs.size()=1 2024-09-12T01:04:11.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.528+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.127__shadow_.DmS2-f4ueoQG23v0kQVQDxyxe81n6RA_0 2024-09-12T01:04:11.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.528+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8399373782950333526', time=2024-09-12T03:03:54.710359+0000, chain.objs.size()=1 2024-09-12T01:04:11.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.528+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.130__shadow_.H5KMd3Ds_NcRMwG8NbMLDEfWG-Fz1jO_0 2024-09-12T01:04:11.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.531+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3049919217308157831', time=2024-09-12T03:03:58.102322+0000, chain.objs.size()=1 2024-09-12T01:04:11.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.531+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.138__shadow_.zXPpnBTwfxJkbRTwX3YwHgjeUoSBapU_0 2024-09-12T01:04:11.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.533+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:11.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.535+0000 7f3a45a2f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T01:04:11.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.536+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:11.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.537+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:11.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.537+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T01:04:11.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.537+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.985151536963584725', time=2024-09-12T03:01:21.584935+0000, chain.objs.size()=2 2024-09-12T01:04:11.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.537+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.83__shadow_.IW4UCCX6P1L_7BEOxgltUtuihQ_irV0_0 2024-09-12T01:04:11.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.537+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.83__shadow_.IW4UCCX6P1L_7BEOxgltUtuihQ_irV0_1 2024-09-12T01:04:11.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.537+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3972766436030256442', time=2024-09-12T03:03:45.486511+0000, chain.objs.size()=1 2024-09-12T01:04:11.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.537+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.114__shadow_.3_r78gyiWBjw7pK1N205sxo_EN9cYzL_0 2024-09-12T01:04:11.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.537+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13693175079774451799', time=2024-09-12T03:03:49.616234+0000, chain.objs.size()=1 2024-09-12T01:04:11.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.537+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.121__shadow_.pA8NJ6p-zDHFt39qoCMO2ToMTKyhfN__0 2024-09-12T01:04:11.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.540+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:11.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.542+0000 7f3a45a2f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T01:04:11.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.543+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:11.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.544+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:11.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.544+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:11.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.545+0000 7f3a45a2f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T01:04:11.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.546+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:11.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.546+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:11.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.547+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T01:04:11.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.547+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9582284848452023092', time=2024-09-12T03:01:30.175618+0000, chain.objs.size()=5 2024-09-12T01:04:11.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.547+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.91__multipart_key1.2~dw0z0_1N22LS6-rkM7a4lnmYTogP2_k.1 2024-09-12T01:04:11.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.547+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.91__multipart_key1.2~dw0z0_1N22LS6-rkM7a4lnmYTogP2_k.2 2024-09-12T01:04:11.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.547+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.91__multipart_key1.2~dw0z0_1N22LS6-rkM7a4lnmYTogP2_k.3 2024-09-12T01:04:11.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.547+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.91__multipart_key1.2~dw0z0_1N22LS6-rkM7a4lnmYTogP2_k.4 2024-09-12T01:04:11.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.547+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.91__multipart_key1.2~dw0z0_1N22LS6-rkM7a4lnmYTogP2_k.5 2024-09-12T01:04:11.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.547+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11349248156863623336', time=2024-09-12T03:03:50.697600+0000, chain.objs.size()=1 2024-09-12T01:04:11.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.547+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.123__shadow_.uos85RGyzTO0Df9B-QN2_pDRPFY7z4S_0 2024-09-12T01:04:11.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.547+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16382339907209444880', time=2024-09-12T03:03:56.272930+0000, chain.objs.size()=1 2024-09-12T01:04:11.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.547+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.133__shadow_._J4-O0Ir5o66zubTyCL26Kh8j5odTHZ_0 2024-09-12T01:04:11.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.549+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:11.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.551+0000 7f3a45a2f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T01:04:11.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.552+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:11.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.552+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:11.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.553+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T01:04:11.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.553+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1086233363229764158', time=2024-09-12T03:01:56.158461+0000, chain.objs.size()=5 2024-09-12T01:04:11.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.553+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.94__multipart_key1.2~QyiheW0A2oNL1FGzGLV0azN0RE3az1c.1 2024-09-12T01:04:11.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.553+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.94__multipart_key1.2~QyiheW0A2oNL1FGzGLV0azN0RE3az1c.2 2024-09-12T01:04:11.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.553+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.94__multipart_key1.2~QyiheW0A2oNL1FGzGLV0azN0RE3az1c.3 2024-09-12T01:04:11.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.553+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.94__multipart_key1.2~QyiheW0A2oNL1FGzGLV0azN0RE3az1c.4 2024-09-12T01:04:11.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.553+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.94__multipart_key1.2~QyiheW0A2oNL1FGzGLV0azN0RE3az1c.5 2024-09-12T01:04:11.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.553+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1860940511683706467', time=2024-09-12T03:03:14.896707+0000, chain.objs.size()=5 2024-09-12T01:04:11.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.553+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.102__multipart_key1.2~y3uu0-Zaq9fGGsJA8eoMwowxOomKTsa.1 2024-09-12T01:04:11.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.553+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.102__shadow_key1.2~y3uu0-Zaq9fGGsJA8eoMwowxOomKTsa.1_1 2024-09-12T01:04:11.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.553+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.102__multipart_key1.2~y3uu0-Zaq9fGGsJA8eoMwowxOomKTsa.2 2024-09-12T01:04:11.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.553+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.102__shadow_key1.2~y3uu0-Zaq9fGGsJA8eoMwowxOomKTsa.2_1 2024-09-12T01:04:11.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.553+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.102__multipart_key1.2~y3uu0-Zaq9fGGsJA8eoMwowxOomKTsa.3 2024-09-12T01:04:11.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.553+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14086960481209841468', time=2024-09-12T03:03:49.027292+0000, chain.objs.size()=1 2024-09-12T01:04:11.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.553+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.120__shadow_.s2KBByAPT6ietP6e-2ouVbsk0WMAqLD_0 2024-09-12T01:04:11.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.557+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:11.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.559+0000 7f3a45a2f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T01:04:11.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.560+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:11.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.561+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:11.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.561+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:11.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.562+0000 7f3a45a2f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T01:04:11.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.563+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:11.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.564+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:11.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.564+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T01:04:11.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.564+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16536621042788401922', time=2024-09-12T03:03:47.808911+0000, chain.objs.size()=1 2024-09-12T01:04:11.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.564+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.118__shadow_.2_uWLDJZi65IuaavrBgLMA0XhQl0mZz_0 2024-09-12T01:04:11.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.564+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2026827714676587023', time=2024-09-12T03:03:50.167302+0000, chain.objs.size()=1 2024-09-12T01:04:11.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.564+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.122__shadow_.Y0WGX90_3kbp1MvRfnx8_TkFa4jk22D_0 2024-09-12T01:04:11.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.564+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4422078874059542127', time=2024-09-12T03:03:51.795331+0000, chain.objs.size()=1 2024-09-12T01:04:11.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.564+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.125__shadow_.kqXqV1YoD671-z-EkuZ1-jmz-9JRep6_0 2024-09-12T01:04:11.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.564+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9847767135229881262', time=2024-09-12T03:03:58.923997+0000, chain.objs.size()=1 2024-09-12T01:04:11.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.564+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.139__shadow_.JFEmcDiMtPpYJ8rs-8V8YegdXJKRU98_0 2024-09-12T01:04:11.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.565+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:11.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.567+0000 7f3a45a2f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T01:04:11.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.569+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:11.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.569+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:11.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.569+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T01:04:11.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.569+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5423548349983788782', time=2024-09-12T03:02:02.290030+0000, chain.objs.size()=5 2024-09-12T01:04:11.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.569+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.94__multipart_key1.2~OHgtIXBYej1VyHVuDgwGSxS_vwG_kmm.1 2024-09-12T01:04:11.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.569+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.94__shadow_key1.2~OHgtIXBYej1VyHVuDgwGSxS_vwG_kmm.1_1 2024-09-12T01:04:11.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.569+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.94__multipart_key1.2~OHgtIXBYej1VyHVuDgwGSxS_vwG_kmm.2 2024-09-12T01:04:11.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.569+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.94__shadow_key1.2~OHgtIXBYej1VyHVuDgwGSxS_vwG_kmm.2_1 2024-09-12T01:04:11.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.569+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.94__multipart_key1.2~OHgtIXBYej1VyHVuDgwGSxS_vwG_kmm.3 2024-09-12T01:04:11.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.569+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7418695564593149358', time=2024-09-12T03:03:47.221184+0000, chain.objs.size()=1 2024-09-12T01:04:11.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.569+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.117__shadow_.AyqC3MZZ7Z5AwH2ZHVbnhlvuuO-sk0p_0 2024-09-12T01:04:11.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.569+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10034264061134014049', time=2024-09-12T03:03:47.252275+0000, chain.objs.size()=1 2024-09-12T01:04:11.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.569+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.117__shadow_.raWIgTrPttX-R9HzM1K07i9PSV1DsrG_0 2024-09-12T01:04:11.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.569+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4641320528240476790', time=2024-09-12T03:03:47.305631+0000, chain.objs.size()=1 2024-09-12T01:04:11.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.569+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.117__shadow_.IcsGDZFC5fBUmiWecdCtaF9wGU6nffP_0 2024-09-12T01:04:11.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.572+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:11.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.575+0000 7f3a45a2f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T01:04:11.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.576+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:11.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.577+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:11.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.577+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T01:04:11.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.577+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18214410971149064524', time=2024-09-12T03:03:44.951134+0000, chain.objs.size()=1 2024-09-12T01:04:11.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.577+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.113__shadow_.UW87m0xd7yvhb0EuB6o87f4gTfNPPV7_0 2024-09-12T01:04:11.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.577+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3792200122540014042', time=2024-09-12T03:03:46.635288+0000, chain.objs.size()=1 2024-09-12T01:04:11.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.577+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.116__shadow_.HVttQb_Ma7qHYOPQdIwFOJ4Rk_I5DQL_0 2024-09-12T01:04:11.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.578+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:11.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.581+0000 7f3a45a2f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T01:04:11.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.582+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:11.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.583+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:11.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.583+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:04:11.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.583+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7294881441000358023', time=2024-09-12T03:02:36.394110+0000, chain.objs.size()=5 2024-09-12T01:04:11.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.583+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.100__multipart_file2.mpg.2~yDueAFTeKd4Vq2rUIJOL3UWK7ppUW19.1 2024-09-12T01:04:11.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.583+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.100__multipart_file2.mpg.2~yDueAFTeKd4Vq2rUIJOL3UWK7ppUW19.2 2024-09-12T01:04:11.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.583+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.100__multipart_file2.mpg.2~yDueAFTeKd4Vq2rUIJOL3UWK7ppUW19.3 2024-09-12T01:04:11.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.583+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.100__multipart_file2.mpg.2~yDueAFTeKd4Vq2rUIJOL3UWK7ppUW19.4 2024-09-12T01:04:11.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.583+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.100__multipart_file2.mpg.2~yDueAFTeKd4Vq2rUIJOL3UWK7ppUW19.5 2024-09-12T01:04:11.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.585+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:11.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.587+0000 7f3a45a2f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T01:04:11.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.588+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:11.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.589+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:11.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.589+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T01:04:11.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.589+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10774140639891043377', time=2024-09-12T03:02:52.116612+0000, chain.objs.size()=5 2024-09-12T01:04:11.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.589+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.102__multipart_key1.2~c0hJOtPB_a4vMyG-CTft7RxrOUeLD3q.1 2024-09-12T01:04:11.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.589+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.102__multipart_key1.2~c0hJOtPB_a4vMyG-CTft7RxrOUeLD3q.2 2024-09-12T01:04:11.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.589+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.102__multipart_key1.2~c0hJOtPB_a4vMyG-CTft7RxrOUeLD3q.3 2024-09-12T01:04:11.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.589+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.102__multipart_key1.2~c0hJOtPB_a4vMyG-CTft7RxrOUeLD3q.4 2024-09-12T01:04:11.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.589+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.102__multipart_key1.2~c0hJOtPB_a4vMyG-CTft7RxrOUeLD3q.5 2024-09-12T01:04:11.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.589+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16327264846445873155', time=2024-09-12T03:03:44.317217+0000, chain.objs.size()=1 2024-09-12T01:04:11.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.589+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.112__shadow_.NDQnKNwTvXhPAaT1ZWkxcuusF8uIyAw_0 2024-09-12T01:04:11.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.589+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12331024138797440174', time=2024-09-12T03:03:44.344666+0000, chain.objs.size()=1 2024-09-12T01:04:11.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.589+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.112__shadow_.X6L5MEfOHqsmd-tC1Pd5eoV7m9bCSlW_0 2024-09-12T01:04:11.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.589+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10399818866145094858', time=2024-09-12T03:03:49.562797+0000, chain.objs.size()=1 2024-09-12T01:04:11.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.589+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.121__shadow_.uH5HnR5wSIPgJARu0-h6r-I3Y9zvNgL_0 2024-09-12T01:04:11.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.592+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:11.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.594+0000 7f3a45a2f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T01:04:11.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.595+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:11.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.596+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:11.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.596+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T01:04:11.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.596+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11371948331878459264', time=2024-09-12T03:02:02.090649+0000, chain.objs.size()=4 2024-09-12T01:04:11.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.596+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.93__shadow_.DZgfsRsUjQV7vFeMeKQigRomT7yZiOc_0 2024-09-12T01:04:11.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.596+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.93__shadow_.DZgfsRsUjQV7vFeMeKQigRomT7yZiOc_1 2024-09-12T01:04:11.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.596+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.93__shadow_.DZgfsRsUjQV7vFeMeKQigRomT7yZiOc_2 2024-09-12T01:04:11.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.596+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.93__shadow_.DZgfsRsUjQV7vFeMeKQigRomT7yZiOc_3 2024-09-12T01:04:11.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.596+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1145406778283106763', time=2024-09-12T03:03:54.136016+0000, chain.objs.size()=1 2024-09-12T01:04:11.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.596+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.129__shadow_.mYO4oku5T4Xt_Xeka-wkf0rSGMB7Jx8_0 2024-09-12T01:04:11.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.599+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:11.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.601+0000 7f3a45a2f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T01:04:11.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.603+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:11.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.603+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:11.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.603+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T01:04:11.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.603+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1536146667590848755', time=2024-09-12T03:01:08.944743+0000, chain.objs.size()=1 2024-09-12T01:04:11.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.603+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.77__shadow_.3SURUAdjEXlwP2aPsxOaIcaNVdD2eG__0 2024-09-12T01:04:11.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.603+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18142334507930625478', time=2024-09-12T03:01:29.982931+0000, chain.objs.size()=5 2024-09-12T01:04:11.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.603+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.91__multipart_key1.2~dw0z0_1N22LS6-rkM7a4lnmYTogP2_k.1 2024-09-12T01:04:11.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.603+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.91__multipart_key1.2~dw0z0_1N22LS6-rkM7a4lnmYTogP2_k.2 2024-09-12T01:04:11.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.603+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.91__multipart_key1.2~dw0z0_1N22LS6-rkM7a4lnmYTogP2_k.3 2024-09-12T01:04:11.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.603+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.91__multipart_key1.2~dw0z0_1N22LS6-rkM7a4lnmYTogP2_k.4 2024-09-12T01:04:11.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.603+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.91__multipart_key1.2~dw0z0_1N22LS6-rkM7a4lnmYTogP2_k.5 2024-09-12T01:04:11.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.603+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10167780261058977832', time=2024-09-12T03:03:57.395676+0000, chain.objs.size()=1 2024-09-12T01:04:11.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.603+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.136__shadow_.P38HElQt4zucfwJl5oaSdYNIp6a3eu5_0 2024-09-12T01:04:11.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.608+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:11.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.610+0000 7f3a45a2f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T01:04:11.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.612+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:11.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.612+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:11.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.613+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T01:04:11.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.613+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13547102277194988606', time=2024-09-12T03:03:47.837878+0000, chain.objs.size()=1 2024-09-12T01:04:11.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.613+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.118__shadow_.arlojc7Y3J5OlEtiwdwyOhiEZ7ALF0a_0 2024-09-12T01:04:11.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.613+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9856729097005898178', time=2024-09-12T03:03:47.889591+0000, chain.objs.size()=1 2024-09-12T01:04:11.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.613+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.118__shadow_.-fXr65EnTry01KDrxOyDBqbDVYGfYk0_0 2024-09-12T01:04:11.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.613+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17825198150086030785', time=2024-09-12T03:03:48.975545+0000, chain.objs.size()=1 2024-09-12T01:04:11.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.613+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.120__shadow_.CS_ZmphwdVYpQYS5-YcfDaTg1pPZfP4_0 2024-09-12T01:04:11.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.613+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7453430703664915119', time=2024-09-12T03:03:55.760875+0000, chain.objs.size()=1 2024-09-12T01:04:11.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.613+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.132__shadow_.W196u6-SsIO0idyg8KfgprlTRKqGTx3_0 2024-09-12T01:04:11.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.614+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:11.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.617+0000 7f3a45a2f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T01:04:11.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.618+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:11.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.619+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:11.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.619+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T01:04:11.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.619+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1009757311537994210', time=2024-09-12T03:01:22.025917+0000, chain.objs.size()=1 2024-09-12T01:04:11.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.619+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.84__shadow_.yGZUXFZxXkDGO_6SafNZxYd6hTUopU4_0 2024-09-12T01:04:11.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.619+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15929568642672825780', time=2024-09-12T03:01:59.346842+0000, chain.objs.size()=5 2024-09-12T01:04:11.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.619+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.94__multipart_key1.2~ZxgP4PhQJ0B_vzVQ2W6JuQ5VFQ7MnUk.1 2024-09-12T01:04:11.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.619+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.94__shadow_key1.2~ZxgP4PhQJ0B_vzVQ2W6JuQ5VFQ7MnUk.1_1 2024-09-12T01:04:11.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.619+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.94__multipart_key1.2~ZxgP4PhQJ0B_vzVQ2W6JuQ5VFQ7MnUk.2 2024-09-12T01:04:11.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.619+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.94__shadow_key1.2~ZxgP4PhQJ0B_vzVQ2W6JuQ5VFQ7MnUk.2_1 2024-09-12T01:04:11.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.619+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.94__multipart_key1.2~ZxgP4PhQJ0B_vzVQ2W6JuQ5VFQ7MnUk.3 2024-09-12T01:04:11.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.619+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4816529779442848749', time=2024-09-12T03:03:10.270685+0000, chain.objs.size()=5 2024-09-12T01:04:11.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.619+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.102__multipart_key1.2~dLEqYl5hiHvoo3q984gkEKaezmBs60G.1 2024-09-12T01:04:11.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.619+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.102__multipart_key1.2~dLEqYl5hiHvoo3q984gkEKaezmBs60G.2 2024-09-12T01:04:11.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.619+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.102__multipart_key1.2~dLEqYl5hiHvoo3q984gkEKaezmBs60G.3 2024-09-12T01:04:11.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.619+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.102__multipart_key1.2~dLEqYl5hiHvoo3q984gkEKaezmBs60G.4 2024-09-12T01:04:11.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.619+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.102__multipart_key1.2~dLEqYl5hiHvoo3q984gkEKaezmBs60G.5 2024-09-12T01:04:11.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.619+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='2~s9LOL9NzFJfzop1K8FYkYdWgAkIMRQM', time=2024-09-12T03:03:38.049872+0000, chain.objs.size()=1 2024-09-12T01:04:11.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.619+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.105__multipart_key1.2~s9LOL9NzFJfzop1K8FYkYdWgAkIMRQM.13 2024-09-12T01:04:11.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.621+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='2~s9LOL9NzFJfzop1K8FYkYdWgAkIMRQM', time=2024-09-12T03:03:38.137008+0000, chain.objs.size()=1 2024-09-12T01:04:11.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.621+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.105__multipart_key1.2~s9LOL9NzFJfzop1K8FYkYdWgAkIMRQM.14 2024-09-12T01:04:11.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.622+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='2~s9LOL9NzFJfzop1K8FYkYdWgAkIMRQM', time=2024-09-12T03:03:38.252941+0000, chain.objs.size()=1 2024-09-12T01:04:11.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.622+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.105__multipart_key1.2~s9LOL9NzFJfzop1K8FYkYdWgAkIMRQM.15 2024-09-12T01:04:11.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.622+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='2~s9LOL9NzFJfzop1K8FYkYdWgAkIMRQM', time=2024-09-12T03:03:38.395674+0000, chain.objs.size()=1 2024-09-12T01:04:11.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.622+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.105__multipart_key1.2~s9LOL9NzFJfzop1K8FYkYdWgAkIMRQM.16 2024-09-12T01:04:11.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.622+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='2~s9LOL9NzFJfzop1K8FYkYdWgAkIMRQM', time=2024-09-12T03:03:38.502564+0000, chain.objs.size()=1 2024-09-12T01:04:11.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.622+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.105__multipart_key1.2~s9LOL9NzFJfzop1K8FYkYdWgAkIMRQM.17 2024-09-12T01:04:11.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.622+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='2~s9LOL9NzFJfzop1K8FYkYdWgAkIMRQM', time=2024-09-12T03:03:38.633729+0000, chain.objs.size()=1 2024-09-12T01:04:11.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.622+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.105__multipart_key1.2~s9LOL9NzFJfzop1K8FYkYdWgAkIMRQM.18 2024-09-12T01:04:11.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.623+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='2~s9LOL9NzFJfzop1K8FYkYdWgAkIMRQM', time=2024-09-12T03:03:38.670456+0000, chain.objs.size()=1 2024-09-12T01:04:11.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.623+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.105__multipart_key1.2~s9LOL9NzFJfzop1K8FYkYdWgAkIMRQM.19 2024-09-12T01:04:11.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.623+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='2~s9LOL9NzFJfzop1K8FYkYdWgAkIMRQM', time=2024-09-12T03:03:38.784803+0000, chain.objs.size()=1 2024-09-12T01:04:11.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.623+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.105__multipart_key1.2~s9LOL9NzFJfzop1K8FYkYdWgAkIMRQM.20 2024-09-12T01:04:11.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.623+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='2~s9LOL9NzFJfzop1K8FYkYdWgAkIMRQM', time=2024-09-12T03:03:38.863111+0000, chain.objs.size()=31 2024-09-12T01:04:11.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.623+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.105__multipart_key1.2~s9LOL9NzFJfzop1K8FYkYdWgAkIMRQM.1 2024-09-12T01:04:11.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.623+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.105__multipart_key1.2~s9LOL9NzFJfzop1K8FYkYdWgAkIMRQM.2 2024-09-12T01:04:11.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.623+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.105__multipart_key1.2~s9LOL9NzFJfzop1K8FYkYdWgAkIMRQM.3 2024-09-12T01:04:11.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.623+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.105__multipart_key1.2~s9LOL9NzFJfzop1K8FYkYdWgAkIMRQM.4 2024-09-12T01:04:11.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.623+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.105__multipart_key1.2~s9LOL9NzFJfzop1K8FYkYdWgAkIMRQM.5 2024-09-12T01:04:11.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.624+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.105__multipart_key1.2~s9LOL9NzFJfzop1K8FYkYdWgAkIMRQM.6 2024-09-12T01:04:11.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.624+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.105__multipart_key1.2~s9LOL9NzFJfzop1K8FYkYdWgAkIMRQM.7 2024-09-12T01:04:11.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.625+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.105__multipart_key1.2~s9LOL9NzFJfzop1K8FYkYdWgAkIMRQM.8 2024-09-12T01:04:11.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.625+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.105__multipart_key1.2~s9LOL9NzFJfzop1K8FYkYdWgAkIMRQM.9 2024-09-12T01:04:11.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.625+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.105__multipart_key1.2~s9LOL9NzFJfzop1K8FYkYdWgAkIMRQM.10 2024-09-12T01:04:11.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.625+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.105__multipart_key1.2~s9LOL9NzFJfzop1K8FYkYdWgAkIMRQM.11 2024-09-12T01:04:11.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.625+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.105__multipart_key1.2~s9LOL9NzFJfzop1K8FYkYdWgAkIMRQM.12 2024-09-12T01:04:11.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.625+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.105__multipart_key1.UMYZr72wSjNFu4v4wvzjxgJC3n1q1mQ_.13 2024-09-12T01:04:11.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.626+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.105__multipart_key1.DLgxfjfKDi-Zdqtewn885CaDwD6BjYAH.14 2024-09-12T01:04:11.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.626+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.105__multipart_key1.Un7cLDKb4a_U0z3mjiBcg6qzwI8-TK5J.15 2024-09-12T01:04:11.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.626+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.105__multipart_key1.8YoywEJWKmsA70weGCsER2Zlm9o9IDFk.16 2024-09-12T01:04:11.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.626+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.105__multipart_key1.SBgZBEP88cmWu-3N2KtqT-k-yY0I_Bxd.17 2024-09-12T01:04:11.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.626+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.105__multipart_key1.udVA05N3EbiQ1a3QHeA_BeKQn2Vx1AAO.18 2024-09-12T01:04:11.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.626+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.105__multipart_key1.MLMXX_5oUhP59h6tN3UE-FVie2BjL3tf.19 2024-09-12T01:04:11.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.627+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.105__multipart_key1.-WYtg81-j0VbARtCJNdMTJQijPkcT3QJ.20 2024-09-12T01:04:11.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.627+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.105__multipart_key1.2~s9LOL9NzFJfzop1K8FYkYdWgAkIMRQM.21 2024-09-12T01:04:11.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.627+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.105__multipart_key1.2~s9LOL9NzFJfzop1K8FYkYdWgAkIMRQM.22 2024-09-12T01:04:11.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.628+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.105__multipart_key1.2~s9LOL9NzFJfzop1K8FYkYdWgAkIMRQM.23 2024-09-12T01:04:11.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.628+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.105__multipart_key1.2~s9LOL9NzFJfzop1K8FYkYdWgAkIMRQM.24 2024-09-12T01:04:11.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.628+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.105__multipart_key1.2~s9LOL9NzFJfzop1K8FYkYdWgAkIMRQM.25 2024-09-12T01:04:11.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.629+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.105__multipart_key1.2~s9LOL9NzFJfzop1K8FYkYdWgAkIMRQM.26 2024-09-12T01:04:11.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.629+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.105__multipart_key1.2~s9LOL9NzFJfzop1K8FYkYdWgAkIMRQM.27 2024-09-12T01:04:11.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.629+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.105__multipart_key1.2~s9LOL9NzFJfzop1K8FYkYdWgAkIMRQM.28 2024-09-12T01:04:11.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.629+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.105__multipart_key1.2~s9LOL9NzFJfzop1K8FYkYdWgAkIMRQM.29 2024-09-12T01:04:11.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.629+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.105__multipart_key1.2~s9LOL9NzFJfzop1K8FYkYdWgAkIMRQM.30 2024-09-12T01:04:11.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.629+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.105__multipart_key1.2~s9LOL9NzFJfzop1K8FYkYdWgAkIMRQM.31 2024-09-12T01:04:11.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.629+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.589508388721232505', time=2024-09-12T03:03:46.048809+0000, chain.objs.size()=1 2024-09-12T01:04:11.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.629+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.115__shadow_.DFefiAfMs4gY8vpimhG4LD-wHZSm08x_0 2024-09-12T01:04:11.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.630+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4757255610110752743', time=2024-09-12T03:04:10.907495+0000, chain.objs.size()=1 2024-09-12T01:04:11.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.630+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.144__shadow_.FyefWtRl3V6fh0qfa1r1yCBoTX_WesB_0 2024-09-12T01:04:11.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.631+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:11.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.633+0000 7f3a45a2f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T01:04:11.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.634+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:11.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.635+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:11.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.635+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T01:04:11.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.635+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10484785967123512458', time=2024-09-12T03:03:05.471870+0000, chain.objs.size()=5 2024-09-12T01:04:11.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.635+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.102__multipart_key1.2~hC9o3mHcub5EnefVUvD3xkLpdf5PdfT.1 2024-09-12T01:04:11.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.635+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.102__multipart_key1.2~hC9o3mHcub5EnefVUvD3xkLpdf5PdfT.2 2024-09-12T01:04:11.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.635+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.102__multipart_key1.2~hC9o3mHcub5EnefVUvD3xkLpdf5PdfT.3 2024-09-12T01:04:11.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.635+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.102__multipart_key1.2~hC9o3mHcub5EnefVUvD3xkLpdf5PdfT.4 2024-09-12T01:04:11.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.635+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.102__multipart_key1.2~hC9o3mHcub5EnefVUvD3xkLpdf5PdfT.5 2024-09-12T01:04:11.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.635+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16375934626327909738', time=2024-09-12T03:03:49.641798+0000, chain.objs.size()=1 2024-09-12T01:04:11.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.635+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.121__shadow_.rJs8YqN9xlPr_lX_JMS_JbX0-1euH8l_0 2024-09-12T01:04:11.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.635+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11134914756703386192', time=2024-09-12T03:03:52.460712+0000, chain.objs.size()=1 2024-09-12T01:04:11.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.635+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.126__shadow_.EjZJUgssvOkf2yaclIeM50oM6cIIvvR_0 2024-09-12T01:04:11.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.638+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:11.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.640+0000 7f3a45a2f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T01:04:11.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.641+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:11.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.642+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:11.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.642+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T01:04:11.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.642+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8188856982872916403', time=2024-09-12T03:01:49.769198+0000, chain.objs.size()=5 2024-09-12T01:04:11.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.642+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.94__multipart_key1.2~5_Ow5bkNRyxec02_djBo5flTTtV0uwp.1 2024-09-12T01:04:11.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.642+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.94__multipart_key1.2~5_Ow5bkNRyxec02_djBo5flTTtV0uwp.2 2024-09-12T01:04:11.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.642+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.94__multipart_key1.2~5_Ow5bkNRyxec02_djBo5flTTtV0uwp.3 2024-09-12T01:04:11.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.642+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.94__multipart_key1.2~5_Ow5bkNRyxec02_djBo5flTTtV0uwp.4 2024-09-12T01:04:11.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.642+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.94__multipart_key1.2~5_Ow5bkNRyxec02_djBo5flTTtV0uwp.5 2024-09-12T01:04:11.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.642+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12019288422467408651', time=2024-09-12T03:02:36.446977+0000, chain.objs.size()=1 2024-09-12T01:04:11.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.642+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.100__shadow_.oEoejG29cJ2BAe488bQdJvgCNCXz3zR_0 2024-09-12T01:04:11.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.642+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1364171459728360183', time=2024-09-12T03:03:51.260805+0000, chain.objs.size()=1 2024-09-12T01:04:11.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.642+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.124__shadow_.pyjIm0VPWK_4c5VAhWUUQmNvi2Xtg3J_0 2024-09-12T01:04:11.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.645+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:11.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.647+0000 7f3a45a2f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T01:04:11.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.648+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:11.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.648+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:11.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.649+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T01:04:11.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.649+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15675794816130490164', time=2024-09-12T03:03:19.695947+0000, chain.objs.size()=5 2024-09-12T01:04:11.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.649+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.102__multipart_key1.2~_m1otDJiNL3JYvEf6npZlKiZMZq8Arb.1 2024-09-12T01:04:11.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.649+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.102__shadow_key1.2~_m1otDJiNL3JYvEf6npZlKiZMZq8Arb.1_1 2024-09-12T01:04:11.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.649+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.102__multipart_key1.2~_m1otDJiNL3JYvEf6npZlKiZMZq8Arb.2 2024-09-12T01:04:11.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.649+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.102__shadow_key1.2~_m1otDJiNL3JYvEf6npZlKiZMZq8Arb.2_1 2024-09-12T01:04:11.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.649+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.102__multipart_key1.2~_m1otDJiNL3JYvEf6npZlKiZMZq8Arb.3 2024-09-12T01:04:11.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.649+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17881778520619737773', time=2024-09-12T03:03:33.191837+0000, chain.objs.size()=5 2024-09-12T01:04:11.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.649+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.104__multipart_key1.2~dViODQ0YCl9owqMj5WfG3PTLWyiF7XI.1 2024-09-12T01:04:11.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.649+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.104__multipart_key1.2~dViODQ0YCl9owqMj5WfG3PTLWyiF7XI.2 2024-09-12T01:04:11.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.649+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.104__multipart_key1.2~dViODQ0YCl9owqMj5WfG3PTLWyiF7XI.3 2024-09-12T01:04:11.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.649+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.104__multipart_key1.2~dViODQ0YCl9owqMj5WfG3PTLWyiF7XI.4 2024-09-12T01:04:11.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.649+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.104__multipart_key1.2~dViODQ0YCl9owqMj5WfG3PTLWyiF7XI.5 2024-09-12T01:04:11.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.649+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12620708712732095018', time=2024-09-12T03:03:49.053612+0000, chain.objs.size()=1 2024-09-12T01:04:11.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.649+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.120__shadow_.nWPe51VgZEenYhYWlS_IhrU-uZbCbU4_0 2024-09-12T01:04:11.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.649+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5358132501155779284', time=2024-09-12T03:03:50.194373+0000, chain.objs.size()=1 2024-09-12T01:04:11.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.649+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.122__shadow_.bMLL-pDBlVe8fY1RKI_Mt-R2a9zjY3T_0 2024-09-12T01:04:11.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.653+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.578556767775393447', time=2024-09-12T03:03:50.724035+0000, chain.objs.size()=1 2024-09-12T01:04:11.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.653+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.123__shadow_.VG-uBc5YJUm0gZMktxIQ9lZuM1uCGmt_0 2024-09-12T01:04:11.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.653+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7892100002745967449', time=2024-09-12T03:03:55.735099+0000, chain.objs.size()=1 2024-09-12T01:04:11.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.653+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.132__shadow_.ZxVCKFkfDIWd4Mxit2b3DwDv-jOJx1d_0 2024-09-12T01:04:11.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.655+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:11.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.657+0000 7f3a45a2f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T01:04:11.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.658+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:11.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.658+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:11.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.659+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T01:04:11.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.659+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3826244320520980259', time=2024-09-12T03:03:46.126768+0000, chain.objs.size()=1 2024-09-12T01:04:11.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.659+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.115__shadow_.pfbXffJKHG_4FcxmtUy96EETRx2hMsV_0 2024-09-12T01:04:11.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.659+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2312022142191308408', time=2024-09-12T03:03:46.687587+0000, chain.objs.size()=1 2024-09-12T01:04:11.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.659+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.116__shadow_.ilCgdXVlToz6KYWSnzf8tC7L06BTwKU_0 2024-09-12T01:04:11.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.659+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9180742439154877025', time=2024-09-12T03:03:48.468122+0000, chain.objs.size()=1 2024-09-12T01:04:11.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.659+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.119__shadow_.xcUre8T7XqqAyAvt9DVfWa6w5MnHmGg_0 2024-09-12T01:04:11.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.659+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16367237749860327495', time=2024-09-12T03:03:52.435220+0000, chain.objs.size()=1 2024-09-12T01:04:11.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.659+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.126__shadow_.0uJca_aeiKlhWBMH1iMxFooh_i_wkiJ_0 2024-09-12T01:04:11.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.660+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:11.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.662+0000 7f3a45a2f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T01:04:11.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.663+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:11.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.664+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:11.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.664+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T01:04:11.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.664+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9248880594849822729', time=2024-09-12T03:02:36.420995+0000, chain.objs.size()=1 2024-09-12T01:04:11.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.664+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.100__shadow_.HuBN4RSYEMuAQgynWETfxNhEwOdCgch_0 2024-09-12T01:04:11.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.664+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='2~nkJd_akyw5KTBAfh1YrT4SsIUPSy2kB', time=2024-09-12T03:02:41.908786+0000, chain.objs.size()=5 2024-09-12T01:04:11.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.664+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.101__multipart_key1.2~nkJd_akyw5KTBAfh1YrT4SsIUPSy2kB.7 2024-09-12T01:04:11.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.664+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.101__multipart_key1.2~nkJd_akyw5KTBAfh1YrT4SsIUPSy2kB.8 2024-09-12T01:04:11.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.664+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.101__multipart_key1.2~nkJd_akyw5KTBAfh1YrT4SsIUPSy2kB.9 2024-09-12T01:04:11.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.664+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.101__multipart_key1.2~nkJd_akyw5KTBAfh1YrT4SsIUPSy2kB.10 2024-09-12T01:04:11.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.664+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.101__multipart_key1.2~nkJd_akyw5KTBAfh1YrT4SsIUPSy2kB.11 2024-09-12T01:04:11.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.664+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14701075853548238497', time=2024-09-12T03:03:46.661110+0000, chain.objs.size()=1 2024-09-12T01:04:11.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.664+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.116__shadow_.d0d5AK4P1dpguILts5_IlD0V1IE3_4M_0 2024-09-12T01:04:11.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.664+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16521713674467890708', time=2024-09-12T03:03:51.847720+0000, chain.objs.size()=1 2024-09-12T01:04:11.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.664+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.125__shadow_.TC_PLoj38E13ALkneOB8AdelHePIYnN_0 2024-09-12T01:04:11.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.664+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9785597972076921962', time=2024-09-12T03:03:53.613152+0000, chain.objs.size()=1 2024-09-12T01:04:11.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.664+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.128__shadow_.0T_KO8UX_gYvARKwD6GpC_y2r6W7aYI_0 2024-09-12T01:04:11.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.668+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:11.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.670+0000 7f3a45a2f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T01:04:11.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.671+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:11.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.672+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:11.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.672+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T01:04:11.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.672+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5393983311810455282', time=2024-09-12T03:01:22.463997+0000, chain.objs.size()=1 2024-09-12T01:04:11.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.672+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.85__shadow_.n9tNXFpraURjtRd6llamny2jnqE12-U_0 2024-09-12T01:04:11.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.672+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5986326725402367444', time=2024-09-12T03:02:17.239415+0000, chain.objs.size()=5 2024-09-12T01:04:11.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.672+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.98__multipart_key1.2~xjR0rQeqei1CeQAN_9oaoqmflmFnqe0.1 2024-09-12T01:04:11.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.672+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.98__multipart_key1.2~xjR0rQeqei1CeQAN_9oaoqmflmFnqe0.2 2024-09-12T01:04:11.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.672+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.98__multipart_key1.2~xjR0rQeqei1CeQAN_9oaoqmflmFnqe0.3 2024-09-12T01:04:11.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.672+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.98__multipart_key1.2~xjR0rQeqei1CeQAN_9oaoqmflmFnqe0.4 2024-09-12T01:04:11.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.672+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.98__multipart_key1.2~xjR0rQeqei1CeQAN_9oaoqmflmFnqe0.5 2024-09-12T01:04:11.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.672+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1695413023606705223', time=2024-09-12T03:03:46.101888+0000, chain.objs.size()=1 2024-09-12T01:04:11.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.672+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.115__shadow_.Ps_cMN2xk5ex5Wk1oonmYbHXApjmxt__0 2024-09-12T01:04:11.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.672+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16471752370633349077', time=2024-09-12T03:03:54.187374+0000, chain.objs.size()=1 2024-09-12T01:04:11.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.672+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.129__shadow_.fbfLl-EY0tR7AVchdQAfz1bW3-bph-D_0 2024-09-12T01:04:11.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.675+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:11.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.677+0000 7f3a45a2f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T01:04:11.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.678+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:11.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.679+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:11.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.679+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T01:04:11.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.679+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18304150507481979239', time=2024-09-12T03:03:50.141026+0000, chain.objs.size()=1 2024-09-12T01:04:11.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.679+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.122__shadow_.8fbcjl1SXTalUQHxdKr0fyOQVkSriU-_0 2024-09-12T01:04:11.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.679+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5010839810215571200', time=2024-09-12T03:03:51.874746+0000, chain.objs.size()=1 2024-09-12T01:04:11.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.679+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.125__shadow_.p5VSKkr0NjztRd17cLqyOcVjZdUyznl_0 2024-09-12T01:04:11.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.679+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7689235848450775477', time=2024-09-12T03:03:53.537048+0000, chain.objs.size()=1 2024-09-12T01:04:11.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.679+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.128__shadow_.OPs5iqrypm0Hu_UCzDHC4j6sEPXI-fs_0 2024-09-12T01:04:11.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.679+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17425004021030912522', time=2024-09-12T03:03:53.562393+0000, chain.objs.size()=1 2024-09-12T01:04:11.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.679+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.128__shadow_.uIAUE3hvF6lGGoS6-nS9_zxad2k2XUD_0 2024-09-12T01:04:11.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.679+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15510407235560518223', time=2024-09-12T03:03:55.187249+0000, chain.objs.size()=1 2024-09-12T01:04:11.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.679+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.131__shadow_.VaLKBBgzQsfrDIqMR9XhRfnXrfsgxIR_0 2024-09-12T01:04:11.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.681+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:11.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.682+0000 7f3a45a2f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T01:04:11.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.684+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:11.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.684+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:11.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.684+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:11.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.685+0000 7f3a45a2f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T01:04:11.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.687+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:11.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.688+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:11.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.688+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T01:04:11.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.688+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9687165003867168422', time=2024-09-12T03:03:48.390952+0000, chain.objs.size()=1 2024-09-12T01:04:11.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.688+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.119__shadow_.ZzLCso2uBGIPXN57DdebhKWHL1Ktmbs_0 2024-09-12T01:04:11.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.688+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3421009174672175918', time=2024-09-12T03:03:50.219829+0000, chain.objs.size()=1 2024-09-12T01:04:11.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.688+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.122__shadow_.m_VfP2EruvmUqE4kbdp1wlb8EFYsLnw_0 2024-09-12T01:04:11.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.688+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15448167904977757601', time=2024-09-12T03:03:56.295879+0000, chain.objs.size()=1 2024-09-12T01:04:11.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.688+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.133__shadow_.dZWn1kF7fcpxP2raSg9ssfJzxttrqTJ_0 2024-09-12T01:04:11.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.689+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:11.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.691+0000 7f3a45a2f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T01:04:11.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.692+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:11.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.693+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:11.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.693+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T01:04:11.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.693+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.907588581604972928', time=2024-09-12T03:02:01.902107+0000, chain.objs.size()=5 2024-09-12T01:04:11.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.693+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.94__multipart_key1.2~5KyqjvfCykuUdcmuwoJiG2KNkWHmq6h.1 2024-09-12T01:04:11.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.693+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.94__shadow_key1.2~5KyqjvfCykuUdcmuwoJiG2KNkWHmq6h.1_1 2024-09-12T01:04:11.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.693+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.94__multipart_key1.2~5KyqjvfCykuUdcmuwoJiG2KNkWHmq6h.2 2024-09-12T01:04:11.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.693+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.94__shadow_key1.2~5KyqjvfCykuUdcmuwoJiG2KNkWHmq6h.2_1 2024-09-12T01:04:11.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.693+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.94__multipart_key1.2~5KyqjvfCykuUdcmuwoJiG2KNkWHmq6h.3 2024-09-12T01:04:11.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.693+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2299684148640439845', time=2024-09-12T03:03:54.110623+0000, chain.objs.size()=1 2024-09-12T01:04:11.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.693+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.129__shadow_.-QtRRGrpfcVP9RIHRrNDXQsoZMfSXeX_0 2024-09-12T01:04:11.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.693+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5644867356515527035', time=2024-09-12T03:04:05.671785+0000, chain.objs.size()=5 2024-09-12T01:04:11.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.693+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.143__multipart_key1.2~xAXi3_6dig42LVRxuWoqSGwGwcvBNSa.1 2024-09-12T01:04:11.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.693+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.143__multipart_key1.2~xAXi3_6dig42LVRxuWoqSGwGwcvBNSa.2 2024-09-12T01:04:11.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.693+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.143__multipart_key1.2~xAXi3_6dig42LVRxuWoqSGwGwcvBNSa.3 2024-09-12T01:04:11.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.693+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.143__multipart_key1.2~xAXi3_6dig42LVRxuWoqSGwGwcvBNSa.4 2024-09-12T01:04:11.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.693+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.143__multipart_key1.2~xAXi3_6dig42LVRxuWoqSGwGwcvBNSa.5 2024-09-12T01:04:11.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.697+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:11.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.699+0000 7f3a45a2f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T01:04:11.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.700+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:11.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.701+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:11.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.701+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T01:04:11.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.701+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10412547118510802558', time=2024-09-12T03:03:44.899733+0000, chain.objs.size()=1 2024-09-12T01:04:11.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.701+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.113__shadow_.oaWx0UlV4lFjDNHNuGBGGlUp6d-PW8t_0 2024-09-12T01:04:11.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.701+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16528412284583818379', time=2024-09-12T03:03:45.460677+0000, chain.objs.size()=1 2024-09-12T01:04:11.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.701+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.114__shadow_.VrtVOCUDkkQZiJCneR_m1L6i8pFa_J3_0 2024-09-12T01:04:11.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.701+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13374031932148921383', time=2024-09-12T03:03:45.513112+0000, chain.objs.size()=1 2024-09-12T01:04:11.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.701+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.114__shadow_.seS9CZYEjg-WBgitSno80mxvJRPHBFH_0 2024-09-12T01:04:11.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.701+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11527636836174374792', time=2024-09-12T03:03:48.442552+0000, chain.objs.size()=1 2024-09-12T01:04:11.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.701+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.119__shadow_.sEbZ999aBrTaj6stjnMkM3sovY9OeGR_0 2024-09-12T01:04:11.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.701+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7707563918703077997', time=2024-09-12T03:03:52.409598+0000, chain.objs.size()=1 2024-09-12T01:04:11.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.701+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.126__shadow_.UkiMgJH9-hAJqksUrLqnPKFI9eFHJ6J_0 2024-09-12T01:04:11.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.701+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14615920298667551076', time=2024-09-12T03:03:52.958695+0000, chain.objs.size()=1 2024-09-12T01:04:11.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.701+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.127__shadow_.S9ijHf4uV1M5HA17phfEUCMNdMRO3hN_0 2024-09-12T01:04:11.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.701+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5163717760408452200', time=2024-09-12T03:03:53.038018+0000, chain.objs.size()=1 2024-09-12T01:04:11.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.701+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.127__shadow_.X-yty-MAyVo69QwfMd9RkFdQL4wGcjs_0 2024-09-12T01:04:11.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.703+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:11.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.705+0000 7f3a45a2f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T01:04:11.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.706+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:11.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.707+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:11.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.707+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T01:04:11.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.707+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12381010495372266503', time=2024-09-12T03:01:15.737660+0000, chain.objs.size()=1 2024-09-12T01:04:11.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.707+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.81__shadow_.Lott2bmYwtwJMmI_lm49WdiLx9dq1iu_0 2024-09-12T01:04:11.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.707+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13301991933488191083', time=2024-09-12T03:03:47.279470+0000, chain.objs.size()=1 2024-09-12T01:04:11.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.707+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.117__shadow_.tW5c8H56F5vU3TmPbEcS6AENX6p2_1F_0 2024-09-12T01:04:11.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.707+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7028657450515992295', time=2024-09-12T03:03:49.001532+0000, chain.objs.size()=1 2024-09-12T01:04:11.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.707+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.120__shadow_.r9Smsr18befAQPKsU_dM8kxmLj2lXFE_0 2024-09-12T01:04:11.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.707+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12227068319117327334', time=2024-09-12T03:03:52.985498+0000, chain.objs.size()=1 2024-09-12T01:04:11.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.707+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.127__shadow_.JHFveOhG6M55IHuDJ8CLv5gkKnHmuo9_0 2024-09-12T01:04:11.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.707+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13400681714834634340', time=2024-09-12T03:03:55.238425+0000, chain.objs.size()=1 2024-09-12T01:04:11.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.707+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.131__shadow_.rVM9vtoKgIb9yAJdfB4leSfNWXu4aBd_0 2024-09-12T01:04:11.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.708+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:11.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.711+0000 7f3a45a2f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T01:04:11.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.712+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:11.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.713+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:11.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.713+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T01:04:11.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.713+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7285382485998549386', time=2024-09-12T03:03:44.370919+0000, chain.objs.size()=1 2024-09-12T01:04:11.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.713+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.112__shadow_.f_2bMfDigepjfgpUWbagYATLQTBNRg8_0 2024-09-12T01:04:11.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.713+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14654149509024084888', time=2024-09-12T03:03:45.540244+0000, chain.objs.size()=1 2024-09-12T01:04:11.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.713+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.114__shadow_.66_af7eGLE5zW6B2HyiTxjnSAGC8Mbx_0 2024-09-12T01:04:11.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.713+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16468461440006448914', time=2024-09-12T03:03:48.417211+0000, chain.objs.size()=1 2024-09-12T01:04:11.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.713+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.119__shadow_.cz32FtSaXtX-aJ9M-gEkP2WLTPbxO3O_0 2024-09-12T01:04:11.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.713+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1762338496533260061', time=2024-09-12T03:03:51.821271+0000, chain.objs.size()=1 2024-09-12T01:04:11.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.713+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.125__shadow_.CH0Qduv_zOLbcuj6lNu4oOrV-xvm2xZ_0 2024-09-12T01:04:11.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.713+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16696916354318876487', time=2024-09-12T03:03:52.382962+0000, chain.objs.size()=1 2024-09-12T01:04:11.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.713+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.126__shadow_.210pNZzhaIYdaMYxXBUbOPbSJ3rnQ49_0 2024-09-12T01:04:11.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.713+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11914068669920610907', time=2024-09-12T03:03:54.684631+0000, chain.objs.size()=1 2024-09-12T01:04:11.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.713+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.130__shadow_.Qn2DLdkSCW-GPVQDrKcSxC2HZBb73Hg_0 2024-09-12T01:04:11.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.714+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:11.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.716+0000 7f3a45a2f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T01:04:11.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.718+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:11.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.718+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:11.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.719+0000 7f3a45a2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-12T01:04:11.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.719+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='2~QoUhgP8k6DL8Dlv9zNTSRCMCCEkTOaz', time=2024-09-12T03:01:14.764219+0000, chain.objs.size()=5 2024-09-12T01:04:11.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.719+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.79__multipart_key1.2~QoUhgP8k6DL8Dlv9zNTSRCMCCEkTOaz.1 2024-09-12T01:04:11.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.719+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.79__multipart_key1.2~QoUhgP8k6DL8Dlv9zNTSRCMCCEkTOaz.2 2024-09-12T01:04:11.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.719+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.79__multipart_key1.2~QoUhgP8k6DL8Dlv9zNTSRCMCCEkTOaz.3 2024-09-12T01:04:11.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.719+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.79__multipart_key1.2~QoUhgP8k6DL8Dlv9zNTSRCMCCEkTOaz.4 2024-09-12T01:04:11.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.719+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.79__multipart_key1.2~QoUhgP8k6DL8Dlv9zNTSRCMCCEkTOaz.5 2024-09-12T01:04:11.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.719+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9366409364723893513', time=2024-09-12T03:02:25.943177+0000, chain.objs.size()=5 2024-09-12T01:04:11.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.719+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.99__multipart_key1.2~TN_FINzjVvh_5QqG_vfxxQO2KbvnXb8.1 2024-09-12T01:04:11.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.719+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.99__multipart_key1.2~TN_FINzjVvh_5QqG_vfxxQO2KbvnXb8.2 2024-09-12T01:04:11.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.719+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.99__multipart_key1.2~TN_FINzjVvh_5QqG_vfxxQO2KbvnXb8.3 2024-09-12T01:04:11.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.719+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.99__multipart_key1.2~TN_FINzjVvh_5QqG_vfxxQO2KbvnXb8.4 2024-09-12T01:04:11.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.719+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.99__multipart_key1.2~TN_FINzjVvh_5QqG_vfxxQO2KbvnXb8.5 2024-09-12T01:04:11.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.719+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.789060246907500611', time=2024-09-12T03:02:36.365966+0000, chain.objs.size()=1 2024-09-12T01:04:11.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.719+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.100__shadow_.lmSVnN5r0SgUqB31ha61jW5rVaRghKX_0 2024-09-12T01:04:11.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.719+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5429692035245142182', time=2024-09-12T03:03:46.075929+0000, chain.objs.size()=1 2024-09-12T01:04:11.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.719+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.115__shadow_.K4GKG99ZgzIF-ugyeOMru6bNx-ISeyW_0 2024-09-12T01:04:11.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.721+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5704032245992054424', time=2024-09-12T03:03:47.863936+0000, chain.objs.size()=1 2024-09-12T01:04:11.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.721+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.118__shadow_.EQaqhoyCuFErbiM1NeY4O_FTs5wqNpy_0 2024-09-12T01:04:11.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.722+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6759269330716474242', time=2024-09-12T03:03:51.286919+0000, chain.objs.size()=1 2024-09-12T01:04:11.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.722+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.124__shadow_._8QX3JVfmHI21alUN9x_0-dPTxmKrVx_0 2024-09-12T01:04:11.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.722+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1329190906452326035', time=2024-09-12T03:03:54.161742+0000, chain.objs.size()=1 2024-09-12T01:04:11.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.722+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.129__shadow_.l2NJiK1UGt9e-Gx97kiTP7jqzdzSQtO_0 2024-09-12T01:04:11.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.722+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17712300982486766182', time=2024-09-12T03:03:55.708731+0000, chain.objs.size()=1 2024-09-12T01:04:11.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.722+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.132__shadow_.xqP78oVYBZ_x9RC35amMrq4T98DL0ad_0 2024-09-12T01:04:11.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.722+0000 7f3a45a2f800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15064419332245221245', time=2024-09-12T03:03:56.249001+0000, chain.objs.size()=1 2024-09-12T01:04:11.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.722+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.133__shadow_.d-iq38t5vyvufqFdwYtA-uqIFOlMkML_0 2024-09-12T01:04:11.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.724+0000 7f3a45a2f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:11.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.727+0000 7f38f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:11.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.729+0000 7f3a45a2f800 20 remove_watcher() i=0 2024-09-12T01:04:11.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.729+0000 7f3a45a2f800 2 removed watcher, disabling cache 2024-09-12T01:04:11.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.730+0000 7f3a45a2f800 20 remove_watcher() i=1 2024-09-12T01:04:11.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.731+0000 7f3a45a2f800 20 remove_watcher() i=2 2024-09-12T01:04:11.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.732+0000 7f3a45a2f800 20 remove_watcher() i=3 2024-09-12T01:04:11.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.733+0000 7f3a45a2f800 20 remove_watcher() i=4 2024-09-12T01:04:11.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.734+0000 7f3a45a2f800 20 remove_watcher() i=5 2024-09-12T01:04:11.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.735+0000 7f3a45a2f800 20 remove_watcher() i=6 2024-09-12T01:04:11.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.736+0000 7f3a45a2f800 20 remove_watcher() i=7 2024-09-12T01:04:11.746 DEBUG:teuthology.orchestra.run.smithi073:> radosgw-admin gc process --include-all 2024-09-12T01:04:11.797 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:04:11.798 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:04:11.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.835+0000 7f9c63e2f800 20 rados->read ofs=0 len=0 2024-09-12T01:04:11.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.837+0000 7f9c63e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:11.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.837+0000 7f9c63e2f800 20 realm 2024-09-12T01:04:11.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.837+0000 7f9c63e2f800 20 rados->read ofs=0 len=0 2024-09-12T01:04:11.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.837+0000 7f9c63e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:11.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.837+0000 7f9c63e2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:04:11.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.837+0000 7f9c63e2f800 20 rados->read ofs=0 len=0 2024-09-12T01:04:11.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.837+0000 7f9c63e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:11.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.837+0000 7f9c63e2f800 20 rados->read ofs=0 len=0 2024-09-12T01:04:11.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.838+0000 7f9c63e2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:11.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.838+0000 7f9c63e2f800 20 rados->read ofs=0 len=0 2024-09-12T01:04:11.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.839+0000 7f9c63e2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:04:11.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.839+0000 7f9c63e2f800 20 searching for the correct realm 2024-09-12T01:04:11.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:11.841+0000 7f9c5f98c640 0 -- 172.21.15.73:0/4272798420 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f9c4801f070 msgr2=0x7f9c48014950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:12.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.046+0000 7f9c5f98c640 0 -- 172.21.15.73:0/4272798420 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f9c4801f070 msgr2=0x7f9c48014950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:12.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.050+0000 7f9c63e2f800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T01:04:12.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.050+0000 7f9c63e2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:04:12.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.050+0000 7f9c63e2f800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T01:04:12.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.050+0000 7f9c63e2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:04:12.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.050+0000 7f9c63e2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:04:12.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.050+0000 7f9c63e2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:04:12.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.050+0000 7f9c63e2f800 20 rados->read ofs=0 len=0 2024-09-12T01:04:12.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.050+0000 7f9c63e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:12.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.050+0000 7f9c63e2f800 20 rados->read ofs=0 len=0 2024-09-12T01:04:12.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.051+0000 7f9c63e2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:12.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.051+0000 7f9c63e2f800 20 rados->read ofs=0 len=0 2024-09-12T01:04:12.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.051+0000 7f9c63e2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:04:12.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.051+0000 7f9c63e2f800 20 zone default found 2024-09-12T01:04:12.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.051+0000 7f9c63e2f800 4 Realm: () 2024-09-12T01:04:12.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.051+0000 7f9c63e2f800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T01:04:12.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.051+0000 7f9c63e2f800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T01:04:12.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.051+0000 7f9c63e2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:04:12.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.051+0000 7f9c63e2f800 20 zonegroup default 2024-09-12T01:04:12.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.051+0000 7f9c63e2f800 20 rados->read ofs=0 len=0 2024-09-12T01:04:12.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.051+0000 7f9c63e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:12.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.051+0000 7f9c63e2f800 20 rados->read ofs=0 len=0 2024-09-12T01:04:12.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.052+0000 7f9c63e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:12.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.052+0000 7f9c63e2f800 20 rados->read ofs=0 len=0 2024-09-12T01:04:12.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.052+0000 7f9c63e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:12.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.052+0000 7f9c63e2f800 20 started sync module instance, tier type = 2024-09-12T01:04:12.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.052+0000 7f9c63e2f800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T01:04:12.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.060+0000 7f9c63e2f800 20 add_watcher() i=0 2024-09-12T01:04:12.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.060+0000 7f9c63e2f800 20 add_watcher() i=1 2024-09-12T01:04:12.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.060+0000 7f9c63e2f800 20 add_watcher() i=2 2024-09-12T01:04:12.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.060+0000 7f9c63e2f800 20 add_watcher() i=3 2024-09-12T01:04:12.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.060+0000 7f9c63e2f800 20 add_watcher() i=4 2024-09-12T01:04:12.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.060+0000 7f9c63e2f800 20 add_watcher() i=5 2024-09-12T01:04:12.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.060+0000 7f9c63e2f800 20 add_watcher() i=6 2024-09-12T01:04:12.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.061+0000 7f9c63e2f800 20 add_watcher() i=7 2024-09-12T01:04:12.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.061+0000 7f9c63e2f800 2 all 8 watchers are set, enabling cache 2024-09-12T01:04:12.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.063+0000 7f9b15fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:12.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.063+0000 7f9c63e2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:04:12.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.063+0000 7f9c63e2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:04:12.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.098+0000 7f9b14fe1640 20 reqs_thread_entry: start 2024-09-12T01:04:12.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.098+0000 7f9c63e2f800 20 init_complete bucket index max shards: 1 2024-09-12T01:04:12.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.098+0000 7f9c63e2f800 20 Filter name: none 2024-09-12T01:04:12.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.098+0000 7f9a8e7fc640 20 reqs_thread_entry: start 2024-09-12T01:04:12.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.098+0000 7f9c63e2f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T01:04:12.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.099+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.100+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:12.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.100+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.101+0000 7f9c63e2f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T01:04:12.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.102+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.102+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:12.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.103+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.104+0000 7f9c63e2f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T01:04:12.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.105+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.105+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:12.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.106+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.107+0000 7f9c63e2f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T01:04:12.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.108+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.108+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:12.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.109+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.110+0000 7f9c63e2f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T01:04:12.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.111+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.111+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:12.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.112+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.112+0000 7f9c63e2f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T01:04:12.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.114+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.114+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:12.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.115+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.115+0000 7f9c63e2f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T01:04:12.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.117+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.117+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:12.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.117+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.118+0000 7f9c63e2f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T01:04:12.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.119+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.120+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:12.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.120+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.121+0000 7f9c63e2f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T01:04:12.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.123+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.123+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:12.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.123+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.124+0000 7f9c63e2f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T01:04:12.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.126+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.126+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:12.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.126+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.127+0000 7f9c63e2f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T01:04:12.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.129+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.129+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:12.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.130+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.130+0000 7f9c63e2f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T01:04:12.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.132+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.132+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:12.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.133+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.133+0000 7f9c63e2f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T01:04:12.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.135+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.135+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:12.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.135+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.136+0000 7f9c63e2f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T01:04:12.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.138+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.138+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:12.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.138+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.139+0000 7f9c63e2f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T01:04:12.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.140+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.141+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:12.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.141+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.142+0000 7f9c63e2f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T01:04:12.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.143+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.143+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:12.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.144+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.145+0000 7f9c63e2f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T01:04:12.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.146+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.146+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:12.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.147+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.148+0000 7f9c63e2f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T01:04:12.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.149+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.149+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:12.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.149+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.150+0000 7f9c63e2f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T01:04:12.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.152+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.152+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:12.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.152+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.153+0000 7f9c63e2f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T01:04:12.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.154+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.155+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:12.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.155+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.156+0000 7f9c63e2f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T01:04:12.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.157+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.157+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:12.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.158+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.158+0000 7f9c63e2f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T01:04:12.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.160+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.160+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:12.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.160+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.161+0000 7f9c63e2f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T01:04:12.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.163+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.163+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:12.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.163+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.164+0000 7f9c63e2f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T01:04:12.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.165+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.166+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:12.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.166+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.167+0000 7f9c63e2f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T01:04:12.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.168+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.169+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:12.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.169+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.170+0000 7f9c63e2f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T01:04:12.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.171+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.171+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:12.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.172+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.172+0000 7f9c63e2f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T01:04:12.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.174+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.174+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:12.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.175+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.176+0000 7f9c63e2f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T01:04:12.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.177+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.177+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:12.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.178+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.179+0000 7f9c63e2f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T01:04:12.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.180+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.180+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:12.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.180+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.181+0000 7f9c63e2f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T01:04:12.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.183+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.183+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:12.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.183+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.184+0000 7f9c63e2f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T01:04:12.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.186+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.186+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:12.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.187+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.188+0000 7f9c63e2f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T01:04:12.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.189+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.189+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:12.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.189+0000 7f9c63e2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:12.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.191+0000 7f9b15fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:12.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.193+0000 7f9c63e2f800 20 remove_watcher() i=0 2024-09-12T01:04:12.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.193+0000 7f9c63e2f800 2 removed watcher, disabling cache 2024-09-12T01:04:12.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.194+0000 7f9c63e2f800 20 remove_watcher() i=1 2024-09-12T01:04:12.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.195+0000 7f9c63e2f800 20 remove_watcher() i=2 2024-09-12T01:04:12.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.196+0000 7f9c63e2f800 20 remove_watcher() i=3 2024-09-12T01:04:12.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.198+0000 7f9c63e2f800 20 remove_watcher() i=4 2024-09-12T01:04:12.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.199+0000 7f9c63e2f800 20 remove_watcher() i=5 2024-09-12T01:04:12.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.200+0000 7f9c63e2f800 20 remove_watcher() i=6 2024-09-12T01:04:12.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:12.201+0000 7f9c63e2f800 20 remove_watcher() i=7 2024-09-12T01:04:12.211 INFO:teuthology.run_tasks:Running task s3tests... 2024-09-12T01:04:12.231 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 main': 'RGW11111111111111111'}, 'force-branch': 'ceph-master', 'storage classes': 'LUKEWARM, FROZEN'}} 2024-09-12T01:04:12.232 INFO:tasks.s3tests:Downloading s3-tests... 2024-09-12T01:04:12.232 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2024-09-12T01:04:12.232 DEBUG:teuthology.orchestra.run.smithi073:> git clone -b ceph-master https://git.ceph.com/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T01:04:12.261 INFO:teuthology.orchestra.run.smithi073.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2024-09-12T01:04:13.072 INFO:tasks.s3tests:Creating rgw users... 2024-09-12T01:04:13.072 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW11111111111111111 --account-name Mr.RGW11111111111111111 --email RGW11111111111111111+test@test.test 2024-09-12T01:04:13.172 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:04:13.172 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:04:13.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.207+0000 7f786612a800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.209+0000 7f786612a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:13.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.209+0000 7f786612a800 20 realm 2024-09-12T01:04:13.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.209+0000 7f786612a800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.209+0000 7f786612a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:13.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.209+0000 7f786612a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:04:13.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.209+0000 7f786612a800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.209+0000 7f786612a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:13.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.209+0000 7f786612a800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.210+0000 7f786612a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:13.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.210+0000 7f786612a800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.211+0000 7f786612a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:04:13.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.211+0000 7f786612a800 20 searching for the correct realm 2024-09-12T01:04:13.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.213+0000 7f7862650640 0 -- 172.21.15.73:0/1541212317 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f7858066f20 msgr2=0x7f7858065990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:13.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.419+0000 7f7862650640 0 -- 172.21.15.73:0/1541212317 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f7858066f20 msgr2=0x7f7858065990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:13.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.424+0000 7f786612a800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T01:04:13.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.424+0000 7f786612a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:04:13.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.424+0000 7f786612a800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T01:04:13.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.424+0000 7f786612a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:04:13.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.424+0000 7f786612a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:04:13.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.424+0000 7f786612a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:04:13.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.424+0000 7f786612a800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.424+0000 7f786612a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:13.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.424+0000 7f786612a800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.424+0000 7f786612a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:13.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.424+0000 7f786612a800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.425+0000 7f786612a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:04:13.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.425+0000 7f786612a800 20 zone default found 2024-09-12T01:04:13.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.425+0000 7f786612a800 4 Realm: () 2024-09-12T01:04:13.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.425+0000 7f786612a800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T01:04:13.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.425+0000 7f786612a800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T01:04:13.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.425+0000 7f786612a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:04:13.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.425+0000 7f786612a800 20 zonegroup default 2024-09-12T01:04:13.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.425+0000 7f786612a800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.425+0000 7f786612a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:13.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.425+0000 7f786612a800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.425+0000 7f786612a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:13.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.425+0000 7f786612a800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.425+0000 7f786612a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:13.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.425+0000 7f786612a800 20 started sync module instance, tier type = 2024-09-12T01:04:13.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.425+0000 7f786612a800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T01:04:13.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.435+0000 7f786612a800 20 add_watcher() i=0 2024-09-12T01:04:13.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.435+0000 7f786612a800 20 add_watcher() i=1 2024-09-12T01:04:13.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.435+0000 7f786612a800 20 add_watcher() i=2 2024-09-12T01:04:13.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.435+0000 7f786612a800 20 add_watcher() i=3 2024-09-12T01:04:13.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.435+0000 7f786612a800 20 add_watcher() i=4 2024-09-12T01:04:13.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.435+0000 7f786612a800 20 add_watcher() i=5 2024-09-12T01:04:13.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.435+0000 7f786612a800 20 add_watcher() i=6 2024-09-12T01:04:13.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.435+0000 7f786612a800 20 add_watcher() i=7 2024-09-12T01:04:13.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.435+0000 7f786612a800 2 all 8 watchers are set, enabling cache 2024-09-12T01:04:13.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.437+0000 7f77137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:13.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.437+0000 7f786612a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:04:13.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.437+0000 7f786612a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:04:13.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.437+0000 7f786612a800 5 note: GC not initialized 2024-09-12T01:04:13.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.438+0000 7f77127fc640 20 reqs_thread_entry: start 2024-09-12T01:04:13.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.438+0000 7f786612a800 20 init_complete bucket index max shards: 1 2024-09-12T01:04:13.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.438+0000 7f786612a800 20 Filter name: none 2024-09-12T01:04:13.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.438+0000 7f7683fff640 20 reqs_thread_entry: start 2024-09-12T01:04:13.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.438+0000 7f786612a800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 : miss 2024-09-12T01:04:13.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.438+0000 7f786612a800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.439+0000 7f786612a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:13.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.439+0000 7f786612a800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x0 2024-09-12T01:04:13.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.439+0000 7f786612a800 10 adding default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-12T01:04:13.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.439+0000 7f786612a800 20 failed to read name.$Mr.RGW11111111111111111 with: (2) No such file or directory 2024-09-12T01:04:13.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.439+0000 7f786612a800 10 cache get: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test : miss 2024-09-12T01:04:13.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.439+0000 7f786612a800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.439+0000 7f786612a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:13.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.439+0000 7f786612a800 10 cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x0 2024-09-12T01:04:13.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.439+0000 7f786612a800 10 adding default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-12T01:04:13.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.439+0000 7f786612a800 20 failed to read rgw11111111111111111+test@test.test with: (2) No such file or directory 2024-09-12T01:04:13.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.440+0000 7f786612a800 10 cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-12T01:04:13.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.440+0000 7f786612a800 10 adding default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-12T01:04:13.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.440+0000 7f786612a800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW11111111111111111, ofs0, ns] 2024-09-12T01:04:13.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.441+0000 7f77457fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497079 cookie 94251023308288 notifier 9033 bl.length()=384 2024-09-12T01:04:13.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.441+0000 7f77457fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-12T01:04:13.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.441+0000 7f77457fa640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-12T01:04:13.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.443+0000 7f786612a800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x17 2024-09-12T01:04:13.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.443+0000 7f786612a800 10 moving default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-12T01:04:13.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.443+0000 7f786612a800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW11111111111111111, ofs0, ns] 2024-09-12T01:04:13.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.444+0000 7f77457fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497125 cookie 94251023315632 notifier 9033 bl.length()=225 2024-09-12T01:04:13.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.444+0000 7f77457fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x17 2024-09-12T01:04:13.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.444+0000 7f77457fa640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-12T01:04:13.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.447+0000 7f786612a800 10 cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x17 2024-09-12T01:04:13.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.447+0000 7f786612a800 10 moving default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-12T01:04:13.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.447+0000 7f786612a800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw11111111111111111+test@test.test, ofs0, ns] 2024-09-12T01:04:13.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.447+0000 7f77457fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497053 cookie 94251023314576 notifier 9033 bl.length()=234 2024-09-12T01:04:13.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.447+0000 7f77457fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x17 2024-09-12T01:04:13.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.447+0000 7f77457fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-12T01:04:13.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.449+0000 7f77137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:13.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.451+0000 7f786612a800 20 remove_watcher() i=0 2024-09-12T01:04:13.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.451+0000 7f786612a800 2 removed watcher, disabling cache 2024-09-12T01:04:13.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.452+0000 7f786612a800 20 remove_watcher() i=1 2024-09-12T01:04:13.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.453+0000 7f786612a800 20 remove_watcher() i=2 2024-09-12T01:04:13.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.454+0000 7f786612a800 20 remove_watcher() i=3 2024-09-12T01:04:13.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.455+0000 7f786612a800 20 remove_watcher() i=4 2024-09-12T01:04:13.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.456+0000 7f786612a800 20 remove_watcher() i=5 2024-09-12T01:04:13.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.457+0000 7f786612a800 20 remove_watcher() i=6 2024-09-12T01:04:13.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.458+0000 7f786612a800 20 remove_watcher() i=7 2024-09-12T01:04:13.465 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T01:04:13.465 INFO:teuthology.orchestra.run.smithi073.stdout: "id": "RGW11111111111111111", 2024-09-12T01:04:13.465 INFO:teuthology.orchestra.run.smithi073.stdout: "tenant": "", 2024-09-12T01:04:13.465 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "Mr.RGW11111111111111111", 2024-09-12T01:04:13.465 INFO:teuthology.orchestra.run.smithi073.stdout: "email": "RGW11111111111111111+test@test.test", 2024-09-12T01:04:13.465 INFO:teuthology.orchestra.run.smithi073.stdout: "quota": { 2024-09-12T01:04:13.465 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": false, 2024-09-12T01:04:13.466 INFO:teuthology.orchestra.run.smithi073.stdout: "check_on_raw": false, 2024-09-12T01:04:13.466 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size": -1, 2024-09-12T01:04:13.466 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size_kb": 0, 2024-09-12T01:04:13.466 INFO:teuthology.orchestra.run.smithi073.stdout: "max_objects": -1 2024-09-12T01:04:13.466 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T01:04:13.466 INFO:teuthology.orchestra.run.smithi073.stdout: "bucket_quota": { 2024-09-12T01:04:13.466 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": false, 2024-09-12T01:04:13.466 INFO:teuthology.orchestra.run.smithi073.stdout: "check_on_raw": false, 2024-09-12T01:04:13.466 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size": -1, 2024-09-12T01:04:13.466 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size_kb": 0, 2024-09-12T01:04:13.466 INFO:teuthology.orchestra.run.smithi073.stdout: "max_objects": -1 2024-09-12T01:04:13.466 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T01:04:13.466 INFO:teuthology.orchestra.run.smithi073.stdout: "max_users": 1000, 2024-09-12T01:04:13.466 INFO:teuthology.orchestra.run.smithi073.stdout: "max_roles": 1000, 2024-09-12T01:04:13.467 INFO:teuthology.orchestra.run.smithi073.stdout: "max_groups": 1000, 2024-09-12T01:04:13.467 INFO:teuthology.orchestra.run.smithi073.stdout: "max_buckets": 1000, 2024-09-12T01:04:13.467 INFO:teuthology.orchestra.run.smithi073.stdout: "max_access_keys": 4 2024-09-12T01:04:13.467 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T01:04:13.468 DEBUG:tasks.s3tests:Creating user RGW11111111111111111 on client.0 2024-09-12T01:04:13.468 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name Mr.RGW11111111111111111 --email foo+test@test.test --access-key EWTAWEVOZDXLFSABMVAD --secret 9axdh9ZLbXJDPLN1ARISEH1QFzfosYVcTx2dBCFeTOJt1oUJmeLTVg== --cluster ceph --account-id RGW11111111111111111 --account-root 2024-09-12T01:04:13.535 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:04:13.535 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:04:13.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.570+0000 7f75e3a15800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.571+0000 7f75e3a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:13.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.571+0000 7f75e3a15800 20 realm 2024-09-12T01:04:13.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.571+0000 7f75e3a15800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.572+0000 7f75e3a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:13.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.572+0000 7f75e3a15800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:04:13.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.572+0000 7f75e3a15800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.572+0000 7f75e3a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:13.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.572+0000 7f75e3a15800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.573+0000 7f75e3a15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:13.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.573+0000 7f75e3a15800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.573+0000 7f75e3a15800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:04:13.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.573+0000 7f75e3a15800 20 searching for the correct realm 2024-09-12T01:04:13.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.576+0000 7f75df993640 0 -- 172.21.15.73:0/2730110020 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f75d4069170 msgr2=0x7f75d4061480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:13.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.782+0000 7f75df993640 0 -- 172.21.15.73:0/2730110020 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f75d4069170 msgr2=0x7f75d4061480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:13.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.786+0000 7f75e3a15800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T01:04:13.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.786+0000 7f75e3a15800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:04:13.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.786+0000 7f75e3a15800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T01:04:13.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.786+0000 7f75e3a15800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:04:13.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.786+0000 7f75e3a15800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:04:13.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.786+0000 7f75e3a15800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:04:13.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.786+0000 7f75e3a15800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.787+0000 7f75e3a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:13.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.787+0000 7f75e3a15800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.787+0000 7f75e3a15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:13.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.787+0000 7f75e3a15800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.787+0000 7f75e3a15800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:04:13.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.787+0000 7f75e3a15800 20 zone default found 2024-09-12T01:04:13.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.787+0000 7f75e3a15800 4 Realm: () 2024-09-12T01:04:13.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.787+0000 7f75e3a15800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T01:04:13.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.787+0000 7f75e3a15800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T01:04:13.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.787+0000 7f75e3a15800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:04:13.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.787+0000 7f75e3a15800 20 zonegroup default 2024-09-12T01:04:13.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.787+0000 7f75e3a15800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.788+0000 7f75e3a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:13.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.788+0000 7f75e3a15800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.788+0000 7f75e3a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:13.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.788+0000 7f75e3a15800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.788+0000 7f75e3a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:13.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.788+0000 7f75e3a15800 20 started sync module instance, tier type = 2024-09-12T01:04:13.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.788+0000 7f75e3a15800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T01:04:13.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.798+0000 7f75e3a15800 20 add_watcher() i=0 2024-09-12T01:04:13.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.798+0000 7f75e3a15800 20 add_watcher() i=1 2024-09-12T01:04:13.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.798+0000 7f75e3a15800 20 add_watcher() i=2 2024-09-12T01:04:13.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.798+0000 7f75e3a15800 20 add_watcher() i=3 2024-09-12T01:04:13.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.798+0000 7f75e3a15800 20 add_watcher() i=4 2024-09-12T01:04:13.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.798+0000 7f75e3a15800 20 add_watcher() i=5 2024-09-12T01:04:13.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.798+0000 7f75e3a15800 20 add_watcher() i=6 2024-09-12T01:04:13.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.799+0000 7f75e3a15800 20 add_watcher() i=7 2024-09-12T01:04:13.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.799+0000 7f75e3a15800 2 all 8 watchers are set, enabling cache 2024-09-12T01:04:13.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.800+0000 7f7495fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:13.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.801+0000 7f75e3a15800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:04:13.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.801+0000 7f75e3a15800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:04:13.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.801+0000 7f75e3a15800 5 note: GC not initialized 2024-09-12T01:04:13.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.801+0000 7f7494fe1640 20 reqs_thread_entry: start 2024-09-12T01:04:13.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.801+0000 7f75e3a15800 20 init_complete bucket index max shards: 1 2024-09-12T01:04:13.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.801+0000 7f75e3a15800 20 Filter name: none 2024-09-12T01:04:13.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.801+0000 7f740e7fc640 20 reqs_thread_entry: start 2024-09-12T01:04:13.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.801+0000 7f75e3a15800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-12T01:04:13.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.801+0000 7f75e3a15800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.801+0000 7f75e3a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:13.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.801+0000 7f75e3a15800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2024-09-12T01:04:13.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.801+0000 7f75e3a15800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T01:04:13.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.801+0000 7f75e3a15800 10 cache get: name=default.rgw.meta+users.email+foo+test@test.test : miss 2024-09-12T01:04:13.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.801+0000 7f75e3a15800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.802+0000 7f75e3a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:13.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.802+0000 7f75e3a15800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x0 2024-09-12T01:04:13.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.802+0000 7f75e3a15800 10 adding default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T01:04:13.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.802+0000 7f75e3a15800 10 cache get: name=default.rgw.meta+users.keys+EWTAWEVOZDXLFSABMVAD : miss 2024-09-12T01:04:13.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.802+0000 7f75e3a15800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.802+0000 7f75e3a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:13.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.802+0000 7f75e3a15800 10 cache put: name=default.rgw.meta+users.keys+EWTAWEVOZDXLFSABMVAD info.flags=0x0 2024-09-12T01:04:13.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.802+0000 7f75e3a15800 10 adding default.rgw.meta+users.keys+EWTAWEVOZDXLFSABMVAD to cache LRU end 2024-09-12T01:04:13.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.802+0000 7f75e3a15800 10 cache get: name=default.rgw.meta+accounts+account.RGW11111111111111111 : miss 2024-09-12T01:04:13.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.802+0000 7f75e3a15800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.803+0000 7f75e3a15800 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T01:04:13.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.803+0000 7f75e3a15800 10 cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-12T01:04:13.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.803+0000 7f75e3a15800 10 adding default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-12T01:04:13.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.803+0000 7f75e3a15800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:04:13.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.803+0000 7f75e3a15800 10 cache get: name=default.rgw.meta+users.keys+EWTAWEVOZDXLFSABMVAD : hit (negative entry) 2024-09-12T01:04:13.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.803+0000 7f75e3a15800 10 cache get: name=default.rgw.meta+users.keys+EWTAWEVOZDXLFSABMVAD : hit (negative entry) 2024-09-12T01:04:13.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.804+0000 7f75e3a15800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T01:04:13.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.804+0000 7f75e3a15800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T01:04:13.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.804+0000 7f75e3a15800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-12T01:04:13.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.804+0000 7f74c2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497126 cookie 94112517911552 notifier 8468 bl.length()=673 2024-09-12T01:04:13.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.804+0000 7f74c2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T01:04:13.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.804+0000 7f74c2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T01:04:13.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.807+0000 7f75e3a15800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-12T01:04:13.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.807+0000 7f75e3a15800 10 moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T01:04:13.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.807+0000 7f75e3a15800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:foo+test@test.test, ofs0, ns] 2024-09-12T01:04:13.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.807+0000 7f74c27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497127 cookie 94112517927056 notifier 8468 bl.length()=185 2024-09-12T01:04:13.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.807+0000 7f74c27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-12T01:04:13.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.807+0000 7f74c27fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T01:04:13.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.810+0000 7f75e3a15800 10 cache put: name=default.rgw.meta+users.keys+EWTAWEVOZDXLFSABMVAD info.flags=0x7 2024-09-12T01:04:13.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.810+0000 7f75e3a15800 10 moving default.rgw.meta+users.keys+EWTAWEVOZDXLFSABMVAD to cache LRU end 2024-09-12T01:04:13.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.810+0000 7f75e3a15800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:EWTAWEVOZDXLFSABMVAD, ofs0, ns] 2024-09-12T01:04:13.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.810+0000 7f74c27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497054 cookie 94112517924352 notifier 8468 bl.length()=186 2024-09-12T01:04:13.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.810+0000 7f74c27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+EWTAWEVOZDXLFSABMVAD info.flags=0x7 2024-09-12T01:04:13.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.810+0000 7f74c27fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+EWTAWEVOZDXLFSABMVAD to cache LRU end 2024-09-12T01:04:13.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.813+0000 7f75e3a15800 20 linked user foo.client.0 to account RGW11111111111111111 2024-09-12T01:04:13.811 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T01:04:13.812 INFO:teuthology.orchestra.run.smithi073.stdout: "user_id": "foo.client.0", 2024-09-12T01:04:13.812 INFO:teuthology.orchestra.run.smithi073.stdout: "display_name": "Mr.RGW11111111111111111", 2024-09-12T01:04:13.812 INFO:teuthology.orchestra.run.smithi073.stdout: "email": "foo+test@test.test", 2024-09-12T01:04:13.812 INFO:teuthology.orchestra.run.smithi073.stdout: "suspended": 0, 2024-09-12T01:04:13.812 INFO:teuthology.orchestra.run.smithi073.stdout: "max_buckets": 1000, 2024-09-12T01:04:13.812 INFO:teuthology.orchestra.run.smithi073.stdout: "subusers": [], 2024-09-12T01:04:13.812 INFO:teuthology.orchestra.run.smithi073.stdout: "keys": [ 2024-09-12T01:04:13.812 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T01:04:13.812 INFO:teuthology.orchestra.run.smithi073.stdout: "user": "foo.client.0", 2024-09-12T01:04:13.812 INFO:teuthology.orchestra.run.smithi073.stdout: "access_key": "EWTAWEVOZDXLFSABMVAD", 2024-09-12T01:04:13.813 INFO:teuthology.orchestra.run.smithi073.stdout: "secret_key": "9axdh9ZLbXJDPLN1ARISEH1QFzfosYVcTx2dBCFeTOJt1oUJmeLTVg==", 2024-09-12T01:04:13.813 INFO:teuthology.orchestra.run.smithi073.stdout: "active": true, 2024-09-12T01:04:13.813 INFO:teuthology.orchestra.run.smithi073.stdout: "create_date": "2024-09-12T01:04:13.803844Z" 2024-09-12T01:04:13.813 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T01:04:13.813 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-12T01:04:13.813 INFO:teuthology.orchestra.run.smithi073.stdout: "swift_keys": [], 2024-09-12T01:04:13.813 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": [], 2024-09-12T01:04:13.813 INFO:teuthology.orchestra.run.smithi073.stdout: "op_mask": "read, write, delete", 2024-09-12T01:04:13.813 INFO:teuthology.orchestra.run.smithi073.stdout: "default_placement": "", 2024-09-12T01:04:13.813 INFO:teuthology.orchestra.run.smithi073.stdout: "default_storage_class": "", 2024-09-12T01:04:13.813 INFO:teuthology.orchestra.run.smithi073.stdout: "placement_tags": [], 2024-09-12T01:04:13.813 INFO:teuthology.orchestra.run.smithi073.stdout: "bucket_quota": { 2024-09-12T01:04:13.814 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": false, 2024-09-12T01:04:13.814 INFO:teuthology.orchestra.run.smithi073.stdout: "check_on_raw": false, 2024-09-12T01:04:13.814 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size": -1, 2024-09-12T01:04:13.814 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size_kb": 0, 2024-09-12T01:04:13.814 INFO:teuthology.orchestra.run.smithi073.stdout: "max_objects": -1 2024-09-12T01:04:13.814 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T01:04:13.814 INFO:teuthology.orchestra.run.smithi073.stdout: "user_quota": { 2024-09-12T01:04:13.814 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": false, 2024-09-12T01:04:13.814 INFO:teuthology.orchestra.run.smithi073.stdout: "check_on_raw": false, 2024-09-12T01:04:13.814 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size": -1, 2024-09-12T01:04:13.814 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size_kb": 0, 2024-09-12T01:04:13.814 INFO:teuthology.orchestra.run.smithi073.stdout: "max_objects": -1 2024-09-12T01:04:13.815 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T01:04:13.815 INFO:teuthology.orchestra.run.smithi073.stdout: "temp_url_keys": [], 2024-09-12T01:04:13.815 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "root", 2024-09-12T01:04:13.815 INFO:teuthology.orchestra.run.smithi073.stdout: "mfa_ids": [], 2024-09-12T01:04:13.815 INFO:teuthology.orchestra.run.smithi073.stdout: "account_id": "RGW11111111111111111", 2024-09-12T01:04:13.815 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/", 2024-09-12T01:04:13.815 INFO:teuthology.orchestra.run.smithi073.stdout: "create_date": "2024-09-12T01:04:13.803830Z", 2024-09-12T01:04:13.815 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-12T01:04:13.815 INFO:teuthology.orchestra.run.smithi073.stdout: "group_ids": [] 2024-09-12T01:04:13.815 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T01:04:13.816 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:04:13.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.813+0000 7f7495fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:13.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.816+0000 7f75e3a15800 20 remove_watcher() i=0 2024-09-12T01:04:13.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.816+0000 7f75e3a15800 2 removed watcher, disabling cache 2024-09-12T01:04:13.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.817+0000 7f75e3a15800 20 remove_watcher() i=1 2024-09-12T01:04:13.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.818+0000 7f75e3a15800 20 remove_watcher() i=2 2024-09-12T01:04:13.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.819+0000 7f75e3a15800 20 remove_watcher() i=3 2024-09-12T01:04:13.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.820+0000 7f75e3a15800 20 remove_watcher() i=4 2024-09-12T01:04:13.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.821+0000 7f75e3a15800 20 remove_watcher() i=5 2024-09-12T01:04:13.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.822+0000 7f75e3a15800 20 remove_watcher() i=6 2024-09-12T01:04:13.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.823+0000 7f75e3a15800 20 remove_watcher() i=7 2024-09-12T01:04:13.833 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 0258957759 --totp-seed JYFMAHKYMB7QG3QHCDVRMI52GSXA5VIS3HFTIG67JYOODZCXF6NBXNTCGXRU5JJA --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T01:04:13.899 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:04:13.899 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:04:13.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.933+0000 7fcd4f411800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.934+0000 7fcd4f411800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:13.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.934+0000 7fcd4f411800 20 realm 2024-09-12T01:04:13.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.934+0000 7fcd4f411800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.935+0000 7fcd4f411800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:13.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.935+0000 7fcd4f411800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:04:13.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.935+0000 7fcd4f411800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.935+0000 7fcd4f411800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:13.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.935+0000 7fcd4f411800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.936+0000 7fcd4f411800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:13.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.936+0000 7fcd4f411800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.936+0000 7fcd4f411800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:04:13.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.936+0000 7fcd4f411800 20 searching for the correct realm 2024-09-12T01:04:13.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.939+0000 7fcd4b393640 0 -- 172.21.15.73:0/1785269279 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fcd4002d070 msgr2=0x7fcd4003da80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:13.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.943+0000 7fcd4a391640 0 -- 172.21.15.73:0/1785269279 >> [v2:172.21.15.117:6800/110688882,v1:172.21.15.117:6801/110688882] conn(0x564b367aa620 msgr2=0x564b367aca10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:13.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.947+0000 7fcd4f411800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T01:04:13.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.947+0000 7fcd4f411800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:04:13.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.947+0000 7fcd4f411800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T01:04:13.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.947+0000 7fcd4f411800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:04:13.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.947+0000 7fcd4f411800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:04:13.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.947+0000 7fcd4f411800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:04:13.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.947+0000 7fcd4f411800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.947+0000 7fcd4f411800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:13.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.947+0000 7fcd4f411800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.947+0000 7fcd4f411800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:13.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.947+0000 7fcd4f411800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.948+0000 7fcd4f411800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:04:13.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.948+0000 7fcd4f411800 20 zone default found 2024-09-12T01:04:13.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.948+0000 7fcd4f411800 4 Realm: () 2024-09-12T01:04:13.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.948+0000 7fcd4f411800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T01:04:13.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.948+0000 7fcd4f411800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T01:04:13.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.948+0000 7fcd4f411800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:04:13.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.948+0000 7fcd4f411800 20 zonegroup default 2024-09-12T01:04:13.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.948+0000 7fcd4f411800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.948+0000 7fcd4f411800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:13.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.948+0000 7fcd4f411800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.948+0000 7fcd4f411800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:13.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.948+0000 7fcd4f411800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.948+0000 7fcd4f411800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:13.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.948+0000 7fcd4f411800 20 started sync module instance, tier type = 2024-09-12T01:04:13.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.948+0000 7fcd4f411800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T01:04:13.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.957+0000 7fcd4f411800 20 add_watcher() i=0 2024-09-12T01:04:13.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.957+0000 7fcd4f411800 20 add_watcher() i=1 2024-09-12T01:04:13.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.957+0000 7fcd4f411800 20 add_watcher() i=2 2024-09-12T01:04:13.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.957+0000 7fcd4f411800 20 add_watcher() i=3 2024-09-12T01:04:13.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.957+0000 7fcd4f411800 20 add_watcher() i=4 2024-09-12T01:04:13.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.957+0000 7fcd4f411800 20 add_watcher() i=5 2024-09-12T01:04:13.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.957+0000 7fcd4f411800 20 add_watcher() i=6 2024-09-12T01:04:13.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.958+0000 7fcd4f411800 20 add_watcher() i=7 2024-09-12T01:04:13.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.958+0000 7fcd4f411800 2 all 8 watchers are set, enabling cache 2024-09-12T01:04:13.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.960+0000 7fcc017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:13.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.960+0000 7fcd4f411800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:04:13.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.960+0000 7fcd4f411800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:04:13.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.960+0000 7fcd4f411800 5 note: GC not initialized 2024-09-12T01:04:13.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.960+0000 7fcb7bfff640 20 reqs_thread_entry: start 2024-09-12T01:04:13.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.960+0000 7fcd4f411800 20 init_complete bucket index max shards: 1 2024-09-12T01:04:13.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.960+0000 7fcd4f411800 20 Filter name: none 2024-09-12T01:04:13.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.960+0000 7fcb79ffb640 20 reqs_thread_entry: start 2024-09-12T01:04:13.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.960+0000 7fcd4f411800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-12T01:04:13.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.960+0000 7fcd4f411800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.961+0000 7fcd4f411800 20 rados_obj.operate() r=0 bl.length=488 2024-09-12T01:04:13.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.961+0000 7fcd4f411800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2024-09-12T01:04:13.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.961+0000 7fcd4f411800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T01:04:13.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:13.961+0000 7fcd4f411800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:04:15.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.403+0000 7fcd4f411800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T01:04:15.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.403+0000 7fcd4f411800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T01:04:15.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.403+0000 7fcd4f411800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-12T01:04:15.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.403+0000 7fcc2dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431720 cookie 94881036551872 notifier 8483 bl.length()=687 2024-09-12T01:04:15.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.403+0000 7fcc2dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T01:04:15.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.403+0000 7fcc2dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T01:04:15.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.406+0000 7fcc017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:15.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.409+0000 7fcd4f411800 20 remove_watcher() i=0 2024-09-12T01:04:15.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.409+0000 7fcd4f411800 2 removed watcher, disabling cache 2024-09-12T01:04:15.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.411+0000 7fcd4f411800 20 remove_watcher() i=1 2024-09-12T01:04:15.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.412+0000 7fcd4f411800 20 remove_watcher() i=2 2024-09-12T01:04:15.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.413+0000 7fcd4f411800 20 remove_watcher() i=3 2024-09-12T01:04:15.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.414+0000 7fcd4f411800 20 remove_watcher() i=4 2024-09-12T01:04:15.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.415+0000 7fcd4f411800 20 remove_watcher() i=5 2024-09-12T01:04:15.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.416+0000 7fcd4f411800 20 remove_watcher() i=6 2024-09-12T01:04:15.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.418+0000 7fcd4f411800 20 remove_watcher() i=7 2024-09-12T01:04:15.429 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2024-09-12T01:04:15.430 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name Mr.bar.client.0 --email bar+test@test.test --access-key ZBAZPRLCVTHFYBREVAFM --secret 24hUpfTJO26Ss5FIAstUlfj9GD+xy28jCZSx5sQr3IFcp9sZ4aL9NA== --cluster ceph 2024-09-12T01:04:15.497 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:04:15.497 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:04:15.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.532+0000 7fbc7c12c800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.534+0000 7fbc7c12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:15.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.534+0000 7fbc7c12c800 20 realm 2024-09-12T01:04:15.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.534+0000 7fbc7c12c800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.534+0000 7fbc7c12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:15.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.534+0000 7fbc7c12c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:04:15.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.534+0000 7fbc7c12c800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.534+0000 7fbc7c12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:15.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.534+0000 7fbc7c12c800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.535+0000 7fbc7c12c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:15.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.535+0000 7fbc7c12c800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.536+0000 7fbc7c12c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:04:15.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.536+0000 7fbc7c12c800 20 searching for the correct realm 2024-09-12T01:04:15.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.538+0000 7fbc7853f640 0 -- 172.21.15.73:0/3471863570 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fbc6003f040 msgr2=0x7fbc6002e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:15.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.745+0000 7fbc7853f640 0 -- 172.21.15.73:0/3471863570 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fbc6003f040 msgr2=0x7fbc6002e990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:15.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.749+0000 7fbc7c12c800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T01:04:15.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.749+0000 7fbc7c12c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:04:15.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.749+0000 7fbc7c12c800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T01:04:15.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.749+0000 7fbc7c12c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:04:15.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.749+0000 7fbc7c12c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:04:15.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.749+0000 7fbc7c12c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:04:15.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.749+0000 7fbc7c12c800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.749+0000 7fbc7c12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:15.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.749+0000 7fbc7c12c800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.750+0000 7fbc7c12c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:15.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.750+0000 7fbc7c12c800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.750+0000 7fbc7c12c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:04:15.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.750+0000 7fbc7c12c800 20 zone default found 2024-09-12T01:04:15.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.750+0000 7fbc7c12c800 4 Realm: () 2024-09-12T01:04:15.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.750+0000 7fbc7c12c800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T01:04:15.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.750+0000 7fbc7c12c800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T01:04:15.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.750+0000 7fbc7c12c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:04:15.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.750+0000 7fbc7c12c800 20 zonegroup default 2024-09-12T01:04:15.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.750+0000 7fbc7c12c800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.750+0000 7fbc7c12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:15.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.750+0000 7fbc7c12c800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.751+0000 7fbc7c12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:15.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.751+0000 7fbc7c12c800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.751+0000 7fbc7c12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:15.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.751+0000 7fbc7c12c800 20 started sync module instance, tier type = 2024-09-12T01:04:15.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.751+0000 7fbc7c12c800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T01:04:15.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.760+0000 7fbc7c12c800 20 add_watcher() i=0 2024-09-12T01:04:15.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.760+0000 7fbc7c12c800 20 add_watcher() i=1 2024-09-12T01:04:15.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.760+0000 7fbc7c12c800 20 add_watcher() i=2 2024-09-12T01:04:15.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.760+0000 7fbc7c12c800 20 add_watcher() i=3 2024-09-12T01:04:15.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.761+0000 7fbc7c12c800 20 add_watcher() i=4 2024-09-12T01:04:15.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.761+0000 7fbc7c12c800 20 add_watcher() i=5 2024-09-12T01:04:15.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.761+0000 7fbc7c12c800 20 add_watcher() i=6 2024-09-12T01:04:15.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.761+0000 7fbc7c12c800 20 add_watcher() i=7 2024-09-12T01:04:15.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.761+0000 7fbc7c12c800 2 all 8 watchers are set, enabling cache 2024-09-12T01:04:15.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.763+0000 7fbb2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:15.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.763+0000 7fbc7c12c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:04:15.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.763+0000 7fbc7c12c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:04:15.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.763+0000 7fbc7c12c800 5 note: GC not initialized 2024-09-12T01:04:15.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.764+0000 7fbb2cfe1640 20 reqs_thread_entry: start 2024-09-12T01:04:15.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.764+0000 7fbc7c12c800 20 init_complete bucket index max shards: 1 2024-09-12T01:04:15.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.764+0000 7fbc7c12c800 20 Filter name: none 2024-09-12T01:04:15.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.764+0000 7fbaa67fc640 20 reqs_thread_entry: start 2024-09-12T01:04:15.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.764+0000 7fbc7c12c800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-12T01:04:15.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.764+0000 7fbc7c12c800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.764+0000 7fbc7c12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:15.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.764+0000 7fbc7c12c800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2024-09-12T01:04:15.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.764+0000 7fbc7c12c800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T01:04:15.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.764+0000 7fbc7c12c800 10 cache get: name=default.rgw.meta+users.email+bar+test@test.test : miss 2024-09-12T01:04:15.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.764+0000 7fbc7c12c800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.765+0000 7fbc7c12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:15.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.765+0000 7fbc7c12c800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x0 2024-09-12T01:04:15.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.765+0000 7fbc7c12c800 10 adding default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T01:04:15.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.765+0000 7fbc7c12c800 10 cache get: name=default.rgw.meta+users.keys+ZBAZPRLCVTHFYBREVAFM : miss 2024-09-12T01:04:15.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.765+0000 7fbc7c12c800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.765+0000 7fbc7c12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:15.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.765+0000 7fbc7c12c800 10 cache put: name=default.rgw.meta+users.keys+ZBAZPRLCVTHFYBREVAFM info.flags=0x0 2024-09-12T01:04:15.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.765+0000 7fbc7c12c800 10 adding default.rgw.meta+users.keys+ZBAZPRLCVTHFYBREVAFM to cache LRU end 2024-09-12T01:04:15.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.765+0000 7fbc7c12c800 10 cache get: name=default.rgw.meta+users.keys+ZBAZPRLCVTHFYBREVAFM : hit (negative entry) 2024-09-12T01:04:15.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.765+0000 7fbc7c12c800 10 cache get: name=default.rgw.meta+users.keys+ZBAZPRLCVTHFYBREVAFM : hit (negative entry) 2024-09-12T01:04:15.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.766+0000 7fbc7c12c800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T01:04:15.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.766+0000 7fbc7c12c800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T01:04:15.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.766+0000 7fbc7c12c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-12T01:04:15.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.767+0000 7fbb56ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431672 cookie 94803870969632 notifier 8501 bl.length()=645 2024-09-12T01:04:15.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.767+0000 7fbb56ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T01:04:15.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.767+0000 7fbb56ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T01:04:15.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.769+0000 7fbc7c12c800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-12T01:04:15.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.769+0000 7fbc7c12c800 10 moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T01:04:15.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.769+0000 7fbc7c12c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:bar+test@test.test, ofs0, ns] 2024-09-12T01:04:15.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.770+0000 7fbb56ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431785 cookie 94803870986896 notifier 8501 bl.length()=185 2024-09-12T01:04:15.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.770+0000 7fbb56ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-12T01:04:15.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.770+0000 7fbb56ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T01:04:15.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.772+0000 7fbc7c12c800 10 cache put: name=default.rgw.meta+users.keys+ZBAZPRLCVTHFYBREVAFM info.flags=0x7 2024-09-12T01:04:15.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.772+0000 7fbc7c12c800 10 moving default.rgw.meta+users.keys+ZBAZPRLCVTHFYBREVAFM to cache LRU end 2024-09-12T01:04:15.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.772+0000 7fbc7c12c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:ZBAZPRLCVTHFYBREVAFM, ofs0, ns] 2024-09-12T01:04:15.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.773+0000 7fbb56ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431721 cookie 94803870976624 notifier 8501 bl.length()=186 2024-09-12T01:04:15.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.773+0000 7fbb56ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+ZBAZPRLCVTHFYBREVAFM info.flags=0x7 2024-09-12T01:04:15.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.773+0000 7fbb56ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+ZBAZPRLCVTHFYBREVAFM to cache LRU end 2024-09-12T01:04:15.773 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T01:04:15.773 INFO:teuthology.orchestra.run.smithi073.stdout: "user_id": "bar.client.0", 2024-09-12T01:04:15.773 INFO:teuthology.orchestra.run.smithi073.stdout: "display_name": "Mr.bar.client.0", 2024-09-12T01:04:15.773 INFO:teuthology.orchestra.run.smithi073.stdout: "email": "bar+test@test.test", 2024-09-12T01:04:15.773 INFO:teuthology.orchestra.run.smithi073.stdout: "suspended": 0, 2024-09-12T01:04:15.773 INFO:teuthology.orchestra.run.smithi073.stdout: "max_buckets": 1000, 2024-09-12T01:04:15.773 INFO:teuthology.orchestra.run.smithi073.stdout: "subusers": [], 2024-09-12T01:04:15.773 INFO:teuthology.orchestra.run.smithi073.stdout: "keys": [ 2024-09-12T01:04:15.773 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T01:04:15.773 INFO:teuthology.orchestra.run.smithi073.stdout: "user": "bar.client.0", 2024-09-12T01:04:15.773 INFO:teuthology.orchestra.run.smithi073.stdout: "access_key": "ZBAZPRLCVTHFYBREVAFM", 2024-09-12T01:04:15.774 INFO:teuthology.orchestra.run.smithi073.stdout: "secret_key": "24hUpfTJO26Ss5FIAstUlfj9GD+xy28jCZSx5sQr3IFcp9sZ4aL9NA==", 2024-09-12T01:04:15.774 INFO:teuthology.orchestra.run.smithi073.stdout: "active": true, 2024-09-12T01:04:15.774 INFO:teuthology.orchestra.run.smithi073.stdout: "create_date": "2024-09-12T01:04:15.766050Z" 2024-09-12T01:04:15.774 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T01:04:15.774 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-12T01:04:15.774 INFO:teuthology.orchestra.run.smithi073.stdout: "swift_keys": [], 2024-09-12T01:04:15.774 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": [], 2024-09-12T01:04:15.774 INFO:teuthology.orchestra.run.smithi073.stdout: "op_mask": "read, write, delete", 2024-09-12T01:04:15.774 INFO:teuthology.orchestra.run.smithi073.stdout: "default_placement": "", 2024-09-12T01:04:15.774 INFO:teuthology.orchestra.run.smithi073.stdout: "default_storage_class": "", 2024-09-12T01:04:15.774 INFO:teuthology.orchestra.run.smithi073.stdout: "placement_tags": [], 2024-09-12T01:04:15.774 INFO:teuthology.orchestra.run.smithi073.stdout: "bucket_quota": { 2024-09-12T01:04:15.775 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": false, 2024-09-12T01:04:15.775 INFO:teuthology.orchestra.run.smithi073.stdout: "check_on_raw": false, 2024-09-12T01:04:15.775 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size": -1, 2024-09-12T01:04:15.775 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size_kb": 0, 2024-09-12T01:04:15.775 INFO:teuthology.orchestra.run.smithi073.stdout: "max_objects": -1 2024-09-12T01:04:15.775 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T01:04:15.775 INFO:teuthology.orchestra.run.smithi073.stdout: "user_quota": { 2024-09-12T01:04:15.775 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": false, 2024-09-12T01:04:15.775 INFO:teuthology.orchestra.run.smithi073.stdout: "check_on_raw": false, 2024-09-12T01:04:15.775 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size": -1, 2024-09-12T01:04:15.775 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size_kb": 0, 2024-09-12T01:04:15.775 INFO:teuthology.orchestra.run.smithi073.stdout: "max_objects": -1 2024-09-12T01:04:15.775 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T01:04:15.775 INFO:teuthology.orchestra.run.smithi073.stdout: "temp_url_keys": [], 2024-09-12T01:04:15.776 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "rgw", 2024-09-12T01:04:15.776 INFO:teuthology.orchestra.run.smithi073.stdout: "mfa_ids": [], 2024-09-12T01:04:15.776 INFO:teuthology.orchestra.run.smithi073.stdout: "account_id": "", 2024-09-12T01:04:15.776 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/", 2024-09-12T01:04:15.776 INFO:teuthology.orchestra.run.smithi073.stdout: "create_date": "2024-09-12T01:04:15.766036Z", 2024-09-12T01:04:15.776 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-12T01:04:15.776 INFO:teuthology.orchestra.run.smithi073.stdout: "group_ids": [] 2024-09-12T01:04:15.776 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T01:04:15.776 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:04:15.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.775+0000 7fbb2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:15.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.777+0000 7fbc7c12c800 20 remove_watcher() i=0 2024-09-12T01:04:15.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.777+0000 7fbc7c12c800 2 removed watcher, disabling cache 2024-09-12T01:04:15.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.779+0000 7fbc7c12c800 20 remove_watcher() i=1 2024-09-12T01:04:15.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.780+0000 7fbc7c12c800 20 remove_watcher() i=2 2024-09-12T01:04:15.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.781+0000 7fbc7c12c800 20 remove_watcher() i=3 2024-09-12T01:04:15.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.782+0000 7fbc7c12c800 20 remove_watcher() i=4 2024-09-12T01:04:15.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.783+0000 7fbc7c12c800 20 remove_watcher() i=5 2024-09-12T01:04:15.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.784+0000 7fbc7c12c800 20 remove_watcher() i=6 2024-09-12T01:04:15.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.785+0000 7fbc7c12c800 20 remove_watcher() i=7 2024-09-12T01:04:15.795 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 7873852780 --totp-seed D2232QG44TZJKDEWTTQW5MMNBKDZMWO6RTZDSD64NOOIJ6MMYUNOVIMQU2O5GFL7 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T01:04:15.861 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:04:15.861 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:04:15.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.895+0000 7f5fc711f800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.897+0000 7f5fc711f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:15.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.897+0000 7f5fc711f800 20 realm 2024-09-12T01:04:15.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.897+0000 7f5fc711f800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.897+0000 7f5fc711f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:15.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.897+0000 7f5fc711f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:04:15.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.897+0000 7f5fc711f800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.897+0000 7f5fc711f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:15.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.897+0000 7f5fc711f800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.898+0000 7f5fc711f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:15.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.898+0000 7f5fc711f800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.899+0000 7f5fc711f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:04:15.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.899+0000 7f5fc711f800 20 searching for the correct realm 2024-09-12T01:04:15.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:15.901+0000 7f5fc36a3640 0 -- 172.21.15.73:0/1853871999 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f5fb802a920 msgr2=0x7f5fb800c450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:16.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.107+0000 7f5fc36a3640 0 -- 172.21.15.73:0/1853871999 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f5fb802a920 msgr2=0x7f5fb800c450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:16.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.111+0000 7f5fc711f800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T01:04:16.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.111+0000 7f5fc711f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:04:16.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.111+0000 7f5fc711f800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T01:04:16.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.111+0000 7f5fc711f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:04:16.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.111+0000 7f5fc711f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:04:16.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.111+0000 7f5fc711f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:04:16.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.111+0000 7f5fc711f800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.111+0000 7f5fc711f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:16.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.111+0000 7f5fc711f800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.112+0000 7f5fc711f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:16.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.112+0000 7f5fc711f800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.112+0000 7f5fc711f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:04:16.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.112+0000 7f5fc711f800 20 zone default found 2024-09-12T01:04:16.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.112+0000 7f5fc711f800 4 Realm: () 2024-09-12T01:04:16.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.112+0000 7f5fc711f800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T01:04:16.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.112+0000 7f5fc711f800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T01:04:16.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.112+0000 7f5fc711f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:04:16.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.112+0000 7f5fc711f800 20 zonegroup default 2024-09-12T01:04:16.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.112+0000 7f5fc711f800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.112+0000 7f5fc711f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:16.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.112+0000 7f5fc711f800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.112+0000 7f5fc711f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:16.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.112+0000 7f5fc711f800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.113+0000 7f5fc711f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:16.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.113+0000 7f5fc711f800 20 started sync module instance, tier type = 2024-09-12T01:04:16.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.113+0000 7f5fc711f800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T01:04:16.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.122+0000 7f5fc711f800 20 add_watcher() i=0 2024-09-12T01:04:16.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.122+0000 7f5fc711f800 20 add_watcher() i=1 2024-09-12T01:04:16.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.122+0000 7f5fc711f800 20 add_watcher() i=2 2024-09-12T01:04:16.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.122+0000 7f5fc711f800 20 add_watcher() i=3 2024-09-12T01:04:16.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.122+0000 7f5fc711f800 20 add_watcher() i=4 2024-09-12T01:04:16.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.122+0000 7f5fc711f800 20 add_watcher() i=5 2024-09-12T01:04:16.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.122+0000 7f5fc711f800 20 add_watcher() i=6 2024-09-12T01:04:16.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.123+0000 7f5fc711f800 20 add_watcher() i=7 2024-09-12T01:04:16.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.123+0000 7f5fc711f800 2 all 8 watchers are set, enabling cache 2024-09-12T01:04:16.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.124+0000 7f5e797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:16.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.124+0000 7f5fc711f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:04:16.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.124+0000 7f5fc711f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:04:16.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.124+0000 7f5fc711f800 5 note: GC not initialized 2024-09-12T01:04:16.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.125+0000 7f5df3fff640 20 reqs_thread_entry: start 2024-09-12T01:04:16.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.125+0000 7f5fc711f800 20 init_complete bucket index max shards: 1 2024-09-12T01:04:16.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.125+0000 7f5fc711f800 20 Filter name: none 2024-09-12T01:04:16.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.125+0000 7f5df1ffb640 20 reqs_thread_entry: start 2024-09-12T01:04:16.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.125+0000 7f5fc711f800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-12T01:04:16.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.125+0000 7f5fc711f800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.125+0000 7f5fc711f800 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T01:04:16.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.125+0000 7f5fc711f800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2024-09-12T01:04:16.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.125+0000 7f5fc711f800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T01:04:16.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.125+0000 7f5fc711f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:04:16.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.128+0000 7f5fc711f800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T01:04:16.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.128+0000 7f5fc711f800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T01:04:16.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.128+0000 7f5fc711f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-12T01:04:16.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.129+0000 7f5ea67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431673 cookie 94711246637216 notifier 8519 bl.length()=659 2024-09-12T01:04:16.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.129+0000 7f5ea67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T01:04:16.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.129+0000 7f5ea67fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T01:04:16.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.131+0000 7f5e797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:16.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.133+0000 7f5fc711f800 20 remove_watcher() i=0 2024-09-12T01:04:16.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.133+0000 7f5fc711f800 2 removed watcher, disabling cache 2024-09-12T01:04:16.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.134+0000 7f5fc711f800 20 remove_watcher() i=1 2024-09-12T01:04:16.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.135+0000 7f5fc711f800 20 remove_watcher() i=2 2024-09-12T01:04:16.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.136+0000 7f5fc711f800 20 remove_watcher() i=3 2024-09-12T01:04:16.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.137+0000 7f5fc711f800 20 remove_watcher() i=4 2024-09-12T01:04:16.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.138+0000 7f5fc711f800 20 remove_watcher() i=5 2024-09-12T01:04:16.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.139+0000 7f5fc711f800 20 remove_watcher() i=6 2024-09-12T01:04:16.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.140+0000 7f5fc711f800 20 remove_watcher() i=7 2024-09-12T01:04:16.150 DEBUG:tasks.s3tests:Creating user testx$tenanteduser.client.0 on client.0 2024-09-12T01:04:16.150 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name 'Mr.testx$tenanteduser.client.0' --email 'testx$tenanteduser+test@test.test' --access-key PPYCAHVLONZYIXXBDGAQ --secret rty/N9WUA4IoPwVoIHOBRmMk4VpTi5AKx4EUArInXW2tv+xr4Sv/5A== --cluster ceph 2024-09-12T01:04:16.214 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:04:16.214 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:04:16.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.248+0000 7f598b72e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.250+0000 7f598b72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:16.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.250+0000 7f598b72e800 20 realm 2024-09-12T01:04:16.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.250+0000 7f598b72e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.250+0000 7f598b72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:16.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.250+0000 7f598b72e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:04:16.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.250+0000 7f598b72e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.251+0000 7f598b72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:16.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.251+0000 7f598b72e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.251+0000 7f598b72e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:16.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.251+0000 7f598b72e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.252+0000 7f598b72e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:04:16.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.252+0000 7f598b72e800 20 searching for the correct realm 2024-09-12T01:04:16.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.253+0000 7f59874dd640 0 -- 172.21.15.73:0/2786519865 >> [v2:172.21.15.117:6816/1460498570,v1:172.21.15.117:6817/1460498570] conn(0x7f598006b070 msgr2=0x7f59800c3b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:16.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.467+0000 7f597ffff640 0 -- 172.21.15.73:0/2786519865 >> [v2:172.21.15.73:6826/269690776,v1:172.21.15.73:6827/269690776] conn(0x7f597803f070 msgr2=0x7f5978018fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:16.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.473+0000 7f598b72e800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T01:04:16.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.473+0000 7f598b72e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:04:16.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.473+0000 7f598b72e800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T01:04:16.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.473+0000 7f598b72e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:04:16.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.473+0000 7f598b72e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:04:16.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.473+0000 7f598b72e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:04:16.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.473+0000 7f598b72e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.474+0000 7f598b72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:16.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.474+0000 7f598b72e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.474+0000 7f598b72e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:16.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.474+0000 7f598b72e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.474+0000 7f598b72e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:04:16.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.474+0000 7f598b72e800 20 zone default found 2024-09-12T01:04:16.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.474+0000 7f598b72e800 4 Realm: () 2024-09-12T01:04:16.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.474+0000 7f598b72e800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T01:04:16.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.474+0000 7f598b72e800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T01:04:16.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.474+0000 7f598b72e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:04:16.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.474+0000 7f598b72e800 20 zonegroup default 2024-09-12T01:04:16.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.474+0000 7f598b72e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.474+0000 7f598b72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:16.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.474+0000 7f598b72e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.475+0000 7f598b72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:16.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.475+0000 7f598b72e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.475+0000 7f598b72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:16.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.475+0000 7f598b72e800 20 started sync module instance, tier type = 2024-09-12T01:04:16.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.475+0000 7f598b72e800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T01:04:16.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.485+0000 7f598b72e800 20 add_watcher() i=0 2024-09-12T01:04:16.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.485+0000 7f598b72e800 20 add_watcher() i=1 2024-09-12T01:04:16.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.485+0000 7f598b72e800 20 add_watcher() i=2 2024-09-12T01:04:16.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.485+0000 7f598b72e800 20 add_watcher() i=3 2024-09-12T01:04:16.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.485+0000 7f598b72e800 20 add_watcher() i=4 2024-09-12T01:04:16.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.485+0000 7f598b72e800 20 add_watcher() i=5 2024-09-12T01:04:16.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.485+0000 7f598b72e800 20 add_watcher() i=6 2024-09-12T01:04:16.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.485+0000 7f598b72e800 20 add_watcher() i=7 2024-09-12T01:04:16.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.485+0000 7f598b72e800 2 all 8 watchers are set, enabling cache 2024-09-12T01:04:16.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.487+0000 7f583dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:16.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.487+0000 7f598b72e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:04:16.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.487+0000 7f598b72e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:04:16.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.487+0000 7f598b72e800 5 note: GC not initialized 2024-09-12T01:04:16.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.488+0000 7f583cfe1640 20 reqs_thread_entry: start 2024-09-12T01:04:16.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.488+0000 7f598b72e800 20 init_complete bucket index max shards: 1 2024-09-12T01:04:16.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.488+0000 7f598b72e800 20 Filter name: none 2024-09-12T01:04:16.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.488+0000 7f57b67fc640 20 reqs_thread_entry: start 2024-09-12T01:04:16.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.488+0000 7f598b72e800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-12T01:04:16.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.488+0000 7f598b72e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.488+0000 7f598b72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:16.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.488+0000 7f598b72e800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2024-09-12T01:04:16.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.488+0000 7f598b72e800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T01:04:16.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.488+0000 7f598b72e800 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test : miss 2024-09-12T01:04:16.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.488+0000 7f598b72e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.489+0000 7f598b72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:16.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.489+0000 7f598b72e800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x0 2024-09-12T01:04:16.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.489+0000 7f598b72e800 10 adding default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T01:04:16.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.489+0000 7f598b72e800 10 cache get: name=default.rgw.meta+users.keys+PPYCAHVLONZYIXXBDGAQ : miss 2024-09-12T01:04:16.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.489+0000 7f598b72e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.489+0000 7f598b72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:16.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.489+0000 7f598b72e800 10 cache put: name=default.rgw.meta+users.keys+PPYCAHVLONZYIXXBDGAQ info.flags=0x0 2024-09-12T01:04:16.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.489+0000 7f598b72e800 10 adding default.rgw.meta+users.keys+PPYCAHVLONZYIXXBDGAQ to cache LRU end 2024-09-12T01:04:16.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.489+0000 7f598b72e800 10 cache get: name=default.rgw.meta+users.keys+PPYCAHVLONZYIXXBDGAQ : hit (negative entry) 2024-09-12T01:04:16.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.489+0000 7f598b72e800 10 cache get: name=default.rgw.meta+users.keys+PPYCAHVLONZYIXXBDGAQ : hit (negative entry) 2024-09-12T01:04:16.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.490+0000 7f598b72e800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T01:04:16.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.490+0000 7f598b72e800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T01:04:16.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.490+0000 7f598b72e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-12T01:04:16.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.490+0000 7f586affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399082 cookie 94410995415040 notifier 9120 bl.length()=719 2024-09-12T01:04:16.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.490+0000 7f586affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T01:04:16.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.490+0000 7f586affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T01:04:16.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.493+0000 7f598b72e800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-12T01:04:16.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.493+0000 7f598b72e800 10 moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T01:04:16.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.493+0000 7f598b72e800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser+test@test.test, ofs0, ns] 2024-09-12T01:04:16.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.494+0000 7f586affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398932 cookie 94410995420496 notifier 9120 bl.length()=215 2024-09-12T01:04:16.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.494+0000 7f586affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-12T01:04:16.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.494+0000 7f586affd640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T01:04:16.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.496+0000 7f598b72e800 10 cache put: name=default.rgw.meta+users.keys+PPYCAHVLONZYIXXBDGAQ info.flags=0x7 2024-09-12T01:04:16.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.496+0000 7f598b72e800 10 moving default.rgw.meta+users.keys+PPYCAHVLONZYIXXBDGAQ to cache LRU end 2024-09-12T01:04:16.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.496+0000 7f598b72e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:PPYCAHVLONZYIXXBDGAQ, ofs0, ns] 2024-09-12T01:04:16.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.496+0000 7f586a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399083 cookie 94410995406016 notifier 9120 bl.length()=201 2024-09-12T01:04:16.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.496+0000 7f586a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+PPYCAHVLONZYIXXBDGAQ info.flags=0x7 2024-09-12T01:04:16.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.496+0000 7f586a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+PPYCAHVLONZYIXXBDGAQ to cache LRU end 2024-09-12T01:04:16.496 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T01:04:16.496 INFO:teuthology.orchestra.run.smithi073.stdout: "user_id": "testx$tenanteduser.client.0", 2024-09-12T01:04:16.496 INFO:teuthology.orchestra.run.smithi073.stdout: "display_name": "Mr.testx$tenanteduser.client.0", 2024-09-12T01:04:16.497 INFO:teuthology.orchestra.run.smithi073.stdout: "email": "testx$tenanteduser+test@test.test", 2024-09-12T01:04:16.497 INFO:teuthology.orchestra.run.smithi073.stdout: "suspended": 0, 2024-09-12T01:04:16.497 INFO:teuthology.orchestra.run.smithi073.stdout: "max_buckets": 1000, 2024-09-12T01:04:16.497 INFO:teuthology.orchestra.run.smithi073.stdout: "subusers": [], 2024-09-12T01:04:16.497 INFO:teuthology.orchestra.run.smithi073.stdout: "keys": [ 2024-09-12T01:04:16.497 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T01:04:16.497 INFO:teuthology.orchestra.run.smithi073.stdout: "user": "testx$tenanteduser.client.0", 2024-09-12T01:04:16.497 INFO:teuthology.orchestra.run.smithi073.stdout: "access_key": "PPYCAHVLONZYIXXBDGAQ", 2024-09-12T01:04:16.497 INFO:teuthology.orchestra.run.smithi073.stdout: "secret_key": "rty/N9WUA4IoPwVoIHOBRmMk4VpTi5AKx4EUArInXW2tv+xr4Sv/5A==", 2024-09-12T01:04:16.497 INFO:teuthology.orchestra.run.smithi073.stdout: "active": true, 2024-09-12T01:04:16.497 INFO:teuthology.orchestra.run.smithi073.stdout: "create_date": "2024-09-12T01:04:16.490266Z" 2024-09-12T01:04:16.498 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T01:04:16.498 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-12T01:04:16.498 INFO:teuthology.orchestra.run.smithi073.stdout: "swift_keys": [], 2024-09-12T01:04:16.498 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": [], 2024-09-12T01:04:16.498 INFO:teuthology.orchestra.run.smithi073.stdout: "op_mask": "read, write, delete", 2024-09-12T01:04:16.498 INFO:teuthology.orchestra.run.smithi073.stdout: "default_placement": "", 2024-09-12T01:04:16.498 INFO:teuthology.orchestra.run.smithi073.stdout: "default_storage_class": "", 2024-09-12T01:04:16.498 INFO:teuthology.orchestra.run.smithi073.stdout: "placement_tags": [], 2024-09-12T01:04:16.499 INFO:teuthology.orchestra.run.smithi073.stdout: "bucket_quota": { 2024-09-12T01:04:16.499 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": false, 2024-09-12T01:04:16.499 INFO:teuthology.orchestra.run.smithi073.stdout: "check_on_raw": false, 2024-09-12T01:04:16.499 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size": -1, 2024-09-12T01:04:16.499 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size_kb": 0, 2024-09-12T01:04:16.499 INFO:teuthology.orchestra.run.smithi073.stdout: "max_objects": -1 2024-09-12T01:04:16.499 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T01:04:16.499 INFO:teuthology.orchestra.run.smithi073.stdout: "user_quota": { 2024-09-12T01:04:16.499 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": false, 2024-09-12T01:04:16.499 INFO:teuthology.orchestra.run.smithi073.stdout: "check_on_raw": false, 2024-09-12T01:04:16.499 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size": -1, 2024-09-12T01:04:16.499 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size_kb": 0, 2024-09-12T01:04:16.499 INFO:teuthology.orchestra.run.smithi073.stdout: "max_objects": -1 2024-09-12T01:04:16.499 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T01:04:16.500 INFO:teuthology.orchestra.run.smithi073.stdout: "temp_url_keys": [], 2024-09-12T01:04:16.500 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "rgw", 2024-09-12T01:04:16.500 INFO:teuthology.orchestra.run.smithi073.stdout: "mfa_ids": [], 2024-09-12T01:04:16.500 INFO:teuthology.orchestra.run.smithi073.stdout: "account_id": "", 2024-09-12T01:04:16.500 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/", 2024-09-12T01:04:16.500 INFO:teuthology.orchestra.run.smithi073.stdout: "create_date": "2024-09-12T01:04:16.490247Z", 2024-09-12T01:04:16.500 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-12T01:04:16.500 INFO:teuthology.orchestra.run.smithi073.stdout: "group_ids": [] 2024-09-12T01:04:16.500 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T01:04:16.500 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:04:16.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.498+0000 7f583dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:16.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.501+0000 7f598b72e800 20 remove_watcher() i=0 2024-09-12T01:04:16.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.501+0000 7f598b72e800 2 removed watcher, disabling cache 2024-09-12T01:04:16.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.502+0000 7f598b72e800 20 remove_watcher() i=1 2024-09-12T01:04:16.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.503+0000 7f598b72e800 20 remove_watcher() i=2 2024-09-12T01:04:16.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.504+0000 7f598b72e800 20 remove_watcher() i=3 2024-09-12T01:04:16.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.505+0000 7f598b72e800 20 remove_watcher() i=4 2024-09-12T01:04:16.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.506+0000 7f598b72e800 20 remove_watcher() i=5 2024-09-12T01:04:16.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.506+0000 7f598b72e800 20 remove_watcher() i=6 2024-09-12T01:04:16.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.508+0000 7f598b72e800 20 remove_watcher() i=7 2024-09-12T01:04:16.517 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 9757222094 --totp-seed WKGQF4NHLFBK2YJEMYR7AVJBN5KD5SVE5XB4TKNCHAEZKC45ERG6TQXLFG5MHHPH --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T01:04:16.583 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:04:16.583 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:04:16.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.617+0000 7f7b2cc0e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.619+0000 7f7b2cc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:16.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.619+0000 7f7b2cc0e800 20 realm 2024-09-12T01:04:16.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.619+0000 7f7b2cc0e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.619+0000 7f7b2cc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:16.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.619+0000 7f7b2cc0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:04:16.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.619+0000 7f7b2cc0e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.620+0000 7f7b2cc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:16.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.620+0000 7f7b2cc0e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.621+0000 7f7b2cc0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:16.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.621+0000 7f7b2cc0e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.622+0000 7f7b2cc0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:04:16.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.622+0000 7f7b2cc0e800 20 searching for the correct realm 2024-09-12T01:04:16.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.624+0000 7f7b28a5a640 0 -- 172.21.15.73:0/981565068 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f7b10047040 msgr2=0x7f7b10049660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:16.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.830+0000 7f7b28a5a640 0 -- 172.21.15.73:0/981565068 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f7b10047040 msgr2=0x7f7b10049660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:16.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.833+0000 7f7b2cc0e800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T01:04:16.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.833+0000 7f7b2cc0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:04:16.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.833+0000 7f7b2cc0e800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T01:04:16.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.833+0000 7f7b2cc0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:04:16.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.834+0000 7f7b2cc0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:04:16.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.834+0000 7f7b2cc0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:04:16.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.834+0000 7f7b2cc0e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.834+0000 7f7b2cc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:16.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.834+0000 7f7b2cc0e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.834+0000 7f7b2cc0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:16.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.834+0000 7f7b2cc0e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.834+0000 7f7b2cc0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:04:16.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.834+0000 7f7b2cc0e800 20 zone default found 2024-09-12T01:04:16.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.834+0000 7f7b2cc0e800 4 Realm: () 2024-09-12T01:04:16.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.834+0000 7f7b2cc0e800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T01:04:16.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.834+0000 7f7b2cc0e800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T01:04:16.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.834+0000 7f7b2cc0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:04:16.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.834+0000 7f7b2cc0e800 20 zonegroup default 2024-09-12T01:04:16.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.834+0000 7f7b2cc0e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.835+0000 7f7b2cc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:16.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.835+0000 7f7b2cc0e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.835+0000 7f7b2cc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:16.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.835+0000 7f7b2cc0e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.835+0000 7f7b2cc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:16.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.835+0000 7f7b2cc0e800 20 started sync module instance, tier type = 2024-09-12T01:04:16.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.835+0000 7f7b2cc0e800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T01:04:16.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.844+0000 7f7b2cc0e800 20 add_watcher() i=0 2024-09-12T01:04:16.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.844+0000 7f7b2cc0e800 20 add_watcher() i=1 2024-09-12T01:04:16.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.844+0000 7f7b2cc0e800 20 add_watcher() i=2 2024-09-12T01:04:16.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.844+0000 7f7b2cc0e800 20 add_watcher() i=3 2024-09-12T01:04:16.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.844+0000 7f7b2cc0e800 20 add_watcher() i=4 2024-09-12T01:04:16.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.844+0000 7f7b2cc0e800 20 add_watcher() i=5 2024-09-12T01:04:16.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.844+0000 7f7b2cc0e800 20 add_watcher() i=6 2024-09-12T01:04:16.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.845+0000 7f7b2cc0e800 20 add_watcher() i=7 2024-09-12T01:04:16.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.845+0000 7f7b2cc0e800 2 all 8 watchers are set, enabling cache 2024-09-12T01:04:16.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.847+0000 7f79defdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:16.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.847+0000 7f7b2cc0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:04:16.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.847+0000 7f7b2cc0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:04:16.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.847+0000 7f7b2cc0e800 5 note: GC not initialized 2024-09-12T01:04:16.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.847+0000 7f79ddfdb640 20 reqs_thread_entry: start 2024-09-12T01:04:16.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.847+0000 7f7b2cc0e800 20 init_complete bucket index max shards: 1 2024-09-12T01:04:16.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.847+0000 7f7b2cc0e800 20 Filter name: none 2024-09-12T01:04:16.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.847+0000 7f794f7fe640 20 reqs_thread_entry: start 2024-09-12T01:04:16.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.847+0000 7f7b2cc0e800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-12T01:04:16.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.847+0000 7f7b2cc0e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.848+0000 7f7b2cc0e800 20 rados_obj.operate() r=0 bl.length=519 2024-09-12T01:04:16.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.848+0000 7f7b2cc0e800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2024-09-12T01:04:16.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.848+0000 7f7b2cc0e800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T01:04:16.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.848+0000 7f7b2cc0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:04:16.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.850+0000 7f7b2cc0e800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T01:04:16.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.850+0000 7f7b2cc0e800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T01:04:16.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.850+0000 7f7b2cc0e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-12T01:04:16.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.850+0000 7f79ff7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399084 cookie 94400490197184 notifier 8549 bl.length()=733 2024-09-12T01:04:16.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.850+0000 7f79ff7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T01:04:16.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.850+0000 7f79ff7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T01:04:16.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.853+0000 7f79defdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:16.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.855+0000 7f7b2cc0e800 20 remove_watcher() i=0 2024-09-12T01:04:16.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.855+0000 7f7b2cc0e800 2 removed watcher, disabling cache 2024-09-12T01:04:16.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.856+0000 7f7b2cc0e800 20 remove_watcher() i=1 2024-09-12T01:04:16.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.857+0000 7f7b2cc0e800 20 remove_watcher() i=2 2024-09-12T01:04:16.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.858+0000 7f7b2cc0e800 20 remove_watcher() i=3 2024-09-12T01:04:16.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.859+0000 7f7b2cc0e800 20 remove_watcher() i=4 2024-09-12T01:04:16.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.860+0000 7f7b2cc0e800 20 remove_watcher() i=5 2024-09-12T01:04:16.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.861+0000 7f7b2cc0e800 20 remove_watcher() i=6 2024-09-12T01:04:16.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.862+0000 7f7b2cc0e800 20 remove_watcher() i=7 2024-09-12T01:04:16.872 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2024-09-12T01:04:16.872 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name Mr.foobar.client.0 --email foobar+test@test.test --access-key FFARUHRNAGVCMQUROLBB --secret bIH63zzhCjHBPQ6pu8GD85CMlfbaVJZhseuiFxjkRWro6FSeuAPSOw== --cluster ceph 2024-09-12T01:04:16.936 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:04:16.936 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:04:16.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.971+0000 7f1b90baf800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.973+0000 7f1b90baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:16.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.973+0000 7f1b90baf800 20 realm 2024-09-12T01:04:16.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.973+0000 7f1b90baf800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.973+0000 7f1b90baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:16.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.973+0000 7f1b90baf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:04:16.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.973+0000 7f1b90baf800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.973+0000 7f1b90baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:16.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.973+0000 7f1b90baf800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.974+0000 7f1b90baf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:16.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.974+0000 7f1b90baf800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.975+0000 7f1b90baf800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:04:16.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.975+0000 7f1b90baf800 20 searching for the correct realm 2024-09-12T01:04:16.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:16.976+0000 7f1b8e6a0640 0 -- 172.21.15.73:0/1355080236 >> [v2:172.21.15.117:6816/1460498570,v1:172.21.15.117:6817/1460498570] conn(0x7f1b78003cb0 msgr2=0x7f1b88080d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:17.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.182+0000 7f1b8de9f640 0 -- 172.21.15.73:0/1355080236 >> [v2:172.21.15.73:6826/269690776,v1:172.21.15.73:6827/269690776] conn(0x7f1b800a0040 msgr2=0x7f1b800a0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:17.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.188+0000 7f1b90baf800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T01:04:17.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.188+0000 7f1b90baf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:04:17.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.188+0000 7f1b90baf800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T01:04:17.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.188+0000 7f1b90baf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:04:17.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.188+0000 7f1b90baf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:04:17.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.188+0000 7f1b90baf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:04:17.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.188+0000 7f1b90baf800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.188+0000 7f1b90baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:17.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.188+0000 7f1b90baf800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.189+0000 7f1b90baf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:17.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.189+0000 7f1b90baf800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.189+0000 7f1b90baf800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:04:17.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.189+0000 7f1b90baf800 20 zone default found 2024-09-12T01:04:17.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.189+0000 7f1b90baf800 4 Realm: () 2024-09-12T01:04:17.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.189+0000 7f1b90baf800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T01:04:17.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.189+0000 7f1b90baf800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T01:04:17.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.189+0000 7f1b90baf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:04:17.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.189+0000 7f1b90baf800 20 zonegroup default 2024-09-12T01:04:17.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.189+0000 7f1b90baf800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.190+0000 7f1b90baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:17.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.190+0000 7f1b90baf800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.190+0000 7f1b90baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:17.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.190+0000 7f1b90baf800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.190+0000 7f1b90baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:17.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.190+0000 7f1b90baf800 20 started sync module instance, tier type = 2024-09-12T01:04:17.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.190+0000 7f1b90baf800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T01:04:17.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.200+0000 7f1b90baf800 20 add_watcher() i=0 2024-09-12T01:04:17.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.200+0000 7f1b90baf800 20 add_watcher() i=1 2024-09-12T01:04:17.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.200+0000 7f1b90baf800 20 add_watcher() i=2 2024-09-12T01:04:17.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.200+0000 7f1b90baf800 20 add_watcher() i=3 2024-09-12T01:04:17.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.200+0000 7f1b90baf800 20 add_watcher() i=4 2024-09-12T01:04:17.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.200+0000 7f1b90baf800 20 add_watcher() i=5 2024-09-12T01:04:17.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.200+0000 7f1b90baf800 20 add_watcher() i=6 2024-09-12T01:04:17.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.201+0000 7f1b90baf800 20 add_watcher() i=7 2024-09-12T01:04:17.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.201+0000 7f1b90baf800 2 all 8 watchers are set, enabling cache 2024-09-12T01:04:17.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.203+0000 7f1a44fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:17.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.203+0000 7f1b90baf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:04:17.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.203+0000 7f1b90baf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:04:17.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.203+0000 7f1b90baf800 5 note: GC not initialized 2024-09-12T01:04:17.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.203+0000 7f19bf7fe640 20 reqs_thread_entry: start 2024-09-12T01:04:17.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.203+0000 7f1b90baf800 20 init_complete bucket index max shards: 1 2024-09-12T01:04:17.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.203+0000 7f1b90baf800 20 Filter name: none 2024-09-12T01:04:17.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.203+0000 7f19bd7fa640 20 reqs_thread_entry: start 2024-09-12T01:04:17.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.203+0000 7f1b90baf800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T01:04:17.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.203+0000 7f1b90baf800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.204+0000 7f1b90baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:17.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.204+0000 7f1b90baf800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2024-09-12T01:04:17.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.204+0000 7f1b90baf800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T01:04:17.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.204+0000 7f1b90baf800 10 cache get: name=default.rgw.meta+users.email+foobar+test@test.test : miss 2024-09-12T01:04:17.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.204+0000 7f1b90baf800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.204+0000 7f1b90baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:17.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.204+0000 7f1b90baf800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x0 2024-09-12T01:04:17.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.204+0000 7f1b90baf800 10 adding default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T01:04:17.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.204+0000 7f1b90baf800 10 cache get: name=default.rgw.meta+users.keys+FFARUHRNAGVCMQUROLBB : miss 2024-09-12T01:04:17.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.204+0000 7f1b90baf800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.204+0000 7f1b90baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:17.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.204+0000 7f1b90baf800 10 cache put: name=default.rgw.meta+users.keys+FFARUHRNAGVCMQUROLBB info.flags=0x0 2024-09-12T01:04:17.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.204+0000 7f1b90baf800 10 adding default.rgw.meta+users.keys+FFARUHRNAGVCMQUROLBB to cache LRU end 2024-09-12T01:04:17.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.204+0000 7f1b90baf800 10 cache get: name=default.rgw.meta+users.keys+FFARUHRNAGVCMQUROLBB : hit (negative entry) 2024-09-12T01:04:17.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.204+0000 7f1b90baf800 10 cache get: name=default.rgw.meta+users.keys+FFARUHRNAGVCMQUROLBB : hit (negative entry) 2024-09-12T01:04:17.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.206+0000 7f1b90baf800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T01:04:17.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.206+0000 7f1b90baf800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T01:04:17.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.206+0000 7f1b90baf800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T01:04:17.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.206+0000 7f1a71ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398933 cookie 93854928625568 notifier 8564 bl.length()=660 2024-09-12T01:04:17.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.206+0000 7f1a71ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T01:04:17.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.206+0000 7f1a71ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T01:04:17.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.209+0000 7f1b90baf800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-12T01:04:17.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.209+0000 7f1b90baf800 10 moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T01:04:17.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.209+0000 7f1b90baf800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:foobar+test@test.test, ofs0, ns] 2024-09-12T01:04:17.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.209+0000 7f1a71ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398970 cookie 93854928599344 notifier 8564 bl.length()=191 2024-09-12T01:04:17.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.209+0000 7f1a71ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-12T01:04:17.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.209+0000 7f1a71ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T01:04:17.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.212+0000 7f1b90baf800 10 cache put: name=default.rgw.meta+users.keys+FFARUHRNAGVCMQUROLBB info.flags=0x7 2024-09-12T01:04:17.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.212+0000 7f1b90baf800 10 moving default.rgw.meta+users.keys+FFARUHRNAGVCMQUROLBB to cache LRU end 2024-09-12T01:04:17.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.212+0000 7f1b90baf800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:FFARUHRNAGVCMQUROLBB, ofs0, ns] 2024-09-12T01:04:17.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.212+0000 7f1a71ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399008 cookie 93854928607712 notifier 8564 bl.length()=189 2024-09-12T01:04:17.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.212+0000 7f1a71ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+FFARUHRNAGVCMQUROLBB info.flags=0x7 2024-09-12T01:04:17.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.212+0000 7f1a71ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+FFARUHRNAGVCMQUROLBB to cache LRU end 2024-09-12T01:04:17.212 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T01:04:17.212 INFO:teuthology.orchestra.run.smithi073.stdout: "user_id": "foobar.client.0", 2024-09-12T01:04:17.212 INFO:teuthology.orchestra.run.smithi073.stdout: "display_name": "Mr.foobar.client.0", 2024-09-12T01:04:17.212 INFO:teuthology.orchestra.run.smithi073.stdout: "email": "foobar+test@test.test", 2024-09-12T01:04:17.212 INFO:teuthology.orchestra.run.smithi073.stdout: "suspended": 0, 2024-09-12T01:04:17.212 INFO:teuthology.orchestra.run.smithi073.stdout: "max_buckets": 1000, 2024-09-12T01:04:17.213 INFO:teuthology.orchestra.run.smithi073.stdout: "subusers": [], 2024-09-12T01:04:17.213 INFO:teuthology.orchestra.run.smithi073.stdout: "keys": [ 2024-09-12T01:04:17.213 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T01:04:17.213 INFO:teuthology.orchestra.run.smithi073.stdout: "user": "foobar.client.0", 2024-09-12T01:04:17.213 INFO:teuthology.orchestra.run.smithi073.stdout: "access_key": "FFARUHRNAGVCMQUROLBB", 2024-09-12T01:04:17.213 INFO:teuthology.orchestra.run.smithi073.stdout: "secret_key": "bIH63zzhCjHBPQ6pu8GD85CMlfbaVJZhseuiFxjkRWro6FSeuAPSOw==", 2024-09-12T01:04:17.213 INFO:teuthology.orchestra.run.smithi073.stdout: "active": true, 2024-09-12T01:04:17.213 INFO:teuthology.orchestra.run.smithi073.stdout: "create_date": "2024-09-12T01:04:17.205647Z" 2024-09-12T01:04:17.213 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T01:04:17.213 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-12T01:04:17.213 INFO:teuthology.orchestra.run.smithi073.stdout: "swift_keys": [], 2024-09-12T01:04:17.213 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": [], 2024-09-12T01:04:17.213 INFO:teuthology.orchestra.run.smithi073.stdout: "op_mask": "read, write, delete", 2024-09-12T01:04:17.214 INFO:teuthology.orchestra.run.smithi073.stdout: "default_placement": "", 2024-09-12T01:04:17.214 INFO:teuthology.orchestra.run.smithi073.stdout: "default_storage_class": "", 2024-09-12T01:04:17.214 INFO:teuthology.orchestra.run.smithi073.stdout: "placement_tags": [], 2024-09-12T01:04:17.214 INFO:teuthology.orchestra.run.smithi073.stdout: "bucket_quota": { 2024-09-12T01:04:17.214 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": false, 2024-09-12T01:04:17.214 INFO:teuthology.orchestra.run.smithi073.stdout: "check_on_raw": false, 2024-09-12T01:04:17.214 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size": -1, 2024-09-12T01:04:17.214 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size_kb": 0, 2024-09-12T01:04:17.214 INFO:teuthology.orchestra.run.smithi073.stdout: "max_objects": -1 2024-09-12T01:04:17.214 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T01:04:17.214 INFO:teuthology.orchestra.run.smithi073.stdout: "user_quota": { 2024-09-12T01:04:17.214 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": false, 2024-09-12T01:04:17.214 INFO:teuthology.orchestra.run.smithi073.stdout: "check_on_raw": false, 2024-09-12T01:04:17.214 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size": -1, 2024-09-12T01:04:17.215 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size_kb": 0, 2024-09-12T01:04:17.215 INFO:teuthology.orchestra.run.smithi073.stdout: "max_objects": -1 2024-09-12T01:04:17.215 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T01:04:17.215 INFO:teuthology.orchestra.run.smithi073.stdout: "temp_url_keys": [], 2024-09-12T01:04:17.215 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "rgw", 2024-09-12T01:04:17.215 INFO:teuthology.orchestra.run.smithi073.stdout: "mfa_ids": [], 2024-09-12T01:04:17.215 INFO:teuthology.orchestra.run.smithi073.stdout: "account_id": "", 2024-09-12T01:04:17.215 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/", 2024-09-12T01:04:17.215 INFO:teuthology.orchestra.run.smithi073.stdout: "create_date": "2024-09-12T01:04:17.205632Z", 2024-09-12T01:04:17.215 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-12T01:04:17.215 INFO:teuthology.orchestra.run.smithi073.stdout: "group_ids": [] 2024-09-12T01:04:17.215 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T01:04:17.215 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:04:17.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.214+0000 7f1a44fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:17.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.216+0000 7f1b90baf800 20 remove_watcher() i=0 2024-09-12T01:04:17.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.216+0000 7f1b90baf800 2 removed watcher, disabling cache 2024-09-12T01:04:17.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.217+0000 7f1b90baf800 20 remove_watcher() i=1 2024-09-12T01:04:17.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.218+0000 7f1b90baf800 20 remove_watcher() i=2 2024-09-12T01:04:17.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.219+0000 7f1b90baf800 20 remove_watcher() i=3 2024-09-12T01:04:17.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.220+0000 7f1b90baf800 20 remove_watcher() i=4 2024-09-12T01:04:17.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.221+0000 7f1b90baf800 20 remove_watcher() i=5 2024-09-12T01:04:17.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.222+0000 7f1b90baf800 20 remove_watcher() i=6 2024-09-12T01:04:17.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.223+0000 7f1b90baf800 20 remove_watcher() i=7 2024-09-12T01:04:17.233 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 5868570160 --totp-seed PMLWTAENAX3MWMWFGK6SSJVDTBHSUHVD2RC4J6LDO3XN7KE53IQZ63SVKRPS3XYE --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T01:04:17.299 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:04:17.300 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:04:17.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.334+0000 7efca212e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.537+0000 7efca212e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:17.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.537+0000 7efca212e800 20 realm 2024-09-12T01:04:17.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.537+0000 7efca212e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.537+0000 7efca212e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:17.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.537+0000 7efca212e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:04:17.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.537+0000 7efca212e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.537+0000 7efca212e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:17.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.537+0000 7efca212e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.538+0000 7efca212e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:17.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.538+0000 7efca212e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.539+0000 7efca212e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:04:17.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.539+0000 7efca212e800 20 searching for the correct realm 2024-09-12T01:04:17.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.542+0000 7efc9e6de640 0 -- 172.21.15.73:0/2290920534 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7efc88056980 msgr2=0x7efc88068450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:04:17.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.748+0000 7efc9e6de640 0 -- 172.21.15.73:0/2290920534 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7efc88056980 msgr2=0x7efc88068450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:17.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.752+0000 7efca212e800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T01:04:17.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.752+0000 7efca212e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:04:17.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.752+0000 7efca212e800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T01:04:17.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.752+0000 7efca212e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:04:17.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.752+0000 7efca212e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:04:17.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.752+0000 7efca212e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:04:17.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.752+0000 7efca212e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.753+0000 7efca212e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:17.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.753+0000 7efca212e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.753+0000 7efca212e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:17.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.753+0000 7efca212e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.753+0000 7efca212e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:04:17.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.753+0000 7efca212e800 20 zone default found 2024-09-12T01:04:17.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.753+0000 7efca212e800 4 Realm: () 2024-09-12T01:04:17.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.753+0000 7efca212e800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T01:04:17.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.753+0000 7efca212e800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T01:04:17.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.753+0000 7efca212e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:04:17.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.753+0000 7efca212e800 20 zonegroup default 2024-09-12T01:04:17.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.753+0000 7efca212e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.753+0000 7efca212e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:17.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.753+0000 7efca212e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.754+0000 7efca212e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:17.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.754+0000 7efca212e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.754+0000 7efca212e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:17.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.754+0000 7efca212e800 20 started sync module instance, tier type = 2024-09-12T01:04:17.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.754+0000 7efca212e800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T01:04:17.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.763+0000 7efca212e800 20 add_watcher() i=0 2024-09-12T01:04:17.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.763+0000 7efca212e800 20 add_watcher() i=1 2024-09-12T01:04:17.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.763+0000 7efca212e800 20 add_watcher() i=2 2024-09-12T01:04:17.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.763+0000 7efca212e800 20 add_watcher() i=3 2024-09-12T01:04:17.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.763+0000 7efca212e800 20 add_watcher() i=4 2024-09-12T01:04:17.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.763+0000 7efca212e800 20 add_watcher() i=5 2024-09-12T01:04:17.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.763+0000 7efca212e800 20 add_watcher() i=6 2024-09-12T01:04:17.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.764+0000 7efca212e800 20 add_watcher() i=7 2024-09-12T01:04:17.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.764+0000 7efca212e800 2 all 8 watchers are set, enabling cache 2024-09-12T01:04:17.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.766+0000 7efb4f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:17.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.766+0000 7efca212e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:04:17.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.766+0000 7efca212e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:04:17.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.766+0000 7efca212e800 5 note: GC not initialized 2024-09-12T01:04:17.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.767+0000 7efb4e7fc640 20 reqs_thread_entry: start 2024-09-12T01:04:17.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.767+0000 7efca212e800 20 init_complete bucket index max shards: 1 2024-09-12T01:04:17.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.767+0000 7efca212e800 20 Filter name: none 2024-09-12T01:04:17.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.767+0000 7efabffff640 20 reqs_thread_entry: start 2024-09-12T01:04:17.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.767+0000 7efca212e800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T01:04:17.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.767+0000 7efca212e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.767+0000 7efca212e800 20 rados_obj.operate() r=0 bl.length=472 2024-09-12T01:04:17.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.767+0000 7efca212e800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-12T01:04:17.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.767+0000 7efca212e800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T01:04:17.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.767+0000 7efca212e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:04:17.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.770+0000 7efca212e800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T01:04:17.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.770+0000 7efca212e800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T01:04:17.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.770+0000 7efca212e800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T01:04:17.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.770+0000 7efb817fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398934 cookie 94759902530592 notifier 8582 bl.length()=674 2024-09-12T01:04:17.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.770+0000 7efb817fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T01:04:17.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.770+0000 7efb817fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T01:04:17.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.772+0000 7efb4f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:17.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.775+0000 7efca212e800 20 remove_watcher() i=0 2024-09-12T01:04:17.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.775+0000 7efca212e800 2 removed watcher, disabling cache 2024-09-12T01:04:17.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.776+0000 7efca212e800 20 remove_watcher() i=1 2024-09-12T01:04:17.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.777+0000 7efca212e800 20 remove_watcher() i=2 2024-09-12T01:04:17.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.778+0000 7efca212e800 20 remove_watcher() i=3 2024-09-12T01:04:17.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.779+0000 7efca212e800 20 remove_watcher() i=4 2024-09-12T01:04:17.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.780+0000 7efca212e800 20 remove_watcher() i=5 2024-09-12T01:04:17.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.781+0000 7efca212e800 20 remove_watcher() i=6 2024-09-12T01:04:17.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.782+0000 7efca212e800 20 remove_watcher() i=7 2024-09-12T01:04:17.792 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*;roles=*;user-policy=*' --cluster ceph 2024-09-12T01:04:17.849 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:04:17.850 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:04:17.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.884+0000 7fb94bd75800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.885+0000 7fb94bd75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:17.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.886+0000 7fb94bd75800 20 realm 2024-09-12T01:04:17.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.886+0000 7fb94bd75800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.886+0000 7fb94bd75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:17.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.886+0000 7fb94bd75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:04:17.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.886+0000 7fb94bd75800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.886+0000 7fb94bd75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:17.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.886+0000 7fb94bd75800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.887+0000 7fb94bd75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:17.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.887+0000 7fb94bd75800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.888+0000 7fb94bd75800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:04:17.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.888+0000 7fb94bd75800 20 searching for the correct realm 2024-09-12T01:04:17.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:17.890+0000 7fb94a060640 0 -- 172.21.15.73:0/3184625280 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fb94001e050 msgr2=0x7fb940066b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:04:18.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.096+0000 7fb94a060640 0 -- 172.21.15.73:0/3184625280 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7fb94001e050 msgr2=0x7fb940066b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:18.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.100+0000 7fb94bd75800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T01:04:18.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.100+0000 7fb94bd75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:04:18.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.100+0000 7fb94bd75800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T01:04:18.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.100+0000 7fb94bd75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:04:18.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.100+0000 7fb94bd75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:04:18.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.100+0000 7fb94bd75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:04:18.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.100+0000 7fb94bd75800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.101+0000 7fb94bd75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:18.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.101+0000 7fb94bd75800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.101+0000 7fb94bd75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:18.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.101+0000 7fb94bd75800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.101+0000 7fb94bd75800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:04:18.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.101+0000 7fb94bd75800 20 zone default found 2024-09-12T01:04:18.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.101+0000 7fb94bd75800 4 Realm: () 2024-09-12T01:04:18.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.101+0000 7fb94bd75800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T01:04:18.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.101+0000 7fb94bd75800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T01:04:18.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.101+0000 7fb94bd75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:04:18.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.101+0000 7fb94bd75800 20 zonegroup default 2024-09-12T01:04:18.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.101+0000 7fb94bd75800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.101+0000 7fb94bd75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:18.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.102+0000 7fb94bd75800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.102+0000 7fb94bd75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:18.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.102+0000 7fb94bd75800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.102+0000 7fb94bd75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:18.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.102+0000 7fb94bd75800 20 started sync module instance, tier type = 2024-09-12T01:04:18.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.102+0000 7fb94bd75800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T01:04:18.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.111+0000 7fb94bd75800 20 add_watcher() i=0 2024-09-12T01:04:18.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.111+0000 7fb94bd75800 20 add_watcher() i=1 2024-09-12T01:04:18.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.111+0000 7fb94bd75800 20 add_watcher() i=2 2024-09-12T01:04:18.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.111+0000 7fb94bd75800 20 add_watcher() i=3 2024-09-12T01:04:18.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.111+0000 7fb94bd75800 20 add_watcher() i=4 2024-09-12T01:04:18.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.111+0000 7fb94bd75800 20 add_watcher() i=5 2024-09-12T01:04:18.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.111+0000 7fb94bd75800 20 add_watcher() i=6 2024-09-12T01:04:18.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.112+0000 7fb94bd75800 20 add_watcher() i=7 2024-09-12T01:04:18.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.112+0000 7fb94bd75800 2 all 8 watchers are set, enabling cache 2024-09-12T01:04:18.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.114+0000 7fb7fbfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:18.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.114+0000 7fb94bd75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:04:18.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.114+0000 7fb94bd75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:04:18.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.114+0000 7fb94bd75800 5 note: GC not initialized 2024-09-12T01:04:18.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.115+0000 7fb7faffd640 20 reqs_thread_entry: start 2024-09-12T01:04:18.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.115+0000 7fb94bd75800 20 init_complete bucket index max shards: 1 2024-09-12T01:04:18.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.115+0000 7fb94bd75800 20 Filter name: none 2024-09-12T01:04:18.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.115+0000 7fb7f8ff9640 20 reqs_thread_entry: start 2024-09-12T01:04:18.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.115+0000 7fb94bd75800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T01:04:18.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.115+0000 7fb94bd75800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.115+0000 7fb94bd75800 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T01:04:18.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.115+0000 7fb94bd75800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-12T01:04:18.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.115+0000 7fb94bd75800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T01:04:18.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.115+0000 7fb94bd75800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:04:18.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.117+0000 7fb94bd75800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T01:04:18.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.117+0000 7fb94bd75800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T01:04:18.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.117+0000 7fb94bd75800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T01:04:18.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.117+0000 7fb82d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398935 cookie 94652503667888 notifier 9192 bl.length()=727 2024-09-12T01:04:18.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.117+0000 7fb82d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T01:04:18.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.117+0000 7fb82d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T01:04:18.117 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T01:04:18.117 INFO:teuthology.orchestra.run.smithi073.stdout: "user_id": "foobar.client.0", 2024-09-12T01:04:18.117 INFO:teuthology.orchestra.run.smithi073.stdout: "display_name": "Mr.foobar.client.0", 2024-09-12T01:04:18.117 INFO:teuthology.orchestra.run.smithi073.stdout: "email": "foobar+test@test.test", 2024-09-12T01:04:18.117 INFO:teuthology.orchestra.run.smithi073.stdout: "suspended": 0, 2024-09-12T01:04:18.117 INFO:teuthology.orchestra.run.smithi073.stdout: "max_buckets": 1000, 2024-09-12T01:04:18.117 INFO:teuthology.orchestra.run.smithi073.stdout: "subusers": [], 2024-09-12T01:04:18.118 INFO:teuthology.orchestra.run.smithi073.stdout: "keys": [ 2024-09-12T01:04:18.118 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T01:04:18.118 INFO:teuthology.orchestra.run.smithi073.stdout: "user": "foobar.client.0", 2024-09-12T01:04:18.118 INFO:teuthology.orchestra.run.smithi073.stdout: "access_key": "FFARUHRNAGVCMQUROLBB", 2024-09-12T01:04:18.118 INFO:teuthology.orchestra.run.smithi073.stdout: "secret_key": "bIH63zzhCjHBPQ6pu8GD85CMlfbaVJZhseuiFxjkRWro6FSeuAPSOw==", 2024-09-12T01:04:18.118 INFO:teuthology.orchestra.run.smithi073.stdout: "active": true, 2024-09-12T01:04:18.118 INFO:teuthology.orchestra.run.smithi073.stdout: "create_date": "2024-09-12T01:04:17.205647Z" 2024-09-12T01:04:18.118 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T01:04:18.118 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-12T01:04:18.118 INFO:teuthology.orchestra.run.smithi073.stdout: "swift_keys": [], 2024-09-12T01:04:18.118 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": [ 2024-09-12T01:04:18.118 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T01:04:18.118 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "oidc-provider", 2024-09-12T01:04:18.119 INFO:teuthology.orchestra.run.smithi073.stdout: "perm": "*" 2024-09-12T01:04:18.119 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T01:04:18.119 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T01:04:18.119 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "roles", 2024-09-12T01:04:18.119 INFO:teuthology.orchestra.run.smithi073.stdout: "perm": "*" 2024-09-12T01:04:18.119 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T01:04:18.119 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T01:04:18.119 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "user-policy", 2024-09-12T01:04:18.119 INFO:teuthology.orchestra.run.smithi073.stdout: "perm": "*" 2024-09-12T01:04:18.119 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T01:04:18.119 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-12T01:04:18.119 INFO:teuthology.orchestra.run.smithi073.stdout: "op_mask": "read, write, delete", 2024-09-12T01:04:18.119 INFO:teuthology.orchestra.run.smithi073.stdout: "default_placement": "", 2024-09-12T01:04:18.119 INFO:teuthology.orchestra.run.smithi073.stdout: "default_storage_class": "", 2024-09-12T01:04:18.120 INFO:teuthology.orchestra.run.smithi073.stdout: "placement_tags": [], 2024-09-12T01:04:18.120 INFO:teuthology.orchestra.run.smithi073.stdout: "bucket_quota": { 2024-09-12T01:04:18.120 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": false, 2024-09-12T01:04:18.120 INFO:teuthology.orchestra.run.smithi073.stdout: "check_on_raw": false, 2024-09-12T01:04:18.120 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size": -1, 2024-09-12T01:04:18.120 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size_kb": 0, 2024-09-12T01:04:18.120 INFO:teuthology.orchestra.run.smithi073.stdout: "max_objects": -1 2024-09-12T01:04:18.120 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T01:04:18.120 INFO:teuthology.orchestra.run.smithi073.stdout: "user_quota": { 2024-09-12T01:04:18.120 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": false, 2024-09-12T01:04:18.120 INFO:teuthology.orchestra.run.smithi073.stdout: "check_on_raw": false, 2024-09-12T01:04:18.120 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size": -1, 2024-09-12T01:04:18.120 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size_kb": 0, 2024-09-12T01:04:18.121 INFO:teuthology.orchestra.run.smithi073.stdout: "max_objects": -1 2024-09-12T01:04:18.121 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T01:04:18.121 INFO:teuthology.orchestra.run.smithi073.stdout: "temp_url_keys": [], 2024-09-12T01:04:18.121 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "rgw", 2024-09-12T01:04:18.121 INFO:teuthology.orchestra.run.smithi073.stdout: "mfa_ids": [ 2024-09-12T01:04:18.121 INFO:teuthology.orchestra.run.smithi073.stdout: "5868570160" 2024-09-12T01:04:18.121 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-12T01:04:18.121 INFO:teuthology.orchestra.run.smithi073.stdout: "account_id": "", 2024-09-12T01:04:18.121 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/", 2024-09-12T01:04:18.121 INFO:teuthology.orchestra.run.smithi073.stdout: "create_date": "2024-09-12T01:04:17.205632Z", 2024-09-12T01:04:18.121 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-12T01:04:18.121 INFO:teuthology.orchestra.run.smithi073.stdout: "group_ids": [] 2024-09-12T01:04:18.121 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T01:04:18.121 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:04:18.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.119+0000 7fb7fbfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:18.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.122+0000 7fb94bd75800 20 remove_watcher() i=0 2024-09-12T01:04:18.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.122+0000 7fb94bd75800 2 removed watcher, disabling cache 2024-09-12T01:04:18.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.123+0000 7fb94bd75800 20 remove_watcher() i=1 2024-09-12T01:04:18.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.124+0000 7fb94bd75800 20 remove_watcher() i=2 2024-09-12T01:04:18.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.125+0000 7fb94bd75800 20 remove_watcher() i=3 2024-09-12T01:04:18.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.126+0000 7fb94bd75800 20 remove_watcher() i=4 2024-09-12T01:04:18.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.127+0000 7fb94bd75800 20 remove_watcher() i=5 2024-09-12T01:04:18.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.128+0000 7fb94bd75800 20 remove_watcher() i=6 2024-09-12T01:04:18.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.129+0000 7fb94bd75800 20 remove_watcher() i=7 2024-09-12T01:04:18.138 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW88888888888888888 --account-name Mr.RGW88888888888888888 --email RGW88888888888888888+test@test.test 2024-09-12T01:04:18.198 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:04:18.198 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:04:18.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.233+0000 7fa58de11800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.234+0000 7fa58de11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:18.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.234+0000 7fa58de11800 20 realm 2024-09-12T01:04:18.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.234+0000 7fa58de11800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.234+0000 7fa58de11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:18.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.234+0000 7fa58de11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:04:18.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.234+0000 7fa58de11800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.234+0000 7fa58de11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:18.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.234+0000 7fa58de11800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.235+0000 7fa58de11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:18.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.235+0000 7fa58de11800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.236+0000 7fa58de11800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:04:18.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.236+0000 7fa58de11800 20 searching for the correct realm 2024-09-12T01:04:18.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.238+0000 7fa588d21640 0 -- 172.21.15.73:0/227109062 >> [v2:172.21.15.73:6826/269690776,v1:172.21.15.73:6827/269690776] conn(0x7fa57c00e040 msgr2=0x7fa57c097f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:18.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.242+0000 7fa589522640 0 -- 172.21.15.73:0/227109062 >> [v2:172.21.15.73:6810/1807760270,v1:172.21.15.73:6811/1807760270] conn(0x7fa584055920 msgr2=0x7fa5840823f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:18.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.448+0000 7fa58de11800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T01:04:18.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.448+0000 7fa58de11800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:04:18.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.448+0000 7fa58de11800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T01:04:18.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.448+0000 7fa58de11800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:04:18.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.448+0000 7fa58de11800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:04:18.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.448+0000 7fa58de11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:04:18.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.448+0000 7fa58de11800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.448+0000 7fa58de11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:18.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.448+0000 7fa58de11800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.449+0000 7fa58de11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:18.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.449+0000 7fa58de11800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.449+0000 7fa58de11800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:04:18.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.449+0000 7fa58de11800 20 zone default found 2024-09-12T01:04:18.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.449+0000 7fa58de11800 4 Realm: () 2024-09-12T01:04:18.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.449+0000 7fa58de11800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T01:04:18.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.449+0000 7fa58de11800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T01:04:18.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.449+0000 7fa58de11800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:04:18.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.449+0000 7fa58de11800 20 zonegroup default 2024-09-12T01:04:18.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.449+0000 7fa58de11800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.449+0000 7fa58de11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:18.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.449+0000 7fa58de11800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.450+0000 7fa58de11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:18.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.450+0000 7fa58de11800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.450+0000 7fa58de11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:18.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.450+0000 7fa58de11800 20 started sync module instance, tier type = 2024-09-12T01:04:18.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.450+0000 7fa58de11800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T01:04:18.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.460+0000 7fa58de11800 20 add_watcher() i=0 2024-09-12T01:04:18.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.460+0000 7fa58de11800 20 add_watcher() i=1 2024-09-12T01:04:18.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.460+0000 7fa58de11800 20 add_watcher() i=2 2024-09-12T01:04:18.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.460+0000 7fa58de11800 20 add_watcher() i=3 2024-09-12T01:04:18.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.460+0000 7fa58de11800 20 add_watcher() i=4 2024-09-12T01:04:18.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.460+0000 7fa58de11800 20 add_watcher() i=5 2024-09-12T01:04:18.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.460+0000 7fa58de11800 20 add_watcher() i=6 2024-09-12T01:04:18.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.461+0000 7fa58de11800 20 add_watcher() i=7 2024-09-12T01:04:18.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.461+0000 7fa58de11800 2 all 8 watchers are set, enabling cache 2024-09-12T01:04:18.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.462+0000 7fa43ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:18.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.463+0000 7fa58de11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:04:18.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.463+0000 7fa58de11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:04:18.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.463+0000 7fa58de11800 5 note: GC not initialized 2024-09-12T01:04:18.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.463+0000 7fa43efe5640 20 reqs_thread_entry: start 2024-09-12T01:04:18.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.463+0000 7fa58de11800 20 init_complete bucket index max shards: 1 2024-09-12T01:04:18.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.463+0000 7fa58de11800 20 Filter name: none 2024-09-12T01:04:18.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.463+0000 7fa43cfe1640 20 reqs_thread_entry: start 2024-09-12T01:04:18.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.463+0000 7fa58de11800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 : miss 2024-09-12T01:04:18.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.463+0000 7fa58de11800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.463+0000 7fa58de11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:18.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.463+0000 7fa58de11800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x0 2024-09-12T01:04:18.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.463+0000 7fa58de11800 10 adding default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T01:04:18.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.463+0000 7fa58de11800 20 failed to read name.$Mr.RGW88888888888888888 with: (2) No such file or directory 2024-09-12T01:04:18.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.463+0000 7fa58de11800 10 cache get: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test : miss 2024-09-12T01:04:18.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.463+0000 7fa58de11800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.464+0000 7fa58de11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:18.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.464+0000 7fa58de11800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x0 2024-09-12T01:04:18.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.464+0000 7fa58de11800 10 adding default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T01:04:18.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.464+0000 7fa58de11800 20 failed to read rgw88888888888888888+test@test.test with: (2) No such file or directory 2024-09-12T01:04:18.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.465+0000 7fa58de11800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T01:04:18.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.465+0000 7fa58de11800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T01:04:18.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.465+0000 7fa58de11800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW88888888888888888, ofs0, ns] 2024-09-12T01:04:18.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.465+0000 7fa46cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398971 cookie 94847327075840 notifier 9213 bl.length()=384 2024-09-12T01:04:18.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.465+0000 7fa46cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T01:04:18.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.465+0000 7fa46cff9640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T01:04:18.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.469+0000 7fa58de11800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-12T01:04:18.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.469+0000 7fa58de11800 10 moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T01:04:18.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.469+0000 7fa58de11800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW88888888888888888, ofs0, ns] 2024-09-12T01:04:18.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.469+0000 7fa46cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399018 cookie 94847327085840 notifier 9213 bl.length()=225 2024-09-12T01:04:18.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.469+0000 7fa46cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-12T01:04:18.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.469+0000 7fa46cff9640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T01:04:18.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.471+0000 7fa58de11800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-12T01:04:18.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.471+0000 7fa58de11800 10 moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T01:04:18.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.471+0000 7fa58de11800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw88888888888888888+test@test.test, ofs0, ns] 2024-09-12T01:04:18.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.472+0000 7fa46cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398943 cookie 94847327079520 notifier 9213 bl.length()=234 2024-09-12T01:04:18.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.472+0000 7fa46cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-12T01:04:18.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.472+0000 7fa46cff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T01:04:18.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.474+0000 7fa43ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:18.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.476+0000 7fa58de11800 20 remove_watcher() i=0 2024-09-12T01:04:18.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.476+0000 7fa58de11800 2 removed watcher, disabling cache 2024-09-12T01:04:18.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.477+0000 7fa58de11800 20 remove_watcher() i=1 2024-09-12T01:04:18.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.479+0000 7fa58de11800 20 remove_watcher() i=2 2024-09-12T01:04:18.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.480+0000 7fa58de11800 20 remove_watcher() i=3 2024-09-12T01:04:18.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.481+0000 7fa58de11800 20 remove_watcher() i=4 2024-09-12T01:04:18.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.482+0000 7fa58de11800 20 remove_watcher() i=5 2024-09-12T01:04:18.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.483+0000 7fa58de11800 20 remove_watcher() i=6 2024-09-12T01:04:18.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.484+0000 7fa58de11800 20 remove_watcher() i=7 2024-09-12T01:04:18.491 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T01:04:18.492 INFO:teuthology.orchestra.run.smithi073.stdout: "id": "RGW88888888888888888", 2024-09-12T01:04:18.492 INFO:teuthology.orchestra.run.smithi073.stdout: "tenant": "", 2024-09-12T01:04:18.492 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "Mr.RGW88888888888888888", 2024-09-12T01:04:18.492 INFO:teuthology.orchestra.run.smithi073.stdout: "email": "RGW88888888888888888+test@test.test", 2024-09-12T01:04:18.492 INFO:teuthology.orchestra.run.smithi073.stdout: "quota": { 2024-09-12T01:04:18.492 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": false, 2024-09-12T01:04:18.492 INFO:teuthology.orchestra.run.smithi073.stdout: "check_on_raw": false, 2024-09-12T01:04:18.492 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size": -1, 2024-09-12T01:04:18.492 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size_kb": 0, 2024-09-12T01:04:18.492 INFO:teuthology.orchestra.run.smithi073.stdout: "max_objects": -1 2024-09-12T01:04:18.492 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T01:04:18.493 INFO:teuthology.orchestra.run.smithi073.stdout: "bucket_quota": { 2024-09-12T01:04:18.493 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": false, 2024-09-12T01:04:18.493 INFO:teuthology.orchestra.run.smithi073.stdout: "check_on_raw": false, 2024-09-12T01:04:18.493 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size": -1, 2024-09-12T01:04:18.493 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size_kb": 0, 2024-09-12T01:04:18.493 INFO:teuthology.orchestra.run.smithi073.stdout: "max_objects": -1 2024-09-12T01:04:18.493 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T01:04:18.493 INFO:teuthology.orchestra.run.smithi073.stdout: "max_users": 1000, 2024-09-12T01:04:18.493 INFO:teuthology.orchestra.run.smithi073.stdout: "max_roles": 1000, 2024-09-12T01:04:18.493 INFO:teuthology.orchestra.run.smithi073.stdout: "max_groups": 1000, 2024-09-12T01:04:18.493 INFO:teuthology.orchestra.run.smithi073.stdout: "max_buckets": 1000, 2024-09-12T01:04:18.493 INFO:teuthology.orchestra.run.smithi073.stdout: "max_access_keys": 4 2024-09-12T01:04:18.493 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T01:04:18.494 DEBUG:tasks.s3tests:Creating user RGW88888888888888888 on client.0 2024-09-12T01:04:18.495 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root1.client.0 --display-name Mr.RGW88888888888888888 --email root1+test@test.test --access-key PFRUZWUZGOJVUVRQBZHE --secret CxQsMG5Hyzua3HZlPpv4SCzIG4tlZD4Im1gbHAHOqTqLWmlAfGKr3g== --cluster ceph --account-id RGW88888888888888888 --account-root 2024-09-12T01:04:18.562 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:04:18.562 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:04:18.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.597+0000 7f460db42800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.598+0000 7f460db42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:18.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.598+0000 7f460db42800 20 realm 2024-09-12T01:04:18.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.598+0000 7f460db42800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.599+0000 7f460db42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:18.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.599+0000 7f460db42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:04:18.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.599+0000 7f460db42800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.599+0000 7f460db42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:18.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.599+0000 7f460db42800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.600+0000 7f460db42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:18.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.600+0000 7f460db42800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.601+0000 7f460db42800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:04:18.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.601+0000 7f460db42800 20 searching for the correct realm 2024-09-12T01:04:18.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.604+0000 7f460a087640 0 -- 172.21.15.73:0/345020134 >> [v2:172.21.15.73:6800/2864081714,v1:172.21.15.73:6801/2864081714] conn(0x55fb7fad4a40 msgr2=0x55fb7fad6f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:18.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.608+0000 7f460a087640 0 -- 172.21.15.73:0/345020134 >> [v2:172.21.15.73:6818/153097326,v1:172.21.15.73:6819/153097326] conn(0x55fb7fac7ef0 msgr2=0x55fb7faca3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:18.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.611+0000 7f460db42800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T01:04:18.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.611+0000 7f460db42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:04:18.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.611+0000 7f460db42800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T01:04:18.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.611+0000 7f460db42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:04:18.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.611+0000 7f460db42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:04:18.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.611+0000 7f460db42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:04:18.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.611+0000 7f460db42800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.611+0000 7f460db42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:18.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.611+0000 7f460db42800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.612+0000 7f460db42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:18.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.612+0000 7f460db42800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.612+0000 7f460db42800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:04:18.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.612+0000 7f460db42800 20 zone default found 2024-09-12T01:04:18.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.612+0000 7f460db42800 4 Realm: () 2024-09-12T01:04:18.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.612+0000 7f460db42800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T01:04:18.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.612+0000 7f460db42800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T01:04:18.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.612+0000 7f460db42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:04:18.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.612+0000 7f460db42800 20 zonegroup default 2024-09-12T01:04:18.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.612+0000 7f460db42800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.612+0000 7f460db42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:18.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.612+0000 7f460db42800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.612+0000 7f460db42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:18.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.612+0000 7f460db42800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.613+0000 7f460db42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:18.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.613+0000 7f460db42800 20 started sync module instance, tier type = 2024-09-12T01:04:18.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.613+0000 7f460db42800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T01:04:18.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.622+0000 7f460db42800 20 add_watcher() i=0 2024-09-12T01:04:18.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.622+0000 7f460db42800 20 add_watcher() i=1 2024-09-12T01:04:18.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.622+0000 7f460db42800 20 add_watcher() i=2 2024-09-12T01:04:18.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.622+0000 7f460db42800 20 add_watcher() i=3 2024-09-12T01:04:18.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.622+0000 7f460db42800 20 add_watcher() i=4 2024-09-12T01:04:18.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.622+0000 7f460db42800 20 add_watcher() i=5 2024-09-12T01:04:18.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.622+0000 7f460db42800 20 add_watcher() i=6 2024-09-12T01:04:18.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.623+0000 7f460db42800 20 add_watcher() i=7 2024-09-12T01:04:18.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.623+0000 7f460db42800 2 all 8 watchers are set, enabling cache 2024-09-12T01:04:18.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.624+0000 7f44bbfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:18.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.624+0000 7f460db42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:04:18.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.624+0000 7f460db42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:04:18.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.624+0000 7f460db42800 5 note: GC not initialized 2024-09-12T01:04:18.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.624+0000 7f44baffd640 20 reqs_thread_entry: start 2024-09-12T01:04:18.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.625+0000 7f460db42800 20 init_complete bucket index max shards: 1 2024-09-12T01:04:18.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.625+0000 7f460db42800 20 Filter name: none 2024-09-12T01:04:18.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.625+0000 7f44b8ff9640 20 reqs_thread_entry: start 2024-09-12T01:04:18.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.625+0000 7f460db42800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-12T01:04:18.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.625+0000 7f460db42800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.625+0000 7f460db42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:18.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.625+0000 7f460db42800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x0 2024-09-12T01:04:18.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.625+0000 7f460db42800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T01:04:18.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.625+0000 7f460db42800 10 cache get: name=default.rgw.meta+users.email+root1+test@test.test : miss 2024-09-12T01:04:18.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.625+0000 7f460db42800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.625+0000 7f460db42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:18.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.625+0000 7f460db42800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x0 2024-09-12T01:04:18.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.625+0000 7f460db42800 10 adding default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T01:04:18.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.625+0000 7f460db42800 10 cache get: name=default.rgw.meta+users.keys+PFRUZWUZGOJVUVRQBZHE : miss 2024-09-12T01:04:18.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.625+0000 7f460db42800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.626+0000 7f460db42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:18.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.626+0000 7f460db42800 10 cache put: name=default.rgw.meta+users.keys+PFRUZWUZGOJVUVRQBZHE info.flags=0x0 2024-09-12T01:04:18.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.626+0000 7f460db42800 10 adding default.rgw.meta+users.keys+PFRUZWUZGOJVUVRQBZHE to cache LRU end 2024-09-12T01:04:18.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.626+0000 7f460db42800 10 cache get: name=default.rgw.meta+accounts+account.RGW88888888888888888 : miss 2024-09-12T01:04:18.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.626+0000 7f460db42800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.626+0000 7f460db42800 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T01:04:18.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.626+0000 7f460db42800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T01:04:18.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.626+0000 7f460db42800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T01:04:18.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.626+0000 7f460db42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:04:18.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.626+0000 7f460db42800 10 cache get: name=default.rgw.meta+users.keys+PFRUZWUZGOJVUVRQBZHE : hit (negative entry) 2024-09-12T01:04:18.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.626+0000 7f460db42800 10 cache get: name=default.rgw.meta+users.keys+PFRUZWUZGOJVUVRQBZHE : hit (negative entry) 2024-09-12T01:04:18.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.628+0000 7f460db42800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T01:04:18.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.628+0000 7f460db42800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T01:04:18.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.628+0000 7f460db42800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-12T01:04:18.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.628+0000 7f44ed7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398972 cookie 94538667170576 notifier 9231 bl.length()=681 2024-09-12T01:04:18.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.628+0000 7f44ed7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T01:04:18.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.628+0000 7f44ed7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T01:04:18.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.631+0000 7f460db42800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-12T01:04:18.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.631+0000 7f460db42800 10 moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T01:04:18.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.631+0000 7f460db42800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root1+test@test.test, ofs0, ns] 2024-09-12T01:04:18.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.631+0000 7f44ecff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399085 cookie 94538667221440 notifier 9231 bl.length()=189 2024-09-12T01:04:18.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.631+0000 7f44ecff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-12T01:04:18.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.631+0000 7f44ecff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T01:04:18.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.634+0000 7f460db42800 10 cache put: name=default.rgw.meta+users.keys+PFRUZWUZGOJVUVRQBZHE info.flags=0x7 2024-09-12T01:04:18.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.634+0000 7f460db42800 10 moving default.rgw.meta+users.keys+PFRUZWUZGOJVUVRQBZHE to cache LRU end 2024-09-12T01:04:18.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.634+0000 7f460db42800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:PFRUZWUZGOJVUVRQBZHE, ofs0, ns] 2024-09-12T01:04:18.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.634+0000 7f44ecff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399019 cookie 94538667169488 notifier 9231 bl.length()=188 2024-09-12T01:04:18.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.634+0000 7f44ecff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+PFRUZWUZGOJVUVRQBZHE info.flags=0x7 2024-09-12T01:04:18.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.634+0000 7f44ecff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+PFRUZWUZGOJVUVRQBZHE to cache LRU end 2024-09-12T01:04:18.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.637+0000 7f460db42800 20 linked user root1.client.0 to account RGW88888888888888888 2024-09-12T01:04:18.636 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T01:04:18.636 INFO:teuthology.orchestra.run.smithi073.stdout: "user_id": "root1.client.0", 2024-09-12T01:04:18.636 INFO:teuthology.orchestra.run.smithi073.stdout: "display_name": "Mr.RGW88888888888888888", 2024-09-12T01:04:18.636 INFO:teuthology.orchestra.run.smithi073.stdout: "email": "root1+test@test.test", 2024-09-12T01:04:18.636 INFO:teuthology.orchestra.run.smithi073.stdout: "suspended": 0, 2024-09-12T01:04:18.636 INFO:teuthology.orchestra.run.smithi073.stdout: "max_buckets": 1000, 2024-09-12T01:04:18.636 INFO:teuthology.orchestra.run.smithi073.stdout: "subusers": [], 2024-09-12T01:04:18.636 INFO:teuthology.orchestra.run.smithi073.stdout: "keys": [ 2024-09-12T01:04:18.636 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T01:04:18.636 INFO:teuthology.orchestra.run.smithi073.stdout: "user": "root1.client.0", 2024-09-12T01:04:18.636 INFO:teuthology.orchestra.run.smithi073.stdout: "access_key": "PFRUZWUZGOJVUVRQBZHE", 2024-09-12T01:04:18.636 INFO:teuthology.orchestra.run.smithi073.stdout: "secret_key": "CxQsMG5Hyzua3HZlPpv4SCzIG4tlZD4Im1gbHAHOqTqLWmlAfGKr3g==", 2024-09-12T01:04:18.637 INFO:teuthology.orchestra.run.smithi073.stdout: "active": true, 2024-09-12T01:04:18.637 INFO:teuthology.orchestra.run.smithi073.stdout: "create_date": "2024-09-12T01:04:18.627592Z" 2024-09-12T01:04:18.637 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T01:04:18.637 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-12T01:04:18.637 INFO:teuthology.orchestra.run.smithi073.stdout: "swift_keys": [], 2024-09-12T01:04:18.637 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": [], 2024-09-12T01:04:18.637 INFO:teuthology.orchestra.run.smithi073.stdout: "op_mask": "read, write, delete", 2024-09-12T01:04:18.637 INFO:teuthology.orchestra.run.smithi073.stdout: "default_placement": "", 2024-09-12T01:04:18.637 INFO:teuthology.orchestra.run.smithi073.stdout: "default_storage_class": "", 2024-09-12T01:04:18.637 INFO:teuthology.orchestra.run.smithi073.stdout: "placement_tags": [], 2024-09-12T01:04:18.637 INFO:teuthology.orchestra.run.smithi073.stdout: "bucket_quota": { 2024-09-12T01:04:18.637 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": false, 2024-09-12T01:04:18.637 INFO:teuthology.orchestra.run.smithi073.stdout: "check_on_raw": false, 2024-09-12T01:04:18.638 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size": -1, 2024-09-12T01:04:18.638 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size_kb": 0, 2024-09-12T01:04:18.638 INFO:teuthology.orchestra.run.smithi073.stdout: "max_objects": -1 2024-09-12T01:04:18.638 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T01:04:18.638 INFO:teuthology.orchestra.run.smithi073.stdout: "user_quota": { 2024-09-12T01:04:18.638 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": false, 2024-09-12T01:04:18.638 INFO:teuthology.orchestra.run.smithi073.stdout: "check_on_raw": false, 2024-09-12T01:04:18.638 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size": -1, 2024-09-12T01:04:18.638 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size_kb": 0, 2024-09-12T01:04:18.638 INFO:teuthology.orchestra.run.smithi073.stdout: "max_objects": -1 2024-09-12T01:04:18.638 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T01:04:18.638 INFO:teuthology.orchestra.run.smithi073.stdout: "temp_url_keys": [], 2024-09-12T01:04:18.638 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "root", 2024-09-12T01:04:18.638 INFO:teuthology.orchestra.run.smithi073.stdout: "mfa_ids": [], 2024-09-12T01:04:18.639 INFO:teuthology.orchestra.run.smithi073.stdout: "account_id": "RGW88888888888888888", 2024-09-12T01:04:18.639 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/", 2024-09-12T01:04:18.639 INFO:teuthology.orchestra.run.smithi073.stdout: "create_date": "2024-09-12T01:04:18.627581Z", 2024-09-12T01:04:18.639 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-12T01:04:18.639 INFO:teuthology.orchestra.run.smithi073.stdout: "group_ids": [] 2024-09-12T01:04:18.639 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T01:04:18.639 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:04:18.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.637+0000 7f44bbfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:18.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.640+0000 7f460db42800 20 remove_watcher() i=0 2024-09-12T01:04:18.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.640+0000 7f460db42800 2 removed watcher, disabling cache 2024-09-12T01:04:18.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.641+0000 7f460db42800 20 remove_watcher() i=1 2024-09-12T01:04:18.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.642+0000 7f460db42800 20 remove_watcher() i=2 2024-09-12T01:04:18.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.643+0000 7f460db42800 20 remove_watcher() i=3 2024-09-12T01:04:18.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.644+0000 7f460db42800 20 remove_watcher() i=4 2024-09-12T01:04:18.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.645+0000 7f460db42800 20 remove_watcher() i=5 2024-09-12T01:04:18.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.646+0000 7f460db42800 20 remove_watcher() i=6 2024-09-12T01:04:18.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.647+0000 7f460db42800 20 remove_watcher() i=7 2024-09-12T01:04:18.657 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root1.client.0 --totp-serial 0212345486 --totp-seed LUBNISGD4MKP3OX7DFYXM3FXKMZCEFKIHEASPFIMRFZAKGXXQ2QPC2E4DZVQHBHG --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T01:04:18.722 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:04:18.722 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:04:18.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.757+0000 7f4b71323800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.758+0000 7f4b71323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:18.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.758+0000 7f4b71323800 20 realm 2024-09-12T01:04:18.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.758+0000 7f4b71323800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.759+0000 7f4b71323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:18.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.759+0000 7f4b71323800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:04:18.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.759+0000 7f4b71323800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.759+0000 7f4b71323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:18.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.759+0000 7f4b71323800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.760+0000 7f4b71323800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:18.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.760+0000 7f4b71323800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.760+0000 7f4b71323800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:04:18.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.760+0000 7f4b71323800 20 searching for the correct realm 2024-09-12T01:04:18.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.762+0000 7f4b6d814640 0 -- 172.21.15.73:0/3172541841 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f4b640dfb60 msgr2=0x7f4b640b2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:18.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.968+0000 7f4b6d814640 0 -- 172.21.15.73:0/3172541841 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f4b640dfb60 msgr2=0x7f4b640b2450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:18.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.972+0000 7f4b71323800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T01:04:18.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.972+0000 7f4b71323800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:04:18.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.972+0000 7f4b71323800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T01:04:18.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.972+0000 7f4b71323800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:04:18.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.972+0000 7f4b71323800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:04:18.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.972+0000 7f4b71323800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:04:18.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.972+0000 7f4b71323800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.973+0000 7f4b71323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:18.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.973+0000 7f4b71323800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.973+0000 7f4b71323800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:18.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.973+0000 7f4b71323800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.973+0000 7f4b71323800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:04:18.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.973+0000 7f4b71323800 20 zone default found 2024-09-12T01:04:18.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.973+0000 7f4b71323800 4 Realm: () 2024-09-12T01:04:18.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.973+0000 7f4b71323800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T01:04:18.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.973+0000 7f4b71323800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T01:04:18.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.973+0000 7f4b71323800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:04:18.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.973+0000 7f4b71323800 20 zonegroup default 2024-09-12T01:04:18.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.973+0000 7f4b71323800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.973+0000 7f4b71323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:18.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.973+0000 7f4b71323800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.974+0000 7f4b71323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:18.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.974+0000 7f4b71323800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.974+0000 7f4b71323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:18.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.974+0000 7f4b71323800 20 started sync module instance, tier type = 2024-09-12T01:04:18.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.974+0000 7f4b71323800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T01:04:18.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.983+0000 7f4b71323800 20 add_watcher() i=0 2024-09-12T01:04:18.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.983+0000 7f4b71323800 20 add_watcher() i=1 2024-09-12T01:04:18.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.983+0000 7f4b71323800 20 add_watcher() i=2 2024-09-12T01:04:18.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.983+0000 7f4b71323800 20 add_watcher() i=3 2024-09-12T01:04:18.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.983+0000 7f4b71323800 20 add_watcher() i=4 2024-09-12T01:04:18.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.983+0000 7f4b71323800 20 add_watcher() i=5 2024-09-12T01:04:18.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.983+0000 7f4b71323800 20 add_watcher() i=6 2024-09-12T01:04:18.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.984+0000 7f4b71323800 20 add_watcher() i=7 2024-09-12T01:04:18.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.984+0000 7f4b71323800 2 all 8 watchers are set, enabling cache 2024-09-12T01:04:18.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.986+0000 7f4a237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:18.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.986+0000 7f4b71323800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:04:18.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.986+0000 7f4b71323800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:04:18.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.986+0000 7f4b71323800 5 note: GC not initialized 2024-09-12T01:04:18.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.986+0000 7f4a227e4640 20 reqs_thread_entry: start 2024-09-12T01:04:18.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.986+0000 7f4b71323800 20 init_complete bucket index max shards: 1 2024-09-12T01:04:18.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.986+0000 7f4b71323800 20 Filter name: none 2024-09-12T01:04:18.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.986+0000 7f4993fff640 20 reqs_thread_entry: start 2024-09-12T01:04:18.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.987+0000 7f4b71323800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-12T01:04:18.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.987+0000 7f4b71323800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.987+0000 7f4b71323800 20 rados_obj.operate() r=0 bl.length=494 2024-09-12T01:04:18.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.987+0000 7f4b71323800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x13 2024-09-12T01:04:18.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.987+0000 7f4b71323800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T01:04:18.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.987+0000 7f4b71323800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:04:18.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.989+0000 7f4b71323800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T01:04:18.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.989+0000 7f4b71323800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T01:04:18.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.989+0000 7f4b71323800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-12T01:04:18.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.990+0000 7f4a50ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398973 cookie 93900012196144 notifier 8645 bl.length()=695 2024-09-12T01:04:18.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.990+0000 7f4a50ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T01:04:18.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.990+0000 7f4a50ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T01:04:18.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.992+0000 7f4a237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:18.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.995+0000 7f4b71323800 20 remove_watcher() i=0 2024-09-12T01:04:18.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.995+0000 7f4b71323800 2 removed watcher, disabling cache 2024-09-12T01:04:18.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.996+0000 7f4b71323800 20 remove_watcher() i=1 2024-09-12T01:04:18.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.997+0000 7f4b71323800 20 remove_watcher() i=2 2024-09-12T01:04:18.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.998+0000 7f4b71323800 20 remove_watcher() i=3 2024-09-12T01:04:18.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:18.999+0000 7f4b71323800 20 remove_watcher() i=4 2024-09-12T01:04:18.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.000+0000 7f4b71323800 20 remove_watcher() i=5 2024-09-12T01:04:19.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.001+0000 7f4b71323800 20 remove_watcher() i=6 2024-09-12T01:04:19.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.002+0000 7f4b71323800 20 remove_watcher() i=7 2024-09-12T01:04:19.012 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW99999999999999999 --account-name Mr.RGW99999999999999999 --email RGW99999999999999999+test@test.test 2024-09-12T01:04:19.071 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:04:19.072 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:04:19.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.107+0000 7f451da0e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:19.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.108+0000 7f451da0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:19.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.108+0000 7f451da0e800 20 realm 2024-09-12T01:04:19.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.108+0000 7f451da0e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:19.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.108+0000 7f451da0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:19.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.108+0000 7f451da0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:04:19.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.108+0000 7f451da0e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:19.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.109+0000 7f451da0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:19.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.109+0000 7f451da0e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:19.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.110+0000 7f451da0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:19.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.110+0000 7f451da0e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:19.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.111+0000 7f451da0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:04:19.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.111+0000 7f451da0e800 20 searching for the correct realm 2024-09-12T01:04:19.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.315+0000 7f45198cc640 0 -- 172.21.15.73:0/2380678536 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f45040bec20 msgr2=0x7f45040a3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:04:19.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.522+0000 7f45198cc640 0 -- 172.21.15.73:0/2380678536 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f45040bec20 msgr2=0x7f45040a3cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:19.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.526+0000 7f451da0e800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T01:04:19.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.526+0000 7f451da0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:04:19.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.526+0000 7f451da0e800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T01:04:19.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.526+0000 7f451da0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:04:19.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.526+0000 7f451da0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:04:19.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.526+0000 7f451da0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:04:19.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.526+0000 7f451da0e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:19.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.526+0000 7f451da0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:19.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.526+0000 7f451da0e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:19.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.526+0000 7f451da0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:19.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.526+0000 7f451da0e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:19.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.526+0000 7f451da0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:04:19.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.527+0000 7f451da0e800 20 zone default found 2024-09-12T01:04:19.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.527+0000 7f451da0e800 4 Realm: () 2024-09-12T01:04:19.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.527+0000 7f451da0e800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T01:04:19.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.527+0000 7f451da0e800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T01:04:19.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.527+0000 7f451da0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:04:19.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.527+0000 7f451da0e800 20 zonegroup default 2024-09-12T01:04:19.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.527+0000 7f451da0e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:19.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.527+0000 7f451da0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:19.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.527+0000 7f451da0e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:19.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.527+0000 7f451da0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:19.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.527+0000 7f451da0e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:19.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.527+0000 7f451da0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:19.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.527+0000 7f451da0e800 20 started sync module instance, tier type = 2024-09-12T01:04:19.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.527+0000 7f451da0e800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T01:04:19.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.537+0000 7f451da0e800 20 add_watcher() i=0 2024-09-12T01:04:19.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.537+0000 7f451da0e800 20 add_watcher() i=1 2024-09-12T01:04:19.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.537+0000 7f451da0e800 20 add_watcher() i=2 2024-09-12T01:04:19.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.537+0000 7f451da0e800 20 add_watcher() i=3 2024-09-12T01:04:19.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.537+0000 7f451da0e800 20 add_watcher() i=4 2024-09-12T01:04:19.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.537+0000 7f451da0e800 20 add_watcher() i=5 2024-09-12T01:04:19.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.537+0000 7f451da0e800 20 add_watcher() i=6 2024-09-12T01:04:19.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.538+0000 7f451da0e800 20 add_watcher() i=7 2024-09-12T01:04:19.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.538+0000 7f451da0e800 2 all 8 watchers are set, enabling cache 2024-09-12T01:04:19.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.540+0000 7f43cffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:19.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.540+0000 7f451da0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:04:19.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.540+0000 7f451da0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:04:19.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.540+0000 7f451da0e800 5 note: GC not initialized 2024-09-12T01:04:19.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.540+0000 7f43cefe5640 20 reqs_thread_entry: start 2024-09-12T01:04:19.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.540+0000 7f451da0e800 20 init_complete bucket index max shards: 1 2024-09-12T01:04:19.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.540+0000 7f451da0e800 20 Filter name: none 2024-09-12T01:04:19.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.540+0000 7f43ccfe1640 20 reqs_thread_entry: start 2024-09-12T01:04:19.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.540+0000 7f451da0e800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 : miss 2024-09-12T01:04:19.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.540+0000 7f451da0e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:19.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.541+0000 7f451da0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:19.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.541+0000 7f451da0e800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x0 2024-09-12T01:04:19.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.541+0000 7f451da0e800 10 adding default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T01:04:19.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.541+0000 7f451da0e800 20 failed to read name.$Mr.RGW99999999999999999 with: (2) No such file or directory 2024-09-12T01:04:19.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.541+0000 7f451da0e800 10 cache get: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test : miss 2024-09-12T01:04:19.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.541+0000 7f451da0e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:19.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.541+0000 7f451da0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:19.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.541+0000 7f451da0e800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x0 2024-09-12T01:04:19.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.541+0000 7f451da0e800 10 adding default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T01:04:19.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.541+0000 7f451da0e800 20 failed to read rgw99999999999999999+test@test.test with: (2) No such file or directory 2024-09-12T01:04:19.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.542+0000 7f451da0e800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T01:04:19.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.542+0000 7f451da0e800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T01:04:19.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.542+0000 7f451da0e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW99999999999999999, ofs0, ns] 2024-09-12T01:04:19.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.543+0000 7f43fcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398974 cookie 94298851780096 notifier 9267 bl.length()=384 2024-09-12T01:04:19.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.543+0000 7f43fcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T01:04:19.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.543+0000 7f43fcff9640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T01:04:19.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.546+0000 7f451da0e800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-12T01:04:19.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.546+0000 7f451da0e800 10 moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T01:04:19.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.546+0000 7f451da0e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW99999999999999999, ofs0, ns] 2024-09-12T01:04:19.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.547+0000 7f43fcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399020 cookie 94298851795984 notifier 9267 bl.length()=225 2024-09-12T01:04:19.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.547+0000 7f43fcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-12T01:04:19.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.547+0000 7f43fcff9640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T01:04:19.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.550+0000 7f451da0e800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-12T01:04:19.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.550+0000 7f451da0e800 10 moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T01:04:19.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.550+0000 7f451da0e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw99999999999999999+test@test.test, ofs0, ns] 2024-09-12T01:04:19.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.550+0000 7f43ebfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398944 cookie 94298851791056 notifier 9267 bl.length()=234 2024-09-12T01:04:19.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.550+0000 7f43ebfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-12T01:04:19.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.550+0000 7f43ebfff640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T01:04:19.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.552+0000 7f43cffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:19.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.555+0000 7f451da0e800 20 remove_watcher() i=0 2024-09-12T01:04:19.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.555+0000 7f451da0e800 2 removed watcher, disabling cache 2024-09-12T01:04:19.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.556+0000 7f451da0e800 20 remove_watcher() i=1 2024-09-12T01:04:19.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.557+0000 7f451da0e800 20 remove_watcher() i=2 2024-09-12T01:04:19.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.558+0000 7f451da0e800 20 remove_watcher() i=3 2024-09-12T01:04:19.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.559+0000 7f451da0e800 20 remove_watcher() i=4 2024-09-12T01:04:19.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.560+0000 7f451da0e800 20 remove_watcher() i=5 2024-09-12T01:04:19.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.561+0000 7f451da0e800 20 remove_watcher() i=6 2024-09-12T01:04:19.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.562+0000 7f451da0e800 20 remove_watcher() i=7 2024-09-12T01:04:19.569 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T01:04:19.569 INFO:teuthology.orchestra.run.smithi073.stdout: "id": "RGW99999999999999999", 2024-09-12T01:04:19.569 INFO:teuthology.orchestra.run.smithi073.stdout: "tenant": "", 2024-09-12T01:04:19.569 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "Mr.RGW99999999999999999", 2024-09-12T01:04:19.570 INFO:teuthology.orchestra.run.smithi073.stdout: "email": "RGW99999999999999999+test@test.test", 2024-09-12T01:04:19.570 INFO:teuthology.orchestra.run.smithi073.stdout: "quota": { 2024-09-12T01:04:19.570 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": false, 2024-09-12T01:04:19.570 INFO:teuthology.orchestra.run.smithi073.stdout: "check_on_raw": false, 2024-09-12T01:04:19.570 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size": -1, 2024-09-12T01:04:19.570 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size_kb": 0, 2024-09-12T01:04:19.570 INFO:teuthology.orchestra.run.smithi073.stdout: "max_objects": -1 2024-09-12T01:04:19.570 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T01:04:19.570 INFO:teuthology.orchestra.run.smithi073.stdout: "bucket_quota": { 2024-09-12T01:04:19.570 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": false, 2024-09-12T01:04:19.570 INFO:teuthology.orchestra.run.smithi073.stdout: "check_on_raw": false, 2024-09-12T01:04:19.570 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size": -1, 2024-09-12T01:04:19.570 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size_kb": 0, 2024-09-12T01:04:19.570 INFO:teuthology.orchestra.run.smithi073.stdout: "max_objects": -1 2024-09-12T01:04:19.570 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T01:04:19.570 INFO:teuthology.orchestra.run.smithi073.stdout: "max_users": 1000, 2024-09-12T01:04:19.571 INFO:teuthology.orchestra.run.smithi073.stdout: "max_roles": 1000, 2024-09-12T01:04:19.571 INFO:teuthology.orchestra.run.smithi073.stdout: "max_groups": 1000, 2024-09-12T01:04:19.571 INFO:teuthology.orchestra.run.smithi073.stdout: "max_buckets": 1000, 2024-09-12T01:04:19.571 INFO:teuthology.orchestra.run.smithi073.stdout: "max_access_keys": 4 2024-09-12T01:04:19.571 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T01:04:19.572 DEBUG:tasks.s3tests:Creating user RGW99999999999999999 on client.0 2024-09-12T01:04:19.572 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root2.client.0 --display-name Mr.RGW99999999999999999 --email root2+test@test.test --access-key OYBJNRFTELQWAEZNCFOU --secret GXH8Wb5PiAf0+XRkOjvNBLyGMdHr+5LEuSpzPpVA7lr92oteFT2fvA== --cluster ceph --account-id RGW99999999999999999 --account-root 2024-09-12T01:04:19.639 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:04:19.639 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:04:19.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.673+0000 7f2e50946800 20 rados->read ofs=0 len=0 2024-09-12T01:04:19.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.675+0000 7f2e50946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:19.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.675+0000 7f2e50946800 20 realm 2024-09-12T01:04:19.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.675+0000 7f2e50946800 20 rados->read ofs=0 len=0 2024-09-12T01:04:19.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.675+0000 7f2e50946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:19.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.675+0000 7f2e50946800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:04:19.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.675+0000 7f2e50946800 20 rados->read ofs=0 len=0 2024-09-12T01:04:19.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.675+0000 7f2e50946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:19.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.675+0000 7f2e50946800 20 rados->read ofs=0 len=0 2024-09-12T01:04:19.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.676+0000 7f2e50946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:19.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.676+0000 7f2e50946800 20 rados->read ofs=0 len=0 2024-09-12T01:04:19.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.677+0000 7f2e50946800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:04:19.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.677+0000 7f2e50946800 20 searching for the correct realm 2024-09-12T01:04:19.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.680+0000 7f2e4ec31640 0 -- 172.21.15.73:0/236184355 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f2e40087030 msgr2=0x7f2e4007a410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:19.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.684+0000 7f2e4ec31640 0 -- 172.21.15.73:0/236184355 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f2d180870a0 msgr2=0x7f2d180894d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:19.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.688+0000 7f2e50946800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T01:04:19.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.688+0000 7f2e50946800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:04:19.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.688+0000 7f2e50946800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T01:04:19.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.688+0000 7f2e50946800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:04:19.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.688+0000 7f2e50946800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:04:19.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.688+0000 7f2e50946800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:04:19.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.688+0000 7f2e50946800 20 rados->read ofs=0 len=0 2024-09-12T01:04:19.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.688+0000 7f2e50946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:19.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.688+0000 7f2e50946800 20 rados->read ofs=0 len=0 2024-09-12T01:04:19.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.688+0000 7f2e50946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:19.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.688+0000 7f2e50946800 20 rados->read ofs=0 len=0 2024-09-12T01:04:19.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.689+0000 7f2e50946800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:04:19.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.689+0000 7f2e50946800 20 zone default found 2024-09-12T01:04:19.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.689+0000 7f2e50946800 4 Realm: () 2024-09-12T01:04:19.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.689+0000 7f2e50946800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T01:04:19.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.689+0000 7f2e50946800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T01:04:19.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.689+0000 7f2e50946800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:04:19.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.689+0000 7f2e50946800 20 zonegroup default 2024-09-12T01:04:19.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.689+0000 7f2e50946800 20 rados->read ofs=0 len=0 2024-09-12T01:04:19.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.689+0000 7f2e50946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:19.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.689+0000 7f2e50946800 20 rados->read ofs=0 len=0 2024-09-12T01:04:19.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.689+0000 7f2e50946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:19.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.689+0000 7f2e50946800 20 rados->read ofs=0 len=0 2024-09-12T01:04:19.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.689+0000 7f2e50946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:19.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.689+0000 7f2e50946800 20 started sync module instance, tier type = 2024-09-12T01:04:19.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.689+0000 7f2e50946800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T01:04:19.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.698+0000 7f2e50946800 20 add_watcher() i=0 2024-09-12T01:04:19.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.698+0000 7f2e50946800 20 add_watcher() i=1 2024-09-12T01:04:19.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.698+0000 7f2e50946800 20 add_watcher() i=2 2024-09-12T01:04:19.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.698+0000 7f2e50946800 20 add_watcher() i=3 2024-09-12T01:04:19.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.698+0000 7f2e50946800 20 add_watcher() i=4 2024-09-12T01:04:19.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.698+0000 7f2e50946800 20 add_watcher() i=5 2024-09-12T01:04:19.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.699+0000 7f2e50946800 20 add_watcher() i=6 2024-09-12T01:04:19.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.699+0000 7f2e50946800 20 add_watcher() i=7 2024-09-12T01:04:19.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.699+0000 7f2e50946800 2 all 8 watchers are set, enabling cache 2024-09-12T01:04:19.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.701+0000 7f2d04fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:19.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.701+0000 7f2e50946800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:04:19.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.701+0000 7f2e50946800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:04:19.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.701+0000 7f2e50946800 5 note: GC not initialized 2024-09-12T01:04:19.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.701+0000 7f2c7f7fe640 20 reqs_thread_entry: start 2024-09-12T01:04:19.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.701+0000 7f2e50946800 20 init_complete bucket index max shards: 1 2024-09-12T01:04:19.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.702+0000 7f2e50946800 20 Filter name: none 2024-09-12T01:04:19.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.702+0000 7f2c7d7fa640 20 reqs_thread_entry: start 2024-09-12T01:04:19.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.702+0000 7f2e50946800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-12T01:04:19.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.702+0000 7f2e50946800 20 rados->read ofs=0 len=0 2024-09-12T01:04:19.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.702+0000 7f2e50946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:19.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.702+0000 7f2e50946800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x0 2024-09-12T01:04:19.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.702+0000 7f2e50946800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T01:04:19.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.702+0000 7f2e50946800 10 cache get: name=default.rgw.meta+users.email+root2+test@test.test : miss 2024-09-12T01:04:19.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.702+0000 7f2e50946800 20 rados->read ofs=0 len=0 2024-09-12T01:04:19.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.702+0000 7f2e50946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:19.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.702+0000 7f2e50946800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x0 2024-09-12T01:04:19.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.702+0000 7f2e50946800 10 adding default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T01:04:19.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.702+0000 7f2e50946800 10 cache get: name=default.rgw.meta+users.keys+OYBJNRFTELQWAEZNCFOU : miss 2024-09-12T01:04:19.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.702+0000 7f2e50946800 20 rados->read ofs=0 len=0 2024-09-12T01:04:19.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.702+0000 7f2e50946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:19.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.702+0000 7f2e50946800 10 cache put: name=default.rgw.meta+users.keys+OYBJNRFTELQWAEZNCFOU info.flags=0x0 2024-09-12T01:04:19.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.702+0000 7f2e50946800 10 adding default.rgw.meta+users.keys+OYBJNRFTELQWAEZNCFOU to cache LRU end 2024-09-12T01:04:19.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.702+0000 7f2e50946800 10 cache get: name=default.rgw.meta+accounts+account.RGW99999999999999999 : miss 2024-09-12T01:04:19.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.702+0000 7f2e50946800 20 rados->read ofs=0 len=0 2024-09-12T01:04:19.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.703+0000 7f2e50946800 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T01:04:19.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.703+0000 7f2e50946800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T01:04:19.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.703+0000 7f2e50946800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T01:04:19.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.703+0000 7f2e50946800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:04:19.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.703+0000 7f2e50946800 10 cache get: name=default.rgw.meta+users.keys+OYBJNRFTELQWAEZNCFOU : hit (negative entry) 2024-09-12T01:04:19.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.703+0000 7f2e50946800 10 cache get: name=default.rgw.meta+users.keys+OYBJNRFTELQWAEZNCFOU : hit (negative entry) 2024-09-12T01:04:19.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.705+0000 7f2e50946800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T01:04:19.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.705+0000 7f2e50946800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T01:04:19.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.705+0000 7f2e50946800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-12T01:04:19.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.705+0000 7f2d31ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398975 cookie 94121178291872 notifier 9285 bl.length()=681 2024-09-12T01:04:19.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.705+0000 7f2d31ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T01:04:19.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.705+0000 7f2d31ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T01:04:19.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.708+0000 7f2e50946800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-12T01:04:19.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.708+0000 7f2e50946800 10 moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T01:04:19.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.708+0000 7f2e50946800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root2+test@test.test, ofs0, ns] 2024-09-12T01:04:19.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.708+0000 7f2d31ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399086 cookie 94121178304176 notifier 9285 bl.length()=189 2024-09-12T01:04:19.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.708+0000 7f2d31ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-12T01:04:19.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.708+0000 7f2d31ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T01:04:19.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.711+0000 7f2e50946800 10 cache put: name=default.rgw.meta+users.keys+OYBJNRFTELQWAEZNCFOU info.flags=0x7 2024-09-12T01:04:19.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.711+0000 7f2e50946800 10 moving default.rgw.meta+users.keys+OYBJNRFTELQWAEZNCFOU to cache LRU end 2024-09-12T01:04:19.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.711+0000 7f2e50946800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:OYBJNRFTELQWAEZNCFOU, ofs0, ns] 2024-09-12T01:04:19.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.711+0000 7f2d317fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399087 cookie 94121178306480 notifier 9285 bl.length()=188 2024-09-12T01:04:19.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.711+0000 7f2d317fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OYBJNRFTELQWAEZNCFOU info.flags=0x7 2024-09-12T01:04:19.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.711+0000 7f2d317fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OYBJNRFTELQWAEZNCFOU to cache LRU end 2024-09-12T01:04:19.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.713+0000 7f2e50946800 20 linked user root2.client.0 to account RGW99999999999999999 2024-09-12T01:04:19.712 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T01:04:19.713 INFO:teuthology.orchestra.run.smithi073.stdout: "user_id": "root2.client.0", 2024-09-12T01:04:19.713 INFO:teuthology.orchestra.run.smithi073.stdout: "display_name": "Mr.RGW99999999999999999", 2024-09-12T01:04:19.713 INFO:teuthology.orchestra.run.smithi073.stdout: "email": "root2+test@test.test", 2024-09-12T01:04:19.713 INFO:teuthology.orchestra.run.smithi073.stdout: "suspended": 0, 2024-09-12T01:04:19.713 INFO:teuthology.orchestra.run.smithi073.stdout: "max_buckets": 1000, 2024-09-12T01:04:19.713 INFO:teuthology.orchestra.run.smithi073.stdout: "subusers": [], 2024-09-12T01:04:19.713 INFO:teuthology.orchestra.run.smithi073.stdout: "keys": [ 2024-09-12T01:04:19.713 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T01:04:19.713 INFO:teuthology.orchestra.run.smithi073.stdout: "user": "root2.client.0", 2024-09-12T01:04:19.713 INFO:teuthology.orchestra.run.smithi073.stdout: "access_key": "OYBJNRFTELQWAEZNCFOU", 2024-09-12T01:04:19.713 INFO:teuthology.orchestra.run.smithi073.stdout: "secret_key": "GXH8Wb5PiAf0+XRkOjvNBLyGMdHr+5LEuSpzPpVA7lr92oteFT2fvA==", 2024-09-12T01:04:19.713 INFO:teuthology.orchestra.run.smithi073.stdout: "active": true, 2024-09-12T01:04:19.713 INFO:teuthology.orchestra.run.smithi073.stdout: "create_date": "2024-09-12T01:04:19.704377Z" 2024-09-12T01:04:19.713 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T01:04:19.714 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-12T01:04:19.714 INFO:teuthology.orchestra.run.smithi073.stdout: "swift_keys": [], 2024-09-12T01:04:19.714 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": [], 2024-09-12T01:04:19.714 INFO:teuthology.orchestra.run.smithi073.stdout: "op_mask": "read, write, delete", 2024-09-12T01:04:19.714 INFO:teuthology.orchestra.run.smithi073.stdout: "default_placement": "", 2024-09-12T01:04:19.714 INFO:teuthology.orchestra.run.smithi073.stdout: "default_storage_class": "", 2024-09-12T01:04:19.714 INFO:teuthology.orchestra.run.smithi073.stdout: "placement_tags": [], 2024-09-12T01:04:19.714 INFO:teuthology.orchestra.run.smithi073.stdout: "bucket_quota": { 2024-09-12T01:04:19.714 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": false, 2024-09-12T01:04:19.714 INFO:teuthology.orchestra.run.smithi073.stdout: "check_on_raw": false, 2024-09-12T01:04:19.714 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size": -1, 2024-09-12T01:04:19.714 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size_kb": 0, 2024-09-12T01:04:19.714 INFO:teuthology.orchestra.run.smithi073.stdout: "max_objects": -1 2024-09-12T01:04:19.714 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T01:04:19.715 INFO:teuthology.orchestra.run.smithi073.stdout: "user_quota": { 2024-09-12T01:04:19.715 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": false, 2024-09-12T01:04:19.715 INFO:teuthology.orchestra.run.smithi073.stdout: "check_on_raw": false, 2024-09-12T01:04:19.715 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size": -1, 2024-09-12T01:04:19.715 INFO:teuthology.orchestra.run.smithi073.stdout: "max_size_kb": 0, 2024-09-12T01:04:19.715 INFO:teuthology.orchestra.run.smithi073.stdout: "max_objects": -1 2024-09-12T01:04:19.715 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T01:04:19.715 INFO:teuthology.orchestra.run.smithi073.stdout: "temp_url_keys": [], 2024-09-12T01:04:19.715 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "root", 2024-09-12T01:04:19.715 INFO:teuthology.orchestra.run.smithi073.stdout: "mfa_ids": [], 2024-09-12T01:04:19.715 INFO:teuthology.orchestra.run.smithi073.stdout: "account_id": "RGW99999999999999999", 2024-09-12T01:04:19.715 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/", 2024-09-12T01:04:19.715 INFO:teuthology.orchestra.run.smithi073.stdout: "create_date": "2024-09-12T01:04:19.704366Z", 2024-09-12T01:04:19.715 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2024-09-12T01:04:19.715 INFO:teuthology.orchestra.run.smithi073.stdout: "group_ids": [] 2024-09-12T01:04:19.716 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T01:04:19.716 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:04:19.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.714+0000 7f2d04fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:19.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.716+0000 7f2e50946800 20 remove_watcher() i=0 2024-09-12T01:04:19.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.716+0000 7f2e50946800 2 removed watcher, disabling cache 2024-09-12T01:04:19.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.718+0000 7f2e50946800 20 remove_watcher() i=1 2024-09-12T01:04:19.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.719+0000 7f2e50946800 20 remove_watcher() i=2 2024-09-12T01:04:19.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.720+0000 7f2e50946800 20 remove_watcher() i=3 2024-09-12T01:04:19.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.721+0000 7f2e50946800 20 remove_watcher() i=4 2024-09-12T01:04:19.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.722+0000 7f2e50946800 20 remove_watcher() i=5 2024-09-12T01:04:19.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.723+0000 7f2e50946800 20 remove_watcher() i=6 2024-09-12T01:04:19.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.724+0000 7f2e50946800 20 remove_watcher() i=7 2024-09-12T01:04:19.733 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root2.client.0 --totp-serial 2261609046 --totp-seed I2APFN2BYJ6QQERJRIRINBGVHOZGUCECER5C63LM3UVUF3DRDUES4ZDSQLRJB725 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T01:04:19.801 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:04:19.801 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:04:19.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.835+0000 7f5b62925800 20 rados->read ofs=0 len=0 2024-09-12T01:04:19.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.836+0000 7f5b62925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:19.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.836+0000 7f5b62925800 20 realm 2024-09-12T01:04:19.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.836+0000 7f5b62925800 20 rados->read ofs=0 len=0 2024-09-12T01:04:19.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.837+0000 7f5b62925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:19.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.837+0000 7f5b62925800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:04:19.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.837+0000 7f5b62925800 20 rados->read ofs=0 len=0 2024-09-12T01:04:19.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.837+0000 7f5b62925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:19.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.837+0000 7f5b62925800 20 rados->read ofs=0 len=0 2024-09-12T01:04:19.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.838+0000 7f5b62925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:19.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.838+0000 7f5b62925800 20 rados->read ofs=0 len=0 2024-09-12T01:04:19.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.838+0000 7f5b62925800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:04:19.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.838+0000 7f5b62925800 20 searching for the correct realm 2024-09-12T01:04:19.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.841+0000 7f5b5edaf640 0 -- 172.21.15.73:0/3950979372 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f5b5402b410 msgr2=0x7f5b5402b830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:19.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.845+0000 7f5b5edaf640 0 -- 172.21.15.73:0/3950979372 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f5a28086ff0 msgr2=0x7f5a28089420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:19.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.848+0000 7f5b62925800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T01:04:19.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.848+0000 7f5b62925800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:04:19.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.848+0000 7f5b62925800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T01:04:19.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.848+0000 7f5b62925800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:04:19.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.848+0000 7f5b62925800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:04:19.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.848+0000 7f5b62925800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:04:19.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.848+0000 7f5b62925800 20 rados->read ofs=0 len=0 2024-09-12T01:04:19.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.848+0000 7f5b62925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:19.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.848+0000 7f5b62925800 20 rados->read ofs=0 len=0 2024-09-12T01:04:19.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.849+0000 7f5b62925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:19.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.849+0000 7f5b62925800 20 rados->read ofs=0 len=0 2024-09-12T01:04:19.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.849+0000 7f5b62925800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:04:19.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.849+0000 7f5b62925800 20 zone default found 2024-09-12T01:04:19.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.849+0000 7f5b62925800 4 Realm: () 2024-09-12T01:04:19.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.849+0000 7f5b62925800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T01:04:19.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.849+0000 7f5b62925800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T01:04:19.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.849+0000 7f5b62925800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:04:19.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.849+0000 7f5b62925800 20 zonegroup default 2024-09-12T01:04:19.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.849+0000 7f5b62925800 20 rados->read ofs=0 len=0 2024-09-12T01:04:19.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.849+0000 7f5b62925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:19.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.849+0000 7f5b62925800 20 rados->read ofs=0 len=0 2024-09-12T01:04:19.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.849+0000 7f5b62925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:19.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.849+0000 7f5b62925800 20 rados->read ofs=0 len=0 2024-09-12T01:04:19.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.850+0000 7f5b62925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:19.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.850+0000 7f5b62925800 20 started sync module instance, tier type = 2024-09-12T01:04:19.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.850+0000 7f5b62925800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T01:04:19.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.858+0000 7f5b62925800 20 add_watcher() i=0 2024-09-12T01:04:19.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.858+0000 7f5b62925800 20 add_watcher() i=1 2024-09-12T01:04:19.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.858+0000 7f5b62925800 20 add_watcher() i=2 2024-09-12T01:04:19.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.858+0000 7f5b62925800 20 add_watcher() i=3 2024-09-12T01:04:19.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.858+0000 7f5b62925800 20 add_watcher() i=4 2024-09-12T01:04:19.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.858+0000 7f5b62925800 20 add_watcher() i=5 2024-09-12T01:04:19.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.858+0000 7f5b62925800 20 add_watcher() i=6 2024-09-12T01:04:19.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.859+0000 7f5b62925800 20 add_watcher() i=7 2024-09-12T01:04:19.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.859+0000 7f5b62925800 2 all 8 watchers are set, enabling cache 2024-09-12T01:04:19.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.861+0000 7f5a14fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:19.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.861+0000 7f5b62925800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:04:19.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.861+0000 7f5b62925800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:04:19.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.861+0000 7f5b62925800 5 note: GC not initialized 2024-09-12T01:04:19.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.861+0000 7f598f7fe640 20 reqs_thread_entry: start 2024-09-12T01:04:19.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.861+0000 7f5b62925800 20 init_complete bucket index max shards: 1 2024-09-12T01:04:19.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.861+0000 7f5b62925800 20 Filter name: none 2024-09-12T01:04:19.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.861+0000 7f598d7fa640 20 reqs_thread_entry: start 2024-09-12T01:04:19.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.861+0000 7f5b62925800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-12T01:04:19.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.861+0000 7f5b62925800 20 rados->read ofs=0 len=0 2024-09-12T01:04:19.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.862+0000 7f5b62925800 20 rados_obj.operate() r=0 bl.length=494 2024-09-12T01:04:19.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.862+0000 7f5b62925800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x13 2024-09-12T01:04:19.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.862+0000 7f5b62925800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T01:04:19.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.862+0000 7f5b62925800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:04:19.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.864+0000 7f5b62925800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T01:04:19.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.864+0000 7f5b62925800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T01:04:19.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.864+0000 7f5b62925800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-12T01:04:19.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.865+0000 7f5a41ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398976 cookie 94038087512848 notifier 9303 bl.length()=695 2024-09-12T01:04:19.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.865+0000 7f5a41ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T01:04:19.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.865+0000 7f5a41ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T01:04:19.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.867+0000 7f5a14fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:19.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.870+0000 7f5b62925800 20 remove_watcher() i=0 2024-09-12T01:04:19.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.870+0000 7f5b62925800 2 removed watcher, disabling cache 2024-09-12T01:04:19.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.871+0000 7f5b62925800 20 remove_watcher() i=1 2024-09-12T01:04:19.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.872+0000 7f5b62925800 20 remove_watcher() i=2 2024-09-12T01:04:19.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.873+0000 7f5b62925800 20 remove_watcher() i=3 2024-09-12T01:04:19.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.874+0000 7f5b62925800 20 remove_watcher() i=4 2024-09-12T01:04:19.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.875+0000 7f5b62925800 20 remove_watcher() i=5 2024-09-12T01:04:19.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.876+0000 7f5b62925800 20 remove_watcher() i=6 2024-09-12T01:04:19.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:04:19.877+0000 7f5b62925800 20 remove_watcher() i=7 2024-09-12T01:04:19.886 INFO:tasks.s3tests:Configuring s3-tests... 2024-09-12T01:04:19.887 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T01:04:19.887 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2024-09-12T01:04:19.915 INFO:tasks.s3tests:Configuring boto... 2024-09-12T01:04:19.915 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T01:04:19.915 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2024-09-12T01:04:19.983 DEBUG:teuthology.orchestra.run.smithi073:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-12T01:04:20.162 INFO:teuthology.orchestra.run.smithi073.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2024-09-12T01:04:20.335 INFO:teuthology.orchestra.run.smithi073.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2024-09-12T01:04:20.597 INFO:teuthology.orchestra.run.smithi073.stdout:py installdeps: -rrequirements.txt 2024-09-12T01:06:08.061 INFO:teuthology.orchestra.run.smithi073.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2024-09-12T01:06:09.450 INFO:teuthology.orchestra.run.smithi073.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.5.0,certifi==2024.8.30,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.8,exceptiongroup==1.2.2,filelock==3.16.0,gevent==24.2.1,greenlet==3.1.0,httplib2==0.22.0,idna==3.8,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==5.3.0,munch==4.0.0,packaging==24.1,platformdirs==4.3.2,pluggy==1.5.0,pyparsing==3.1.4,pyproject-api==1.7.1,pytest==8.3.3,python-dateutil==2.9.0.post0,pytz==2024.2,PyYAML==6.0.2,requests==2.32.3,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=75e486125633c581e1f96d441626bec6db283965e5c1f9a9488ebd32a64f3b22,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.18.1,urllib3==1.26.20,virtualenv==20.26.4,zope.event==5.0,zope.interface==7.0.3 2024-09-12T01:06:09.450 INFO:teuthology.orchestra.run.smithi073.stdout:py run-test-pre: PYTHONHASHSEED='3189758449' 2024-09-12T01:06:09.450 INFO:teuthology.orchestra.run.smithi073.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-12T01:06:09.584 INFO:teuthology.orchestra.run.smithi073.stdout:============================= test session starts ============================== 2024-09-12T01:06:09.585 INFO:teuthology.orchestra.run.smithi073.stdout:platform linux -- Python 3.9.19, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2024-09-12T01:06:09.585 INFO:teuthology.orchestra.run.smithi073.stdout:cachedir: .tox/py/.pytest_cache 2024-09-12T01:06:09.585 INFO:teuthology.orchestra.run.smithi073.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T01:06:09.585 INFO:teuthology.orchestra.run.smithi073.stdout:configfile: pytest.ini 2024-09-12T01:06:11.334 INFO:teuthology.orchestra.run.smithi073.stdout:collecting ... collected 872 items / 126 deselected / 746 selected 2024-09-12T01:06:11.335 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:06:11.943 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none PASSED [ 0%] 2024-09-12T01:06:12.253 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty PASSED [ 0%] 2024-09-12T01:06:12.548 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2024-09-12T01:06:12.843 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2024-09-12T01:06:13.151 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none PASSED [ 0%] 2024-09-12T01:06:13.374 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2024-09-12T01:06:13.717 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 0%] 2024-09-12T01:06:13.932 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2024-09-12T01:06:14.057 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty PASSED [ 1%] 2024-09-12T01:06:14.179 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none PASSED [ 1%] 2024-09-12T01:06:14.488 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 PASSED [ 1%] 2024-09-12T01:06:14.803 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 PASSED [ 1%] 2024-09-12T01:06:15.112 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 PASSED [ 1%] 2024-09-12T01:06:15.429 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 PASSED [ 1%] 2024-09-12T01:06:15.555 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 PASSED [ 2%] 2024-09-12T01:06:15.683 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 PASSED [ 2%] 2024-09-12T01:06:15.762 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2024-09-12T01:06:15.842 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2024-09-12T01:06:15.920 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2024-09-12T01:06:16.001 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 2%] 2024-09-12T01:06:16.080 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 2%] 2024-09-12T01:06:16.159 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 2%] 2024-09-12T01:06:16.253 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2024-09-12T01:06:16.332 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2024-09-12T01:06:16.412 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2024-09-12T01:06:16.494 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2024-09-12T01:06:16.574 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 3%] 2024-09-12T01:06:16.654 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 3%] 2024-09-12T01:06:16.734 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 3%] 2024-09-12T01:06:16.814 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2024-09-12T01:06:16.893 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2024-09-12T01:06:16.972 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2024-09-12T01:06:17.052 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-12T01:06:17.133 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-12T01:06:17.213 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 4%] 2024-09-12T01:06:17.293 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 4%] 2024-09-12T01:06:17.373 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 4%] 2024-09-12T01:06:17.452 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2024-09-12T01:06:17.533 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2024-09-12T01:06:17.613 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 5%] 2024-09-12T01:06:17.693 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 5%] 2024-09-12T01:06:17.771 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 5%] 2024-09-12T01:06:17.851 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 5%] 2024-09-12T01:06:17.931 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 5%] 2024-09-12T01:06:18.011 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2024-09-12T01:06:18.090 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2024-09-12T01:06:18.170 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 6%] 2024-09-12T01:06:18.250 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 6%] 2024-09-12T01:06:18.330 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 6%] 2024-09-12T01:06:18.410 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 6%] 2024-09-12T01:06:18.489 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 6%] 2024-09-12T01:06:18.568 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 6%] 2024-09-12T01:06:18.647 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2024-09-12T01:06:19.392 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 7%] 2024-09-12T01:06:27.827 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 7%] 2024-09-12T01:06:35.209 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 7%] 2024-09-12T01:06:50.861 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 7%] 2024-09-12T01:07:10.546 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 7%] 2024-09-12T01:07:15.801 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 7%] 2024-09-12T01:07:22.221 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 8%] 2024-09-12T01:07:23.754 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 8%] 2024-09-12T01:07:24.069 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 8%] 2024-09-12T01:07:24.907 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 8%] 2024-09-12T01:07:25.810 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 8%] 2024-09-12T01:07:26.781 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 8%] 2024-09-12T01:07:27.220 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 8%] 2024-09-12T01:07:27.661 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 8%] 2024-09-12T01:07:27.661 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 9%] 2024-09-12T01:07:27.662 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 9%] 2024-09-12T01:07:27.662 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 9%] 2024-09-12T01:07:27.663 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 9%] 2024-09-12T01:07:27.664 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 9%] 2024-09-12T01:07:27.665 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 9%] 2024-09-12T01:07:27.666 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 9%] 2024-09-12T01:07:27.667 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-09-12T01:07:27.667 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-12T01:07:27.668 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-12T01:07:27.669 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-12T01:07:27.670 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 10%] 2024-09-12T01:07:27.671 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-12T01:07:27.672 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-12T01:07:27.672 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-12T01:07:27.673 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-12T01:07:27.674 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-12T01:07:27.675 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-12T01:07:27.675 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-12T01:07:27.676 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 11%] 2024-09-12T01:07:27.677 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 11%] 2024-09-12T01:07:27.679 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 11%] 2024-09-12T01:07:27.679 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 12%] 2024-09-12T01:07:27.679 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 12%] 2024-09-12T01:07:27.680 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 12%] 2024-09-12T01:07:27.681 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 12%] 2024-09-12T01:07:27.682 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 12%] 2024-09-12T01:07:27.764 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 12%] 2024-09-12T01:07:27.778 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 12%] 2024-09-12T01:07:28.916 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 13%] 2024-09-12T01:07:37.301 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 13%] 2024-09-12T01:07:38.058 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 13%] 2024-09-12T01:07:38.985 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 13%] 2024-09-12T01:07:39.917 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 13%] 2024-09-12T01:07:40.844 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 13%] 2024-09-12T01:07:41.776 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 13%] 2024-09-12T01:07:42.537 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 13%] 2024-09-12T01:07:43.473 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 14%] 2024-09-12T01:07:44.319 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 14%] 2024-09-12T01:07:45.150 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 14%] 2024-09-12T01:07:45.903 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 14%] 2024-09-12T01:07:46.571 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 14%] 2024-09-12T01:07:47.231 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 14%] 2024-09-12T01:07:47.780 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 14%] 2024-09-12T01:07:48.556 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 15%] 2024-09-12T01:07:49.406 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 15%] 2024-09-12T01:07:50.279 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 15%] 2024-09-12T01:07:51.041 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 15%] 2024-09-12T01:07:51.806 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 15%] 2024-09-12T01:07:52.573 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 15%] 2024-09-12T01:07:53.332 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 15%] 2024-09-12T01:07:54.083 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 15%] 2024-09-12T01:07:54.747 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 16%] 2024-09-12T01:07:55.411 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 16%] 2024-09-12T01:07:55.959 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 16%] 2024-09-12T01:07:56.550 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 16%] 2024-09-12T01:07:57.113 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 16%] 2024-09-12T01:07:57.661 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 16%] 2024-09-12T01:07:58.204 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 16%] 2024-09-12T01:07:59.154 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 17%] 2024-09-12T01:07:59.710 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 17%] 2024-09-12T01:08:00.280 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 17%] 2024-09-12T01:08:00.987 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 17%] 2024-09-12T01:08:01.684 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 17%] 2024-09-12T01:08:02.231 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 17%] 2024-09-12T01:08:02.954 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 17%] 2024-09-12T01:08:03.841 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 17%] 2024-09-12T01:08:04.701 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-12T01:08:05.328 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 18%] 2024-09-12T01:08:06.008 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 18%] 2024-09-12T01:08:06.706 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 18%] 2024-09-12T01:08:07.716 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-12T01:08:08.633 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-12T01:08:09.460 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-12T01:08:10.425 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 19%] 2024-09-12T01:08:11.508 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 19%] 2024-09-12T01:08:13.433 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-12T01:08:15.693 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-12T01:08:16.803 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-12T01:08:17.879 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-12T01:08:18.731 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 19%] 2024-09-12T01:08:19.757 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 19%] 2024-09-12T01:08:20.575 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 20%] 2024-09-12T01:08:22.209 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_create PASSED [ 20%] 2024-09-12T01:08:23.337 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_case_insensitive_name PASSED [ 20%] 2024-09-12T01:08:24.672 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_delete PASSED [ 20%] 2024-09-12T01:08:27.172 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list PASSED [ 20%] 2024-09-12T01:08:30.404 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list_path_prefix PASSED [ 20%] 2024-09-12T01:08:32.302 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_name PASSED [ 20%] 2024-09-12T01:08:34.064 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_path PASSED [ 21%] 2024-09-12T01:08:35.470 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_create PASSED [ 21%] 2024-09-12T01:08:36.415 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_create PASSED [ 21%] 2024-09-12T01:08:38.026 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_update PASSED [ 21%] 2024-09-12T01:08:39.202 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_update PASSED [ 21%] 2024-09-12T01:08:40.719 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_delete PASSED [ 21%] 2024-09-12T01:08:41.845 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_delete PASSED [ 21%] 2024-09-12T01:08:43.768 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_list PASSED [ 21%] 2024-09-12T01:08:45.354 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_bucket_policy_allow PASSED [ 22%] 2024-09-12T01:08:47.496 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy PASSED [ 22%] 2024-09-12T01:08:49.556 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_managed PASSED [ 22%] 2024-09-12T01:08:51.076 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_allow PASSED [ 22%] 2024-09-12T01:08:52.457 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_create PASSED [ 22%] 2024-09-12T01:08:53.616 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_case_insensitive_name PASSED [ 22%] 2024-09-12T01:08:56.092 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_list PASSED [ 22%] 2024-09-12T01:08:57.937 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_update PASSED [ 23%] 2024-09-12T01:09:00.036 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy PASSED [ 23%] 2024-09-12T01:09:02.078 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy PASSED [ 23%] 2024-09-12T01:09:03.991 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy_allow PASSED [ 23%] 2024-09-12T01:09:05.925 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy_allow PASSED [ 23%] 2024-09-12T01:09:07.526 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_create PASSED [ 23%] 2024-09-12T01:09:08.720 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_case_insensitive_name PASSED [ 23%] 2024-09-12T01:09:10.069 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_delete PASSED [ 23%] 2024-09-12T01:09:12.373 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list PASSED [ 24%] 2024-09-12T01:09:15.280 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list_path_prefix PASSED [ 24%] 2024-09-12T01:09:16.662 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_update PASSED [ 24%] 2024-09-12T01:09:18.607 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy PASSED [ 24%] 2024-09-12T01:09:20.539 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_managed PASSED [ 24%] 2024-09-12T01:09:22.428 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow PASSED [ 24%] 2024-09-12T01:09:24.509 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_same_account_role_policy_allow PASSED [ 24%] 2024-09-12T01:09:26.671 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_role_policy_allow PASSED [ 25%] 2024-09-12T01:09:28.798 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_create_bucket PASSED [ 25%] 2024-09-12T01:09:30.783 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_get_role PASSED [ 25%] 2024-09-12T01:09:32.099 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_account_oidc_provider PASSED [ 25%] 2024-09-12T01:09:33.208 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_new_client_id_to_oidc PASSED [ 25%] 2024-09-12T01:09:34.316 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_existing_client_id_to_oidc PASSED [ 25%] 2024-09-12T01:09:35.432 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_verify_update_thumbprintlist_of_oidc PASSED [ 25%] 2024-09-12T01:09:37.271 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_user_arn PASSED [ 26%] 2024-09-12T01:09:39.219 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_user_arn PASSED [ 26%] 2024-09-12T01:09:41.133 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_arn PASSED [ 26%] 2024-09-12T01:09:42.965 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_arn PASSED [ 26%] 2024-09-12T01:09:44.881 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_id PASSED [ 26%] 2024-09-12T01:09:46.707 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_id PASSED [ 26%] 2024-09-12T01:09:48.568 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_user_id PASSED [ 26%] 2024-09-12T01:09:50.503 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_user_id PASSED [ 26%] 2024-09-12T01:09:52.329 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_canonical_id PASSED [ 27%] 2024-09-12T01:09:54.236 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-12T01:09:56.063 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_account_email PASSED [ 27%] 2024-09-12T01:09:57.962 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_account_email PASSED [ 27%] 2024-09-12T01:09:59.292 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_arn PASSED [ 27%] 2024-09-12T01:10:00.626 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_id PASSED [ 27%] 2024-09-12T01:10:01.909 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-12T01:10:03.185 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_account_email PASSED [ 28%] 2024-09-12T01:10:04.190 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 28%] 2024-09-12T01:10:05.255 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 28%] 2024-09-12T01:10:06.235 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 28%] 2024-09-12T01:10:07.237 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 28%] 2024-09-12T01:10:08.184 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 28%] 2024-09-12T01:10:09.160 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 28%] 2024-09-12T01:10:10.120 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 28%] 2024-09-12T01:10:11.076 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 29%] 2024-09-12T01:10:12.098 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 29%] 2024-09-12T01:10:13.735 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 29%] 2024-09-12T01:10:15.382 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 29%] 2024-09-12T01:10:16.247 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-12T01:10:17.108 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-12T01:10:18.062 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 29%] 2024-09-12T01:10:19.017 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 30%] 2024-09-12T01:10:20.698 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 30%] 2024-09-12T01:10:22.353 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 30%] 2024-09-12T01:10:23.316 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 30%] 2024-09-12T01:10:24.273 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 30%] 2024-09-12T01:10:25.353 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 30%] 2024-09-12T01:10:26.332 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 30%] 2024-09-12T01:10:27.336 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 30%] 2024-09-12T01:10:28.289 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 31%] 2024-09-12T01:10:29.246 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 31%] 2024-09-12T01:10:30.216 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 31%] 2024-09-12T01:10:31.186 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 31%] 2024-09-12T01:10:32.154 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 31%] 2024-09-12T01:10:33.165 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 31%] 2024-09-12T01:10:34.120 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 31%] 2024-09-12T01:10:35.037 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 32%] 2024-09-12T01:10:35.961 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 32%] 2024-09-12T01:10:36.880 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 32%] 2024-09-12T01:10:37.860 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 32%] 2024-09-12T01:10:38.835 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 32%] 2024-09-12T01:11:25.349 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 32%] 2024-09-12T01:11:26.302 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 32%] 2024-09-12T01:11:27.240 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 32%] 2024-09-12T01:11:28.183 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 33%] 2024-09-12T01:11:29.104 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 33%] 2024-09-12T01:11:30.029 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 33%] 2024-09-12T01:11:30.959 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 33%] 2024-09-12T01:11:31.900 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 33%] 2024-09-12T01:11:32.887 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 33%] 2024-09-12T01:11:33.806 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 33%] 2024-09-12T01:11:34.724 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 34%] 2024-09-12T01:11:35.646 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 34%] 2024-09-12T01:11:36.588 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 34%] 2024-09-12T01:11:37.550 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 34%] 2024-09-12T01:11:38.506 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 34%] 2024-09-12T01:11:39.502 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 34%] 2024-09-12T01:11:40.466 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 34%] 2024-09-12T01:11:41.434 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 34%] 2024-09-12T01:11:42.424 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 35%] 2024-09-12T01:11:43.384 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-12T01:11:44.348 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-12T01:11:45.311 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-12T01:11:46.307 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-12T01:11:47.354 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 35%] 2024-09-12T01:11:48.391 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 35%] 2024-09-12T01:11:49.349 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 36%] 2024-09-12T01:11:50.304 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 36%] 2024-09-12T01:11:51.263 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 36%] 2024-09-12T01:11:52.270 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 36%] 2024-09-12T01:11:52.824 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 36%] 2024-09-12T01:11:53.680 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 36%] 2024-09-12T01:11:55.853 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 36%] 2024-09-12T01:11:58.030 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 36%] 2024-09-12T01:11:59.003 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 37%] 2024-09-12T01:12:00.018 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 37%] 2024-09-12T01:12:01.116 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 37%] 2024-09-12T01:12:02.073 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 37%] 2024-09-12T01:12:03.106 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 37%] 2024-09-12T01:12:04.125 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 37%] 2024-09-12T01:12:05.099 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 37%] 2024-09-12T01:12:06.054 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 38%] 2024-09-12T01:12:07.047 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 38%] 2024-09-12T01:12:08.014 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 38%] 2024-09-12T01:12:08.970 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 38%] 2024-09-12T01:12:09.936 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 38%] 2024-09-12T01:12:11.158 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data PASSED [ 38%] 2024-09-12T01:12:12.722 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning PASSED [ 38%] 2024-09-12T01:12:13.609 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 39%] 2024-09-12T01:12:14.456 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 39%] 2024-09-12T01:12:15.234 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 39%] 2024-09-12T01:12:15.993 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 39%] 2024-09-12T01:12:16.537 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 39%] 2024-09-12T01:12:17.079 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 39%] 2024-09-12T01:12:17.654 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 39%] 2024-09-12T01:12:18.508 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 39%] 2024-09-12T01:12:22.601 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 40%] 2024-09-12T01:12:23.193 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 40%] 2024-09-12T01:12:24.010 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 40%] 2024-09-12T01:12:24.728 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 40%] 2024-09-12T01:12:25.489 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 40%] 2024-09-12T01:12:26.244 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 40%] 2024-09-12T01:12:28.607 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 40%] 2024-09-12T01:12:29.723 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 41%] 2024-09-12T01:12:30.858 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 41%] 2024-09-12T01:13:17.583 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 41%] 2024-09-12T01:14:04.116 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 41%] 2024-09-12T01:14:04.962 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 41%] 2024-09-12T01:14:05.841 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 41%] 2024-09-12T01:14:06.699 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 41%] 2024-09-12T01:14:07.554 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 41%] 2024-09-12T01:14:08.530 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 42%] 2024-09-12T01:14:09.390 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 42%] 2024-09-12T01:14:10.252 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 42%] 2024-09-12T01:14:11.319 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 42%] 2024-09-12T01:14:12.231 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 42%] 2024-09-12T01:14:13.133 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 42%] 2024-09-12T01:14:14.032 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 42%] 2024-09-12T01:14:15.034 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 43%] 2024-09-12T01:14:15.906 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 43%] 2024-09-12T01:14:16.662 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 43%] 2024-09-12T01:14:17.480 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 43%] 2024-09-12T01:14:18.374 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 43%] 2024-09-12T01:14:20.078 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 43%] 2024-09-12T01:14:20.995 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 43%] 2024-09-12T01:14:21.815 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 43%] 2024-09-12T01:14:22.642 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 44%] 2024-09-12T01:14:23.553 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 44%] 2024-09-12T01:14:24.454 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 44%] 2024-09-12T01:14:25.226 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 44%] 2024-09-12T01:14:25.985 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 44%] 2024-09-12T01:14:26.744 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 44%] 2024-09-12T01:14:27.542 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 44%] 2024-09-12T01:14:28.302 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 45%] 2024-09-12T01:14:29.069 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 45%] 2024-09-12T01:14:29.974 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 45%] 2024-09-12T01:14:30.733 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 45%] 2024-09-12T01:14:31.522 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 45%] 2024-09-12T01:14:32.286 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 45%] 2024-09-12T01:14:33.041 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 45%] 2024-09-12T01:14:34.029 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket PASSED [ 45%] 2024-09-12T01:14:34.828 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 46%] 2024-09-12T01:14:35.588 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 46%] 2024-09-12T01:14:36.373 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 46%] 2024-09-12T01:14:37.129 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 46%] 2024-09-12T01:14:37.904 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 46%] 2024-09-12T01:14:38.667 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 46%] 2024-09-12T01:14:39.428 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 46%] 2024-09-12T01:14:41.523 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 47%] 2024-09-12T01:14:42.283 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 47%] 2024-09-12T01:14:43.233 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 47%] 2024-09-12T01:14:44.132 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed PASSED [ 47%] 2024-09-12T01:14:44.988 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good PASSED [ 47%] 2024-09-12T01:14:45.879 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 47%] 2024-09-12T01:14:46.790 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 47%] 2024-09-12T01:14:48.753 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed PASSED [ 47%] 2024-09-12T01:14:49.650 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good PASSED [ 48%] 2024-09-12T01:14:50.543 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 48%] 2024-09-12T01:14:51.576 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good PASSED [ 48%] 2024-09-12T01:14:52.605 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 48%] 2024-09-12T01:14:53.614 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 48%] 2024-09-12T01:14:54.497 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 48%] 2024-09-12T01:14:55.502 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 48%] 2024-09-12T01:14:56.553 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 49%] 2024-09-12T01:14:57.452 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 49%] 2024-09-12T01:14:58.493 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 49%] 2024-09-12T01:14:59.390 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 49%] 2024-09-12T01:15:00.209 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 49%] 2024-09-12T01:15:01.039 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 49%] 2024-09-12T01:15:01.918 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 49%] 2024-09-12T01:15:02.676 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 50%] 2024-09-12T01:15:03.237 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 50%] 2024-09-12T01:15:04.282 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 50%] 2024-09-12T01:15:05.123 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 50%] 2024-09-12T01:15:06.035 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 50%] 2024-09-12T01:15:09.376 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime PASSED [ 50%] 2024-09-12T01:15:10.245 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 50%] 2024-09-12T01:15:11.117 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 50%] 2024-09-12T01:15:11.970 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 51%] 2024-09-12T01:15:12.816 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 51%] 2024-09-12T01:15:13.608 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 51%] 2024-09-12T01:15:14.472 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 51%] 2024-09-12T01:15:15.426 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 51%] 2024-09-12T01:15:16.436 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 51%] 2024-09-12T01:15:17.301 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 51%] 2024-09-12T01:15:18.164 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 52%] 2024-09-12T01:15:19.034 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 52%] 2024-09-12T01:15:19.935 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 52%] 2024-09-12T01:15:20.866 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 52%] 2024-09-12T01:15:21.694 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 52%] 2024-09-12T01:15:22.606 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl PASSED [ 52%] 2024-09-12T01:15:23.569 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl_tenant PASSED [ 52%] 2024-09-12T01:15:24.478 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 52%] 2024-09-12T01:15:25.025 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 53%] 2024-09-12T01:15:25.568 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 53%] 2024-09-12T01:15:26.142 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 53%] 2024-09-12T01:15:26.807 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 53%] 2024-09-12T01:15:27.491 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 53%] 2024-09-12T01:15:28.156 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 53%] 2024-09-12T01:15:28.828 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 53%] 2024-09-12T01:15:29.560 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 54%] 2024-09-12T01:15:30.107 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 54%] 2024-09-12T01:15:30.660 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 54%] 2024-09-12T01:15:31.376 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 54%] 2024-09-12T01:15:31.921 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 54%] 2024-09-12T01:15:32.469 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 54%] 2024-09-12T01:15:33.016 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 54%] 2024-09-12T01:15:33.560 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 54%] 2024-09-12T01:15:34.272 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 55%] 2024-09-12T01:15:35.001 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 55%] 2024-09-12T01:15:35.778 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 55%] 2024-09-12T01:15:36.520 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 55%] 2024-09-12T01:15:37.246 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 55%] 2024-09-12T01:15:38.045 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default PASSED [ 55%] 2024-09-12T01:15:38.770 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create PASSED [ 55%] 2024-09-12T01:15:39.573 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned PASSED [ 56%] 2024-09-12T01:15:40.304 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-12T01:15:41.017 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread PASSED [ 56%] 2024-09-12T01:15:41.928 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default PASSED [ 56%] 2024-09-12T01:15:42.824 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create PASSED [ 56%] 2024-09-12T01:15:43.824 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned PASSED [ 56%] 2024-09-12T01:15:44.735 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-12T01:15:45.633 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread PASSED [ 56%] 2024-09-12T01:15:46.634 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 57%] 2024-09-12T01:15:47.594 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 57%] 2024-09-12T01:15:48.575 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 57%] 2024-09-12T01:15:49.569 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 57%] 2024-09-12T01:15:50.337 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 57%] 2024-09-12T01:15:51.347 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl PASSED [ 57%] 2024-09-12T01:15:52.330 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write PASSED [ 57%] 2024-09-12T01:15:53.324 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp PASSED [ 58%] 2024-09-12T01:15:54.310 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read PASSED [ 58%] 2024-09-12T01:15:55.347 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp PASSED [ 58%] 2024-09-12T01:15:56.783 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol PASSED [ 58%] 2024-09-12T01:15:58.057 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read PASSED [ 58%] 2024-09-12T01:15:59.340 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp PASSED [ 58%] 2024-09-12T01:16:00.680 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write PASSED [ 58%] 2024-09-12T01:16:01.947 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp PASSED [ 58%] 2024-09-12T01:16:02.839 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 59%] 2024-09-12T01:16:03.743 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 59%] 2024-09-12T01:16:04.663 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 59%] 2024-09-12T01:16:05.563 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email PASSED [ 59%] 2024-09-12T01:16:06.426 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 59%] 2024-09-12T01:16:07.447 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 59%] 2024-09-12T01:16:08.816 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 59%] 2024-09-12T01:16:10.185 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 60%] 2024-09-12T01:16:11.574 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 60%] 2024-09-12T01:16:12.948 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 60%] 2024-09-12T01:16:14.313 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 60%] 2024-09-12T01:16:15.676 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 60%] 2024-09-12T01:16:17.089 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 60%] 2024-09-12T01:16:18.464 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 60%] 2024-09-12T01:16:19.830 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 60%] 2024-09-12T01:16:21.085 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 61%] 2024-09-12T01:16:22.372 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 61%] 2024-09-12T01:16:23.633 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 61%] 2024-09-12T01:16:25.077 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 61%] 2024-09-12T01:16:26.463 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 61%] 2024-09-12T01:16:27.010 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 61%] 2024-09-12T01:16:27.558 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 61%] 2024-09-12T01:16:28.113 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 62%] 2024-09-12T01:16:28.965 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 62%] 2024-09-12T01:16:29.811 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 62%] 2024-09-12T01:16:30.479 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 62%] 2024-09-12T01:16:31.145 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 62%] 2024-09-12T01:16:32.298 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 62%] 2024-09-12T01:16:34.782 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 62%] 2024-09-12T01:16:35.886 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 63%] 2024-09-12T01:16:36.882 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 63%] 2024-09-12T01:16:40.781 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 63%] 2024-09-12T01:16:41.801 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 63%] 2024-09-12T01:16:42.794 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 63%] 2024-09-12T01:16:43.757 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 63%] 2024-09-12T01:16:44.705 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 63%] 2024-09-12T01:16:45.968 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 63%] 2024-09-12T01:16:46.972 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 64%] 2024-09-12T01:16:48.240 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 64%] 2024-09-12T01:16:49.376 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 64%] 2024-09-12T01:16:51.058 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 64%] 2024-09-12T01:16:52.690 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 64%] 2024-09-12T01:16:53.456 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 64%] 2024-09-12T01:16:54.217 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 64%] 2024-09-12T01:16:56.692 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 65%] 2024-09-12T01:16:57.770 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 65%] 2024-09-12T01:17:25.768 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 65%] 2024-09-12T01:17:26.669 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty PASSED [ 65%] 2024-09-12T01:17:27.768 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small PASSED [ 65%] 2024-09-12T01:17:31.120 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small PASSED [ 65%] 2024-09-12T01:17:32.159 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range PASSED [ 65%] 2024-09-12T01:17:33.811 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range PASSED [ 65%] 2024-09-12T01:17:44.218 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names PASSED [ 66%] 2024-09-12T01:18:05.104 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload PASSED [ 66%] 2024-09-12T01:18:34.948 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned PASSED [ 66%] 2024-09-12T01:20:23.913 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part PASSED [ 66%] 2024-09-12T01:20:35.229 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes PASSED [ 66%] 2024-09-12T01:20:58.992 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes PASSED [ 66%] 2024-09-12T01:21:00.375 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small PASSED [ 66%] 2024-09-12T01:21:06.722 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents PASSED [ 67%] 2024-09-12T01:21:12.451 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object PASSED [ 67%] 2024-09-12T01:21:15.281 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload PASSED [ 67%] 2024-09-12T01:21:16.180 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found PASSED [ 67%] 2024-09-12T01:21:20.980 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload PASSED [ 67%] 2024-09-12T01:21:22.038 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner PASSED [ 67%] 2024-09-12T01:21:22.945 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part PASSED [ 67%] 2024-09-12T01:21:23.879 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag PASSED [ 67%] 2024-09-12T01:21:43.529 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part PASSED [ 68%] 2024-09-12T01:21:47.185 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_single_get_part PASSED [ 68%] 2024-09-12T01:21:48.137 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part PASSED [ 68%] 2024-09-12T01:21:49.007 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue PASSED [ 68%] 2024-09-12T01:21:49.972 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors PASSED [ 68%] 2024-09-12T01:21:56.885 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response PASSED [ 68%] 2024-09-12T01:22:00.881 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard PASSED [ 68%] 2024-09-12T01:22:04.811 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option PASSED [ 69%] 2024-09-12T01:22:05.815 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object PASSED [ 69%] 2024-09-12T01:22:06.801 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant PASSED [ 69%] 2024-09-12T01:22:07.799 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object PASSED [ 69%] 2024-09-12T01:22:08.775 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_with_acl PASSED [ 69%] 2024-09-12T01:22:09.756 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant PASSED [ 69%] 2024-09-12T01:22:10.770 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant_with_acl PASSED [ 69%] 2024-09-12T01:22:11.702 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging PASSED [ 69%] 2024-09-12T01:22:13.410 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb PASSED [ 70%] 2024-09-12T01:22:16.942 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb PASSED [ 70%] 2024-09-12T01:22:22.749 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb PASSED [ 70%] 2024-09-12T01:22:24.901 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb PASSED [ 70%] 2024-09-12T01:22:29.400 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb PASSED [ 70%] 2024-09-12T01:22:37.240 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb PASSED [ 70%] 2024-09-12T01:22:39.253 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb PASSED [ 70%] 2024-09-12T01:22:43.358 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb PASSED [ 71%] 2024-09-12T01:22:50.231 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb PASSED [ 71%] 2024-09-12T01:22:52.243 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb PASSED [ 71%] 2024-09-12T01:22:53.301 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write PASSED [ 71%] 2024-09-12T01:22:54.758 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last PASSED [ 71%] 2024-09-12T01:22:55.651 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code PASSED [ 71%] 2024-09-12T01:23:02.843 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code PASSED [ 71%] 2024-09-12T01:23:03.740 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code PASSED [ 71%] 2024-09-12T01:23:04.643 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code PASSED [ 72%] 2024-09-12T01:23:05.535 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range PASSED [ 72%] 2024-09-12T01:23:06.458 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object PASSED [ 72%] 2024-09-12T01:23:07.797 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend PASSED [ 72%] 2024-09-12T01:23:19.213 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove PASSED [ 72%] 2024-09-12T01:23:20.649 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head PASSED [ 72%] 2024-09-12T01:23:21.935 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal PASSED [ 72%] 2024-09-12T01:23:23.351 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite PASSED [ 73%] 2024-09-12T01:23:24.883 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended PASSED [ 73%] 2024-09-12T01:23:30.044 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions PASSED [ 73%] 2024-09-12T01:23:31.508 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspended_copy PASSED [ 73%] 2024-09-12T01:23:37.504 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all PASSED [ 73%] 2024-09-12T01:23:58.919 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names PASSED [ 73%] 2024-09-12T01:24:34.505 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart PASSED [ 73%] 2024-09-12T01:24:37.105 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker PASSED [ 73%] 2024-09-12T01:24:39.615 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version PASSED [ 74%] 2024-09-12T01:24:40.875 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete PASSED [ 74%] 2024-09-12T01:24:42.212 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker PASSED [ 74%] 2024-09-12T01:24:43.285 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create PASSED [ 74%] 2024-09-12T01:24:44.769 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl PASSED [ 74%] 2024-09-12T01:24:46.154 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified PASSED [ 74%] 2024-09-12T01:24:48.660 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove PASSED [ 74%] 2024-09-12T01:24:49.481 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set PASSED [ 75%] 2024-09-12T01:24:50.308 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get PASSED [ 75%] 2024-09-12T01:24:51.128 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id PASSED [ 75%] 2024-09-12T01:24:51.887 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long PASSED [ 75%] 2024-09-12T01:24:52.681 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id PASSED [ 75%] 2024-09-12T01:24:53.563 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status PASSED [ 75%] 2024-09-12T01:24:54.329 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date PASSED [ 75%] 2024-09-12T01:24:55.084 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date PASSED [ 76%] 2024-09-12T01:24:55.985 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent PASSED [ 76%] 2024-09-12T01:24:56.746 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker PASSED [ 76%] 2024-09-12T01:24:57.524 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter PASSED [ 76%] 2024-09-12T01:24:58.283 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter PASSED [ 76%] 2024-09-12T01:24:59.048 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart PASSED [ 76%] 2024-09-12T01:24:59.848 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date PASSED [ 76%] 2024-09-12T01:25:00.753 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b PASSED [ 76%] 2024-09-12T01:25:01.660 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb PASSED [ 77%] 2024-09-12T01:25:03.044 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB PASSED [ 77%] 2024-09-12T01:25:03.943 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b PASSED [ 77%] 2024-09-12T01:25:04.841 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head PASSED [ 77%] 2024-09-12T01:25:05.741 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present PASSED [ 77%] 2024-09-12T01:25:06.642 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key PASSED [ 77%] 2024-09-12T01:25:07.476 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 PASSED [ 77%] 2024-09-12T01:25:08.234 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 PASSED [ 78%] 2024-09-12T01:25:08.993 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key PASSED [ 78%] 2024-09-12T01:25:09.750 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c PASSED [ 78%] 2024-09-12T01:25:56.372 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload PASSED [ 78%] 2024-09-12T01:26:43.308 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload PASSED [ 78%] 2024-09-12T01:26:53.042 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download PASSED [ 78%] 2024-09-12T01:26:53.962 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request PASSED [ 78%] 2024-09-12T01:27:55.117 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_enforced_with_bucket_policy PASSED [ 78%] 2024-09-12T01:28:57.061 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_deny_algo_with_bucket_policy PASSED [ 79%] 2024-09-12T01:28:57.982 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head PASSED [ 79%] 2024-09-12T01:28:58.873 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present PASSED [ 79%] 2024-09-12T01:28:59.645 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key PASSED [ 79%] 2024-09-12T01:29:00.408 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared PASSED [ 79%] 2024-09-12T01:29:30.657 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload PASSED [ 79%] 2024-09-12T01:29:39.380 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 PASSED [ 79%] 2024-09-12T01:29:48.141 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 PASSED [ 80%] 2024-09-12T01:29:49.048 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request PASSED [ 80%] 2024-09-12T01:29:49.975 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b PASSED [ 80%] 2024-09-12T01:29:50.875 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb PASSED [ 80%] 2024-09-12T01:29:52.189 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB PASSED [ 80%] 2024-09-12T01:29:53.090 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b PASSED [ 80%] 2024-09-12T01:29:53.983 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare PASSED [ 80%] 2024-09-12T01:29:54.968 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy PASSED [ 80%] 2024-09-12T01:29:55.962 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy PASSED [ 81%] 2024-09-12T01:29:57.004 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl PASSED [ 81%] 2024-09-12T01:29:58.042 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl PASSED [ 81%] 2024-09-12T01:29:58.991 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_different_tenant PASSED [ 81%] 2024-09-12T01:29:59.914 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_tenanted_bucket PASSED [ 81%] 2024-09-12T01:30:01.366 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket PASSED [ 81%] 2024-09-12T01:30:02.817 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket PASSED [ 81%] 2024-09-12T01:30:05.687 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging PASSED [ 82%] 2024-09-12T01:30:07.926 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging PASSED [ 82%] 2024-09-12T01:30:10.239 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags PASSED [ 82%] 2024-09-12T01:30:12.609 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags PASSED [ 82%] 2024-09-12T01:30:14.879 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags PASSED [ 82%] 2024-09-12T01:30:17.161 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags PASSED [ 82%] 2024-09-12T01:30:19.514 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags PASSED [ 82%] 2024-09-12T01:30:21.956 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags PASSED [ 82%] 2024-09-12T01:30:24.323 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags PASSED [ 83%] 2024-09-12T01:30:25.264 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request PASSED [ 83%] 2024-09-12T01:30:26.177 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request PASSED [ 83%] 2024-09-12T01:30:27.135 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags PASSED [ 83%] 2024-09-12T01:30:29.493 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public PASSED [ 83%] 2024-09-12T01:30:32.374 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public PASSED [ 83%] 2024-09-12T01:30:34.839 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public PASSED [ 83%] 2024-09-12T01:30:36.614 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id PASSED [ 84%] 2024-09-12T01:30:56.849 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id PASSED [ 84%] 2024-09-12T01:30:58.136 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag PASSED [ 84%] 2024-09-12T01:30:59.465 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag PASSED [ 84%] 2024-09-12T01:31:00.764 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag PASSED [ 84%] 2024-09-12T01:31:02.431 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source PASSED [ 84%] 2024-09-12T01:31:03.854 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta PASSED [ 84%] 2024-09-12T01:31:04.847 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl PASSED [ 84%] 2024-09-12T01:31:06.250 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant PASSED [ 85%] 2024-09-12T01:31:07.027 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 PASSED [ 85%] 2024-09-12T01:31:07.787 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms PASSED [ 85%] 2024-09-12T01:31:08.543 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms PASSED [ 85%] 2024-09-12T01:31:09.345 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms PASSED [ 85%] 2024-09-12T01:31:10.255 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc PASSED [ 85%] 2024-09-12T01:31:11.095 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 PASSED [ 85%] 2024-09-12T01:31:12.435 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag PASSED [ 86%] 2024-09-12T01:31:13.221 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock PASSED [ 86%] 2024-09-12T01:31:13.945 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket PASSED [ 86%] 2024-09-12T01:31:14.679 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years PASSED [ 86%] 2024-09-12T01:31:15.403 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days PASSED [ 86%] 2024-09-12T01:31:16.139 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years PASSED [ 86%] 2024-09-12T01:31:16.973 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode PASSED [ 86%] 2024-09-12T01:31:17.700 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status PASSED [ 86%] 2024-09-12T01:31:18.433 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning PASSED [ 87%] 2024-09-12T01:31:19.182 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock PASSED [ 87%] 2024-09-12T01:31:19.910 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket PASSED [ 87%] 2024-09-12T01:31:20.830 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention PASSED [ 87%] 2024-09-12T01:31:21.669 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket PASSED [ 87%] 2024-09-12T01:31:22.581 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode PASSED [ 87%] 2024-09-12T01:31:23.456 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention PASSED [ 87%] 2024-09-12T01:31:24.292 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 PASSED [ 88%] 2024-09-12T01:31:25.152 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket PASSED [ 88%] 2024-09-12T01:31:26.153 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid PASSED [ 88%] 2024-09-12T01:31:27.069 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention PASSED [ 88%] 2024-09-12T01:31:27.986 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period PASSED [ 88%] 2024-09-12T01:31:28.856 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period PASSED [ 88%] 2024-09-12T01:31:29.764 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass PASSED [ 88%] 2024-09-12T01:31:30.636 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention PASSED [ 89%] 2024-09-12T01:31:31.662 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_retention PASSED [ 89%] 2024-09-12T01:31:32.667 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker PASSED [ 89%] 2024-09-12T01:31:33.657 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention PASSED [ 89%] 2024-09-12T01:31:34.498 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold PASSED [ 89%] 2024-09-12T01:31:35.326 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket PASSED [ 89%] 2024-09-12T01:31:36.202 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status PASSED [ 89%] 2024-09-12T01:31:37.183 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold PASSED [ 89%] 2024-09-12T01:31:38.006 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket PASSED [ 90%] 2024-09-12T01:31:38.923 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on PASSED [ 90%] 2024-09-12T01:31:39.965 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_legal_hold_on PASSED [ 90%] 2024-09-12T01:31:40.773 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off PASSED [ 90%] 2024-09-12T01:31:41.705 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata PASSED [ 90%] 2024-09-12T01:31:42.590 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj PASSED [ 90%] 2024-09-12T01:31:53.194 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass PASSED [ 90%] 2024-09-12T01:31:54.045 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass PASSED [ 91%] 2024-09-12T01:32:04.505 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance PASSED [ 91%] 2024-09-12T01:32:05.488 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good PASSED [ 91%] 2024-09-12T01:32:06.498 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed PASSED [ 91%] 2024-09-12T01:32:07.255 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status PASSED [ 91%] 2024-09-12T01:32:08.071 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T01:32:08.896 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T01:32:09.786 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T01:32:10.630 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status PASSED [ 92%] 2024-09-12T01:32:11.481 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_principal_bucket_policy_status PASSED [ 92%] 2024-09-12T01:32:12.243 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_allow_notprincipal PASSED [ 92%] 2024-09-12T01:32:13.067 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_get_undefined_public_block PASSED [ 92%] 2024-09-12T01:32:13.985 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_block_deny_bucket_policy PASSED [ 92%] 2024-09-12T01:32:14.800 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block PASSED [ 92%] 2024-09-12T01:32:15.782 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls PASSED [ 92%] 2024-09-12T01:32:16.711 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls PASSED [ 93%] 2024-09-12T01:32:17.577 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy PASSED [ 93%] 2024-09-12T01:32:18.374 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy_with_principal PASSED [ 93%] 2024-09-12T01:32:19.523 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls PASSED [ 93%] 2024-09-12T01:32:34.121 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy PASSED [ 93%] 2024-09-12T01:32:34.877 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms PASSED [ 93%] 2024-09-12T01:32:35.724 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms PASSED [ 93%] 2024-09-12T01:32:36.608 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms PASSED [ 93%] 2024-09-12T01:32:37.564 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request PASSED [ 94%] 2024-09-12T01:32:40.253 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent PASSED [ 94%] 2024-09-12T01:32:41.180 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_object_checksum_sha256 PASSED [ 94%] 2024-09-12T01:32:42.615 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_sha256 PASSED [ 94%] 2024-09-12T01:32:48.085 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_3parts PASSED [ 94%] 2024-09-12T01:32:50.023 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_checksum PASSED [ 94%] 2024-09-12T01:33:00.434 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause PASSED [ 94%] 2024-09-12T01:33:10.354 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection PASSED [ 95%] 2024-09-12T01:33:11.182 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation PASSED [ 95%] 2024-09-12T01:33:12.392 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation PASSED [ 95%] 2024-09-12T01:33:26.431 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max PASSED [ 95%] 2024-09-12T01:33:48.845 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions PASSED [ 95%] 2024-09-12T01:33:52.375 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max PASSED [ 95%] 2024-09-12T01:33:56.087 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions PASSED [ 95%] 2024-09-12T01:33:58.435 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions PASSED [ 95%] 2024-09-12T01:34:00.420 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions PASSED [ 96%] 2024-09-12T01:34:01.277 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions PASSED [ 96%] 2024-09-12T01:34:07.794 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions PASSED [ 96%] 2024-09-12T01:34:12.673 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions PASSED [ 96%] 2024-09-12T01:35:07.917 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions PASSED [ 96%] 2024-09-12T01:35:14.997 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions PASSED [ 96%] 2024-09-12T01:35:17.152 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions PASSED [ 96%] 2024-09-12T01:35:19.097 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3select.py::test_alias PASSED [ 97%] 2024-09-12T01:35:20.192 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce PASSED [ 97%] 2024-09-12T01:35:25.586 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime PASSED [ 97%] 2024-09-12T01:35:29.567 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime PASSED [ 97%] 2024-09-12T01:35:30.878 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser PASSED [ 97%] 2024-09-12T01:35:32.352 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition PASSED [ 97%] 2024-09-12T01:35:37.611 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition PASSED [ 97%] 2024-09-12T01:35:41.018 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions PASSED [ 97%] 2024-09-12T01:35:45.487 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions PASSED [ 98%] 2024-09-12T01:35:47.495 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions PASSED [ 98%] 2024-09-12T01:35:47.956 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3select.py::test_version PASSED [ 98%] 2024-09-12T01:35:51.884 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions PASSED [ 98%] 2024-09-12T01:35:55.929 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions PASSED [ 98%] 2024-09-12T01:35:58.460 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions PASSED [ 98%] 2024-09-12T01:36:02.206 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions PASSED [ 98%] 2024-09-12T01:36:03.835 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions PASSED [ 99%] 2024-09-12T01:36:38.319 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions PASSED [ 99%] 2024-09-12T01:36:38.781 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions PASSED [ 99%] 2024-09-12T01:36:40.030 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic PASSED [ 99%] 2024-09-12T01:36:41.008 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic PASSED [ 99%] 2024-09-12T01:36:41.866 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic_publish PASSED [ 99%] 2024-09-12T01:36:43.030 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic_publish PASSED [ 99%] 2024-09-12T01:36:43.052 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2024-09-12T01:36:43.052 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:36:43.053 INFO:teuthology.orchestra.run.smithi073.stdout:=============================== warnings summary =============================== 2024-09-12T01:36:43.053 INFO:teuthology.orchestra.run.smithi073.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-09-12T01:36:43.053 INFO:teuthology.orchestra.run.smithi073.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-09-12T01:36:43.053 INFO:teuthology.orchestra.run.smithi073.stdout: import imp 2024-09-12T01:36:43.053 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:36:43.053 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_headers.py:120 2024-09-12T01:36:43.053 INFO:teuthology.orchestra.run.smithi073.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:120: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T01:36:43.054 INFO:teuthology.orchestra.run.smithi073.stdout: if boto_type is 'S3Connection': 2024-09-12T01:36:43.054 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:36:43.054 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_headers.py:124 2024-09-12T01:36:43.054 INFO:teuthology.orchestra.run.smithi073.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T01:36:43.054 INFO:teuthology.orchestra.run.smithi073.stdout: elif boto_type is 'HTTPRequest': 2024-09-12T01:36:43.054 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:36:43.054 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_s3.py:359 2024-09-12T01:36:43.054 INFO:teuthology.orchestra.run.smithi073.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence \W 2024-09-12T01:36:43.055 INFO:teuthology.orchestra.run.smithi073.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2024-09-12T01:36:43.055 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:36:43.055 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_s3_website.py:176 2024-09-12T01:36:43.055 INFO:teuthology.orchestra.run.smithi073.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T01:36:43.055 INFO:teuthology.orchestra.run.smithi073.stdout: if k is 'BucketName': 2024-09-12T01:36:43.055 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:36:43.055 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_s3_website.py:253 2024-09-12T01:36:43.055 INFO:teuthology.orchestra.run.smithi073.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2024-09-12T01:36:43.055 INFO:teuthology.orchestra.run.smithi073.stdout: @pytest.mark.timeout(10) 2024-09-12T01:36:43.055 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:36:43.055 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests/functional/test_s3_website.py:1077 2024-09-12T01:36:43.055 INFO:teuthology.orchestra.run.smithi073.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2024-09-12T01:36:43.055 INFO:teuthology.orchestra.run.smithi073.stdout: @pytest.mark.s3website_routing_rules 2024-09-12T01:36:43.056 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:36:43.056 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py:2214 2024-09-12T01:36:43.056 INFO:teuthology.orchestra.run.smithi073.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2214: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:36:43.056 INFO:teuthology.orchestra.run.smithi073.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:36:43.056 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:36:43.056 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py:2229 2024-09-12T01:36:43.056 INFO:teuthology.orchestra.run.smithi073.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2229: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:36:43.056 INFO:teuthology.orchestra.run.smithi073.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T01:36:43.056 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:36:43.056 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py:2235 2024-09-12T01:36:43.056 INFO:teuthology.orchestra.run.smithi073.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2235: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:36:43.056 INFO:teuthology.orchestra.run.smithi073.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2024-09-12T01:36:43.057 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:36:43.057 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py:2292 2024-09-12T01:36:43.057 INFO:teuthology.orchestra.run.smithi073.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2292: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:36:43.057 INFO:teuthology.orchestra.run.smithi073.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:36:43.057 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:36:43.057 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py:2307 2024-09-12T01:36:43.057 INFO:teuthology.orchestra.run.smithi073.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2307: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:36:43.057 INFO:teuthology.orchestra.run.smithi073.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T01:36:43.057 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:36:43.058 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py:2325 2024-09-12T01:36:43.058 INFO:teuthology.orchestra.run.smithi073.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2325: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:36:43.058 INFO:teuthology.orchestra.run.smithi073.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:36:43.058 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:36:43.058 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py:2340 2024-09-12T01:36:43.058 INFO:teuthology.orchestra.run.smithi073.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2340: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:36:43.058 INFO:teuthology.orchestra.run.smithi073.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2024-09-12T01:36:43.058 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:36:43.059 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py:2358 2024-09-12T01:36:43.059 INFO:teuthology.orchestra.run.smithi073.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2358: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:36:43.059 INFO:teuthology.orchestra.run.smithi073.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:36:43.059 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:36:43.059 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py:2373 2024-09-12T01:36:43.059 INFO:teuthology.orchestra.run.smithi073.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2373: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:36:43.059 INFO:teuthology.orchestra.run.smithi073.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T01:36:43.059 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:36:43.059 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py:2423 2024-09-12T01:36:43.059 INFO:teuthology.orchestra.run.smithi073.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2423: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:36:43.059 INFO:teuthology.orchestra.run.smithi073.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:36:43.060 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:36:43.060 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py:2455 2024-09-12T01:36:43.060 INFO:teuthology.orchestra.run.smithi073.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2455: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:36:43.060 INFO:teuthology.orchestra.run.smithi073.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:36:43.060 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:36:43.060 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_headers.py: 29 warnings 2024-09-12T01:36:43.060 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_iam.py: 82 warnings 2024-09-12T01:36:43.060 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3.py: 497 warnings 2024-09-12T01:36:43.060 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_s3select.py: 33 warnings 2024-09-12T01:36:43.060 INFO:teuthology.orchestra.run.smithi073.stdout:s3tests_boto3/functional/test_sns.py: 3 warnings 2024-09-12T01:36:43.060 INFO:teuthology.orchestra.run.smithi073.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi073.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:36:43.060 INFO:teuthology.orchestra.run.smithi073.stdout: warnings.warn( 2024-09-12T01:36:43.060 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:36:43.061 INFO:teuthology.orchestra.run.smithi073.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-12T01:36:43.061 INFO:teuthology.orchestra.run.smithi073.stdout:= 680 passed, 65 skipped, 126 deselected, 1 xfailed, 662 warnings in 1833.47s (0:30:33) = 2024-09-12T01:36:43.180 INFO:teuthology.orchestra.run.smithi073.stdout:___________________________________ summary ____________________________________ 2024-09-12T01:36:43.180 INFO:teuthology.orchestra.run.smithi073.stdout: py: commands succeeded 2024-09-12T01:36:43.180 INFO:teuthology.orchestra.run.smithi073.stdout: congratulations :) 2024-09-12T01:36:43.197 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2024-09-12T01:36:43.198 DEBUG:teuthology.orchestra.run.smithi073:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T01:36:43.307 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:36:43.308 INFO:tasks.s3tests:Cleaning up boto... 2024-09-12T01:36:43.308 DEBUG:teuthology.orchestra.run.smithi073:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2024-09-12T01:36:43.337 INFO:tasks.s3tests:Removing s3-tests... 2024-09-12T01:36:43.337 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T01:36:43.529 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T01:36:43.540 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T01:36:43.540 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T01:36:43.540 DEBUG:teuthology.orchestra.run.smithi073:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T01:36:43.569 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:36:43.569 INFO:teuthology.orchestra.run.smithi073.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T01:36:43.570 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T01:36:43.639 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T01:36:43.639 DEBUG:teuthology.orchestra.run.smithi073:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T01:36:43.707 INFO:tasks.workunit:timeout=3h 2024-09-12T01:36:43.708 INFO:tasks.workunit:cleanup=True 2024-09-12T01:36:43.708 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T01:36:43.777 INFO:tasks.workunit.client.0.smithi073.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T01:37:28.894 INFO:tasks.workunit.client.0.smithi073.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T01:37:28.894 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T01:37:28.894 INFO:tasks.workunit.client.0.smithi073.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T01:37:28.894 INFO:tasks.workunit.client.0.smithi073.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T01:37:28.894 INFO:tasks.workunit.client.0.smithi073.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T01:37:28.894 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T01:37:28.894 INFO:tasks.workunit.client.0.smithi073.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T01:37:28.895 INFO:tasks.workunit.client.0.smithi073.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T01:37:28.895 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T01:37:28.895 INFO:tasks.workunit.client.0.smithi073.stderr: git switch -c 2024-09-12T01:37:28.895 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T01:37:28.895 INFO:tasks.workunit.client.0.smithi073.stderr:Or undo this operation with: 2024-09-12T01:37:28.895 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T01:37:28.895 INFO:tasks.workunit.client.0.smithi073.stderr: git switch - 2024-09-12T01:37:28.895 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T01:37:28.895 INFO:tasks.workunit.client.0.smithi073.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T01:37:28.895 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T01:37:28.895 INFO:tasks.workunit.client.0.smithi073.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T01:37:28.898 DEBUG:teuthology.orchestra.run.smithi073:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T01:37:28.967 INFO:tasks.workunit.client.0.smithi073.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T01:37:28.969 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T01:37:28.969 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T01:37:29.018 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T01:37:29.067 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T01:37:29.106 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T01:37:29.108 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T01:37:29.108 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T01:37:29.146 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T01:37:29.150 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T01:37:29.150 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T01:37:29.220 INFO:tasks.workunit:Running workunits matching rgw/run-versioning.sh on client.0... 2024-09-12T01:37:29.221 INFO:tasks.workunit:Running workunit rgw/run-versioning.sh... 2024-09-12T01:37:29.221 DEBUG:teuthology.orchestra.run.smithi073:workunit test rgw/run-versioning.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-12T01:37:29.294 INFO:tasks.workunit.client.0.smithi073.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-12T01:37:29.295 INFO:tasks.workunit.client.0.smithi073.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T01:37:29.295 INFO:tasks.workunit.client.0.smithi073.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T01:37:31.792 INFO:tasks.workunit.client.0.smithi073.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T01:37:31.792 INFO:tasks.workunit.client.0.smithi073.stderr:++ deactivate nondestructive 2024-09-12T01:37:31.792 INFO:tasks.workunit.client.0.smithi073.stderr:++ '[' -n '' ']' 2024-09-12T01:37:31.792 INFO:tasks.workunit.client.0.smithi073.stderr:++ '[' -n '' ']' 2024-09-12T01:37:31.793 INFO:tasks.workunit.client.0.smithi073.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T01:37:31.793 INFO:tasks.workunit.client.0.smithi073.stderr:++ hash -r 2024-09-12T01:37:31.793 INFO:tasks.workunit.client.0.smithi073.stderr:++ '[' -n '' ']' 2024-09-12T01:37:31.793 INFO:tasks.workunit.client.0.smithi073.stderr:++ unset VIRTUAL_ENV 2024-09-12T01:37:31.793 INFO:tasks.workunit.client.0.smithi073.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T01:37:31.793 INFO:tasks.workunit.client.0.smithi073.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T01:37:31.793 INFO:tasks.workunit.client.0.smithi073.stderr:++ export VIRTUAL_ENV 2024-09-12T01:37:31.794 INFO:tasks.workunit.client.0.smithi073.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T01:37:31.794 INFO:tasks.workunit.client.0.smithi073.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T01:37:31.794 INFO:tasks.workunit.client.0.smithi073.stderr:++ export PATH 2024-09-12T01:37:31.794 INFO:tasks.workunit.client.0.smithi073.stderr:++ '[' -n '' ']' 2024-09-12T01:37:31.794 INFO:tasks.workunit.client.0.smithi073.stderr:++ '[' -z '' ']' 2024-09-12T01:37:31.794 INFO:tasks.workunit.client.0.smithi073.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T01:37:31.795 INFO:tasks.workunit.client.0.smithi073.stderr:++ PS1='(rgw) ' 2024-09-12T01:37:31.795 INFO:tasks.workunit.client.0.smithi073.stderr:++ export PS1 2024-09-12T01:37:31.795 INFO:tasks.workunit.client.0.smithi073.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T01:37:31.795 INFO:tasks.workunit.client.0.smithi073.stderr:++ hash -r 2024-09-12T01:37:31.795 INFO:tasks.workunit.client.0.smithi073.stderr:+ pip install pip --upgrade 2024-09-12T01:37:32.021 INFO:tasks.workunit.client.0.smithi073.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T01:37:32.200 INFO:tasks.workunit.client.0.smithi073.stdout:Collecting pip 2024-09-12T01:37:32.205 INFO:tasks.workunit.client.0.smithi073.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T01:37:32.250 INFO:tasks.workunit.client.0.smithi073.stdout:Installing collected packages: pip 2024-09-12T01:37:32.250 INFO:tasks.workunit.client.0.smithi073.stdout: Attempting uninstall: pip 2024-09-12T01:37:32.250 INFO:tasks.workunit.client.0.smithi073.stdout: Found existing installation: pip 21.3.1 2024-09-12T01:37:32.399 INFO:tasks.workunit.client.0.smithi073.stdout: Uninstalling pip-21.3.1: 2024-09-12T01:37:32.404 INFO:tasks.workunit.client.0.smithi073.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T01:37:33.151 INFO:tasks.workunit.client.0.smithi073.stdout:Successfully installed pip-24.2 2024-09-12T01:37:33.202 INFO:tasks.workunit.client.0.smithi073.stderr:+ pip install boto3 2024-09-12T01:37:33.979 INFO:tasks.workunit.client.0.smithi073.stdout:Collecting boto3 2024-09-12T01:37:33.981 INFO:tasks.workunit.client.0.smithi073.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T01:37:34.542 INFO:tasks.workunit.client.0.smithi073.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T01:37:34.543 INFO:tasks.workunit.client.0.smithi073.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T01:37:34.644 INFO:tasks.workunit.client.0.smithi073.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T01:37:34.645 INFO:tasks.workunit.client.0.smithi073.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T01:37:34.703 INFO:tasks.workunit.client.0.smithi073.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T01:37:34.704 INFO:tasks.workunit.client.0.smithi073.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T01:37:34.762 INFO:tasks.workunit.client.0.smithi073.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T01:37:34.763 INFO:tasks.workunit.client.0.smithi073.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T01:37:34.840 INFO:tasks.workunit.client.0.smithi073.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T01:37:34.842 INFO:tasks.workunit.client.0.smithi073.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-12T01:37:34.977 INFO:tasks.workunit.client.0.smithi073.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T01:37:34.978 INFO:tasks.workunit.client.0.smithi073.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T01:37:34.984 INFO:tasks.workunit.client.0.smithi073.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T01:37:34.985 INFO:tasks.workunit.client.0.smithi073.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T01:37:34.994 INFO:tasks.workunit.client.0.smithi073.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T01:37:34.995 INFO:tasks.workunit.client.0.smithi073.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T01:37:34.996 INFO:tasks.workunit.client.0.smithi073.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T01:37:34.998 INFO:tasks.workunit.client.0.smithi073.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-12T01:37:34.999 INFO:tasks.workunit.client.0.smithi073.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T01:37:35.072 INFO:tasks.workunit.client.0.smithi073.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T01:37:36.109 INFO:tasks.workunit.client.0.smithi073.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-12T01:37:36.229 INFO:tasks.workunit.client.0.smithi073.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_versioning.py 2024-09-12T01:37:36.351 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin user create --uid versioning-tester --display-name "Versioning Testing" --access-key LTA662PVVDTDWX6M2AB0 --secret pvtchqajgzqx5581t6qbddbkj0bgf3a69qdkjcea 2024-09-12T01:37:36.385 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:37:36.385 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:37:36.423 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.423+0000 7f19ad413800 20 rados->read ofs=0 len=0 2024-09-12T01:37:36.425 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.424+0000 7f19ad413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:36.425 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.424+0000 7f19ad413800 20 realm 2024-09-12T01:37:36.425 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.424+0000 7f19ad413800 20 rados->read ofs=0 len=0 2024-09-12T01:37:36.425 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.424+0000 7f19ad413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:36.425 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.424+0000 7f19ad413800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:37:36.425 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.424+0000 7f19ad413800 20 rados->read ofs=0 len=0 2024-09-12T01:37:36.425 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.424+0000 7f19ad413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:36.425 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.424+0000 7f19ad413800 20 rados->read ofs=0 len=0 2024-09-12T01:37:36.426 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.426+0000 7f19ad413800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:37:36.426 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.426+0000 7f19ad413800 20 rados->read ofs=0 len=0 2024-09-12T01:37:36.427 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.426+0000 7f19ad413800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:37:36.427 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.426+0000 7f19ad413800 20 searching for the correct realm 2024-09-12T01:37:36.428 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.428+0000 7f19a8b92640 0 -- 172.21.15.73:0/1136068410 >> [v2:172.21.15.117:6816/1460498570,v1:172.21.15.117:6817/1460498570] conn(0x56291ca396a0 msgr2=0x7f19a4070960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:37:36.432 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.432+0000 7f19a8b92640 0 -- 172.21.15.73:0/1136068410 >> [v2:172.21.15.117:6816/1460498570,v1:172.21.15.117:6817/1460498570] conn(0x7f1874087070 msgr2=0x7f18740894a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:37:36.438 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.438+0000 7f19ad413800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T01:37:36.438 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.438+0000 7f19ad413800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:37:36.438 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.438+0000 7f19ad413800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T01:37:36.438 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.438+0000 7f19ad413800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:37:36.438 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.438+0000 7f19ad413800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:37:36.439 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.438+0000 7f19ad413800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:37:36.439 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.438+0000 7f19ad413800 20 rados->read ofs=0 len=0 2024-09-12T01:37:36.439 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.438+0000 7f19ad413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:36.439 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.438+0000 7f19ad413800 20 rados->read ofs=0 len=0 2024-09-12T01:37:36.440 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.438+0000 7f19ad413800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:37:36.440 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.438+0000 7f19ad413800 20 rados->read ofs=0 len=0 2024-09-12T01:37:36.440 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.439+0000 7f19ad413800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:37:36.440 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.439+0000 7f19ad413800 20 zone default found 2024-09-12T01:37:36.440 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.439+0000 7f19ad413800 4 Realm: () 2024-09-12T01:37:36.440 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.439+0000 7f19ad413800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T01:37:36.440 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.439+0000 7f19ad413800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T01:37:36.441 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.439+0000 7f19ad413800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:37:36.441 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.439+0000 7f19ad413800 20 zonegroup default 2024-09-12T01:37:36.441 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.439+0000 7f19ad413800 20 rados->read ofs=0 len=0 2024-09-12T01:37:36.441 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.439+0000 7f19ad413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:36.441 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.439+0000 7f19ad413800 20 rados->read ofs=0 len=0 2024-09-12T01:37:36.441 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.439+0000 7f19ad413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:36.441 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.439+0000 7f19ad413800 20 rados->read ofs=0 len=0 2024-09-12T01:37:36.441 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.439+0000 7f19ad413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:36.441 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.439+0000 7f19ad413800 20 started sync module instance, tier type = 2024-09-12T01:37:36.441 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.439+0000 7f19ad413800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T01:37:36.449 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.448+0000 7f19ad413800 20 add_watcher() i=0 2024-09-12T01:37:36.449 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.448+0000 7f19ad413800 20 add_watcher() i=1 2024-09-12T01:37:36.449 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.448+0000 7f19ad413800 20 add_watcher() i=2 2024-09-12T01:37:36.449 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.448+0000 7f19ad413800 20 add_watcher() i=3 2024-09-12T01:37:36.449 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.448+0000 7f19ad413800 20 add_watcher() i=4 2024-09-12T01:37:36.449 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.448+0000 7f19ad413800 20 add_watcher() i=5 2024-09-12T01:37:36.449 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.448+0000 7f19ad413800 20 add_watcher() i=6 2024-09-12T01:37:36.450 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.450+0000 7f19ad413800 20 add_watcher() i=7 2024-09-12T01:37:36.450 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.450+0000 7f19ad413800 2 all 8 watchers are set, enabling cache 2024-09-12T01:37:36.452 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.452+0000 7f185f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:37:36.453 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.452+0000 7f19ad413800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:37:36.453 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.452+0000 7f19ad413800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:37:36.453 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.452+0000 7f19ad413800 5 note: GC not initialized 2024-09-12T01:37:36.453 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.452+0000 7f185e7e4640 20 reqs_thread_entry: start 2024-09-12T01:37:36.453 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.452+0000 7f19ad413800 20 init_complete bucket index max shards: 1 2024-09-12T01:37:36.453 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.452+0000 7f19ad413800 20 Filter name: none 2024-09-12T01:37:36.453 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.452+0000 7f1857fff640 20 reqs_thread_entry: start 2024-09-12T01:37:36.453 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.453+0000 7f19ad413800 10 cache get: name=default.rgw.meta+users.uid+versioning-tester : miss 2024-09-12T01:37:36.453 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.453+0000 7f19ad413800 20 rados->read ofs=0 len=0 2024-09-12T01:37:36.454 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.453+0000 7f19ad413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:36.454 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.453+0000 7f19ad413800 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x0 2024-09-12T01:37:36.454 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.453+0000 7f19ad413800 10 adding default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T01:37:36.454 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.453+0000 7f19ad413800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : miss 2024-09-12T01:37:36.455 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.453+0000 7f19ad413800 20 rados->read ofs=0 len=0 2024-09-12T01:37:36.455 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.453+0000 7f19ad413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:36.455 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.453+0000 7f19ad413800 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x0 2024-09-12T01:37:36.455 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.453+0000 7f19ad413800 10 adding default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T01:37:36.455 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.453+0000 7f19ad413800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-12T01:37:36.455 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.453+0000 7f19ad413800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-12T01:37:36.455 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.455+0000 7f19ad413800 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-12T01:37:36.456 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.455+0000 7f19ad413800 10 moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T01:37:36.456 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.455+0000 7f19ad413800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:versioning-tester, ofs0, ns] 2024-09-12T01:37:36.456 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.455+0000 7f187ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399080 cookie 94734576570464 notifier 8711 bl.length()=613 2024-09-12T01:37:36.456 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.455+0000 7f187ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-12T01:37:36.456 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.455+0000 7f187ffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T01:37:36.459 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.458+0000 7f19ad413800 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-12T01:37:36.459 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.458+0000 7f19ad413800 10 moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T01:37:36.459 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.458+0000 7f19ad413800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:LTA662PVVDTDWX6M2AB0, ofs0, ns] 2024-09-12T01:37:36.459 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.458+0000 7f187ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399380 cookie 94734576567776 notifier 8711 bl.length()=191 2024-09-12T01:37:36.459 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.458+0000 7f187ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-12T01:37:36.459 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.458+0000 7f187ffff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T01:37:36.460 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.460+0000 7f185f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:37:36.463 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.463+0000 7f19ad413800 20 remove_watcher() i=0 2024-09-12T01:37:36.463 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.463+0000 7f19ad413800 2 removed watcher, disabling cache 2024-09-12T01:37:36.464 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.464+0000 7f19ad413800 20 remove_watcher() i=1 2024-09-12T01:37:36.465 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.465+0000 7f19ad413800 20 remove_watcher() i=2 2024-09-12T01:37:36.466 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.466+0000 7f19ad413800 20 remove_watcher() i=3 2024-09-12T01:37:36.467 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.467+0000 7f19ad413800 20 remove_watcher() i=4 2024-09-12T01:37:36.468 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.468+0000 7f19ad413800 20 remove_watcher() i=5 2024-09-12T01:37:36.469 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.469+0000 7f19ad413800 20 remove_watcher() i=6 2024-09-12T01:37:36.470 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:36.470+0000 7f19ad413800 20 remove_watcher() i=7 2024-09-12T01:37:36.646 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:37:36.646 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T01:37:36.694 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:37:36.694 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T01:37:36.753 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:37:36.753 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T01:37:36.793 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:37:36.793 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T01:37:36.820 INFO:tasks.workunit.client.0.smithi073.stderr:TEST: verify that index entries and OLH objects are cleaned up after redundant deletes 2024-09-12T01:37:36.820 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T01:37:36.822 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:37:36.823 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T01:37:36.859 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:37:36.859 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T01:37:36.893 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:37:36.894 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T01:37:36.935 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-12T01:37:36.963 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:37:36.963 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:37:37.001 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.001+0000 7fade6898800 20 rados->read ofs=0 len=0 2024-09-12T01:37:37.003 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.002+0000 7fade6898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:37.003 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.002+0000 7fade6898800 20 realm 2024-09-12T01:37:37.003 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.002+0000 7fade6898800 20 rados->read ofs=0 len=0 2024-09-12T01:37:37.003 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.003+0000 7fade6898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:37.003 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.003+0000 7fade6898800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:37:37.003 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.003+0000 7fade6898800 20 rados->read ofs=0 len=0 2024-09-12T01:37:37.004 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.003+0000 7fade6898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:37.004 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.003+0000 7fade6898800 20 rados->read ofs=0 len=0 2024-09-12T01:37:37.004 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.004+0000 7fade6898800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:37:37.004 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.004+0000 7fade6898800 20 rados->read ofs=0 len=0 2024-09-12T01:37:37.005 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.005+0000 7fade6898800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:37:37.005 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.005+0000 7fade6898800 20 searching for the correct realm 2024-09-12T01:37:37.006 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.006+0000 7fade4382640 0 -- 172.21.15.73:0/542123468 >> [v2:172.21.15.117:6816/1460498570,v1:172.21.15.117:6817/1460498570] conn(0x7faddc025040 msgr2=0x7faddc024920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:37:37.211 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.210+0000 7fade3b81640 0 -- 172.21.15.73:0/542123468 >> [v2:172.21.15.117:6800/110688882,v1:172.21.15.117:6801/110688882] conn(0x563cbe7b93a0 msgr2=0x563cbe7bb790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:37:37.218 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.217+0000 7fade6898800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T01:37:37.218 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.217+0000 7fade6898800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:37:37.218 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.217+0000 7fade6898800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T01:37:37.218 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.217+0000 7fade6898800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:37:37.218 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.217+0000 7fade6898800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:37:37.219 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.217+0000 7fade6898800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:37:37.219 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.217+0000 7fade6898800 20 rados->read ofs=0 len=0 2024-09-12T01:37:37.219 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.218+0000 7fade6898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:37.219 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.218+0000 7fade6898800 20 rados->read ofs=0 len=0 2024-09-12T01:37:37.219 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.218+0000 7fade6898800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:37:37.219 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.218+0000 7fade6898800 20 rados->read ofs=0 len=0 2024-09-12T01:37:37.220 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.218+0000 7fade6898800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:37:37.220 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.218+0000 7fade6898800 20 zone default found 2024-09-12T01:37:37.220 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.218+0000 7fade6898800 4 Realm: () 2024-09-12T01:37:37.221 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.218+0000 7fade6898800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T01:37:37.221 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.218+0000 7fade6898800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T01:37:37.221 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.218+0000 7fade6898800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:37:37.221 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.218+0000 7fade6898800 20 zonegroup default 2024-09-12T01:37:37.221 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.218+0000 7fade6898800 20 rados->read ofs=0 len=0 2024-09-12T01:37:37.221 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.218+0000 7fade6898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:37.221 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.218+0000 7fade6898800 20 rados->read ofs=0 len=0 2024-09-12T01:37:37.221 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.219+0000 7fade6898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:37.221 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.219+0000 7fade6898800 20 rados->read ofs=0 len=0 2024-09-12T01:37:37.221 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.219+0000 7fade6898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:37.221 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.219+0000 7fade6898800 20 started sync module instance, tier type = 2024-09-12T01:37:37.221 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.219+0000 7fade6898800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T01:37:37.229 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.229+0000 7fade6898800 20 add_watcher() i=0 2024-09-12T01:37:37.229 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.229+0000 7fade6898800 20 add_watcher() i=1 2024-09-12T01:37:37.229 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.229+0000 7fade6898800 20 add_watcher() i=2 2024-09-12T01:37:37.229 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.229+0000 7fade6898800 20 add_watcher() i=3 2024-09-12T01:37:37.229 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.229+0000 7fade6898800 20 add_watcher() i=4 2024-09-12T01:37:37.229 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.229+0000 7fade6898800 20 add_watcher() i=5 2024-09-12T01:37:37.230 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.229+0000 7fade6898800 20 add_watcher() i=6 2024-09-12T01:37:37.231 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.230+0000 7fade6898800 20 add_watcher() i=7 2024-09-12T01:37:37.231 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.230+0000 7fade6898800 2 all 8 watchers are set, enabling cache 2024-09-12T01:37:37.232 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.232+0000 7fac9afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:37:37.233 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.233+0000 7fade6898800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:37:37.234 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.233+0000 7fade6898800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:37:37.234 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.233+0000 7fade6898800 5 note: GC not initialized 2024-09-12T01:37:37.234 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.233+0000 7fac99fdb640 20 reqs_thread_entry: start 2024-09-12T01:37:37.234 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.233+0000 7fade6898800 20 init_complete bucket index max shards: 1 2024-09-12T01:37:37.234 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.233+0000 7fade6898800 20 Filter name: none 2024-09-12T01:37:37.234 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.233+0000 7fac0b7fe640 20 reqs_thread_entry: start 2024-09-12T01:37:37.234 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.233+0000 7fade6898800 20 rados->read ofs=0 len=0 2024-09-12T01:37:37.235 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.234+0000 7fade6898800 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T01:37:37.235 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.234+0000 7fade6898800 20 rados->read ofs=0 len=0 2024-09-12T01:37:37.235 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.234+0000 7fade6898800 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T01:37:37.235 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.234+0000 7fade6898800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T01:37:37.235 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.234+0000 7fade6898800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T01:37:37.235 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.234+0000 7fade6898800 20 INFO: main: starting shard=0 2024-09-12T01:37:37.235 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.234+0000 7fade6898800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.782.0 2024-09-12T01:37:37.236 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.235+0000 7fade6898800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:37:37.236 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.235+0000 7fade6898800 20 INFO: main: done 2024-09-12T01:37:37.236 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.236+0000 7fac9afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:37:37.238 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.238+0000 7fade6898800 20 remove_watcher() i=0 2024-09-12T01:37:37.238 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.238+0000 7fade6898800 2 removed watcher, disabling cache 2024-09-12T01:37:37.240 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.239+0000 7fade6898800 20 remove_watcher() i=1 2024-09-12T01:37:37.240 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.240+0000 7fade6898800 20 remove_watcher() i=2 2024-09-12T01:37:37.241 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.241+0000 7fade6898800 20 remove_watcher() i=3 2024-09-12T01:37:37.242 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.242+0000 7fade6898800 20 remove_watcher() i=4 2024-09-12T01:37:37.243 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.243+0000 7fade6898800 20 remove_watcher() i=5 2024-09-12T01:37:37.244 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.244+0000 7fade6898800 20 remove_watcher() i=6 2024-09-12T01:37:37.245 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.245+0000 7fade6898800 20 remove_watcher() i=7 2024-09-12T01:37:37.257 INFO:tasks.workunit.client.0.smithi073.stderr:rados -p default.rgw.buckets.data ls | grep dbc10f32-be45-4d3b-836f-11e139a65355 2024-09-12T01:37:37.280 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:37:37.281 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:37:37.357 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:37.357+0000 7f8bc5272640 0 -- 172.21.15.73:0/1385290115 >> [v2:172.21.15.73:6810/1807760270,v1:172.21.15.73:6811/1807760270] conn(0x7f8bac006840 msgr2=0x7f8bac035160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:37:37.366 INFO:tasks.workunit.client.0.smithi073.stderr:TEST: verify that index entries and OLH objects are cleaned up after index linking error 2024-09-12T01:37:37.366 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T01:37:37.367 INFO:tasks.workunit.client.0.smithi073.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T01:37:38.762 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:37:38.762 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T01:37:38.797 INFO:tasks.workunit.client.0.smithi073.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T01:37:39.194 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-12T01:37:39.223 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:37:39.223 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:37:39.261 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.260+0000 7f4454240800 20 rados->read ofs=0 len=0 2024-09-12T01:37:39.263 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.263+0000 7f4454240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:39.263 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.263+0000 7f4454240800 20 realm 2024-09-12T01:37:39.263 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.263+0000 7f4454240800 20 rados->read ofs=0 len=0 2024-09-12T01:37:39.264 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.263+0000 7f4454240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:39.264 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.263+0000 7f4454240800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:37:39.264 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.263+0000 7f4454240800 20 rados->read ofs=0 len=0 2024-09-12T01:37:39.264 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.263+0000 7f4454240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:39.264 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.263+0000 7f4454240800 20 rados->read ofs=0 len=0 2024-09-12T01:37:39.264 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.264+0000 7f4454240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:37:39.264 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.264+0000 7f4454240800 20 rados->read ofs=0 len=0 2024-09-12T01:37:39.265 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.265+0000 7f4454240800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:37:39.265 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.265+0000 7f4454240800 20 searching for the correct realm 2024-09-12T01:37:39.268 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.268+0000 7f4451d2a640 0 -- 172.21.15.73:0/224870057 >> [v2:172.21.15.117:6816/1460498570,v1:172.21.15.117:6817/1460498570] conn(0x7f444c025040 msgr2=0x7f444c026430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:37:39.272 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.272+0000 7f4451d2a640 0 -- 172.21.15.73:0/224870057 >> [v2:172.21.15.117:6816/1460498570,v1:172.21.15.117:6817/1460498570] conn(0x7f431c087070 msgr2=0x7f431c0894a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:37:39.276 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.275+0000 7f4454240800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T01:37:39.276 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.275+0000 7f4454240800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:37:39.276 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.275+0000 7f4454240800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T01:37:39.276 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.275+0000 7f4454240800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:37:39.276 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.275+0000 7f4454240800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:37:39.276 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.275+0000 7f4454240800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:37:39.276 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.275+0000 7f4454240800 20 rados->read ofs=0 len=0 2024-09-12T01:37:39.276 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.276+0000 7f4454240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:39.276 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.276+0000 7f4454240800 20 rados->read ofs=0 len=0 2024-09-12T01:37:39.278 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.276+0000 7f4454240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:37:39.278 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.276+0000 7f4454240800 20 rados->read ofs=0 len=0 2024-09-12T01:37:39.278 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.276+0000 7f4454240800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:37:39.278 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.276+0000 7f4454240800 20 zone default found 2024-09-12T01:37:39.278 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.276+0000 7f4454240800 4 Realm: () 2024-09-12T01:37:39.278 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.276+0000 7f4454240800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T01:37:39.278 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.276+0000 7f4454240800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T01:37:39.278 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.276+0000 7f4454240800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:37:39.278 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.276+0000 7f4454240800 20 zonegroup default 2024-09-12T01:37:39.278 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.276+0000 7f4454240800 20 rados->read ofs=0 len=0 2024-09-12T01:37:39.278 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.276+0000 7f4454240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:39.278 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.277+0000 7f4454240800 20 rados->read ofs=0 len=0 2024-09-12T01:37:39.278 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.277+0000 7f4454240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:39.279 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.277+0000 7f4454240800 20 rados->read ofs=0 len=0 2024-09-12T01:37:39.279 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.277+0000 7f4454240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:39.279 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.277+0000 7f4454240800 20 started sync module instance, tier type = 2024-09-12T01:37:39.279 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.277+0000 7f4454240800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T01:37:39.287 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.286+0000 7f4454240800 20 add_watcher() i=0 2024-09-12T01:37:39.287 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.286+0000 7f4454240800 20 add_watcher() i=1 2024-09-12T01:37:39.287 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.286+0000 7f4454240800 20 add_watcher() i=2 2024-09-12T01:37:39.287 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.286+0000 7f4454240800 20 add_watcher() i=3 2024-09-12T01:37:39.287 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.286+0000 7f4454240800 20 add_watcher() i=4 2024-09-12T01:37:39.287 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.286+0000 7f4454240800 20 add_watcher() i=5 2024-09-12T01:37:39.287 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.287+0000 7f4454240800 20 add_watcher() i=6 2024-09-12T01:37:39.288 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.287+0000 7f4454240800 20 add_watcher() i=7 2024-09-12T01:37:39.288 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.287+0000 7f4454240800 2 all 8 watchers are set, enabling cache 2024-09-12T01:37:39.289 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.289+0000 7f43037fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:37:39.290 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.289+0000 7f4454240800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:37:39.290 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.289+0000 7f4454240800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:37:39.291 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.290+0000 7f4454240800 5 note: GC not initialized 2024-09-12T01:37:39.291 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.290+0000 7f43027fc640 20 reqs_thread_entry: start 2024-09-12T01:37:39.291 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.290+0000 7f4454240800 20 init_complete bucket index max shards: 1 2024-09-12T01:37:39.291 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.290+0000 7f4454240800 20 Filter name: none 2024-09-12T01:37:39.291 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.290+0000 7f4273fff640 20 reqs_thread_entry: start 2024-09-12T01:37:39.291 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.290+0000 7f4454240800 20 rados->read ofs=0 len=0 2024-09-12T01:37:39.291 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.290+0000 7f4454240800 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T01:37:39.291 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.290+0000 7f4454240800 20 rados->read ofs=0 len=0 2024-09-12T01:37:39.292 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.291+0000 7f4454240800 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T01:37:39.292 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.291+0000 7f4454240800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T01:37:39.292 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.291+0000 7f4454240800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T01:37:39.292 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.291+0000 7f4454240800 20 INFO: main: starting shard=0 2024-09-12T01:37:39.292 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.291+0000 7f4454240800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.782.0 2024-09-12T01:37:39.292 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.291+0000 7f4454240800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:37:39.292 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.291+0000 7f4454240800 20 INFO: main: done 2024-09-12T01:37:39.293 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.292+0000 7f43037fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:37:39.295 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.294+0000 7f4454240800 20 remove_watcher() i=0 2024-09-12T01:37:39.295 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.294+0000 7f4454240800 2 removed watcher, disabling cache 2024-09-12T01:37:39.296 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.296+0000 7f4454240800 20 remove_watcher() i=1 2024-09-12T01:37:39.297 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.297+0000 7f4454240800 20 remove_watcher() i=2 2024-09-12T01:37:39.299 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.298+0000 7f4454240800 20 remove_watcher() i=3 2024-09-12T01:37:39.299 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.299+0000 7f4454240800 20 remove_watcher() i=4 2024-09-12T01:37:39.300 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.300+0000 7f4454240800 20 remove_watcher() i=5 2024-09-12T01:37:39.301 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.301+0000 7f4454240800 20 remove_watcher() i=6 2024-09-12T01:37:39.302 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.302+0000 7f4454240800 20 remove_watcher() i=7 2024-09-12T01:37:39.313 INFO:tasks.workunit.client.0.smithi073.stderr:rados -p default.rgw.buckets.data ls | grep 6d37c116-4a95-4a35-9488-bcf416c03f8e 2024-09-12T01:37:39.336 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:37:39.336 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:37:39.413 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:39.412+0000 7f5f67811640 0 -- 172.21.15.73:0/1892433832 >> [v2:172.21.15.73:6800/2864081714,v1:172.21.15.73:6801/2864081714] conn(0x7f5f5c019840 msgr2=0x7f5f5c0082d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:37:39.424 INFO:tasks.workunit.client.0.smithi073.stderr:TEST: verify that original null object version is intact after failed olh upgrade 2024-09-12T01:37:39.424 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T01:37:39.426 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:37:39.426 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T01:37:39.455 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:37:39.455 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T01:37:39.492 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:37:39.492 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T01:37:39.520 INFO:tasks.workunit.client.0.smithi073.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T01:37:40.916 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:37:40.916 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T01:37:41.009 INFO:tasks.workunit.client.0.smithi073.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T01:37:41.011 INFO:tasks.workunit.client.0.smithi073.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T01:37:41.419 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:37:41.420 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T01:37:41.487 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:37:41.487 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T01:37:41.532 INFO:tasks.workunit.client.0.smithi073.stderr:TEST: verify that concurrent delete requests do not leave behind olh entries 2024-09-12T01:37:41.532 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-12T01:37:41.534 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:37:41.534 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T01:37:41.598 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:37:41.599 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T01:37:41.658 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:37:41.658 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T01:37:41.693 INFO:tasks.workunit.client.0.smithi073.stderr:ceph config set client rgw_debug_inject_latency_bi_unlink 2 2024-09-12T01:37:43.091 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:37:43.091 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T01:37:43.156 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:37:43.156 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T01:37:45.222 INFO:tasks.workunit.client.0.smithi073.stderr:ceph config rm client rgw_debug_inject_latency_bi_unlink 2024-09-12T01:37:45.632 INFO:tasks.workunit.client.0.smithi073.stderr:radosgw-admin bucket check olh --bucket versioning-bucket --dump-keys 2024-09-12T01:37:45.662 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:37:45.662 INFO:tasks.workunit.client.0.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:37:45.700 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.701+0000 7f026553d800 20 rados->read ofs=0 len=0 2024-09-12T01:37:45.702 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.702+0000 7f026553d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:45.702 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.702+0000 7f026553d800 20 realm 2024-09-12T01:37:45.702 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.702+0000 7f026553d800 20 rados->read ofs=0 len=0 2024-09-12T01:37:45.702 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.703+0000 7f026553d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:45.702 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.703+0000 7f026553d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:37:45.702 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.703+0000 7f026553d800 20 rados->read ofs=0 len=0 2024-09-12T01:37:45.703 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.703+0000 7f026553d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:45.703 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.703+0000 7f026553d800 20 rados->read ofs=0 len=0 2024-09-12T01:37:45.703 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.704+0000 7f026553d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:37:45.703 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.704+0000 7f026553d800 20 rados->read ofs=0 len=0 2024-09-12T01:37:45.704 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.705+0000 7f026553d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:37:45.704 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.705+0000 7f026553d800 20 searching for the correct realm 2024-09-12T01:37:45.705 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.706+0000 7f026122a640 0 -- 172.21.15.73:0/1440254069 >> [v2:172.21.15.117:6816/1460498570,v1:172.21.15.117:6817/1460498570] conn(0x7f025c064040 msgr2=0x7f025c067450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:37:45.911 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.912+0000 7f0260a29640 0 -- 172.21.15.73:0/1440254069 >> [v2:172.21.15.73:6826/269690776,v1:172.21.15.73:6827/269690776] conn(0x7f0254055020 msgr2=0x7f025407b3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:37:45.918 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.919+0000 7f026553d800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T01:37:45.918 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.919+0000 7f026553d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:37:45.918 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.919+0000 7f026553d800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T01:37:45.918 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.919+0000 7f026553d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:37:45.918 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.919+0000 7f026553d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:37:45.918 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.919+0000 7f026553d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:37:45.918 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.919+0000 7f026553d800 20 rados->read ofs=0 len=0 2024-09-12T01:37:45.919 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.919+0000 7f026553d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:45.919 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.919+0000 7f026553d800 20 rados->read ofs=0 len=0 2024-09-12T01:37:45.920 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.919+0000 7f026553d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:37:45.920 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.919+0000 7f026553d800 20 rados->read ofs=0 len=0 2024-09-12T01:37:45.920 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.919+0000 7f026553d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:37:45.920 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.919+0000 7f026553d800 20 zone default found 2024-09-12T01:37:45.920 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.919+0000 7f026553d800 4 Realm: () 2024-09-12T01:37:45.920 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.919+0000 7f026553d800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T01:37:45.921 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.919+0000 7f026553d800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T01:37:45.921 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.919+0000 7f026553d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:37:45.921 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.919+0000 7f026553d800 20 zonegroup default 2024-09-12T01:37:45.921 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.919+0000 7f026553d800 20 rados->read ofs=0 len=0 2024-09-12T01:37:45.921 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.920+0000 7f026553d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:45.921 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.920+0000 7f026553d800 20 rados->read ofs=0 len=0 2024-09-12T01:37:45.921 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.920+0000 7f026553d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:45.921 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.920+0000 7f026553d800 20 rados->read ofs=0 len=0 2024-09-12T01:37:45.921 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.920+0000 7f026553d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:45.921 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.920+0000 7f026553d800 20 started sync module instance, tier type = 2024-09-12T01:37:45.921 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.920+0000 7f026553d800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T01:37:45.929 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.930+0000 7f026553d800 20 add_watcher() i=0 2024-09-12T01:37:45.929 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.930+0000 7f026553d800 20 add_watcher() i=1 2024-09-12T01:37:45.929 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.930+0000 7f026553d800 20 add_watcher() i=2 2024-09-12T01:37:45.929 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.930+0000 7f026553d800 20 add_watcher() i=3 2024-09-12T01:37:45.930 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.930+0000 7f026553d800 20 add_watcher() i=4 2024-09-12T01:37:45.930 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.930+0000 7f026553d800 20 add_watcher() i=5 2024-09-12T01:37:45.930 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.930+0000 7f026553d800 20 add_watcher() i=6 2024-09-12T01:37:45.930 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.931+0000 7f026553d800 20 add_watcher() i=7 2024-09-12T01:37:45.930 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.931+0000 7f026553d800 2 all 8 watchers are set, enabling cache 2024-09-12T01:37:45.934 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.934+0000 7f0117fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:37:45.934 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.934+0000 7f026553d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:37:45.934 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.934+0000 7f026553d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:37:45.934 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.934+0000 7f026553d800 5 note: GC not initialized 2024-09-12T01:37:45.934 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.934+0000 7f0116fe5640 20 reqs_thread_entry: start 2024-09-12T01:37:45.934 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.934+0000 7f026553d800 20 init_complete bucket index max shards: 1 2024-09-12T01:37:45.934 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.934+0000 7f026553d800 20 Filter name: none 2024-09-12T01:37:45.934 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.934+0000 7f0114fe1640 20 reqs_thread_entry: start 2024-09-12T01:37:45.934 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.934+0000 7f026553d800 10 cache get: name=default.rgw.meta+root+versioning-bucket : miss 2024-09-12T01:37:45.934 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.934+0000 7f026553d800 20 rados->read ofs=0 len=0 2024-09-12T01:37:45.936 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.935+0000 7f026553d800 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T01:37:45.936 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.935+0000 7f026553d800 10 cache put: name=default.rgw.meta+root+versioning-bucket info.flags=0x11 2024-09-12T01:37:45.936 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.935+0000 7f026553d800 10 adding default.rgw.meta+root+versioning-bucket to cache LRU end 2024-09-12T01:37:45.936 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.935+0000 7f026553d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.782 : miss 2024-09-12T01:37:45.936 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.935+0000 7f026553d800 20 rados->read ofs=0 len=0 2024-09-12T01:37:45.936 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.935+0000 7f026553d800 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T01:37:45.936 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.935+0000 7f026553d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.782 info.flags=0x17 2024-09-12T01:37:45.936 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.935+0000 7f026553d800 10 adding default.rgw.meta+root+.bucket.meta.versioning-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.782 to cache LRU end 2024-09-12T01:37:45.936 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.935+0000 7f026553d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:37:45.936 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.935+0000 7f026553d800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T01:37:45.936 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.935+0000 7f026553d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.versioning-bucket:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.782 2024-09-12T01:37:45.937 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.935+0000 7f026553d800 20 bucket index object: :.dir.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.782.0 2024-09-12T01:37:45.937 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.936+0000 7f026553d800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T01:37:45.937 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.936+0000 7f026553d800 1 NOTICE: finished all shards (0 entries found) 2024-09-12T01:37:45.937 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.937+0000 7f0117fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:37:45.939 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.939+0000 7f026553d800 20 remove_watcher() i=0 2024-09-12T01:37:45.939 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.939+0000 7f026553d800 2 removed watcher, disabling cache 2024-09-12T01:37:45.940 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.941+0000 7f026553d800 20 remove_watcher() i=1 2024-09-12T01:37:45.941 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.942+0000 7f026553d800 20 remove_watcher() i=2 2024-09-12T01:37:45.942 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.943+0000 7f026553d800 20 remove_watcher() i=3 2024-09-12T01:37:45.943 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.944+0000 7f026553d800 20 remove_watcher() i=4 2024-09-12T01:37:45.944 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.945+0000 7f026553d800 20 remove_watcher() i=5 2024-09-12T01:37:45.945 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.946+0000 7f026553d800 20 remove_watcher() i=6 2024-09-12T01:37:45.946 INFO:tasks.workunit.client.0.smithi073.stderr:2024-09-12T01:37:45.947+0000 7f026553d800 20 remove_watcher() i=7 2024-09-12T01:37:45.956 INFO:tasks.workunit.client.0.smithi073.stderr:Deleting bucket versioning-bucket 2024-09-12T01:37:45.958 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:37:45.958 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T01:37:45.984 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:37:45.984 INFO:tasks.workunit.client.0.smithi073.stderr: warnings.warn( 2024-09-12T01:37:46.041 INFO:tasks.workunit.client.0.smithi073.stderr:Completed bucket versioning tests 2024-09-12T01:37:46.041 INFO:tasks.workunit.client.0.smithi073.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-12T01:37:46.041 INFO:tasks.workunit.client.0.smithi073.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-12T01:37:46.041 INFO:tasks.workunit.client.0.smithi073.stdout:connected to https://localhost:443 2024-09-12T01:37:46.103 INFO:tasks.workunit.client.0.smithi073.stderr:+ deactivate 2024-09-12T01:37:46.103 INFO:tasks.workunit.client.0.smithi073.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-12T01:37:46.103 INFO:tasks.workunit.client.0.smithi073.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T01:37:46.103 INFO:tasks.workunit.client.0.smithi073.stderr:+ export PATH 2024-09-12T01:37:46.103 INFO:tasks.workunit.client.0.smithi073.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T01:37:46.103 INFO:tasks.workunit.client.0.smithi073.stderr:+ '[' -n '' ']' 2024-09-12T01:37:46.103 INFO:tasks.workunit.client.0.smithi073.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T01:37:46.103 INFO:tasks.workunit.client.0.smithi073.stderr:+ hash -r 2024-09-12T01:37:46.103 INFO:tasks.workunit.client.0.smithi073.stderr:+ '[' -n '' ']' 2024-09-12T01:37:46.103 INFO:tasks.workunit.client.0.smithi073.stderr:+ unset VIRTUAL_ENV 2024-09-12T01:37:46.104 INFO:tasks.workunit.client.0.smithi073.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T01:37:46.104 INFO:tasks.workunit.client.0.smithi073.stderr:+ unset -f deactivate 2024-09-12T01:37:46.104 INFO:tasks.workunit.client.0.smithi073.stderr:+ echo OK. 2024-09-12T01:37:46.105 INFO:tasks.workunit.client.0.smithi073.stdout:OK. 2024-09-12T01:37:46.105 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T01:37:46.105 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T01:37:46.186 INFO:tasks.workunit:Stopping ['rgw/run-versioning.sh'] on client.0... 2024-09-12T01:37:46.186 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T01:37:46.558 DEBUG:teuthology.parallel:result is None 2024-09-12T01:37:46.558 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T01:37:46.597 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T01:37:46.597 DEBUG:teuthology.orchestra.run.smithi073:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T01:37:46.665 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T01:37:46.666 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2024-09-12T01:37:46.675 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2024-09-12T01:37:46.718 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2024-09-12T01:37:46.718 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2024-09-12T01:37:46.718 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2024-09-12T01:37:46.781 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2024-09-12T01:37:46.781 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2024-09-12T01:37:46.838 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:37:46.838 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:37:46.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:46.873+0000 7f6bca739800 20 rados->read ofs=0 len=0 2024-09-12T01:37:46.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:46.874+0000 7f6bca739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:46.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:46.874+0000 7f6bca739800 20 realm 2024-09-12T01:37:46.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:46.874+0000 7f6bca739800 20 rados->read ofs=0 len=0 2024-09-12T01:37:46.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:46.874+0000 7f6bca739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:46.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:46.874+0000 7f6bca739800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:37:46.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:46.874+0000 7f6bca739800 20 rados->read ofs=0 len=0 2024-09-12T01:37:46.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:46.875+0000 7f6bca739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:46.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:46.875+0000 7f6bca739800 20 rados->read ofs=0 len=0 2024-09-12T01:37:46.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:46.875+0000 7f6bca739800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:37:46.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:46.875+0000 7f6bca739800 20 rados->read ofs=0 len=0 2024-09-12T01:37:46.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:46.876+0000 7f6bca739800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:37:46.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:46.876+0000 7f6bca739800 20 searching for the correct realm 2024-09-12T01:37:46.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:46.877+0000 7f6bc63ce640 0 -- 172.21.15.73:0/3017136307 >> [v2:172.21.15.117:6816/1460498570,v1:172.21.15.117:6817/1460498570] conn(0x7f6bc0015030 msgr2=0x7f6bc0035440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:37:47.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.083+0000 7f6bbffff640 0 -- 172.21.15.73:0/3017136307 >> [v2:172.21.15.73:6826/269690776,v1:172.21.15.73:6827/269690776] conn(0x7f6bb80a5980 msgr2=0x7f6bb80c4ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:37:47.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.089+0000 7f6bca739800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T01:37:47.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.089+0000 7f6bca739800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:37:47.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.089+0000 7f6bca739800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T01:37:47.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.089+0000 7f6bca739800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:37:47.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.089+0000 7f6bca739800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:37:47.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.089+0000 7f6bca739800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:37:47.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.089+0000 7f6bca739800 20 rados->read ofs=0 len=0 2024-09-12T01:37:47.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.090+0000 7f6bca739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:47.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.090+0000 7f6bca739800 20 rados->read ofs=0 len=0 2024-09-12T01:37:47.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.090+0000 7f6bca739800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:37:47.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.090+0000 7f6bca739800 20 rados->read ofs=0 len=0 2024-09-12T01:37:47.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.090+0000 7f6bca739800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:37:47.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.090+0000 7f6bca739800 20 zone default found 2024-09-12T01:37:47.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.090+0000 7f6bca739800 4 Realm: () 2024-09-12T01:37:47.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.090+0000 7f6bca739800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T01:37:47.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.090+0000 7f6bca739800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T01:37:47.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.090+0000 7f6bca739800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:37:47.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.090+0000 7f6bca739800 20 zonegroup default 2024-09-12T01:37:47.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.090+0000 7f6bca739800 20 rados->read ofs=0 len=0 2024-09-12T01:37:47.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.090+0000 7f6bca739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:47.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.090+0000 7f6bca739800 20 rados->read ofs=0 len=0 2024-09-12T01:37:47.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.091+0000 7f6bca739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:47.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.091+0000 7f6bca739800 20 rados->read ofs=0 len=0 2024-09-12T01:37:47.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.091+0000 7f6bca739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:47.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.091+0000 7f6bca739800 20 started sync module instance, tier type = 2024-09-12T01:37:47.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.091+0000 7f6bca739800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T01:37:47.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.100+0000 7f6bca739800 20 add_watcher() i=0 2024-09-12T01:37:47.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.100+0000 7f6bca739800 20 add_watcher() i=1 2024-09-12T01:37:47.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.100+0000 7f6bca739800 20 add_watcher() i=2 2024-09-12T01:37:47.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.100+0000 7f6bca739800 20 add_watcher() i=3 2024-09-12T01:37:47.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.100+0000 7f6bca739800 20 add_watcher() i=4 2024-09-12T01:37:47.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.100+0000 7f6bca739800 20 add_watcher() i=5 2024-09-12T01:37:47.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.100+0000 7f6bca739800 20 add_watcher() i=6 2024-09-12T01:37:47.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.101+0000 7f6bca739800 20 add_watcher() i=7 2024-09-12T01:37:47.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.101+0000 7f6bca739800 2 all 8 watchers are set, enabling cache 2024-09-12T01:37:47.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.103+0000 7f6a7d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:37:47.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.103+0000 7f6bca739800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:37:47.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.103+0000 7f6bca739800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:37:47.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.139+0000 7f6a777fe640 20 reqs_thread_entry: start 2024-09-12T01:37:47.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.139+0000 7f6bca739800 20 init_complete bucket index max shards: 1 2024-09-12T01:37:47.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.139+0000 7f6bca739800 20 Filter name: none 2024-09-12T01:37:47.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.140+0000 7f6a757fa640 20 reqs_thread_entry: start 2024-09-12T01:37:47.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.140+0000 7f6bca739800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-12T01:37:47.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.140+0000 7f6bca739800 20 rados->read ofs=0 len=0 2024-09-12T01:37:47.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.140+0000 7f6bca739800 20 rados_obj.operate() r=0 bl.length=482 2024-09-12T01:37:47.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.140+0000 7f6bca739800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x13 2024-09-12T01:37:47.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.140+0000 7f6bca739800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T01:37:47.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.140+0000 7f6bca739800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:37:47.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.141+0000 7f6bca739800 10 removing key index: HJXABPZFKLHBDOCZIJOJ 2024-09-12T01:37:47.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.142+0000 7f6bca739800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:HJXABPZFKLHBDOCZIJOJ, ofs0, ns] 2024-09-12T01:37:47.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.142+0000 7f6aa9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399388 cookie 94721769904752 notifier 9450 bl.length()=170 2024-09-12T01:37:47.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.144+0000 7f6bca739800 10 removing email index: tester.client.0_test@test.test 2024-09-12T01:37:47.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.144+0000 7f6bca739800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-12T01:37:47.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.145+0000 7f6aa9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576400088 cookie 94721769887984 notifier 9450 bl.length()=181 2024-09-12T01:37:47.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.146+0000 7f6bca739800 10 removing user buckets index 2024-09-12T01:37:47.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.147+0000 7f6bca739800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0.buckets, ofs0, ns] 2024-09-12T01:37:47.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.147+0000 7f6aa97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399081 cookie 94721769908832 notifier 9450 bl.length()=172 2024-09-12T01:37:47.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.148+0000 7f6bca739800 10 removing user index: tester.client.0 2024-09-12T01:37:47.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.149+0000 7f6bca739800 10 removing default.rgw.meta+users.uid+tester.client.0 from cache 2024-09-12T01:37:47.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.149+0000 7f6bca739800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-12T01:37:47.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.150+0000 7f6aa9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399389 cookie 94721769907088 notifier 9450 bl.length()=164 2024-09-12T01:37:47.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.152+0000 7f6a7d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:37:47.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.154+0000 7f6bca739800 20 remove_watcher() i=0 2024-09-12T01:37:47.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.154+0000 7f6bca739800 2 removed watcher, disabling cache 2024-09-12T01:37:47.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.156+0000 7f6bca739800 20 remove_watcher() i=1 2024-09-12T01:37:47.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.157+0000 7f6bca739800 20 remove_watcher() i=2 2024-09-12T01:37:47.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.158+0000 7f6bca739800 20 remove_watcher() i=3 2024-09-12T01:37:47.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.159+0000 7f6bca739800 20 remove_watcher() i=4 2024-09-12T01:37:47.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.159+0000 7f6bca739800 20 remove_watcher() i=5 2024-09-12T01:37:47.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.160+0000 7f6bca739800 20 remove_watcher() i=6 2024-09-12T01:37:47.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:47.161+0000 7f6bca739800 20 remove_watcher() i=7 2024-09-12T01:37:47.171 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2024-09-12T01:37:47.181 DEBUG:teuthology.run_tasks:Unwinding manager tox 2024-09-12T01:37:47.224 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf /home/ubuntu/cephtest/tox-venv 2024-09-12T01:37:47.279 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-12T01:37:47.291 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-12T01:37:47.291 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:37:47.299 INFO:tasks.rgw.client.0.smithi073.stdout:2024-09-12T01:37:47.296+0000 f874640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 46130) UID: 0 2024-09-12T01:37:47.300 INFO:tasks.rgw.client.0.smithi073.stdout:2024-09-12T01:37:47.299+0000 a1be240 -1 shutting down 2024-09-12T01:37:58.039 INFO:tasks.rgw.client.0.smithi073.stderr:==00:01:09:12.738 46133== could not unlink /tmp/vgdb-pipe-from-vgdb-to-46133-by-root-on-??? 2024-09-12T01:37:58.040 INFO:tasks.rgw.client.0.smithi073.stderr:==00:01:09:12.738 46133== could not unlink /tmp/vgdb-pipe-to-vgdb-from-46133-by-root-on-??? 2024-09-12T01:37:58.040 INFO:tasks.rgw.client.0.smithi073.stderr:==00:01:09:12.738 46133== could not unlink /tmp/vgdb-pipe-shared-mem-vgdb-46133-by-root-on-??? 2024-09-12T01:37:59.495 INFO:tasks.rgw.client.0:Stopped 2024-09-12T01:37:59.495 DEBUG:teuthology.orchestra.run.smithi073:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-12T01:37:59.530 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f /etc/ceph/vault-root-token 2024-09-12T01:37:59.614 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-12T01:37:59.696 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-12T01:37:59.697 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-12T01:37:59.697 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-12T01:37:59.795 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:37:59.795 INFO:teuthology.orchestra.run.smithi073.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:37:59.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:59.829+0000 7f8786c98800 20 rados->read ofs=0 len=0 2024-09-12T01:37:59.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:59.830+0000 7f8786c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:59.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:59.830+0000 7f8786c98800 20 realm 2024-09-12T01:37:59.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:59.830+0000 7f8786c98800 20 rados->read ofs=0 len=0 2024-09-12T01:37:59.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:59.830+0000 7f8786c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:59.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:59.830+0000 7f8786c98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:37:59.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:59.830+0000 7f8786c98800 20 rados->read ofs=0 len=0 2024-09-12T01:37:59.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:59.831+0000 7f8786c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:59.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:59.831+0000 7f8786c98800 20 rados->read ofs=0 len=0 2024-09-12T01:37:59.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:59.832+0000 7f8786c98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:37:59.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:59.832+0000 7f8786c98800 20 rados->read ofs=0 len=0 2024-09-12T01:37:59.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:59.833+0000 7f8786c98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:37:59.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:59.833+0000 7f8786c98800 20 searching for the correct realm 2024-09-12T01:37:59.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:37:59.835+0000 7f8784f8a640 0 -- 172.21.15.73:0/3328777400 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f876c02d070 msgr2=0x7f876c067300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:38:00.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.042+0000 7f8784f8a640 0 -- 172.21.15.73:0/3328777400 >> [v2:172.21.15.117:6808/87909260,v1:172.21.15.117:6809/87909260] conn(0x7f876c02d070 msgr2=0x7f876c067300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:38:00.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.046+0000 7f8786c98800 20 RGWRados::pool_iterate: got zone_info.f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d 2024-09-12T01:38:00.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.046+0000 7f8786c98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:38:00.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.046+0000 7f8786c98800 20 RGWRados::pool_iterate: got zonegroup_info.c9f76197-40a0-4367-a07e-facc016b2039 2024-09-12T01:38:00.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.046+0000 7f8786c98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:38:00.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.046+0000 7f8786c98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:38:00.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.046+0000 7f8786c98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:38:00.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.046+0000 7f8786c98800 20 rados->read ofs=0 len=0 2024-09-12T01:38:00.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.046+0000 7f8786c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:38:00.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.046+0000 7f8786c98800 20 rados->read ofs=0 len=0 2024-09-12T01:38:00.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.047+0000 7f8786c98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:38:00.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.047+0000 7f8786c98800 20 rados->read ofs=0 len=0 2024-09-12T01:38:00.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.047+0000 7f8786c98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:38:00.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.047+0000 7f8786c98800 20 zone default found 2024-09-12T01:38:00.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.047+0000 7f8786c98800 4 Realm: () 2024-09-12T01:38:00.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.047+0000 7f8786c98800 4 ZoneGroup: default (c9f76197-40a0-4367-a07e-facc016b2039) 2024-09-12T01:38:00.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.047+0000 7f8786c98800 4 Zone: default (f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d) 2024-09-12T01:38:00.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.047+0000 7f8786c98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:38:00.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.047+0000 7f8786c98800 20 zonegroup default 2024-09-12T01:38:00.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.047+0000 7f8786c98800 20 rados->read ofs=0 len=0 2024-09-12T01:38:00.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.047+0000 7f8786c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:38:00.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.047+0000 7f8786c98800 20 rados->read ofs=0 len=0 2024-09-12T01:38:00.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.048+0000 7f8786c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:38:00.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.048+0000 7f8786c98800 20 rados->read ofs=0 len=0 2024-09-12T01:38:00.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.048+0000 7f8786c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:38:00.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.048+0000 7f8786c98800 20 started sync module instance, tier type = 2024-09-12T01:38:00.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.048+0000 7f8786c98800 20 started zone id=f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d (name=default) with tier type = 2024-09-12T01:38:00.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.057+0000 7f8786c98800 20 add_watcher() i=0 2024-09-12T01:38:00.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.057+0000 7f8786c98800 20 add_watcher() i=1 2024-09-12T01:38:00.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.057+0000 7f8786c98800 20 add_watcher() i=2 2024-09-12T01:38:00.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.057+0000 7f8786c98800 20 add_watcher() i=3 2024-09-12T01:38:00.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.057+0000 7f8786c98800 20 add_watcher() i=4 2024-09-12T01:38:00.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.057+0000 7f8786c98800 20 add_watcher() i=5 2024-09-12T01:38:00.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.057+0000 7f8786c98800 20 add_watcher() i=6 2024-09-12T01:38:00.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.058+0000 7f8786c98800 20 add_watcher() i=7 2024-09-12T01:38:00.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.058+0000 7f8786c98800 2 all 8 watchers are set, enabling cache 2024-09-12T01:38:00.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.059+0000 7f863afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:38:00.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.059+0000 7f8786c98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:38:00.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.059+0000 7f8786c98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:38:00.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.096+0000 7f8639fdb640 20 reqs_thread_entry: start 2024-09-12T01:38:00.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.096+0000 7f8786c98800 20 init_complete bucket index max shards: 1 2024-09-12T01:38:00.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.096+0000 7f8786c98800 20 Filter name: none 2024-09-12T01:38:00.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.096+0000 7f85ab7fe640 20 reqs_thread_entry: start 2024-09-12T01:38:00.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.096+0000 7f8786c98800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T01:38:00.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.098+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:38:00.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.098+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:38:00.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.099+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/42905' 2024-09-12T01:38:00.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.099+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17123846438810402044', time=2024-09-12T03:10:10.655568+0000, chain.objs.size()=1 2024-09-12T01:38:00.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.099+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.235__shadow_.DHPDsu6QgXLTa825EH_sRO09LpZl-Ww_0 2024-09-12T01:38:00.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.099+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2459216575667438913', time=2024-09-12T03:10:29.784013+0000, chain.objs.size()=1 2024-09-12T01:38:00.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.099+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.252__shadow_.Y9p722g0DIIkkqEQsdL6HOsVdLQdq7O_0 2024-09-12T01:38:00.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.099+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5697538503124358853', time=2024-09-12T03:11:14.440717+0000, chain.objs.size()=1 2024-09-12T01:38:00.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.099+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.-N4toqyBlKERBau9Yqk3_Vj9oH0eELZ_0 2024-09-12T01:38:00.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.099+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8586697500823922637', time=2024-09-12T03:11:14.561588+0000, chain.objs.size()=1 2024-09-12T01:38:00.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.099+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.VNkeyzMmAxxtjk9OR8xxr2E4Mz9MXRT_0 2024-09-12T01:38:00.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.099+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7964543828129415746', time=2024-09-12T03:11:14.972175+0000, chain.objs.size()=1 2024-09-12T01:38:00.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.099+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.7cM9pSpeG0F4f-P35VP5iwO8SjjV0IQ_0 2024-09-12T01:38:00.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.099+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12996568685217616495', time=2024-09-12T03:11:15.026229+0000, chain.objs.size()=1 2024-09-12T01:38:00.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.099+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.IdChlGvw4tcEMhy_8xMPkua7e9x9cIj_0 2024-09-12T01:38:00.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.100+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8741388628599398239', time=2024-09-12T03:11:15.277667+0000, chain.objs.size()=1 2024-09-12T01:38:00.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.100+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.rWJTCHfmA8iQVRuLHa2Bf4KzRZhVyRk_0 2024-09-12T01:38:00.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.100+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17994932595845712025', time=2024-09-12T03:11:15.342931+0000, chain.objs.size()=1 2024-09-12T01:38:00.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.100+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.ammer0xfaWymSCsRVmevHsTMUIoAcEh_0 2024-09-12T01:38:00.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.100+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8544488748787697429', time=2024-09-12T03:11:15.405179+0000, chain.objs.size()=1 2024-09-12T01:38:00.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.100+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.cxpuy8rnMXw0JAzvTgyaGoMag0qpmhw_0 2024-09-12T01:38:00.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.100+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8144502497776446372', time=2024-09-12T03:11:16.232703+0000, chain.objs.size()=1 2024-09-12T01:38:00.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.100+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.9KnUaet5FE04US5spxA_a8Y0Wj8PEKq_0 2024-09-12T01:38:00.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.100+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6515605646394923293', time=2024-09-12T03:11:16.515920+0000, chain.objs.size()=1 2024-09-12T01:38:00.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.100+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.iLovtaVWFyuKcK2QMLl7Kcla0kY_wRj_0 2024-09-12T01:38:00.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.100+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14833121700715457757', time=2024-09-12T03:11:16.942595+0000, chain.objs.size()=1 2024-09-12T01:38:00.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.100+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.8i8NoKylluYQob15VEX9oVxAf_zsXJp_0 2024-09-12T01:38:00.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.101+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5999642177406991164', time=2024-09-12T03:11:17.914583+0000, chain.objs.size()=1 2024-09-12T01:38:00.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.101+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.kWh6SyrEOUSZ2IIYz4138iSIAZH00Zz_0 2024-09-12T01:38:00.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.102+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17145787195387493617', time=2024-09-12T03:11:18.843080+0000, chain.objs.size()=1 2024-09-12T01:38:00.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.102+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.YzUAP93uWAVgZZX_uSoYg2cvvawJQx-_0 2024-09-12T01:38:00.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.102+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15982762821607021172', time=2024-09-12T03:11:19.019634+0000, chain.objs.size()=1 2024-09-12T01:38:00.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.102+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.6RhJOFV08IFtKO9fr99bAMCOgB1x_3A_0 2024-09-12T01:38:00.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.102+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2925687497219743863', time=2024-09-12T03:11:19.814689+0000, chain.objs.size()=1 2024-09-12T01:38:00.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.102+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.msalUTLxDqBXHPJZk0v0DlAZPlo4rOE_0 2024-09-12T01:38:00.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.102+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.377542736660589489', time=2024-09-12T03:11:20.283346+0000, chain.objs.size()=1 2024-09-12T01:38:00.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.102+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.OVFTIXcolCxPnjUwQUh8T32OhyzxAgv_0 2024-09-12T01:38:00.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.102+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7224961802682020351', time=2024-09-12T03:11:21.543505+0000, chain.objs.size()=1 2024-09-12T01:38:00.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.102+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.3bYQCjE4VB86vey4vMhAAAHjiCIzhxo_0 2024-09-12T01:38:00.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.102+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7069243731599867919', time=2024-09-12T03:11:21.664929+0000, chain.objs.size()=1 2024-09-12T01:38:00.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.102+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.7v0yo2SEz2yBqMH-74E5ae1Zb6InnQT_0 2024-09-12T01:38:00.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.102+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2299231904372508510', time=2024-09-12T03:11:22.279662+0000, chain.objs.size()=1 2024-09-12T01:38:00.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.102+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.XE3VXvE8LDw93mEDh-xsMJX06vVSJ_m_0 2024-09-12T01:38:00.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.102+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3038347112613898512', time=2024-09-12T03:11:23.090320+0000, chain.objs.size()=1 2024-09-12T01:38:00.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.102+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.8EkV4S2oRACUNkIOQTxprleVX9KGGNR_0 2024-09-12T01:38:00.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.103+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15500646455155962567', time=2024-09-12T03:11:23.657664+0000, chain.objs.size()=1 2024-09-12T01:38:00.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.103+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.F8Ph0-7OcP6CeWy3O1K4ZnFDTSxicBu_0 2024-09-12T01:38:00.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.103+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16654443032374342132', time=2024-09-12T03:11:24.122967+0000, chain.objs.size()=1 2024-09-12T01:38:00.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.103+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.PlCPf1C-7zTjzaQG6oYGF2AfLc2SLmB_0 2024-09-12T01:38:00.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.103+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12409596988456632434', time=2024-09-12T03:11:24.250273+0000, chain.objs.size()=1 2024-09-12T01:38:00.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.103+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.IYqqsKLEFYbS6Xgit6AY_C-nK6hQD9L_0 2024-09-12T01:38:00.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.103+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17042867774458568972', time=2024-09-12T03:11:24.640159+0000, chain.objs.size()=1 2024-09-12T01:38:00.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.103+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.-6dnaQng0FXyQi3nGEXXfnBo7ZNCRyh_0 2024-09-12T01:38:00.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.103+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.526313858526928877', time=2024-09-12T03:11:24.691079+0000, chain.objs.size()=1 2024-09-12T01:38:00.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.103+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.5Y_LYs9OQShE94Mx3Ts8pGaHIp7lNEq_0 2024-09-12T01:38:00.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.103+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12128828926598407214', time=2024-09-12T03:11:25.839983+0000, chain.objs.size()=1 2024-09-12T01:38:00.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.103+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.263__shadow_.cjm2_DYVgE4lPC01ErmkzDK6oP8-8Ms_0 2024-09-12T01:38:00.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.104+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8450848619334244957', time=2024-09-12T03:11:34.301352+0000, chain.objs.size()=1 2024-09-12T01:38:00.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.104+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.272__shadow_.9qkp3S4mvdrlv-pv409O_gqbR1Aspk6_0 2024-09-12T01:38:00.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.104+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6119763343255560759', time=2024-09-12T03:11:41.000967+0000, chain.objs.size()=1 2024-09-12T01:38:00.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.104+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.279__shadow_.fI418mj-n2aeZKrRQwhjLw7NcJQKPF0_0 2024-09-12T01:38:00.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.105+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11004285591962590079', time=2024-09-12T03:11:43.921020+0000, chain.objs.size()=1 2024-09-12T01:38:00.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.105+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.282__shadow_.7Dz0G69ZL8uufrSO-fypPUZjQNT_R5q_0 2024-09-12T01:38:00.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.105+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14144277371383928860', time=2024-09-12T03:11:43.921796+0000, chain.objs.size()=1 2024-09-12T01:38:00.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.105+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.282__shadow_.w716qN0i7e5SCRUZLzTzSflrTaGGyrP_0 2024-09-12T01:38:00.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.105+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8714441258185894454', time=2024-09-12T03:13:06.982253+0000, chain.objs.size()=1 2024-09-12T01:38:00.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.105+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.AQOiXEJGISjEfpC2SIITn-_NHCPHDoY_0 2024-09-12T01:38:00.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.105+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13213624508209797500', time=2024-09-12T03:13:07.224481+0000, chain.objs.size()=1 2024-09-12T01:38:00.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.105+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.B6lhzlKcSmYkKbbyFzTptP6XHPgAmBg_0 2024-09-12T01:38:00.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.105+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15489505145495093213', time=2024-09-12T03:13:08.674116+0000, chain.objs.size()=1 2024-09-12T01:38:00.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.105+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.C2jDrVL7RAgF75-qUjsk55SmDC6tfgZ_0 2024-09-12T01:38:00.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.105+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8711292275191437138', time=2024-09-12T03:13:08.699230+0000, chain.objs.size()=1 2024-09-12T01:38:00.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.105+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.NVy3kDvx_C0g3svzKZFqAMfqleSfRMJ_0 2024-09-12T01:38:00.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.105+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12784774575493175925', time=2024-09-12T03:13:09.056047+0000, chain.objs.size()=1 2024-09-12T01:38:00.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.105+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.VEvi1beLTTcCgcaQp8w4yCvMPz5QiZB_0 2024-09-12T01:38:00.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.105+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11860173413693477811', time=2024-09-12T03:13:09.118323+0000, chain.objs.size()=1 2024-09-12T01:38:00.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.105+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.AnvCcIuboPXC2z-OQLN1_Td_rjwg8nJ_0 2024-09-12T01:38:00.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.105+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8560081255652784181', time=2024-09-12T03:13:09.228681+0000, chain.objs.size()=1 2024-09-12T01:38:00.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.105+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.JW33zMujmPSPNW3zXCBADGxQHBh81tE_0 2024-09-12T01:38:00.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.105+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8190172915315587055', time=2024-09-12T03:13:09.721682+0000, chain.objs.size()=1 2024-09-12T01:38:00.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.105+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.boSYrb5nBRCdt19Qwuk4AMUYQAiHufO_0 2024-09-12T01:38:00.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.106+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10398266137417456902', time=2024-09-12T03:13:09.845800+0000, chain.objs.size()=1 2024-09-12T01:38:00.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.107+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.TBDTAyEmhfxhKpuF-JRjOGRIO5NdtuL_0 2024-09-12T01:38:00.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.107+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12193170187674689624', time=2024-09-12T03:13:10.446970+0000, chain.objs.size()=1 2024-09-12T01:38:00.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.107+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.tV4aWjdiYvKw6QjE9N2DdqjWT83y2OS_0 2024-09-12T01:38:00.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.107+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12836899629916779855', time=2024-09-12T03:13:10.447595+0000, chain.objs.size()=1 2024-09-12T01:38:00.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.107+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.usUeZ3DLTZXeXUFUiQOajG32rhpKoW3_0 2024-09-12T01:38:00.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.107+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4996138872523621870', time=2024-09-12T03:13:10.558061+0000, chain.objs.size()=1 2024-09-12T01:38:00.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.107+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.naBwhC3DK33Cbws9OTLn452s3USU5nD_0 2024-09-12T01:38:00.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.107+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8216063610278625419', time=2024-09-12T03:13:11.593929+0000, chain.objs.size()=1 2024-09-12T01:38:00.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.107+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.z8qZEQx4tO4IyAPgmvJ8Hltj9awvG49_0 2024-09-12T01:38:00.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.107+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17312949936339523895', time=2024-09-12T03:13:11.669648+0000, chain.objs.size()=1 2024-09-12T01:38:00.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.107+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.6_MSc71IcSQmuZYWj7UkRmdDHqV17pk_0 2024-09-12T01:38:00.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.107+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2199980562395057600', time=2024-09-12T03:13:11.976750+0000, chain.objs.size()=1 2024-09-12T01:38:00.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.107+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.OGOwDblu-KCj3TJSeVE896V-NbjKrAC_0 2024-09-12T01:38:00.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.107+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4290740600374130896', time=2024-09-12T03:13:13.054263+0000, chain.objs.size()=1 2024-09-12T01:38:00.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.107+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.EiudQAriGpu358FyD1HJhKMj1NSFh5z_0 2024-09-12T01:38:00.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.107+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13385283178800481166', time=2024-09-12T03:13:13.849464+0000, chain.objs.size()=1 2024-09-12T01:38:00.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.107+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.jJd-vLwkAuajbNRbpAxmSrNtAweYE_w_0 2024-09-12T01:38:00.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.108+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13399205458598144520', time=2024-09-12T03:13:13.929376+0000, chain.objs.size()=1 2024-09-12T01:38:00.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.108+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.BY3PlNLYxw8rhiujmKZzgqykyDoet2c_0 2024-09-12T01:38:00.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.108+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15977172285217384218', time=2024-09-12T03:13:14.065592+0000, chain.objs.size()=1 2024-09-12T01:38:00.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.108+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.kuyBaiGV-fE_TDA-4_l3Pd_CZoUIYyT_0 2024-09-12T01:38:00.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.109+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16264666876844943368', time=2024-09-12T03:13:14.280138+0000, chain.objs.size()=1 2024-09-12T01:38:00.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.109+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.AsMtUbcuQF_9cCyP5Z5Kiv9z69e1h4-_0 2024-09-12T01:38:00.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.109+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15532726976575087489', time=2024-09-12T03:13:14.403676+0000, chain.objs.size()=1 2024-09-12T01:38:00.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.109+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.ua5bwndNsKu9aGIFgzmCHRdKsQ-9khj_0 2024-09-12T01:38:00.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.109+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10002766386370370110', time=2024-09-12T03:13:14.490056+0000, chain.objs.size()=1 2024-09-12T01:38:00.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.109+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.VK9qkZ_EuFUJVJdf1irxp2JTH71TdZo_0 2024-09-12T01:38:00.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.109+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9423961803485201822', time=2024-09-12T03:13:14.641498+0000, chain.objs.size()=1 2024-09-12T01:38:00.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.109+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.q4JHQqSJNEdaO07w17KOKcJQC7sgwpl_0 2024-09-12T01:38:00.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.109+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13801172338539829660', time=2024-09-12T03:13:15.148415+0000, chain.objs.size()=1 2024-09-12T01:38:00.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.109+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.eXJctkEhmGSSGeaIwUF_g3QKeRQSVoU_0 2024-09-12T01:38:00.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.109+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4821594386528994226', time=2024-09-12T03:13:15.148979+0000, chain.objs.size()=1 2024-09-12T01:38:00.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.109+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.C7bGuFsePAzbnZGvZTm0jxYhONZ-npl_0 2024-09-12T01:38:00.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.109+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7492342909360555569', time=2024-09-12T03:13:15.213334+0000, chain.objs.size()=1 2024-09-12T01:38:00.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.109+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.zSJ0cm7VwOEJ1MvWaEQ2TR4eq0zW3mh_0 2024-09-12T01:38:00.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.109+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15147413127269749492', time=2024-09-12T03:13:15.915849+0000, chain.objs.size()=1 2024-09-12T01:38:00.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.109+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.X3c96nopSgy6WKnjLci_Fdy_CSiZxOV_0 2024-09-12T01:38:00.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.109+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15528620206231041302', time=2024-09-12T03:13:16.882643+0000, chain.objs.size()=1 2024-09-12T01:38:00.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.109+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.U567-htbAMEUrCT53eQTfonzcCwSvuk_0 2024-09-12T01:38:00.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.110+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11831242025593841915', time=2024-09-12T03:13:17.144456+0000, chain.objs.size()=1 2024-09-12T01:38:00.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.110+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.zz-pACxBL_uaRMDR5uHgnX9NZibPEzg_0 2024-09-12T01:38:00.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.111+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17831948074725299697', time=2024-09-12T03:13:53.790644+0000, chain.objs.size()=1 2024-09-12T01:38:00.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.111+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.6y_x_g_nIZu9dXQiprAE8BApVcJbbxC_0 2024-09-12T01:38:00.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.111+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8732705871947294471', time=2024-09-12T03:13:53.928204+0000, chain.objs.size()=1 2024-09-12T01:38:00.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.111+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.A2qH0XykNRM3DzIurazL7_dEF9zMAom_0 2024-09-12T01:38:00.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.111+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3204282831937013244', time=2024-09-12T03:13:54.369765+0000, chain.objs.size()=1 2024-09-12T01:38:00.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.111+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.uKWYYQdQimCYOHS5pEmq7PH-t4ZTn9-_0 2024-09-12T01:38:00.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.111+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16275705177351566865', time=2024-09-12T03:13:54.575282+0000, chain.objs.size()=1 2024-09-12T01:38:00.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.111+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.r91qJ1Jh4RPSxQkYln23_ct5azqdQO3_0 2024-09-12T01:38:00.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.113+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11777605470156296723', time=2024-09-12T03:13:55.455964+0000, chain.objs.size()=1 2024-09-12T01:38:00.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.113+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.sFI1HKqHb2wYGtxJ0olcZhvgX6hKRuJ_0 2024-09-12T01:38:00.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.115+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5043947938519029735', time=2024-09-12T03:13:55.476433+0000, chain.objs.size()=1 2024-09-12T01:38:00.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.115+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.KAxa5BLSOEVqRM0HaYhNTktjbE1nOl2_0 2024-09-12T01:38:00.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.115+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6750895547839579914', time=2024-09-12T03:13:55.477840+0000, chain.objs.size()=1 2024-09-12T01:38:00.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.115+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.cGmq4Mja5eGPhpbxwPkeiw5r1sV7_Ht_0 2024-09-12T01:38:00.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.116+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18219452170480272301', time=2024-09-12T03:13:55.673786+0000, chain.objs.size()=1 2024-09-12T01:38:00.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.116+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.xWDhxDnLeua2gFtoNtJ7fUTHtXCKUmn_0 2024-09-12T01:38:00.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.116+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14223488973577911858', time=2024-09-12T03:13:55.674360+0000, chain.objs.size()=1 2024-09-12T01:38:00.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.116+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.oackDQdnv4HRwX1XOOTfapBzdtVPJlb_0 2024-09-12T01:38:00.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.116+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14025687328260939588', time=2024-09-12T03:13:55.731571+0000, chain.objs.size()=1 2024-09-12T01:38:00.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.116+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.WwLB3LQuUy4AFPMECkREWvh8uwwP-uB_0 2024-09-12T01:38:00.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.116+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2822385685917639873', time=2024-09-12T03:13:56.459502+0000, chain.objs.size()=1 2024-09-12T01:38:00.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.116+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.tHxIzcv-e7Q7tGus8uWrATw2iXfEzNR_0 2024-09-12T01:38:00.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.116+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16819820111667082097', time=2024-09-12T03:13:56.995527+0000, chain.objs.size()=1 2024-09-12T01:38:00.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.116+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.OFHTCCWXXXgilBndH2p-PGkfLk1v1MK_0 2024-09-12T01:38:00.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.116+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11621792475259103979', time=2024-09-12T03:13:57.375673+0000, chain.objs.size()=1 2024-09-12T01:38:00.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.116+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.ZaIXjH_NWjnKjU2i6oyTZlNDzMbujA0_0 2024-09-12T01:38:00.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.116+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8565173488184773856', time=2024-09-12T03:13:57.824023+0000, chain.objs.size()=1 2024-09-12T01:38:00.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.116+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.SFFNGtp56SPaNBRd2sOJenhotjLLUde_0 2024-09-12T01:38:00.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.116+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16426919650070948246', time=2024-09-12T03:13:58.160648+0000, chain.objs.size()=1 2024-09-12T01:38:00.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.116+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.34_TwqgQBqVONEAujeAB_9G9lGq9AFj_0 2024-09-12T01:38:00.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.118+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16119854511001427595', time=2024-09-12T03:13:58.459898+0000, chain.objs.size()=1 2024-09-12T01:38:00.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.118+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.osBR6CwUkJU3IiOcbq06R3DceIflFOd_0 2024-09-12T01:38:00.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.118+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18181256046663234666', time=2024-09-12T03:13:58.750665+0000, chain.objs.size()=1 2024-09-12T01:38:00.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.118+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.FGQS0oqhtcxPflV_Z5fZr_8jXlOzShK_0 2024-09-12T01:38:00.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.121+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6172262161543024333', time=2024-09-12T03:13:59.148955+0000, chain.objs.size()=1 2024-09-12T01:38:00.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.121+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.sjOokBnkAcLiEwCO9bu--Rvo2OqjgqH_0 2024-09-12T01:38:00.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.121+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4239464006199554060', time=2024-09-12T03:13:59.315206+0000, chain.objs.size()=1 2024-09-12T01:38:00.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.121+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.cFAXtPkbz5VpPRui2hBEVGKKMeyx0KO_0 2024-09-12T01:38:00.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.121+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8619726025580589368', time=2024-09-12T03:13:59.780342+0000, chain.objs.size()=1 2024-09-12T01:38:00.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.121+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.0qGyvq3Z98SV2M8_bfPp4MYv0zuEoV5_0 2024-09-12T01:38:00.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.121+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14889197990615282090', time=2024-09-12T03:13:59.821967+0000, chain.objs.size()=1 2024-09-12T01:38:00.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.121+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.m7Y_b3JRwQE0MABvi6LenoTCL-I-Gr5_0 2024-09-12T01:38:00.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.121+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7706930150516855478', time=2024-09-12T03:14:00.459499+0000, chain.objs.size()=1 2024-09-12T01:38:00.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.121+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Wg_ElocVUJnaEHdIZHKHOVKgBMi97IB_0 2024-09-12T01:38:00.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.121+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16311826403410801882', time=2024-09-12T03:14:00.557203+0000, chain.objs.size()=1 2024-09-12T01:38:00.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.121+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Vv_seGTUO8Aoc42Lc_v_WInsIjd25H0_0 2024-09-12T01:38:00.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.121+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11360617786625172003', time=2024-09-12T03:14:00.760949+0000, chain.objs.size()=1 2024-09-12T01:38:00.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.121+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.uIRms-6bGSR456Ei7VJxqFrxQGiOVf2_0 2024-09-12T01:38:00.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.121+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12230229358179327792', time=2024-09-12T03:14:00.761704+0000, chain.objs.size()=1 2024-09-12T01:38:00.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.121+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.9M91w40LqxK9P0Howk3Y554dOBErDkc_0 2024-09-12T01:38:00.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.121+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13464766362491769162', time=2024-09-12T03:14:01.708412+0000, chain.objs.size()=1 2024-09-12T01:38:00.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.121+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.C31rsH7TOa0w8FIX2IX1G4X3c__smU6_0 2024-09-12T01:38:00.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.121+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14304490029916968361', time=2024-09-12T03:14:02.281792+0000, chain.objs.size()=1 2024-09-12T01:38:00.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.121+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.qs8lZ-imO9axmbAOJiefmNO3-p9Xqc5_0 2024-09-12T01:38:00.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.121+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10751856291831456810', time=2024-09-12T03:14:02.282726+0000, chain.objs.size()=1 2024-09-12T01:38:00.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.121+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.-jRNHDZ4oVV33APrmlunoc-bvCW9F9W_0 2024-09-12T01:38:00.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.126+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1361742348950805227', time=2024-09-12T03:14:02.413696+0000, chain.objs.size()=1 2024-09-12T01:38:00.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.126+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.5G0thaf9X2Pi3u4pCH9FqhlnCT2m8Wo_0 2024-09-12T01:38:00.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.126+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13430307218030739314', time=2024-09-12T03:14:02.472257+0000, chain.objs.size()=1 2024-09-12T01:38:00.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.126+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.6LPty6eb3ltHBAP8FLsMmfJykx1vZ25_0 2024-09-12T01:38:00.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.126+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10275958932072640127', time=2024-09-12T03:14:02.609274+0000, chain.objs.size()=1 2024-09-12T01:38:00.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.126+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.zu8Xg8GJfJfGpYCnLz5WMlR4qkAEzo5_0 2024-09-12T01:38:00.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.126+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12626311537119307232', time=2024-09-12T03:14:02.887914+0000, chain.objs.size()=1 2024-09-12T01:38:00.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.126+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.6WhtRYmqNe9pM3fl4zpaQbuThevFwvA_0 2024-09-12T01:38:00.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.126+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8732082089638178402', time=2024-09-12T03:14:03.065726+0000, chain.objs.size()=1 2024-09-12T01:38:00.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.126+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.p4o0idTylz8hg3YVt6Dpr3lM-TAevt8_0 2024-09-12T01:38:00.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.126+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18164035444542111923', time=2024-09-12T03:14:03.460612+0000, chain.objs.size()=1 2024-09-12T01:38:00.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.126+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Ggyq4l9VvebODCZ-f51r_8M-NYpPjle_0 2024-09-12T01:38:00.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.126+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12608346699388659650', time=2024-09-12T03:14:03.517259+0000, chain.objs.size()=1 2024-09-12T01:38:00.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.126+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.zloIyTEThzw49hC9WDGAxkk43IgnqBi_0 2024-09-12T01:38:00.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.126+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9504497769208617144', time=2024-09-12T03:14:03.550928+0000, chain.objs.size()=1 2024-09-12T01:38:00.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.126+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.l8v8DgxzjhbH7f0LmiAshhW9wXcjXtf_0 2024-09-12T01:38:00.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.126+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7558921803631485290', time=2024-09-12T03:14:03.641704+0000, chain.objs.size()=1 2024-09-12T01:38:00.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.126+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.MD9_IxNP6ny69Ecb6wUTTh8PE6A52wH_0 2024-09-12T01:38:00.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.126+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5019997145140317503', time=2024-09-12T03:14:17.861246+0000, chain.objs.size()=1 2024-09-12T01:38:00.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.126+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.340__shadow_.2x9T3ghbutYJ1LmJU0FXwmWQfBW8kwM_0 2024-09-12T01:38:00.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.126+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18043842565063414846', time=2024-09-12T03:14:51.134526+0000, chain.objs.size()=1 2024-09-12T01:38:00.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.126+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.377__shadow_.75IBRI7V1FeOcpMr64a-K3zqF4lq7yr_0 2024-09-12T01:38:00.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.128+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6202219917419232461', time=2024-09-12T03:14:57.012916+0000, chain.objs.size()=1 2024-09-12T01:38:00.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.128+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.383__shadow_.y6HRGjjsP8L9QFn300in49gJkgx31J7_0 2024-09-12T01:38:00.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.131+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 0/42905 2024-09-12T01:38:00.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.133+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-12T01:38:00.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.133+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4005767889396195849', time=2024-09-12T03:16:34.344351+0000, chain.objs.size()=1 2024-09-12T01:38:00.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.133+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.483__shadow_.Giy2_mPESermaAZmiBFmIMbGLVIvqJ4_0 2024-09-12T01:38:00.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.133+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3277765510664667515', time=2024-09-12T03:16:40.347542+0000, chain.objs.size()=3 2024-09-12T01:38:00.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.133+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.486__shadow_.ec5-CCmExoIjkZvSRZ-xvocMngPc4Id_0 2024-09-12T01:38:00.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.133+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.486__shadow_.ec5-CCmExoIjkZvSRZ-xvocMngPc4Id_1 2024-09-12T01:38:00.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.133+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.486__shadow_.ec5-CCmExoIjkZvSRZ-xvocMngPc4Id_2 2024-09-12T01:38:00.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.133+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9308497419354233027', time=2024-09-12T03:17:37.960865+0000, chain.objs.size()=1 2024-09-12T01:38:00.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.133+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.518__multipart_mymultipart.2~H7VEE3PCLaPTWARjcC_u_EnUwZodyPo.1 2024-09-12T01:38:00.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.133+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7957211868589837085', time=2024-09-12T03:20:32.500066+0000, chain.objs.size()=3 2024-09-12T01:38:00.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.133+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.523__multipart_mymultipart.2~QfQsl0sM0swZhBsWud6zzjzEmTBGDLg.1 2024-09-12T01:38:00.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.133+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.523__multipart_mymultipart.2~QfQsl0sM0swZhBsWud6zzjzEmTBGDLg.2 2024-09-12T01:38:00.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.134+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.523__multipart_mymultipart.2~QfQsl0sM0swZhBsWud6zzjzEmTBGDLg.3 2024-09-12T01:38:00.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.134+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9721068821891005676', time=2024-09-12T03:20:34.577787+0000, chain.objs.size()=3 2024-09-12T01:38:00.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.134+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.523__multipart_mymultipart.2~Tkoy6PpOxyCAc9QW_2-J1GRfMYqLTK6.1 2024-09-12T01:38:00.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.134+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.523__multipart_mymultipart.2~Tkoy6PpOxyCAc9QW_2-J1GRfMYqLTK6.2 2024-09-12T01:38:00.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.134+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.523__multipart_mymultipart.2~Tkoy6PpOxyCAc9QW_2-J1GRfMYqLTK6.3 2024-09-12T01:38:00.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.134+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12294943996569388306', time=2024-09-12T03:22:35.640830+0000, chain.objs.size()=1 2024-09-12T01:38:00.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.134+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.555__shadow_.n7QlZr4027CmJJdN9bTlzwu399ANmQF_0 2024-09-12T01:38:00.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.135+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9257973929966068726', time=2024-09-12T03:23:55.918535+0000, chain.objs.size()=1 2024-09-12T01:38:00.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.135+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.577__shadow:v6.UXTShCu2tYg5dsJsmR7ZUoEbem-k_.mkEZvDvRe-n2hGKa43GeWfFM-knDT88_0 2024-09-12T01:38:00.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.136+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16428824319762842460', time=2024-09-12T03:24:33.925837+0000, chain.objs.size()=4 2024-09-12T01:38:00.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.136+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.578__multipart_testobj.2~B7txT0i_uAqRoXjFtpnaM1mSwn5a063.1 2024-09-12T01:38:00.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.136+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.578__multipart_testobj.2~B7txT0i_uAqRoXjFtpnaM1mSwn5a063.2 2024-09-12T01:38:00.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.137+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.578__multipart_testobj.2~B7txT0i_uAqRoXjFtpnaM1mSwn5a063.3 2024-09-12T01:38:00.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.137+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.578__multipart_testobj.2~B7txT0i_uAqRoXjFtpnaM1mSwn5a063.4 2024-09-12T01:38:00.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.137+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17942460713656430430', time=2024-09-12T03:24:47.734652+0000, chain.objs.size()=1 2024-09-12T01:38:00.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.137+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.587__shadow:vVIaoQuVlPHS2z-Wccq7jRHmvVCTL5e_.jOWdJaoc9pza4iS_x7ISonAEaW4dsZm_0 2024-09-12T01:38:00.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.137+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1848790924790080953', time=2024-09-12T03:30:29.042132+0000, chain.objs.size()=1 2024-09-12T01:38:00.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.137+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.654__shadow_.5unl7HClIKrlsBhwO9mIahfOHtQK6ji_0 2024-09-12T01:38:00.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.137+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='2~JhzcvOlBELX0bh6R-XlctrL_NnEFgDD', time=2024-09-12T03:32:42.204399+0000, chain.objs.size()=1 2024-09-12T01:38:00.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.137+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.742__multipart_mymultipart.2~JhzcvOlBELX0bh6R-XlctrL_NnEFgDD.1 2024-09-12T01:38:00.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.140+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:38:00.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.143+0000 7f8786c98800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T01:38:00.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.144+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:38:00.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.144+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:38:00.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.145+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46508' 2024-09-12T01:38:00.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.145+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2346783659011121562', time=2024-09-12T03:06:35.130577+0000, chain.objs.size()=3 2024-09-12T01:38:00.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.145+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.159__multipart_mymultipart-STANDARD.2~znukqsPuXZONjH1lcgtb-nSyMnus6_6.1 2024-09-12T01:38:00.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.145+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.159__multipart_mymultipart-STANDARD.2~znukqsPuXZONjH1lcgtb-nSyMnus6_6.2 2024-09-12T01:38:00.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.145+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.159__multipart_mymultipart-STANDARD.2~znukqsPuXZONjH1lcgtb-nSyMnus6_6.3 2024-09-12T01:38:00.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.145+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5455434114586814328', time=2024-09-12T03:08:17.315848+0000, chain.objs.size()=1 2024-09-12T01:38:00.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.145+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.204__shadow_.ENA8-BZuYjBaWzFSQCIj_TzeznFocQ-_0 2024-09-12T01:38:00.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.145+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6574913471354118715', time=2024-09-12T03:10:06.804714+0000, chain.objs.size()=1 2024-09-12T01:38:00.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.145+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.231__shadow_.TZbMrg9d0gxWvsvT0Jd7umjl93beH42_0 2024-09-12T01:38:00.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.145+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16181161132744889480', time=2024-09-12T03:10:30.738873+0000, chain.objs.size()=1 2024-09-12T01:38:00.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.145+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.253__shadow_.xtW_YTmBU4H2pYZi7hufvG7BVJ4kJPr_0 2024-09-12T01:38:00.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.145+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15643305580277633023', time=2024-09-12T03:11:14.421407+0000, chain.objs.size()=1 2024-09-12T01:38:00.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.145+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.tzWMoUb5RgIGAIZ4SFdWnRgxWzjyNxx_0 2024-09-12T01:38:00.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.145+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16542763257011945017', time=2024-09-12T03:11:14.641943+0000, chain.objs.size()=1 2024-09-12T01:38:00.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.145+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.jF7jBBYQ_mrFPUSPMkjsqUP6iWDwlr7_0 2024-09-12T01:38:00.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.145+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7593987234715423810', time=2024-09-12T03:11:14.687389+0000, chain.objs.size()=1 2024-09-12T01:38:00.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.145+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.C4uqPv80O0C-T2SXq5CndDeYTAl5vOC_0 2024-09-12T01:38:00.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.145+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10862953128195853463', time=2024-09-12T03:11:15.199778+0000, chain.objs.size()=1 2024-09-12T01:38:00.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.145+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.cjAilTC6LUHrUa4SThmKiEpn8luBpB8_0 2024-09-12T01:38:00.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.145+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14773824110743421333', time=2024-09-12T03:11:15.944853+0000, chain.objs.size()=1 2024-09-12T01:38:00.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.145+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Z8K-xPRgBptJk_XK-n2QIyxYYercLfr_0 2024-09-12T01:38:00.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.145+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17719406947668656129', time=2024-09-12T03:11:17.397789+0000, chain.objs.size()=1 2024-09-12T01:38:00.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.145+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.GxhqpbeMOpD4FN_eCe7bMKHiu1IkGok_0 2024-09-12T01:38:00.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.150+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16919122750987853818', time=2024-09-12T03:11:17.711162+0000, chain.objs.size()=1 2024-09-12T01:38:00.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.150+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Wva-I1543pzQmIi7oB3BmwyFUUPff1b_0 2024-09-12T01:38:00.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.150+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6229950189187934156', time=2024-09-12T03:11:18.029151+0000, chain.objs.size()=1 2024-09-12T01:38:00.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.150+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Sic_4yMbWJcER6miSc0VoJo_kmKFYGQ_0 2024-09-12T01:38:00.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.150+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12025261755107810567', time=2024-09-12T03:11:18.057964+0000, chain.objs.size()=1 2024-09-12T01:38:00.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.150+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.T42o89-VuLXqIZdTlILY4S-CShxjM6n_0 2024-09-12T01:38:00.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.150+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6611611726490107538', time=2024-09-12T03:11:18.124719+0000, chain.objs.size()=1 2024-09-12T01:38:00.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.150+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.se6wv9vPjzg3deG4N8g32Gnd202zQvS_0 2024-09-12T01:38:00.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.150+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15590954462776325883', time=2024-09-12T03:11:20.349055+0000, chain.objs.size()=1 2024-09-12T01:38:00.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.150+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.BZ-2XD_cLTK3mzK-Wdx45Km-0FkoSG6_0 2024-09-12T01:38:00.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.150+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8622170617688893195', time=2024-09-12T03:11:20.790005+0000, chain.objs.size()=1 2024-09-12T01:38:00.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.150+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.cFaSA5H3pVif5WU8eIdg6QJ4jLWtP0K_0 2024-09-12T01:38:00.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.150+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14741613208129276616', time=2024-09-12T03:11:20.912566+0000, chain.objs.size()=1 2024-09-12T01:38:00.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.150+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.ZxH-75BeYhj6kyWt7n5uksOOmPWleNY_0 2024-09-12T01:38:00.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.150+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11213860264263721607', time=2024-09-12T03:11:21.946175+0000, chain.objs.size()=1 2024-09-12T01:38:00.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.150+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Suj_ACkivw3Ff8BMnHTAjJA80njZv3C_0 2024-09-12T01:38:00.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.150+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15145075437733996005', time=2024-09-12T03:11:21.992630+0000, chain.objs.size()=1 2024-09-12T01:38:00.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.150+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Gcx_q50yuPe3MAm97-tXOT6UEc9jIDk_0 2024-09-12T01:38:00.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.150+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17973113140831708157', time=2024-09-12T03:11:22.106511+0000, chain.objs.size()=1 2024-09-12T01:38:00.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.150+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.zGVb_hd062EkY2bI9catRUiwBSyqD7m_0 2024-09-12T01:38:00.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.150+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8600260054968187608', time=2024-09-12T03:11:22.413954+0000, chain.objs.size()=1 2024-09-12T01:38:00.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.150+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.tNDiSYxMqrfWS5KUOL_MC2gDsMBWl84_0 2024-09-12T01:38:00.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.151+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4322977131258664909', time=2024-09-12T03:11:22.521420+0000, chain.objs.size()=1 2024-09-12T01:38:00.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.151+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.0hUEoyuR5SB2L3AmpeT1VCqMgkYtJ5F_0 2024-09-12T01:38:00.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.152+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4793099308243928405', time=2024-09-12T03:11:22.827494+0000, chain.objs.size()=1 2024-09-12T01:38:00.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.152+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.YS-Df9ndgVfNumgSvJgsMHG0LMeaHax_0 2024-09-12T01:38:00.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.152+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1283696266120264308', time=2024-09-12T03:11:23.234386+0000, chain.objs.size()=1 2024-09-12T01:38:00.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.152+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.mmovlFTzUNAb6BcbzFL-2JnwMigc-67_0 2024-09-12T01:38:00.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.152+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7656834849096531200', time=2024-09-12T03:11:23.466651+0000, chain.objs.size()=1 2024-09-12T01:38:00.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.152+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.39qBmG9X-qF4aK2liWLQY08iYJXGtem_0 2024-09-12T01:38:00.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.152+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9480947924901999083', time=2024-09-12T03:11:23.483605+0000, chain.objs.size()=1 2024-09-12T01:38:00.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.152+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.w20BVIq60ZqkDgykbxeyWepj8qio3Ue_0 2024-09-12T01:38:00.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.153+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13940157260038751232', time=2024-09-12T03:11:23.654873+0000, chain.objs.size()=1 2024-09-12T01:38:00.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.153+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.ZWt2k5VzUeWA_sBGlmJ-ldzumAIKxcn_0 2024-09-12T01:38:00.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.153+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1499698312787591442', time=2024-09-12T03:11:24.270158+0000, chain.objs.size()=1 2024-09-12T01:38:00.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.153+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.9WlXY--bz7fRLAY6KP3y9WnM9Dq7-fd_0 2024-09-12T01:38:00.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.153+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17526558799911891569', time=2024-09-12T03:11:24.461187+0000, chain.objs.size()=1 2024-09-12T01:38:00.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.153+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.tv3ePypDqG0pM8w6NLiHVls6KBy7RfD_0 2024-09-12T01:38:00.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.153+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9041571346546700784', time=2024-09-12T03:11:24.681267+0000, chain.objs.size()=1 2024-09-12T01:38:00.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.153+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.fm9llNvXxf5yEhTg4xEBOVSuzgqtwPP_0 2024-09-12T01:38:00.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.153+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5093165837826705032', time=2024-09-12T03:11:27.755404+0000, chain.objs.size()=1 2024-09-12T01:38:00.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.153+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.265__shadow_.THFSzAbYX7T01b1c-F7io54oibX1l0J_0 2024-09-12T01:38:00.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.154+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5480463380545606737', time=2024-09-12T03:11:36.141891+0000, chain.objs.size()=1 2024-09-12T01:38:00.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.154+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.274__shadow_.y_cQE8mhsLc2lfafhqPA_0Eia56Pn5G_0 2024-09-12T01:38:00.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.154+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14677041550319393648', time=2024-09-12T03:11:48.924430+0000, chain.objs.size()=1 2024-09-12T01:38:00.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.154+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.287__shadow_.N74jH3KALhQyv0t2NCkWOOJknTUDhFA_0 2024-09-12T01:38:00.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.154+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6800468010209564582', time=2024-09-12T03:11:55.289676+0000, chain.objs.size()=1 2024-09-12T01:38:00.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.154+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.292__shadow_.OE31o1EXc1njwN_hTj6PR2f155HlmU0_0 2024-09-12T01:38:00.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.155+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11756243134236252500', time=2024-09-12T03:13:07.144026+0000, chain.objs.size()=1 2024-09-12T01:38:00.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.155+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.BnafFZTKyJ4UjO1UQ-0Mk-riylYh5dN_0 2024-09-12T01:38:00.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.155+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15018033973150218290', time=2024-09-12T03:13:07.212876+0000, chain.objs.size()=1 2024-09-12T01:38:00.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.155+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.upZjG3pm0YyT9T9W8-PXxir_2Z0iIwP_0 2024-09-12T01:38:00.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.155+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8620588038704975345', time=2024-09-12T03:13:07.227298+0000, chain.objs.size()=1 2024-09-12T01:38:00.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.155+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.d_KrCn7_qK4g9VeBx6q9rtmf_hx8rcB_0 2024-09-12T01:38:00.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.155+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.78083799381013764', time=2024-09-12T03:13:08.552012+0000, chain.objs.size()=1 2024-09-12T01:38:00.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.155+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.IN8k6lPO8onB02iSJtiRJRw6GDZfZXy_0 2024-09-12T01:38:00.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.155+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2747657321634633033', time=2024-09-12T03:13:08.877324+0000, chain.objs.size()=1 2024-09-12T01:38:00.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.155+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.XfuRcG8NubEZjrCuhBi0yZdbvDdeprE_0 2024-09-12T01:38:00.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.155+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16427682676311588', time=2024-09-12T03:13:08.964705+0000, chain.objs.size()=1 2024-09-12T01:38:00.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.155+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.NRnES-Y3cX6_hLEqZR_DvKAjYRyHAdb_0 2024-09-12T01:38:00.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.155+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15868441337217206201', time=2024-09-12T03:13:09.253537+0000, chain.objs.size()=1 2024-09-12T01:38:00.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.155+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.dMKmwkFlLA6kNvPpD9pqjyL2wm9xqqn_0 2024-09-12T01:38:00.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.156+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6826715293327856302', time=2024-09-12T03:13:10.016570+0000, chain.objs.size()=1 2024-09-12T01:38:00.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.156+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.2X_SyDIYjQSCbKGtdHuXZIknEY9comD_0 2024-09-12T01:38:00.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.156+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5267367881251563231', time=2024-09-12T03:13:10.325687+0000, chain.objs.size()=1 2024-09-12T01:38:00.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.156+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.1A3rj0rO-dm1VbLgcmfykNBGh3sC3xy_0 2024-09-12T01:38:00.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.157+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9094105334449083139', time=2024-09-12T03:13:10.384311+0000, chain.objs.size()=1 2024-09-12T01:38:00.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.157+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.7iASUlSTcSr272rvpOrJGdC8YLqVyEF_0 2024-09-12T01:38:00.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.157+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14808155317864946900', time=2024-09-12T03:13:10.441352+0000, chain.objs.size()=1 2024-09-12T01:38:00.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.157+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.CRr2O5Si3X-mGwAoFenzD4P9dyiFlSJ_0 2024-09-12T01:38:00.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.157+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1741292371464951888', time=2024-09-12T03:13:10.666332+0000, chain.objs.size()=1 2024-09-12T01:38:00.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.157+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.DryB1BFnOfPULpiVCxlYHVvQcIKZmMc_0 2024-09-12T01:38:00.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.157+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5908483527677140506', time=2024-09-12T03:13:11.283714+0000, chain.objs.size()=1 2024-09-12T01:38:00.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.157+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.iCIP8r7l1ZNE1UuMhn0_9qnRHDG3dCz_0 2024-09-12T01:38:00.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.157+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14126151514069298532', time=2024-09-12T03:13:11.846769+0000, chain.objs.size()=1 2024-09-12T01:38:00.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.157+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.c68GiE87SjarSP7AOBDqKCKn6MBHRPH_0 2024-09-12T01:38:00.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.158+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13183724039055673600', time=2024-09-12T03:13:11.872033+0000, chain.objs.size()=1 2024-09-12T01:38:00.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.158+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.xOPQi-csM_r2DRLxNmX74qYKd1kPVof_0 2024-09-12T01:38:00.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.158+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.293100224945380694', time=2024-09-12T03:13:11.955434+0000, chain.objs.size()=1 2024-09-12T01:38:00.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.158+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.YRYMpfcCIjHudDrPbfIx51W9B4qAQw2_0 2024-09-12T01:38:00.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.158+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1246385075699947519', time=2024-09-12T03:13:12.079658+0000, chain.objs.size()=1 2024-09-12T01:38:00.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.158+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.v9Vvr3rduNCEjaab1WCUjJO0vMnyYYx_0 2024-09-12T01:38:00.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.158+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6973328613181371395', time=2024-09-12T03:13:12.681578+0000, chain.objs.size()=1 2024-09-12T01:38:00.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.158+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.E5BxfcDEP5qcAlN2W-7_EOHR6xBlFWf_0 2024-09-12T01:38:00.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.158+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2468027883844159714', time=2024-09-12T03:13:13.042682+0000, chain.objs.size()=1 2024-09-12T01:38:00.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.158+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.Rl77-VxvNDI6pmzkY75gXc8IBvCfMK__0 2024-09-12T01:38:00.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.158+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7217524538310228382', time=2024-09-12T03:13:14.282360+0000, chain.objs.size()=1 2024-09-12T01:38:00.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.158+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.THf1MlVshHjzTpxt39kKC23-qaLkFT0_0 2024-09-12T01:38:00.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.158+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14327101592620612150', time=2024-09-12T03:13:14.406850+0000, chain.objs.size()=1 2024-09-12T01:38:00.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.158+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.OH6f0miyIaPzlQmfJ7Q_IxT7aF7EDok_0 2024-09-12T01:38:00.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.158+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1801293753170481802', time=2024-09-12T03:13:14.666069+0000, chain.objs.size()=1 2024-09-12T01:38:00.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.158+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.YTk7VvE-WE6oO1U2zH-2OmN0KyEtYYk_0 2024-09-12T01:38:00.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.160+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.501931967317246001', time=2024-09-12T03:13:15.109560+0000, chain.objs.size()=1 2024-09-12T01:38:00.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.160+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.Gktot2u3dmO_7VPWi9LHycy_rKqt60o_0 2024-09-12T01:38:00.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.160+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12928163049751231024', time=2024-09-12T03:13:15.713920+0000, chain.objs.size()=1 2024-09-12T01:38:00.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.160+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.AEE_LwPH4ziN9GcCIEyALH1pyUDcDjB_0 2024-09-12T01:38:00.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.160+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2908059756930221403', time=2024-09-12T03:13:16.684492+0000, chain.objs.size()=1 2024-09-12T01:38:00.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.160+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.iAiw2vs3UsRJADHjplTEn9NzPGplsJ__0 2024-09-12T01:38:00.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.160+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9769063386828060034', time=2024-09-12T03:13:16.844735+0000, chain.objs.size()=1 2024-09-12T01:38:00.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.160+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.ufF1hbjI89MjWG_Y7mKPea1ABwCjXzM_0 2024-09-12T01:38:00.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.161+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9892987900534154187', time=2024-09-12T03:13:16.909394+0000, chain.objs.size()=1 2024-09-12T01:38:00.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.161+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.9NDLMLu6mlFGT72WB63ZrhVJqbKJ8hs_0 2024-09-12T01:38:00.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.161+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.355156386624486328', time=2024-09-12T03:13:17.082435+0000, chain.objs.size()=1 2024-09-12T01:38:00.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.161+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.MZH3hxooo9EkIal7IL5bb85SFqD_TSF_0 2024-09-12T01:38:00.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.161+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18224437148249620538', time=2024-09-12T03:13:53.648258+0000, chain.objs.size()=1 2024-09-12T01:38:00.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.161+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.WRv58X9mrqRHnTOhN33zOFpGTSuDSgm_0 2024-09-12T01:38:00.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.161+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12063201383618225529', time=2024-09-12T03:13:53.964129+0000, chain.objs.size()=1 2024-09-12T01:38:00.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.161+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Q486seMKuLbpalNA8v2iHSjyIZXgvRV_0 2024-09-12T01:38:00.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.161+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13025724888697192408', time=2024-09-12T03:13:54.154362+0000, chain.objs.size()=1 2024-09-12T01:38:00.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.161+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.TXsHy3IwIRxr7k3gS1b1p8-FwNNVB4U_0 2024-09-12T01:38:00.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.161+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6236531962394215909', time=2024-09-12T03:13:54.189847+0000, chain.objs.size()=1 2024-09-12T01:38:00.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.161+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.21-gDA_cbMVo77tyfbsS9Jn_OKVpmOe_0 2024-09-12T01:38:00.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.161+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9740770661068179044', time=2024-09-12T03:13:54.218306+0000, chain.objs.size()=1 2024-09-12T01:38:00.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.161+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.eVbR0M88WsRyV4mdmnydQzqUFvabQrL_0 2024-09-12T01:38:00.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.161+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12682950510792876137', time=2024-09-12T03:13:55.246853+0000, chain.objs.size()=1 2024-09-12T01:38:00.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.161+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.SdZo5oDDXggS0b1VV6eS_IGSJoScojW_0 2024-09-12T01:38:00.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.163+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13803902110118323687', time=2024-09-12T03:13:55.269978+0000, chain.objs.size()=1 2024-09-12T01:38:00.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.163+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.9KHCXfpCQFQaPBF3TGBXC7wIoPMkvGy_0 2024-09-12T01:38:00.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.163+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9642944256508909419', time=2024-09-12T03:13:55.646662+0000, chain.objs.size()=1 2024-09-12T01:38:00.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.163+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.JcUq3lunQmbHcCUj8qRaW2a3J6E5fdb_0 2024-09-12T01:38:00.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.163+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17892271246488742555', time=2024-09-12T03:13:55.758232+0000, chain.objs.size()=1 2024-09-12T01:38:00.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.163+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Q08ITzaowXbF3Co5SMRJFadsp5CsFUi_0 2024-09-12T01:38:00.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.163+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12491462572643122183', time=2024-09-12T03:13:55.867575+0000, chain.objs.size()=1 2024-09-12T01:38:00.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.163+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.U_rOJtzDnSsETJsvkjT_2yEjxtKRuEM_0 2024-09-12T01:38:00.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.164+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6116706700633081990', time=2024-09-12T03:13:56.598341+0000, chain.objs.size()=1 2024-09-12T01:38:00.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.164+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.z8-5pSBOr7P_7KCxWlmA7KzUO9UDFlM_0 2024-09-12T01:38:00.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.164+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.382499949396580889', time=2024-09-12T03:13:56.760200+0000, chain.objs.size()=1 2024-09-12T01:38:00.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.164+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.KZAG2u8reZ3vPRWi4lHSeZBVsdB45wT_0 2024-09-12T01:38:00.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.164+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9877164406372825496', time=2024-09-12T03:13:57.268388+0000, chain.objs.size()=1 2024-09-12T01:38:00.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.164+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.sC8fsNCbJCD-gBQRD9Bmgae3Y7PQ-uU_0 2024-09-12T01:38:00.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.164+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16933134351771858801', time=2024-09-12T03:13:57.955116+0000, chain.objs.size()=1 2024-09-12T01:38:00.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.164+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.0IzU6l_e2YNnnw7Tph1M9loLXtYwaYQ_0 2024-09-12T01:38:00.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.164+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10486338038715994990', time=2024-09-12T03:13:57.995959+0000, chain.objs.size()=1 2024-09-12T01:38:00.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.164+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.77INxLk52RcHve2CtGeR73eI6jdqDkD_0 2024-09-12T01:38:00.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.164+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18033916027688877126', time=2024-09-12T03:13:59.734298+0000, chain.objs.size()=1 2024-09-12T01:38:00.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.164+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.hSubGG7p2doQkNC9MBxewYXmXgCRa3Q_0 2024-09-12T01:38:00.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.164+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5639880284933237123', time=2024-09-12T03:14:00.113203+0000, chain.objs.size()=1 2024-09-12T01:38:00.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.164+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.5dPWCszeNO1E3Aal9inhy5RevXMeC26_0 2024-09-12T01:38:00.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.165+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4259794496069370448', time=2024-09-12T03:14:00.113881+0000, chain.objs.size()=1 2024-09-12T01:38:00.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.165+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.1putgFyYaeSW-Y5A8ctPN4D88hdYwvU_0 2024-09-12T01:38:00.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.165+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16498516037415585077', time=2024-09-12T03:14:00.731143+0000, chain.objs.size()=1 2024-09-12T01:38:00.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.165+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.x9w03nBaROXdpToqlebBxTEUhLs0J2X_0 2024-09-12T01:38:00.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.168+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13392049729388257204', time=2024-09-12T03:14:00.768451+0000, chain.objs.size()=1 2024-09-12T01:38:00.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.168+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.F4S_nJo5oEVmCX5Ss8ZotVnZovj_oua_0 2024-09-12T01:38:00.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.168+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2550514881646765873', time=2024-09-12T03:14:00.891849+0000, chain.objs.size()=1 2024-09-12T01:38:00.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.168+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.mHVIgmeVPcRjux3my9CqLEvPzUeStLR_0 2024-09-12T01:38:00.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.168+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5467441451050416316', time=2024-09-12T03:14:00.998686+0000, chain.objs.size()=1 2024-09-12T01:38:00.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.168+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.0cHBEigS2rdT6iP_oxzl1IIJTQFw3xX_0 2024-09-12T01:38:00.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.168+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16346386377313100986', time=2024-09-12T03:14:01.267909+0000, chain.objs.size()=1 2024-09-12T01:38:00.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.168+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.60ltxaPGSDv-C-l7BMGjI2t5KozmNrn_0 2024-09-12T01:38:00.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.168+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10416882226135531682', time=2024-09-12T03:14:01.397290+0000, chain.objs.size()=1 2024-09-12T01:38:00.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.168+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.wNEbNIQoCcQf4Bk0ePCY1VKDc8kV_Lc_0 2024-09-12T01:38:00.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.168+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4987859751466678976', time=2024-09-12T03:14:01.398054+0000, chain.objs.size()=1 2024-09-12T01:38:00.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.168+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.DWvX0t0UnISioWwHjFovGBw_bnsaoaS_0 2024-09-12T01:38:00.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.168+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17608646285320189808', time=2024-09-12T03:14:01.859855+0000, chain.objs.size()=1 2024-09-12T01:38:00.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.168+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.cTZS9uxz88TIvfEaptcpLIR-EJOQ2aa_0 2024-09-12T01:38:00.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.168+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16055170921172933361', time=2024-09-12T03:14:01.960042+0000, chain.objs.size()=1 2024-09-12T01:38:00.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.168+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.uCg9eikkKWiHGvuiRYrhIM5tQqvL5yV_0 2024-09-12T01:38:00.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.168+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.903534910357127619', time=2024-09-12T03:14:02.001421+0000, chain.objs.size()=1 2024-09-12T01:38:00.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.168+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.kUhvEx2lQi0u9MAh4DRmD6gdx6J_45O_0 2024-09-12T01:38:00.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.168+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8624480477766293061', time=2024-09-12T03:14:02.070245+0000, chain.objs.size()=1 2024-09-12T01:38:00.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.168+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.IgROGhumk_8pseo-5z_kC8adblmgWM1_0 2024-09-12T01:38:00.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.168+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18008531917345216003', time=2024-09-12T03:14:02.354390+0000, chain.objs.size()=1 2024-09-12T01:38:00.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.168+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.GlHYhjh6cMUgySdjDYfyF-TwD0OJecS_0 2024-09-12T01:38:00.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.170+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3947185054147482286', time=2024-09-12T03:14:02.589330+0000, chain.objs.size()=1 2024-09-12T01:38:00.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.170+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.7_bJnp4DnyE1Wt42gaOAkyKdfpfRsO3_0 2024-09-12T01:38:00.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.172+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1311850862503491079', time=2024-09-12T03:14:03.066571+0000, chain.objs.size()=1 2024-09-12T01:38:00.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.172+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Kui2i2vnTLF6761PqY1bFEEjTE-K84H_0 2024-09-12T01:38:00.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.172+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7719459827810675174', time=2024-09-12T03:14:03.376827+0000, chain.objs.size()=1 2024-09-12T01:38:00.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.172+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.4yKfrG-RzcwmotKDn0QZ_itMHD3SanQ_0 2024-09-12T01:38:00.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.172+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13420754249097536821', time=2024-09-12T03:14:12.687404+0000, chain.objs.size()=1 2024-09-12T01:38:00.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.172+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.334__shadow_.Exg8FMoO5Gh_JBX9J6BX3gx07v7RM7a_0 2024-09-12T01:38:00.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.172+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17324128442855739662', time=2024-09-12T03:15:45.891964+0000, chain.objs.size()=1 2024-09-12T01:38:00.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.172+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.434__shadow_.eOBiIvoKjMaprsVAlmY2LbM11DKrjpm_0 2024-09-12T01:38:00.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.172+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10715502600995668190', time=2024-09-12T03:15:53.870980+0000, chain.objs.size()=1 2024-09-12T01:38:00.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.172+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.442__shadow_.7LMDxCQ6-B2Q1mWkW4zVcs9aWNl1J7L_0 2024-09-12T01:38:00.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.172+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18022041054563213052', time=2024-09-12T03:16:13.874188+0000, chain.objs.size()=1 2024-09-12T01:38:00.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.172+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.459__shadow_.xfwo1j5kioW03itu_piLFOeq2Aqj3x8_0 2024-09-12T01:38:00.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.172+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15854480896336493037', time=2024-09-12T03:16:47.800295+0000, chain.objs.size()=1 2024-09-12T01:38:00.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.172+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.495__shadow_.E3jrf7I5M6PUZfgW_uu5ro0Mr5Dlyjm_0 2024-09-12T01:38:00.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.175+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 0/46508 2024-09-12T01:38:00.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.178+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T01:38:00.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.178+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18069465479604966828', time=2024-09-12T03:16:52.241568+0000, chain.objs.size()=1 2024-09-12T01:38:00.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.178+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.500__shadow_.MFfsuz_3hzMAx3PEFBoGV5Ej3J33uxQ_0 2024-09-12T01:38:00.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.178+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1525885541055698211', time=2024-09-12T03:17:43.615254+0000, chain.objs.size()=1 2024-09-12T01:38:00.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.178+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.517__shadow_.rFA_hLPO5kt7ZEekjJNae5hFEvwZlK4_0 2024-09-12T01:38:00.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.178+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7490764384857476177', time=2024-09-12T03:22:16.508419+0000, chain.objs.size()=1 2024-09-12T01:38:00.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.178+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.551__shadow_.E19FWYZgHPIjtXjZlozuJfiiikplqpp_0 2024-09-12T01:38:00.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.178+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11092093728665472089', time=2024-09-12T03:22:51.385448+0000, chain.objs.size()=1 2024-09-12T01:38:00.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.178+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.559__shadow_.YTYH_UXC2Uj6I1511oc9XvcJSr-cnHG_0 2024-09-12T01:38:00.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.178+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15090950139110837096', time=2024-09-12T03:23:09.145881+0000, chain.objs.size()=1 2024-09-12T01:38:00.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.178+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.569__shadow:.BsYTv3UKjAYdN8BzOYNgDJMuThq1TL_.KTpjBu1rsuyK7XktFinrZ8mXHDiixRP_0 2024-09-12T01:38:00.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.178+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10213602442455148831', time=2024-09-12T03:23:12.322611+0000, chain.objs.size()=1 2024-09-12T01:38:00.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.178+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.569__shadow:S.wQOXhqfzK4NrO6t5hgjJCOMuypr5b_.3HkJ5UNOfPRTrGXXlX-A9bLDZEnyr3x_0 2024-09-12T01:38:00.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.178+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.584824507695415298', time=2024-09-12T03:23:20.005543+0000, chain.objs.size()=1 2024-09-12T01:38:00.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.178+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.570__shadow:GQpXW1O3ms2E0E..unvaylj.9nIm5k-_.e7AowZ4hlwu4JlWaoeKMJL5p-cUT-XI_0 2024-09-12T01:38:00.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.178+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14897326339960403954', time=2024-09-12T03:23:22.644766+0000, chain.objs.size()=1 2024-09-12T01:38:00.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.178+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.572__shadow_.5qWt6Es69veLbdxkCr9W7B6Lmic6E5r_0 2024-09-12T01:38:00.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.179+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7106778685124902755', time=2024-09-12T03:23:39.225142+0000, chain.objs.size()=1 2024-09-12T01:38:00.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.179+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.577__shadow:CChrYLERpG47N5FqoXRaGCLIQlAj4M9_.W13u7lfSVX_CVLXVs5uTyxY2hk4VcGC_0 2024-09-12T01:38:00.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.179+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4432706694887061039', time=2024-09-12T03:23:46.740982+0000, chain.objs.size()=1 2024-09-12T01:38:00.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.179+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.577__shadow:uxs0FEW4lKfiYROz1mBvg4vocDPBTdZ_.afRXQFPa6osGPbz9KIHTbS4AmdmOqKF_0 2024-09-12T01:38:00.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.179+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.454669622724698753', time=2024-09-12T03:23:53.837153+0000, chain.objs.size()=1 2024-09-12T01:38:00.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.179+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.577__shadow:1ca1Jnzm8a.PMHnF.rEXR8ZXjCbtLKB_.ZEh2g5CcoDBPz1hr2tKg_ufVyzcXe60_0 2024-09-12T01:38:00.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.179+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5182670822012625828', time=2024-09-12T03:24:44.280498+0000, chain.objs.size()=1 2024-09-12T01:38:00.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.179+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.585__shadow:hgf8SbsrNU1EgLpHV-HE9o4FcwyR-YB_.2Z1NlI49hRfHOxl5a34dKBZfcfCEIEh_0 2024-09-12T01:38:00.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.180+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3638056663215098830', time=2024-09-12T03:24:45.716957+0000, chain.objs.size()=1 2024-09-12T01:38:00.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.180+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.586__shadow:tOs5dpf5Kyq73m5sNJi78dhR7qC9uaO_.tuzLFsfYYU-sdQzt8h7ctscC35fLAkv_0 2024-09-12T01:38:00.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.180+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10174216122346980500', time=2024-09-12T03:29:55.521734+0000, chain.objs.size()=1 2024-09-12T01:38:00.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.180+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.633__shadow_.B-EqDzaNcvNY8u3LrR5unfw38CoP41j_0 2024-09-12T01:38:00.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.180+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1927466820111026771', time=2024-09-12T03:29:56.571008+0000, chain.objs.size()=1 2024-09-12T01:38:00.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.180+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.634__shadow_.dhHidTYkeFVjDaLyBv9UfZYCSiN-YCw_0 2024-09-12T01:38:00.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.185+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:38:00.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.187+0000 7f8786c98800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T01:38:00.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.189+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:38:00.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.189+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:38:00.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.190+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44229' 2024-09-12T01:38:00.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.190+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='__-qWc_5DYcEi6QoYkgdpM_-WPsPi7Ai', time=2024-09-12T03:06:49.527244+0000, chain.objs.size()=2 2024-09-12T01:38:00.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.190+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.160__shadow_.NTjRTCNvRDh2c2EXPBphrmx-MBPrkeJ_0 2024-09-12T01:38:00.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.190+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.160__shadow_.NTjRTCNvRDh2c2EXPBphrmx-MBPrkeJ_1 2024-09-12T01:38:00.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.190+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14572067510479427258', time=2024-09-12T03:10:14.949168+0000, chain.objs.size()=1 2024-09-12T01:38:00.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.190+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.238__shadow_.fIzQWJtmj7O6inL0ITylUD0sTdQVvq9_0 2024-09-12T01:38:00.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.190+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17741341427101923583', time=2024-09-12T03:10:34.610082+0000, chain.objs.size()=1 2024-09-12T01:38:00.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.190+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.257__shadow_.GpZ158ZRquhZPuwmirVJMWtvtRA4kls_0 2024-09-12T01:38:00.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.190+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.181826316431115120', time=2024-09-12T03:11:14.371633+0000, chain.objs.size()=1 2024-09-12T01:38:00.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.190+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.7X5_qn1Rll5KICQ4ZdXR7Ay6oW9Kdb4_0 2024-09-12T01:38:00.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.190+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14911106337115536987', time=2024-09-12T03:11:14.973005+0000, chain.objs.size()=1 2024-09-12T01:38:00.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.190+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.dK94SVxzzikyYUvZfFlMcWv-9Bynips_0 2024-09-12T01:38:00.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.190+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6708686340533258670', time=2024-09-12T03:11:15.133524+0000, chain.objs.size()=1 2024-09-12T01:38:00.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.190+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.yQHI5gfGX4AtjG5bZppQkH_2kYKeJr3_0 2024-09-12T01:38:00.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.190+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5403786891899039228', time=2024-09-12T03:11:16.009917+0000, chain.objs.size()=1 2024-09-12T01:38:00.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.190+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.KjQ0WTWYHLg7MrKfv2xD5N6ga4RrVCY_0 2024-09-12T01:38:00.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.190+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8246366858175246252', time=2024-09-12T03:11:16.812030+0000, chain.objs.size()=1 2024-09-12T01:38:00.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.190+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.A6za5mCob_kby9Jp0qj73NlKAJoHpgV_0 2024-09-12T01:38:00.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.190+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15131109136324546604', time=2024-09-12T03:11:16.845651+0000, chain.objs.size()=1 2024-09-12T01:38:00.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.190+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.I3Gb1Zz-VXnAa1MJnMu2_61p60jWUrX_0 2024-09-12T01:38:00.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.190+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14606033569508910617', time=2024-09-12T03:11:17.412170+0000, chain.objs.size()=1 2024-09-12T01:38:00.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.190+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.XTbqX_qbIy4AAv4HoaY8I8FiO0Q7ykM_0 2024-09-12T01:38:00.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.190+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2135501131139629170', time=2024-09-12T03:11:17.420368+0000, chain.objs.size()=1 2024-09-12T01:38:00.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.190+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.y43va3RTfxAjqV3sczUvXJuY6x3dM-D_0 2024-09-12T01:38:00.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.194+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7714710969863634740', time=2024-09-12T03:11:17.732577+0000, chain.objs.size()=1 2024-09-12T01:38:00.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.194+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.97-pvjMYvNqIJgl2adslrJvEvr6gtkQ_0 2024-09-12T01:38:00.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.194+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13202822956743114535', time=2024-09-12T03:11:18.222498+0000, chain.objs.size()=1 2024-09-12T01:38:00.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.194+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.4kh6uBiyJxQUrBh_m5SIiLa9yAxK_1L_0 2024-09-12T01:38:00.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.194+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17074882492168813068', time=2024-09-12T03:11:18.365092+0000, chain.objs.size()=1 2024-09-12T01:38:00.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.194+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.JSdW_7ldb-oEHZP4A50R89EMmVwavlO_0 2024-09-12T01:38:00.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.194+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4082669255700216512', time=2024-09-12T03:11:18.952743+0000, chain.objs.size()=1 2024-09-12T01:38:00.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.194+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.s3834NU7j6rzeqA5-fJuEZLR-hkZ2lG_0 2024-09-12T01:38:00.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.194+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3132834149673550559', time=2024-09-12T03:11:19.235157+0000, chain.objs.size()=1 2024-09-12T01:38:00.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.194+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.3ID88NLScdmgn6SZEpVfEH7ow87useG_0 2024-09-12T01:38:00.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.194+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3891129549904525734', time=2024-09-12T03:11:20.224813+0000, chain.objs.size()=1 2024-09-12T01:38:00.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.194+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.uy1-MVk6JM4e5xRUo8ZoCtuKnumk9S8_0 2024-09-12T01:38:00.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.194+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3697004607900863253', time=2024-09-12T03:11:20.430137+0000, chain.objs.size()=1 2024-09-12T01:38:00.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.194+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.7lxH_dy98GgLdQ0RNA7dZbLy7J0RDe-_0 2024-09-12T01:38:00.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.194+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1645343466421828315', time=2024-09-12T03:11:20.935808+0000, chain.objs.size()=1 2024-09-12T01:38:00.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.194+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.ZGtLg8mosMVw0oSqmxG8egsn4NFcgA6_0 2024-09-12T01:38:00.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.194+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11445616357075211059', time=2024-09-12T03:11:21.838990+0000, chain.objs.size()=1 2024-09-12T01:38:00.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.194+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.CJDi2YCZak-eTRfrCX-VFVdRMIMav5r_0 2024-09-12T01:38:00.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.194+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12639689775594675313', time=2024-09-12T03:11:21.967519+0000, chain.objs.size()=1 2024-09-12T01:38:00.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.194+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.MMoKgLNEQ1-c-nZC1P_LbqWSb2e3UwO_0 2024-09-12T01:38:00.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.194+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16509173062101764336', time=2024-09-12T03:11:21.969694+0000, chain.objs.size()=1 2024-09-12T01:38:00.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.194+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.awJyIrELhZtTc9EO3XGegVXTcnAu7HO_0 2024-09-12T01:38:00.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.196+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15626113054577432802', time=2024-09-12T03:11:22.542785+0000, chain.objs.size()=1 2024-09-12T01:38:00.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.196+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.sm3Na1-qf2UekLW8-Rh9F1iQ6K-PgmU_0 2024-09-12T01:38:00.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.196+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3098213191053387161', time=2024-09-12T03:11:22.825994+0000, chain.objs.size()=1 2024-09-12T01:38:00.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.196+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.K-zjX66bNjFJBJbX8TfsUb5BIj99jFj_0 2024-09-12T01:38:00.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.197+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11069028804993678211', time=2024-09-12T03:11:23.315942+0000, chain.objs.size()=1 2024-09-12T01:38:00.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.197+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.T9YCFFhLXa9CUv8eme35FfSodKL3hfc_0 2024-09-12T01:38:00.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.197+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4184342149253611012', time=2024-09-12T03:11:23.316618+0000, chain.objs.size()=1 2024-09-12T01:38:00.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.197+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.iYZ9VGFm9qlxdxkinE3n_3tL8ViRerU_0 2024-09-12T01:38:00.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.197+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13990509256483223506', time=2024-09-12T03:11:24.431241+0000, chain.objs.size()=1 2024-09-12T01:38:00.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.197+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.phgPOtvXxYopkXnL4QlI65Lyg4os7jv_0 2024-09-12T01:38:00.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.197+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16126899474285449624', time=2024-09-12T03:11:24.724926+0000, chain.objs.size()=1 2024-09-12T01:38:00.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.197+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.b72Wh0jRfqqRzMVqRmPT6GvpYcdauH0_0 2024-09-12T01:38:00.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.197+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13715729005713437521', time=2024-09-12T03:11:24.811866+0000, chain.objs.size()=1 2024-09-12T01:38:00.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.197+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.qAkYYwS0FyYf5qp1qPrOQeBgYfQAmzt_0 2024-09-12T01:38:00.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.197+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17771862803062056985', time=2024-09-12T03:11:31.451594+0000, chain.objs.size()=1 2024-09-12T01:38:00.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.197+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.269__shadow_.XjBATj_M1x7JgB4YskCs2-NsIGtSsMl_0 2024-09-12T01:38:00.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.197+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8642890296918339932', time=2024-09-12T03:11:35.218475+0000, chain.objs.size()=1 2024-09-12T01:38:00.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.197+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.273__shadow_.Q0MU7_DtR8O_x25J9DDdCC2pnMMAj91_0 2024-09-12T01:38:00.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.197+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7355809737588981286', time=2024-09-12T03:11:55.288930+0000, chain.objs.size()=1 2024-09-12T01:38:00.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.197+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.292__shadow_.jrOSJnWpIjy7AM02HCkC66H-T76Ju2B_0 2024-09-12T01:38:00.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.197+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16031204695855949065', time=2024-09-12T03:11:55.420029+0000, chain.objs.size()=1 2024-09-12T01:38:00.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.197+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.292__shadow_.CQLTWS_5Dwg_f7cQdZ4d1cw_LyG2khn_0 2024-09-12T01:38:00.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.198+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16342934521592238009', time=2024-09-12T03:11:57.496849+0000, chain.objs.size()=1 2024-09-12T01:38:00.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.198+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.293__shadow_.-hb3iKsU36QarUBOBNjHtL5TSOXzlL0_0 2024-09-12T01:38:00.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.198+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11382231234068186422', time=2024-09-12T03:12:09.502257+0000, chain.objs.size()=1 2024-09-12T01:38:00.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.198+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.305__shadow_.WqwUsCwY6FEdZuwRAEDCAYvtIWfu_kk_0 2024-09-12T01:38:00.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.199+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17522946388467160500', time=2024-09-12T03:12:10.730178+0000, chain.objs.size()=1 2024-09-12T01:38:00.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.199+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.306__shadow_.NDhy6g0nHc9InbMxHgqvLfxz_mH51gh_0 2024-09-12T01:38:00.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.199+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11060525450529434869', time=2024-09-12T03:13:06.989890+0000, chain.objs.size()=1 2024-09-12T01:38:00.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.199+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.E99kMs7Ph5xnejX-S2lC9K_brVAFLGM_0 2024-09-12T01:38:00.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.199+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5783126074966193996', time=2024-09-12T03:13:06.990605+0000, chain.objs.size()=1 2024-09-12T01:38:00.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.199+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.2blE61zbFxQCMwlNOAbWEaZftUDtzwn_0 2024-09-12T01:38:00.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.200+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6609267235820419400', time=2024-09-12T03:13:07.070464+0000, chain.objs.size()=1 2024-09-12T01:38:00.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.200+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.S3OjE01BRMuz8Wlj7H14Q5Z22mune-4_0 2024-09-12T01:38:00.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.200+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6807797083508534411', time=2024-09-12T03:13:07.499064+0000, chain.objs.size()=1 2024-09-12T01:38:00.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.200+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.LiFismKTBQMDIuz4R6ODcKLnktpFAqb_0 2024-09-12T01:38:00.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.200+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11578037610944153314', time=2024-09-12T03:13:07.744599+0000, chain.objs.size()=1 2024-09-12T01:38:00.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.200+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.fKPUNKXB_K40IaO_9Ca_AXGgS1ndTrm_0 2024-09-12T01:38:00.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.200+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10489810484671201331', time=2024-09-12T03:13:08.580663+0000, chain.objs.size()=1 2024-09-12T01:38:00.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.200+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.iUMRpAVaWn_LKU9Bmv9j4XHDUa6frZf_0 2024-09-12T01:38:00.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.200+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16654318977715656875', time=2024-09-12T03:13:08.679880+0000, chain.objs.size()=1 2024-09-12T01:38:00.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.200+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.BIG5ZXAIOk4ULv3Lmvsi2w8zm460gv8_0 2024-09-12T01:38:00.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.200+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11193536002145218919', time=2024-09-12T03:13:08.704989+0000, chain.objs.size()=1 2024-09-12T01:38:00.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.200+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.-OzdWNwqul6260VeQnn-2rxUzah6MTE_0 2024-09-12T01:38:00.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.200+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13224778206800763405', time=2024-09-12T03:13:08.836059+0000, chain.objs.size()=1 2024-09-12T01:38:00.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.200+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.HxXAaOhXFiaItdMveCIyAO-JcwEfCyB_0 2024-09-12T01:38:00.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.200+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2692047526815729337', time=2024-09-12T03:13:08.871323+0000, chain.objs.size()=1 2024-09-12T01:38:00.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.200+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.HiXM_ie60YQ7xceRWy0CT6ra08j5FJF_0 2024-09-12T01:38:00.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.200+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13600932949493481374', time=2024-09-12T03:13:09.754158+0000, chain.objs.size()=1 2024-09-12T01:38:00.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.200+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.RA3L1BQ1UogAGz0RoN5eDpfM7pjBYao_0 2024-09-12T01:38:00.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.200+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.181462901371938483', time=2024-09-12T03:13:09.821529+0000, chain.objs.size()=1 2024-09-12T01:38:00.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.200+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.srIy-MZljNlPdZUVIzlOfGU5pbbTN_z_0 2024-09-12T01:38:00.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.200+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5785915821937339407', time=2024-09-12T03:13:09.954290+0000, chain.objs.size()=1 2024-09-12T01:38:00.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.200+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.bDv9LOxoQDpEPf3qiRUx-11RSWXBcyY_0 2024-09-12T01:38:00.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.202+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8545580445675550374', time=2024-09-12T03:13:10.275720+0000, chain.objs.size()=1 2024-09-12T01:38:00.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.202+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.EhCdndl2xuhldeVDGVL4BleNNLaXfZg_0 2024-09-12T01:38:00.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.202+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4120501275110415291', time=2024-09-12T03:13:10.454108+0000, chain.objs.size()=1 2024-09-12T01:38:00.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.202+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.czvPzCxRHlqd3oTr7n-kwD5LOHfzkbP_0 2024-09-12T01:38:00.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.202+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3196320806501993036', time=2024-09-12T03:13:10.455356+0000, chain.objs.size()=1 2024-09-12T01:38:00.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.202+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.pzIqucoiZAfHs24EaclWVD2ZrA5e1Xb_0 2024-09-12T01:38:00.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.202+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11604367663024904560', time=2024-09-12T03:13:11.136828+0000, chain.objs.size()=1 2024-09-12T01:38:00.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.202+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.at5Jb9-lozfAJ2KZvRHDIpi7__f6N0m_0 2024-09-12T01:38:00.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.203+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7901820332831990397', time=2024-09-12T03:13:11.877632+0000, chain.objs.size()=1 2024-09-12T01:38:00.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.203+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.yj4I0ITjvdl1xEmqa26lC29MHw1QWu__0 2024-09-12T01:38:00.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.203+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7083990533459008776', time=2024-09-12T03:13:12.025460+0000, chain.objs.size()=1 2024-09-12T01:38:00.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.203+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.2X6VtpnLflv8h12GeOb5EgqBFvReri3_0 2024-09-12T01:38:00.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.203+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7765992127476674201', time=2024-09-12T03:13:12.490548+0000, chain.objs.size()=1 2024-09-12T01:38:00.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.203+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.g0Q41HG6nteYL-bUILUxv9IiXrbzile_0 2024-09-12T01:38:00.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.203+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2143979331931066523', time=2024-09-12T03:13:12.828528+0000, chain.objs.size()=1 2024-09-12T01:38:00.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.203+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_._X4TtQZPVnF95RnGeOp9stdO4P_o4Zt_0 2024-09-12T01:38:00.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.203+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1088317516714536012', time=2024-09-12T03:13:12.978376+0000, chain.objs.size()=1 2024-09-12T01:38:00.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.203+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.0fA7vrwjHBnYAQFaYqXtShnMTowh2CV_0 2024-09-12T01:38:00.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.203+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8033066974820589377', time=2024-09-12T03:13:13.100875+0000, chain.objs.size()=1 2024-09-12T01:38:00.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.203+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.AjANxhujmA8SH-dXHTjd03tLXR78-5b_0 2024-09-12T01:38:00.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.203+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16780947050609715737', time=2024-09-12T03:13:13.179097+0000, chain.objs.size()=1 2024-09-12T01:38:00.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.203+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.Fe0H0hkVMYM-v1GHcxt8t1i1Y5cIKRm_0 2024-09-12T01:38:00.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.203+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3832021461814980195', time=2024-09-12T03:13:15.250214+0000, chain.objs.size()=1 2024-09-12T01:38:00.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.203+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.6SYViTM3VEtComNvHNJD5dUIac1waw4_0 2024-09-12T01:38:00.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.203+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11925883618261113178', time=2024-09-12T03:13:15.687887+0000, chain.objs.size()=1 2024-09-12T01:38:00.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.203+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.4r4aj_MKeCwMrCHYZI9Xl3hSP_RC3ka_0 2024-09-12T01:38:00.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.204+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16271312688514733581', time=2024-09-12T03:13:16.077165+0000, chain.objs.size()=1 2024-09-12T01:38:00.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.204+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.aOstkEGFaL9VyAy5i9DoMz7JpMy2eq2_0 2024-09-12T01:38:00.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.204+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15683128777140491021', time=2024-09-12T03:13:16.369549+0000, chain.objs.size()=1 2024-09-12T01:38:00.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.204+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.4AXJfZbQCV_q2HJS3Qejae9qIX3IBgn_0 2024-09-12T01:38:00.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.204+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8047511964818531549', time=2024-09-12T03:13:16.521413+0000, chain.objs.size()=1 2024-09-12T01:38:00.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.204+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.WxpnSRYqFu_kGe8PxPdmyS2Am7xyUBl_0 2024-09-12T01:38:00.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.204+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.499979492117767554', time=2024-09-12T03:13:16.984547+0000, chain.objs.size()=1 2024-09-12T01:38:00.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.204+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.6i84D1DbFGjzqEYE24YDKCwiWWanOvb_0 2024-09-12T01:38:00.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.205+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11083790866991038086', time=2024-09-12T03:13:53.602615+0000, chain.objs.size()=1 2024-09-12T01:38:00.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.205+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Kf2HwhWIFFCnGqNRk5itCtFkNBbfO1Q_0 2024-09-12T01:38:00.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.205+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8897529744385822565', time=2024-09-12T03:13:53.603404+0000, chain.objs.size()=1 2024-09-12T01:38:00.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.205+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.4eG-QnBufAVOQXKdZ71tHS7_vQ6l9KQ_0 2024-09-12T01:38:00.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.205+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4573394642227807871', time=2024-09-12T03:13:53.604231+0000, chain.objs.size()=1 2024-09-12T01:38:00.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.205+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.rHHZ4vaUd45HQnV3g9dX-2cTdKjM4Fd_0 2024-09-12T01:38:00.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.205+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15731430561344867912', time=2024-09-12T03:13:53.748237+0000, chain.objs.size()=1 2024-09-12T01:38:00.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.205+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.COA2iJqR5eZ0ucCgJ6l_K1K3geqtTfQ_0 2024-09-12T01:38:00.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.205+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13278664024763405566', time=2024-09-12T03:13:53.943827+0000, chain.objs.size()=1 2024-09-12T01:38:00.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.205+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Zxymqi76yIgyu3EQ6zTuSiQWaaOGBF1_0 2024-09-12T01:38:00.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.208+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17074118123742524548', time=2024-09-12T03:13:54.005850+0000, chain.objs.size()=1 2024-09-12T01:38:00.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.208+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.uEi71fdkEswSYYA5bvNA2V2cOnG76Vr_0 2024-09-12T01:38:00.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.208+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10424570806042853688', time=2024-09-12T03:13:54.042573+0000, chain.objs.size()=1 2024-09-12T01:38:00.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.208+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.h4ZW79nnHknXzMKbdutRtyooWLHEfbp_0 2024-09-12T01:38:00.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.208+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13551358666043112562', time=2024-09-12T03:13:54.199380+0000, chain.objs.size()=1 2024-09-12T01:38:00.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.208+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.az2l_o7mJk1VPET9C-pfSLr4195_T2Y_0 2024-09-12T01:38:00.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.208+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8536777252903041460', time=2024-09-12T03:13:54.411870+0000, chain.objs.size()=1 2024-09-12T01:38:00.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.208+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.W7IQwLOc4M4nevgbyM9KL5GMVWHC5Nz_0 2024-09-12T01:38:00.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.208+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5387099670907963066', time=2024-09-12T03:13:55.147825+0000, chain.objs.size()=1 2024-09-12T01:38:00.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.208+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.STIZTL4o67bXdv7BZvtcLxrBMV2VCtv_0 2024-09-12T01:38:00.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.208+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2954021135010754956', time=2024-09-12T03:13:55.154920+0000, chain.objs.size()=1 2024-09-12T01:38:00.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.208+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.tXjWQ8uWkwBnjFVWriH3U2lti2vEgRm_0 2024-09-12T01:38:00.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.208+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16895330561255097901', time=2024-09-12T03:13:55.616177+0000, chain.objs.size()=1 2024-09-12T01:38:00.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.208+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.xx6ekzclSbbZSXrV0VoF2vyNxPUtwR6_0 2024-09-12T01:38:00.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.208+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10621335399768500051', time=2024-09-12T03:13:55.959775+0000, chain.objs.size()=1 2024-09-12T01:38:00.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.208+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.9yUh6ehMrNQrgPpvFT2ZMHMqTL6ZmfJ_0 2024-09-12T01:38:00.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.208+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7625713927517394287', time=2024-09-12T03:13:56.033999+0000, chain.objs.size()=1 2024-09-12T01:38:00.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.208+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.KlVOYZbDJNYui09YlcKe2gsgHkHslo3_0 2024-09-12T01:38:00.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.208+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17956990386039752557', time=2024-09-12T03:13:56.580581+0000, chain.objs.size()=1 2024-09-12T01:38:00.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.208+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.MnIVjplgBr4jIM6G3Er90K0teST-C2T_0 2024-09-12T01:38:00.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.209+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3696579194503591700', time=2024-09-12T03:13:56.998796+0000, chain.objs.size()=1 2024-09-12T01:38:00.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.209+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.DLHOLoj4FQGondloMxHyC30x-GwxY2h_0 2024-09-12T01:38:00.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.211+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8118406050794989272', time=2024-09-12T03:13:57.071758+0000, chain.objs.size()=1 2024-09-12T01:38:00.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.211+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.3ioHfgoYfwaDkGFW1-b9nix4VMId6kX_0 2024-09-12T01:38:00.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.211+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15033287647393797090', time=2024-09-12T03:13:57.123228+0000, chain.objs.size()=1 2024-09-12T01:38:00.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.211+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.0QdSAIyVozwoqJpcGhWRfbwxR0rt6Bs_0 2024-09-12T01:38:00.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.211+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9279845294361005704', time=2024-09-12T03:13:57.323789+0000, chain.objs.size()=1 2024-09-12T01:38:00.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.211+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.ADoZ3841TC975UCBILq-iHoWqUJHOUm_0 2024-09-12T01:38:00.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.211+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14666375248431257429', time=2024-09-12T03:13:57.984678+0000, chain.objs.size()=1 2024-09-12T01:38:00.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.211+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.jW0dP4a5GcA0hTaPb8KFwwZfR0_g2UW_0 2024-09-12T01:38:00.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.211+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3288032003803450106', time=2024-09-12T03:13:57.986239+0000, chain.objs.size()=1 2024-09-12T01:38:00.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.211+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.hZWZbQvxH9KbwiW9xKuo9BI10yYe8XP_0 2024-09-12T01:38:00.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.211+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2995702952713293489', time=2024-09-12T03:13:58.009206+0000, chain.objs.size()=1 2024-09-12T01:38:00.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.211+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.0S7kuZV9KoHZDCpyPC4isIaIpGZXzKu_0 2024-09-12T01:38:00.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.211+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8838609060070808524', time=2024-09-12T03:13:58.422260+0000, chain.objs.size()=1 2024-09-12T01:38:00.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.211+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.dTS2EsaGcmho_lTRDB9A5DTpWQG8MFb_0 2024-09-12T01:38:00.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.211+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6230529007132565311', time=2024-09-12T03:13:58.772231+0000, chain.objs.size()=1 2024-09-12T01:38:00.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.211+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_._KBNCcANCQIlz59NQqsUx94Saf2hFXZ_0 2024-09-12T01:38:00.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.212+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1552519962670687665', time=2024-09-12T03:13:59.466779+0000, chain.objs.size()=1 2024-09-12T01:38:00.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.212+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.uwRJG3M14zWuqT8Ps6bRoHcY-REOp-I_0 2024-09-12T01:38:00.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.212+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3893608334515075839', time=2024-09-12T03:13:59.846432+0000, chain.objs.size()=1 2024-09-12T01:38:00.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.212+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.IOgOUxJCFveeXxA2pWCzLWsXsZ2_KKp_0 2024-09-12T01:38:00.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.212+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12854105455087268699', time=2024-09-12T03:14:00.013640+0000, chain.objs.size()=1 2024-09-12T01:38:00.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.212+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.6smvu5RdXA2CW1f5aa9AX60N9BI40cr_0 2024-09-12T01:38:00.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.214+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10529578364069890502', time=2024-09-12T03:14:00.627644+0000, chain.objs.size()=1 2024-09-12T01:38:00.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.214+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.b-GmuLUQ0_eXX4dES-1XBT-cOd6ISHU_0 2024-09-12T01:38:00.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.214+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8025263971794113819', time=2024-09-12T03:14:01.823496+0000, chain.objs.size()=1 2024-09-12T01:38:00.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.214+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.JF_AlUu6IMF3xyQnE-nTKAeix6x-sxc_0 2024-09-12T01:38:00.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.214+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13613249523874831715', time=2024-09-12T03:14:01.846172+0000, chain.objs.size()=1 2024-09-12T01:38:00.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.214+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_._m03R-S8Yx91cy2-_RjAM5Lmo5iynKd_0 2024-09-12T01:38:00.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.214+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17520263406628536437', time=2024-09-12T03:14:01.952703+0000, chain.objs.size()=1 2024-09-12T01:38:00.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.214+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.AuGhSjI8E7X601Ot_If6AvwWAi5l7WX_0 2024-09-12T01:38:00.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.214+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10903553204822639159', time=2024-09-12T03:14:01.984784+0000, chain.objs.size()=1 2024-09-12T01:38:00.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.214+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.42VAUIIpQdhcWPqZyJ7m-Ql-aX0SghY_0 2024-09-12T01:38:00.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.214+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16553661388016483945', time=2024-09-12T03:14:01.985375+0000, chain.objs.size()=1 2024-09-12T01:38:00.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.214+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.9HfCvx7j_daB8eoalTClpHUqvvDSSHd_0 2024-09-12T01:38:00.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.214+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15752102991269330937', time=2024-09-12T03:14:02.067989+0000, chain.objs.size()=1 2024-09-12T01:38:00.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.214+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.2TIoittgNcokU2Nk6Utrw5rK1pBucET_0 2024-09-12T01:38:00.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.217+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 0/44229 2024-09-12T01:38:00.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.220+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T01:38:00.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.220+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5857301554520023303', time=2024-09-12T03:14:02.111401+0000, chain.objs.size()=1 2024-09-12T01:38:00.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.220+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.UThgvLiEZit0eCbQymO66aFrPRxZePS_0 2024-09-12T01:38:00.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.220+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1233236684198080834', time=2024-09-12T03:14:02.888153+0000, chain.objs.size()=1 2024-09-12T01:38:00.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.220+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.okD-tDUE1zASlTa6WrOvSHmdOH4K0G-_0 2024-09-12T01:38:00.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.220+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9610612907036857291', time=2024-09-12T03:14:03.461777+0000, chain.objs.size()=1 2024-09-12T01:38:00.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.220+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.ihLhUxVsCM1kw9tli3SMOi8XgaUQQ2U_0 2024-09-12T01:38:00.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.220+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.397934232723291507', time=2024-09-12T03:14:03.673187+0000, chain.objs.size()=1 2024-09-12T01:38:00.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.220+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.RoNFZtVw7G4RXJqkZ-IonsI_CJ_owKc_0 2024-09-12T01:38:00.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.220+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16986098604275036036', time=2024-09-12T03:16:11.123199+0000, chain.objs.size()=1 2024-09-12T01:38:00.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.220+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.457__shadow_.O1_Nd7aj058qY0-f0X2PiFXRTOwaVAX_0 2024-09-12T01:38:00.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.220+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4273818371965964779', time=2024-09-12T03:16:34.342783+0000, chain.objs.size()=1 2024-09-12T01:38:00.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.220+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.483__shadow_.YA-0AbWiP2jpzaHAXUwIzNsVyYOr-TR_0 2024-09-12T01:38:00.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.220+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='2~CGHhLUVGb2O1P-a_mdyQRsEPFgV_65A', time=2024-09-12T03:19:45.900607+0000, chain.objs.size()=1 2024-09-12T01:38:00.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.220+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.522__multipart_mymultipart.2~CGHhLUVGb2O1P-a_mdyQRsEPFgV_65A.2 2024-09-12T01:38:00.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.220+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='2~CGHhLUVGb2O1P-a_mdyQRsEPFgV_65A', time=2024-09-12T03:19:45.904445+0000, chain.objs.size()=1 2024-09-12T01:38:00.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.220+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.522__multipart_mymultipart.2~CGHhLUVGb2O1P-a_mdyQRsEPFgV_65A.3 2024-09-12T01:38:00.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.220+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='2~qni54VmrC9DjmO8VTDo04b7pOEBf8EB', time=2024-09-12T03:21:22.540753+0000, chain.objs.size()=1 2024-09-12T01:38:00.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.220+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.533__multipart_mymultipart.2~qni54VmrC9DjmO8VTDo04b7pOEBf8EB.1 2024-09-12T01:38:00.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.220+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.197318206457477463', time=2024-09-12T03:22:15.735044+0000, chain.objs.size()=1 2024-09-12T01:38:00.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.220+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.551__shadow_.PN9J-RQo4A5z3Wf10SymP26S3OIljxk_0 2024-09-12T01:38:00.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.220+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16766855086063741782', time=2024-09-12T03:23:12.687141+0000, chain.objs.size()=1 2024-09-12T01:38:00.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.220+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.569__shadow:u-uIa8ztHaVOxNpw0hfukK.AI.DDoFn_.zYoTr5OP2OHuAGH1AXPGBpqtYJ9helJ_0 2024-09-12T01:38:00.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.220+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14899304129895222365', time=2024-09-12T03:23:14.452915+0000, chain.objs.size()=1 2024-09-12T01:38:00.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.220+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.569__shadow:IyrGUpDVkFESDJRYbGZeaYaPElzAO-O_.m43Z3eO9rUuX2mjnMjNNToYJSlg0kvg_0 2024-09-12T01:38:00.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.222+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16759513452034622356', time=2024-09-12T03:23:42.975723+0000, chain.objs.size()=1 2024-09-12T01:38:00.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.222+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.577__shadow:9Uvjt0aCk0TRWW6HV0PJo9QoJ7sBeig_.myZbUN44j7epDoblhNPYadjhUajftRC_0 2024-09-12T01:38:00.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.222+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5655682243960006324', time=2024-09-12T03:24:24.095536+0000, chain.objs.size()=4 2024-09-12T01:38:00.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.222+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.578__multipart_testobj.2~J9sEzMeuzNJ7flwfkBELYy5nt_iUo6D.1 2024-09-12T01:38:00.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.222+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.578__multipart_testobj.2~J9sEzMeuzNJ7flwfkBELYy5nt_iUo6D.2 2024-09-12T01:38:00.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.222+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.578__multipart_testobj.2~J9sEzMeuzNJ7flwfkBELYy5nt_iUo6D.3 2024-09-12T01:38:00.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.222+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.578__multipart_testobj.2~J9sEzMeuzNJ7flwfkBELYy5nt_iUo6D.4 2024-09-12T01:38:00.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.222+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14318210876319623962', time=2024-09-12T03:28:56.416270+0000, chain.objs.size()=1 2024-09-12T01:38:00.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.222+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.618__shadow_.Nh2K4EYpJzHzy7I4qTFo4SBa0OvDcS3_0 2024-09-12T01:38:00.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.222+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='2~LkxhePGyhQDhG0yjTew4cABcOha32pe', time=2024-09-12T03:29:47.746041+0000, chain.objs.size()=6 2024-09-12T01:38:00.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.222+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.625__multipart_multipart_enc.2~LkxhePGyhQDhG0yjTew4cABcOha32pe.1 2024-09-12T01:38:00.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.222+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.625__multipart_multipart_enc.2~LkxhePGyhQDhG0yjTew4cABcOha32pe.2 2024-09-12T01:38:00.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.222+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.625__multipart_multipart_enc.2~LkxhePGyhQDhG0yjTew4cABcOha32pe.3 2024-09-12T01:38:00.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.222+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.625__multipart_multipart_enc.2~LkxhePGyhQDhG0yjTew4cABcOha32pe.4 2024-09-12T01:38:00.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.222+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.625__multipart_multipart_enc.2~LkxhePGyhQDhG0yjTew4cABcOha32pe.5 2024-09-12T01:38:00.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.225+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.625__multipart_multipart_enc.2~LkxhePGyhQDhG0yjTew4cABcOha32pe.6 2024-09-12T01:38:00.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.225+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1980502754031824693', time=2024-09-12T03:29:48.610879+0000, chain.objs.size()=1 2024-09-12T01:38:00.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.225+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.626__shadow_._a50nGxql-plJG3X2G99hwYFDKd6fA9_0 2024-09-12T01:38:00.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.225+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16712932367600832528', time=2024-09-12T03:31:00.300850+0000, chain.objs.size()=1 2024-09-12T01:38:00.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.225+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.665__shadow_.MwT0gnLlq05q2OMY1qRXDeruiF94CcU_0 2024-09-12T01:38:00.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.225+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10412808757081010166', time=2024-09-12T03:31:03.240268+0000, chain.objs.size()=1 2024-09-12T01:38:00.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.225+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.668__shadow_.-vqoU98T_btLrKDo5gu1Rcr7fT7kz_k_0 2024-09-12T01:38:00.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.227+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:38:00.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.229+0000 7f8786c98800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T01:38:00.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.231+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:38:00.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.231+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:38:00.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.232+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49715' 2024-09-12T01:38:00.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.232+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='_-IcLwm2-oNXXu6UIgSZe6MGqFFg8VpJ', time=2024-09-12T03:07:10.417032+0000, chain.objs.size()=2 2024-09-12T01:38:00.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.232+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.161__shadow_.UMGOXmQhXQynrSbf09jWNheNRJDMmwc_0 2024-09-12T01:38:00.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.232+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.161__shadow_.UMGOXmQhXQynrSbf09jWNheNRJDMmwc_1 2024-09-12T01:38:00.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.232+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='_mpKbuVTy9aBEQH42bMxQsA5QVgwB9jH', time=2024-09-12T03:07:10.441960+0000, chain.objs.size()=2 2024-09-12T01:38:00.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.232+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.161__shadow_.7alP2L3okmvOM_um6Ma_VhGE3bGuq_9_0 2024-09-12T01:38:00.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.232+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.161__shadow_.7alP2L3okmvOM_um6Ma_VhGE3bGuq_9_1 2024-09-12T01:38:00.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.232+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8741901389430095114', time=2024-09-12T03:10:09.693778+0000, chain.objs.size()=1 2024-09-12T01:38:00.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.232+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.234__shadow_.5Vbp_T6PmrFYMsJGM4R_exAbELVdLPE_0 2024-09-12T01:38:00.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.232+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12230600023200033757', time=2024-09-12T03:10:18.595429+0000, chain.objs.size()=1 2024-09-12T01:38:00.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.232+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.242__shadow_.V0RutM6XgtSashUZWNlgMe6gIRS8H92_0 2024-09-12T01:38:00.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.232+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5291251979708706642', time=2024-09-12T03:10:21.921085+0000, chain.objs.size()=1 2024-09-12T01:38:00.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.232+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.244__shadow_.SEJXF_3v224-SKcHpfcRP0aS5Vyl2k__0 2024-09-12T01:38:00.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.232+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14703030684555713885', time=2024-09-12T03:10:38.396939+0000, chain.objs.size()=1 2024-09-12T01:38:00.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.232+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.261__shadow_._yHEF9IWKKFvxxwvqzEUrZPBcTKfZ1W_0 2024-09-12T01:38:00.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.232+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2619874853429495438', time=2024-09-12T03:11:14.393151+0000, chain.objs.size()=1 2024-09-12T01:38:00.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.232+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.BcUa2nuhOSlVJxyc9-UdihIOSmeDkSW_0 2024-09-12T01:38:00.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.232+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14625719306727687391', time=2024-09-12T03:11:14.561084+0000, chain.objs.size()=1 2024-09-12T01:38:00.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.232+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.V73W1e5EPrwM8Rs599TpyT8js3RIL_E_0 2024-09-12T01:38:00.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.232+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15783134366374578656', time=2024-09-12T03:11:14.805057+0000, chain.objs.size()=1 2024-09-12T01:38:00.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.232+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.FThoA2IXvQT7NtaljbFt7HuVe509tMl_0 2024-09-12T01:38:00.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.232+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9422257068232982361', time=2024-09-12T03:11:14.912493+0000, chain.objs.size()=1 2024-09-12T01:38:00.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.232+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.3q_AjQOmABb9mDUyXET5HKnKDHKbDun_0 2024-09-12T01:38:00.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.235+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6771059980089350818', time=2024-09-12T03:11:15.279152+0000, chain.objs.size()=1 2024-09-12T01:38:00.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.235+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.NHz8F-dOVDyGZewsLEOO-SwmNxbDaTq_0 2024-09-12T01:38:00.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.235+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16613077951661133828', time=2024-09-12T03:11:16.513565+0000, chain.objs.size()=1 2024-09-12T01:38:00.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.235+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.HgnEPFeZ3de00EA9Hl7kP-RJDkpYz-M_0 2024-09-12T01:38:00.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.235+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14390166299970030569', time=2024-09-12T03:11:16.642480+0000, chain.objs.size()=1 2024-09-12T01:38:00.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.235+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.XQI9CK_wxia-t9PNtAiMVmU2LkqDHSx_0 2024-09-12T01:38:00.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.235+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6364711756838183464', time=2024-09-12T03:11:16.771922+0000, chain.objs.size()=1 2024-09-12T01:38:00.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.235+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.mX75Q4DL_uVfYzS0WfnM6fpAkwUNTl1_0 2024-09-12T01:38:00.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.235+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1421812734140907743', time=2024-09-12T03:11:17.955921+0000, chain.objs.size()=1 2024-09-12T01:38:00.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.235+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.GOI8OYCZQxknXa5ltWTDjGvI6k-iUMf_0 2024-09-12T01:38:00.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.235+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3626460334715729671', time=2024-09-12T03:11:17.990641+0000, chain.objs.size()=1 2024-09-12T01:38:00.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.235+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.6iGdi5lT3RtIjQ1TZgnkQ3-W79O6MI0_0 2024-09-12T01:38:00.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.235+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17095955581252825915', time=2024-09-12T03:11:18.185836+0000, chain.objs.size()=1 2024-09-12T01:38:00.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.235+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.0lUMWfQTIlg0mnMOUSZFMU6GhfVF9pN_0 2024-09-12T01:38:00.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.235+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8650247564750757198', time=2024-09-12T03:11:18.421700+0000, chain.objs.size()=1 2024-09-12T01:38:00.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.235+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.6PhkEgyy7phih3EByXfV8L5cohj9VW-_0 2024-09-12T01:38:00.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.235+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2397094760604484163', time=2024-09-12T03:11:18.854343+0000, chain.objs.size()=1 2024-09-12T01:38:00.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.235+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.EuD-uMpA1eGiZzCBPpwvlYgRB2KL7t7_0 2024-09-12T01:38:00.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.235+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1133835246971468395', time=2024-09-12T03:11:19.257357+0000, chain.objs.size()=1 2024-09-12T01:38:00.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.235+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_._xgJ8LTcKJ9dnbmjiH7RlFsqGmcI677_0 2024-09-12T01:38:00.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.235+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6653834512441793101', time=2024-09-12T03:11:19.258035+0000, chain.objs.size()=1 2024-09-12T01:38:00.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.235+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.xdnhN1t-VIyMS0hijAKy8dkKW6RjsGg_0 2024-09-12T01:38:00.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.236+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7346114355015720839', time=2024-09-12T03:11:19.258800+0000, chain.objs.size()=1 2024-09-12T01:38:00.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.236+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.XTna0AH3ZasM4kNab_0bXFPXJyfP5vR_0 2024-09-12T01:38:00.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.237+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.591363972995272498', time=2024-09-12T03:11:19.520404+0000, chain.objs.size()=1 2024-09-12T01:38:00.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.237+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.y0HMugQ4abC6JyjA_1_ZXhTfE4UAZLI_0 2024-09-12T01:38:00.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.237+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14967557578446988279', time=2024-09-12T03:11:19.800229+0000, chain.objs.size()=1 2024-09-12T01:38:00.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.237+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.ngC91EiGJlgixusrcnKJDSSQsaT3jMD_0 2024-09-12T01:38:00.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.237+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13760961298800125344', time=2024-09-12T03:11:19.822867+0000, chain.objs.size()=1 2024-09-12T01:38:00.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.237+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Vzh-OT5NyAfUBOwQbt3FmOx5TFn7PeD_0 2024-09-12T01:38:00.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.237+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10260395940453779407', time=2024-09-12T03:11:20.184461+0000, chain.objs.size()=1 2024-09-12T01:38:00.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.237+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.LBaO8yzdvEd5VKxbxEFimSktdpgKn23_0 2024-09-12T01:38:00.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.237+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.97380104572609000', time=2024-09-12T03:11:20.416031+0000, chain.objs.size()=1 2024-09-12T01:38:00.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.237+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.UoMBgX1rss_c4Vcr0ne3DDuGN5ztHsy_0 2024-09-12T01:38:00.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.237+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11412471377663995850', time=2024-09-12T03:11:20.533803+0000, chain.objs.size()=1 2024-09-12T01:38:00.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.237+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.BzYE8T42DBxx3xm1LxCrrvmoXw89EoT_0 2024-09-12T01:38:00.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.238+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13352631701435883522', time=2024-09-12T03:11:21.132683+0000, chain.objs.size()=1 2024-09-12T01:38:00.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.238+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.32sza842Ix7e8-4zt9OJHqVj9YPmI13_0 2024-09-12T01:38:00.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.238+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3915013528101660583', time=2024-09-12T03:11:21.192501+0000, chain.objs.size()=1 2024-09-12T01:38:00.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.238+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.5UMh3LnvnVwx02rywABtLgpBopi8UiA_0 2024-09-12T01:38:00.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.238+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5336364734330195479', time=2024-09-12T03:11:21.652652+0000, chain.objs.size()=1 2024-09-12T01:38:00.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.238+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.H3guq9nTjagzs6BNc8moLvecxGUAYlU_0 2024-09-12T01:38:00.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.238+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11842720993193454624', time=2024-09-12T03:11:21.832305+0000, chain.objs.size()=1 2024-09-12T01:38:00.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.238+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.V1iLkOwvhuEWSbk-V3t2vWgvti6GKzh_0 2024-09-12T01:38:00.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.238+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6187197022164334853', time=2024-09-12T03:11:21.850885+0000, chain.objs.size()=1 2024-09-12T01:38:00.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.238+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.qVC_n_FcBcaoauuIXjCBgE4VjPYiKNf_0 2024-09-12T01:38:00.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.239+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13171355518785865642', time=2024-09-12T03:11:21.946223+0000, chain.objs.size()=1 2024-09-12T01:38:00.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.239+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.0GEdK3GcTmnUFGh3Jn1ikVpuu7nn1e0_0 2024-09-12T01:38:00.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.239+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4394581765005041260', time=2024-09-12T03:11:22.001512+0000, chain.objs.size()=1 2024-09-12T01:38:00.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.239+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.KFNDfHg_qxxwkWSu0ZEwknlB6oFsNkw_0 2024-09-12T01:38:00.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.239+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4862954996146259384', time=2024-09-12T03:11:22.081387+0000, chain.objs.size()=1 2024-09-12T01:38:00.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.239+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.-FG64IE1LF4BvO9BF83GswOnIaowtQA_0 2024-09-12T01:38:00.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.239+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4164903930789563371', time=2024-09-12T03:11:22.413936+0000, chain.objs.size()=1 2024-09-12T01:38:00.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.239+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.6YMar2vHnkJTuwmKjT7-nmD3yEak7Lv_0 2024-09-12T01:38:00.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.239+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3569867762084465543', time=2024-09-12T03:11:22.444552+0000, chain.objs.size()=1 2024-09-12T01:38:00.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.239+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.3FYky_zycHTP4ZMlqsgZHmZeTwOEI-Q_0 2024-09-12T01:38:00.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.239+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11225821910507668761', time=2024-09-12T03:11:22.521421+0000, chain.objs.size()=1 2024-09-12T01:38:00.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.239+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.q4qrKcKrnnOhgp5IjHjenoMPQM4Mijf_0 2024-09-12T01:38:00.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.239+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11900597670163158685', time=2024-09-12T03:11:22.827494+0000, chain.objs.size()=1 2024-09-12T01:38:00.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.239+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.qRzXP22rk6lQyWPnFgHeSsBFEH_qZCK_0 2024-09-12T01:38:00.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.239+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11354045606303413801', time=2024-09-12T03:11:22.848924+0000, chain.objs.size()=1 2024-09-12T01:38:00.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.239+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.eGH1AoNXWvMbSHH6AS6KdH6X2fgRQmq_0 2024-09-12T01:38:00.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.240+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18122164863697255143', time=2024-09-12T03:11:22.849733+0000, chain.objs.size()=1 2024-09-12T01:38:00.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.240+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Dk0V3l9fHb-kYbBSBSsN0zriuIqqeHR_0 2024-09-12T01:38:00.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.240+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.821667876607848901', time=2024-09-12T03:11:22.884131+0000, chain.objs.size()=1 2024-09-12T01:38:00.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.240+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Uw-dcyeF6NeG7QEyUK6UIA-yxqFal2N_0 2024-09-12T01:38:00.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.240+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4594764496546938047', time=2024-09-12T03:11:22.885422+0000, chain.objs.size()=1 2024-09-12T01:38:00.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.240+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.yWwMxHsM36uYQDF5KSt6sgUqr1scrLu_0 2024-09-12T01:38:00.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.241+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12070046702375117154', time=2024-09-12T03:11:23.147250+0000, chain.objs.size()=1 2024-09-12T01:38:00.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.241+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.lzn7wuzqdNqYeIvgJdxp1AR8Wo0WbjX_0 2024-09-12T01:38:00.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.241+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12792367022542702580', time=2024-09-12T03:11:23.165605+0000, chain.objs.size()=1 2024-09-12T01:38:00.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.241+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.358kdpC1PzZVH5bnby4m8UqO4_bJ9yo_0 2024-09-12T01:38:00.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.241+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16979068312714125709', time=2024-09-12T03:11:23.379743+0000, chain.objs.size()=1 2024-09-12T01:38:00.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.241+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.XanyIcbOyBSklKCLZWPCFMaYdY45BjC_0 2024-09-12T01:38:00.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.241+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8133989177378080514', time=2024-09-12T03:11:23.532846+0000, chain.objs.size()=1 2024-09-12T01:38:00.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.241+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.l8ikenAFmYVb1qlAFH5JqWDTm1rin2Y_0 2024-09-12T01:38:00.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.242+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18196623849818404957', time=2024-09-12T03:11:23.535302+0000, chain.objs.size()=1 2024-09-12T01:38:00.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.242+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.x1M8J9bpuhzSjOE1KJW2w8-S1fxiMYc_0 2024-09-12T01:38:00.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.242+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2695181891774603082', time=2024-09-12T03:11:23.654919+0000, chain.objs.size()=1 2024-09-12T01:38:00.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.242+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.xK3NQXdCoelpi8VCrf2778HVmLlouOb_0 2024-09-12T01:38:00.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.242+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13130344709074905101', time=2024-09-12T03:11:23.745207+0000, chain.objs.size()=1 2024-09-12T01:38:00.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.242+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.qLnFcqQDOml8bwMm3RHgFExmH8irdX0_0 2024-09-12T01:38:00.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.242+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3941204366318028845', time=2024-09-12T03:11:24.374256+0000, chain.objs.size()=1 2024-09-12T01:38:00.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.242+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.b8L70tXnImhumwNU816hMRVZBcJJMO4_0 2024-09-12T01:38:00.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.242+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12779953656020934623', time=2024-09-12T03:11:24.496568+0000, chain.objs.size()=1 2024-09-12T01:38:00.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.242+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.BiQmLyV4vRvXrYzmd7dDMATFOHuB0lP_0 2024-09-12T01:38:00.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.242+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13301025004229156985', time=2024-09-12T03:11:24.603698+0000, chain.objs.size()=1 2024-09-12T01:38:00.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.242+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.jbuAuc97zaCatQiE1Swbvgw-v3DxuYz_0 2024-09-12T01:38:00.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.242+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8231958356357484197', time=2024-09-12T03:11:31.459069+0000, chain.objs.size()=1 2024-09-12T01:38:00.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.242+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.269__shadow_.Bvz2LRrG1nBMl61uinfFeOIS69AYxwH_0 2024-09-12T01:38:00.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.243+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.340419482594933348', time=2024-09-12T03:11:48.919291+0000, chain.objs.size()=1 2024-09-12T01:38:00.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.243+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.287__shadow_.1MlA6HkThfrPpxSn9-kdVkfngeAvu6m_0 2024-09-12T01:38:00.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.244+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14401776387504802099', time=2024-09-12T03:11:57.482688+0000, chain.objs.size()=1 2024-09-12T01:38:00.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.244+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.293__shadow_.IJXe7Q6q9QTXuOzLUBysaL1SFiB1ufy_0 2024-09-12T01:38:00.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.244+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16387245373774520792', time=2024-09-12T03:13:06.816138+0000, chain.objs.size()=1 2024-09-12T01:38:00.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.244+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.1ox5CQJEPiPIbwaqXgI6mUZRURc9Ts6_0 2024-09-12T01:38:00.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.244+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16512065343629555491', time=2024-09-12T03:13:07.300741+0000, chain.objs.size()=1 2024-09-12T01:38:00.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.244+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.FJOzg-iJq8-dbBJBJ1EbR5dtVKG2M8W_0 2024-09-12T01:38:00.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.244+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11789846748876763978', time=2024-09-12T03:13:07.397196+0000, chain.objs.size()=1 2024-09-12T01:38:00.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.244+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.bJUvHHHzUZWGz3sY8UPPidfUmAxxtZp_0 2024-09-12T01:38:00.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.244+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3182946467887464409', time=2024-09-12T03:13:08.274523+0000, chain.objs.size()=1 2024-09-12T01:38:00.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.244+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.pKtQjFUYWMXocp6Bus18MewV2yFcSJn_0 2024-09-12T01:38:00.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.244+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16070283856826824353', time=2024-09-12T03:13:08.411151+0000, chain.objs.size()=1 2024-09-12T01:38:00.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.244+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.NFYjripyN0t9LKNEQBM49Vs5zp5o4bR_0 2024-09-12T01:38:00.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.245+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13771599741164884794', time=2024-09-12T03:13:08.501953+0000, chain.objs.size()=1 2024-09-12T01:38:00.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.245+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.pIHdXv_I9fXvW3xxH3r3DbZzbkm9XSI_0 2024-09-12T01:38:00.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.245+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3795417177003830552', time=2024-09-12T03:13:09.042957+0000, chain.objs.size()=1 2024-09-12T01:38:00.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.245+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.HiZG_cMnjK1B1yqh2B8YnrY3Hfe0tdo_0 2024-09-12T01:38:00.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.245+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3777381750933276054', time=2024-09-12T03:13:09.987356+0000, chain.objs.size()=1 2024-09-12T01:38:00.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.245+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.GHmdxX_oojwghns0eMa8LHVab6H5pqr_0 2024-09-12T01:38:00.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.245+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1126223889032935816', time=2024-09-12T03:13:10.016975+0000, chain.objs.size()=1 2024-09-12T01:38:00.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.245+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.nMEnakKcJ9FF3JDPX9Do1sut3yNs0JY_0 2024-09-12T01:38:00.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.245+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13077649370873470238', time=2024-09-12T03:13:10.164094+0000, chain.objs.size()=1 2024-09-12T01:38:00.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.245+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.3dhEIAlOjNE-8gc_2Pca3-vw5DSuT--_0 2024-09-12T01:38:00.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.245+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6834145202510596746', time=2024-09-12T03:13:10.325687+0000, chain.objs.size()=1 2024-09-12T01:38:00.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.245+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.OWzSvpKN_HzbBnUK7wLKETLiXi8Bn94_0 2024-09-12T01:38:00.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.245+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4992794454102922030', time=2024-09-12T03:13:10.399532+0000, chain.objs.size()=1 2024-09-12T01:38:00.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.245+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.ncu2m0C6fjOwtOjzt0893ldRSFwB41f_0 2024-09-12T01:38:00.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.246+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17718126004450866206', time=2024-09-12T03:13:10.579683+0000, chain.objs.size()=1 2024-09-12T01:38:00.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.246+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.z2vosI_5pssoTGomDp_2iQrV9LF9K4n_0 2024-09-12T01:38:00.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.246+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4800843169107911537', time=2024-09-12T03:13:11.133031+0000, chain.objs.size()=1 2024-09-12T01:38:00.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.247+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.kgUgpP1-4spPpoJyLfCbNfvWBQYPnhF_0 2024-09-12T01:38:00.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.247+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2185962708089733481', time=2024-09-12T03:13:11.304266+0000, chain.objs.size()=1 2024-09-12T01:38:00.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.247+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.Z4KwLUMrOgAxY0yJ1ir01qawsjGvvxT_0 2024-09-12T01:38:00.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.247+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11479204294962415637', time=2024-09-12T03:13:11.346299+0000, chain.objs.size()=1 2024-09-12T01:38:00.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.247+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.nyuUqT3TNg3TVIvaD-1hkkhqRrVItPy_0 2024-09-12T01:38:00.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.247+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6574325309635016557', time=2024-09-12T03:13:11.403620+0000, chain.objs.size()=1 2024-09-12T01:38:00.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.247+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.XQl5uHg1tayG5IwQyz-QFJscVjNmgoe_0 2024-09-12T01:38:00.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.248+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14164205428258838054', time=2024-09-12T03:13:11.467157+0000, chain.objs.size()=1 2024-09-12T01:38:00.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.248+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.eYaQEoP_-sxS7DOeLIXiucYvlYSXrHn_0 2024-09-12T01:38:00.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.248+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8901605290073282132', time=2024-09-12T03:13:11.485355+0000, chain.objs.size()=1 2024-09-12T01:38:00.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.248+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.HRoYSO_qjPRugnSSubxSY-sM75Zf7L3_0 2024-09-12T01:38:00.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.248+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2109120037268111020', time=2024-09-12T03:13:11.593456+0000, chain.objs.size()=1 2024-09-12T01:38:00.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.248+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.xx3fB7bX8Y9-Pfjgo4T-_TMsmOgjOdn_0 2024-09-12T01:38:00.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.248+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17229432939337096287', time=2024-09-12T03:13:12.712641+0000, chain.objs.size()=1 2024-09-12T01:38:00.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.248+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.-JxWTO5DzKJsMtgb5Slh1yTMaYKN-36_0 2024-09-12T01:38:00.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.248+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5754357536120909996', time=2024-09-12T03:13:13.211997+0000, chain.objs.size()=1 2024-09-12T01:38:00.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.248+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.OTB6DUQa2Qwr-zre-fdwcB2EVJt9g1-_0 2024-09-12T01:38:00.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.248+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10565175067438447563', time=2024-09-12T03:13:13.216965+0000, chain.objs.size()=1 2024-09-12T01:38:00.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.248+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.0cylZW8E-TvqGechPuC8xgEjtfuV7-N_0 2024-09-12T01:38:00.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.248+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5596585812502919669', time=2024-09-12T03:13:13.362864+0000, chain.objs.size()=1 2024-09-12T01:38:00.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.248+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.x7MTvuzaqJeM8xPQpl2Smkd7LV2ez7P_0 2024-09-12T01:38:00.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.248+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2378002553855942047', time=2024-09-12T03:13:13.845185+0000, chain.objs.size()=1 2024-09-12T01:38:00.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.248+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.zj_zmFauhgAZVO45Hbcub08VdN34iEf_0 2024-09-12T01:38:00.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.249+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1736725847043890225', time=2024-09-12T03:13:14.606820+0000, chain.objs.size()=1 2024-09-12T01:38:00.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.249+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.JcjxoVvYkxub2kJ-UVKGtK65Ahb3pcU_0 2024-09-12T01:38:00.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.249+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10573715979538113422', time=2024-09-12T03:13:15.184552+0000, chain.objs.size()=1 2024-09-12T01:38:00.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.249+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.UmfhfBqG6dxspLjmLN-3L3KL2HebdWm_0 2024-09-12T01:38:00.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.249+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2618702685404667677', time=2024-09-12T03:13:15.434761+0000, chain.objs.size()=1 2024-09-12T01:38:00.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.249+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.enbym2tMLgNZF7FNUENzXY29GdwedgD_0 2024-09-12T01:38:00.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.250+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2494059476311936214', time=2024-09-12T03:13:15.830869+0000, chain.objs.size()=1 2024-09-12T01:38:00.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.250+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.BEjanD3ItixTV3eooHqDzom5h8pgAj__0 2024-09-12T01:38:00.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.250+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17732804908788184562', time=2024-09-12T03:13:16.066591+0000, chain.objs.size()=1 2024-09-12T01:38:00.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.250+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.imXOXsA_yD8El5bOH5oXwJ9BJXIpF3y_0 2024-09-12T01:38:00.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.250+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8452966359726101731', time=2024-09-12T03:13:16.379013+0000, chain.objs.size()=1 2024-09-12T01:38:00.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.250+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.bY6DhwkyZNBwzj21vYNOi0fKSzbhF1y_0 2024-09-12T01:38:00.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.250+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13233449605322971256', time=2024-09-12T03:13:16.473133+0000, chain.objs.size()=1 2024-09-12T01:38:00.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.250+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.li96K9A82KsgnKJwFDxtGRVnQ_-yUus_0 2024-09-12T01:38:00.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.250+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15126737673664648643', time=2024-09-12T03:13:16.493248+0000, chain.objs.size()=1 2024-09-12T01:38:00.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.250+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.i3DAJYwgA60aPiwqjuwvV2mGSldnzL0_0 2024-09-12T01:38:00.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.250+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9386920336974298186', time=2024-09-12T03:13:16.661749+0000, chain.objs.size()=1 2024-09-12T01:38:00.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.250+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.h61EkP8Zn2EmyEFXsc54cXYRQSSV5Pf_0 2024-09-12T01:38:00.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.250+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11276705640949356971', time=2024-09-12T03:13:17.075731+0000, chain.objs.size()=1 2024-09-12T01:38:00.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.250+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.CMUu77T5chVoWpL5M_JvhDb5b467WTj_0 2024-09-12T01:38:00.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.250+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17142055389360077107', time=2024-09-12T03:13:53.579528+0000, chain.objs.size()=1 2024-09-12T01:38:00.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.250+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.tVhA79QyuASiGJm4QQ7ku346ed56VKg_0 2024-09-12T01:38:00.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.251+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3249512872295742676', time=2024-09-12T03:13:53.648220+0000, chain.objs.size()=1 2024-09-12T01:38:00.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.251+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.teJqrg9MxtB77GYbpTNYtj0tpLfDnCY_0 2024-09-12T01:38:00.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.251+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14887279115207891281', time=2024-09-12T03:13:54.352948+0000, chain.objs.size()=1 2024-09-12T01:38:00.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.251+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.GwRT692VQgfOChXuqILrGtzxuFVj6rh_0 2024-09-12T01:38:00.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.251+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.824694668974014164', time=2024-09-12T03:13:54.451147+0000, chain.objs.size()=1 2024-09-12T01:38:00.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.251+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.aqjhKIHS-5w2a4wphwzLeLl0QFDLM9H_0 2024-09-12T01:38:00.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.257+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10375182268496666658', time=2024-09-12T03:13:55.096952+0000, chain.objs.size()=1 2024-09-12T01:38:00.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.257+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.q_tSg0UQurnQMvpudd_eNC1pVj9b69K_0 2024-09-12T01:38:00.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.257+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3199398251961360016', time=2024-09-12T03:13:55.539758+0000, chain.objs.size()=1 2024-09-12T01:38:00.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.257+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.9jidsTt0VuY7RzB0JE-oIpRiaUHUTZp_0 2024-09-12T01:38:00.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.257+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1592016883347203208', time=2024-09-12T03:13:55.585398+0000, chain.objs.size()=1 2024-09-12T01:38:00.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.257+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.xP-3FQiyLgRQWOco5m38nJE66Pgvjrg_0 2024-09-12T01:38:00.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.257+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13916444673852787119', time=2024-09-12T03:13:56.505162+0000, chain.objs.size()=1 2024-09-12T01:38:00.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.257+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.DoQK33hLMV3r7YZYBaNfywvVIlNBoBV_0 2024-09-12T01:38:00.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.259+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 0/49715 2024-09-12T01:38:00.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.261+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=42, truncated=0, next_marker='' 2024-09-12T01:38:00.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.261+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15973721105959180742', time=2024-09-12T03:13:56.598341+0000, chain.objs.size()=1 2024-09-12T01:38:00.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.261+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.cTOzCkIPORpDFDBK78CxNcvaxcC1-Am_0 2024-09-12T01:38:00.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.261+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.447454725582313575', time=2024-09-12T03:13:56.879210+0000, chain.objs.size()=1 2024-09-12T01:38:00.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.261+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.HUl0n8m4LhWVgcTby3yjdrrrZ4kSUVa_0 2024-09-12T01:38:00.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.262+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9206761477335005287', time=2024-09-12T03:13:57.024587+0000, chain.objs.size()=1 2024-09-12T01:38:00.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.262+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.i1Mn-NCVr2ndpGsvgaAH4rD7X5Lqe_3_0 2024-09-12T01:38:00.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.262+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17136756831427047745', time=2024-09-12T03:13:57.025306+0000, chain.objs.size()=1 2024-09-12T01:38:00.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.262+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.0AuY_pLnc-jgTCVDHfCb6l9Ig-Gp0rK_0 2024-09-12T01:38:00.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.262+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2843122646083215095', time=2024-09-12T03:13:57.062201+0000, chain.objs.size()=1 2024-09-12T01:38:00.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.262+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.jMxsrMNSaGDVBG-BkJ5FKlI5hojqXNG_0 2024-09-12T01:38:00.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.262+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12759012936717361049', time=2024-09-12T03:13:57.103406+0000, chain.objs.size()=1 2024-09-12T01:38:00.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.262+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.YaWjetY2Oh4on0GbyPw2H600xzWCtgZ_0 2024-09-12T01:38:00.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.262+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1215512579120714099', time=2024-09-12T03:13:57.236077+0000, chain.objs.size()=1 2024-09-12T01:38:00.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.262+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.TErQBtPUQszPhSIQukzTvY4xP33biEv_0 2024-09-12T01:38:00.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.262+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6911540566933839617', time=2024-09-12T03:13:57.359926+0000, chain.objs.size()=1 2024-09-12T01:38:00.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.262+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.4KQ3EiKSzEuxNO0BA4ayupajMfzzi55_0 2024-09-12T01:38:00.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.262+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10977960756160439170', time=2024-09-12T03:13:58.285538+0000, chain.objs.size()=1 2024-09-12T01:38:00.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.262+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.xTpUbviZUr3_pDtZ2BMQIhkdtISMl-E_0 2024-09-12T01:38:00.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.262+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2578870904982499038', time=2024-09-12T03:13:58.554377+0000, chain.objs.size()=1 2024-09-12T01:38:00.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.262+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.SnT3Ufj2T8ohPKDvNmpkzk5rJymkHlb_0 2024-09-12T01:38:00.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.262+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7518466505042739495', time=2024-09-12T03:13:59.889259+0000, chain.objs.size()=1 2024-09-12T01:38:00.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.262+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.9EpHIj7cuvdz-gTgvC2R2knf27OhAQu_0 2024-09-12T01:38:00.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.262+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3527918198320431070', time=2024-09-12T03:13:59.956815+0000, chain.objs.size()=1 2024-09-12T01:38:00.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.262+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.0iPS3VUbDkHu0uAm7oRfuTKwPgolb-s_0 2024-09-12T01:38:00.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.263+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10155108374137660023', time=2024-09-12T03:14:00.020879+0000, chain.objs.size()=1 2024-09-12T01:38:00.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.263+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.zSAZRPkPc7_Ohf8qkXm8703HF-ytjzR_0 2024-09-12T01:38:00.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.264+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16003449152301916466', time=2024-09-12T03:14:00.567614+0000, chain.objs.size()=1 2024-09-12T01:38:00.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.264+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Yb5sd8dWmItSN3dofTQXS0n5XjUZucN_0 2024-09-12T01:38:00.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.264+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.435767894971353637', time=2024-09-12T03:14:00.999288+0000, chain.objs.size()=1 2024-09-12T01:38:00.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.264+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.hIDeoXKXuCX0sfrtQU78CbJo4EPS-0f_0 2024-09-12T01:38:00.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.264+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1412188485372652468', time=2024-09-12T03:14:01.000239+0000, chain.objs.size()=1 2024-09-12T01:38:00.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.264+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.H1LdcKdTRXrhNEvllNjppaAnawCWJ2k_0 2024-09-12T01:38:00.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.264+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15414145912151475404', time=2024-09-12T03:14:01.136398+0000, chain.objs.size()=1 2024-09-12T01:38:00.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.264+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.OQK48YAH0DVZSZK1qQh7dDAw7T1kSRm_0 2024-09-12T01:38:00.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.264+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11307083432881685534', time=2024-09-12T03:14:01.241778+0000, chain.objs.size()=1 2024-09-12T01:38:00.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.264+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.3e6O3s2G0Ewg8YpC5ySbCRIFRAu79t5_0 2024-09-12T01:38:00.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.264+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11117000554885919897', time=2024-09-12T03:14:01.706885+0000, chain.objs.size()=1 2024-09-12T01:38:00.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.264+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.ienGva6181G2BMQjythuugyjMo-PczB_0 2024-09-12T01:38:00.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.264+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15993371095885400072', time=2024-09-12T03:14:01.725816+0000, chain.objs.size()=1 2024-09-12T01:38:00.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.264+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.1tqtcw9OnnYeyvshxVuGnJVV9wgdV0q_0 2024-09-12T01:38:00.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.264+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9982015869034418293', time=2024-09-12T03:14:01.804293+0000, chain.objs.size()=1 2024-09-12T01:38:00.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.264+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.oo9wiVDO7BAd8vWu6rYmMETMDcMRFCj_0 2024-09-12T01:38:00.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.264+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3951207584491241836', time=2024-09-12T03:14:02.230844+0000, chain.objs.size()=1 2024-09-12T01:38:00.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.264+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.BBjR6oMlTFKqZi6QXRhnJknDsAOabEv_0 2024-09-12T01:38:00.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.265+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3900335545042036564', time=2024-09-12T03:14:02.231650+0000, chain.objs.size()=1 2024-09-12T01:38:00.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.265+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.DYz-V65fh8tePS6IsYkhXJKNCLPiKXh_0 2024-09-12T01:38:00.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.265+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12305707543720537724', time=2024-09-12T03:14:02.287634+0000, chain.objs.size()=1 2024-09-12T01:38:00.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.265+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.9SAjuZX30T2nD70VUNG9uX-BlTN0jzT_0 2024-09-12T01:38:00.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.265+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15471615012862704142', time=2024-09-12T03:14:02.536005+0000, chain.objs.size()=1 2024-09-12T01:38:00.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.265+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.024KAJ6AzQG2oMyxMncdDVFQruRdusd_0 2024-09-12T01:38:00.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.266+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.591045608200598895', time=2024-09-12T03:14:02.617360+0000, chain.objs.size()=1 2024-09-12T01:38:00.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.266+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.GEJ-nZNzE1Z8RU9mbNb8mpwXrWkcjYh_0 2024-09-12T01:38:00.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.266+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1908198803942898904', time=2024-09-12T03:14:03.462634+0000, chain.objs.size()=1 2024-09-12T01:38:00.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.266+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Sru1xngpQP2FmmD_MJIQW3124-WJNr__0 2024-09-12T01:38:00.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.266+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5197715716262163968', time=2024-09-12T03:14:15.454775+0000, chain.objs.size()=1 2024-09-12T01:38:00.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.266+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.337__shadow_.1lkNDTCv-iIQRppZt7o-uINFejZGEDI_0 2024-09-12T01:38:00.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.266+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15872365475532710650', time=2024-09-12T03:14:56.108078+0000, chain.objs.size()=1 2024-09-12T01:38:00.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.266+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.382__shadow_.7XomV0tLNj9msXSkjGfpQ5roy2g0Gvs_0 2024-09-12T01:38:00.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.266+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18172803920822297639', time=2024-09-12T03:16:09.745510+0000, chain.objs.size()=1 2024-09-12T01:38:00.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.266+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.456__shadow_.TGxzjyblCp9m4FF5xM-ifn1w31Gxdyc_0 2024-09-12T01:38:00.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.269+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10622922694663429495', time=2024-09-12T03:16:43.312653+0000, chain.objs.size()=1 2024-09-12T01:38:00.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.269+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.489__shadow_._cFq37b0gObn6EHCAiGrRkQI9mTlAB4_0 2024-09-12T01:38:00.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.269+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4022880205954476520', time=2024-09-12T03:16:55.870346+0000, chain.objs.size()=1 2024-09-12T01:38:00.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.269+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.503__shadow:zjHxI5MExGDTEMgC.YI1-B-Wp2XBZjW_.xteVVbi5oDy4c1uLu1Qcooxbp-bOuaB_0 2024-09-12T01:38:00.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.269+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5432155692862484549', time=2024-09-12T03:17:25.162171+0000, chain.objs.size()=6 2024-09-12T01:38:00.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.269+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.507__multipart_srcmultipart.2~ckyMCV3hbT7G8qDArZScZPf4n-CghR1.1 2024-09-12T01:38:00.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.269+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.507__multipart_srcmultipart.2~ckyMCV3hbT7G8qDArZScZPf4n-CghR1.2 2024-09-12T01:38:00.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.269+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.507__multipart_srcmultipart.2~ckyMCV3hbT7G8qDArZScZPf4n-CghR1.3 2024-09-12T01:38:00.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.272+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.507__multipart_srcmultipart.2~ckyMCV3hbT7G8qDArZScZPf4n-CghR1.4 2024-09-12T01:38:00.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.272+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.507__multipart_srcmultipart.2~ckyMCV3hbT7G8qDArZScZPf4n-CghR1.5 2024-09-12T01:38:00.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.272+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.507__multipart_srcmultipart.2~ckyMCV3hbT7G8qDArZScZPf4n-CghR1.6 2024-09-12T01:38:00.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.272+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12582679307965225585', time=2024-09-12T03:17:33.184949+0000, chain.objs.size()=1 2024-09-12T01:38:00.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.272+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.515__shadow_.q_c43F520uPaWZ9G7JBV4OQPjW7yJLr_0 2024-09-12T01:38:00.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.272+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1572089200137372836', time=2024-09-12T03:20:10.014967+0000, chain.objs.size()=6 2024-09-12T01:38:00.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.272+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.522__multipart_mymultipart.2~CGHhLUVGb2O1P-a_mdyQRsEPFgV_65A.1 2024-09-12T01:38:00.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.272+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.522__multipart_mymultipart.Fm4x5TDoUynaMraxGh9nECiIrHNtXn5X.2 2024-09-12T01:38:00.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.272+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.522__multipart_mymultipart.mokfPhrMiTGvaX6RIjiG6q4VxStz2U7Z.3 2024-09-12T01:38:00.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.272+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.522__multipart_mymultipart.2~CGHhLUVGb2O1P-a_mdyQRsEPFgV_65A.4 2024-09-12T01:38:00.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.272+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.522__multipart_mymultipart.2~CGHhLUVGb2O1P-a_mdyQRsEPFgV_65A.5 2024-09-12T01:38:00.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.272+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.522__multipart_mymultipart.2~CGHhLUVGb2O1P-a_mdyQRsEPFgV_65A.6 2024-09-12T01:38:00.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.272+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9580060987177764064', time=2024-09-12T03:22:38.810876+0000, chain.objs.size()=1 2024-09-12T01:38:00.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.272+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.556__shadow_.02in0mj3Gp51vWaEhnSqgBGMU476jpJ_0 2024-09-12T01:38:00.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.273+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13132760580512167312', time=2024-09-12T03:23:35.061346+0000, chain.objs.size()=1 2024-09-12T01:38:00.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.273+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.576__shadow:Yy82OnZV5a4etMOHiJGo6uM49LwLcYh_.Es19H4bhnd4ogLgpBw05AKrBldJvM2X_0 2024-09-12T01:38:00.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.274+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2597884178204373880', time=2024-09-12T03:24:47.966227+0000, chain.objs.size()=1 2024-09-12T01:38:00.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.274+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.587__shadow:4hdzNxBeOXkh.7uaANv-VO.vpn03Q7S_.TsSRu7hysNrTlYuuyXej-voGob_5axY_0 2024-09-12T01:38:00.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.274+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7381563602413156302', time=2024-09-12T03:26:52.602182+0000, chain.objs.size()=6 2024-09-12T01:38:00.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.274+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.615__multipart_multipart_enc.2~GquGicz3v5ok8LfM6x5vy43ulpTe7_9.1 2024-09-12T01:38:00.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.274+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.615__multipart_multipart_enc.2~GquGicz3v5ok8LfM6x5vy43ulpTe7_9.2 2024-09-12T01:38:00.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.274+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.615__multipart_multipart_enc.2~GquGicz3v5ok8LfM6x5vy43ulpTe7_9.3 2024-09-12T01:38:00.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.277+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.615__multipart_multipart_enc.2~GquGicz3v5ok8LfM6x5vy43ulpTe7_9.4 2024-09-12T01:38:00.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.277+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.615__multipart_multipart_enc.2~GquGicz3v5ok8LfM6x5vy43ulpTe7_9.5 2024-09-12T01:38:00.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.277+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.615__multipart_multipart_enc.2~GquGicz3v5ok8LfM6x5vy43ulpTe7_9.6 2024-09-12T01:38:00.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.277+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='2~ysQBrhl51pXNHqjwWgApYEkVAI48fKB', time=2024-09-12T03:29:38.980200+0000, chain.objs.size()=6 2024-09-12T01:38:00.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.277+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.624__multipart_multipart_enc.2~ysQBrhl51pXNHqjwWgApYEkVAI48fKB.1 2024-09-12T01:38:00.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.277+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.624__multipart_multipart_enc.2~ysQBrhl51pXNHqjwWgApYEkVAI48fKB.2 2024-09-12T01:38:00.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.277+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.624__multipart_multipart_enc.2~ysQBrhl51pXNHqjwWgApYEkVAI48fKB.3 2024-09-12T01:38:00.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.277+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.624__multipart_multipart_enc.2~ysQBrhl51pXNHqjwWgApYEkVAI48fKB.4 2024-09-12T01:38:00.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.277+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.624__multipart_multipart_enc.2~ysQBrhl51pXNHqjwWgApYEkVAI48fKB.5 2024-09-12T01:38:00.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.279+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.624__multipart_multipart_enc.2~ysQBrhl51pXNHqjwWgApYEkVAI48fKB.6 2024-09-12T01:38:00.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.279+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14704206960748908235', time=2024-09-12T03:29:57.599594+0000, chain.objs.size()=1 2024-09-12T01:38:00.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.279+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.635__shadow_.I0knBtCkrQrIilhmDKfclCBdkV4RbdH_0 2024-09-12T01:38:00.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.280+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11275469960598614929', time=2024-09-12T03:30:59.030376+0000, chain.objs.size()=1 2024-09-12T01:38:00.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.280+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.664__shadow_.PEFaBSTVZzMbHRoUW_B3llEUy1hPLk0_0 2024-09-12T01:38:00.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.285+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:38:00.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.287+0000 7f8786c98800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T01:38:00.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.288+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:38:00.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.289+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:38:00.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.290+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45972' 2024-09-12T01:38:00.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.290+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1143386749161878295', time=2024-09-12T03:07:07.521060+0000, chain.objs.size()=3 2024-09-12T01:38:00.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.290+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.161__multipart_foo-FROZEN.2~R5g5kOpCG8_aVLlnOd8WHBMEBYyoQQJ.1 2024-09-12T01:38:00.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.290+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.161__multipart_foo-FROZEN.2~R5g5kOpCG8_aVLlnOd8WHBMEBYyoQQJ.2 2024-09-12T01:38:00.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.290+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.161__multipart_foo-FROZEN.2~R5g5kOpCG8_aVLlnOd8WHBMEBYyoQQJ.3 2024-09-12T01:38:00.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.290+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3346508784742292264', time=2024-09-12T03:10:20.269867+0000, chain.objs.size()=1 2024-09-12T01:38:00.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.290+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.243__shadow_.QVWl6ncN9wh3aVvyTylR839hOGd_iHW_0 2024-09-12T01:38:00.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.290+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13838786356589059404', time=2024-09-12T03:11:14.597656+0000, chain.objs.size()=1 2024-09-12T01:38:00.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.290+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.bE09GiPmp3hbVYZBhrMk_fXLqApjHOg_0 2024-09-12T01:38:00.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.290+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9366353673594645864', time=2024-09-12T03:11:14.986898+0000, chain.objs.size()=1 2024-09-12T01:38:00.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.290+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.12TyvmgPKtRQE0l1IKGckT0qbKQzzNv_0 2024-09-12T01:38:00.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.290+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5120887588313609223', time=2024-09-12T03:11:15.077254+0000, chain.objs.size()=1 2024-09-12T01:38:00.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.290+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.sZatuAHVP542nL2PrP-XdIqPvz92hiK_0 2024-09-12T01:38:00.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.290+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6463389243744550102', time=2024-09-12T03:11:15.166495+0000, chain.objs.size()=1 2024-09-12T01:38:00.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.290+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.iY3PBa5yN_db-7gjDsWyEm5EnLiJpLi_0 2024-09-12T01:38:00.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.290+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6613638707070302367', time=2024-09-12T03:11:15.337513+0000, chain.objs.size()=1 2024-09-12T01:38:00.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.290+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.VYvHYNEKTw_rIGKmDlBTAXpT3sLq2NC_0 2024-09-12T01:38:00.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.290+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14658641238151852208', time=2024-09-12T03:11:16.012445+0000, chain.objs.size()=1 2024-09-12T01:38:00.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.290+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.KZq1Tfp2ED3HYYy6Bu60-pt7AxYS165_0 2024-09-12T01:38:00.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.290+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7331594962717067223', time=2024-09-12T03:11:16.527428+0000, chain.objs.size()=1 2024-09-12T01:38:00.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.290+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.j1SnXkuqZw47-DzKSrUd-AR5DHTRCAx_0 2024-09-12T01:38:00.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.290+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5871492228924319403', time=2024-09-12T03:11:16.933441+0000, chain.objs.size()=1 2024-09-12T01:38:00.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.290+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.35MJk1LWTaSF49eFxBtvZiwoQi6o2ZR_0 2024-09-12T01:38:00.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.296+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4702488790824719179', time=2024-09-12T03:11:17.554999+0000, chain.objs.size()=1 2024-09-12T01:38:00.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.296+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Wx0uaKQfIqYMXIg0EEepm59gsmNTpy1_0 2024-09-12T01:38:00.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.296+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12550931082176229683', time=2024-09-12T03:11:17.770782+0000, chain.objs.size()=1 2024-09-12T01:38:00.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.296+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Hrl0wAg3JRvK-WFcmhu8qSifH_pIOsn_0 2024-09-12T01:38:00.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.297+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10217561692403076636', time=2024-09-12T03:11:17.924133+0000, chain.objs.size()=1 2024-09-12T01:38:00.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.297+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Q7bVw-81arKGrrvto2FLm_2hnpMmo8y_0 2024-09-12T01:38:00.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.297+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7533827339558939801', time=2024-09-12T03:11:18.442344+0000, chain.objs.size()=1 2024-09-12T01:38:00.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.297+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.FOMtY3L-j_9uMVp2SoZkvoMUg8zmwss_0 2024-09-12T01:38:00.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.297+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5175225571086649152', time=2024-09-12T03:11:18.951688+0000, chain.objs.size()=1 2024-09-12T01:38:00.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.297+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.F6bBQs-zWE-w1lf7UdtOKiEN-_i6PYq_0 2024-09-12T01:38:00.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.297+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7874943570085880799', time=2024-09-12T03:11:18.952323+0000, chain.objs.size()=1 2024-09-12T01:38:00.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.297+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.4ybCDv1tbK9bq_YyyV2eXpaAhflOQ74_0 2024-09-12T01:38:00.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.297+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16538493839278572710', time=2024-09-12T03:11:19.689493+0000, chain.objs.size()=1 2024-09-12T01:38:00.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.297+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.gLcO8bnaQJPoAeV4rnrSnDShphrpaYP_0 2024-09-12T01:38:00.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.297+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3687815902289516332', time=2024-09-12T03:11:21.692621+0000, chain.objs.size()=1 2024-09-12T01:38:00.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.297+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.X423nz5WM_mBx748fDE-CxUG3IY1QXa_0 2024-09-12T01:38:00.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.297+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8217876656863692388', time=2024-09-12T03:11:21.837932+0000, chain.objs.size()=1 2024-09-12T01:38:00.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.297+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.jT0d62oeAoU6Ryes-Duj1487GYfmwRf_0 2024-09-12T01:38:00.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.297+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3533006616891599411', time=2024-09-12T03:11:22.528352+0000, chain.objs.size()=1 2024-09-12T01:38:00.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.297+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.YxwzXjUg5dZmia2FGOynQ7ZCwnj0vJa_0 2024-09-12T01:38:00.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.297+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2689140169834774928', time=2024-09-12T03:11:23.658739+0000, chain.objs.size()=1 2024-09-12T01:38:00.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.297+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.3buPQQEeVIph-L5R4Cu8qcIa-jFNhBW_0 2024-09-12T01:38:00.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.299+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3273657082450271612', time=2024-09-12T03:11:24.898509+0000, chain.objs.size()=1 2024-09-12T01:38:00.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.299+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.nRYJPMqAfDUvH3G_9ml8SMFeG-zy3QE_0 2024-09-12T01:38:00.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.299+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12376409071921359943', time=2024-09-12T03:11:24.904520+0000, chain.objs.size()=1 2024-09-12T01:38:00.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.299+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Celd1zMQyx-0r-k1ubotko03VxUjlo0_0 2024-09-12T01:38:00.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.300+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2444369485537142956', time=2024-09-12T03:11:34.301522+0000, chain.objs.size()=1 2024-09-12T01:38:00.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.300+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.272__shadow_.R9rlZdZlS6R-pHj9I1rigjNlwyUxZF6_0 2024-09-12T01:38:00.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.300+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12989784793563682482', time=2024-09-12T03:11:37.115908+0000, chain.objs.size()=1 2024-09-12T01:38:00.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.300+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.275__shadow_.9Sr0hN2eI9Ao3r3fuVb4laAh_RCKGqj_0 2024-09-12T01:38:00.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.300+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14491719968593275415', time=2024-09-12T03:11:47.962580+0000, chain.objs.size()=1 2024-09-12T01:38:00.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.300+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.286__shadow_.mpi_7hJiWIXgahUzQv8ElZ0EENhdSkY_0 2024-09-12T01:38:00.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.300+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2524427716162266639', time=2024-09-12T03:11:57.602823+0000, chain.objs.size()=1 2024-09-12T01:38:00.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.300+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.293__shadow_.lLZCrByUy_0vFx1QnEvwH1PViyNL7Ki_0 2024-09-12T01:38:00.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.302+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16300403064662923685', time=2024-09-12T03:12:00.544441+0000, chain.objs.size()=1 2024-09-12T01:38:00.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.302+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.296__shadow_.9fWLZfJ86evEiZKo21hQSMrAepNVijk_0 2024-09-12T01:38:00.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.302+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11141007052278882496', time=2024-09-12T03:12:04.659901+0000, chain.objs.size()=1 2024-09-12T01:38:00.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.302+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.300__shadow_.esKCODtgfenHrd4ZbwrXvsznte2UnS8_0 2024-09-12T01:38:00.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.302+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6679904772802726319', time=2024-09-12T03:12:10.724875+0000, chain.objs.size()=1 2024-09-12T01:38:00.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.302+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.306__shadow_.GkF2-jxamnRnHMhteHZt7C1QeP8bgkc_0 2024-09-12T01:38:00.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.302+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8578950143829202021', time=2024-09-12T03:12:28.947584+0000, chain.objs.size()=1 2024-09-12T01:38:00.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.302+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.321__shadow_.Sk1AyyHTDALOgygLWpnGeQEpW6vkPJI_0 2024-09-12T01:38:00.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.302+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6962035563285993514', time=2024-09-12T03:13:07.355704+0000, chain.objs.size()=1 2024-09-12T01:38:00.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.302+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.1AE7B__n0shGITDjTtB-Wru_r5k7L0O_0 2024-09-12T01:38:00.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.302+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16308076259877000399', time=2024-09-12T03:13:07.612350+0000, chain.objs.size()=1 2024-09-12T01:38:00.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.302+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.Q4AyrqajfO7OVXYDiYtkdyOMusfnP8V_0 2024-09-12T01:38:00.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.302+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3122476819413106521', time=2024-09-12T03:13:08.305714+0000, chain.objs.size()=1 2024-09-12T01:38:00.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.302+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.6z19hLTkfJgGATIVaeFzDY07VWK3dUb_0 2024-09-12T01:38:00.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.302+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7825270031312057974', time=2024-09-12T03:13:08.306518+0000, chain.objs.size()=1 2024-09-12T01:38:00.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.302+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.yxtaWaPYjBgAT3fYXyCsmKGcF-lpRE5_0 2024-09-12T01:38:00.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.305+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14057510325720724850', time=2024-09-12T03:13:08.436145+0000, chain.objs.size()=1 2024-09-12T01:38:00.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.305+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.MI8P7QaN1YIyA50wXawrRqOkJUDPmpL_0 2024-09-12T01:38:00.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.305+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4744421075800108814', time=2024-09-12T03:13:08.552595+0000, chain.objs.size()=1 2024-09-12T01:38:00.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.305+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.EGm_3ITsuRgUVQ6rHm6IDbuBGRChsbk_0 2024-09-12T01:38:00.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.305+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14548545160621125762', time=2024-09-12T03:13:08.930545+0000, chain.objs.size()=1 2024-09-12T01:38:00.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.305+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.eOta8r4CBqVcotdUMv_10yXj_eV7P3L_0 2024-09-12T01:38:00.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.305+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14896291575457060492', time=2024-09-12T03:13:09.050537+0000, chain.objs.size()=1 2024-09-12T01:38:00.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.305+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.3p9zPRz0VACYsQaE5ULUAgCxFAtlwhC_0 2024-09-12T01:38:00.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.308+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12809061761932864695', time=2024-09-12T03:13:09.083431+0000, chain.objs.size()=1 2024-09-12T01:38:00.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.308+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.gRfbROkOtUxWjWOI1xbJ1PL0MaQ7S6p_0 2024-09-12T01:38:00.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.308+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1672963650874807871', time=2024-09-12T03:13:09.233378+0000, chain.objs.size()=1 2024-09-12T01:38:00.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.308+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.YywtN2h2v151IdwMQRNkntjq35o0Fpj_0 2024-09-12T01:38:00.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.308+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7250082367475071602', time=2024-09-12T03:13:10.113846+0000, chain.objs.size()=1 2024-09-12T01:38:00.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.308+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.e7KuhZdD7OBRFal8-AcMky8mOQVQtVq_0 2024-09-12T01:38:00.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.308+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9973750938660485629', time=2024-09-12T03:13:10.212382+0000, chain.objs.size()=1 2024-09-12T01:38:00.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.308+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.l5qFP-aMVvOrPLpP4jPCte5kyVlzH_g_0 2024-09-12T01:38:00.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.308+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12393670968328676617', time=2024-09-12T03:13:11.133684+0000, chain.objs.size()=1 2024-09-12T01:38:00.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.308+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.IfkuvhcAyZdRzZgA8AkEmZ_DZTfSOhE_0 2024-09-12T01:38:00.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.308+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1932387510306814000', time=2024-09-12T03:13:11.383931+0000, chain.objs.size()=1 2024-09-12T01:38:00.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.308+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.bHr_r6B4ZNNb52jPsXpbD9otWrdfhdc_0 2024-09-12T01:38:00.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.308+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.719068497671451652', time=2024-09-12T03:13:11.478977+0000, chain.objs.size()=1 2024-09-12T01:38:00.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.308+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.Wxtu0TcoEHUirtjrFj3FT3dDKqnTIoF_0 2024-09-12T01:38:00.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.308+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3917183839304589991', time=2024-09-12T03:13:12.525703+0000, chain.objs.size()=1 2024-09-12T01:38:00.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.308+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.cDMmBOB6fROC8yqIRa7uhvIHsLGMgoq_0 2024-09-12T01:38:00.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.309+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1153062213668437167', time=2024-09-12T03:13:12.678273+0000, chain.objs.size()=1 2024-09-12T01:38:00.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.309+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.znfSK4TXYw63xj2cliJE1SCHkmeizDq_0 2024-09-12T01:38:00.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.309+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7267714160097948873', time=2024-09-12T03:13:12.811876+0000, chain.objs.size()=1 2024-09-12T01:38:00.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.309+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_._5jr6BhzLOaHIl4hxwz5_h-28Cgswb6_0 2024-09-12T01:38:00.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.309+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8081868761555455064', time=2024-09-12T03:13:12.870331+0000, chain.objs.size()=1 2024-09-12T01:38:00.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.309+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.vu4xAjHXaNGSi8NOjXCTR6tZ1JNczFb_0 2024-09-12T01:38:00.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.310+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10510396335967401208', time=2024-09-12T03:13:12.870925+0000, chain.objs.size()=1 2024-09-12T01:38:00.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.310+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.LyLdEtOHiasEr8bvLR_aKyj0iLnZQIR_0 2024-09-12T01:38:00.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.311+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8019284922507506017', time=2024-09-12T03:13:13.222674+0000, chain.objs.size()=1 2024-09-12T01:38:00.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.311+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.8DGqHXNh_jVKxzsKqKpaS9iawdXbWOL_0 2024-09-12T01:38:00.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.314+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6007934149106628004', time=2024-09-12T03:13:13.781247+0000, chain.objs.size()=1 2024-09-12T01:38:00.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.314+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.mKvmClObaeaz26ZxOUkIdHzxT4OQ6sz_0 2024-09-12T01:38:00.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.314+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8718256967056026480', time=2024-09-12T03:13:13.932082+0000, chain.objs.size()=1 2024-09-12T01:38:00.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.314+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.Uowh9Ec_4OO9IG6Z1naqN2Kk8IAKn4S_0 2024-09-12T01:38:00.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.314+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17905064559528174343', time=2024-09-12T03:13:13.990634+0000, chain.objs.size()=1 2024-09-12T01:38:00.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.314+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.pb6yyfOw82VnEI3RsgAkPptqCWfuuFT_0 2024-09-12T01:38:00.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.314+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9236385685588353909', time=2024-09-12T03:13:14.160254+0000, chain.objs.size()=1 2024-09-12T01:38:00.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.314+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.TqVNEN8jOLmPbNfIISALAv-xXflU45B_0 2024-09-12T01:38:00.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.314+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.890038344606799238', time=2024-09-12T03:13:14.492326+0000, chain.objs.size()=1 2024-09-12T01:38:00.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.314+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.O52D__7NrGLmUGlqRuAKfk9KlA6L7zV_0 2024-09-12T01:38:00.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.314+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3180970950008108466', time=2024-09-12T03:13:14.492834+0000, chain.objs.size()=1 2024-09-12T01:38:00.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.314+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.ksfk-grZ-McCsNt7fFS1PeN51LdJ8Lm_0 2024-09-12T01:38:00.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.314+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7526049848837862689', time=2024-09-12T03:13:14.752564+0000, chain.objs.size()=1 2024-09-12T01:38:00.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.314+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.0nnPLWNWF8KztVysGDYKy6yI5bG19kC_0 2024-09-12T01:38:00.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.314+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12498586634811329561', time=2024-09-12T03:13:14.772724+0000, chain.objs.size()=1 2024-09-12T01:38:00.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.314+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.aG49wpmkbjFc-trx0J3xpj79BHGB7O4_0 2024-09-12T01:38:00.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.314+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8158752941413350368', time=2024-09-12T03:13:15.961511+0000, chain.objs.size()=1 2024-09-12T01:38:00.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.314+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.NIZKHBevImJtM8hzVGgTTrQXbqPEiqY_0 2024-09-12T01:38:00.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.314+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2828358683547954315', time=2024-09-12T03:13:16.379476+0000, chain.objs.size()=1 2024-09-12T01:38:00.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.314+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.GGTjGZ3RkKlXNhYrbsgNjH8xL7QC-VC_0 2024-09-12T01:38:00.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.314+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17163786889198010648', time=2024-09-12T03:13:16.669374+0000, chain.objs.size()=1 2024-09-12T01:38:00.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.314+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.gQSROxsz4PxERLq7QX4Ke612Hw061_Y_0 2024-09-12T01:38:00.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.316+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10183401849375199110', time=2024-09-12T03:13:54.389511+0000, chain.objs.size()=1 2024-09-12T01:38:00.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.316+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.gcJGJbP-Neecu4zkAIKdU_xOVkFynVL_0 2024-09-12T01:38:00.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.317+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9656743628413129418', time=2024-09-12T03:13:55.370395+0000, chain.objs.size()=1 2024-09-12T01:38:00.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.318+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.n_wAD7zZJqSrTD8rfgiwAwvXp5vV0x6_0 2024-09-12T01:38:00.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.318+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12603966784166978681', time=2024-09-12T03:13:55.443215+0000, chain.objs.size()=1 2024-09-12T01:38:00.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.318+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.M4Vx9gdsLqfnjfzzAGV9aWt4K7M-WRE_0 2024-09-12T01:38:00.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.319+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13531498562525037647', time=2024-09-12T03:13:56.041124+0000, chain.objs.size()=1 2024-09-12T01:38:00.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.319+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.cuHGo-BmCx495pldi0F1JSgnHa5qAtk_0 2024-09-12T01:38:00.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.319+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7346195393092815247', time=2024-09-12T03:13:56.610822+0000, chain.objs.size()=1 2024-09-12T01:38:00.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.319+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.rMrh57_hxK5QInWVSu2iZ6pHsKnQ0Qm_0 2024-09-12T01:38:00.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.319+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8446685876538391778', time=2024-09-12T03:13:56.967105+0000, chain.objs.size()=1 2024-09-12T01:38:00.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.319+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.-Wl-a1LJZPtghO1kgX59LBGQy_Zw2at_0 2024-09-12T01:38:00.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.319+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10277927247235459902', time=2024-09-12T03:13:56.995158+0000, chain.objs.size()=1 2024-09-12T01:38:00.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.319+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.t7LJOuWaCRW60uwGzyUEyvBnUrbl47-_0 2024-09-12T01:38:00.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.320+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6361082614217423072', time=2024-09-12T03:13:56.995980+0000, chain.objs.size()=1 2024-09-12T01:38:00.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.320+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.AmipkJjA2PaZGpGFWE-sPl0TgsYa_Fz_0 2024-09-12T01:38:00.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.320+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4650484318551568005', time=2024-09-12T03:13:57.279251+0000, chain.objs.size()=1 2024-09-12T01:38:00.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.320+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.9a12DhGz3C6gf-226GU5cd3lmSojrY1_0 2024-09-12T01:38:00.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.320+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16348767214427972955', time=2024-09-12T03:13:58.269119+0000, chain.objs.size()=1 2024-09-12T01:38:00.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.320+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.gc_8u8dwH81rOE3sotdUNtlpKa5IYTB_0 2024-09-12T01:38:00.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.320+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6752701969385732572', time=2024-09-12T03:13:58.270076+0000, chain.objs.size()=1 2024-09-12T01:38:00.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.320+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Kwq4YtUEsCnttgwyd_qT3FkvueAOO3E_0 2024-09-12T01:38:00.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.320+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14914951456004372848', time=2024-09-12T03:13:58.502336+0000, chain.objs.size()=1 2024-09-12T01:38:00.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.320+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_._ImfCqGV0-DvZbaIKXU-v9dMVCGvfrb_0 2024-09-12T01:38:00.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.320+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.136590359708637673', time=2024-09-12T03:13:58.690597+0000, chain.objs.size()=1 2024-09-12T01:38:00.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.320+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.alypB7GJI9W1Eg3etk6TmvRWaNKrYfC_0 2024-09-12T01:38:00.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.321+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5206024105602780799', time=2024-09-12T03:13:59.188537+0000, chain.objs.size()=1 2024-09-12T01:38:00.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.321+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.KCoEUvVhlz5DSsFTpYUoBXuH4NwLkZi_0 2024-09-12T01:38:00.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.322+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3788027773974634594', time=2024-09-12T03:13:59.716469+0000, chain.objs.size()=1 2024-09-12T01:38:00.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.322+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Mtrp32oaEqYh_n64pm0vtK22LvYvvFX_0 2024-09-12T01:38:00.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.325+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10097530197583422509', time=2024-09-12T03:14:00.674119+0000, chain.objs.size()=1 2024-09-12T01:38:00.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.325+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.2UDI8u3id2HpsZVaEhc6p2BhI_aX5FK_0 2024-09-12T01:38:00.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.325+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12954258880400058113', time=2024-09-12T03:14:00.772525+0000, chain.objs.size()=1 2024-09-12T01:38:00.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.325+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.ZXQuRKKYiYeBS_q88CNLqAvhmhrUc-u_0 2024-09-12T01:38:00.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.325+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6741917385320145566', time=2024-09-12T03:14:01.381546+0000, chain.objs.size()=1 2024-09-12T01:38:00.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.325+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.p5GgNkJISdtcWH3266ETt1kpS55eL4w_0 2024-09-12T01:38:00.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.325+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7515783798084173416', time=2024-09-12T03:14:01.395319+0000, chain.objs.size()=1 2024-09-12T01:38:00.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.325+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.gqqIQV0CxXVxNskiLK6ETpjNWB0N6cE_0 2024-09-12T01:38:00.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.325+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4992857530486244352', time=2024-09-12T03:14:01.681378+0000, chain.objs.size()=1 2024-09-12T01:38:00.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.325+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.JoOztyWUz-h-Zpu9op5mdsUxHAQ33MG_0 2024-09-12T01:38:00.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.325+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7736177581963192090', time=2024-09-12T03:14:01.717843+0000, chain.objs.size()=1 2024-09-12T01:38:00.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.325+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.3QYYSUhbLzji_o0uQrlXG2VXzJz1oNw_0 2024-09-12T01:38:00.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.325+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12854287900283271026', time=2024-09-12T03:14:02.320536+0000, chain.objs.size()=1 2024-09-12T01:38:00.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.325+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.kebOpdBgBa_r99_mEdIrchXdTKixurk_0 2024-09-12T01:38:00.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.325+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10119718689812788968', time=2024-09-12T03:14:02.856086+0000, chain.objs.size()=1 2024-09-12T01:38:00.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.325+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.7Cn0v7MYvWhCqti4Pd8Jju8LYt7DSUE_0 2024-09-12T01:38:00.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.325+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.775370631603932989', time=2024-09-12T03:14:02.937986+0000, chain.objs.size()=1 2024-09-12T01:38:00.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.325+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.EbOJZUSdAu3rMj2NH2wIE9HFhNoqQcC_0 2024-09-12T01:38:00.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.325+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10130968789699106849', time=2024-09-12T03:14:02.938723+0000, chain.objs.size()=1 2024-09-12T01:38:00.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.325+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.DkJwJ9cpEmYYjOtkuqdzCIlEK6_qBlt_0 2024-09-12T01:38:00.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.325+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4449029764226305185', time=2024-09-12T03:14:03.202684+0000, chain.objs.size()=1 2024-09-12T01:38:00.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.325+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.TVD_cttfW28IsHLG5ETzshavxNz-SbE_0 2024-09-12T01:38:00.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.330+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9537325509115412928', time=2024-09-12T03:14:03.334957+0000, chain.objs.size()=1 2024-09-12T01:38:00.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.330+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.DtJkuWbvD0t24AZ6MCB_6ZTUxEjmqEJ_0 2024-09-12T01:38:00.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.330+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13070635181270956505', time=2024-09-12T03:14:03.653474+0000, chain.objs.size()=1 2024-09-12T01:38:00.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.330+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.q8bHpBt8olL9bdFBLrsg87Gr0U4fyTx_0 2024-09-12T01:38:00.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.331+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14442112044548293552', time=2024-09-12T03:15:03.849242+0000, chain.objs.size()=1 2024-09-12T01:38:00.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.331+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.390__shadow_.WQ5mAKsIK4tVWEmc7batrkfpoKEVaeO_0 2024-09-12T01:38:00.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.331+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7291946830091154591', time=2024-09-12T03:15:48.117824+0000, chain.objs.size()=1 2024-09-12T01:38:00.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.331+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.436__shadow_.olcD3w-YAMglubwhqgAVm-q_NUK_HDl_0 2024-09-12T01:38:00.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.331+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1214665340799444762', time=2024-09-12T03:15:51.894188+0000, chain.objs.size()=1 2024-09-12T01:38:00.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.331+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.440__shadow_.YaTK7VrIPIWNgj5btHwIkUXThijBj_a_0 2024-09-12T01:38:00.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.331+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13263362635207244753', time=2024-09-12T03:16:12.515508+0000, chain.objs.size()=1 2024-09-12T01:38:00.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.331+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.458__shadow_.fDq9SIhfwdIwblS2ob6BvBs0fDBI0cN_0 2024-09-12T01:38:00.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.331+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18051022393523385728', time=2024-09-12T03:16:18.021622+0000, chain.objs.size()=1 2024-09-12T01:38:00.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.331+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.462__shadow_.P5UDFhAhYPGwzbn9ZqmSqdCfxCH2Jui_0 2024-09-12T01:38:00.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.331+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1845015657648496629', time=2024-09-12T03:16:20.660212+0000, chain.objs.size()=1 2024-09-12T01:38:00.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.331+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.464__shadow_.dsTIhoTWulEj5S3zwk5A0yFXce50uyH_0 2024-09-12T01:38:00.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.331+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18027491728543330216', time=2024-09-12T03:16:55.881139+0000, chain.objs.size()=1 2024-09-12T01:38:00.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.331+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.503__shadow:zjHxI5MExGDTEMgC.YI1-B-Wp2XBZjW_.xteVVbi5oDy4c1uLu1Qcooxbp-bOuaB_0 2024-09-12T01:38:00.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.331+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1743068423059698220', time=2024-09-12T03:17:40.083103+0000, chain.objs.size()=1 2024-09-12T01:38:00.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.331+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.518__multipart_mymultipart.2~v_akFd7GXXYj8IHVeZKaeQYv6mH6wOK.1 2024-09-12T01:38:00.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.331+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.983546518747416672', time=2024-09-12T03:22:28.953851+0000, chain.objs.size()=1 2024-09-12T01:38:00.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.331+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.554__shadow_.dCeKnjAKOekOjiocfeSzZwY8m3ppiqs_0 2024-09-12T01:38:00.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.336+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 0/45972 2024-09-12T01:38:00.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.339+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T01:38:00.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.339+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='2~_pm-J-u6NzsDjNy7Hacm-qCGJ-daMLW', time=2024-09-12T03:22:53.894323+0000, chain.objs.size()=1 2024-09-12T01:38:00.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.339+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.561__multipart_mymultipart.2~_pm-J-u6NzsDjNy7Hacm-qCGJ-daMLW.1 2024-09-12T01:38:00.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.339+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17142831959883922767', time=2024-09-12T03:23:16.554193+0000, chain.objs.size()=1 2024-09-12T01:38:00.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.339+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.569__shadow:QALXzoiU-NvjInyJIe6qi9cwPfKmStq_.XpZkHj6J95uUKPgjjtwSy9B0GLraImc_0 2024-09-12T01:38:00.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.339+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17644672630514393573', time=2024-09-12T03:23:30.931176+0000, chain.objs.size()=1 2024-09-12T01:38:00.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.339+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.575__shadow:sH9DOdGWEv5IN9MInrvq9qyWVrE7K-5_.BoiCLe7RrQlpRFp2_NKLAg2FujZ0lDK_0 2024-09-12T01:38:00.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.339+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15247576862732213759', time=2024-09-12T03:23:42.431579+0000, chain.objs.size()=1 2024-09-12T01:38:00.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.339+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.577__shadow:a6HiHp89hl3D3tNB6mUgW3Yra0qCDV6_.TJx_JAZYkfMa9JCPQmKKO6ObQC_QBDG_0 2024-09-12T01:38:00.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.339+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9706768371558553122', time=2024-09-12T03:23:47.178729+0000, chain.objs.size()=1 2024-09-12T01:38:00.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.339+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.577__shadow:aOrnz3HfU4iDYxCJCGv1qr1zRHz.aAT_.5CAAO8vja-oZaMmYQHUwvNbmefbYIZD_0 2024-09-12T01:38:00.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.339+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4647059658776441820', time=2024-09-12T03:24:44.326973+0000, chain.objs.size()=1 2024-09-12T01:38:00.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.339+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.585__shadow:lv8v8JzCG5iD3AAJuMaZdkl.Rx.bwUH_.srER4tMoK4xUESX5w0f5d3k7_GXe8IM_0 2024-09-12T01:38:00.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.339+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8791150612179377869', time=2024-09-12T03:25:55.927954+0000, chain.objs.size()=6 2024-09-12T01:38:00.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.339+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.613__multipart_multipart_enc.2~MzNieQBJmybJYpoEE903m-Xenh7TGyK.1 2024-09-12T01:38:00.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.339+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.613__multipart_multipart_enc.2~MzNieQBJmybJYpoEE903m-Xenh7TGyK.2 2024-09-12T01:38:00.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.339+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.613__multipart_multipart_enc.2~MzNieQBJmybJYpoEE903m-Xenh7TGyK.3 2024-09-12T01:38:00.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.339+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.613__multipart_multipart_enc.2~MzNieQBJmybJYpoEE903m-Xenh7TGyK.4 2024-09-12T01:38:00.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.339+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.613__multipart_multipart_enc.2~MzNieQBJmybJYpoEE903m-Xenh7TGyK.5 2024-09-12T01:38:00.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.339+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.613__multipart_multipart_enc.2~MzNieQBJmybJYpoEE903m-Xenh7TGyK.6 2024-09-12T01:38:00.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.347+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:38:00.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.350+0000 7f8786c98800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T01:38:00.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.351+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:38:00.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.351+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:38:00.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.352+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48887' 2024-09-12T01:38:00.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.352+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16930997917388558662', time=2024-09-12T03:08:08.053186+0000, chain.objs.size()=1 2024-09-12T01:38:00.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.352+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.197__shadow_.t2LqRDN1y2vr7kd9-3iAKq-VN-9gbh0_0 2024-09-12T01:38:00.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.352+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8431962033606593944', time=2024-09-12T03:08:16.237922+0000, chain.objs.size()=1 2024-09-12T01:38:00.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.352+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.203__shadow_.NSNAlWnrLsk33JKv3F94z0yHWyEx9kh_0 2024-09-12T01:38:00.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.352+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12337293225200246056', time=2024-09-12T03:10:24.927784+0000, chain.objs.size()=1 2024-09-12T01:38:00.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.352+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.247__shadow_.kGYIomRYZ9n5SfW6RuOjJXRicjkvAD9_0 2024-09-12T01:38:00.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.352+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13542140002800429485', time=2024-09-12T03:10:26.897705+0000, chain.objs.size()=1 2024-09-12T01:38:00.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.352+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.249__shadow_.RO_7r_GCw58Lvvndqi5CowvmHkH2Bma_0 2024-09-12T01:38:00.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.352+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.210592355585871828', time=2024-09-12T03:10:38.390843+0000, chain.objs.size()=1 2024-09-12T01:38:00.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.352+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.261__shadow_.cStoVDD0XcvCTI0nqyjffjRxNCctX8h_0 2024-09-12T01:38:00.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.352+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5986781748535884961', time=2024-09-12T03:11:15.072699+0000, chain.objs.size()=1 2024-09-12T01:38:00.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.352+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.kMJPFwgl1tdFWDh56WQdrWlTjhbGBqK_0 2024-09-12T01:38:00.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.352+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7277992964856828513', time=2024-09-12T03:11:15.134047+0000, chain.objs.size()=1 2024-09-12T01:38:00.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.352+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.BMOLWk9XQoj2JfMUiYmi45nFMO6xQQf_0 2024-09-12T01:38:00.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.352+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10614339818257411563', time=2024-09-12T03:11:16.286398+0000, chain.objs.size()=1 2024-09-12T01:38:00.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.352+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.D9aFeZd4GKlvy9Dqa45xpqLfxZaD9gX_0 2024-09-12T01:38:00.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.352+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.921716488866028744', time=2024-09-12T03:11:16.292709+0000, chain.objs.size()=1 2024-09-12T01:38:00.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.352+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.ki4aTTP71HEwX6OOwIwnRk8lTOu73z__0 2024-09-12T01:38:00.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.352+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9059981762703873589', time=2024-09-12T03:11:17.672386+0000, chain.objs.size()=1 2024-09-12T01:38:00.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.352+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.9q7rsicnS3Kak38x5uGn1siMXm9hBd9_0 2024-09-12T01:38:00.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.352+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15998695361546352297', time=2024-09-12T03:11:17.912583+0000, chain.objs.size()=1 2024-09-12T01:38:00.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.352+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.P2EPl3gI73wAEiLXL_gQHU9OCqXfssQ_0 2024-09-12T01:38:00.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.352+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3928616184669368070', time=2024-09-12T03:11:18.008408+0000, chain.objs.size()=1 2024-09-12T01:38:00.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.352+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.S_9OjRjoq5FgnwiVWqsGsJk8DOf6xfz_0 2024-09-12T01:38:00.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.354+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3460143142002112219', time=2024-09-12T03:11:18.337674+0000, chain.objs.size()=1 2024-09-12T01:38:00.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.354+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Jk0ceasq_laKPv4JxVnDPDFpfWVRHxo_0 2024-09-12T01:38:00.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.354+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17451469326985194614', time=2024-09-12T03:11:18.829966+0000, chain.objs.size()=1 2024-09-12T01:38:00.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.354+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.2jFnqAAncpVyak5Q_J8I1N3zm8gpZ1D_0 2024-09-12T01:38:00.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.354+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7994393304885283161', time=2024-09-12T03:11:18.882659+0000, chain.objs.size()=1 2024-09-12T01:38:00.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.354+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.ctvXFbNBAQzmo8EdPdOVtrbwBddph9t_0 2024-09-12T01:38:00.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.354+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4139819656606684173', time=2024-09-12T03:11:19.003797+0000, chain.objs.size()=1 2024-09-12T01:38:00.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.354+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.6fyk0qQDNepbVJ4cJfYciRF3CfoywJc_0 2024-09-12T01:38:00.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.354+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2229846976486997826', time=2024-09-12T03:11:20.912542+0000, chain.objs.size()=1 2024-09-12T01:38:00.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.354+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.6EBEizYDZwA7ggc28CTmRfC9cL_RQdk_0 2024-09-12T01:38:00.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.356+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14325711092519711979', time=2024-09-12T03:11:22.207436+0000, chain.objs.size()=1 2024-09-12T01:38:00.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.356+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Iw3G_Swn14ufMKlrPbmCvQeHnxHQxGK_0 2024-09-12T01:38:00.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.357+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10895409999069383441', time=2024-09-12T03:11:22.234872+0000, chain.objs.size()=1 2024-09-12T01:38:00.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.357+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Oedb-6sZbVFzDEAwAWrfJGtuwuoIu27_0 2024-09-12T01:38:00.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.357+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9256141115639331892', time=2024-09-12T03:11:22.312393+0000, chain.objs.size()=1 2024-09-12T01:38:00.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.357+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.nGxaMYlLPtPZzhQhzFpa-X0TmFEhaLX_0 2024-09-12T01:38:00.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.357+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9852217965211521197', time=2024-09-12T03:11:22.444551+0000, chain.objs.size()=1 2024-09-12T01:38:00.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.357+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.s-1S1yHCYCPdUASEtMWLgu1hRuN19D7_0 2024-09-12T01:38:00.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.357+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10076556058877799349', time=2024-09-12T03:11:22.885483+0000, chain.objs.size()=1 2024-09-12T01:38:00.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.357+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.spBzSBXxhkjXwAtywFqyibgPRY_bG3Z_0 2024-09-12T01:38:00.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.359+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13969964804700756563', time=2024-09-12T03:11:23.347222+0000, chain.objs.size()=1 2024-09-12T01:38:00.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.359+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.t4zATCNsXo8NsPr1XmMli1JhH505D4h_0 2024-09-12T01:38:00.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.359+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15457039959499809219', time=2024-09-12T03:11:23.466651+0000, chain.objs.size()=1 2024-09-12T01:38:00.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.359+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.orlY4CXn3v4CAvEBm1DL3krhj315mkd_0 2024-09-12T01:38:00.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.359+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3680772629088350814', time=2024-09-12T03:11:24.243734+0000, chain.objs.size()=1 2024-09-12T01:38:00.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.359+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.8bH1jxJ-DG87YTpXGIUDRIwVSRyVl7t_0 2024-09-12T01:38:00.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.359+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17322792087683760980', time=2024-09-12T03:11:24.324055+0000, chain.objs.size()=1 2024-09-12T01:38:00.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.359+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.NWqfYjiC7C1VNtiIwPlst5htJyv3Jqd_0 2024-09-12T01:38:00.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.359+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17536294164648585970', time=2024-09-12T03:11:24.374175+0000, chain.objs.size()=1 2024-09-12T01:38:00.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.359+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.JfXKeYFYiLtbg21A71sekHSJLuS4Xbz_0 2024-09-12T01:38:00.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.359+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18111272487993913449', time=2024-09-12T03:11:24.502880+0000, chain.objs.size()=1 2024-09-12T01:38:00.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.359+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.1gKsuu0aHf79QhYrjynGQeDDJmx2K9h_0 2024-09-12T01:38:00.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.362+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17399495106550924851', time=2024-09-12T03:11:26.815367+0000, chain.objs.size()=1 2024-09-12T01:38:00.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.362+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.264__shadow_.7N7o6EyqCBBfC80VwYJzUfHBbAZogMv_0 2024-09-12T01:38:00.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.362+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.394008202459871159', time=2024-09-12T03:11:34.301267+0000, chain.objs.size()=1 2024-09-12T01:38:00.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.362+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.272__shadow_.PPpjSEIhATQTLpxyiXV46BuXNsDPdjR_0 2024-09-12T01:38:00.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.362+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9140083087220587623', time=2024-09-12T03:11:41.007373+0000, chain.objs.size()=1 2024-09-12T01:38:00.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.362+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.279__shadow_._5CM4Tk-UACEo_96BkOuz3Se3ckW9jA_0 2024-09-12T01:38:00.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.362+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6206524891317605089', time=2024-09-12T03:11:44.877049+0000, chain.objs.size()=1 2024-09-12T01:38:00.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.362+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.283__shadow_.dLCyi4ss15ED_skqy_uTaK7Mm5wmd99_0 2024-09-12T01:38:00.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.362+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1451813444321193583', time=2024-09-12T03:11:50.837790+0000, chain.objs.size()=1 2024-09-12T01:38:00.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.362+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.289__shadow_.yYDoYv-thPEXqTeFYCzpdUgTer41PVQ_0 2024-09-12T01:38:00.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.362+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9007598898703369750', time=2024-09-12T03:11:55.318308+0000, chain.objs.size()=1 2024-09-12T01:38:00.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.362+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.292__shadow_.MikY9uHaGZYKIBoFEuzQBabc4A9nuVa_0 2024-09-12T01:38:00.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.365+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14379662791501234468', time=2024-09-12T03:11:57.468412+0000, chain.objs.size()=1 2024-09-12T01:38:00.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.365+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.293__shadow_.53WwAq9SCXerImadAvra7G9JdYxvgrL_0 2024-09-12T01:38:00.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.365+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6862460693922779989', time=2024-09-12T03:12:01.656673+0000, chain.objs.size()=1 2024-09-12T01:38:00.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.365+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.297__shadow_.fMaBg49MB4B0CKe0CVhpnJhNPUkRY0F_0 2024-09-12T01:38:00.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.365+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7488291881685767903', time=2024-09-12T03:13:07.045734+0000, chain.objs.size()=1 2024-09-12T01:38:00.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.365+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.qGwR0wHdKph1kO_E82Ecp3BD7HznvWq_0 2024-09-12T01:38:00.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.365+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14695734014891079373', time=2024-09-12T03:13:07.490112+0000, chain.objs.size()=1 2024-09-12T01:38:00.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.365+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.ZxIA79G3zbLPvjyszgzhKRnvHGKiLZb_0 2024-09-12T01:38:00.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.365+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18360358724777149527', time=2024-09-12T03:13:07.647802+0000, chain.objs.size()=1 2024-09-12T01:38:00.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.365+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.Pv_5bB06k4NkdaaXrZqocyZcflnsy0Q_0 2024-09-12T01:38:00.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.365+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5814614863372946615', time=2024-09-12T03:13:07.773809+0000, chain.objs.size()=1 2024-09-12T01:38:00.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.365+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.Yn_QeXm8BIWH721nsbbKpjpU3AWHH8B_0 2024-09-12T01:38:00.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.367+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14222338643485190654', time=2024-09-12T03:13:08.343588+0000, chain.objs.size()=1 2024-09-12T01:38:00.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.367+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.wYAQODpdh2khEAvZQkRaPkOepP8bjtS_0 2024-09-12T01:38:00.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.367+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16933864628628455946', time=2024-09-12T03:13:08.501951+0000, chain.objs.size()=1 2024-09-12T01:38:00.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.367+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.VhGVofAqbuwKQOlbDlL3e8Y823-giTW_0 2024-09-12T01:38:00.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.367+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11856946023309981012', time=2024-09-12T03:13:08.608269+0000, chain.objs.size()=1 2024-09-12T01:38:00.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.367+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.ciUBXpjSNx7SinCLb7PjYAOzU_U1tvE_0 2024-09-12T01:38:00.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.367+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8174372904071711919', time=2024-09-12T03:13:08.609057+0000, chain.objs.size()=1 2024-09-12T01:38:00.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.367+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.j3pxg_zwL7NpbQ6UXYHTHUAQL6dydFM_0 2024-09-12T01:38:00.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.367+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7345754979404896295', time=2024-09-12T03:13:08.981029+0000, chain.objs.size()=1 2024-09-12T01:38:00.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.367+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.Y9S-tkfmbvX5QhLpNpO0iodRxKIuC8M_0 2024-09-12T01:38:00.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.370+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15201255565723241053', time=2024-09-12T03:13:09.246122+0000, chain.objs.size()=1 2024-09-12T01:38:00.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.370+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.z0bgOKz8klGfbojL5EyYXKYE3ny_9qB_0 2024-09-12T01:38:00.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.370+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10080435344498842440', time=2024-09-12T03:13:10.035907+0000, chain.objs.size()=1 2024-09-12T01:38:00.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.370+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.5J3V0yU__ailrWmwmzI9eUgZsIa4cPm_0 2024-09-12T01:38:00.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.370+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2553947111360972077', time=2024-09-12T03:13:10.087693+0000, chain.objs.size()=1 2024-09-12T01:38:00.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.370+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.ZDuU0vFdH1A966TJ2b7hgFUxWxZcVli_0 2024-09-12T01:38:00.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.370+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11545559963003740561', time=2024-09-12T03:13:10.233826+0000, chain.objs.size()=1 2024-09-12T01:38:00.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.370+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.hF4SVZoJQi1lCiT9iYQPn2k0ZBOvFnp_0 2024-09-12T01:38:00.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.370+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10302822498428449234', time=2024-09-12T03:13:10.284506+0000, chain.objs.size()=1 2024-09-12T01:38:00.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.370+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.KWvOGy7oLSVFIxTu0fPBEwSr1blN31u_0 2024-09-12T01:38:00.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.370+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16374605428774940905', time=2024-09-12T03:13:10.317176+0000, chain.objs.size()=1 2024-09-12T01:38:00.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.370+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.R5pPceXqgxHE9KSNSLZew6P1CIn2h4h_0 2024-09-12T01:38:00.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.373+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11992937511714757416', time=2024-09-12T03:13:11.098883+0000, chain.objs.size()=1 2024-09-12T01:38:00.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.373+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.yy_yRw-x9rCELJPImeL2FotAkY-GVxi_0 2024-09-12T01:38:00.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.373+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1221833342974420973', time=2024-09-12T03:13:11.609651+0000, chain.objs.size()=1 2024-09-12T01:38:00.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.373+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.1eWdk-UlcyRF8WGWSUHVAm1IqdQlsdp_0 2024-09-12T01:38:00.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.373+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1596336116648566950', time=2024-09-12T03:13:11.872025+0000, chain.objs.size()=1 2024-09-12T01:38:00.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.373+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.kQAcNOa5NRwZWlc1CHDlx4B155ETFkz_0 2024-09-12T01:38:00.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.373+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6053752857994566502', time=2024-09-12T03:13:11.950409+0000, chain.objs.size()=1 2024-09-12T01:38:00.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.373+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.2r4mJouvXFbFZ2t3JrEL15pkfpDgPwm_0 2024-09-12T01:38:00.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.373+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13817180238565057461', time=2024-09-12T03:13:11.976903+0000, chain.objs.size()=1 2024-09-12T01:38:00.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.373+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.dsZ6mqddjodwZfx54be5HWa0_QeH7rj_0 2024-09-12T01:38:00.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.374+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17754847929336847995', time=2024-09-12T03:13:12.920872+0000, chain.objs.size()=1 2024-09-12T01:38:00.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.374+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.ChIDmx8E6JMGlH_hMRb5d1f0T5ShTQz_0 2024-09-12T01:38:00.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.374+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10116091810657506038', time=2024-09-12T03:13:13.212066+0000, chain.objs.size()=1 2024-09-12T01:38:00.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.374+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.qgunZ6mygMs3QD-f-drvvUgs_eXhzFO_0 2024-09-12T01:38:00.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.374+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14076908841196397427', time=2024-09-12T03:13:14.303927+0000, chain.objs.size()=1 2024-09-12T01:38:00.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.374+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.eHR24PrRU7JpZxTUtHFnMKG-JNj_Edd_0 2024-09-12T01:38:00.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.374+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3821795734677313709', time=2024-09-12T03:13:14.380834+0000, chain.objs.size()=1 2024-09-12T01:38:00.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.374+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.Sr-H6SeLHlsJZL-PYptiTzHBRrZKWtk_0 2024-09-12T01:38:00.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.374+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1585894475520338132', time=2024-09-12T03:13:14.406787+0000, chain.objs.size()=1 2024-09-12T01:38:00.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.374+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.qhdlrFVGZsoyGD2L88YTanzEhr3fHGt_0 2024-09-12T01:38:00.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.374+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10355846672636783334', time=2024-09-12T03:13:14.559139+0000, chain.objs.size()=1 2024-09-12T01:38:00.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.374+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.ptFmxmw5fY8Wmxu4wOC96ROMPTEQ6j2_0 2024-09-12T01:38:00.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.375+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6347441803009150328', time=2024-09-12T03:13:14.753168+0000, chain.objs.size()=1 2024-09-12T01:38:00.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.375+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.-eWhRzmlUspv-k6gARHffGxD0eKm3My_0 2024-09-12T01:38:00.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.375+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13136386375179721477', time=2024-09-12T03:13:15.210763+0000, chain.objs.size()=1 2024-09-12T01:38:00.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.375+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.urx6EbWF8Va_lcpaQYwR2jq9PzoPRbs_0 2024-09-12T01:38:00.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.375+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16787454949800397484', time=2024-09-12T03:13:15.931616+0000, chain.objs.size()=1 2024-09-12T01:38:00.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.375+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.CLmwVLrYSUfCo_OvDldDeqnrh6RC7F4_0 2024-09-12T01:38:00.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.375+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9963460475121663458', time=2024-09-12T03:13:17.036201+0000, chain.objs.size()=1 2024-09-12T01:38:00.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.375+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.ujFCRKt2YOkPJ8LG9ZOsgSzl1h_QNGz_0 2024-09-12T01:38:00.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.375+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14777300611179466132', time=2024-09-12T03:13:53.863329+0000, chain.objs.size()=1 2024-09-12T01:38:00.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.375+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.A4crIWVtYQp0OBYS0ahMd-f_bObFpzV_0 2024-09-12T01:38:00.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.376+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1331658740958049487', time=2024-09-12T03:13:53.932954+0000, chain.objs.size()=1 2024-09-12T01:38:00.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.376+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.hEThHCQwtwEZDL8y86KOoic-pULiteB_0 2024-09-12T01:38:00.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.376+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13991874660893829919', time=2024-09-12T03:13:54.189882+0000, chain.objs.size()=1 2024-09-12T01:38:00.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.376+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.V5AU0Z7tkQfTjpPze5JN-i65qP6tCrc_0 2024-09-12T01:38:00.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.377+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14761394912848297054', time=2024-09-12T03:13:54.574574+0000, chain.objs.size()=1 2024-09-12T01:38:00.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.377+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.bryLNm_m0n0uJrMlrYD5A6RrXo6yXIi_0 2024-09-12T01:38:00.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.377+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8873859073113716912', time=2024-09-12T03:13:55.171701+0000, chain.objs.size()=1 2024-09-12T01:38:00.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.377+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.WjaYXVfP1xyoAcS4D2liNYq4UCmYOhe_0 2024-09-12T01:38:00.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.377+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16982575110086561432', time=2024-09-12T03:13:55.774747+0000, chain.objs.size()=1 2024-09-12T01:38:00.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.377+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.FHteBAii1oiktB1VE2zNCZFV-yAAlTW_0 2024-09-12T01:38:00.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.377+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14338134657521131233', time=2024-09-12T03:13:57.126727+0000, chain.objs.size()=1 2024-09-12T01:38:00.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.377+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.jvYDQ9K7xT42w6vjBOh7TyjLNV7s5Rs_0 2024-09-12T01:38:00.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.377+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1457358284048674344', time=2024-09-12T03:13:57.158381+0000, chain.objs.size()=1 2024-09-12T01:38:00.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.377+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.tf79LTcKYqJH2w0EjAognHfAQQoZekX_0 2024-09-12T01:38:00.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.377+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7255181843526089246', time=2024-09-12T03:13:57.222543+0000, chain.objs.size()=1 2024-09-12T01:38:00.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.377+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.ntv12F5nhrXxEKXj2sg_Vz1tMNsI2u3_0 2024-09-12T01:38:00.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.377+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4230035474180100652', time=2024-09-12T03:13:58.103636+0000, chain.objs.size()=1 2024-09-12T01:38:00.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.377+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.F-632quG0-y7k7EIGeTs9D4GYCWvr8T_0 2024-09-12T01:38:00.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.377+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8864895414812342126', time=2024-09-12T03:13:58.285543+0000, chain.objs.size()=1 2024-09-12T01:38:00.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.377+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.t6mq5IuzAg33VqciKTgfa8pADEgSmE3_0 2024-09-12T01:38:00.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.377+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7949899775576949127', time=2024-09-12T03:13:58.286339+0000, chain.objs.size()=1 2024-09-12T01:38:00.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.377+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.wo-9N6HHI8vvPnZVG3pKi5E6qh40Z-X_0 2024-09-12T01:38:00.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.377+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11725753249222761890', time=2024-09-12T03:13:58.400216+0000, chain.objs.size()=1 2024-09-12T01:38:00.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.377+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.OtbG5P70RoPMWavPEoPcA6OBhkKlbAh_0 2024-09-12T01:38:00.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.378+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2057233705437380735', time=2024-09-12T03:13:58.596998+0000, chain.objs.size()=1 2024-09-12T01:38:00.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.378+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.B2hqsu82XVgSb_vppyy2axzJtjJF3_6_0 2024-09-12T01:38:00.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.379+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9348701698762494493', time=2024-09-12T03:13:58.674964+0000, chain.objs.size()=1 2024-09-12T01:38:00.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.379+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.iVJHkwLmpbCm41LrCUMJwzTnrNOD7vz_0 2024-09-12T01:38:00.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.379+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9428967944871514374', time=2024-09-12T03:13:58.686858+0000, chain.objs.size()=1 2024-09-12T01:38:00.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.379+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.AjdYZqTHGv0_Sel5CljlY0Q4Wv_mZF1_0 2024-09-12T01:38:00.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.380+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12152832073890679939', time=2024-09-12T03:13:58.780481+0000, chain.objs.size()=1 2024-09-12T01:38:00.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.380+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.SBAr9sC-gmfyUHEGiwMftMeLHfj0PpZ_0 2024-09-12T01:38:00.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.380+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16547589351960261243', time=2024-09-12T03:13:59.357744+0000, chain.objs.size()=1 2024-09-12T01:38:00.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.380+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.2xpMVJSGZi5eL1IOfF9odb0wLObQZEG_0 2024-09-12T01:38:00.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.380+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15399008608809944221', time=2024-09-12T03:13:59.516606+0000, chain.objs.size()=1 2024-09-12T01:38:00.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.380+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.UoWG89QO9omKOSf6TSfncx5BstBL2Vj_0 2024-09-12T01:38:00.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.380+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17451711141978720579', time=2024-09-12T03:13:59.914863+0000, chain.objs.size()=1 2024-09-12T01:38:00.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.380+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.xhLagpCsmWsX82FIx4fnKjfG5d60JTL_0 2024-09-12T01:38:00.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.380+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14117085686286371818', time=2024-09-12T03:14:00.515160+0000, chain.objs.size()=1 2024-09-12T01:38:00.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.380+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Yhy1NqDK2jdinFgY1A3T6iUP1bmxJuS_0 2024-09-12T01:38:00.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.380+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12863325363880214516', time=2024-09-12T03:14:00.602634+0000, chain.objs.size()=1 2024-09-12T01:38:00.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.380+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.HuVZY-kdfqHTAGyXNtVZQ2dBRC9_QAg_0 2024-09-12T01:38:00.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.380+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15781517990028514686', time=2024-09-12T03:14:00.635122+0000, chain.objs.size()=1 2024-09-12T01:38:00.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.380+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.L4JPEodaCx1-M47BliPs4yxhAQw62ST_0 2024-09-12T01:38:00.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.380+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11509159793815647662', time=2024-09-12T03:14:00.998680+0000, chain.objs.size()=1 2024-09-12T01:38:00.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.380+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.pD5tcK6zsLRdBO4FEdSphedxAVxV6_P_0 2024-09-12T01:38:00.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.380+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13325267404546915246', time=2024-09-12T03:14:00.999458+0000, chain.objs.size()=1 2024-09-12T01:38:00.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.380+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.HGreSuKLS40LVY3RfWrrra-NR_KGDHn_0 2024-09-12T01:38:00.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.380+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3828706457708001902', time=2024-09-12T03:14:01.135732+0000, chain.objs.size()=1 2024-09-12T01:38:00.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.380+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.c6BhEt1ZPMuXJjtEQDTUVlZWhxi7RTa_0 2024-09-12T01:38:00.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.380+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12031204750009296146', time=2024-09-12T03:14:01.397282+0000, chain.objs.size()=1 2024-09-12T01:38:00.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.380+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Pt2VUFz89Ec0Lgw9CUeuDPjIc_npaPo_0 2024-09-12T01:38:00.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.382+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15523890061602948310', time=2024-09-12T03:14:01.859857+0000, chain.objs.size()=1 2024-09-12T01:38:00.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.382+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.kByRvhEwfUqOWYKvWMCwiCQkK6xZ085_0 2024-09-12T01:38:00.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.382+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.45294912052430462', time=2024-09-12T03:14:02.070294+0000, chain.objs.size()=1 2024-09-12T01:38:00.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.382+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.L1482pHNu92mxSlod3ElymeSbX8zlUw_0 2024-09-12T01:38:00.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.382+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15841560504957738168', time=2024-09-12T03:14:02.421337+0000, chain.objs.size()=1 2024-09-12T01:38:00.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.382+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.6yAcdWl9o9FpBX_C1P9fBmwITnbKU8X_0 2024-09-12T01:38:00.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.382+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2894355903698650391', time=2024-09-12T03:14:02.480480+0000, chain.objs.size()=1 2024-09-12T01:38:00.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.382+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.qe7x-YjeVrT8YjXTgkH7N2dvboLrOCH_0 2024-09-12T01:38:00.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.382+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8812829743071264552', time=2024-09-12T03:14:02.519674+0000, chain.objs.size()=1 2024-09-12T01:38:00.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.382+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.seDXxuHG4zAFmknNGi8TimJ-6U685zr_0 2024-09-12T01:38:00.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.382+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12606834919199659498', time=2024-09-12T03:14:02.981715+0000, chain.objs.size()=1 2024-09-12T01:38:00.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.382+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.5-cbBNzf-RNYCGdN48BaCCcIcVx_YpB_0 2024-09-12T01:38:00.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.382+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13446313687820682223', time=2024-09-12T03:14:03.085576+0000, chain.objs.size()=1 2024-09-12T01:38:00.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.382+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.t8YvgmBlexKzTrDhSly4T_VMKpCh7xI_0 2024-09-12T01:38:00.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.384+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 0/48887 2024-09-12T01:38:00.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.386+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T01:38:00.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.386+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3752134131423423511', time=2024-09-12T03:14:03.345843+0000, chain.objs.size()=1 2024-09-12T01:38:00.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.386+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.U0EIVLLWJI1UERswAfUaNIVyQbjBXNN_0 2024-09-12T01:38:00.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.387+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8938517167816833130', time=2024-09-12T03:14:03.643282+0000, chain.objs.size()=1 2024-09-12T01:38:00.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.387+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.wSwkpUOGziuFCFWAXkZ65x_KnsAa1Ex_0 2024-09-12T01:38:00.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.387+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9906387021303927240', time=2024-09-12T03:14:42.776948+0000, chain.objs.size()=1 2024-09-12T01:38:00.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.387+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.369__shadow_.kNynDlgtO6V6HWgzbh8AVTjeeonhvcZ_0 2024-09-12T01:38:00.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.387+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11015019664670022072', time=2024-09-12T03:15:56.342068+0000, chain.objs.size()=1 2024-09-12T01:38:00.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.387+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.444__shadow_.QW2eJ8DKsEPKd7FPlIUXROIQ-8PSgB9_0 2024-09-12T01:38:00.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.387+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7244113480160607396', time=2024-09-12T03:16:23.201769+0000, chain.objs.size()=1 2024-09-12T01:38:00.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.387+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.466__shadow_.GRUIhxXyOyAAWHSDYHTyOvMHEDLewzu_0 2024-09-12T01:38:00.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.387+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3726389816533762986', time=2024-09-12T03:16:41.337723+0000, chain.objs.size()=1 2024-09-12T01:38:00.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.387+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.487__shadow_.x-8PO4dww3eNQ8dIyIp_M9fqHoarL-e_0 2024-09-12T01:38:00.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.387+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12331185937924087359', time=2024-09-12T03:20:34.779329+0000, chain.objs.size()=2 2024-09-12T01:38:00.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.387+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.523__multipart_mymultipart.2~Ky-2qOll8kHMwch-lxjPH7qqMlaSW5M.1 2024-09-12T01:38:00.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.387+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.523__multipart_mymultipart.2~Ky-2qOll8kHMwch-lxjPH7qqMlaSW5M.2 2024-09-12T01:38:00.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.387+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18230240832649219554', time=2024-09-12T03:23:17.223291+0000, chain.objs.size()=1 2024-09-12T01:38:00.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.387+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.569__shadow:x2S6a-h24WkdQ45iyno6NMtGbfNGr4g_.1ptJQItUucO4_cPdiXkObn2B8_zzmXe_0 2024-09-12T01:38:00.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.387+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16850125365329126032', time=2024-09-12T03:23:19.909888+0000, chain.objs.size()=1 2024-09-12T01:38:00.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.387+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.570__shadow:eGdQESw1gQ1qDFwN206QAk8EpuNT-wU_.uWluop_MXZmDhBds1XzJ2sGSJ7vG9gu_0 2024-09-12T01:38:00.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.387+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4215684783074533357', time=2024-09-12T03:23:36.918825+0000, chain.objs.size()=1 2024-09-12T01:38:00.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.387+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.576__shadow:puWFCmGufbXHwJ6a6tVjpLt1Czpk97C_.2D5IbyqUnpLFQw_wiwqHqpF9f9ecvtj_0 2024-09-12T01:38:00.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.387+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6921642705420435953', time=2024-09-12T03:23:48.709079+0000, chain.objs.size()=1 2024-09-12T01:38:00.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.387+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.577__shadow:rUIGYgSAQD5i8N4GMJPiFQOfyX06hKB_.07X3T5iadzo_tK3cFPrCdaqQ79mHoAs_0 2024-09-12T01:38:00.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.390+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9537972604689446765', time=2024-09-12T03:25:05.296658+0000, chain.objs.size()=1 2024-09-12T01:38:00.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.390+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.607__shadow_.wiCIctHMZMo3o8qYBc5xZWy2l9PX4-J_0 2024-09-12T01:38:00.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.390+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10976094311976608356', time=2024-09-12T03:30:56.233134+0000, chain.objs.size()=6 2024-09-12T01:38:00.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.390+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.661__multipart_baz.2~qTpfgzTLa47W83tpJZ4bfUxWO2_XFsk.1 2024-09-12T01:38:00.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.390+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.661__multipart_baz.2~qTpfgzTLa47W83tpJZ4bfUxWO2_XFsk.2 2024-09-12T01:38:00.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.390+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.661__multipart_baz.2~qTpfgzTLa47W83tpJZ4bfUxWO2_XFsk.3 2024-09-12T01:38:00.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.391+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.661__multipart_baz.2~qTpfgzTLa47W83tpJZ4bfUxWO2_XFsk.4 2024-09-12T01:38:00.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.391+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.661__multipart_baz.2~qTpfgzTLa47W83tpJZ4bfUxWO2_XFsk.5 2024-09-12T01:38:00.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.391+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.661__multipart_baz.2~qTpfgzTLa47W83tpJZ4bfUxWO2_XFsk.6 2024-09-12T01:38:00.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.391+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16401824790858336211', time=2024-09-12T03:30:57.712886+0000, chain.objs.size()=1 2024-09-12T01:38:00.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.391+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.663__shadow_.DYY7yHHtWV-pwO0NnASOfYvh-eFFtGg_0 2024-09-12T01:38:00.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.391+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='2~RCjcnJnR-kq3TB-Dc82sgDE9D72JS_x', time=2024-09-12T03:32:42.219429+0000, chain.objs.size()=1 2024-09-12T01:38:00.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.391+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.742__multipart_mymultipart2.2~RCjcnJnR-kq3TB-Dc82sgDE9D72JS_x.1 2024-09-12T01:38:00.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.393+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:38:00.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.395+0000 7f8786c98800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T01:38:00.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.396+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:38:00.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.397+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:38:00.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.398+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45135' 2024-09-12T01:38:00.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.398+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='_V3_W_RFFlJ5KxCyLDBWCOIHaqyiGt8i', time=2024-09-12T03:06:39.185045+0000, chain.objs.size()=1 2024-09-12T01:38:00.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.398+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.160__shadow_.8Dpd0p3Xmkp35jle14Y0JZbzCSlrwky_0 2024-09-12T01:38:00.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.398+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='_voq5fZ6dCPdnEJupRFaIYPi6CK3j9nW', time=2024-09-12T03:07:15.722339+0000, chain.objs.size()=1 2024-09-12T01:38:00.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.398+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.163__shadow_.3mr0lypzBL8uIQ_lHCTurtO_uUpfi6__0 2024-09-12T01:38:00.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.398+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6553043964547073582', time=2024-09-12T03:08:11.156296+0000, chain.objs.size()=1 2024-09-12T01:38:00.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.398+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.200__shadow_.vHjAzGl0Ot0y3K_J9np3uj1M9z1Tjg2_0 2024-09-12T01:38:00.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.398+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10316366513201303456', time=2024-09-12T03:10:35.528022+0000, chain.objs.size()=1 2024-09-12T01:38:00.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.398+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.258__shadow_.ZlLMPOphw6miTcDPij7GHtWT2ajsG01_0 2024-09-12T01:38:00.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.398+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12987673716865731367', time=2024-09-12T03:11:14.352371+0000, chain.objs.size()=1 2024-09-12T01:38:00.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.398+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.HrEXBzOYoWVFcNp6OUPLeJ7X6XXRJ_b_0 2024-09-12T01:38:00.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.398+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7514374558894320367', time=2024-09-12T03:11:15.341246+0000, chain.objs.size()=1 2024-09-12T01:38:00.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.398+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.vlP8LMiipluxeGsMdivSxsvpJsGARD-_0 2024-09-12T01:38:00.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.398+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7816591348468330353', time=2024-09-12T03:11:15.973793+0000, chain.objs.size()=1 2024-09-12T01:38:00.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.398+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.87W7FGvZyQm8_1myH9eiEraFuzHuQ2E_0 2024-09-12T01:38:00.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.398+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5604500717483000151', time=2024-09-12T03:11:16.403469+0000, chain.objs.size()=1 2024-09-12T01:38:00.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.398+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Z7ieQcqPR5AAAEVbrFxIs8WpirtJvSU_0 2024-09-12T01:38:00.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.398+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2060557518591217234', time=2024-09-12T03:11:16.663765+0000, chain.objs.size()=1 2024-09-12T01:38:00.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.398+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.181gfAAOw4KHbUbzQyTvcV-Gvxl-Jfv_0 2024-09-12T01:38:00.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.398+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13634769464853138414', time=2024-09-12T03:11:17.516203+0000, chain.objs.size()=1 2024-09-12T01:38:00.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.398+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.gVdp3I9OMpxcflO1Q327RmmWA9NwM8k_0 2024-09-12T01:38:00.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.398+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14208359276682985201', time=2024-09-12T03:11:17.584357+0000, chain.objs.size()=1 2024-09-12T01:38:00.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.398+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.BNdm1KSUfH9pmh71Baz7539RPMDb_0D_0 2024-09-12T01:38:00.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.398+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15992412548320650839', time=2024-09-12T03:11:17.989975+0000, chain.objs.size()=1 2024-09-12T01:38:00.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.398+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.b2vT1yTCfPcE9fxASlRIc3JCCZIyGBX_0 2024-09-12T01:38:00.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.402+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12516276152246383472', time=2024-09-12T03:11:19.377559+0000, chain.objs.size()=1 2024-09-12T01:38:00.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.402+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Q3XRPkwSA78R9e-vw2YZw6FeyNN6CBh_0 2024-09-12T01:38:00.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.405+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9497549694702549922', time=2024-09-12T03:11:20.533659+0000, chain.objs.size()=1 2024-09-12T01:38:00.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.405+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.BFh2PCo3sKu0z5z3Mn9B7smlfHMg6LI_0 2024-09-12T01:38:00.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.405+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17856214864205685873', time=2024-09-12T03:11:20.534407+0000, chain.objs.size()=1 2024-09-12T01:38:00.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.405+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.jb3d-ewScqmSIV4dUT2KD8rYyr4lrYa_0 2024-09-12T01:38:00.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.405+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12786859566503107643', time=2024-09-12T03:11:20.848264+0000, chain.objs.size()=1 2024-09-12T01:38:00.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.405+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.VCTcs59JVmCNSpkBbC8mzrcM1E-hEoz_0 2024-09-12T01:38:00.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.405+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18098810807006937092', time=2024-09-12T03:11:20.852555+0000, chain.objs.size()=1 2024-09-12T01:38:00.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.405+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Sewgby5eZpch4L2eq4KvcWM0I_0Y1An_0 2024-09-12T01:38:00.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.405+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6118892643491825591', time=2024-09-12T03:11:21.078426+0000, chain.objs.size()=1 2024-09-12T01:38:00.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.405+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.zsuXWjHV1tPyv-4E-cffNIpiyQIAxk5_0 2024-09-12T01:38:00.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.405+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14414631623719812948', time=2024-09-12T03:11:21.592713+0000, chain.objs.size()=1 2024-09-12T01:38:00.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.405+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.F6RglSEeUiD37kbUjGQFjDFID726WpY_0 2024-09-12T01:38:00.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.405+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1986605675439579247', time=2024-09-12T03:11:21.695012+0000, chain.objs.size()=1 2024-09-12T01:38:00.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.405+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_._OSAiQU0gI_uWI6N_2VMfJVYKfFBXJw_0 2024-09-12T01:38:00.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.405+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10108287819780838906', time=2024-09-12T03:11:21.695682+0000, chain.objs.size()=1 2024-09-12T01:38:00.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.405+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_._TBisk1eiJ4IwrdVKOEeNQ_dM93_7f9_0 2024-09-12T01:38:00.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.405+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3175210127570050877', time=2024-09-12T03:11:21.851459+0000, chain.objs.size()=1 2024-09-12T01:38:00.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.405+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.-kTIIUILUABF8GA-3lyYTyRBSB6mKBK_0 2024-09-12T01:38:00.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.405+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8319745011613334848', time=2024-09-12T03:11:22.106652+0000, chain.objs.size()=1 2024-09-12T01:38:00.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.405+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.szbaOqcH7SWGZP2Bnyc4hppmRYJBt4l_0 2024-09-12T01:38:00.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.405+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14232785457942010749', time=2024-09-12T03:11:22.965969+0000, chain.objs.size()=1 2024-09-12T01:38:00.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.405+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.AGHkPPbFgJ9-Isa_0wSpwhRx4vTSeXI_0 2024-09-12T01:38:00.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.407+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14553446806782895787', time=2024-09-12T03:11:23.058753+0000, chain.objs.size()=1 2024-09-12T01:38:00.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.407+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.bvC1v8E6V1PZJnG2_94cS9TCfjCY7lE_0 2024-09-12T01:38:00.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.408+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14280844080670077644', time=2024-09-12T03:11:23.166925+0000, chain.objs.size()=1 2024-09-12T01:38:00.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.408+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.lNY4MAvj9L8YCNJBb5nSpGBFaeUWKK4_0 2024-09-12T01:38:00.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.408+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7554966344021857030', time=2024-09-12T03:11:24.099193+0000, chain.objs.size()=1 2024-09-12T01:38:00.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.408+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.FrlNvqYmRljI-2koOIbx27pL64mezJQ_0 2024-09-12T01:38:00.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.408+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7739795435174071061', time=2024-09-12T03:11:24.233677+0000, chain.objs.size()=1 2024-09-12T01:38:00.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.408+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.WIyby2Au884rZPy-eGfSAe9xaoXYAEj_0 2024-09-12T01:38:00.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.408+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14419580551399056674', time=2024-09-12T03:11:24.479842+0000, chain.objs.size()=1 2024-09-12T01:38:00.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.408+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.MM1CYgjkX1NqEkZtrVspudJG1iJoiuY_0 2024-09-12T01:38:00.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.408+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3424735723618500290', time=2024-09-12T03:11:24.718368+0000, chain.objs.size()=1 2024-09-12T01:38:00.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.408+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.sNyBXjbwqc_AfpLkXf2Coc7MFkKDpqt_0 2024-09-12T01:38:00.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.408+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17774031235202106824', time=2024-09-12T03:11:32.419379+0000, chain.objs.size()=1 2024-09-12T01:38:00.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.408+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.270__shadow_.A5hSYk-J2OAu2_1w5VxA1IMrv_JePc__0 2024-09-12T01:38:00.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.408+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5981470333517660294', time=2024-09-12T03:11:32.423209+0000, chain.objs.size()=1 2024-09-12T01:38:00.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.408+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.270__shadow_.Syxqav3qaL2dTBi-3LwsLKjnjttfdb1_0 2024-09-12T01:38:00.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.408+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13826673648720713258', time=2024-09-12T03:11:57.483388+0000, chain.objs.size()=1 2024-09-12T01:38:00.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.408+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.293__shadow_.oCtqtw957DpOZdkEPISz1zDamQhkJLb_0 2024-09-12T01:38:00.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.408+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.652393766897805900', time=2024-09-12T03:12:07.587125+0000, chain.objs.size()=1 2024-09-12T01:38:00.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.408+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.303__shadow_.c-N5a8avJ9vtly7EFBSPAKjUJxAwxa5_0 2024-09-12T01:38:00.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.408+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17678077262057914171', time=2024-09-12T03:13:07.367530+0000, chain.objs.size()=1 2024-09-12T01:38:00.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.408+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.npl1L8RuEAPr0SXnHlNmv9FyrcqE2S9_0 2024-09-12T01:38:00.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.409+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6780683225974894542', time=2024-09-12T03:13:07.592679+0000, chain.objs.size()=1 2024-09-12T01:38:00.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.409+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.Qhbphqjh5eWyevTK8KO_FY8ucnO3jLW_0 2024-09-12T01:38:00.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.410+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3589488210994453405', time=2024-09-12T03:13:08.386901+0000, chain.objs.size()=1 2024-09-12T01:38:00.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.410+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.u22hwkNo_4J9nlFdadiYuSp051kii2A_0 2024-09-12T01:38:00.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.410+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7500905751734847464', time=2024-09-12T03:13:08.701624+0000, chain.objs.size()=1 2024-09-12T01:38:00.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.410+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.EwQnOiK-INtULMs6dPv6o-mfUUdhxf6_0 2024-09-12T01:38:00.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.411+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13266568904923786297', time=2024-09-12T03:13:08.815838+0000, chain.objs.size()=1 2024-09-12T01:38:00.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.411+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.trM6n5vR10cWI2qVtGW1fENL-tGfw9e_0 2024-09-12T01:38:00.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.411+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8605301572129462429', time=2024-09-12T03:13:09.247207+0000, chain.objs.size()=1 2024-09-12T01:38:00.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.411+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.ZQRE6kmJZ96h12pWxsmQTVvT9msCK1O_0 2024-09-12T01:38:00.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.411+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2684859900781613612', time=2024-09-12T03:13:09.885052+0000, chain.objs.size()=1 2024-09-12T01:38:00.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.411+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.3nTZO0XursCrf3ycVw1Z71WraO3oiOp_0 2024-09-12T01:38:00.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.411+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3718650338718204427', time=2024-09-12T03:13:10.143892+0000, chain.objs.size()=1 2024-09-12T01:38:00.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.411+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.AmLBcdoiRpA6CFge_osIBQIl8nuQwLk_0 2024-09-12T01:38:00.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.411+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4587270374953152450', time=2024-09-12T03:13:10.355413+0000, chain.objs.size()=1 2024-09-12T01:38:00.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.411+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.BulVG-UHboNlamKOCFJebIvsY4fCyFF_0 2024-09-12T01:38:00.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.411+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14142886796120512834', time=2024-09-12T03:13:10.442042+0000, chain.objs.size()=1 2024-09-12T01:38:00.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.411+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.QTRv_c48yem5WW5aVpVpxuNUS_jlhdW_0 2024-09-12T01:38:00.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.414+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1781517739327661814', time=2024-09-12T03:13:10.623234+0000, chain.objs.size()=1 2024-09-12T01:38:00.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.414+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.dyAE51vuhMwUTSmqzzcdrwPUTs01Cgf_0 2024-09-12T01:38:00.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.414+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11553593811591411354', time=2024-09-12T03:13:11.098053+0000, chain.objs.size()=1 2024-09-12T01:38:00.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.414+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.zjzKoWvy6_ybfAWOR0nmvB8-zkZUJSR_0 2024-09-12T01:38:00.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.414+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5429814258085924224', time=2024-09-12T03:13:12.592402+0000, chain.objs.size()=1 2024-09-12T01:38:00.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.414+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.QEcY_YxoYEOT1lSMgi9uAR2NPSWxGCm_0 2024-09-12T01:38:00.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.414+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8920736639312581079', time=2024-09-12T03:13:12.971353+0000, chain.objs.size()=1 2024-09-12T01:38:00.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.414+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.KJApFJVKZkHTvaA9zqylqiIB7jjq4bb_0 2024-09-12T01:38:00.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.414+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13885288750163766759', time=2024-09-12T03:13:13.077905+0000, chain.objs.size()=1 2024-09-12T01:38:00.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.414+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.rDYgI7HEUF9Bo03e1i3jC9O97DgpqRY_0 2024-09-12T01:38:00.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.414+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14594995698502377720', time=2024-09-12T03:13:13.293681+0000, chain.objs.size()=1 2024-09-12T01:38:00.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.414+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.v4s7Sl2R7xgtgfou-41XAJguKY9ay8J_0 2024-09-12T01:38:00.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.414+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4962634994246665877', time=2024-09-12T03:13:13.468508+0000, chain.objs.size()=1 2024-09-12T01:38:00.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.414+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.np-tO0OijYwRw6X_IR4mvi7A1_TL3uE_0 2024-09-12T01:38:00.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.414+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7230234740934645423', time=2024-09-12T03:13:13.794987+0000, chain.objs.size()=1 2024-09-12T01:38:00.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.414+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.gshZi3BRR7dSbNunAuI9qxmRGh0S1Xi_0 2024-09-12T01:38:00.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.414+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17038577547445823901', time=2024-09-12T03:13:13.849103+0000, chain.objs.size()=1 2024-09-12T01:38:00.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.414+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.wfohcENardpQ6D1kv2nrK0-WhbNnvvt_0 2024-09-12T01:38:00.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.414+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4136226351473483445', time=2024-09-12T03:13:13.849855+0000, chain.objs.size()=1 2024-09-12T01:38:00.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.414+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.9kZaWDzcWWLJl0K1Yrwdg8kzx-tK3UD_0 2024-09-12T01:38:00.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.414+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13951090648705727514', time=2024-09-12T03:13:14.397140+0000, chain.objs.size()=1 2024-09-12T01:38:00.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.414+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.tfI_jWB8HuGtWYmZpmYmdKZQDFjOOhL_0 2024-09-12T01:38:00.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.417+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9068298681916272930', time=2024-09-12T03:13:14.706724+0000, chain.objs.size()=1 2024-09-12T01:38:00.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.417+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.-DiJtllhWMTkMp4T1JF-8V6te4GoYYO_0 2024-09-12T01:38:00.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.417+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1371992310631100624', time=2024-09-12T03:13:14.751419+0000, chain.objs.size()=1 2024-09-12T01:38:00.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.417+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.6imfnm2CK0cGLSbamXum2cGL0nb8Rf8_0 2024-09-12T01:38:00.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.417+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6876116316441677074', time=2024-09-12T03:13:15.417587+0000, chain.objs.size()=1 2024-09-12T01:38:00.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.417+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.O3FC7CP0kPtpvq1E66gNIAVhPAzm_DC_0 2024-09-12T01:38:00.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.417+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14813043286596331768', time=2024-09-12T03:13:15.436028+0000, chain.objs.size()=1 2024-09-12T01:38:00.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.417+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.36YYLgKQdmhV967sFrEvYo7km2UbC0V_0 2024-09-12T01:38:00.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.417+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9040479125668737307', time=2024-09-12T03:13:15.563315+0000, chain.objs.size()=1 2024-09-12T01:38:00.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.417+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.hcTlu3xURqO3s8H1aGSnyptrqNSd-Cm_0 2024-09-12T01:38:00.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.417+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.376032923582021091', time=2024-09-12T03:13:15.608503+0000, chain.objs.size()=1 2024-09-12T01:38:00.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.417+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.BdRxFR0hgb-TZKsiAoCTb7yoQUSqvPl_0 2024-09-12T01:38:00.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.417+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16703481727064198679', time=2024-09-12T03:13:15.895795+0000, chain.objs.size()=1 2024-09-12T01:38:00.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.417+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.2XJhGmJRPF2lKhsq8RzezEr3n_Bwcbb_0 2024-09-12T01:38:00.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.417+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2390463457447737612', time=2024-09-12T03:13:16.377073+0000, chain.objs.size()=1 2024-09-12T01:38:00.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.417+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.4kgPpTO4ZF5MLBavfTsoo1n-Vki6q3I_0 2024-09-12T01:38:00.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.417+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18011383892437004801', time=2024-09-12T03:13:16.983979+0000, chain.objs.size()=1 2024-09-12T01:38:00.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.417+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.EwKDQfh1oqdmzQVAxScC65D1pv_zIlb_0 2024-09-12T01:38:00.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.417+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3014327388765629080', time=2024-09-12T03:13:53.585563+0000, chain.objs.size()=1 2024-09-12T01:38:00.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.417+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.JQ4LhDJz98wjSU9oBi9ySBYQbaRgPEP_0 2024-09-12T01:38:00.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.417+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6920021080583264851', time=2024-09-12T03:13:53.835207+0000, chain.objs.size()=1 2024-09-12T01:38:00.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.417+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.StOIKY-0HYq-lpXfum4Kh5LbzoXeuOU_0 2024-09-12T01:38:00.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.420+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11643302673027855417', time=2024-09-12T03:13:54.503704+0000, chain.objs.size()=1 2024-09-12T01:38:00.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.420+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.WqZKElNupzn3E-sre5GYnv86IIL_iBS_0 2024-09-12T01:38:00.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.420+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6274358063293183026', time=2024-09-12T03:13:54.510346+0000, chain.objs.size()=1 2024-09-12T01:38:00.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.420+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.DAILAWsvkVW1e0qw7It0txQeCvywvyP_0 2024-09-12T01:38:00.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.423+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15932657727584631214', time=2024-09-12T03:13:55.304510+0000, chain.objs.size()=1 2024-09-12T01:38:00.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.423+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.D1d4H2SG5pyt2d-sb9f-5uUD-e82MV6_0 2024-09-12T01:38:00.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.423+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10994284053134714528', time=2024-09-12T03:13:55.957062+0000, chain.objs.size()=1 2024-09-12T01:38:00.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.423+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.RqONhWAqwoHAMqZPekGxR8ARaDfuTU2_0 2024-09-12T01:38:00.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.423+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12086161356795380844', time=2024-09-12T03:13:56.512370+0000, chain.objs.size()=1 2024-09-12T01:38:00.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.423+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.O7pWKa7NjDczDaGtFctZ_a289ciU0tO_0 2024-09-12T01:38:00.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.423+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18049226033016855375', time=2024-09-12T03:13:56.646158+0000, chain.objs.size()=1 2024-09-12T01:38:00.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.423+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.k5AibM08AaxIoiCw0f3hLb8I-yLKcFk_0 2024-09-12T01:38:00.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.423+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11300770335604595870', time=2024-09-12T03:13:56.650787+0000, chain.objs.size()=1 2024-09-12T01:38:00.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.423+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.65Io5O4IjsiwLVEkoxOPQ2aZJBtSdKH_0 2024-09-12T01:38:00.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.423+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.820349693584703505', time=2024-09-12T03:13:56.745917+0000, chain.objs.size()=1 2024-09-12T01:38:00.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.423+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.XHC3hB4up0XM6eYWXMYA7zLkIJXiG8R_0 2024-09-12T01:38:00.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.423+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.600437742234874406', time=2024-09-12T03:13:56.756682+0000, chain.objs.size()=1 2024-09-12T01:38:00.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.423+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.J753IN4uE_-aIk8_RGOC3NJZIAbuCDE_0 2024-09-12T01:38:00.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.423+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5964825295877982411', time=2024-09-12T03:13:58.241246+0000, chain.objs.size()=1 2024-09-12T01:38:00.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.423+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.rz0fl8qDtxM_-MRX6KI3KPYxffRVKxu_0 2024-09-12T01:38:00.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.423+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15893316571558489926', time=2024-09-12T03:13:58.444721+0000, chain.objs.size()=1 2024-09-12T01:38:00.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.423+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Uy3VZPdgmcSvwKPBuSa51ZMR72yg5ey_0 2024-09-12T01:38:00.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.423+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1057173271132962260', time=2024-09-12T03:13:58.803759+0000, chain.objs.size()=1 2024-09-12T01:38:00.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.423+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_._Dqpzxm70ZsBpneMXHmmKwLV2uEnNVB_0 2024-09-12T01:38:00.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.426+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15161309143136872656', time=2024-09-12T03:13:59.186430+0000, chain.objs.size()=1 2024-09-12T01:38:00.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.426+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.ul-kCCN69z-IlOrP2c34IYr_seCry_E_0 2024-09-12T01:38:00.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.426+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4534347869858781535', time=2024-09-12T03:13:59.216276+0000, chain.objs.size()=1 2024-09-12T01:38:00.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.426+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.2D5AcNhJ4sb2fZO1k7M7R4IXrLVhdX8_0 2024-09-12T01:38:00.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.426+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.454308503343489567', time=2024-09-12T03:13:59.364967+0000, chain.objs.size()=1 2024-09-12T01:38:00.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.426+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.naOxYXXln3OQuVGY99C77Hub7kRJM9c_0 2024-09-12T01:38:00.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.429+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10036352754434726739', time=2024-09-12T03:13:59.600752+0000, chain.objs.size()=1 2024-09-12T01:38:00.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.429+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.0zDh90M2dQpkBYWfFh2TvAfd5_bSMDj_0 2024-09-12T01:38:00.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.429+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9632864385454510240', time=2024-09-12T03:13:59.948673+0000, chain.objs.size()=1 2024-09-12T01:38:00.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.429+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Aolm9xk1kbVEiE1Zh5P2qZXQuGS69Al_0 2024-09-12T01:38:00.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.429+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14072011709080579608', time=2024-09-12T03:14:00.044255+0000, chain.objs.size()=1 2024-09-12T01:38:00.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.429+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.u7IYfZdYdzZof8tWQg1gixMAuK0iOvA_0 2024-09-12T01:38:00.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.429+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14617275590498524312', time=2024-09-12T03:14:00.429121+0000, chain.objs.size()=1 2024-09-12T01:38:00.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.429+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.cvptUwFFLZBpDRZrly033YEKyyzSvOa_0 2024-09-12T01:38:00.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.429+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3927655038629070707', time=2024-09-12T03:14:00.960601+0000, chain.objs.size()=1 2024-09-12T01:38:00.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.429+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.rLoP4u3cDaT25CIwyDJwINmKXIJ3TZC_0 2024-09-12T01:38:00.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.429+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6316538784005995225', time=2024-09-12T03:14:01.125548+0000, chain.objs.size()=1 2024-09-12T01:38:00.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.429+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.gSWysW9k86v9ULDRbC2TwQwVdAtX6Gc_0 2024-09-12T01:38:00.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.429+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10579562682666786934', time=2024-09-12T03:14:01.856848+0000, chain.objs.size()=1 2024-09-12T01:38:00.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.429+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Kp9id5G2D6D9Q_pQjkuAhIIKOHH_TC__0 2024-09-12T01:38:00.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.429+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9280359637899536440', time=2024-09-12T03:14:02.038741+0000, chain.objs.size()=1 2024-09-12T01:38:00.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.429+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.sECgirN3MFXwPGKNGr6XVF-bp6_hhnG_0 2024-09-12T01:38:00.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.429+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15577895660698357452', time=2024-09-12T03:14:02.567953+0000, chain.objs.size()=1 2024-09-12T01:38:00.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.429+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.l2dnwBgY1caqLGMT411frcOyI5AUrE6_0 2024-09-12T01:38:00.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.429+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8665438315083562645', time=2024-09-12T03:14:03.014902+0000, chain.objs.size()=1 2024-09-12T01:38:00.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.429+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.r5LevN0y7LFIOJDUlMiYL2E2JAxrnlz_0 2024-09-12T01:38:00.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.429+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11269074616201675818', time=2024-09-12T03:14:03.060170+0000, chain.objs.size()=1 2024-09-12T01:38:00.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.429+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.TpcVcIhXwEq8hhrpEDsmTpeO_zewFLn_0 2024-09-12T01:38:00.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.434+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2485934560820038697', time=2024-09-12T03:14:03.315784+0000, chain.objs.size()=1 2024-09-12T01:38:00.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.434+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.wBskuV4IoQsZCc6lyW0VekYd5C7vNra_0 2024-09-12T01:38:00.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.434+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12882499289463494641', time=2024-09-12T03:14:11.556442+0000, chain.objs.size()=1 2024-09-12T01:38:00.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.434+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.333__shadow_.vHM5W6KJLlk7Ei7pgogPWwizv3JNXQj_0 2024-09-12T01:38:00.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.434+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11903857038975901107', time=2024-09-12T03:14:54.797676+0000, chain.objs.size()=1 2024-09-12T01:38:00.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.434+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.381__shadow_.k5tye2s_GDVVinEfzKd-tWvkK8IxVfH_0 2024-09-12T01:38:00.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.434+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14690706454335248599', time=2024-09-12T03:15:49.126303+0000, chain.objs.size()=1 2024-09-12T01:38:00.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.434+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.437__shadow_.NGJzBeZ1737S7NO_305ICNwgrHk2pm3_0 2024-09-12T01:38:00.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.434+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4139271925878610646', time=2024-09-12T03:16:16.598326+0000, chain.objs.size()=1 2024-09-12T01:38:00.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.434+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.461__shadow_.sPuI7egJnn3XfZlGwSZYqQpOnViH1za_0 2024-09-12T01:38:00.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.434+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8452460232524304173', time=2024-09-12T03:16:31.807287+0000, chain.objs.size()=1 2024-09-12T01:38:00.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.434+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.481__shadow_.928wi5HAqgHGTuxKPh1YbrrdB92hhXp_0 2024-09-12T01:38:00.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.434+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1456094576669520199', time=2024-09-12T03:16:45.524147+0000, chain.objs.size()=1 2024-09-12T01:38:00.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.434+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.491__shadow_.JGBIfG_Noi4SZmMhosrxtfJV_laYCkq_0 2024-09-12T01:38:00.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.434+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14715807515529168898', time=2024-09-12T03:20:30.292453+0000, chain.objs.size()=2 2024-09-12T01:38:00.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.434+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.523__multipart_mymultipart.2~3NAUAIUzM9rR-qLzrBvz4BjWcxT3RFl.1 2024-09-12T01:38:00.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.434+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.523__multipart_mymultipart.2~3NAUAIUzM9rR-qLzrBvz4BjWcxT3RFl.2 2024-09-12T01:38:00.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.439+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 0/45135 2024-09-12T01:38:00.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.442+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-12T01:38:00.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.442+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7614633967649483043', time=2024-09-12T03:22:42.166011+0000, chain.objs.size()=1 2024-09-12T01:38:00.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.442+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.557__shadow_.suhdazyM8Y8dIvnu_4pOVOwHvmYoYTn_0 2024-09-12T01:38:00.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.442+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15654194298787686452', time=2024-09-12T03:23:10.111444+0000, chain.objs.size()=1 2024-09-12T01:38:00.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.442+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.569__shadow:287U612OiU.RqewPg2oWw26r8-SS81Q_.w_FYvX7cQCj49Iq4IGOYdnQo6V0XJ1o_0 2024-09-12T01:38:00.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.442+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11554474482199732995', time=2024-09-12T03:23:18.565286+0000, chain.objs.size()=1 2024-09-12T01:38:00.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.442+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.569__shadow:Zhrp02JgC0biVlXwG2DmqLijX-70Zf2_.05bqv2g00TIEtBfE-Vhwwuu6IEgBvjW_0 2024-09-12T01:38:00.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.442+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10386538731932937982', time=2024-09-12T03:23:35.994746+0000, chain.objs.size()=1 2024-09-12T01:38:00.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.442+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.576__shadow:dMSDxQ6QtOqAruP9rzOJwiyV1SEwQfP_.EehC5WTrLl2ZPUd0jWgH2R6ZldqDUvk_0 2024-09-12T01:38:00.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.442+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10469083525415218924', time=2024-09-12T03:23:47.549836+0000, chain.objs.size()=1 2024-09-12T01:38:00.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.442+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.577__shadow:d5gGnmdF4QeBAhC1D5IPQtkwOb9lFj6_.bp-sBHJnOKnliagefCWsGrR5izoV23G_0 2024-09-12T01:38:00.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.442+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1538358062624961312', time=2024-09-12T03:23:58.086105+0000, chain.objs.size()=1 2024-09-12T01:38:00.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.442+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.577__shadow:Af5dO2YHUB7hDnMsUWDEJ3xLrH57.0H_.bo8jvDvABtvM7-ytN7SqlWot36u_2lQ_0 2024-09-12T01:38:00.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.442+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14046432659383297410', time=2024-09-12T03:24:36.635787+0000, chain.objs.size()=1 2024-09-12T01:38:00.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.442+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.579__shadow:HSEiG22BY4s7XZHuKbxznpk8fOlCb2D_.XRf3dNjnkphTv6zy_ND3vUp40vCQU-l_0 2024-09-12T01:38:00.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.442+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1231155616671459941', time=2024-09-12T03:24:41.431790+0000, chain.objs.size()=1 2024-09-12T01:38:00.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.442+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.583__shadow:wD.fV2NneKQLPNTLux9HPhObnt.tsz6_.brBbDXsxcmlIg0L49Ezxxnv9s8uFncS_0 2024-09-12T01:38:00.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.442+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16423168183676884521', time=2024-09-12T03:25:03.504678+0000, chain.objs.size()=1 2024-09-12T01:38:00.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.442+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.605__shadow_.qGjNE7Q7atHGX79keHOlnlAGHUWR7nW_0 2024-09-12T01:38:00.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.442+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4252402642742157617', time=2024-09-12T03:30:59.034507+0000, chain.objs.size()=1 2024-09-12T01:38:00.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.442+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.664__shadow_.2inbIlj6Th7OSFF8CwEdFmWOzJRqsp1_0 2024-09-12T01:38:00.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.442+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2604884744064030587', time=2024-09-12T03:31:26.472726+0000, chain.objs.size()=1 2024-09-12T01:38:00.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.442+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.697__shadow:8FIbaUvt0F.V8.ql0fqqM7vAP3RCAlm_.fN7st5wbk64Qk49w2os-r-tkHtypR5a_0 2024-09-12T01:38:00.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.449+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:38:00.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.451+0000 7f8786c98800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T01:38:00.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.453+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:38:00.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.453+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:38:00.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.454+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46792' 2024-09-12T01:38:00.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.454+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='_yJjJcllQu_a9eoKRRn23_9zgmTXC9Kn', time=2024-09-12T03:06:50.731524+0000, chain.objs.size()=2 2024-09-12T01:38:00.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.454+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.160__shadow_.UHA9P5ikfmt0U51BWMUjvl8Jjr5F4ZV_0 2024-09-12T01:38:00.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.454+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.160__shadow_.UHA9P5ikfmt0U51BWMUjvl8Jjr5F4ZV_1 2024-09-12T01:38:00.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.454+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='_OSZDu6uX04DjnJWYD-qnaZjDO03zQp7', time=2024-09-12T03:07:15.697463+0000, chain.objs.size()=1 2024-09-12T01:38:00.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.454+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.163__shadow_.cC_vLEaHkdTrvAsxMWAKGMng-ipehKN_0 2024-09-12T01:38:00.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.454+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17077790678084942335', time=2024-09-12T03:07:38.548565+0000, chain.objs.size()=1 2024-09-12T01:38:00.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.454+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.176__shadow_.-bcMtUPpA1tcLWZXqwPwMxW3mpgZm1R_0 2024-09-12T01:38:00.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.454+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='2~5kSOX4HDV7IPROasR2JkbNr69n4Kvg7', time=2024-09-12T03:08:15.157115+0000, chain.objs.size()=1 2024-09-12T01:38:00.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.454+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.202__multipart_mymultipart.2~5kSOX4HDV7IPROasR2JkbNr69n4Kvg7.1 2024-09-12T01:38:00.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.454+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9896246715291779735', time=2024-09-12T03:10:20.270374+0000, chain.objs.size()=1 2024-09-12T01:38:00.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.454+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.243__shadow_.5RW89QbagJxraF1g-YHdAi8motE43zx_0 2024-09-12T01:38:00.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.454+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4754673101228339544', time=2024-09-12T03:10:36.446760+0000, chain.objs.size()=1 2024-09-12T01:38:00.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.454+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.259__shadow_.PITN-Dv15pcCrsOhEhDxCLNwK4h4b16_0 2024-09-12T01:38:00.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.454+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12972901911658816231', time=2024-09-12T03:11:14.439850+0000, chain.objs.size()=1 2024-09-12T01:38:00.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.454+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.M9PekKo1i0KBx5dJGlWR8QG5FyF0oRg_0 2024-09-12T01:38:00.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.454+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17975591341322118240', time=2024-09-12T03:11:15.140068+0000, chain.objs.size()=1 2024-09-12T01:38:00.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.454+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Oc8CQ_VYkw_yRgGXFmJSXOL3SdqY34P_0 2024-09-12T01:38:00.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.454+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13628406002247907735', time=2024-09-12T03:11:15.300780+0000, chain.objs.size()=1 2024-09-12T01:38:00.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.454+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Lo70Unj3A9OftPHwAZjV1OPbkAoY4qk_0 2024-09-12T01:38:00.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.454+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6872253126336529218', time=2024-09-12T03:11:15.982098+0000, chain.objs.size()=1 2024-09-12T01:38:00.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.454+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.mn_l1oHlnaz1LM_-7o7zbDAO0ncc3-u_0 2024-09-12T01:38:00.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.454+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7458482599695879289', time=2024-09-12T03:11:17.402514+0000, chain.objs.size()=1 2024-09-12T01:38:00.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.454+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.xeU5xQWr--5TOaLru93PKTrSsg9zZwL_0 2024-09-12T01:38:00.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.457+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8067701660263648351', time=2024-09-12T03:11:17.485396+0000, chain.objs.size()=1 2024-09-12T01:38:00.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.457+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.rtJlkxoxA5WvYsj9bE861aT585jVoD-_0 2024-09-12T01:38:00.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.458+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13401989256993035121', time=2024-09-12T03:11:17.881885+0000, chain.objs.size()=1 2024-09-12T01:38:00.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.458+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.tp-lKgOsSaDOfLAb8e_N_f5yuznff-M_0 2024-09-12T01:38:00.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.458+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11875940306185366781', time=2024-09-12T03:11:18.132767+0000, chain.objs.size()=1 2024-09-12T01:38:00.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.458+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.SSdC4kXdfEPPPh4MMM6J0Q02-XCwRGN_0 2024-09-12T01:38:00.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.458+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3843127457978400417', time=2024-09-12T03:11:18.300303+0000, chain.objs.size()=1 2024-09-12T01:38:00.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.458+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.iXBNNfC6EVOR6fOBLVRi3O28ACXwVg0_0 2024-09-12T01:38:00.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.458+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11179409821474527315', time=2024-09-12T03:11:19.025222+0000, chain.objs.size()=1 2024-09-12T01:38:00.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.458+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.epwSv482AADxaamx7Djnx5FG88FLIQ8_0 2024-09-12T01:38:00.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.458+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1626951295428504198', time=2024-09-12T03:11:19.058779+0000, chain.objs.size()=1 2024-09-12T01:38:00.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.458+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Y9NC6LZMAyg6YlxUyhhY1EzxY9WDfy9_0 2024-09-12T01:38:00.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.458+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8873225654970051426', time=2024-09-12T03:11:19.059594+0000, chain.objs.size()=1 2024-09-12T01:38:00.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.458+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.hzFq2WG8SFVpucTHqnmPCNDSYnYUcci_0 2024-09-12T01:38:00.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.458+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12869709949299884097', time=2024-09-12T03:11:19.234121+0000, chain.objs.size()=1 2024-09-12T01:38:00.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.458+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.BlhLFMkxYKFEgXerRun55NScw2dR_CZ_0 2024-09-12T01:38:00.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.458+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3665083985070484611', time=2024-09-12T03:11:19.349906+0000, chain.objs.size()=1 2024-09-12T01:38:00.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.458+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.bhwSuFyG3z719Pid4Ip9J1vvd0kfktD_0 2024-09-12T01:38:00.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.460+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8120190018076405362', time=2024-09-12T03:11:19.622426+0000, chain.objs.size()=1 2024-09-12T01:38:00.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.460+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.2wi1Iie6vDEL-jWn46YaKChIePxxkXX_0 2024-09-12T01:38:00.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.460+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13448560832294835871', time=2024-09-12T03:11:19.770197+0000, chain.objs.size()=1 2024-09-12T01:38:00.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.460+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.UyJ22xJCIhvlJgjExox5_1Obn5zSyTt_0 2024-09-12T01:38:00.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.460+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11682393505663675954', time=2024-09-12T03:11:20.362211+0000, chain.objs.size()=1 2024-09-12T01:38:00.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.460+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.mfW0J5_QBhQ_72j0mdJCdokk9uOKZFZ_0 2024-09-12T01:38:00.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.460+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10267121181722824731', time=2024-09-12T03:11:20.494777+0000, chain.objs.size()=1 2024-09-12T01:38:00.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.460+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.-vwzEKdwl4yYqHWkoRajCz27ddr2VqQ_0 2024-09-12T01:38:00.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.463+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10082497505431475121', time=2024-09-12T03:11:20.772490+0000, chain.objs.size()=1 2024-09-12T01:38:00.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.463+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.ki8Ge-XJAi0rs85u6HXjsvJkRyljK1z_0 2024-09-12T01:38:00.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.463+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4574896009187094620', time=2024-09-12T03:11:20.773225+0000, chain.objs.size()=1 2024-09-12T01:38:00.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.463+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.yOSK0bs8ayWNcF_kbLUlHV2kWBHXGXn_0 2024-09-12T01:38:00.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.463+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2903772592253105504', time=2024-09-12T03:11:20.933626+0000, chain.objs.size()=1 2024-09-12T01:38:00.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.463+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.x1cJBWykxfno4Z5pHmCqvWYeRoGritg_0 2024-09-12T01:38:00.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.463+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11020849774062695253', time=2024-09-12T03:11:21.537614+0000, chain.objs.size()=1 2024-09-12T01:38:00.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.463+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.27Eju9eTXMRaW98O84e2vQULcHCHkZe_0 2024-09-12T01:38:00.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.463+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12015825749786763913', time=2024-09-12T03:11:21.538950+0000, chain.objs.size()=1 2024-09-12T01:38:00.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.463+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.u_3940a--Ub5d91xUuS9szKWkT5hSRX_0 2024-09-12T01:38:00.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.463+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13724601728108113216', time=2024-09-12T03:11:22.143226+0000, chain.objs.size()=1 2024-09-12T01:38:00.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.463+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.D6EhCknTMf9hhruw-44vpsyHRP9DY3e_0 2024-09-12T01:38:00.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.463+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15615344619715252356', time=2024-09-12T03:11:22.277990+0000, chain.objs.size()=1 2024-09-12T01:38:00.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.463+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.nHOVOuNeFUr4PHgGSoW2905XGUTUgie_0 2024-09-12T01:38:00.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.465+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17531929625530165287', time=2024-09-12T03:11:22.350391+0000, chain.objs.size()=1 2024-09-12T01:38:00.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.465+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.naVqdz3ZurLrdtoK6z-_B91Ly7PZqJ2_0 2024-09-12T01:38:00.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.465+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15674843383234724914', time=2024-09-12T03:11:22.417212+0000, chain.objs.size()=1 2024-09-12T01:38:00.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.465+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.jTfSE630tQ1YVGHErSpLEjyjgtFuCJT_0 2024-09-12T01:38:00.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.465+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18257471320932478659', time=2024-09-12T03:11:22.857555+0000, chain.objs.size()=1 2024-09-12T01:38:00.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.465+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.fLAAci-78Lc_95ICF15yaHkdEALMEsj_0 2024-09-12T01:38:00.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.465+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15636781381558496200', time=2024-09-12T03:11:23.085472+0000, chain.objs.size()=1 2024-09-12T01:38:00.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.465+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.ykmqH_ivt4UvZ6xVUExKiVzqimNTuzL_0 2024-09-12T01:38:00.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.468+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14469208404248242377', time=2024-09-12T03:11:23.186453+0000, chain.objs.size()=1 2024-09-12T01:38:00.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.468+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Le_nZfc-Or4Glq02M0vz5_kbDpUbeXL_0 2024-09-12T01:38:00.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.468+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3540028758688307409', time=2024-09-12T03:11:23.243523+0000, chain.objs.size()=1 2024-09-12T01:38:00.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.468+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.wTU7cRvl-nm6ZFFqEmp1fI9HrnCE1kY_0 2024-09-12T01:38:00.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.468+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16780849869771699322', time=2024-09-12T03:11:23.272979+0000, chain.objs.size()=1 2024-09-12T01:38:00.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.468+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.bkaxSkS3qw3tunclHZDwmTb8Csul5C-_0 2024-09-12T01:38:00.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.468+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12686722941086362048', time=2024-09-12T03:11:23.363209+0000, chain.objs.size()=1 2024-09-12T01:38:00.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.468+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.MS6qNXwD5W_GfC0PoVWlCHc--OOokJV_0 2024-09-12T01:38:00.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.468+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1291474699594040287', time=2024-09-12T03:11:24.789090+0000, chain.objs.size()=1 2024-09-12T01:38:00.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.468+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.DRaXadqy2ppr_z3qqIF1IaZgmQw6xr2_0 2024-09-12T01:38:00.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.468+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13276331074761135044', time=2024-09-12T03:11:24.851328+0000, chain.objs.size()=1 2024-09-12T01:38:00.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.468+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.UZpOQZGX3K-a6c-6OXqR9K7kfzvnzRZ_0 2024-09-12T01:38:00.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.468+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16905550726366607923', time=2024-09-12T03:11:24.887253+0000, chain.objs.size()=1 2024-09-12T01:38:00.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.468+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.wS5Y1pb8V-RUQZFfBLIPs5QFMkUH-Vm_0 2024-09-12T01:38:00.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.468+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4137407096615120488', time=2024-09-12T03:11:24.897827+0000, chain.objs.size()=1 2024-09-12T01:38:00.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.468+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.V1nb4guxYHo__6V5UrOYo62Tw91xEBQ_0 2024-09-12T01:38:00.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.471+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5743838073871265364', time=2024-09-12T03:11:46.900543+0000, chain.objs.size()=1 2024-09-12T01:38:00.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.471+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.285__shadow_.HUqnhu1ZSO1J6GY_RQzE37vwlRjXqNm_0 2024-09-12T01:38:00.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.471+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11668217116432410016', time=2024-09-12T03:11:55.333805+0000, chain.objs.size()=1 2024-09-12T01:38:00.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.471+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.292__shadow_.nfj0spiJVT2PvhlUXde7CfUvW-Nebef_0 2024-09-12T01:38:00.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.471+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14440510498840358000', time=2024-09-12T03:12:04.664712+0000, chain.objs.size()=1 2024-09-12T01:38:00.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.471+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.300__shadow_.V1Bbitd30JzzIi-KYqy7MRJRuHbj6nP_0 2024-09-12T01:38:00.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.471+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9176463164394442254', time=2024-09-12T03:12:12.266037+0000, chain.objs.size()=1 2024-09-12T01:38:00.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.471+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.307__shadow:QMNCfS23-IrY23I6FKv1An-nz7W76V8_.x7IDFdWYwtUff_8fh0_scbuphnBcol-_0 2024-09-12T01:38:00.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.471+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13483915465117313060', time=2024-09-12T03:12:27.489254+0000, chain.objs.size()=1 2024-09-12T01:38:00.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.471+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.319__shadow:OudeBzV4XksFwTQzFhUaJoHDDeM0Feq_.okw7IF5iPZ1wPy0QaGc1FK2HCL_FXAj_0 2024-09-12T01:38:00.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.471+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3830268437867591382', time=2024-09-12T03:13:07.207526+0000, chain.objs.size()=1 2024-09-12T01:38:00.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.471+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.NUNxipYCW9WelPhjcPoXMzQncVrkp4T_0 2024-09-12T01:38:00.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.473+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8066861079193783314', time=2024-09-12T03:13:07.296368+0000, chain.objs.size()=1 2024-09-12T01:38:00.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.473+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.2HlsBFRP1sHBYw8OWHpbzR2CWMYo6tQ_0 2024-09-12T01:38:00.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.473+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11448316231152398420', time=2024-09-12T03:13:08.561215+0000, chain.objs.size()=1 2024-09-12T01:38:00.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.473+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.0f8vtF4kdK-7kQiS4zniZT4ihppe521_0 2024-09-12T01:38:00.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.473+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18011140013695543503', time=2024-09-12T03:13:08.746546+0000, chain.objs.size()=1 2024-09-12T01:38:00.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.473+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.8Jbk2eBrJ0bUQj7sHe4WNOUuf11JHJN_0 2024-09-12T01:38:00.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.473+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1434895062086338789', time=2024-09-12T03:13:09.053036+0000, chain.objs.size()=1 2024-09-12T01:38:00.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.473+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.EH_JjIkUWGOFxk-GzpeZs8R__tDjrYc_0 2024-09-12T01:38:00.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.473+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13920165388040380690', time=2024-09-12T03:13:09.053545+0000, chain.objs.size()=1 2024-09-12T01:38:00.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.473+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.PxoQ-KQPL_agqjS-JSA3gWaJvanBsKU_0 2024-09-12T01:38:00.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.473+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4143407071146142322', time=2024-09-12T03:13:10.240091+0000, chain.objs.size()=1 2024-09-12T01:38:00.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.473+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.Z0W5AirCR1h4ZyMK6Xb0WXuHia43amc_0 2024-09-12T01:38:00.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.474+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11118387427858554951', time=2024-09-12T03:13:10.562681+0000, chain.objs.size()=1 2024-09-12T01:38:00.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.474+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.XHXjFqJmsdR8S-XqxqG2Skd5Gp1XaGv_0 2024-09-12T01:38:00.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.476+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10435262796331408693', time=2024-09-12T03:13:10.611708+0000, chain.objs.size()=1 2024-09-12T01:38:00.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.476+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.exsTpaRQ9UWYI5MQ0ce_sj6I1vHisJ4_0 2024-09-12T01:38:00.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.476+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17355095304899878808', time=2024-09-12T03:13:10.612471+0000, chain.objs.size()=1 2024-09-12T01:38:00.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.476+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.cwOaD6n5P_LodbW9c52pzbzm4_lMElv_0 2024-09-12T01:38:00.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.476+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8972519480948964035', time=2024-09-12T03:13:11.649319+0000, chain.objs.size()=1 2024-09-12T01:38:00.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.476+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.5tnhouIv5D5iCLrfNpsdd1xNWQkDMDH_0 2024-09-12T01:38:00.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.476+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8479844567740016198', time=2024-09-12T03:13:12.806491+0000, chain.objs.size()=1 2024-09-12T01:38:00.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.476+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.i81UYFrHTHLYl82JoYPbYMqX6ZF7fUk_0 2024-09-12T01:38:00.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.476+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13523006510355678444', time=2024-09-12T03:13:13.051462+0000, chain.objs.size()=1 2024-09-12T01:38:00.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.476+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.mvjhWZp2yRcp4bI4jMbPv2j-iLemliq_0 2024-09-12T01:38:00.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.479+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10389247984144586788', time=2024-09-12T03:13:13.934102+0000, chain.objs.size()=1 2024-09-12T01:38:00.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.479+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.e1XelH59D_48s1Hgb5gCtxL4OcyR94d_0 2024-09-12T01:38:00.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.479+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3744021939871710019', time=2024-09-12T03:13:14.320116+0000, chain.objs.size()=1 2024-09-12T01:38:00.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.479+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.xYIZ84iaUN2UbDa2mg2KT01vR8AJJkP_0 2024-09-12T01:38:00.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.479+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17721139724981774058', time=2024-09-12T03:13:14.320894+0000, chain.objs.size()=1 2024-09-12T01:38:00.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.479+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.NZVKFRynyV5k3Neb104A7ePKQlT4N9L_0 2024-09-12T01:38:00.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.479+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13925102384207107548', time=2024-09-12T03:13:15.085991+0000, chain.objs.size()=1 2024-09-12T01:38:00.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.479+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.umir7dhBimgk56Z_nI3YIWyP06BySjt_0 2024-09-12T01:38:00.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.479+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16788165783187893167', time=2024-09-12T03:13:15.247820+0000, chain.objs.size()=1 2024-09-12T01:38:00.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.479+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.ngaD-CndRmcD2LiPcu55e4wngDu7zCR_0 2024-09-12T01:38:00.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.479+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2971266897247185047', time=2024-09-12T03:13:15.454191+0000, chain.objs.size()=1 2024-09-12T01:38:00.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.479+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.UmcUKJfSDlCCmQQf_n4nmQmzFFXbg6X_0 2024-09-12T01:38:00.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.479+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14683897634496056162', time=2024-09-12T03:13:15.632104+0000, chain.objs.size()=1 2024-09-12T01:38:00.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.479+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.iFL9pLuc3yQeFh1RtMLNBDmlzK4yLfL_0 2024-09-12T01:38:00.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.479+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5977443965590574427', time=2024-09-12T03:13:15.796806+0000, chain.objs.size()=1 2024-09-12T01:38:00.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.479+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.9TIVti1b4TC81iq0Oshi2dqdFqNFUio_0 2024-09-12T01:38:00.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.479+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8270855675579984451', time=2024-09-12T03:13:16.065225+0000, chain.objs.size()=1 2024-09-12T01:38:00.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.479+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.vqm4inrz7MtIlW_GK04i9YfZncxJDX3_0 2024-09-12T01:38:00.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.481+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11359148494732634456', time=2024-09-12T03:13:16.727242+0000, chain.objs.size()=1 2024-09-12T01:38:00.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.481+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.pWabyjJ_tKSvfwvFTsIYBD0dVOl3gM7_0 2024-09-12T01:38:00.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.481+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7910010689105192183', time=2024-09-12T03:13:16.779447+0000, chain.objs.size()=1 2024-09-12T01:38:00.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.481+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.OPmHj2nJWq5rAbeTUnkN-kZ3jDdmlDO_0 2024-09-12T01:38:00.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.481+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3213247480236096863', time=2024-09-12T03:13:16.845848+0000, chain.objs.size()=1 2024-09-12T01:38:00.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.481+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.xHkC02OP_5wHQFOSW-5RjBxqHfSdE0f_0 2024-09-12T01:38:00.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.481+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6302258655470329410', time=2024-09-12T03:13:17.115499+0000, chain.objs.size()=1 2024-09-12T01:38:00.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.481+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.IF-u3GST9xYRfDrSqI6BheEumYKLnau_0 2024-09-12T01:38:00.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.481+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13558274225244820911', time=2024-09-12T03:13:17.136893+0000, chain.objs.size()=1 2024-09-12T01:38:00.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.481+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.Kt3AP7VNZicZVF4A4zh3NMgjUqopVkA_0 2024-09-12T01:38:00.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.483+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5027937577458282796', time=2024-09-12T03:13:53.561851+0000, chain.objs.size()=1 2024-09-12T01:38:00.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.483+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.8spBhMX0117OLVaJxgP-DbVp3BuZ2AQ_0 2024-09-12T01:38:00.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.483+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14232495188895763745', time=2024-09-12T03:13:53.606965+0000, chain.objs.size()=1 2024-09-12T01:38:00.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.483+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.4taTYTqETFKMj70iJmOEBTXGxanPqmL_0 2024-09-12T01:38:00.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.483+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4037437787253685835', time=2024-09-12T03:13:53.707232+0000, chain.objs.size()=1 2024-09-12T01:38:00.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.483+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.7eRPH_ebpUJ9hhY_TinLURheJJcmT8e_0 2024-09-12T01:38:00.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.483+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8042822624846562816', time=2024-09-12T03:13:53.708080+0000, chain.objs.size()=1 2024-09-12T01:38:00.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.483+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.rNgfKwkHQ3GOqWP4oKIsZ7MDItTEjGt_0 2024-09-12T01:38:00.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.483+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9824430786828315455', time=2024-09-12T03:13:53.852630+0000, chain.objs.size()=1 2024-09-12T01:38:00.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.483+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.9g-k4J3MoJ_KOFYA3ehyZPtWq8HvX4S_0 2024-09-12T01:38:00.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.483+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3283538232402735177', time=2024-09-12T03:13:54.198537+0000, chain.objs.size()=1 2024-09-12T01:38:00.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.483+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.HU_3gnoVYMDUIlJg1XV8xvkwfDhVurd_0 2024-09-12T01:38:00.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.483+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7870299866646038769', time=2024-09-12T03:13:54.428428+0000, chain.objs.size()=1 2024-09-12T01:38:00.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.483+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.eQESf2rxXr--llGkJdAnGmLiJaEQL83_0 2024-09-12T01:38:00.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.484+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12571346525016466298', time=2024-09-12T03:13:55.093523+0000, chain.objs.size()=1 2024-09-12T01:38:00.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.484+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.97i7RYpu-qnGeUL1MpsWlVjWM3x75R2_0 2024-09-12T01:38:00.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.484+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14447033357519212151', time=2024-09-12T03:13:55.321426+0000, chain.objs.size()=1 2024-09-12T01:38:00.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.484+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.l-WA0X11SpMCHuGuAmGje-cjoynFVmN_0 2024-09-12T01:38:00.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.484+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3571153146333175464', time=2024-09-12T03:13:56.486384+0000, chain.objs.size()=1 2024-09-12T01:38:00.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.484+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.vnWCGZT27mIATxCxSy_zWAcVjJyUvCB_0 2024-09-12T01:38:00.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.484+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16597415322463755267', time=2024-09-12T03:13:56.997154+0000, chain.objs.size()=1 2024-09-12T01:38:00.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.484+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Q40x4X5sb8tleCV5N8GSVg52j3FxCMI_0 2024-09-12T01:38:00.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.486+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.226506313203783144', time=2024-09-12T03:13:57.820454+0000, chain.objs.size()=1 2024-09-12T01:38:00.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.486+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.UaT5Gp3tRRAY1N0d3YiBgjwN_j1JOyx_0 2024-09-12T01:38:00.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.486+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12925274592921763468', time=2024-09-12T03:13:58.091740+0000, chain.objs.size()=1 2024-09-12T01:38:00.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.486+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.T5P700uUizLaXPKXh336voiSSqQYtHY_0 2024-09-12T01:38:00.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.487+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4874722869129331442', time=2024-09-12T03:13:58.408958+0000, chain.objs.size()=1 2024-09-12T01:38:00.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.487+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.vff6CjYbEj4jVFp8UJ2uROWzIMboCZY_0 2024-09-12T01:38:00.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.487+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17901217022553828404', time=2024-09-12T03:13:58.559616+0000, chain.objs.size()=1 2024-09-12T01:38:00.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.487+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.nPc8KMGVCNZRvVUwfcOBue58AufbUzy_0 2024-09-12T01:38:00.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.487+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3973419727143097184', time=2024-09-12T03:13:58.592748+0000, chain.objs.size()=1 2024-09-12T01:38:00.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.487+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.csNf8SpEEwNWY2OzJ4hb9DdZq2wjf7z_0 2024-09-12T01:38:00.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.487+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12813198004573127854', time=2024-09-12T03:13:58.712649+0000, chain.objs.size()=1 2024-09-12T01:38:00.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.487+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.N0Y2rTWGRydNqDAerWGOY-wkp1-oX4K_0 2024-09-12T01:38:00.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.487+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14371211146700398913', time=2024-09-12T03:13:59.146619+0000, chain.objs.size()=1 2024-09-12T01:38:00.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.487+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.YRRPfTYPlzNQJHLtNBQUHX5QqgTPDRj_0 2024-09-12T01:38:00.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.487+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17467122039025481221', time=2024-09-12T03:13:59.340667+0000, chain.objs.size()=1 2024-09-12T01:38:00.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.487+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.JzAPHj1eH5emKKpkXM3e2QIrKHsxRpw_0 2024-09-12T01:38:00.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.487+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9473310249345414989', time=2024-09-12T03:13:59.465716+0000, chain.objs.size()=1 2024-09-12T01:38:00.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.487+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.lpGGXp5nk1GCwCjsFEJsUKvOW16I_lw_0 2024-09-12T01:38:00.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.487+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18352323725129219120', time=2024-09-12T03:13:59.817247+0000, chain.objs.size()=1 2024-09-12T01:38:00.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.487+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.8YQKp6qL7CQDChj6slntGJ8EILJIIzY_0 2024-09-12T01:38:00.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.487+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6572936418011955683', time=2024-09-12T03:14:00.575716+0000, chain.objs.size()=1 2024-09-12T01:38:00.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.487+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.sfXUL0CoMqHNDhvW2iGndWRwa3-ibWk_0 2024-09-12T01:38:00.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.488+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14405413664857278455', time=2024-09-12T03:14:00.677079+0000, chain.objs.size()=1 2024-09-12T01:38:00.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.488+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Xi9C-IMO5nfLgy9VlXzPUl_zVzMS5BV_0 2024-09-12T01:38:00.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.488+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12040057328849739507', time=2024-09-12T03:14:00.893095+0000, chain.objs.size()=1 2024-09-12T01:38:00.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.488+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.pAt7-vd9AOklKGmv1iXFGCg74bx2rnj_0 2024-09-12T01:38:00.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.489+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14800763844645314250', time=2024-09-12T03:14:00.984809+0000, chain.objs.size()=1 2024-09-12T01:38:00.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.489+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.MSDeHoS64lPRw3GtuxXZIw9sStszIvK_0 2024-09-12T01:38:00.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.491+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 0/46792 2024-09-12T01:38:00.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.493+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=28, truncated=0, next_marker='' 2024-09-12T01:38:00.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.493+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4954520844174539249', time=2024-09-12T03:14:01.304297+0000, chain.objs.size()=1 2024-09-12T01:38:00.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.493+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.bQ3hy8uzAmiV1_u6XCfzAzfoQtZ9HAU_0 2024-09-12T01:38:00.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.493+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11455672758097159401', time=2024-09-12T03:14:01.860160+0000, chain.objs.size()=1 2024-09-12T01:38:00.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.493+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.dToXgxqtvWKJNRZOrrlq3AEe4GKxhXf_0 2024-09-12T01:38:00.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.493+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8193797146602811436', time=2024-09-12T03:14:02.120467+0000, chain.objs.size()=1 2024-09-12T01:38:00.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.493+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.39hHjOj1hOtdVlZ0jsK0pFHakIc2vdG_0 2024-09-12T01:38:00.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.493+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14464980671646163253', time=2024-09-12T03:14:02.182541+0000, chain.objs.size()=1 2024-09-12T01:38:00.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.493+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.y4G2i77HeYvMrmbQaETDgTC1YgdIqEx_0 2024-09-12T01:38:00.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.493+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14668925486824363397', time=2024-09-12T03:14:02.323118+0000, chain.objs.size()=1 2024-09-12T01:38:00.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.493+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.MBGs3zdWeKXTk1opRtsgspnltxG-TWZ_0 2024-09-12T01:38:00.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.493+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12404703406159080230', time=2024-09-12T03:14:02.507359+0000, chain.objs.size()=1 2024-09-12T01:38:00.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.493+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.lET9zwLGAU34lQtFDfkTDHEKV4ikthH_0 2024-09-12T01:38:00.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.493+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1106879318768642599', time=2024-09-12T03:14:02.535690+0000, chain.objs.size()=1 2024-09-12T01:38:00.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.493+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.soNWy1eGjTGpc09MENwk8iNpDFl4AXq_0 2024-09-12T01:38:00.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.493+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14560513352446453660', time=2024-09-12T03:14:02.608516+0000, chain.objs.size()=1 2024-09-12T01:38:00.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.493+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.D-75sP5OyVLABAv3CW22613_tGXdLhb_0 2024-09-12T01:38:00.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.493+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2379363231618051407', time=2024-09-12T03:14:02.631680+0000, chain.objs.size()=1 2024-09-12T01:38:00.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.493+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.8N5l0NXHqh4tuP5UZ1rbXIllXV9RaKZ_0 2024-09-12T01:38:00.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.493+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14645091249032754546', time=2024-09-12T03:14:03.589618+0000, chain.objs.size()=1 2024-09-12T01:38:00.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.493+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.XqxNNsO82qcOITqD0f4tzn4I2QO73gl_0 2024-09-12T01:38:00.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.493+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4821614581623271044', time=2024-09-12T03:14:09.811103+0000, chain.objs.size()=1 2024-09-12T01:38:00.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.493+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.331__shadow_.0gKuA-S11aooT53PQw3IzcFW-DZeejY_0 2024-09-12T01:38:00.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.493+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11109239217663233445', time=2024-09-12T03:15:21.255791+0000, chain.objs.size()=1 2024-09-12T01:38:00.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.493+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.408__shadow_.JUUcLT3PxMCuOwByBXSkY3dmQbr78v-_0 2024-09-12T01:38:00.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.495+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15807671543342034768', time=2024-09-12T03:15:41.484559+0000, chain.objs.size()=1 2024-09-12T01:38:00.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.495+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.429__shadow_.rg28LlvweX53FERkZEY7uU84hw4Nuf2_0 2024-09-12T01:38:00.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.495+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5095487504861595492', time=2024-09-12T03:16:15.235813+0000, chain.objs.size()=1 2024-09-12T01:38:00.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.495+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.460__shadow_.SalLoj-PjgdOL8-hKV6wvopL69aLDtn_0 2024-09-12T01:38:00.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.495+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14540130094195506156', time=2024-09-12T03:17:43.617559+0000, chain.objs.size()=1 2024-09-12T01:38:00.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.495+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.517__shadow_.SBFQg51N5rGG6pC6_8Ua9EeOGm95tKb_0 2024-09-12T01:38:00.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.495+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6030889833725378678', time=2024-09-12T03:18:04.668407+0000, chain.objs.size()=6 2024-09-12T01:38:00.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.495+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.519__multipart_mymultipart.2~LgDa75kEIAyvi2LrXTALkKTIcJ_tVPO.1 2024-09-12T01:38:00.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.495+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.519__multipart_mymultipart.2~LgDa75kEIAyvi2LrXTALkKTIcJ_tVPO.2 2024-09-12T01:38:00.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.495+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.519__multipart_mymultipart.2~LgDa75kEIAyvi2LrXTALkKTIcJ_tVPO.3 2024-09-12T01:38:00.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.495+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.519__multipart_mymultipart.2~LgDa75kEIAyvi2LrXTALkKTIcJ_tVPO.4 2024-09-12T01:38:00.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.496+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.519__multipart_mymultipart.2~LgDa75kEIAyvi2LrXTALkKTIcJ_tVPO.5 2024-09-12T01:38:00.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.496+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.519__multipart_mymultipart.2~LgDa75kEIAyvi2LrXTALkKTIcJ_tVPO.6 2024-09-12T01:38:00.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.496+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17719387860684629865', time=2024-09-12T03:20:26.766019+0000, chain.objs.size()=1 2024-09-12T01:38:00.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.496+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.523__multipart_mymultipart.2~1wJUPxyz_YOZO8kGmR_tx762-0JCayc.1 2024-09-12T01:38:00.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.496+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17700111623884751108', time=2024-09-12T03:20:28.017516+0000, chain.objs.size()=2 2024-09-12T01:38:00.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.496+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.523__multipart_mymultipart.2~lhn3C0tFo_7hv5TLKRumZd5Jk0IhpVn.1 2024-09-12T01:38:00.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.497+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.523__multipart_mymultipart.2~lhn3C0tFo_7hv5TLKRumZd5Jk0IhpVn.2 2024-09-12T01:38:00.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.497+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='2~MN3BiJyWhSNRoK9Rtl6eLKCubxWXQlO', time=2024-09-12T03:21:14.623104+0000, chain.objs.size()=2 2024-09-12T01:38:00.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.497+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.529__multipart_mymultipart.2~MN3BiJyWhSNRoK9Rtl6eLKCubxWXQlO.1 2024-09-12T01:38:00.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.497+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.529__multipart_mymultipart.2~MN3BiJyWhSNRoK9Rtl6eLKCubxWXQlO.2 2024-09-12T01:38:00.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.497+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10798883429289371974', time=2024-09-12T03:23:25.762890+0000, chain.objs.size()=1 2024-09-12T01:38:00.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.497+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.574__shadow_.u7jDHpjcL563-sFygaRCpUoLmH07rF9_0 2024-09-12T01:38:00.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.497+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8172001745741398427', time=2024-09-12T03:23:36.676048+0000, chain.objs.size()=1 2024-09-12T01:38:00.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.497+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.576__shadow:-sdMgaKuJtFoMJiD.PAXBIkwsD9y.r1_.hOY1TI_J8ooNWl26lX8zR814CmaLfZc_0 2024-09-12T01:38:00.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.497+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5797267144257509443', time=2024-09-12T03:24:36.559503+0000, chain.objs.size()=1 2024-09-12T01:38:00.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.497+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.579__shadow:GbI3B1uJAJcfqcUEQ-VVCiAvI7kQPg1_.EbTNO7MGKzc98GWHLrSuGXICnfxvwPZ_0 2024-09-12T01:38:00.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.497+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17931792423182874733', time=2024-09-12T03:24:47.875022+0000, chain.objs.size()=1 2024-09-12T01:38:00.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.497+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.587__shadow:XUIbBWeCoP6tNQc95ZjRFZhUnV4PCcW_.AxI9mby42R3Cw9jT3kAmZE425Xnr51d_0 2024-09-12T01:38:00.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.498+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15617580388879506463', time=2024-09-12T03:30:00.732612+0000, chain.objs.size()=1 2024-09-12T01:38:00.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.498+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.638__shadow_.UAAWmU0H8udCzV2vCJcIQ6FTREKGcZX_0 2024-09-12T01:38:00.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.498+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.92976008495827251', time=2024-09-12T03:30:26.692703+0000, chain.objs.size()=1 2024-09-12T01:38:00.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.498+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.653__shadow_.4_8eSOIfgHljc0JQ8E5zEaO-kmCJBqG_0 2024-09-12T01:38:00.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.498+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9428982425467068953', time=2024-09-12T03:31:04.401376+0000, chain.objs.size()=1 2024-09-12T01:38:00.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.498+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.670__shadow_.5_KwphDlnsFmr1o1Nmi9JSZcGocBa23_0 2024-09-12T01:38:00.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.498+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.267110497998935429', time=2024-09-12T03:31:05.613403+0000, chain.objs.size()=1 2024-09-12T01:38:00.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.498+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.671__shadow_.fgsLVRF04KjkxXJ9TclO4cNigElkz-S_0 2024-09-12T01:38:00.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.499+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13692857275477396429', time=2024-09-12T03:32:04.074657+0000, chain.objs.size()=1 2024-09-12T01:38:00.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.499+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.717__shadow:xaycwC45FQLCIIuzonmyTsEvQJkli-u_.SLEeSE2RBwAWiScqNEFsMlbEGFoSXtF_0 2024-09-12T01:38:00.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.501+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:38:00.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.504+0000 7f8786c98800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T01:38:00.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.505+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:38:00.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.506+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:38:00.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.506+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44005' 2024-09-12T01:38:00.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.506+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14287179700931918372', time=2024-09-12T03:07:48.964437+0000, chain.objs.size()=1 2024-09-12T01:38:00.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.506+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.188__shadow_.daHwk9L8lPPNp_MkcAYgaakLEq8VRSM_0 2024-09-12T01:38:00.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.506+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10848738354541473797', time=2024-09-12T03:10:05.807453+0000, chain.objs.size()=1 2024-09-12T01:38:00.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.506+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.230__shadow_.xyj71L26BcAz7LePgcfBGzoblj2oU4R_0 2024-09-12T01:38:00.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.506+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7250368161130374554', time=2024-09-12T03:10:13.305465+0000, chain.objs.size()=1 2024-09-12T01:38:00.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.506+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.237__shadow_.ipv2mnlPgeh0fnjDP6QPvxlhShQq3FL_0 2024-09-12T01:38:00.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.507+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11866473144927748003', time=2024-09-12T03:10:28.822406+0000, chain.objs.size()=1 2024-09-12T01:38:00.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.507+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.251__shadow_.xiB9E56w2OPOI3xVeHnEKukoJTMGFhy_0 2024-09-12T01:38:00.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.507+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.904378341160093787', time=2024-09-12T03:10:32.693524+0000, chain.objs.size()=1 2024-09-12T01:38:00.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.507+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.255__shadow_.1DcOjE5EUaVrAOkS68mNGoOZ-bw5V-6_0 2024-09-12T01:38:00.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.507+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10409975106610603623', time=2024-09-12T03:11:14.541762+0000, chain.objs.size()=1 2024-09-12T01:38:00.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.507+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.FfB5iQyU1phl7qnrt17SISOxWtqpEUI_0 2024-09-12T01:38:00.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.507+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2875462274169513538', time=2024-09-12T03:11:14.924574+0000, chain.objs.size()=1 2024-09-12T01:38:00.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.507+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.BeVSDhQsvEHQyQs-oCA_ZX9s3t8ayNt_0 2024-09-12T01:38:00.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.507+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8303971902107651249', time=2024-09-12T03:11:15.167568+0000, chain.objs.size()=1 2024-09-12T01:38:00.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.507+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.0Wn9HM79Tvhuh2pzNWjK_b8xP-___7H_0 2024-09-12T01:38:00.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.507+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12548016863931311133', time=2024-09-12T03:11:15.391561+0000, chain.objs.size()=1 2024-09-12T01:38:00.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.507+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.egRiehbMKhyNotgzKy6CjwS6e3uSAU9_0 2024-09-12T01:38:00.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.507+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7171424579877945480', time=2024-09-12T03:11:16.093146+0000, chain.objs.size()=1 2024-09-12T01:38:00.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.507+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.cjBYupOAOmjGtzzZqxy70u_C6kflrdy_0 2024-09-12T01:38:00.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.507+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16141730462457348987', time=2024-09-12T03:11:16.094279+0000, chain.objs.size()=1 2024-09-12T01:38:00.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.507+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.v6yBZVePPdVe8rgZ07zOFzJ0HvaVt-5_0 2024-09-12T01:38:00.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.507+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.560100994261152829', time=2024-09-12T03:11:16.232448+0000, chain.objs.size()=1 2024-09-12T01:38:00.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.507+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.VcVy4pUViyP0MIpsNX9O3TZQLfXe0Og_0 2024-09-12T01:38:00.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.508+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3678442172334106225', time=2024-09-12T03:11:16.515867+0000, chain.objs.size()=1 2024-09-12T01:38:00.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.508+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.fZzEV5DUPBdxcXk_l2DRe9w4s3Cwm_q_0 2024-09-12T01:38:00.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.508+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12054929265560276674', time=2024-09-12T03:11:17.420967+0000, chain.objs.size()=1 2024-09-12T01:38:00.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.508+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.HMJXPCdzHL_LWhV64SaJ7Xi28ZiY6Nj_0 2024-09-12T01:38:00.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.509+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13151309856196148356', time=2024-09-12T03:11:18.163150+0000, chain.objs.size()=1 2024-09-12T01:38:00.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.509+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.wNWZZjhCSToEY1iyzf3TA8THU6lRkiu_0 2024-09-12T01:38:00.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.509+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2130701497691894810', time=2024-09-12T03:11:18.224355+0000, chain.objs.size()=1 2024-09-12T01:38:00.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.509+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Qz5FE3LoBl5Igs_EZ97xEcC6LIyb2IP_0 2024-09-12T01:38:00.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.509+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8375837994034197156', time=2024-09-12T03:11:18.843080+0000, chain.objs.size()=1 2024-09-12T01:38:00.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.509+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.CxU62ntTE2fXJgoXS4fxxKfYJD1UcGx_0 2024-09-12T01:38:00.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.509+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3645447419169580178', time=2024-09-12T03:11:18.926344+0000, chain.objs.size()=1 2024-09-12T01:38:00.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.509+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.mzAxltAjlTxMe0EqPR6O0WNnirr1rkl_0 2024-09-12T01:38:00.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.509+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.918753430018307615', time=2024-09-12T03:11:19.469307+0000, chain.objs.size()=1 2024-09-12T01:38:00.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.509+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.V8BQfvsZ04JtZgpBy16C5oE4ngjTV2l_0 2024-09-12T01:38:00.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.509+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8764509301382951997', time=2024-09-12T03:11:19.470515+0000, chain.objs.size()=1 2024-09-12T01:38:00.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.509+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.4_TdWYNqYlqfY6iWPuWZtzhjWaK_tzi_0 2024-09-12T01:38:00.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.509+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12253954481472919713', time=2024-09-12T03:11:19.598072+0000, chain.objs.size()=1 2024-09-12T01:38:00.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.509+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.moFLGlRI7W1Ira0YhLVh3DbwpPkWrOn_0 2024-09-12T01:38:00.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.509+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17044148393403790492', time=2024-09-12T03:11:20.430923+0000, chain.objs.size()=1 2024-09-12T01:38:00.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.509+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.k4tk4aTrYpky-DqTB6tBfGX1XdIpdQC_0 2024-09-12T01:38:00.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.509+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5277871778417924519', time=2024-09-12T03:11:20.640586+0000, chain.objs.size()=1 2024-09-12T01:38:00.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.509+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.KdBJ78F-oIOxBn90T7WG5CPtVK36JoD_0 2024-09-12T01:38:00.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.510+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11478862393562760348', time=2024-09-12T03:11:21.010305+0000, chain.objs.size()=1 2024-09-12T01:38:00.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.510+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.RqO823c5NPRH7qgOQiMNcIhAzm3UKcN_0 2024-09-12T01:38:00.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.510+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13326172354795358505', time=2024-09-12T03:11:21.543489+0000, chain.objs.size()=1 2024-09-12T01:38:00.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.510+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.L5NzGw7laLqzJOZ1a2L8ty6c2voXW07_0 2024-09-12T01:38:00.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.512+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4947190630552828877', time=2024-09-12T03:11:21.664229+0000, chain.objs.size()=1 2024-09-12T01:38:00.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.512+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.ckolCAJeCfC7usuODMeh1Co9kb8cLzJ_0 2024-09-12T01:38:00.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.512+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7107306068286184107', time=2024-09-12T03:11:21.734153+0000, chain.objs.size()=1 2024-09-12T01:38:00.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.512+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.GbPKKWPLoiJ_nBDUUoDBIbijlwLMlhd_0 2024-09-12T01:38:00.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.512+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9092368985842711871', time=2024-09-12T03:11:22.278929+0000, chain.objs.size()=1 2024-09-12T01:38:00.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.512+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.CmnYvstV0KqxzxiaVc_7mIqWOYSe_kO_0 2024-09-12T01:38:00.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.512+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2510031974792196310', time=2024-09-12T03:11:23.194610+0000, chain.objs.size()=1 2024-09-12T01:38:00.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.512+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.HuI-cGM0seMPO2wYQMjauJZeJDihrJf_0 2024-09-12T01:38:00.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.512+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12033781565868025248', time=2024-09-12T03:11:23.316979+0000, chain.objs.size()=1 2024-09-12T01:38:00.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.512+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.XNb6bqD2MJSOfu5Q5oLr28I6FJIT4ew_0 2024-09-12T01:38:00.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.512+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.537692559330374210', time=2024-09-12T03:11:23.364644+0000, chain.objs.size()=1 2024-09-12T01:38:00.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.512+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.B88aA2ECJloPOZYjChv-qLwzayp3DWT_0 2024-09-12T01:38:00.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.512+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6544133467619412811', time=2024-09-12T03:11:23.549213+0000, chain.objs.size()=1 2024-09-12T01:38:00.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.512+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.haCBdJ0fOFnSny8zeshh4Z2oO8lyj6p_0 2024-09-12T01:38:00.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.512+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8093572033429899976', time=2024-09-12T03:11:23.592597+0000, chain.objs.size()=1 2024-09-12T01:38:00.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.512+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Q9wD7Hru55XgmCj7C-t4otJUSrXzKfd_0 2024-09-12T01:38:00.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.512+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14859689049448781856', time=2024-09-12T03:11:23.750311+0000, chain.objs.size()=1 2024-09-12T01:38:00.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.512+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.13SnyHDJtdjl58kkmK-Cc4etg6mtD7t_0 2024-09-12T01:38:00.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.513+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13479377534664783092', time=2024-09-12T03:11:24.124163+0000, chain.objs.size()=1 2024-09-12T01:38:00.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.513+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.84UU6PrNXfPR5UGclz3RX1rXc2JTYok_0 2024-09-12T01:38:00.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.513+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11264633673312121495', time=2024-09-12T03:11:24.125527+0000, chain.objs.size()=1 2024-09-12T01:38:00.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.513+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.njm-Sp1b0N6PQCKrxyOYj_yokozbcm__0 2024-09-12T01:38:00.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.514+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11341100127824350180', time=2024-09-12T03:11:24.434537+0000, chain.objs.size()=1 2024-09-12T01:38:00.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.514+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.YXtwhdvkAbqLh1oroXOftMKM25cG0od_0 2024-09-12T01:38:00.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.514+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17164886216154973102', time=2024-09-12T03:11:24.532309+0000, chain.objs.size()=1 2024-09-12T01:38:00.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.514+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Uc3hCOmuKIBgEdpiOAE3ije26J_KqPb_0 2024-09-12T01:38:00.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.514+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12604706660350600736', time=2024-09-12T03:11:41.981565+0000, chain.objs.size()=1 2024-09-12T01:38:00.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.514+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.280__shadow_.LcD_oIb3LX_JemcPNx1wYUjC5YhcXuN_0 2024-09-12T01:38:00.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.514+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8180540512488111739', time=2024-09-12T03:11:42.953052+0000, chain.objs.size()=1 2024-09-12T01:38:00.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.514+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.281__shadow_.mK8dTN_sHePNKAAKV8zKjpg1GpgHHXf_0 2024-09-12T01:38:00.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.514+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7017285364013942202', time=2024-09-12T03:11:43.929841+0000, chain.objs.size()=1 2024-09-12T01:38:00.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.514+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.282__shadow_.H8-2cumR4aRXFSX2EizAfP_vOVbRE3M_0 2024-09-12T01:38:00.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.514+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7267747360454952253', time=2024-09-12T03:11:49.886395+0000, chain.objs.size()=1 2024-09-12T01:38:00.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.514+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.288__shadow_.eCGg9bRTm8-vKDexPtXacLHKITS55_r_0 2024-09-12T01:38:00.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.514+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14638633781742694245', time=2024-09-12T03:11:55.321256+0000, chain.objs.size()=1 2024-09-12T01:38:00.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.514+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.292__shadow_.ygOv0Cp_ry-tcYPzmNl36zMoICsCGXD_0 2024-09-12T01:38:00.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.514+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10414152959219644110', time=2024-09-12T03:11:55.419195+0000, chain.objs.size()=1 2024-09-12T01:38:00.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.514+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.292__shadow_.GC6BAEVxESVFzh0TXe2ppWfXbQ35EMW_0 2024-09-12T01:38:00.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.514+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2930572324157965992', time=2024-09-12T03:11:57.558704+0000, chain.objs.size()=1 2024-09-12T01:38:00.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.514+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.293__shadow_.yMWiA2Z7nXsiCwh0yWNL40OkfMH-u82_0 2024-09-12T01:38:00.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.515+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10202937381822274446', time=2024-09-12T03:12:03.708078+0000, chain.objs.size()=1 2024-09-12T01:38:00.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.515+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.299__shadow_.tfPQDiGELpoPlVD70wsjF-cL4I-N3Al_0 2024-09-12T01:38:00.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.515+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1923868915031855717', time=2024-09-12T03:12:06.628051+0000, chain.objs.size()=1 2024-09-12T01:38:00.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.515+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.302__shadow_.G78Pk3aGegKQv9plfuYoqdS_m5eiiyX_0 2024-09-12T01:38:00.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.517+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15569699488993928942', time=2024-09-12T03:13:07.034463+0000, chain.objs.size()=1 2024-09-12T01:38:00.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.517+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.1eOgbg6tC5zSHLSzqa3Zns28T1XR2s4_0 2024-09-12T01:38:00.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.517+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18003496565657741745', time=2024-09-12T03:13:07.109279+0000, chain.objs.size()=1 2024-09-12T01:38:00.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.517+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.g_QDwXd2Ux7AUIL-BYQGN-VQMOD-ujc_0 2024-09-12T01:38:00.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.517+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5564434801528925475', time=2024-09-12T03:13:07.168264+0000, chain.objs.size()=1 2024-09-12T01:38:00.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.517+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.jvGATsjBr5YFwPsLUfqjEfW8y-gTwRL_0 2024-09-12T01:38:00.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.517+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14077280884912394218', time=2024-09-12T03:13:07.249473+0000, chain.objs.size()=1 2024-09-12T01:38:00.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.517+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.oUEaTcDCR7bVTneXVV_Al-1xqYk4_I8_0 2024-09-12T01:38:00.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.517+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4153845465253686204', time=2024-09-12T03:13:07.321431+0000, chain.objs.size()=1 2024-09-12T01:38:00.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.517+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.73ZHl-GCzFyQVnA82C3NoGyrmdVLx0__0 2024-09-12T01:38:00.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.517+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10356886269016146046', time=2024-09-12T03:13:07.648141+0000, chain.objs.size()=1 2024-09-12T01:38:00.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.517+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.MlcsF82nPfx5baIeXPSuL8-AD5s30y__0 2024-09-12T01:38:00.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.517+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17258396765431091554', time=2024-09-12T03:13:07.759452+0000, chain.objs.size()=1 2024-09-12T01:38:00.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.517+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.uy5MXZzRn0-qdJzJt-8W460suOg-gdG_0 2024-09-12T01:38:00.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.517+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5213218633703352466', time=2024-09-12T03:13:08.673986+0000, chain.objs.size()=1 2024-09-12T01:38:00.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.517+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.BBVdtkTsbo3Azd2_OQUfvnTLea7eDhb_0 2024-09-12T01:38:00.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.517+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8743729715480868372', time=2024-09-12T03:13:08.700352+0000, chain.objs.size()=1 2024-09-12T01:38:00.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.517+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.iQ_1X-x_XuwmtqlqG3IYgSWTS-ywphC_0 2024-09-12T01:38:00.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.517+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8116370269757921243', time=2024-09-12T03:13:08.917583+0000, chain.objs.size()=1 2024-09-12T01:38:00.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.517+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.cA07R_TYetUDaYuc9OvydPbhA2snEM3_0 2024-09-12T01:38:00.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.517+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3781209466478440803', time=2024-09-12T03:13:09.148418+0000, chain.objs.size()=1 2024-09-12T01:38:00.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.517+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.N9Xb-uMgbBtgNGIQzDKqnRH30nHEAgA_0 2024-09-12T01:38:00.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.519+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7891594917081889596', time=2024-09-12T03:13:09.179978+0000, chain.objs.size()=1 2024-09-12T01:38:00.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.519+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.mWr5NPbIk5lQtZW4gEUiXWFUxhj__Us_0 2024-09-12T01:38:00.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.522+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.43300281419042819', time=2024-09-12T03:13:09.211151+0000, chain.objs.size()=1 2024-09-12T01:38:00.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.522+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.qf7JtDFva6kAfl720B6EXQzN8B5ICNd_0 2024-09-12T01:38:00.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.522+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2228101039291103913', time=2024-09-12T03:13:09.257445+0000, chain.objs.size()=1 2024-09-12T01:38:00.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.522+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.KXOntbe97tM8fOQiedvY6HKrkIM9stu_0 2024-09-12T01:38:00.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.522+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9827818120898051241', time=2024-09-12T03:13:09.845809+0000, chain.objs.size()=1 2024-09-12T01:38:00.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.522+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.2hMqjNMcRfDWc87DYatG_jkJL8Cei19_0 2024-09-12T01:38:00.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.522+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.956593189020155812', time=2024-09-12T03:13:10.076763+0000, chain.objs.size()=1 2024-09-12T01:38:00.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.522+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.U6rq4VM6K9b68HsuP20SyZcCftqG5P-_0 2024-09-12T01:38:00.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.522+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14466763590947375085', time=2024-09-12T03:13:10.205070+0000, chain.objs.size()=1 2024-09-12T01:38:00.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.522+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.8KrSOaNMyaVLEOXkv1541fpqI_DIG5L_0 2024-09-12T01:38:00.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.522+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13141639711048194759', time=2024-09-12T03:13:10.293647+0000, chain.objs.size()=1 2024-09-12T01:38:00.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.522+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.hTTn_L7x9yPBDgWj6Ue_vyvpsBv_co3_0 2024-09-12T01:38:00.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.522+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5389260960461506227', time=2024-09-12T03:13:11.191800+0000, chain.objs.size()=1 2024-09-12T01:38:00.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.523+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.wVJ5pVwvpBJdf3AWE4feBpuntmALcuz_0 2024-09-12T01:38:00.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.523+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7959557621989808393', time=2024-09-12T03:13:12.076332+0000, chain.objs.size()=1 2024-09-12T01:38:00.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.523+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.19WBmtrAkfqi44pDVIz7I5eL89LwkEq_0 2024-09-12T01:38:00.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.523+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14433322604368685650', time=2024-09-12T03:13:12.516370+0000, chain.objs.size()=1 2024-09-12T01:38:00.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.523+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.f6BIiLcppOQQERt3UZGrYMAmnWpkmon_0 2024-09-12T01:38:00.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.523+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4720476946115302241', time=2024-09-12T03:13:12.654889+0000, chain.objs.size()=1 2024-09-12T01:38:00.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.523+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.NYwogxiaM3-S26_MdRKUjPImhKNNFfe_0 2024-09-12T01:38:00.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.523+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11317831112152004541', time=2024-09-12T03:13:14.010715+0000, chain.objs.size()=1 2024-09-12T01:38:00.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.523+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.tRSOrXC4pNne1WfXuSnKEnvTovi9x9v_0 2024-09-12T01:38:00.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.524+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11436316718032946711', time=2024-09-12T03:13:14.280104+0000, chain.objs.size()=1 2024-09-12T01:38:00.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.524+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.qyFaskPgQwXwm94aOY25Z7HzKntKc-T_0 2024-09-12T01:38:00.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.525+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12308921512226203273', time=2024-09-12T03:13:14.755098+0000, chain.objs.size()=1 2024-09-12T01:38:00.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.525+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.SiK9tmGbAP15nT4b4V6Zo2wBKLI4i83_0 2024-09-12T01:38:00.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.528+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8288727513656014415', time=2024-09-12T03:13:15.352389+0000, chain.objs.size()=1 2024-09-12T01:38:00.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.528+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.gtdttfy2oOlfLWRhllcvX0WGe7bIGYA_0 2024-09-12T01:38:00.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.528+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12352548991109282884', time=2024-09-12T03:13:15.451965+0000, chain.objs.size()=1 2024-09-12T01:38:00.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.528+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.8X5a6NGMLm73ZsOfzFoiVnXV6aHPjZ4_0 2024-09-12T01:38:00.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.528+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14188344976189883527', time=2024-09-12T03:13:15.610212+0000, chain.objs.size()=1 2024-09-12T01:38:00.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.528+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.NQAtndDWInsjLRk3Qz9xVZp57CRjLfW_0 2024-09-12T01:38:00.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.528+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5416524623331763276', time=2024-09-12T03:13:15.915883+0000, chain.objs.size()=1 2024-09-12T01:38:00.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.528+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.Db1wMXIjUsN7x4FNv0jyCp113NcGs7K_0 2024-09-12T01:38:00.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.528+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6828340302625741332', time=2024-09-12T03:13:15.964533+0000, chain.objs.size()=1 2024-09-12T01:38:00.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.528+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.KtD3a4kuObNXXz0FufKIquk_T_NeSNB_0 2024-09-12T01:38:00.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.528+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13466364130746407887', time=2024-09-12T03:13:16.639682+0000, chain.objs.size()=1 2024-09-12T01:38:00.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.528+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.NrELVyqwhElF9IrXDbh9Sjfc1oL-Nei_0 2024-09-12T01:38:00.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.528+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4132758617134270986', time=2024-09-12T03:13:53.684252+0000, chain.objs.size()=1 2024-09-12T01:38:00.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.528+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.XerTolBXnvnJYHCM7DscCURuaYwnGzL_0 2024-09-12T01:38:00.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.528+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16101378566015431948', time=2024-09-12T03:13:53.758970+0000, chain.objs.size()=1 2024-09-12T01:38:00.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.528+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.txJAUmtcGsZUdLVKWjmJoyyXujXkXer_0 2024-09-12T01:38:00.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.528+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5273765345231449453', time=2024-09-12T03:13:54.254208+0000, chain.objs.size()=1 2024-09-12T01:38:00.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.528+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.mxvF8324V53pJqcRllipTZUNFmgJabQ_0 2024-09-12T01:38:00.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.528+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16984602704851902625', time=2024-09-12T03:13:55.230459+0000, chain.objs.size()=1 2024-09-12T01:38:00.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.528+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.-EiIVEYuFl5l92vjBHER7plenNWiv6b_0 2024-09-12T01:38:00.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.528+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8454384942690425783', time=2024-09-12T03:13:55.252835+0000, chain.objs.size()=1 2024-09-12T01:38:00.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.528+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.J3N6eLqxs1JqfxUoObBpuVPuBG0v-Wk_0 2024-09-12T01:38:00.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.531+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6520163675304192888', time=2024-09-12T03:13:55.306281+0000, chain.objs.size()=1 2024-09-12T01:38:00.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.531+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.5Qslf4EqYl04gdXorOsfWpeHPn6QUje_0 2024-09-12T01:38:00.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.531+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8159962697138606988', time=2024-09-12T03:13:55.477462+0000, chain.objs.size()=1 2024-09-12T01:38:00.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.531+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.AMA2i7lSsavFIUwv9WIIZQqfYVZOB3O_0 2024-09-12T01:38:00.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.531+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.466970017837619386', time=2024-09-12T03:13:56.044123+0000, chain.objs.size()=1 2024-09-12T01:38:00.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.531+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.6MzZBsl8hNPH7uYIStk9IEWiBdwOrVM_0 2024-09-12T01:38:00.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.531+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.158228080349289157', time=2024-09-12T03:13:56.489214+0000, chain.objs.size()=1 2024-09-12T01:38:00.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.531+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.asORQKOH4WV8vRFL7xzfWTRuXxFZ-Sc_0 2024-09-12T01:38:00.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.531+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18308398488865812894', time=2024-09-12T03:13:56.655592+0000, chain.objs.size()=1 2024-09-12T01:38:00.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.531+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.FhufBZ1W6lAiX1grNWgY0AArqGCMOmh_0 2024-09-12T01:38:00.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.531+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6749580556002107676', time=2024-09-12T03:13:56.940578+0000, chain.objs.size()=1 2024-09-12T01:38:00.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.531+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.anJwn0RFOchn_geCxZMpdC-tI43k7zg_0 2024-09-12T01:38:00.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.531+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17177257317720325566', time=2024-09-12T03:13:57.266039+0000, chain.objs.size()=1 2024-09-12T01:38:00.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.531+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.4ZEznJJpWlaVofwLGgwc57rz6hElUw3_0 2024-09-12T01:38:00.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.531+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2654419474851056045', time=2024-09-12T03:13:57.341374+0000, chain.objs.size()=1 2024-09-12T01:38:00.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.531+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.LZrt8XSUUwoIXfKX6lh2z_C5AGe08yz_0 2024-09-12T01:38:00.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.531+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5920815325689202164', time=2024-09-12T03:13:57.341972+0000, chain.objs.size()=1 2024-09-12T01:38:00.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.531+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.GawwvQkWBK3Xm8jj_beqxbkKtBNPMmx_0 2024-09-12T01:38:00.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.531+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17307035522521567293', time=2024-09-12T03:13:57.824017+0000, chain.objs.size()=1 2024-09-12T01:38:00.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.531+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.yg4dlnrCGb_0c6eU33cIlK3j1OdvHDg_0 2024-09-12T01:38:00.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.532+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7069638957583254845', time=2024-09-12T03:13:57.996804+0000, chain.objs.size()=1 2024-09-12T01:38:00.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.532+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.2123RlrwuO8x5T6aN8g-1qKFutl4Q-4_0 2024-09-12T01:38:00.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.532+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10419889020977478609', time=2024-09-12T03:13:58.266419+0000, chain.objs.size()=1 2024-09-12T01:38:00.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.532+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.HljsZr7VDSAn_qIAvNaTsMBTeYacAJG_0 2024-09-12T01:38:00.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.533+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2342499198037092796', time=2024-09-12T03:13:59.148983+0000, chain.objs.size()=1 2024-09-12T01:38:00.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.533+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.URAzRbhMTOGs42K5wGwFXRKvZShaxE4_0 2024-09-12T01:38:00.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.533+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13962634833746597380', time=2024-09-12T03:13:59.568437+0000, chain.objs.size()=1 2024-09-12T01:38:00.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.533+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.8WK0bOFMDqoP71llUTjf81LD9T7Aqe2_0 2024-09-12T01:38:00.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.533+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11244887980028197414', time=2024-09-12T03:13:59.644830+0000, chain.objs.size()=1 2024-09-12T01:38:00.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.533+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.9H3WsdKuLB6QqYQnN7xqBC_U9Az1zOE_0 2024-09-12T01:38:00.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.534+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1454607853515822457', time=2024-09-12T03:14:00.098262+0000, chain.objs.size()=1 2024-09-12T01:38:00.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.534+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.cxy2e51G9-NjbdGhEhMuNa1xa_5nvT0_0 2024-09-12T01:38:00.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.534+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14224498928008521811', time=2024-09-12T03:14:00.492782+0000, chain.objs.size()=1 2024-09-12T01:38:00.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.534+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.XJGw1gQp0RAm2QL9ByHKR_JUhpkKbOE_0 2024-09-12T01:38:00.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.540+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 0/44005 2024-09-12T01:38:00.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.542+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=30, truncated=0, next_marker='' 2024-09-12T01:38:00.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.542+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8075387012477789498', time=2024-09-12T03:14:00.597568+0000, chain.objs.size()=1 2024-09-12T01:38:00.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.542+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Bi86ZKOcElUc1CSgLGO1DZKKz24-sdv_0 2024-09-12T01:38:00.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.542+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12849017060138605341', time=2024-09-12T03:14:00.633904+0000, chain.objs.size()=1 2024-09-12T01:38:00.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.542+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.PuKpv-cTcidzX5ofZMTEdKSzXScIYav_0 2024-09-12T01:38:00.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.542+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17401404799246378632', time=2024-09-12T03:14:00.862783+0000, chain.objs.size()=1 2024-09-12T01:38:00.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.542+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.8oJLlNh8xzknFQruivYGfTUCpd34IN-_0 2024-09-12T01:38:00.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.542+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17130218242307392175', time=2024-09-12T03:14:00.993128+0000, chain.objs.size()=1 2024-09-12T01:38:00.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.542+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.1okmQ4vyJXFM-sF2Uo5W_G4saPbD86Q_0 2024-09-12T01:38:00.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.542+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4086150512849764706', time=2024-09-12T03:14:01.233125+0000, chain.objs.size()=1 2024-09-12T01:38:00.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.542+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.6h72R9PysmkbNl4640_sr2uxJCmNYa8_0 2024-09-12T01:38:00.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.542+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15360735162091595868', time=2024-09-12T03:14:01.812805+0000, chain.objs.size()=1 2024-09-12T01:38:00.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.542+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.0iv8LWxgQ-A6lemRf4xAAXUnhsbZ3wG_0 2024-09-12T01:38:00.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.542+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3907605778976094646', time=2024-09-12T03:14:01.844883+0000, chain.objs.size()=1 2024-09-12T01:38:00.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.542+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.qctoHxSGDBXc1X7DlxvJNXb_PCdrevh_0 2024-09-12T01:38:00.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.542+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2171359846743472661', time=2024-09-12T03:14:02.070128+0000, chain.objs.size()=1 2024-09-12T01:38:00.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.542+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.kiGGA353sWDzw1qpy0qNyI2Q5yvXIFb_0 2024-09-12T01:38:00.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.542+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.488889604355245285', time=2024-09-12T03:14:02.070635+0000, chain.objs.size()=1 2024-09-12T01:38:00.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.542+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.TWsHq_6BJFQowCMRNDmGyGgX2EB9LUj_0 2024-09-12T01:38:00.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.542+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8793710129921958056', time=2024-09-12T03:14:02.199857+0000, chain.objs.size()=1 2024-09-12T01:38:00.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.542+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.y_v0-QoFByNrwL2tbhq3ck6_6TY4lBU_0 2024-09-12T01:38:00.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.542+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13739428844336695820', time=2024-09-12T03:14:02.472352+0000, chain.objs.size()=1 2024-09-12T01:38:00.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.542+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.g-H25RibNdqZRi-70HznJE7RKXG5aIS_0 2024-09-12T01:38:00.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.542+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1047670345402816026', time=2024-09-12T03:14:02.887936+0000, chain.objs.size()=1 2024-09-12T01:38:00.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.542+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.jaUi3rvnw0oK_KWwOBSIcWcXAM0DGcl_0 2024-09-12T01:38:00.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.544+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12177639986240245761', time=2024-09-12T03:14:03.234075+0000, chain.objs.size()=1 2024-09-12T01:38:00.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.544+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.5NSAfTuX7oAQF-lsnDA--M3akHX4x-Q_0 2024-09-12T01:38:00.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.545+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9747861628106905239', time=2024-09-12T03:14:03.531301+0000, chain.objs.size()=1 2024-09-12T01:38:00.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.545+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.WMY6Mefkvsy3YQPjdexSjtyPAoERD7h_0 2024-09-12T01:38:00.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.545+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11769708275612452132', time=2024-09-12T03:14:10.642409+0000, chain.objs.size()=1 2024-09-12T01:38:00.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.545+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.332__shadow_.SQ8rKO5qA12e_to3JtJ6xfpzDvpEER-_0 2024-09-12T01:38:00.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.545+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17518404779346354543', time=2024-09-12T03:14:24.013692+0000, chain.objs.size()=1 2024-09-12T01:38:00.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.545+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.346__shadow_.qbTAX3M5i12wBvEdFqIF4_s2HONsAFc_0 2024-09-12T01:38:00.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.545+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5004815510946918235', time=2024-09-12T03:14:44.549902+0000, chain.objs.size()=1 2024-09-12T01:38:00.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.545+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.371__shadow_.-OCgGjJz6LJ7X57tmUSciOfpCR9fQgM_0 2024-09-12T01:38:00.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.545+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9369469140549516403', time=2024-09-12T03:16:19.394677+0000, chain.objs.size()=1 2024-09-12T01:38:00.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.545+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.463__shadow_.5c-0yU5f_AowWLU3FS6xRQpqjEvxM8I_0 2024-09-12T01:38:00.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.545+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13255320999782931382', time=2024-09-12T03:16:34.343764+0000, chain.objs.size()=1 2024-09-12T01:38:00.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.545+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.483__shadow_.tqNyuR_ESIooQJKJXdywbEg__BIzrWt_0 2024-09-12T01:38:00.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.545+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13267683741129020317', time=2024-09-12T03:17:30.509960+0000, chain.objs.size()=1 2024-09-12T01:38:00.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.545+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.512__shadow_.WOSBbRQ7eISZ8d603huePZHp4e52vnh_0 2024-09-12T01:38:00.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.545+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6613895533091994802', time=2024-09-12T03:22:38.352118+0000, chain.objs.size()=1 2024-09-12T01:38:00.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.545+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.556__shadow_.x2o9vO6Ld_68QiPlVQizd0aHr6Fxqji_0 2024-09-12T01:38:00.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.545+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13566314520628851610', time=2024-09-12T03:22:52.859326+0000, chain.objs.size()=1 2024-09-12T01:38:00.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.545+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.560__shadow_.RjpLpwbazSqRuhC3YqFfTDDrzQ7nJ0s_0 2024-09-12T01:38:00.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.545+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16190356957320238096', time=2024-09-12T03:23:13.650592+0000, chain.objs.size()=1 2024-09-12T01:38:00.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.545+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.569__shadow:5ctvBonHi9tbZD.3V4mkwt2itp8Yyug_.vzabtomauRCIt6gCis9kvwFwjNftCv7_0 2024-09-12T01:38:00.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.545+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11511606546309424013', time=2024-09-12T03:23:22.530366+0000, chain.objs.size()=1 2024-09-12T01:38:00.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.545+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.572__shadow:K1KQxPflv3YfXXPk.zmFzvAfpQ94bbd_.qd1b46rSycVUBloNu4lSNKJMcTTplvW_0 2024-09-12T01:38:00.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.546+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10598096350317475574', time=2024-09-12T03:23:45.045432+0000, chain.objs.size()=1 2024-09-12T01:38:00.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.546+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.577__shadow:xc0R6.MixEUTwF27uA1BeG2RUqJMQQ7_.qSd0tlokA69WQ7aIv1B6N6UY6Zpb1GZ_0 2024-09-12T01:38:00.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.546+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11545959739540587394', time=2024-09-12T03:23:52.309318+0000, chain.objs.size()=1 2024-09-12T01:38:00.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.546+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.577__shadow:roQEJ5yFz8-qO5L6guiTD0gWrHeJrNF_.InAtoJOPZrv3aRl78lt6ZvisUVo2l74_0 2024-09-12T01:38:00.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.547+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9352280503972636565', time=2024-09-12T03:24:36.390247+0000, chain.objs.size()=1 2024-09-12T01:38:00.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.547+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.579__shadow:7H8C.ZOoDshA.r0decygqdh.w-44QAW_.2cFHAfrsJK8EgVJcJ7finQFPjP77iDY_0 2024-09-12T01:38:00.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.547+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4190775530178590465', time=2024-09-12T03:30:21.504091+0000, chain.objs.size()=1 2024-09-12T01:38:00.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.547+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.649__shadow_.YJTUV7VUpQM_hE6VcgIisyZtbHuNZp9_0 2024-09-12T01:38:00.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.549+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10461633487710732511', time=2024-09-12T03:31:01.822027+0000, chain.objs.size()=1 2024-09-12T01:38:00.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.549+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.666__shadow_.-qN2zrSEDYZJ7T-1wFehtl9Fkh02xRl_0 2024-09-12T01:38:00.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.549+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18084945925601398328', time=2024-09-12T03:31:34.075644+0000, chain.objs.size()=1 2024-09-12T01:38:00.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.549+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.705__shadow:7EweZo4Wz-o8Ze1reTzvGp-wN0Sqj98_.Jm27i2-07HhsOBsQMbScPmkHhZmIABw_0 2024-09-12T01:38:00.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.553+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:38:00.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.557+0000 7f8786c98800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T01:38:00.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.558+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:38:00.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.559+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:38:00.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.559+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/55785' 2024-09-12T01:38:00.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.559+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='_O7xPqNVN3Cb6B7uFqM5RtmRPs8478uq', time=2024-09-12T03:06:50.783221+0000, chain.objs.size()=1 2024-09-12T01:38:00.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.559+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.160__shadow_.eaCDmHdBMnVRVi_2XdFfb-5HFR2Nfwp_0 2024-09-12T01:38:00.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.559+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9661264269339495477', time=2024-09-12T03:10:18.594410+0000, chain.objs.size()=1 2024-09-12T01:38:00.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.559+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.242__shadow_.HiICuHEiA5-_0SaA3RdgZsEHXwhDK-2_0 2024-09-12T01:38:00.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.559+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7171503689499649900', time=2024-09-12T03:10:21.929465+0000, chain.objs.size()=1 2024-09-12T01:38:00.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.559+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.244__shadow_.YgNN-Wq7j9FYjtonFatIiNfEvV__g4C_0 2024-09-12T01:38:00.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.559+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4608609255873232201', time=2024-09-12T03:10:22.884571+0000, chain.objs.size()=1 2024-09-12T01:38:00.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.559+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.245__shadow_.X59umpkZuEXFEj5xzpCupdbaDM-bTXy_0 2024-09-12T01:38:00.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.560+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7699570881214016016', time=2024-09-12T03:10:25.912853+0000, chain.objs.size()=1 2024-09-12T01:38:00.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.560+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.248__shadow_.B66z-B19U6eqqoDiq588Rwt2FK_mE5Y_0 2024-09-12T01:38:00.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.560+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4134101636000155327', time=2024-09-12T03:11:14.727631+0000, chain.objs.size()=1 2024-09-12T01:38:00.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.560+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.ps1LoQ8z5rdFsMtVIveU2jDBr-cG0_T_0 2024-09-12T01:38:00.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.560+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17697051749274107380', time=2024-09-12T03:11:15.261932+0000, chain.objs.size()=1 2024-09-12T01:38:00.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.560+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.RugU2C5tVhXu695kO9ddnS89tSZMj2o_0 2024-09-12T01:38:00.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.560+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5471835093094992861', time=2024-09-12T03:11:16.228336+0000, chain.objs.size()=1 2024-09-12T01:38:00.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.560+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.NRdhg5M-Us2d9nycBiCOOZyRnQvyogB_0 2024-09-12T01:38:00.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.560+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14874715625519439100', time=2024-09-12T03:11:16.231193+0000, chain.objs.size()=1 2024-09-12T01:38:00.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.560+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.uOqFSmy0hBvIV1Cco_FoZ2vcLnwYiM5_0 2024-09-12T01:38:00.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.560+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11383048351548101981', time=2024-09-12T03:11:16.846220+0000, chain.objs.size()=1 2024-09-12T01:38:00.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.560+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.J9iJpICfn2mZEG9DRPTdvqiNKKDNoEv_0 2024-09-12T01:38:00.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.560+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14477106953864856005', time=2024-09-12T03:11:17.958917+0000, chain.objs.size()=1 2024-09-12T01:38:00.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.560+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.RMhnzuQontF5asY8ct8NNodcQMXF93v_0 2024-09-12T01:38:00.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.560+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14260201872519489688', time=2024-09-12T03:11:18.035202+0000, chain.objs.size()=1 2024-09-12T01:38:00.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.560+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.ULi_NLOIbXzObKNJCtfGdcIPTmeQPW0_0 2024-09-12T01:38:00.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.566+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2841122234378624782', time=2024-09-12T03:11:18.433675+0000, chain.objs.size()=1 2024-09-12T01:38:00.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.566+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.99f8A2U1qkdE3B4ayJpDXFzbF5Itlqn_0 2024-09-12T01:38:00.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.566+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.556458706790102818', time=2024-09-12T03:11:18.843762+0000, chain.objs.size()=1 2024-09-12T01:38:00.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.566+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.0GiFDefEVB5TbmvYa0wGRiKgvFwpoxP_0 2024-09-12T01:38:00.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.566+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14911316796454948699', time=2024-09-12T03:11:19.102553+0000, chain.objs.size()=1 2024-09-12T01:38:00.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.566+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.1UOWNxrg6buXtXUVuhKq8guqKiPo7_u_0 2024-09-12T01:38:00.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.566+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16521519042206817606', time=2024-09-12T03:11:19.149024+0000, chain.objs.size()=1 2024-09-12T01:38:00.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.566+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Rt8vCiu97EJm-53ZRBXXf4xtaJ-SyuE_0 2024-09-12T01:38:00.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.566+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14352240555050027446', time=2024-09-12T03:11:19.236705+0000, chain.objs.size()=1 2024-09-12T01:38:00.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.566+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.HNX07WEEH_7TqZzbd5_ffYsavCkpYM1_0 2024-09-12T01:38:00.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.566+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12209257373416642185', time=2024-09-12T03:11:19.468170+0000, chain.objs.size()=1 2024-09-12T01:38:00.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.566+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Oj6VJED8rY7F5OPlzKHPLkromccOFzw_0 2024-09-12T01:38:00.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.566+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5274584071189204309', time=2024-09-12T03:11:19.723428+0000, chain.objs.size()=1 2024-09-12T01:38:00.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.566+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.f23cO1ZAyDFEw37WzUy8Zo1hMAjTYPP_0 2024-09-12T01:38:00.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.566+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17908740758178877677', time=2024-09-12T03:11:20.598133+0000, chain.objs.size()=1 2024-09-12T01:38:00.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.566+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.dWJlpRIDgNdxuvT2Rtj-Y_6q4G8xl2u_0 2024-09-12T01:38:00.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.566+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7601131176295324609', time=2024-09-12T03:11:20.674119+0000, chain.objs.size()=1 2024-09-12T01:38:00.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.566+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.M69BFghyKeZ2-6tvlyAvdmwt60rR8vU_0 2024-09-12T01:38:00.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.566+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14900121440650178694', time=2024-09-12T03:11:21.540284+0000, chain.objs.size()=1 2024-09-12T01:38:00.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.566+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.BmiBf_4v3k7m9Tq6rFFn-CDJ9us9A5Z_0 2024-09-12T01:38:00.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.566+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17392366742939310114', time=2024-09-12T03:11:21.692558+0000, chain.objs.size()=1 2024-09-12T01:38:00.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.566+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.disb0B9Zhgn9tjdFga93zCUlfXt77yc_0 2024-09-12T01:38:00.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.569+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4465994326310901291', time=2024-09-12T03:11:21.912429+0000, chain.objs.size()=1 2024-09-12T01:38:00.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.569+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.onA-lNhrODnZ5-XXkA7tGZDuXUkB5gf_0 2024-09-12T01:38:00.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.569+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1720962414175231038', time=2024-09-12T03:11:22.476016+0000, chain.objs.size()=1 2024-09-12T01:38:00.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.569+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Ax5qBuiHl-6KRgc_zNrkABLCySywzO-_0 2024-09-12T01:38:00.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.572+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14526131041256648052', time=2024-09-12T03:11:23.121155+0000, chain.objs.size()=1 2024-09-12T01:38:00.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.572+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.38svx9suj0Ao1Rk4v7u6N4t4nkZ1p2w_0 2024-09-12T01:38:00.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.572+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15838122990244917131', time=2024-09-12T03:11:23.411095+0000, chain.objs.size()=1 2024-09-12T01:38:00.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.572+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.GszbY4bRwxTMlpt4EbvhtXLq-TWIwns_0 2024-09-12T01:38:00.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.572+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8341557678378406783', time=2024-09-12T03:11:23.658810+0000, chain.objs.size()=1 2024-09-12T01:38:00.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.572+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.e52idedAHvcbXsSfYpbinoCTzZmM27U_0 2024-09-12T01:38:00.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.572+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2767731496587864800', time=2024-09-12T03:11:23.725291+0000, chain.objs.size()=1 2024-09-12T01:38:00.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.572+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.YIkzBomsBgZVCYNGDoL7UcHzStkXSeI_0 2024-09-12T01:38:00.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.572+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16292917906736028910', time=2024-09-12T03:11:23.750716+0000, chain.objs.size()=1 2024-09-12T01:38:00.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.572+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.MTsG8OSA4uY0f-TemcQ5M-yyZ500va8_0 2024-09-12T01:38:00.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.572+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9593728573421684812', time=2024-09-12T03:11:23.822594+0000, chain.objs.size()=1 2024-09-12T01:38:00.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.572+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.yg0Nkp6-oL49tuOooCou11KUdjtCIpp_0 2024-09-12T01:38:00.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.572+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9785877735550969696', time=2024-09-12T03:11:24.284176+0000, chain.objs.size()=1 2024-09-12T01:38:00.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.572+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.m-tLeZ794fNuCJVBY5c8NDbEbBVHO-q_0 2024-09-12T01:38:00.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.572+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5005487925551309748', time=2024-09-12T03:11:24.432719+0000, chain.objs.size()=1 2024-09-12T01:38:00.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.572+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.QdW4B9WNtCHJK1touVePWr612QZQfzk_0 2024-09-12T01:38:00.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.572+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4629138930705098858', time=2024-09-12T03:11:24.816530+0000, chain.objs.size()=1 2024-09-12T01:38:00.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.572+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.JNDNlEzRQ2On9qecD4vpjyMRja_wJVk_0 2024-09-12T01:38:00.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.572+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13576346904005733600', time=2024-09-12T03:11:24.817313+0000, chain.objs.size()=1 2024-09-12T01:38:00.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.572+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.CeGud2ddurF49j9j7zgm0yrv56c2H8O_0 2024-09-12T01:38:00.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.573+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12547921214261134513', time=2024-09-12T03:11:24.842203+0000, chain.objs.size()=1 2024-09-12T01:38:00.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.573+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.8REbyq1GLnCKqKUxrZ85rGSlddEyh5X_0 2024-09-12T01:38:00.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.576+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6894328685812056507', time=2024-09-12T03:11:24.898500+0000, chain.objs.size()=1 2024-09-12T01:38:00.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.576+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.MmDtbRwg5-I0ulS6P8bXBBKGIJhdnCm_0 2024-09-12T01:38:00.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.576+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3434607497583986057', time=2024-09-12T03:11:29.595652+0000, chain.objs.size()=1 2024-09-12T01:38:00.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.576+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.267__shadow_.IoQISjZx07Pa0IYn5r2f6TLoNqS8qhT_0 2024-09-12T01:38:00.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.576+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12978528633431086235', time=2024-09-12T03:11:32.413283+0000, chain.objs.size()=1 2024-09-12T01:38:00.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.576+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.270__shadow_.VkpDAfHWiYa9_-tCufuukr4DJXEtHZn_0 2024-09-12T01:38:00.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.579+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3468436921897130485', time=2024-09-12T03:11:38.076880+0000, chain.objs.size()=1 2024-09-12T01:38:00.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.579+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.276__shadow_.fIzdIdzdO_tzS0sEBqLtpp8Ta_hZlCy_0 2024-09-12T01:38:00.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.579+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7557699981101166457', time=2024-09-12T03:11:38.079439+0000, chain.objs.size()=1 2024-09-12T01:38:00.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.579+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.276__shadow_.D5vPDCVeJkkTK6eSiMvoXHLU0LV7tZ3_0 2024-09-12T01:38:00.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.579+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12976903050750580254', time=2024-09-12T03:11:57.602665+0000, chain.objs.size()=1 2024-09-12T01:38:00.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.579+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.293__shadow_.mw9EfJ_BA5cvab0llz7iSCkf7jN5TOo_0 2024-09-12T01:38:00.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.579+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15977878754883959405', time=2024-09-12T03:12:01.649780+0000, chain.objs.size()=1 2024-09-12T01:38:00.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.579+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.297__shadow_.JKEG7ZzIjuK4AWY6EEBVVhkX4TevS0E_0 2024-09-12T01:38:00.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.579+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15172504393714120464', time=2024-09-12T03:12:08.550996+0000, chain.objs.size()=1 2024-09-12T01:38:00.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.579+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.304__shadow_.1PlBESmjXXfzuvE3f8qSY-S_qSCMjCM_0 2024-09-12T01:38:00.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.579+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3950942978075408182', time=2024-09-12T03:13:07.508938+0000, chain.objs.size()=1 2024-09-12T01:38:00.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.579+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.Y6UxxROAgZeMasXEWFyXGZop8XF_vzv_0 2024-09-12T01:38:00.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.579+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.31174130197877700', time=2024-09-12T03:13:08.305694+0000, chain.objs.size()=1 2024-09-12T01:38:00.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.579+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.C4aohh3hFzEC3bNonAr4WZToLpbdpiJ_0 2024-09-12T01:38:00.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.579+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11415611543021576342', time=2024-09-12T03:13:08.489156+0000, chain.objs.size()=1 2024-09-12T01:38:00.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.579+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.91EebtIu2RGeHN8hvE0AbnrCu5OHYwV_0 2024-09-12T01:38:00.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.581+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3031499212561462381', time=2024-09-12T03:13:08.552707+0000, chain.objs.size()=1 2024-09-12T01:38:00.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.581+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.IsfuF-U5bVTOQrcon4rE4WVSrWrtjpL_0 2024-09-12T01:38:00.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.581+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14984532807166334436', time=2024-09-12T03:13:08.582827+0000, chain.objs.size()=1 2024-09-12T01:38:00.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.581+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.D5_Hbt4EArmXIYrkYa22Glybx4bCf7g_0 2024-09-12T01:38:00.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.581+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8812225129351191961', time=2024-09-12T03:13:08.736038+0000, chain.objs.size()=1 2024-09-12T01:38:00.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.581+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.APPdTIWEUnJ-ygKzcl-JSTCGvtM4e3W_0 2024-09-12T01:38:00.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.581+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9633302000949338933', time=2024-09-12T03:13:09.206384+0000, chain.objs.size()=1 2024-09-12T01:38:00.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.581+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.fS5b1L_5oWAnC0yvEUizTQJPVBNtr5l_0 2024-09-12T01:38:00.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.581+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.488744721089683187', time=2024-09-12T03:13:09.754664+0000, chain.objs.size()=1 2024-09-12T01:38:00.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.581+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.AVMq3UjLFELwjW-3IyhnumoqQhZ_Yuj_0 2024-09-12T01:38:00.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.581+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10108457936176723754', time=2024-09-12T03:13:09.952100+0000, chain.objs.size()=1 2024-09-12T01:38:00.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.581+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.h1U6stJozKilTS2vIwlsiu9DMGTXWvu_0 2024-09-12T01:38:00.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.581+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12201202328999500282', time=2024-09-12T03:13:11.165685+0000, chain.objs.size()=1 2024-09-12T01:38:00.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.581+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.x7hCvXhuzRseTusf-IXiLT6mLmz8OZt_0 2024-09-12T01:38:00.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.581+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14189664430533297099', time=2024-09-12T03:13:11.551491+0000, chain.objs.size()=1 2024-09-12T01:38:00.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.581+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.NOv3HfI0kygnSLFWQPSre94UaSiT-qq_0 2024-09-12T01:38:00.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.581+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8962544171691638232', time=2024-09-12T03:13:11.669718+0000, chain.objs.size()=1 2024-09-12T01:38:00.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.581+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.vFWjO-CAoGYvsAnHblEBT7NodwGPAIG_0 2024-09-12T01:38:00.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.581+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7534251425800931400', time=2024-09-12T03:13:12.025626+0000, chain.objs.size()=1 2024-09-12T01:38:00.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.581+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.ySTCo0I8JDAX9SaL5egqwSA2z72Kjjb_0 2024-09-12T01:38:00.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.581+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17762865246466031594', time=2024-09-12T03:13:12.096682+0000, chain.objs.size()=1 2024-09-12T01:38:00.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.581+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.Yd64EShUmWsKW4Jkhnv2tv7yhPdLfd5_0 2024-09-12T01:38:00.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.585+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11387820318747517148', time=2024-09-12T03:13:12.613745+0000, chain.objs.size()=1 2024-09-12T01:38:00.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.585+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.DkNaQEOZANeIv7MjoBLgFiCYe1obU7__0 2024-09-12T01:38:00.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.585+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14668065662002939027', time=2024-09-12T03:13:12.702666+0000, chain.objs.size()=1 2024-09-12T01:38:00.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.585+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.te7moHauXIiyOsTatwBEuvKTcgDpJne_0 2024-09-12T01:38:00.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.585+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16785264518665707113', time=2024-09-12T03:13:12.703393+0000, chain.objs.size()=1 2024-09-12T01:38:00.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.585+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.cO9p3wcurcG7CVI2SF2hCcoB8zIP1nt_0 2024-09-12T01:38:00.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.585+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8305229259327949067', time=2024-09-12T03:13:12.811867+0000, chain.objs.size()=1 2024-09-12T01:38:00.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.585+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.pOVbx4NgPXCojmemLMbxTYMt-0wYYku_0 2024-09-12T01:38:00.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.585+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16315087449421398097', time=2024-09-12T03:13:12.835387+0000, chain.objs.size()=1 2024-09-12T01:38:00.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.585+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.UAewdp_FigPvBXB2FSROYoNi5SPXuIy_0 2024-09-12T01:38:00.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.585+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18092832797110565348', time=2024-09-12T03:13:13.851379+0000, chain.objs.size()=1 2024-09-12T01:38:00.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.585+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.f0rlm56lMITGEYn5nP78a59q8TxFc-D_0 2024-09-12T01:38:00.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.585+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6681828877373720183', time=2024-09-12T03:13:14.118172+0000, chain.objs.size()=1 2024-09-12T01:38:00.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.585+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.G0Ocn4HdhfWn6AHLLeOGLkBdu3p4rYJ_0 2024-09-12T01:38:00.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.585+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8235660711563705071', time=2024-09-12T03:13:14.118854+0000, chain.objs.size()=1 2024-09-12T01:38:00.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.585+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.21l906c8nBUswSbconk4xu-dd1TINRV_0 2024-09-12T01:38:00.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.586+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2754354933162866865', time=2024-09-12T03:13:14.557038+0000, chain.objs.size()=1 2024-09-12T01:38:00.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.586+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.N6iAMdzz5A91Q99vZd7z2DkU-JSudMS_0 2024-09-12T01:38:00.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.586+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15449451030056007772', time=2024-09-12T03:13:14.640496+0000, chain.objs.size()=1 2024-09-12T01:38:00.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.586+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.xBUV4Yta1eEn-1KBVXkYhrlCcL11STO_0 2024-09-12T01:38:00.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.586+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3880626543950852441', time=2024-09-12T03:13:14.772714+0000, chain.objs.size()=1 2024-09-12T01:38:00.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.586+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.FZzSRZmJ8P-URKZpmqN2EwBMj8JxyFl_0 2024-09-12T01:38:00.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.588+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15982265808397146146', time=2024-09-12T03:13:15.290607+0000, chain.objs.size()=1 2024-09-12T01:38:00.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.588+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.4KvgmbbvxUUyT9aLXmZTYwSxk2eOWpC_0 2024-09-12T01:38:00.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.588+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18237275777843628338', time=2024-09-12T03:13:15.776018+0000, chain.objs.size()=1 2024-09-12T01:38:00.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.588+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.d-vpkFutw5kcCfBhD3Nkpk4QyBPm2Pf_0 2024-09-12T01:38:00.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.591+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16623991317033903144', time=2024-09-12T03:13:15.776743+0000, chain.objs.size()=1 2024-09-12T01:38:00.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.591+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.wYFDZmOcCUYn9aHXq7cI8VkN2nBfycz_0 2024-09-12T01:38:00.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.591+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4978083461813851754', time=2024-09-12T03:13:16.026150+0000, chain.objs.size()=1 2024-09-12T01:38:00.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.591+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.32qIRIpkFQDngu-ZNQNxa14Wn8Mzytp_0 2024-09-12T01:38:00.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.591+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6809270797104487879', time=2024-09-12T03:13:16.756089+0000, chain.objs.size()=1 2024-09-12T01:38:00.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.591+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_._vUDbtqZ-S2JKTHqVFCv1xep6C7jUeD_0 2024-09-12T01:38:00.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.591+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16952089234456416573', time=2024-09-12T03:13:17.099519+0000, chain.objs.size()=1 2024-09-12T01:38:00.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.591+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.ypcqC2pXcR6ciPhDvO2ldvm76MFCKJH_0 2024-09-12T01:38:00.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.591+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6995456764943009460', time=2024-09-12T03:13:54.066468+0000, chain.objs.size()=1 2024-09-12T01:38:00.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.591+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.F-ATZGcpMg-v_mTXtidErU3nVKe6-qQ_0 2024-09-12T01:38:00.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.591+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3477653845664446632', time=2024-09-12T03:13:54.204388+0000, chain.objs.size()=1 2024-09-12T01:38:00.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.591+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.V86PYs0IehsSeaXZWOrFdjHu4G3RrP5_0 2024-09-12T01:38:00.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.591+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15889397728979085769', time=2024-09-12T03:13:54.402702+0000, chain.objs.size()=1 2024-09-12T01:38:00.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.591+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.R4aOPa-a8NL7A7yyLTq89UknKnkOyQo_0 2024-09-12T01:38:00.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.591+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2857974935312107765', time=2024-09-12T03:13:54.539451+0000, chain.objs.size()=1 2024-09-12T01:38:00.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.591+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.SFfMlLmtHfjNw7Z6LQ4zR37Pdz7nqCW_0 2024-09-12T01:38:00.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.591+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17695815381723237184', time=2024-09-12T03:13:55.730837+0000, chain.objs.size()=1 2024-09-12T01:38:00.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.591+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.sv7SA3lY7x6wPcGcbDKymuQc7heuGcb_0 2024-09-12T01:38:00.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.591+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11716335806895647774', time=2024-09-12T03:13:55.851598+0000, chain.objs.size()=1 2024-09-12T01:38:00.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.591+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.SB2kBRd0o54fI4thaocDLBjTPHF-OoZ_0 2024-09-12T01:38:00.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.594+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15100700171275625487', time=2024-09-12T03:13:55.934083+0000, chain.objs.size()=1 2024-09-12T01:38:00.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.594+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.v3NhY4t7AtOFQecyTG8pN0W9dN5paGk_0 2024-09-12T01:38:00.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.596+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2508083289931017408', time=2024-09-12T03:13:55.935015+0000, chain.objs.size()=1 2024-09-12T01:38:00.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.596+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.CH5_hiGWgjy_7_LJeKduBnRgFwUiZCK_0 2024-09-12T01:38:00.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.596+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8841560855278653668', time=2024-09-12T03:13:56.967053+0000, chain.objs.size()=1 2024-09-12T01:38:00.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.596+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.RKrOeHbhGRqdpZ9McPHZr_ixwbQh3Q9_0 2024-09-12T01:38:00.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.596+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13622325419139882093', time=2024-09-12T03:13:56.995158+0000, chain.objs.size()=1 2024-09-12T01:38:00.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.596+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.E1xFBnmi6wIpQjpzOIyCJVL9yRjkKzo_0 2024-09-12T01:38:00.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.596+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18384867279858551249', time=2024-09-12T03:13:57.196054+0000, chain.objs.size()=1 2024-09-12T01:38:00.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.596+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.qbSrNYYF65JBNQnSeNi0rxofBKUhF2I_0 2024-09-12T01:38:00.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.596+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16795609150755972562', time=2024-09-12T03:13:57.363156+0000, chain.objs.size()=1 2024-09-12T01:38:00.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.596+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.leu3U4o76v25GPfQCur5mvSxAled8yW_0 2024-09-12T01:38:00.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.596+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16154941371992403408', time=2024-09-12T03:13:57.364981+0000, chain.objs.size()=1 2024-09-12T01:38:00.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.596+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.BSiEdDrC4pja4uQB7GKujnO-ZfOHpbM_0 2024-09-12T01:38:00.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.596+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13566864639377428873', time=2024-09-12T03:13:58.161760+0000, chain.objs.size()=1 2024-09-12T01:38:00.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.596+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.UB_tde8evubmu169oTDrAU7auL1HFlp_0 2024-09-12T01:38:00.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.596+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14678088108895224986', time=2024-09-12T03:13:58.162480+0000, chain.objs.size()=1 2024-09-12T01:38:00.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.596+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.onlAjfDkFkZB34jD2m3VqHy6yQLRV69_0 2024-09-12T01:38:00.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.596+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8503105614038197560', time=2024-09-12T03:13:58.524343+0000, chain.objs.size()=1 2024-09-12T01:38:00.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.596+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.OWUaN2E1VkNeVbXeN-GfxOnkPzaSLBL_0 2024-09-12T01:38:00.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.596+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18010542856097043728', time=2024-09-12T03:13:58.762001+0000, chain.objs.size()=1 2024-09-12T01:38:00.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.596+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.KHIrFv0-h0U0i-VV6hLTexu_fWeoycS_0 2024-09-12T01:38:00.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.596+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.388912396487144498', time=2024-09-12T03:13:59.262128+0000, chain.objs.size()=1 2024-09-12T01:38:00.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.596+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_._mjfWRMoAyorDr51G7HBaBxX5fSuIx3_0 2024-09-12T01:38:00.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.599+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17036402095126793205', time=2024-09-12T03:13:59.660504+0000, chain.objs.size()=1 2024-09-12T01:38:00.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.599+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.vTs7CDKWrlEGCbbJxep_FU22Jw-n7Ye_0 2024-09-12T01:38:00.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.599+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5655606267541479637', time=2024-09-12T03:14:00.984118+0000, chain.objs.size()=1 2024-09-12T01:38:00.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.599+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.jUpv9m1k4eaSUvwDuztsDie6lOnimC8_0 2024-09-12T01:38:00.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.599+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2165926247539457300', time=2024-09-12T03:14:01.264049+0000, chain.objs.size()=1 2024-09-12T01:38:00.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.599+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.JZUe7-oacjL-0aT9X_4ouI0gqmjwN8V_0 2024-09-12T01:38:00.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.601+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5021851535404088822', time=2024-09-12T03:14:01.717841+0000, chain.objs.size()=1 2024-09-12T01:38:00.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.601+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.uyTMEyAJ4LblRTHiQ5ryx01U0m6hEE1_0 2024-09-12T01:38:00.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.602+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.202024863873099188', time=2024-09-12T03:14:01.824036+0000, chain.objs.size()=1 2024-09-12T01:38:00.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.602+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Ju1ZfOC0V7sNo1JKJIhh9nPw7l_TIk8_0 2024-09-12T01:38:00.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.602+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11752693975269864093', time=2024-09-12T03:14:01.824874+0000, chain.objs.size()=1 2024-09-12T01:38:00.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.602+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.i0Jxu2LoixGGC1FFweUoY018dyTIfOn_0 2024-09-12T01:38:00.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.602+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8693897311066033966', time=2024-09-12T03:14:01.863361+0000, chain.objs.size()=1 2024-09-12T01:38:00.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.602+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.6WeVTlpYui8iHNK2i7ruYuHxO9nLaOM_0 2024-09-12T01:38:00.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.604+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 0/55785 2024-09-12T01:38:00.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.607+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=38, truncated=0, next_marker='' 2024-09-12T01:38:00.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.607+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7934979185096148792', time=2024-09-12T03:14:02.063299+0000, chain.objs.size()=1 2024-09-12T01:38:00.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.607+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.5IIiGsK214Scbj7nbofclbaOjwQKbEv_0 2024-09-12T01:38:00.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.607+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2415000771855222716', time=2024-09-12T03:14:02.232193+0000, chain.objs.size()=1 2024-09-12T01:38:00.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.607+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.qiKox9u5vOm-ybBVNdKOWQRYFeAhuFa_0 2024-09-12T01:38:00.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.607+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9350367381718959343', time=2024-09-12T03:14:02.938001+0000, chain.objs.size()=1 2024-09-12T01:38:00.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.607+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.qD_fynuTePe24UP8EUazdciPWZRzXVf_0 2024-09-12T01:38:00.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.607+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16357570862470577905', time=2024-09-12T03:14:03.394351+0000, chain.objs.size()=1 2024-09-12T01:38:00.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.607+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.UvWsdKNuBs0tBY-yw-2HyxAhsBVbgrx_0 2024-09-12T01:38:00.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.607+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14434449814471529856', time=2024-09-12T03:14:03.395212+0000, chain.objs.size()=1 2024-09-12T01:38:00.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.607+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.P6UEp1FpD4hGDAv7jlx8HAhAMA0x6bq_0 2024-09-12T01:38:00.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.607+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10407355877617927771', time=2024-09-12T03:14:03.524812+0000, chain.objs.size()=1 2024-09-12T01:38:00.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.607+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.lkon5c2jOYkTrNSoHjQHgjcyRqjYXFE_0 2024-09-12T01:38:00.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.608+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2591685939989029727', time=2024-09-12T03:14:03.653452+0000, chain.objs.size()=1 2024-09-12T01:38:00.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.608+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.bl3xLx2Ml7SE1GobqMs2TSX1Q3b_2oK_0 2024-09-12T01:38:00.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.608+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6543009218919693292', time=2024-09-12T03:16:06.988456+0000, chain.objs.size()=1 2024-09-12T01:38:00.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.608+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.454__shadow_.gkFck7j1feR3prziy6dtfS-_0Rdj7ao_0 2024-09-12T01:38:00.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.608+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3965277723990111952', time=2024-09-12T03:16:20.354027+0000, chain.objs.size()=1 2024-09-12T01:38:00.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.608+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.464__shadow_.H930XMksi-FYj4rTo148bEk6BEDpdNF_0 2024-09-12T01:38:00.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.608+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14114353975514968732', time=2024-09-12T03:16:21.634430+0000, chain.objs.size()=1 2024-09-12T01:38:00.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.608+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.465__shadow_.8SAu6zRHtQIG0ASW3qFMLPiv2ydrPIW_0 2024-09-12T01:38:00.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.608+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3139324767928103821', time=2024-09-12T03:16:34.343078+0000, chain.objs.size()=1 2024-09-12T01:38:00.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.608+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.483__shadow_.mQmVy4kVJmEzI0JwQIqQmwTg5vvG13Z_0 2024-09-12T01:38:00.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.608+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7754919990952913236', time=2024-09-12T03:16:36.093905+0000, chain.objs.size()=1 2024-09-12T01:38:00.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.608+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.485__shadow_.e4PWRGoCAPxx1mmn3nY9NUzbJctX5IV_0 2024-09-12T01:38:00.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.609+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8011422465931005960', time=2024-09-12T03:16:40.343386+0000, chain.objs.size()=3 2024-09-12T01:38:00.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.609+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.486__shadow_.ec5-CCmExoIjkZvSRZ-xvocMngPc4Id_0 2024-09-12T01:38:00.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.609+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.486__shadow_.ec5-CCmExoIjkZvSRZ-xvocMngPc4Id_1 2024-09-12T01:38:00.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.612+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.486__shadow_.ec5-CCmExoIjkZvSRZ-xvocMngPc4Id_2 2024-09-12T01:38:00.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.612+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6090025375460715369', time=2024-09-12T03:18:30.026524+0000, chain.objs.size()=3 2024-09-12T01:38:00.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.612+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.521__multipart_mymultipart.2~Qf2MUQ3AxuhanRhZW2U2JMjAO6iOoYf.1 2024-09-12T01:38:00.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.612+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.521__multipart_mymultipart.2~Qf2MUQ3AxuhanRhZW2U2JMjAO6iOoYf.2 2024-09-12T01:38:00.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.612+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.521__multipart_mymultipart.2~Qf2MUQ3AxuhanRhZW2U2JMjAO6iOoYf.3 2024-09-12T01:38:00.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.612+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14346451357688484368', time=2024-09-12T03:18:34.324898+0000, chain.objs.size()=1 2024-09-12T01:38:00.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.612+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.520__shadow:7ibdoBbs2UxthdFlsYYDBKhEUGLsjI0_.bhTOtjLP8RSLwgzhiGtL48KLC2YD-6E_0 2024-09-12T01:38:00.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.612+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10048160946738803872', time=2024-09-12T03:20:58.377564+0000, chain.objs.size()=1 2024-09-12T01:38:00.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.612+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.524__shadow_.ow5LSw_CMYvEVaMkzmnezuJwapdwQLF_0 2024-09-12T01:38:00.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.612+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='2~TfRIlPmG5PNFfjQ28lIT-m8k0eQ8kqZ', time=2024-09-12T03:21:20.329114+0000, chain.objs.size()=2 2024-09-12T01:38:00.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.612+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.531__multipart_mymultipart.2~TfRIlPmG5PNFfjQ28lIT-m8k0eQ8kqZ.1 2024-09-12T01:38:00.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.612+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.531__multipart_mymultipart.2~TfRIlPmG5PNFfjQ28lIT-m8k0eQ8kqZ.2 2024-09-12T01:38:00.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.612+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='2~aSW-sJNzTv5P7YPbqZlmG1Z0ox_zR2f', time=2024-09-12T03:21:20.386469+0000, chain.objs.size()=1 2024-09-12T01:38:00.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.612+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.531__multipart_mymultipart2.2~aSW-sJNzTv5P7YPbqZlmG1Z0ox_zR2f.1 2024-09-12T01:38:00.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.615+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4749565814718174339', time=2024-09-12T03:21:47.702746+0000, chain.objs.size()=1 2024-09-12T01:38:00.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.615+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.537__shadow_.oM10tOMm3wzPRrfc_01T5uASsz8i4wy_0 2024-09-12T01:38:00.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.615+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1310683738957227415', time=2024-09-12T03:22:41.906603+0000, chain.objs.size()=1 2024-09-12T01:38:00.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.615+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.557__shadow_.v4P0SyZB6d9snpogftJs7NWfaNVFtZ5_0 2024-09-12T01:38:00.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.615+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.86911166566122099', time=2024-09-12T03:23:18.326760+0000, chain.objs.size()=1 2024-09-12T01:38:00.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.615+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.569__shadow:kNB9hd1U.9xdEQFiO.2zcztXyraBL7B_.GeVOEOJsDbPLR1iv7ZG55DYZIBNos-t_0 2024-09-12T01:38:00.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.618+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6744979340858728251', time=2024-09-12T03:23:34.498745+0000, chain.objs.size()=1 2024-09-12T01:38:00.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.618+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.576__shadow:Ki9GYi0KrVwItzMWbMbpvLwoJAAnVl8_.YTfhIY4EzEmLm-7D9TbTzjhWxtOcwr__0 2024-09-12T01:38:00.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.621+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16729610831085061356', time=2024-09-12T03:23:45.672861+0000, chain.objs.size()=1 2024-09-12T01:38:00.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.621+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.577__shadow:3keKK-uaKsN5GiTSwLEXRYyQQXfuikE_.q8QNTkCXi5XNF05gVjsLhUhiuzBVCht_0 2024-09-12T01:38:00.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.621+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3441621998574065475', time=2024-09-12T03:23:49.466568+0000, chain.objs.size()=1 2024-09-12T01:38:00.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.621+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.577__shadow:VEDrDjT8IryiFW5.h4rCcVxZq6qhpdz_.s2Yt4xnt_zSbnEMT8KEKewSkat95edy_0 2024-09-12T01:38:00.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.621+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12400371590652545555', time=2024-09-12T03:23:56.481120+0000, chain.objs.size()=1 2024-09-12T01:38:00.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.621+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.577__shadow:jjn5HxY.XtPImvASHmr7gWCmFh9GULp_.T1iuWkPJrKUu3JRGmsD-9rRmgau_7Kn_0 2024-09-12T01:38:00.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.621+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16136898590732797385', time=2024-09-12T03:24:38.996663+0000, chain.objs.size()=1 2024-09-12T01:38:00.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.621+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.580__shadow:y5nyAE92iruKUZQ05jeXEW8p0g-Gkk._.LmWQDL3edT5cF7DwWasYK51_r9YPxUP_0 2024-09-12T01:38:00.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.621+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4779028176599849003', time=2024-09-12T03:24:39.191971+0000, chain.objs.size()=1 2024-09-12T01:38:00.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.621+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.580__shadow:y5nyAE92iruKUZQ05jeXEW8p0g-Gkk._.LmWQDL3edT5cF7DwWasYK51_r9YPxUP_0 2024-09-12T01:38:00.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.621+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8031386188493421772', time=2024-09-12T03:24:39.192695+0000, chain.objs.size()=1 2024-09-12T01:38:00.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.621+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.580__shadow:rti6lG5SjN5JArBCm7lt0wFRBt.7dmw_.czMrMk2GH347WN7UyZwy8vP-ngYA1Y4_0 2024-09-12T01:38:00.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.621+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14047933751462526175', time=2024-09-12T03:24:45.696902+0000, chain.objs.size()=1 2024-09-12T01:38:00.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.621+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.586__shadow:DDFtGDgRjn3hAZivRvhdH1SNptUZCm1_.A00RStsVrxn_ov6caS60KQxSWK_ljlg_0 2024-09-12T01:38:00.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.621+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14212229143367041434', time=2024-09-12T03:28:56.616052+0000, chain.objs.size()=1 2024-09-12T01:38:00.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.621+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.618__shadow_.2fMH2d-YLsNQx8T4vWKCydD-2x_-Z4A_0 2024-09-12T01:38:00.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.621+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8333662970640086766', time=2024-09-12T03:29:49.507555+0000, chain.objs.size()=1 2024-09-12T01:38:00.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.621+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.627__shadow_.b83KwpQHvXyOQiC3tIkE1UqwT5WpKa3_0 2024-09-12T01:38:00.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.621+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4607356212981344460', time=2024-09-12T03:30:09.774122+0000, chain.objs.size()=2 2024-09-12T01:38:00.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.621+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.644__shadow_.NKL1GylzGnQ2r57Ha0S729M2MOPcy-X_0 2024-09-12T01:38:00.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.621+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.644__shadow_.NKL1GylzGnQ2r57Ha0S729M2MOPcy-X_1 2024-09-12T01:38:00.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.622+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5252382861462155184', time=2024-09-12T03:30:19.077093+0000, chain.objs.size()=1 2024-09-12T01:38:00.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.622+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.648__shadow_.O9h14lXNONSE-KW4q4mofvaBVvXPM9P_0 2024-09-12T01:38:00.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.623+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10562721470860727501', time=2024-09-12T03:30:57.707954+0000, chain.objs.size()=1 2024-09-12T01:38:00.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.623+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.663__shadow_.pmss8rxu4zotfZN8B949fSDGy804w42_0 2024-09-12T01:38:00.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.623+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6445646038798154385', time=2024-09-12T03:31:05.810272+0000, chain.objs.size()=1 2024-09-12T01:38:00.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.623+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.672__shadow_.bJchXriCL87tbvsT0ND_1rbGtOPsL_I_0 2024-09-12T01:38:00.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.623+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7030798280832719725', time=2024-09-12T03:31:12.002081+0000, chain.objs.size()=1 2024-09-12T01:38:00.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.623+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.679__shadow_.QbrU3s4tJODAZO3Kzr4uC1h2v_xf7CY_0 2024-09-12T01:38:00.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.624+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12181056816228720308', time=2024-09-12T03:31:38.483906+0000, chain.objs.size()=1 2024-09-12T01:38:00.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.624+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.710__shadow:tWlI.8lGO9x3PocW9oL3xmbxq8I1AiM_.gsoAcGoVvkYOceTtXCyaBv-twrg13kn_0 2024-09-12T01:38:00.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.624+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9113921422797873366', time=2024-09-12T03:32:40.743475+0000, chain.objs.size()=1 2024-09-12T01:38:00.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.624+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.741__shadow_.l7Asgiez_Fb1Wqw5_CriWWEXOCBORwY_0 2024-09-12T01:38:00.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.629+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:38:00.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.632+0000 7f8786c98800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T01:38:00.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.634+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:38:00.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.634+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:38:00.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.635+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48847' 2024-09-12T01:38:00.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.635+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14960913650135095347', time=2024-09-12T03:07:23.670655+0000, chain.objs.size()=1 2024-09-12T01:38:00.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.635+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.166__shadow_.reuqJVJeLaKTcgn90de4O3U8njHIXD4_0 2024-09-12T01:38:00.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.635+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10622196863132770060', time=2024-09-12T03:10:09.699572+0000, chain.objs.size()=1 2024-09-12T01:38:00.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.635+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.234__shadow_.cpJDSDw1FrNPBz8QsWj-NVmjLXBdVBY_0 2024-09-12T01:38:00.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.635+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12939166515653006408', time=2024-09-12T03:10:20.269978+0000, chain.objs.size()=1 2024-09-12T01:38:00.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.635+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.243__shadow_.7J7vjTM4Tx81aSt7CbWM1T3mkkJXj9z_0 2024-09-12T01:38:00.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.635+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17982678999062646362', time=2024-09-12T03:10:23.853404+0000, chain.objs.size()=1 2024-09-12T01:38:00.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.635+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.246__shadow_.0LjsBLHeIGdMQW0SYvptUMQkwuJaOKr_0 2024-09-12T01:38:00.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.635+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.623738354081401840', time=2024-09-12T03:10:30.748518+0000, chain.objs.size()=1 2024-09-12T01:38:00.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.635+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.253__shadow_.v2V5tLp0blBjwqfRnjPTxj-NjCBx3t1_0 2024-09-12T01:38:00.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.635+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1261574161719901891', time=2024-09-12T03:11:14.372052+0000, chain.objs.size()=1 2024-09-12T01:38:00.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.635+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.RWRFP0EHniDQkboNJ4ST83RceVfKgXl_0 2024-09-12T01:38:00.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.635+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3214397069441161782', time=2024-09-12T03:11:14.443635+0000, chain.objs.size()=1 2024-09-12T01:38:00.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.635+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.AD1WbGQE-vXrWjJNCZKQRK0HrzKI31w_0 2024-09-12T01:38:00.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.635+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7879608905297785898', time=2024-09-12T03:11:14.520017+0000, chain.objs.size()=1 2024-09-12T01:38:00.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.635+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.qY85tMo2x58ylBdjBvzwOK_4-euk3w__0 2024-09-12T01:38:00.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.635+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3669998752460022466', time=2024-09-12T03:11:14.598115+0000, chain.objs.size()=1 2024-09-12T01:38:00.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.635+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.ifdXjm0IR13jpQL5chwFE7wzJWy9hnh_0 2024-09-12T01:38:00.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.635+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15664886518858789928', time=2024-09-12T03:11:15.170319+0000, chain.objs.size()=1 2024-09-12T01:38:00.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.635+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.A076xn5LNKS78NU7xecAD3wrYj2deSE_0 2024-09-12T01:38:00.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.635+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1357887555572428601', time=2024-09-12T03:11:15.301382+0000, chain.objs.size()=1 2024-09-12T01:38:00.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.635+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.FC4qtbxDeG3TvDmATUdKW6eZWDl5wTW_0 2024-09-12T01:38:00.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.635+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2171045514954649792', time=2024-09-12T03:11:15.364758+0000, chain.objs.size()=1 2024-09-12T01:38:00.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.635+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Xk8CfAeLdbAWMh44_4hsrn4cmLF5JLX_0 2024-09-12T01:38:00.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.637+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10382563100851554693', time=2024-09-12T03:11:16.014490+0000, chain.objs.size()=1 2024-09-12T01:38:00.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.637+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.0kixtKm3EUG_Gnvbf3nE274ABTv78L5_0 2024-09-12T01:38:00.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.637+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5096273453519936209', time=2024-09-12T03:11:16.148231+0000, chain.objs.size()=1 2024-09-12T01:38:00.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.637+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Y6RVBmCSQnWQxwwDKl29rsibJifk2JF_0 2024-09-12T01:38:00.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.637+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16982916785998669156', time=2024-09-12T03:11:16.231515+0000, chain.objs.size()=1 2024-09-12T01:38:00.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.637+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.uxn5xQweFS8dPW8QCe7obBv11IpGg_q_0 2024-09-12T01:38:00.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.637+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3540048618772496753', time=2024-09-12T03:11:16.257830+0000, chain.objs.size()=1 2024-09-12T01:38:00.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.637+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.ugNw32A0t6ZM_a2Q37P_T5JeWhiDliw_0 2024-09-12T01:38:00.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.637+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8619831119957758282', time=2024-09-12T03:11:16.359220+0000, chain.objs.size()=1 2024-09-12T01:38:00.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.637+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.aELpcdslv6BYFkkDY81y4Dw4HMU2Rb5_0 2024-09-12T01:38:00.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.637+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14754141390762781024', time=2024-09-12T03:11:16.375036+0000, chain.objs.size()=1 2024-09-12T01:38:00.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.637+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.FNgb2U7-4WoO3HtlerU3xHAqu5SLatc_0 2024-09-12T01:38:00.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.637+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5667307881545574833', time=2024-09-12T03:11:16.879795+0000, chain.objs.size()=1 2024-09-12T01:38:00.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.637+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.smOFTHYlkJrKwJsN0s4FeGeYFKa5Zzf_0 2024-09-12T01:38:00.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.637+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2422393041797523429', time=2024-09-12T03:11:17.657255+0000, chain.objs.size()=1 2024-09-12T01:38:00.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.637+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.s8eI6V_0AD_v4w6aj7B3zQmBQ430yvr_0 2024-09-12T01:38:00.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.637+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10384368049212413399', time=2024-09-12T03:11:17.897359+0000, chain.objs.size()=1 2024-09-12T01:38:00.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.637+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.rUWXopnVBnvrTCqHWkVJs6Z6NVyOvwR_0 2024-09-12T01:38:00.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.637+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14482755968839328602', time=2024-09-12T03:11:17.959574+0000, chain.objs.size()=1 2024-09-12T01:38:00.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.637+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.ZOQJa5GTxaNmALwdyULti40Ma3nrS4w_0 2024-09-12T01:38:00.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.637+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13770602345316940791', time=2024-09-12T03:11:18.202933+0000, chain.objs.size()=1 2024-09-12T01:38:00.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.637+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.FABvoxWjD1K-9fBslUlsN2qmCYN305-_0 2024-09-12T01:38:00.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.639+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4794994851058897369', time=2024-09-12T03:11:18.287712+0000, chain.objs.size()=1 2024-09-12T01:38:00.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.639+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.jrtU1hitwPcaiIFt3OBn0vpx8uy2gdB_0 2024-09-12T01:38:00.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.639+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9437240361432026196', time=2024-09-12T03:11:18.288394+0000, chain.objs.size()=1 2024-09-12T01:38:00.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.639+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.-KbsFneVj7NnrKL7lnusdDVKRs2RvHL_0 2024-09-12T01:38:00.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.639+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1438388242158418845', time=2024-09-12T03:11:18.927456+0000, chain.objs.size()=1 2024-09-12T01:38:00.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.639+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Kk-tWUBgHrXu-xBuC6vnBrLvL5Zrzy8_0 2024-09-12T01:38:00.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.639+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4784549316512330456', time=2024-09-12T03:11:19.236202+0000, chain.objs.size()=1 2024-09-12T01:38:00.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.639+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.rLAZIK0Iwn0FUS1suVsyj448GjKNMxy_0 2024-09-12T01:38:00.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.639+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15277255308256986542', time=2024-09-12T03:11:19.535149+0000, chain.objs.size()=1 2024-09-12T01:38:00.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.639+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.lDahBKyumOQ8mVnEHDaMDRnGDVhjjeB_0 2024-09-12T01:38:00.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.640+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8842807674714245421', time=2024-09-12T03:11:20.553348+0000, chain.objs.size()=1 2024-09-12T01:38:00.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.640+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.meIujM72_k__PE_fRgbOFnIFOhO9pDy_0 2024-09-12T01:38:00.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.640+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14647771546495795553', time=2024-09-12T03:11:20.983404+0000, chain.objs.size()=1 2024-09-12T01:38:00.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.640+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.qPJEqlxsyuLkSYfV9pezj0KbMZTYs8R_0 2024-09-12T01:38:00.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.640+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17915198115946398069', time=2024-09-12T03:11:21.080924+0000, chain.objs.size()=1 2024-09-12T01:38:00.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.640+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.uz1zsL55rdgtdSdZh5o7mGeiMKX037g_0 2024-09-12T01:38:00.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.640+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12967364845882975330', time=2024-09-12T03:11:21.676645+0000, chain.objs.size()=1 2024-09-12T01:38:00.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.640+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Xvbi5P4rlh0mORD95CwQ-2OQ9T86YJ6_0 2024-09-12T01:38:00.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.640+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.824053925706320301', time=2024-09-12T03:11:22.118276+0000, chain.objs.size()=1 2024-09-12T01:38:00.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.640+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.3bnTOMjrSk55pf2RmaKKDita-qUrna1_0 2024-09-12T01:38:00.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.640+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4411892755420230773', time=2024-09-12T03:11:22.953296+0000, chain.objs.size()=1 2024-09-12T01:38:00.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.640+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.zwrIWx9D_mqQF5G-9JSnQZOaR0U9K9C_0 2024-09-12T01:38:00.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.640+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5604454189738185453', time=2024-09-12T03:11:23.005197+0000, chain.objs.size()=1 2024-09-12T01:38:00.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.640+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.gQJMP7VsVB-mjFL58CrxHOhOWyQJqOe_0 2024-09-12T01:38:00.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.641+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1658657967083734550', time=2024-09-12T03:11:23.006044+0000, chain.objs.size()=1 2024-09-12T01:38:00.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.641+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.N7kvvH-zsIePL_g_qlsuEwNFfxCglka_0 2024-09-12T01:38:00.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.641+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1203221160559687006', time=2024-09-12T03:11:23.332464+0000, chain.objs.size()=1 2024-09-12T01:38:00.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.641+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.7GQ1lP_BQIgVKJcbVLZDSbvvdI9uNz7_0 2024-09-12T01:38:00.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.642+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8510425356447682298', time=2024-09-12T03:11:23.441277+0000, chain.objs.size()=1 2024-09-12T01:38:00.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.642+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.W2NNw2bdHNucXmRI9bTTei8oUi8m6hC_0 2024-09-12T01:38:00.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.642+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9038108985253621731', time=2024-09-12T03:11:23.803512+0000, chain.objs.size()=1 2024-09-12T01:38:00.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.642+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.o9Ox0tSjWJI3IP6B5z1J_djrmBXQB3p_0 2024-09-12T01:38:00.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.642+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5476606435371776205', time=2024-09-12T03:11:23.823552+0000, chain.objs.size()=1 2024-09-12T01:38:00.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.642+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.e_YHliPY0fZpcx_-xggpzs_FsDNl2t3_0 2024-09-12T01:38:00.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.642+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2515961558553369710', time=2024-09-12T03:11:24.431500+0000, chain.objs.size()=1 2024-09-12T01:38:00.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.642+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.RSfq5G3VD3IbsD0qz3iO3zEUPrin2Vu_0 2024-09-12T01:38:00.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.642+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1138857065111087847', time=2024-09-12T03:11:24.497044+0000, chain.objs.size()=1 2024-09-12T01:38:00.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.642+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.eu8g3COpKx4jzhCV7QpIUSvrI_jgdfC_0 2024-09-12T01:38:00.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.642+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11921918421884431016', time=2024-09-12T03:11:24.641158+0000, chain.objs.size()=1 2024-09-12T01:38:00.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.642+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.cV2fXSZIu4XaOLA2qDuMImXNQ7kBx-N_0 2024-09-12T01:38:00.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.642+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2563792941373485151', time=2024-09-12T03:11:27.754692+0000, chain.objs.size()=1 2024-09-12T01:38:00.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.642+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.265__shadow_.Dx4JNZw8Pf5g1oQGsmZbDKDkAXsnlJ8_0 2024-09-12T01:38:00.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.642+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14049358815583234187', time=2024-09-12T03:11:33.381445+0000, chain.objs.size()=1 2024-09-12T01:38:00.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.642+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.271__shadow_.QODvfbwPiqodQYKUSoImDnx94-m9S0p_0 2024-09-12T01:38:00.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.642+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3387550503427256028', time=2024-09-12T03:11:40.038257+0000, chain.objs.size()=1 2024-09-12T01:38:00.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.642+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.278__shadow_.0IJbWQKLFYW6yf-w25UG8W2PoUDQ_eE_0 2024-09-12T01:38:00.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.643+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5934416648659128338', time=2024-09-12T03:11:45.884333+0000, chain.objs.size()=1 2024-09-12T01:38:00.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.643+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.284__shadow_.K_xEvYIuIuCfxAhnADZnbjSHvt7QyQC_0 2024-09-12T01:38:00.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.643+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8948050785623470446', time=2024-09-12T03:11:55.396346+0000, chain.objs.size()=1 2024-09-12T01:38:00.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.643+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.292__shadow_.KuahNG0Pzr08cctAH-8QNq6xtUgYsu3_0 2024-09-12T01:38:00.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.644+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12121731476255813412', time=2024-09-12T03:11:55.418592+0000, chain.objs.size()=1 2024-09-12T01:38:00.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.644+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.292__shadow_.T8tpGhT1GveroQCjW76s6GQQMqdtySE_0 2024-09-12T01:38:00.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.644+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11870853335029486956', time=2024-09-12T03:12:05.634182+0000, chain.objs.size()=1 2024-09-12T01:38:00.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.644+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.301__shadow_.Vo-H6O-u4w7gYdZggJ5Wi6BjFsWjAW4_0 2024-09-12T01:38:00.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.644+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.707439840700263031', time=2024-09-12T03:12:07.593066+0000, chain.objs.size()=1 2024-09-12T01:38:00.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.644+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.303__shadow_.dDN9SW4RcYeho3X_IvcddZSAmcb7ysx_0 2024-09-12T01:38:00.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.644+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6263355039776500960', time=2024-09-12T03:13:06.772985+0000, chain.objs.size()=1 2024-09-12T01:38:00.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.644+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.yA1josYUFiZME3NUZs8MMSJ9k1eOvX5_0 2024-09-12T01:38:00.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.644+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11144376521292349775', time=2024-09-12T03:13:06.984643+0000, chain.objs.size()=1 2024-09-12T01:38:00.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.644+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.onoqsnPEbTtxrFtq1OonSyupL0MyYOJ_0 2024-09-12T01:38:00.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.644+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1364872693788830956', time=2024-09-12T03:13:07.223930+0000, chain.objs.size()=1 2024-09-12T01:38:00.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.644+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.OOJbKtns5lfaDDVqpBZe-Asv0kxDA29_0 2024-09-12T01:38:00.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.645+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11261721437210121064', time=2024-09-12T03:13:08.375993+0000, chain.objs.size()=1 2024-09-12T01:38:00.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.645+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.-xshky6ilqYD_SzlFfk8e6pwTETS6ob_0 2024-09-12T01:38:00.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.645+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6271856848040418142', time=2024-09-12T03:13:08.828531+0000, chain.objs.size()=1 2024-09-12T01:38:00.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.645+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.FiBd3LbeQQgHWeZXY2A9Z8O2R2aLWgH_0 2024-09-12T01:38:00.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.645+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12582537622327838004', time=2024-09-12T03:13:08.882043+0000, chain.objs.size()=1 2024-09-12T01:38:00.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.645+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.LSpg2DgpbQM3jso4cXs16ZG7Jo_4vo4_0 2024-09-12T01:38:00.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.645+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6461085570615972135', time=2024-09-12T03:13:08.962144+0000, chain.objs.size()=1 2024-09-12T01:38:00.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.645+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.riTsAAzGwhs-PL9xorkr-my4w-xuAAS_0 2024-09-12T01:38:00.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.645+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3435845437105187849', time=2024-09-12T03:13:09.042379+0000, chain.objs.size()=1 2024-09-12T01:38:00.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.645+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.bdh7uJcD4cFTdEYYHYiZTTIccrzS2Rz_0 2024-09-12T01:38:00.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.646+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7224445481295589208', time=2024-09-12T03:13:09.084169+0000, chain.objs.size()=1 2024-09-12T01:38:00.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.646+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.JDQ9U154WS47cBf2S2Kh1YLCMKzueIQ_0 2024-09-12T01:38:00.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.646+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3417535070846619861', time=2024-09-12T03:13:09.265618+0000, chain.objs.size()=1 2024-09-12T01:38:00.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.646+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.nu6LAmYDvrCdzTUE7BLZNEXVCBH4ien_0 2024-09-12T01:38:00.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.646+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3042266681048438977', time=2024-09-12T03:13:09.705650+0000, chain.objs.size()=1 2024-09-12T01:38:00.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.646+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.x8ENJU9KkaLAlNuk92FDnx1jxmtHsbO_0 2024-09-12T01:38:00.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.646+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14176516343976494740', time=2024-09-12T03:13:09.902125+0000, chain.objs.size()=1 2024-09-12T01:38:00.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.646+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.ofoILEV7tfMp-cs4Jht3EjC3qkBHyxB_0 2024-09-12T01:38:00.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.646+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13219149249480538634', time=2024-09-12T03:13:10.415365+0000, chain.objs.size()=1 2024-09-12T01:38:00.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.646+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.i8dVcPPqa6V58I2uPdXMhsGB3USYpDR_0 2024-09-12T01:38:00.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.646+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16464022131364739324', time=2024-09-12T03:13:10.449595+0000, chain.objs.size()=1 2024-09-12T01:38:00.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.646+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.vdv2TqeGEXQOThDHwKIUtxa2NUJ7ZcD_0 2024-09-12T01:38:00.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.646+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17057002319643525011', time=2024-09-12T03:13:11.230503+0000, chain.objs.size()=1 2024-09-12T01:38:00.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.646+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.g71EX5UI7P8FJvLEIJXcBBpzXR8Ehc1_0 2024-09-12T01:38:00.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.647+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10322421644133960142', time=2024-09-12T03:13:11.463549+0000, chain.objs.size()=1 2024-09-12T01:38:00.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.647+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.JI693MZQUSpRREDUhf2XJm1Z15OTrsE_0 2024-09-12T01:38:00.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.647+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2638319266666356492', time=2024-09-12T03:13:11.513800+0000, chain.objs.size()=1 2024-09-12T01:38:00.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.647+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.MERMRcPgv3VK87x_ADvLpWf8IK8xnWi_0 2024-09-12T01:38:00.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.647+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2010067646175144195', time=2024-09-12T03:13:11.776143+0000, chain.objs.size()=1 2024-09-12T01:38:00.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.647+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.xHdy4T3W90JxdeOmSK1zHwiHu7zc3s5_0 2024-09-12T01:38:00.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.647+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12466140872957642952', time=2024-09-12T03:13:11.878865+0000, chain.objs.size()=1 2024-09-12T01:38:00.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.647+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.IyQ8A9iabseA1cxYI4kmKS4rT7-gSSp_0 2024-09-12T01:38:00.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.647+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10830825905084377150', time=2024-09-12T03:13:12.072884+0000, chain.objs.size()=1 2024-09-12T01:38:00.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.647+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.fm7NMU0Cx0FuW_5CqWVIxLwDHs__xzv_0 2024-09-12T01:38:00.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.649+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11548458641935364397', time=2024-09-12T03:13:12.529083+0000, chain.objs.size()=1 2024-09-12T01:38:00.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.649+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.O6l-n6K5Tdh6-We5N3NvH5iXE1zkSJm_0 2024-09-12T01:38:00.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.650+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10265497456630210595', time=2024-09-12T03:13:13.101787+0000, chain.objs.size()=1 2024-09-12T01:38:00.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.650+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.GORMwYhTr6enFH7l7f9zEs-FKsAzhRQ_0 2024-09-12T01:38:00.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.650+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9664679533800139787', time=2024-09-12T03:13:13.345695+0000, chain.objs.size()=1 2024-09-12T01:38:00.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.650+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.yvICtx4uWGKr00Zkd9mWZpQ5wzRwT-8_0 2024-09-12T01:38:00.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.650+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18354319590575367238', time=2024-09-12T03:13:13.991305+0000, chain.objs.size()=1 2024-09-12T01:38:00.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.650+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.bXMxMQiOkXj7eRzvhMjZcF0sHdW5J7Y_0 2024-09-12T01:38:00.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.650+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15080455289363867491', time=2024-09-12T03:13:14.120051+0000, chain.objs.size()=1 2024-09-12T01:38:00.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.650+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.VyJNzO_sOH5IXdD2DIUGIL8XiRexmwS_0 2024-09-12T01:38:00.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.650+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3356954422368864115', time=2024-09-12T03:13:14.488407+0000, chain.objs.size()=1 2024-09-12T01:38:00.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.650+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.YRpaNdk1fZPRlVmTvY5c4WkVXsjuNYq_0 2024-09-12T01:38:00.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.650+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3934614078272450947', time=2024-09-12T03:13:14.515435+0000, chain.objs.size()=1 2024-09-12T01:38:00.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.650+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.WjdfroOdkF3aZm15pBv3mKCXpJSRlyl_0 2024-09-12T01:38:00.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.650+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10844287531002335221', time=2024-09-12T03:13:14.516167+0000, chain.objs.size()=1 2024-09-12T01:38:00.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.650+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.zuCvRVqMNbRivnf2x2_vSlxQefCZHPf_0 2024-09-12T01:38:00.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.650+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8357150827346128982', time=2024-09-12T03:13:15.093939+0000, chain.objs.size()=1 2024-09-12T01:38:00.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.650+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.k_sgNq1CiaSOzRYeauCvyQwGCVrhVZ4_0 2024-09-12T01:38:00.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.650+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9731317729148578650', time=2024-09-12T03:13:16.041318+0000, chain.objs.size()=1 2024-09-12T01:38:00.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.650+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.1ZBO3MWVlL3gKc15fjd-Dgbc94RZVKc_0 2024-09-12T01:38:00.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.650+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6437193857122205580', time=2024-09-12T03:13:16.062484+0000, chain.objs.size()=1 2024-09-12T01:38:00.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.650+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.0BW0Mbo-j2_7mf03RufWisxuyEaQvy__0 2024-09-12T01:38:00.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.653+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16327078359654035088', time=2024-09-12T03:13:16.063166+0000, chain.objs.size()=1 2024-09-12T01:38:00.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.653+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.rfrRGXQtkoMzj8fm_qlpphCV3u_EK0C_0 2024-09-12T01:38:00.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.653+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8766455604666128522', time=2024-09-12T03:13:16.526590+0000, chain.objs.size()=1 2024-09-12T01:38:00.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.653+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.bPQGkfcINxBuTCmJ5afl4YcDkL9t_el_0 2024-09-12T01:38:00.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.653+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16597950735129230386', time=2024-09-12T03:13:16.527295+0000, chain.objs.size()=1 2024-09-12T01:38:00.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.653+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.q3WivHpPzGSRGFd3AeujifmfuWlBcxs_0 2024-09-12T01:38:00.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.653+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15959921637417423552', time=2024-09-12T03:13:16.589823+0000, chain.objs.size()=1 2024-09-12T01:38:00.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.653+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.RX3Q1OdKpsRVLxZUvXuw8jjWvgIrQKp_0 2024-09-12T01:38:00.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.653+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15056548163259366561', time=2024-09-12T03:13:16.643102+0000, chain.objs.size()=1 2024-09-12T01:38:00.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.653+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.HWdlUVhMvJru0WA-LAUO-szTMWgAnIk_0 2024-09-12T01:38:00.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.653+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1246093902556009802', time=2024-09-12T03:13:16.673650+0000, chain.objs.size()=1 2024-09-12T01:38:00.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.653+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.Pg1xYcy5X31rgjpRojWGoesgGHMl-VO_0 2024-09-12T01:38:00.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.653+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18422366632121076251', time=2024-09-12T03:13:16.730051+0000, chain.objs.size()=1 2024-09-12T01:38:00.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.653+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.UltJmgiC26edY6l77co0mDq5rvFEOqM_0 2024-09-12T01:38:00.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.653+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13800467346353566137', time=2024-09-12T03:13:16.911474+0000, chain.objs.size()=1 2024-09-12T01:38:00.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.653+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.9nhK1C_L8mQ1fPZ1T_FkeTgbiN_KxKt_0 2024-09-12T01:38:00.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.653+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8302337735867834627', time=2024-09-12T03:13:17.094287+0000, chain.objs.size()=1 2024-09-12T01:38:00.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.653+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.CE8V1hVoLUShr6rBThmStQEVgoR1QTO_0 2024-09-12T01:38:00.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.653+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16679753157032379693', time=2024-09-12T03:13:17.138995+0000, chain.objs.size()=1 2024-09-12T01:38:00.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.653+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.u1GexTN_zI9IH6VdkmG5S7Z5f5ZTQOp_0 2024-09-12T01:38:00.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.653+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10537309906871275226', time=2024-09-12T03:13:53.770888+0000, chain.objs.size()=1 2024-09-12T01:38:00.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.653+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.ygY9yy9wMoVaBCBcpzx_ttZpyMbISEx_0 2024-09-12T01:38:00.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.656+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13016621964991440572', time=2024-09-12T03:13:53.771599+0000, chain.objs.size()=1 2024-09-12T01:38:00.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.656+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.eYeNzubcI-qrrnvDdbGvvtalF6v-nYn_0 2024-09-12T01:38:00.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.656+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15847775908144219956', time=2024-09-12T03:13:53.905858+0000, chain.objs.size()=1 2024-09-12T01:38:00.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.656+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.ZpXJIMy36p39cBE4CmBKdPdXF0J8WAj_0 2024-09-12T01:38:00.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.656+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12753219382077398834', time=2024-09-12T03:13:53.906539+0000, chain.objs.size()=1 2024-09-12T01:38:00.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.656+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.v5ougEDmHKpTSbBvEIiDrZa5yRHE-FH_0 2024-09-12T01:38:00.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.656+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4676972027230575793', time=2024-09-12T03:13:53.966250+0000, chain.objs.size()=1 2024-09-12T01:38:00.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.656+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.kvSMSuiALr6G72wBJ8Pyka9p4CkUdJL_0 2024-09-12T01:38:00.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.656+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8108984719344537967', time=2024-09-12T03:13:54.465394+0000, chain.objs.size()=1 2024-09-12T01:38:00.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.656+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.qNYHWw2d4D35s_X_jv9JYzqnsp34u4X_0 2024-09-12T01:38:00.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.656+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13678967453001596523', time=2024-09-12T03:13:55.550344+0000, chain.objs.size()=1 2024-09-12T01:38:00.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.656+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.A5WidX3hn6IQ-Wfri1o5GumkwdCCUD7_0 2024-09-12T01:38:00.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.656+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2789362340932065778', time=2024-09-12T03:13:55.965274+0000, chain.objs.size()=1 2024-09-12T01:38:00.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.656+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.qR-fwHPBupud7DnS41UWWLVWRAxgYfA_0 2024-09-12T01:38:00.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.662+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 0/48847 2024-09-12T01:38:00.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.666+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=39, truncated=0, next_marker='' 2024-09-12T01:38:00.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.666+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13373291431042684311', time=2024-09-12T03:13:56.513491+0000, chain.objs.size()=1 2024-09-12T01:38:00.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.666+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Su7_V7MaxlaJ_MJoIaoUB2gjpJDtNdx_0 2024-09-12T01:38:00.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.666+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11409693147737763072', time=2024-09-12T03:13:57.087704+0000, chain.objs.size()=1 2024-09-12T01:38:00.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.666+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.OruZrGyecPBm-7haT0x9b7wZMDvE3B0_0 2024-09-12T01:38:00.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.666+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4788439434125675285', time=2024-09-12T03:13:57.125054+0000, chain.objs.size()=1 2024-09-12T01:38:00.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.666+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.9pWyPXjJ5dFZaglJQA6mFCtPOemjDTQ_0 2024-09-12T01:38:00.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.666+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1860337003926350365', time=2024-09-12T03:13:58.602591+0000, chain.objs.size()=1 2024-09-12T01:38:00.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.666+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.-IBA9vCAYXkrvzEDB3RVdK5Mumhi2dG_0 2024-09-12T01:38:00.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.666+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4072798802447509340', time=2024-09-12T03:13:58.687373+0000, chain.objs.size()=1 2024-09-12T01:38:00.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.666+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.c2U6jKsnl0vuLX4eL9CMRuvqb_Ip0im_0 2024-09-12T01:38:00.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.666+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8610674461495671480', time=2024-09-12T03:13:59.543103+0000, chain.objs.size()=1 2024-09-12T01:38:00.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.666+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Jw_I_lVNhMszb5KivYsmpKqiRGgfZHS_0 2024-09-12T01:38:00.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.666+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17025287839676630745', time=2024-09-12T03:13:59.701957+0000, chain.objs.size()=1 2024-09-12T01:38:00.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.666+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.I-iSqNE6ewakWVE8rRx5HnE5uwvEEIM_0 2024-09-12T01:38:00.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.666+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5488951324546599351', time=2024-09-12T03:14:00.447921+0000, chain.objs.size()=1 2024-09-12T01:38:00.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.666+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.wu86m0MrbUatjQMotF1M1Bbgcpo1QHJ_0 2024-09-12T01:38:00.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.666+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13960371885816610105', time=2024-09-12T03:14:00.677433+0000, chain.objs.size()=1 2024-09-12T01:38:00.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.666+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.oub_RMtexpoGyW1_d6gZvsXSAvP3bR6_0 2024-09-12T01:38:00.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.666+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.811929962788116789', time=2024-09-12T03:14:00.860696+0000, chain.objs.size()=1 2024-09-12T01:38:00.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.666+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.6S25a6Us-rdXyXB834YpucuexqAmv7c_0 2024-09-12T01:38:00.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.666+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17730754872643109519', time=2024-09-12T03:14:01.366244+0000, chain.objs.size()=1 2024-09-12T01:38:00.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.666+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.kcgd6yNeuLp4V1ttqyf0r4iY-fDhI9e_0 2024-09-12T01:38:00.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.666+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2746539088083682367', time=2024-09-12T03:14:01.714017+0000, chain.objs.size()=1 2024-09-12T01:38:00.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.666+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.VrY2P3odlE0OFb2SnKhETk5tF1eDV7t_0 2024-09-12T01:38:00.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.668+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3763113736447665612', time=2024-09-12T03:14:01.947322+0000, chain.objs.size()=1 2024-09-12T01:38:00.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.668+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.nP5iokR_oyTT3UERWQeo4WojoUhpG3g_0 2024-09-12T01:38:00.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.668+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11953690315275936237', time=2024-09-12T03:14:02.085323+0000, chain.objs.size()=1 2024-09-12T01:38:00.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.668+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.0i4uD1AgwC3Yfd1Na9KUQXVH_TSlWVR_0 2024-09-12T01:38:00.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.668+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1457030176044445480', time=2024-09-12T03:14:02.939919+0000, chain.objs.size()=1 2024-09-12T01:38:00.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.668+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.UQVkrIadavZ_I1Se6udR7AA4nW_tHv8_0 2024-09-12T01:38:00.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.668+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4872010576057024382', time=2024-09-12T03:14:03.082163+0000, chain.objs.size()=1 2024-09-12T01:38:00.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.668+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Bs4g8C8TtBB-9aih87P5xItKZ42nnf8_0 2024-09-12T01:38:00.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.668+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8437582753115097813', time=2024-09-12T03:14:03.207388+0000, chain.objs.size()=1 2024-09-12T01:38:00.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.668+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.hIhyZhMavhsQG1xA-qqysFpHFuVfeWK_0 2024-09-12T01:38:00.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.668+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16229959494216549438', time=2024-09-12T03:14:03.211389+0000, chain.objs.size()=1 2024-09-12T01:38:00.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.668+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.gulIco13hWEUDtyMSo2tLalEyvCGgsA_0 2024-09-12T01:38:00.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.668+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11427748296452477922', time=2024-09-12T03:14:03.414067+0000, chain.objs.size()=1 2024-09-12T01:38:00.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.668+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.LZLfh3XqsTYW4GIy01Yp29rtD9NwD4D_0 2024-09-12T01:38:00.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.668+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3604889177999119375', time=2024-09-12T03:15:08.948087+0000, chain.objs.size()=1 2024-09-12T01:38:00.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.668+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.394__shadow:bAy6U1C-XMgK3PRTVXJc-2AxhCDiWgf_.qkgXmswsGZtei0OqqtFt0AKCO-1-6aY_0 2024-09-12T01:38:00.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.668+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9153387097342780953', time=2024-09-12T03:16:08.378530+0000, chain.objs.size()=1 2024-09-12T01:38:00.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.668+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.455__shadow_.D_TweKkwrI_LQf-Eet5CWUBLSejR2Gz_0 2024-09-12T01:38:00.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.668+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5000685551892980554', time=2024-09-12T03:16:18.024164+0000, chain.objs.size()=1 2024-09-12T01:38:00.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.668+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.462__shadow_.iY_xObFq3VZ3KxfSu01alxQZSahVl1z_0 2024-09-12T01:38:00.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.668+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1378299055601850314', time=2024-09-12T03:16:21.935787+0000, chain.objs.size()=1 2024-09-12T01:38:00.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.668+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.465__shadow_.s7HMCgcei3Qa0LD3w-cZeexkx4IbjLG_0 2024-09-12T01:38:00.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.669+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1327549434415968307', time=2024-09-12T03:18:34.311674+0000, chain.objs.size()=3 2024-09-12T01:38:00.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.669+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.520__shadow:ECOAISTqAX5doXaQMzVTwO2XDl0.tp4_.56YsQCe6AEiaecfPoZrQ2uqRtMm1-MG_0 2024-09-12T01:38:00.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.670+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.520__shadow:ECOAISTqAX5doXaQMzVTwO2XDl0.tp4_.56YsQCe6AEiaecfPoZrQ2uqRtMm1-MG_1 2024-09-12T01:38:00.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.670+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.520__shadow:ECOAISTqAX5doXaQMzVTwO2XDl0.tp4_.56YsQCe6AEiaecfPoZrQ2uqRtMm1-MG_2 2024-09-12T01:38:00.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.670+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9853245479753335331', time=2024-09-12T03:20:23.480921+0000, chain.objs.size()=6 2024-09-12T01:38:00.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.670+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.522__multipart_mymultipart.IF6Nw2XVN5alrq9zMbkAOdT6o2lUHy_q.1 2024-09-12T01:38:00.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.670+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.522__multipart_mymultipart.H6SqA3Toagdhs6YdAF-udU1trARbffJo.2 2024-09-12T01:38:00.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.672+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.522__multipart_mymultipart.1L-38c9iXIPM1gjxav8YnNRA2F65xQUf.3 2024-09-12T01:38:00.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.672+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.522__multipart_mymultipart.uOilmGX4cqjRbo2hiKlHwsnValw8x2Ak.4 2024-09-12T01:38:00.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.672+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.522__multipart_mymultipart.4FCmKLN3DlPjikZxzvDA50jAod54t6hk.5 2024-09-12T01:38:00.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.672+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.522__multipart_mymultipart.GkN-MM3qG4UJuSRHwdGiCOfer3CuUDLg.6 2024-09-12T01:38:00.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.672+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17316180206521128167', time=2024-09-12T03:22:48.452601+0000, chain.objs.size()=1 2024-09-12T01:38:00.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.672+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.558__shadow_.b6GTu4rcRW0hTea86nWybibFyFfs0kY_0 2024-09-12T01:38:00.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.672+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9625033336072118502', time=2024-09-12T03:23:04.200226+0000, chain.objs.size()=1 2024-09-12T01:38:00.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.672+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.565__shadow_.m33OoEYYEBLEB8P7DRLsCODhvJu6PGF_0 2024-09-12T01:38:00.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.672+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.645228992416010548', time=2024-09-12T03:23:05.098157+0000, chain.objs.size()=1 2024-09-12T01:38:00.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.672+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.566__shadow_.8DK8w0ueLEi_2sSOUCMvPrR-IT4cu7g_0 2024-09-12T01:38:00.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.673+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11571070479519066170', time=2024-09-12T03:23:14.086380+0000, chain.objs.size()=1 2024-09-12T01:38:00.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.673+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.569__shadow:YZgf9dxUxu.ltvhk720USVnP6kcamr7_.hHW4WONiGevRUnCVoHWG7ZP2J6aVJ6J_0 2024-09-12T01:38:00.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.673+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.255247237340742017', time=2024-09-12T03:23:14.754241+0000, chain.objs.size()=1 2024-09-12T01:38:00.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.673+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.569__shadow:6QcBl4-y54.FBx57ZngHVjXZlzHlcfM_.H_8CUQW-TwEq4egRyp_JVluxGzK4O8-_0 2024-09-12T01:38:00.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.674+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2134409116421709181', time=2024-09-12T03:23:28.483434+0000, chain.objs.size()=1 2024-09-12T01:38:00.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.674+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.574__shadow:KDQg8T3x1hv7IAbEt45vUhwbBMWF-ER_.kxVncFWsK2U9wJnohkS2HzXmDuW2wCJ_0 2024-09-12T01:38:00.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.674+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4647845390537236784', time=2024-09-12T03:23:33.874493+0000, chain.objs.size()=1 2024-09-12T01:38:00.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.674+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.576__shadow:O8v-3n8rcrR6QnRie0brj7pZ9.2so4Q_.LWgxHS-SSLhy-fpep0me6b_pQ0YG5Oe_0 2024-09-12T01:38:00.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.674+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14137234843365437339', time=2024-09-12T03:23:46.235576+0000, chain.objs.size()=1 2024-09-12T01:38:00.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.674+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.577__shadow:RWJM6ax2HOS3HJpPmfhy0ZbeDCTAsol_.curjCvtHzInVt7YnEeIlsHDeF6p2IvF_0 2024-09-12T01:38:00.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.674+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.658218988579448053', time=2024-09-12T03:23:51.380154+0000, chain.objs.size()=1 2024-09-12T01:38:00.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.674+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.577__shadow:ARN9iZRPj0rMEksRgKA51SecMLSkz8L_.lszrYK9JsUIY34EwzjwUtdVC-l799MP_0 2024-09-12T01:38:00.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.674+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2550840365405441171', time=2024-09-12T03:26:42.830234+0000, chain.objs.size()=6 2024-09-12T01:38:00.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.674+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.614__multipart_multipart_enc.2~2mhHdAAxoMZ4Q2pQxwRfdO2-mhPXhD0.1 2024-09-12T01:38:00.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.674+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.614__multipart_multipart_enc.2~2mhHdAAxoMZ4Q2pQxwRfdO2-mhPXhD0.2 2024-09-12T01:38:00.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.674+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.614__multipart_multipart_enc.2~2mhHdAAxoMZ4Q2pQxwRfdO2-mhPXhD0.3 2024-09-12T01:38:00.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.674+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.614__multipart_multipart_enc.2~2mhHdAAxoMZ4Q2pQxwRfdO2-mhPXhD0.4 2024-09-12T01:38:00.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.674+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.614__multipart_multipart_enc.2~2mhHdAAxoMZ4Q2pQxwRfdO2-mhPXhD0.5 2024-09-12T01:38:00.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.675+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.614__multipart_multipart_enc.2~2mhHdAAxoMZ4Q2pQxwRfdO2-mhPXhD0.6 2024-09-12T01:38:00.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.675+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1512468265317112302', time=2024-09-12T03:30:02.193351+0000, chain.objs.size()=1 2024-09-12T01:38:00.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.675+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.640__shadow_.OUT3JK8f8jaRhQric663KPce4G02eo1_0 2024-09-12T01:38:00.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.677+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6984976898306717242', time=2024-09-12T03:31:24.717413+0000, chain.objs.size()=1 2024-09-12T01:38:00.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.677+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.695__shadow_.iv9LL_bf4BRheRssE-MBKzVHsu3L8Xs_0 2024-09-12T01:38:00.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.677+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16607346571454286869', time=2024-09-12T03:31:27.392579+0000, chain.objs.size()=1 2024-09-12T01:38:00.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.677+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.698__shadow:wRkByRq-D1LN9Asba.b2UVYmmmSWWhe_.O9EZpmCNLzln03xcfIrSrjp7Put4NwV_0 2024-09-12T01:38:00.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.677+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18032593431552300815', time=2024-09-12T03:31:34.884432+0000, chain.objs.size()=1 2024-09-12T01:38:00.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.677+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.706__shadow_.PR8PfkjfT8tc0ua3X4PFm83SN0l0ypO_0 2024-09-12T01:38:00.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.682+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:38:00.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.685+0000 7f8786c98800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T01:38:00.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.687+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:38:00.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.687+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:38:00.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.688+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/56512' 2024-09-12T01:38:00.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.688+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='_yDgvBSj6pa0dJOTPPgp9BXg43XRMNmE', time=2024-09-12T03:07:22.120504+0000, chain.objs.size()=1 2024-09-12T01:38:00.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.688+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.165__shadow_.rlmIuLbIkHrYPM5TPTg1jYGgurW2UbK_0 2024-09-12T01:38:00.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.688+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11072370227651229310', time=2024-09-12T03:10:09.696761+0000, chain.objs.size()=1 2024-09-12T01:38:00.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.688+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.234__shadow_.9cNaV-P1qS3y5rhD_NITa9A3b_yDUw2_0 2024-09-12T01:38:00.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.688+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13107664935314389479', time=2024-09-12T03:10:13.316037+0000, chain.objs.size()=1 2024-09-12T01:38:00.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.688+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.237__shadow_.GNGhhW2BW6Q_V8UhVnN9OpxHTZa5kla_0 2024-09-12T01:38:00.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.688+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.613596040156330780', time=2024-09-12T03:10:31.712889+0000, chain.objs.size()=1 2024-09-12T01:38:00.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.688+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.254__shadow_.k-pcAwOomXD2agAP5VHTAZeMCTF_3d__0 2024-09-12T01:38:00.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.688+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9058879132891214421', time=2024-09-12T03:11:14.674777+0000, chain.objs.size()=1 2024-09-12T01:38:00.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.688+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.TNKBeKGpPQVUe5VBEfmNHWOEHT-C-Mc_0 2024-09-12T01:38:00.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.688+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6014237372176634774', time=2024-09-12T03:11:14.924332+0000, chain.objs.size()=1 2024-09-12T01:38:00.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.688+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.4ub1zuataDg5woGokBQ71bcIqE4PM27_0 2024-09-12T01:38:00.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.688+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.602772302862467872', time=2024-09-12T03:11:14.972220+0000, chain.objs.size()=1 2024-09-12T01:38:00.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.688+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.z4beLteB92yQLfS3nxzDlDTCuog3Tem_0 2024-09-12T01:38:00.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.688+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11639425461892249924', time=2024-09-12T03:11:15.342761+0000, chain.objs.size()=1 2024-09-12T01:38:00.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.688+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.1U4-kQ7eyctNvbebuFMcl2GbQ3HlMGF_0 2024-09-12T01:38:00.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.688+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9083078572462393611', time=2024-09-12T03:11:15.421356+0000, chain.objs.size()=1 2024-09-12T01:38:00.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.688+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.oJjNzAZAOr_9rE1UU0wUMfMdTaDWXFT_0 2024-09-12T01:38:00.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.688+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13270955808111941328', time=2024-09-12T03:11:15.973879+0000, chain.objs.size()=1 2024-09-12T01:38:00.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.688+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Zcz7A6o3Zx7L0AqcsamkV3IeLFWSlCJ_0 2024-09-12T01:38:00.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.688+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4008119765319958660', time=2024-09-12T03:11:16.096826+0000, chain.objs.size()=1 2024-09-12T01:38:00.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.688+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.bI-WxYsasH2E1RLYD-wgGpcHdSikZUS_0 2024-09-12T01:38:00.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.688+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3823327396425490929', time=2024-09-12T03:11:16.183433+0000, chain.objs.size()=1 2024-09-12T01:38:00.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.688+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.2N1mhremqFcfsWxP2H6_dFWw272gQx9_0 2024-09-12T01:38:00.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.689+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7898285461186115799', time=2024-09-12T03:11:16.595638+0000, chain.objs.size()=1 2024-09-12T01:38:00.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.690+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.joNNnIiZ8Rmo0gVeeBF4MVgt2i4217E_0 2024-09-12T01:38:00.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.690+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16447713890516123143', time=2024-09-12T03:11:16.870247+0000, chain.objs.size()=1 2024-09-12T01:38:00.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.690+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.IjnE76lHQ1ML12WVJn5dbo-HYUnS2eb_0 2024-09-12T01:38:00.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.690+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8388364076412241724', time=2024-09-12T03:11:16.942508+0000, chain.objs.size()=1 2024-09-12T01:38:00.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.690+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.co_NMDMIFSB490UjEtoqpvoY_ntHtpn_0 2024-09-12T01:38:00.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.690+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5343393030863184969', time=2024-09-12T03:11:17.552723+0000, chain.objs.size()=1 2024-09-12T01:38:00.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.690+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.GO4A-wjn8RRECVImqP8kwn7cPWLHkib_0 2024-09-12T01:38:00.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.690+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8606002649422400133', time=2024-09-12T03:11:17.553308+0000, chain.objs.size()=1 2024-09-12T01:38:00.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.690+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.yoPaVwifZaT3LMxYGaq0ghHjD_3qT9g_0 2024-09-12T01:38:00.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.690+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16496585859713310129', time=2024-09-12T03:11:17.962586+0000, chain.objs.size()=1 2024-09-12T01:38:00.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.690+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.9ca-Vt0xyqRxevBe3HBdTfPiUfwUuO-_0 2024-09-12T01:38:00.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.690+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16949391490699678588', time=2024-09-12T03:11:18.133903+0000, chain.objs.size()=1 2024-09-12T01:38:00.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.690+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Gk4NrBAqCBkmN-bTHk4EUlgHkaJk0sM_0 2024-09-12T01:38:00.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.690+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6366191041050328820', time=2024-09-12T03:11:18.161999+0000, chain.objs.size()=1 2024-09-12T01:38:00.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.690+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.TfP1-CKG5s4C45abKnv2G4WHsk8sZ_1_0 2024-09-12T01:38:00.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.690+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6196477067412466029', time=2024-09-12T03:11:18.195885+0000, chain.objs.size()=1 2024-09-12T01:38:00.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.690+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.eh5BBw6v5RaCKettzzsU3iD7ux9fOAl_0 2024-09-12T01:38:00.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.691+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9867555709802850847', time=2024-09-12T03:11:18.304076+0000, chain.objs.size()=1 2024-09-12T01:38:00.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.691+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.hKsa0jIEanAYHYdlPyAkbeG64QPYZ2P_0 2024-09-12T01:38:00.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.691+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10084144425676482110', time=2024-09-12T03:11:18.350557+0000, chain.objs.size()=1 2024-09-12T01:38:00.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.691+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.oquWaWEOGccpbYzWYmtGhTHg00xD-76_0 2024-09-12T01:38:00.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.691+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18071234661345764013', time=2024-09-12T03:11:18.434917+0000, chain.objs.size()=1 2024-09-12T01:38:00.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.691+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.vbzWDSRQZKhz8ypuDlRTclNlCLHUQzb_0 2024-09-12T01:38:00.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.693+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5324804462363415384', time=2024-09-12T03:11:18.842497+0000, chain.objs.size()=1 2024-09-12T01:38:00.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.693+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Km2ZIuMfaPi0YJLGnEMa8FBH5j5Y4-O_0 2024-09-12T01:38:00.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.693+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12984234387515027545', time=2024-09-12T03:11:19.069165+0000, chain.objs.size()=1 2024-09-12T01:38:00.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.693+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.hk698ka8sppUFDytrjl5o9McsDRzGaG_0 2024-09-12T01:38:00.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.693+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15058787591764392580', time=2024-09-12T03:11:19.069749+0000, chain.objs.size()=1 2024-09-12T01:38:00.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.693+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.-3xvHsqTYVJEhZph5aTi22oF_fpolbK_0 2024-09-12T01:38:00.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.694+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6651274268844076606', time=2024-09-12T03:11:19.080663+0000, chain.objs.size()=1 2024-09-12T01:38:00.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.694+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Is3Uz-5fa_eecXUtkCzdfQ2clp1As8T_0 2024-09-12T01:38:00.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.697+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15143364914968072515', time=2024-09-12T03:11:19.763518+0000, chain.objs.size()=1 2024-09-12T01:38:00.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.697+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.xjSQcpFolnbCgQyxBIQNuYpwYoKS3uk_0 2024-09-12T01:38:00.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.697+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5798599309656104322', time=2024-09-12T03:11:20.207082+0000, chain.objs.size()=1 2024-09-12T01:38:00.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.697+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.300pghF0TxhY2p_rE7541JxGjDjEKW8_0 2024-09-12T01:38:00.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.697+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11718711408404415329', time=2024-09-12T03:11:20.695829+0000, chain.objs.size()=1 2024-09-12T01:38:00.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.697+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.QjMWp23I_SY1_VSwnINWxa2jZvTRmMG_0 2024-09-12T01:38:00.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.697+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14114098888968643227', time=2024-09-12T03:11:20.934225+0000, chain.objs.size()=1 2024-09-12T01:38:00.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.697+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.49KESMWqOcXoefsM_mltnbqhCvYPbFm_0 2024-09-12T01:38:00.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.697+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1995600173994942760', time=2024-09-12T03:11:21.072949+0000, chain.objs.size()=1 2024-09-12T01:38:00.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.697+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.GwwCBU1pxCnhK7s5gN2ZBtMXAnvGhP0_0 2024-09-12T01:38:00.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.697+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4009773929083993618', time=2024-09-12T03:11:21.079982+0000, chain.objs.size()=1 2024-09-12T01:38:00.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.697+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.0tMgei7ut8GOVIZx4znS2MmQj9oR57y_0 2024-09-12T01:38:00.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.697+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6347113868952458157', time=2024-09-12T03:11:21.508311+0000, chain.objs.size()=1 2024-09-12T01:38:00.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.697+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.SNFmzZ6Ca0iBaMZgMXWerUt-dME0nxL_0 2024-09-12T01:38:00.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.697+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13492093453935406019', time=2024-09-12T03:11:21.543259+0000, chain.objs.size()=1 2024-09-12T01:38:00.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.697+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.GRyXNdysfQRXwt97Tu_LXdlwVdpA7ZK_0 2024-09-12T01:38:00.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.697+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3746744199493619452', time=2024-09-12T03:11:21.665748+0000, chain.objs.size()=1 2024-09-12T01:38:00.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.697+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.IQC8DuCFFojBnMdC0pq42ACFy_XwjNc_0 2024-09-12T01:38:00.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.697+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15970333119049290438', time=2024-09-12T03:11:21.839829+0000, chain.objs.size()=1 2024-09-12T01:38:00.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.697+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.cB-G9Dq0ueBCq7IcBLWotjhnk8YVWbe_0 2024-09-12T01:38:00.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.697+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8895704480670678479', time=2024-09-12T03:11:22.177749+0000, chain.objs.size()=1 2024-09-12T01:38:00.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.697+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.YKg_ywWuPTQtO80EtOcYtdgffmUpVeE_0 2024-09-12T01:38:00.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.702+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9384714452426348027', time=2024-09-12T03:11:22.279077+0000, chain.objs.size()=1 2024-09-12T01:38:00.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.702+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.mHcWUZ7Qp4GDRt8nUq7J8vzGaHgqU52_0 2024-09-12T01:38:00.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.702+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14732299238816489399', time=2024-09-12T03:11:22.316309+0000, chain.objs.size()=1 2024-09-12T01:38:00.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.702+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.JKDwnqicJgQVYS6t164FqhrmauKyoDu_0 2024-09-12T01:38:00.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.702+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10687327446590604850', time=2024-09-12T03:11:22.542940+0000, chain.objs.size()=1 2024-09-12T01:38:00.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.702+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Z8IyzoxYQM1IrjvzrdX0zgylNP0VFri_0 2024-09-12T01:38:00.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.702+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5961135383289386219', time=2024-09-12T03:11:22.859826+0000, chain.objs.size()=1 2024-09-12T01:38:00.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.702+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.raZLR0tAXPDV9ia3gLa4_f_KQPtgA1k_0 2024-09-12T01:38:00.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.702+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18257107033988101298', time=2024-09-12T03:11:22.861105+0000, chain.objs.size()=1 2024-09-12T01:38:00.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.702+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.9TGyftEIxbfNqs-w8Z4bsWagdpzFWxH_0 2024-09-12T01:38:00.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.702+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10610665913137192033', time=2024-09-12T03:11:23.115688+0000, chain.objs.size()=1 2024-09-12T01:38:00.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.702+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_._8llSPiLitV09DvwVQ9of1zHs7ZfsTk_0 2024-09-12T01:38:00.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.702+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.822423979304893824', time=2024-09-12T03:11:23.410790+0000, chain.objs.size()=1 2024-09-12T01:38:00.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.702+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.1SiGoB6pI-aYfh3tNW1SwtTHR6oc4rg_0 2024-09-12T01:38:00.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.702+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4426376653831397205', time=2024-09-12T03:11:23.823010+0000, chain.objs.size()=1 2024-09-12T01:38:00.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.702+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.1boH6oxy52jgTinMviAttbzt0G5iicm_0 2024-09-12T01:38:00.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.702+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15716959148501335222', time=2024-09-12T03:11:24.284674+0000, chain.objs.size()=1 2024-09-12T01:38:00.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.702+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.-8qk17Epqr3fV9vDUIHjY2eAU9WETFL_0 2024-09-12T01:38:00.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.702+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.511133869318876607', time=2024-09-12T03:11:24.568263+0000, chain.objs.size()=1 2024-09-12T01:38:00.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.702+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.x4JIdj-5Q16jFmkmnf62GEgWnqiSIKC_0 2024-09-12T01:38:00.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.702+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13275452798615818498', time=2024-09-12T03:11:37.117066+0000, chain.objs.size()=1 2024-09-12T01:38:00.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.702+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.275__shadow_.GzojcpHymvM6bDgJoLZToN4LlZzL-lD_0 2024-09-12T01:38:00.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.703+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10076855392523458466', time=2024-09-12T03:11:38.085706+0000, chain.objs.size()=1 2024-09-12T01:38:00.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.703+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.276__shadow_.AKGoAxDKD_AigDA4P764gEkhzUv6LyY_0 2024-09-12T01:38:00.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.704+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2301510361550767351', time=2024-09-12T03:11:41.983804+0000, chain.objs.size()=1 2024-09-12T01:38:00.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.704+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.280__shadow_.Yz4xWk2ZL72-4Mt3vG-M_CYAbbgFwDt_0 2024-09-12T01:38:00.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.705+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10599065588139479841', time=2024-09-12T03:11:47.962679+0000, chain.objs.size()=1 2024-09-12T01:38:00.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.705+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.286__shadow_.hAu-c5Dj9YBa9Uyn7vDxBHu2wxHGiiC_0 2024-09-12T01:38:00.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.705+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5731911281559653594', time=2024-09-12T03:11:55.319319+0000, chain.objs.size()=1 2024-09-12T01:38:00.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.705+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.292__shadow_.JhdFLLfJuK3WjveNu2N7l_6miwgXZar_0 2024-09-12T01:38:00.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.706+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17352177633474231834', time=2024-09-12T03:11:57.496850+0000, chain.objs.size()=1 2024-09-12T01:38:00.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.706+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.293__shadow_.fWO-lRg-9DM3RN4hvMe7yrGAUPsCd8H_0 2024-09-12T01:38:00.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.706+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7642621550774979551', time=2024-09-12T03:11:57.506972+0000, chain.objs.size()=1 2024-09-12T01:38:00.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.706+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.293__shadow_.QyvWCM_lYJgYMBG1WoYDQkAYTMi0Gy9_0 2024-09-12T01:38:00.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.706+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7086192260446081927', time=2024-09-12T03:11:57.603588+0000, chain.objs.size()=1 2024-09-12T01:38:00.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.706+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.293__shadow_.BpTXv7D0QOLfvUXgQp-lW2vNSPGYEdY_0 2024-09-12T01:38:00.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.706+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14473438009470699711', time=2024-09-12T03:11:59.560949+0000, chain.objs.size()=1 2024-09-12T01:38:00.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.706+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.295__shadow_.0PbIWEMCXCoMf1lGNKabnKlDInHMJi4_0 2024-09-12T01:38:00.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.706+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16220827392422125885', time=2024-09-12T03:12:07.590008+0000, chain.objs.size()=1 2024-09-12T01:38:00.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.706+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.303__shadow_.HVeBSRmftks71yrH3lKXLUCxoU8qEqK_0 2024-09-12T01:38:00.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.706+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9674599781145850670', time=2024-09-12T03:13:07.090325+0000, chain.objs.size()=1 2024-09-12T01:38:00.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.706+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.VZ46T3M2tMJ6VfWdjI40HkegIRa0-6z_0 2024-09-12T01:38:00.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.706+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10869498434696942823', time=2024-09-12T03:13:09.229866+0000, chain.objs.size()=1 2024-09-12T01:38:00.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.706+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.fVFRYn73NUg9XuZorICm1JzJTAgKxMr_0 2024-09-12T01:38:00.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.706+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12814684394864272187', time=2024-09-12T03:13:09.749110+0000, chain.objs.size()=1 2024-09-12T01:38:00.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.706+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.lmjHaq8t7hXWo9VaetlM2Yrg_mzZEmD_0 2024-09-12T01:38:00.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.706+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11498845843064354224', time=2024-09-12T03:13:09.873696+0000, chain.objs.size()=1 2024-09-12T01:38:00.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.706+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.coI2Xh7LaaZmFhWbO-j3nhFp2jaTLwO_0 2024-09-12T01:38:00.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.706+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3543367986600395542', time=2024-09-12T03:13:10.205125+0000, chain.objs.size()=1 2024-09-12T01:38:00.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.706+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.2FhHV7oxe65qh2Cj8Edaci16e2vb73F_0 2024-09-12T01:38:00.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.707+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11986196507792370266', time=2024-09-12T03:13:10.235438+0000, chain.objs.size()=1 2024-09-12T01:38:00.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.707+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.nrz5loRvpEqtAyyk9khMye7wDg19c2r_0 2024-09-12T01:38:00.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.707+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11412425625166827879', time=2024-09-12T03:13:10.485800+0000, chain.objs.size()=1 2024-09-12T01:38:00.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.707+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.dIHFQdIwXgK2UgMI14byRU1QnFkz9HZ_0 2024-09-12T01:38:00.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.708+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11342901672396990881', time=2024-09-12T03:13:11.085808+0000, chain.objs.size()=1 2024-09-12T01:38:00.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.708+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.U6ApT-7soSl8G6AT97L8TVkuF2VkhH9_0 2024-09-12T01:38:00.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.708+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16103478726968580464', time=2024-09-12T03:13:11.741851+0000, chain.objs.size()=1 2024-09-12T01:38:00.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.708+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.DLlTcQofuj4PHWdTb1LfBb1WGhxe2NK_0 2024-09-12T01:38:00.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.708+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9501105324087803218', time=2024-09-12T03:13:11.743242+0000, chain.objs.size()=1 2024-09-12T01:38:00.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.708+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.7eIjt7UBgwccD0asrX50SY8W8eGiLhc_0 2024-09-12T01:38:00.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.708+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10307110000263136254', time=2024-09-12T03:13:11.785508+0000, chain.objs.size()=1 2024-09-12T01:38:00.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.708+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.04smqKC4sACqbuuoTQ6s0U7P9uWhkzv_0 2024-09-12T01:38:00.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.708+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5861657782811707682', time=2024-09-12T03:13:11.875381+0000, chain.objs.size()=1 2024-09-12T01:38:00.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.708+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.LmmVmitmA0f_HI1fXo7K_6_qeXQVx9__0 2024-09-12T01:38:00.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.708+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17485440621620782387', time=2024-09-12T03:13:12.076767+0000, chain.objs.size()=1 2024-09-12T01:38:00.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.708+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.oO1riG-dRjSjkX323yQJddywjH5JGCW_0 2024-09-12T01:38:00.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.709+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6785442986781734857', time=2024-09-12T03:13:12.488002+0000, chain.objs.size()=1 2024-09-12T01:38:00.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.709+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.3HtsLliKntqiKLckBdEqneO8f5lEUaO_0 2024-09-12T01:38:00.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.709+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.715928053138812270', time=2024-09-12T03:13:12.636809+0000, chain.objs.size()=1 2024-09-12T01:38:00.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.709+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.5_X5if1UXYJk0aeHglk3x5h1hA2BNHY_0 2024-09-12T01:38:00.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.709+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13411471085678747889', time=2024-09-12T03:13:12.729226+0000, chain.objs.size()=1 2024-09-12T01:38:00.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.709+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.oBLdWrW1TA5eH5f_j_M5aKu8XfDyr73_0 2024-09-12T01:38:00.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.710+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4290296385610393328', time=2024-09-12T03:13:12.897780+0000, chain.objs.size()=1 2024-09-12T01:38:00.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.710+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.UhyU0TtnVRlUrsZgFhKfhGqrRvh7Wwf_0 2024-09-12T01:38:00.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.710+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16185529483676631044', time=2024-09-12T03:13:13.091539+0000, chain.objs.size()=1 2024-09-12T01:38:00.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.710+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.4kVjH29ORPOIepmJ0T9yD1sj84s-Lr3_0 2024-09-12T01:38:00.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.710+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.308947528444214990', time=2024-09-12T03:13:13.251436+0000, chain.objs.size()=1 2024-09-12T01:38:00.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.710+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.8dM2dzGvccNwYi9u4Hee8MgH8JbODN4_0 2024-09-12T01:38:00.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.713+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17558394158384284299', time=2024-09-12T03:13:13.443194+0000, chain.objs.size()=1 2024-09-12T01:38:00.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.713+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.L4x11UNojp8HjOJvlNAlZKU0w-5ATKm_0 2024-09-12T01:38:00.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.713+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13653852729409777432', time=2024-09-12T03:13:13.468651+0000, chain.objs.size()=1 2024-09-12T01:38:00.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.713+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.L7Q-i5BwyquHb51yvIbRsjtZVCuJVpA_0 2024-09-12T01:38:00.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.713+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.598880069961193644', time=2024-09-12T03:13:13.469393+0000, chain.objs.size()=1 2024-09-12T01:38:00.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.713+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.XTlud5WfNtZytSX--skgdia2ZGrvzzU_0 2024-09-12T01:38:00.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.713+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13463901632779310140', time=2024-09-12T03:13:13.929389+0000, chain.objs.size()=1 2024-09-12T01:38:00.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.713+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.EgkoZZ5ElPfgWeyabGSN8-2ypfi7SOb_0 2024-09-12T01:38:00.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.713+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16351349106977756143', time=2024-09-12T03:13:14.010844+0000, chain.objs.size()=1 2024-09-12T01:38:00.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.713+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.6k_V1pquC7_Y-gPcZEVLXutUYq05pKt_0 2024-09-12T01:38:00.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.713+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10635041615250569363', time=2024-09-12T03:13:14.246009+0000, chain.objs.size()=1 2024-09-12T01:38:00.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.713+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.saK0GrqKZiwHiDUbp2nSOkO8jTMl9rp_0 2024-09-12T01:38:00.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.713+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1654366842415800125', time=2024-09-12T03:13:14.711694+0000, chain.objs.size()=1 2024-09-12T01:38:00.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.713+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.M23JOwiPNOrIun4N1MRy6ku6YP_tx-e_0 2024-09-12T01:38:00.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.713+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8772759414003758961', time=2024-09-12T03:13:14.754167+0000, chain.objs.size()=1 2024-09-12T01:38:00.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.713+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.em6ne44q7wYYwk8zlA2f8Kkk7OhA4A8_0 2024-09-12T01:38:00.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.713+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4014072737508565683', time=2024-09-12T03:13:15.115691+0000, chain.objs.size()=1 2024-09-12T01:38:00.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.713+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.QQADmfjiIboeZhig6-fzOnuokxZarM9_0 2024-09-12T01:38:00.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.713+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14305908288608724010', time=2024-09-12T03:13:15.448370+0000, chain.objs.size()=1 2024-09-12T01:38:00.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.713+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.KB6UAP0vBw-VeP3_BYTHx5So6igJIzb_0 2024-09-12T01:38:00.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.713+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2139705711539324501', time=2024-09-12T03:13:15.564200+0000, chain.objs.size()=1 2024-09-12T01:38:00.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.713+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.1ufLGPXzoRxn4S_Y35qaGFnfHRPszBm_0 2024-09-12T01:38:00.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.714+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2135350033007756090', time=2024-09-12T03:13:15.565937+0000, chain.objs.size()=1 2024-09-12T01:38:00.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.714+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.IXf6Z6AQPwx6rQ83taivolg6JcZ0pC-_0 2024-09-12T01:38:00.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.716+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11048942243257833540', time=2024-09-12T03:13:15.772481+0000, chain.objs.size()=1 2024-09-12T01:38:00.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.716+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.ZkMtP7wj3IjzIVJbOLRcW8ohOP32orv_0 2024-09-12T01:38:00.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.717+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.118456852997393759', time=2024-09-12T03:13:15.796849+0000, chain.objs.size()=1 2024-09-12T01:38:00.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.717+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.b9v_IKMqGJ9j1EYX0F9Rhh6-f8RgZal_0 2024-09-12T01:38:00.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.717+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9824809442698207033', time=2024-09-12T03:13:16.075866+0000, chain.objs.size()=1 2024-09-12T01:38:00.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.717+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.56ArqFQqkIZ1Ii4H-vFA0KkzHmYDxEl_0 2024-09-12T01:38:00.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.717+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9542015965787617221', time=2024-09-12T03:13:16.076596+0000, chain.objs.size()=1 2024-09-12T01:38:00.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.717+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.gOqpXCZyfo4pxL6SZFTgdyJDio4YUPT_0 2024-09-12T01:38:00.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.717+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3698894627344667101', time=2024-09-12T03:13:16.411388+0000, chain.objs.size()=1 2024-09-12T01:38:00.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.717+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.WKzs1TbPQmgABBT4cwzZGsFxCBy4RQN_0 2024-09-12T01:38:00.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.717+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5518829195553456332', time=2024-09-12T03:13:16.669261+0000, chain.objs.size()=1 2024-09-12T01:38:00.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.717+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.XPZwRSIWKZVMEq_6Z3j9yxU1IoqVzBl_0 2024-09-12T01:38:00.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.718+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5990916962523431133', time=2024-09-12T03:13:16.784708+0000, chain.objs.size()=1 2024-09-12T01:38:00.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.718+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.fb1bf8yw-fEbJE9TROUmZwN99AszoJv_0 2024-09-12T01:38:00.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.718+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2263279753171455442', time=2024-09-12T03:13:54.293722+0000, chain.objs.size()=1 2024-09-12T01:38:00.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.718+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.CRuXGAukfxmFcYNUUUomU8xHcALcQa7_0 2024-09-12T01:38:00.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.718+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16984593809905026299', time=2024-09-12T03:13:55.095939+0000, chain.objs.size()=1 2024-09-12T01:38:00.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.718+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.dhqU83q1cKY2P6zE3x6hGtY4aUFaz_O_0 2024-09-12T01:38:00.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.718+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1045686978409304368', time=2024-09-12T03:13:55.393172+0000, chain.objs.size()=1 2024-09-12T01:38:00.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.718+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.dK5c-c42dTQjzIxXXpVKin6pckoNU7a_0 2024-09-12T01:38:00.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.720+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 0/56512 2024-09-12T01:38:00.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.723+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=51, truncated=0, next_marker='' 2024-09-12T01:38:00.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.723+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16429060991492783490', time=2024-09-12T03:13:55.503011+0000, chain.objs.size()=1 2024-09-12T01:38:00.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.723+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.TaZXMAQGqMgKrZh8zc03QNHHsHulY9K_0 2024-09-12T01:38:00.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.723+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11741024599542586139', time=2024-09-12T03:13:55.760507+0000, chain.objs.size()=1 2024-09-12T01:38:00.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.723+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.FL1nBYSTHFiH_U3qjgRmsBz80wuTeFE_0 2024-09-12T01:38:00.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.723+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9078415288113421127', time=2024-09-12T03:13:55.840776+0000, chain.objs.size()=1 2024-09-12T01:38:00.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.723+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.AHdCbveP9mH2PFPnZXlQ1Y08ywk8eX8_0 2024-09-12T01:38:00.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.723+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13419360282930905508', time=2024-09-12T03:13:56.597591+0000, chain.objs.size()=1 2024-09-12T01:38:00.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.723+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.wd2Gf6wP6XqhXvjj-cR62W1MqpLFwfx_0 2024-09-12T01:38:00.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.723+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16634642528436339326', time=2024-09-12T03:13:56.880172+0000, chain.objs.size()=1 2024-09-12T01:38:00.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.723+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.GxpKzFSoP_tgpqXWmMsPod-_CSXhj8B_0 2024-09-12T01:38:00.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.723+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13182475181642151950', time=2024-09-12T03:13:57.396731+0000, chain.objs.size()=1 2024-09-12T01:38:00.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.723+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.1vxnKPzLB3UpnA91i_OGqZvY41qsW8D_0 2024-09-12T01:38:00.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.723+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17379646582355309318', time=2024-09-12T03:13:57.417765+0000, chain.objs.size()=1 2024-09-12T01:38:00.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.723+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.3nC2_0wTwDubnAKJS7h8wsNX96nKLgh_0 2024-09-12T01:38:00.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.723+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1079806757668730726', time=2024-09-12T03:13:57.425192+0000, chain.objs.size()=1 2024-09-12T01:38:00.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.723+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.KqKcYMTWhwOTvbCwuft05_UY_8_K9wH_0 2024-09-12T01:38:00.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.723+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8145650154231103591', time=2024-09-12T03:13:58.189281+0000, chain.objs.size()=1 2024-09-12T01:38:00.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.723+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.fX7uecu4Kwm4RPOERbxjAow5HdJsbVo_0 2024-09-12T01:38:00.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.723+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5331817608280725765', time=2024-09-12T03:13:58.405222+0000, chain.objs.size()=1 2024-09-12T01:38:00.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.723+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.P73DiEZLrTKA033dCsBmD5H51VjhS8J_0 2024-09-12T01:38:00.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.723+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16202855897440074003', time=2024-09-12T03:13:58.653177+0000, chain.objs.size()=1 2024-09-12T01:38:00.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.723+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.eQDzZm9-EZ_f3WFr9PHYyyJM8EtlNv0_0 2024-09-12T01:38:00.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.723+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.718191168573834879', time=2024-09-12T03:13:58.770958+0000, chain.objs.size()=1 2024-09-12T01:38:00.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.723+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.wL1bFDhT8agzoXz5E1BBOZrfxU1_cG3_0 2024-09-12T01:38:00.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.724+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12388381028314981950', time=2024-09-12T03:13:59.265029+0000, chain.objs.size()=1 2024-09-12T01:38:00.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.724+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.vJZWlEqrnigj170H-ySZOKtV4al2VLZ_0 2024-09-12T01:38:00.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.724+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17900115825123971387', time=2024-09-12T03:13:59.265690+0000, chain.objs.size()=1 2024-09-12T01:38:00.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.724+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.iJKzqFlwR889YA23RvijtXcj1SWX7s5_0 2024-09-12T01:38:00.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.724+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14640680377592043582', time=2024-09-12T03:13:59.465133+0000, chain.objs.size()=1 2024-09-12T01:38:00.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.724+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.QUi9GwcEU-qTOnCcnInPXlLWgUB2NvI_0 2024-09-12T01:38:00.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.725+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15073448873712993618', time=2024-09-12T03:13:59.881585+0000, chain.objs.size()=1 2024-09-12T01:38:00.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.725+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.a4rsLXPudWinNYpwMPiLJHjozaFy-Si_0 2024-09-12T01:38:00.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.725+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13453852685731434161', time=2024-09-12T03:14:00.035716+0000, chain.objs.size()=1 2024-09-12T01:38:00.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.725+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.W-snOgeKxWfJdkuxBqgCU3sLg5dRZcD_0 2024-09-12T01:38:00.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.727+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9274117704492458290', time=2024-09-12T03:14:00.075929+0000, chain.objs.size()=1 2024-09-12T01:38:00.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.727+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.nTn966nlODl6tUdpwf3eyARwHD6lS7J_0 2024-09-12T01:38:00.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.727+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7775484302819569523', time=2024-09-12T03:14:00.117433+0000, chain.objs.size()=1 2024-09-12T01:38:00.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.727+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.ZgGEDlJIs8F_rHdSWqBXpD-WAxiMC8B_0 2024-09-12T01:38:00.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.727+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1261211444598372479', time=2024-09-12T03:14:00.459533+0000, chain.objs.size()=1 2024-09-12T01:38:00.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.727+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.K-rR_6HtQGkITx8kQstYPUD3PtDTuSd_0 2024-09-12T01:38:00.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.727+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6597710986121987774', time=2024-09-12T03:14:00.460368+0000, chain.objs.size()=1 2024-09-12T01:38:00.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.727+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.2SkXYxHKcV6zRwt37lka-7r2Qzocsw4_0 2024-09-12T01:38:00.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.727+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14590393100368706563', time=2024-09-12T03:14:01.267196+0000, chain.objs.size()=1 2024-09-12T01:38:00.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.727+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.l-LUGwx6tInfbZwCqLhfZbakcaYUFyi_0 2024-09-12T01:38:00.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.727+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14839627340735679754', time=2024-09-12T03:14:01.374297+0000, chain.objs.size()=1 2024-09-12T01:38:00.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.727+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.eeqthgwMjUs4kiMuXs34AVFxcM-r_dT_0 2024-09-12T01:38:00.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.727+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1964379331367228210', time=2024-09-12T03:14:01.951137+0000, chain.objs.size()=1 2024-09-12T01:38:00.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.727+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.cLojg32XRSDJ25y8W9voFzTlsomWjRX_0 2024-09-12T01:38:00.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.727+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17343186620312103540', time=2024-09-12T03:14:02.040235+0000, chain.objs.size()=1 2024-09-12T01:38:00.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.727+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.X8tRuMtkJ5lIwq10_MFJU4G6Vy9fOq5_0 2024-09-12T01:38:00.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.727+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8104908426326920756', time=2024-09-12T03:14:02.231084+0000, chain.objs.size()=1 2024-09-12T01:38:00.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.727+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.GknKEwRRQpT8VCPCSXKTT9IzwqYxhdi_0 2024-09-12T01:38:00.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.727+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8422289859070729068', time=2024-09-12T03:14:02.413704+0000, chain.objs.size()=1 2024-09-12T01:38:00.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.727+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Zxhe50SfJoyqMnA0MGxZ-DAUu6fxYju_0 2024-09-12T01:38:00.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.727+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15436566551327328422', time=2024-09-12T03:14:02.628836+0000, chain.objs.size()=1 2024-09-12T01:38:00.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.727+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.prD4HTuWAC5P2SNxSgjMg5DcwZtpby6_0 2024-09-12T01:38:00.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.730+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4111886611402692053', time=2024-09-12T03:14:03.460698+0000, chain.objs.size()=1 2024-09-12T01:38:00.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.730+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.zJqlN00uAj5c6LWtLjA5xWnNGgmQq6U_0 2024-09-12T01:38:00.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.730+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16393875545198511806', time=2024-09-12T03:14:03.517319+0000, chain.objs.size()=1 2024-09-12T01:38:00.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.730+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.XHoRTIWRVxWfsTo0sEii9jVvWDYfdO4_0 2024-09-12T01:38:00.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.730+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2430234004041989409', time=2024-09-12T03:14:03.549240+0000, chain.objs.size()=1 2024-09-12T01:38:00.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.730+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.LGisW7gRvLLBu_bwLIPiBVv8sh-0G-B_0 2024-09-12T01:38:00.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.730+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4701844837043848081', time=2024-09-12T03:14:03.619288+0000, chain.objs.size()=1 2024-09-12T01:38:00.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.730+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.r0o8-SvwCjaMNAPOCTrkRX16y69g-rb_0 2024-09-12T01:38:00.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.730+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4090992557283962169', time=2024-09-12T03:14:03.676578+0000, chain.objs.size()=1 2024-09-12T01:38:00.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.730+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.bs-BErKi4mKGZtDl4_93VUR7OpPPpCx_0 2024-09-12T01:38:00.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.730+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16594793604518054388', time=2024-09-12T03:14:03.677172+0000, chain.objs.size()=1 2024-09-12T01:38:00.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.730+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.k66Elt-T-1wUWwP5ybh9aoJZkndvRCq_0 2024-09-12T01:38:00.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.730+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13879311197684974698', time=2024-09-12T03:14:06.254922+0000, chain.objs.size()=1 2024-09-12T01:38:00.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.730+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.327__shadow_.CgltUMv-oiKxbtILzXLDelD6-sv07mZ_0 2024-09-12T01:38:00.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.730+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16523538927445515723', time=2024-09-12T03:14:29.538914+0000, chain.objs.size()=1 2024-09-12T01:38:00.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.730+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.353__shadow_.d_ji870WSBqZL70N_-AVof3rsVpXCIx_0 2024-09-12T01:38:00.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.730+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8509196406363376764', time=2024-09-12T03:16:21.527497+0000, chain.objs.size()=1 2024-09-12T01:38:00.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.730+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.465__shadow_.XqP3Gm0nOIBlW-OYbIpAU5QW5ddXvf5_0 2024-09-12T01:38:00.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.733+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2891023919305590227', time=2024-09-12T03:16:47.803796+0000, chain.objs.size()=1 2024-09-12T01:38:00.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.733+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.495__shadow_.E3jrf7I5M6PUZfgW_uu5ro0Mr5Dlyjm_0 2024-09-12T01:38:00.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.733+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4520308473976396567', time=2024-09-12T03:16:52.242161+0000, chain.objs.size()=1 2024-09-12T01:38:00.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.733+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.500__shadow_.MFfsuz_3hzMAx3PEFBoGV5Ej3J33uxQ_0 2024-09-12T01:38:00.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.733+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15583125283866828708', time=2024-09-12T03:17:25.340200+0000, chain.objs.size()=6 2024-09-12T01:38:00.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.733+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.507__multipart_srcmultipart.2~ckyMCV3hbT7G8qDArZScZPf4n-CghR1.1 2024-09-12T01:38:00.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.733+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.507__multipart_srcmultipart.2~ckyMCV3hbT7G8qDArZScZPf4n-CghR1.2 2024-09-12T01:38:00.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.733+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.507__multipart_srcmultipart.2~ckyMCV3hbT7G8qDArZScZPf4n-CghR1.3 2024-09-12T01:38:00.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.733+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.507__multipart_srcmultipart.2~ckyMCV3hbT7G8qDArZScZPf4n-CghR1.4 2024-09-12T01:38:00.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.733+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.507__multipart_srcmultipart.2~ckyMCV3hbT7G8qDArZScZPf4n-CghR1.5 2024-09-12T01:38:00.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.733+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.507__multipart_srcmultipart.2~ckyMCV3hbT7G8qDArZScZPf4n-CghR1.6 2024-09-12T01:38:00.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.733+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10698058602992421669', time=2024-09-12T03:18:34.512488+0000, chain.objs.size()=3 2024-09-12T01:38:00.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.733+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.521__multipart_mymultipart.2~ZUbrPYyfJLTu-3RqZWGz0y8pcO5IYlG.1 2024-09-12T01:38:00.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.733+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.521__multipart_mymultipart.2~ZUbrPYyfJLTu-3RqZWGz0y8pcO5IYlG.2 2024-09-12T01:38:00.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.735+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.521__multipart_mymultipart.2~ZUbrPYyfJLTu-3RqZWGz0y8pcO5IYlG.3 2024-09-12T01:38:00.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.735+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11678789540338226534', time=2024-09-12T03:20:47.557968+0000, chain.objs.size()=2 2024-09-12T01:38:00.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.735+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.525__multipart_mymultipart.2~ciNp695Tiby6cmmJJdQYIwWUF9VvDdX.1 2024-09-12T01:38:00.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.735+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.525__multipart_mymultipart.2~ciNp695Tiby6cmmJJdQYIwWUF9VvDdX.2 2024-09-12T01:38:00.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.735+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9527866527687019627', time=2024-09-12T03:22:28.231609+0000, chain.objs.size()=1 2024-09-12T01:38:00.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.735+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.554__shadow_.9BarOEC7YB2eCqqI_DJZp6f5CUxxqPq_0 2024-09-12T01:38:00.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.735+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17024016328280830398', time=2024-09-12T03:23:55.289635+0000, chain.objs.size()=1 2024-09-12T01:38:00.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.735+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.577__shadow:oytAAMWY-gUTB11b.SOpcgSL3SLF-yf_.BEBDDmrjBZY4tBXpL4kmkKKSfqQEv8Q_0 2024-09-12T01:38:00.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.735+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10563857264522882348', time=2024-09-12T03:30:34.402361+0000, chain.objs.size()=2 2024-09-12T01:38:00.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.735+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.656__shadow_.QqU8rEUlbZf3JHTb8itXWgjaQn9HN2C_0 2024-09-12T01:38:00.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.737+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.656__shadow_.QqU8rEUlbZf3JHTb8itXWgjaQn9HN2C_1 2024-09-12T01:38:00.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.737+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11319507481070723519', time=2024-09-12T03:31:01.821975+0000, chain.objs.size()=1 2024-09-12T01:38:00.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.737+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.666__shadow_.qrFya15Ek3uBHugiHiKReRmWZN9bOyM_0 2024-09-12T01:38:00.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.737+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16631965559599000469', time=2024-09-12T03:31:01.997090+0000, chain.objs.size()=1 2024-09-12T01:38:00.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.737+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.666__shadow_.I_fCJSDmwKChf2qqr5V8P7hP4zAIuXy_0 2024-09-12T01:38:00.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.737+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5779051819926506682', time=2024-09-12T03:31:03.416607+0000, chain.objs.size()=1 2024-09-12T01:38:00.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.737+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.668__shadow_.0KC_-7dWF6RwGb4_N7JlKB-13ivkrza_0 2024-09-12T01:38:00.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.737+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7136446451129922769', time=2024-09-12T03:31:30.051955+0000, chain.objs.size()=1 2024-09-12T01:38:00.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.737+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.701__shadow:bEfyml0KRsY2Oc8pDpHNntYcl-3rKRW_.p0yyFsNTQvFtGShRlxFjuqPeFVN-waG_0 2024-09-12T01:38:00.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.739+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11298684204271923609', time=2024-09-12T03:31:32.081119+0000, chain.objs.size()=1 2024-09-12T01:38:00.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.739+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.703__shadow:eyYyKlwAUCvKRCShqNib7bFOAy1KwrZ_.jCWQCxiPHsSN9vSo4e2Zhs69oaToNUp_0 2024-09-12T01:38:00.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.739+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13975082289690573065', time=2024-09-12T03:31:33.011825+0000, chain.objs.size()=1 2024-09-12T01:38:00.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.739+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.704__shadow:Lgz.CZEn4xCZi35vZVLM4dS8KFlDQi-_.EXwn57WpUCEmopQHoE56LoMCGfPca9H_0 2024-09-12T01:38:00.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.740+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:38:00.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.742+0000 7f8786c98800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T01:38:00.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.743+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:38:00.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.744+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:38:00.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.745+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/57095' 2024-09-12T01:38:00.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.745+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14057252975708921883', time=2024-09-12T03:06:35.103172+0000, chain.objs.size()=3 2024-09-12T01:38:00.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.745+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.159__multipart_mymultipart-LUKEWARM.2~1C6GbMwTljVC_eo1zg0JZGQC58kcF2a.1 2024-09-12T01:38:00.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.745+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.159__multipart_mymultipart-LUKEWARM.2~1C6GbMwTljVC_eo1zg0JZGQC58kcF2a.2 2024-09-12T01:38:00.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.745+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.159__multipart_mymultipart-LUKEWARM.2~1C6GbMwTljVC_eo1zg0JZGQC58kcF2a.3 2024-09-12T01:38:00.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.745+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='_x_fk3W28qPNFA0n6CXT_vV9JOIRYo2C', time=2024-09-12T03:06:44.372267+0000, chain.objs.size()=2 2024-09-12T01:38:00.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.745+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.160__shadow_.yWqHzv92Mtlur8A8CkIeHWl7wMMJ-2v_0 2024-09-12T01:38:00.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.745+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.160__shadow_.yWqHzv92Mtlur8A8CkIeHWl7wMMJ-2v_1 2024-09-12T01:38:00.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.745+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='_M177zgv5ylq1TosSFi81XR99ZK9UJtE', time=2024-09-12T03:07:02.397124+0000, chain.objs.size()=2 2024-09-12T01:38:00.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.745+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.161__shadow_.F_uYvzdIC0PdEptUZt4gPsoyiJ02yyP_0 2024-09-12T01:38:00.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.745+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.161__shadow_.F_uYvzdIC0PdEptUZt4gPsoyiJ02yyP_1 2024-09-12T01:38:00.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.745+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='_6lZLRu80pcpzkHJjM3fiDjeJwEUDrAv', time=2024-09-12T03:07:10.467452+0000, chain.objs.size()=1 2024-09-12T01:38:00.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.745+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.161__shadow_.4UnWFLNJekdUpN-0IWRbVrxP37w-_up_0 2024-09-12T01:38:00.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.745+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12445747025381944899', time=2024-09-12T03:07:43.878747+0000, chain.objs.size()=1 2024-09-12T01:38:00.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.745+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.182__shadow_.k6rjTYch4Xv_Y4XOc48W0mqhGWq3hD3_0 2024-09-12T01:38:00.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.745+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4964753591491186592', time=2024-09-12T03:10:35.522140+0000, chain.objs.size()=1 2024-09-12T01:38:00.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.745+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.258__shadow_.SWycCYIApmtW3Of9yVQKAHcYe8gvu0q_0 2024-09-12T01:38:00.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.745+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6438269196499108024', time=2024-09-12T03:11:14.673827+0000, chain.objs.size()=1 2024-09-12T01:38:00.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.745+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.l4zxSoOaSxFLZZAZvpY4q9JonGB4wMh_0 2024-09-12T01:38:00.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.745+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12808198346490682909', time=2024-09-12T03:11:14.797309+0000, chain.objs.size()=1 2024-09-12T01:38:00.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.745+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.wdumulsnuZZ-Wr2LDBdx3FABOSsO30z_0 2024-09-12T01:38:00.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.748+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18052136731508514652', time=2024-09-12T03:11:15.166478+0000, chain.objs.size()=1 2024-09-12T01:38:00.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.748+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_._mBpmvZL7NZizN1wSvM5Y6qujahB3H7_0 2024-09-12T01:38:00.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.753+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16296102894723081224', time=2024-09-12T03:11:15.337424+0000, chain.objs.size()=1 2024-09-12T01:38:00.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.753+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.P0MbWpv9o2NDeZ8eO5q86CTJnGhD2hz_0 2024-09-12T01:38:00.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.753+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9467993510673567335', time=2024-09-12T03:11:15.382592+0000, chain.objs.size()=1 2024-09-12T01:38:00.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.753+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.OQixLLetrvRQi_gMzvt8Hfu_lD4J8SC_0 2024-09-12T01:38:00.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.753+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7772254874458142827', time=2024-09-12T03:11:16.372997+0000, chain.objs.size()=1 2024-09-12T01:38:00.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.753+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.n40TwH0M9qHeXwvV0x6M9YcqL1D_qUm_0 2024-09-12T01:38:00.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.753+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17710155090511471031', time=2024-09-12T03:11:16.439874+0000, chain.objs.size()=1 2024-09-12T01:38:00.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.753+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.9cni6JUhy0NCb2qIkXgmPRJtcfUmTt2_0 2024-09-12T01:38:00.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.753+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12306453097895357511', time=2024-09-12T03:11:16.671941+0000, chain.objs.size()=1 2024-09-12T01:38:00.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.753+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.LLSn5CvxQY-gd7LU-_26_x2FJO0ACN8_0 2024-09-12T01:38:00.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.753+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14528882313609677515', time=2024-09-12T03:11:16.813728+0000, chain.objs.size()=1 2024-09-12T01:38:00.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.753+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.hTGhbFa9EflZ-TdnolRw_mCWgW-zuyH_0 2024-09-12T01:38:00.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.753+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2964021402518362331', time=2024-09-12T03:11:16.814499+0000, chain.objs.size()=1 2024-09-12T01:38:00.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.753+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.6muq8l5fSmjZzV1a7bX_XEa7VOieA0t_0 2024-09-12T01:38:00.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.753+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15955770446026507060', time=2024-09-12T03:11:17.481178+0000, chain.objs.size()=1 2024-09-12T01:38:00.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.753+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.AyIX_DeFp7mz_ftOITsrnHOnPJUf_FH_0 2024-09-12T01:38:00.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.753+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18208972260893971023', time=2024-09-12T03:11:17.555085+0000, chain.objs.size()=1 2024-09-12T01:38:00.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.753+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.XOUMz70eFslgFjSM6Ur4QNya6OJVqYS_0 2024-09-12T01:38:00.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.753+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6869176202719789123', time=2024-09-12T03:11:17.848916+0000, chain.objs.size()=1 2024-09-12T01:38:00.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.753+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Pt4qexuCAmk2_HvrsTgCKFbc_iwaWyr_0 2024-09-12T01:38:00.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.753+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9721784517219526951', time=2024-09-12T03:11:18.303477+0000, chain.objs.size()=1 2024-09-12T01:38:00.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.753+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.CLEGRNLLF6Wq1D44t6tVEM8o2saoL5V_0 2024-09-12T01:38:00.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.758+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6691598544135167159', time=2024-09-12T03:11:18.304273+0000, chain.objs.size()=1 2024-09-12T01:38:00.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.758+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.cQwhnV1gcbSsjH6Z55js0IYiDwhfAO6_0 2024-09-12T01:38:00.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.758+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14194159606399291484', time=2024-09-12T03:11:18.305112+0000, chain.objs.size()=1 2024-09-12T01:38:00.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.758+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.aTivWjxEtzaF1OvBvHFhct66mZs0njy_0 2024-09-12T01:38:00.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.758+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9103303781122501674', time=2024-09-12T03:11:18.359509+0000, chain.objs.size()=1 2024-09-12T01:38:00.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.758+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.PIz3K8ttkimfEoRR7iUKjHuHeihphcA_0 2024-09-12T01:38:00.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.758+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7599617343095908195', time=2024-09-12T03:11:18.926570+0000, chain.objs.size()=1 2024-09-12T01:38:00.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.758+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.l04kT2Pp83Y2h9aGS7enwwgb4L_7aMP_0 2024-09-12T01:38:00.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.758+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7555659224305565633', time=2024-09-12T03:11:19.102509+0000, chain.objs.size()=1 2024-09-12T01:38:00.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.758+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.d98H2D54_sfV3yObCEuJq-cIsUvBiEN_0 2024-09-12T01:38:00.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.758+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17805726787099991542', time=2024-09-12T03:11:19.352833+0000, chain.objs.size()=1 2024-09-12T01:38:00.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.758+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.GzO5zCDyh88HALIAuAc0fmG09tdo5YQ_0 2024-09-12T01:38:00.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.758+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7890660936922322683', time=2024-09-12T03:11:19.401259+0000, chain.objs.size()=1 2024-09-12T01:38:00.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.758+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.wA9OUeCf_6NVMr1V0kRARu7Oiugup31_0 2024-09-12T01:38:00.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.758+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5741600174386545075', time=2024-09-12T03:11:19.468149+0000, chain.objs.size()=1 2024-09-12T01:38:00.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.758+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.dVqWeb41BZRohth2XOxc3tyIM1d3Oar_0 2024-09-12T01:38:00.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.758+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6725256164117053875', time=2024-09-12T03:11:19.596479+0000, chain.objs.size()=1 2024-09-12T01:38:00.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.758+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.iuPcu6VTScgcwKMEuYh7tr7wD_Svfhg_0 2024-09-12T01:38:00.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.761+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12949031645252090593', time=2024-09-12T03:11:19.689493+0000, chain.objs.size()=1 2024-09-12T01:38:00.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.761+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.sYx5Zukj-yCgav2C-d7L-TdSopcV0jL_0 2024-09-12T01:38:00.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.761+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.246531155776608595', time=2024-09-12T03:11:20.187045+0000, chain.objs.size()=1 2024-09-12T01:38:00.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.761+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.GOUHLwUIawaPSg2xVlZjl_4DOUbru_r_0 2024-09-12T01:38:00.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.764+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7255908437419392690', time=2024-09-12T03:11:20.187800+0000, chain.objs.size()=1 2024-09-12T01:38:00.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.764+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.15jPzVNLYpj0QU-Ni30pW12CjQnpSXo_0 2024-09-12T01:38:00.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.764+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7024360555514323853', time=2024-09-12T03:11:20.207659+0000, chain.objs.size()=1 2024-09-12T01:38:00.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.764+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.oXjn4A4TJe8c3cATHHoLrDRDR-NcDhD_0 2024-09-12T01:38:00.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.764+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4076754339367137102', time=2024-09-12T03:11:20.495973+0000, chain.objs.size()=1 2024-09-12T01:38:00.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.764+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.4n9zrzLzfSgM1TB3uPkxwdNhfusrifO_0 2024-09-12T01:38:00.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.764+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15397832875934364480', time=2024-09-12T03:11:20.512188+0000, chain.objs.size()=1 2024-09-12T01:38:00.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.764+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.4jc0bs8M14r3Q_ieOZ0J2IzMHwirvqA_0 2024-09-12T01:38:00.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.764+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12184213418554768062', time=2024-09-12T03:11:20.801994+0000, chain.objs.size()=1 2024-09-12T01:38:00.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.764+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.VYXzMSXmgoyZjVW85tsOOh72ykRtbaf_0 2024-09-12T01:38:00.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.764+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3309504600986753161', time=2024-09-12T03:11:20.922148+0000, chain.objs.size()=1 2024-09-12T01:38:00.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.764+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.dGpykqHwq4INFE7cXAyWcnvOLBlXJdU_0 2024-09-12T01:38:00.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.764+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14901533490918124720', time=2024-09-12T03:11:21.040142+0000, chain.objs.size()=1 2024-09-12T01:38:00.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.764+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.1mZ0yCwuYHWPioJORPr2HCZdiT-3pUz_0 2024-09-12T01:38:00.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.764+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11899111507507079176', time=2024-09-12T03:11:21.539442+0000, chain.objs.size()=1 2024-09-12T01:38:00.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.764+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Xz2Ec-Z2Uds9GQVNWopHwYVbpyiYMqU_0 2024-09-12T01:38:00.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.764+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1973506373650567689', time=2024-09-12T03:11:22.037303+0000, chain.objs.size()=1 2024-09-12T01:38:00.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.764+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.thC-0UL7Rs0WAuraiBL-Y4mwJg2nz_d_0 2024-09-12T01:38:00.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.767+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.588341426237502816', time=2024-09-12T03:11:22.038022+0000, chain.objs.size()=1 2024-09-12T01:38:00.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.767+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.c_7knJNn4QbHttRqHujs0YXBrXDTgxT_0 2024-09-12T01:38:00.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.767+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1209956967530961090', time=2024-09-12T03:11:22.499477+0000, chain.objs.size()=1 2024-09-12T01:38:00.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.767+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.QDO5Qxm4iNDpreM5w-eQhihWnOJQPUx_0 2024-09-12T01:38:00.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.770+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7648612943894174391', time=2024-09-12T03:11:23.193903+0000, chain.objs.size()=1 2024-09-12T01:38:00.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.770+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.warpHPVVekg9wEO1-_eZoWNnTxgEIlR_0 2024-09-12T01:38:00.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.770+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15814684111581706486', time=2024-09-12T03:11:23.251273+0000, chain.objs.size()=1 2024-09-12T01:38:00.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.770+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.rPIhn20EjDIV-C6ZYEA8AA8_RFz3LiZ_0 2024-09-12T01:38:00.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.770+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7327812142816372892', time=2024-09-12T03:11:24.284176+0000, chain.objs.size()=1 2024-09-12T01:38:00.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.770+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.KUhp6UkEyOmGDtghP9gPF94K-OKhsU3_0 2024-09-12T01:38:00.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.770+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14765752841960340209', time=2024-09-12T03:11:24.326711+0000, chain.objs.size()=1 2024-09-12T01:38:00.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.770+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.dYzgJnfSu1rJb-1i1kqujNtSnJVMrC7_0 2024-09-12T01:38:00.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.770+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11522495013561941247', time=2024-09-12T03:11:24.567808+0000, chain.objs.size()=1 2024-09-12T01:38:00.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.770+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.WXqsCCtsa_wi4aqZ1vFIJ6VE1KZhjqZ_0 2024-09-12T01:38:00.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.770+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16416436648083994648', time=2024-09-12T03:11:24.723653+0000, chain.objs.size()=1 2024-09-12T01:38:00.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.770+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.yTjE0RVbv1eEpcERUdopSWsSH13rldo_0 2024-09-12T01:38:00.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.770+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6439273621116051502', time=2024-09-12T03:11:30.528939+0000, chain.objs.size()=1 2024-09-12T01:38:00.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.770+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.268__shadow_.iO7aZ2E9LyGSXa62_IREYZmYj27K58z_0 2024-09-12T01:38:00.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.770+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1781571242153947856', time=2024-09-12T03:11:33.382611+0000, chain.objs.size()=1 2024-09-12T01:38:00.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.770+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.271__shadow_.m_rPmipS5iCnXXK8KrZR7Tu5Fg5obpa_0 2024-09-12T01:38:00.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.770+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14076567025696777064', time=2024-09-12T03:11:39.074062+0000, chain.objs.size()=1 2024-09-12T01:38:00.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.770+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.277__shadow_.CPT3Hwgjp90CXfJyMRDSwCWTP1fvvHM_0 2024-09-12T01:38:00.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.772+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18295774177669530847', time=2024-09-12T03:11:42.960819+0000, chain.objs.size()=1 2024-09-12T01:38:00.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.772+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.281__shadow_.WImkLWQJXmdKlK1VXoggbNVNjdv5q4e_0 2024-09-12T01:38:00.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.772+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17359393421829305007', time=2024-09-12T03:11:46.910328+0000, chain.objs.size()=1 2024-09-12T01:38:00.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.772+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.285__shadow_.7adom17pjUcjcPixUU28opthTpoFmqM_0 2024-09-12T01:38:00.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.772+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5302217982465079441', time=2024-09-12T03:11:55.340617+0000, chain.objs.size()=1 2024-09-12T01:38:00.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.772+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.292__shadow_.xwpAneBcSe3z15bQaVtxe6a8QAxfijb_0 2024-09-12T01:38:00.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.772+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14227753814987818822', time=2024-09-12T03:12:05.634300+0000, chain.objs.size()=1 2024-09-12T01:38:00.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.772+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.301__shadow_.ofde_CpFo1DM5nkEVxK1al4AyH5LFcm_0 2024-09-12T01:38:00.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.772+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16885347097938552057', time=2024-09-12T03:12:27.475434+0000, chain.objs.size()=1 2024-09-12T01:38:00.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.772+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.319__shadow:Awo8UCiQfmzZij3fVBkIpdVd.nb7U86_.779B5RWTDAFstxM6mdxHxqp6JcOq-a0_0 2024-09-12T01:38:00.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.775+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13739726238789445878', time=2024-09-12T03:13:06.836319+0000, chain.objs.size()=1 2024-09-12T01:38:00.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.775+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.HWPmev6Uz-Q0SwtZMEtkIM3fQ9gFvWP_0 2024-09-12T01:38:00.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.775+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17404575272277852313', time=2024-09-12T03:13:07.355692+0000, chain.objs.size()=1 2024-09-12T01:38:00.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.775+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.62bKJZtP6espIecY0nEkYx33OPDgB7q_0 2024-09-12T01:38:00.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.775+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3891523751530213385', time=2024-09-12T03:13:07.508951+0000, chain.objs.size()=1 2024-09-12T01:38:00.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.775+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.ofkbX-mWH9i5LzyzvpagHeaMDRbweQn_0 2024-09-12T01:38:00.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.775+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1961693102507919211', time=2024-09-12T03:13:07.556574+0000, chain.objs.size()=1 2024-09-12T01:38:00.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.775+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.NBoNmrff8cQv7JTSa7qyVHBY7hYi2Ri_0 2024-09-12T01:38:00.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.775+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8167429816061696563', time=2024-09-12T03:13:07.757826+0000, chain.objs.size()=1 2024-09-12T01:38:00.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.775+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.nuANARuMF1dODIxLTF60VTZqkw_8sPe_0 2024-09-12T01:38:00.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.775+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.377902801619076252', time=2024-09-12T03:13:08.386419+0000, chain.objs.size()=1 2024-09-12T01:38:00.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.775+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.wvgDzW4YKz_RKwaqh0QttnXbSsiuk4f_0 2024-09-12T01:38:00.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.775+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3068319280365646723', time=2024-09-12T03:13:08.387049+0000, chain.objs.size()=1 2024-09-12T01:38:00.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.775+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.wtcWuo3mHTg3xyQQSbRgc45sWqLMC1Z_0 2024-09-12T01:38:00.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.776+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7044827025112841007', time=2024-09-12T03:13:08.696699+0000, chain.objs.size()=1 2024-09-12T01:38:00.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.776+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.IxrAtHlCxVKe1VA-iTdiOEKPrkj-vpa_0 2024-09-12T01:38:00.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.776+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5366864779168329232', time=2024-09-12T03:13:08.736047+0000, chain.objs.size()=1 2024-09-12T01:38:00.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.776+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.0orkG4BzHGo6WoHW9sDHe4VNz8mqtcD_0 2024-09-12T01:38:00.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.776+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9694245997913790885', time=2024-09-12T03:13:08.795051+0000, chain.objs.size()=1 2024-09-12T01:38:00.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.776+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.V6vawedfa2hpJ-zOxNa6udUJzULIDHX_0 2024-09-12T01:38:00.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.776+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8620021687000473855', time=2024-09-12T03:13:08.963291+0000, chain.objs.size()=1 2024-09-12T01:38:00.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.776+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.m5YqmHVcUC2nI1Agjj7q7NuQpVj7eBs_0 2024-09-12T01:38:00.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.778+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15635556260467481559', time=2024-09-12T03:13:09.083431+0000, chain.objs.size()=1 2024-09-12T01:38:00.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.778+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.tTgblmuwMqHoa-bFcuTAfmS7eRBToTg_0 2024-09-12T01:38:00.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.778+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2775970912508915371', time=2024-09-12T03:13:09.181886+0000, chain.objs.size()=1 2024-09-12T01:38:00.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.778+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.Bk6xzwkurWjzUQ323PTHxJoemxmOaV7_0 2024-09-12T01:38:00.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.781+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10253939534028942888', time=2024-09-12T03:13:09.206384+0000, chain.objs.size()=1 2024-09-12T01:38:00.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.781+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.D5Hh05FzbZdlAPZCCbrznoKz7DMSOvf_0 2024-09-12T01:38:00.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.781+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3984076023826622876', time=2024-09-12T03:13:09.207282+0000, chain.objs.size()=1 2024-09-12T01:38:00.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.781+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.-79N0QezImvKtCh3NFFTMjXg4h3rQGZ_0 2024-09-12T01:38:00.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.781+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1598917420783242822', time=2024-09-12T03:13:09.929543+0000, chain.objs.size()=1 2024-09-12T01:38:00.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.781+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.5A0VmESf6GHsYZVqlPMxD4JbthgKQXv_0 2024-09-12T01:38:00.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.781+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1901529099183068613', time=2024-09-12T03:13:10.677548+0000, chain.objs.size()=1 2024-09-12T01:38:00.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.781+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.VOdohBZa_NOkTWH99mk65BK2Uo9v0vY_0 2024-09-12T01:38:00.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.781+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7559746295627956451', time=2024-09-12T03:13:11.330228+0000, chain.objs.size()=1 2024-09-12T01:38:00.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.781+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.tYg5_z6tzuTcCKo3MmVka79RDr3XqlA_0 2024-09-12T01:38:00.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.781+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8702228137491366935', time=2024-09-12T03:13:11.551491+0000, chain.objs.size()=1 2024-09-12T01:38:00.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.781+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.Q8RdqShGd448odhmxPFRAPBWGKH3rhL_0 2024-09-12T01:38:00.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.781+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18007036591304703543', time=2024-09-12T03:13:12.524899+0000, chain.objs.size()=1 2024-09-12T01:38:00.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.781+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.XYDnNdCieQ4DyGLvgEoLZ5mzwh4Gyj9_0 2024-09-12T01:38:00.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.781+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9669084153867032068', time=2024-09-12T03:13:12.525606+0000, chain.objs.size()=1 2024-09-12T01:38:00.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.781+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.GTLG2VvdPZBS2XMeSBTJE-y2CiHOJ1__0 2024-09-12T01:38:00.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.781+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13829873254743349143', time=2024-09-12T03:13:12.578959+0000, chain.objs.size()=1 2024-09-12T01:38:00.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.781+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.MZ2A4g-xUTeYI0V_PMWI8uw764WnX61_0 2024-09-12T01:38:00.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.781+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16753202848005558625', time=2024-09-12T03:13:13.097907+0000, chain.objs.size()=1 2024-09-12T01:38:00.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.781+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.nh6OqNaiSMmq4sNeaXbrLx1qdOOTBCI_0 2024-09-12T01:38:00.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.781+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6068977435754524411', time=2024-09-12T03:13:14.215161+0000, chain.objs.size()=1 2024-09-12T01:38:00.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.781+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.9rK7n7CN4hw8sW9qsdsHLUiIjQ-C2en_0 2024-09-12T01:38:00.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.783+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7448862570766014159', time=2024-09-12T03:13:14.668255+0000, chain.objs.size()=1 2024-09-12T01:38:00.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.783+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.JYFxT6SRPM0h4K3mgQ_KrdXN8PocGEG_0 2024-09-12T01:38:00.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.787+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10863944584057544468', time=2024-09-12T03:13:14.772809+0000, chain.objs.size()=1 2024-09-12T01:38:00.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.787+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.uRGS_RSDeds_9K_MS5jNGfZn-tf3S8t_0 2024-09-12T01:38:00.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.787+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18224354956964782869', time=2024-09-12T03:13:15.323805+0000, chain.objs.size()=1 2024-09-12T01:38:00.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.787+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.Ch2QKasqym1X4Z-Q6CF2wFjRn50T_Qi_0 2024-09-12T01:38:00.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.787+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18177910938894906219', time=2024-09-12T03:13:15.324449+0000, chain.objs.size()=1 2024-09-12T01:38:00.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.787+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.BA2DWUlhs1zLsGslbBtimkDqUQkojCE_0 2024-09-12T01:38:00.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.787+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12778319253556068171', time=2024-09-12T03:13:15.914872+0000, chain.objs.size()=1 2024-09-12T01:38:00.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.787+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.REMIcDmS5X9CMunyFyxzrEFwWcsvl8o_0 2024-09-12T01:38:00.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.787+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16603298629737650164', time=2024-09-12T03:13:15.991790+0000, chain.objs.size()=1 2024-09-12T01:38:00.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.787+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.Okj38VS3i8jHkcHbD1dvsiOC40V96_v_0 2024-09-12T01:38:00.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.787+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11579242380173358068', time=2024-09-12T03:13:16.378762+0000, chain.objs.size()=1 2024-09-12T01:38:00.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.787+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.ORAcj-FWt0OO2dpf6RGNPhlSLt4doTe_0 2024-09-12T01:38:00.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.787+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.768195927080042965', time=2024-09-12T03:13:16.959405+0000, chain.objs.size()=1 2024-09-12T01:38:00.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.787+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.tPjst57mJJf5zJtWZRNzKHfZZEt9m_a_0 2024-09-12T01:38:00.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.787+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12835259242368150892', time=2024-09-12T03:13:17.040702+0000, chain.objs.size()=1 2024-09-12T01:38:00.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.787+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.xEHBg5sE_G3G5wIxAIgpkVsbCrv9DSM_0 2024-09-12T01:38:00.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.787+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7624744167852763135', time=2024-09-12T03:13:53.851411+0000, chain.objs.size()=1 2024-09-12T01:38:00.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.787+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.KOuQFFpdVkb-yxnsOy5EGV2UHvjEnz1_0 2024-09-12T01:38:00.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.787+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16380398253264749100', time=2024-09-12T03:13:54.033736+0000, chain.objs.size()=1 2024-09-12T01:38:00.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.787+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.bIkmGnpeFwqsZO9KkGgCqRsGJYXvq74_0 2024-09-12T01:38:00.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.789+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12181695296030936709', time=2024-09-12T03:13:54.088871+0000, chain.objs.size()=1 2024-09-12T01:38:00.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.789+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.mKo_wtHoaL0uJk3ETDy5y9_5_kGl3ih_0 2024-09-12T01:38:00.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.789+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1252682227786173658', time=2024-09-12T03:13:54.336635+0000, chain.objs.size()=1 2024-09-12T01:38:00.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.789+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.JS-ozThL9YCNda4bUGB34TZHU7mdjjm_0 2024-09-12T01:38:00.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.789+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14248898405099414304', time=2024-09-12T03:13:54.425791+0000, chain.objs.size()=1 2024-09-12T01:38:00.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.789+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.eWMVTPU8LVXQRp2-UoASkU-akNj1zKP_0 2024-09-12T01:38:00.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.792+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18039453722682350756', time=2024-09-12T03:13:55.370411+0000, chain.objs.size()=1 2024-09-12T01:38:00.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.792+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.NoDnbT2A6yt9fu7a3QJaMceKZVZUx1d_0 2024-09-12T01:38:00.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.792+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10382930729306620116', time=2024-09-12T03:13:55.730808+0000, chain.objs.size()=1 2024-09-12T01:38:00.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.792+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.FD3izatDbYvfQxQ3OcOQ1Qfn9mqPEIU_0 2024-09-12T01:38:00.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.793+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14008406228904555382', time=2024-09-12T03:13:56.484309+0000, chain.objs.size()=1 2024-09-12T01:38:00.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.793+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.ICwqcFq8p3jZslNCYbuKtScUVAiKk6T_0 2024-09-12T01:38:00.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.793+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4061398628787017654', time=2024-09-12T03:13:56.756308+0000, chain.objs.size()=1 2024-09-12T01:38:00.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.793+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.0ZyV-Fx_tjJzevlTQgoLnOB5EqtgSta_0 2024-09-12T01:38:00.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.793+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5941620333701631597', time=2024-09-12T03:13:56.995193+0000, chain.objs.size()=1 2024-09-12T01:38:00.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.793+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.zlUr5F0FMH2GpNd7meSkspb2yBThcGT_0 2024-09-12T01:38:00.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.793+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16020332508804382830', time=2024-09-12T03:13:57.119486+0000, chain.objs.size()=1 2024-09-12T01:38:00.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.793+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.IjiZB4E0eBoDWXZSXO_tsG_BIbvn5J0_0 2024-09-12T01:38:00.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.798+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 0/57095 2024-09-12T01:38:00.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.801+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=44, truncated=0, next_marker='' 2024-09-12T01:38:00.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.801+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2055384447699675280', time=2024-09-12T03:13:57.801380+0000, chain.objs.size()=1 2024-09-12T01:38:00.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.801+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.1-DbLdn1-wPY5RC0ODEb-tu2C17QeL1_0 2024-09-12T01:38:00.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.801+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.308585414770312871', time=2024-09-12T03:13:57.960958+0000, chain.objs.size()=1 2024-09-12T01:38:00.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.801+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.CC6JyiBu3d-kweFLPxJyLn4rNMlzgtt_0 2024-09-12T01:38:00.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.801+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8536741277975452804', time=2024-09-12T03:13:58.161760+0000, chain.objs.size()=1 2024-09-12T01:38:00.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.801+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.bgBvqadXM3URejDYaj5ni1gPUrij8jJ_0 2024-09-12T01:38:00.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.801+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1083497595830005355', time=2024-09-12T03:13:58.364950+0000, chain.objs.size()=1 2024-09-12T01:38:00.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.801+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.7Okr9ZDRwcZagMevVeKJ2UA4VGVNqeX_0 2024-09-12T01:38:00.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.801+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4066814255559741858', time=2024-09-12T03:13:58.689854+0000, chain.objs.size()=1 2024-09-12T01:38:00.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.801+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.YUH9gzrs4g8pJz8C_WS9RK6K7GbNgBI_0 2024-09-12T01:38:00.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.801+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11559005300130762627', time=2024-09-12T03:13:58.715908+0000, chain.objs.size()=1 2024-09-12T01:38:00.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.801+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.fG8gPJzBqmysp-hVvmGvrxfbO3os6Hh_0 2024-09-12T01:38:00.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.801+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3777305600567212674', time=2024-09-12T03:13:58.716584+0000, chain.objs.size()=1 2024-09-12T01:38:00.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.801+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_._G8Bbeyk98QXjBvts-58aTvRNO3rAwD_0 2024-09-12T01:38:00.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.801+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1558558736092393850', time=2024-09-12T03:13:59.645080+0000, chain.objs.size()=1 2024-09-12T01:38:00.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.801+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.z79Lv_qKkez9_l4LxNa5J8l6QO5XqQc_0 2024-09-12T01:38:00.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.801+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2102747370475955589', time=2024-09-12T03:13:59.767010+0000, chain.objs.size()=1 2024-09-12T01:38:00.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.801+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.tbVwBqnd3qjTFl9EwaSqWlaEl6vIQ10_0 2024-09-12T01:38:00.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.801+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6968983193259483771', time=2024-09-12T03:13:59.950832+0000, chain.objs.size()=1 2024-09-12T01:38:00.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.801+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.KlMXqo1MfF3QNQh1yoJaqnjeySz3A4P_0 2024-09-12T01:38:00.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.801+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8351767110282635905', time=2024-09-12T03:14:00.045527+0000, chain.objs.size()=1 2024-09-12T01:38:00.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.801+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_._1tYWegVJZwje6VcJilqffW__fb1KWg_0 2024-09-12T01:38:00.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.801+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3152733466549880448', time=2024-09-12T03:14:00.632541+0000, chain.objs.size()=1 2024-09-12T01:38:00.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.801+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.HKEeQDeWJyH_bF6bxkaqwQ6hUDwOejl_0 2024-09-12T01:38:00.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.803+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12234646450928851097', time=2024-09-12T03:14:00.826803+0000, chain.objs.size()=1 2024-09-12T01:38:00.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.803+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.GFDDipjY4DzNRJ7CU5gjE1_BoSX7ohh_0 2024-09-12T01:38:00.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.806+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5353496152904988779', time=2024-09-12T03:14:01.228846+0000, chain.objs.size()=1 2024-09-12T01:38:00.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.806+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.lSwtxgRHdYUMf1kVnzuWODU9vDSokVB_0 2024-09-12T01:38:00.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.806+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8626486301172024934', time=2024-09-12T03:14:01.312504+0000, chain.objs.size()=1 2024-09-12T01:38:00.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.806+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.D8ROulssaLr3WFIW4u-ZEXWH_teKAnl_0 2024-09-12T01:38:00.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.806+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4849911471386530401', time=2024-09-12T03:14:01.717903+0000, chain.objs.size()=1 2024-09-12T01:38:00.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.806+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.AdAy3KkmV1YkAj1ioCD_56yogptymkG_0 2024-09-12T01:38:00.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.806+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.986697262692228642', time=2024-09-12T03:14:02.348070+0000, chain.objs.size()=1 2024-09-12T01:38:00.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.806+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.QvjEnFEnXZXgYNt-URrRUZaitx0xi92_0 2024-09-12T01:38:00.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.806+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3301062555512942516', time=2024-09-12T03:14:03.056058+0000, chain.objs.size()=1 2024-09-12T01:38:00.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.806+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.KGPL8TjEsqzpZY7yOEbQOKgnON-pJ_1_0 2024-09-12T01:38:00.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.806+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5670233266792832177', time=2024-09-12T03:14:03.081619+0000, chain.objs.size()=1 2024-09-12T01:38:00.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.806+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.1EWszhia6TOfydVjpLcVGViZ1tatQ1S_0 2024-09-12T01:38:00.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.806+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9589808349999506182', time=2024-09-12T03:14:03.249580+0000, chain.objs.size()=1 2024-09-12T01:38:00.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.806+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.nlisGTRuUXo-pfPr7EL_M6Z81Rtx1nC_0 2024-09-12T01:38:00.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.806+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5939355279073699929', time=2024-09-12T03:14:03.358980+0000, chain.objs.size()=1 2024-09-12T01:38:00.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.806+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.ld-1G8frGW24gf4CTb0MIm0_QWhA7J6_0 2024-09-12T01:38:00.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.806+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8063570797112019957', time=2024-09-12T03:14:03.673351+0000, chain.objs.size()=1 2024-09-12T01:38:00.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.806+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Rfo4lbeWhcuo10itI01NVPc4TBVMRSm_0 2024-09-12T01:38:00.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.806+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15529191550874096017', time=2024-09-12T03:14:07.114355+0000, chain.objs.size()=1 2024-09-12T01:38:00.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.806+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.328__shadow_.KOYC7Vo2d3mUi1eMHhAaS9f8KnV6lVg_0 2024-09-12T01:38:00.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.806+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5775702449369779030', time=2024-09-12T03:14:20.555525+0000, chain.objs.size()=1 2024-09-12T01:38:00.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.806+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.342__shadow_.d8DUPEVUxJxkOmwc3nLYpLkvVQI2P9g_0 2024-09-12T01:38:00.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.808+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15642724357132477702', time=2024-09-12T03:16:00.242122+0000, chain.objs.size()=1 2024-09-12T01:38:00.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.808+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.447__shadow_.fOohyTeng9KqNIDRERY-2xhGvLYlbqE_0 2024-09-12T01:38:00.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.808+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6547770371306810345', time=2024-09-12T03:16:31.807359+0000, chain.objs.size()=1 2024-09-12T01:38:00.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.808+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.481__shadow_.aSii8mjyNOdXHvzISlmjUhcgTec6qYp_0 2024-09-12T01:38:00.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.808+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15733410264702589946', time=2024-09-12T03:16:35.460144+0000, chain.objs.size()=1 2024-09-12T01:38:00.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.808+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.484__shadow_.M6tFk6pbiwgx-ZqdIwj0LHoaIzFEWHW_0 2024-09-12T01:38:00.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.811+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1202539382853320413', time=2024-09-12T03:16:35.460964+0000, chain.objs.size()=1 2024-09-12T01:38:00.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.811+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.484__shadow_.WYtrKRWU20H4QDp6NLcz_KGzPJBvdlv_0 2024-09-12T01:38:00.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.811+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9376023185229949020', time=2024-09-12T03:16:56.226688+0000, chain.objs.size()=1 2024-09-12T01:38:00.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.811+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.503__shadow:zjHxI5MExGDTEMgC.YI1-B-Wp2XBZjW_.xteVVbi5oDy4c1uLu1Qcooxbp-bOuaB_0 2024-09-12T01:38:00.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.811+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8698272325691681189', time=2024-09-12T03:17:42.901214+0000, chain.objs.size()=1 2024-09-12T01:38:00.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.811+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.518__multipart_mymultipart.2~DbeXHTM5bkUDbECCjqmgbkoaNQj60Ti.1 2024-09-12T01:38:00.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.811+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3587321473232260983', time=2024-09-12T03:22:42.909925+0000, chain.objs.size()=1 2024-09-12T01:38:00.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.811+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.557__shadow_.DYGe6KuNO8qswHf38g2T0IWeY3YfCwd_0 2024-09-12T01:38:00.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.811+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4326510630651750040', time=2024-09-12T03:23:15.422814+0000, chain.objs.size()=1 2024-09-12T01:38:00.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.811+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.569__shadow:PTzVez5OzFbIQcNV0sLMvCONjhbgZze_.iFUnRL2u8_BhoVfL2loUWy6HfDtiNox_0 2024-09-12T01:38:00.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.811+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17845644216282743986', time=2024-09-12T03:23:26.365323+0000, chain.objs.size()=1 2024-09-12T01:38:00.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.811+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.574__shadow:sLC9u7wK.mVVNyv5sH-Dzk1XlqZrZ6d_.9yhKvZo_eaL0QN3t33TdhOyip2dDaWx_0 2024-09-12T01:38:00.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.811+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.944876115160299469', time=2024-09-12T03:24:36.494690+0000, chain.objs.size()=1 2024-09-12T01:38:00.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.811+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.579__shadow:2vbBajTKIE-v2AvelU-LVvdEz6Ajvpv_.H-Y4gNprgzk6-spWnF5D08hhYb5iYc2_0 2024-09-12T01:38:00.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.811+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15662254370503405634', time=2024-09-12T03:24:38.976469+0000, chain.objs.size()=1 2024-09-12T01:38:00.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.811+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.580__shadow:lRKq1XAFChM41QgEyR9SzNNZWhNLJV2_.gKxkvQo9V8ZhaSpUeaqoUIVAuNkiPJF_0 2024-09-12T01:38:00.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.811+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.789855041120207235', time=2024-09-12T03:25:02.602110+0000, chain.objs.size()=1 2024-09-12T01:38:00.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.811+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.604__shadow_.wVQ6fUBojXtwNfRVam0M5s_nEH8YM_O_0 2024-09-12T01:38:00.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.811+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7114412009845569071', time=2024-09-12T03:26:53.541713+0000, chain.objs.size()=1 2024-09-12T01:38:00.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.811+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.616__shadow_.YQkUdwziN5TOZHv5ROsJPV-DonxIbpp_0 2024-09-12T01:38:00.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.812+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1147429588417421866', time=2024-09-12T03:29:51.738791+0000, chain.objs.size()=1 2024-09-12T01:38:00.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.812+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.629__shadow_.3WF78OoQKmP9mzobVJ-zGYS_fCo1DuQ_0 2024-09-12T01:38:00.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.813+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6365092044808436128', time=2024-09-12T03:30:05.251505+0000, chain.objs.size()=1 2024-09-12T01:38:00.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.813+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.642__shadow_.Qaa-1tLxrst8HThBGHxg2zbFChJ8TFC_0 2024-09-12T01:38:00.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.813+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9840359480594335257', time=2024-09-12T03:30:56.068915+0000, chain.objs.size()=6 2024-09-12T01:38:00.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.813+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.660__multipart_bar.2~Y75fFS0fNism9T4sLvPH9Wo93JhoUni.1 2024-09-12T01:38:00.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.814+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.660__multipart_bar.2~Y75fFS0fNism9T4sLvPH9Wo93JhoUni.2 2024-09-12T01:38:00.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.814+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.660__multipart_bar.2~Y75fFS0fNism9T4sLvPH9Wo93JhoUni.3 2024-09-12T01:38:00.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.817+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.660__multipart_bar.2~Y75fFS0fNism9T4sLvPH9Wo93JhoUni.4 2024-09-12T01:38:00.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.817+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.660__multipart_bar.2~Y75fFS0fNism9T4sLvPH9Wo93JhoUni.5 2024-09-12T01:38:00.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.817+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.660__multipart_bar.2~Y75fFS0fNism9T4sLvPH9Wo93JhoUni.6 2024-09-12T01:38:00.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.817+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17985383537510817639', time=2024-09-12T03:31:00.300653+0000, chain.objs.size()=1 2024-09-12T01:38:00.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.817+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.665__shadow_.ale1ISjxoChfj1AwbU7YgYyu5kHYUxQ_0 2024-09-12T01:38:00.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.817+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5064590578317208744', time=2024-09-12T03:31:23.704860+0000, chain.objs.size()=1 2024-09-12T01:38:00.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.817+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.694__shadow:aB9d3jPt-P0iWEZQnigj-3PkNZHoapc_.u4CHw87oBo4yXi_6UX_spoIUc80NA_Q_0 2024-09-12T01:38:00.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.817+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5387617791899790629', time=2024-09-12T03:31:39.532428+0000, chain.objs.size()=1 2024-09-12T01:38:00.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.817+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.711__multipart_file1.2~9nCvk72-sVSKC0EheAgBLzOqnTpF7pv.1 2024-09-12T01:38:00.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.817+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12449043810095079940', time=2024-09-12T03:32:06.032223+0000, chain.objs.size()=1 2024-09-12T01:38:00.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.817+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.719__shadow_.nafvhnWfzqgrADmYmzEc8GSmK55WhKt_0 2024-09-12T01:38:00.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.820+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:38:00.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.823+0000 7f8786c98800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T01:38:00.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.824+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:38:00.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.825+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:38:00.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.825+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44545' 2024-09-12T01:38:00.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.825+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10649731373055177181', time=2024-09-12T03:06:35.077251+0000, chain.objs.size()=3 2024-09-12T01:38:00.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.825+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.159__multipart_mymultipart-FROZEN.2~1_HK8uNu_UtE46PttkbV44QCvDVRgGu.1 2024-09-12T01:38:00.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.825+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.159__multipart_mymultipart-FROZEN.2~1_HK8uNu_UtE46PttkbV44QCvDVRgGu.2 2024-09-12T01:38:00.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.825+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.159__multipart_mymultipart-FROZEN.2~1_HK8uNu_UtE46PttkbV44QCvDVRgGu.3 2024-09-12T01:38:00.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.825+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16781878767303805188', time=2024-09-12T03:06:54.569262+0000, chain.objs.size()=3 2024-09-12T01:38:00.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.825+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.161__multipart_foo-STANDARD.2~SZYin5imC5_vX_mLBbfwHrcLaqXueh3.1 2024-09-12T01:38:00.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.825+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.161__multipart_foo-STANDARD.2~SZYin5imC5_vX_mLBbfwHrcLaqXueh3.2 2024-09-12T01:38:00.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.825+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.161__multipart_foo-STANDARD.2~SZYin5imC5_vX_mLBbfwHrcLaqXueh3.3 2024-09-12T01:38:00.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.825+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10718294907787370383', time=2024-09-12T03:10:15.792584+0000, chain.objs.size()=1 2024-09-12T01:38:00.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.825+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.239__shadow_.TM90_nXJWdt3SE4Xr3cTax6pi_8B2Rf_0 2024-09-12T01:38:00.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.825+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7071415992733225457', time=2024-09-12T03:10:17.647315+0000, chain.objs.size()=1 2024-09-12T01:38:00.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.825+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.241__shadow_._6mWePeTjZZvzD5VPfFmK2Lj5hTymt1_0 2024-09-12T01:38:00.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.825+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5465413598585037569', time=2024-09-12T03:10:25.908869+0000, chain.objs.size()=1 2024-09-12T01:38:00.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.825+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.248__shadow_.sw7fI6zfZAnAwV66BMChYD40wJZSJTA_0 2024-09-12T01:38:00.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.825+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10617840366403545862', time=2024-09-12T03:10:29.776933+0000, chain.objs.size()=1 2024-09-12T01:38:00.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.825+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.252__shadow_.21bDSM6H8XXqonl4uy6heaJMVfbrWeJ_0 2024-09-12T01:38:00.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.825+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.463046858782321505', time=2024-09-12T03:11:14.421477+0000, chain.objs.size()=1 2024-09-12T01:38:00.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.825+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.4OUQt9HmZM_wfu7y5I8u4j_1qrgxrnx_0 2024-09-12T01:38:00.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.826+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17892588775905739941', time=2024-09-12T03:11:14.764300+0000, chain.objs.size()=1 2024-09-12T01:38:00.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.826+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.amejeubGATUxXNkT7WNiGt8s8da4efy_0 2024-09-12T01:38:00.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.829+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.215552143174906375', time=2024-09-12T03:11:14.782514+0000, chain.objs.size()=1 2024-09-12T01:38:00.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.829+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.zyQIm3rOSLR5CAlhEsAaUZugdfQZpDK_0 2024-09-12T01:38:00.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.829+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14384716942407691094', time=2024-09-12T03:11:14.897136+0000, chain.objs.size()=1 2024-09-12T01:38:00.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.829+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.OtF_A8w901vbFommJDng1MHeM4gdq1H_0 2024-09-12T01:38:00.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.829+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8341739296786717899', time=2024-09-12T03:11:14.897898+0000, chain.objs.size()=1 2024-09-12T01:38:00.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.829+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.sKeEOV7J-7ep66we0UrJgt2oSNom0ID_0 2024-09-12T01:38:00.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.829+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16060367120644337319', time=2024-09-12T03:11:15.018854+0000, chain.objs.size()=1 2024-09-12T01:38:00.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.829+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.zILirtxWF3hCU4EAeAZkeAJUU_xfdaJ_0 2024-09-12T01:38:00.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.829+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8355194533890828295', time=2024-09-12T03:11:16.097021+0000, chain.objs.size()=1 2024-09-12T01:38:00.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.829+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.RJkGhFgoO27VDtzMuV4xc3QZbygwkO0_0 2024-09-12T01:38:00.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.829+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.232211949175199539', time=2024-09-12T03:11:16.340745+0000, chain.objs.size()=1 2024-09-12T01:38:00.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.829+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.6SrDEgeUh9H84jByrV22y1NUNphRlWJ_0 2024-09-12T01:38:00.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.829+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16839747146331775663', time=2024-09-12T03:11:16.480102+0000, chain.objs.size()=1 2024-09-12T01:38:00.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.829+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.z7z1sUIJBI5aOiHt8OmnooSstq1KqVz_0 2024-09-12T01:38:00.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.830+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4528954845528325156', time=2024-09-12T03:11:16.684721+0000, chain.objs.size()=1 2024-09-12T01:38:00.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.830+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.CcN2gJPM1mmwZmeLSUQ3BSaY54hwJxa_0 2024-09-12T01:38:00.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.830+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17150611194375384521', time=2024-09-12T03:11:16.721769+0000, chain.objs.size()=1 2024-09-12T01:38:00.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.830+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.tjOw_MaMtT3oGuQ0AzRGJjdEcJQV84w_0 2024-09-12T01:38:00.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.830+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8119023536632777145', time=2024-09-12T03:11:16.859335+0000, chain.objs.size()=1 2024-09-12T01:38:00.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.830+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.QxRvw20p-1Cf987Nf4EakQ-SUlbIJIH_0 2024-09-12T01:38:00.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.830+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6107949472960285894', time=2024-09-12T03:11:17.448737+0000, chain.objs.size()=1 2024-09-12T01:38:00.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.830+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.BSewxjxpRsmzZ0Eid5-2jN_F60ns7ra_0 2024-09-12T01:38:00.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.831+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3634857497430072616', time=2024-09-12T03:11:17.654401+0000, chain.objs.size()=1 2024-09-12T01:38:00.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.831+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.2YRewyHM15jCieaXbOwstl6ihyaPsgn_0 2024-09-12T01:38:00.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.831+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10079272876733560880', time=2024-09-12T03:11:17.796926+0000, chain.objs.size()=1 2024-09-12T01:38:00.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.831+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.gKvwGor-q08v6NWVCUex7SoEPHAKsCG_0 2024-09-12T01:38:00.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.832+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10124059307923680490', time=2024-09-12T03:11:17.955847+0000, chain.objs.size()=1 2024-09-12T01:38:00.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.832+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.3WDo86AIXzWn4Wq5Ua6U72eRci27_oq_0 2024-09-12T01:38:00.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.832+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16158351014296861764', time=2024-09-12T03:11:18.265461+0000, chain.objs.size()=1 2024-09-12T01:38:00.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.832+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.ZHqc_zE-Cdl4T76Mcz3tS--R50oujk4_0 2024-09-12T01:38:00.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.832+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7155639171637167550', time=2024-09-12T03:11:18.421635+0000, chain.objs.size()=1 2024-09-12T01:38:00.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.832+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.EXF-YYIp-s3SeHaHTByCUblDjP4-KZ1_0 2024-09-12T01:38:00.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.832+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8678719482243454220', time=2024-09-12T03:11:18.440927+0000, chain.objs.size()=1 2024-09-12T01:38:00.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.832+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.SdsJCxOKqvEAUw8QOKr78R02LCTTULI_0 2024-09-12T01:38:00.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.832+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14662585709001645661', time=2024-09-12T03:11:18.806626+0000, chain.objs.size()=1 2024-09-12T01:38:00.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.832+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.v4FcIc5QPfZcHSEZ_-YMgXy0eifB3T7_0 2024-09-12T01:38:00.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.832+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13122258135056112252', time=2024-09-12T03:11:18.829936+0000, chain.objs.size()=1 2024-09-12T01:38:00.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.832+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.0lr88X3GncofMuQiiZPiGcW-dyS8gY4_0 2024-09-12T01:38:00.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.832+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5051271458381828106', time=2024-09-12T03:11:19.014932+0000, chain.objs.size()=1 2024-09-12T01:38:00.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.832+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.gXSmFEl3sRpouxNOzwAuER7hAxYkiMH_0 2024-09-12T01:38:00.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.832+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1081470671084822304', time=2024-09-12T03:11:19.403372+0000, chain.objs.size()=1 2024-09-12T01:38:00.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.832+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.d5NwYWeSKWqKj2P2EsM2G6D2sgyStC8_0 2024-09-12T01:38:00.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.832+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13230091071381810653', time=2024-09-12T03:11:19.810835+0000, chain.objs.size()=1 2024-09-12T01:38:00.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.832+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.gStydbsTfit71tdcTGSPtvwVXtJS53E_0 2024-09-12T01:38:00.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.833+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4594643933723989368', time=2024-09-12T03:11:19.811493+0000, chain.objs.size()=1 2024-09-12T01:38:00.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.833+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.m4VbPs7bfsIl2b2u3z38e38DwuloA9u_0 2024-09-12T01:38:00.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.833+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14071522388217327228', time=2024-09-12T03:11:20.184502+0000, chain.objs.size()=1 2024-09-12T01:38:00.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.833+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.1IXkb-riz9mf7SPrOswj2HoHs9-yP-__0 2024-09-12T01:38:00.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.833+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3014082127033876050', time=2024-09-12T03:11:20.650407+0000, chain.objs.size()=1 2024-09-12T01:38:00.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.833+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.72p5KKuBfVzQU-ebvxHxuZWMkte_6Bn_0 2024-09-12T01:38:00.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.834+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.110804814957780001', time=2024-09-12T03:11:20.890473+0000, chain.objs.size()=1 2024-09-12T01:38:00.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.834+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.xr2Fpr-A4SBRHAyk7X8t6ZTPhVDbAD9_0 2024-09-12T01:38:00.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.835+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14890539306513307202', time=2024-09-12T03:11:20.966668+0000, chain.objs.size()=1 2024-09-12T01:38:00.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.835+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.a_Twldi33LYuwQxoW4-2-IOVTBEGpSi_0 2024-09-12T01:38:00.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.835+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3128840509653368412', time=2024-09-12T03:11:21.663261+0000, chain.objs.size()=1 2024-09-12T01:38:00.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.835+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.i8eEFfQcehldJqMslSLQSA8HMCleN_U_0 2024-09-12T01:38:00.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.835+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5716374422873805431', time=2024-09-12T03:11:21.695972+0000, chain.objs.size()=1 2024-09-12T01:38:00.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.835+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.E1SCP4rfquWFeqde9X4JaNRAXBlhrpC_0 2024-09-12T01:38:00.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.835+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7775577547289238783', time=2024-09-12T03:11:22.374890+0000, chain.objs.size()=1 2024-09-12T01:38:00.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.835+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.N54o2mk1LK5U7VFpsrWhnITFpS-D1Os_0 2024-09-12T01:38:00.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.835+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12072673013824287000', time=2024-09-12T03:11:22.393356+0000, chain.objs.size()=1 2024-09-12T01:38:00.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.835+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.8-QD4maazC-eVIGvbVX4Pa5FbgjN1sz_0 2024-09-12T01:38:00.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.835+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14496161304475412637', time=2024-09-12T03:11:22.848924+0000, chain.objs.size()=1 2024-09-12T01:38:00.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.835+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.qTPRYlA4vqsXpqhcQyab3JKeyIPA73p_0 2024-09-12T01:38:00.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.835+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8170723813319243610', time=2024-09-12T03:11:23.701576+0000, chain.objs.size()=1 2024-09-12T01:38:00.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.835+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.zuszpeOZduWvT-ohKutm6EGPZCidSVd_0 2024-09-12T01:38:00.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.835+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16638362961301373554', time=2024-09-12T03:11:24.690741+0000, chain.objs.size()=1 2024-09-12T01:38:00.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.835+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Sb9dFj-yqTvLbhYAWv64zoUA_zEPYlj_0 2024-09-12T01:38:00.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.835+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6406370647825885769', time=2024-09-12T03:11:46.912434+0000, chain.objs.size()=1 2024-09-12T01:38:00.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.835+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.285__shadow_.Vv24jdvl_DhFyWh5to_g_LqBDHqlBEY_0 2024-09-12T01:38:00.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.835+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7598636418576421896', time=2024-09-12T03:11:51.795866+0000, chain.objs.size()=1 2024-09-12T01:38:00.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.835+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.290__shadow_.ZMIaRu0_INWqjJsRvv6xzdW0SEhrFGm_0 2024-09-12T01:38:00.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.835+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5894099069274450239', time=2024-09-12T03:11:55.318328+0000, chain.objs.size()=1 2024-09-12T01:38:00.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.835+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.292__shadow_.r-iHHWcJZBSuIC7-HSU-AqaaMiQq_Vb_0 2024-09-12T01:38:00.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.836+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1370664646393455233', time=2024-09-12T03:11:57.545470+0000, chain.objs.size()=1 2024-09-12T01:38:00.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.836+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.293__shadow_.KEOkFdPN7UZYT0e-CnYScklgv62N9jS_0 2024-09-12T01:38:00.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.836+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15348229521770346601', time=2024-09-12T03:11:59.561890+0000, chain.objs.size()=1 2024-09-12T01:38:00.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.836+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.295__shadow_.LdgzcfyLmpxjDBAfQ6lbIM1hRw-ph51_0 2024-09-12T01:38:00.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.839+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9491613022042381169', time=2024-09-12T03:12:01.656667+0000, chain.objs.size()=1 2024-09-12T01:38:00.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.839+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.297__shadow_.lqb57yjqqbvOhA8WaUB3aUw9gbXpJq5_0 2024-09-12T01:38:00.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.839+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2840215877517368002', time=2024-09-12T03:12:12.261130+0000, chain.objs.size()=1 2024-09-12T01:38:00.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.839+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.307__shadow:wDQW0Hw5RqUuDL8CCU8G7Kk1SirhvAj_.DQpJIIEEX09USwdhWcB3bchfvTVhfLI_0 2024-09-12T01:38:00.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.842+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14933885417739517494', time=2024-09-12T03:13:06.773068+0000, chain.objs.size()=1 2024-09-12T01:38:00.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.842+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.KaaqUp42XwBZ6CsvgOVCa3BPEl_pL5K_0 2024-09-12T01:38:00.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.842+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17542110420515853654', time=2024-09-12T03:13:07.090786+0000, chain.objs.size()=1 2024-09-12T01:38:00.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.842+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.I8RicGwURhvMBfIh-NnR-c6QX_oY0Er_0 2024-09-12T01:38:00.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.842+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3524598087457375543', time=2024-09-12T03:13:07.758695+0000, chain.objs.size()=1 2024-09-12T01:38:00.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.842+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.5RsekY5S2lhCr70CpUqCY-7RCGXIIwC_0 2024-09-12T01:38:00.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.842+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2620725119726420311', time=2024-09-12T03:13:08.428077+0000, chain.objs.size()=1 2024-09-12T01:38:00.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.842+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.R_dLWvR-5_l2QfYlnPrk4b4SFdFNu6t_0 2024-09-12T01:38:00.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.842+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9027018197688426461', time=2024-09-12T03:13:08.729773+0000, chain.objs.size()=1 2024-09-12T01:38:00.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.842+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.VEkxpfOpv7t8prO5SjAWv64agDyOJgU_0 2024-09-12T01:38:00.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.842+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4034307953520767920', time=2024-09-12T03:13:08.964775+0000, chain.objs.size()=1 2024-09-12T01:38:00.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.842+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.sMHPPJn-2NTQzTmmZWDCKU-Qm0z8iHR_0 2024-09-12T01:38:00.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.842+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11729560138308533445', time=2024-09-12T03:13:09.246127+0000, chain.objs.size()=1 2024-09-12T01:38:00.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.842+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.6y1LYP3GWER0EE5w6jP-aqLnlBSjO9z_0 2024-09-12T01:38:00.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.842+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18137077450443867147', time=2024-09-12T03:13:10.356978+0000, chain.objs.size()=1 2024-09-12T01:38:00.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.842+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.2fg0v98ovvq89BQShdq4OlC7jty0arq_0 2024-09-12T01:38:00.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.842+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13990263283928820533', time=2024-09-12T03:13:11.089069+0000, chain.objs.size()=1 2024-09-12T01:38:00.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.842+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.7TI7Z8ReijYLhWsTMZ_fm05JflZ_VkX_0 2024-09-12T01:38:00.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.842+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11634143261470171063', time=2024-09-12T03:13:11.125548+0000, chain.objs.size()=1 2024-09-12T01:38:00.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.842+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.U_2lV-RRxzWmnd5fg_U-7_FXS5l48xn_0 2024-09-12T01:38:00.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.842+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16250346952978383010', time=2024-09-12T03:13:11.776319+0000, chain.objs.size()=1 2024-09-12T01:38:00.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.842+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.rEV_VhPpg8NdJO9fDfVhyDm31W3YKPa_0 2024-09-12T01:38:00.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.844+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4413805415961310600', time=2024-09-12T03:13:12.079658+0000, chain.objs.size()=1 2024-09-12T01:38:00.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.844+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.oA8LSyFE2e94Uh0L1D2t3ISsrM2FY-E_0 2024-09-12T01:38:00.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.844+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1358463163003882521', time=2024-09-12T03:13:12.103338+0000, chain.objs.size()=1 2024-09-12T01:38:00.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.844+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.lf_x23mZeS-XF51pebiM9OFcOHqTKHS_0 2024-09-12T01:38:00.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.844+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18239681916808837553', time=2024-09-12T03:13:12.828099+0000, chain.objs.size()=1 2024-09-12T01:38:00.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.844+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.t7ue8U7RZwpQWqUUSmNdPbpqO47ZtaC_0 2024-09-12T01:38:00.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.844+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7331670782368060841', time=2024-09-12T03:13:13.448929+0000, chain.objs.size()=1 2024-09-12T01:38:00.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.844+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.3dNA4HOWs1M_YlM32v6l9ZpEZiCO7Kr_0 2024-09-12T01:38:00.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.844+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11971067837402660143', time=2024-09-12T03:13:13.468740+0000, chain.objs.size()=1 2024-09-12T01:38:00.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.844+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.vaZDBO_DAT1jl2gAjGign9O3bnV2Abz_0 2024-09-12T01:38:00.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.845+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9009121457197143509', time=2024-09-12T03:13:13.989690+0000, chain.objs.size()=1 2024-09-12T01:38:00.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.845+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.FOjmz_ApKjIynvfbRmFnvdBRuXWfSYT_0 2024-09-12T01:38:00.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.845+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7179306016063465957', time=2024-09-12T03:13:14.247335+0000, chain.objs.size()=1 2024-09-12T01:38:00.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.845+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.o3CdugaGtmRBwd5I75SMRyU9RUyaWpb_0 2024-09-12T01:38:00.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.845+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7824194279615068554', time=2024-09-12T03:13:14.406806+0000, chain.objs.size()=1 2024-09-12T01:38:00.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.845+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.G7qSnWtFW7g6EyQSlix1P_muRrzf4-4_0 2024-09-12T01:38:00.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.845+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14841582347838192288', time=2024-09-12T03:13:14.514245+0000, chain.objs.size()=1 2024-09-12T01:38:00.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.845+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.sXepXWWJAsSjJRsRqC1L38Bn63qo6EL_0 2024-09-12T01:38:00.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.845+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5001662866464205360', time=2024-09-12T03:13:14.587116+0000, chain.objs.size()=1 2024-09-12T01:38:00.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.845+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.JOgODYG04mrSfFVzotMj4rB1uSlx0gR_0 2024-09-12T01:38:00.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.846+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5053291605615581489', time=2024-09-12T03:13:14.606821+0000, chain.objs.size()=1 2024-09-12T01:38:00.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.846+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.oL8s_i_5n1BQ_6qX0spDt_GB4DrzSUp_0 2024-09-12T01:38:00.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.846+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15612549072345366586', time=2024-09-12T03:13:15.450587+0000, chain.objs.size()=1 2024-09-12T01:38:00.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.846+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.QnOqRsyQ5Cpl5LfsxDIx5lyOYqNWkBg_0 2024-09-12T01:38:00.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.846+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14127202990421167240', time=2024-09-12T03:13:15.563921+0000, chain.objs.size()=1 2024-09-12T01:38:00.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.846+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_._ZK06_KY-urKogCfhk_9h59D9QfaISd_0 2024-09-12T01:38:00.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.848+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2209852162413006674', time=2024-09-12T03:13:15.674143+0000, chain.objs.size()=1 2024-09-12T01:38:00.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.848+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.jSwiZrKZHW5uvEXYc81FJ2htnMj5kjs_0 2024-09-12T01:38:00.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.848+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17078622462992951884', time=2024-09-12T03:13:15.800403+0000, chain.objs.size()=1 2024-09-12T01:38:00.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.848+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.LF2PLi2Y_ze6NQeRqP3LsCIAE1FvAkC_0 2024-09-12T01:38:00.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.848+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13866777461615298832', time=2024-09-12T03:13:16.038414+0000, chain.objs.size()=1 2024-09-12T01:38:00.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.848+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.JGJqpbi0V5vdNvdbG8YpJofEwJzp0Ho_0 2024-09-12T01:38:00.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.850+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1989538622035931604', time=2024-09-12T03:13:16.379868+0000, chain.objs.size()=1 2024-09-12T01:38:00.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.850+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.iT4_7V4pouN-QX4BKJgoikqpw7igNjO_0 2024-09-12T01:38:00.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.850+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15733438278845999331', time=2024-09-12T03:13:16.783133+0000, chain.objs.size()=1 2024-09-12T01:38:00.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.850+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.cYEyDaCj2U3QyMad3QLCMPfa2Osoo_H_0 2024-09-12T01:38:00.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.850+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3550562645698494842', time=2024-09-12T03:13:17.108933+0000, chain.objs.size()=1 2024-09-12T01:38:00.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.850+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.E-OBoZTSSQs3V6QgBYp4gsHDukWeGRS_0 2024-09-12T01:38:00.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.850+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7755350599153763790', time=2024-09-12T03:13:53.744972+0000, chain.objs.size()=1 2024-09-12T01:38:00.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.850+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Zna3uWVdI1NOmiQqbzY6otp1EvllSZ1_0 2024-09-12T01:38:00.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.851+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3338277361817927759', time=2024-09-12T03:13:54.291402+0000, chain.objs.size()=1 2024-09-12T01:38:00.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.851+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.ny7FbbvWc85n4BPJpgN2jHHwiUUYbk-_0 2024-09-12T01:38:00.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.851+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16896226333086621844', time=2024-09-12T03:13:55.211944+0000, chain.objs.size()=1 2024-09-12T01:38:00.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.851+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.fMM5RvGOy9xoYv4aJFMd25M6MckRQSI_0 2024-09-12T01:38:00.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.851+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9251381309734998870', time=2024-09-12T03:13:55.479863+0000, chain.objs.size()=1 2024-09-12T01:38:00.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.851+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_._T1i3FnAUHHmpFBGfu-Y_lW-zkcx8kt_0 2024-09-12T01:38:00.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.851+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7117126461155814590', time=2024-09-12T03:13:56.505237+0000, chain.objs.size()=1 2024-09-12T01:38:00.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.851+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.rTZXUC0DJsfir9cl-E-cicSCzo1p93P_0 2024-09-12T01:38:00.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.851+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16543860058508374743', time=2024-09-12T03:13:56.505824+0000, chain.objs.size()=1 2024-09-12T01:38:00.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.851+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Lq1kIlfwrAzhzMSesb79zkGyufWrD1m_0 2024-09-12T01:38:00.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.854+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.705945264137391862', time=2024-09-12T03:13:56.847656+0000, chain.objs.size()=1 2024-09-12T01:38:00.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.854+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Lf5fuy5Z-DZ2MM3rZFp9NM9uMoFK1sO_0 2024-09-12T01:38:00.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.854+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15759373392708424353', time=2024-09-12T03:13:58.400167+0000, chain.objs.size()=1 2024-09-12T01:38:00.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.854+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Nlg6AOwA8SCN31SIMvjcP6YrxfWJcpo_0 2024-09-12T01:38:00.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.856+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10774528459145384712', time=2024-09-12T03:13:59.151322+0000, chain.objs.size()=1 2024-09-12T01:38:00.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.856+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.KMh70XEldx9d-EFciHI9sLmnO9wsPVc_0 2024-09-12T01:38:00.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.856+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13246363844112928280', time=2024-09-12T03:13:59.648294+0000, chain.objs.size()=1 2024-09-12T01:38:00.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.856+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.uqWakQVDx4WakG0PNcRG9pucfLghv9M_0 2024-09-12T01:38:00.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.856+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.671131724119087977', time=2024-09-12T03:14:01.036211+0000, chain.objs.size()=1 2024-09-12T01:38:00.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.856+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.kiRbLRqJnubqqI8GIbY6uO3RdijVxIt_0 2024-09-12T01:38:00.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.856+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16901445253112835348', time=2024-09-12T03:14:01.135713+0000, chain.objs.size()=1 2024-09-12T01:38:00.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.856+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.LZncHyhTpCyO1UwdkE8XKs53p-T-YZh_0 2024-09-12T01:38:00.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.856+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3063531662182930092', time=2024-09-12T03:14:01.706939+0000, chain.objs.size()=1 2024-09-12T01:38:00.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.856+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.qaT7V2zBsEWOQ-PF5oqNYgwZHnHbcAC_0 2024-09-12T01:38:00.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.856+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18096182723869910327', time=2024-09-12T03:14:01.825900+0000, chain.objs.size()=1 2024-09-12T01:38:00.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.856+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.WSqrRUgAWaReXTNlCR-YsReTi2dC8Ti_0 2024-09-12T01:38:00.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.856+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11334571032804197323', time=2024-09-12T03:14:02.381821+0000, chain.objs.size()=1 2024-09-12T01:38:00.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.856+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.2NZDBKTW0bcE-sSNbEsCJwVXNUnuLH4_0 2024-09-12T01:38:00.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.856+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3203937324884114174', time=2024-09-12T03:14:02.421352+0000, chain.objs.size()=1 2024-09-12T01:38:00.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.856+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.RvDQEuCGLXIGJahY0hoq_2NlBTgYNKA_0 2024-09-12T01:38:00.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.856+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18322009640945329255', time=2024-09-12T03:14:03.328352+0000, chain.objs.size()=1 2024-09-12T01:38:00.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.856+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.PzR5GRYLobBaR2joT-slqjT5JrTMmpq_0 2024-09-12T01:38:00.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.856+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13326765298997969494', time=2024-09-12T03:14:43.689787+0000, chain.objs.size()=1 2024-09-12T01:38:00.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.856+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.370__shadow_.KU5lizZCAqOqB6Fg7v1PyYoqJOsd9FK_0 2024-09-12T01:38:00.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.856+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6203411483815652171', time=2024-09-12T03:15:20.421693+0000, chain.objs.size()=1 2024-09-12T01:38:00.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.856+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.407__shadow_.FrVUjor-idSyXFDHEM9MAHrrEmlYxvV_0 2024-09-12T01:38:00.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.858+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15374892520173847320', time=2024-09-12T03:15:45.190890+0000, chain.objs.size()=1 2024-09-12T01:38:00.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.858+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.433__shadow_.raPUVnV43e4pEABjq-1jVo5gffpR0ED_0 2024-09-12T01:38:00.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.859+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14069792802089882457', time=2024-09-12T03:15:52.874212+0000, chain.objs.size()=1 2024-09-12T01:38:00.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.859+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.441__shadow_.G-MVAdEd1-HhtDLjudTPiglebICqISr_0 2024-09-12T01:38:00.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.865+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 0/44545 2024-09-12T01:38:00.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.867+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T01:38:00.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.867+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9092042542151334082', time=2024-09-12T03:16:23.201810+0000, chain.objs.size()=1 2024-09-12T01:38:00.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.867+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.466__shadow_.oNKSyBbWhjQb2boagFXuBmxOeenQP3Q_0 2024-09-12T01:38:00.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.867+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8876365169635011465', time=2024-09-12T03:16:35.453100+0000, chain.objs.size()=1 2024-09-12T01:38:00.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.867+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.484__shadow_.SJGCFwL7EAVMFshwVvu7u13xGpYR0Wb_0 2024-09-12T01:38:00.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.867+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2263010703577184531', time=2024-09-12T03:21:12.016259+0000, chain.objs.size()=2 2024-09-12T01:38:00.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.867+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.528__multipart_mymultipart.2~b0yaFR4p75L00HwGsjmr5cYlpfut1Jk.1 2024-09-12T01:38:00.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.867+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.528__multipart_mymultipart.2~b0yaFR4p75L00HwGsjmr5cYlpfut1Jk.2 2024-09-12T01:38:00.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.867+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1856175577548274875', time=2024-09-12T03:22:54.302247+0000, chain.objs.size()=1 2024-09-12T01:38:00.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.867+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.561__multipart_mymultipart.JNKKh1cr2KLwf5bAR3c6gL2p4PkcT2je.1 2024-09-12T01:38:00.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.867+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9671185068592839587', time=2024-09-12T03:23:15.858736+0000, chain.objs.size()=1 2024-09-12T01:38:00.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.867+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.569__shadow:9xdI3zw7Ijep55pvlmcyED3T2n9MwWl_.5WtvqXqtEixzofifzW1wqaszLqF6hTQ_0 2024-09-12T01:38:00.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.867+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8373399837984734164', time=2024-09-12T03:23:17.656556+0000, chain.objs.size()=1 2024-09-12T01:38:00.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.867+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.569__shadow:KLRf1FJudnCWTC2BLnycj.MkPxy3FFM_.f6Z2nHa2U-yZHHWPbgzX-pWrC-sFOUW_0 2024-09-12T01:38:00.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.867+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3990771640326935871', time=2024-09-12T03:23:24.146901+0000, chain.objs.size()=1 2024-09-12T01:38:00.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.867+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.573__shadow_.KeYG1ocUuEQxsaXp3984Wm_6Q13NKoU_0 2024-09-12T01:38:00.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.867+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12904537353581112550', time=2024-09-12T03:23:28.853080+0000, chain.objs.size()=1 2024-09-12T01:38:00.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.867+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.574__shadow:FIPjEW-p.qt7HbTcwfLlU0nfZkULp7N_.rx4toBBvwem_704JRBMGeT9bBNk3-bK_0 2024-09-12T01:38:00.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.867+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13424430200785671254', time=2024-09-12T03:23:35.557446+0000, chain.objs.size()=1 2024-09-12T01:38:00.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.867+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.576__shadow:CqSMLPwoJWWqKQ.SdLAwZRASuBhbuIf_.nzos3KNY7JyTBy2fcJ7whWX4HwCcgtC_0 2024-09-12T01:38:00.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.867+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4355674857193018361', time=2024-09-12T03:23:41.628901+0000, chain.objs.size()=1 2024-09-12T01:38:00.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.867+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.577__shadow:0R7dFcdOa0Z52jNgcdAzgircIzEe8A2_.M_Hn-gkow8xxvulMQqx3BINb2T9yqTX_0 2024-09-12T01:38:00.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.867+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6440556061141657166', time=2024-09-12T03:24:40.092362+0000, chain.objs.size()=1 2024-09-12T01:38:00.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.867+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.582__shadow:vgYshYidUkgyFVZvgLWuACcfKb1Z7aj_.p-qWbWPDb_6OrlhpIe1gSMH75-8P7B2_0 2024-09-12T01:38:00.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.869+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4148779507389738984', time=2024-09-12T03:30:00.911016+0000, chain.objs.size()=1 2024-09-12T01:38:00.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.869+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.639__shadow_.8Smts0XkE3j7bwH2lmwE7FLx_WfIyPf_0 2024-09-12T01:38:00.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.869+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13157161709030908162', time=2024-09-12T03:30:25.734889+0000, chain.objs.size()=1 2024-09-12T01:38:00.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.869+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.652__shadow_.B7HHqu4taNLBI-DZGJJdNP0yWgmmnnY_0 2024-09-12T01:38:00.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.869+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13627493159935299701', time=2024-09-12T03:31:31.079623+0000, chain.objs.size()=1 2024-09-12T01:38:00.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.869+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.702__multipart_file1.2~NXO_6TSb4Hw6ClQa66UFb1QGzw-ftAD.1 2024-09-12T01:38:00.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.871+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:38:00.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.874+0000 7f8786c98800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T01:38:00.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.875+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:38:00.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.876+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:38:00.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.877+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47999' 2024-09-12T01:38:00.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.877+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7840416154437949628', time=2024-09-12T03:06:13.638901+0000, chain.objs.size()=1 2024-09-12T01:38:00.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.877+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.151__shadow_.8sxhuK-rgL8uRD2ImNu_FI5JNJyNidp_0 2024-09-12T01:38:00.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.877+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3532191088562019072', time=2024-09-12T03:07:00.915934+0000, chain.objs.size()=3 2024-09-12T01:38:00.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.877+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.161__multipart_foo-LUKEWARM.2~j7ZEyRVaZfuuQoXFw_wXL-K1HTYboMA.1 2024-09-12T01:38:00.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.877+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.161__multipart_foo-LUKEWARM.2~j7ZEyRVaZfuuQoXFw_wXL-K1HTYboMA.2 2024-09-12T01:38:00.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.877+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.161__multipart_foo-LUKEWARM.2~j7ZEyRVaZfuuQoXFw_wXL-K1HTYboMA.3 2024-09-12T01:38:00.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.877+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15981302519151379883', time=2024-09-12T03:10:06.799104+0000, chain.objs.size()=1 2024-09-12T01:38:00.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.877+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.231__shadow_.z-mH3EPpfxPLNXyTM2V1oZC5LbSKEC0_0 2024-09-12T01:38:00.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.877+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13481730793578837635', time=2024-09-12T03:10:17.647161+0000, chain.objs.size()=1 2024-09-12T01:38:00.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.877+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.241__shadow_.cOhAnwWsL22h4D-OJW1HQ1-fMS4JN4R_0 2024-09-12T01:38:00.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.877+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5955428791680285045', time=2024-09-12T03:10:21.917497+0000, chain.objs.size()=1 2024-09-12T01:38:00.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.877+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.244__shadow_._s4qHHtTXv43fG1p_uM49IiuSCJdOrx_0 2024-09-12T01:38:00.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.877+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7953771946529008235', time=2024-09-12T03:10:22.890582+0000, chain.objs.size()=1 2024-09-12T01:38:00.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.877+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.245__shadow_.pM03Z0zmSGdC-J-v63-wCR06jCkB7TC_0 2024-09-12T01:38:00.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.877+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.365759049484181539', time=2024-09-12T03:10:23.853643+0000, chain.objs.size()=1 2024-09-12T01:38:00.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.877+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.246__shadow_.POhunWdxifp7eqVV5AG1l8UBZURAOnm_0 2024-09-12T01:38:00.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.877+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8101463013107433585', time=2024-09-12T03:10:25.906413+0000, chain.objs.size()=1 2024-09-12T01:38:00.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.877+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.248__shadow_.fRRX-hxtvfuaxHL5_RcIUkckjUoIqt__0 2024-09-12T01:38:00.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.877+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9888315465685751470', time=2024-09-12T03:10:29.785251+0000, chain.objs.size()=1 2024-09-12T01:38:00.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.877+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.252__shadow_.2GliJ1VJaHJU_mKNc903fcsvu78CFgq_0 2024-09-12T01:38:00.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.877+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18236408846943204991', time=2024-09-12T03:11:14.537703+0000, chain.objs.size()=1 2024-09-12T01:38:00.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.877+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.L3ehzT_gA46ezQgEaaFj8mQYX2XBcI-_0 2024-09-12T01:38:00.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.879+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2564642155395171248', time=2024-09-12T03:11:15.228782+0000, chain.objs.size()=1 2024-09-12T01:38:00.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.879+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.G0VVI-gEsaqk7wxcMiXK6yYfIygkNcP_0 2024-09-12T01:38:00.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.879+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10043997561840315246', time=2024-09-12T03:11:16.112447+0000, chain.objs.size()=1 2024-09-12T01:38:00.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.879+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.XyWD8hOdbnYqHKEd86HRpMUkaSLWQvn_0 2024-09-12T01:38:00.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.879+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13009827370195248807', time=2024-09-12T03:11:16.233545+0000, chain.objs.size()=1 2024-09-12T01:38:00.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.879+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.9L3roLwD9TMgKiJbQw5odikxH3KVsax_0 2024-09-12T01:38:00.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.879+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11965206273570851871', time=2024-09-12T03:11:16.298959+0000, chain.objs.size()=1 2024-09-12T01:38:00.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.879+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.8I2ranJidghoIWbF-c5MPs4xOlsYPVD_0 2024-09-12T01:38:00.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.879+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9257517272584706476', time=2024-09-12T03:11:16.728864+0000, chain.objs.size()=1 2024-09-12T01:38:00.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.879+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.VoAptioOXbF_KeNFDtlJTtjovMGlB-0_0 2024-09-12T01:38:00.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.879+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7890417556400966481', time=2024-09-12T03:11:16.904457+0000, chain.objs.size()=1 2024-09-12T01:38:00.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.879+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Gg8afOHbPGwZ7APzFGJYs-HnEHh1tBj_0 2024-09-12T01:38:00.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.879+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6889817850372758846', time=2024-09-12T03:11:17.402531+0000, chain.objs.size()=1 2024-09-12T01:38:00.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.879+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.EgIhJulJEtPet9arF7f9CHVYbmOHaW__0 2024-09-12T01:38:00.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.879+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17433090801209748859', time=2024-09-12T03:11:17.405068+0000, chain.objs.size()=1 2024-09-12T01:38:00.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.879+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.CZBfW0axHj91Tq76ytRrW0xqa7LYKae_0 2024-09-12T01:38:00.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.879+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1430789221609988751', time=2024-09-12T03:11:18.399391+0000, chain.objs.size()=1 2024-09-12T01:38:00.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.879+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.brNb69s2hsyCJ7HeprA_XcFqo9R8jfx_0 2024-09-12T01:38:00.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.879+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2179051106731360011', time=2024-09-12T03:11:18.936441+0000, chain.objs.size()=1 2024-09-12T01:38:00.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.879+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.hFB-tcAALrbrkvsN5LD3HjzTZFkI9KZ_0 2024-09-12T01:38:00.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.879+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5225494087746011957', time=2024-09-12T03:11:19.083635+0000, chain.objs.size()=1 2024-09-12T01:38:00.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.879+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.PPVfSEVijNFaH0vTw4ys9w7O7hYli6P_0 2024-09-12T01:38:00.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.880+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15517877857056846641', time=2024-09-12T03:11:19.383927+0000, chain.objs.size()=1 2024-09-12T01:38:00.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.880+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.OjTK8Lw-iPMOSP_kSlzTk_ky4ukRKTA_0 2024-09-12T01:38:00.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.882+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1270640880715516600', time=2024-09-12T03:11:19.539192+0000, chain.objs.size()=1 2024-09-12T01:38:00.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.882+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.-bRRXHL6ZpBWqwa3043zZsCPoRN5Lgv_0 2024-09-12T01:38:00.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.882+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9389950913236261635', time=2024-09-12T03:11:19.622248+0000, chain.objs.size()=1 2024-09-12T01:38:00.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.882+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.YF92OpXSThnWmBV82ctrR0Vpqx_w4gm_0 2024-09-12T01:38:00.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.882+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7535994519706225541', time=2024-09-12T03:11:19.623022+0000, chain.objs.size()=1 2024-09-12T01:38:00.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.882+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.gpQUxiJyI1mTTNGzDUF7O2LeqhLkIDd_0 2024-09-12T01:38:00.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.882+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14089957247224656079', time=2024-09-12T03:11:19.691959+0000, chain.objs.size()=1 2024-09-12T01:38:00.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.882+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.0dtNN4z-9kfesLwn5qNMxFYdYFEosXq_0 2024-09-12T01:38:00.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.882+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17930277314368172431', time=2024-09-12T03:11:19.762649+0000, chain.objs.size()=1 2024-09-12T01:38:00.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.882+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.1JWJlA0uVx6ckRj9zOFA9mrAMVSYT2G_0 2024-09-12T01:38:00.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.882+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12738442813714478944', time=2024-09-12T03:11:19.813007+0000, chain.objs.size()=1 2024-09-12T01:38:00.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.882+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.573keNnssL1ZtcDll2kRQZT5UwkB3FR_0 2024-09-12T01:38:00.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.882+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6473551555193839498', time=2024-09-12T03:11:19.813555+0000, chain.objs.size()=1 2024-09-12T01:38:00.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.882+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.VK5oADNredBQASdf9tkwkBvg0hmsdgO_0 2024-09-12T01:38:00.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.882+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1789198128668256078', time=2024-09-12T03:11:19.834590+0000, chain.objs.size()=1 2024-09-12T01:38:00.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.882+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.kJS4bKCncqS1udVL2X3ydhyxX0r8MNU_0 2024-09-12T01:38:00.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.882+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10554441495098604313', time=2024-09-12T03:11:20.239416+0000, chain.objs.size()=1 2024-09-12T01:38:00.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.882+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.AWcVBD8vCQWiLmuBXbF5thLO_megh3X_0 2024-09-12T01:38:00.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.882+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11333168358523229095', time=2024-09-12T03:11:20.240892+0000, chain.objs.size()=1 2024-09-12T01:38:00.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.882+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.BeBRX47Fezsk8lBYAiRVZup1s3cdBi7_0 2024-09-12T01:38:00.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.882+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16267413697429533762', time=2024-09-12T03:11:20.672198+0000, chain.objs.size()=1 2024-09-12T01:38:00.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.882+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.dpVZn3hQDI-QjHPzTOIChmAjtL_qK0Q_0 2024-09-12T01:38:00.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.887+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16799681479487753535', time=2024-09-12T03:11:20.737538+0000, chain.objs.size()=1 2024-09-12T01:38:00.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.887+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.M0IW1AXSgtfwXcX1TvzofStpRYCDHJA_0 2024-09-12T01:38:00.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.887+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1668001591230277244', time=2024-09-12T03:11:20.772564+0000, chain.objs.size()=1 2024-09-12T01:38:00.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.887+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.NjEOCAFbih3Tp5fDqV8Lyz4E2YHoSOL_0 2024-09-12T01:38:00.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.887+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3531632467859148382', time=2024-09-12T03:11:21.062581+0000, chain.objs.size()=1 2024-09-12T01:38:00.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.887+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.V1KimBSetNvYb9C1g-1Az5Zfe1cWE9x_0 2024-09-12T01:38:00.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.887+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5157340948940422479', time=2024-09-12T03:11:21.537742+0000, chain.objs.size()=1 2024-09-12T01:38:00.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.887+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.tguftA97YsqMgt3R0bzjfKdaJZu2Yj0_0 2024-09-12T01:38:00.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.887+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15219744863867053454', time=2024-09-12T03:11:21.867522+0000, chain.objs.size()=1 2024-09-12T01:38:00.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.887+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.CrvSh4fknzAzGJxCMxru1UBGqZWwzja_0 2024-09-12T01:38:00.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.887+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14748321348852231507', time=2024-09-12T03:11:21.998481+0000, chain.objs.size()=1 2024-09-12T01:38:00.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.887+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.i2vbSvNK8dUCGHoCLVJaea8D_djjFL6_0 2024-09-12T01:38:00.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.887+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9953265884593065019', time=2024-09-12T03:11:22.117795+0000, chain.objs.size()=1 2024-09-12T01:38:00.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.887+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.uGV6Kh5Uvu_d-Ve063hSGT87ZSvv3iN_0 2024-09-12T01:38:00.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.887+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5506374335027918703', time=2024-09-12T03:11:23.187114+0000, chain.objs.size()=1 2024-09-12T01:38:00.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.887+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.De84z_bpAifjb3-g2WzOLAVxxCclFSo_0 2024-09-12T01:38:00.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.887+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13891461965703832556', time=2024-09-12T03:11:23.769177+0000, chain.objs.size()=1 2024-09-12T01:38:00.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.887+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.nRSxnHCutr8JpQurfBMqLOuMQabg0vn_0 2024-09-12T01:38:00.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.887+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16593274185669959721', time=2024-09-12T03:11:23.822466+0000, chain.objs.size()=1 2024-09-12T01:38:00.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.887+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.f_T3nY7PMwGE_fiGDBJHSGumutnI50P_0 2024-09-12T01:38:00.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.887+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6603916308941343180', time=2024-09-12T03:11:23.839644+0000, chain.objs.size()=1 2024-09-12T01:38:00.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.887+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.ky8gK3qhZLCKLFhzSkqswjz9Vt8fdcp_0 2024-09-12T01:38:00.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.889+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7359952968195718507', time=2024-09-12T03:11:24.081071+0000, chain.objs.size()=1 2024-09-12T01:38:00.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.889+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.fAXL_BTYsjMwacu7h471pFiqxzRFyvt_0 2024-09-12T01:38:00.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.889+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3258541578385838832', time=2024-09-12T03:11:24.194595+0000, chain.objs.size()=1 2024-09-12T01:38:00.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.889+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.1ipZYpcseUYxUmOGM4XoKPcZUfD6reo_0 2024-09-12T01:38:00.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.889+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7813751105171516294', time=2024-09-12T03:11:24.247942+0000, chain.objs.size()=1 2024-09-12T01:38:00.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.889+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.McouQkQyjb33VK6JzTiDAIBcLtYEnUE_0 2024-09-12T01:38:00.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.889+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3069269499923639222', time=2024-09-12T03:11:24.535027+0000, chain.objs.size()=1 2024-09-12T01:38:00.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.889+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.F8PnUCjjGmCTd3J28x_Xu_4HDRfNT44_0 2024-09-12T01:38:00.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.889+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8944951165074442594', time=2024-09-12T03:11:24.563846+0000, chain.objs.size()=1 2024-09-12T01:38:00.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.889+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Dk8hx-TQT5VhUxBMjIHACcWZzWS8yQH_0 2024-09-12T01:38:00.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.889+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2534463361592319930', time=2024-09-12T03:11:24.789050+0000, chain.objs.size()=1 2024-09-12T01:38:00.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.889+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.KBcRIRNw2XP_67pjdCyVsewnXd8dRC9_0 2024-09-12T01:38:00.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.889+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10161882230521977167', time=2024-09-12T03:11:25.834594+0000, chain.objs.size()=1 2024-09-12T01:38:00.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.890+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.263__shadow_.sCWbHYj-1Z6TFK7s0VX4oi5uGSdNuaS_0 2024-09-12T01:38:00.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.890+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9338430165440165517', time=2024-09-12T03:11:45.881293+0000, chain.objs.size()=1 2024-09-12T01:38:00.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.890+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.284__shadow_.LLY8gAUsgocsnLFj8R4Yzl3GTIyOhnO_0 2024-09-12T01:38:00.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.890+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3022960435077229998', time=2024-09-12T03:11:49.885685+0000, chain.objs.size()=1 2024-09-12T01:38:00.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.890+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.288__shadow_.kRWondprCSSkk1CuY29Q_HHlY0H91vg_0 2024-09-12T01:38:00.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.890+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1595294308343737648', time=2024-09-12T03:11:55.333741+0000, chain.objs.size()=1 2024-09-12T01:38:00.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.890+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.292__shadow_.rngbv8vSYkF6ZuLhikZTnDKT8PhTIO0_0 2024-09-12T01:38:00.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.890+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8331776679257069326', time=2024-09-12T03:11:55.334381+0000, chain.objs.size()=1 2024-09-12T01:38:00.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.890+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.292__shadow_.rT4G1-Ed56u6Z8h87-7gmwAs_OGxUC3_0 2024-09-12T01:38:00.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.891+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10263351126564839838', time=2024-09-12T03:11:55.334940+0000, chain.objs.size()=1 2024-09-12T01:38:00.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.891+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.292__shadow_.jl0ICu8kJPhBqUBjF4RYcUlJsIDENMR_0 2024-09-12T01:38:00.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.891+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5425072355892867863', time=2024-09-12T03:11:55.420458+0000, chain.objs.size()=1 2024-09-12T01:38:00.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.891+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.292__shadow_.mjyP2U3RbrPBLzxlFQbAwnnfy0T3LrZ_0 2024-09-12T01:38:00.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.894+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15607912472837039886', time=2024-09-12T03:11:58.571984+0000, chain.objs.size()=1 2024-09-12T01:38:00.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.894+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.294__shadow_.X67ylygOLk35Yy54vzQ41ZNOZvvP5GD_0 2024-09-12T01:38:00.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.894+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10858598871309584938', time=2024-09-12T03:11:58.573158+0000, chain.objs.size()=1 2024-09-12T01:38:00.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.894+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.294__shadow_.lY5pzgZDcSEjCX3Nx1o8ucWTJshbomT_0 2024-09-12T01:38:00.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.894+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8741600722186654684', time=2024-09-12T03:12:06.627259+0000, chain.objs.size()=1 2024-09-12T01:38:00.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.894+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.302__shadow_.JrJfYq73DpV-QnYTi6BL8WL1WAW2UJx_0 2024-09-12T01:38:00.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.895+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.862695741767407168', time=2024-09-12T03:13:06.834863+0000, chain.objs.size()=1 2024-09-12T01:38:00.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.895+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.Dj-549vsHE_eTAJDmH-_icuKVTR4vZm_0 2024-09-12T01:38:00.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.895+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4936190561996770139', time=2024-09-12T03:13:06.835856+0000, chain.objs.size()=1 2024-09-12T01:38:00.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.895+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.B7ofB8a9m1aemiz5Hqcodm1c1xiUv5f_0 2024-09-12T01:38:00.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.895+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13280457761024382353', time=2024-09-12T03:13:07.387076+0000, chain.objs.size()=1 2024-09-12T01:38:00.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.895+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.SRl7a5ZwqYlAsXEsrzy-644_qch2QPG_0 2024-09-12T01:38:00.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.895+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.301459913776801983', time=2024-09-12T03:13:07.760473+0000, chain.objs.size()=1 2024-09-12T01:38:00.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.895+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.abKUzI2N2jlmjzM-JZ8BAnh46ArDxRh_0 2024-09-12T01:38:00.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.895+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2792015874096977852', time=2024-09-12T03:13:08.326545+0000, chain.objs.size()=1 2024-09-12T01:38:00.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.895+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.WqAZj3vHzDH2cHz-TthfKm2SIIKD1gU_0 2024-09-12T01:38:00.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.895+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15252209695524762703', time=2024-09-12T03:13:08.454606+0000, chain.objs.size()=1 2024-09-12T01:38:00.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.895+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.ACb6zUl2n8SiSavS3tEg2JEBrXNXlEO_0 2024-09-12T01:38:00.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.895+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5915436365339212482', time=2024-09-12T03:13:08.680439+0000, chain.objs.size()=1 2024-09-12T01:38:00.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.895+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.nZGElNqpHl2MrrRWFnoa3BxzfG8Qbml_0 2024-09-12T01:38:00.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.897+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4503413241796441919', time=2024-09-12T03:13:08.853605+0000, chain.objs.size()=1 2024-09-12T01:38:00.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.897+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.gcUdcTahCDTZSMdrDM-m0Ml9x0h_nVn_0 2024-09-12T01:38:00.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.901+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1877422072998883372', time=2024-09-12T03:13:08.938575+0000, chain.objs.size()=1 2024-09-12T01:38:00.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.901+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.CvjjirR_RI9TWCb66zSOTZuaytlxhCw_0 2024-09-12T01:38:00.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.901+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4525993257718414332', time=2024-09-12T03:13:09.726090+0000, chain.objs.size()=1 2024-09-12T01:38:00.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.901+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.9mJDfrqTqredjMrWjp5x8VNIKdwFkDc_0 2024-09-12T01:38:00.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.901+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3486578838220148347', time=2024-09-12T03:13:09.927870+0000, chain.objs.size()=1 2024-09-12T01:38:00.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.901+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.JJqNxut5FV3wn3Qekih7ttzUESz6jfI_0 2024-09-12T01:38:00.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.901+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15356031010809002794', time=2024-09-12T03:13:10.384059+0000, chain.objs.size()=1 2024-09-12T01:38:00.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.901+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.46y1N0Jx9D883L6m4LMuRdiTgPcZu2t_0 2024-09-12T01:38:00.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.901+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14551236689511552765', time=2024-09-12T03:13:10.450833+0000, chain.objs.size()=1 2024-09-12T01:38:00.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.901+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.b9xeKUk-oVaoJwjp5dtCnRn_aleAvnt_0 2024-09-12T01:38:00.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.901+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3137575854296565244', time=2024-09-12T03:13:10.681598+0000, chain.objs.size()=1 2024-09-12T01:38:00.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.901+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.uORe2Bes517jhulrkP3n4Ij38bhKu_v_0 2024-09-12T01:38:00.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.901+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14645963877251879702', time=2024-09-12T03:13:11.135571+0000, chain.objs.size()=1 2024-09-12T01:38:00.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.901+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.Ex1vp2b53KYuBZTjs5eGzYMT4QMsWOW_0 2024-09-12T01:38:00.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.901+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4757527159395550946', time=2024-09-12T03:13:11.252142+0000, chain.objs.size()=1 2024-09-12T01:38:00.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.901+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.30xUIcdJYS9Rsz1YqIJ_haJRwaappSw_0 2024-09-12T01:38:00.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.901+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10993403251528865254', time=2024-09-12T03:13:11.565856+0000, chain.objs.size()=1 2024-09-12T01:38:00.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.901+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.ZtGXTs0AFkQQr6lXrTvO-A0HLVhWiUj_0 2024-09-12T01:38:00.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.901+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14920297173047350090', time=2024-09-12T03:13:11.613169+0000, chain.objs.size()=1 2024-09-12T01:38:00.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.901+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.oFomgf-7rmedfjR_NpqzxSA3emjJRkT_0 2024-09-12T01:38:00.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.902+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14618338493700303433', time=2024-09-12T03:13:11.695050+0000, chain.objs.size()=1 2024-09-12T01:38:00.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.902+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.uHCDY6FLbZVOqZ5Ayg91gpKVC6sR4nT_0 2024-09-12T01:38:00.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.902+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16098797564678336755', time=2024-09-12T03:13:11.749115+0000, chain.objs.size()=1 2024-09-12T01:38:00.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.902+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.MRwfN5Iftuz0gidMOAkvsSIm7NsdL7I_0 2024-09-12T01:38:00.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.903+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5091654036162717156', time=2024-09-12T03:13:11.828085+0000, chain.objs.size()=1 2024-09-12T01:38:00.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.903+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.f-FVx-_w6_4Vy6smKGjEnHvf1uq6QrQ_0 2024-09-12T01:38:00.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.903+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3123729686209973922', time=2024-09-12T03:13:11.828814+0000, chain.objs.size()=1 2024-09-12T01:38:00.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.903+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.1TbOCAXtGUGERwy9A4OD2nZPHWlnKpa_0 2024-09-12T01:38:00.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.904+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13724169431971889798', time=2024-09-12T03:13:12.675576+0000, chain.objs.size()=1 2024-09-12T01:38:00.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.904+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.hvYoXRshePQm-O7jpJAOwCnW2T18R98_0 2024-09-12T01:38:00.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.904+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3501127286199931053', time=2024-09-12T03:13:12.837738+0000, chain.objs.size()=1 2024-09-12T01:38:00.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.904+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.FwPX-sxu9WuUuTkpT3i8rLrLdeacLxz_0 2024-09-12T01:38:00.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.904+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18227740957436737342', time=2024-09-12T03:13:13.372778+0000, chain.objs.size()=1 2024-09-12T01:38:00.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.904+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.Y0OA--cj-lOPt3rFVbrZQamspTiFVK7_0 2024-09-12T01:38:00.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.904+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7852088650483402597', time=2024-09-12T03:13:13.373339+0000, chain.objs.size()=1 2024-09-12T01:38:00.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.904+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.YHs2lmO2tX94OY52R3Q85x9Z-w_hrw3_0 2024-09-12T01:38:00.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.904+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14167045480428094990', time=2024-09-12T03:13:13.993105+0000, chain.objs.size()=1 2024-09-12T01:38:00.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.904+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.oz_JPCh_eO7ZXwnbMsFyHL7VywTWbaD_0 2024-09-12T01:38:00.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.904+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3648930151651956389', time=2024-09-12T03:13:14.474879+0000, chain.objs.size()=1 2024-09-12T01:38:00.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.904+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.adNywT2OYA9Tm-PhR6H9SgYQK7TC5WA_0 2024-09-12T01:38:00.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.904+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1583612719781383483', time=2024-09-12T03:13:15.454177+0000, chain.objs.size()=1 2024-09-12T01:38:00.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.904+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.KRdaJyCESwJ5qZYRH6ZPA8H7NPghisv_0 2024-09-12T01:38:00.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.904+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10471207779175949647', time=2024-09-12T03:13:15.779636+0000, chain.objs.size()=1 2024-09-12T01:38:00.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.904+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.R1aMQs45LyFHv18I_U_TNOMt4g047yh_0 2024-09-12T01:38:00.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.904+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11479448927476535938', time=2024-09-12T03:13:15.837351+0000, chain.objs.size()=1 2024-09-12T01:38:00.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.904+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.rzrBaaulwBIPTW41oERBoSvvgjaTeBf_0 2024-09-12T01:38:00.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.905+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4509999614948693998', time=2024-09-12T03:13:16.779532+0000, chain.objs.size()=1 2024-09-12T01:38:00.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.905+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.GZ8qliUNIR4itKm8tN9OqIFTDytbdsF_0 2024-09-12T01:38:00.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.905+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2776730760446750326', time=2024-09-12T03:13:54.122729+0000, chain.objs.size()=1 2024-09-12T01:38:00.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.905+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.WPdECJ0ZRAmKOWZ5l8ROeFmyRz2ohl2_0 2024-09-12T01:38:00.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.906+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14725452629411825521', time=2024-09-12T03:13:54.168297+0000, chain.objs.size()=1 2024-09-12T01:38:00.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.906+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.ut0bpZoWBkt_JLNaEd-V1_ZF_pdYqnD_0 2024-09-12T01:38:00.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.906+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14603411800023215672', time=2024-09-12T03:13:54.198423+0000, chain.objs.size()=1 2024-09-12T01:38:00.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.906+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.mYMhFrOc5hFTEssyrJoExX9NqNbd_Ef_0 2024-09-12T01:38:00.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.906+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7806295438868342568', time=2024-09-12T03:13:54.330039+0000, chain.objs.size()=1 2024-09-12T01:38:00.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.906+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.TNO6kPLmpgn4xZLjfdInRpH2CZNuF-N_0 2024-09-12T01:38:00.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.906+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18106696145200780670', time=2024-09-12T03:13:55.720916+0000, chain.objs.size()=1 2024-09-12T01:38:00.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.906+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.JpDn5pWekIuqHuKjZCBLrwa1uTwV9PU_0 2024-09-12T01:38:00.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.906+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3750352764765039198', time=2024-09-12T03:13:56.043266+0000, chain.objs.size()=1 2024-09-12T01:38:00.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.906+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.C5pQCT5ed74pacoiJQEDpXImeIfjJ1H_0 2024-09-12T01:38:00.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.906+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2850361408398117656', time=2024-09-12T03:13:56.719273+0000, chain.objs.size()=1 2024-09-12T01:38:00.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.906+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.4EFvKDTd36_RHl56IS83fuvdfLEEJtN_0 2024-09-12T01:38:00.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.908+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13663742220254000449', time=2024-09-12T03:13:57.027760+0000, chain.objs.size()=1 2024-09-12T01:38:00.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.908+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.h-x6bdYNOQJjjHWaO3wxM8bPMVjszvV_0 2024-09-12T01:38:00.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.909+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 0/47999 2024-09-12T01:38:00.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.912+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=32, truncated=0, next_marker='' 2024-09-12T01:38:00.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.912+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5503757807590829531', time=2024-09-12T03:13:57.324067+0000, chain.objs.size()=1 2024-09-12T01:38:00.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.912+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.jnZo6HI7I9HtnAgzwlXBPiwYSQQWmcv_0 2024-09-12T01:38:00.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.912+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11208634873818643214', time=2024-09-12T03:13:58.143015+0000, chain.objs.size()=1 2024-09-12T01:38:00.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.912+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.nD0vVlIAsBIIPpag__gounJPgfIMTkC_0 2024-09-12T01:38:00.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.912+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15076552196552802442', time=2024-09-12T03:13:58.440301+0000, chain.objs.size()=1 2024-09-12T01:38:00.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.912+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.GC71t6rnLOQPM1dFVPWxcAZUpIwO-wI_0 2024-09-12T01:38:00.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.912+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14400833269730790865', time=2024-09-12T03:13:58.560980+0000, chain.objs.size()=1 2024-09-12T01:38:00.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.912+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.-mnM2q6G7gKKxOGbESAjz0v8ymambK5_0 2024-09-12T01:38:00.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.912+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.832336459141466206', time=2024-09-12T03:13:59.160073+0000, chain.objs.size()=1 2024-09-12T01:38:00.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.912+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Befw2opmY5zs6-cGRdyakJwDalnfYow_0 2024-09-12T01:38:00.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.912+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6541022265600441930', time=2024-09-12T03:13:59.465805+0000, chain.objs.size()=1 2024-09-12T01:38:00.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.912+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Z9NzhEAgaOvlNTboZ4y7w-RLfha8dmk_0 2024-09-12T01:38:00.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.912+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12900750288072022638', time=2024-09-12T03:13:59.701873+0000, chain.objs.size()=1 2024-09-12T01:38:00.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.912+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.rRwravQkIBZlQUX9IMqfl2jZ-Ac2OzH_0 2024-09-12T01:38:00.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.912+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8261276988181340024', time=2024-09-12T03:13:59.854030+0000, chain.objs.size()=1 2024-09-12T01:38:00.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.912+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.XhyNmpoenOAzSarkHguJUMEldeLPvpW_0 2024-09-12T01:38:00.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.912+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14072451635285912535', time=2024-09-12T03:13:59.909036+0000, chain.objs.size()=1 2024-09-12T01:38:00.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.912+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.nuERl9v_mfxTTPyYAA05bJSeLMJ7La5_0 2024-09-12T01:38:00.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.912+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5657629625288410255', time=2024-09-12T03:13:59.913181+0000, chain.objs.size()=1 2024-09-12T01:38:00.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.912+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.oUjSVF2xKnHuctbJ31L9ZVa5aNVbvPQ_0 2024-09-12T01:38:00.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.912+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12241549213175360019', time=2024-09-12T03:13:59.941299+0000, chain.objs.size()=1 2024-09-12T01:38:00.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.912+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.5W9_Oj7ozw3F1hCM7wbBb2sjiYmeSO6_0 2024-09-12T01:38:00.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.912+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14975658459113799014', time=2024-09-12T03:13:59.941949+0000, chain.objs.size()=1 2024-09-12T01:38:00.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.912+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.I9Px4V3pT-1f_8PzTynwkIhS3sOQ-0s_0 2024-09-12T01:38:00.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.914+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17797444702492440314', time=2024-09-12T03:14:00.623594+0000, chain.objs.size()=1 2024-09-12T01:38:00.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.914+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.WeBBD37bT2DGgXEe4d4SmtyCWKezxIU_0 2024-09-12T01:38:00.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.916+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12772441742385895921', time=2024-09-12T03:14:01.123709+0000, chain.objs.size()=1 2024-09-12T01:38:00.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.916+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.jCjETEgJOEzy-kFi9PQnrB7C2wy_V5s_0 2024-09-12T01:38:00.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.916+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17775636403743306587', time=2024-09-12T03:14:01.948031+0000, chain.objs.size()=1 2024-09-12T01:38:00.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.916+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Va7pNvhNS1ii0RY921-3C7SSRPNYvjv_0 2024-09-12T01:38:00.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.916+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4770496777927189934', time=2024-09-12T03:14:02.417276+0000, chain.objs.size()=1 2024-09-12T01:38:00.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.916+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.JMwHTnBdPuZ7PGlVepm7LVkxePOFNRW_0 2024-09-12T01:38:00.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.916+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14025968390972744581', time=2024-09-12T03:14:02.527057+0000, chain.objs.size()=1 2024-09-12T01:38:00.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.916+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.XBkgo6gF2Q_V7eFV42JN3VdkHKdn3eL_0 2024-09-12T01:38:00.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.916+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14598152910718570932', time=2024-09-12T03:14:02.949771+0000, chain.objs.size()=1 2024-09-12T01:38:00.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.916+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.G5JMzgrT-xDs_H5zbMCmRAirYSPqyKi_0 2024-09-12T01:38:00.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.916+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.417099817414812180', time=2024-09-12T03:14:03.065405+0000, chain.objs.size()=1 2024-09-12T01:38:00.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.916+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.v-bq8y0zK2VvX5drAUUH-sDsRiFRZ-c_0 2024-09-12T01:38:00.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.916+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4799541753768303165', time=2024-09-12T03:14:03.082746+0000, chain.objs.size()=1 2024-09-12T01:38:00.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.916+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.RJt2Fw1kxHzsHdaJxj8icVFkWR3mX4y_0 2024-09-12T01:38:00.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.916+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.778778360485487722', time=2024-09-12T03:14:03.560839+0000, chain.objs.size()=1 2024-09-12T01:38:00.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.916+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.PNW04cq7gnvpNKgBzphpoz4EtyR1u1j_0 2024-09-12T01:38:00.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.916+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11947158280327646417', time=2024-09-12T03:14:21.375113+0000, chain.objs.size()=1 2024-09-12T01:38:00.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.916+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.343__shadow_.bUfcjTk9rBwxZXBnIhlR11v62qb9Fag_0 2024-09-12T01:38:00.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.916+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1984029757236039499', time=2024-09-12T03:14:48.301652+0000, chain.objs.size()=1 2024-09-12T01:38:00.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.916+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.374__shadow_.2znc2DfPc4vxRJjeJiMsuM5zKXtyQX1_0 2024-09-12T01:38:00.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.916+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16425695780972714510', time=2024-09-12T03:15:50.886806+0000, chain.objs.size()=1 2024-09-12T01:38:00.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.916+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.439__shadow_.Z-g1oJRdFiRH9L8CKRVpFkSiRPVMpw6_0 2024-09-12T01:38:00.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.919+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8996237027860974578', time=2024-09-12T03:16:50.454186+0000, chain.objs.size()=1 2024-09-12T01:38:00.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.919+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.497__shadow_.9sLB_Krfa9LaZ7p_I7rU3ZrVQ9pjgMq_0 2024-09-12T01:38:00.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.919+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3750700868146002751', time=2024-09-12T03:16:55.881447+0000, chain.objs.size()=1 2024-09-12T01:38:00.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.919+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.503__shadow:zjHxI5MExGDTEMgC.YI1-B-Wp2XBZjW_.xteVVbi5oDy4c1uLu1Qcooxbp-bOuaB_0 2024-09-12T01:38:00.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.920+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4710014940240277624', time=2024-09-12T03:19:23.403113+0000, chain.objs.size()=6 2024-09-12T01:38:00.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.920+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.522__multipart_mymultipart.2~4WjXOANFZiABAM1-GiRAiDQR4yKaHVo.1 2024-09-12T01:38:00.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.920+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.522__multipart_mymultipart._z8g-O25MYDLbuJW3r9B5rcHy5nhdkFF.2 2024-09-12T01:38:00.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.920+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.522__multipart_mymultipart.2~4WjXOANFZiABAM1-GiRAiDQR4yKaHVo.3 2024-09-12T01:38:00.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.920+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.522__multipart_mymultipart.2~4WjXOANFZiABAM1-GiRAiDQR4yKaHVo.4 2024-09-12T01:38:00.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.920+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.522__multipart_mymultipart.2~4WjXOANFZiABAM1-GiRAiDQR4yKaHVo.5 2024-09-12T01:38:00.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.920+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.522__multipart_mymultipart.2~4WjXOANFZiABAM1-GiRAiDQR4yKaHVo.6 2024-09-12T01:38:00.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.920+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11653037769326993193', time=2024-09-12T03:21:46.749535+0000, chain.objs.size()=1 2024-09-12T01:38:00.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.920+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.536__multipart_mymultipart.2~NzXcHaQYNy9XQBmaS5vhS9iu4nUoqrK.1 2024-09-12T01:38:00.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.920+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4076372896041657530', time=2024-09-12T03:24:29.957526+0000, chain.objs.size()=4 2024-09-12T01:38:00.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.920+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.578__multipart_testobj.2~yyBblnPgM_lN1hxUjvrtD8-C4XCE6sQ.1 2024-09-12T01:38:00.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.920+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.578__multipart_testobj.2~yyBblnPgM_lN1hxUjvrtD8-C4XCE6sQ.2 2024-09-12T01:38:00.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.922+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.578__multipart_testobj.2~yyBblnPgM_lN1hxUjvrtD8-C4XCE6sQ.3 2024-09-12T01:38:00.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.922+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.578__multipart_testobj.2~yyBblnPgM_lN1hxUjvrtD8-C4XCE6sQ.4 2024-09-12T01:38:00.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.922+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18341156823705468171', time=2024-09-12T03:24:38.945853+0000, chain.objs.size()=1 2024-09-12T01:38:00.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.922+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.580__shadow:y5nyAE92iruKUZQ05jeXEW8p0g-Gkk._.LmWQDL3edT5cF7DwWasYK51_r9YPxUP_0 2024-09-12T01:38:00.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.922+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8144196831151951358', time=2024-09-12T03:31:28.274913+0000, chain.objs.size()=1 2024-09-12T01:38:00.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.922+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.699__shadow:xf6uZk2A4Ql9Wa7ePFuBnarh1aDJSWi_.vVzVfPQOahgOiK9vpaBTsk1ebEb7_m9_0 2024-09-12T01:38:00.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.923+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14445501609871000005', time=2024-09-12T03:32:33.685556+0000, chain.objs.size()=10 2024-09-12T01:38:00.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.923+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.735__multipart_foo.2~3LoVbSSMLOZe27tNz9oTCmtiJRnLpL-.1 2024-09-12T01:38:00.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.923+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.735__multipart_foo.2~3LoVbSSMLOZe27tNz9oTCmtiJRnLpL-.2 2024-09-12T01:38:00.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.923+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.735__multipart_foo.2~3LoVbSSMLOZe27tNz9oTCmtiJRnLpL-.3 2024-09-12T01:38:00.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.923+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.735__multipart_foo.2~3LoVbSSMLOZe27tNz9oTCmtiJRnLpL-.4 2024-09-12T01:38:00.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.923+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.735__multipart_foo.2~3LoVbSSMLOZe27tNz9oTCmtiJRnLpL-.5 2024-09-12T01:38:00.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.923+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.735__multipart_foo.2~3LoVbSSMLOZe27tNz9oTCmtiJRnLpL-.6 2024-09-12T01:38:00.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.923+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.735__multipart_foo.2~3LoVbSSMLOZe27tNz9oTCmtiJRnLpL-.7 2024-09-12T01:38:00.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.923+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.735__multipart_foo.2~3LoVbSSMLOZe27tNz9oTCmtiJRnLpL-.8 2024-09-12T01:38:00.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.924+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.735__multipart_foo.2~3LoVbSSMLOZe27tNz9oTCmtiJRnLpL-.9 2024-09-12T01:38:00.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.924+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.735__multipart_foo.2~3LoVbSSMLOZe27tNz9oTCmtiJRnLpL-.10 2024-09-12T01:38:00.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.925+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:38:00.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.927+0000 7f8786c98800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T01:38:00.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.929+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:38:00.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.929+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:38:00.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.930+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44277' 2024-09-12T01:38:00.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.930+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.642842451539935411', time=2024-09-12T03:06:48.316974+0000, chain.objs.size()=2 2024-09-12T01:38:00.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.930+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.160__shadow_.UTGmJD5VZfu_bdrz77z9tdkkQJlEept_0 2024-09-12T01:38:00.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.930+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.160__shadow_.UTGmJD5VZfu_bdrz77z9tdkkQJlEept_1 2024-09-12T01:38:00.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.930+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.546649010620228728', time=2024-09-12T03:10:05.812564+0000, chain.objs.size()=1 2024-09-12T01:38:00.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.930+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.230__shadow_.Az-A7e9Zsg8yvxXF4KZHwP14Pw5JImJ_0 2024-09-12T01:38:00.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.930+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17477914974720346750', time=2024-09-12T03:10:13.317056+0000, chain.objs.size()=1 2024-09-12T01:38:00.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.930+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.237__shadow_.IF67J56WafoQ9zqvAVuGS6y57sdZKA6_0 2024-09-12T01:38:00.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.930+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3818254480660092795', time=2024-09-12T03:10:16.665624+0000, chain.objs.size()=1 2024-09-12T01:38:00.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.930+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.240__shadow_.P6f8zDRnP_RagwqygIz-E8NxprYtwpY_0 2024-09-12T01:38:00.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.930+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11292357075226874043', time=2024-09-12T03:10:31.720128+0000, chain.objs.size()=1 2024-09-12T01:38:00.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.930+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.254__shadow_.6NqRIVl_u3vsSazFXEvwBvPMixGMqmk_0 2024-09-12T01:38:00.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.930+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2111719144181542262', time=2024-09-12T03:10:35.527825+0000, chain.objs.size()=1 2024-09-12T01:38:00.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.930+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.258__shadow_.QjoLcIfpu29Wx7ZSXojZ4GCn_h7i83Y_0 2024-09-12T01:38:00.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.930+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18058364469937598472', time=2024-09-12T03:11:14.543116+0000, chain.objs.size()=1 2024-09-12T01:38:00.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.930+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.pkN-5hYOwm-q93WGPRc8fwMFQE42lho_0 2024-09-12T01:38:00.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.930+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9572918181625602902', time=2024-09-12T03:11:14.676221+0000, chain.objs.size()=1 2024-09-12T01:38:00.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.930+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.JBjySB3-1loOiydRK8O1liGvt4rzQ3H_0 2024-09-12T01:38:00.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.930+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10794307589011362003', time=2024-09-12T03:11:14.972979+0000, chain.objs.size()=1 2024-09-12T01:38:00.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.930+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.bjfI_3t2iSD2yk9sxgqChG1RJsP7dwH_0 2024-09-12T01:38:00.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.930+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5936192199886285927', time=2024-09-12T03:11:15.382235+0000, chain.objs.size()=1 2024-09-12T01:38:00.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.930+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.u_aDpTnxkd3bHBcMDGg8b-D4cdEnGI-_0 2024-09-12T01:38:00.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.930+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11879721431708186889', time=2024-09-12T03:11:16.341831+0000, chain.objs.size()=1 2024-09-12T01:38:00.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.930+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.d-mwJJnaFbO-IgOZPGNiWBkWptuBoYx_0 2024-09-12T01:38:00.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.933+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9681946826876111656', time=2024-09-12T03:11:16.374145+0000, chain.objs.size()=1 2024-09-12T01:38:00.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.933+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.VYSaU_ILZ48OLCvUfnTouVK9QVPBWAb_0 2024-09-12T01:38:00.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.933+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1978616990933918691', time=2024-09-12T03:11:17.581500+0000, chain.objs.size()=1 2024-09-12T01:38:00.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.933+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.aPOhCMf01CpOuHnXfq4nddf56TKCjJX_0 2024-09-12T01:38:00.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.933+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5571920676720971552', time=2024-09-12T03:11:17.765817+0000, chain.objs.size()=1 2024-09-12T01:38:00.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.933+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.GkWYHM_YOLVGnFVNuRWY2OtCf60SD3Z_0 2024-09-12T01:38:00.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.933+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8647129849362895562', time=2024-09-12T03:11:18.035431+0000, chain.objs.size()=1 2024-09-12T01:38:00.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.933+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.1E5EkKtjDwEeZESvDP8abTDbUH6jQpl_0 2024-09-12T01:38:00.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.933+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16827273553159786515', time=2024-09-12T03:11:18.197507+0000, chain.objs.size()=1 2024-09-12T01:38:00.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.933+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.QYCucKahyyq2IZM_0K8BtSFxmdbq4t1_0 2024-09-12T01:38:00.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.933+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9260815034410547632', time=2024-09-12T03:11:18.406549+0000, chain.objs.size()=1 2024-09-12T01:38:00.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.933+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.wLODmbq7iZ6rlZrsQz4mDw_p5RJr_DP_0 2024-09-12T01:38:00.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.933+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18058619307373871429', time=2024-09-12T03:11:19.235927+0000, chain.objs.size()=1 2024-09-12T01:38:00.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.933+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.vfFvmjddjNv26tTD3bTXqXfyIeCkVFv_0 2024-09-12T01:38:00.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.933+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4879081090301436205', time=2024-09-12T03:11:19.378122+0000, chain.objs.size()=1 2024-09-12T01:38:00.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.933+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.qQ5Bf5uJh8AAD4yq77OorgZryakdWv1_0 2024-09-12T01:38:00.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.933+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1918461465940856537', time=2024-09-12T03:11:19.629497+0000, chain.objs.size()=1 2024-09-12T01:38:00.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.933+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.0QubkbW4Qzj8RTFWvl94mDFt4iNSza9_0 2024-09-12T01:38:00.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.933+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11655594823886553789', time=2024-09-12T03:11:19.721531+0000, chain.objs.size()=1 2024-09-12T01:38:00.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.933+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.GU5Uq6jPxE5wHttueweKVCR8IGXLRE4_0 2024-09-12T01:38:00.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.933+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11241146252548671238', time=2024-09-12T03:11:20.364694+0000, chain.objs.size()=1 2024-09-12T01:38:00.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.933+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.L9esDGTYi6GQov7a7W9fy32NxmGgMeb_0 2024-09-12T01:38:00.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.935+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15849436424214594888', time=2024-09-12T03:11:20.553116+0000, chain.objs.size()=1 2024-09-12T01:38:00.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.935+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.O0kEhyhROGvQv2tE_LEEvpghW_tWkQo_0 2024-09-12T01:38:00.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.935+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1639601582790265733', time=2024-09-12T03:11:20.815873+0000, chain.objs.size()=1 2024-09-12T01:38:00.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.935+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.BQ8NuL9VJZB49CY3Ycgm7qj6roY-VSb_0 2024-09-12T01:38:00.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.935+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12235909441042853940', time=2024-09-12T03:11:20.816439+0000, chain.objs.size()=1 2024-09-12T01:38:00.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.935+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.2Ll4JKGs38Be_hz68dp9zvyp6TcFZJv_0 2024-09-12T01:38:00.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.935+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12867463296603334186', time=2024-09-12T03:11:21.048817+0000, chain.objs.size()=1 2024-09-12T01:38:00.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.935+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.adXG-JNf-wAn4hgV-4tvOOmZ4_KANWr_0 2024-09-12T01:38:00.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.935+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11425281041771876780', time=2024-09-12T03:11:21.172831+0000, chain.objs.size()=1 2024-09-12T01:38:00.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.935+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.FiwoqSDmLFXcD4PhGKfQTnm_VLMQU1T_0 2024-09-12T01:38:00.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.935+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7328133361639148532', time=2024-09-12T03:11:21.947885+0000, chain.objs.size()=1 2024-09-12T01:38:00.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.935+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.jDalMm112gz-ExUmHGRDb7tWiZtgsfs_0 2024-09-12T01:38:00.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.935+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14367246639671378970', time=2024-09-12T03:11:22.111425+0000, chain.objs.size()=1 2024-09-12T01:38:00.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.935+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.YbQUVXd8s3GNQyuoL2vpc-3bGRM-_KX_0 2024-09-12T01:38:00.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.935+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11202302889275069415', time=2024-09-12T03:11:22.114549+0000, chain.objs.size()=1 2024-09-12T01:38:00.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.935+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.ct4tYYM76x5WynPiabbRpwR52biwr2n_0 2024-09-12T01:38:00.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.936+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13109456253489856188', time=2024-09-12T03:11:22.141632+0000, chain.objs.size()=1 2024-09-12T01:38:00.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.936+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.hqWqvEzIoiHTlmpduaDMOc0eeBT-JKX_0 2024-09-12T01:38:00.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.936+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4225594196280458855', time=2024-09-12T03:11:22.446172+0000, chain.objs.size()=1 2024-09-12T01:38:00.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.936+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.svU6ZcVxIj0yo99zPKOXYrpSR-ogdf5_0 2024-09-12T01:38:00.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.936+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12488513421008334682', time=2024-09-12T03:11:23.656660+0000, chain.objs.size()=1 2024-09-12T01:38:00.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.936+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.K0ieK1FkCvW1K4q3_zJ07Jdl9aRV1cB_0 2024-09-12T01:38:00.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.936+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18082812426851217440', time=2024-09-12T03:11:24.567786+0000, chain.objs.size()=1 2024-09-12T01:38:00.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.936+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.b1FbUY5mq2FwOa_gPuxifTSvt7fzBbe_0 2024-09-12T01:38:00.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.936+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18241939029980094027', time=2024-09-12T03:11:24.640811+0000, chain.objs.size()=1 2024-09-12T01:38:00.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.936+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.mO1wHwPjzy6fJUcVa86NncCbezjcrMb_0 2024-09-12T01:38:00.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.936+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11102086125583902413', time=2024-09-12T03:11:24.686633+0000, chain.objs.size()=1 2024-09-12T01:38:00.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.936+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.IPyVysL-mZ-XIV7wTOu-ExbtH0NRptq_0 2024-09-12T01:38:00.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.937+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14338943895821884735', time=2024-09-12T03:11:24.725120+0000, chain.objs.size()=1 2024-09-12T01:38:00.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.937+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.0iaUPCxejl8TeGdLKdKgDDSaohKOKF-_0 2024-09-12T01:38:00.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.937+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10795476484245499392', time=2024-09-12T03:11:24.852229+0000, chain.objs.size()=1 2024-09-12T01:38:00.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.937+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.06InDMbRd8BidFwjsGN59e84IXUzE9E_0 2024-09-12T01:38:00.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.937+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16080287448665116166', time=2024-09-12T03:11:25.840180+0000, chain.objs.size()=1 2024-09-12T01:38:00.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.937+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.263__shadow_.wGvlh2KEpjfZ_ul0Eu5QnjXZsAc5FmG_0 2024-09-12T01:38:00.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.937+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5837230684569988703', time=2024-09-12T03:11:35.218427+0000, chain.objs.size()=1 2024-09-12T01:38:00.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.937+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.273__shadow_.BrD73MroFXBTnpQgbYW_rlo6Ik_Wp8y_0 2024-09-12T01:38:00.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.937+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12434374670442338181', time=2024-09-12T03:11:39.074709+0000, chain.objs.size()=1 2024-09-12T01:38:00.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.937+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.277__shadow_.0JE_txszwlduR9bC1uR7abK3mGcQCMh_0 2024-09-12T01:38:00.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.937+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7178870958241659981', time=2024-09-12T03:11:41.007305+0000, chain.objs.size()=1 2024-09-12T01:38:00.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.937+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.279__shadow_.H0V3VQlIfA59bW_xiHeyoMU0gWgE5KK_0 2024-09-12T01:38:00.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.938+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2667090792684770615', time=2024-09-12T03:11:44.887859+0000, chain.objs.size()=1 2024-09-12T01:38:00.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.938+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.283__shadow_.InIa_jPGPyO9jkyrFS_pmgY8t71NCzY_0 2024-09-12T01:38:00.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.938+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6990753665935638356', time=2024-09-12T03:11:51.803288+0000, chain.objs.size()=1 2024-09-12T01:38:00.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.938+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.290__shadow_.EFQggaOJhH2cxs-QYxn1V6QgN-seE8e_0 2024-09-12T01:38:00.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.939+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15524058032645897417', time=2024-09-12T03:11:55.288469+0000, chain.objs.size()=1 2024-09-12T01:38:00.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.939+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.292__shadow_.Z31na027A_MGa2Y21vN2dLeHVj_T-1g_0 2024-09-12T01:38:00.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.939+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13468247928881399394', time=2024-09-12T03:11:55.289381+0000, chain.objs.size()=1 2024-09-12T01:38:00.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.939+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.292__shadow_.dH2AzPrZb2bJ4HzsOfOXVf4SYnK-upc_0 2024-09-12T01:38:00.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.939+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12453422421783985938', time=2024-09-12T03:12:02.677462+0000, chain.objs.size()=1 2024-09-12T01:38:00.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.939+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.298__shadow_.RliRsR5cqOs2uCWLyJYUvhdUQHQJPrl_0 2024-09-12T01:38:00.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.939+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10631253920523846722', time=2024-09-12T03:12:05.633874+0000, chain.objs.size()=1 2024-09-12T01:38:00.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.939+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.301__shadow_.u-2Yj2RKWTEICaGz_gEO4ZOwtG4WXDd_0 2024-09-12T01:38:00.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.939+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5463356430590958113', time=2024-09-12T03:12:09.496359+0000, chain.objs.size()=1 2024-09-12T01:38:00.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.939+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.305__shadow_.Vv4DaZ5UL_afYt7T2FVu9nVD03SvHXz_0 2024-09-12T01:38:00.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.939+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14878749728743156673', time=2024-09-12T03:12:30.055221+0000, chain.objs.size()=1 2024-09-12T01:38:00.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.939+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.322__shadow_.2nqeeUiZiJHvqvjIzzMv3R9BXMDkW1__0 2024-09-12T01:38:00.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.939+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6486654847038692730', time=2024-09-12T03:13:07.251415+0000, chain.objs.size()=1 2024-09-12T01:38:00.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.939+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.BaD7c0P4pnoSAKc_ooDGPMXRtLkDgnp_0 2024-09-12T01:38:00.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.939+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3518540338721666650', time=2024-09-12T03:13:07.392334+0000, chain.objs.size()=1 2024-09-12T01:38:00.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.939+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.PovcN4nlGaGPbTibqRhrsybMiJ4RPpi_0 2024-09-12T01:38:00.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.939+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6189031213038862060', time=2024-09-12T03:13:07.450933+0000, chain.objs.size()=1 2024-09-12T01:38:00.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.939+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.hJNzN6hpSxHNTRowNEaLjoVhgNR1trC_0 2024-09-12T01:38:00.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.940+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11493641193178650905', time=2024-09-12T03:13:08.303084+0000, chain.objs.size()=1 2024-09-12T01:38:00.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.940+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.QHTOkphXY_0I7zj_pS4tGA-YVXfNG1e_0 2024-09-12T01:38:00.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.940+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15299464341328185946', time=2024-09-12T03:13:08.483175+0000, chain.objs.size()=1 2024-09-12T01:38:00.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.940+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.H1kSSq2YB-G_tAjKm5eZsO74rcNq0iB_0 2024-09-12T01:38:00.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.941+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9179906926186081068', time=2024-09-12T03:13:08.836070+0000, chain.objs.size()=1 2024-09-12T01:38:00.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.941+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.PdmkjxK1CWRnig2MsQhqkk_ajUoMizE_0 2024-09-12T01:38:00.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.941+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9042352158383957925', time=2024-09-12T03:13:09.708517+0000, chain.objs.size()=1 2024-09-12T01:38:00.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.941+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.g0DXDjcf8n9Rd4F7JKdjMXAEKI_2bD6_0 2024-09-12T01:38:00.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.941+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16256740433344928917', time=2024-09-12T03:13:10.022827+0000, chain.objs.size()=1 2024-09-12T01:38:00.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.941+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.Nd6OMzdI5qxDEzzTid2764gCjrDai2f_0 2024-09-12T01:38:00.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.941+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9495901284092228551', time=2024-09-12T03:13:10.338233+0000, chain.objs.size()=1 2024-09-12T01:38:00.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.941+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.ZfYRG7G1v9lvpliL5KdK1Ha6isJKuxh_0 2024-09-12T01:38:00.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.941+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.787373030963993530', time=2024-09-12T03:13:10.680592+0000, chain.objs.size()=1 2024-09-12T01:38:00.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.941+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.6B3nfY9w5o8ZV1Gwv0kby94eSjYmmcb_0 2024-09-12T01:38:00.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.941+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17326468050109414484', time=2024-09-12T03:13:11.286204+0000, chain.objs.size()=1 2024-09-12T01:38:00.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.941+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.EDEjKH0VKlwe6GR2LwHzR-4MouykZzY_0 2024-09-12T01:38:00.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.942+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12057531872899429500', time=2024-09-12T03:13:11.584600+0000, chain.objs.size()=1 2024-09-12T01:38:00.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.942+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.fSvQh5YTTHRYziZZbBFv7HLwqVlJncN_0 2024-09-12T01:38:00.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.942+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12897702750851481395', time=2024-09-12T03:13:11.877342+0000, chain.objs.size()=1 2024-09-12T01:38:00.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.942+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.dmbys6f3hT08P5j5J4ngf0P-YMnJAFZ_0 2024-09-12T01:38:00.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.942+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17315699456332183710', time=2024-09-12T03:13:11.972054+0000, chain.objs.size()=1 2024-09-12T01:38:00.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.942+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.B2oIlFHAIepcSOjpeCR36z13nH0GV7L_0 2024-09-12T01:38:00.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.942+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12962896580345157488', time=2024-09-12T03:13:12.528029+0000, chain.objs.size()=1 2024-09-12T01:38:00.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.942+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.RN9mDR2cgSR1APYR2Lz-YEmx7vxK82r_0 2024-09-12T01:38:00.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.942+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5247241642297348932', time=2024-09-12T03:13:12.528656+0000, chain.objs.size()=1 2024-09-12T01:38:00.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.942+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.28tEfs4FOUJRYsSqNoA2aG98iUcj5m0_0 2024-09-12T01:38:00.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.943+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10639030275217201003', time=2024-09-12T03:13:12.978357+0000, chain.objs.size()=1 2024-09-12T01:38:00.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.943+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.YW3oZ0SQv_4m-tAWjWv-OXTRy_9ESQo_0 2024-09-12T01:38:00.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.944+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17317039887460022186', time=2024-09-12T03:13:13.040340+0000, chain.objs.size()=1 2024-09-12T01:38:00.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.944+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.lXFyPKqisujEgQFHZJjIJeX9maIhkLr_0 2024-09-12T01:38:00.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.944+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.849209151156666166', time=2024-09-12T03:13:13.101689+0000, chain.objs.size()=1 2024-09-12T01:38:00.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.944+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.SwP6gki_fYaEFLjU5Nm9bVwdfmv4_nV_0 2024-09-12T01:38:00.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.944+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2191592361200121830', time=2024-09-12T03:13:13.255171+0000, chain.objs.size()=1 2024-09-12T01:38:00.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.944+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_._HHnZuK12y99nWkBzdPmf9yTfcR91C4_0 2024-09-12T01:38:00.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.944+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2009757933659795729', time=2024-09-12T03:13:13.363376+0000, chain.objs.size()=1 2024-09-12T01:38:00.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.944+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.al_o9CyVDRQHdz2k7uB6yrVFMsLSwFW_0 2024-09-12T01:38:00.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.944+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8534837531708753380', time=2024-09-12T03:13:13.849374+0000, chain.objs.size()=1 2024-09-12T01:38:00.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.944+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.roeF-JR-Q5DMkG7aw6f3M9SF0np_-WO_0 2024-09-12T01:38:00.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.944+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12503804139634744538', time=2024-09-12T03:13:13.992752+0000, chain.objs.size()=1 2024-09-12T01:38:00.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.944+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.bHqTMtn19C_2prq6mBHdxytMY0dQsYG_0 2024-09-12T01:38:00.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.944+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.50417398570785195', time=2024-09-12T03:13:13.993293+0000, chain.objs.size()=1 2024-09-12T01:38:00.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.944+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.5oTGEEEpKbpPswLKKNO1wpKRQ8ecx6l_0 2024-09-12T01:38:00.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.944+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7653953917108650956', time=2024-09-12T03:13:14.477643+0000, chain.objs.size()=1 2024-09-12T01:38:00.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.944+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.jdqVttxJ1B2AVKgoE-4zMjwJKfaJlWD_0 2024-09-12T01:38:00.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.945+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.289250336458038720', time=2024-09-12T03:13:14.675848+0000, chain.objs.size()=1 2024-09-12T01:38:00.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.945+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.83iv8iMFYjWvaJ99vBURhZIULD4LDMx_0 2024-09-12T01:38:00.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.946+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3093065205114636700', time=2024-09-12T03:13:14.676863+0000, chain.objs.size()=1 2024-09-12T01:38:00.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.946+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.x8jcSgFAL8Buv5Oh2v2P-mgfObfVLN4_0 2024-09-12T01:38:00.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.947+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13837208729741169366', time=2024-09-12T03:13:15.248781+0000, chain.objs.size()=1 2024-09-12T01:38:00.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.947+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.zJ6du-l4bTICQynVxFgiSHHAhi1VKZU_0 2024-09-12T01:38:00.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.947+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10502547146648682979', time=2024-09-12T03:13:16.063301+0000, chain.objs.size()=1 2024-09-12T01:38:00.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.947+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.VbnH4tl_fmwfcdKnorxj_2fPvPfUfDt_0 2024-09-12T01:38:00.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.947+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18090090527079434861', time=2024-09-12T03:13:16.365768+0000, chain.objs.size()=1 2024-09-12T01:38:00.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.947+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.GGeefI--Rsdc87Jq0wB_R2IwxISc9pt_0 2024-09-12T01:38:00.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.947+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.129698886872010172', time=2024-09-12T03:13:16.944796+0000, chain.objs.size()=1 2024-09-12T01:38:00.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.947+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.4TfpFNZZXehXIIMXBHAfX4wTli17ss7_0 2024-09-12T01:38:00.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.947+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12223973592721831869', time=2024-09-12T03:13:17.134711+0000, chain.objs.size()=1 2024-09-12T01:38:00.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.947+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.yfobwYbWdREjTyMsvpJwFwjdlhxa6yr_0 2024-09-12T01:38:00.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.947+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1465504476975043379', time=2024-09-12T03:13:17.135340+0000, chain.objs.size()=1 2024-09-12T01:38:00.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.947+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.O4k3mxszy5mt3VxDJ6oS_eo2GnMOBMJ_0 2024-09-12T01:38:00.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.947+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11189981607572726098', time=2024-09-12T03:13:53.787503+0000, chain.objs.size()=1 2024-09-12T01:38:00.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.947+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.WT_MsdfNWXX6EukzDwNGz5hFdPnYX3k_0 2024-09-12T01:38:00.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.947+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15741170332752491869', time=2024-09-12T03:13:55.146941+0000, chain.objs.size()=1 2024-09-12T01:38:00.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.947+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.WwTkrX24yj7ZH8nSNVpxmbN31im0vvZ_0 2024-09-12T01:38:00.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.947+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1426957747939031252', time=2024-09-12T03:13:55.413046+0000, chain.objs.size()=1 2024-09-12T01:38:00.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.947+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.2-mDwLx8cFOKmeV1u7h8dPBDb30fcwA_0 2024-09-12T01:38:00.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.947+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5018726980227301187', time=2024-09-12T03:13:55.435745+0000, chain.objs.size()=1 2024-09-12T01:38:00.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.947+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.fdW6MVnT8RmFVVs5UNEDbi4R6eyOJVO_0 2024-09-12T01:38:00.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.948+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8324313475227305570', time=2024-09-12T03:13:55.729495+0000, chain.objs.size()=1 2024-09-12T01:38:00.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.948+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.FJ6I2BWiwyWwJyxe40PkkRZxnEjkkC0_0 2024-09-12T01:38:00.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.949+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11430769928375054626', time=2024-09-12T03:13:56.036402+0000, chain.objs.size()=1 2024-09-12T01:38:00.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.949+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.0WxMW48KVdG7pWItby-NOwJyJA6znWv_0 2024-09-12T01:38:00.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.949+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9062128951769442352', time=2024-09-12T03:13:56.673889+0000, chain.objs.size()=1 2024-09-12T01:38:00.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.949+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.kZj8Yby1nzyOe1IvWaDtYzm-j2RK2ax_0 2024-09-12T01:38:00.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.949+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10485109357069246081', time=2024-09-12T03:13:56.854353+0000, chain.objs.size()=1 2024-09-12T01:38:00.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.949+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.cjMlZmhinlYM-zE4CToZfHvNsx7jvaX_0 2024-09-12T01:38:00.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.949+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11798990840166199824', time=2024-09-12T03:13:57.220286+0000, chain.objs.size()=1 2024-09-12T01:38:00.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.949+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.RvLRDew4nprHF62otAk_4_BkBRgk5fa_0 2024-09-12T01:38:00.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.949+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1596634513984028559', time=2024-09-12T03:13:57.807566+0000, chain.objs.size()=1 2024-09-12T01:38:00.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.949+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.DibqU6AbK6BwBOLO50ofeuV-JyPEVCv_0 2024-09-12T01:38:00.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.950+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5499198732848839325', time=2024-09-12T03:13:57.986238+0000, chain.objs.size()=1 2024-09-12T01:38:00.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.950+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.T3Vp2_oqDE_XJZydDeIT7I5OZ-mflw7_0 2024-09-12T01:38:00.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.950+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8878524369670613857', time=2024-09-12T03:13:58.130103+0000, chain.objs.size()=1 2024-09-12T01:38:00.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.950+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.YdgrTnHpa14g3N9XyL42XhhT16xGTkl_0 2024-09-12T01:38:00.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.950+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2499207213140634127', time=2024-09-12T03:13:58.549980+0000, chain.objs.size()=1 2024-09-12T01:38:00.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.950+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.oCMZIP3ITAuZvP2WceQV05peTq5TK9w_0 2024-09-12T01:38:00.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.950+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15636354166408344580', time=2024-09-12T03:13:59.260540+0000, chain.objs.size()=1 2024-09-12T01:38:00.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.950+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.BmwV92w-NHwBm240sJKk6681tA97o4o_0 2024-09-12T01:38:00.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.950+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4281074398037025813', time=2024-09-12T03:13:59.303775+0000, chain.objs.size()=1 2024-09-12T01:38:00.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.950+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.riCRGcGFD_33Ufe9_mOqBdiqiwRVNBl_0 2024-09-12T01:38:00.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.950+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12582965151013038956', time=2024-09-12T03:13:59.329119+0000, chain.objs.size()=1 2024-09-12T01:38:00.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.950+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.DHSzVc4vWZ4t9iuX3M0OMZF6sVdZS5X_0 2024-09-12T01:38:00.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.950+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6539682227465186353', time=2024-09-12T03:13:59.361359+0000, chain.objs.size()=1 2024-09-12T01:38:00.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.950+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.srPar7mRNnbGlMbjyxrM3q0kxXHQY7V_0 2024-09-12T01:38:00.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.952+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 0/44277 2024-09-12T01:38:00.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.955+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=26, truncated=0, next_marker='' 2024-09-12T01:38:00.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.955+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10648287593468038080', time=2024-09-12T03:13:59.433180+0000, chain.objs.size()=1 2024-09-12T01:38:00.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.955+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.nR3V01FfBZsLAltlyBXKJ_JRW2OWQiI_0 2024-09-12T01:38:00.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.955+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14706676335012456488', time=2024-09-12T03:14:00.471750+0000, chain.objs.size()=1 2024-09-12T01:38:00.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.955+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.YJiiYqkUCv5yTWkYmu747Wt00J1-4-1_0 2024-09-12T01:38:00.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.955+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16864027312592483576', time=2024-09-12T03:14:00.482785+0000, chain.objs.size()=1 2024-09-12T01:38:00.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.955+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.f7pY1PMYJ2D8ABAMX3jASVF17k2rTUt_0 2024-09-12T01:38:00.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.955+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6760110603281485145', time=2024-09-12T03:14:00.595927+0000, chain.objs.size()=1 2024-09-12T01:38:00.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.955+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.H244AGfPitLfedt0ABv4s4En9lFC7le_0 2024-09-12T01:38:00.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.955+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14446559726294269389', time=2024-09-12T03:14:00.849770+0000, chain.objs.size()=1 2024-09-12T01:38:00.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.955+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_._LcY7nCWdMt6cqmwWPRyyUlGWGXAWov_0 2024-09-12T01:38:00.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.955+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14085635284450216574', time=2024-09-12T03:14:00.894231+0000, chain.objs.size()=1 2024-09-12T01:38:00.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.955+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.z5vaB0BoHkH7CCfO4kFNpkebIWCeJQG_0 2024-09-12T01:38:00.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.955+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3466799439916614431', time=2024-09-12T03:14:00.959993+0000, chain.objs.size()=1 2024-09-12T01:38:00.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.955+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.M7lSnbMSGFBbKYni-gToqEg8nUov4ue_0 2024-09-12T01:38:00.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.955+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4170059697122455051', time=2024-09-12T03:14:01.125865+0000, chain.objs.size()=1 2024-09-12T01:38:00.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.955+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.2KqdGjd1ncmsaoA-uTpTF9CanJEnigC_0 2024-09-12T01:38:00.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.955+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3707349894978766867', time=2024-09-12T03:14:01.712536+0000, chain.objs.size()=1 2024-09-12T01:38:00.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.955+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.YDHK7PA0mN4wZcgYx-BseZtdaNChZVb_0 2024-09-12T01:38:00.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.955+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1916197046973058957', time=2024-09-12T03:14:02.382335+0000, chain.objs.size()=1 2024-09-12T01:38:00.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.955+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.H_LSKV2HWp7hviezK-YRoH7DCtr9mIv_0 2024-09-12T01:38:00.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.955+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.652251059050202691', time=2024-09-12T03:14:02.472309+0000, chain.objs.size()=1 2024-09-12T01:38:00.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.955+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.i00Nz1_ojee8NbwYrlBz8pLyS2WvFtE_0 2024-09-12T01:38:00.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.955+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6915611169075256378', time=2024-09-12T03:14:03.202769+0000, chain.objs.size()=1 2024-09-12T01:38:00.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.955+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.BhEeSRx2l8i0pRjjx0EejxG7UJQzFNh_0 2024-09-12T01:38:00.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.957+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11739592738582961188', time=2024-09-12T03:14:07.957373+0000, chain.objs.size()=1 2024-09-12T01:38:00.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.957+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.329__shadow_.sCK64zsfHTszE6WiUvHHLIu5Ttq4aXP_0 2024-09-12T01:38:00.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.957+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14626157729682703218', time=2024-09-12T03:15:03.850062+0000, chain.objs.size()=1 2024-09-12T01:38:00.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.957+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.390__shadow_.MwXV7xCNB3Yc-eJLHCgO_mYU-1txK-R_0 2024-09-12T01:38:00.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.957+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11328147371466268148', time=2024-09-12T03:16:41.340691+0000, chain.objs.size()=1 2024-09-12T01:38:00.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.957+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.487__shadow_.x-8PO4dww3eNQ8dIyIp_M9fqHoarL-e_0 2024-09-12T01:38:00.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.957+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3408906817756030039', time=2024-09-12T03:16:50.628659+0000, chain.objs.size()=1 2024-09-12T01:38:00.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.957+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.498__shadow_.ctdwiLP5k1_eyNvnNmYK6l5C6AAP_FM_0 2024-09-12T01:38:00.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.957+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10077997718881991339', time=2024-09-12T03:17:24.965414+0000, chain.objs.size()=6 2024-09-12T01:38:00.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.957+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.507__multipart_srcmultipart.2~ckyMCV3hbT7G8qDArZScZPf4n-CghR1.1 2024-09-12T01:38:00.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.957+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.507__multipart_srcmultipart.2~ckyMCV3hbT7G8qDArZScZPf4n-CghR1.2 2024-09-12T01:38:00.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.957+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.507__multipart_srcmultipart.2~ckyMCV3hbT7G8qDArZScZPf4n-CghR1.3 2024-09-12T01:38:00.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.957+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.507__multipart_srcmultipart.2~ckyMCV3hbT7G8qDArZScZPf4n-CghR1.4 2024-09-12T01:38:00.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.957+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.507__multipart_srcmultipart.2~ckyMCV3hbT7G8qDArZScZPf4n-CghR1.5 2024-09-12T01:38:00.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.957+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.507__multipart_srcmultipart.2~ckyMCV3hbT7G8qDArZScZPf4n-CghR1.6 2024-09-12T01:38:00.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.957+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13314215093747319571', time=2024-09-12T03:17:43.615789+0000, chain.objs.size()=1 2024-09-12T01:38:00.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.958+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.517__shadow_.1qWDuWu4mnidLcqbqD_xvR9DDd2kP1b_0 2024-09-12T01:38:00.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.958+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7812414595379504996', time=2024-09-12T03:23:10.914392+0000, chain.objs.size()=1 2024-09-12T01:38:00.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.958+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.569__shadow:KNF8-5C77Y2txO4NAyvAH-oz1oGqzTr_.kQOF8ZGALVQxj0pKNhGWrim73nBx96v_0 2024-09-12T01:38:00.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.958+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15644737615184794667', time=2024-09-12T03:23:13.226839+0000, chain.objs.size()=1 2024-09-12T01:38:00.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.958+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.569__shadow:pWiOK9Y6OgOU4kkOH1QXWerq2K1hFIm_.eistzXuJP4x1IAETR1TwkY_tx5QaKaV_0 2024-09-12T01:38:00.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.958+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3196587307013226236', time=2024-09-12T03:23:52.982664+0000, chain.objs.size()=1 2024-09-12T01:38:00.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.958+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.577__shadow:r1rllgzKIDHe86kE7lpfZNFy.YNXpWl_.eC3_pwqFyhR-TJ3h9_SU1xpp4Val1mH_0 2024-09-12T01:38:00.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.958+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4451263095977545137', time=2024-09-12T03:23:53.223956+0000, chain.objs.size()=1 2024-09-12T01:38:00.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.958+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.577__shadow:QFeH7IACaUx35SZ7Q9DVH2QanfnP5Ca_.m1OAxvNO_MvcByG6wZw1TLp_QQAIaCX_0 2024-09-12T01:38:00.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.960+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6394634124054426605', time=2024-09-12T03:25:06.199132+0000, chain.objs.size()=1 2024-09-12T01:38:00.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.960+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.608__shadow_.5qqTVZG4dgRHvpp24RX5eNCMvoMMhDC_0 2024-09-12T01:38:00.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.960+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11069964344238574002', time=2024-09-12T03:27:54.669157+0000, chain.objs.size()=1 2024-09-12T01:38:00.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.960+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.617__shadow_.S7fAmILlWtNiko9jbfDHfq5SkLWwJ4y_0 2024-09-12T01:38:00.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.960+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8330744103056687471', time=2024-09-12T03:31:22.869397+0000, chain.objs.size()=1 2024-09-12T01:38:00.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.960+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.693__shadow:Kw73luzxfIA.2u286fcC7cf7I1F64fm_.W2PQGbhdXiltj8h1G3zAFJzzRIPuHib_0 2024-09-12T01:38:00.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.960+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4165270118271841637', time=2024-09-12T03:32:19.078504+0000, chain.objs.size()=1 2024-09-12T01:38:00.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.960+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.734__shadow_.LR7fqOkfDZD6P6mKsLr3UFEOGQkIHdx_0 2024-09-12T01:38:00.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.965+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:38:00.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.968+0000 7f8786c98800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T01:38:00.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.969+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:38:00.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.969+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:38:00.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.970+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44747' 2024-09-12T01:38:00.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.970+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8132663334220819267', time=2024-09-12T03:10:10.656873+0000, chain.objs.size()=1 2024-09-12T01:38:00.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.970+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.235__shadow_.1-AK58wVGM7dm5X6Pn9WZOFQ3bpjhaV_0 2024-09-12T01:38:00.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.970+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13618143464804976376', time=2024-09-12T03:10:28.822430+0000, chain.objs.size()=1 2024-09-12T01:38:00.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.970+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.251__shadow_.y8DHbcxMKmWToiZgV8S1Azq2EiqX9tZ_0 2024-09-12T01:38:00.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.970+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2700825729125466690', time=2024-09-12T03:10:31.723010+0000, chain.objs.size()=1 2024-09-12T01:38:00.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.970+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.254__shadow_.-REBCL1goliQzwtrpweezJe_AQJP7xC_0 2024-09-12T01:38:00.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.970+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17998209082384565310', time=2024-09-12T03:10:32.700422+0000, chain.objs.size()=1 2024-09-12T01:38:00.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.970+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.255__shadow_.H957w3dYi7TyQfgEhbS1X2rdvp_Z24U_0 2024-09-12T01:38:00.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.970+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4778013476193254726', time=2024-09-12T03:11:14.797331+0000, chain.objs.size()=1 2024-09-12T01:38:00.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.970+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.abtpyk1AWD26Mrdvt_lqYNRhMolXyKL_0 2024-09-12T01:38:00.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.970+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5424161096288093690', time=2024-09-12T03:11:14.806641+0000, chain.objs.size()=1 2024-09-12T01:38:00.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.970+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.xcA0YiLMuNza8qp2tW8UnrTcQV8C2j9_0 2024-09-12T01:38:00.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.970+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.91216887794652371', time=2024-09-12T03:11:14.807251+0000, chain.objs.size()=1 2024-09-12T01:38:00.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.970+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.5H4BK-kvUqH2M1Q3ufLkm58v7sWd-lI_0 2024-09-12T01:38:00.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.970+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15575193922590776887', time=2024-09-12T03:11:14.858695+0000, chain.objs.size()=1 2024-09-12T01:38:00.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.970+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Jt_MSRXy8p08mJ81GI_CbZhj8yqp5t1_0 2024-09-12T01:38:00.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.970+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10832796638332707003', time=2024-09-12T03:11:14.887071+0000, chain.objs.size()=1 2024-09-12T01:38:00.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.970+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.EpH9A0sblw3TduuC5g5l8L5yu7hEwYv_0 2024-09-12T01:38:00.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.970+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17841567605435059731', time=2024-09-12T03:11:15.014460+0000, chain.objs.size()=1 2024-09-12T01:38:00.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.970+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.1rnIYi8KLhR7Fe4-CX1nQC4ionC4DrI_0 2024-09-12T01:38:00.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.970+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15400383992655155725', time=2024-09-12T03:11:15.077864+0000, chain.objs.size()=1 2024-09-12T01:38:00.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.970+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.oXMWBYkwwZX2CBIxCX4T2-MdkM8tqrq_0 2024-09-12T01:38:00.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.970+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8339095728023924551', time=2024-09-12T03:11:15.261910+0000, chain.objs.size()=1 2024-09-12T01:38:00.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.970+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.AhyzGbnMJTS6c3qTqDmCGkp2_rZlijX_0 2024-09-12T01:38:00.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.972+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4726928531401604969', time=2024-09-12T03:11:15.952069+0000, chain.objs.size()=1 2024-09-12T01:38:00.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.972+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.U2i_jKIEL7XThgzyoRWu3Q4B0Q0_FKi_0 2024-09-12T01:38:00.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.972+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7022597028142219417', time=2024-09-12T03:11:16.013215+0000, chain.objs.size()=1 2024-09-12T01:38:00.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.972+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.yDX-1VA8cuSVl2LxMrLDoU90_cjkX1s_0 2024-09-12T01:38:00.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.972+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13352096587272971370', time=2024-09-12T03:11:16.528169+0000, chain.objs.size()=1 2024-09-12T01:38:00.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.972+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.U-59ItW6cXWwFcGkHs5UxFEhf8nmHbB_0 2024-09-12T01:38:00.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.972+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6529761187691808313', time=2024-09-12T03:11:17.808563+0000, chain.objs.size()=1 2024-09-12T01:38:00.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.972+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.tiNUBu12rfZXbYoAcQIjCvljJmpPmJq_0 2024-09-12T01:38:00.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.972+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18210799893302114768', time=2024-09-12T03:11:18.135172+0000, chain.objs.size()=1 2024-09-12T01:38:00.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.972+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.LM76AzOzqQp4E8w_wtGGH4zQagky_4w_0 2024-09-12T01:38:00.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.972+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16522142730025913743', time=2024-09-12T03:11:19.019764+0000, chain.objs.size()=1 2024-09-12T01:38:00.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.972+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.5Yg-L7Vy8ir6d20Y1ajbz9hFiUqvwqB_0 2024-09-12T01:38:00.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.972+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3290415959088963025', time=2024-09-12T03:11:19.235800+0000, chain.objs.size()=1 2024-09-12T01:38:00.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.972+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.5oANtEka17Lnoce9T35hJ_Hbj_DstqG_0 2024-09-12T01:38:00.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.972+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17023683158618033813', time=2024-09-12T03:11:19.508429+0000, chain.objs.size()=1 2024-09-12T01:38:00.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.972+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Y5rVS5_RqNFIKcYrh-lT3puPS5aLCVj_0 2024-09-12T01:38:00.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.972+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7992118421147761306', time=2024-09-12T03:11:19.596424+0000, chain.objs.size()=1 2024-09-12T01:38:00.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.972+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.scjeFr6eBCK15zjaudKrvDFomYS8ZD6_0 2024-09-12T01:38:00.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.972+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2829532812240712471', time=2024-09-12T03:11:20.291668+0000, chain.objs.size()=1 2024-09-12T01:38:00.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.972+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.70a-ETx81T4BCq-GRrXjdz_fsgGZEmU_0 2024-09-12T01:38:00.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.972+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13960188521490430700', time=2024-09-12T03:11:20.882665+0000, chain.objs.size()=1 2024-09-12T01:38:00.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.972+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.L9PLhrGD7ivvlw-gWVa01zZYtE1dt30_0 2024-09-12T01:38:00.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.975+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14540463345463319955', time=2024-09-12T03:11:21.152813+0000, chain.objs.size()=1 2024-09-12T01:38:00.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.975+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.LOFXJjKGC92cAZoSoHgkmRGH2Fg9sdg_0 2024-09-12T01:38:00.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.975+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18106010519173619107', time=2024-09-12T03:11:21.165070+0000, chain.objs.size()=1 2024-09-12T01:38:00.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.975+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.n1uEC40cFOidsa9nfXas0p4qbJA3Ib1_0 2024-09-12T01:38:00.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.975+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.331464457245396428', time=2024-09-12T03:11:22.004702+0000, chain.objs.size()=1 2024-09-12T01:38:00.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.975+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.HKa2cQfsYBU_7JcAsBikpr8X040h9cu_0 2024-09-12T01:38:00.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.975+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15371708919472104450', time=2024-09-12T03:11:22.953821+0000, chain.objs.size()=1 2024-09-12T01:38:00.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.975+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.4ECa40BWQZI3DvB6dtrPxlxi2YYFLsN_0 2024-09-12T01:38:00.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.975+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11861000087550409220', time=2024-09-12T03:11:23.042112+0000, chain.objs.size()=1 2024-09-12T01:38:00.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.975+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.UP-muyPmy50EbzwpWzE-__4YPk2DaDj_0 2024-09-12T01:38:00.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.975+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8305816222741815257', time=2024-09-12T03:11:23.439172+0000, chain.objs.size()=1 2024-09-12T01:38:00.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.975+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.zIo-wTnbn0hVfST3MxqXSeT2ZoZIc89_0 2024-09-12T01:38:00.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.975+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18077947709107237203', time=2024-09-12T03:11:23.822652+0000, chain.objs.size()=1 2024-09-12T01:38:00.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.975+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.-_dewybTMZ1OmO-LqIHvdfoqmrzE7Fx_0 2024-09-12T01:38:00.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.975+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8980419155855831841', time=2024-09-12T03:11:24.126022+0000, chain.objs.size()=1 2024-09-12T01:38:00.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.975+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.NYkm2bFF_W_SYEdbOpdmvmDVRCLhHW5_0 2024-09-12T01:38:00.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.975+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13410265401614333351', time=2024-09-12T03:11:24.126824+0000, chain.objs.size()=1 2024-09-12T01:38:00.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.975+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.lKEWlllZM4G9bWiIjKByRqAPhHJC6Zp_0 2024-09-12T01:38:00.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.975+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12445760004874682831', time=2024-09-12T03:11:24.248780+0000, chain.objs.size()=1 2024-09-12T01:38:00.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.975+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.sT_PQMirXuzJbhaudqKGysGigIdJZ6m_0 2024-09-12T01:38:00.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.975+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8277437648503808333', time=2024-09-12T03:11:24.432704+0000, chain.objs.size()=1 2024-09-12T01:38:00.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.975+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.HwYVrSytgv83BRBRcc8i6t-Bbk3GXbG_0 2024-09-12T01:38:00.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.978+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13701774118268895815', time=2024-09-12T03:11:24.532674+0000, chain.objs.size()=1 2024-09-12T01:38:00.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.978+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.KE8BUTdfCbB7RWR2GkBz6_f0pJyn6E5_0 2024-09-12T01:38:00.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.978+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14043817169188910231', time=2024-09-12T03:11:24.842285+0000, chain.objs.size()=1 2024-09-12T01:38:00.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.978+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.2zwtBHK28CLhynbeXnXrTaBDxn4aeVu_0 2024-09-12T01:38:00.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.978+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7979321916922656360', time=2024-09-12T03:11:24.913308+0000, chain.objs.size()=1 2024-09-12T01:38:00.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.978+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.YD4M32Ja1xfYkKUUZzYjnkmaeLXS1D1_0 2024-09-12T01:38:00.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.978+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8612991685352107877', time=2024-09-12T03:11:28.677561+0000, chain.objs.size()=1 2024-09-12T01:38:00.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.978+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.266__shadow_.hjSeRkz5_-XFkTvDn8PeNzg-Nu4hzOt_0 2024-09-12T01:38:00.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.978+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15653675902915800905', time=2024-09-12T03:11:35.225807+0000, chain.objs.size()=1 2024-09-12T01:38:00.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.978+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.273__shadow_.awz6Q9xez6LX2ckNF7_-Rr2DbociGNI_0 2024-09-12T01:38:00.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.978+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8417721434111766500', time=2024-09-12T03:11:40.042526+0000, chain.objs.size()=1 2024-09-12T01:38:00.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.978+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.278__shadow_.-81b9G95bGAfi-ILsA_Xolq-vQip0H8_0 2024-09-12T01:38:00.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.978+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6695918007219079372', time=2024-09-12T03:11:41.007498+0000, chain.objs.size()=1 2024-09-12T01:38:00.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.978+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.279__shadow_.kUcT5YqCoAjyMi28vnkyCk2hJyZ4AIg_0 2024-09-12T01:38:00.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.978+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5651735322812195998', time=2024-09-12T03:11:46.904442+0000, chain.objs.size()=1 2024-09-12T01:38:00.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.978+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.285__shadow_.8Dejk2YyUktv1HGtdStyHmtwY8abCmx_0 2024-09-12T01:38:00.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.978+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.726715729605051596', time=2024-09-12T03:12:02.679923+0000, chain.objs.size()=1 2024-09-12T01:38:00.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.978+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.298__shadow_.pIZenBpG0TcrSnlFiHJQQ1aqsUI1yF9_0 2024-09-12T01:38:00.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.978+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6153219216307390390', time=2024-09-12T03:13:06.778211+0000, chain.objs.size()=1 2024-09-12T01:38:00.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.978+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.RZd3B1NAZ1Yp8O3KEAvTrdaz8dsjbYH_0 2024-09-12T01:38:00.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.978+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15659496902611569266', time=2024-09-12T03:13:07.033479+0000, chain.objs.size()=1 2024-09-12T01:38:00.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.978+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.V0S07V5GJd2s83peHu1f5ZoFjZYXjWF_0 2024-09-12T01:38:00.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.980+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6049793749781685401', time=2024-09-12T03:13:07.796369+0000, chain.objs.size()=1 2024-09-12T01:38:00.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.980+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.UHr1sy0Wl9UlAw5w2iE0KHaiJyEUP3O_0 2024-09-12T01:38:00.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.981+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17409414636631484432', time=2024-09-12T03:13:08.755097+0000, chain.objs.size()=1 2024-09-12T01:38:00.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.981+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.vv2aADWGj0ynLDOHI2AvtOAYBDEjsDk_0 2024-09-12T01:38:00.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.981+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7473820842507314035', time=2024-09-12T03:13:10.015961+0000, chain.objs.size()=1 2024-09-12T01:38:00.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.981+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.T_DCKoetOfXZwBQhpSV7_ES56IGLiHq_0 2024-09-12T01:38:00.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.981+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4357177860547667102', time=2024-09-12T03:13:10.142839+0000, chain.objs.size()=1 2024-09-12T01:38:00.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.981+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.HRnHjk2lTM4U7tEqlfGSTAXEzNAPzXq_0 2024-09-12T01:38:00.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.981+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17721507909639456808', time=2024-09-12T03:13:10.169623+0000, chain.objs.size()=1 2024-09-12T01:38:00.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.981+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.cN0vM2TzezR9TzJVGsJlNO-q-L-SJ84_0 2024-09-12T01:38:00.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.981+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15708034937635781593', time=2024-09-12T03:13:10.273460+0000, chain.objs.size()=1 2024-09-12T01:38:00.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.981+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.HHy2jKaKpSRuTRBjPFX0zU9MkBePkSr_0 2024-09-12T01:38:00.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.981+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4062872902880589355', time=2024-09-12T03:13:10.549374+0000, chain.objs.size()=1 2024-09-12T01:38:00.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.981+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.jf-JKfZALPNG7pjMvLB2yjKsEyKTF7i_0 2024-09-12T01:38:00.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.981+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11961301454169422610', time=2024-09-12T03:13:11.262219+0000, chain.objs.size()=1 2024-09-12T01:38:00.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.981+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.4LvRREtLt0G70VdG19OIF1vSPdj0Qzh_0 2024-09-12T01:38:00.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.981+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14859505569157561183', time=2024-09-12T03:13:11.784861+0000, chain.objs.size()=1 2024-09-12T01:38:00.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.981+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.EtcJT1Fn3vbm0EtYtpgX0DaGutabhsr_0 2024-09-12T01:38:00.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.981+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1646622987994318352', time=2024-09-12T03:13:12.072198+0000, chain.objs.size()=1 2024-09-12T01:38:00.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.981+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.lYzKAWWVgH3o2b3nqWM6hbZHLeDADhE_0 2024-09-12T01:38:00.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.981+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14281742959934740272', time=2024-09-12T03:13:12.524896+0000, chain.objs.size()=1 2024-09-12T01:38:00.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.981+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.btNxbsjuowDNCZocW4kKShHRTm73Kq4_0 2024-09-12T01:38:00.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.982+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7040162063566014730', time=2024-09-12T03:13:12.676601+0000, chain.objs.size()=1 2024-09-12T01:38:00.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.982+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.6EAd1uG2euCfliELBkXy_0Kg9NVRPJT_0 2024-09-12T01:38:00.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.984+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14439552075830635041', time=2024-09-12T03:13:13.097885+0000, chain.objs.size()=1 2024-09-12T01:38:00.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.984+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.MQzoy1DdbQpdK3d5XWBBFXlnZFzGykR_0 2024-09-12T01:38:00.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.984+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3363753638586013930', time=2024-09-12T03:13:13.375555+0000, chain.objs.size()=1 2024-09-12T01:38:00.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.984+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.giHMDVl6d8QXJuJp7MKyuWoHmHoL0f2_0 2024-09-12T01:38:00.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.984+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13643192369655394664', time=2024-09-12T03:13:13.781997+0000, chain.objs.size()=1 2024-09-12T01:38:00.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.984+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.hsvfSC-HhQRyVzhn674pOe3ErpKKFwV_0 2024-09-12T01:38:00.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.984+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.246574810165817179', time=2024-09-12T03:13:13.877922+0000, chain.objs.size()=1 2024-09-12T01:38:00.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.984+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.saZhanvcSEc15Ifzi1svoxW2BS9cUSQ_0 2024-09-12T01:38:00.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.984+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11580396399671874332', time=2024-09-12T03:13:14.184743+0000, chain.objs.size()=1 2024-09-12T01:38:00.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.984+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.dYFXhkWs91X6vcVf0j03FDaIsHll3CP_0 2024-09-12T01:38:00.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.984+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.183931695810364426', time=2024-09-12T03:13:14.215144+0000, chain.objs.size()=1 2024-09-12T01:38:00.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.984+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.6KYs4fgmAqy-87msHff6gvZjwxa9Plv_0 2024-09-12T01:38:00.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.984+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15585502710750981313', time=2024-09-12T03:13:14.475194+0000, chain.objs.size()=1 2024-09-12T01:38:00.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.984+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.eqLoPGMfgxvwElIG8hpcRJqhXPq_4uu_0 2024-09-12T01:38:00.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.984+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1187756537346576404', time=2024-09-12T03:13:15.142960+0000, chain.objs.size()=1 2024-09-12T01:38:00.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.984+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.kiN5cSd86dFXcw6cCDS9Booo8FCkiqi_0 2024-09-12T01:38:00.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.984+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3214320637752539059', time=2024-09-12T03:13:15.705401+0000, chain.objs.size()=1 2024-09-12T01:38:00.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.984+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.BRoxLqP9X8RJl6xjbYV-zv4DH6Dt-Kw_0 2024-09-12T01:38:01.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.984+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10886698249013663720', time=2024-09-12T03:13:15.706015+0000, chain.objs.size()=1 2024-09-12T01:38:01.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.984+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.YLRHSTGDMO65JVDMA3bQQQGsIMqb8ir_0 2024-09-12T01:38:01.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.984+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8070413367068331742', time=2024-09-12T03:13:16.378762+0000, chain.objs.size()=1 2024-09-12T01:38:01.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.984+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.hYBHH1TdaL7Hhud15MLhBm1pu24-v5W_0 2024-09-12T01:38:01.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.986+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9763481008792660833', time=2024-09-12T03:13:16.794407+0000, chain.objs.size()=1 2024-09-12T01:38:01.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.986+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.-RXagSQURcosRU1br6rxM5vrA1QKNSL_0 2024-09-12T01:38:01.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.987+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11549730683763776635', time=2024-09-12T03:13:16.842895+0000, chain.objs.size()=1 2024-09-12T01:38:01.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.987+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.WOJHlBRBGV82DxoMmshx-gHjsLSEXfz_0 2024-09-12T01:38:01.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.987+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.352266834569770936', time=2024-09-12T03:13:54.065809+0000, chain.objs.size()=1 2024-09-12T01:38:01.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.988+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.AEfuHZFRTdGFweFCYWMW8tn2gQUG4cs_0 2024-09-12T01:38:01.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.988+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15737304754626840277', time=2024-09-12T03:13:54.579803+0000, chain.objs.size()=1 2024-09-12T01:38:01.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.988+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.LacCAIiCIAg2Mk5ScvkCZ4Obmlwt3Gw_0 2024-09-12T01:38:01.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.988+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1521598281888579186', time=2024-09-12T03:13:55.501909+0000, chain.objs.size()=1 2024-09-12T01:38:01.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.988+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.wndWMl3EQ8td1nDR1wLXv3w-LOj3CKu_0 2024-09-12T01:38:01.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.988+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15673542590670264718', time=2024-09-12T03:13:55.626341+0000, chain.objs.size()=1 2024-09-12T01:38:01.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.988+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.OZCOgPn5KmXjQBSAxAY8oTFS2xikWyg_0 2024-09-12T01:38:01.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.988+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12394334936813786481', time=2024-09-12T03:13:55.933382+0000, chain.objs.size()=1 2024-09-12T01:38:01.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.988+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.9VP6smXPmb0pfiemu7DA_y4exFZGDd8_0 2024-09-12T01:38:01.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.988+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9499472278843223062', time=2024-09-12T03:13:56.727436+0000, chain.objs.size()=1 2024-09-12T01:38:01.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.988+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.08LoEODZ9NEt03HJ0LUf8OxYkTE4C-i_0 2024-09-12T01:38:01.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.988+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16030087914015304627', time=2024-09-12T03:13:57.071047+0000, chain.objs.size()=1 2024-09-12T01:38:01.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.988+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.SrUv3YJB1vNuKrR1un6IMYa7HcyUiOk_0 2024-09-12T01:38:01.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.988+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1574380175095772214', time=2024-09-12T03:13:57.826229+0000, chain.objs.size()=1 2024-09-12T01:38:01.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.988+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.902nQLpyAZpRDye4QYm2c5Etus2aBw4_0 2024-09-12T01:38:01.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.988+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4355251823226265538', time=2024-09-12T03:13:58.134501+0000, chain.objs.size()=1 2024-09-12T01:38:01.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.988+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.4haYUZc_fQIjypt83SAfq6LWRzr8MTZ_0 2024-09-12T01:38:01.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.990+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15792114349974397148', time=2024-09-12T03:13:58.501630+0000, chain.objs.size()=1 2024-09-12T01:38:01.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.990+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.NmOh47v1kq-SR3YsqE-Wenbo2ooJv-V_0 2024-09-12T01:38:01.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.990+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12211259496679110345', time=2024-09-12T03:13:58.689818+0000, chain.objs.size()=1 2024-09-12T01:38:01.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.990+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.MraEqlGKjT74jkw22VINbk4Y39HQ8os_0 2024-09-12T01:38:01.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.990+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12058452411853677892', time=2024-09-12T03:13:59.302453+0000, chain.objs.size()=1 2024-09-12T01:38:01.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.990+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.g3eRvB0MrXtB6PQ8le3j7nsNa1e_M6v_0 2024-09-12T01:38:01.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.990+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15956647803041646528', time=2024-09-12T03:13:59.715774+0000, chain.objs.size()=1 2024-09-12T01:38:01.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.990+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.57nPxNl4DMj3k6odk0JF5fIAg4nFtr0_0 2024-09-12T01:38:01.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.990+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15476165207690304387', time=2024-09-12T03:14:00.594924+0000, chain.objs.size()=1 2024-09-12T01:38:01.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.990+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.lsjsChjNgah5GNaePhHLNSrycJd4qox_0 2024-09-12T01:38:01.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.990+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10182360139855390646', time=2024-09-12T03:14:00.849952+0000, chain.objs.size()=1 2024-09-12T01:38:01.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.990+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.KRo1-TDMrFLcKJGd0gGaQIn3ZdFT7Dd_0 2024-09-12T01:38:01.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.990+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10310236217605291317', time=2024-09-12T03:14:01.228849+0000, chain.objs.size()=1 2024-09-12T01:38:01.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.990+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.0qRNU2ounVHyDbjEgLzSShSK_NWhW5k_0 2024-09-12T01:38:01.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.990+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16924978235245896453', time=2024-09-12T03:14:02.308055+0000, chain.objs.size()=1 2024-09-12T01:38:01.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.990+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.MeEy40TkkiKXLhRfi8A-1Z3eHSJE7CG_0 2024-09-12T01:38:01.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.990+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16118075031995958275', time=2024-09-12T03:14:02.567978+0000, chain.objs.size()=1 2024-09-12T01:38:01.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.990+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.u_pqSstZcOdcey8NKE7Y9pF-uI4ttMH_0 2024-09-12T01:38:01.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.990+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13509647363159354339', time=2024-09-12T03:14:02.568827+0000, chain.objs.size()=1 2024-09-12T01:38:01.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.990+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.cgvauaPCdJ39hqrUHjRWH2dFE70ycip_0 2024-09-12T01:38:01.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.990+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2424279532898082998', time=2024-09-12T03:14:03.301029+0000, chain.objs.size()=1 2024-09-12T01:38:01.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.990+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.ovfy2jJtw002qbqNS_So0ziJY3IOnPn_0 2024-09-12T01:38:01.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.992+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15006972554801201442', time=2024-09-12T03:14:03.524809+0000, chain.objs.size()=1 2024-09-12T01:38:01.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.992+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.suqABJKwyWHipQuvdIdP_wdxf_7d4Tk_0 2024-09-12T01:38:01.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.995+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14768558282864812950', time=2024-09-12T03:14:05.354305+0000, chain.objs.size()=1 2024-09-12T01:38:01.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.995+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.326__shadow_.5t8LfLtx81n9sN93z42j2_7X0SruCXu_0 2024-09-12T01:38:01.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.995+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4918707479485262212', time=2024-09-12T03:14:45.440159+0000, chain.objs.size()=1 2024-09-12T01:38:01.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.995+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.372__shadow_.jUyUh8WWAjKjNouonxdnk8cLhjzYGNy_0 2024-09-12T01:38:01.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.995+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15252195545644277886', time=2024-09-12T03:14:52.909133+0000, chain.objs.size()=1 2024-09-12T01:38:01.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.995+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.379__shadow_.mLpYDTr7QXf2sJEoM-UJdMkOVkGAKz4_0 2024-09-12T01:38:01.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.995+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14899170211766973285', time=2024-09-12T03:16:22.893336+0000, chain.objs.size()=1 2024-09-12T01:38:01.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.995+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.466__shadow_.qGJ037MuvnuQ8h9QDr0nDD35FjE8QBa_0 2024-09-12T01:38:01.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.995+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10114351764055354704', time=2024-09-12T03:16:34.343087+0000, chain.objs.size()=1 2024-09-12T01:38:01.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.995+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.483__shadow_.ygNwKyQbinmsmwUhsDZfSUNZbk-fIt1_0 2024-09-12T01:38:01.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.995+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11735997837856923881', time=2024-09-12T03:16:34.344039+0000, chain.objs.size()=1 2024-09-12T01:38:01.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.995+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.483__shadow_.gMIYZPOb0eSpoGJIinL9z2xCHm1RclY_0 2024-09-12T01:38:01.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.995+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14741215924840455716', time=2024-09-12T03:16:35.451236+0000, chain.objs.size()=1 2024-09-12T01:38:01.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.995+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.484__shadow_.TGX3X3nNDtOmcvDmfL5NzVIxW2B81Y-_0 2024-09-12T01:38:01.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.995+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8253946145341996923', time=2024-09-12T03:16:48.654580+0000, chain.objs.size()=1 2024-09-12T01:38:01.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.995+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.496__shadow_.i4jpoIFBP5Jujst-3S1nFew0bLxkStq_0 2024-09-12T01:38:01.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.995+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10331507394278589337', time=2024-09-12T03:22:12.967820+0000, chain.objs.size()=1 2024-09-12T01:38:01.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.995+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.550__shadow_.LP4WF71KCgFxK87DJib7BHE2jPLp3Gp_0 2024-09-12T01:38:01.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:00.998+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 0/44747 2024-09-12T01:38:01.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.000+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-12T01:38:01.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.000+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17066015336095311549', time=2024-09-12T03:23:08.778852+0000, chain.objs.size()=1 2024-09-12T01:38:01.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.000+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.569__shadow:TeXmAvTLHgai0McMg2Qf8JmMFjbhsr._.a7jP95-vuIpXlXzg0TMFPVqSoT1kzHa_0 2024-09-12T01:38:01.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.000+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10756384350224387531', time=2024-09-12T03:23:21.131533+0000, chain.objs.size()=1 2024-09-12T01:38:01.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.000+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.571__shadow_.vz5Cdd0siLlSZDLF-JCxVLjTgmWvfaW_0 2024-09-12T01:38:01.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.000+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2921458933535006234', time=2024-09-12T03:23:47.857198+0000, chain.objs.size()=1 2024-09-12T01:38:01.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.000+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.577__shadow:lN5BmumtT8gemDRb43VS6b.gC54loXE_._wwthRqOtWmDraxXb2UHSrHz7_CEwdR_0 2024-09-12T01:38:01.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.000+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17221686293165025614', time=2024-09-12T03:23:50.163099+0000, chain.objs.size()=1 2024-09-12T01:38:01.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.000+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.577__shadow:nRDq21q-irkf8DgGKXEdBTZyjK.J9yO_.dyxvsJ_Dt9XWla0UCVDyn3vNDZimzHM_0 2024-09-12T01:38:01.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.000+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9311640133794851230', time=2024-09-12T03:24:38.939469+0000, chain.objs.size()=1 2024-09-12T01:38:01.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.000+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.580__shadow:rti6lG5SjN5JArBCm7lt0wFRBt.7dmw_.czMrMk2GH347WN7UyZwy8vP-ngYA1Y4_0 2024-09-12T01:38:01.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.000+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12676603040623535755', time=2024-09-12T03:30:12.174705+0000, chain.objs.size()=1 2024-09-12T01:38:01.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.000+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.645__shadow_.P_GLD1CtHpuy_Do-Pel1axJFbQshjqR_0 2024-09-12T01:38:01.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.000+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17417638723694301489', time=2024-09-12T03:30:56.419163+0000, chain.objs.size()=6 2024-09-12T01:38:01.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.000+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.662__multipart_foo.2~I3v5LLBoUTNsyG4F8HSpgoL9L0dQeaa.1 2024-09-12T01:38:01.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.000+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.662__multipart_foo.2~I3v5LLBoUTNsyG4F8HSpgoL9L0dQeaa.2 2024-09-12T01:38:01.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.000+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.662__multipart_foo.2~I3v5LLBoUTNsyG4F8HSpgoL9L0dQeaa.3 2024-09-12T01:38:01.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.000+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.662__multipart_foo.2~I3v5LLBoUTNsyG4F8HSpgoL9L0dQeaa.4 2024-09-12T01:38:01.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.000+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.662__multipart_foo.2~I3v5LLBoUTNsyG4F8HSpgoL9L0dQeaa.5 2024-09-12T01:38:01.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.000+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.662__multipart_foo.2~I3v5LLBoUTNsyG4F8HSpgoL9L0dQeaa.6 2024-09-12T01:38:01.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.002+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18021537259546907452', time=2024-09-12T03:31:36.749661+0000, chain.objs.size()=1 2024-09-12T01:38:01.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.002+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.708__shadow:mqXTqTNdI3AgAQf-83ZgYFGuf06Pr43_.vGdx8GtqJ6GzmBojzr3nlIv2yopCKen_0 2024-09-12T01:38:01.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.002+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12456946882347664392', time=2024-09-12T03:31:41.121275+0000, chain.objs.size()=1 2024-09-12T01:38:01.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.002+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.713__shadow:6o-K6Kj-gW1k1XGqV8OqjEOOz5ombtC_.BWl6G5VC4CYenA-9kB2iDdNvW8fWuo__0 2024-09-12T01:38:01.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.003+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4191413387205675496', time=2024-09-12T03:32:05.049641+0000, chain.objs.size()=1 2024-09-12T01:38:01.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.003+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.718__shadow_.u8vQ0phgNrzi9wfjchwqsTizwAdqjyk_0 2024-09-12T01:38:01.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.004+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:38:01.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.006+0000 7f8786c98800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T01:38:01.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.008+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:38:01.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.008+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:38:01.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.009+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46921' 2024-09-12T01:38:01.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.009+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13282060466382562525', time=2024-09-12T03:06:19.304887+0000, chain.objs.size()=1 2024-09-12T01:38:01.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.009+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.157__shadow:EVxTTYtgbYzVIhx0uGwFwrQ0i2wfeOM_.umd6hw-B0ORCC0cIYVOFHwmFYPlYov9_0 2024-09-12T01:38:01.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.009+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37360527095740817', time=2024-09-12T03:10:08.728777+0000, chain.objs.size()=1 2024-09-12T01:38:01.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.009+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.233__shadow_.gCyNn6nEmIQNStSZPcqqxn2t0ETo2o0_0 2024-09-12T01:38:01.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.009+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11975258529916925923', time=2024-09-12T03:10:14.935874+0000, chain.objs.size()=1 2024-09-12T01:38:01.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.009+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.238__shadow_.Z6WYrKb2GhWo19oiYClzSyYMM4_g2Xq_0 2024-09-12T01:38:01.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.009+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6134649681104135744', time=2024-09-12T03:10:37.430168+0000, chain.objs.size()=1 2024-09-12T01:38:01.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.009+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.260__shadow_.nuPpOPf7UFFzgUGlTE6VGMDJNHhZnBn_0 2024-09-12T01:38:01.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.009+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2745001705394281549', time=2024-09-12T03:11:14.584838+0000, chain.objs.size()=1 2024-09-12T01:38:01.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.009+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.MElaPKca3Pq0ldyQzZVGnBHEcDDDxqC_0 2024-09-12T01:38:01.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.009+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14291009254737470889', time=2024-09-12T03:11:15.133894+0000, chain.objs.size()=1 2024-09-12T01:38:01.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.009+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.-nuqb9Z4C0Ah2i_FQ1L6skH76V5t7I7_0 2024-09-12T01:38:01.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.009+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9670176473530016383', time=2024-09-12T03:11:15.258798+0000, chain.objs.size()=1 2024-09-12T01:38:01.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.009+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.kpaBYAWZcw24iR-cN6Kc-rAyRTnjkN__0 2024-09-12T01:38:01.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.009+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1825287137925695189', time=2024-09-12T03:11:16.125969+0000, chain.objs.size()=1 2024-09-12T01:38:01.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.009+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.dgkFL3bM76u6vAK6mku-BJsKKuJxd-O_0 2024-09-12T01:38:01.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.009+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10219366823301457041', time=2024-09-12T03:11:16.704439+0000, chain.objs.size()=1 2024-09-12T01:38:01.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.009+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.PYObSZsXgKNU4dC6ETIppGZpm2RNe6Z_0 2024-09-12T01:38:01.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.009+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10263248516845678239', time=2024-09-12T03:11:17.550252+0000, chain.objs.size()=1 2024-09-12T01:38:01.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.009+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.g6FJys9rofxfGUq_XOcTy4uCf0rD3Zn_0 2024-09-12T01:38:01.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.009+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4929919398961026206', time=2024-09-12T03:11:17.910680+0000, chain.objs.size()=1 2024-09-12T01:38:01.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.009+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.HyUUj0tymSmInvsPWeK9IjsXvSG9rZz_0 2024-09-12T01:38:01.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.009+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12945372212137440636', time=2024-09-12T03:11:18.830845+0000, chain.objs.size()=1 2024-09-12T01:38:01.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.009+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.8nKFgpz9_XuWMIodAKnya41qmgxo-Oy_0 2024-09-12T01:38:01.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.013+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8067480173509410484', time=2024-09-12T03:11:18.934524+0000, chain.objs.size()=1 2024-09-12T01:38:01.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.013+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.bx79inxE6k-3VVR7DRNrYrprCvakNN1_0 2024-09-12T01:38:01.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.013+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6631741008452463738', time=2024-09-12T03:11:20.238471+0000, chain.objs.size()=1 2024-09-12T01:38:01.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.013+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.RmWuTDa02dK5kqUtOzjXZOvTULcg0sB_0 2024-09-12T01:38:01.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.013+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12823868893522231681', time=2024-09-12T03:11:20.380462+0000, chain.objs.size()=1 2024-09-12T01:38:01.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.013+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.L38ViT7aPHh0COCij5NUNiUjsJd84lT_0 2024-09-12T01:38:01.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.013+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8936047518673226893', time=2024-09-12T03:11:20.639737+0000, chain.objs.size()=1 2024-09-12T01:38:01.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.013+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Y0nzwI5rwE7PnHaQObTxXiaJqHp3w5f_0 2024-09-12T01:38:01.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.013+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14487314614081228208', time=2024-09-12T03:11:21.662597+0000, chain.objs.size()=1 2024-09-12T01:38:01.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.013+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Sbh_4I-MU2GvFqJbwvdUYIqQ7-dE5Ki_0 2024-09-12T01:38:01.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.013+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18371344731500242021', time=2024-09-12T03:11:22.235387+0000, chain.objs.size()=1 2024-09-12T01:38:01.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.013+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.fd27O5XfABSA94WG-Oq37h-YOTTYqwt_0 2024-09-12T01:38:01.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.013+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9117348801308556243', time=2024-09-12T03:11:23.420071+0000, chain.objs.size()=1 2024-09-12T01:38:01.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.013+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.QNWTPA-8ho2AZg_Yz-CNyU56lfrkSaS_0 2024-09-12T01:38:01.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.013+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10239094582809098119', time=2024-09-12T03:11:23.532965+0000, chain.objs.size()=1 2024-09-12T01:38:01.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.013+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.6-oNbWsbM_ba28BrACU9FXlIJmQeLVq_0 2024-09-12T01:38:01.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.013+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7885948421125448368', time=2024-09-12T03:11:23.606154+0000, chain.objs.size()=1 2024-09-12T01:38:01.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.013+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.H3_Hs4R2uoS7G_R2uC2Cq-BWOJFaGsg_0 2024-09-12T01:38:01.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.013+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16849566607186226350', time=2024-09-12T03:11:23.635752+0000, chain.objs.size()=1 2024-09-12T01:38:01.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.013+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.VTmdJVH3r0xCrtiyWpeBE1vQHs11BwO_0 2024-09-12T01:38:01.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.013+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3961896426544132743', time=2024-09-12T03:11:23.762685+0000, chain.objs.size()=1 2024-09-12T01:38:01.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.013+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.H-go4ML5kBVPSfb5b81LfCUgnl8MyUf_0 2024-09-12T01:38:01.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.015+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12651007629120285344', time=2024-09-12T03:11:24.162877+0000, chain.objs.size()=1 2024-09-12T01:38:01.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.015+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.CESr49A824RXEZmN-MZkv2m2Yz7s7pb_0 2024-09-12T01:38:01.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.016+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14051607849857786475', time=2024-09-12T03:11:24.887131+0000, chain.objs.size()=1 2024-09-12T01:38:01.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.016+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.LkIQn_Hsu8tngCvOGTRi_lPVlyLm3TE_0 2024-09-12T01:38:01.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.016+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.938737291839988467', time=2024-09-12T03:11:50.844793+0000, chain.objs.size()=1 2024-09-12T01:38:01.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.016+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.289__shadow_.RAPChjPm3PgksLE0js1oGKxlXiIR-FQ_0 2024-09-12T01:38:01.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.016+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7699226428583839369', time=2024-09-12T03:11:55.406693+0000, chain.objs.size()=1 2024-09-12T01:38:01.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.016+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.292__shadow_.LkcJjNiCFKIz54XR7aR0DoDdY3eoOVt_0 2024-09-12T01:38:01.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.016+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6365887238456227010', time=2024-09-12T03:11:57.468149+0000, chain.objs.size()=1 2024-09-12T01:38:01.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.016+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.293__shadow_.GklMawTOuWCYBWAyHWfNRItKXAgxYsL_0 2024-09-12T01:38:01.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.016+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15960174149110705910', time=2024-09-12T03:11:57.530446+0000, chain.objs.size()=1 2024-09-12T01:38:01.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.016+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.293__shadow_.SzswsR7NQI_fufuLVqFsDrfDERNcHMi_0 2024-09-12T01:38:01.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.016+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3528481058189195982', time=2024-09-12T03:11:58.572463+0000, chain.objs.size()=1 2024-09-12T01:38:01.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.016+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.294__shadow_.LsFFBGL1POzkkzDut4CvgCjC3TQq5Nn_0 2024-09-12T01:38:01.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.016+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9676064612679930530', time=2024-09-12T03:12:00.547548+0000, chain.objs.size()=1 2024-09-12T01:38:01.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.016+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.296__shadow_.ZnmLhRk9OwErERN-ntdLGUIuV2fTBYY_0 2024-09-12T01:38:01.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.016+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4920323793553813045', time=2024-09-12T03:12:02.681414+0000, chain.objs.size()=1 2024-09-12T01:38:01.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.016+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.298__shadow_.HsZe3uj9KsDIz4lXzCxmf9ikCHy39Ki_0 2024-09-12T01:38:01.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.016+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7928365538688143613', time=2024-09-12T03:12:08.545868+0000, chain.objs.size()=1 2024-09-12T01:38:01.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.016+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.304__shadow_.RqdHSEKzYn2a8Lx65ue24G_nzXl1bVd_0 2024-09-12T01:38:01.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.016+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11183955339046157732', time=2024-09-12T03:12:28.943540+0000, chain.objs.size()=1 2024-09-12T01:38:01.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.016+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.321__shadow_.h2sV8l3_ZpdkLtY3tvN7qAh3s-lR9yQ_0 2024-09-12T01:38:01.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.019+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4927775059628558574', time=2024-09-12T03:13:07.118311+0000, chain.objs.size()=1 2024-09-12T01:38:01.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.019+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.33_wZcVeqjU92BDBChMo0Mm4t7gXtTT_0 2024-09-12T01:38:01.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.019+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.896763652448375411', time=2024-09-12T03:13:07.152106+0000, chain.objs.size()=1 2024-09-12T01:38:01.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.019+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.X2EKB7nuRtjmdp0ubSfthxBF3_QG22O_0 2024-09-12T01:38:01.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.019+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17895687767237135064', time=2024-09-12T03:13:07.367777+0000, chain.objs.size()=1 2024-09-12T01:38:01.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.019+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.g9tRZYWh-XDYpsGBlj5k7dmpTxvqMaj_0 2024-09-12T01:38:01.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.019+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4573194430760557875', time=2024-09-12T03:13:07.648646+0000, chain.objs.size()=1 2024-09-12T01:38:01.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.019+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.U2AsNFMOHdgeH7p3jOgkd2JxQ0JqR1q_0 2024-09-12T01:38:01.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.019+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17933167089762934935', time=2024-09-12T03:13:08.290366+0000, chain.objs.size()=1 2024-09-12T01:38:01.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.019+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.tjQgZryhFn_hCtT0E9-AUbsQmHRk3xr_0 2024-09-12T01:38:01.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.019+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8571776218847976436', time=2024-09-12T03:13:08.344557+0000, chain.objs.size()=1 2024-09-12T01:38:01.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.019+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.JfD0Nmmp1xEhbrNqdxDjf_h9nczxnVZ_0 2024-09-12T01:38:01.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.019+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14510066958324568865', time=2024-09-12T03:13:08.467478+0000, chain.objs.size()=1 2024-09-12T01:38:01.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.019+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.PZgummjjBDoAOCTblLABUmGtncpQSso_0 2024-09-12T01:38:01.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.020+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8935727944835798251', time=2024-09-12T03:13:08.795053+0000, chain.objs.size()=1 2024-09-12T01:38:01.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.020+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.jebjUfOngVBpFNtkZfi9iNO_7lgAAYf_0 2024-09-12T01:38:01.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.020+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2584012708267445312', time=2024-09-12T03:13:08.930852+0000, chain.objs.size()=1 2024-09-12T01:38:01.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.020+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.XG96jPpqLFI4mPIh9CZI-909Elr-L60_0 2024-09-12T01:38:01.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.020+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10871326773632718799', time=2024-09-12T03:13:09.923596+0000, chain.objs.size()=1 2024-09-12T01:38:01.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.020+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.GSlShP7-QdfdZ0kV5usdyTaYiZyvYWs_0 2024-09-12T01:38:01.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.020+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14449741093595557945', time=2024-09-12T03:13:10.024465+0000, chain.objs.size()=1 2024-09-12T01:38:01.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.020+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.MpL-4PhNh1dVR1GcF2nA5NRGOzUnxLA_0 2024-09-12T01:38:01.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.022+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12906377671274432166', time=2024-09-12T03:13:10.104013+0000, chain.objs.size()=1 2024-09-12T01:38:01.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.022+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_._8n2vYA_rZV1wK7M8bfra3l5ExtF5wg_0 2024-09-12T01:38:01.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.022+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12010824970709082502', time=2024-09-12T03:13:10.678513+0000, chain.objs.size()=1 2024-09-12T01:38:01.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.022+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.viN6JpzrEV3U1UAZ99mNfCiBdN30ZDC_0 2024-09-12T01:38:01.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.025+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8548012797031288907', time=2024-09-12T03:13:11.230533+0000, chain.objs.size()=1 2024-09-12T01:38:01.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.025+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.zZFNXWbvonFkaXyru4qsyl44TXgYHH-_0 2024-09-12T01:38:01.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.025+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11297744067228541139', time=2024-09-12T03:13:11.344630+0000, chain.objs.size()=1 2024-09-12T01:38:01.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.025+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.O8_a8t69eJ3bK3bEf3wjqqA1NlHuI9P_0 2024-09-12T01:38:01.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.025+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15160551545779512445', time=2024-09-12T03:13:12.512208+0000, chain.objs.size()=1 2024-09-12T01:38:01.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.025+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.PpvVOF2izMhXpJxOiH0WpePCbSl6wLr_0 2024-09-12T01:38:01.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.025+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8886910837832684056', time=2024-09-12T03:13:12.868593+0000, chain.objs.size()=1 2024-09-12T01:38:01.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.025+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_._hz5hjGJSzIL9tXeF84EEh8GZQwZ6d-_0 2024-09-12T01:38:01.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.026+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6577292850316183097', time=2024-09-12T03:13:13.347299+0000, chain.objs.size()=1 2024-09-12T01:38:01.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.026+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.PNaeuilIwa_y4CRz0hBISauGw6tLV1U_0 2024-09-12T01:38:01.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.026+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8966715347721770342', time=2024-09-12T03:13:13.384884+0000, chain.objs.size()=1 2024-09-12T01:38:01.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.026+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.yg5B8tPsvaLYqy7e3eTwBl3m5_Tk-ZW_0 2024-09-12T01:38:01.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.026+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16267943288221280798', time=2024-09-12T03:13:13.468452+0000, chain.objs.size()=1 2024-09-12T01:38:01.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.026+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.20KbXjPBMdrLShJJl6NOn5RBx7EXeSM_0 2024-09-12T01:38:01.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.026+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2411488534864122738', time=2024-09-12T03:13:13.484400+0000, chain.objs.size()=1 2024-09-12T01:38:01.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.026+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.ODrjaDsaNysgmH1D3LVBdCRHAf-_Qpa_0 2024-09-12T01:38:01.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.026+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4524094435670253637', time=2024-09-12T03:13:14.381377+0000, chain.objs.size()=1 2024-09-12T01:38:01.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.026+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.jfntPvFIMLaQXugjHWu3S1IfOEI0SEA_0 2024-09-12T01:38:01.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.026+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15223271008071087060', time=2024-09-12T03:13:14.397087+0000, chain.objs.size()=1 2024-09-12T01:38:01.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.026+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.1cN8HEV-4dnaWSB1fpp5NY2hEfEwooq_0 2024-09-12T01:38:01.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.026+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12619273061434170522', time=2024-09-12T03:13:14.662294+0000, chain.objs.size()=1 2024-09-12T01:38:01.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.026+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.n3PdoOHyzolKkXFJQR1UfRsXRa1b1SF_0 2024-09-12T01:38:01.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.031+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16993319473616181007', time=2024-09-12T03:13:15.410452+0000, chain.objs.size()=1 2024-09-12T01:38:01.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.031+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.a1d_5IUX8dA8u_pbqnVKBH0FmfJXJr9_0 2024-09-12T01:38:01.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.031+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.26672775973080034', time=2024-09-12T03:13:15.665535+0000, chain.objs.size()=1 2024-09-12T01:38:01.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.031+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.mMsmOz4CP0ML_BXH9TI6x0phLU9wPgq_0 2024-09-12T01:38:01.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.031+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2305843162760009953', time=2024-09-12T03:13:16.513719+0000, chain.objs.size()=1 2024-09-12T01:38:01.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.031+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.R2_8aPq2lSwP182nUW7Zy2AQZxYLth__0 2024-09-12T01:38:01.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.031+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4696380593008368410', time=2024-09-12T03:13:16.624721+0000, chain.objs.size()=1 2024-09-12T01:38:01.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.031+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.JF_HunymWXVQGWOYXIRzBQNUupxpt-z_0 2024-09-12T01:38:01.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.031+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1793685356635073910', time=2024-09-12T03:13:17.082437+0000, chain.objs.size()=1 2024-09-12T01:38:01.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.031+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.jNYg1_3sbSCMi3diTA-0jJzseZIGPnO_0 2024-09-12T01:38:01.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.031+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12290064038014693128', time=2024-09-12T03:13:54.151312+0000, chain.objs.size()=1 2024-09-12T01:38:01.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.031+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.dUhtYI68VSTiGsuf4TmbAjUy4NXSnAT_0 2024-09-12T01:38:01.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.031+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14363581882903106026', time=2024-09-12T03:13:55.173960+0000, chain.objs.size()=1 2024-09-12T01:38:01.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.031+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.0OXCpMKDlN53uXoCAqkiVBRss4_fnMG_0 2024-09-12T01:38:01.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.031+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4655845602825312238', time=2024-09-12T03:13:55.511107+0000, chain.objs.size()=1 2024-09-12T01:38:01.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.031+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.ZGHAkoedBZqcmkx6XPEPveXqdD3Kdj__0 2024-09-12T01:38:01.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.031+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10656657903836699907', time=2024-09-12T03:13:55.619187+0000, chain.objs.size()=1 2024-09-12T01:38:01.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.031+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.1OfuWA_ij-R3bm8E1JMdQ6BcyChPOT5_0 2024-09-12T01:38:01.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.031+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4937957572614626147', time=2024-09-12T03:13:55.731266+0000, chain.objs.size()=1 2024-09-12T01:38:01.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.031+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.D05Q-PdVSU69g4j6cEnnaYbTwGGl9Qg_0 2024-09-12T01:38:01.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.031+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12212467165033926649', time=2024-09-12T03:13:55.812540+0000, chain.objs.size()=1 2024-09-12T01:38:01.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.031+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.opi81pECz17hQHFIi5lbSQDn5Q-b7nf_0 2024-09-12T01:38:01.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.033+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5340799580465963735', time=2024-09-12T03:13:55.863268+0000, chain.objs.size()=1 2024-09-12T01:38:01.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.033+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.eY47Lzac8sOrCtDpTP9b_9JaLFTqm11_0 2024-09-12T01:38:01.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.034+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4877160812576249587', time=2024-09-12T03:13:55.934293+0000, chain.objs.size()=1 2024-09-12T01:38:01.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.034+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_._3xn39uo73AuEbeyf7SulkXUcN13YiI_0 2024-09-12T01:38:01.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.034+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4031537682231230766', time=2024-09-12T03:13:56.486073+0000, chain.objs.size()=1 2024-09-12T01:38:01.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.034+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.yyJzzvlmri1-oeGCpArHN8wy1TLyQ3R_0 2024-09-12T01:38:01.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.034+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2647625880790092184', time=2024-09-12T03:13:56.635629+0000, chain.objs.size()=1 2024-09-12T01:38:01.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.034+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.kwEXuhRQuBu_z1x8I2Gk5V87uj--GrS_0 2024-09-12T01:38:01.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.034+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.543952059291157900', time=2024-09-12T03:13:56.757533+0000, chain.objs.size()=1 2024-09-12T01:38:01.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.034+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.sL2tXgmnYjcmL504fOPLs05FagRhoJZ_0 2024-09-12T01:38:01.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.034+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12252343591990513158', time=2024-09-12T03:13:56.869669+0000, chain.objs.size()=1 2024-09-12T01:38:01.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.034+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.cBb3idx4HIGwUvsWK950q-aEDqEimNe_0 2024-09-12T01:38:01.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.034+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9274166493555266803', time=2024-09-12T03:13:56.963823+0000, chain.objs.size()=1 2024-09-12T01:38:01.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.034+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.USgc0GHejqtMYKK3p2eTVoA1EYslXGR_0 2024-09-12T01:38:01.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.034+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10426616871459591134', time=2024-09-12T03:13:57.824859+0000, chain.objs.size()=1 2024-09-12T01:38:01.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.034+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.LnttHKq_5tPHyQBTing12X7On1dMbir_0 2024-09-12T01:38:01.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.034+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14717706419182346807', time=2024-09-12T03:13:57.992853+0000, chain.objs.size()=1 2024-09-12T01:38:01.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.034+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.EFBLuc0mMqYWzg_j9bmJPhOpYMKxfZ1_0 2024-09-12T01:38:01.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.034+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6528348246211174292', time=2024-09-12T03:13:58.076678+0000, chain.objs.size()=1 2024-09-12T01:38:01.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.034+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.-2yOsxsusHIAfG1lcsNC7KkH2L3OIgk_0 2024-09-12T01:38:01.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.034+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6680179569108209458', time=2024-09-12T03:13:58.131406+0000, chain.objs.size()=1 2024-09-12T01:38:01.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.034+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.gbGctHDfpNKBHtG6FKqCAOeIAdpGzfH_0 2024-09-12T01:38:01.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.034+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15581392588158727993', time=2024-09-12T03:13:58.303445+0000, chain.objs.size()=1 2024-09-12T01:38:01.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.034+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.uJl18TV-50B5LtwyR1GZACrqJS_htqD_0 2024-09-12T01:38:01.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.036+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14501409303805260214', time=2024-09-12T03:13:58.370513+0000, chain.objs.size()=1 2024-09-12T01:38:01.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.036+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.0PvCESGBplXt0T-bNhYtv6xqlhFzWcK_0 2024-09-12T01:38:01.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.036+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15786659318715860847', time=2024-09-12T03:13:58.787512+0000, chain.objs.size()=1 2024-09-12T01:38:01.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.036+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.UXtyvcvIfy10dXuUBthzI1X8u6d--9U_0 2024-09-12T01:38:01.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.036+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9546674837023158790', time=2024-09-12T03:13:59.433449+0000, chain.objs.size()=1 2024-09-12T01:38:01.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.036+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.P89L3JaIQRq-VjvbfK8roiroAcrUVD-_0 2024-09-12T01:38:01.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.037+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1525718622287987880', time=2024-09-12T03:13:59.448825+0000, chain.objs.size()=1 2024-09-12T01:38:01.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.037+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.v4cJ36RU0R15vn589tLdgcttPeQ2_cz_0 2024-09-12T01:38:01.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.037+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16006707324956906567', time=2024-09-12T03:13:59.720229+0000, chain.objs.size()=1 2024-09-12T01:38:01.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.037+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.FX7_abbFda8T6Sa-0w8BHgjK2ByiLg0_0 2024-09-12T01:38:01.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.037+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9394047328333123456', time=2024-09-12T03:14:00.452606+0000, chain.objs.size()=1 2024-09-12T01:38:01.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.037+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.JKXtc2DARiy94v1nop-rv4UC4y16C5j_0 2024-09-12T01:38:01.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.037+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10126546386180963275', time=2024-09-12T03:14:01.709935+0000, chain.objs.size()=1 2024-09-12T01:38:01.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.037+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.NUp2VR-CyCn_5n50YAIqCL9snWwE6jj_0 2024-09-12T01:38:01.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.037+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15955596844237386993', time=2024-09-12T03:14:01.949379+0000, chain.objs.size()=1 2024-09-12T01:38:01.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.037+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.eDY_MDJu8YouUlaQLrIS_gFo2bBE9xE_0 2024-09-12T01:38:01.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.037+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11525021326652500342', time=2024-09-12T03:14:02.475175+0000, chain.objs.size()=1 2024-09-12T01:38:01.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.037+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.ZvKD3egfL7cIWhl3cucp5CAgZczrpb5_0 2024-09-12T01:38:01.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.037+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11168783366457296511', time=2024-09-12T03:14:02.609425+0000, chain.objs.size()=1 2024-09-12T01:38:01.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.037+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.rgxqlIvR0nR0FZqSwWPFfdDpuWjxEtm_0 2024-09-12T01:38:01.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.037+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7789194327967442457', time=2024-09-12T03:14:03.211317+0000, chain.objs.size()=1 2024-09-12T01:38:01.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.037+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.M3iCbIEpjuPpmJGaaoSCx88Nd5gcuXG_0 2024-09-12T01:38:01.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.037+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16753685487994901722', time=2024-09-12T03:14:03.553266+0000, chain.objs.size()=1 2024-09-12T01:38:01.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.037+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.lN77JCsMcGSbxLWE4sfIJundUOXvZIz_0 2024-09-12T01:38:01.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.037+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4041029054408956666', time=2024-09-12T03:14:19.642119+0000, chain.objs.size()=1 2024-09-12T01:38:01.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.038+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.341__shadow_.RFKtZefrjWQuyVBOeVpws6_XqQQAo7j_0 2024-09-12T01:38:01.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.038+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9232226896340834703', time=2024-09-12T03:14:53.173587+0000, chain.objs.size()=1 2024-09-12T01:38:01.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.038+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.379__shadow_.4nmh4mzoaRmIk8mlR-2ogye469e2Nca_0 2024-09-12T01:38:01.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.039+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8098176403251444858', time=2024-09-12T03:17:43.777994+0000, chain.objs.size()=1 2024-09-12T01:38:01.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.039+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.518__multipart_mymultipart.2~Xokf45oIFTVcaXQfhTybowz9rReRjxu.1 2024-09-12T01:38:01.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.039+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16445759944278834391', time=2024-09-12T03:19:45.922640+0000, chain.objs.size()=6 2024-09-12T01:38:01.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.039+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.522__multipart_mymultipart.2~0sETi2zh6twdMaygo6dyYUApZWIMCB9.1 2024-09-12T01:38:01.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.040+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.522__multipart_mymultipart.2~0sETi2zh6twdMaygo6dyYUApZWIMCB9.2 2024-09-12T01:38:01.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.040+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.522__multipart_mymultipart.TI0uIxOkQs3Yb6FR4GvJSKD4hD1UirLn.3 2024-09-12T01:38:01.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.043+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.522__multipart_mymultipart.2~0sETi2zh6twdMaygo6dyYUApZWIMCB9.4 2024-09-12T01:38:01.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.043+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.522__multipart_mymultipart.2~0sETi2zh6twdMaygo6dyYUApZWIMCB9.5 2024-09-12T01:38:01.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.043+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.522__multipart_mymultipart.2~0sETi2zh6twdMaygo6dyYUApZWIMCB9.6 2024-09-12T01:38:01.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.043+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4033178954550046365', time=2024-09-12T03:23:10.547317+0000, chain.objs.size()=1 2024-09-12T01:38:01.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.043+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.569__shadow:5z7RZkyxkbYHpQmCVVioiIaYZ.5XOiS_.G7aMeXXTmfKzxCxdPwDlR4Bmh8oY5vr_0 2024-09-12T01:38:01.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.043+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4656487074095676474', time=2024-09-12T03:23:18.024213+0000, chain.objs.size()=1 2024-09-12T01:38:01.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.043+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.569__shadow:IXDyg9.j3iRa6uacBUU5turRhovUo2b_.Lo-lZ_W3ToCB7jMncezX8WxPFfQmf3j_0 2024-09-12T01:38:01.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.043+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7828449302652904402', time=2024-09-12T03:23:39.915864+0000, chain.objs.size()=1 2024-09-12T01:38:01.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.043+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.577__shadow:Yqeb.heqy3Jp8MJF6JW3W-Hd4RbIgb7_.eoRhcz24CGT_7PhUhPVwhYaIi9Y2_Hj_0 2024-09-12T01:38:01.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.046+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 0/46921 2024-09-12T01:38:01.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.048+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T01:38:01.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.048+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2376751780872016321', time=2024-09-12T03:23:42.734854+0000, chain.objs.size()=1 2024-09-12T01:38:01.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.048+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.577__shadow:T9JFtSUZmnldmcuWpHviQXoH3MNFKQk_.reAmFr5V_ArQFdjXgIFQOzXgsiAp6ue_0 2024-09-12T01:38:01.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.048+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8165312200224866063', time=2024-09-12T03:24:47.925506+0000, chain.objs.size()=1 2024-09-12T01:38:01.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.048+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.587__shadow:9IpEJzzFn3SekCw8SzWMVh5.a2ToUPX_.u7ZyGHf9ZXc4kJUudlEwxSGKhFExORe_0 2024-09-12T01:38:01.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.048+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14192979883467870069', time=2024-09-12T03:25:04.407044+0000, chain.objs.size()=1 2024-09-12T01:38:01.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.048+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.606__shadow_.qE5FZMbX1WOQ3k70oy3PhJ2kRzxD6yL_0 2024-09-12T01:38:01.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.048+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3702309982000313631', time=2024-09-12T03:29:53.545929+0000, chain.objs.size()=1 2024-09-12T01:38:01.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.048+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.631__shadow_.IQTHrlSa2DXQ2A8RrkNBGLAuCL3I34d_0 2024-09-12T01:38:01.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.048+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15740814335159879894', time=2024-09-12T03:30:16.724971+0000, chain.objs.size()=1 2024-09-12T01:38:01.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.048+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.647__shadow_.MYztcRV5ZuELM1OKG6cF2JghtoySppK_0 2024-09-12T01:38:01.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.048+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5116740672596094654', time=2024-09-12T03:31:01.997025+0000, chain.objs.size()=1 2024-09-12T01:38:01.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.048+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.666__shadow_.qrFya15Ek3uBHugiHiKReRmWZN9bOyM_0 2024-09-12T01:38:01.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.051+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:38:01.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.054+0000 7f8786c98800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T01:38:01.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.055+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:38:01.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.055+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:38:01.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.056+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48153' 2024-09-12T01:38:01.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.056+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13361846119070171018', time=2024-09-12T03:06:27.721016+0000, chain.objs.size()=2 2024-09-12T01:38:01.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.056+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.158__shadow_.PXDnNQvcoEDww_5_tzzXEyaO44eBv_u_0 2024-09-12T01:38:01.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.056+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.158__shadow_.PXDnNQvcoEDww_5_tzzXEyaO44eBv_u_1 2024-09-12T01:38:01.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.056+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.122282386682098260', time=2024-09-12T03:10:14.948460+0000, chain.objs.size()=1 2024-09-12T01:38:01.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.056+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.238__shadow_.mR-GHzJuebr-KtcM_gpvNZQgAhUrf1S_0 2024-09-12T01:38:01.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.056+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16291692989657574110', time=2024-09-12T03:10:20.276188+0000, chain.objs.size()=1 2024-09-12T01:38:01.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.056+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.243__shadow_.usWJ_J4Zv7EazNkicqsJZapz0v8OVC5_0 2024-09-12T01:38:01.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.056+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5763361307583246369', time=2024-09-12T03:10:24.932582+0000, chain.objs.size()=1 2024-09-12T01:38:01.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.056+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.247__shadow_.jlV6qd8mJWV5gg0G9Nmg8u2N483n1Xs_0 2024-09-12T01:38:01.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.056+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7499232861766862346', time=2024-09-12T03:10:27.865003+0000, chain.objs.size()=1 2024-09-12T01:38:01.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.056+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.250__shadow_.o29Qz0CZPgknBU5I0U0aNWrCIvKbSr7_0 2024-09-12T01:38:01.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.056+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10140389335164392356', time=2024-09-12T03:10:28.825597+0000, chain.objs.size()=1 2024-09-12T01:38:01.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.056+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.251__shadow_.kkk1T4J-L7aUoE5A5r7D1Zp7slnEQ-A_0 2024-09-12T01:38:01.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.056+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7397257239369575730', time=2024-09-12T03:10:30.748377+0000, chain.objs.size()=1 2024-09-12T01:38:01.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.056+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.253__shadow_.vjGUbRtYl45HCUkMhoLOa3DUsG4CcXI_0 2024-09-12T01:38:01.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.056+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10904628662312066518', time=2024-09-12T03:11:14.466650+0000, chain.objs.size()=1 2024-09-12T01:38:01.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.056+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.gWXgjoNV1Jql_MHtKmrfmM3qyTdoAQ8_0 2024-09-12T01:38:01.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.056+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13766298200353743021', time=2024-09-12T03:11:14.787743+0000, chain.objs.size()=1 2024-09-12T01:38:01.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.056+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.GWWXPGfTjCBRTPJxTGNdERtHOZ3QeZJ_0 2024-09-12T01:38:01.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.056+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15261910174116614925', time=2024-09-12T03:11:14.788366+0000, chain.objs.size()=1 2024-09-12T01:38:01.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.056+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.P-uUNSLn-PkdgNEw1CYT3alyr9PpB_u_0 2024-09-12T01:38:01.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.056+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17177515739334854580', time=2024-09-12T03:11:15.045774+0000, chain.objs.size()=1 2024-09-12T01:38:01.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.056+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.RDJ8dRBglnCXNPJUGmiB1Fd-AXwiW1B_0 2024-09-12T01:38:01.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.061+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6917753270712251984', time=2024-09-12T03:11:15.169841+0000, chain.objs.size()=1 2024-09-12T01:38:01.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.061+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.647mXRPn0iAC5tgVPNoj-7Cq4Jq0XoV_0 2024-09-12T01:38:01.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.061+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.898056503556160413', time=2024-09-12T03:11:16.186115+0000, chain.objs.size()=1 2024-09-12T01:38:01.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.061+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.FGWyeVH0_-nPDUwgLjHuZSf4yG27c07_0 2024-09-12T01:38:01.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.061+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14383202574480645077', time=2024-09-12T03:11:16.359089+0000, chain.objs.size()=1 2024-09-12T01:38:01.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.061+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.nCIyqaxxTN4ARb0FJbkuYY7-URAQ_mI_0 2024-09-12T01:38:01.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.061+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14723448889081533058', time=2024-09-12T03:11:16.497916+0000, chain.objs.size()=1 2024-09-12T01:38:01.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.061+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.UhhiUbf2FvgpaE4JRKC060z8_FFtKmX_0 2024-09-12T01:38:01.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.061+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6029079200930820881', time=2024-09-12T03:11:16.523108+0000, chain.objs.size()=1 2024-09-12T01:38:01.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.061+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.HC4JEntgvgx0KyYha5Bxj77OWptc9wt_0 2024-09-12T01:38:01.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.061+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17524866348362280074', time=2024-09-12T03:11:16.581492+0000, chain.objs.size()=1 2024-09-12T01:38:01.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.061+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.QaHUWUFGM5kBXnINWkZQQpyDqmzVijP_0 2024-09-12T01:38:01.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.061+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11019213494682432879', time=2024-09-12T03:11:19.350543+0000, chain.objs.size()=1 2024-09-12T01:38:01.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.061+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.gEBBPBcJpKlB-y8rnHNFahqEHgMq2Ve_0 2024-09-12T01:38:01.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.061+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18355195124362605303', time=2024-09-12T03:11:19.557349+0000, chain.objs.size()=1 2024-09-12T01:38:01.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.061+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.xluCoYvVerkkRwm87GRa41nZUTQRrSh_0 2024-09-12T01:38:01.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.061+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12020814709021968818', time=2024-09-12T03:11:20.318806+0000, chain.objs.size()=1 2024-09-12T01:38:01.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.061+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.RWdID2jrZUBgmQdRcpR4lYhYs2YYA8U_0 2024-09-12T01:38:01.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.061+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10696613345924970904', time=2024-09-12T03:11:20.494178+0000, chain.objs.size()=1 2024-09-12T01:38:01.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.061+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.w_VZuCGnNpl67PUJlj9koC5BbASwW34_0 2024-09-12T01:38:01.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.061+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15365679614379895542', time=2024-09-12T03:11:21.192783+0000, chain.objs.size()=1 2024-09-12T01:38:01.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.061+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.P5uyVh3pk4kv4PGw_C_xPfXy4tO9NFH_0 2024-09-12T01:38:01.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.062+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9226133260725055727', time=2024-09-12T03:11:21.538290+0000, chain.objs.size()=1 2024-09-12T01:38:01.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.062+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.RHjTI5TsyyM1vS2NC0ynmiE3CJsXXOe_0 2024-09-12T01:38:01.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.062+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8248038594935488109', time=2024-09-12T03:11:21.947447+0000, chain.objs.size()=1 2024-09-12T01:38:01.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.062+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.lR4xtmw0CLKJMQZCWcmBkIFiTRs86yV_0 2024-09-12T01:38:01.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.066+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8795335837157490311', time=2024-09-12T03:11:22.828718+0000, chain.objs.size()=1 2024-09-12T01:38:01.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.066+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.mlPDzQQ68Vg7IcAjiOxdJjA1FHVLLzm_0 2024-09-12T01:38:01.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.066+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15105054329376873174', time=2024-09-12T03:11:23.472340+0000, chain.objs.size()=1 2024-09-12T01:38:01.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.066+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.4dGnyuYJUEdZhQVFZfKIwm-fc3QzahQ_0 2024-09-12T01:38:01.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.066+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2981749961511651782', time=2024-09-12T03:11:23.473106+0000, chain.objs.size()=1 2024-09-12T01:38:01.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.066+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.edBv6xhI7JMwkauMXYupsEi0j8-OJlB_0 2024-09-12T01:38:01.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.066+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18173220046280109967', time=2024-09-12T03:11:24.278294+0000, chain.objs.size()=1 2024-09-12T01:38:01.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.066+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.RtzEvnF05xxu8I1HU1Lup_Aj12xLx40_0 2024-09-12T01:38:01.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.066+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4936689688347090917', time=2024-09-12T03:11:24.388964+0000, chain.objs.size()=1 2024-09-12T01:38:01.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.066+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.P0D8WYIiTgZXoIMB1WPGQWxdXvjCzaF_0 2024-09-12T01:38:01.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.066+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15132204928495763420', time=2024-09-12T03:11:24.417703+0000, chain.objs.size()=1 2024-09-12T01:38:01.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.066+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.QFNwB6fnB0g_ek0wleHWWICn9A4Svs9_0 2024-09-12T01:38:01.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.067+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18014865521104148170', time=2024-09-12T03:11:24.721811+0000, chain.objs.size()=1 2024-09-12T01:38:01.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.067+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.9PPpMp8K6KxMeL84U2Zdsm-SbA7iA3H_0 2024-09-12T01:38:01.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.067+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15095568025300216354', time=2024-09-12T03:11:24.867846+0000, chain.objs.size()=1 2024-09-12T01:38:01.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.067+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.0hlPJJkLb87eyG5bsj3VWMf90SLTvU6_0 2024-09-12T01:38:01.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.067+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18124813120453537390', time=2024-09-12T03:11:26.816446+0000, chain.objs.size()=1 2024-09-12T01:38:01.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.067+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.264__shadow_.BGkxbtmkRGLU7BFBPPgTiMjWjFHD0aa_0 2024-09-12T01:38:01.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.067+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14266825796864662925', time=2024-09-12T03:11:30.528404+0000, chain.objs.size()=1 2024-09-12T01:38:01.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.067+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.268__shadow_.yft1OLRC6OnrcxgpkvLD4sbz-rXyd0__0 2024-09-12T01:38:01.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.067+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17340857336093106289', time=2024-09-12T03:11:57.508951+0000, chain.objs.size()=1 2024-09-12T01:38:01.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.067+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.293__shadow_.Y_4N7L5lSHP3iLvYhpucMk4ZDThKg5Z_0 2024-09-12T01:38:01.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.068+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17043576282103074056', time=2024-09-12T03:11:57.586278+0000, chain.objs.size()=1 2024-09-12T01:38:01.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.068+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.293__shadow_.PswGpc7gCdPbYIsLiO6HgWM-sdRkkLp_0 2024-09-12T01:38:01.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.068+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2057010528600286357', time=2024-09-12T03:12:00.544882+0000, chain.objs.size()=1 2024-09-12T01:38:01.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.068+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.296__shadow_.SAs3cAqG6E-pTOVdPV_OLd4ezZqdDid_0 2024-09-12T01:38:01.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.069+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13891331825028880303', time=2024-09-12T03:12:03.704588+0000, chain.objs.size()=1 2024-09-12T01:38:01.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.069+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.299__shadow_.iC21FE7JVgz4uyH0AIgQGkBHJei-YOU_0 2024-09-12T01:38:01.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.069+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15137788996614019132', time=2024-09-12T03:12:06.627323+0000, chain.objs.size()=1 2024-09-12T01:38:01.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.069+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.302__shadow_.Ev8ep8f-oxfODda2XA_GNe9mkiBzacv_0 2024-09-12T01:38:01.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.069+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11192965194377277454', time=2024-09-12T03:13:06.833223+0000, chain.objs.size()=1 2024-09-12T01:38:01.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.069+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.KhwTIFVaSFmnI-fG29YAJ-IegVEfb_0_0 2024-09-12T01:38:01.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.069+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17644673135177000028', time=2024-09-12T03:13:06.833891+0000, chain.objs.size()=1 2024-09-12T01:38:01.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.069+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.OluoQjtTj_UKBS5MQ70OEA6AzQeRM0K_0 2024-09-12T01:38:01.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.069+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16368469835295294409', time=2024-09-12T03:13:06.871178+0000, chain.objs.size()=1 2024-09-12T01:38:01.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.069+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.FVBtXnl0TK5sunv7afzBrDJDfINp4iP_0 2024-09-12T01:38:01.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.069+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2237879173646820262', time=2024-09-12T03:13:06.906543+0000, chain.objs.size()=1 2024-09-12T01:38:01.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.069+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.dCM66TVcFW58Ao19Zelziduh02FDdV8_0 2024-09-12T01:38:01.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.070+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.782205702488662898', time=2024-09-12T03:13:06.984097+0000, chain.objs.size()=1 2024-09-12T01:38:01.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.070+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.LMlwYVJVtfldQos0u5OHQkvgkmi1UyS_0 2024-09-12T01:38:01.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.070+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8277414073243835299', time=2024-09-12T03:13:07.327078+0000, chain.objs.size()=1 2024-09-12T01:38:01.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.070+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.z293JliuW35HHooCpm6o-M3YKH5YCUl_0 2024-09-12T01:38:01.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.070+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10598691214385491545', time=2024-09-12T03:13:07.444333+0000, chain.objs.size()=1 2024-09-12T01:38:01.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.070+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.L5fqGRbEe-Nj7I2_bK0XYLDbBgLu2XG_0 2024-09-12T01:38:01.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.070+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15921044704416740433', time=2024-09-12T03:13:07.644262+0000, chain.objs.size()=1 2024-09-12T01:38:01.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.070+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.LR8HP1PBcn3jUZnFO54Jtvelyjv-qWm_0 2024-09-12T01:38:01.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.071+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14330862228841610185', time=2024-09-12T03:13:08.490414+0000, chain.objs.size()=1 2024-09-12T01:38:01.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.071+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.Fo3CrFcTW5BPPEfkW7vx9HOAyVrGg3I_0 2024-09-12T01:38:01.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.071+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9583197153889517876', time=2024-09-12T03:13:08.707770+0000, chain.objs.size()=1 2024-09-12T01:38:01.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.071+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.NJACvB9XOYOqIOfYcYtfWDURY6vm2Tj_0 2024-09-12T01:38:01.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.071+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8189034546800389061', time=2024-09-12T03:13:08.800897+0000, chain.objs.size()=1 2024-09-12T01:38:01.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.071+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.3q4wNiMQsifGfjTCFS-DrC2EcofWPFI_0 2024-09-12T01:38:01.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.071+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17730924078498819101', time=2024-09-12T03:13:10.535419+0000, chain.objs.size()=1 2024-09-12T01:38:01.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.071+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.7SV4PSgmRERHQzXOAIeuRZbunnBCOLl_0 2024-09-12T01:38:01.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.074+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2844282646370476158', time=2024-09-12T03:13:10.645343+0000, chain.objs.size()=1 2024-09-12T01:38:01.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.074+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.uS3S0HqfaMtN2dSdQqiu1ZgS3EdNnJv_0 2024-09-12T01:38:01.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.074+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5402333244547318592', time=2024-09-12T03:13:10.681603+0000, chain.objs.size()=1 2024-09-12T01:38:01.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.074+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.fzybaw9z97vt9ZLzvQivsCHNGThQPXy_0 2024-09-12T01:38:01.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.074+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11256965906979189965', time=2024-09-12T03:13:11.389554+0000, chain.objs.size()=1 2024-09-12T01:38:01.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.074+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.du5HQi2MseKEaSH_ywPe5W9j6E6ehXh_0 2024-09-12T01:38:01.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.074+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9373933740304060974', time=2024-09-12T03:13:11.518541+0000, chain.objs.size()=1 2024-09-12T01:38:01.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.074+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.6Na2uv_enSZP4pOY7BIQ7IjF_TVcM6P_0 2024-09-12T01:38:01.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.074+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15845339298295083124', time=2024-09-12T03:13:11.916653+0000, chain.objs.size()=1 2024-09-12T01:38:01.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.074+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.EPOuzcj3ehs5k3VwZCjfy7qJZ_fvZ2k_0 2024-09-12T01:38:01.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.074+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11852720801135948251', time=2024-09-12T03:13:11.992267+0000, chain.objs.size()=1 2024-09-12T01:38:01.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.074+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.NBn-O8kfvJdEhwgZVdc-0D3kaeEd8kW_0 2024-09-12T01:38:01.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.074+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.839630109420446994', time=2024-09-12T03:13:12.020943+0000, chain.objs.size()=1 2024-09-12T01:38:01.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.074+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.ssVoT1d-8Kh98osP1GBvF1AzffD27QN_0 2024-09-12T01:38:01.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.074+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.808549101284729539', time=2024-09-12T03:13:12.616247+0000, chain.objs.size()=1 2024-09-12T01:38:01.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.074+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.xe1VS8Jxb5Oj-2316-Sir5QphyxqVnH_0 2024-09-12T01:38:01.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.074+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17683247921306447406', time=2024-09-12T03:13:12.886826+0000, chain.objs.size()=1 2024-09-12T01:38:01.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.074+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.R_zrEiG28aKyHk1dVMrcdwwBkuZrwgN_0 2024-09-12T01:38:01.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.074+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15955631846347270440', time=2024-09-12T03:13:12.976038+0000, chain.objs.size()=1 2024-09-12T01:38:01.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.074+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.X7gSRbdRX5Tgkzwi0nT1WLMmJIOcXh7_0 2024-09-12T01:38:01.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.076+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16697675038311465916', time=2024-09-12T03:13:13.095188+0000, chain.objs.size()=1 2024-09-12T01:38:01.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.076+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.f0n55Nu37yjI0oj1xYazitr1dA8O45O_0 2024-09-12T01:38:01.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.076+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8008295307983652483', time=2024-09-12T03:13:13.471586+0000, chain.objs.size()=1 2024-09-12T01:38:01.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.076+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.GZdmHYfjNalKYT_iwXl1Z0KHTDrIrlG_0 2024-09-12T01:38:01.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.076+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1842323175267868494', time=2024-09-12T03:13:13.850133+0000, chain.objs.size()=1 2024-09-12T01:38:01.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.076+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.KB17oQIcuDbb1596eA3ViIYiWujU20H_0 2024-09-12T01:38:01.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.076+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7614701901678813245', time=2024-09-12T03:13:13.850732+0000, chain.objs.size()=1 2024-09-12T01:38:01.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.076+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.NIQGXS0WxjhIBshMHhPY6NmY5UCIOzM_0 2024-09-12T01:38:01.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.080+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9655748809565712209', time=2024-09-12T03:13:14.119381+0000, chain.objs.size()=1 2024-09-12T01:38:01.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.080+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.zcDcoZusaGbsRDh8KcpEzu8RaPC1duX_0 2024-09-12T01:38:01.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.080+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6229629923855359648', time=2024-09-12T03:13:15.247201+0000, chain.objs.size()=1 2024-09-12T01:38:01.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.080+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.lJe4xoksgGNZCla1DzTGDvmbWq41GZf_0 2024-09-12T01:38:01.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.080+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12392643881139469436', time=2024-09-12T03:13:15.593908+0000, chain.objs.size()=1 2024-09-12T01:38:01.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.080+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.0dUfLrFnO788GaANZx3Kdo2fd-rDbWn_0 2024-09-12T01:38:01.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.080+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10775975603865733664', time=2024-09-12T03:13:15.631444+0000, chain.objs.size()=1 2024-09-12T01:38:01.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.080+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.mE9sRYnVXa3PpkfXCHwcIj7iA3gnYGT_0 2024-09-12T01:38:01.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.080+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1400944226687566747', time=2024-09-12T03:13:15.706295+0000, chain.objs.size()=1 2024-09-12T01:38:01.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.080+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.wHrosSr--sWsCb6mQg7dFHyEP425MHE_0 2024-09-12T01:38:01.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.080+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2860784654037466076', time=2024-09-12T03:13:16.490532+0000, chain.objs.size()=1 2024-09-12T01:38:01.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.080+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.o7HpA-QHPiHKU8yXXuBgLq9jdwDhRYU_0 2024-09-12T01:38:01.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.080+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6591340743857843780', time=2024-09-12T03:13:16.520013+0000, chain.objs.size()=1 2024-09-12T01:38:01.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.080+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.lFkAgnPozPxCSS8p2wiwfp34MHo1YaG_0 2024-09-12T01:38:01.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.082+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8010855966048973213', time=2024-09-12T03:13:16.565684+0000, chain.objs.size()=1 2024-09-12T01:38:01.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.082+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.yt1mheB2HyFqf6W2vE88VoRtRBJ_RHQ_0 2024-09-12T01:38:01.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.082+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11188817739637132376', time=2024-09-12T03:13:16.601776+0000, chain.objs.size()=1 2024-09-12T01:38:01.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.082+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.3s7T-2i-d5j1rJzbRbBA7HSlTieHVgf_0 2024-09-12T01:38:01.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.082+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8454890283907057543', time=2024-09-12T03:13:16.988939+0000, chain.objs.size()=1 2024-09-12T01:38:01.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.082+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.84WnBb2--fzC3TFcF869PvaxKrVjlna_0 2024-09-12T01:38:01.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.082+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13223602186160122962', time=2024-09-12T03:13:53.607698+0000, chain.objs.size()=1 2024-09-12T01:38:01.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.082+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.epLSs9EKVGi5RwmyCGXn1HkJIzYgFbF_0 2024-09-12T01:38:01.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.082+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11442633088100726747', time=2024-09-12T03:13:53.731616+0000, chain.objs.size()=1 2024-09-12T01:38:01.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.082+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.d-yXjCg_ZBOKaotv7teyafo8fm3RO7a_0 2024-09-12T01:38:01.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.082+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2047875227030204640', time=2024-09-12T03:13:53.746298+0000, chain.objs.size()=1 2024-09-12T01:38:01.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.082+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.2tsRuFXZxrcjsQBHpWqEKI0pYnEjCbe_0 2024-09-12T01:38:01.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.085+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13543209284078554016', time=2024-09-12T03:13:54.454032+0000, chain.objs.size()=1 2024-09-12T01:38:01.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.085+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.3YAadvxuLRsFdusWUUvho_R3UvI9nBF_0 2024-09-12T01:38:01.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.085+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2455806263342856027', time=2024-09-12T03:13:54.533277+0000, chain.objs.size()=1 2024-09-12T01:38:01.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.085+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.w_emFXx_MWHPaXpltN6Dkobq-qtfZhx_0 2024-09-12T01:38:01.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.085+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3655577833794641165', time=2024-09-12T03:13:55.092676+0000, chain.objs.size()=1 2024-09-12T01:38:01.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.085+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.8SklXaLao8lAN4jzImLkESkj6uBCF-j_0 2024-09-12T01:38:01.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.085+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9926860143858830982', time=2024-09-12T03:13:55.141500+0000, chain.objs.size()=1 2024-09-12T01:38:01.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.085+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.rcpRkTrwDDYlgEyzlDf-pmKWT71jzsL_0 2024-09-12T01:38:01.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.085+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15091567002173493599', time=2024-09-12T03:13:55.170068+0000, chain.objs.size()=1 2024-09-12T01:38:01.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.085+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.CCySuf5Uw8nq6mZFr-UnUMbfVP6CzsF_0 2024-09-12T01:38:01.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.085+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7145867690237837789', time=2024-09-12T03:13:55.477957+0000, chain.objs.size()=1 2024-09-12T01:38:01.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.085+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_._o6UluY_vThH1qC8TxAjX3FLOcSvPjq_0 2024-09-12T01:38:01.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.088+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3155898407620204007', time=2024-09-12T03:13:55.588113+0000, chain.objs.size()=1 2024-09-12T01:38:01.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.088+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.edVfUT5yazA253r1KR_Xy6FbK62sUOF_0 2024-09-12T01:38:01.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.088+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2706868844793105647', time=2024-09-12T03:13:55.720897+0000, chain.objs.size()=1 2024-09-12T01:38:01.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.088+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.OLPQygZt8YT0XdneNSAevSCW5j1rgSF_0 2024-09-12T01:38:01.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.088+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18054855905172273124', time=2024-09-12T03:13:55.757705+0000, chain.objs.size()=1 2024-09-12T01:38:01.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.088+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.9LnL7KnZ1mkvxYUZvE21FTcTWZfApJg_0 2024-09-12T01:38:01.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.088+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11541372294170112605', time=2024-09-12T03:13:55.960741+0000, chain.objs.size()=1 2024-09-12T01:38:01.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.088+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.U5o384HSqyloFEfl6kPFnNvE-AiUQjo_0 2024-09-12T01:38:01.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.088+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2020071684693547038', time=2024-09-12T03:13:56.043253+0000, chain.objs.size()=1 2024-09-12T01:38:01.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.088+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.4dZ1mgkePBC4jw6_lyQjWFnmfw3KNsg_0 2024-09-12T01:38:01.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.091+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1636550186511410449', time=2024-09-12T03:13:56.062822+0000, chain.objs.size()=1 2024-09-12T01:38:01.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.091+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.sAZKCQEkXvKfXlrk2pu58czICr6HlXo_0 2024-09-12T01:38:01.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.091+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4572134151804332320', time=2024-09-12T03:13:56.643850+0000, chain.objs.size()=1 2024-09-12T01:38:01.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.091+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.8GuhQ1Z_T6tiwgN67KBbOK9ptyEyflT_0 2024-09-12T01:38:01.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.091+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10013069395606855513', time=2024-09-12T03:13:56.845497+0000, chain.objs.size()=1 2024-09-12T01:38:01.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.091+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.qciiK2_rFU7FQGr8E-qeOqOIELy00d7_0 2024-09-12T01:38:01.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.091+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16403079062120483068', time=2024-09-12T03:13:57.997416+0000, chain.objs.size()=1 2024-09-12T01:38:01.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.091+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.C0rxmOBwstgY5BkdXc1oQddN3OI5S0z_0 2024-09-12T01:38:01.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.091+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1506023309364691179', time=2024-09-12T03:13:59.510275+0000, chain.objs.size()=1 2024-09-12T01:38:01.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.091+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Ms9LNfasH8B7nMSL2wbmZU24KHwVM5__0 2024-09-12T01:38:01.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.091+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4918954568739900745', time=2024-09-12T03:13:59.596010+0000, chain.objs.size()=1 2024-09-12T01:38:01.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.091+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.7vGZJ-Sc-_OPS-NmaAFfZWOyxRBTTxR_0 2024-09-12T01:38:01.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.093+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12706756528281032115', time=2024-09-12T03:13:59.816624+0000, chain.objs.size()=1 2024-09-12T01:38:01.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.093+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.KV1kkfKkLLAnDxrTurYJkSeAiELFnxy_0 2024-09-12T01:38:01.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.094+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16291883129347682730', time=2024-09-12T03:14:00.594738+0000, chain.objs.size()=1 2024-09-12T01:38:01.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.094+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.s7asrm9qTrLgv1OE4quyXi-jvryaMf2_0 2024-09-12T01:38:01.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.094+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7530500672377001265', time=2024-09-12T03:14:01.369051+0000, chain.objs.size()=1 2024-09-12T01:38:01.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.094+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.l_zitRMYoZ-zkDap8cOynHUxePJ7zYN_0 2024-09-12T01:38:01.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.094+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1684333699398928067', time=2024-09-12T03:14:02.183202+0000, chain.objs.size()=1 2024-09-12T01:38:01.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.094+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.MH4EE29u-bEf_mjpdRbGqY6oKjG9d5z_0 2024-09-12T01:38:01.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.094+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13096403372070653484', time=2024-09-12T03:14:03.064489+0000, chain.objs.size()=1 2024-09-12T01:38:01.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.094+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.owPQpa4JvNcZrT-3OxrHAHqqP0jELf2_0 2024-09-12T01:38:01.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.099+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 0/48153 2024-09-12T01:38:01.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.101+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T01:38:01.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.101+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4486916613618086766', time=2024-09-12T03:14:03.153747+0000, chain.objs.size()=1 2024-09-12T01:38:01.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.101+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.hn0ciuifEKcQ54BkoeDk6ZaXsjyjDA__0 2024-09-12T01:38:01.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.101+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15117509653762491845', time=2024-09-12T03:14:03.165824+0000, chain.objs.size()=1 2024-09-12T01:38:01.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.101+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.FUuj97qAwdFzGyhM16DsQSbJ3QIBenB_0 2024-09-12T01:38:01.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.101+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10115217086477938754', time=2024-09-12T03:14:03.642300+0000, chain.objs.size()=1 2024-09-12T01:38:01.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.101+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.f0ORxz7e-2kNph1ttU6Z9TMJB3i_naG_0 2024-09-12T01:38:01.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.101+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.594206449692540871', time=2024-09-12T03:14:08.952387+0000, chain.objs.size()=1 2024-09-12T01:38:01.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.101+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.330__shadow_.imfgbI837WZ0UI-wDLwMXVdmqN0D2jf_0 2024-09-12T01:38:01.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.101+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10002617203808884300', time=2024-09-12T03:15:23.304890+0000, chain.objs.size()=1 2024-09-12T01:38:01.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.101+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.410__shadow_.RiBYDceixw1Cbo3AenKu2O_L5RaAQbR_0 2024-09-12T01:38:01.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.101+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7538001994539805771', time=2024-09-12T03:16:04.222372+0000, chain.objs.size()=1 2024-09-12T01:38:01.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.101+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.451__shadow_.qyBIgLvHtRubLTEmlxJX2xMEFAO8vcb_0 2024-09-12T01:38:01.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.101+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1494886996937392762', time=2024-09-12T03:16:22.788885+0000, chain.objs.size()=1 2024-09-12T01:38:01.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.101+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.466__shadow_.AlkNeiuu7FKeNQmylDE80EGXKhwjgqb_0 2024-09-12T01:38:01.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.101+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3687288929300821503', time=2024-09-12T03:16:23.204441+0000, chain.objs.size()=1 2024-09-12T01:38:01.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.101+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.466__shadow_.yTlLSqX7u8CoLqd_mgI0nM98k0KJ9rU_0 2024-09-12T01:38:01.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.101+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7269630342539771620', time=2024-09-12T03:16:34.341802+0000, chain.objs.size()=1 2024-09-12T01:38:01.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.101+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.483__shadow_.Cgp3GECb514Sk3URNPdwY0V6Cw5B-YI_0 2024-09-12T01:38:01.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.101+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18443673410056884105', time=2024-09-12T03:17:24.974510+0000, chain.objs.size()=6 2024-09-12T01:38:01.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.101+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.507__multipart_srcmultipart.2~ckyMCV3hbT7G8qDArZScZPf4n-CghR1.1 2024-09-12T01:38:01.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.101+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.507__multipart_srcmultipart.2~ckyMCV3hbT7G8qDArZScZPf4n-CghR1.2 2024-09-12T01:38:01.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.101+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.507__multipart_srcmultipart.2~ckyMCV3hbT7G8qDArZScZPf4n-CghR1.3 2024-09-12T01:38:01.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.105+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.507__multipart_srcmultipart.2~ckyMCV3hbT7G8qDArZScZPf4n-CghR1.4 2024-09-12T01:38:01.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.105+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.507__multipart_srcmultipart.2~ckyMCV3hbT7G8qDArZScZPf4n-CghR1.5 2024-09-12T01:38:01.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.105+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.507__multipart_srcmultipart.2~ckyMCV3hbT7G8qDArZScZPf4n-CghR1.6 2024-09-12T01:38:01.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.105+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11009740404176080174', time=2024-09-12T03:20:44.490575+0000, chain.objs.size()=2 2024-09-12T01:38:01.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.105+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.525__multipart_mymultipart.2~H0ueATIXEzmrT_l3gpc9geeylHfyswv.1 2024-09-12T01:38:01.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.105+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.525__multipart_mymultipart.2~H0ueATIXEzmrT_l3gpc9geeylHfyswv.2 2024-09-12T01:38:01.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.105+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13590473093266410210', time=2024-09-12T03:23:02.398939+0000, chain.objs.size()=1 2024-09-12T01:38:01.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.105+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.563__shadow_.wJtV-znr1Xba7CY_NuPMo-UMb0l8iys_0 2024-09-12T01:38:01.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.105+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3689824268335784557', time=2024-09-12T03:23:11.225839+0000, chain.objs.size()=1 2024-09-12T01:38:01.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.105+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.569__shadow:r6MQXxr-jeA3.oG6itweKhwBPm4VeTw_.NnYc-WWXdvbza2KxtWt49I2vbplNW5H_0 2024-09-12T01:38:01.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.105+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12016426633298566449', time=2024-09-12T03:23:16.792681+0000, chain.objs.size()=1 2024-09-12T01:38:01.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.105+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.569__shadow:PYvne4PQhudjQWmzEleIYn5wbF4vE4O_.uBUIMtL78z6aHgm9UaR7WAiGSmeypdn_0 2024-09-12T01:38:01.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.105+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.594962097119489758', time=2024-09-12T03:24:36.507812+0000, chain.objs.size()=1 2024-09-12T01:38:01.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.105+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.579__shadow:43iIIURNABu.p7-2QYNvutOo0k0F1y3_.jMk9F3PfM9dKI_uzLEqjUyoNxrIFIQM_0 2024-09-12T01:38:01.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.105+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3423800373353627557', time=2024-09-12T03:24:40.107718+0000, chain.objs.size()=1 2024-09-12T01:38:01.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.105+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.582__shadow:SMFTNv8xYfz8LnHx2PuXCagPBTLXjnr_.RAUAhfvmNYBkrg8RG2nTxlmIgqpiC5M_0 2024-09-12T01:38:01.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.105+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8091754081953798355', time=2024-09-12T03:24:41.406719+0000, chain.objs.size()=1 2024-09-12T01:38:01.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.105+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.583__shadow:Wq6pyUjomdtcuegrs7T29Vu0nyqEKa5_.LNsExnw6C0RfGfmmES6dVJz2x2jy1d-_0 2024-09-12T01:38:01.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.108+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17121743114589103065', time=2024-09-12T03:24:55.536133+0000, chain.objs.size()=1 2024-09-12T01:38:01.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.108+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.596__shadow_.xWW55v7SQYMG2HIZlkIPHkRMHiEW37__0 2024-09-12T01:38:01.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.108+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11310101117698429624', time=2024-09-12T03:25:01.213804+0000, chain.objs.size()=1 2024-09-12T01:38:01.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.108+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.603__shadow_.aNog-Q-widwqibncdP8zDs0uRKFF7zW_0 2024-09-12T01:38:01.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.113+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:38:01.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.115+0000 7f8786c98800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T01:38:01.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.117+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:38:01.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.117+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:38:01.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.118+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49002' 2024-09-12T01:38:01.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.118+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='_-lE0nLkX4kRL6ZsUAKFIJKSZQhDxyzv', time=2024-09-12T03:06:50.758527+0000, chain.objs.size()=2 2024-09-12T01:38:01.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.118+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.160__shadow_.T7ws_Gx5jQRezkvxcHpwOoCGHjRR2KC_0 2024-09-12T01:38:01.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.118+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.160__shadow_.T7ws_Gx5jQRezkvxcHpwOoCGHjRR2KC_1 2024-09-12T01:38:01.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.118+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6447006411615199419', time=2024-09-12T03:07:15.571858+0000, chain.objs.size()=1 2024-09-12T01:38:01.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.118+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.162__shadow_.czW82CvHqPGiarlGRqaCuciitAIqfy9_0 2024-09-12T01:38:01.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.118+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.799153887734804426', time=2024-09-12T03:10:25.906572+0000, chain.objs.size()=1 2024-09-12T01:38:01.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.118+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.248__shadow_.vJjODIJohzUI1FhO2IPz9dUeH3tEwy5_0 2024-09-12T01:38:01.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.118+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16710436744439247256', time=2024-09-12T03:10:27.873425+0000, chain.objs.size()=1 2024-09-12T01:38:01.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.118+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.250__shadow_.0Pk38hr-KB8WzexQRX0fHKprxBpnPct_0 2024-09-12T01:38:01.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.118+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10252764436813497235', time=2024-09-12T03:10:38.399376+0000, chain.objs.size()=1 2024-09-12T01:38:01.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.118+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.261__shadow_.G1dBfk9_H78yziASxxx7k7gVko9Vp_G_0 2024-09-12T01:38:01.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.118+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6054819719039680502', time=2024-09-12T03:11:14.810675+0000, chain.objs.size()=1 2024-09-12T01:38:01.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.118+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.taAzmdRtVoU2l40wGpYBzzTVknImB1H_0 2024-09-12T01:38:01.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.118+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14293540204281508011', time=2024-09-12T03:11:14.972701+0000, chain.objs.size()=1 2024-09-12T01:38:01.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.118+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.VYM4ntJRkwL0Il9XIwzRGRp8WcWH7Zv_0 2024-09-12T01:38:01.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.118+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15781263820464882612', time=2024-09-12T03:11:15.227064+0000, chain.objs.size()=1 2024-09-12T01:38:01.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.118+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.GNWUBr0KcZnIA6oR8DsOJ7riN7eAtUL_0 2024-09-12T01:38:01.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.118+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15846499322204849170', time=2024-09-12T03:11:16.097138+0000, chain.objs.size()=1 2024-09-12T01:38:01.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.118+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.ousLSQczLaO0bL3PK4AAQb8qkkfLnOf_0 2024-09-12T01:38:01.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.118+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13424895297843813794', time=2024-09-12T03:11:16.149089+0000, chain.objs.size()=1 2024-09-12T01:38:01.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.118+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.3fdrhsiHRDRMvBH-r21SO_jEurNSYbq_0 2024-09-12T01:38:01.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.118+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12735225310423067757', time=2024-09-12T03:11:16.897935+0000, chain.objs.size()=1 2024-09-12T01:38:01.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.118+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.RGuSeVBbmarBqtxAKcV7IoSURqEMfNE_0 2024-09-12T01:38:01.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.125+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1520782996226550036', time=2024-09-12T03:11:17.381302+0000, chain.objs.size()=1 2024-09-12T01:38:01.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.125+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.eyVnJ5j9y3kkbUAujfEMw9dmVIk_x9s_0 2024-09-12T01:38:01.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.125+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12010827408122096657', time=2024-09-12T03:11:17.635189+0000, chain.objs.size()=1 2024-09-12T01:38:01.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.125+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.jR25eRbqId73rASG7Zgbzh9gqGgO1Oh_0 2024-09-12T01:38:01.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.125+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5728105279391569128', time=2024-09-12T03:11:18.156938+0000, chain.objs.size()=1 2024-09-12T01:38:01.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.125+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.s6NSf1XMzCO5CrCP1mDUTi8NGjrg4tx_0 2024-09-12T01:38:01.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.125+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.503802362901910335', time=2024-09-12T03:11:19.148154+0000, chain.objs.size()=1 2024-09-12T01:38:01.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.125+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.8gFM_zkIrZlJqYY5wJqOzrqVsIAyC_b_0 2024-09-12T01:38:01.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.125+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1454018824206537287', time=2024-09-12T03:11:19.629534+0000, chain.objs.size()=1 2024-09-12T01:38:01.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.125+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.TfpCk6Crf6RoFHY_p29y2tvMHz_3p-s_0 2024-09-12T01:38:01.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.125+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12847347580401339587', time=2024-09-12T03:11:19.677656+0000, chain.objs.size()=1 2024-09-12T01:38:01.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.125+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Zy9WSdRdpjqHQ8U5cNW8Ack11gXI-gf_0 2024-09-12T01:38:01.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.125+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16672405269481941131', time=2024-09-12T03:11:20.258944+0000, chain.objs.size()=1 2024-09-12T01:38:01.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.125+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.A9gGhJfjldMN0Mfy8oitiydWvAsZUHa_0 2024-09-12T01:38:01.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.125+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11256950571678455092', time=2024-09-12T03:11:20.552855+0000, chain.objs.size()=1 2024-09-12T01:38:01.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.125+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.dVRwgvqYn8XkzL_5Od4o219Eh5adfIL_0 2024-09-12T01:38:01.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.125+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9575990464493880870', time=2024-09-12T03:11:20.612519+0000, chain.objs.size()=1 2024-09-12T01:38:01.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.125+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.p01gUhgr1M6UUnAtFqQf2mU3-AO0a-L_0 2024-09-12T01:38:01.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.125+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6394107763103360881', time=2024-09-12T03:11:20.678588+0000, chain.objs.size()=1 2024-09-12T01:38:01.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.125+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.TGH1qNlNYfo_2VdX15jdEq9S1gUzOZu_0 2024-09-12T01:38:01.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.125+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.373055308976229528', time=2024-09-12T03:11:20.742192+0000, chain.objs.size()=1 2024-09-12T01:38:01.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.125+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.naI_9VYF5QXSSU73Y_yPKnf5Nfku8n1_0 2024-09-12T01:38:01.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.126+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2712670403167256193', time=2024-09-12T03:11:21.185108+0000, chain.objs.size()=1 2024-09-12T01:38:01.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.126+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.ilr161kuxUM3i6oSnlb9oMcOiI897uW_0 2024-09-12T01:38:01.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.126+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13642849332228016544', time=2024-09-12T03:11:21.868190+0000, chain.objs.size()=1 2024-09-12T01:38:01.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.126+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.ND6y-yMHNFw9Ypy_CyHyX2r3D80A0AK_0 2024-09-12T01:38:01.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.127+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11454503882190526089', time=2024-09-12T03:11:21.913269+0000, chain.objs.size()=1 2024-09-12T01:38:01.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.127+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.81ibjhmRRLUeU0UJ4isvwHuAgGq1Uvh_0 2024-09-12T01:38:01.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.130+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9889169842298526579', time=2024-09-12T03:11:22.115415+0000, chain.objs.size()=1 2024-09-12T01:38:01.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.130+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.dIBW4242zSmvaaoFD7fhDEdb6-UBmFB_0 2024-09-12T01:38:01.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.130+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3380148071512811719', time=2024-09-12T03:11:22.116092+0000, chain.objs.size()=1 2024-09-12T01:38:01.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.130+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.cuGsNfb0NaHSwSa_zK6MCjSXZIDgHh2_0 2024-09-12T01:38:01.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.130+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17113582911369761852', time=2024-09-12T03:11:22.523536+0000, chain.objs.size()=1 2024-09-12T01:38:01.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.130+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.yzE28NPkLP_ltzm_3if1R70cYP9K3AJ_0 2024-09-12T01:38:01.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.130+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7909300553655343725', time=2024-09-12T03:11:22.897861+0000, chain.objs.size()=1 2024-09-12T01:38:01.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.130+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.9JKODR-cuDIpyf68dmX3ezcQKgJbSNl_0 2024-09-12T01:38:01.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.130+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16414724293500184749', time=2024-09-12T03:11:23.020250+0000, chain.objs.size()=1 2024-09-12T01:38:01.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.130+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.ydKFll0-32Hx-lIgsl6Von_fE8h5Yx4_0 2024-09-12T01:38:01.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.130+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15001828805880861556', time=2024-09-12T03:11:24.105859+0000, chain.objs.size()=1 2024-09-12T01:38:01.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.130+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.QA2CkMKF3VmLeEejCuLWbe9p-gSL8KI_0 2024-09-12T01:38:01.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.130+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6841490607550511640', time=2024-09-12T03:11:24.107199+0000, chain.objs.size()=1 2024-09-12T01:38:01.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.130+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.QffFqDJFgpuq1ca7E8ldjVYNjAM6tPt_0 2024-09-12T01:38:01.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.130+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6063583015548773582', time=2024-09-12T03:11:24.325771+0000, chain.objs.size()=1 2024-09-12T01:38:01.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.130+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.ZdDLPjK3v24yOsdwWL2a0KO2ugKRUzj_0 2024-09-12T01:38:01.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.130+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1556558169767754115', time=2024-09-12T03:11:24.567357+0000, chain.objs.size()=1 2024-09-12T01:38:01.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.130+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.71NwszukXYbOgH71Jx2Rxk5aMdpfZQO_0 2024-09-12T01:38:01.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.130+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9497636698535902764', time=2024-09-12T03:11:24.567924+0000, chain.objs.size()=1 2024-09-12T01:38:01.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.130+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.xbDkV89ViiFWSVMBzpsDulegq3UJAoJ_0 2024-09-12T01:38:01.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.133+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6132779047146921127', time=2024-09-12T03:11:24.640829+0000, chain.objs.size()=1 2024-09-12T01:38:01.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.133+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.i4u5pP74mn8d-wKT_29nBhQHTbBDwuq_0 2024-09-12T01:38:01.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.133+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6135253040683943783', time=2024-09-12T03:11:24.779811+0000, chain.objs.size()=1 2024-09-12T01:38:01.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.133+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.X7HViLhqPQAYWsBgAcMgmmbtpLtVYpu_0 2024-09-12T01:38:01.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.133+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10900164245095043646', time=2024-09-12T03:11:24.811962+0000, chain.objs.size()=1 2024-09-12T01:38:01.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.133+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Ozm8eXv5DARwoe8-zCsU79F-S0wq4d6_0 2024-09-12T01:38:01.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.133+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14198831543027589105', time=2024-09-12T03:11:24.851963+0000, chain.objs.size()=1 2024-09-12T01:38:01.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.133+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.K0De4AtSy3OP9qtfF2erLwvelyT4RPj_0 2024-09-12T01:38:01.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.135+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17242947720186267014', time=2024-09-12T03:11:27.750007+0000, chain.objs.size()=1 2024-09-12T01:38:01.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.135+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.265__shadow_.a_pqCW4L7_cNeOI7iowfQcteUBPH_uP_0 2024-09-12T01:38:01.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.135+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.653909760482694838', time=2024-09-12T03:11:38.074364+0000, chain.objs.size()=1 2024-09-12T01:38:01.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.135+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.276__shadow_._JkMBJb65pvHhR_jBGkVj_v86Br4ad9_0 2024-09-12T01:38:01.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.135+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16984553932969114542', time=2024-09-12T03:11:47.965583+0000, chain.objs.size()=1 2024-09-12T01:38:01.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.135+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.286__shadow_.ABPTalvHgPofRzDzn_QFOojtFj259db_0 2024-09-12T01:38:01.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.135+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3240959399465927220', time=2024-09-12T03:11:59.560502+0000, chain.objs.size()=1 2024-09-12T01:38:01.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.135+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.295__shadow_.-xj_ULXr3a_2RoR8qaQnxxm4Vx-uR1O_0 2024-09-12T01:38:01.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.135+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3007038254680084145', time=2024-09-12T03:12:08.551118+0000, chain.objs.size()=1 2024-09-12T01:38:01.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.135+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.304__shadow_.75teVkjv30AUB0hpgk4DnQ2Esjc2h8__0 2024-09-12T01:38:01.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.135+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12372424238800535549', time=2024-09-12T03:12:09.502285+0000, chain.objs.size()=1 2024-09-12T01:38:01.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.135+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.305__shadow_.E7qx4TSRN8S3ILpqxfzVZ6slxnb9g1f_0 2024-09-12T01:38:01.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.135+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12432799549727476794', time=2024-09-12T03:12:10.730260+0000, chain.objs.size()=1 2024-09-12T01:38:01.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.135+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.306__shadow_.XppDOXzoCRFaxf64jDNTRpKBbGxTq2t_0 2024-09-12T01:38:01.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.138+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10314741392233394870', time=2024-09-12T03:12:27.492075+0000, chain.objs.size()=1 2024-09-12T01:38:01.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.138+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.319__shadow:GY6MP417UzhA8BO5hec-jRTqZSPkovk_.gkM2I6LZKXnd9AEubJrBi9ju1zNSA9R_0 2024-09-12T01:38:01.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.138+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17523363967782762703', time=2024-09-12T03:13:06.919028+0000, chain.objs.size()=1 2024-09-12T01:38:01.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.138+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.-fJ0VlGzM3iVyJ17WiXaEwm6nY54he8_0 2024-09-12T01:38:01.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.138+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14784635008132058948', time=2024-09-12T03:13:07.120999+0000, chain.objs.size()=1 2024-09-12T01:38:01.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.138+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.SvH-rE0JXjFst5KhgQMRQ4i0Yg6ierf_0 2024-09-12T01:38:01.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.138+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13113115903502051898', time=2024-09-12T03:13:07.170659+0000, chain.objs.size()=1 2024-09-12T01:38:01.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.138+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.NXIMib9DITnXKXyPInm_c06KZSFD_Qw_0 2024-09-12T01:38:01.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.138+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13432893115668884153', time=2024-09-12T03:13:07.171215+0000, chain.objs.size()=1 2024-09-12T01:38:01.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.138+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.vIqWUkB-YSBjvy2YeQDHr8eEeF-1CaL_0 2024-09-12T01:38:01.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.138+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12304197850901977888', time=2024-09-12T03:13:07.589659+0000, chain.objs.size()=1 2024-09-12T01:38:01.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.138+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.vAWddfFrVkKRDcz88NOu9-KbpfA3Nsp_0 2024-09-12T01:38:01.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.138+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17869380747098742243', time=2024-09-12T03:13:07.795574+0000, chain.objs.size()=1 2024-09-12T01:38:01.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.138+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.xVi-JsFiw1hmNm5ijzDB1DEvpUD0f3F_0 2024-09-12T01:38:01.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.138+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14677990352527103973', time=2024-09-12T03:13:07.796235+0000, chain.objs.size()=1 2024-09-12T01:38:01.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.138+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.aKBkGESFq_WTT9bFLIZBtBsIGT9oFBi_0 2024-09-12T01:38:01.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.141+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2948282101112293505', time=2024-09-12T03:13:08.375826+0000, chain.objs.size()=1 2024-09-12T01:38:01.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.141+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.psbjp0oFeuMhiOk8v0XHXGcMyaK1vzU_0 2024-09-12T01:38:01.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.141+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1035600877456107842', time=2024-09-12T03:13:09.930970+0000, chain.objs.size()=1 2024-09-12T01:38:01.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.141+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.wUs44ywHWcgYAZZ9sB94XZkoRwgC33r_0 2024-09-12T01:38:01.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.141+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18131349224915185645', time=2024-09-12T03:13:10.105705+0000, chain.objs.size()=1 2024-09-12T01:38:01.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.141+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.3pikP3368JugLKg7VWzbMoah0AuZqqo_0 2024-09-12T01:38:01.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.141+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13906090285667963691', time=2024-09-12T03:13:10.570123+0000, chain.objs.size()=1 2024-09-12T01:38:01.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.141+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.EwScRNT01QVR2-MRHO_BRE3LT3tfawr_0 2024-09-12T01:38:01.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.141+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13975518732650154420', time=2024-09-12T03:13:10.613125+0000, chain.objs.size()=1 2024-09-12T01:38:01.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.141+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.8KFOBR-pc6NAVc6msf5Zo8fLI_wdjJT_0 2024-09-12T01:38:01.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.141+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16760049962072828958', time=2024-09-12T03:13:10.614355+0000, chain.objs.size()=1 2024-09-12T01:38:01.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.141+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.HZz9xe4gyt-zFXr4-_82HP3W9PcnvOY_0 2024-09-12T01:38:01.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.141+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17509393689202474346', time=2024-09-12T03:13:10.615443+0000, chain.objs.size()=1 2024-09-12T01:38:01.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.141+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.ABepSrbT72rfgIHmtjT5R8MSgLyNUSc_0 2024-09-12T01:38:01.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.141+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3463055337301587237', time=2024-09-12T03:13:11.123507+0000, chain.objs.size()=1 2024-09-12T01:38:01.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.141+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.5QO-sqVFTUS4wGvUUkIEFoLDL2armFU_0 2024-09-12T01:38:01.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.141+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2094798996701315102', time=2024-09-12T03:13:11.328324+0000, chain.objs.size()=1 2024-09-12T01:38:01.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.141+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.oN4Nr7aml2sCvPTqE82bHZGowKynyd9_0 2024-09-12T01:38:01.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.143+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13043364468156712257', time=2024-09-12T03:13:11.548477+0000, chain.objs.size()=1 2024-09-12T01:38:01.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.143+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.PnX016imF7xGMRk80GBEiBaVlyAbI0b_0 2024-09-12T01:38:01.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.143+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4181582512386317114', time=2024-09-12T03:13:11.698610+0000, chain.objs.size()=1 2024-09-12T01:38:01.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.143+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.6veLYP_oNkWBOXS1X1Jo1QeLneURKmn_0 2024-09-12T01:38:01.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.143+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.311430584433149306', time=2024-09-12T03:13:11.973582+0000, chain.objs.size()=1 2024-09-12T01:38:01.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.143+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.LIiITL8v3ID1R7nZiBUrVNiGbqNUAWW_0 2024-09-12T01:38:01.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.143+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17904556055043392120', time=2024-09-12T03:13:12.025532+0000, chain.objs.size()=1 2024-09-12T01:38:01.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.143+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.2K0NnEXpgWpRHWMjKnJBQfMmMNjm-cz_0 2024-09-12T01:38:01.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.145+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11209252683928999490', time=2024-09-12T03:13:12.078177+0000, chain.objs.size()=1 2024-09-12T01:38:01.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.145+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.IW2M_sI4UWjGtp_kdksV6T0NIV9jFMj_0 2024-09-12T01:38:01.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.145+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14555369315761053072', time=2024-09-12T03:13:12.528471+0000, chain.objs.size()=1 2024-09-12T01:38:01.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.145+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.1yjQNgG1RLFmifv3u_CN9gqDGzGqB50_0 2024-09-12T01:38:01.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.145+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18360308851226612249', time=2024-09-12T03:13:12.956738+0000, chain.objs.size()=1 2024-09-12T01:38:01.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.145+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.NtIXTZ4EGjZjT4GpY0lGUJToTPaBYld_0 2024-09-12T01:38:01.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.146+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11601990367138279588', time=2024-09-12T03:13:12.977669+0000, chain.objs.size()=1 2024-09-12T01:38:01.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.146+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.wziWUHqKnXlKGEUzsbjNWSN0-8i0OfM_0 2024-09-12T01:38:01.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.146+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16181737706551547250', time=2024-09-12T03:13:13.781628+0000, chain.objs.size()=1 2024-09-12T01:38:01.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.146+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.eNq7Fw55wPUfQoJWhosM9mMrTkEojc1_0 2024-09-12T01:38:01.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.146+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9416391370462802064', time=2024-09-12T03:13:14.195274+0000, chain.objs.size()=1 2024-09-12T01:38:01.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.146+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.cEYRgnhnViGZoKW6sBE9DIzlEd5OSl9_0 2024-09-12T01:38:01.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.146+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2635247613015711253', time=2024-09-12T03:13:14.195947+0000, chain.objs.size()=1 2024-09-12T01:38:01.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.146+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.upQOaLaDX-Sd-AagGL_aOsAjogIOOhH_0 2024-09-12T01:38:01.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.146+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11992611330018434893', time=2024-09-12T03:13:15.185717+0000, chain.objs.size()=1 2024-09-12T01:38:01.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.146+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.IoKurhhzwlrqYUn4DVdETMCSIzTvQ2U_0 2024-09-12T01:38:01.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.149+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3726129612493857982', time=2024-09-12T03:13:15.285879+0000, chain.objs.size()=1 2024-09-12T01:38:01.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.149+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.CFTIF5m8KIRTL-fQpE_rbUAUD0huPha_0 2024-09-12T01:38:01.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.149+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7020912661931813467', time=2024-09-12T03:13:15.537194+0000, chain.objs.size()=1 2024-09-12T01:38:01.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.149+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.87LzwJK8-LqURuIBqa7Mifby7migb9-_0 2024-09-12T01:38:01.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.149+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1193554773537526159', time=2024-09-12T03:13:15.814906+0000, chain.objs.size()=1 2024-09-12T01:38:01.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.149+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.zesuMOA7Cy6MYF8l52NAZaDFkwW5gFk_0 2024-09-12T01:38:01.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.149+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15239082379592341760', time=2024-09-12T03:13:15.835370+0000, chain.objs.size()=1 2024-09-12T01:38:01.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.149+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.jtLz5Fq19hSyNjlFA6zTrEOzezGWgo4_0 2024-09-12T01:38:01.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.149+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11467057113269297483', time=2024-09-12T03:13:16.045655+0000, chain.objs.size()=1 2024-09-12T01:38:01.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.149+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.BVh0UOS2pPORcDz3q2OeJiuUpVIHddT_0 2024-09-12T01:38:01.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.149+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7775307063164665268', time=2024-09-12T03:13:16.363703+0000, chain.objs.size()=1 2024-09-12T01:38:01.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.149+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.tvpIPIr21fcFA24ohRtOWDAzDJaZ_Mw_0 2024-09-12T01:38:01.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.149+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17020288817254319888', time=2024-09-12T03:13:16.777668+0000, chain.objs.size()=1 2024-09-12T01:38:01.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.149+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.h9vh6Jf6g6A5gRWTYtjl_V2_RsqlUwD_0 2024-09-12T01:38:01.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.152+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9453960520785050472', time=2024-09-12T03:13:16.847151+0000, chain.objs.size()=1 2024-09-12T01:38:01.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.152+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.3RdFzDS0RNYr3CEBY8poV3bCmZ9mZ-t_0 2024-09-12T01:38:01.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.152+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4821436530213195555', time=2024-09-12T03:13:17.115571+0000, chain.objs.size()=1 2024-09-12T01:38:01.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.152+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.C8GAFkBsDyXkEg6EIQtc7UgIpqqViYG_0 2024-09-12T01:38:01.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.152+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8115035885991358415', time=2024-09-12T03:13:53.928571+0000, chain.objs.size()=1 2024-09-12T01:38:01.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.152+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_._QSTEjFOlBM7wQCwhNkdNTlGAyRD5HV_0 2024-09-12T01:38:01.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.152+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11884989819407352054', time=2024-09-12T03:13:54.089100+0000, chain.objs.size()=1 2024-09-12T01:38:01.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.152+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.baxDFHONJjLYbSi3JFXQmuGHNh_mGoi_0 2024-09-12T01:38:01.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.154+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11681057481206767034', time=2024-09-12T03:13:54.144129+0000, chain.objs.size()=1 2024-09-12T01:38:01.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.154+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.SE17lhJlUrcIP3z77qfpQ_paAyo9W_t_0 2024-09-12T01:38:01.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.154+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3137822387348586450', time=2024-09-12T03:13:56.877061+0000, chain.objs.size()=1 2024-09-12T01:38:01.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.154+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.G5NYn3AIuId8rrdr4DNxvNIgD3rhZOY_0 2024-09-12T01:38:01.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.154+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10662121754879596679', time=2024-09-12T03:13:57.826113+0000, chain.objs.size()=1 2024-09-12T01:38:01.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.154+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.2uBzZsfzCtARHJmnBM4jG8IVSeSBIyz_0 2024-09-12T01:38:01.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.154+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15359577582037345336', time=2024-09-12T03:13:57.860526+0000, chain.objs.size()=1 2024-09-12T01:38:01.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.154+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.MF5riiYTY4MRSNWdwTO97KyI9WQ3_Bm_0 2024-09-12T01:38:01.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.154+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7956655747577493687', time=2024-09-12T03:13:58.063495+0000, chain.objs.size()=1 2024-09-12T01:38:01.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.154+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.uuFN25WqSX-5q5iJGs6iy78X0HXhjWp_0 2024-09-12T01:38:01.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.154+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4254032346476032905', time=2024-09-12T03:13:58.130118+0000, chain.objs.size()=1 2024-09-12T01:38:01.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.154+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.oUO4LITfrM8W2U6_aQ4Leg-F3zO7xWI_0 2024-09-12T01:38:01.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.155+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4529154339730423850', time=2024-09-12T03:13:58.130792+0000, chain.objs.size()=1 2024-09-12T01:38:01.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.155+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.-StQZzKKdXP27tQsAE9gHDMJVdjzNMX_0 2024-09-12T01:38:01.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.157+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15995295668611492690', time=2024-09-12T03:13:58.293427+0000, chain.objs.size()=1 2024-09-12T01:38:01.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.157+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.9E-n3iWyLSmqqLgOyEkw0YA0w-zmkvG_0 2024-09-12T01:38:01.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.157+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15319436471354892059', time=2024-09-12T03:13:58.304785+0000, chain.objs.size()=1 2024-09-12T01:38:01.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.157+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.dErcuvUyVSHTXJ4FFMVTvrsOD1-hJkY_0 2024-09-12T01:38:01.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.157+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1548857527350387608', time=2024-09-12T03:13:58.320937+0000, chain.objs.size()=1 2024-09-12T01:38:01.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.157+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.D5Hb6J7uF_HyO38a9UVM_bY797_14Qq_0 2024-09-12T01:38:01.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.157+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17096194198618177363', time=2024-09-12T03:13:58.381942+0000, chain.objs.size()=1 2024-09-12T01:38:01.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.157+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.l3CemOPEOQubFO6pQk5_wVul86en-Yg_0 2024-09-12T01:38:01.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.160+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1069048091786110977', time=2024-09-12T03:13:58.787681+0000, chain.objs.size()=1 2024-09-12T01:38:01.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.160+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.3XL6Ajs2K9KJwLrz0IDE79gLLj_iKqE_0 2024-09-12T01:38:01.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.160+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18414485631878147733', time=2024-09-12T03:13:59.360578+0000, chain.objs.size()=1 2024-09-12T01:38:01.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.160+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.KLJFYWK7smQxJRbYHXWGtGydS9-t3Ee_0 2024-09-12T01:38:01.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.160+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.150571715096262604', time=2024-09-12T03:13:59.572583+0000, chain.objs.size()=1 2024-09-12T01:38:01.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.160+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.CtUYQ5pZ35e4SrkU3j7uRA-9JEyFN1V_0 2024-09-12T01:38:01.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.163+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 0/49002 2024-09-12T01:38:01.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.166+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=33, truncated=0, next_marker='' 2024-09-12T01:38:01.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.166+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3699402949291927625', time=2024-09-12T03:13:59.596172+0000, chain.objs.size()=1 2024-09-12T01:38:01.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.166+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.KeSzvkUrR1BIt6hXwNDSBoEhUuUjyOM_0 2024-09-12T01:38:01.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.166+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9283898529666259054', time=2024-09-12T03:13:59.643908+0000, chain.objs.size()=1 2024-09-12T01:38:01.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.166+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.V4yKeRNHnuqy8pZmgzSKa_nmDc5dCe9_0 2024-09-12T01:38:01.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.166+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.333687839627037631', time=2024-09-12T03:13:59.644712+0000, chain.objs.size()=1 2024-09-12T01:38:01.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.166+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Q3CtvaRlrWs1yl2Z4zZgjYjFOWqOlJy_0 2024-09-12T01:38:01.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.166+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7433219576165277377', time=2024-09-12T03:14:00.482866+0000, chain.objs.size()=1 2024-09-12T01:38:01.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.166+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.r3HPJvZgoQYxPGPratmJQWUsswakxrN_0 2024-09-12T01:38:01.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.166+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7693795584622905207', time=2024-09-12T03:14:00.732716+0000, chain.objs.size()=1 2024-09-12T01:38:01.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.166+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.pIblrmY1kU9GwhzrEJIuvxv7Qfq5Wo6_0 2024-09-12T01:38:01.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.166+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3612386016180994823', time=2024-09-12T03:14:00.849866+0000, chain.objs.size()=1 2024-09-12T01:38:01.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.166+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.sEfGkOJ0lFPrMAzI5dNQ_KHZXXILpV-_0 2024-09-12T01:38:01.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.166+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15597543591171659161', time=2024-09-12T03:14:00.880440+0000, chain.objs.size()=1 2024-09-12T01:38:01.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.166+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.T35YQGF_GPgS6ZQLtPpMJdsghppfMJY_0 2024-09-12T01:38:01.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.166+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8181897032689344091', time=2024-09-12T03:14:01.266297+0000, chain.objs.size()=1 2024-09-12T01:38:01.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.166+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.mqLEUr2k5X_4l3QG4Pkt-udrgxk-gp__0 2024-09-12T01:38:01.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.166+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13476717627718543320', time=2024-09-12T03:14:02.067983+0000, chain.objs.size()=1 2024-09-12T01:38:01.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.166+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.LYdag8Qa2QSJz-b03d0b5KBaZElR_se_0 2024-09-12T01:38:01.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.166+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4535335116619584660', time=2024-09-12T03:14:02.345569+0000, chain.objs.size()=1 2024-09-12T01:38:01.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.166+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.pYIQgl3giO817VluzL08t_1VZds6qn2_0 2024-09-12T01:38:01.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.166+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15183118607978752362', time=2024-09-12T03:14:02.569262+0000, chain.objs.size()=1 2024-09-12T01:38:01.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.166+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.lhaNadOB6XjdC0-pANerIMe96TeQI_-_0 2024-09-12T01:38:01.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.166+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10712251203704624110', time=2024-09-12T03:14:03.058377+0000, chain.objs.size()=1 2024-09-12T01:38:01.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.166+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.dCXeHs33gDheipzRawqLZfDReSxTjpV_0 2024-09-12T01:38:01.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.167+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4972233700644516364', time=2024-09-12T03:14:03.273024+0000, chain.objs.size()=1 2024-09-12T01:38:01.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.167+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.tve5Dho87WvK2cxcUmjzCJVByoiEDwH_0 2024-09-12T01:38:01.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.167+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11288734770247556003', time=2024-09-12T03:14:03.673193+0000, chain.objs.size()=1 2024-09-12T01:38:01.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.167+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.rrmMXiDrBE83m_HoX2ib55uMKjaOyrr_0 2024-09-12T01:38:01.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.168+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2239530657330289876', time=2024-09-12T03:16:12.516450+0000, chain.objs.size()=1 2024-09-12T01:38:01.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.168+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.458__shadow_.VWgHnC6LNK9wYr6nQCaSRuCJaF_KCpp_0 2024-09-12T01:38:01.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.168+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9833180206189481249', time=2024-09-12T03:16:45.351836+0000, chain.objs.size()=1 2024-09-12T01:38:01.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.168+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.491__shadow_.JGBIfG_Noi4SZmMhosrxtfJV_laYCkq_0 2024-09-12T01:38:01.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.168+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6147246502147118938', time=2024-09-12T03:18:24.046910+0000, chain.objs.size()=3 2024-09-12T01:38:01.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.168+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.521__multipart_mymultipart.2~-cnOXxunUPNS_IJlXQ1djbiEJIr_Hpf.1 2024-09-12T01:38:01.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.168+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.521__multipart_mymultipart.2~-cnOXxunUPNS_IJlXQ1djbiEJIr_Hpf.2 2024-09-12T01:38:01.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.168+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.521__multipart_mymultipart.2~-cnOXxunUPNS_IJlXQ1djbiEJIr_Hpf.3 2024-09-12T01:38:01.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.168+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='2~fZqbblGzXMQbERy5dCDCgN3cy0wgkF8', time=2024-09-12T03:20:09.978448+0000, chain.objs.size()=1 2024-09-12T01:38:01.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.168+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.522__multipart_mymultipart.2~fZqbblGzXMQbERy5dCDCgN3cy0wgkF8.1 2024-09-12T01:38:01.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.168+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='2~fZqbblGzXMQbERy5dCDCgN3cy0wgkF8', time=2024-09-12T03:20:09.982730+0000, chain.objs.size()=1 2024-09-12T01:38:01.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.168+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.522__multipart_mymultipart.2~fZqbblGzXMQbERy5dCDCgN3cy0wgkF8.2 2024-09-12T01:38:01.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.168+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='2~fZqbblGzXMQbERy5dCDCgN3cy0wgkF8', time=2024-09-12T03:20:09.986469+0000, chain.objs.size()=1 2024-09-12T01:38:01.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.168+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.522__multipart_mymultipart.2~fZqbblGzXMQbERy5dCDCgN3cy0wgkF8.3 2024-09-12T01:38:01.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.168+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='2~fZqbblGzXMQbERy5dCDCgN3cy0wgkF8', time=2024-09-12T03:20:09.990320+0000, chain.objs.size()=1 2024-09-12T01:38:01.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.168+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.522__multipart_mymultipart.2~fZqbblGzXMQbERy5dCDCgN3cy0wgkF8.4 2024-09-12T01:38:01.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.169+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='2~fZqbblGzXMQbERy5dCDCgN3cy0wgkF8', time=2024-09-12T03:20:09.993867+0000, chain.objs.size()=1 2024-09-12T01:38:01.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.169+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.522__multipart_mymultipart.2~fZqbblGzXMQbERy5dCDCgN3cy0wgkF8.5 2024-09-12T01:38:01.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.169+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='2~fZqbblGzXMQbERy5dCDCgN3cy0wgkF8', time=2024-09-12T03:20:09.997528+0000, chain.objs.size()=1 2024-09-12T01:38:01.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.169+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.522__multipart_mymultipart.2~fZqbblGzXMQbERy5dCDCgN3cy0wgkF8.6 2024-09-12T01:38:01.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.169+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11315301279308186173', time=2024-09-12T03:20:55.648217+0000, chain.objs.size()=3 2024-09-12T01:38:01.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.169+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.525__multipart_mymultipart.2~lrXj5BsEG7anJ3VaUI2poYlQ4YfcREl.1 2024-09-12T01:38:01.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.171+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.525__multipart_mymultipart.2~lrXj5BsEG7anJ3VaUI2poYlQ4YfcREl.2 2024-09-12T01:38:01.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.171+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.525__multipart_mymultipart.2~lrXj5BsEG7anJ3VaUI2poYlQ4YfcREl.3 2024-09-12T01:38:01.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.171+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='2~C7euCmWiHnVCnm0qk48Lzew7iB36euR', time=2024-09-12T03:21:23.478102+0000, chain.objs.size()=1 2024-09-12T01:38:01.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.171+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.534__multipart_mymultipart.2~C7euCmWiHnVCnm0qk48Lzew7iB36euR.1 2024-09-12T01:38:01.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.171+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6453156541525412272', time=2024-09-12T03:22:22.310705+0000, chain.objs.size()=1 2024-09-12T01:38:01.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.171+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.552__shadow_.OQNuxXEZHdxIIdHCu9L9InRaBIGbfbx_0 2024-09-12T01:38:01.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.171+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9013821506753871353', time=2024-09-12T03:23:30.842245+0000, chain.objs.size()=1 2024-09-12T01:38:01.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.171+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.575__shadow_.-4Xoytzbk7EY7enBa9pWAjxkrLS4S4w_0 2024-09-12T01:38:01.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.171+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2418468787516977712', time=2024-09-12T03:23:50.791824+0000, chain.objs.size()=1 2024-09-12T01:38:01.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.171+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.577__shadow:VUY8wf0P0KXeo5.2TuUQahb8RM0kAN8_.43hvDV0GzoVc7x82U_ATm_rcgWvLPtn_0 2024-09-12T01:38:01.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.171+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16200712417107787571', time=2024-09-12T03:23:57.781314+0000, chain.objs.size()=1 2024-09-12T01:38:01.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.171+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.577__shadow:tm57ELJA5K-KyGvUmYpw3USBOes9TLF_.XZtk4VZzna8eqgYOCoSy0jcfeEhuLrw_0 2024-09-12T01:38:01.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.171+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15851708492579006054', time=2024-09-12T03:23:58.326574+0000, chain.objs.size()=1 2024-09-12T01:38:01.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.171+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.577__shadow:wTGfFJkGC.CypNiKQDI4efWbyK7YLjN_.0NWItTu41ci5p1DYEvtZOLCdkUgCCTL_0 2024-09-12T01:38:01.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.171+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8787167086886346158', time=2024-09-12T03:24:38.946983+0000, chain.objs.size()=1 2024-09-12T01:38:01.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.171+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.580__shadow:rti6lG5SjN5JArBCm7lt0wFRBt.7dmw_.czMrMk2GH347WN7UyZwy8vP-ngYA1Y4_0 2024-09-12T01:38:01.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.171+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2705772990344375694', time=2024-09-12T03:28:57.531924+0000, chain.objs.size()=1 2024-09-12T01:38:01.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.171+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.619__shadow_.rIgiXneBX7pXAOs3vXy6WHMAdvjtGA__0 2024-09-12T01:38:01.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.171+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15605921750654476703', time=2024-09-12T03:31:37.567013+0000, chain.objs.size()=1 2024-09-12T01:38:01.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.171+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.709__shadow_.LHEC2H5ybb-6Ueu6G6CEjLTfsrm0EJc_0 2024-09-12T01:38:01.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.174+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:38:01.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.176+0000 7f8786c98800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T01:38:01.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.178+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:38:01.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.178+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:38:01.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.179+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49414' 2024-09-12T01:38:01.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.179+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14853622897543800374', time=2024-09-12T03:07:27.139522+0000, chain.objs.size()=1 2024-09-12T01:38:01.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.179+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.171__shadow_.nA6O9PaxkH-5C81qk7np1xsCtXQU5Kw_0 2024-09-12T01:38:01.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.179+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4913679059929250238', time=2024-09-12T03:10:05.812565+0000, chain.objs.size()=1 2024-09-12T01:38:01.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.179+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.230__shadow_.YzVDeowC7I03oE3LHhx_WpXXIdBLeHw_0 2024-09-12T01:38:01.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.179+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.827455995924164573', time=2024-09-12T03:10:17.639646+0000, chain.objs.size()=1 2024-09-12T01:38:01.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.179+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.241__shadow_.FH18dLYkzf9t42_mI47jFx00THhcZyi_0 2024-09-12T01:38:01.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.179+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9635501870348520239', time=2024-09-12T03:10:28.822794+0000, chain.objs.size()=1 2024-09-12T01:38:01.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.179+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.251__shadow_.-HFinSoMGKUI9M_IDN_Pn5qGDBoKRtU_0 2024-09-12T01:38:01.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.179+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4273236429408174509', time=2024-09-12T03:10:33.698070+0000, chain.objs.size()=1 2024-09-12T01:38:01.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.179+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.256__shadow_.pDVhMcB9APtSjldqKtK5gkq3xJszOfq_0 2024-09-12T01:38:01.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.179+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6059658735498239235', time=2024-09-12T03:10:33.702543+0000, chain.objs.size()=1 2024-09-12T01:38:01.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.179+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.256__shadow_.hp7QXDMiMAMBvHSQtgf4Lc5jtdr7asB_0 2024-09-12T01:38:01.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.179+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3330783259551629433', time=2024-09-12T03:10:36.450263+0000, chain.objs.size()=1 2024-09-12T01:38:01.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.179+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.259__shadow_.YAMMEUJ2RIUjCDG9YEFZT1mw7eNnQQS_0 2024-09-12T01:38:01.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.179+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18106564552815522189', time=2024-09-12T03:10:38.399351+0000, chain.objs.size()=1 2024-09-12T01:38:01.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.179+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.261__shadow_.wjZ4TP-x_I1OfMm22Pn_XbXadiG_WvE_0 2024-09-12T01:38:01.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.179+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9180076610934391669', time=2024-09-12T03:11:14.518054+0000, chain.objs.size()=1 2024-09-12T01:38:01.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.179+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.UYFxhkxrViw0LFMl1sOOfPYl_6Pi91D_0 2024-09-12T01:38:01.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.179+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18138785187901703096', time=2024-09-12T03:11:14.702298+0000, chain.objs.size()=1 2024-09-12T01:38:01.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.179+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.8kwvnPEfiKNIH-rDXhyWCs_GahnyZBD_0 2024-09-12T01:38:01.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.179+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12061177950708779056', time=2024-09-12T03:11:14.915266+0000, chain.objs.size()=1 2024-09-12T01:38:01.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.179+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.KojumSLo5vu2c79tMV6q3F5AW87hSEv_0 2024-09-12T01:38:01.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.179+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12122444023348670589', time=2024-09-12T03:11:15.134174+0000, chain.objs.size()=1 2024-09-12T01:38:01.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.179+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.mjHqAVRJjG2QXnF13K58KUZdQ2fCMlA_0 2024-09-12T01:38:01.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.181+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12730163565955026129', time=2024-09-12T03:11:15.304659+0000, chain.objs.size()=1 2024-09-12T01:38:01.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.181+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.nBEvHGd_Efouj1wPM95copuQODaYJmq_0 2024-09-12T01:38:01.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.181+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.652303870381342867', time=2024-09-12T03:11:15.409058+0000, chain.objs.size()=1 2024-09-12T01:38:01.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.181+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.hYVc9wCWbAHBk1JzTZX31_W_a-A16WU_0 2024-09-12T01:38:01.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.181+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16279886412273837633', time=2024-09-12T03:11:16.341751+0000, chain.objs.size()=1 2024-09-12T01:38:01.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.181+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.sKLex-d4xw8ukVUTwPwPj2E1ZPCZS4o_0 2024-09-12T01:38:01.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.181+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1019814704705151838', time=2024-09-12T03:11:17.582061+0000, chain.objs.size()=1 2024-09-12T01:38:01.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.181+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.jfDXvlMTUr5a7w5WFr8qIjOOB6X-s-h_0 2024-09-12T01:38:01.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.181+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9901087565715708524', time=2024-09-12T03:11:18.954210+0000, chain.objs.size()=1 2024-09-12T01:38:01.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.181+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Keyl02Ovs-9XpOrHc7KnjBB0sxag5EZ_0 2024-09-12T01:38:01.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.181+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9768988108347180572', time=2024-09-12T03:11:19.235016+0000, chain.objs.size()=1 2024-09-12T01:38:01.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.181+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.AOTvWxpR7KoHvfoc4rlbzHI92OPlQTf_0 2024-09-12T01:38:01.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.182+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13771387810787662777', time=2024-09-12T03:11:19.410860+0000, chain.objs.size()=1 2024-09-12T01:38:01.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.182+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.G18Vowmnp-uJMv-RPuhvtCqVT4tuja7_0 2024-09-12T01:38:01.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.182+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14913913362875327236', time=2024-09-12T03:11:19.721116+0000, chain.objs.size()=1 2024-09-12T01:38:01.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.182+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Ve8saYV7GQxLaWxybTfvVTnDBcsH_4l_0 2024-09-12T01:38:01.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.182+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7751247058650398915', time=2024-09-12T03:11:19.763460+0000, chain.objs.size()=1 2024-09-12T01:38:01.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.182+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_._vZ958e-k5udn8x--TW_Nd1oABLognj_0 2024-09-12T01:38:01.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.182+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16812172005700797782', time=2024-09-12T03:11:19.764257+0000, chain.objs.size()=1 2024-09-12T01:38:01.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.182+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.hxnLIhfpwKpLWGDXWJm3vaw4TE2vlHj_0 2024-09-12T01:38:01.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.182+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14795601433946020988', time=2024-09-12T03:11:19.825860+0000, chain.objs.size()=1 2024-09-12T01:38:01.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.182+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.e53dkiJLpLFmFq3BntMKLEt00Z2TrVY_0 2024-09-12T01:38:01.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.183+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2899914120206452889', time=2024-09-12T03:11:20.552273+0000, chain.objs.size()=1 2024-09-12T01:38:01.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.183+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.pgNbQpHGZOEuZ2l7lLWA-5oaFqhiSGQ_0 2024-09-12T01:38:01.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.184+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12838294712783646728', time=2024-09-12T03:11:21.132756+0000, chain.objs.size()=1 2024-09-12T01:38:01.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.184+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.VX7BJTKRyg4u7_GAZXxyDqFTOPkE3rF_0 2024-09-12T01:38:01.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.184+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14535461338015379428', time=2024-09-12T03:11:21.172863+0000, chain.objs.size()=1 2024-09-12T01:38:01.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.184+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.mg2-B44PISh8diQVsGM36Urhu5WlsPN_0 2024-09-12T01:38:01.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.184+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9231465283157627382', time=2024-09-12T03:11:21.538380+0000, chain.objs.size()=1 2024-09-12T01:38:01.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.184+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.YW0Y-PKscuNsvn4tvJe1VQI6LR1jj_o_0 2024-09-12T01:38:01.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.184+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18293024844509410443', time=2024-09-12T03:11:21.539099+0000, chain.objs.size()=1 2024-09-12T01:38:01.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.184+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.ax2bBA6PEByUO43KLxSkonfc1jY4CST_0 2024-09-12T01:38:01.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.184+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3122347501230827767', time=2024-09-12T03:11:21.771593+0000, chain.objs.size()=1 2024-09-12T01:38:01.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.184+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.qQIKlNw5mqwsgQNmls36wkA190l2GzX_0 2024-09-12T01:38:01.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.184+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10130598013008377328', time=2024-09-12T03:11:21.838663+0000, chain.objs.size()=1 2024-09-12T01:38:01.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.184+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.CA51opELqRD15SGNhbWKuMRM0nT_OkJ_0 2024-09-12T01:38:01.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.184+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9265059880443719907', time=2024-09-12T03:11:22.112769+0000, chain.objs.size()=1 2024-09-12T01:38:01.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.184+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.EVCh6TzbrUcPqbn_R1Y0bvlzPHNLR6N_0 2024-09-12T01:38:01.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.184+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4480557087381203242', time=2024-09-12T03:11:22.449947+0000, chain.objs.size()=1 2024-09-12T01:38:01.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.184+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.TUzNQD2RF_C1y92Bex350pcExf09JCy_0 2024-09-12T01:38:01.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.184+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5285255546405931805', time=2024-09-12T03:11:23.244566+0000, chain.objs.size()=1 2024-09-12T01:38:01.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.184+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.-bNqqkyKIgLRqj3bZGZ5ockHmwpANQE_0 2024-09-12T01:38:01.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.184+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1067862568455949203', time=2024-09-12T03:11:23.787417+0000, chain.objs.size()=1 2024-09-12T01:38:01.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.184+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.LJzeiMG-Jn5b652A2PzrrbV5Agq7Rw3_0 2024-09-12T01:38:01.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.185+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8342230058622774242', time=2024-09-12T03:11:23.823807+0000, chain.objs.size()=1 2024-09-12T01:38:01.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.185+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.EvTdFVGBwTBwjuoVBYExTrTETgdRdm3_0 2024-09-12T01:38:01.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.186+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2006699238026900698', time=2024-09-12T03:11:24.108973+0000, chain.objs.size()=1 2024-09-12T01:38:01.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.186+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.pw4iR5hZZ1JlkTbreuNEgq67oFyJm1f_0 2024-09-12T01:38:01.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.186+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16380919217547176435', time=2024-09-12T03:11:24.195817+0000, chain.objs.size()=1 2024-09-12T01:38:01.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.186+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.H99MhWndSxYEeXQAPtCLUL4wiy7K4AR_0 2024-09-12T01:38:01.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.186+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17067116396085139574', time=2024-09-12T03:11:24.270857+0000, chain.objs.size()=1 2024-09-12T01:38:01.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.186+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.6u9W4z41-CekBTyO0ZH5M3BG7EySMiZ_0 2024-09-12T01:38:01.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.186+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14768150878406340255', time=2024-09-12T03:11:24.369729+0000, chain.objs.size()=1 2024-09-12T01:38:01.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.186+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.AoojuxreRjbPUmMSuuGFGeZ4t-u8nn0_0 2024-09-12T01:38:01.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.186+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9015404165195322770', time=2024-09-12T03:11:24.911274+0000, chain.objs.size()=1 2024-09-12T01:38:01.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.186+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.z12ZROnFlNhzxkCFNfZ1kbamaTXPH1N_0 2024-09-12T01:38:01.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.187+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10679492190254825685', time=2024-09-12T03:11:49.880156+0000, chain.objs.size()=1 2024-09-12T01:38:01.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.187+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.288__shadow_.AyQF3NZI3hUSnzkuCADxRF62J02zJ11_0 2024-09-12T01:38:01.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.187+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10820860714849169077', time=2024-09-12T03:11:55.419764+0000, chain.objs.size()=1 2024-09-12T01:38:01.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.187+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.292__shadow_.QLWDyNDA2xV6lDdkFPSbY3clw9w4xq7_0 2024-09-12T01:38:01.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.188+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6664234393276212881', time=2024-09-12T03:11:57.496853+0000, chain.objs.size()=1 2024-09-12T01:38:01.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.188+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.293__shadow_.618LZaW8QtltHJrSF-_Yiunh1DftIgR_0 2024-09-12T01:38:01.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.188+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6751287589079795041', time=2024-09-12T03:12:01.647205+0000, chain.objs.size()=1 2024-09-12T01:38:01.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.188+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.297__shadow_.Y-LjRG1HNH0b2htP45KYaIDtdEZNeeU_0 2024-09-12T01:38:01.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.188+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6188187801563399969', time=2024-09-12T03:12:12.267909+0000, chain.objs.size()=1 2024-09-12T01:38:01.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.188+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.307__shadow:5cCEjhyTqvMhn3f2EePboC0OUBh7Psq_.wgBHcfzVrqWhtdutwTmi7fCV8VGR7il_0 2024-09-12T01:38:01.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.188+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3208282594480986894', time=2024-09-12T03:13:06.994804+0000, chain.objs.size()=1 2024-09-12T01:38:01.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.188+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.buAmm3qa1pOlczI8NGwlE6S-j3-gP9C_0 2024-09-12T01:38:01.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.189+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6760289408464219637', time=2024-09-12T03:13:08.797615+0000, chain.objs.size()=1 2024-09-12T01:38:01.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.189+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.EXo3vyrAkD5iWY9LcF8IvjRmcAKw1Ro_0 2024-09-12T01:38:01.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.189+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14549945983756703504', time=2024-09-12T03:13:09.211983+0000, chain.objs.size()=1 2024-09-12T01:38:01.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.189+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.ixd-mJFqloCXsce-64JPR5eMZvbsfiB_0 2024-09-12T01:38:01.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.189+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.872113053096993651', time=2024-09-12T03:13:09.895220+0000, chain.objs.size()=1 2024-09-12T01:38:01.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.189+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.JYuvsoSOr4oI8Tpb82p3NySAHR2jbT0_0 2024-09-12T01:38:01.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.189+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2865867972295075348', time=2024-09-12T03:13:10.022743+0000, chain.objs.size()=1 2024-09-12T01:38:01.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.189+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.seLkwciueQNkdG-VNpKoTxH1q9WyC1c_0 2024-09-12T01:38:01.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.189+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5886513242968820183', time=2024-09-12T03:13:10.212264+0000, chain.objs.size()=1 2024-09-12T01:38:01.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.189+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.eA43hfKrL8CMPJF8Q-QWgiqzjqh2kI6_0 2024-09-12T01:38:01.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.189+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9557521090859254597', time=2024-09-12T03:13:10.569780+0000, chain.objs.size()=1 2024-09-12T01:38:01.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.189+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.ecYdqlPc-EW3ACjApoLJY9bgN99IRhw_0 2024-09-12T01:38:01.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.189+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5483965464154548125', time=2024-09-12T03:13:11.193005+0000, chain.objs.size()=1 2024-09-12T01:38:01.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.189+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.di9YQD5bGXfPfwQnOLXlwIaOF1h3Oti_0 2024-09-12T01:38:01.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.190+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6607575179410874451', time=2024-09-12T03:13:11.467555+0000, chain.objs.size()=1 2024-09-12T01:38:01.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.190+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_._si_aXgPnfTlO61wlD_M5GoPwsqXHOb_0 2024-09-12T01:38:01.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.190+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6429466160494132179', time=2024-09-12T03:13:11.468173+0000, chain.objs.size()=1 2024-09-12T01:38:01.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.190+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.ZlBatOl55X_wMlEosvMAWCnvC2c8YvO_0 2024-09-12T01:38:01.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.190+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3775595286108816319', time=2024-09-12T03:13:11.515565+0000, chain.objs.size()=1 2024-09-12T01:38:01.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.190+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.UyQcQyU0PVTpWSviu9oXMpaugAT9ocu_0 2024-09-12T01:38:01.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.190+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16454689934068107043', time=2024-09-12T03:13:11.750580+0000, chain.objs.size()=1 2024-09-12T01:38:01.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.190+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.rneYe5e5PI81VMH-AYg77hXJIubmRau_0 2024-09-12T01:38:01.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.190+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11520864805165459504', time=2024-09-12T03:13:11.835935+0000, chain.objs.size()=1 2024-09-12T01:38:01.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.190+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.GtoNyrua7OJp-pXFHmr-3nOhY5rtNaz_0 2024-09-12T01:38:01.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.191+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8572946926572496157', time=2024-09-12T03:13:12.675310+0000, chain.objs.size()=1 2024-09-12T01:38:01.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.191+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.UNVOZ3zMHczz906sHINtkUTfeNmnDFp_0 2024-09-12T01:38:01.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.191+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.164949060977452535', time=2024-09-12T03:13:13.363344+0000, chain.objs.size()=1 2024-09-12T01:38:01.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.191+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.s5hLh3pyw8J1G5irJfBbEfXKaKyftgI_0 2024-09-12T01:38:01.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.191+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1128515761646524548', time=2024-09-12T03:13:14.107782+0000, chain.objs.size()=1 2024-09-12T01:38:01.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.191+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.NRMKUfxoRkm7BQmEGv-9JT_J13jpTZz_0 2024-09-12T01:38:01.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.191+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1771402191848236946', time=2024-09-12T03:13:14.380760+0000, chain.objs.size()=1 2024-09-12T01:38:01.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.191+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.WTc_dRVba1EgDSUeK-p3l5cHcLQnm7F_0 2024-09-12T01:38:01.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.191+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1969161922251367562', time=2024-09-12T03:13:14.548241+0000, chain.objs.size()=1 2024-09-12T01:38:01.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.191+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.3uEVvEyo6HjvstMz8KNx_SX5ljPFqIG_0 2024-09-12T01:38:01.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.191+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7800738175850741202', time=2024-09-12T03:13:14.744175+0000, chain.objs.size()=1 2024-09-12T01:38:01.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.191+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.4f_-eRRKaAw8EJhicsggQ6qNTkXd0dd_0 2024-09-12T01:38:01.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.192+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12977473242185891708', time=2024-09-12T03:13:15.112311+0000, chain.objs.size()=1 2024-09-12T01:38:01.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.192+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.qafF6rxI7UFA5dHFcE08iqO1cY4A_Ut_0 2024-09-12T01:38:01.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.193+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.818014117189395770', time=2024-09-12T03:13:15.418645+0000, chain.objs.size()=1 2024-09-12T01:38:01.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.193+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.QVSKtz7y5kGGwiYn7nvXVKxej0QFuB7_0 2024-09-12T01:38:01.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.193+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9876537033442952011', time=2024-09-12T03:13:15.918035+0000, chain.objs.size()=1 2024-09-12T01:38:01.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.193+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.ayZYvAJ_hoBz6hdozjcdVrZYV9DUfJW_0 2024-09-12T01:38:01.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.193+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14878774139380805924', time=2024-09-12T03:13:15.918759+0000, chain.objs.size()=1 2024-09-12T01:38:01.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.193+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.8AIo54GvlglU5zw_CzMwxJHuzHmw-Ku_0 2024-09-12T01:38:01.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.194+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17480838227499654265', time=2024-09-12T03:13:16.017313+0000, chain.objs.size()=1 2024-09-12T01:38:01.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.194+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.aF8JblwVYcF0_jPqspX_z_vXTR8QoJf_0 2024-09-12T01:38:01.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.194+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.867935904868101748', time=2024-09-12T03:13:16.377552+0000, chain.objs.size()=1 2024-09-12T01:38:01.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.194+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.rb5fL3UePPDedPDke6fvZo9gacBBBkE_0 2024-09-12T01:38:01.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.194+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4593296619857199027', time=2024-09-12T03:13:16.668707+0000, chain.objs.size()=1 2024-09-12T01:38:01.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.194+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.gpQAFJPj9Sy7Igjulp5vSjL8CZBATDR_0 2024-09-12T01:38:01.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.194+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9232864697532907956', time=2024-09-12T03:13:16.847896+0000, chain.objs.size()=1 2024-09-12T01:38:01.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.194+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.L6pP5inVVoW49-wsr5hhgj2faAr_olq_0 2024-09-12T01:38:01.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.194+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6595386273931471766', time=2024-09-12T03:13:53.984681+0000, chain.objs.size()=1 2024-09-12T01:38:01.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.194+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.QvIt5Quxso0psDwROrXt5sy1QxFtWAX_0 2024-09-12T01:38:01.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.194+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2214990667137257140', time=2024-09-12T03:13:54.032505+0000, chain.objs.size()=1 2024-09-12T01:38:01.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.194+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.w-fdv11t_bpzeeBmgiN04-h4lEwlNP6_0 2024-09-12T01:38:01.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.194+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13550498656536632428', time=2024-09-12T03:13:54.322779+0000, chain.objs.size()=1 2024-09-12T01:38:01.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.194+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.g2iTmi-e-HKJbQEU2RNR0RL-LO-w-ZU_0 2024-09-12T01:38:01.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.194+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4882737768173004963', time=2024-09-12T03:13:54.538123+0000, chain.objs.size()=1 2024-09-12T01:38:01.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.194+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.o5EKoDEMqEX_kJteZH_gPzoBdtMEJux_0 2024-09-12T01:38:01.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.195+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7267164771499525630', time=2024-09-12T03:13:55.278473+0000, chain.objs.size()=1 2024-09-12T01:38:01.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.195+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.vMygHnz-b3G6FH7stpLTDEBs9HSwcMi_0 2024-09-12T01:38:01.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.195+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1334570904045017710', time=2024-09-12T03:13:55.372765+0000, chain.objs.size()=1 2024-09-12T01:38:01.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.195+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.ZyQxiE2JchBMxV9mNRU93rmBJUxM4xC_0 2024-09-12T01:38:01.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.196+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6622677611640049820', time=2024-09-12T03:13:55.583102+0000, chain.objs.size()=1 2024-09-12T01:38:01.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.196+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.JkWoNXkgty4TrbfM45CborwzmBt2ZKX_0 2024-09-12T01:38:01.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.196+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6167265988853814607', time=2024-09-12T03:13:55.614898+0000, chain.objs.size()=1 2024-09-12T01:38:01.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.196+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.J7OS1aTLRMtvzJvhWhPsApct5hRZkUV_0 2024-09-12T01:38:01.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.197+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5864902464868852037', time=2024-09-12T03:13:56.832785+0000, chain.objs.size()=1 2024-09-12T01:38:01.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.197+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Rhc7WRvtDuADBMaXqzmA9dBEoZP7i_C_0 2024-09-12T01:38:01.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.197+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13944036814097350948', time=2024-09-12T03:13:57.123295+0000, chain.objs.size()=1 2024-09-12T01:38:01.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.197+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.QMnfGpAOoJ3NaGILg22WqT0dQ-1LBfR_0 2024-09-12T01:38:01.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.197+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6905973180599102809', time=2024-09-12T03:13:58.253583+0000, chain.objs.size()=1 2024-09-12T01:38:01.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.197+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.8xShehBuKPvvuRu_lW_slySoF_7f0bU_0 2024-09-12T01:38:01.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.197+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14041539759990872454', time=2024-09-12T03:13:58.459633+0000, chain.objs.size()=1 2024-09-12T01:38:01.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.197+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.tq7oPyxo19U64lJFQKyjm6_cMtjHVTO_0 2024-09-12T01:38:01.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.197+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8609022080157012512', time=2024-09-12T03:13:58.554388+0000, chain.objs.size()=1 2024-09-12T01:38:01.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.197+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Fcp1rr8LkbREbDkJNW1tZe22SJ2hkqP_0 2024-09-12T01:38:01.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.197+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13598666447450244384', time=2024-09-12T03:13:59.131825+0000, chain.objs.size()=1 2024-09-12T01:38:01.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.197+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.e8nrBVyVq1fkTXZNrqLBeL9yKDrj_ZJ_0 2024-09-12T01:38:01.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.197+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17260197633541072754', time=2024-09-12T03:13:59.330057+0000, chain.objs.size()=1 2024-09-12T01:38:01.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.197+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.FH2t11MqFlr5DG6fclCZlehFZ3F8AG6_0 2024-09-12T01:38:01.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.197+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12492979330738155583', time=2024-09-12T03:13:59.643589+0000, chain.objs.size()=1 2024-09-12T01:38:01.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.197+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.EZaYw7BUbmYHJ25b309DPw6FtQKa_uv_0 2024-09-12T01:38:01.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.197+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8911864597675532179', time=2024-09-12T03:13:59.766128+0000, chain.objs.size()=1 2024-09-12T01:38:01.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.197+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.bmDlQD4MMSHEJ6EuiM7_LFwetSqKSmE_0 2024-09-12T01:38:01.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.198+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14139728984751710041', time=2024-09-12T03:13:59.812088+0000, chain.objs.size()=1 2024-09-12T01:38:01.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.198+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.MPEFGR4bnwbI6B3Yl2rC8E8CFL-rW4B_0 2024-09-12T01:38:01.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.198+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.870842583238913009', time=2024-09-12T03:13:59.812763+0000, chain.objs.size()=1 2024-09-12T01:38:01.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.198+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.BA2qrL3d7zO00Mkaa0TaWgdM136TKdv_0 2024-09-12T01:38:01.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.198+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11586350421988186066', time=2024-09-12T03:14:00.046598+0000, chain.objs.size()=1 2024-09-12T01:38:01.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.198+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.gD_1fH6ui6_MQoHgss9c6rrzQMYquVc_0 2024-09-12T01:38:01.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.198+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15966033803814628271', time=2024-09-12T03:14:00.733743+0000, chain.objs.size()=1 2024-09-12T01:38:01.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.198+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.nv3QNwzaPctpQtH8L27m4n35g6el4Pp_0 2024-09-12T01:38:01.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.198+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7665916068015204565', time=2024-09-12T03:14:00.793096+0000, chain.objs.size()=1 2024-09-12T01:38:01.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.198+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.YYrhKj30A3pnFk4H4wBcltOmtGJpraN_0 2024-09-12T01:38:01.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.198+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.311394491393035735', time=2024-09-12T03:14:01.202638+0000, chain.objs.size()=1 2024-09-12T01:38:01.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.198+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.un0DzWMsQY9iJcB8OPmkiSOD4uTrrGJ_0 2024-09-12T01:38:01.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.199+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15160731789787550447', time=2024-09-12T03:14:01.266255+0000, chain.objs.size()=1 2024-09-12T01:38:01.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.199+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.y1c-41fwsQT0DYBlZSp98Tj1WL2fAuv_0 2024-09-12T01:38:01.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.199+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6384360703079199442', time=2024-09-12T03:14:02.201576+0000, chain.objs.size()=1 2024-09-12T01:38:01.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.199+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.ZVLqX8RY45XQVSYDHELtbYoKLDAQueS_0 2024-09-12T01:38:01.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.199+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14978594981298422422', time=2024-09-12T03:14:03.380930+0000, chain.objs.size()=1 2024-09-12T01:38:01.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.199+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.k171qaDirypzZD6IWm-mLn5INNFVbSs_0 2024-09-12T01:38:01.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.200+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6158052406597203328', time=2024-09-12T03:14:03.381456+0000, chain.objs.size()=1 2024-09-12T01:38:01.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.200+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.3XR-lSzbsVSAqY9DrDLboGBxjxiIvM0_0 2024-09-12T01:38:01.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.200+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15298095080006765945', time=2024-09-12T03:14:41.088987+0000, chain.objs.size()=1 2024-09-12T01:38:01.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.200+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.367__shadow_.EtS2RraqIPquq4M3fY_hQGZHVkx6TcZ_0 2024-09-12T01:38:01.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.202+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 0/49414 2024-09-12T01:38:01.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.204+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T01:38:01.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.204+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17765391117171497371', time=2024-09-12T03:14:50.106892+0000, chain.objs.size()=1 2024-09-12T01:38:01.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.204+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.376__shadow_.Ikonbvf7fs9qL9TXL672O1A_i9fKSu9_0 2024-09-12T01:38:01.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.204+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12193188308283512038', time=2024-09-12T03:14:52.169079+0000, chain.objs.size()=1 2024-09-12T01:38:01.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.204+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.378__shadow_.GvcqGUf3oibk_20KA8ocRzqlLkdokjR_0 2024-09-12T01:38:01.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.204+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4718385637159020991', time=2024-09-12T03:14:58.051079+0000, chain.objs.size()=1 2024-09-12T01:38:01.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.204+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.384__shadow_.Rf3K9Y5tcGN7BII9gfzEsN8jNfU4MaK_0 2024-09-12T01:38:01.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.204+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8859281936675382579', time=2024-09-12T03:16:11.120559+0000, chain.objs.size()=1 2024-09-12T01:38:01.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.204+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.457__shadow_.fKfQHRpnZZ1-pFLPtaicChY4Yy7Tgpg_0 2024-09-12T01:38:01.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.204+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17483415573790995258', time=2024-09-12T03:16:34.342675+0000, chain.objs.size()=1 2024-09-12T01:38:01.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.204+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.483__shadow_.zzb0Pmax0UjkKwjlV75HFX4r_YY1IjN_0 2024-09-12T01:38:01.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.204+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3744567426461810161', time=2024-09-12T03:16:55.876877+0000, chain.objs.size()=1 2024-09-12T01:38:01.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.204+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.503__shadow:zjHxI5MExGDTEMgC.YI1-B-Wp2XBZjW_.xteVVbi5oDy4c1uLu1Qcooxbp-bOuaB_0 2024-09-12T01:38:01.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.204+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15698126346922529594', time=2024-09-12T03:18:34.345115+0000, chain.objs.size()=1 2024-09-12T01:38:01.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.204+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.520__shadow:glegwVM8Qrl9n71yn-I7IEeafgoRmqT_.B5IWGRYq-dGwqaFVVOzVeTr5Bjo68Ov_0 2024-09-12T01:38:01.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.205+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12453458209879035183', time=2024-09-12T03:21:10.631427+0000, chain.objs.size()=1 2024-09-12T01:38:01.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.205+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.528__shadow_.R75nmAdi5JCLaXXWA4mVELed6o3lWAS_0 2024-09-12T01:38:01.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.205+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11815739949972830993', time=2024-09-12T03:22:55.210038+0000, chain.objs.size()=1 2024-09-12T01:38:01.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.205+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.562__shadow_.rm4oAvr2nw75FhKhSROh0cRnDP6cHy9_0 2024-09-12T01:38:01.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.205+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8408185121192077475', time=2024-09-12T03:23:57.412308+0000, chain.objs.size()=1 2024-09-12T01:38:01.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.205+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.577__shadow:-vjBWrl1bEGBraInMlnCVE4h4A7G0fb_.M9ewrCFpQmTq5d4sY94XR4QD1Qcs42z_0 2024-09-12T01:38:01.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.205+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7486032331101497274', time=2024-09-12T03:24:47.792941+0000, chain.objs.size()=1 2024-09-12T01:38:01.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.205+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.587__shadow:OrgkkhTvwF3T8.NkHSeI5zH.jYtNkUV_.b91oKOenEkXKcqkVW8uSd6ckDG5ukx4_0 2024-09-12T01:38:01.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.205+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11731937234477616288', time=2024-09-12T03:31:25.696481+0000, chain.objs.size()=1 2024-09-12T01:38:01.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.205+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.696__shadow:L2NmhD-dSiukDZPukEPoPT6lqjPB7mw_.Eymyb3650vQSDpbnHOcFh-q7sxuUH70_0 2024-09-12T01:38:01.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.207+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.147779824919665099', time=2024-09-12T03:31:41.961200+0000, chain.objs.size()=1 2024-09-12T01:38:01.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.207+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.714__shadow:mdJ6lvFRn0cGaBI-ybYFStDkMKI1QKQ_.hyuwLzgba6kgYaS_xosjGc_c9as5TRD_0 2024-09-12T01:38:01.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.208+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:38:01.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.210+0000 7f8786c98800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T01:38:01.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.211+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:38:01.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.212+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:38:01.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.212+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44972' 2024-09-12T01:38:01.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.212+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4267840475887100238', time=2024-09-12T03:10:10.661613+0000, chain.objs.size()=1 2024-09-12T01:38:01.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.212+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.235__shadow_.ldGqlvqagnwQTAgqNfWTBh_SR85AMM4_0 2024-09-12T01:38:01.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.212+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14211298111725596490', time=2024-09-12T03:10:11.618594+0000, chain.objs.size()=1 2024-09-12T01:38:01.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.212+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.236__shadow_.CW1T5-Yo5eqdyF1B6RYDXi1isL4NvsJ_0 2024-09-12T01:38:01.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.212+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15789782409297339536', time=2024-09-12T03:10:18.595162+0000, chain.objs.size()=1 2024-09-12T01:38:01.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.212+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.242__shadow_.tCADctOtVy6RJIknw6sR4bPk5Qsa2TN_0 2024-09-12T01:38:01.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.212+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14290704230215611322', time=2024-09-12T03:10:24.923576+0000, chain.objs.size()=1 2024-09-12T01:38:01.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.212+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.247__shadow_.GsMyA6f0VaUtthfYnKBJTuX_mOOo7L8_0 2024-09-12T01:38:01.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.212+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5805738369967475452', time=2024-09-12T03:10:30.748964+0000, chain.objs.size()=1 2024-09-12T01:38:01.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.212+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.253__shadow_.CUteSeqxL7joKTzQ354OGTsKf3ddIK5_0 2024-09-12T01:38:01.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.212+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11653610198457776673', time=2024-09-12T03:10:32.703051+0000, chain.objs.size()=1 2024-09-12T01:38:01.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.212+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.255__shadow_.L2qCWpPjUbPy3N6WZ9xGFys1oRbS6_m_0 2024-09-12T01:38:01.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.212+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9581576458920042923', time=2024-09-12T03:10:33.692191+0000, chain.objs.size()=1 2024-09-12T01:38:01.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.212+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.256__shadow_.SS5jfLFEH4R_Wtkju-yKnDQ8uF_IuFF_0 2024-09-12T01:38:01.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.212+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16394282266751823641', time=2024-09-12T03:11:15.341855+0000, chain.objs.size()=1 2024-09-12T01:38:01.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.212+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.FNtWYtY4pEqhMOz3wBncUnEnFbm3aaN_0 2024-09-12T01:38:01.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.212+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9827922165147515444', time=2024-09-12T03:11:16.009783+0000, chain.objs.size()=1 2024-09-12T01:38:01.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.212+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.pwaivDXbA0WZOz3ajBxglt0sHLiBULc_0 2024-09-12T01:38:01.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.212+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11910693200790861140', time=2024-09-12T03:11:16.447000+0000, chain.objs.size()=1 2024-09-12T01:38:01.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.212+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.E3f38NkY6b6EGKTHCdXcznLLyhwXG0w_0 2024-09-12T01:38:01.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.212+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.717263639505628778', time=2024-09-12T03:11:16.496547+0000, chain.objs.size()=1 2024-09-12T01:38:01.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.212+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.vOhzkKm2EEO44tSuiyam3dWOOTkz2cv_0 2024-09-12T01:38:01.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.212+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10119734199061060534', time=2024-09-12T03:11:16.527145+0000, chain.objs.size()=1 2024-09-12T01:38:01.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.212+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.orPQAJhUBLCChauuao5NhGt_veAfcE5_0 2024-09-12T01:38:01.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.214+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11872683935283256747', time=2024-09-12T03:11:18.288726+0000, chain.objs.size()=1 2024-09-12T01:38:01.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.214+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.vZEFaFGb5-cB0h_UTjOgWiV-EJqtlLu_0 2024-09-12T01:38:01.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.215+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.302533588840853352', time=2024-09-12T03:11:18.407201+0000, chain.objs.size()=1 2024-09-12T01:38:01.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.215+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.xZRk_bdFROs8X8LEv5_8_7WF3mMpkBc_0 2024-09-12T01:38:01.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.215+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1971911124413960333', time=2024-09-12T03:11:19.235101+0000, chain.objs.size()=1 2024-09-12T01:38:01.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.215+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.kzEfct-czx8p4-DZRFIkxrIeEzOfypJ_0 2024-09-12T01:38:01.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.215+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4277183943266109863', time=2024-09-12T03:11:20.299289+0000, chain.objs.size()=1 2024-09-12T01:38:01.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.215+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.TkUVircqHJ8jaaUOWp5gMPrgvnmEFcz_0 2024-09-12T01:38:01.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.215+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17931782712185826267', time=2024-09-12T03:11:20.742104+0000, chain.objs.size()=1 2024-09-12T01:38:01.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.215+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.AxO7r9LV1nXd1-iRP_e1t8ORKU_Lvm3_0 2024-09-12T01:38:01.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.215+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10072637076710882553', time=2024-09-12T03:11:21.125976+0000, chain.objs.size()=1 2024-09-12T01:38:01.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.215+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.PLRAN9mIgBfs9EpseI-AzodpkRm2oBO_0 2024-09-12T01:38:01.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.215+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14322321735504532661', time=2024-09-12T03:11:21.838990+0000, chain.objs.size()=1 2024-09-12T01:38:01.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.215+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.c1y8wWepuJcVPq20of3k3Ih8zQk1HTG_0 2024-09-12T01:38:01.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.215+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5777166980253795470', time=2024-09-12T03:11:21.967804+0000, chain.objs.size()=1 2024-09-12T01:38:01.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.215+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.fhIXps_dz1hiUP1OXAI8M0BNAPM4DDh_0 2024-09-12T01:38:01.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.215+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11582475710543107865', time=2024-09-12T03:11:22.213223+0000, chain.objs.size()=1 2024-09-12T01:38:01.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.215+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.8CBmDFq1td_yWE2b5i8GnVVYonExhP9_0 2024-09-12T01:38:01.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.217+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11835175593583835487', time=2024-09-12T03:11:22.413845+0000, chain.objs.size()=1 2024-09-12T01:38:01.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.217+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.2Euhs_J77cAb0-FCoQvhRKKpKtQLjvE_0 2024-09-12T01:38:01.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.217+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12933382455112546906', time=2024-09-12T03:11:23.020309+0000, chain.objs.size()=1 2024-09-12T01:38:01.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.217+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.UdlRtKrnEg1K8pjZ56Fdsd83VT2LjK0_0 2024-09-12T01:38:01.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.217+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16712351941178362076', time=2024-09-12T03:11:23.020986+0000, chain.objs.size()=1 2024-09-12T01:38:01.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.217+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.enDH-iaK5GxA7cyaugxwpY9634Q8Wwf_0 2024-09-12T01:38:01.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.217+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17145443827245045735', time=2024-09-12T03:11:23.050530+0000, chain.objs.size()=1 2024-09-12T01:38:01.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.217+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.e646dujDMxSj24XUbtkUM3V6GFVkQpg_0 2024-09-12T01:38:01.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.217+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8201996492312909480', time=2024-09-12T03:11:23.195155+0000, chain.objs.size()=1 2024-09-12T01:38:01.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.217+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.FjJbtaoelGxUWAJquejpZ8jOo12VC7w_0 2024-09-12T01:38:01.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.217+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1029028018524206492', time=2024-09-12T03:11:23.547255+0000, chain.objs.size()=1 2024-09-12T01:38:01.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.217+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.lOhiXzEVShtFij9rRd_4fLiMNbI_3ay_0 2024-09-12T01:38:01.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.217+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12010378303499844414', time=2024-09-12T03:11:24.109056+0000, chain.objs.size()=1 2024-09-12T01:38:01.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.217+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.ILRWP66sxKZw3e02d9tQZu6REkdO1HR_0 2024-09-12T01:38:01.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.217+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.970432873802879527', time=2024-09-12T03:11:24.271103+0000, chain.objs.size()=1 2024-09-12T01:38:01.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.217+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.wdU5EFmqRlqKO2fLJokHUbxHT6CZYaz_0 2024-09-12T01:38:01.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.217+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.248359610677425839', time=2024-09-12T03:11:24.431310+0000, chain.objs.size()=1 2024-09-12T01:38:01.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.217+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Ld4QXxYEJFCSAEaa2eBdyRl-4sSOfFi_0 2024-09-12T01:38:01.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.217+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1603777577236244081', time=2024-09-12T03:11:24.603714+0000, chain.objs.size()=1 2024-09-12T01:38:01.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.217+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.jLA5FV_jt-nW7PIBbARjuM9az0XWcK4_0 2024-09-12T01:38:01.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.217+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8727648246385121697', time=2024-09-12T03:11:33.383086+0000, chain.objs.size()=1 2024-09-12T01:38:01.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.217+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.271__shadow_.rH-kvaauyvA7ML5sbj6ZORY60fDTTCw_0 2024-09-12T01:38:01.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.220+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6342709107150535978', time=2024-09-12T03:11:44.888674+0000, chain.objs.size()=1 2024-09-12T01:38:01.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.220+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.283__shadow_.134-OFH7a04qscX42cOB-60PpgJ5FHx_0 2024-09-12T01:38:01.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.220+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15392975820472000547', time=2024-09-12T03:11:55.420033+0000, chain.objs.size()=1 2024-09-12T01:38:01.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.220+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.292__shadow_._FPpHj3-z1EFVLlzNfxTfHmAdyq99wC_0 2024-09-12T01:38:01.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.220+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17696065879061094628', time=2024-09-12T03:12:04.656456+0000, chain.objs.size()=1 2024-09-12T01:38:01.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.220+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.300__shadow_.WIpCDAMQDeFCPeVbpR6QNkm-I5_1GRc_0 2024-09-12T01:38:01.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.220+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11183616186447082283', time=2024-09-12T03:13:06.835921+0000, chain.objs.size()=1 2024-09-12T01:38:01.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.220+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.1IofDx2ZQuTy1XuPaFlKObJMjvhLYQI_0 2024-09-12T01:38:01.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.220+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15331061486165329198', time=2024-09-12T03:13:07.032523+0000, chain.objs.size()=1 2024-09-12T01:38:01.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.220+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.AsoFs8SfCsB6oZ5gM8bfI4zJzVyP9PZ_0 2024-09-12T01:38:01.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.220+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11091529086371331187', time=2024-09-12T03:13:07.524724+0000, chain.objs.size()=1 2024-09-12T01:38:01.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.220+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.XGIN4qzRNzYf3-5JhBORdiqeMYb18fs_0 2024-09-12T01:38:01.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.220+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.475950879765123155', time=2024-09-12T03:13:07.685917+0000, chain.objs.size()=1 2024-09-12T01:38:01.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.220+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.5P4-M6rhPZteDyI8WiqIThxNUUP8X0P_0 2024-09-12T01:38:01.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.220+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8729890947680838088', time=2024-09-12T03:13:09.154086+0000, chain.objs.size()=1 2024-09-12T01:38:01.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.220+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.GjCcE8FDvpdfIT9EeRHkM8UJBKQEtB8_0 2024-09-12T01:38:01.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.220+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.471134079198767513', time=2024-09-12T03:13:09.176157+0000, chain.objs.size()=1 2024-09-12T01:38:01.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.220+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.S1OkIJJAsnamHuucNyi7V9-rY8-SS-S_0 2024-09-12T01:38:01.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.220+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9893357313562096053', time=2024-09-12T03:13:09.754198+0000, chain.objs.size()=1 2024-09-12T01:38:01.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.220+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.HMT0fVSEuAPs0O7rxNAznHSHyPiDWnN_0 2024-09-12T01:38:01.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.220+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12564946548461050066', time=2024-09-12T03:13:09.821536+0000, chain.objs.size()=1 2024-09-12T01:38:01.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.220+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.ECxzWgqu6fk8nYL-01W368OJeCSUsCM_0 2024-09-12T01:38:01.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.224+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1699050979569341533', time=2024-09-12T03:13:10.570162+0000, chain.objs.size()=1 2024-09-12T01:38:01.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.224+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.FWyKanUKIzumoTPcHI-nNzQHpJDxx3A_0 2024-09-12T01:38:01.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.224+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11723342920484168872', time=2024-09-12T03:13:10.681401+0000, chain.objs.size()=1 2024-09-12T01:38:01.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.224+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.DVEyJ_ItiEc_X0gWoDcC1CdmwS4Eb_N_0 2024-09-12T01:38:01.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.224+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17305616628169677556', time=2024-09-12T03:13:11.352136+0000, chain.objs.size()=1 2024-09-12T01:38:01.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.224+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.CYkZzaXtkDcYbl7suEoXikHsQXVKYBA_0 2024-09-12T01:38:01.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.224+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2199852023755443285', time=2024-09-12T03:13:11.878212+0000, chain.objs.size()=1 2024-09-12T01:38:01.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.224+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.eSotcz534FlkFvSluGy4rRHSJ5h-cB-_0 2024-09-12T01:38:01.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.224+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14949046240506009933', time=2024-09-12T03:13:11.970985+0000, chain.objs.size()=1 2024-09-12T01:38:01.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.224+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.-Un0lpH3cBkwsG9tL7aiosOCoW-K5zX_0 2024-09-12T01:38:01.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.224+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.52881910893307856', time=2024-09-12T03:13:12.489959+0000, chain.objs.size()=1 2024-09-12T01:38:01.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.224+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.7eeTc6-aD4W9PWhvI1AQstSwZywPiqa_0 2024-09-12T01:38:01.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.224+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.690232428526922614', time=2024-09-12T03:13:12.495705+0000, chain.objs.size()=1 2024-09-12T01:38:01.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.224+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.QgB7_CiPo-95xF3ctkq-FPMDXIlFwmc_0 2024-09-12T01:38:01.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.224+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7975830987431051048', time=2024-09-12T03:13:12.704506+0000, chain.objs.size()=1 2024-09-12T01:38:01.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.224+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.mLPRmtlN1yPRhZ3lSzQkvNZssiTo4NI_0 2024-09-12T01:38:01.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.224+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12360573259697432844', time=2024-09-12T03:13:12.886890+0000, chain.objs.size()=1 2024-09-12T01:38:01.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.224+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.rgoIIIoGCgTuNVsQBSbPGm1RXnQw5Eg_0 2024-09-12T01:38:01.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.224+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14410399016291705514', time=2024-09-12T03:13:13.418929+0000, chain.objs.size()=1 2024-09-12T01:38:01.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.224+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.Jg7LDoVleSzRd3Dtw9kGoH9JUlYErk__0 2024-09-12T01:38:01.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.224+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7065582329227302561', time=2024-09-12T03:13:13.848633+0000, chain.objs.size()=1 2024-09-12T01:38:01.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.224+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.DqkyRZWJdx22umiQtucT76oIugm2fG3_0 2024-09-12T01:38:01.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.225+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17663946822893841074', time=2024-09-12T03:13:14.071262+0000, chain.objs.size()=1 2024-09-12T01:38:01.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.226+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.81GXHP6PGg62De6ui8FoqThd-wtBUdm_0 2024-09-12T01:38:01.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.226+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2810023481446647382', time=2024-09-12T03:13:14.106653+0000, chain.objs.size()=1 2024-09-12T01:38:01.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.226+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.Ipy57V4RGXCLUYcw2YqizgDS7fPiV5k_0 2024-09-12T01:38:01.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.226+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7797340514451310133', time=2024-09-12T03:13:14.195601+0000, chain.objs.size()=1 2024-09-12T01:38:01.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.226+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.4dC31SUSu7HW5BGt9WmvbaQIRRyHHvw_0 2024-09-12T01:38:01.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.226+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2364138185702994744', time=2024-09-12T03:13:14.318148+0000, chain.objs.size()=1 2024-09-12T01:38:01.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.226+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.cm90aaQCNopzlznG38zAPhhYTBIL7Sn_0 2024-09-12T01:38:01.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.227+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4246187507993232454', time=2024-09-12T03:13:14.674761+0000, chain.objs.size()=1 2024-09-12T01:38:01.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.227+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.CbC2yhSopGQh6wnjvdiG7N849O2_QdY_0 2024-09-12T01:38:01.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.227+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9547296785366887997', time=2024-09-12T03:13:15.077945+0000, chain.objs.size()=1 2024-09-12T01:38:01.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.227+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.ESvWOkvOr3Jj7iOozHikgLUAZ8dUZ_l_0 2024-09-12T01:38:01.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.227+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11219441108983797366', time=2024-09-12T03:13:15.351104+0000, chain.objs.size()=1 2024-09-12T01:38:01.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.227+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_._fEEEIOVi0bJ9FfgVzTqzxkL0sddAJL_0 2024-09-12T01:38:01.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.227+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16628645605503478011', time=2024-09-12T03:13:15.434028+0000, chain.objs.size()=1 2024-09-12T01:38:01.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.227+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.CsTZSP4-LmUOkQSxAxdQa43ltPn2Eq5_0 2024-09-12T01:38:01.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.227+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16981216526137393747', time=2024-09-12T03:13:15.917338+0000, chain.objs.size()=1 2024-09-12T01:38:01.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.227+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.YKgvyx_bNF_3EEviMr94ZMaFgwJyzk4_0 2024-09-12T01:38:01.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.227+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11550482341134883848', time=2024-09-12T03:13:15.966714+0000, chain.objs.size()=1 2024-09-12T01:38:01.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.227+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.WM2Age3mG5c89U2CThB5QBiHLlbFFFk_0 2024-09-12T01:38:01.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.227+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14817303497995245258', time=2024-09-12T03:13:16.365038+0000, chain.objs.size()=1 2024-09-12T01:38:01.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.227+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.uoaDESn75n1xiNF-PQqYJ2sQM_mR0yy_0 2024-09-12T01:38:01.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.227+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1488877341474328804', time=2024-09-12T03:13:16.481669+0000, chain.objs.size()=1 2024-09-12T01:38:01.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.227+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.DIqbdEZgneDXPL3PvbnySMwxiE_UFog_0 2024-09-12T01:38:01.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.227+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12530496155064366193', time=2024-09-12T03:13:16.889252+0000, chain.objs.size()=1 2024-09-12T01:38:01.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.227+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.hHz0ayAUZGx6pxR02JYZ3F70ggecvic_0 2024-09-12T01:38:01.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.230+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6153987639214517368', time=2024-09-12T03:13:16.984703+0000, chain.objs.size()=1 2024-09-12T01:38:01.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.230+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.6sBL-4bZq2c8WR90BQQqnrhxxZ8DX_o_0 2024-09-12T01:38:01.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.230+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17263164620167122420', time=2024-09-12T03:13:54.145259+0000, chain.objs.size()=1 2024-09-12T01:38:01.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.230+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.msM4obGe5XrwFArtwWx85ojDQLqHFe1_0 2024-09-12T01:38:01.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.230+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12503438027314982127', time=2024-09-12T03:13:54.412445+0000, chain.objs.size()=1 2024-09-12T01:38:01.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.230+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.viS4UUjPKWCohtO8_uZvg9UI3gj7VEx_0 2024-09-12T01:38:01.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.230+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2858754046329006130', time=2024-09-12T03:13:54.563493+0000, chain.objs.size()=1 2024-09-12T01:38:01.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.230+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.w3MMaIJ8N0VN6QO7cZb6Fnjhc2wL2z1_0 2024-09-12T01:38:01.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.230+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17195286771592120271', time=2024-09-12T03:13:55.146299+0000, chain.objs.size()=1 2024-09-12T01:38:01.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.230+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.eobNz9CLrYy_35Oa26jWli0Xnky7R-N_0 2024-09-12T01:38:01.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.230+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3096247051308526275', time=2024-09-12T03:13:55.231552+0000, chain.objs.size()=1 2024-09-12T01:38:01.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.230+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.VzweC_AXYKkt7I0S9n2nPuPBNgMQuLD_0 2024-09-12T01:38:01.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.230+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15440347844355200670', time=2024-09-12T03:13:55.344186+0000, chain.objs.size()=1 2024-09-12T01:38:01.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.230+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.NzEY09OnQ21dIwM78ErpVs88no-k0QO_0 2024-09-12T01:38:01.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.230+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4704566860440707684', time=2024-09-12T03:13:55.373216+0000, chain.objs.size()=1 2024-09-12T01:38:01.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.230+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.HijRDTLrOtY_DzBPEqYeJInrxJm7LDD_0 2024-09-12T01:38:01.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.230+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16579421175646908335', time=2024-09-12T03:13:57.825551+0000, chain.objs.size()=1 2024-09-12T01:38:01.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.230+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.ipSX6NL_EgcIMTJkIRYKLxl6MpezdaJ_0 2024-09-12T01:38:01.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.230+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6630428950100627104', time=2024-09-12T03:13:58.253629+0000, chain.objs.size()=1 2024-09-12T01:38:01.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.230+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.kpPgc27nm0OZNcAiFuSxuThVsOrFbbK_0 2024-09-12T01:38:01.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.230+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8100571858401900398', time=2024-09-12T03:13:58.549359+0000, chain.objs.size()=1 2024-09-12T01:38:01.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.230+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Dz6WYHoq4rvz0YYL0V4wQwIyZm2n7F7_0 2024-09-12T01:38:01.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.231+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1130922761759415416', time=2024-09-12T03:13:58.788946+0000, chain.objs.size()=1 2024-09-12T01:38:01.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.231+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.zr33OSZeVDctDu4viqq5qYynuuLRu2X_0 2024-09-12T01:38:01.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.232+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.363508419616792672', time=2024-09-12T03:13:59.330107+0000, chain.objs.size()=1 2024-09-12T01:38:01.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.232+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.g3e4d-5pEwazt-0tTbmXp62mkWB5Z2r_0 2024-09-12T01:38:01.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.233+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8212562823759957643', time=2024-09-12T03:13:59.596160+0000, chain.objs.size()=1 2024-09-12T01:38:01.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.233+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.NX9F0NcXPelYPxCGOwhW2kYMcAyIG_k_0 2024-09-12T01:38:01.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.233+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11982091899981280250', time=2024-09-12T03:13:59.816261+0000, chain.objs.size()=1 2024-09-12T01:38:01.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.233+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.2AnMVh7yRllL6DfGPweFdh-hRLT4eHo_0 2024-09-12T01:38:01.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.233+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4430042892374999525', time=2024-09-12T03:14:00.080623+0000, chain.objs.size()=1 2024-09-12T01:38:01.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.233+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.U-4Md7YAzZGx43Xg2bkhEMEu37tegmQ_0 2024-09-12T01:38:01.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.233+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5257306025578464269', time=2024-09-12T03:14:00.772261+0000, chain.objs.size()=1 2024-09-12T01:38:01.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.233+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.dZcEAwSYIx_8dq-vHf3v8e9Td2NMziS_0 2024-09-12T01:38:01.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.233+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8588632851854788862', time=2024-09-12T03:14:01.092997+0000, chain.objs.size()=1 2024-09-12T01:38:01.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.233+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.RhF0-tTsVR5ZO_r08Sh4iSDpSuvp-eT_0 2024-09-12T01:38:01.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.233+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1546384132965991339', time=2024-09-12T03:14:01.265875+0000, chain.objs.size()=1 2024-09-12T01:38:01.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.233+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.kC4cY5Iy805hdmAmxoer1o-SjX-Xj1A_0 2024-09-12T01:38:01.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.234+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9189820909272970550', time=2024-09-12T03:14:01.710691+0000, chain.objs.size()=1 2024-09-12T01:38:01.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.234+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.cG3uatIRZZ5waaKL8GxkIy6-hmF67SX_0 2024-09-12T01:38:01.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.234+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4308299135314054978', time=2024-09-12T03:14:02.111237+0000, chain.objs.size()=1 2024-09-12T01:38:01.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.234+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.2Ur_LnxoOgaSlKs0LRhZ8G2Ma4LMuFU_0 2024-09-12T01:38:01.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.234+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17241726219781032937', time=2024-09-12T03:14:02.176854+0000, chain.objs.size()=1 2024-09-12T01:38:01.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.234+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.i9MBunjaSZc2xRT9Oyjud-JQ027z8Xz_0 2024-09-12T01:38:01.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.234+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13309229473875335887', time=2024-09-12T03:14:02.345569+0000, chain.objs.size()=1 2024-09-12T01:38:01.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.234+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.2sjU9__3ZtykxjnwYQIKIyFL8_6EGXf_0 2024-09-12T01:38:01.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.234+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3591226223913675748', time=2024-09-12T03:14:02.948454+0000, chain.objs.size()=1 2024-09-12T01:38:01.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.234+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.oCjzna3vsIFIHPzwUKXFXxJgEc0skJS_0 2024-09-12T01:38:01.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.237+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.426577314592094441', time=2024-09-12T03:14:02.948951+0000, chain.objs.size()=1 2024-09-12T01:38:01.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.237+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.osuSOaudoBMPdlXKwe5wU6oLFDNh4pt_0 2024-09-12T01:38:01.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.237+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15053734274088128524', time=2024-09-12T03:14:03.349092+0000, chain.objs.size()=1 2024-09-12T01:38:01.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.237+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.YHHSODnK4vZvI2fhWHewCBSZ4DXrynj_0 2024-09-12T01:38:01.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.237+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10451665982470052910', time=2024-09-12T03:14:03.349728+0000, chain.objs.size()=1 2024-09-12T01:38:01.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.237+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.90lQG-XasBULWGsHIv4Tk1Vd5L_2v3I_0 2024-09-12T01:38:01.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.237+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1139729270272623762', time=2024-09-12T03:14:07.858737+0000, chain.objs.size()=1 2024-09-12T01:38:01.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.237+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.329__shadow_.k7WWRMozMpp-Gx-Tc_w9wQIUbfry5qm_0 2024-09-12T01:38:01.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.237+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3278956621790991189', time=2024-09-12T03:14:22.201882+0000, chain.objs.size()=1 2024-09-12T01:38:01.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.237+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.344__shadow_.vWwTFHcvhFa-grhcguJlqRPJzmNvf-A_0 2024-09-12T01:38:01.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.237+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14281738278383752732', time=2024-09-12T03:14:46.346496+0000, chain.objs.size()=1 2024-09-12T01:38:01.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.237+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.373__shadow_.L02ROKoLG7IMlZBeSlV6CGaBxfQcM8w_0 2024-09-12T01:38:01.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.237+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16628550469085892852', time=2024-09-12T03:15:22.168982+0000, chain.objs.size()=1 2024-09-12T01:38:01.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.237+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.409__shadow_.m-QjWup9GM4Lz-azWMl9EB654ccNU2w_0 2024-09-12T01:38:01.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.237+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3873616456074203938', time=2024-09-12T03:16:03.302662+0000, chain.objs.size()=1 2024-09-12T01:38:01.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.237+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.450__shadow_.JDvdLW3bPe-eefeu_njCf8AqvXF6i6M_0 2024-09-12T01:38:01.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.237+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17220186300606011979', time=2024-09-12T03:16:08.382679+0000, chain.objs.size()=1 2024-09-12T01:38:01.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.237+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.455__shadow_.xKKw9jMYZJCmqwt_132bobTU10TP_Q2_0 2024-09-12T01:38:01.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.240+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 0/44972 2024-09-12T01:38:01.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.242+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T01:38:01.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.242+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2809281571580113142', time=2024-09-12T03:16:34.307936+0000, chain.objs.size()=1 2024-09-12T01:38:01.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.242+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.483__shadow_.NbEerjHVBLWCqg1HijwhnGkgJwAWE22_0 2024-09-12T01:38:01.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.242+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12931084610300198381', time=2024-09-12T03:17:27.326948+0000, chain.objs.size()=1 2024-09-12T01:38:01.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.242+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.511__multipart_mymultipart.2~xbXH8J9OcyjIoQ2nehX_qCKCEKXo6u5.1 2024-09-12T01:38:01.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.242+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2007298626878371140', time=2024-09-12T03:22:48.692016+0000, chain.objs.size()=1 2024-09-12T01:38:01.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.242+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.558__shadow_.Q6b-NeaqyGsvCt--hJ0smwm4qrapm00_0 2024-09-12T01:38:01.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.242+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12983976346008078712', time=2024-09-12T03:23:08.341347+0000, chain.objs.size()=1 2024-09-12T01:38:01.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.242+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.569__shadow:8cczykL-fSjuRNob1.yo3a6fTHJv0w8_.F85vzIzsFYB5c93zMFNqAhiMmDdWw5O_0 2024-09-12T01:38:01.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.242+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17401085038576410579', time=2024-09-12T03:23:33.184961+0000, chain.objs.size()=1 2024-09-12T01:38:01.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.242+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.576__shadow:og7Cttt6us3m3fRCMzbWkzdF1I5ftYX_.xkPO4wcIYrpzP5c-MTLh_Hhzsq96Djv_0 2024-09-12T01:38:01.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.244+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:38:01.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.246+0000 7f8786c98800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T01:38:01.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.247+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:38:01.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.247+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:38:01.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.248+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45149' 2024-09-12T01:38:01.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.248+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7989269935744225439', time=2024-09-12T03:07:21.986761+0000, chain.objs.size()=2 2024-09-12T01:38:01.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.248+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.164__multipart_foo.2~21dEoANk5M-Wj1-7AFAtIXawh9UNdWx.1 2024-09-12T01:38:01.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.249+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.164__multipart_foo.2~21dEoANk5M-Wj1-7AFAtIXawh9UNdWx.2 2024-09-12T01:38:01.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.249+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17151534258790148835', time=2024-09-12T03:10:11.613155+0000, chain.objs.size()=1 2024-09-12T01:38:01.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.249+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.236__shadow_.Ks1BcBcF2oL-Em4TRRqE1E92YdKcPZx_0 2024-09-12T01:38:01.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.249+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14517575025786296244', time=2024-09-12T03:10:22.894558+0000, chain.objs.size()=1 2024-09-12T01:38:01.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.249+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.245__shadow_.G-qo4WcWeFAZOvV_dklyzUqOogB6KL3_0 2024-09-12T01:38:01.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.249+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16621985233780599652', time=2024-09-12T03:10:23.845929+0000, chain.objs.size()=1 2024-09-12T01:38:01.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.249+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.246__shadow_.7im_z3FyyVWhnb-QeJ911xCe0ls0GdJ_0 2024-09-12T01:38:01.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.249+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.940215362714361072', time=2024-09-12T03:11:14.421407+0000, chain.objs.size()=1 2024-09-12T01:38:01.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.249+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.-87xtwxckRPPnEfA3GGT0uzOt1kf5Ym_0 2024-09-12T01:38:01.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.249+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12156636493350930544', time=2024-09-12T03:11:14.536013+0000, chain.objs.size()=1 2024-09-12T01:38:01.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.249+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.zNAfwvOv3kuggXIpFZlF0yiCWAvpuYs_0 2024-09-12T01:38:01.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.249+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12111189946291513752', time=2024-09-12T03:11:15.341339+0000, chain.objs.size()=1 2024-09-12T01:38:01.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.249+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.9_JbbdrrPAJbAqXiMcQkH8gmIFKNAHb_0 2024-09-12T01:38:01.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.249+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9850816044703211972', time=2024-09-12T03:11:16.124107+0000, chain.objs.size()=1 2024-09-12T01:38:01.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.249+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.4UE1HdEnVAreq19I40UrL2IrtgT8tbw_0 2024-09-12T01:38:01.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.249+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7285734126312742224', time=2024-09-12T03:11:16.557030+0000, chain.objs.size()=1 2024-09-12T01:38:01.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.249+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.iu2s3CLNqD68BoDv61EVxk8MU_xAx2S_0 2024-09-12T01:38:01.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.249+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16844159121587719469', time=2024-09-12T03:11:16.621205+0000, chain.objs.size()=1 2024-09-12T01:38:01.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.249+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.0ZK6eUObnNMlLaVUrTzomNaILpVlwEq_0 2024-09-12T01:38:01.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.249+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12202354087180022731', time=2024-09-12T03:11:16.721756+0000, chain.objs.size()=1 2024-09-12T01:38:01.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.249+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.kThIOgwE6wHOAJ9CzcMu5kq09XycEQV_0 2024-09-12T01:38:01.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.253+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5882964090444933135', time=2024-09-12T03:11:16.722430+0000, chain.objs.size()=1 2024-09-12T01:38:01.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.253+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.lepR2idUxnV54kNoSWWKZ7GuMsikshU_0 2024-09-12T01:38:01.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.253+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10139211609408375425', time=2024-09-12T03:11:17.672368+0000, chain.objs.size()=1 2024-09-12T01:38:01.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.253+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.mxMW3KcOJGuYsWy1rn1EW2QjY0lIFm4_0 2024-09-12T01:38:01.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.253+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5824585881924384130', time=2024-09-12T03:11:17.755234+0000, chain.objs.size()=1 2024-09-12T01:38:01.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.253+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.zKBCVCNlS9Xgk0l5O-T8qBpiPwxhowR_0 2024-09-12T01:38:01.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.253+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2172726851041916559', time=2024-09-12T03:11:18.057923+0000, chain.objs.size()=1 2024-09-12T01:38:01.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.253+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.kzPcSw-o_Rjrvi8PI_evLoYZFAQDvXp_0 2024-09-12T01:38:01.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.253+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9513480570329029972', time=2024-09-12T03:11:19.146469+0000, chain.objs.size()=1 2024-09-12T01:38:01.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.253+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.KHAu3iyIXkNmk45p1fNXaNG_tRmPTqm_0 2024-09-12T01:38:01.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.253+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15354959174005339193', time=2024-09-12T03:11:19.570527+0000, chain.objs.size()=1 2024-09-12T01:38:01.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.253+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Fxn3KuCnCNuCQ7nRXo3SFu7ku2lhtx3_0 2024-09-12T01:38:01.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.253+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10407532170225132253', time=2024-09-12T03:11:19.688947+0000, chain.objs.size()=1 2024-09-12T01:38:01.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.253+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.mbU4ThAkNFJ1e2cOukzdtpiIxsCZRU4_0 2024-09-12T01:38:01.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.253+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3810693453689677177', time=2024-09-12T03:11:19.718564+0000, chain.objs.size()=1 2024-09-12T01:38:01.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.253+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.JFjlxAcO2NSe2rqelqwBzgfd0kxk4fl_0 2024-09-12T01:38:01.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.253+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1900426757135453341', time=2024-09-12T03:11:20.184986+0000, chain.objs.size()=1 2024-09-12T01:38:01.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.253+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.8BiW9nc7zGXbmH3kUazEHFxPN8jaKmU_0 2024-09-12T01:38:01.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.253+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14685525841422115709', time=2024-09-12T03:11:20.610897+0000, chain.objs.size()=1 2024-09-12T01:38:01.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.253+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.foKqsPl7sOlvcDOxxg3H0vS-BC1rSzQ_0 2024-09-12T01:38:01.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.253+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2741164394817109602', time=2024-09-12T03:11:20.754481+0000, chain.objs.size()=1 2024-09-12T01:38:01.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.253+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.YLDz3GeHQDAxX-ZlTmmcgfxcRZrSdG5_0 2024-09-12T01:38:01.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.256+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3615205340675879403', time=2024-09-12T03:11:20.932746+0000, chain.objs.size()=1 2024-09-12T01:38:01.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.256+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.uqitI7Cr0H8druPC3yoOvLk7gLmxd4v_0 2024-09-12T01:38:01.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.256+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12472279777882971168', time=2024-09-12T03:11:21.968440+0000, chain.objs.size()=1 2024-09-12T01:38:01.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.256+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.KsOyQyMoF3mE9hp2yum7iP3VOg5VRdo_0 2024-09-12T01:38:01.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.259+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15942397597777292815', time=2024-09-12T03:11:22.312393+0000, chain.objs.size()=1 2024-09-12T01:38:01.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.259+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.jnYMgF0C9FsgXgg-dTTc-oifwwt65Xo_0 2024-09-12T01:38:01.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.259+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2125926476746835477', time=2024-09-12T03:11:22.960102+0000, chain.objs.size()=1 2024-09-12T01:38:01.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.259+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Xb9mRj88W_zM2UnJNkXk-rz1p00C5RI_0 2024-09-12T01:38:01.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.259+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5381243181619725233', time=2024-09-12T03:11:23.287791+0000, chain.objs.size()=1 2024-09-12T01:38:01.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.259+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.MjjVKSZO2M8vop-IhHjwn4lj6o0agj__0 2024-09-12T01:38:01.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.259+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16090956611023855781', time=2024-09-12T03:11:23.379874+0000, chain.objs.size()=1 2024-09-12T01:38:01.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.259+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.netMpKYg2B3U80tJR4I1awn4AV0LV9o_0 2024-09-12T01:38:01.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.259+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10004031994287425160', time=2024-09-12T03:11:24.270133+0000, chain.objs.size()=1 2024-09-12T01:38:01.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.259+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.CtWiU2NnClkqPgUmUvVbo2un2OQDqKz_0 2024-09-12T01:38:01.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.259+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8116179938940255500', time=2024-09-12T03:11:51.790658+0000, chain.objs.size()=1 2024-09-12T01:38:01.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.259+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.290__shadow_.PXnl0x4d-8tpzTlL93WA6vO-trN9jEs_0 2024-09-12T01:38:01.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.259+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13340517400122218057', time=2024-09-12T03:11:55.289676+0000, chain.objs.size()=1 2024-09-12T01:38:01.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.259+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.292__shadow_.H5L3gOVMRBgdztt9KY3kprmJXIlDyNd_0 2024-09-12T01:38:01.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.259+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.341321359770228364', time=2024-09-12T03:11:55.290455+0000, chain.objs.size()=1 2024-09-12T01:38:01.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.259+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.292__shadow_.aBWXnDL44tcQpYE2ZZmeBwye-iQSEFW_0 2024-09-12T01:38:01.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.259+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6780589833327694025', time=2024-09-12T03:11:57.482688+0000, chain.objs.size()=1 2024-09-12T01:38:01.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.259+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.293__shadow_.TEHeYE9iDCtJx0Plw22pVnwTnj5dcWc_0 2024-09-12T01:38:01.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.261+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14240084285844600526', time=2024-09-12T03:11:57.584868+0000, chain.objs.size()=1 2024-09-12T01:38:01.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.261+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.293__shadow_.YF1DU1LbsIAed0FIDILDHZLoPG-gieg_0 2024-09-12T01:38:01.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.261+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9200648061092553728', time=2024-09-12T03:12:02.672412+0000, chain.objs.size()=1 2024-09-12T01:38:01.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.261+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.298__shadow_.vsCDHUvKERBkLhxvGX8wX7u1J4SiEIj_0 2024-09-12T01:38:01.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.264+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7183863357772590592', time=2024-09-12T03:12:27.473227+0000, chain.objs.size()=1 2024-09-12T01:38:01.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.264+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.319__shadow:qN-G-biV05ENJgrbmcLqzxuYnoBMuik_.G6GMYG2C3zKH4gx3Ia3Z9O-zTt40mvY_0 2024-09-12T01:38:01.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.265+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9145420209966735153', time=2024-09-12T03:13:06.833435+0000, chain.objs.size()=1 2024-09-12T01:38:01.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.265+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.HhLtuxOWPCfzFXPSou1WA9UnlBMFpwx_0 2024-09-12T01:38:01.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.265+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12092316239124079380', time=2024-09-12T03:13:06.986277+0000, chain.objs.size()=1 2024-09-12T01:38:01.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.265+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.-iAgVfUAubOkB7rPl04t02GPE6lKvrB_0 2024-09-12T01:38:01.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.265+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9059826328768569096', time=2024-09-12T03:13:06.986951+0000, chain.objs.size()=1 2024-09-12T01:38:01.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.265+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.80dO6OlOlbyaZqG1jNeLbRNjpxpUgjh_0 2024-09-12T01:38:01.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.265+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17269734399583374168', time=2024-09-12T03:13:06.994129+0000, chain.objs.size()=1 2024-09-12T01:38:01.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.265+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.GsZ31mdeJi_iSGElP7YBRakMZFElbYn_0 2024-09-12T01:38:01.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.265+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15302082318328097699', time=2024-09-12T03:13:07.120360+0000, chain.objs.size()=1 2024-09-12T01:38:01.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.265+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.pGnjPJN8PDbmF61NLBBCokNxW4dVLRq_0 2024-09-12T01:38:01.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.265+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4030250567097138921', time=2024-09-12T03:13:07.273615+0000, chain.objs.size()=1 2024-09-12T01:38:01.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.265+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.Ew7HZNnj17XKrMqcZSTZLAPB7JCcwdu_0 2024-09-12T01:38:01.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.265+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3423899798329617357', time=2024-09-12T03:13:07.356681+0000, chain.objs.size()=1 2024-09-12T01:38:01.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.265+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.i7-sugP1k9nWFyDm2KrSPRYNOrWSw3h_0 2024-09-12T01:38:01.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.265+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12304668078338702645', time=2024-09-12T03:13:07.357621+0000, chain.objs.size()=1 2024-09-12T01:38:01.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.265+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.0QloUwsY3smdQqmM43p2CIVjhQPhtdW_0 2024-09-12T01:38:01.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.267+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13940206031921539315', time=2024-09-12T03:13:07.647806+0000, chain.objs.size()=1 2024-09-12T01:38:01.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.267+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.kAg5lfvewGwiGahZnBlvY7aDOOzF0GT_0 2024-09-12T01:38:01.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.267+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16514377711987467655', time=2024-09-12T03:13:08.301721+0000, chain.objs.size()=1 2024-09-12T01:38:01.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.267+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.fpU5oFX4bqj0V6l_tZsjaFHGGc29hKn_0 2024-09-12T01:38:01.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.270+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17912237908979295330', time=2024-09-12T03:13:08.302444+0000, chain.objs.size()=1 2024-09-12T01:38:01.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.270+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.OADAjgDQn1TQNXDj1VwWyJVRvYhKZ13_0 2024-09-12T01:38:01.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.270+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11347684892498762962', time=2024-09-12T03:13:08.501961+0000, chain.objs.size()=1 2024-09-12T01:38:01.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.270+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.ujh5a33yCbgZMKp5rZHHYl0ugD2m6Ix_0 2024-09-12T01:38:01.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.270+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11073703490422555672', time=2024-09-12T03:13:10.211889+0000, chain.objs.size()=1 2024-09-12T01:38:01.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.270+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.4SNo6hLIFZszkAClRCOlpfXhvs12yWs_0 2024-09-12T01:38:01.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.270+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.860601595963027505', time=2024-09-12T03:13:10.643667+0000, chain.objs.size()=1 2024-09-12T01:38:01.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.270+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.GMd9rz1NDXmAy-KxNEdv8xO2IlLMVZS_0 2024-09-12T01:38:01.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.270+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14434279330853050739', time=2024-09-12T03:13:11.153123+0000, chain.objs.size()=1 2024-09-12T01:38:01.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.270+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.K3Jx28UCcmx9q5duSdQNRl4cO-OqA-K_0 2024-09-12T01:38:01.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.270+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9184734696184767440', time=2024-09-12T03:13:11.242779+0000, chain.objs.size()=1 2024-09-12T01:38:01.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.270+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.hJZafG-62lfqtzeSPZdz8LWqYyhrxgl_0 2024-09-12T01:38:01.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.270+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1078845532170899796', time=2024-09-12T03:13:11.308163+0000, chain.objs.size()=1 2024-09-12T01:38:01.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.270+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.ebEAu0wHWRlpkfuHq1OcsKkPYRN4MBv_0 2024-09-12T01:38:01.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.270+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9877315266132165099', time=2024-09-12T03:13:11.473897+0000, chain.objs.size()=1 2024-09-12T01:38:01.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.270+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.F07XlzTcl84TgRhf2mjtTLKKjk5V_qz_0 2024-09-12T01:38:01.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.270+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17214116951072855980', time=2024-09-12T03:13:12.866484+0000, chain.objs.size()=1 2024-09-12T01:38:01.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.270+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.1yr_sz1ICqdib48LO3XPv-ruBKSP_R2_0 2024-09-12T01:38:01.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.270+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1615225644451838573', time=2024-09-12T03:13:12.952328+0000, chain.objs.size()=1 2024-09-12T01:38:01.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.270+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.RR1N3K3prtXEml1WeSQ5Z52wkKXMxY4_0 2024-09-12T01:38:01.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.270+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.406447966057224198', time=2024-09-12T03:13:13.042617+0000, chain.objs.size()=1 2024-09-12T01:38:01.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.270+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.5nf2oBeDTEPWeTkDW7sGybnUSI0vbqo_0 2024-09-12T01:38:01.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.275+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7068118759192495739', time=2024-09-12T03:13:13.043370+0000, chain.objs.size()=1 2024-09-12T01:38:01.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.275+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.tli-sPBlry-PO_VkFbNPUcgfJqu1FCT_0 2024-09-12T01:38:01.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.275+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17331605472493419832', time=2024-09-12T03:13:13.152556+0000, chain.objs.size()=1 2024-09-12T01:38:01.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.276+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.nsMqUlP6Jpy2HzYduCBkEjVcbUD4otj_0 2024-09-12T01:38:01.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.276+0000 7f8784789640 0 -- 172.21.15.73:0/3328777400 >> [v2:172.21.15.117:6824/197320478,v1:172.21.15.117:6825/197320478] conn(0x55e6269f3140 msgr2=0x55e6269f5590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:38:01.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.276+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14148415020637005540', time=2024-09-12T03:13:13.212065+0000, chain.objs.size()=1 2024-09-12T01:38:01.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.276+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.tc5l2GLA-vklnSt87aXY-LTfGvmAR20_0 2024-09-12T01:38:01.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.276+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9048318503057885779', time=2024-09-12T03:13:13.308763+0000, chain.objs.size()=1 2024-09-12T01:38:01.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.276+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.j5i0dMcQEeaSAECA-Z3mISfA4xGYnwA_0 2024-09-12T01:38:01.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.276+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18386922628919730208', time=2024-09-12T03:13:13.845207+0000, chain.objs.size()=1 2024-09-12T01:38:01.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.276+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.E-i5Px-1XxJjmEKXWOWcYYLorMmJyq3_0 2024-09-12T01:38:01.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.276+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6179250207475023244', time=2024-09-12T03:13:13.845862+0000, chain.objs.size()=1 2024-09-12T01:38:01.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.276+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.TIGp82csnHiiFVV8xYvAoKES2o2S5WN_0 2024-09-12T01:38:01.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.276+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2905128657184241820', time=2024-09-12T03:13:13.956604+0000, chain.objs.size()=1 2024-09-12T01:38:01.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.276+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.0BwLr66EaJEDToB3HTzOZ8DlQOqdVnt_0 2024-09-12T01:38:01.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.276+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11983801155721953276', time=2024-09-12T03:13:13.957225+0000, chain.objs.size()=1 2024-09-12T01:38:01.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.276+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.RDbQpmyPZr1wFShmlpAOOps5xIhQhgn_0 2024-09-12T01:38:01.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.276+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10441752884153350064', time=2024-09-12T03:13:14.097049+0000, chain.objs.size()=1 2024-09-12T01:38:01.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.276+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.yJ3iritMVtb5xPe65QaJ97_oBUWDCEc_0 2024-09-12T01:38:01.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.276+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.437209050312939172', time=2024-09-12T03:13:14.380833+0000, chain.objs.size()=1 2024-09-12T01:38:01.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.276+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.DIsBfjmYN9zzURpJ2Ucia--RzKEl2j4_0 2024-09-12T01:38:01.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.276+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5293339880581768981', time=2024-09-12T03:13:15.072617+0000, chain.objs.size()=1 2024-09-12T01:38:01.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.276+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.GY3TnHt8adLVMzxrte_Du_kjKKMqDsF_0 2024-09-12T01:38:01.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.281+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13985372766114397954', time=2024-09-12T03:13:15.222314+0000, chain.objs.size()=1 2024-09-12T01:38:01.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.281+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.QZPC_0SFkanMhjWj4LUXQDrry823bFC_0 2024-09-12T01:38:01.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.281+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16438726863114818811', time=2024-09-12T03:13:15.237331+0000, chain.objs.size()=1 2024-09-12T01:38:01.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.281+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.EheCiPLeeP4xFYCve25sJOEJtqTO72X_0 2024-09-12T01:38:01.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.281+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11676165857429627966', time=2024-09-12T03:13:15.331920+0000, chain.objs.size()=1 2024-09-12T01:38:01.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.281+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.MxRM_zgtXuyNUFKBEcHssnxAciSZmIN_0 2024-09-12T01:38:01.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.281+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12357178497423613325', time=2024-09-12T03:13:15.533843+0000, chain.objs.size()=1 2024-09-12T01:38:01.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.281+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.IDs1QSD5lqgERClUPgvF3ZunA6_Jha1_0 2024-09-12T01:38:01.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.281+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1163993987415089599', time=2024-09-12T03:13:15.741045+0000, chain.objs.size()=1 2024-09-12T01:38:01.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.282+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.8Jd2OIzWeLOona3dBV5Z5TsOrAPFdxC_0 2024-09-12T01:38:01.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.282+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15277042720744642713', time=2024-09-12T03:13:16.379075+0000, chain.objs.size()=1 2024-09-12T01:38:01.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.282+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.ivlhUNanXgzRpEMCdSFp7hjuzeFQBdm_0 2024-09-12T01:38:01.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.282+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15369560315203737160', time=2024-09-12T03:13:16.513315+0000, chain.objs.size()=1 2024-09-12T01:38:01.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.282+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.vZTgAa4VAjG_k0ra41Y4vnFMJOOFOvF_0 2024-09-12T01:38:01.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.282+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10454766979566871135', time=2024-09-12T03:13:16.636823+0000, chain.objs.size()=1 2024-09-12T01:38:01.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.282+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.C-55eRYUJAAb5M4On4KnMx6lMX1Vwgu_0 2024-09-12T01:38:01.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.282+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2956215831081344985', time=2024-09-12T03:13:16.810666+0000, chain.objs.size()=1 2024-09-12T01:38:01.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.282+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.FgojzSjPPUjHjUuSae4g_9q_ZlTngO6_0 2024-09-12T01:38:01.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.282+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4144108288026592665', time=2024-09-12T03:13:16.986529+0000, chain.objs.size()=1 2024-09-12T01:38:01.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.282+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.prMmq-7zmbjB32m5k1NOrzpluKPe_Y-_0 2024-09-12T01:38:01.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.282+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13519868297076009729', time=2024-09-12T03:13:17.127081+0000, chain.objs.size()=1 2024-09-12T01:38:01.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.282+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.hN8lKKt3RP3RxieseN-4e1vvVYZ1Jkj_0 2024-09-12T01:38:01.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.283+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10109424261988130559', time=2024-09-12T03:13:53.648293+0000, chain.objs.size()=1 2024-09-12T01:38:01.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.283+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.fu8JsaFhiWHh5nQL3pvM4BD3vEK4Yxm_0 2024-09-12T01:38:01.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.284+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9582945982236518190', time=2024-09-12T03:13:53.863324+0000, chain.objs.size()=1 2024-09-12T01:38:01.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.284+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.khqt0FiU2IMPxwo1CRvcc93lNYYDzhd_0 2024-09-12T01:38:01.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.287+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3194225810287450791', time=2024-09-12T03:13:53.873616+0000, chain.objs.size()=1 2024-09-12T01:38:01.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.287+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.TIwWu5L3NAZe000gFeO30SB6RNVnpT8_0 2024-09-12T01:38:01.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.287+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5403672204637346763', time=2024-09-12T03:13:53.901777+0000, chain.objs.size()=1 2024-09-12T01:38:01.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.287+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.PhrARD8OxMpc69goIM7lL3GDKJsUn_E_0 2024-09-12T01:38:01.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.287+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17532770069160001332', time=2024-09-12T03:13:54.218299+0000, chain.objs.size()=1 2024-09-12T01:38:01.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.287+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.oH4n6N8toGVR_06Uz7lxO--dc59wbvW_0 2024-09-12T01:38:01.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.287+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8741667951835836302', time=2024-09-12T03:13:55.758620+0000, chain.objs.size()=1 2024-09-12T01:38:01.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.287+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.qvckhBEsiq15UoiW9EMFFehHcow2Qis_0 2024-09-12T01:38:01.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.287+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14036027029690164949', time=2024-09-12T03:13:55.906564+0000, chain.objs.size()=1 2024-09-12T01:38:01.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.287+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.8RdNEIfjAiKIOVlrOp0F4rDe40EbdfO_0 2024-09-12T01:38:01.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.287+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13254772483069692057', time=2024-09-12T03:13:56.012083+0000, chain.objs.size()=1 2024-09-12T01:38:01.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.287+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.6piGIHogZrkauZiWzc19ssN-LyefB2N_0 2024-09-12T01:38:01.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.287+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.444645174361990598', time=2024-09-12T03:13:56.048501+0000, chain.objs.size()=1 2024-09-12T01:38:01.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.287+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.hmiNxIGWEBOoFDNPhczQ1CvJTaUxz_k_0 2024-09-12T01:38:01.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.287+0000 7f8784789640 0 -- 172.21.15.73:0/3328777400 >> [v2:172.21.15.117:6816/1460498570,v1:172.21.15.117:6817/1460498570] conn(0x7f877c02a060 msgr2=0x7f877c0982a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:38:01.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.287+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9572027686202708786', time=2024-09-12T03:13:57.861301+0000, chain.objs.size()=1 2024-09-12T01:38:01.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.287+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.ys1qG_cGcgKp6Vzh5in7cmPOejLt_az_0 2024-09-12T01:38:01.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.287+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4710203986852672473', time=2024-09-12T03:13:57.963476+0000, chain.objs.size()=1 2024-09-12T01:38:01.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.287+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.ZDjakATzUi3bWnvA9BHD-Qy8iFFwBaV_0 2024-09-12T01:38:01.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.287+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3571219800452252484', time=2024-09-12T03:13:58.108707+0000, chain.objs.size()=1 2024-09-12T01:38:01.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.287+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.sOkEQKYD3hmysqdfgd2cFg0gIpa4Vmu_0 2024-09-12T01:38:01.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.290+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7067549671572417127', time=2024-09-12T03:13:58.285615+0000, chain.objs.size()=1 2024-09-12T01:38:01.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.290+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.PDv5r59jygKNFqhDp0xSRRr_krkoCc4_0 2024-09-12T01:38:01.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.293+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14632780670472668981', time=2024-09-12T03:13:58.400232+0000, chain.objs.size()=1 2024-09-12T01:38:01.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.293+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.nLO92MWehWSCRHqO1IEqWm2sSHJK091_0 2024-09-12T01:38:01.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.293+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.181417962777459005', time=2024-09-12T03:13:58.419050+0000, chain.objs.size()=1 2024-09-12T01:38:01.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.293+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.rxyeGCCDfGraV-K_gSnJ8PnjKUOsogO_0 2024-09-12T01:38:01.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.293+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3130178958638288769', time=2024-09-12T03:13:58.714088+0000, chain.objs.size()=1 2024-09-12T01:38:01.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.293+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.2YWwRo34h_vdIdrlugL90vLcAUHxi3y_0 2024-09-12T01:38:01.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.293+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10827109960495289692', time=2024-09-12T03:13:59.151307+0000, chain.objs.size()=1 2024-09-12T01:38:01.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.293+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.191XeDLbOjSNhBVT0h4ukociW7qzdKq_0 2024-09-12T01:38:01.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.293+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4570878272064346166', time=2024-09-12T03:13:59.516587+0000, chain.objs.size()=1 2024-09-12T01:38:01.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.293+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.avJR7FxVD4hhN1_VBElaFQ2vosk_oy4_0 2024-09-12T01:38:01.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.293+0000 7f8783f88640 0 -- 172.21.15.73:0/3328777400 >> [v2:172.21.15.73:6818/153097326,v1:172.21.15.73:6819/153097326] conn(0x55e6269eee60 msgr2=0x55e6269f1320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:38:01.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.293+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2598588783840555863', time=2024-09-12T03:14:00.488632+0000, chain.objs.size()=1 2024-09-12T01:38:01.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.293+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.h_61l3Wm8Zj3eZD0F_8H8fDQr26CfKE_0 2024-09-12T01:38:01.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.293+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18312011231025613725', time=2024-09-12T03:14:00.635122+0000, chain.objs.size()=1 2024-09-12T01:38:01.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.293+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.9bUrtaboViEfUY_QvWGEjXOYHXpe6nV_0 2024-09-12T01:38:01.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.293+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13699663359401011744', time=2024-09-12T03:14:00.708039+0000, chain.objs.size()=1 2024-09-12T01:38:01.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.293+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.BaXDgN5yj-07hRdD_22AdnylExRkYjt_0 2024-09-12T01:38:01.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.299+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 0/45149 2024-09-12T01:38:01.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.302+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=33, truncated=0, next_marker='' 2024-09-12T01:38:01.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.302+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11393798027993825472', time=2024-09-12T03:14:00.891789+0000, chain.objs.size()=1 2024-09-12T01:38:01.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.302+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.wz5-Vbt5QnUrxXdbwY1X_3sWQyYbk4h_0 2024-09-12T01:38:01.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.302+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13528070752366763717', time=2024-09-12T03:14:00.998582+0000, chain.objs.size()=1 2024-09-12T01:38:01.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.302+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.RczHDPN1jEMzbWY7pQvMz3LM6DSf5ns_0 2024-09-12T01:38:01.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.302+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15709511204609790484', time=2024-09-12T03:14:00.999553+0000, chain.objs.size()=1 2024-09-12T01:38:01.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.302+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.SShToZKfPHc3m2ZqBNHsjFaDuvxjAjF_0 2024-09-12T01:38:01.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.302+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17442676981237473803', time=2024-09-12T03:14:01.036172+0000, chain.objs.size()=1 2024-09-12T01:38:01.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.302+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.IZFZvT6dmzptTsbHWmv8NUoKMLzgwUg_0 2024-09-12T01:38:01.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.302+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15888872806853323555', time=2024-09-12T03:14:01.135748+0000, chain.objs.size()=1 2024-09-12T01:38:01.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.302+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.nRC4uS1J535eNYRrbOczfgRCc7n0NlG_0 2024-09-12T01:38:01.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.302+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10541709770224664112', time=2024-09-12T03:14:01.331324+0000, chain.objs.size()=1 2024-09-12T01:38:01.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.302+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.jKp8VGVIjKlMkTzkFJ8qq-ZmpxOCqqM_0 2024-09-12T01:38:01.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.302+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11298115503201926537', time=2024-09-12T03:14:01.397290+0000, chain.objs.size()=1 2024-09-12T01:38:01.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.302+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.MWzKMOCXnOFiJfCxVesaII--7ghIAJP_0 2024-09-12T01:38:01.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.302+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14782831509334022823', time=2024-09-12T03:14:01.825883+0000, chain.objs.size()=1 2024-09-12T01:38:01.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.302+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.CG88noUzwrBLCG7GGgb2PJubw9BOdh7_0 2024-09-12T01:38:01.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.302+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.473660933459440764', time=2024-09-12T03:14:01.859908+0000, chain.objs.size()=1 2024-09-12T01:38:01.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.302+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.9ZPifQyLZaEonrfWWDqX9Jd-l01JaJA_0 2024-09-12T01:38:01.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.302+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8427641853257530429', time=2024-09-12T03:14:01.960015+0000, chain.objs.size()=1 2024-09-12T01:38:01.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.302+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.1VOjk-hSO9hgR4qZ8_YFA-kX0zAJJug_0 2024-09-12T01:38:01.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.302+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7628599541056262071', time=2024-09-12T03:14:02.183579+0000, chain.objs.size()=1 2024-09-12T01:38:01.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.302+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.eSoxNwdBkeD2mU9IcgsNhKdnow6We3I_0 2024-09-12T01:38:01.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.302+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14434165990074142305', time=2024-09-12T03:14:02.381821+0000, chain.objs.size()=1 2024-09-12T01:38:01.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.302+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.n1slnhVTNM4YwNwbv4QSK2SN05gMwBb_0 2024-09-12T01:38:01.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.307+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7142436577223867145', time=2024-09-12T03:14:02.480431+0000, chain.objs.size()=1 2024-09-12T01:38:01.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.307+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.E4BaUWiYMFlk0M9lJFWZ9gkdRBt58nX_0 2024-09-12T01:38:01.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.307+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10879527092160522052', time=2024-09-12T03:14:02.907946+0000, chain.objs.size()=1 2024-09-12T01:38:01.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.307+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.RjG8I6NZtLcJ3IQiueyUuBhTCyGNcBa_0 2024-09-12T01:38:01.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.307+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1683243286716346016', time=2024-09-12T03:14:03.223168+0000, chain.objs.size()=1 2024-09-12T01:38:01.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.307+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.ujZVBWMmHzJEEjt9L-s6AwXHCPXfOC__0 2024-09-12T01:38:01.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.307+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4350670100944497994', time=2024-09-12T03:14:23.109533+0000, chain.objs.size()=1 2024-09-12T01:38:01.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.307+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.345__shadow_.3W_uk5z3hcATSdIkVMID-5lpgMlohVq_0 2024-09-12T01:38:01.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.307+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6935787399692532870', time=2024-09-12T03:14:49.208885+0000, chain.objs.size()=1 2024-09-12T01:38:01.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.307+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.375__shadow_.71IcyiUrAlaV0X6_emmd88SGpgmgMbu_0 2024-09-12T01:38:01.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.307+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10172478111575241804', time=2024-09-12T03:15:42.381816+0000, chain.objs.size()=1 2024-09-12T01:38:01.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.307+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.430__shadow_.JsMZ_Wbeu_jB2TXiFOkBYY4AsLaKm08_0 2024-09-12T01:38:01.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.307+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9959725903113646678', time=2024-09-12T03:15:46.892588+0000, chain.objs.size()=1 2024-09-12T01:38:01.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.307+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.435__shadow_.mKMVQAIGz9ovU0_WjdsYsq5Yl41HPZi_0 2024-09-12T01:38:01.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.307+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2708661496566353669', time=2024-09-12T03:16:42.360415+0000, chain.objs.size()=1 2024-09-12T01:38:01.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.307+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.488__shadow_.YYgitvyW6tIeyS-eNoASa_CC73nkPZ6_0 2024-09-12T01:38:01.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.307+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2523570897841459663', time=2024-09-12T03:16:50.453439+0000, chain.objs.size()=1 2024-09-12T01:38:01.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.307+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.497__shadow_.9sLB_Krfa9LaZ7p_I7rU3ZrVQ9pjgMq_0 2024-09-12T01:38:01.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.307+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14654558691612915861', time=2024-09-12T03:22:53.648658+0000, chain.objs.size()=1 2024-09-12T01:38:01.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.307+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.561__multipart_mymultipart.2~BNqGybqXcuaOYDywu_SNjTCQ1NTDTJP.1 2024-09-12T01:38:01.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.307+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11799125486297119277', time=2024-09-12T03:23:16.251915+0000, chain.objs.size()=1 2024-09-12T01:38:01.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.307+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.569__shadow:JLm5VdQUlyVgCqVUC6ofP28Zj5iO41j_.BjpZKsqPbzZpr9WGfbaGRoJPj22hsv__0 2024-09-12T01:38:01.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.309+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.304186487727121493', time=2024-09-12T03:23:29.402415+0000, chain.objs.size()=1 2024-09-12T01:38:01.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.309+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.574__shadow:.UpVx46Fu7m5o5tadSKfr59z-sPrLCJ_.bHBEk6uAj0HsKNcbc7ZFX4PyRcAOG0s_0 2024-09-12T01:38:01.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.309+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12494602151733079006', time=2024-09-12T03:23:52.678334+0000, chain.objs.size()=1 2024-09-12T01:38:01.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.309+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.577__shadow:s-OuSZZmlJB2i5u8RzLl458FL6FJeok_.ru1Vyf5CmVPTJs85iyNwbETh5Z536bi_0 2024-09-12T01:38:01.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.310+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.891958553611971360', time=2024-09-12T03:24:55.538152+0000, chain.objs.size()=1 2024-09-12T01:38:01.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.310+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.596__shadow_.Brf_k9qSr814K7z7pzmiNqFj7CUeotY_0 2024-09-12T01:38:01.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.310+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13735678939175444620', time=2024-09-12T03:29:52.652044+0000, chain.objs.size()=1 2024-09-12T01:38:01.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.310+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.630__shadow_.HgmBQLled4uAXbq0f1pAr0TFjuTLnlT_0 2024-09-12T01:38:01.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.310+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16096669114701720870', time=2024-09-12T03:29:54.499008+0000, chain.objs.size()=1 2024-09-12T01:38:01.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.310+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.632__shadow_.8JW_H3IBK8ifwg9EVNNp7aa38swAGQf_0 2024-09-12T01:38:01.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.310+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.307979037952368367', time=2024-09-12T03:29:58.554454+0000, chain.objs.size()=1 2024-09-12T01:38:01.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.310+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.636__shadow_.5uYXMlV2zA27Xg6Zcz28RDYXlm6bVci_0 2024-09-12T01:38:01.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.310+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1769940111262237379', time=2024-09-12T03:31:03.241225+0000, chain.objs.size()=1 2024-09-12T01:38:01.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.310+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.668__shadow_.0KC_-7dWF6RwGb4_N7JlKB-13ivkrza_0 2024-09-12T01:38:01.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.310+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10797022624441747544', time=2024-09-12T03:31:12.009572+0000, chain.objs.size()=1 2024-09-12T01:38:01.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.310+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.679__shadow_.a0jyjttQjWUzEdUNzG3vmzCUxPj6nBe_0 2024-09-12T01:38:01.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.310+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15768341391108197846', time=2024-09-12T03:31:29.181451+0000, chain.objs.size()=1 2024-09-12T01:38:01.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.310+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.700__shadow:AvA7LOPC--mYftgUwHDDwUVbsUUBYia_.DqaRdwlHP3eJjJrVXUOfQzvA0F7OZmt_0 2024-09-12T01:38:01.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.310+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8072061328851058436', time=2024-09-12T03:32:47.638481+0000, chain.objs.size()=3 2024-09-12T01:38:01.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.310+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.743__multipart_mymultipart3.2~A-bxqMDAW_Fd35PLxnm2soGtlDTkS3j.1 2024-09-12T01:38:01.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.310+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.743__multipart_mymultipart3.2~A-bxqMDAW_Fd35PLxnm2soGtlDTkS3j.2 2024-09-12T01:38:01.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.311+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.743__multipart_mymultipart3.2~A-bxqMDAW_Fd35PLxnm2soGtlDTkS3j.3 2024-09-12T01:38:01.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.315+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:38:01.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.320+0000 7f8786c98800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T01:38:01.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.322+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:38:01.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.322+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:38:01.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.323+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=94, truncated=0, next_marker='' 2024-09-12T01:38:01.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.323+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3680721325302528644', time=2024-09-12T03:07:40.403643+0000, chain.objs.size()=1 2024-09-12T01:38:01.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.323+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.178__shadow_.wE8B18KnT1p5aodYhPshKdIUQDrxGZI_0 2024-09-12T01:38:01.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.323+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6150513674976507562', time=2024-09-12T03:10:11.614543+0000, chain.objs.size()=1 2024-09-12T01:38:01.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.323+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.236__shadow_.yBQMsNVuXEWS9L7EZcv7yn246M30bvH_0 2024-09-12T01:38:01.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.323+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.986365158189656745', time=2024-09-12T03:10:31.720108+0000, chain.objs.size()=1 2024-09-12T01:38:01.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.323+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.254__shadow_.rtnB31NVPEvxVHEFeLXXywPy_Qh1FOy_0 2024-09-12T01:38:01.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.323+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7240559059818109139', time=2024-09-12T03:11:14.543090+0000, chain.objs.size()=1 2024-09-12T01:38:01.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.323+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.31z96VPFIFY3HYIfADlaQce7elquY5i_0 2024-09-12T01:38:01.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.323+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13039898383097864508', time=2024-09-12T03:11:14.702312+0000, chain.objs.size()=1 2024-09-12T01:38:01.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.323+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.ssVY03XNCSu64t8ks41JGS-GUuHmqfX_0 2024-09-12T01:38:01.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.323+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4352983951077739534', time=2024-09-12T03:11:15.016818+0000, chain.objs.size()=1 2024-09-12T01:38:01.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.323+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.xDSqfFEiBOnu0hfUWBcLg_g3ZLhSFWp_0 2024-09-12T01:38:01.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.323+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9020957418829578385', time=2024-09-12T03:11:15.261464+0000, chain.objs.size()=1 2024-09-12T01:38:01.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.323+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.DadZ3NpDn3_PWRzAjwxUcMFfz9kB0ff_0 2024-09-12T01:38:01.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.323+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16246664359071330642', time=2024-09-12T03:11:16.009907+0000, chain.objs.size()=1 2024-09-12T01:38:01.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.323+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.W1mTkGhhDVDHfwpwVwEe9vDiaAEanlV_0 2024-09-12T01:38:01.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.323+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16333532045195780850', time=2024-09-12T03:11:16.231928+0000, chain.objs.size()=1 2024-09-12T01:38:01.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.323+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.XYSfMEk5fO5JAxIMqCD2-UWYY3Kju7u_0 2024-09-12T01:38:01.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.323+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6268128578946230917', time=2024-09-12T03:11:16.445786+0000, chain.objs.size()=1 2024-09-12T01:38:01.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.323+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.N455gMQ0hPTjC9oNyLEDP4McbPoEjzb_0 2024-09-12T01:38:01.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.323+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.37197106606251617', time=2024-09-12T03:11:16.446397+0000, chain.objs.size()=1 2024-09-12T01:38:01.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.323+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Q_M0dYwnTLNVlGGiDT6ZAF0wlSUaN-9_0 2024-09-12T01:38:01.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.323+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7149503011217401462', time=2024-09-12T03:11:16.932986+0000, chain.objs.size()=1 2024-09-12T01:38:01.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.323+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.osAT214a1r0eoiIMUlAaX1lOBBF9bCO_0 2024-09-12T01:38:01.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.325+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13992846016151297650', time=2024-09-12T03:11:17.530182+0000, chain.objs.size()=1 2024-09-12T01:38:01.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.325+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.2HBr9hJBfeXciJOdG1eApmrj67A6YvQ_0 2024-09-12T01:38:01.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.325+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.635211214189709411', time=2024-09-12T03:11:17.634383+0000, chain.objs.size()=1 2024-09-12T01:38:01.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.325+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.XG-HPTL5-JJUUKbrg649-Z4TOkkwa8O_0 2024-09-12T01:38:01.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.325+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4228766580587352512', time=2024-09-12T03:11:17.693538+0000, chain.objs.size()=1 2024-09-12T01:38:01.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.325+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.t8ckzvJMoFnlAKMxuIldM0w6knqbhmk_0 2024-09-12T01:38:01.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.325+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8635852334485794683', time=2024-09-12T03:11:17.805395+0000, chain.objs.size()=1 2024-09-12T01:38:01.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.325+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.j8CmtmBAipmZ994U5U4aQTVIKHggA70_0 2024-09-12T01:38:01.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.327+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14973746198007803445', time=2024-09-12T03:11:18.434396+0000, chain.objs.size()=1 2024-09-12T01:38:01.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.327+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.4Cs96OxqNfpomHqqxY8vpJPfW_R5NWe_0 2024-09-12T01:38:01.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.327+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11719355817455382463', time=2024-09-12T03:11:19.495768+0000, chain.objs.size()=1 2024-09-12T01:38:01.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.327+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.oz8R1KiOVmpDvpKCbyDM4HZYqq3ADLC_0 2024-09-12T01:38:01.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.327+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8672196200507010828', time=2024-09-12T03:11:19.596042+0000, chain.objs.size()=1 2024-09-12T01:38:01.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.327+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.rLg-QSbUocRTzFJlKVeoqleL65KOevu_0 2024-09-12T01:38:01.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.327+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2846980531862244041', time=2024-09-12T03:11:20.364666+0000, chain.objs.size()=1 2024-09-12T01:38:01.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.327+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.wyCbwtUWmE7H4xfwIM-_DR2QDMxQC08_0 2024-09-12T01:38:01.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.327+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2629432327818665131', time=2024-09-12T03:11:20.741404+0000, chain.objs.size()=1 2024-09-12T01:38:01.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.327+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.8nDjrnEgQ_OubERdHUKJ1Jvx8AoRsbs_0 2024-09-12T01:38:01.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.327+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7168858228788940653', time=2024-09-12T03:11:21.129040+0000, chain.objs.size()=1 2024-09-12T01:38:01.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.327+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.f2L9AN5UAosUwJ9jCsDXFSNRALve5-R_0 2024-09-12T01:38:01.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.327+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6331737220242921959', time=2024-09-12T03:11:21.193398+0000, chain.objs.size()=1 2024-09-12T01:38:01.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.327+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.vSIlP6JUZGVNUheXCjiMQBpRPEn-eOY_0 2024-09-12T01:38:01.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.327+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3050561732263725419', time=2024-09-12T03:11:21.538818+0000, chain.objs.size()=1 2024-09-12T01:38:01.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.327+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Vbskr70cjkBJ7av-_B7ZKJ9XiTLvBsi_0 2024-09-12T01:38:01.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.327+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10408593134234002315', time=2024-09-12T03:11:21.544027+0000, chain.objs.size()=1 2024-09-12T01:38:01.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.327+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.c5wyfq9IERdWkSeDVaXK-1kC7u84dtR_0 2024-09-12T01:38:01.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.330+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3927900701943391642', time=2024-09-12T03:11:21.742413+0000, chain.objs.size()=1 2024-09-12T01:38:01.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.330+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.NMmHbxbtr6BihIF0YUjVaUqXoJiWPrG_0 2024-09-12T01:38:01.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.330+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10309243063070725183', time=2024-09-12T03:11:22.480059+0000, chain.objs.size()=1 2024-09-12T01:38:01.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.330+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.gmqfUTB3Djx0dp1_mrvRnhiKeTqVKzA_0 2024-09-12T01:38:01.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.332+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9756691001057436676', time=2024-09-12T03:11:22.542785+0000, chain.objs.size()=1 2024-09-12T01:38:01.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.332+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_._vA4HXR7kI5VnUNBtC-G3w2AVpf-uxz_0 2024-09-12T01:38:01.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.332+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16340519154817582253', time=2024-09-12T03:11:22.952624+0000, chain.objs.size()=1 2024-09-12T01:38:01.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.332+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.WDhqdp5Zx6NlNINy3vRQk9JXBQdnxeF_0 2024-09-12T01:38:01.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.332+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15408525190495487888', time=2024-09-12T03:11:22.980718+0000, chain.objs.size()=1 2024-09-12T01:38:01.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.332+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.FZddD7EeHcuMAsMT-Y4qgkROtcc-Nis_0 2024-09-12T01:38:01.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.332+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2316678372001275981', time=2024-09-12T03:11:23.472957+0000, chain.objs.size()=1 2024-09-12T01:38:01.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.332+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.FBPhChRQ4kbkoBwVegvPfiDDACCejfV_0 2024-09-12T01:38:01.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.332+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3143188501350866286', time=2024-09-12T03:11:23.546985+0000, chain.objs.size()=1 2024-09-12T01:38:01.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.332+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.HoUFe4Ne5CqzowaM4qCbgf8QcFplZLB_0 2024-09-12T01:38:01.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.332+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14676773061222740970', time=2024-09-12T03:11:24.107210+0000, chain.objs.size()=1 2024-09-12T01:38:01.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.332+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.39P_GLyHypl0idY-2o0v31oHYoZ-nBM_0 2024-09-12T01:38:01.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.333+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12843314735612887472', time=2024-09-12T03:11:24.407390+0000, chain.objs.size()=1 2024-09-12T01:38:01.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.333+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.ulED-f7WNufd5YHbV6d9VZBphIwml7N_0 2024-09-12T01:38:01.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.333+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16859174998811136673', time=2024-09-12T03:11:24.567786+0000, chain.objs.size()=1 2024-09-12T01:38:01.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.333+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.2n5B_MreGnfdkTfRKZFzGXEQVJbEAqH_0 2024-09-12T01:38:01.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.333+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12528470808732016097', time=2024-09-12T03:11:50.840349+0000, chain.objs.size()=1 2024-09-12T01:38:01.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.333+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.289__shadow_.IimPzjAe7fwYo83XjlpCaznUVdsQD7y_0 2024-09-12T01:38:01.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.333+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10437429315048554909', time=2024-09-12T03:11:57.535122+0000, chain.objs.size()=1 2024-09-12T01:38:01.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.333+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.293__shadow_.ZcWxouE--ACO9dOrlZX2i8GRfHhx5Lw_0 2024-09-12T01:38:01.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.335+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6279631141133320737', time=2024-09-12T03:11:57.535775+0000, chain.objs.size()=1 2024-09-12T01:38:01.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.335+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.293__shadow_.H2_XJqAiqS3wGk5r4PrkfeJSCCjtO42_0 2024-09-12T01:38:01.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.338+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4799603006923724084', time=2024-09-12T03:12:03.707331+0000, chain.objs.size()=1 2024-09-12T01:38:01.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.338+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.299__shadow_.uqATq8u02HrVBRlfZjFpW2ltfw6Wd9x_0 2024-09-12T01:38:01.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.338+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9724710280426880829', time=2024-09-12T03:12:08.551004+0000, chain.objs.size()=1 2024-09-12T01:38:01.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.338+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.304__shadow_.tL0kJPRjX50Tdc6Eg7DbbU6FZLh49HN_0 2024-09-12T01:38:01.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.338+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.960498021306587791', time=2024-09-12T03:13:06.835846+0000, chain.objs.size()=1 2024-09-12T01:38:01.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.338+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.4Fdfw781yCvzc8Iz90qruTq72dkY7V4_0 2024-09-12T01:38:01.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.338+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11699174138629456710', time=2024-09-12T03:13:07.538913+0000, chain.objs.size()=1 2024-09-12T01:38:01.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.338+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.IA5HwDDzTCGRHUY9WTx0qoRs3FDW2-R_0 2024-09-12T01:38:01.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.338+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10680917872855647355', time=2024-09-12T03:13:09.088666+0000, chain.objs.size()=1 2024-09-12T01:38:01.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.338+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.s0yT6zjCVtenZYH2gHMDUDxy-gnjfV8_0 2024-09-12T01:38:01.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.338+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17326331054612999449', time=2024-09-12T03:13:09.753688+0000, chain.objs.size()=1 2024-09-12T01:38:01.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.338+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.l38uhkmeFkwK3ldMnBU3SiDGMkWrDnm_0 2024-09-12T01:38:01.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.338+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9601770573921091999', time=2024-09-12T03:13:09.895241+0000, chain.objs.size()=1 2024-09-12T01:38:01.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.338+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.CSGHoB-ouJBwT_7bdxOI9W8nlDjsEY9_0 2024-09-12T01:38:01.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.338+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.917299907221613253', time=2024-09-12T03:13:13.220978+0000, chain.objs.size()=1 2024-09-12T01:38:01.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.338+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.b1G7m-VIi_rdv0PhEdX1cUYfNxFdcXS_0 2024-09-12T01:38:01.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.338+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1599118182010591980', time=2024-09-12T03:13:13.330918+0000, chain.objs.size()=1 2024-09-12T01:38:01.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.338+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.74nKgSX20GcMUjpd76JCfQXbHB6L2K4_0 2024-09-12T01:38:01.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.338+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8805631768232465820', time=2024-09-12T03:13:14.071325+0000, chain.objs.size()=1 2024-09-12T01:38:01.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.338+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.xeTHGgPXVHitxWgXOfN6rmgKjlAdK8a_0 2024-09-12T01:38:01.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.338+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9815605938661238489', time=2024-09-12T03:13:14.269836+0000, chain.objs.size()=1 2024-09-12T01:38:01.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.338+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.T9Fb3O6-pbkvHFOegn6ShcLO8d46Zq1_0 2024-09-12T01:38:01.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.341+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7282287879863062483', time=2024-09-12T03:13:15.251707+0000, chain.objs.size()=1 2024-09-12T01:38:01.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.341+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.93QBaVb0SE9Xtree4WPgnyApu84k3g2_0 2024-09-12T01:38:01.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.341+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11604092909669430481', time=2024-09-12T03:13:15.783843+0000, chain.objs.size()=1 2024-09-12T01:38:01.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.341+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.tqLxj5CoYmKi7jcuipmQXCvPf8qy0rr_0 2024-09-12T01:38:01.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.341+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13661341110734852160', time=2024-09-12T03:13:15.966716+0000, chain.objs.size()=1 2024-09-12T01:38:01.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.341+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.EL7p3j54786ZM2nWxzaZu9fkdLJyDFA_0 2024-09-12T01:38:01.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.341+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11686598584283476381', time=2024-09-12T03:13:16.521511+0000, chain.objs.size()=1 2024-09-12T01:38:01.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.342+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.zNHuzA2a7CB1uovdN_xvsbLm62Ph0sq_0 2024-09-12T01:38:01.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.342+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8057109771413709035', time=2024-09-12T03:13:16.700208+0000, chain.objs.size()=1 2024-09-12T01:38:01.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.342+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.M3LKqyUG-UMDNg8_6-0SOrJNns4u_in_0 2024-09-12T01:38:01.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.342+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13572601143520356690', time=2024-09-12T03:13:16.734899+0000, chain.objs.size()=1 2024-09-12T01:38:01.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.342+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.9XljYIShXhzYQaA2T-RisvAcPLpJNx3_0 2024-09-12T01:38:01.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.342+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7247269762509104459', time=2024-09-12T03:13:16.847799+0000, chain.objs.size()=1 2024-09-12T01:38:01.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.342+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.fg47X1dMJttTg59qw7o8oPN6B1oWcGc_0 2024-09-12T01:38:01.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.342+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10208907808894563453', time=2024-09-12T03:13:16.943539+0000, chain.objs.size()=1 2024-09-12T01:38:01.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.342+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.oEvpHfmJLlQXkPmu68ucvZWqzsQZCQN_0 2024-09-12T01:38:01.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.342+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6186639378574170278', time=2024-09-12T03:13:53.787493+0000, chain.objs.size()=1 2024-09-12T01:38:01.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.342+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.KUGSLfF4NWWkl_vSpuWbIppOeckDywJ_0 2024-09-12T01:38:01.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.342+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4764849837438171741', time=2024-09-12T03:13:53.897145+0000, chain.objs.size()=1 2024-09-12T01:38:01.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.342+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.jtR9GMx5UaypJjc-ZdBCKtfQn-UwzQ1_0 2024-09-12T01:38:01.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.342+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1091620703126521446', time=2024-09-12T03:13:54.146856+0000, chain.objs.size()=1 2024-09-12T01:38:01.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.342+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.7EwghCvZAuOzMdrZfNZnZArFrLz8z8t_0 2024-09-12T01:38:01.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.342+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4817098375285323624', time=2024-09-12T03:13:55.232329+0000, chain.objs.size()=1 2024-09-12T01:38:01.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.342+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.eCNd9ovWze0d4POAoleF--4BQ8iBlkb_0 2024-09-12T01:38:01.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.342+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5266723298253059404', time=2024-09-12T03:13:55.616773+0000, chain.objs.size()=1 2024-09-12T01:38:01.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.342+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.bOJX3ePVBw3Ub-ARDv3e0WJDguYTlUq_0 2024-09-12T01:38:01.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.343+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6343615148329209361', time=2024-09-12T03:13:55.840760+0000, chain.objs.size()=1 2024-09-12T01:38:01.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.343+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.9rsQLm2u9I-CZ7o_pAuTF1H8Iiix5Fg_0 2024-09-12T01:38:01.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.344+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12497353604476146521', time=2024-09-12T03:13:55.924985+0000, chain.objs.size()=1 2024-09-12T01:38:01.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.344+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.m22u2i8dVJrOaNCTB7yWQ1Ac6Ad1xQ5_0 2024-09-12T01:38:01.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.344+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5811999016693501044', time=2024-09-12T03:13:55.959611+0000, chain.objs.size()=1 2024-09-12T01:38:01.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.344+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.qqjmLnU5hRATZUBZcz49b6W4E-12mzt_0 2024-09-12T01:38:01.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.344+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3446567921900175454', time=2024-09-12T03:13:56.645102+0000, chain.objs.size()=1 2024-09-12T01:38:01.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.344+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_._9ePW99tapiXDi-kd6Abp0xPH2o9E1n_0 2024-09-12T01:38:01.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.344+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11413663861043108991', time=2024-09-12T03:13:56.760675+0000, chain.objs.size()=1 2024-09-12T01:38:01.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.344+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.oVJ1vpMcXeHSPC9lR1-nodOyOYW7BHJ_0 2024-09-12T01:38:01.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.344+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.785183753037046420', time=2024-09-12T03:13:57.221295+0000, chain.objs.size()=1 2024-09-12T01:38:01.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.344+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.pD0t0v7T-D5s6cyQ71_YCIhZ9e7XvCM_0 2024-09-12T01:38:01.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.344+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18216414039311715198', time=2024-09-12T03:13:57.240330+0000, chain.objs.size()=1 2024-09-12T01:38:01.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.344+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.WpZjrLcJldger8hQzL8LR1KgN3vFvpk_0 2024-09-12T01:38:01.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.345+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17166478100258370607', time=2024-09-12T03:13:57.323768+0000, chain.objs.size()=1 2024-09-12T01:38:01.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.345+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.2dhQPwBF0VXUZ1tliUpl7-DipCwUoqX_0 2024-09-12T01:38:01.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.345+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.806408159297978553', time=2024-09-12T03:13:57.986269+0000, chain.objs.size()=1 2024-09-12T01:38:01.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.345+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.PYtaGwJfdB-xa4JZ0JAXfKUrlFCwfqS_0 2024-09-12T01:38:01.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.345+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1511694503723842360', time=2024-09-12T03:13:58.180666+0000, chain.objs.size()=1 2024-09-12T01:38:01.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.345+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.0oPCwtliNuPdorLunKYFG4dEQ_F7Hdu_0 2024-09-12T01:38:01.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.345+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6773288132069498134', time=2024-09-12T03:13:58.422240+0000, chain.objs.size()=1 2024-09-12T01:38:01.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.345+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.pjo0Xb620yzX6RfwvPN2t7VO_ml59F2_0 2024-09-12T01:38:01.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.345+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16266879251139262493', time=2024-09-12T03:13:58.652692+0000, chain.objs.size()=1 2024-09-12T01:38:01.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.345+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.6hT6IDBcVqzYxw2sL6gKnFkTOn73GJ7_0 2024-09-12T01:38:01.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.346+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13926178135904096968', time=2024-09-12T03:13:59.168207+0000, chain.objs.size()=1 2024-09-12T01:38:01.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.346+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.B2vWKep0uiGfmHgm-gx68VGJziCULpZ_0 2024-09-12T01:38:01.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.346+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14261555686870151260', time=2024-09-12T03:13:59.428085+0000, chain.objs.size()=1 2024-09-12T01:38:01.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.346+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Bt3_7wisM-V6TAY76l79IEwqjQ8MxrQ_0 2024-09-12T01:38:01.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.346+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10598856344285324527', time=2024-09-12T03:13:59.673856+0000, chain.objs.size()=1 2024-09-12T01:38:01.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.346+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.wLa_QrP3JSXZeBW8OdxHyGMOHbAlG-R_0 2024-09-12T01:38:01.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.346+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13723158135353513526', time=2024-09-12T03:13:59.816062+0000, chain.objs.size()=1 2024-09-12T01:38:01.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.346+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.vbS9jt82pOKpTCtH1_w-8dkmyAr1Ux1_0 2024-09-12T01:38:01.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.346+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8314903227026709004', time=2024-09-12T03:14:00.738266+0000, chain.objs.size()=1 2024-09-12T01:38:01.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.346+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.MAWs77i3jkKRh32WZOIQ8ghzWL-7cpR_0 2024-09-12T01:38:01.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.346+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15055770156057701038', time=2024-09-12T03:14:01.091781+0000, chain.objs.size()=1 2024-09-12T01:38:01.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.346+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Sjku9PwcEAIoKOiM-RewuqvKbybhLag_0 2024-09-12T01:38:01.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.347+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13665798670982928603', time=2024-09-12T03:14:01.712103+0000, chain.objs.size()=1 2024-09-12T01:38:01.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.347+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.NuMYarMLa_rCSkYPF1J9K6CazmB_FA2_0 2024-09-12T01:38:01.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.348+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9096330598041137976', time=2024-09-12T03:14:01.953208+0000, chain.objs.size()=1 2024-09-12T01:38:01.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.348+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Ma8WzTjGhbRUJSIVOwluKXC_PHv6AQo_0 2024-09-12T01:38:01.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.348+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10122974169502211007', time=2024-09-12T03:14:03.058724+0000, chain.objs.size()=1 2024-09-12T01:38:01.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.348+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.jKxEzB9DbfxPykNy2NjAIj9l1iPz_Ti_0 2024-09-12T01:38:01.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.348+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8580845935754223533', time=2024-09-12T03:14:03.165884+0000, chain.objs.size()=1 2024-09-12T01:38:01.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.348+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.6nVlGJmcDCu-V3C0PMOVY1-PXPgbSHm_0 2024-09-12T01:38:01.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.348+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11172817662956054854', time=2024-09-12T03:14:03.202787+0000, chain.objs.size()=1 2024-09-12T01:38:01.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.348+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.PmwlRztfwsK2ychVIiZtTXJI0VLwbdi_0 2024-09-12T01:38:01.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.348+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11567870729613899934', time=2024-09-12T03:14:03.461801+0000, chain.objs.size()=1 2024-09-12T01:38:01.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.348+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.z5OUwX_PzYY72BAGj7ms2iw1YBg7P2P_0 2024-09-12T01:38:01.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.349+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6943542406083867072', time=2024-09-12T03:27:54.425091+0000, chain.objs.size()=1 2024-09-12T01:38:01.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.349+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.617__shadow_.JQ53mJKDb1CUGS7HnQJKaHqkrQQXm59_0 2024-09-12T01:38:01.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.349+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3598157197873652537', time=2024-09-12T03:28:58.436758+0000, chain.objs.size()=1 2024-09-12T01:38:01.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.349+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.620__shadow_.B7Yonam1rhAPMDuwhiUiaIvG-osN4CC_0 2024-09-12T01:38:01.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.349+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9789406044435443120', time=2024-09-12T03:29:30.220997+0000, chain.objs.size()=6 2024-09-12T01:38:01.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.349+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.623__multipart_multipart_enc.2~eb03QD-bSYuqnz6crfJn9_x0ZWeNwIA.1 2024-09-12T01:38:01.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.349+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.623__multipart_multipart_enc.2~eb03QD-bSYuqnz6crfJn9_x0ZWeNwIA.2 2024-09-12T01:38:01.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.349+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.623__multipart_multipart_enc.2~eb03QD-bSYuqnz6crfJn9_x0ZWeNwIA.3 2024-09-12T01:38:01.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.349+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.623__multipart_multipart_enc.2~eb03QD-bSYuqnz6crfJn9_x0ZWeNwIA.4 2024-09-12T01:38:01.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.351+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.623__multipart_multipart_enc.2~eb03QD-bSYuqnz6crfJn9_x0ZWeNwIA.5 2024-09-12T01:38:01.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.351+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.623__multipart_multipart_enc.2~eb03QD-bSYuqnz6crfJn9_x0ZWeNwIA.6 2024-09-12T01:38:01.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.352+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1561228704078255927', time=2024-09-12T03:30:07.477606+0000, chain.objs.size()=1 2024-09-12T01:38:01.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.352+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.643__shadow_.hGMqOqdvUmsdEVMhFuEEjFnW0oCta6U_0 2024-09-12T01:38:01.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.354+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13949627064869410847', time=2024-09-12T03:30:14.446115+0000, chain.objs.size()=2 2024-09-12T01:38:01.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.354+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.646__shadow_.4HcBVx92x57_8wouf2nX8CLG-jdSgcQ_0 2024-09-12T01:38:01.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.354+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.646__shadow_.4HcBVx92x57_8wouf2nX8CLG-jdSgcQ_1 2024-09-12T01:38:01.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.354+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12601902385538873974', time=2024-09-12T03:31:20.218075+0000, chain.objs.size()=1 2024-09-12T01:38:01.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.354+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.690__shadow:k8XeB9ludTU-8F9jvuXqqbzlsRdtRzm_.JLL44twRuUX50XcFR3VfEtPla3zjh99_0 2024-09-12T01:38:01.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.354+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8081740036083301338', time=2024-09-12T03:32:06.028620+0000, chain.objs.size()=1 2024-09-12T01:38:01.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.354+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.719__shadow_.nafvhnWfzqgrADmYmzEc8GSmK55WhKt_0 2024-09-12T01:38:01.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.354+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7575364868853524911', time=2024-09-12T03:32:42.142790+0000, chain.objs.size()=1 2024-09-12T01:38:01.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.354+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.742__multipart_mymultipart3.2~xIpaPX7q-zomQibtRR_pcTkMdAlmw8e.1 2024-09-12T01:38:01.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.360+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:38:01.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.362+0000 7f8786c98800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T01:38:01.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.364+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:38:01.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.364+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:38:01.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.365+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48167' 2024-09-12T01:38:01.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.365+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='_Dwk0uqNnZ-GK2doDRUZ_PoGQvkz5V4v', time=2024-09-12T03:06:55.870076+0000, chain.objs.size()=1 2024-09-12T01:38:01.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.365+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.161__shadow_.Z6LmIN98K-ukn-BGe-7kSeFFlJXZBtK_0 2024-09-12T01:38:01.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.365+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1436183055548115911', time=2024-09-12T03:10:08.729572+0000, chain.objs.size()=1 2024-09-12T01:38:01.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.365+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.233__shadow_.ckXKaHrOYcYKN_URATOvuOlIx788rep_0 2024-09-12T01:38:01.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.365+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16224394809437365698', time=2024-09-12T03:10:13.316463+0000, chain.objs.size()=1 2024-09-12T01:38:01.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.365+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.237__shadow_.rbUtiuslquAaEnxvu0rC72mHH2mdJff_0 2024-09-12T01:38:01.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.365+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17209685296122760882', time=2024-09-12T03:10:14.949248+0000, chain.objs.size()=1 2024-09-12T01:38:01.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.365+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.238__shadow_.nheGNWLuXeU8Bu6fuUTtEfw1wZ6fFr6_0 2024-09-12T01:38:01.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.365+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15314314508826647858', time=2024-09-12T03:10:21.930232+0000, chain.objs.size()=1 2024-09-12T01:38:01.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.365+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.244__shadow_.z2WyChs7EAF-khxVUFyTBnRKLYR3TeZ_0 2024-09-12T01:38:01.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.365+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.345174458770747573', time=2024-09-12T03:10:22.890307+0000, chain.objs.size()=1 2024-09-12T01:38:01.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.365+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.245__shadow_.5-l49QIEdrsTTZRsjeDxAAz5IXSOGvQ_0 2024-09-12T01:38:01.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.365+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.608963531636350239', time=2024-09-12T03:11:14.756630+0000, chain.objs.size()=1 2024-09-12T01:38:01.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.365+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.rSgf1feHKWPaQbdvecRgRrVHrHtnX6c_0 2024-09-12T01:38:01.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.365+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8799127491875031478', time=2024-09-12T03:11:14.757639+0000, chain.objs.size()=1 2024-09-12T01:38:01.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.365+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.vFBonSNkfwh7B-Pg58LbK6a0hcLwN-1_0 2024-09-12T01:38:01.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.365+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.878142469859226115', time=2024-09-12T03:11:15.166510+0000, chain.objs.size()=1 2024-09-12T01:38:01.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.365+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.0E-iGZvRAK42eNckjEoxwyKxGrbwx9C_0 2024-09-12T01:38:01.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.365+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14530442878566468468', time=2024-09-12T03:11:15.952072+0000, chain.objs.size()=1 2024-09-12T01:38:01.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.365+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.dr7pFWEKmrpebcC9TowvWSN4XgeCOxK_0 2024-09-12T01:38:01.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.365+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9915576968170535995', time=2024-09-12T03:11:16.012391+0000, chain.objs.size()=1 2024-09-12T01:38:01.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.365+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.5EPiTEvyZzymFF8L1Df5pAJQSfdndbY_0 2024-09-12T01:38:01.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.365+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15127969454154551231', time=2024-09-12T03:11:16.084965+0000, chain.objs.size()=1 2024-09-12T01:38:01.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.365+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Y73M3xlQ6elnG9u1o-AgVFNHs_rrcMY_0 2024-09-12T01:38:01.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.366+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15638049547148573967', time=2024-09-12T03:11:16.257442+0000, chain.objs.size()=1 2024-09-12T01:38:01.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.366+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.p7xiX-Np0fzYRsKlZMimCHVIY-EC4wL_0 2024-09-12T01:38:01.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.367+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18019390731911478213', time=2024-09-12T03:11:16.404409+0000, chain.objs.size()=1 2024-09-12T01:38:01.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.367+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.TgFHJhX_yVEBkNxmnVUibztcI01pIGl_0 2024-09-12T01:38:01.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.367+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7228552638189716935', time=2024-09-12T03:11:16.671908+0000, chain.objs.size()=1 2024-09-12T01:38:01.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.367+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.o0KQ936wja01lpUD9N0YPGmJkEsD8yy_0 2024-09-12T01:38:01.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.369+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6013665280203422415', time=2024-09-12T03:11:17.383795+0000, chain.objs.size()=1 2024-09-12T01:38:01.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.369+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Gfx3eHRC7ZzFAKHsy8BGEJy6ahMk3-Y_0 2024-09-12T01:38:01.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.369+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1691347575466392468', time=2024-09-12T03:11:17.736183+0000, chain.objs.size()=1 2024-09-12T01:38:01.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.369+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.N1dmxi8lUJvatSX44QJPettvgosf2wV_0 2024-09-12T01:38:01.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.369+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13210393651760569559', time=2024-09-12T03:11:17.848876+0000, chain.objs.size()=1 2024-09-12T01:38:01.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.369+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.msP83HCfVl-2EHzjj0tzisGckAzX_1j_0 2024-09-12T01:38:01.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.369+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14919813399177767809', time=2024-09-12T03:11:18.098625+0000, chain.objs.size()=1 2024-09-12T01:38:01.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.369+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.0aK4F-cMKn4yPojbz0Z_msXuYv1ZM1V_0 2024-09-12T01:38:01.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.369+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12183270386680791754', time=2024-09-12T03:11:18.135181+0000, chain.objs.size()=1 2024-09-12T01:38:01.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.369+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.X7EcTfjq2JW_msoiCEJYZEIemEjzldK_0 2024-09-12T01:38:01.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.369+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2333759103122893928', time=2024-09-12T03:11:18.157210+0000, chain.objs.size()=1 2024-09-12T01:38:01.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.369+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.77ht7CdW41hummtv-a_F1LJkf8qge6n_0 2024-09-12T01:38:01.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.369+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7398671439285475209', time=2024-09-12T03:11:18.926808+0000, chain.objs.size()=1 2024-09-12T01:38:01.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.369+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.a3YxuZyE8tA0wDfob7USxaIWrUCjlIB_0 2024-09-12T01:38:01.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.369+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8742911208568159722', time=2024-09-12T03:11:19.149696+0000, chain.objs.size()=1 2024-09-12T01:38:01.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.369+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.aTOzc_fOpNEyOk8hM1PhPxwlAw-MzOR_0 2024-09-12T01:38:01.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.369+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.231846852623151397', time=2024-09-12T03:11:19.236001+0000, chain.objs.size()=1 2024-09-12T01:38:01.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.369+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.CnM_s8XPVnVq7cBHsRATTt5NGYc-Vit_0 2024-09-12T01:38:01.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.369+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.40883132219011073', time=2024-09-12T03:11:19.279277+0000, chain.objs.size()=1 2024-09-12T01:38:01.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.369+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.DDcJbdC3mH_sUH8cElg9SMNoVi4hV08_0 2024-09-12T01:38:01.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.372+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17687552626767263409', time=2024-09-12T03:11:20.495946+0000, chain.objs.size()=1 2024-09-12T01:38:01.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.372+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.WeNkeSigdsc9UAQ3SY5-zIjamspiDRL_0 2024-09-12T01:38:01.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.375+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11016986190964964498', time=2024-09-12T03:11:20.882666+0000, chain.objs.size()=1 2024-09-12T01:38:01.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.375+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.umqtbEUhO3m1hOMelOpfQFSgPHrfGbY_0 2024-09-12T01:38:01.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.375+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5653247803086327022', time=2024-09-12T03:11:21.123545+0000, chain.objs.size()=1 2024-09-12T01:38:01.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.375+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.nQ1avcZI0ScWqw-5BSppDzKsNyyrdTc_0 2024-09-12T01:38:01.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.375+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3622315794133716120', time=2024-09-12T03:11:21.178839+0000, chain.objs.size()=1 2024-09-12T01:38:01.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.375+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.-kmIIBe6lYCyiZaYC2XTd05aH-EZJXA_0 2024-09-12T01:38:01.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.375+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1866249862953995801', time=2024-09-12T03:11:21.539533+0000, chain.objs.size()=1 2024-09-12T01:38:01.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.375+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.ctfFrtfakRaNT75yiSGC4ThuQenvTHz_0 2024-09-12T01:38:01.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.375+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1189991284300614883', time=2024-09-12T03:11:21.837915+0000, chain.objs.size()=1 2024-09-12T01:38:01.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.375+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.5AH09bn43nWpg5ynmINlHfz9ryCJ2cT_0 2024-09-12T01:38:01.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.375+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9652372958180898614', time=2024-09-12T03:11:21.838629+0000, chain.objs.size()=1 2024-09-12T01:38:01.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.375+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.ZpUxhChyfze55sDAM7vuSrUPm7z1qCs_0 2024-09-12T01:38:01.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.375+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7090886844614156886', time=2024-09-12T03:11:21.839342+0000, chain.objs.size()=1 2024-09-12T01:38:01.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.375+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.WAKOfGTrb4YKYhNNDSDpzOIHaWLW-1L_0 2024-09-12T01:38:01.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.375+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6212472138269987608', time=2024-09-12T03:11:22.237528+0000, chain.objs.size()=1 2024-09-12T01:38:01.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.375+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.ZuQeERj63w6-ad02izdONdKoI_29QmD_0 2024-09-12T01:38:01.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.375+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12046838922678172004', time=2024-09-12T03:11:22.528365+0000, chain.objs.size()=1 2024-09-12T01:38:01.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.375+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.UdpALiPCW9TeMjQA04esigBwMxO5PM__0 2024-09-12T01:38:01.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.375+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17493062401379013375', time=2024-09-12T03:11:23.042123+0000, chain.objs.size()=1 2024-09-12T01:38:01.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.375+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.o-84-IW7K2sN9Qwq_pNw2OxvJ9Iv8lE_0 2024-09-12T01:38:01.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.378+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8497134394538241396', time=2024-09-12T03:11:24.083702+0000, chain.objs.size()=1 2024-09-12T01:38:01.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.378+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.2eXWpV33jjPKj7jpuiPEh94y4GhAcTl_0 2024-09-12T01:38:01.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.378+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5202926943941754826', time=2024-09-12T03:11:24.152064+0000, chain.objs.size()=1 2024-09-12T01:38:01.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.378+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.ocvyHH6Jq0ORgs5opGuqRCEtQT_HrZl_0 2024-09-12T01:38:01.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.381+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1516239493010344533', time=2024-09-12T03:11:26.816717+0000, chain.objs.size()=1 2024-09-12T01:38:01.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.381+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.264__shadow_._izljufyesVTF0ydbvERtb4yCBpxkX1_0 2024-09-12T01:38:01.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.381+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9032047989497227902', time=2024-09-12T03:11:28.677613+0000, chain.objs.size()=1 2024-09-12T01:38:01.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.381+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.266__shadow_.R6N5WDljgyqOFbsVW4pqA9tx3g9FEvh_0 2024-09-12T01:38:01.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.381+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15495061897407586765', time=2024-09-12T03:11:37.123770+0000, chain.objs.size()=1 2024-09-12T01:38:01.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.381+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.275__shadow_.5GSIIax1LuS4r-cOjLxlHwoEFzq3CKl_0 2024-09-12T01:38:01.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.381+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4891604329388897807', time=2024-09-12T03:11:47.955922+0000, chain.objs.size()=1 2024-09-12T01:38:01.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.381+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.286__shadow_.yhpsRxwpEHsoePBihsqaz72a_ECGwIz_0 2024-09-12T01:38:01.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.381+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14873922343147068194', time=2024-09-12T03:11:57.585328+0000, chain.objs.size()=1 2024-09-12T01:38:01.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.381+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.293__shadow_.-Uq-3gvqGf4prAXZUmSirQYg-JPWjpr_0 2024-09-12T01:38:01.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.381+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.105759769453260901', time=2024-09-12T03:11:57.603312+0000, chain.objs.size()=1 2024-09-12T01:38:01.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.381+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.293__shadow_.PjVtJcHcN5BfBic3efbwXsp0y7_RCwv_0 2024-09-12T01:38:01.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.381+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1241556856873666470', time=2024-09-12T03:12:05.624343+0000, chain.objs.size()=1 2024-09-12T01:38:01.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.381+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.301__shadow_.9Tzc7Gw26oAAU6sVrvECpmBu7jaO2KN_0 2024-09-12T01:38:01.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.381+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14055722804326059045', time=2024-09-12T03:13:07.205851+0000, chain.objs.size()=1 2024-09-12T01:38:01.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.381+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.bJKaxAFeC8U086Ds6zkDaCqSix_Bh9M_0 2024-09-12T01:38:01.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.381+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16918793601445905249', time=2024-09-12T03:13:07.612346+0000, chain.objs.size()=1 2024-09-12T01:38:01.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.381+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.qdN8YlKw_nitLA-oLy_JwL1Rcu6uMod_0 2024-09-12T01:38:01.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.381+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6207578126472344804', time=2024-09-12T03:13:08.306444+0000, chain.objs.size()=1 2024-09-12T01:38:01.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.381+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.T7M1WWj3Eg4wHbfKDN9Vbcg-mdUirMK_0 2024-09-12T01:38:01.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.381+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10122369094069541021', time=2024-09-12T03:13:08.488429+0000, chain.objs.size()=1 2024-09-12T01:38:01.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.381+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.XuvVF8Z_aVVeUvjkIT1R1WHRTa306oB_0 2024-09-12T01:38:01.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.382+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3081035607661338914', time=2024-09-12T03:13:09.050540+0000, chain.objs.size()=1 2024-09-12T01:38:01.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.382+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.7KyXBCGIsGinHVWn0vP2ZdsoaFR7XLs_0 2024-09-12T01:38:01.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.382+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6680223698095018155', time=2024-09-12T03:13:09.719629+0000, chain.objs.size()=1 2024-09-12T01:38:01.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.382+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.ylLXOhaz6BSjlQHWcZZ6-LJFOjrMTm6_0 2024-09-12T01:38:01.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.386+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2879521080099429', time=2024-09-12T03:13:09.755447+0000, chain.objs.size()=1 2024-09-12T01:38:01.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.386+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.L2Tbg4qkUVjVokX1nyJKDvJVfaQxS0C_0 2024-09-12T01:38:01.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.386+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2135166428161509143', time=2024-09-12T03:13:10.041780+0000, chain.objs.size()=1 2024-09-12T01:38:01.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.386+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.SotJHnmL9DLGYPbdAhFtHykKgpKqg2C_0 2024-09-12T01:38:01.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.386+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.938673629189042476', time=2024-09-12T03:13:10.120460+0000, chain.objs.size()=1 2024-09-12T01:38:01.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.386+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.B6szgqnaJ8lRMnsP6fTyzUdp73OTpBM_0 2024-09-12T01:38:01.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.386+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9128842910933863055', time=2024-09-12T03:13:10.142884+0000, chain.objs.size()=1 2024-09-12T01:38:01.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.386+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.DQQ7n8CPr9a9SnKJBnXSpSZ7HOheiuj_0 2024-09-12T01:38:01.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.386+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8142910209942963703', time=2024-09-12T03:13:10.273513+0000, chain.objs.size()=1 2024-09-12T01:38:01.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.386+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.CzQKQH--ZsnEl16_yjxLiJFeL7Eh9BI_0 2024-09-12T01:38:01.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.386+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15404664399148346033', time=2024-09-12T03:13:11.509895+0000, chain.objs.size()=1 2024-09-12T01:38:01.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.386+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.c5EzDiHcP4ApaCTNp5IBQ2V5G6_zUrv_0 2024-09-12T01:38:01.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.387+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10751806167023383337', time=2024-09-12T03:13:11.697696+0000, chain.objs.size()=1 2024-09-12T01:38:01.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.387+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.BvChPIk9T-byVvdygTPgV2nAZnV7jYy_0 2024-09-12T01:38:01.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.387+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15984226841385929798', time=2024-09-12T03:13:11.873194+0000, chain.objs.size()=1 2024-09-12T01:38:01.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.387+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.GoUqb3JbhuTVwVIiWOTHQM9sz46Z_Yc_0 2024-09-12T01:38:01.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.387+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14881851868310215894', time=2024-09-12T03:13:13.097899+0000, chain.objs.size()=1 2024-09-12T01:38:01.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.387+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.pW_j-1PXE1QaPOeJLoGBqjRroPIoAzn_0 2024-09-12T01:38:01.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.387+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5114661224284832129', time=2024-09-12T03:13:13.417235+0000, chain.objs.size()=1 2024-09-12T01:38:01.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.387+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.7lc7vK51HvxhPOmg1c2Vw54NTcPHCeL_0 2024-09-12T01:38:01.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.387+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5169613714312531620', time=2024-09-12T03:13:13.470783+0000, chain.objs.size()=1 2024-09-12T01:38:01.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.387+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.Cm1fsfLHEAGOB4cT-V7xRFzzIE2qvTc_0 2024-09-12T01:38:01.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.388+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17602351285029417575', time=2024-09-12T03:13:14.063386+0000, chain.objs.size()=1 2024-09-12T01:38:01.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.388+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.yVY6qBc9Oroa8V4smqOXxDjR4BBhfvd_0 2024-09-12T01:38:01.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.392+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.682954508688743245', time=2024-09-12T03:13:14.184856+0000, chain.objs.size()=1 2024-09-12T01:38:01.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.392+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.jtZwvcisx1nuFR3O2FaueP4XVEoPfPm_0 2024-09-12T01:38:01.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.392+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12451882094871480863', time=2024-09-12T03:13:14.641320+0000, chain.objs.size()=1 2024-09-12T01:38:01.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.392+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.oLlYwojhXGSag8wvQ1W28mNtYOB-vVr_0 2024-09-12T01:38:01.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.392+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17873291031888841195', time=2024-09-12T03:13:15.335351+0000, chain.objs.size()=1 2024-09-12T01:38:01.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.392+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.7w993TzkYpCfQuRokI_4drntBMHKuLB_0 2024-09-12T01:38:01.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.392+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5334326610370133227', time=2024-09-12T03:13:15.453544+0000, chain.objs.size()=1 2024-09-12T01:38:01.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.392+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.KE515sdRTp9ZOwjry2JhgzbYdujCFGn_0 2024-09-12T01:38:01.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.392+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16336823742480342734', time=2024-09-12T03:13:16.937698+0000, chain.objs.size()=1 2024-09-12T01:38:01.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.392+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.AB9NiDD0zkC0hFoFqth90MUYEm_o4cR_0 2024-09-12T01:38:01.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.392+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6466368273553140192', time=2024-09-12T03:13:17.100204+0000, chain.objs.size()=1 2024-09-12T01:38:01.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.392+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.4juJDcaBST8BbcrTyrOcocahr9NVIW6_0 2024-09-12T01:38:01.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.392+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16821488844074190207', time=2024-09-12T03:13:53.642511+0000, chain.objs.size()=1 2024-09-12T01:38:01.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.392+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.3jdT-T7A6Nv7iTDFPoMH3h6ofKrImii_0 2024-09-12T01:38:01.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.392+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18142396819803769726', time=2024-09-12T03:13:53.967421+0000, chain.objs.size()=1 2024-09-12T01:38:01.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.392+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.vyj45ySyfAF76FK20mNAzN6aTBOoOdn_0 2024-09-12T01:38:01.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.392+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2895719605141397575', time=2024-09-12T03:13:54.065802+0000, chain.objs.size()=1 2024-09-12T01:38:01.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.392+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.VF2H3RdYIB-KWRzr2mA8J2M2PLAmq1t_0 2024-09-12T01:38:01.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.392+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13801939337654173105', time=2024-09-12T03:13:55.240105+0000, chain.objs.size()=1 2024-09-12T01:38:01.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.392+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Ef9l7wrsHwnivujqulnqVzHImkokNoU_0 2024-09-12T01:38:01.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.392+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6465947479429343042', time=2024-09-12T03:13:55.626246+0000, chain.objs.size()=1 2024-09-12T01:38:01.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.392+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.WiCNoyfCoiDambNG9vLQ6tIqq3ngzbJ_0 2024-09-12T01:38:01.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.394+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14330197186606290627', time=2024-09-12T03:13:55.800213+0000, chain.objs.size()=1 2024-09-12T01:38:01.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.394+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.nP5yCbj2W3iKEUxYdS2bYv54MiVfPn7_0 2024-09-12T01:38:01.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.394+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7554367715385546950', time=2024-09-12T03:13:55.800939+0000, chain.objs.size()=1 2024-09-12T01:38:01.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.394+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.FvTA9jUL40ntPUiUihBZ-CLb_ozOqEU_0 2024-09-12T01:38:01.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.395+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7893153375340736156', time=2024-09-12T03:13:55.933368+0000, chain.objs.size()=1 2024-09-12T01:38:01.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.395+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.opQH_b6N_8r_77V4DjZULFV-32DZXp0_0 2024-09-12T01:38:01.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.398+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14504892622555260094', time=2024-09-12T03:13:56.065264+0000, chain.objs.size()=1 2024-09-12T01:38:01.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.398+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.kKyZWHxs_WGGBSQnDUb6flsTH0SngSy_0 2024-09-12T01:38:01.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.398+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12106086374957132237', time=2024-09-12T03:13:56.484220+0000, chain.objs.size()=1 2024-09-12T01:38:01.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.398+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.-tQ42-xgAPmxkOdQekYwqK65H7uteJP_0 2024-09-12T01:38:01.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.398+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4222555996391887256', time=2024-09-12T03:13:56.485009+0000, chain.objs.size()=1 2024-09-12T01:38:01.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.398+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.mZxb2eoKKflB4Vnn9DelmK9tLUG1Vta_0 2024-09-12T01:38:01.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.398+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6733725800676684664', time=2024-09-12T03:13:56.756346+0000, chain.objs.size()=1 2024-09-12T01:38:01.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.398+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.tprh-MB5XEMr0xRqBjaauL7esakaWLx_0 2024-09-12T01:38:01.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.398+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18157088291313739038', time=2024-09-12T03:13:57.034540+0000, chain.objs.size()=1 2024-09-12T01:38:01.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.398+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Ump-KUPoNQIyvlvrALlVG-tl1MKKtVt_0 2024-09-12T01:38:01.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.398+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12651026361766736863', time=2024-09-12T03:13:57.315406+0000, chain.objs.size()=1 2024-09-12T01:38:01.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.398+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.QBzCQoLKpGJHv_b6msAhKpte0ghXzWN_0 2024-09-12T01:38:01.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.398+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1808268604859714287', time=2024-09-12T03:13:57.373682+0000, chain.objs.size()=1 2024-09-12T01:38:01.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.398+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.HBp90v7tJ6xDoCMX0k-ztnKACM4vJYo_0 2024-09-12T01:38:01.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.398+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16424368664347684634', time=2024-09-12T03:13:58.008809+0000, chain.objs.size()=1 2024-09-12T01:38:01.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.398+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.6gC0gS2l6z2MhaLcw5rYNJeonBIDGGc_0 2024-09-12T01:38:01.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.398+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10144875416365968286', time=2024-09-12T03:13:59.187292+0000, chain.objs.size()=1 2024-09-12T01:38:01.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.398+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.u6V9UqkDEZEhThvTsAyD3sGb--raPlo_0 2024-09-12T01:38:01.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.398+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12028313007504135500', time=2024-09-12T03:13:59.194022+0000, chain.objs.size()=1 2024-09-12T01:38:01.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.398+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.fTXFCA91I2lW6Kv2_qysRpalrtrrg-w_0 2024-09-12T01:38:01.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.398+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.404267245919582293', time=2024-09-12T03:13:59.506508+0000, chain.objs.size()=1 2024-09-12T01:38:01.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.398+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.DQRd4ummwKq-YavAXJeSdjnau2xd4WB_0 2024-09-12T01:38:01.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.400+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17868713192287892675', time=2024-09-12T03:13:59.507335+0000, chain.objs.size()=1 2024-09-12T01:38:01.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.400+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.yvCe0gkwVgTeivk9ZTT1j9FI0xSKOdK_0 2024-09-12T01:38:01.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.401+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8232309595089109130', time=2024-09-12T03:13:59.950851+0000, chain.objs.size()=1 2024-09-12T01:38:01.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.401+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.VVp7Gj8X9vHYetkbBj0dmLVq18nLaor_0 2024-09-12T01:38:01.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.401+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14190525520232488286', time=2024-09-12T03:14:00.095025+0000, chain.objs.size()=1 2024-09-12T01:38:01.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.401+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.-JFPhFNseKORZJeCv48N5tsYt1D7I8B_0 2024-09-12T01:38:01.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.401+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9830973885698939131', time=2024-09-12T03:14:00.109649+0000, chain.objs.size()=1 2024-09-12T01:38:01.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.401+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.92O6p6T98tcLDkvV4LjCqWVwgfdo4E4_0 2024-09-12T01:38:01.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.401+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3599736875584475190', time=2024-09-12T03:14:00.449685+0000, chain.objs.size()=1 2024-09-12T01:38:01.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.401+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.KQKA1wLk2FfVHuXwo1ge87RIp72fo9Q_0 2024-09-12T01:38:01.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.401+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1536037997625408790', time=2024-09-12T03:14:00.456449+0000, chain.objs.size()=1 2024-09-12T01:38:01.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.401+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.0u-x6wGxqmECFnTT0KQZ_lzxPamWOTD_0 2024-09-12T01:38:01.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.401+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6159945119006575238', time=2024-09-12T03:14:01.124662+0000, chain.objs.size()=1 2024-09-12T01:38:01.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.401+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.-qY2zIF6WZQzuoPHPge7sku7BqV03wr_0 2024-09-12T01:38:01.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.401+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18327374958224924222', time=2024-09-12T03:14:02.567978+0000, chain.objs.size()=1 2024-09-12T01:38:01.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.401+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.U9FAE6gzFj-seDaLVq8x3df3U4byHnt_0 2024-09-12T01:38:01.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.403+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15619199769578704180', time=2024-09-12T03:14:02.889336+0000, chain.objs.size()=1 2024-09-12T01:38:01.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.403+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.j0z8GvM6dKQdiAPFdIJ1v4lUKETQthA_0 2024-09-12T01:38:01.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.403+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9275504233865020864', time=2024-09-12T03:14:11.780663+0000, chain.objs.size()=1 2024-09-12T01:38:01.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.403+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.333__shadow_.DHyN4UZpHB2F01hgmxCxlXum6Ta_uqH_0 2024-09-12T01:38:01.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.403+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13617272681288740347', time=2024-09-12T03:15:03.852344+0000, chain.objs.size()=1 2024-09-12T01:38:01.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.403+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.390__shadow_.BEQuR6gK43oS6bNPwZpNGih7de4hVd0_0 2024-09-12T01:38:01.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.403+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11633700302994215306', time=2024-09-12T03:16:20.249977+0000, chain.objs.size()=1 2024-09-12T01:38:01.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.403+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.464__shadow_.pIhlCIgEAfZZ6-r49kpmXaWqBfOnfhT_0 2024-09-12T01:38:01.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.409+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 0/48167 2024-09-12T01:38:01.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.412+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T01:38:01.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.412+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6078848221869784992', time=2024-09-12T03:16:21.940615+0000, chain.objs.size()=1 2024-09-12T01:38:01.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.412+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.465__shadow_.LlseO6yH3U31LgEAq1pRRB6kjOKZh94_0 2024-09-12T01:38:01.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.412+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='2~Ktf5mKcD_Oo_Pba39zv3fRhNmov8E2I', time=2024-09-12T03:18:41.978829+0000, chain.objs.size()=1 2024-09-12T01:38:01.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.412+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.522__multipart_mymultipart.2~Ktf5mKcD_Oo_Pba39zv3fRhNmov8E2I.1 2024-09-12T01:38:01.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.412+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='2~4WjXOANFZiABAM1-GiRAiDQR4yKaHVo', time=2024-09-12T03:19:01.629335+0000, chain.objs.size()=1 2024-09-12T01:38:01.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.412+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.522__multipart_mymultipart.2~4WjXOANFZiABAM1-GiRAiDQR4yKaHVo.2 2024-09-12T01:38:01.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.412+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='2~9A79sgjjDwaFNtN6qi6A62kBxTwvRix', time=2024-09-12T03:21:28.444518+0000, chain.objs.size()=1 2024-09-12T01:38:01.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.412+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.535__multipart_mymultipart.2~9A79sgjjDwaFNtN6qi6A62kBxTwvRix.3 2024-09-12T01:38:01.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.412+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.86878326989194823', time=2024-09-12T03:22:12.538120+0000, chain.objs.size()=1 2024-09-12T01:38:01.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.412+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.550__shadow_.WBfybkAhXglkOB2_dHg3-3MWgHSQ_44_0 2024-09-12T01:38:01.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.412+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2800484606558917928', time=2024-09-12T03:23:03.304532+0000, chain.objs.size()=1 2024-09-12T01:38:01.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.412+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.564__shadow_.6eLNrSiqfEQ6fPMc1YbncNJ1zFzBVh0_0 2024-09-12T01:38:01.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.412+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.452300006299693709', time=2024-09-12T03:23:26.991978+0000, chain.objs.size()=1 2024-09-12T01:38:01.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.412+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.574__shadow:AiyosfgP51u9inflvdmT6W42NbghGWs_.l1JaR9YFDVmN5yCXXCQvH5GloV1VWfZ_0 2024-09-12T01:38:01.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.412+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1646123324768884324', time=2024-09-12T03:23:42.062320+0000, chain.objs.size()=1 2024-09-12T01:38:01.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.412+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.577__shadow:Sy1LEErt64Q0HqXXaTQKUWbl1TWuuFf_.29zTHzGMpqmXSWQxcSgbAKBK_mB4YGp_0 2024-09-12T01:38:01.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.412+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8595545737418433226', time=2024-09-12T03:23:48.099817+0000, chain.objs.size()=1 2024-09-12T01:38:01.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.412+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.577__shadow:zOcF4F6S4MieHHFauQbFKCcBkvDXJ5T_.jGOzB7sHJ1lbQOPJX2-s9lPXIKLdQH9_0 2024-09-12T01:38:01.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.412+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2930534261859937020', time=2024-09-12T03:24:47.839263+0000, chain.objs.size()=1 2024-09-12T01:38:01.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.412+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.587__shadow:K5LD935J.rFd9zKNUggRflHa2mFl1U1_.XzF4OAvFPAaVGFEQiLSK69FUxo9ySgL_0 2024-09-12T01:38:01.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.412+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4108938619418149172', time=2024-09-12T03:30:57.715667+0000, chain.objs.size()=1 2024-09-12T01:38:01.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.412+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.663__shadow_.ZIi13_wnehzq42_1ZJVPyDUcsB61FMr_0 2024-09-12T01:38:01.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.412+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16694327224692566689', time=2024-09-12T03:32:39.812865+0000, chain.objs.size()=1 2024-09-12T01:38:01.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.412+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.740__shadow_.tf0ZUO7Abm1A1OUTAVmewZyBF8zrBzB_0 2024-09-12T01:38:01.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.417+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:38:01.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.422+0000 7f8786c98800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T01:38:01.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.424+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:38:01.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.424+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:38:01.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.425+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45737' 2024-09-12T01:38:01.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.425+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='_TqXO9F0-3crKpUtsIPnMGSovDBl2drD', time=2024-09-12T03:07:08.986004+0000, chain.objs.size()=2 2024-09-12T01:38:01.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.425+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.161__shadow_.097_id_NABq4BR845ucLecEc9K_BvnJ_0 2024-09-12T01:38:01.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.425+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.161__shadow_.097_id_NABq4BR845ucLecEc9K_BvnJ_1 2024-09-12T01:38:01.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.425+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10484330301887359494', time=2024-09-12T03:10:06.803267+0000, chain.objs.size()=1 2024-09-12T01:38:01.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.425+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.231__shadow_.WPfndYrpBVOZqCuM0dVWNaV-o79E2va_0 2024-09-12T01:38:01.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.425+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15853308603756639002', time=2024-09-12T03:10:08.729276+0000, chain.objs.size()=1 2024-09-12T01:38:01.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.425+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.233__shadow_.qda-tCSG1uXyDNoC-xmzJeRrVfGwXjb_0 2024-09-12T01:38:01.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.425+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1330525558656445488', time=2024-09-12T03:11:14.519921+0000, chain.objs.size()=1 2024-09-12T01:38:01.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.425+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.qxiNz_lF3ALTXS7Pt_UazdGHDv_Ti9U_0 2024-09-12T01:38:01.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.425+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12041409311382514670', time=2024-09-12T03:11:14.672967+0000, chain.objs.size()=1 2024-09-12T01:38:01.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.425+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.x27GdlHLZqvnzHdUEqtCcxbDqCopKKg_0 2024-09-12T01:38:01.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.425+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2268245991851850801', time=2024-09-12T03:11:15.139981+0000, chain.objs.size()=1 2024-09-12T01:38:01.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.425+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.81b74BBuhjBkaSusPd2vYTZhKufrPmt_0 2024-09-12T01:38:01.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.425+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14775874971528653522', time=2024-09-12T03:11:15.169967+0000, chain.objs.size()=1 2024-09-12T01:38:01.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.425+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.cT7vu5HCaarD4P2P8Sw-2cA4aCREwvG_0 2024-09-12T01:38:01.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.425+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3729486095572085970', time=2024-09-12T03:11:16.257134+0000, chain.objs.size()=1 2024-09-12T01:38:01.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.425+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.McefS2xOduFFvyB7lctVeAOVdHmyeNg_0 2024-09-12T01:38:01.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.425+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17418452643546042531', time=2024-09-12T03:11:16.299578+0000, chain.objs.size()=1 2024-09-12T01:38:01.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.425+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.F-p1MrOaJnvgv1vAUFdzFh8e8e-Iof7_0 2024-09-12T01:38:01.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.425+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9467577241333224656', time=2024-09-12T03:11:16.498115+0000, chain.objs.size()=1 2024-09-12T01:38:01.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.425+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.38Qhuv7asRxs3xGtwYGicDRtUTh5Ucc_0 2024-09-12T01:38:01.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.425+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.232234171509887183', time=2024-09-12T03:11:16.526598+0000, chain.objs.size()=1 2024-09-12T01:38:01.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.425+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_._Sp5u8EJalliMo23dQLtAmjzWLVyMPg_0 2024-09-12T01:38:01.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.432+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15197034702975111076', time=2024-09-12T03:11:16.728189+0000, chain.objs.size()=1 2024-09-12T01:38:01.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.432+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.iawC6J-Du0TLh1sNV-uBtN2v5uBc2lj_0 2024-09-12T01:38:01.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.432+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3314392090825537010', time=2024-09-12T03:11:16.842802+0000, chain.objs.size()=1 2024-09-12T01:38:01.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.432+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.xSH_EBuD25UhyUapzyERNKWv9agh9T4_0 2024-09-12T01:38:01.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.432+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2112147121694337891', time=2024-09-12T03:11:17.881866+0000, chain.objs.size()=1 2024-09-12T01:38:01.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.432+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.AKz0gD5CR3Fl_LTyZ7Je_HD1Bglwpep_0 2024-09-12T01:38:01.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.432+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8019471364201851377', time=2024-09-12T03:11:18.033954+0000, chain.objs.size()=1 2024-09-12T01:38:01.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.432+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.VA0UkiGTROJ9QL7SOamHFieJ2TsmDwN_0 2024-09-12T01:38:01.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.432+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.46764068652422664', time=2024-09-12T03:11:18.935681+0000, chain.objs.size()=1 2024-09-12T01:38:01.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.432+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.XpuWVpkvJKABXJonvPOvMlJ72Cvky2W_0 2024-09-12T01:38:01.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.432+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15498526483511135126', time=2024-09-12T03:11:19.082940+0000, chain.objs.size()=1 2024-09-12T01:38:01.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.432+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.iHRBK0FKU2hzdNCo7pHZCzDkReL7lPB_0 2024-09-12T01:38:01.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.432+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15763505782732874830', time=2024-09-12T03:11:19.692717+0000, chain.objs.size()=1 2024-09-12T01:38:01.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.432+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.gAyj_he89L-wfueB0yBaleE4EZNWJlS_0 2024-09-12T01:38:01.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.432+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6068789604627385960', time=2024-09-12T03:11:20.208914+0000, chain.objs.size()=1 2024-09-12T01:38:01.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.432+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.G3iuQ3g0-o1Cr76xuQQTOqk7o-X6DVS_0 2024-09-12T01:38:01.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.432+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17162214130733647561', time=2024-09-12T03:11:20.318889+0000, chain.objs.size()=1 2024-09-12T01:38:01.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.432+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.AgdPAm94D-4VQO7FFpmgjh0AinmY-ls_0 2024-09-12T01:38:01.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.432+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5526546768864394291', time=2024-09-12T03:11:20.429706+0000, chain.objs.size()=1 2024-09-12T01:38:01.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.432+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.ZrTi5J5PcK46YI60Pkp5AXFdy5sqBGu_0 2024-09-12T01:38:01.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.432+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8587064897348955942', time=2024-09-12T03:11:20.430432+0000, chain.objs.size()=1 2024-09-12T01:38:01.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.432+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.f0m4D05KXr0YJXqz-_nYWwBu3pEWAnl_0 2024-09-12T01:38:01.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.434+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8232980154253092445', time=2024-09-12T03:11:20.494085+0000, chain.objs.size()=1 2024-09-12T01:38:01.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.434+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.__ytgKN7KALMY9Rndrlwd_IyYRWas-k_0 2024-09-12T01:38:01.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.437+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13652647878575555464', time=2024-09-12T03:11:20.773254+0000, chain.objs.size()=1 2024-09-12T01:38:01.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.437+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.kkU2oGNP6smiJPQ7tPF9uaEQT59c4Fw_0 2024-09-12T01:38:01.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.437+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3078949843551244116', time=2024-09-12T03:11:20.933758+0000, chain.objs.size()=1 2024-09-12T01:38:01.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.437+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.O-QYxWNoKmH2wmuVhZhRn3kzRVSemNo_0 2024-09-12T01:38:01.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.437+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3856192500692668460', time=2024-09-12T03:11:21.836435+0000, chain.objs.size()=1 2024-09-12T01:38:01.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.437+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.EJV4kO87ugbfZmBLzRcLNfJtackAamE_0 2024-09-12T01:38:01.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.437+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9288395438565119010', time=2024-09-12T03:11:22.277990+0000, chain.objs.size()=1 2024-09-12T01:38:01.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.437+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.XkOnhWAY7dgsiR1ayhLz0ygjdo8Qzgh_0 2024-09-12T01:38:01.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.437+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2641598315173250206', time=2024-09-12T03:11:22.278645+0000, chain.objs.size()=1 2024-09-12T01:38:01.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.437+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Jd6ZW1-rif-j6iiaZFNxGyismwQB7Ju_0 2024-09-12T01:38:01.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.437+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3837491229221624982', time=2024-09-12T03:11:23.186444+0000, chain.objs.size()=1 2024-09-12T01:38:01.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.437+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Dqc8xWHaZ_eHjFkpmjxcEtyAfcbAUKl_0 2024-09-12T01:38:01.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.437+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11560114308019767205', time=2024-09-12T03:11:23.590960+0000, chain.objs.size()=1 2024-09-12T01:38:01.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.437+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.rST9NNIJGhxY75aBip9nW93sJN5yQN9_0 2024-09-12T01:38:01.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.437+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11494707356286117680', time=2024-09-12T03:11:23.656012+0000, chain.objs.size()=1 2024-09-12T01:38:01.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.437+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.4MVSMvifuxaXtdnN-Ke5V1o645p7kKe_0 2024-09-12T01:38:01.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.437+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10535494012700607579', time=2024-09-12T03:11:23.770041+0000, chain.objs.size()=1 2024-09-12T01:38:01.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.437+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.xPxDH-gREFQZVuid830aKO-iIznFAq8_0 2024-09-12T01:38:01.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.437+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11434661008068585593', time=2024-09-12T03:11:23.823197+0000, chain.objs.size()=1 2024-09-12T01:38:01.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.437+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.8fj_Ny71V5RKlSyaQmZCvoG1QulymQQ_0 2024-09-12T01:38:01.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.437+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2228431653428361428', time=2024-09-12T03:11:29.599255+0000, chain.objs.size()=1 2024-09-12T01:38:01.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.437+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.267__shadow_.T-PZB3aM8IAXmqkNxVa7hRCsrLdIqDh_0 2024-09-12T01:38:01.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.440+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11352119624817024015', time=2024-09-12T03:11:42.960415+0000, chain.objs.size()=1 2024-09-12T01:38:01.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.440+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.281__shadow_.2Iebz6NBGTzyJMQyutPruvvXOUo14I2_0 2024-09-12T01:38:01.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.443+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3618971485235556189', time=2024-09-12T03:11:48.928212+0000, chain.objs.size()=1 2024-09-12T01:38:01.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.443+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.287__shadow_.z0IgvFfSq6365QrA1K8mJjaoy0WCtl1_0 2024-09-12T01:38:01.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.443+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12820927923864186916', time=2024-09-12T03:11:57.509714+0000, chain.objs.size()=1 2024-09-12T01:38:01.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.443+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.293__shadow_.l351c6ZZNOcBLmHmhXTp320p36qiwxD_0 2024-09-12T01:38:01.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.443+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5346056300795150945', time=2024-09-12T03:11:57.586294+0000, chain.objs.size()=1 2024-09-12T01:38:01.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.443+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.293__shadow_.ns5FxIb8LFAsvxqTppSOmZnXtkf2TGe_0 2024-09-12T01:38:01.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.443+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7817253560298052857', time=2024-09-12T03:11:58.572630+0000, chain.objs.size()=1 2024-09-12T01:38:01.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.443+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.294__shadow_.lHh01Z5CCrfZCHdeVIdHb0v9S_fRzXW_0 2024-09-12T01:38:01.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.443+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14595227609223814449', time=2024-09-12T03:12:06.628071+0000, chain.objs.size()=1 2024-09-12T01:38:01.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.443+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.302__shadow_.P7rJP5-kQY6ieMUp74EpTD2M6wXB7wB_0 2024-09-12T01:38:01.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.443+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11329671394555350853', time=2024-09-12T03:12:30.049718+0000, chain.objs.size()=1 2024-09-12T01:38:01.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.443+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.322__shadow_.L1ylIwqLCqUSoeQa7caUvh9NSzmyudZ_0 2024-09-12T01:38:01.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.443+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6036793282406022262', time=2024-09-12T03:13:06.833213+0000, chain.objs.size()=1 2024-09-12T01:38:01.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.443+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.QJljgAZdSE565Ty6b-14Wwjsn46-neF_0 2024-09-12T01:38:01.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.443+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13469399850271956271', time=2024-09-12T03:13:07.131087+0000, chain.objs.size()=1 2024-09-12T01:38:01.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.443+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.Uw95K-f6K6i2fHldLYLJtUdsq9bPSEC_0 2024-09-12T01:38:01.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.443+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13497092905857807476', time=2024-09-12T03:13:07.245844+0000, chain.objs.size()=1 2024-09-12T01:38:01.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.443+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.oRiGe1JYhOdIZcGDp0jPA5YrsaMoHcJ_0 2024-09-12T01:38:01.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.443+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8096304055588868747', time=2024-09-12T03:13:07.356515+0000, chain.objs.size()=1 2024-09-12T01:38:01.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.443+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.NS9lV1HN8M4eW1fqVUOOiAP4fwix3bU_0 2024-09-12T01:38:01.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.443+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8275347486312768985', time=2024-09-12T03:13:07.444249+0000, chain.objs.size()=1 2024-09-12T01:38:01.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.443+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.8j7anwBeGGMSTosPEUAvUqW4y_QQby5_0 2024-09-12T01:38:01.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.448+0000 7f8784f8a640 0 -- 172.21.15.73:0/3328777400 >> [v2:172.21.15.73:6800/2864081714,v1:172.21.15.73:6801/2864081714] conn(0x55e6269eee60 msgr2=0x7f864c093140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:38:01.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.448+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1725701522470214852', time=2024-09-12T03:13:07.606557+0000, chain.objs.size()=1 2024-09-12T01:38:01.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.448+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.D6N5xuRq0U5JEIMVtgesP4oRk488Xhd_0 2024-09-12T01:38:01.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.448+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4839216040802249690', time=2024-09-12T03:13:07.705046+0000, chain.objs.size()=1 2024-09-12T01:38:01.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.448+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.r9KpBIAoyqG7NsnJlzAQjVyFTk5W-f9_0 2024-09-12T01:38:01.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.448+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13496248540892144253', time=2024-09-12T03:13:07.745676+0000, chain.objs.size()=1 2024-09-12T01:38:01.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.448+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.i-2cPvkvjirReZ8fR_ZEnsiJIrvySPt_0 2024-09-12T01:38:01.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.449+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17464685796398921852', time=2024-09-12T03:13:08.606650+0000, chain.objs.size()=1 2024-09-12T01:38:01.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.449+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.Iwli9dRdRBrfby-MQH0bMI6uasocWkp_0 2024-09-12T01:38:01.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.449+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13402414483557767263', time=2024-09-12T03:13:08.607309+0000, chain.objs.size()=1 2024-09-12T01:38:01.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.449+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.dLKfGe-OHtfsdjUl4iG212ePsQa1Akg_0 2024-09-12T01:38:01.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.449+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13692811102070156476', time=2024-09-12T03:13:09.053130+0000, chain.objs.size()=1 2024-09-12T01:38:01.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.449+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.Y76lDYMuaaFKPTMtXI5nt7XYDgJPxpZ_0 2024-09-12T01:38:01.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.449+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9943251205209917561', time=2024-09-12T03:13:09.747112+0000, chain.objs.size()=1 2024-09-12T01:38:01.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.449+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.p2TTeUvw0_-zEQ95tHDr8U6i4y74hz2_0 2024-09-12T01:38:01.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.449+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.289680315441256545', time=2024-09-12T03:13:10.111356+0000, chain.objs.size()=1 2024-09-12T01:38:01.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.449+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.pvhfs01QVwOeBNy_9wk6_HXASJVHHh0_0 2024-09-12T01:38:01.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.449+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8815587571743177024', time=2024-09-12T03:13:10.240077+0000, chain.objs.size()=1 2024-09-12T01:38:01.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.449+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.90RUGN9--S9V7l0P88bNieaqeUgp_F3_0 2024-09-12T01:38:01.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.449+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12140759507100818076', time=2024-09-12T03:13:10.611705+0000, chain.objs.size()=1 2024-09-12T01:38:01.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.449+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.MW6mVWrMNTnpzZbjaokHAj9GqDXig4v_0 2024-09-12T01:38:01.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.449+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3361045346307067615', time=2024-09-12T03:13:11.252842+0000, chain.objs.size()=1 2024-09-12T01:38:01.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.449+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.MVck-Yr4ciVQBgJ0HJyx9sN_VHzwatn_0 2024-09-12T01:38:01.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.450+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6756947232034009535', time=2024-09-12T03:13:11.322685+0000, chain.objs.size()=1 2024-09-12T01:38:01.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.450+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.s0g6BmHgwHK19pTlb78JoeHg0JBPU13_0 2024-09-12T01:38:01.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.451+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15121650073291136089', time=2024-09-12T03:13:11.415331+0000, chain.objs.size()=1 2024-09-12T01:38:01.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.451+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.V846WNF7WT_kUzYu7eOcfZCWKSm2tZb_0 2024-09-12T01:38:01.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.451+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11453109735633856724', time=2024-09-12T03:13:11.695863+0000, chain.objs.size()=1 2024-09-12T01:38:01.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.451+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.6R4wET6OtLFskdArqpRFmysum9yY9Ka_0 2024-09-12T01:38:01.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.451+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8389577832930859089', time=2024-09-12T03:13:11.877654+0000, chain.objs.size()=1 2024-09-12T01:38:01.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.451+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.haTSF2RnM3up87eCweZlLg_sZ4twAiR_0 2024-09-12T01:38:01.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.452+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6281243819483604641', time=2024-09-12T03:13:12.531520+0000, chain.objs.size()=1 2024-09-12T01:38:01.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.452+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.vOKLCc6-9qe01TIvFHw4uRRnnGSpbD9_0 2024-09-12T01:38:01.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.452+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17612843257125763354', time=2024-09-12T03:13:12.702158+0000, chain.objs.size()=1 2024-09-12T01:38:01.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.452+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.nspBjaQQiELVYymreEPEQ0Ed3RUNeBE_0 2024-09-12T01:38:01.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.452+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6621865749093742752', time=2024-09-12T03:13:13.217577+0000, chain.objs.size()=1 2024-09-12T01:38:01.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.452+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.I-154BdMEegpR-Tqoc6lOUhYRUBY7ZK_0 2024-09-12T01:38:01.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.452+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14009608820568317600', time=2024-09-12T03:13:13.218279+0000, chain.objs.size()=1 2024-09-12T01:38:01.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.452+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.GWUFWToGIAzQrxF9KsSDDwUtrwxK40L_0 2024-09-12T01:38:01.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.452+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2534847875843464098', time=2024-09-12T03:13:13.415544+0000, chain.objs.size()=1 2024-09-12T01:38:01.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.452+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.7IvemOhN1LLVRouUSR5uagIohf7KYZ2_0 2024-09-12T01:38:01.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.452+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17739067185467037175', time=2024-09-12T03:13:13.822073+0000, chain.objs.size()=1 2024-09-12T01:38:01.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.452+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.OIclE9lFZg4IdOS71_YDfeJ73LtgxMq_0 2024-09-12T01:38:01.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.452+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15578308028030377030', time=2024-09-12T03:13:14.320124+0000, chain.objs.size()=1 2024-09-12T01:38:01.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.452+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.-F9XdkludYPtQSO5gSm72765v-hqN99_0 2024-09-12T01:38:01.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.453+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13578477718380331432', time=2024-09-12T03:13:14.475653+0000, chain.objs.size()=1 2024-09-12T01:38:01.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.453+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.nvRROXpzGUCnBBIYO5PRneuj0MG5WUR_0 2024-09-12T01:38:01.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.453+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15996648136479370231', time=2024-09-12T03:13:14.515933+0000, chain.objs.size()=1 2024-09-12T01:38:01.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.453+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.2oreY22z7Dvn0X2nvHDxbVXJhC0UHFf_0 2024-09-12T01:38:01.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.453+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15526205644769055421', time=2024-09-12T03:13:14.666535+0000, chain.objs.size()=1 2024-09-12T01:38:01.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.453+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.LqbEOg-_BEATeun4YRuTUQNy1RWze9Y_0 2024-09-12T01:38:01.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.454+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3150880298213866886', time=2024-09-12T03:13:15.325697+0000, chain.objs.size()=1 2024-09-12T01:38:01.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.454+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.sFxby8biiXLVH3syUtwvJTJ1UOzExAS_0 2024-09-12T01:38:01.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.454+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17683368056776789132', time=2024-09-12T03:13:15.326331+0000, chain.objs.size()=1 2024-09-12T01:38:01.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.454+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.rVlkFrMZbIwW7cG0-mImuHkGLATpko1_0 2024-09-12T01:38:01.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.454+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9188295498898612013', time=2024-09-12T03:13:15.593908+0000, chain.objs.size()=1 2024-09-12T01:38:01.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.454+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_._gUBTSO6gJhJlnxSQ_piG6109WHAf0q_0 2024-09-12T01:38:01.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.455+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.354041805971806215', time=2024-09-12T03:13:15.836654+0000, chain.objs.size()=1 2024-09-12T01:38:01.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.455+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.N9F8KToJ8_shtCYpcST75t-tGnVZhZa_0 2024-09-12T01:38:01.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.455+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12778846338214786556', time=2024-09-12T03:13:16.490391+0000, chain.objs.size()=1 2024-09-12T01:38:01.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.455+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.x9TmF5rWA5SsRpjQl5yD_hZ_awMyMm5_0 2024-09-12T01:38:01.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.455+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13057864891583864524', time=2024-09-12T03:13:16.519936+0000, chain.objs.size()=1 2024-09-12T01:38:01.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.455+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.RKEk1mEtlIH16cmetYdY12dtKHd3oj8_0 2024-09-12T01:38:01.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.455+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8021417598765013406', time=2024-09-12T03:13:53.786194+0000, chain.objs.size()=1 2024-09-12T01:38:01.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.455+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.uT5dKdy7oVNcGUpmrV7o7onampNsomP_0 2024-09-12T01:38:01.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.455+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9195394439606520197', time=2024-09-12T03:13:53.834513+0000, chain.objs.size()=1 2024-09-12T01:38:01.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.455+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.CH7FSD_q0PtFY8AuuHQPC6VJGQH57oe_0 2024-09-12T01:38:01.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.455+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3770920089574831044', time=2024-09-12T03:13:53.931446+0000, chain.objs.size()=1 2024-09-12T01:38:01.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.455+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.XLM-savTY5B1zAUsQ9KW2gXPIZD1Q8v_0 2024-09-12T01:38:01.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.455+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5116650883454654271', time=2024-09-12T03:13:54.575315+0000, chain.objs.size()=1 2024-09-12T01:38:01.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.455+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.afcj8kNR1T_YZamKpaPt0J8W_7nPI3V_0 2024-09-12T01:38:01.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.455+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14738820944287600289', time=2024-09-12T03:13:55.207248+0000, chain.objs.size()=1 2024-09-12T01:38:01.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.455+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.mPktrMwmPTbB7BxyGBGhoQmm9EZe4tI_0 2024-09-12T01:38:01.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.456+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.145981033442621950', time=2024-09-12T03:13:55.283489+0000, chain.objs.size()=1 2024-09-12T01:38:01.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.456+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.FgSU0GRUe0esH3DoJsVyU1yBNLvHoye_0 2024-09-12T01:38:01.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.456+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6467086152889605362', time=2024-09-12T03:13:55.366767+0000, chain.objs.size()=1 2024-09-12T01:38:01.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.456+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.w9mCjt4srrz9baiicvoNx8WnrBjeY5Q_0 2024-09-12T01:38:01.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.456+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13823430149936318506', time=2024-09-12T03:13:55.443505+0000, chain.objs.size()=1 2024-09-12T01:38:01.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.456+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.-fgQ41FT6nrZ-9d01hcBl-PLIT2PnAn_0 2024-09-12T01:38:01.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.457+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9666792225418431558', time=2024-09-12T03:13:55.680603+0000, chain.objs.size()=1 2024-09-12T01:38:01.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.457+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.qSPPBFlczxGaqtFvBRsWB2s5357n7Qe_0 2024-09-12T01:38:01.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.457+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15169790898041559724', time=2024-09-12T03:13:55.925274+0000, chain.objs.size()=1 2024-09-12T01:38:01.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.457+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.k7oELJyqSI0-qfaCPOpYJG6WBcAK92d_0 2024-09-12T01:38:01.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.457+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8810108542167078448', time=2024-09-12T03:13:56.044098+0000, chain.objs.size()=1 2024-09-12T01:38:01.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.457+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Qdz9IcfdjJXZCm6Y5uIZTpnBpQfJwHu_0 2024-09-12T01:38:01.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.457+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8865551942208365539', time=2024-09-12T03:13:56.590175+0000, chain.objs.size()=1 2024-09-12T01:38:01.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.457+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.K_SmUNv8u7hIXtko2UbKNpWmdMKnnKV_0 2024-09-12T01:38:01.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.457+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10347203069212938662', time=2024-09-12T03:13:57.137542+0000, chain.objs.size()=1 2024-09-12T01:38:01.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.457+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.hBtrMM6AG3TWnE33nyYB1xaxsFfeOUR_0 2024-09-12T01:38:01.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.457+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16124199692550781742', time=2024-09-12T03:13:57.153086+0000, chain.objs.size()=1 2024-09-12T01:38:01.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.457+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.u2hLmIhTNFs899uOEaW75bhUzfUB9gY_0 2024-09-12T01:38:01.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.457+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2229745547893102183', time=2024-09-12T03:13:57.172455+0000, chain.objs.size()=1 2024-09-12T01:38:01.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.457+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.B4Xzu_g2ApD-qSpxQRTm5LbI0tk8W0M_0 2024-09-12T01:38:01.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.458+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3715117711210303214', time=2024-09-12T03:13:57.268232+0000, chain.objs.size()=1 2024-09-12T01:38:01.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.458+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.bGX-u625TxzMOZG0dTqb4fEt0-ZRcOi_0 2024-09-12T01:38:01.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.459+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16207929249148064096', time=2024-09-12T03:13:57.324801+0000, chain.objs.size()=1 2024-09-12T01:38:01.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.459+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.PhDdUWrQ0VADiSad4DS7krSZtUoyBeL_0 2024-09-12T01:38:01.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.459+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2892140157828620056', time=2024-09-12T03:13:57.381053+0000, chain.objs.size()=1 2024-09-12T01:38:01.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.459+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.v_vLEObq45L2d19wAu7J_jmaLPSzmHF_0 2024-09-12T01:38:01.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.459+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9698727509234402831', time=2024-09-12T03:13:57.428241+0000, chain.objs.size()=1 2024-09-12T01:38:01.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.459+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.sEuLEHynaOBMCgzOTONXVtwUQHAOG4w_0 2024-09-12T01:38:01.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.459+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12518115205061936271', time=2024-09-12T03:13:57.820481+0000, chain.objs.size()=1 2024-09-12T01:38:01.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.459+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.SGI88NbruRF9M3NQBCbr_g2EPfxjCOW_0 2024-09-12T01:38:01.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.460+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10121600263137311167', time=2024-09-12T03:13:58.253612+0000, chain.objs.size()=1 2024-09-12T01:38:01.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.460+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Bp0L22PfPgr1e5l0Bot7805nq1wlpEl_0 2024-09-12T01:38:01.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.460+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14064850426434520834', time=2024-09-12T03:13:59.542845+0000, chain.objs.size()=1 2024-09-12T01:38:01.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.460+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.py-EtahPRNZx7W8Ugj9GOjJGakfGwIW_0 2024-09-12T01:38:01.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.460+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6518485511075095202', time=2024-09-12T03:13:59.913943+0000, chain.objs.size()=1 2024-09-12T01:38:01.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.460+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.CFbH4FOVlUlfcdfurYfgSYpMsFqU8d__0 2024-09-12T01:38:01.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.463+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 0/45737 2024-09-12T01:38:01.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.465+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=25, truncated=0, next_marker='' 2024-09-12T01:38:01.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.465+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7306792056191057344', time=2024-09-12T03:14:00.765330+0000, chain.objs.size()=1 2024-09-12T01:38:01.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.465+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.o3bS5v9ZSkKj82Vuy3FW-hEFdDlapKk_0 2024-09-12T01:38:01.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.465+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12412962390104258537', time=2024-09-12T03:14:01.095125+0000, chain.objs.size()=1 2024-09-12T01:38:01.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.465+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.aAEnntPbB8DiMl87rtDU6Vy4UygXrOV_0 2024-09-12T01:38:01.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.465+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17624029449546100408', time=2024-09-12T03:14:01.201593+0000, chain.objs.size()=1 2024-09-12T01:38:01.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.465+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.3Q5CGs4Et0TD1cxV8iT4hhGF7gtlTDP_0 2024-09-12T01:38:01.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.465+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8289008874870382375', time=2024-09-12T03:14:01.390766+0000, chain.objs.size()=1 2024-09-12T01:38:01.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.465+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.4Ac-19IxNbO4aWmaQHunNNFLtSCr2ju_0 2024-09-12T01:38:01.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.465+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16678113884036485837', time=2024-09-12T03:14:01.708600+0000, chain.objs.size()=1 2024-09-12T01:38:01.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.465+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.l8bk_lt6ijpK_CALBJIx-zRfxhDIvBZ_0 2024-09-12T01:38:01.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.465+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6962747294328678551', time=2024-09-12T03:14:02.068206+0000, chain.objs.size()=1 2024-09-12T01:38:01.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.465+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.cc_B9S77DsbNEcukzkGc5FJi-levPWe_0 2024-09-12T01:38:01.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.465+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1032794414341419473', time=2024-09-12T03:14:02.231641+0000, chain.objs.size()=1 2024-09-12T01:38:01.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.465+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.X44_pt5NNK9HFx3qWQ5nFCbJ5srgseS_0 2024-09-12T01:38:01.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.465+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12192949828358189582', time=2024-09-12T03:14:02.507395+0000, chain.objs.size()=1 2024-09-12T01:38:01.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.465+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.ndECRabVfyxY4T4GRx560lfNAkpybCm_0 2024-09-12T01:38:01.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.465+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6214025141877683548', time=2024-09-12T03:14:02.888529+0000, chain.objs.size()=1 2024-09-12T01:38:01.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.465+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.w-2FHWyRqaM0W2hAd4P13lYqwbrKkUH_0 2024-09-12T01:38:01.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.465+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10294064287200445664', time=2024-09-12T03:14:03.064489+0000, chain.objs.size()=1 2024-09-12T01:38:01.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.465+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.YaafGj_qK9sBpXwvwEzrii5nxIRyMCN_0 2024-09-12T01:38:01.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.465+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1627125981705353030', time=2024-09-12T03:14:03.378064+0000, chain.objs.size()=1 2024-09-12T01:38:01.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.465+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.efKLB_Dpwztd8yc3F44Pud4GytK-0GV_0 2024-09-12T01:38:01.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.465+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14847158455172268729', time=2024-09-12T03:14:03.525789+0000, chain.objs.size()=1 2024-09-12T01:38:01.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.465+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.E91xQRfUZRwfSNh_iVjgPbSZv0J5Kuz_0 2024-09-12T01:38:01.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.467+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10327622516566366634', time=2024-09-12T03:16:13.874708+0000, chain.objs.size()=1 2024-09-12T01:38:01.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.467+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.459__shadow_.3uHeiRBoDXL4mM8KPOyGjFoPxR-h944_0 2024-09-12T01:38:01.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.467+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6518907522831632397', time=2024-09-12T03:16:19.396967+0000, chain.objs.size()=1 2024-09-12T01:38:01.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.467+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.463__shadow_.jKwtEAuzpqrxwUSV33IHuGgfHAmHbfp_0 2024-09-12T01:38:01.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.467+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2124627984155360444', time=2024-09-12T03:16:35.451526+0000, chain.objs.size()=1 2024-09-12T01:38:01.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.467+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.484__shadow_.fpsVrb8hE1WvTUGX_iglp2Qkp5VIZeb_0 2024-09-12T01:38:01.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.467+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3583961206258234809', time=2024-09-12T03:16:46.399912+0000, chain.objs.size()=1 2024-09-12T01:38:01.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.467+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.493__shadow_.XhlqvUpeMNVKOgD2XCigK1dDiY1rUZo_0 2024-09-12T01:38:01.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.467+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5136236566479808516', time=2024-09-12T03:22:21.163379+0000, chain.objs.size()=2 2024-09-12T01:38:01.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.467+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.552__shadow_.g0_bQb7N1NP2ZKqsyBUzTCuAwE_ty_b_0 2024-09-12T01:38:01.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.467+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.552__shadow_.g0_bQb7N1NP2ZKqsyBUzTCuAwE_ty_b_1 2024-09-12T01:38:01.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.467+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10239632688440141300', time=2024-09-12T03:22:51.803282+0000, chain.objs.size()=1 2024-09-12T01:38:01.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.467+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.559__shadow_.m5raDtbN1kyQgFmrTXoCjf_2UHs9d0f_0 2024-09-12T01:38:01.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.467+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9715329661290017498', time=2024-09-12T03:23:09.688377+0000, chain.objs.size()=1 2024-09-12T01:38:01.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.467+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.569__shadow:lpqUyLr-AgxQSmXNjYlSSotq6izrBWv_.freXJCCHXlL8w6a7ipMe9XO76JeAYgK_0 2024-09-12T01:38:01.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.467+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14450464794805751198', time=2024-09-12T03:23:11.892047+0000, chain.objs.size()=1 2024-09-12T01:38:01.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.467+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.569__shadow:xjGu2ZwsneafpTy4r..NufwQIqiz-il_.LDfkAvnUUYjR6XjoXEZacutS78-gXGz_0 2024-09-12T01:38:01.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.467+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5526728829657798725', time=2024-09-12T03:23:20.052631+0000, chain.objs.size()=1 2024-09-12T01:38:01.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.467+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.570__shadow:MmSj2w0AFyEmHZqTAK5MPpaqyMs5-.k_.Lt8JKkDYJv93oeu5PoJEPiNX8g4SsHQ_0 2024-09-12T01:38:01.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.467+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.765288127713995238', time=2024-09-12T03:23:25.820377+0000, chain.objs.size()=1 2024-09-12T01:38:01.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.467+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.574__shadow_.oln7OxCst34xg02GVCxczeYIJy_FAvX_0 2024-09-12T01:38:01.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.468+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12042796076980127074', time=2024-09-12T03:23:43.587851+0000, chain.objs.size()=1 2024-09-12T01:38:01.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.468+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.577__shadow:fyjyJ8PInR5FuMbU71aaWvYS-TYO56h_.vkZgJGCAB11TBxhTQrfoia46bcxCQQd_0 2024-09-12T01:38:01.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.470+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8458979942967494226', time=2024-09-12T03:24:39.191536+0000, chain.objs.size()=1 2024-09-12T01:38:01.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.470+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.580__shadow:y5nyAE92iruKUZQ05jeXEW8p0g-Gkk._.LmWQDL3edT5cF7DwWasYK51_r9YPxUP_0 2024-09-12T01:38:01.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.470+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14231379255317798242', time=2024-09-12T03:31:25.484064+0000, chain.objs.size()=1 2024-09-12T01:38:01.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.470+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.696__shadow:yRyhED9yglSdZ-ZXqpv9OIg0nQW9Yqt_.Bb2UVpR9pJapKOOTPieFhShn9Fn07DE_0 2024-09-12T01:38:01.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.471+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:38:01.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.473+0000 7f8786c98800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T01:38:01.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.475+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:38:01.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.475+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:38:01.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.476+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47696' 2024-09-12T01:38:01.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.476+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3901186255871538402', time=2024-09-12T03:06:38.086535+0000, chain.objs.size()=1 2024-09-12T01:38:01.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.476+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.160__shadow_.eR4LvrQRl0LgMdFfQlmbOemvCU_9D1Q_0 2024-09-12T01:38:01.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.476+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1309886163731434156', time=2024-09-12T03:07:39.485355+0000, chain.objs.size()=1 2024-09-12T01:38:01.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.476+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.177__shadow_.CGmd6prq0V39HVIDSWpRAlf02m-Fj3u_0 2024-09-12T01:38:01.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.476+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10853717746662143781', time=2024-09-12T03:10:11.608425+0000, chain.objs.size()=1 2024-09-12T01:38:01.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.476+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.236__shadow_.PWtjXxAlFV8zZgTuFmYZqUb8HiSKOrU_0 2024-09-12T01:38:01.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.476+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4683200832967384754', time=2024-09-12T03:10:34.615504+0000, chain.objs.size()=1 2024-09-12T01:38:01.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.476+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.257__shadow_.evWpIfzBT3veseRaQM0iOlygE7HHD3G_0 2024-09-12T01:38:01.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.476+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7034152876258049526', time=2024-09-12T03:10:37.435197+0000, chain.objs.size()=1 2024-09-12T01:38:01.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.476+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.260__shadow_.blRnk_zYMIvZVx5Nzh07Zt8sPpi0_Vq_0 2024-09-12T01:38:01.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.476+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1980608331596612338', time=2024-09-12T03:11:14.542408+0000, chain.objs.size()=1 2024-09-12T01:38:01.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.476+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.jyAQrI021-6QgdTla0tX_CMnRFZ-yd-_0 2024-09-12T01:38:01.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.476+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17975705977043816639', time=2024-09-12T03:11:15.404958+0000, chain.objs.size()=1 2024-09-12T01:38:01.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.476+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.bidZFduGAnqrwtG0Fc9fyvBOeYxoCpt_0 2024-09-12T01:38:01.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.476+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4110784230700085433', time=2024-09-12T03:11:15.407478+0000, chain.objs.size()=1 2024-09-12T01:38:01.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.476+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_._D3qqhuTQIypE6kh1omyukg8N_9HFxq_0 2024-09-12T01:38:01.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.476+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6551482744602644464', time=2024-09-12T03:11:16.807028+0000, chain.objs.size()=1 2024-09-12T01:38:01.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.476+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.cW6dMahw7b3YVduVLR0U9xFIcWc5Anj_0 2024-09-12T01:38:01.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.476+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11478896957582568189', time=2024-09-12T03:11:16.952274+0000, chain.objs.size()=1 2024-09-12T01:38:01.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.476+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.R4LYjwvdB9omfVXjaztq31OLqX1Hu9H_0 2024-09-12T01:38:01.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.476+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18263742995073330406', time=2024-09-12T03:11:17.403194+0000, chain.objs.size()=1 2024-09-12T01:38:01.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.476+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.yzFi-ncjWWu1sMPa2z4NtD-XjOTxH_T_0 2024-09-12T01:38:01.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.476+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1674815429778028342', time=2024-09-12T03:11:17.767577+0000, chain.objs.size()=1 2024-09-12T01:38:01.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.476+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.xqkLawjWDveWUc7LBgcPSTPSPyXzozZ_0 2024-09-12T01:38:01.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.478+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1889562835813130703', time=2024-09-12T03:11:17.768393+0000, chain.objs.size()=1 2024-09-12T01:38:01.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.478+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.pyzVnws23p3mTFvGr5rlLLBKahX_qxW_0 2024-09-12T01:38:01.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.478+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10340396661016754944', time=2024-09-12T03:11:17.839336+0000, chain.objs.size()=1 2024-09-12T01:38:01.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.478+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.4eTFJyUbKDsxIC-Hhb4FOFOos9A_QwP_0 2024-09-12T01:38:01.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.478+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17431312443199516005', time=2024-09-12T03:11:18.133943+0000, chain.objs.size()=1 2024-09-12T01:38:01.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.478+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.kc0O1LZn_Uzc7V6xC6NxGD9zFkS5G-X_0 2024-09-12T01:38:01.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.478+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15330612796010647578', time=2024-09-12T03:11:18.162642+0000, chain.objs.size()=1 2024-09-12T01:38:01.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.478+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.rpFhmZcUCIOtrB9q-JG_GoeWrUubAIa_0 2024-09-12T01:38:01.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.478+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13053122364468176340', time=2024-09-12T03:11:18.304331+0000, chain.objs.size()=1 2024-09-12T01:38:01.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.478+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.8BFdBh2P3qiDugP1GaT2quqD7ODD6CD_0 2024-09-12T01:38:01.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.478+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4550202958046757956', time=2024-09-12T03:11:19.258403+0000, chain.objs.size()=1 2024-09-12T01:38:01.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.478+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.TQ6jsGhn2JXkCDP50-j8MB9q2GLwSm-_0 2024-09-12T01:38:01.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.478+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4212663962907127887', time=2024-09-12T03:11:19.351535+0000, chain.objs.size()=1 2024-09-12T01:38:01.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.478+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.MzH-MsKxdeAhXtZFK_R7XvNujqZi4K3_0 2024-09-12T01:38:01.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.478+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4626084792068165093', time=2024-09-12T03:11:19.384363+0000, chain.objs.size()=1 2024-09-12T01:38:01.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.478+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.K9xavUWj3qJCKmwQVt5vkvntdo4l8lD_0 2024-09-12T01:38:01.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.478+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5260872351663473958', time=2024-09-12T03:11:19.411993+0000, chain.objs.size()=1 2024-09-12T01:38:01.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.478+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.lvf8CuqJtpjGpDXFd17d-JCbMlEKicp_0 2024-09-12T01:38:01.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.478+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2394570988006944161', time=2024-09-12T03:11:20.363104+0000, chain.objs.size()=1 2024-09-12T01:38:01.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.478+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.obdwZFYym1Yg0c2EHBuigjuOIp98-OP_0 2024-09-12T01:38:01.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.478+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10238488822323783626', time=2024-09-12T03:11:20.641103+0000, chain.objs.size()=1 2024-09-12T01:38:01.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.478+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.NFVB8nBcpQpfiEhuuqJXmUx0e1RmVyG_0 2024-09-12T01:38:01.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.480+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16691765155719465144', time=2024-09-12T03:11:20.934425+0000, chain.objs.size()=1 2024-09-12T01:38:01.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.480+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.xJvc3YPz0yuClJFLM7BnZdLJlWUhj-4_0 2024-09-12T01:38:01.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.480+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17639474232002508937', time=2024-09-12T03:11:20.986705+0000, chain.objs.size()=1 2024-09-12T01:38:01.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.480+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.yqxUsOaaDnLcCsRqKvhU1zeqBaYU1dT_0 2024-09-12T01:38:01.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.480+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10116515533971921080', time=2024-09-12T03:11:21.179219+0000, chain.objs.size()=1 2024-09-12T01:38:01.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.480+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.ueGnRor2T3M0gcb6CoA3OD27anyLhg-_0 2024-09-12T01:38:01.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.480+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13821165481858468378', time=2024-09-12T03:11:21.739789+0000, chain.objs.size()=1 2024-09-12T01:38:01.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.480+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.s4yeY-tIqGAzPtrFrKcoWuTvhxu3sg-_0 2024-09-12T01:38:01.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.480+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12374243637691942492', time=2024-09-12T03:11:21.768689+0000, chain.objs.size()=1 2024-09-12T01:38:01.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.480+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.rqiWtHbvAZVbEhMUPAbRuQJF4LSF9M4_0 2024-09-12T01:38:01.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.481+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12408127252031517922', time=2024-09-12T03:11:22.984213+0000, chain.objs.size()=1 2024-09-12T01:38:01.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.481+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.vVOD8O1d8pK_k0Nuev2Tr_cgcEmOM7W_0 2024-09-12T01:38:01.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.481+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5856611957764524143', time=2024-09-12T03:11:23.195227+0000, chain.objs.size()=1 2024-09-12T01:38:01.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.481+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.XaegLqHXUpddfAFxxghlR44YLRAfbuz_0 2024-09-12T01:38:01.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.481+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4188869327171372809', time=2024-09-12T03:11:23.247248+0000, chain.objs.size()=1 2024-09-12T01:38:01.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.481+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.O-YHD6npmhGXnPuEAMAI6UyrinUWWSI_0 2024-09-12T01:38:01.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.481+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10573431830868157468', time=2024-09-12T03:11:23.365516+0000, chain.objs.size()=1 2024-09-12T01:38:01.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.481+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.od83XpA01hxz_Q1c631an_lntjSq8TD_0 2024-09-12T01:38:01.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.481+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8255691936507876838', time=2024-09-12T03:11:23.611386+0000, chain.objs.size()=1 2024-09-12T01:38:01.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.481+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.4OvrUUP9d8ediOrvxtUiIGzhdLE_Nze_0 2024-09-12T01:38:01.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.481+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1220751670618682632', time=2024-09-12T03:11:24.391478+0000, chain.objs.size()=1 2024-09-12T01:38:01.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.481+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.96qC1_qO7AIx9tIwGboUhr69dcuL_nb_0 2024-09-12T01:38:01.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.482+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5243083557429978310', time=2024-09-12T03:11:24.809711+0000, chain.objs.size()=1 2024-09-12T01:38:01.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.482+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.bQ9ni9Skomhpno97z85DNCw5PFmpcJX_0 2024-09-12T01:38:01.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.482+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10552539509782293155', time=2024-09-12T03:11:29.601625+0000, chain.objs.size()=1 2024-09-12T01:38:01.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.482+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.267__shadow_.cgnf2Z03QYu3Gt0e6v7VTKEsB8-ohBM_0 2024-09-12T01:38:01.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.482+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.721811740520287348', time=2024-09-12T03:11:30.524051+0000, chain.objs.size()=1 2024-09-12T01:38:01.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.482+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.268__shadow_.ZnGPkWG9A6YkcxxiyzFBLpd7B_NHHEn_0 2024-09-12T01:38:01.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.482+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4303827957765622868', time=2024-09-12T03:11:36.138684+0000, chain.objs.size()=1 2024-09-12T01:38:01.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.482+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.274__shadow_.UOYP7i3IDh69OWxfQlboyMpLnHDIapj_0 2024-09-12T01:38:01.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.482+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4968467652722376769', time=2024-09-12T03:11:37.117157+0000, chain.objs.size()=1 2024-09-12T01:38:01.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.482+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.275__shadow_.soAFFepAGuSTP4Rtlk1k2tVjSoqxLSz_0 2024-09-12T01:38:01.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.483+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5689300246853552902', time=2024-09-12T03:11:41.976757+0000, chain.objs.size()=1 2024-09-12T01:38:01.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.483+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.280__shadow_.rPUTtI8z5Z23EpSOQEB8VRbhY30hdxC_0 2024-09-12T01:38:01.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.483+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16321289357715016427', time=2024-09-12T03:11:44.882129+0000, chain.objs.size()=1 2024-09-12T01:38:01.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.483+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.283__shadow_.m3yGB4a_j_VtPIh54VQrQaDLNdYQsff_0 2024-09-12T01:38:01.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.483+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1238836753342211849', time=2024-09-12T03:12:27.444716+0000, chain.objs.size()=1 2024-09-12T01:38:01.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.483+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.319__shadow:KHtfwB7mFxjIfR7O5ai1lxc9dO0VFJa_.c4yLqAOyXc9nd-E0SnZ_KYpuYloBnC3_0 2024-09-12T01:38:01.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.483+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15102187893017033874', time=2024-09-12T03:13:06.962098+0000, chain.objs.size()=1 2024-09-12T01:38:01.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.483+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.yiRJoKcvZLxkvjw4W1pHjEHkQR0Z4Q__0 2024-09-12T01:38:01.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.483+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8010696859887894090', time=2024-09-12T03:13:07.469306+0000, chain.objs.size()=1 2024-09-12T01:38:01.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.483+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.Dzp_5caqEwYwYArVNH6K7z8mcKtVudw_0 2024-09-12T01:38:01.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.483+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9821804829716720354', time=2024-09-12T03:13:07.648850+0000, chain.objs.size()=1 2024-09-12T01:38:01.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.483+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.PPKzHcAYddm4zNJhBEtUBp1xmFBIhiy_0 2024-09-12T01:38:01.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.484+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3785895379039686548', time=2024-09-12T03:13:07.803007+0000, chain.objs.size()=1 2024-09-12T01:38:01.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.484+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.vzo2jt5omBU4rcj6falP3Fu7JnpLdsZ_0 2024-09-12T01:38:01.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.484+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6239870393583635979', time=2024-09-12T03:13:08.380793+0000, chain.objs.size()=1 2024-09-12T01:38:01.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.484+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.3mtKxpCW4H5aKgrz0u4WEum19MQSZob_0 2024-09-12T01:38:01.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.485+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6492635135433061913', time=2024-09-12T03:13:08.881777+0000, chain.objs.size()=1 2024-09-12T01:38:01.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.485+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_._yRr0_t4ctGHOISQjzgAzed7Jy3AyIR_0 2024-09-12T01:38:01.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.485+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1320560207358703440', time=2024-09-12T03:13:09.210642+0000, chain.objs.size()=1 2024-09-12T01:38:01.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.485+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.NrG9RtCnmD0Ir4Ko26PcBYSJfnHgWxa_0 2024-09-12T01:38:01.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.485+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10264473874161742710', time=2024-09-12T03:13:09.721760+0000, chain.objs.size()=1 2024-09-12T01:38:01.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.485+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.xbGqgcMbMe2rGTLaIAV_n_gLYNT6aj9_0 2024-09-12T01:38:01.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.485+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6100677662760895310', time=2024-09-12T03:13:09.749407+0000, chain.objs.size()=1 2024-09-12T01:38:01.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.485+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.mtfkbb8e2aPj10nYBK8pHRFhbOuzkwf_0 2024-09-12T01:38:01.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.485+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16727057934086377768', time=2024-09-12T03:13:11.350517+0000, chain.objs.size()=1 2024-09-12T01:38:01.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.485+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.ZbWg65cLTlqRxVBHpNbCoOEqzTB-mv-_0 2024-09-12T01:38:01.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.485+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8654455033538545008', time=2024-09-12T03:13:11.412838+0000, chain.objs.size()=1 2024-09-12T01:38:01.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.485+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.vErpli4N5WizY9_QRdET41k65vERr0x_0 2024-09-12T01:38:01.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.487+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13632236185271092981', time=2024-09-12T03:13:11.430049+0000, chain.objs.size()=1 2024-09-12T01:38:01.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.487+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.R0cle5U9M_dCiefWtYRlqIGNm8MGIF4_0 2024-09-12T01:38:01.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.487+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14988550636631602369', time=2024-09-12T03:13:11.550295+0000, chain.objs.size()=1 2024-09-12T01:38:01.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.487+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.V-te38pRpkHMDTV7pAdr_X24zfJ3f8m_0 2024-09-12T01:38:01.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.487+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1709348218472092919', time=2024-09-12T03:13:11.626541+0000, chain.objs.size()=1 2024-09-12T01:38:01.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.487+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.8F3vX25j1AT7IHYf7P4vzi4_iGbsg9Y_0 2024-09-12T01:38:01.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.487+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10583079169561283399', time=2024-09-12T03:13:11.695656+0000, chain.objs.size()=1 2024-09-12T01:38:01.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.487+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.XQzr1bcojRBuGgSqcW5DeW16LuDiNCQ_0 2024-09-12T01:38:01.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.487+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8815276551400052681', time=2024-09-12T03:13:12.923479+0000, chain.objs.size()=1 2024-09-12T01:38:01.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.487+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.C3UwbYOiYbyiXxPcwZJZ8GauCx3WFQO_0 2024-09-12T01:38:01.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.488+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5254912556865944560', time=2024-09-12T03:13:13.293204+0000, chain.objs.size()=1 2024-09-12T01:38:01.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.488+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_._smspOOUFTdLZPwB0qBDXsIX8W4ZFKB_0 2024-09-12T01:38:01.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.488+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13666775276878987113', time=2024-09-12T03:13:14.066699+0000, chain.objs.size()=1 2024-09-12T01:38:01.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.488+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.P7XfEeYobfXDzOOoE30VTZupV3NJzBb_0 2024-09-12T01:38:01.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.488+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3863285557249335424', time=2024-09-12T03:13:14.112356+0000, chain.objs.size()=1 2024-09-12T01:38:01.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.488+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.CVdTirryEdUkcrg3CCXIdjNdIlY9v34_0 2024-09-12T01:38:01.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.488+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16394995249787272777', time=2024-09-12T03:13:14.383627+0000, chain.objs.size()=1 2024-09-12T01:38:01.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.488+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.hCU1ebmaP4dK1NeicqID2bV-LD9-Pzs_0 2024-09-12T01:38:01.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.488+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14850234929961414147', time=2024-09-12T03:13:14.773521+0000, chain.objs.size()=1 2024-09-12T01:38:01.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.488+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.kJHe3UEDnIJLW8T-Dlv93Qu1Q2niVfB_0 2024-09-12T01:38:01.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.488+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7951475433166923764', time=2024-09-12T03:13:15.213382+0000, chain.objs.size()=1 2024-09-12T01:38:01.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.488+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.O4RhAuyWlUQ7VR0S1dbRLeqWVzqrsPp_0 2024-09-12T01:38:01.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.489+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17310817107609501149', time=2024-09-12T03:13:15.448345+0000, chain.objs.size()=1 2024-09-12T01:38:01.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.489+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.pzauQcV4ODqqPXsUQ_tRQBcAbNCqRhN_0 2024-09-12T01:38:01.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.490+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4792542388361416491', time=2024-09-12T03:13:15.449834+0000, chain.objs.size()=1 2024-09-12T01:38:01.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.490+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.TfeIP9zmNdcwOPoLRmkgnt4c9Rcelpl_0 2024-09-12T01:38:01.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.491+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12019557341064151929', time=2024-09-12T03:13:15.742004+0000, chain.objs.size()=1 2024-09-12T01:38:01.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.491+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.fZ0ankQgwSq8sYIbFF_nfGTOswOEWhE_0 2024-09-12T01:38:01.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.491+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13082654644669599778', time=2024-09-12T03:13:16.381814+0000, chain.objs.size()=1 2024-09-12T01:38:01.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.491+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.aIwCCeuQocKV9nJOxiWj-gHs2xgj111_0 2024-09-12T01:38:01.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.491+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4112683121468260624', time=2024-09-12T03:13:16.669258+0000, chain.objs.size()=1 2024-09-12T01:38:01.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.491+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.yJp9WQOyvNFd3vfElM09J5YntZuihKj_0 2024-09-12T01:38:01.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.491+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12863041653300350974', time=2024-09-12T03:13:16.952542+0000, chain.objs.size()=1 2024-09-12T01:38:01.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.491+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.76KPv2J9k3Xb50cqcmKKKx0xRSfXJxv_0 2024-09-12T01:38:01.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.491+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8251616066547848868', time=2024-09-12T03:13:16.997871+0000, chain.objs.size()=1 2024-09-12T01:38:01.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.491+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.E3ypljt_CQmSFUH1xnb82VSUVBg6Q2W_0 2024-09-12T01:38:01.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.491+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6797158696978786739', time=2024-09-12T03:13:54.543668+0000, chain.objs.size()=1 2024-09-12T01:38:01.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.491+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.iDitx5zW6jAputgFFJELgEw3Ji-z2ky_0 2024-09-12T01:38:01.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.491+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16990487869713689367', time=2024-09-12T03:13:54.564019+0000, chain.objs.size()=1 2024-09-12T01:38:01.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.491+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.JbLbZLV0MjU4Md0nwz8YR7CIJjyJU6o_0 2024-09-12T01:38:01.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.491+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11162470511847758036', time=2024-09-12T03:13:55.092447+0000, chain.objs.size()=1 2024-09-12T01:38:01.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.491+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.tRLGnwDpx8xH4GZMRuzsizKWgffkunv_0 2024-09-12T01:38:01.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.491+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1598026049180147076', time=2024-09-12T03:13:55.148367+0000, chain.objs.size()=1 2024-09-12T01:38:01.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.491+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.-36ZJ3r3E4PSY4Pflwy3wn5MTGgn0pC_0 2024-09-12T01:38:01.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.491+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.221453132967548080', time=2024-09-12T03:13:56.058129+0000, chain.objs.size()=1 2024-09-12T01:38:01.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.491+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.M7gnyq8joDKOkykJUKv4gN1rP1UgaEh_0 2024-09-12T01:38:01.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.494+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15131121179507087028', time=2024-09-12T03:13:56.512319+0000, chain.objs.size()=1 2024-09-12T01:38:01.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.494+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.GJpIAjgx23g6aWaPREVOg3tnVW0CGsK_0 2024-09-12T01:38:01.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.494+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14772665987371556192', time=2024-09-12T03:13:56.750617+0000, chain.objs.size()=1 2024-09-12T01:38:01.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.494+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.ixCWVEeGbwrd4bboswM9l5y6tbG5yDX_0 2024-09-12T01:38:01.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.494+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4380585679911809202', time=2024-09-12T03:13:57.223051+0000, chain.objs.size()=1 2024-09-12T01:38:01.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.494+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.LzFs891eMaMlEEB3LKZk4PI0eJAz70k_0 2024-09-12T01:38:01.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.494+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6969470327967258191', time=2024-09-12T03:13:57.264912+0000, chain.objs.size()=1 2024-09-12T01:38:01.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.494+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.6eZX-K6CWh8MLlNa9O9HkFXeGsthVM7_0 2024-09-12T01:38:01.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.495+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2506960181554038432', time=2024-09-12T03:13:57.266571+0000, chain.objs.size()=1 2024-09-12T01:38:01.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.495+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.ArrvhPkrGSZeVf06HdfSIY_47ZtLlNd_0 2024-09-12T01:38:01.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.495+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1368161747500335197', time=2024-09-12T03:13:57.795978+0000, chain.objs.size()=1 2024-09-12T01:38:01.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.495+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.0un7LXWj1kextSOHHzk8w80fwqXlWG2_0 2024-09-12T01:38:01.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.495+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7945561199739005214', time=2024-09-12T03:13:57.823233+0000, chain.objs.size()=1 2024-09-12T01:38:01.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.495+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.1z7s8x5We42mWv0wQJPve3PxALTnFuM_0 2024-09-12T01:38:01.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.495+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15741090142938076396', time=2024-09-12T03:13:57.996232+0000, chain.objs.size()=1 2024-09-12T01:38:01.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.495+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Rgl7Wbn7MR2mUJmnXqQLWSHzaUUN0gk_0 2024-09-12T01:38:01.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.495+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3546497697925770830', time=2024-09-12T03:13:58.063640+0000, chain.objs.size()=1 2024-09-12T01:38:01.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.495+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.-aY8cAzu5exE2EXD7tZj7OLuiz1UUQJ_0 2024-09-12T01:38:01.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.495+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10388122028182007134', time=2024-09-12T03:13:59.399857+0000, chain.objs.size()=1 2024-09-12T01:38:01.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.495+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.bu6U1a6zfcOuAVGPDo5zGBRwfE9W4F0_0 2024-09-12T01:38:01.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.495+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15146053664992896530', time=2024-09-12T03:13:59.645582+0000, chain.objs.size()=1 2024-09-12T01:38:01.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.495+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.cz8f3ieiJo1gYEc1EVRBGzT8GuWU0vT_0 2024-09-12T01:38:01.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.497+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2460306402082397295', time=2024-09-12T03:14:00.024434+0000, chain.objs.size()=1 2024-09-12T01:38:01.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.497+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Ri8DC_Quw092pqeEUjIfRuJqaczTC43_0 2024-09-12T01:38:01.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.497+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2096593899055037868', time=2024-09-12T03:14:00.076321+0000, chain.objs.size()=1 2024-09-12T01:38:01.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.497+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.h-REzjknPwW-9tq9xX2MN1sZ7ZI0BUj_0 2024-09-12T01:38:01.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.497+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11812579662536005891', time=2024-09-12T03:14:01.951106+0000, chain.objs.size()=1 2024-09-12T01:38:01.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.497+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Ha-p924dXrMJ8D8y4ooXFZsmEOaXCft_0 2024-09-12T01:38:01.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.497+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5739276572453763268', time=2024-09-12T03:14:02.072094+0000, chain.objs.size()=1 2024-09-12T01:38:01.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.497+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.IakkaUfxl2Ax9iitUSHfQyJmOvsKTSQ_0 2024-09-12T01:38:01.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.498+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8317239544309673024', time=2024-09-12T03:14:02.230711+0000, chain.objs.size()=1 2024-09-12T01:38:01.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.498+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.ke-bY1aL1rgdd967zjWeJsl3VbixQqu_0 2024-09-12T01:38:01.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.498+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14433712375700921956', time=2024-09-12T03:14:02.324254+0000, chain.objs.size()=1 2024-09-12T01:38:01.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.498+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.O16RKLsX2zq7FdHvHT6teLHjBv_szYq_0 2024-09-12T01:38:01.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.498+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18132958407134732065', time=2024-09-12T03:14:03.203709+0000, chain.objs.size()=1 2024-09-12T01:38:01.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.498+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.wlCsryiFtJUMDOLn4AjHOqVVP9hfI3m_0 2024-09-12T01:38:01.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.498+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16486476621590216175', time=2024-09-12T03:14:03.273133+0000, chain.objs.size()=1 2024-09-12T01:38:01.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.498+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.scIlFpdf9vuM-RHjYiBIwfbPV_d4nVl_0 2024-09-12T01:38:01.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.498+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13006779489374635084', time=2024-09-12T03:14:03.515946+0000, chain.objs.size()=1 2024-09-12T01:38:01.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.498+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.8s68BI64AFdeMCh0sMKZfseiILR-Mfd_0 2024-09-12T01:38:01.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.498+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4275474530757920574', time=2024-09-12T03:14:55.054849+0000, chain.objs.size()=1 2024-09-12T01:38:01.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.498+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.381__shadow_.EvQlCzXZEHcI5XUuM1g5cGYb1x_g3Ra_0 2024-09-12T01:38:01.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.498+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6778592943523846632', time=2024-09-12T03:15:44.281702+0000, chain.objs.size()=1 2024-09-12T01:38:01.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.498+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.432__shadow_.poYhd5q_ngQTUM_pgsaXYOqU3PwgpKE_0 2024-09-12T01:38:01.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.498+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13599757714838006729', time=2024-09-12T03:16:09.748357+0000, chain.objs.size()=1 2024-09-12T01:38:01.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.498+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.456__shadow_.v9yn2kt3LmvslII9R2NqkBuavVTcVwU_0 2024-09-12T01:38:01.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.500+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10859716718310454064', time=2024-09-12T03:16:20.660043+0000, chain.objs.size()=1 2024-09-12T01:38:01.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.500+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.464__shadow_.xfDHqTmPgb7CabhvbXJ7Bud6bsul8kp_0 2024-09-12T01:38:01.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.503+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 0/47696 2024-09-12T01:38:01.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.505+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T01:38:01.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.505+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4324336020152896920', time=2024-09-12T03:16:20.660710+0000, chain.objs.size()=1 2024-09-12T01:38:01.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.505+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.464__shadow_.Q9T9i07vPmUhJd2JchrjAq55kCyllRE_0 2024-09-12T01:38:01.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.505+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16127065692968029083', time=2024-09-12T03:16:21.943258+0000, chain.objs.size()=1 2024-09-12T01:38:01.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.505+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.465__shadow_.2GNy5pefmEiE51tBVEinztGkFrEZYV7_0 2024-09-12T01:38:01.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.505+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4631600507394502268', time=2024-09-12T03:16:34.325639+0000, chain.objs.size()=1 2024-09-12T01:38:01.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.505+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.483__shadow_.XP_J_NSfnAzSxC5zNGkPrdIJnjcRtJB_0 2024-09-12T01:38:01.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.505+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='2~0sETi2zh6twdMaygo6dyYUApZWIMCB9', time=2024-09-12T03:19:23.384752+0000, chain.objs.size()=1 2024-09-12T01:38:01.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.505+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.522__multipart_mymultipart.2~0sETi2zh6twdMaygo6dyYUApZWIMCB9.3 2024-09-12T01:38:01.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.505+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11692128344262776176', time=2024-09-12T03:22:36.805428+0000, chain.objs.size()=1 2024-09-12T01:38:01.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.505+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.555__shadow_.sd1wp4OaRYk-rQgd8e0NCqqZWLNNbrs_0 2024-09-12T01:38:01.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.505+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15153880095101813865', time=2024-09-12T03:23:09.449537+0000, chain.objs.size()=1 2024-09-12T01:38:01.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.505+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.569__shadow:k-g4ouG.f.0itrlVtO9OIeAZ5Ai5tPb_.PfK-kNzrXvvsHy_nOxPxWAOALMVUPp3_0 2024-09-12T01:38:01.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.505+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4594791638805163514', time=2024-09-12T03:23:14.993444+0000, chain.objs.size()=1 2024-09-12T01:38:01.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.505+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.569__shadow:.epnFl7h1BkJ302TeGQBsCcHC3aS5M2_.Y_i1kQJ-BXc6n0pWaJ-iPo9q9JakDPD_0 2024-09-12T01:38:01.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.505+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4573397105410827462', time=2024-09-12T03:23:38.466720+0000, chain.objs.size()=1 2024-09-12T01:38:01.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.505+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.577__shadow:WuxoYYyypbZ-ZieVKUuQik3XEjIpL8h_._6iZLqcUVneExQCVgA8IcZDvR9JxXXP_0 2024-09-12T01:38:01.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.505+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.161127225288528100', time=2024-09-12T03:24:39.182038+0000, chain.objs.size()=1 2024-09-12T01:38:01.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.505+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.580__shadow:lRKq1XAFChM41QgEyR9SzNNZWhNLJV2_.gKxkvQo9V8ZhaSpUeaqoUIVAuNkiPJF_0 2024-09-12T01:38:01.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.505+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3646493604080332694', time=2024-09-12T03:29:50.440550+0000, chain.objs.size()=1 2024-09-12T01:38:01.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.505+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.628__shadow_.5xd-LqfWdKt6a-vvKFoOa0QSFRVZpO8_0 2024-09-12T01:38:01.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.505+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6651394735029488094', time=2024-09-12T03:30:24.791883+0000, chain.objs.size()=1 2024-09-12T01:38:01.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.505+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.651__shadow_.5VIkmhU8HmTYwwdQegddC0Rpi0tU3jT_0 2024-09-12T01:38:01.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.505+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13533572448810143708', time=2024-09-12T03:30:59.027672+0000, chain.objs.size()=1 2024-09-12T01:38:01.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.505+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.664__shadow_.BHohFW84aE6rr87kMJRsZyk2VEqqSBy_0 2024-09-12T01:38:01.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.510+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:38:01.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.514+0000 7f8786c98800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T01:38:01.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.515+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:38:01.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.516+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:38:01.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.517+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49043' 2024-09-12T01:38:01.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.517+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11138850263886288823', time=2024-09-12T03:10:10.656312+0000, chain.objs.size()=1 2024-09-12T01:38:01.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.517+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.235__shadow_.AcOSQql_9hMGgGfuZ9v8CGUlwy2A1tH_0 2024-09-12T01:38:01.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.517+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14831287703115971320', time=2024-09-12T03:10:32.703741+0000, chain.objs.size()=1 2024-09-12T01:38:01.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.517+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.255__shadow_.Ne47al4_H350rGn7DF7V8-Od0aXTtQ6_0 2024-09-12T01:38:01.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.517+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1564096929305972576', time=2024-09-12T03:10:33.702615+0000, chain.objs.size()=1 2024-09-12T01:38:01.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.517+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.256__shadow_.m6dV5c7s3_EuVKTJms9ZlVxgqb6Kpqq_0 2024-09-12T01:38:01.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.517+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13868580247443201367', time=2024-09-12T03:10:36.452964+0000, chain.objs.size()=1 2024-09-12T01:38:01.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.517+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.259__shadow_.h-YZCilpJL690SUW5T04ogEBcL3rBJ3_0 2024-09-12T01:38:01.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.517+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15773309300543945639', time=2024-09-12T03:10:37.437991+0000, chain.objs.size()=1 2024-09-12T01:38:01.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.517+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.260__shadow_.pzNdALl5-ukOrL0UdeIQhMestKok9zy_0 2024-09-12T01:38:01.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.517+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13646745460695112514', time=2024-09-12T03:11:14.371682+0000, chain.objs.size()=1 2024-09-12T01:38:01.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.517+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.oUFFeQXClWae-fwQN-pcc_uN4fnITHv_0 2024-09-12T01:38:01.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.517+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15927438771050910009', time=2024-09-12T03:11:14.394608+0000, chain.objs.size()=1 2024-09-12T01:38:01.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.517+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.gw4Oc-BsAhpDxpmGL_7IJ4lHL4ov3RT_0 2024-09-12T01:38:01.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.517+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5140477027317072571', time=2024-09-12T03:11:14.441355+0000, chain.objs.size()=1 2024-09-12T01:38:01.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.517+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.ch5PagDlZlniGqPMLrR2OzyH8OrG54A_0 2024-09-12T01:38:01.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.517+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3832099688813981626', time=2024-09-12T03:11:14.675420+0000, chain.objs.size()=1 2024-09-12T01:38:01.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.517+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.kLDcz2tum8YGYi74lFKJ0Kk0_aUIEcD_0 2024-09-12T01:38:01.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.517+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8627178064755497977', time=2024-09-12T03:11:14.701980+0000, chain.objs.size()=1 2024-09-12T01:38:01.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.517+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.8QsJpz5tNKf5Up-w8H_Kr5ndbaPzr-H_0 2024-09-12T01:38:01.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.517+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16339776871285969191', time=2024-09-12T03:11:14.810131+0000, chain.objs.size()=1 2024-09-12T01:38:01.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.517+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.2c8mHGtMlDQAl6vYm1PszctJQUpGcea_0 2024-09-12T01:38:01.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.517+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7411795171039640095', time=2024-09-12T03:11:14.810754+0000, chain.objs.size()=1 2024-09-12T01:38:01.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.517+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.q1OvDtljQVJ6z7BIZP7gl3_ZTFVpYFD_0 2024-09-12T01:38:01.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.519+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5105330455076001093', time=2024-09-12T03:11:14.915231+0000, chain.objs.size()=1 2024-09-12T01:38:01.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.519+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.RpetzpotC68iq6i9HQOexRtFaMXrRAY_0 2024-09-12T01:38:01.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.519+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11669494189854366827', time=2024-09-12T03:11:16.116244+0000, chain.objs.size()=1 2024-09-12T01:38:01.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.519+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.cZabJOB5WaYYvbOAU2KtwYmWlnC0Gkc_0 2024-09-12T01:38:01.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.521+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15505407390645533867', time=2024-09-12T03:11:16.446051+0000, chain.objs.size()=1 2024-09-12T01:38:01.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.521+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.2WLXvWcG5t2q3CkCYqoEOonmgcI1a1c_0 2024-09-12T01:38:01.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.521+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1308891716401612122', time=2024-09-12T03:11:16.897918+0000, chain.objs.size()=1 2024-09-12T01:38:01.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.521+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.P6nI0RqAaYwjG-KnOCwChQQY6s6Noo7_0 2024-09-12T01:38:01.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.521+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16228451691198388242', time=2024-09-12T03:11:16.933307+0000, chain.objs.size()=1 2024-09-12T01:38:01.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.521+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.QquRW9C2UvpXscMo7sRHMF5l7hbxPwi_0 2024-09-12T01:38:01.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.521+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12025720302289554651', time=2024-09-12T03:11:17.411715+0000, chain.objs.size()=1 2024-09-12T01:38:01.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.521+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.X6NeS9tp2eToEaYWEzDqJV857uc_QHG_0 2024-09-12T01:38:01.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.521+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1648146016790674512', time=2024-09-12T03:11:17.582152+0000, chain.objs.size()=1 2024-09-12T01:38:01.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.521+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.ftkK_f9czGsixB8g4qj0AmsvvoPNoWI_0 2024-09-12T01:38:01.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.521+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4216284496198572202', time=2024-09-12T03:11:17.693549+0000, chain.objs.size()=1 2024-09-12T01:38:01.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.521+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.dXrtx4mEjpnfDnu8AiRppJpNprTlCVh_0 2024-09-12T01:38:01.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.521+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16697862875881105726', time=2024-09-12T03:11:17.964303+0000, chain.objs.size()=1 2024-09-12T01:38:01.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.521+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.XhrLcwtc226IAohMmP7phNbh1AnGUPv_0 2024-09-12T01:38:01.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.521+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8068266446440319604', time=2024-09-12T03:11:18.434389+0000, chain.objs.size()=1 2024-09-12T01:38:01.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.521+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.q69ETUmtDWUmxD_hpANTHkfN3oQ0NXG_0 2024-09-12T01:38:01.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.521+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5711057828084488128', time=2024-09-12T03:11:19.234431+0000, chain.objs.size()=1 2024-09-12T01:38:01.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.521+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.nO6tZDeU_VWq3AjTNMwSHaVyFEKn30Q_0 2024-09-12T01:38:01.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.521+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10521395375870742959', time=2024-09-12T03:11:19.410862+0000, chain.objs.size()=1 2024-09-12T01:38:01.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.521+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.mfUGb0GTTPpbxAdag03uIz22KjAvBlr_0 2024-09-12T01:38:01.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.521+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16122529282945819839', time=2024-09-12T03:11:19.468805+0000, chain.objs.size()=1 2024-09-12T01:38:01.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.521+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.GdMylcdgftqouPnXuk4Ea7I9JERExUq_0 2024-09-12T01:38:01.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.524+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8805107743761892960', time=2024-09-12T03:11:19.825841+0000, chain.objs.size()=1 2024-09-12T01:38:01.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.524+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.7gsNjOAXRBuOZenYnn5QJirSr66D1UY_0 2024-09-12T01:38:01.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.524+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.589634788450395632', time=2024-09-12T03:11:20.201689+0000, chain.objs.size()=1 2024-09-12T01:38:01.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.524+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.5QlIxkUUEkcBxGWzlRtB96AOHN4j5A6_0 2024-09-12T01:38:01.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.524+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5613658211322763170', time=2024-09-12T03:11:20.996847+0000, chain.objs.size()=1 2024-09-12T01:38:01.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.524+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.QNXV3kCBidxO0HDHPZyf-4DWvFdNJ9h_0 2024-09-12T01:38:01.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.524+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10632619548274500247', time=2024-09-12T03:11:21.094262+0000, chain.objs.size()=1 2024-09-12T01:38:01.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.524+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.MZ9ozyhn_VNt-wywt5O6LaeYoFXMRCN_0 2024-09-12T01:38:01.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.524+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5415169449613314955', time=2024-09-12T03:11:21.538845+0000, chain.objs.size()=1 2024-09-12T01:38:01.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.524+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.-KNofuwYLvVY3Nru0HRmyJwobojUYOr_0 2024-09-12T01:38:01.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.524+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7863911435053057865', time=2024-09-12T03:11:22.235474+0000, chain.objs.size()=1 2024-09-12T01:38:01.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.524+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.ioQ_2AufoqsmD1fwUDcBvEKvKV75ueh_0 2024-09-12T01:38:01.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.525+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11697079853237564408', time=2024-09-12T03:11:22.445423+0000, chain.objs.size()=1 2024-09-12T01:38:01.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.525+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.vIO1aJOqra22aeWdXOFksPxVTLgWkOC_0 2024-09-12T01:38:01.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.525+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5135182571109908439', time=2024-09-12T03:11:22.980703+0000, chain.objs.size()=1 2024-09-12T01:38:01.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.525+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.ThUYCKZ_g57eDaMrHBEWLg3MyhItKvY_0 2024-09-12T01:38:01.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.525+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5772012212508614435', time=2024-09-12T03:11:23.725080+0000, chain.objs.size()=1 2024-09-12T01:38:01.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.525+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.0efKQQSdYBGRUYvS7ZNlu-gTe1V6VUl_0 2024-09-12T01:38:01.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.525+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14122775237479395243', time=2024-09-12T03:11:23.750610+0000, chain.objs.size()=1 2024-09-12T01:38:01.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.525+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.YbAgEiLVFv5Uyce_Xeqe5RF7h04K2Mb_0 2024-09-12T01:38:01.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.525+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6036206896669794735', time=2024-09-12T03:11:24.685950+0000, chain.objs.size()=1 2024-09-12T01:38:01.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.525+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.-ODKwnq-92ebeErjS4PC8t4MWEsT7y0_0 2024-09-12T01:38:01.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.525+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2962008825223688967', time=2024-09-12T03:11:40.046130+0000, chain.objs.size()=1 2024-09-12T01:38:01.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.525+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.278__shadow_._T1OuKCqQDGU4SmJGThYz6rgwoZTr6i_0 2024-09-12T01:38:01.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.526+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6878530635236111766', time=2024-09-12T03:11:45.885050+0000, chain.objs.size()=1 2024-09-12T01:38:01.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.526+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.284__shadow_.-icJ6Qy1LjoQ8z9Ns8ecXGBO5pARXlC_0 2024-09-12T01:38:01.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.526+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1553171396195636562', time=2024-09-12T03:11:57.471464+0000, chain.objs.size()=1 2024-09-12T01:38:01.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.526+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.293__shadow_.FUydEZe_ktSb2mWH3Bvs2NeP7d3rNER_0 2024-09-12T01:38:01.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.526+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3192645683749033461', time=2024-09-12T03:11:59.549543+0000, chain.objs.size()=1 2024-09-12T01:38:01.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.526+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.295__shadow_.lZGF2rb39qpvk5tC6xoUOqU7eGAQS2e_0 2024-09-12T01:38:01.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.528+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4573244562011132707', time=2024-09-12T03:12:04.665926+0000, chain.objs.size()=1 2024-09-12T01:38:01.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.528+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.300__shadow_.NKQXPbZUCrmyezZ5fDkbUZFuT8-zbWd_0 2024-09-12T01:38:01.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.528+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17881034405270221496', time=2024-09-12T03:12:23.570957+0000, chain.objs.size()=1 2024-09-12T01:38:01.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.528+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.315__shadow_.Lx8sJ1GvSmHX21fow7Egh_L5I9xzBxd_0 2024-09-12T01:38:01.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.528+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13653696956169418171', time=2024-09-12T03:13:06.941725+0000, chain.objs.size()=1 2024-09-12T01:38:01.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.528+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.lJulj1c_evqI602AX70thfH3JYNZ6wF_0 2024-09-12T01:38:01.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.528+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3023195723816879296', time=2024-09-12T03:13:06.988659+0000, chain.objs.size()=1 2024-09-12T01:38:01.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.528+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.lLpJpyLdp45KyHzXEZNSfFo34mk-37x_0 2024-09-12T01:38:01.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.528+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3497376844163566603', time=2024-09-12T03:13:07.121026+0000, chain.objs.size()=1 2024-09-12T01:38:01.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.528+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.vYCjD50Vm84ja_wcLgCy8VUhhdC10p-_0 2024-09-12T01:38:01.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.529+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1992215202175705274', time=2024-09-12T03:13:07.646713+0000, chain.objs.size()=1 2024-09-12T01:38:01.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.529+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.j_rSpe8-jZlanB8cnefkyn_G6qCb6ec_0 2024-09-12T01:38:01.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.529+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3332105026753030886', time=2024-09-12T03:13:07.795184+0000, chain.objs.size()=1 2024-09-12T01:38:01.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.529+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.Alvfzrcnp4K-D1DWKyBOS6zwQ3sQ0EE_0 2024-09-12T01:38:01.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.529+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2422790780356440365', time=2024-09-12T03:13:08.278506+0000, chain.objs.size()=1 2024-09-12T01:38:01.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.529+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.8FjbJWCf8EG8Lxnb6UCEYLAIDC7HT9U_0 2024-09-12T01:38:01.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.530+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16411721905329167378', time=2024-09-12T03:13:09.043469+0000, chain.objs.size()=1 2024-09-12T01:38:01.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.530+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.nXKlS4y32sskf3BVgpNgJNrjVut43jS_0 2024-09-12T01:38:01.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.530+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1477462000018137579', time=2024-09-12T03:13:09.849113+0000, chain.objs.size()=1 2024-09-12T01:38:01.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.530+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.uwbmu0nTeFoegf0qQ962GJHFmh_CqJh_0 2024-09-12T01:38:01.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.530+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3114967742626166232', time=2024-09-12T03:13:09.877596+0000, chain.objs.size()=1 2024-09-12T01:38:01.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.530+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.-X1vutXaBb8WNNftFKCpTLRutVxomzJ_0 2024-09-12T01:38:01.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.530+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6160789814687308223', time=2024-09-12T03:13:09.987479+0000, chain.objs.size()=1 2024-09-12T01:38:01.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.530+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.6UHRH6otxbarkMOWZqjilkFA-BsMrfJ_0 2024-09-12T01:38:01.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.530+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2027104319177451588', time=2024-09-12T03:13:10.066815+0000, chain.objs.size()=1 2024-09-12T01:38:01.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.530+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.iLCmyZ-8oqvKYTOlXp9MzRhaGH9VDUV_0 2024-09-12T01:38:01.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.530+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.350913056726617065', time=2024-09-12T03:13:10.143406+0000, chain.objs.size()=1 2024-09-12T01:38:01.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.530+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.B4xn-9Zmfq5FX7MURpLfR2x08uOCOUf_0 2024-09-12T01:38:01.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.530+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10858013046070975644', time=2024-09-12T03:13:10.452900+0000, chain.objs.size()=1 2024-09-12T01:38:01.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.530+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.wZNRmTR81L8xIArBQOPmp3PEdR39zxb_0 2024-09-12T01:38:01.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.530+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15127886178381984797', time=2024-09-12T03:13:10.487397+0000, chain.objs.size()=1 2024-09-12T01:38:01.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.530+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.Y15ia1sZW3GaBJ-dnXfbJkRv2sajHY8_0 2024-09-12T01:38:01.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.530+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5305753388838566836', time=2024-09-12T03:13:11.161509+0000, chain.objs.size()=1 2024-09-12T01:38:01.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.530+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.q1vLNH4inj4jbI8LrWIe9Au85n7A1AV_0 2024-09-12T01:38:01.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.531+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13352719643726951131', time=2024-09-12T03:13:11.286742+0000, chain.objs.size()=1 2024-09-12T01:38:01.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.531+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.hyiYK4ACWtNRmWFzWppOc2VR_DV7IKV_0 2024-09-12T01:38:01.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.531+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6866836202473531402', time=2024-09-12T03:13:11.329586+0000, chain.objs.size()=1 2024-09-12T01:38:01.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.531+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.orxJVqmnqhs8oRmQWrm5Rivja2q2HAv_0 2024-09-12T01:38:01.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.532+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6610573596853554225', time=2024-09-12T03:13:11.623746+0000, chain.objs.size()=1 2024-09-12T01:38:01.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.532+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.kGde5oug7KVBL6OqNTEuMu0NjvmZ08__0 2024-09-12T01:38:01.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.532+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7356092127456066233', time=2024-09-12T03:13:12.672241+0000, chain.objs.size()=1 2024-09-12T01:38:01.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.532+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.FQCtR0SIDcpIuN9bOPV0eoPK_IQqVq3_0 2024-09-12T01:38:01.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.532+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14225092825701333932', time=2024-09-12T03:13:12.829756+0000, chain.objs.size()=1 2024-09-12T01:38:01.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.532+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_._R_D390M2wd1mHGev3W7Dl5wcBpzjCp_0 2024-09-12T01:38:01.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.532+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16412864712727801723', time=2024-09-12T03:13:13.193931+0000, chain.objs.size()=1 2024-09-12T01:38:01.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.532+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.mhmUvOxNaLkbTQ4WRPwI4FF06HtEBTh_0 2024-09-12T01:38:01.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.533+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2562339867404385466', time=2024-09-12T03:13:13.220984+0000, chain.objs.size()=1 2024-09-12T01:38:01.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.533+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.vt0HJgDUj2yM3ya01Pn5dnmRYjwW1Sx_0 2024-09-12T01:38:01.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.533+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14325943495018752445', time=2024-09-12T03:13:14.107911+0000, chain.objs.size()=1 2024-09-12T01:38:01.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.533+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.dymbQpryyEGqTdgHwGnL_Rc_zXa-L5C_0 2024-09-12T01:38:01.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.533+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9953334230942482197', time=2024-09-12T03:13:14.676402+0000, chain.objs.size()=1 2024-09-12T01:38:01.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.533+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.b3sowP0KQBGk0CC6WakQ-L_1-v7mkSE_0 2024-09-12T01:38:01.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.533+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12494520795825917554', time=2024-09-12T03:13:15.112386+0000, chain.objs.size()=1 2024-09-12T01:38:01.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.533+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.EoVpxoQzse69IS5ocm6nNtD3HOzH4fF_0 2024-09-12T01:38:01.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.533+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18336619440865553718', time=2024-09-12T03:13:15.140999+0000, chain.objs.size()=1 2024-09-12T01:38:01.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.533+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.1MDa5A-nEruQjki8p_fROk1dwvlVIxq_0 2024-09-12T01:38:01.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.533+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.319138418829549716', time=2024-09-12T03:13:15.250176+0000, chain.objs.size()=1 2024-09-12T01:38:01.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.533+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.IETYoGkxOdDLoUCHxDERh9y12dGXAew_0 2024-09-12T01:38:01.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.533+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4187523192282331165', time=2024-09-12T03:13:15.611312+0000, chain.objs.size()=1 2024-09-12T01:38:01.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.533+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.aynBaL52d0ulvkYucAfB6AFs6xkvZkH_0 2024-09-12T01:38:01.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.533+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12917398050889775378', time=2024-09-12T03:13:15.653672+0000, chain.objs.size()=1 2024-09-12T01:38:01.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.533+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.2gSmCBiWzZw3vAOpLageie7SP5Einnd_0 2024-09-12T01:38:01.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.533+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16963141882413583369', time=2024-09-12T03:13:15.918064+0000, chain.objs.size()=1 2024-09-12T01:38:01.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.533+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.ZObaPxVHDnBTjMZM-xNl79Zf08rArzy_0 2024-09-12T01:38:01.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.534+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3989928316898992353', time=2024-09-12T03:13:16.364160+0000, chain.objs.size()=1 2024-09-12T01:38:01.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.534+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.F0omPYQ5IP0bOZbQXNfkPYXd_EY_SpE_0 2024-09-12T01:38:01.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.534+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15342154124875914954', time=2024-09-12T03:13:16.638047+0000, chain.objs.size()=1 2024-09-12T01:38:01.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.534+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.r1QhS_D_QNWRegFyQshMUmgLgOAp6Oq_0 2024-09-12T01:38:01.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.534+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2995505502931626051', time=2024-09-12T03:13:53.641016+0000, chain.objs.size()=1 2024-09-12T01:38:01.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.534+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.oMDCNl77aJ4NpLPsMRnNsvhD0VqQ2sI_0 2024-09-12T01:38:01.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.534+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8255447415663780093', time=2024-09-12T03:13:53.978724+0000, chain.objs.size()=1 2024-09-12T01:38:01.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.534+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.5y9lxaqcfhO_FvcfFVbpr5NROtBhjvv_0 2024-09-12T01:38:01.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.535+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14418740425599287673', time=2024-09-12T03:13:54.032494+0000, chain.objs.size()=1 2024-09-12T01:38:01.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.535+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.7xxazkZ07fGdKBCnjCwidh-cFwHdyG-_0 2024-09-12T01:38:01.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.535+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.529582036386529505', time=2024-09-12T03:13:54.033324+0000, chain.objs.size()=1 2024-09-12T01:38:01.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.535+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.K4bGA2CBV7Har2QXBKRYD5h6ZNTY-ZI_0 2024-09-12T01:38:01.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.535+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15705529027947026451', time=2024-09-12T03:13:54.318633+0000, chain.objs.size()=1 2024-09-12T01:38:01.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.535+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.8x9Vkz60CkPgmVqFdbSTJOzIlEpkVzf_0 2024-09-12T01:38:01.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.535+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16619593966256044268', time=2024-09-12T03:13:54.319806+0000, chain.objs.size()=1 2024-09-12T01:38:01.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.535+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_._tgJ9j_Z2BW-T5cfyTvhx7O3LTC91TV_0 2024-09-12T01:38:01.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.535+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4926054001225412666', time=2024-09-12T03:13:54.324039+0000, chain.objs.size()=1 2024-09-12T01:38:01.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.535+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.f63fLI0u7QzKEuxGHu6tuQvaHUwsBid_0 2024-09-12T01:38:01.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.535+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3396135559546250561', time=2024-09-12T03:13:54.537701+0000, chain.objs.size()=1 2024-09-12T01:38:01.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.535+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.DgiBOg95I13c6G5kmd_bBmUnmsU67hY_0 2024-09-12T01:38:01.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.535+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17777941659579718415', time=2024-09-12T03:13:54.538855+0000, chain.objs.size()=1 2024-09-12T01:38:01.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.535+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.HCrXF2954j-RLExf6cq98Qorr6f-a13_0 2024-09-12T01:38:01.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.537+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3431645080838900375', time=2024-09-12T03:13:55.278563+0000, chain.objs.size()=1 2024-09-12T01:38:01.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.537+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.DuD7PHCGh4r3EXfsT_4L0qhZKsT_Qc-_0 2024-09-12T01:38:01.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.540+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11835658931510825809', time=2024-09-12T03:13:55.728125+0000, chain.objs.size()=1 2024-09-12T01:38:01.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.540+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.TKBSdc1Eu58Xa3ChqBDM6nXFWKYNCmC_0 2024-09-12T01:38:01.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.540+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15694355649661909254', time=2024-09-12T03:13:55.854667+0000, chain.objs.size()=1 2024-09-12T01:38:01.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.540+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.ZuxqOEKCUUJgtH7sZMzQxkXP8Y0Yqsi_0 2024-09-12T01:38:01.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.540+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6233281190025786846', time=2024-09-12T03:13:56.486887+0000, chain.objs.size()=1 2024-09-12T01:38:01.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.540+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.wQzXbyB-doom74lA_Ktt-qaEtLAR6ym_0 2024-09-12T01:38:01.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.540+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6249490946503611641', time=2024-09-12T03:13:56.645147+0000, chain.objs.size()=1 2024-09-12T01:38:01.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.540+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Z8qyceBRzAG6hAW4B0Q33hmJ-3_6DG8_0 2024-09-12T01:38:01.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.540+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8610673999783074085', time=2024-09-12T03:13:56.760676+0000, chain.objs.size()=1 2024-09-12T01:38:01.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.540+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Fo0-h1POOb0o3dhJonN7MHWE-nSP-ET_0 2024-09-12T01:38:01.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.540+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8440077062006405849', time=2024-09-12T03:13:56.875835+0000, chain.objs.size()=1 2024-09-12T01:38:01.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.540+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.wDBs4fv_1hc2TbM4tE2Hoz0cjsfa66l_0 2024-09-12T01:38:01.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.540+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16310890539893337688', time=2024-09-12T03:13:56.877073+0000, chain.objs.size()=1 2024-09-12T01:38:01.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.540+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Tr5-RRzKG1jLlIBHcxQuWfigFd5BoD7_0 2024-09-12T01:38:01.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.540+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17793003589950350204', time=2024-09-12T03:13:57.029345+0000, chain.objs.size()=1 2024-09-12T01:38:01.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.540+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.hImGZzWZCHn2wOCHkaKjt7z_oxreE9J_0 2024-09-12T01:38:01.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.540+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13863357481243676540', time=2024-09-12T03:13:57.396944+0000, chain.objs.size()=1 2024-09-12T01:38:01.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.540+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.G0RiwpEMlkbD9XSkkUN81e1F4CG7-V4_0 2024-09-12T01:38:01.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.540+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8054304521636793417', time=2024-09-12T03:13:57.923350+0000, chain.objs.size()=1 2024-09-12T01:38:01.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.540+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.SxHXt5Il-ul6zKZFs_ZO1stlgUMVtIN_0 2024-09-12T01:38:01.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.540+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16762007528995898274', time=2024-09-12T03:13:57.968099+0000, chain.objs.size()=1 2024-09-12T01:38:01.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.540+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.XIVqDxu7rU75NZVrTmhFeGpAfib-oPA_0 2024-09-12T01:38:01.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.542+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13394861355094017779', time=2024-09-12T03:13:58.165187+0000, chain.objs.size()=1 2024-09-12T01:38:01.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.542+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.7PYYjng5YuZMo4U_Hn63enDXonv9R_7_0 2024-09-12T01:38:01.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.543+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16521526292168346934', time=2024-09-12T03:13:58.265695+0000, chain.objs.size()=1 2024-09-12T01:38:01.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.543+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.JuK4CU135FI3Jd0rV3K__TZn3hJP75f_0 2024-09-12T01:38:01.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.543+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16329912184071978324', time=2024-09-12T03:13:58.554339+0000, chain.objs.size()=1 2024-09-12T01:38:01.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.543+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.pM9SbP7ACUo5qnY7kSebZ9VTsJ0Q7tI_0 2024-09-12T01:38:01.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.543+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10842464174267593399', time=2024-09-12T03:13:58.568324+0000, chain.objs.size()=1 2024-09-12T01:38:01.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.543+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.KsCBo-Nh6xO3yHAIoNcusxPWW748-8X_0 2024-09-12T01:38:01.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.543+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10187310493474951970', time=2024-09-12T03:13:58.652809+0000, chain.objs.size()=1 2024-09-12T01:38:01.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.543+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.U3fPXSjCyBv26-59g50mXjalwZzyEq8_0 2024-09-12T01:38:01.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.549+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 0/49043 2024-09-12T01:38:01.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.551+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=35, truncated=0, next_marker='' 2024-09-12T01:38:01.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.551+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9769949050374934900', time=2024-09-12T03:13:59.200141+0000, chain.objs.size()=1 2024-09-12T01:38:01.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.551+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.52sJRrUgjUhn3xxreZRfWxHDSMsTlnD_0 2024-09-12T01:38:01.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.551+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11104134192471062055', time=2024-09-12T03:13:59.200973+0000, chain.objs.size()=1 2024-09-12T01:38:01.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.551+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.slqLDuLSTGxyTsuzJCnTwMIgN87jgT__0 2024-09-12T01:38:01.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.551+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13789090552530523068', time=2024-09-12T03:13:59.398725+0000, chain.objs.size()=1 2024-09-12T01:38:01.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.551+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.h1O_EcbRvbQQkeHyzMPrap5_eltVb8p_0 2024-09-12T01:38:01.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.551+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10922497201827400674', time=2024-09-12T03:13:59.584748+0000, chain.objs.size()=1 2024-09-12T01:38:01.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.551+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.6C9N5COoQr-Nf8Opf9AjhorabSbRG_i_0 2024-09-12T01:38:01.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.551+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3065805691215271653', time=2024-09-12T03:13:59.765690+0000, chain.objs.size()=1 2024-09-12T01:38:01.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.551+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.S4XFR9kQZ2QPxBi9OBc-GepQqbsZ4Dt_0 2024-09-12T01:38:01.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.551+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15607395062667862266', time=2024-09-12T03:13:59.882558+0000, chain.objs.size()=1 2024-09-12T01:38:01.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.551+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.ZqN7sZRFM0F4mXogbxGw6EdCJbULpmB_0 2024-09-12T01:38:01.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.551+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16693583521663137388', time=2024-09-12T03:13:59.907109+0000, chain.objs.size()=1 2024-09-12T01:38:01.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.551+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.1RuPVDfKD9Ob79EKpch3jstH00dI8QY_0 2024-09-12T01:38:01.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.551+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17871026776131061237', time=2024-09-12T03:13:59.951402+0000, chain.objs.size()=1 2024-09-12T01:38:01.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.551+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.SdJpD9-EBa-CkgVGGKTXQRXT6sSRYtW_0 2024-09-12T01:38:01.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.551+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7867834587665854387', time=2024-09-12T03:14:00.013573+0000, chain.objs.size()=1 2024-09-12T01:38:01.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.551+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.cXfe21Xa_AsNXwk0788rgSESJNB4m1p_0 2024-09-12T01:38:01.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.551+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8374785793974675787', time=2024-09-12T03:14:00.126538+0000, chain.objs.size()=1 2024-09-12T01:38:01.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.551+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.ZVB_o2KQe-zQDFBpYU_fZo3yZQOfFi__0 2024-09-12T01:38:01.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.551+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6384515741874403777', time=2024-09-12T03:14:00.414310+0000, chain.objs.size()=1 2024-09-12T01:38:01.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.551+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.sm5l8KcRoO8oNCLTrDa6w9Z4WrSvmAq_0 2024-09-12T01:38:01.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.551+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18082641268917612887', time=2024-09-12T03:14:01.302293+0000, chain.objs.size()=1 2024-09-12T01:38:01.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.551+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.m1FxDfUXTQ1YMaqlnV0xqMN7gJrkyi6_0 2024-09-12T01:38:01.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.553+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14477021515559333400', time=2024-09-12T03:14:01.394912+0000, chain.objs.size()=1 2024-09-12T01:38:01.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.553+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.WPfaWq7HRn5MGGHhkmN7EHD0-JANQV__0 2024-09-12T01:38:01.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.553+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18294378920855127281', time=2024-09-12T03:14:01.711984+0000, chain.objs.size()=1 2024-09-12T01:38:01.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.553+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.GLGXhJVa9GR87OPgPqbdVvPQXL8hx_Q_0 2024-09-12T01:38:01.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.553+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12670129883695165836', time=2024-09-12T03:14:01.823393+0000, chain.objs.size()=1 2024-09-12T01:38:01.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.553+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_._jrGFHxqMMiowPHb-kzCvDYl_mxga2x_0 2024-09-12T01:38:01.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.553+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13118088118676224762', time=2024-09-12T03:14:02.414587+0000, chain.objs.size()=1 2024-09-12T01:38:01.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.553+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.cXtCMkpxCR5Bs42_H77jSDAepUedvC1_0 2024-09-12T01:38:01.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.555+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2693506134893513209', time=2024-09-12T03:14:03.058756+0000, chain.objs.size()=1 2024-09-12T01:38:01.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.555+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.TnnC2YDmp5FXufM7yJI2WErcb0JrYjx_0 2024-09-12T01:38:01.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.555+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4772243148918192159', time=2024-09-12T03:14:03.272925+0000, chain.objs.size()=1 2024-09-12T01:38:01.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.555+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.SnUbPpzq7VAmzhGodmbYtZaewFceJOR_0 2024-09-12T01:38:01.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.555+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5398501128773725646', time=2024-09-12T03:14:03.639942+0000, chain.objs.size()=1 2024-09-12T01:38:01.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.555+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.6X6I4RaXOiXVimWbrVtZlD_75Jqr63d_0 2024-09-12T01:38:01.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.555+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4577089588557449089', time=2024-09-12T03:15:43.370745+0000, chain.objs.size()=1 2024-09-12T01:38:01.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.555+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.431__shadow_._F00ZKhoS6uOyhYMw-N0Eka8R9Z1SLs_0 2024-09-12T01:38:01.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.555+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7787554762911486993', time=2024-09-12T03:16:48.943857+0000, chain.objs.size()=1 2024-09-12T01:38:01.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.555+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.496__shadow_.i4jpoIFBP5Jujst-3S1nFew0bLxkStq_0 2024-09-12T01:38:01.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.556+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7751179528351153877', time=2024-09-12T03:17:25.332005+0000, chain.objs.size()=6 2024-09-12T01:38:01.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.556+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.507__multipart_srcmultipart.2~ckyMCV3hbT7G8qDArZScZPf4n-CghR1.1 2024-09-12T01:38:01.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.556+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.507__multipart_srcmultipart.2~ckyMCV3hbT7G8qDArZScZPf4n-CghR1.2 2024-09-12T01:38:01.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.556+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.507__multipart_srcmultipart.2~ckyMCV3hbT7G8qDArZScZPf4n-CghR1.3 2024-09-12T01:38:01.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.556+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.507__multipart_srcmultipart.2~ckyMCV3hbT7G8qDArZScZPf4n-CghR1.4 2024-09-12T01:38:01.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.556+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.507__multipart_srcmultipart.2~ckyMCV3hbT7G8qDArZScZPf4n-CghR1.5 2024-09-12T01:38:01.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.556+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.507__multipart_srcmultipart.2~ckyMCV3hbT7G8qDArZScZPf4n-CghR1.6 2024-09-12T01:38:01.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.558+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6753130999173766977', time=2024-09-12T03:20:58.553816+0000, chain.objs.size()=2 2024-09-12T01:38:01.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.558+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.525__multipart_mymultipart.2~Cq9oQXcwwFVVbhlIDxJT2vC0PCwHjPS.1 2024-09-12T01:38:01.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.558+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.525__multipart_mymultipart.2~Cq9oQXcwwFVVbhlIDxJT2vC0PCwHjPS.2 2024-09-12T01:38:01.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.558+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7244694086973115900', time=2024-09-12T03:22:49.793505+0000, chain.objs.size()=1 2024-09-12T01:38:01.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.558+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.558__shadow_.vGF9V7WqaiUFhII8yz0LDoOauPQvR_z_0 2024-09-12T01:38:01.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.558+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2027628586315575637', time=2024-09-12T03:23:19.689823+0000, chain.objs.size()=1 2024-09-12T01:38:01.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.558+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.570__shadow:6iSR9MvKKRlgFCxqZCGP8T3ifrz-Nzr_.wAvMeEV0CBuHKkw47oNyptuuJxHXZFv_0 2024-09-12T01:38:01.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.558+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6538493459261856902', time=2024-09-12T03:23:19.958379+0000, chain.objs.size()=1 2024-09-12T01:38:01.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.558+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.570__shadow:oRJxxbv4ab5aNsuOipJQYaAVv7ohSfx_.oCTBSP63dtp0ySMJpHML5JGzFuY2SjV_0 2024-09-12T01:38:01.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.558+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13806792486813196225', time=2024-09-12T03:23:25.925319+0000, chain.objs.size()=1 2024-09-12T01:38:01.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.558+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.574__shadow_.G2uxCn_qg62OeA4P7kT3t4uW8DOB_yS_0 2024-09-12T01:38:01.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.558+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18126777625950553543', time=2024-09-12T03:23:28.049067+0000, chain.objs.size()=1 2024-09-12T01:38:01.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.558+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.574__shadow:zmF7LqPbpDSwx9Sa1YlYVPpuRAEZDnY_.1QI0WDKrBzM50PvxiCNCbFcWWYwIcl4_0 2024-09-12T01:38:01.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.558+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9477055086405597109', time=2024-09-12T03:23:30.733863+0000, chain.objs.size()=1 2024-09-12T01:38:01.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.558+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.575__shadow_.-4Xoytzbk7EY7enBa9pWAjxkrLS4S4w_0 2024-09-12T01:38:01.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.561+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4915834115288978340', time=2024-09-12T03:23:54.592599+0000, chain.objs.size()=1 2024-09-12T01:38:01.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.561+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.577__shadow:YXwKGnqcFZB9d69N-8h2a89ePBjzI8C_.0K2QYphsECWTUphxwp7ib2GezMXzKwY_0 2024-09-12T01:38:01.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.561+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4813437664407904132', time=2024-09-12T03:24:36.547600+0000, chain.objs.size()=1 2024-09-12T01:38:01.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.561+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.579__shadow:cTENW0Omu1gxYQhTfppJTRkxzpSjWz9_.IQTaj5rAZCxD-P3QjLU2gi-GjsPkHEc_0 2024-09-12T01:38:01.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.561+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8784756863375275337', time=2024-09-12T03:24:47.629715+0000, chain.objs.size()=1 2024-09-12T01:38:01.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.561+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.587__shadow:pEqmO2-i1HwBa8kOzrJPlsOqbUYJ9L._.AJlYRaDNAO3bbFYW756ycDk66TWkqDG_0 2024-09-12T01:38:01.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.561+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7164138405048041585', time=2024-09-12T03:29:59.614432+0000, chain.objs.size()=1 2024-09-12T01:38:01.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.561+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.637__shadow_.2z0Muub0sEtsfjADc9bXV0K0S6WGlA4_0 2024-09-12T01:38:01.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.562+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4898878828258838741', time=2024-09-12T03:30:31.935479+0000, chain.objs.size()=1 2024-09-12T01:38:01.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.562+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.655__shadow_.YeL-yHf1DKXVfwROFS0JWVYzsP9X95q_0 2024-09-12T01:38:01.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.562+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5749022285995140676', time=2024-09-12T03:31:32.952712+0000, chain.objs.size()=1 2024-09-12T01:38:01.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.562+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.704__shadow:TyfqLlJi72nddoe8ZgYN1ISH6Kq-TLo_.ZXbC5GJ62ECES3hMLTg4o9jwfIsu7Ac_0 2024-09-12T01:38:01.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.567+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:38:01.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.569+0000 7f8786c98800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T01:38:01.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.571+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:38:01.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.571+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:38:01.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.572+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44362' 2024-09-12T01:38:01.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.572+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2498233600860190293', time=2024-09-12T03:06:12.762607+0000, chain.objs.size()=1 2024-09-12T01:38:01.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.572+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.148__shadow_.9BgwBuT4xRdKn9IfbI8SV_g1imrcq3R_0 2024-09-12T01:38:01.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.572+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4415986365881500976', time=2024-09-12T03:06:27.746556+0000, chain.objs.size()=1 2024-09-12T01:38:01.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.572+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.158__shadow_.zqkzJ6fd0CHnwniW5yXbvf6-DQJ3uQL_0 2024-09-12T01:38:01.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.572+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16398185512035437659', time=2024-09-12T03:07:22.878219+0000, chain.objs.size()=1 2024-09-12T01:38:01.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.572+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.166__shadow_.KwOk7kZyk4ENYzQ52U8Q8tcbpcjRCGn_0 2024-09-12T01:38:01.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.572+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15125982058450206551', time=2024-09-12T03:07:41.328545+0000, chain.objs.size()=1 2024-09-12T01:38:01.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.572+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.179__shadow_.crgQ5YDZeCIrb7sGCjjS9mxTpSIBrWC_0 2024-09-12T01:38:01.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.572+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3067778020056438085', time=2024-09-12T03:07:44.707977+0000, chain.objs.size()=1 2024-09-12T01:38:01.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.572+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.183__shadow_.YNKMbmWzArcgurRNquBIHaxiY-XAGCN_0 2024-09-12T01:38:01.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.572+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13315188257200168728', time=2024-09-12T03:10:04.663133+0000, chain.objs.size()=1 2024-09-12T01:38:01.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.572+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.228__shadow_.56nF7WhkpnRSt3AkW5HqTy-Fzuqh2l9_0 2024-09-12T01:38:01.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.572+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10161975573776667265', time=2024-09-12T03:10:09.696866+0000, chain.objs.size()=1 2024-09-12T01:38:01.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.572+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.234__shadow_.AZofJvUwIRCd6unumhFEhgv_T-_Eaia_0 2024-09-12T01:38:01.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.572+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13461693310818345826', time=2024-09-12T03:10:21.932459+0000, chain.objs.size()=1 2024-09-12T01:38:01.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.572+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.244__shadow_.jur7xXyIPAYJ4_HSAQ6NroRAVdWgztl_0 2024-09-12T01:38:01.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.572+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1027090803462947063', time=2024-09-12T03:10:27.869765+0000, chain.objs.size()=1 2024-09-12T01:38:01.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.572+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.250__shadow_.e2vd0m3LtGrNwqz-bSUxSV-aQT27KHJ_0 2024-09-12T01:38:01.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.572+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12356039437413269465', time=2024-09-12T03:11:16.373017+0000, chain.objs.size()=1 2024-09-12T01:38:01.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.572+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.fr6aN5WZYPuSXnFr-OjAhIP58ERuK-x_0 2024-09-12T01:38:01.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.572+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9868184311102983448', time=2024-09-12T03:11:16.404489+0000, chain.objs.size()=1 2024-09-12T01:38:01.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.572+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.3LIg4DY4F16ToLS8zJc9liZhdJ6JGof_0 2024-09-12T01:38:01.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.572+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3080059624540411774', time=2024-09-12T03:11:16.671976+0000, chain.objs.size()=1 2024-09-12T01:38:01.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.572+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Z0B9knk3yQrlHgSLNpAq8XXg855nppf_0 2024-09-12T01:38:01.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.576+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13442370664386177286', time=2024-09-12T03:11:16.813693+0000, chain.objs.size()=1 2024-09-12T01:38:01.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.576+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.QV2iUqG1py4zcIcTnF3UPB0s0tI6Lqv_0 2024-09-12T01:38:01.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.576+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.257475900425997147', time=2024-09-12T03:11:16.846260+0000, chain.objs.size()=1 2024-09-12T01:38:01.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.576+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.VNTzdLL8k8G1QeZfuiY7mCtrXnEJXwX_0 2024-09-12T01:38:01.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.576+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11035447219412813607', time=2024-09-12T03:11:17.446493+0000, chain.objs.size()=1 2024-09-12T01:38:01.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.576+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.-y1k0tD8ha2cukD4F4tNbxEXjrtvo3i_0 2024-09-12T01:38:01.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.576+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7848013890781108828', time=2024-09-12T03:11:18.070305+0000, chain.objs.size()=1 2024-09-12T01:38:01.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.576+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Q4NAgb4ZcPhwb73WknFjNYN939ODgUp_0 2024-09-12T01:38:01.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.576+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3948021907156560915', time=2024-09-12T03:11:18.843773+0000, chain.objs.size()=1 2024-09-12T01:38:01.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.576+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.XCplluxgQEYABzCtlNRQLhOAeetq_Uu_0 2024-09-12T01:38:01.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.576+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2425395073483465602', time=2024-09-12T03:11:19.149056+0000, chain.objs.size()=1 2024-09-12T01:38:01.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.576+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.2Mtu1HeSejqb9CPFd1vioRIyoX4nel1_0 2024-09-12T01:38:01.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.576+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1028436377854370474', time=2024-09-12T03:11:19.596458+0000, chain.objs.size()=1 2024-09-12T01:38:01.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.576+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.4zjtjlSjW0CFv7x825s8OZQSeBX9FQh_0 2024-09-12T01:38:01.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.576+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5077723080463223682', time=2024-09-12T03:11:20.363824+0000, chain.objs.size()=1 2024-09-12T01:38:01.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.576+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.AlUHEhTwgbji4kee2kOYA7tsvhPupRt_0 2024-09-12T01:38:01.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.576+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9934259159100054568', time=2024-09-12T03:11:20.364531+0000, chain.objs.size()=1 2024-09-12T01:38:01.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.576+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.pVHG8ugMGL0NRh-CqlO5WvUNjp7OUNX_0 2024-09-12T01:38:01.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.576+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17410593805507788973', time=2024-09-12T03:11:20.432097+0000, chain.objs.size()=1 2024-09-12T01:38:01.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.576+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.2ojCB-f6sQR6Hyf_4guom7k69UFDHzk_0 2024-09-12T01:38:01.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.577+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6468153052589727516', time=2024-09-12T03:11:20.922073+0000, chain.objs.size()=1 2024-09-12T01:38:01.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.577+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.yWNU0TSm6PCrkcrSGxiqxmS552gVVhA_0 2024-09-12T01:38:01.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.579+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3018570022873334765', time=2024-09-12T03:11:21.040175+0000, chain.objs.size()=1 2024-09-12T01:38:01.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.579+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.1lnWVu6JQiBm__ONKjapJ7NBaIQS46Q_0 2024-09-12T01:38:01.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.579+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3342341512867966902', time=2024-09-12T03:11:22.119551+0000, chain.objs.size()=1 2024-09-12T01:38:01.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.579+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.TxZrGCXM4mpcdAo7kuW5zfTwGc8iLiu_0 2024-09-12T01:38:01.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.579+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17469066098170684361', time=2024-09-12T03:11:22.120269+0000, chain.objs.size()=1 2024-09-12T01:38:01.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.579+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.K23_5AsjYvyjdRs_-kvRDfuvz60FjJS_0 2024-09-12T01:38:01.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.579+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12079457942720923006', time=2024-09-12T03:11:22.279436+0000, chain.objs.size()=1 2024-09-12T01:38:01.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.579+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Vjzc1rKf3XRPpZvii23TX8-jxger6q2_0 2024-09-12T01:38:01.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.579+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6754808950800319816', time=2024-09-12T03:11:22.325215+0000, chain.objs.size()=1 2024-09-12T01:38:01.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.579+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.lIEIXlnCw6sC20fN26aspqGMnMN0wcQ_0 2024-09-12T01:38:01.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.579+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14533753881880102822', time=2024-09-12T03:11:22.849143+0000, chain.objs.size()=1 2024-09-12T01:38:01.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.579+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.IgHJm98nExOVRjobC15yLXCKqIkrOzH_0 2024-09-12T01:38:01.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.579+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3935412220438363798', time=2024-09-12T03:11:23.317372+0000, chain.objs.size()=1 2024-09-12T01:38:01.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.579+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.c5SsEw3g-BmNW9Dl35pcjd6N5I3zt6K_0 2024-09-12T01:38:01.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.579+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11169915996851300895', time=2024-09-12T03:11:23.495147+0000, chain.objs.size()=1 2024-09-12T01:38:01.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.580+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.RCuc0uy_WkHbUKsaHdm-fiWE0zt0MvI_0 2024-09-12T01:38:01.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.580+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1507029735452056853', time=2024-09-12T03:11:23.624998+0000, chain.objs.size()=1 2024-09-12T01:38:01.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.580+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.DuxYcUxviXyigQv4pn2mO_IzvkkDwdR_0 2024-09-12T01:38:01.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.580+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3170974139976247227', time=2024-09-12T03:11:23.822658+0000, chain.objs.size()=1 2024-09-12T01:38:01.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.580+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Ydew0lsgoJmbT9FuKwQE6qChtNbjNW5_0 2024-09-12T01:38:01.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.580+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11737294174357944102', time=2024-09-12T03:11:24.405062+0000, chain.objs.size()=1 2024-09-12T01:38:01.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.580+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.gET53OTE7cy0pm-alR-r4B_PK34HbPK_0 2024-09-12T01:38:01.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.585+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11419724004241822979', time=2024-09-12T03:11:24.769186+0000, chain.objs.size()=1 2024-09-12T01:38:01.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.585+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.7BVv3hyFgaJPXXZveygbisBXvJkBzFH_0 2024-09-12T01:38:01.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.585+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10668097518490511391', time=2024-09-12T03:11:31.455762+0000, chain.objs.size()=1 2024-09-12T01:38:01.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.585+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.269__shadow_.bRmDbCcffsOUyJB-ovVBuvYjqjeUxtx_0 2024-09-12T01:38:01.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.585+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15843463634891807581', time=2024-09-12T03:11:39.080563+0000, chain.objs.size()=1 2024-09-12T01:38:01.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.585+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.277__shadow_.PzwFAkvQX1uEzm2GIlRn_9WFNOwI1No_0 2024-09-12T01:38:01.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.585+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.212245267357142687', time=2024-09-12T03:11:39.081237+0000, chain.objs.size()=1 2024-09-12T01:38:01.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.585+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.277__shadow_.fVzCo-TCaGwghulNH7BtZ_CCmx6gkH7_0 2024-09-12T01:38:01.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.585+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12997781589178537213', time=2024-09-12T03:11:42.953093+0000, chain.objs.size()=1 2024-09-12T01:38:01.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.585+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.281__shadow_.-a3LEe7yiS5TArCU5drtRAhRKv7JH_9_0 2024-09-12T01:38:01.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.585+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17057000275223093755', time=2024-09-12T03:11:45.883824+0000, chain.objs.size()=1 2024-09-12T01:38:01.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.585+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.284__shadow_.ZspPeNNIYCAWgltefqKHslJNSC_xPC2_0 2024-09-12T01:38:01.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.585+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10551411679051801226', time=2024-09-12T03:12:00.690939+0000, chain.objs.size()=1 2024-09-12T01:38:01.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.585+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.296__shadow_.09URHi-C2MIJ2v1jxVsc9ZM7q60dE7a_0 2024-09-12T01:38:01.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.585+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2396805376328423795', time=2024-09-12T03:13:06.836331+0000, chain.objs.size()=1 2024-09-12T01:38:01.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.585+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.GkUZ9clbw8mblWtQzMtGO-oyjD3bnIn_0 2024-09-12T01:38:01.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.585+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6361683581481726469', time=2024-09-12T03:13:07.321664+0000, chain.objs.size()=1 2024-09-12T01:38:01.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.585+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.UEjsZPEtY2CxPn-fIGlAexFybeNFsgm_0 2024-09-12T01:38:01.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.585+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13294126032320947608', time=2024-09-12T03:13:07.796403+0000, chain.objs.size()=1 2024-09-12T01:38:01.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.585+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.mxqvvX-mBYnU1Eq--Lsa2xa2m7fF1L9_0 2024-09-12T01:38:01.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.585+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5212628176306266051', time=2024-09-12T03:13:07.809578+0000, chain.objs.size()=1 2024-09-12T01:38:01.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.585+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.Ttr4SBLvXERK8TE7eLdTrDuViRWEp8J_0 2024-09-12T01:38:01.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.588+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.739034917494453238', time=2024-09-12T03:13:08.963328+0000, chain.objs.size()=1 2024-09-12T01:38:01.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.588+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.7v6X6IxiVp4d5Wu3pcNqCJNMmQQjHBx_0 2024-09-12T01:38:01.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.591+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12530872861003846447', time=2024-09-12T03:13:09.050501+0000, chain.objs.size()=1 2024-09-12T01:38:01.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.591+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.zi7z20WAxz-pbxZnITH6fPSTb1Lx6t7_0 2024-09-12T01:38:01.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.591+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6423451342439979209', time=2024-09-12T03:13:10.365154+0000, chain.objs.size()=1 2024-09-12T01:38:01.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.591+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.lIx7XK8w_paMYBR9jq3WcxckEiVuqan_0 2024-09-12T01:38:01.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.591+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6007006944310990306', time=2024-09-12T03:13:10.549316+0000, chain.objs.size()=1 2024-09-12T01:38:01.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.591+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.KY52lYTRF_rCyJBKoke6NDZNUxa2WTT_0 2024-09-12T01:38:01.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.591+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16183356681373159350', time=2024-09-12T03:13:10.677609+0000, chain.objs.size()=1 2024-09-12T01:38:01.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.591+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.xYaEP05sDUMUDz2NBE8ky51oVEOINt__0 2024-09-12T01:38:01.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.591+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7900856062178533919', time=2024-09-12T03:13:11.745834+0000, chain.objs.size()=1 2024-09-12T01:38:01.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.591+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.gNYu0ycbaVsIQ4G2pInqzwuMuDFde0u_0 2024-09-12T01:38:01.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.591+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4916102578615625582', time=2024-09-12T03:13:11.746669+0000, chain.objs.size()=1 2024-09-12T01:38:01.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.591+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.RsxQfMMD276ccsqwpGmvGKUzxaWSm9T_0 2024-09-12T01:38:01.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.591+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3982629875546484116', time=2024-09-12T03:13:11.747369+0000, chain.objs.size()=1 2024-09-12T01:38:01.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.591+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.V0Nl72W2696PeuItUfMk2lEahihTsZA_0 2024-09-12T01:38:01.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.591+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6353894850743278355', time=2024-09-12T03:13:11.980427+0000, chain.objs.size()=1 2024-09-12T01:38:01.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.591+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.SPfIvka9PE2dRe9s-3MnBb5wntrVh7Z_0 2024-09-12T01:38:01.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.591+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11440750359420977640', time=2024-09-12T03:13:12.835387+0000, chain.objs.size()=1 2024-09-12T01:38:01.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.591+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.2BZvAfYRlby8oXfJzzGidV7kxihH-do_0 2024-09-12T01:38:01.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.591+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17668372174930106617', time=2024-09-12T03:13:12.870345+0000, chain.objs.size()=1 2024-09-12T01:38:01.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.591+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.OPapI_yVwAYrd_x0wKOMCqJ9CI94SvV_0 2024-09-12T01:38:01.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.591+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14772794208181103463', time=2024-09-12T03:13:12.954580+0000, chain.objs.size()=1 2024-09-12T01:38:01.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.591+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.1XsjohDfLrbwlspV-R8A2mvC3lsH8ir_0 2024-09-12T01:38:01.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.593+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5901625661075102002', time=2024-09-12T03:13:13.286688+0000, chain.objs.size()=1 2024-09-12T01:38:01.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.593+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.DmLvtoVz7QuMB5PTSHi-UdQJE-4WnuN_0 2024-09-12T01:38:01.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.596+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4720858720155851575', time=2024-09-12T03:13:13.334757+0000, chain.objs.size()=1 2024-09-12T01:38:01.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.596+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.ZVJFinLjl2TT7a-bUmRDLqvUCWZR0pf_0 2024-09-12T01:38:01.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.596+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5217651248586150055', time=2024-09-12T03:13:13.470777+0000, chain.objs.size()=1 2024-09-12T01:38:01.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.596+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.1eCF2-x3sv8fc_mEjsNtG16RFvIAyG4_0 2024-09-12T01:38:01.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.596+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3575299748515623895', time=2024-09-12T03:13:13.851331+0000, chain.objs.size()=1 2024-09-12T01:38:01.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.596+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.AJ8NldVsON0gEU5r9cWhbk2b9k0Kooa_0 2024-09-12T01:38:01.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.596+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16213916276398854793', time=2024-09-12T03:13:14.250245+0000, chain.objs.size()=1 2024-09-12T01:38:01.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.596+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.9AB_ufulF1eT3HxJpGhJWyeGXtkiM03_0 2024-09-12T01:38:01.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.596+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14775390263496374186', time=2024-09-12T03:13:14.288781+0000, chain.objs.size()=1 2024-09-12T01:38:01.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.596+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.-OZfaYlWF5s7pSC9G5_r3MQuUYIJIni_0 2024-09-12T01:38:01.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.596+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6354765084499398416', time=2024-09-12T03:13:15.914902+0000, chain.objs.size()=1 2024-09-12T01:38:01.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.596+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.pkZB50N6_1A2pc2BBAqOYLmPOMwxk5I_0 2024-09-12T01:38:01.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.596+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14401632253716881292', time=2024-09-12T03:13:16.065838+0000, chain.objs.size()=1 2024-09-12T01:38:01.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.596+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.fnaOJXa5X0vF6fhMELyg_-zoh0i9u0y_0 2024-09-12T01:38:01.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.596+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4253409612147137900', time=2024-09-12T03:13:16.842895+0000, chain.objs.size()=1 2024-09-12T01:38:01.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.596+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.CZK_kiO8SNn7zBj546IJ7SqOgSLu366_0 2024-09-12T01:38:01.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.596+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17546439296094251366', time=2024-09-12T03:13:53.766933+0000, chain.objs.size()=1 2024-09-12T01:38:01.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.596+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Bt9Xz79oPWsyC3N6LNtgQSarPj5e7hM_0 2024-09-12T01:38:01.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.596+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5377235183411514328', time=2024-09-12T03:13:53.926111+0000, chain.objs.size()=1 2024-09-12T01:38:01.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.596+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.qT504kh6D9Hx-0RY70XIuEuKUVKduJb_0 2024-09-12T01:38:01.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.596+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11513691855149422775', time=2024-09-12T03:13:54.508272+0000, chain.objs.size()=1 2024-09-12T01:38:01.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.597+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.2iNNXeJZm82Hu4L9TgjDWpzitPn-3nb_0 2024-09-12T01:38:01.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.599+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4499832883943472328', time=2024-09-12T03:13:54.539451+0000, chain.objs.size()=1 2024-09-12T01:38:01.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.599+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.xgfrRxn-RrH9i97DO1xlJ9fRSU89EN4_0 2024-09-12T01:38:01.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.599+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7653558038285109512', time=2024-09-12T03:13:54.540275+0000, chain.objs.size()=1 2024-09-12T01:38:01.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.599+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.uJQ4UoomVYWqRQ1jAtKg91pdzrnZVke_0 2024-09-12T01:38:01.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.602+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9704814307208739455', time=2024-09-12T03:13:55.341057+0000, chain.objs.size()=1 2024-09-12T01:38:01.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.602+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.RQfjTHiGBZvPJPSoNCuE3ckVDyu4OYj_0 2024-09-12T01:38:01.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.602+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17642625472019942356', time=2024-09-12T03:13:55.501898+0000, chain.objs.size()=1 2024-09-12T01:38:01.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.602+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.D2EVh2W_LsWT0WlkeNo-iXuNh-AsgKO_0 2024-09-12T01:38:01.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.602+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1753699042080307391', time=2024-09-12T03:13:55.522714+0000, chain.objs.size()=1 2024-09-12T01:38:01.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.602+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.IyX95cLV9NZ9_toETM6Bbd7rX15dUUH_0 2024-09-12T01:38:01.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.602+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16561656220815924634', time=2024-09-12T03:13:56.041183+0000, chain.objs.size()=1 2024-09-12T01:38:01.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.602+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.elLphm5jFYwxg_00xaQCeQ8BkZvBx1A_0 2024-09-12T01:38:01.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.602+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5927925545069472698', time=2024-09-12T03:13:56.727350+0000, chain.objs.size()=1 2024-09-12T01:38:01.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.602+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.vIJGNm-F34zCZPKnaWTCBZ7XkZ87Q2H_0 2024-09-12T01:38:01.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.602+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12130274935291033335', time=2024-09-12T03:13:57.119486+0000, chain.objs.size()=1 2024-09-12T01:38:01.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.602+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Unlst7fKqZXzKCO6FRvyJDTrfeSFf2T_0 2024-09-12T01:38:01.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.602+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1799930412507810722', time=2024-09-12T03:13:57.867771+0000, chain.objs.size()=1 2024-09-12T01:38:01.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.602+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.ET-wrHLeeVkh7VgU5fMlYrX2-cZPrme_0 2024-09-12T01:38:01.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.602+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5325088155763275302', time=2024-09-12T03:13:58.382536+0000, chain.objs.size()=1 2024-09-12T01:38:01.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.602+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.zxeroekYxf43Wpiv6s2j4lJvBBqdzcH_0 2024-09-12T01:38:01.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.602+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2005203589861303482', time=2024-09-12T03:13:59.228691+0000, chain.objs.size()=1 2024-09-12T01:38:01.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.602+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.uJ6ckXS5si1Yx-gdZ3gqE2eYWiGokJL_0 2024-09-12T01:38:01.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.602+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13103274012005386432', time=2024-09-12T03:13:59.506487+0000, chain.objs.size()=1 2024-09-12T01:38:01.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.602+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.LNBbaUOKMvyDygCmmFxlP44qSP6TuWM_0 2024-09-12T01:38:01.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.602+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15084971115594234730', time=2024-09-12T03:13:59.768619+0000, chain.objs.size()=1 2024-09-12T01:38:01.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.602+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.vOlAtb6i3iqpNODNHvDls4Olufkd46Z_0 2024-09-12T01:38:01.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.604+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13163322344513320285', time=2024-09-12T03:13:59.808196+0000, chain.objs.size()=1 2024-09-12T01:38:01.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.604+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.g3xoe-s0jzAfNeavf3t-1lv_2z_EMx8_0 2024-09-12T01:38:01.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.607+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13854596559870084478', time=2024-09-12T03:14:00.014950+0000, chain.objs.size()=1 2024-09-12T01:38:01.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.607+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.tv2tXefix3ApfWdDfVPy_Mf_fiOO7w4_0 2024-09-12T01:38:01.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.607+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.984612091292258872', time=2024-09-12T03:14:00.449598+0000, chain.objs.size()=1 2024-09-12T01:38:01.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.607+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.haTaERgIwtO8rgrTudqFRDnZiKMt7gD_0 2024-09-12T01:38:01.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.607+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1043745736784695564', time=2024-09-12T03:14:00.632427+0000, chain.objs.size()=1 2024-09-12T01:38:01.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.607+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.UtaCd66A_DnR_kg_fAtl63ccZHZQouW_0 2024-09-12T01:38:01.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.607+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10091129005542749879', time=2024-09-12T03:14:00.984141+0000, chain.objs.size()=1 2024-09-12T01:38:01.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.607+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.w0dOiS7SQLClTNVdn4pF3Ucu__UrFr8_0 2024-09-12T01:38:01.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.607+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.488165291107422927', time=2024-09-12T03:14:02.201558+0000, chain.objs.size()=1 2024-09-12T01:38:01.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.607+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.j5PRhv9CqTJDBhr2PgiDpOQsGsWbobj_0 2024-09-12T01:38:01.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.607+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9188654906721943352', time=2024-09-12T03:14:02.308112+0000, chain.objs.size()=1 2024-09-12T01:38:01.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.607+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.ppsm2Adfaqm4Xfm67rGXovcTcBKPVvb_0 2024-09-12T01:38:01.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.607+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10513745388694061816', time=2024-09-12T03:14:02.635453+0000, chain.objs.size()=1 2024-09-12T01:38:01.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.607+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.81Tl2aW6b5joZ3sObtFzqV9QFIt6SDa_0 2024-09-12T01:38:01.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.607+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1551897797429395899', time=2024-09-12T03:14:03.335013+0000, chain.objs.size()=1 2024-09-12T01:38:01.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.607+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.yCUoWCuSHiggbc8B5PPREMy2-M42MiZ_0 2024-09-12T01:38:01.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.607+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14335934264131839395', time=2024-09-12T03:14:03.524795+0000, chain.objs.size()=1 2024-09-12T01:38:01.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.607+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.3HXuo1GKFUbs0HvIKEHK1dVuHBI5ZWu_0 2024-09-12T01:38:01.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.607+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2174642715653672262', time=2024-09-12T03:14:03.525537+0000, chain.objs.size()=1 2024-09-12T01:38:01.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.607+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.GFx7G0CNJc9qFNE8aYreE5bmnDSMtFO_0 2024-09-12T01:38:01.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.609+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16869780934461522256', time=2024-09-12T03:14:03.526194+0000, chain.objs.size()=1 2024-09-12T01:38:01.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.609+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.DpLOqlJF66CXnrX-5pseBFW4IRPkrUY_0 2024-09-12T01:38:01.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.609+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1141950664068845487', time=2024-09-12T03:14:10.877312+0000, chain.objs.size()=1 2024-09-12T01:38:01.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.609+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.332__shadow_.GKr5uyFcuulMPhZvofKjvbuSPqyygDZ_0 2024-09-12T01:38:01.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.612+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8907043190720704852', time=2024-09-12T03:14:14.595630+0000, chain.objs.size()=1 2024-09-12T01:38:01.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.612+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.336__shadow_.zsggKc38CqBoh4THgLMd99Sc3n7g8Sl_0 2024-09-12T01:38:01.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.612+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17371286653003820487', time=2024-09-12T03:14:50.837550+0000, chain.objs.size()=1 2024-09-12T01:38:01.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.612+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.377__shadow_.9O0FF8hv42vKttnZovAN99JMxpeHcba_0 2024-09-12T01:38:01.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.612+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12218265787774957944', time=2024-09-12T03:16:42.364697+0000, chain.objs.size()=1 2024-09-12T01:38:01.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.612+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.488__shadow_.YYgitvyW6tIeyS-eNoASa_CC73nkPZ6_0 2024-09-12T01:38:01.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.612+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.371497149219945935', time=2024-09-12T03:22:24.048723+0000, chain.objs.size()=1 2024-09-12T01:38:01.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.612+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.553__shadow_.WtJT_FrYvwvFmA_U946ojZXrIMV6EzV_0 2024-09-12T01:38:01.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.612+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14099908094304338565', time=2024-09-12T03:23:11.465475+0000, chain.objs.size()=1 2024-09-12T01:38:01.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.612+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.569__shadow:a0DMp.GoE3VNazD7sk2.qO9R3d0jguF_.wlGPqw_uIEtlod-o8Z3-jUMrq1d0cdy_0 2024-09-12T01:38:01.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.618+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 0/44362 2024-09-12T01:38:01.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.621+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-12T01:38:01.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.621+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16716033609512702395', time=2024-09-12T03:23:23.975905+0000, chain.objs.size()=1 2024-09-12T01:38:01.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.621+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.573__shadow_.d7Cw4xrhMWAp-yFQQQV2k0yY_GRbiRu_0 2024-09-12T01:38:01.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.621+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15753797087804289430', time=2024-09-12T03:23:32.424269+0000, chain.objs.size()=1 2024-09-12T01:38:01.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.621+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.576__shadow:Xsu3GLj9TqvpGT40fXpiREAECK285hZ_.6NiZ09ePfQDdK46G6EgyyhUTTcrPfsV_0 2024-09-12T01:38:01.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.621+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5539919181171016577', time=2024-09-12T03:23:41.103006+0000, chain.objs.size()=1 2024-09-12T01:38:01.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.621+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.577__shadow:o6p69RRL.R0vgx-M-Zk5iikWBsaY54D_.7Ho0_XEEVZUf9iPMCvC1di9-76_DFaG_0 2024-09-12T01:38:01.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.621+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16200232895289102230', time=2024-09-12T03:24:36.435682+0000, chain.objs.size()=1 2024-09-12T01:38:01.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.621+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.579__shadow:-ZHDXtnWmgztwe5zVY8HmK8eZzS7Ul._.kSSYxWdnoo0HjWGYPsZ73OkXVhnFbCg_0 2024-09-12T01:38:01.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.621+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16982429254003294125', time=2024-09-12T03:24:45.672643+0000, chain.objs.size()=1 2024-09-12T01:38:01.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.621+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.586__shadow:ryZjPWVibO7Gr3ypRLhcwZ.ksVsDpCU_.ssrcjyKPT_e9ndQJ5deQMTExQsRCmTi_0 2024-09-12T01:38:01.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.621+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11414709466128739197', time=2024-09-12T03:24:47.670224+0000, chain.objs.size()=1 2024-09-12T01:38:01.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.621+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.587__shadow:90STqto1cdfpiqjhH.JuxtB9nUlSdVL_.qY9nZrAopX8rLJ6rHXyxwh9wgH_NZqt_0 2024-09-12T01:38:01.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.621+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11776858747741247310', time=2024-09-12T03:30:23.888982+0000, chain.objs.size()=1 2024-09-12T01:38:01.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.621+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.650__shadow_.8hOdEvFNCdq31G9Iv_w6JaASizN1Ftt_0 2024-09-12T01:38:01.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.621+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15123717544992389039', time=2024-09-12T03:31:01.822643+0000, chain.objs.size()=1 2024-09-12T01:38:01.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.621+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.666__shadow_.I_fCJSDmwKChf2qqr5V8P7hP4zAIuXy_0 2024-09-12T01:38:01.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.621+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10349876681507086286', time=2024-09-12T03:31:35.741008+0000, chain.objs.size()=1 2024-09-12T01:38:01.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.621+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.707__shadow:vJ-V0FBr26Ugh45zCQPTjrrlWR6AaPL_.0ky6MZM3Jbw3njAHoiTpxuipnALirHA_0 2024-09-12T01:38:01.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.621+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6270420629802374054', time=2024-09-12T03:31:40.189485+0000, chain.objs.size()=1 2024-09-12T01:38:01.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.621+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.712__shadow:V4lBSxFhh5vH1uSSrSB1niOZaI8f7FB_.KbTaP3xmM92Z6y2JxJD09nQuFmzAmEs_0 2024-09-12T01:38:01.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.621+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11216481060931711343', time=2024-09-12T03:33:11.738194+0000, chain.objs.size()=1 2024-09-12T01:38:01.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.621+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.745__shadow_.318ddyRIgxA_tNvHFWZuu42WTUsT-zG_0 2024-09-12T01:38:01.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.626+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:38:01.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.628+0000 7f8786c98800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T01:38:01.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.629+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:38:01.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.630+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:38:01.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.630+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46480' 2024-09-12T01:38:01.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.630+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8642109135038508952', time=2024-09-12T03:07:26.701462+0000, chain.objs.size()=1 2024-09-12T01:38:01.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.630+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.170__shadow_.HCrIkFaWI_hbBjRG3VrO79-ElcPgHWT_0 2024-09-12T01:38:01.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.630+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9321595314530431064', time=2024-09-12T03:07:43.029360+0000, chain.objs.size()=1 2024-09-12T01:38:01.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.630+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.181__shadow_.ItiXmidXazIT6BqQXp6sx3zQ3XYVfvW_0 2024-09-12T01:38:01.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.630+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16849090033885662978', time=2024-09-12T03:08:09.857473+0000, chain.objs.size()=1 2024-09-12T01:38:01.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.630+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.199__shadow_.J0gkFyZhda_SFIiZsqXi-f95KS1NHd5_0 2024-09-12T01:38:01.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.630+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.679169829052673422', time=2024-09-12T03:10:13.315998+0000, chain.objs.size()=1 2024-09-12T01:38:01.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.630+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.237__shadow_.UtLM5B9qt3Qu8Q2o2PGrizaBD_nNi0G_0 2024-09-12T01:38:01.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.630+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7703136807863941447', time=2024-09-12T03:10:14.940191+0000, chain.objs.size()=1 2024-09-12T01:38:01.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.630+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.238__shadow_.ul3V-dXnsE1liTXTonvbFuTHu4dXM5E_0 2024-09-12T01:38:01.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.630+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10529549402878781344', time=2024-09-12T03:10:17.647866+0000, chain.objs.size()=1 2024-09-12T01:38:01.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.630+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.241__shadow_.685xZ6-Nn08Ou6eVmJ5bYmEe6HIxPkv_0 2024-09-12T01:38:01.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.630+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7129413500963434822', time=2024-09-12T03:10:20.280964+0000, chain.objs.size()=1 2024-09-12T01:38:01.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.630+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.243__shadow_.ERaXMs8yom1nIfIT67oCoHrcovoBBwQ_0 2024-09-12T01:38:01.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.630+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13322424468284533125', time=2024-09-12T03:10:23.854481+0000, chain.objs.size()=1 2024-09-12T01:38:01.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.630+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.246__shadow_.7w3QNLzN-chTV2In5VOAjqIaeZ3qMjA_0 2024-09-12T01:38:01.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.630+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7931356749119303119', time=2024-09-12T03:10:24.933799+0000, chain.objs.size()=1 2024-09-12T01:38:01.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.630+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.247__shadow_.HEOTNWR2xD_I99AvVbgd4ptI2n_0DMd_0 2024-09-12T01:38:01.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.630+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5648677561341998022', time=2024-09-12T03:10:26.898839+0000, chain.objs.size()=1 2024-09-12T01:38:01.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.630+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.249__shadow_.GaMcO56MG5OyIbrNe3XzYuDW_fjt70C_0 2024-09-12T01:38:01.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.630+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13946095167511663654', time=2024-09-12T03:10:27.870389+0000, chain.objs.size()=1 2024-09-12T01:38:01.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.630+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.250__shadow_.u_BGrfx35j8qqcC1FUbZ97JWtdWyCv5_0 2024-09-12T01:38:01.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.630+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11535111260894005473', time=2024-09-12T03:10:29.784039+0000, chain.objs.size()=1 2024-09-12T01:38:01.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.630+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.252__shadow_.IjElwUBfyofv9Xq9i9deldm4G89BRQ7_0 2024-09-12T01:38:01.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.632+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11037514199336462820', time=2024-09-12T03:11:14.440717+0000, chain.objs.size()=1 2024-09-12T01:38:01.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.632+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.GjRfMwOIJ5dt6Yiq7HKrNBZguPAQGVa_0 2024-09-12T01:38:01.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.632+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8807516096800069218', time=2024-09-12T03:11:14.598990+0000, chain.objs.size()=1 2024-09-12T01:38:01.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.632+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.WLQNennovqJQd2E12rsM-VU14d-21B2_0 2024-09-12T01:38:01.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.632+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12999593227003307014', time=2024-09-12T03:11:14.611789+0000, chain.objs.size()=1 2024-09-12T01:38:01.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.632+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.BC_7B-Ie1vQEldZcp23uPIsPTDVXWjj_0 2024-09-12T01:38:01.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.632+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7203344489738190532', time=2024-09-12T03:11:14.970324+0000, chain.objs.size()=1 2024-09-12T01:38:01.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.632+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.CRtcpyrmr_cSamGZW2sYPVJvlKupFL-_0 2024-09-12T01:38:01.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.632+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17154608626881349860', time=2024-09-12T03:11:15.051277+0000, chain.objs.size()=1 2024-09-12T01:38:01.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.632+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.DamK2_xKyagnjQy1GSGJX_Eed3EsaIR_0 2024-09-12T01:38:01.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.632+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11550090278419647385', time=2024-09-12T03:11:15.405263+0000, chain.objs.size()=1 2024-09-12T01:38:01.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.632+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_._QJDvvHl58N2uOKVrEwB1ZU5vLkBOZh_0 2024-09-12T01:38:01.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.632+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7736014535138781712', time=2024-09-12T03:11:15.408559+0000, chain.objs.size()=1 2024-09-12T01:38:01.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.632+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.IfyjqkJpP-bdKsbRCV-rRsQRhNC8lDb_0 2024-09-12T01:38:01.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.635+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14035974909854170639', time=2024-09-12T03:11:15.966841+0000, chain.objs.size()=1 2024-09-12T01:38:01.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.635+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.zj88feP6acABEdimemqrAkbSsPGIKYY_0 2024-09-12T01:38:01.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.635+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3094550457230524137', time=2024-09-12T03:11:15.973867+0000, chain.objs.size()=1 2024-09-12T01:38:01.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.635+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.o-SjUpukz6thDdUT7LI_NDTtq_ccPPX_0 2024-09-12T01:38:01.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.635+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12766307257016499979', time=2024-09-12T03:11:16.232737+0000, chain.objs.size()=1 2024-09-12T01:38:01.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.635+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.y_iAgHEa5XN2JfTdIKTEnWvnqECwePA_0 2024-09-12T01:38:01.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.635+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2513994229093257862', time=2024-09-12T03:11:16.595644+0000, chain.objs.size()=1 2024-09-12T01:38:01.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.635+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.6Jbj_bxej-7r2O3nzLQA33OGOAkshcn_0 2024-09-12T01:38:01.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.635+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3009287574572213488', time=2024-09-12T03:11:16.678736+0000, chain.objs.size()=1 2024-09-12T01:38:01.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.635+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.TK2T-q48dThbztkjuIaNCEtLtMO0Qhi_0 2024-09-12T01:38:01.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.635+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16915857023426270063', time=2024-09-12T03:11:16.806868+0000, chain.objs.size()=1 2024-09-12T01:38:01.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.635+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.cYFYnvOzMrY6CbVRFnQvaSDF_cOdIT5_0 2024-09-12T01:38:01.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.635+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12809437417744640238', time=2024-09-12T03:11:16.942537+0000, chain.objs.size()=1 2024-09-12T01:38:01.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.635+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.ZztRJom3C8QhowSGRbie0kCrETfy94p_0 2024-09-12T01:38:01.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.635+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12852991772089777940', time=2024-09-12T03:11:17.617766+0000, chain.objs.size()=1 2024-09-12T01:38:01.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.635+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.FukiJBQay6GHxFtDkq_NAo57hipZEv0_0 2024-09-12T01:38:01.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.636+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11143618578187433437', time=2024-09-12T03:11:17.618303+0000, chain.objs.size()=1 2024-09-12T01:38:01.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.636+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.XbGebNu-RGDMQSc5tVWeOi6oHp3dnIY_0 2024-09-12T01:38:01.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.636+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2960521895909947737', time=2024-09-12T03:11:17.722442+0000, chain.objs.size()=1 2024-09-12T01:38:01.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.636+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.LbfewyV1BGliw3O0QU_Ch2WrPHtLUCa_0 2024-09-12T01:38:01.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.636+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11315570367557465238', time=2024-09-12T03:11:17.807960+0000, chain.objs.size()=1 2024-09-12T01:38:01.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.636+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.xd7dN8nmnDvh9IrNzs_nt4afi30TiSB_0 2024-09-12T01:38:01.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.641+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13102491746310322610', time=2024-09-12T03:11:18.926392+0000, chain.objs.size()=1 2024-09-12T01:38:01.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.641+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.bEXj1ObXJgk8WKdqGKntbAO-AoIb5sN_0 2024-09-12T01:38:01.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.641+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16667967206390494281', time=2024-09-12T03:11:18.988111+0000, chain.objs.size()=1 2024-09-12T01:38:01.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.641+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.JoHI9ZBnYeSiHhZfVVqAfl9W7uL_A-4_0 2024-09-12T01:38:01.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.641+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10449174334331806141', time=2024-09-12T03:11:19.350951+0000, chain.objs.size()=1 2024-09-12T01:38:01.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.641+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.wgszyWHzTaHNeEVMqDtWuQj9oQMXoBP_0 2024-09-12T01:38:01.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.641+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16077014477584504442', time=2024-09-12T03:11:19.723004+0000, chain.objs.size()=1 2024-09-12T01:38:01.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.641+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Rpuot-SLm18CsFAHKRRsWvnxGp-pRk0_0 2024-09-12T01:38:01.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.641+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5042940034951352397', time=2024-09-12T03:11:19.837044+0000, chain.objs.size()=1 2024-09-12T01:38:01.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.641+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.6eEvXepKyHVMxYoLBs1HmKaSG-ggwbt_0 2024-09-12T01:38:01.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.641+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11438626603880352013', time=2024-09-12T03:11:20.256354+0000, chain.objs.size()=1 2024-09-12T01:38:01.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.641+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.zmORv550cSfxPMZmq0Ps9NvaDLPM4wK_0 2024-09-12T01:38:01.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.641+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10202653009812271380', time=2024-09-12T03:11:20.495034+0000, chain.objs.size()=1 2024-09-12T01:38:01.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.641+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.6LgkIzQdlAHC8SYuoU0ISu4YHSgp2lt_0 2024-09-12T01:38:01.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.641+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11068808677607227093', time=2024-09-12T03:11:20.875393+0000, chain.objs.size()=1 2024-09-12T01:38:01.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.641+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.LhJgmz_eJs9WcnCsn5PV1OnZ0VK2AfG_0 2024-09-12T01:38:01.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.641+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7671403326813039037', time=2024-09-12T03:11:21.080026+0000, chain.objs.size()=1 2024-09-12T01:38:01.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.641+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.hm-9Kz6yvwy8Q6_4K5xvmoPTIZSUauA_0 2024-09-12T01:38:01.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.641+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12379410850202231856', time=2024-09-12T03:11:21.124344+0000, chain.objs.size()=1 2024-09-12T01:38:01.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.641+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.7bp9YWDQdZj9sNVICJynaAYl29Q9R7e_0 2024-09-12T01:38:01.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.641+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12822280144769495556', time=2024-09-12T03:11:21.732635+0000, chain.objs.size()=1 2024-09-12T01:38:01.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.641+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.JhvxQfSjhhFeHjaXLgra6ddDIxPNcTl_0 2024-09-12T01:38:01.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.644+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2200466299080053923', time=2024-09-12T03:11:22.118631+0000, chain.objs.size()=1 2024-09-12T01:38:01.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.644+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.LfNtBbTG44YgfSrk5s4PN5eaGV1HT4m_0 2024-09-12T01:38:01.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.644+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.945383539452370639', time=2024-09-12T03:11:22.523838+0000, chain.objs.size()=1 2024-09-12T01:38:01.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.644+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.X1BFZRmbTc3E-2JQDU8mRorIhEpcwOZ_0 2024-09-12T01:38:01.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.644+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13840651172967546844', time=2024-09-12T03:11:22.825464+0000, chain.objs.size()=1 2024-09-12T01:38:01.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.644+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.z85nxq04mSVqU8Apfg_VsTvWE0YZnLs_0 2024-09-12T01:38:01.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.644+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2948157090815923469', time=2024-09-12T03:11:23.021007+0000, chain.objs.size()=1 2024-09-12T01:38:01.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.644+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.03MvePyba2q-7NvCIlFkQSl6Ypkls06_0 2024-09-12T01:38:01.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.647+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9801326870990796456', time=2024-09-12T03:11:23.021688+0000, chain.objs.size()=1 2024-09-12T01:38:01.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.647+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.qGBRI0uyryRjo4N1CbuDH607iYDWWoW_0 2024-09-12T01:38:01.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.647+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10998349554962555414', time=2024-09-12T03:11:23.088800+0000, chain.objs.size()=1 2024-09-12T01:38:01.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.647+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.7RUVBj5i6ZC1ZADGYg-5iYUcSo5cEOc_0 2024-09-12T01:38:01.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.647+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9865196171597488538', time=2024-09-12T03:11:23.273670+0000, chain.objs.size()=1 2024-09-12T01:38:01.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.647+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.XxiLKXUE2BBXyQEJ-K-peT_HY66bzaa_0 2024-09-12T01:38:01.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.647+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9793757752238673934', time=2024-09-12T03:11:23.477394+0000, chain.objs.size()=1 2024-09-12T01:38:01.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.647+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.zSkiB_DmVK9kZSXTI8h4Qw2NdT9xnaL_0 2024-09-12T01:38:01.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.647+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.761342473591435376', time=2024-09-12T03:11:50.838239+0000, chain.objs.size()=1 2024-09-12T01:38:01.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.647+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.289__shadow_.Z1n0rgABlps1OPYpq7v7VGkNTKIQOCx_0 2024-09-12T01:38:01.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.647+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10373725760674342626', time=2024-09-12T03:11:55.320884+0000, chain.objs.size()=1 2024-09-12T01:38:01.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.647+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.292__shadow_.wbaiu3-B32CL1_0QsaKGkmxpHizTIwN_0 2024-09-12T01:38:01.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.647+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12178782948258912722', time=2024-09-12T03:11:55.419230+0000, chain.objs.size()=1 2024-09-12T01:38:01.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.647+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.292__shadow_.LlUyaHI4Urz6ZMyqLbDgj3awdOUN_h1_0 2024-09-12T01:38:01.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.647+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1862929571700902222', time=2024-09-12T03:12:18.067342+0000, chain.objs.size()=1 2024-09-12T01:38:01.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.647+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.313__shadow_.7uzYZH8fr_5KPNXEZwnOrI4P-047KV7_0 2024-09-12T01:38:01.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.647+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10524722448930267112', time=2024-09-12T03:12:28.941292+0000, chain.objs.size()=1 2024-09-12T01:38:01.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.647+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.321__shadow_.0YjZJujkwkzHEtJl0o30mPOsgSetl4h_0 2024-09-12T01:38:01.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.647+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.565054685096401309', time=2024-09-12T03:13:07.109254+0000, chain.objs.size()=1 2024-09-12T01:38:01.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.647+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.-JfBROPgRt7uqNsGnOeCjr0egA8USA9_0 2024-09-12T01:38:01.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.647+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9865873407340380230', time=2024-09-12T03:13:07.470278+0000, chain.objs.size()=1 2024-09-12T01:38:01.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.647+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.7ASIPPFoD8EVt14FPbGIQP-7tm9Hz64_0 2024-09-12T01:38:01.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.652+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11834880967259169346', time=2024-09-12T03:13:07.470859+0000, chain.objs.size()=1 2024-09-12T01:38:01.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.652+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.y1dr_G9xcCSy7VRVacRF8NhlrR0buIZ_0 2024-09-12T01:38:01.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.653+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8901878641110960402', time=2024-09-12T03:13:07.500317+0000, chain.objs.size()=1 2024-09-12T01:38:01.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.653+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.F_cNR0spfpFw1IsUIF2-5x6BLtSSiSz_0 2024-09-12T01:38:01.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.653+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1893568317150793886', time=2024-09-12T03:13:07.797690+0000, chain.objs.size()=1 2024-09-12T01:38:01.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.653+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.nKfDUIOsrCyORTq1aOj36Kr1-_rp35d_0 2024-09-12T01:38:01.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.653+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9605628826922698408', time=2024-09-12T03:13:08.493441+0000, chain.objs.size()=1 2024-09-12T01:38:01.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.653+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.LhJUGg40IgRn-YdEUG4EYfSZi6Kq91b_0 2024-09-12T01:38:01.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.653+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11967275935722550075', time=2024-09-12T03:13:08.541978+0000, chain.objs.size()=1 2024-09-12T01:38:01.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.653+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.CiOG6ThqiREr_YOiNkmFP4F1vCsy07R_0 2024-09-12T01:38:01.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.653+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5049415012960106460', time=2024-09-12T03:13:08.609611+0000, chain.objs.size()=1 2024-09-12T01:38:01.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.653+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.vpUXYqwbxk2aIFuaMK12R_0jIyICQ3W_0 2024-09-12T01:38:01.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.653+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13025935118254055649', time=2024-09-12T03:13:08.610300+0000, chain.objs.size()=1 2024-09-12T01:38:01.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.653+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.9FtOQMQiUT7J7oiT5T9i9DG3JYr3w-4_0 2024-09-12T01:38:01.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.653+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7245445770114228549', time=2024-09-12T03:13:08.672784+0000, chain.objs.size()=1 2024-09-12T01:38:01.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.653+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.rFXMsfuUOVb9Ag-CiWZhA6dPXdyVN3P_0 2024-09-12T01:38:01.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.653+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3065877333977884186', time=2024-09-12T03:13:09.118309+0000, chain.objs.size()=1 2024-09-12T01:38:01.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.653+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.6bdIg4XbgHqmy6S6mmQSW9Er2T_MgFH_0 2024-09-12T01:38:01.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.653+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5816965330536412258', time=2024-09-12T03:13:09.845332+0000, chain.objs.size()=1 2024-09-12T01:38:01.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.653+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.csT_EN8vvbnVlicm1U0C6pJK-QWKfLy_0 2024-09-12T01:38:01.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.653+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5411558597253912764', time=2024-09-12T03:13:10.293685+0000, chain.objs.size()=1 2024-09-12T01:38:01.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.653+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.GEs9VylUDjabUZPPrLcKDYK8gbmadu1_0 2024-09-12T01:38:01.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.654+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2001467072217893090', time=2024-09-12T03:13:10.446807+0000, chain.objs.size()=1 2024-09-12T01:38:01.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.654+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.fOMyR0N4pGAtfN1Nv_5PKniff5GuXWM_0 2024-09-12T01:38:01.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.655+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10129483088755624735', time=2024-09-12T03:13:10.540027+0000, chain.objs.size()=1 2024-09-12T01:38:01.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.655+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.UEKTKrbZxzQpBl1WKUnJ_yF4cz9FROG_0 2024-09-12T01:38:01.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.655+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1291102750368063428', time=2024-09-12T03:13:11.289457+0000, chain.objs.size()=1 2024-09-12T01:38:01.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.655+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.618-evhePPXvWvpOAgHSZRyZJZ25xHb_0 2024-09-12T01:38:01.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.655+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16317792990752280925', time=2024-09-12T03:13:11.593961+0000, chain.objs.size()=1 2024-09-12T01:38:01.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.655+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.IvzEclVNJ95wN79gLTHO-48TG9f53Z-_0 2024-09-12T01:38:01.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.655+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6981968570149446873', time=2024-09-12T03:13:12.026090+0000, chain.objs.size()=1 2024-09-12T01:38:01.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.655+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.7B7stwPL9mPp3iKiAQtGFKOY_gXxfXy_0 2024-09-12T01:38:01.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.656+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7108429376380705212', time=2024-09-12T03:13:12.098651+0000, chain.objs.size()=1 2024-09-12T01:38:01.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.656+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.w3zd16oobMlXvHAAD8TOVpaI-eBV8Pl_0 2024-09-12T01:38:01.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.656+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14179037756471020089', time=2024-09-12T03:13:12.517655+0000, chain.objs.size()=1 2024-09-12T01:38:01.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.656+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.tWVHg-CZvLkzXOINZyPA-z_hoP4GRQ4_0 2024-09-12T01:38:01.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.656+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17695599192852616868', time=2024-09-12T03:13:12.579765+0000, chain.objs.size()=1 2024-09-12T01:38:01.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.656+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.61wkzeROxKhbvOD_SazUFgun62CKrtt_0 2024-09-12T01:38:01.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.656+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15384935512202967130', time=2024-09-12T03:13:13.054227+0000, chain.objs.size()=1 2024-09-12T01:38:01.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.656+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.zZiyTnofOy_OAoaNH2olnEkbDLP4OQY_0 2024-09-12T01:38:01.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.656+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5535014659506156791', time=2024-09-12T03:13:13.951390+0000, chain.objs.size()=1 2024-09-12T01:38:01.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.656+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.WY6vLTC8iSNuBMqagO1G7bV_QeK_zzr_0 2024-09-12T01:38:01.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.656+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4320846772154163113', time=2024-09-12T03:13:14.403671+0000, chain.objs.size()=1 2024-09-12T01:38:01.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.656+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.MLKA_MPgiSSuuMyMnYcKUkaWzCOBdIP_0 2024-09-12T01:38:01.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.656+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14186542233311990052', time=2024-09-12T03:13:15.446946+0000, chain.objs.size()=1 2024-09-12T01:38:01.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.656+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.eJ3ZvvHyBodZ3wHncwiHXpm5ED6V81v_0 2024-09-12T01:38:01.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.657+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7818658940429591865', time=2024-09-12T03:13:15.610225+0000, chain.objs.size()=1 2024-09-12T01:38:01.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.657+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.L8hRHpez6balOSDctHMkElf3SiVtgEG_0 2024-09-12T01:38:01.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.658+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11707058360123064728', time=2024-09-12T03:13:15.964587+0000, chain.objs.size()=1 2024-09-12T01:38:01.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.658+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.D-Mg3udsEuaaL5jVEJc1S31t2JSljCg_0 2024-09-12T01:38:01.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.658+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4624814433880108007', time=2024-09-12T03:13:16.492557+0000, chain.objs.size()=1 2024-09-12T01:38:01.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.658+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.uh6kC1Epu3tk8nPcI0BTllqoaZabPXU_0 2024-09-12T01:38:01.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.658+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9404565787700056537', time=2024-09-12T03:13:16.524401+0000, chain.objs.size()=1 2024-09-12T01:38:01.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.658+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.teYGyrGqGqw1fe3hXq9Tc6i53Rt6yIO_0 2024-09-12T01:38:01.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.661+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6499385435884893294', time=2024-09-12T03:13:53.602004+0000, chain.objs.size()=1 2024-09-12T01:38:01.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.661+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.zJBEdDKLFmBB4qTk1BcGSXlZpIoQNo0_0 2024-09-12T01:38:01.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.661+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16832203000862421078', time=2024-09-12T03:13:53.602865+0000, chain.objs.size()=1 2024-09-12T01:38:01.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.661+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.0q0sfc9Kr0rR932i7itjZTGRBE3Y1Vr_0 2024-09-12T01:38:01.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.661+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16400275053598829284', time=2024-09-12T03:13:53.719155+0000, chain.objs.size()=1 2024-09-12T01:38:01.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.661+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.4OcjKh5M6wAH6DRz4QRY-Cgx3lqsw5M_0 2024-09-12T01:38:01.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.661+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13168381737468382684', time=2024-09-12T03:13:55.347840+0000, chain.objs.size()=1 2024-09-12T01:38:01.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.661+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.ci70CyjJhr_-LDgX9xaZYVCdEYFRyut_0 2024-09-12T01:38:01.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.661+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17411968633150383150', time=2024-09-12T03:13:55.587243+0000, chain.objs.size()=1 2024-09-12T01:38:01.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.661+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.JfcmUjMtNBVejpIoBzIW8nkdWsPCuXv_0 2024-09-12T01:38:01.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.661+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10435822602454529439', time=2024-09-12T03:13:56.000167+0000, chain.objs.size()=1 2024-09-12T01:38:01.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.661+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.bw52O-9kNTBhttnhXVLKv1lkp13VWVg_0 2024-09-12T01:38:01.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.661+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15998869942595678932', time=2024-09-12T03:13:56.459538+0000, chain.objs.size()=1 2024-09-12T01:38:01.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.661+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.t8Vh6iCzNILAx9X6wyqjtMdCU7VYX8G_0 2024-09-12T01:38:01.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.664+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8822787863734981349', time=2024-09-12T03:13:56.644347+0000, chain.objs.size()=1 2024-09-12T01:38:01.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.664+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.tZk_JcUMfZqzYzMeCf5fzSxfQwxByML_0 2024-09-12T01:38:01.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.664+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12822106094152780812', time=2024-09-12T03:13:56.750604+0000, chain.objs.size()=1 2024-09-12T01:38:01.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.664+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.ZmGaKZV2W_T04c6xjUcwpi2OIqPqclr_0 2024-09-12T01:38:01.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.664+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13820034749854881252', time=2024-09-12T03:13:56.880023+0000, chain.objs.size()=1 2024-09-12T01:38:01.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.664+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.MdFX6einnDbeurIJ-xAWCKFNp91CDoZ_0 2024-09-12T01:38:01.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.664+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3447407343319795871', time=2024-09-12T03:13:56.900257+0000, chain.objs.size()=1 2024-09-12T01:38:01.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.664+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.sA5KrJLpH92DbR949J6KxewKsmw5jaP_0 2024-09-12T01:38:01.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.664+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16779935992363872942', time=2024-09-12T03:13:57.412014+0000, chain.objs.size()=1 2024-09-12T01:38:01.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.664+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.YebrnYIcMiAydKXk9qEVtJlZrmVMMNV_0 2024-09-12T01:38:01.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.667+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.935271496693685067', time=2024-09-12T03:13:57.824080+0000, chain.objs.size()=1 2024-09-12T01:38:01.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.667+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.evHkq_elyFUZKig9p7_A4iQrr8MdadI_0 2024-09-12T01:38:01.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.667+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4728563906684176630', time=2024-09-12T03:13:58.502882+0000, chain.objs.size()=1 2024-09-12T01:38:01.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.667+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.ghNHXprs6uK5ltRSWJrnTmrPeUhYueq_0 2024-09-12T01:38:01.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.667+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3571376372562780261', time=2024-09-12T03:13:58.687502+0000, chain.objs.size()=1 2024-09-12T01:38:01.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.667+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.9TP21SZNrAUaEGmtdEECd8HUqk6rpFW_0 2024-09-12T01:38:01.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.667+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5848826875629328870', time=2024-09-12T03:13:58.799200+0000, chain.objs.size()=1 2024-09-12T01:38:01.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.667+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.MAaV1E4-yKbgbEBat9DD6_AXMdF4-ZD_0 2024-09-12T01:38:01.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.667+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3754813329366249388', time=2024-09-12T03:13:59.504761+0000, chain.objs.size()=1 2024-09-12T01:38:01.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.667+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.7eb69KSNgG0Z4dOJO_fDJuCgGtQYaFj_0 2024-09-12T01:38:01.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.670+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 0/46480 2024-09-12T01:38:01.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.672+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=27, truncated=0, next_marker='' 2024-09-12T01:38:01.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.672+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11584873596664076201', time=2024-09-12T03:14:00.458820+0000, chain.objs.size()=1 2024-09-12T01:38:01.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.672+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.NuPPEIFaT8oDuPTTg1e0qTrGzR3J0ix_0 2024-09-12T01:38:01.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.672+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14217470410282968856', time=2024-09-12T03:14:00.633913+0000, chain.objs.size()=1 2024-09-12T01:38:01.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.672+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.rDsfpmEsSag6i6Q1Oijquu4puaojhL6_0 2024-09-12T01:38:01.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.672+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1594954187221974702', time=2024-09-12T03:14:00.761025+0000, chain.objs.size()=1 2024-09-12T01:38:01.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.672+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.07z3l3Ud41tKefULuYEBp74y9OKiL1L_0 2024-09-12T01:38:01.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.672+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.259149314384092797', time=2024-09-12T03:14:00.833875+0000, chain.objs.size()=1 2024-09-12T01:38:01.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.672+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.8TP-2k19BKkvVy3NIuVG0gx25gKWmJn_0 2024-09-12T01:38:01.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.672+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12042952561043136278', time=2024-09-12T03:14:00.993118+0000, chain.objs.size()=1 2024-09-12T01:38:01.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.672+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.N74_d2ht3J_hNrI2qt_q2lmYz3zqxEj_0 2024-09-12T01:38:01.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.672+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7397684261244686580', time=2024-09-12T03:14:01.267162+0000, chain.objs.size()=1 2024-09-12T01:38:01.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.672+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.WohqOwmiDYR0KZspngqMvPXavIPJ4m9_0 2024-09-12T01:38:01.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.672+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6021620410014488040', time=2024-09-12T03:14:01.950665+0000, chain.objs.size()=1 2024-09-12T01:38:01.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.672+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.oOMbjBliHwzt0LqeRgCLxBgubmyHOkI_0 2024-09-12T01:38:01.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.672+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1889422492363509441', time=2024-09-12T03:14:02.174763+0000, chain.objs.size()=1 2024-09-12T01:38:01.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.672+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.5cCz8ZWK801PmFMcr7bLsGBVJGsW-ar_0 2024-09-12T01:38:01.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.672+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17283690489628169554', time=2024-09-12T03:14:02.398712+0000, chain.objs.size()=1 2024-09-12T01:38:01.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.672+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.H06wD17g2NHXGFu_ZnHNvELUOv-W84y_0 2024-09-12T01:38:01.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.672+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17271950302220937572', time=2024-09-12T03:14:02.563181+0000, chain.objs.size()=1 2024-09-12T01:38:01.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.672+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.V3D_4nAdNNxM7QQgd3JCIoSNwSuXwLi_0 2024-09-12T01:38:01.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.672+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14006202768884616660', time=2024-09-12T03:14:02.941250+0000, chain.objs.size()=1 2024-09-12T01:38:01.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.672+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.t1j9FF7BMnHuQ2WlnOk901Bso1qG2Ca_0 2024-09-12T01:38:01.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.672+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8655889437138706311', time=2024-09-12T03:14:03.090311+0000, chain.objs.size()=1 2024-09-12T01:38:01.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.672+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.kwVEANDb5cX1Cvt14PP6jtPG7MFj8Sa_0 2024-09-12T01:38:01.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.674+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5429669961087985795', time=2024-09-12T03:16:34.344302+0000, chain.objs.size()=1 2024-09-12T01:38:01.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.674+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.483__shadow_.9Ig_InTYxFIwN0K_cQTDwwjArdCK5u__0 2024-09-12T01:38:01.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.674+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10507884235034840067', time=2024-09-12T03:16:44.001458+0000, chain.objs.size()=1 2024-09-12T01:38:01.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.674+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.490__shadow_.lu3Qd4cmM1m3fpey6aaeLIv9NccUtco_0 2024-09-12T01:38:01.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.674+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10507884235034840067', time=2024-09-12T03:16:44.260968+0000, chain.objs.size()=1 2024-09-12T01:38:01.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.674+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.490__shadow_.lu3Qd4cmM1m3fpey6aaeLIv9NccUtco_0 2024-09-12T01:38:01.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.676+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17258107793475118162', time=2024-09-12T03:16:48.945997+0000, chain.objs.size()=1 2024-09-12T01:38:01.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.676+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.496__shadow_.i4jpoIFBP5Jujst-3S1nFew0bLxkStq_0 2024-09-12T01:38:01.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.677+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8260346922915098930', time=2024-09-12T03:16:52.069803+0000, chain.objs.size()=1 2024-09-12T01:38:01.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.677+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.499__shadow_.gxiScUEf_jIXJqSM-8EAzdh_AuiRcYa_0 2024-09-12T01:38:01.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.677+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4379642759707856450', time=2024-09-12T03:17:43.618174+0000, chain.objs.size()=1 2024-09-12T01:38:01.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.677+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.517__shadow_.ZcbzLbKsFJ6z6iUkat0EvAmdOKljrBo_0 2024-09-12T01:38:01.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.677+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16686424034327457322', time=2024-09-12T03:19:01.647611+0000, chain.objs.size()=6 2024-09-12T01:38:01.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.677+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.522__multipart_mymultipart.eJemNU0k-jRCF4MSw1bXJT3UcaMA1gva.1 2024-09-12T01:38:01.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.677+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.522__multipart_mymultipart.2~Ktf5mKcD_Oo_Pba39zv3fRhNmov8E2I.2 2024-09-12T01:38:01.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.677+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.522__multipart_mymultipart.2~Ktf5mKcD_Oo_Pba39zv3fRhNmov8E2I.3 2024-09-12T01:38:01.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.677+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.522__multipart_mymultipart.2~Ktf5mKcD_Oo_Pba39zv3fRhNmov8E2I.4 2024-09-12T01:38:01.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.677+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.522__multipart_mymultipart.2~Ktf5mKcD_Oo_Pba39zv3fRhNmov8E2I.5 2024-09-12T01:38:01.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.677+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.522__multipart_mymultipart.2~Ktf5mKcD_Oo_Pba39zv3fRhNmov8E2I.6 2024-09-12T01:38:01.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.677+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.242281830057474556', time=2024-09-12T03:23:12.988368+0000, chain.objs.size()=1 2024-09-12T01:38:01.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.677+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.569__shadow:USuSVv1mp5HsHc5OJcTsq1wF35oih4._.YfbFDdsStx09yh2SeeV7Q6oliXeJ3ou_0 2024-09-12T01:38:01.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.677+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3097538830813585230', time=2024-09-12T03:23:36.371340+0000, chain.objs.size()=1 2024-09-12T01:38:01.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.677+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.576__shadow:PJ4lQ6YmfIHsWsbv0kdsVE9Tc.Cim9-_.dHj8befRYbUnGyKDLseY_oMqs5zDRjW_0 2024-09-12T01:38:01.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.678+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6302932450917495396', time=2024-09-12T03:23:44.347049+0000, chain.objs.size()=1 2024-09-12T01:38:01.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.678+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.577__shadow:hQj2rS8zdzRxLAuueKKNqUV7g9gGpBl_.HRDfEFiQqad8tLm41tK1uYNb_FHUo2o_0 2024-09-12T01:38:01.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.679+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12783906579432527890', time=2024-09-12T03:24:36.444933+0000, chain.objs.size()=1 2024-09-12T01:38:01.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.679+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.579__shadow:iEv601hzWjW6kuXXmZ2eZRzIy6M8l1Q_.qBca1zEktCyLV54UXfMCEMajGi2myos_0 2024-09-12T01:38:01.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.679+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3710540664037021851', time=2024-09-12T03:24:36.635359+0000, chain.objs.size()=1 2024-09-12T01:38:01.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.679+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.579__shadow:PJEAAt33P92LF4HgMbZXTLUA9uz0lSl_.PTctT4nmD94FCbOkoWHTE_NdCPuVVGf_0 2024-09-12T01:38:01.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.679+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17308015433420822970', time=2024-09-12T03:31:12.009368+0000, chain.objs.size()=1 2024-09-12T01:38:01.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.679+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.679__shadow_.VCe5_tF78pL5c4RKiP-4qxTLHulVUa5_0 2024-09-12T01:38:01.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.679+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14132930917447285775', time=2024-09-12T03:31:22.152779+0000, chain.objs.size()=1 2024-09-12T01:38:01.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.679+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.692__shadow:yOGQkR7TyD1Cjjab5AH1mYtkvZNQ3Gm_.gVyNB3jAWZercggfHqB5XgGcG4RLpZr_0 2024-09-12T01:38:01.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.679+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5092339301409802615', time=2024-09-12T03:32:49.589383+0000, chain.objs.size()=1 2024-09-12T01:38:01.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.679+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.744__shadow_.Tca-N2iyUijUhbkh4EgmYrSwjtfUFa3_0 2024-09-12T01:38:01.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.683+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:38:01.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.685+0000 7f8786c98800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T01:38:01.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.686+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:38:01.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.686+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:38:01.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.687+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/52147' 2024-09-12T01:38:01.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.687+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10075304925113797519', time=2024-09-12T03:06:43.135806+0000, chain.objs.size()=2 2024-09-12T01:38:01.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.687+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.160__shadow_.RMWx550kAhh2_gKeJeKb1JlZcDZmARp_0 2024-09-12T01:38:01.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.687+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.160__shadow_.RMWx550kAhh2_gKeJeKb1JlZcDZmARp_1 2024-09-12T01:38:01.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.687+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='_C2q9wJpS7FRJ8GHEStAYe4XM5M9Wxau', time=2024-09-12T03:07:22.144958+0000, chain.objs.size()=1 2024-09-12T01:38:01.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.687+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.165__shadow_.Uqm3fnOxAKCSiHBZ6QV_mzKba5YKkA2_0 2024-09-12T01:38:01.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.687+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6660629893223150664', time=2024-09-12T03:07:49.845494+0000, chain.objs.size()=1 2024-09-12T01:38:01.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.687+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.189__shadow_.wacL-TzkJgGNlUYI6DmM3XE8GMAyqrK_0 2024-09-12T01:38:01.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.687+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.680089135341644986', time=2024-09-12T03:10:26.898906+0000, chain.objs.size()=1 2024-09-12T01:38:01.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.687+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.249__shadow_.uWdE2j066Y_71ZFcF3EA9DtNX4kFIaQ_0 2024-09-12T01:38:01.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.687+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7383765441070253009', time=2024-09-12T03:10:37.434713+0000, chain.objs.size()=1 2024-09-12T01:38:01.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.687+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.260__shadow_.TMvJV1a1MGBO1pdYo8b3eTf9brII00f_0 2024-09-12T01:38:01.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.687+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17814846334606766857', time=2024-09-12T03:11:14.439979+0000, chain.objs.size()=1 2024-09-12T01:38:01.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.687+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.3P0LQJ4GIDN4w3pT_1m4ZfcClc2H32y_0 2024-09-12T01:38:01.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.687+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7185693144123671890', time=2024-09-12T03:11:14.466878+0000, chain.objs.size()=1 2024-09-12T01:38:01.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.687+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.LQTB73f9Abbif1VtrOqWEtMN7w0yaHE_0 2024-09-12T01:38:01.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.687+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3947766384667643451', time=2024-09-12T03:11:15.203321+0000, chain.objs.size()=1 2024-09-12T01:38:01.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.687+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.IhWOASPmKqeBoTJ7pj0MyIGx-FkMkB8_0 2024-09-12T01:38:01.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.687+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2420636478769371266', time=2024-09-12T03:11:16.111721+0000, chain.objs.size()=1 2024-09-12T01:38:01.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.687+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Ek0yyWrT8cTEoFZeqirPR5atC1ZHGEE_0 2024-09-12T01:38:01.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.687+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15364093665967750129', time=2024-09-12T03:11:16.581340+0000, chain.objs.size()=1 2024-09-12T01:38:01.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.687+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.iBtRjVRRKIsWfZm5mNfobGqOEjLWnql_0 2024-09-12T01:38:01.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.687+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5447219513033514978', time=2024-09-12T03:11:16.643552+0000, chain.objs.size()=1 2024-09-12T01:38:01.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.687+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.9G-Bip8A5v6SqQ5rM_2crMubnCpNdm4_0 2024-09-12T01:38:01.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.690+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15375056189773389068', time=2024-09-12T03:11:16.677815+0000, chain.objs.size()=1 2024-09-12T01:38:01.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.690+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.7duDWcizOg-CFyN1JC_Osc8uLtJGXQC_0 2024-09-12T01:38:01.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.691+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14078346274919697913', time=2024-09-12T03:11:16.678503+0000, chain.objs.size()=1 2024-09-12T01:38:01.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.691+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.yNc63kbDON1Rl0u10rt0eYME3_Y2_dB_0 2024-09-12T01:38:01.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.691+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6906398933301429130', time=2024-09-12T03:11:17.403431+0000, chain.objs.size()=1 2024-09-12T01:38:01.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.691+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.atrPbHPHk7HIiSYuoxnjO2lSAtLmqkX_0 2024-09-12T01:38:01.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.691+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9917403853248522096', time=2024-09-12T03:11:17.404291+0000, chain.objs.size()=1 2024-09-12T01:38:01.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.691+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.PUbv-08_ZSkTiNaCMKakmVUrmYWogsT_0 2024-09-12T01:38:01.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.691+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5219549091374104182', time=2024-09-12T03:11:17.614221+0000, chain.objs.size()=1 2024-09-12T01:38:01.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.691+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.QmaRTAYuGHrLK4y7ySUOuEuEets3HKt_0 2024-09-12T01:38:01.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.691+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11334940289064606120', time=2024-09-12T03:11:17.847933+0000, chain.objs.size()=1 2024-09-12T01:38:01.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.691+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_._dw6O8HCHDUn4Gslmwrk7VQ_5fNXRLW_0 2024-09-12T01:38:01.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.691+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4686184875042032146', time=2024-09-12T03:11:18.300222+0000, chain.objs.size()=1 2024-09-12T01:38:01.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.691+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.ebHAB0U3tYnNRuKIyUrZzpOq31QFQOn_0 2024-09-12T01:38:01.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.691+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12532755469423586992', time=2024-09-12T03:11:18.433597+0000, chain.objs.size()=1 2024-09-12T01:38:01.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.691+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.ZtkEHNIAGEuF22YXQzrUUi2thV0C2S4_0 2024-09-12T01:38:01.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.691+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17605408952009595619', time=2024-09-12T03:11:19.233898+0000, chain.objs.size()=1 2024-09-12T01:38:01.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.691+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.Mpx4a9W_w_R4hx87g02mwPRv0weQ7AE_0 2024-09-12T01:38:01.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.691+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5227898100685772702', time=2024-09-12T03:11:19.405918+0000, chain.objs.size()=1 2024-09-12T01:38:01.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.691+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.QDKZuUcQeETmmjeqVQXnsOb4n46Utnk_0 2024-09-12T01:38:01.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.691+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14611815448188909871', time=2024-09-12T03:11:19.521056+0000, chain.objs.size()=1 2024-09-12T01:38:01.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.691+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_._rmVvn7goC004x4tWOlDuQQ8y8w9OmE_0 2024-09-12T01:38:01.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.692+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1150877286577407835', time=2024-09-12T03:11:20.240108+0000, chain.objs.size()=1 2024-09-12T01:38:01.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.692+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.hg97WR0kHTwV-EscdFaV8SU897PpUsw_0 2024-09-12T01:38:01.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.693+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4405356442651055383', time=2024-09-12T03:11:20.393757+0000, chain.objs.size()=1 2024-09-12T01:38:01.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.693+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.wzMfEy8nKrEX1TqVbQt4I8KkUVSInXO_0 2024-09-12T01:38:01.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.693+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3561341861012966154', time=2024-09-12T03:11:20.462386+0000, chain.objs.size()=1 2024-09-12T01:38:01.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.693+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.dmQYSUAZIdt7QEv9e40qG80hG42qetV_0 2024-09-12T01:38:01.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.695+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12088124597414630180', time=2024-09-12T03:11:20.551839+0000, chain.objs.size()=1 2024-09-12T01:38:01.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.695+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.28tHgZnb_tc23nkO-_3ekqjeveaHrhR_0 2024-09-12T01:38:01.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.695+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.972456497839883123', time=2024-09-12T03:11:20.671619+0000, chain.objs.size()=1 2024-09-12T01:38:01.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.695+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.6Ahmg6xp9yRAMCjyNJufPf7HMhC8f-K_0 2024-09-12T01:38:01.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.695+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12175312551019155349', time=2024-09-12T03:11:20.736641+0000, chain.objs.size()=1 2024-09-12T01:38:01.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.695+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.FeKLG876fw1BOAmrokZfZqFn8W6Jy6G_0 2024-09-12T01:38:01.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.695+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3524295680738568183', time=2024-09-12T03:11:21.063365+0000, chain.objs.size()=1 2024-09-12T01:38:01.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.695+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_._xMtA0Hp2lImD0p2VZTHfYLHPOydMIc_0 2024-09-12T01:38:01.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.695+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3863141255956379283', time=2024-09-12T03:11:22.463468+0000, chain.objs.size()=1 2024-09-12T01:38:01.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.695+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.r8yITCZOjfOh6Y5VfkEJI7ITtSPpL3m_0 2024-09-12T01:38:01.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.695+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15130823555271788499', time=2024-09-12T03:11:22.507512+0000, chain.objs.size()=1 2024-09-12T01:38:01.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.695+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.WcpDL8eTCBPgokN3nhEUxS10sHx01zw_0 2024-09-12T01:38:01.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.695+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.709892801617849005', time=2024-09-12T03:11:23.546031+0000, chain.objs.size()=1 2024-09-12T01:38:01.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.695+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.3H64cLxgNaNyoKirLENUeiX0i2zrBl2_0 2024-09-12T01:38:01.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.695+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4519493362261920916', time=2024-09-12T03:11:23.821912+0000, chain.objs.size()=1 2024-09-12T01:38:01.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.695+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.2cCxG2cveNTifX6AClzl99L-F0EWETT_0 2024-09-12T01:38:01.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.695+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5188029860000913029', time=2024-09-12T03:11:24.081745+0000, chain.objs.size()=1 2024-09-12T01:38:01.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.695+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.YVzDNahd0i9zVBsO7GMQiraapLvXt17_0 2024-09-12T01:38:01.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.696+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18079718765615946663', time=2024-09-12T03:11:24.121757+0000, chain.objs.size()=1 2024-09-12T01:38:01.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.696+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.4DrX9uNLdWQxqhB4PxwYU9Ee-8cymE7_0 2024-09-12T01:38:01.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.696+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11629524602180628725', time=2024-09-12T03:11:24.481412+0000, chain.objs.size()=1 2024-09-12T01:38:01.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.696+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.FXMCXubUtO-tMUA5tfVyeYzL6Bn2QPL_0 2024-09-12T01:38:01.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.701+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3850070988373509091', time=2024-09-12T03:11:24.639911+0000, chain.objs.size()=1 2024-09-12T01:38:01.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.701+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.sAm78NuJRbVqzOxG7Z6IjA_6q4FbB7b_0 2024-09-12T01:38:01.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.701+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9227562022841526999', time=2024-09-12T03:11:28.677174+0000, chain.objs.size()=1 2024-09-12T01:38:01.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.701+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.266__shadow_.1apFNofobYW8o-sRU5PwWt3o8kwpQYQ_0 2024-09-12T01:38:01.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.701+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11325311745295444845', time=2024-09-12T03:11:40.038715+0000, chain.objs.size()=1 2024-09-12T01:38:01.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.701+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.278__shadow_.FWovMHXe3eZ32rMLaAKs7uK7bW1vxjw_0 2024-09-12T01:38:01.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.701+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3713272263138401381', time=2024-09-12T03:11:43.924611+0000, chain.objs.size()=1 2024-09-12T01:38:01.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.701+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.282__shadow_.5qw4Cttau-ytBxkSJBJd69d81zFBQEI_0 2024-09-12T01:38:01.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.701+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17915601100848938490', time=2024-09-12T03:11:51.797303+0000, chain.objs.size()=1 2024-09-12T01:38:01.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.701+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.290__shadow_.tvwVPYy1tUc5ndk_3ZViDjR6CrNEkh9_0 2024-09-12T01:38:01.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.701+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2493935471045761376', time=2024-09-12T03:11:55.421125+0000, chain.objs.size()=1 2024-09-12T01:38:01.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.701+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.292__shadow_.Ie7XLf2P_Q6WGYF0MeFnxMS9rWDbKB4_0 2024-09-12T01:38:01.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.701+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5819779275542662073', time=2024-09-12T03:11:57.508951+0000, chain.objs.size()=1 2024-09-12T01:38:01.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.701+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.293__shadow_.DRGwO9kPri_y4TNjsvavRCRIxG8fClt_0 2024-09-12T01:38:01.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.701+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.597603153306753096', time=2024-09-12T03:12:30.054057+0000, chain.objs.size()=1 2024-09-12T01:38:01.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.701+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.322__shadow_.CQFFpxDYd9hBrtVbxu1Mk4-LvpkLUA4_0 2024-09-12T01:38:01.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.701+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9143377084478134670', time=2024-09-12T03:13:06.834026+0000, chain.objs.size()=1 2024-09-12T01:38:01.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.701+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.svU-aML0rzQaYbWSqSf-R8bnkVlJon9_0 2024-09-12T01:38:01.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.701+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5313800878349115085', time=2024-09-12T03:13:06.906566+0000, chain.objs.size()=1 2024-09-12T01:38:01.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.701+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.UsCgHUlvx95oHJW9kicunvvIyrmhfFc_0 2024-09-12T01:38:01.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.701+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8289733740025837960', time=2024-09-12T03:13:06.930786+0000, chain.objs.size()=1 2024-09-12T01:38:01.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.701+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.BjexYgRC3YdQtv1QkGfe4Ng0MjCtdry_0 2024-09-12T01:38:01.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.702+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16082196200755371533', time=2024-09-12T03:13:07.274129+0000, chain.objs.size()=1 2024-09-12T01:38:01.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.702+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.fmUrZvUk0nc6RKn5DCj2g7jAKzJuXMK_0 2024-09-12T01:38:01.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.706+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2045930463504852916', time=2024-09-12T03:13:07.445003+0000, chain.objs.size()=1 2024-09-12T01:38:01.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.706+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.vYpavzzoPfAfwRBrPla3QTci1UllHpL_0 2024-09-12T01:38:01.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.706+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5014509830507471253', time=2024-09-12T03:13:07.495898+0000, chain.objs.size()=1 2024-09-12T01:38:01.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.706+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.gF9H9tNbFIVF8a7r1paoQ49o2RsDivk_0 2024-09-12T01:38:01.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.706+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11523609263499551598', time=2024-09-12T03:13:07.541873+0000, chain.objs.size()=1 2024-09-12T01:38:01.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.706+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.AL5KFgtTbOn0xPyPvjy67ha1-eheyFn_0 2024-09-12T01:38:01.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.706+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16057776408310193660', time=2024-09-12T03:13:07.644261+0000, chain.objs.size()=1 2024-09-12T01:38:01.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.706+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.Fy5q6L9vIovzEGCGFpiFccqQauNx3bJ_0 2024-09-12T01:38:01.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.706+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1377510731808008579', time=2024-09-12T03:13:08.374500+0000, chain.objs.size()=1 2024-09-12T01:38:01.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.706+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.cAx6Kxh6oDp53Q_vXcyJdhJyVk0tXOF_0 2024-09-12T01:38:01.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.706+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16253895407564622833', time=2024-09-12T03:13:08.913615+0000, chain.objs.size()=1 2024-09-12T01:38:01.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.706+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.xBMeAcNJS4-mxLigfuagG4PpIG55Whf_0 2024-09-12T01:38:01.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.706+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11148833501715303908', time=2024-09-12T03:13:09.270201+0000, chain.objs.size()=1 2024-09-12T01:38:01.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.706+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.IGOTCaqKLUfLAEiKkv7k5qS-Dk5_XQV_0 2024-09-12T01:38:01.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.706+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13450821873244420882', time=2024-09-12T03:13:09.747727+0000, chain.objs.size()=1 2024-09-12T01:38:01.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.706+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.VkFRHjp1_S2amYNgllEkyutvBpq6Ylb_0 2024-09-12T01:38:01.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.706+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5682799629836890472', time=2024-09-12T03:13:09.748263+0000, chain.objs.size()=1 2024-09-12T01:38:01.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.706+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.p01lsWtnSLC77Qpg1n5eJRzCdvUg5fn_0 2024-09-12T01:38:01.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.706+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.641013195621466004', time=2024-09-12T03:13:09.848390+0000, chain.objs.size()=1 2024-09-12T01:38:01.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.706+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.j1S5luF8pCU5Kmjn-iZfwzjr6vjcEWE_0 2024-09-12T01:38:01.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.706+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14006001709154687729', time=2024-09-12T03:13:10.281668+0000, chain.objs.size()=1 2024-09-12T01:38:01.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.706+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.K4MsOHVx7eqK8vModTnjFGT_Uexm5xj_0 2024-09-12T01:38:01.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.709+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4567599734662560266', time=2024-09-12T03:13:10.514082+0000, chain.objs.size()=1 2024-09-12T01:38:01.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.709+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.zx-ahNJTYJoZVi7yDijbEud0IsBmjY2_0 2024-09-12T01:38:01.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.712+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12149289286558135583', time=2024-09-12T03:13:11.167068+0000, chain.objs.size()=1 2024-09-12T01:38:01.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.712+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.A8gXucGDwBBqEyyo392qsV4CsiV4AJt_0 2024-09-12T01:38:01.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.712+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12691785456507083109', time=2024-09-12T03:13:11.167602+0000, chain.objs.size()=1 2024-09-12T01:38:01.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.712+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.K1aiPR8OzQdBDwWbQNT7VikQiwyWNt3_0 2024-09-12T01:38:01.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.712+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14876117449390244746', time=2024-09-12T03:13:12.702825+0000, chain.objs.size()=1 2024-09-12T01:38:01.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.712+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.WW0browXG-SXeXfdxZcE_0OJTIjeoJu_0 2024-09-12T01:38:01.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.712+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4827595632380284236', time=2024-09-12T03:13:12.976052+0000, chain.objs.size()=1 2024-09-12T01:38:01.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.712+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.bfz_1HUKXbdnKDCxPJL2f0eDsr6qcPj_0 2024-09-12T01:38:01.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.712+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1249868568397484092', time=2024-09-12T03:13:13.189419+0000, chain.objs.size()=1 2024-09-12T01:38:01.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.712+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_._FxrpaYry5GUZQemh8aKHIjUfLlcOTq_0 2024-09-12T01:38:01.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.712+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11057283772825424261', time=2024-09-12T03:13:13.414990+0000, chain.objs.size()=1 2024-09-12T01:38:01.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.712+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.DDBnXTvfYjn5t1Th0IdjN-V3KV53rut_0 2024-09-12T01:38:01.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.712+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6870733316643335299', time=2024-09-12T03:13:14.025882+0000, chain.objs.size()=1 2024-09-12T01:38:01.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.712+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.4M3npIG-yfzek7RFwuSwasQmE5fab9i_0 2024-09-12T01:38:01.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.712+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3965737106549532253', time=2024-09-12T03:13:14.163021+0000, chain.objs.size()=1 2024-09-12T01:38:01.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.712+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.48yY5mrHVGTODu2NgmStLZ1d9OVo-44_0 2024-09-12T01:38:01.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.712+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9407134507482061023', time=2024-09-12T03:13:14.556838+0000, chain.objs.size()=1 2024-09-12T01:38:01.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.712+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.HZoCdiCRGD5wYEph6FscnnTUr18vrqB_0 2024-09-12T01:38:01.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.712+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15074830964202119841', time=2024-09-12T03:13:14.667285+0000, chain.objs.size()=1 2024-09-12T01:38:01.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.712+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.uHAuvzaSoQDQ_Fk1uJUd16VB4naI6yI_0 2024-09-12T01:38:01.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.712+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2231180855590954199', time=2024-09-12T03:13:15.151103+0000, chain.objs.size()=1 2024-09-12T01:38:01.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.712+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.Bp6bF1OEDO80M8Etv2KxMhMlCo8YpSm_0 2024-09-12T01:38:01.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.713+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2140889997909208541', time=2024-09-12T03:13:15.326856+0000, chain.objs.size()=1 2024-09-12T01:38:01.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.713+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_._dh672Pp6t9X7gjPWtVaCUODXh8uv6I_0 2024-09-12T01:38:01.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.713+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4366550888270412272', time=2024-09-12T03:13:15.535990+0000, chain.objs.size()=1 2024-09-12T01:38:01.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.713+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.ESz9XUBPlRzP-fLgwbgOLTV6cILeQCB_0 2024-09-12T01:38:01.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.714+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5212949508946565700', time=2024-09-12T03:13:15.713560+0000, chain.objs.size()=1 2024-09-12T01:38:01.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.714+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.rItTqKjsPmM-EkXYd6P5q4yr0HIOy7__0 2024-09-12T01:38:01.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.714+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6217057376009996713', time=2024-09-12T03:13:16.672819+0000, chain.objs.size()=1 2024-09-12T01:38:01.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.714+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_._2EWDymlheLfBo52W5M_UfOKPV1n3XA_0 2024-09-12T01:38:01.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.714+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12193021821163375954', time=2024-09-12T03:13:16.673564+0000, chain.objs.size()=1 2024-09-12T01:38:01.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.714+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.4KU9Wcw-3gQJ77-7U1kxnT9MszVbnrA_0 2024-09-12T01:38:01.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.714+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10019153631613151708', time=2024-09-12T03:13:16.988914+0000, chain.objs.size()=1 2024-09-12T01:38:01.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.714+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.1_baRFV7YpS5_AT8l-c1aCr1uf4t49O_0 2024-09-12T01:38:01.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.714+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10344584971953018347', time=2024-09-12T03:13:53.577968+0000, chain.objs.size()=1 2024-09-12T01:38:01.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.714+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.vHu486JMwMRzl13hKchOQfpyimYEZ6t_0 2024-09-12T01:38:01.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.714+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14924917047822148826', time=2024-09-12T03:13:54.033253+0000, chain.objs.size()=1 2024-09-12T01:38:01.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.714+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.hsrpXaICLZWSoknBZc5sGMS9a6nT8Bc_0 2024-09-12T01:38:01.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.714+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4674950913621618560', time=2024-09-12T03:13:54.076050+0000, chain.objs.size()=1 2024-09-12T01:38:01.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.714+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.iFKmIs40ttbWEgYdzou63q0rrQU8RE5_0 2024-09-12T01:38:01.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.714+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9229446649911693364', time=2024-09-12T03:13:54.294943+0000, chain.objs.size()=1 2024-09-12T01:38:01.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.714+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.-ahXaC3-qu2c9n5jcgV34RLP9R6_Q2d_0 2024-09-12T01:38:01.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.714+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14573316206830414933', time=2024-09-12T03:13:54.305991+0000, chain.objs.size()=1 2024-09-12T01:38:01.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.714+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.vC-o-tuADl43NJpiUayXYHsYjdnP0P__0 2024-09-12T01:38:01.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.715+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10407414508675312383', time=2024-09-12T03:13:54.359430+0000, chain.objs.size()=1 2024-09-12T01:38:01.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.715+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.VeNf3iHz2h3jATDQUWn8U8jpT8dw9z-_0 2024-09-12T01:38:01.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.715+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2407447643391473232', time=2024-09-12T03:13:54.533258+0000, chain.objs.size()=1 2024-09-12T01:38:01.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.715+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.h1TtcwzG7pU4_2ZyNQY3xA2WTv20fRi_0 2024-09-12T01:38:01.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.716+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7551154749762592952', time=2024-09-12T03:13:55.141455+0000, chain.objs.size()=1 2024-09-12T01:38:01.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.716+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.7lZax9DAb0USUjEWN_Z7BuKLkg54Nv4_0 2024-09-12T01:38:01.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.716+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7688708493207016820', time=2024-09-12T03:13:55.831408+0000, chain.objs.size()=1 2024-09-12T01:38:01.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.716+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.t9KrP-gTB82LKqGGmDlmTUfXDlhwwlN_0 2024-09-12T01:38:01.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.716+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9933138189633526780', time=2024-09-12T03:13:55.960813+0000, chain.objs.size()=1 2024-09-12T01:38:01.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.716+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Y_unyg_oZPqtlRQQaeOtgAFJWIWxrnv_0 2024-09-12T01:38:01.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.716+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10365155281788439863', time=2024-09-12T03:13:56.643816+0000, chain.objs.size()=1 2024-09-12T01:38:01.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.716+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.TWyk9yAYmqeynlO43bTfjbW4lPIT0NL_0 2024-09-12T01:38:01.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.716+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16078439524525192024', time=2024-09-12T03:13:56.644536+0000, chain.objs.size()=1 2024-09-12T01:38:01.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.716+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.CfAOo7ppSxaf48Ly2X8e1B77zL2RmoU_0 2024-09-12T01:38:01.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.716+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11831540828806889141', time=2024-09-12T03:13:56.845484+0000, chain.objs.size()=1 2024-09-12T01:38:01.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.716+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_._VP2vkq9L0fCNjcjQF_3ilQT2HRvfRZ_0 2024-09-12T01:38:01.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.716+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9180579677948043702', time=2024-09-12T03:13:56.846269+0000, chain.objs.size()=1 2024-09-12T01:38:01.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.716+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.hLGuXUOe3dAdSeIbypeOWJpLX64YUYY_0 2024-09-12T01:38:01.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.716+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9975838607603499044', time=2024-09-12T03:13:56.873993+0000, chain.objs.size()=1 2024-09-12T01:38:01.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.716+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.AjiuZkdF_zymJ63TRCGhNVgZvAoXVk9_0 2024-09-12T01:38:01.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.716+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6552308439199369305', time=2024-09-12T03:13:57.173125+0000, chain.objs.size()=1 2024-09-12T01:38:01.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.716+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.g1b2kOFYe7jc-llYfY0_kdX2pXfiSyk_0 2024-09-12T01:38:01.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.717+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4280104140152289565', time=2024-09-12T03:13:57.410799+0000, chain.objs.size()=1 2024-09-12T01:38:01.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.717+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.L3XS19SZ4eczCZj8NLJfYtxO4BU4xmL_0 2024-09-12T01:38:01.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.717+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1294530603476346418', time=2024-09-12T03:13:57.997367+0000, chain.objs.size()=1 2024-09-12T01:38:01.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.717+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.TOzVr8l8UWfBup1Hgh5j5Dth3trQj8B_0 2024-09-12T01:38:01.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.718+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1497715766139269636', time=2024-09-12T03:13:58.496726+0000, chain.objs.size()=1 2024-09-12T01:38:01.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.718+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.5QuuufqfWJXYS09NyxssplUBSiNoFBq_0 2024-09-12T01:38:01.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.718+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10375777824059828495', time=2024-09-12T03:13:58.559599+0000, chain.objs.size()=1 2024-09-12T01:38:01.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.718+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.azWNlinq8HJIatKwTGEvOfvO96W27Y__0 2024-09-12T01:38:01.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.718+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5691282013959210269', time=2024-09-12T03:13:58.560354+0000, chain.objs.size()=1 2024-09-12T01:38:01.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.718+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Wd8ll9NGyCSvkftFdh7uBVBN7ymdrAR_0 2024-09-12T01:38:01.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.718+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17623927359522065241', time=2024-09-12T03:13:58.712655+0000, chain.objs.size()=1 2024-09-12T01:38:01.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.718+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.e9FrPmuleaJNXmA23By0k2oM4wnu-FV_0 2024-09-12T01:38:01.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.718+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14817364650218144886', time=2024-09-12T03:13:59.293674+0000, chain.objs.size()=1 2024-09-12T01:38:01.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.718+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.wVnh71-SycWURswvUt0VVYfO8yYBStp_0 2024-09-12T01:38:01.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.720+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 0/52147 2024-09-12T01:38:01.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.722+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=42, truncated=0, next_marker='' 2024-09-12T01:38:01.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.722+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13794959192376323975', time=2024-09-12T03:13:59.364710+0000, chain.objs.size()=1 2024-09-12T01:38:01.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.722+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.F-bHqbXouQEkelYoJvSOYMkW7azzmzb_0 2024-09-12T01:38:01.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.722+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16636205101306053834', time=2024-09-12T03:13:59.396409+0000, chain.objs.size()=1 2024-09-12T01:38:01.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.722+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.fSsFA1eURyiUCphGCYLYNeAj_IIwVkI_0 2024-09-12T01:38:01.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.722+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2935478370548164214', time=2024-09-12T03:13:59.433758+0000, chain.objs.size()=1 2024-09-12T01:38:01.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.722+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.o-Id-IsLH2JpxmPDYe-GvpMtSIAcMUd_0 2024-09-12T01:38:01.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.722+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14774651413817985471', time=2024-09-12T03:14:00.076266+0000, chain.objs.size()=1 2024-09-12T01:38:01.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.722+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.uFDkHFceyubnsDzUuqcaFqjNZVxF-e7_0 2024-09-12T01:38:01.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.722+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8837217288649640177', time=2024-09-12T03:14:00.554690+0000, chain.objs.size()=1 2024-09-12T01:38:01.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.722+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.NXxZPEblkF6FRleP5Saahfz0oxwsUpP_0 2024-09-12T01:38:01.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.722+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5631752408038214919', time=2024-09-12T03:14:00.765900+0000, chain.objs.size()=1 2024-09-12T01:38:01.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.722+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.MMCY1XqRmPyjI3UU2J2H4q8X1ZB8lN9_0 2024-09-12T01:38:01.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.722+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3666035987053853100', time=2024-09-12T03:14:00.876127+0000, chain.objs.size()=1 2024-09-12T01:38:01.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.722+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.S-kCxIW5R13c6cRjkDbac3GvT3h92ge_0 2024-09-12T01:38:01.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.722+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9460284969749534694', time=2024-09-12T03:14:01.095833+0000, chain.objs.size()=1 2024-09-12T01:38:01.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.722+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.PHo9-kG65H6aquFjzkFtUkx1G0LJ_bF_0 2024-09-12T01:38:01.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.722+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17845181799305166790', time=2024-09-12T03:14:01.124273+0000, chain.objs.size()=1 2024-09-12T01:38:01.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.722+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.oAtsvjiD39fq2QX23tIU68vZKUmYMPy_0 2024-09-12T01:38:01.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.722+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6114886047601427301', time=2024-09-12T03:14:01.172495+0000, chain.objs.size()=1 2024-09-12T01:38:01.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.722+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.RRm4bXlsQ5VB6tq29fwB-hbABZkZ4iW_0 2024-09-12T01:38:01.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.722+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16180732558226951111', time=2024-09-12T03:14:01.369051+0000, chain.objs.size()=1 2024-09-12T01:38:01.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.722+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.0WtKF3gXkOVmgGVA3kHJC-HIPEPivv-_0 2024-09-12T01:38:01.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.722+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3720163025152378939', time=2024-09-12T03:14:01.372950+0000, chain.objs.size()=1 2024-09-12T01:38:01.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.722+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.NWGTDfQ3Oym6OkK7gbPzsgCbLrmNogx_0 2024-09-12T01:38:01.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.724+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10980629512956062561', time=2024-09-12T03:14:01.985650+0000, chain.objs.size()=1 2024-09-12T01:38:01.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.724+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.ltC6k1YLaDMIZvrqxF17CayoNQTpnGl_0 2024-09-12T01:38:01.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.725+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11475251335043314669', time=2024-09-12T03:14:02.182601+0000, chain.objs.size()=1 2024-09-12T01:38:01.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.725+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.U52wRf5BLS_x0lFKxKXpB31gskCfZGm_0 2024-09-12T01:38:01.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.725+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17176119853302818285', time=2024-09-12T03:14:02.183361+0000, chain.objs.size()=1 2024-09-12T01:38:01.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.725+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.S8Erter9_TUJ3-LCAfn21PgAPm7q-kX_0 2024-09-12T01:38:01.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.725+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.795002990551449995', time=2024-09-12T03:14:02.591172+0000, chain.objs.size()=1 2024-09-12T01:38:01.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.725+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.65wjvFHWaUVu99qPJcBBD4Ip18J6If__0 2024-09-12T01:38:01.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.726+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13744915336476868571', time=2024-09-12T03:14:02.631668+0000, chain.objs.size()=1 2024-09-12T01:38:01.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.726+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.bsav87yNOWPkuj7DQBRITMUKg8Lxi4C_0 2024-09-12T01:38:01.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.726+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6162428325320541264', time=2024-09-12T03:14:02.636107+0000, chain.objs.size()=1 2024-09-12T01:38:01.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.726+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.3GeQ6HN62dFD_yuksjvcEPTYFKfQQiU_0 2024-09-12T01:38:01.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.726+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13470765009867511042', time=2024-09-12T03:14:03.211719+0000, chain.objs.size()=1 2024-09-12T01:38:01.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.726+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.kjIvgy0sjMg7tAVQgUjBRNpkjGNWX2C_0 2024-09-12T01:38:01.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.726+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6531731291722505437', time=2024-09-12T03:14:03.619563+0000, chain.objs.size()=1 2024-09-12T01:38:01.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.726+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.bafyY0my0sjA-rngnl_BrtBNcYJkJ8w_0 2024-09-12T01:38:01.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.726+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9217906233734101706', time=2024-09-12T03:14:03.642324+0000, chain.objs.size()=1 2024-09-12T01:38:01.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.726+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.esARM0SMe9cIYVUCy3va7bk70KD04Di_0 2024-09-12T01:38:01.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.726+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2561545053864174765', time=2024-09-12T03:14:03.673591+0000, chain.objs.size()=1 2024-09-12T01:38:01.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.726+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.xMhTTXDj4dF5BRi2tAU4ChN-633ItYh_0 2024-09-12T01:38:01.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.726+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.211483355671372399', time=2024-09-12T03:14:13.589781+0000, chain.objs.size()=1 2024-09-12T01:38:01.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.726+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.335__shadow_.RrlkR-luu0B1DLgLOMS7tjIfL7t8LDS_0 2024-09-12T01:38:01.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.726+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7640710318321700969', time=2024-09-12T03:15:54.908588+0000, chain.objs.size()=1 2024-09-12T01:38:01.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.726+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.443__shadow_.7rJgDbRHK5mvcWNVJPyHJ2gBOvHBevy_0 2024-09-12T01:38:01.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.727+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7593461421376973601', time=2024-09-12T03:16:50.627811+0000, chain.objs.size()=1 2024-09-12T01:38:01.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.727+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.498__shadow_.ctdwiLP5k1_eyNvnNmYK6l5C6AAP_FM_0 2024-09-12T01:38:01.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.727+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2461981149638274258', time=2024-09-12T03:16:52.073514+0000, chain.objs.size()=1 2024-09-12T01:38:01.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.727+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.499__shadow_.gxiScUEf_jIXJqSM-8EAzdh_AuiRcYa_0 2024-09-12T01:38:01.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.727+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.288088388387849980', time=2024-09-12T03:16:56.065619+0000, chain.objs.size()=1 2024-09-12T01:38:01.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.727+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.503__shadow:zjHxI5MExGDTEMgC.YI1-B-Wp2XBZjW_.xteVVbi5oDy4c1uLu1Qcooxbp-bOuaB_0 2024-09-12T01:38:01.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.728+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9107348557423470657', time=2024-09-12T03:17:24.966297+0000, chain.objs.size()=6 2024-09-12T01:38:01.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.728+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.507__multipart_srcmultipart.2~ckyMCV3hbT7G8qDArZScZPf4n-CghR1.1 2024-09-12T01:38:01.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.728+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.507__multipart_srcmultipart.2~ckyMCV3hbT7G8qDArZScZPf4n-CghR1.2 2024-09-12T01:38:01.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.728+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.507__multipart_srcmultipart.2~ckyMCV3hbT7G8qDArZScZPf4n-CghR1.3 2024-09-12T01:38:01.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.729+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.507__multipart_srcmultipart.2~ckyMCV3hbT7G8qDArZScZPf4n-CghR1.4 2024-09-12T01:38:01.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.729+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.507__multipart_srcmultipart.2~ckyMCV3hbT7G8qDArZScZPf4n-CghR1.5 2024-09-12T01:38:01.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.729+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.507__multipart_srcmultipart.2~ckyMCV3hbT7G8qDArZScZPf4n-CghR1.6 2024-09-12T01:38:01.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.729+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2121610018016057011', time=2024-09-12T03:17:31.686524+0000, chain.objs.size()=1 2024-09-12T01:38:01.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.729+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.514__shadow_.5BZ9P_QXPpjEgCaaKHSMa25psLYb5ZV_0 2024-09-12T01:38:01.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.729+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8609764301411112437', time=2024-09-12T03:20:42.085507+0000, chain.objs.size()=1 2024-09-12T01:38:01.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.729+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.525__multipart_mymultipart.2~Yg61IoUoyx29rTSRHBEH1P0VpUs38Gp.1 2024-09-12T01:38:01.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.729+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1243160715439589903', time=2024-09-12T03:20:51.685912+0000, chain.objs.size()=3 2024-09-12T01:38:01.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.729+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.525__multipart_mymultipart.2~HbTbn5nc_qv38rITwsfpEFLws50lEmT.1 2024-09-12T01:38:01.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.729+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.525__multipart_mymultipart.2~HbTbn5nc_qv38rITwsfpEFLws50lEmT.2 2024-09-12T01:38:01.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.729+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.525__multipart_mymultipart.2~HbTbn5nc_qv38rITwsfpEFLws50lEmT.3 2024-09-12T01:38:01.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.729+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='2~gYTWa-AYplhamxOLsm4P66TMUeQuhZw', time=2024-09-12T03:20:59.962774+0000, chain.objs.size()=10 2024-09-12T01:38:01.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.729+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.526__multipart_mymultipart.2~gYTWa-AYplhamxOLsm4P66TMUeQuhZw.1 2024-09-12T01:38:01.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.730+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.526__multipart_mymultipart.2~gYTWa-AYplhamxOLsm4P66TMUeQuhZw.2 2024-09-12T01:38:01.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.731+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.526__multipart_mymultipart.2~gYTWa-AYplhamxOLsm4P66TMUeQuhZw.3 2024-09-12T01:38:01.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.731+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.526__multipart_mymultipart.2~gYTWa-AYplhamxOLsm4P66TMUeQuhZw.4 2024-09-12T01:38:01.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.731+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.526__multipart_mymultipart.2~gYTWa-AYplhamxOLsm4P66TMUeQuhZw.5 2024-09-12T01:38:01.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.731+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.526__multipart_mymultipart.2~gYTWa-AYplhamxOLsm4P66TMUeQuhZw.6 2024-09-12T01:38:01.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.731+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.526__multipart_mymultipart.2~gYTWa-AYplhamxOLsm4P66TMUeQuhZw.7 2024-09-12T01:38:01.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.731+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.526__multipart_mymultipart.2~gYTWa-AYplhamxOLsm4P66TMUeQuhZw.8 2024-09-12T01:38:01.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.731+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.526__multipart_mymultipart.2~gYTWa-AYplhamxOLsm4P66TMUeQuhZw.9 2024-09-12T01:38:01.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.732+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.526__multipart_mymultipart.2~gYTWa-AYplhamxOLsm4P66TMUeQuhZw.10 2024-09-12T01:38:01.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.732+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='2~fIrMPrfIk2GN2PnaGqhgxMkPFfbMz2w', time=2024-09-12T03:21:20.293897+0000, chain.objs.size()=1 2024-09-12T01:38:01.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.732+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.531__multipart_mymultipart.2~fIrMPrfIk2GN2PnaGqhgxMkPFfbMz2w.1 2024-09-12T01:38:01.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.732+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14363692238656384790', time=2024-09-12T03:23:27.553145+0000, chain.objs.size()=1 2024-09-12T01:38:01.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.732+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.574__shadow:PqT5uVP7rkNrPHX3BESQ5nciMLbKriH_.kJGs-3aK39qNEJo23U5o01QVWZ7WFak_0 2024-09-12T01:38:01.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.732+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4023320016194768179', time=2024-09-12T03:23:29.159919+0000, chain.objs.size()=1 2024-09-12T01:38:01.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.732+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.574__shadow:2LdKR6hOWk8Jn5w5dCBO1Ha8QZBv64m_.eIGmN0cfdQkklaKcQN_uIxR6Z4WjR4C_0 2024-09-12T01:38:01.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.733+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18203147599709947103', time=2024-09-12T03:23:56.980073+0000, chain.objs.size()=1 2024-09-12T01:38:01.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.733+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.577__shadow:KhBW98Rd35071Dh7jN3X0wMiziQOvKS_.EeuFlNeM_oZG_jhgK35GqzSGhbbl-bY_0 2024-09-12T01:38:01.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.733+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4355704428274272977', time=2024-09-12T03:24:36.384355+0000, chain.objs.size()=1 2024-09-12T01:38:01.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.733+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.579__shadow:vTbGync5QUpFNiMMOpENTrcZgHXfECM_.CbKldYqQM_jvwCMMqcZiMnLSFtnpWgD_0 2024-09-12T01:38:01.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.733+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12668188199685463714', time=2024-09-12T03:24:44.257057+0000, chain.objs.size()=1 2024-09-12T01:38:01.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.733+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.585__shadow:FYWHYnRLeESd0Ifr2RDFL4D2B.LI.uv_.ZlhcfqxJE9E4z9lxU6VCRj68dYAszp-_0 2024-09-12T01:38:01.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.733+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10539284456227910060', time=2024-09-12T03:24:47.770935+0000, chain.objs.size()=1 2024-09-12T01:38:01.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.733+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.587__shadow:skahpuOBaoEcS4-f4a35cuTmGx72XQF_.gwlBT05u-2uR4bdYfXLtoLI272_9SYZ_0 2024-09-12T01:38:01.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.733+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10059710161225734664', time=2024-09-12T03:31:00.305318+0000, chain.objs.size()=1 2024-09-12T01:38:01.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.733+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.665__shadow_.T4PklUpQ5bSIK43LEUDxBJkdElPKVh__0 2024-09-12T01:38:01.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.733+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11004653957010310881', time=2024-09-12T03:31:21.218795+0000, chain.objs.size()=1 2024-09-12T01:38:01.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.733+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.691__shadow_.AsJD71PjR1jw8qxjarCRVtIAaXZrVnU_0 2024-09-12T01:38:01.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.733+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4825039454000925270', time=2024-09-12T03:31:52.761622+0000, chain.objs.size()=1 2024-09-12T01:38:01.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.733+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.715__shadow:jVoFYA.foPmcV4Ea.Dj.fJCz4Ii3zlE_.vStCqE9uZvCSgLfJOVfb-3eT9xLmvA6_0 2024-09-12T01:38:01.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.736+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:38:01.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.738+0000 7f8786c98800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T01:38:01.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.739+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:38:01.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.740+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:38:01.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.741+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50080' 2024-09-12T01:38:01.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.741+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4699957572843125432', time=2024-09-12T03:06:12.465690+0000, chain.objs.size()=1 2024-09-12T01:38:01.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.741+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.147__shadow_.8I7BT3GWWlbxmRWShGGKXp0K-g10BeB_0 2024-09-12T01:38:01.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.741+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11810558999902126982', time=2024-09-12T03:06:27.694753+0000, chain.objs.size()=2 2024-09-12T01:38:01.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.741+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.158__shadow_.fORfpoNtTRG7rZzQ-kdt0SRXmGlloig_0 2024-09-12T01:38:01.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.741+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.158__shadow_.fORfpoNtTRG7rZzQ-kdt0SRXmGlloig_1 2024-09-12T01:38:01.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.741+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='2~Q6TAywTbCAQPRIhlSdqHcYt-5diX7L6', time=2024-09-12T03:08:12.859767+0000, chain.objs.size()=1 2024-09-12T01:38:01.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.741+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.201__multipart_mymultipart.2~Q6TAywTbCAQPRIhlSdqHcYt-5diX7L6.1 2024-09-12T01:38:01.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.741+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1794075450092394972', time=2024-09-12T03:10:08.728071+0000, chain.objs.size()=1 2024-09-12T01:38:01.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.741+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.233__shadow_.9Z8kC2UURwSwUaOXb7IywSDEmRaGYDX_0 2024-09-12T01:38:01.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.741+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1625601569918705138', time=2024-09-12T03:10:18.588045+0000, chain.objs.size()=1 2024-09-12T01:38:01.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.741+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.242__shadow_.g4z3UcKiyj3JmINcBQu7luql9HvEpmX_0 2024-09-12T01:38:01.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.741+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11764010742160261712', time=2024-09-12T03:10:26.903550+0000, chain.objs.size()=1 2024-09-12T01:38:01.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.741+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.249__shadow_.SZIlbNPL2ZRjJ0HrJos0F_5lggy1GGm_0 2024-09-12T01:38:01.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.741+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15000836143123899159', time=2024-09-12T03:10:34.616278+0000, chain.objs.size()=1 2024-09-12T01:38:01.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.741+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.257__shadow_.SeLnFdLhBu9PDIPbByM1x74jXqLykTU_0 2024-09-12T01:38:01.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.741+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7591774044370932545', time=2024-09-12T03:11:14.969319+0000, chain.objs.size()=1 2024-09-12T01:38:01.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.741+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.EhRXc6Dfvg4Md7W9caXF8Vrg52XxQkN_0 2024-09-12T01:38:01.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.741+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1213512079368605213', time=2024-09-12T03:11:15.966740+0000, chain.objs.size()=1 2024-09-12T01:38:01.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.741+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.-r8NlfdpU5RMGUt9v0ORFouih2M2Sme_0 2024-09-12T01:38:01.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.741+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9122989494718773465', time=2024-09-12T03:11:16.015038+0000, chain.objs.size()=1 2024-09-12T01:38:01.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.741+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.6bjDr3IGAAlRcGIVT1iOWcqZy_XUV3Z_0 2024-09-12T01:38:01.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.741+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13379938713750284829', time=2024-09-12T03:11:16.139271+0000, chain.objs.size()=1 2024-09-12T01:38:01.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.741+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.yeEV8fLt0_VnVb_k966N5Ikk9VUUfe__0 2024-09-12T01:38:01.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.744+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4493405344219725035', time=2024-09-12T03:11:16.774388+0000, chain.objs.size()=1 2024-09-12T01:38:01.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.744+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.NA3BDvvC0zYkcdFt3iFDv9U1fvJL3lu_0 2024-09-12T01:38:01.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.744+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5302627555899009666', time=2024-09-12T03:11:16.829555+0000, chain.objs.size()=1 2024-09-12T01:38:01.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.744+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.E0LgUggMT33etaM6WuwZYxBZACSOsiJ_0 2024-09-12T01:38:01.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.744+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9363151024563868078', time=2024-09-12T03:11:16.840564+0000, chain.objs.size()=1 2024-09-12T01:38:01.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.744+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.ttGh1V40NP5UQUphvhKVmN4ZkLDxCBV_0 2024-09-12T01:38:01.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.744+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7353983741576199533', time=2024-09-12T03:11:16.931479+0000, chain.objs.size()=1 2024-09-12T01:38:01.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.744+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.5YYe2UtGIxyiB7vM3C6020ZbNujUJVJ_0 2024-09-12T01:38:01.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.744+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3247035107747924552', time=2024-09-12T03:11:16.932090+0000, chain.objs.size()=1 2024-09-12T01:38:01.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.744+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.9504PzFozg2F2gXrZ3oJT1opsthAqiN_0 2024-09-12T01:38:01.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.744+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12634498178216725328', time=2024-09-12T03:11:17.583118+0000, chain.objs.size()=1 2024-09-12T01:38:01.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.744+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.L5XeqpvgdcOizD0CHIpHX-XEtdTJ_BC_0 2024-09-12T01:38:01.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.744+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.759242883873424164', time=2024-09-12T03:11:18.304902+0000, chain.objs.size()=1 2024-09-12T01:38:01.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.744+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.QJlflUjtxd6r-MgxgHUKWyEkE5ApFY1_0 2024-09-12T01:38:01.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.744+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15787239459520771050', time=2024-09-12T03:11:18.350717+0000, chain.objs.size()=1 2024-09-12T01:38:01.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.744+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.blVG9pseWL8k96a83IAEvmdtrlBp_F-_0 2024-09-12T01:38:01.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.744+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17263553231849114106', time=2024-09-12T03:11:18.434863+0000, chain.objs.size()=1 2024-09-12T01:38:01.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.744+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.YJC9TD-frNAchKv0EiUiaAL0CTDo3Ka_0 2024-09-12T01:38:01.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.744+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10738588780626962668', time=2024-09-12T03:11:19.147139+0000, chain.objs.size()=1 2024-09-12T01:38:01.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.744+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.JaSt2aP_0-IqzUgNgWHXSw3QGTTopWp_0 2024-09-12T01:38:01.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.744+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.889138194021868434', time=2024-09-12T03:11:19.147672+0000, chain.objs.size()=1 2024-09-12T01:38:01.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.744+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.8uvUOFERyjDczCnwDmMiuta43ZV4zHZ_0 2024-09-12T01:38:01.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.745+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4293973874908868915', time=2024-09-12T03:11:19.470049+0000, chain.objs.size()=1 2024-09-12T01:38:01.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.745+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.PtUJVpoOkf1IJ22ITqmwSIY-mCjLtO0_0 2024-09-12T01:38:01.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.746+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9562798405717802883', time=2024-09-12T03:11:19.597120+0000, chain.objs.size()=1 2024-09-12T01:38:01.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.746+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.iQ3rTCTEQC5gobBGoJkSqq7VgNsk-dP_0 2024-09-12T01:38:01.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.746+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13194366733471329990', time=2024-09-12T03:11:20.639871+0000, chain.objs.size()=1 2024-09-12T01:38:01.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.746+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.rQngLhDGKRIegLbuDiNWnbvAeW_DgTj_0 2024-09-12T01:38:01.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.746+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10232986372107744632', time=2024-09-12T03:11:20.641610+0000, chain.objs.size()=1 2024-09-12T01:38:01.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.746+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.su8I24JSCnYdP4NjqDdGs5aEqBDkFmc_0 2024-09-12T01:38:01.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.746+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13665886366311427311', time=2024-09-12T03:11:21.664910+0000, chain.objs.size()=1 2024-09-12T01:38:01.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.746+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.FGVPmPUSW6hbCg2bTatpjmjnT2LTdB7_0 2024-09-12T01:38:01.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.746+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17801432838468961422', time=2024-09-12T03:11:22.037123+0000, chain.objs.size()=1 2024-09-12T01:38:01.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.746+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.craHkvDPFfNouxg_65a5H7DQawMDfRa_0 2024-09-12T01:38:01.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.746+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14063448843083782730', time=2024-09-12T03:11:22.413255+0000, chain.objs.size()=1 2024-09-12T01:38:01.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.746+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.X1rDfgiC2X_p96Kyxq0oqbS0HIqQtL__0 2024-09-12T01:38:01.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.746+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8454512040357236135', time=2024-09-12T03:11:22.413788+0000, chain.objs.size()=1 2024-09-12T01:38:01.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.746+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.A2t0LL4MHgqYnzVtLCw2nt09N4B2Cov_0 2024-09-12T01:38:01.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.746+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1455496059703233675', time=2024-09-12T03:11:23.142630+0000, chain.objs.size()=1 2024-09-12T01:38:01.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.746+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.DFKbXwv6i0SePm4MYCWUn642kUtgQiI_0 2024-09-12T01:38:01.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.746+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9185365790732925974', time=2024-09-12T03:11:23.247843+0000, chain.objs.size()=1 2024-09-12T01:38:01.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.746+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.RrFL47ewuPQ7uL4JgtJ3ogoEChxQt9T_0 2024-09-12T01:38:01.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.746+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8234607843631542819', time=2024-09-12T03:11:23.592091+0000, chain.objs.size()=1 2024-09-12T01:38:01.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.746+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.jqektwZtegAJgqohrrRRrA4htmzz838_0 2024-09-12T01:38:01.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.747+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3865248480038517716', time=2024-09-12T03:11:23.657654+0000, chain.objs.size()=1 2024-09-12T01:38:01.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.747+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.KFUPEH3F7hEtf7dsN5Cs2zbEtDSndqD_0 2024-09-12T01:38:01.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.748+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2285771133159730733', time=2024-09-12T03:11:24.286680+0000, chain.objs.size()=1 2024-09-12T01:38:01.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.748+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.JERHlISGpBQeCUZ8sQOaSVWZhlDwec1_0 2024-09-12T01:38:01.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.749+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18420121738227380541', time=2024-09-12T03:11:24.725976+0000, chain.objs.size()=1 2024-09-12T01:38:01.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.749+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.DRXwq7JnkGyUkWOFjGh1crFLMYURtlR_0 2024-09-12T01:38:01.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.749+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.732408847796327454', time=2024-09-12T03:11:24.853178+0000, chain.objs.size()=1 2024-09-12T01:38:01.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.749+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.262__shadow_.RKitJsI9ppawEC1oBoagjVhO93EpDt3_0 2024-09-12T01:38:01.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.749+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5560378244040471334', time=2024-09-12T03:11:36.142717+0000, chain.objs.size()=1 2024-09-12T01:38:01.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.749+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.274__shadow_.hwDgudX8U_bfD2KxW5Y9wLUiPDMOPIG_0 2024-09-12T01:38:01.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.749+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3560480642463730981', time=2024-09-12T03:11:41.982147+0000, chain.objs.size()=1 2024-09-12T01:38:01.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.749+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.280__shadow_.R_671HF04P3_LmB05VNf31D30MhGM3S_0 2024-09-12T01:38:01.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.749+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10025912403954270174', time=2024-09-12T03:11:48.929671+0000, chain.objs.size()=1 2024-09-12T01:38:01.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.749+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.287__shadow_.SZPE0lXj4HLfTRZeeZRB4MSyUgL43Nf_0 2024-09-12T01:38:01.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.749+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14150085934904573898', time=2024-09-12T03:11:49.875854+0000, chain.objs.size()=1 2024-09-12T01:38:01.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.749+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.288__shadow_.GK72TAl2HoyM0_j5L2lufySK7UMkOUA_0 2024-09-12T01:38:01.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.749+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9120733655015268814', time=2024-09-12T03:11:53.238543+0000, chain.objs.size()=1 2024-09-12T01:38:01.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.749+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.291__shadow_.HwBEHe-0GqOnxsS0c9nrE79rEbgzskC_0 2024-09-12T01:38:01.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.749+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12044402903391676553', time=2024-09-12T03:12:03.700086+0000, chain.objs.size()=1 2024-09-12T01:38:01.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.749+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.299__shadow_.3IwSrzTpp7E4_lzoGsjbExMt0mFd-Xw_0 2024-09-12T01:38:01.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.749+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6274027855033511128', time=2024-09-12T03:12:07.585640+0000, chain.objs.size()=1 2024-09-12T01:38:01.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.749+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.303__shadow_.xSWBYpv8LMS409R_heW7xa3uSrLkk69_0 2024-09-12T01:38:01.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.750+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12079813613893482931', time=2024-09-12T03:12:09.506951+0000, chain.objs.size()=1 2024-09-12T01:38:01.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.750+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.305__shadow_.mXJxJdLBMdPQgxooRyQfIWkz9_y4TPD_0 2024-09-12T01:38:01.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.750+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2298181512508368567', time=2024-09-12T03:13:06.836126+0000, chain.objs.size()=1 2024-09-12T01:38:01.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.750+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.P3810aH3sGgyLbdTlZrjUp39EaVNAzZ_0 2024-09-12T01:38:01.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.751+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17422370030120122748', time=2024-09-12T03:13:07.512088+0000, chain.objs.size()=1 2024-09-12T01:38:01.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.751+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.xCBRT_e5OkQ4KN8C_IjV4OFVUKvvxTq_0 2024-09-12T01:38:01.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.751+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1191706467142538189', time=2024-09-12T03:13:07.607771+0000, chain.objs.size()=1 2024-09-12T01:38:01.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.751+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.mRYAmsZc3us29Wn_sJ-tudMArbJeyYy_0 2024-09-12T01:38:01.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.751+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13650598428698104090', time=2024-09-12T03:13:07.810526+0000, chain.objs.size()=1 2024-09-12T01:38:01.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.751+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.88Sc9ETcxMP3LcbEOQqgRio_t-xV23b_0 2024-09-12T01:38:01.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.751+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3867964786789171433', time=2024-09-12T03:13:08.834241+0000, chain.objs.size()=1 2024-09-12T01:38:01.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.751+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.iW8x4gPsr_ZVYlRnuhgOMpwIQMvX3bJ_0 2024-09-12T01:38:01.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.751+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14596429374099885456', time=2024-09-12T03:13:08.834779+0000, chain.objs.size()=1 2024-09-12T01:38:01.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.751+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.yrTipqszPYFEbhQd_9093Y_86b55bPM_0 2024-09-12T01:38:01.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.751+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.18107822277258397470', time=2024-09-12T03:13:08.882263+0000, chain.objs.size()=1 2024-09-12T01:38:01.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.751+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.Y1D6BBSp0GTBDyAQbYm_p7EwqQoS3DV_0 2024-09-12T01:38:01.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.751+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2998573896676583636', time=2024-09-12T03:13:08.962063+0000, chain.objs.size()=1 2024-09-12T01:38:01.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.751+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.NhkxShJjNb9OAdLcjWZNR0165HsWcti_0 2024-09-12T01:38:01.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.751+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5909705751790027244', time=2024-09-12T03:13:09.147818+0000, chain.objs.size()=1 2024-09-12T01:38:01.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.751+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.vxWcVF9RARW7VK6QpoS10HA6VA9aItC_0 2024-09-12T01:38:01.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.751+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6926173523351465585', time=2024-09-12T03:13:09.927500+0000, chain.objs.size()=1 2024-09-12T01:38:01.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.751+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.Z-Zralbvsj3-SHbiVt7QkPugZ3WNJdX_0 2024-09-12T01:38:01.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.752+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10886698261898666438', time=2024-09-12T03:13:10.046583+0000, chain.objs.size()=1 2024-09-12T01:38:01.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.752+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.kCH5z53fN6fU929m2r76XPc-fUuGS7y_0 2024-09-12T01:38:01.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.752+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7804463659636824080', time=2024-09-12T03:13:11.158031+0000, chain.objs.size()=1 2024-09-12T01:38:01.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.752+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.jGd_tJeFCjXLqlF7OzC2x4ZYCAa4tj9_0 2024-09-12T01:38:01.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.752+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10695633593940731943', time=2024-09-12T03:13:11.743274+0000, chain.objs.size()=1 2024-09-12T01:38:01.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.752+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.uVw4N_szTlyAOPJYXFGegwV_8zL4pCE_0 2024-09-12T01:38:01.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.752+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6029242602092806004', time=2024-09-12T03:13:12.076944+0000, chain.objs.size()=1 2024-09-12T01:38:01.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.752+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.1T7jWxXYyX5BsFCujAI7M_rSltEoSoz_0 2024-09-12T01:38:01.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.753+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11614994094419630381', time=2024-09-12T03:13:12.098664+0000, chain.objs.size()=1 2024-09-12T01:38:01.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.753+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.hLNITvdHNiKIThEYcwKtE6ChO5CgycX_0 2024-09-12T01:38:01.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.754+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2697780216997852626', time=2024-09-12T03:13:12.729841+0000, chain.objs.size()=1 2024-09-12T01:38:01.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.754+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.m-u7WW8WmNmLtcQi97XChz_r2d3qwDB_0 2024-09-12T01:38:01.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.754+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4550685211486019513', time=2024-09-12T03:13:13.137426+0000, chain.objs.size()=1 2024-09-12T01:38:01.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.754+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.I56Ej_f19ebRkRx8MweSy2BjJin0Omc_0 2024-09-12T01:38:01.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.754+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.325356716846625342', time=2024-09-12T03:13:13.360762+0000, chain.objs.size()=1 2024-09-12T01:38:01.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.754+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.tLcUPUt7Qqe7QJnrVFQSfk4G2C5ct6Y_0 2024-09-12T01:38:01.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.754+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5058884719005745237', time=2024-09-12T03:13:14.324453+0000, chain.objs.size()=1 2024-09-12T01:38:01.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.754+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.C407oYag91OBVP3MUNSowYlpAbURr0W_0 2024-09-12T01:38:01.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.754+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4191720619358000747', time=2024-09-12T03:13:14.678729+0000, chain.objs.size()=1 2024-09-12T01:38:01.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.754+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.cHJmoQZYqJnvVmkCdr8kflgALot35pZ_0 2024-09-12T01:38:01.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.754+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9629314678875506318', time=2024-09-12T03:13:14.710386+0000, chain.objs.size()=1 2024-09-12T01:38:01.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.754+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.uG9dhynuoFi_c8TdTBODZufPeZz1MN6_0 2024-09-12T01:38:01.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.754+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1451907580003550838', time=2024-09-12T03:13:15.115721+0000, chain.objs.size()=1 2024-09-12T01:38:01.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.754+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.X8yrMLX7O2Bqyeo9GsVHBmEkb_tzUl9_0 2024-09-12T01:38:01.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.754+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9724909315063865775', time=2024-09-12T03:13:15.452668+0000, chain.objs.size()=1 2024-09-12T01:38:01.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.754+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.o_pIfJISKjHB2OIocQlklJdfHVU4GHI_0 2024-09-12T01:38:01.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.754+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12137353936457218608', time=2024-09-12T03:13:15.554368+0000, chain.objs.size()=1 2024-09-12T01:38:01.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.754+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.BPzKJGzKbdD_o47gLHcfEjWv6eqItKt_0 2024-09-12T01:38:01.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.754+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.4551876271072349121', time=2024-09-12T03:13:15.555618+0000, chain.objs.size()=1 2024-09-12T01:38:01.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.754+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.6xRfuLv1rdZeH46GIStCr9q2bX0utBB_0 2024-09-12T01:38:01.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.755+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.449550011709433781', time=2024-09-12T03:13:15.772592+0000, chain.objs.size()=1 2024-09-12T01:38:01.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.755+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.YpkHH0I-vFCtvKZqgk0ApuRequkT832_0 2024-09-12T01:38:01.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.755+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15189699850752422224', time=2024-09-12T03:13:15.814795+0000, chain.objs.size()=1 2024-09-12T01:38:01.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.755+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.0aTmHNRSjU5X3FzoHGBkiezYcBx8XxO_0 2024-09-12T01:38:01.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.756+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10799731964700914923', time=2024-09-12T03:13:16.083598+0000, chain.objs.size()=1 2024-09-12T01:38:01.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.756+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.YeruQZ9HtvbGcVDGefbJEYpfCdXFOIH_0 2024-09-12T01:38:01.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.756+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12986962862003247960', time=2024-09-12T03:13:16.382640+0000, chain.objs.size()=1 2024-09-12T01:38:01.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.756+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_._nmzioJaOd9u_qPTomjZTGamKhLksH-_0 2024-09-12T01:38:01.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.756+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2360209110283948848', time=2024-09-12T03:13:16.789649+0000, chain.objs.size()=1 2024-09-12T01:38:01.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.756+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.3sSDoKIXgHZIfyquaxGSdXYBYqsNSkL_0 2024-09-12T01:38:01.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.757+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3479680551364583477', time=2024-09-12T03:13:16.947525+0000, chain.objs.size()=1 2024-09-12T01:38:01.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.757+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.EWuXp9nkszIHG3-GPaRQC_lxDDfKxk1_0 2024-09-12T01:38:01.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.757+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15859464495410550448', time=2024-09-12T03:13:16.948827+0000, chain.objs.size()=1 2024-09-12T01:38:01.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.757+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.GPZjFLowbQeATflpAN6o4p9OcttMaWB_0 2024-09-12T01:38:01.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.757+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.533616846137879309', time=2024-09-12T03:13:17.039800+0000, chain.objs.size()=1 2024-09-12T01:38:01.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.757+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.TYmhVcbC0PAqwasrZ_vXy7kgc3hhmB1_0 2024-09-12T01:38:01.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.757+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10888065186739593575', time=2024-09-12T03:13:17.133443+0000, chain.objs.size()=1 2024-09-12T01:38:01.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.757+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.323__shadow_.o3_JBiwxsVUQ3fA3W1TFOUZGnK77ike_0 2024-09-12T01:38:01.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.757+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9605864523687416970', time=2024-09-12T03:13:53.720632+0000, chain.objs.size()=1 2024-09-12T01:38:01.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.757+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.ufuQvdiJKRbr9FyLMbbYk-Q_DX0Ihru_0 2024-09-12T01:38:01.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.757+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.363037734762488232', time=2024-09-12T03:13:54.253481+0000, chain.objs.size()=1 2024-09-12T01:38:01.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.757+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_._ES604BSVUMrezl3E0FU8XDYksWzF2t_0 2024-09-12T01:38:01.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.757+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3059332901509479197', time=2024-09-12T03:13:54.291477+0000, chain.objs.size()=1 2024-09-12T01:38:01.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.757+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.OeLnZgmlnuLcz3aELrhjeDF5_ZfFaSL_0 2024-09-12T01:38:01.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.757+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13212500676125165863', time=2024-09-12T03:13:54.329957+0000, chain.objs.size()=1 2024-09-12T01:38:01.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.757+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Sl9i2BKCQ6sktQw6MsMzKhVvrzEoToV_0 2024-09-12T01:38:01.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.757+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13752217175175093454', time=2024-09-12T03:13:54.389448+0000, chain.objs.size()=1 2024-09-12T01:38:01.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.757+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.X808fs2rf8TMuqOaX6L4WNNWSRrO_MW_0 2024-09-12T01:38:01.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.757+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11028469247405439719', time=2024-09-12T03:13:55.091535+0000, chain.objs.size()=1 2024-09-12T01:38:01.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.757+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Rs98rjPZ3wa2e2l934rpFoPeNOHCBaS_0 2024-09-12T01:38:01.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.759+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2910648313173910250', time=2024-09-12T03:13:55.281237+0000, chain.objs.size()=1 2024-09-12T01:38:01.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.759+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.0MdqSnCZnveOOE9jQ0tBuUfEO4yTzld_0 2024-09-12T01:38:01.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.759+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.990665096199467088', time=2024-09-12T03:13:55.394561+0000, chain.objs.size()=1 2024-09-12T01:38:01.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.759+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.JrTVBJf56sjethHJblG2xOnUUXA2cUK_0 2024-09-12T01:38:01.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.762+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.2048126716513271370', time=2024-09-12T03:13:55.412260+0000, chain.objs.size()=1 2024-09-12T01:38:01.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.762+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.wSbCVknEH8jfdG3xPa4X7eRvenr1dBF_0 2024-09-12T01:38:01.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.762+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11974224214241177138', time=2024-09-12T03:13:55.619429+0000, chain.objs.size()=1 2024-09-12T01:38:01.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.762+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.mxJrIAiqLy1ZvTdeZEBAfbU1W8wvVOY_0 2024-09-12T01:38:01.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.762+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12364991194267133725', time=2024-09-12T03:13:55.620139+0000, chain.objs.size()=1 2024-09-12T01:38:01.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.762+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.ldH-h7lMtlDKEmK0nLIwX7GzIdtzb51_0 2024-09-12T01:38:01.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.762+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17359172832730256494', time=2024-09-12T03:13:55.854223+0000, chain.objs.size()=1 2024-09-12T01:38:01.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.762+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.49Hl1zkJQAPsQ2e5h990UGps5HiPBiI_0 2024-09-12T01:38:01.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.762+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.748747104258758410', time=2024-09-12T03:13:56.513320+0000, chain.objs.size()=1 2024-09-12T01:38:01.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.762+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.UaRSW5wvc5jnVdMEDkc_eVCX5UxZPkE_0 2024-09-12T01:38:01.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.762+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14637279486351931201', time=2024-09-12T03:13:56.844702+0000, chain.objs.size()=1 2024-09-12T01:38:01.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.762+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.PBpwXRuj1kCJG3P78kK7YJfN68fVpBR_0 2024-09-12T01:38:01.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.762+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14419698816396503837', time=2024-09-12T03:13:57.412032+0000, chain.objs.size()=1 2024-09-12T01:38:01.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.762+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.-Tjfqqr_BnRgpc-vtSwllfnCrL_l51L_0 2024-09-12T01:38:01.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.762+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7390804775755587725', time=2024-09-12T03:13:58.713580+0000, chain.objs.size()=1 2024-09-12T01:38:01.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.762+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.Aa1IL9TaJKwnrYggR0BliTSFOqQMILs_0 2024-09-12T01:38:01.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.762+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.9689655342030138861', time=2024-09-12T03:14:00.075690+0000, chain.objs.size()=1 2024-09-12T01:38:01.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.762+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.g1lj7vTfzH5BgCCDzOlcOa2xkV5dGBb_0 2024-09-12T01:38:01.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.762+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16712420854467898846', time=2024-09-12T03:14:00.104843+0000, chain.objs.size()=1 2024-09-12T01:38:01.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.762+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.MKvkIB6Bu2rVW94xB4NkEmPl-_WKWhN_0 2024-09-12T01:38:01.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.763+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.3230821056269193757', time=2024-09-12T03:14:00.879476+0000, chain.objs.size()=1 2024-09-12T01:38:01.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.763+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.pXyW0eBwqhzvxBkmYZCvFU76vBZgCBH_0 2024-09-12T01:38:01.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.764+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7302805670427405431', time=2024-09-12T03:14:01.127316+0000, chain.objs.size()=1 2024-09-12T01:38:01.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.764+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.YkjlH1oLElB2_qR2rPK-a6Zkox8K4rb_0 2024-09-12T01:38:01.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.766+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7252010618869440209', time=2024-09-12T03:14:01.175131+0000, chain.objs.size()=1 2024-09-12T01:38:01.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.766+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.ikAl61enm9w6-06A8GQzw0VPPpI5Vpi_0 2024-09-12T01:38:01.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.769+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 0/50080 2024-09-12T01:38:01.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.772+0000 7f8786c98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=26, truncated=0, next_marker='' 2024-09-12T01:38:01.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.772+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1636785960586162125', time=2024-09-12T03:14:01.232569+0000, chain.objs.size()=1 2024-09-12T01:38:01.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.772+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.KqgVoEBbse1fKCZm7wpRdqsLz1tvYcD_0 2024-09-12T01:38:01.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.772+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12450575506203281214', time=2024-09-12T03:14:01.708412+0000, chain.objs.size()=1 2024-09-12T01:38:01.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.772+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.NJhkB9vRatJuUNsOh818egJtwyBhs2A_0 2024-09-12T01:38:01.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.772+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12253953128547634323', time=2024-09-12T03:14:02.942713+0000, chain.objs.size()=1 2024-09-12T01:38:01.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.772+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.UETp-MlG3Kcd1eVHmFFJ0ECauPMlsr__0 2024-09-12T01:38:01.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.772+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8704622027113992238', time=2024-09-12T03:14:03.153293+0000, chain.objs.size()=1 2024-09-12T01:38:01.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.772+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.SBJF8Vde-uOQNFr0FBT_dYN8h-ohBrI_0 2024-09-12T01:38:01.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.772+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15716194268969938888', time=2024-09-12T03:14:03.234630+0000, chain.objs.size()=1 2024-09-12T01:38:01.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.772+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.PU22CL98SK6gOaxSY7ZEJnAzx0iZ595_0 2024-09-12T01:38:01.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.772+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1607465370241893162', time=2024-09-12T03:14:03.324034+0000, chain.objs.size()=1 2024-09-12T01:38:01.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.772+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.vDFM26Cjoogx3CBH-b3uiVi2ga1bsK4_0 2024-09-12T01:38:01.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.772+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.5138852735284338843', time=2024-09-12T03:14:03.410347+0000, chain.objs.size()=1 2024-09-12T01:38:01.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.772+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.324__shadow_.-H6dVZIknAoRx5y9OgxE7G87HBuVwMp_0 2024-09-12T01:38:01.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.772+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13098993317747135422', time=2024-09-12T03:14:17.039861+0000, chain.objs.size()=1 2024-09-12T01:38:01.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.772+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.339__shadow_.H5_3rfPctIzlmU9MWqceV6myklDBaHD_0 2024-09-12T01:38:01.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.772+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7893529196510029774', time=2024-09-12T03:16:15.236921+0000, chain.objs.size()=1 2024-09-12T01:38:01.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.772+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.460__shadow_.yPRlezMRHsDifA68Zpx05bk6JKvDQaZ_0 2024-09-12T01:38:01.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.772+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6612476258632524884', time=2024-09-12T03:16:16.594753+0000, chain.objs.size()=1 2024-09-12T01:38:01.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.772+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.461__shadow_.qu_MshySybpA3jT0W9rmAqdDNU8TCKS_0 2024-09-12T01:38:01.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.772+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.16804841403381522223', time=2024-09-12T03:16:34.344540+0000, chain.objs.size()=1 2024-09-12T01:38:01.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.772+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.483__shadow_.tiKyvSD8J4dLfAm1DdUP-SBaleyS4_w_0 2024-09-12T01:38:01.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.772+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1949623733346231865', time=2024-09-12T03:17:30.683534+0000, chain.objs.size()=1 2024-09-12T01:38:01.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.772+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.513__multipart_mymultipart.2~FBVKn9sH1JHQ34Bx3SUZ3IJwFCFNaMM.1 2024-09-12T01:38:01.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.774+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.10117859819863055885', time=2024-09-12T03:17:33.364073+0000, chain.objs.size()=1 2024-09-12T01:38:01.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.774+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.516__multipart_mymultipartcopy.2~zOf4prrcGcuE0JtlvtfYfT1OETu8olM.1 2024-09-12T01:38:01.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.777+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.1702912816749203999', time=2024-09-12T03:21:06.289433+0000, chain.objs.size()=4 2024-09-12T01:38:01.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.777+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.527__multipart_mymultipart.2~SRbiwv3SKLvWNyd8NzorLUVuZ5L0HhC.1 2024-09-12T01:38:01.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.777+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.527__multipart_mymultipart.2~SRbiwv3SKLvWNyd8NzorLUVuZ5L0HhC.2 2024-09-12T01:38:01.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.777+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.527__multipart_mymultipart.2~SRbiwv3SKLvWNyd8NzorLUVuZ5L0HhC.3 2024-09-12T01:38:01.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.777+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.527__multipart_mymultipart.2~SRbiwv3SKLvWNyd8NzorLUVuZ5L0HhC.4 2024-09-12T01:38:01.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.777+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.8988812753719422806', time=2024-09-12T03:21:43.095368+0000, chain.objs.size()=4 2024-09-12T01:38:01.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.777+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.535__multipart_mymultipart.2~9A79sgjjDwaFNtN6qi6A62kBxTwvRix.1 2024-09-12T01:38:01.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.777+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.535__multipart_mymultipart.2~9A79sgjjDwaFNtN6qi6A62kBxTwvRix.2 2024-09-12T01:38:01.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.777+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.535__multipart_mymultipart.voR1ovZDC84bhLVdGvjmpF_wHsQ14PRZ.3 2024-09-12T01:38:01.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.777+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.535__multipart_mymultipart.2~9A79sgjjDwaFNtN6qi6A62kBxTwvRix.4 2024-09-12T01:38:01.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.777+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.7490026946086868277', time=2024-09-12T03:22:24.459159+0000, chain.objs.size()=1 2024-09-12T01:38:01.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.777+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.553__shadow_.fjVBDZCVg75zV8Enf6wxBAX-v6DEqKF_0 2024-09-12T01:38:01.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.777+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.17397961209254759252', time=2024-09-12T03:22:38.198495+0000, chain.objs.size()=1 2024-09-12T01:38:01.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.777+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.556__shadow_.xh4qCYQTGae_5IVW_nP7ETgmKBxkDnt_0 2024-09-12T01:38:01.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.780+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.13737567680856478933', time=2024-09-12T03:23:40.540635+0000, chain.objs.size()=1 2024-09-12T01:38:01.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.780+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.577__shadow:t-1SLZ5CFCh4UomNfJHOCDgNOH6poGO_.QY7t5s0OX1x0jcvqlK7KwmSF0PZURPI_0 2024-09-12T01:38:01.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.783+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.14409181941884905070', time=2024-09-12T03:23:51.878511+0000, chain.objs.size()=1 2024-09-12T01:38:01.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.783+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.577__shadow:u81FuN.2Jfal-BQ6iKWSY8boMJkFn6i_.CB-aSy5_1b2bNJXQdpcf-NLXZqvo4Zr_0 2024-09-12T01:38:01.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.783+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6741605465174331416', time=2024-09-12T03:24:38.934808+0000, chain.objs.size()=1 2024-09-12T01:38:01.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.783+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.580__shadow:lRKq1XAFChM41QgEyR9SzNNZWhNLJV2_.gKxkvQo9V8ZhaSpUeaqoUIVAuNkiPJF_0 2024-09-12T01:38:01.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.783+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11517519899262156833', time=2024-09-12T03:25:00.306317+0000, chain.objs.size()=1 2024-09-12T01:38:01.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.783+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.602__shadow_.Uf93hQvX6MWvvEc0iBS8bzn_NUoOJfr_0 2024-09-12T01:38:01.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.783+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.12944471949882486276', time=2024-09-12T03:30:02.374006+0000, chain.objs.size()=1 2024-09-12T01:38:01.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.783+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.641__shadow_.sOgLAtrieeUo6egl2BKvW009uLB6ZBF_0 2024-09-12T01:38:01.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.783+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.15347738753491788899', time=2024-09-12T03:31:53.617998+0000, chain.objs.size()=1 2024-09-12T01:38:01.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.783+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.716__shadow:1TSsX3P6-IXFki4Bpt1yXPZlnIOJ6Ja_.PQUglSlnmsWGC6CGuOE5-3b1WHC5E5D_0 2024-09-12T01:38:01.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.783+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11027799910169214161', time=2024-09-12T03:32:05.046319+0000, chain.objs.size()=1 2024-09-12T01:38:01.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.783+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.718__shadow_.u8vQ0phgNrzi9wfjchwqsTizwAdqjyk_0 2024-09-12T01:38:01.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.783+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.6720576610304649463', time=2024-09-12T03:32:37.121921+0000, chain.objs.size()=1 2024-09-12T01:38:01.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.783+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.739__shadow_.w0Sok44vAdwR2-owrEgc0q6jNmoSOwD_0 2024-09-12T01:38:01.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.785+0000 7f8786c98800 20 garbage collection: RGWGC::process iterating over entry tag='f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.11784838949620101710', time=2024-09-12T03:37:41.644633+0000, chain.objs.size()=1 2024-09-12T01:38:01.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.785+0000 7f8786c98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f9f527f5-8b4c-4872-ac3f-dc4ec6ab0c0d.4589.782__shadow_.BuW47tThs1od2Ufq2NX4-jU5CLJ3TSB_0 2024-09-12T01:38:01.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.791+0000 7f8786c98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:38:01.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.796+0000 7f863afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:38:01.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.798+0000 7f8786c98800 20 remove_watcher() i=0 2024-09-12T01:38:01.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.798+0000 7f8786c98800 2 removed watcher, disabling cache 2024-09-12T01:38:01.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.799+0000 7f8786c98800 20 remove_watcher() i=1 2024-09-12T01:38:01.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.800+0000 7f8786c98800 20 remove_watcher() i=2 2024-09-12T01:38:01.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.801+0000 7f8786c98800 20 remove_watcher() i=3 2024-09-12T01:38:01.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.802+0000 7f8786c98800 20 remove_watcher() i=4 2024-09-12T01:38:01.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.803+0000 7f8786c98800 20 remove_watcher() i=5 2024-09-12T01:38:01.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.804+0000 7f8786c98800 20 remove_watcher() i=6 2024-09-12T01:38:01.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T01:38:01.805+0000 7f8786c98800 20 remove_watcher() i=7 2024-09-12T01:38:01.815 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-09-12T01:38:01.826 DEBUG:teuthology.orchestra.run.smithi073:> rm -f /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/root.key 2024-09-12T01:38:01.885 DEBUG:teuthology.orchestra.run.smithi073:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-09-12T01:38:01.954 DEBUG:teuthology.orchestra.run.smithi073:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.crt /home/ubuntu/cephtest/ca/rgw.client.0.key 2024-09-12T01:38:02.024 DEBUG:teuthology.orchestra.run.smithi073:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-09-12T01:38:02.093 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm /usr/share/pki/ca-trust-source/anchors/root.crt 2024-09-12T01:38:02.171 DEBUG:teuthology.orchestra.run.smithi073:> sudo update-ca-trust 2024-09-12T01:38:03.241 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-12T01:38:03.252 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T01:38:03.252 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:38:03.591 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:38:03.605 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T01:38:03.608 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":2352,"stamp":"2024-09-12T01:38:01.938531+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":343016073,"num_objects":2715,"num_object_clones":0,"num_object_copies":5430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2715,"num_whiteouts":0,"num_read":179406,"num_read_kb":2409008,"num_write":141464,"num_write_kb":2323065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":27197,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13762,"ondisk_log_size":13762,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2193464,"kb_used_data":902452,"kb_used_omap":12,"kb_used_meta":1290355,"kb_avail":752781256,"statfs":{"total":773094113280,"available":770848006144,"internally_reserved":0,"allocated":924110848,"data_stored":890050473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1321324081},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-344916886,"num_objects":-2098,"num_object_clones":0,"num_object_copies":-4196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2098,"num_whiteouts":0,"num_read":2347,"num_read_kb":1949,"num_write":2227,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004864"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:17.783401+0000","last_change":"2024-09-12T01:04:15.393241+0000","last_active":"2024-09-12T01:34:17.783401+0000","last_peered":"2024-09-12T01:34:17.783401+0000","last_clean":"2024-09-12T01:34:17.783401+0000","last_became_active":"2024-09-12T01:04:15.392944+0000","last_became_peered":"2024-09-12T01:04:15.392944+0000","last_unstale":"2024-09-12T01:34:17.783401+0000","last_undegraded":"2024-09-12T01:34:17.783401+0000","last_fullsized":"2024-09-12T01:34:17.783401+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:32.532552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"263'6","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:57.780602+0000","last_change":"2024-09-12T00:46:26.362583+0000","last_active":"2024-09-12T01:33:57.780602+0000","last_peered":"2024-09-12T01:33:57.780602+0000","last_clean":"2024-09-12T01:33:57.780602+0000","last_became_active":"2024-09-12T00:46:26.362231+0000","last_became_peered":"2024-09-12T00:46:26.362231+0000","last_unstale":"2024-09-12T01:33:57.780602+0000","last_undegraded":"2024-09-12T01:33:57.780602+0000","last_fullsized":"2024-09-12T01:33:57.780602+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:47.340687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":19456,"num_write":11,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:54.637545+0000","last_change":"2024-09-12T00:46:22.353581+0000","last_active":"2024-09-12T01:33:54.637545+0000","last_peered":"2024-09-12T01:33:54.637545+0000","last_clean":"2024-09-12T01:33:54.637545+0000","last_became_active":"2024-09-12T00:46:22.353306+0000","last_became_peered":"2024-09-12T00:46:22.353306+0000","last_unstale":"2024-09-12T01:33:54.637545+0000","last_undegraded":"2024-09-12T01:33:54.637545+0000","last_fullsized":"2024-09-12T01:33:54.637545+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:42.123772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"263'59","reported_seq":219,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:41.789494+0000","last_change":"2024-09-12T00:42:36.818643+0000","last_active":"2024-09-12T01:34:41.789494+0000","last_peered":"2024-09-12T01:34:41.789494+0000","last_clean":"2024-09-12T01:34:41.789494+0000","last_became_active":"2024-09-12T00:42:36.818329+0000","last_became_peered":"2024-09-12T00:42:36.818329+0000","last_unstale":"2024-09-12T01:34:41.789494+0000","last_undegraded":"2024-09-12T01:34:41.789494+0000","last_fullsized":"2024-09-12T01:34:41.789494+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:59.176386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":293,"num_read_kb":205,"num_write":105,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:16.629694+0000","last_change":"2024-09-12T01:04:15.393046+0000","last_active":"2024-09-12T01:34:16.629694+0000","last_peered":"2024-09-12T01:34:16.629694+0000","last_clean":"2024-09-12T01:34:16.629694+0000","last_became_active":"2024-09-12T01:04:15.392747+0000","last_became_peered":"2024-09-12T01:04:15.392747+0000","last_unstale":"2024-09-12T01:34:16.629694+0000","last_undegraded":"2024-09-12T01:34:16.629694+0000","last_fullsized":"2024-09-12T01:34:16.629694+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:12.627526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"263'2","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.534462+0000","last_change":"2024-09-12T00:46:26.370283+0000","last_active":"2024-09-12T01:33:56.534462+0000","last_peered":"2024-09-12T01:33:56.534462+0000","last_clean":"2024-09-12T01:33:56.534462+0000","last_became_active":"2024-09-12T00:46:26.369944+0000","last_became_peered":"2024-09-12T00:46:26.369944+0000","last_unstale":"2024-09-12T01:33:56.534462+0000","last_undegraded":"2024-09-12T01:33:56.534462+0000","last_fullsized":"2024-09-12T01:33:56.534462+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:14.648408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"260'8","reported_seq":70,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.933295+0000","last_change":"2024-09-12T00:46:22.354256+0000","last_active":"2024-09-12T01:33:51.933295+0000","last_peered":"2024-09-12T01:33:51.933295+0000","last_clean":"2024-09-12T01:33:51.933295+0000","last_became_active":"2024-09-12T00:46:22.352009+0000","last_became_peered":"2024-09-12T00:46:22.352009+0000","last_unstale":"2024-09-12T01:33:51.933295+0000","last_undegraded":"2024-09-12T01:33:51.933295+0000","last_fullsized":"2024-09-12T01:33:51.933295+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:27.873653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":26626,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"263'20","reported_seq":116,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:56.533176+0000","last_change":"2024-09-12T00:42:36.809720+0000","last_active":"2024-09-12T01:34:56.533176+0000","last_peered":"2024-09-12T01:34:56.533176+0000","last_clean":"2024-09-12T01:34:56.533176+0000","last_became_active":"2024-09-12T00:42:36.809431+0000","last_became_peered":"2024-09-12T00:42:36.809431+0000","last_unstale":"2024-09-12T01:34:56.533176+0000","last_undegraded":"2024-09-12T01:34:56.533176+0000","last_fullsized":"2024-09-12T01:34:56.533176+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:09.971874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":73,"num_write":40,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:16.528384+0000","last_change":"2024-09-12T01:04:15.384612+0000","last_active":"2024-09-12T01:33:16.528384+0000","last_peered":"2024-09-12T01:33:16.528384+0000","last_clean":"2024-09-12T01:33:16.528384+0000","last_became_active":"2024-09-12T01:04:15.384312+0000","last_became_peered":"2024-09-12T01:04:15.384312+0000","last_unstale":"2024-09-12T01:33:16.528384+0000","last_undegraded":"2024-09-12T01:33:16.528384+0000","last_fullsized":"2024-09-12T01:33:16.528384+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:27.357127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:21.786809+0000","last_change":"2024-09-12T00:46:26.563569+0000","last_active":"2024-09-12T01:34:21.786809+0000","last_peered":"2024-09-12T01:34:21.786809+0000","last_clean":"2024-09-12T01:34:21.786809+0000","last_became_active":"2024-09-12T00:46:26.563267+0000","last_became_peered":"2024-09-12T00:46:26.563267+0000","last_unstale":"2024-09-12T01:34:21.786809+0000","last_undegraded":"2024-09-12T01:34:21.786809+0000","last_fullsized":"2024-09-12T01:34:21.786809+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:14.364154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"260'3","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:41.531630+0000","last_change":"2024-09-12T00:46:22.341443+0000","last_active":"2024-09-12T01:34:41.531630+0000","last_peered":"2024-09-12T01:34:41.531630+0000","last_clean":"2024-09-12T01:34:41.531630+0000","last_became_active":"2024-09-12T00:46:22.340655+0000","last_became_peered":"2024-09-12T00:46:22.340655+0000","last_unstale":"2024-09-12T01:34:41.531630+0000","last_undegraded":"2024-09-12T01:34:41.531630+0000","last_fullsized":"2024-09-12T01:34:41.531630+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:34.773392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"263'63","reported_seq":226,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:06.792053+0000","last_change":"2024-09-12T00:42:36.814795+0000","last_active":"2024-09-12T01:35:06.792053+0000","last_peered":"2024-09-12T01:35:06.792053+0000","last_clean":"2024-09-12T01:35:06.792053+0000","last_became_active":"2024-09-12T00:42:36.814510+0000","last_became_peered":"2024-09-12T00:42:36.814510+0000","last_unstale":"2024-09-12T01:35:06.792053+0000","last_undegraded":"2024-09-12T01:35:06.792053+0000","last_fullsized":"2024-09-12T01:35:06.792053+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:42.130114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":321,"num_read_kb":228,"num_write":110,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:19.633277+0000","last_change":"2024-09-12T01:04:15.402204+0000","last_active":"2024-09-12T01:33:19.633277+0000","last_peered":"2024-09-12T01:33:19.633277+0000","last_clean":"2024-09-12T01:33:19.633277+0000","last_became_active":"2024-09-12T01:04:15.401897+0000","last_became_peered":"2024-09-12T01:04:15.401897+0000","last_unstale":"2024-09-12T01:33:19.633277+0000","last_undegraded":"2024-09-12T01:33:19.633277+0000","last_fullsized":"2024-09-12T01:33:19.633277+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:27.841236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:39.642849+0000","last_change":"2024-09-12T00:46:26.562165+0000","last_active":"2024-09-12T01:34:39.642849+0000","last_peered":"2024-09-12T01:34:39.642849+0000","last_clean":"2024-09-12T01:34:39.642849+0000","last_became_active":"2024-09-12T00:46:26.561870+0000","last_became_peered":"2024-09-12T00:46:26.561870+0000","last_unstale":"2024-09-12T01:34:39.642849+0000","last_undegraded":"2024-09-12T01:34:39.642849+0000","last_fullsized":"2024-09-12T01:34:39.642849+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:20.530939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"263'6","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.235708+0000","last_change":"2024-09-12T00:46:22.339498+0000","last_active":"2024-09-12T01:38:00.235708+0000","last_peered":"2024-09-12T01:38:00.235708+0000","last_clean":"2024-09-12T01:38:00.235708+0000","last_became_active":"2024-09-12T00:46:22.339141+0000","last_became_peered":"2024-09-12T00:46:22.339141+0000","last_unstale":"2024-09-12T01:38:00.235708+0000","last_undegraded":"2024-09-12T01:38:00.235708+0000","last_fullsized":"2024-09-12T01:38:00.235708+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:45.856718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"263'62","reported_seq":225,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:09.646373+0000","last_change":"2024-09-12T00:42:36.816859+0000","last_active":"2024-09-12T01:35:09.646373+0000","last_peered":"2024-09-12T01:35:09.646373+0000","last_clean":"2024-09-12T01:35:09.646373+0000","last_became_active":"2024-09-12T00:42:36.816570+0000","last_became_peered":"2024-09-12T00:42:36.816570+0000","last_unstale":"2024-09-12T01:35:09.646373+0000","last_undegraded":"2024-09-12T01:35:09.646373+0000","last_fullsized":"2024-09-12T01:35:09.646373+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:03.911054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":318,"num_read_kb":239,"num_write":100,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:19.640647+0000","last_change":"2024-09-12T01:04:15.400469+0000","last_active":"2024-09-12T01:34:19.640647+0000","last_peered":"2024-09-12T01:34:19.640647+0000","last_clean":"2024-09-12T01:34:19.640647+0000","last_became_active":"2024-09-12T01:04:15.400228+0000","last_became_peered":"2024-09-12T01:04:15.400228+0000","last_unstale":"2024-09-12T01:34:19.640647+0000","last_undegraded":"2024-09-12T01:34:19.640647+0000","last_fullsized":"2024-09-12T01:34:19.640647+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:12.710997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"263'7","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:52.788364+0000","last_change":"2024-09-12T00:46:26.368145+0000","last_active":"2024-09-12T01:34:52.788364+0000","last_peered":"2024-09-12T01:34:52.788364+0000","last_clean":"2024-09-12T01:34:52.788364+0000","last_became_active":"2024-09-12T00:46:26.367849+0000","last_became_peered":"2024-09-12T00:46:26.367849+0000","last_unstale":"2024-09-12T01:34:52.788364+0000","last_undegraded":"2024-09-12T01:34:52.788364+0000","last_fullsized":"2024-09-12T01:34:52.788364+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:35.175209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":7168,"num_write":17,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"263'13","reported_seq":83,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:06.806586+0000","last_change":"2024-09-12T00:46:22.351181+0000","last_active":"2024-09-12T01:37:06.806586+0000","last_peered":"2024-09-12T01:37:06.806586+0000","last_clean":"2024-09-12T01:37:06.806586+0000","last_became_active":"2024-09-12T00:46:22.349597+0000","last_became_peered":"2024-09-12T00:46:22.349597+0000","last_unstale":"2024-09-12T01:37:06.806586+0000","last_undegraded":"2024-09-12T01:37:06.806586+0000","last_fullsized":"2024-09-12T01:37:06.806586+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:58.755945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":44034,"num_write":28,"num_write_kb":19456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"263'28","reported_seq":129,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:09.646341+0000","last_change":"2024-09-12T00:42:36.815076+0000","last_active":"2024-09-12T01:35:09.646341+0000","last_peered":"2024-09-12T01:35:09.646341+0000","last_clean":"2024-09-12T01:35:09.646341+0000","last_became_active":"2024-09-12T00:42:36.814799+0000","last_became_peered":"2024-09-12T00:42:36.814799+0000","last_unstale":"2024-09-12T01:35:09.646341+0000","last_undegraded":"2024-09-12T01:35:09.646341+0000","last_fullsized":"2024-09-12T01:35:09.646341+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:46.026762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":94,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:31.946433+0000","last_change":"2024-09-12T01:04:15.388981+0000","last_active":"2024-09-12T01:35:31.946433+0000","last_peered":"2024-09-12T01:35:31.946433+0000","last_clean":"2024-09-12T01:35:31.946433+0000","last_became_active":"2024-09-12T01:04:15.388593+0000","last_became_peered":"2024-09-12T01:04:15.388593+0000","last_unstale":"2024-09-12T01:35:31.946433+0000","last_undegraded":"2024-09-12T01:35:31.946433+0000","last_fullsized":"2024-09-12T01:35:31.946433+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:42.435298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"260'2","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:46.540932+0000","last_change":"2024-09-12T00:47:05.446932+0000","last_active":"2024-09-12T01:34:46.540932+0000","last_peered":"2024-09-12T01:34:46.540932+0000","last_clean":"2024-09-12T01:34:46.540932+0000","last_became_active":"2024-09-12T00:47:05.444004+0000","last_became_peered":"2024-09-12T00:47:05.444004+0000","last_unstale":"2024-09-12T01:34:46.540932+0000","last_undegraded":"2024-09-12T01:34:46.540932+0000","last_fullsized":"2024-09-12T01:34:46.540932+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:13.946930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":27197,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"263'2","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:21.563798+0000","last_change":"2024-09-12T00:46:22.348331+0000","last_active":"2024-09-12T01:37:21.563798+0000","last_peered":"2024-09-12T01:37:21.563798+0000","last_clean":"2024-09-12T01:37:21.563798+0000","last_became_active":"2024-09-12T00:46:22.347338+0000","last_became_peered":"2024-09-12T00:46:22.347338+0000","last_unstale":"2024-09-12T01:37:21.563798+0000","last_undegraded":"2024-09-12T01:37:21.563798+0000","last_fullsized":"2024-09-12T01:37:21.563798+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:08.989061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"260'71","reported_seq":297,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:06.543849+0000","last_change":"2024-09-12T00:42:36.812768+0000","last_active":"2024-09-12T01:35:06.543849+0000","last_peered":"2024-09-12T01:35:06.543849+0000","last_clean":"2024-09-12T01:35:06.543849+0000","last_became_active":"2024-09-12T00:42:36.812454+0000","last_became_peered":"2024-09-12T00:42:36.812454+0000","last_unstale":"2024-09-12T01:35:06.543849+0000","last_undegraded":"2024-09-12T01:35:06.543849+0000","last_fullsized":"2024-09-12T01:35:06.543849+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:06.880124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":475,"num_read_kb":319,"num_write":83,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"263'1","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:16.721868+0000","last_change":"2024-09-12T01:04:15.391988+0000","last_active":"2024-09-12T01:34:16.721868+0000","last_peered":"2024-09-12T01:34:16.721868+0000","last_clean":"2024-09-12T01:34:16.721868+0000","last_became_active":"2024-09-12T01:04:15.391532+0000","last_became_peered":"2024-09-12T01:04:15.391532+0000","last_unstale":"2024-09-12T01:34:16.721868+0000","last_undegraded":"2024-09-12T01:34:16.721868+0000","last_fullsized":"2024-09-12T01:34:16.721868+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:13.040622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"263'6","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.236119+0000","last_change":"2024-09-12T00:46:26.374943+0000","last_active":"2024-09-12T01:38:00.236119+0000","last_peered":"2024-09-12T01:38:00.236119+0000","last_clean":"2024-09-12T01:38:00.236119+0000","last_became_active":"2024-09-12T00:46:26.374660+0000","last_became_peered":"2024-09-12T00:46:26.374660+0000","last_unstale":"2024-09-12T01:38:00.236119+0000","last_undegraded":"2024-09-12T01:38:00.236119+0000","last_fullsized":"2024-09-12T01:38:00.236119+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:20.054984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"263'7","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:21.555167+0000","last_change":"2024-09-12T00:46:22.340546+0000","last_active":"2024-09-12T01:36:21.555167+0000","last_peered":"2024-09-12T01:36:21.555167+0000","last_clean":"2024-09-12T01:36:21.555167+0000","last_became_active":"2024-09-12T00:46:22.340228+0000","last_became_peered":"2024-09-12T00:46:22.340228+0000","last_unstale":"2024-09-12T01:36:21.555167+0000","last_undegraded":"2024-09-12T01:36:21.555167+0000","last_fullsized":"2024-09-12T01:36:21.555167+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:22.609852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6219,"num_write":7,"num_write_kb":6219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"263'129","reported_seq":431,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:31.780542+0000","last_change":"2024-09-12T00:42:36.813186+0000","last_active":"2024-09-12T01:33:31.780542+0000","last_peered":"2024-09-12T01:33:31.780542+0000","last_clean":"2024-09-12T01:33:31.780542+0000","last_became_active":"2024-09-12T00:42:36.812882+0000","last_became_peered":"2024-09-12T00:42:36.812882+0000","last_unstale":"2024-09-12T01:33:31.780542+0000","last_undegraded":"2024-09-12T01:33:31.780542+0000","last_fullsized":"2024-09-12T01:33:31.780542+0000","mapping_epoch":250,"log_start":"260'100","ondisk_log_start":"260'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:07.773148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":723,"num_read_kb":503,"num_write":193,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:16.721896+0000","last_change":"2024-09-12T01:04:15.398861+0000","last_active":"2024-09-12T01:34:16.721896+0000","last_peered":"2024-09-12T01:34:16.721896+0000","last_clean":"2024-09-12T01:34:16.721896+0000","last_became_active":"2024-09-12T01:04:15.398533+0000","last_became_peered":"2024-09-12T01:04:15.398533+0000","last_unstale":"2024-09-12T01:34:16.721896+0000","last_undegraded":"2024-09-12T01:34:16.721896+0000","last_fullsized":"2024-09-12T01:34:16.721896+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:15.428730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"263'3","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:59.638134+0000","last_change":"2024-09-12T00:46:26.368036+0000","last_active":"2024-09-12T01:33:59.638134+0000","last_peered":"2024-09-12T01:33:59.638134+0000","last_clean":"2024-09-12T01:33:59.638134+0000","last_became_active":"2024-09-12T00:46:26.367766+0000","last_became_peered":"2024-09-12T00:46:26.367766+0000","last_unstale":"2024-09-12T01:33:59.638134+0000","last_undegraded":"2024-09-12T01:33:59.638134+0000","last_fullsized":"2024-09-12T01:33:59.638134+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:04.823775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5246081,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":8,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.783149+0000","last_change":"2024-09-12T00:46:22.354118+0000","last_active":"2024-09-12T01:33:51.783149+0000","last_peered":"2024-09-12T01:33:51.783149+0000","last_clean":"2024-09-12T01:33:51.783149+0000","last_became_active":"2024-09-12T00:46:22.353833+0000","last_became_peered":"2024-09-12T00:46:22.353833+0000","last_unstale":"2024-09-12T01:33:51.783149+0000","last_undegraded":"2024-09-12T01:33:51.783149+0000","last_fullsized":"2024-09-12T01:33:51.783149+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:15.168253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'39","reported_seq":166,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:21.929290+0000","last_change":"2024-09-12T00:42:36.803994+0000","last_active":"2024-09-12T01:33:21.929290+0000","last_peered":"2024-09-12T01:33:21.929290+0000","last_clean":"2024-09-12T01:33:21.929290+0000","last_became_active":"2024-09-12T00:42:36.803692+0000","last_became_peered":"2024-09-12T00:42:36.803692+0000","last_unstale":"2024-09-12T01:33:21.929290+0000","last_undegraded":"2024-09-12T01:33:21.929290+0000","last_fullsized":"2024-09-12T01:33:21.929290+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:25.542741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":209,"num_read_kb":149,"num_write":77,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.938567+0000","last_change":"2024-09-12T01:04:15.385887+0000","last_active":"2024-09-12T01:34:36.938567+0000","last_peered":"2024-09-12T01:34:36.938567+0000","last_clean":"2024-09-12T01:34:36.938567+0000","last_became_active":"2024-09-12T01:04:15.385172+0000","last_became_peered":"2024-09-12T01:04:15.385172+0000","last_unstale":"2024-09-12T01:34:36.938567+0000","last_undegraded":"2024-09-12T01:34:36.938567+0000","last_fullsized":"2024-09-12T01:34:36.938567+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:15.451328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"263'3","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:49.644101+0000","last_change":"2024-09-12T00:46:26.565125+0000","last_active":"2024-09-12T01:34:49.644101+0000","last_peered":"2024-09-12T01:34:49.644101+0000","last_clean":"2024-09-12T01:34:49.644101+0000","last_became_active":"2024-09-12T00:46:26.561643+0000","last_became_peered":"2024-09-12T00:46:26.561643+0000","last_unstale":"2024-09-12T01:34:49.644101+0000","last_undegraded":"2024-09-12T01:34:49.644101+0000","last_fullsized":"2024-09-12T01:34:49.644101+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:50.221519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5247843,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":10250,"num_write":8,"num_write_kb":5125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:27.793407+0000","last_change":"2024-09-12T00:46:22.349290+0000","last_active":"2024-09-12T01:35:27.793407+0000","last_peered":"2024-09-12T01:35:27.793407+0000","last_clean":"2024-09-12T01:35:27.793407+0000","last_became_active":"2024-09-12T00:46:22.349007+0000","last_became_peered":"2024-09-12T00:46:22.349007+0000","last_unstale":"2024-09-12T01:35:27.793407+0000","last_undegraded":"2024-09-12T01:35:27.793407+0000","last_fullsized":"2024-09-12T01:35:27.793407+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:56.041981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"263'19","reported_seq":112,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:21.779391+0000","last_change":"2024-09-12T00:42:36.815233+0000","last_active":"2024-09-12T01:33:21.779391+0000","last_peered":"2024-09-12T01:33:21.779391+0000","last_clean":"2024-09-12T01:33:21.779391+0000","last_became_active":"2024-09-12T00:42:36.814846+0000","last_became_peered":"2024-09-12T00:42:36.814846+0000","last_unstale":"2024-09-12T01:33:21.779391+0000","last_undegraded":"2024-09-12T01:33:21.779391+0000","last_fullsized":"2024-09-12T01:33:21.779391+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:27.509902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":75,"num_write":34,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"263'1","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.531023+0000","last_change":"2024-09-12T01:04:15.395818+0000","last_active":"2024-09-12T01:34:36.531023+0000","last_peered":"2024-09-12T01:34:36.531023+0000","last_clean":"2024-09-12T01:34:36.531023+0000","last_became_active":"2024-09-12T01:04:15.395540+0000","last_became_peered":"2024-09-12T01:04:15.395540+0000","last_unstale":"2024-09-12T01:34:36.531023+0000","last_undegraded":"2024-09-12T01:34:36.531023+0000","last_fullsized":"2024-09-12T01:34:36.531023+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:29.002458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:39.649759+0000","last_change":"2024-09-12T00:46:26.562294+0000","last_active":"2024-09-12T01:35:39.649759+0000","last_peered":"2024-09-12T01:35:39.649759+0000","last_clean":"2024-09-12T01:35:39.649759+0000","last_became_active":"2024-09-12T00:46:26.561961+0000","last_became_peered":"2024-09-12T00:46:26.561961+0000","last_unstale":"2024-09-12T01:35:39.649759+0000","last_undegraded":"2024-09-12T01:35:39.649759+0000","last_fullsized":"2024-09-12T01:35:39.649759+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:55.068083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"260'5","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:41.725916+0000","last_change":"2024-09-12T00:46:22.351249+0000","last_active":"2024-09-12T01:34:41.725916+0000","last_peered":"2024-09-12T01:34:41.725916+0000","last_clean":"2024-09-12T01:34:41.725916+0000","last_became_active":"2024-09-12T00:46:22.350947+0000","last_became_peered":"2024-09-12T00:46:22.350947+0000","last_unstale":"2024-09-12T01:34:41.725916+0000","last_undegraded":"2024-09-12T01:34:41.725916+0000","last_fullsized":"2024-09-12T01:34:41.725916+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:16.221679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"263'28","reported_seq":135,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:24.633878+0000","last_change":"2024-09-12T00:42:36.815997+0000","last_active":"2024-09-12T01:33:24.633878+0000","last_peered":"2024-09-12T01:33:24.633878+0000","last_clean":"2024-09-12T01:33:24.633878+0000","last_became_active":"2024-09-12T00:42:36.815638+0000","last_became_peered":"2024-09-12T00:42:36.815638+0000","last_unstale":"2024-09-12T01:33:24.633878+0000","last_undegraded":"2024-09-12T01:33:24.633878+0000","last_fullsized":"2024-09-12T01:33:24.633878+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:31.983576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":103,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.724838+0000","last_change":"2024-09-12T01:04:15.391815+0000","last_active":"2024-09-12T01:34:36.724838+0000","last_peered":"2024-09-12T01:34:36.724838+0000","last_clean":"2024-09-12T01:34:36.724838+0000","last_became_active":"2024-09-12T01:04:15.391501+0000","last_became_peered":"2024-09-12T01:04:15.391501+0000","last_unstale":"2024-09-12T01:34:36.724838+0000","last_undegraded":"2024-09-12T01:34:36.724838+0000","last_fullsized":"2024-09-12T01:34:36.724838+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:28.795724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:49.644166+0000","last_change":"2024-09-12T00:46:26.563439+0000","last_active":"2024-09-12T01:34:49.644166+0000","last_peered":"2024-09-12T01:34:49.644166+0000","last_clean":"2024-09-12T01:34:49.644166+0000","last_became_active":"2024-09-12T00:46:26.563091+0000","last_became_peered":"2024-09-12T00:46:26.563091+0000","last_unstale":"2024-09-12T01:34:49.644166+0000","last_undegraded":"2024-09-12T01:34:49.644166+0000","last_fullsized":"2024-09-12T01:34:49.644166+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:05.796776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:41.531600+0000","last_change":"2024-09-12T00:46:22.354515+0000","last_active":"2024-09-12T01:34:41.531600+0000","last_peered":"2024-09-12T01:34:41.531600+0000","last_clean":"2024-09-12T01:34:41.531600+0000","last_became_active":"2024-09-12T00:46:22.354167+0000","last_became_peered":"2024-09-12T00:46:22.354167+0000","last_unstale":"2024-09-12T01:34:41.531600+0000","last_undegraded":"2024-09-12T01:34:41.531600+0000","last_fullsized":"2024-09-12T01:34:41.531600+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:09.196332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"260'8","reported_seq":81,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:21.624072+0000","last_change":"2024-09-12T00:42:36.803040+0000","last_active":"2024-09-12T01:33:21.624072+0000","last_peered":"2024-09-12T01:33:21.624072+0000","last_clean":"2024-09-12T01:33:21.624072+0000","last_became_active":"2024-09-12T00:42:36.802737+0000","last_became_peered":"2024-09-12T00:42:36.802737+0000","last_unstale":"2024-09-12T01:33:21.624072+0000","last_undegraded":"2024-09-12T01:33:21.624072+0000","last_fullsized":"2024-09-12T01:33:21.624072+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:54.260259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:37.786393+0000","last_change":"2024-09-12T01:04:15.393599+0000","last_active":"2024-09-12T01:34:37.786393+0000","last_peered":"2024-09-12T01:34:37.786393+0000","last_clean":"2024-09-12T01:34:37.786393+0000","last_became_active":"2024-09-12T01:04:15.393292+0000","last_became_peered":"2024-09-12T01:04:15.393292+0000","last_unstale":"2024-09-12T01:34:37.786393+0000","last_undegraded":"2024-09-12T01:34:37.786393+0000","last_fullsized":"2024-09-12T01:34:37.786393+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:04.044752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"263'3","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:11.562356+0000","last_change":"2024-09-12T00:46:26.371159+0000","last_active":"2024-09-12T01:37:11.562356+0000","last_peered":"2024-09-12T01:37:11.562356+0000","last_clean":"2024-09-12T01:37:11.562356+0000","last_became_active":"2024-09-12T00:46:26.370845+0000","last_became_peered":"2024-09-12T00:46:26.370845+0000","last_unstale":"2024-09-12T01:37:11.562356+0000","last_undegraded":"2024-09-12T01:37:11.562356+0000","last_fullsized":"2024-09-12T01:37:11.562356+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:36.995861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:41.789472+0000","last_change":"2024-09-12T00:46:22.349777+0000","last_active":"2024-09-12T01:34:41.789472+0000","last_peered":"2024-09-12T01:34:41.789472+0000","last_clean":"2024-09-12T01:34:41.789472+0000","last_became_active":"2024-09-12T00:46:22.348534+0000","last_became_peered":"2024-09-12T00:46:22.348534+0000","last_unstale":"2024-09-12T01:34:41.789472+0000","last_undegraded":"2024-09-12T01:34:41.789472+0000","last_fullsized":"2024-09-12T01:34:41.789472+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:19.642717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"263'16","reported_seq":98,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:11.721017+0000","last_change":"2024-09-12T00:42:36.812901+0000","last_active":"2024-09-12T01:34:11.721017+0000","last_peered":"2024-09-12T01:34:11.721017+0000","last_clean":"2024-09-12T01:34:11.721017+0000","last_became_active":"2024-09-12T00:42:36.812629+0000","last_became_peered":"2024-09-12T00:42:36.812629+0000","last_unstale":"2024-09-12T01:34:11.721017+0000","last_undegraded":"2024-09-12T01:34:11.721017+0000","last_fullsized":"2024-09-12T01:34:11.721017+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:44.152868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":48,"num_write":38,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:14.632788+0000","last_change":"2024-09-12T01:04:15.398685+0000","last_active":"2024-09-12T01:33:14.632788+0000","last_peered":"2024-09-12T01:33:14.632788+0000","last_clean":"2024-09-12T01:33:14.632788+0000","last_became_active":"2024-09-12T01:04:15.398407+0000","last_became_peered":"2024-09-12T01:04:15.398407+0000","last_unstale":"2024-09-12T01:33:14.632788+0000","last_undegraded":"2024-09-12T01:33:14.632788+0000","last_fullsized":"2024-09-12T01:33:14.632788+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:31.635332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"263'2","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:26.945832+0000","last_change":"2024-09-12T00:46:26.367154+0000","last_active":"2024-09-12T01:35:26.945832+0000","last_peered":"2024-09-12T01:35:26.945832+0000","last_clean":"2024-09-12T01:35:26.945832+0000","last_became_active":"2024-09-12T00:46:26.366602+0000","last_became_peered":"2024-09-12T00:46:26.366602+0000","last_unstale":"2024-09-12T01:35:26.945832+0000","last_undegraded":"2024-09-12T01:35:26.945832+0000","last_fullsized":"2024-09-12T01:35:26.945832+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:36.704535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"263'8","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.830541+0000","last_change":"2024-09-12T00:46:22.351729+0000","last_active":"2024-09-12T01:38:00.830541+0000","last_peered":"2024-09-12T01:38:00.830541+0000","last_clean":"2024-09-12T01:38:00.830541+0000","last_became_active":"2024-09-12T00:46:22.351432+0000","last_became_peered":"2024-09-12T00:46:22.351432+0000","last_unstale":"2024-09-12T01:38:00.830541+0000","last_undegraded":"2024-09-12T01:38:00.830541+0000","last_fullsized":"2024-09-12T01:38:00.830541+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:22.950636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":18,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"252'16","reported_seq":103,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.718650+0000","last_change":"2024-09-12T00:42:36.813580+0000","last_active":"2024-09-12T01:33:56.718650+0000","last_peered":"2024-09-12T01:33:56.718650+0000","last_clean":"2024-09-12T01:33:56.718650+0000","last_became_active":"2024-09-12T00:42:36.813324+0000","last_became_peered":"2024-09-12T00:42:36.813324+0000","last_unstale":"2024-09-12T01:33:56.718650+0000","last_undegraded":"2024-09-12T01:33:56.718650+0000","last_fullsized":"2024-09-12T01:33:56.718650+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:12.154346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":59,"num_write":21,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:16.778711+0000","last_change":"2024-09-12T01:04:15.394539+0000","last_active":"2024-09-12T01:33:16.778711+0000","last_peered":"2024-09-12T01:33:16.778711+0000","last_clean":"2024-09-12T01:33:16.778711+0000","last_became_active":"2024-09-12T01:04:15.393021+0000","last_became_peered":"2024-09-12T01:04:15.393021+0000","last_unstale":"2024-09-12T01:33:16.778711+0000","last_undegraded":"2024-09-12T01:33:16.778711+0000","last_fullsized":"2024-09-12T01:33:16.778711+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:47.214589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"260'8","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:26.945799+0000","last_change":"2024-09-12T00:46:26.371696+0000","last_active":"2024-09-12T01:35:26.945799+0000","last_peered":"2024-09-12T01:35:26.945799+0000","last_clean":"2024-09-12T01:35:26.945799+0000","last_became_active":"2024-09-12T00:46:26.371443+0000","last_became_peered":"2024-09-12T00:46:26.371443+0000","last_unstale":"2024-09-12T01:35:26.945799+0000","last_undegraded":"2024-09-12T01:35:26.945799+0000","last_fullsized":"2024-09-12T01:35:26.945799+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:26.396539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":26626,"num_write":8,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:24.648070+0000","last_change":"2024-09-12T00:46:22.352325+0000","last_active":"2024-09-12T01:35:24.648070+0000","last_peered":"2024-09-12T01:35:24.648070+0000","last_clean":"2024-09-12T01:35:24.648070+0000","last_became_active":"2024-09-12T00:46:22.350714+0000","last_became_peered":"2024-09-12T00:46:22.350714+0000","last_unstale":"2024-09-12T01:35:24.648070+0000","last_undegraded":"2024-09-12T01:35:24.648070+0000","last_fullsized":"2024-09-12T01:35:24.648070+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:40.578771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"263'52","reported_seq":201,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.783741+0000","last_change":"2024-09-12T00:42:36.818076+0000","last_active":"2024-09-12T01:33:56.783741+0000","last_peered":"2024-09-12T01:33:56.783741+0000","last_clean":"2024-09-12T01:33:56.783741+0000","last_became_active":"2024-09-12T00:42:36.817763+0000","last_became_peered":"2024-09-12T00:42:36.817763+0000","last_unstale":"2024-09-12T01:33:56.783741+0000","last_undegraded":"2024-09-12T01:33:56.783741+0000","last_fullsized":"2024-09-12T01:33:56.783741+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:56.184689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":268,"num_read_kb":195,"num_write":87,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.788740+0000","last_change":"2024-09-12T01:04:15.397100+0000","last_active":"2024-09-12T01:34:36.788740+0000","last_peered":"2024-09-12T01:34:36.788740+0000","last_clean":"2024-09-12T01:34:36.788740+0000","last_became_active":"2024-09-12T01:04:15.396832+0000","last_became_peered":"2024-09-12T01:04:15.396832+0000","last_unstale":"2024-09-12T01:34:36.788740+0000","last_undegraded":"2024-09-12T01:34:36.788740+0000","last_fullsized":"2024-09-12T01:34:36.788740+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:22.398122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:29.648642+0000","last_change":"2024-09-12T00:46:26.373712+0000","last_active":"2024-09-12T01:35:29.648642+0000","last_peered":"2024-09-12T01:35:29.648642+0000","last_clean":"2024-09-12T01:35:29.648642+0000","last_became_active":"2024-09-12T00:46:26.373401+0000","last_became_peered":"2024-09-12T00:46:26.373401+0000","last_unstale":"2024-09-12T01:35:29.648642+0000","last_undegraded":"2024-09-12T01:35:29.648642+0000","last_fullsized":"2024-09-12T01:35:29.648642+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:11.356426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:21.546124+0000","last_change":"2024-09-12T00:46:22.348093+0000","last_active":"2024-09-12T01:35:21.546124+0000","last_peered":"2024-09-12T01:35:21.546124+0000","last_clean":"2024-09-12T01:35:21.546124+0000","last_became_active":"2024-09-12T00:46:22.347794+0000","last_became_peered":"2024-09-12T00:46:22.347794+0000","last_unstale":"2024-09-12T01:35:21.546124+0000","last_undegraded":"2024-09-12T01:35:21.546124+0000","last_fullsized":"2024-09-12T01:35:21.546124+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:37.768628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'10","reported_seq":83,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.534383+0000","last_change":"2024-09-12T00:42:36.802979+0000","last_active":"2024-09-12T01:33:56.534383+0000","last_peered":"2024-09-12T01:33:56.534383+0000","last_clean":"2024-09-12T01:33:56.534383+0000","last_became_active":"2024-09-12T00:42:36.802647+0000","last_became_peered":"2024-09-12T00:42:36.802647+0000","last_unstale":"2024-09-12T01:33:56.534383+0000","last_undegraded":"2024-09-12T01:33:56.534383+0000","last_fullsized":"2024-09-12T01:33:56.534383+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:38.850484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":30,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:14.632767+0000","last_change":"2024-09-12T01:04:15.397994+0000","last_active":"2024-09-12T01:33:14.632767+0000","last_peered":"2024-09-12T01:33:14.632767+0000","last_clean":"2024-09-12T01:33:14.632767+0000","last_became_active":"2024-09-12T01:04:15.397646+0000","last_became_peered":"2024-09-12T01:04:15.397646+0000","last_unstale":"2024-09-12T01:33:14.632767+0000","last_undegraded":"2024-09-12T01:33:14.632767+0000","last_fullsized":"2024-09-12T01:33:14.632767+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:13.049264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"263'3","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.567221+0000","last_change":"2024-09-12T00:46:26.373701+0000","last_active":"2024-09-12T01:37:46.567221+0000","last_peered":"2024-09-12T01:37:46.567221+0000","last_clean":"2024-09-12T01:37:46.567221+0000","last_became_active":"2024-09-12T00:46:26.373354+0000","last_became_peered":"2024-09-12T00:46:26.373354+0000","last_unstale":"2024-09-12T01:37:46.567221+0000","last_undegraded":"2024-09-12T01:37:46.567221+0000","last_fullsized":"2024-09-12T01:37:46.567221+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:00.128990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:22.792606+0000","last_change":"2024-09-12T00:46:22.349188+0000","last_active":"2024-09-12T01:35:22.792606+0000","last_peered":"2024-09-12T01:35:22.792606+0000","last_clean":"2024-09-12T01:35:22.792606+0000","last_became_active":"2024-09-12T00:46:22.348875+0000","last_became_peered":"2024-09-12T00:46:22.348875+0000","last_unstale":"2024-09-12T01:35:22.792606+0000","last_undegraded":"2024-09-12T01:35:22.792606+0000","last_fullsized":"2024-09-12T01:35:22.792606+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:31.550301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"263'37","reported_seq":164,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:59.638083+0000","last_change":"2024-09-12T00:42:36.814630+0000","last_active":"2024-09-12T01:33:59.638083+0000","last_peered":"2024-09-12T01:33:59.638083+0000","last_clean":"2024-09-12T01:33:59.638083+0000","last_became_active":"2024-09-12T00:42:36.814235+0000","last_became_peered":"2024-09-12T00:42:36.814235+0000","last_unstale":"2024-09-12T01:33:59.638083+0000","last_undegraded":"2024-09-12T01:33:59.638083+0000","last_fullsized":"2024-09-12T01:33:59.638083+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:12.766338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":201,"num_read_kb":139,"num_write":71,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:51.532638+0000","last_change":"2024-09-12T01:04:15.396161+0000","last_active":"2024-09-12T01:34:51.532638+0000","last_peered":"2024-09-12T01:34:51.532638+0000","last_clean":"2024-09-12T01:34:51.532638+0000","last_became_active":"2024-09-12T01:04:15.395860+0000","last_became_peered":"2024-09-12T01:04:15.395860+0000","last_unstale":"2024-09-12T01:34:51.532638+0000","last_undegraded":"2024-09-12T01:34:51.532638+0000","last_fullsized":"2024-09-12T01:34:51.532638+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:49.503666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:44.636344+0000","last_change":"2024-09-12T00:46:26.373083+0000","last_active":"2024-09-12T01:33:44.636344+0000","last_peered":"2024-09-12T01:33:44.636344+0000","last_clean":"2024-09-12T01:33:44.636344+0000","last_became_active":"2024-09-12T00:46:26.372803+0000","last_became_peered":"2024-09-12T00:46:26.372803+0000","last_unstale":"2024-09-12T01:33:44.636344+0000","last_undegraded":"2024-09-12T01:33:44.636344+0000","last_fullsized":"2024-09-12T01:33:44.636344+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:18.884189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"263'9","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.567429+0000","last_change":"2024-09-12T00:46:22.356200+0000","last_active":"2024-09-12T01:38:00.567429+0000","last_peered":"2024-09-12T01:38:00.567429+0000","last_clean":"2024-09-12T01:38:00.567429+0000","last_became_active":"2024-09-12T00:46:22.355962+0000","last_became_peered":"2024-09-12T00:46:22.355962+0000","last_unstale":"2024-09-12T01:38:00.567429+0000","last_undegraded":"2024-09-12T01:38:00.567429+0000","last_fullsized":"2024-09-12T01:38:00.567429+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:15:50.421437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5707,"num_write":14,"num_write_kb":4683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"263'12","reported_seq":90,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:39.642863+0000","last_change":"2024-09-12T00:42:36.817087+0000","last_active":"2024-09-12T01:34:39.642863+0000","last_peered":"2024-09-12T01:34:39.642863+0000","last_clean":"2024-09-12T01:34:39.642863+0000","last_became_active":"2024-09-12T00:42:36.816673+0000","last_became_peered":"2024-09-12T00:42:36.816673+0000","last_unstale":"2024-09-12T01:34:39.642863+0000","last_undegraded":"2024-09-12T01:34:39.642863+0000","last_fullsized":"2024-09-12T01:34:39.642863+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:44.855498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":40,"num_write":24,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.736023+0000","last_change":"2024-09-12T01:04:15.393891+0000","last_active":"2024-09-12T01:35:46.736023+0000","last_peered":"2024-09-12T01:35:46.736023+0000","last_clean":"2024-09-12T01:35:46.736023+0000","last_became_active":"2024-09-12T01:04:15.393597+0000","last_became_peered":"2024-09-12T01:04:15.393597+0000","last_unstale":"2024-09-12T01:35:46.736023+0000","last_undegraded":"2024-09-12T01:35:46.736023+0000","last_fullsized":"2024-09-12T01:35:46.736023+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:33.585796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:44.636315+0000","last_change":"2024-09-12T00:46:26.366156+0000","last_active":"2024-09-12T01:33:44.636315+0000","last_peered":"2024-09-12T01:33:44.636315+0000","last_clean":"2024-09-12T01:33:44.636315+0000","last_became_active":"2024-09-12T00:46:26.365848+0000","last_became_peered":"2024-09-12T00:46:26.365848+0000","last_unstale":"2024-09-12T01:33:44.636315+0000","last_undegraded":"2024-09-12T01:33:44.636315+0000","last_fullsized":"2024-09-12T01:33:44.636315+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:48.611575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"263'3","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:51.539246+0000","last_change":"2024-09-12T00:46:22.351422+0000","last_active":"2024-09-12T01:35:51.539246+0000","last_peered":"2024-09-12T01:35:51.539246+0000","last_clean":"2024-09-12T01:35:51.539246+0000","last_became_active":"2024-09-12T00:46:22.350815+0000","last_became_peered":"2024-09-12T00:46:22.350815+0000","last_unstale":"2024-09-12T01:35:51.539246+0000","last_undegraded":"2024-09-12T01:35:51.539246+0000","last_fullsized":"2024-09-12T01:35:51.539246+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:04.321097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"263'49","reported_seq":188,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:22.784293+0000","last_change":"2024-09-12T00:42:36.811488+0000","last_active":"2024-09-12T01:34:22.784293+0000","last_peered":"2024-09-12T01:34:22.784293+0000","last_clean":"2024-09-12T01:34:22.784293+0000","last_became_active":"2024-09-12T00:42:36.810754+0000","last_became_peered":"2024-09-12T00:42:36.810754+0000","last_unstale":"2024-09-12T01:34:22.784293+0000","last_undegraded":"2024-09-12T01:34:22.784293+0000","last_fullsized":"2024-09-12T01:34:22.784293+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:12.064178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":240,"num_read_kb":165,"num_write":91,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.539582+0000","last_change":"2024-09-12T01:04:15.397399+0000","last_active":"2024-09-12T01:34:36.539582+0000","last_peered":"2024-09-12T01:34:36.539582+0000","last_clean":"2024-09-12T01:34:36.539582+0000","last_became_active":"2024-09-12T01:04:15.396999+0000","last_became_peered":"2024-09-12T01:04:15.396999+0000","last_unstale":"2024-09-12T01:34:36.539582+0000","last_undegraded":"2024-09-12T01:34:36.539582+0000","last_fullsized":"2024-09-12T01:34:36.539582+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:43.411584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:46.932525+0000","last_change":"2024-09-12T00:46:26.563322+0000","last_active":"2024-09-12T01:33:46.932525+0000","last_peered":"2024-09-12T01:33:46.932525+0000","last_clean":"2024-09-12T01:33:46.932525+0000","last_became_active":"2024-09-12T00:46:26.563041+0000","last_became_peered":"2024-09-12T00:46:26.563041+0000","last_unstale":"2024-09-12T01:33:46.932525+0000","last_undegraded":"2024-09-12T01:33:46.932525+0000","last_fullsized":"2024-09-12T01:33:46.932525+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:42.189294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:36.781253+0000","last_change":"2024-09-12T00:46:22.353183+0000","last_active":"2024-09-12T01:33:36.781253+0000","last_peered":"2024-09-12T01:33:36.781253+0000","last_clean":"2024-09-12T01:33:36.781253+0000","last_became_active":"2024-09-12T00:46:22.352933+0000","last_became_peered":"2024-09-12T00:46:22.352933+0000","last_unstale":"2024-09-12T01:33:36.781253+0000","last_undegraded":"2024-09-12T01:33:36.781253+0000","last_fullsized":"2024-09-12T01:33:36.781253+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:32.297784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"263'30","reported_seq":143,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:21.537673+0000","last_change":"2024-09-12T00:42:36.817007+0000","last_active":"2024-09-12T01:34:21.537673+0000","last_peered":"2024-09-12T01:34:21.537673+0000","last_clean":"2024-09-12T01:34:21.537673+0000","last_became_active":"2024-09-12T00:42:36.816619+0000","last_became_peered":"2024-09-12T00:42:36.816619+0000","last_unstale":"2024-09-12T01:34:21.537673+0000","last_undegraded":"2024-09-12T01:34:21.537673+0000","last_fullsized":"2024-09-12T01:34:21.537673+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:41.160245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":113,"num_write":55,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.724886+0000","last_change":"2024-09-12T01:04:15.396475+0000","last_active":"2024-09-12T01:34:36.724886+0000","last_peered":"2024-09-12T01:34:36.724886+0000","last_clean":"2024-09-12T01:34:36.724886+0000","last_became_active":"2024-09-12T01:04:15.396125+0000","last_became_peered":"2024-09-12T01:04:15.396125+0000","last_unstale":"2024-09-12T01:34:36.724886+0000","last_undegraded":"2024-09-12T01:34:36.724886+0000","last_fullsized":"2024-09-12T01:34:36.724886+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:47.673931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:44.636360+0000","last_change":"2024-09-12T00:46:26.366690+0000","last_active":"2024-09-12T01:33:44.636360+0000","last_peered":"2024-09-12T01:33:44.636360+0000","last_clean":"2024-09-12T01:33:44.636360+0000","last_became_active":"2024-09-12T00:46:26.366293+0000","last_became_peered":"2024-09-12T00:46:26.366293+0000","last_unstale":"2024-09-12T01:33:44.636360+0000","last_undegraded":"2024-09-12T01:33:44.636360+0000","last_fullsized":"2024-09-12T01:33:44.636360+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:56.900344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"263'2","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:41.931768+0000","last_change":"2024-09-12T00:46:22.348841+0000","last_active":"2024-09-12T01:33:41.931768+0000","last_peered":"2024-09-12T01:33:41.931768+0000","last_clean":"2024-09-12T01:33:41.931768+0000","last_became_active":"2024-09-12T00:46:22.348546+0000","last_became_peered":"2024-09-12T00:46:22.348546+0000","last_unstale":"2024-09-12T01:33:41.931768+0000","last_undegraded":"2024-09-12T01:33:41.931768+0000","last_fullsized":"2024-09-12T01:33:41.931768+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:40.207770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"263'34","reported_seq":149,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:21.630269+0000","last_change":"2024-09-12T00:42:36.817828+0000","last_active":"2024-09-12T01:34:21.630269+0000","last_peered":"2024-09-12T01:34:21.630269+0000","last_clean":"2024-09-12T01:34:21.630269+0000","last_became_active":"2024-09-12T00:42:36.817530+0000","last_became_peered":"2024-09-12T00:42:36.817530+0000","last_unstale":"2024-09-12T01:34:21.630269+0000","last_undegraded":"2024-09-12T01:34:21.630269+0000","last_fullsized":"2024-09-12T01:34:21.630269+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:04.364763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":117,"num_write":66,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:44.650432+0000","last_change":"2024-09-12T01:04:15.399818+0000","last_active":"2024-09-12T01:35:44.650432+0000","last_peered":"2024-09-12T01:35:44.650432+0000","last_clean":"2024-09-12T01:35:44.650432+0000","last_became_active":"2024-09-12T01:04:15.399564+0000","last_became_peered":"2024-09-12T01:04:15.399564+0000","last_unstale":"2024-09-12T01:35:44.650432+0000","last_undegraded":"2024-09-12T01:35:44.650432+0000","last_fullsized":"2024-09-12T01:35:44.650432+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:02.148148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"263'7","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:16.554428+0000","last_change":"2024-09-12T00:46:26.374247+0000","last_active":"2024-09-12T01:36:16.554428+0000","last_peered":"2024-09-12T01:36:16.554428+0000","last_clean":"2024-09-12T01:36:16.554428+0000","last_became_active":"2024-09-12T00:46:26.373942+0000","last_became_peered":"2024-09-12T00:46:26.373942+0000","last_unstale":"2024-09-12T01:36:16.554428+0000","last_undegraded":"2024-09-12T01:36:16.554428+0000","last_fullsized":"2024-09-12T01:36:16.554428+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:35.593349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8208,"num_write":12,"num_write_kb":8208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:01.784297+0000","last_change":"2024-09-12T00:46:22.352449+0000","last_active":"2024-09-12T01:34:01.784297+0000","last_peered":"2024-09-12T01:34:01.784297+0000","last_clean":"2024-09-12T01:34:01.784297+0000","last_became_active":"2024-09-12T00:46:22.352156+0000","last_became_peered":"2024-09-12T00:46:22.352156+0000","last_unstale":"2024-09-12T01:34:01.784297+0000","last_undegraded":"2024-09-12T01:34:01.784297+0000","last_fullsized":"2024-09-12T01:34:01.784297+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:05.797995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"263'10","reported_seq":83,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:21.786707+0000","last_change":"2024-09-12T00:42:36.817431+0000","last_active":"2024-09-12T01:34:21.786707+0000","last_peered":"2024-09-12T01:34:21.786707+0000","last_clean":"2024-09-12T01:34:21.786707+0000","last_became_active":"2024-09-12T00:42:36.817021+0000","last_became_peered":"2024-09-12T00:42:36.817021+0000","last_unstale":"2024-09-12T01:34:21.786707+0000","last_undegraded":"2024-09-12T01:34:21.786707+0000","last_fullsized":"2024-09-12T01:34:21.786707+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:32.868292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:41.716228+0000","last_change":"2024-09-12T01:04:15.396406+0000","last_active":"2024-09-12T01:33:41.716228+0000","last_peered":"2024-09-12T01:33:41.716228+0000","last_clean":"2024-09-12T01:33:41.716228+0000","last_became_active":"2024-09-12T01:04:15.396096+0000","last_became_peered":"2024-09-12T01:04:15.396096+0000","last_unstale":"2024-09-12T01:33:41.716228+0000","last_undegraded":"2024-09-12T01:33:41.716228+0000","last_fullsized":"2024-09-12T01:33:41.716228+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:42.402476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"260'5","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:06.720106+0000","last_change":"2024-09-12T00:46:26.562285+0000","last_active":"2024-09-12T01:34:06.720106+0000","last_peered":"2024-09-12T01:34:06.720106+0000","last_clean":"2024-09-12T01:34:06.720106+0000","last_became_active":"2024-09-12T00:46:26.561924+0000","last_became_peered":"2024-09-12T00:46:26.561924+0000","last_unstale":"2024-09-12T01:34:06.720106+0000","last_undegraded":"2024-09-12T01:34:06.720106+0000","last_fullsized":"2024-09-12T01:34:06.720106+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:06.317073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:01.934433+0000","last_change":"2024-09-12T00:46:22.350102+0000","last_active":"2024-09-12T01:34:01.934433+0000","last_peered":"2024-09-12T01:34:01.934433+0000","last_clean":"2024-09-12T01:34:01.934433+0000","last_became_active":"2024-09-12T00:46:22.349376+0000","last_became_peered":"2024-09-12T00:46:22.349376+0000","last_unstale":"2024-09-12T01:34:01.934433+0000","last_undegraded":"2024-09-12T01:34:01.934433+0000","last_fullsized":"2024-09-12T01:34:01.934433+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:38.382481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"263'30","reported_seq":144,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:51.727585+0000","last_change":"2024-09-12T00:42:36.810100+0000","last_active":"2024-09-12T01:34:51.727585+0000","last_peered":"2024-09-12T01:34:51.727585+0000","last_clean":"2024-09-12T01:34:51.727585+0000","last_became_active":"2024-09-12T00:42:36.809602+0000","last_became_peered":"2024-09-12T00:42:36.809602+0000","last_unstale":"2024-09-12T01:34:51.727585+0000","last_undegraded":"2024-09-12T01:34:51.727585+0000","last_fullsized":"2024-09-12T01:34:51.727585+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:44.821006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":112,"num_write":54,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"263'1","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.736044+0000","last_change":"2024-09-12T01:04:15.393241+0000","last_active":"2024-09-12T01:35:46.736044+0000","last_peered":"2024-09-12T01:35:46.736044+0000","last_clean":"2024-09-12T01:35:46.736044+0000","last_became_active":"2024-09-12T01:04:15.392789+0000","last_became_peered":"2024-09-12T01:04:15.392789+0000","last_unstale":"2024-09-12T01:35:46.736044+0000","last_undegraded":"2024-09-12T01:35:46.736044+0000","last_fullsized":"2024-09-12T01:35:46.736044+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:06.945446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"260'5","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:41.931667+0000","last_change":"2024-09-12T00:46:26.370237+0000","last_active":"2024-09-12T01:33:41.931667+0000","last_peered":"2024-09-12T01:33:41.931667+0000","last_clean":"2024-09-12T01:33:41.931667+0000","last_became_active":"2024-09-12T00:46:26.369883+0000","last_became_peered":"2024-09-12T00:46:26.369883+0000","last_unstale":"2024-09-12T01:33:41.931667+0000","last_undegraded":"2024-09-12T01:33:41.931667+0000","last_fullsized":"2024-09-12T01:33:41.931667+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:01.571704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:06.784985+0000","last_change":"2024-09-12T00:46:22.348999+0000","last_active":"2024-09-12T01:34:06.784985+0000","last_peered":"2024-09-12T01:34:06.784985+0000","last_clean":"2024-09-12T01:34:06.784985+0000","last_became_active":"2024-09-12T00:46:22.348568+0000","last_became_peered":"2024-09-12T00:46:22.348568+0000","last_unstale":"2024-09-12T01:34:06.784985+0000","last_undegraded":"2024-09-12T01:34:06.784985+0000","last_fullsized":"2024-09-12T01:34:06.784985+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:24.267629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"263'9","reported_seq":84,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:39.642740+0000","last_change":"2024-09-12T00:42:36.814268+0000","last_active":"2024-09-12T01:34:39.642740+0000","last_peered":"2024-09-12T01:34:39.642740+0000","last_clean":"2024-09-12T01:34:39.642740+0000","last_became_active":"2024-09-12T00:42:36.813997+0000","last_became_peered":"2024-09-12T00:42:36.813997+0000","last_unstale":"2024-09-12T01:34:39.642740+0000","last_undegraded":"2024-09-12T01:34:39.642740+0000","last_fullsized":"2024-09-12T01:34:39.642740+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:34.191233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.797023+0000","last_change":"2024-09-12T01:04:15.393511+0000","last_active":"2024-09-12T01:35:46.797023+0000","last_peered":"2024-09-12T01:35:46.797023+0000","last_clean":"2024-09-12T01:35:46.797023+0000","last_became_active":"2024-09-12T01:04:15.393220+0000","last_became_peered":"2024-09-12T01:04:15.393220+0000","last_unstale":"2024-09-12T01:35:46.797023+0000","last_undegraded":"2024-09-12T01:35:46.797023+0000","last_fullsized":"2024-09-12T01:35:46.797023+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:27.528771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"263'2","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:26.741954+0000","last_change":"2024-09-12T00:46:26.370629+0000","last_active":"2024-09-12T01:36:26.741954+0000","last_peered":"2024-09-12T01:36:26.741954+0000","last_clean":"2024-09-12T01:36:26.741954+0000","last_became_active":"2024-09-12T00:46:26.370349+0000","last_became_peered":"2024-09-12T00:46:26.370349+0000","last_unstale":"2024-09-12T01:36:26.741954+0000","last_undegraded":"2024-09-12T01:36:26.741954+0000","last_fullsized":"2024-09-12T01:36:26.741954+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:26.584727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"263'11","reported_seq":76,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.830190+0000","last_change":"2024-09-12T00:46:22.346319+0000","last_active":"2024-09-12T01:38:00.830190+0000","last_peered":"2024-09-12T01:38:00.830190+0000","last_clean":"2024-09-12T01:38:00.830190+0000","last_became_active":"2024-09-12T00:46:22.346024+0000","last_became_peered":"2024-09-12T00:46:22.346024+0000","last_unstale":"2024-09-12T01:38:00.830190+0000","last_undegraded":"2024-09-12T01:38:00.830190+0000","last_fullsized":"2024-09-12T01:38:00.830190+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:06.683878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":32770,"num_write":16,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"263'38","reported_seq":159,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.539545+0000","last_change":"2024-09-12T00:42:36.809663+0000","last_active":"2024-09-12T01:34:36.539545+0000","last_peered":"2024-09-12T01:34:36.539545+0000","last_clean":"2024-09-12T01:34:36.539545+0000","last_became_active":"2024-09-12T00:42:36.809350+0000","last_became_peered":"2024-09-12T00:42:36.809350+0000","last_unstale":"2024-09-12T01:34:36.539545+0000","last_undegraded":"2024-09-12T01:34:36.539545+0000","last_fullsized":"2024-09-12T01:34:36.539545+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:37.120320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":127,"num_write":71,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:31.733691+0000","last_change":"2024-09-12T01:04:15.395069+0000","last_active":"2024-09-12T01:35:31.733691+0000","last_peered":"2024-09-12T01:35:31.733691+0000","last_clean":"2024-09-12T01:35:31.733691+0000","last_became_active":"2024-09-12T01:04:15.394795+0000","last_became_peered":"2024-09-12T01:04:15.394795+0000","last_unstale":"2024-09-12T01:35:31.733691+0000","last_undegraded":"2024-09-12T01:35:31.733691+0000","last_fullsized":"2024-09-12T01:35:31.733691+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:28.070748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"263'2","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:31.802388+0000","last_change":"2024-09-12T00:46:26.368134+0000","last_active":"2024-09-12T01:36:31.802388+0000","last_peered":"2024-09-12T01:36:31.802388+0000","last_clean":"2024-09-12T01:36:31.802388+0000","last_became_active":"2024-09-12T00:46:26.367852+0000","last_became_peered":"2024-09-12T00:46:26.367852+0000","last_unstale":"2024-09-12T01:36:31.802388+0000","last_undegraded":"2024-09-12T01:36:31.802388+0000","last_fullsized":"2024-09-12T01:36:31.802388+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:38.753123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1142,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"260'3","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:16.721849+0000","last_change":"2024-09-12T00:46:22.351593+0000","last_active":"2024-09-12T01:34:16.721849+0000","last_peered":"2024-09-12T01:34:16.721849+0000","last_clean":"2024-09-12T01:34:16.721849+0000","last_became_active":"2024-09-12T00:46:22.351237+0000","last_became_peered":"2024-09-12T00:46:22.351237+0000","last_unstale":"2024-09-12T01:34:16.721849+0000","last_undegraded":"2024-09-12T01:34:16.721849+0000","last_fullsized":"2024-09-12T01:34:16.721849+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:04.853460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'36","reported_seq":159,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.788869+0000","last_change":"2024-09-12T00:42:36.819102+0000","last_active":"2024-09-12T01:34:36.788869+0000","last_peered":"2024-09-12T01:34:36.788869+0000","last_clean":"2024-09-12T01:34:36.788869+0000","last_became_active":"2024-09-12T00:42:36.818852+0000","last_became_peered":"2024-09-12T00:42:36.818852+0000","last_unstale":"2024-09-12T01:34:36.788869+0000","last_undegraded":"2024-09-12T01:34:36.788869+0000","last_fullsized":"2024-09-12T01:34:36.788869+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:23.943088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":132,"num_write":65,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:32.794132+0000","last_change":"2024-09-12T01:04:15.393939+0000","last_active":"2024-09-12T01:35:32.794132+0000","last_peered":"2024-09-12T01:35:32.794132+0000","last_clean":"2024-09-12T01:35:32.794132+0000","last_became_active":"2024-09-12T01:04:15.393651+0000","last_became_peered":"2024-09-12T01:04:15.393651+0000","last_unstale":"2024-09-12T01:35:32.794132+0000","last_undegraded":"2024-09-12T01:35:32.794132+0000","last_fullsized":"2024-09-12T01:35:32.794132+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:16.671263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"263'5","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:26.801703+0000","last_change":"2024-09-12T00:46:26.563573+0000","last_active":"2024-09-12T01:36:26.801703+0000","last_peered":"2024-09-12T01:36:26.801703+0000","last_clean":"2024-09-12T01:36:26.801703+0000","last_became_active":"2024-09-12T00:46:26.563277+0000","last_became_peered":"2024-09-12T00:46:26.563277+0000","last_unstale":"2024-09-12T01:36:26.801703+0000","last_undegraded":"2024-09-12T01:36:26.801703+0000","last_fullsized":"2024-09-12T01:36:26.801703+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:09.897827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":7168,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:31.631288+0000","last_change":"2024-09-12T00:46:22.351630+0000","last_active":"2024-09-12T01:34:31.631288+0000","last_peered":"2024-09-12T01:34:31.631288+0000","last_clean":"2024-09-12T01:34:31.631288+0000","last_became_active":"2024-09-12T00:46:22.351162+0000","last_became_peered":"2024-09-12T00:46:22.351162+0000","last_unstale":"2024-09-12T01:34:31.631288+0000","last_undegraded":"2024-09-12T01:34:31.631288+0000","last_fullsized":"2024-09-12T01:34:31.631288+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:07.137302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"263'20","reported_seq":113,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.539639+0000","last_change":"2024-09-12T00:42:36.815139+0000","last_active":"2024-09-12T01:34:36.539639+0000","last_peered":"2024-09-12T01:34:36.539639+0000","last_clean":"2024-09-12T01:34:36.539639+0000","last_became_active":"2024-09-12T00:42:36.814845+0000","last_became_peered":"2024-09-12T00:42:36.814845+0000","last_unstale":"2024-09-12T01:34:36.539639+0000","last_undegraded":"2024-09-12T01:34:36.539639+0000","last_fullsized":"2024-09-12T01:34:36.539639+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:26.879251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":75,"num_write":35,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:16.936450+0000","last_change":"2024-09-12T01:04:15.388704+0000","last_active":"2024-09-12T01:34:16.936450+0000","last_peered":"2024-09-12T01:34:16.936450+0000","last_clean":"2024-09-12T01:34:16.936450+0000","last_became_active":"2024-09-12T01:04:15.388423+0000","last_became_peered":"2024-09-12T01:04:15.388423+0000","last_unstale":"2024-09-12T01:34:16.936450+0000","last_undegraded":"2024-09-12T01:34:16.936450+0000","last_fullsized":"2024-09-12T01:34:16.936450+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:13.488601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:06.720233+0000","last_change":"2024-09-12T00:46:26.565006+0000","last_active":"2024-09-12T01:34:06.720233+0000","last_peered":"2024-09-12T01:34:06.720233+0000","last_clean":"2024-09-12T01:34:06.720233+0000","last_became_active":"2024-09-12T00:46:26.564771+0000","last_became_peered":"2024-09-12T00:46:26.564771+0000","last_unstale":"2024-09-12T01:34:06.720233+0000","last_undegraded":"2024-09-12T01:34:06.720233+0000","last_fullsized":"2024-09-12T01:34:06.720233+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:24.506289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"260'3","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:57.780660+0000","last_change":"2024-09-12T00:46:22.350365+0000","last_active":"2024-09-12T01:33:57.780660+0000","last_peered":"2024-09-12T01:33:57.780660+0000","last_clean":"2024-09-12T01:33:57.780660+0000","last_became_active":"2024-09-12T00:46:22.350045+0000","last_became_peered":"2024-09-12T00:46:22.350045+0000","last_unstale":"2024-09-12T01:33:57.780660+0000","last_undegraded":"2024-09-12T01:33:57.780660+0000","last_fullsized":"2024-09-12T01:33:57.780660+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:09.828897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"263'41","reported_seq":169,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:56.728429+0000","last_change":"2024-09-12T00:42:36.814530+0000","last_active":"2024-09-12T01:34:56.728429+0000","last_peered":"2024-09-12T01:34:56.728429+0000","last_clean":"2024-09-12T01:34:56.728429+0000","last_became_active":"2024-09-12T00:42:36.814228+0000","last_became_peered":"2024-09-12T00:42:36.814228+0000","last_unstale":"2024-09-12T01:34:56.728429+0000","last_undegraded":"2024-09-12T01:34:56.728429+0000","last_fullsized":"2024-09-12T01:34:56.728429+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:19.454136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":139,"num_write":79,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:31.547532+0000","last_change":"2024-09-12T01:04:15.388771+0000","last_active":"2024-09-12T01:35:31.547532+0000","last_peered":"2024-09-12T01:35:31.547532+0000","last_clean":"2024-09-12T01:35:31.547532+0000","last_became_active":"2024-09-12T01:04:15.388492+0000","last_became_peered":"2024-09-12T01:04:15.388492+0000","last_unstale":"2024-09-12T01:35:31.547532+0000","last_undegraded":"2024-09-12T01:35:31.547532+0000","last_fullsized":"2024-09-12T01:35:31.547532+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:40.040155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:06.535900+0000","last_change":"2024-09-12T00:46:26.369312+0000","last_active":"2024-09-12T01:34:06.535900+0000","last_peered":"2024-09-12T01:34:06.535900+0000","last_clean":"2024-09-12T01:34:06.535900+0000","last_became_active":"2024-09-12T00:46:26.369004+0000","last_became_peered":"2024-09-12T00:46:26.369004+0000","last_unstale":"2024-09-12T01:34:06.535900+0000","last_undegraded":"2024-09-12T01:34:06.535900+0000","last_fullsized":"2024-09-12T01:34:06.535900+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:24.565234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:01.719448+0000","last_change":"2024-09-12T00:46:22.354042+0000","last_active":"2024-09-12T01:34:01.719448+0000","last_peered":"2024-09-12T01:34:01.719448+0000","last_clean":"2024-09-12T01:34:01.719448+0000","last_became_active":"2024-09-12T00:46:22.353747+0000","last_became_peered":"2024-09-12T00:46:22.353747+0000","last_unstale":"2024-09-12T01:34:01.719448+0000","last_undegraded":"2024-09-12T01:34:01.719448+0000","last_fullsized":"2024-09-12T01:34:01.719448+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:40.026238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"263'8","reported_seq":80,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:41.940572+0000","last_change":"2024-09-12T00:42:36.809380+0000","last_active":"2024-09-12T01:34:41.940572+0000","last_peered":"2024-09-12T01:34:41.940572+0000","last_clean":"2024-09-12T01:34:41.940572+0000","last_became_active":"2024-09-12T00:42:36.808945+0000","last_became_peered":"2024-09-12T00:42:36.808945+0000","last_unstale":"2024-09-12T01:34:41.940572+0000","last_undegraded":"2024-09-12T01:34:41.940572+0000","last_fullsized":"2024-09-12T01:34:41.940572+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:08.194856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":23,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"262'1","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.531103+0000","last_change":"2024-09-12T01:04:15.395533+0000","last_active":"2024-09-12T01:34:36.531103+0000","last_peered":"2024-09-12T01:34:36.531103+0000","last_clean":"2024-09-12T01:34:36.531103+0000","last_became_active":"2024-09-12T01:04:15.395223+0000","last_became_peered":"2024-09-12T01:04:15.395223+0000","last_unstale":"2024-09-12T01:34:36.531103+0000","last_undegraded":"2024-09-12T01:34:36.531103+0000","last_fullsized":"2024-09-12T01:34:36.531103+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:54.625901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"260'2","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:21.937069+0000","last_change":"2024-09-12T00:46:26.367308+0000","last_active":"2024-09-12T01:34:21.937069+0000","last_peered":"2024-09-12T01:34:21.937069+0000","last_clean":"2024-09-12T01:34:21.937069+0000","last_became_active":"2024-09-12T00:46:26.367039+0000","last_became_peered":"2024-09-12T00:46:26.367039+0000","last_unstale":"2024-09-12T01:34:21.937069+0000","last_undegraded":"2024-09-12T01:34:21.937069+0000","last_fullsized":"2024-09-12T01:34:21.937069+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:30.091487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"263'2","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:31.742697+0000","last_change":"2024-09-12T00:46:22.350076+0000","last_active":"2024-09-12T01:36:31.742697+0000","last_peered":"2024-09-12T01:36:31.742697+0000","last_clean":"2024-09-12T01:36:31.742697+0000","last_became_active":"2024-09-12T00:46:22.349779+0000","last_became_peered":"2024-09-12T00:46:22.349779+0000","last_unstale":"2024-09-12T01:36:31.742697+0000","last_undegraded":"2024-09-12T01:36:31.742697+0000","last_fullsized":"2024-09-12T01:36:31.742697+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:41.826282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":5,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"263'23","reported_seq":123,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:42.787235+0000","last_change":"2024-09-12T00:42:36.811265+0000","last_active":"2024-09-12T01:34:42.787235+0000","last_peered":"2024-09-12T01:34:42.787235+0000","last_clean":"2024-09-12T01:34:42.787235+0000","last_became_active":"2024-09-12T00:42:36.810979+0000","last_became_peered":"2024-09-12T00:42:36.810979+0000","last_unstale":"2024-09-12T01:34:42.787235+0000","last_undegraded":"2024-09-12T01:34:42.787235+0000","last_fullsized":"2024-09-12T01:34:42.787235+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:56.532046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":82,"num_write":51,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.788829+0000","last_change":"2024-09-12T01:04:15.388624+0000","last_active":"2024-09-12T01:34:36.788829+0000","last_peered":"2024-09-12T01:34:36.788829+0000","last_clean":"2024-09-12T01:34:36.788829+0000","last_became_active":"2024-09-12T01:04:15.388331+0000","last_became_peered":"2024-09-12T01:04:15.388331+0000","last_unstale":"2024-09-12T01:34:36.788829+0000","last_undegraded":"2024-09-12T01:34:36.788829+0000","last_fullsized":"2024-09-12T01:34:36.788829+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:07.975645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"260'5","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:32.785494+0000","last_change":"2024-09-12T00:46:26.370948+0000","last_active":"2024-09-12T01:34:32.785494+0000","last_peered":"2024-09-12T01:34:32.785494+0000","last_clean":"2024-09-12T01:34:32.785494+0000","last_became_active":"2024-09-12T00:46:26.370448+0000","last_became_peered":"2024-09-12T00:46:26.370448+0000","last_unstale":"2024-09-12T01:34:32.785494+0000","last_undegraded":"2024-09-12T01:34:32.785494+0000","last_fullsized":"2024-09-12T01:34:32.785494+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:41.502037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"263'2","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:21.741202+0000","last_change":"2024-09-12T00:46:22.354072+0000","last_active":"2024-09-12T01:36:21.741202+0000","last_peered":"2024-09-12T01:36:21.741202+0000","last_clean":"2024-09-12T01:36:21.741202+0000","last_became_active":"2024-09-12T00:46:22.353796+0000","last_became_peered":"2024-09-12T00:46:22.353796+0000","last_unstale":"2024-09-12T01:36:21.741202+0000","last_undegraded":"2024-09-12T01:36:21.741202+0000","last_fullsized":"2024-09-12T01:36:21.741202+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:52.950825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"263'41","reported_seq":174,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:41.540574+0000","last_change":"2024-09-12T00:42:36.814983+0000","last_active":"2024-09-12T01:34:41.540574+0000","last_peered":"2024-09-12T01:34:41.540574+0000","last_clean":"2024-09-12T01:34:41.540574+0000","last_became_active":"2024-09-12T00:42:36.814700+0000","last_became_peered":"2024-09-12T00:42:36.814700+0000","last_unstale":"2024-09-12T01:34:41.540574+0000","last_undegraded":"2024-09-12T01:34:41.540574+0000","last_fullsized":"2024-09-12T01:34:41.540574+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:47.477989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":150,"num_write":75,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:31.795233+0000","last_change":"2024-09-12T01:04:15.393354+0000","last_active":"2024-09-12T01:35:31.795233+0000","last_peered":"2024-09-12T01:35:31.795233+0000","last_clean":"2024-09-12T01:35:31.795233+0000","last_became_active":"2024-09-12T01:04:15.392129+0000","last_became_peered":"2024-09-12T01:04:15.392129+0000","last_unstale":"2024-09-12T01:35:31.795233+0000","last_undegraded":"2024-09-12T01:35:31.795233+0000","last_fullsized":"2024-09-12T01:35:31.795233+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:07.333078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:21.537643+0000","last_change":"2024-09-12T00:46:26.374929+0000","last_active":"2024-09-12T01:34:21.537643+0000","last_peered":"2024-09-12T01:34:21.537643+0000","last_clean":"2024-09-12T01:34:21.537643+0000","last_became_active":"2024-09-12T00:46:26.374630+0000","last_became_peered":"2024-09-12T00:46:26.374630+0000","last_unstale":"2024-09-12T01:34:21.537643+0000","last_undegraded":"2024-09-12T01:34:21.537643+0000","last_fullsized":"2024-09-12T01:34:21.537643+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:40.273744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:16.936526+0000","last_change":"2024-09-12T00:46:22.345808+0000","last_active":"2024-09-12T01:34:16.936526+0000","last_peered":"2024-09-12T01:34:16.936526+0000","last_clean":"2024-09-12T01:34:16.936526+0000","last_became_active":"2024-09-12T00:46:22.345455+0000","last_became_peered":"2024-09-12T00:46:22.345455+0000","last_unstale":"2024-09-12T01:34:16.936526+0000","last_undegraded":"2024-09-12T01:34:16.936526+0000","last_fullsized":"2024-09-12T01:34:16.936526+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:43.503840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"263'47","reported_seq":185,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:41.540334+0000","last_change":"2024-09-12T00:42:36.810603+0000","last_active":"2024-09-12T01:34:41.540334+0000","last_peered":"2024-09-12T01:34:41.540334+0000","last_clean":"2024-09-12T01:34:41.540334+0000","last_became_active":"2024-09-12T00:42:36.810179+0000","last_became_peered":"2024-09-12T00:42:36.810179+0000","last_unstale":"2024-09-12T01:34:41.540334+0000","last_undegraded":"2024-09-12T01:34:41.540334+0000","last_fullsized":"2024-09-12T01:34:41.540334+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:20.658302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":235,"num_read_kb":167,"num_write":78,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:41.735210+0000","last_change":"2024-09-12T01:04:15.393713+0000","last_active":"2024-09-12T01:35:41.735210+0000","last_peered":"2024-09-12T01:35:41.735210+0000","last_clean":"2024-09-12T01:35:41.735210+0000","last_became_active":"2024-09-12T01:04:15.393424+0000","last_became_peered":"2024-09-12T01:04:15.393424+0000","last_unstale":"2024-09-12T01:35:41.735210+0000","last_undegraded":"2024-09-12T01:35:41.735210+0000","last_fullsized":"2024-09-12T01:35:41.735210+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:46.950196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"260'6","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:21.537798+0000","last_change":"2024-09-12T00:46:26.372459+0000","last_active":"2024-09-12T01:34:21.537798+0000","last_peered":"2024-09-12T01:34:21.537798+0000","last_clean":"2024-09-12T01:34:21.537798+0000","last_became_active":"2024-09-12T00:46:26.372169+0000","last_became_peered":"2024-09-12T00:46:26.372169+0000","last_unstale":"2024-09-12T01:34:21.537798+0000","last_undegraded":"2024-09-12T01:34:21.537798+0000","last_fullsized":"2024-09-12T01:34:21.537798+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:20.872522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"263'5","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:21.555122+0000","last_change":"2024-09-12T00:46:22.350497+0000","last_active":"2024-09-12T01:36:21.555122+0000","last_peered":"2024-09-12T01:36:21.555122+0000","last_clean":"2024-09-12T01:36:21.555122+0000","last_became_active":"2024-09-12T00:46:22.350210+0000","last_became_peered":"2024-09-12T00:46:22.350210+0000","last_unstale":"2024-09-12T01:36:21.555122+0000","last_undegraded":"2024-09-12T01:36:21.555122+0000","last_fullsized":"2024-09-12T01:36:21.555122+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:30.513705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4096,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"260'15","reported_seq":102,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:51.727537+0000","last_change":"2024-09-12T00:42:36.810443+0000","last_active":"2024-09-12T01:34:51.727537+0000","last_peered":"2024-09-12T01:34:51.727537+0000","last_clean":"2024-09-12T01:34:51.727537+0000","last_became_active":"2024-09-12T00:42:36.810110+0000","last_became_peered":"2024-09-12T00:42:36.810110+0000","last_unstale":"2024-09-12T01:34:51.727537+0000","last_undegraded":"2024-09-12T01:34:51.727537+0000","last_fullsized":"2024-09-12T01:34:51.727537+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:11.301801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":54,"num_write":27,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"263'299","reported_seq":907,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.710943+0000","last_change":"2024-09-12T00:28:31.203847+0000","last_active":"2024-09-12T01:38:01.710943+0000","last_peered":"2024-09-12T01:38:01.710943+0000","last_clean":"2024-09-12T01:38:01.710943+0000","last_became_active":"2024-09-12T00:28:31.201886+0000","last_became_peered":"2024-09-12T00:28:31.201886+0000","last_unstale":"2024-09-12T01:38:01.710943+0000","last_undegraded":"2024-09-12T01:38:01.710943+0000","last_fullsized":"2024-09-12T01:38:01.710943+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:39.441025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":380,"num_read_kb":9626,"num_write":915,"num_write_kb":19266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"263'157","reported_seq":722,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:32.776738+0000","last_change":"2024-09-12T00:28:33.211480+0000","last_active":"2024-09-12T01:33:32.776738+0000","last_peered":"2024-09-12T01:33:32.776738+0000","last_clean":"2024-09-12T01:33:32.776738+0000","last_became_active":"2024-09-12T00:28:33.211182+0000","last_became_peered":"2024-09-12T00:28:33.211182+0000","last_unstale":"2024-09-12T01:33:32.776738+0000","last_undegraded":"2024-09-12T01:33:32.776738+0000","last_fullsized":"2024-09-12T01:33:32.776738+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:45.597820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":685,"num_read_kb":553,"num_write":251,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"263'241","reported_seq":951,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:11.943996+0000","last_change":"2024-09-12T00:28:31.204861+0000","last_active":"2024-09-12T01:35:11.943996+0000","last_peered":"2024-09-12T01:35:11.943996+0000","last_clean":"2024-09-12T01:35:11.943996+0000","last_became_active":"2024-09-12T00:28:31.204561+0000","last_became_peered":"2024-09-12T00:28:31.204561+0000","last_unstale":"2024-09-12T01:35:11.943996+0000","last_undegraded":"2024-09-12T01:35:11.943996+0000","last_fullsized":"2024-09-12T01:35:11.943996+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:08.162064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12638018,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":543,"num_read_kb":14276,"num_write":977,"num_write_kb":31679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"263'59","reported_seq":619,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:36.715209+0000","last_change":"2024-09-12T00:28:33.217339+0000","last_active":"2024-09-12T01:33:36.715209+0000","last_peered":"2024-09-12T01:33:36.715209+0000","last_clean":"2024-09-12T01:33:36.715209+0000","last_became_active":"2024-09-12T00:28:33.217028+0000","last_became_peered":"2024-09-12T00:28:33.217028+0000","last_unstale":"2024-09-12T01:33:36.715209+0000","last_undegraded":"2024-09-12T01:33:36.715209+0000","last_fullsized":"2024-09-12T01:33:36.715209+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:39:58.330668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":252,"num_read_kb":216,"num_write":87,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"263'332","reported_seq":1191,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.751929+0000","last_change":"2024-09-12T00:28:31.203640+0000","last_active":"2024-09-12T01:38:01.751929+0000","last_peered":"2024-09-12T01:38:01.751929+0000","last_clean":"2024-09-12T01:38:01.751929+0000","last_became_active":"2024-09-12T00:28:31.203351+0000","last_became_peered":"2024-09-12T00:28:31.203351+0000","last_unstale":"2024-09-12T01:38:01.751929+0000","last_undegraded":"2024-09-12T01:38:01.751929+0000","last_fullsized":"2024-09-12T01:38:01.751929+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:37.607022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306757,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":934,"num_read_kb":42793,"num_write":1132,"num_write_kb":18824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"263'429","reported_seq":1173,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:36.531564+0000","last_change":"2024-09-12T00:28:33.217739+0000","last_active":"2024-09-12T01:33:36.531564+0000","last_peered":"2024-09-12T01:33:36.531564+0000","last_clean":"2024-09-12T01:33:36.531564+0000","last_became_active":"2024-09-12T00:28:33.217215+0000","last_became_peered":"2024-09-12T00:28:33.217215+0000","last_unstale":"2024-09-12T01:33:36.531564+0000","last_undegraded":"2024-09-12T01:33:36.531564+0000","last_fullsized":"2024-09-12T01:33:36.531564+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":400,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:28.536144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2092,"num_read_kb":1758,"num_write":778,"num_write_kb":522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"263'307","reported_seq":999,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:37.786456+0000","last_change":"2024-09-12T00:28:31.214517+0000","last_active":"2024-09-12T01:34:37.786456+0000","last_peered":"2024-09-12T01:34:37.786456+0000","last_clean":"2024-09-12T01:34:37.786456+0000","last_became_active":"2024-09-12T00:28:31.213595+0000","last_became_peered":"2024-09-12T00:28:31.213595+0000","last_unstale":"2024-09-12T01:34:37.786456+0000","last_undegraded":"2024-09-12T01:34:37.786456+0000","last_fullsized":"2024-09-12T01:34:37.786456+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:36.346586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2047320,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":560,"num_read_kb":11143,"num_write":1094,"num_write_kb":15238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"263'289","reported_seq":921,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:49.421430+0000","last_change":"2024-09-12T00:28:33.218650+0000","last_active":"2024-09-12T01:33:49.421430+0000","last_peered":"2024-09-12T01:33:49.421430+0000","last_clean":"2024-09-12T01:33:49.421430+0000","last_became_active":"2024-09-12T00:28:33.218393+0000","last_became_peered":"2024-09-12T00:28:33.218393+0000","last_unstale":"2024-09-12T01:33:49.421430+0000","last_undegraded":"2024-09-12T01:33:49.421430+0000","last_fullsized":"2024-09-12T01:33:49.421430+0000","mapping_epoch":27,"log_start":"260'200","ondisk_log_start":"260'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:52.716266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1288,"num_read_kb":1088,"num_write":481,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"263'315","reported_seq":909,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.733442+0000","last_change":"2024-09-12T00:28:31.205251+0000","last_active":"2024-09-12T01:38:01.733442+0000","last_peered":"2024-09-12T01:38:01.733442+0000","last_clean":"2024-09-12T01:38:01.733442+0000","last_became_active":"2024-09-12T00:28:31.204962+0000","last_became_peered":"2024-09-12T00:28:31.204962+0000","last_unstale":"2024-09-12T01:38:01.733442+0000","last_undegraded":"2024-09-12T01:38:01.733442+0000","last_fullsized":"2024-09-12T01:38:01.733442+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:35.543975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170211,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":403,"num_read_kb":1209,"num_write":988,"num_write_kb":17836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"263'4176","reported_seq":4796,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:51.541648+0000","last_change":"2024-09-12T00:28:33.214790+0000","last_active":"2024-09-12T01:34:51.541648+0000","last_peered":"2024-09-12T01:34:51.541648+0000","last_clean":"2024-09-12T01:34:51.541648+0000","last_became_active":"2024-09-12T00:28:33.214515+0000","last_became_peered":"2024-09-12T00:28:33.214515+0000","last_unstale":"2024-09-12T01:34:51.541648+0000","last_undegraded":"2024-09-12T01:34:51.541648+0000","last_fullsized":"2024-09-12T01:34:51.541648+0000","mapping_epoch":27,"log_start":"263'4100","ondisk_log_start":"263'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":3000,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:53.747881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16813,"num_read_kb":14096,"num_write":6273,"num_write_kb":3125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"263'321","reported_seq":968,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.490167+0000","last_change":"2024-09-12T00:28:31.214068+0000","last_active":"2024-09-12T01:35:16.490167+0000","last_peered":"2024-09-12T01:35:16.490167+0000","last_clean":"2024-09-12T01:35:16.490167+0000","last_became_active":"2024-09-12T00:28:31.212573+0000","last_became_peered":"2024-09-12T00:28:31.212573+0000","last_unstale":"2024-09-12T01:35:16.490167+0000","last_undegraded":"2024-09-12T01:35:16.490167+0000","last_fullsized":"2024-09-12T01:35:16.490167+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:07.432079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5946915,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":524,"num_read_kb":12450,"num_write":1178,"num_write_kb":24719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"263'260","reported_seq":970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.545564+0000","last_change":"2024-09-12T00:28:33.213811+0000","last_active":"2024-09-12T01:35:16.545564+0000","last_peered":"2024-09-12T01:35:16.545564+0000","last_clean":"2024-09-12T01:35:16.545564+0000","last_became_active":"2024-09-12T00:28:33.213014+0000","last_became_peered":"2024-09-12T00:28:33.213014+0000","last_unstale":"2024-09-12T01:35:16.545564+0000","last_undegraded":"2024-09-12T01:35:16.545564+0000","last_fullsized":"2024-09-12T01:35:16.545564+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:25.774640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1431,"num_read_kb":1278,"num_write":426,"num_write_kb":225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"263'316","reported_seq":951,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.726913+0000","last_change":"2024-09-12T00:28:31.210405+0000","last_active":"2024-09-12T01:38:01.726913+0000","last_peered":"2024-09-12T01:38:01.726913+0000","last_clean":"2024-09-12T01:38:01.726913+0000","last_became_active":"2024-09-12T00:28:31.210039+0000","last_became_peered":"2024-09-12T00:28:31.210039+0000","last_unstale":"2024-09-12T01:38:01.726913+0000","last_undegraded":"2024-09-12T01:38:01.726913+0000","last_fullsized":"2024-09-12T01:38:01.726913+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:33.172818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262202,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":471,"num_read_kb":7448,"num_write":1016,"num_write_kb":42696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"263'277","reported_seq":963,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:17.791987+0000","last_change":"2024-09-12T00:28:33.217908+0000","last_active":"2024-09-12T01:35:17.791987+0000","last_peered":"2024-09-12T01:35:17.791987+0000","last_clean":"2024-09-12T01:35:17.791987+0000","last_became_active":"2024-09-12T00:28:33.216856+0000","last_became_peered":"2024-09-12T00:28:33.216856+0000","last_unstale":"2024-09-12T01:35:17.791987+0000","last_undegraded":"2024-09-12T01:35:17.791987+0000","last_fullsized":"2024-09-12T01:35:17.791987+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:14.540790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1252,"num_read_kb":1029,"num_write":416,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"263'251","reported_seq":862,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:04.652742+0000","last_change":"2024-09-12T00:28:31.213450+0000","last_active":"2024-09-12T01:36:04.652742+0000","last_peered":"2024-09-12T01:36:04.652742+0000","last_clean":"2024-09-12T01:36:04.652742+0000","last_became_active":"2024-09-12T00:28:31.213172+0000","last_became_peered":"2024-09-12T00:28:31.213172+0000","last_unstale":"2024-09-12T01:36:04.652742+0000","last_undegraded":"2024-09-12T01:36:04.652742+0000","last_fullsized":"2024-09-12T01:36:04.652742+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:29.256307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13517815,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":381,"num_read_kb":13792,"num_write":908,"num_write_kb":26598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"263'108","reported_seq":718,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.535539+0000","last_change":"2024-09-12T00:28:33.206578+0000","last_active":"2024-09-12T01:35:16.535539+0000","last_peered":"2024-09-12T01:35:16.535539+0000","last_clean":"2024-09-12T01:35:16.535539+0000","last_became_active":"2024-09-12T00:28:33.206296+0000","last_became_peered":"2024-09-12T00:28:33.206296+0000","last_unstale":"2024-09-12T01:35:16.535539+0000","last_undegraded":"2024-09-12T01:35:16.535539+0000","last_fullsized":"2024-09-12T01:35:16.535539+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:53.527780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":463,"num_read_kb":402,"num_write":161,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"263'4150","reported_seq":4755,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.534336+0000","last_change":"2024-09-12T00:28:33.214093+0000","last_active":"2024-09-12T01:33:56.534336+0000","last_peered":"2024-09-12T01:33:56.534336+0000","last_clean":"2024-09-12T01:33:56.534336+0000","last_became_active":"2024-09-12T00:28:33.213777+0000","last_became_peered":"2024-09-12T00:28:33.213777+0000","last_unstale":"2024-09-12T01:33:56.534336+0000","last_undegraded":"2024-09-12T01:33:56.534336+0000","last_fullsized":"2024-09-12T01:33:56.534336+0000","mapping_epoch":27,"log_start":"263'4100","ondisk_log_start":"263'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":3000,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:34.960052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16687,"num_read_kb":13992,"num_write":6250,"num_write_kb":3125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"263'364","reported_seq":992,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.479322+0000","last_change":"2024-09-12T00:29:04.274666+0000","last_active":"2024-09-12T01:38:01.479322+0000","last_peered":"2024-09-12T01:38:01.479322+0000","last_clean":"2024-09-12T01:38:01.479322+0000","last_became_active":"2024-09-12T00:29:04.274377+0000","last_became_peered":"2024-09-12T00:29:04.274377+0000","last_unstale":"2024-09-12T01:38:01.479322+0000","last_undegraded":"2024-09-12T01:38:01.479322+0000","last_fullsized":"2024-09-12T01:38:01.479322+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:54.628791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1617669,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":550,"num_read_kb":2856,"num_write":1170,"num_write_kb":27657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"263'295","reported_seq":935,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:08.059213+0000","last_change":"2024-09-12T00:28:33.218880+0000","last_active":"2024-09-12T01:35:08.059213+0000","last_peered":"2024-09-12T01:35:08.059213+0000","last_clean":"2024-09-12T01:35:08.059213+0000","last_became_active":"2024-09-12T00:28:33.218660+0000","last_became_peered":"2024-09-12T00:28:33.218660+0000","last_unstale":"2024-09-12T01:35:08.059213+0000","last_undegraded":"2024-09-12T01:35:08.059213+0000","last_fullsized":"2024-09-12T01:35:08.059213+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:31.583663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1306,"num_read_kb":1072,"num_write":479,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"263'359","reported_seq":1022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.479027+0000","last_change":"2024-09-12T00:28:31.213720+0000","last_active":"2024-09-12T01:38:01.479027+0000","last_peered":"2024-09-12T01:38:01.479027+0000","last_clean":"2024-09-12T01:38:01.479027+0000","last_became_active":"2024-09-12T00:28:31.213388+0000","last_became_peered":"2024-09-12T00:28:31.213388+0000","last_unstale":"2024-09-12T01:38:01.479027+0000","last_undegraded":"2024-09-12T01:38:01.479027+0000","last_fullsized":"2024-09-12T01:38:01.479027+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:39.340566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133769,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":583,"num_read_kb":20058,"num_write":1145,"num_write_kb":40619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"263'90","reported_seq":673,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:52.081197+0000","last_change":"2024-09-12T00:28:33.214308+0000","last_active":"2024-09-12T01:35:52.081197+0000","last_peered":"2024-09-12T01:35:52.081197+0000","last_clean":"2024-09-12T01:35:52.081197+0000","last_became_active":"2024-09-12T00:28:33.213998+0000","last_became_peered":"2024-09-12T00:28:33.213998+0000","last_unstale":"2024-09-12T01:35:52.081197+0000","last_undegraded":"2024-09-12T01:35:52.081197+0000","last_fullsized":"2024-09-12T01:35:52.081197+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:58.148121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":414,"num_read_kb":350,"num_write":126,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"263'343","reported_seq":1055,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.535524+0000","last_change":"2024-09-12T00:28:31.215536+0000","last_active":"2024-09-12T01:38:01.535524+0000","last_peered":"2024-09-12T01:38:01.535524+0000","last_clean":"2024-09-12T01:38:01.535524+0000","last_became_active":"2024-09-12T00:28:31.215230+0000","last_became_peered":"2024-09-12T00:28:31.215230+0000","last_unstale":"2024-09-12T01:38:01.535524+0000","last_undegraded":"2024-09-12T01:38:01.535524+0000","last_fullsized":"2024-09-12T01:38:01.535524+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:13.446276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254878,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":618,"num_read_kb":115792,"num_write":1085,"num_write_kb":22723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"263'230","reported_seq":852,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:56.125911+0000","last_change":"2024-09-12T00:28:33.206843+0000","last_active":"2024-09-12T01:35:56.125911+0000","last_peered":"2024-09-12T01:35:56.125911+0000","last_clean":"2024-09-12T01:35:56.125911+0000","last_became_active":"2024-09-12T00:28:33.206305+0000","last_became_peered":"2024-09-12T00:28:33.206305+0000","last_unstale":"2024-09-12T01:35:56.125911+0000","last_undegraded":"2024-09-12T01:35:56.125911+0000","last_fullsized":"2024-09-12T01:35:56.125911+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:47.700041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":971,"num_read_kb":790,"num_write":344,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"263'404","reported_seq":1133,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.559024+0000","last_change":"2024-09-12T00:28:31.200080+0000","last_active":"2024-09-12T01:38:01.559024+0000","last_peered":"2024-09-12T01:38:01.559024+0000","last_clean":"2024-09-12T01:38:01.559024+0000","last_became_active":"2024-09-12T00:28:31.199779+0000","last_became_peered":"2024-09-12T00:28:31.199779+0000","last_unstale":"2024-09-12T01:38:01.559024+0000","last_undegraded":"2024-09-12T01:38:01.559024+0000","last_fullsized":"2024-09-12T01:38:01.559024+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:30.398312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":360748,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":660,"num_read_kb":69033,"num_write":1309,"num_write_kb":57878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"263'150","reported_seq":800,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:17.328724+0000","last_change":"2024-09-12T00:28:33.209112+0000","last_active":"2024-09-12T01:35:17.328724+0000","last_peered":"2024-09-12T01:35:17.328724+0000","last_clean":"2024-09-12T01:35:17.328724+0000","last_became_active":"2024-09-12T00:28:33.208831+0000","last_became_peered":"2024-09-12T00:28:33.208831+0000","last_unstale":"2024-09-12T01:35:17.328724+0000","last_undegraded":"2024-09-12T01:35:17.328724+0000","last_fullsized":"2024-09-12T01:35:17.328724+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:49.062557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":710,"num_read_kb":600,"num_write":211,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"263'322","reported_seq":968,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:49.636910+0000","last_change":"2024-09-12T00:28:31.202543+0000","last_active":"2024-09-12T01:33:49.636910+0000","last_peered":"2024-09-12T01:33:49.636910+0000","last_clean":"2024-09-12T01:33:49.636910+0000","last_became_active":"2024-09-12T00:28:31.202245+0000","last_became_peered":"2024-09-12T00:28:31.202245+0000","last_unstale":"2024-09-12T01:33:49.636910+0000","last_undegraded":"2024-09-12T01:33:49.636910+0000","last_fullsized":"2024-09-12T01:33:49.636910+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:12.536550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11608952,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":483,"num_read_kb":23092,"num_write":1269,"num_write_kb":58944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"263'113","reported_seq":719,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.533718+0000","last_change":"2024-09-12T00:28:33.207817+0000","last_active":"2024-09-12T01:33:51.533718+0000","last_peered":"2024-09-12T01:33:51.533718+0000","last_clean":"2024-09-12T01:33:51.533718+0000","last_became_active":"2024-09-12T00:28:33.207527+0000","last_became_peered":"2024-09-12T00:28:33.207527+0000","last_unstale":"2024-09-12T01:33:51.533718+0000","last_undegraded":"2024-09-12T01:33:51.533718+0000","last_fullsized":"2024-09-12T01:33:51.533718+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:31.972357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":515,"num_read_kb":438,"num_write":174,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"263'311","reported_seq":970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.719296+0000","last_change":"2024-09-12T00:28:31.204106+0000","last_active":"2024-09-12T01:38:01.719296+0000","last_peered":"2024-09-12T01:38:01.719296+0000","last_clean":"2024-09-12T01:38:01.719296+0000","last_became_active":"2024-09-12T00:28:31.203048+0000","last_became_peered":"2024-09-12T00:28:31.203048+0000","last_unstale":"2024-09-12T01:38:01.719296+0000","last_undegraded":"2024-09-12T01:38:01.719296+0000","last_fullsized":"2024-09-12T01:38:01.719296+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:57.305025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524344,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":495,"num_read_kb":45596,"num_write":1045,"num_write_kb":35489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"263'106","reported_seq":617,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:42.693662+0000","last_change":"2024-09-12T00:28:41.227253+0000","last_active":"2024-09-12T01:36:42.693662+0000","last_peered":"2024-09-12T01:36:42.693662+0000","last_clean":"2024-09-12T01:36:42.693662+0000","last_became_active":"2024-09-12T00:28:41.226952+0000","last_became_peered":"2024-09-12T00:28:41.226952+0000","last_unstale":"2024-09-12T01:36:42.693662+0000","last_undegraded":"2024-09-12T01:36:42.693662+0000","last_fullsized":"2024-09-12T01:36:42.693662+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:26.588660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":155,"num_read_kb":144,"num_write":259,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"263'188","reported_seq":772,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:09.639537+0000","last_change":"2024-09-12T00:28:33.209848+0000","last_active":"2024-09-12T01:34:09.639537+0000","last_peered":"2024-09-12T01:34:09.639537+0000","last_clean":"2024-09-12T01:34:09.639537+0000","last_became_active":"2024-09-12T00:28:33.209521+0000","last_became_peered":"2024-09-12T00:28:33.209521+0000","last_unstale":"2024-09-12T01:34:09.639537+0000","last_undegraded":"2024-09-12T01:34:09.639537+0000","last_fullsized":"2024-09-12T01:34:09.639537+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:21.840301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":834,"num_read_kb":672,"num_write":307,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"263'353","reported_seq":957,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.698618+0000","last_change":"2024-09-12T00:28:31.206298+0000","last_active":"2024-09-12T01:38:01.698618+0000","last_peered":"2024-09-12T01:38:01.698618+0000","last_clean":"2024-09-12T01:38:01.698618+0000","last_became_active":"2024-09-12T00:28:31.206010+0000","last_became_peered":"2024-09-12T00:28:31.206010+0000","last_unstale":"2024-09-12T01:38:01.698618+0000","last_undegraded":"2024-09-12T01:38:01.698618+0000","last_fullsized":"2024-09-12T01:38:01.698618+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:59.671503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":430,"num_read_kb":5592,"num_write":1103,"num_write_kb":25256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:47.779150+0000","last_change":"2024-09-12T00:28:35.212219+0000","last_active":"2024-09-12T01:33:47.779150+0000","last_peered":"2024-09-12T01:33:47.779150+0000","last_clean":"2024-09-12T01:33:47.779150+0000","last_became_active":"2024-09-12T00:28:35.211231+0000","last_became_peered":"2024-09-12T00:28:35.211231+0000","last_unstale":"2024-09-12T01:33:47.779150+0000","last_undegraded":"2024-09-12T01:33:47.779150+0000","last_fullsized":"2024-09-12T01:33:47.779150+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:10.530098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"263'348","reported_seq":970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.628118+0000","last_change":"2024-09-12T00:28:37.216446+0000","last_active":"2024-09-12T01:38:01.628118+0000","last_peered":"2024-09-12T01:38:01.628118+0000","last_clean":"2024-09-12T01:38:01.628118+0000","last_became_active":"2024-09-12T00:28:37.216169+0000","last_became_peered":"2024-09-12T00:28:37.216169+0000","last_unstale":"2024-09-12T01:38:01.628118+0000","last_undegraded":"2024-09-12T01:38:01.628118+0000","last_fullsized":"2024-09-12T01:38:01.628118+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:12.966316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44362,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":554,"num_read_kb":1122,"num_write":430,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.718741+0000","last_change":"2024-09-12T00:28:39.214249+0000","last_active":"2024-09-12T01:33:56.718741+0000","last_peered":"2024-09-12T01:33:56.718741+0000","last_clean":"2024-09-12T01:33:56.718741+0000","last_became_active":"2024-09-12T00:28:39.213942+0000","last_became_peered":"2024-09-12T00:28:39.213942+0000","last_unstale":"2024-09-12T01:33:56.718741+0000","last_undegraded":"2024-09-12T01:33:56.718741+0000","last_fullsized":"2024-09-12T01:33:56.718741+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:13.977918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"263'182","reported_seq":733,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:39.518790+0000","last_change":"2024-09-12T00:28:41.229922+0000","last_active":"2024-09-12T01:36:39.518790+0000","last_peered":"2024-09-12T01:36:39.518790+0000","last_clean":"2024-09-12T01:36:39.518790+0000","last_became_active":"2024-09-12T00:28:41.229608+0000","last_became_peered":"2024-09-12T00:28:41.229608+0000","last_unstale":"2024-09-12T01:36:39.518790+0000","last_undegraded":"2024-09-12T01:36:39.518790+0000","last_fullsized":"2024-09-12T01:36:39.518790+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:00.176000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":231,"num_read_kb":225,"num_write":383,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"263'212","reported_seq":813,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:47.779133+0000","last_change":"2024-09-12T00:28:33.212615+0000","last_active":"2024-09-12T01:33:47.779133+0000","last_peered":"2024-09-12T01:33:47.779133+0000","last_clean":"2024-09-12T01:33:47.779133+0000","last_became_active":"2024-09-12T00:28:33.212334+0000","last_became_peered":"2024-09-12T00:28:33.212334+0000","last_unstale":"2024-09-12T01:33:47.779133+0000","last_undegraded":"2024-09-12T01:33:47.779133+0000","last_fullsized":"2024-09-12T01:33:47.779133+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:46.854089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":883,"num_read_kb":721,"num_write":311,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"263'324","reported_seq":981,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.758063+0000","last_change":"2024-09-12T00:28:31.208474+0000","last_active":"2024-09-12T01:38:01.758063+0000","last_peered":"2024-09-12T01:38:01.758063+0000","last_clean":"2024-09-12T01:38:01.758063+0000","last_became_active":"2024-09-12T00:28:31.208141+0000","last_became_peered":"2024-09-12T00:28:31.208141+0000","last_unstale":"2024-09-12T01:38:01.758063+0000","last_undegraded":"2024-09-12T01:38:01.758063+0000","last_fullsized":"2024-09-12T01:38:01.758063+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:28:51.190004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395868,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":543,"num_read_kb":93032,"num_write":945,"num_write_kb":55506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:09.639557+0000","last_change":"2024-09-12T00:28:35.213065+0000","last_active":"2024-09-12T01:34:09.639557+0000","last_peered":"2024-09-12T01:34:09.639557+0000","last_clean":"2024-09-12T01:34:09.639557+0000","last_became_active":"2024-09-12T00:28:35.212745+0000","last_became_peered":"2024-09-12T00:28:35.212745+0000","last_unstale":"2024-09-12T01:34:09.639557+0000","last_undegraded":"2024-09-12T01:34:09.639557+0000","last_fullsized":"2024-09-12T01:34:09.639557+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:29.695288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"263'92","reported_seq":630,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:16.554571+0000","last_change":"2024-09-12T00:28:37.221408+0000","last_active":"2024-09-12T01:36:16.554571+0000","last_peered":"2024-09-12T01:36:16.554571+0000","last_clean":"2024-09-12T01:36:16.554571+0000","last_became_active":"2024-09-12T00:28:37.220899+0000","last_became_peered":"2024-09-12T00:28:37.220899+0000","last_unstale":"2024-09-12T01:36:16.554571+0000","last_undegraded":"2024-09-12T01:36:16.554571+0000","last_fullsized":"2024-09-12T01:36:16.554571+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:45.174607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":118,"num_read_kb":113,"num_write":78,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.534538+0000","last_change":"2024-09-12T00:28:39.222836+0000","last_active":"2024-09-12T01:33:56.534538+0000","last_peered":"2024-09-12T01:33:56.534538+0000","last_clean":"2024-09-12T01:33:56.534538+0000","last_became_active":"2024-09-12T00:28:39.222553+0000","last_became_peered":"2024-09-12T00:28:39.222553+0000","last_unstale":"2024-09-12T01:33:56.534538+0000","last_undegraded":"2024-09-12T01:33:56.534538+0000","last_fullsized":"2024-09-12T01:33:56.534538+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:57.986714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"263'126","reported_seq":631,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:42.376957+0000","last_change":"2024-09-12T00:28:41.228569+0000","last_active":"2024-09-12T01:36:42.376957+0000","last_peered":"2024-09-12T01:36:42.376957+0000","last_clean":"2024-09-12T01:36:42.376957+0000","last_became_active":"2024-09-12T00:28:41.228305+0000","last_became_peered":"2024-09-12T00:28:41.228305+0000","last_unstale":"2024-09-12T01:36:42.376957+0000","last_undegraded":"2024-09-12T01:36:42.376957+0000","last_fullsized":"2024-09-12T01:36:42.376957+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:24.274319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":144,"num_read_kb":135,"num_write":299,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"263'197","reported_seq":842,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.783202+0000","last_change":"2024-09-12T00:28:33.219367+0000","last_active":"2024-09-12T01:33:51.783202+0000","last_peered":"2024-09-12T01:33:51.783202+0000","last_clean":"2024-09-12T01:33:51.783202+0000","last_became_active":"2024-09-12T00:28:33.219082+0000","last_became_peered":"2024-09-12T00:28:33.219082+0000","last_unstale":"2024-09-12T01:33:51.783202+0000","last_undegraded":"2024-09-12T01:33:51.783202+0000","last_fullsized":"2024-09-12T01:33:51.783202+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:01.014245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":923,"num_read_kb":768,"num_write":333,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"263'375","reported_seq":1002,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.732052+0000","last_change":"2024-09-12T00:28:31.204550+0000","last_active":"2024-09-12T01:38:01.732052+0000","last_peered":"2024-09-12T01:38:01.732052+0000","last_clean":"2024-09-12T01:38:01.732052+0000","last_became_active":"2024-09-12T00:28:31.204223+0000","last_became_peered":"2024-09-12T00:28:31.204223+0000","last_unstale":"2024-09-12T01:38:01.732052+0000","last_undegraded":"2024-09-12T01:38:01.732052+0000","last_fullsized":"2024-09-12T01:38:01.732052+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:52.918860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133702,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":535,"num_read_kb":1739,"num_write":1184,"num_write_kb":22527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:49.637009+0000","last_change":"2024-09-12T00:28:35.212684+0000","last_active":"2024-09-12T01:33:49.637009+0000","last_peered":"2024-09-12T01:33:49.637009+0000","last_clean":"2024-09-12T01:33:49.637009+0000","last_became_active":"2024-09-12T00:28:35.212197+0000","last_became_peered":"2024-09-12T00:28:35.212197+0000","last_unstale":"2024-09-12T01:33:49.637009+0000","last_undegraded":"2024-09-12T01:33:49.637009+0000","last_fullsized":"2024-09-12T01:33:49.637009+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:02.479666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"263'133","reported_seq":693,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:11.629177+0000","last_change":"2024-09-12T00:28:37.221078+0000","last_active":"2024-09-12T01:34:11.629177+0000","last_peered":"2024-09-12T01:34:11.629177+0000","last_clean":"2024-09-12T01:34:11.629177+0000","last_became_active":"2024-09-12T00:28:37.220665+0000","last_became_peered":"2024-09-12T00:28:37.220665+0000","last_unstale":"2024-09-12T01:34:11.629177+0000","last_undegraded":"2024-09-12T01:34:11.629177+0000","last_fullsized":"2024-09-12T01:34:11.629177+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:48.810725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":170,"num_read_kb":162,"num_write":114,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"263'767","reported_seq":4806,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.053951+0000","last_change":"2024-09-12T00:28:39.218836+0000","last_active":"2024-09-12T01:38:00.053951+0000","last_peered":"2024-09-12T01:38:00.053951+0000","last_clean":"2024-09-12T01:38:00.053951+0000","last_became_active":"2024-09-12T00:28:39.218476+0000","last_became_peered":"2024-09-12T00:28:39.218476+0000","last_unstale":"2024-09-12T01:38:00.053951+0000","last_undegraded":"2024-09-12T01:38:00.053951+0000","last_fullsized":"2024-09-12T01:38:00.053951+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:48.644746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"263'191","reported_seq":1014,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:41.653002+0000","last_change":"2024-09-12T00:28:41.257967+0000","last_active":"2024-09-12T01:36:41.653002+0000","last_peered":"2024-09-12T01:36:41.653002+0000","last_clean":"2024-09-12T01:36:41.653002+0000","last_became_active":"2024-09-12T00:28:41.257679+0000","last_became_peered":"2024-09-12T00:28:41.257679+0000","last_unstale":"2024-09-12T01:36:41.653002+0000","last_undegraded":"2024-09-12T01:36:41.653002+0000","last_fullsized":"2024-09-12T01:36:41.653002+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:03.811468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":583,"num_read_kb":580,"num_write":423,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"263'82","reported_seq":627,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:49.636986+0000","last_change":"2024-09-12T00:28:33.212834+0000","last_active":"2024-09-12T01:33:49.636986+0000","last_peered":"2024-09-12T01:33:49.636986+0000","last_clean":"2024-09-12T01:33:49.636986+0000","last_became_active":"2024-09-12T00:28:33.212564+0000","last_became_peered":"2024-09-12T00:28:33.212564+0000","last_unstale":"2024-09-12T01:33:49.636986+0000","last_undegraded":"2024-09-12T01:33:49.636986+0000","last_fullsized":"2024-09-12T01:33:49.636986+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:09.246468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":372,"num_read_kb":309,"num_write":130,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"263'292","reported_seq":994,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.483030+0000","last_change":"2024-09-12T00:28:31.208261+0000","last_active":"2024-09-12T01:38:01.483030+0000","last_peered":"2024-09-12T01:38:01.483030+0000","last_clean":"2024-09-12T01:38:01.483030+0000","last_became_active":"2024-09-12T00:28:31.207938+0000","last_became_peered":"2024-09-12T00:28:31.207938+0000","last_unstale":"2024-09-12T01:38:01.483030+0000","last_undegraded":"2024-09-12T01:38:01.483030+0000","last_fullsized":"2024-09-12T01:38:01.483030+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:57.649279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174711,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":512,"num_read_kb":179847,"num_write":970,"num_write_kb":39231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:52.780005+0000","last_change":"2024-09-12T00:28:35.213658+0000","last_active":"2024-09-12T01:33:52.780005+0000","last_peered":"2024-09-12T01:33:52.780005+0000","last_clean":"2024-09-12T01:33:52.780005+0000","last_became_active":"2024-09-12T00:28:35.213178+0000","last_became_peered":"2024-09-12T00:28:35.213178+0000","last_unstale":"2024-09-12T01:33:52.780005+0000","last_undegraded":"2024-09-12T01:33:52.780005+0000","last_fullsized":"2024-09-12T01:33:52.780005+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:24.544971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"263'258","reported_seq":836,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.362668+0000","last_change":"2024-09-12T00:28:37.426701+0000","last_active":"2024-09-12T01:38:01.362668+0000","last_peered":"2024-09-12T01:38:01.362668+0000","last_clean":"2024-09-12T01:38:01.362668+0000","last_became_active":"2024-09-12T00:28:37.426357+0000","last_became_peered":"2024-09-12T00:28:37.426357+0000","last_unstale":"2024-09-12T01:38:01.362668+0000","last_undegraded":"2024-09-12T01:38:01.362668+0000","last_fullsized":"2024-09-12T01:38:01.362668+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:10.776649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15889,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":416,"num_read_kb":929,"num_write":326,"num_write_kb":245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"263'764","reported_seq":2643,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:49.984000+0000","last_change":"2024-09-12T00:28:39.219349+0000","last_active":"2024-09-12T01:37:49.984000+0000","last_peered":"2024-09-12T01:37:49.984000+0000","last_clean":"2024-09-12T01:37:49.984000+0000","last_became_active":"2024-09-12T00:28:39.218738+0000","last_became_peered":"2024-09-12T00:28:39.218738+0000","last_unstale":"2024-09-12T01:37:49.984000+0000","last_undegraded":"2024-09-12T01:37:49.984000+0000","last_fullsized":"2024-09-12T01:37:49.984000+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":700,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:17.422620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"263'110","reported_seq":678,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:47.796048+0000","last_change":"2024-09-12T00:28:33.213347+0000","last_active":"2024-09-12T01:35:47.796048+0000","last_peered":"2024-09-12T01:35:47.796048+0000","last_clean":"2024-09-12T01:35:47.796048+0000","last_became_active":"2024-09-12T00:28:33.213074+0000","last_became_peered":"2024-09-12T00:28:33.213074+0000","last_unstale":"2024-09-12T01:35:47.796048+0000","last_undegraded":"2024-09-12T01:35:47.796048+0000","last_fullsized":"2024-09-12T01:35:47.796048+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:23.084366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":473,"num_read_kb":387,"num_write":177,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"263'304","reported_seq":913,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.733507+0000","last_change":"2024-09-12T00:28:31.208561+0000","last_active":"2024-09-12T01:38:01.733507+0000","last_peered":"2024-09-12T01:38:01.733507+0000","last_clean":"2024-09-12T01:38:01.733507+0000","last_became_active":"2024-09-12T00:28:31.207567+0000","last_became_peered":"2024-09-12T00:28:31.207567+0000","last_unstale":"2024-09-12T01:38:01.733507+0000","last_undegraded":"2024-09-12T01:38:01.733507+0000","last_fullsized":"2024-09-12T01:38:01.733507+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:20.391261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":384,"num_read_kb":9497,"num_write":972,"num_write_kb":19827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.736003+0000","last_change":"2024-09-12T00:28:35.210621+0000","last_active":"2024-09-12T01:35:46.736003+0000","last_peered":"2024-09-12T01:35:46.736003+0000","last_clean":"2024-09-12T01:35:46.736003+0000","last_became_active":"2024-09-12T00:28:35.209944+0000","last_became_peered":"2024-09-12T00:28:35.209944+0000","last_unstale":"2024-09-12T01:35:46.736003+0000","last_undegraded":"2024-09-12T01:35:46.736003+0000","last_fullsized":"2024-09-12T01:35:46.736003+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:49.310299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"263'364","reported_seq":991,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:52.797020+0000","last_change":"2024-09-12T00:28:37.424559+0000","last_active":"2024-09-12T01:35:52.797020+0000","last_peered":"2024-09-12T01:35:52.797020+0000","last_clean":"2024-09-12T01:35:52.797020+0000","last_became_active":"2024-09-12T00:28:37.424250+0000","last_became_peered":"2024-09-12T00:28:37.424250+0000","last_unstale":"2024-09-12T01:35:52.797020+0000","last_undegraded":"2024-09-12T01:35:52.797020+0000","last_fullsized":"2024-09-12T01:35:52.797020+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:53.905894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49099,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":575,"num_read_kb":1032,"num_write":440,"num_write_kb":258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.933854+0000","last_change":"2024-09-12T00:28:39.214210+0000","last_active":"2024-09-12T01:33:56.933854+0000","last_peered":"2024-09-12T01:33:56.933854+0000","last_clean":"2024-09-12T01:33:56.933854+0000","last_became_active":"2024-09-12T00:28:39.213889+0000","last_became_peered":"2024-09-12T00:28:39.213889+0000","last_unstale":"2024-09-12T01:33:56.933854+0000","last_undegraded":"2024-09-12T01:33:56.933854+0000","last_fullsized":"2024-09-12T01:33:56.933854+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:04.180315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"263'533","reported_seq":1343,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:47.142053+0000","last_change":"2024-09-12T00:28:41.229982+0000","last_active":"2024-09-12T01:37:47.142053+0000","last_peered":"2024-09-12T01:37:47.142053+0000","last_clean":"2024-09-12T01:37:47.142053+0000","last_became_active":"2024-09-12T00:28:41.229664+0000","last_became_peered":"2024-09-12T00:28:41.229664+0000","last_unstale":"2024-09-12T01:37:47.142053+0000","last_undegraded":"2024-09-12T01:37:47.142053+0000","last_fullsized":"2024-09-12T01:37:47.142053+0000","mapping_epoch":35,"log_start":"263'500","ondisk_log_start":"263'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":500,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:28.373424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":472,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1261,"num_read_kb":1256,"num_write":1100,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"263'151","reported_seq":766,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.549725+0000","last_change":"2024-09-12T00:28:33.201995+0000","last_active":"2024-09-12T01:35:46.549725+0000","last_peered":"2024-09-12T01:35:46.549725+0000","last_clean":"2024-09-12T01:35:46.549725+0000","last_became_active":"2024-09-12T00:28:33.201673+0000","last_became_peered":"2024-09-12T00:28:33.201673+0000","last_unstale":"2024-09-12T01:35:46.549725+0000","last_undegraded":"2024-09-12T01:35:46.549725+0000","last_fullsized":"2024-09-12T01:35:46.549725+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:31.181867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":672,"num_read_kb":557,"num_write":251,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"263'417","reported_seq":1119,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.747151+0000","last_change":"2024-09-12T00:28:31.202584+0000","last_active":"2024-09-12T01:38:01.747151+0000","last_peered":"2024-09-12T01:38:01.747151+0000","last_clean":"2024-09-12T01:38:01.747151+0000","last_became_active":"2024-09-12T00:28:31.202279+0000","last_became_peered":"2024-09-12T00:28:31.202279+0000","last_unstale":"2024-09-12T01:38:01.747151+0000","last_undegraded":"2024-09-12T01:38:01.747151+0000","last_fullsized":"2024-09-12T01:38:01.747151+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:56.615946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":282856,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":774,"num_read_kb":12137,"num_write":1232,"num_write_kb":44296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.538620+0000","last_change":"2024-09-12T00:28:35.210515+0000","last_active":"2024-09-12T01:35:46.538620+0000","last_peered":"2024-09-12T01:35:46.538620+0000","last_clean":"2024-09-12T01:35:46.538620+0000","last_became_active":"2024-09-12T00:28:35.210154+0000","last_became_peered":"2024-09-12T00:28:35.210154+0000","last_unstale":"2024-09-12T01:35:46.538620+0000","last_undegraded":"2024-09-12T01:35:46.538620+0000","last_fullsized":"2024-09-12T01:35:46.538620+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:27.486274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"263'268","reported_seq":849,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:09.653372+0000","last_change":"2024-09-12T00:28:37.220230+0000","last_active":"2024-09-12T01:36:09.653372+0000","last_peered":"2024-09-12T01:36:09.653372+0000","last_clean":"2024-09-12T01:36:09.653372+0000","last_became_active":"2024-09-12T00:28:37.219967+0000","last_became_peered":"2024-09-12T00:28:37.219967+0000","last_unstale":"2024-09-12T01:36:09.653372+0000","last_undegraded":"2024-09-12T01:36:09.653372+0000","last_fullsized":"2024-09-12T01:36:09.653372+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:44.830810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49927,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":436,"num_read_kb":914,"num_write":354,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:54.637493+0000","last_change":"2024-09-12T00:28:39.216619+0000","last_active":"2024-09-12T01:33:54.637493+0000","last_peered":"2024-09-12T01:33:54.637493+0000","last_clean":"2024-09-12T01:33:54.637493+0000","last_became_active":"2024-09-12T00:28:39.216330+0000","last_became_peered":"2024-09-12T00:28:39.216330+0000","last_unstale":"2024-09-12T01:33:54.637493+0000","last_undegraded":"2024-09-12T01:33:54.637493+0000","last_fullsized":"2024-09-12T01:33:54.637493+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:08.447550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"263'2405","reported_seq":4247,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:36.457076+0000","last_change":"2024-09-12T00:28:41.228159+0000","last_active":"2024-09-12T01:37:36.457076+0000","last_peered":"2024-09-12T01:37:36.457076+0000","last_clean":"2024-09-12T01:37:36.457076+0000","last_became_active":"2024-09-12T00:28:41.227877+0000","last_became_peered":"2024-09-12T00:28:41.227877+0000","last_unstale":"2024-09-12T01:37:36.457076+0000","last_undegraded":"2024-09-12T01:37:36.457076+0000","last_fullsized":"2024-09-12T01:37:36.457076+0000","mapping_epoch":35,"log_start":"263'2300","ondisk_log_start":"263'2300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":2300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:29.699595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1208,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6068,"num_read_kb":6055,"num_write":4875,"num_write_kb":1798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"263'303","reported_seq":972,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.533631+0000","last_change":"2024-09-12T00:28:33.218264+0000","last_active":"2024-09-12T01:33:51.533631+0000","last_peered":"2024-09-12T01:33:51.533631+0000","last_clean":"2024-09-12T01:33:51.533631+0000","last_became_active":"2024-09-12T00:28:33.217954+0000","last_became_peered":"2024-09-12T00:28:33.217954+0000","last_unstale":"2024-09-12T01:33:51.533631+0000","last_undegraded":"2024-09-12T01:33:51.533631+0000","last_fullsized":"2024-09-12T01:33:51.533631+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:44.095321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1356,"num_read_kb":1133,"num_write":489,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"263'383","reported_seq":1069,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.693915+0000","last_change":"2024-09-12T00:28:31.215918+0000","last_active":"2024-09-12T01:38:01.693915+0000","last_peered":"2024-09-12T01:38:01.693915+0000","last_clean":"2024-09-12T01:38:01.693915+0000","last_became_active":"2024-09-12T00:28:31.215643+0000","last_became_peered":"2024-09-12T00:28:31.215643+0000","last_unstale":"2024-09-12T01:38:01.693915+0000","last_undegraded":"2024-09-12T01:38:01.693915+0000","last_fullsized":"2024-09-12T01:38:01.693915+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:03.063848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432543,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":555,"num_read_kb":94195,"num_write":1240,"num_write_kb":52818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.627099+0000","last_change":"2024-09-12T00:28:35.208477+0000","last_active":"2024-09-12T01:33:51.627099+0000","last_peered":"2024-09-12T01:33:51.627099+0000","last_clean":"2024-09-12T01:33:51.627099+0000","last_became_active":"2024-09-12T00:28:35.208169+0000","last_became_peered":"2024-09-12T00:28:35.208169+0000","last_unstale":"2024-09-12T01:33:51.627099+0000","last_undegraded":"2024-09-12T01:33:51.627099+0000","last_fullsized":"2024-09-12T01:33:51.627099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:22.104533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"263'330","reported_seq":940,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.229680+0000","last_change":"2024-09-12T00:28:37.221382+0000","last_active":"2024-09-12T01:38:00.229680+0000","last_peered":"2024-09-12T01:38:00.229680+0000","last_clean":"2024-09-12T01:38:00.229680+0000","last_became_active":"2024-09-12T00:28:37.220877+0000","last_became_peered":"2024-09-12T00:28:37.220877+0000","last_unstale":"2024-09-12T01:38:00.229680+0000","last_undegraded":"2024-09-12T01:38:00.229680+0000","last_fullsized":"2024-09-12T01:38:00.229680+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:32:44.806344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44229,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":532,"num_read_kb":1137,"num_write":418,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"263'773","reported_seq":2587,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.806004+0000","last_change":"2024-09-12T00:28:39.216443+0000","last_active":"2024-09-12T01:38:01.806004+0000","last_peered":"2024-09-12T01:38:01.806004+0000","last_clean":"2024-09-12T01:38:01.806004+0000","last_became_active":"2024-09-12T00:28:39.215746+0000","last_became_peered":"2024-09-12T00:28:39.215746+0000","last_unstale":"2024-09-12T01:38:01.806004+0000","last_undegraded":"2024-09-12T01:38:01.806004+0000","last_fullsized":"2024-09-12T01:38:01.806004+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:06.915545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"263'80","reported_seq":574,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.022592+0000","last_change":"2024-09-12T00:28:41.228845+0000","last_active":"2024-09-12T01:37:46.022592+0000","last_peered":"2024-09-12T01:37:46.022592+0000","last_clean":"2024-09-12T01:37:46.022592+0000","last_became_active":"2024-09-12T00:28:41.228361+0000","last_became_peered":"2024-09-12T00:28:41.228361+0000","last_unstale":"2024-09-12T01:37:46.022592+0000","last_undegraded":"2024-09-12T01:37:46.022592+0000","last_fullsized":"2024-09-12T01:37:46.022592+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:22.221289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":65,"num_write":188,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"263'302","reported_seq":908,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:48.154867+0000","last_change":"2024-09-12T00:28:33.219482+0000","last_active":"2024-09-12T01:35:48.154867+0000","last_peered":"2024-09-12T01:35:48.154867+0000","last_clean":"2024-09-12T01:35:48.154867+0000","last_became_active":"2024-09-12T00:28:33.219182+0000","last_became_peered":"2024-09-12T00:28:33.219182+0000","last_unstale":"2024-09-12T01:35:48.154867+0000","last_undegraded":"2024-09-12T01:35:48.154867+0000","last_fullsized":"2024-09-12T01:35:48.154867+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:37.924996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1277,"num_read_kb":1021,"num_write":469,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"263'305","reported_seq":972,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:19.663015+0000","last_change":"2024-09-12T00:28:31.215345+0000","last_active":"2024-09-12T01:35:19.663015+0000","last_peered":"2024-09-12T01:35:19.663015+0000","last_clean":"2024-09-12T01:35:19.663015+0000","last_became_active":"2024-09-12T00:28:31.214920+0000","last_became_peered":"2024-09-12T00:28:31.214920+0000","last_unstale":"2024-09-12T01:35:19.663015+0000","last_undegraded":"2024-09-12T01:35:19.663015+0000","last_fullsized":"2024-09-12T01:35:19.663015+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:51.465462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6350794,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":515,"num_read_kb":15343,"num_write":1167,"num_write_kb":35661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.627067+0000","last_change":"2024-09-12T00:28:35.208217+0000","last_active":"2024-09-12T01:33:51.627067+0000","last_peered":"2024-09-12T01:33:51.627067+0000","last_clean":"2024-09-12T01:33:51.627067+0000","last_became_active":"2024-09-12T00:28:35.207881+0000","last_became_peered":"2024-09-12T00:28:35.207881+0000","last_unstale":"2024-09-12T01:33:51.627067+0000","last_undegraded":"2024-09-12T01:33:51.627067+0000","last_fullsized":"2024-09-12T01:33:51.627067+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:10.037662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"263'466","reported_seq":1120,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.006707+0000","last_change":"2024-09-12T00:28:37.217137+0000","last_active":"2024-09-12T01:38:01.006707+0000","last_peered":"2024-09-12T01:38:01.006707+0000","last_clean":"2024-09-12T01:38:01.006707+0000","last_became_active":"2024-09-12T00:28:37.216189+0000","last_became_peered":"2024-09-12T00:28:37.216189+0000","last_unstale":"2024-09-12T01:38:01.006707+0000","last_undegraded":"2024-09-12T01:38:01.006707+0000","last_fullsized":"2024-09-12T01:38:01.006707+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:12.417502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90719,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":821,"num_read_kb":1951,"num_write":658,"num_write_kb":528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:51.539194+0000","last_change":"2024-09-12T00:28:39.212958+0000","last_active":"2024-09-12T01:35:51.539194+0000","last_peered":"2024-09-12T01:35:51.539194+0000","last_clean":"2024-09-12T01:35:51.539194+0000","last_became_active":"2024-09-12T00:28:39.212687+0000","last_became_peered":"2024-09-12T00:28:39.212687+0000","last_unstale":"2024-09-12T01:35:51.539194+0000","last_undegraded":"2024-09-12T01:35:51.539194+0000","last_fullsized":"2024-09-12T01:35:51.539194+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:16.911233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"263'133","reported_seq":661,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:51.948546+0000","last_change":"2024-09-12T00:28:41.226044+0000","last_active":"2024-09-12T01:35:51.948546+0000","last_peered":"2024-09-12T01:35:51.948546+0000","last_clean":"2024-09-12T01:35:51.948546+0000","last_became_active":"2024-09-12T00:28:41.225700+0000","last_became_peered":"2024-09-12T00:28:41.225700+0000","last_unstale":"2024-09-12T01:35:51.948546+0000","last_undegraded":"2024-09-12T01:35:51.948546+0000","last_fullsized":"2024-09-12T01:35:51.948546+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:22.538216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":521,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":185,"num_read_kb":167,"num_write":321,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"263'175","reported_seq":779,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.533678+0000","last_change":"2024-09-12T00:28:33.205438+0000","last_active":"2024-09-12T01:33:51.533678+0000","last_peered":"2024-09-12T01:33:51.533678+0000","last_clean":"2024-09-12T01:33:51.533678+0000","last_became_active":"2024-09-12T00:28:33.204532+0000","last_became_peered":"2024-09-12T00:28:33.204532+0000","last_unstale":"2024-09-12T01:33:51.533678+0000","last_undegraded":"2024-09-12T01:33:51.533678+0000","last_fullsized":"2024-09-12T01:33:51.533678+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:42.519724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":765,"num_read_kb":622,"num_write":270,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"263'310","reported_seq":946,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:24.852094+0000","last_change":"2024-09-12T00:28:31.207547+0000","last_active":"2024-09-12T01:36:24.852094+0000","last_peered":"2024-09-12T01:36:24.852094+0000","last_clean":"2024-09-12T01:36:24.852094+0000","last_became_active":"2024-09-12T00:28:31.207269+0000","last_became_peered":"2024-09-12T00:28:31.207269+0000","last_unstale":"2024-09-12T01:36:24.852094+0000","last_undegraded":"2024-09-12T01:36:24.852094+0000","last_fullsized":"2024-09-12T01:36:24.852094+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:27.052564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11558926,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":469,"num_read_kb":24702,"num_write":1056,"num_write_kb":40904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.627126+0000","last_change":"2024-09-12T00:28:35.209783+0000","last_active":"2024-09-12T01:33:51.627126+0000","last_peered":"2024-09-12T01:33:51.627126+0000","last_clean":"2024-09-12T01:33:51.627126+0000","last_became_active":"2024-09-12T00:28:35.208829+0000","last_became_peered":"2024-09-12T00:28:35.208829+0000","last_unstale":"2024-09-12T01:33:51.627126+0000","last_undegraded":"2024-09-12T01:33:51.627126+0000","last_fullsized":"2024-09-12T01:33:51.627126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:49.399261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"263'284","reported_seq":877,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.054138+0000","last_change":"2024-09-12T00:28:37.210416+0000","last_active":"2024-09-12T01:38:01.054138+0000","last_peered":"2024-09-12T01:38:01.054138+0000","last_clean":"2024-09-12T01:38:01.054138+0000","last_became_active":"2024-09-12T00:28:37.210162+0000","last_became_peered":"2024-09-12T00:28:37.210162+0000","last_unstale":"2024-09-12T01:38:01.054138+0000","last_undegraded":"2024-09-12T01:38:01.054138+0000","last_fullsized":"2024-09-12T01:38:01.054138+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:03.051183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46921,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":495,"num_read_kb":1053,"num_write":432,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:06.785115+0000","last_change":"2024-09-12T00:28:39.220793+0000","last_active":"2024-09-12T01:34:06.785115+0000","last_peered":"2024-09-12T01:34:06.785115+0000","last_clean":"2024-09-12T01:34:06.785115+0000","last_became_active":"2024-09-12T00:28:39.220468+0000","last_became_peered":"2024-09-12T00:28:39.220468+0000","last_unstale":"2024-09-12T01:34:06.785115+0000","last_undegraded":"2024-09-12T01:34:06.785115+0000","last_fullsized":"2024-09-12T01:34:06.785115+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:49.834445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"263'81","reported_seq":575,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:59.659578+0000","last_change":"2024-09-12T00:28:41.228956+0000","last_active":"2024-09-12T01:36:59.659578+0000","last_peered":"2024-09-12T01:36:59.659578+0000","last_clean":"2024-09-12T01:36:59.659578+0000","last_became_active":"2024-09-12T00:28:41.228663+0000","last_became_peered":"2024-09-12T00:28:41.228663+0000","last_unstale":"2024-09-12T01:36:59.659578+0000","last_undegraded":"2024-09-12T01:36:59.659578+0000","last_fullsized":"2024-09-12T01:36:59.659578+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:51.130761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":503,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":60,"num_read_kb":59,"num_write":193,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"263'158","reported_seq":779,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:45.663215+0000","last_change":"2024-09-12T00:28:33.207160+0000","last_active":"2024-09-12T01:35:45.663215+0000","last_peered":"2024-09-12T01:35:45.663215+0000","last_clean":"2024-09-12T01:35:45.663215+0000","last_became_active":"2024-09-12T00:28:33.206883+0000","last_became_peered":"2024-09-12T00:28:33.206883+0000","last_unstale":"2024-09-12T01:35:45.663215+0000","last_undegraded":"2024-09-12T01:35:45.663215+0000","last_fullsized":"2024-09-12T01:35:45.663215+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:15.306805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":717,"num_read_kb":595,"num_write":233,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"263'296","reported_seq":911,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.493238+0000","last_change":"2024-09-12T00:28:31.203866+0000","last_active":"2024-09-12T01:38:01.493238+0000","last_peered":"2024-09-12T01:38:01.493238+0000","last_clean":"2024-09-12T01:38:01.493238+0000","last_became_active":"2024-09-12T00:28:31.203369+0000","last_became_peered":"2024-09-12T00:28:31.203369+0000","last_unstale":"2024-09-12T01:38:01.493238+0000","last_undegraded":"2024-09-12T01:38:01.493238+0000","last_fullsized":"2024-09-12T01:38:01.493238+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:04.800888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7425264,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":365,"num_read_kb":56295,"num_write":839,"num_write_kb":46368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.933271+0000","last_change":"2024-09-12T00:28:35.208477+0000","last_active":"2024-09-12T01:33:51.933271+0000","last_peered":"2024-09-12T01:33:51.933271+0000","last_clean":"2024-09-12T01:33:51.933271+0000","last_became_active":"2024-09-12T00:28:35.207923+0000","last_became_peered":"2024-09-12T00:28:35.207923+0000","last_unstale":"2024-09-12T01:33:51.933271+0000","last_undegraded":"2024-09-12T01:33:51.933271+0000","last_fullsized":"2024-09-12T01:33:51.933271+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:33.170429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"263'348","reported_seq":950,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.685418+0000","last_change":"2024-09-12T00:28:37.220980+0000","last_active":"2024-09-12T01:38:00.685418+0000","last_peered":"2024-09-12T01:38:00.685418+0000","last_clean":"2024-09-12T01:38:00.685418+0000","last_became_active":"2024-09-12T00:28:37.220674+0000","last_became_peered":"2024-09-12T00:28:37.220674+0000","last_unstale":"2024-09-12T01:38:00.685418+0000","last_undegraded":"2024-09-12T01:38:00.685418+0000","last_fullsized":"2024-09-12T01:38:00.685418+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:29.407891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48847,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":575,"num_read_kb":1313,"num_write":464,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"263'738","reported_seq":4566,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.053880+0000","last_change":"2024-09-12T00:28:39.214151+0000","last_active":"2024-09-12T01:38:00.053880+0000","last_peered":"2024-09-12T01:38:00.053880+0000","last_clean":"2024-09-12T01:38:00.053880+0000","last_became_active":"2024-09-12T00:28:39.213871+0000","last_became_peered":"2024-09-12T00:28:39.213871+0000","last_unstale":"2024-09-12T01:38:00.053880+0000","last_undegraded":"2024-09-12T01:38:00.053880+0000","last_fullsized":"2024-09-12T01:38:00.053880+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":700,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:10.173214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"263'194","reported_seq":745,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:40.186256+0000","last_change":"2024-09-12T00:28:41.227781+0000","last_active":"2024-09-12T01:36:40.186256+0000","last_peered":"2024-09-12T01:36:40.186256+0000","last_clean":"2024-09-12T01:36:40.186256+0000","last_became_active":"2024-09-12T00:28:41.227310+0000","last_became_peered":"2024-09-12T00:28:41.227310+0000","last_unstale":"2024-09-12T01:36:40.186256+0000","last_undegraded":"2024-09-12T01:36:40.186256+0000","last_fullsized":"2024-09-12T01:36:40.186256+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:23.647466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1879,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":313,"num_read_kb":267,"num_write":467,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"263'134","reported_seq":758,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.533762+0000","last_change":"2024-09-12T00:28:33.211637+0000","last_active":"2024-09-12T01:33:51.533762+0000","last_peered":"2024-09-12T01:33:51.533762+0000","last_clean":"2024-09-12T01:33:51.533762+0000","last_became_active":"2024-09-12T00:28:33.211327+0000","last_became_peered":"2024-09-12T00:28:33.211327+0000","last_unstale":"2024-09-12T01:33:51.533762+0000","last_undegraded":"2024-09-12T01:33:51.533762+0000","last_fullsized":"2024-09-12T01:33:51.533762+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:57.179232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":621,"num_read_kb":525,"num_write":194,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"263'361","reported_seq":1059,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.544158+0000","last_change":"2024-09-12T00:28:31.202041+0000","last_active":"2024-09-12T01:38:01.544158+0000","last_peered":"2024-09-12T01:38:01.544158+0000","last_clean":"2024-09-12T01:38:01.544158+0000","last_became_active":"2024-09-12T00:28:31.201275+0000","last_became_peered":"2024-09-12T00:28:31.201275+0000","last_unstale":"2024-09-12T01:38:01.544158+0000","last_undegraded":"2024-09-12T01:38:01.544158+0000","last_fullsized":"2024-09-12T01:38:01.544158+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:04.675535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395916,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":631,"num_read_kb":30113,"num_write":1181,"num_write_kb":53346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1445,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.876592+0000","last_change":"2024-09-12T00:28:35.210438+0000","last_active":"2024-09-12T01:37:46.876592+0000","last_peered":"2024-09-12T01:37:46.876592+0000","last_clean":"2024-09-12T01:37:46.876592+0000","last_became_active":"2024-09-12T00:28:35.210173+0000","last_became_peered":"2024-09-12T00:28:35.210173+0000","last_unstale":"2024-09-12T01:37:46.876592+0000","last_undegraded":"2024-09-12T01:37:46.876592+0000","last_fullsized":"2024-09-12T01:37:46.876592+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:01.967609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":948,"num_read_kb":948,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"263'106","reported_seq":638,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:54.637565+0000","last_change":"2024-09-12T00:28:37.424197+0000","last_active":"2024-09-12T01:33:54.637565+0000","last_peered":"2024-09-12T01:33:54.637565+0000","last_clean":"2024-09-12T01:33:54.637565+0000","last_became_active":"2024-09-12T00:28:37.423847+0000","last_became_peered":"2024-09-12T00:28:37.423847+0000","last_unstale":"2024-09-12T01:33:54.637565+0000","last_undegraded":"2024-09-12T01:33:54.637565+0000","last_fullsized":"2024-09-12T01:33:54.637565+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:11.857170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":109,"num_read_kb":102,"num_write":74,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"263'759","reported_seq":2646,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.054967+0000","last_change":"2024-09-12T00:28:39.216574+0000","last_active":"2024-09-12T01:38:00.054967+0000","last_peered":"2024-09-12T01:38:00.054967+0000","last_clean":"2024-09-12T01:38:00.054967+0000","last_became_active":"2024-09-12T00:28:39.216244+0000","last_became_peered":"2024-09-12T00:28:39.216244+0000","last_unstale":"2024-09-12T01:38:00.054967+0000","last_undegraded":"2024-09-12T01:38:00.054967+0000","last_fullsized":"2024-09-12T01:38:00.054967+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":700,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:06.051077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"263'177","reported_seq":688,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:41.529420+0000","last_change":"2024-09-12T00:28:41.226032+0000","last_active":"2024-09-12T01:36:41.529420+0000","last_peered":"2024-09-12T01:36:41.529420+0000","last_clean":"2024-09-12T01:36:41.529420+0000","last_became_active":"2024-09-12T00:28:41.225728+0000","last_became_peered":"2024-09-12T00:28:41.225728+0000","last_unstale":"2024-09-12T01:36:41.529420+0000","last_undegraded":"2024-09-12T01:36:41.529420+0000","last_fullsized":"2024-09-12T01:36:41.529420+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:37.084319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":145,"num_write":308,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"263'4256","reported_seq":4857,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:58.613431+0000","last_change":"2024-09-12T00:28:33.206100+0000","last_active":"2024-09-12T01:33:58.613431+0000","last_peered":"2024-09-12T01:33:58.613431+0000","last_clean":"2024-09-12T01:33:58.613431+0000","last_became_active":"2024-09-12T00:28:33.205792+0000","last_became_peered":"2024-09-12T00:28:33.205792+0000","last_unstale":"2024-09-12T01:33:58.613431+0000","last_undegraded":"2024-09-12T01:33:58.613431+0000","last_fullsized":"2024-09-12T01:33:58.613431+0000","mapping_epoch":27,"log_start":"263'4200","ondisk_log_start":"263'4200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":3000,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:14.540790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17142,"num_read_kb":14400,"num_write":6430,"num_write_kb":3228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"263'314","reported_seq":1033,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:44.650323+0000","last_change":"2024-09-12T00:28:31.202748+0000","last_active":"2024-09-12T01:35:44.650323+0000","last_peered":"2024-09-12T01:35:44.650323+0000","last_clean":"2024-09-12T01:35:44.650323+0000","last_became_active":"2024-09-12T00:28:31.202456+0000","last_became_peered":"2024-09-12T00:28:31.202456+0000","last_unstale":"2024-09-12T01:35:44.650323+0000","last_undegraded":"2024-09-12T01:35:44.650323+0000","last_fullsized":"2024-09-12T01:35:44.650323+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:33.698882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9926443,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":589,"num_read_kb":78127,"num_write":1311,"num_write_kb":48684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.533751+0000","last_change":"2024-09-12T00:28:35.207665+0000","last_active":"2024-09-12T01:33:51.533751+0000","last_peered":"2024-09-12T01:33:51.533751+0000","last_clean":"2024-09-12T01:33:51.533751+0000","last_became_active":"2024-09-12T00:28:35.207343+0000","last_became_peered":"2024-09-12T00:28:35.207343+0000","last_unstale":"2024-09-12T01:33:51.533751+0000","last_undegraded":"2024-09-12T01:33:51.533751+0000","last_fullsized":"2024-09-12T01:33:51.533751+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:06.989902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"263'364","reported_seq":977,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:07.799351+0000","last_change":"2024-09-12T00:28:37.211454+0000","last_active":"2024-09-12T01:36:07.799351+0000","last_peered":"2024-09-12T01:36:07.799351+0000","last_clean":"2024-09-12T01:36:07.799351+0000","last_became_active":"2024-09-12T00:28:37.211090+0000","last_became_peered":"2024-09-12T00:28:37.211090+0000","last_unstale":"2024-09-12T01:36:07.799351+0000","last_undegraded":"2024-09-12T01:36:07.799351+0000","last_fullsized":"2024-09-12T01:36:07.799351+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:34:21.708434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57189,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":581,"num_read_kb":1095,"num_write":456,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.534269+0000","last_change":"2024-09-12T00:28:39.219992+0000","last_active":"2024-09-12T01:33:56.534269+0000","last_peered":"2024-09-12T01:33:56.534269+0000","last_clean":"2024-09-12T01:33:56.534269+0000","last_became_active":"2024-09-12T00:28:39.219687+0000","last_became_peered":"2024-09-12T00:28:39.219687+0000","last_unstale":"2024-09-12T01:33:56.534269+0000","last_undegraded":"2024-09-12T01:33:56.534269+0000","last_fullsized":"2024-09-12T01:33:56.534269+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:05.399679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"263'114","reported_seq":619,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:41.523331+0000","last_change":"2024-09-12T00:28:41.226379+0000","last_active":"2024-09-12T01:36:41.523331+0000","last_peered":"2024-09-12T01:36:41.523331+0000","last_clean":"2024-09-12T01:36:41.523331+0000","last_became_active":"2024-09-12T00:28:41.226049+0000","last_became_peered":"2024-09-12T00:28:41.226049+0000","last_unstale":"2024-09-12T01:36:41.523331+0000","last_undegraded":"2024-09-12T01:36:41.523331+0000","last_fullsized":"2024-09-12T01:36:41.523331+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:35.250632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":871,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":118,"num_read_kb":115,"num_write":279,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"263'144","reported_seq":778,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:31.547552+0000","last_change":"2024-09-12T00:28:33.214340+0000","last_active":"2024-09-12T01:35:31.547552+0000","last_peered":"2024-09-12T01:35:31.547552+0000","last_clean":"2024-09-12T01:35:31.547552+0000","last_became_active":"2024-09-12T00:28:33.214018+0000","last_became_peered":"2024-09-12T00:28:33.214018+0000","last_unstale":"2024-09-12T01:35:31.547552+0000","last_undegraded":"2024-09-12T01:35:31.547552+0000","last_fullsized":"2024-09-12T01:35:31.547552+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:53.550703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":636,"num_read_kb":544,"num_write":220,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":614,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:31.723989+0000","last_change":"2024-09-12T00:28:14.748208+0000","last_active":"2024-09-12T01:34:31.723989+0000","last_peered":"2024-09-12T01:34:31.723989+0000","last_clean":"2024-09-12T01:34:31.723989+0000","last_became_active":"2024-09-12T00:28:14.744766+0000","last_became_peered":"2024-09-12T00:28:14.744766+0000","last_unstale":"2024-09-12T01:34:31.723989+0000","last_undegraded":"2024-09-12T01:34:31.723989+0000","last_fullsized":"2024-09-12T01:34:31.723989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:13.107271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:13.107271+0000","last_clean_scrub_stamp":"2024-09-12T00:28:13.107271+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:46.810948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"21'1","reported_seq":522,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:02.789773+0000","last_change":"2024-09-12T00:28:21.169710+0000","last_active":"2024-09-12T01:35:02.789773+0000","last_peered":"2024-09-12T01:35:02.789773+0000","last_clean":"2024-09-12T01:35:02.789773+0000","last_became_active":"2024-09-12T00:28:19.162328+0000","last_became_peered":"2024-09-12T00:28:19.162328+0000","last_unstale":"2024-09-12T01:35:02.789773+0000","last_undegraded":"2024-09-12T01:35:02.789773+0000","last_fullsized":"2024-09-12T01:35:02.789773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_clean_scrub_stamp":"2024-09-12T00:28:18.139537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:10.146909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046717800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"263'264","reported_seq":905,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:14.646937+0000","last_change":"2024-09-12T00:28:31.215764+0000","last_active":"2024-09-12T01:35:14.646937+0000","last_peered":"2024-09-12T01:35:14.646937+0000","last_clean":"2024-09-12T01:35:14.646937+0000","last_became_active":"2024-09-12T00:28:31.215485+0000","last_became_peered":"2024-09-12T00:28:31.215485+0000","last_unstale":"2024-09-12T01:35:14.646937+0000","last_undegraded":"2024-09-12T01:35:14.646937+0000","last_fullsized":"2024-09-12T01:35:14.646937+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:18.448556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16203515,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":406,"num_read_kb":39194,"num_write":1039,"num_write_kb":25197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.731330+0000","last_change":"2024-09-12T00:28:35.209125+0000","last_active":"2024-09-12T01:35:16.731330+0000","last_peered":"2024-09-12T01:35:16.731330+0000","last_clean":"2024-09-12T01:35:16.731330+0000","last_became_active":"2024-09-12T00:28:35.208812+0000","last_became_peered":"2024-09-12T00:28:35.208812+0000","last_unstale":"2024-09-12T01:35:16.731330+0000","last_undegraded":"2024-09-12T01:35:16.731330+0000","last_fullsized":"2024-09-12T01:35:16.731330+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:01.363469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"263'732","reported_seq":1432,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:47.138248+0000","last_change":"2024-09-12T00:28:37.221326+0000","last_active":"2024-09-12T01:37:47.138248+0000","last_peered":"2024-09-12T01:37:47.138248+0000","last_clean":"2024-09-12T01:37:47.138248+0000","last_became_active":"2024-09-12T00:28:37.221001+0000","last_became_peered":"2024-09-12T00:28:37.221001+0000","last_unstale":"2024-09-12T01:37:47.138248+0000","last_undegraded":"2024-09-12T01:37:47.138248+0000","last_fullsized":"2024-09-12T01:37:47.138248+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":700,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:20.998547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167007,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1417,"num_read_kb":3020,"num_write":1346,"num_write_kb":1186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:51.797587+0000","last_change":"2024-09-12T00:28:39.221623+0000","last_active":"2024-09-12T01:35:51.797587+0000","last_peered":"2024-09-12T01:35:51.797587+0000","last_clean":"2024-09-12T01:35:51.797587+0000","last_became_active":"2024-09-12T00:28:39.221007+0000","last_became_peered":"2024-09-12T00:28:39.221007+0000","last_unstale":"2024-09-12T01:35:51.797587+0000","last_undegraded":"2024-09-12T01:35:51.797587+0000","last_fullsized":"2024-09-12T01:35:51.797587+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:49.965506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"263'186","reported_seq":885,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:42.615741+0000","last_change":"2024-09-12T00:28:41.226364+0000","last_active":"2024-09-12T01:36:42.615741+0000","last_peered":"2024-09-12T01:36:42.615741+0000","last_clean":"2024-09-12T01:36:42.615741+0000","last_became_active":"2024-09-12T00:28:41.226077+0000","last_became_peered":"2024-09-12T00:28:41.226077+0000","last_unstale":"2024-09-12T01:36:42.615741+0000","last_undegraded":"2024-09-12T01:36:42.615741+0000","last_fullsized":"2024-09-12T01:36:42.615741+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:54.387034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":407,"num_read_kb":405,"num_write":366,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"263'200","reported_seq":809,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.797044+0000","last_change":"2024-09-12T00:28:33.214619+0000","last_active":"2024-09-12T01:35:46.797044+0000","last_peered":"2024-09-12T01:35:46.797044+0000","last_clean":"2024-09-12T01:35:46.797044+0000","last_became_active":"2024-09-12T00:28:33.214351+0000","last_became_peered":"2024-09-12T00:28:33.214351+0000","last_unstale":"2024-09-12T01:35:46.797044+0000","last_undegraded":"2024-09-12T01:35:46.797044+0000","last_fullsized":"2024-09-12T01:35:46.797044+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:27.014128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":877,"num_read_kb":731,"num_write":291,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.724871+0000","last_change":"2024-09-12T00:28:21.165739+0000","last_active":"2024-09-12T01:34:36.724871+0000","last_peered":"2024-09-12T01:34:36.724871+0000","last_clean":"2024-09-12T01:34:36.724871+0000","last_became_active":"2024-09-12T00:28:19.164970+0000","last_became_peered":"2024-09-12T00:28:19.164970+0000","last_unstale":"2024-09-12T01:34:36.724871+0000","last_undegraded":"2024-09-12T01:34:36.724871+0000","last_fullsized":"2024-09-12T01:34:36.724871+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_clean_scrub_stamp":"2024-09-12T00:28:18.139537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:32.778181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055291100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"263'372","reported_seq":1104,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.731893+0000","last_change":"2024-09-12T00:28:31.205110+0000","last_active":"2024-09-12T01:38:01.731893+0000","last_peered":"2024-09-12T01:38:01.731893+0000","last_clean":"2024-09-12T01:38:01.731893+0000","last_became_active":"2024-09-12T00:28:31.204842+0000","last_became_peered":"2024-09-12T00:28:31.204842+0000","last_unstale":"2024-09-12T01:38:01.731893+0000","last_undegraded":"2024-09-12T01:38:01.731893+0000","last_fullsized":"2024-09-12T01:38:01.731893+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:16.741760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":699,"num_read_kb":44079,"num_write":1206,"num_write_kb":29123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:47.796159+0000","last_change":"2024-09-12T00:28:35.216312+0000","last_active":"2024-09-12T01:35:47.796159+0000","last_peered":"2024-09-12T01:35:47.796159+0000","last_clean":"2024-09-12T01:35:47.796159+0000","last_became_active":"2024-09-12T00:28:35.215063+0000","last_became_peered":"2024-09-12T00:28:35.215063+0000","last_unstale":"2024-09-12T01:35:47.796159+0000","last_undegraded":"2024-09-12T01:35:47.796159+0000","last_fullsized":"2024-09-12T01:35:47.796159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:30.514762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"263'1343","reported_seq":3122,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:49.932054+0000","last_change":"2024-09-12T00:28:37.211623+0000","last_active":"2024-09-12T01:37:49.932054+0000","last_peered":"2024-09-12T01:37:49.932054+0000","last_clean":"2024-09-12T01:37:49.932054+0000","last_became_active":"2024-09-12T00:28:37.211275+0000","last_became_peered":"2024-09-12T00:28:37.211275+0000","last_unstale":"2024-09-12T01:37:49.932054+0000","last_undegraded":"2024-09-12T01:37:49.932054+0000","last_fullsized":"2024-09-12T01:37:49.932054+0000","mapping_epoch":31,"log_start":"263'1300","ondisk_log_start":"263'1300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":1300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:17.542912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188900,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2142,"num_read_kb":3861,"num_write":1272,"num_write_kb":1085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:36.734401+0000","last_change":"2024-09-12T00:28:39.217983+0000","last_active":"2024-09-12T01:35:36.734401+0000","last_peered":"2024-09-12T01:35:36.734401+0000","last_clean":"2024-09-12T01:35:36.734401+0000","last_became_active":"2024-09-12T00:28:39.217623+0000","last_became_peered":"2024-09-12T00:28:39.217623+0000","last_unstale":"2024-09-12T01:35:36.734401+0000","last_undegraded":"2024-09-12T01:35:36.734401+0000","last_fullsized":"2024-09-12T01:35:36.734401+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:06.473217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"263'261","reported_seq":805,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:13.164033+0000","last_change":"2024-09-12T00:28:41.255226+0000","last_active":"2024-09-12T01:36:13.164033+0000","last_peered":"2024-09-12T01:36:13.164033+0000","last_clean":"2024-09-12T01:36:13.164033+0000","last_became_active":"2024-09-12T00:28:41.254814+0000","last_became_peered":"2024-09-12T00:28:41.254814+0000","last_unstale":"2024-09-12T01:36:13.164033+0000","last_undegraded":"2024-09-12T01:36:13.164033+0000","last_fullsized":"2024-09-12T01:36:13.164033+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:30.223844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":416,"num_read_kb":400,"num_write":581,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"263'116","reported_seq":754,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.948067+0000","last_change":"2024-09-12T00:28:33.216657+0000","last_active":"2024-09-12T01:35:46.948067+0000","last_peered":"2024-09-12T01:35:46.948067+0000","last_clean":"2024-09-12T01:35:46.948067+0000","last_became_active":"2024-09-12T00:28:33.216335+0000","last_became_peered":"2024-09-12T00:28:33.216335+0000","last_unstale":"2024-09-12T01:35:46.948067+0000","last_undegraded":"2024-09-12T01:35:46.948067+0000","last_fullsized":"2024-09-12T01:35:46.948067+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:46.854089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":537,"num_read_kb":460,"num_write":159,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":528,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:01.533662+0000","last_change":"2024-09-12T00:28:21.323944+0000","last_active":"2024-09-12T01:35:01.533662+0000","last_peered":"2024-09-12T01:35:01.533662+0000","last_clean":"2024-09-12T01:35:01.533662+0000","last_became_active":"2024-09-12T00:28:19.225901+0000","last_became_peered":"2024-09-12T00:28:19.225901+0000","last_unstale":"2024-09-12T01:35:01.533662+0000","last_undegraded":"2024-09-12T01:35:01.533662+0000","last_fullsized":"2024-09-12T01:35:01.533662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_clean_scrub_stamp":"2024-09-12T00:28:18.139537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:52.557475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032319500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"263'272","reported_seq":1071,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:45.210107+0000","last_change":"2024-09-12T00:28:31.198866+0000","last_active":"2024-09-12T01:37:45.210107+0000","last_peered":"2024-09-12T01:37:45.210107+0000","last_clean":"2024-09-12T01:37:45.210107+0000","last_became_active":"2024-09-12T00:28:31.198575+0000","last_became_peered":"2024-09-12T00:28:31.198575+0000","last_unstale":"2024-09-12T01:37:45.210107+0000","last_undegraded":"2024-09-12T01:37:45.210107+0000","last_fullsized":"2024-09-12T01:37:45.210107+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:05.185444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14429172,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":767,"num_read_kb":78199,"num_write":1008,"num_write_kb":40255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.538695+0000","last_change":"2024-09-12T00:28:35.209485+0000","last_active":"2024-09-12T01:35:46.538695+0000","last_peered":"2024-09-12T01:35:46.538695+0000","last_clean":"2024-09-12T01:35:46.538695+0000","last_became_active":"2024-09-12T00:28:35.209218+0000","last_became_peered":"2024-09-12T00:28:35.209218+0000","last_unstale":"2024-09-12T01:35:46.538695+0000","last_undegraded":"2024-09-12T01:35:46.538695+0000","last_fullsized":"2024-09-12T01:35:46.538695+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:55.033156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"263'279","reported_seq":1658,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:43.275282+0000","last_change":"2024-09-12T00:28:37.424055+0000","last_active":"2024-09-12T01:37:43.275282+0000","last_peered":"2024-09-12T01:37:43.275282+0000","last_clean":"2024-09-12T01:37:43.275282+0000","last_became_active":"2024-09-12T00:28:37.423714+0000","last_became_peered":"2024-09-12T00:28:37.423714+0000","last_unstale":"2024-09-12T01:37:43.275282+0000","last_undegraded":"2024-09-12T01:37:43.275282+0000","last_fullsized":"2024-09-12T01:37:43.275282+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:07.336278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":244,"num_read_kb":234,"num_write":227,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:21.793908+0000","last_change":"2024-09-12T00:28:39.218980+0000","last_active":"2024-09-12T01:35:21.793908+0000","last_peered":"2024-09-12T01:35:21.793908+0000","last_clean":"2024-09-12T01:35:21.793908+0000","last_became_active":"2024-09-12T00:28:39.218692+0000","last_became_peered":"2024-09-12T00:28:39.218692+0000","last_unstale":"2024-09-12T01:35:21.793908+0000","last_undegraded":"2024-09-12T01:35:21.793908+0000","last_fullsized":"2024-09-12T01:35:21.793908+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:07.969643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"263'252","reported_seq":855,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:45.936486+0000","last_change":"2024-09-12T00:28:41.229721+0000","last_active":"2024-09-12T01:37:45.936486+0000","last_peered":"2024-09-12T01:37:45.936486+0000","last_clean":"2024-09-12T01:37:45.936486+0000","last_became_active":"2024-09-12T00:28:41.229441+0000","last_became_peered":"2024-09-12T00:28:41.229441+0000","last_unstale":"2024-09-12T01:37:45.936486+0000","last_undegraded":"2024-09-12T01:37:45.936486+0000","last_fullsized":"2024-09-12T01:37:45.936486+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:46.056278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":487,"num_read_kb":509,"num_write":546,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"263'223","reported_seq":896,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:58.635373+0000","last_change":"2024-09-12T00:28:33.205511+0000","last_active":"2024-09-12T01:35:58.635373+0000","last_peered":"2024-09-12T01:35:58.635373+0000","last_clean":"2024-09-12T01:35:58.635373+0000","last_became_active":"2024-09-12T00:28:33.205107+0000","last_became_peered":"2024-09-12T00:28:33.205107+0000","last_unstale":"2024-09-12T01:35:58.635373+0000","last_undegraded":"2024-09-12T01:35:58.635373+0000","last_fullsized":"2024-09-12T01:35:58.635373+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:39.413290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1021,"num_read_kb":847,"num_write":335,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"23'2","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:02.789730+0000","last_change":"2024-09-12T00:28:21.170135+0000","last_active":"2024-09-12T01:35:02.789730+0000","last_peered":"2024-09-12T01:35:02.789730+0000","last_clean":"2024-09-12T01:35:02.789730+0000","last_became_active":"2024-09-12T00:28:19.162307+0000","last_became_peered":"2024-09-12T00:28:19.162307+0000","last_unstale":"2024-09-12T01:35:02.789730+0000","last_undegraded":"2024-09-12T01:35:02.789730+0000","last_fullsized":"2024-09-12T01:35:02.789730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_clean_scrub_stamp":"2024-09-12T00:28:18.139537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:21.559693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089189499999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"263'346","reported_seq":1030,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.522162+0000","last_change":"2024-09-12T00:28:31.208859+0000","last_active":"2024-09-12T01:38:01.522162+0000","last_peered":"2024-09-12T01:38:01.522162+0000","last_clean":"2024-09-12T01:38:01.522162+0000","last_became_active":"2024-09-12T00:28:31.208584+0000","last_became_peered":"2024-09-12T00:28:31.208584+0000","last_unstale":"2024-09-12T01:38:01.522162+0000","last_undegraded":"2024-09-12T01:38:01.522162+0000","last_fullsized":"2024-09-12T01:38:01.522162+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:48.765543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":266336,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":632,"num_read_kb":7750,"num_write":1113,"num_write_kb":19514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:26.794599+0000","last_change":"2024-09-12T00:28:35.207488+0000","last_active":"2024-09-12T01:35:26.794599+0000","last_peered":"2024-09-12T01:35:26.794599+0000","last_clean":"2024-09-12T01:35:26.794599+0000","last_became_active":"2024-09-12T00:28:35.207234+0000","last_became_peered":"2024-09-12T00:28:35.207234+0000","last_unstale":"2024-09-12T01:35:26.794599+0000","last_undegraded":"2024-09-12T01:35:26.794599+0000","last_fullsized":"2024-09-12T01:35:26.794599+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:43.759273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"263'160","reported_seq":717,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:47.314594+0000","last_change":"2024-09-12T00:28:37.219924+0000","last_active":"2024-09-12T01:37:47.314594+0000","last_peered":"2024-09-12T01:37:47.314594+0000","last_clean":"2024-09-12T01:37:47.314594+0000","last_became_active":"2024-09-12T00:28:37.219599+0000","last_became_peered":"2024-09-12T00:28:37.219599+0000","last_unstale":"2024-09-12T01:37:47.314594+0000","last_undegraded":"2024-09-12T01:37:47.314594+0000","last_fullsized":"2024-09-12T01:37:47.314594+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:19.639653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":184,"num_read_kb":176,"num_write":136,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:51.550499+0000","last_change":"2024-09-12T00:28:39.216740+0000","last_active":"2024-09-12T01:35:51.550499+0000","last_peered":"2024-09-12T01:35:51.550499+0000","last_clean":"2024-09-12T01:35:51.550499+0000","last_became_active":"2024-09-12T00:28:39.216397+0000","last_became_peered":"2024-09-12T00:28:39.216397+0000","last_unstale":"2024-09-12T01:35:51.550499+0000","last_undegraded":"2024-09-12T01:35:51.550499+0000","last_fullsized":"2024-09-12T01:35:51.550499+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:48.659805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"263'110","reported_seq":654,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:42.778344+0000","last_change":"2024-09-12T00:28:41.230939+0000","last_active":"2024-09-12T01:33:42.778344+0000","last_peered":"2024-09-12T01:33:42.778344+0000","last_clean":"2024-09-12T01:33:42.778344+0000","last_became_active":"2024-09-12T00:28:41.230698+0000","last_became_peered":"2024-09-12T00:28:41.230698+0000","last_unstale":"2024-09-12T01:33:42.778344+0000","last_undegraded":"2024-09-12T01:33:42.778344+0000","last_fullsized":"2024-09-12T01:33:42.778344+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:35.474853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":194,"num_write":246,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"263'101","reported_seq":687,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.944551+0000","last_change":"2024-09-12T00:28:33.214613+0000","last_active":"2024-09-12T01:35:16.944551+0000","last_peered":"2024-09-12T01:35:16.944551+0000","last_clean":"2024-09-12T01:35:16.944551+0000","last_became_active":"2024-09-12T00:28:33.213241+0000","last_became_peered":"2024-09-12T00:28:33.213241+0000","last_unstale":"2024-09-12T01:35:16.944551+0000","last_undegraded":"2024-09-12T01:35:16.944551+0000","last_fullsized":"2024-09-12T01:35:16.944551+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:03.213237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":440,"num_read_kb":364,"num_write":181,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"263'260","reported_seq":876,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:28.765614+0000","last_change":"2024-09-12T00:28:31.209668+0000","last_active":"2024-09-12T01:35:28.765614+0000","last_peered":"2024-09-12T01:35:28.765614+0000","last_clean":"2024-09-12T01:35:28.765614+0000","last_became_active":"2024-09-12T00:28:31.209154+0000","last_became_peered":"2024-09-12T00:28:31.209154+0000","last_unstale":"2024-09-12T01:35:28.765614+0000","last_undegraded":"2024-09-12T01:35:28.765614+0000","last_fullsized":"2024-09-12T01:35:28.765614+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:20.428733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":924838,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":376,"num_read_kb":910,"num_write":940,"num_write_kb":5944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":533,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:01.942757+0000","last_change":"2024-09-12T00:28:21.163542+0000","last_active":"2024-09-12T01:35:01.942757+0000","last_peered":"2024-09-12T01:35:01.942757+0000","last_clean":"2024-09-12T01:35:01.942757+0000","last_became_active":"2024-09-12T00:28:19.383394+0000","last_became_peered":"2024-09-12T00:28:19.383394+0000","last_unstale":"2024-09-12T01:35:01.942757+0000","last_undegraded":"2024-09-12T01:35:01.942757+0000","last_fullsized":"2024-09-12T01:35:01.942757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_clean_scrub_stamp":"2024-09-12T00:28:18.139537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:28.230151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046548800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.793286+0000","last_change":"2024-09-12T00:28:35.208415+0000","last_active":"2024-09-12T01:35:16.793286+0000","last_peered":"2024-09-12T01:35:16.793286+0000","last_clean":"2024-09-12T01:35:16.793286+0000","last_became_active":"2024-09-12T00:28:35.208094+0000","last_became_peered":"2024-09-12T00:28:35.208094+0000","last_unstale":"2024-09-12T01:35:16.793286+0000","last_undegraded":"2024-09-12T01:35:16.793286+0000","last_fullsized":"2024-09-12T01:35:16.793286+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:03.328037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"263'655","reported_seq":1348,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.420767+0000","last_change":"2024-09-12T00:28:37.221025+0000","last_active":"2024-09-12T01:38:01.420767+0000","last_peered":"2024-09-12T01:38:01.420767+0000","last_clean":"2024-09-12T01:38:01.420767+0000","last_became_active":"2024-09-12T00:28:37.220158+0000","last_became_peered":"2024-09-12T00:28:37.220158+0000","last_unstale":"2024-09-12T01:38:01.420767+0000","last_undegraded":"2024-09-12T01:38:01.420767+0000","last_fullsized":"2024-09-12T01:38:01.420767+0000","mapping_epoch":31,"log_start":"263'600","ondisk_log_start":"263'600","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":600,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:50.143092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103952,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1701,"num_read_kb":3039,"num_write":2184,"num_write_kb":1992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:21.546179+0000","last_change":"2024-09-12T00:28:39.220506+0000","last_active":"2024-09-12T01:35:21.546179+0000","last_peered":"2024-09-12T01:35:21.546179+0000","last_clean":"2024-09-12T01:35:21.546179+0000","last_became_active":"2024-09-12T00:28:39.220079+0000","last_became_peered":"2024-09-12T00:28:39.220079+0000","last_unstale":"2024-09-12T01:35:21.546179+0000","last_undegraded":"2024-09-12T01:35:21.546179+0000","last_fullsized":"2024-09-12T01:35:21.546179+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:23.654340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"263'134","reported_seq":653,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.800037+0000","last_change":"2024-09-12T00:28:41.258045+0000","last_active":"2024-09-12T01:36:11.800037+0000","last_peered":"2024-09-12T01:36:11.800037+0000","last_clean":"2024-09-12T01:36:11.800037+0000","last_became_active":"2024-09-12T00:28:41.257739+0000","last_became_peered":"2024-09-12T00:28:41.257739+0000","last_unstale":"2024-09-12T01:36:11.800037+0000","last_undegraded":"2024-09-12T01:36:11.800037+0000","last_fullsized":"2024-09-12T01:36:11.800037+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:03.828940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":203,"num_read_kb":182,"num_write":334,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"263'142","reported_seq":775,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.793315+0000","last_change":"2024-09-12T00:28:33.216340+0000","last_active":"2024-09-12T01:35:16.793315+0000","last_peered":"2024-09-12T01:35:16.793315+0000","last_clean":"2024-09-12T01:35:16.793315+0000","last_became_active":"2024-09-12T00:28:33.216065+0000","last_became_peered":"2024-09-12T00:28:33.216065+0000","last_unstale":"2024-09-12T01:35:16.793315+0000","last_undegraded":"2024-09-12T01:35:16.793315+0000","last_fullsized":"2024-09-12T01:35:16.793315+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:28.642231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":614,"num_read_kb":525,"num_write":208,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"263'263","reported_seq":923,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:18.191774+0000","last_change":"2024-09-12T00:28:31.199416+0000","last_active":"2024-09-12T01:35:18.191774+0000","last_peered":"2024-09-12T01:35:18.191774+0000","last_clean":"2024-09-12T01:35:18.191774+0000","last_became_active":"2024-09-12T00:28:31.198681+0000","last_became_peered":"2024-09-12T00:28:31.198681+0000","last_unstale":"2024-09-12T01:35:18.191774+0000","last_undegraded":"2024-09-12T01:35:18.191774+0000","last_fullsized":"2024-09-12T01:35:18.191774+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:11.597114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5837932,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":405,"num_read_kb":38180,"num_write":974,"num_write_kb":26889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":522,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.731345+0000","last_change":"2024-09-12T00:28:21.165802+0000","last_active":"2024-09-12T01:35:16.731345+0000","last_peered":"2024-09-12T01:35:16.731345+0000","last_clean":"2024-09-12T01:35:16.731345+0000","last_became_active":"2024-09-12T00:28:19.384222+0000","last_became_peered":"2024-09-12T00:28:19.384222+0000","last_unstale":"2024-09-12T01:35:16.731345+0000","last_undegraded":"2024-09-12T01:35:16.731345+0000","last_fullsized":"2024-09-12T01:35:16.731345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_clean_scrub_stamp":"2024-09-12T00:28:18.139537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:40.635892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060999899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"37'5","reported_seq":982,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:59.821892+0000","last_change":"2024-09-12T00:28:35.208566+0000","last_active":"2024-09-12T01:37:59.821892+0000","last_peered":"2024-09-12T01:37:59.821892+0000","last_clean":"2024-09-12T01:37:59.821892+0000","last_became_active":"2024-09-12T00:28:35.207941+0000","last_became_peered":"2024-09-12T00:28:35.207941+0000","last_unstale":"2024-09-12T01:37:59.821892+0000","last_undegraded":"2024-09-12T01:37:59.821892+0000","last_fullsized":"2024-09-12T01:37:59.821892+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:30.697798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":1191,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"263'246","reported_seq":839,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:48.927414+0000","last_change":"2024-09-12T00:28:37.424197+0000","last_active":"2024-09-12T01:36:48.927414+0000","last_peered":"2024-09-12T01:36:48.927414+0000","last_clean":"2024-09-12T01:36:48.927414+0000","last_became_active":"2024-09-12T00:28:37.423835+0000","last_became_peered":"2024-09-12T00:28:37.423835+0000","last_unstale":"2024-09-12T01:36:48.927414+0000","last_undegraded":"2024-09-12T01:36:48.927414+0000","last_fullsized":"2024-09-12T01:36:48.927414+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:55.348547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":310,"num_read_kb":301,"num_write":288,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"263'776","reported_seq":2891,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:49.977782+0000","last_change":"2024-09-12T00:28:39.214336+0000","last_active":"2024-09-12T01:37:49.977782+0000","last_peered":"2024-09-12T01:37:49.977782+0000","last_clean":"2024-09-12T01:37:49.977782+0000","last_became_active":"2024-09-12T00:28:39.214050+0000","last_became_peered":"2024-09-12T00:28:39.214050+0000","last_unstale":"2024-09-12T01:37:49.977782+0000","last_undegraded":"2024-09-12T01:37:49.977782+0000","last_fullsized":"2024-09-12T01:37:49.977782+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:42.935841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"263'143","reported_seq":656,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:29.656020+0000","last_change":"2024-09-12T00:28:41.255145+0000","last_active":"2024-09-12T01:36:29.656020+0000","last_peered":"2024-09-12T01:36:29.656020+0000","last_clean":"2024-09-12T01:36:29.656020+0000","last_became_active":"2024-09-12T00:28:41.254826+0000","last_became_peered":"2024-09-12T00:28:41.254826+0000","last_unstale":"2024-09-12T01:36:29.656020+0000","last_undegraded":"2024-09-12T01:36:29.656020+0000","last_fullsized":"2024-09-12T01:36:29.656020+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:08.523605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1298,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":177,"num_read_kb":162,"num_write":341,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"263'307","reported_seq":910,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:37.788688+0000","last_change":"2024-09-12T00:28:33.217822+0000","last_active":"2024-09-12T01:35:37.788688+0000","last_peered":"2024-09-12T01:35:37.788688+0000","last_clean":"2024-09-12T01:35:37.788688+0000","last_became_active":"2024-09-12T00:28:33.217516+0000","last_became_peered":"2024-09-12T00:28:33.217516+0000","last_unstale":"2024-09-12T01:35:37.788688+0000","last_undegraded":"2024-09-12T01:35:37.788688+0000","last_fullsized":"2024-09-12T01:35:37.788688+0000","mapping_epoch":27,"log_start":"260'200","ondisk_log_start":"260'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:49.139392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1312,"num_read_kb":1045,"num_write":501,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"263'242","reported_seq":836,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:44.650445+0000","last_change":"2024-09-12T00:28:31.203440+0000","last_active":"2024-09-12T01:35:44.650445+0000","last_peered":"2024-09-12T01:35:44.650445+0000","last_clean":"2024-09-12T01:35:44.650445+0000","last_became_active":"2024-09-12T00:28:31.202895+0000","last_became_peered":"2024-09-12T00:28:31.202895+0000","last_unstale":"2024-09-12T01:35:44.650445+0000","last_undegraded":"2024-09-12T01:35:44.650445+0000","last_fullsized":"2024-09-12T01:35:44.650445+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:43.468294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5508333,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":302,"num_read_kb":358,"num_write":890,"num_write_kb":25812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":532,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:31.946415+0000","last_change":"2024-09-12T00:28:21.163585+0000","last_active":"2024-09-12T01:35:31.946415+0000","last_peered":"2024-09-12T01:35:31.946415+0000","last_clean":"2024-09-12T01:35:31.946415+0000","last_became_active":"2024-09-12T00:28:19.160344+0000","last_became_peered":"2024-09-12T00:28:19.160344+0000","last_unstale":"2024-09-12T01:35:31.946415+0000","last_undegraded":"2024-09-12T01:35:31.946415+0000","last_fullsized":"2024-09-12T01:35:31.946415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_clean_scrub_stamp":"2024-09-12T00:28:18.139537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:57.842057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000483707,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.545492+0000","last_change":"2024-09-12T00:28:35.215757+0000","last_active":"2024-09-12T01:35:16.545492+0000","last_peered":"2024-09-12T01:35:16.545492+0000","last_clean":"2024-09-12T01:35:16.545492+0000","last_became_active":"2024-09-12T00:28:35.215429+0000","last_became_peered":"2024-09-12T00:28:35.215429+0000","last_unstale":"2024-09-12T01:35:16.545492+0000","last_undegraded":"2024-09-12T01:35:16.545492+0000","last_fullsized":"2024-09-12T01:35:16.545492+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:04.938748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"263'130","reported_seq":687,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.545524+0000","last_change":"2024-09-12T00:28:37.220271+0000","last_active":"2024-09-12T01:35:16.545524+0000","last_peered":"2024-09-12T01:35:16.545524+0000","last_clean":"2024-09-12T01:35:16.545524+0000","last_became_active":"2024-09-12T00:28:37.219746+0000","last_became_peered":"2024-09-12T00:28:37.219746+0000","last_unstale":"2024-09-12T01:35:16.545524+0000","last_undegraded":"2024-09-12T01:35:16.545524+0000","last_fullsized":"2024-09-12T01:35:16.545524+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:18.690666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":158,"num_read_kb":152,"num_write":104,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"263'764","reported_seq":2679,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:49.984028+0000","last_change":"2024-09-12T00:28:39.218435+0000","last_active":"2024-09-12T01:37:49.984028+0000","last_peered":"2024-09-12T01:37:49.984028+0000","last_clean":"2024-09-12T01:37:49.984028+0000","last_became_active":"2024-09-12T00:28:39.218170+0000","last_became_peered":"2024-09-12T00:28:39.218170+0000","last_unstale":"2024-09-12T01:37:49.984028+0000","last_undegraded":"2024-09-12T01:37:49.984028+0000","last_fullsized":"2024-09-12T01:37:49.984028+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":700,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:17.381935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"263'181","reported_seq":680,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.783783+0000","last_change":"2024-09-12T00:28:41.225659+0000","last_active":"2024-09-12T01:33:56.783783+0000","last_peered":"2024-09-12T01:33:56.783783+0000","last_clean":"2024-09-12T01:33:56.783783+0000","last_became_active":"2024-09-12T00:28:41.225316+0000","last_became_peered":"2024-09-12T00:28:41.225316+0000","last_unstale":"2024-09-12T01:33:56.783783+0000","last_undegraded":"2024-09-12T01:33:56.783783+0000","last_fullsized":"2024-09-12T01:33:56.783783+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:54.404729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":127,"num_read_kb":125,"num_write":428,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"263'342","reported_seq":978,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:20.408095+0000","last_change":"2024-09-12T00:28:33.212942+0000","last_active":"2024-09-12T01:36:20.408095+0000","last_peered":"2024-09-12T01:36:20.408095+0000","last_clean":"2024-09-12T01:36:20.408095+0000","last_became_active":"2024-09-12T00:28:33.212624+0000","last_became_peered":"2024-09-12T00:28:33.212624+0000","last_unstale":"2024-09-12T01:36:20.408095+0000","last_undegraded":"2024-09-12T01:36:20.408095+0000","last_fullsized":"2024-09-12T01:36:20.408095+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:49.030957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1481,"num_read_kb":1196,"num_write":544,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"263'449","reported_seq":1164,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.751547+0000","last_change":"2024-09-12T00:28:31.203441+0000","last_active":"2024-09-12T01:38:01.751547+0000","last_peered":"2024-09-12T01:38:01.751547+0000","last_clean":"2024-09-12T01:38:01.751547+0000","last_became_active":"2024-09-12T00:28:31.203087+0000","last_became_peered":"2024-09-12T00:28:31.203087+0000","last_unstale":"2024-09-12T01:38:01.751547+0000","last_undegraded":"2024-09-12T01:38:01.751547+0000","last_fullsized":"2024-09-12T01:38:01.751547+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:34.969519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":607243,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":857,"num_read_kb":36686,"num_write":1272,"num_write_kb":31229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:31.547584+0000","last_change":"2024-09-12T00:28:21.324169+0000","last_active":"2024-09-12T01:35:31.547584+0000","last_peered":"2024-09-12T01:35:31.547584+0000","last_clean":"2024-09-12T01:35:31.547584+0000","last_became_active":"2024-09-12T00:28:19.162886+0000","last_became_peered":"2024-09-12T00:28:19.162886+0000","last_unstale":"2024-09-12T01:35:31.547584+0000","last_undegraded":"2024-09-12T01:35:31.547584+0000","last_fullsized":"2024-09-12T01:35:31.547584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_clean_scrub_stamp":"2024-09-12T00:28:18.139537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:37.883634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044054899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:49.643998+0000","last_change":"2024-09-12T00:28:35.213217+0000","last_active":"2024-09-12T01:34:49.643998+0000","last_peered":"2024-09-12T01:34:49.643998+0000","last_clean":"2024-09-12T01:34:49.643998+0000","last_became_active":"2024-09-12T00:28:35.212916+0000","last_became_peered":"2024-09-12T00:28:35.212916+0000","last_unstale":"2024-09-12T01:34:49.643998+0000","last_undegraded":"2024-09-12T01:34:49.643998+0000","last_fullsized":"2024-09-12T01:34:49.643998+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:29.058758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"263'763","reported_seq":1501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.569644+0000","last_change":"2024-09-12T00:28:37.424089+0000","last_active":"2024-09-12T01:38:01.569644+0000","last_peered":"2024-09-12T01:38:01.569644+0000","last_clean":"2024-09-12T01:38:01.569644+0000","last_became_active":"2024-09-12T00:28:37.423755+0000","last_became_peered":"2024-09-12T00:28:37.423755+0000","last_unstale":"2024-09-12T01:38:01.569644+0000","last_undegraded":"2024-09-12T01:38:01.569644+0000","last_fullsized":"2024-09-12T01:38:01.569644+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:34.013923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138292,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1365,"num_read_kb":3277,"num_write":1104,"num_write_kb":888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:19.647506+0000","last_change":"2024-09-12T00:28:39.216520+0000","last_active":"2024-09-12T01:35:19.647506+0000","last_peered":"2024-09-12T01:35:19.647506+0000","last_clean":"2024-09-12T01:35:19.647506+0000","last_became_active":"2024-09-12T00:28:39.216237+0000","last_became_peered":"2024-09-12T00:28:39.216237+0000","last_unstale":"2024-09-12T01:35:19.647506+0000","last_undegraded":"2024-09-12T01:35:19.647506+0000","last_fullsized":"2024-09-12T01:35:19.647506+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:00.630922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"263'83","reported_seq":575,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:57.780634+0000","last_change":"2024-09-12T00:28:41.234000+0000","last_active":"2024-09-12T01:33:57.780634+0000","last_peered":"2024-09-12T01:33:57.780634+0000","last_clean":"2024-09-12T01:33:57.780634+0000","last_became_active":"2024-09-12T00:28:41.233696+0000","last_became_peered":"2024-09-12T00:28:41.233696+0000","last_unstale":"2024-09-12T01:33:57.780634+0000","last_undegraded":"2024-09-12T01:33:57.780634+0000","last_fullsized":"2024-09-12T01:33:57.780634+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:56.154197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":84,"num_read_kb":82,"num_write":190,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"263'149","reported_seq":715,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:42.805442+0000","last_change":"2024-09-12T00:28:41.226966+0000","last_active":"2024-09-12T01:36:42.805442+0000","last_peered":"2024-09-12T01:36:42.805442+0000","last_clean":"2024-09-12T01:36:42.805442+0000","last_became_active":"2024-09-12T00:28:41.226143+0000","last_became_peered":"2024-09-12T00:28:41.226143+0000","last_unstale":"2024-09-12T01:36:42.805442+0000","last_undegraded":"2024-09-12T01:36:42.805442+0000","last_fullsized":"2024-09-12T01:36:42.805442+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:18.139245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":251,"num_read_kb":240,"num_write":350,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"263'64","reported_seq":620,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:00.504480+0000","last_change":"2024-09-12T00:28:33.210002+0000","last_active":"2024-09-12T01:34:00.504480+0000","last_peered":"2024-09-12T01:34:00.504480+0000","last_clean":"2024-09-12T01:34:00.504480+0000","last_became_active":"2024-09-12T00:28:33.209335+0000","last_became_peered":"2024-09-12T00:28:33.209335+0000","last_unstale":"2024-09-12T01:34:00.504480+0000","last_undegraded":"2024-09-12T01:34:00.504480+0000","last_fullsized":"2024-09-12T01:34:00.504480+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:09.521704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":218,"num_write":93,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"263'381","reported_seq":1062,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.500975+0000","last_change":"2024-09-12T00:29:04.295940+0000","last_active":"2024-09-12T01:38:01.500975+0000","last_peered":"2024-09-12T01:38:01.500975+0000","last_clean":"2024-09-12T01:38:01.500975+0000","last_became_active":"2024-09-12T00:29:04.295676+0000","last_became_peered":"2024-09-12T00:29:04.295676+0000","last_unstale":"2024-09-12T01:38:01.500975+0000","last_undegraded":"2024-09-12T01:38:01.500975+0000","last_fullsized":"2024-09-12T01:38:01.500975+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:49.747597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2554861,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":751,"num_read_kb":17367,"num_write":1233,"num_write_kb":40068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.933837+0000","last_change":"2024-09-12T00:28:35.208489+0000","last_active":"2024-09-12T01:33:56.933837+0000","last_peered":"2024-09-12T01:33:56.933837+0000","last_clean":"2024-09-12T01:33:56.933837+0000","last_became_active":"2024-09-12T00:28:35.208165+0000","last_became_peered":"2024-09-12T00:28:35.208165+0000","last_unstale":"2024-09-12T01:33:56.933837+0000","last_undegraded":"2024-09-12T01:33:56.933837+0000","last_fullsized":"2024-09-12T01:33:56.933837+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:27.761289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"263'292","reported_seq":879,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:19.654666+0000","last_change":"2024-09-12T00:28:37.217911+0000","last_active":"2024-09-12T01:36:19.654666+0000","last_peered":"2024-09-12T01:36:19.654666+0000","last_clean":"2024-09-12T01:36:19.654666+0000","last_became_active":"2024-09-12T00:28:37.217603+0000","last_became_peered":"2024-09-12T00:28:37.217603+0000","last_unstale":"2024-09-12T01:36:19.654666+0000","last_undegraded":"2024-09-12T01:36:19.654666+0000","last_fullsized":"2024-09-12T01:36:19.654666+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:00.439250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52004,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":474,"num_read_kb":983,"num_write":384,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:59.638101+0000","last_change":"2024-09-12T00:28:39.216498+0000","last_active":"2024-09-12T01:33:59.638101+0000","last_peered":"2024-09-12T01:33:59.638101+0000","last_clean":"2024-09-12T01:33:59.638101+0000","last_became_active":"2024-09-12T00:28:39.216143+0000","last_became_peered":"2024-09-12T00:28:39.216143+0000","last_unstale":"2024-09-12T01:33:59.638101+0000","last_undegraded":"2024-09-12T01:33:59.638101+0000","last_fullsized":"2024-09-12T01:33:59.638101+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:29.237838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"263'119","reported_seq":632,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:42.721881+0000","last_change":"2024-09-12T00:28:41.232566+0000","last_active":"2024-09-12T01:36:42.721881+0000","last_peered":"2024-09-12T01:36:42.721881+0000","last_clean":"2024-09-12T01:36:42.721881+0000","last_became_active":"2024-09-12T00:28:41.232114+0000","last_became_peered":"2024-09-12T00:28:41.232114+0000","last_unstale":"2024-09-12T01:36:42.721881+0000","last_undegraded":"2024-09-12T01:36:42.721881+0000","last_fullsized":"2024-09-12T01:36:42.721881+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:39.890316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":141,"num_write":283,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"263'346","reported_seq":1045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.019124+0000","last_change":"2024-09-12T00:29:04.292672+0000","last_active":"2024-09-12T01:37:46.019124+0000","last_peered":"2024-09-12T01:37:46.019124+0000","last_clean":"2024-09-12T01:37:46.019124+0000","last_became_active":"2024-09-12T00:29:04.292302+0000","last_became_peered":"2024-09-12T00:29:04.292302+0000","last_unstale":"2024-09-12T01:37:46.019124+0000","last_undegraded":"2024-09-12T01:37:46.019124+0000","last_fullsized":"2024-09-12T01:37:46.019124+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:30.169396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1719,"num_read_kb":1484,"num_write":537,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"263'386","reported_seq":1163,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.715162+0000","last_change":"2024-09-12T00:28:31.208025+0000","last_active":"2024-09-12T01:38:01.715162+0000","last_peered":"2024-09-12T01:38:01.715162+0000","last_clean":"2024-09-12T01:38:01.715162+0000","last_became_active":"2024-09-12T00:28:31.207765+0000","last_became_peered":"2024-09-12T00:28:31.207765+0000","last_unstale":"2024-09-12T01:38:01.715162+0000","last_undegraded":"2024-09-12T01:38:01.715162+0000","last_fullsized":"2024-09-12T01:38:01.715162+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:36.097785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2529502,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":736,"num_read_kb":9284,"num_write":1355,"num_write_kb":41598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:54.637512+0000","last_change":"2024-09-12T00:28:35.212549+0000","last_active":"2024-09-12T01:33:54.637512+0000","last_peered":"2024-09-12T01:33:54.637512+0000","last_clean":"2024-09-12T01:33:54.637512+0000","last_became_active":"2024-09-12T00:28:35.212243+0000","last_became_peered":"2024-09-12T00:28:35.212243+0000","last_unstale":"2024-09-12T01:33:54.637512+0000","last_undegraded":"2024-09-12T01:33:54.637512+0000","last_fullsized":"2024-09-12T01:33:54.637512+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:02.038789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"263'57","reported_seq":565,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.783705+0000","last_change":"2024-09-12T00:28:37.220699+0000","last_active":"2024-09-12T01:33:56.783705+0000","last_peered":"2024-09-12T01:33:56.783705+0000","last_clean":"2024-09-12T01:33:56.783705+0000","last_became_active":"2024-09-12T00:28:37.219799+0000","last_became_peered":"2024-09-12T00:28:37.219799+0000","last_unstale":"2024-09-12T01:33:56.783705+0000","last_undegraded":"2024-09-12T01:33:56.783705+0000","last_fullsized":"2024-09-12T01:33:56.783705+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:52.584996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":42,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:01.719361+0000","last_change":"2024-09-12T00:28:39.219540+0000","last_active":"2024-09-12T01:34:01.719361+0000","last_peered":"2024-09-12T01:34:01.719361+0000","last_clean":"2024-09-12T01:34:01.719361+0000","last_became_active":"2024-09-12T00:28:39.219209+0000","last_became_peered":"2024-09-12T00:28:39.219209+0000","last_unstale":"2024-09-12T01:34:01.719361+0000","last_undegraded":"2024-09-12T01:34:01.719361+0000","last_fullsized":"2024-09-12T01:34:01.719361+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:53.327778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"263'211","reported_seq":739,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:41.517803+0000","last_change":"2024-09-12T00:28:41.226184+0000","last_active":"2024-09-12T01:36:41.517803+0000","last_peered":"2024-09-12T01:36:41.517803+0000","last_clean":"2024-09-12T01:36:41.517803+0000","last_became_active":"2024-09-12T00:28:41.225673+0000","last_became_peered":"2024-09-12T00:28:41.225673+0000","last_unstale":"2024-09-12T01:36:41.517803+0000","last_undegraded":"2024-09-12T01:36:41.517803+0000","last_fullsized":"2024-09-12T01:36:41.517803+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:16.037270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":332,"num_read_kb":318,"num_write":482,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"263'71","reported_seq":693,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:54.637476+0000","last_change":"2024-09-12T00:28:33.214078+0000","last_active":"2024-09-12T01:33:54.637476+0000","last_peered":"2024-09-12T01:33:54.637476+0000","last_clean":"2024-09-12T01:33:54.637476+0000","last_became_active":"2024-09-12T00:28:33.213777+0000","last_became_peered":"2024-09-12T00:28:33.213777+0000","last_unstale":"2024-09-12T01:33:54.637476+0000","last_undegraded":"2024-09-12T01:33:54.637476+0000","last_fullsized":"2024-09-12T01:33:54.637476+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:02.647251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":365,"num_read_kb":325,"num_write":89,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"263'271","reported_seq":898,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:40.245457+0000","last_change":"2024-09-12T00:28:31.214433+0000","last_active":"2024-09-12T01:35:40.245457+0000","last_peered":"2024-09-12T01:35:40.245457+0000","last_clean":"2024-09-12T01:35:40.245457+0000","last_became_active":"2024-09-12T00:28:31.213567+0000","last_became_peered":"2024-09-12T00:28:31.213567+0000","last_unstale":"2024-09-12T01:35:40.245457+0000","last_undegraded":"2024-09-12T01:35:40.245457+0000","last_fullsized":"2024-09-12T01:35:40.245457+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:37.746979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5534219,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":393,"num_read_kb":31326,"num_write":929,"num_write_kb":46181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.718581+0000","last_change":"2024-09-12T00:28:35.210262+0000","last_active":"2024-09-12T01:33:56.718581+0000","last_peered":"2024-09-12T01:33:56.718581+0000","last_clean":"2024-09-12T01:33:56.718581+0000","last_became_active":"2024-09-12T00:28:35.210000+0000","last_became_peered":"2024-09-12T00:28:35.210000+0000","last_unstale":"2024-09-12T01:33:56.718581+0000","last_undegraded":"2024-09-12T01:33:56.718581+0000","last_fullsized":"2024-09-12T01:33:56.718581+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:21.147847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"263'330","reported_seq":927,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.037803+0000","last_change":"2024-09-12T00:28:37.222936+0000","last_active":"2024-09-12T01:37:46.037803+0000","last_peered":"2024-09-12T01:37:46.037803+0000","last_clean":"2024-09-12T01:37:46.037803+0000","last_became_active":"2024-09-12T00:28:37.222678+0000","last_became_peered":"2024-09-12T00:28:37.222678+0000","last_unstale":"2024-09-12T01:37:46.037803+0000","last_undegraded":"2024-09-12T01:37:46.037803+0000","last_fullsized":"2024-09-12T01:37:46.037803+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:29.474781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56973,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":538,"num_read_kb":1095,"num_write":432,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:01.534928+0000","last_change":"2024-09-12T00:28:39.216508+0000","last_active":"2024-09-12T01:34:01.534928+0000","last_peered":"2024-09-12T01:34:01.534928+0000","last_clean":"2024-09-12T01:34:01.534928+0000","last_became_active":"2024-09-12T00:28:39.216200+0000","last_became_peered":"2024-09-12T00:28:39.216200+0000","last_unstale":"2024-09-12T01:34:01.534928+0000","last_undegraded":"2024-09-12T01:34:01.534928+0000","last_fullsized":"2024-09-12T01:34:01.534928+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:22.629426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"263'112","reported_seq":626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:42.778426+0000","last_change":"2024-09-12T00:28:41.232852+0000","last_active":"2024-09-12T01:33:42.778426+0000","last_peered":"2024-09-12T01:33:42.778426+0000","last_clean":"2024-09-12T01:33:42.778426+0000","last_became_active":"2024-09-12T00:28:41.232381+0000","last_became_peered":"2024-09-12T00:28:41.232381+0000","last_unstale":"2024-09-12T01:33:42.778426+0000","last_undegraded":"2024-09-12T01:33:42.778426+0000","last_fullsized":"2024-09-12T01:33:42.778426+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:50.533536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":176,"num_read_kb":166,"num_write":281,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"263'153","reported_seq":745,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:54.637443+0000","last_change":"2024-09-12T00:28:33.211984+0000","last_active":"2024-09-12T01:33:54.637443+0000","last_peered":"2024-09-12T01:33:54.637443+0000","last_clean":"2024-09-12T01:33:54.637443+0000","last_became_active":"2024-09-12T00:28:33.211165+0000","last_became_peered":"2024-09-12T00:28:33.211165+0000","last_unstale":"2024-09-12T01:33:54.637443+0000","last_undegraded":"2024-09-12T01:33:54.637443+0000","last_fullsized":"2024-09-12T01:33:54.637443+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:15.409950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":668,"num_read_kb":545,"num_write":223,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"263'332","reported_seq":961,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.766693+0000","last_change":"2024-09-12T00:28:31.214222+0000","last_active":"2024-09-12T01:38:01.766693+0000","last_peered":"2024-09-12T01:38:01.766693+0000","last_clean":"2024-09-12T01:38:01.766693+0000","last_became_active":"2024-09-12T00:28:31.213971+0000","last_became_peered":"2024-09-12T00:28:31.213971+0000","last_unstale":"2024-09-12T01:38:01.766693+0000","last_undegraded":"2024-09-12T01:38:01.766693+0000","last_fullsized":"2024-09-12T01:38:01.766693+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:34.097978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340133,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":428,"num_read_kb":61436,"num_write":986,"num_write_kb":69756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.534222+0000","last_change":"2024-09-12T00:28:35.210349+0000","last_active":"2024-09-12T01:33:56.534222+0000","last_peered":"2024-09-12T01:33:56.534222+0000","last_clean":"2024-09-12T01:33:56.534222+0000","last_became_active":"2024-09-12T00:28:35.210060+0000","last_became_peered":"2024-09-12T00:28:35.210060+0000","last_unstale":"2024-09-12T01:33:56.534222+0000","last_undegraded":"2024-09-12T01:33:56.534222+0000","last_fullsized":"2024-09-12T01:33:56.534222+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:54.262760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"263'297","reported_seq":871,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.176723+0000","last_change":"2024-09-12T00:28:37.221776+0000","last_active":"2024-09-12T01:38:01.176723+0000","last_peered":"2024-09-12T01:38:01.176723+0000","last_clean":"2024-09-12T01:38:01.176723+0000","last_became_active":"2024-09-12T00:28:37.221491+0000","last_became_peered":"2024-09-12T00:28:37.221491+0000","last_unstale":"2024-09-12T01:38:01.176723+0000","last_undegraded":"2024-09-12T01:38:01.176723+0000","last_fullsized":"2024-09-12T01:38:01.176723+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:53.230082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49002,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":484,"num_read_kb":1163,"num_write":396,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:01.784353+0000","last_change":"2024-09-12T00:28:39.219270+0000","last_active":"2024-09-12T01:34:01.784353+0000","last_peered":"2024-09-12T01:34:01.784353+0000","last_clean":"2024-09-12T01:34:01.784353+0000","last_became_active":"2024-09-12T00:28:39.219004+0000","last_became_peered":"2024-09-12T00:28:39.219004+0000","last_unstale":"2024-09-12T01:34:01.784353+0000","last_undegraded":"2024-09-12T01:34:01.784353+0000","last_fullsized":"2024-09-12T01:34:01.784353+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:04.158965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"263'478","reported_seq":1262,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:42.590207+0000","last_change":"2024-09-12T00:28:33.216889+0000","last_active":"2024-09-12T01:36:42.590207+0000","last_peered":"2024-09-12T01:36:42.590207+0000","last_clean":"2024-09-12T01:36:42.590207+0000","last_became_active":"2024-09-12T00:28:33.216610+0000","last_became_peered":"2024-09-12T00:28:33.216610+0000","last_unstale":"2024-09-12T01:36:42.590207+0000","last_undegraded":"2024-09-12T01:36:42.590207+0000","last_fullsized":"2024-09-12T01:36:42.590207+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:20.599221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2349,"num_read_kb":2016,"num_write":868,"num_write_kb":562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"263'259","reported_seq":890,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:49.636836+0000","last_change":"2024-09-12T00:28:31.208064+0000","last_active":"2024-09-12T01:33:49.636836+0000","last_peered":"2024-09-12T01:33:49.636836+0000","last_clean":"2024-09-12T01:33:49.636836+0000","last_became_active":"2024-09-12T00:28:31.207770+0000","last_became_peered":"2024-09-12T00:28:31.207770+0000","last_unstale":"2024-09-12T01:33:49.636836+0000","last_undegraded":"2024-09-12T01:33:49.636836+0000","last_fullsized":"2024-09-12T01:33:49.636836+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:48.014014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5418705,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":389,"num_read_kb":17283,"num_write":887,"num_write_kb":20034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:46.790016+0000","last_change":"2024-09-12T00:28:35.209110+0000","last_active":"2024-09-12T01:34:46.790016+0000","last_peered":"2024-09-12T01:34:46.790016+0000","last_clean":"2024-09-12T01:34:46.790016+0000","last_became_active":"2024-09-12T00:28:35.208868+0000","last_became_peered":"2024-09-12T00:28:35.208868+0000","last_unstale":"2024-09-12T01:34:46.790016+0000","last_undegraded":"2024-09-12T01:34:46.790016+0000","last_fullsized":"2024-09-12T01:34:46.790016+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:58.443488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"263'519","reported_seq":1161,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:47.113851+0000","last_change":"2024-09-12T00:28:37.211376+0000","last_active":"2024-09-12T01:37:47.113851+0000","last_peered":"2024-09-12T01:37:47.113851+0000","last_clean":"2024-09-12T01:37:47.113851+0000","last_became_active":"2024-09-12T00:28:37.210514+0000","last_became_peered":"2024-09-12T00:28:37.210514+0000","last_unstale":"2024-09-12T01:37:47.113851+0000","last_undegraded":"2024-09-12T01:37:47.113851+0000","last_fullsized":"2024-09-12T01:37:47.113851+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":500,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:55.293515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114751,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":893,"num_read_kb":1958,"num_write":778,"num_write_kb":674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:42.778441+0000","last_change":"2024-09-12T00:28:39.220157+0000","last_active":"2024-09-12T01:33:42.778441+0000","last_peered":"2024-09-12T01:33:42.778441+0000","last_clean":"2024-09-12T01:33:42.778441+0000","last_became_active":"2024-09-12T00:28:39.219808+0000","last_became_peered":"2024-09-12T00:28:39.219808+0000","last_unstale":"2024-09-12T01:33:42.778441+0000","last_undegraded":"2024-09-12T01:33:42.778441+0000","last_fullsized":"2024-09-12T01:33:42.778441+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:25.859464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"263'226","reported_seq":794,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:42.584721+0000","last_change":"2024-09-12T00:28:41.257924+0000","last_active":"2024-09-12T01:36:42.584721+0000","last_peered":"2024-09-12T01:36:42.584721+0000","last_clean":"2024-09-12T01:36:42.584721+0000","last_became_active":"2024-09-12T00:28:41.257639+0000","last_became_peered":"2024-09-12T00:28:41.257639+0000","last_unstale":"2024-09-12T01:36:42.584721+0000","last_undegraded":"2024-09-12T01:36:42.584721+0000","last_fullsized":"2024-09-12T01:36:42.584721+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:36.066637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":674,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":491,"num_read_kb":439,"num_write":521,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"263'158","reported_seq":749,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:46.790004+0000","last_change":"2024-09-12T00:28:33.215368+0000","last_active":"2024-09-12T01:34:46.790004+0000","last_peered":"2024-09-12T01:34:46.790004+0000","last_clean":"2024-09-12T01:34:46.790004+0000","last_became_active":"2024-09-12T00:28:33.215105+0000","last_became_peered":"2024-09-12T00:28:33.215105+0000","last_unstale":"2024-09-12T01:34:46.790004+0000","last_undegraded":"2024-09-12T01:34:46.790004+0000","last_fullsized":"2024-09-12T01:34:46.790004+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:01.247332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":692,"num_read_kb":572,"num_write":247,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"263'306","reported_seq":961,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:55.269878+0000","last_change":"2024-09-12T00:28:31.206881+0000","last_active":"2024-09-12T01:33:55.269878+0000","last_peered":"2024-09-12T01:33:55.269878+0000","last_clean":"2024-09-12T01:33:55.269878+0000","last_became_active":"2024-09-12T00:28:31.206562+0000","last_became_peered":"2024-09-12T00:28:31.206562+0000","last_unstale":"2024-09-12T01:33:55.269878+0000","last_undegraded":"2024-09-12T01:33:55.269878+0000","last_fullsized":"2024-09-12T01:33:55.269878+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:30.337503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8827667,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":462,"num_read_kb":3739,"num_write":1169,"num_write_kb":48925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.545536+0000","last_change":"2024-09-12T00:28:35.210344+0000","last_active":"2024-09-12T01:35:16.545536+0000","last_peered":"2024-09-12T01:35:16.545536+0000","last_clean":"2024-09-12T01:35:16.545536+0000","last_became_active":"2024-09-12T00:28:35.210046+0000","last_became_peered":"2024-09-12T00:28:35.210046+0000","last_unstale":"2024-09-12T01:35:16.545536+0000","last_undegraded":"2024-09-12T01:35:16.545536+0000","last_fullsized":"2024-09-12T01:35:16.545536+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:03.841464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"263'330","reported_seq":923,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.210125+0000","last_change":"2024-09-12T00:28:37.212617+0000","last_active":"2024-09-12T01:38:01.210125+0000","last_peered":"2024-09-12T01:38:01.210125+0000","last_clean":"2024-09-12T01:38:01.210125+0000","last_became_active":"2024-09-12T00:28:37.212236+0000","last_became_peered":"2024-09-12T00:28:37.212236+0000","last_unstale":"2024-09-12T01:38:01.210125+0000","last_undegraded":"2024-09-12T01:38:01.210125+0000","last_fullsized":"2024-09-12T01:38:01.210125+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:16.662629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49414,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":546,"num_read_kb":1160,"num_write":454,"num_write_kb":329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:41.931728+0000","last_change":"2024-09-12T00:28:39.218198+0000","last_active":"2024-09-12T01:33:41.931728+0000","last_peered":"2024-09-12T01:33:41.931728+0000","last_clean":"2024-09-12T01:33:41.931728+0000","last_became_active":"2024-09-12T00:28:39.217947+0000","last_became_peered":"2024-09-12T00:28:39.217947+0000","last_unstale":"2024-09-12T01:33:41.931728+0000","last_undegraded":"2024-09-12T01:33:41.931728+0000","last_fullsized":"2024-09-12T01:33:41.931728+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:45.277309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"263'220","reported_seq":1091,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.567227+0000","last_change":"2024-09-12T00:28:41.233293+0000","last_active":"2024-09-12T01:36:38.567227+0000","last_peered":"2024-09-12T01:36:38.567227+0000","last_clean":"2024-09-12T01:36:38.567227+0000","last_became_active":"2024-09-12T00:28:41.232347+0000","last_became_peered":"2024-09-12T00:28:41.232347+0000","last_unstale":"2024-09-12T01:36:38.567227+0000","last_undegraded":"2024-09-12T01:36:38.567227+0000","last_fullsized":"2024-09-12T01:36:38.567227+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:07.441315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":645,"num_read_kb":635,"num_write":602,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"263'72","reported_seq":627,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:52.550530+0000","last_change":"2024-09-12T00:28:33.208225+0000","last_active":"2024-09-12T01:33:52.550530+0000","last_peered":"2024-09-12T01:33:52.550530+0000","last_clean":"2024-09-12T01:33:52.550530+0000","last_became_active":"2024-09-12T00:28:33.207968+0000","last_became_peered":"2024-09-12T00:28:33.207968+0000","last_unstale":"2024-09-12T01:33:52.550530+0000","last_undegraded":"2024-09-12T01:33:52.550530+0000","last_fullsized":"2024-09-12T01:33:52.550530+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:44.313634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":308,"num_read_kb":254,"num_write":109,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"263'289","reported_seq":915,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.527649+0000","last_change":"2024-09-12T00:28:31.195341+0000","last_active":"2024-09-12T01:38:01.527649+0000","last_peered":"2024-09-12T01:38:01.527649+0000","last_clean":"2024-09-12T01:38:01.527649+0000","last_became_active":"2024-09-12T00:28:31.195038+0000","last_became_peered":"2024-09-12T00:28:31.195038+0000","last_unstale":"2024-09-12T01:38:01.527649+0000","last_undegraded":"2024-09-12T01:38:01.527649+0000","last_fullsized":"2024-09-12T01:38:01.527649+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:10.944170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264279,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":420,"num_read_kb":13573,"num_write":959,"num_write_kb":34116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:36.531621+0000","last_change":"2024-09-12T00:28:35.215894+0000","last_active":"2024-09-12T01:33:36.531621+0000","last_peered":"2024-09-12T01:33:36.531621+0000","last_clean":"2024-09-12T01:33:36.531621+0000","last_became_active":"2024-09-12T00:28:35.215576+0000","last_became_peered":"2024-09-12T00:28:35.215576+0000","last_unstale":"2024-09-12T01:33:36.531621+0000","last_undegraded":"2024-09-12T01:33:36.531621+0000","last_fullsized":"2024-09-12T01:33:36.531621+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:24.130329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"263'283","reported_seq":874,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:24.663088+0000","last_change":"2024-09-12T00:28:37.424316+0000","last_active":"2024-09-12T01:37:24.663088+0000","last_peered":"2024-09-12T01:37:24.663088+0000","last_clean":"2024-09-12T01:37:24.663088+0000","last_became_active":"2024-09-12T00:28:37.423835+0000","last_became_peered":"2024-09-12T00:28:37.423835+0000","last_unstale":"2024-09-12T01:37:24.663088+0000","last_undegraded":"2024-09-12T01:37:24.663088+0000","last_fullsized":"2024-09-12T01:37:24.663088+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:16.822185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55686,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":473,"num_read_kb":989,"num_write":380,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:46.941196+0000","last_change":"2024-09-12T00:28:39.219814+0000","last_active":"2024-09-12T01:34:46.941196+0000","last_peered":"2024-09-12T01:34:46.941196+0000","last_clean":"2024-09-12T01:34:46.941196+0000","last_became_active":"2024-09-12T00:28:39.219541+0000","last_became_peered":"2024-09-12T00:28:39.219541+0000","last_unstale":"2024-09-12T01:34:46.941196+0000","last_undegraded":"2024-09-12T01:34:46.941196+0000","last_fullsized":"2024-09-12T01:34:46.941196+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:16.760034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"263'114","reported_seq":599,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:47.141542+0000","last_change":"2024-09-12T00:28:41.232661+0000","last_active":"2024-09-12T01:37:47.141542+0000","last_peered":"2024-09-12T01:37:47.141542+0000","last_clean":"2024-09-12T01:37:47.141542+0000","last_became_active":"2024-09-12T00:28:41.232305+0000","last_became_peered":"2024-09-12T00:28:41.232305+0000","last_unstale":"2024-09-12T01:37:47.141542+0000","last_undegraded":"2024-09-12T01:37:47.141542+0000","last_fullsized":"2024-09-12T01:37:47.141542+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:16.813541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":90,"num_read_kb":88,"num_write":260,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"263'145","reported_seq":711,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:36.625552+0000","last_change":"2024-09-12T00:28:33.214222+0000","last_active":"2024-09-12T01:33:36.625552+0000","last_peered":"2024-09-12T01:33:36.625552+0000","last_clean":"2024-09-12T01:33:36.625552+0000","last_became_active":"2024-09-12T00:28:33.213905+0000","last_became_peered":"2024-09-12T00:28:33.213905+0000","last_unstale":"2024-09-12T01:33:36.625552+0000","last_undegraded":"2024-09-12T01:33:36.625552+0000","last_fullsized":"2024-09-12T01:33:36.625552+0000","mapping_epoch":27,"log_start":"260'100","ondisk_log_start":"260'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:53.032156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":580,"num_read_kb":470,"num_write":232,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"263'309","reported_seq":1003,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.746967+0000","last_change":"2024-09-12T00:28:31.203713+0000","last_active":"2024-09-12T01:38:01.746967+0000","last_peered":"2024-09-12T01:38:01.746967+0000","last_clean":"2024-09-12T01:38:01.746967+0000","last_became_active":"2024-09-12T00:28:31.203417+0000","last_became_peered":"2024-09-12T00:28:31.203417+0000","last_unstale":"2024-09-12T01:38:01.746967+0000","last_undegraded":"2024-09-12T01:38:01.746967+0000","last_fullsized":"2024-09-12T01:38:01.746967+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:22.904080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262193,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":643,"num_read_kb":683,"num_write":1258,"num_write_kb":6456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:36.931007+0000","last_change":"2024-09-12T00:28:35.208282+0000","last_active":"2024-09-12T01:33:36.931007+0000","last_peered":"2024-09-12T01:33:36.931007+0000","last_clean":"2024-09-12T01:33:36.931007+0000","last_became_active":"2024-09-12T00:28:35.207992+0000","last_became_peered":"2024-09-12T00:28:35.207992+0000","last_unstale":"2024-09-12T01:33:36.931007+0000","last_undegraded":"2024-09-12T01:33:36.931007+0000","last_fullsized":"2024-09-12T01:33:36.931007+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:40:54.373200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"263'105","reported_seq":647,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:51.541995+0000","last_change":"2024-09-12T00:28:37.424144+0000","last_active":"2024-09-12T01:34:51.541995+0000","last_peered":"2024-09-12T01:34:51.541995+0000","last_clean":"2024-09-12T01:34:51.541995+0000","last_became_active":"2024-09-12T00:28:37.423765+0000","last_became_peered":"2024-09-12T00:28:37.423765+0000","last_unstale":"2024-09-12T01:34:51.541995+0000","last_undegraded":"2024-09-12T01:34:51.541995+0000","last_fullsized":"2024-09-12T01:34:51.541995+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:37.831318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":155,"num_read_kb":148,"num_write":156,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"263'760","reported_seq":2427,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.050221+0000","last_change":"2024-09-12T00:28:39.217233+0000","last_active":"2024-09-12T01:38:00.050221+0000","last_peered":"2024-09-12T01:38:00.050221+0000","last_clean":"2024-09-12T01:38:00.050221+0000","last_became_active":"2024-09-12T00:28:39.216704+0000","last_became_peered":"2024-09-12T00:28:39.216704+0000","last_unstale":"2024-09-12T01:38:00.050221+0000","last_undegraded":"2024-09-12T01:38:00.050221+0000","last_fullsized":"2024-09-12T01:38:00.050221+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:06.941324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"263'157","reported_seq":655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:41.582118+0000","last_change":"2024-09-12T00:28:41.228417+0000","last_active":"2024-09-12T01:36:41.582118+0000","last_peered":"2024-09-12T01:36:41.582118+0000","last_clean":"2024-09-12T01:36:41.582118+0000","last_became_active":"2024-09-12T00:28:41.227892+0000","last_became_peered":"2024-09-12T00:28:41.227892+0000","last_unstale":"2024-09-12T01:36:41.582118+0000","last_undegraded":"2024-09-12T01:36:41.582118+0000","last_fullsized":"2024-09-12T01:36:41.582118+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:55.234284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":160,"num_read_kb":153,"num_write":389,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"263'138","reported_seq":717,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:36.531599+0000","last_change":"2024-09-12T00:28:33.205366+0000","last_active":"2024-09-12T01:33:36.531599+0000","last_peered":"2024-09-12T01:33:36.531599+0000","last_clean":"2024-09-12T01:33:36.531599+0000","last_became_active":"2024-09-12T00:28:33.204722+0000","last_became_peered":"2024-09-12T00:28:33.204722+0000","last_unstale":"2024-09-12T01:33:36.531599+0000","last_undegraded":"2024-09-12T01:33:36.531599+0000","last_fullsized":"2024-09-12T01:33:36.531599+0000","mapping_epoch":27,"log_start":"260'100","ondisk_log_start":"260'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:40.757422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":575,"num_read_kb":467,"num_write":204,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"263'267","reported_seq":985,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:02.798570+0000","last_change":"2024-09-12T00:28:31.214127+0000","last_active":"2024-09-12T01:36:02.798570+0000","last_peered":"2024-09-12T01:36:02.798570+0000","last_clean":"2024-09-12T01:36:02.798570+0000","last_became_active":"2024-09-12T00:28:31.212597+0000","last_became_peered":"2024-09-12T00:28:31.212597+0000","last_unstale":"2024-09-12T01:36:02.798570+0000","last_undegraded":"2024-09-12T01:36:02.798570+0000","last_fullsized":"2024-09-12T01:36:02.798570+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:45.696465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301335,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":646,"num_read_kb":2175,"num_write":1055,"num_write_kb":612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:36.715250+0000","last_change":"2024-09-12T00:28:35.210989+0000","last_active":"2024-09-12T01:33:36.715250+0000","last_peered":"2024-09-12T01:33:36.715250+0000","last_clean":"2024-09-12T01:33:36.715250+0000","last_became_active":"2024-09-12T00:28:35.210710+0000","last_became_peered":"2024-09-12T00:28:35.210710+0000","last_unstale":"2024-09-12T01:33:36.715250+0000","last_undegraded":"2024-09-12T01:33:36.715250+0000","last_fullsized":"2024-09-12T01:33:36.715250+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:33.211433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"263'382","reported_seq":994,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:22.801661+0000","last_change":"2024-09-12T00:28:37.210612+0000","last_active":"2024-09-12T01:36:22.801661+0000","last_peered":"2024-09-12T01:36:22.801661+0000","last_clean":"2024-09-12T01:36:22.801661+0000","last_became_active":"2024-09-12T00:28:37.210317+0000","last_became_peered":"2024-09-12T00:28:37.210317+0000","last_unstale":"2024-09-12T01:36:22.801661+0000","last_undegraded":"2024-09-12T01:36:22.801661+0000","last_fullsized":"2024-09-12T01:36:22.801661+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:31.821476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76180,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":636,"num_read_kb":1300,"num_write":522,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.783725+0000","last_change":"2024-09-12T00:28:39.218794+0000","last_active":"2024-09-12T01:33:56.783725+0000","last_peered":"2024-09-12T01:33:56.783725+0000","last_clean":"2024-09-12T01:33:56.783725+0000","last_became_active":"2024-09-12T00:28:39.218026+0000","last_became_peered":"2024-09-12T00:28:39.218026+0000","last_unstale":"2024-09-12T01:33:56.783725+0000","last_undegraded":"2024-09-12T01:33:56.783725+0000","last_fullsized":"2024-09-12T01:33:56.783725+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:18.115521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"263'133","reported_seq":629,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:21.741327+0000","last_change":"2024-09-12T00:28:41.231966+0000","last_active":"2024-09-12T01:36:21.741327+0000","last_peered":"2024-09-12T01:36:21.741327+0000","last_clean":"2024-09-12T01:36:21.741327+0000","last_became_active":"2024-09-12T00:28:41.231611+0000","last_became_peered":"2024-09-12T00:28:41.231611+0000","last_unstale":"2024-09-12T01:36:21.741327+0000","last_undegraded":"2024-09-12T01:36:21.741327+0000","last_fullsized":"2024-09-12T01:36:21.741327+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:05.050533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":625,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":135,"num_read_kb":130,"num_write":322,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"263'92","reported_seq":673,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:36.531552+0000","last_change":"2024-09-12T00:28:33.204989+0000","last_active":"2024-09-12T01:33:36.531552+0000","last_peered":"2024-09-12T01:33:36.531552+0000","last_clean":"2024-09-12T01:33:36.531552+0000","last_became_active":"2024-09-12T00:28:33.204653+0000","last_became_peered":"2024-09-12T00:28:33.204653+0000","last_unstale":"2024-09-12T01:33:36.531552+0000","last_undegraded":"2024-09-12T01:33:36.531552+0000","last_fullsized":"2024-09-12T01:33:36.531552+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:22.275865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":393,"num_read_kb":329,"num_write":145,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"263'353","reported_seq":1045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:26.402299+0000","last_change":"2024-09-12T00:28:31.214035+0000","last_active":"2024-09-12T01:36:26.402299+0000","last_peered":"2024-09-12T01:36:26.402299+0000","last_clean":"2024-09-12T01:36:26.402299+0000","last_became_active":"2024-09-12T00:28:31.212752+0000","last_became_peered":"2024-09-12T00:28:31.212752+0000","last_unstale":"2024-09-12T01:36:26.402299+0000","last_undegraded":"2024-09-12T01:36:26.402299+0000","last_fullsized":"2024-09-12T01:36:26.402299+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:33.447125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17854756,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":728,"num_read_kb":13300,"num_write":1298,"num_write_kb":24353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:37.777506+0000","last_change":"2024-09-12T00:28:35.208702+0000","last_active":"2024-09-12T01:33:37.777506+0000","last_peered":"2024-09-12T01:33:37.777506+0000","last_clean":"2024-09-12T01:33:37.777506+0000","last_became_active":"2024-09-12T00:28:35.207869+0000","last_became_peered":"2024-09-12T00:28:35.207869+0000","last_unstale":"2024-09-12T01:33:37.777506+0000","last_undegraded":"2024-09-12T01:33:37.777506+0000","last_fullsized":"2024-09-12T01:33:37.777506+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:39.750226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"263'310","reported_seq":893,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.823008+0000","last_change":"2024-09-12T00:28:37.221622+0000","last_active":"2024-09-12T01:38:00.823008+0000","last_peered":"2024-09-12T01:38:00.823008+0000","last_clean":"2024-09-12T01:38:00.823008+0000","last_became_active":"2024-09-12T00:28:37.221289+0000","last_became_peered":"2024-09-12T00:28:37.221289+0000","last_unstale":"2024-09-12T01:38:00.823008+0000","last_undegraded":"2024-09-12T01:38:00.823008+0000","last_fullsized":"2024-09-12T01:38:00.823008+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:13.295191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57095,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":538,"num_read_kb":1320,"num_write":444,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:11.536147+0000","last_change":"2024-09-12T00:28:39.217261+0000","last_active":"2024-09-12T01:34:11.536147+0000","last_peered":"2024-09-12T01:34:11.536147+0000","last_clean":"2024-09-12T01:34:11.536147+0000","last_became_active":"2024-09-12T00:28:39.216943+0000","last_became_peered":"2024-09-12T00:28:39.216943+0000","last_unstale":"2024-09-12T01:34:11.536147+0000","last_undegraded":"2024-09-12T01:34:11.536147+0000","last_fullsized":"2024-09-12T01:34:11.536147+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:27.903826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"263'138","reported_seq":675,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:20.328319+0000","last_change":"2024-09-12T00:28:41.258056+0000","last_active":"2024-09-12T01:35:20.328319+0000","last_peered":"2024-09-12T01:35:20.328319+0000","last_clean":"2024-09-12T01:35:20.328319+0000","last_became_active":"2024-09-12T00:28:41.257796+0000","last_became_peered":"2024-09-12T00:28:41.257796+0000","last_unstale":"2024-09-12T01:35:20.328319+0000","last_undegraded":"2024-09-12T01:35:20.328319+0000","last_fullsized":"2024-09-12T01:35:20.328319+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:21.378439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":982,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":234,"num_read_kb":212,"num_write":368,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"263'73","reported_seq":628,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:04.638853+0000","last_change":"2024-09-12T00:28:33.206104+0000","last_active":"2024-09-12T01:34:04.638853+0000","last_peered":"2024-09-12T01:34:04.638853+0000","last_clean":"2024-09-12T01:34:04.638853+0000","last_became_active":"2024-09-12T00:28:33.205832+0000","last_became_peered":"2024-09-12T00:28:33.205832+0000","last_unstale":"2024-09-12T01:34:04.638853+0000","last_undegraded":"2024-09-12T01:34:04.638853+0000","last_fullsized":"2024-09-12T01:34:04.638853+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:47.756933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":322,"num_read_kb":264,"num_write":102,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"263'272","reported_seq":907,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:39.479186+0000","last_change":"2024-09-12T00:28:31.200496+0000","last_active":"2024-09-12T01:37:39.479186+0000","last_peered":"2024-09-12T01:37:39.479186+0000","last_clean":"2024-09-12T01:37:39.479186+0000","last_became_active":"2024-09-12T00:28:31.200234+0000","last_became_peered":"2024-09-12T00:28:31.200234+0000","last_unstale":"2024-09-12T01:37:39.479186+0000","last_undegraded":"2024-09-12T01:37:39.479186+0000","last_fullsized":"2024-09-12T01:37:39.479186+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:25.377262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5561855,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":401,"num_read_kb":15822,"num_write":1029,"num_write_kb":25857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.533584+0000","last_change":"2024-09-12T00:28:35.206882+0000","last_active":"2024-09-12T01:33:51.533584+0000","last_peered":"2024-09-12T01:33:51.533584+0000","last_clean":"2024-09-12T01:33:51.533584+0000","last_became_active":"2024-09-12T00:28:35.206597+0000","last_became_peered":"2024-09-12T00:28:35.206597+0000","last_unstale":"2024-09-12T01:33:51.533584+0000","last_undegraded":"2024-09-12T01:33:51.533584+0000","last_fullsized":"2024-09-12T01:33:51.533584+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:07.120698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"263'275","reported_seq":839,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:09.653390+0000","last_change":"2024-09-12T00:28:37.220535+0000","last_active":"2024-09-12T01:36:09.653390+0000","last_peered":"2024-09-12T01:36:09.653390+0000","last_clean":"2024-09-12T01:36:09.653390+0000","last_became_active":"2024-09-12T00:28:37.219652+0000","last_became_peered":"2024-09-12T00:28:37.219652+0000","last_unstale":"2024-09-12T01:36:09.653390+0000","last_undegraded":"2024-09-12T01:36:09.653390+0000","last_fullsized":"2024-09-12T01:36:09.653390+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:35.052492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69302,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":460,"num_read_kb":1067,"num_write":388,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:41.532251+0000","last_change":"2024-09-12T00:28:39.218146+0000","last_active":"2024-09-12T01:33:41.532251+0000","last_peered":"2024-09-12T01:33:41.532251+0000","last_clean":"2024-09-12T01:33:41.532251+0000","last_became_active":"2024-09-12T00:28:39.217869+0000","last_became_peered":"2024-09-12T00:28:39.217869+0000","last_unstale":"2024-09-12T01:33:41.532251+0000","last_undegraded":"2024-09-12T01:33:41.532251+0000","last_fullsized":"2024-09-12T01:33:41.532251+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:50.890111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"263'190","reported_seq":1287,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.478652+0000","last_change":"2024-09-12T00:28:41.232727+0000","last_active":"2024-09-12T01:36:38.478652+0000","last_peered":"2024-09-12T01:36:38.478652+0000","last_clean":"2024-09-12T01:36:38.478652+0000","last_became_active":"2024-09-12T00:28:41.232040+0000","last_became_peered":"2024-09-12T00:28:41.232040+0000","last_unstale":"2024-09-12T01:36:38.478652+0000","last_undegraded":"2024-09-12T01:36:38.478652+0000","last_fullsized":"2024-09-12T01:36:38.478652+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:12.584298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":841,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":800,"num_read_kb":795,"num_write":450,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"263'254","reported_seq":913,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.533604+0000","last_change":"2024-09-12T00:28:33.209146+0000","last_active":"2024-09-12T01:33:51.533604+0000","last_peered":"2024-09-12T01:33:51.533604+0000","last_clean":"2024-09-12T01:33:51.533604+0000","last_became_active":"2024-09-12T00:28:33.208787+0000","last_became_peered":"2024-09-12T00:28:33.208787+0000","last_unstale":"2024-09-12T01:33:51.533604+0000","last_undegraded":"2024-09-12T01:33:51.533604+0000","last_fullsized":"2024-09-12T01:33:51.533604+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:39.287147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1164,"num_read_kb":956,"num_write":405,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"263'316","reported_seq":1064,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.727735+0000","last_change":"2024-09-12T00:29:04.275056+0000","last_active":"2024-09-12T01:38:01.727735+0000","last_peered":"2024-09-12T01:38:01.727735+0000","last_clean":"2024-09-12T01:38:01.727735+0000","last_became_active":"2024-09-12T00:29:04.274746+0000","last_became_peered":"2024-09-12T00:29:04.274746+0000","last_unstale":"2024-09-12T01:38:01.727735+0000","last_undegraded":"2024-09-12T01:38:01.727735+0000","last_fullsized":"2024-09-12T01:38:01.727735+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:44.084463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524334,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":565,"num_read_kb":52761,"num_write":1033,"num_write_kb":38285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"37'4","reported_seq":984,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.866374+0000","last_change":"2024-09-12T00:28:35.207612+0000","last_active":"2024-09-12T01:37:46.866374+0000","last_peered":"2024-09-12T01:37:46.866374+0000","last_clean":"2024-09-12T01:37:46.866374+0000","last_became_active":"2024-09-12T00:28:35.207332+0000","last_became_peered":"2024-09-12T00:28:35.207332+0000","last_unstale":"2024-09-12T01:37:46.866374+0000","last_undegraded":"2024-09-12T01:37:46.866374+0000","last_fullsized":"2024-09-12T01:37:46.866374+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:37.071411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":721,"num_read_kb":719,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"263'325","reported_seq":930,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.451609+0000","last_change":"2024-09-12T00:28:37.207659+0000","last_active":"2024-09-12T01:38:00.451609+0000","last_peered":"2024-09-12T01:38:00.451609+0000","last_clean":"2024-09-12T01:38:00.451609+0000","last_became_active":"2024-09-12T00:28:37.207373+0000","last_became_peered":"2024-09-12T00:28:37.207373+0000","last_unstale":"2024-09-12T01:38:00.451609+0000","last_undegraded":"2024-09-12T01:38:00.451609+0000","last_fullsized":"2024-09-12T01:38:00.451609+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:14.729544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45135,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":515,"num_read_kb":1089,"num_write":408,"num_write_kb":271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:41.781852+0000","last_change":"2024-09-12T00:28:39.217215+0000","last_active":"2024-09-12T01:33:41.781852+0000","last_peered":"2024-09-12T01:33:41.781852+0000","last_clean":"2024-09-12T01:33:41.781852+0000","last_became_active":"2024-09-12T00:28:39.215651+0000","last_became_peered":"2024-09-12T00:28:39.215651+0000","last_unstale":"2024-09-12T01:33:41.781852+0000","last_undegraded":"2024-09-12T01:33:41.781852+0000","last_fullsized":"2024-09-12T01:33:41.781852+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:18.517005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"263'132","reported_seq":629,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.017444+0000","last_change":"2024-09-12T00:28:41.227004+0000","last_active":"2024-09-12T01:37:46.017444+0000","last_peered":"2024-09-12T01:37:46.017444+0000","last_clean":"2024-09-12T01:37:46.017444+0000","last_became_active":"2024-09-12T00:28:41.226687+0000","last_became_peered":"2024-09-12T00:28:41.226687+0000","last_unstale":"2024-09-12T01:37:46.017444+0000","last_undegraded":"2024-09-12T01:37:46.017444+0000","last_fullsized":"2024-09-12T01:37:46.017444+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:17.799068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":132,"num_read_kb":117,"num_write":304,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"263'292","reported_seq":922,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.948057+0000","last_change":"2024-09-12T00:28:33.211180+0000","last_active":"2024-09-12T01:35:46.948057+0000","last_peered":"2024-09-12T01:35:46.948057+0000","last_clean":"2024-09-12T01:35:46.948057+0000","last_became_active":"2024-09-12T00:28:33.210635+0000","last_became_peered":"2024-09-12T00:28:33.210635+0000","last_unstale":"2024-09-12T01:35:46.948057+0000","last_undegraded":"2024-09-12T01:35:46.948057+0000","last_fullsized":"2024-09-12T01:35:46.948057+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:52.779854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1259,"num_read_kb":1011,"num_write":460,"num_write_kb":225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"263'324","reported_seq":944,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.535496+0000","last_change":"2024-09-12T00:28:31.207464+0000","last_active":"2024-09-12T01:38:01.535496+0000","last_peered":"2024-09-12T01:38:01.535496+0000","last_clean":"2024-09-12T01:38:01.535496+0000","last_became_active":"2024-09-12T00:28:31.206672+0000","last_became_peered":"2024-09-12T00:28:31.206672+0000","last_unstale":"2024-09-12T01:38:01.535496+0000","last_undegraded":"2024-09-12T01:38:01.535496+0000","last_fullsized":"2024-09-12T01:38:01.535496+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:16.072963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":684071,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":456,"num_read_kb":11577,"num_write":1042,"num_write_kb":29091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"263'314","reported_seq":941,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.948041+0000","last_change":"2024-09-12T00:28:33.207374+0000","last_active":"2024-09-12T01:35:46.948041+0000","last_peered":"2024-09-12T01:35:46.948041+0000","last_clean":"2024-09-12T01:35:46.948041+0000","last_became_active":"2024-09-12T00:28:33.206512+0000","last_became_peered":"2024-09-12T00:28:33.206512+0000","last_unstale":"2024-09-12T01:35:46.948041+0000","last_undegraded":"2024-09-12T01:35:46.948041+0000","last_fullsized":"2024-09-12T01:35:46.948041+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:00.796082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1325,"num_read_kb":1067,"num_write":489,"num_write_kb":251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"263'323","reported_seq":962,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.538497+0000","last_change":"2024-09-12T00:29:04.272074+0000","last_active":"2024-09-12T01:38:01.538497+0000","last_peered":"2024-09-12T01:38:01.538497+0000","last_clean":"2024-09-12T01:38:01.538497+0000","last_became_active":"2024-09-12T00:29:04.271753+0000","last_became_peered":"2024-09-12T00:29:04.271753+0000","last_unstale":"2024-09-12T01:38:01.538497+0000","last_undegraded":"2024-09-12T01:38:01.538497+0000","last_fullsized":"2024-09-12T01:38:01.538497+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:42.475525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":500,"num_read_kb":1624,"num_write":1030,"num_write_kb":30525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"263'349","reported_seq":960,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:47.796128+0000","last_change":"2024-09-12T00:28:33.214934+0000","last_active":"2024-09-12T01:35:47.796128+0000","last_peered":"2024-09-12T01:35:47.796128+0000","last_clean":"2024-09-12T01:35:47.796128+0000","last_became_active":"2024-09-12T00:28:33.214679+0000","last_became_peered":"2024-09-12T00:28:33.214679+0000","last_unstale":"2024-09-12T01:35:47.796128+0000","last_undegraded":"2024-09-12T01:35:47.796128+0000","last_fullsized":"2024-09-12T01:35:47.796128+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:00.796082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1495,"num_read_kb":1194,"num_write":562,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"263'302","reported_seq":969,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:40.252643+0000","last_change":"2024-09-12T00:28:31.209614+0000","last_active":"2024-09-12T01:35:40.252643+0000","last_peered":"2024-09-12T01:35:40.252643+0000","last_clean":"2024-09-12T01:35:40.252643+0000","last_became_active":"2024-09-12T00:28:31.209266+0000","last_became_peered":"2024-09-12T00:28:31.209266+0000","last_unstale":"2024-09-12T01:35:40.252643+0000","last_undegraded":"2024-09-12T01:35:40.252643+0000","last_fullsized":"2024-09-12T01:35:40.252643+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:17.128660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11171705,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":512,"num_read_kb":38602,"num_write":1180,"num_write_kb":22367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"263'104","reported_seq":689,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.948017+0000","last_change":"2024-09-12T00:28:33.216968+0000","last_active":"2024-09-12T01:35:46.948017+0000","last_peered":"2024-09-12T01:35:46.948017+0000","last_clean":"2024-09-12T01:35:46.948017+0000","last_became_active":"2024-09-12T00:28:33.213020+0000","last_became_peered":"2024-09-12T00:28:33.213020+0000","last_unstale":"2024-09-12T01:35:46.948017+0000","last_undegraded":"2024-09-12T01:35:46.948017+0000","last_fullsized":"2024-09-12T01:35:46.948017+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:49.966752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":435,"num_read_kb":365,"num_write":138,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"263'309","reported_seq":1047,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.733181+0000","last_change":"2024-09-12T00:28:31.208858+0000","last_active":"2024-09-12T01:38:01.733181+0000","last_peered":"2024-09-12T01:38:01.733181+0000","last_clean":"2024-09-12T01:38:01.733181+0000","last_became_active":"2024-09-12T00:28:31.208548+0000","last_became_peered":"2024-09-12T00:28:31.208548+0000","last_unstale":"2024-09-12T01:38:01.733181+0000","last_undegraded":"2024-09-12T01:38:01.733181+0000","last_fullsized":"2024-09-12T01:38:01.733181+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:14.657513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49275,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":734,"num_read_kb":31441,"num_write":965,"num_write_kb":36605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"263'125","reported_seq":761,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:13.175412+0000","last_change":"2024-09-12T00:28:33.217855+0000","last_active":"2024-09-12T01:36:13.175412+0000","last_peered":"2024-09-12T01:36:13.175412+0000","last_clean":"2024-09-12T01:36:13.175412+0000","last_became_active":"2024-09-12T00:28:33.217573+0000","last_became_peered":"2024-09-12T00:28:33.217573+0000","last_unstale":"2024-09-12T01:36:13.175412+0000","last_undegraded":"2024-09-12T01:36:13.175412+0000","last_fullsized":"2024-09-12T01:36:13.175412+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:26.283665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":588,"num_read_kb":500,"num_write":193,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"263'350","reported_seq":991,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.533585+0000","last_change":"2024-09-12T00:29:04.267833+0000","last_active":"2024-09-12T01:38:01.533585+0000","last_peered":"2024-09-12T01:38:01.533585+0000","last_clean":"2024-09-12T01:38:01.533585+0000","last_became_active":"2024-09-12T00:29:04.267546+0000","last_became_peered":"2024-09-12T00:29:04.267546+0000","last_unstale":"2024-09-12T01:38:01.533585+0000","last_undegraded":"2024-09-12T01:38:01.533585+0000","last_fullsized":"2024-09-12T01:38:01.533585+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:45.410402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2316194,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":594,"num_read_kb":3307,"num_write":1231,"num_write_kb":18821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"263'308","reported_seq":1002,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.545510+0000","last_change":"2024-09-12T00:28:33.209863+0000","last_active":"2024-09-12T01:35:16.545510+0000","last_peered":"2024-09-12T01:35:16.545510+0000","last_clean":"2024-09-12T01:35:16.545510+0000","last_became_active":"2024-09-12T00:28:33.208929+0000","last_became_peered":"2024-09-12T00:28:33.208929+0000","last_unstale":"2024-09-12T01:35:16.545510+0000","last_undegraded":"2024-09-12T01:35:16.545510+0000","last_fullsized":"2024-09-12T01:35:16.545510+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:38.145227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1423,"num_read_kb":1158,"num_write":481,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"263'256","reported_seq":898,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.782075+0000","last_change":"2024-09-12T00:28:31.206143+0000","last_active":"2024-09-12T01:35:57.782075+0000","last_peered":"2024-09-12T01:35:57.782075+0000","last_clean":"2024-09-12T01:35:57.782075+0000","last_became_active":"2024-09-12T00:28:31.205829+0000","last_became_peered":"2024-09-12T00:28:31.205829+0000","last_unstale":"2024-09-12T01:35:57.782075+0000","last_undegraded":"2024-09-12T01:35:57.782075+0000","last_fullsized":"2024-09-12T01:35:57.782075+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:18.050330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5873432,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":398,"num_read_kb":5275,"num_write":977,"num_write_kb":26638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"263'110","reported_seq":699,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:14.646908+0000","last_change":"2024-09-12T00:28:33.208267+0000","last_active":"2024-09-12T01:35:14.646908+0000","last_peered":"2024-09-12T01:35:14.646908+0000","last_clean":"2024-09-12T01:35:14.646908+0000","last_became_active":"2024-09-12T00:28:33.208010+0000","last_became_peered":"2024-09-12T00:28:33.208010+0000","last_unstale":"2024-09-12T01:35:14.646908+0000","last_undegraded":"2024-09-12T01:35:14.646908+0000","last_fullsized":"2024-09-12T01:35:14.646908+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:07.389367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":481,"num_read_kb":401,"num_write":165,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"263'361","reported_seq":1003,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.523918+0000","last_change":"2024-09-12T00:28:31.205820+0000","last_active":"2024-09-12T01:38:01.523918+0000","last_peered":"2024-09-12T01:38:01.523918+0000","last_clean":"2024-09-12T01:38:01.523918+0000","last_became_active":"2024-09-12T00:28:31.205366+0000","last_became_peered":"2024-09-12T00:28:31.205366+0000","last_unstale":"2024-09-12T01:38:01.523918+0000","last_undegraded":"2024-09-12T01:38:01.523918+0000","last_fullsized":"2024-09-12T01:38:01.523918+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:37.694868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":584,"num_read_kb":12807,"num_write":1205,"num_write_kb":27426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"263'206","reported_seq":826,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:32.524627+0000","last_change":"2024-09-12T00:28:33.209326+0000","last_active":"2024-09-12T01:35:32.524627+0000","last_peered":"2024-09-12T01:35:32.524627+0000","last_clean":"2024-09-12T01:35:32.524627+0000","last_became_active":"2024-09-12T00:28:33.209028+0000","last_became_peered":"2024-09-12T00:28:33.209028+0000","last_unstale":"2024-09-12T01:35:32.524627+0000","last_undegraded":"2024-09-12T01:35:32.524627+0000","last_fullsized":"2024-09-12T01:35:32.524627+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:20.185402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":877,"num_read_kb":721,"num_write":304,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"263'262","reported_seq":931,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:55.258184+0000","last_change":"2024-09-12T00:28:31.203730+0000","last_active":"2024-09-12T01:35:55.258184+0000","last_peered":"2024-09-12T01:35:55.258184+0000","last_clean":"2024-09-12T01:35:55.258184+0000","last_became_active":"2024-09-12T00:28:31.203185+0000","last_became_peered":"2024-09-12T00:28:31.203185+0000","last_unstale":"2024-09-12T01:35:55.258184+0000","last_undegraded":"2024-09-12T01:35:55.258184+0000","last_fullsized":"2024-09-12T01:35:55.258184+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:39.470819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20475208,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":440,"num_read_kb":88705,"num_write":979,"num_write_kb":43642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"263'403","reported_seq":1080,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.783830+0000","last_change":"2024-09-12T00:29:04.275730+0000","last_active":"2024-09-12T01:33:56.783830+0000","last_peered":"2024-09-12T01:33:56.783830+0000","last_clean":"2024-09-12T01:33:56.783830+0000","last_became_active":"2024-09-12T00:29:04.275434+0000","last_became_peered":"2024-09-12T00:29:04.275434+0000","last_unstale":"2024-09-12T01:33:56.783830+0000","last_undegraded":"2024-09-12T01:33:56.783830+0000","last_fullsized":"2024-09-12T01:33:56.783830+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:49.369214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1782,"num_read_kb":1435,"num_write":639,"num_write_kb":352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"263'272","reported_seq":909,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:47.796028+0000","last_change":"2024-09-12T00:28:31.209794+0000","last_active":"2024-09-12T01:35:47.796028+0000","last_peered":"2024-09-12T01:35:47.796028+0000","last_clean":"2024-09-12T01:35:47.796028+0000","last_became_active":"2024-09-12T00:28:31.209468+0000","last_became_peered":"2024-09-12T00:28:31.209468+0000","last_unstale":"2024-09-12T01:35:47.796028+0000","last_undegraded":"2024-09-12T01:35:47.796028+0000","last_fullsized":"2024-09-12T01:35:47.796028+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:32.906913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7261358,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":440,"num_read_kb":2644,"num_write":984,"num_write_kb":18676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"263'161","reported_seq":736,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:29.654561+0000","last_change":"2024-09-12T00:28:33.208952+0000","last_active":"2024-09-12T01:35:29.654561+0000","last_peered":"2024-09-12T01:35:29.654561+0000","last_clean":"2024-09-12T01:35:29.654561+0000","last_became_active":"2024-09-12T00:28:33.208285+0000","last_became_peered":"2024-09-12T00:28:33.208285+0000","last_unstale":"2024-09-12T01:35:29.654561+0000","last_undegraded":"2024-09-12T01:35:29.654561+0000","last_fullsized":"2024-09-12T01:35:29.654561+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:58.828709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":689,"num_read_kb":558,"num_write":246,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"263'295","reported_seq":925,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:14.115203+0000","last_change":"2024-09-12T00:28:31.200270+0000","last_active":"2024-09-12T01:35:14.115203+0000","last_peered":"2024-09-12T01:35:14.115203+0000","last_clean":"2024-09-12T01:35:14.115203+0000","last_became_active":"2024-09-12T00:28:31.199924+0000","last_became_peered":"2024-09-12T00:28:31.199924+0000","last_unstale":"2024-09-12T01:35:14.115203+0000","last_undegraded":"2024-09-12T01:35:14.115203+0000","last_fullsized":"2024-09-12T01:35:14.115203+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:27.025158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7365505,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":426,"num_read_kb":12716,"num_write":1056,"num_write_kb":44871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"263'322","reported_seq":999,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:41.195483+0000","last_change":"2024-09-12T00:28:33.208356+0000","last_active":"2024-09-12T01:35:41.195483+0000","last_peered":"2024-09-12T01:35:41.195483+0000","last_clean":"2024-09-12T01:35:41.195483+0000","last_became_active":"2024-09-12T00:28:33.208088+0000","last_became_peered":"2024-09-12T00:28:33.208088+0000","last_unstale":"2024-09-12T01:35:41.195483+0000","last_undegraded":"2024-09-12T01:35:41.195483+0000","last_fullsized":"2024-09-12T01:35:41.195483+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:12.972774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1424,"num_read_kb":1183,"num_write":488,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"263'282","reported_seq":950,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:47.779071+0000","last_change":"2024-09-12T00:28:31.211421+0000","last_active":"2024-09-12T01:33:47.779071+0000","last_peered":"2024-09-12T01:33:47.779071+0000","last_clean":"2024-09-12T01:33:47.779071+0000","last_became_active":"2024-09-12T00:28:31.211083+0000","last_became_peered":"2024-09-12T00:28:31.211083+0000","last_unstale":"2024-09-12T01:33:47.779071+0000","last_undegraded":"2024-09-12T01:33:47.779071+0000","last_fullsized":"2024-09-12T01:33:47.779071+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:55.832817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":595266,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":542,"num_read_kb":3403,"num_write":1168,"num_write_kb":8870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"263'152","reported_seq":767,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:02.380980+0000","last_change":"2024-09-12T00:28:33.209816+0000","last_active":"2024-09-12T01:36:02.380980+0000","last_peered":"2024-09-12T01:36:02.380980+0000","last_clean":"2024-09-12T01:36:02.380980+0000","last_became_active":"2024-09-12T00:28:33.209024+0000","last_became_peered":"2024-09-12T00:28:33.209024+0000","last_unstale":"2024-09-12T01:36:02.380980+0000","last_undegraded":"2024-09-12T01:36:02.380980+0000","last_fullsized":"2024-09-12T01:36:02.380980+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:09.766449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":684,"num_read_kb":599,"num_write":231,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"263'309","reported_seq":927,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.752002+0000","last_change":"2024-09-12T00:28:31.207686+0000","last_active":"2024-09-12T01:38:01.752002+0000","last_peered":"2024-09-12T01:38:01.752002+0000","last_clean":"2024-09-12T01:38:01.752002+0000","last_became_active":"2024-09-12T00:28:31.207399+0000","last_became_peered":"2024-09-12T00:28:31.207399+0000","last_unstale":"2024-09-12T01:38:01.752002+0000","last_undegraded":"2024-09-12T01:38:01.752002+0000","last_fullsized":"2024-09-12T01:38:01.752002+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:23.656345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":660490,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":412,"num_read_kb":9232,"num_write":885,"num_write_kb":18206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"263'63","reported_seq":616,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:31.055891+0000","last_change":"2024-09-12T00:28:33.213456+0000","last_active":"2024-09-12T01:35:31.055891+0000","last_peered":"2024-09-12T01:35:31.055891+0000","last_clean":"2024-09-12T01:35:31.055891+0000","last_became_active":"2024-09-12T00:28:33.213110+0000","last_became_peered":"2024-09-12T00:28:33.213110+0000","last_unstale":"2024-09-12T01:35:31.055891+0000","last_undegraded":"2024-09-12T01:35:31.055891+0000","last_fullsized":"2024-09-12T01:35:31.055891+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:43.946245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":226,"num_write":102,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"263'347","reported_seq":1020,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.519322+0000","last_change":"2024-09-12T00:28:31.203837+0000","last_active":"2024-09-12T01:38:01.519322+0000","last_peered":"2024-09-12T01:38:01.519322+0000","last_clean":"2024-09-12T01:38:01.519322+0000","last_became_active":"2024-09-12T00:28:31.203478+0000","last_became_peered":"2024-09-12T00:28:31.203478+0000","last_unstale":"2024-09-12T01:38:01.519322+0000","last_undegraded":"2024-09-12T01:38:01.519322+0000","last_fullsized":"2024-09-12T01:38:01.519322+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:31.896358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524422,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":625,"num_read_kb":38935,"num_write":1076,"num_write_kb":32997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"263'193","reported_seq":781,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.783140+0000","last_change":"2024-09-12T00:28:33.220290+0000","last_active":"2024-09-12T01:33:51.783140+0000","last_peered":"2024-09-12T01:33:51.783140+0000","last_clean":"2024-09-12T01:33:51.783140+0000","last_became_active":"2024-09-12T00:28:33.220013+0000","last_became_peered":"2024-09-12T00:28:33.220013+0000","last_unstale":"2024-09-12T01:33:51.783140+0000","last_undegraded":"2024-09-12T01:33:51.783140+0000","last_fullsized":"2024-09-12T01:33:51.783140+0000","mapping_epoch":27,"log_start":"260'100","ondisk_log_start":"260'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:33.307077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":806,"num_read_kb":650,"num_write":294,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"263'313","reported_seq":930,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.701869+0000","last_change":"2024-09-12T00:28:31.204579+0000","last_active":"2024-09-12T01:38:01.701869+0000","last_peered":"2024-09-12T01:38:01.701869+0000","last_clean":"2024-09-12T01:38:01.701869+0000","last_became_active":"2024-09-12T00:28:31.204305+0000","last_became_peered":"2024-09-12T00:28:31.204305+0000","last_unstale":"2024-09-12T01:38:01.701869+0000","last_undegraded":"2024-09-12T01:38:01.701869+0000","last_fullsized":"2024-09-12T01:38:01.701869+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:37.446006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133673,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":474,"num_read_kb":11794,"num_write":1039,"num_write_kb":34532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"263'110","reported_seq":720,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:25.136847+0000","last_change":"2024-09-12T00:28:33.217086+0000","last_active":"2024-09-12T01:35:25.136847+0000","last_peered":"2024-09-12T01:35:25.136847+0000","last_clean":"2024-09-12T01:35:25.136847+0000","last_became_active":"2024-09-12T00:28:33.216814+0000","last_became_peered":"2024-09-12T00:28:33.216814+0000","last_unstale":"2024-09-12T01:35:25.136847+0000","last_undegraded":"2024-09-12T01:35:25.136847+0000","last_fullsized":"2024-09-12T01:35:25.136847+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:27.405799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":456,"num_read_kb":389,"num_write":151,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"263'346","reported_seq":1029,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.491744+0000","last_change":"2024-09-12T00:28:31.200695+0000","last_active":"2024-09-12T01:38:01.491744+0000","last_peered":"2024-09-12T01:38:01.491744+0000","last_clean":"2024-09-12T01:38:01.491744+0000","last_became_active":"2024-09-12T00:28:31.200421+0000","last_became_peered":"2024-09-12T00:28:31.200421+0000","last_unstale":"2024-09-12T01:38:01.491744+0000","last_undegraded":"2024-09-12T01:38:01.491744+0000","last_fullsized":"2024-09-12T01:38:01.491744+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:56.623886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1658550,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":533,"num_read_kb":83268,"num_write":1169,"num_write_kb":21609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"263'106","reported_seq":683,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:41.519720+0000","last_change":"2024-09-12T00:28:33.213440+0000","last_active":"2024-09-12T01:36:41.519720+0000","last_peered":"2024-09-12T01:36:41.519720+0000","last_clean":"2024-09-12T01:36:41.519720+0000","last_became_active":"2024-09-12T00:28:33.213100+0000","last_became_peered":"2024-09-12T00:28:33.213100+0000","last_unstale":"2024-09-12T01:36:41.519720+0000","last_undegraded":"2024-09-12T01:36:41.519720+0000","last_fullsized":"2024-09-12T01:36:41.519720+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:38.213563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":481,"num_read_kb":399,"num_write":154,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"263'288","reported_seq":976,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:52.780018+0000","last_change":"2024-09-12T00:28:31.215965+0000","last_active":"2024-09-12T01:33:52.780018+0000","last_peered":"2024-09-12T01:33:52.780018+0000","last_clean":"2024-09-12T01:33:52.780018+0000","last_became_active":"2024-09-12T00:28:31.215581+0000","last_became_peered":"2024-09-12T00:28:31.215581+0000","last_unstale":"2024-09-12T01:33:52.780018+0000","last_undegraded":"2024-09-12T01:33:52.780018+0000","last_fullsized":"2024-09-12T01:33:52.780018+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:38.099218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9952782,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":520,"num_read_kb":13302,"num_write":1130,"num_write_kb":31930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"263'248","reported_seq":888,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:24.851885+0000","last_change":"2024-09-12T00:28:31.214764+0000","last_active":"2024-09-12T01:36:24.851885+0000","last_peered":"2024-09-12T01:36:24.851885+0000","last_clean":"2024-09-12T01:36:24.851885+0000","last_became_active":"2024-09-12T00:28:31.214134+0000","last_became_peered":"2024-09-12T00:28:31.214134+0000","last_unstale":"2024-09-12T01:36:24.851885+0000","last_undegraded":"2024-09-12T01:36:24.851885+0000","last_fullsized":"2024-09-12T01:36:24.851885+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:00.479671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17637685,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":410,"num_read_kb":31725,"num_write":951,"num_write_kb":40420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"263'102","reported_seq":694,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:01.784409+0000","last_change":"2024-09-12T00:28:33.213186+0000","last_active":"2024-09-12T01:34:01.784409+0000","last_peered":"2024-09-12T01:34:01.784409+0000","last_clean":"2024-09-12T01:34:01.784409+0000","last_became_active":"2024-09-12T00:28:33.212886+0000","last_became_peered":"2024-09-12T00:28:33.212886+0000","last_unstale":"2024-09-12T01:34:01.784409+0000","last_undegraded":"2024-09-12T01:34:01.784409+0000","last_fullsized":"2024-09-12T01:34:01.784409+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:53.462824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":476,"num_read_kb":407,"num_write":159,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"263'328","reported_seq":1075,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:24.851441+0000","last_change":"2024-09-12T00:28:31.197815+0000","last_active":"2024-09-12T01:36:24.851441+0000","last_peered":"2024-09-12T01:36:24.851441+0000","last_clean":"2024-09-12T01:36:24.851441+0000","last_became_active":"2024-09-12T00:28:31.196230+0000","last_became_peered":"2024-09-12T00:28:31.196230+0000","last_unstale":"2024-09-12T01:36:24.851441+0000","last_undegraded":"2024-09-12T01:36:24.851441+0000","last_fullsized":"2024-09-12T01:36:24.851441+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:32.020082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17586873,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":667,"num_read_kb":35667,"num_write":1224,"num_write_kb":40181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"263'212","reported_seq":801,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:01.455973+0000","last_change":"2024-09-12T00:28:33.213479+0000","last_active":"2024-09-12T01:34:01.455973+0000","last_peered":"2024-09-12T01:34:01.455973+0000","last_clean":"2024-09-12T01:34:01.455973+0000","last_became_active":"2024-09-12T00:28:33.213187+0000","last_became_peered":"2024-09-12T00:28:33.213187+0000","last_unstale":"2024-09-12T01:34:01.455973+0000","last_undegraded":"2024-09-12T01:34:01.455973+0000","last_fullsized":"2024-09-12T01:34:01.455973+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:03.213237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":884,"num_read_kb":712,"num_write":323,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5759,"num_read_kb":4046,"num_write":1929,"num_write_kb":827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1000,"ondisk_log_size":1000,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15395,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":15045,"num_read_kb":14706,"num_write":16739,"num_write_kb":4892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1773,"ondisk_log_size":1773,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":501,"ondisk_log_size":501,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1671029,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":18659,"num_read_kb":37297,"num_write":15679,"num_write_kb":11858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1867776,"data_stored":1469111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1974,"ondisk_log_size":1974,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2396,"num_read_kb":2858,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":103056,"num_read_kb":85959,"num_write":37323,"num_write_kb":18865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4302,"ondisk_log_size":4302,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":296689113,"num_objects":2352,"num_object_clones":0,"num_object_copies":4704,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2352,"num_whiteouts":0,"num_read":34160,"num_read_kb":1909912,"num_write":69355,"num_write_kb":2052201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":593608704,"data_stored":578270824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3943,"ondisk_log_size":3943,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":32514020,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":122,"num_read_kb":175308,"num_write":144,"num_write_kb":116383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":27197,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":72998912,"data_stored":72992692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":84,"ondisk_log_size":84,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":11534336,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":131,"num_read_kb":178855,"num_write":152,"num_write_kb":116383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":46772224,"data_stored":46770128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510283,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":259636,"kb_used_data":29848,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94112204,"statfs":{"total":96636764160,"available":96370896896,"internally_reserved":0,"allocated":30564352,"data_stored":27856316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":235207114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510282,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":263728,"kb_used_data":33884,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94108112,"statfs":{"total":96636764160,"available":96366706688,"internally_reserved":0,"allocated":34697216,"data_stored":32019931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":235207110},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510284,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":314256,"kb_used_data":202624,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94057584,"statfs":{"total":96636764160,"available":96314966016,"internally_reserved":0,"allocated":207486976,"data_stored":200875094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510281,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":210132,"kb_used_data":142808,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94161708,"statfs":{"total":96636764160,"available":96421588992,"internally_reserved":0,"allocated":146235392,"data_stored":141707397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510284,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":106688,"kb_used_data":57356,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94265152,"statfs":{"total":96636764160,"available":96527515648,"internally_reserved":0,"allocated":58732544,"data_stored":55554255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510286,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":271812,"kb_used_data":164340,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94100028,"statfs":{"total":96636764160,"available":96358428672,"internally_reserved":0,"allocated":168284160,"data_stored":163763127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110033349},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510285,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302192,"kb_used_data":58492,"kb_used_omap":1,"kb_used_meta":243518,"kb_avail":94069648,"statfs":{"total":96636764160,"available":96327319552,"internally_reserved":0,"allocated":59895808,"data_stored":56705710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":249362885},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575690,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":465020,"kb_used_data":213100,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":93906820,"statfs":{"total":96636764160,"available":96160583680,"internally_reserved":0,"allocated":218214400,"data_stored":211568643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":257948104},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":31928320,"data_stored":31687986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":124751872,"data_stored":121780828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16175104,"data_stored":15670618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":173539328,"data_stored":168466743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":34234368,"data_stored":33463876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":179056640,"data_stored":174053234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":18251776,"data_stored":17721878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15671296,"data_stored":15425661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":487424,"data_stored":416106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":569344,"data_stored":480013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":675840,"data_stored":569274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16826368,"data_stored":16825637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20508672,"data_stored":20507307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":3145728,"data_stored":3145728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22605824,"data_stored":22604459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3145728,"data_stored":3145728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":19984384,"data_stored":19979529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:38:03.625 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:38:03.944 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:38:03.956 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T01:38:03.958 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":2352,"stamp":"2024-09-12T01:38:01.938531+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":343016073,"num_objects":2715,"num_object_clones":0,"num_object_copies":5430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2715,"num_whiteouts":0,"num_read":179406,"num_read_kb":2409008,"num_write":141464,"num_write_kb":2323065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":27197,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13762,"ondisk_log_size":13762,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2193464,"kb_used_data":902452,"kb_used_omap":12,"kb_used_meta":1290355,"kb_avail":752781256,"statfs":{"total":773094113280,"available":770848006144,"internally_reserved":0,"allocated":924110848,"data_stored":890050473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1321324081},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-344916886,"num_objects":-2098,"num_object_clones":0,"num_object_copies":-4196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2098,"num_whiteouts":0,"num_read":2347,"num_read_kb":1949,"num_write":2227,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004864"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:17.783401+0000","last_change":"2024-09-12T01:04:15.393241+0000","last_active":"2024-09-12T01:34:17.783401+0000","last_peered":"2024-09-12T01:34:17.783401+0000","last_clean":"2024-09-12T01:34:17.783401+0000","last_became_active":"2024-09-12T01:04:15.392944+0000","last_became_peered":"2024-09-12T01:04:15.392944+0000","last_unstale":"2024-09-12T01:34:17.783401+0000","last_undegraded":"2024-09-12T01:34:17.783401+0000","last_fullsized":"2024-09-12T01:34:17.783401+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:32.532552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"263'6","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:57.780602+0000","last_change":"2024-09-12T00:46:26.362583+0000","last_active":"2024-09-12T01:33:57.780602+0000","last_peered":"2024-09-12T01:33:57.780602+0000","last_clean":"2024-09-12T01:33:57.780602+0000","last_became_active":"2024-09-12T00:46:26.362231+0000","last_became_peered":"2024-09-12T00:46:26.362231+0000","last_unstale":"2024-09-12T01:33:57.780602+0000","last_undegraded":"2024-09-12T01:33:57.780602+0000","last_fullsized":"2024-09-12T01:33:57.780602+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:47.340687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":19456,"num_write":11,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:54.637545+0000","last_change":"2024-09-12T00:46:22.353581+0000","last_active":"2024-09-12T01:33:54.637545+0000","last_peered":"2024-09-12T01:33:54.637545+0000","last_clean":"2024-09-12T01:33:54.637545+0000","last_became_active":"2024-09-12T00:46:22.353306+0000","last_became_peered":"2024-09-12T00:46:22.353306+0000","last_unstale":"2024-09-12T01:33:54.637545+0000","last_undegraded":"2024-09-12T01:33:54.637545+0000","last_fullsized":"2024-09-12T01:33:54.637545+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:42.123772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"263'59","reported_seq":219,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:41.789494+0000","last_change":"2024-09-12T00:42:36.818643+0000","last_active":"2024-09-12T01:34:41.789494+0000","last_peered":"2024-09-12T01:34:41.789494+0000","last_clean":"2024-09-12T01:34:41.789494+0000","last_became_active":"2024-09-12T00:42:36.818329+0000","last_became_peered":"2024-09-12T00:42:36.818329+0000","last_unstale":"2024-09-12T01:34:41.789494+0000","last_undegraded":"2024-09-12T01:34:41.789494+0000","last_fullsized":"2024-09-12T01:34:41.789494+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:59.176386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":293,"num_read_kb":205,"num_write":105,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:16.629694+0000","last_change":"2024-09-12T01:04:15.393046+0000","last_active":"2024-09-12T01:34:16.629694+0000","last_peered":"2024-09-12T01:34:16.629694+0000","last_clean":"2024-09-12T01:34:16.629694+0000","last_became_active":"2024-09-12T01:04:15.392747+0000","last_became_peered":"2024-09-12T01:04:15.392747+0000","last_unstale":"2024-09-12T01:34:16.629694+0000","last_undegraded":"2024-09-12T01:34:16.629694+0000","last_fullsized":"2024-09-12T01:34:16.629694+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:12.627526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"263'2","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.534462+0000","last_change":"2024-09-12T00:46:26.370283+0000","last_active":"2024-09-12T01:33:56.534462+0000","last_peered":"2024-09-12T01:33:56.534462+0000","last_clean":"2024-09-12T01:33:56.534462+0000","last_became_active":"2024-09-12T00:46:26.369944+0000","last_became_peered":"2024-09-12T00:46:26.369944+0000","last_unstale":"2024-09-12T01:33:56.534462+0000","last_undegraded":"2024-09-12T01:33:56.534462+0000","last_fullsized":"2024-09-12T01:33:56.534462+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:14.648408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"260'8","reported_seq":70,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.933295+0000","last_change":"2024-09-12T00:46:22.354256+0000","last_active":"2024-09-12T01:33:51.933295+0000","last_peered":"2024-09-12T01:33:51.933295+0000","last_clean":"2024-09-12T01:33:51.933295+0000","last_became_active":"2024-09-12T00:46:22.352009+0000","last_became_peered":"2024-09-12T00:46:22.352009+0000","last_unstale":"2024-09-12T01:33:51.933295+0000","last_undegraded":"2024-09-12T01:33:51.933295+0000","last_fullsized":"2024-09-12T01:33:51.933295+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:27.873653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":26626,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"263'20","reported_seq":116,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:56.533176+0000","last_change":"2024-09-12T00:42:36.809720+0000","last_active":"2024-09-12T01:34:56.533176+0000","last_peered":"2024-09-12T01:34:56.533176+0000","last_clean":"2024-09-12T01:34:56.533176+0000","last_became_active":"2024-09-12T00:42:36.809431+0000","last_became_peered":"2024-09-12T00:42:36.809431+0000","last_unstale":"2024-09-12T01:34:56.533176+0000","last_undegraded":"2024-09-12T01:34:56.533176+0000","last_fullsized":"2024-09-12T01:34:56.533176+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:09.971874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":73,"num_write":40,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:16.528384+0000","last_change":"2024-09-12T01:04:15.384612+0000","last_active":"2024-09-12T01:33:16.528384+0000","last_peered":"2024-09-12T01:33:16.528384+0000","last_clean":"2024-09-12T01:33:16.528384+0000","last_became_active":"2024-09-12T01:04:15.384312+0000","last_became_peered":"2024-09-12T01:04:15.384312+0000","last_unstale":"2024-09-12T01:33:16.528384+0000","last_undegraded":"2024-09-12T01:33:16.528384+0000","last_fullsized":"2024-09-12T01:33:16.528384+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:27.357127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:21.786809+0000","last_change":"2024-09-12T00:46:26.563569+0000","last_active":"2024-09-12T01:34:21.786809+0000","last_peered":"2024-09-12T01:34:21.786809+0000","last_clean":"2024-09-12T01:34:21.786809+0000","last_became_active":"2024-09-12T00:46:26.563267+0000","last_became_peered":"2024-09-12T00:46:26.563267+0000","last_unstale":"2024-09-12T01:34:21.786809+0000","last_undegraded":"2024-09-12T01:34:21.786809+0000","last_fullsized":"2024-09-12T01:34:21.786809+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:14.364154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"260'3","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:41.531630+0000","last_change":"2024-09-12T00:46:22.341443+0000","last_active":"2024-09-12T01:34:41.531630+0000","last_peered":"2024-09-12T01:34:41.531630+0000","last_clean":"2024-09-12T01:34:41.531630+0000","last_became_active":"2024-09-12T00:46:22.340655+0000","last_became_peered":"2024-09-12T00:46:22.340655+0000","last_unstale":"2024-09-12T01:34:41.531630+0000","last_undegraded":"2024-09-12T01:34:41.531630+0000","last_fullsized":"2024-09-12T01:34:41.531630+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:34.773392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"263'63","reported_seq":226,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:06.792053+0000","last_change":"2024-09-12T00:42:36.814795+0000","last_active":"2024-09-12T01:35:06.792053+0000","last_peered":"2024-09-12T01:35:06.792053+0000","last_clean":"2024-09-12T01:35:06.792053+0000","last_became_active":"2024-09-12T00:42:36.814510+0000","last_became_peered":"2024-09-12T00:42:36.814510+0000","last_unstale":"2024-09-12T01:35:06.792053+0000","last_undegraded":"2024-09-12T01:35:06.792053+0000","last_fullsized":"2024-09-12T01:35:06.792053+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:42.130114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":321,"num_read_kb":228,"num_write":110,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:19.633277+0000","last_change":"2024-09-12T01:04:15.402204+0000","last_active":"2024-09-12T01:33:19.633277+0000","last_peered":"2024-09-12T01:33:19.633277+0000","last_clean":"2024-09-12T01:33:19.633277+0000","last_became_active":"2024-09-12T01:04:15.401897+0000","last_became_peered":"2024-09-12T01:04:15.401897+0000","last_unstale":"2024-09-12T01:33:19.633277+0000","last_undegraded":"2024-09-12T01:33:19.633277+0000","last_fullsized":"2024-09-12T01:33:19.633277+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:27.841236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:39.642849+0000","last_change":"2024-09-12T00:46:26.562165+0000","last_active":"2024-09-12T01:34:39.642849+0000","last_peered":"2024-09-12T01:34:39.642849+0000","last_clean":"2024-09-12T01:34:39.642849+0000","last_became_active":"2024-09-12T00:46:26.561870+0000","last_became_peered":"2024-09-12T00:46:26.561870+0000","last_unstale":"2024-09-12T01:34:39.642849+0000","last_undegraded":"2024-09-12T01:34:39.642849+0000","last_fullsized":"2024-09-12T01:34:39.642849+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:20.530939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"263'6","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.235708+0000","last_change":"2024-09-12T00:46:22.339498+0000","last_active":"2024-09-12T01:38:00.235708+0000","last_peered":"2024-09-12T01:38:00.235708+0000","last_clean":"2024-09-12T01:38:00.235708+0000","last_became_active":"2024-09-12T00:46:22.339141+0000","last_became_peered":"2024-09-12T00:46:22.339141+0000","last_unstale":"2024-09-12T01:38:00.235708+0000","last_undegraded":"2024-09-12T01:38:00.235708+0000","last_fullsized":"2024-09-12T01:38:00.235708+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:45.856718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"263'62","reported_seq":225,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:09.646373+0000","last_change":"2024-09-12T00:42:36.816859+0000","last_active":"2024-09-12T01:35:09.646373+0000","last_peered":"2024-09-12T01:35:09.646373+0000","last_clean":"2024-09-12T01:35:09.646373+0000","last_became_active":"2024-09-12T00:42:36.816570+0000","last_became_peered":"2024-09-12T00:42:36.816570+0000","last_unstale":"2024-09-12T01:35:09.646373+0000","last_undegraded":"2024-09-12T01:35:09.646373+0000","last_fullsized":"2024-09-12T01:35:09.646373+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:03.911054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":318,"num_read_kb":239,"num_write":100,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:19.640647+0000","last_change":"2024-09-12T01:04:15.400469+0000","last_active":"2024-09-12T01:34:19.640647+0000","last_peered":"2024-09-12T01:34:19.640647+0000","last_clean":"2024-09-12T01:34:19.640647+0000","last_became_active":"2024-09-12T01:04:15.400228+0000","last_became_peered":"2024-09-12T01:04:15.400228+0000","last_unstale":"2024-09-12T01:34:19.640647+0000","last_undegraded":"2024-09-12T01:34:19.640647+0000","last_fullsized":"2024-09-12T01:34:19.640647+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:12.710997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"263'7","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:52.788364+0000","last_change":"2024-09-12T00:46:26.368145+0000","last_active":"2024-09-12T01:34:52.788364+0000","last_peered":"2024-09-12T01:34:52.788364+0000","last_clean":"2024-09-12T01:34:52.788364+0000","last_became_active":"2024-09-12T00:46:26.367849+0000","last_became_peered":"2024-09-12T00:46:26.367849+0000","last_unstale":"2024-09-12T01:34:52.788364+0000","last_undegraded":"2024-09-12T01:34:52.788364+0000","last_fullsized":"2024-09-12T01:34:52.788364+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:35.175209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":7168,"num_write":17,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"263'13","reported_seq":83,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:06.806586+0000","last_change":"2024-09-12T00:46:22.351181+0000","last_active":"2024-09-12T01:37:06.806586+0000","last_peered":"2024-09-12T01:37:06.806586+0000","last_clean":"2024-09-12T01:37:06.806586+0000","last_became_active":"2024-09-12T00:46:22.349597+0000","last_became_peered":"2024-09-12T00:46:22.349597+0000","last_unstale":"2024-09-12T01:37:06.806586+0000","last_undegraded":"2024-09-12T01:37:06.806586+0000","last_fullsized":"2024-09-12T01:37:06.806586+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:58.755945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":44034,"num_write":28,"num_write_kb":19456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"263'28","reported_seq":129,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:09.646341+0000","last_change":"2024-09-12T00:42:36.815076+0000","last_active":"2024-09-12T01:35:09.646341+0000","last_peered":"2024-09-12T01:35:09.646341+0000","last_clean":"2024-09-12T01:35:09.646341+0000","last_became_active":"2024-09-12T00:42:36.814799+0000","last_became_peered":"2024-09-12T00:42:36.814799+0000","last_unstale":"2024-09-12T01:35:09.646341+0000","last_undegraded":"2024-09-12T01:35:09.646341+0000","last_fullsized":"2024-09-12T01:35:09.646341+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:46.026762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":94,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:31.946433+0000","last_change":"2024-09-12T01:04:15.388981+0000","last_active":"2024-09-12T01:35:31.946433+0000","last_peered":"2024-09-12T01:35:31.946433+0000","last_clean":"2024-09-12T01:35:31.946433+0000","last_became_active":"2024-09-12T01:04:15.388593+0000","last_became_peered":"2024-09-12T01:04:15.388593+0000","last_unstale":"2024-09-12T01:35:31.946433+0000","last_undegraded":"2024-09-12T01:35:31.946433+0000","last_fullsized":"2024-09-12T01:35:31.946433+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:42.435298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"260'2","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:46.540932+0000","last_change":"2024-09-12T00:47:05.446932+0000","last_active":"2024-09-12T01:34:46.540932+0000","last_peered":"2024-09-12T01:34:46.540932+0000","last_clean":"2024-09-12T01:34:46.540932+0000","last_became_active":"2024-09-12T00:47:05.444004+0000","last_became_peered":"2024-09-12T00:47:05.444004+0000","last_unstale":"2024-09-12T01:34:46.540932+0000","last_undegraded":"2024-09-12T01:34:46.540932+0000","last_fullsized":"2024-09-12T01:34:46.540932+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:13.946930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":27197,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"263'2","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:21.563798+0000","last_change":"2024-09-12T00:46:22.348331+0000","last_active":"2024-09-12T01:37:21.563798+0000","last_peered":"2024-09-12T01:37:21.563798+0000","last_clean":"2024-09-12T01:37:21.563798+0000","last_became_active":"2024-09-12T00:46:22.347338+0000","last_became_peered":"2024-09-12T00:46:22.347338+0000","last_unstale":"2024-09-12T01:37:21.563798+0000","last_undegraded":"2024-09-12T01:37:21.563798+0000","last_fullsized":"2024-09-12T01:37:21.563798+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:08.989061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"260'71","reported_seq":297,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:06.543849+0000","last_change":"2024-09-12T00:42:36.812768+0000","last_active":"2024-09-12T01:35:06.543849+0000","last_peered":"2024-09-12T01:35:06.543849+0000","last_clean":"2024-09-12T01:35:06.543849+0000","last_became_active":"2024-09-12T00:42:36.812454+0000","last_became_peered":"2024-09-12T00:42:36.812454+0000","last_unstale":"2024-09-12T01:35:06.543849+0000","last_undegraded":"2024-09-12T01:35:06.543849+0000","last_fullsized":"2024-09-12T01:35:06.543849+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:06.880124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":475,"num_read_kb":319,"num_write":83,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"263'1","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:16.721868+0000","last_change":"2024-09-12T01:04:15.391988+0000","last_active":"2024-09-12T01:34:16.721868+0000","last_peered":"2024-09-12T01:34:16.721868+0000","last_clean":"2024-09-12T01:34:16.721868+0000","last_became_active":"2024-09-12T01:04:15.391532+0000","last_became_peered":"2024-09-12T01:04:15.391532+0000","last_unstale":"2024-09-12T01:34:16.721868+0000","last_undegraded":"2024-09-12T01:34:16.721868+0000","last_fullsized":"2024-09-12T01:34:16.721868+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:13.040622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"263'6","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.236119+0000","last_change":"2024-09-12T00:46:26.374943+0000","last_active":"2024-09-12T01:38:00.236119+0000","last_peered":"2024-09-12T01:38:00.236119+0000","last_clean":"2024-09-12T01:38:00.236119+0000","last_became_active":"2024-09-12T00:46:26.374660+0000","last_became_peered":"2024-09-12T00:46:26.374660+0000","last_unstale":"2024-09-12T01:38:00.236119+0000","last_undegraded":"2024-09-12T01:38:00.236119+0000","last_fullsized":"2024-09-12T01:38:00.236119+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:20.054984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"263'7","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:21.555167+0000","last_change":"2024-09-12T00:46:22.340546+0000","last_active":"2024-09-12T01:36:21.555167+0000","last_peered":"2024-09-12T01:36:21.555167+0000","last_clean":"2024-09-12T01:36:21.555167+0000","last_became_active":"2024-09-12T00:46:22.340228+0000","last_became_peered":"2024-09-12T00:46:22.340228+0000","last_unstale":"2024-09-12T01:36:21.555167+0000","last_undegraded":"2024-09-12T01:36:21.555167+0000","last_fullsized":"2024-09-12T01:36:21.555167+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:22.609852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6219,"num_write":7,"num_write_kb":6219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"263'129","reported_seq":431,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:31.780542+0000","last_change":"2024-09-12T00:42:36.813186+0000","last_active":"2024-09-12T01:33:31.780542+0000","last_peered":"2024-09-12T01:33:31.780542+0000","last_clean":"2024-09-12T01:33:31.780542+0000","last_became_active":"2024-09-12T00:42:36.812882+0000","last_became_peered":"2024-09-12T00:42:36.812882+0000","last_unstale":"2024-09-12T01:33:31.780542+0000","last_undegraded":"2024-09-12T01:33:31.780542+0000","last_fullsized":"2024-09-12T01:33:31.780542+0000","mapping_epoch":250,"log_start":"260'100","ondisk_log_start":"260'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:07.773148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":723,"num_read_kb":503,"num_write":193,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:16.721896+0000","last_change":"2024-09-12T01:04:15.398861+0000","last_active":"2024-09-12T01:34:16.721896+0000","last_peered":"2024-09-12T01:34:16.721896+0000","last_clean":"2024-09-12T01:34:16.721896+0000","last_became_active":"2024-09-12T01:04:15.398533+0000","last_became_peered":"2024-09-12T01:04:15.398533+0000","last_unstale":"2024-09-12T01:34:16.721896+0000","last_undegraded":"2024-09-12T01:34:16.721896+0000","last_fullsized":"2024-09-12T01:34:16.721896+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:15.428730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"263'3","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:59.638134+0000","last_change":"2024-09-12T00:46:26.368036+0000","last_active":"2024-09-12T01:33:59.638134+0000","last_peered":"2024-09-12T01:33:59.638134+0000","last_clean":"2024-09-12T01:33:59.638134+0000","last_became_active":"2024-09-12T00:46:26.367766+0000","last_became_peered":"2024-09-12T00:46:26.367766+0000","last_unstale":"2024-09-12T01:33:59.638134+0000","last_undegraded":"2024-09-12T01:33:59.638134+0000","last_fullsized":"2024-09-12T01:33:59.638134+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:04.823775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5246081,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":8,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.783149+0000","last_change":"2024-09-12T00:46:22.354118+0000","last_active":"2024-09-12T01:33:51.783149+0000","last_peered":"2024-09-12T01:33:51.783149+0000","last_clean":"2024-09-12T01:33:51.783149+0000","last_became_active":"2024-09-12T00:46:22.353833+0000","last_became_peered":"2024-09-12T00:46:22.353833+0000","last_unstale":"2024-09-12T01:33:51.783149+0000","last_undegraded":"2024-09-12T01:33:51.783149+0000","last_fullsized":"2024-09-12T01:33:51.783149+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:15.168253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'39","reported_seq":166,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:21.929290+0000","last_change":"2024-09-12T00:42:36.803994+0000","last_active":"2024-09-12T01:33:21.929290+0000","last_peered":"2024-09-12T01:33:21.929290+0000","last_clean":"2024-09-12T01:33:21.929290+0000","last_became_active":"2024-09-12T00:42:36.803692+0000","last_became_peered":"2024-09-12T00:42:36.803692+0000","last_unstale":"2024-09-12T01:33:21.929290+0000","last_undegraded":"2024-09-12T01:33:21.929290+0000","last_fullsized":"2024-09-12T01:33:21.929290+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:25.542741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":209,"num_read_kb":149,"num_write":77,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.938567+0000","last_change":"2024-09-12T01:04:15.385887+0000","last_active":"2024-09-12T01:34:36.938567+0000","last_peered":"2024-09-12T01:34:36.938567+0000","last_clean":"2024-09-12T01:34:36.938567+0000","last_became_active":"2024-09-12T01:04:15.385172+0000","last_became_peered":"2024-09-12T01:04:15.385172+0000","last_unstale":"2024-09-12T01:34:36.938567+0000","last_undegraded":"2024-09-12T01:34:36.938567+0000","last_fullsized":"2024-09-12T01:34:36.938567+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:15.451328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"263'3","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:49.644101+0000","last_change":"2024-09-12T00:46:26.565125+0000","last_active":"2024-09-12T01:34:49.644101+0000","last_peered":"2024-09-12T01:34:49.644101+0000","last_clean":"2024-09-12T01:34:49.644101+0000","last_became_active":"2024-09-12T00:46:26.561643+0000","last_became_peered":"2024-09-12T00:46:26.561643+0000","last_unstale":"2024-09-12T01:34:49.644101+0000","last_undegraded":"2024-09-12T01:34:49.644101+0000","last_fullsized":"2024-09-12T01:34:49.644101+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:50.221519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5247843,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":10250,"num_write":8,"num_write_kb":5125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:27.793407+0000","last_change":"2024-09-12T00:46:22.349290+0000","last_active":"2024-09-12T01:35:27.793407+0000","last_peered":"2024-09-12T01:35:27.793407+0000","last_clean":"2024-09-12T01:35:27.793407+0000","last_became_active":"2024-09-12T00:46:22.349007+0000","last_became_peered":"2024-09-12T00:46:22.349007+0000","last_unstale":"2024-09-12T01:35:27.793407+0000","last_undegraded":"2024-09-12T01:35:27.793407+0000","last_fullsized":"2024-09-12T01:35:27.793407+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:56.041981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"263'19","reported_seq":112,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:21.779391+0000","last_change":"2024-09-12T00:42:36.815233+0000","last_active":"2024-09-12T01:33:21.779391+0000","last_peered":"2024-09-12T01:33:21.779391+0000","last_clean":"2024-09-12T01:33:21.779391+0000","last_became_active":"2024-09-12T00:42:36.814846+0000","last_became_peered":"2024-09-12T00:42:36.814846+0000","last_unstale":"2024-09-12T01:33:21.779391+0000","last_undegraded":"2024-09-12T01:33:21.779391+0000","last_fullsized":"2024-09-12T01:33:21.779391+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:27.509902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":75,"num_write":34,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"263'1","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.531023+0000","last_change":"2024-09-12T01:04:15.395818+0000","last_active":"2024-09-12T01:34:36.531023+0000","last_peered":"2024-09-12T01:34:36.531023+0000","last_clean":"2024-09-12T01:34:36.531023+0000","last_became_active":"2024-09-12T01:04:15.395540+0000","last_became_peered":"2024-09-12T01:04:15.395540+0000","last_unstale":"2024-09-12T01:34:36.531023+0000","last_undegraded":"2024-09-12T01:34:36.531023+0000","last_fullsized":"2024-09-12T01:34:36.531023+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:29.002458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:39.649759+0000","last_change":"2024-09-12T00:46:26.562294+0000","last_active":"2024-09-12T01:35:39.649759+0000","last_peered":"2024-09-12T01:35:39.649759+0000","last_clean":"2024-09-12T01:35:39.649759+0000","last_became_active":"2024-09-12T00:46:26.561961+0000","last_became_peered":"2024-09-12T00:46:26.561961+0000","last_unstale":"2024-09-12T01:35:39.649759+0000","last_undegraded":"2024-09-12T01:35:39.649759+0000","last_fullsized":"2024-09-12T01:35:39.649759+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:55.068083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"260'5","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:41.725916+0000","last_change":"2024-09-12T00:46:22.351249+0000","last_active":"2024-09-12T01:34:41.725916+0000","last_peered":"2024-09-12T01:34:41.725916+0000","last_clean":"2024-09-12T01:34:41.725916+0000","last_became_active":"2024-09-12T00:46:22.350947+0000","last_became_peered":"2024-09-12T00:46:22.350947+0000","last_unstale":"2024-09-12T01:34:41.725916+0000","last_undegraded":"2024-09-12T01:34:41.725916+0000","last_fullsized":"2024-09-12T01:34:41.725916+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:16.221679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"263'28","reported_seq":135,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:24.633878+0000","last_change":"2024-09-12T00:42:36.815997+0000","last_active":"2024-09-12T01:33:24.633878+0000","last_peered":"2024-09-12T01:33:24.633878+0000","last_clean":"2024-09-12T01:33:24.633878+0000","last_became_active":"2024-09-12T00:42:36.815638+0000","last_became_peered":"2024-09-12T00:42:36.815638+0000","last_unstale":"2024-09-12T01:33:24.633878+0000","last_undegraded":"2024-09-12T01:33:24.633878+0000","last_fullsized":"2024-09-12T01:33:24.633878+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:31.983576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":103,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.724838+0000","last_change":"2024-09-12T01:04:15.391815+0000","last_active":"2024-09-12T01:34:36.724838+0000","last_peered":"2024-09-12T01:34:36.724838+0000","last_clean":"2024-09-12T01:34:36.724838+0000","last_became_active":"2024-09-12T01:04:15.391501+0000","last_became_peered":"2024-09-12T01:04:15.391501+0000","last_unstale":"2024-09-12T01:34:36.724838+0000","last_undegraded":"2024-09-12T01:34:36.724838+0000","last_fullsized":"2024-09-12T01:34:36.724838+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:28.795724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:49.644166+0000","last_change":"2024-09-12T00:46:26.563439+0000","last_active":"2024-09-12T01:34:49.644166+0000","last_peered":"2024-09-12T01:34:49.644166+0000","last_clean":"2024-09-12T01:34:49.644166+0000","last_became_active":"2024-09-12T00:46:26.563091+0000","last_became_peered":"2024-09-12T00:46:26.563091+0000","last_unstale":"2024-09-12T01:34:49.644166+0000","last_undegraded":"2024-09-12T01:34:49.644166+0000","last_fullsized":"2024-09-12T01:34:49.644166+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:05.796776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:41.531600+0000","last_change":"2024-09-12T00:46:22.354515+0000","last_active":"2024-09-12T01:34:41.531600+0000","last_peered":"2024-09-12T01:34:41.531600+0000","last_clean":"2024-09-12T01:34:41.531600+0000","last_became_active":"2024-09-12T00:46:22.354167+0000","last_became_peered":"2024-09-12T00:46:22.354167+0000","last_unstale":"2024-09-12T01:34:41.531600+0000","last_undegraded":"2024-09-12T01:34:41.531600+0000","last_fullsized":"2024-09-12T01:34:41.531600+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:09.196332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"260'8","reported_seq":81,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:21.624072+0000","last_change":"2024-09-12T00:42:36.803040+0000","last_active":"2024-09-12T01:33:21.624072+0000","last_peered":"2024-09-12T01:33:21.624072+0000","last_clean":"2024-09-12T01:33:21.624072+0000","last_became_active":"2024-09-12T00:42:36.802737+0000","last_became_peered":"2024-09-12T00:42:36.802737+0000","last_unstale":"2024-09-12T01:33:21.624072+0000","last_undegraded":"2024-09-12T01:33:21.624072+0000","last_fullsized":"2024-09-12T01:33:21.624072+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:54.260259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:37.786393+0000","last_change":"2024-09-12T01:04:15.393599+0000","last_active":"2024-09-12T01:34:37.786393+0000","last_peered":"2024-09-12T01:34:37.786393+0000","last_clean":"2024-09-12T01:34:37.786393+0000","last_became_active":"2024-09-12T01:04:15.393292+0000","last_became_peered":"2024-09-12T01:04:15.393292+0000","last_unstale":"2024-09-12T01:34:37.786393+0000","last_undegraded":"2024-09-12T01:34:37.786393+0000","last_fullsized":"2024-09-12T01:34:37.786393+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:04.044752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"263'3","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:11.562356+0000","last_change":"2024-09-12T00:46:26.371159+0000","last_active":"2024-09-12T01:37:11.562356+0000","last_peered":"2024-09-12T01:37:11.562356+0000","last_clean":"2024-09-12T01:37:11.562356+0000","last_became_active":"2024-09-12T00:46:26.370845+0000","last_became_peered":"2024-09-12T00:46:26.370845+0000","last_unstale":"2024-09-12T01:37:11.562356+0000","last_undegraded":"2024-09-12T01:37:11.562356+0000","last_fullsized":"2024-09-12T01:37:11.562356+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:36.995861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:41.789472+0000","last_change":"2024-09-12T00:46:22.349777+0000","last_active":"2024-09-12T01:34:41.789472+0000","last_peered":"2024-09-12T01:34:41.789472+0000","last_clean":"2024-09-12T01:34:41.789472+0000","last_became_active":"2024-09-12T00:46:22.348534+0000","last_became_peered":"2024-09-12T00:46:22.348534+0000","last_unstale":"2024-09-12T01:34:41.789472+0000","last_undegraded":"2024-09-12T01:34:41.789472+0000","last_fullsized":"2024-09-12T01:34:41.789472+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:19.642717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"263'16","reported_seq":98,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:11.721017+0000","last_change":"2024-09-12T00:42:36.812901+0000","last_active":"2024-09-12T01:34:11.721017+0000","last_peered":"2024-09-12T01:34:11.721017+0000","last_clean":"2024-09-12T01:34:11.721017+0000","last_became_active":"2024-09-12T00:42:36.812629+0000","last_became_peered":"2024-09-12T00:42:36.812629+0000","last_unstale":"2024-09-12T01:34:11.721017+0000","last_undegraded":"2024-09-12T01:34:11.721017+0000","last_fullsized":"2024-09-12T01:34:11.721017+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:44.152868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":48,"num_write":38,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:14.632788+0000","last_change":"2024-09-12T01:04:15.398685+0000","last_active":"2024-09-12T01:33:14.632788+0000","last_peered":"2024-09-12T01:33:14.632788+0000","last_clean":"2024-09-12T01:33:14.632788+0000","last_became_active":"2024-09-12T01:04:15.398407+0000","last_became_peered":"2024-09-12T01:04:15.398407+0000","last_unstale":"2024-09-12T01:33:14.632788+0000","last_undegraded":"2024-09-12T01:33:14.632788+0000","last_fullsized":"2024-09-12T01:33:14.632788+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:31.635332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"263'2","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:26.945832+0000","last_change":"2024-09-12T00:46:26.367154+0000","last_active":"2024-09-12T01:35:26.945832+0000","last_peered":"2024-09-12T01:35:26.945832+0000","last_clean":"2024-09-12T01:35:26.945832+0000","last_became_active":"2024-09-12T00:46:26.366602+0000","last_became_peered":"2024-09-12T00:46:26.366602+0000","last_unstale":"2024-09-12T01:35:26.945832+0000","last_undegraded":"2024-09-12T01:35:26.945832+0000","last_fullsized":"2024-09-12T01:35:26.945832+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:36.704535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"263'8","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.830541+0000","last_change":"2024-09-12T00:46:22.351729+0000","last_active":"2024-09-12T01:38:00.830541+0000","last_peered":"2024-09-12T01:38:00.830541+0000","last_clean":"2024-09-12T01:38:00.830541+0000","last_became_active":"2024-09-12T00:46:22.351432+0000","last_became_peered":"2024-09-12T00:46:22.351432+0000","last_unstale":"2024-09-12T01:38:00.830541+0000","last_undegraded":"2024-09-12T01:38:00.830541+0000","last_fullsized":"2024-09-12T01:38:00.830541+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:22.950636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":18,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"252'16","reported_seq":103,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.718650+0000","last_change":"2024-09-12T00:42:36.813580+0000","last_active":"2024-09-12T01:33:56.718650+0000","last_peered":"2024-09-12T01:33:56.718650+0000","last_clean":"2024-09-12T01:33:56.718650+0000","last_became_active":"2024-09-12T00:42:36.813324+0000","last_became_peered":"2024-09-12T00:42:36.813324+0000","last_unstale":"2024-09-12T01:33:56.718650+0000","last_undegraded":"2024-09-12T01:33:56.718650+0000","last_fullsized":"2024-09-12T01:33:56.718650+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:12.154346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":59,"num_write":21,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:16.778711+0000","last_change":"2024-09-12T01:04:15.394539+0000","last_active":"2024-09-12T01:33:16.778711+0000","last_peered":"2024-09-12T01:33:16.778711+0000","last_clean":"2024-09-12T01:33:16.778711+0000","last_became_active":"2024-09-12T01:04:15.393021+0000","last_became_peered":"2024-09-12T01:04:15.393021+0000","last_unstale":"2024-09-12T01:33:16.778711+0000","last_undegraded":"2024-09-12T01:33:16.778711+0000","last_fullsized":"2024-09-12T01:33:16.778711+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:47.214589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"260'8","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:26.945799+0000","last_change":"2024-09-12T00:46:26.371696+0000","last_active":"2024-09-12T01:35:26.945799+0000","last_peered":"2024-09-12T01:35:26.945799+0000","last_clean":"2024-09-12T01:35:26.945799+0000","last_became_active":"2024-09-12T00:46:26.371443+0000","last_became_peered":"2024-09-12T00:46:26.371443+0000","last_unstale":"2024-09-12T01:35:26.945799+0000","last_undegraded":"2024-09-12T01:35:26.945799+0000","last_fullsized":"2024-09-12T01:35:26.945799+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:26.396539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":26626,"num_write":8,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:24.648070+0000","last_change":"2024-09-12T00:46:22.352325+0000","last_active":"2024-09-12T01:35:24.648070+0000","last_peered":"2024-09-12T01:35:24.648070+0000","last_clean":"2024-09-12T01:35:24.648070+0000","last_became_active":"2024-09-12T00:46:22.350714+0000","last_became_peered":"2024-09-12T00:46:22.350714+0000","last_unstale":"2024-09-12T01:35:24.648070+0000","last_undegraded":"2024-09-12T01:35:24.648070+0000","last_fullsized":"2024-09-12T01:35:24.648070+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:40.578771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"263'52","reported_seq":201,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.783741+0000","last_change":"2024-09-12T00:42:36.818076+0000","last_active":"2024-09-12T01:33:56.783741+0000","last_peered":"2024-09-12T01:33:56.783741+0000","last_clean":"2024-09-12T01:33:56.783741+0000","last_became_active":"2024-09-12T00:42:36.817763+0000","last_became_peered":"2024-09-12T00:42:36.817763+0000","last_unstale":"2024-09-12T01:33:56.783741+0000","last_undegraded":"2024-09-12T01:33:56.783741+0000","last_fullsized":"2024-09-12T01:33:56.783741+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:56.184689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":268,"num_read_kb":195,"num_write":87,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.788740+0000","last_change":"2024-09-12T01:04:15.397100+0000","last_active":"2024-09-12T01:34:36.788740+0000","last_peered":"2024-09-12T01:34:36.788740+0000","last_clean":"2024-09-12T01:34:36.788740+0000","last_became_active":"2024-09-12T01:04:15.396832+0000","last_became_peered":"2024-09-12T01:04:15.396832+0000","last_unstale":"2024-09-12T01:34:36.788740+0000","last_undegraded":"2024-09-12T01:34:36.788740+0000","last_fullsized":"2024-09-12T01:34:36.788740+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:22.398122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:29.648642+0000","last_change":"2024-09-12T00:46:26.373712+0000","last_active":"2024-09-12T01:35:29.648642+0000","last_peered":"2024-09-12T01:35:29.648642+0000","last_clean":"2024-09-12T01:35:29.648642+0000","last_became_active":"2024-09-12T00:46:26.373401+0000","last_became_peered":"2024-09-12T00:46:26.373401+0000","last_unstale":"2024-09-12T01:35:29.648642+0000","last_undegraded":"2024-09-12T01:35:29.648642+0000","last_fullsized":"2024-09-12T01:35:29.648642+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:11.356426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:21.546124+0000","last_change":"2024-09-12T00:46:22.348093+0000","last_active":"2024-09-12T01:35:21.546124+0000","last_peered":"2024-09-12T01:35:21.546124+0000","last_clean":"2024-09-12T01:35:21.546124+0000","last_became_active":"2024-09-12T00:46:22.347794+0000","last_became_peered":"2024-09-12T00:46:22.347794+0000","last_unstale":"2024-09-12T01:35:21.546124+0000","last_undegraded":"2024-09-12T01:35:21.546124+0000","last_fullsized":"2024-09-12T01:35:21.546124+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:37.768628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'10","reported_seq":83,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.534383+0000","last_change":"2024-09-12T00:42:36.802979+0000","last_active":"2024-09-12T01:33:56.534383+0000","last_peered":"2024-09-12T01:33:56.534383+0000","last_clean":"2024-09-12T01:33:56.534383+0000","last_became_active":"2024-09-12T00:42:36.802647+0000","last_became_peered":"2024-09-12T00:42:36.802647+0000","last_unstale":"2024-09-12T01:33:56.534383+0000","last_undegraded":"2024-09-12T01:33:56.534383+0000","last_fullsized":"2024-09-12T01:33:56.534383+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:38.850484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":30,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:14.632767+0000","last_change":"2024-09-12T01:04:15.397994+0000","last_active":"2024-09-12T01:33:14.632767+0000","last_peered":"2024-09-12T01:33:14.632767+0000","last_clean":"2024-09-12T01:33:14.632767+0000","last_became_active":"2024-09-12T01:04:15.397646+0000","last_became_peered":"2024-09-12T01:04:15.397646+0000","last_unstale":"2024-09-12T01:33:14.632767+0000","last_undegraded":"2024-09-12T01:33:14.632767+0000","last_fullsized":"2024-09-12T01:33:14.632767+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:13.049264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"263'3","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.567221+0000","last_change":"2024-09-12T00:46:26.373701+0000","last_active":"2024-09-12T01:37:46.567221+0000","last_peered":"2024-09-12T01:37:46.567221+0000","last_clean":"2024-09-12T01:37:46.567221+0000","last_became_active":"2024-09-12T00:46:26.373354+0000","last_became_peered":"2024-09-12T00:46:26.373354+0000","last_unstale":"2024-09-12T01:37:46.567221+0000","last_undegraded":"2024-09-12T01:37:46.567221+0000","last_fullsized":"2024-09-12T01:37:46.567221+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:00.128990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:22.792606+0000","last_change":"2024-09-12T00:46:22.349188+0000","last_active":"2024-09-12T01:35:22.792606+0000","last_peered":"2024-09-12T01:35:22.792606+0000","last_clean":"2024-09-12T01:35:22.792606+0000","last_became_active":"2024-09-12T00:46:22.348875+0000","last_became_peered":"2024-09-12T00:46:22.348875+0000","last_unstale":"2024-09-12T01:35:22.792606+0000","last_undegraded":"2024-09-12T01:35:22.792606+0000","last_fullsized":"2024-09-12T01:35:22.792606+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:31.550301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"263'37","reported_seq":164,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:59.638083+0000","last_change":"2024-09-12T00:42:36.814630+0000","last_active":"2024-09-12T01:33:59.638083+0000","last_peered":"2024-09-12T01:33:59.638083+0000","last_clean":"2024-09-12T01:33:59.638083+0000","last_became_active":"2024-09-12T00:42:36.814235+0000","last_became_peered":"2024-09-12T00:42:36.814235+0000","last_unstale":"2024-09-12T01:33:59.638083+0000","last_undegraded":"2024-09-12T01:33:59.638083+0000","last_fullsized":"2024-09-12T01:33:59.638083+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:12.766338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":201,"num_read_kb":139,"num_write":71,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:51.532638+0000","last_change":"2024-09-12T01:04:15.396161+0000","last_active":"2024-09-12T01:34:51.532638+0000","last_peered":"2024-09-12T01:34:51.532638+0000","last_clean":"2024-09-12T01:34:51.532638+0000","last_became_active":"2024-09-12T01:04:15.395860+0000","last_became_peered":"2024-09-12T01:04:15.395860+0000","last_unstale":"2024-09-12T01:34:51.532638+0000","last_undegraded":"2024-09-12T01:34:51.532638+0000","last_fullsized":"2024-09-12T01:34:51.532638+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:49.503666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:44.636344+0000","last_change":"2024-09-12T00:46:26.373083+0000","last_active":"2024-09-12T01:33:44.636344+0000","last_peered":"2024-09-12T01:33:44.636344+0000","last_clean":"2024-09-12T01:33:44.636344+0000","last_became_active":"2024-09-12T00:46:26.372803+0000","last_became_peered":"2024-09-12T00:46:26.372803+0000","last_unstale":"2024-09-12T01:33:44.636344+0000","last_undegraded":"2024-09-12T01:33:44.636344+0000","last_fullsized":"2024-09-12T01:33:44.636344+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:18.884189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"263'9","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.567429+0000","last_change":"2024-09-12T00:46:22.356200+0000","last_active":"2024-09-12T01:38:00.567429+0000","last_peered":"2024-09-12T01:38:00.567429+0000","last_clean":"2024-09-12T01:38:00.567429+0000","last_became_active":"2024-09-12T00:46:22.355962+0000","last_became_peered":"2024-09-12T00:46:22.355962+0000","last_unstale":"2024-09-12T01:38:00.567429+0000","last_undegraded":"2024-09-12T01:38:00.567429+0000","last_fullsized":"2024-09-12T01:38:00.567429+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:15:50.421437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5707,"num_write":14,"num_write_kb":4683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"263'12","reported_seq":90,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:39.642863+0000","last_change":"2024-09-12T00:42:36.817087+0000","last_active":"2024-09-12T01:34:39.642863+0000","last_peered":"2024-09-12T01:34:39.642863+0000","last_clean":"2024-09-12T01:34:39.642863+0000","last_became_active":"2024-09-12T00:42:36.816673+0000","last_became_peered":"2024-09-12T00:42:36.816673+0000","last_unstale":"2024-09-12T01:34:39.642863+0000","last_undegraded":"2024-09-12T01:34:39.642863+0000","last_fullsized":"2024-09-12T01:34:39.642863+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:44.855498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":40,"num_write":24,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.736023+0000","last_change":"2024-09-12T01:04:15.393891+0000","last_active":"2024-09-12T01:35:46.736023+0000","last_peered":"2024-09-12T01:35:46.736023+0000","last_clean":"2024-09-12T01:35:46.736023+0000","last_became_active":"2024-09-12T01:04:15.393597+0000","last_became_peered":"2024-09-12T01:04:15.393597+0000","last_unstale":"2024-09-12T01:35:46.736023+0000","last_undegraded":"2024-09-12T01:35:46.736023+0000","last_fullsized":"2024-09-12T01:35:46.736023+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:33.585796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:44.636315+0000","last_change":"2024-09-12T00:46:26.366156+0000","last_active":"2024-09-12T01:33:44.636315+0000","last_peered":"2024-09-12T01:33:44.636315+0000","last_clean":"2024-09-12T01:33:44.636315+0000","last_became_active":"2024-09-12T00:46:26.365848+0000","last_became_peered":"2024-09-12T00:46:26.365848+0000","last_unstale":"2024-09-12T01:33:44.636315+0000","last_undegraded":"2024-09-12T01:33:44.636315+0000","last_fullsized":"2024-09-12T01:33:44.636315+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:48.611575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"263'3","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:51.539246+0000","last_change":"2024-09-12T00:46:22.351422+0000","last_active":"2024-09-12T01:35:51.539246+0000","last_peered":"2024-09-12T01:35:51.539246+0000","last_clean":"2024-09-12T01:35:51.539246+0000","last_became_active":"2024-09-12T00:46:22.350815+0000","last_became_peered":"2024-09-12T00:46:22.350815+0000","last_unstale":"2024-09-12T01:35:51.539246+0000","last_undegraded":"2024-09-12T01:35:51.539246+0000","last_fullsized":"2024-09-12T01:35:51.539246+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:04.321097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"263'49","reported_seq":188,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:22.784293+0000","last_change":"2024-09-12T00:42:36.811488+0000","last_active":"2024-09-12T01:34:22.784293+0000","last_peered":"2024-09-12T01:34:22.784293+0000","last_clean":"2024-09-12T01:34:22.784293+0000","last_became_active":"2024-09-12T00:42:36.810754+0000","last_became_peered":"2024-09-12T00:42:36.810754+0000","last_unstale":"2024-09-12T01:34:22.784293+0000","last_undegraded":"2024-09-12T01:34:22.784293+0000","last_fullsized":"2024-09-12T01:34:22.784293+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:12.064178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":240,"num_read_kb":165,"num_write":91,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.539582+0000","last_change":"2024-09-12T01:04:15.397399+0000","last_active":"2024-09-12T01:34:36.539582+0000","last_peered":"2024-09-12T01:34:36.539582+0000","last_clean":"2024-09-12T01:34:36.539582+0000","last_became_active":"2024-09-12T01:04:15.396999+0000","last_became_peered":"2024-09-12T01:04:15.396999+0000","last_unstale":"2024-09-12T01:34:36.539582+0000","last_undegraded":"2024-09-12T01:34:36.539582+0000","last_fullsized":"2024-09-12T01:34:36.539582+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:43.411584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:46.932525+0000","last_change":"2024-09-12T00:46:26.563322+0000","last_active":"2024-09-12T01:33:46.932525+0000","last_peered":"2024-09-12T01:33:46.932525+0000","last_clean":"2024-09-12T01:33:46.932525+0000","last_became_active":"2024-09-12T00:46:26.563041+0000","last_became_peered":"2024-09-12T00:46:26.563041+0000","last_unstale":"2024-09-12T01:33:46.932525+0000","last_undegraded":"2024-09-12T01:33:46.932525+0000","last_fullsized":"2024-09-12T01:33:46.932525+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:42.189294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:36.781253+0000","last_change":"2024-09-12T00:46:22.353183+0000","last_active":"2024-09-12T01:33:36.781253+0000","last_peered":"2024-09-12T01:33:36.781253+0000","last_clean":"2024-09-12T01:33:36.781253+0000","last_became_active":"2024-09-12T00:46:22.352933+0000","last_became_peered":"2024-09-12T00:46:22.352933+0000","last_unstale":"2024-09-12T01:33:36.781253+0000","last_undegraded":"2024-09-12T01:33:36.781253+0000","last_fullsized":"2024-09-12T01:33:36.781253+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:32.297784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"263'30","reported_seq":143,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:21.537673+0000","last_change":"2024-09-12T00:42:36.817007+0000","last_active":"2024-09-12T01:34:21.537673+0000","last_peered":"2024-09-12T01:34:21.537673+0000","last_clean":"2024-09-12T01:34:21.537673+0000","last_became_active":"2024-09-12T00:42:36.816619+0000","last_became_peered":"2024-09-12T00:42:36.816619+0000","last_unstale":"2024-09-12T01:34:21.537673+0000","last_undegraded":"2024-09-12T01:34:21.537673+0000","last_fullsized":"2024-09-12T01:34:21.537673+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:41.160245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":113,"num_write":55,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.724886+0000","last_change":"2024-09-12T01:04:15.396475+0000","last_active":"2024-09-12T01:34:36.724886+0000","last_peered":"2024-09-12T01:34:36.724886+0000","last_clean":"2024-09-12T01:34:36.724886+0000","last_became_active":"2024-09-12T01:04:15.396125+0000","last_became_peered":"2024-09-12T01:04:15.396125+0000","last_unstale":"2024-09-12T01:34:36.724886+0000","last_undegraded":"2024-09-12T01:34:36.724886+0000","last_fullsized":"2024-09-12T01:34:36.724886+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:47.673931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:44.636360+0000","last_change":"2024-09-12T00:46:26.366690+0000","last_active":"2024-09-12T01:33:44.636360+0000","last_peered":"2024-09-12T01:33:44.636360+0000","last_clean":"2024-09-12T01:33:44.636360+0000","last_became_active":"2024-09-12T00:46:26.366293+0000","last_became_peered":"2024-09-12T00:46:26.366293+0000","last_unstale":"2024-09-12T01:33:44.636360+0000","last_undegraded":"2024-09-12T01:33:44.636360+0000","last_fullsized":"2024-09-12T01:33:44.636360+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:56.900344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"263'2","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:41.931768+0000","last_change":"2024-09-12T00:46:22.348841+0000","last_active":"2024-09-12T01:33:41.931768+0000","last_peered":"2024-09-12T01:33:41.931768+0000","last_clean":"2024-09-12T01:33:41.931768+0000","last_became_active":"2024-09-12T00:46:22.348546+0000","last_became_peered":"2024-09-12T00:46:22.348546+0000","last_unstale":"2024-09-12T01:33:41.931768+0000","last_undegraded":"2024-09-12T01:33:41.931768+0000","last_fullsized":"2024-09-12T01:33:41.931768+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:40.207770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"263'34","reported_seq":149,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:21.630269+0000","last_change":"2024-09-12T00:42:36.817828+0000","last_active":"2024-09-12T01:34:21.630269+0000","last_peered":"2024-09-12T01:34:21.630269+0000","last_clean":"2024-09-12T01:34:21.630269+0000","last_became_active":"2024-09-12T00:42:36.817530+0000","last_became_peered":"2024-09-12T00:42:36.817530+0000","last_unstale":"2024-09-12T01:34:21.630269+0000","last_undegraded":"2024-09-12T01:34:21.630269+0000","last_fullsized":"2024-09-12T01:34:21.630269+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:04.364763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":117,"num_write":66,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:44.650432+0000","last_change":"2024-09-12T01:04:15.399818+0000","last_active":"2024-09-12T01:35:44.650432+0000","last_peered":"2024-09-12T01:35:44.650432+0000","last_clean":"2024-09-12T01:35:44.650432+0000","last_became_active":"2024-09-12T01:04:15.399564+0000","last_became_peered":"2024-09-12T01:04:15.399564+0000","last_unstale":"2024-09-12T01:35:44.650432+0000","last_undegraded":"2024-09-12T01:35:44.650432+0000","last_fullsized":"2024-09-12T01:35:44.650432+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:02.148148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"263'7","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:16.554428+0000","last_change":"2024-09-12T00:46:26.374247+0000","last_active":"2024-09-12T01:36:16.554428+0000","last_peered":"2024-09-12T01:36:16.554428+0000","last_clean":"2024-09-12T01:36:16.554428+0000","last_became_active":"2024-09-12T00:46:26.373942+0000","last_became_peered":"2024-09-12T00:46:26.373942+0000","last_unstale":"2024-09-12T01:36:16.554428+0000","last_undegraded":"2024-09-12T01:36:16.554428+0000","last_fullsized":"2024-09-12T01:36:16.554428+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:35.593349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8208,"num_write":12,"num_write_kb":8208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:01.784297+0000","last_change":"2024-09-12T00:46:22.352449+0000","last_active":"2024-09-12T01:34:01.784297+0000","last_peered":"2024-09-12T01:34:01.784297+0000","last_clean":"2024-09-12T01:34:01.784297+0000","last_became_active":"2024-09-12T00:46:22.352156+0000","last_became_peered":"2024-09-12T00:46:22.352156+0000","last_unstale":"2024-09-12T01:34:01.784297+0000","last_undegraded":"2024-09-12T01:34:01.784297+0000","last_fullsized":"2024-09-12T01:34:01.784297+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:05.797995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"263'10","reported_seq":83,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:21.786707+0000","last_change":"2024-09-12T00:42:36.817431+0000","last_active":"2024-09-12T01:34:21.786707+0000","last_peered":"2024-09-12T01:34:21.786707+0000","last_clean":"2024-09-12T01:34:21.786707+0000","last_became_active":"2024-09-12T00:42:36.817021+0000","last_became_peered":"2024-09-12T00:42:36.817021+0000","last_unstale":"2024-09-12T01:34:21.786707+0000","last_undegraded":"2024-09-12T01:34:21.786707+0000","last_fullsized":"2024-09-12T01:34:21.786707+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:32.868292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:41.716228+0000","last_change":"2024-09-12T01:04:15.396406+0000","last_active":"2024-09-12T01:33:41.716228+0000","last_peered":"2024-09-12T01:33:41.716228+0000","last_clean":"2024-09-12T01:33:41.716228+0000","last_became_active":"2024-09-12T01:04:15.396096+0000","last_became_peered":"2024-09-12T01:04:15.396096+0000","last_unstale":"2024-09-12T01:33:41.716228+0000","last_undegraded":"2024-09-12T01:33:41.716228+0000","last_fullsized":"2024-09-12T01:33:41.716228+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:42.402476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"260'5","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:06.720106+0000","last_change":"2024-09-12T00:46:26.562285+0000","last_active":"2024-09-12T01:34:06.720106+0000","last_peered":"2024-09-12T01:34:06.720106+0000","last_clean":"2024-09-12T01:34:06.720106+0000","last_became_active":"2024-09-12T00:46:26.561924+0000","last_became_peered":"2024-09-12T00:46:26.561924+0000","last_unstale":"2024-09-12T01:34:06.720106+0000","last_undegraded":"2024-09-12T01:34:06.720106+0000","last_fullsized":"2024-09-12T01:34:06.720106+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:06.317073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:01.934433+0000","last_change":"2024-09-12T00:46:22.350102+0000","last_active":"2024-09-12T01:34:01.934433+0000","last_peered":"2024-09-12T01:34:01.934433+0000","last_clean":"2024-09-12T01:34:01.934433+0000","last_became_active":"2024-09-12T00:46:22.349376+0000","last_became_peered":"2024-09-12T00:46:22.349376+0000","last_unstale":"2024-09-12T01:34:01.934433+0000","last_undegraded":"2024-09-12T01:34:01.934433+0000","last_fullsized":"2024-09-12T01:34:01.934433+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:38.382481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"263'30","reported_seq":144,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:51.727585+0000","last_change":"2024-09-12T00:42:36.810100+0000","last_active":"2024-09-12T01:34:51.727585+0000","last_peered":"2024-09-12T01:34:51.727585+0000","last_clean":"2024-09-12T01:34:51.727585+0000","last_became_active":"2024-09-12T00:42:36.809602+0000","last_became_peered":"2024-09-12T00:42:36.809602+0000","last_unstale":"2024-09-12T01:34:51.727585+0000","last_undegraded":"2024-09-12T01:34:51.727585+0000","last_fullsized":"2024-09-12T01:34:51.727585+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:44.821006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":112,"num_write":54,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"263'1","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.736044+0000","last_change":"2024-09-12T01:04:15.393241+0000","last_active":"2024-09-12T01:35:46.736044+0000","last_peered":"2024-09-12T01:35:46.736044+0000","last_clean":"2024-09-12T01:35:46.736044+0000","last_became_active":"2024-09-12T01:04:15.392789+0000","last_became_peered":"2024-09-12T01:04:15.392789+0000","last_unstale":"2024-09-12T01:35:46.736044+0000","last_undegraded":"2024-09-12T01:35:46.736044+0000","last_fullsized":"2024-09-12T01:35:46.736044+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:06.945446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"260'5","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:41.931667+0000","last_change":"2024-09-12T00:46:26.370237+0000","last_active":"2024-09-12T01:33:41.931667+0000","last_peered":"2024-09-12T01:33:41.931667+0000","last_clean":"2024-09-12T01:33:41.931667+0000","last_became_active":"2024-09-12T00:46:26.369883+0000","last_became_peered":"2024-09-12T00:46:26.369883+0000","last_unstale":"2024-09-12T01:33:41.931667+0000","last_undegraded":"2024-09-12T01:33:41.931667+0000","last_fullsized":"2024-09-12T01:33:41.931667+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:01.571704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:06.784985+0000","last_change":"2024-09-12T00:46:22.348999+0000","last_active":"2024-09-12T01:34:06.784985+0000","last_peered":"2024-09-12T01:34:06.784985+0000","last_clean":"2024-09-12T01:34:06.784985+0000","last_became_active":"2024-09-12T00:46:22.348568+0000","last_became_peered":"2024-09-12T00:46:22.348568+0000","last_unstale":"2024-09-12T01:34:06.784985+0000","last_undegraded":"2024-09-12T01:34:06.784985+0000","last_fullsized":"2024-09-12T01:34:06.784985+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:24.267629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"263'9","reported_seq":84,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:39.642740+0000","last_change":"2024-09-12T00:42:36.814268+0000","last_active":"2024-09-12T01:34:39.642740+0000","last_peered":"2024-09-12T01:34:39.642740+0000","last_clean":"2024-09-12T01:34:39.642740+0000","last_became_active":"2024-09-12T00:42:36.813997+0000","last_became_peered":"2024-09-12T00:42:36.813997+0000","last_unstale":"2024-09-12T01:34:39.642740+0000","last_undegraded":"2024-09-12T01:34:39.642740+0000","last_fullsized":"2024-09-12T01:34:39.642740+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:34.191233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.797023+0000","last_change":"2024-09-12T01:04:15.393511+0000","last_active":"2024-09-12T01:35:46.797023+0000","last_peered":"2024-09-12T01:35:46.797023+0000","last_clean":"2024-09-12T01:35:46.797023+0000","last_became_active":"2024-09-12T01:04:15.393220+0000","last_became_peered":"2024-09-12T01:04:15.393220+0000","last_unstale":"2024-09-12T01:35:46.797023+0000","last_undegraded":"2024-09-12T01:35:46.797023+0000","last_fullsized":"2024-09-12T01:35:46.797023+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:27.528771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"263'2","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:26.741954+0000","last_change":"2024-09-12T00:46:26.370629+0000","last_active":"2024-09-12T01:36:26.741954+0000","last_peered":"2024-09-12T01:36:26.741954+0000","last_clean":"2024-09-12T01:36:26.741954+0000","last_became_active":"2024-09-12T00:46:26.370349+0000","last_became_peered":"2024-09-12T00:46:26.370349+0000","last_unstale":"2024-09-12T01:36:26.741954+0000","last_undegraded":"2024-09-12T01:36:26.741954+0000","last_fullsized":"2024-09-12T01:36:26.741954+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:26.584727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"263'11","reported_seq":76,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.830190+0000","last_change":"2024-09-12T00:46:22.346319+0000","last_active":"2024-09-12T01:38:00.830190+0000","last_peered":"2024-09-12T01:38:00.830190+0000","last_clean":"2024-09-12T01:38:00.830190+0000","last_became_active":"2024-09-12T00:46:22.346024+0000","last_became_peered":"2024-09-12T00:46:22.346024+0000","last_unstale":"2024-09-12T01:38:00.830190+0000","last_undegraded":"2024-09-12T01:38:00.830190+0000","last_fullsized":"2024-09-12T01:38:00.830190+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:06.683878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":32770,"num_write":16,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"263'38","reported_seq":159,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.539545+0000","last_change":"2024-09-12T00:42:36.809663+0000","last_active":"2024-09-12T01:34:36.539545+0000","last_peered":"2024-09-12T01:34:36.539545+0000","last_clean":"2024-09-12T01:34:36.539545+0000","last_became_active":"2024-09-12T00:42:36.809350+0000","last_became_peered":"2024-09-12T00:42:36.809350+0000","last_unstale":"2024-09-12T01:34:36.539545+0000","last_undegraded":"2024-09-12T01:34:36.539545+0000","last_fullsized":"2024-09-12T01:34:36.539545+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:37.120320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":127,"num_write":71,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:31.733691+0000","last_change":"2024-09-12T01:04:15.395069+0000","last_active":"2024-09-12T01:35:31.733691+0000","last_peered":"2024-09-12T01:35:31.733691+0000","last_clean":"2024-09-12T01:35:31.733691+0000","last_became_active":"2024-09-12T01:04:15.394795+0000","last_became_peered":"2024-09-12T01:04:15.394795+0000","last_unstale":"2024-09-12T01:35:31.733691+0000","last_undegraded":"2024-09-12T01:35:31.733691+0000","last_fullsized":"2024-09-12T01:35:31.733691+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:28.070748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"263'2","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:31.802388+0000","last_change":"2024-09-12T00:46:26.368134+0000","last_active":"2024-09-12T01:36:31.802388+0000","last_peered":"2024-09-12T01:36:31.802388+0000","last_clean":"2024-09-12T01:36:31.802388+0000","last_became_active":"2024-09-12T00:46:26.367852+0000","last_became_peered":"2024-09-12T00:46:26.367852+0000","last_unstale":"2024-09-12T01:36:31.802388+0000","last_undegraded":"2024-09-12T01:36:31.802388+0000","last_fullsized":"2024-09-12T01:36:31.802388+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:38.753123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1142,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"260'3","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:16.721849+0000","last_change":"2024-09-12T00:46:22.351593+0000","last_active":"2024-09-12T01:34:16.721849+0000","last_peered":"2024-09-12T01:34:16.721849+0000","last_clean":"2024-09-12T01:34:16.721849+0000","last_became_active":"2024-09-12T00:46:22.351237+0000","last_became_peered":"2024-09-12T00:46:22.351237+0000","last_unstale":"2024-09-12T01:34:16.721849+0000","last_undegraded":"2024-09-12T01:34:16.721849+0000","last_fullsized":"2024-09-12T01:34:16.721849+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:04.853460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'36","reported_seq":159,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.788869+0000","last_change":"2024-09-12T00:42:36.819102+0000","last_active":"2024-09-12T01:34:36.788869+0000","last_peered":"2024-09-12T01:34:36.788869+0000","last_clean":"2024-09-12T01:34:36.788869+0000","last_became_active":"2024-09-12T00:42:36.818852+0000","last_became_peered":"2024-09-12T00:42:36.818852+0000","last_unstale":"2024-09-12T01:34:36.788869+0000","last_undegraded":"2024-09-12T01:34:36.788869+0000","last_fullsized":"2024-09-12T01:34:36.788869+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:23.943088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":132,"num_write":65,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:32.794132+0000","last_change":"2024-09-12T01:04:15.393939+0000","last_active":"2024-09-12T01:35:32.794132+0000","last_peered":"2024-09-12T01:35:32.794132+0000","last_clean":"2024-09-12T01:35:32.794132+0000","last_became_active":"2024-09-12T01:04:15.393651+0000","last_became_peered":"2024-09-12T01:04:15.393651+0000","last_unstale":"2024-09-12T01:35:32.794132+0000","last_undegraded":"2024-09-12T01:35:32.794132+0000","last_fullsized":"2024-09-12T01:35:32.794132+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:16.671263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"263'5","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:26.801703+0000","last_change":"2024-09-12T00:46:26.563573+0000","last_active":"2024-09-12T01:36:26.801703+0000","last_peered":"2024-09-12T01:36:26.801703+0000","last_clean":"2024-09-12T01:36:26.801703+0000","last_became_active":"2024-09-12T00:46:26.563277+0000","last_became_peered":"2024-09-12T00:46:26.563277+0000","last_unstale":"2024-09-12T01:36:26.801703+0000","last_undegraded":"2024-09-12T01:36:26.801703+0000","last_fullsized":"2024-09-12T01:36:26.801703+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:09.897827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":7168,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:31.631288+0000","last_change":"2024-09-12T00:46:22.351630+0000","last_active":"2024-09-12T01:34:31.631288+0000","last_peered":"2024-09-12T01:34:31.631288+0000","last_clean":"2024-09-12T01:34:31.631288+0000","last_became_active":"2024-09-12T00:46:22.351162+0000","last_became_peered":"2024-09-12T00:46:22.351162+0000","last_unstale":"2024-09-12T01:34:31.631288+0000","last_undegraded":"2024-09-12T01:34:31.631288+0000","last_fullsized":"2024-09-12T01:34:31.631288+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:07.137302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"263'20","reported_seq":113,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.539639+0000","last_change":"2024-09-12T00:42:36.815139+0000","last_active":"2024-09-12T01:34:36.539639+0000","last_peered":"2024-09-12T01:34:36.539639+0000","last_clean":"2024-09-12T01:34:36.539639+0000","last_became_active":"2024-09-12T00:42:36.814845+0000","last_became_peered":"2024-09-12T00:42:36.814845+0000","last_unstale":"2024-09-12T01:34:36.539639+0000","last_undegraded":"2024-09-12T01:34:36.539639+0000","last_fullsized":"2024-09-12T01:34:36.539639+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:26.879251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":75,"num_write":35,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:16.936450+0000","last_change":"2024-09-12T01:04:15.388704+0000","last_active":"2024-09-12T01:34:16.936450+0000","last_peered":"2024-09-12T01:34:16.936450+0000","last_clean":"2024-09-12T01:34:16.936450+0000","last_became_active":"2024-09-12T01:04:15.388423+0000","last_became_peered":"2024-09-12T01:04:15.388423+0000","last_unstale":"2024-09-12T01:34:16.936450+0000","last_undegraded":"2024-09-12T01:34:16.936450+0000","last_fullsized":"2024-09-12T01:34:16.936450+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:13.488601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:06.720233+0000","last_change":"2024-09-12T00:46:26.565006+0000","last_active":"2024-09-12T01:34:06.720233+0000","last_peered":"2024-09-12T01:34:06.720233+0000","last_clean":"2024-09-12T01:34:06.720233+0000","last_became_active":"2024-09-12T00:46:26.564771+0000","last_became_peered":"2024-09-12T00:46:26.564771+0000","last_unstale":"2024-09-12T01:34:06.720233+0000","last_undegraded":"2024-09-12T01:34:06.720233+0000","last_fullsized":"2024-09-12T01:34:06.720233+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:24.506289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"260'3","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:57.780660+0000","last_change":"2024-09-12T00:46:22.350365+0000","last_active":"2024-09-12T01:33:57.780660+0000","last_peered":"2024-09-12T01:33:57.780660+0000","last_clean":"2024-09-12T01:33:57.780660+0000","last_became_active":"2024-09-12T00:46:22.350045+0000","last_became_peered":"2024-09-12T00:46:22.350045+0000","last_unstale":"2024-09-12T01:33:57.780660+0000","last_undegraded":"2024-09-12T01:33:57.780660+0000","last_fullsized":"2024-09-12T01:33:57.780660+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:09.828897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"263'41","reported_seq":169,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:56.728429+0000","last_change":"2024-09-12T00:42:36.814530+0000","last_active":"2024-09-12T01:34:56.728429+0000","last_peered":"2024-09-12T01:34:56.728429+0000","last_clean":"2024-09-12T01:34:56.728429+0000","last_became_active":"2024-09-12T00:42:36.814228+0000","last_became_peered":"2024-09-12T00:42:36.814228+0000","last_unstale":"2024-09-12T01:34:56.728429+0000","last_undegraded":"2024-09-12T01:34:56.728429+0000","last_fullsized":"2024-09-12T01:34:56.728429+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:19.454136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":139,"num_write":79,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:31.547532+0000","last_change":"2024-09-12T01:04:15.388771+0000","last_active":"2024-09-12T01:35:31.547532+0000","last_peered":"2024-09-12T01:35:31.547532+0000","last_clean":"2024-09-12T01:35:31.547532+0000","last_became_active":"2024-09-12T01:04:15.388492+0000","last_became_peered":"2024-09-12T01:04:15.388492+0000","last_unstale":"2024-09-12T01:35:31.547532+0000","last_undegraded":"2024-09-12T01:35:31.547532+0000","last_fullsized":"2024-09-12T01:35:31.547532+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:40.040155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:06.535900+0000","last_change":"2024-09-12T00:46:26.369312+0000","last_active":"2024-09-12T01:34:06.535900+0000","last_peered":"2024-09-12T01:34:06.535900+0000","last_clean":"2024-09-12T01:34:06.535900+0000","last_became_active":"2024-09-12T00:46:26.369004+0000","last_became_peered":"2024-09-12T00:46:26.369004+0000","last_unstale":"2024-09-12T01:34:06.535900+0000","last_undegraded":"2024-09-12T01:34:06.535900+0000","last_fullsized":"2024-09-12T01:34:06.535900+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:24.565234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:01.719448+0000","last_change":"2024-09-12T00:46:22.354042+0000","last_active":"2024-09-12T01:34:01.719448+0000","last_peered":"2024-09-12T01:34:01.719448+0000","last_clean":"2024-09-12T01:34:01.719448+0000","last_became_active":"2024-09-12T00:46:22.353747+0000","last_became_peered":"2024-09-12T00:46:22.353747+0000","last_unstale":"2024-09-12T01:34:01.719448+0000","last_undegraded":"2024-09-12T01:34:01.719448+0000","last_fullsized":"2024-09-12T01:34:01.719448+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:40.026238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"263'8","reported_seq":80,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:41.940572+0000","last_change":"2024-09-12T00:42:36.809380+0000","last_active":"2024-09-12T01:34:41.940572+0000","last_peered":"2024-09-12T01:34:41.940572+0000","last_clean":"2024-09-12T01:34:41.940572+0000","last_became_active":"2024-09-12T00:42:36.808945+0000","last_became_peered":"2024-09-12T00:42:36.808945+0000","last_unstale":"2024-09-12T01:34:41.940572+0000","last_undegraded":"2024-09-12T01:34:41.940572+0000","last_fullsized":"2024-09-12T01:34:41.940572+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:08.194856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":23,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"262'1","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.531103+0000","last_change":"2024-09-12T01:04:15.395533+0000","last_active":"2024-09-12T01:34:36.531103+0000","last_peered":"2024-09-12T01:34:36.531103+0000","last_clean":"2024-09-12T01:34:36.531103+0000","last_became_active":"2024-09-12T01:04:15.395223+0000","last_became_peered":"2024-09-12T01:04:15.395223+0000","last_unstale":"2024-09-12T01:34:36.531103+0000","last_undegraded":"2024-09-12T01:34:36.531103+0000","last_fullsized":"2024-09-12T01:34:36.531103+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:54.625901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"260'2","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:21.937069+0000","last_change":"2024-09-12T00:46:26.367308+0000","last_active":"2024-09-12T01:34:21.937069+0000","last_peered":"2024-09-12T01:34:21.937069+0000","last_clean":"2024-09-12T01:34:21.937069+0000","last_became_active":"2024-09-12T00:46:26.367039+0000","last_became_peered":"2024-09-12T00:46:26.367039+0000","last_unstale":"2024-09-12T01:34:21.937069+0000","last_undegraded":"2024-09-12T01:34:21.937069+0000","last_fullsized":"2024-09-12T01:34:21.937069+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:30.091487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"263'2","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:31.742697+0000","last_change":"2024-09-12T00:46:22.350076+0000","last_active":"2024-09-12T01:36:31.742697+0000","last_peered":"2024-09-12T01:36:31.742697+0000","last_clean":"2024-09-12T01:36:31.742697+0000","last_became_active":"2024-09-12T00:46:22.349779+0000","last_became_peered":"2024-09-12T00:46:22.349779+0000","last_unstale":"2024-09-12T01:36:31.742697+0000","last_undegraded":"2024-09-12T01:36:31.742697+0000","last_fullsized":"2024-09-12T01:36:31.742697+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:41.826282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":5,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"263'23","reported_seq":123,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:42.787235+0000","last_change":"2024-09-12T00:42:36.811265+0000","last_active":"2024-09-12T01:34:42.787235+0000","last_peered":"2024-09-12T01:34:42.787235+0000","last_clean":"2024-09-12T01:34:42.787235+0000","last_became_active":"2024-09-12T00:42:36.810979+0000","last_became_peered":"2024-09-12T00:42:36.810979+0000","last_unstale":"2024-09-12T01:34:42.787235+0000","last_undegraded":"2024-09-12T01:34:42.787235+0000","last_fullsized":"2024-09-12T01:34:42.787235+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:56.532046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":82,"num_write":51,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.788829+0000","last_change":"2024-09-12T01:04:15.388624+0000","last_active":"2024-09-12T01:34:36.788829+0000","last_peered":"2024-09-12T01:34:36.788829+0000","last_clean":"2024-09-12T01:34:36.788829+0000","last_became_active":"2024-09-12T01:04:15.388331+0000","last_became_peered":"2024-09-12T01:04:15.388331+0000","last_unstale":"2024-09-12T01:34:36.788829+0000","last_undegraded":"2024-09-12T01:34:36.788829+0000","last_fullsized":"2024-09-12T01:34:36.788829+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:07.975645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"260'5","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:32.785494+0000","last_change":"2024-09-12T00:46:26.370948+0000","last_active":"2024-09-12T01:34:32.785494+0000","last_peered":"2024-09-12T01:34:32.785494+0000","last_clean":"2024-09-12T01:34:32.785494+0000","last_became_active":"2024-09-12T00:46:26.370448+0000","last_became_peered":"2024-09-12T00:46:26.370448+0000","last_unstale":"2024-09-12T01:34:32.785494+0000","last_undegraded":"2024-09-12T01:34:32.785494+0000","last_fullsized":"2024-09-12T01:34:32.785494+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:41.502037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"263'2","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:21.741202+0000","last_change":"2024-09-12T00:46:22.354072+0000","last_active":"2024-09-12T01:36:21.741202+0000","last_peered":"2024-09-12T01:36:21.741202+0000","last_clean":"2024-09-12T01:36:21.741202+0000","last_became_active":"2024-09-12T00:46:22.353796+0000","last_became_peered":"2024-09-12T00:46:22.353796+0000","last_unstale":"2024-09-12T01:36:21.741202+0000","last_undegraded":"2024-09-12T01:36:21.741202+0000","last_fullsized":"2024-09-12T01:36:21.741202+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:52.950825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"263'41","reported_seq":174,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:41.540574+0000","last_change":"2024-09-12T00:42:36.814983+0000","last_active":"2024-09-12T01:34:41.540574+0000","last_peered":"2024-09-12T01:34:41.540574+0000","last_clean":"2024-09-12T01:34:41.540574+0000","last_became_active":"2024-09-12T00:42:36.814700+0000","last_became_peered":"2024-09-12T00:42:36.814700+0000","last_unstale":"2024-09-12T01:34:41.540574+0000","last_undegraded":"2024-09-12T01:34:41.540574+0000","last_fullsized":"2024-09-12T01:34:41.540574+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:47.477989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":150,"num_write":75,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:31.795233+0000","last_change":"2024-09-12T01:04:15.393354+0000","last_active":"2024-09-12T01:35:31.795233+0000","last_peered":"2024-09-12T01:35:31.795233+0000","last_clean":"2024-09-12T01:35:31.795233+0000","last_became_active":"2024-09-12T01:04:15.392129+0000","last_became_peered":"2024-09-12T01:04:15.392129+0000","last_unstale":"2024-09-12T01:35:31.795233+0000","last_undegraded":"2024-09-12T01:35:31.795233+0000","last_fullsized":"2024-09-12T01:35:31.795233+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:07.333078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:21.537643+0000","last_change":"2024-09-12T00:46:26.374929+0000","last_active":"2024-09-12T01:34:21.537643+0000","last_peered":"2024-09-12T01:34:21.537643+0000","last_clean":"2024-09-12T01:34:21.537643+0000","last_became_active":"2024-09-12T00:46:26.374630+0000","last_became_peered":"2024-09-12T00:46:26.374630+0000","last_unstale":"2024-09-12T01:34:21.537643+0000","last_undegraded":"2024-09-12T01:34:21.537643+0000","last_fullsized":"2024-09-12T01:34:21.537643+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:40.273744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:16.936526+0000","last_change":"2024-09-12T00:46:22.345808+0000","last_active":"2024-09-12T01:34:16.936526+0000","last_peered":"2024-09-12T01:34:16.936526+0000","last_clean":"2024-09-12T01:34:16.936526+0000","last_became_active":"2024-09-12T00:46:22.345455+0000","last_became_peered":"2024-09-12T00:46:22.345455+0000","last_unstale":"2024-09-12T01:34:16.936526+0000","last_undegraded":"2024-09-12T01:34:16.936526+0000","last_fullsized":"2024-09-12T01:34:16.936526+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:43.503840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"263'47","reported_seq":185,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:41.540334+0000","last_change":"2024-09-12T00:42:36.810603+0000","last_active":"2024-09-12T01:34:41.540334+0000","last_peered":"2024-09-12T01:34:41.540334+0000","last_clean":"2024-09-12T01:34:41.540334+0000","last_became_active":"2024-09-12T00:42:36.810179+0000","last_became_peered":"2024-09-12T00:42:36.810179+0000","last_unstale":"2024-09-12T01:34:41.540334+0000","last_undegraded":"2024-09-12T01:34:41.540334+0000","last_fullsized":"2024-09-12T01:34:41.540334+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:20.658302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":235,"num_read_kb":167,"num_write":78,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:41.735210+0000","last_change":"2024-09-12T01:04:15.393713+0000","last_active":"2024-09-12T01:35:41.735210+0000","last_peered":"2024-09-12T01:35:41.735210+0000","last_clean":"2024-09-12T01:35:41.735210+0000","last_became_active":"2024-09-12T01:04:15.393424+0000","last_became_peered":"2024-09-12T01:04:15.393424+0000","last_unstale":"2024-09-12T01:35:41.735210+0000","last_undegraded":"2024-09-12T01:35:41.735210+0000","last_fullsized":"2024-09-12T01:35:41.735210+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:46.950196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"260'6","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:21.537798+0000","last_change":"2024-09-12T00:46:26.372459+0000","last_active":"2024-09-12T01:34:21.537798+0000","last_peered":"2024-09-12T01:34:21.537798+0000","last_clean":"2024-09-12T01:34:21.537798+0000","last_became_active":"2024-09-12T00:46:26.372169+0000","last_became_peered":"2024-09-12T00:46:26.372169+0000","last_unstale":"2024-09-12T01:34:21.537798+0000","last_undegraded":"2024-09-12T01:34:21.537798+0000","last_fullsized":"2024-09-12T01:34:21.537798+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:20.872522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"263'5","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:21.555122+0000","last_change":"2024-09-12T00:46:22.350497+0000","last_active":"2024-09-12T01:36:21.555122+0000","last_peered":"2024-09-12T01:36:21.555122+0000","last_clean":"2024-09-12T01:36:21.555122+0000","last_became_active":"2024-09-12T00:46:22.350210+0000","last_became_peered":"2024-09-12T00:46:22.350210+0000","last_unstale":"2024-09-12T01:36:21.555122+0000","last_undegraded":"2024-09-12T01:36:21.555122+0000","last_fullsized":"2024-09-12T01:36:21.555122+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:30.513705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4096,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"260'15","reported_seq":102,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:51.727537+0000","last_change":"2024-09-12T00:42:36.810443+0000","last_active":"2024-09-12T01:34:51.727537+0000","last_peered":"2024-09-12T01:34:51.727537+0000","last_clean":"2024-09-12T01:34:51.727537+0000","last_became_active":"2024-09-12T00:42:36.810110+0000","last_became_peered":"2024-09-12T00:42:36.810110+0000","last_unstale":"2024-09-12T01:34:51.727537+0000","last_undegraded":"2024-09-12T01:34:51.727537+0000","last_fullsized":"2024-09-12T01:34:51.727537+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:11.301801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":54,"num_write":27,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"263'299","reported_seq":907,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.710943+0000","last_change":"2024-09-12T00:28:31.203847+0000","last_active":"2024-09-12T01:38:01.710943+0000","last_peered":"2024-09-12T01:38:01.710943+0000","last_clean":"2024-09-12T01:38:01.710943+0000","last_became_active":"2024-09-12T00:28:31.201886+0000","last_became_peered":"2024-09-12T00:28:31.201886+0000","last_unstale":"2024-09-12T01:38:01.710943+0000","last_undegraded":"2024-09-12T01:38:01.710943+0000","last_fullsized":"2024-09-12T01:38:01.710943+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:39.441025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":380,"num_read_kb":9626,"num_write":915,"num_write_kb":19266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"263'157","reported_seq":722,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:32.776738+0000","last_change":"2024-09-12T00:28:33.211480+0000","last_active":"2024-09-12T01:33:32.776738+0000","last_peered":"2024-09-12T01:33:32.776738+0000","last_clean":"2024-09-12T01:33:32.776738+0000","last_became_active":"2024-09-12T00:28:33.211182+0000","last_became_peered":"2024-09-12T00:28:33.211182+0000","last_unstale":"2024-09-12T01:33:32.776738+0000","last_undegraded":"2024-09-12T01:33:32.776738+0000","last_fullsized":"2024-09-12T01:33:32.776738+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:45.597820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":685,"num_read_kb":553,"num_write":251,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"263'241","reported_seq":951,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:11.943996+0000","last_change":"2024-09-12T00:28:31.204861+0000","last_active":"2024-09-12T01:35:11.943996+0000","last_peered":"2024-09-12T01:35:11.943996+0000","last_clean":"2024-09-12T01:35:11.943996+0000","last_became_active":"2024-09-12T00:28:31.204561+0000","last_became_peered":"2024-09-12T00:28:31.204561+0000","last_unstale":"2024-09-12T01:35:11.943996+0000","last_undegraded":"2024-09-12T01:35:11.943996+0000","last_fullsized":"2024-09-12T01:35:11.943996+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:08.162064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12638018,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":543,"num_read_kb":14276,"num_write":977,"num_write_kb":31679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"263'59","reported_seq":619,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:36.715209+0000","last_change":"2024-09-12T00:28:33.217339+0000","last_active":"2024-09-12T01:33:36.715209+0000","last_peered":"2024-09-12T01:33:36.715209+0000","last_clean":"2024-09-12T01:33:36.715209+0000","last_became_active":"2024-09-12T00:28:33.217028+0000","last_became_peered":"2024-09-12T00:28:33.217028+0000","last_unstale":"2024-09-12T01:33:36.715209+0000","last_undegraded":"2024-09-12T01:33:36.715209+0000","last_fullsized":"2024-09-12T01:33:36.715209+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:39:58.330668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":252,"num_read_kb":216,"num_write":87,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"263'332","reported_seq":1191,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.751929+0000","last_change":"2024-09-12T00:28:31.203640+0000","last_active":"2024-09-12T01:38:01.751929+0000","last_peered":"2024-09-12T01:38:01.751929+0000","last_clean":"2024-09-12T01:38:01.751929+0000","last_became_active":"2024-09-12T00:28:31.203351+0000","last_became_peered":"2024-09-12T00:28:31.203351+0000","last_unstale":"2024-09-12T01:38:01.751929+0000","last_undegraded":"2024-09-12T01:38:01.751929+0000","last_fullsized":"2024-09-12T01:38:01.751929+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:37.607022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306757,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":934,"num_read_kb":42793,"num_write":1132,"num_write_kb":18824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"263'429","reported_seq":1173,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:36.531564+0000","last_change":"2024-09-12T00:28:33.217739+0000","last_active":"2024-09-12T01:33:36.531564+0000","last_peered":"2024-09-12T01:33:36.531564+0000","last_clean":"2024-09-12T01:33:36.531564+0000","last_became_active":"2024-09-12T00:28:33.217215+0000","last_became_peered":"2024-09-12T00:28:33.217215+0000","last_unstale":"2024-09-12T01:33:36.531564+0000","last_undegraded":"2024-09-12T01:33:36.531564+0000","last_fullsized":"2024-09-12T01:33:36.531564+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":400,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:28.536144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2092,"num_read_kb":1758,"num_write":778,"num_write_kb":522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"263'307","reported_seq":999,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:37.786456+0000","last_change":"2024-09-12T00:28:31.214517+0000","last_active":"2024-09-12T01:34:37.786456+0000","last_peered":"2024-09-12T01:34:37.786456+0000","last_clean":"2024-09-12T01:34:37.786456+0000","last_became_active":"2024-09-12T00:28:31.213595+0000","last_became_peered":"2024-09-12T00:28:31.213595+0000","last_unstale":"2024-09-12T01:34:37.786456+0000","last_undegraded":"2024-09-12T01:34:37.786456+0000","last_fullsized":"2024-09-12T01:34:37.786456+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:36.346586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2047320,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":560,"num_read_kb":11143,"num_write":1094,"num_write_kb":15238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"263'289","reported_seq":921,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:49.421430+0000","last_change":"2024-09-12T00:28:33.218650+0000","last_active":"2024-09-12T01:33:49.421430+0000","last_peered":"2024-09-12T01:33:49.421430+0000","last_clean":"2024-09-12T01:33:49.421430+0000","last_became_active":"2024-09-12T00:28:33.218393+0000","last_became_peered":"2024-09-12T00:28:33.218393+0000","last_unstale":"2024-09-12T01:33:49.421430+0000","last_undegraded":"2024-09-12T01:33:49.421430+0000","last_fullsized":"2024-09-12T01:33:49.421430+0000","mapping_epoch":27,"log_start":"260'200","ondisk_log_start":"260'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:52.716266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1288,"num_read_kb":1088,"num_write":481,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"263'315","reported_seq":909,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.733442+0000","last_change":"2024-09-12T00:28:31.205251+0000","last_active":"2024-09-12T01:38:01.733442+0000","last_peered":"2024-09-12T01:38:01.733442+0000","last_clean":"2024-09-12T01:38:01.733442+0000","last_became_active":"2024-09-12T00:28:31.204962+0000","last_became_peered":"2024-09-12T00:28:31.204962+0000","last_unstale":"2024-09-12T01:38:01.733442+0000","last_undegraded":"2024-09-12T01:38:01.733442+0000","last_fullsized":"2024-09-12T01:38:01.733442+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:35.543975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170211,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":403,"num_read_kb":1209,"num_write":988,"num_write_kb":17836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"263'4176","reported_seq":4796,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:51.541648+0000","last_change":"2024-09-12T00:28:33.214790+0000","last_active":"2024-09-12T01:34:51.541648+0000","last_peered":"2024-09-12T01:34:51.541648+0000","last_clean":"2024-09-12T01:34:51.541648+0000","last_became_active":"2024-09-12T00:28:33.214515+0000","last_became_peered":"2024-09-12T00:28:33.214515+0000","last_unstale":"2024-09-12T01:34:51.541648+0000","last_undegraded":"2024-09-12T01:34:51.541648+0000","last_fullsized":"2024-09-12T01:34:51.541648+0000","mapping_epoch":27,"log_start":"263'4100","ondisk_log_start":"263'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":3000,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:53.747881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16813,"num_read_kb":14096,"num_write":6273,"num_write_kb":3125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"263'321","reported_seq":968,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.490167+0000","last_change":"2024-09-12T00:28:31.214068+0000","last_active":"2024-09-12T01:35:16.490167+0000","last_peered":"2024-09-12T01:35:16.490167+0000","last_clean":"2024-09-12T01:35:16.490167+0000","last_became_active":"2024-09-12T00:28:31.212573+0000","last_became_peered":"2024-09-12T00:28:31.212573+0000","last_unstale":"2024-09-12T01:35:16.490167+0000","last_undegraded":"2024-09-12T01:35:16.490167+0000","last_fullsized":"2024-09-12T01:35:16.490167+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:07.432079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5946915,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":524,"num_read_kb":12450,"num_write":1178,"num_write_kb":24719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"263'260","reported_seq":970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.545564+0000","last_change":"2024-09-12T00:28:33.213811+0000","last_active":"2024-09-12T01:35:16.545564+0000","last_peered":"2024-09-12T01:35:16.545564+0000","last_clean":"2024-09-12T01:35:16.545564+0000","last_became_active":"2024-09-12T00:28:33.213014+0000","last_became_peered":"2024-09-12T00:28:33.213014+0000","last_unstale":"2024-09-12T01:35:16.545564+0000","last_undegraded":"2024-09-12T01:35:16.545564+0000","last_fullsized":"2024-09-12T01:35:16.545564+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:25.774640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1431,"num_read_kb":1278,"num_write":426,"num_write_kb":225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"263'316","reported_seq":951,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.726913+0000","last_change":"2024-09-12T00:28:31.210405+0000","last_active":"2024-09-12T01:38:01.726913+0000","last_peered":"2024-09-12T01:38:01.726913+0000","last_clean":"2024-09-12T01:38:01.726913+0000","last_became_active":"2024-09-12T00:28:31.210039+0000","last_became_peered":"2024-09-12T00:28:31.210039+0000","last_unstale":"2024-09-12T01:38:01.726913+0000","last_undegraded":"2024-09-12T01:38:01.726913+0000","last_fullsized":"2024-09-12T01:38:01.726913+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:33.172818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262202,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":471,"num_read_kb":7448,"num_write":1016,"num_write_kb":42696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"263'277","reported_seq":963,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:17.791987+0000","last_change":"2024-09-12T00:28:33.217908+0000","last_active":"2024-09-12T01:35:17.791987+0000","last_peered":"2024-09-12T01:35:17.791987+0000","last_clean":"2024-09-12T01:35:17.791987+0000","last_became_active":"2024-09-12T00:28:33.216856+0000","last_became_peered":"2024-09-12T00:28:33.216856+0000","last_unstale":"2024-09-12T01:35:17.791987+0000","last_undegraded":"2024-09-12T01:35:17.791987+0000","last_fullsized":"2024-09-12T01:35:17.791987+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:14.540790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1252,"num_read_kb":1029,"num_write":416,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"263'251","reported_seq":862,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:04.652742+0000","last_change":"2024-09-12T00:28:31.213450+0000","last_active":"2024-09-12T01:36:04.652742+0000","last_peered":"2024-09-12T01:36:04.652742+0000","last_clean":"2024-09-12T01:36:04.652742+0000","last_became_active":"2024-09-12T00:28:31.213172+0000","last_became_peered":"2024-09-12T00:28:31.213172+0000","last_unstale":"2024-09-12T01:36:04.652742+0000","last_undegraded":"2024-09-12T01:36:04.652742+0000","last_fullsized":"2024-09-12T01:36:04.652742+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:29.256307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13517815,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":381,"num_read_kb":13792,"num_write":908,"num_write_kb":26598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"263'108","reported_seq":718,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.535539+0000","last_change":"2024-09-12T00:28:33.206578+0000","last_active":"2024-09-12T01:35:16.535539+0000","last_peered":"2024-09-12T01:35:16.535539+0000","last_clean":"2024-09-12T01:35:16.535539+0000","last_became_active":"2024-09-12T00:28:33.206296+0000","last_became_peered":"2024-09-12T00:28:33.206296+0000","last_unstale":"2024-09-12T01:35:16.535539+0000","last_undegraded":"2024-09-12T01:35:16.535539+0000","last_fullsized":"2024-09-12T01:35:16.535539+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:53.527780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":463,"num_read_kb":402,"num_write":161,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"263'4150","reported_seq":4755,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.534336+0000","last_change":"2024-09-12T00:28:33.214093+0000","last_active":"2024-09-12T01:33:56.534336+0000","last_peered":"2024-09-12T01:33:56.534336+0000","last_clean":"2024-09-12T01:33:56.534336+0000","last_became_active":"2024-09-12T00:28:33.213777+0000","last_became_peered":"2024-09-12T00:28:33.213777+0000","last_unstale":"2024-09-12T01:33:56.534336+0000","last_undegraded":"2024-09-12T01:33:56.534336+0000","last_fullsized":"2024-09-12T01:33:56.534336+0000","mapping_epoch":27,"log_start":"263'4100","ondisk_log_start":"263'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":3000,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:34.960052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16687,"num_read_kb":13992,"num_write":6250,"num_write_kb":3125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"263'364","reported_seq":992,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.479322+0000","last_change":"2024-09-12T00:29:04.274666+0000","last_active":"2024-09-12T01:38:01.479322+0000","last_peered":"2024-09-12T01:38:01.479322+0000","last_clean":"2024-09-12T01:38:01.479322+0000","last_became_active":"2024-09-12T00:29:04.274377+0000","last_became_peered":"2024-09-12T00:29:04.274377+0000","last_unstale":"2024-09-12T01:38:01.479322+0000","last_undegraded":"2024-09-12T01:38:01.479322+0000","last_fullsized":"2024-09-12T01:38:01.479322+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:54.628791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1617669,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":550,"num_read_kb":2856,"num_write":1170,"num_write_kb":27657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"263'295","reported_seq":935,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:08.059213+0000","last_change":"2024-09-12T00:28:33.218880+0000","last_active":"2024-09-12T01:35:08.059213+0000","last_peered":"2024-09-12T01:35:08.059213+0000","last_clean":"2024-09-12T01:35:08.059213+0000","last_became_active":"2024-09-12T00:28:33.218660+0000","last_became_peered":"2024-09-12T00:28:33.218660+0000","last_unstale":"2024-09-12T01:35:08.059213+0000","last_undegraded":"2024-09-12T01:35:08.059213+0000","last_fullsized":"2024-09-12T01:35:08.059213+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:31.583663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1306,"num_read_kb":1072,"num_write":479,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"263'359","reported_seq":1022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.479027+0000","last_change":"2024-09-12T00:28:31.213720+0000","last_active":"2024-09-12T01:38:01.479027+0000","last_peered":"2024-09-12T01:38:01.479027+0000","last_clean":"2024-09-12T01:38:01.479027+0000","last_became_active":"2024-09-12T00:28:31.213388+0000","last_became_peered":"2024-09-12T00:28:31.213388+0000","last_unstale":"2024-09-12T01:38:01.479027+0000","last_undegraded":"2024-09-12T01:38:01.479027+0000","last_fullsized":"2024-09-12T01:38:01.479027+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:39.340566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133769,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":583,"num_read_kb":20058,"num_write":1145,"num_write_kb":40619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"263'90","reported_seq":673,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:52.081197+0000","last_change":"2024-09-12T00:28:33.214308+0000","last_active":"2024-09-12T01:35:52.081197+0000","last_peered":"2024-09-12T01:35:52.081197+0000","last_clean":"2024-09-12T01:35:52.081197+0000","last_became_active":"2024-09-12T00:28:33.213998+0000","last_became_peered":"2024-09-12T00:28:33.213998+0000","last_unstale":"2024-09-12T01:35:52.081197+0000","last_undegraded":"2024-09-12T01:35:52.081197+0000","last_fullsized":"2024-09-12T01:35:52.081197+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:58.148121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":414,"num_read_kb":350,"num_write":126,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"263'343","reported_seq":1055,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.535524+0000","last_change":"2024-09-12T00:28:31.215536+0000","last_active":"2024-09-12T01:38:01.535524+0000","last_peered":"2024-09-12T01:38:01.535524+0000","last_clean":"2024-09-12T01:38:01.535524+0000","last_became_active":"2024-09-12T00:28:31.215230+0000","last_became_peered":"2024-09-12T00:28:31.215230+0000","last_unstale":"2024-09-12T01:38:01.535524+0000","last_undegraded":"2024-09-12T01:38:01.535524+0000","last_fullsized":"2024-09-12T01:38:01.535524+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:13.446276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254878,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":618,"num_read_kb":115792,"num_write":1085,"num_write_kb":22723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"263'230","reported_seq":852,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:56.125911+0000","last_change":"2024-09-12T00:28:33.206843+0000","last_active":"2024-09-12T01:35:56.125911+0000","last_peered":"2024-09-12T01:35:56.125911+0000","last_clean":"2024-09-12T01:35:56.125911+0000","last_became_active":"2024-09-12T00:28:33.206305+0000","last_became_peered":"2024-09-12T00:28:33.206305+0000","last_unstale":"2024-09-12T01:35:56.125911+0000","last_undegraded":"2024-09-12T01:35:56.125911+0000","last_fullsized":"2024-09-12T01:35:56.125911+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:47.700041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":971,"num_read_kb":790,"num_write":344,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"263'404","reported_seq":1133,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.559024+0000","last_change":"2024-09-12T00:28:31.200080+0000","last_active":"2024-09-12T01:38:01.559024+0000","last_peered":"2024-09-12T01:38:01.559024+0000","last_clean":"2024-09-12T01:38:01.559024+0000","last_became_active":"2024-09-12T00:28:31.199779+0000","last_became_peered":"2024-09-12T00:28:31.199779+0000","last_unstale":"2024-09-12T01:38:01.559024+0000","last_undegraded":"2024-09-12T01:38:01.559024+0000","last_fullsized":"2024-09-12T01:38:01.559024+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:30.398312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":360748,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":660,"num_read_kb":69033,"num_write":1309,"num_write_kb":57878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"263'150","reported_seq":800,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:17.328724+0000","last_change":"2024-09-12T00:28:33.209112+0000","last_active":"2024-09-12T01:35:17.328724+0000","last_peered":"2024-09-12T01:35:17.328724+0000","last_clean":"2024-09-12T01:35:17.328724+0000","last_became_active":"2024-09-12T00:28:33.208831+0000","last_became_peered":"2024-09-12T00:28:33.208831+0000","last_unstale":"2024-09-12T01:35:17.328724+0000","last_undegraded":"2024-09-12T01:35:17.328724+0000","last_fullsized":"2024-09-12T01:35:17.328724+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:49.062557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":710,"num_read_kb":600,"num_write":211,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"263'322","reported_seq":968,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:49.636910+0000","last_change":"2024-09-12T00:28:31.202543+0000","last_active":"2024-09-12T01:33:49.636910+0000","last_peered":"2024-09-12T01:33:49.636910+0000","last_clean":"2024-09-12T01:33:49.636910+0000","last_became_active":"2024-09-12T00:28:31.202245+0000","last_became_peered":"2024-09-12T00:28:31.202245+0000","last_unstale":"2024-09-12T01:33:49.636910+0000","last_undegraded":"2024-09-12T01:33:49.636910+0000","last_fullsized":"2024-09-12T01:33:49.636910+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:12.536550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11608952,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":483,"num_read_kb":23092,"num_write":1269,"num_write_kb":58944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"263'113","reported_seq":719,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.533718+0000","last_change":"2024-09-12T00:28:33.207817+0000","last_active":"2024-09-12T01:33:51.533718+0000","last_peered":"2024-09-12T01:33:51.533718+0000","last_clean":"2024-09-12T01:33:51.533718+0000","last_became_active":"2024-09-12T00:28:33.207527+0000","last_became_peered":"2024-09-12T00:28:33.207527+0000","last_unstale":"2024-09-12T01:33:51.533718+0000","last_undegraded":"2024-09-12T01:33:51.533718+0000","last_fullsized":"2024-09-12T01:33:51.533718+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:31.972357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":515,"num_read_kb":438,"num_write":174,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"263'311","reported_seq":970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.719296+0000","last_change":"2024-09-12T00:28:31.204106+0000","last_active":"2024-09-12T01:38:01.719296+0000","last_peered":"2024-09-12T01:38:01.719296+0000","last_clean":"2024-09-12T01:38:01.719296+0000","last_became_active":"2024-09-12T00:28:31.203048+0000","last_became_peered":"2024-09-12T00:28:31.203048+0000","last_unstale":"2024-09-12T01:38:01.719296+0000","last_undegraded":"2024-09-12T01:38:01.719296+0000","last_fullsized":"2024-09-12T01:38:01.719296+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:57.305025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524344,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":495,"num_read_kb":45596,"num_write":1045,"num_write_kb":35489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"263'106","reported_seq":617,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:42.693662+0000","last_change":"2024-09-12T00:28:41.227253+0000","last_active":"2024-09-12T01:36:42.693662+0000","last_peered":"2024-09-12T01:36:42.693662+0000","last_clean":"2024-09-12T01:36:42.693662+0000","last_became_active":"2024-09-12T00:28:41.226952+0000","last_became_peered":"2024-09-12T00:28:41.226952+0000","last_unstale":"2024-09-12T01:36:42.693662+0000","last_undegraded":"2024-09-12T01:36:42.693662+0000","last_fullsized":"2024-09-12T01:36:42.693662+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:26.588660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":155,"num_read_kb":144,"num_write":259,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"263'188","reported_seq":772,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:09.639537+0000","last_change":"2024-09-12T00:28:33.209848+0000","last_active":"2024-09-12T01:34:09.639537+0000","last_peered":"2024-09-12T01:34:09.639537+0000","last_clean":"2024-09-12T01:34:09.639537+0000","last_became_active":"2024-09-12T00:28:33.209521+0000","last_became_peered":"2024-09-12T00:28:33.209521+0000","last_unstale":"2024-09-12T01:34:09.639537+0000","last_undegraded":"2024-09-12T01:34:09.639537+0000","last_fullsized":"2024-09-12T01:34:09.639537+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:21.840301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":834,"num_read_kb":672,"num_write":307,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"263'353","reported_seq":957,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.698618+0000","last_change":"2024-09-12T00:28:31.206298+0000","last_active":"2024-09-12T01:38:01.698618+0000","last_peered":"2024-09-12T01:38:01.698618+0000","last_clean":"2024-09-12T01:38:01.698618+0000","last_became_active":"2024-09-12T00:28:31.206010+0000","last_became_peered":"2024-09-12T00:28:31.206010+0000","last_unstale":"2024-09-12T01:38:01.698618+0000","last_undegraded":"2024-09-12T01:38:01.698618+0000","last_fullsized":"2024-09-12T01:38:01.698618+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:59.671503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":430,"num_read_kb":5592,"num_write":1103,"num_write_kb":25256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:47.779150+0000","last_change":"2024-09-12T00:28:35.212219+0000","last_active":"2024-09-12T01:33:47.779150+0000","last_peered":"2024-09-12T01:33:47.779150+0000","last_clean":"2024-09-12T01:33:47.779150+0000","last_became_active":"2024-09-12T00:28:35.211231+0000","last_became_peered":"2024-09-12T00:28:35.211231+0000","last_unstale":"2024-09-12T01:33:47.779150+0000","last_undegraded":"2024-09-12T01:33:47.779150+0000","last_fullsized":"2024-09-12T01:33:47.779150+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:10.530098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"263'348","reported_seq":970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.628118+0000","last_change":"2024-09-12T00:28:37.216446+0000","last_active":"2024-09-12T01:38:01.628118+0000","last_peered":"2024-09-12T01:38:01.628118+0000","last_clean":"2024-09-12T01:38:01.628118+0000","last_became_active":"2024-09-12T00:28:37.216169+0000","last_became_peered":"2024-09-12T00:28:37.216169+0000","last_unstale":"2024-09-12T01:38:01.628118+0000","last_undegraded":"2024-09-12T01:38:01.628118+0000","last_fullsized":"2024-09-12T01:38:01.628118+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:12.966316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44362,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":554,"num_read_kb":1122,"num_write":430,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.718741+0000","last_change":"2024-09-12T00:28:39.214249+0000","last_active":"2024-09-12T01:33:56.718741+0000","last_peered":"2024-09-12T01:33:56.718741+0000","last_clean":"2024-09-12T01:33:56.718741+0000","last_became_active":"2024-09-12T00:28:39.213942+0000","last_became_peered":"2024-09-12T00:28:39.213942+0000","last_unstale":"2024-09-12T01:33:56.718741+0000","last_undegraded":"2024-09-12T01:33:56.718741+0000","last_fullsized":"2024-09-12T01:33:56.718741+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:13.977918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"263'182","reported_seq":733,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:39.518790+0000","last_change":"2024-09-12T00:28:41.229922+0000","last_active":"2024-09-12T01:36:39.518790+0000","last_peered":"2024-09-12T01:36:39.518790+0000","last_clean":"2024-09-12T01:36:39.518790+0000","last_became_active":"2024-09-12T00:28:41.229608+0000","last_became_peered":"2024-09-12T00:28:41.229608+0000","last_unstale":"2024-09-12T01:36:39.518790+0000","last_undegraded":"2024-09-12T01:36:39.518790+0000","last_fullsized":"2024-09-12T01:36:39.518790+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:00.176000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":231,"num_read_kb":225,"num_write":383,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"263'212","reported_seq":813,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:47.779133+0000","last_change":"2024-09-12T00:28:33.212615+0000","last_active":"2024-09-12T01:33:47.779133+0000","last_peered":"2024-09-12T01:33:47.779133+0000","last_clean":"2024-09-12T01:33:47.779133+0000","last_became_active":"2024-09-12T00:28:33.212334+0000","last_became_peered":"2024-09-12T00:28:33.212334+0000","last_unstale":"2024-09-12T01:33:47.779133+0000","last_undegraded":"2024-09-12T01:33:47.779133+0000","last_fullsized":"2024-09-12T01:33:47.779133+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:46.854089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":883,"num_read_kb":721,"num_write":311,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"263'324","reported_seq":981,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.758063+0000","last_change":"2024-09-12T00:28:31.208474+0000","last_active":"2024-09-12T01:38:01.758063+0000","last_peered":"2024-09-12T01:38:01.758063+0000","last_clean":"2024-09-12T01:38:01.758063+0000","last_became_active":"2024-09-12T00:28:31.208141+0000","last_became_peered":"2024-09-12T00:28:31.208141+0000","last_unstale":"2024-09-12T01:38:01.758063+0000","last_undegraded":"2024-09-12T01:38:01.758063+0000","last_fullsized":"2024-09-12T01:38:01.758063+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:28:51.190004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395868,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":543,"num_read_kb":93032,"num_write":945,"num_write_kb":55506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:09.639557+0000","last_change":"2024-09-12T00:28:35.213065+0000","last_active":"2024-09-12T01:34:09.639557+0000","last_peered":"2024-09-12T01:34:09.639557+0000","last_clean":"2024-09-12T01:34:09.639557+0000","last_became_active":"2024-09-12T00:28:35.212745+0000","last_became_peered":"2024-09-12T00:28:35.212745+0000","last_unstale":"2024-09-12T01:34:09.639557+0000","last_undegraded":"2024-09-12T01:34:09.639557+0000","last_fullsized":"2024-09-12T01:34:09.639557+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:29.695288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"263'92","reported_seq":630,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:16.554571+0000","last_change":"2024-09-12T00:28:37.221408+0000","last_active":"2024-09-12T01:36:16.554571+0000","last_peered":"2024-09-12T01:36:16.554571+0000","last_clean":"2024-09-12T01:36:16.554571+0000","last_became_active":"2024-09-12T00:28:37.220899+0000","last_became_peered":"2024-09-12T00:28:37.220899+0000","last_unstale":"2024-09-12T01:36:16.554571+0000","last_undegraded":"2024-09-12T01:36:16.554571+0000","last_fullsized":"2024-09-12T01:36:16.554571+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:45.174607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":118,"num_read_kb":113,"num_write":78,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.534538+0000","last_change":"2024-09-12T00:28:39.222836+0000","last_active":"2024-09-12T01:33:56.534538+0000","last_peered":"2024-09-12T01:33:56.534538+0000","last_clean":"2024-09-12T01:33:56.534538+0000","last_became_active":"2024-09-12T00:28:39.222553+0000","last_became_peered":"2024-09-12T00:28:39.222553+0000","last_unstale":"2024-09-12T01:33:56.534538+0000","last_undegraded":"2024-09-12T01:33:56.534538+0000","last_fullsized":"2024-09-12T01:33:56.534538+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:57.986714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"263'126","reported_seq":631,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:42.376957+0000","last_change":"2024-09-12T00:28:41.228569+0000","last_active":"2024-09-12T01:36:42.376957+0000","last_peered":"2024-09-12T01:36:42.376957+0000","last_clean":"2024-09-12T01:36:42.376957+0000","last_became_active":"2024-09-12T00:28:41.228305+0000","last_became_peered":"2024-09-12T00:28:41.228305+0000","last_unstale":"2024-09-12T01:36:42.376957+0000","last_undegraded":"2024-09-12T01:36:42.376957+0000","last_fullsized":"2024-09-12T01:36:42.376957+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:24.274319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":144,"num_read_kb":135,"num_write":299,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"263'197","reported_seq":842,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.783202+0000","last_change":"2024-09-12T00:28:33.219367+0000","last_active":"2024-09-12T01:33:51.783202+0000","last_peered":"2024-09-12T01:33:51.783202+0000","last_clean":"2024-09-12T01:33:51.783202+0000","last_became_active":"2024-09-12T00:28:33.219082+0000","last_became_peered":"2024-09-12T00:28:33.219082+0000","last_unstale":"2024-09-12T01:33:51.783202+0000","last_undegraded":"2024-09-12T01:33:51.783202+0000","last_fullsized":"2024-09-12T01:33:51.783202+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:01.014245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":923,"num_read_kb":768,"num_write":333,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"263'375","reported_seq":1002,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.732052+0000","last_change":"2024-09-12T00:28:31.204550+0000","last_active":"2024-09-12T01:38:01.732052+0000","last_peered":"2024-09-12T01:38:01.732052+0000","last_clean":"2024-09-12T01:38:01.732052+0000","last_became_active":"2024-09-12T00:28:31.204223+0000","last_became_peered":"2024-09-12T00:28:31.204223+0000","last_unstale":"2024-09-12T01:38:01.732052+0000","last_undegraded":"2024-09-12T01:38:01.732052+0000","last_fullsized":"2024-09-12T01:38:01.732052+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:52.918860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133702,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":535,"num_read_kb":1739,"num_write":1184,"num_write_kb":22527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:49.637009+0000","last_change":"2024-09-12T00:28:35.212684+0000","last_active":"2024-09-12T01:33:49.637009+0000","last_peered":"2024-09-12T01:33:49.637009+0000","last_clean":"2024-09-12T01:33:49.637009+0000","last_became_active":"2024-09-12T00:28:35.212197+0000","last_became_peered":"2024-09-12T00:28:35.212197+0000","last_unstale":"2024-09-12T01:33:49.637009+0000","last_undegraded":"2024-09-12T01:33:49.637009+0000","last_fullsized":"2024-09-12T01:33:49.637009+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:02.479666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"263'133","reported_seq":693,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:11.629177+0000","last_change":"2024-09-12T00:28:37.221078+0000","last_active":"2024-09-12T01:34:11.629177+0000","last_peered":"2024-09-12T01:34:11.629177+0000","last_clean":"2024-09-12T01:34:11.629177+0000","last_became_active":"2024-09-12T00:28:37.220665+0000","last_became_peered":"2024-09-12T00:28:37.220665+0000","last_unstale":"2024-09-12T01:34:11.629177+0000","last_undegraded":"2024-09-12T01:34:11.629177+0000","last_fullsized":"2024-09-12T01:34:11.629177+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:48.810725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":170,"num_read_kb":162,"num_write":114,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"263'767","reported_seq":4806,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.053951+0000","last_change":"2024-09-12T00:28:39.218836+0000","last_active":"2024-09-12T01:38:00.053951+0000","last_peered":"2024-09-12T01:38:00.053951+0000","last_clean":"2024-09-12T01:38:00.053951+0000","last_became_active":"2024-09-12T00:28:39.218476+0000","last_became_peered":"2024-09-12T00:28:39.218476+0000","last_unstale":"2024-09-12T01:38:00.053951+0000","last_undegraded":"2024-09-12T01:38:00.053951+0000","last_fullsized":"2024-09-12T01:38:00.053951+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:48.644746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"263'191","reported_seq":1014,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:41.653002+0000","last_change":"2024-09-12T00:28:41.257967+0000","last_active":"2024-09-12T01:36:41.653002+0000","last_peered":"2024-09-12T01:36:41.653002+0000","last_clean":"2024-09-12T01:36:41.653002+0000","last_became_active":"2024-09-12T00:28:41.257679+0000","last_became_peered":"2024-09-12T00:28:41.257679+0000","last_unstale":"2024-09-12T01:36:41.653002+0000","last_undegraded":"2024-09-12T01:36:41.653002+0000","last_fullsized":"2024-09-12T01:36:41.653002+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:03.811468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":583,"num_read_kb":580,"num_write":423,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"263'82","reported_seq":627,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:49.636986+0000","last_change":"2024-09-12T00:28:33.212834+0000","last_active":"2024-09-12T01:33:49.636986+0000","last_peered":"2024-09-12T01:33:49.636986+0000","last_clean":"2024-09-12T01:33:49.636986+0000","last_became_active":"2024-09-12T00:28:33.212564+0000","last_became_peered":"2024-09-12T00:28:33.212564+0000","last_unstale":"2024-09-12T01:33:49.636986+0000","last_undegraded":"2024-09-12T01:33:49.636986+0000","last_fullsized":"2024-09-12T01:33:49.636986+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:09.246468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":372,"num_read_kb":309,"num_write":130,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"263'292","reported_seq":994,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.483030+0000","last_change":"2024-09-12T00:28:31.208261+0000","last_active":"2024-09-12T01:38:01.483030+0000","last_peered":"2024-09-12T01:38:01.483030+0000","last_clean":"2024-09-12T01:38:01.483030+0000","last_became_active":"2024-09-12T00:28:31.207938+0000","last_became_peered":"2024-09-12T00:28:31.207938+0000","last_unstale":"2024-09-12T01:38:01.483030+0000","last_undegraded":"2024-09-12T01:38:01.483030+0000","last_fullsized":"2024-09-12T01:38:01.483030+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:57.649279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174711,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":512,"num_read_kb":179847,"num_write":970,"num_write_kb":39231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:52.780005+0000","last_change":"2024-09-12T00:28:35.213658+0000","last_active":"2024-09-12T01:33:52.780005+0000","last_peered":"2024-09-12T01:33:52.780005+0000","last_clean":"2024-09-12T01:33:52.780005+0000","last_became_active":"2024-09-12T00:28:35.213178+0000","last_became_peered":"2024-09-12T00:28:35.213178+0000","last_unstale":"2024-09-12T01:33:52.780005+0000","last_undegraded":"2024-09-12T01:33:52.780005+0000","last_fullsized":"2024-09-12T01:33:52.780005+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:24.544971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"263'258","reported_seq":836,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.362668+0000","last_change":"2024-09-12T00:28:37.426701+0000","last_active":"2024-09-12T01:38:01.362668+0000","last_peered":"2024-09-12T01:38:01.362668+0000","last_clean":"2024-09-12T01:38:01.362668+0000","last_became_active":"2024-09-12T00:28:37.426357+0000","last_became_peered":"2024-09-12T00:28:37.426357+0000","last_unstale":"2024-09-12T01:38:01.362668+0000","last_undegraded":"2024-09-12T01:38:01.362668+0000","last_fullsized":"2024-09-12T01:38:01.362668+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:10.776649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15889,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":416,"num_read_kb":929,"num_write":326,"num_write_kb":245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"263'764","reported_seq":2643,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:49.984000+0000","last_change":"2024-09-12T00:28:39.219349+0000","last_active":"2024-09-12T01:37:49.984000+0000","last_peered":"2024-09-12T01:37:49.984000+0000","last_clean":"2024-09-12T01:37:49.984000+0000","last_became_active":"2024-09-12T00:28:39.218738+0000","last_became_peered":"2024-09-12T00:28:39.218738+0000","last_unstale":"2024-09-12T01:37:49.984000+0000","last_undegraded":"2024-09-12T01:37:49.984000+0000","last_fullsized":"2024-09-12T01:37:49.984000+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":700,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:17.422620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"263'110","reported_seq":678,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:47.796048+0000","last_change":"2024-09-12T00:28:33.213347+0000","last_active":"2024-09-12T01:35:47.796048+0000","last_peered":"2024-09-12T01:35:47.796048+0000","last_clean":"2024-09-12T01:35:47.796048+0000","last_became_active":"2024-09-12T00:28:33.213074+0000","last_became_peered":"2024-09-12T00:28:33.213074+0000","last_unstale":"2024-09-12T01:35:47.796048+0000","last_undegraded":"2024-09-12T01:35:47.796048+0000","last_fullsized":"2024-09-12T01:35:47.796048+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:23.084366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":473,"num_read_kb":387,"num_write":177,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"263'304","reported_seq":913,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.733507+0000","last_change":"2024-09-12T00:28:31.208561+0000","last_active":"2024-09-12T01:38:01.733507+0000","last_peered":"2024-09-12T01:38:01.733507+0000","last_clean":"2024-09-12T01:38:01.733507+0000","last_became_active":"2024-09-12T00:28:31.207567+0000","last_became_peered":"2024-09-12T00:28:31.207567+0000","last_unstale":"2024-09-12T01:38:01.733507+0000","last_undegraded":"2024-09-12T01:38:01.733507+0000","last_fullsized":"2024-09-12T01:38:01.733507+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:20.391261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":384,"num_read_kb":9497,"num_write":972,"num_write_kb":19827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.736003+0000","last_change":"2024-09-12T00:28:35.210621+0000","last_active":"2024-09-12T01:35:46.736003+0000","last_peered":"2024-09-12T01:35:46.736003+0000","last_clean":"2024-09-12T01:35:46.736003+0000","last_became_active":"2024-09-12T00:28:35.209944+0000","last_became_peered":"2024-09-12T00:28:35.209944+0000","last_unstale":"2024-09-12T01:35:46.736003+0000","last_undegraded":"2024-09-12T01:35:46.736003+0000","last_fullsized":"2024-09-12T01:35:46.736003+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:49.310299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"263'364","reported_seq":991,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:52.797020+0000","last_change":"2024-09-12T00:28:37.424559+0000","last_active":"2024-09-12T01:35:52.797020+0000","last_peered":"2024-09-12T01:35:52.797020+0000","last_clean":"2024-09-12T01:35:52.797020+0000","last_became_active":"2024-09-12T00:28:37.424250+0000","last_became_peered":"2024-09-12T00:28:37.424250+0000","last_unstale":"2024-09-12T01:35:52.797020+0000","last_undegraded":"2024-09-12T01:35:52.797020+0000","last_fullsized":"2024-09-12T01:35:52.797020+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:53.905894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49099,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":575,"num_read_kb":1032,"num_write":440,"num_write_kb":258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.933854+0000","last_change":"2024-09-12T00:28:39.214210+0000","last_active":"2024-09-12T01:33:56.933854+0000","last_peered":"2024-09-12T01:33:56.933854+0000","last_clean":"2024-09-12T01:33:56.933854+0000","last_became_active":"2024-09-12T00:28:39.213889+0000","last_became_peered":"2024-09-12T00:28:39.213889+0000","last_unstale":"2024-09-12T01:33:56.933854+0000","last_undegraded":"2024-09-12T01:33:56.933854+0000","last_fullsized":"2024-09-12T01:33:56.933854+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:04.180315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"263'533","reported_seq":1343,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:47.142053+0000","last_change":"2024-09-12T00:28:41.229982+0000","last_active":"2024-09-12T01:37:47.142053+0000","last_peered":"2024-09-12T01:37:47.142053+0000","last_clean":"2024-09-12T01:37:47.142053+0000","last_became_active":"2024-09-12T00:28:41.229664+0000","last_became_peered":"2024-09-12T00:28:41.229664+0000","last_unstale":"2024-09-12T01:37:47.142053+0000","last_undegraded":"2024-09-12T01:37:47.142053+0000","last_fullsized":"2024-09-12T01:37:47.142053+0000","mapping_epoch":35,"log_start":"263'500","ondisk_log_start":"263'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":500,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:28.373424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":472,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1261,"num_read_kb":1256,"num_write":1100,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"263'151","reported_seq":766,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.549725+0000","last_change":"2024-09-12T00:28:33.201995+0000","last_active":"2024-09-12T01:35:46.549725+0000","last_peered":"2024-09-12T01:35:46.549725+0000","last_clean":"2024-09-12T01:35:46.549725+0000","last_became_active":"2024-09-12T00:28:33.201673+0000","last_became_peered":"2024-09-12T00:28:33.201673+0000","last_unstale":"2024-09-12T01:35:46.549725+0000","last_undegraded":"2024-09-12T01:35:46.549725+0000","last_fullsized":"2024-09-12T01:35:46.549725+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:31.181867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":672,"num_read_kb":557,"num_write":251,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"263'417","reported_seq":1119,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.747151+0000","last_change":"2024-09-12T00:28:31.202584+0000","last_active":"2024-09-12T01:38:01.747151+0000","last_peered":"2024-09-12T01:38:01.747151+0000","last_clean":"2024-09-12T01:38:01.747151+0000","last_became_active":"2024-09-12T00:28:31.202279+0000","last_became_peered":"2024-09-12T00:28:31.202279+0000","last_unstale":"2024-09-12T01:38:01.747151+0000","last_undegraded":"2024-09-12T01:38:01.747151+0000","last_fullsized":"2024-09-12T01:38:01.747151+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:56.615946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":282856,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":774,"num_read_kb":12137,"num_write":1232,"num_write_kb":44296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.538620+0000","last_change":"2024-09-12T00:28:35.210515+0000","last_active":"2024-09-12T01:35:46.538620+0000","last_peered":"2024-09-12T01:35:46.538620+0000","last_clean":"2024-09-12T01:35:46.538620+0000","last_became_active":"2024-09-12T00:28:35.210154+0000","last_became_peered":"2024-09-12T00:28:35.210154+0000","last_unstale":"2024-09-12T01:35:46.538620+0000","last_undegraded":"2024-09-12T01:35:46.538620+0000","last_fullsized":"2024-09-12T01:35:46.538620+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:27.486274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"263'268","reported_seq":849,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:09.653372+0000","last_change":"2024-09-12T00:28:37.220230+0000","last_active":"2024-09-12T01:36:09.653372+0000","last_peered":"2024-09-12T01:36:09.653372+0000","last_clean":"2024-09-12T01:36:09.653372+0000","last_became_active":"2024-09-12T00:28:37.219967+0000","last_became_peered":"2024-09-12T00:28:37.219967+0000","last_unstale":"2024-09-12T01:36:09.653372+0000","last_undegraded":"2024-09-12T01:36:09.653372+0000","last_fullsized":"2024-09-12T01:36:09.653372+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:44.830810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49927,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":436,"num_read_kb":914,"num_write":354,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:54.637493+0000","last_change":"2024-09-12T00:28:39.216619+0000","last_active":"2024-09-12T01:33:54.637493+0000","last_peered":"2024-09-12T01:33:54.637493+0000","last_clean":"2024-09-12T01:33:54.637493+0000","last_became_active":"2024-09-12T00:28:39.216330+0000","last_became_peered":"2024-09-12T00:28:39.216330+0000","last_unstale":"2024-09-12T01:33:54.637493+0000","last_undegraded":"2024-09-12T01:33:54.637493+0000","last_fullsized":"2024-09-12T01:33:54.637493+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:08.447550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"263'2405","reported_seq":4247,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:36.457076+0000","last_change":"2024-09-12T00:28:41.228159+0000","last_active":"2024-09-12T01:37:36.457076+0000","last_peered":"2024-09-12T01:37:36.457076+0000","last_clean":"2024-09-12T01:37:36.457076+0000","last_became_active":"2024-09-12T00:28:41.227877+0000","last_became_peered":"2024-09-12T00:28:41.227877+0000","last_unstale":"2024-09-12T01:37:36.457076+0000","last_undegraded":"2024-09-12T01:37:36.457076+0000","last_fullsized":"2024-09-12T01:37:36.457076+0000","mapping_epoch":35,"log_start":"263'2300","ondisk_log_start":"263'2300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":2300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:29.699595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1208,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6068,"num_read_kb":6055,"num_write":4875,"num_write_kb":1798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"263'303","reported_seq":972,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.533631+0000","last_change":"2024-09-12T00:28:33.218264+0000","last_active":"2024-09-12T01:33:51.533631+0000","last_peered":"2024-09-12T01:33:51.533631+0000","last_clean":"2024-09-12T01:33:51.533631+0000","last_became_active":"2024-09-12T00:28:33.217954+0000","last_became_peered":"2024-09-12T00:28:33.217954+0000","last_unstale":"2024-09-12T01:33:51.533631+0000","last_undegraded":"2024-09-12T01:33:51.533631+0000","last_fullsized":"2024-09-12T01:33:51.533631+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:44.095321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1356,"num_read_kb":1133,"num_write":489,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"263'383","reported_seq":1069,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.693915+0000","last_change":"2024-09-12T00:28:31.215918+0000","last_active":"2024-09-12T01:38:01.693915+0000","last_peered":"2024-09-12T01:38:01.693915+0000","last_clean":"2024-09-12T01:38:01.693915+0000","last_became_active":"2024-09-12T00:28:31.215643+0000","last_became_peered":"2024-09-12T00:28:31.215643+0000","last_unstale":"2024-09-12T01:38:01.693915+0000","last_undegraded":"2024-09-12T01:38:01.693915+0000","last_fullsized":"2024-09-12T01:38:01.693915+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:03.063848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432543,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":555,"num_read_kb":94195,"num_write":1240,"num_write_kb":52818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.627099+0000","last_change":"2024-09-12T00:28:35.208477+0000","last_active":"2024-09-12T01:33:51.627099+0000","last_peered":"2024-09-12T01:33:51.627099+0000","last_clean":"2024-09-12T01:33:51.627099+0000","last_became_active":"2024-09-12T00:28:35.208169+0000","last_became_peered":"2024-09-12T00:28:35.208169+0000","last_unstale":"2024-09-12T01:33:51.627099+0000","last_undegraded":"2024-09-12T01:33:51.627099+0000","last_fullsized":"2024-09-12T01:33:51.627099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:22.104533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"263'330","reported_seq":940,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.229680+0000","last_change":"2024-09-12T00:28:37.221382+0000","last_active":"2024-09-12T01:38:00.229680+0000","last_peered":"2024-09-12T01:38:00.229680+0000","last_clean":"2024-09-12T01:38:00.229680+0000","last_became_active":"2024-09-12T00:28:37.220877+0000","last_became_peered":"2024-09-12T00:28:37.220877+0000","last_unstale":"2024-09-12T01:38:00.229680+0000","last_undegraded":"2024-09-12T01:38:00.229680+0000","last_fullsized":"2024-09-12T01:38:00.229680+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:32:44.806344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44229,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":532,"num_read_kb":1137,"num_write":418,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"263'773","reported_seq":2587,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.806004+0000","last_change":"2024-09-12T00:28:39.216443+0000","last_active":"2024-09-12T01:38:01.806004+0000","last_peered":"2024-09-12T01:38:01.806004+0000","last_clean":"2024-09-12T01:38:01.806004+0000","last_became_active":"2024-09-12T00:28:39.215746+0000","last_became_peered":"2024-09-12T00:28:39.215746+0000","last_unstale":"2024-09-12T01:38:01.806004+0000","last_undegraded":"2024-09-12T01:38:01.806004+0000","last_fullsized":"2024-09-12T01:38:01.806004+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:06.915545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"263'80","reported_seq":574,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.022592+0000","last_change":"2024-09-12T00:28:41.228845+0000","last_active":"2024-09-12T01:37:46.022592+0000","last_peered":"2024-09-12T01:37:46.022592+0000","last_clean":"2024-09-12T01:37:46.022592+0000","last_became_active":"2024-09-12T00:28:41.228361+0000","last_became_peered":"2024-09-12T00:28:41.228361+0000","last_unstale":"2024-09-12T01:37:46.022592+0000","last_undegraded":"2024-09-12T01:37:46.022592+0000","last_fullsized":"2024-09-12T01:37:46.022592+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:22.221289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":65,"num_write":188,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"263'302","reported_seq":908,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:48.154867+0000","last_change":"2024-09-12T00:28:33.219482+0000","last_active":"2024-09-12T01:35:48.154867+0000","last_peered":"2024-09-12T01:35:48.154867+0000","last_clean":"2024-09-12T01:35:48.154867+0000","last_became_active":"2024-09-12T00:28:33.219182+0000","last_became_peered":"2024-09-12T00:28:33.219182+0000","last_unstale":"2024-09-12T01:35:48.154867+0000","last_undegraded":"2024-09-12T01:35:48.154867+0000","last_fullsized":"2024-09-12T01:35:48.154867+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:37.924996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1277,"num_read_kb":1021,"num_write":469,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"263'305","reported_seq":972,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:19.663015+0000","last_change":"2024-09-12T00:28:31.215345+0000","last_active":"2024-09-12T01:35:19.663015+0000","last_peered":"2024-09-12T01:35:19.663015+0000","last_clean":"2024-09-12T01:35:19.663015+0000","last_became_active":"2024-09-12T00:28:31.214920+0000","last_became_peered":"2024-09-12T00:28:31.214920+0000","last_unstale":"2024-09-12T01:35:19.663015+0000","last_undegraded":"2024-09-12T01:35:19.663015+0000","last_fullsized":"2024-09-12T01:35:19.663015+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:51.465462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6350794,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":515,"num_read_kb":15343,"num_write":1167,"num_write_kb":35661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.627067+0000","last_change":"2024-09-12T00:28:35.208217+0000","last_active":"2024-09-12T01:33:51.627067+0000","last_peered":"2024-09-12T01:33:51.627067+0000","last_clean":"2024-09-12T01:33:51.627067+0000","last_became_active":"2024-09-12T00:28:35.207881+0000","last_became_peered":"2024-09-12T00:28:35.207881+0000","last_unstale":"2024-09-12T01:33:51.627067+0000","last_undegraded":"2024-09-12T01:33:51.627067+0000","last_fullsized":"2024-09-12T01:33:51.627067+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:10.037662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"263'466","reported_seq":1120,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.006707+0000","last_change":"2024-09-12T00:28:37.217137+0000","last_active":"2024-09-12T01:38:01.006707+0000","last_peered":"2024-09-12T01:38:01.006707+0000","last_clean":"2024-09-12T01:38:01.006707+0000","last_became_active":"2024-09-12T00:28:37.216189+0000","last_became_peered":"2024-09-12T00:28:37.216189+0000","last_unstale":"2024-09-12T01:38:01.006707+0000","last_undegraded":"2024-09-12T01:38:01.006707+0000","last_fullsized":"2024-09-12T01:38:01.006707+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:12.417502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90719,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":821,"num_read_kb":1951,"num_write":658,"num_write_kb":528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:51.539194+0000","last_change":"2024-09-12T00:28:39.212958+0000","last_active":"2024-09-12T01:35:51.539194+0000","last_peered":"2024-09-12T01:35:51.539194+0000","last_clean":"2024-09-12T01:35:51.539194+0000","last_became_active":"2024-09-12T00:28:39.212687+0000","last_became_peered":"2024-09-12T00:28:39.212687+0000","last_unstale":"2024-09-12T01:35:51.539194+0000","last_undegraded":"2024-09-12T01:35:51.539194+0000","last_fullsized":"2024-09-12T01:35:51.539194+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:16.911233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"263'133","reported_seq":661,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:51.948546+0000","last_change":"2024-09-12T00:28:41.226044+0000","last_active":"2024-09-12T01:35:51.948546+0000","last_peered":"2024-09-12T01:35:51.948546+0000","last_clean":"2024-09-12T01:35:51.948546+0000","last_became_active":"2024-09-12T00:28:41.225700+0000","last_became_peered":"2024-09-12T00:28:41.225700+0000","last_unstale":"2024-09-12T01:35:51.948546+0000","last_undegraded":"2024-09-12T01:35:51.948546+0000","last_fullsized":"2024-09-12T01:35:51.948546+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:22.538216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":521,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":185,"num_read_kb":167,"num_write":321,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"263'175","reported_seq":779,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.533678+0000","last_change":"2024-09-12T00:28:33.205438+0000","last_active":"2024-09-12T01:33:51.533678+0000","last_peered":"2024-09-12T01:33:51.533678+0000","last_clean":"2024-09-12T01:33:51.533678+0000","last_became_active":"2024-09-12T00:28:33.204532+0000","last_became_peered":"2024-09-12T00:28:33.204532+0000","last_unstale":"2024-09-12T01:33:51.533678+0000","last_undegraded":"2024-09-12T01:33:51.533678+0000","last_fullsized":"2024-09-12T01:33:51.533678+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:42.519724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":765,"num_read_kb":622,"num_write":270,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"263'310","reported_seq":946,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:24.852094+0000","last_change":"2024-09-12T00:28:31.207547+0000","last_active":"2024-09-12T01:36:24.852094+0000","last_peered":"2024-09-12T01:36:24.852094+0000","last_clean":"2024-09-12T01:36:24.852094+0000","last_became_active":"2024-09-12T00:28:31.207269+0000","last_became_peered":"2024-09-12T00:28:31.207269+0000","last_unstale":"2024-09-12T01:36:24.852094+0000","last_undegraded":"2024-09-12T01:36:24.852094+0000","last_fullsized":"2024-09-12T01:36:24.852094+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:27.052564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11558926,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":469,"num_read_kb":24702,"num_write":1056,"num_write_kb":40904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.627126+0000","last_change":"2024-09-12T00:28:35.209783+0000","last_active":"2024-09-12T01:33:51.627126+0000","last_peered":"2024-09-12T01:33:51.627126+0000","last_clean":"2024-09-12T01:33:51.627126+0000","last_became_active":"2024-09-12T00:28:35.208829+0000","last_became_peered":"2024-09-12T00:28:35.208829+0000","last_unstale":"2024-09-12T01:33:51.627126+0000","last_undegraded":"2024-09-12T01:33:51.627126+0000","last_fullsized":"2024-09-12T01:33:51.627126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:49.399261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"263'284","reported_seq":877,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.054138+0000","last_change":"2024-09-12T00:28:37.210416+0000","last_active":"2024-09-12T01:38:01.054138+0000","last_peered":"2024-09-12T01:38:01.054138+0000","last_clean":"2024-09-12T01:38:01.054138+0000","last_became_active":"2024-09-12T00:28:37.210162+0000","last_became_peered":"2024-09-12T00:28:37.210162+0000","last_unstale":"2024-09-12T01:38:01.054138+0000","last_undegraded":"2024-09-12T01:38:01.054138+0000","last_fullsized":"2024-09-12T01:38:01.054138+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:03.051183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46921,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":495,"num_read_kb":1053,"num_write":432,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:06.785115+0000","last_change":"2024-09-12T00:28:39.220793+0000","last_active":"2024-09-12T01:34:06.785115+0000","last_peered":"2024-09-12T01:34:06.785115+0000","last_clean":"2024-09-12T01:34:06.785115+0000","last_became_active":"2024-09-12T00:28:39.220468+0000","last_became_peered":"2024-09-12T00:28:39.220468+0000","last_unstale":"2024-09-12T01:34:06.785115+0000","last_undegraded":"2024-09-12T01:34:06.785115+0000","last_fullsized":"2024-09-12T01:34:06.785115+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:49.834445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"263'81","reported_seq":575,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:59.659578+0000","last_change":"2024-09-12T00:28:41.228956+0000","last_active":"2024-09-12T01:36:59.659578+0000","last_peered":"2024-09-12T01:36:59.659578+0000","last_clean":"2024-09-12T01:36:59.659578+0000","last_became_active":"2024-09-12T00:28:41.228663+0000","last_became_peered":"2024-09-12T00:28:41.228663+0000","last_unstale":"2024-09-12T01:36:59.659578+0000","last_undegraded":"2024-09-12T01:36:59.659578+0000","last_fullsized":"2024-09-12T01:36:59.659578+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:51.130761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":503,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":60,"num_read_kb":59,"num_write":193,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"263'158","reported_seq":779,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:45.663215+0000","last_change":"2024-09-12T00:28:33.207160+0000","last_active":"2024-09-12T01:35:45.663215+0000","last_peered":"2024-09-12T01:35:45.663215+0000","last_clean":"2024-09-12T01:35:45.663215+0000","last_became_active":"2024-09-12T00:28:33.206883+0000","last_became_peered":"2024-09-12T00:28:33.206883+0000","last_unstale":"2024-09-12T01:35:45.663215+0000","last_undegraded":"2024-09-12T01:35:45.663215+0000","last_fullsized":"2024-09-12T01:35:45.663215+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:15.306805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":717,"num_read_kb":595,"num_write":233,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"263'296","reported_seq":911,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.493238+0000","last_change":"2024-09-12T00:28:31.203866+0000","last_active":"2024-09-12T01:38:01.493238+0000","last_peered":"2024-09-12T01:38:01.493238+0000","last_clean":"2024-09-12T01:38:01.493238+0000","last_became_active":"2024-09-12T00:28:31.203369+0000","last_became_peered":"2024-09-12T00:28:31.203369+0000","last_unstale":"2024-09-12T01:38:01.493238+0000","last_undegraded":"2024-09-12T01:38:01.493238+0000","last_fullsized":"2024-09-12T01:38:01.493238+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:04.800888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7425264,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":365,"num_read_kb":56295,"num_write":839,"num_write_kb":46368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.933271+0000","last_change":"2024-09-12T00:28:35.208477+0000","last_active":"2024-09-12T01:33:51.933271+0000","last_peered":"2024-09-12T01:33:51.933271+0000","last_clean":"2024-09-12T01:33:51.933271+0000","last_became_active":"2024-09-12T00:28:35.207923+0000","last_became_peered":"2024-09-12T00:28:35.207923+0000","last_unstale":"2024-09-12T01:33:51.933271+0000","last_undegraded":"2024-09-12T01:33:51.933271+0000","last_fullsized":"2024-09-12T01:33:51.933271+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:33.170429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"263'348","reported_seq":950,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.685418+0000","last_change":"2024-09-12T00:28:37.220980+0000","last_active":"2024-09-12T01:38:00.685418+0000","last_peered":"2024-09-12T01:38:00.685418+0000","last_clean":"2024-09-12T01:38:00.685418+0000","last_became_active":"2024-09-12T00:28:37.220674+0000","last_became_peered":"2024-09-12T00:28:37.220674+0000","last_unstale":"2024-09-12T01:38:00.685418+0000","last_undegraded":"2024-09-12T01:38:00.685418+0000","last_fullsized":"2024-09-12T01:38:00.685418+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:29.407891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48847,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":575,"num_read_kb":1313,"num_write":464,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"263'738","reported_seq":4566,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.053880+0000","last_change":"2024-09-12T00:28:39.214151+0000","last_active":"2024-09-12T01:38:00.053880+0000","last_peered":"2024-09-12T01:38:00.053880+0000","last_clean":"2024-09-12T01:38:00.053880+0000","last_became_active":"2024-09-12T00:28:39.213871+0000","last_became_peered":"2024-09-12T00:28:39.213871+0000","last_unstale":"2024-09-12T01:38:00.053880+0000","last_undegraded":"2024-09-12T01:38:00.053880+0000","last_fullsized":"2024-09-12T01:38:00.053880+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":700,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:10.173214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"263'194","reported_seq":745,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:40.186256+0000","last_change":"2024-09-12T00:28:41.227781+0000","last_active":"2024-09-12T01:36:40.186256+0000","last_peered":"2024-09-12T01:36:40.186256+0000","last_clean":"2024-09-12T01:36:40.186256+0000","last_became_active":"2024-09-12T00:28:41.227310+0000","last_became_peered":"2024-09-12T00:28:41.227310+0000","last_unstale":"2024-09-12T01:36:40.186256+0000","last_undegraded":"2024-09-12T01:36:40.186256+0000","last_fullsized":"2024-09-12T01:36:40.186256+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:23.647466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1879,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":313,"num_read_kb":267,"num_write":467,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"263'134","reported_seq":758,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.533762+0000","last_change":"2024-09-12T00:28:33.211637+0000","last_active":"2024-09-12T01:33:51.533762+0000","last_peered":"2024-09-12T01:33:51.533762+0000","last_clean":"2024-09-12T01:33:51.533762+0000","last_became_active":"2024-09-12T00:28:33.211327+0000","last_became_peered":"2024-09-12T00:28:33.211327+0000","last_unstale":"2024-09-12T01:33:51.533762+0000","last_undegraded":"2024-09-12T01:33:51.533762+0000","last_fullsized":"2024-09-12T01:33:51.533762+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:57.179232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":621,"num_read_kb":525,"num_write":194,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"263'361","reported_seq":1059,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.544158+0000","last_change":"2024-09-12T00:28:31.202041+0000","last_active":"2024-09-12T01:38:01.544158+0000","last_peered":"2024-09-12T01:38:01.544158+0000","last_clean":"2024-09-12T01:38:01.544158+0000","last_became_active":"2024-09-12T00:28:31.201275+0000","last_became_peered":"2024-09-12T00:28:31.201275+0000","last_unstale":"2024-09-12T01:38:01.544158+0000","last_undegraded":"2024-09-12T01:38:01.544158+0000","last_fullsized":"2024-09-12T01:38:01.544158+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:04.675535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395916,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":631,"num_read_kb":30113,"num_write":1181,"num_write_kb":53346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1445,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.876592+0000","last_change":"2024-09-12T00:28:35.210438+0000","last_active":"2024-09-12T01:37:46.876592+0000","last_peered":"2024-09-12T01:37:46.876592+0000","last_clean":"2024-09-12T01:37:46.876592+0000","last_became_active":"2024-09-12T00:28:35.210173+0000","last_became_peered":"2024-09-12T00:28:35.210173+0000","last_unstale":"2024-09-12T01:37:46.876592+0000","last_undegraded":"2024-09-12T01:37:46.876592+0000","last_fullsized":"2024-09-12T01:37:46.876592+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:01.967609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":948,"num_read_kb":948,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"263'106","reported_seq":638,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:54.637565+0000","last_change":"2024-09-12T00:28:37.424197+0000","last_active":"2024-09-12T01:33:54.637565+0000","last_peered":"2024-09-12T01:33:54.637565+0000","last_clean":"2024-09-12T01:33:54.637565+0000","last_became_active":"2024-09-12T00:28:37.423847+0000","last_became_peered":"2024-09-12T00:28:37.423847+0000","last_unstale":"2024-09-12T01:33:54.637565+0000","last_undegraded":"2024-09-12T01:33:54.637565+0000","last_fullsized":"2024-09-12T01:33:54.637565+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:11.857170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":109,"num_read_kb":102,"num_write":74,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"263'759","reported_seq":2646,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.054967+0000","last_change":"2024-09-12T00:28:39.216574+0000","last_active":"2024-09-12T01:38:00.054967+0000","last_peered":"2024-09-12T01:38:00.054967+0000","last_clean":"2024-09-12T01:38:00.054967+0000","last_became_active":"2024-09-12T00:28:39.216244+0000","last_became_peered":"2024-09-12T00:28:39.216244+0000","last_unstale":"2024-09-12T01:38:00.054967+0000","last_undegraded":"2024-09-12T01:38:00.054967+0000","last_fullsized":"2024-09-12T01:38:00.054967+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":700,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:06.051077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"263'177","reported_seq":688,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:41.529420+0000","last_change":"2024-09-12T00:28:41.226032+0000","last_active":"2024-09-12T01:36:41.529420+0000","last_peered":"2024-09-12T01:36:41.529420+0000","last_clean":"2024-09-12T01:36:41.529420+0000","last_became_active":"2024-09-12T00:28:41.225728+0000","last_became_peered":"2024-09-12T00:28:41.225728+0000","last_unstale":"2024-09-12T01:36:41.529420+0000","last_undegraded":"2024-09-12T01:36:41.529420+0000","last_fullsized":"2024-09-12T01:36:41.529420+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:37.084319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":145,"num_write":308,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"263'4256","reported_seq":4857,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:58.613431+0000","last_change":"2024-09-12T00:28:33.206100+0000","last_active":"2024-09-12T01:33:58.613431+0000","last_peered":"2024-09-12T01:33:58.613431+0000","last_clean":"2024-09-12T01:33:58.613431+0000","last_became_active":"2024-09-12T00:28:33.205792+0000","last_became_peered":"2024-09-12T00:28:33.205792+0000","last_unstale":"2024-09-12T01:33:58.613431+0000","last_undegraded":"2024-09-12T01:33:58.613431+0000","last_fullsized":"2024-09-12T01:33:58.613431+0000","mapping_epoch":27,"log_start":"263'4200","ondisk_log_start":"263'4200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":3000,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:14.540790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17142,"num_read_kb":14400,"num_write":6430,"num_write_kb":3228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"263'314","reported_seq":1033,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:44.650323+0000","last_change":"2024-09-12T00:28:31.202748+0000","last_active":"2024-09-12T01:35:44.650323+0000","last_peered":"2024-09-12T01:35:44.650323+0000","last_clean":"2024-09-12T01:35:44.650323+0000","last_became_active":"2024-09-12T00:28:31.202456+0000","last_became_peered":"2024-09-12T00:28:31.202456+0000","last_unstale":"2024-09-12T01:35:44.650323+0000","last_undegraded":"2024-09-12T01:35:44.650323+0000","last_fullsized":"2024-09-12T01:35:44.650323+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:33.698882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9926443,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":589,"num_read_kb":78127,"num_write":1311,"num_write_kb":48684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.533751+0000","last_change":"2024-09-12T00:28:35.207665+0000","last_active":"2024-09-12T01:33:51.533751+0000","last_peered":"2024-09-12T01:33:51.533751+0000","last_clean":"2024-09-12T01:33:51.533751+0000","last_became_active":"2024-09-12T00:28:35.207343+0000","last_became_peered":"2024-09-12T00:28:35.207343+0000","last_unstale":"2024-09-12T01:33:51.533751+0000","last_undegraded":"2024-09-12T01:33:51.533751+0000","last_fullsized":"2024-09-12T01:33:51.533751+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:06.989902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"263'364","reported_seq":977,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:07.799351+0000","last_change":"2024-09-12T00:28:37.211454+0000","last_active":"2024-09-12T01:36:07.799351+0000","last_peered":"2024-09-12T01:36:07.799351+0000","last_clean":"2024-09-12T01:36:07.799351+0000","last_became_active":"2024-09-12T00:28:37.211090+0000","last_became_peered":"2024-09-12T00:28:37.211090+0000","last_unstale":"2024-09-12T01:36:07.799351+0000","last_undegraded":"2024-09-12T01:36:07.799351+0000","last_fullsized":"2024-09-12T01:36:07.799351+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:34:21.708434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57189,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":581,"num_read_kb":1095,"num_write":456,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.534269+0000","last_change":"2024-09-12T00:28:39.219992+0000","last_active":"2024-09-12T01:33:56.534269+0000","last_peered":"2024-09-12T01:33:56.534269+0000","last_clean":"2024-09-12T01:33:56.534269+0000","last_became_active":"2024-09-12T00:28:39.219687+0000","last_became_peered":"2024-09-12T00:28:39.219687+0000","last_unstale":"2024-09-12T01:33:56.534269+0000","last_undegraded":"2024-09-12T01:33:56.534269+0000","last_fullsized":"2024-09-12T01:33:56.534269+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:05.399679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"263'114","reported_seq":619,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:41.523331+0000","last_change":"2024-09-12T00:28:41.226379+0000","last_active":"2024-09-12T01:36:41.523331+0000","last_peered":"2024-09-12T01:36:41.523331+0000","last_clean":"2024-09-12T01:36:41.523331+0000","last_became_active":"2024-09-12T00:28:41.226049+0000","last_became_peered":"2024-09-12T00:28:41.226049+0000","last_unstale":"2024-09-12T01:36:41.523331+0000","last_undegraded":"2024-09-12T01:36:41.523331+0000","last_fullsized":"2024-09-12T01:36:41.523331+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:35.250632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":871,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":118,"num_read_kb":115,"num_write":279,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"263'144","reported_seq":778,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:31.547552+0000","last_change":"2024-09-12T00:28:33.214340+0000","last_active":"2024-09-12T01:35:31.547552+0000","last_peered":"2024-09-12T01:35:31.547552+0000","last_clean":"2024-09-12T01:35:31.547552+0000","last_became_active":"2024-09-12T00:28:33.214018+0000","last_became_peered":"2024-09-12T00:28:33.214018+0000","last_unstale":"2024-09-12T01:35:31.547552+0000","last_undegraded":"2024-09-12T01:35:31.547552+0000","last_fullsized":"2024-09-12T01:35:31.547552+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:53.550703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":636,"num_read_kb":544,"num_write":220,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":614,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:31.723989+0000","last_change":"2024-09-12T00:28:14.748208+0000","last_active":"2024-09-12T01:34:31.723989+0000","last_peered":"2024-09-12T01:34:31.723989+0000","last_clean":"2024-09-12T01:34:31.723989+0000","last_became_active":"2024-09-12T00:28:14.744766+0000","last_became_peered":"2024-09-12T00:28:14.744766+0000","last_unstale":"2024-09-12T01:34:31.723989+0000","last_undegraded":"2024-09-12T01:34:31.723989+0000","last_fullsized":"2024-09-12T01:34:31.723989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:13.107271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:13.107271+0000","last_clean_scrub_stamp":"2024-09-12T00:28:13.107271+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:46.810948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"21'1","reported_seq":522,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:02.789773+0000","last_change":"2024-09-12T00:28:21.169710+0000","last_active":"2024-09-12T01:35:02.789773+0000","last_peered":"2024-09-12T01:35:02.789773+0000","last_clean":"2024-09-12T01:35:02.789773+0000","last_became_active":"2024-09-12T00:28:19.162328+0000","last_became_peered":"2024-09-12T00:28:19.162328+0000","last_unstale":"2024-09-12T01:35:02.789773+0000","last_undegraded":"2024-09-12T01:35:02.789773+0000","last_fullsized":"2024-09-12T01:35:02.789773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_clean_scrub_stamp":"2024-09-12T00:28:18.139537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:10.146909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046717800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"263'264","reported_seq":905,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:14.646937+0000","last_change":"2024-09-12T00:28:31.215764+0000","last_active":"2024-09-12T01:35:14.646937+0000","last_peered":"2024-09-12T01:35:14.646937+0000","last_clean":"2024-09-12T01:35:14.646937+0000","last_became_active":"2024-09-12T00:28:31.215485+0000","last_became_peered":"2024-09-12T00:28:31.215485+0000","last_unstale":"2024-09-12T01:35:14.646937+0000","last_undegraded":"2024-09-12T01:35:14.646937+0000","last_fullsized":"2024-09-12T01:35:14.646937+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:18.448556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16203515,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":406,"num_read_kb":39194,"num_write":1039,"num_write_kb":25197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.731330+0000","last_change":"2024-09-12T00:28:35.209125+0000","last_active":"2024-09-12T01:35:16.731330+0000","last_peered":"2024-09-12T01:35:16.731330+0000","last_clean":"2024-09-12T01:35:16.731330+0000","last_became_active":"2024-09-12T00:28:35.208812+0000","last_became_peered":"2024-09-12T00:28:35.208812+0000","last_unstale":"2024-09-12T01:35:16.731330+0000","last_undegraded":"2024-09-12T01:35:16.731330+0000","last_fullsized":"2024-09-12T01:35:16.731330+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:01.363469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"263'732","reported_seq":1432,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:47.138248+0000","last_change":"2024-09-12T00:28:37.221326+0000","last_active":"2024-09-12T01:37:47.138248+0000","last_peered":"2024-09-12T01:37:47.138248+0000","last_clean":"2024-09-12T01:37:47.138248+0000","last_became_active":"2024-09-12T00:28:37.221001+0000","last_became_peered":"2024-09-12T00:28:37.221001+0000","last_unstale":"2024-09-12T01:37:47.138248+0000","last_undegraded":"2024-09-12T01:37:47.138248+0000","last_fullsized":"2024-09-12T01:37:47.138248+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":700,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:20.998547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167007,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1417,"num_read_kb":3020,"num_write":1346,"num_write_kb":1186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:51.797587+0000","last_change":"2024-09-12T00:28:39.221623+0000","last_active":"2024-09-12T01:35:51.797587+0000","last_peered":"2024-09-12T01:35:51.797587+0000","last_clean":"2024-09-12T01:35:51.797587+0000","last_became_active":"2024-09-12T00:28:39.221007+0000","last_became_peered":"2024-09-12T00:28:39.221007+0000","last_unstale":"2024-09-12T01:35:51.797587+0000","last_undegraded":"2024-09-12T01:35:51.797587+0000","last_fullsized":"2024-09-12T01:35:51.797587+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:49.965506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"263'186","reported_seq":885,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:42.615741+0000","last_change":"2024-09-12T00:28:41.226364+0000","last_active":"2024-09-12T01:36:42.615741+0000","last_peered":"2024-09-12T01:36:42.615741+0000","last_clean":"2024-09-12T01:36:42.615741+0000","last_became_active":"2024-09-12T00:28:41.226077+0000","last_became_peered":"2024-09-12T00:28:41.226077+0000","last_unstale":"2024-09-12T01:36:42.615741+0000","last_undegraded":"2024-09-12T01:36:42.615741+0000","last_fullsized":"2024-09-12T01:36:42.615741+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:54.387034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":407,"num_read_kb":405,"num_write":366,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"263'200","reported_seq":809,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.797044+0000","last_change":"2024-09-12T00:28:33.214619+0000","last_active":"2024-09-12T01:35:46.797044+0000","last_peered":"2024-09-12T01:35:46.797044+0000","last_clean":"2024-09-12T01:35:46.797044+0000","last_became_active":"2024-09-12T00:28:33.214351+0000","last_became_peered":"2024-09-12T00:28:33.214351+0000","last_unstale":"2024-09-12T01:35:46.797044+0000","last_undegraded":"2024-09-12T01:35:46.797044+0000","last_fullsized":"2024-09-12T01:35:46.797044+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:27.014128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":877,"num_read_kb":731,"num_write":291,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.724871+0000","last_change":"2024-09-12T00:28:21.165739+0000","last_active":"2024-09-12T01:34:36.724871+0000","last_peered":"2024-09-12T01:34:36.724871+0000","last_clean":"2024-09-12T01:34:36.724871+0000","last_became_active":"2024-09-12T00:28:19.164970+0000","last_became_peered":"2024-09-12T00:28:19.164970+0000","last_unstale":"2024-09-12T01:34:36.724871+0000","last_undegraded":"2024-09-12T01:34:36.724871+0000","last_fullsized":"2024-09-12T01:34:36.724871+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_clean_scrub_stamp":"2024-09-12T00:28:18.139537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:32.778181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055291100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"263'372","reported_seq":1104,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.731893+0000","last_change":"2024-09-12T00:28:31.205110+0000","last_active":"2024-09-12T01:38:01.731893+0000","last_peered":"2024-09-12T01:38:01.731893+0000","last_clean":"2024-09-12T01:38:01.731893+0000","last_became_active":"2024-09-12T00:28:31.204842+0000","last_became_peered":"2024-09-12T00:28:31.204842+0000","last_unstale":"2024-09-12T01:38:01.731893+0000","last_undegraded":"2024-09-12T01:38:01.731893+0000","last_fullsized":"2024-09-12T01:38:01.731893+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:16.741760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":699,"num_read_kb":44079,"num_write":1206,"num_write_kb":29123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:47.796159+0000","last_change":"2024-09-12T00:28:35.216312+0000","last_active":"2024-09-12T01:35:47.796159+0000","last_peered":"2024-09-12T01:35:47.796159+0000","last_clean":"2024-09-12T01:35:47.796159+0000","last_became_active":"2024-09-12T00:28:35.215063+0000","last_became_peered":"2024-09-12T00:28:35.215063+0000","last_unstale":"2024-09-12T01:35:47.796159+0000","last_undegraded":"2024-09-12T01:35:47.796159+0000","last_fullsized":"2024-09-12T01:35:47.796159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:30.514762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"263'1343","reported_seq":3122,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:49.932054+0000","last_change":"2024-09-12T00:28:37.211623+0000","last_active":"2024-09-12T01:37:49.932054+0000","last_peered":"2024-09-12T01:37:49.932054+0000","last_clean":"2024-09-12T01:37:49.932054+0000","last_became_active":"2024-09-12T00:28:37.211275+0000","last_became_peered":"2024-09-12T00:28:37.211275+0000","last_unstale":"2024-09-12T01:37:49.932054+0000","last_undegraded":"2024-09-12T01:37:49.932054+0000","last_fullsized":"2024-09-12T01:37:49.932054+0000","mapping_epoch":31,"log_start":"263'1300","ondisk_log_start":"263'1300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":1300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:17.542912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188900,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2142,"num_read_kb":3861,"num_write":1272,"num_write_kb":1085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:36.734401+0000","last_change":"2024-09-12T00:28:39.217983+0000","last_active":"2024-09-12T01:35:36.734401+0000","last_peered":"2024-09-12T01:35:36.734401+0000","last_clean":"2024-09-12T01:35:36.734401+0000","last_became_active":"2024-09-12T00:28:39.217623+0000","last_became_peered":"2024-09-12T00:28:39.217623+0000","last_unstale":"2024-09-12T01:35:36.734401+0000","last_undegraded":"2024-09-12T01:35:36.734401+0000","last_fullsized":"2024-09-12T01:35:36.734401+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:06.473217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"263'261","reported_seq":805,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:13.164033+0000","last_change":"2024-09-12T00:28:41.255226+0000","last_active":"2024-09-12T01:36:13.164033+0000","last_peered":"2024-09-12T01:36:13.164033+0000","last_clean":"2024-09-12T01:36:13.164033+0000","last_became_active":"2024-09-12T00:28:41.254814+0000","last_became_peered":"2024-09-12T00:28:41.254814+0000","last_unstale":"2024-09-12T01:36:13.164033+0000","last_undegraded":"2024-09-12T01:36:13.164033+0000","last_fullsized":"2024-09-12T01:36:13.164033+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:30.223844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":416,"num_read_kb":400,"num_write":581,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"263'116","reported_seq":754,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.948067+0000","last_change":"2024-09-12T00:28:33.216657+0000","last_active":"2024-09-12T01:35:46.948067+0000","last_peered":"2024-09-12T01:35:46.948067+0000","last_clean":"2024-09-12T01:35:46.948067+0000","last_became_active":"2024-09-12T00:28:33.216335+0000","last_became_peered":"2024-09-12T00:28:33.216335+0000","last_unstale":"2024-09-12T01:35:46.948067+0000","last_undegraded":"2024-09-12T01:35:46.948067+0000","last_fullsized":"2024-09-12T01:35:46.948067+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:46.854089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":537,"num_read_kb":460,"num_write":159,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":528,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:01.533662+0000","last_change":"2024-09-12T00:28:21.323944+0000","last_active":"2024-09-12T01:35:01.533662+0000","last_peered":"2024-09-12T01:35:01.533662+0000","last_clean":"2024-09-12T01:35:01.533662+0000","last_became_active":"2024-09-12T00:28:19.225901+0000","last_became_peered":"2024-09-12T00:28:19.225901+0000","last_unstale":"2024-09-12T01:35:01.533662+0000","last_undegraded":"2024-09-12T01:35:01.533662+0000","last_fullsized":"2024-09-12T01:35:01.533662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_clean_scrub_stamp":"2024-09-12T00:28:18.139537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:52.557475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032319500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"263'272","reported_seq":1071,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:45.210107+0000","last_change":"2024-09-12T00:28:31.198866+0000","last_active":"2024-09-12T01:37:45.210107+0000","last_peered":"2024-09-12T01:37:45.210107+0000","last_clean":"2024-09-12T01:37:45.210107+0000","last_became_active":"2024-09-12T00:28:31.198575+0000","last_became_peered":"2024-09-12T00:28:31.198575+0000","last_unstale":"2024-09-12T01:37:45.210107+0000","last_undegraded":"2024-09-12T01:37:45.210107+0000","last_fullsized":"2024-09-12T01:37:45.210107+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:05.185444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14429172,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":767,"num_read_kb":78199,"num_write":1008,"num_write_kb":40255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.538695+0000","last_change":"2024-09-12T00:28:35.209485+0000","last_active":"2024-09-12T01:35:46.538695+0000","last_peered":"2024-09-12T01:35:46.538695+0000","last_clean":"2024-09-12T01:35:46.538695+0000","last_became_active":"2024-09-12T00:28:35.209218+0000","last_became_peered":"2024-09-12T00:28:35.209218+0000","last_unstale":"2024-09-12T01:35:46.538695+0000","last_undegraded":"2024-09-12T01:35:46.538695+0000","last_fullsized":"2024-09-12T01:35:46.538695+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:55.033156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"263'279","reported_seq":1658,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:43.275282+0000","last_change":"2024-09-12T00:28:37.424055+0000","last_active":"2024-09-12T01:37:43.275282+0000","last_peered":"2024-09-12T01:37:43.275282+0000","last_clean":"2024-09-12T01:37:43.275282+0000","last_became_active":"2024-09-12T00:28:37.423714+0000","last_became_peered":"2024-09-12T00:28:37.423714+0000","last_unstale":"2024-09-12T01:37:43.275282+0000","last_undegraded":"2024-09-12T01:37:43.275282+0000","last_fullsized":"2024-09-12T01:37:43.275282+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:07.336278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":244,"num_read_kb":234,"num_write":227,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:21.793908+0000","last_change":"2024-09-12T00:28:39.218980+0000","last_active":"2024-09-12T01:35:21.793908+0000","last_peered":"2024-09-12T01:35:21.793908+0000","last_clean":"2024-09-12T01:35:21.793908+0000","last_became_active":"2024-09-12T00:28:39.218692+0000","last_became_peered":"2024-09-12T00:28:39.218692+0000","last_unstale":"2024-09-12T01:35:21.793908+0000","last_undegraded":"2024-09-12T01:35:21.793908+0000","last_fullsized":"2024-09-12T01:35:21.793908+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:07.969643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"263'252","reported_seq":855,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:45.936486+0000","last_change":"2024-09-12T00:28:41.229721+0000","last_active":"2024-09-12T01:37:45.936486+0000","last_peered":"2024-09-12T01:37:45.936486+0000","last_clean":"2024-09-12T01:37:45.936486+0000","last_became_active":"2024-09-12T00:28:41.229441+0000","last_became_peered":"2024-09-12T00:28:41.229441+0000","last_unstale":"2024-09-12T01:37:45.936486+0000","last_undegraded":"2024-09-12T01:37:45.936486+0000","last_fullsized":"2024-09-12T01:37:45.936486+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:46.056278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":487,"num_read_kb":509,"num_write":546,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"263'223","reported_seq":896,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:58.635373+0000","last_change":"2024-09-12T00:28:33.205511+0000","last_active":"2024-09-12T01:35:58.635373+0000","last_peered":"2024-09-12T01:35:58.635373+0000","last_clean":"2024-09-12T01:35:58.635373+0000","last_became_active":"2024-09-12T00:28:33.205107+0000","last_became_peered":"2024-09-12T00:28:33.205107+0000","last_unstale":"2024-09-12T01:35:58.635373+0000","last_undegraded":"2024-09-12T01:35:58.635373+0000","last_fullsized":"2024-09-12T01:35:58.635373+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:39.413290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1021,"num_read_kb":847,"num_write":335,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"23'2","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:02.789730+0000","last_change":"2024-09-12T00:28:21.170135+0000","last_active":"2024-09-12T01:35:02.789730+0000","last_peered":"2024-09-12T01:35:02.789730+0000","last_clean":"2024-09-12T01:35:02.789730+0000","last_became_active":"2024-09-12T00:28:19.162307+0000","last_became_peered":"2024-09-12T00:28:19.162307+0000","last_unstale":"2024-09-12T01:35:02.789730+0000","last_undegraded":"2024-09-12T01:35:02.789730+0000","last_fullsized":"2024-09-12T01:35:02.789730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_clean_scrub_stamp":"2024-09-12T00:28:18.139537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:21.559693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089189499999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"263'346","reported_seq":1030,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.522162+0000","last_change":"2024-09-12T00:28:31.208859+0000","last_active":"2024-09-12T01:38:01.522162+0000","last_peered":"2024-09-12T01:38:01.522162+0000","last_clean":"2024-09-12T01:38:01.522162+0000","last_became_active":"2024-09-12T00:28:31.208584+0000","last_became_peered":"2024-09-12T00:28:31.208584+0000","last_unstale":"2024-09-12T01:38:01.522162+0000","last_undegraded":"2024-09-12T01:38:01.522162+0000","last_fullsized":"2024-09-12T01:38:01.522162+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:48.765543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":266336,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":632,"num_read_kb":7750,"num_write":1113,"num_write_kb":19514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:26.794599+0000","last_change":"2024-09-12T00:28:35.207488+0000","last_active":"2024-09-12T01:35:26.794599+0000","last_peered":"2024-09-12T01:35:26.794599+0000","last_clean":"2024-09-12T01:35:26.794599+0000","last_became_active":"2024-09-12T00:28:35.207234+0000","last_became_peered":"2024-09-12T00:28:35.207234+0000","last_unstale":"2024-09-12T01:35:26.794599+0000","last_undegraded":"2024-09-12T01:35:26.794599+0000","last_fullsized":"2024-09-12T01:35:26.794599+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:43.759273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"263'160","reported_seq":717,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:47.314594+0000","last_change":"2024-09-12T00:28:37.219924+0000","last_active":"2024-09-12T01:37:47.314594+0000","last_peered":"2024-09-12T01:37:47.314594+0000","last_clean":"2024-09-12T01:37:47.314594+0000","last_became_active":"2024-09-12T00:28:37.219599+0000","last_became_peered":"2024-09-12T00:28:37.219599+0000","last_unstale":"2024-09-12T01:37:47.314594+0000","last_undegraded":"2024-09-12T01:37:47.314594+0000","last_fullsized":"2024-09-12T01:37:47.314594+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:19.639653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":184,"num_read_kb":176,"num_write":136,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:51.550499+0000","last_change":"2024-09-12T00:28:39.216740+0000","last_active":"2024-09-12T01:35:51.550499+0000","last_peered":"2024-09-12T01:35:51.550499+0000","last_clean":"2024-09-12T01:35:51.550499+0000","last_became_active":"2024-09-12T00:28:39.216397+0000","last_became_peered":"2024-09-12T00:28:39.216397+0000","last_unstale":"2024-09-12T01:35:51.550499+0000","last_undegraded":"2024-09-12T01:35:51.550499+0000","last_fullsized":"2024-09-12T01:35:51.550499+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:48.659805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"263'110","reported_seq":654,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:42.778344+0000","last_change":"2024-09-12T00:28:41.230939+0000","last_active":"2024-09-12T01:33:42.778344+0000","last_peered":"2024-09-12T01:33:42.778344+0000","last_clean":"2024-09-12T01:33:42.778344+0000","last_became_active":"2024-09-12T00:28:41.230698+0000","last_became_peered":"2024-09-12T00:28:41.230698+0000","last_unstale":"2024-09-12T01:33:42.778344+0000","last_undegraded":"2024-09-12T01:33:42.778344+0000","last_fullsized":"2024-09-12T01:33:42.778344+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:35.474853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":194,"num_write":246,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"263'101","reported_seq":687,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.944551+0000","last_change":"2024-09-12T00:28:33.214613+0000","last_active":"2024-09-12T01:35:16.944551+0000","last_peered":"2024-09-12T01:35:16.944551+0000","last_clean":"2024-09-12T01:35:16.944551+0000","last_became_active":"2024-09-12T00:28:33.213241+0000","last_became_peered":"2024-09-12T00:28:33.213241+0000","last_unstale":"2024-09-12T01:35:16.944551+0000","last_undegraded":"2024-09-12T01:35:16.944551+0000","last_fullsized":"2024-09-12T01:35:16.944551+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:03.213237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":440,"num_read_kb":364,"num_write":181,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"263'260","reported_seq":876,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:28.765614+0000","last_change":"2024-09-12T00:28:31.209668+0000","last_active":"2024-09-12T01:35:28.765614+0000","last_peered":"2024-09-12T01:35:28.765614+0000","last_clean":"2024-09-12T01:35:28.765614+0000","last_became_active":"2024-09-12T00:28:31.209154+0000","last_became_peered":"2024-09-12T00:28:31.209154+0000","last_unstale":"2024-09-12T01:35:28.765614+0000","last_undegraded":"2024-09-12T01:35:28.765614+0000","last_fullsized":"2024-09-12T01:35:28.765614+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:20.428733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":924838,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":376,"num_read_kb":910,"num_write":940,"num_write_kb":5944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":533,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:01.942757+0000","last_change":"2024-09-12T00:28:21.163542+0000","last_active":"2024-09-12T01:35:01.942757+0000","last_peered":"2024-09-12T01:35:01.942757+0000","last_clean":"2024-09-12T01:35:01.942757+0000","last_became_active":"2024-09-12T00:28:19.383394+0000","last_became_peered":"2024-09-12T00:28:19.383394+0000","last_unstale":"2024-09-12T01:35:01.942757+0000","last_undegraded":"2024-09-12T01:35:01.942757+0000","last_fullsized":"2024-09-12T01:35:01.942757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_clean_scrub_stamp":"2024-09-12T00:28:18.139537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:28.230151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046548800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.793286+0000","last_change":"2024-09-12T00:28:35.208415+0000","last_active":"2024-09-12T01:35:16.793286+0000","last_peered":"2024-09-12T01:35:16.793286+0000","last_clean":"2024-09-12T01:35:16.793286+0000","last_became_active":"2024-09-12T00:28:35.208094+0000","last_became_peered":"2024-09-12T00:28:35.208094+0000","last_unstale":"2024-09-12T01:35:16.793286+0000","last_undegraded":"2024-09-12T01:35:16.793286+0000","last_fullsized":"2024-09-12T01:35:16.793286+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:03.328037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"263'655","reported_seq":1348,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.420767+0000","last_change":"2024-09-12T00:28:37.221025+0000","last_active":"2024-09-12T01:38:01.420767+0000","last_peered":"2024-09-12T01:38:01.420767+0000","last_clean":"2024-09-12T01:38:01.420767+0000","last_became_active":"2024-09-12T00:28:37.220158+0000","last_became_peered":"2024-09-12T00:28:37.220158+0000","last_unstale":"2024-09-12T01:38:01.420767+0000","last_undegraded":"2024-09-12T01:38:01.420767+0000","last_fullsized":"2024-09-12T01:38:01.420767+0000","mapping_epoch":31,"log_start":"263'600","ondisk_log_start":"263'600","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":600,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:50.143092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103952,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1701,"num_read_kb":3039,"num_write":2184,"num_write_kb":1992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:21.546179+0000","last_change":"2024-09-12T00:28:39.220506+0000","last_active":"2024-09-12T01:35:21.546179+0000","last_peered":"2024-09-12T01:35:21.546179+0000","last_clean":"2024-09-12T01:35:21.546179+0000","last_became_active":"2024-09-12T00:28:39.220079+0000","last_became_peered":"2024-09-12T00:28:39.220079+0000","last_unstale":"2024-09-12T01:35:21.546179+0000","last_undegraded":"2024-09-12T01:35:21.546179+0000","last_fullsized":"2024-09-12T01:35:21.546179+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:23.654340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"263'134","reported_seq":653,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.800037+0000","last_change":"2024-09-12T00:28:41.258045+0000","last_active":"2024-09-12T01:36:11.800037+0000","last_peered":"2024-09-12T01:36:11.800037+0000","last_clean":"2024-09-12T01:36:11.800037+0000","last_became_active":"2024-09-12T00:28:41.257739+0000","last_became_peered":"2024-09-12T00:28:41.257739+0000","last_unstale":"2024-09-12T01:36:11.800037+0000","last_undegraded":"2024-09-12T01:36:11.800037+0000","last_fullsized":"2024-09-12T01:36:11.800037+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:03.828940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":203,"num_read_kb":182,"num_write":334,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"263'142","reported_seq":775,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.793315+0000","last_change":"2024-09-12T00:28:33.216340+0000","last_active":"2024-09-12T01:35:16.793315+0000","last_peered":"2024-09-12T01:35:16.793315+0000","last_clean":"2024-09-12T01:35:16.793315+0000","last_became_active":"2024-09-12T00:28:33.216065+0000","last_became_peered":"2024-09-12T00:28:33.216065+0000","last_unstale":"2024-09-12T01:35:16.793315+0000","last_undegraded":"2024-09-12T01:35:16.793315+0000","last_fullsized":"2024-09-12T01:35:16.793315+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:28.642231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":614,"num_read_kb":525,"num_write":208,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"263'263","reported_seq":923,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:18.191774+0000","last_change":"2024-09-12T00:28:31.199416+0000","last_active":"2024-09-12T01:35:18.191774+0000","last_peered":"2024-09-12T01:35:18.191774+0000","last_clean":"2024-09-12T01:35:18.191774+0000","last_became_active":"2024-09-12T00:28:31.198681+0000","last_became_peered":"2024-09-12T00:28:31.198681+0000","last_unstale":"2024-09-12T01:35:18.191774+0000","last_undegraded":"2024-09-12T01:35:18.191774+0000","last_fullsized":"2024-09-12T01:35:18.191774+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:11.597114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5837932,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":405,"num_read_kb":38180,"num_write":974,"num_write_kb":26889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":522,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.731345+0000","last_change":"2024-09-12T00:28:21.165802+0000","last_active":"2024-09-12T01:35:16.731345+0000","last_peered":"2024-09-12T01:35:16.731345+0000","last_clean":"2024-09-12T01:35:16.731345+0000","last_became_active":"2024-09-12T00:28:19.384222+0000","last_became_peered":"2024-09-12T00:28:19.384222+0000","last_unstale":"2024-09-12T01:35:16.731345+0000","last_undegraded":"2024-09-12T01:35:16.731345+0000","last_fullsized":"2024-09-12T01:35:16.731345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_clean_scrub_stamp":"2024-09-12T00:28:18.139537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:40.635892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060999899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"37'5","reported_seq":982,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:59.821892+0000","last_change":"2024-09-12T00:28:35.208566+0000","last_active":"2024-09-12T01:37:59.821892+0000","last_peered":"2024-09-12T01:37:59.821892+0000","last_clean":"2024-09-12T01:37:59.821892+0000","last_became_active":"2024-09-12T00:28:35.207941+0000","last_became_peered":"2024-09-12T00:28:35.207941+0000","last_unstale":"2024-09-12T01:37:59.821892+0000","last_undegraded":"2024-09-12T01:37:59.821892+0000","last_fullsized":"2024-09-12T01:37:59.821892+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:30.697798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":1191,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"263'246","reported_seq":839,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:48.927414+0000","last_change":"2024-09-12T00:28:37.424197+0000","last_active":"2024-09-12T01:36:48.927414+0000","last_peered":"2024-09-12T01:36:48.927414+0000","last_clean":"2024-09-12T01:36:48.927414+0000","last_became_active":"2024-09-12T00:28:37.423835+0000","last_became_peered":"2024-09-12T00:28:37.423835+0000","last_unstale":"2024-09-12T01:36:48.927414+0000","last_undegraded":"2024-09-12T01:36:48.927414+0000","last_fullsized":"2024-09-12T01:36:48.927414+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:55.348547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":310,"num_read_kb":301,"num_write":288,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"263'776","reported_seq":2891,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:49.977782+0000","last_change":"2024-09-12T00:28:39.214336+0000","last_active":"2024-09-12T01:37:49.977782+0000","last_peered":"2024-09-12T01:37:49.977782+0000","last_clean":"2024-09-12T01:37:49.977782+0000","last_became_active":"2024-09-12T00:28:39.214050+0000","last_became_peered":"2024-09-12T00:28:39.214050+0000","last_unstale":"2024-09-12T01:37:49.977782+0000","last_undegraded":"2024-09-12T01:37:49.977782+0000","last_fullsized":"2024-09-12T01:37:49.977782+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:42.935841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"263'143","reported_seq":656,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:29.656020+0000","last_change":"2024-09-12T00:28:41.255145+0000","last_active":"2024-09-12T01:36:29.656020+0000","last_peered":"2024-09-12T01:36:29.656020+0000","last_clean":"2024-09-12T01:36:29.656020+0000","last_became_active":"2024-09-12T00:28:41.254826+0000","last_became_peered":"2024-09-12T00:28:41.254826+0000","last_unstale":"2024-09-12T01:36:29.656020+0000","last_undegraded":"2024-09-12T01:36:29.656020+0000","last_fullsized":"2024-09-12T01:36:29.656020+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:08.523605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1298,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":177,"num_read_kb":162,"num_write":341,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"263'307","reported_seq":910,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:37.788688+0000","last_change":"2024-09-12T00:28:33.217822+0000","last_active":"2024-09-12T01:35:37.788688+0000","last_peered":"2024-09-12T01:35:37.788688+0000","last_clean":"2024-09-12T01:35:37.788688+0000","last_became_active":"2024-09-12T00:28:33.217516+0000","last_became_peered":"2024-09-12T00:28:33.217516+0000","last_unstale":"2024-09-12T01:35:37.788688+0000","last_undegraded":"2024-09-12T01:35:37.788688+0000","last_fullsized":"2024-09-12T01:35:37.788688+0000","mapping_epoch":27,"log_start":"260'200","ondisk_log_start":"260'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:49.139392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1312,"num_read_kb":1045,"num_write":501,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"263'242","reported_seq":836,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:44.650445+0000","last_change":"2024-09-12T00:28:31.203440+0000","last_active":"2024-09-12T01:35:44.650445+0000","last_peered":"2024-09-12T01:35:44.650445+0000","last_clean":"2024-09-12T01:35:44.650445+0000","last_became_active":"2024-09-12T00:28:31.202895+0000","last_became_peered":"2024-09-12T00:28:31.202895+0000","last_unstale":"2024-09-12T01:35:44.650445+0000","last_undegraded":"2024-09-12T01:35:44.650445+0000","last_fullsized":"2024-09-12T01:35:44.650445+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:43.468294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5508333,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":302,"num_read_kb":358,"num_write":890,"num_write_kb":25812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":532,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:31.946415+0000","last_change":"2024-09-12T00:28:21.163585+0000","last_active":"2024-09-12T01:35:31.946415+0000","last_peered":"2024-09-12T01:35:31.946415+0000","last_clean":"2024-09-12T01:35:31.946415+0000","last_became_active":"2024-09-12T00:28:19.160344+0000","last_became_peered":"2024-09-12T00:28:19.160344+0000","last_unstale":"2024-09-12T01:35:31.946415+0000","last_undegraded":"2024-09-12T01:35:31.946415+0000","last_fullsized":"2024-09-12T01:35:31.946415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_clean_scrub_stamp":"2024-09-12T00:28:18.139537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:57.842057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000483707,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.545492+0000","last_change":"2024-09-12T00:28:35.215757+0000","last_active":"2024-09-12T01:35:16.545492+0000","last_peered":"2024-09-12T01:35:16.545492+0000","last_clean":"2024-09-12T01:35:16.545492+0000","last_became_active":"2024-09-12T00:28:35.215429+0000","last_became_peered":"2024-09-12T00:28:35.215429+0000","last_unstale":"2024-09-12T01:35:16.545492+0000","last_undegraded":"2024-09-12T01:35:16.545492+0000","last_fullsized":"2024-09-12T01:35:16.545492+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:04.938748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"263'130","reported_seq":687,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.545524+0000","last_change":"2024-09-12T00:28:37.220271+0000","last_active":"2024-09-12T01:35:16.545524+0000","last_peered":"2024-09-12T01:35:16.545524+0000","last_clean":"2024-09-12T01:35:16.545524+0000","last_became_active":"2024-09-12T00:28:37.219746+0000","last_became_peered":"2024-09-12T00:28:37.219746+0000","last_unstale":"2024-09-12T01:35:16.545524+0000","last_undegraded":"2024-09-12T01:35:16.545524+0000","last_fullsized":"2024-09-12T01:35:16.545524+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:18.690666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":158,"num_read_kb":152,"num_write":104,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"263'764","reported_seq":2679,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:49.984028+0000","last_change":"2024-09-12T00:28:39.218435+0000","last_active":"2024-09-12T01:37:49.984028+0000","last_peered":"2024-09-12T01:37:49.984028+0000","last_clean":"2024-09-12T01:37:49.984028+0000","last_became_active":"2024-09-12T00:28:39.218170+0000","last_became_peered":"2024-09-12T00:28:39.218170+0000","last_unstale":"2024-09-12T01:37:49.984028+0000","last_undegraded":"2024-09-12T01:37:49.984028+0000","last_fullsized":"2024-09-12T01:37:49.984028+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":700,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:17.381935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"263'181","reported_seq":680,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.783783+0000","last_change":"2024-09-12T00:28:41.225659+0000","last_active":"2024-09-12T01:33:56.783783+0000","last_peered":"2024-09-12T01:33:56.783783+0000","last_clean":"2024-09-12T01:33:56.783783+0000","last_became_active":"2024-09-12T00:28:41.225316+0000","last_became_peered":"2024-09-12T00:28:41.225316+0000","last_unstale":"2024-09-12T01:33:56.783783+0000","last_undegraded":"2024-09-12T01:33:56.783783+0000","last_fullsized":"2024-09-12T01:33:56.783783+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:54.404729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":127,"num_read_kb":125,"num_write":428,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"263'342","reported_seq":978,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:20.408095+0000","last_change":"2024-09-12T00:28:33.212942+0000","last_active":"2024-09-12T01:36:20.408095+0000","last_peered":"2024-09-12T01:36:20.408095+0000","last_clean":"2024-09-12T01:36:20.408095+0000","last_became_active":"2024-09-12T00:28:33.212624+0000","last_became_peered":"2024-09-12T00:28:33.212624+0000","last_unstale":"2024-09-12T01:36:20.408095+0000","last_undegraded":"2024-09-12T01:36:20.408095+0000","last_fullsized":"2024-09-12T01:36:20.408095+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:49.030957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1481,"num_read_kb":1196,"num_write":544,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"263'449","reported_seq":1164,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.751547+0000","last_change":"2024-09-12T00:28:31.203441+0000","last_active":"2024-09-12T01:38:01.751547+0000","last_peered":"2024-09-12T01:38:01.751547+0000","last_clean":"2024-09-12T01:38:01.751547+0000","last_became_active":"2024-09-12T00:28:31.203087+0000","last_became_peered":"2024-09-12T00:28:31.203087+0000","last_unstale":"2024-09-12T01:38:01.751547+0000","last_undegraded":"2024-09-12T01:38:01.751547+0000","last_fullsized":"2024-09-12T01:38:01.751547+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:34.969519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":607243,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":857,"num_read_kb":36686,"num_write":1272,"num_write_kb":31229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:31.547584+0000","last_change":"2024-09-12T00:28:21.324169+0000","last_active":"2024-09-12T01:35:31.547584+0000","last_peered":"2024-09-12T01:35:31.547584+0000","last_clean":"2024-09-12T01:35:31.547584+0000","last_became_active":"2024-09-12T00:28:19.162886+0000","last_became_peered":"2024-09-12T00:28:19.162886+0000","last_unstale":"2024-09-12T01:35:31.547584+0000","last_undegraded":"2024-09-12T01:35:31.547584+0000","last_fullsized":"2024-09-12T01:35:31.547584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_clean_scrub_stamp":"2024-09-12T00:28:18.139537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:37.883634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044054899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:49.643998+0000","last_change":"2024-09-12T00:28:35.213217+0000","last_active":"2024-09-12T01:34:49.643998+0000","last_peered":"2024-09-12T01:34:49.643998+0000","last_clean":"2024-09-12T01:34:49.643998+0000","last_became_active":"2024-09-12T00:28:35.212916+0000","last_became_peered":"2024-09-12T00:28:35.212916+0000","last_unstale":"2024-09-12T01:34:49.643998+0000","last_undegraded":"2024-09-12T01:34:49.643998+0000","last_fullsized":"2024-09-12T01:34:49.643998+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:29.058758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"263'763","reported_seq":1501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.569644+0000","last_change":"2024-09-12T00:28:37.424089+0000","last_active":"2024-09-12T01:38:01.569644+0000","last_peered":"2024-09-12T01:38:01.569644+0000","last_clean":"2024-09-12T01:38:01.569644+0000","last_became_active":"2024-09-12T00:28:37.423755+0000","last_became_peered":"2024-09-12T00:28:37.423755+0000","last_unstale":"2024-09-12T01:38:01.569644+0000","last_undegraded":"2024-09-12T01:38:01.569644+0000","last_fullsized":"2024-09-12T01:38:01.569644+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:34.013923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138292,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1365,"num_read_kb":3277,"num_write":1104,"num_write_kb":888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:19.647506+0000","last_change":"2024-09-12T00:28:39.216520+0000","last_active":"2024-09-12T01:35:19.647506+0000","last_peered":"2024-09-12T01:35:19.647506+0000","last_clean":"2024-09-12T01:35:19.647506+0000","last_became_active":"2024-09-12T00:28:39.216237+0000","last_became_peered":"2024-09-12T00:28:39.216237+0000","last_unstale":"2024-09-12T01:35:19.647506+0000","last_undegraded":"2024-09-12T01:35:19.647506+0000","last_fullsized":"2024-09-12T01:35:19.647506+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:00.630922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"263'83","reported_seq":575,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:57.780634+0000","last_change":"2024-09-12T00:28:41.234000+0000","last_active":"2024-09-12T01:33:57.780634+0000","last_peered":"2024-09-12T01:33:57.780634+0000","last_clean":"2024-09-12T01:33:57.780634+0000","last_became_active":"2024-09-12T00:28:41.233696+0000","last_became_peered":"2024-09-12T00:28:41.233696+0000","last_unstale":"2024-09-12T01:33:57.780634+0000","last_undegraded":"2024-09-12T01:33:57.780634+0000","last_fullsized":"2024-09-12T01:33:57.780634+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:56.154197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":84,"num_read_kb":82,"num_write":190,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"263'149","reported_seq":715,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:42.805442+0000","last_change":"2024-09-12T00:28:41.226966+0000","last_active":"2024-09-12T01:36:42.805442+0000","last_peered":"2024-09-12T01:36:42.805442+0000","last_clean":"2024-09-12T01:36:42.805442+0000","last_became_active":"2024-09-12T00:28:41.226143+0000","last_became_peered":"2024-09-12T00:28:41.226143+0000","last_unstale":"2024-09-12T01:36:42.805442+0000","last_undegraded":"2024-09-12T01:36:42.805442+0000","last_fullsized":"2024-09-12T01:36:42.805442+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:18.139245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":251,"num_read_kb":240,"num_write":350,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"263'64","reported_seq":620,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:00.504480+0000","last_change":"2024-09-12T00:28:33.210002+0000","last_active":"2024-09-12T01:34:00.504480+0000","last_peered":"2024-09-12T01:34:00.504480+0000","last_clean":"2024-09-12T01:34:00.504480+0000","last_became_active":"2024-09-12T00:28:33.209335+0000","last_became_peered":"2024-09-12T00:28:33.209335+0000","last_unstale":"2024-09-12T01:34:00.504480+0000","last_undegraded":"2024-09-12T01:34:00.504480+0000","last_fullsized":"2024-09-12T01:34:00.504480+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:09.521704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":218,"num_write":93,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"263'381","reported_seq":1062,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.500975+0000","last_change":"2024-09-12T00:29:04.295940+0000","last_active":"2024-09-12T01:38:01.500975+0000","last_peered":"2024-09-12T01:38:01.500975+0000","last_clean":"2024-09-12T01:38:01.500975+0000","last_became_active":"2024-09-12T00:29:04.295676+0000","last_became_peered":"2024-09-12T00:29:04.295676+0000","last_unstale":"2024-09-12T01:38:01.500975+0000","last_undegraded":"2024-09-12T01:38:01.500975+0000","last_fullsized":"2024-09-12T01:38:01.500975+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:49.747597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2554861,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":751,"num_read_kb":17367,"num_write":1233,"num_write_kb":40068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.933837+0000","last_change":"2024-09-12T00:28:35.208489+0000","last_active":"2024-09-12T01:33:56.933837+0000","last_peered":"2024-09-12T01:33:56.933837+0000","last_clean":"2024-09-12T01:33:56.933837+0000","last_became_active":"2024-09-12T00:28:35.208165+0000","last_became_peered":"2024-09-12T00:28:35.208165+0000","last_unstale":"2024-09-12T01:33:56.933837+0000","last_undegraded":"2024-09-12T01:33:56.933837+0000","last_fullsized":"2024-09-12T01:33:56.933837+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:27.761289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"263'292","reported_seq":879,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:19.654666+0000","last_change":"2024-09-12T00:28:37.217911+0000","last_active":"2024-09-12T01:36:19.654666+0000","last_peered":"2024-09-12T01:36:19.654666+0000","last_clean":"2024-09-12T01:36:19.654666+0000","last_became_active":"2024-09-12T00:28:37.217603+0000","last_became_peered":"2024-09-12T00:28:37.217603+0000","last_unstale":"2024-09-12T01:36:19.654666+0000","last_undegraded":"2024-09-12T01:36:19.654666+0000","last_fullsized":"2024-09-12T01:36:19.654666+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:00.439250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52004,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":474,"num_read_kb":983,"num_write":384,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:59.638101+0000","last_change":"2024-09-12T00:28:39.216498+0000","last_active":"2024-09-12T01:33:59.638101+0000","last_peered":"2024-09-12T01:33:59.638101+0000","last_clean":"2024-09-12T01:33:59.638101+0000","last_became_active":"2024-09-12T00:28:39.216143+0000","last_became_peered":"2024-09-12T00:28:39.216143+0000","last_unstale":"2024-09-12T01:33:59.638101+0000","last_undegraded":"2024-09-12T01:33:59.638101+0000","last_fullsized":"2024-09-12T01:33:59.638101+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:29.237838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"263'119","reported_seq":632,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:42.721881+0000","last_change":"2024-09-12T00:28:41.232566+0000","last_active":"2024-09-12T01:36:42.721881+0000","last_peered":"2024-09-12T01:36:42.721881+0000","last_clean":"2024-09-12T01:36:42.721881+0000","last_became_active":"2024-09-12T00:28:41.232114+0000","last_became_peered":"2024-09-12T00:28:41.232114+0000","last_unstale":"2024-09-12T01:36:42.721881+0000","last_undegraded":"2024-09-12T01:36:42.721881+0000","last_fullsized":"2024-09-12T01:36:42.721881+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:39.890316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":141,"num_write":283,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"263'346","reported_seq":1045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.019124+0000","last_change":"2024-09-12T00:29:04.292672+0000","last_active":"2024-09-12T01:37:46.019124+0000","last_peered":"2024-09-12T01:37:46.019124+0000","last_clean":"2024-09-12T01:37:46.019124+0000","last_became_active":"2024-09-12T00:29:04.292302+0000","last_became_peered":"2024-09-12T00:29:04.292302+0000","last_unstale":"2024-09-12T01:37:46.019124+0000","last_undegraded":"2024-09-12T01:37:46.019124+0000","last_fullsized":"2024-09-12T01:37:46.019124+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:30.169396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1719,"num_read_kb":1484,"num_write":537,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"263'386","reported_seq":1163,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.715162+0000","last_change":"2024-09-12T00:28:31.208025+0000","last_active":"2024-09-12T01:38:01.715162+0000","last_peered":"2024-09-12T01:38:01.715162+0000","last_clean":"2024-09-12T01:38:01.715162+0000","last_became_active":"2024-09-12T00:28:31.207765+0000","last_became_peered":"2024-09-12T00:28:31.207765+0000","last_unstale":"2024-09-12T01:38:01.715162+0000","last_undegraded":"2024-09-12T01:38:01.715162+0000","last_fullsized":"2024-09-12T01:38:01.715162+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:36.097785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2529502,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":736,"num_read_kb":9284,"num_write":1355,"num_write_kb":41598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:54.637512+0000","last_change":"2024-09-12T00:28:35.212549+0000","last_active":"2024-09-12T01:33:54.637512+0000","last_peered":"2024-09-12T01:33:54.637512+0000","last_clean":"2024-09-12T01:33:54.637512+0000","last_became_active":"2024-09-12T00:28:35.212243+0000","last_became_peered":"2024-09-12T00:28:35.212243+0000","last_unstale":"2024-09-12T01:33:54.637512+0000","last_undegraded":"2024-09-12T01:33:54.637512+0000","last_fullsized":"2024-09-12T01:33:54.637512+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:02.038789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"263'57","reported_seq":565,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.783705+0000","last_change":"2024-09-12T00:28:37.220699+0000","last_active":"2024-09-12T01:33:56.783705+0000","last_peered":"2024-09-12T01:33:56.783705+0000","last_clean":"2024-09-12T01:33:56.783705+0000","last_became_active":"2024-09-12T00:28:37.219799+0000","last_became_peered":"2024-09-12T00:28:37.219799+0000","last_unstale":"2024-09-12T01:33:56.783705+0000","last_undegraded":"2024-09-12T01:33:56.783705+0000","last_fullsized":"2024-09-12T01:33:56.783705+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:52.584996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":42,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:01.719361+0000","last_change":"2024-09-12T00:28:39.219540+0000","last_active":"2024-09-12T01:34:01.719361+0000","last_peered":"2024-09-12T01:34:01.719361+0000","last_clean":"2024-09-12T01:34:01.719361+0000","last_became_active":"2024-09-12T00:28:39.219209+0000","last_became_peered":"2024-09-12T00:28:39.219209+0000","last_unstale":"2024-09-12T01:34:01.719361+0000","last_undegraded":"2024-09-12T01:34:01.719361+0000","last_fullsized":"2024-09-12T01:34:01.719361+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:53.327778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"263'211","reported_seq":739,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:41.517803+0000","last_change":"2024-09-12T00:28:41.226184+0000","last_active":"2024-09-12T01:36:41.517803+0000","last_peered":"2024-09-12T01:36:41.517803+0000","last_clean":"2024-09-12T01:36:41.517803+0000","last_became_active":"2024-09-12T00:28:41.225673+0000","last_became_peered":"2024-09-12T00:28:41.225673+0000","last_unstale":"2024-09-12T01:36:41.517803+0000","last_undegraded":"2024-09-12T01:36:41.517803+0000","last_fullsized":"2024-09-12T01:36:41.517803+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:16.037270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":332,"num_read_kb":318,"num_write":482,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"263'71","reported_seq":693,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:54.637476+0000","last_change":"2024-09-12T00:28:33.214078+0000","last_active":"2024-09-12T01:33:54.637476+0000","last_peered":"2024-09-12T01:33:54.637476+0000","last_clean":"2024-09-12T01:33:54.637476+0000","last_became_active":"2024-09-12T00:28:33.213777+0000","last_became_peered":"2024-09-12T00:28:33.213777+0000","last_unstale":"2024-09-12T01:33:54.637476+0000","last_undegraded":"2024-09-12T01:33:54.637476+0000","last_fullsized":"2024-09-12T01:33:54.637476+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:02.647251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":365,"num_read_kb":325,"num_write":89,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"263'271","reported_seq":898,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:40.245457+0000","last_change":"2024-09-12T00:28:31.214433+0000","last_active":"2024-09-12T01:35:40.245457+0000","last_peered":"2024-09-12T01:35:40.245457+0000","last_clean":"2024-09-12T01:35:40.245457+0000","last_became_active":"2024-09-12T00:28:31.213567+0000","last_became_peered":"2024-09-12T00:28:31.213567+0000","last_unstale":"2024-09-12T01:35:40.245457+0000","last_undegraded":"2024-09-12T01:35:40.245457+0000","last_fullsized":"2024-09-12T01:35:40.245457+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:37.746979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5534219,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":393,"num_read_kb":31326,"num_write":929,"num_write_kb":46181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.718581+0000","last_change":"2024-09-12T00:28:35.210262+0000","last_active":"2024-09-12T01:33:56.718581+0000","last_peered":"2024-09-12T01:33:56.718581+0000","last_clean":"2024-09-12T01:33:56.718581+0000","last_became_active":"2024-09-12T00:28:35.210000+0000","last_became_peered":"2024-09-12T00:28:35.210000+0000","last_unstale":"2024-09-12T01:33:56.718581+0000","last_undegraded":"2024-09-12T01:33:56.718581+0000","last_fullsized":"2024-09-12T01:33:56.718581+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:21.147847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"263'330","reported_seq":927,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.037803+0000","last_change":"2024-09-12T00:28:37.222936+0000","last_active":"2024-09-12T01:37:46.037803+0000","last_peered":"2024-09-12T01:37:46.037803+0000","last_clean":"2024-09-12T01:37:46.037803+0000","last_became_active":"2024-09-12T00:28:37.222678+0000","last_became_peered":"2024-09-12T00:28:37.222678+0000","last_unstale":"2024-09-12T01:37:46.037803+0000","last_undegraded":"2024-09-12T01:37:46.037803+0000","last_fullsized":"2024-09-12T01:37:46.037803+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:29.474781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56973,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":538,"num_read_kb":1095,"num_write":432,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:01.534928+0000","last_change":"2024-09-12T00:28:39.216508+0000","last_active":"2024-09-12T01:34:01.534928+0000","last_peered":"2024-09-12T01:34:01.534928+0000","last_clean":"2024-09-12T01:34:01.534928+0000","last_became_active":"2024-09-12T00:28:39.216200+0000","last_became_peered":"2024-09-12T00:28:39.216200+0000","last_unstale":"2024-09-12T01:34:01.534928+0000","last_undegraded":"2024-09-12T01:34:01.534928+0000","last_fullsized":"2024-09-12T01:34:01.534928+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:22.629426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"263'112","reported_seq":626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:42.778426+0000","last_change":"2024-09-12T00:28:41.232852+0000","last_active":"2024-09-12T01:33:42.778426+0000","last_peered":"2024-09-12T01:33:42.778426+0000","last_clean":"2024-09-12T01:33:42.778426+0000","last_became_active":"2024-09-12T00:28:41.232381+0000","last_became_peered":"2024-09-12T00:28:41.232381+0000","last_unstale":"2024-09-12T01:33:42.778426+0000","last_undegraded":"2024-09-12T01:33:42.778426+0000","last_fullsized":"2024-09-12T01:33:42.778426+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:50.533536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":176,"num_read_kb":166,"num_write":281,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"263'153","reported_seq":745,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:54.637443+0000","last_change":"2024-09-12T00:28:33.211984+0000","last_active":"2024-09-12T01:33:54.637443+0000","last_peered":"2024-09-12T01:33:54.637443+0000","last_clean":"2024-09-12T01:33:54.637443+0000","last_became_active":"2024-09-12T00:28:33.211165+0000","last_became_peered":"2024-09-12T00:28:33.211165+0000","last_unstale":"2024-09-12T01:33:54.637443+0000","last_undegraded":"2024-09-12T01:33:54.637443+0000","last_fullsized":"2024-09-12T01:33:54.637443+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:15.409950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":668,"num_read_kb":545,"num_write":223,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"263'332","reported_seq":961,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.766693+0000","last_change":"2024-09-12T00:28:31.214222+0000","last_active":"2024-09-12T01:38:01.766693+0000","last_peered":"2024-09-12T01:38:01.766693+0000","last_clean":"2024-09-12T01:38:01.766693+0000","last_became_active":"2024-09-12T00:28:31.213971+0000","last_became_peered":"2024-09-12T00:28:31.213971+0000","last_unstale":"2024-09-12T01:38:01.766693+0000","last_undegraded":"2024-09-12T01:38:01.766693+0000","last_fullsized":"2024-09-12T01:38:01.766693+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:34.097978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340133,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":428,"num_read_kb":61436,"num_write":986,"num_write_kb":69756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.534222+0000","last_change":"2024-09-12T00:28:35.210349+0000","last_active":"2024-09-12T01:33:56.534222+0000","last_peered":"2024-09-12T01:33:56.534222+0000","last_clean":"2024-09-12T01:33:56.534222+0000","last_became_active":"2024-09-12T00:28:35.210060+0000","last_became_peered":"2024-09-12T00:28:35.210060+0000","last_unstale":"2024-09-12T01:33:56.534222+0000","last_undegraded":"2024-09-12T01:33:56.534222+0000","last_fullsized":"2024-09-12T01:33:56.534222+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:54.262760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"263'297","reported_seq":871,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.176723+0000","last_change":"2024-09-12T00:28:37.221776+0000","last_active":"2024-09-12T01:38:01.176723+0000","last_peered":"2024-09-12T01:38:01.176723+0000","last_clean":"2024-09-12T01:38:01.176723+0000","last_became_active":"2024-09-12T00:28:37.221491+0000","last_became_peered":"2024-09-12T00:28:37.221491+0000","last_unstale":"2024-09-12T01:38:01.176723+0000","last_undegraded":"2024-09-12T01:38:01.176723+0000","last_fullsized":"2024-09-12T01:38:01.176723+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:53.230082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49002,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":484,"num_read_kb":1163,"num_write":396,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:01.784353+0000","last_change":"2024-09-12T00:28:39.219270+0000","last_active":"2024-09-12T01:34:01.784353+0000","last_peered":"2024-09-12T01:34:01.784353+0000","last_clean":"2024-09-12T01:34:01.784353+0000","last_became_active":"2024-09-12T00:28:39.219004+0000","last_became_peered":"2024-09-12T00:28:39.219004+0000","last_unstale":"2024-09-12T01:34:01.784353+0000","last_undegraded":"2024-09-12T01:34:01.784353+0000","last_fullsized":"2024-09-12T01:34:01.784353+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:04.158965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"263'478","reported_seq":1262,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:42.590207+0000","last_change":"2024-09-12T00:28:33.216889+0000","last_active":"2024-09-12T01:36:42.590207+0000","last_peered":"2024-09-12T01:36:42.590207+0000","last_clean":"2024-09-12T01:36:42.590207+0000","last_became_active":"2024-09-12T00:28:33.216610+0000","last_became_peered":"2024-09-12T00:28:33.216610+0000","last_unstale":"2024-09-12T01:36:42.590207+0000","last_undegraded":"2024-09-12T01:36:42.590207+0000","last_fullsized":"2024-09-12T01:36:42.590207+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:20.599221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2349,"num_read_kb":2016,"num_write":868,"num_write_kb":562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"263'259","reported_seq":890,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:49.636836+0000","last_change":"2024-09-12T00:28:31.208064+0000","last_active":"2024-09-12T01:33:49.636836+0000","last_peered":"2024-09-12T01:33:49.636836+0000","last_clean":"2024-09-12T01:33:49.636836+0000","last_became_active":"2024-09-12T00:28:31.207770+0000","last_became_peered":"2024-09-12T00:28:31.207770+0000","last_unstale":"2024-09-12T01:33:49.636836+0000","last_undegraded":"2024-09-12T01:33:49.636836+0000","last_fullsized":"2024-09-12T01:33:49.636836+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:48.014014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5418705,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":389,"num_read_kb":17283,"num_write":887,"num_write_kb":20034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:46.790016+0000","last_change":"2024-09-12T00:28:35.209110+0000","last_active":"2024-09-12T01:34:46.790016+0000","last_peered":"2024-09-12T01:34:46.790016+0000","last_clean":"2024-09-12T01:34:46.790016+0000","last_became_active":"2024-09-12T00:28:35.208868+0000","last_became_peered":"2024-09-12T00:28:35.208868+0000","last_unstale":"2024-09-12T01:34:46.790016+0000","last_undegraded":"2024-09-12T01:34:46.790016+0000","last_fullsized":"2024-09-12T01:34:46.790016+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:58.443488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"263'519","reported_seq":1161,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:47.113851+0000","last_change":"2024-09-12T00:28:37.211376+0000","last_active":"2024-09-12T01:37:47.113851+0000","last_peered":"2024-09-12T01:37:47.113851+0000","last_clean":"2024-09-12T01:37:47.113851+0000","last_became_active":"2024-09-12T00:28:37.210514+0000","last_became_peered":"2024-09-12T00:28:37.210514+0000","last_unstale":"2024-09-12T01:37:47.113851+0000","last_undegraded":"2024-09-12T01:37:47.113851+0000","last_fullsized":"2024-09-12T01:37:47.113851+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":500,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:55.293515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114751,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":893,"num_read_kb":1958,"num_write":778,"num_write_kb":674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:42.778441+0000","last_change":"2024-09-12T00:28:39.220157+0000","last_active":"2024-09-12T01:33:42.778441+0000","last_peered":"2024-09-12T01:33:42.778441+0000","last_clean":"2024-09-12T01:33:42.778441+0000","last_became_active":"2024-09-12T00:28:39.219808+0000","last_became_peered":"2024-09-12T00:28:39.219808+0000","last_unstale":"2024-09-12T01:33:42.778441+0000","last_undegraded":"2024-09-12T01:33:42.778441+0000","last_fullsized":"2024-09-12T01:33:42.778441+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:25.859464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"263'226","reported_seq":794,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:42.584721+0000","last_change":"2024-09-12T00:28:41.257924+0000","last_active":"2024-09-12T01:36:42.584721+0000","last_peered":"2024-09-12T01:36:42.584721+0000","last_clean":"2024-09-12T01:36:42.584721+0000","last_became_active":"2024-09-12T00:28:41.257639+0000","last_became_peered":"2024-09-12T00:28:41.257639+0000","last_unstale":"2024-09-12T01:36:42.584721+0000","last_undegraded":"2024-09-12T01:36:42.584721+0000","last_fullsized":"2024-09-12T01:36:42.584721+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:36.066637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":674,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":491,"num_read_kb":439,"num_write":521,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"263'158","reported_seq":749,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:46.790004+0000","last_change":"2024-09-12T00:28:33.215368+0000","last_active":"2024-09-12T01:34:46.790004+0000","last_peered":"2024-09-12T01:34:46.790004+0000","last_clean":"2024-09-12T01:34:46.790004+0000","last_became_active":"2024-09-12T00:28:33.215105+0000","last_became_peered":"2024-09-12T00:28:33.215105+0000","last_unstale":"2024-09-12T01:34:46.790004+0000","last_undegraded":"2024-09-12T01:34:46.790004+0000","last_fullsized":"2024-09-12T01:34:46.790004+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:01.247332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":692,"num_read_kb":572,"num_write":247,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"263'306","reported_seq":961,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:55.269878+0000","last_change":"2024-09-12T00:28:31.206881+0000","last_active":"2024-09-12T01:33:55.269878+0000","last_peered":"2024-09-12T01:33:55.269878+0000","last_clean":"2024-09-12T01:33:55.269878+0000","last_became_active":"2024-09-12T00:28:31.206562+0000","last_became_peered":"2024-09-12T00:28:31.206562+0000","last_unstale":"2024-09-12T01:33:55.269878+0000","last_undegraded":"2024-09-12T01:33:55.269878+0000","last_fullsized":"2024-09-12T01:33:55.269878+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:30.337503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8827667,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":462,"num_read_kb":3739,"num_write":1169,"num_write_kb":48925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.545536+0000","last_change":"2024-09-12T00:28:35.210344+0000","last_active":"2024-09-12T01:35:16.545536+0000","last_peered":"2024-09-12T01:35:16.545536+0000","last_clean":"2024-09-12T01:35:16.545536+0000","last_became_active":"2024-09-12T00:28:35.210046+0000","last_became_peered":"2024-09-12T00:28:35.210046+0000","last_unstale":"2024-09-12T01:35:16.545536+0000","last_undegraded":"2024-09-12T01:35:16.545536+0000","last_fullsized":"2024-09-12T01:35:16.545536+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:03.841464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"263'330","reported_seq":923,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.210125+0000","last_change":"2024-09-12T00:28:37.212617+0000","last_active":"2024-09-12T01:38:01.210125+0000","last_peered":"2024-09-12T01:38:01.210125+0000","last_clean":"2024-09-12T01:38:01.210125+0000","last_became_active":"2024-09-12T00:28:37.212236+0000","last_became_peered":"2024-09-12T00:28:37.212236+0000","last_unstale":"2024-09-12T01:38:01.210125+0000","last_undegraded":"2024-09-12T01:38:01.210125+0000","last_fullsized":"2024-09-12T01:38:01.210125+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:16.662629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49414,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":546,"num_read_kb":1160,"num_write":454,"num_write_kb":329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:41.931728+0000","last_change":"2024-09-12T00:28:39.218198+0000","last_active":"2024-09-12T01:33:41.931728+0000","last_peered":"2024-09-12T01:33:41.931728+0000","last_clean":"2024-09-12T01:33:41.931728+0000","last_became_active":"2024-09-12T00:28:39.217947+0000","last_became_peered":"2024-09-12T00:28:39.217947+0000","last_unstale":"2024-09-12T01:33:41.931728+0000","last_undegraded":"2024-09-12T01:33:41.931728+0000","last_fullsized":"2024-09-12T01:33:41.931728+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:45.277309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"263'220","reported_seq":1091,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.567227+0000","last_change":"2024-09-12T00:28:41.233293+0000","last_active":"2024-09-12T01:36:38.567227+0000","last_peered":"2024-09-12T01:36:38.567227+0000","last_clean":"2024-09-12T01:36:38.567227+0000","last_became_active":"2024-09-12T00:28:41.232347+0000","last_became_peered":"2024-09-12T00:28:41.232347+0000","last_unstale":"2024-09-12T01:36:38.567227+0000","last_undegraded":"2024-09-12T01:36:38.567227+0000","last_fullsized":"2024-09-12T01:36:38.567227+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:07.441315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":645,"num_read_kb":635,"num_write":602,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"263'72","reported_seq":627,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:52.550530+0000","last_change":"2024-09-12T00:28:33.208225+0000","last_active":"2024-09-12T01:33:52.550530+0000","last_peered":"2024-09-12T01:33:52.550530+0000","last_clean":"2024-09-12T01:33:52.550530+0000","last_became_active":"2024-09-12T00:28:33.207968+0000","last_became_peered":"2024-09-12T00:28:33.207968+0000","last_unstale":"2024-09-12T01:33:52.550530+0000","last_undegraded":"2024-09-12T01:33:52.550530+0000","last_fullsized":"2024-09-12T01:33:52.550530+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:44.313634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":308,"num_read_kb":254,"num_write":109,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"263'289","reported_seq":915,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.527649+0000","last_change":"2024-09-12T00:28:31.195341+0000","last_active":"2024-09-12T01:38:01.527649+0000","last_peered":"2024-09-12T01:38:01.527649+0000","last_clean":"2024-09-12T01:38:01.527649+0000","last_became_active":"2024-09-12T00:28:31.195038+0000","last_became_peered":"2024-09-12T00:28:31.195038+0000","last_unstale":"2024-09-12T01:38:01.527649+0000","last_undegraded":"2024-09-12T01:38:01.527649+0000","last_fullsized":"2024-09-12T01:38:01.527649+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:10.944170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264279,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":420,"num_read_kb":13573,"num_write":959,"num_write_kb":34116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:36.531621+0000","last_change":"2024-09-12T00:28:35.215894+0000","last_active":"2024-09-12T01:33:36.531621+0000","last_peered":"2024-09-12T01:33:36.531621+0000","last_clean":"2024-09-12T01:33:36.531621+0000","last_became_active":"2024-09-12T00:28:35.215576+0000","last_became_peered":"2024-09-12T00:28:35.215576+0000","last_unstale":"2024-09-12T01:33:36.531621+0000","last_undegraded":"2024-09-12T01:33:36.531621+0000","last_fullsized":"2024-09-12T01:33:36.531621+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:24.130329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"263'283","reported_seq":874,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:24.663088+0000","last_change":"2024-09-12T00:28:37.424316+0000","last_active":"2024-09-12T01:37:24.663088+0000","last_peered":"2024-09-12T01:37:24.663088+0000","last_clean":"2024-09-12T01:37:24.663088+0000","last_became_active":"2024-09-12T00:28:37.423835+0000","last_became_peered":"2024-09-12T00:28:37.423835+0000","last_unstale":"2024-09-12T01:37:24.663088+0000","last_undegraded":"2024-09-12T01:37:24.663088+0000","last_fullsized":"2024-09-12T01:37:24.663088+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:16.822185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55686,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":473,"num_read_kb":989,"num_write":380,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:46.941196+0000","last_change":"2024-09-12T00:28:39.219814+0000","last_active":"2024-09-12T01:34:46.941196+0000","last_peered":"2024-09-12T01:34:46.941196+0000","last_clean":"2024-09-12T01:34:46.941196+0000","last_became_active":"2024-09-12T00:28:39.219541+0000","last_became_peered":"2024-09-12T00:28:39.219541+0000","last_unstale":"2024-09-12T01:34:46.941196+0000","last_undegraded":"2024-09-12T01:34:46.941196+0000","last_fullsized":"2024-09-12T01:34:46.941196+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:16.760034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"263'114","reported_seq":599,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:47.141542+0000","last_change":"2024-09-12T00:28:41.232661+0000","last_active":"2024-09-12T01:37:47.141542+0000","last_peered":"2024-09-12T01:37:47.141542+0000","last_clean":"2024-09-12T01:37:47.141542+0000","last_became_active":"2024-09-12T00:28:41.232305+0000","last_became_peered":"2024-09-12T00:28:41.232305+0000","last_unstale":"2024-09-12T01:37:47.141542+0000","last_undegraded":"2024-09-12T01:37:47.141542+0000","last_fullsized":"2024-09-12T01:37:47.141542+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:16.813541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":90,"num_read_kb":88,"num_write":260,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"263'145","reported_seq":711,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:36.625552+0000","last_change":"2024-09-12T00:28:33.214222+0000","last_active":"2024-09-12T01:33:36.625552+0000","last_peered":"2024-09-12T01:33:36.625552+0000","last_clean":"2024-09-12T01:33:36.625552+0000","last_became_active":"2024-09-12T00:28:33.213905+0000","last_became_peered":"2024-09-12T00:28:33.213905+0000","last_unstale":"2024-09-12T01:33:36.625552+0000","last_undegraded":"2024-09-12T01:33:36.625552+0000","last_fullsized":"2024-09-12T01:33:36.625552+0000","mapping_epoch":27,"log_start":"260'100","ondisk_log_start":"260'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:53.032156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":580,"num_read_kb":470,"num_write":232,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"263'309","reported_seq":1003,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.746967+0000","last_change":"2024-09-12T00:28:31.203713+0000","last_active":"2024-09-12T01:38:01.746967+0000","last_peered":"2024-09-12T01:38:01.746967+0000","last_clean":"2024-09-12T01:38:01.746967+0000","last_became_active":"2024-09-12T00:28:31.203417+0000","last_became_peered":"2024-09-12T00:28:31.203417+0000","last_unstale":"2024-09-12T01:38:01.746967+0000","last_undegraded":"2024-09-12T01:38:01.746967+0000","last_fullsized":"2024-09-12T01:38:01.746967+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:22.904080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262193,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":643,"num_read_kb":683,"num_write":1258,"num_write_kb":6456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:36.931007+0000","last_change":"2024-09-12T00:28:35.208282+0000","last_active":"2024-09-12T01:33:36.931007+0000","last_peered":"2024-09-12T01:33:36.931007+0000","last_clean":"2024-09-12T01:33:36.931007+0000","last_became_active":"2024-09-12T00:28:35.207992+0000","last_became_peered":"2024-09-12T00:28:35.207992+0000","last_unstale":"2024-09-12T01:33:36.931007+0000","last_undegraded":"2024-09-12T01:33:36.931007+0000","last_fullsized":"2024-09-12T01:33:36.931007+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:40:54.373200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"263'105","reported_seq":647,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:51.541995+0000","last_change":"2024-09-12T00:28:37.424144+0000","last_active":"2024-09-12T01:34:51.541995+0000","last_peered":"2024-09-12T01:34:51.541995+0000","last_clean":"2024-09-12T01:34:51.541995+0000","last_became_active":"2024-09-12T00:28:37.423765+0000","last_became_peered":"2024-09-12T00:28:37.423765+0000","last_unstale":"2024-09-12T01:34:51.541995+0000","last_undegraded":"2024-09-12T01:34:51.541995+0000","last_fullsized":"2024-09-12T01:34:51.541995+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:37.831318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":155,"num_read_kb":148,"num_write":156,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"263'760","reported_seq":2427,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.050221+0000","last_change":"2024-09-12T00:28:39.217233+0000","last_active":"2024-09-12T01:38:00.050221+0000","last_peered":"2024-09-12T01:38:00.050221+0000","last_clean":"2024-09-12T01:38:00.050221+0000","last_became_active":"2024-09-12T00:28:39.216704+0000","last_became_peered":"2024-09-12T00:28:39.216704+0000","last_unstale":"2024-09-12T01:38:00.050221+0000","last_undegraded":"2024-09-12T01:38:00.050221+0000","last_fullsized":"2024-09-12T01:38:00.050221+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:06.941324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"263'157","reported_seq":655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:41.582118+0000","last_change":"2024-09-12T00:28:41.228417+0000","last_active":"2024-09-12T01:36:41.582118+0000","last_peered":"2024-09-12T01:36:41.582118+0000","last_clean":"2024-09-12T01:36:41.582118+0000","last_became_active":"2024-09-12T00:28:41.227892+0000","last_became_peered":"2024-09-12T00:28:41.227892+0000","last_unstale":"2024-09-12T01:36:41.582118+0000","last_undegraded":"2024-09-12T01:36:41.582118+0000","last_fullsized":"2024-09-12T01:36:41.582118+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:55.234284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":160,"num_read_kb":153,"num_write":389,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"263'138","reported_seq":717,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:36.531599+0000","last_change":"2024-09-12T00:28:33.205366+0000","last_active":"2024-09-12T01:33:36.531599+0000","last_peered":"2024-09-12T01:33:36.531599+0000","last_clean":"2024-09-12T01:33:36.531599+0000","last_became_active":"2024-09-12T00:28:33.204722+0000","last_became_peered":"2024-09-12T00:28:33.204722+0000","last_unstale":"2024-09-12T01:33:36.531599+0000","last_undegraded":"2024-09-12T01:33:36.531599+0000","last_fullsized":"2024-09-12T01:33:36.531599+0000","mapping_epoch":27,"log_start":"260'100","ondisk_log_start":"260'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:40.757422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":575,"num_read_kb":467,"num_write":204,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"263'267","reported_seq":985,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:02.798570+0000","last_change":"2024-09-12T00:28:31.214127+0000","last_active":"2024-09-12T01:36:02.798570+0000","last_peered":"2024-09-12T01:36:02.798570+0000","last_clean":"2024-09-12T01:36:02.798570+0000","last_became_active":"2024-09-12T00:28:31.212597+0000","last_became_peered":"2024-09-12T00:28:31.212597+0000","last_unstale":"2024-09-12T01:36:02.798570+0000","last_undegraded":"2024-09-12T01:36:02.798570+0000","last_fullsized":"2024-09-12T01:36:02.798570+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:45.696465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301335,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":646,"num_read_kb":2175,"num_write":1055,"num_write_kb":612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:36.715250+0000","last_change":"2024-09-12T00:28:35.210989+0000","last_active":"2024-09-12T01:33:36.715250+0000","last_peered":"2024-09-12T01:33:36.715250+0000","last_clean":"2024-09-12T01:33:36.715250+0000","last_became_active":"2024-09-12T00:28:35.210710+0000","last_became_peered":"2024-09-12T00:28:35.210710+0000","last_unstale":"2024-09-12T01:33:36.715250+0000","last_undegraded":"2024-09-12T01:33:36.715250+0000","last_fullsized":"2024-09-12T01:33:36.715250+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:33.211433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"263'382","reported_seq":994,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:22.801661+0000","last_change":"2024-09-12T00:28:37.210612+0000","last_active":"2024-09-12T01:36:22.801661+0000","last_peered":"2024-09-12T01:36:22.801661+0000","last_clean":"2024-09-12T01:36:22.801661+0000","last_became_active":"2024-09-12T00:28:37.210317+0000","last_became_peered":"2024-09-12T00:28:37.210317+0000","last_unstale":"2024-09-12T01:36:22.801661+0000","last_undegraded":"2024-09-12T01:36:22.801661+0000","last_fullsized":"2024-09-12T01:36:22.801661+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:31.821476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76180,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":636,"num_read_kb":1300,"num_write":522,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.783725+0000","last_change":"2024-09-12T00:28:39.218794+0000","last_active":"2024-09-12T01:33:56.783725+0000","last_peered":"2024-09-12T01:33:56.783725+0000","last_clean":"2024-09-12T01:33:56.783725+0000","last_became_active":"2024-09-12T00:28:39.218026+0000","last_became_peered":"2024-09-12T00:28:39.218026+0000","last_unstale":"2024-09-12T01:33:56.783725+0000","last_undegraded":"2024-09-12T01:33:56.783725+0000","last_fullsized":"2024-09-12T01:33:56.783725+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:18.115521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"263'133","reported_seq":629,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:21.741327+0000","last_change":"2024-09-12T00:28:41.231966+0000","last_active":"2024-09-12T01:36:21.741327+0000","last_peered":"2024-09-12T01:36:21.741327+0000","last_clean":"2024-09-12T01:36:21.741327+0000","last_became_active":"2024-09-12T00:28:41.231611+0000","last_became_peered":"2024-09-12T00:28:41.231611+0000","last_unstale":"2024-09-12T01:36:21.741327+0000","last_undegraded":"2024-09-12T01:36:21.741327+0000","last_fullsized":"2024-09-12T01:36:21.741327+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:05.050533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":625,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":135,"num_read_kb":130,"num_write":322,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"263'92","reported_seq":673,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:36.531552+0000","last_change":"2024-09-12T00:28:33.204989+0000","last_active":"2024-09-12T01:33:36.531552+0000","last_peered":"2024-09-12T01:33:36.531552+0000","last_clean":"2024-09-12T01:33:36.531552+0000","last_became_active":"2024-09-12T00:28:33.204653+0000","last_became_peered":"2024-09-12T00:28:33.204653+0000","last_unstale":"2024-09-12T01:33:36.531552+0000","last_undegraded":"2024-09-12T01:33:36.531552+0000","last_fullsized":"2024-09-12T01:33:36.531552+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:22.275865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":393,"num_read_kb":329,"num_write":145,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"263'353","reported_seq":1045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:26.402299+0000","last_change":"2024-09-12T00:28:31.214035+0000","last_active":"2024-09-12T01:36:26.402299+0000","last_peered":"2024-09-12T01:36:26.402299+0000","last_clean":"2024-09-12T01:36:26.402299+0000","last_became_active":"2024-09-12T00:28:31.212752+0000","last_became_peered":"2024-09-12T00:28:31.212752+0000","last_unstale":"2024-09-12T01:36:26.402299+0000","last_undegraded":"2024-09-12T01:36:26.402299+0000","last_fullsized":"2024-09-12T01:36:26.402299+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:33.447125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17854756,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":728,"num_read_kb":13300,"num_write":1298,"num_write_kb":24353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:37.777506+0000","last_change":"2024-09-12T00:28:35.208702+0000","last_active":"2024-09-12T01:33:37.777506+0000","last_peered":"2024-09-12T01:33:37.777506+0000","last_clean":"2024-09-12T01:33:37.777506+0000","last_became_active":"2024-09-12T00:28:35.207869+0000","last_became_peered":"2024-09-12T00:28:35.207869+0000","last_unstale":"2024-09-12T01:33:37.777506+0000","last_undegraded":"2024-09-12T01:33:37.777506+0000","last_fullsized":"2024-09-12T01:33:37.777506+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:39.750226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"263'310","reported_seq":893,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.823008+0000","last_change":"2024-09-12T00:28:37.221622+0000","last_active":"2024-09-12T01:38:00.823008+0000","last_peered":"2024-09-12T01:38:00.823008+0000","last_clean":"2024-09-12T01:38:00.823008+0000","last_became_active":"2024-09-12T00:28:37.221289+0000","last_became_peered":"2024-09-12T00:28:37.221289+0000","last_unstale":"2024-09-12T01:38:00.823008+0000","last_undegraded":"2024-09-12T01:38:00.823008+0000","last_fullsized":"2024-09-12T01:38:00.823008+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:13.295191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57095,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":538,"num_read_kb":1320,"num_write":444,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:11.536147+0000","last_change":"2024-09-12T00:28:39.217261+0000","last_active":"2024-09-12T01:34:11.536147+0000","last_peered":"2024-09-12T01:34:11.536147+0000","last_clean":"2024-09-12T01:34:11.536147+0000","last_became_active":"2024-09-12T00:28:39.216943+0000","last_became_peered":"2024-09-12T00:28:39.216943+0000","last_unstale":"2024-09-12T01:34:11.536147+0000","last_undegraded":"2024-09-12T01:34:11.536147+0000","last_fullsized":"2024-09-12T01:34:11.536147+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:27.903826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"263'138","reported_seq":675,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:20.328319+0000","last_change":"2024-09-12T00:28:41.258056+0000","last_active":"2024-09-12T01:35:20.328319+0000","last_peered":"2024-09-12T01:35:20.328319+0000","last_clean":"2024-09-12T01:35:20.328319+0000","last_became_active":"2024-09-12T00:28:41.257796+0000","last_became_peered":"2024-09-12T00:28:41.257796+0000","last_unstale":"2024-09-12T01:35:20.328319+0000","last_undegraded":"2024-09-12T01:35:20.328319+0000","last_fullsized":"2024-09-12T01:35:20.328319+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:21.378439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":982,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":234,"num_read_kb":212,"num_write":368,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"263'73","reported_seq":628,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:04.638853+0000","last_change":"2024-09-12T00:28:33.206104+0000","last_active":"2024-09-12T01:34:04.638853+0000","last_peered":"2024-09-12T01:34:04.638853+0000","last_clean":"2024-09-12T01:34:04.638853+0000","last_became_active":"2024-09-12T00:28:33.205832+0000","last_became_peered":"2024-09-12T00:28:33.205832+0000","last_unstale":"2024-09-12T01:34:04.638853+0000","last_undegraded":"2024-09-12T01:34:04.638853+0000","last_fullsized":"2024-09-12T01:34:04.638853+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:47.756933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":322,"num_read_kb":264,"num_write":102,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"263'272","reported_seq":907,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:39.479186+0000","last_change":"2024-09-12T00:28:31.200496+0000","last_active":"2024-09-12T01:37:39.479186+0000","last_peered":"2024-09-12T01:37:39.479186+0000","last_clean":"2024-09-12T01:37:39.479186+0000","last_became_active":"2024-09-12T00:28:31.200234+0000","last_became_peered":"2024-09-12T00:28:31.200234+0000","last_unstale":"2024-09-12T01:37:39.479186+0000","last_undegraded":"2024-09-12T01:37:39.479186+0000","last_fullsized":"2024-09-12T01:37:39.479186+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:25.377262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5561855,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":401,"num_read_kb":15822,"num_write":1029,"num_write_kb":25857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.533584+0000","last_change":"2024-09-12T00:28:35.206882+0000","last_active":"2024-09-12T01:33:51.533584+0000","last_peered":"2024-09-12T01:33:51.533584+0000","last_clean":"2024-09-12T01:33:51.533584+0000","last_became_active":"2024-09-12T00:28:35.206597+0000","last_became_peered":"2024-09-12T00:28:35.206597+0000","last_unstale":"2024-09-12T01:33:51.533584+0000","last_undegraded":"2024-09-12T01:33:51.533584+0000","last_fullsized":"2024-09-12T01:33:51.533584+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:07.120698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"263'275","reported_seq":839,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:09.653390+0000","last_change":"2024-09-12T00:28:37.220535+0000","last_active":"2024-09-12T01:36:09.653390+0000","last_peered":"2024-09-12T01:36:09.653390+0000","last_clean":"2024-09-12T01:36:09.653390+0000","last_became_active":"2024-09-12T00:28:37.219652+0000","last_became_peered":"2024-09-12T00:28:37.219652+0000","last_unstale":"2024-09-12T01:36:09.653390+0000","last_undegraded":"2024-09-12T01:36:09.653390+0000","last_fullsized":"2024-09-12T01:36:09.653390+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:35.052492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69302,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":460,"num_read_kb":1067,"num_write":388,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:41.532251+0000","last_change":"2024-09-12T00:28:39.218146+0000","last_active":"2024-09-12T01:33:41.532251+0000","last_peered":"2024-09-12T01:33:41.532251+0000","last_clean":"2024-09-12T01:33:41.532251+0000","last_became_active":"2024-09-12T00:28:39.217869+0000","last_became_peered":"2024-09-12T00:28:39.217869+0000","last_unstale":"2024-09-12T01:33:41.532251+0000","last_undegraded":"2024-09-12T01:33:41.532251+0000","last_fullsized":"2024-09-12T01:33:41.532251+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:50.890111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"263'190","reported_seq":1287,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.478652+0000","last_change":"2024-09-12T00:28:41.232727+0000","last_active":"2024-09-12T01:36:38.478652+0000","last_peered":"2024-09-12T01:36:38.478652+0000","last_clean":"2024-09-12T01:36:38.478652+0000","last_became_active":"2024-09-12T00:28:41.232040+0000","last_became_peered":"2024-09-12T00:28:41.232040+0000","last_unstale":"2024-09-12T01:36:38.478652+0000","last_undegraded":"2024-09-12T01:36:38.478652+0000","last_fullsized":"2024-09-12T01:36:38.478652+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:12.584298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":841,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":800,"num_read_kb":795,"num_write":450,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"263'254","reported_seq":913,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.533604+0000","last_change":"2024-09-12T00:28:33.209146+0000","last_active":"2024-09-12T01:33:51.533604+0000","last_peered":"2024-09-12T01:33:51.533604+0000","last_clean":"2024-09-12T01:33:51.533604+0000","last_became_active":"2024-09-12T00:28:33.208787+0000","last_became_peered":"2024-09-12T00:28:33.208787+0000","last_unstale":"2024-09-12T01:33:51.533604+0000","last_undegraded":"2024-09-12T01:33:51.533604+0000","last_fullsized":"2024-09-12T01:33:51.533604+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:39.287147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1164,"num_read_kb":956,"num_write":405,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"263'316","reported_seq":1064,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.727735+0000","last_change":"2024-09-12T00:29:04.275056+0000","last_active":"2024-09-12T01:38:01.727735+0000","last_peered":"2024-09-12T01:38:01.727735+0000","last_clean":"2024-09-12T01:38:01.727735+0000","last_became_active":"2024-09-12T00:29:04.274746+0000","last_became_peered":"2024-09-12T00:29:04.274746+0000","last_unstale":"2024-09-12T01:38:01.727735+0000","last_undegraded":"2024-09-12T01:38:01.727735+0000","last_fullsized":"2024-09-12T01:38:01.727735+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:44.084463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524334,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":565,"num_read_kb":52761,"num_write":1033,"num_write_kb":38285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"37'4","reported_seq":984,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.866374+0000","last_change":"2024-09-12T00:28:35.207612+0000","last_active":"2024-09-12T01:37:46.866374+0000","last_peered":"2024-09-12T01:37:46.866374+0000","last_clean":"2024-09-12T01:37:46.866374+0000","last_became_active":"2024-09-12T00:28:35.207332+0000","last_became_peered":"2024-09-12T00:28:35.207332+0000","last_unstale":"2024-09-12T01:37:46.866374+0000","last_undegraded":"2024-09-12T01:37:46.866374+0000","last_fullsized":"2024-09-12T01:37:46.866374+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:37.071411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":721,"num_read_kb":719,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"263'325","reported_seq":930,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.451609+0000","last_change":"2024-09-12T00:28:37.207659+0000","last_active":"2024-09-12T01:38:00.451609+0000","last_peered":"2024-09-12T01:38:00.451609+0000","last_clean":"2024-09-12T01:38:00.451609+0000","last_became_active":"2024-09-12T00:28:37.207373+0000","last_became_peered":"2024-09-12T00:28:37.207373+0000","last_unstale":"2024-09-12T01:38:00.451609+0000","last_undegraded":"2024-09-12T01:38:00.451609+0000","last_fullsized":"2024-09-12T01:38:00.451609+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:14.729544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45135,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":515,"num_read_kb":1089,"num_write":408,"num_write_kb":271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:41.781852+0000","last_change":"2024-09-12T00:28:39.217215+0000","last_active":"2024-09-12T01:33:41.781852+0000","last_peered":"2024-09-12T01:33:41.781852+0000","last_clean":"2024-09-12T01:33:41.781852+0000","last_became_active":"2024-09-12T00:28:39.215651+0000","last_became_peered":"2024-09-12T00:28:39.215651+0000","last_unstale":"2024-09-12T01:33:41.781852+0000","last_undegraded":"2024-09-12T01:33:41.781852+0000","last_fullsized":"2024-09-12T01:33:41.781852+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:18.517005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"263'132","reported_seq":629,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.017444+0000","last_change":"2024-09-12T00:28:41.227004+0000","last_active":"2024-09-12T01:37:46.017444+0000","last_peered":"2024-09-12T01:37:46.017444+0000","last_clean":"2024-09-12T01:37:46.017444+0000","last_became_active":"2024-09-12T00:28:41.226687+0000","last_became_peered":"2024-09-12T00:28:41.226687+0000","last_unstale":"2024-09-12T01:37:46.017444+0000","last_undegraded":"2024-09-12T01:37:46.017444+0000","last_fullsized":"2024-09-12T01:37:46.017444+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:17.799068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":132,"num_read_kb":117,"num_write":304,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"263'292","reported_seq":922,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.948057+0000","last_change":"2024-09-12T00:28:33.211180+0000","last_active":"2024-09-12T01:35:46.948057+0000","last_peered":"2024-09-12T01:35:46.948057+0000","last_clean":"2024-09-12T01:35:46.948057+0000","last_became_active":"2024-09-12T00:28:33.210635+0000","last_became_peered":"2024-09-12T00:28:33.210635+0000","last_unstale":"2024-09-12T01:35:46.948057+0000","last_undegraded":"2024-09-12T01:35:46.948057+0000","last_fullsized":"2024-09-12T01:35:46.948057+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:52.779854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1259,"num_read_kb":1011,"num_write":460,"num_write_kb":225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"263'324","reported_seq":944,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.535496+0000","last_change":"2024-09-12T00:28:31.207464+0000","last_active":"2024-09-12T01:38:01.535496+0000","last_peered":"2024-09-12T01:38:01.535496+0000","last_clean":"2024-09-12T01:38:01.535496+0000","last_became_active":"2024-09-12T00:28:31.206672+0000","last_became_peered":"2024-09-12T00:28:31.206672+0000","last_unstale":"2024-09-12T01:38:01.535496+0000","last_undegraded":"2024-09-12T01:38:01.535496+0000","last_fullsized":"2024-09-12T01:38:01.535496+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:16.072963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":684071,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":456,"num_read_kb":11577,"num_write":1042,"num_write_kb":29091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"263'314","reported_seq":941,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.948041+0000","last_change":"2024-09-12T00:28:33.207374+0000","last_active":"2024-09-12T01:35:46.948041+0000","last_peered":"2024-09-12T01:35:46.948041+0000","last_clean":"2024-09-12T01:35:46.948041+0000","last_became_active":"2024-09-12T00:28:33.206512+0000","last_became_peered":"2024-09-12T00:28:33.206512+0000","last_unstale":"2024-09-12T01:35:46.948041+0000","last_undegraded":"2024-09-12T01:35:46.948041+0000","last_fullsized":"2024-09-12T01:35:46.948041+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:00.796082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1325,"num_read_kb":1067,"num_write":489,"num_write_kb":251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"263'323","reported_seq":962,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.538497+0000","last_change":"2024-09-12T00:29:04.272074+0000","last_active":"2024-09-12T01:38:01.538497+0000","last_peered":"2024-09-12T01:38:01.538497+0000","last_clean":"2024-09-12T01:38:01.538497+0000","last_became_active":"2024-09-12T00:29:04.271753+0000","last_became_peered":"2024-09-12T00:29:04.271753+0000","last_unstale":"2024-09-12T01:38:01.538497+0000","last_undegraded":"2024-09-12T01:38:01.538497+0000","last_fullsized":"2024-09-12T01:38:01.538497+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:42.475525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":500,"num_read_kb":1624,"num_write":1030,"num_write_kb":30525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"263'349","reported_seq":960,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:47.796128+0000","last_change":"2024-09-12T00:28:33.214934+0000","last_active":"2024-09-12T01:35:47.796128+0000","last_peered":"2024-09-12T01:35:47.796128+0000","last_clean":"2024-09-12T01:35:47.796128+0000","last_became_active":"2024-09-12T00:28:33.214679+0000","last_became_peered":"2024-09-12T00:28:33.214679+0000","last_unstale":"2024-09-12T01:35:47.796128+0000","last_undegraded":"2024-09-12T01:35:47.796128+0000","last_fullsized":"2024-09-12T01:35:47.796128+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:00.796082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1495,"num_read_kb":1194,"num_write":562,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"263'302","reported_seq":969,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:40.252643+0000","last_change":"2024-09-12T00:28:31.209614+0000","last_active":"2024-09-12T01:35:40.252643+0000","last_peered":"2024-09-12T01:35:40.252643+0000","last_clean":"2024-09-12T01:35:40.252643+0000","last_became_active":"2024-09-12T00:28:31.209266+0000","last_became_peered":"2024-09-12T00:28:31.209266+0000","last_unstale":"2024-09-12T01:35:40.252643+0000","last_undegraded":"2024-09-12T01:35:40.252643+0000","last_fullsized":"2024-09-12T01:35:40.252643+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:17.128660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11171705,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":512,"num_read_kb":38602,"num_write":1180,"num_write_kb":22367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"263'104","reported_seq":689,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.948017+0000","last_change":"2024-09-12T00:28:33.216968+0000","last_active":"2024-09-12T01:35:46.948017+0000","last_peered":"2024-09-12T01:35:46.948017+0000","last_clean":"2024-09-12T01:35:46.948017+0000","last_became_active":"2024-09-12T00:28:33.213020+0000","last_became_peered":"2024-09-12T00:28:33.213020+0000","last_unstale":"2024-09-12T01:35:46.948017+0000","last_undegraded":"2024-09-12T01:35:46.948017+0000","last_fullsized":"2024-09-12T01:35:46.948017+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:49.966752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":435,"num_read_kb":365,"num_write":138,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"263'309","reported_seq":1047,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.733181+0000","last_change":"2024-09-12T00:28:31.208858+0000","last_active":"2024-09-12T01:38:01.733181+0000","last_peered":"2024-09-12T01:38:01.733181+0000","last_clean":"2024-09-12T01:38:01.733181+0000","last_became_active":"2024-09-12T00:28:31.208548+0000","last_became_peered":"2024-09-12T00:28:31.208548+0000","last_unstale":"2024-09-12T01:38:01.733181+0000","last_undegraded":"2024-09-12T01:38:01.733181+0000","last_fullsized":"2024-09-12T01:38:01.733181+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:14.657513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49275,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":734,"num_read_kb":31441,"num_write":965,"num_write_kb":36605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"263'125","reported_seq":761,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:13.175412+0000","last_change":"2024-09-12T00:28:33.217855+0000","last_active":"2024-09-12T01:36:13.175412+0000","last_peered":"2024-09-12T01:36:13.175412+0000","last_clean":"2024-09-12T01:36:13.175412+0000","last_became_active":"2024-09-12T00:28:33.217573+0000","last_became_peered":"2024-09-12T00:28:33.217573+0000","last_unstale":"2024-09-12T01:36:13.175412+0000","last_undegraded":"2024-09-12T01:36:13.175412+0000","last_fullsized":"2024-09-12T01:36:13.175412+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:26.283665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":588,"num_read_kb":500,"num_write":193,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"263'350","reported_seq":991,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.533585+0000","last_change":"2024-09-12T00:29:04.267833+0000","last_active":"2024-09-12T01:38:01.533585+0000","last_peered":"2024-09-12T01:38:01.533585+0000","last_clean":"2024-09-12T01:38:01.533585+0000","last_became_active":"2024-09-12T00:29:04.267546+0000","last_became_peered":"2024-09-12T00:29:04.267546+0000","last_unstale":"2024-09-12T01:38:01.533585+0000","last_undegraded":"2024-09-12T01:38:01.533585+0000","last_fullsized":"2024-09-12T01:38:01.533585+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:45.410402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2316194,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":594,"num_read_kb":3307,"num_write":1231,"num_write_kb":18821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"263'308","reported_seq":1002,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.545510+0000","last_change":"2024-09-12T00:28:33.209863+0000","last_active":"2024-09-12T01:35:16.545510+0000","last_peered":"2024-09-12T01:35:16.545510+0000","last_clean":"2024-09-12T01:35:16.545510+0000","last_became_active":"2024-09-12T00:28:33.208929+0000","last_became_peered":"2024-09-12T00:28:33.208929+0000","last_unstale":"2024-09-12T01:35:16.545510+0000","last_undegraded":"2024-09-12T01:35:16.545510+0000","last_fullsized":"2024-09-12T01:35:16.545510+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:38.145227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1423,"num_read_kb":1158,"num_write":481,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"263'256","reported_seq":898,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.782075+0000","last_change":"2024-09-12T00:28:31.206143+0000","last_active":"2024-09-12T01:35:57.782075+0000","last_peered":"2024-09-12T01:35:57.782075+0000","last_clean":"2024-09-12T01:35:57.782075+0000","last_became_active":"2024-09-12T00:28:31.205829+0000","last_became_peered":"2024-09-12T00:28:31.205829+0000","last_unstale":"2024-09-12T01:35:57.782075+0000","last_undegraded":"2024-09-12T01:35:57.782075+0000","last_fullsized":"2024-09-12T01:35:57.782075+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:18.050330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5873432,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":398,"num_read_kb":5275,"num_write":977,"num_write_kb":26638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"263'110","reported_seq":699,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:14.646908+0000","last_change":"2024-09-12T00:28:33.208267+0000","last_active":"2024-09-12T01:35:14.646908+0000","last_peered":"2024-09-12T01:35:14.646908+0000","last_clean":"2024-09-12T01:35:14.646908+0000","last_became_active":"2024-09-12T00:28:33.208010+0000","last_became_peered":"2024-09-12T00:28:33.208010+0000","last_unstale":"2024-09-12T01:35:14.646908+0000","last_undegraded":"2024-09-12T01:35:14.646908+0000","last_fullsized":"2024-09-12T01:35:14.646908+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:07.389367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":481,"num_read_kb":401,"num_write":165,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"263'361","reported_seq":1003,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.523918+0000","last_change":"2024-09-12T00:28:31.205820+0000","last_active":"2024-09-12T01:38:01.523918+0000","last_peered":"2024-09-12T01:38:01.523918+0000","last_clean":"2024-09-12T01:38:01.523918+0000","last_became_active":"2024-09-12T00:28:31.205366+0000","last_became_peered":"2024-09-12T00:28:31.205366+0000","last_unstale":"2024-09-12T01:38:01.523918+0000","last_undegraded":"2024-09-12T01:38:01.523918+0000","last_fullsized":"2024-09-12T01:38:01.523918+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:37.694868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":584,"num_read_kb":12807,"num_write":1205,"num_write_kb":27426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"263'206","reported_seq":826,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:32.524627+0000","last_change":"2024-09-12T00:28:33.209326+0000","last_active":"2024-09-12T01:35:32.524627+0000","last_peered":"2024-09-12T01:35:32.524627+0000","last_clean":"2024-09-12T01:35:32.524627+0000","last_became_active":"2024-09-12T00:28:33.209028+0000","last_became_peered":"2024-09-12T00:28:33.209028+0000","last_unstale":"2024-09-12T01:35:32.524627+0000","last_undegraded":"2024-09-12T01:35:32.524627+0000","last_fullsized":"2024-09-12T01:35:32.524627+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:20.185402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":877,"num_read_kb":721,"num_write":304,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"263'262","reported_seq":931,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:55.258184+0000","last_change":"2024-09-12T00:28:31.203730+0000","last_active":"2024-09-12T01:35:55.258184+0000","last_peered":"2024-09-12T01:35:55.258184+0000","last_clean":"2024-09-12T01:35:55.258184+0000","last_became_active":"2024-09-12T00:28:31.203185+0000","last_became_peered":"2024-09-12T00:28:31.203185+0000","last_unstale":"2024-09-12T01:35:55.258184+0000","last_undegraded":"2024-09-12T01:35:55.258184+0000","last_fullsized":"2024-09-12T01:35:55.258184+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:39.470819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20475208,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":440,"num_read_kb":88705,"num_write":979,"num_write_kb":43642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"263'403","reported_seq":1080,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.783830+0000","last_change":"2024-09-12T00:29:04.275730+0000","last_active":"2024-09-12T01:33:56.783830+0000","last_peered":"2024-09-12T01:33:56.783830+0000","last_clean":"2024-09-12T01:33:56.783830+0000","last_became_active":"2024-09-12T00:29:04.275434+0000","last_became_peered":"2024-09-12T00:29:04.275434+0000","last_unstale":"2024-09-12T01:33:56.783830+0000","last_undegraded":"2024-09-12T01:33:56.783830+0000","last_fullsized":"2024-09-12T01:33:56.783830+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:49.369214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1782,"num_read_kb":1435,"num_write":639,"num_write_kb":352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"263'272","reported_seq":909,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:47.796028+0000","last_change":"2024-09-12T00:28:31.209794+0000","last_active":"2024-09-12T01:35:47.796028+0000","last_peered":"2024-09-12T01:35:47.796028+0000","last_clean":"2024-09-12T01:35:47.796028+0000","last_became_active":"2024-09-12T00:28:31.209468+0000","last_became_peered":"2024-09-12T00:28:31.209468+0000","last_unstale":"2024-09-12T01:35:47.796028+0000","last_undegraded":"2024-09-12T01:35:47.796028+0000","last_fullsized":"2024-09-12T01:35:47.796028+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:32.906913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7261358,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":440,"num_read_kb":2644,"num_write":984,"num_write_kb":18676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"263'161","reported_seq":736,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:29.654561+0000","last_change":"2024-09-12T00:28:33.208952+0000","last_active":"2024-09-12T01:35:29.654561+0000","last_peered":"2024-09-12T01:35:29.654561+0000","last_clean":"2024-09-12T01:35:29.654561+0000","last_became_active":"2024-09-12T00:28:33.208285+0000","last_became_peered":"2024-09-12T00:28:33.208285+0000","last_unstale":"2024-09-12T01:35:29.654561+0000","last_undegraded":"2024-09-12T01:35:29.654561+0000","last_fullsized":"2024-09-12T01:35:29.654561+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:58.828709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":689,"num_read_kb":558,"num_write":246,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"263'295","reported_seq":925,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:14.115203+0000","last_change":"2024-09-12T00:28:31.200270+0000","last_active":"2024-09-12T01:35:14.115203+0000","last_peered":"2024-09-12T01:35:14.115203+0000","last_clean":"2024-09-12T01:35:14.115203+0000","last_became_active":"2024-09-12T00:28:31.199924+0000","last_became_peered":"2024-09-12T00:28:31.199924+0000","last_unstale":"2024-09-12T01:35:14.115203+0000","last_undegraded":"2024-09-12T01:35:14.115203+0000","last_fullsized":"2024-09-12T01:35:14.115203+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:27.025158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7365505,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":426,"num_read_kb":12716,"num_write":1056,"num_write_kb":44871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"263'322","reported_seq":999,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:41.195483+0000","last_change":"2024-09-12T00:28:33.208356+0000","last_active":"2024-09-12T01:35:41.195483+0000","last_peered":"2024-09-12T01:35:41.195483+0000","last_clean":"2024-09-12T01:35:41.195483+0000","last_became_active":"2024-09-12T00:28:33.208088+0000","last_became_peered":"2024-09-12T00:28:33.208088+0000","last_unstale":"2024-09-12T01:35:41.195483+0000","last_undegraded":"2024-09-12T01:35:41.195483+0000","last_fullsized":"2024-09-12T01:35:41.195483+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:12.972774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1424,"num_read_kb":1183,"num_write":488,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"263'282","reported_seq":950,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:47.779071+0000","last_change":"2024-09-12T00:28:31.211421+0000","last_active":"2024-09-12T01:33:47.779071+0000","last_peered":"2024-09-12T01:33:47.779071+0000","last_clean":"2024-09-12T01:33:47.779071+0000","last_became_active":"2024-09-12T00:28:31.211083+0000","last_became_peered":"2024-09-12T00:28:31.211083+0000","last_unstale":"2024-09-12T01:33:47.779071+0000","last_undegraded":"2024-09-12T01:33:47.779071+0000","last_fullsized":"2024-09-12T01:33:47.779071+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:55.832817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":595266,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":542,"num_read_kb":3403,"num_write":1168,"num_write_kb":8870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"263'152","reported_seq":767,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:02.380980+0000","last_change":"2024-09-12T00:28:33.209816+0000","last_active":"2024-09-12T01:36:02.380980+0000","last_peered":"2024-09-12T01:36:02.380980+0000","last_clean":"2024-09-12T01:36:02.380980+0000","last_became_active":"2024-09-12T00:28:33.209024+0000","last_became_peered":"2024-09-12T00:28:33.209024+0000","last_unstale":"2024-09-12T01:36:02.380980+0000","last_undegraded":"2024-09-12T01:36:02.380980+0000","last_fullsized":"2024-09-12T01:36:02.380980+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:09.766449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":684,"num_read_kb":599,"num_write":231,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"263'309","reported_seq":927,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.752002+0000","last_change":"2024-09-12T00:28:31.207686+0000","last_active":"2024-09-12T01:38:01.752002+0000","last_peered":"2024-09-12T01:38:01.752002+0000","last_clean":"2024-09-12T01:38:01.752002+0000","last_became_active":"2024-09-12T00:28:31.207399+0000","last_became_peered":"2024-09-12T00:28:31.207399+0000","last_unstale":"2024-09-12T01:38:01.752002+0000","last_undegraded":"2024-09-12T01:38:01.752002+0000","last_fullsized":"2024-09-12T01:38:01.752002+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:23.656345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":660490,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":412,"num_read_kb":9232,"num_write":885,"num_write_kb":18206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"263'63","reported_seq":616,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:31.055891+0000","last_change":"2024-09-12T00:28:33.213456+0000","last_active":"2024-09-12T01:35:31.055891+0000","last_peered":"2024-09-12T01:35:31.055891+0000","last_clean":"2024-09-12T01:35:31.055891+0000","last_became_active":"2024-09-12T00:28:33.213110+0000","last_became_peered":"2024-09-12T00:28:33.213110+0000","last_unstale":"2024-09-12T01:35:31.055891+0000","last_undegraded":"2024-09-12T01:35:31.055891+0000","last_fullsized":"2024-09-12T01:35:31.055891+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:43.946245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":226,"num_write":102,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"263'347","reported_seq":1020,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.519322+0000","last_change":"2024-09-12T00:28:31.203837+0000","last_active":"2024-09-12T01:38:01.519322+0000","last_peered":"2024-09-12T01:38:01.519322+0000","last_clean":"2024-09-12T01:38:01.519322+0000","last_became_active":"2024-09-12T00:28:31.203478+0000","last_became_peered":"2024-09-12T00:28:31.203478+0000","last_unstale":"2024-09-12T01:38:01.519322+0000","last_undegraded":"2024-09-12T01:38:01.519322+0000","last_fullsized":"2024-09-12T01:38:01.519322+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:31.896358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524422,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":625,"num_read_kb":38935,"num_write":1076,"num_write_kb":32997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"263'193","reported_seq":781,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.783140+0000","last_change":"2024-09-12T00:28:33.220290+0000","last_active":"2024-09-12T01:33:51.783140+0000","last_peered":"2024-09-12T01:33:51.783140+0000","last_clean":"2024-09-12T01:33:51.783140+0000","last_became_active":"2024-09-12T00:28:33.220013+0000","last_became_peered":"2024-09-12T00:28:33.220013+0000","last_unstale":"2024-09-12T01:33:51.783140+0000","last_undegraded":"2024-09-12T01:33:51.783140+0000","last_fullsized":"2024-09-12T01:33:51.783140+0000","mapping_epoch":27,"log_start":"260'100","ondisk_log_start":"260'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:33.307077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":806,"num_read_kb":650,"num_write":294,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"263'313","reported_seq":930,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.701869+0000","last_change":"2024-09-12T00:28:31.204579+0000","last_active":"2024-09-12T01:38:01.701869+0000","last_peered":"2024-09-12T01:38:01.701869+0000","last_clean":"2024-09-12T01:38:01.701869+0000","last_became_active":"2024-09-12T00:28:31.204305+0000","last_became_peered":"2024-09-12T00:28:31.204305+0000","last_unstale":"2024-09-12T01:38:01.701869+0000","last_undegraded":"2024-09-12T01:38:01.701869+0000","last_fullsized":"2024-09-12T01:38:01.701869+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:37.446006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133673,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":474,"num_read_kb":11794,"num_write":1039,"num_write_kb":34532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"263'110","reported_seq":720,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:25.136847+0000","last_change":"2024-09-12T00:28:33.217086+0000","last_active":"2024-09-12T01:35:25.136847+0000","last_peered":"2024-09-12T01:35:25.136847+0000","last_clean":"2024-09-12T01:35:25.136847+0000","last_became_active":"2024-09-12T00:28:33.216814+0000","last_became_peered":"2024-09-12T00:28:33.216814+0000","last_unstale":"2024-09-12T01:35:25.136847+0000","last_undegraded":"2024-09-12T01:35:25.136847+0000","last_fullsized":"2024-09-12T01:35:25.136847+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:27.405799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":456,"num_read_kb":389,"num_write":151,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"263'346","reported_seq":1029,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.491744+0000","last_change":"2024-09-12T00:28:31.200695+0000","last_active":"2024-09-12T01:38:01.491744+0000","last_peered":"2024-09-12T01:38:01.491744+0000","last_clean":"2024-09-12T01:38:01.491744+0000","last_became_active":"2024-09-12T00:28:31.200421+0000","last_became_peered":"2024-09-12T00:28:31.200421+0000","last_unstale":"2024-09-12T01:38:01.491744+0000","last_undegraded":"2024-09-12T01:38:01.491744+0000","last_fullsized":"2024-09-12T01:38:01.491744+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:56.623886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1658550,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":533,"num_read_kb":83268,"num_write":1169,"num_write_kb":21609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"263'106","reported_seq":683,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:41.519720+0000","last_change":"2024-09-12T00:28:33.213440+0000","last_active":"2024-09-12T01:36:41.519720+0000","last_peered":"2024-09-12T01:36:41.519720+0000","last_clean":"2024-09-12T01:36:41.519720+0000","last_became_active":"2024-09-12T00:28:33.213100+0000","last_became_peered":"2024-09-12T00:28:33.213100+0000","last_unstale":"2024-09-12T01:36:41.519720+0000","last_undegraded":"2024-09-12T01:36:41.519720+0000","last_fullsized":"2024-09-12T01:36:41.519720+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:38.213563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":481,"num_read_kb":399,"num_write":154,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"263'288","reported_seq":976,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:52.780018+0000","last_change":"2024-09-12T00:28:31.215965+0000","last_active":"2024-09-12T01:33:52.780018+0000","last_peered":"2024-09-12T01:33:52.780018+0000","last_clean":"2024-09-12T01:33:52.780018+0000","last_became_active":"2024-09-12T00:28:31.215581+0000","last_became_peered":"2024-09-12T00:28:31.215581+0000","last_unstale":"2024-09-12T01:33:52.780018+0000","last_undegraded":"2024-09-12T01:33:52.780018+0000","last_fullsized":"2024-09-12T01:33:52.780018+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:38.099218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9952782,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":520,"num_read_kb":13302,"num_write":1130,"num_write_kb":31930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"263'248","reported_seq":888,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:24.851885+0000","last_change":"2024-09-12T00:28:31.214764+0000","last_active":"2024-09-12T01:36:24.851885+0000","last_peered":"2024-09-12T01:36:24.851885+0000","last_clean":"2024-09-12T01:36:24.851885+0000","last_became_active":"2024-09-12T00:28:31.214134+0000","last_became_peered":"2024-09-12T00:28:31.214134+0000","last_unstale":"2024-09-12T01:36:24.851885+0000","last_undegraded":"2024-09-12T01:36:24.851885+0000","last_fullsized":"2024-09-12T01:36:24.851885+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:00.479671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17637685,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":410,"num_read_kb":31725,"num_write":951,"num_write_kb":40420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"263'102","reported_seq":694,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:01.784409+0000","last_change":"2024-09-12T00:28:33.213186+0000","last_active":"2024-09-12T01:34:01.784409+0000","last_peered":"2024-09-12T01:34:01.784409+0000","last_clean":"2024-09-12T01:34:01.784409+0000","last_became_active":"2024-09-12T00:28:33.212886+0000","last_became_peered":"2024-09-12T00:28:33.212886+0000","last_unstale":"2024-09-12T01:34:01.784409+0000","last_undegraded":"2024-09-12T01:34:01.784409+0000","last_fullsized":"2024-09-12T01:34:01.784409+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:53.462824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":476,"num_read_kb":407,"num_write":159,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"263'328","reported_seq":1075,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:24.851441+0000","last_change":"2024-09-12T00:28:31.197815+0000","last_active":"2024-09-12T01:36:24.851441+0000","last_peered":"2024-09-12T01:36:24.851441+0000","last_clean":"2024-09-12T01:36:24.851441+0000","last_became_active":"2024-09-12T00:28:31.196230+0000","last_became_peered":"2024-09-12T00:28:31.196230+0000","last_unstale":"2024-09-12T01:36:24.851441+0000","last_undegraded":"2024-09-12T01:36:24.851441+0000","last_fullsized":"2024-09-12T01:36:24.851441+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:32.020082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17586873,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":667,"num_read_kb":35667,"num_write":1224,"num_write_kb":40181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"263'212","reported_seq":801,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:01.455973+0000","last_change":"2024-09-12T00:28:33.213479+0000","last_active":"2024-09-12T01:34:01.455973+0000","last_peered":"2024-09-12T01:34:01.455973+0000","last_clean":"2024-09-12T01:34:01.455973+0000","last_became_active":"2024-09-12T00:28:33.213187+0000","last_became_peered":"2024-09-12T00:28:33.213187+0000","last_unstale":"2024-09-12T01:34:01.455973+0000","last_undegraded":"2024-09-12T01:34:01.455973+0000","last_fullsized":"2024-09-12T01:34:01.455973+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:03.213237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":884,"num_read_kb":712,"num_write":323,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5759,"num_read_kb":4046,"num_write":1929,"num_write_kb":827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1000,"ondisk_log_size":1000,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15395,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":15045,"num_read_kb":14706,"num_write":16739,"num_write_kb":4892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1773,"ondisk_log_size":1773,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":501,"ondisk_log_size":501,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1671029,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":18659,"num_read_kb":37297,"num_write":15679,"num_write_kb":11858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1867776,"data_stored":1469111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1974,"ondisk_log_size":1974,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2396,"num_read_kb":2858,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":103056,"num_read_kb":85959,"num_write":37323,"num_write_kb":18865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4302,"ondisk_log_size":4302,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":296689113,"num_objects":2352,"num_object_clones":0,"num_object_copies":4704,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2352,"num_whiteouts":0,"num_read":34160,"num_read_kb":1909912,"num_write":69355,"num_write_kb":2052201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":593608704,"data_stored":578270824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3943,"ondisk_log_size":3943,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":32514020,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":122,"num_read_kb":175308,"num_write":144,"num_write_kb":116383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":27197,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":72998912,"data_stored":72992692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":84,"ondisk_log_size":84,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":11534336,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":131,"num_read_kb":178855,"num_write":152,"num_write_kb":116383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":46772224,"data_stored":46770128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510283,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":259636,"kb_used_data":29848,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94112204,"statfs":{"total":96636764160,"available":96370896896,"internally_reserved":0,"allocated":30564352,"data_stored":27856316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":235207114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510282,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":263728,"kb_used_data":33884,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94108112,"statfs":{"total":96636764160,"available":96366706688,"internally_reserved":0,"allocated":34697216,"data_stored":32019931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":235207110},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510284,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":314256,"kb_used_data":202624,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94057584,"statfs":{"total":96636764160,"available":96314966016,"internally_reserved":0,"allocated":207486976,"data_stored":200875094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510281,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":210132,"kb_used_data":142808,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94161708,"statfs":{"total":96636764160,"available":96421588992,"internally_reserved":0,"allocated":146235392,"data_stored":141707397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510284,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":106688,"kb_used_data":57356,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94265152,"statfs":{"total":96636764160,"available":96527515648,"internally_reserved":0,"allocated":58732544,"data_stored":55554255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510286,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":271812,"kb_used_data":164340,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94100028,"statfs":{"total":96636764160,"available":96358428672,"internally_reserved":0,"allocated":168284160,"data_stored":163763127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110033349},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510285,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302192,"kb_used_data":58492,"kb_used_omap":1,"kb_used_meta":243518,"kb_avail":94069648,"statfs":{"total":96636764160,"available":96327319552,"internally_reserved":0,"allocated":59895808,"data_stored":56705710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":249362885},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575690,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":465020,"kb_used_data":213100,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":93906820,"statfs":{"total":96636764160,"available":96160583680,"internally_reserved":0,"allocated":218214400,"data_stored":211568643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":257948104},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":31928320,"data_stored":31687986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":124751872,"data_stored":121780828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16175104,"data_stored":15670618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":173539328,"data_stored":168466743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":34234368,"data_stored":33463876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":179056640,"data_stored":174053234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":18251776,"data_stored":17721878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15671296,"data_stored":15425661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":487424,"data_stored":416106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":569344,"data_stored":480013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":675840,"data_stored":569274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16826368,"data_stored":16825637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20508672,"data_stored":20507307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":3145728,"data_stored":3145728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22605824,"data_stored":22604459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3145728,"data_stored":3145728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":19984384,"data_stored":19979529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:38:03.973 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T01:38:03.973 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:38:04.311 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:38:04.322 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T01:38:04.325 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":2353,"stamp":"2024-09-12T01:38:03.939388+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":218380745,"num_objects":1543,"num_object_clones":0,"num_object_copies":3086,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1543,"num_whiteouts":0,"num_read":180750,"num_read_kb":2410507,"num_write":142721,"num_write_kb":2323087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":27197,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13616,"ondisk_log_size":13616,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1912168,"kb_used_data":628956,"kb_used_omap":12,"kb_used_meta":1282035,"kb_avail":753062552,"statfs":{"total":773094113280,"available":771136053248,"internally_reserved":0,"allocated":644050944,"data_stored":616683980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1312804401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-469552214,"num_objects":-3270,"num_object_clones":0,"num_object_copies":-6540,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-3270,"num_whiteouts":0,"num_read":3688,"num_read_kb":3443,"num_write":3484,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005138"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:17.783401+0000","last_change":"2024-09-12T01:04:15.393241+0000","last_active":"2024-09-12T01:34:17.783401+0000","last_peered":"2024-09-12T01:34:17.783401+0000","last_clean":"2024-09-12T01:34:17.783401+0000","last_became_active":"2024-09-12T01:04:15.392944+0000","last_became_peered":"2024-09-12T01:04:15.392944+0000","last_unstale":"2024-09-12T01:34:17.783401+0000","last_undegraded":"2024-09-12T01:34:17.783401+0000","last_fullsized":"2024-09-12T01:34:17.783401+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:32.532552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"263'8","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.458995+0000","last_change":"2024-09-12T00:46:26.362583+0000","last_active":"2024-09-12T01:38:00.458995+0000","last_peered":"2024-09-12T01:38:00.458995+0000","last_clean":"2024-09-12T01:38:00.458995+0000","last_became_active":"2024-09-12T00:46:26.362231+0000","last_became_peered":"2024-09-12T00:46:26.362231+0000","last_unstale":"2024-09-12T01:38:00.458995+0000","last_undegraded":"2024-09-12T01:38:00.458995+0000","last_fullsized":"2024-09-12T01:38:00.458995+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:47.340687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":19456,"num_write":13,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:54.637545+0000","last_change":"2024-09-12T00:46:22.353581+0000","last_active":"2024-09-12T01:33:54.637545+0000","last_peered":"2024-09-12T01:33:54.637545+0000","last_clean":"2024-09-12T01:33:54.637545+0000","last_became_active":"2024-09-12T00:46:22.353306+0000","last_became_peered":"2024-09-12T00:46:22.353306+0000","last_unstale":"2024-09-12T01:33:54.637545+0000","last_undegraded":"2024-09-12T01:33:54.637545+0000","last_fullsized":"2024-09-12T01:33:54.637545+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:42.123772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"263'59","reported_seq":219,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:41.789494+0000","last_change":"2024-09-12T00:42:36.818643+0000","last_active":"2024-09-12T01:34:41.789494+0000","last_peered":"2024-09-12T01:34:41.789494+0000","last_clean":"2024-09-12T01:34:41.789494+0000","last_became_active":"2024-09-12T00:42:36.818329+0000","last_became_peered":"2024-09-12T00:42:36.818329+0000","last_unstale":"2024-09-12T01:34:41.789494+0000","last_undegraded":"2024-09-12T01:34:41.789494+0000","last_fullsized":"2024-09-12T01:34:41.789494+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:59.176386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":293,"num_read_kb":205,"num_write":105,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:16.629694+0000","last_change":"2024-09-12T01:04:15.393046+0000","last_active":"2024-09-12T01:34:16.629694+0000","last_peered":"2024-09-12T01:34:16.629694+0000","last_clean":"2024-09-12T01:34:16.629694+0000","last_became_active":"2024-09-12T01:04:15.392747+0000","last_became_peered":"2024-09-12T01:04:15.392747+0000","last_unstale":"2024-09-12T01:34:16.629694+0000","last_undegraded":"2024-09-12T01:34:16.629694+0000","last_fullsized":"2024-09-12T01:34:16.629694+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:12.627526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"263'2","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.534462+0000","last_change":"2024-09-12T00:46:26.370283+0000","last_active":"2024-09-12T01:33:56.534462+0000","last_peered":"2024-09-12T01:33:56.534462+0000","last_clean":"2024-09-12T01:33:56.534462+0000","last_became_active":"2024-09-12T00:46:26.369944+0000","last_became_peered":"2024-09-12T00:46:26.369944+0000","last_unstale":"2024-09-12T01:33:56.534462+0000","last_undegraded":"2024-09-12T01:33:56.534462+0000","last_fullsized":"2024-09-12T01:33:56.534462+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:14.648408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"260'8","reported_seq":70,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.933295+0000","last_change":"2024-09-12T00:46:22.354256+0000","last_active":"2024-09-12T01:33:51.933295+0000","last_peered":"2024-09-12T01:33:51.933295+0000","last_clean":"2024-09-12T01:33:51.933295+0000","last_became_active":"2024-09-12T00:46:22.352009+0000","last_became_peered":"2024-09-12T00:46:22.352009+0000","last_unstale":"2024-09-12T01:33:51.933295+0000","last_undegraded":"2024-09-12T01:33:51.933295+0000","last_fullsized":"2024-09-12T01:33:51.933295+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:27.873653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":26626,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"263'20","reported_seq":116,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:56.533176+0000","last_change":"2024-09-12T00:42:36.809720+0000","last_active":"2024-09-12T01:34:56.533176+0000","last_peered":"2024-09-12T01:34:56.533176+0000","last_clean":"2024-09-12T01:34:56.533176+0000","last_became_active":"2024-09-12T00:42:36.809431+0000","last_became_peered":"2024-09-12T00:42:36.809431+0000","last_unstale":"2024-09-12T01:34:56.533176+0000","last_undegraded":"2024-09-12T01:34:56.533176+0000","last_fullsized":"2024-09-12T01:34:56.533176+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:09.971874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":73,"num_write":40,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:16.528384+0000","last_change":"2024-09-12T01:04:15.384612+0000","last_active":"2024-09-12T01:33:16.528384+0000","last_peered":"2024-09-12T01:33:16.528384+0000","last_clean":"2024-09-12T01:33:16.528384+0000","last_became_active":"2024-09-12T01:04:15.384312+0000","last_became_peered":"2024-09-12T01:04:15.384312+0000","last_unstale":"2024-09-12T01:33:16.528384+0000","last_undegraded":"2024-09-12T01:33:16.528384+0000","last_fullsized":"2024-09-12T01:33:16.528384+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:27.357127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:21.786809+0000","last_change":"2024-09-12T00:46:26.563569+0000","last_active":"2024-09-12T01:34:21.786809+0000","last_peered":"2024-09-12T01:34:21.786809+0000","last_clean":"2024-09-12T01:34:21.786809+0000","last_became_active":"2024-09-12T00:46:26.563267+0000","last_became_peered":"2024-09-12T00:46:26.563267+0000","last_unstale":"2024-09-12T01:34:21.786809+0000","last_undegraded":"2024-09-12T01:34:21.786809+0000","last_fullsized":"2024-09-12T01:34:21.786809+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:14.364154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"260'3","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:41.531630+0000","last_change":"2024-09-12T00:46:22.341443+0000","last_active":"2024-09-12T01:34:41.531630+0000","last_peered":"2024-09-12T01:34:41.531630+0000","last_clean":"2024-09-12T01:34:41.531630+0000","last_became_active":"2024-09-12T00:46:22.340655+0000","last_became_peered":"2024-09-12T00:46:22.340655+0000","last_unstale":"2024-09-12T01:34:41.531630+0000","last_undegraded":"2024-09-12T01:34:41.531630+0000","last_fullsized":"2024-09-12T01:34:41.531630+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:34.773392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"263'63","reported_seq":226,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:06.792053+0000","last_change":"2024-09-12T00:42:36.814795+0000","last_active":"2024-09-12T01:35:06.792053+0000","last_peered":"2024-09-12T01:35:06.792053+0000","last_clean":"2024-09-12T01:35:06.792053+0000","last_became_active":"2024-09-12T00:42:36.814510+0000","last_became_peered":"2024-09-12T00:42:36.814510+0000","last_unstale":"2024-09-12T01:35:06.792053+0000","last_undegraded":"2024-09-12T01:35:06.792053+0000","last_fullsized":"2024-09-12T01:35:06.792053+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:42.130114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":321,"num_read_kb":228,"num_write":110,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:19.633277+0000","last_change":"2024-09-12T01:04:15.402204+0000","last_active":"2024-09-12T01:33:19.633277+0000","last_peered":"2024-09-12T01:33:19.633277+0000","last_clean":"2024-09-12T01:33:19.633277+0000","last_became_active":"2024-09-12T01:04:15.401897+0000","last_became_peered":"2024-09-12T01:04:15.401897+0000","last_unstale":"2024-09-12T01:33:19.633277+0000","last_undegraded":"2024-09-12T01:33:19.633277+0000","last_fullsized":"2024-09-12T01:33:19.633277+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:27.841236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:39.642849+0000","last_change":"2024-09-12T00:46:26.562165+0000","last_active":"2024-09-12T01:34:39.642849+0000","last_peered":"2024-09-12T01:34:39.642849+0000","last_clean":"2024-09-12T01:34:39.642849+0000","last_became_active":"2024-09-12T00:46:26.561870+0000","last_became_peered":"2024-09-12T00:46:26.561870+0000","last_unstale":"2024-09-12T01:34:39.642849+0000","last_undegraded":"2024-09-12T01:34:39.642849+0000","last_fullsized":"2024-09-12T01:34:39.642849+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:20.530939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"263'6","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.235708+0000","last_change":"2024-09-12T00:46:22.339498+0000","last_active":"2024-09-12T01:38:00.235708+0000","last_peered":"2024-09-12T01:38:00.235708+0000","last_clean":"2024-09-12T01:38:00.235708+0000","last_became_active":"2024-09-12T00:46:22.339141+0000","last_became_peered":"2024-09-12T00:46:22.339141+0000","last_unstale":"2024-09-12T01:38:00.235708+0000","last_undegraded":"2024-09-12T01:38:00.235708+0000","last_fullsized":"2024-09-12T01:38:00.235708+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:45.856718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"263'62","reported_seq":225,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:09.646373+0000","last_change":"2024-09-12T00:42:36.816859+0000","last_active":"2024-09-12T01:35:09.646373+0000","last_peered":"2024-09-12T01:35:09.646373+0000","last_clean":"2024-09-12T01:35:09.646373+0000","last_became_active":"2024-09-12T00:42:36.816570+0000","last_became_peered":"2024-09-12T00:42:36.816570+0000","last_unstale":"2024-09-12T01:35:09.646373+0000","last_undegraded":"2024-09-12T01:35:09.646373+0000","last_fullsized":"2024-09-12T01:35:09.646373+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:03.911054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":318,"num_read_kb":239,"num_write":100,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:19.640647+0000","last_change":"2024-09-12T01:04:15.400469+0000","last_active":"2024-09-12T01:34:19.640647+0000","last_peered":"2024-09-12T01:34:19.640647+0000","last_clean":"2024-09-12T01:34:19.640647+0000","last_became_active":"2024-09-12T01:04:15.400228+0000","last_became_peered":"2024-09-12T01:04:15.400228+0000","last_unstale":"2024-09-12T01:34:19.640647+0000","last_undegraded":"2024-09-12T01:34:19.640647+0000","last_fullsized":"2024-09-12T01:34:19.640647+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:12.710997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"263'9","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.748908+0000","last_change":"2024-09-12T00:46:26.368145+0000","last_active":"2024-09-12T01:38:00.748908+0000","last_peered":"2024-09-12T01:38:00.748908+0000","last_clean":"2024-09-12T01:38:00.748908+0000","last_became_active":"2024-09-12T00:46:26.367849+0000","last_became_peered":"2024-09-12T00:46:26.367849+0000","last_unstale":"2024-09-12T01:38:00.748908+0000","last_undegraded":"2024-09-12T01:38:00.748908+0000","last_fullsized":"2024-09-12T01:38:00.748908+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:35.175209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7168,"num_write":19,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"263'13","reported_seq":83,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:06.806586+0000","last_change":"2024-09-12T00:46:22.351181+0000","last_active":"2024-09-12T01:37:06.806586+0000","last_peered":"2024-09-12T01:37:06.806586+0000","last_clean":"2024-09-12T01:37:06.806586+0000","last_became_active":"2024-09-12T00:46:22.349597+0000","last_became_peered":"2024-09-12T00:46:22.349597+0000","last_unstale":"2024-09-12T01:37:06.806586+0000","last_undegraded":"2024-09-12T01:37:06.806586+0000","last_fullsized":"2024-09-12T01:37:06.806586+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:58.755945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":44034,"num_write":28,"num_write_kb":19456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"263'28","reported_seq":129,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:09.646341+0000","last_change":"2024-09-12T00:42:36.815076+0000","last_active":"2024-09-12T01:35:09.646341+0000","last_peered":"2024-09-12T01:35:09.646341+0000","last_clean":"2024-09-12T01:35:09.646341+0000","last_became_active":"2024-09-12T00:42:36.814799+0000","last_became_peered":"2024-09-12T00:42:36.814799+0000","last_unstale":"2024-09-12T01:35:09.646341+0000","last_undegraded":"2024-09-12T01:35:09.646341+0000","last_fullsized":"2024-09-12T01:35:09.646341+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:46.026762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":94,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:31.946433+0000","last_change":"2024-09-12T01:04:15.388981+0000","last_active":"2024-09-12T01:35:31.946433+0000","last_peered":"2024-09-12T01:35:31.946433+0000","last_clean":"2024-09-12T01:35:31.946433+0000","last_became_active":"2024-09-12T01:04:15.388593+0000","last_became_peered":"2024-09-12T01:04:15.388593+0000","last_unstale":"2024-09-12T01:35:31.946433+0000","last_undegraded":"2024-09-12T01:35:31.946433+0000","last_fullsized":"2024-09-12T01:35:31.946433+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:42.435298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"260'2","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:46.540932+0000","last_change":"2024-09-12T00:47:05.446932+0000","last_active":"2024-09-12T01:34:46.540932+0000","last_peered":"2024-09-12T01:34:46.540932+0000","last_clean":"2024-09-12T01:34:46.540932+0000","last_became_active":"2024-09-12T00:47:05.444004+0000","last_became_peered":"2024-09-12T00:47:05.444004+0000","last_unstale":"2024-09-12T01:34:46.540932+0000","last_undegraded":"2024-09-12T01:34:46.540932+0000","last_fullsized":"2024-09-12T01:34:46.540932+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:13.946930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":27197,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"263'2","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:21.563798+0000","last_change":"2024-09-12T00:46:22.348331+0000","last_active":"2024-09-12T01:37:21.563798+0000","last_peered":"2024-09-12T01:37:21.563798+0000","last_clean":"2024-09-12T01:37:21.563798+0000","last_became_active":"2024-09-12T00:46:22.347338+0000","last_became_peered":"2024-09-12T00:46:22.347338+0000","last_unstale":"2024-09-12T01:37:21.563798+0000","last_undegraded":"2024-09-12T01:37:21.563798+0000","last_fullsized":"2024-09-12T01:37:21.563798+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:08.989061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"260'71","reported_seq":297,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:06.543849+0000","last_change":"2024-09-12T00:42:36.812768+0000","last_active":"2024-09-12T01:35:06.543849+0000","last_peered":"2024-09-12T01:35:06.543849+0000","last_clean":"2024-09-12T01:35:06.543849+0000","last_became_active":"2024-09-12T00:42:36.812454+0000","last_became_peered":"2024-09-12T00:42:36.812454+0000","last_unstale":"2024-09-12T01:35:06.543849+0000","last_undegraded":"2024-09-12T01:35:06.543849+0000","last_fullsized":"2024-09-12T01:35:06.543849+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:06.880124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":475,"num_read_kb":319,"num_write":83,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"263'1","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:16.721868+0000","last_change":"2024-09-12T01:04:15.391988+0000","last_active":"2024-09-12T01:34:16.721868+0000","last_peered":"2024-09-12T01:34:16.721868+0000","last_clean":"2024-09-12T01:34:16.721868+0000","last_became_active":"2024-09-12T01:04:15.391532+0000","last_became_peered":"2024-09-12T01:04:15.391532+0000","last_unstale":"2024-09-12T01:34:16.721868+0000","last_undegraded":"2024-09-12T01:34:16.721868+0000","last_fullsized":"2024-09-12T01:34:16.721868+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:13.040622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"263'6","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.236119+0000","last_change":"2024-09-12T00:46:26.374943+0000","last_active":"2024-09-12T01:38:00.236119+0000","last_peered":"2024-09-12T01:38:00.236119+0000","last_clean":"2024-09-12T01:38:00.236119+0000","last_became_active":"2024-09-12T00:46:26.374660+0000","last_became_peered":"2024-09-12T00:46:26.374660+0000","last_unstale":"2024-09-12T01:38:00.236119+0000","last_undegraded":"2024-09-12T01:38:00.236119+0000","last_fullsized":"2024-09-12T01:38:00.236119+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:20.054984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"263'7","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:21.555167+0000","last_change":"2024-09-12T00:46:22.340546+0000","last_active":"2024-09-12T01:36:21.555167+0000","last_peered":"2024-09-12T01:36:21.555167+0000","last_clean":"2024-09-12T01:36:21.555167+0000","last_became_active":"2024-09-12T00:46:22.340228+0000","last_became_peered":"2024-09-12T00:46:22.340228+0000","last_unstale":"2024-09-12T01:36:21.555167+0000","last_undegraded":"2024-09-12T01:36:21.555167+0000","last_fullsized":"2024-09-12T01:36:21.555167+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:22.609852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6219,"num_write":7,"num_write_kb":6219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"263'129","reported_seq":431,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:31.780542+0000","last_change":"2024-09-12T00:42:36.813186+0000","last_active":"2024-09-12T01:33:31.780542+0000","last_peered":"2024-09-12T01:33:31.780542+0000","last_clean":"2024-09-12T01:33:31.780542+0000","last_became_active":"2024-09-12T00:42:36.812882+0000","last_became_peered":"2024-09-12T00:42:36.812882+0000","last_unstale":"2024-09-12T01:33:31.780542+0000","last_undegraded":"2024-09-12T01:33:31.780542+0000","last_fullsized":"2024-09-12T01:33:31.780542+0000","mapping_epoch":250,"log_start":"260'100","ondisk_log_start":"260'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:07.773148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":723,"num_read_kb":503,"num_write":193,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:16.721896+0000","last_change":"2024-09-12T01:04:15.398861+0000","last_active":"2024-09-12T01:34:16.721896+0000","last_peered":"2024-09-12T01:34:16.721896+0000","last_clean":"2024-09-12T01:34:16.721896+0000","last_became_active":"2024-09-12T01:04:15.398533+0000","last_became_peered":"2024-09-12T01:04:15.398533+0000","last_unstale":"2024-09-12T01:34:16.721896+0000","last_undegraded":"2024-09-12T01:34:16.721896+0000","last_fullsized":"2024-09-12T01:34:16.721896+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:15.428730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"263'3","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:59.638134+0000","last_change":"2024-09-12T00:46:26.368036+0000","last_active":"2024-09-12T01:33:59.638134+0000","last_peered":"2024-09-12T01:33:59.638134+0000","last_clean":"2024-09-12T01:33:59.638134+0000","last_became_active":"2024-09-12T00:46:26.367766+0000","last_became_peered":"2024-09-12T00:46:26.367766+0000","last_unstale":"2024-09-12T01:33:59.638134+0000","last_undegraded":"2024-09-12T01:33:59.638134+0000","last_fullsized":"2024-09-12T01:33:59.638134+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:04.823775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5246081,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":8,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.783149+0000","last_change":"2024-09-12T00:46:22.354118+0000","last_active":"2024-09-12T01:33:51.783149+0000","last_peered":"2024-09-12T01:33:51.783149+0000","last_clean":"2024-09-12T01:33:51.783149+0000","last_became_active":"2024-09-12T00:46:22.353833+0000","last_became_peered":"2024-09-12T00:46:22.353833+0000","last_unstale":"2024-09-12T01:33:51.783149+0000","last_undegraded":"2024-09-12T01:33:51.783149+0000","last_fullsized":"2024-09-12T01:33:51.783149+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:15.168253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'39","reported_seq":166,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:21.929290+0000","last_change":"2024-09-12T00:42:36.803994+0000","last_active":"2024-09-12T01:33:21.929290+0000","last_peered":"2024-09-12T01:33:21.929290+0000","last_clean":"2024-09-12T01:33:21.929290+0000","last_became_active":"2024-09-12T00:42:36.803692+0000","last_became_peered":"2024-09-12T00:42:36.803692+0000","last_unstale":"2024-09-12T01:33:21.929290+0000","last_undegraded":"2024-09-12T01:33:21.929290+0000","last_fullsized":"2024-09-12T01:33:21.929290+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:25.542741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":209,"num_read_kb":149,"num_write":77,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.938567+0000","last_change":"2024-09-12T01:04:15.385887+0000","last_active":"2024-09-12T01:34:36.938567+0000","last_peered":"2024-09-12T01:34:36.938567+0000","last_clean":"2024-09-12T01:34:36.938567+0000","last_became_active":"2024-09-12T01:04:15.385172+0000","last_became_peered":"2024-09-12T01:04:15.385172+0000","last_unstale":"2024-09-12T01:34:36.938567+0000","last_undegraded":"2024-09-12T01:34:36.938567+0000","last_fullsized":"2024-09-12T01:34:36.938567+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:15.451328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"263'3","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:49.644101+0000","last_change":"2024-09-12T00:46:26.565125+0000","last_active":"2024-09-12T01:34:49.644101+0000","last_peered":"2024-09-12T01:34:49.644101+0000","last_clean":"2024-09-12T01:34:49.644101+0000","last_became_active":"2024-09-12T00:46:26.561643+0000","last_became_peered":"2024-09-12T00:46:26.561643+0000","last_unstale":"2024-09-12T01:34:49.644101+0000","last_undegraded":"2024-09-12T01:34:49.644101+0000","last_fullsized":"2024-09-12T01:34:49.644101+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:50.221519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5247843,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":10250,"num_write":8,"num_write_kb":5125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:27.793407+0000","last_change":"2024-09-12T00:46:22.349290+0000","last_active":"2024-09-12T01:35:27.793407+0000","last_peered":"2024-09-12T01:35:27.793407+0000","last_clean":"2024-09-12T01:35:27.793407+0000","last_became_active":"2024-09-12T00:46:22.349007+0000","last_became_peered":"2024-09-12T00:46:22.349007+0000","last_unstale":"2024-09-12T01:35:27.793407+0000","last_undegraded":"2024-09-12T01:35:27.793407+0000","last_fullsized":"2024-09-12T01:35:27.793407+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:56.041981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"263'19","reported_seq":112,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:21.779391+0000","last_change":"2024-09-12T00:42:36.815233+0000","last_active":"2024-09-12T01:33:21.779391+0000","last_peered":"2024-09-12T01:33:21.779391+0000","last_clean":"2024-09-12T01:33:21.779391+0000","last_became_active":"2024-09-12T00:42:36.814846+0000","last_became_peered":"2024-09-12T00:42:36.814846+0000","last_unstale":"2024-09-12T01:33:21.779391+0000","last_undegraded":"2024-09-12T01:33:21.779391+0000","last_fullsized":"2024-09-12T01:33:21.779391+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:27.509902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":75,"num_write":34,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"263'1","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.531023+0000","last_change":"2024-09-12T01:04:15.395818+0000","last_active":"2024-09-12T01:34:36.531023+0000","last_peered":"2024-09-12T01:34:36.531023+0000","last_clean":"2024-09-12T01:34:36.531023+0000","last_became_active":"2024-09-12T01:04:15.395540+0000","last_became_peered":"2024-09-12T01:04:15.395540+0000","last_unstale":"2024-09-12T01:34:36.531023+0000","last_undegraded":"2024-09-12T01:34:36.531023+0000","last_fullsized":"2024-09-12T01:34:36.531023+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:29.002458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:39.649759+0000","last_change":"2024-09-12T00:46:26.562294+0000","last_active":"2024-09-12T01:35:39.649759+0000","last_peered":"2024-09-12T01:35:39.649759+0000","last_clean":"2024-09-12T01:35:39.649759+0000","last_became_active":"2024-09-12T00:46:26.561961+0000","last_became_peered":"2024-09-12T00:46:26.561961+0000","last_unstale":"2024-09-12T01:35:39.649759+0000","last_undegraded":"2024-09-12T01:35:39.649759+0000","last_fullsized":"2024-09-12T01:35:39.649759+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:55.068083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"260'5","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:41.725916+0000","last_change":"2024-09-12T00:46:22.351249+0000","last_active":"2024-09-12T01:34:41.725916+0000","last_peered":"2024-09-12T01:34:41.725916+0000","last_clean":"2024-09-12T01:34:41.725916+0000","last_became_active":"2024-09-12T00:46:22.350947+0000","last_became_peered":"2024-09-12T00:46:22.350947+0000","last_unstale":"2024-09-12T01:34:41.725916+0000","last_undegraded":"2024-09-12T01:34:41.725916+0000","last_fullsized":"2024-09-12T01:34:41.725916+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:16.221679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"263'28","reported_seq":135,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:24.633878+0000","last_change":"2024-09-12T00:42:36.815997+0000","last_active":"2024-09-12T01:33:24.633878+0000","last_peered":"2024-09-12T01:33:24.633878+0000","last_clean":"2024-09-12T01:33:24.633878+0000","last_became_active":"2024-09-12T00:42:36.815638+0000","last_became_peered":"2024-09-12T00:42:36.815638+0000","last_unstale":"2024-09-12T01:33:24.633878+0000","last_undegraded":"2024-09-12T01:33:24.633878+0000","last_fullsized":"2024-09-12T01:33:24.633878+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:31.983576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":103,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.724838+0000","last_change":"2024-09-12T01:04:15.391815+0000","last_active":"2024-09-12T01:34:36.724838+0000","last_peered":"2024-09-12T01:34:36.724838+0000","last_clean":"2024-09-12T01:34:36.724838+0000","last_became_active":"2024-09-12T01:04:15.391501+0000","last_became_peered":"2024-09-12T01:04:15.391501+0000","last_unstale":"2024-09-12T01:34:36.724838+0000","last_undegraded":"2024-09-12T01:34:36.724838+0000","last_fullsized":"2024-09-12T01:34:36.724838+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:28.795724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:49.644166+0000","last_change":"2024-09-12T00:46:26.563439+0000","last_active":"2024-09-12T01:34:49.644166+0000","last_peered":"2024-09-12T01:34:49.644166+0000","last_clean":"2024-09-12T01:34:49.644166+0000","last_became_active":"2024-09-12T00:46:26.563091+0000","last_became_peered":"2024-09-12T00:46:26.563091+0000","last_unstale":"2024-09-12T01:34:49.644166+0000","last_undegraded":"2024-09-12T01:34:49.644166+0000","last_fullsized":"2024-09-12T01:34:49.644166+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:05.796776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:41.531600+0000","last_change":"2024-09-12T00:46:22.354515+0000","last_active":"2024-09-12T01:34:41.531600+0000","last_peered":"2024-09-12T01:34:41.531600+0000","last_clean":"2024-09-12T01:34:41.531600+0000","last_became_active":"2024-09-12T00:46:22.354167+0000","last_became_peered":"2024-09-12T00:46:22.354167+0000","last_unstale":"2024-09-12T01:34:41.531600+0000","last_undegraded":"2024-09-12T01:34:41.531600+0000","last_fullsized":"2024-09-12T01:34:41.531600+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:09.196332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"260'8","reported_seq":81,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:21.624072+0000","last_change":"2024-09-12T00:42:36.803040+0000","last_active":"2024-09-12T01:33:21.624072+0000","last_peered":"2024-09-12T01:33:21.624072+0000","last_clean":"2024-09-12T01:33:21.624072+0000","last_became_active":"2024-09-12T00:42:36.802737+0000","last_became_peered":"2024-09-12T00:42:36.802737+0000","last_unstale":"2024-09-12T01:33:21.624072+0000","last_undegraded":"2024-09-12T01:33:21.624072+0000","last_fullsized":"2024-09-12T01:33:21.624072+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:54.260259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:37.786393+0000","last_change":"2024-09-12T01:04:15.393599+0000","last_active":"2024-09-12T01:34:37.786393+0000","last_peered":"2024-09-12T01:34:37.786393+0000","last_clean":"2024-09-12T01:34:37.786393+0000","last_became_active":"2024-09-12T01:04:15.393292+0000","last_became_peered":"2024-09-12T01:04:15.393292+0000","last_unstale":"2024-09-12T01:34:37.786393+0000","last_undegraded":"2024-09-12T01:34:37.786393+0000","last_fullsized":"2024-09-12T01:34:37.786393+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:04.044752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"263'3","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:11.562356+0000","last_change":"2024-09-12T00:46:26.371159+0000","last_active":"2024-09-12T01:37:11.562356+0000","last_peered":"2024-09-12T01:37:11.562356+0000","last_clean":"2024-09-12T01:37:11.562356+0000","last_became_active":"2024-09-12T00:46:26.370845+0000","last_became_peered":"2024-09-12T00:46:26.370845+0000","last_unstale":"2024-09-12T01:37:11.562356+0000","last_undegraded":"2024-09-12T01:37:11.562356+0000","last_fullsized":"2024-09-12T01:37:11.562356+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:36.995861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:41.789472+0000","last_change":"2024-09-12T00:46:22.349777+0000","last_active":"2024-09-12T01:34:41.789472+0000","last_peered":"2024-09-12T01:34:41.789472+0000","last_clean":"2024-09-12T01:34:41.789472+0000","last_became_active":"2024-09-12T00:46:22.348534+0000","last_became_peered":"2024-09-12T00:46:22.348534+0000","last_unstale":"2024-09-12T01:34:41.789472+0000","last_undegraded":"2024-09-12T01:34:41.789472+0000","last_fullsized":"2024-09-12T01:34:41.789472+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:19.642717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"263'16","reported_seq":98,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:11.721017+0000","last_change":"2024-09-12T00:42:36.812901+0000","last_active":"2024-09-12T01:34:11.721017+0000","last_peered":"2024-09-12T01:34:11.721017+0000","last_clean":"2024-09-12T01:34:11.721017+0000","last_became_active":"2024-09-12T00:42:36.812629+0000","last_became_peered":"2024-09-12T00:42:36.812629+0000","last_unstale":"2024-09-12T01:34:11.721017+0000","last_undegraded":"2024-09-12T01:34:11.721017+0000","last_fullsized":"2024-09-12T01:34:11.721017+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:44.152868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":48,"num_write":38,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:14.632788+0000","last_change":"2024-09-12T01:04:15.398685+0000","last_active":"2024-09-12T01:33:14.632788+0000","last_peered":"2024-09-12T01:33:14.632788+0000","last_clean":"2024-09-12T01:33:14.632788+0000","last_became_active":"2024-09-12T01:04:15.398407+0000","last_became_peered":"2024-09-12T01:04:15.398407+0000","last_unstale":"2024-09-12T01:33:14.632788+0000","last_undegraded":"2024-09-12T01:33:14.632788+0000","last_fullsized":"2024-09-12T01:33:14.632788+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:31.635332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"263'3","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.962291+0000","last_change":"2024-09-12T00:46:26.367154+0000","last_active":"2024-09-12T01:37:46.962291+0000","last_peered":"2024-09-12T01:37:46.962291+0000","last_clean":"2024-09-12T01:37:46.962291+0000","last_became_active":"2024-09-12T00:46:26.366602+0000","last_became_peered":"2024-09-12T00:46:26.366602+0000","last_unstale":"2024-09-12T01:37:46.962291+0000","last_undegraded":"2024-09-12T01:37:46.962291+0000","last_fullsized":"2024-09-12T01:37:46.962291+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:36.704535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"263'8","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.830541+0000","last_change":"2024-09-12T00:46:22.351729+0000","last_active":"2024-09-12T01:38:00.830541+0000","last_peered":"2024-09-12T01:38:00.830541+0000","last_clean":"2024-09-12T01:38:00.830541+0000","last_became_active":"2024-09-12T00:46:22.351432+0000","last_became_peered":"2024-09-12T00:46:22.351432+0000","last_unstale":"2024-09-12T01:38:00.830541+0000","last_undegraded":"2024-09-12T01:38:00.830541+0000","last_fullsized":"2024-09-12T01:38:00.830541+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:22.950636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":18,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"252'16","reported_seq":103,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.718650+0000","last_change":"2024-09-12T00:42:36.813580+0000","last_active":"2024-09-12T01:33:56.718650+0000","last_peered":"2024-09-12T01:33:56.718650+0000","last_clean":"2024-09-12T01:33:56.718650+0000","last_became_active":"2024-09-12T00:42:36.813324+0000","last_became_peered":"2024-09-12T00:42:36.813324+0000","last_unstale":"2024-09-12T01:33:56.718650+0000","last_undegraded":"2024-09-12T01:33:56.718650+0000","last_fullsized":"2024-09-12T01:33:56.718650+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:12.154346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":59,"num_write":21,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:16.778711+0000","last_change":"2024-09-12T01:04:15.394539+0000","last_active":"2024-09-12T01:33:16.778711+0000","last_peered":"2024-09-12T01:33:16.778711+0000","last_clean":"2024-09-12T01:33:16.778711+0000","last_became_active":"2024-09-12T01:04:15.393021+0000","last_became_peered":"2024-09-12T01:04:15.393021+0000","last_unstale":"2024-09-12T01:33:16.778711+0000","last_undegraded":"2024-09-12T01:33:16.778711+0000","last_fullsized":"2024-09-12T01:33:16.778711+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:47.214589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"260'8","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:26.945799+0000","last_change":"2024-09-12T00:46:26.371696+0000","last_active":"2024-09-12T01:35:26.945799+0000","last_peered":"2024-09-12T01:35:26.945799+0000","last_clean":"2024-09-12T01:35:26.945799+0000","last_became_active":"2024-09-12T00:46:26.371443+0000","last_became_peered":"2024-09-12T00:46:26.371443+0000","last_unstale":"2024-09-12T01:35:26.945799+0000","last_undegraded":"2024-09-12T01:35:26.945799+0000","last_fullsized":"2024-09-12T01:35:26.945799+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:26.396539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":26626,"num_write":8,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:24.648070+0000","last_change":"2024-09-12T00:46:22.352325+0000","last_active":"2024-09-12T01:35:24.648070+0000","last_peered":"2024-09-12T01:35:24.648070+0000","last_clean":"2024-09-12T01:35:24.648070+0000","last_became_active":"2024-09-12T00:46:22.350714+0000","last_became_peered":"2024-09-12T00:46:22.350714+0000","last_unstale":"2024-09-12T01:35:24.648070+0000","last_undegraded":"2024-09-12T01:35:24.648070+0000","last_fullsized":"2024-09-12T01:35:24.648070+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:40.578771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"263'52","reported_seq":201,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.783741+0000","last_change":"2024-09-12T00:42:36.818076+0000","last_active":"2024-09-12T01:33:56.783741+0000","last_peered":"2024-09-12T01:33:56.783741+0000","last_clean":"2024-09-12T01:33:56.783741+0000","last_became_active":"2024-09-12T00:42:36.817763+0000","last_became_peered":"2024-09-12T00:42:36.817763+0000","last_unstale":"2024-09-12T01:33:56.783741+0000","last_undegraded":"2024-09-12T01:33:56.783741+0000","last_fullsized":"2024-09-12T01:33:56.783741+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:56.184689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":268,"num_read_kb":195,"num_write":87,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.788740+0000","last_change":"2024-09-12T01:04:15.397100+0000","last_active":"2024-09-12T01:34:36.788740+0000","last_peered":"2024-09-12T01:34:36.788740+0000","last_clean":"2024-09-12T01:34:36.788740+0000","last_became_active":"2024-09-12T01:04:15.396832+0000","last_became_peered":"2024-09-12T01:04:15.396832+0000","last_unstale":"2024-09-12T01:34:36.788740+0000","last_undegraded":"2024-09-12T01:34:36.788740+0000","last_fullsized":"2024-09-12T01:34:36.788740+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:22.398122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:29.648642+0000","last_change":"2024-09-12T00:46:26.373712+0000","last_active":"2024-09-12T01:35:29.648642+0000","last_peered":"2024-09-12T01:35:29.648642+0000","last_clean":"2024-09-12T01:35:29.648642+0000","last_became_active":"2024-09-12T00:46:26.373401+0000","last_became_peered":"2024-09-12T00:46:26.373401+0000","last_unstale":"2024-09-12T01:35:29.648642+0000","last_undegraded":"2024-09-12T01:35:29.648642+0000","last_fullsized":"2024-09-12T01:35:29.648642+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:11.356426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:21.546124+0000","last_change":"2024-09-12T00:46:22.348093+0000","last_active":"2024-09-12T01:35:21.546124+0000","last_peered":"2024-09-12T01:35:21.546124+0000","last_clean":"2024-09-12T01:35:21.546124+0000","last_became_active":"2024-09-12T00:46:22.347794+0000","last_became_peered":"2024-09-12T00:46:22.347794+0000","last_unstale":"2024-09-12T01:35:21.546124+0000","last_undegraded":"2024-09-12T01:35:21.546124+0000","last_fullsized":"2024-09-12T01:35:21.546124+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:37.768628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'10","reported_seq":83,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.534383+0000","last_change":"2024-09-12T00:42:36.802979+0000","last_active":"2024-09-12T01:33:56.534383+0000","last_peered":"2024-09-12T01:33:56.534383+0000","last_clean":"2024-09-12T01:33:56.534383+0000","last_became_active":"2024-09-12T00:42:36.802647+0000","last_became_peered":"2024-09-12T00:42:36.802647+0000","last_unstale":"2024-09-12T01:33:56.534383+0000","last_undegraded":"2024-09-12T01:33:56.534383+0000","last_fullsized":"2024-09-12T01:33:56.534383+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:38.850484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":30,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:14.632767+0000","last_change":"2024-09-12T01:04:15.397994+0000","last_active":"2024-09-12T01:33:14.632767+0000","last_peered":"2024-09-12T01:33:14.632767+0000","last_clean":"2024-09-12T01:33:14.632767+0000","last_became_active":"2024-09-12T01:04:15.397646+0000","last_became_peered":"2024-09-12T01:04:15.397646+0000","last_unstale":"2024-09-12T01:33:14.632767+0000","last_undegraded":"2024-09-12T01:33:14.632767+0000","last_fullsized":"2024-09-12T01:33:14.632767+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:13.049264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"263'3","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.567221+0000","last_change":"2024-09-12T00:46:26.373701+0000","last_active":"2024-09-12T01:37:46.567221+0000","last_peered":"2024-09-12T01:37:46.567221+0000","last_clean":"2024-09-12T01:37:46.567221+0000","last_became_active":"2024-09-12T00:46:26.373354+0000","last_became_peered":"2024-09-12T00:46:26.373354+0000","last_unstale":"2024-09-12T01:37:46.567221+0000","last_undegraded":"2024-09-12T01:37:46.567221+0000","last_fullsized":"2024-09-12T01:37:46.567221+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:00.128990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:22.792606+0000","last_change":"2024-09-12T00:46:22.349188+0000","last_active":"2024-09-12T01:35:22.792606+0000","last_peered":"2024-09-12T01:35:22.792606+0000","last_clean":"2024-09-12T01:35:22.792606+0000","last_became_active":"2024-09-12T00:46:22.348875+0000","last_became_peered":"2024-09-12T00:46:22.348875+0000","last_unstale":"2024-09-12T01:35:22.792606+0000","last_undegraded":"2024-09-12T01:35:22.792606+0000","last_fullsized":"2024-09-12T01:35:22.792606+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:31.550301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"263'37","reported_seq":164,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:59.638083+0000","last_change":"2024-09-12T00:42:36.814630+0000","last_active":"2024-09-12T01:33:59.638083+0000","last_peered":"2024-09-12T01:33:59.638083+0000","last_clean":"2024-09-12T01:33:59.638083+0000","last_became_active":"2024-09-12T00:42:36.814235+0000","last_became_peered":"2024-09-12T00:42:36.814235+0000","last_unstale":"2024-09-12T01:33:59.638083+0000","last_undegraded":"2024-09-12T01:33:59.638083+0000","last_fullsized":"2024-09-12T01:33:59.638083+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:12.766338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":201,"num_read_kb":139,"num_write":71,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:51.532638+0000","last_change":"2024-09-12T01:04:15.396161+0000","last_active":"2024-09-12T01:34:51.532638+0000","last_peered":"2024-09-12T01:34:51.532638+0000","last_clean":"2024-09-12T01:34:51.532638+0000","last_became_active":"2024-09-12T01:04:15.395860+0000","last_became_peered":"2024-09-12T01:04:15.395860+0000","last_unstale":"2024-09-12T01:34:51.532638+0000","last_undegraded":"2024-09-12T01:34:51.532638+0000","last_fullsized":"2024-09-12T01:34:51.532638+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:49.503666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:44.636344+0000","last_change":"2024-09-12T00:46:26.373083+0000","last_active":"2024-09-12T01:33:44.636344+0000","last_peered":"2024-09-12T01:33:44.636344+0000","last_clean":"2024-09-12T01:33:44.636344+0000","last_became_active":"2024-09-12T00:46:26.372803+0000","last_became_peered":"2024-09-12T00:46:26.372803+0000","last_unstale":"2024-09-12T01:33:44.636344+0000","last_undegraded":"2024-09-12T01:33:44.636344+0000","last_fullsized":"2024-09-12T01:33:44.636344+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:18.884189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"263'9","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.567429+0000","last_change":"2024-09-12T00:46:22.356200+0000","last_active":"2024-09-12T01:38:00.567429+0000","last_peered":"2024-09-12T01:38:00.567429+0000","last_clean":"2024-09-12T01:38:00.567429+0000","last_became_active":"2024-09-12T00:46:22.355962+0000","last_became_peered":"2024-09-12T00:46:22.355962+0000","last_unstale":"2024-09-12T01:38:00.567429+0000","last_undegraded":"2024-09-12T01:38:00.567429+0000","last_fullsized":"2024-09-12T01:38:00.567429+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:15:50.421437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5707,"num_write":14,"num_write_kb":4683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"263'12","reported_seq":90,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:39.642863+0000","last_change":"2024-09-12T00:42:36.817087+0000","last_active":"2024-09-12T01:34:39.642863+0000","last_peered":"2024-09-12T01:34:39.642863+0000","last_clean":"2024-09-12T01:34:39.642863+0000","last_became_active":"2024-09-12T00:42:36.816673+0000","last_became_peered":"2024-09-12T00:42:36.816673+0000","last_unstale":"2024-09-12T01:34:39.642863+0000","last_undegraded":"2024-09-12T01:34:39.642863+0000","last_fullsized":"2024-09-12T01:34:39.642863+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:44.855498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":40,"num_write":24,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.736023+0000","last_change":"2024-09-12T01:04:15.393891+0000","last_active":"2024-09-12T01:35:46.736023+0000","last_peered":"2024-09-12T01:35:46.736023+0000","last_clean":"2024-09-12T01:35:46.736023+0000","last_became_active":"2024-09-12T01:04:15.393597+0000","last_became_peered":"2024-09-12T01:04:15.393597+0000","last_unstale":"2024-09-12T01:35:46.736023+0000","last_undegraded":"2024-09-12T01:35:46.736023+0000","last_fullsized":"2024-09-12T01:35:46.736023+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:33.585796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:44.636315+0000","last_change":"2024-09-12T00:46:26.366156+0000","last_active":"2024-09-12T01:33:44.636315+0000","last_peered":"2024-09-12T01:33:44.636315+0000","last_clean":"2024-09-12T01:33:44.636315+0000","last_became_active":"2024-09-12T00:46:26.365848+0000","last_became_peered":"2024-09-12T00:46:26.365848+0000","last_unstale":"2024-09-12T01:33:44.636315+0000","last_undegraded":"2024-09-12T01:33:44.636315+0000","last_fullsized":"2024-09-12T01:33:44.636315+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:48.611575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"263'3","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:51.539246+0000","last_change":"2024-09-12T00:46:22.351422+0000","last_active":"2024-09-12T01:35:51.539246+0000","last_peered":"2024-09-12T01:35:51.539246+0000","last_clean":"2024-09-12T01:35:51.539246+0000","last_became_active":"2024-09-12T00:46:22.350815+0000","last_became_peered":"2024-09-12T00:46:22.350815+0000","last_unstale":"2024-09-12T01:35:51.539246+0000","last_undegraded":"2024-09-12T01:35:51.539246+0000","last_fullsized":"2024-09-12T01:35:51.539246+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:04.321097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"263'49","reported_seq":188,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:22.784293+0000","last_change":"2024-09-12T00:42:36.811488+0000","last_active":"2024-09-12T01:34:22.784293+0000","last_peered":"2024-09-12T01:34:22.784293+0000","last_clean":"2024-09-12T01:34:22.784293+0000","last_became_active":"2024-09-12T00:42:36.810754+0000","last_became_peered":"2024-09-12T00:42:36.810754+0000","last_unstale":"2024-09-12T01:34:22.784293+0000","last_undegraded":"2024-09-12T01:34:22.784293+0000","last_fullsized":"2024-09-12T01:34:22.784293+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:12.064178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":240,"num_read_kb":165,"num_write":91,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.539582+0000","last_change":"2024-09-12T01:04:15.397399+0000","last_active":"2024-09-12T01:34:36.539582+0000","last_peered":"2024-09-12T01:34:36.539582+0000","last_clean":"2024-09-12T01:34:36.539582+0000","last_became_active":"2024-09-12T01:04:15.396999+0000","last_became_peered":"2024-09-12T01:04:15.396999+0000","last_unstale":"2024-09-12T01:34:36.539582+0000","last_undegraded":"2024-09-12T01:34:36.539582+0000","last_fullsized":"2024-09-12T01:34:36.539582+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:43.411584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:46.932525+0000","last_change":"2024-09-12T00:46:26.563322+0000","last_active":"2024-09-12T01:33:46.932525+0000","last_peered":"2024-09-12T01:33:46.932525+0000","last_clean":"2024-09-12T01:33:46.932525+0000","last_became_active":"2024-09-12T00:46:26.563041+0000","last_became_peered":"2024-09-12T00:46:26.563041+0000","last_unstale":"2024-09-12T01:33:46.932525+0000","last_undegraded":"2024-09-12T01:33:46.932525+0000","last_fullsized":"2024-09-12T01:33:46.932525+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:42.189294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:36.781253+0000","last_change":"2024-09-12T00:46:22.353183+0000","last_active":"2024-09-12T01:33:36.781253+0000","last_peered":"2024-09-12T01:33:36.781253+0000","last_clean":"2024-09-12T01:33:36.781253+0000","last_became_active":"2024-09-12T00:46:22.352933+0000","last_became_peered":"2024-09-12T00:46:22.352933+0000","last_unstale":"2024-09-12T01:33:36.781253+0000","last_undegraded":"2024-09-12T01:33:36.781253+0000","last_fullsized":"2024-09-12T01:33:36.781253+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:32.297784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"263'30","reported_seq":143,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:21.537673+0000","last_change":"2024-09-12T00:42:36.817007+0000","last_active":"2024-09-12T01:34:21.537673+0000","last_peered":"2024-09-12T01:34:21.537673+0000","last_clean":"2024-09-12T01:34:21.537673+0000","last_became_active":"2024-09-12T00:42:36.816619+0000","last_became_peered":"2024-09-12T00:42:36.816619+0000","last_unstale":"2024-09-12T01:34:21.537673+0000","last_undegraded":"2024-09-12T01:34:21.537673+0000","last_fullsized":"2024-09-12T01:34:21.537673+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:41.160245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":113,"num_write":55,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.724886+0000","last_change":"2024-09-12T01:04:15.396475+0000","last_active":"2024-09-12T01:34:36.724886+0000","last_peered":"2024-09-12T01:34:36.724886+0000","last_clean":"2024-09-12T01:34:36.724886+0000","last_became_active":"2024-09-12T01:04:15.396125+0000","last_became_peered":"2024-09-12T01:04:15.396125+0000","last_unstale":"2024-09-12T01:34:36.724886+0000","last_undegraded":"2024-09-12T01:34:36.724886+0000","last_fullsized":"2024-09-12T01:34:36.724886+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:47.673931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:44.636360+0000","last_change":"2024-09-12T00:46:26.366690+0000","last_active":"2024-09-12T01:33:44.636360+0000","last_peered":"2024-09-12T01:33:44.636360+0000","last_clean":"2024-09-12T01:33:44.636360+0000","last_became_active":"2024-09-12T00:46:26.366293+0000","last_became_peered":"2024-09-12T00:46:26.366293+0000","last_unstale":"2024-09-12T01:33:44.636360+0000","last_undegraded":"2024-09-12T01:33:44.636360+0000","last_fullsized":"2024-09-12T01:33:44.636360+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:56.900344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"263'3","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:56.949080+0000","last_change":"2024-09-12T00:46:22.348841+0000","last_active":"2024-09-12T01:35:56.949080+0000","last_peered":"2024-09-12T01:35:56.949080+0000","last_clean":"2024-09-12T01:35:56.949080+0000","last_became_active":"2024-09-12T00:46:22.348546+0000","last_became_peered":"2024-09-12T00:46:22.348546+0000","last_unstale":"2024-09-12T01:35:56.949080+0000","last_undegraded":"2024-09-12T01:35:56.949080+0000","last_fullsized":"2024-09-12T01:35:56.949080+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:40.207770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"263'34","reported_seq":149,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:21.630269+0000","last_change":"2024-09-12T00:42:36.817828+0000","last_active":"2024-09-12T01:34:21.630269+0000","last_peered":"2024-09-12T01:34:21.630269+0000","last_clean":"2024-09-12T01:34:21.630269+0000","last_became_active":"2024-09-12T00:42:36.817530+0000","last_became_peered":"2024-09-12T00:42:36.817530+0000","last_unstale":"2024-09-12T01:34:21.630269+0000","last_undegraded":"2024-09-12T01:34:21.630269+0000","last_fullsized":"2024-09-12T01:34:21.630269+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:04.364763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":117,"num_write":66,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:44.650432+0000","last_change":"2024-09-12T01:04:15.399818+0000","last_active":"2024-09-12T01:35:44.650432+0000","last_peered":"2024-09-12T01:35:44.650432+0000","last_clean":"2024-09-12T01:35:44.650432+0000","last_became_active":"2024-09-12T01:04:15.399564+0000","last_became_peered":"2024-09-12T01:04:15.399564+0000","last_unstale":"2024-09-12T01:35:44.650432+0000","last_undegraded":"2024-09-12T01:35:44.650432+0000","last_fullsized":"2024-09-12T01:35:44.650432+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:02.148148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"263'7","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:16.554428+0000","last_change":"2024-09-12T00:46:26.374247+0000","last_active":"2024-09-12T01:36:16.554428+0000","last_peered":"2024-09-12T01:36:16.554428+0000","last_clean":"2024-09-12T01:36:16.554428+0000","last_became_active":"2024-09-12T00:46:26.373942+0000","last_became_peered":"2024-09-12T00:46:26.373942+0000","last_unstale":"2024-09-12T01:36:16.554428+0000","last_undegraded":"2024-09-12T01:36:16.554428+0000","last_fullsized":"2024-09-12T01:36:16.554428+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:35.593349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8208,"num_write":12,"num_write_kb":8208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:01.784297+0000","last_change":"2024-09-12T00:46:22.352449+0000","last_active":"2024-09-12T01:34:01.784297+0000","last_peered":"2024-09-12T01:34:01.784297+0000","last_clean":"2024-09-12T01:34:01.784297+0000","last_became_active":"2024-09-12T00:46:22.352156+0000","last_became_peered":"2024-09-12T00:46:22.352156+0000","last_unstale":"2024-09-12T01:34:01.784297+0000","last_undegraded":"2024-09-12T01:34:01.784297+0000","last_fullsized":"2024-09-12T01:34:01.784297+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:05.797995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"263'10","reported_seq":83,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:21.786707+0000","last_change":"2024-09-12T00:42:36.817431+0000","last_active":"2024-09-12T01:34:21.786707+0000","last_peered":"2024-09-12T01:34:21.786707+0000","last_clean":"2024-09-12T01:34:21.786707+0000","last_became_active":"2024-09-12T00:42:36.817021+0000","last_became_peered":"2024-09-12T00:42:36.817021+0000","last_unstale":"2024-09-12T01:34:21.786707+0000","last_undegraded":"2024-09-12T01:34:21.786707+0000","last_fullsized":"2024-09-12T01:34:21.786707+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:32.868292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:41.716228+0000","last_change":"2024-09-12T01:04:15.396406+0000","last_active":"2024-09-12T01:33:41.716228+0000","last_peered":"2024-09-12T01:33:41.716228+0000","last_clean":"2024-09-12T01:33:41.716228+0000","last_became_active":"2024-09-12T01:04:15.396096+0000","last_became_peered":"2024-09-12T01:04:15.396096+0000","last_unstale":"2024-09-12T01:33:41.716228+0000","last_undegraded":"2024-09-12T01:33:41.716228+0000","last_fullsized":"2024-09-12T01:33:41.716228+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:42.402476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"260'5","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:06.720106+0000","last_change":"2024-09-12T00:46:26.562285+0000","last_active":"2024-09-12T01:34:06.720106+0000","last_peered":"2024-09-12T01:34:06.720106+0000","last_clean":"2024-09-12T01:34:06.720106+0000","last_became_active":"2024-09-12T00:46:26.561924+0000","last_became_peered":"2024-09-12T00:46:26.561924+0000","last_unstale":"2024-09-12T01:34:06.720106+0000","last_undegraded":"2024-09-12T01:34:06.720106+0000","last_fullsized":"2024-09-12T01:34:06.720106+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:06.317073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:01.934433+0000","last_change":"2024-09-12T00:46:22.350102+0000","last_active":"2024-09-12T01:34:01.934433+0000","last_peered":"2024-09-12T01:34:01.934433+0000","last_clean":"2024-09-12T01:34:01.934433+0000","last_became_active":"2024-09-12T00:46:22.349376+0000","last_became_peered":"2024-09-12T00:46:22.349376+0000","last_unstale":"2024-09-12T01:34:01.934433+0000","last_undegraded":"2024-09-12T01:34:01.934433+0000","last_fullsized":"2024-09-12T01:34:01.934433+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:38.382481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"263'30","reported_seq":144,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:51.727585+0000","last_change":"2024-09-12T00:42:36.810100+0000","last_active":"2024-09-12T01:34:51.727585+0000","last_peered":"2024-09-12T01:34:51.727585+0000","last_clean":"2024-09-12T01:34:51.727585+0000","last_became_active":"2024-09-12T00:42:36.809602+0000","last_became_peered":"2024-09-12T00:42:36.809602+0000","last_unstale":"2024-09-12T01:34:51.727585+0000","last_undegraded":"2024-09-12T01:34:51.727585+0000","last_fullsized":"2024-09-12T01:34:51.727585+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:44.821006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":112,"num_write":54,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"263'1","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.736044+0000","last_change":"2024-09-12T01:04:15.393241+0000","last_active":"2024-09-12T01:35:46.736044+0000","last_peered":"2024-09-12T01:35:46.736044+0000","last_clean":"2024-09-12T01:35:46.736044+0000","last_became_active":"2024-09-12T01:04:15.392789+0000","last_became_peered":"2024-09-12T01:04:15.392789+0000","last_unstale":"2024-09-12T01:35:46.736044+0000","last_undegraded":"2024-09-12T01:35:46.736044+0000","last_fullsized":"2024-09-12T01:35:46.736044+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:06.945446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"260'5","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:41.931667+0000","last_change":"2024-09-12T00:46:26.370237+0000","last_active":"2024-09-12T01:33:41.931667+0000","last_peered":"2024-09-12T01:33:41.931667+0000","last_clean":"2024-09-12T01:33:41.931667+0000","last_became_active":"2024-09-12T00:46:26.369883+0000","last_became_peered":"2024-09-12T00:46:26.369883+0000","last_unstale":"2024-09-12T01:33:41.931667+0000","last_undegraded":"2024-09-12T01:33:41.931667+0000","last_fullsized":"2024-09-12T01:33:41.931667+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:01.571704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:06.784985+0000","last_change":"2024-09-12T00:46:22.348999+0000","last_active":"2024-09-12T01:34:06.784985+0000","last_peered":"2024-09-12T01:34:06.784985+0000","last_clean":"2024-09-12T01:34:06.784985+0000","last_became_active":"2024-09-12T00:46:22.348568+0000","last_became_peered":"2024-09-12T00:46:22.348568+0000","last_unstale":"2024-09-12T01:34:06.784985+0000","last_undegraded":"2024-09-12T01:34:06.784985+0000","last_fullsized":"2024-09-12T01:34:06.784985+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:24.267629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"263'9","reported_seq":84,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:39.642740+0000","last_change":"2024-09-12T00:42:36.814268+0000","last_active":"2024-09-12T01:34:39.642740+0000","last_peered":"2024-09-12T01:34:39.642740+0000","last_clean":"2024-09-12T01:34:39.642740+0000","last_became_active":"2024-09-12T00:42:36.813997+0000","last_became_peered":"2024-09-12T00:42:36.813997+0000","last_unstale":"2024-09-12T01:34:39.642740+0000","last_undegraded":"2024-09-12T01:34:39.642740+0000","last_fullsized":"2024-09-12T01:34:39.642740+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:34.191233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.797023+0000","last_change":"2024-09-12T01:04:15.393511+0000","last_active":"2024-09-12T01:35:46.797023+0000","last_peered":"2024-09-12T01:35:46.797023+0000","last_clean":"2024-09-12T01:35:46.797023+0000","last_became_active":"2024-09-12T01:04:15.393220+0000","last_became_peered":"2024-09-12T01:04:15.393220+0000","last_unstale":"2024-09-12T01:35:46.797023+0000","last_undegraded":"2024-09-12T01:35:46.797023+0000","last_fullsized":"2024-09-12T01:35:46.797023+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:27.528771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"263'2","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:26.741954+0000","last_change":"2024-09-12T00:46:26.370629+0000","last_active":"2024-09-12T01:36:26.741954+0000","last_peered":"2024-09-12T01:36:26.741954+0000","last_clean":"2024-09-12T01:36:26.741954+0000","last_became_active":"2024-09-12T00:46:26.370349+0000","last_became_peered":"2024-09-12T00:46:26.370349+0000","last_unstale":"2024-09-12T01:36:26.741954+0000","last_undegraded":"2024-09-12T01:36:26.741954+0000","last_fullsized":"2024-09-12T01:36:26.741954+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:26.584727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"263'11","reported_seq":76,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.830190+0000","last_change":"2024-09-12T00:46:22.346319+0000","last_active":"2024-09-12T01:38:00.830190+0000","last_peered":"2024-09-12T01:38:00.830190+0000","last_clean":"2024-09-12T01:38:00.830190+0000","last_became_active":"2024-09-12T00:46:22.346024+0000","last_became_peered":"2024-09-12T00:46:22.346024+0000","last_unstale":"2024-09-12T01:38:00.830190+0000","last_undegraded":"2024-09-12T01:38:00.830190+0000","last_fullsized":"2024-09-12T01:38:00.830190+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:06.683878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":32770,"num_write":16,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"263'38","reported_seq":159,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.539545+0000","last_change":"2024-09-12T00:42:36.809663+0000","last_active":"2024-09-12T01:34:36.539545+0000","last_peered":"2024-09-12T01:34:36.539545+0000","last_clean":"2024-09-12T01:34:36.539545+0000","last_became_active":"2024-09-12T00:42:36.809350+0000","last_became_peered":"2024-09-12T00:42:36.809350+0000","last_unstale":"2024-09-12T01:34:36.539545+0000","last_undegraded":"2024-09-12T01:34:36.539545+0000","last_fullsized":"2024-09-12T01:34:36.539545+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:37.120320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":127,"num_write":71,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:31.733691+0000","last_change":"2024-09-12T01:04:15.395069+0000","last_active":"2024-09-12T01:35:31.733691+0000","last_peered":"2024-09-12T01:35:31.733691+0000","last_clean":"2024-09-12T01:35:31.733691+0000","last_became_active":"2024-09-12T01:04:15.394795+0000","last_became_peered":"2024-09-12T01:04:15.394795+0000","last_unstale":"2024-09-12T01:35:31.733691+0000","last_undegraded":"2024-09-12T01:35:31.733691+0000","last_fullsized":"2024-09-12T01:35:31.733691+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:28.070748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"263'2","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:31.802388+0000","last_change":"2024-09-12T00:46:26.368134+0000","last_active":"2024-09-12T01:36:31.802388+0000","last_peered":"2024-09-12T01:36:31.802388+0000","last_clean":"2024-09-12T01:36:31.802388+0000","last_became_active":"2024-09-12T00:46:26.367852+0000","last_became_peered":"2024-09-12T00:46:26.367852+0000","last_unstale":"2024-09-12T01:36:31.802388+0000","last_undegraded":"2024-09-12T01:36:31.802388+0000","last_fullsized":"2024-09-12T01:36:31.802388+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:38.753123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1142,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"260'3","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:16.721849+0000","last_change":"2024-09-12T00:46:22.351593+0000","last_active":"2024-09-12T01:34:16.721849+0000","last_peered":"2024-09-12T01:34:16.721849+0000","last_clean":"2024-09-12T01:34:16.721849+0000","last_became_active":"2024-09-12T00:46:22.351237+0000","last_became_peered":"2024-09-12T00:46:22.351237+0000","last_unstale":"2024-09-12T01:34:16.721849+0000","last_undegraded":"2024-09-12T01:34:16.721849+0000","last_fullsized":"2024-09-12T01:34:16.721849+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:04.853460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'36","reported_seq":159,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.788869+0000","last_change":"2024-09-12T00:42:36.819102+0000","last_active":"2024-09-12T01:34:36.788869+0000","last_peered":"2024-09-12T01:34:36.788869+0000","last_clean":"2024-09-12T01:34:36.788869+0000","last_became_active":"2024-09-12T00:42:36.818852+0000","last_became_peered":"2024-09-12T00:42:36.818852+0000","last_unstale":"2024-09-12T01:34:36.788869+0000","last_undegraded":"2024-09-12T01:34:36.788869+0000","last_fullsized":"2024-09-12T01:34:36.788869+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:23.943088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":132,"num_write":65,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:32.794132+0000","last_change":"2024-09-12T01:04:15.393939+0000","last_active":"2024-09-12T01:35:32.794132+0000","last_peered":"2024-09-12T01:35:32.794132+0000","last_clean":"2024-09-12T01:35:32.794132+0000","last_became_active":"2024-09-12T01:04:15.393651+0000","last_became_peered":"2024-09-12T01:04:15.393651+0000","last_unstale":"2024-09-12T01:35:32.794132+0000","last_undegraded":"2024-09-12T01:35:32.794132+0000","last_fullsized":"2024-09-12T01:35:32.794132+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:16.671263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"263'5","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:26.801703+0000","last_change":"2024-09-12T00:46:26.563573+0000","last_active":"2024-09-12T01:36:26.801703+0000","last_peered":"2024-09-12T01:36:26.801703+0000","last_clean":"2024-09-12T01:36:26.801703+0000","last_became_active":"2024-09-12T00:46:26.563277+0000","last_became_peered":"2024-09-12T00:46:26.563277+0000","last_unstale":"2024-09-12T01:36:26.801703+0000","last_undegraded":"2024-09-12T01:36:26.801703+0000","last_fullsized":"2024-09-12T01:36:26.801703+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:09.897827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":7168,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:31.631288+0000","last_change":"2024-09-12T00:46:22.351630+0000","last_active":"2024-09-12T01:34:31.631288+0000","last_peered":"2024-09-12T01:34:31.631288+0000","last_clean":"2024-09-12T01:34:31.631288+0000","last_became_active":"2024-09-12T00:46:22.351162+0000","last_became_peered":"2024-09-12T00:46:22.351162+0000","last_unstale":"2024-09-12T01:34:31.631288+0000","last_undegraded":"2024-09-12T01:34:31.631288+0000","last_fullsized":"2024-09-12T01:34:31.631288+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:07.137302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"263'20","reported_seq":113,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.539639+0000","last_change":"2024-09-12T00:42:36.815139+0000","last_active":"2024-09-12T01:34:36.539639+0000","last_peered":"2024-09-12T01:34:36.539639+0000","last_clean":"2024-09-12T01:34:36.539639+0000","last_became_active":"2024-09-12T00:42:36.814845+0000","last_became_peered":"2024-09-12T00:42:36.814845+0000","last_unstale":"2024-09-12T01:34:36.539639+0000","last_undegraded":"2024-09-12T01:34:36.539639+0000","last_fullsized":"2024-09-12T01:34:36.539639+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:26.879251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":75,"num_write":35,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:16.936450+0000","last_change":"2024-09-12T01:04:15.388704+0000","last_active":"2024-09-12T01:34:16.936450+0000","last_peered":"2024-09-12T01:34:16.936450+0000","last_clean":"2024-09-12T01:34:16.936450+0000","last_became_active":"2024-09-12T01:04:15.388423+0000","last_became_peered":"2024-09-12T01:04:15.388423+0000","last_unstale":"2024-09-12T01:34:16.936450+0000","last_undegraded":"2024-09-12T01:34:16.936450+0000","last_fullsized":"2024-09-12T01:34:16.936450+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:13.488601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:06.720233+0000","last_change":"2024-09-12T00:46:26.565006+0000","last_active":"2024-09-12T01:34:06.720233+0000","last_peered":"2024-09-12T01:34:06.720233+0000","last_clean":"2024-09-12T01:34:06.720233+0000","last_became_active":"2024-09-12T00:46:26.564771+0000","last_became_peered":"2024-09-12T00:46:26.564771+0000","last_unstale":"2024-09-12T01:34:06.720233+0000","last_undegraded":"2024-09-12T01:34:06.720233+0000","last_fullsized":"2024-09-12T01:34:06.720233+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:24.506289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"260'3","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:57.780660+0000","last_change":"2024-09-12T00:46:22.350365+0000","last_active":"2024-09-12T01:33:57.780660+0000","last_peered":"2024-09-12T01:33:57.780660+0000","last_clean":"2024-09-12T01:33:57.780660+0000","last_became_active":"2024-09-12T00:46:22.350045+0000","last_became_peered":"2024-09-12T00:46:22.350045+0000","last_unstale":"2024-09-12T01:33:57.780660+0000","last_undegraded":"2024-09-12T01:33:57.780660+0000","last_fullsized":"2024-09-12T01:33:57.780660+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:09.828897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"263'41","reported_seq":169,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:56.728429+0000","last_change":"2024-09-12T00:42:36.814530+0000","last_active":"2024-09-12T01:34:56.728429+0000","last_peered":"2024-09-12T01:34:56.728429+0000","last_clean":"2024-09-12T01:34:56.728429+0000","last_became_active":"2024-09-12T00:42:36.814228+0000","last_became_peered":"2024-09-12T00:42:36.814228+0000","last_unstale":"2024-09-12T01:34:56.728429+0000","last_undegraded":"2024-09-12T01:34:56.728429+0000","last_fullsized":"2024-09-12T01:34:56.728429+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:19.454136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":139,"num_write":79,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:31.547532+0000","last_change":"2024-09-12T01:04:15.388771+0000","last_active":"2024-09-12T01:35:31.547532+0000","last_peered":"2024-09-12T01:35:31.547532+0000","last_clean":"2024-09-12T01:35:31.547532+0000","last_became_active":"2024-09-12T01:04:15.388492+0000","last_became_peered":"2024-09-12T01:04:15.388492+0000","last_unstale":"2024-09-12T01:35:31.547532+0000","last_undegraded":"2024-09-12T01:35:31.547532+0000","last_fullsized":"2024-09-12T01:35:31.547532+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:40.040155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:06.535900+0000","last_change":"2024-09-12T00:46:26.369312+0000","last_active":"2024-09-12T01:34:06.535900+0000","last_peered":"2024-09-12T01:34:06.535900+0000","last_clean":"2024-09-12T01:34:06.535900+0000","last_became_active":"2024-09-12T00:46:26.369004+0000","last_became_peered":"2024-09-12T00:46:26.369004+0000","last_unstale":"2024-09-12T01:34:06.535900+0000","last_undegraded":"2024-09-12T01:34:06.535900+0000","last_fullsized":"2024-09-12T01:34:06.535900+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:24.565234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:01.719448+0000","last_change":"2024-09-12T00:46:22.354042+0000","last_active":"2024-09-12T01:34:01.719448+0000","last_peered":"2024-09-12T01:34:01.719448+0000","last_clean":"2024-09-12T01:34:01.719448+0000","last_became_active":"2024-09-12T00:46:22.353747+0000","last_became_peered":"2024-09-12T00:46:22.353747+0000","last_unstale":"2024-09-12T01:34:01.719448+0000","last_undegraded":"2024-09-12T01:34:01.719448+0000","last_fullsized":"2024-09-12T01:34:01.719448+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:40.026238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"263'8","reported_seq":80,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:41.940572+0000","last_change":"2024-09-12T00:42:36.809380+0000","last_active":"2024-09-12T01:34:41.940572+0000","last_peered":"2024-09-12T01:34:41.940572+0000","last_clean":"2024-09-12T01:34:41.940572+0000","last_became_active":"2024-09-12T00:42:36.808945+0000","last_became_peered":"2024-09-12T00:42:36.808945+0000","last_unstale":"2024-09-12T01:34:41.940572+0000","last_undegraded":"2024-09-12T01:34:41.940572+0000","last_fullsized":"2024-09-12T01:34:41.940572+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:08.194856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":23,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"262'1","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.531103+0000","last_change":"2024-09-12T01:04:15.395533+0000","last_active":"2024-09-12T01:34:36.531103+0000","last_peered":"2024-09-12T01:34:36.531103+0000","last_clean":"2024-09-12T01:34:36.531103+0000","last_became_active":"2024-09-12T01:04:15.395223+0000","last_became_peered":"2024-09-12T01:04:15.395223+0000","last_unstale":"2024-09-12T01:34:36.531103+0000","last_undegraded":"2024-09-12T01:34:36.531103+0000","last_fullsized":"2024-09-12T01:34:36.531103+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:54.625901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"260'2","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:21.937069+0000","last_change":"2024-09-12T00:46:26.367308+0000","last_active":"2024-09-12T01:34:21.937069+0000","last_peered":"2024-09-12T01:34:21.937069+0000","last_clean":"2024-09-12T01:34:21.937069+0000","last_became_active":"2024-09-12T00:46:26.367039+0000","last_became_peered":"2024-09-12T00:46:26.367039+0000","last_unstale":"2024-09-12T01:34:21.937069+0000","last_undegraded":"2024-09-12T01:34:21.937069+0000","last_fullsized":"2024-09-12T01:34:21.937069+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:30.091487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"263'2","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:31.742697+0000","last_change":"2024-09-12T00:46:22.350076+0000","last_active":"2024-09-12T01:36:31.742697+0000","last_peered":"2024-09-12T01:36:31.742697+0000","last_clean":"2024-09-12T01:36:31.742697+0000","last_became_active":"2024-09-12T00:46:22.349779+0000","last_became_peered":"2024-09-12T00:46:22.349779+0000","last_unstale":"2024-09-12T01:36:31.742697+0000","last_undegraded":"2024-09-12T01:36:31.742697+0000","last_fullsized":"2024-09-12T01:36:31.742697+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:41.826282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":5,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"263'23","reported_seq":123,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:42.787235+0000","last_change":"2024-09-12T00:42:36.811265+0000","last_active":"2024-09-12T01:34:42.787235+0000","last_peered":"2024-09-12T01:34:42.787235+0000","last_clean":"2024-09-12T01:34:42.787235+0000","last_became_active":"2024-09-12T00:42:36.810979+0000","last_became_peered":"2024-09-12T00:42:36.810979+0000","last_unstale":"2024-09-12T01:34:42.787235+0000","last_undegraded":"2024-09-12T01:34:42.787235+0000","last_fullsized":"2024-09-12T01:34:42.787235+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:56.532046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":82,"num_write":51,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.788829+0000","last_change":"2024-09-12T01:04:15.388624+0000","last_active":"2024-09-12T01:34:36.788829+0000","last_peered":"2024-09-12T01:34:36.788829+0000","last_clean":"2024-09-12T01:34:36.788829+0000","last_became_active":"2024-09-12T01:04:15.388331+0000","last_became_peered":"2024-09-12T01:04:15.388331+0000","last_unstale":"2024-09-12T01:34:36.788829+0000","last_undegraded":"2024-09-12T01:34:36.788829+0000","last_fullsized":"2024-09-12T01:34:36.788829+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:07.975645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"260'5","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:32.785494+0000","last_change":"2024-09-12T00:46:26.370948+0000","last_active":"2024-09-12T01:34:32.785494+0000","last_peered":"2024-09-12T01:34:32.785494+0000","last_clean":"2024-09-12T01:34:32.785494+0000","last_became_active":"2024-09-12T00:46:26.370448+0000","last_became_peered":"2024-09-12T00:46:26.370448+0000","last_unstale":"2024-09-12T01:34:32.785494+0000","last_undegraded":"2024-09-12T01:34:32.785494+0000","last_fullsized":"2024-09-12T01:34:32.785494+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:41.502037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"263'2","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:21.741202+0000","last_change":"2024-09-12T00:46:22.354072+0000","last_active":"2024-09-12T01:36:21.741202+0000","last_peered":"2024-09-12T01:36:21.741202+0000","last_clean":"2024-09-12T01:36:21.741202+0000","last_became_active":"2024-09-12T00:46:22.353796+0000","last_became_peered":"2024-09-12T00:46:22.353796+0000","last_unstale":"2024-09-12T01:36:21.741202+0000","last_undegraded":"2024-09-12T01:36:21.741202+0000","last_fullsized":"2024-09-12T01:36:21.741202+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:52.950825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"263'41","reported_seq":174,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:41.540574+0000","last_change":"2024-09-12T00:42:36.814983+0000","last_active":"2024-09-12T01:34:41.540574+0000","last_peered":"2024-09-12T01:34:41.540574+0000","last_clean":"2024-09-12T01:34:41.540574+0000","last_became_active":"2024-09-12T00:42:36.814700+0000","last_became_peered":"2024-09-12T00:42:36.814700+0000","last_unstale":"2024-09-12T01:34:41.540574+0000","last_undegraded":"2024-09-12T01:34:41.540574+0000","last_fullsized":"2024-09-12T01:34:41.540574+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:47.477989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":150,"num_write":75,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:31.795233+0000","last_change":"2024-09-12T01:04:15.393354+0000","last_active":"2024-09-12T01:35:31.795233+0000","last_peered":"2024-09-12T01:35:31.795233+0000","last_clean":"2024-09-12T01:35:31.795233+0000","last_became_active":"2024-09-12T01:04:15.392129+0000","last_became_peered":"2024-09-12T01:04:15.392129+0000","last_unstale":"2024-09-12T01:35:31.795233+0000","last_undegraded":"2024-09-12T01:35:31.795233+0000","last_fullsized":"2024-09-12T01:35:31.795233+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:07.333078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:21.537643+0000","last_change":"2024-09-12T00:46:26.374929+0000","last_active":"2024-09-12T01:34:21.537643+0000","last_peered":"2024-09-12T01:34:21.537643+0000","last_clean":"2024-09-12T01:34:21.537643+0000","last_became_active":"2024-09-12T00:46:26.374630+0000","last_became_peered":"2024-09-12T00:46:26.374630+0000","last_unstale":"2024-09-12T01:34:21.537643+0000","last_undegraded":"2024-09-12T01:34:21.537643+0000","last_fullsized":"2024-09-12T01:34:21.537643+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:40.273744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:16.936526+0000","last_change":"2024-09-12T00:46:22.345808+0000","last_active":"2024-09-12T01:34:16.936526+0000","last_peered":"2024-09-12T01:34:16.936526+0000","last_clean":"2024-09-12T01:34:16.936526+0000","last_became_active":"2024-09-12T00:46:22.345455+0000","last_became_peered":"2024-09-12T00:46:22.345455+0000","last_unstale":"2024-09-12T01:34:16.936526+0000","last_undegraded":"2024-09-12T01:34:16.936526+0000","last_fullsized":"2024-09-12T01:34:16.936526+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:43.503840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"263'47","reported_seq":185,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:41.540334+0000","last_change":"2024-09-12T00:42:36.810603+0000","last_active":"2024-09-12T01:34:41.540334+0000","last_peered":"2024-09-12T01:34:41.540334+0000","last_clean":"2024-09-12T01:34:41.540334+0000","last_became_active":"2024-09-12T00:42:36.810179+0000","last_became_peered":"2024-09-12T00:42:36.810179+0000","last_unstale":"2024-09-12T01:34:41.540334+0000","last_undegraded":"2024-09-12T01:34:41.540334+0000","last_fullsized":"2024-09-12T01:34:41.540334+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:20.658302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":235,"num_read_kb":167,"num_write":78,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:41.735210+0000","last_change":"2024-09-12T01:04:15.393713+0000","last_active":"2024-09-12T01:35:41.735210+0000","last_peered":"2024-09-12T01:35:41.735210+0000","last_clean":"2024-09-12T01:35:41.735210+0000","last_became_active":"2024-09-12T01:04:15.393424+0000","last_became_peered":"2024-09-12T01:04:15.393424+0000","last_unstale":"2024-09-12T01:35:41.735210+0000","last_undegraded":"2024-09-12T01:35:41.735210+0000","last_fullsized":"2024-09-12T01:35:41.735210+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:46.950196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"260'6","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:21.537798+0000","last_change":"2024-09-12T00:46:26.372459+0000","last_active":"2024-09-12T01:34:21.537798+0000","last_peered":"2024-09-12T01:34:21.537798+0000","last_clean":"2024-09-12T01:34:21.537798+0000","last_became_active":"2024-09-12T00:46:26.372169+0000","last_became_peered":"2024-09-12T00:46:26.372169+0000","last_unstale":"2024-09-12T01:34:21.537798+0000","last_undegraded":"2024-09-12T01:34:21.537798+0000","last_fullsized":"2024-09-12T01:34:21.537798+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:20.872522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"263'5","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:21.555122+0000","last_change":"2024-09-12T00:46:22.350497+0000","last_active":"2024-09-12T01:36:21.555122+0000","last_peered":"2024-09-12T01:36:21.555122+0000","last_clean":"2024-09-12T01:36:21.555122+0000","last_became_active":"2024-09-12T00:46:22.350210+0000","last_became_peered":"2024-09-12T00:46:22.350210+0000","last_unstale":"2024-09-12T01:36:21.555122+0000","last_undegraded":"2024-09-12T01:36:21.555122+0000","last_fullsized":"2024-09-12T01:36:21.555122+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:30.513705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4096,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"260'15","reported_seq":102,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:51.727537+0000","last_change":"2024-09-12T00:42:36.810443+0000","last_active":"2024-09-12T01:34:51.727537+0000","last_peered":"2024-09-12T01:34:51.727537+0000","last_clean":"2024-09-12T01:34:51.727537+0000","last_became_active":"2024-09-12T00:42:36.810110+0000","last_became_peered":"2024-09-12T00:42:36.810110+0000","last_unstale":"2024-09-12T01:34:51.727537+0000","last_undegraded":"2024-09-12T01:34:51.727537+0000","last_fullsized":"2024-09-12T01:34:51.727537+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:11.301801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":54,"num_write":27,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"263'299","reported_seq":907,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.710943+0000","last_change":"2024-09-12T00:28:31.203847+0000","last_active":"2024-09-12T01:38:01.710943+0000","last_peered":"2024-09-12T01:38:01.710943+0000","last_clean":"2024-09-12T01:38:01.710943+0000","last_became_active":"2024-09-12T00:28:31.201886+0000","last_became_peered":"2024-09-12T00:28:31.201886+0000","last_unstale":"2024-09-12T01:38:01.710943+0000","last_undegraded":"2024-09-12T01:38:01.710943+0000","last_fullsized":"2024-09-12T01:38:01.710943+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:39.441025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":380,"num_read_kb":9626,"num_write":915,"num_write_kb":19266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"263'157","reported_seq":722,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:32.776738+0000","last_change":"2024-09-12T00:28:33.211480+0000","last_active":"2024-09-12T01:33:32.776738+0000","last_peered":"2024-09-12T01:33:32.776738+0000","last_clean":"2024-09-12T01:33:32.776738+0000","last_became_active":"2024-09-12T00:28:33.211182+0000","last_became_peered":"2024-09-12T00:28:33.211182+0000","last_unstale":"2024-09-12T01:33:32.776738+0000","last_undegraded":"2024-09-12T01:33:32.776738+0000","last_fullsized":"2024-09-12T01:33:32.776738+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:45.597820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":685,"num_read_kb":553,"num_write":251,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"263'296","reported_seq":1006,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.770532+0000","last_change":"2024-09-12T00:28:31.204861+0000","last_active":"2024-09-12T01:38:01.770532+0000","last_peered":"2024-09-12T01:38:01.770532+0000","last_clean":"2024-09-12T01:38:01.770532+0000","last_became_active":"2024-09-12T00:28:31.204561+0000","last_became_peered":"2024-09-12T00:28:31.204561+0000","last_unstale":"2024-09-12T01:38:01.770532+0000","last_undegraded":"2024-09-12T01:38:01.770532+0000","last_fullsized":"2024-09-12T01:38:01.770532+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:08.162064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243127,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":598,"num_read_kb":14276,"num_write":1032,"num_write_kb":31679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"263'59","reported_seq":619,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:36.715209+0000","last_change":"2024-09-12T00:28:33.217339+0000","last_active":"2024-09-12T01:33:36.715209+0000","last_peered":"2024-09-12T01:33:36.715209+0000","last_clean":"2024-09-12T01:33:36.715209+0000","last_became_active":"2024-09-12T00:28:33.217028+0000","last_became_peered":"2024-09-12T00:28:33.217028+0000","last_unstale":"2024-09-12T01:33:36.715209+0000","last_undegraded":"2024-09-12T01:33:36.715209+0000","last_fullsized":"2024-09-12T01:33:36.715209+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:39:58.330668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":252,"num_read_kb":216,"num_write":87,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"263'332","reported_seq":1191,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.751929+0000","last_change":"2024-09-12T00:28:31.203640+0000","last_active":"2024-09-12T01:38:01.751929+0000","last_peered":"2024-09-12T01:38:01.751929+0000","last_clean":"2024-09-12T01:38:01.751929+0000","last_became_active":"2024-09-12T00:28:31.203351+0000","last_became_peered":"2024-09-12T00:28:31.203351+0000","last_unstale":"2024-09-12T01:38:01.751929+0000","last_undegraded":"2024-09-12T01:38:01.751929+0000","last_fullsized":"2024-09-12T01:38:01.751929+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:37.607022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306757,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":934,"num_read_kb":42793,"num_write":1132,"num_write_kb":18824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"263'429","reported_seq":1173,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:36.531564+0000","last_change":"2024-09-12T00:28:33.217739+0000","last_active":"2024-09-12T01:33:36.531564+0000","last_peered":"2024-09-12T01:33:36.531564+0000","last_clean":"2024-09-12T01:33:36.531564+0000","last_became_active":"2024-09-12T00:28:33.217215+0000","last_became_peered":"2024-09-12T00:28:33.217215+0000","last_unstale":"2024-09-12T01:33:36.531564+0000","last_undegraded":"2024-09-12T01:33:36.531564+0000","last_fullsized":"2024-09-12T01:33:36.531564+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":400,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:28.536144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2092,"num_read_kb":1758,"num_write":778,"num_write_kb":522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"263'376","reported_seq":1068,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.766499+0000","last_change":"2024-09-12T00:28:31.214517+0000","last_active":"2024-09-12T01:38:01.766499+0000","last_peered":"2024-09-12T01:38:01.766499+0000","last_clean":"2024-09-12T01:38:01.766499+0000","last_became_active":"2024-09-12T00:28:31.213595+0000","last_became_peered":"2024-09-12T00:28:31.213595+0000","last_unstale":"2024-09-12T01:38:01.766499+0000","last_undegraded":"2024-09-12T01:38:01.766499+0000","last_fullsized":"2024-09-12T01:38:01.766499+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:36.346586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1440418,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":629,"num_read_kb":11143,"num_write":1163,"num_write_kb":15238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"263'289","reported_seq":921,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:49.421430+0000","last_change":"2024-09-12T00:28:33.218650+0000","last_active":"2024-09-12T01:33:49.421430+0000","last_peered":"2024-09-12T01:33:49.421430+0000","last_clean":"2024-09-12T01:33:49.421430+0000","last_became_active":"2024-09-12T00:28:33.218393+0000","last_became_peered":"2024-09-12T00:28:33.218393+0000","last_unstale":"2024-09-12T01:33:49.421430+0000","last_undegraded":"2024-09-12T01:33:49.421430+0000","last_fullsized":"2024-09-12T01:33:49.421430+0000","mapping_epoch":27,"log_start":"260'200","ondisk_log_start":"260'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:52.716266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1288,"num_read_kb":1088,"num_write":481,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"263'315","reported_seq":909,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.733442+0000","last_change":"2024-09-12T00:28:31.205251+0000","last_active":"2024-09-12T01:38:01.733442+0000","last_peered":"2024-09-12T01:38:01.733442+0000","last_clean":"2024-09-12T01:38:01.733442+0000","last_became_active":"2024-09-12T00:28:31.204962+0000","last_became_peered":"2024-09-12T00:28:31.204962+0000","last_unstale":"2024-09-12T01:38:01.733442+0000","last_undegraded":"2024-09-12T01:38:01.733442+0000","last_fullsized":"2024-09-12T01:38:01.733442+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:35.543975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170211,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":403,"num_read_kb":1209,"num_write":988,"num_write_kb":17836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"263'4176","reported_seq":4796,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:51.541648+0000","last_change":"2024-09-12T00:28:33.214790+0000","last_active":"2024-09-12T01:34:51.541648+0000","last_peered":"2024-09-12T01:34:51.541648+0000","last_clean":"2024-09-12T01:34:51.541648+0000","last_became_active":"2024-09-12T00:28:33.214515+0000","last_became_peered":"2024-09-12T00:28:33.214515+0000","last_unstale":"2024-09-12T01:34:51.541648+0000","last_undegraded":"2024-09-12T01:34:51.541648+0000","last_fullsized":"2024-09-12T01:34:51.541648+0000","mapping_epoch":27,"log_start":"263'4100","ondisk_log_start":"263'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":3000,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:53.747881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16813,"num_read_kb":14096,"num_write":6273,"num_write_kb":3125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"263'398","reported_seq":1045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.752061+0000","last_change":"2024-09-12T00:28:31.214068+0000","last_active":"2024-09-12T01:38:01.752061+0000","last_peered":"2024-09-12T01:38:01.752061+0000","last_clean":"2024-09-12T01:38:01.752061+0000","last_became_active":"2024-09-12T00:28:31.212573+0000","last_became_peered":"2024-09-12T00:28:31.212573+0000","last_unstale":"2024-09-12T01:38:01.752061+0000","last_undegraded":"2024-09-12T01:38:01.752061+0000","last_fullsized":"2024-09-12T01:38:01.752061+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:07.432079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568635,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":601,"num_read_kb":12450,"num_write":1255,"num_write_kb":24719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"263'260","reported_seq":970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.545564+0000","last_change":"2024-09-12T00:28:33.213811+0000","last_active":"2024-09-12T01:35:16.545564+0000","last_peered":"2024-09-12T01:35:16.545564+0000","last_clean":"2024-09-12T01:35:16.545564+0000","last_became_active":"2024-09-12T00:28:33.213014+0000","last_became_peered":"2024-09-12T00:28:33.213014+0000","last_unstale":"2024-09-12T01:35:16.545564+0000","last_undegraded":"2024-09-12T01:35:16.545564+0000","last_fullsized":"2024-09-12T01:35:16.545564+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:25.774640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1431,"num_read_kb":1278,"num_write":426,"num_write_kb":225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"263'316","reported_seq":951,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.726913+0000","last_change":"2024-09-12T00:28:31.210405+0000","last_active":"2024-09-12T01:38:01.726913+0000","last_peered":"2024-09-12T01:38:01.726913+0000","last_clean":"2024-09-12T01:38:01.726913+0000","last_became_active":"2024-09-12T00:28:31.210039+0000","last_became_peered":"2024-09-12T00:28:31.210039+0000","last_unstale":"2024-09-12T01:38:01.726913+0000","last_undegraded":"2024-09-12T01:38:01.726913+0000","last_fullsized":"2024-09-12T01:38:01.726913+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:33.172818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262202,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":471,"num_read_kb":7448,"num_write":1016,"num_write_kb":42696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"263'277","reported_seq":963,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:17.791987+0000","last_change":"2024-09-12T00:28:33.217908+0000","last_active":"2024-09-12T01:35:17.791987+0000","last_peered":"2024-09-12T01:35:17.791987+0000","last_clean":"2024-09-12T01:35:17.791987+0000","last_became_active":"2024-09-12T00:28:33.216856+0000","last_became_peered":"2024-09-12T00:28:33.216856+0000","last_unstale":"2024-09-12T01:35:17.791987+0000","last_undegraded":"2024-09-12T01:35:17.791987+0000","last_fullsized":"2024-09-12T01:35:17.791987+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:14.540790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1252,"num_read_kb":1029,"num_write":416,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"263'251","reported_seq":862,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:04.652742+0000","last_change":"2024-09-12T00:28:31.213450+0000","last_active":"2024-09-12T01:36:04.652742+0000","last_peered":"2024-09-12T01:36:04.652742+0000","last_clean":"2024-09-12T01:36:04.652742+0000","last_became_active":"2024-09-12T00:28:31.213172+0000","last_became_peered":"2024-09-12T00:28:31.213172+0000","last_unstale":"2024-09-12T01:36:04.652742+0000","last_undegraded":"2024-09-12T01:36:04.652742+0000","last_fullsized":"2024-09-12T01:36:04.652742+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:29.256307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13517815,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":381,"num_read_kb":13792,"num_write":908,"num_write_kb":26598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"263'108","reported_seq":718,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.535539+0000","last_change":"2024-09-12T00:28:33.206578+0000","last_active":"2024-09-12T01:35:16.535539+0000","last_peered":"2024-09-12T01:35:16.535539+0000","last_clean":"2024-09-12T01:35:16.535539+0000","last_became_active":"2024-09-12T00:28:33.206296+0000","last_became_peered":"2024-09-12T00:28:33.206296+0000","last_unstale":"2024-09-12T01:35:16.535539+0000","last_undegraded":"2024-09-12T01:35:16.535539+0000","last_fullsized":"2024-09-12T01:35:16.535539+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:53.527780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":463,"num_read_kb":402,"num_write":161,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"263'4150","reported_seq":4755,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.534336+0000","last_change":"2024-09-12T00:28:33.214093+0000","last_active":"2024-09-12T01:33:56.534336+0000","last_peered":"2024-09-12T01:33:56.534336+0000","last_clean":"2024-09-12T01:33:56.534336+0000","last_became_active":"2024-09-12T00:28:33.213777+0000","last_became_peered":"2024-09-12T00:28:33.213777+0000","last_unstale":"2024-09-12T01:33:56.534336+0000","last_undegraded":"2024-09-12T01:33:56.534336+0000","last_fullsized":"2024-09-12T01:33:56.534336+0000","mapping_epoch":27,"log_start":"263'4100","ondisk_log_start":"263'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":3000,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:34.960052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16687,"num_read_kb":13992,"num_write":6250,"num_write_kb":3125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"263'364","reported_seq":992,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.479322+0000","last_change":"2024-09-12T00:29:04.274666+0000","last_active":"2024-09-12T01:38:01.479322+0000","last_peered":"2024-09-12T01:38:01.479322+0000","last_clean":"2024-09-12T01:38:01.479322+0000","last_became_active":"2024-09-12T00:29:04.274377+0000","last_became_peered":"2024-09-12T00:29:04.274377+0000","last_unstale":"2024-09-12T01:38:01.479322+0000","last_undegraded":"2024-09-12T01:38:01.479322+0000","last_fullsized":"2024-09-12T01:38:01.479322+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:54.628791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1617669,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":550,"num_read_kb":2856,"num_write":1170,"num_write_kb":27657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"263'295","reported_seq":935,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:08.059213+0000","last_change":"2024-09-12T00:28:33.218880+0000","last_active":"2024-09-12T01:35:08.059213+0000","last_peered":"2024-09-12T01:35:08.059213+0000","last_clean":"2024-09-12T01:35:08.059213+0000","last_became_active":"2024-09-12T00:28:33.218660+0000","last_became_peered":"2024-09-12T00:28:33.218660+0000","last_unstale":"2024-09-12T01:35:08.059213+0000","last_undegraded":"2024-09-12T01:35:08.059213+0000","last_fullsized":"2024-09-12T01:35:08.059213+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:31.583663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1306,"num_read_kb":1072,"num_write":479,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"263'359","reported_seq":1022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.479027+0000","last_change":"2024-09-12T00:28:31.213720+0000","last_active":"2024-09-12T01:38:01.479027+0000","last_peered":"2024-09-12T01:38:01.479027+0000","last_clean":"2024-09-12T01:38:01.479027+0000","last_became_active":"2024-09-12T00:28:31.213388+0000","last_became_peered":"2024-09-12T00:28:31.213388+0000","last_unstale":"2024-09-12T01:38:01.479027+0000","last_undegraded":"2024-09-12T01:38:01.479027+0000","last_fullsized":"2024-09-12T01:38:01.479027+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:39.340566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133769,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":583,"num_read_kb":20058,"num_write":1145,"num_write_kb":40619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"263'90","reported_seq":673,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:52.081197+0000","last_change":"2024-09-12T00:28:33.214308+0000","last_active":"2024-09-12T01:35:52.081197+0000","last_peered":"2024-09-12T01:35:52.081197+0000","last_clean":"2024-09-12T01:35:52.081197+0000","last_became_active":"2024-09-12T00:28:33.213998+0000","last_became_peered":"2024-09-12T00:28:33.213998+0000","last_unstale":"2024-09-12T01:35:52.081197+0000","last_undegraded":"2024-09-12T01:35:52.081197+0000","last_fullsized":"2024-09-12T01:35:52.081197+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:58.148121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":414,"num_read_kb":350,"num_write":126,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"263'343","reported_seq":1055,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.535524+0000","last_change":"2024-09-12T00:28:31.215536+0000","last_active":"2024-09-12T01:38:01.535524+0000","last_peered":"2024-09-12T01:38:01.535524+0000","last_clean":"2024-09-12T01:38:01.535524+0000","last_became_active":"2024-09-12T00:28:31.215230+0000","last_became_peered":"2024-09-12T00:28:31.215230+0000","last_unstale":"2024-09-12T01:38:01.535524+0000","last_undegraded":"2024-09-12T01:38:01.535524+0000","last_fullsized":"2024-09-12T01:38:01.535524+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:13.446276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254878,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":618,"num_read_kb":115792,"num_write":1085,"num_write_kb":22723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"263'230","reported_seq":852,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:56.125911+0000","last_change":"2024-09-12T00:28:33.206843+0000","last_active":"2024-09-12T01:35:56.125911+0000","last_peered":"2024-09-12T01:35:56.125911+0000","last_clean":"2024-09-12T01:35:56.125911+0000","last_became_active":"2024-09-12T00:28:33.206305+0000","last_became_peered":"2024-09-12T00:28:33.206305+0000","last_unstale":"2024-09-12T01:35:56.125911+0000","last_undegraded":"2024-09-12T01:35:56.125911+0000","last_fullsized":"2024-09-12T01:35:56.125911+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:47.700041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":971,"num_read_kb":790,"num_write":344,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"263'404","reported_seq":1133,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.559024+0000","last_change":"2024-09-12T00:28:31.200080+0000","last_active":"2024-09-12T01:38:01.559024+0000","last_peered":"2024-09-12T01:38:01.559024+0000","last_clean":"2024-09-12T01:38:01.559024+0000","last_became_active":"2024-09-12T00:28:31.199779+0000","last_became_peered":"2024-09-12T00:28:31.199779+0000","last_unstale":"2024-09-12T01:38:01.559024+0000","last_undegraded":"2024-09-12T01:38:01.559024+0000","last_fullsized":"2024-09-12T01:38:01.559024+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:30.398312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":360748,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":660,"num_read_kb":69033,"num_write":1309,"num_write_kb":57878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"263'150","reported_seq":800,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:17.328724+0000","last_change":"2024-09-12T00:28:33.209112+0000","last_active":"2024-09-12T01:35:17.328724+0000","last_peered":"2024-09-12T01:35:17.328724+0000","last_clean":"2024-09-12T01:35:17.328724+0000","last_became_active":"2024-09-12T00:28:33.208831+0000","last_became_peered":"2024-09-12T00:28:33.208831+0000","last_unstale":"2024-09-12T01:35:17.328724+0000","last_undegraded":"2024-09-12T01:35:17.328724+0000","last_fullsized":"2024-09-12T01:35:17.328724+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:49.062557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":710,"num_read_kb":600,"num_write":211,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"263'322","reported_seq":968,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:49.636910+0000","last_change":"2024-09-12T00:28:31.202543+0000","last_active":"2024-09-12T01:33:49.636910+0000","last_peered":"2024-09-12T01:33:49.636910+0000","last_clean":"2024-09-12T01:33:49.636910+0000","last_became_active":"2024-09-12T00:28:31.202245+0000","last_became_peered":"2024-09-12T00:28:31.202245+0000","last_unstale":"2024-09-12T01:33:49.636910+0000","last_undegraded":"2024-09-12T01:33:49.636910+0000","last_fullsized":"2024-09-12T01:33:49.636910+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:12.536550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11608952,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":483,"num_read_kb":23092,"num_write":1269,"num_write_kb":58944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"263'113","reported_seq":719,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.533718+0000","last_change":"2024-09-12T00:28:33.207817+0000","last_active":"2024-09-12T01:33:51.533718+0000","last_peered":"2024-09-12T01:33:51.533718+0000","last_clean":"2024-09-12T01:33:51.533718+0000","last_became_active":"2024-09-12T00:28:33.207527+0000","last_became_peered":"2024-09-12T00:28:33.207527+0000","last_unstale":"2024-09-12T01:33:51.533718+0000","last_undegraded":"2024-09-12T01:33:51.533718+0000","last_fullsized":"2024-09-12T01:33:51.533718+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:31.972357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":515,"num_read_kb":438,"num_write":174,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"263'311","reported_seq":970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.719296+0000","last_change":"2024-09-12T00:28:31.204106+0000","last_active":"2024-09-12T01:38:01.719296+0000","last_peered":"2024-09-12T01:38:01.719296+0000","last_clean":"2024-09-12T01:38:01.719296+0000","last_became_active":"2024-09-12T00:28:31.203048+0000","last_became_peered":"2024-09-12T00:28:31.203048+0000","last_unstale":"2024-09-12T01:38:01.719296+0000","last_undegraded":"2024-09-12T01:38:01.719296+0000","last_fullsized":"2024-09-12T01:38:01.719296+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:57.305025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524344,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":495,"num_read_kb":45596,"num_write":1045,"num_write_kb":35489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"263'106","reported_seq":617,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:42.693662+0000","last_change":"2024-09-12T00:28:41.227253+0000","last_active":"2024-09-12T01:36:42.693662+0000","last_peered":"2024-09-12T01:36:42.693662+0000","last_clean":"2024-09-12T01:36:42.693662+0000","last_became_active":"2024-09-12T00:28:41.226952+0000","last_became_peered":"2024-09-12T00:28:41.226952+0000","last_unstale":"2024-09-12T01:36:42.693662+0000","last_undegraded":"2024-09-12T01:36:42.693662+0000","last_fullsized":"2024-09-12T01:36:42.693662+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:26.588660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":155,"num_read_kb":144,"num_write":259,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"263'188","reported_seq":772,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:09.639537+0000","last_change":"2024-09-12T00:28:33.209848+0000","last_active":"2024-09-12T01:34:09.639537+0000","last_peered":"2024-09-12T01:34:09.639537+0000","last_clean":"2024-09-12T01:34:09.639537+0000","last_became_active":"2024-09-12T00:28:33.209521+0000","last_became_peered":"2024-09-12T00:28:33.209521+0000","last_unstale":"2024-09-12T01:34:09.639537+0000","last_undegraded":"2024-09-12T01:34:09.639537+0000","last_fullsized":"2024-09-12T01:34:09.639537+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:21.840301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":834,"num_read_kb":672,"num_write":307,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"263'353","reported_seq":957,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.698618+0000","last_change":"2024-09-12T00:28:31.206298+0000","last_active":"2024-09-12T01:38:01.698618+0000","last_peered":"2024-09-12T01:38:01.698618+0000","last_clean":"2024-09-12T01:38:01.698618+0000","last_became_active":"2024-09-12T00:28:31.206010+0000","last_became_peered":"2024-09-12T00:28:31.206010+0000","last_unstale":"2024-09-12T01:38:01.698618+0000","last_undegraded":"2024-09-12T01:38:01.698618+0000","last_fullsized":"2024-09-12T01:38:01.698618+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:59.671503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":430,"num_read_kb":5592,"num_write":1103,"num_write_kb":25256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:47.779150+0000","last_change":"2024-09-12T00:28:35.212219+0000","last_active":"2024-09-12T01:33:47.779150+0000","last_peered":"2024-09-12T01:33:47.779150+0000","last_clean":"2024-09-12T01:33:47.779150+0000","last_became_active":"2024-09-12T00:28:35.211231+0000","last_became_peered":"2024-09-12T00:28:35.211231+0000","last_unstale":"2024-09-12T01:33:47.779150+0000","last_undegraded":"2024-09-12T01:33:47.779150+0000","last_fullsized":"2024-09-12T01:33:47.779150+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:10.530098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"263'348","reported_seq":970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.628118+0000","last_change":"2024-09-12T00:28:37.216446+0000","last_active":"2024-09-12T01:38:01.628118+0000","last_peered":"2024-09-12T01:38:01.628118+0000","last_clean":"2024-09-12T01:38:01.628118+0000","last_became_active":"2024-09-12T00:28:37.216169+0000","last_became_peered":"2024-09-12T00:28:37.216169+0000","last_unstale":"2024-09-12T01:38:01.628118+0000","last_undegraded":"2024-09-12T01:38:01.628118+0000","last_fullsized":"2024-09-12T01:38:01.628118+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:12.966316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44362,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":554,"num_read_kb":1122,"num_write":430,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.718741+0000","last_change":"2024-09-12T00:28:39.214249+0000","last_active":"2024-09-12T01:33:56.718741+0000","last_peered":"2024-09-12T01:33:56.718741+0000","last_clean":"2024-09-12T01:33:56.718741+0000","last_became_active":"2024-09-12T00:28:39.213942+0000","last_became_peered":"2024-09-12T00:28:39.213942+0000","last_unstale":"2024-09-12T01:33:56.718741+0000","last_undegraded":"2024-09-12T01:33:56.718741+0000","last_fullsized":"2024-09-12T01:33:56.718741+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:13.977918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"263'182","reported_seq":733,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:39.518790+0000","last_change":"2024-09-12T00:28:41.229922+0000","last_active":"2024-09-12T01:36:39.518790+0000","last_peered":"2024-09-12T01:36:39.518790+0000","last_clean":"2024-09-12T01:36:39.518790+0000","last_became_active":"2024-09-12T00:28:41.229608+0000","last_became_peered":"2024-09-12T00:28:41.229608+0000","last_unstale":"2024-09-12T01:36:39.518790+0000","last_undegraded":"2024-09-12T01:36:39.518790+0000","last_fullsized":"2024-09-12T01:36:39.518790+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:00.176000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":231,"num_read_kb":225,"num_write":383,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"263'212","reported_seq":813,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:47.779133+0000","last_change":"2024-09-12T00:28:33.212615+0000","last_active":"2024-09-12T01:33:47.779133+0000","last_peered":"2024-09-12T01:33:47.779133+0000","last_clean":"2024-09-12T01:33:47.779133+0000","last_became_active":"2024-09-12T00:28:33.212334+0000","last_became_peered":"2024-09-12T00:28:33.212334+0000","last_unstale":"2024-09-12T01:33:47.779133+0000","last_undegraded":"2024-09-12T01:33:47.779133+0000","last_fullsized":"2024-09-12T01:33:47.779133+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:46.854089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":883,"num_read_kb":721,"num_write":311,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"263'324","reported_seq":981,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.758063+0000","last_change":"2024-09-12T00:28:31.208474+0000","last_active":"2024-09-12T01:38:01.758063+0000","last_peered":"2024-09-12T01:38:01.758063+0000","last_clean":"2024-09-12T01:38:01.758063+0000","last_became_active":"2024-09-12T00:28:31.208141+0000","last_became_peered":"2024-09-12T00:28:31.208141+0000","last_unstale":"2024-09-12T01:38:01.758063+0000","last_undegraded":"2024-09-12T01:38:01.758063+0000","last_fullsized":"2024-09-12T01:38:01.758063+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:28:51.190004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395868,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":543,"num_read_kb":93032,"num_write":945,"num_write_kb":55506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:09.639557+0000","last_change":"2024-09-12T00:28:35.213065+0000","last_active":"2024-09-12T01:34:09.639557+0000","last_peered":"2024-09-12T01:34:09.639557+0000","last_clean":"2024-09-12T01:34:09.639557+0000","last_became_active":"2024-09-12T00:28:35.212745+0000","last_became_peered":"2024-09-12T00:28:35.212745+0000","last_unstale":"2024-09-12T01:34:09.639557+0000","last_undegraded":"2024-09-12T01:34:09.639557+0000","last_fullsized":"2024-09-12T01:34:09.639557+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:29.695288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"263'92","reported_seq":630,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:16.554571+0000","last_change":"2024-09-12T00:28:37.221408+0000","last_active":"2024-09-12T01:36:16.554571+0000","last_peered":"2024-09-12T01:36:16.554571+0000","last_clean":"2024-09-12T01:36:16.554571+0000","last_became_active":"2024-09-12T00:28:37.220899+0000","last_became_peered":"2024-09-12T00:28:37.220899+0000","last_unstale":"2024-09-12T01:36:16.554571+0000","last_undegraded":"2024-09-12T01:36:16.554571+0000","last_fullsized":"2024-09-12T01:36:16.554571+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:45.174607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":118,"num_read_kb":113,"num_write":78,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.534538+0000","last_change":"2024-09-12T00:28:39.222836+0000","last_active":"2024-09-12T01:33:56.534538+0000","last_peered":"2024-09-12T01:33:56.534538+0000","last_clean":"2024-09-12T01:33:56.534538+0000","last_became_active":"2024-09-12T00:28:39.222553+0000","last_became_peered":"2024-09-12T00:28:39.222553+0000","last_unstale":"2024-09-12T01:33:56.534538+0000","last_undegraded":"2024-09-12T01:33:56.534538+0000","last_fullsized":"2024-09-12T01:33:56.534538+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:57.986714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"263'126","reported_seq":631,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:42.376957+0000","last_change":"2024-09-12T00:28:41.228569+0000","last_active":"2024-09-12T01:36:42.376957+0000","last_peered":"2024-09-12T01:36:42.376957+0000","last_clean":"2024-09-12T01:36:42.376957+0000","last_became_active":"2024-09-12T00:28:41.228305+0000","last_became_peered":"2024-09-12T00:28:41.228305+0000","last_unstale":"2024-09-12T01:36:42.376957+0000","last_undegraded":"2024-09-12T01:36:42.376957+0000","last_fullsized":"2024-09-12T01:36:42.376957+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:24.274319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":144,"num_read_kb":135,"num_write":299,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"263'197","reported_seq":842,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.783202+0000","last_change":"2024-09-12T00:28:33.219367+0000","last_active":"2024-09-12T01:33:51.783202+0000","last_peered":"2024-09-12T01:33:51.783202+0000","last_clean":"2024-09-12T01:33:51.783202+0000","last_became_active":"2024-09-12T00:28:33.219082+0000","last_became_peered":"2024-09-12T00:28:33.219082+0000","last_unstale":"2024-09-12T01:33:51.783202+0000","last_undegraded":"2024-09-12T01:33:51.783202+0000","last_fullsized":"2024-09-12T01:33:51.783202+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:01.014245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":923,"num_read_kb":768,"num_write":333,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"263'375","reported_seq":1002,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.732052+0000","last_change":"2024-09-12T00:28:31.204550+0000","last_active":"2024-09-12T01:38:01.732052+0000","last_peered":"2024-09-12T01:38:01.732052+0000","last_clean":"2024-09-12T01:38:01.732052+0000","last_became_active":"2024-09-12T00:28:31.204223+0000","last_became_peered":"2024-09-12T00:28:31.204223+0000","last_unstale":"2024-09-12T01:38:01.732052+0000","last_undegraded":"2024-09-12T01:38:01.732052+0000","last_fullsized":"2024-09-12T01:38:01.732052+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:52.918860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133702,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":535,"num_read_kb":1739,"num_write":1184,"num_write_kb":22527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:49.637009+0000","last_change":"2024-09-12T00:28:35.212684+0000","last_active":"2024-09-12T01:33:49.637009+0000","last_peered":"2024-09-12T01:33:49.637009+0000","last_clean":"2024-09-12T01:33:49.637009+0000","last_became_active":"2024-09-12T00:28:35.212197+0000","last_became_peered":"2024-09-12T00:28:35.212197+0000","last_unstale":"2024-09-12T01:33:49.637009+0000","last_undegraded":"2024-09-12T01:33:49.637009+0000","last_fullsized":"2024-09-12T01:33:49.637009+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:02.479666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"263'133","reported_seq":693,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:11.629177+0000","last_change":"2024-09-12T00:28:37.221078+0000","last_active":"2024-09-12T01:34:11.629177+0000","last_peered":"2024-09-12T01:34:11.629177+0000","last_clean":"2024-09-12T01:34:11.629177+0000","last_became_active":"2024-09-12T00:28:37.220665+0000","last_became_peered":"2024-09-12T00:28:37.220665+0000","last_unstale":"2024-09-12T01:34:11.629177+0000","last_undegraded":"2024-09-12T01:34:11.629177+0000","last_fullsized":"2024-09-12T01:34:11.629177+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:48.810725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":170,"num_read_kb":162,"num_write":114,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"263'767","reported_seq":4806,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.053951+0000","last_change":"2024-09-12T00:28:39.218836+0000","last_active":"2024-09-12T01:38:00.053951+0000","last_peered":"2024-09-12T01:38:00.053951+0000","last_clean":"2024-09-12T01:38:00.053951+0000","last_became_active":"2024-09-12T00:28:39.218476+0000","last_became_peered":"2024-09-12T00:28:39.218476+0000","last_unstale":"2024-09-12T01:38:00.053951+0000","last_undegraded":"2024-09-12T01:38:00.053951+0000","last_fullsized":"2024-09-12T01:38:00.053951+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:48.644746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"263'191","reported_seq":1014,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:41.653002+0000","last_change":"2024-09-12T00:28:41.257967+0000","last_active":"2024-09-12T01:36:41.653002+0000","last_peered":"2024-09-12T01:36:41.653002+0000","last_clean":"2024-09-12T01:36:41.653002+0000","last_became_active":"2024-09-12T00:28:41.257679+0000","last_became_peered":"2024-09-12T00:28:41.257679+0000","last_unstale":"2024-09-12T01:36:41.653002+0000","last_undegraded":"2024-09-12T01:36:41.653002+0000","last_fullsized":"2024-09-12T01:36:41.653002+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:03.811468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":583,"num_read_kb":580,"num_write":423,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"263'82","reported_seq":627,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:49.636986+0000","last_change":"2024-09-12T00:28:33.212834+0000","last_active":"2024-09-12T01:33:49.636986+0000","last_peered":"2024-09-12T01:33:49.636986+0000","last_clean":"2024-09-12T01:33:49.636986+0000","last_became_active":"2024-09-12T00:28:33.212564+0000","last_became_peered":"2024-09-12T00:28:33.212564+0000","last_unstale":"2024-09-12T01:33:49.636986+0000","last_undegraded":"2024-09-12T01:33:49.636986+0000","last_fullsized":"2024-09-12T01:33:49.636986+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:09.246468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":372,"num_read_kb":309,"num_write":130,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"263'292","reported_seq":994,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.483030+0000","last_change":"2024-09-12T00:28:31.208261+0000","last_active":"2024-09-12T01:38:01.483030+0000","last_peered":"2024-09-12T01:38:01.483030+0000","last_clean":"2024-09-12T01:38:01.483030+0000","last_became_active":"2024-09-12T00:28:31.207938+0000","last_became_peered":"2024-09-12T00:28:31.207938+0000","last_unstale":"2024-09-12T01:38:01.483030+0000","last_undegraded":"2024-09-12T01:38:01.483030+0000","last_fullsized":"2024-09-12T01:38:01.483030+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:57.649279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174711,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":512,"num_read_kb":179847,"num_write":970,"num_write_kb":39231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:52.780005+0000","last_change":"2024-09-12T00:28:35.213658+0000","last_active":"2024-09-12T01:33:52.780005+0000","last_peered":"2024-09-12T01:33:52.780005+0000","last_clean":"2024-09-12T01:33:52.780005+0000","last_became_active":"2024-09-12T00:28:35.213178+0000","last_became_peered":"2024-09-12T00:28:35.213178+0000","last_unstale":"2024-09-12T01:33:52.780005+0000","last_undegraded":"2024-09-12T01:33:52.780005+0000","last_fullsized":"2024-09-12T01:33:52.780005+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:24.544971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"263'258","reported_seq":836,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.362668+0000","last_change":"2024-09-12T00:28:37.426701+0000","last_active":"2024-09-12T01:38:01.362668+0000","last_peered":"2024-09-12T01:38:01.362668+0000","last_clean":"2024-09-12T01:38:01.362668+0000","last_became_active":"2024-09-12T00:28:37.426357+0000","last_became_peered":"2024-09-12T00:28:37.426357+0000","last_unstale":"2024-09-12T01:38:01.362668+0000","last_undegraded":"2024-09-12T01:38:01.362668+0000","last_fullsized":"2024-09-12T01:38:01.362668+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:10.776649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15889,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":416,"num_read_kb":929,"num_write":326,"num_write_kb":245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"263'764","reported_seq":2643,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:49.984000+0000","last_change":"2024-09-12T00:28:39.219349+0000","last_active":"2024-09-12T01:37:49.984000+0000","last_peered":"2024-09-12T01:37:49.984000+0000","last_clean":"2024-09-12T01:37:49.984000+0000","last_became_active":"2024-09-12T00:28:39.218738+0000","last_became_peered":"2024-09-12T00:28:39.218738+0000","last_unstale":"2024-09-12T01:37:49.984000+0000","last_undegraded":"2024-09-12T01:37:49.984000+0000","last_fullsized":"2024-09-12T01:37:49.984000+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":700,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:17.422620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"263'110","reported_seq":678,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:47.796048+0000","last_change":"2024-09-12T00:28:33.213347+0000","last_active":"2024-09-12T01:35:47.796048+0000","last_peered":"2024-09-12T01:35:47.796048+0000","last_clean":"2024-09-12T01:35:47.796048+0000","last_became_active":"2024-09-12T00:28:33.213074+0000","last_became_peered":"2024-09-12T00:28:33.213074+0000","last_unstale":"2024-09-12T01:35:47.796048+0000","last_undegraded":"2024-09-12T01:35:47.796048+0000","last_fullsized":"2024-09-12T01:35:47.796048+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:23.084366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":473,"num_read_kb":387,"num_write":177,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"263'304","reported_seq":913,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.733507+0000","last_change":"2024-09-12T00:28:31.208561+0000","last_active":"2024-09-12T01:38:01.733507+0000","last_peered":"2024-09-12T01:38:01.733507+0000","last_clean":"2024-09-12T01:38:01.733507+0000","last_became_active":"2024-09-12T00:28:31.207567+0000","last_became_peered":"2024-09-12T00:28:31.207567+0000","last_unstale":"2024-09-12T01:38:01.733507+0000","last_undegraded":"2024-09-12T01:38:01.733507+0000","last_fullsized":"2024-09-12T01:38:01.733507+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:20.391261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":384,"num_read_kb":9497,"num_write":972,"num_write_kb":19827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.736003+0000","last_change":"2024-09-12T00:28:35.210621+0000","last_active":"2024-09-12T01:35:46.736003+0000","last_peered":"2024-09-12T01:35:46.736003+0000","last_clean":"2024-09-12T01:35:46.736003+0000","last_became_active":"2024-09-12T00:28:35.209944+0000","last_became_peered":"2024-09-12T00:28:35.209944+0000","last_unstale":"2024-09-12T01:35:46.736003+0000","last_undegraded":"2024-09-12T01:35:46.736003+0000","last_fullsized":"2024-09-12T01:35:46.736003+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:49.310299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"263'369","reported_seq":1002,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.143752+0000","last_change":"2024-09-12T00:28:37.424559+0000","last_active":"2024-09-12T01:38:00.143752+0000","last_peered":"2024-09-12T01:38:00.143752+0000","last_clean":"2024-09-12T01:38:00.143752+0000","last_became_active":"2024-09-12T00:28:37.424250+0000","last_became_peered":"2024-09-12T00:28:37.424250+0000","last_unstale":"2024-09-12T01:38:00.143752+0000","last_undegraded":"2024-09-12T01:38:00.143752+0000","last_fullsized":"2024-09-12T01:38:00.143752+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:53.905894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42905,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":588,"num_read_kb":1145,"num_write":446,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.933854+0000","last_change":"2024-09-12T00:28:39.214210+0000","last_active":"2024-09-12T01:33:56.933854+0000","last_peered":"2024-09-12T01:33:56.933854+0000","last_clean":"2024-09-12T01:33:56.933854+0000","last_became_active":"2024-09-12T00:28:39.213889+0000","last_became_peered":"2024-09-12T00:28:39.213889+0000","last_unstale":"2024-09-12T01:33:56.933854+0000","last_undegraded":"2024-09-12T01:33:56.933854+0000","last_fullsized":"2024-09-12T01:33:56.933854+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:04.180315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"263'533","reported_seq":1343,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:47.142053+0000","last_change":"2024-09-12T00:28:41.229982+0000","last_active":"2024-09-12T01:37:47.142053+0000","last_peered":"2024-09-12T01:37:47.142053+0000","last_clean":"2024-09-12T01:37:47.142053+0000","last_became_active":"2024-09-12T00:28:41.229664+0000","last_became_peered":"2024-09-12T00:28:41.229664+0000","last_unstale":"2024-09-12T01:37:47.142053+0000","last_undegraded":"2024-09-12T01:37:47.142053+0000","last_fullsized":"2024-09-12T01:37:47.142053+0000","mapping_epoch":35,"log_start":"263'500","ondisk_log_start":"263'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":500,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:28.373424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":472,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1261,"num_read_kb":1256,"num_write":1100,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"263'151","reported_seq":766,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.549725+0000","last_change":"2024-09-12T00:28:33.201995+0000","last_active":"2024-09-12T01:35:46.549725+0000","last_peered":"2024-09-12T01:35:46.549725+0000","last_clean":"2024-09-12T01:35:46.549725+0000","last_became_active":"2024-09-12T00:28:33.201673+0000","last_became_peered":"2024-09-12T00:28:33.201673+0000","last_unstale":"2024-09-12T01:35:46.549725+0000","last_undegraded":"2024-09-12T01:35:46.549725+0000","last_fullsized":"2024-09-12T01:35:46.549725+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:31.181867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":672,"num_read_kb":557,"num_write":251,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"263'417","reported_seq":1119,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.747151+0000","last_change":"2024-09-12T00:28:31.202584+0000","last_active":"2024-09-12T01:38:01.747151+0000","last_peered":"2024-09-12T01:38:01.747151+0000","last_clean":"2024-09-12T01:38:01.747151+0000","last_became_active":"2024-09-12T00:28:31.202279+0000","last_became_peered":"2024-09-12T00:28:31.202279+0000","last_unstale":"2024-09-12T01:38:01.747151+0000","last_undegraded":"2024-09-12T01:38:01.747151+0000","last_fullsized":"2024-09-12T01:38:01.747151+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:56.615946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":282856,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":774,"num_read_kb":12137,"num_write":1232,"num_write_kb":44296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.538620+0000","last_change":"2024-09-12T00:28:35.210515+0000","last_active":"2024-09-12T01:35:46.538620+0000","last_peered":"2024-09-12T01:35:46.538620+0000","last_clean":"2024-09-12T01:35:46.538620+0000","last_became_active":"2024-09-12T00:28:35.210154+0000","last_became_peered":"2024-09-12T00:28:35.210154+0000","last_unstale":"2024-09-12T01:35:46.538620+0000","last_undegraded":"2024-09-12T01:35:46.538620+0000","last_fullsized":"2024-09-12T01:35:46.538620+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:27.486274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"263'268","reported_seq":849,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:09.653372+0000","last_change":"2024-09-12T00:28:37.220230+0000","last_active":"2024-09-12T01:36:09.653372+0000","last_peered":"2024-09-12T01:36:09.653372+0000","last_clean":"2024-09-12T01:36:09.653372+0000","last_became_active":"2024-09-12T00:28:37.219967+0000","last_became_peered":"2024-09-12T00:28:37.219967+0000","last_unstale":"2024-09-12T01:36:09.653372+0000","last_undegraded":"2024-09-12T01:36:09.653372+0000","last_fullsized":"2024-09-12T01:36:09.653372+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:44.830810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49927,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":436,"num_read_kb":914,"num_write":354,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:54.637493+0000","last_change":"2024-09-12T00:28:39.216619+0000","last_active":"2024-09-12T01:33:54.637493+0000","last_peered":"2024-09-12T01:33:54.637493+0000","last_clean":"2024-09-12T01:33:54.637493+0000","last_became_active":"2024-09-12T00:28:39.216330+0000","last_became_peered":"2024-09-12T00:28:39.216330+0000","last_unstale":"2024-09-12T01:33:54.637493+0000","last_undegraded":"2024-09-12T01:33:54.637493+0000","last_fullsized":"2024-09-12T01:33:54.637493+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:08.447550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"263'2405","reported_seq":4247,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:36.457076+0000","last_change":"2024-09-12T00:28:41.228159+0000","last_active":"2024-09-12T01:37:36.457076+0000","last_peered":"2024-09-12T01:37:36.457076+0000","last_clean":"2024-09-12T01:37:36.457076+0000","last_became_active":"2024-09-12T00:28:41.227877+0000","last_became_peered":"2024-09-12T00:28:41.227877+0000","last_unstale":"2024-09-12T01:37:36.457076+0000","last_undegraded":"2024-09-12T01:37:36.457076+0000","last_fullsized":"2024-09-12T01:37:36.457076+0000","mapping_epoch":35,"log_start":"263'2300","ondisk_log_start":"263'2300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":2300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:29.699595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1208,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6068,"num_read_kb":6055,"num_write":4875,"num_write_kb":1798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"263'303","reported_seq":972,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.533631+0000","last_change":"2024-09-12T00:28:33.218264+0000","last_active":"2024-09-12T01:33:51.533631+0000","last_peered":"2024-09-12T01:33:51.533631+0000","last_clean":"2024-09-12T01:33:51.533631+0000","last_became_active":"2024-09-12T00:28:33.217954+0000","last_became_peered":"2024-09-12T00:28:33.217954+0000","last_unstale":"2024-09-12T01:33:51.533631+0000","last_undegraded":"2024-09-12T01:33:51.533631+0000","last_fullsized":"2024-09-12T01:33:51.533631+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:44.095321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1356,"num_read_kb":1133,"num_write":489,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"263'383","reported_seq":1069,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.693915+0000","last_change":"2024-09-12T00:28:31.215918+0000","last_active":"2024-09-12T01:38:01.693915+0000","last_peered":"2024-09-12T01:38:01.693915+0000","last_clean":"2024-09-12T01:38:01.693915+0000","last_became_active":"2024-09-12T00:28:31.215643+0000","last_became_peered":"2024-09-12T00:28:31.215643+0000","last_unstale":"2024-09-12T01:38:01.693915+0000","last_undegraded":"2024-09-12T01:38:01.693915+0000","last_fullsized":"2024-09-12T01:38:01.693915+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:03.063848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432543,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":555,"num_read_kb":94195,"num_write":1240,"num_write_kb":52818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.627099+0000","last_change":"2024-09-12T00:28:35.208477+0000","last_active":"2024-09-12T01:33:51.627099+0000","last_peered":"2024-09-12T01:33:51.627099+0000","last_clean":"2024-09-12T01:33:51.627099+0000","last_became_active":"2024-09-12T00:28:35.208169+0000","last_became_peered":"2024-09-12T00:28:35.208169+0000","last_unstale":"2024-09-12T01:33:51.627099+0000","last_undegraded":"2024-09-12T01:33:51.627099+0000","last_fullsized":"2024-09-12T01:33:51.627099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:22.104533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"263'330","reported_seq":940,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.229680+0000","last_change":"2024-09-12T00:28:37.221382+0000","last_active":"2024-09-12T01:38:00.229680+0000","last_peered":"2024-09-12T01:38:00.229680+0000","last_clean":"2024-09-12T01:38:00.229680+0000","last_became_active":"2024-09-12T00:28:37.220877+0000","last_became_peered":"2024-09-12T00:28:37.220877+0000","last_unstale":"2024-09-12T01:38:00.229680+0000","last_undegraded":"2024-09-12T01:38:00.229680+0000","last_fullsized":"2024-09-12T01:38:00.229680+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:32:44.806344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44229,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":532,"num_read_kb":1137,"num_write":418,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"263'773","reported_seq":2587,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.806004+0000","last_change":"2024-09-12T00:28:39.216443+0000","last_active":"2024-09-12T01:38:01.806004+0000","last_peered":"2024-09-12T01:38:01.806004+0000","last_clean":"2024-09-12T01:38:01.806004+0000","last_became_active":"2024-09-12T00:28:39.215746+0000","last_became_peered":"2024-09-12T00:28:39.215746+0000","last_unstale":"2024-09-12T01:38:01.806004+0000","last_undegraded":"2024-09-12T01:38:01.806004+0000","last_fullsized":"2024-09-12T01:38:01.806004+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:06.915545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"263'80","reported_seq":574,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.022592+0000","last_change":"2024-09-12T00:28:41.228845+0000","last_active":"2024-09-12T01:37:46.022592+0000","last_peered":"2024-09-12T01:37:46.022592+0000","last_clean":"2024-09-12T01:37:46.022592+0000","last_became_active":"2024-09-12T00:28:41.228361+0000","last_became_peered":"2024-09-12T00:28:41.228361+0000","last_unstale":"2024-09-12T01:37:46.022592+0000","last_undegraded":"2024-09-12T01:37:46.022592+0000","last_fullsized":"2024-09-12T01:37:46.022592+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:22.221289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":65,"num_write":188,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"263'302","reported_seq":908,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:48.154867+0000","last_change":"2024-09-12T00:28:33.219482+0000","last_active":"2024-09-12T01:35:48.154867+0000","last_peered":"2024-09-12T01:35:48.154867+0000","last_clean":"2024-09-12T01:35:48.154867+0000","last_became_active":"2024-09-12T00:28:33.219182+0000","last_became_peered":"2024-09-12T00:28:33.219182+0000","last_unstale":"2024-09-12T01:35:48.154867+0000","last_undegraded":"2024-09-12T01:35:48.154867+0000","last_fullsized":"2024-09-12T01:35:48.154867+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:37.924996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1277,"num_read_kb":1021,"num_write":469,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"263'374","reported_seq":1041,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.747308+0000","last_change":"2024-09-12T00:28:31.215345+0000","last_active":"2024-09-12T01:38:01.747308+0000","last_peered":"2024-09-12T01:38:01.747308+0000","last_clean":"2024-09-12T01:38:01.747308+0000","last_became_active":"2024-09-12T00:28:31.214920+0000","last_became_peered":"2024-09-12T00:28:31.214920+0000","last_unstale":"2024-09-12T01:38:01.747308+0000","last_undegraded":"2024-09-12T01:38:01.747308+0000","last_fullsized":"2024-09-12T01:38:01.747308+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:51.465462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":584,"num_read_kb":15343,"num_write":1236,"num_write_kb":35661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.627067+0000","last_change":"2024-09-12T00:28:35.208217+0000","last_active":"2024-09-12T01:33:51.627067+0000","last_peered":"2024-09-12T01:33:51.627067+0000","last_clean":"2024-09-12T01:33:51.627067+0000","last_became_active":"2024-09-12T00:28:35.207881+0000","last_became_peered":"2024-09-12T00:28:35.207881+0000","last_unstale":"2024-09-12T01:33:51.627067+0000","last_undegraded":"2024-09-12T01:33:51.627067+0000","last_fullsized":"2024-09-12T01:33:51.627067+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:10.037662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"263'466","reported_seq":1120,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.006707+0000","last_change":"2024-09-12T00:28:37.217137+0000","last_active":"2024-09-12T01:38:01.006707+0000","last_peered":"2024-09-12T01:38:01.006707+0000","last_clean":"2024-09-12T01:38:01.006707+0000","last_became_active":"2024-09-12T00:28:37.216189+0000","last_became_peered":"2024-09-12T00:28:37.216189+0000","last_unstale":"2024-09-12T01:38:01.006707+0000","last_undegraded":"2024-09-12T01:38:01.006707+0000","last_fullsized":"2024-09-12T01:38:01.006707+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:12.417502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90719,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":821,"num_read_kb":1951,"num_write":658,"num_write_kb":528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:51.539194+0000","last_change":"2024-09-12T00:28:39.212958+0000","last_active":"2024-09-12T01:35:51.539194+0000","last_peered":"2024-09-12T01:35:51.539194+0000","last_clean":"2024-09-12T01:35:51.539194+0000","last_became_active":"2024-09-12T00:28:39.212687+0000","last_became_peered":"2024-09-12T00:28:39.212687+0000","last_unstale":"2024-09-12T01:35:51.539194+0000","last_undegraded":"2024-09-12T01:35:51.539194+0000","last_fullsized":"2024-09-12T01:35:51.539194+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:16.911233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"263'133","reported_seq":662,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:13.149858+0000","last_change":"2024-09-12T00:28:41.226044+0000","last_active":"2024-09-12T01:36:13.149858+0000","last_peered":"2024-09-12T01:36:13.149858+0000","last_clean":"2024-09-12T01:36:13.149858+0000","last_became_active":"2024-09-12T00:28:41.225700+0000","last_became_peered":"2024-09-12T00:28:41.225700+0000","last_unstale":"2024-09-12T01:36:13.149858+0000","last_undegraded":"2024-09-12T01:36:13.149858+0000","last_fullsized":"2024-09-12T01:36:13.149858+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:22.538216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":521,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":185,"num_read_kb":167,"num_write":321,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"263'175","reported_seq":779,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.533678+0000","last_change":"2024-09-12T00:28:33.205438+0000","last_active":"2024-09-12T01:33:51.533678+0000","last_peered":"2024-09-12T01:33:51.533678+0000","last_clean":"2024-09-12T01:33:51.533678+0000","last_became_active":"2024-09-12T00:28:33.204532+0000","last_became_peered":"2024-09-12T00:28:33.204532+0000","last_unstale":"2024-09-12T01:33:51.533678+0000","last_undegraded":"2024-09-12T01:33:51.533678+0000","last_fullsized":"2024-09-12T01:33:51.533678+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:42.519724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":765,"num_read_kb":622,"num_write":270,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"263'310","reported_seq":946,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:24.852094+0000","last_change":"2024-09-12T00:28:31.207547+0000","last_active":"2024-09-12T01:36:24.852094+0000","last_peered":"2024-09-12T01:36:24.852094+0000","last_clean":"2024-09-12T01:36:24.852094+0000","last_became_active":"2024-09-12T00:28:31.207269+0000","last_became_peered":"2024-09-12T00:28:31.207269+0000","last_unstale":"2024-09-12T01:36:24.852094+0000","last_undegraded":"2024-09-12T01:36:24.852094+0000","last_fullsized":"2024-09-12T01:36:24.852094+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:27.052564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11558926,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":469,"num_read_kb":24702,"num_write":1056,"num_write_kb":40904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.627126+0000","last_change":"2024-09-12T00:28:35.209783+0000","last_active":"2024-09-12T01:33:51.627126+0000","last_peered":"2024-09-12T01:33:51.627126+0000","last_clean":"2024-09-12T01:33:51.627126+0000","last_became_active":"2024-09-12T00:28:35.208829+0000","last_became_peered":"2024-09-12T00:28:35.208829+0000","last_unstale":"2024-09-12T01:33:51.627126+0000","last_undegraded":"2024-09-12T01:33:51.627126+0000","last_fullsized":"2024-09-12T01:33:51.627126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:49.399261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"263'284","reported_seq":877,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.054138+0000","last_change":"2024-09-12T00:28:37.210416+0000","last_active":"2024-09-12T01:38:01.054138+0000","last_peered":"2024-09-12T01:38:01.054138+0000","last_clean":"2024-09-12T01:38:01.054138+0000","last_became_active":"2024-09-12T00:28:37.210162+0000","last_became_peered":"2024-09-12T00:28:37.210162+0000","last_unstale":"2024-09-12T01:38:01.054138+0000","last_undegraded":"2024-09-12T01:38:01.054138+0000","last_fullsized":"2024-09-12T01:38:01.054138+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:03.051183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46921,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":495,"num_read_kb":1053,"num_write":432,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:06.785115+0000","last_change":"2024-09-12T00:28:39.220793+0000","last_active":"2024-09-12T01:34:06.785115+0000","last_peered":"2024-09-12T01:34:06.785115+0000","last_clean":"2024-09-12T01:34:06.785115+0000","last_became_active":"2024-09-12T00:28:39.220468+0000","last_became_peered":"2024-09-12T00:28:39.220468+0000","last_unstale":"2024-09-12T01:34:06.785115+0000","last_undegraded":"2024-09-12T01:34:06.785115+0000","last_fullsized":"2024-09-12T01:34:06.785115+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:49.834445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"263'81","reported_seq":575,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:59.659578+0000","last_change":"2024-09-12T00:28:41.228956+0000","last_active":"2024-09-12T01:36:59.659578+0000","last_peered":"2024-09-12T01:36:59.659578+0000","last_clean":"2024-09-12T01:36:59.659578+0000","last_became_active":"2024-09-12T00:28:41.228663+0000","last_became_peered":"2024-09-12T00:28:41.228663+0000","last_unstale":"2024-09-12T01:36:59.659578+0000","last_undegraded":"2024-09-12T01:36:59.659578+0000","last_fullsized":"2024-09-12T01:36:59.659578+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:51.130761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":503,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":60,"num_read_kb":59,"num_write":193,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"263'158","reported_seq":779,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:45.663215+0000","last_change":"2024-09-12T00:28:33.207160+0000","last_active":"2024-09-12T01:35:45.663215+0000","last_peered":"2024-09-12T01:35:45.663215+0000","last_clean":"2024-09-12T01:35:45.663215+0000","last_became_active":"2024-09-12T00:28:33.206883+0000","last_became_peered":"2024-09-12T00:28:33.206883+0000","last_unstale":"2024-09-12T01:35:45.663215+0000","last_undegraded":"2024-09-12T01:35:45.663215+0000","last_fullsized":"2024-09-12T01:35:45.663215+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:15.306805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":717,"num_read_kb":595,"num_write":233,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"263'296","reported_seq":911,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.493238+0000","last_change":"2024-09-12T00:28:31.203866+0000","last_active":"2024-09-12T01:38:01.493238+0000","last_peered":"2024-09-12T01:38:01.493238+0000","last_clean":"2024-09-12T01:38:01.493238+0000","last_became_active":"2024-09-12T00:28:31.203369+0000","last_became_peered":"2024-09-12T00:28:31.203369+0000","last_unstale":"2024-09-12T01:38:01.493238+0000","last_undegraded":"2024-09-12T01:38:01.493238+0000","last_fullsized":"2024-09-12T01:38:01.493238+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:04.800888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7425264,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":365,"num_read_kb":56295,"num_write":839,"num_write_kb":46368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.933271+0000","last_change":"2024-09-12T00:28:35.208477+0000","last_active":"2024-09-12T01:33:51.933271+0000","last_peered":"2024-09-12T01:33:51.933271+0000","last_clean":"2024-09-12T01:33:51.933271+0000","last_became_active":"2024-09-12T00:28:35.207923+0000","last_became_peered":"2024-09-12T00:28:35.207923+0000","last_unstale":"2024-09-12T01:33:51.933271+0000","last_undegraded":"2024-09-12T01:33:51.933271+0000","last_fullsized":"2024-09-12T01:33:51.933271+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:33.170429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"263'348","reported_seq":950,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.685418+0000","last_change":"2024-09-12T00:28:37.220980+0000","last_active":"2024-09-12T01:38:00.685418+0000","last_peered":"2024-09-12T01:38:00.685418+0000","last_clean":"2024-09-12T01:38:00.685418+0000","last_became_active":"2024-09-12T00:28:37.220674+0000","last_became_peered":"2024-09-12T00:28:37.220674+0000","last_unstale":"2024-09-12T01:38:00.685418+0000","last_undegraded":"2024-09-12T01:38:00.685418+0000","last_fullsized":"2024-09-12T01:38:00.685418+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:29.407891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48847,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":575,"num_read_kb":1313,"num_write":464,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"263'738","reported_seq":4566,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.053880+0000","last_change":"2024-09-12T00:28:39.214151+0000","last_active":"2024-09-12T01:38:00.053880+0000","last_peered":"2024-09-12T01:38:00.053880+0000","last_clean":"2024-09-12T01:38:00.053880+0000","last_became_active":"2024-09-12T00:28:39.213871+0000","last_became_peered":"2024-09-12T00:28:39.213871+0000","last_unstale":"2024-09-12T01:38:00.053880+0000","last_undegraded":"2024-09-12T01:38:00.053880+0000","last_fullsized":"2024-09-12T01:38:00.053880+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":700,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:10.173214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"263'194","reported_seq":745,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:40.186256+0000","last_change":"2024-09-12T00:28:41.227781+0000","last_active":"2024-09-12T01:36:40.186256+0000","last_peered":"2024-09-12T01:36:40.186256+0000","last_clean":"2024-09-12T01:36:40.186256+0000","last_became_active":"2024-09-12T00:28:41.227310+0000","last_became_peered":"2024-09-12T00:28:41.227310+0000","last_unstale":"2024-09-12T01:36:40.186256+0000","last_undegraded":"2024-09-12T01:36:40.186256+0000","last_fullsized":"2024-09-12T01:36:40.186256+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:23.647466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1879,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":313,"num_read_kb":267,"num_write":467,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"263'134","reported_seq":758,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.533762+0000","last_change":"2024-09-12T00:28:33.211637+0000","last_active":"2024-09-12T01:33:51.533762+0000","last_peered":"2024-09-12T01:33:51.533762+0000","last_clean":"2024-09-12T01:33:51.533762+0000","last_became_active":"2024-09-12T00:28:33.211327+0000","last_became_peered":"2024-09-12T00:28:33.211327+0000","last_unstale":"2024-09-12T01:33:51.533762+0000","last_undegraded":"2024-09-12T01:33:51.533762+0000","last_fullsized":"2024-09-12T01:33:51.533762+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:57.179232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":621,"num_read_kb":525,"num_write":194,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"263'361","reported_seq":1059,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.544158+0000","last_change":"2024-09-12T00:28:31.202041+0000","last_active":"2024-09-12T01:38:01.544158+0000","last_peered":"2024-09-12T01:38:01.544158+0000","last_clean":"2024-09-12T01:38:01.544158+0000","last_became_active":"2024-09-12T00:28:31.201275+0000","last_became_peered":"2024-09-12T00:28:31.201275+0000","last_unstale":"2024-09-12T01:38:01.544158+0000","last_undegraded":"2024-09-12T01:38:01.544158+0000","last_fullsized":"2024-09-12T01:38:01.544158+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:04.675535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395916,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":631,"num_read_kb":30113,"num_write":1181,"num_write_kb":53346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1449,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:59.832864+0000","last_change":"2024-09-12T00:28:35.210438+0000","last_active":"2024-09-12T01:37:59.832864+0000","last_peered":"2024-09-12T01:37:59.832864+0000","last_clean":"2024-09-12T01:37:59.832864+0000","last_became_active":"2024-09-12T00:28:35.210173+0000","last_became_peered":"2024-09-12T00:28:35.210173+0000","last_unstale":"2024-09-12T01:37:59.832864+0000","last_undegraded":"2024-09-12T01:37:59.832864+0000","last_fullsized":"2024-09-12T01:37:59.832864+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:01.967609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":952,"num_read_kb":952,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"263'106","reported_seq":638,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:54.637565+0000","last_change":"2024-09-12T00:28:37.424197+0000","last_active":"2024-09-12T01:33:54.637565+0000","last_peered":"2024-09-12T01:33:54.637565+0000","last_clean":"2024-09-12T01:33:54.637565+0000","last_became_active":"2024-09-12T00:28:37.423847+0000","last_became_peered":"2024-09-12T00:28:37.423847+0000","last_unstale":"2024-09-12T01:33:54.637565+0000","last_undegraded":"2024-09-12T01:33:54.637565+0000","last_fullsized":"2024-09-12T01:33:54.637565+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:11.857170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":109,"num_read_kb":102,"num_write":74,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"263'759","reported_seq":2646,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.054967+0000","last_change":"2024-09-12T00:28:39.216574+0000","last_active":"2024-09-12T01:38:00.054967+0000","last_peered":"2024-09-12T01:38:00.054967+0000","last_clean":"2024-09-12T01:38:00.054967+0000","last_became_active":"2024-09-12T00:28:39.216244+0000","last_became_peered":"2024-09-12T00:28:39.216244+0000","last_unstale":"2024-09-12T01:38:00.054967+0000","last_undegraded":"2024-09-12T01:38:00.054967+0000","last_fullsized":"2024-09-12T01:38:00.054967+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":700,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:06.051077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"263'177","reported_seq":688,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:41.529420+0000","last_change":"2024-09-12T00:28:41.226032+0000","last_active":"2024-09-12T01:36:41.529420+0000","last_peered":"2024-09-12T01:36:41.529420+0000","last_clean":"2024-09-12T01:36:41.529420+0000","last_became_active":"2024-09-12T00:28:41.225728+0000","last_became_peered":"2024-09-12T00:28:41.225728+0000","last_unstale":"2024-09-12T01:36:41.529420+0000","last_undegraded":"2024-09-12T01:36:41.529420+0000","last_fullsized":"2024-09-12T01:36:41.529420+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:37.084319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":145,"num_write":308,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"263'4256","reported_seq":4857,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:58.613431+0000","last_change":"2024-09-12T00:28:33.206100+0000","last_active":"2024-09-12T01:33:58.613431+0000","last_peered":"2024-09-12T01:33:58.613431+0000","last_clean":"2024-09-12T01:33:58.613431+0000","last_became_active":"2024-09-12T00:28:33.205792+0000","last_became_peered":"2024-09-12T00:28:33.205792+0000","last_unstale":"2024-09-12T01:33:58.613431+0000","last_undegraded":"2024-09-12T01:33:58.613431+0000","last_fullsized":"2024-09-12T01:33:58.613431+0000","mapping_epoch":27,"log_start":"263'4200","ondisk_log_start":"263'4200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":3000,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:14.540790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17142,"num_read_kb":14400,"num_write":6430,"num_write_kb":3228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"263'314","reported_seq":1033,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:44.650323+0000","last_change":"2024-09-12T00:28:31.202748+0000","last_active":"2024-09-12T01:35:44.650323+0000","last_peered":"2024-09-12T01:35:44.650323+0000","last_clean":"2024-09-12T01:35:44.650323+0000","last_became_active":"2024-09-12T00:28:31.202456+0000","last_became_peered":"2024-09-12T00:28:31.202456+0000","last_unstale":"2024-09-12T01:35:44.650323+0000","last_undegraded":"2024-09-12T01:35:44.650323+0000","last_fullsized":"2024-09-12T01:35:44.650323+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:33.698882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9926443,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":589,"num_read_kb":78127,"num_write":1311,"num_write_kb":48684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.533751+0000","last_change":"2024-09-12T00:28:35.207665+0000","last_active":"2024-09-12T01:33:51.533751+0000","last_peered":"2024-09-12T01:33:51.533751+0000","last_clean":"2024-09-12T01:33:51.533751+0000","last_became_active":"2024-09-12T00:28:35.207343+0000","last_became_peered":"2024-09-12T00:28:35.207343+0000","last_unstale":"2024-09-12T01:33:51.533751+0000","last_undegraded":"2024-09-12T01:33:51.533751+0000","last_fullsized":"2024-09-12T01:33:51.533751+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:06.989902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"263'369","reported_seq":987,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.685057+0000","last_change":"2024-09-12T00:28:37.211454+0000","last_active":"2024-09-12T01:38:01.685057+0000","last_peered":"2024-09-12T01:38:01.685057+0000","last_clean":"2024-09-12T01:38:01.685057+0000","last_became_active":"2024-09-12T00:28:37.211090+0000","last_became_peered":"2024-09-12T00:28:37.211090+0000","last_unstale":"2024-09-12T01:38:01.685057+0000","last_undegraded":"2024-09-12T01:38:01.685057+0000","last_fullsized":"2024-09-12T01:38:01.685057+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:34:21.708434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46480,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":594,"num_read_kb":1224,"num_write":462,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.534269+0000","last_change":"2024-09-12T00:28:39.219992+0000","last_active":"2024-09-12T01:33:56.534269+0000","last_peered":"2024-09-12T01:33:56.534269+0000","last_clean":"2024-09-12T01:33:56.534269+0000","last_became_active":"2024-09-12T00:28:39.219687+0000","last_became_peered":"2024-09-12T00:28:39.219687+0000","last_unstale":"2024-09-12T01:33:56.534269+0000","last_undegraded":"2024-09-12T01:33:56.534269+0000","last_fullsized":"2024-09-12T01:33:56.534269+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:05.399679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"263'114","reported_seq":619,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:41.523331+0000","last_change":"2024-09-12T00:28:41.226379+0000","last_active":"2024-09-12T01:36:41.523331+0000","last_peered":"2024-09-12T01:36:41.523331+0000","last_clean":"2024-09-12T01:36:41.523331+0000","last_became_active":"2024-09-12T00:28:41.226049+0000","last_became_peered":"2024-09-12T00:28:41.226049+0000","last_unstale":"2024-09-12T01:36:41.523331+0000","last_undegraded":"2024-09-12T01:36:41.523331+0000","last_fullsized":"2024-09-12T01:36:41.523331+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:35.250632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":871,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":118,"num_read_kb":115,"num_write":279,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"263'144","reported_seq":778,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:31.547552+0000","last_change":"2024-09-12T00:28:33.214340+0000","last_active":"2024-09-12T01:35:31.547552+0000","last_peered":"2024-09-12T01:35:31.547552+0000","last_clean":"2024-09-12T01:35:31.547552+0000","last_became_active":"2024-09-12T00:28:33.214018+0000","last_became_peered":"2024-09-12T00:28:33.214018+0000","last_unstale":"2024-09-12T01:35:31.547552+0000","last_undegraded":"2024-09-12T01:35:31.547552+0000","last_fullsized":"2024-09-12T01:35:31.547552+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:53.550703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":636,"num_read_kb":544,"num_write":220,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":614,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:31.723989+0000","last_change":"2024-09-12T00:28:14.748208+0000","last_active":"2024-09-12T01:34:31.723989+0000","last_peered":"2024-09-12T01:34:31.723989+0000","last_clean":"2024-09-12T01:34:31.723989+0000","last_became_active":"2024-09-12T00:28:14.744766+0000","last_became_peered":"2024-09-12T00:28:14.744766+0000","last_unstale":"2024-09-12T01:34:31.723989+0000","last_undegraded":"2024-09-12T01:34:31.723989+0000","last_fullsized":"2024-09-12T01:34:31.723989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:13.107271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:13.107271+0000","last_clean_scrub_stamp":"2024-09-12T00:28:13.107271+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:46.810948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"21'1","reported_seq":522,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:02.789773+0000","last_change":"2024-09-12T00:28:21.169710+0000","last_active":"2024-09-12T01:35:02.789773+0000","last_peered":"2024-09-12T01:35:02.789773+0000","last_clean":"2024-09-12T01:35:02.789773+0000","last_became_active":"2024-09-12T00:28:19.162328+0000","last_became_peered":"2024-09-12T00:28:19.162328+0000","last_unstale":"2024-09-12T01:35:02.789773+0000","last_undegraded":"2024-09-12T01:35:02.789773+0000","last_fullsized":"2024-09-12T01:35:02.789773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_clean_scrub_stamp":"2024-09-12T00:28:18.139537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:10.146909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046717800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"263'264","reported_seq":905,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:14.646937+0000","last_change":"2024-09-12T00:28:31.215764+0000","last_active":"2024-09-12T01:35:14.646937+0000","last_peered":"2024-09-12T01:35:14.646937+0000","last_clean":"2024-09-12T01:35:14.646937+0000","last_became_active":"2024-09-12T00:28:31.215485+0000","last_became_peered":"2024-09-12T00:28:31.215485+0000","last_unstale":"2024-09-12T01:35:14.646937+0000","last_undegraded":"2024-09-12T01:35:14.646937+0000","last_fullsized":"2024-09-12T01:35:14.646937+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:18.448556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16203515,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":406,"num_read_kb":39194,"num_write":1039,"num_write_kb":25197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.731330+0000","last_change":"2024-09-12T00:28:35.209125+0000","last_active":"2024-09-12T01:35:16.731330+0000","last_peered":"2024-09-12T01:35:16.731330+0000","last_clean":"2024-09-12T01:35:16.731330+0000","last_became_active":"2024-09-12T00:28:35.208812+0000","last_became_peered":"2024-09-12T00:28:35.208812+0000","last_unstale":"2024-09-12T01:35:16.731330+0000","last_undegraded":"2024-09-12T01:35:16.731330+0000","last_fullsized":"2024-09-12T01:35:16.731330+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:01.363469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"263'747","reported_seq":1462,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.795476+0000","last_change":"2024-09-12T00:28:37.221326+0000","last_active":"2024-09-12T01:38:01.795476+0000","last_peered":"2024-09-12T01:38:01.795476+0000","last_clean":"2024-09-12T01:38:01.795476+0000","last_became_active":"2024-09-12T00:28:37.221001+0000","last_became_peered":"2024-09-12T00:28:37.221001+0000","last_unstale":"2024-09-12T01:38:01.795476+0000","last_undegraded":"2024-09-12T01:38:01.795476+0000","last_fullsized":"2024-09-12T01:38:01.795476+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":700,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:20.998547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141781,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1456,"num_read_kb":3385,"num_write":1364,"num_write_kb":1192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:51.797587+0000","last_change":"2024-09-12T00:28:39.221623+0000","last_active":"2024-09-12T01:35:51.797587+0000","last_peered":"2024-09-12T01:35:51.797587+0000","last_clean":"2024-09-12T01:35:51.797587+0000","last_became_active":"2024-09-12T00:28:39.221007+0000","last_became_peered":"2024-09-12T00:28:39.221007+0000","last_unstale":"2024-09-12T01:35:51.797587+0000","last_undegraded":"2024-09-12T01:35:51.797587+0000","last_fullsized":"2024-09-12T01:35:51.797587+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:49.965506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"263'186","reported_seq":885,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:42.615741+0000","last_change":"2024-09-12T00:28:41.226364+0000","last_active":"2024-09-12T01:36:42.615741+0000","last_peered":"2024-09-12T01:36:42.615741+0000","last_clean":"2024-09-12T01:36:42.615741+0000","last_became_active":"2024-09-12T00:28:41.226077+0000","last_became_peered":"2024-09-12T00:28:41.226077+0000","last_unstale":"2024-09-12T01:36:42.615741+0000","last_undegraded":"2024-09-12T01:36:42.615741+0000","last_fullsized":"2024-09-12T01:36:42.615741+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:54.387034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":407,"num_read_kb":405,"num_write":366,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"263'200","reported_seq":809,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.797044+0000","last_change":"2024-09-12T00:28:33.214619+0000","last_active":"2024-09-12T01:35:46.797044+0000","last_peered":"2024-09-12T01:35:46.797044+0000","last_clean":"2024-09-12T01:35:46.797044+0000","last_became_active":"2024-09-12T00:28:33.214351+0000","last_became_peered":"2024-09-12T00:28:33.214351+0000","last_unstale":"2024-09-12T01:35:46.797044+0000","last_undegraded":"2024-09-12T01:35:46.797044+0000","last_fullsized":"2024-09-12T01:35:46.797044+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:27.014128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":877,"num_read_kb":731,"num_write":291,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.724871+0000","last_change":"2024-09-12T00:28:21.165739+0000","last_active":"2024-09-12T01:34:36.724871+0000","last_peered":"2024-09-12T01:34:36.724871+0000","last_clean":"2024-09-12T01:34:36.724871+0000","last_became_active":"2024-09-12T00:28:19.164970+0000","last_became_peered":"2024-09-12T00:28:19.164970+0000","last_unstale":"2024-09-12T01:34:36.724871+0000","last_undegraded":"2024-09-12T01:34:36.724871+0000","last_fullsized":"2024-09-12T01:34:36.724871+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_clean_scrub_stamp":"2024-09-12T00:28:18.139537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:32.778181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055291100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"263'372","reported_seq":1104,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.731893+0000","last_change":"2024-09-12T00:28:31.205110+0000","last_active":"2024-09-12T01:38:01.731893+0000","last_peered":"2024-09-12T01:38:01.731893+0000","last_clean":"2024-09-12T01:38:01.731893+0000","last_became_active":"2024-09-12T00:28:31.204842+0000","last_became_peered":"2024-09-12T00:28:31.204842+0000","last_unstale":"2024-09-12T01:38:01.731893+0000","last_undegraded":"2024-09-12T01:38:01.731893+0000","last_fullsized":"2024-09-12T01:38:01.731893+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:16.741760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":699,"num_read_kb":44079,"num_write":1206,"num_write_kb":29123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:47.796159+0000","last_change":"2024-09-12T00:28:35.216312+0000","last_active":"2024-09-12T01:35:47.796159+0000","last_peered":"2024-09-12T01:35:47.796159+0000","last_clean":"2024-09-12T01:35:47.796159+0000","last_became_active":"2024-09-12T00:28:35.215063+0000","last_became_peered":"2024-09-12T00:28:35.215063+0000","last_unstale":"2024-09-12T01:35:47.796159+0000","last_undegraded":"2024-09-12T01:35:47.796159+0000","last_fullsized":"2024-09-12T01:35:47.796159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:30.514762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"263'1361","reported_seq":3156,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.739191+0000","last_change":"2024-09-12T00:28:37.211623+0000","last_active":"2024-09-12T01:38:01.739191+0000","last_peered":"2024-09-12T01:38:01.739191+0000","last_clean":"2024-09-12T01:38:01.739191+0000","last_became_active":"2024-09-12T00:28:37.211275+0000","last_became_peered":"2024-09-12T00:28:37.211275+0000","last_unstale":"2024-09-12T01:38:01.739191+0000","last_undegraded":"2024-09-12T01:38:01.739191+0000","last_fullsized":"2024-09-12T01:38:01.739191+0000","mapping_epoch":31,"log_start":"263'1300","ondisk_log_start":"263'1300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":1300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:17.542912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145911,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2184,"num_read_kb":4297,"num_write":1290,"num_write_kb":1091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:36.734401+0000","last_change":"2024-09-12T00:28:39.217983+0000","last_active":"2024-09-12T01:35:36.734401+0000","last_peered":"2024-09-12T01:35:36.734401+0000","last_clean":"2024-09-12T01:35:36.734401+0000","last_became_active":"2024-09-12T00:28:39.217623+0000","last_became_peered":"2024-09-12T00:28:39.217623+0000","last_unstale":"2024-09-12T01:35:36.734401+0000","last_undegraded":"2024-09-12T01:35:36.734401+0000","last_fullsized":"2024-09-12T01:35:36.734401+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:06.473217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"263'261","reported_seq":805,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:13.164033+0000","last_change":"2024-09-12T00:28:41.255226+0000","last_active":"2024-09-12T01:36:13.164033+0000","last_peered":"2024-09-12T01:36:13.164033+0000","last_clean":"2024-09-12T01:36:13.164033+0000","last_became_active":"2024-09-12T00:28:41.254814+0000","last_became_peered":"2024-09-12T00:28:41.254814+0000","last_unstale":"2024-09-12T01:36:13.164033+0000","last_undegraded":"2024-09-12T01:36:13.164033+0000","last_fullsized":"2024-09-12T01:36:13.164033+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:30.223844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":416,"num_read_kb":400,"num_write":581,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"263'116","reported_seq":754,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.948067+0000","last_change":"2024-09-12T00:28:33.216657+0000","last_active":"2024-09-12T01:35:46.948067+0000","last_peered":"2024-09-12T01:35:46.948067+0000","last_clean":"2024-09-12T01:35:46.948067+0000","last_became_active":"2024-09-12T00:28:33.216335+0000","last_became_peered":"2024-09-12T00:28:33.216335+0000","last_unstale":"2024-09-12T01:35:46.948067+0000","last_undegraded":"2024-09-12T01:35:46.948067+0000","last_fullsized":"2024-09-12T01:35:46.948067+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:46.854089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":537,"num_read_kb":460,"num_write":159,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":528,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:01.533662+0000","last_change":"2024-09-12T00:28:21.323944+0000","last_active":"2024-09-12T01:35:01.533662+0000","last_peered":"2024-09-12T01:35:01.533662+0000","last_clean":"2024-09-12T01:35:01.533662+0000","last_became_active":"2024-09-12T00:28:19.225901+0000","last_became_peered":"2024-09-12T00:28:19.225901+0000","last_unstale":"2024-09-12T01:35:01.533662+0000","last_undegraded":"2024-09-12T01:35:01.533662+0000","last_fullsized":"2024-09-12T01:35:01.533662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_clean_scrub_stamp":"2024-09-12T00:28:18.139537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:52.557475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032319500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"263'337","reported_seq":1136,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.734889+0000","last_change":"2024-09-12T00:28:31.198866+0000","last_active":"2024-09-12T01:38:01.734889+0000","last_peered":"2024-09-12T01:38:01.734889+0000","last_clean":"2024-09-12T01:38:01.734889+0000","last_became_active":"2024-09-12T00:28:31.198575+0000","last_became_peered":"2024-09-12T00:28:31.198575+0000","last_unstale":"2024-09-12T01:38:01.734889+0000","last_undegraded":"2024-09-12T01:38:01.734889+0000","last_fullsized":"2024-09-12T01:38:01.734889+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:05.185444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3941571,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":832,"num_read_kb":78199,"num_write":1073,"num_write_kb":40255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.538695+0000","last_change":"2024-09-12T00:28:35.209485+0000","last_active":"2024-09-12T01:35:46.538695+0000","last_peered":"2024-09-12T01:35:46.538695+0000","last_clean":"2024-09-12T01:35:46.538695+0000","last_became_active":"2024-09-12T00:28:35.209218+0000","last_became_peered":"2024-09-12T00:28:35.209218+0000","last_unstale":"2024-09-12T01:35:46.538695+0000","last_undegraded":"2024-09-12T01:35:46.538695+0000","last_fullsized":"2024-09-12T01:35:46.538695+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:55.033156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"263'279","reported_seq":1658,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:43.275282+0000","last_change":"2024-09-12T00:28:37.424055+0000","last_active":"2024-09-12T01:37:43.275282+0000","last_peered":"2024-09-12T01:37:43.275282+0000","last_clean":"2024-09-12T01:37:43.275282+0000","last_became_active":"2024-09-12T00:28:37.423714+0000","last_became_peered":"2024-09-12T00:28:37.423714+0000","last_unstale":"2024-09-12T01:37:43.275282+0000","last_undegraded":"2024-09-12T01:37:43.275282+0000","last_fullsized":"2024-09-12T01:37:43.275282+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:07.336278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":244,"num_read_kb":234,"num_write":227,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:21.793908+0000","last_change":"2024-09-12T00:28:39.218980+0000","last_active":"2024-09-12T01:35:21.793908+0000","last_peered":"2024-09-12T01:35:21.793908+0000","last_clean":"2024-09-12T01:35:21.793908+0000","last_became_active":"2024-09-12T00:28:39.218692+0000","last_became_peered":"2024-09-12T00:28:39.218692+0000","last_unstale":"2024-09-12T01:35:21.793908+0000","last_undegraded":"2024-09-12T01:35:21.793908+0000","last_fullsized":"2024-09-12T01:35:21.793908+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:07.969643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"263'252","reported_seq":855,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:45.936486+0000","last_change":"2024-09-12T00:28:41.229721+0000","last_active":"2024-09-12T01:37:45.936486+0000","last_peered":"2024-09-12T01:37:45.936486+0000","last_clean":"2024-09-12T01:37:45.936486+0000","last_became_active":"2024-09-12T00:28:41.229441+0000","last_became_peered":"2024-09-12T00:28:41.229441+0000","last_unstale":"2024-09-12T01:37:45.936486+0000","last_undegraded":"2024-09-12T01:37:45.936486+0000","last_fullsized":"2024-09-12T01:37:45.936486+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:46.056278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":487,"num_read_kb":509,"num_write":546,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"263'223","reported_seq":896,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:58.635373+0000","last_change":"2024-09-12T00:28:33.205511+0000","last_active":"2024-09-12T01:35:58.635373+0000","last_peered":"2024-09-12T01:35:58.635373+0000","last_clean":"2024-09-12T01:35:58.635373+0000","last_became_active":"2024-09-12T00:28:33.205107+0000","last_became_peered":"2024-09-12T00:28:33.205107+0000","last_unstale":"2024-09-12T01:35:58.635373+0000","last_undegraded":"2024-09-12T01:35:58.635373+0000","last_fullsized":"2024-09-12T01:35:58.635373+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:39.413290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1021,"num_read_kb":847,"num_write":335,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"23'2","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:02.789730+0000","last_change":"2024-09-12T00:28:21.170135+0000","last_active":"2024-09-12T01:35:02.789730+0000","last_peered":"2024-09-12T01:35:02.789730+0000","last_clean":"2024-09-12T01:35:02.789730+0000","last_became_active":"2024-09-12T00:28:19.162307+0000","last_became_peered":"2024-09-12T00:28:19.162307+0000","last_unstale":"2024-09-12T01:35:02.789730+0000","last_undegraded":"2024-09-12T01:35:02.789730+0000","last_fullsized":"2024-09-12T01:35:02.789730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_clean_scrub_stamp":"2024-09-12T00:28:18.139537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:21.559693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089189499999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"263'346","reported_seq":1030,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.522162+0000","last_change":"2024-09-12T00:28:31.208859+0000","last_active":"2024-09-12T01:38:01.522162+0000","last_peered":"2024-09-12T01:38:01.522162+0000","last_clean":"2024-09-12T01:38:01.522162+0000","last_became_active":"2024-09-12T00:28:31.208584+0000","last_became_peered":"2024-09-12T00:28:31.208584+0000","last_unstale":"2024-09-12T01:38:01.522162+0000","last_undegraded":"2024-09-12T01:38:01.522162+0000","last_fullsized":"2024-09-12T01:38:01.522162+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:48.765543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":266336,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":632,"num_read_kb":7750,"num_write":1113,"num_write_kb":19514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:26.794599+0000","last_change":"2024-09-12T00:28:35.207488+0000","last_active":"2024-09-12T01:35:26.794599+0000","last_peered":"2024-09-12T01:35:26.794599+0000","last_clean":"2024-09-12T01:35:26.794599+0000","last_became_active":"2024-09-12T00:28:35.207234+0000","last_became_peered":"2024-09-12T00:28:35.207234+0000","last_unstale":"2024-09-12T01:35:26.794599+0000","last_undegraded":"2024-09-12T01:35:26.794599+0000","last_fullsized":"2024-09-12T01:35:26.794599+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:43.759273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"263'160","reported_seq":717,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:47.314594+0000","last_change":"2024-09-12T00:28:37.219924+0000","last_active":"2024-09-12T01:37:47.314594+0000","last_peered":"2024-09-12T01:37:47.314594+0000","last_clean":"2024-09-12T01:37:47.314594+0000","last_became_active":"2024-09-12T00:28:37.219599+0000","last_became_peered":"2024-09-12T00:28:37.219599+0000","last_unstale":"2024-09-12T01:37:47.314594+0000","last_undegraded":"2024-09-12T01:37:47.314594+0000","last_fullsized":"2024-09-12T01:37:47.314594+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:19.639653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":184,"num_read_kb":176,"num_write":136,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:51.550499+0000","last_change":"2024-09-12T00:28:39.216740+0000","last_active":"2024-09-12T01:35:51.550499+0000","last_peered":"2024-09-12T01:35:51.550499+0000","last_clean":"2024-09-12T01:35:51.550499+0000","last_became_active":"2024-09-12T00:28:39.216397+0000","last_became_peered":"2024-09-12T00:28:39.216397+0000","last_unstale":"2024-09-12T01:35:51.550499+0000","last_undegraded":"2024-09-12T01:35:51.550499+0000","last_fullsized":"2024-09-12T01:35:51.550499+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:48.659805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"263'110","reported_seq":655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:52.796953+0000","last_change":"2024-09-12T00:28:41.230939+0000","last_active":"2024-09-12T01:35:52.796953+0000","last_peered":"2024-09-12T01:35:52.796953+0000","last_clean":"2024-09-12T01:35:52.796953+0000","last_became_active":"2024-09-12T00:28:41.230698+0000","last_became_peered":"2024-09-12T00:28:41.230698+0000","last_unstale":"2024-09-12T01:35:52.796953+0000","last_undegraded":"2024-09-12T01:35:52.796953+0000","last_fullsized":"2024-09-12T01:35:52.796953+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:35.474853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":194,"num_write":246,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"263'101","reported_seq":687,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.944551+0000","last_change":"2024-09-12T00:28:33.214613+0000","last_active":"2024-09-12T01:35:16.944551+0000","last_peered":"2024-09-12T01:35:16.944551+0000","last_clean":"2024-09-12T01:35:16.944551+0000","last_became_active":"2024-09-12T00:28:33.213241+0000","last_became_peered":"2024-09-12T00:28:33.213241+0000","last_unstale":"2024-09-12T01:35:16.944551+0000","last_undegraded":"2024-09-12T01:35:16.944551+0000","last_fullsized":"2024-09-12T01:35:16.944551+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:03.213237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":440,"num_read_kb":364,"num_write":181,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"263'329","reported_seq":945,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.760799+0000","last_change":"2024-09-12T00:28:31.209668+0000","last_active":"2024-09-12T01:38:01.760799+0000","last_peered":"2024-09-12T01:38:01.760799+0000","last_clean":"2024-09-12T01:38:01.760799+0000","last_became_active":"2024-09-12T00:28:31.209154+0000","last_became_peered":"2024-09-12T00:28:31.209154+0000","last_unstale":"2024-09-12T01:38:01.760799+0000","last_undegraded":"2024-09-12T01:38:01.760799+0000","last_fullsized":"2024-09-12T01:38:01.760799+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:20.428733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":854338,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":445,"num_read_kb":910,"num_write":1009,"num_write_kb":5944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":533,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:01.942757+0000","last_change":"2024-09-12T00:28:21.163542+0000","last_active":"2024-09-12T01:35:01.942757+0000","last_peered":"2024-09-12T01:35:01.942757+0000","last_clean":"2024-09-12T01:35:01.942757+0000","last_became_active":"2024-09-12T00:28:19.383394+0000","last_became_peered":"2024-09-12T00:28:19.383394+0000","last_unstale":"2024-09-12T01:35:01.942757+0000","last_undegraded":"2024-09-12T01:35:01.942757+0000","last_fullsized":"2024-09-12T01:35:01.942757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_clean_scrub_stamp":"2024-09-12T00:28:18.139537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:28.230151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046548800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.793286+0000","last_change":"2024-09-12T00:28:35.208415+0000","last_active":"2024-09-12T01:35:16.793286+0000","last_peered":"2024-09-12T01:35:16.793286+0000","last_clean":"2024-09-12T01:35:16.793286+0000","last_became_active":"2024-09-12T00:28:35.208094+0000","last_became_peered":"2024-09-12T00:28:35.208094+0000","last_unstale":"2024-09-12T01:35:16.793286+0000","last_undegraded":"2024-09-12T01:35:16.793286+0000","last_fullsized":"2024-09-12T01:35:16.793286+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:03.328037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"263'655","reported_seq":1348,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.420767+0000","last_change":"2024-09-12T00:28:37.221025+0000","last_active":"2024-09-12T01:38:01.420767+0000","last_peered":"2024-09-12T01:38:01.420767+0000","last_clean":"2024-09-12T01:38:01.420767+0000","last_became_active":"2024-09-12T00:28:37.220158+0000","last_became_peered":"2024-09-12T00:28:37.220158+0000","last_unstale":"2024-09-12T01:38:01.420767+0000","last_undegraded":"2024-09-12T01:38:01.420767+0000","last_fullsized":"2024-09-12T01:38:01.420767+0000","mapping_epoch":31,"log_start":"263'600","ondisk_log_start":"263'600","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":600,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:50.143092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103952,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1701,"num_read_kb":3039,"num_write":2184,"num_write_kb":1992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:21.546179+0000","last_change":"2024-09-12T00:28:39.220506+0000","last_active":"2024-09-12T01:35:21.546179+0000","last_peered":"2024-09-12T01:35:21.546179+0000","last_clean":"2024-09-12T01:35:21.546179+0000","last_became_active":"2024-09-12T00:28:39.220079+0000","last_became_peered":"2024-09-12T00:28:39.220079+0000","last_unstale":"2024-09-12T01:35:21.546179+0000","last_undegraded":"2024-09-12T01:35:21.546179+0000","last_fullsized":"2024-09-12T01:35:21.546179+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:23.654340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"263'134","reported_seq":653,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.800037+0000","last_change":"2024-09-12T00:28:41.258045+0000","last_active":"2024-09-12T01:36:11.800037+0000","last_peered":"2024-09-12T01:36:11.800037+0000","last_clean":"2024-09-12T01:36:11.800037+0000","last_became_active":"2024-09-12T00:28:41.257739+0000","last_became_peered":"2024-09-12T00:28:41.257739+0000","last_unstale":"2024-09-12T01:36:11.800037+0000","last_undegraded":"2024-09-12T01:36:11.800037+0000","last_fullsized":"2024-09-12T01:36:11.800037+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:03.828940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":203,"num_read_kb":182,"num_write":334,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"263'142","reported_seq":775,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.793315+0000","last_change":"2024-09-12T00:28:33.216340+0000","last_active":"2024-09-12T01:35:16.793315+0000","last_peered":"2024-09-12T01:35:16.793315+0000","last_clean":"2024-09-12T01:35:16.793315+0000","last_became_active":"2024-09-12T00:28:33.216065+0000","last_became_peered":"2024-09-12T00:28:33.216065+0000","last_unstale":"2024-09-12T01:35:16.793315+0000","last_undegraded":"2024-09-12T01:35:16.793315+0000","last_fullsized":"2024-09-12T01:35:16.793315+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:28.642231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":614,"num_read_kb":525,"num_write":208,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"263'340","reported_seq":1000,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.764779+0000","last_change":"2024-09-12T00:28:31.199416+0000","last_active":"2024-09-12T01:38:01.764779+0000","last_peered":"2024-09-12T01:38:01.764779+0000","last_clean":"2024-09-12T01:38:01.764779+0000","last_became_active":"2024-09-12T00:28:31.198681+0000","last_became_peered":"2024-09-12T00:28:31.198681+0000","last_unstale":"2024-09-12T01:38:01.764779+0000","last_undegraded":"2024-09-12T01:38:01.764779+0000","last_fullsized":"2024-09-12T01:38:01.764779+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:11.597114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550835,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":482,"num_read_kb":38182,"num_write":1051,"num_write_kb":26889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":522,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.731345+0000","last_change":"2024-09-12T00:28:21.165802+0000","last_active":"2024-09-12T01:35:16.731345+0000","last_peered":"2024-09-12T01:35:16.731345+0000","last_clean":"2024-09-12T01:35:16.731345+0000","last_became_active":"2024-09-12T00:28:19.384222+0000","last_became_peered":"2024-09-12T00:28:19.384222+0000","last_unstale":"2024-09-12T01:35:16.731345+0000","last_undegraded":"2024-09-12T01:35:16.731345+0000","last_fullsized":"2024-09-12T01:35:16.731345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_clean_scrub_stamp":"2024-09-12T00:28:18.139537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:40.635892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060999899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"37'5","reported_seq":982,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:59.821892+0000","last_change":"2024-09-12T00:28:35.208566+0000","last_active":"2024-09-12T01:37:59.821892+0000","last_peered":"2024-09-12T01:37:59.821892+0000","last_clean":"2024-09-12T01:37:59.821892+0000","last_became_active":"2024-09-12T00:28:35.207941+0000","last_became_peered":"2024-09-12T00:28:35.207941+0000","last_unstale":"2024-09-12T01:37:59.821892+0000","last_undegraded":"2024-09-12T01:37:59.821892+0000","last_fullsized":"2024-09-12T01:37:59.821892+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:30.697798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":1191,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"263'246","reported_seq":839,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:48.927414+0000","last_change":"2024-09-12T00:28:37.424197+0000","last_active":"2024-09-12T01:36:48.927414+0000","last_peered":"2024-09-12T01:36:48.927414+0000","last_clean":"2024-09-12T01:36:48.927414+0000","last_became_active":"2024-09-12T00:28:37.423835+0000","last_became_peered":"2024-09-12T00:28:37.423835+0000","last_unstale":"2024-09-12T01:36:48.927414+0000","last_undegraded":"2024-09-12T01:36:48.927414+0000","last_fullsized":"2024-09-12T01:36:48.927414+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:55.348547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":310,"num_read_kb":301,"num_write":288,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"263'781","reported_seq":2896,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.556589+0000","last_change":"2024-09-12T00:28:39.214336+0000","last_active":"2024-09-12T01:38:01.556589+0000","last_peered":"2024-09-12T01:38:01.556589+0000","last_clean":"2024-09-12T01:38:01.556589+0000","last_became_active":"2024-09-12T00:28:39.214050+0000","last_became_peered":"2024-09-12T00:28:39.214050+0000","last_unstale":"2024-09-12T01:38:01.556589+0000","last_undegraded":"2024-09-12T01:38:01.556589+0000","last_fullsized":"2024-09-12T01:38:01.556589+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:42.935841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"263'143","reported_seq":656,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:29.656020+0000","last_change":"2024-09-12T00:28:41.255145+0000","last_active":"2024-09-12T01:36:29.656020+0000","last_peered":"2024-09-12T01:36:29.656020+0000","last_clean":"2024-09-12T01:36:29.656020+0000","last_became_active":"2024-09-12T00:28:41.254826+0000","last_became_peered":"2024-09-12T00:28:41.254826+0000","last_unstale":"2024-09-12T01:36:29.656020+0000","last_undegraded":"2024-09-12T01:36:29.656020+0000","last_fullsized":"2024-09-12T01:36:29.656020+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:08.523605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1298,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":177,"num_read_kb":162,"num_write":341,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"263'307","reported_seq":910,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:37.788688+0000","last_change":"2024-09-12T00:28:33.217822+0000","last_active":"2024-09-12T01:35:37.788688+0000","last_peered":"2024-09-12T01:35:37.788688+0000","last_clean":"2024-09-12T01:35:37.788688+0000","last_became_active":"2024-09-12T00:28:33.217516+0000","last_became_peered":"2024-09-12T00:28:33.217516+0000","last_unstale":"2024-09-12T01:35:37.788688+0000","last_undegraded":"2024-09-12T01:35:37.788688+0000","last_fullsized":"2024-09-12T01:35:37.788688+0000","mapping_epoch":27,"log_start":"260'200","ondisk_log_start":"260'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:49.139392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1312,"num_read_kb":1045,"num_write":501,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"263'242","reported_seq":836,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:44.650445+0000","last_change":"2024-09-12T00:28:31.203440+0000","last_active":"2024-09-12T01:35:44.650445+0000","last_peered":"2024-09-12T01:35:44.650445+0000","last_clean":"2024-09-12T01:35:44.650445+0000","last_became_active":"2024-09-12T00:28:31.202895+0000","last_became_peered":"2024-09-12T00:28:31.202895+0000","last_unstale":"2024-09-12T01:35:44.650445+0000","last_undegraded":"2024-09-12T01:35:44.650445+0000","last_fullsized":"2024-09-12T01:35:44.650445+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:43.468294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5508333,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":302,"num_read_kb":358,"num_write":890,"num_write_kb":25812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":532,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:31.946415+0000","last_change":"2024-09-12T00:28:21.163585+0000","last_active":"2024-09-12T01:35:31.946415+0000","last_peered":"2024-09-12T01:35:31.946415+0000","last_clean":"2024-09-12T01:35:31.946415+0000","last_became_active":"2024-09-12T00:28:19.160344+0000","last_became_peered":"2024-09-12T00:28:19.160344+0000","last_unstale":"2024-09-12T01:35:31.946415+0000","last_undegraded":"2024-09-12T01:35:31.946415+0000","last_fullsized":"2024-09-12T01:35:31.946415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_clean_scrub_stamp":"2024-09-12T00:28:18.139537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:57.842057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000483707,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.545492+0000","last_change":"2024-09-12T00:28:35.215757+0000","last_active":"2024-09-12T01:35:16.545492+0000","last_peered":"2024-09-12T01:35:16.545492+0000","last_clean":"2024-09-12T01:35:16.545492+0000","last_became_active":"2024-09-12T00:28:35.215429+0000","last_became_peered":"2024-09-12T00:28:35.215429+0000","last_unstale":"2024-09-12T01:35:16.545492+0000","last_undegraded":"2024-09-12T01:35:16.545492+0000","last_fullsized":"2024-09-12T01:35:16.545492+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:04.938748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"263'130","reported_seq":687,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.545524+0000","last_change":"2024-09-12T00:28:37.220271+0000","last_active":"2024-09-12T01:35:16.545524+0000","last_peered":"2024-09-12T01:35:16.545524+0000","last_clean":"2024-09-12T01:35:16.545524+0000","last_became_active":"2024-09-12T00:28:37.219746+0000","last_became_peered":"2024-09-12T00:28:37.219746+0000","last_unstale":"2024-09-12T01:35:16.545524+0000","last_undegraded":"2024-09-12T01:35:16.545524+0000","last_fullsized":"2024-09-12T01:35:16.545524+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:18.690666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":158,"num_read_kb":152,"num_write":104,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"263'764","reported_seq":2679,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:49.984028+0000","last_change":"2024-09-12T00:28:39.218435+0000","last_active":"2024-09-12T01:37:49.984028+0000","last_peered":"2024-09-12T01:37:49.984028+0000","last_clean":"2024-09-12T01:37:49.984028+0000","last_became_active":"2024-09-12T00:28:39.218170+0000","last_became_peered":"2024-09-12T00:28:39.218170+0000","last_unstale":"2024-09-12T01:37:49.984028+0000","last_undegraded":"2024-09-12T01:37:49.984028+0000","last_fullsized":"2024-09-12T01:37:49.984028+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":700,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:17.381935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"263'181","reported_seq":680,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.783783+0000","last_change":"2024-09-12T00:28:41.225659+0000","last_active":"2024-09-12T01:33:56.783783+0000","last_peered":"2024-09-12T01:33:56.783783+0000","last_clean":"2024-09-12T01:33:56.783783+0000","last_became_active":"2024-09-12T00:28:41.225316+0000","last_became_peered":"2024-09-12T00:28:41.225316+0000","last_unstale":"2024-09-12T01:33:56.783783+0000","last_undegraded":"2024-09-12T01:33:56.783783+0000","last_fullsized":"2024-09-12T01:33:56.783783+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:54.404729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":127,"num_read_kb":125,"num_write":428,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"263'342","reported_seq":978,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:20.408095+0000","last_change":"2024-09-12T00:28:33.212942+0000","last_active":"2024-09-12T01:36:20.408095+0000","last_peered":"2024-09-12T01:36:20.408095+0000","last_clean":"2024-09-12T01:36:20.408095+0000","last_became_active":"2024-09-12T00:28:33.212624+0000","last_became_peered":"2024-09-12T00:28:33.212624+0000","last_unstale":"2024-09-12T01:36:20.408095+0000","last_undegraded":"2024-09-12T01:36:20.408095+0000","last_fullsized":"2024-09-12T01:36:20.408095+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:49.030957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1481,"num_read_kb":1196,"num_write":544,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"263'449","reported_seq":1164,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.751547+0000","last_change":"2024-09-12T00:28:31.203441+0000","last_active":"2024-09-12T01:38:01.751547+0000","last_peered":"2024-09-12T01:38:01.751547+0000","last_clean":"2024-09-12T01:38:01.751547+0000","last_became_active":"2024-09-12T00:28:31.203087+0000","last_became_peered":"2024-09-12T00:28:31.203087+0000","last_unstale":"2024-09-12T01:38:01.751547+0000","last_undegraded":"2024-09-12T01:38:01.751547+0000","last_fullsized":"2024-09-12T01:38:01.751547+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:34.969519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":607243,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":857,"num_read_kb":36686,"num_write":1272,"num_write_kb":31229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:31.547584+0000","last_change":"2024-09-12T00:28:21.324169+0000","last_active":"2024-09-12T01:35:31.547584+0000","last_peered":"2024-09-12T01:35:31.547584+0000","last_clean":"2024-09-12T01:35:31.547584+0000","last_became_active":"2024-09-12T00:28:19.162886+0000","last_became_peered":"2024-09-12T00:28:19.162886+0000","last_unstale":"2024-09-12T01:35:31.547584+0000","last_undegraded":"2024-09-12T01:35:31.547584+0000","last_fullsized":"2024-09-12T01:35:31.547584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_clean_scrub_stamp":"2024-09-12T00:28:18.139537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:37.883634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044054899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:49.643998+0000","last_change":"2024-09-12T00:28:35.213217+0000","last_active":"2024-09-12T01:34:49.643998+0000","last_peered":"2024-09-12T01:34:49.643998+0000","last_clean":"2024-09-12T01:34:49.643998+0000","last_became_active":"2024-09-12T00:28:35.212916+0000","last_became_peered":"2024-09-12T00:28:35.212916+0000","last_unstale":"2024-09-12T01:34:49.643998+0000","last_undegraded":"2024-09-12T01:34:49.643998+0000","last_fullsized":"2024-09-12T01:34:49.643998+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:29.058758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"263'763","reported_seq":1501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.569644+0000","last_change":"2024-09-12T00:28:37.424089+0000","last_active":"2024-09-12T01:38:01.569644+0000","last_peered":"2024-09-12T01:38:01.569644+0000","last_clean":"2024-09-12T01:38:01.569644+0000","last_became_active":"2024-09-12T00:28:37.423755+0000","last_became_peered":"2024-09-12T00:28:37.423755+0000","last_unstale":"2024-09-12T01:38:01.569644+0000","last_undegraded":"2024-09-12T01:38:01.569644+0000","last_fullsized":"2024-09-12T01:38:01.569644+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:34.013923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138292,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1365,"num_read_kb":3277,"num_write":1104,"num_write_kb":888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:19.647506+0000","last_change":"2024-09-12T00:28:39.216520+0000","last_active":"2024-09-12T01:35:19.647506+0000","last_peered":"2024-09-12T01:35:19.647506+0000","last_clean":"2024-09-12T01:35:19.647506+0000","last_became_active":"2024-09-12T00:28:39.216237+0000","last_became_peered":"2024-09-12T00:28:39.216237+0000","last_unstale":"2024-09-12T01:35:19.647506+0000","last_undegraded":"2024-09-12T01:35:19.647506+0000","last_fullsized":"2024-09-12T01:35:19.647506+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:00.630922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"263'83","reported_seq":575,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:57.780634+0000","last_change":"2024-09-12T00:28:41.234000+0000","last_active":"2024-09-12T01:33:57.780634+0000","last_peered":"2024-09-12T01:33:57.780634+0000","last_clean":"2024-09-12T01:33:57.780634+0000","last_became_active":"2024-09-12T00:28:41.233696+0000","last_became_peered":"2024-09-12T00:28:41.233696+0000","last_unstale":"2024-09-12T01:33:57.780634+0000","last_undegraded":"2024-09-12T01:33:57.780634+0000","last_fullsized":"2024-09-12T01:33:57.780634+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:56.154197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":84,"num_read_kb":82,"num_write":190,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"263'149","reported_seq":715,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:42.805442+0000","last_change":"2024-09-12T00:28:41.226966+0000","last_active":"2024-09-12T01:36:42.805442+0000","last_peered":"2024-09-12T01:36:42.805442+0000","last_clean":"2024-09-12T01:36:42.805442+0000","last_became_active":"2024-09-12T00:28:41.226143+0000","last_became_peered":"2024-09-12T00:28:41.226143+0000","last_unstale":"2024-09-12T01:36:42.805442+0000","last_undegraded":"2024-09-12T01:36:42.805442+0000","last_fullsized":"2024-09-12T01:36:42.805442+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:18.139245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":251,"num_read_kb":240,"num_write":350,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"263'64","reported_seq":620,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:00.504480+0000","last_change":"2024-09-12T00:28:33.210002+0000","last_active":"2024-09-12T01:34:00.504480+0000","last_peered":"2024-09-12T01:34:00.504480+0000","last_clean":"2024-09-12T01:34:00.504480+0000","last_became_active":"2024-09-12T00:28:33.209335+0000","last_became_peered":"2024-09-12T00:28:33.209335+0000","last_unstale":"2024-09-12T01:34:00.504480+0000","last_undegraded":"2024-09-12T01:34:00.504480+0000","last_fullsized":"2024-09-12T01:34:00.504480+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:09.521704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":218,"num_write":93,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"263'381","reported_seq":1062,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.500975+0000","last_change":"2024-09-12T00:29:04.295940+0000","last_active":"2024-09-12T01:38:01.500975+0000","last_peered":"2024-09-12T01:38:01.500975+0000","last_clean":"2024-09-12T01:38:01.500975+0000","last_became_active":"2024-09-12T00:29:04.295676+0000","last_became_peered":"2024-09-12T00:29:04.295676+0000","last_unstale":"2024-09-12T01:38:01.500975+0000","last_undegraded":"2024-09-12T01:38:01.500975+0000","last_fullsized":"2024-09-12T01:38:01.500975+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:49.747597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2554861,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":751,"num_read_kb":17367,"num_write":1233,"num_write_kb":40068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.933837+0000","last_change":"2024-09-12T00:28:35.208489+0000","last_active":"2024-09-12T01:33:56.933837+0000","last_peered":"2024-09-12T01:33:56.933837+0000","last_clean":"2024-09-12T01:33:56.933837+0000","last_became_active":"2024-09-12T00:28:35.208165+0000","last_became_peered":"2024-09-12T00:28:35.208165+0000","last_unstale":"2024-09-12T01:33:56.933837+0000","last_undegraded":"2024-09-12T01:33:56.933837+0000","last_fullsized":"2024-09-12T01:33:56.933837+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:27.761289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"263'292","reported_seq":879,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:19.654666+0000","last_change":"2024-09-12T00:28:37.217911+0000","last_active":"2024-09-12T01:36:19.654666+0000","last_peered":"2024-09-12T01:36:19.654666+0000","last_clean":"2024-09-12T01:36:19.654666+0000","last_became_active":"2024-09-12T00:28:37.217603+0000","last_became_peered":"2024-09-12T00:28:37.217603+0000","last_unstale":"2024-09-12T01:36:19.654666+0000","last_undegraded":"2024-09-12T01:36:19.654666+0000","last_fullsized":"2024-09-12T01:36:19.654666+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:00.439250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52004,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":474,"num_read_kb":983,"num_write":384,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:59.638101+0000","last_change":"2024-09-12T00:28:39.216498+0000","last_active":"2024-09-12T01:33:59.638101+0000","last_peered":"2024-09-12T01:33:59.638101+0000","last_clean":"2024-09-12T01:33:59.638101+0000","last_became_active":"2024-09-12T00:28:39.216143+0000","last_became_peered":"2024-09-12T00:28:39.216143+0000","last_unstale":"2024-09-12T01:33:59.638101+0000","last_undegraded":"2024-09-12T01:33:59.638101+0000","last_fullsized":"2024-09-12T01:33:59.638101+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:29.237838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"263'119","reported_seq":632,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:42.721881+0000","last_change":"2024-09-12T00:28:41.232566+0000","last_active":"2024-09-12T01:36:42.721881+0000","last_peered":"2024-09-12T01:36:42.721881+0000","last_clean":"2024-09-12T01:36:42.721881+0000","last_became_active":"2024-09-12T00:28:41.232114+0000","last_became_peered":"2024-09-12T00:28:41.232114+0000","last_unstale":"2024-09-12T01:36:42.721881+0000","last_undegraded":"2024-09-12T01:36:42.721881+0000","last_fullsized":"2024-09-12T01:36:42.721881+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:39.890316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":141,"num_write":283,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"263'346","reported_seq":1045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.019124+0000","last_change":"2024-09-12T00:29:04.292672+0000","last_active":"2024-09-12T01:37:46.019124+0000","last_peered":"2024-09-12T01:37:46.019124+0000","last_clean":"2024-09-12T01:37:46.019124+0000","last_became_active":"2024-09-12T00:29:04.292302+0000","last_became_peered":"2024-09-12T00:29:04.292302+0000","last_unstale":"2024-09-12T01:37:46.019124+0000","last_undegraded":"2024-09-12T01:37:46.019124+0000","last_fullsized":"2024-09-12T01:37:46.019124+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:30.169396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1719,"num_read_kb":1484,"num_write":537,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"263'386","reported_seq":1163,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.715162+0000","last_change":"2024-09-12T00:28:31.208025+0000","last_active":"2024-09-12T01:38:01.715162+0000","last_peered":"2024-09-12T01:38:01.715162+0000","last_clean":"2024-09-12T01:38:01.715162+0000","last_became_active":"2024-09-12T00:28:31.207765+0000","last_became_peered":"2024-09-12T00:28:31.207765+0000","last_unstale":"2024-09-12T01:38:01.715162+0000","last_undegraded":"2024-09-12T01:38:01.715162+0000","last_fullsized":"2024-09-12T01:38:01.715162+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:36.097785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2529502,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":736,"num_read_kb":9284,"num_write":1355,"num_write_kb":41598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:54.637512+0000","last_change":"2024-09-12T00:28:35.212549+0000","last_active":"2024-09-12T01:33:54.637512+0000","last_peered":"2024-09-12T01:33:54.637512+0000","last_clean":"2024-09-12T01:33:54.637512+0000","last_became_active":"2024-09-12T00:28:35.212243+0000","last_became_peered":"2024-09-12T00:28:35.212243+0000","last_unstale":"2024-09-12T01:33:54.637512+0000","last_undegraded":"2024-09-12T01:33:54.637512+0000","last_fullsized":"2024-09-12T01:33:54.637512+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:02.038789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"263'57","reported_seq":565,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.783705+0000","last_change":"2024-09-12T00:28:37.220699+0000","last_active":"2024-09-12T01:33:56.783705+0000","last_peered":"2024-09-12T01:33:56.783705+0000","last_clean":"2024-09-12T01:33:56.783705+0000","last_became_active":"2024-09-12T00:28:37.219799+0000","last_became_peered":"2024-09-12T00:28:37.219799+0000","last_unstale":"2024-09-12T01:33:56.783705+0000","last_undegraded":"2024-09-12T01:33:56.783705+0000","last_fullsized":"2024-09-12T01:33:56.783705+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:52.584996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":42,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:01.719361+0000","last_change":"2024-09-12T00:28:39.219540+0000","last_active":"2024-09-12T01:34:01.719361+0000","last_peered":"2024-09-12T01:34:01.719361+0000","last_clean":"2024-09-12T01:34:01.719361+0000","last_became_active":"2024-09-12T00:28:39.219209+0000","last_became_peered":"2024-09-12T00:28:39.219209+0000","last_unstale":"2024-09-12T01:34:01.719361+0000","last_undegraded":"2024-09-12T01:34:01.719361+0000","last_fullsized":"2024-09-12T01:34:01.719361+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:53.327778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"263'211","reported_seq":739,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:41.517803+0000","last_change":"2024-09-12T00:28:41.226184+0000","last_active":"2024-09-12T01:36:41.517803+0000","last_peered":"2024-09-12T01:36:41.517803+0000","last_clean":"2024-09-12T01:36:41.517803+0000","last_became_active":"2024-09-12T00:28:41.225673+0000","last_became_peered":"2024-09-12T00:28:41.225673+0000","last_unstale":"2024-09-12T01:36:41.517803+0000","last_undegraded":"2024-09-12T01:36:41.517803+0000","last_fullsized":"2024-09-12T01:36:41.517803+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:16.037270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":332,"num_read_kb":318,"num_write":482,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"263'71","reported_seq":693,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:54.637476+0000","last_change":"2024-09-12T00:28:33.214078+0000","last_active":"2024-09-12T01:33:54.637476+0000","last_peered":"2024-09-12T01:33:54.637476+0000","last_clean":"2024-09-12T01:33:54.637476+0000","last_became_active":"2024-09-12T00:28:33.213777+0000","last_became_peered":"2024-09-12T00:28:33.213777+0000","last_unstale":"2024-09-12T01:33:54.637476+0000","last_undegraded":"2024-09-12T01:33:54.637476+0000","last_fullsized":"2024-09-12T01:33:54.637476+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:02.647251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":365,"num_read_kb":325,"num_write":89,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"263'341","reported_seq":968,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.731971+0000","last_change":"2024-09-12T00:28:31.214433+0000","last_active":"2024-09-12T01:38:01.731971+0000","last_peered":"2024-09-12T01:38:01.731971+0000","last_clean":"2024-09-12T01:38:01.731971+0000","last_became_active":"2024-09-12T00:28:31.213567+0000","last_became_peered":"2024-09-12T00:28:31.213567+0000","last_unstale":"2024-09-12T01:38:01.731971+0000","last_undegraded":"2024-09-12T01:38:01.731971+0000","last_fullsized":"2024-09-12T01:38:01.731971+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:37.746979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262191,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":463,"num_read_kb":31334,"num_write":999,"num_write_kb":46181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.718581+0000","last_change":"2024-09-12T00:28:35.210262+0000","last_active":"2024-09-12T01:33:56.718581+0000","last_peered":"2024-09-12T01:33:56.718581+0000","last_clean":"2024-09-12T01:33:56.718581+0000","last_became_active":"2024-09-12T00:28:35.210000+0000","last_became_peered":"2024-09-12T00:28:35.210000+0000","last_unstale":"2024-09-12T01:33:56.718581+0000","last_undegraded":"2024-09-12T01:33:56.718581+0000","last_fullsized":"2024-09-12T01:33:56.718581+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:21.147847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"263'330","reported_seq":927,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.037803+0000","last_change":"2024-09-12T00:28:37.222936+0000","last_active":"2024-09-12T01:37:46.037803+0000","last_peered":"2024-09-12T01:37:46.037803+0000","last_clean":"2024-09-12T01:37:46.037803+0000","last_became_active":"2024-09-12T00:28:37.222678+0000","last_became_peered":"2024-09-12T00:28:37.222678+0000","last_unstale":"2024-09-12T01:37:46.037803+0000","last_undegraded":"2024-09-12T01:37:46.037803+0000","last_fullsized":"2024-09-12T01:37:46.037803+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:29.474781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56973,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":538,"num_read_kb":1095,"num_write":432,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:01.534928+0000","last_change":"2024-09-12T00:28:39.216508+0000","last_active":"2024-09-12T01:34:01.534928+0000","last_peered":"2024-09-12T01:34:01.534928+0000","last_clean":"2024-09-12T01:34:01.534928+0000","last_became_active":"2024-09-12T00:28:39.216200+0000","last_became_peered":"2024-09-12T00:28:39.216200+0000","last_unstale":"2024-09-12T01:34:01.534928+0000","last_undegraded":"2024-09-12T01:34:01.534928+0000","last_fullsized":"2024-09-12T01:34:01.534928+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:22.629426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"263'112","reported_seq":626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:42.778426+0000","last_change":"2024-09-12T00:28:41.232852+0000","last_active":"2024-09-12T01:33:42.778426+0000","last_peered":"2024-09-12T01:33:42.778426+0000","last_clean":"2024-09-12T01:33:42.778426+0000","last_became_active":"2024-09-12T00:28:41.232381+0000","last_became_peered":"2024-09-12T00:28:41.232381+0000","last_unstale":"2024-09-12T01:33:42.778426+0000","last_undegraded":"2024-09-12T01:33:42.778426+0000","last_fullsized":"2024-09-12T01:33:42.778426+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:50.533536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":176,"num_read_kb":166,"num_write":281,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"263'153","reported_seq":745,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:54.637443+0000","last_change":"2024-09-12T00:28:33.211984+0000","last_active":"2024-09-12T01:33:54.637443+0000","last_peered":"2024-09-12T01:33:54.637443+0000","last_clean":"2024-09-12T01:33:54.637443+0000","last_became_active":"2024-09-12T00:28:33.211165+0000","last_became_peered":"2024-09-12T00:28:33.211165+0000","last_unstale":"2024-09-12T01:33:54.637443+0000","last_undegraded":"2024-09-12T01:33:54.637443+0000","last_fullsized":"2024-09-12T01:33:54.637443+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:15.409950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":668,"num_read_kb":545,"num_write":223,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"263'332","reported_seq":961,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.766693+0000","last_change":"2024-09-12T00:28:31.214222+0000","last_active":"2024-09-12T01:38:01.766693+0000","last_peered":"2024-09-12T01:38:01.766693+0000","last_clean":"2024-09-12T01:38:01.766693+0000","last_became_active":"2024-09-12T00:28:31.213971+0000","last_became_peered":"2024-09-12T00:28:31.213971+0000","last_unstale":"2024-09-12T01:38:01.766693+0000","last_undegraded":"2024-09-12T01:38:01.766693+0000","last_fullsized":"2024-09-12T01:38:01.766693+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:34.097978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340133,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":428,"num_read_kb":61436,"num_write":986,"num_write_kb":69756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.534222+0000","last_change":"2024-09-12T00:28:35.210349+0000","last_active":"2024-09-12T01:33:56.534222+0000","last_peered":"2024-09-12T01:33:56.534222+0000","last_clean":"2024-09-12T01:33:56.534222+0000","last_became_active":"2024-09-12T00:28:35.210060+0000","last_became_peered":"2024-09-12T00:28:35.210060+0000","last_unstale":"2024-09-12T01:33:56.534222+0000","last_undegraded":"2024-09-12T01:33:56.534222+0000","last_fullsized":"2024-09-12T01:33:56.534222+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:54.262760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"263'297","reported_seq":871,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.176723+0000","last_change":"2024-09-12T00:28:37.221776+0000","last_active":"2024-09-12T01:38:01.176723+0000","last_peered":"2024-09-12T01:38:01.176723+0000","last_clean":"2024-09-12T01:38:01.176723+0000","last_became_active":"2024-09-12T00:28:37.221491+0000","last_became_peered":"2024-09-12T00:28:37.221491+0000","last_unstale":"2024-09-12T01:38:01.176723+0000","last_undegraded":"2024-09-12T01:38:01.176723+0000","last_fullsized":"2024-09-12T01:38:01.176723+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:53.230082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49002,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":484,"num_read_kb":1163,"num_write":396,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:01.784353+0000","last_change":"2024-09-12T00:28:39.219270+0000","last_active":"2024-09-12T01:34:01.784353+0000","last_peered":"2024-09-12T01:34:01.784353+0000","last_clean":"2024-09-12T01:34:01.784353+0000","last_became_active":"2024-09-12T00:28:39.219004+0000","last_became_peered":"2024-09-12T00:28:39.219004+0000","last_unstale":"2024-09-12T01:34:01.784353+0000","last_undegraded":"2024-09-12T01:34:01.784353+0000","last_fullsized":"2024-09-12T01:34:01.784353+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:04.158965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"263'478","reported_seq":1262,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:42.590207+0000","last_change":"2024-09-12T00:28:33.216889+0000","last_active":"2024-09-12T01:36:42.590207+0000","last_peered":"2024-09-12T01:36:42.590207+0000","last_clean":"2024-09-12T01:36:42.590207+0000","last_became_active":"2024-09-12T00:28:33.216610+0000","last_became_peered":"2024-09-12T00:28:33.216610+0000","last_unstale":"2024-09-12T01:36:42.590207+0000","last_undegraded":"2024-09-12T01:36:42.590207+0000","last_fullsized":"2024-09-12T01:36:42.590207+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:20.599221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2349,"num_read_kb":2016,"num_write":868,"num_write_kb":562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"263'259","reported_seq":890,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:49.636836+0000","last_change":"2024-09-12T00:28:31.208064+0000","last_active":"2024-09-12T01:33:49.636836+0000","last_peered":"2024-09-12T01:33:49.636836+0000","last_clean":"2024-09-12T01:33:49.636836+0000","last_became_active":"2024-09-12T00:28:31.207770+0000","last_became_peered":"2024-09-12T00:28:31.207770+0000","last_unstale":"2024-09-12T01:33:49.636836+0000","last_undegraded":"2024-09-12T01:33:49.636836+0000","last_fullsized":"2024-09-12T01:33:49.636836+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:48.014014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5418705,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":389,"num_read_kb":17283,"num_write":887,"num_write_kb":20034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:46.790016+0000","last_change":"2024-09-12T00:28:35.209110+0000","last_active":"2024-09-12T01:34:46.790016+0000","last_peered":"2024-09-12T01:34:46.790016+0000","last_clean":"2024-09-12T01:34:46.790016+0000","last_became_active":"2024-09-12T00:28:35.208868+0000","last_became_peered":"2024-09-12T00:28:35.208868+0000","last_unstale":"2024-09-12T01:34:46.790016+0000","last_undegraded":"2024-09-12T01:34:46.790016+0000","last_fullsized":"2024-09-12T01:34:46.790016+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:58.443488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"263'529","reported_seq":1181,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.115873+0000","last_change":"2024-09-12T00:28:37.211376+0000","last_active":"2024-09-12T01:38:01.115873+0000","last_peered":"2024-09-12T01:38:01.115873+0000","last_clean":"2024-09-12T01:38:01.115873+0000","last_became_active":"2024-09-12T00:28:37.210514+0000","last_became_peered":"2024-09-12T00:28:37.210514+0000","last_unstale":"2024-09-12T01:38:01.115873+0000","last_undegraded":"2024-09-12T01:38:01.115873+0000","last_fullsized":"2024-09-12T01:38:01.115873+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":500,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:55.293515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94945,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":919,"num_read_kb":2214,"num_write":790,"num_write_kb":678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:42.778441+0000","last_change":"2024-09-12T00:28:39.220157+0000","last_active":"2024-09-12T01:33:42.778441+0000","last_peered":"2024-09-12T01:33:42.778441+0000","last_clean":"2024-09-12T01:33:42.778441+0000","last_became_active":"2024-09-12T00:28:39.219808+0000","last_became_peered":"2024-09-12T00:28:39.219808+0000","last_unstale":"2024-09-12T01:33:42.778441+0000","last_undegraded":"2024-09-12T01:33:42.778441+0000","last_fullsized":"2024-09-12T01:33:42.778441+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:25.859464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"263'226","reported_seq":794,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:42.584721+0000","last_change":"2024-09-12T00:28:41.257924+0000","last_active":"2024-09-12T01:36:42.584721+0000","last_peered":"2024-09-12T01:36:42.584721+0000","last_clean":"2024-09-12T01:36:42.584721+0000","last_became_active":"2024-09-12T00:28:41.257639+0000","last_became_peered":"2024-09-12T00:28:41.257639+0000","last_unstale":"2024-09-12T01:36:42.584721+0000","last_undegraded":"2024-09-12T01:36:42.584721+0000","last_fullsized":"2024-09-12T01:36:42.584721+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:36.066637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":674,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":491,"num_read_kb":439,"num_write":521,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"263'158","reported_seq":749,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:46.790004+0000","last_change":"2024-09-12T00:28:33.215368+0000","last_active":"2024-09-12T01:34:46.790004+0000","last_peered":"2024-09-12T01:34:46.790004+0000","last_clean":"2024-09-12T01:34:46.790004+0000","last_became_active":"2024-09-12T00:28:33.215105+0000","last_became_peered":"2024-09-12T00:28:33.215105+0000","last_unstale":"2024-09-12T01:34:46.790004+0000","last_undegraded":"2024-09-12T01:34:46.790004+0000","last_fullsized":"2024-09-12T01:34:46.790004+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:01.247332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":692,"num_read_kb":572,"num_write":247,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"263'389","reported_seq":1044,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.732275+0000","last_change":"2024-09-12T00:28:31.206881+0000","last_active":"2024-09-12T01:38:01.732275+0000","last_peered":"2024-09-12T01:38:01.732275+0000","last_clean":"2024-09-12T01:38:01.732275+0000","last_became_active":"2024-09-12T00:28:31.206562+0000","last_became_peered":"2024-09-12T00:28:31.206562+0000","last_unstale":"2024-09-12T01:38:01.732275+0000","last_undegraded":"2024-09-12T01:38:01.732275+0000","last_fullsized":"2024-09-12T01:38:01.732275+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:30.337503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395844,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":545,"num_read_kb":3743,"num_write":1252,"num_write_kb":48925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.545536+0000","last_change":"2024-09-12T00:28:35.210344+0000","last_active":"2024-09-12T01:35:16.545536+0000","last_peered":"2024-09-12T01:35:16.545536+0000","last_clean":"2024-09-12T01:35:16.545536+0000","last_became_active":"2024-09-12T00:28:35.210046+0000","last_became_peered":"2024-09-12T00:28:35.210046+0000","last_unstale":"2024-09-12T01:35:16.545536+0000","last_undegraded":"2024-09-12T01:35:16.545536+0000","last_fullsized":"2024-09-12T01:35:16.545536+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:03.841464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"263'330","reported_seq":923,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.210125+0000","last_change":"2024-09-12T00:28:37.212617+0000","last_active":"2024-09-12T01:38:01.210125+0000","last_peered":"2024-09-12T01:38:01.210125+0000","last_clean":"2024-09-12T01:38:01.210125+0000","last_became_active":"2024-09-12T00:28:37.212236+0000","last_became_peered":"2024-09-12T00:28:37.212236+0000","last_unstale":"2024-09-12T01:38:01.210125+0000","last_undegraded":"2024-09-12T01:38:01.210125+0000","last_fullsized":"2024-09-12T01:38:01.210125+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:16.662629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49414,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":546,"num_read_kb":1160,"num_write":454,"num_write_kb":329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:41.931728+0000","last_change":"2024-09-12T00:28:39.218198+0000","last_active":"2024-09-12T01:33:41.931728+0000","last_peered":"2024-09-12T01:33:41.931728+0000","last_clean":"2024-09-12T01:33:41.931728+0000","last_became_active":"2024-09-12T00:28:39.217947+0000","last_became_peered":"2024-09-12T00:28:39.217947+0000","last_unstale":"2024-09-12T01:33:41.931728+0000","last_undegraded":"2024-09-12T01:33:41.931728+0000","last_fullsized":"2024-09-12T01:33:41.931728+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:45.277309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"263'220","reported_seq":1091,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.567227+0000","last_change":"2024-09-12T00:28:41.233293+0000","last_active":"2024-09-12T01:36:38.567227+0000","last_peered":"2024-09-12T01:36:38.567227+0000","last_clean":"2024-09-12T01:36:38.567227+0000","last_became_active":"2024-09-12T00:28:41.232347+0000","last_became_peered":"2024-09-12T00:28:41.232347+0000","last_unstale":"2024-09-12T01:36:38.567227+0000","last_undegraded":"2024-09-12T01:36:38.567227+0000","last_fullsized":"2024-09-12T01:36:38.567227+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:07.441315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":645,"num_read_kb":635,"num_write":602,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"263'72","reported_seq":627,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:52.550530+0000","last_change":"2024-09-12T00:28:33.208225+0000","last_active":"2024-09-12T01:33:52.550530+0000","last_peered":"2024-09-12T01:33:52.550530+0000","last_clean":"2024-09-12T01:33:52.550530+0000","last_became_active":"2024-09-12T00:28:33.207968+0000","last_became_peered":"2024-09-12T00:28:33.207968+0000","last_unstale":"2024-09-12T01:33:52.550530+0000","last_undegraded":"2024-09-12T01:33:52.550530+0000","last_fullsized":"2024-09-12T01:33:52.550530+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:44.313634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":308,"num_read_kb":254,"num_write":109,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"263'289","reported_seq":915,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.527649+0000","last_change":"2024-09-12T00:28:31.195341+0000","last_active":"2024-09-12T01:38:01.527649+0000","last_peered":"2024-09-12T01:38:01.527649+0000","last_clean":"2024-09-12T01:38:01.527649+0000","last_became_active":"2024-09-12T00:28:31.195038+0000","last_became_peered":"2024-09-12T00:28:31.195038+0000","last_unstale":"2024-09-12T01:38:01.527649+0000","last_undegraded":"2024-09-12T01:38:01.527649+0000","last_fullsized":"2024-09-12T01:38:01.527649+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:10.944170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264279,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":420,"num_read_kb":13573,"num_write":959,"num_write_kb":34116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:36.531621+0000","last_change":"2024-09-12T00:28:35.215894+0000","last_active":"2024-09-12T01:33:36.531621+0000","last_peered":"2024-09-12T01:33:36.531621+0000","last_clean":"2024-09-12T01:33:36.531621+0000","last_became_active":"2024-09-12T00:28:35.215576+0000","last_became_peered":"2024-09-12T00:28:35.215576+0000","last_unstale":"2024-09-12T01:33:36.531621+0000","last_undegraded":"2024-09-12T01:33:36.531621+0000","last_fullsized":"2024-09-12T01:33:36.531621+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:24.130329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"263'283","reported_seq":874,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:24.663088+0000","last_change":"2024-09-12T00:28:37.424316+0000","last_active":"2024-09-12T01:37:24.663088+0000","last_peered":"2024-09-12T01:37:24.663088+0000","last_clean":"2024-09-12T01:37:24.663088+0000","last_became_active":"2024-09-12T00:28:37.423835+0000","last_became_peered":"2024-09-12T00:28:37.423835+0000","last_unstale":"2024-09-12T01:37:24.663088+0000","last_undegraded":"2024-09-12T01:37:24.663088+0000","last_fullsized":"2024-09-12T01:37:24.663088+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:16.822185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55686,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":473,"num_read_kb":989,"num_write":380,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:46.941196+0000","last_change":"2024-09-12T00:28:39.219814+0000","last_active":"2024-09-12T01:34:46.941196+0000","last_peered":"2024-09-12T01:34:46.941196+0000","last_clean":"2024-09-12T01:34:46.941196+0000","last_became_active":"2024-09-12T00:28:39.219541+0000","last_became_peered":"2024-09-12T00:28:39.219541+0000","last_unstale":"2024-09-12T01:34:46.941196+0000","last_undegraded":"2024-09-12T01:34:46.941196+0000","last_fullsized":"2024-09-12T01:34:46.941196+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:16.760034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"263'114","reported_seq":599,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:47.141542+0000","last_change":"2024-09-12T00:28:41.232661+0000","last_active":"2024-09-12T01:37:47.141542+0000","last_peered":"2024-09-12T01:37:47.141542+0000","last_clean":"2024-09-12T01:37:47.141542+0000","last_became_active":"2024-09-12T00:28:41.232305+0000","last_became_peered":"2024-09-12T00:28:41.232305+0000","last_unstale":"2024-09-12T01:37:47.141542+0000","last_undegraded":"2024-09-12T01:37:47.141542+0000","last_fullsized":"2024-09-12T01:37:47.141542+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:16.813541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":90,"num_read_kb":88,"num_write":260,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"263'145","reported_seq":711,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:36.625552+0000","last_change":"2024-09-12T00:28:33.214222+0000","last_active":"2024-09-12T01:33:36.625552+0000","last_peered":"2024-09-12T01:33:36.625552+0000","last_clean":"2024-09-12T01:33:36.625552+0000","last_became_active":"2024-09-12T00:28:33.213905+0000","last_became_peered":"2024-09-12T00:28:33.213905+0000","last_unstale":"2024-09-12T01:33:36.625552+0000","last_undegraded":"2024-09-12T01:33:36.625552+0000","last_fullsized":"2024-09-12T01:33:36.625552+0000","mapping_epoch":27,"log_start":"260'100","ondisk_log_start":"260'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:53.032156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":580,"num_read_kb":470,"num_write":232,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"263'309","reported_seq":1003,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.746967+0000","last_change":"2024-09-12T00:28:31.203713+0000","last_active":"2024-09-12T01:38:01.746967+0000","last_peered":"2024-09-12T01:38:01.746967+0000","last_clean":"2024-09-12T01:38:01.746967+0000","last_became_active":"2024-09-12T00:28:31.203417+0000","last_became_peered":"2024-09-12T00:28:31.203417+0000","last_unstale":"2024-09-12T01:38:01.746967+0000","last_undegraded":"2024-09-12T01:38:01.746967+0000","last_fullsized":"2024-09-12T01:38:01.746967+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:22.904080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262193,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":643,"num_read_kb":683,"num_write":1258,"num_write_kb":6456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:36.931007+0000","last_change":"2024-09-12T00:28:35.208282+0000","last_active":"2024-09-12T01:33:36.931007+0000","last_peered":"2024-09-12T01:33:36.931007+0000","last_clean":"2024-09-12T01:33:36.931007+0000","last_became_active":"2024-09-12T00:28:35.207992+0000","last_became_peered":"2024-09-12T00:28:35.207992+0000","last_unstale":"2024-09-12T01:33:36.931007+0000","last_undegraded":"2024-09-12T01:33:36.931007+0000","last_fullsized":"2024-09-12T01:33:36.931007+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:40:54.373200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"263'105","reported_seq":647,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:51.541995+0000","last_change":"2024-09-12T00:28:37.424144+0000","last_active":"2024-09-12T01:34:51.541995+0000","last_peered":"2024-09-12T01:34:51.541995+0000","last_clean":"2024-09-12T01:34:51.541995+0000","last_became_active":"2024-09-12T00:28:37.423765+0000","last_became_peered":"2024-09-12T00:28:37.423765+0000","last_unstale":"2024-09-12T01:34:51.541995+0000","last_undegraded":"2024-09-12T01:34:51.541995+0000","last_fullsized":"2024-09-12T01:34:51.541995+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:37.831318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":155,"num_read_kb":148,"num_write":156,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"263'760","reported_seq":2427,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.050221+0000","last_change":"2024-09-12T00:28:39.217233+0000","last_active":"2024-09-12T01:38:00.050221+0000","last_peered":"2024-09-12T01:38:00.050221+0000","last_clean":"2024-09-12T01:38:00.050221+0000","last_became_active":"2024-09-12T00:28:39.216704+0000","last_became_peered":"2024-09-12T00:28:39.216704+0000","last_unstale":"2024-09-12T01:38:00.050221+0000","last_undegraded":"2024-09-12T01:38:00.050221+0000","last_fullsized":"2024-09-12T01:38:00.050221+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:06.941324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"263'157","reported_seq":655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:41.582118+0000","last_change":"2024-09-12T00:28:41.228417+0000","last_active":"2024-09-12T01:36:41.582118+0000","last_peered":"2024-09-12T01:36:41.582118+0000","last_clean":"2024-09-12T01:36:41.582118+0000","last_became_active":"2024-09-12T00:28:41.227892+0000","last_became_peered":"2024-09-12T00:28:41.227892+0000","last_unstale":"2024-09-12T01:36:41.582118+0000","last_undegraded":"2024-09-12T01:36:41.582118+0000","last_fullsized":"2024-09-12T01:36:41.582118+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:55.234284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":160,"num_read_kb":153,"num_write":389,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"263'138","reported_seq":717,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:36.531599+0000","last_change":"2024-09-12T00:28:33.205366+0000","last_active":"2024-09-12T01:33:36.531599+0000","last_peered":"2024-09-12T01:33:36.531599+0000","last_clean":"2024-09-12T01:33:36.531599+0000","last_became_active":"2024-09-12T00:28:33.204722+0000","last_became_peered":"2024-09-12T00:28:33.204722+0000","last_unstale":"2024-09-12T01:33:36.531599+0000","last_undegraded":"2024-09-12T01:33:36.531599+0000","last_fullsized":"2024-09-12T01:33:36.531599+0000","mapping_epoch":27,"log_start":"260'100","ondisk_log_start":"260'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:40.757422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":575,"num_read_kb":467,"num_write":204,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"263'325","reported_seq":1043,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.775147+0000","last_change":"2024-09-12T00:28:31.214127+0000","last_active":"2024-09-12T01:38:01.775147+0000","last_peered":"2024-09-12T01:38:01.775147+0000","last_clean":"2024-09-12T01:38:01.775147+0000","last_became_active":"2024-09-12T00:28:31.212597+0000","last_became_peered":"2024-09-12T00:28:31.212597+0000","last_unstale":"2024-09-12T01:38:01.775147+0000","last_undegraded":"2024-09-12T01:38:01.775147+0000","last_fullsized":"2024-09-12T01:38:01.775147+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:45.696465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":273370,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":704,"num_read_kb":2179,"num_write":1113,"num_write_kb":612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:36.715250+0000","last_change":"2024-09-12T00:28:35.210989+0000","last_active":"2024-09-12T01:33:36.715250+0000","last_peered":"2024-09-12T01:33:36.715250+0000","last_clean":"2024-09-12T01:33:36.715250+0000","last_became_active":"2024-09-12T00:28:35.210710+0000","last_became_peered":"2024-09-12T00:28:35.210710+0000","last_unstale":"2024-09-12T01:33:36.715250+0000","last_undegraded":"2024-09-12T01:33:36.715250+0000","last_fullsized":"2024-09-12T01:33:36.715250+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:33.211433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"263'387","reported_seq":1004,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.742223+0000","last_change":"2024-09-12T00:28:37.210612+0000","last_active":"2024-09-12T01:38:00.742223+0000","last_peered":"2024-09-12T01:38:00.742223+0000","last_clean":"2024-09-12T01:38:00.742223+0000","last_became_active":"2024-09-12T00:28:37.210317+0000","last_became_peered":"2024-09-12T00:28:37.210317+0000","last_unstale":"2024-09-12T01:38:00.742223+0000","last_undegraded":"2024-09-12T01:38:00.742223+0000","last_fullsized":"2024-09-12T01:38:00.742223+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:31.821476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56512,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":649,"num_read_kb":1465,"num_write":528,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.783725+0000","last_change":"2024-09-12T00:28:39.218794+0000","last_active":"2024-09-12T01:33:56.783725+0000","last_peered":"2024-09-12T01:33:56.783725+0000","last_clean":"2024-09-12T01:33:56.783725+0000","last_became_active":"2024-09-12T00:28:39.218026+0000","last_became_peered":"2024-09-12T00:28:39.218026+0000","last_unstale":"2024-09-12T01:33:56.783725+0000","last_undegraded":"2024-09-12T01:33:56.783725+0000","last_fullsized":"2024-09-12T01:33:56.783725+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:18.115521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"263'133","reported_seq":629,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:21.741327+0000","last_change":"2024-09-12T00:28:41.231966+0000","last_active":"2024-09-12T01:36:21.741327+0000","last_peered":"2024-09-12T01:36:21.741327+0000","last_clean":"2024-09-12T01:36:21.741327+0000","last_became_active":"2024-09-12T00:28:41.231611+0000","last_became_peered":"2024-09-12T00:28:41.231611+0000","last_unstale":"2024-09-12T01:36:21.741327+0000","last_undegraded":"2024-09-12T01:36:21.741327+0000","last_fullsized":"2024-09-12T01:36:21.741327+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:05.050533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":625,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":135,"num_read_kb":130,"num_write":322,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"263'92","reported_seq":673,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:36.531552+0000","last_change":"2024-09-12T00:28:33.204989+0000","last_active":"2024-09-12T01:33:36.531552+0000","last_peered":"2024-09-12T01:33:36.531552+0000","last_clean":"2024-09-12T01:33:36.531552+0000","last_became_active":"2024-09-12T00:28:33.204653+0000","last_became_peered":"2024-09-12T00:28:33.204653+0000","last_unstale":"2024-09-12T01:33:36.531552+0000","last_undegraded":"2024-09-12T01:33:36.531552+0000","last_fullsized":"2024-09-12T01:33:36.531552+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:22.275865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":393,"num_read_kb":329,"num_write":145,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"263'429","reported_seq":1121,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.757405+0000","last_change":"2024-09-12T00:28:31.214035+0000","last_active":"2024-09-12T01:38:01.757405+0000","last_peered":"2024-09-12T01:38:01.757405+0000","last_clean":"2024-09-12T01:38:01.757405+0000","last_became_active":"2024-09-12T00:28:31.212752+0000","last_became_peered":"2024-09-12T00:28:31.212752+0000","last_unstale":"2024-09-12T01:38:01.757405+0000","last_undegraded":"2024-09-12T01:38:01.757405+0000","last_fullsized":"2024-09-12T01:38:01.757405+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":400,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:33.447125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":804,"num_read_kb":13300,"num_write":1374,"num_write_kb":24353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:37.777506+0000","last_change":"2024-09-12T00:28:35.208702+0000","last_active":"2024-09-12T01:33:37.777506+0000","last_peered":"2024-09-12T01:33:37.777506+0000","last_clean":"2024-09-12T01:33:37.777506+0000","last_became_active":"2024-09-12T00:28:35.207869+0000","last_became_peered":"2024-09-12T00:28:35.207869+0000","last_unstale":"2024-09-12T01:33:37.777506+0000","last_undegraded":"2024-09-12T01:33:37.777506+0000","last_fullsized":"2024-09-12T01:33:37.777506+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:39.750226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"263'310","reported_seq":893,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.823008+0000","last_change":"2024-09-12T00:28:37.221622+0000","last_active":"2024-09-12T01:38:00.823008+0000","last_peered":"2024-09-12T01:38:00.823008+0000","last_clean":"2024-09-12T01:38:00.823008+0000","last_became_active":"2024-09-12T00:28:37.221289+0000","last_became_peered":"2024-09-12T00:28:37.221289+0000","last_unstale":"2024-09-12T01:38:00.823008+0000","last_undegraded":"2024-09-12T01:38:00.823008+0000","last_fullsized":"2024-09-12T01:38:00.823008+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:13.295191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57095,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":538,"num_read_kb":1320,"num_write":444,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:11.536147+0000","last_change":"2024-09-12T00:28:39.217261+0000","last_active":"2024-09-12T01:34:11.536147+0000","last_peered":"2024-09-12T01:34:11.536147+0000","last_clean":"2024-09-12T01:34:11.536147+0000","last_became_active":"2024-09-12T00:28:39.216943+0000","last_became_peered":"2024-09-12T00:28:39.216943+0000","last_unstale":"2024-09-12T01:34:11.536147+0000","last_undegraded":"2024-09-12T01:34:11.536147+0000","last_fullsized":"2024-09-12T01:34:11.536147+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:27.903826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"263'138","reported_seq":675,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:20.328319+0000","last_change":"2024-09-12T00:28:41.258056+0000","last_active":"2024-09-12T01:35:20.328319+0000","last_peered":"2024-09-12T01:35:20.328319+0000","last_clean":"2024-09-12T01:35:20.328319+0000","last_became_active":"2024-09-12T00:28:41.257796+0000","last_became_peered":"2024-09-12T00:28:41.257796+0000","last_unstale":"2024-09-12T01:35:20.328319+0000","last_undegraded":"2024-09-12T01:35:20.328319+0000","last_fullsized":"2024-09-12T01:35:20.328319+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:21.378439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":982,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":234,"num_read_kb":212,"num_write":368,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"263'73","reported_seq":628,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:04.638853+0000","last_change":"2024-09-12T00:28:33.206104+0000","last_active":"2024-09-12T01:34:04.638853+0000","last_peered":"2024-09-12T01:34:04.638853+0000","last_clean":"2024-09-12T01:34:04.638853+0000","last_became_active":"2024-09-12T00:28:33.205832+0000","last_became_peered":"2024-09-12T00:28:33.205832+0000","last_unstale":"2024-09-12T01:34:04.638853+0000","last_undegraded":"2024-09-12T01:34:04.638853+0000","last_fullsized":"2024-09-12T01:34:04.638853+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:47.756933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":322,"num_read_kb":264,"num_write":102,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"263'272","reported_seq":907,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:39.479186+0000","last_change":"2024-09-12T00:28:31.200496+0000","last_active":"2024-09-12T01:37:39.479186+0000","last_peered":"2024-09-12T01:37:39.479186+0000","last_clean":"2024-09-12T01:37:39.479186+0000","last_became_active":"2024-09-12T00:28:31.200234+0000","last_became_peered":"2024-09-12T00:28:31.200234+0000","last_unstale":"2024-09-12T01:37:39.479186+0000","last_undegraded":"2024-09-12T01:37:39.479186+0000","last_fullsized":"2024-09-12T01:37:39.479186+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:25.377262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5561855,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":401,"num_read_kb":15822,"num_write":1029,"num_write_kb":25857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.533584+0000","last_change":"2024-09-12T00:28:35.206882+0000","last_active":"2024-09-12T01:33:51.533584+0000","last_peered":"2024-09-12T01:33:51.533584+0000","last_clean":"2024-09-12T01:33:51.533584+0000","last_became_active":"2024-09-12T00:28:35.206597+0000","last_became_peered":"2024-09-12T00:28:35.206597+0000","last_unstale":"2024-09-12T01:33:51.533584+0000","last_undegraded":"2024-09-12T01:33:51.533584+0000","last_fullsized":"2024-09-12T01:33:51.533584+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:07.120698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"263'275","reported_seq":839,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:09.653390+0000","last_change":"2024-09-12T00:28:37.220535+0000","last_active":"2024-09-12T01:36:09.653390+0000","last_peered":"2024-09-12T01:36:09.653390+0000","last_clean":"2024-09-12T01:36:09.653390+0000","last_became_active":"2024-09-12T00:28:37.219652+0000","last_became_peered":"2024-09-12T00:28:37.219652+0000","last_unstale":"2024-09-12T01:36:09.653390+0000","last_undegraded":"2024-09-12T01:36:09.653390+0000","last_fullsized":"2024-09-12T01:36:09.653390+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:35.052492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69302,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":460,"num_read_kb":1067,"num_write":388,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:41.532251+0000","last_change":"2024-09-12T00:28:39.218146+0000","last_active":"2024-09-12T01:33:41.532251+0000","last_peered":"2024-09-12T01:33:41.532251+0000","last_clean":"2024-09-12T01:33:41.532251+0000","last_became_active":"2024-09-12T00:28:39.217869+0000","last_became_peered":"2024-09-12T00:28:39.217869+0000","last_unstale":"2024-09-12T01:33:41.532251+0000","last_undegraded":"2024-09-12T01:33:41.532251+0000","last_fullsized":"2024-09-12T01:33:41.532251+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:50.890111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"263'190","reported_seq":1287,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.478652+0000","last_change":"2024-09-12T00:28:41.232727+0000","last_active":"2024-09-12T01:36:38.478652+0000","last_peered":"2024-09-12T01:36:38.478652+0000","last_clean":"2024-09-12T01:36:38.478652+0000","last_became_active":"2024-09-12T00:28:41.232040+0000","last_became_peered":"2024-09-12T00:28:41.232040+0000","last_unstale":"2024-09-12T01:36:38.478652+0000","last_undegraded":"2024-09-12T01:36:38.478652+0000","last_fullsized":"2024-09-12T01:36:38.478652+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:12.584298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":841,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":800,"num_read_kb":795,"num_write":450,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"263'254","reported_seq":913,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.533604+0000","last_change":"2024-09-12T00:28:33.209146+0000","last_active":"2024-09-12T01:33:51.533604+0000","last_peered":"2024-09-12T01:33:51.533604+0000","last_clean":"2024-09-12T01:33:51.533604+0000","last_became_active":"2024-09-12T00:28:33.208787+0000","last_became_peered":"2024-09-12T00:28:33.208787+0000","last_unstale":"2024-09-12T01:33:51.533604+0000","last_undegraded":"2024-09-12T01:33:51.533604+0000","last_fullsized":"2024-09-12T01:33:51.533604+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:39.287147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1164,"num_read_kb":956,"num_write":405,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"263'316","reported_seq":1064,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.727735+0000","last_change":"2024-09-12T00:29:04.275056+0000","last_active":"2024-09-12T01:38:01.727735+0000","last_peered":"2024-09-12T01:38:01.727735+0000","last_clean":"2024-09-12T01:38:01.727735+0000","last_became_active":"2024-09-12T00:29:04.274746+0000","last_became_peered":"2024-09-12T00:29:04.274746+0000","last_unstale":"2024-09-12T01:38:01.727735+0000","last_undegraded":"2024-09-12T01:38:01.727735+0000","last_fullsized":"2024-09-12T01:38:01.727735+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:44.084463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524334,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":565,"num_read_kb":52761,"num_write":1033,"num_write_kb":38285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"37'4","reported_seq":986,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:59.822617+0000","last_change":"2024-09-12T00:28:35.207612+0000","last_active":"2024-09-12T01:37:59.822617+0000","last_peered":"2024-09-12T01:37:59.822617+0000","last_clean":"2024-09-12T01:37:59.822617+0000","last_became_active":"2024-09-12T00:28:35.207332+0000","last_became_peered":"2024-09-12T00:28:35.207332+0000","last_unstale":"2024-09-12T01:37:59.822617+0000","last_undegraded":"2024-09-12T01:37:59.822617+0000","last_fullsized":"2024-09-12T01:37:59.822617+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:37.071411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"263'325","reported_seq":930,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.451609+0000","last_change":"2024-09-12T00:28:37.207659+0000","last_active":"2024-09-12T01:38:00.451609+0000","last_peered":"2024-09-12T01:38:00.451609+0000","last_clean":"2024-09-12T01:38:00.451609+0000","last_became_active":"2024-09-12T00:28:37.207373+0000","last_became_peered":"2024-09-12T00:28:37.207373+0000","last_unstale":"2024-09-12T01:38:00.451609+0000","last_undegraded":"2024-09-12T01:38:00.451609+0000","last_fullsized":"2024-09-12T01:38:00.451609+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:14.729544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45135,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":515,"num_read_kb":1089,"num_write":408,"num_write_kb":271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:41.781852+0000","last_change":"2024-09-12T00:28:39.217215+0000","last_active":"2024-09-12T01:33:41.781852+0000","last_peered":"2024-09-12T01:33:41.781852+0000","last_clean":"2024-09-12T01:33:41.781852+0000","last_became_active":"2024-09-12T00:28:39.215651+0000","last_became_peered":"2024-09-12T00:28:39.215651+0000","last_unstale":"2024-09-12T01:33:41.781852+0000","last_undegraded":"2024-09-12T01:33:41.781852+0000","last_fullsized":"2024-09-12T01:33:41.781852+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:18.517005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"263'132","reported_seq":629,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.017444+0000","last_change":"2024-09-12T00:28:41.227004+0000","last_active":"2024-09-12T01:37:46.017444+0000","last_peered":"2024-09-12T01:37:46.017444+0000","last_clean":"2024-09-12T01:37:46.017444+0000","last_became_active":"2024-09-12T00:28:41.226687+0000","last_became_peered":"2024-09-12T00:28:41.226687+0000","last_unstale":"2024-09-12T01:37:46.017444+0000","last_undegraded":"2024-09-12T01:37:46.017444+0000","last_fullsized":"2024-09-12T01:37:46.017444+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:17.799068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":132,"num_read_kb":117,"num_write":304,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"263'292","reported_seq":922,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.948057+0000","last_change":"2024-09-12T00:28:33.211180+0000","last_active":"2024-09-12T01:35:46.948057+0000","last_peered":"2024-09-12T01:35:46.948057+0000","last_clean":"2024-09-12T01:35:46.948057+0000","last_became_active":"2024-09-12T00:28:33.210635+0000","last_became_peered":"2024-09-12T00:28:33.210635+0000","last_unstale":"2024-09-12T01:35:46.948057+0000","last_undegraded":"2024-09-12T01:35:46.948057+0000","last_fullsized":"2024-09-12T01:35:46.948057+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:52.779854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1259,"num_read_kb":1011,"num_write":460,"num_write_kb":225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"263'324","reported_seq":944,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.535496+0000","last_change":"2024-09-12T00:28:31.207464+0000","last_active":"2024-09-12T01:38:01.535496+0000","last_peered":"2024-09-12T01:38:01.535496+0000","last_clean":"2024-09-12T01:38:01.535496+0000","last_became_active":"2024-09-12T00:28:31.206672+0000","last_became_peered":"2024-09-12T00:28:31.206672+0000","last_unstale":"2024-09-12T01:38:01.535496+0000","last_undegraded":"2024-09-12T01:38:01.535496+0000","last_fullsized":"2024-09-12T01:38:01.535496+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:16.072963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":684071,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":456,"num_read_kb":11577,"num_write":1042,"num_write_kb":29091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"263'314","reported_seq":941,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.948041+0000","last_change":"2024-09-12T00:28:33.207374+0000","last_active":"2024-09-12T01:35:46.948041+0000","last_peered":"2024-09-12T01:35:46.948041+0000","last_clean":"2024-09-12T01:35:46.948041+0000","last_became_active":"2024-09-12T00:28:33.206512+0000","last_became_peered":"2024-09-12T00:28:33.206512+0000","last_unstale":"2024-09-12T01:35:46.948041+0000","last_undegraded":"2024-09-12T01:35:46.948041+0000","last_fullsized":"2024-09-12T01:35:46.948041+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:00.796082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1325,"num_read_kb":1067,"num_write":489,"num_write_kb":251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"263'323","reported_seq":962,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.538497+0000","last_change":"2024-09-12T00:29:04.272074+0000","last_active":"2024-09-12T01:38:01.538497+0000","last_peered":"2024-09-12T01:38:01.538497+0000","last_clean":"2024-09-12T01:38:01.538497+0000","last_became_active":"2024-09-12T00:29:04.271753+0000","last_became_peered":"2024-09-12T00:29:04.271753+0000","last_unstale":"2024-09-12T01:38:01.538497+0000","last_undegraded":"2024-09-12T01:38:01.538497+0000","last_fullsized":"2024-09-12T01:38:01.538497+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:42.475525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":500,"num_read_kb":1624,"num_write":1030,"num_write_kb":30525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"263'349","reported_seq":960,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:47.796128+0000","last_change":"2024-09-12T00:28:33.214934+0000","last_active":"2024-09-12T01:35:47.796128+0000","last_peered":"2024-09-12T01:35:47.796128+0000","last_clean":"2024-09-12T01:35:47.796128+0000","last_became_active":"2024-09-12T00:28:33.214679+0000","last_became_peered":"2024-09-12T00:28:33.214679+0000","last_unstale":"2024-09-12T01:35:47.796128+0000","last_undegraded":"2024-09-12T01:35:47.796128+0000","last_fullsized":"2024-09-12T01:35:47.796128+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:00.796082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1495,"num_read_kb":1194,"num_write":562,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"263'364","reported_seq":1031,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.783755+0000","last_change":"2024-09-12T00:28:31.209614+0000","last_active":"2024-09-12T01:38:01.783755+0000","last_peered":"2024-09-12T01:38:01.783755+0000","last_clean":"2024-09-12T01:38:01.783755+0000","last_became_active":"2024-09-12T00:28:31.209266+0000","last_became_peered":"2024-09-12T00:28:31.209266+0000","last_unstale":"2024-09-12T01:38:01.783755+0000","last_undegraded":"2024-09-12T01:38:01.783755+0000","last_fullsized":"2024-09-12T01:38:01.783755+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:17.128660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2581681,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":574,"num_read_kb":38602,"num_write":1242,"num_write_kb":22367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"263'104","reported_seq":689,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.948017+0000","last_change":"2024-09-12T00:28:33.216968+0000","last_active":"2024-09-12T01:35:46.948017+0000","last_peered":"2024-09-12T01:35:46.948017+0000","last_clean":"2024-09-12T01:35:46.948017+0000","last_became_active":"2024-09-12T00:28:33.213020+0000","last_became_peered":"2024-09-12T00:28:33.213020+0000","last_unstale":"2024-09-12T01:35:46.948017+0000","last_undegraded":"2024-09-12T01:35:46.948017+0000","last_fullsized":"2024-09-12T01:35:46.948017+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:49.966752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":435,"num_read_kb":365,"num_write":138,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"263'309","reported_seq":1047,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.733181+0000","last_change":"2024-09-12T00:28:31.208858+0000","last_active":"2024-09-12T01:38:01.733181+0000","last_peered":"2024-09-12T01:38:01.733181+0000","last_clean":"2024-09-12T01:38:01.733181+0000","last_became_active":"2024-09-12T00:28:31.208548+0000","last_became_peered":"2024-09-12T00:28:31.208548+0000","last_unstale":"2024-09-12T01:38:01.733181+0000","last_undegraded":"2024-09-12T01:38:01.733181+0000","last_fullsized":"2024-09-12T01:38:01.733181+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:14.657513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49275,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":734,"num_read_kb":31441,"num_write":965,"num_write_kb":36605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"263'125","reported_seq":761,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:13.175412+0000","last_change":"2024-09-12T00:28:33.217855+0000","last_active":"2024-09-12T01:36:13.175412+0000","last_peered":"2024-09-12T01:36:13.175412+0000","last_clean":"2024-09-12T01:36:13.175412+0000","last_became_active":"2024-09-12T00:28:33.217573+0000","last_became_peered":"2024-09-12T00:28:33.217573+0000","last_unstale":"2024-09-12T01:36:13.175412+0000","last_undegraded":"2024-09-12T01:36:13.175412+0000","last_fullsized":"2024-09-12T01:36:13.175412+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:26.283665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":588,"num_read_kb":500,"num_write":193,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"263'350","reported_seq":991,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.533585+0000","last_change":"2024-09-12T00:29:04.267833+0000","last_active":"2024-09-12T01:38:01.533585+0000","last_peered":"2024-09-12T01:38:01.533585+0000","last_clean":"2024-09-12T01:38:01.533585+0000","last_became_active":"2024-09-12T00:29:04.267546+0000","last_became_peered":"2024-09-12T00:29:04.267546+0000","last_unstale":"2024-09-12T01:38:01.533585+0000","last_undegraded":"2024-09-12T01:38:01.533585+0000","last_fullsized":"2024-09-12T01:38:01.533585+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:45.410402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2316194,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":594,"num_read_kb":3307,"num_write":1231,"num_write_kb":18821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"263'308","reported_seq":1002,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.545510+0000","last_change":"2024-09-12T00:28:33.209863+0000","last_active":"2024-09-12T01:35:16.545510+0000","last_peered":"2024-09-12T01:35:16.545510+0000","last_clean":"2024-09-12T01:35:16.545510+0000","last_became_active":"2024-09-12T00:28:33.208929+0000","last_became_peered":"2024-09-12T00:28:33.208929+0000","last_unstale":"2024-09-12T01:35:16.545510+0000","last_undegraded":"2024-09-12T01:35:16.545510+0000","last_fullsized":"2024-09-12T01:35:16.545510+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:38.145227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1423,"num_read_kb":1158,"num_write":481,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"263'311","reported_seq":953,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.766140+0000","last_change":"2024-09-12T00:28:31.206143+0000","last_active":"2024-09-12T01:38:01.766140+0000","last_peered":"2024-09-12T01:38:01.766140+0000","last_clean":"2024-09-12T01:38:01.766140+0000","last_became_active":"2024-09-12T00:28:31.205829+0000","last_became_peered":"2024-09-12T00:28:31.205829+0000","last_unstale":"2024-09-12T01:38:01.766140+0000","last_undegraded":"2024-09-12T01:38:01.766140+0000","last_fullsized":"2024-09-12T01:38:01.766140+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:18.050330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262189,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":453,"num_read_kb":5277,"num_write":1032,"num_write_kb":26638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"263'110","reported_seq":699,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:14.646908+0000","last_change":"2024-09-12T00:28:33.208267+0000","last_active":"2024-09-12T01:35:14.646908+0000","last_peered":"2024-09-12T01:35:14.646908+0000","last_clean":"2024-09-12T01:35:14.646908+0000","last_became_active":"2024-09-12T00:28:33.208010+0000","last_became_peered":"2024-09-12T00:28:33.208010+0000","last_unstale":"2024-09-12T01:35:14.646908+0000","last_undegraded":"2024-09-12T01:35:14.646908+0000","last_fullsized":"2024-09-12T01:35:14.646908+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:07.389367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":481,"num_read_kb":401,"num_write":165,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"263'361","reported_seq":1003,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.523918+0000","last_change":"2024-09-12T00:28:31.205820+0000","last_active":"2024-09-12T01:38:01.523918+0000","last_peered":"2024-09-12T01:38:01.523918+0000","last_clean":"2024-09-12T01:38:01.523918+0000","last_became_active":"2024-09-12T00:28:31.205366+0000","last_became_peered":"2024-09-12T00:28:31.205366+0000","last_unstale":"2024-09-12T01:38:01.523918+0000","last_undegraded":"2024-09-12T01:38:01.523918+0000","last_fullsized":"2024-09-12T01:38:01.523918+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:37.694868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":584,"num_read_kb":12807,"num_write":1205,"num_write_kb":27426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"263'206","reported_seq":826,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:32.524627+0000","last_change":"2024-09-12T00:28:33.209326+0000","last_active":"2024-09-12T01:35:32.524627+0000","last_peered":"2024-09-12T01:35:32.524627+0000","last_clean":"2024-09-12T01:35:32.524627+0000","last_became_active":"2024-09-12T00:28:33.209028+0000","last_became_peered":"2024-09-12T00:28:33.209028+0000","last_unstale":"2024-09-12T01:35:32.524627+0000","last_undegraded":"2024-09-12T01:35:32.524627+0000","last_fullsized":"2024-09-12T01:35:32.524627+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:20.185402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":877,"num_read_kb":721,"num_write":304,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"263'262","reported_seq":931,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:55.258184+0000","last_change":"2024-09-12T00:28:31.203730+0000","last_active":"2024-09-12T01:35:55.258184+0000","last_peered":"2024-09-12T01:35:55.258184+0000","last_clean":"2024-09-12T01:35:55.258184+0000","last_became_active":"2024-09-12T00:28:31.203185+0000","last_became_peered":"2024-09-12T00:28:31.203185+0000","last_unstale":"2024-09-12T01:35:55.258184+0000","last_undegraded":"2024-09-12T01:35:55.258184+0000","last_fullsized":"2024-09-12T01:35:55.258184+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:39.470819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20475208,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":440,"num_read_kb":88705,"num_write":979,"num_write_kb":43642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"263'403","reported_seq":1080,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.783830+0000","last_change":"2024-09-12T00:29:04.275730+0000","last_active":"2024-09-12T01:33:56.783830+0000","last_peered":"2024-09-12T01:33:56.783830+0000","last_clean":"2024-09-12T01:33:56.783830+0000","last_became_active":"2024-09-12T00:29:04.275434+0000","last_became_peered":"2024-09-12T00:29:04.275434+0000","last_unstale":"2024-09-12T01:33:56.783830+0000","last_undegraded":"2024-09-12T01:33:56.783830+0000","last_fullsized":"2024-09-12T01:33:56.783830+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:49.369214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1782,"num_read_kb":1435,"num_write":639,"num_write_kb":352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"263'328","reported_seq":965,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.718807+0000","last_change":"2024-09-12T00:28:31.209794+0000","last_active":"2024-09-12T01:38:01.718807+0000","last_peered":"2024-09-12T01:38:01.718807+0000","last_clean":"2024-09-12T01:38:01.718807+0000","last_became_active":"2024-09-12T00:28:31.209468+0000","last_became_peered":"2024-09-12T00:28:31.209468+0000","last_unstale":"2024-09-12T01:38:01.718807+0000","last_undegraded":"2024-09-12T01:38:01.718807+0000","last_fullsized":"2024-09-12T01:38:01.718807+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:32.906913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6901132,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":496,"num_read_kb":2644,"num_write":1040,"num_write_kb":18676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"263'161","reported_seq":736,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:29.654561+0000","last_change":"2024-09-12T00:28:33.208952+0000","last_active":"2024-09-12T01:35:29.654561+0000","last_peered":"2024-09-12T01:35:29.654561+0000","last_clean":"2024-09-12T01:35:29.654561+0000","last_became_active":"2024-09-12T00:28:33.208285+0000","last_became_peered":"2024-09-12T00:28:33.208285+0000","last_unstale":"2024-09-12T01:35:29.654561+0000","last_undegraded":"2024-09-12T01:35:29.654561+0000","last_fullsized":"2024-09-12T01:35:29.654561+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:58.828709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":689,"num_read_kb":558,"num_write":246,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"263'295","reported_seq":925,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:14.115203+0000","last_change":"2024-09-12T00:28:31.200270+0000","last_active":"2024-09-12T01:35:14.115203+0000","last_peered":"2024-09-12T01:35:14.115203+0000","last_clean":"2024-09-12T01:35:14.115203+0000","last_became_active":"2024-09-12T00:28:31.199924+0000","last_became_peered":"2024-09-12T00:28:31.199924+0000","last_unstale":"2024-09-12T01:35:14.115203+0000","last_undegraded":"2024-09-12T01:35:14.115203+0000","last_fullsized":"2024-09-12T01:35:14.115203+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:27.025158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7365505,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":426,"num_read_kb":12716,"num_write":1056,"num_write_kb":44871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"263'322","reported_seq":999,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:41.195483+0000","last_change":"2024-09-12T00:28:33.208356+0000","last_active":"2024-09-12T01:35:41.195483+0000","last_peered":"2024-09-12T01:35:41.195483+0000","last_clean":"2024-09-12T01:35:41.195483+0000","last_became_active":"2024-09-12T00:28:33.208088+0000","last_became_peered":"2024-09-12T00:28:33.208088+0000","last_unstale":"2024-09-12T01:35:41.195483+0000","last_undegraded":"2024-09-12T01:35:41.195483+0000","last_fullsized":"2024-09-12T01:35:41.195483+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:12.972774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1424,"num_read_kb":1183,"num_write":488,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"263'341","reported_seq":1009,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.754771+0000","last_change":"2024-09-12T00:28:31.211421+0000","last_active":"2024-09-12T01:38:01.754771+0000","last_peered":"2024-09-12T01:38:01.754771+0000","last_clean":"2024-09-12T01:38:01.754771+0000","last_became_active":"2024-09-12T00:28:31.211083+0000","last_became_peered":"2024-09-12T00:28:31.211083+0000","last_unstale":"2024-09-12T01:38:01.754771+0000","last_undegraded":"2024-09-12T01:38:01.754771+0000","last_fullsized":"2024-09-12T01:38:01.754771+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:55.832817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262163,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":601,"num_read_kb":3403,"num_write":1227,"num_write_kb":8870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"263'152","reported_seq":767,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:02.380980+0000","last_change":"2024-09-12T00:28:33.209816+0000","last_active":"2024-09-12T01:36:02.380980+0000","last_peered":"2024-09-12T01:36:02.380980+0000","last_clean":"2024-09-12T01:36:02.380980+0000","last_became_active":"2024-09-12T00:28:33.209024+0000","last_became_peered":"2024-09-12T00:28:33.209024+0000","last_unstale":"2024-09-12T01:36:02.380980+0000","last_undegraded":"2024-09-12T01:36:02.380980+0000","last_fullsized":"2024-09-12T01:36:02.380980+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:09.766449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":684,"num_read_kb":599,"num_write":231,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"263'309","reported_seq":927,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.752002+0000","last_change":"2024-09-12T00:28:31.207686+0000","last_active":"2024-09-12T01:38:01.752002+0000","last_peered":"2024-09-12T01:38:01.752002+0000","last_clean":"2024-09-12T01:38:01.752002+0000","last_became_active":"2024-09-12T00:28:31.207399+0000","last_became_peered":"2024-09-12T00:28:31.207399+0000","last_unstale":"2024-09-12T01:38:01.752002+0000","last_undegraded":"2024-09-12T01:38:01.752002+0000","last_fullsized":"2024-09-12T01:38:01.752002+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:23.656345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":660490,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":412,"num_read_kb":9232,"num_write":885,"num_write_kb":18206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"263'63","reported_seq":616,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:31.055891+0000","last_change":"2024-09-12T00:28:33.213456+0000","last_active":"2024-09-12T01:35:31.055891+0000","last_peered":"2024-09-12T01:35:31.055891+0000","last_clean":"2024-09-12T01:35:31.055891+0000","last_became_active":"2024-09-12T00:28:33.213110+0000","last_became_peered":"2024-09-12T00:28:33.213110+0000","last_unstale":"2024-09-12T01:35:31.055891+0000","last_undegraded":"2024-09-12T01:35:31.055891+0000","last_fullsized":"2024-09-12T01:35:31.055891+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:43.946245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":226,"num_write":102,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"263'347","reported_seq":1020,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.519322+0000","last_change":"2024-09-12T00:28:31.203837+0000","last_active":"2024-09-12T01:38:01.519322+0000","last_peered":"2024-09-12T01:38:01.519322+0000","last_clean":"2024-09-12T01:38:01.519322+0000","last_became_active":"2024-09-12T00:28:31.203478+0000","last_became_peered":"2024-09-12T00:28:31.203478+0000","last_unstale":"2024-09-12T01:38:01.519322+0000","last_undegraded":"2024-09-12T01:38:01.519322+0000","last_fullsized":"2024-09-12T01:38:01.519322+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:31.896358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524422,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":625,"num_read_kb":38935,"num_write":1076,"num_write_kb":32997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"263'193","reported_seq":781,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.783140+0000","last_change":"2024-09-12T00:28:33.220290+0000","last_active":"2024-09-12T01:33:51.783140+0000","last_peered":"2024-09-12T01:33:51.783140+0000","last_clean":"2024-09-12T01:33:51.783140+0000","last_became_active":"2024-09-12T00:28:33.220013+0000","last_became_peered":"2024-09-12T00:28:33.220013+0000","last_unstale":"2024-09-12T01:33:51.783140+0000","last_undegraded":"2024-09-12T01:33:51.783140+0000","last_fullsized":"2024-09-12T01:33:51.783140+0000","mapping_epoch":27,"log_start":"260'100","ondisk_log_start":"260'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:33.307077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":806,"num_read_kb":650,"num_write":294,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"263'313","reported_seq":930,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.701869+0000","last_change":"2024-09-12T00:28:31.204579+0000","last_active":"2024-09-12T01:38:01.701869+0000","last_peered":"2024-09-12T01:38:01.701869+0000","last_clean":"2024-09-12T01:38:01.701869+0000","last_became_active":"2024-09-12T00:28:31.204305+0000","last_became_peered":"2024-09-12T00:28:31.204305+0000","last_unstale":"2024-09-12T01:38:01.701869+0000","last_undegraded":"2024-09-12T01:38:01.701869+0000","last_fullsized":"2024-09-12T01:38:01.701869+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:37.446006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133673,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":474,"num_read_kb":11794,"num_write":1039,"num_write_kb":34532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"263'110","reported_seq":720,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:25.136847+0000","last_change":"2024-09-12T00:28:33.217086+0000","last_active":"2024-09-12T01:35:25.136847+0000","last_peered":"2024-09-12T01:35:25.136847+0000","last_clean":"2024-09-12T01:35:25.136847+0000","last_became_active":"2024-09-12T00:28:33.216814+0000","last_became_peered":"2024-09-12T00:28:33.216814+0000","last_unstale":"2024-09-12T01:35:25.136847+0000","last_undegraded":"2024-09-12T01:35:25.136847+0000","last_fullsized":"2024-09-12T01:35:25.136847+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:27.405799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":456,"num_read_kb":389,"num_write":151,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"263'346","reported_seq":1029,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.491744+0000","last_change":"2024-09-12T00:28:31.200695+0000","last_active":"2024-09-12T01:38:01.491744+0000","last_peered":"2024-09-12T01:38:01.491744+0000","last_clean":"2024-09-12T01:38:01.491744+0000","last_became_active":"2024-09-12T00:28:31.200421+0000","last_became_peered":"2024-09-12T00:28:31.200421+0000","last_unstale":"2024-09-12T01:38:01.491744+0000","last_undegraded":"2024-09-12T01:38:01.491744+0000","last_fullsized":"2024-09-12T01:38:01.491744+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:56.623886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1658550,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":533,"num_read_kb":83268,"num_write":1169,"num_write_kb":21609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"263'106","reported_seq":683,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:41.519720+0000","last_change":"2024-09-12T00:28:33.213440+0000","last_active":"2024-09-12T01:36:41.519720+0000","last_peered":"2024-09-12T01:36:41.519720+0000","last_clean":"2024-09-12T01:36:41.519720+0000","last_became_active":"2024-09-12T00:28:33.213100+0000","last_became_peered":"2024-09-12T00:28:33.213100+0000","last_unstale":"2024-09-12T01:36:41.519720+0000","last_undegraded":"2024-09-12T01:36:41.519720+0000","last_fullsized":"2024-09-12T01:36:41.519720+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:38.213563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":481,"num_read_kb":399,"num_write":154,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"263'346","reported_seq":1034,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.749067+0000","last_change":"2024-09-12T00:28:31.215965+0000","last_active":"2024-09-12T01:38:01.749067+0000","last_peered":"2024-09-12T01:38:01.749067+0000","last_clean":"2024-09-12T01:38:01.749067+0000","last_became_active":"2024-09-12T00:28:31.215581+0000","last_became_peered":"2024-09-12T00:28:31.215581+0000","last_unstale":"2024-09-12T01:38:01.749067+0000","last_undegraded":"2024-09-12T01:38:01.749067+0000","last_fullsized":"2024-09-12T01:38:01.749067+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:38.099218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3558704,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":578,"num_read_kb":13304,"num_write":1188,"num_write_kb":31930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"263'307","reported_seq":947,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.733963+0000","last_change":"2024-09-12T00:28:31.214764+0000","last_active":"2024-09-12T01:38:01.733963+0000","last_peered":"2024-09-12T01:38:01.733963+0000","last_clean":"2024-09-12T01:38:01.733963+0000","last_became_active":"2024-09-12T00:28:31.214134+0000","last_became_peered":"2024-09-12T00:28:31.214134+0000","last_unstale":"2024-09-12T01:38:01.733963+0000","last_undegraded":"2024-09-12T01:38:01.733963+0000","last_fullsized":"2024-09-12T01:38:01.733963+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:00.479671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553650,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":469,"num_read_kb":31725,"num_write":1010,"num_write_kb":40420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"263'102","reported_seq":694,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:01.784409+0000","last_change":"2024-09-12T00:28:33.213186+0000","last_active":"2024-09-12T01:34:01.784409+0000","last_peered":"2024-09-12T01:34:01.784409+0000","last_clean":"2024-09-12T01:34:01.784409+0000","last_became_active":"2024-09-12T00:28:33.212886+0000","last_became_peered":"2024-09-12T00:28:33.212886+0000","last_unstale":"2024-09-12T01:34:01.784409+0000","last_undegraded":"2024-09-12T01:34:01.784409+0000","last_fullsized":"2024-09-12T01:34:01.784409+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:53.462824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":476,"num_read_kb":407,"num_write":159,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"263'396","reported_seq":1143,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.731959+0000","last_change":"2024-09-12T00:28:31.197815+0000","last_active":"2024-09-12T01:38:01.731959+0000","last_peered":"2024-09-12T01:38:01.731959+0000","last_clean":"2024-09-12T01:38:01.731959+0000","last_became_active":"2024-09-12T00:28:31.196230+0000","last_became_peered":"2024-09-12T00:28:31.196230+0000","last_unstale":"2024-09-12T01:38:01.731959+0000","last_undegraded":"2024-09-12T01:38:01.731959+0000","last_fullsized":"2024-09-12T01:38:01.731959+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:32.020082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291522,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":735,"num_read_kb":35673,"num_write":1292,"num_write_kb":40181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"263'212","reported_seq":801,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:01.455973+0000","last_change":"2024-09-12T00:28:33.213479+0000","last_active":"2024-09-12T01:34:01.455973+0000","last_peered":"2024-09-12T01:34:01.455973+0000","last_clean":"2024-09-12T01:34:01.455973+0000","last_became_active":"2024-09-12T00:28:33.213187+0000","last_became_peered":"2024-09-12T00:28:33.213187+0000","last_unstale":"2024-09-12T01:34:01.455973+0000","last_undegraded":"2024-09-12T01:34:01.455973+0000","last_fullsized":"2024-09-12T01:34:01.455973+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:03.213237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":884,"num_read_kb":712,"num_write":323,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5759,"num_read_kb":4046,"num_write":1929,"num_write_kb":827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1000,"ondisk_log_size":1000,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15395,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":15045,"num_read_kb":14706,"num_write":16739,"num_write_kb":4892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1773,"ondisk_log_size":1773,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":506,"ondisk_log_size":506,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1546437,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":18805,"num_read_kb":38761,"num_write":15745,"num_write_kb":11880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":486207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2032,"ondisk_log_size":2032,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2403,"num_read_kb":2865,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":103056,"num_read_kb":85959,"num_write":37323,"num_write_kb":18865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4302,"ondisk_log_size":4302,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":193149897,"num_objects":1186,"num_object_clones":0,"num_object_copies":2372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1186,"num_whiteouts":0,"num_read":35345,"num_read_kb":1909940,"num_write":70540,"num_write_kb":2052201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":351162368,"data_stored":343412814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3728,"ondisk_log_size":3728,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":16785380,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":127,"num_read_kb":175308,"num_write":149,"num_write_kb":116383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":27197,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":29421568,"data_stored":29416713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":89,"ondisk_log_size":89,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":132,"num_read_kb":178855,"num_write":153,"num_write_kb":116383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":26800128,"data_stored":26798763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":93,"ondisk_log_size":93,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510283,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":259636,"kb_used_data":29848,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94112204,"statfs":{"total":96636764160,"available":96370896896,"internally_reserved":0,"allocated":30564352,"data_stored":27856316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":235207114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510282,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":263728,"kb_used_data":33884,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94108112,"statfs":{"total":96636764160,"available":96366706688,"internally_reserved":0,"allocated":34697216,"data_stored":32019931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":235207110},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510285,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":143624,"kb_used_data":44244,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94228216,"statfs":{"total":96636764160,"available":96489693184,"internally_reserved":0,"allocated":45305856,"data_stored":43509539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510281,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":210132,"kb_used_data":142808,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94161708,"statfs":{"total":96636764160,"available":96421588992,"internally_reserved":0,"allocated":146235392,"data_stored":141707397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510284,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":106688,"kb_used_data":57356,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94265152,"statfs":{"total":96636764160,"available":96527515648,"internally_reserved":0,"allocated":58732544,"data_stored":55554255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510287,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":161148,"kb_used_data":49224,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94210692,"statfs":{"total":96636764160,"available":96471748608,"internally_reserved":0,"allocated":50405376,"data_stored":47762189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510285,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302192,"kb_used_data":58492,"kb_used_omap":1,"kb_used_meta":243518,"kb_avail":94069648,"statfs":{"total":96636764160,"available":96327319552,"internally_reserved":0,"allocated":59895808,"data_stored":56705710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":249362885},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575690,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":465020,"kb_used_data":213100,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":93906820,"statfs":{"total":96636764160,"available":96160583680,"internally_reserved":0,"allocated":218214400,"data_stored":211568643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":257948104},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":31928320,"data_stored":31687986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19750912,"data_stored":19603309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16175104,"data_stored":15670618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":173539328,"data_stored":168466743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":34234368,"data_stored":33463876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":41611264,"data_stored":41372743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":18251776,"data_stored":17721878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15671296,"data_stored":15425661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":569344,"data_stored":480013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20508672,"data_stored":20507307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3145728,"data_stored":3145728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":19984384,"data_stored":19979529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:38:04.340 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:38:04.664 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:38:04.664 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":263,"fsid":"f020195c-ad88-4fe3-a760-71957da35598","created":"2024-09-12T00:27:58.232371+0000","modified":"2024-09-12T01:04:16.375385+0000","last_up_change":"2024-09-12T00:28:11.103864+0000","last_in_change":"2024-09-12T00:28:01.397414+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":16,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":68,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:28:12.470055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T00:28:17.330363+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":23,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-12T00:28:30.061210+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-12T00:28:31.526219+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-12T00:28:33.464503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-12T00:28:35.265637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-12T00:28:37.232357+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-12T00:28:39.277193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":65,"pool_name":"default.rgw.buckets.non-ec","create_time":"2024-09-12T00:42:34.983683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"252","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":66,"pool_name":"default.rgw.buckets.data.frozen","create_time":"2024-09-12T00:46:21.275111+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"255","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":67,"pool_name":"default.rgw.buckets.data.lukewarm","create_time":"2024-09-12T00:46:25.263082+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"258","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":68,"pool_name":"default.rgw.otp","create_time":"2024-09-12T01:04:13.962824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"263","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eb34ba71-824c-4899-8325-e5683677cde7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1807760270},{"type":"v1","addr":"172.21.15.73:6811","nonce":1807760270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1807760270},{"type":"v1","addr":"172.21.15.73:6813","nonce":1807760270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1807760270},{"type":"v1","addr":"172.21.15.73:6817","nonce":1807760270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1807760270},{"type":"v1","addr":"172.21.15.73:6815","nonce":1807760270}]},"public_addr":"172.21.15.73:6811/1807760270","cluster_addr":"172.21.15.73:6813/1807760270","heartbeat_back_addr":"172.21.15.73:6817/1807760270","heartbeat_front_addr":"172.21.15.73:6815/1807760270","state":["exists","up"]},{"osd":1,"uuid":"c5a02013-ada7-406c-9a62-4a683000d243","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":153097326},{"type":"v1","addr":"172.21.15.73:6819","nonce":153097326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":153097326},{"type":"v1","addr":"172.21.15.73:6821","nonce":153097326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":153097326},{"type":"v1","addr":"172.21.15.73:6825","nonce":153097326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":153097326},{"type":"v1","addr":"172.21.15.73:6823","nonce":153097326}]},"public_addr":"172.21.15.73:6819/153097326","cluster_addr":"172.21.15.73:6821/153097326","heartbeat_back_addr":"172.21.15.73:6825/153097326","heartbeat_front_addr":"172.21.15.73:6823/153097326","state":["exists","up"]},{"osd":2,"uuid":"f0720950-c9f6-4f48-882d-ca95299711e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":269690776},{"type":"v1","addr":"172.21.15.73:6827","nonce":269690776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":269690776},{"type":"v1","addr":"172.21.15.73:6829","nonce":269690776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":269690776},{"type":"v1","addr":"172.21.15.73:6833","nonce":269690776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":269690776},{"type":"v1","addr":"172.21.15.73:6831","nonce":269690776}]},"public_addr":"172.21.15.73:6827/269690776","cluster_addr":"172.21.15.73:6829/269690776","heartbeat_back_addr":"172.21.15.73:6833/269690776","heartbeat_front_addr":"172.21.15.73:6831/269690776","state":["exists","up"]},{"osd":3,"uuid":"986d4757-211f-4814-aeb4-9567f819b765","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2864081714},{"type":"v1","addr":"172.21.15.73:6801","nonce":2864081714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2864081714},{"type":"v1","addr":"172.21.15.73:6803","nonce":2864081714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2864081714},{"type":"v1","addr":"172.21.15.73:6807","nonce":2864081714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2864081714},{"type":"v1","addr":"172.21.15.73:6805","nonce":2864081714}]},"public_addr":"172.21.15.73:6801/2864081714","cluster_addr":"172.21.15.73:6803/2864081714","heartbeat_back_addr":"172.21.15.73:6807/2864081714","heartbeat_front_addr":"172.21.15.73:6805/2864081714","state":["exists","up"]},{"osd":4,"uuid":"f04f1a37-5e86-4527-9c26-8ca21ccdd082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":87909260},{"type":"v1","addr":"172.21.15.117:6809","nonce":87909260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":87909260},{"type":"v1","addr":"172.21.15.117:6811","nonce":87909260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":87909260},{"type":"v1","addr":"172.21.15.117:6815","nonce":87909260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":87909260},{"type":"v1","addr":"172.21.15.117:6813","nonce":87909260}]},"public_addr":"172.21.15.117:6809/87909260","cluster_addr":"172.21.15.117:6811/87909260","heartbeat_back_addr":"172.21.15.117:6815/87909260","heartbeat_front_addr":"172.21.15.117:6813/87909260","state":["exists","up"]},{"osd":5,"uuid":"53aa7cf0-1f78-411c-bb5e-e5f5789dc4cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":197320478},{"type":"v1","addr":"172.21.15.117:6825","nonce":197320478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":197320478},{"type":"v1","addr":"172.21.15.117:6827","nonce":197320478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":197320478},{"type":"v1","addr":"172.21.15.117:6831","nonce":197320478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":197320478},{"type":"v1","addr":"172.21.15.117:6829","nonce":197320478}]},"public_addr":"172.21.15.117:6825/197320478","cluster_addr":"172.21.15.117:6827/197320478","heartbeat_back_addr":"172.21.15.117:6831/197320478","heartbeat_front_addr":"172.21.15.117:6829/197320478","state":["exists","up"]},{"osd":6,"uuid":"47cdfa3e-cd16-404c-bb76-1524ac454b51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":110688882},{"type":"v1","addr":"172.21.15.117:6801","nonce":110688882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":110688882},{"type":"v1","addr":"172.21.15.117:6803","nonce":110688882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":110688882},{"type":"v1","addr":"172.21.15.117:6807","nonce":110688882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":110688882},{"type":"v1","addr":"172.21.15.117:6805","nonce":110688882}]},"public_addr":"172.21.15.117:6801/110688882","cluster_addr":"172.21.15.117:6803/110688882","heartbeat_back_addr":"172.21.15.117:6807/110688882","heartbeat_front_addr":"172.21.15.117:6805/110688882","state":["exists","up"]},{"osd":7,"uuid":"3caf8dd6-f629-41af-94f2-e636d1aa2536","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":1460498570},{"type":"v1","addr":"172.21.15.117:6817","nonce":1460498570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":1460498570},{"type":"v1","addr":"172.21.15.117:6819","nonce":1460498570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":1460498570},{"type":"v1","addr":"172.21.15.117:6823","nonce":1460498570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":1460498570},{"type":"v1","addr":"172.21.15.117:6821","nonce":1460498570}]},"public_addr":"172.21.15.117:6817/1460498570","cluster_addr":"172.21.15.117:6819/1460498570","heartbeat_back_addr":"172.21.15.117:6823/1460498570","heartbeat_front_addr":"172.21.15.117:6821/1460498570","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:28:08.764438+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:28:07.752079+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:28:08.096171+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:28:07.206891+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:28:08.219743+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:28:07.997017+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:28:07.448575+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:28:08.645429+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.14","mappings":[{"from":4,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.24","mappings":[{"from":3,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.2f","mappings":[{"from":3,"to":2}]},{"pgid":"67.18","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":1,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:38:05.678 INFO:tasks.ceph:Scrubbing osd.0 2024-09-12T01:38:05.679 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:38:05.839 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T01:38:05.839 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:38:05.839 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T01:38:05.850 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-12T01:38:06.148 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 0 to deep-scrub 2024-09-12T01:38:06.162 INFO:tasks.ceph:Scrubbing osd.1 2024-09-12T01:38:06.162 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:38:06.298 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T01:38:06.298 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:38:06.298 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T01:38:06.309 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-12T01:38:06.611 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 1 to deep-scrub 2024-09-12T01:38:06.625 INFO:tasks.ceph:Scrubbing osd.2 2024-09-12T01:38:06.625 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:38:06.761 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T01:38:06.761 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:38:06.761 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T01:38:06.772 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-12T01:38:07.071 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 2 to deep-scrub 2024-09-12T01:38:07.084 INFO:tasks.ceph:Scrubbing osd.3 2024-09-12T01:38:07.084 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:38:07.222 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T01:38:07.222 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:38:07.222 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T01:38:07.233 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-12T01:38:07.533 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 3 to deep-scrub 2024-09-12T01:38:07.548 INFO:tasks.ceph:Scrubbing osd.4 2024-09-12T01:38:07.549 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:38:07.687 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T01:38:07.687 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:38:07.687 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T01:38:07.697 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-12T01:38:07.998 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 4 to deep-scrub 2024-09-12T01:38:08.012 INFO:tasks.ceph:Scrubbing osd.5 2024-09-12T01:38:08.012 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:38:08.151 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T01:38:08.151 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:38:08.151 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T01:38:08.161 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-12T01:38:08.466 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 5 to deep-scrub 2024-09-12T01:38:08.479 INFO:tasks.ceph:Scrubbing osd.6 2024-09-12T01:38:08.479 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:38:08.618 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T01:38:08.618 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:38:08.618 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T01:38:08.629 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-12T01:38:08.931 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 6 to deep-scrub 2024-09-12T01:38:08.944 INFO:tasks.ceph:Scrubbing osd.7 2024-09-12T01:38:08.944 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:38:09.083 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T01:38:09.084 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:38:09.084 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T01:38:09.094 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-12T01:38:09.426 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 7 to deep-scrub 2024-09-12T01:38:09.439 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:38:09.763 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:38:09.775 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T01:38:09.777 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":2355,"stamp":"2024-09-12T01:38:07.940565+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":96390822,"num_objects":752,"num_object_clones":0,"num_object_copies":1504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":752,"num_whiteouts":0,"num_read":181613,"num_read_kb":2411162,"num_write":143549,"num_write_kb":2323097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":27197,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13654,"ondisk_log_size":13654,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1515564,"kb_used_data":215224,"kb_used_omap":12,"kb_used_meta":1298675,"kb_avail":753459156,"statfs":{"total":773094113280,"available":771542175744,"internally_reserved":0,"allocated":220389376,"data_stored":206842470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1329843761},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,3],"upper_bound":4},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-591542137,"num_objects":-4061,"num_object_clones":0,"num_object_copies":-8122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4061,"num_whiteouts":0,"num_read":4547,"num_read_kb":4094,"num_write":4312,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004461"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:17.783401+0000","last_change":"2024-09-12T01:04:15.393241+0000","last_active":"2024-09-12T01:34:17.783401+0000","last_peered":"2024-09-12T01:34:17.783401+0000","last_clean":"2024-09-12T01:34:17.783401+0000","last_became_active":"2024-09-12T01:04:15.392944+0000","last_became_peered":"2024-09-12T01:04:15.392944+0000","last_unstale":"2024-09-12T01:34:17.783401+0000","last_undegraded":"2024-09-12T01:34:17.783401+0000","last_fullsized":"2024-09-12T01:34:17.783401+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:32.532552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"263'8","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.458995+0000","last_change":"2024-09-12T00:46:26.362583+0000","last_active":"2024-09-12T01:38:00.458995+0000","last_peered":"2024-09-12T01:38:00.458995+0000","last_clean":"2024-09-12T01:38:00.458995+0000","last_became_active":"2024-09-12T00:46:26.362231+0000","last_became_peered":"2024-09-12T00:46:26.362231+0000","last_unstale":"2024-09-12T01:38:00.458995+0000","last_undegraded":"2024-09-12T01:38:00.458995+0000","last_fullsized":"2024-09-12T01:38:00.458995+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:47.340687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":19456,"num_write":13,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:54.637545+0000","last_change":"2024-09-12T00:46:22.353581+0000","last_active":"2024-09-12T01:33:54.637545+0000","last_peered":"2024-09-12T01:33:54.637545+0000","last_clean":"2024-09-12T01:33:54.637545+0000","last_became_active":"2024-09-12T00:46:22.353306+0000","last_became_peered":"2024-09-12T00:46:22.353306+0000","last_unstale":"2024-09-12T01:33:54.637545+0000","last_undegraded":"2024-09-12T01:33:54.637545+0000","last_fullsized":"2024-09-12T01:33:54.637545+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:42.123772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"263'59","reported_seq":219,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:41.789494+0000","last_change":"2024-09-12T00:42:36.818643+0000","last_active":"2024-09-12T01:34:41.789494+0000","last_peered":"2024-09-12T01:34:41.789494+0000","last_clean":"2024-09-12T01:34:41.789494+0000","last_became_active":"2024-09-12T00:42:36.818329+0000","last_became_peered":"2024-09-12T00:42:36.818329+0000","last_unstale":"2024-09-12T01:34:41.789494+0000","last_undegraded":"2024-09-12T01:34:41.789494+0000","last_fullsized":"2024-09-12T01:34:41.789494+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:59.176386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":293,"num_read_kb":205,"num_write":105,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:16.629694+0000","last_change":"2024-09-12T01:04:15.393046+0000","last_active":"2024-09-12T01:34:16.629694+0000","last_peered":"2024-09-12T01:34:16.629694+0000","last_clean":"2024-09-12T01:34:16.629694+0000","last_became_active":"2024-09-12T01:04:15.392747+0000","last_became_peered":"2024-09-12T01:04:15.392747+0000","last_unstale":"2024-09-12T01:34:16.629694+0000","last_undegraded":"2024-09-12T01:34:16.629694+0000","last_fullsized":"2024-09-12T01:34:16.629694+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:12.627526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"263'3","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:26.555957+0000","last_change":"2024-09-12T00:46:26.370283+0000","last_active":"2024-09-12T01:36:26.555957+0000","last_peered":"2024-09-12T01:36:26.555957+0000","last_clean":"2024-09-12T01:36:26.555957+0000","last_became_active":"2024-09-12T00:46:26.369944+0000","last_became_peered":"2024-09-12T00:46:26.369944+0000","last_unstale":"2024-09-12T01:36:26.555957+0000","last_undegraded":"2024-09-12T01:36:26.555957+0000","last_fullsized":"2024-09-12T01:36:26.555957+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:14.648408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"260'8","reported_seq":70,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.933295+0000","last_change":"2024-09-12T00:46:22.354256+0000","last_active":"2024-09-12T01:33:51.933295+0000","last_peered":"2024-09-12T01:33:51.933295+0000","last_clean":"2024-09-12T01:33:51.933295+0000","last_became_active":"2024-09-12T00:46:22.352009+0000","last_became_peered":"2024-09-12T00:46:22.352009+0000","last_unstale":"2024-09-12T01:33:51.933295+0000","last_undegraded":"2024-09-12T01:33:51.933295+0000","last_fullsized":"2024-09-12T01:33:51.933295+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:27.873653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":26626,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"263'20","reported_seq":116,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:56.533176+0000","last_change":"2024-09-12T00:42:36.809720+0000","last_active":"2024-09-12T01:34:56.533176+0000","last_peered":"2024-09-12T01:34:56.533176+0000","last_clean":"2024-09-12T01:34:56.533176+0000","last_became_active":"2024-09-12T00:42:36.809431+0000","last_became_peered":"2024-09-12T00:42:36.809431+0000","last_unstale":"2024-09-12T01:34:56.533176+0000","last_undegraded":"2024-09-12T01:34:56.533176+0000","last_fullsized":"2024-09-12T01:34:56.533176+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:09.971874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":73,"num_write":40,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:41.548876+0000","last_change":"2024-09-12T01:04:15.384612+0000","last_active":"2024-09-12T01:35:41.548876+0000","last_peered":"2024-09-12T01:35:41.548876+0000","last_clean":"2024-09-12T01:35:41.548876+0000","last_became_active":"2024-09-12T01:04:15.384312+0000","last_became_peered":"2024-09-12T01:04:15.384312+0000","last_unstale":"2024-09-12T01:35:41.548876+0000","last_undegraded":"2024-09-12T01:35:41.548876+0000","last_fullsized":"2024-09-12T01:35:41.548876+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:27.357127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:21.786809+0000","last_change":"2024-09-12T00:46:26.563569+0000","last_active":"2024-09-12T01:34:21.786809+0000","last_peered":"2024-09-12T01:34:21.786809+0000","last_clean":"2024-09-12T01:34:21.786809+0000","last_became_active":"2024-09-12T00:46:26.563267+0000","last_became_peered":"2024-09-12T00:46:26.563267+0000","last_unstale":"2024-09-12T01:34:21.786809+0000","last_undegraded":"2024-09-12T01:34:21.786809+0000","last_fullsized":"2024-09-12T01:34:21.786809+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:14.364154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"260'3","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:41.531630+0000","last_change":"2024-09-12T00:46:22.341443+0000","last_active":"2024-09-12T01:34:41.531630+0000","last_peered":"2024-09-12T01:34:41.531630+0000","last_clean":"2024-09-12T01:34:41.531630+0000","last_became_active":"2024-09-12T00:46:22.340655+0000","last_became_peered":"2024-09-12T00:46:22.340655+0000","last_unstale":"2024-09-12T01:34:41.531630+0000","last_undegraded":"2024-09-12T01:34:41.531630+0000","last_fullsized":"2024-09-12T01:34:41.531630+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:34.773392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"263'63","reported_seq":226,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:06.792053+0000","last_change":"2024-09-12T00:42:36.814795+0000","last_active":"2024-09-12T01:35:06.792053+0000","last_peered":"2024-09-12T01:35:06.792053+0000","last_clean":"2024-09-12T01:35:06.792053+0000","last_became_active":"2024-09-12T00:42:36.814510+0000","last_became_peered":"2024-09-12T00:42:36.814510+0000","last_unstale":"2024-09-12T01:35:06.792053+0000","last_undegraded":"2024-09-12T01:35:06.792053+0000","last_fullsized":"2024-09-12T01:35:06.792053+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:42.130114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":321,"num_read_kb":228,"num_write":110,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:19.633277+0000","last_change":"2024-09-12T01:04:15.402204+0000","last_active":"2024-09-12T01:33:19.633277+0000","last_peered":"2024-09-12T01:33:19.633277+0000","last_clean":"2024-09-12T01:33:19.633277+0000","last_became_active":"2024-09-12T01:04:15.401897+0000","last_became_peered":"2024-09-12T01:04:15.401897+0000","last_unstale":"2024-09-12T01:33:19.633277+0000","last_undegraded":"2024-09-12T01:33:19.633277+0000","last_fullsized":"2024-09-12T01:33:19.633277+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:27.841236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:39.642849+0000","last_change":"2024-09-12T00:46:26.562165+0000","last_active":"2024-09-12T01:34:39.642849+0000","last_peered":"2024-09-12T01:34:39.642849+0000","last_clean":"2024-09-12T01:34:39.642849+0000","last_became_active":"2024-09-12T00:46:26.561870+0000","last_became_peered":"2024-09-12T00:46:26.561870+0000","last_unstale":"2024-09-12T01:34:39.642849+0000","last_undegraded":"2024-09-12T01:34:39.642849+0000","last_fullsized":"2024-09-12T01:34:39.642849+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:20.530939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"263'6","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.235708+0000","last_change":"2024-09-12T00:46:22.339498+0000","last_active":"2024-09-12T01:38:00.235708+0000","last_peered":"2024-09-12T01:38:00.235708+0000","last_clean":"2024-09-12T01:38:00.235708+0000","last_became_active":"2024-09-12T00:46:22.339141+0000","last_became_peered":"2024-09-12T00:46:22.339141+0000","last_unstale":"2024-09-12T01:38:00.235708+0000","last_undegraded":"2024-09-12T01:38:00.235708+0000","last_fullsized":"2024-09-12T01:38:00.235708+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:45.856718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"263'62","reported_seq":225,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:09.646373+0000","last_change":"2024-09-12T00:42:36.816859+0000","last_active":"2024-09-12T01:35:09.646373+0000","last_peered":"2024-09-12T01:35:09.646373+0000","last_clean":"2024-09-12T01:35:09.646373+0000","last_became_active":"2024-09-12T00:42:36.816570+0000","last_became_peered":"2024-09-12T00:42:36.816570+0000","last_unstale":"2024-09-12T01:35:09.646373+0000","last_undegraded":"2024-09-12T01:35:09.646373+0000","last_fullsized":"2024-09-12T01:35:09.646373+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:03.911054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":318,"num_read_kb":239,"num_write":100,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:19.640647+0000","last_change":"2024-09-12T01:04:15.400469+0000","last_active":"2024-09-12T01:34:19.640647+0000","last_peered":"2024-09-12T01:34:19.640647+0000","last_clean":"2024-09-12T01:34:19.640647+0000","last_became_active":"2024-09-12T01:04:15.400228+0000","last_became_peered":"2024-09-12T01:04:15.400228+0000","last_unstale":"2024-09-12T01:34:19.640647+0000","last_undegraded":"2024-09-12T01:34:19.640647+0000","last_fullsized":"2024-09-12T01:34:19.640647+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:12.710997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"263'9","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.748908+0000","last_change":"2024-09-12T00:46:26.368145+0000","last_active":"2024-09-12T01:38:00.748908+0000","last_peered":"2024-09-12T01:38:00.748908+0000","last_clean":"2024-09-12T01:38:00.748908+0000","last_became_active":"2024-09-12T00:46:26.367849+0000","last_became_peered":"2024-09-12T00:46:26.367849+0000","last_unstale":"2024-09-12T01:38:00.748908+0000","last_undegraded":"2024-09-12T01:38:00.748908+0000","last_fullsized":"2024-09-12T01:38:00.748908+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:35.175209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7168,"num_write":19,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"263'13","reported_seq":83,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:06.806586+0000","last_change":"2024-09-12T00:46:22.351181+0000","last_active":"2024-09-12T01:37:06.806586+0000","last_peered":"2024-09-12T01:37:06.806586+0000","last_clean":"2024-09-12T01:37:06.806586+0000","last_became_active":"2024-09-12T00:46:22.349597+0000","last_became_peered":"2024-09-12T00:46:22.349597+0000","last_unstale":"2024-09-12T01:37:06.806586+0000","last_undegraded":"2024-09-12T01:37:06.806586+0000","last_fullsized":"2024-09-12T01:37:06.806586+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:58.755945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":44034,"num_write":28,"num_write_kb":19456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"263'28","reported_seq":129,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:09.646341+0000","last_change":"2024-09-12T00:42:36.815076+0000","last_active":"2024-09-12T01:35:09.646341+0000","last_peered":"2024-09-12T01:35:09.646341+0000","last_clean":"2024-09-12T01:35:09.646341+0000","last_became_active":"2024-09-12T00:42:36.814799+0000","last_became_peered":"2024-09-12T00:42:36.814799+0000","last_unstale":"2024-09-12T01:35:09.646341+0000","last_undegraded":"2024-09-12T01:35:09.646341+0000","last_fullsized":"2024-09-12T01:35:09.646341+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:46.026762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":94,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:31.946433+0000","last_change":"2024-09-12T01:04:15.388981+0000","last_active":"2024-09-12T01:35:31.946433+0000","last_peered":"2024-09-12T01:35:31.946433+0000","last_clean":"2024-09-12T01:35:31.946433+0000","last_became_active":"2024-09-12T01:04:15.388593+0000","last_became_peered":"2024-09-12T01:04:15.388593+0000","last_unstale":"2024-09-12T01:35:31.946433+0000","last_undegraded":"2024-09-12T01:35:31.946433+0000","last_fullsized":"2024-09-12T01:35:31.946433+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:42.435298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"260'2","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:46.540932+0000","last_change":"2024-09-12T00:47:05.446932+0000","last_active":"2024-09-12T01:34:46.540932+0000","last_peered":"2024-09-12T01:34:46.540932+0000","last_clean":"2024-09-12T01:34:46.540932+0000","last_became_active":"2024-09-12T00:47:05.444004+0000","last_became_peered":"2024-09-12T00:47:05.444004+0000","last_unstale":"2024-09-12T01:34:46.540932+0000","last_undegraded":"2024-09-12T01:34:46.540932+0000","last_fullsized":"2024-09-12T01:34:46.540932+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:13.946930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":27197,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"263'2","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:21.563798+0000","last_change":"2024-09-12T00:46:22.348331+0000","last_active":"2024-09-12T01:37:21.563798+0000","last_peered":"2024-09-12T01:37:21.563798+0000","last_clean":"2024-09-12T01:37:21.563798+0000","last_became_active":"2024-09-12T00:46:22.347338+0000","last_became_peered":"2024-09-12T00:46:22.347338+0000","last_unstale":"2024-09-12T01:37:21.563798+0000","last_undegraded":"2024-09-12T01:37:21.563798+0000","last_fullsized":"2024-09-12T01:37:21.563798+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:08.989061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"260'71","reported_seq":297,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:06.543849+0000","last_change":"2024-09-12T00:42:36.812768+0000","last_active":"2024-09-12T01:35:06.543849+0000","last_peered":"2024-09-12T01:35:06.543849+0000","last_clean":"2024-09-12T01:35:06.543849+0000","last_became_active":"2024-09-12T00:42:36.812454+0000","last_became_peered":"2024-09-12T00:42:36.812454+0000","last_unstale":"2024-09-12T01:35:06.543849+0000","last_undegraded":"2024-09-12T01:35:06.543849+0000","last_fullsized":"2024-09-12T01:35:06.543849+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:06.880124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":475,"num_read_kb":319,"num_write":83,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"263'1","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:16.721868+0000","last_change":"2024-09-12T01:04:15.391988+0000","last_active":"2024-09-12T01:34:16.721868+0000","last_peered":"2024-09-12T01:34:16.721868+0000","last_clean":"2024-09-12T01:34:16.721868+0000","last_became_active":"2024-09-12T01:04:15.391532+0000","last_became_peered":"2024-09-12T01:04:15.391532+0000","last_unstale":"2024-09-12T01:34:16.721868+0000","last_undegraded":"2024-09-12T01:34:16.721868+0000","last_fullsized":"2024-09-12T01:34:16.721868+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:13.040622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"263'6","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.236119+0000","last_change":"2024-09-12T00:46:26.374943+0000","last_active":"2024-09-12T01:38:00.236119+0000","last_peered":"2024-09-12T01:38:00.236119+0000","last_clean":"2024-09-12T01:38:00.236119+0000","last_became_active":"2024-09-12T00:46:26.374660+0000","last_became_peered":"2024-09-12T00:46:26.374660+0000","last_unstale":"2024-09-12T01:38:00.236119+0000","last_undegraded":"2024-09-12T01:38:00.236119+0000","last_fullsized":"2024-09-12T01:38:00.236119+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:20.054984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"263'7","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:21.555167+0000","last_change":"2024-09-12T00:46:22.340546+0000","last_active":"2024-09-12T01:36:21.555167+0000","last_peered":"2024-09-12T01:36:21.555167+0000","last_clean":"2024-09-12T01:36:21.555167+0000","last_became_active":"2024-09-12T00:46:22.340228+0000","last_became_peered":"2024-09-12T00:46:22.340228+0000","last_unstale":"2024-09-12T01:36:21.555167+0000","last_undegraded":"2024-09-12T01:36:21.555167+0000","last_fullsized":"2024-09-12T01:36:21.555167+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:22.609852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6219,"num_write":7,"num_write_kb":6219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"263'129","reported_seq":431,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:31.780542+0000","last_change":"2024-09-12T00:42:36.813186+0000","last_active":"2024-09-12T01:33:31.780542+0000","last_peered":"2024-09-12T01:33:31.780542+0000","last_clean":"2024-09-12T01:33:31.780542+0000","last_became_active":"2024-09-12T00:42:36.812882+0000","last_became_peered":"2024-09-12T00:42:36.812882+0000","last_unstale":"2024-09-12T01:33:31.780542+0000","last_undegraded":"2024-09-12T01:33:31.780542+0000","last_fullsized":"2024-09-12T01:33:31.780542+0000","mapping_epoch":250,"log_start":"260'100","ondisk_log_start":"260'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:07.773148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":723,"num_read_kb":503,"num_write":193,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:16.721896+0000","last_change":"2024-09-12T01:04:15.398861+0000","last_active":"2024-09-12T01:34:16.721896+0000","last_peered":"2024-09-12T01:34:16.721896+0000","last_clean":"2024-09-12T01:34:16.721896+0000","last_became_active":"2024-09-12T01:04:15.398533+0000","last_became_peered":"2024-09-12T01:04:15.398533+0000","last_unstale":"2024-09-12T01:34:16.721896+0000","last_undegraded":"2024-09-12T01:34:16.721896+0000","last_fullsized":"2024-09-12T01:34:16.721896+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:15.428730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"263'5","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.405774+0000","last_change":"2024-09-12T00:46:26.368036+0000","last_active":"2024-09-12T01:38:00.405774+0000","last_peered":"2024-09-12T01:38:00.405774+0000","last_clean":"2024-09-12T01:38:00.405774+0000","last_became_active":"2024-09-12T00:46:26.367766+0000","last_became_peered":"2024-09-12T00:46:26.367766+0000","last_unstale":"2024-09-12T01:38:00.405774+0000","last_undegraded":"2024-09-12T01:38:00.405774+0000","last_fullsized":"2024-09-12T01:38:00.405774+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:04.823775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4,"num_write":10,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.783149+0000","last_change":"2024-09-12T00:46:22.354118+0000","last_active":"2024-09-12T01:33:51.783149+0000","last_peered":"2024-09-12T01:33:51.783149+0000","last_clean":"2024-09-12T01:33:51.783149+0000","last_became_active":"2024-09-12T00:46:22.353833+0000","last_became_peered":"2024-09-12T00:46:22.353833+0000","last_unstale":"2024-09-12T01:33:51.783149+0000","last_undegraded":"2024-09-12T01:33:51.783149+0000","last_fullsized":"2024-09-12T01:33:51.783149+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:15.168253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'39","reported_seq":166,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:21.929290+0000","last_change":"2024-09-12T00:42:36.803994+0000","last_active":"2024-09-12T01:33:21.929290+0000","last_peered":"2024-09-12T01:33:21.929290+0000","last_clean":"2024-09-12T01:33:21.929290+0000","last_became_active":"2024-09-12T00:42:36.803692+0000","last_became_peered":"2024-09-12T00:42:36.803692+0000","last_unstale":"2024-09-12T01:33:21.929290+0000","last_undegraded":"2024-09-12T01:33:21.929290+0000","last_fullsized":"2024-09-12T01:33:21.929290+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:25.542741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":209,"num_read_kb":149,"num_write":77,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.938567+0000","last_change":"2024-09-12T01:04:15.385887+0000","last_active":"2024-09-12T01:34:36.938567+0000","last_peered":"2024-09-12T01:34:36.938567+0000","last_clean":"2024-09-12T01:34:36.938567+0000","last_became_active":"2024-09-12T01:04:15.385172+0000","last_became_peered":"2024-09-12T01:04:15.385172+0000","last_unstale":"2024-09-12T01:34:36.938567+0000","last_undegraded":"2024-09-12T01:34:36.938567+0000","last_fullsized":"2024-09-12T01:34:36.938567+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:15.451328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"263'5","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.880428+0000","last_change":"2024-09-12T00:46:26.565125+0000","last_active":"2024-09-12T01:38:00.880428+0000","last_peered":"2024-09-12T01:38:00.880428+0000","last_clean":"2024-09-12T01:38:00.880428+0000","last_became_active":"2024-09-12T00:46:26.561643+0000","last_became_peered":"2024-09-12T00:46:26.561643+0000","last_unstale":"2024-09-12T01:38:00.880428+0000","last_undegraded":"2024-09-12T01:38:00.880428+0000","last_fullsized":"2024-09-12T01:38:00.880428+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:50.221519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10250,"num_write":10,"num_write_kb":5125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:27.793407+0000","last_change":"2024-09-12T00:46:22.349290+0000","last_active":"2024-09-12T01:35:27.793407+0000","last_peered":"2024-09-12T01:35:27.793407+0000","last_clean":"2024-09-12T01:35:27.793407+0000","last_became_active":"2024-09-12T00:46:22.349007+0000","last_became_peered":"2024-09-12T00:46:22.349007+0000","last_unstale":"2024-09-12T01:35:27.793407+0000","last_undegraded":"2024-09-12T01:35:27.793407+0000","last_fullsized":"2024-09-12T01:35:27.793407+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:56.041981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"263'19","reported_seq":112,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:21.779391+0000","last_change":"2024-09-12T00:42:36.815233+0000","last_active":"2024-09-12T01:33:21.779391+0000","last_peered":"2024-09-12T01:33:21.779391+0000","last_clean":"2024-09-12T01:33:21.779391+0000","last_became_active":"2024-09-12T00:42:36.814846+0000","last_became_peered":"2024-09-12T00:42:36.814846+0000","last_unstale":"2024-09-12T01:33:21.779391+0000","last_undegraded":"2024-09-12T01:33:21.779391+0000","last_fullsized":"2024-09-12T01:33:21.779391+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:27.509902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":75,"num_write":34,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"263'1","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.531023+0000","last_change":"2024-09-12T01:04:15.395818+0000","last_active":"2024-09-12T01:34:36.531023+0000","last_peered":"2024-09-12T01:34:36.531023+0000","last_clean":"2024-09-12T01:34:36.531023+0000","last_became_active":"2024-09-12T01:04:15.395540+0000","last_became_peered":"2024-09-12T01:04:15.395540+0000","last_unstale":"2024-09-12T01:34:36.531023+0000","last_undegraded":"2024-09-12T01:34:36.531023+0000","last_fullsized":"2024-09-12T01:34:36.531023+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:29.002458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:39.649759+0000","last_change":"2024-09-12T00:46:26.562294+0000","last_active":"2024-09-12T01:35:39.649759+0000","last_peered":"2024-09-12T01:35:39.649759+0000","last_clean":"2024-09-12T01:35:39.649759+0000","last_became_active":"2024-09-12T00:46:26.561961+0000","last_became_peered":"2024-09-12T00:46:26.561961+0000","last_unstale":"2024-09-12T01:35:39.649759+0000","last_undegraded":"2024-09-12T01:35:39.649759+0000","last_fullsized":"2024-09-12T01:35:39.649759+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:55.068083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"260'5","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:41.725916+0000","last_change":"2024-09-12T00:46:22.351249+0000","last_active":"2024-09-12T01:34:41.725916+0000","last_peered":"2024-09-12T01:34:41.725916+0000","last_clean":"2024-09-12T01:34:41.725916+0000","last_became_active":"2024-09-12T00:46:22.350947+0000","last_became_peered":"2024-09-12T00:46:22.350947+0000","last_unstale":"2024-09-12T01:34:41.725916+0000","last_undegraded":"2024-09-12T01:34:41.725916+0000","last_fullsized":"2024-09-12T01:34:41.725916+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:16.221679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"263'28","reported_seq":135,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:24.633878+0000","last_change":"2024-09-12T00:42:36.815997+0000","last_active":"2024-09-12T01:33:24.633878+0000","last_peered":"2024-09-12T01:33:24.633878+0000","last_clean":"2024-09-12T01:33:24.633878+0000","last_became_active":"2024-09-12T00:42:36.815638+0000","last_became_peered":"2024-09-12T00:42:36.815638+0000","last_unstale":"2024-09-12T01:33:24.633878+0000","last_undegraded":"2024-09-12T01:33:24.633878+0000","last_fullsized":"2024-09-12T01:33:24.633878+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:31.983576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":103,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.724838+0000","last_change":"2024-09-12T01:04:15.391815+0000","last_active":"2024-09-12T01:34:36.724838+0000","last_peered":"2024-09-12T01:34:36.724838+0000","last_clean":"2024-09-12T01:34:36.724838+0000","last_became_active":"2024-09-12T01:04:15.391501+0000","last_became_peered":"2024-09-12T01:04:15.391501+0000","last_unstale":"2024-09-12T01:34:36.724838+0000","last_undegraded":"2024-09-12T01:34:36.724838+0000","last_fullsized":"2024-09-12T01:34:36.724838+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:28.795724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:49.644166+0000","last_change":"2024-09-12T00:46:26.563439+0000","last_active":"2024-09-12T01:34:49.644166+0000","last_peered":"2024-09-12T01:34:49.644166+0000","last_clean":"2024-09-12T01:34:49.644166+0000","last_became_active":"2024-09-12T00:46:26.563091+0000","last_became_peered":"2024-09-12T00:46:26.563091+0000","last_unstale":"2024-09-12T01:34:49.644166+0000","last_undegraded":"2024-09-12T01:34:49.644166+0000","last_fullsized":"2024-09-12T01:34:49.644166+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:05.796776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:41.531600+0000","last_change":"2024-09-12T00:46:22.354515+0000","last_active":"2024-09-12T01:34:41.531600+0000","last_peered":"2024-09-12T01:34:41.531600+0000","last_clean":"2024-09-12T01:34:41.531600+0000","last_became_active":"2024-09-12T00:46:22.354167+0000","last_became_peered":"2024-09-12T00:46:22.354167+0000","last_unstale":"2024-09-12T01:34:41.531600+0000","last_undegraded":"2024-09-12T01:34:41.531600+0000","last_fullsized":"2024-09-12T01:34:41.531600+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:09.196332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"260'8","reported_seq":81,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:21.624072+0000","last_change":"2024-09-12T00:42:36.803040+0000","last_active":"2024-09-12T01:33:21.624072+0000","last_peered":"2024-09-12T01:33:21.624072+0000","last_clean":"2024-09-12T01:33:21.624072+0000","last_became_active":"2024-09-12T00:42:36.802737+0000","last_became_peered":"2024-09-12T00:42:36.802737+0000","last_unstale":"2024-09-12T01:33:21.624072+0000","last_undegraded":"2024-09-12T01:33:21.624072+0000","last_fullsized":"2024-09-12T01:33:21.624072+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:54.260259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:37.786393+0000","last_change":"2024-09-12T01:04:15.393599+0000","last_active":"2024-09-12T01:34:37.786393+0000","last_peered":"2024-09-12T01:34:37.786393+0000","last_clean":"2024-09-12T01:34:37.786393+0000","last_became_active":"2024-09-12T01:04:15.393292+0000","last_became_peered":"2024-09-12T01:04:15.393292+0000","last_unstale":"2024-09-12T01:34:37.786393+0000","last_undegraded":"2024-09-12T01:34:37.786393+0000","last_fullsized":"2024-09-12T01:34:37.786393+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:04.044752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"263'3","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:11.562356+0000","last_change":"2024-09-12T00:46:26.371159+0000","last_active":"2024-09-12T01:37:11.562356+0000","last_peered":"2024-09-12T01:37:11.562356+0000","last_clean":"2024-09-12T01:37:11.562356+0000","last_became_active":"2024-09-12T00:46:26.370845+0000","last_became_peered":"2024-09-12T00:46:26.370845+0000","last_unstale":"2024-09-12T01:37:11.562356+0000","last_undegraded":"2024-09-12T01:37:11.562356+0000","last_fullsized":"2024-09-12T01:37:11.562356+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:36.995861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:41.789472+0000","last_change":"2024-09-12T00:46:22.349777+0000","last_active":"2024-09-12T01:34:41.789472+0000","last_peered":"2024-09-12T01:34:41.789472+0000","last_clean":"2024-09-12T01:34:41.789472+0000","last_became_active":"2024-09-12T00:46:22.348534+0000","last_became_peered":"2024-09-12T00:46:22.348534+0000","last_unstale":"2024-09-12T01:34:41.789472+0000","last_undegraded":"2024-09-12T01:34:41.789472+0000","last_fullsized":"2024-09-12T01:34:41.789472+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:19.642717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"263'16","reported_seq":98,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:11.721017+0000","last_change":"2024-09-12T00:42:36.812901+0000","last_active":"2024-09-12T01:34:11.721017+0000","last_peered":"2024-09-12T01:34:11.721017+0000","last_clean":"2024-09-12T01:34:11.721017+0000","last_became_active":"2024-09-12T00:42:36.812629+0000","last_became_peered":"2024-09-12T00:42:36.812629+0000","last_unstale":"2024-09-12T01:34:11.721017+0000","last_undegraded":"2024-09-12T01:34:11.721017+0000","last_fullsized":"2024-09-12T01:34:11.721017+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:44.152868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":48,"num_write":38,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:39.649821+0000","last_change":"2024-09-12T01:04:15.398685+0000","last_active":"2024-09-12T01:35:39.649821+0000","last_peered":"2024-09-12T01:35:39.649821+0000","last_clean":"2024-09-12T01:35:39.649821+0000","last_became_active":"2024-09-12T01:04:15.398407+0000","last_became_peered":"2024-09-12T01:04:15.398407+0000","last_unstale":"2024-09-12T01:35:39.649821+0000","last_undegraded":"2024-09-12T01:35:39.649821+0000","last_fullsized":"2024-09-12T01:35:39.649821+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:31.635332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"263'3","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.962291+0000","last_change":"2024-09-12T00:46:26.367154+0000","last_active":"2024-09-12T01:37:46.962291+0000","last_peered":"2024-09-12T01:37:46.962291+0000","last_clean":"2024-09-12T01:37:46.962291+0000","last_became_active":"2024-09-12T00:46:26.366602+0000","last_became_peered":"2024-09-12T00:46:26.366602+0000","last_unstale":"2024-09-12T01:37:46.962291+0000","last_undegraded":"2024-09-12T01:37:46.962291+0000","last_fullsized":"2024-09-12T01:37:46.962291+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:36.704535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"263'9","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.830640+0000","last_change":"2024-09-12T00:46:22.351729+0000","last_active":"2024-09-12T01:38:00.830640+0000","last_peered":"2024-09-12T01:38:00.830640+0000","last_clean":"2024-09-12T01:38:00.830640+0000","last_became_active":"2024-09-12T00:46:22.351432+0000","last_became_peered":"2024-09-12T00:46:22.351432+0000","last_unstale":"2024-09-12T01:38:00.830640+0000","last_undegraded":"2024-09-12T01:38:00.830640+0000","last_fullsized":"2024-09-12T01:38:00.830640+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:22.950636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":19,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"252'16","reported_seq":103,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.718650+0000","last_change":"2024-09-12T00:42:36.813580+0000","last_active":"2024-09-12T01:33:56.718650+0000","last_peered":"2024-09-12T01:33:56.718650+0000","last_clean":"2024-09-12T01:33:56.718650+0000","last_became_active":"2024-09-12T00:42:36.813324+0000","last_became_peered":"2024-09-12T00:42:36.813324+0000","last_unstale":"2024-09-12T01:33:56.718650+0000","last_undegraded":"2024-09-12T01:33:56.718650+0000","last_fullsized":"2024-09-12T01:33:56.718650+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:12.154346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":59,"num_write":21,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:41.796461+0000","last_change":"2024-09-12T01:04:15.394539+0000","last_active":"2024-09-12T01:35:41.796461+0000","last_peered":"2024-09-12T01:35:41.796461+0000","last_clean":"2024-09-12T01:35:41.796461+0000","last_became_active":"2024-09-12T01:04:15.393021+0000","last_became_peered":"2024-09-12T01:04:15.393021+0000","last_unstale":"2024-09-12T01:35:41.796461+0000","last_undegraded":"2024-09-12T01:35:41.796461+0000","last_fullsized":"2024-09-12T01:35:41.796461+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"260'8","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:26.945799+0000","last_change":"2024-09-12T00:46:26.371696+0000","last_active":"2024-09-12T01:35:26.945799+0000","last_peered":"2024-09-12T01:35:26.945799+0000","last_clean":"2024-09-12T01:35:26.945799+0000","last_became_active":"2024-09-12T00:46:26.371443+0000","last_became_peered":"2024-09-12T00:46:26.371443+0000","last_unstale":"2024-09-12T01:35:26.945799+0000","last_undegraded":"2024-09-12T01:35:26.945799+0000","last_fullsized":"2024-09-12T01:35:26.945799+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:26.396539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":26626,"num_write":8,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:24.648070+0000","last_change":"2024-09-12T00:46:22.352325+0000","last_active":"2024-09-12T01:35:24.648070+0000","last_peered":"2024-09-12T01:35:24.648070+0000","last_clean":"2024-09-12T01:35:24.648070+0000","last_became_active":"2024-09-12T00:46:22.350714+0000","last_became_peered":"2024-09-12T00:46:22.350714+0000","last_unstale":"2024-09-12T01:35:24.648070+0000","last_undegraded":"2024-09-12T01:35:24.648070+0000","last_fullsized":"2024-09-12T01:35:24.648070+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:40.578771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"263'52","reported_seq":201,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.783741+0000","last_change":"2024-09-12T00:42:36.818076+0000","last_active":"2024-09-12T01:33:56.783741+0000","last_peered":"2024-09-12T01:33:56.783741+0000","last_clean":"2024-09-12T01:33:56.783741+0000","last_became_active":"2024-09-12T00:42:36.817763+0000","last_became_peered":"2024-09-12T00:42:36.817763+0000","last_unstale":"2024-09-12T01:33:56.783741+0000","last_undegraded":"2024-09-12T01:33:56.783741+0000","last_fullsized":"2024-09-12T01:33:56.783741+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:56.184689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":268,"num_read_kb":195,"num_write":87,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.788740+0000","last_change":"2024-09-12T01:04:15.397100+0000","last_active":"2024-09-12T01:34:36.788740+0000","last_peered":"2024-09-12T01:34:36.788740+0000","last_clean":"2024-09-12T01:34:36.788740+0000","last_became_active":"2024-09-12T01:04:15.396832+0000","last_became_peered":"2024-09-12T01:04:15.396832+0000","last_unstale":"2024-09-12T01:34:36.788740+0000","last_undegraded":"2024-09-12T01:34:36.788740+0000","last_fullsized":"2024-09-12T01:34:36.788740+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:22.398122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:29.648642+0000","last_change":"2024-09-12T00:46:26.373712+0000","last_active":"2024-09-12T01:35:29.648642+0000","last_peered":"2024-09-12T01:35:29.648642+0000","last_clean":"2024-09-12T01:35:29.648642+0000","last_became_active":"2024-09-12T00:46:26.373401+0000","last_became_peered":"2024-09-12T00:46:26.373401+0000","last_unstale":"2024-09-12T01:35:29.648642+0000","last_undegraded":"2024-09-12T01:35:29.648642+0000","last_fullsized":"2024-09-12T01:35:29.648642+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:11.356426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:21.546124+0000","last_change":"2024-09-12T00:46:22.348093+0000","last_active":"2024-09-12T01:35:21.546124+0000","last_peered":"2024-09-12T01:35:21.546124+0000","last_clean":"2024-09-12T01:35:21.546124+0000","last_became_active":"2024-09-12T00:46:22.347794+0000","last_became_peered":"2024-09-12T00:46:22.347794+0000","last_unstale":"2024-09-12T01:35:21.546124+0000","last_undegraded":"2024-09-12T01:35:21.546124+0000","last_fullsized":"2024-09-12T01:35:21.546124+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:37.768628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'10","reported_seq":83,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.534383+0000","last_change":"2024-09-12T00:42:36.802979+0000","last_active":"2024-09-12T01:33:56.534383+0000","last_peered":"2024-09-12T01:33:56.534383+0000","last_clean":"2024-09-12T01:33:56.534383+0000","last_became_active":"2024-09-12T00:42:36.802647+0000","last_became_peered":"2024-09-12T00:42:36.802647+0000","last_unstale":"2024-09-12T01:33:56.534383+0000","last_undegraded":"2024-09-12T01:33:56.534383+0000","last_fullsized":"2024-09-12T01:33:56.534383+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:38.850484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":30,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:39.649795+0000","last_change":"2024-09-12T01:04:15.397994+0000","last_active":"2024-09-12T01:35:39.649795+0000","last_peered":"2024-09-12T01:35:39.649795+0000","last_clean":"2024-09-12T01:35:39.649795+0000","last_became_active":"2024-09-12T01:04:15.397646+0000","last_became_peered":"2024-09-12T01:04:15.397646+0000","last_unstale":"2024-09-12T01:35:39.649795+0000","last_undegraded":"2024-09-12T01:35:39.649795+0000","last_fullsized":"2024-09-12T01:35:39.649795+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:13.049264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"263'3","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.567221+0000","last_change":"2024-09-12T00:46:26.373701+0000","last_active":"2024-09-12T01:37:46.567221+0000","last_peered":"2024-09-12T01:37:46.567221+0000","last_clean":"2024-09-12T01:37:46.567221+0000","last_became_active":"2024-09-12T00:46:26.373354+0000","last_became_peered":"2024-09-12T00:46:26.373354+0000","last_unstale":"2024-09-12T01:37:46.567221+0000","last_undegraded":"2024-09-12T01:37:46.567221+0000","last_fullsized":"2024-09-12T01:37:46.567221+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:00.128990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:22.792606+0000","last_change":"2024-09-12T00:46:22.349188+0000","last_active":"2024-09-12T01:35:22.792606+0000","last_peered":"2024-09-12T01:35:22.792606+0000","last_clean":"2024-09-12T01:35:22.792606+0000","last_became_active":"2024-09-12T00:46:22.348875+0000","last_became_peered":"2024-09-12T00:46:22.348875+0000","last_unstale":"2024-09-12T01:35:22.792606+0000","last_undegraded":"2024-09-12T01:35:22.792606+0000","last_fullsized":"2024-09-12T01:35:22.792606+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:31.550301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"263'37","reported_seq":164,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:59.638083+0000","last_change":"2024-09-12T00:42:36.814630+0000","last_active":"2024-09-12T01:33:59.638083+0000","last_peered":"2024-09-12T01:33:59.638083+0000","last_clean":"2024-09-12T01:33:59.638083+0000","last_became_active":"2024-09-12T00:42:36.814235+0000","last_became_peered":"2024-09-12T00:42:36.814235+0000","last_unstale":"2024-09-12T01:33:59.638083+0000","last_undegraded":"2024-09-12T01:33:59.638083+0000","last_fullsized":"2024-09-12T01:33:59.638083+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:12.766338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":201,"num_read_kb":139,"num_write":71,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:51.532638+0000","last_change":"2024-09-12T01:04:15.396161+0000","last_active":"2024-09-12T01:34:51.532638+0000","last_peered":"2024-09-12T01:34:51.532638+0000","last_clean":"2024-09-12T01:34:51.532638+0000","last_became_active":"2024-09-12T01:04:15.395860+0000","last_became_peered":"2024-09-12T01:04:15.395860+0000","last_unstale":"2024-09-12T01:34:51.532638+0000","last_undegraded":"2024-09-12T01:34:51.532638+0000","last_fullsized":"2024-09-12T01:34:51.532638+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:49.503666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:44.636344+0000","last_change":"2024-09-12T00:46:26.373083+0000","last_active":"2024-09-12T01:33:44.636344+0000","last_peered":"2024-09-12T01:33:44.636344+0000","last_clean":"2024-09-12T01:33:44.636344+0000","last_became_active":"2024-09-12T00:46:26.372803+0000","last_became_peered":"2024-09-12T00:46:26.372803+0000","last_unstale":"2024-09-12T01:33:44.636344+0000","last_undegraded":"2024-09-12T01:33:44.636344+0000","last_fullsized":"2024-09-12T01:33:44.636344+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:18.884189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"263'9","reported_seq":67,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.744735+0000","last_change":"2024-09-12T00:46:22.356200+0000","last_active":"2024-09-12T01:38:01.744735+0000","last_peered":"2024-09-12T01:38:01.744735+0000","last_clean":"2024-09-12T01:38:01.744735+0000","last_became_active":"2024-09-12T00:46:22.355962+0000","last_became_peered":"2024-09-12T00:46:22.355962+0000","last_unstale":"2024-09-12T01:38:01.744735+0000","last_undegraded":"2024-09-12T01:38:01.744735+0000","last_fullsized":"2024-09-12T01:38:01.744735+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:15:50.421437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5707,"num_write":14,"num_write_kb":4683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"263'12","reported_seq":90,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:39.642863+0000","last_change":"2024-09-12T00:42:36.817087+0000","last_active":"2024-09-12T01:34:39.642863+0000","last_peered":"2024-09-12T01:34:39.642863+0000","last_clean":"2024-09-12T01:34:39.642863+0000","last_became_active":"2024-09-12T00:42:36.816673+0000","last_became_peered":"2024-09-12T00:42:36.816673+0000","last_unstale":"2024-09-12T01:34:39.642863+0000","last_undegraded":"2024-09-12T01:34:39.642863+0000","last_fullsized":"2024-09-12T01:34:39.642863+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:44.855498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":40,"num_write":24,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.736023+0000","last_change":"2024-09-12T01:04:15.393891+0000","last_active":"2024-09-12T01:35:46.736023+0000","last_peered":"2024-09-12T01:35:46.736023+0000","last_clean":"2024-09-12T01:35:46.736023+0000","last_became_active":"2024-09-12T01:04:15.393597+0000","last_became_peered":"2024-09-12T01:04:15.393597+0000","last_unstale":"2024-09-12T01:35:46.736023+0000","last_undegraded":"2024-09-12T01:35:46.736023+0000","last_fullsized":"2024-09-12T01:35:46.736023+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:33.585796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:44.636315+0000","last_change":"2024-09-12T00:46:26.366156+0000","last_active":"2024-09-12T01:33:44.636315+0000","last_peered":"2024-09-12T01:33:44.636315+0000","last_clean":"2024-09-12T01:33:44.636315+0000","last_became_active":"2024-09-12T00:46:26.365848+0000","last_became_peered":"2024-09-12T00:46:26.365848+0000","last_unstale":"2024-09-12T01:33:44.636315+0000","last_undegraded":"2024-09-12T01:33:44.636315+0000","last_fullsized":"2024-09-12T01:33:44.636315+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:48.611575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"263'3","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.235580+0000","last_change":"2024-09-12T00:46:22.351422+0000","last_active":"2024-09-12T01:38:00.235580+0000","last_peered":"2024-09-12T01:38:00.235580+0000","last_clean":"2024-09-12T01:38:00.235580+0000","last_became_active":"2024-09-12T00:46:22.350815+0000","last_became_peered":"2024-09-12T00:46:22.350815+0000","last_unstale":"2024-09-12T01:38:00.235580+0000","last_undegraded":"2024-09-12T01:38:00.235580+0000","last_fullsized":"2024-09-12T01:38:00.235580+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:04.321097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"263'49","reported_seq":188,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:22.784293+0000","last_change":"2024-09-12T00:42:36.811488+0000","last_active":"2024-09-12T01:34:22.784293+0000","last_peered":"2024-09-12T01:34:22.784293+0000","last_clean":"2024-09-12T01:34:22.784293+0000","last_became_active":"2024-09-12T00:42:36.810754+0000","last_became_peered":"2024-09-12T00:42:36.810754+0000","last_unstale":"2024-09-12T01:34:22.784293+0000","last_undegraded":"2024-09-12T01:34:22.784293+0000","last_fullsized":"2024-09-12T01:34:22.784293+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:12.064178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":240,"num_read_kb":165,"num_write":91,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.539582+0000","last_change":"2024-09-12T01:04:15.397399+0000","last_active":"2024-09-12T01:34:36.539582+0000","last_peered":"2024-09-12T01:34:36.539582+0000","last_clean":"2024-09-12T01:34:36.539582+0000","last_became_active":"2024-09-12T01:04:15.396999+0000","last_became_peered":"2024-09-12T01:04:15.396999+0000","last_unstale":"2024-09-12T01:34:36.539582+0000","last_undegraded":"2024-09-12T01:34:36.539582+0000","last_fullsized":"2024-09-12T01:34:36.539582+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:43.411584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:46.932525+0000","last_change":"2024-09-12T00:46:26.563322+0000","last_active":"2024-09-12T01:33:46.932525+0000","last_peered":"2024-09-12T01:33:46.932525+0000","last_clean":"2024-09-12T01:33:46.932525+0000","last_became_active":"2024-09-12T00:46:26.563041+0000","last_became_peered":"2024-09-12T00:46:26.563041+0000","last_unstale":"2024-09-12T01:33:46.932525+0000","last_undegraded":"2024-09-12T01:33:46.932525+0000","last_fullsized":"2024-09-12T01:33:46.932525+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:42.189294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:51.797572+0000","last_change":"2024-09-12T00:46:22.353183+0000","last_active":"2024-09-12T01:35:51.797572+0000","last_peered":"2024-09-12T01:35:51.797572+0000","last_clean":"2024-09-12T01:35:51.797572+0000","last_became_active":"2024-09-12T00:46:22.352933+0000","last_became_peered":"2024-09-12T00:46:22.352933+0000","last_unstale":"2024-09-12T01:35:51.797572+0000","last_undegraded":"2024-09-12T01:35:51.797572+0000","last_fullsized":"2024-09-12T01:35:51.797572+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"263'30","reported_seq":143,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:21.537673+0000","last_change":"2024-09-12T00:42:36.817007+0000","last_active":"2024-09-12T01:34:21.537673+0000","last_peered":"2024-09-12T01:34:21.537673+0000","last_clean":"2024-09-12T01:34:21.537673+0000","last_became_active":"2024-09-12T00:42:36.816619+0000","last_became_peered":"2024-09-12T00:42:36.816619+0000","last_unstale":"2024-09-12T01:34:21.537673+0000","last_undegraded":"2024-09-12T01:34:21.537673+0000","last_fullsized":"2024-09-12T01:34:21.537673+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:41.160245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":113,"num_write":55,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.724886+0000","last_change":"2024-09-12T01:04:15.396475+0000","last_active":"2024-09-12T01:34:36.724886+0000","last_peered":"2024-09-12T01:34:36.724886+0000","last_clean":"2024-09-12T01:34:36.724886+0000","last_became_active":"2024-09-12T01:04:15.396125+0000","last_became_peered":"2024-09-12T01:04:15.396125+0000","last_unstale":"2024-09-12T01:34:36.724886+0000","last_undegraded":"2024-09-12T01:34:36.724886+0000","last_fullsized":"2024-09-12T01:34:36.724886+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:47.673931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:44.636360+0000","last_change":"2024-09-12T00:46:26.366690+0000","last_active":"2024-09-12T01:33:44.636360+0000","last_peered":"2024-09-12T01:33:44.636360+0000","last_clean":"2024-09-12T01:33:44.636360+0000","last_became_active":"2024-09-12T00:46:26.366293+0000","last_became_peered":"2024-09-12T00:46:26.366293+0000","last_unstale":"2024-09-12T01:33:44.636360+0000","last_undegraded":"2024-09-12T01:33:44.636360+0000","last_fullsized":"2024-09-12T01:33:44.636360+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:56.900344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"263'3","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:56.949080+0000","last_change":"2024-09-12T00:46:22.348841+0000","last_active":"2024-09-12T01:35:56.949080+0000","last_peered":"2024-09-12T01:35:56.949080+0000","last_clean":"2024-09-12T01:35:56.949080+0000","last_became_active":"2024-09-12T00:46:22.348546+0000","last_became_peered":"2024-09-12T00:46:22.348546+0000","last_unstale":"2024-09-12T01:35:56.949080+0000","last_undegraded":"2024-09-12T01:35:56.949080+0000","last_fullsized":"2024-09-12T01:35:56.949080+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:40.207770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"263'34","reported_seq":149,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:21.630269+0000","last_change":"2024-09-12T00:42:36.817828+0000","last_active":"2024-09-12T01:34:21.630269+0000","last_peered":"2024-09-12T01:34:21.630269+0000","last_clean":"2024-09-12T01:34:21.630269+0000","last_became_active":"2024-09-12T00:42:36.817530+0000","last_became_peered":"2024-09-12T00:42:36.817530+0000","last_unstale":"2024-09-12T01:34:21.630269+0000","last_undegraded":"2024-09-12T01:34:21.630269+0000","last_fullsized":"2024-09-12T01:34:21.630269+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:04.364763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":117,"num_write":66,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:44.650432+0000","last_change":"2024-09-12T01:04:15.399818+0000","last_active":"2024-09-12T01:35:44.650432+0000","last_peered":"2024-09-12T01:35:44.650432+0000","last_clean":"2024-09-12T01:35:44.650432+0000","last_became_active":"2024-09-12T01:04:15.399564+0000","last_became_peered":"2024-09-12T01:04:15.399564+0000","last_unstale":"2024-09-12T01:35:44.650432+0000","last_undegraded":"2024-09-12T01:35:44.650432+0000","last_fullsized":"2024-09-12T01:35:44.650432+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:02.148148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"263'7","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:16.554428+0000","last_change":"2024-09-12T00:46:26.374247+0000","last_active":"2024-09-12T01:36:16.554428+0000","last_peered":"2024-09-12T01:36:16.554428+0000","last_clean":"2024-09-12T01:36:16.554428+0000","last_became_active":"2024-09-12T00:46:26.373942+0000","last_became_peered":"2024-09-12T00:46:26.373942+0000","last_unstale":"2024-09-12T01:36:16.554428+0000","last_undegraded":"2024-09-12T01:36:16.554428+0000","last_fullsized":"2024-09-12T01:36:16.554428+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:35.593349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8208,"num_write":12,"num_write_kb":8208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:01.784297+0000","last_change":"2024-09-12T00:46:22.352449+0000","last_active":"2024-09-12T01:34:01.784297+0000","last_peered":"2024-09-12T01:34:01.784297+0000","last_clean":"2024-09-12T01:34:01.784297+0000","last_became_active":"2024-09-12T00:46:22.352156+0000","last_became_peered":"2024-09-12T00:46:22.352156+0000","last_unstale":"2024-09-12T01:34:01.784297+0000","last_undegraded":"2024-09-12T01:34:01.784297+0000","last_fullsized":"2024-09-12T01:34:01.784297+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:05.797995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"263'10","reported_seq":83,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:21.786707+0000","last_change":"2024-09-12T00:42:36.817431+0000","last_active":"2024-09-12T01:34:21.786707+0000","last_peered":"2024-09-12T01:34:21.786707+0000","last_clean":"2024-09-12T01:34:21.786707+0000","last_became_active":"2024-09-12T00:42:36.817021+0000","last_became_peered":"2024-09-12T00:42:36.817021+0000","last_unstale":"2024-09-12T01:34:21.786707+0000","last_undegraded":"2024-09-12T01:34:21.786707+0000","last_fullsized":"2024-09-12T01:34:21.786707+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:32.868292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:41.716228+0000","last_change":"2024-09-12T01:04:15.396406+0000","last_active":"2024-09-12T01:33:41.716228+0000","last_peered":"2024-09-12T01:33:41.716228+0000","last_clean":"2024-09-12T01:33:41.716228+0000","last_became_active":"2024-09-12T01:04:15.396096+0000","last_became_peered":"2024-09-12T01:04:15.396096+0000","last_unstale":"2024-09-12T01:33:41.716228+0000","last_undegraded":"2024-09-12T01:33:41.716228+0000","last_fullsized":"2024-09-12T01:33:41.716228+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:42.402476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"260'5","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:06.720106+0000","last_change":"2024-09-12T00:46:26.562285+0000","last_active":"2024-09-12T01:34:06.720106+0000","last_peered":"2024-09-12T01:34:06.720106+0000","last_clean":"2024-09-12T01:34:06.720106+0000","last_became_active":"2024-09-12T00:46:26.561924+0000","last_became_peered":"2024-09-12T00:46:26.561924+0000","last_unstale":"2024-09-12T01:34:06.720106+0000","last_undegraded":"2024-09-12T01:34:06.720106+0000","last_fullsized":"2024-09-12T01:34:06.720106+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:06.317073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:01.934433+0000","last_change":"2024-09-12T00:46:22.350102+0000","last_active":"2024-09-12T01:34:01.934433+0000","last_peered":"2024-09-12T01:34:01.934433+0000","last_clean":"2024-09-12T01:34:01.934433+0000","last_became_active":"2024-09-12T00:46:22.349376+0000","last_became_peered":"2024-09-12T00:46:22.349376+0000","last_unstale":"2024-09-12T01:34:01.934433+0000","last_undegraded":"2024-09-12T01:34:01.934433+0000","last_fullsized":"2024-09-12T01:34:01.934433+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:38.382481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"263'30","reported_seq":144,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:51.727585+0000","last_change":"2024-09-12T00:42:36.810100+0000","last_active":"2024-09-12T01:34:51.727585+0000","last_peered":"2024-09-12T01:34:51.727585+0000","last_clean":"2024-09-12T01:34:51.727585+0000","last_became_active":"2024-09-12T00:42:36.809602+0000","last_became_peered":"2024-09-12T00:42:36.809602+0000","last_unstale":"2024-09-12T01:34:51.727585+0000","last_undegraded":"2024-09-12T01:34:51.727585+0000","last_fullsized":"2024-09-12T01:34:51.727585+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:44.821006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":112,"num_write":54,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"263'1","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.736044+0000","last_change":"2024-09-12T01:04:15.393241+0000","last_active":"2024-09-12T01:35:46.736044+0000","last_peered":"2024-09-12T01:35:46.736044+0000","last_clean":"2024-09-12T01:35:46.736044+0000","last_became_active":"2024-09-12T01:04:15.392789+0000","last_became_peered":"2024-09-12T01:04:15.392789+0000","last_unstale":"2024-09-12T01:35:46.736044+0000","last_undegraded":"2024-09-12T01:35:46.736044+0000","last_fullsized":"2024-09-12T01:35:46.736044+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:06.945446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"260'5","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:41.931667+0000","last_change":"2024-09-12T00:46:26.370237+0000","last_active":"2024-09-12T01:33:41.931667+0000","last_peered":"2024-09-12T01:33:41.931667+0000","last_clean":"2024-09-12T01:33:41.931667+0000","last_became_active":"2024-09-12T00:46:26.369883+0000","last_became_peered":"2024-09-12T00:46:26.369883+0000","last_unstale":"2024-09-12T01:33:41.931667+0000","last_undegraded":"2024-09-12T01:33:41.931667+0000","last_fullsized":"2024-09-12T01:33:41.931667+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:01.571704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:06.784985+0000","last_change":"2024-09-12T00:46:22.348999+0000","last_active":"2024-09-12T01:34:06.784985+0000","last_peered":"2024-09-12T01:34:06.784985+0000","last_clean":"2024-09-12T01:34:06.784985+0000","last_became_active":"2024-09-12T00:46:22.348568+0000","last_became_peered":"2024-09-12T00:46:22.348568+0000","last_unstale":"2024-09-12T01:34:06.784985+0000","last_undegraded":"2024-09-12T01:34:06.784985+0000","last_fullsized":"2024-09-12T01:34:06.784985+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:24.267629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"263'9","reported_seq":84,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:39.642740+0000","last_change":"2024-09-12T00:42:36.814268+0000","last_active":"2024-09-12T01:34:39.642740+0000","last_peered":"2024-09-12T01:34:39.642740+0000","last_clean":"2024-09-12T01:34:39.642740+0000","last_became_active":"2024-09-12T00:42:36.813997+0000","last_became_peered":"2024-09-12T00:42:36.813997+0000","last_unstale":"2024-09-12T01:34:39.642740+0000","last_undegraded":"2024-09-12T01:34:39.642740+0000","last_fullsized":"2024-09-12T01:34:39.642740+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:34.191233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.797023+0000","last_change":"2024-09-12T01:04:15.393511+0000","last_active":"2024-09-12T01:35:46.797023+0000","last_peered":"2024-09-12T01:35:46.797023+0000","last_clean":"2024-09-12T01:35:46.797023+0000","last_became_active":"2024-09-12T01:04:15.393220+0000","last_became_peered":"2024-09-12T01:04:15.393220+0000","last_unstale":"2024-09-12T01:35:46.797023+0000","last_undegraded":"2024-09-12T01:35:46.797023+0000","last_fullsized":"2024-09-12T01:35:46.797023+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:27.528771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"263'2","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:26.741954+0000","last_change":"2024-09-12T00:46:26.370629+0000","last_active":"2024-09-12T01:36:26.741954+0000","last_peered":"2024-09-12T01:36:26.741954+0000","last_clean":"2024-09-12T01:36:26.741954+0000","last_became_active":"2024-09-12T00:46:26.370349+0000","last_became_peered":"2024-09-12T00:46:26.370349+0000","last_unstale":"2024-09-12T01:36:26.741954+0000","last_undegraded":"2024-09-12T01:36:26.741954+0000","last_fullsized":"2024-09-12T01:36:26.741954+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:26.584727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"263'11","reported_seq":77,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.934169+0000","last_change":"2024-09-12T00:46:22.346319+0000","last_active":"2024-09-12T01:38:00.934169+0000","last_peered":"2024-09-12T01:38:00.934169+0000","last_clean":"2024-09-12T01:38:00.934169+0000","last_became_active":"2024-09-12T00:46:22.346024+0000","last_became_peered":"2024-09-12T00:46:22.346024+0000","last_unstale":"2024-09-12T01:38:00.934169+0000","last_undegraded":"2024-09-12T01:38:00.934169+0000","last_fullsized":"2024-09-12T01:38:00.934169+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:06.683878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":32770,"num_write":16,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"263'38","reported_seq":159,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.539545+0000","last_change":"2024-09-12T00:42:36.809663+0000","last_active":"2024-09-12T01:34:36.539545+0000","last_peered":"2024-09-12T01:34:36.539545+0000","last_clean":"2024-09-12T01:34:36.539545+0000","last_became_active":"2024-09-12T00:42:36.809350+0000","last_became_peered":"2024-09-12T00:42:36.809350+0000","last_unstale":"2024-09-12T01:34:36.539545+0000","last_undegraded":"2024-09-12T01:34:36.539545+0000","last_fullsized":"2024-09-12T01:34:36.539545+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:37.120320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":127,"num_write":71,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:31.733691+0000","last_change":"2024-09-12T01:04:15.395069+0000","last_active":"2024-09-12T01:35:31.733691+0000","last_peered":"2024-09-12T01:35:31.733691+0000","last_clean":"2024-09-12T01:35:31.733691+0000","last_became_active":"2024-09-12T01:04:15.394795+0000","last_became_peered":"2024-09-12T01:04:15.394795+0000","last_unstale":"2024-09-12T01:35:31.733691+0000","last_undegraded":"2024-09-12T01:35:31.733691+0000","last_fullsized":"2024-09-12T01:35:31.733691+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:28.070748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"263'2","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:31.802388+0000","last_change":"2024-09-12T00:46:26.368134+0000","last_active":"2024-09-12T01:36:31.802388+0000","last_peered":"2024-09-12T01:36:31.802388+0000","last_clean":"2024-09-12T01:36:31.802388+0000","last_became_active":"2024-09-12T00:46:26.367852+0000","last_became_peered":"2024-09-12T00:46:26.367852+0000","last_unstale":"2024-09-12T01:36:31.802388+0000","last_undegraded":"2024-09-12T01:36:31.802388+0000","last_fullsized":"2024-09-12T01:36:31.802388+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:38.753123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1142,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"260'3","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:16.721849+0000","last_change":"2024-09-12T00:46:22.351593+0000","last_active":"2024-09-12T01:34:16.721849+0000","last_peered":"2024-09-12T01:34:16.721849+0000","last_clean":"2024-09-12T01:34:16.721849+0000","last_became_active":"2024-09-12T00:46:22.351237+0000","last_became_peered":"2024-09-12T00:46:22.351237+0000","last_unstale":"2024-09-12T01:34:16.721849+0000","last_undegraded":"2024-09-12T01:34:16.721849+0000","last_fullsized":"2024-09-12T01:34:16.721849+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:04.853460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'36","reported_seq":159,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.788869+0000","last_change":"2024-09-12T00:42:36.819102+0000","last_active":"2024-09-12T01:34:36.788869+0000","last_peered":"2024-09-12T01:34:36.788869+0000","last_clean":"2024-09-12T01:34:36.788869+0000","last_became_active":"2024-09-12T00:42:36.818852+0000","last_became_peered":"2024-09-12T00:42:36.818852+0000","last_unstale":"2024-09-12T01:34:36.788869+0000","last_undegraded":"2024-09-12T01:34:36.788869+0000","last_fullsized":"2024-09-12T01:34:36.788869+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:23.943088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":132,"num_write":65,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:32.794132+0000","last_change":"2024-09-12T01:04:15.393939+0000","last_active":"2024-09-12T01:35:32.794132+0000","last_peered":"2024-09-12T01:35:32.794132+0000","last_clean":"2024-09-12T01:35:32.794132+0000","last_became_active":"2024-09-12T01:04:15.393651+0000","last_became_peered":"2024-09-12T01:04:15.393651+0000","last_unstale":"2024-09-12T01:35:32.794132+0000","last_undegraded":"2024-09-12T01:35:32.794132+0000","last_fullsized":"2024-09-12T01:35:32.794132+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:16.671263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"263'5","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:26.801703+0000","last_change":"2024-09-12T00:46:26.563573+0000","last_active":"2024-09-12T01:36:26.801703+0000","last_peered":"2024-09-12T01:36:26.801703+0000","last_clean":"2024-09-12T01:36:26.801703+0000","last_became_active":"2024-09-12T00:46:26.563277+0000","last_became_peered":"2024-09-12T00:46:26.563277+0000","last_unstale":"2024-09-12T01:36:26.801703+0000","last_undegraded":"2024-09-12T01:36:26.801703+0000","last_fullsized":"2024-09-12T01:36:26.801703+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:09.897827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":7168,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:31.631288+0000","last_change":"2024-09-12T00:46:22.351630+0000","last_active":"2024-09-12T01:34:31.631288+0000","last_peered":"2024-09-12T01:34:31.631288+0000","last_clean":"2024-09-12T01:34:31.631288+0000","last_became_active":"2024-09-12T00:46:22.351162+0000","last_became_peered":"2024-09-12T00:46:22.351162+0000","last_unstale":"2024-09-12T01:34:31.631288+0000","last_undegraded":"2024-09-12T01:34:31.631288+0000","last_fullsized":"2024-09-12T01:34:31.631288+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:07.137302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"263'20","reported_seq":113,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.539639+0000","last_change":"2024-09-12T00:42:36.815139+0000","last_active":"2024-09-12T01:34:36.539639+0000","last_peered":"2024-09-12T01:34:36.539639+0000","last_clean":"2024-09-12T01:34:36.539639+0000","last_became_active":"2024-09-12T00:42:36.814845+0000","last_became_peered":"2024-09-12T00:42:36.814845+0000","last_unstale":"2024-09-12T01:34:36.539639+0000","last_undegraded":"2024-09-12T01:34:36.539639+0000","last_fullsized":"2024-09-12T01:34:36.539639+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:26.879251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":75,"num_write":35,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:16.936450+0000","last_change":"2024-09-12T01:04:15.388704+0000","last_active":"2024-09-12T01:34:16.936450+0000","last_peered":"2024-09-12T01:34:16.936450+0000","last_clean":"2024-09-12T01:34:16.936450+0000","last_became_active":"2024-09-12T01:04:15.388423+0000","last_became_peered":"2024-09-12T01:04:15.388423+0000","last_unstale":"2024-09-12T01:34:16.936450+0000","last_undegraded":"2024-09-12T01:34:16.936450+0000","last_fullsized":"2024-09-12T01:34:16.936450+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:13.488601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:06.720233+0000","last_change":"2024-09-12T00:46:26.565006+0000","last_active":"2024-09-12T01:34:06.720233+0000","last_peered":"2024-09-12T01:34:06.720233+0000","last_clean":"2024-09-12T01:34:06.720233+0000","last_became_active":"2024-09-12T00:46:26.564771+0000","last_became_peered":"2024-09-12T00:46:26.564771+0000","last_unstale":"2024-09-12T01:34:06.720233+0000","last_undegraded":"2024-09-12T01:34:06.720233+0000","last_fullsized":"2024-09-12T01:34:06.720233+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:24.506289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"260'3","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:57.780660+0000","last_change":"2024-09-12T00:46:22.350365+0000","last_active":"2024-09-12T01:33:57.780660+0000","last_peered":"2024-09-12T01:33:57.780660+0000","last_clean":"2024-09-12T01:33:57.780660+0000","last_became_active":"2024-09-12T00:46:22.350045+0000","last_became_peered":"2024-09-12T00:46:22.350045+0000","last_unstale":"2024-09-12T01:33:57.780660+0000","last_undegraded":"2024-09-12T01:33:57.780660+0000","last_fullsized":"2024-09-12T01:33:57.780660+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:09.828897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"263'41","reported_seq":169,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:56.728429+0000","last_change":"2024-09-12T00:42:36.814530+0000","last_active":"2024-09-12T01:34:56.728429+0000","last_peered":"2024-09-12T01:34:56.728429+0000","last_clean":"2024-09-12T01:34:56.728429+0000","last_became_active":"2024-09-12T00:42:36.814228+0000","last_became_peered":"2024-09-12T00:42:36.814228+0000","last_unstale":"2024-09-12T01:34:56.728429+0000","last_undegraded":"2024-09-12T01:34:56.728429+0000","last_fullsized":"2024-09-12T01:34:56.728429+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:19.454136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":139,"num_write":79,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:31.547532+0000","last_change":"2024-09-12T01:04:15.388771+0000","last_active":"2024-09-12T01:35:31.547532+0000","last_peered":"2024-09-12T01:35:31.547532+0000","last_clean":"2024-09-12T01:35:31.547532+0000","last_became_active":"2024-09-12T01:04:15.388492+0000","last_became_peered":"2024-09-12T01:04:15.388492+0000","last_unstale":"2024-09-12T01:35:31.547532+0000","last_undegraded":"2024-09-12T01:35:31.547532+0000","last_fullsized":"2024-09-12T01:35:31.547532+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:40.040155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:06.535900+0000","last_change":"2024-09-12T00:46:26.369312+0000","last_active":"2024-09-12T01:34:06.535900+0000","last_peered":"2024-09-12T01:34:06.535900+0000","last_clean":"2024-09-12T01:34:06.535900+0000","last_became_active":"2024-09-12T00:46:26.369004+0000","last_became_peered":"2024-09-12T00:46:26.369004+0000","last_unstale":"2024-09-12T01:34:06.535900+0000","last_undegraded":"2024-09-12T01:34:06.535900+0000","last_fullsized":"2024-09-12T01:34:06.535900+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:24.565234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:01.719448+0000","last_change":"2024-09-12T00:46:22.354042+0000","last_active":"2024-09-12T01:34:01.719448+0000","last_peered":"2024-09-12T01:34:01.719448+0000","last_clean":"2024-09-12T01:34:01.719448+0000","last_became_active":"2024-09-12T00:46:22.353747+0000","last_became_peered":"2024-09-12T00:46:22.353747+0000","last_unstale":"2024-09-12T01:34:01.719448+0000","last_undegraded":"2024-09-12T01:34:01.719448+0000","last_fullsized":"2024-09-12T01:34:01.719448+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:40.026238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"263'8","reported_seq":80,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:41.940572+0000","last_change":"2024-09-12T00:42:36.809380+0000","last_active":"2024-09-12T01:34:41.940572+0000","last_peered":"2024-09-12T01:34:41.940572+0000","last_clean":"2024-09-12T01:34:41.940572+0000","last_became_active":"2024-09-12T00:42:36.808945+0000","last_became_peered":"2024-09-12T00:42:36.808945+0000","last_unstale":"2024-09-12T01:34:41.940572+0000","last_undegraded":"2024-09-12T01:34:41.940572+0000","last_fullsized":"2024-09-12T01:34:41.940572+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:08.194856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":23,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"262'1","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.531103+0000","last_change":"2024-09-12T01:04:15.395533+0000","last_active":"2024-09-12T01:34:36.531103+0000","last_peered":"2024-09-12T01:34:36.531103+0000","last_clean":"2024-09-12T01:34:36.531103+0000","last_became_active":"2024-09-12T01:04:15.395223+0000","last_became_peered":"2024-09-12T01:04:15.395223+0000","last_unstale":"2024-09-12T01:34:36.531103+0000","last_undegraded":"2024-09-12T01:34:36.531103+0000","last_fullsized":"2024-09-12T01:34:36.531103+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:54.625901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"260'2","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:21.937069+0000","last_change":"2024-09-12T00:46:26.367308+0000","last_active":"2024-09-12T01:34:21.937069+0000","last_peered":"2024-09-12T01:34:21.937069+0000","last_clean":"2024-09-12T01:34:21.937069+0000","last_became_active":"2024-09-12T00:46:26.367039+0000","last_became_peered":"2024-09-12T00:46:26.367039+0000","last_unstale":"2024-09-12T01:34:21.937069+0000","last_undegraded":"2024-09-12T01:34:21.937069+0000","last_fullsized":"2024-09-12T01:34:21.937069+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:30.091487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"263'2","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:31.742697+0000","last_change":"2024-09-12T00:46:22.350076+0000","last_active":"2024-09-12T01:36:31.742697+0000","last_peered":"2024-09-12T01:36:31.742697+0000","last_clean":"2024-09-12T01:36:31.742697+0000","last_became_active":"2024-09-12T00:46:22.349779+0000","last_became_peered":"2024-09-12T00:46:22.349779+0000","last_unstale":"2024-09-12T01:36:31.742697+0000","last_undegraded":"2024-09-12T01:36:31.742697+0000","last_fullsized":"2024-09-12T01:36:31.742697+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:41.826282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":5,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"263'23","reported_seq":123,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:42.787235+0000","last_change":"2024-09-12T00:42:36.811265+0000","last_active":"2024-09-12T01:34:42.787235+0000","last_peered":"2024-09-12T01:34:42.787235+0000","last_clean":"2024-09-12T01:34:42.787235+0000","last_became_active":"2024-09-12T00:42:36.810979+0000","last_became_peered":"2024-09-12T00:42:36.810979+0000","last_unstale":"2024-09-12T01:34:42.787235+0000","last_undegraded":"2024-09-12T01:34:42.787235+0000","last_fullsized":"2024-09-12T01:34:42.787235+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:56.532046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":82,"num_write":51,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.788829+0000","last_change":"2024-09-12T01:04:15.388624+0000","last_active":"2024-09-12T01:34:36.788829+0000","last_peered":"2024-09-12T01:34:36.788829+0000","last_clean":"2024-09-12T01:34:36.788829+0000","last_became_active":"2024-09-12T01:04:15.388331+0000","last_became_peered":"2024-09-12T01:04:15.388331+0000","last_unstale":"2024-09-12T01:34:36.788829+0000","last_undegraded":"2024-09-12T01:34:36.788829+0000","last_fullsized":"2024-09-12T01:34:36.788829+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:07.975645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"260'5","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:32.785494+0000","last_change":"2024-09-12T00:46:26.370948+0000","last_active":"2024-09-12T01:34:32.785494+0000","last_peered":"2024-09-12T01:34:32.785494+0000","last_clean":"2024-09-12T01:34:32.785494+0000","last_became_active":"2024-09-12T00:46:26.370448+0000","last_became_peered":"2024-09-12T00:46:26.370448+0000","last_unstale":"2024-09-12T01:34:32.785494+0000","last_undegraded":"2024-09-12T01:34:32.785494+0000","last_fullsized":"2024-09-12T01:34:32.785494+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:41.502037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"263'2","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:21.741202+0000","last_change":"2024-09-12T00:46:22.354072+0000","last_active":"2024-09-12T01:36:21.741202+0000","last_peered":"2024-09-12T01:36:21.741202+0000","last_clean":"2024-09-12T01:36:21.741202+0000","last_became_active":"2024-09-12T00:46:22.353796+0000","last_became_peered":"2024-09-12T00:46:22.353796+0000","last_unstale":"2024-09-12T01:36:21.741202+0000","last_undegraded":"2024-09-12T01:36:21.741202+0000","last_fullsized":"2024-09-12T01:36:21.741202+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:52.950825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"263'41","reported_seq":174,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:41.540574+0000","last_change":"2024-09-12T00:42:36.814983+0000","last_active":"2024-09-12T01:34:41.540574+0000","last_peered":"2024-09-12T01:34:41.540574+0000","last_clean":"2024-09-12T01:34:41.540574+0000","last_became_active":"2024-09-12T00:42:36.814700+0000","last_became_peered":"2024-09-12T00:42:36.814700+0000","last_unstale":"2024-09-12T01:34:41.540574+0000","last_undegraded":"2024-09-12T01:34:41.540574+0000","last_fullsized":"2024-09-12T01:34:41.540574+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:47.477989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":150,"num_write":75,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:31.795233+0000","last_change":"2024-09-12T01:04:15.393354+0000","last_active":"2024-09-12T01:35:31.795233+0000","last_peered":"2024-09-12T01:35:31.795233+0000","last_clean":"2024-09-12T01:35:31.795233+0000","last_became_active":"2024-09-12T01:04:15.392129+0000","last_became_peered":"2024-09-12T01:04:15.392129+0000","last_unstale":"2024-09-12T01:35:31.795233+0000","last_undegraded":"2024-09-12T01:35:31.795233+0000","last_fullsized":"2024-09-12T01:35:31.795233+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:07.333078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:21.537643+0000","last_change":"2024-09-12T00:46:26.374929+0000","last_active":"2024-09-12T01:34:21.537643+0000","last_peered":"2024-09-12T01:34:21.537643+0000","last_clean":"2024-09-12T01:34:21.537643+0000","last_became_active":"2024-09-12T00:46:26.374630+0000","last_became_peered":"2024-09-12T00:46:26.374630+0000","last_unstale":"2024-09-12T01:34:21.537643+0000","last_undegraded":"2024-09-12T01:34:21.537643+0000","last_fullsized":"2024-09-12T01:34:21.537643+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:40.273744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:16.936526+0000","last_change":"2024-09-12T00:46:22.345808+0000","last_active":"2024-09-12T01:34:16.936526+0000","last_peered":"2024-09-12T01:34:16.936526+0000","last_clean":"2024-09-12T01:34:16.936526+0000","last_became_active":"2024-09-12T00:46:22.345455+0000","last_became_peered":"2024-09-12T00:46:22.345455+0000","last_unstale":"2024-09-12T01:34:16.936526+0000","last_undegraded":"2024-09-12T01:34:16.936526+0000","last_fullsized":"2024-09-12T01:34:16.936526+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:43.503840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"263'47","reported_seq":185,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:41.540334+0000","last_change":"2024-09-12T00:42:36.810603+0000","last_active":"2024-09-12T01:34:41.540334+0000","last_peered":"2024-09-12T01:34:41.540334+0000","last_clean":"2024-09-12T01:34:41.540334+0000","last_became_active":"2024-09-12T00:42:36.810179+0000","last_became_peered":"2024-09-12T00:42:36.810179+0000","last_unstale":"2024-09-12T01:34:41.540334+0000","last_undegraded":"2024-09-12T01:34:41.540334+0000","last_fullsized":"2024-09-12T01:34:41.540334+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:20.658302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":235,"num_read_kb":167,"num_write":78,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:41.735210+0000","last_change":"2024-09-12T01:04:15.393713+0000","last_active":"2024-09-12T01:35:41.735210+0000","last_peered":"2024-09-12T01:35:41.735210+0000","last_clean":"2024-09-12T01:35:41.735210+0000","last_became_active":"2024-09-12T01:04:15.393424+0000","last_became_peered":"2024-09-12T01:04:15.393424+0000","last_unstale":"2024-09-12T01:35:41.735210+0000","last_undegraded":"2024-09-12T01:35:41.735210+0000","last_fullsized":"2024-09-12T01:35:41.735210+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:46.950196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"260'6","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:21.537798+0000","last_change":"2024-09-12T00:46:26.372459+0000","last_active":"2024-09-12T01:34:21.537798+0000","last_peered":"2024-09-12T01:34:21.537798+0000","last_clean":"2024-09-12T01:34:21.537798+0000","last_became_active":"2024-09-12T00:46:26.372169+0000","last_became_peered":"2024-09-12T00:46:26.372169+0000","last_unstale":"2024-09-12T01:34:21.537798+0000","last_undegraded":"2024-09-12T01:34:21.537798+0000","last_fullsized":"2024-09-12T01:34:21.537798+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:20.872522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"263'5","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:21.555122+0000","last_change":"2024-09-12T00:46:22.350497+0000","last_active":"2024-09-12T01:36:21.555122+0000","last_peered":"2024-09-12T01:36:21.555122+0000","last_clean":"2024-09-12T01:36:21.555122+0000","last_became_active":"2024-09-12T00:46:22.350210+0000","last_became_peered":"2024-09-12T00:46:22.350210+0000","last_unstale":"2024-09-12T01:36:21.555122+0000","last_undegraded":"2024-09-12T01:36:21.555122+0000","last_fullsized":"2024-09-12T01:36:21.555122+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:30.513705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4096,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"260'15","reported_seq":102,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:51.727537+0000","last_change":"2024-09-12T00:42:36.810443+0000","last_active":"2024-09-12T01:34:51.727537+0000","last_peered":"2024-09-12T01:34:51.727537+0000","last_clean":"2024-09-12T01:34:51.727537+0000","last_became_active":"2024-09-12T00:42:36.810110+0000","last_became_peered":"2024-09-12T00:42:36.810110+0000","last_unstale":"2024-09-12T01:34:51.727537+0000","last_undegraded":"2024-09-12T01:34:51.727537+0000","last_fullsized":"2024-09-12T01:34:51.727537+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:11.301801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":54,"num_write":27,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"263'299","reported_seq":908,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.757147+0000","last_change":"2024-09-12T00:28:31.203847+0000","last_active":"2024-09-12T01:38:01.757147+0000","last_peered":"2024-09-12T01:38:01.757147+0000","last_clean":"2024-09-12T01:38:01.757147+0000","last_became_active":"2024-09-12T00:28:31.201886+0000","last_became_peered":"2024-09-12T00:28:31.201886+0000","last_unstale":"2024-09-12T01:38:01.757147+0000","last_undegraded":"2024-09-12T01:38:01.757147+0000","last_fullsized":"2024-09-12T01:38:01.757147+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:39.441025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":380,"num_read_kb":9626,"num_write":915,"num_write_kb":19266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"263'157","reported_seq":722,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:32.776738+0000","last_change":"2024-09-12T00:28:33.211480+0000","last_active":"2024-09-12T01:33:32.776738+0000","last_peered":"2024-09-12T01:33:32.776738+0000","last_clean":"2024-09-12T01:33:32.776738+0000","last_became_active":"2024-09-12T00:28:33.211182+0000","last_became_peered":"2024-09-12T00:28:33.211182+0000","last_unstale":"2024-09-12T01:33:32.776738+0000","last_undegraded":"2024-09-12T01:33:32.776738+0000","last_fullsized":"2024-09-12T01:33:32.776738+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:45.597820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":685,"num_read_kb":553,"num_write":251,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"263'296","reported_seq":1006,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.770532+0000","last_change":"2024-09-12T00:28:31.204861+0000","last_active":"2024-09-12T01:38:01.770532+0000","last_peered":"2024-09-12T01:38:01.770532+0000","last_clean":"2024-09-12T01:38:01.770532+0000","last_became_active":"2024-09-12T00:28:31.204561+0000","last_became_peered":"2024-09-12T00:28:31.204561+0000","last_unstale":"2024-09-12T01:38:01.770532+0000","last_undegraded":"2024-09-12T01:38:01.770532+0000","last_fullsized":"2024-09-12T01:38:01.770532+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:08.162064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243127,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":598,"num_read_kb":14276,"num_write":1032,"num_write_kb":31679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"263'59","reported_seq":619,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:36.715209+0000","last_change":"2024-09-12T00:28:33.217339+0000","last_active":"2024-09-12T01:33:36.715209+0000","last_peered":"2024-09-12T01:33:36.715209+0000","last_clean":"2024-09-12T01:33:36.715209+0000","last_became_active":"2024-09-12T00:28:33.217028+0000","last_became_peered":"2024-09-12T00:28:33.217028+0000","last_unstale":"2024-09-12T01:33:36.715209+0000","last_undegraded":"2024-09-12T01:33:36.715209+0000","last_fullsized":"2024-09-12T01:33:36.715209+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:39:58.330668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":252,"num_read_kb":216,"num_write":87,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"263'332","reported_seq":1191,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.751929+0000","last_change":"2024-09-12T00:28:31.203640+0000","last_active":"2024-09-12T01:38:01.751929+0000","last_peered":"2024-09-12T01:38:01.751929+0000","last_clean":"2024-09-12T01:38:01.751929+0000","last_became_active":"2024-09-12T00:28:31.203351+0000","last_became_peered":"2024-09-12T00:28:31.203351+0000","last_unstale":"2024-09-12T01:38:01.751929+0000","last_undegraded":"2024-09-12T01:38:01.751929+0000","last_fullsized":"2024-09-12T01:38:01.751929+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:37.607022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306757,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":934,"num_read_kb":42793,"num_write":1132,"num_write_kb":18824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"263'429","reported_seq":1173,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:36.531564+0000","last_change":"2024-09-12T00:28:33.217739+0000","last_active":"2024-09-12T01:33:36.531564+0000","last_peered":"2024-09-12T01:33:36.531564+0000","last_clean":"2024-09-12T01:33:36.531564+0000","last_became_active":"2024-09-12T00:28:33.217215+0000","last_became_peered":"2024-09-12T00:28:33.217215+0000","last_unstale":"2024-09-12T01:33:36.531564+0000","last_undegraded":"2024-09-12T01:33:36.531564+0000","last_fullsized":"2024-09-12T01:33:36.531564+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":400,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:28.536144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2092,"num_read_kb":1758,"num_write":778,"num_write_kb":522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"263'376","reported_seq":1068,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.766499+0000","last_change":"2024-09-12T00:28:31.214517+0000","last_active":"2024-09-12T01:38:01.766499+0000","last_peered":"2024-09-12T01:38:01.766499+0000","last_clean":"2024-09-12T01:38:01.766499+0000","last_became_active":"2024-09-12T00:28:31.213595+0000","last_became_peered":"2024-09-12T00:28:31.213595+0000","last_unstale":"2024-09-12T01:38:01.766499+0000","last_undegraded":"2024-09-12T01:38:01.766499+0000","last_fullsized":"2024-09-12T01:38:01.766499+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:36.346586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1440418,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":629,"num_read_kb":11143,"num_write":1163,"num_write_kb":15238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"263'289","reported_seq":921,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:49.421430+0000","last_change":"2024-09-12T00:28:33.218650+0000","last_active":"2024-09-12T01:33:49.421430+0000","last_peered":"2024-09-12T01:33:49.421430+0000","last_clean":"2024-09-12T01:33:49.421430+0000","last_became_active":"2024-09-12T00:28:33.218393+0000","last_became_peered":"2024-09-12T00:28:33.218393+0000","last_unstale":"2024-09-12T01:33:49.421430+0000","last_undegraded":"2024-09-12T01:33:49.421430+0000","last_fullsized":"2024-09-12T01:33:49.421430+0000","mapping_epoch":27,"log_start":"260'200","ondisk_log_start":"260'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:52.716266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1288,"num_read_kb":1088,"num_write":481,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"263'316","reported_seq":910,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.746803+0000","last_change":"2024-09-12T00:28:31.205251+0000","last_active":"2024-09-12T01:38:01.746803+0000","last_peered":"2024-09-12T01:38:01.746803+0000","last_clean":"2024-09-12T01:38:01.746803+0000","last_became_active":"2024-09-12T00:28:31.204962+0000","last_became_peered":"2024-09-12T00:28:31.204962+0000","last_unstale":"2024-09-12T01:38:01.746803+0000","last_undegraded":"2024-09-12T01:38:01.746803+0000","last_fullsized":"2024-09-12T01:38:01.746803+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:35.543975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170194,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":404,"num_read_kb":1209,"num_write":989,"num_write_kb":17836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"263'4176","reported_seq":4796,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:51.541648+0000","last_change":"2024-09-12T00:28:33.214790+0000","last_active":"2024-09-12T01:34:51.541648+0000","last_peered":"2024-09-12T01:34:51.541648+0000","last_clean":"2024-09-12T01:34:51.541648+0000","last_became_active":"2024-09-12T00:28:33.214515+0000","last_became_peered":"2024-09-12T00:28:33.214515+0000","last_unstale":"2024-09-12T01:34:51.541648+0000","last_undegraded":"2024-09-12T01:34:51.541648+0000","last_fullsized":"2024-09-12T01:34:51.541648+0000","mapping_epoch":27,"log_start":"263'4100","ondisk_log_start":"263'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":3000,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:53.747881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16813,"num_read_kb":14096,"num_write":6273,"num_write_kb":3125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"263'398","reported_seq":1045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.752061+0000","last_change":"2024-09-12T00:28:31.214068+0000","last_active":"2024-09-12T01:38:01.752061+0000","last_peered":"2024-09-12T01:38:01.752061+0000","last_clean":"2024-09-12T01:38:01.752061+0000","last_became_active":"2024-09-12T00:28:31.212573+0000","last_became_peered":"2024-09-12T00:28:31.212573+0000","last_unstale":"2024-09-12T01:38:01.752061+0000","last_undegraded":"2024-09-12T01:38:01.752061+0000","last_fullsized":"2024-09-12T01:38:01.752061+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:07.432079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568635,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":601,"num_read_kb":12450,"num_write":1255,"num_write_kb":24719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"263'260","reported_seq":970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.545564+0000","last_change":"2024-09-12T00:28:33.213811+0000","last_active":"2024-09-12T01:35:16.545564+0000","last_peered":"2024-09-12T01:35:16.545564+0000","last_clean":"2024-09-12T01:35:16.545564+0000","last_became_active":"2024-09-12T00:28:33.213014+0000","last_became_peered":"2024-09-12T00:28:33.213014+0000","last_unstale":"2024-09-12T01:35:16.545564+0000","last_undegraded":"2024-09-12T01:35:16.545564+0000","last_fullsized":"2024-09-12T01:35:16.545564+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:25.774640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1431,"num_read_kb":1278,"num_write":426,"num_write_kb":225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"263'318","reported_seq":953,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.757819+0000","last_change":"2024-09-12T00:28:31.210405+0000","last_active":"2024-09-12T01:38:01.757819+0000","last_peered":"2024-09-12T01:38:01.757819+0000","last_clean":"2024-09-12T01:38:01.757819+0000","last_became_active":"2024-09-12T00:28:31.210039+0000","last_became_peered":"2024-09-12T00:28:31.210039+0000","last_unstale":"2024-09-12T01:38:01.757819+0000","last_undegraded":"2024-09-12T01:38:01.757819+0000","last_fullsized":"2024-09-12T01:38:01.757819+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:33.172818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262189,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":473,"num_read_kb":7448,"num_write":1018,"num_write_kb":42696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"263'277","reported_seq":963,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:17.791987+0000","last_change":"2024-09-12T00:28:33.217908+0000","last_active":"2024-09-12T01:35:17.791987+0000","last_peered":"2024-09-12T01:35:17.791987+0000","last_clean":"2024-09-12T01:35:17.791987+0000","last_became_active":"2024-09-12T00:28:33.216856+0000","last_became_peered":"2024-09-12T00:28:33.216856+0000","last_unstale":"2024-09-12T01:35:17.791987+0000","last_undegraded":"2024-09-12T01:35:17.791987+0000","last_fullsized":"2024-09-12T01:35:17.791987+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:14.540790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1252,"num_read_kb":1029,"num_write":416,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"263'318","reported_seq":929,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.760412+0000","last_change":"2024-09-12T00:28:31.213450+0000","last_active":"2024-09-12T01:38:01.760412+0000","last_peered":"2024-09-12T01:38:01.760412+0000","last_clean":"2024-09-12T01:38:01.760412+0000","last_became_active":"2024-09-12T00:28:31.213172+0000","last_became_peered":"2024-09-12T00:28:31.213172+0000","last_unstale":"2024-09-12T01:38:01.760412+0000","last_undegraded":"2024-09-12T01:38:01.760412+0000","last_fullsized":"2024-09-12T01:38:01.760412+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:29.256307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1657979,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":448,"num_read_kb":13792,"num_write":975,"num_write_kb":26598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"263'108","reported_seq":718,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.535539+0000","last_change":"2024-09-12T00:28:33.206578+0000","last_active":"2024-09-12T01:35:16.535539+0000","last_peered":"2024-09-12T01:35:16.535539+0000","last_clean":"2024-09-12T01:35:16.535539+0000","last_became_active":"2024-09-12T00:28:33.206296+0000","last_became_peered":"2024-09-12T00:28:33.206296+0000","last_unstale":"2024-09-12T01:35:16.535539+0000","last_undegraded":"2024-09-12T01:35:16.535539+0000","last_fullsized":"2024-09-12T01:35:16.535539+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:53.527780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":463,"num_read_kb":402,"num_write":161,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"263'4150","reported_seq":4755,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.534336+0000","last_change":"2024-09-12T00:28:33.214093+0000","last_active":"2024-09-12T01:33:56.534336+0000","last_peered":"2024-09-12T01:33:56.534336+0000","last_clean":"2024-09-12T01:33:56.534336+0000","last_became_active":"2024-09-12T00:28:33.213777+0000","last_became_peered":"2024-09-12T00:28:33.213777+0000","last_unstale":"2024-09-12T01:33:56.534336+0000","last_undegraded":"2024-09-12T01:33:56.534336+0000","last_fullsized":"2024-09-12T01:33:56.534336+0000","mapping_epoch":27,"log_start":"263'4100","ondisk_log_start":"263'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":3000,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:34.960052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16687,"num_read_kb":13992,"num_write":6250,"num_write_kb":3125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"263'383","reported_seq":1011,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.775483+0000","last_change":"2024-09-12T00:29:04.274666+0000","last_active":"2024-09-12T01:38:01.775483+0000","last_peered":"2024-09-12T01:38:01.775483+0000","last_clean":"2024-09-12T01:38:01.775483+0000","last_became_active":"2024-09-12T00:29:04.274377+0000","last_became_peered":"2024-09-12T00:29:04.274377+0000","last_unstale":"2024-09-12T01:38:01.775483+0000","last_undegraded":"2024-09-12T01:38:01.775483+0000","last_fullsized":"2024-09-12T01:38:01.775483+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:54.628791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568865,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":569,"num_read_kb":2856,"num_write":1189,"num_write_kb":27657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"263'295","reported_seq":935,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:08.059213+0000","last_change":"2024-09-12T00:28:33.218880+0000","last_active":"2024-09-12T01:35:08.059213+0000","last_peered":"2024-09-12T01:35:08.059213+0000","last_clean":"2024-09-12T01:35:08.059213+0000","last_became_active":"2024-09-12T00:28:33.218660+0000","last_became_peered":"2024-09-12T00:28:33.218660+0000","last_unstale":"2024-09-12T01:35:08.059213+0000","last_undegraded":"2024-09-12T01:35:08.059213+0000","last_fullsized":"2024-09-12T01:35:08.059213+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:31.583663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1306,"num_read_kb":1072,"num_write":479,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"263'364","reported_seq":1027,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.725025+0000","last_change":"2024-09-12T00:28:31.213720+0000","last_active":"2024-09-12T01:38:01.725025+0000","last_peered":"2024-09-12T01:38:01.725025+0000","last_clean":"2024-09-12T01:38:01.725025+0000","last_became_active":"2024-09-12T00:28:31.213388+0000","last_became_peered":"2024-09-12T00:28:31.213388+0000","last_unstale":"2024-09-12T01:38:01.725025+0000","last_undegraded":"2024-09-12T01:38:01.725025+0000","last_fullsized":"2024-09-12T01:38:01.725025+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:39.340566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133695,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":588,"num_read_kb":20058,"num_write":1150,"num_write_kb":40619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"263'90","reported_seq":673,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:52.081197+0000","last_change":"2024-09-12T00:28:33.214308+0000","last_active":"2024-09-12T01:35:52.081197+0000","last_peered":"2024-09-12T01:35:52.081197+0000","last_clean":"2024-09-12T01:35:52.081197+0000","last_became_active":"2024-09-12T00:28:33.213998+0000","last_became_peered":"2024-09-12T00:28:33.213998+0000","last_unstale":"2024-09-12T01:35:52.081197+0000","last_undegraded":"2024-09-12T01:35:52.081197+0000","last_fullsized":"2024-09-12T01:35:52.081197+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:58.148121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":414,"num_read_kb":350,"num_write":126,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"263'349","reported_seq":1061,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.736889+0000","last_change":"2024-09-12T00:28:31.215536+0000","last_active":"2024-09-12T01:38:01.736889+0000","last_peered":"2024-09-12T01:38:01.736889+0000","last_clean":"2024-09-12T01:38:01.736889+0000","last_became_active":"2024-09-12T00:28:31.215230+0000","last_became_peered":"2024-09-12T00:28:31.215230+0000","last_unstale":"2024-09-12T01:38:01.736889+0000","last_undegraded":"2024-09-12T01:38:01.736889+0000","last_fullsized":"2024-09-12T01:38:01.736889+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:13.446276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254836,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":624,"num_read_kb":115792,"num_write":1091,"num_write_kb":22723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"263'230","reported_seq":852,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:56.125911+0000","last_change":"2024-09-12T00:28:33.206843+0000","last_active":"2024-09-12T01:35:56.125911+0000","last_peered":"2024-09-12T01:35:56.125911+0000","last_clean":"2024-09-12T01:35:56.125911+0000","last_became_active":"2024-09-12T00:28:33.206305+0000","last_became_peered":"2024-09-12T00:28:33.206305+0000","last_unstale":"2024-09-12T01:35:56.125911+0000","last_undegraded":"2024-09-12T01:35:56.125911+0000","last_fullsized":"2024-09-12T01:35:56.125911+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:47.700041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":971,"num_read_kb":790,"num_write":344,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"263'413","reported_seq":1142,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.747063+0000","last_change":"2024-09-12T00:28:31.200080+0000","last_active":"2024-09-12T01:38:01.747063+0000","last_peered":"2024-09-12T01:38:01.747063+0000","last_clean":"2024-09-12T01:38:01.747063+0000","last_became_active":"2024-09-12T00:28:31.199779+0000","last_became_peered":"2024-09-12T00:28:31.199779+0000","last_unstale":"2024-09-12T01:38:01.747063+0000","last_undegraded":"2024-09-12T01:38:01.747063+0000","last_fullsized":"2024-09-12T01:38:01.747063+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:30.398312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306267,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":669,"num_read_kb":69035,"num_write":1318,"num_write_kb":57878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"263'150","reported_seq":800,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:17.328724+0000","last_change":"2024-09-12T00:28:33.209112+0000","last_active":"2024-09-12T01:35:17.328724+0000","last_peered":"2024-09-12T01:35:17.328724+0000","last_clean":"2024-09-12T01:35:17.328724+0000","last_became_active":"2024-09-12T00:28:33.208831+0000","last_became_peered":"2024-09-12T00:28:33.208831+0000","last_unstale":"2024-09-12T01:35:17.328724+0000","last_undegraded":"2024-09-12T01:35:17.328724+0000","last_fullsized":"2024-09-12T01:35:17.328724+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:49.062557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":710,"num_read_kb":600,"num_write":211,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"263'397","reported_seq":1043,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.775241+0000","last_change":"2024-09-12T00:28:31.202543+0000","last_active":"2024-09-12T01:38:01.775241+0000","last_peered":"2024-09-12T01:38:01.775241+0000","last_clean":"2024-09-12T01:38:01.775241+0000","last_became_active":"2024-09-12T00:28:31.202245+0000","last_became_peered":"2024-09-12T00:28:31.202245+0000","last_unstale":"2024-09-12T01:38:01.775241+0000","last_undegraded":"2024-09-12T01:38:01.775241+0000","last_fullsized":"2024-09-12T01:38:01.775241+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:12.536550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":558,"num_read_kb":23094,"num_write":1344,"num_write_kb":58944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"263'113","reported_seq":719,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.533718+0000","last_change":"2024-09-12T00:28:33.207817+0000","last_active":"2024-09-12T01:33:51.533718+0000","last_peered":"2024-09-12T01:33:51.533718+0000","last_clean":"2024-09-12T01:33:51.533718+0000","last_became_active":"2024-09-12T00:28:33.207527+0000","last_became_peered":"2024-09-12T00:28:33.207527+0000","last_unstale":"2024-09-12T01:33:51.533718+0000","last_undegraded":"2024-09-12T01:33:51.533718+0000","last_fullsized":"2024-09-12T01:33:51.533718+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:31.972357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":515,"num_read_kb":438,"num_write":174,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"263'311","reported_seq":970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.719296+0000","last_change":"2024-09-12T00:28:31.204106+0000","last_active":"2024-09-12T01:38:01.719296+0000","last_peered":"2024-09-12T01:38:01.719296+0000","last_clean":"2024-09-12T01:38:01.719296+0000","last_became_active":"2024-09-12T00:28:31.203048+0000","last_became_peered":"2024-09-12T00:28:31.203048+0000","last_unstale":"2024-09-12T01:38:01.719296+0000","last_undegraded":"2024-09-12T01:38:01.719296+0000","last_fullsized":"2024-09-12T01:38:01.719296+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:57.305025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524344,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":495,"num_read_kb":45596,"num_write":1045,"num_write_kb":35489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"263'106","reported_seq":617,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:42.693662+0000","last_change":"2024-09-12T00:28:41.227253+0000","last_active":"2024-09-12T01:36:42.693662+0000","last_peered":"2024-09-12T01:36:42.693662+0000","last_clean":"2024-09-12T01:36:42.693662+0000","last_became_active":"2024-09-12T00:28:41.226952+0000","last_became_peered":"2024-09-12T00:28:41.226952+0000","last_unstale":"2024-09-12T01:36:42.693662+0000","last_undegraded":"2024-09-12T01:36:42.693662+0000","last_fullsized":"2024-09-12T01:36:42.693662+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:26.588660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":155,"num_read_kb":144,"num_write":259,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"263'188","reported_seq":772,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:09.639537+0000","last_change":"2024-09-12T00:28:33.209848+0000","last_active":"2024-09-12T01:34:09.639537+0000","last_peered":"2024-09-12T01:34:09.639537+0000","last_clean":"2024-09-12T01:34:09.639537+0000","last_became_active":"2024-09-12T00:28:33.209521+0000","last_became_peered":"2024-09-12T00:28:33.209521+0000","last_unstale":"2024-09-12T01:34:09.639537+0000","last_undegraded":"2024-09-12T01:34:09.639537+0000","last_fullsized":"2024-09-12T01:34:09.639537+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:21.840301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":834,"num_read_kb":672,"num_write":307,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"263'353","reported_seq":957,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.698618+0000","last_change":"2024-09-12T00:28:31.206298+0000","last_active":"2024-09-12T01:38:01.698618+0000","last_peered":"2024-09-12T01:38:01.698618+0000","last_clean":"2024-09-12T01:38:01.698618+0000","last_became_active":"2024-09-12T00:28:31.206010+0000","last_became_peered":"2024-09-12T00:28:31.206010+0000","last_unstale":"2024-09-12T01:38:01.698618+0000","last_undegraded":"2024-09-12T01:38:01.698618+0000","last_fullsized":"2024-09-12T01:38:01.698618+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:59.671503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":430,"num_read_kb":5592,"num_write":1103,"num_write_kb":25256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:47.779150+0000","last_change":"2024-09-12T00:28:35.212219+0000","last_active":"2024-09-12T01:33:47.779150+0000","last_peered":"2024-09-12T01:33:47.779150+0000","last_clean":"2024-09-12T01:33:47.779150+0000","last_became_active":"2024-09-12T00:28:35.211231+0000","last_became_peered":"2024-09-12T00:28:35.211231+0000","last_unstale":"2024-09-12T01:33:47.779150+0000","last_undegraded":"2024-09-12T01:33:47.779150+0000","last_fullsized":"2024-09-12T01:33:47.779150+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:10.530098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"263'348","reported_seq":970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.628118+0000","last_change":"2024-09-12T00:28:37.216446+0000","last_active":"2024-09-12T01:38:01.628118+0000","last_peered":"2024-09-12T01:38:01.628118+0000","last_clean":"2024-09-12T01:38:01.628118+0000","last_became_active":"2024-09-12T00:28:37.216169+0000","last_became_peered":"2024-09-12T00:28:37.216169+0000","last_unstale":"2024-09-12T01:38:01.628118+0000","last_undegraded":"2024-09-12T01:38:01.628118+0000","last_fullsized":"2024-09-12T01:38:01.628118+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:12.966316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44362,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":554,"num_read_kb":1122,"num_write":430,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.718741+0000","last_change":"2024-09-12T00:28:39.214249+0000","last_active":"2024-09-12T01:33:56.718741+0000","last_peered":"2024-09-12T01:33:56.718741+0000","last_clean":"2024-09-12T01:33:56.718741+0000","last_became_active":"2024-09-12T00:28:39.213942+0000","last_became_peered":"2024-09-12T00:28:39.213942+0000","last_unstale":"2024-09-12T01:33:56.718741+0000","last_undegraded":"2024-09-12T01:33:56.718741+0000","last_fullsized":"2024-09-12T01:33:56.718741+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:13.977918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"263'182","reported_seq":733,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:39.518790+0000","last_change":"2024-09-12T00:28:41.229922+0000","last_active":"2024-09-12T01:36:39.518790+0000","last_peered":"2024-09-12T01:36:39.518790+0000","last_clean":"2024-09-12T01:36:39.518790+0000","last_became_active":"2024-09-12T00:28:41.229608+0000","last_became_peered":"2024-09-12T00:28:41.229608+0000","last_unstale":"2024-09-12T01:36:39.518790+0000","last_undegraded":"2024-09-12T01:36:39.518790+0000","last_fullsized":"2024-09-12T01:36:39.518790+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:00.176000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":231,"num_read_kb":225,"num_write":383,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"263'212","reported_seq":813,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:47.779133+0000","last_change":"2024-09-12T00:28:33.212615+0000","last_active":"2024-09-12T01:33:47.779133+0000","last_peered":"2024-09-12T01:33:47.779133+0000","last_clean":"2024-09-12T01:33:47.779133+0000","last_became_active":"2024-09-12T00:28:33.212334+0000","last_became_peered":"2024-09-12T00:28:33.212334+0000","last_unstale":"2024-09-12T01:33:47.779133+0000","last_undegraded":"2024-09-12T01:33:47.779133+0000","last_fullsized":"2024-09-12T01:33:47.779133+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:46.854089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":883,"num_read_kb":721,"num_write":311,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"263'324","reported_seq":981,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.758063+0000","last_change":"2024-09-12T00:28:31.208474+0000","last_active":"2024-09-12T01:38:01.758063+0000","last_peered":"2024-09-12T01:38:01.758063+0000","last_clean":"2024-09-12T01:38:01.758063+0000","last_became_active":"2024-09-12T00:28:31.208141+0000","last_became_peered":"2024-09-12T00:28:31.208141+0000","last_unstale":"2024-09-12T01:38:01.758063+0000","last_undegraded":"2024-09-12T01:38:01.758063+0000","last_fullsized":"2024-09-12T01:38:01.758063+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:28:51.190004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395868,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":543,"num_read_kb":93032,"num_write":945,"num_write_kb":55506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:09.639557+0000","last_change":"2024-09-12T00:28:35.213065+0000","last_active":"2024-09-12T01:34:09.639557+0000","last_peered":"2024-09-12T01:34:09.639557+0000","last_clean":"2024-09-12T01:34:09.639557+0000","last_became_active":"2024-09-12T00:28:35.212745+0000","last_became_peered":"2024-09-12T00:28:35.212745+0000","last_unstale":"2024-09-12T01:34:09.639557+0000","last_undegraded":"2024-09-12T01:34:09.639557+0000","last_fullsized":"2024-09-12T01:34:09.639557+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:29.695288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"263'92","reported_seq":630,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:16.554571+0000","last_change":"2024-09-12T00:28:37.221408+0000","last_active":"2024-09-12T01:36:16.554571+0000","last_peered":"2024-09-12T01:36:16.554571+0000","last_clean":"2024-09-12T01:36:16.554571+0000","last_became_active":"2024-09-12T00:28:37.220899+0000","last_became_peered":"2024-09-12T00:28:37.220899+0000","last_unstale":"2024-09-12T01:36:16.554571+0000","last_undegraded":"2024-09-12T01:36:16.554571+0000","last_fullsized":"2024-09-12T01:36:16.554571+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:45.174607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":118,"num_read_kb":113,"num_write":78,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.534538+0000","last_change":"2024-09-12T00:28:39.222836+0000","last_active":"2024-09-12T01:33:56.534538+0000","last_peered":"2024-09-12T01:33:56.534538+0000","last_clean":"2024-09-12T01:33:56.534538+0000","last_became_active":"2024-09-12T00:28:39.222553+0000","last_became_peered":"2024-09-12T00:28:39.222553+0000","last_unstale":"2024-09-12T01:33:56.534538+0000","last_undegraded":"2024-09-12T01:33:56.534538+0000","last_fullsized":"2024-09-12T01:33:56.534538+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:57.986714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"263'126","reported_seq":631,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:42.376957+0000","last_change":"2024-09-12T00:28:41.228569+0000","last_active":"2024-09-12T01:36:42.376957+0000","last_peered":"2024-09-12T01:36:42.376957+0000","last_clean":"2024-09-12T01:36:42.376957+0000","last_became_active":"2024-09-12T00:28:41.228305+0000","last_became_peered":"2024-09-12T00:28:41.228305+0000","last_unstale":"2024-09-12T01:36:42.376957+0000","last_undegraded":"2024-09-12T01:36:42.376957+0000","last_fullsized":"2024-09-12T01:36:42.376957+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:24.274319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":144,"num_read_kb":135,"num_write":299,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"263'197","reported_seq":842,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.783202+0000","last_change":"2024-09-12T00:28:33.219367+0000","last_active":"2024-09-12T01:33:51.783202+0000","last_peered":"2024-09-12T01:33:51.783202+0000","last_clean":"2024-09-12T01:33:51.783202+0000","last_became_active":"2024-09-12T00:28:33.219082+0000","last_became_peered":"2024-09-12T00:28:33.219082+0000","last_unstale":"2024-09-12T01:33:51.783202+0000","last_undegraded":"2024-09-12T01:33:51.783202+0000","last_fullsized":"2024-09-12T01:33:51.783202+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:01.014245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":923,"num_read_kb":768,"num_write":333,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"263'376","reported_seq":1003,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.753703+0000","last_change":"2024-09-12T00:28:31.204550+0000","last_active":"2024-09-12T01:38:01.753703+0000","last_peered":"2024-09-12T01:38:01.753703+0000","last_clean":"2024-09-12T01:38:01.753703+0000","last_became_active":"2024-09-12T00:28:31.204223+0000","last_became_peered":"2024-09-12T00:28:31.204223+0000","last_unstale":"2024-09-12T01:38:01.753703+0000","last_undegraded":"2024-09-12T01:38:01.753703+0000","last_fullsized":"2024-09-12T01:38:01.753703+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:52.918860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133695,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":536,"num_read_kb":1739,"num_write":1185,"num_write_kb":22527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:49.637009+0000","last_change":"2024-09-12T00:28:35.212684+0000","last_active":"2024-09-12T01:33:49.637009+0000","last_peered":"2024-09-12T01:33:49.637009+0000","last_clean":"2024-09-12T01:33:49.637009+0000","last_became_active":"2024-09-12T00:28:35.212197+0000","last_became_peered":"2024-09-12T00:28:35.212197+0000","last_unstale":"2024-09-12T01:33:49.637009+0000","last_undegraded":"2024-09-12T01:33:49.637009+0000","last_fullsized":"2024-09-12T01:33:49.637009+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:02.479666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"263'133","reported_seq":693,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:11.629177+0000","last_change":"2024-09-12T00:28:37.221078+0000","last_active":"2024-09-12T01:34:11.629177+0000","last_peered":"2024-09-12T01:34:11.629177+0000","last_clean":"2024-09-12T01:34:11.629177+0000","last_became_active":"2024-09-12T00:28:37.220665+0000","last_became_peered":"2024-09-12T00:28:37.220665+0000","last_unstale":"2024-09-12T01:34:11.629177+0000","last_undegraded":"2024-09-12T01:34:11.629177+0000","last_fullsized":"2024-09-12T01:34:11.629177+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:48.810725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":170,"num_read_kb":162,"num_write":114,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"263'768","reported_seq":4807,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.290625+0000","last_change":"2024-09-12T00:28:39.218836+0000","last_active":"2024-09-12T01:38:01.290625+0000","last_peered":"2024-09-12T01:38:01.290625+0000","last_clean":"2024-09-12T01:38:01.290625+0000","last_became_active":"2024-09-12T00:28:39.218476+0000","last_became_peered":"2024-09-12T00:28:39.218476+0000","last_unstale":"2024-09-12T01:38:01.290625+0000","last_undegraded":"2024-09-12T01:38:01.290625+0000","last_fullsized":"2024-09-12T01:38:01.290625+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:48.644746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"263'191","reported_seq":1014,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:41.653002+0000","last_change":"2024-09-12T00:28:41.257967+0000","last_active":"2024-09-12T01:36:41.653002+0000","last_peered":"2024-09-12T01:36:41.653002+0000","last_clean":"2024-09-12T01:36:41.653002+0000","last_became_active":"2024-09-12T00:28:41.257679+0000","last_became_peered":"2024-09-12T00:28:41.257679+0000","last_unstale":"2024-09-12T01:36:41.653002+0000","last_undegraded":"2024-09-12T01:36:41.653002+0000","last_fullsized":"2024-09-12T01:36:41.653002+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:03.811468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":583,"num_read_kb":580,"num_write":423,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"263'82","reported_seq":627,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:49.636986+0000","last_change":"2024-09-12T00:28:33.212834+0000","last_active":"2024-09-12T01:33:49.636986+0000","last_peered":"2024-09-12T01:33:49.636986+0000","last_clean":"2024-09-12T01:33:49.636986+0000","last_became_active":"2024-09-12T00:28:33.212564+0000","last_became_peered":"2024-09-12T00:28:33.212564+0000","last_unstale":"2024-09-12T01:33:49.636986+0000","last_undegraded":"2024-09-12T01:33:49.636986+0000","last_fullsized":"2024-09-12T01:33:49.636986+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:09.246468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":372,"num_read_kb":309,"num_write":130,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"263'298","reported_seq":1000,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.712788+0000","last_change":"2024-09-12T00:28:31.208261+0000","last_active":"2024-09-12T01:38:01.712788+0000","last_peered":"2024-09-12T01:38:01.712788+0000","last_clean":"2024-09-12T01:38:01.712788+0000","last_became_active":"2024-09-12T00:28:31.207938+0000","last_became_peered":"2024-09-12T00:28:31.207938+0000","last_unstale":"2024-09-12T01:38:01.712788+0000","last_undegraded":"2024-09-12T01:38:01.712788+0000","last_fullsized":"2024-09-12T01:38:01.712788+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:57.649279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174663,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":518,"num_read_kb":179847,"num_write":976,"num_write_kb":39231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:52.780005+0000","last_change":"2024-09-12T00:28:35.213658+0000","last_active":"2024-09-12T01:33:52.780005+0000","last_peered":"2024-09-12T01:33:52.780005+0000","last_clean":"2024-09-12T01:33:52.780005+0000","last_became_active":"2024-09-12T00:28:35.213178+0000","last_became_peered":"2024-09-12T00:28:35.213178+0000","last_unstale":"2024-09-12T01:33:52.780005+0000","last_undegraded":"2024-09-12T01:33:52.780005+0000","last_fullsized":"2024-09-12T01:33:52.780005+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:24.544971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"263'258","reported_seq":836,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.362668+0000","last_change":"2024-09-12T00:28:37.426701+0000","last_active":"2024-09-12T01:38:01.362668+0000","last_peered":"2024-09-12T01:38:01.362668+0000","last_clean":"2024-09-12T01:38:01.362668+0000","last_became_active":"2024-09-12T00:28:37.426357+0000","last_became_peered":"2024-09-12T00:28:37.426357+0000","last_unstale":"2024-09-12T01:38:01.362668+0000","last_undegraded":"2024-09-12T01:38:01.362668+0000","last_fullsized":"2024-09-12T01:38:01.362668+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:10.776649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15889,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":416,"num_read_kb":929,"num_write":326,"num_write_kb":245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"263'769","reported_seq":2648,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.452385+0000","last_change":"2024-09-12T00:28:39.219349+0000","last_active":"2024-09-12T01:38:01.452385+0000","last_peered":"2024-09-12T01:38:01.452385+0000","last_clean":"2024-09-12T01:38:01.452385+0000","last_became_active":"2024-09-12T00:28:39.218738+0000","last_became_peered":"2024-09-12T00:28:39.218738+0000","last_unstale":"2024-09-12T01:38:01.452385+0000","last_undegraded":"2024-09-12T01:38:01.452385+0000","last_fullsized":"2024-09-12T01:38:01.452385+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:17.422620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"263'110","reported_seq":678,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:47.796048+0000","last_change":"2024-09-12T00:28:33.213347+0000","last_active":"2024-09-12T01:35:47.796048+0000","last_peered":"2024-09-12T01:35:47.796048+0000","last_clean":"2024-09-12T01:35:47.796048+0000","last_became_active":"2024-09-12T00:28:33.213074+0000","last_became_peered":"2024-09-12T00:28:33.213074+0000","last_unstale":"2024-09-12T01:35:47.796048+0000","last_undegraded":"2024-09-12T01:35:47.796048+0000","last_fullsized":"2024-09-12T01:35:47.796048+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:23.084366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":473,"num_read_kb":387,"num_write":177,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"263'304","reported_seq":913,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.733507+0000","last_change":"2024-09-12T00:28:31.208561+0000","last_active":"2024-09-12T01:38:01.733507+0000","last_peered":"2024-09-12T01:38:01.733507+0000","last_clean":"2024-09-12T01:38:01.733507+0000","last_became_active":"2024-09-12T00:28:31.207567+0000","last_became_peered":"2024-09-12T00:28:31.207567+0000","last_unstale":"2024-09-12T01:38:01.733507+0000","last_undegraded":"2024-09-12T01:38:01.733507+0000","last_fullsized":"2024-09-12T01:38:01.733507+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:20.391261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":384,"num_read_kb":9497,"num_write":972,"num_write_kb":19827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.736003+0000","last_change":"2024-09-12T00:28:35.210621+0000","last_active":"2024-09-12T01:35:46.736003+0000","last_peered":"2024-09-12T01:35:46.736003+0000","last_clean":"2024-09-12T01:35:46.736003+0000","last_became_active":"2024-09-12T00:28:35.209944+0000","last_became_peered":"2024-09-12T00:28:35.209944+0000","last_unstale":"2024-09-12T01:35:46.736003+0000","last_undegraded":"2024-09-12T01:35:46.736003+0000","last_fullsized":"2024-09-12T01:35:46.736003+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:49.310299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"263'369","reported_seq":1002,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.143752+0000","last_change":"2024-09-12T00:28:37.424559+0000","last_active":"2024-09-12T01:38:00.143752+0000","last_peered":"2024-09-12T01:38:00.143752+0000","last_clean":"2024-09-12T01:38:00.143752+0000","last_became_active":"2024-09-12T00:28:37.424250+0000","last_became_peered":"2024-09-12T00:28:37.424250+0000","last_unstale":"2024-09-12T01:38:00.143752+0000","last_undegraded":"2024-09-12T01:38:00.143752+0000","last_fullsized":"2024-09-12T01:38:00.143752+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:53.905894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42905,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":588,"num_read_kb":1145,"num_write":446,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.933854+0000","last_change":"2024-09-12T00:28:39.214210+0000","last_active":"2024-09-12T01:33:56.933854+0000","last_peered":"2024-09-12T01:33:56.933854+0000","last_clean":"2024-09-12T01:33:56.933854+0000","last_became_active":"2024-09-12T00:28:39.213889+0000","last_became_peered":"2024-09-12T00:28:39.213889+0000","last_unstale":"2024-09-12T01:33:56.933854+0000","last_undegraded":"2024-09-12T01:33:56.933854+0000","last_fullsized":"2024-09-12T01:33:56.933854+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:04.180315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"263'533","reported_seq":1343,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:47.142053+0000","last_change":"2024-09-12T00:28:41.229982+0000","last_active":"2024-09-12T01:37:47.142053+0000","last_peered":"2024-09-12T01:37:47.142053+0000","last_clean":"2024-09-12T01:37:47.142053+0000","last_became_active":"2024-09-12T00:28:41.229664+0000","last_became_peered":"2024-09-12T00:28:41.229664+0000","last_unstale":"2024-09-12T01:37:47.142053+0000","last_undegraded":"2024-09-12T01:37:47.142053+0000","last_fullsized":"2024-09-12T01:37:47.142053+0000","mapping_epoch":35,"log_start":"263'500","ondisk_log_start":"263'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":500,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:28.373424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":472,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1261,"num_read_kb":1256,"num_write":1100,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"263'151","reported_seq":766,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.549725+0000","last_change":"2024-09-12T00:28:33.201995+0000","last_active":"2024-09-12T01:35:46.549725+0000","last_peered":"2024-09-12T01:35:46.549725+0000","last_clean":"2024-09-12T01:35:46.549725+0000","last_became_active":"2024-09-12T00:28:33.201673+0000","last_became_peered":"2024-09-12T00:28:33.201673+0000","last_unstale":"2024-09-12T01:35:46.549725+0000","last_undegraded":"2024-09-12T01:35:46.549725+0000","last_fullsized":"2024-09-12T01:35:46.549725+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:31.181867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":672,"num_read_kb":557,"num_write":251,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"263'420","reported_seq":1122,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.765031+0000","last_change":"2024-09-12T00:28:31.202584+0000","last_active":"2024-09-12T01:38:01.765031+0000","last_peered":"2024-09-12T01:38:01.765031+0000","last_clean":"2024-09-12T01:38:01.765031+0000","last_became_active":"2024-09-12T00:28:31.202279+0000","last_became_peered":"2024-09-12T00:28:31.202279+0000","last_unstale":"2024-09-12T01:38:01.765031+0000","last_undegraded":"2024-09-12T01:38:01.765031+0000","last_fullsized":"2024-09-12T01:38:01.765031+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:56.615946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262213,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":777,"num_read_kb":12137,"num_write":1235,"num_write_kb":44296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.538620+0000","last_change":"2024-09-12T00:28:35.210515+0000","last_active":"2024-09-12T01:35:46.538620+0000","last_peered":"2024-09-12T01:35:46.538620+0000","last_clean":"2024-09-12T01:35:46.538620+0000","last_became_active":"2024-09-12T00:28:35.210154+0000","last_became_peered":"2024-09-12T00:28:35.210154+0000","last_unstale":"2024-09-12T01:35:46.538620+0000","last_undegraded":"2024-09-12T01:35:46.538620+0000","last_fullsized":"2024-09-12T01:35:46.538620+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:27.486274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"263'273","reported_seq":859,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.873904+0000","last_change":"2024-09-12T00:28:37.220230+0000","last_active":"2024-09-12T01:38:00.873904+0000","last_peered":"2024-09-12T01:38:00.873904+0000","last_clean":"2024-09-12T01:38:00.873904+0000","last_became_active":"2024-09-12T00:28:37.219967+0000","last_became_peered":"2024-09-12T00:28:37.219967+0000","last_unstale":"2024-09-12T01:38:00.873904+0000","last_undegraded":"2024-09-12T01:38:00.873904+0000","last_fullsized":"2024-09-12T01:38:00.873904+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:44.830810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44545,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":449,"num_read_kb":1025,"num_write":360,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:54.637493+0000","last_change":"2024-09-12T00:28:39.216619+0000","last_active":"2024-09-12T01:33:54.637493+0000","last_peered":"2024-09-12T01:33:54.637493+0000","last_clean":"2024-09-12T01:33:54.637493+0000","last_became_active":"2024-09-12T00:28:39.216330+0000","last_became_peered":"2024-09-12T00:28:39.216330+0000","last_unstale":"2024-09-12T01:33:54.637493+0000","last_undegraded":"2024-09-12T01:33:54.637493+0000","last_fullsized":"2024-09-12T01:33:54.637493+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:08.447550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"263'2405","reported_seq":4247,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:36.457076+0000","last_change":"2024-09-12T00:28:41.228159+0000","last_active":"2024-09-12T01:37:36.457076+0000","last_peered":"2024-09-12T01:37:36.457076+0000","last_clean":"2024-09-12T01:37:36.457076+0000","last_became_active":"2024-09-12T00:28:41.227877+0000","last_became_peered":"2024-09-12T00:28:41.227877+0000","last_unstale":"2024-09-12T01:37:36.457076+0000","last_undegraded":"2024-09-12T01:37:36.457076+0000","last_fullsized":"2024-09-12T01:37:36.457076+0000","mapping_epoch":35,"log_start":"263'2300","ondisk_log_start":"263'2300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":2300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:29.699595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1208,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6068,"num_read_kb":6055,"num_write":4875,"num_write_kb":1798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"263'303","reported_seq":972,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.533631+0000","last_change":"2024-09-12T00:28:33.218264+0000","last_active":"2024-09-12T01:33:51.533631+0000","last_peered":"2024-09-12T01:33:51.533631+0000","last_clean":"2024-09-12T01:33:51.533631+0000","last_became_active":"2024-09-12T00:28:33.217954+0000","last_became_peered":"2024-09-12T00:28:33.217954+0000","last_unstale":"2024-09-12T01:33:51.533631+0000","last_undegraded":"2024-09-12T01:33:51.533631+0000","last_fullsized":"2024-09-12T01:33:51.533631+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:44.095321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1356,"num_read_kb":1133,"num_write":489,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"263'384","reported_seq":1070,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.735173+0000","last_change":"2024-09-12T00:28:31.215918+0000","last_active":"2024-09-12T01:38:01.735173+0000","last_peered":"2024-09-12T01:38:01.735173+0000","last_clean":"2024-09-12T01:38:01.735173+0000","last_became_active":"2024-09-12T00:28:31.215643+0000","last_became_peered":"2024-09-12T00:28:31.215643+0000","last_unstale":"2024-09-12T01:38:01.735173+0000","last_undegraded":"2024-09-12T01:38:01.735173+0000","last_fullsized":"2024-09-12T01:38:01.735173+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:03.063848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432537,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":556,"num_read_kb":94195,"num_write":1241,"num_write_kb":52818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.627099+0000","last_change":"2024-09-12T00:28:35.208477+0000","last_active":"2024-09-12T01:33:51.627099+0000","last_peered":"2024-09-12T01:33:51.627099+0000","last_clean":"2024-09-12T01:33:51.627099+0000","last_became_active":"2024-09-12T00:28:35.208169+0000","last_became_peered":"2024-09-12T00:28:35.208169+0000","last_unstale":"2024-09-12T01:33:51.627099+0000","last_undegraded":"2024-09-12T01:33:51.627099+0000","last_fullsized":"2024-09-12T01:33:51.627099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:22.104533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"263'330","reported_seq":940,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.229680+0000","last_change":"2024-09-12T00:28:37.221382+0000","last_active":"2024-09-12T01:38:00.229680+0000","last_peered":"2024-09-12T01:38:00.229680+0000","last_clean":"2024-09-12T01:38:00.229680+0000","last_became_active":"2024-09-12T00:28:37.220877+0000","last_became_peered":"2024-09-12T00:28:37.220877+0000","last_unstale":"2024-09-12T01:38:00.229680+0000","last_undegraded":"2024-09-12T01:38:00.229680+0000","last_fullsized":"2024-09-12T01:38:00.229680+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:32:44.806344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44229,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":532,"num_read_kb":1137,"num_write":418,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"263'773","reported_seq":2587,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.806004+0000","last_change":"2024-09-12T00:28:39.216443+0000","last_active":"2024-09-12T01:38:01.806004+0000","last_peered":"2024-09-12T01:38:01.806004+0000","last_clean":"2024-09-12T01:38:01.806004+0000","last_became_active":"2024-09-12T00:28:39.215746+0000","last_became_peered":"2024-09-12T00:28:39.215746+0000","last_unstale":"2024-09-12T01:38:01.806004+0000","last_undegraded":"2024-09-12T01:38:01.806004+0000","last_fullsized":"2024-09-12T01:38:01.806004+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:06.915545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"263'80","reported_seq":574,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.022592+0000","last_change":"2024-09-12T00:28:41.228845+0000","last_active":"2024-09-12T01:37:46.022592+0000","last_peered":"2024-09-12T01:37:46.022592+0000","last_clean":"2024-09-12T01:37:46.022592+0000","last_became_active":"2024-09-12T00:28:41.228361+0000","last_became_peered":"2024-09-12T00:28:41.228361+0000","last_unstale":"2024-09-12T01:37:46.022592+0000","last_undegraded":"2024-09-12T01:37:46.022592+0000","last_fullsized":"2024-09-12T01:37:46.022592+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:22.221289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":65,"num_write":188,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"263'302","reported_seq":908,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:48.154867+0000","last_change":"2024-09-12T00:28:33.219482+0000","last_active":"2024-09-12T01:35:48.154867+0000","last_peered":"2024-09-12T01:35:48.154867+0000","last_clean":"2024-09-12T01:35:48.154867+0000","last_became_active":"2024-09-12T00:28:33.219182+0000","last_became_peered":"2024-09-12T00:28:33.219182+0000","last_unstale":"2024-09-12T01:35:48.154867+0000","last_undegraded":"2024-09-12T01:35:48.154867+0000","last_fullsized":"2024-09-12T01:35:48.154867+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:37.924996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1277,"num_read_kb":1021,"num_write":469,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"263'374","reported_seq":1041,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.747308+0000","last_change":"2024-09-12T00:28:31.215345+0000","last_active":"2024-09-12T01:38:01.747308+0000","last_peered":"2024-09-12T01:38:01.747308+0000","last_clean":"2024-09-12T01:38:01.747308+0000","last_became_active":"2024-09-12T00:28:31.214920+0000","last_became_peered":"2024-09-12T00:28:31.214920+0000","last_unstale":"2024-09-12T01:38:01.747308+0000","last_undegraded":"2024-09-12T01:38:01.747308+0000","last_fullsized":"2024-09-12T01:38:01.747308+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:51.465462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":584,"num_read_kb":15343,"num_write":1236,"num_write_kb":35661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.627067+0000","last_change":"2024-09-12T00:28:35.208217+0000","last_active":"2024-09-12T01:33:51.627067+0000","last_peered":"2024-09-12T01:33:51.627067+0000","last_clean":"2024-09-12T01:33:51.627067+0000","last_became_active":"2024-09-12T00:28:35.207881+0000","last_became_peered":"2024-09-12T00:28:35.207881+0000","last_unstale":"2024-09-12T01:33:51.627067+0000","last_undegraded":"2024-09-12T01:33:51.627067+0000","last_fullsized":"2024-09-12T01:33:51.627067+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:10.037662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"263'466","reported_seq":1120,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.006707+0000","last_change":"2024-09-12T00:28:37.217137+0000","last_active":"2024-09-12T01:38:01.006707+0000","last_peered":"2024-09-12T01:38:01.006707+0000","last_clean":"2024-09-12T01:38:01.006707+0000","last_became_active":"2024-09-12T00:28:37.216189+0000","last_became_peered":"2024-09-12T00:28:37.216189+0000","last_unstale":"2024-09-12T01:38:01.006707+0000","last_undegraded":"2024-09-12T01:38:01.006707+0000","last_fullsized":"2024-09-12T01:38:01.006707+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:12.417502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90719,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":821,"num_read_kb":1951,"num_write":658,"num_write_kb":528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:51.539194+0000","last_change":"2024-09-12T00:28:39.212958+0000","last_active":"2024-09-12T01:35:51.539194+0000","last_peered":"2024-09-12T01:35:51.539194+0000","last_clean":"2024-09-12T01:35:51.539194+0000","last_became_active":"2024-09-12T00:28:39.212687+0000","last_became_peered":"2024-09-12T00:28:39.212687+0000","last_unstale":"2024-09-12T01:35:51.539194+0000","last_undegraded":"2024-09-12T01:35:51.539194+0000","last_fullsized":"2024-09-12T01:35:51.539194+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:16.911233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"263'133","reported_seq":662,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:13.149858+0000","last_change":"2024-09-12T00:28:41.226044+0000","last_active":"2024-09-12T01:36:13.149858+0000","last_peered":"2024-09-12T01:36:13.149858+0000","last_clean":"2024-09-12T01:36:13.149858+0000","last_became_active":"2024-09-12T00:28:41.225700+0000","last_became_peered":"2024-09-12T00:28:41.225700+0000","last_unstale":"2024-09-12T01:36:13.149858+0000","last_undegraded":"2024-09-12T01:36:13.149858+0000","last_fullsized":"2024-09-12T01:36:13.149858+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:22.538216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":521,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":185,"num_read_kb":167,"num_write":321,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"263'175","reported_seq":779,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.533678+0000","last_change":"2024-09-12T00:28:33.205438+0000","last_active":"2024-09-12T01:33:51.533678+0000","last_peered":"2024-09-12T01:33:51.533678+0000","last_clean":"2024-09-12T01:33:51.533678+0000","last_became_active":"2024-09-12T00:28:33.204532+0000","last_became_peered":"2024-09-12T00:28:33.204532+0000","last_unstale":"2024-09-12T01:33:51.533678+0000","last_undegraded":"2024-09-12T01:33:51.533678+0000","last_fullsized":"2024-09-12T01:33:51.533678+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:42.519724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":765,"num_read_kb":622,"num_write":270,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"263'376","reported_seq":1012,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.755031+0000","last_change":"2024-09-12T00:28:31.207547+0000","last_active":"2024-09-12T01:38:01.755031+0000","last_peered":"2024-09-12T01:38:01.755031+0000","last_clean":"2024-09-12T01:38:01.755031+0000","last_became_active":"2024-09-12T00:28:31.207269+0000","last_became_peered":"2024-09-12T00:28:31.207269+0000","last_unstale":"2024-09-12T01:38:01.755031+0000","last_undegraded":"2024-09-12T01:38:01.755031+0000","last_fullsized":"2024-09-12T01:38:01.755031+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:27.052564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291522,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":535,"num_read_kb":24704,"num_write":1122,"num_write_kb":40904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.627126+0000","last_change":"2024-09-12T00:28:35.209783+0000","last_active":"2024-09-12T01:33:51.627126+0000","last_peered":"2024-09-12T01:33:51.627126+0000","last_clean":"2024-09-12T01:33:51.627126+0000","last_became_active":"2024-09-12T00:28:35.208829+0000","last_became_peered":"2024-09-12T00:28:35.208829+0000","last_unstale":"2024-09-12T01:33:51.627126+0000","last_undegraded":"2024-09-12T01:33:51.627126+0000","last_fullsized":"2024-09-12T01:33:51.627126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:49.399261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"263'284","reported_seq":877,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.054138+0000","last_change":"2024-09-12T00:28:37.210416+0000","last_active":"2024-09-12T01:38:01.054138+0000","last_peered":"2024-09-12T01:38:01.054138+0000","last_clean":"2024-09-12T01:38:01.054138+0000","last_became_active":"2024-09-12T00:28:37.210162+0000","last_became_peered":"2024-09-12T00:28:37.210162+0000","last_unstale":"2024-09-12T01:38:01.054138+0000","last_undegraded":"2024-09-12T01:38:01.054138+0000","last_fullsized":"2024-09-12T01:38:01.054138+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:03.051183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46921,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":495,"num_read_kb":1053,"num_write":432,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:06.785115+0000","last_change":"2024-09-12T00:28:39.220793+0000","last_active":"2024-09-12T01:34:06.785115+0000","last_peered":"2024-09-12T01:34:06.785115+0000","last_clean":"2024-09-12T01:34:06.785115+0000","last_became_active":"2024-09-12T00:28:39.220468+0000","last_became_peered":"2024-09-12T00:28:39.220468+0000","last_unstale":"2024-09-12T01:34:06.785115+0000","last_undegraded":"2024-09-12T01:34:06.785115+0000","last_fullsized":"2024-09-12T01:34:06.785115+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:49.834445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"263'81","reported_seq":575,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:59.659578+0000","last_change":"2024-09-12T00:28:41.228956+0000","last_active":"2024-09-12T01:36:59.659578+0000","last_peered":"2024-09-12T01:36:59.659578+0000","last_clean":"2024-09-12T01:36:59.659578+0000","last_became_active":"2024-09-12T00:28:41.228663+0000","last_became_peered":"2024-09-12T00:28:41.228663+0000","last_unstale":"2024-09-12T01:36:59.659578+0000","last_undegraded":"2024-09-12T01:36:59.659578+0000","last_fullsized":"2024-09-12T01:36:59.659578+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:51.130761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":503,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":60,"num_read_kb":59,"num_write":193,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"263'158","reported_seq":779,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:45.663215+0000","last_change":"2024-09-12T00:28:33.207160+0000","last_active":"2024-09-12T01:35:45.663215+0000","last_peered":"2024-09-12T01:35:45.663215+0000","last_clean":"2024-09-12T01:35:45.663215+0000","last_became_active":"2024-09-12T00:28:33.206883+0000","last_became_peered":"2024-09-12T00:28:33.206883+0000","last_unstale":"2024-09-12T01:35:45.663215+0000","last_undegraded":"2024-09-12T01:35:45.663215+0000","last_fullsized":"2024-09-12T01:35:45.663215+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:15.306805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":717,"num_read_kb":595,"num_write":233,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"263'306","reported_seq":922,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.774968+0000","last_change":"2024-09-12T00:28:31.203866+0000","last_active":"2024-09-12T01:38:01.774968+0000","last_peered":"2024-09-12T01:38:01.774968+0000","last_clean":"2024-09-12T01:38:01.774968+0000","last_became_active":"2024-09-12T00:28:31.203369+0000","last_became_peered":"2024-09-12T00:28:31.203369+0000","last_unstale":"2024-09-12T01:38:01.774968+0000","last_undegraded":"2024-09-12T01:38:01.774968+0000","last_fullsized":"2024-09-12T01:38:01.774968+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:04.800888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7425128,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":375,"num_read_kb":56295,"num_write":849,"num_write_kb":46368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.933271+0000","last_change":"2024-09-12T00:28:35.208477+0000","last_active":"2024-09-12T01:33:51.933271+0000","last_peered":"2024-09-12T01:33:51.933271+0000","last_clean":"2024-09-12T01:33:51.933271+0000","last_became_active":"2024-09-12T00:28:35.207923+0000","last_became_peered":"2024-09-12T00:28:35.207923+0000","last_unstale":"2024-09-12T01:33:51.933271+0000","last_undegraded":"2024-09-12T01:33:51.933271+0000","last_fullsized":"2024-09-12T01:33:51.933271+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:33.170429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"263'348","reported_seq":950,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.685418+0000","last_change":"2024-09-12T00:28:37.220980+0000","last_active":"2024-09-12T01:38:00.685418+0000","last_peered":"2024-09-12T01:38:00.685418+0000","last_clean":"2024-09-12T01:38:00.685418+0000","last_became_active":"2024-09-12T00:28:37.220674+0000","last_became_peered":"2024-09-12T00:28:37.220674+0000","last_unstale":"2024-09-12T01:38:00.685418+0000","last_undegraded":"2024-09-12T01:38:00.685418+0000","last_fullsized":"2024-09-12T01:38:00.685418+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:29.407891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48847,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":575,"num_read_kb":1313,"num_write":464,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"263'739","reported_seq":4567,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.054946+0000","last_change":"2024-09-12T00:28:39.214151+0000","last_active":"2024-09-12T01:38:00.054946+0000","last_peered":"2024-09-12T01:38:00.054946+0000","last_clean":"2024-09-12T01:38:00.054946+0000","last_became_active":"2024-09-12T00:28:39.213871+0000","last_became_peered":"2024-09-12T00:28:39.213871+0000","last_unstale":"2024-09-12T01:38:00.054946+0000","last_undegraded":"2024-09-12T01:38:00.054946+0000","last_fullsized":"2024-09-12T01:38:00.054946+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":700,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:10.173214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"263'194","reported_seq":745,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:40.186256+0000","last_change":"2024-09-12T00:28:41.227781+0000","last_active":"2024-09-12T01:36:40.186256+0000","last_peered":"2024-09-12T01:36:40.186256+0000","last_clean":"2024-09-12T01:36:40.186256+0000","last_became_active":"2024-09-12T00:28:41.227310+0000","last_became_peered":"2024-09-12T00:28:41.227310+0000","last_unstale":"2024-09-12T01:36:40.186256+0000","last_undegraded":"2024-09-12T01:36:40.186256+0000","last_fullsized":"2024-09-12T01:36:40.186256+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:23.647466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1879,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":313,"num_read_kb":267,"num_write":467,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"263'134","reported_seq":758,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.533762+0000","last_change":"2024-09-12T00:28:33.211637+0000","last_active":"2024-09-12T01:33:51.533762+0000","last_peered":"2024-09-12T01:33:51.533762+0000","last_clean":"2024-09-12T01:33:51.533762+0000","last_became_active":"2024-09-12T00:28:33.211327+0000","last_became_peered":"2024-09-12T00:28:33.211327+0000","last_unstale":"2024-09-12T01:33:51.533762+0000","last_undegraded":"2024-09-12T01:33:51.533762+0000","last_fullsized":"2024-09-12T01:33:51.533762+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:57.179232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":621,"num_read_kb":525,"num_write":194,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"263'370","reported_seq":1068,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.720670+0000","last_change":"2024-09-12T00:28:31.202041+0000","last_active":"2024-09-12T01:38:01.720670+0000","last_peered":"2024-09-12T01:38:01.720670+0000","last_clean":"2024-09-12T01:38:01.720670+0000","last_became_active":"2024-09-12T00:28:31.201275+0000","last_became_peered":"2024-09-12T00:28:31.201275+0000","last_unstale":"2024-09-12T01:38:01.720670+0000","last_undegraded":"2024-09-12T01:38:01.720670+0000","last_fullsized":"2024-09-12T01:38:01.720670+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:04.675535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395829,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":640,"num_read_kb":30113,"num_write":1190,"num_write_kb":53346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1449,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:59.832864+0000","last_change":"2024-09-12T00:28:35.210438+0000","last_active":"2024-09-12T01:37:59.832864+0000","last_peered":"2024-09-12T01:37:59.832864+0000","last_clean":"2024-09-12T01:37:59.832864+0000","last_became_active":"2024-09-12T00:28:35.210173+0000","last_became_peered":"2024-09-12T00:28:35.210173+0000","last_unstale":"2024-09-12T01:37:59.832864+0000","last_undegraded":"2024-09-12T01:37:59.832864+0000","last_fullsized":"2024-09-12T01:37:59.832864+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:01.967609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":952,"num_read_kb":952,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"263'106","reported_seq":638,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:54.637565+0000","last_change":"2024-09-12T00:28:37.424197+0000","last_active":"2024-09-12T01:33:54.637565+0000","last_peered":"2024-09-12T01:33:54.637565+0000","last_clean":"2024-09-12T01:33:54.637565+0000","last_became_active":"2024-09-12T00:28:37.423847+0000","last_became_peered":"2024-09-12T00:28:37.423847+0000","last_unstale":"2024-09-12T01:33:54.637565+0000","last_undegraded":"2024-09-12T01:33:54.637565+0000","last_fullsized":"2024-09-12T01:33:54.637565+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:11.857170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":109,"num_read_kb":102,"num_write":74,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"263'760","reported_seq":2647,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.056045+0000","last_change":"2024-09-12T00:28:39.216574+0000","last_active":"2024-09-12T01:38:00.056045+0000","last_peered":"2024-09-12T01:38:00.056045+0000","last_clean":"2024-09-12T01:38:00.056045+0000","last_became_active":"2024-09-12T00:28:39.216244+0000","last_became_peered":"2024-09-12T00:28:39.216244+0000","last_unstale":"2024-09-12T01:38:00.056045+0000","last_undegraded":"2024-09-12T01:38:00.056045+0000","last_fullsized":"2024-09-12T01:38:00.056045+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:06.051077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"263'177","reported_seq":688,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:41.529420+0000","last_change":"2024-09-12T00:28:41.226032+0000","last_active":"2024-09-12T01:36:41.529420+0000","last_peered":"2024-09-12T01:36:41.529420+0000","last_clean":"2024-09-12T01:36:41.529420+0000","last_became_active":"2024-09-12T00:28:41.225728+0000","last_became_peered":"2024-09-12T00:28:41.225728+0000","last_unstale":"2024-09-12T01:36:41.529420+0000","last_undegraded":"2024-09-12T01:36:41.529420+0000","last_fullsized":"2024-09-12T01:36:41.529420+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:37.084319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":145,"num_write":308,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"263'4256","reported_seq":4857,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:58.613431+0000","last_change":"2024-09-12T00:28:33.206100+0000","last_active":"2024-09-12T01:33:58.613431+0000","last_peered":"2024-09-12T01:33:58.613431+0000","last_clean":"2024-09-12T01:33:58.613431+0000","last_became_active":"2024-09-12T00:28:33.205792+0000","last_became_peered":"2024-09-12T00:28:33.205792+0000","last_unstale":"2024-09-12T01:33:58.613431+0000","last_undegraded":"2024-09-12T01:33:58.613431+0000","last_fullsized":"2024-09-12T01:33:58.613431+0000","mapping_epoch":27,"log_start":"263'4200","ondisk_log_start":"263'4200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":3000,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:14.540790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17142,"num_read_kb":14400,"num_write":6430,"num_write_kb":3228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"263'376","reported_seq":1095,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.751713+0000","last_change":"2024-09-12T00:28:31.202748+0000","last_active":"2024-09-12T01:38:01.751713+0000","last_peered":"2024-09-12T01:38:01.751713+0000","last_clean":"2024-09-12T01:38:01.751713+0000","last_became_active":"2024-09-12T00:28:31.202456+0000","last_became_peered":"2024-09-12T00:28:31.202456+0000","last_unstale":"2024-09-12T01:38:01.751713+0000","last_undegraded":"2024-09-12T01:38:01.751713+0000","last_fullsized":"2024-09-12T01:38:01.751713+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:33.698882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":651,"num_read_kb":78129,"num_write":1373,"num_write_kb":48684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.533751+0000","last_change":"2024-09-12T00:28:35.207665+0000","last_active":"2024-09-12T01:33:51.533751+0000","last_peered":"2024-09-12T01:33:51.533751+0000","last_clean":"2024-09-12T01:33:51.533751+0000","last_became_active":"2024-09-12T00:28:35.207343+0000","last_became_peered":"2024-09-12T00:28:35.207343+0000","last_unstale":"2024-09-12T01:33:51.533751+0000","last_undegraded":"2024-09-12T01:33:51.533751+0000","last_fullsized":"2024-09-12T01:33:51.533751+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:06.989902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"263'369","reported_seq":987,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.685057+0000","last_change":"2024-09-12T00:28:37.211454+0000","last_active":"2024-09-12T01:38:01.685057+0000","last_peered":"2024-09-12T01:38:01.685057+0000","last_clean":"2024-09-12T01:38:01.685057+0000","last_became_active":"2024-09-12T00:28:37.211090+0000","last_became_peered":"2024-09-12T00:28:37.211090+0000","last_unstale":"2024-09-12T01:38:01.685057+0000","last_undegraded":"2024-09-12T01:38:01.685057+0000","last_fullsized":"2024-09-12T01:38:01.685057+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:34:21.708434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46480,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":594,"num_read_kb":1224,"num_write":462,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.534269+0000","last_change":"2024-09-12T00:28:39.219992+0000","last_active":"2024-09-12T01:33:56.534269+0000","last_peered":"2024-09-12T01:33:56.534269+0000","last_clean":"2024-09-12T01:33:56.534269+0000","last_became_active":"2024-09-12T00:28:39.219687+0000","last_became_peered":"2024-09-12T00:28:39.219687+0000","last_unstale":"2024-09-12T01:33:56.534269+0000","last_undegraded":"2024-09-12T01:33:56.534269+0000","last_fullsized":"2024-09-12T01:33:56.534269+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:05.399679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"263'114","reported_seq":619,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:41.523331+0000","last_change":"2024-09-12T00:28:41.226379+0000","last_active":"2024-09-12T01:36:41.523331+0000","last_peered":"2024-09-12T01:36:41.523331+0000","last_clean":"2024-09-12T01:36:41.523331+0000","last_became_active":"2024-09-12T00:28:41.226049+0000","last_became_peered":"2024-09-12T00:28:41.226049+0000","last_unstale":"2024-09-12T01:36:41.523331+0000","last_undegraded":"2024-09-12T01:36:41.523331+0000","last_fullsized":"2024-09-12T01:36:41.523331+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:35.250632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":871,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":118,"num_read_kb":115,"num_write":279,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"263'144","reported_seq":778,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:31.547552+0000","last_change":"2024-09-12T00:28:33.214340+0000","last_active":"2024-09-12T01:35:31.547552+0000","last_peered":"2024-09-12T01:35:31.547552+0000","last_clean":"2024-09-12T01:35:31.547552+0000","last_became_active":"2024-09-12T00:28:33.214018+0000","last_became_peered":"2024-09-12T00:28:33.214018+0000","last_unstale":"2024-09-12T01:35:31.547552+0000","last_undegraded":"2024-09-12T01:35:31.547552+0000","last_fullsized":"2024-09-12T01:35:31.547552+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:53.550703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":636,"num_read_kb":544,"num_write":220,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":614,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:31.723989+0000","last_change":"2024-09-12T00:28:14.748208+0000","last_active":"2024-09-12T01:34:31.723989+0000","last_peered":"2024-09-12T01:34:31.723989+0000","last_clean":"2024-09-12T01:34:31.723989+0000","last_became_active":"2024-09-12T00:28:14.744766+0000","last_became_peered":"2024-09-12T00:28:14.744766+0000","last_unstale":"2024-09-12T01:34:31.723989+0000","last_undegraded":"2024-09-12T01:34:31.723989+0000","last_fullsized":"2024-09-12T01:34:31.723989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:13.107271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:13.107271+0000","last_clean_scrub_stamp":"2024-09-12T00:28:13.107271+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:46.810948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"21'1","reported_seq":522,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:02.789773+0000","last_change":"2024-09-12T00:28:21.169710+0000","last_active":"2024-09-12T01:35:02.789773+0000","last_peered":"2024-09-12T01:35:02.789773+0000","last_clean":"2024-09-12T01:35:02.789773+0000","last_became_active":"2024-09-12T00:28:19.162328+0000","last_became_peered":"2024-09-12T00:28:19.162328+0000","last_unstale":"2024-09-12T01:35:02.789773+0000","last_undegraded":"2024-09-12T01:35:02.789773+0000","last_fullsized":"2024-09-12T01:35:02.789773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_clean_scrub_stamp":"2024-09-12T00:28:18.139537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:10.146909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046717800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"263'318","reported_seq":959,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.744233+0000","last_change":"2024-09-12T00:28:31.215764+0000","last_active":"2024-09-12T01:38:01.744233+0000","last_peered":"2024-09-12T01:38:01.744233+0000","last_clean":"2024-09-12T01:38:01.744233+0000","last_became_active":"2024-09-12T00:28:31.215485+0000","last_became_peered":"2024-09-12T00:28:31.215485+0000","last_unstale":"2024-09-12T01:38:01.744233+0000","last_undegraded":"2024-09-12T01:38:01.744233+0000","last_fullsized":"2024-09-12T01:38:01.744233+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:18.448556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436935,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":460,"num_read_kb":39194,"num_write":1093,"num_write_kb":25197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.731330+0000","last_change":"2024-09-12T00:28:35.209125+0000","last_active":"2024-09-12T01:35:16.731330+0000","last_peered":"2024-09-12T01:35:16.731330+0000","last_clean":"2024-09-12T01:35:16.731330+0000","last_became_active":"2024-09-12T00:28:35.208812+0000","last_became_peered":"2024-09-12T00:28:35.208812+0000","last_unstale":"2024-09-12T01:35:16.731330+0000","last_undegraded":"2024-09-12T01:35:16.731330+0000","last_fullsized":"2024-09-12T01:35:16.731330+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:01.363469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"263'747","reported_seq":1462,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.795476+0000","last_change":"2024-09-12T00:28:37.221326+0000","last_active":"2024-09-12T01:38:01.795476+0000","last_peered":"2024-09-12T01:38:01.795476+0000","last_clean":"2024-09-12T01:38:01.795476+0000","last_became_active":"2024-09-12T00:28:37.221001+0000","last_became_peered":"2024-09-12T00:28:37.221001+0000","last_unstale":"2024-09-12T01:38:01.795476+0000","last_undegraded":"2024-09-12T01:38:01.795476+0000","last_fullsized":"2024-09-12T01:38:01.795476+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":700,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:20.998547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141781,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1456,"num_read_kb":3385,"num_write":1364,"num_write_kb":1192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:51.797587+0000","last_change":"2024-09-12T00:28:39.221623+0000","last_active":"2024-09-12T01:35:51.797587+0000","last_peered":"2024-09-12T01:35:51.797587+0000","last_clean":"2024-09-12T01:35:51.797587+0000","last_became_active":"2024-09-12T00:28:39.221007+0000","last_became_peered":"2024-09-12T00:28:39.221007+0000","last_unstale":"2024-09-12T01:35:51.797587+0000","last_undegraded":"2024-09-12T01:35:51.797587+0000","last_fullsized":"2024-09-12T01:35:51.797587+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:49.965506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"263'186","reported_seq":885,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:42.615741+0000","last_change":"2024-09-12T00:28:41.226364+0000","last_active":"2024-09-12T01:36:42.615741+0000","last_peered":"2024-09-12T01:36:42.615741+0000","last_clean":"2024-09-12T01:36:42.615741+0000","last_became_active":"2024-09-12T00:28:41.226077+0000","last_became_peered":"2024-09-12T00:28:41.226077+0000","last_unstale":"2024-09-12T01:36:42.615741+0000","last_undegraded":"2024-09-12T01:36:42.615741+0000","last_fullsized":"2024-09-12T01:36:42.615741+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:54.387034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":407,"num_read_kb":405,"num_write":366,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"263'200","reported_seq":809,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.797044+0000","last_change":"2024-09-12T00:28:33.214619+0000","last_active":"2024-09-12T01:35:46.797044+0000","last_peered":"2024-09-12T01:35:46.797044+0000","last_clean":"2024-09-12T01:35:46.797044+0000","last_became_active":"2024-09-12T00:28:33.214351+0000","last_became_peered":"2024-09-12T00:28:33.214351+0000","last_unstale":"2024-09-12T01:35:46.797044+0000","last_undegraded":"2024-09-12T01:35:46.797044+0000","last_fullsized":"2024-09-12T01:35:46.797044+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:27.014128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":877,"num_read_kb":731,"num_write":291,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.724871+0000","last_change":"2024-09-12T00:28:21.165739+0000","last_active":"2024-09-12T01:34:36.724871+0000","last_peered":"2024-09-12T01:34:36.724871+0000","last_clean":"2024-09-12T01:34:36.724871+0000","last_became_active":"2024-09-12T00:28:19.164970+0000","last_became_peered":"2024-09-12T00:28:19.164970+0000","last_unstale":"2024-09-12T01:34:36.724871+0000","last_undegraded":"2024-09-12T01:34:36.724871+0000","last_fullsized":"2024-09-12T01:34:36.724871+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_clean_scrub_stamp":"2024-09-12T00:28:18.139537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:32.778181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055291100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"263'372","reported_seq":1104,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.731893+0000","last_change":"2024-09-12T00:28:31.205110+0000","last_active":"2024-09-12T01:38:01.731893+0000","last_peered":"2024-09-12T01:38:01.731893+0000","last_clean":"2024-09-12T01:38:01.731893+0000","last_became_active":"2024-09-12T00:28:31.204842+0000","last_became_peered":"2024-09-12T00:28:31.204842+0000","last_unstale":"2024-09-12T01:38:01.731893+0000","last_undegraded":"2024-09-12T01:38:01.731893+0000","last_fullsized":"2024-09-12T01:38:01.731893+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:16.741760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":699,"num_read_kb":44079,"num_write":1206,"num_write_kb":29123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:47.796159+0000","last_change":"2024-09-12T00:28:35.216312+0000","last_active":"2024-09-12T01:35:47.796159+0000","last_peered":"2024-09-12T01:35:47.796159+0000","last_clean":"2024-09-12T01:35:47.796159+0000","last_became_active":"2024-09-12T00:28:35.215063+0000","last_became_peered":"2024-09-12T00:28:35.215063+0000","last_unstale":"2024-09-12T01:35:47.796159+0000","last_undegraded":"2024-09-12T01:35:47.796159+0000","last_fullsized":"2024-09-12T01:35:47.796159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:30.514762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"263'1361","reported_seq":3156,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.739191+0000","last_change":"2024-09-12T00:28:37.211623+0000","last_active":"2024-09-12T01:38:01.739191+0000","last_peered":"2024-09-12T01:38:01.739191+0000","last_clean":"2024-09-12T01:38:01.739191+0000","last_became_active":"2024-09-12T00:28:37.211275+0000","last_became_peered":"2024-09-12T00:28:37.211275+0000","last_unstale":"2024-09-12T01:38:01.739191+0000","last_undegraded":"2024-09-12T01:38:01.739191+0000","last_fullsized":"2024-09-12T01:38:01.739191+0000","mapping_epoch":31,"log_start":"263'1300","ondisk_log_start":"263'1300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":1300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:17.542912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145911,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2184,"num_read_kb":4297,"num_write":1290,"num_write_kb":1091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:36.734401+0000","last_change":"2024-09-12T00:28:39.217983+0000","last_active":"2024-09-12T01:35:36.734401+0000","last_peered":"2024-09-12T01:35:36.734401+0000","last_clean":"2024-09-12T01:35:36.734401+0000","last_became_active":"2024-09-12T00:28:39.217623+0000","last_became_peered":"2024-09-12T00:28:39.217623+0000","last_unstale":"2024-09-12T01:35:36.734401+0000","last_undegraded":"2024-09-12T01:35:36.734401+0000","last_fullsized":"2024-09-12T01:35:36.734401+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:06.473217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"263'261","reported_seq":806,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:13.177560+0000","last_change":"2024-09-12T00:28:41.255226+0000","last_active":"2024-09-12T01:36:13.177560+0000","last_peered":"2024-09-12T01:36:13.177560+0000","last_clean":"2024-09-12T01:36:13.177560+0000","last_became_active":"2024-09-12T00:28:41.254814+0000","last_became_peered":"2024-09-12T00:28:41.254814+0000","last_unstale":"2024-09-12T01:36:13.177560+0000","last_undegraded":"2024-09-12T01:36:13.177560+0000","last_fullsized":"2024-09-12T01:36:13.177560+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":416,"num_read_kb":400,"num_write":581,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"263'116","reported_seq":754,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.948067+0000","last_change":"2024-09-12T00:28:33.216657+0000","last_active":"2024-09-12T01:35:46.948067+0000","last_peered":"2024-09-12T01:35:46.948067+0000","last_clean":"2024-09-12T01:35:46.948067+0000","last_became_active":"2024-09-12T00:28:33.216335+0000","last_became_peered":"2024-09-12T00:28:33.216335+0000","last_unstale":"2024-09-12T01:35:46.948067+0000","last_undegraded":"2024-09-12T01:35:46.948067+0000","last_fullsized":"2024-09-12T01:35:46.948067+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:46.854089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":537,"num_read_kb":460,"num_write":159,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":528,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:01.533662+0000","last_change":"2024-09-12T00:28:21.323944+0000","last_active":"2024-09-12T01:35:01.533662+0000","last_peered":"2024-09-12T01:35:01.533662+0000","last_clean":"2024-09-12T01:35:01.533662+0000","last_became_active":"2024-09-12T00:28:19.225901+0000","last_became_peered":"2024-09-12T00:28:19.225901+0000","last_unstale":"2024-09-12T01:35:01.533662+0000","last_undegraded":"2024-09-12T01:35:01.533662+0000","last_fullsized":"2024-09-12T01:35:01.533662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_clean_scrub_stamp":"2024-09-12T00:28:18.139537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:52.557475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032319500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"263'337","reported_seq":1136,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.734889+0000","last_change":"2024-09-12T00:28:31.198866+0000","last_active":"2024-09-12T01:38:01.734889+0000","last_peered":"2024-09-12T01:38:01.734889+0000","last_clean":"2024-09-12T01:38:01.734889+0000","last_became_active":"2024-09-12T00:28:31.198575+0000","last_became_peered":"2024-09-12T00:28:31.198575+0000","last_unstale":"2024-09-12T01:38:01.734889+0000","last_undegraded":"2024-09-12T01:38:01.734889+0000","last_fullsized":"2024-09-12T01:38:01.734889+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:05.185444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3941571,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":832,"num_read_kb":78199,"num_write":1073,"num_write_kb":40255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.538695+0000","last_change":"2024-09-12T00:28:35.209485+0000","last_active":"2024-09-12T01:35:46.538695+0000","last_peered":"2024-09-12T01:35:46.538695+0000","last_clean":"2024-09-12T01:35:46.538695+0000","last_became_active":"2024-09-12T00:28:35.209218+0000","last_became_peered":"2024-09-12T00:28:35.209218+0000","last_unstale":"2024-09-12T01:35:46.538695+0000","last_undegraded":"2024-09-12T01:35:46.538695+0000","last_fullsized":"2024-09-12T01:35:46.538695+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:55.033156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"263'279","reported_seq":1658,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:43.275282+0000","last_change":"2024-09-12T00:28:37.424055+0000","last_active":"2024-09-12T01:37:43.275282+0000","last_peered":"2024-09-12T01:37:43.275282+0000","last_clean":"2024-09-12T01:37:43.275282+0000","last_became_active":"2024-09-12T00:28:37.423714+0000","last_became_peered":"2024-09-12T00:28:37.423714+0000","last_unstale":"2024-09-12T01:37:43.275282+0000","last_undegraded":"2024-09-12T01:37:43.275282+0000","last_fullsized":"2024-09-12T01:37:43.275282+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:07.336278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":244,"num_read_kb":234,"num_write":227,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:21.793908+0000","last_change":"2024-09-12T00:28:39.218980+0000","last_active":"2024-09-12T01:35:21.793908+0000","last_peered":"2024-09-12T01:35:21.793908+0000","last_clean":"2024-09-12T01:35:21.793908+0000","last_became_active":"2024-09-12T00:28:39.218692+0000","last_became_peered":"2024-09-12T00:28:39.218692+0000","last_unstale":"2024-09-12T01:35:21.793908+0000","last_undegraded":"2024-09-12T01:35:21.793908+0000","last_fullsized":"2024-09-12T01:35:21.793908+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:07.969643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"263'252","reported_seq":855,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:45.936486+0000","last_change":"2024-09-12T00:28:41.229721+0000","last_active":"2024-09-12T01:37:45.936486+0000","last_peered":"2024-09-12T01:37:45.936486+0000","last_clean":"2024-09-12T01:37:45.936486+0000","last_became_active":"2024-09-12T00:28:41.229441+0000","last_became_peered":"2024-09-12T00:28:41.229441+0000","last_unstale":"2024-09-12T01:37:45.936486+0000","last_undegraded":"2024-09-12T01:37:45.936486+0000","last_fullsized":"2024-09-12T01:37:45.936486+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:46.056278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":487,"num_read_kb":509,"num_write":546,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"263'223","reported_seq":896,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:58.635373+0000","last_change":"2024-09-12T00:28:33.205511+0000","last_active":"2024-09-12T01:35:58.635373+0000","last_peered":"2024-09-12T01:35:58.635373+0000","last_clean":"2024-09-12T01:35:58.635373+0000","last_became_active":"2024-09-12T00:28:33.205107+0000","last_became_peered":"2024-09-12T00:28:33.205107+0000","last_unstale":"2024-09-12T01:35:58.635373+0000","last_undegraded":"2024-09-12T01:35:58.635373+0000","last_fullsized":"2024-09-12T01:35:58.635373+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:39.413290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1021,"num_read_kb":847,"num_write":335,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"23'2","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:02.789730+0000","last_change":"2024-09-12T00:28:21.170135+0000","last_active":"2024-09-12T01:35:02.789730+0000","last_peered":"2024-09-12T01:35:02.789730+0000","last_clean":"2024-09-12T01:35:02.789730+0000","last_became_active":"2024-09-12T00:28:19.162307+0000","last_became_peered":"2024-09-12T00:28:19.162307+0000","last_unstale":"2024-09-12T01:35:02.789730+0000","last_undegraded":"2024-09-12T01:35:02.789730+0000","last_fullsized":"2024-09-12T01:35:02.789730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_clean_scrub_stamp":"2024-09-12T00:28:18.139537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:21.559693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089189499999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"263'355","reported_seq":1039,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.707260+0000","last_change":"2024-09-12T00:28:31.208859+0000","last_active":"2024-09-12T01:38:01.707260+0000","last_peered":"2024-09-12T01:38:01.707260+0000","last_clean":"2024-09-12T01:38:01.707260+0000","last_became_active":"2024-09-12T00:28:31.208584+0000","last_became_peered":"2024-09-12T00:28:31.208584+0000","last_unstale":"2024-09-12T01:38:01.707260+0000","last_undegraded":"2024-09-12T01:38:01.707260+0000","last_fullsized":"2024-09-12T01:38:01.707260+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:48.765543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262163,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":641,"num_read_kb":7750,"num_write":1122,"num_write_kb":19514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:26.794599+0000","last_change":"2024-09-12T00:28:35.207488+0000","last_active":"2024-09-12T01:35:26.794599+0000","last_peered":"2024-09-12T01:35:26.794599+0000","last_clean":"2024-09-12T01:35:26.794599+0000","last_became_active":"2024-09-12T00:28:35.207234+0000","last_became_peered":"2024-09-12T00:28:35.207234+0000","last_unstale":"2024-09-12T01:35:26.794599+0000","last_undegraded":"2024-09-12T01:35:26.794599+0000","last_fullsized":"2024-09-12T01:35:26.794599+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:43.759273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"263'160","reported_seq":717,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:47.314594+0000","last_change":"2024-09-12T00:28:37.219924+0000","last_active":"2024-09-12T01:37:47.314594+0000","last_peered":"2024-09-12T01:37:47.314594+0000","last_clean":"2024-09-12T01:37:47.314594+0000","last_became_active":"2024-09-12T00:28:37.219599+0000","last_became_peered":"2024-09-12T00:28:37.219599+0000","last_unstale":"2024-09-12T01:37:47.314594+0000","last_undegraded":"2024-09-12T01:37:47.314594+0000","last_fullsized":"2024-09-12T01:37:47.314594+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:19.639653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":184,"num_read_kb":176,"num_write":136,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:51.550499+0000","last_change":"2024-09-12T00:28:39.216740+0000","last_active":"2024-09-12T01:35:51.550499+0000","last_peered":"2024-09-12T01:35:51.550499+0000","last_clean":"2024-09-12T01:35:51.550499+0000","last_became_active":"2024-09-12T00:28:39.216397+0000","last_became_peered":"2024-09-12T00:28:39.216397+0000","last_unstale":"2024-09-12T01:35:51.550499+0000","last_undegraded":"2024-09-12T01:35:51.550499+0000","last_fullsized":"2024-09-12T01:35:51.550499+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:48.659805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"263'110","reported_seq":655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:52.796953+0000","last_change":"2024-09-12T00:28:41.230939+0000","last_active":"2024-09-12T01:35:52.796953+0000","last_peered":"2024-09-12T01:35:52.796953+0000","last_clean":"2024-09-12T01:35:52.796953+0000","last_became_active":"2024-09-12T00:28:41.230698+0000","last_became_peered":"2024-09-12T00:28:41.230698+0000","last_unstale":"2024-09-12T01:35:52.796953+0000","last_undegraded":"2024-09-12T01:35:52.796953+0000","last_fullsized":"2024-09-12T01:35:52.796953+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:35.474853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":194,"num_write":246,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"263'101","reported_seq":687,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.944551+0000","last_change":"2024-09-12T00:28:33.214613+0000","last_active":"2024-09-12T01:35:16.944551+0000","last_peered":"2024-09-12T01:35:16.944551+0000","last_clean":"2024-09-12T01:35:16.944551+0000","last_became_active":"2024-09-12T00:28:33.213241+0000","last_became_peered":"2024-09-12T00:28:33.213241+0000","last_unstale":"2024-09-12T01:35:16.944551+0000","last_undegraded":"2024-09-12T01:35:16.944551+0000","last_fullsized":"2024-09-12T01:35:16.944551+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:03.213237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":440,"num_read_kb":364,"num_write":181,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"263'329","reported_seq":945,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.760799+0000","last_change":"2024-09-12T00:28:31.209668+0000","last_active":"2024-09-12T01:38:01.760799+0000","last_peered":"2024-09-12T01:38:01.760799+0000","last_clean":"2024-09-12T01:38:01.760799+0000","last_became_active":"2024-09-12T00:28:31.209154+0000","last_became_peered":"2024-09-12T00:28:31.209154+0000","last_unstale":"2024-09-12T01:38:01.760799+0000","last_undegraded":"2024-09-12T01:38:01.760799+0000","last_fullsized":"2024-09-12T01:38:01.760799+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:20.428733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":854338,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":445,"num_read_kb":910,"num_write":1009,"num_write_kb":5944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":533,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:01.942757+0000","last_change":"2024-09-12T00:28:21.163542+0000","last_active":"2024-09-12T01:35:01.942757+0000","last_peered":"2024-09-12T01:35:01.942757+0000","last_clean":"2024-09-12T01:35:01.942757+0000","last_became_active":"2024-09-12T00:28:19.383394+0000","last_became_peered":"2024-09-12T00:28:19.383394+0000","last_unstale":"2024-09-12T01:35:01.942757+0000","last_undegraded":"2024-09-12T01:35:01.942757+0000","last_fullsized":"2024-09-12T01:35:01.942757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_clean_scrub_stamp":"2024-09-12T00:28:18.139537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:28.230151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046548800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.793286+0000","last_change":"2024-09-12T00:28:35.208415+0000","last_active":"2024-09-12T01:35:16.793286+0000","last_peered":"2024-09-12T01:35:16.793286+0000","last_clean":"2024-09-12T01:35:16.793286+0000","last_became_active":"2024-09-12T00:28:35.208094+0000","last_became_peered":"2024-09-12T00:28:35.208094+0000","last_unstale":"2024-09-12T01:35:16.793286+0000","last_undegraded":"2024-09-12T01:35:16.793286+0000","last_fullsized":"2024-09-12T01:35:16.793286+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:03.328037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"263'655","reported_seq":1348,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.420767+0000","last_change":"2024-09-12T00:28:37.221025+0000","last_active":"2024-09-12T01:38:01.420767+0000","last_peered":"2024-09-12T01:38:01.420767+0000","last_clean":"2024-09-12T01:38:01.420767+0000","last_became_active":"2024-09-12T00:28:37.220158+0000","last_became_peered":"2024-09-12T00:28:37.220158+0000","last_unstale":"2024-09-12T01:38:01.420767+0000","last_undegraded":"2024-09-12T01:38:01.420767+0000","last_fullsized":"2024-09-12T01:38:01.420767+0000","mapping_epoch":31,"log_start":"263'600","ondisk_log_start":"263'600","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":600,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:50.143092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103952,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1701,"num_read_kb":3039,"num_write":2184,"num_write_kb":1992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:21.546179+0000","last_change":"2024-09-12T00:28:39.220506+0000","last_active":"2024-09-12T01:35:21.546179+0000","last_peered":"2024-09-12T01:35:21.546179+0000","last_clean":"2024-09-12T01:35:21.546179+0000","last_became_active":"2024-09-12T00:28:39.220079+0000","last_became_peered":"2024-09-12T00:28:39.220079+0000","last_unstale":"2024-09-12T01:35:21.546179+0000","last_undegraded":"2024-09-12T01:35:21.546179+0000","last_fullsized":"2024-09-12T01:35:21.546179+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:23.654340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"263'134","reported_seq":653,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.800037+0000","last_change":"2024-09-12T00:28:41.258045+0000","last_active":"2024-09-12T01:36:11.800037+0000","last_peered":"2024-09-12T01:36:11.800037+0000","last_clean":"2024-09-12T01:36:11.800037+0000","last_became_active":"2024-09-12T00:28:41.257739+0000","last_became_peered":"2024-09-12T00:28:41.257739+0000","last_unstale":"2024-09-12T01:36:11.800037+0000","last_undegraded":"2024-09-12T01:36:11.800037+0000","last_fullsized":"2024-09-12T01:36:11.800037+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:03.828940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":203,"num_read_kb":182,"num_write":334,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"263'142","reported_seq":775,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.793315+0000","last_change":"2024-09-12T00:28:33.216340+0000","last_active":"2024-09-12T01:35:16.793315+0000","last_peered":"2024-09-12T01:35:16.793315+0000","last_clean":"2024-09-12T01:35:16.793315+0000","last_became_active":"2024-09-12T00:28:33.216065+0000","last_became_peered":"2024-09-12T00:28:33.216065+0000","last_unstale":"2024-09-12T01:35:16.793315+0000","last_undegraded":"2024-09-12T01:35:16.793315+0000","last_fullsized":"2024-09-12T01:35:16.793315+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:28.642231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":614,"num_read_kb":525,"num_write":208,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"263'340","reported_seq":1000,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.764779+0000","last_change":"2024-09-12T00:28:31.199416+0000","last_active":"2024-09-12T01:38:01.764779+0000","last_peered":"2024-09-12T01:38:01.764779+0000","last_clean":"2024-09-12T01:38:01.764779+0000","last_became_active":"2024-09-12T00:28:31.198681+0000","last_became_peered":"2024-09-12T00:28:31.198681+0000","last_unstale":"2024-09-12T01:38:01.764779+0000","last_undegraded":"2024-09-12T01:38:01.764779+0000","last_fullsized":"2024-09-12T01:38:01.764779+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:11.597114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550835,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":482,"num_read_kb":38182,"num_write":1051,"num_write_kb":26889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":522,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.731345+0000","last_change":"2024-09-12T00:28:21.165802+0000","last_active":"2024-09-12T01:35:16.731345+0000","last_peered":"2024-09-12T01:35:16.731345+0000","last_clean":"2024-09-12T01:35:16.731345+0000","last_became_active":"2024-09-12T00:28:19.384222+0000","last_became_peered":"2024-09-12T00:28:19.384222+0000","last_unstale":"2024-09-12T01:35:16.731345+0000","last_undegraded":"2024-09-12T01:35:16.731345+0000","last_fullsized":"2024-09-12T01:35:16.731345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_clean_scrub_stamp":"2024-09-12T00:28:18.139537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:40.635892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060999899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"37'5","reported_seq":982,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:59.821892+0000","last_change":"2024-09-12T00:28:35.208566+0000","last_active":"2024-09-12T01:37:59.821892+0000","last_peered":"2024-09-12T01:37:59.821892+0000","last_clean":"2024-09-12T01:37:59.821892+0000","last_became_active":"2024-09-12T00:28:35.207941+0000","last_became_peered":"2024-09-12T00:28:35.207941+0000","last_unstale":"2024-09-12T01:37:59.821892+0000","last_undegraded":"2024-09-12T01:37:59.821892+0000","last_fullsized":"2024-09-12T01:37:59.821892+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:30.697798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":1191,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"263'246","reported_seq":839,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:48.927414+0000","last_change":"2024-09-12T00:28:37.424197+0000","last_active":"2024-09-12T01:36:48.927414+0000","last_peered":"2024-09-12T01:36:48.927414+0000","last_clean":"2024-09-12T01:36:48.927414+0000","last_became_active":"2024-09-12T00:28:37.423835+0000","last_became_peered":"2024-09-12T00:28:37.423835+0000","last_unstale":"2024-09-12T01:36:48.927414+0000","last_undegraded":"2024-09-12T01:36:48.927414+0000","last_fullsized":"2024-09-12T01:36:48.927414+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:55.348547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":310,"num_read_kb":301,"num_write":288,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"263'781","reported_seq":2896,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.556589+0000","last_change":"2024-09-12T00:28:39.214336+0000","last_active":"2024-09-12T01:38:01.556589+0000","last_peered":"2024-09-12T01:38:01.556589+0000","last_clean":"2024-09-12T01:38:01.556589+0000","last_became_active":"2024-09-12T00:28:39.214050+0000","last_became_peered":"2024-09-12T00:28:39.214050+0000","last_unstale":"2024-09-12T01:38:01.556589+0000","last_undegraded":"2024-09-12T01:38:01.556589+0000","last_fullsized":"2024-09-12T01:38:01.556589+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:42.935841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"263'143","reported_seq":656,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:29.656020+0000","last_change":"2024-09-12T00:28:41.255145+0000","last_active":"2024-09-12T01:36:29.656020+0000","last_peered":"2024-09-12T01:36:29.656020+0000","last_clean":"2024-09-12T01:36:29.656020+0000","last_became_active":"2024-09-12T00:28:41.254826+0000","last_became_peered":"2024-09-12T00:28:41.254826+0000","last_unstale":"2024-09-12T01:36:29.656020+0000","last_undegraded":"2024-09-12T01:36:29.656020+0000","last_fullsized":"2024-09-12T01:36:29.656020+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:08.523605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1298,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":177,"num_read_kb":162,"num_write":341,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"263'307","reported_seq":910,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:37.788688+0000","last_change":"2024-09-12T00:28:33.217822+0000","last_active":"2024-09-12T01:35:37.788688+0000","last_peered":"2024-09-12T01:35:37.788688+0000","last_clean":"2024-09-12T01:35:37.788688+0000","last_became_active":"2024-09-12T00:28:33.217516+0000","last_became_peered":"2024-09-12T00:28:33.217516+0000","last_unstale":"2024-09-12T01:35:37.788688+0000","last_undegraded":"2024-09-12T01:35:37.788688+0000","last_fullsized":"2024-09-12T01:35:37.788688+0000","mapping_epoch":27,"log_start":"260'200","ondisk_log_start":"260'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:49.139392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1312,"num_read_kb":1045,"num_write":501,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"263'305","reported_seq":899,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.734569+0000","last_change":"2024-09-12T00:28:31.203440+0000","last_active":"2024-09-12T01:38:01.734569+0000","last_peered":"2024-09-12T01:38:01.734569+0000","last_clean":"2024-09-12T01:38:01.734569+0000","last_became_active":"2024-09-12T00:28:31.202895+0000","last_became_peered":"2024-09-12T00:28:31.202895+0000","last_unstale":"2024-09-12T01:38:01.734569+0000","last_undegraded":"2024-09-12T01:38:01.734569+0000","last_fullsized":"2024-09-12T01:38:01.734569+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:43.468294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262178,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":365,"num_read_kb":358,"num_write":953,"num_write_kb":25812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":532,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:31.946415+0000","last_change":"2024-09-12T00:28:21.163585+0000","last_active":"2024-09-12T01:35:31.946415+0000","last_peered":"2024-09-12T01:35:31.946415+0000","last_clean":"2024-09-12T01:35:31.946415+0000","last_became_active":"2024-09-12T00:28:19.160344+0000","last_became_peered":"2024-09-12T00:28:19.160344+0000","last_unstale":"2024-09-12T01:35:31.946415+0000","last_undegraded":"2024-09-12T01:35:31.946415+0000","last_fullsized":"2024-09-12T01:35:31.946415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_clean_scrub_stamp":"2024-09-12T00:28:18.139537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:57.842057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000483707,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.545492+0000","last_change":"2024-09-12T00:28:35.215757+0000","last_active":"2024-09-12T01:35:16.545492+0000","last_peered":"2024-09-12T01:35:16.545492+0000","last_clean":"2024-09-12T01:35:16.545492+0000","last_became_active":"2024-09-12T00:28:35.215429+0000","last_became_peered":"2024-09-12T00:28:35.215429+0000","last_unstale":"2024-09-12T01:35:16.545492+0000","last_undegraded":"2024-09-12T01:35:16.545492+0000","last_fullsized":"2024-09-12T01:35:16.545492+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:04.938748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"263'130","reported_seq":687,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.545524+0000","last_change":"2024-09-12T00:28:37.220271+0000","last_active":"2024-09-12T01:35:16.545524+0000","last_peered":"2024-09-12T01:35:16.545524+0000","last_clean":"2024-09-12T01:35:16.545524+0000","last_became_active":"2024-09-12T00:28:37.219746+0000","last_became_peered":"2024-09-12T00:28:37.219746+0000","last_unstale":"2024-09-12T01:35:16.545524+0000","last_undegraded":"2024-09-12T01:35:16.545524+0000","last_fullsized":"2024-09-12T01:35:16.545524+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:18.690666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":158,"num_read_kb":152,"num_write":104,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"263'769","reported_seq":2684,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.452972+0000","last_change":"2024-09-12T00:28:39.218435+0000","last_active":"2024-09-12T01:38:01.452972+0000","last_peered":"2024-09-12T01:38:01.452972+0000","last_clean":"2024-09-12T01:38:01.452972+0000","last_became_active":"2024-09-12T00:28:39.218170+0000","last_became_peered":"2024-09-12T00:28:39.218170+0000","last_unstale":"2024-09-12T01:38:01.452972+0000","last_undegraded":"2024-09-12T01:38:01.452972+0000","last_fullsized":"2024-09-12T01:38:01.452972+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:17.381935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"263'181","reported_seq":680,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.783783+0000","last_change":"2024-09-12T00:28:41.225659+0000","last_active":"2024-09-12T01:33:56.783783+0000","last_peered":"2024-09-12T01:33:56.783783+0000","last_clean":"2024-09-12T01:33:56.783783+0000","last_became_active":"2024-09-12T00:28:41.225316+0000","last_became_peered":"2024-09-12T00:28:41.225316+0000","last_unstale":"2024-09-12T01:33:56.783783+0000","last_undegraded":"2024-09-12T01:33:56.783783+0000","last_fullsized":"2024-09-12T01:33:56.783783+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:54.404729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":127,"num_read_kb":125,"num_write":428,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"263'342","reported_seq":978,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:20.408095+0000","last_change":"2024-09-12T00:28:33.212942+0000","last_active":"2024-09-12T01:36:20.408095+0000","last_peered":"2024-09-12T01:36:20.408095+0000","last_clean":"2024-09-12T01:36:20.408095+0000","last_became_active":"2024-09-12T00:28:33.212624+0000","last_became_peered":"2024-09-12T00:28:33.212624+0000","last_unstale":"2024-09-12T01:36:20.408095+0000","last_undegraded":"2024-09-12T01:36:20.408095+0000","last_fullsized":"2024-09-12T01:36:20.408095+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:49.030957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1481,"num_read_kb":1196,"num_write":544,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"263'449","reported_seq":1164,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.751547+0000","last_change":"2024-09-12T00:28:31.203441+0000","last_active":"2024-09-12T01:38:01.751547+0000","last_peered":"2024-09-12T01:38:01.751547+0000","last_clean":"2024-09-12T01:38:01.751547+0000","last_became_active":"2024-09-12T00:28:31.203087+0000","last_became_peered":"2024-09-12T00:28:31.203087+0000","last_unstale":"2024-09-12T01:38:01.751547+0000","last_undegraded":"2024-09-12T01:38:01.751547+0000","last_fullsized":"2024-09-12T01:38:01.751547+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:34.969519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":607243,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":857,"num_read_kb":36686,"num_write":1272,"num_write_kb":31229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:31.547584+0000","last_change":"2024-09-12T00:28:21.324169+0000","last_active":"2024-09-12T01:35:31.547584+0000","last_peered":"2024-09-12T01:35:31.547584+0000","last_clean":"2024-09-12T01:35:31.547584+0000","last_became_active":"2024-09-12T00:28:19.162886+0000","last_became_peered":"2024-09-12T00:28:19.162886+0000","last_unstale":"2024-09-12T01:35:31.547584+0000","last_undegraded":"2024-09-12T01:35:31.547584+0000","last_fullsized":"2024-09-12T01:35:31.547584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:18.139537+0000","last_clean_scrub_stamp":"2024-09-12T00:28:18.139537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:37.883634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044054899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:49.643998+0000","last_change":"2024-09-12T00:28:35.213217+0000","last_active":"2024-09-12T01:34:49.643998+0000","last_peered":"2024-09-12T01:34:49.643998+0000","last_clean":"2024-09-12T01:34:49.643998+0000","last_became_active":"2024-09-12T00:28:35.212916+0000","last_became_peered":"2024-09-12T00:28:35.212916+0000","last_unstale":"2024-09-12T01:34:49.643998+0000","last_undegraded":"2024-09-12T01:34:49.643998+0000","last_fullsized":"2024-09-12T01:34:49.643998+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:29.058758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"263'763","reported_seq":1501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.569644+0000","last_change":"2024-09-12T00:28:37.424089+0000","last_active":"2024-09-12T01:38:01.569644+0000","last_peered":"2024-09-12T01:38:01.569644+0000","last_clean":"2024-09-12T01:38:01.569644+0000","last_became_active":"2024-09-12T00:28:37.423755+0000","last_became_peered":"2024-09-12T00:28:37.423755+0000","last_unstale":"2024-09-12T01:38:01.569644+0000","last_undegraded":"2024-09-12T01:38:01.569644+0000","last_fullsized":"2024-09-12T01:38:01.569644+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:34.013923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138292,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1365,"num_read_kb":3277,"num_write":1104,"num_write_kb":888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:19.647506+0000","last_change":"2024-09-12T00:28:39.216520+0000","last_active":"2024-09-12T01:35:19.647506+0000","last_peered":"2024-09-12T01:35:19.647506+0000","last_clean":"2024-09-12T01:35:19.647506+0000","last_became_active":"2024-09-12T00:28:39.216237+0000","last_became_peered":"2024-09-12T00:28:39.216237+0000","last_unstale":"2024-09-12T01:35:19.647506+0000","last_undegraded":"2024-09-12T01:35:19.647506+0000","last_fullsized":"2024-09-12T01:35:19.647506+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:00.630922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"263'83","reported_seq":575,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:57.780634+0000","last_change":"2024-09-12T00:28:41.234000+0000","last_active":"2024-09-12T01:33:57.780634+0000","last_peered":"2024-09-12T01:33:57.780634+0000","last_clean":"2024-09-12T01:33:57.780634+0000","last_became_active":"2024-09-12T00:28:41.233696+0000","last_became_peered":"2024-09-12T00:28:41.233696+0000","last_unstale":"2024-09-12T01:33:57.780634+0000","last_undegraded":"2024-09-12T01:33:57.780634+0000","last_fullsized":"2024-09-12T01:33:57.780634+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:56.154197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":84,"num_read_kb":82,"num_write":190,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"263'149","reported_seq":715,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:42.805442+0000","last_change":"2024-09-12T00:28:41.226966+0000","last_active":"2024-09-12T01:36:42.805442+0000","last_peered":"2024-09-12T01:36:42.805442+0000","last_clean":"2024-09-12T01:36:42.805442+0000","last_became_active":"2024-09-12T00:28:41.226143+0000","last_became_peered":"2024-09-12T00:28:41.226143+0000","last_unstale":"2024-09-12T01:36:42.805442+0000","last_undegraded":"2024-09-12T01:36:42.805442+0000","last_fullsized":"2024-09-12T01:36:42.805442+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:18.139245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":251,"num_read_kb":240,"num_write":350,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"263'64","reported_seq":620,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:00.504480+0000","last_change":"2024-09-12T00:28:33.210002+0000","last_active":"2024-09-12T01:34:00.504480+0000","last_peered":"2024-09-12T01:34:00.504480+0000","last_clean":"2024-09-12T01:34:00.504480+0000","last_became_active":"2024-09-12T00:28:33.209335+0000","last_became_peered":"2024-09-12T00:28:33.209335+0000","last_unstale":"2024-09-12T01:34:00.504480+0000","last_undegraded":"2024-09-12T01:34:00.504480+0000","last_fullsized":"2024-09-12T01:34:00.504480+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:09.521704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":218,"num_write":93,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"263'387","reported_seq":1068,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.735584+0000","last_change":"2024-09-12T00:29:04.295940+0000","last_active":"2024-09-12T01:38:01.735584+0000","last_peered":"2024-09-12T01:38:01.735584+0000","last_clean":"2024-09-12T01:38:01.735584+0000","last_became_active":"2024-09-12T00:29:04.295676+0000","last_became_peered":"2024-09-12T00:29:04.295676+0000","last_unstale":"2024-09-12T01:38:01.735584+0000","last_undegraded":"2024-09-12T01:38:01.735584+0000","last_fullsized":"2024-09-12T01:38:01.735584+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:49.747597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2554787,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":757,"num_read_kb":17367,"num_write":1239,"num_write_kb":40068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.933837+0000","last_change":"2024-09-12T00:28:35.208489+0000","last_active":"2024-09-12T01:33:56.933837+0000","last_peered":"2024-09-12T01:33:56.933837+0000","last_clean":"2024-09-12T01:33:56.933837+0000","last_became_active":"2024-09-12T00:28:35.208165+0000","last_became_peered":"2024-09-12T00:28:35.208165+0000","last_unstale":"2024-09-12T01:33:56.933837+0000","last_undegraded":"2024-09-12T01:33:56.933837+0000","last_fullsized":"2024-09-12T01:33:56.933837+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:27.761289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"263'297","reported_seq":889,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.187390+0000","last_change":"2024-09-12T00:28:37.217911+0000","last_active":"2024-09-12T01:38:00.187390+0000","last_peered":"2024-09-12T01:38:00.187390+0000","last_clean":"2024-09-12T01:38:00.187390+0000","last_became_active":"2024-09-12T00:28:37.217603+0000","last_became_peered":"2024-09-12T00:28:37.217603+0000","last_unstale":"2024-09-12T01:38:00.187390+0000","last_undegraded":"2024-09-12T01:38:00.187390+0000","last_fullsized":"2024-09-12T01:38:00.187390+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:00.439250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46508,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":487,"num_read_kb":1094,"num_write":390,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:59.638101+0000","last_change":"2024-09-12T00:28:39.216498+0000","last_active":"2024-09-12T01:33:59.638101+0000","last_peered":"2024-09-12T01:33:59.638101+0000","last_clean":"2024-09-12T01:33:59.638101+0000","last_became_active":"2024-09-12T00:28:39.216143+0000","last_became_peered":"2024-09-12T00:28:39.216143+0000","last_unstale":"2024-09-12T01:33:59.638101+0000","last_undegraded":"2024-09-12T01:33:59.638101+0000","last_fullsized":"2024-09-12T01:33:59.638101+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:29.237838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"263'119","reported_seq":632,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:42.721881+0000","last_change":"2024-09-12T00:28:41.232566+0000","last_active":"2024-09-12T01:36:42.721881+0000","last_peered":"2024-09-12T01:36:42.721881+0000","last_clean":"2024-09-12T01:36:42.721881+0000","last_became_active":"2024-09-12T00:28:41.232114+0000","last_became_peered":"2024-09-12T00:28:41.232114+0000","last_unstale":"2024-09-12T01:36:42.721881+0000","last_undegraded":"2024-09-12T01:36:42.721881+0000","last_fullsized":"2024-09-12T01:36:42.721881+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:39.890316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":141,"num_write":283,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"263'346","reported_seq":1045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.019124+0000","last_change":"2024-09-12T00:29:04.292672+0000","last_active":"2024-09-12T01:37:46.019124+0000","last_peered":"2024-09-12T01:37:46.019124+0000","last_clean":"2024-09-12T01:37:46.019124+0000","last_became_active":"2024-09-12T00:29:04.292302+0000","last_became_peered":"2024-09-12T00:29:04.292302+0000","last_unstale":"2024-09-12T01:37:46.019124+0000","last_undegraded":"2024-09-12T01:37:46.019124+0000","last_fullsized":"2024-09-12T01:37:46.019124+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:30.169396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1719,"num_read_kb":1484,"num_write":537,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"263'386","reported_seq":1163,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.715162+0000","last_change":"2024-09-12T00:28:31.208025+0000","last_active":"2024-09-12T01:38:01.715162+0000","last_peered":"2024-09-12T01:38:01.715162+0000","last_clean":"2024-09-12T01:38:01.715162+0000","last_became_active":"2024-09-12T00:28:31.207765+0000","last_became_peered":"2024-09-12T00:28:31.207765+0000","last_unstale":"2024-09-12T01:38:01.715162+0000","last_undegraded":"2024-09-12T01:38:01.715162+0000","last_fullsized":"2024-09-12T01:38:01.715162+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:36.097785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2529502,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":736,"num_read_kb":9284,"num_write":1355,"num_write_kb":41598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:54.637512+0000","last_change":"2024-09-12T00:28:35.212549+0000","last_active":"2024-09-12T01:33:54.637512+0000","last_peered":"2024-09-12T01:33:54.637512+0000","last_clean":"2024-09-12T01:33:54.637512+0000","last_became_active":"2024-09-12T00:28:35.212243+0000","last_became_peered":"2024-09-12T00:28:35.212243+0000","last_unstale":"2024-09-12T01:33:54.637512+0000","last_undegraded":"2024-09-12T01:33:54.637512+0000","last_fullsized":"2024-09-12T01:33:54.637512+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:02.038789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"263'57","reported_seq":565,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.783705+0000","last_change":"2024-09-12T00:28:37.220699+0000","last_active":"2024-09-12T01:33:56.783705+0000","last_peered":"2024-09-12T01:33:56.783705+0000","last_clean":"2024-09-12T01:33:56.783705+0000","last_became_active":"2024-09-12T00:28:37.219799+0000","last_became_peered":"2024-09-12T00:28:37.219799+0000","last_unstale":"2024-09-12T01:33:56.783705+0000","last_undegraded":"2024-09-12T01:33:56.783705+0000","last_fullsized":"2024-09-12T01:33:56.783705+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:52.584996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":42,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:01.719361+0000","last_change":"2024-09-12T00:28:39.219540+0000","last_active":"2024-09-12T01:34:01.719361+0000","last_peered":"2024-09-12T01:34:01.719361+0000","last_clean":"2024-09-12T01:34:01.719361+0000","last_became_active":"2024-09-12T00:28:39.219209+0000","last_became_peered":"2024-09-12T00:28:39.219209+0000","last_unstale":"2024-09-12T01:34:01.719361+0000","last_undegraded":"2024-09-12T01:34:01.719361+0000","last_fullsized":"2024-09-12T01:34:01.719361+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:53.327778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"263'211","reported_seq":739,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:41.517803+0000","last_change":"2024-09-12T00:28:41.226184+0000","last_active":"2024-09-12T01:36:41.517803+0000","last_peered":"2024-09-12T01:36:41.517803+0000","last_clean":"2024-09-12T01:36:41.517803+0000","last_became_active":"2024-09-12T00:28:41.225673+0000","last_became_peered":"2024-09-12T00:28:41.225673+0000","last_unstale":"2024-09-12T01:36:41.517803+0000","last_undegraded":"2024-09-12T01:36:41.517803+0000","last_fullsized":"2024-09-12T01:36:41.517803+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:16.037270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":332,"num_read_kb":318,"num_write":482,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"263'71","reported_seq":693,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:54.637476+0000","last_change":"2024-09-12T00:28:33.214078+0000","last_active":"2024-09-12T01:33:54.637476+0000","last_peered":"2024-09-12T01:33:54.637476+0000","last_clean":"2024-09-12T01:33:54.637476+0000","last_became_active":"2024-09-12T00:28:33.213777+0000","last_became_peered":"2024-09-12T00:28:33.213777+0000","last_unstale":"2024-09-12T01:33:54.637476+0000","last_undegraded":"2024-09-12T01:33:54.637476+0000","last_fullsized":"2024-09-12T01:33:54.637476+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:02.647251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":365,"num_read_kb":325,"num_write":89,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"263'341","reported_seq":968,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.731971+0000","last_change":"2024-09-12T00:28:31.214433+0000","last_active":"2024-09-12T01:38:01.731971+0000","last_peered":"2024-09-12T01:38:01.731971+0000","last_clean":"2024-09-12T01:38:01.731971+0000","last_became_active":"2024-09-12T00:28:31.213567+0000","last_became_peered":"2024-09-12T00:28:31.213567+0000","last_unstale":"2024-09-12T01:38:01.731971+0000","last_undegraded":"2024-09-12T01:38:01.731971+0000","last_fullsized":"2024-09-12T01:38:01.731971+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:37.746979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262191,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":463,"num_read_kb":31334,"num_write":999,"num_write_kb":46181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.718581+0000","last_change":"2024-09-12T00:28:35.210262+0000","last_active":"2024-09-12T01:33:56.718581+0000","last_peered":"2024-09-12T01:33:56.718581+0000","last_clean":"2024-09-12T01:33:56.718581+0000","last_became_active":"2024-09-12T00:28:35.210000+0000","last_became_peered":"2024-09-12T00:28:35.210000+0000","last_unstale":"2024-09-12T01:33:56.718581+0000","last_undegraded":"2024-09-12T01:33:56.718581+0000","last_fullsized":"2024-09-12T01:33:56.718581+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:21.147847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"263'335","reported_seq":937,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.318801+0000","last_change":"2024-09-12T00:28:37.222936+0000","last_active":"2024-09-12T01:38:01.318801+0000","last_peered":"2024-09-12T01:38:01.318801+0000","last_clean":"2024-09-12T01:38:01.318801+0000","last_became_active":"2024-09-12T00:28:37.222678+0000","last_became_peered":"2024-09-12T00:28:37.222678+0000","last_unstale":"2024-09-12T01:38:01.318801+0000","last_undegraded":"2024-09-12T01:38:01.318801+0000","last_fullsized":"2024-09-12T01:38:01.318801+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:29.474781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45149,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":551,"num_read_kb":1230,"num_write":438,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:01.534928+0000","last_change":"2024-09-12T00:28:39.216508+0000","last_active":"2024-09-12T01:34:01.534928+0000","last_peered":"2024-09-12T01:34:01.534928+0000","last_clean":"2024-09-12T01:34:01.534928+0000","last_became_active":"2024-09-12T00:28:39.216200+0000","last_became_peered":"2024-09-12T00:28:39.216200+0000","last_unstale":"2024-09-12T01:34:01.534928+0000","last_undegraded":"2024-09-12T01:34:01.534928+0000","last_fullsized":"2024-09-12T01:34:01.534928+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:22.629426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"263'112","reported_seq":626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:42.778426+0000","last_change":"2024-09-12T00:28:41.232852+0000","last_active":"2024-09-12T01:33:42.778426+0000","last_peered":"2024-09-12T01:33:42.778426+0000","last_clean":"2024-09-12T01:33:42.778426+0000","last_became_active":"2024-09-12T00:28:41.232381+0000","last_became_peered":"2024-09-12T00:28:41.232381+0000","last_unstale":"2024-09-12T01:33:42.778426+0000","last_undegraded":"2024-09-12T01:33:42.778426+0000","last_fullsized":"2024-09-12T01:33:42.778426+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:50.533536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":176,"num_read_kb":166,"num_write":281,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"263'153","reported_seq":745,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:54.637443+0000","last_change":"2024-09-12T00:28:33.211984+0000","last_active":"2024-09-12T01:33:54.637443+0000","last_peered":"2024-09-12T01:33:54.637443+0000","last_clean":"2024-09-12T01:33:54.637443+0000","last_became_active":"2024-09-12T00:28:33.211165+0000","last_became_peered":"2024-09-12T00:28:33.211165+0000","last_unstale":"2024-09-12T01:33:54.637443+0000","last_undegraded":"2024-09-12T01:33:54.637443+0000","last_fullsized":"2024-09-12T01:33:54.637443+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:15.409950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":668,"num_read_kb":545,"num_write":223,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"263'332","reported_seq":961,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.766693+0000","last_change":"2024-09-12T00:28:31.214222+0000","last_active":"2024-09-12T01:38:01.766693+0000","last_peered":"2024-09-12T01:38:01.766693+0000","last_clean":"2024-09-12T01:38:01.766693+0000","last_became_active":"2024-09-12T00:28:31.213971+0000","last_became_peered":"2024-09-12T00:28:31.213971+0000","last_unstale":"2024-09-12T01:38:01.766693+0000","last_undegraded":"2024-09-12T01:38:01.766693+0000","last_fullsized":"2024-09-12T01:38:01.766693+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:34.097978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340133,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":428,"num_read_kb":61436,"num_write":986,"num_write_kb":69756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.534222+0000","last_change":"2024-09-12T00:28:35.210349+0000","last_active":"2024-09-12T01:33:56.534222+0000","last_peered":"2024-09-12T01:33:56.534222+0000","last_clean":"2024-09-12T01:33:56.534222+0000","last_became_active":"2024-09-12T00:28:35.210060+0000","last_became_peered":"2024-09-12T00:28:35.210060+0000","last_unstale":"2024-09-12T01:33:56.534222+0000","last_undegraded":"2024-09-12T01:33:56.534222+0000","last_fullsized":"2024-09-12T01:33:56.534222+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:54.262760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"263'297","reported_seq":871,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.176723+0000","last_change":"2024-09-12T00:28:37.221776+0000","last_active":"2024-09-12T01:38:01.176723+0000","last_peered":"2024-09-12T01:38:01.176723+0000","last_clean":"2024-09-12T01:38:01.176723+0000","last_became_active":"2024-09-12T00:28:37.221491+0000","last_became_peered":"2024-09-12T00:28:37.221491+0000","last_unstale":"2024-09-12T01:38:01.176723+0000","last_undegraded":"2024-09-12T01:38:01.176723+0000","last_fullsized":"2024-09-12T01:38:01.176723+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:53.230082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49002,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":484,"num_read_kb":1163,"num_write":396,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:01.784353+0000","last_change":"2024-09-12T00:28:39.219270+0000","last_active":"2024-09-12T01:34:01.784353+0000","last_peered":"2024-09-12T01:34:01.784353+0000","last_clean":"2024-09-12T01:34:01.784353+0000","last_became_active":"2024-09-12T00:28:39.219004+0000","last_became_peered":"2024-09-12T00:28:39.219004+0000","last_unstale":"2024-09-12T01:34:01.784353+0000","last_undegraded":"2024-09-12T01:34:01.784353+0000","last_fullsized":"2024-09-12T01:34:01.784353+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:04.158965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"263'478","reported_seq":1262,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:42.590207+0000","last_change":"2024-09-12T00:28:33.216889+0000","last_active":"2024-09-12T01:36:42.590207+0000","last_peered":"2024-09-12T01:36:42.590207+0000","last_clean":"2024-09-12T01:36:42.590207+0000","last_became_active":"2024-09-12T00:28:33.216610+0000","last_became_peered":"2024-09-12T00:28:33.216610+0000","last_unstale":"2024-09-12T01:36:42.590207+0000","last_undegraded":"2024-09-12T01:36:42.590207+0000","last_fullsized":"2024-09-12T01:36:42.590207+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:20.599221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2349,"num_read_kb":2016,"num_write":868,"num_write_kb":562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"263'338","reported_seq":969,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.781155+0000","last_change":"2024-09-12T00:28:31.208064+0000","last_active":"2024-09-12T01:38:01.781155+0000","last_peered":"2024-09-12T01:38:01.781155+0000","last_clean":"2024-09-12T01:38:01.781155+0000","last_became_active":"2024-09-12T00:28:31.207770+0000","last_became_peered":"2024-09-12T00:28:31.207770+0000","last_unstale":"2024-09-12T01:38:01.781155+0000","last_undegraded":"2024-09-12T01:38:01.781155+0000","last_fullsized":"2024-09-12T01:38:01.781155+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:48.014014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":467,"num_read_kb":17286,"num_write":965,"num_write_kb":20034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:46.790016+0000","last_change":"2024-09-12T00:28:35.209110+0000","last_active":"2024-09-12T01:34:46.790016+0000","last_peered":"2024-09-12T01:34:46.790016+0000","last_clean":"2024-09-12T01:34:46.790016+0000","last_became_active":"2024-09-12T00:28:35.208868+0000","last_became_peered":"2024-09-12T00:28:35.208868+0000","last_unstale":"2024-09-12T01:34:46.790016+0000","last_undegraded":"2024-09-12T01:34:46.790016+0000","last_fullsized":"2024-09-12T01:34:46.790016+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:58.443488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"263'529","reported_seq":1181,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.115873+0000","last_change":"2024-09-12T00:28:37.211376+0000","last_active":"2024-09-12T01:38:01.115873+0000","last_peered":"2024-09-12T01:38:01.115873+0000","last_clean":"2024-09-12T01:38:01.115873+0000","last_became_active":"2024-09-12T00:28:37.210514+0000","last_became_peered":"2024-09-12T00:28:37.210514+0000","last_unstale":"2024-09-12T01:38:01.115873+0000","last_undegraded":"2024-09-12T01:38:01.115873+0000","last_fullsized":"2024-09-12T01:38:01.115873+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":500,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:55.293515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94945,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":919,"num_read_kb":2214,"num_write":790,"num_write_kb":678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:42.778441+0000","last_change":"2024-09-12T00:28:39.220157+0000","last_active":"2024-09-12T01:33:42.778441+0000","last_peered":"2024-09-12T01:33:42.778441+0000","last_clean":"2024-09-12T01:33:42.778441+0000","last_became_active":"2024-09-12T00:28:39.219808+0000","last_became_peered":"2024-09-12T00:28:39.219808+0000","last_unstale":"2024-09-12T01:33:42.778441+0000","last_undegraded":"2024-09-12T01:33:42.778441+0000","last_fullsized":"2024-09-12T01:33:42.778441+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:25.859464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"263'226","reported_seq":794,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:42.584721+0000","last_change":"2024-09-12T00:28:41.257924+0000","last_active":"2024-09-12T01:36:42.584721+0000","last_peered":"2024-09-12T01:36:42.584721+0000","last_clean":"2024-09-12T01:36:42.584721+0000","last_became_active":"2024-09-12T00:28:41.257639+0000","last_became_peered":"2024-09-12T00:28:41.257639+0000","last_unstale":"2024-09-12T01:36:42.584721+0000","last_undegraded":"2024-09-12T01:36:42.584721+0000","last_fullsized":"2024-09-12T01:36:42.584721+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:36.066637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":674,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":491,"num_read_kb":439,"num_write":521,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"263'158","reported_seq":749,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:46.790004+0000","last_change":"2024-09-12T00:28:33.215368+0000","last_active":"2024-09-12T01:34:46.790004+0000","last_peered":"2024-09-12T01:34:46.790004+0000","last_clean":"2024-09-12T01:34:46.790004+0000","last_became_active":"2024-09-12T00:28:33.215105+0000","last_became_peered":"2024-09-12T00:28:33.215105+0000","last_unstale":"2024-09-12T01:34:46.790004+0000","last_undegraded":"2024-09-12T01:34:46.790004+0000","last_fullsized":"2024-09-12T01:34:46.790004+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:01.247332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":692,"num_read_kb":572,"num_write":247,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"263'389","reported_seq":1044,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.732275+0000","last_change":"2024-09-12T00:28:31.206881+0000","last_active":"2024-09-12T01:38:01.732275+0000","last_peered":"2024-09-12T01:38:01.732275+0000","last_clean":"2024-09-12T01:38:01.732275+0000","last_became_active":"2024-09-12T00:28:31.206562+0000","last_became_peered":"2024-09-12T00:28:31.206562+0000","last_unstale":"2024-09-12T01:38:01.732275+0000","last_undegraded":"2024-09-12T01:38:01.732275+0000","last_fullsized":"2024-09-12T01:38:01.732275+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:30.337503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395844,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":545,"num_read_kb":3743,"num_write":1252,"num_write_kb":48925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.545536+0000","last_change":"2024-09-12T00:28:35.210344+0000","last_active":"2024-09-12T01:35:16.545536+0000","last_peered":"2024-09-12T01:35:16.545536+0000","last_clean":"2024-09-12T01:35:16.545536+0000","last_became_active":"2024-09-12T00:28:35.210046+0000","last_became_peered":"2024-09-12T00:28:35.210046+0000","last_unstale":"2024-09-12T01:35:16.545536+0000","last_undegraded":"2024-09-12T01:35:16.545536+0000","last_fullsized":"2024-09-12T01:35:16.545536+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:03.841464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"263'330","reported_seq":923,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.210125+0000","last_change":"2024-09-12T00:28:37.212617+0000","last_active":"2024-09-12T01:38:01.210125+0000","last_peered":"2024-09-12T01:38:01.210125+0000","last_clean":"2024-09-12T01:38:01.210125+0000","last_became_active":"2024-09-12T00:28:37.212236+0000","last_became_peered":"2024-09-12T00:28:37.212236+0000","last_unstale":"2024-09-12T01:38:01.210125+0000","last_undegraded":"2024-09-12T01:38:01.210125+0000","last_fullsized":"2024-09-12T01:38:01.210125+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:16.662629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49414,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":546,"num_read_kb":1160,"num_write":454,"num_write_kb":329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:41.931728+0000","last_change":"2024-09-12T00:28:39.218198+0000","last_active":"2024-09-12T01:33:41.931728+0000","last_peered":"2024-09-12T01:33:41.931728+0000","last_clean":"2024-09-12T01:33:41.931728+0000","last_became_active":"2024-09-12T00:28:39.217947+0000","last_became_peered":"2024-09-12T00:28:39.217947+0000","last_unstale":"2024-09-12T01:33:41.931728+0000","last_undegraded":"2024-09-12T01:33:41.931728+0000","last_fullsized":"2024-09-12T01:33:41.931728+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:45.277309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"263'220","reported_seq":1091,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.567227+0000","last_change":"2024-09-12T00:28:41.233293+0000","last_active":"2024-09-12T01:36:38.567227+0000","last_peered":"2024-09-12T01:36:38.567227+0000","last_clean":"2024-09-12T01:36:38.567227+0000","last_became_active":"2024-09-12T00:28:41.232347+0000","last_became_peered":"2024-09-12T00:28:41.232347+0000","last_unstale":"2024-09-12T01:36:38.567227+0000","last_undegraded":"2024-09-12T01:36:38.567227+0000","last_fullsized":"2024-09-12T01:36:38.567227+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:07.441315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":645,"num_read_kb":635,"num_write":602,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"263'72","reported_seq":627,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:52.550530+0000","last_change":"2024-09-12T00:28:33.208225+0000","last_active":"2024-09-12T01:33:52.550530+0000","last_peered":"2024-09-12T01:33:52.550530+0000","last_clean":"2024-09-12T01:33:52.550530+0000","last_became_active":"2024-09-12T00:28:33.207968+0000","last_became_peered":"2024-09-12T00:28:33.207968+0000","last_unstale":"2024-09-12T01:33:52.550530+0000","last_undegraded":"2024-09-12T01:33:52.550530+0000","last_fullsized":"2024-09-12T01:33:52.550530+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:44.313634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":308,"num_read_kb":254,"num_write":109,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"263'295","reported_seq":921,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.717269+0000","last_change":"2024-09-12T00:28:31.195341+0000","last_active":"2024-09-12T01:38:01.717269+0000","last_peered":"2024-09-12T01:38:01.717269+0000","last_clean":"2024-09-12T01:38:01.717269+0000","last_became_active":"2024-09-12T00:28:31.195038+0000","last_became_peered":"2024-09-12T00:28:31.195038+0000","last_unstale":"2024-09-12T01:38:01.717269+0000","last_undegraded":"2024-09-12T01:38:01.717269+0000","last_fullsized":"2024-09-12T01:38:01.717269+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:10.944170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262176,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":426,"num_read_kb":13574,"num_write":965,"num_write_kb":34116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:36.531621+0000","last_change":"2024-09-12T00:28:35.215894+0000","last_active":"2024-09-12T01:33:36.531621+0000","last_peered":"2024-09-12T01:33:36.531621+0000","last_clean":"2024-09-12T01:33:36.531621+0000","last_became_active":"2024-09-12T00:28:35.215576+0000","last_became_peered":"2024-09-12T00:28:35.215576+0000","last_unstale":"2024-09-12T01:33:36.531621+0000","last_undegraded":"2024-09-12T01:33:36.531621+0000","last_fullsized":"2024-09-12T01:33:36.531621+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:24.130329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"263'288","reported_seq":884,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.395002+0000","last_change":"2024-09-12T00:28:37.424316+0000","last_active":"2024-09-12T01:38:00.395002+0000","last_peered":"2024-09-12T01:38:00.395002+0000","last_clean":"2024-09-12T01:38:00.395002+0000","last_became_active":"2024-09-12T00:28:37.423835+0000","last_became_peered":"2024-09-12T00:28:37.423835+0000","last_unstale":"2024-09-12T01:38:00.395002+0000","last_undegraded":"2024-09-12T01:38:00.395002+0000","last_fullsized":"2024-09-12T01:38:00.395002+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:16.822185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48887,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":486,"num_read_kb":1104,"num_write":386,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:46.941196+0000","last_change":"2024-09-12T00:28:39.219814+0000","last_active":"2024-09-12T01:34:46.941196+0000","last_peered":"2024-09-12T01:34:46.941196+0000","last_clean":"2024-09-12T01:34:46.941196+0000","last_became_active":"2024-09-12T00:28:39.219541+0000","last_became_peered":"2024-09-12T00:28:39.219541+0000","last_unstale":"2024-09-12T01:34:46.941196+0000","last_undegraded":"2024-09-12T01:34:46.941196+0000","last_fullsized":"2024-09-12T01:34:46.941196+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:16.760034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"263'114","reported_seq":599,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:47.141542+0000","last_change":"2024-09-12T00:28:41.232661+0000","last_active":"2024-09-12T01:37:47.141542+0000","last_peered":"2024-09-12T01:37:47.141542+0000","last_clean":"2024-09-12T01:37:47.141542+0000","last_became_active":"2024-09-12T00:28:41.232305+0000","last_became_peered":"2024-09-12T00:28:41.232305+0000","last_unstale":"2024-09-12T01:37:47.141542+0000","last_undegraded":"2024-09-12T01:37:47.141542+0000","last_fullsized":"2024-09-12T01:37:47.141542+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:16.813541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":90,"num_read_kb":88,"num_write":260,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"263'145","reported_seq":711,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:36.625552+0000","last_change":"2024-09-12T00:28:33.214222+0000","last_active":"2024-09-12T01:33:36.625552+0000","last_peered":"2024-09-12T01:33:36.625552+0000","last_clean":"2024-09-12T01:33:36.625552+0000","last_became_active":"2024-09-12T00:28:33.213905+0000","last_became_peered":"2024-09-12T00:28:33.213905+0000","last_unstale":"2024-09-12T01:33:36.625552+0000","last_undegraded":"2024-09-12T01:33:36.625552+0000","last_fullsized":"2024-09-12T01:33:36.625552+0000","mapping_epoch":27,"log_start":"260'100","ondisk_log_start":"260'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:53.032156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":580,"num_read_kb":470,"num_write":232,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"263'309","reported_seq":1003,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.746967+0000","last_change":"2024-09-12T00:28:31.203713+0000","last_active":"2024-09-12T01:38:01.746967+0000","last_peered":"2024-09-12T01:38:01.746967+0000","last_clean":"2024-09-12T01:38:01.746967+0000","last_became_active":"2024-09-12T00:28:31.203417+0000","last_became_peered":"2024-09-12T00:28:31.203417+0000","last_unstale":"2024-09-12T01:38:01.746967+0000","last_undegraded":"2024-09-12T01:38:01.746967+0000","last_fullsized":"2024-09-12T01:38:01.746967+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:22.904080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262193,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":643,"num_read_kb":683,"num_write":1258,"num_write_kb":6456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:36.931007+0000","last_change":"2024-09-12T00:28:35.208282+0000","last_active":"2024-09-12T01:33:36.931007+0000","last_peered":"2024-09-12T01:33:36.931007+0000","last_clean":"2024-09-12T01:33:36.931007+0000","last_became_active":"2024-09-12T00:28:35.207992+0000","last_became_peered":"2024-09-12T00:28:35.207992+0000","last_unstale":"2024-09-12T01:33:36.931007+0000","last_undegraded":"2024-09-12T01:33:36.931007+0000","last_fullsized":"2024-09-12T01:33:36.931007+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:40:54.373200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"263'105","reported_seq":647,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:51.541995+0000","last_change":"2024-09-12T00:28:37.424144+0000","last_active":"2024-09-12T01:34:51.541995+0000","last_peered":"2024-09-12T01:34:51.541995+0000","last_clean":"2024-09-12T01:34:51.541995+0000","last_became_active":"2024-09-12T00:28:37.423765+0000","last_became_peered":"2024-09-12T00:28:37.423765+0000","last_unstale":"2024-09-12T01:34:51.541995+0000","last_undegraded":"2024-09-12T01:34:51.541995+0000","last_fullsized":"2024-09-12T01:34:51.541995+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:37.831318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":155,"num_read_kb":148,"num_write":156,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"263'761","reported_seq":2428,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.051454+0000","last_change":"2024-09-12T00:28:39.217233+0000","last_active":"2024-09-12T01:38:00.051454+0000","last_peered":"2024-09-12T01:38:00.051454+0000","last_clean":"2024-09-12T01:38:00.051454+0000","last_became_active":"2024-09-12T00:28:39.216704+0000","last_became_peered":"2024-09-12T00:28:39.216704+0000","last_unstale":"2024-09-12T01:38:00.051454+0000","last_undegraded":"2024-09-12T01:38:00.051454+0000","last_fullsized":"2024-09-12T01:38:00.051454+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:06.941324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"263'157","reported_seq":655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:41.582118+0000","last_change":"2024-09-12T00:28:41.228417+0000","last_active":"2024-09-12T01:36:41.582118+0000","last_peered":"2024-09-12T01:36:41.582118+0000","last_clean":"2024-09-12T01:36:41.582118+0000","last_became_active":"2024-09-12T00:28:41.227892+0000","last_became_peered":"2024-09-12T00:28:41.227892+0000","last_unstale":"2024-09-12T01:36:41.582118+0000","last_undegraded":"2024-09-12T01:36:41.582118+0000","last_fullsized":"2024-09-12T01:36:41.582118+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:55.234284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":160,"num_read_kb":153,"num_write":389,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"263'138","reported_seq":717,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:36.531599+0000","last_change":"2024-09-12T00:28:33.205366+0000","last_active":"2024-09-12T01:33:36.531599+0000","last_peered":"2024-09-12T01:33:36.531599+0000","last_clean":"2024-09-12T01:33:36.531599+0000","last_became_active":"2024-09-12T00:28:33.204722+0000","last_became_peered":"2024-09-12T00:28:33.204722+0000","last_unstale":"2024-09-12T01:33:36.531599+0000","last_undegraded":"2024-09-12T01:33:36.531599+0000","last_fullsized":"2024-09-12T01:33:36.531599+0000","mapping_epoch":27,"log_start":"260'100","ondisk_log_start":"260'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:40.757422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":575,"num_read_kb":467,"num_write":204,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"263'325","reported_seq":1043,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.775147+0000","last_change":"2024-09-12T00:28:31.214127+0000","last_active":"2024-09-12T01:38:01.775147+0000","last_peered":"2024-09-12T01:38:01.775147+0000","last_clean":"2024-09-12T01:38:01.775147+0000","last_became_active":"2024-09-12T00:28:31.212597+0000","last_became_peered":"2024-09-12T00:28:31.212597+0000","last_unstale":"2024-09-12T01:38:01.775147+0000","last_undegraded":"2024-09-12T01:38:01.775147+0000","last_fullsized":"2024-09-12T01:38:01.775147+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:45.696465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":273370,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":704,"num_read_kb":2179,"num_write":1113,"num_write_kb":612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:36.715250+0000","last_change":"2024-09-12T00:28:35.210989+0000","last_active":"2024-09-12T01:33:36.715250+0000","last_peered":"2024-09-12T01:33:36.715250+0000","last_clean":"2024-09-12T01:33:36.715250+0000","last_became_active":"2024-09-12T00:28:35.210710+0000","last_became_peered":"2024-09-12T00:28:35.210710+0000","last_unstale":"2024-09-12T01:33:36.715250+0000","last_undegraded":"2024-09-12T01:33:36.715250+0000","last_fullsized":"2024-09-12T01:33:36.715250+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:33.211433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"263'387","reported_seq":1004,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.742223+0000","last_change":"2024-09-12T00:28:37.210612+0000","last_active":"2024-09-12T01:38:00.742223+0000","last_peered":"2024-09-12T01:38:00.742223+0000","last_clean":"2024-09-12T01:38:00.742223+0000","last_became_active":"2024-09-12T00:28:37.210317+0000","last_became_peered":"2024-09-12T00:28:37.210317+0000","last_unstale":"2024-09-12T01:38:00.742223+0000","last_undegraded":"2024-09-12T01:38:00.742223+0000","last_fullsized":"2024-09-12T01:38:00.742223+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:31.821476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56512,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":649,"num_read_kb":1465,"num_write":528,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.783725+0000","last_change":"2024-09-12T00:28:39.218794+0000","last_active":"2024-09-12T01:33:56.783725+0000","last_peered":"2024-09-12T01:33:56.783725+0000","last_clean":"2024-09-12T01:33:56.783725+0000","last_became_active":"2024-09-12T00:28:39.218026+0000","last_became_peered":"2024-09-12T00:28:39.218026+0000","last_unstale":"2024-09-12T01:33:56.783725+0000","last_undegraded":"2024-09-12T01:33:56.783725+0000","last_fullsized":"2024-09-12T01:33:56.783725+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:18.115521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"263'133","reported_seq":629,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:21.741327+0000","last_change":"2024-09-12T00:28:41.231966+0000","last_active":"2024-09-12T01:36:21.741327+0000","last_peered":"2024-09-12T01:36:21.741327+0000","last_clean":"2024-09-12T01:36:21.741327+0000","last_became_active":"2024-09-12T00:28:41.231611+0000","last_became_peered":"2024-09-12T00:28:41.231611+0000","last_unstale":"2024-09-12T01:36:21.741327+0000","last_undegraded":"2024-09-12T01:36:21.741327+0000","last_fullsized":"2024-09-12T01:36:21.741327+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:05.050533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":625,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":135,"num_read_kb":130,"num_write":322,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"263'92","reported_seq":673,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:36.531552+0000","last_change":"2024-09-12T00:28:33.204989+0000","last_active":"2024-09-12T01:33:36.531552+0000","last_peered":"2024-09-12T01:33:36.531552+0000","last_clean":"2024-09-12T01:33:36.531552+0000","last_became_active":"2024-09-12T00:28:33.204653+0000","last_became_peered":"2024-09-12T00:28:33.204653+0000","last_unstale":"2024-09-12T01:33:36.531552+0000","last_undegraded":"2024-09-12T01:33:36.531552+0000","last_fullsized":"2024-09-12T01:33:36.531552+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:22.275865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":393,"num_read_kb":329,"num_write":145,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"263'429","reported_seq":1121,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.757405+0000","last_change":"2024-09-12T00:28:31.214035+0000","last_active":"2024-09-12T01:38:01.757405+0000","last_peered":"2024-09-12T01:38:01.757405+0000","last_clean":"2024-09-12T01:38:01.757405+0000","last_became_active":"2024-09-12T00:28:31.212752+0000","last_became_peered":"2024-09-12T00:28:31.212752+0000","last_unstale":"2024-09-12T01:38:01.757405+0000","last_undegraded":"2024-09-12T01:38:01.757405+0000","last_fullsized":"2024-09-12T01:38:01.757405+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":400,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:33.447125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":804,"num_read_kb":13300,"num_write":1374,"num_write_kb":24353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:37.777506+0000","last_change":"2024-09-12T00:28:35.208702+0000","last_active":"2024-09-12T01:33:37.777506+0000","last_peered":"2024-09-12T01:33:37.777506+0000","last_clean":"2024-09-12T01:33:37.777506+0000","last_became_active":"2024-09-12T00:28:35.207869+0000","last_became_peered":"2024-09-12T00:28:35.207869+0000","last_unstale":"2024-09-12T01:33:37.777506+0000","last_undegraded":"2024-09-12T01:33:37.777506+0000","last_fullsized":"2024-09-12T01:33:37.777506+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:39.750226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"263'310","reported_seq":893,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.823008+0000","last_change":"2024-09-12T00:28:37.221622+0000","last_active":"2024-09-12T01:38:00.823008+0000","last_peered":"2024-09-12T01:38:00.823008+0000","last_clean":"2024-09-12T01:38:00.823008+0000","last_became_active":"2024-09-12T00:28:37.221289+0000","last_became_peered":"2024-09-12T00:28:37.221289+0000","last_unstale":"2024-09-12T01:38:00.823008+0000","last_undegraded":"2024-09-12T01:38:00.823008+0000","last_fullsized":"2024-09-12T01:38:00.823008+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:13.295191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57095,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":538,"num_read_kb":1320,"num_write":444,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:11.536147+0000","last_change":"2024-09-12T00:28:39.217261+0000","last_active":"2024-09-12T01:34:11.536147+0000","last_peered":"2024-09-12T01:34:11.536147+0000","last_clean":"2024-09-12T01:34:11.536147+0000","last_became_active":"2024-09-12T00:28:39.216943+0000","last_became_peered":"2024-09-12T00:28:39.216943+0000","last_unstale":"2024-09-12T01:34:11.536147+0000","last_undegraded":"2024-09-12T01:34:11.536147+0000","last_fullsized":"2024-09-12T01:34:11.536147+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:27.903826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"263'138","reported_seq":675,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:20.328319+0000","last_change":"2024-09-12T00:28:41.258056+0000","last_active":"2024-09-12T01:35:20.328319+0000","last_peered":"2024-09-12T01:35:20.328319+0000","last_clean":"2024-09-12T01:35:20.328319+0000","last_became_active":"2024-09-12T00:28:41.257796+0000","last_became_peered":"2024-09-12T00:28:41.257796+0000","last_unstale":"2024-09-12T01:35:20.328319+0000","last_undegraded":"2024-09-12T01:35:20.328319+0000","last_fullsized":"2024-09-12T01:35:20.328319+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:21.378439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":982,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":234,"num_read_kb":212,"num_write":368,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"263'73","reported_seq":628,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:04.638853+0000","last_change":"2024-09-12T00:28:33.206104+0000","last_active":"2024-09-12T01:34:04.638853+0000","last_peered":"2024-09-12T01:34:04.638853+0000","last_clean":"2024-09-12T01:34:04.638853+0000","last_became_active":"2024-09-12T00:28:33.205832+0000","last_became_peered":"2024-09-12T00:28:33.205832+0000","last_unstale":"2024-09-12T01:34:04.638853+0000","last_undegraded":"2024-09-12T01:34:04.638853+0000","last_fullsized":"2024-09-12T01:34:04.638853+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:47.756933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":322,"num_read_kb":264,"num_write":102,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"263'337","reported_seq":972,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.770263+0000","last_change":"2024-09-12T00:28:31.200496+0000","last_active":"2024-09-12T01:38:01.770263+0000","last_peered":"2024-09-12T01:38:01.770263+0000","last_clean":"2024-09-12T01:38:01.770263+0000","last_became_active":"2024-09-12T00:28:31.200234+0000","last_became_peered":"2024-09-12T00:28:31.200234+0000","last_unstale":"2024-09-12T01:38:01.770263+0000","last_undegraded":"2024-09-12T01:38:01.770263+0000","last_fullsized":"2024-09-12T01:38:01.770263+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:25.377262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262245,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":466,"num_read_kb":15822,"num_write":1094,"num_write_kb":25857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.533584+0000","last_change":"2024-09-12T00:28:35.206882+0000","last_active":"2024-09-12T01:33:51.533584+0000","last_peered":"2024-09-12T01:33:51.533584+0000","last_clean":"2024-09-12T01:33:51.533584+0000","last_became_active":"2024-09-12T00:28:35.206597+0000","last_became_peered":"2024-09-12T00:28:35.206597+0000","last_unstale":"2024-09-12T01:33:51.533584+0000","last_undegraded":"2024-09-12T01:33:51.533584+0000","last_fullsized":"2024-09-12T01:33:51.533584+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:07.120698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"263'280","reported_seq":849,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.287558+0000","last_change":"2024-09-12T00:28:37.220535+0000","last_active":"2024-09-12T01:38:00.287558+0000","last_peered":"2024-09-12T01:38:00.287558+0000","last_clean":"2024-09-12T01:38:00.287558+0000","last_became_active":"2024-09-12T00:28:37.219652+0000","last_became_peered":"2024-09-12T00:28:37.219652+0000","last_unstale":"2024-09-12T01:38:00.287558+0000","last_undegraded":"2024-09-12T01:38:00.287558+0000","last_fullsized":"2024-09-12T01:38:00.287558+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:35.052492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49715,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":473,"num_read_kb":1234,"num_write":394,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:41.532251+0000","last_change":"2024-09-12T00:28:39.218146+0000","last_active":"2024-09-12T01:33:41.532251+0000","last_peered":"2024-09-12T01:33:41.532251+0000","last_clean":"2024-09-12T01:33:41.532251+0000","last_became_active":"2024-09-12T00:28:39.217869+0000","last_became_peered":"2024-09-12T00:28:39.217869+0000","last_unstale":"2024-09-12T01:33:41.532251+0000","last_undegraded":"2024-09-12T01:33:41.532251+0000","last_fullsized":"2024-09-12T01:33:41.532251+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:50.890111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"263'190","reported_seq":1287,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.478652+0000","last_change":"2024-09-12T00:28:41.232727+0000","last_active":"2024-09-12T01:36:38.478652+0000","last_peered":"2024-09-12T01:36:38.478652+0000","last_clean":"2024-09-12T01:36:38.478652+0000","last_became_active":"2024-09-12T00:28:41.232040+0000","last_became_peered":"2024-09-12T00:28:41.232040+0000","last_unstale":"2024-09-12T01:36:38.478652+0000","last_undegraded":"2024-09-12T01:36:38.478652+0000","last_fullsized":"2024-09-12T01:36:38.478652+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:12.584298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":841,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":800,"num_read_kb":795,"num_write":450,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"263'254","reported_seq":913,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.533604+0000","last_change":"2024-09-12T00:28:33.209146+0000","last_active":"2024-09-12T01:33:51.533604+0000","last_peered":"2024-09-12T01:33:51.533604+0000","last_clean":"2024-09-12T01:33:51.533604+0000","last_became_active":"2024-09-12T00:28:33.208787+0000","last_became_peered":"2024-09-12T00:28:33.208787+0000","last_unstale":"2024-09-12T01:33:51.533604+0000","last_undegraded":"2024-09-12T01:33:51.533604+0000","last_fullsized":"2024-09-12T01:33:51.533604+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:39.287147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1164,"num_read_kb":956,"num_write":405,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"263'316","reported_seq":1064,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.727735+0000","last_change":"2024-09-12T00:29:04.275056+0000","last_active":"2024-09-12T01:38:01.727735+0000","last_peered":"2024-09-12T01:38:01.727735+0000","last_clean":"2024-09-12T01:38:01.727735+0000","last_became_active":"2024-09-12T00:29:04.274746+0000","last_became_peered":"2024-09-12T00:29:04.274746+0000","last_unstale":"2024-09-12T01:38:01.727735+0000","last_undegraded":"2024-09-12T01:38:01.727735+0000","last_fullsized":"2024-09-12T01:38:01.727735+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:44.084463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524334,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":565,"num_read_kb":52761,"num_write":1033,"num_write_kb":38285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"37'4","reported_seq":986,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:59.822617+0000","last_change":"2024-09-12T00:28:35.207612+0000","last_active":"2024-09-12T01:37:59.822617+0000","last_peered":"2024-09-12T01:37:59.822617+0000","last_clean":"2024-09-12T01:37:59.822617+0000","last_became_active":"2024-09-12T00:28:35.207332+0000","last_became_peered":"2024-09-12T00:28:35.207332+0000","last_unstale":"2024-09-12T01:37:59.822617+0000","last_undegraded":"2024-09-12T01:37:59.822617+0000","last_fullsized":"2024-09-12T01:37:59.822617+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:37.071411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"263'325","reported_seq":930,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.451609+0000","last_change":"2024-09-12T00:28:37.207659+0000","last_active":"2024-09-12T01:38:00.451609+0000","last_peered":"2024-09-12T01:38:00.451609+0000","last_clean":"2024-09-12T01:38:00.451609+0000","last_became_active":"2024-09-12T00:28:37.207373+0000","last_became_peered":"2024-09-12T00:28:37.207373+0000","last_unstale":"2024-09-12T01:38:00.451609+0000","last_undegraded":"2024-09-12T01:38:00.451609+0000","last_fullsized":"2024-09-12T01:38:00.451609+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:14.729544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45135,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":515,"num_read_kb":1089,"num_write":408,"num_write_kb":271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:41.781852+0000","last_change":"2024-09-12T00:28:39.217215+0000","last_active":"2024-09-12T01:33:41.781852+0000","last_peered":"2024-09-12T01:33:41.781852+0000","last_clean":"2024-09-12T01:33:41.781852+0000","last_became_active":"2024-09-12T00:28:39.215651+0000","last_became_peered":"2024-09-12T00:28:39.215651+0000","last_unstale":"2024-09-12T01:33:41.781852+0000","last_undegraded":"2024-09-12T01:33:41.781852+0000","last_fullsized":"2024-09-12T01:33:41.781852+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:18.517005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"263'132","reported_seq":629,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.017444+0000","last_change":"2024-09-12T00:28:41.227004+0000","last_active":"2024-09-12T01:37:46.017444+0000","last_peered":"2024-09-12T01:37:46.017444+0000","last_clean":"2024-09-12T01:37:46.017444+0000","last_became_active":"2024-09-12T00:28:41.226687+0000","last_became_peered":"2024-09-12T00:28:41.226687+0000","last_unstale":"2024-09-12T01:37:46.017444+0000","last_undegraded":"2024-09-12T01:37:46.017444+0000","last_fullsized":"2024-09-12T01:37:46.017444+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:17.799068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":132,"num_read_kb":117,"num_write":304,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"263'292","reported_seq":922,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.948057+0000","last_change":"2024-09-12T00:28:33.211180+0000","last_active":"2024-09-12T01:35:46.948057+0000","last_peered":"2024-09-12T01:35:46.948057+0000","last_clean":"2024-09-12T01:35:46.948057+0000","last_became_active":"2024-09-12T00:28:33.210635+0000","last_became_peered":"2024-09-12T00:28:33.210635+0000","last_unstale":"2024-09-12T01:35:46.948057+0000","last_undegraded":"2024-09-12T01:35:46.948057+0000","last_fullsized":"2024-09-12T01:35:46.948057+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:52.779854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1259,"num_read_kb":1011,"num_write":460,"num_write_kb":225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"263'332","reported_seq":952,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.749915+0000","last_change":"2024-09-12T00:28:31.207464+0000","last_active":"2024-09-12T01:38:01.749915+0000","last_peered":"2024-09-12T01:38:01.749915+0000","last_clean":"2024-09-12T01:38:01.749915+0000","last_became_active":"2024-09-12T00:28:31.206672+0000","last_became_peered":"2024-09-12T00:28:31.206672+0000","last_unstale":"2024-09-12T01:38:01.749915+0000","last_undegraded":"2024-09-12T01:38:01.749915+0000","last_fullsized":"2024-09-12T01:38:01.749915+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:16.072963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661307,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":464,"num_read_kb":11577,"num_write":1050,"num_write_kb":29091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"263'314","reported_seq":941,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.948041+0000","last_change":"2024-09-12T00:28:33.207374+0000","last_active":"2024-09-12T01:35:46.948041+0000","last_peered":"2024-09-12T01:35:46.948041+0000","last_clean":"2024-09-12T01:35:46.948041+0000","last_became_active":"2024-09-12T00:28:33.206512+0000","last_became_peered":"2024-09-12T00:28:33.206512+0000","last_unstale":"2024-09-12T01:35:46.948041+0000","last_undegraded":"2024-09-12T01:35:46.948041+0000","last_fullsized":"2024-09-12T01:35:46.948041+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:00.796082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1325,"num_read_kb":1067,"num_write":489,"num_write_kb":251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"263'327","reported_seq":966,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.707025+0000","last_change":"2024-09-12T00:29:04.272074+0000","last_active":"2024-09-12T01:38:01.707025+0000","last_peered":"2024-09-12T01:38:01.707025+0000","last_clean":"2024-09-12T01:38:01.707025+0000","last_became_active":"2024-09-12T00:29:04.271753+0000","last_became_peered":"2024-09-12T00:29:04.271753+0000","last_unstale":"2024-09-12T01:38:01.707025+0000","last_undegraded":"2024-09-12T01:38:01.707025+0000","last_fullsized":"2024-09-12T01:38:01.707025+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:42.475525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":504,"num_read_kb":1624,"num_write":1034,"num_write_kb":30525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"263'349","reported_seq":960,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:47.796128+0000","last_change":"2024-09-12T00:28:33.214934+0000","last_active":"2024-09-12T01:35:47.796128+0000","last_peered":"2024-09-12T01:35:47.796128+0000","last_clean":"2024-09-12T01:35:47.796128+0000","last_became_active":"2024-09-12T00:28:33.214679+0000","last_became_peered":"2024-09-12T00:28:33.214679+0000","last_unstale":"2024-09-12T01:35:47.796128+0000","last_undegraded":"2024-09-12T01:35:47.796128+0000","last_fullsized":"2024-09-12T01:35:47.796128+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:00.796082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1495,"num_read_kb":1194,"num_write":562,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"263'364","reported_seq":1031,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.783755+0000","last_change":"2024-09-12T00:28:31.209614+0000","last_active":"2024-09-12T01:38:01.783755+0000","last_peered":"2024-09-12T01:38:01.783755+0000","last_clean":"2024-09-12T01:38:01.783755+0000","last_became_active":"2024-09-12T00:28:31.209266+0000","last_became_peered":"2024-09-12T00:28:31.209266+0000","last_unstale":"2024-09-12T01:38:01.783755+0000","last_undegraded":"2024-09-12T01:38:01.783755+0000","last_fullsized":"2024-09-12T01:38:01.783755+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:17.128660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2581681,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":574,"num_read_kb":38602,"num_write":1242,"num_write_kb":22367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"263'104","reported_seq":689,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.948017+0000","last_change":"2024-09-12T00:28:33.216968+0000","last_active":"2024-09-12T01:35:46.948017+0000","last_peered":"2024-09-12T01:35:46.948017+0000","last_clean":"2024-09-12T01:35:46.948017+0000","last_became_active":"2024-09-12T00:28:33.213020+0000","last_became_peered":"2024-09-12T00:28:33.213020+0000","last_unstale":"2024-09-12T01:35:46.948017+0000","last_undegraded":"2024-09-12T01:35:46.948017+0000","last_fullsized":"2024-09-12T01:35:46.948017+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:49.966752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":435,"num_read_kb":365,"num_write":138,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"263'309","reported_seq":1047,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.733181+0000","last_change":"2024-09-12T00:28:31.208858+0000","last_active":"2024-09-12T01:38:01.733181+0000","last_peered":"2024-09-12T01:38:01.733181+0000","last_clean":"2024-09-12T01:38:01.733181+0000","last_became_active":"2024-09-12T00:28:31.208548+0000","last_became_peered":"2024-09-12T00:28:31.208548+0000","last_unstale":"2024-09-12T01:38:01.733181+0000","last_undegraded":"2024-09-12T01:38:01.733181+0000","last_fullsized":"2024-09-12T01:38:01.733181+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:14.657513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49275,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":734,"num_read_kb":31441,"num_write":965,"num_write_kb":36605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"263'125","reported_seq":761,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:13.175412+0000","last_change":"2024-09-12T00:28:33.217855+0000","last_active":"2024-09-12T01:36:13.175412+0000","last_peered":"2024-09-12T01:36:13.175412+0000","last_clean":"2024-09-12T01:36:13.175412+0000","last_became_active":"2024-09-12T00:28:33.217573+0000","last_became_peered":"2024-09-12T00:28:33.217573+0000","last_unstale":"2024-09-12T01:36:13.175412+0000","last_undegraded":"2024-09-12T01:36:13.175412+0000","last_fullsized":"2024-09-12T01:36:13.175412+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:26.283665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":588,"num_read_kb":500,"num_write":193,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"263'352","reported_seq":993,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.717117+0000","last_change":"2024-09-12T00:29:04.267833+0000","last_active":"2024-09-12T01:38:01.717117+0000","last_peered":"2024-09-12T01:38:01.717117+0000","last_clean":"2024-09-12T01:38:01.717117+0000","last_became_active":"2024-09-12T00:29:04.267546+0000","last_became_peered":"2024-09-12T00:29:04.267546+0000","last_unstale":"2024-09-12T01:38:01.717117+0000","last_undegraded":"2024-09-12T01:38:01.717117+0000","last_fullsized":"2024-09-12T01:38:01.717117+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:45.410402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2316165,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":596,"num_read_kb":3307,"num_write":1233,"num_write_kb":18821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"263'308","reported_seq":1002,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.545510+0000","last_change":"2024-09-12T00:28:33.209863+0000","last_active":"2024-09-12T01:35:16.545510+0000","last_peered":"2024-09-12T01:35:16.545510+0000","last_clean":"2024-09-12T01:35:16.545510+0000","last_became_active":"2024-09-12T00:28:33.208929+0000","last_became_peered":"2024-09-12T00:28:33.208929+0000","last_unstale":"2024-09-12T01:35:16.545510+0000","last_undegraded":"2024-09-12T01:35:16.545510+0000","last_fullsized":"2024-09-12T01:35:16.545510+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:38.145227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1423,"num_read_kb":1158,"num_write":481,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"263'311","reported_seq":953,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.766140+0000","last_change":"2024-09-12T00:28:31.206143+0000","last_active":"2024-09-12T01:38:01.766140+0000","last_peered":"2024-09-12T01:38:01.766140+0000","last_clean":"2024-09-12T01:38:01.766140+0000","last_became_active":"2024-09-12T00:28:31.205829+0000","last_became_peered":"2024-09-12T00:28:31.205829+0000","last_unstale":"2024-09-12T01:38:01.766140+0000","last_undegraded":"2024-09-12T01:38:01.766140+0000","last_fullsized":"2024-09-12T01:38:01.766140+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:18.050330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262189,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":453,"num_read_kb":5277,"num_write":1032,"num_write_kb":26638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"263'110","reported_seq":699,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:14.646908+0000","last_change":"2024-09-12T00:28:33.208267+0000","last_active":"2024-09-12T01:35:14.646908+0000","last_peered":"2024-09-12T01:35:14.646908+0000","last_clean":"2024-09-12T01:35:14.646908+0000","last_became_active":"2024-09-12T00:28:33.208010+0000","last_became_peered":"2024-09-12T00:28:33.208010+0000","last_unstale":"2024-09-12T01:35:14.646908+0000","last_undegraded":"2024-09-12T01:35:14.646908+0000","last_fullsized":"2024-09-12T01:35:14.646908+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:07.389367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":481,"num_read_kb":401,"num_write":165,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"263'369","reported_seq":1011,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.729408+0000","last_change":"2024-09-12T00:28:31.205820+0000","last_active":"2024-09-12T01:38:01.729408+0000","last_peered":"2024-09-12T01:38:01.729408+0000","last_clean":"2024-09-12T01:38:01.729408+0000","last_became_active":"2024-09-12T00:28:31.205366+0000","last_became_peered":"2024-09-12T00:28:31.205366+0000","last_unstale":"2024-09-12T01:38:01.729408+0000","last_undegraded":"2024-09-12T01:38:01.729408+0000","last_fullsized":"2024-09-12T01:38:01.729408+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:37.694868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":592,"num_read_kb":12807,"num_write":1213,"num_write_kb":27426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"263'206","reported_seq":826,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:32.524627+0000","last_change":"2024-09-12T00:28:33.209326+0000","last_active":"2024-09-12T01:35:32.524627+0000","last_peered":"2024-09-12T01:35:32.524627+0000","last_clean":"2024-09-12T01:35:32.524627+0000","last_became_active":"2024-09-12T00:28:33.209028+0000","last_became_peered":"2024-09-12T00:28:33.209028+0000","last_unstale":"2024-09-12T01:35:32.524627+0000","last_undegraded":"2024-09-12T01:35:32.524627+0000","last_fullsized":"2024-09-12T01:35:32.524627+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:20.185402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":877,"num_read_kb":721,"num_write":304,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"263'325","reported_seq":994,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.749343+0000","last_change":"2024-09-12T00:28:31.203730+0000","last_active":"2024-09-12T01:38:01.749343+0000","last_peered":"2024-09-12T01:38:01.749343+0000","last_clean":"2024-09-12T01:38:01.749343+0000","last_became_active":"2024-09-12T00:28:31.203185+0000","last_became_peered":"2024-09-12T00:28:31.203185+0000","last_unstale":"2024-09-12T01:38:01.749343+0000","last_undegraded":"2024-09-12T01:38:01.749343+0000","last_fullsized":"2024-09-12T01:38:01.749343+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:39.470819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524364,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":503,"num_read_kb":88709,"num_write":1042,"num_write_kb":43642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"263'403","reported_seq":1080,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.783830+0000","last_change":"2024-09-12T00:29:04.275730+0000","last_active":"2024-09-12T01:33:56.783830+0000","last_peered":"2024-09-12T01:33:56.783830+0000","last_clean":"2024-09-12T01:33:56.783830+0000","last_became_active":"2024-09-12T00:29:04.275434+0000","last_became_peered":"2024-09-12T00:29:04.275434+0000","last_unstale":"2024-09-12T01:33:56.783830+0000","last_undegraded":"2024-09-12T01:33:56.783830+0000","last_fullsized":"2024-09-12T01:33:56.783830+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:49.369214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1782,"num_read_kb":1435,"num_write":639,"num_write_kb":352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"263'328","reported_seq":965,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.718807+0000","last_change":"2024-09-12T00:28:31.209794+0000","last_active":"2024-09-12T01:38:01.718807+0000","last_peered":"2024-09-12T01:38:01.718807+0000","last_clean":"2024-09-12T01:38:01.718807+0000","last_became_active":"2024-09-12T00:28:31.209468+0000","last_became_peered":"2024-09-12T00:28:31.209468+0000","last_unstale":"2024-09-12T01:38:01.718807+0000","last_undegraded":"2024-09-12T01:38:01.718807+0000","last_fullsized":"2024-09-12T01:38:01.718807+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:32.906913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6901132,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":496,"num_read_kb":2644,"num_write":1040,"num_write_kb":18676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"263'161","reported_seq":736,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:29.654561+0000","last_change":"2024-09-12T00:28:33.208952+0000","last_active":"2024-09-12T01:35:29.654561+0000","last_peered":"2024-09-12T01:35:29.654561+0000","last_clean":"2024-09-12T01:35:29.654561+0000","last_became_active":"2024-09-12T00:28:33.208285+0000","last_became_peered":"2024-09-12T00:28:33.208285+0000","last_unstale":"2024-09-12T01:35:29.654561+0000","last_undegraded":"2024-09-12T01:35:29.654561+0000","last_fullsized":"2024-09-12T01:35:29.654561+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:58.828709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":689,"num_read_kb":558,"num_write":246,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"263'359","reported_seq":989,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.749362+0000","last_change":"2024-09-12T00:28:31.200270+0000","last_active":"2024-09-12T01:38:01.749362+0000","last_peered":"2024-09-12T01:38:01.749362+0000","last_clean":"2024-09-12T01:38:01.749362+0000","last_became_active":"2024-09-12T00:28:31.199924+0000","last_became_peered":"2024-09-12T00:28:31.199924+0000","last_unstale":"2024-09-12T01:38:01.749362+0000","last_undegraded":"2024-09-12T01:38:01.749362+0000","last_fullsized":"2024-09-12T01:38:01.749362+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:27.025158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":490,"num_read_kb":12716,"num_write":1120,"num_write_kb":44871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"263'322","reported_seq":999,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:41.195483+0000","last_change":"2024-09-12T00:28:33.208356+0000","last_active":"2024-09-12T01:35:41.195483+0000","last_peered":"2024-09-12T01:35:41.195483+0000","last_clean":"2024-09-12T01:35:41.195483+0000","last_became_active":"2024-09-12T00:28:33.208088+0000","last_became_peered":"2024-09-12T00:28:33.208088+0000","last_unstale":"2024-09-12T01:35:41.195483+0000","last_undegraded":"2024-09-12T01:35:41.195483+0000","last_fullsized":"2024-09-12T01:35:41.195483+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:12.972774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1424,"num_read_kb":1183,"num_write":488,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"263'341","reported_seq":1009,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.754771+0000","last_change":"2024-09-12T00:28:31.211421+0000","last_active":"2024-09-12T01:38:01.754771+0000","last_peered":"2024-09-12T01:38:01.754771+0000","last_clean":"2024-09-12T01:38:01.754771+0000","last_became_active":"2024-09-12T00:28:31.211083+0000","last_became_peered":"2024-09-12T00:28:31.211083+0000","last_unstale":"2024-09-12T01:38:01.754771+0000","last_undegraded":"2024-09-12T01:38:01.754771+0000","last_fullsized":"2024-09-12T01:38:01.754771+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:55.832817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262163,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":601,"num_read_kb":3403,"num_write":1227,"num_write_kb":8870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"263'152","reported_seq":767,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:02.380980+0000","last_change":"2024-09-12T00:28:33.209816+0000","last_active":"2024-09-12T01:36:02.380980+0000","last_peered":"2024-09-12T01:36:02.380980+0000","last_clean":"2024-09-12T01:36:02.380980+0000","last_became_active":"2024-09-12T00:28:33.209024+0000","last_became_peered":"2024-09-12T00:28:33.209024+0000","last_unstale":"2024-09-12T01:36:02.380980+0000","last_undegraded":"2024-09-12T01:36:02.380980+0000","last_fullsized":"2024-09-12T01:36:02.380980+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:09.766449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":684,"num_read_kb":599,"num_write":231,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"263'309","reported_seq":927,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.752002+0000","last_change":"2024-09-12T00:28:31.207686+0000","last_active":"2024-09-12T01:38:01.752002+0000","last_peered":"2024-09-12T01:38:01.752002+0000","last_clean":"2024-09-12T01:38:01.752002+0000","last_became_active":"2024-09-12T00:28:31.207399+0000","last_became_peered":"2024-09-12T00:28:31.207399+0000","last_unstale":"2024-09-12T01:38:01.752002+0000","last_undegraded":"2024-09-12T01:38:01.752002+0000","last_fullsized":"2024-09-12T01:38:01.752002+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:23.656345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":660490,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":412,"num_read_kb":9232,"num_write":885,"num_write_kb":18206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"263'63","reported_seq":616,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:31.055891+0000","last_change":"2024-09-12T00:28:33.213456+0000","last_active":"2024-09-12T01:35:31.055891+0000","last_peered":"2024-09-12T01:35:31.055891+0000","last_clean":"2024-09-12T01:35:31.055891+0000","last_became_active":"2024-09-12T00:28:33.213110+0000","last_became_peered":"2024-09-12T00:28:33.213110+0000","last_unstale":"2024-09-12T01:35:31.055891+0000","last_undegraded":"2024-09-12T01:35:31.055891+0000","last_fullsized":"2024-09-12T01:35:31.055891+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:43.946245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":226,"num_write":102,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"263'355","reported_seq":1028,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.749008+0000","last_change":"2024-09-12T00:28:31.203837+0000","last_active":"2024-09-12T01:38:01.749008+0000","last_peered":"2024-09-12T01:38:01.749008+0000","last_clean":"2024-09-12T01:38:01.749008+0000","last_became_active":"2024-09-12T00:28:31.203478+0000","last_became_peered":"2024-09-12T00:28:31.203478+0000","last_unstale":"2024-09-12T01:38:01.749008+0000","last_undegraded":"2024-09-12T01:38:01.749008+0000","last_fullsized":"2024-09-12T01:38:01.749008+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:31.896358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":633,"num_read_kb":38935,"num_write":1084,"num_write_kb":32997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"263'193","reported_seq":781,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.783140+0000","last_change":"2024-09-12T00:28:33.220290+0000","last_active":"2024-09-12T01:33:51.783140+0000","last_peered":"2024-09-12T01:33:51.783140+0000","last_clean":"2024-09-12T01:33:51.783140+0000","last_became_active":"2024-09-12T00:28:33.220013+0000","last_became_peered":"2024-09-12T00:28:33.220013+0000","last_unstale":"2024-09-12T01:33:51.783140+0000","last_undegraded":"2024-09-12T01:33:51.783140+0000","last_fullsized":"2024-09-12T01:33:51.783140+0000","mapping_epoch":27,"log_start":"260'100","ondisk_log_start":"260'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:33.307077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":806,"num_read_kb":650,"num_write":294,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"263'314","reported_seq":931,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.720583+0000","last_change":"2024-09-12T00:28:31.204579+0000","last_active":"2024-09-12T01:38:01.720583+0000","last_peered":"2024-09-12T01:38:01.720583+0000","last_clean":"2024-09-12T01:38:01.720583+0000","last_became_active":"2024-09-12T00:28:31.204305+0000","last_became_peered":"2024-09-12T00:28:31.204305+0000","last_unstale":"2024-09-12T01:38:01.720583+0000","last_undegraded":"2024-09-12T01:38:01.720583+0000","last_fullsized":"2024-09-12T01:38:01.720583+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:37.446006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133653,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":11794,"num_write":1040,"num_write_kb":34532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"263'110","reported_seq":720,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:25.136847+0000","last_change":"2024-09-12T00:28:33.217086+0000","last_active":"2024-09-12T01:35:25.136847+0000","last_peered":"2024-09-12T01:35:25.136847+0000","last_clean":"2024-09-12T01:35:25.136847+0000","last_became_active":"2024-09-12T00:28:33.216814+0000","last_became_peered":"2024-09-12T00:28:33.216814+0000","last_unstale":"2024-09-12T01:35:25.136847+0000","last_undegraded":"2024-09-12T01:35:25.136847+0000","last_fullsized":"2024-09-12T01:35:25.136847+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:27.405799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":456,"num_read_kb":389,"num_write":151,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"263'357","reported_seq":1040,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.714857+0000","last_change":"2024-09-12T00:28:31.200695+0000","last_active":"2024-09-12T01:38:01.714857+0000","last_peered":"2024-09-12T01:38:01.714857+0000","last_clean":"2024-09-12T01:38:01.714857+0000","last_became_active":"2024-09-12T00:28:31.200421+0000","last_became_peered":"2024-09-12T00:28:31.200421+0000","last_unstale":"2024-09-12T01:38:01.714857+0000","last_undegraded":"2024-09-12T01:38:01.714857+0000","last_fullsized":"2024-09-12T01:38:01.714857+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:56.623886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1658143,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":544,"num_read_kb":83268,"num_write":1180,"num_write_kb":21609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"263'106","reported_seq":683,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:41.519720+0000","last_change":"2024-09-12T00:28:33.213440+0000","last_active":"2024-09-12T01:36:41.519720+0000","last_peered":"2024-09-12T01:36:41.519720+0000","last_clean":"2024-09-12T01:36:41.519720+0000","last_became_active":"2024-09-12T00:28:33.213100+0000","last_became_peered":"2024-09-12T00:28:33.213100+0000","last_unstale":"2024-09-12T01:36:41.519720+0000","last_undegraded":"2024-09-12T01:36:41.519720+0000","last_fullsized":"2024-09-12T01:36:41.519720+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:38.213563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":481,"num_read_kb":399,"num_write":154,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"263'346","reported_seq":1034,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.749067+0000","last_change":"2024-09-12T00:28:31.215965+0000","last_active":"2024-09-12T01:38:01.749067+0000","last_peered":"2024-09-12T01:38:01.749067+0000","last_clean":"2024-09-12T01:38:01.749067+0000","last_became_active":"2024-09-12T00:28:31.215581+0000","last_became_peered":"2024-09-12T00:28:31.215581+0000","last_unstale":"2024-09-12T01:38:01.749067+0000","last_undegraded":"2024-09-12T01:38:01.749067+0000","last_fullsized":"2024-09-12T01:38:01.749067+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:38.099218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3558704,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":578,"num_read_kb":13304,"num_write":1188,"num_write_kb":31930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"263'307","reported_seq":947,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.733963+0000","last_change":"2024-09-12T00:28:31.214764+0000","last_active":"2024-09-12T01:38:01.733963+0000","last_peered":"2024-09-12T01:38:01.733963+0000","last_clean":"2024-09-12T01:38:01.733963+0000","last_became_active":"2024-09-12T00:28:31.214134+0000","last_became_peered":"2024-09-12T00:28:31.214134+0000","last_unstale":"2024-09-12T01:38:01.733963+0000","last_undegraded":"2024-09-12T01:38:01.733963+0000","last_fullsized":"2024-09-12T01:38:01.733963+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:00.479671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553650,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":469,"num_read_kb":31725,"num_write":1010,"num_write_kb":40420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"263'102","reported_seq":694,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:01.784409+0000","last_change":"2024-09-12T00:28:33.213186+0000","last_active":"2024-09-12T01:34:01.784409+0000","last_peered":"2024-09-12T01:34:01.784409+0000","last_clean":"2024-09-12T01:34:01.784409+0000","last_became_active":"2024-09-12T00:28:33.212886+0000","last_became_peered":"2024-09-12T00:28:33.212886+0000","last_unstale":"2024-09-12T01:34:01.784409+0000","last_undegraded":"2024-09-12T01:34:01.784409+0000","last_fullsized":"2024-09-12T01:34:01.784409+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:53.462824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":476,"num_read_kb":407,"num_write":159,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"263'396","reported_seq":1143,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.731959+0000","last_change":"2024-09-12T00:28:31.197815+0000","last_active":"2024-09-12T01:38:01.731959+0000","last_peered":"2024-09-12T01:38:01.731959+0000","last_clean":"2024-09-12T01:38:01.731959+0000","last_became_active":"2024-09-12T00:28:31.196230+0000","last_became_peered":"2024-09-12T00:28:31.196230+0000","last_unstale":"2024-09-12T01:38:01.731959+0000","last_undegraded":"2024-09-12T01:38:01.731959+0000","last_fullsized":"2024-09-12T01:38:01.731959+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:30.185028+0000","last_clean_scrub_stamp":"2024-09-12T00:28:30.185028+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:32.020082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291522,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":735,"num_read_kb":35673,"num_write":1292,"num_write_kb":40181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"263'212","reported_seq":801,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:01.455973+0000","last_change":"2024-09-12T00:28:33.213479+0000","last_active":"2024-09-12T01:34:01.455973+0000","last_peered":"2024-09-12T01:34:01.455973+0000","last_clean":"2024-09-12T01:34:01.455973+0000","last_became_active":"2024-09-12T00:28:33.213187+0000","last_became_peered":"2024-09-12T00:28:33.213187+0000","last_unstale":"2024-09-12T01:34:01.455973+0000","last_undegraded":"2024-09-12T01:34:01.455973+0000","last_fullsized":"2024-09-12T01:34:01.455973+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:03.213237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":884,"num_read_kb":712,"num_write":323,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5759,"num_read_kb":4046,"num_write":1929,"num_write_kb":827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1000,"ondisk_log_size":1000,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15395,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":15045,"num_read_kb":14706,"num_write":16739,"num_write_kb":4892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1773,"ondisk_log_size":1773,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":520,"ondisk_log_size":520,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1497349,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":18870,"num_read_kb":39400,"num_write":15775,"num_write_kb":11890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2057,"ondisk_log_size":2057,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2403,"num_read_kb":2865,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":103056,"num_read_kb":85959,"num_write":37323,"num_write_kb":18865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4302,"ondisk_log_size":4302,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":94285898,"num_objects":401,"num_object_clones":0,"num_object_copies":802,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":401,"num_whiteouts":0,"num_read":36137,"num_read_kb":1909956,"num_write":71332,"num_write_kb":2052201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":190078976,"data_stored":188571796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3721,"ondisk_log_size":3721,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":175308,"num_write":154,"num_write_kb":116383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":27197,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":178855,"num_write":154,"num_write_kb":116383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510284,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":249264,"kb_used_data":19384,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94122576,"statfs":{"total":96636764160,"available":96381517824,"internally_reserved":0,"allocated":19849216,"data_stored":18131665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":235207114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510283,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":245736,"kb_used_data":15764,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94126104,"statfs":{"total":96636764160,"available":96385130496,"internally_reserved":0,"allocated":16142336,"data_stored":14537201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":235207110},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510286,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":143624,"kb_used_data":44244,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94228216,"statfs":{"total":96636764160,"available":96489693184,"internally_reserved":0,"allocated":45305856,"data_stored":43509539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510282,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":102604,"kb_used_data":31080,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94269236,"statfs":{"total":96636764160,"available":96531697664,"internally_reserved":0,"allocated":31825920,"data_stored":30189258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510285,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71420,"kb_used_data":17880,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94300420,"statfs":{"total":96636764160,"available":96563630080,"internally_reserved":0,"allocated":18309120,"data_stored":16732323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510288,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":134632,"kb_used_data":22856,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94237208,"statfs":{"total":96636764160,"available":96498900992,"internally_reserved":0,"allocated":23404544,"data_stored":21740424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510286,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":283304,"kb_used_data":35332,"kb_used_omap":1,"kb_used_meta":247678,"kb_avail":94088536,"statfs":{"total":96636764160,"available":96346660864,"internally_reserved":0,"allocated":36179968,"data_stored":34415974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":253622725},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575691,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":284980,"kb_used_data":28684,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":94086860,"statfs":{"total":96636764160,"available":96344944640,"internally_reserved":0,"allocated":29372416,"data_stored":27586086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":262207944},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,3],"upper_bound":4},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":31928320,"data_stored":31687986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19750912,"data_stored":19603309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14700544,"data_stored":14596831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":25714688,"data_stored":25449825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28241920,"data_stored":28055424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":41611264,"data_stored":41372743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12529664,"data_stored":12400757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15601664,"data_stored":15404921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:38:09.794 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.794 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.794 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.794 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.795 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.795 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.795 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.795 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.795 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.795 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.795 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.795 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.795 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.796 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.796 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.796 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.796 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.796 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.796 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.796 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.796 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.796 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.797 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.797 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.797 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.797 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.797 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.797 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.797 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.797 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.797 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.798 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.798 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.798 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.798 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.798 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.798 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.798 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.798 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.798 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.799 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.799 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.799 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.799 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.799 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.799 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.799 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.799 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.799 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.800 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.800 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.800 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.800 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.800 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.800 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.800 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.800 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.800 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.801 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.801 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.801 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.801 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.801 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.801 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.801 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.801 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.801 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.802 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.802 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.802 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.802 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.802 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.802 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.802 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.802 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.802 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.803 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.803 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.803 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.803 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.803 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.803 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.803 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.803 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.803 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.804 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.804 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.804 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.804 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.804 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.804 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.804 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.804 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.804 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.805 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.805 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.805 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.805 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.805 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.805 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.805 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.805 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.805 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.806 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.806 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.806 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.806 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.806 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.806 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.806 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.806 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.807 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.807 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.807 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.807 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.807 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.807 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.807 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.807 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.807 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.807 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.808 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.808 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.808 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.808 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.808 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.808 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.808 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.808 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.808 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.809 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.809 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.809 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.809 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.809 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.809 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.809 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.809 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.810 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.810 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.810 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.810 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.810 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.810 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.810 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.810 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.810 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.811 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.811 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.811 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.811 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.811 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.811 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.811 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.811 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.811 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.812 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.812 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.812 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.812 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T00:28:34.191880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.812 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.812 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.812 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.812 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.812 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.813 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T00:28:34.191880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.813 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.813 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.813 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.813 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.813 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.813 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T00:28:34.191880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.813 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.813 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.814 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.814 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.814 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.814 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T00:28:34.191880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.814 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.814 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.815 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.815 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.815 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-12T00:28:34.191880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.815 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.815 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.815 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.815 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.816 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.816 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-12T00:28:34.191880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.816 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.816 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.816 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.816 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.816 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.816 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-12T00:28:34.191880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.816 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.817 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.817 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.817 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.817 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.817 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-12T00:28:34.191880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.817 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.817 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.817 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.818 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.818 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.818 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-12T00:28:34.191880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.818 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.818 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.818 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.818 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.818 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.819 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-12T00:28:34.191880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.819 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.819 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.819 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.819 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.819 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.819 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T00:28:34.191880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.819 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.819 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.820 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.820 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.820 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.820 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T00:28:34.191880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.820 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.820 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.820 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.820 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.821 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-12T00:28:13.107271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.821 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-12T00:28:18.139537+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.821 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.821 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-12T00:28:34.191880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.821 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.821 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.821 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.821 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.822 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-12T00:28:18.139537+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.822 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.822 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T00:28:34.191880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.822 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.822 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.822 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.822 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.822 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-12T00:28:18.139537+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.823 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.823 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-12T00:28:34.191880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.823 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.823 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.823 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.823 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.823 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-12T00:28:18.139537+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.823 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.824 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-12T00:28:34.191880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.824 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.824 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.824 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.824 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.824 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.824 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-12T00:28:18.139537+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.824 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-12T00:28:34.191880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.825 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.825 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.825 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.825 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.825 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.825 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-12T00:28:18.139537+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.825 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-12T00:28:34.191880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.825 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.826 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.826 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.826 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.826 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.826 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-12T00:28:18.139537+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.826 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T00:28:34.191880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.826 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.826 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.827 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.827 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.827 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.827 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-12T00:28:18.139537+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.827 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T00:28:34.191880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.827 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.827 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.828 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.828 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.828 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.828 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.828 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-12T00:28:34.191880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.828 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.829 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.829 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.829 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.829 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.829 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T00:28:34.191880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.829 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.829 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.829 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.830 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.830 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.830 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-12T00:28:34.191880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.830 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.830 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.830 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.830 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.830 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.831 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-12T00:28:34.191880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.831 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.831 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.831 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.831 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.831 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-12T00:28:34.191880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.831 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.831 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.831 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.832 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.832 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.832 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-12T00:28:34.191880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.832 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.832 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.832 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.832 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.832 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.833 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-12T00:28:34.191880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.833 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.833 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.833 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.833 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.833 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.833 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T00:28:34.191880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.833 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.834 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.834 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.834 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.834 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.834 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T00:28:34.191880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.834 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.834 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.834 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.834 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.835 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.835 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T00:28:34.191880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.835 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.835 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.835 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.835 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.835 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.835 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T00:28:34.191880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.836 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.836 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.836 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.836 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.836 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.836 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-12T00:28:34.191880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.836 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.836 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.837 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.837 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.837 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.837 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.837 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.837 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.837 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.837 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.838 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.838 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.838 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.838 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.838 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.838 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.838 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.838 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.839 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.839 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.839 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.839 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.839 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.839 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.839 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.839 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.840 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.840 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.840 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.840 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.840 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.840 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.840 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.841 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.841 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.841 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.841 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.841 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-12T00:28:30.185028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.841 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:09.841 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T01:38:29.843 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:38:30.174 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:38:30.186 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T01:38:30.188 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":2366,"stamp":"2024-09-12T01:38:29.950088+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":96390822,"num_objects":752,"num_object_clones":0,"num_object_copies":1504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":752,"num_whiteouts":0,"num_read":181613,"num_read_kb":2411162,"num_write":143549,"num_write_kb":2323097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":27197,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":568531,"num_omap_keys":1352,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13497,"ondisk_log_size":13497,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1518200,"kb_used_data":215224,"kb_used_omap":12,"kb_used_meta":1302835,"kb_avail":753456520,"statfs":{"total":773094113280,"available":771539476480,"internally_reserved":0,"allocated":220389376,"data_stored":206842470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1334103601},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":568066,"num_omap_keys":1350,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005499"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:17.783401+0000","last_change":"2024-09-12T01:04:15.393241+0000","last_active":"2024-09-12T01:34:17.783401+0000","last_peered":"2024-09-12T01:34:17.783401+0000","last_clean":"2024-09-12T01:34:17.783401+0000","last_became_active":"2024-09-12T01:04:15.392944+0000","last_became_peered":"2024-09-12T01:04:15.392944+0000","last_unstale":"2024-09-12T01:34:17.783401+0000","last_undegraded":"2024-09-12T01:34:17.783401+0000","last_fullsized":"2024-09-12T01:34:17.783401+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:32.532552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"263'8","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.458995+0000","last_change":"2024-09-12T00:46:26.362583+0000","last_active":"2024-09-12T01:38:00.458995+0000","last_peered":"2024-09-12T01:38:00.458995+0000","last_clean":"2024-09-12T01:38:00.458995+0000","last_became_active":"2024-09-12T00:46:26.362231+0000","last_became_peered":"2024-09-12T00:46:26.362231+0000","last_unstale":"2024-09-12T01:38:00.458995+0000","last_undegraded":"2024-09-12T01:38:00.458995+0000","last_fullsized":"2024-09-12T01:38:00.458995+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:47.340687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":19456,"num_write":13,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:54.637545+0000","last_change":"2024-09-12T00:46:22.353581+0000","last_active":"2024-09-12T01:33:54.637545+0000","last_peered":"2024-09-12T01:33:54.637545+0000","last_clean":"2024-09-12T01:33:54.637545+0000","last_became_active":"2024-09-12T00:46:22.353306+0000","last_became_peered":"2024-09-12T00:46:22.353306+0000","last_unstale":"2024-09-12T01:33:54.637545+0000","last_undegraded":"2024-09-12T01:33:54.637545+0000","last_fullsized":"2024-09-12T01:33:54.637545+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:42.123772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"263'59","reported_seq":219,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:41.789494+0000","last_change":"2024-09-12T00:42:36.818643+0000","last_active":"2024-09-12T01:34:41.789494+0000","last_peered":"2024-09-12T01:34:41.789494+0000","last_clean":"2024-09-12T01:34:41.789494+0000","last_became_active":"2024-09-12T00:42:36.818329+0000","last_became_peered":"2024-09-12T00:42:36.818329+0000","last_unstale":"2024-09-12T01:34:41.789494+0000","last_undegraded":"2024-09-12T01:34:41.789494+0000","last_fullsized":"2024-09-12T01:34:41.789494+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:59.176386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":293,"num_read_kb":205,"num_write":105,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:16.629694+0000","last_change":"2024-09-12T01:04:15.393046+0000","last_active":"2024-09-12T01:34:16.629694+0000","last_peered":"2024-09-12T01:34:16.629694+0000","last_clean":"2024-09-12T01:34:16.629694+0000","last_became_active":"2024-09-12T01:04:15.392747+0000","last_became_peered":"2024-09-12T01:04:15.392747+0000","last_unstale":"2024-09-12T01:34:16.629694+0000","last_undegraded":"2024-09-12T01:34:16.629694+0000","last_fullsized":"2024-09-12T01:34:16.629694+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:12.627526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"263'3","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:26.555957+0000","last_change":"2024-09-12T00:46:26.370283+0000","last_active":"2024-09-12T01:36:26.555957+0000","last_peered":"2024-09-12T01:36:26.555957+0000","last_clean":"2024-09-12T01:36:26.555957+0000","last_became_active":"2024-09-12T00:46:26.369944+0000","last_became_peered":"2024-09-12T00:46:26.369944+0000","last_unstale":"2024-09-12T01:36:26.555957+0000","last_undegraded":"2024-09-12T01:36:26.555957+0000","last_fullsized":"2024-09-12T01:36:26.555957+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:14.648408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"260'8","reported_seq":70,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.933295+0000","last_change":"2024-09-12T00:46:22.354256+0000","last_active":"2024-09-12T01:33:51.933295+0000","last_peered":"2024-09-12T01:33:51.933295+0000","last_clean":"2024-09-12T01:33:51.933295+0000","last_became_active":"2024-09-12T00:46:22.352009+0000","last_became_peered":"2024-09-12T00:46:22.352009+0000","last_unstale":"2024-09-12T01:33:51.933295+0000","last_undegraded":"2024-09-12T01:33:51.933295+0000","last_fullsized":"2024-09-12T01:33:51.933295+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:27.873653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":26626,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"263'20","reported_seq":116,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:56.533176+0000","last_change":"2024-09-12T00:42:36.809720+0000","last_active":"2024-09-12T01:34:56.533176+0000","last_peered":"2024-09-12T01:34:56.533176+0000","last_clean":"2024-09-12T01:34:56.533176+0000","last_became_active":"2024-09-12T00:42:36.809431+0000","last_became_peered":"2024-09-12T00:42:36.809431+0000","last_unstale":"2024-09-12T01:34:56.533176+0000","last_undegraded":"2024-09-12T01:34:56.533176+0000","last_fullsized":"2024-09-12T01:34:56.533176+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:09.971874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":73,"num_write":40,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:41.548876+0000","last_change":"2024-09-12T01:04:15.384612+0000","last_active":"2024-09-12T01:35:41.548876+0000","last_peered":"2024-09-12T01:35:41.548876+0000","last_clean":"2024-09-12T01:35:41.548876+0000","last_became_active":"2024-09-12T01:04:15.384312+0000","last_became_peered":"2024-09-12T01:04:15.384312+0000","last_unstale":"2024-09-12T01:35:41.548876+0000","last_undegraded":"2024-09-12T01:35:41.548876+0000","last_fullsized":"2024-09-12T01:35:41.548876+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:27.357127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:21.786809+0000","last_change":"2024-09-12T00:46:26.563569+0000","last_active":"2024-09-12T01:34:21.786809+0000","last_peered":"2024-09-12T01:34:21.786809+0000","last_clean":"2024-09-12T01:34:21.786809+0000","last_became_active":"2024-09-12T00:46:26.563267+0000","last_became_peered":"2024-09-12T00:46:26.563267+0000","last_unstale":"2024-09-12T01:34:21.786809+0000","last_undegraded":"2024-09-12T01:34:21.786809+0000","last_fullsized":"2024-09-12T01:34:21.786809+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:14.364154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"260'3","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:41.531630+0000","last_change":"2024-09-12T00:46:22.341443+0000","last_active":"2024-09-12T01:34:41.531630+0000","last_peered":"2024-09-12T01:34:41.531630+0000","last_clean":"2024-09-12T01:34:41.531630+0000","last_became_active":"2024-09-12T00:46:22.340655+0000","last_became_peered":"2024-09-12T00:46:22.340655+0000","last_unstale":"2024-09-12T01:34:41.531630+0000","last_undegraded":"2024-09-12T01:34:41.531630+0000","last_fullsized":"2024-09-12T01:34:41.531630+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:34.773392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"263'63","reported_seq":226,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:06.792053+0000","last_change":"2024-09-12T00:42:36.814795+0000","last_active":"2024-09-12T01:35:06.792053+0000","last_peered":"2024-09-12T01:35:06.792053+0000","last_clean":"2024-09-12T01:35:06.792053+0000","last_became_active":"2024-09-12T00:42:36.814510+0000","last_became_peered":"2024-09-12T00:42:36.814510+0000","last_unstale":"2024-09-12T01:35:06.792053+0000","last_undegraded":"2024-09-12T01:35:06.792053+0000","last_fullsized":"2024-09-12T01:35:06.792053+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:42.130114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":321,"num_read_kb":228,"num_write":110,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:44.650367+0000","last_change":"2024-09-12T01:04:15.402204+0000","last_active":"2024-09-12T01:35:44.650367+0000","last_peered":"2024-09-12T01:35:44.650367+0000","last_clean":"2024-09-12T01:35:44.650367+0000","last_became_active":"2024-09-12T01:04:15.401897+0000","last_became_peered":"2024-09-12T01:04:15.401897+0000","last_unstale":"2024-09-12T01:35:44.650367+0000","last_undegraded":"2024-09-12T01:35:44.650367+0000","last_fullsized":"2024-09-12T01:35:44.650367+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:39.642849+0000","last_change":"2024-09-12T00:46:26.562165+0000","last_active":"2024-09-12T01:34:39.642849+0000","last_peered":"2024-09-12T01:34:39.642849+0000","last_clean":"2024-09-12T01:34:39.642849+0000","last_became_active":"2024-09-12T00:46:26.561870+0000","last_became_peered":"2024-09-12T00:46:26.561870+0000","last_unstale":"2024-09-12T01:34:39.642849+0000","last_undegraded":"2024-09-12T01:34:39.642849+0000","last_fullsized":"2024-09-12T01:34:39.642849+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:20.530939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"263'6","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.125693+0000","last_change":"2024-09-12T00:46:22.339498+0000","last_active":"2024-09-12T01:38:01.125693+0000","last_peered":"2024-09-12T01:38:01.125693+0000","last_clean":"2024-09-12T01:38:01.125693+0000","last_became_active":"2024-09-12T00:46:22.339141+0000","last_became_peered":"2024-09-12T00:46:22.339141+0000","last_unstale":"2024-09-12T01:38:01.125693+0000","last_undegraded":"2024-09-12T01:38:01.125693+0000","last_fullsized":"2024-09-12T01:38:01.125693+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"263'62","reported_seq":225,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:09.646373+0000","last_change":"2024-09-12T00:42:36.816859+0000","last_active":"2024-09-12T01:35:09.646373+0000","last_peered":"2024-09-12T01:35:09.646373+0000","last_clean":"2024-09-12T01:35:09.646373+0000","last_became_active":"2024-09-12T00:42:36.816570+0000","last_became_peered":"2024-09-12T00:42:36.816570+0000","last_unstale":"2024-09-12T01:35:09.646373+0000","last_undegraded":"2024-09-12T01:35:09.646373+0000","last_fullsized":"2024-09-12T01:35:09.646373+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:03.911054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":318,"num_read_kb":239,"num_write":100,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:19.654739+0000","last_change":"2024-09-12T01:04:15.400469+0000","last_active":"2024-09-12T01:36:19.654739+0000","last_peered":"2024-09-12T01:36:19.654739+0000","last_clean":"2024-09-12T01:36:19.654739+0000","last_became_active":"2024-09-12T01:04:15.400228+0000","last_became_peered":"2024-09-12T01:04:15.400228+0000","last_unstale":"2024-09-12T01:36:19.654739+0000","last_undegraded":"2024-09-12T01:36:19.654739+0000","last_fullsized":"2024-09-12T01:36:19.654739+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"263'9","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.748908+0000","last_change":"2024-09-12T00:46:26.368145+0000","last_active":"2024-09-12T01:38:00.748908+0000","last_peered":"2024-09-12T01:38:00.748908+0000","last_clean":"2024-09-12T01:38:00.748908+0000","last_became_active":"2024-09-12T00:46:26.367849+0000","last_became_peered":"2024-09-12T00:46:26.367849+0000","last_unstale":"2024-09-12T01:38:00.748908+0000","last_undegraded":"2024-09-12T01:38:00.748908+0000","last_fullsized":"2024-09-12T01:38:00.748908+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:35.175209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7168,"num_write":19,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"263'13","reported_seq":83,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:06.806586+0000","last_change":"2024-09-12T00:46:22.351181+0000","last_active":"2024-09-12T01:37:06.806586+0000","last_peered":"2024-09-12T01:37:06.806586+0000","last_clean":"2024-09-12T01:37:06.806586+0000","last_became_active":"2024-09-12T00:46:22.349597+0000","last_became_peered":"2024-09-12T00:46:22.349597+0000","last_unstale":"2024-09-12T01:37:06.806586+0000","last_undegraded":"2024-09-12T01:37:06.806586+0000","last_fullsized":"2024-09-12T01:37:06.806586+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:58.755945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":44034,"num_write":28,"num_write_kb":19456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"263'28","reported_seq":129,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:09.646341+0000","last_change":"2024-09-12T00:42:36.815076+0000","last_active":"2024-09-12T01:35:09.646341+0000","last_peered":"2024-09-12T01:35:09.646341+0000","last_clean":"2024-09-12T01:35:09.646341+0000","last_became_active":"2024-09-12T00:42:36.814799+0000","last_became_peered":"2024-09-12T00:42:36.814799+0000","last_unstale":"2024-09-12T01:35:09.646341+0000","last_undegraded":"2024-09-12T01:35:09.646341+0000","last_fullsized":"2024-09-12T01:35:09.646341+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:46.026762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":94,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:31.946433+0000","last_change":"2024-09-12T01:04:15.388981+0000","last_active":"2024-09-12T01:35:31.946433+0000","last_peered":"2024-09-12T01:35:31.946433+0000","last_clean":"2024-09-12T01:35:31.946433+0000","last_became_active":"2024-09-12T01:04:15.388593+0000","last_became_peered":"2024-09-12T01:04:15.388593+0000","last_unstale":"2024-09-12T01:35:31.946433+0000","last_undegraded":"2024-09-12T01:35:31.946433+0000","last_fullsized":"2024-09-12T01:35:31.946433+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:42.435298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"260'2","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:46.540932+0000","last_change":"2024-09-12T00:47:05.446932+0000","last_active":"2024-09-12T01:34:46.540932+0000","last_peered":"2024-09-12T01:34:46.540932+0000","last_clean":"2024-09-12T01:34:46.540932+0000","last_became_active":"2024-09-12T00:47:05.444004+0000","last_became_peered":"2024-09-12T00:47:05.444004+0000","last_unstale":"2024-09-12T01:34:46.540932+0000","last_undegraded":"2024-09-12T01:34:46.540932+0000","last_fullsized":"2024-09-12T01:34:46.540932+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:13.946930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":27197,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"263'2","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:21.563798+0000","last_change":"2024-09-12T00:46:22.348331+0000","last_active":"2024-09-12T01:37:21.563798+0000","last_peered":"2024-09-12T01:37:21.563798+0000","last_clean":"2024-09-12T01:37:21.563798+0000","last_became_active":"2024-09-12T00:46:22.347338+0000","last_became_peered":"2024-09-12T00:46:22.347338+0000","last_unstale":"2024-09-12T01:37:21.563798+0000","last_undegraded":"2024-09-12T01:37:21.563798+0000","last_fullsized":"2024-09-12T01:37:21.563798+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:08.989061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"260'71","reported_seq":297,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:06.543849+0000","last_change":"2024-09-12T00:42:36.812768+0000","last_active":"2024-09-12T01:35:06.543849+0000","last_peered":"2024-09-12T01:35:06.543849+0000","last_clean":"2024-09-12T01:35:06.543849+0000","last_became_active":"2024-09-12T00:42:36.812454+0000","last_became_peered":"2024-09-12T00:42:36.812454+0000","last_unstale":"2024-09-12T01:35:06.543849+0000","last_undegraded":"2024-09-12T01:35:06.543849+0000","last_fullsized":"2024-09-12T01:35:06.543849+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:06.880124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":475,"num_read_kb":319,"num_write":83,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"263'1","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:16.721868+0000","last_change":"2024-09-12T01:04:15.391988+0000","last_active":"2024-09-12T01:34:16.721868+0000","last_peered":"2024-09-12T01:34:16.721868+0000","last_clean":"2024-09-12T01:34:16.721868+0000","last_became_active":"2024-09-12T01:04:15.391532+0000","last_became_peered":"2024-09-12T01:04:15.391532+0000","last_unstale":"2024-09-12T01:34:16.721868+0000","last_undegraded":"2024-09-12T01:34:16.721868+0000","last_fullsized":"2024-09-12T01:34:16.721868+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:13.040622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"263'6","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.236119+0000","last_change":"2024-09-12T00:46:26.374943+0000","last_active":"2024-09-12T01:38:00.236119+0000","last_peered":"2024-09-12T01:38:00.236119+0000","last_clean":"2024-09-12T01:38:00.236119+0000","last_became_active":"2024-09-12T00:46:26.374660+0000","last_became_peered":"2024-09-12T00:46:26.374660+0000","last_unstale":"2024-09-12T01:38:00.236119+0000","last_undegraded":"2024-09-12T01:38:00.236119+0000","last_fullsized":"2024-09-12T01:38:00.236119+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:20.054984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"263'7","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:21.555167+0000","last_change":"2024-09-12T00:46:22.340546+0000","last_active":"2024-09-12T01:36:21.555167+0000","last_peered":"2024-09-12T01:36:21.555167+0000","last_clean":"2024-09-12T01:36:21.555167+0000","last_became_active":"2024-09-12T00:46:22.340228+0000","last_became_peered":"2024-09-12T00:46:22.340228+0000","last_unstale":"2024-09-12T01:36:21.555167+0000","last_undegraded":"2024-09-12T01:36:21.555167+0000","last_fullsized":"2024-09-12T01:36:21.555167+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:22.609852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6219,"num_write":7,"num_write_kb":6219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"263'129","reported_seq":432,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:56.798118+0000","last_change":"2024-09-12T00:42:36.813186+0000","last_active":"2024-09-12T01:35:56.798118+0000","last_peered":"2024-09-12T01:35:56.798118+0000","last_clean":"2024-09-12T01:35:56.798118+0000","last_became_active":"2024-09-12T00:42:36.812882+0000","last_became_peered":"2024-09-12T00:42:36.812882+0000","last_unstale":"2024-09-12T01:35:56.798118+0000","last_undegraded":"2024-09-12T01:35:56.798118+0000","last_fullsized":"2024-09-12T01:35:56.798118+0000","mapping_epoch":250,"log_start":"260'100","ondisk_log_start":"260'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":723,"num_read_kb":503,"num_write":193,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:16.721896+0000","last_change":"2024-09-12T01:04:15.398861+0000","last_active":"2024-09-12T01:34:16.721896+0000","last_peered":"2024-09-12T01:34:16.721896+0000","last_clean":"2024-09-12T01:34:16.721896+0000","last_became_active":"2024-09-12T01:04:15.398533+0000","last_became_peered":"2024-09-12T01:04:15.398533+0000","last_unstale":"2024-09-12T01:34:16.721896+0000","last_undegraded":"2024-09-12T01:34:16.721896+0000","last_fullsized":"2024-09-12T01:34:16.721896+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:15.428730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"263'5","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.405774+0000","last_change":"2024-09-12T00:46:26.368036+0000","last_active":"2024-09-12T01:38:00.405774+0000","last_peered":"2024-09-12T01:38:00.405774+0000","last_clean":"2024-09-12T01:38:00.405774+0000","last_became_active":"2024-09-12T00:46:26.367766+0000","last_became_peered":"2024-09-12T00:46:26.367766+0000","last_unstale":"2024-09-12T01:38:00.405774+0000","last_undegraded":"2024-09-12T01:38:00.405774+0000","last_fullsized":"2024-09-12T01:38:00.405774+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:04.823775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4,"num_write":10,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.783149+0000","last_change":"2024-09-12T00:46:22.354118+0000","last_active":"2024-09-12T01:33:51.783149+0000","last_peered":"2024-09-12T01:33:51.783149+0000","last_clean":"2024-09-12T01:33:51.783149+0000","last_became_active":"2024-09-12T00:46:22.353833+0000","last_became_peered":"2024-09-12T00:46:22.353833+0000","last_unstale":"2024-09-12T01:33:51.783149+0000","last_undegraded":"2024-09-12T01:33:51.783149+0000","last_fullsized":"2024-09-12T01:33:51.783149+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:15.168253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'39","reported_seq":167,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.947948+0000","last_change":"2024-09-12T00:42:36.803994+0000","last_active":"2024-09-12T01:35:46.947948+0000","last_peered":"2024-09-12T01:35:46.947948+0000","last_clean":"2024-09-12T01:35:46.947948+0000","last_became_active":"2024-09-12T00:42:36.803692+0000","last_became_peered":"2024-09-12T00:42:36.803692+0000","last_unstale":"2024-09-12T01:35:46.947948+0000","last_undegraded":"2024-09-12T01:35:46.947948+0000","last_fullsized":"2024-09-12T01:35:46.947948+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":209,"num_read_kb":149,"num_write":77,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.938567+0000","last_change":"2024-09-12T01:04:15.385887+0000","last_active":"2024-09-12T01:34:36.938567+0000","last_peered":"2024-09-12T01:34:36.938567+0000","last_clean":"2024-09-12T01:34:36.938567+0000","last_became_active":"2024-09-12T01:04:15.385172+0000","last_became_peered":"2024-09-12T01:04:15.385172+0000","last_unstale":"2024-09-12T01:34:36.938567+0000","last_undegraded":"2024-09-12T01:34:36.938567+0000","last_fullsized":"2024-09-12T01:34:36.938567+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:15.451328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"263'5","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.880428+0000","last_change":"2024-09-12T00:46:26.565125+0000","last_active":"2024-09-12T01:38:00.880428+0000","last_peered":"2024-09-12T01:38:00.880428+0000","last_clean":"2024-09-12T01:38:00.880428+0000","last_became_active":"2024-09-12T00:46:26.561643+0000","last_became_peered":"2024-09-12T00:46:26.561643+0000","last_unstale":"2024-09-12T01:38:00.880428+0000","last_undegraded":"2024-09-12T01:38:00.880428+0000","last_fullsized":"2024-09-12T01:38:00.880428+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:50.221519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10250,"num_write":10,"num_write_kb":5125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:27.793407+0000","last_change":"2024-09-12T00:46:22.349290+0000","last_active":"2024-09-12T01:35:27.793407+0000","last_peered":"2024-09-12T01:35:27.793407+0000","last_clean":"2024-09-12T01:35:27.793407+0000","last_became_active":"2024-09-12T00:46:22.349007+0000","last_became_peered":"2024-09-12T00:46:22.349007+0000","last_unstale":"2024-09-12T01:35:27.793407+0000","last_undegraded":"2024-09-12T01:35:27.793407+0000","last_fullsized":"2024-09-12T01:35:27.793407+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:56.041981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"263'19","reported_seq":113,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.797074+0000","last_change":"2024-09-12T00:42:36.815233+0000","last_active":"2024-09-12T01:35:46.797074+0000","last_peered":"2024-09-12T01:35:46.797074+0000","last_clean":"2024-09-12T01:35:46.797074+0000","last_became_active":"2024-09-12T00:42:36.814846+0000","last_became_peered":"2024-09-12T00:42:36.814846+0000","last_unstale":"2024-09-12T01:35:46.797074+0000","last_undegraded":"2024-09-12T01:35:46.797074+0000","last_fullsized":"2024-09-12T01:35:46.797074+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":75,"num_write":34,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"263'1","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.531023+0000","last_change":"2024-09-12T01:04:15.395818+0000","last_active":"2024-09-12T01:34:36.531023+0000","last_peered":"2024-09-12T01:34:36.531023+0000","last_clean":"2024-09-12T01:34:36.531023+0000","last_became_active":"2024-09-12T01:04:15.395540+0000","last_became_peered":"2024-09-12T01:04:15.395540+0000","last_unstale":"2024-09-12T01:34:36.531023+0000","last_undegraded":"2024-09-12T01:34:36.531023+0000","last_fullsized":"2024-09-12T01:34:36.531023+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:29.002458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:39.649759+0000","last_change":"2024-09-12T00:46:26.562294+0000","last_active":"2024-09-12T01:35:39.649759+0000","last_peered":"2024-09-12T01:35:39.649759+0000","last_clean":"2024-09-12T01:35:39.649759+0000","last_became_active":"2024-09-12T00:46:26.561961+0000","last_became_peered":"2024-09-12T00:46:26.561961+0000","last_unstale":"2024-09-12T01:35:39.649759+0000","last_undegraded":"2024-09-12T01:35:39.649759+0000","last_fullsized":"2024-09-12T01:35:39.649759+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:55.068083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"260'5","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:41.725916+0000","last_change":"2024-09-12T00:46:22.351249+0000","last_active":"2024-09-12T01:34:41.725916+0000","last_peered":"2024-09-12T01:34:41.725916+0000","last_clean":"2024-09-12T01:34:41.725916+0000","last_became_active":"2024-09-12T00:46:22.350947+0000","last_became_peered":"2024-09-12T00:46:22.350947+0000","last_unstale":"2024-09-12T01:34:41.725916+0000","last_undegraded":"2024-09-12T01:34:41.725916+0000","last_fullsized":"2024-09-12T01:34:41.725916+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:16.221679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"263'28","reported_seq":136,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:49.651117+0000","last_change":"2024-09-12T00:42:36.815997+0000","last_active":"2024-09-12T01:35:49.651117+0000","last_peered":"2024-09-12T01:35:49.651117+0000","last_clean":"2024-09-12T01:35:49.651117+0000","last_became_active":"2024-09-12T00:42:36.815638+0000","last_became_peered":"2024-09-12T00:42:36.815638+0000","last_unstale":"2024-09-12T01:35:49.651117+0000","last_undegraded":"2024-09-12T01:35:49.651117+0000","last_fullsized":"2024-09-12T01:35:49.651117+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":103,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.724838+0000","last_change":"2024-09-12T01:04:15.391815+0000","last_active":"2024-09-12T01:34:36.724838+0000","last_peered":"2024-09-12T01:34:36.724838+0000","last_clean":"2024-09-12T01:34:36.724838+0000","last_became_active":"2024-09-12T01:04:15.391501+0000","last_became_peered":"2024-09-12T01:04:15.391501+0000","last_unstale":"2024-09-12T01:34:36.724838+0000","last_undegraded":"2024-09-12T01:34:36.724838+0000","last_fullsized":"2024-09-12T01:34:36.724838+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:28.795724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:49.644166+0000","last_change":"2024-09-12T00:46:26.563439+0000","last_active":"2024-09-12T01:34:49.644166+0000","last_peered":"2024-09-12T01:34:49.644166+0000","last_clean":"2024-09-12T01:34:49.644166+0000","last_became_active":"2024-09-12T00:46:26.563091+0000","last_became_peered":"2024-09-12T00:46:26.563091+0000","last_unstale":"2024-09-12T01:34:49.644166+0000","last_undegraded":"2024-09-12T01:34:49.644166+0000","last_fullsized":"2024-09-12T01:34:49.644166+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:05.796776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:41.531600+0000","last_change":"2024-09-12T00:46:22.354515+0000","last_active":"2024-09-12T01:34:41.531600+0000","last_peered":"2024-09-12T01:34:41.531600+0000","last_clean":"2024-09-12T01:34:41.531600+0000","last_became_active":"2024-09-12T00:46:22.354167+0000","last_became_peered":"2024-09-12T00:46:22.354167+0000","last_unstale":"2024-09-12T01:34:41.531600+0000","last_undegraded":"2024-09-12T01:34:41.531600+0000","last_fullsized":"2024-09-12T01:34:41.531600+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:09.196332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"260'8","reported_seq":82,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.538672+0000","last_change":"2024-09-12T00:42:36.803040+0000","last_active":"2024-09-12T01:35:46.538672+0000","last_peered":"2024-09-12T01:35:46.538672+0000","last_clean":"2024-09-12T01:35:46.538672+0000","last_became_active":"2024-09-12T00:42:36.802737+0000","last_became_peered":"2024-09-12T00:42:36.802737+0000","last_unstale":"2024-09-12T01:35:46.538672+0000","last_undegraded":"2024-09-12T01:35:46.538672+0000","last_fullsized":"2024-09-12T01:35:46.538672+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:37.786393+0000","last_change":"2024-09-12T01:04:15.393599+0000","last_active":"2024-09-12T01:34:37.786393+0000","last_peered":"2024-09-12T01:34:37.786393+0000","last_clean":"2024-09-12T01:34:37.786393+0000","last_became_active":"2024-09-12T01:04:15.393292+0000","last_became_peered":"2024-09-12T01:04:15.393292+0000","last_unstale":"2024-09-12T01:34:37.786393+0000","last_undegraded":"2024-09-12T01:34:37.786393+0000","last_fullsized":"2024-09-12T01:34:37.786393+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:04.044752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"263'3","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:11.562356+0000","last_change":"2024-09-12T00:46:26.371159+0000","last_active":"2024-09-12T01:37:11.562356+0000","last_peered":"2024-09-12T01:37:11.562356+0000","last_clean":"2024-09-12T01:37:11.562356+0000","last_became_active":"2024-09-12T00:46:26.370845+0000","last_became_peered":"2024-09-12T00:46:26.370845+0000","last_unstale":"2024-09-12T01:37:11.562356+0000","last_undegraded":"2024-09-12T01:37:11.562356+0000","last_fullsized":"2024-09-12T01:37:11.562356+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:36.995861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:41.789472+0000","last_change":"2024-09-12T00:46:22.349777+0000","last_active":"2024-09-12T01:34:41.789472+0000","last_peered":"2024-09-12T01:34:41.789472+0000","last_clean":"2024-09-12T01:34:41.789472+0000","last_became_active":"2024-09-12T00:46:22.348534+0000","last_became_peered":"2024-09-12T00:46:22.348534+0000","last_unstale":"2024-09-12T01:34:41.789472+0000","last_undegraded":"2024-09-12T01:34:41.789472+0000","last_fullsized":"2024-09-12T01:34:41.789472+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:19.642717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"263'16","reported_seq":98,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:11.721017+0000","last_change":"2024-09-12T00:42:36.812901+0000","last_active":"2024-09-12T01:34:11.721017+0000","last_peered":"2024-09-12T01:34:11.721017+0000","last_clean":"2024-09-12T01:34:11.721017+0000","last_became_active":"2024-09-12T00:42:36.812629+0000","last_became_peered":"2024-09-12T00:42:36.812629+0000","last_unstale":"2024-09-12T01:34:11.721017+0000","last_undegraded":"2024-09-12T01:34:11.721017+0000","last_fullsized":"2024-09-12T01:34:11.721017+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:44.152868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":48,"num_write":38,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:39.649821+0000","last_change":"2024-09-12T01:04:15.398685+0000","last_active":"2024-09-12T01:35:39.649821+0000","last_peered":"2024-09-12T01:35:39.649821+0000","last_clean":"2024-09-12T01:35:39.649821+0000","last_became_active":"2024-09-12T01:04:15.398407+0000","last_became_peered":"2024-09-12T01:04:15.398407+0000","last_unstale":"2024-09-12T01:35:39.649821+0000","last_undegraded":"2024-09-12T01:35:39.649821+0000","last_fullsized":"2024-09-12T01:35:39.649821+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:31.635332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"263'3","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.962291+0000","last_change":"2024-09-12T00:46:26.367154+0000","last_active":"2024-09-12T01:37:46.962291+0000","last_peered":"2024-09-12T01:37:46.962291+0000","last_clean":"2024-09-12T01:37:46.962291+0000","last_became_active":"2024-09-12T00:46:26.366602+0000","last_became_peered":"2024-09-12T00:46:26.366602+0000","last_unstale":"2024-09-12T01:37:46.962291+0000","last_undegraded":"2024-09-12T01:37:46.962291+0000","last_fullsized":"2024-09-12T01:37:46.962291+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:36.704535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"263'9","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.830640+0000","last_change":"2024-09-12T00:46:22.351729+0000","last_active":"2024-09-12T01:38:00.830640+0000","last_peered":"2024-09-12T01:38:00.830640+0000","last_clean":"2024-09-12T01:38:00.830640+0000","last_became_active":"2024-09-12T00:46:22.351432+0000","last_became_peered":"2024-09-12T00:46:22.351432+0000","last_unstale":"2024-09-12T01:38:00.830640+0000","last_undegraded":"2024-09-12T01:38:00.830640+0000","last_fullsized":"2024-09-12T01:38:00.830640+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:22.950636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":19,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"252'16","reported_seq":103,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.718650+0000","last_change":"2024-09-12T00:42:36.813580+0000","last_active":"2024-09-12T01:33:56.718650+0000","last_peered":"2024-09-12T01:33:56.718650+0000","last_clean":"2024-09-12T01:33:56.718650+0000","last_became_active":"2024-09-12T00:42:36.813324+0000","last_became_peered":"2024-09-12T00:42:36.813324+0000","last_unstale":"2024-09-12T01:33:56.718650+0000","last_undegraded":"2024-09-12T01:33:56.718650+0000","last_fullsized":"2024-09-12T01:33:56.718650+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:12.154346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":59,"num_write":21,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:41.796461+0000","last_change":"2024-09-12T01:04:15.394539+0000","last_active":"2024-09-12T01:35:41.796461+0000","last_peered":"2024-09-12T01:35:41.796461+0000","last_clean":"2024-09-12T01:35:41.796461+0000","last_became_active":"2024-09-12T01:04:15.393021+0000","last_became_peered":"2024-09-12T01:04:15.393021+0000","last_unstale":"2024-09-12T01:35:41.796461+0000","last_undegraded":"2024-09-12T01:35:41.796461+0000","last_fullsized":"2024-09-12T01:35:41.796461+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"260'8","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:26.945799+0000","last_change":"2024-09-12T00:46:26.371696+0000","last_active":"2024-09-12T01:35:26.945799+0000","last_peered":"2024-09-12T01:35:26.945799+0000","last_clean":"2024-09-12T01:35:26.945799+0000","last_became_active":"2024-09-12T00:46:26.371443+0000","last_became_peered":"2024-09-12T00:46:26.371443+0000","last_unstale":"2024-09-12T01:35:26.945799+0000","last_undegraded":"2024-09-12T01:35:26.945799+0000","last_fullsized":"2024-09-12T01:35:26.945799+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:26.396539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":26626,"num_write":8,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:24.648070+0000","last_change":"2024-09-12T00:46:22.352325+0000","last_active":"2024-09-12T01:35:24.648070+0000","last_peered":"2024-09-12T01:35:24.648070+0000","last_clean":"2024-09-12T01:35:24.648070+0000","last_became_active":"2024-09-12T00:46:22.350714+0000","last_became_peered":"2024-09-12T00:46:22.350714+0000","last_unstale":"2024-09-12T01:35:24.648070+0000","last_undegraded":"2024-09-12T01:35:24.648070+0000","last_fullsized":"2024-09-12T01:35:24.648070+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:40.578771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"263'52","reported_seq":201,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.783741+0000","last_change":"2024-09-12T00:42:36.818076+0000","last_active":"2024-09-12T01:33:56.783741+0000","last_peered":"2024-09-12T01:33:56.783741+0000","last_clean":"2024-09-12T01:33:56.783741+0000","last_became_active":"2024-09-12T00:42:36.817763+0000","last_became_peered":"2024-09-12T00:42:36.817763+0000","last_unstale":"2024-09-12T01:33:56.783741+0000","last_undegraded":"2024-09-12T01:33:56.783741+0000","last_fullsized":"2024-09-12T01:33:56.783741+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:56.184689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":268,"num_read_kb":195,"num_write":87,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.788740+0000","last_change":"2024-09-12T01:04:15.397100+0000","last_active":"2024-09-12T01:34:36.788740+0000","last_peered":"2024-09-12T01:34:36.788740+0000","last_clean":"2024-09-12T01:34:36.788740+0000","last_became_active":"2024-09-12T01:04:15.396832+0000","last_became_peered":"2024-09-12T01:04:15.396832+0000","last_unstale":"2024-09-12T01:34:36.788740+0000","last_undegraded":"2024-09-12T01:34:36.788740+0000","last_fullsized":"2024-09-12T01:34:36.788740+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:22.398122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:29.648642+0000","last_change":"2024-09-12T00:46:26.373712+0000","last_active":"2024-09-12T01:35:29.648642+0000","last_peered":"2024-09-12T01:35:29.648642+0000","last_clean":"2024-09-12T01:35:29.648642+0000","last_became_active":"2024-09-12T00:46:26.373401+0000","last_became_peered":"2024-09-12T00:46:26.373401+0000","last_unstale":"2024-09-12T01:35:29.648642+0000","last_undegraded":"2024-09-12T01:35:29.648642+0000","last_fullsized":"2024-09-12T01:35:29.648642+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:11.356426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:21.546124+0000","last_change":"2024-09-12T00:46:22.348093+0000","last_active":"2024-09-12T01:35:21.546124+0000","last_peered":"2024-09-12T01:35:21.546124+0000","last_clean":"2024-09-12T01:35:21.546124+0000","last_became_active":"2024-09-12T00:46:22.347794+0000","last_became_peered":"2024-09-12T00:46:22.347794+0000","last_unstale":"2024-09-12T01:35:21.546124+0000","last_undegraded":"2024-09-12T01:35:21.546124+0000","last_fullsized":"2024-09-12T01:35:21.546124+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:37.768628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'10","reported_seq":83,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.534383+0000","last_change":"2024-09-12T00:42:36.802979+0000","last_active":"2024-09-12T01:33:56.534383+0000","last_peered":"2024-09-12T01:33:56.534383+0000","last_clean":"2024-09-12T01:33:56.534383+0000","last_became_active":"2024-09-12T00:42:36.802647+0000","last_became_peered":"2024-09-12T00:42:36.802647+0000","last_unstale":"2024-09-12T01:33:56.534383+0000","last_undegraded":"2024-09-12T01:33:56.534383+0000","last_fullsized":"2024-09-12T01:33:56.534383+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:38.850484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":30,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:39.649795+0000","last_change":"2024-09-12T01:04:15.397994+0000","last_active":"2024-09-12T01:35:39.649795+0000","last_peered":"2024-09-12T01:35:39.649795+0000","last_clean":"2024-09-12T01:35:39.649795+0000","last_became_active":"2024-09-12T01:04:15.397646+0000","last_became_peered":"2024-09-12T01:04:15.397646+0000","last_unstale":"2024-09-12T01:35:39.649795+0000","last_undegraded":"2024-09-12T01:35:39.649795+0000","last_fullsized":"2024-09-12T01:35:39.649795+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:13.049264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"263'3","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.567221+0000","last_change":"2024-09-12T00:46:26.373701+0000","last_active":"2024-09-12T01:37:46.567221+0000","last_peered":"2024-09-12T01:37:46.567221+0000","last_clean":"2024-09-12T01:37:46.567221+0000","last_became_active":"2024-09-12T00:46:26.373354+0000","last_became_peered":"2024-09-12T00:46:26.373354+0000","last_unstale":"2024-09-12T01:37:46.567221+0000","last_undegraded":"2024-09-12T01:37:46.567221+0000","last_fullsized":"2024-09-12T01:37:46.567221+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:00.128990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:22.792606+0000","last_change":"2024-09-12T00:46:22.349188+0000","last_active":"2024-09-12T01:35:22.792606+0000","last_peered":"2024-09-12T01:35:22.792606+0000","last_clean":"2024-09-12T01:35:22.792606+0000","last_became_active":"2024-09-12T00:46:22.348875+0000","last_became_peered":"2024-09-12T00:46:22.348875+0000","last_unstale":"2024-09-12T01:35:22.792606+0000","last_undegraded":"2024-09-12T01:35:22.792606+0000","last_fullsized":"2024-09-12T01:35:22.792606+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:31.550301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"263'37","reported_seq":164,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:59.638083+0000","last_change":"2024-09-12T00:42:36.814630+0000","last_active":"2024-09-12T01:33:59.638083+0000","last_peered":"2024-09-12T01:33:59.638083+0000","last_clean":"2024-09-12T01:33:59.638083+0000","last_became_active":"2024-09-12T00:42:36.814235+0000","last_became_peered":"2024-09-12T00:42:36.814235+0000","last_unstale":"2024-09-12T01:33:59.638083+0000","last_undegraded":"2024-09-12T01:33:59.638083+0000","last_fullsized":"2024-09-12T01:33:59.638083+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:12.766338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":201,"num_read_kb":139,"num_write":71,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:51.532638+0000","last_change":"2024-09-12T01:04:15.396161+0000","last_active":"2024-09-12T01:34:51.532638+0000","last_peered":"2024-09-12T01:34:51.532638+0000","last_clean":"2024-09-12T01:34:51.532638+0000","last_became_active":"2024-09-12T01:04:15.395860+0000","last_became_peered":"2024-09-12T01:04:15.395860+0000","last_unstale":"2024-09-12T01:34:51.532638+0000","last_undegraded":"2024-09-12T01:34:51.532638+0000","last_fullsized":"2024-09-12T01:34:51.532638+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:49.503666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:59.652257+0000","last_change":"2024-09-12T00:46:26.373083+0000","last_active":"2024-09-12T01:35:59.652257+0000","last_peered":"2024-09-12T01:35:59.652257+0000","last_clean":"2024-09-12T01:35:59.652257+0000","last_became_active":"2024-09-12T00:46:26.372803+0000","last_became_peered":"2024-09-12T00:46:26.372803+0000","last_unstale":"2024-09-12T01:35:59.652257+0000","last_undegraded":"2024-09-12T01:35:59.652257+0000","last_fullsized":"2024-09-12T01:35:59.652257+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"263'9","reported_seq":67,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.744735+0000","last_change":"2024-09-12T00:46:22.356200+0000","last_active":"2024-09-12T01:38:01.744735+0000","last_peered":"2024-09-12T01:38:01.744735+0000","last_clean":"2024-09-12T01:38:01.744735+0000","last_became_active":"2024-09-12T00:46:22.355962+0000","last_became_peered":"2024-09-12T00:46:22.355962+0000","last_unstale":"2024-09-12T01:38:01.744735+0000","last_undegraded":"2024-09-12T01:38:01.744735+0000","last_fullsized":"2024-09-12T01:38:01.744735+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:15:50.421437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5707,"num_write":14,"num_write_kb":4683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"263'12","reported_seq":90,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:39.642863+0000","last_change":"2024-09-12T00:42:36.817087+0000","last_active":"2024-09-12T01:34:39.642863+0000","last_peered":"2024-09-12T01:34:39.642863+0000","last_clean":"2024-09-12T01:34:39.642863+0000","last_became_active":"2024-09-12T00:42:36.816673+0000","last_became_peered":"2024-09-12T00:42:36.816673+0000","last_unstale":"2024-09-12T01:34:39.642863+0000","last_undegraded":"2024-09-12T01:34:39.642863+0000","last_fullsized":"2024-09-12T01:34:39.642863+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:44.855498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":40,"num_write":24,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.736023+0000","last_change":"2024-09-12T01:04:15.393891+0000","last_active":"2024-09-12T01:35:46.736023+0000","last_peered":"2024-09-12T01:35:46.736023+0000","last_clean":"2024-09-12T01:35:46.736023+0000","last_became_active":"2024-09-12T01:04:15.393597+0000","last_became_peered":"2024-09-12T01:04:15.393597+0000","last_unstale":"2024-09-12T01:35:46.736023+0000","last_undegraded":"2024-09-12T01:35:46.736023+0000","last_fullsized":"2024-09-12T01:35:46.736023+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:33.585796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:59.652227+0000","last_change":"2024-09-12T00:46:26.366156+0000","last_active":"2024-09-12T01:35:59.652227+0000","last_peered":"2024-09-12T01:35:59.652227+0000","last_clean":"2024-09-12T01:35:59.652227+0000","last_became_active":"2024-09-12T00:46:26.365848+0000","last_became_peered":"2024-09-12T00:46:26.365848+0000","last_unstale":"2024-09-12T01:35:59.652227+0000","last_undegraded":"2024-09-12T01:35:59.652227+0000","last_fullsized":"2024-09-12T01:35:59.652227+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"263'3","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.235580+0000","last_change":"2024-09-12T00:46:22.351422+0000","last_active":"2024-09-12T01:38:00.235580+0000","last_peered":"2024-09-12T01:38:00.235580+0000","last_clean":"2024-09-12T01:38:00.235580+0000","last_became_active":"2024-09-12T00:46:22.350815+0000","last_became_peered":"2024-09-12T00:46:22.350815+0000","last_unstale":"2024-09-12T01:38:00.235580+0000","last_undegraded":"2024-09-12T01:38:00.235580+0000","last_fullsized":"2024-09-12T01:38:00.235580+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:04.321097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"263'49","reported_seq":188,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:22.784293+0000","last_change":"2024-09-12T00:42:36.811488+0000","last_active":"2024-09-12T01:34:22.784293+0000","last_peered":"2024-09-12T01:34:22.784293+0000","last_clean":"2024-09-12T01:34:22.784293+0000","last_became_active":"2024-09-12T00:42:36.810754+0000","last_became_peered":"2024-09-12T00:42:36.810754+0000","last_unstale":"2024-09-12T01:34:22.784293+0000","last_undegraded":"2024-09-12T01:34:22.784293+0000","last_fullsized":"2024-09-12T01:34:22.784293+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:12.064178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":240,"num_read_kb":165,"num_write":91,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.539582+0000","last_change":"2024-09-12T01:04:15.397399+0000","last_active":"2024-09-12T01:34:36.539582+0000","last_peered":"2024-09-12T01:34:36.539582+0000","last_clean":"2024-09-12T01:34:36.539582+0000","last_became_active":"2024-09-12T01:04:15.396999+0000","last_became_peered":"2024-09-12T01:04:15.396999+0000","last_unstale":"2024-09-12T01:34:36.539582+0000","last_undegraded":"2024-09-12T01:34:36.539582+0000","last_fullsized":"2024-09-12T01:34:36.539582+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:43.411584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:01.949606+0000","last_change":"2024-09-12T00:46:26.563322+0000","last_active":"2024-09-12T01:36:01.949606+0000","last_peered":"2024-09-12T01:36:01.949606+0000","last_clean":"2024-09-12T01:36:01.949606+0000","last_became_active":"2024-09-12T00:46:26.563041+0000","last_became_peered":"2024-09-12T00:46:26.563041+0000","last_unstale":"2024-09-12T01:36:01.949606+0000","last_undegraded":"2024-09-12T01:36:01.949606+0000","last_fullsized":"2024-09-12T01:36:01.949606+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:51.797572+0000","last_change":"2024-09-12T00:46:22.353183+0000","last_active":"2024-09-12T01:35:51.797572+0000","last_peered":"2024-09-12T01:35:51.797572+0000","last_clean":"2024-09-12T01:35:51.797572+0000","last_became_active":"2024-09-12T00:46:22.352933+0000","last_became_peered":"2024-09-12T00:46:22.352933+0000","last_unstale":"2024-09-12T01:35:51.797572+0000","last_undegraded":"2024-09-12T01:35:51.797572+0000","last_fullsized":"2024-09-12T01:35:51.797572+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"263'30","reported_seq":143,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:21.537673+0000","last_change":"2024-09-12T00:42:36.817007+0000","last_active":"2024-09-12T01:34:21.537673+0000","last_peered":"2024-09-12T01:34:21.537673+0000","last_clean":"2024-09-12T01:34:21.537673+0000","last_became_active":"2024-09-12T00:42:36.816619+0000","last_became_peered":"2024-09-12T00:42:36.816619+0000","last_unstale":"2024-09-12T01:34:21.537673+0000","last_undegraded":"2024-09-12T01:34:21.537673+0000","last_fullsized":"2024-09-12T01:34:21.537673+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:41.160245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":113,"num_write":55,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.724886+0000","last_change":"2024-09-12T01:04:15.396475+0000","last_active":"2024-09-12T01:34:36.724886+0000","last_peered":"2024-09-12T01:34:36.724886+0000","last_clean":"2024-09-12T01:34:36.724886+0000","last_became_active":"2024-09-12T01:04:15.396125+0000","last_became_peered":"2024-09-12T01:04:15.396125+0000","last_unstale":"2024-09-12T01:34:36.724886+0000","last_undegraded":"2024-09-12T01:34:36.724886+0000","last_fullsized":"2024-09-12T01:34:36.724886+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:47.673931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:59.652267+0000","last_change":"2024-09-12T00:46:26.366690+0000","last_active":"2024-09-12T01:35:59.652267+0000","last_peered":"2024-09-12T01:35:59.652267+0000","last_clean":"2024-09-12T01:35:59.652267+0000","last_became_active":"2024-09-12T00:46:26.366293+0000","last_became_peered":"2024-09-12T00:46:26.366293+0000","last_unstale":"2024-09-12T01:35:59.652267+0000","last_undegraded":"2024-09-12T01:35:59.652267+0000","last_fullsized":"2024-09-12T01:35:59.652267+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"263'3","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.294892+0000","last_change":"2024-09-12T00:46:22.348841+0000","last_active":"2024-09-12T01:38:00.294892+0000","last_peered":"2024-09-12T01:38:00.294892+0000","last_clean":"2024-09-12T01:38:00.294892+0000","last_became_active":"2024-09-12T00:46:22.348546+0000","last_became_peered":"2024-09-12T00:46:22.348546+0000","last_unstale":"2024-09-12T01:38:00.294892+0000","last_undegraded":"2024-09-12T01:38:00.294892+0000","last_fullsized":"2024-09-12T01:38:00.294892+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"263'34","reported_seq":149,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:21.630269+0000","last_change":"2024-09-12T00:42:36.817828+0000","last_active":"2024-09-12T01:34:21.630269+0000","last_peered":"2024-09-12T01:34:21.630269+0000","last_clean":"2024-09-12T01:34:21.630269+0000","last_became_active":"2024-09-12T00:42:36.817530+0000","last_became_peered":"2024-09-12T00:42:36.817530+0000","last_unstale":"2024-09-12T01:34:21.630269+0000","last_undegraded":"2024-09-12T01:34:21.630269+0000","last_fullsized":"2024-09-12T01:34:21.630269+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:04.364763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":117,"num_write":66,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:44.650432+0000","last_change":"2024-09-12T01:04:15.399818+0000","last_active":"2024-09-12T01:35:44.650432+0000","last_peered":"2024-09-12T01:35:44.650432+0000","last_clean":"2024-09-12T01:35:44.650432+0000","last_became_active":"2024-09-12T01:04:15.399564+0000","last_became_peered":"2024-09-12T01:04:15.399564+0000","last_unstale":"2024-09-12T01:35:44.650432+0000","last_undegraded":"2024-09-12T01:35:44.650432+0000","last_fullsized":"2024-09-12T01:35:44.650432+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:02.148148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"263'7","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.060005+0000","last_change":"2024-09-12T00:46:26.374247+0000","last_active":"2024-09-12T01:38:01.060005+0000","last_peered":"2024-09-12T01:38:01.060005+0000","last_clean":"2024-09-12T01:38:01.060005+0000","last_became_active":"2024-09-12T00:46:26.373942+0000","last_became_peered":"2024-09-12T00:46:26.373942+0000","last_unstale":"2024-09-12T01:38:01.060005+0000","last_undegraded":"2024-09-12T01:38:01.060005+0000","last_fullsized":"2024-09-12T01:38:01.060005+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8208,"num_write":12,"num_write_kb":8208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.799872+0000","last_change":"2024-09-12T00:46:22.352449+0000","last_active":"2024-09-12T01:36:11.799872+0000","last_peered":"2024-09-12T01:36:11.799872+0000","last_clean":"2024-09-12T01:36:11.799872+0000","last_became_active":"2024-09-12T00:46:22.352156+0000","last_became_peered":"2024-09-12T00:46:22.352156+0000","last_unstale":"2024-09-12T01:36:11.799872+0000","last_undegraded":"2024-09-12T01:36:11.799872+0000","last_fullsized":"2024-09-12T01:36:11.799872+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"263'10","reported_seq":83,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:21.786707+0000","last_change":"2024-09-12T00:42:36.817431+0000","last_active":"2024-09-12T01:34:21.786707+0000","last_peered":"2024-09-12T01:34:21.786707+0000","last_clean":"2024-09-12T01:34:21.786707+0000","last_became_active":"2024-09-12T00:42:36.817021+0000","last_became_peered":"2024-09-12T00:42:36.817021+0000","last_unstale":"2024-09-12T01:34:21.786707+0000","last_undegraded":"2024-09-12T01:34:21.786707+0000","last_fullsized":"2024-09-12T01:34:21.786707+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:32.868292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:56.737510+0000","last_change":"2024-09-12T01:04:15.396406+0000","last_active":"2024-09-12T01:35:56.737510+0000","last_peered":"2024-09-12T01:35:56.737510+0000","last_clean":"2024-09-12T01:35:56.737510+0000","last_became_active":"2024-09-12T01:04:15.396096+0000","last_became_peered":"2024-09-12T01:04:15.396096+0000","last_unstale":"2024-09-12T01:35:56.737510+0000","last_undegraded":"2024-09-12T01:35:56.737510+0000","last_fullsized":"2024-09-12T01:35:56.737510+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"260'5","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:16.740421+0000","last_change":"2024-09-12T00:46:26.562285+0000","last_active":"2024-09-12T01:36:16.740421+0000","last_peered":"2024-09-12T01:36:16.740421+0000","last_clean":"2024-09-12T01:36:16.740421+0000","last_became_active":"2024-09-12T00:46:26.561924+0000","last_became_peered":"2024-09-12T00:46:26.561924+0000","last_unstale":"2024-09-12T01:36:16.740421+0000","last_undegraded":"2024-09-12T01:36:16.740421+0000","last_fullsized":"2024-09-12T01:36:16.740421+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.950836+0000","last_change":"2024-09-12T00:46:22.350102+0000","last_active":"2024-09-12T01:36:11.950836+0000","last_peered":"2024-09-12T01:36:11.950836+0000","last_clean":"2024-09-12T01:36:11.950836+0000","last_became_active":"2024-09-12T00:46:22.349376+0000","last_became_peered":"2024-09-12T00:46:22.349376+0000","last_unstale":"2024-09-12T01:36:11.950836+0000","last_undegraded":"2024-09-12T01:36:11.950836+0000","last_fullsized":"2024-09-12T01:36:11.950836+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"263'30","reported_seq":144,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:51.727585+0000","last_change":"2024-09-12T00:42:36.810100+0000","last_active":"2024-09-12T01:34:51.727585+0000","last_peered":"2024-09-12T01:34:51.727585+0000","last_clean":"2024-09-12T01:34:51.727585+0000","last_became_active":"2024-09-12T00:42:36.809602+0000","last_became_peered":"2024-09-12T00:42:36.809602+0000","last_unstale":"2024-09-12T01:34:51.727585+0000","last_undegraded":"2024-09-12T01:34:51.727585+0000","last_fullsized":"2024-09-12T01:34:51.727585+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:44.821006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":112,"num_write":54,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"263'1","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.736044+0000","last_change":"2024-09-12T01:04:15.393241+0000","last_active":"2024-09-12T01:35:46.736044+0000","last_peered":"2024-09-12T01:35:46.736044+0000","last_clean":"2024-09-12T01:35:46.736044+0000","last_became_active":"2024-09-12T01:04:15.392789+0000","last_became_peered":"2024-09-12T01:04:15.392789+0000","last_unstale":"2024-09-12T01:35:46.736044+0000","last_undegraded":"2024-09-12T01:35:46.736044+0000","last_fullsized":"2024-09-12T01:35:46.736044+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:06.945446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"260'5","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:56.949041+0000","last_change":"2024-09-12T00:46:26.370237+0000","last_active":"2024-09-12T01:35:56.949041+0000","last_peered":"2024-09-12T01:35:56.949041+0000","last_clean":"2024-09-12T01:35:56.949041+0000","last_became_active":"2024-09-12T00:46:26.369883+0000","last_became_peered":"2024-09-12T00:46:26.369883+0000","last_unstale":"2024-09-12T01:35:56.949041+0000","last_undegraded":"2024-09-12T01:35:56.949041+0000","last_fullsized":"2024-09-12T01:35:56.949041+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:16.800540+0000","last_change":"2024-09-12T00:46:22.348999+0000","last_active":"2024-09-12T01:36:16.800540+0000","last_peered":"2024-09-12T01:36:16.800540+0000","last_clean":"2024-09-12T01:36:16.800540+0000","last_became_active":"2024-09-12T00:46:22.348568+0000","last_became_peered":"2024-09-12T00:46:22.348568+0000","last_unstale":"2024-09-12T01:36:16.800540+0000","last_undegraded":"2024-09-12T01:36:16.800540+0000","last_fullsized":"2024-09-12T01:36:16.800540+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"263'9","reported_seq":84,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:39.642740+0000","last_change":"2024-09-12T00:42:36.814268+0000","last_active":"2024-09-12T01:34:39.642740+0000","last_peered":"2024-09-12T01:34:39.642740+0000","last_clean":"2024-09-12T01:34:39.642740+0000","last_became_active":"2024-09-12T00:42:36.813997+0000","last_became_peered":"2024-09-12T00:42:36.813997+0000","last_unstale":"2024-09-12T01:34:39.642740+0000","last_undegraded":"2024-09-12T01:34:39.642740+0000","last_fullsized":"2024-09-12T01:34:39.642740+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:34.191233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.797023+0000","last_change":"2024-09-12T01:04:15.393511+0000","last_active":"2024-09-12T01:35:46.797023+0000","last_peered":"2024-09-12T01:35:46.797023+0000","last_clean":"2024-09-12T01:35:46.797023+0000","last_became_active":"2024-09-12T01:04:15.393220+0000","last_became_peered":"2024-09-12T01:04:15.393220+0000","last_unstale":"2024-09-12T01:35:46.797023+0000","last_undegraded":"2024-09-12T01:35:46.797023+0000","last_fullsized":"2024-09-12T01:35:46.797023+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:27.528771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"263'2","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:26.741954+0000","last_change":"2024-09-12T00:46:26.370629+0000","last_active":"2024-09-12T01:36:26.741954+0000","last_peered":"2024-09-12T01:36:26.741954+0000","last_clean":"2024-09-12T01:36:26.741954+0000","last_became_active":"2024-09-12T00:46:26.370349+0000","last_became_peered":"2024-09-12T00:46:26.370349+0000","last_unstale":"2024-09-12T01:36:26.741954+0000","last_undegraded":"2024-09-12T01:36:26.741954+0000","last_fullsized":"2024-09-12T01:36:26.741954+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:26.584727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"263'11","reported_seq":77,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.934169+0000","last_change":"2024-09-12T00:46:22.346319+0000","last_active":"2024-09-12T01:38:00.934169+0000","last_peered":"2024-09-12T01:38:00.934169+0000","last_clean":"2024-09-12T01:38:00.934169+0000","last_became_active":"2024-09-12T00:46:22.346024+0000","last_became_peered":"2024-09-12T00:46:22.346024+0000","last_unstale":"2024-09-12T01:38:00.934169+0000","last_undegraded":"2024-09-12T01:38:00.934169+0000","last_fullsized":"2024-09-12T01:38:00.934169+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:06.683878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":32770,"num_write":16,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"263'38","reported_seq":159,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.539545+0000","last_change":"2024-09-12T00:42:36.809663+0000","last_active":"2024-09-12T01:34:36.539545+0000","last_peered":"2024-09-12T01:34:36.539545+0000","last_clean":"2024-09-12T01:34:36.539545+0000","last_became_active":"2024-09-12T00:42:36.809350+0000","last_became_peered":"2024-09-12T00:42:36.809350+0000","last_unstale":"2024-09-12T01:34:36.539545+0000","last_undegraded":"2024-09-12T01:34:36.539545+0000","last_fullsized":"2024-09-12T01:34:36.539545+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:37.120320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":127,"num_write":71,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:31.733691+0000","last_change":"2024-09-12T01:04:15.395069+0000","last_active":"2024-09-12T01:35:31.733691+0000","last_peered":"2024-09-12T01:35:31.733691+0000","last_clean":"2024-09-12T01:35:31.733691+0000","last_became_active":"2024-09-12T01:04:15.394795+0000","last_became_peered":"2024-09-12T01:04:15.394795+0000","last_unstale":"2024-09-12T01:35:31.733691+0000","last_undegraded":"2024-09-12T01:35:31.733691+0000","last_fullsized":"2024-09-12T01:35:31.733691+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:28.070748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"263'2","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:31.802388+0000","last_change":"2024-09-12T00:46:26.368134+0000","last_active":"2024-09-12T01:36:31.802388+0000","last_peered":"2024-09-12T01:36:31.802388+0000","last_clean":"2024-09-12T01:36:31.802388+0000","last_became_active":"2024-09-12T00:46:26.367852+0000","last_became_peered":"2024-09-12T00:46:26.367852+0000","last_unstale":"2024-09-12T01:36:31.802388+0000","last_undegraded":"2024-09-12T01:36:31.802388+0000","last_fullsized":"2024-09-12T01:36:31.802388+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:38.753123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1142,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"260'3","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:21.741257+0000","last_change":"2024-09-12T00:46:22.351593+0000","last_active":"2024-09-12T01:36:21.741257+0000","last_peered":"2024-09-12T01:36:21.741257+0000","last_clean":"2024-09-12T01:36:21.741257+0000","last_became_active":"2024-09-12T00:46:22.351237+0000","last_became_peered":"2024-09-12T00:46:22.351237+0000","last_unstale":"2024-09-12T01:36:21.741257+0000","last_undegraded":"2024-09-12T01:36:21.741257+0000","last_fullsized":"2024-09-12T01:36:21.741257+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'36","reported_seq":159,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.788869+0000","last_change":"2024-09-12T00:42:36.819102+0000","last_active":"2024-09-12T01:34:36.788869+0000","last_peered":"2024-09-12T01:34:36.788869+0000","last_clean":"2024-09-12T01:34:36.788869+0000","last_became_active":"2024-09-12T00:42:36.818852+0000","last_became_peered":"2024-09-12T00:42:36.818852+0000","last_unstale":"2024-09-12T01:34:36.788869+0000","last_undegraded":"2024-09-12T01:34:36.788869+0000","last_fullsized":"2024-09-12T01:34:36.788869+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:23.943088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":132,"num_write":65,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:32.794132+0000","last_change":"2024-09-12T01:04:15.393939+0000","last_active":"2024-09-12T01:35:32.794132+0000","last_peered":"2024-09-12T01:35:32.794132+0000","last_clean":"2024-09-12T01:35:32.794132+0000","last_became_active":"2024-09-12T01:04:15.393651+0000","last_became_peered":"2024-09-12T01:04:15.393651+0000","last_unstale":"2024-09-12T01:35:32.794132+0000","last_undegraded":"2024-09-12T01:35:32.794132+0000","last_fullsized":"2024-09-12T01:35:32.794132+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:16.671263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"263'5","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:26.801703+0000","last_change":"2024-09-12T00:46:26.563573+0000","last_active":"2024-09-12T01:36:26.801703+0000","last_peered":"2024-09-12T01:36:26.801703+0000","last_clean":"2024-09-12T01:36:26.801703+0000","last_became_active":"2024-09-12T00:46:26.563277+0000","last_became_peered":"2024-09-12T00:46:26.563277+0000","last_unstale":"2024-09-12T01:36:26.801703+0000","last_undegraded":"2024-09-12T01:36:26.801703+0000","last_fullsized":"2024-09-12T01:36:26.801703+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:09.897827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":7168,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:31.631288+0000","last_change":"2024-09-12T00:46:22.351630+0000","last_active":"2024-09-12T01:34:31.631288+0000","last_peered":"2024-09-12T01:34:31.631288+0000","last_clean":"2024-09-12T01:34:31.631288+0000","last_became_active":"2024-09-12T00:46:22.351162+0000","last_became_peered":"2024-09-12T00:46:22.351162+0000","last_unstale":"2024-09-12T01:34:31.631288+0000","last_undegraded":"2024-09-12T01:34:31.631288+0000","last_fullsized":"2024-09-12T01:34:31.631288+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:07.137302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"263'20","reported_seq":113,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.539639+0000","last_change":"2024-09-12T00:42:36.815139+0000","last_active":"2024-09-12T01:34:36.539639+0000","last_peered":"2024-09-12T01:34:36.539639+0000","last_clean":"2024-09-12T01:34:36.539639+0000","last_became_active":"2024-09-12T00:42:36.814845+0000","last_became_peered":"2024-09-12T00:42:36.814845+0000","last_unstale":"2024-09-12T01:34:36.539639+0000","last_undegraded":"2024-09-12T01:34:36.539639+0000","last_fullsized":"2024-09-12T01:34:36.539639+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:26.879251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":75,"num_write":35,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:16.951486+0000","last_change":"2024-09-12T01:04:15.388704+0000","last_active":"2024-09-12T01:36:16.951486+0000","last_peered":"2024-09-12T01:36:16.951486+0000","last_clean":"2024-09-12T01:36:16.951486+0000","last_became_active":"2024-09-12T01:04:15.388423+0000","last_became_peered":"2024-09-12T01:04:15.388423+0000","last_unstale":"2024-09-12T01:36:16.951486+0000","last_undegraded":"2024-09-12T01:36:16.951486+0000","last_fullsized":"2024-09-12T01:36:16.951486+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:16.740599+0000","last_change":"2024-09-12T00:46:26.565006+0000","last_active":"2024-09-12T01:36:16.740599+0000","last_peered":"2024-09-12T01:36:16.740599+0000","last_clean":"2024-09-12T01:36:16.740599+0000","last_became_active":"2024-09-12T00:46:26.564771+0000","last_became_peered":"2024-09-12T00:46:26.564771+0000","last_unstale":"2024-09-12T01:36:16.740599+0000","last_undegraded":"2024-09-12T01:36:16.740599+0000","last_fullsized":"2024-09-12T01:36:16.740599+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"260'3","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:07.799372+0000","last_change":"2024-09-12T00:46:22.350365+0000","last_active":"2024-09-12T01:36:07.799372+0000","last_peered":"2024-09-12T01:36:07.799372+0000","last_clean":"2024-09-12T01:36:07.799372+0000","last_became_active":"2024-09-12T00:46:22.350045+0000","last_became_peered":"2024-09-12T00:46:22.350045+0000","last_unstale":"2024-09-12T01:36:07.799372+0000","last_undegraded":"2024-09-12T01:36:07.799372+0000","last_fullsized":"2024-09-12T01:36:07.799372+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"263'41","reported_seq":169,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:56.728429+0000","last_change":"2024-09-12T00:42:36.814530+0000","last_active":"2024-09-12T01:34:56.728429+0000","last_peered":"2024-09-12T01:34:56.728429+0000","last_clean":"2024-09-12T01:34:56.728429+0000","last_became_active":"2024-09-12T00:42:36.814228+0000","last_became_peered":"2024-09-12T00:42:36.814228+0000","last_unstale":"2024-09-12T01:34:56.728429+0000","last_undegraded":"2024-09-12T01:34:56.728429+0000","last_fullsized":"2024-09-12T01:34:56.728429+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:19.454136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":139,"num_write":79,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:31.547532+0000","last_change":"2024-09-12T01:04:15.388771+0000","last_active":"2024-09-12T01:35:31.547532+0000","last_peered":"2024-09-12T01:35:31.547532+0000","last_clean":"2024-09-12T01:35:31.547532+0000","last_became_active":"2024-09-12T01:04:15.388492+0000","last_became_peered":"2024-09-12T01:04:15.388492+0000","last_unstale":"2024-09-12T01:35:31.547532+0000","last_undegraded":"2024-09-12T01:35:31.547532+0000","last_fullsized":"2024-09-12T01:35:31.547532+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:40.040155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:16.554539+0000","last_change":"2024-09-12T00:46:26.369312+0000","last_active":"2024-09-12T01:36:16.554539+0000","last_peered":"2024-09-12T01:36:16.554539+0000","last_clean":"2024-09-12T01:36:16.554539+0000","last_became_active":"2024-09-12T00:46:26.369004+0000","last_became_peered":"2024-09-12T00:46:26.369004+0000","last_unstale":"2024-09-12T01:36:16.554539+0000","last_undegraded":"2024-09-12T01:36:16.554539+0000","last_fullsized":"2024-09-12T01:36:16.554539+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.739916+0000","last_change":"2024-09-12T00:46:22.354042+0000","last_active":"2024-09-12T01:36:11.739916+0000","last_peered":"2024-09-12T01:36:11.739916+0000","last_clean":"2024-09-12T01:36:11.739916+0000","last_became_active":"2024-09-12T00:46:22.353747+0000","last_became_peered":"2024-09-12T00:46:22.353747+0000","last_unstale":"2024-09-12T01:36:11.739916+0000","last_undegraded":"2024-09-12T01:36:11.739916+0000","last_fullsized":"2024-09-12T01:36:11.739916+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"263'8","reported_seq":80,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:41.940572+0000","last_change":"2024-09-12T00:42:36.809380+0000","last_active":"2024-09-12T01:34:41.940572+0000","last_peered":"2024-09-12T01:34:41.940572+0000","last_clean":"2024-09-12T01:34:41.940572+0000","last_became_active":"2024-09-12T00:42:36.808945+0000","last_became_peered":"2024-09-12T00:42:36.808945+0000","last_unstale":"2024-09-12T01:34:41.940572+0000","last_undegraded":"2024-09-12T01:34:41.940572+0000","last_fullsized":"2024-09-12T01:34:41.940572+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:08.194856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":23,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"262'1","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.531103+0000","last_change":"2024-09-12T01:04:15.395533+0000","last_active":"2024-09-12T01:34:36.531103+0000","last_peered":"2024-09-12T01:34:36.531103+0000","last_clean":"2024-09-12T01:34:36.531103+0000","last_became_active":"2024-09-12T01:04:15.395223+0000","last_became_peered":"2024-09-12T01:04:15.395223+0000","last_unstale":"2024-09-12T01:34:36.531103+0000","last_undegraded":"2024-09-12T01:34:36.531103+0000","last_fullsized":"2024-09-12T01:34:36.531103+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:54.625901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"260'2","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:21.937069+0000","last_change":"2024-09-12T00:46:26.367308+0000","last_active":"2024-09-12T01:34:21.937069+0000","last_peered":"2024-09-12T01:34:21.937069+0000","last_clean":"2024-09-12T01:34:21.937069+0000","last_became_active":"2024-09-12T00:46:26.367039+0000","last_became_peered":"2024-09-12T00:46:26.367039+0000","last_unstale":"2024-09-12T01:34:21.937069+0000","last_undegraded":"2024-09-12T01:34:21.937069+0000","last_fullsized":"2024-09-12T01:34:21.937069+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:30.091487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"263'2","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:31.742697+0000","last_change":"2024-09-12T00:46:22.350076+0000","last_active":"2024-09-12T01:36:31.742697+0000","last_peered":"2024-09-12T01:36:31.742697+0000","last_clean":"2024-09-12T01:36:31.742697+0000","last_became_active":"2024-09-12T00:46:22.349779+0000","last_became_peered":"2024-09-12T00:46:22.349779+0000","last_unstale":"2024-09-12T01:36:31.742697+0000","last_undegraded":"2024-09-12T01:36:31.742697+0000","last_fullsized":"2024-09-12T01:36:31.742697+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:41.826282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":5,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"263'23","reported_seq":123,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:42.787235+0000","last_change":"2024-09-12T00:42:36.811265+0000","last_active":"2024-09-12T01:34:42.787235+0000","last_peered":"2024-09-12T01:34:42.787235+0000","last_clean":"2024-09-12T01:34:42.787235+0000","last_became_active":"2024-09-12T00:42:36.810979+0000","last_became_peered":"2024-09-12T00:42:36.810979+0000","last_unstale":"2024-09-12T01:34:42.787235+0000","last_undegraded":"2024-09-12T01:34:42.787235+0000","last_fullsized":"2024-09-12T01:34:42.787235+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:56.532046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":82,"num_write":51,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.788829+0000","last_change":"2024-09-12T01:04:15.388624+0000","last_active":"2024-09-12T01:34:36.788829+0000","last_peered":"2024-09-12T01:34:36.788829+0000","last_clean":"2024-09-12T01:34:36.788829+0000","last_became_active":"2024-09-12T01:04:15.388331+0000","last_became_peered":"2024-09-12T01:04:15.388331+0000","last_unstale":"2024-09-12T01:34:36.788829+0000","last_undegraded":"2024-09-12T01:34:36.788829+0000","last_fullsized":"2024-09-12T01:34:36.788829+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:07.975645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"260'5","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:32.785494+0000","last_change":"2024-09-12T00:46:26.370948+0000","last_active":"2024-09-12T01:34:32.785494+0000","last_peered":"2024-09-12T01:34:32.785494+0000","last_clean":"2024-09-12T01:34:32.785494+0000","last_became_active":"2024-09-12T00:46:26.370448+0000","last_became_peered":"2024-09-12T00:46:26.370448+0000","last_unstale":"2024-09-12T01:34:32.785494+0000","last_undegraded":"2024-09-12T01:34:32.785494+0000","last_fullsized":"2024-09-12T01:34:32.785494+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:41.502037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"263'2","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.934255+0000","last_change":"2024-09-12T00:46:22.354072+0000","last_active":"2024-09-12T01:38:00.934255+0000","last_peered":"2024-09-12T01:38:00.934255+0000","last_clean":"2024-09-12T01:38:00.934255+0000","last_became_active":"2024-09-12T00:46:22.353796+0000","last_became_peered":"2024-09-12T00:46:22.353796+0000","last_unstale":"2024-09-12T01:38:00.934255+0000","last_undegraded":"2024-09-12T01:38:00.934255+0000","last_fullsized":"2024-09-12T01:38:00.934255+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"263'41","reported_seq":174,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:41.540574+0000","last_change":"2024-09-12T00:42:36.814983+0000","last_active":"2024-09-12T01:34:41.540574+0000","last_peered":"2024-09-12T01:34:41.540574+0000","last_clean":"2024-09-12T01:34:41.540574+0000","last_became_active":"2024-09-12T00:42:36.814700+0000","last_became_peered":"2024-09-12T00:42:36.814700+0000","last_unstale":"2024-09-12T01:34:41.540574+0000","last_undegraded":"2024-09-12T01:34:41.540574+0000","last_fullsized":"2024-09-12T01:34:41.540574+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:47.477989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":150,"num_write":75,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:31.795233+0000","last_change":"2024-09-12T01:04:15.393354+0000","last_active":"2024-09-12T01:35:31.795233+0000","last_peered":"2024-09-12T01:35:31.795233+0000","last_clean":"2024-09-12T01:35:31.795233+0000","last_became_active":"2024-09-12T01:04:15.392129+0000","last_became_peered":"2024-09-12T01:04:15.392129+0000","last_unstale":"2024-09-12T01:35:31.795233+0000","last_undegraded":"2024-09-12T01:35:31.795233+0000","last_fullsized":"2024-09-12T01:35:31.795233+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:07.333078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:21.537643+0000","last_change":"2024-09-12T00:46:26.374929+0000","last_active":"2024-09-12T01:34:21.537643+0000","last_peered":"2024-09-12T01:34:21.537643+0000","last_clean":"2024-09-12T01:34:21.537643+0000","last_became_active":"2024-09-12T00:46:26.374630+0000","last_became_peered":"2024-09-12T00:46:26.374630+0000","last_unstale":"2024-09-12T01:34:21.537643+0000","last_undegraded":"2024-09-12T01:34:21.537643+0000","last_fullsized":"2024-09-12T01:34:21.537643+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:40.273744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:21.952091+0000","last_change":"2024-09-12T00:46:22.345808+0000","last_active":"2024-09-12T01:36:21.952091+0000","last_peered":"2024-09-12T01:36:21.952091+0000","last_clean":"2024-09-12T01:36:21.952091+0000","last_became_active":"2024-09-12T00:46:22.345455+0000","last_became_peered":"2024-09-12T00:46:22.345455+0000","last_unstale":"2024-09-12T01:36:21.952091+0000","last_undegraded":"2024-09-12T01:36:21.952091+0000","last_fullsized":"2024-09-12T01:36:21.952091+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"263'47","reported_seq":185,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:41.540334+0000","last_change":"2024-09-12T00:42:36.810603+0000","last_active":"2024-09-12T01:34:41.540334+0000","last_peered":"2024-09-12T01:34:41.540334+0000","last_clean":"2024-09-12T01:34:41.540334+0000","last_became_active":"2024-09-12T00:42:36.810179+0000","last_became_peered":"2024-09-12T00:42:36.810179+0000","last_unstale":"2024-09-12T01:34:41.540334+0000","last_undegraded":"2024-09-12T01:34:41.540334+0000","last_fullsized":"2024-09-12T01:34:41.540334+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:20.658302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":235,"num_read_kb":167,"num_write":78,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:41.735210+0000","last_change":"2024-09-12T01:04:15.393713+0000","last_active":"2024-09-12T01:35:41.735210+0000","last_peered":"2024-09-12T01:35:41.735210+0000","last_clean":"2024-09-12T01:35:41.735210+0000","last_became_active":"2024-09-12T01:04:15.393424+0000","last_became_peered":"2024-09-12T01:04:15.393424+0000","last_unstale":"2024-09-12T01:35:41.735210+0000","last_undegraded":"2024-09-12T01:35:41.735210+0000","last_fullsized":"2024-09-12T01:35:41.735210+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:46.950196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"260'6","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:21.537798+0000","last_change":"2024-09-12T00:46:26.372459+0000","last_active":"2024-09-12T01:34:21.537798+0000","last_peered":"2024-09-12T01:34:21.537798+0000","last_clean":"2024-09-12T01:34:21.537798+0000","last_became_active":"2024-09-12T00:46:26.372169+0000","last_became_peered":"2024-09-12T00:46:26.372169+0000","last_unstale":"2024-09-12T01:34:21.537798+0000","last_undegraded":"2024-09-12T01:34:21.537798+0000","last_fullsized":"2024-09-12T01:34:21.537798+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:20.872522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"263'5","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.121609+0000","last_change":"2024-09-12T00:46:22.350497+0000","last_active":"2024-09-12T01:38:01.121609+0000","last_peered":"2024-09-12T01:38:01.121609+0000","last_clean":"2024-09-12T01:38:01.121609+0000","last_became_active":"2024-09-12T00:46:22.350210+0000","last_became_peered":"2024-09-12T00:46:22.350210+0000","last_unstale":"2024-09-12T01:38:01.121609+0000","last_undegraded":"2024-09-12T01:38:01.121609+0000","last_fullsized":"2024-09-12T01:38:01.121609+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4096,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"260'15","reported_seq":102,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:51.727537+0000","last_change":"2024-09-12T00:42:36.810443+0000","last_active":"2024-09-12T01:34:51.727537+0000","last_peered":"2024-09-12T01:34:51.727537+0000","last_clean":"2024-09-12T01:34:51.727537+0000","last_became_active":"2024-09-12T00:42:36.810110+0000","last_became_peered":"2024-09-12T00:42:36.810110+0000","last_unstale":"2024-09-12T01:34:51.727537+0000","last_undegraded":"2024-09-12T01:34:51.727537+0000","last_fullsized":"2024-09-12T01:34:51.727537+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:11.301801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":54,"num_write":27,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"263'304","reported_seq":921,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:24.416620+0000","last_change":"2024-09-12T01:38:24.416620+0000","last_active":"2024-09-12T01:38:24.416620+0000","last_peered":"2024-09-12T01:38:24.416620+0000","last_clean":"2024-09-12T01:38:24.416620+0000","last_became_active":"2024-09-12T00:28:31.201886+0000","last_became_peered":"2024-09-12T00:28:31.201886+0000","last_unstale":"2024-09-12T01:38:24.416620+0000","last_undegraded":"2024-09-12T01:38:24.416620+0000","last_fullsized":"2024-09-12T01:38:24.416620+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'304","last_scrub_stamp":"2024-09-12T01:38:24.416516+0000","last_deep_scrub":"263'304","last_deep_scrub_stamp":"2024-09-12T01:38:24.416516+0000","last_clean_scrub_stamp":"2024-09-12T01:38:24.416516+0000","objects_scrubbed":5,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:25.833677+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":380,"num_read_kb":9626,"num_write":915,"num_write_kb":19266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"263'157","reported_seq":722,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:32.776738+0000","last_change":"2024-09-12T00:28:33.211480+0000","last_active":"2024-09-12T01:33:32.776738+0000","last_peered":"2024-09-12T01:33:32.776738+0000","last_clean":"2024-09-12T01:33:32.776738+0000","last_became_active":"2024-09-12T00:28:33.211182+0000","last_became_peered":"2024-09-12T00:28:33.211182+0000","last_unstale":"2024-09-12T01:33:32.776738+0000","last_undegraded":"2024-09-12T01:33:32.776738+0000","last_fullsized":"2024-09-12T01:33:32.776738+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:45.597820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":685,"num_read_kb":553,"num_write":251,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"263'303","reported_seq":1021,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.170633+0000","last_change":"2024-09-12T01:38:13.170633+0000","last_active":"2024-09-12T01:38:13.170633+0000","last_peered":"2024-09-12T01:38:13.170633+0000","last_clean":"2024-09-12T01:38:13.170633+0000","last_became_active":"2024-09-12T00:28:31.204561+0000","last_became_peered":"2024-09-12T00:28:31.204561+0000","last_unstale":"2024-09-12T01:38:13.170633+0000","last_undegraded":"2024-09-12T01:38:13.170633+0000","last_fullsized":"2024-09-12T01:38:13.170633+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'303","last_scrub_stamp":"2024-09-12T01:38:13.170492+0000","last_deep_scrub":"263'303","last_deep_scrub_stamp":"2024-09-12T01:38:13.170492+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.170492+0000","objects_scrubbed":7,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:13.390983+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243127,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":598,"num_read_kb":14276,"num_write":1032,"num_write_kb":31679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"263'59","reported_seq":627,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:26.393537+0000","last_change":"2024-09-12T01:38:26.393537+0000","last_active":"2024-09-12T01:38:26.393537+0000","last_peered":"2024-09-12T01:38:26.393537+0000","last_clean":"2024-09-12T01:38:26.393537+0000","last_became_active":"2024-09-12T00:28:33.217028+0000","last_became_peered":"2024-09-12T00:28:33.217028+0000","last_unstale":"2024-09-12T01:38:26.393537+0000","last_undegraded":"2024-09-12T01:38:26.393537+0000","last_fullsized":"2024-09-12T01:38:26.393537+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'59","last_scrub_stamp":"2024-09-12T01:38:26.393448+0000","last_deep_scrub":"263'59","last_deep_scrub_stamp":"2024-09-12T01:38:26.393448+0000","last_clean_scrub_stamp":"2024-09-12T01:38:26.393448+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:46.060664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":252,"num_read_kb":216,"num_write":87,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"263'337","reported_seq":1204,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.036839+0000","last_change":"2024-09-12T01:38:14.036839+0000","last_active":"2024-09-12T01:38:14.036839+0000","last_peered":"2024-09-12T01:38:14.036839+0000","last_clean":"2024-09-12T01:38:14.036839+0000","last_became_active":"2024-09-12T00:28:31.203351+0000","last_became_peered":"2024-09-12T00:28:31.203351+0000","last_unstale":"2024-09-12T01:38:14.036839+0000","last_undegraded":"2024-09-12T01:38:14.036839+0000","last_fullsized":"2024-09-12T01:38:14.036839+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'337","last_scrub_stamp":"2024-09-12T01:38:14.036713+0000","last_deep_scrub":"263'337","last_deep_scrub_stamp":"2024-09-12T01:38:14.036713+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.036713+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:13.619013+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306757,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":934,"num_read_kb":42793,"num_write":1132,"num_write_kb":18824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"263'429","reported_seq":1181,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:25.554814+0000","last_change":"2024-09-12T01:38:25.554814+0000","last_active":"2024-09-12T01:38:25.554814+0000","last_peered":"2024-09-12T01:38:25.554814+0000","last_clean":"2024-09-12T01:38:25.554814+0000","last_became_active":"2024-09-12T00:28:33.217215+0000","last_became_peered":"2024-09-12T00:28:33.217215+0000","last_unstale":"2024-09-12T01:38:25.554814+0000","last_undegraded":"2024-09-12T01:38:25.554814+0000","last_fullsized":"2024-09-12T01:38:25.554814+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'429","last_scrub_stamp":"2024-09-12T01:38:25.554727+0000","last_deep_scrub":"263'429","last_deep_scrub_stamp":"2024-09-12T01:38:25.554727+0000","last_clean_scrub_stamp":"2024-09-12T01:38:25.554727+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":400,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:43.252309+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2092,"num_read_kb":1758,"num_write":778,"num_write_kb":522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"263'382","reported_seq":1082,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.353995+0000","last_change":"2024-09-12T01:38:21.353995+0000","last_active":"2024-09-12T01:38:21.353995+0000","last_peered":"2024-09-12T01:38:21.353995+0000","last_clean":"2024-09-12T01:38:21.353995+0000","last_became_active":"2024-09-12T00:28:31.213595+0000","last_became_peered":"2024-09-12T00:28:31.213595+0000","last_unstale":"2024-09-12T01:38:21.353995+0000","last_undegraded":"2024-09-12T01:38:21.353995+0000","last_fullsized":"2024-09-12T01:38:21.353995+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'382","last_scrub_stamp":"2024-09-12T01:38:21.353886+0000","last_deep_scrub":"263'382","last_deep_scrub_stamp":"2024-09-12T01:38:21.353886+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.353886+0000","objects_scrubbed":6,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:32.927736+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1440418,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":629,"num_read_kb":11143,"num_write":1163,"num_write_kb":15238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"263'289","reported_seq":921,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:49.421430+0000","last_change":"2024-09-12T00:28:33.218650+0000","last_active":"2024-09-12T01:33:49.421430+0000","last_peered":"2024-09-12T01:33:49.421430+0000","last_clean":"2024-09-12T01:33:49.421430+0000","last_became_active":"2024-09-12T00:28:33.218393+0000","last_became_peered":"2024-09-12T00:28:33.218393+0000","last_unstale":"2024-09-12T01:33:49.421430+0000","last_undegraded":"2024-09-12T01:33:49.421430+0000","last_fullsized":"2024-09-12T01:33:49.421430+0000","mapping_epoch":27,"log_start":"260'200","ondisk_log_start":"260'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:52.716266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1288,"num_read_kb":1088,"num_write":481,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"263'321","reported_seq":923,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.314117+0000","last_change":"2024-09-12T01:38:21.314117+0000","last_active":"2024-09-12T01:38:21.314117+0000","last_peered":"2024-09-12T01:38:21.314117+0000","last_clean":"2024-09-12T01:38:21.314117+0000","last_became_active":"2024-09-12T00:28:31.204962+0000","last_became_peered":"2024-09-12T00:28:31.204962+0000","last_unstale":"2024-09-12T01:38:21.314117+0000","last_undegraded":"2024-09-12T01:38:21.314117+0000","last_fullsized":"2024-09-12T01:38:21.314117+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'321","last_scrub_stamp":"2024-09-12T01:38:21.314001+0000","last_deep_scrub":"263'321","last_deep_scrub_stamp":"2024-09-12T01:38:21.314001+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.314001+0000","objects_scrubbed":5,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:15.820622+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170194,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":404,"num_read_kb":1209,"num_write":989,"num_write_kb":17836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"263'4176","reported_seq":4804,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.172692+0000","last_change":"2024-09-12T01:38:22.172692+0000","last_active":"2024-09-12T01:38:22.172692+0000","last_peered":"2024-09-12T01:38:22.172692+0000","last_clean":"2024-09-12T01:38:22.172692+0000","last_became_active":"2024-09-12T00:28:33.214515+0000","last_became_peered":"2024-09-12T00:28:33.214515+0000","last_unstale":"2024-09-12T01:38:22.172692+0000","last_undegraded":"2024-09-12T01:38:22.172692+0000","last_fullsized":"2024-09-12T01:38:22.172692+0000","mapping_epoch":27,"log_start":"263'4100","ondisk_log_start":"263'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4176","last_scrub_stamp":"2024-09-12T01:38:22.172610+0000","last_deep_scrub":"263'4176","last_deep_scrub_stamp":"2024-09-12T01:38:22.172610+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.172610+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":3000,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:13.652374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16813,"num_read_kb":14096,"num_write":6273,"num_write_kb":3125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"263'405","reported_seq":1060,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:23.354602+0000","last_change":"2024-09-12T01:38:23.354602+0000","last_active":"2024-09-12T01:38:23.354602+0000","last_peered":"2024-09-12T01:38:23.354602+0000","last_clean":"2024-09-12T01:38:23.354602+0000","last_became_active":"2024-09-12T00:28:31.212573+0000","last_became_peered":"2024-09-12T00:28:31.212573+0000","last_unstale":"2024-09-12T01:38:23.354602+0000","last_undegraded":"2024-09-12T01:38:23.354602+0000","last_fullsized":"2024-09-12T01:38:23.354602+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'405","last_scrub_stamp":"2024-09-12T01:38:23.354510+0000","last_deep_scrub":"263'405","last_deep_scrub_stamp":"2024-09-12T01:38:23.354510+0000","last_clean_scrub_stamp":"2024-09-12T01:38:23.354510+0000","objects_scrubbed":7,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:30.422460+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568635,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":601,"num_read_kb":12450,"num_write":1255,"num_write_kb":24719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"263'260","reported_seq":970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.545564+0000","last_change":"2024-09-12T00:28:33.213811+0000","last_active":"2024-09-12T01:35:16.545564+0000","last_peered":"2024-09-12T01:35:16.545564+0000","last_clean":"2024-09-12T01:35:16.545564+0000","last_became_active":"2024-09-12T00:28:33.213014+0000","last_became_peered":"2024-09-12T00:28:33.213014+0000","last_unstale":"2024-09-12T01:35:16.545564+0000","last_undegraded":"2024-09-12T01:35:16.545564+0000","last_fullsized":"2024-09-12T01:35:16.545564+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:25.774640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1431,"num_read_kb":1278,"num_write":426,"num_write_kb":225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"263'323","reported_seq":966,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.283699+0000","last_change":"2024-09-12T01:38:20.283699+0000","last_active":"2024-09-12T01:38:20.283699+0000","last_peered":"2024-09-12T01:38:20.283699+0000","last_clean":"2024-09-12T01:38:20.283699+0000","last_became_active":"2024-09-12T00:28:31.210039+0000","last_became_peered":"2024-09-12T00:28:31.210039+0000","last_unstale":"2024-09-12T01:38:20.283699+0000","last_undegraded":"2024-09-12T01:38:20.283699+0000","last_fullsized":"2024-09-12T01:38:20.283699+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'323","last_scrub_stamp":"2024-09-12T01:38:20.283603+0000","last_deep_scrub":"263'323","last_deep_scrub_stamp":"2024-09-12T01:38:20.283603+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.283603+0000","objects_scrubbed":5,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:00.352419+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262189,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":473,"num_read_kb":7448,"num_write":1018,"num_write_kb":42696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"263'277","reported_seq":963,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:17.791987+0000","last_change":"2024-09-12T00:28:33.217908+0000","last_active":"2024-09-12T01:35:17.791987+0000","last_peered":"2024-09-12T01:35:17.791987+0000","last_clean":"2024-09-12T01:35:17.791987+0000","last_became_active":"2024-09-12T00:28:33.216856+0000","last_became_peered":"2024-09-12T00:28:33.216856+0000","last_unstale":"2024-09-12T01:35:17.791987+0000","last_undegraded":"2024-09-12T01:35:17.791987+0000","last_fullsized":"2024-09-12T01:35:17.791987+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:14.540790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1252,"num_read_kb":1029,"num_write":416,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"263'323","reported_seq":942,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:25.274440+0000","last_change":"2024-09-12T01:38:25.274440+0000","last_active":"2024-09-12T01:38:25.274440+0000","last_peered":"2024-09-12T01:38:25.274440+0000","last_clean":"2024-09-12T01:38:25.274440+0000","last_became_active":"2024-09-12T00:28:31.213172+0000","last_became_peered":"2024-09-12T00:28:31.213172+0000","last_unstale":"2024-09-12T01:38:25.274440+0000","last_undegraded":"2024-09-12T01:38:25.274440+0000","last_fullsized":"2024-09-12T01:38:25.274440+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'323","last_scrub_stamp":"2024-09-12T01:38:25.274349+0000","last_deep_scrub":"263'323","last_deep_scrub_stamp":"2024-09-12T01:38:25.274349+0000","last_clean_scrub_stamp":"2024-09-12T01:38:25.274349+0000","objects_scrubbed":5,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:20.497013+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1657979,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":448,"num_read_kb":13792,"num_write":975,"num_write_kb":26598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"263'108","reported_seq":726,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.719896+0000","last_change":"2024-09-12T01:38:15.719896+0000","last_active":"2024-09-12T01:38:15.719896+0000","last_peered":"2024-09-12T01:38:15.719896+0000","last_clean":"2024-09-12T01:38:15.719896+0000","last_became_active":"2024-09-12T00:28:33.206296+0000","last_became_peered":"2024-09-12T00:28:33.206296+0000","last_unstale":"2024-09-12T01:38:15.719896+0000","last_undegraded":"2024-09-12T01:38:15.719896+0000","last_fullsized":"2024-09-12T01:38:15.719896+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'108","last_scrub_stamp":"2024-09-12T01:38:15.719809+0000","last_deep_scrub":"263'108","last_deep_scrub_stamp":"2024-09-12T01:38:15.719809+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.719809+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:07.737417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":463,"num_read_kb":402,"num_write":161,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"263'4150","reported_seq":4763,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:24.517843+0000","last_change":"2024-09-12T01:38:24.517843+0000","last_active":"2024-09-12T01:38:24.517843+0000","last_peered":"2024-09-12T01:38:24.517843+0000","last_clean":"2024-09-12T01:38:24.517843+0000","last_became_active":"2024-09-12T00:28:33.213777+0000","last_became_peered":"2024-09-12T00:28:33.213777+0000","last_unstale":"2024-09-12T01:38:24.517843+0000","last_undegraded":"2024-09-12T01:38:24.517843+0000","last_fullsized":"2024-09-12T01:38:24.517843+0000","mapping_epoch":27,"log_start":"263'4100","ondisk_log_start":"263'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4150","last_scrub_stamp":"2024-09-12T01:38:24.517726+0000","last_deep_scrub":"263'4150","last_deep_scrub_stamp":"2024-09-12T01:38:24.517726+0000","last_clean_scrub_stamp":"2024-09-12T01:38:24.517726+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":3000,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:14.431730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16687,"num_read_kb":13992,"num_write":6250,"num_write_kb":3125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"263'389","reported_seq":1025,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.696924+0000","last_change":"2024-09-12T01:38:12.696924+0000","last_active":"2024-09-12T01:38:12.696924+0000","last_peered":"2024-09-12T01:38:12.696924+0000","last_clean":"2024-09-12T01:38:12.696924+0000","last_became_active":"2024-09-12T00:29:04.274377+0000","last_became_peered":"2024-09-12T00:29:04.274377+0000","last_unstale":"2024-09-12T01:38:12.696924+0000","last_undegraded":"2024-09-12T01:38:12.696924+0000","last_fullsized":"2024-09-12T01:38:12.696924+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'389","last_scrub_stamp":"2024-09-12T01:38:12.696814+0000","last_deep_scrub":"263'389","last_deep_scrub_stamp":"2024-09-12T01:38:12.696814+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.696814+0000","objects_scrubbed":6,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:54.981263+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568865,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":569,"num_read_kb":2856,"num_write":1189,"num_write_kb":27657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"263'295","reported_seq":943,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:25.405638+0000","last_change":"2024-09-12T01:38:25.405638+0000","last_active":"2024-09-12T01:38:25.405638+0000","last_peered":"2024-09-12T01:38:25.405638+0000","last_clean":"2024-09-12T01:38:25.405638+0000","last_became_active":"2024-09-12T00:28:33.218660+0000","last_became_peered":"2024-09-12T00:28:33.218660+0000","last_unstale":"2024-09-12T01:38:25.405638+0000","last_undegraded":"2024-09-12T01:38:25.405638+0000","last_fullsized":"2024-09-12T01:38:25.405638+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'295","last_scrub_stamp":"2024-09-12T01:38:25.405555+0000","last_deep_scrub":"263'295","last_deep_scrub_stamp":"2024-09-12T01:38:25.405555+0000","last_clean_scrub_stamp":"2024-09-12T01:38:25.405555+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:09.677150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1306,"num_read_kb":1072,"num_write":479,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"263'371","reported_seq":1042,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.100566+0000","last_change":"2024-09-12T01:38:16.100566+0000","last_active":"2024-09-12T01:38:16.100566+0000","last_peered":"2024-09-12T01:38:16.100566+0000","last_clean":"2024-09-12T01:38:16.100566+0000","last_became_active":"2024-09-12T00:28:31.213388+0000","last_became_peered":"2024-09-12T00:28:31.213388+0000","last_unstale":"2024-09-12T01:38:16.100566+0000","last_undegraded":"2024-09-12T01:38:16.100566+0000","last_fullsized":"2024-09-12T01:38:16.100566+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'371","last_scrub_stamp":"2024-09-12T01:38:16.100452+0000","last_deep_scrub":"263'371","last_deep_scrub_stamp":"2024-09-12T01:38:16.100452+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.100452+0000","objects_scrubbed":7,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:47.142311+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133695,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":588,"num_read_kb":20058,"num_write":1150,"num_write_kb":40619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"263'90","reported_seq":681,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:27.422148+0000","last_change":"2024-09-12T01:38:27.422148+0000","last_active":"2024-09-12T01:38:27.422148+0000","last_peered":"2024-09-12T01:38:27.422148+0000","last_clean":"2024-09-12T01:38:27.422148+0000","last_became_active":"2024-09-12T00:28:33.213998+0000","last_became_peered":"2024-09-12T00:28:33.213998+0000","last_unstale":"2024-09-12T01:38:27.422148+0000","last_undegraded":"2024-09-12T01:38:27.422148+0000","last_fullsized":"2024-09-12T01:38:27.422148+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'90","last_scrub_stamp":"2024-09-12T01:38:27.422064+0000","last_deep_scrub":"263'90","last_deep_scrub_stamp":"2024-09-12T01:38:27.422064+0000","last_clean_scrub_stamp":"2024-09-12T01:38:27.422064+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:02.338451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":414,"num_read_kb":350,"num_write":126,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"263'353","reported_seq":1073,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.108241+0000","last_change":"2024-09-12T01:38:14.108241+0000","last_active":"2024-09-12T01:38:14.108241+0000","last_peered":"2024-09-12T01:38:14.108241+0000","last_clean":"2024-09-12T01:38:14.108241+0000","last_became_active":"2024-09-12T00:28:31.215230+0000","last_became_peered":"2024-09-12T00:28:31.215230+0000","last_unstale":"2024-09-12T01:38:14.108241+0000","last_undegraded":"2024-09-12T01:38:14.108241+0000","last_fullsized":"2024-09-12T01:38:14.108241+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'353","last_scrub_stamp":"2024-09-12T01:38:14.108148+0000","last_deep_scrub":"263'353","last_deep_scrub_stamp":"2024-09-12T01:38:14.108148+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.108148+0000","objects_scrubbed":4,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:21.237357+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254836,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":624,"num_read_kb":115792,"num_write":1091,"num_write_kb":22723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"263'230","reported_seq":860,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.727989+0000","last_change":"2024-09-12T01:38:14.727989+0000","last_active":"2024-09-12T01:38:14.727989+0000","last_peered":"2024-09-12T01:38:14.727989+0000","last_clean":"2024-09-12T01:38:14.727989+0000","last_became_active":"2024-09-12T00:28:33.206305+0000","last_became_peered":"2024-09-12T00:28:33.206305+0000","last_unstale":"2024-09-12T01:38:14.727989+0000","last_undegraded":"2024-09-12T01:38:14.727989+0000","last_fullsized":"2024-09-12T01:38:14.727989+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'230","last_scrub_stamp":"2024-09-12T01:38:14.727900+0000","last_deep_scrub":"263'230","last_deep_scrub_stamp":"2024-09-12T01:38:14.727900+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.727900+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:41.691362+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":971,"num_read_kb":790,"num_write":344,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"263'421","reported_seq":1158,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.506130+0000","last_change":"2024-09-12T01:38:10.506130+0000","last_active":"2024-09-12T01:38:10.506130+0000","last_peered":"2024-09-12T01:38:10.506130+0000","last_clean":"2024-09-12T01:38:10.506130+0000","last_became_active":"2024-09-12T00:28:31.199779+0000","last_became_peered":"2024-09-12T00:28:31.199779+0000","last_unstale":"2024-09-12T01:38:10.506130+0000","last_undegraded":"2024-09-12T01:38:10.506130+0000","last_fullsized":"2024-09-12T01:38:10.506130+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'421","last_scrub_stamp":"2024-09-12T01:38:10.506027+0000","last_deep_scrub":"263'421","last_deep_scrub_stamp":"2024-09-12T01:38:10.506027+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.506027+0000","objects_scrubbed":8,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:11.152787+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306267,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":669,"num_read_kb":69035,"num_write":1318,"num_write_kb":57878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"263'150","reported_seq":808,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:23.751611+0000","last_change":"2024-09-12T01:38:23.751611+0000","last_active":"2024-09-12T01:38:23.751611+0000","last_peered":"2024-09-12T01:38:23.751611+0000","last_clean":"2024-09-12T01:38:23.751611+0000","last_became_active":"2024-09-12T00:28:33.208831+0000","last_became_peered":"2024-09-12T00:28:33.208831+0000","last_unstale":"2024-09-12T01:38:23.751611+0000","last_undegraded":"2024-09-12T01:38:23.751611+0000","last_fullsized":"2024-09-12T01:38:23.751611+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'150","last_scrub_stamp":"2024-09-12T01:38:23.751512+0000","last_deep_scrub":"263'150","last_deep_scrub_stamp":"2024-09-12T01:38:23.751512+0000","last_clean_scrub_stamp":"2024-09-12T01:38:23.751512+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:11.911885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":710,"num_read_kb":600,"num_write":211,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"263'405","reported_seq":1059,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.205241+0000","last_change":"2024-09-12T01:38:14.205241+0000","last_active":"2024-09-12T01:38:14.205241+0000","last_peered":"2024-09-12T01:38:14.205241+0000","last_clean":"2024-09-12T01:38:14.205241+0000","last_became_active":"2024-09-12T00:28:31.202245+0000","last_became_peered":"2024-09-12T00:28:31.202245+0000","last_unstale":"2024-09-12T01:38:14.205241+0000","last_undegraded":"2024-09-12T01:38:14.205241+0000","last_fullsized":"2024-09-12T01:38:14.205241+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'405","last_scrub_stamp":"2024-09-12T01:38:14.205130+0000","last_deep_scrub":"263'405","last_deep_scrub_stamp":"2024-09-12T01:38:14.205130+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.205130+0000","objects_scrubbed":8,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:57.720032+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":558,"num_read_kb":23094,"num_write":1344,"num_write_kb":58944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"263'113","reported_seq":727,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:26.561527+0000","last_change":"2024-09-12T01:38:26.561527+0000","last_active":"2024-09-12T01:38:26.561527+0000","last_peered":"2024-09-12T01:38:26.561527+0000","last_clean":"2024-09-12T01:38:26.561527+0000","last_became_active":"2024-09-12T00:28:33.207527+0000","last_became_peered":"2024-09-12T00:28:33.207527+0000","last_unstale":"2024-09-12T01:38:26.561527+0000","last_undegraded":"2024-09-12T01:38:26.561527+0000","last_fullsized":"2024-09-12T01:38:26.561527+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'113","last_scrub_stamp":"2024-09-12T01:38:26.561433+0000","last_deep_scrub":"263'113","last_deep_scrub_stamp":"2024-09-12T01:38:26.561433+0000","last_clean_scrub_stamp":"2024-09-12T01:38:26.561433+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:15.140885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":515,"num_read_kb":438,"num_write":174,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"263'316","reported_seq":983,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.078901+0000","last_change":"2024-09-12T01:38:11.078901+0000","last_active":"2024-09-12T01:38:11.078901+0000","last_peered":"2024-09-12T01:38:11.078901+0000","last_clean":"2024-09-12T01:38:11.078901+0000","last_became_active":"2024-09-12T00:28:31.203048+0000","last_became_peered":"2024-09-12T00:28:31.203048+0000","last_unstale":"2024-09-12T01:38:11.078901+0000","last_undegraded":"2024-09-12T01:38:11.078901+0000","last_fullsized":"2024-09-12T01:38:11.078901+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'316","last_scrub_stamp":"2024-09-12T01:38:11.078811+0000","last_deep_scrub":"263'316","last_deep_scrub_stamp":"2024-09-12T01:38:11.078811+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.078811+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:13.632696+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524344,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":495,"num_read_kb":45596,"num_write":1045,"num_write_kb":35489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"263'106","reported_seq":617,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:42.693662+0000","last_change":"2024-09-12T00:28:41.227253+0000","last_active":"2024-09-12T01:36:42.693662+0000","last_peered":"2024-09-12T01:36:42.693662+0000","last_clean":"2024-09-12T01:36:42.693662+0000","last_became_active":"2024-09-12T00:28:41.226952+0000","last_became_peered":"2024-09-12T00:28:41.226952+0000","last_unstale":"2024-09-12T01:36:42.693662+0000","last_undegraded":"2024-09-12T01:36:42.693662+0000","last_fullsized":"2024-09-12T01:36:42.693662+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:26.588660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":155,"num_read_kb":144,"num_write":259,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"263'188","reported_seq":780,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.217081+0000","last_change":"2024-09-12T01:38:17.217081+0000","last_active":"2024-09-12T01:38:17.217081+0000","last_peered":"2024-09-12T01:38:17.217081+0000","last_clean":"2024-09-12T01:38:17.217081+0000","last_became_active":"2024-09-12T00:28:33.209521+0000","last_became_peered":"2024-09-12T00:28:33.209521+0000","last_unstale":"2024-09-12T01:38:17.217081+0000","last_undegraded":"2024-09-12T01:38:17.217081+0000","last_fullsized":"2024-09-12T01:38:17.217081+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'188","last_scrub_stamp":"2024-09-12T01:38:17.216936+0000","last_deep_scrub":"263'188","last_deep_scrub_stamp":"2024-09-12T01:38:17.216936+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.216936+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:48.308382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":834,"num_read_kb":672,"num_write":307,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"263'362","reported_seq":974,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.290235+0000","last_change":"2024-09-12T01:38:17.290235+0000","last_active":"2024-09-12T01:38:17.290235+0000","last_peered":"2024-09-12T01:38:17.290235+0000","last_clean":"2024-09-12T01:38:17.290235+0000","last_became_active":"2024-09-12T00:28:31.206010+0000","last_became_peered":"2024-09-12T00:28:31.206010+0000","last_unstale":"2024-09-12T01:38:17.290235+0000","last_undegraded":"2024-09-12T01:38:17.290235+0000","last_fullsized":"2024-09-12T01:38:17.290235+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'362","last_scrub_stamp":"2024-09-12T01:38:17.290125+0000","last_deep_scrub":"263'362","last_deep_scrub_stamp":"2024-09-12T01:38:17.290125+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.290125+0000","objects_scrubbed":9,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:31.994331+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":430,"num_read_kb":5592,"num_write":1103,"num_write_kb":25256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:47.779150+0000","last_change":"2024-09-12T00:28:35.212219+0000","last_active":"2024-09-12T01:33:47.779150+0000","last_peered":"2024-09-12T01:33:47.779150+0000","last_clean":"2024-09-12T01:33:47.779150+0000","last_became_active":"2024-09-12T00:28:35.211231+0000","last_became_peered":"2024-09-12T00:28:35.211231+0000","last_unstale":"2024-09-12T01:33:47.779150+0000","last_undegraded":"2024-09-12T01:33:47.779150+0000","last_fullsized":"2024-09-12T01:33:47.779150+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:10.530098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"263'348","reported_seq":970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.628118+0000","last_change":"2024-09-12T00:28:37.216446+0000","last_active":"2024-09-12T01:38:01.628118+0000","last_peered":"2024-09-12T01:38:01.628118+0000","last_clean":"2024-09-12T01:38:01.628118+0000","last_became_active":"2024-09-12T00:28:37.216169+0000","last_became_peered":"2024-09-12T00:28:37.216169+0000","last_unstale":"2024-09-12T01:38:01.628118+0000","last_undegraded":"2024-09-12T01:38:01.628118+0000","last_fullsized":"2024-09-12T01:38:01.628118+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:12.966316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44362,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":554,"num_read_kb":1122,"num_write":430,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.718741+0000","last_change":"2024-09-12T00:28:39.214249+0000","last_active":"2024-09-12T01:33:56.718741+0000","last_peered":"2024-09-12T01:33:56.718741+0000","last_clean":"2024-09-12T01:33:56.718741+0000","last_became_active":"2024-09-12T00:28:39.213942+0000","last_became_peered":"2024-09-12T00:28:39.213942+0000","last_unstale":"2024-09-12T01:33:56.718741+0000","last_undegraded":"2024-09-12T01:33:56.718741+0000","last_fullsized":"2024-09-12T01:33:56.718741+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:13.977918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"263'182","reported_seq":733,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:39.518790+0000","last_change":"2024-09-12T00:28:41.229922+0000","last_active":"2024-09-12T01:36:39.518790+0000","last_peered":"2024-09-12T01:36:39.518790+0000","last_clean":"2024-09-12T01:36:39.518790+0000","last_became_active":"2024-09-12T00:28:41.229608+0000","last_became_peered":"2024-09-12T00:28:41.229608+0000","last_unstale":"2024-09-12T01:36:39.518790+0000","last_undegraded":"2024-09-12T01:36:39.518790+0000","last_fullsized":"2024-09-12T01:36:39.518790+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:00.176000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":231,"num_read_kb":225,"num_write":383,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"263'212","reported_seq":821,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:24.382381+0000","last_change":"2024-09-12T01:38:24.382381+0000","last_active":"2024-09-12T01:38:24.382381+0000","last_peered":"2024-09-12T01:38:24.382381+0000","last_clean":"2024-09-12T01:38:24.382381+0000","last_became_active":"2024-09-12T00:28:33.212334+0000","last_became_peered":"2024-09-12T00:28:33.212334+0000","last_unstale":"2024-09-12T01:38:24.382381+0000","last_undegraded":"2024-09-12T01:38:24.382381+0000","last_fullsized":"2024-09-12T01:38:24.382381+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'212","last_scrub_stamp":"2024-09-12T01:38:24.382297+0000","last_deep_scrub":"263'212","last_deep_scrub_stamp":"2024-09-12T01:38:24.382297+0000","last_clean_scrub_stamp":"2024-09-12T01:38:24.382297+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:06.630505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":883,"num_read_kb":721,"num_write":311,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"263'332","reported_seq":997,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:09.077241+0000","last_change":"2024-09-12T01:38:09.077241+0000","last_active":"2024-09-12T01:38:09.077241+0000","last_peered":"2024-09-12T01:38:09.077241+0000","last_clean":"2024-09-12T01:38:09.077241+0000","last_became_active":"2024-09-12T00:28:31.208141+0000","last_became_peered":"2024-09-12T00:28:31.208141+0000","last_unstale":"2024-09-12T01:38:09.077241+0000","last_undegraded":"2024-09-12T01:38:09.077241+0000","last_fullsized":"2024-09-12T01:38:09.077241+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'332","last_scrub_stamp":"2024-09-12T01:38:09.077147+0000","last_deep_scrub":"263'332","last_deep_scrub_stamp":"2024-09-12T01:38:09.077147+0000","last_clean_scrub_stamp":"2024-09-12T01:38:09.077147+0000","objects_scrubbed":8,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:39.882962+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395868,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":543,"num_read_kb":93032,"num_write":945,"num_write_kb":55506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:09.639557+0000","last_change":"2024-09-12T00:28:35.213065+0000","last_active":"2024-09-12T01:34:09.639557+0000","last_peered":"2024-09-12T01:34:09.639557+0000","last_clean":"2024-09-12T01:34:09.639557+0000","last_became_active":"2024-09-12T00:28:35.212745+0000","last_became_peered":"2024-09-12T00:28:35.212745+0000","last_unstale":"2024-09-12T01:34:09.639557+0000","last_undegraded":"2024-09-12T01:34:09.639557+0000","last_fullsized":"2024-09-12T01:34:09.639557+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:29.695288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"263'92","reported_seq":630,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:16.554571+0000","last_change":"2024-09-12T00:28:37.221408+0000","last_active":"2024-09-12T01:36:16.554571+0000","last_peered":"2024-09-12T01:36:16.554571+0000","last_clean":"2024-09-12T01:36:16.554571+0000","last_became_active":"2024-09-12T00:28:37.220899+0000","last_became_peered":"2024-09-12T00:28:37.220899+0000","last_unstale":"2024-09-12T01:36:16.554571+0000","last_undegraded":"2024-09-12T01:36:16.554571+0000","last_fullsized":"2024-09-12T01:36:16.554571+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:45.174607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":118,"num_read_kb":113,"num_write":78,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.534538+0000","last_change":"2024-09-12T00:28:39.222836+0000","last_active":"2024-09-12T01:33:56.534538+0000","last_peered":"2024-09-12T01:33:56.534538+0000","last_clean":"2024-09-12T01:33:56.534538+0000","last_became_active":"2024-09-12T00:28:39.222553+0000","last_became_peered":"2024-09-12T00:28:39.222553+0000","last_unstale":"2024-09-12T01:33:56.534538+0000","last_undegraded":"2024-09-12T01:33:56.534538+0000","last_fullsized":"2024-09-12T01:33:56.534538+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:57.986714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"263'126","reported_seq":631,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:42.376957+0000","last_change":"2024-09-12T00:28:41.228569+0000","last_active":"2024-09-12T01:36:42.376957+0000","last_peered":"2024-09-12T01:36:42.376957+0000","last_clean":"2024-09-12T01:36:42.376957+0000","last_became_active":"2024-09-12T00:28:41.228305+0000","last_became_peered":"2024-09-12T00:28:41.228305+0000","last_unstale":"2024-09-12T01:36:42.376957+0000","last_undegraded":"2024-09-12T01:36:42.376957+0000","last_fullsized":"2024-09-12T01:36:42.376957+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:24.274319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":144,"num_read_kb":135,"num_write":299,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"263'197","reported_seq":850,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.026708+0000","last_change":"2024-09-12T01:38:15.026708+0000","last_active":"2024-09-12T01:38:15.026708+0000","last_peered":"2024-09-12T01:38:15.026708+0000","last_clean":"2024-09-12T01:38:15.026708+0000","last_became_active":"2024-09-12T00:28:33.219082+0000","last_became_peered":"2024-09-12T00:28:33.219082+0000","last_unstale":"2024-09-12T01:38:15.026708+0000","last_undegraded":"2024-09-12T01:38:15.026708+0000","last_fullsized":"2024-09-12T01:38:15.026708+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'197","last_scrub_stamp":"2024-09-12T01:38:15.026624+0000","last_deep_scrub":"263'197","last_deep_scrub_stamp":"2024-09-12T01:38:15.026624+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.026624+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:40.437735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":923,"num_read_kb":768,"num_write":333,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"263'386","reported_seq":1021,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.293459+0000","last_change":"2024-09-12T01:38:14.293459+0000","last_active":"2024-09-12T01:38:14.293459+0000","last_peered":"2024-09-12T01:38:14.293459+0000","last_clean":"2024-09-12T01:38:14.293459+0000","last_became_active":"2024-09-12T00:28:31.204223+0000","last_became_peered":"2024-09-12T00:28:31.204223+0000","last_unstale":"2024-09-12T01:38:14.293459+0000","last_undegraded":"2024-09-12T01:38:14.293459+0000","last_fullsized":"2024-09-12T01:38:14.293459+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'386","last_scrub_stamp":"2024-09-12T01:38:14.293320+0000","last_deep_scrub":"263'386","last_deep_scrub_stamp":"2024-09-12T01:38:14.293320+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.293320+0000","objects_scrubbed":10,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:55.332433+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133695,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":536,"num_read_kb":1739,"num_write":1185,"num_write_kb":22527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:49.637009+0000","last_change":"2024-09-12T00:28:35.212684+0000","last_active":"2024-09-12T01:33:49.637009+0000","last_peered":"2024-09-12T01:33:49.637009+0000","last_clean":"2024-09-12T01:33:49.637009+0000","last_became_active":"2024-09-12T00:28:35.212197+0000","last_became_peered":"2024-09-12T00:28:35.212197+0000","last_unstale":"2024-09-12T01:33:49.637009+0000","last_undegraded":"2024-09-12T01:33:49.637009+0000","last_fullsized":"2024-09-12T01:33:49.637009+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:02.479666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"263'140","reported_seq":708,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:25.699196+0000","last_change":"2024-09-12T01:38:25.699196+0000","last_active":"2024-09-12T01:38:25.699196+0000","last_peered":"2024-09-12T01:38:25.699196+0000","last_clean":"2024-09-12T01:38:25.699196+0000","last_became_active":"2024-09-12T00:28:37.220665+0000","last_became_peered":"2024-09-12T00:28:37.220665+0000","last_unstale":"2024-09-12T01:38:25.699196+0000","last_undegraded":"2024-09-12T01:38:25.699196+0000","last_fullsized":"2024-09-12T01:38:25.699196+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'140","last_scrub_stamp":"2024-09-12T01:38:25.699105+0000","last_deep_scrub":"263'140","last_deep_scrub_stamp":"2024-09-12T01:38:25.699105+0000","last_clean_scrub_stamp":"2024-09-12T01:38:25.699105+0000","objects_scrubbed":7,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:46.861174+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":170,"num_read_kb":162,"num_write":114,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"263'768","reported_seq":4807,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.290625+0000","last_change":"2024-09-12T00:28:39.218836+0000","last_active":"2024-09-12T01:38:01.290625+0000","last_peered":"2024-09-12T01:38:01.290625+0000","last_clean":"2024-09-12T01:38:01.290625+0000","last_became_active":"2024-09-12T00:28:39.218476+0000","last_became_peered":"2024-09-12T00:28:39.218476+0000","last_unstale":"2024-09-12T01:38:01.290625+0000","last_undegraded":"2024-09-12T01:38:01.290625+0000","last_fullsized":"2024-09-12T01:38:01.290625+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:48.644746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"263'191","reported_seq":1014,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:41.653002+0000","last_change":"2024-09-12T00:28:41.257967+0000","last_active":"2024-09-12T01:36:41.653002+0000","last_peered":"2024-09-12T01:36:41.653002+0000","last_clean":"2024-09-12T01:36:41.653002+0000","last_became_active":"2024-09-12T00:28:41.257679+0000","last_became_peered":"2024-09-12T00:28:41.257679+0000","last_unstale":"2024-09-12T01:36:41.653002+0000","last_undegraded":"2024-09-12T01:36:41.653002+0000","last_fullsized":"2024-09-12T01:36:41.653002+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:03.811468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":583,"num_read_kb":580,"num_write":423,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"263'82","reported_seq":635,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.209303+0000","last_change":"2024-09-12T01:38:16.209303+0000","last_active":"2024-09-12T01:38:16.209303+0000","last_peered":"2024-09-12T01:38:16.209303+0000","last_clean":"2024-09-12T01:38:16.209303+0000","last_became_active":"2024-09-12T00:28:33.212564+0000","last_became_peered":"2024-09-12T00:28:33.212564+0000","last_unstale":"2024-09-12T01:38:16.209303+0000","last_undegraded":"2024-09-12T01:38:16.209303+0000","last_fullsized":"2024-09-12T01:38:16.209303+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'82","last_scrub_stamp":"2024-09-12T01:38:16.209203+0000","last_deep_scrub":"263'82","last_deep_scrub_stamp":"2024-09-12T01:38:16.209203+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.209203+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:28.323813+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":372,"num_read_kb":309,"num_write":130,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"263'301","reported_seq":1011,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.134452+0000","last_change":"2024-09-12T01:38:13.134452+0000","last_active":"2024-09-12T01:38:13.134452+0000","last_peered":"2024-09-12T01:38:13.134452+0000","last_clean":"2024-09-12T01:38:13.134452+0000","last_became_active":"2024-09-12T00:28:31.207938+0000","last_became_peered":"2024-09-12T00:28:31.207938+0000","last_unstale":"2024-09-12T01:38:13.134452+0000","last_undegraded":"2024-09-12T01:38:13.134452+0000","last_fullsized":"2024-09-12T01:38:13.134452+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'301","last_scrub_stamp":"2024-09-12T01:38:13.134357+0000","last_deep_scrub":"263'301","last_deep_scrub_stamp":"2024-09-12T01:38:13.134357+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.134357+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:18.383579+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174663,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":518,"num_read_kb":179847,"num_write":976,"num_write_kb":39231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:52.780005+0000","last_change":"2024-09-12T00:28:35.213658+0000","last_active":"2024-09-12T01:33:52.780005+0000","last_peered":"2024-09-12T01:33:52.780005+0000","last_clean":"2024-09-12T01:33:52.780005+0000","last_became_active":"2024-09-12T00:28:35.213178+0000","last_became_peered":"2024-09-12T00:28:35.213178+0000","last_unstale":"2024-09-12T01:33:52.780005+0000","last_undegraded":"2024-09-12T01:33:52.780005+0000","last_fullsized":"2024-09-12T01:33:52.780005+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:24.544971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"263'258","reported_seq":836,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.362668+0000","last_change":"2024-09-12T00:28:37.426701+0000","last_active":"2024-09-12T01:38:01.362668+0000","last_peered":"2024-09-12T01:38:01.362668+0000","last_clean":"2024-09-12T01:38:01.362668+0000","last_became_active":"2024-09-12T00:28:37.426357+0000","last_became_peered":"2024-09-12T00:28:37.426357+0000","last_unstale":"2024-09-12T01:38:01.362668+0000","last_undegraded":"2024-09-12T01:38:01.362668+0000","last_fullsized":"2024-09-12T01:38:01.362668+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:10.776649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15889,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":416,"num_read_kb":929,"num_write":326,"num_write_kb":245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"263'769","reported_seq":2648,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.452385+0000","last_change":"2024-09-12T00:28:39.219349+0000","last_active":"2024-09-12T01:38:01.452385+0000","last_peered":"2024-09-12T01:38:01.452385+0000","last_clean":"2024-09-12T01:38:01.452385+0000","last_became_active":"2024-09-12T00:28:39.218738+0000","last_became_peered":"2024-09-12T00:28:39.218738+0000","last_unstale":"2024-09-12T01:38:01.452385+0000","last_undegraded":"2024-09-12T01:38:01.452385+0000","last_fullsized":"2024-09-12T01:38:01.452385+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:17.422620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"263'110","reported_seq":686,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.383696+0000","last_change":"2024-09-12T01:38:22.383696+0000","last_active":"2024-09-12T01:38:22.383696+0000","last_peered":"2024-09-12T01:38:22.383696+0000","last_clean":"2024-09-12T01:38:22.383696+0000","last_became_active":"2024-09-12T00:28:33.213074+0000","last_became_peered":"2024-09-12T00:28:33.213074+0000","last_unstale":"2024-09-12T01:38:22.383696+0000","last_undegraded":"2024-09-12T01:38:22.383696+0000","last_fullsized":"2024-09-12T01:38:22.383696+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'110","last_scrub_stamp":"2024-09-12T01:38:22.383615+0000","last_deep_scrub":"263'110","last_deep_scrub_stamp":"2024-09-12T01:38:22.383615+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.383615+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:00.918063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":473,"num_read_kb":387,"num_write":177,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"263'310","reported_seq":927,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.315153+0000","last_change":"2024-09-12T01:38:15.315153+0000","last_active":"2024-09-12T01:38:15.315153+0000","last_peered":"2024-09-12T01:38:15.315153+0000","last_clean":"2024-09-12T01:38:15.315153+0000","last_became_active":"2024-09-12T00:28:31.207567+0000","last_became_peered":"2024-09-12T00:28:31.207567+0000","last_unstale":"2024-09-12T01:38:15.315153+0000","last_undegraded":"2024-09-12T01:38:15.315153+0000","last_fullsized":"2024-09-12T01:38:15.315153+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'310","last_scrub_stamp":"2024-09-12T01:38:15.315042+0000","last_deep_scrub":"263'310","last_deep_scrub_stamp":"2024-09-12T01:38:15.315042+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.315042+0000","objects_scrubbed":6,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:05.943857+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":384,"num_read_kb":9497,"num_write":972,"num_write_kb":19827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.736003+0000","last_change":"2024-09-12T00:28:35.210621+0000","last_active":"2024-09-12T01:35:46.736003+0000","last_peered":"2024-09-12T01:35:46.736003+0000","last_clean":"2024-09-12T01:35:46.736003+0000","last_became_active":"2024-09-12T00:28:35.209944+0000","last_became_peered":"2024-09-12T00:28:35.209944+0000","last_unstale":"2024-09-12T01:35:46.736003+0000","last_undegraded":"2024-09-12T01:35:46.736003+0000","last_fullsized":"2024-09-12T01:35:46.736003+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:49.310299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"263'369","reported_seq":1002,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.143752+0000","last_change":"2024-09-12T00:28:37.424559+0000","last_active":"2024-09-12T01:38:00.143752+0000","last_peered":"2024-09-12T01:38:00.143752+0000","last_clean":"2024-09-12T01:38:00.143752+0000","last_became_active":"2024-09-12T00:28:37.424250+0000","last_became_peered":"2024-09-12T00:28:37.424250+0000","last_unstale":"2024-09-12T01:38:00.143752+0000","last_undegraded":"2024-09-12T01:38:00.143752+0000","last_fullsized":"2024-09-12T01:38:00.143752+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:53.905894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42905,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":588,"num_read_kb":1145,"num_write":446,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.950916+0000","last_change":"2024-09-12T00:28:39.214210+0000","last_active":"2024-09-12T01:36:11.950916+0000","last_peered":"2024-09-12T01:36:11.950916+0000","last_clean":"2024-09-12T01:36:11.950916+0000","last_became_active":"2024-09-12T00:28:39.213889+0000","last_became_peered":"2024-09-12T00:28:39.213889+0000","last_unstale":"2024-09-12T01:36:11.950916+0000","last_undegraded":"2024-09-12T01:36:11.950916+0000","last_fullsized":"2024-09-12T01:36:11.950916+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"263'533","reported_seq":1343,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:47.142053+0000","last_change":"2024-09-12T00:28:41.229982+0000","last_active":"2024-09-12T01:37:47.142053+0000","last_peered":"2024-09-12T01:37:47.142053+0000","last_clean":"2024-09-12T01:37:47.142053+0000","last_became_active":"2024-09-12T00:28:41.229664+0000","last_became_peered":"2024-09-12T00:28:41.229664+0000","last_unstale":"2024-09-12T01:37:47.142053+0000","last_undegraded":"2024-09-12T01:37:47.142053+0000","last_fullsized":"2024-09-12T01:37:47.142053+0000","mapping_epoch":35,"log_start":"263'500","ondisk_log_start":"263'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":500,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:28.373424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":472,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1261,"num_read_kb":1256,"num_write":1100,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"263'151","reported_seq":774,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.524133+0000","last_change":"2024-09-12T01:38:16.524133+0000","last_active":"2024-09-12T01:38:16.524133+0000","last_peered":"2024-09-12T01:38:16.524133+0000","last_clean":"2024-09-12T01:38:16.524133+0000","last_became_active":"2024-09-12T00:28:33.201673+0000","last_became_peered":"2024-09-12T00:28:33.201673+0000","last_unstale":"2024-09-12T01:38:16.524133+0000","last_undegraded":"2024-09-12T01:38:16.524133+0000","last_fullsized":"2024-09-12T01:38:16.524133+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'151","last_scrub_stamp":"2024-09-12T01:38:16.524038+0000","last_deep_scrub":"263'151","last_deep_scrub_stamp":"2024-09-12T01:38:16.524038+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.524038+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:20.505594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":672,"num_read_kb":557,"num_write":251,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"263'425","reported_seq":1136,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.266274+0000","last_change":"2024-09-12T01:38:12.266183+0000","last_active":"2024-09-12T01:38:12.266274+0000","last_peered":"2024-09-12T01:38:12.266274+0000","last_clean":"2024-09-12T01:38:12.266274+0000","last_became_active":"2024-09-12T00:28:31.202279+0000","last_became_peered":"2024-09-12T00:28:31.202279+0000","last_unstale":"2024-09-12T01:38:12.266274+0000","last_undegraded":"2024-09-12T01:38:12.266274+0000","last_fullsized":"2024-09-12T01:38:12.266274+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'425","last_scrub_stamp":"2024-09-12T01:38:12.266071+0000","last_deep_scrub":"263'425","last_deep_scrub_stamp":"2024-09-12T01:38:12.266071+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.266071+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:43.456179+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262213,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":777,"num_read_kb":12137,"num_write":1235,"num_write_kb":44296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":512,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.741517+0000","last_change":"2024-09-12T01:38:16.741517+0000","last_active":"2024-09-12T01:38:16.741517+0000","last_peered":"2024-09-12T01:38:16.741517+0000","last_clean":"2024-09-12T01:38:16.741517+0000","last_became_active":"2024-09-12T00:28:35.210154+0000","last_became_peered":"2024-09-12T00:28:35.210154+0000","last_unstale":"2024-09-12T01:38:16.741517+0000","last_undegraded":"2024-09-12T01:38:16.741517+0000","last_fullsized":"2024-09-12T01:38:16.741517+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:16.741414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:16.741414+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.741414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:08.905624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"263'273","reported_seq":860,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.874882+0000","last_change":"2024-09-12T00:28:37.220230+0000","last_active":"2024-09-12T01:38:00.874882+0000","last_peered":"2024-09-12T01:38:00.874882+0000","last_clean":"2024-09-12T01:38:00.874882+0000","last_became_active":"2024-09-12T00:28:37.219967+0000","last_became_peered":"2024-09-12T00:28:37.219967+0000","last_unstale":"2024-09-12T01:38:00.874882+0000","last_undegraded":"2024-09-12T01:38:00.874882+0000","last_fullsized":"2024-09-12T01:38:00.874882+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44545,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":449,"num_read_kb":1025,"num_write":360,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:04.652809+0000","last_change":"2024-09-12T00:28:39.216619+0000","last_active":"2024-09-12T01:36:04.652809+0000","last_peered":"2024-09-12T01:36:04.652809+0000","last_clean":"2024-09-12T01:36:04.652809+0000","last_became_active":"2024-09-12T00:28:39.216330+0000","last_became_peered":"2024-09-12T00:28:39.216330+0000","last_unstale":"2024-09-12T01:36:04.652809+0000","last_undegraded":"2024-09-12T01:36:04.652809+0000","last_fullsized":"2024-09-12T01:36:04.652809+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"263'2405","reported_seq":4247,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:36.457076+0000","last_change":"2024-09-12T00:28:41.228159+0000","last_active":"2024-09-12T01:37:36.457076+0000","last_peered":"2024-09-12T01:37:36.457076+0000","last_clean":"2024-09-12T01:37:36.457076+0000","last_became_active":"2024-09-12T00:28:41.227877+0000","last_became_peered":"2024-09-12T00:28:41.227877+0000","last_unstale":"2024-09-12T01:37:36.457076+0000","last_undegraded":"2024-09-12T01:37:36.457076+0000","last_fullsized":"2024-09-12T01:37:36.457076+0000","mapping_epoch":35,"log_start":"263'2300","ondisk_log_start":"263'2300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":2300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:29.699595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1208,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6068,"num_read_kb":6055,"num_write":4875,"num_write_kb":1798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"263'303","reported_seq":981,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.167240+0000","last_change":"2024-09-12T01:38:18.167240+0000","last_active":"2024-09-12T01:38:18.167240+0000","last_peered":"2024-09-12T01:38:18.167240+0000","last_clean":"2024-09-12T01:38:18.167240+0000","last_became_active":"2024-09-12T00:28:33.217954+0000","last_became_peered":"2024-09-12T00:28:33.217954+0000","last_unstale":"2024-09-12T01:38:18.167240+0000","last_undegraded":"2024-09-12T01:38:18.167240+0000","last_fullsized":"2024-09-12T01:38:18.167240+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'303","last_scrub_stamp":"2024-09-12T01:38:18.167157+0000","last_deep_scrub":"263'303","last_deep_scrub_stamp":"2024-09-12T01:38:18.167157+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.167157+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:00.698674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1356,"num_read_kb":1133,"num_write":489,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"263'389","reported_seq":1084,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.277274+0000","last_change":"2024-09-12T01:38:16.277183+0000","last_active":"2024-09-12T01:38:16.277274+0000","last_peered":"2024-09-12T01:38:16.277274+0000","last_clean":"2024-09-12T01:38:16.277274+0000","last_became_active":"2024-09-12T00:28:31.215643+0000","last_became_peered":"2024-09-12T00:28:31.215643+0000","last_unstale":"2024-09-12T01:38:16.277274+0000","last_undegraded":"2024-09-12T01:38:16.277274+0000","last_fullsized":"2024-09-12T01:38:16.277274+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'389","last_scrub_stamp":"2024-09-12T01:38:16.277044+0000","last_deep_scrub":"263'389","last_deep_scrub_stamp":"2024-09-12T01:38:16.277044+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.277044+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:21.030278+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432537,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":556,"num_read_kb":94195,"num_write":1241,"num_write_kb":52818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.733004+0000","last_change":"2024-09-12T01:38:18.732898+0000","last_active":"2024-09-12T01:38:18.733004+0000","last_peered":"2024-09-12T01:38:18.733004+0000","last_clean":"2024-09-12T01:38:18.733004+0000","last_became_active":"2024-09-12T00:28:35.208169+0000","last_became_peered":"2024-09-12T00:28:35.208169+0000","last_unstale":"2024-09-12T01:38:18.733004+0000","last_undegraded":"2024-09-12T01:38:18.733004+0000","last_fullsized":"2024-09-12T01:38:18.733004+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:18.732796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:18.732796+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.732796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:48.698141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"263'330","reported_seq":940,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.229680+0000","last_change":"2024-09-12T00:28:37.221382+0000","last_active":"2024-09-12T01:38:00.229680+0000","last_peered":"2024-09-12T01:38:00.229680+0000","last_clean":"2024-09-12T01:38:00.229680+0000","last_became_active":"2024-09-12T00:28:37.220877+0000","last_became_peered":"2024-09-12T00:28:37.220877+0000","last_unstale":"2024-09-12T01:38:00.229680+0000","last_undegraded":"2024-09-12T01:38:00.229680+0000","last_fullsized":"2024-09-12T01:38:00.229680+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:32:44.806344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44229,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":532,"num_read_kb":1137,"num_write":418,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"263'773","reported_seq":2587,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.806004+0000","last_change":"2024-09-12T00:28:39.216443+0000","last_active":"2024-09-12T01:38:01.806004+0000","last_peered":"2024-09-12T01:38:01.806004+0000","last_clean":"2024-09-12T01:38:01.806004+0000","last_became_active":"2024-09-12T00:28:39.215746+0000","last_became_peered":"2024-09-12T00:28:39.215746+0000","last_unstale":"2024-09-12T01:38:01.806004+0000","last_undegraded":"2024-09-12T01:38:01.806004+0000","last_fullsized":"2024-09-12T01:38:01.806004+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:06.915545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"263'80","reported_seq":574,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.022592+0000","last_change":"2024-09-12T00:28:41.228845+0000","last_active":"2024-09-12T01:37:46.022592+0000","last_peered":"2024-09-12T01:37:46.022592+0000","last_clean":"2024-09-12T01:37:46.022592+0000","last_became_active":"2024-09-12T00:28:41.228361+0000","last_became_peered":"2024-09-12T00:28:41.228361+0000","last_unstale":"2024-09-12T01:37:46.022592+0000","last_undegraded":"2024-09-12T01:37:46.022592+0000","last_fullsized":"2024-09-12T01:37:46.022592+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:22.221289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":65,"num_write":188,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"263'302","reported_seq":917,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:26.124747+0000","last_change":"2024-09-12T01:38:26.124747+0000","last_active":"2024-09-12T01:38:26.124747+0000","last_peered":"2024-09-12T01:38:26.124747+0000","last_clean":"2024-09-12T01:38:26.124747+0000","last_became_active":"2024-09-12T00:28:33.219182+0000","last_became_peered":"2024-09-12T00:28:33.219182+0000","last_unstale":"2024-09-12T01:38:26.124747+0000","last_undegraded":"2024-09-12T01:38:26.124747+0000","last_fullsized":"2024-09-12T01:38:26.124747+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'302","last_scrub_stamp":"2024-09-12T01:38:26.124659+0000","last_deep_scrub":"263'302","last_deep_scrub_stamp":"2024-09-12T01:38:26.124659+0000","last_clean_scrub_stamp":"2024-09-12T01:38:26.124659+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:53.789811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1277,"num_read_kb":1021,"num_write":469,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"263'378","reported_seq":1054,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.303730+0000","last_change":"2024-09-12T01:38:12.303676+0000","last_active":"2024-09-12T01:38:12.303730+0000","last_peered":"2024-09-12T01:38:12.303730+0000","last_clean":"2024-09-12T01:38:12.303730+0000","last_became_active":"2024-09-12T00:28:31.214920+0000","last_became_peered":"2024-09-12T00:28:31.214920+0000","last_unstale":"2024-09-12T01:38:12.303730+0000","last_undegraded":"2024-09-12T01:38:12.303730+0000","last_fullsized":"2024-09-12T01:38:12.303730+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'378","last_scrub_stamp":"2024-09-12T01:38:12.303574+0000","last_deep_scrub":"263'378","last_deep_scrub_stamp":"2024-09-12T01:38:12.303574+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.303574+0000","objects_scrubbed":4,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:03.116923+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":584,"num_read_kb":15343,"num_write":1236,"num_write_kb":35661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":512,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.754507+0000","last_change":"2024-09-12T01:38:17.754507+0000","last_active":"2024-09-12T01:38:17.754507+0000","last_peered":"2024-09-12T01:38:17.754507+0000","last_clean":"2024-09-12T01:38:17.754507+0000","last_became_active":"2024-09-12T00:28:35.207881+0000","last_became_peered":"2024-09-12T00:28:35.207881+0000","last_unstale":"2024-09-12T01:38:17.754507+0000","last_undegraded":"2024-09-12T01:38:17.754507+0000","last_fullsized":"2024-09-12T01:38:17.754507+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:17.754418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:17.754418+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.754418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:59.001650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"263'466","reported_seq":1120,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.006707+0000","last_change":"2024-09-12T00:28:37.217137+0000","last_active":"2024-09-12T01:38:01.006707+0000","last_peered":"2024-09-12T01:38:01.006707+0000","last_clean":"2024-09-12T01:38:01.006707+0000","last_became_active":"2024-09-12T00:28:37.216189+0000","last_became_peered":"2024-09-12T00:28:37.216189+0000","last_unstale":"2024-09-12T01:38:01.006707+0000","last_undegraded":"2024-09-12T01:38:01.006707+0000","last_fullsized":"2024-09-12T01:38:01.006707+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:12.417502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90719,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":821,"num_read_kb":1951,"num_write":658,"num_write_kb":528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.791092+0000","last_change":"2024-09-12T01:38:22.791092+0000","last_active":"2024-09-12T01:38:22.791092+0000","last_peered":"2024-09-12T01:38:22.791092+0000","last_clean":"2024-09-12T01:38:22.791092+0000","last_became_active":"2024-09-12T00:28:39.212687+0000","last_became_peered":"2024-09-12T00:28:39.212687+0000","last_unstale":"2024-09-12T01:38:22.791092+0000","last_undegraded":"2024-09-12T01:38:22.791092+0000","last_fullsized":"2024-09-12T01:38:22.791092+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:22.790991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:22.790991+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.790991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:06.359775+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"263'133","reported_seq":662,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:13.149858+0000","last_change":"2024-09-12T00:28:41.226044+0000","last_active":"2024-09-12T01:36:13.149858+0000","last_peered":"2024-09-12T01:36:13.149858+0000","last_clean":"2024-09-12T01:36:13.149858+0000","last_became_active":"2024-09-12T00:28:41.225700+0000","last_became_peered":"2024-09-12T00:28:41.225700+0000","last_unstale":"2024-09-12T01:36:13.149858+0000","last_undegraded":"2024-09-12T01:36:13.149858+0000","last_fullsized":"2024-09-12T01:36:13.149858+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:22.538216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":521,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":185,"num_read_kb":167,"num_write":321,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"263'175","reported_seq":788,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.459440+0000","last_change":"2024-09-12T01:38:11.459368+0000","last_active":"2024-09-12T01:38:11.459440+0000","last_peered":"2024-09-12T01:38:11.459440+0000","last_clean":"2024-09-12T01:38:11.459440+0000","last_became_active":"2024-09-12T00:28:33.204532+0000","last_became_peered":"2024-09-12T00:28:33.204532+0000","last_unstale":"2024-09-12T01:38:11.459440+0000","last_undegraded":"2024-09-12T01:38:11.459440+0000","last_fullsized":"2024-09-12T01:38:11.459440+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'175","last_scrub_stamp":"2024-09-12T01:38:11.459272+0000","last_deep_scrub":"263'175","last_deep_scrub_stamp":"2024-09-12T01:38:11.459272+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.459272+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:41.431006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":765,"num_read_kb":622,"num_write":270,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"263'382","reported_seq":1027,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.215722+0000","last_change":"2024-09-12T01:38:18.215663+0000","last_active":"2024-09-12T01:38:18.215722+0000","last_peered":"2024-09-12T01:38:18.215722+0000","last_clean":"2024-09-12T01:38:18.215722+0000","last_became_active":"2024-09-12T00:28:31.207269+0000","last_became_peered":"2024-09-12T00:28:31.207269+0000","last_unstale":"2024-09-12T01:38:18.215722+0000","last_undegraded":"2024-09-12T01:38:18.215722+0000","last_fullsized":"2024-09-12T01:38:18.215722+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'382","last_scrub_stamp":"2024-09-12T01:38:18.215562+0000","last_deep_scrub":"263'382","last_deep_scrub_stamp":"2024-09-12T01:38:18.215562+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.215562+0000","objects_scrubbed":6,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:29.623240+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291522,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":535,"num_read_kb":24704,"num_write":1122,"num_write_kb":40904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.726168+0000","last_change":"2024-09-12T01:38:20.726071+0000","last_active":"2024-09-12T01:38:20.726168+0000","last_peered":"2024-09-12T01:38:20.726168+0000","last_clean":"2024-09-12T01:38:20.726168+0000","last_became_active":"2024-09-12T00:28:35.208829+0000","last_became_peered":"2024-09-12T00:28:35.208829+0000","last_unstale":"2024-09-12T01:38:20.726168+0000","last_undegraded":"2024-09-12T01:38:20.726168+0000","last_fullsized":"2024-09-12T01:38:20.726168+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:20.725958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:20.725958+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.725958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:14.695147+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"263'284","reported_seq":878,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.055101+0000","last_change":"2024-09-12T00:28:37.210416+0000","last_active":"2024-09-12T01:38:01.055101+0000","last_peered":"2024-09-12T01:38:01.055101+0000","last_clean":"2024-09-12T01:38:01.055101+0000","last_became_active":"2024-09-12T00:28:37.210162+0000","last_became_peered":"2024-09-12T00:28:37.210162+0000","last_unstale":"2024-09-12T01:38:01.055101+0000","last_undegraded":"2024-09-12T01:38:01.055101+0000","last_fullsized":"2024-09-12T01:38:01.055101+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46921,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":495,"num_read_kb":1053,"num_write":432,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:06.785115+0000","last_change":"2024-09-12T00:28:39.220793+0000","last_active":"2024-09-12T01:34:06.785115+0000","last_peered":"2024-09-12T01:34:06.785115+0000","last_clean":"2024-09-12T01:34:06.785115+0000","last_became_active":"2024-09-12T00:28:39.220468+0000","last_became_peered":"2024-09-12T00:28:39.220468+0000","last_unstale":"2024-09-12T01:34:06.785115+0000","last_undegraded":"2024-09-12T01:34:06.785115+0000","last_fullsized":"2024-09-12T01:34:06.785115+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:49.834445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"263'81","reported_seq":575,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:59.659578+0000","last_change":"2024-09-12T00:28:41.228956+0000","last_active":"2024-09-12T01:36:59.659578+0000","last_peered":"2024-09-12T01:36:59.659578+0000","last_clean":"2024-09-12T01:36:59.659578+0000","last_became_active":"2024-09-12T00:28:41.228663+0000","last_became_peered":"2024-09-12T00:28:41.228663+0000","last_unstale":"2024-09-12T01:36:59.659578+0000","last_undegraded":"2024-09-12T01:36:59.659578+0000","last_fullsized":"2024-09-12T01:36:59.659578+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:51.130761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":503,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":60,"num_read_kb":59,"num_write":193,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"263'158","reported_seq":788,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.505568+0000","last_change":"2024-09-12T01:38:13.505491+0000","last_active":"2024-09-12T01:38:13.505568+0000","last_peered":"2024-09-12T01:38:13.505568+0000","last_clean":"2024-09-12T01:38:13.505568+0000","last_became_active":"2024-09-12T00:28:33.206883+0000","last_became_peered":"2024-09-12T00:28:33.206883+0000","last_unstale":"2024-09-12T01:38:13.505568+0000","last_undegraded":"2024-09-12T01:38:13.505568+0000","last_fullsized":"2024-09-12T01:38:13.505568+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'158","last_scrub_stamp":"2024-09-12T01:38:13.505388+0000","last_deep_scrub":"263'158","last_deep_scrub_stamp":"2024-09-12T01:38:13.505388+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.505388+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:21.434548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":717,"num_read_kb":595,"num_write":233,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"263'311","reported_seq":935,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.152253+0000","last_change":"2024-09-12T01:38:10.152253+0000","last_active":"2024-09-12T01:38:10.152253+0000","last_peered":"2024-09-12T01:38:10.152253+0000","last_clean":"2024-09-12T01:38:10.152253+0000","last_became_active":"2024-09-12T00:28:31.203369+0000","last_became_peered":"2024-09-12T00:28:31.203369+0000","last_unstale":"2024-09-12T01:38:10.152253+0000","last_undegraded":"2024-09-12T01:38:10.152253+0000","last_fullsized":"2024-09-12T01:38:10.152253+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'311","last_scrub_stamp":"2024-09-12T01:38:10.152154+0000","last_deep_scrub":"263'311","last_deep_scrub_stamp":"2024-09-12T01:38:10.152154+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.152154+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:08.174048+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7425128,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":375,"num_read_kb":56295,"num_write":849,"num_write_kb":46368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.025660+0000","last_change":"2024-09-12T01:38:22.025660+0000","last_active":"2024-09-12T01:38:22.025660+0000","last_peered":"2024-09-12T01:38:22.025660+0000","last_clean":"2024-09-12T01:38:22.025660+0000","last_became_active":"2024-09-12T00:28:35.207923+0000","last_became_peered":"2024-09-12T00:28:35.207923+0000","last_unstale":"2024-09-12T01:38:22.025660+0000","last_undegraded":"2024-09-12T01:38:22.025660+0000","last_fullsized":"2024-09-12T01:38:22.025660+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:22.025562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:22.025562+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.025562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:15.589299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"263'348","reported_seq":950,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.685418+0000","last_change":"2024-09-12T00:28:37.220980+0000","last_active":"2024-09-12T01:38:00.685418+0000","last_peered":"2024-09-12T01:38:00.685418+0000","last_clean":"2024-09-12T01:38:00.685418+0000","last_became_active":"2024-09-12T00:28:37.220674+0000","last_became_peered":"2024-09-12T00:28:37.220674+0000","last_unstale":"2024-09-12T01:38:00.685418+0000","last_undegraded":"2024-09-12T01:38:00.685418+0000","last_fullsized":"2024-09-12T01:38:00.685418+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:29.407891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48847,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":575,"num_read_kb":1313,"num_write":464,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"263'739","reported_seq":4576,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:24.709916+0000","last_change":"2024-09-12T01:38:24.709856+0000","last_active":"2024-09-12T01:38:24.709916+0000","last_peered":"2024-09-12T01:38:24.709916+0000","last_clean":"2024-09-12T01:38:24.709916+0000","last_became_active":"2024-09-12T00:28:39.213871+0000","last_became_peered":"2024-09-12T00:28:39.213871+0000","last_unstale":"2024-09-12T01:38:24.709916+0000","last_undegraded":"2024-09-12T01:38:24.709916+0000","last_fullsized":"2024-09-12T01:38:24.709916+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'739","last_scrub_stamp":"2024-09-12T01:38:24.709738+0000","last_deep_scrub":"263'739","last_deep_scrub_stamp":"2024-09-12T01:38:24.709738+0000","last_clean_scrub_stamp":"2024-09-12T01:38:24.709738+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":700,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:14.725207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"263'194","reported_seq":745,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:40.186256+0000","last_change":"2024-09-12T00:28:41.227781+0000","last_active":"2024-09-12T01:36:40.186256+0000","last_peered":"2024-09-12T01:36:40.186256+0000","last_clean":"2024-09-12T01:36:40.186256+0000","last_became_active":"2024-09-12T00:28:41.227310+0000","last_became_peered":"2024-09-12T00:28:41.227310+0000","last_unstale":"2024-09-12T01:36:40.186256+0000","last_undegraded":"2024-09-12T01:36:40.186256+0000","last_fullsized":"2024-09-12T01:36:40.186256+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:23.647466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1879,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":313,"num_read_kb":267,"num_write":467,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"263'134","reported_seq":767,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.496591+0000","last_change":"2024-09-12T01:38:17.496539+0000","last_active":"2024-09-12T01:38:17.496591+0000","last_peered":"2024-09-12T01:38:17.496591+0000","last_clean":"2024-09-12T01:38:17.496591+0000","last_became_active":"2024-09-12T00:28:33.211327+0000","last_became_peered":"2024-09-12T00:28:33.211327+0000","last_unstale":"2024-09-12T01:38:17.496591+0000","last_undegraded":"2024-09-12T01:38:17.496591+0000","last_fullsized":"2024-09-12T01:38:17.496591+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'134","last_scrub_stamp":"2024-09-12T01:38:17.496441+0000","last_deep_scrub":"263'134","last_deep_scrub_stamp":"2024-09-12T01:38:17.496441+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.496441+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:31.354433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":621,"num_read_kb":525,"num_write":194,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"263'378","reported_seq":1084,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.492901+0000","last_change":"2024-09-12T01:38:12.492901+0000","last_active":"2024-09-12T01:38:12.492901+0000","last_peered":"2024-09-12T01:38:12.492901+0000","last_clean":"2024-09-12T01:38:12.492901+0000","last_became_active":"2024-09-12T00:28:31.201275+0000","last_became_peered":"2024-09-12T00:28:31.201275+0000","last_unstale":"2024-09-12T01:38:12.492901+0000","last_undegraded":"2024-09-12T01:38:12.492901+0000","last_fullsized":"2024-09-12T01:38:12.492901+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'378","last_scrub_stamp":"2024-09-12T01:38:12.492779+0000","last_deep_scrub":"263'378","last_deep_scrub_stamp":"2024-09-12T01:38:12.492779+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.492779+0000","objects_scrubbed":8,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:39.803942+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395829,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":640,"num_read_kb":30113,"num_write":1190,"num_write_kb":53346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1450,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.047729+0000","last_change":"2024-09-12T00:28:35.210438+0000","last_active":"2024-09-12T01:38:00.047729+0000","last_peered":"2024-09-12T01:38:00.047729+0000","last_clean":"2024-09-12T01:38:00.047729+0000","last_became_active":"2024-09-12T00:28:35.210173+0000","last_became_peered":"2024-09-12T00:28:35.210173+0000","last_unstale":"2024-09-12T01:38:00.047729+0000","last_undegraded":"2024-09-12T01:38:00.047729+0000","last_fullsized":"2024-09-12T01:38:00.047729+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":952,"num_read_kb":952,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"263'106","reported_seq":639,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:09.653408+0000","last_change":"2024-09-12T00:28:37.424197+0000","last_active":"2024-09-12T01:36:09.653408+0000","last_peered":"2024-09-12T01:36:09.653408+0000","last_clean":"2024-09-12T01:36:09.653408+0000","last_became_active":"2024-09-12T00:28:37.423847+0000","last_became_peered":"2024-09-12T00:28:37.423847+0000","last_unstale":"2024-09-12T01:36:09.653408+0000","last_undegraded":"2024-09-12T01:36:09.653408+0000","last_fullsized":"2024-09-12T01:36:09.653408+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":109,"num_read_kb":102,"num_write":74,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"263'760","reported_seq":2656,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:26.210045+0000","last_change":"2024-09-12T01:38:26.209968+0000","last_active":"2024-09-12T01:38:26.210045+0000","last_peered":"2024-09-12T01:38:26.210045+0000","last_clean":"2024-09-12T01:38:26.210045+0000","last_became_active":"2024-09-12T00:28:39.216244+0000","last_became_peered":"2024-09-12T00:28:39.216244+0000","last_unstale":"2024-09-12T01:38:26.210045+0000","last_undegraded":"2024-09-12T01:38:26.210045+0000","last_fullsized":"2024-09-12T01:38:26.210045+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'760","last_scrub_stamp":"2024-09-12T01:38:26.209888+0000","last_deep_scrub":"263'760","last_deep_scrub_stamp":"2024-09-12T01:38:26.209888+0000","last_clean_scrub_stamp":"2024-09-12T01:38:26.209888+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:02.637163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"263'177","reported_seq":688,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:41.529420+0000","last_change":"2024-09-12T00:28:41.226032+0000","last_active":"2024-09-12T01:36:41.529420+0000","last_peered":"2024-09-12T01:36:41.529420+0000","last_clean":"2024-09-12T01:36:41.529420+0000","last_became_active":"2024-09-12T00:28:41.225728+0000","last_became_peered":"2024-09-12T00:28:41.225728+0000","last_unstale":"2024-09-12T01:36:41.529420+0000","last_undegraded":"2024-09-12T01:36:41.529420+0000","last_fullsized":"2024-09-12T01:36:41.529420+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:37.084319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":145,"num_write":308,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"263'4256","reported_seq":4866,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.093864+0000","last_change":"2024-09-12T01:38:20.093799+0000","last_active":"2024-09-12T01:38:20.093864+0000","last_peered":"2024-09-12T01:38:20.093864+0000","last_clean":"2024-09-12T01:38:20.093864+0000","last_became_active":"2024-09-12T00:28:33.205792+0000","last_became_peered":"2024-09-12T00:28:33.205792+0000","last_unstale":"2024-09-12T01:38:20.093864+0000","last_undegraded":"2024-09-12T01:38:20.093864+0000","last_fullsized":"2024-09-12T01:38:20.093864+0000","mapping_epoch":27,"log_start":"263'4200","ondisk_log_start":"263'4200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4256","last_scrub_stamp":"2024-09-12T01:38:20.093696+0000","last_deep_scrub":"263'4256","last_deep_scrub_stamp":"2024-09-12T01:38:20.093696+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.093696+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":3000,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:49.819357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17142,"num_read_kb":14400,"num_write":6430,"num_write_kb":3228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"263'385","reported_seq":1112,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.241283+0000","last_change":"2024-09-12T01:38:10.241283+0000","last_active":"2024-09-12T01:38:10.241283+0000","last_peered":"2024-09-12T01:38:10.241283+0000","last_clean":"2024-09-12T01:38:10.241283+0000","last_became_active":"2024-09-12T00:28:31.202456+0000","last_became_peered":"2024-09-12T00:28:31.202456+0000","last_unstale":"2024-09-12T01:38:10.241283+0000","last_undegraded":"2024-09-12T01:38:10.241283+0000","last_fullsized":"2024-09-12T01:38:10.241283+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'385","last_scrub_stamp":"2024-09-12T01:38:10.241176+0000","last_deep_scrub":"263'385","last_deep_scrub_stamp":"2024-09-12T01:38:10.241176+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.241176+0000","objects_scrubbed":9,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:45.643799+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":651,"num_read_kb":78129,"num_write":1373,"num_write_kb":48684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:06.553086+0000","last_change":"2024-09-12T00:28:35.207665+0000","last_active":"2024-09-12T01:36:06.553086+0000","last_peered":"2024-09-12T01:36:06.553086+0000","last_clean":"2024-09-12T01:36:06.553086+0000","last_became_active":"2024-09-12T00:28:35.207343+0000","last_became_peered":"2024-09-12T00:28:35.207343+0000","last_unstale":"2024-09-12T01:36:06.553086+0000","last_undegraded":"2024-09-12T01:36:06.553086+0000","last_fullsized":"2024-09-12T01:36:06.553086+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"263'369","reported_seq":988,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.685971+0000","last_change":"2024-09-12T00:28:37.211454+0000","last_active":"2024-09-12T01:38:01.685971+0000","last_peered":"2024-09-12T01:38:01.685971+0000","last_clean":"2024-09-12T01:38:01.685971+0000","last_became_active":"2024-09-12T00:28:37.211090+0000","last_became_peered":"2024-09-12T00:28:37.211090+0000","last_unstale":"2024-09-12T01:38:01.685971+0000","last_undegraded":"2024-09-12T01:38:01.685971+0000","last_fullsized":"2024-09-12T01:38:01.685971+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46480,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":594,"num_read_kb":1224,"num_write":462,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:25.181529+0000","last_change":"2024-09-12T01:38:25.181468+0000","last_active":"2024-09-12T01:38:25.181529+0000","last_peered":"2024-09-12T01:38:25.181529+0000","last_clean":"2024-09-12T01:38:25.181529+0000","last_became_active":"2024-09-12T00:28:39.219687+0000","last_became_peered":"2024-09-12T00:28:39.219687+0000","last_unstale":"2024-09-12T01:38:25.181529+0000","last_undegraded":"2024-09-12T01:38:25.181529+0000","last_fullsized":"2024-09-12T01:38:25.181529+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:25.181379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:25.181379+0000","last_clean_scrub_stamp":"2024-09-12T01:38:25.181379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:32.900668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"263'114","reported_seq":619,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:41.523331+0000","last_change":"2024-09-12T00:28:41.226379+0000","last_active":"2024-09-12T01:36:41.523331+0000","last_peered":"2024-09-12T01:36:41.523331+0000","last_clean":"2024-09-12T01:36:41.523331+0000","last_became_active":"2024-09-12T00:28:41.226049+0000","last_became_peered":"2024-09-12T00:28:41.226049+0000","last_unstale":"2024-09-12T01:36:41.523331+0000","last_undegraded":"2024-09-12T01:36:41.523331+0000","last_fullsized":"2024-09-12T01:36:41.523331+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:35.250632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":871,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":118,"num_read_kb":115,"num_write":279,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"263'144","reported_seq":786,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.138001+0000","last_change":"2024-09-12T01:38:17.138001+0000","last_active":"2024-09-12T01:38:17.138001+0000","last_peered":"2024-09-12T01:38:17.138001+0000","last_clean":"2024-09-12T01:38:17.138001+0000","last_became_active":"2024-09-12T00:28:33.214018+0000","last_became_peered":"2024-09-12T00:28:33.214018+0000","last_unstale":"2024-09-12T01:38:17.138001+0000","last_undegraded":"2024-09-12T01:38:17.138001+0000","last_fullsized":"2024-09-12T01:38:17.138001+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'144","last_scrub_stamp":"2024-09-12T01:38:17.137901+0000","last_deep_scrub":"263'144","last_deep_scrub_stamp":"2024-09-12T01:38:17.137901+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.137901+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:44.770374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":636,"num_read_kb":544,"num_write":220,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"263'74","reported_seq":624,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.264507+0000","last_change":"2024-09-12T01:38:11.264507+0000","last_active":"2024-09-12T01:38:11.264507+0000","last_peered":"2024-09-12T01:38:11.264507+0000","last_clean":"2024-09-12T01:38:11.264507+0000","last_became_active":"2024-09-12T00:28:14.744766+0000","last_became_peered":"2024-09-12T00:28:14.744766+0000","last_unstale":"2024-09-12T01:38:11.264507+0000","last_undegraded":"2024-09-12T01:38:11.264507+0000","last_fullsized":"2024-09-12T01:38:11.264507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'74","last_scrub_stamp":"2024-09-12T01:38:11.264366+0000","last_deep_scrub":"263'74","last_deep_scrub_stamp":"2024-09-12T01:38:11.264366+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.264366+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:33.200544+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"263'2","reported_seq":531,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.265261+0000","last_change":"2024-09-12T01:38:11.265261+0000","last_active":"2024-09-12T01:38:11.265261+0000","last_peered":"2024-09-12T01:38:11.265261+0000","last_clean":"2024-09-12T01:38:11.265261+0000","last_became_active":"2024-09-12T00:28:19.162328+0000","last_became_peered":"2024-09-12T00:28:19.162328+0000","last_unstale":"2024-09-12T01:38:11.265261+0000","last_undegraded":"2024-09-12T01:38:11.265261+0000","last_fullsized":"2024-09-12T01:38:11.265261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:38:11.265179+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:38:11.265179+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.265179+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:49.396121+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00046717800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"263'321","reported_seq":970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:09.261369+0000","last_change":"2024-09-12T01:38:09.261369+0000","last_active":"2024-09-12T01:38:09.261369+0000","last_peered":"2024-09-12T01:38:09.261369+0000","last_clean":"2024-09-12T01:38:09.261369+0000","last_became_active":"2024-09-12T00:28:31.215485+0000","last_became_peered":"2024-09-12T00:28:31.215485+0000","last_unstale":"2024-09-12T01:38:09.261369+0000","last_undegraded":"2024-09-12T01:38:09.261369+0000","last_fullsized":"2024-09-12T01:38:09.261369+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'321","last_scrub_stamp":"2024-09-12T01:38:09.261297+0000","last_deep_scrub":"263'321","last_deep_scrub_stamp":"2024-09-12T01:38:09.261297+0000","last_clean_scrub_stamp":"2024-09-12T01:38:09.261297+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:38.767121+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436935,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":460,"num_read_kb":39194,"num_write":1093,"num_write_kb":25197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.731330+0000","last_change":"2024-09-12T00:28:35.209125+0000","last_active":"2024-09-12T01:35:16.731330+0000","last_peered":"2024-09-12T01:35:16.731330+0000","last_clean":"2024-09-12T01:35:16.731330+0000","last_became_active":"2024-09-12T00:28:35.208812+0000","last_became_peered":"2024-09-12T00:28:35.208812+0000","last_unstale":"2024-09-12T01:35:16.731330+0000","last_undegraded":"2024-09-12T01:35:16.731330+0000","last_fullsized":"2024-09-12T01:35:16.731330+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:01.363469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"263'747","reported_seq":1462,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.795476+0000","last_change":"2024-09-12T00:28:37.221326+0000","last_active":"2024-09-12T01:38:01.795476+0000","last_peered":"2024-09-12T01:38:01.795476+0000","last_clean":"2024-09-12T01:38:01.795476+0000","last_became_active":"2024-09-12T00:28:37.221001+0000","last_became_peered":"2024-09-12T00:28:37.221001+0000","last_unstale":"2024-09-12T01:38:01.795476+0000","last_undegraded":"2024-09-12T01:38:01.795476+0000","last_fullsized":"2024-09-12T01:38:01.795476+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":700,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:20.998547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141781,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1456,"num_read_kb":3385,"num_write":1364,"num_write_kb":1192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:51.797587+0000","last_change":"2024-09-12T00:28:39.221623+0000","last_active":"2024-09-12T01:35:51.797587+0000","last_peered":"2024-09-12T01:35:51.797587+0000","last_clean":"2024-09-12T01:35:51.797587+0000","last_became_active":"2024-09-12T00:28:39.221007+0000","last_became_peered":"2024-09-12T00:28:39.221007+0000","last_unstale":"2024-09-12T01:35:51.797587+0000","last_undegraded":"2024-09-12T01:35:51.797587+0000","last_fullsized":"2024-09-12T01:35:51.797587+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:49.965506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"263'186","reported_seq":885,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:42.615741+0000","last_change":"2024-09-12T00:28:41.226364+0000","last_active":"2024-09-12T01:36:42.615741+0000","last_peered":"2024-09-12T01:36:42.615741+0000","last_clean":"2024-09-12T01:36:42.615741+0000","last_became_active":"2024-09-12T00:28:41.226077+0000","last_became_peered":"2024-09-12T00:28:41.226077+0000","last_unstale":"2024-09-12T01:36:42.615741+0000","last_undegraded":"2024-09-12T01:36:42.615741+0000","last_fullsized":"2024-09-12T01:36:42.615741+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:54.387034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":407,"num_read_kb":405,"num_write":366,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"263'200","reported_seq":817,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.045446+0000","last_change":"2024-09-12T01:38:13.045446+0000","last_active":"2024-09-12T01:38:13.045446+0000","last_peered":"2024-09-12T01:38:13.045446+0000","last_clean":"2024-09-12T01:38:13.045446+0000","last_became_active":"2024-09-12T00:28:33.214351+0000","last_became_peered":"2024-09-12T00:28:33.214351+0000","last_unstale":"2024-09-12T01:38:13.045446+0000","last_undegraded":"2024-09-12T01:38:13.045446+0000","last_fullsized":"2024-09-12T01:38:13.045446+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'200","last_scrub_stamp":"2024-09-12T01:38:13.045354+0000","last_deep_scrub":"263'200","last_deep_scrub_stamp":"2024-09-12T01:38:13.045354+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.045354+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:24.710351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":877,"num_read_kb":731,"num_write":291,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":531,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.289843+0000","last_change":"2024-09-12T01:38:13.289843+0000","last_active":"2024-09-12T01:38:13.289843+0000","last_peered":"2024-09-12T01:38:13.289843+0000","last_clean":"2024-09-12T01:38:13.289843+0000","last_became_active":"2024-09-12T00:28:19.164970+0000","last_became_peered":"2024-09-12T00:28:19.164970+0000","last_unstale":"2024-09-12T01:38:13.289843+0000","last_undegraded":"2024-09-12T01:38:13.289843+0000","last_fullsized":"2024-09-12T01:38:13.289843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:13.289759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:13.289759+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.289759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:35.748664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055291100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"263'381","reported_seq":1121,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:08.100822+0000","last_change":"2024-09-12T01:38:08.100822+0000","last_active":"2024-09-12T01:38:08.100822+0000","last_peered":"2024-09-12T01:38:08.100822+0000","last_clean":"2024-09-12T01:38:08.100822+0000","last_became_active":"2024-09-12T00:28:31.204842+0000","last_became_peered":"2024-09-12T00:28:31.204842+0000","last_unstale":"2024-09-12T01:38:08.100822+0000","last_undegraded":"2024-09-12T01:38:08.100822+0000","last_fullsized":"2024-09-12T01:38:08.100822+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'381","last_scrub_stamp":"2024-09-12T01:38:08.100667+0000","last_deep_scrub":"263'381","last_deep_scrub_stamp":"2024-09-12T01:38:08.100667+0000","last_clean_scrub_stamp":"2024-09-12T01:38:08.100667+0000","objects_scrubbed":9,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:45.468456+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":699,"num_read_kb":44079,"num_write":1206,"num_write_kb":29123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:47.796159+0000","last_change":"2024-09-12T00:28:35.216312+0000","last_active":"2024-09-12T01:35:47.796159+0000","last_peered":"2024-09-12T01:35:47.796159+0000","last_clean":"2024-09-12T01:35:47.796159+0000","last_became_active":"2024-09-12T00:28:35.215063+0000","last_became_peered":"2024-09-12T00:28:35.215063+0000","last_unstale":"2024-09-12T01:35:47.796159+0000","last_undegraded":"2024-09-12T01:35:47.796159+0000","last_fullsized":"2024-09-12T01:35:47.796159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:30.514762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"263'1361","reported_seq":3156,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.739191+0000","last_change":"2024-09-12T00:28:37.211623+0000","last_active":"2024-09-12T01:38:01.739191+0000","last_peered":"2024-09-12T01:38:01.739191+0000","last_clean":"2024-09-12T01:38:01.739191+0000","last_became_active":"2024-09-12T00:28:37.211275+0000","last_became_peered":"2024-09-12T00:28:37.211275+0000","last_unstale":"2024-09-12T01:38:01.739191+0000","last_undegraded":"2024-09-12T01:38:01.739191+0000","last_fullsized":"2024-09-12T01:38:01.739191+0000","mapping_epoch":31,"log_start":"263'1300","ondisk_log_start":"263'1300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":1300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:17.542912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145911,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2184,"num_read_kb":4297,"num_write":1290,"num_write_kb":1091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:36.734401+0000","last_change":"2024-09-12T00:28:39.217983+0000","last_active":"2024-09-12T01:35:36.734401+0000","last_peered":"2024-09-12T01:35:36.734401+0000","last_clean":"2024-09-12T01:35:36.734401+0000","last_became_active":"2024-09-12T00:28:39.217623+0000","last_became_peered":"2024-09-12T00:28:39.217623+0000","last_unstale":"2024-09-12T01:35:36.734401+0000","last_undegraded":"2024-09-12T01:35:36.734401+0000","last_fullsized":"2024-09-12T01:35:36.734401+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:06.473217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"263'261","reported_seq":806,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:13.177560+0000","last_change":"2024-09-12T00:28:41.255226+0000","last_active":"2024-09-12T01:36:13.177560+0000","last_peered":"2024-09-12T01:36:13.177560+0000","last_clean":"2024-09-12T01:36:13.177560+0000","last_became_active":"2024-09-12T00:28:41.254814+0000","last_became_peered":"2024-09-12T00:28:41.254814+0000","last_unstale":"2024-09-12T01:36:13.177560+0000","last_undegraded":"2024-09-12T01:36:13.177560+0000","last_fullsized":"2024-09-12T01:36:13.177560+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":416,"num_read_kb":400,"num_write":581,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"263'116","reported_seq":762,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.044813+0000","last_change":"2024-09-12T01:38:19.044813+0000","last_active":"2024-09-12T01:38:19.044813+0000","last_peered":"2024-09-12T01:38:19.044813+0000","last_clean":"2024-09-12T01:38:19.044813+0000","last_became_active":"2024-09-12T00:28:33.216335+0000","last_became_peered":"2024-09-12T00:28:33.216335+0000","last_unstale":"2024-09-12T01:38:19.044813+0000","last_undegraded":"2024-09-12T01:38:19.044813+0000","last_fullsized":"2024-09-12T01:38:19.044813+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'116","last_scrub_stamp":"2024-09-12T01:38:19.044713+0000","last_deep_scrub":"263'116","last_deep_scrub_stamp":"2024-09-12T01:38:19.044713+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.044713+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:33.501842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":537,"num_read_kb":460,"num_write":159,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":536,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:07.840574+0000","last_change":"2024-09-12T01:38:07.840574+0000","last_active":"2024-09-12T01:38:07.840574+0000","last_peered":"2024-09-12T01:38:07.840574+0000","last_clean":"2024-09-12T01:38:07.840574+0000","last_became_active":"2024-09-12T00:28:19.225901+0000","last_became_peered":"2024-09-12T00:28:19.225901+0000","last_unstale":"2024-09-12T01:38:07.840574+0000","last_undegraded":"2024-09-12T01:38:07.840574+0000","last_fullsized":"2024-09-12T01:38:07.840574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:07.840493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:07.840493+0000","last_clean_scrub_stamp":"2024-09-12T01:38:07.840493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:17.786493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032319500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"263'346","reported_seq":1153,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:08.229143+0000","last_change":"2024-09-12T01:38:08.229143+0000","last_active":"2024-09-12T01:38:08.229143+0000","last_peered":"2024-09-12T01:38:08.229143+0000","last_clean":"2024-09-12T01:38:08.229143+0000","last_became_active":"2024-09-12T00:28:31.198575+0000","last_became_peered":"2024-09-12T00:28:31.198575+0000","last_unstale":"2024-09-12T01:38:08.229143+0000","last_undegraded":"2024-09-12T01:38:08.229143+0000","last_fullsized":"2024-09-12T01:38:08.229143+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'346","last_scrub_stamp":"2024-09-12T01:38:08.229006+0000","last_deep_scrub":"263'346","last_deep_scrub_stamp":"2024-09-12T01:38:08.229006+0000","last_clean_scrub_stamp":"2024-09-12T01:38:08.229006+0000","objects_scrubbed":9,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:39.417199+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3941571,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":832,"num_read_kb":78199,"num_write":1073,"num_write_kb":40255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"263'2","reported_seq":514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.734864+0000","last_change":"2024-09-12T01:38:13.734864+0000","last_active":"2024-09-12T01:38:13.734864+0000","last_peered":"2024-09-12T01:38:13.734864+0000","last_clean":"2024-09-12T01:38:13.734864+0000","last_became_active":"2024-09-12T00:28:35.209218+0000","last_became_peered":"2024-09-12T00:28:35.209218+0000","last_unstale":"2024-09-12T01:38:13.734864+0000","last_undegraded":"2024-09-12T01:38:13.734864+0000","last_fullsized":"2024-09-12T01:38:13.734864+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:38:13.734781+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:38:13.734781+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.734781+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:29.932696+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"263'279","reported_seq":1658,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:43.275282+0000","last_change":"2024-09-12T00:28:37.424055+0000","last_active":"2024-09-12T01:37:43.275282+0000","last_peered":"2024-09-12T01:37:43.275282+0000","last_clean":"2024-09-12T01:37:43.275282+0000","last_became_active":"2024-09-12T00:28:37.423714+0000","last_became_peered":"2024-09-12T00:28:37.423714+0000","last_unstale":"2024-09-12T01:37:43.275282+0000","last_undegraded":"2024-09-12T01:37:43.275282+0000","last_fullsized":"2024-09-12T01:37:43.275282+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:07.336278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":244,"num_read_kb":234,"num_write":227,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:21.793908+0000","last_change":"2024-09-12T00:28:39.218980+0000","last_active":"2024-09-12T01:35:21.793908+0000","last_peered":"2024-09-12T01:35:21.793908+0000","last_clean":"2024-09-12T01:35:21.793908+0000","last_became_active":"2024-09-12T00:28:39.218692+0000","last_became_peered":"2024-09-12T00:28:39.218692+0000","last_unstale":"2024-09-12T01:35:21.793908+0000","last_undegraded":"2024-09-12T01:35:21.793908+0000","last_fullsized":"2024-09-12T01:35:21.793908+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:07.969643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"263'252","reported_seq":856,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.028499+0000","last_change":"2024-09-12T00:28:41.229721+0000","last_active":"2024-09-12T01:37:46.028499+0000","last_peered":"2024-09-12T01:37:46.028499+0000","last_clean":"2024-09-12T01:37:46.028499+0000","last_became_active":"2024-09-12T00:28:41.229441+0000","last_became_peered":"2024-09-12T00:28:41.229441+0000","last_unstale":"2024-09-12T01:37:46.028499+0000","last_undegraded":"2024-09-12T01:37:46.028499+0000","last_fullsized":"2024-09-12T01:37:46.028499+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":487,"num_read_kb":509,"num_write":546,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"263'224","reported_seq":905,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.182019+0000","last_change":"2024-09-12T01:38:14.182019+0000","last_active":"2024-09-12T01:38:14.182019+0000","last_peered":"2024-09-12T01:38:14.182019+0000","last_clean":"2024-09-12T01:38:14.182019+0000","last_became_active":"2024-09-12T00:28:33.205107+0000","last_became_peered":"2024-09-12T00:28:33.205107+0000","last_unstale":"2024-09-12T01:38:14.182019+0000","last_undegraded":"2024-09-12T01:38:14.182019+0000","last_fullsized":"2024-09-12T01:38:14.182019+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'224","last_scrub_stamp":"2024-09-12T01:38:14.181928+0000","last_deep_scrub":"263'224","last_deep_scrub_stamp":"2024-09-12T01:38:14.181928+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.181928+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:53.395317+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1021,"num_read_kb":847,"num_write":335,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":465,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"263'3","reported_seq":532,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:09.217929+0000","last_change":"2024-09-12T01:38:09.217929+0000","last_active":"2024-09-12T01:38:09.217929+0000","last_peered":"2024-09-12T01:38:09.217929+0000","last_clean":"2024-09-12T01:38:09.217929+0000","last_became_active":"2024-09-12T00:28:19.162307+0000","last_became_peered":"2024-09-12T00:28:19.162307+0000","last_unstale":"2024-09-12T01:38:09.217929+0000","last_undegraded":"2024-09-12T01:38:09.217929+0000","last_fullsized":"2024-09-12T01:38:09.217929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-12T01:38:09.217852+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-12T01:38:09.217852+0000","last_clean_scrub_stamp":"2024-09-12T01:38:09.217852+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:31.504965+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00089189499999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"263'359","reported_seq":1051,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:08.508023+0000","last_change":"2024-09-12T01:38:08.508023+0000","last_active":"2024-09-12T01:38:08.508023+0000","last_peered":"2024-09-12T01:38:08.508023+0000","last_clean":"2024-09-12T01:38:08.508023+0000","last_became_active":"2024-09-12T00:28:31.208584+0000","last_became_peered":"2024-09-12T00:28:31.208584+0000","last_unstale":"2024-09-12T01:38:08.508023+0000","last_undegraded":"2024-09-12T01:38:08.508023+0000","last_fullsized":"2024-09-12T01:38:08.508023+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'359","last_scrub_stamp":"2024-09-12T01:38:08.507897+0000","last_deep_scrub":"263'359","last_deep_scrub_stamp":"2024-09-12T01:38:08.507897+0000","last_clean_scrub_stamp":"2024-09-12T01:38:08.507897+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:25.206563+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262163,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":641,"num_read_kb":7750,"num_write":1122,"num_write_kb":19514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:26.794599+0000","last_change":"2024-09-12T00:28:35.207488+0000","last_active":"2024-09-12T01:35:26.794599+0000","last_peered":"2024-09-12T01:35:26.794599+0000","last_clean":"2024-09-12T01:35:26.794599+0000","last_became_active":"2024-09-12T00:28:35.207234+0000","last_became_peered":"2024-09-12T00:28:35.207234+0000","last_unstale":"2024-09-12T01:35:26.794599+0000","last_undegraded":"2024-09-12T01:35:26.794599+0000","last_fullsized":"2024-09-12T01:35:26.794599+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:43.759273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"263'160","reported_seq":717,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:47.314594+0000","last_change":"2024-09-12T00:28:37.219924+0000","last_active":"2024-09-12T01:37:47.314594+0000","last_peered":"2024-09-12T01:37:47.314594+0000","last_clean":"2024-09-12T01:37:47.314594+0000","last_became_active":"2024-09-12T00:28:37.219599+0000","last_became_peered":"2024-09-12T00:28:37.219599+0000","last_unstale":"2024-09-12T01:37:47.314594+0000","last_undegraded":"2024-09-12T01:37:47.314594+0000","last_fullsized":"2024-09-12T01:37:47.314594+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:19.639653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":184,"num_read_kb":176,"num_write":136,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:51.550499+0000","last_change":"2024-09-12T00:28:39.216740+0000","last_active":"2024-09-12T01:35:51.550499+0000","last_peered":"2024-09-12T01:35:51.550499+0000","last_clean":"2024-09-12T01:35:51.550499+0000","last_became_active":"2024-09-12T00:28:39.216397+0000","last_became_peered":"2024-09-12T00:28:39.216397+0000","last_unstale":"2024-09-12T01:35:51.550499+0000","last_undegraded":"2024-09-12T01:35:51.550499+0000","last_fullsized":"2024-09-12T01:35:51.550499+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:48.659805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"263'110","reported_seq":655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:52.796953+0000","last_change":"2024-09-12T00:28:41.230939+0000","last_active":"2024-09-12T01:35:52.796953+0000","last_peered":"2024-09-12T01:35:52.796953+0000","last_clean":"2024-09-12T01:35:52.796953+0000","last_became_active":"2024-09-12T00:28:41.230698+0000","last_became_peered":"2024-09-12T00:28:41.230698+0000","last_unstale":"2024-09-12T01:35:52.796953+0000","last_undegraded":"2024-09-12T01:35:52.796953+0000","last_fullsized":"2024-09-12T01:35:52.796953+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:35.474853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":194,"num_write":246,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"263'101","reported_seq":695,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.032734+0000","last_change":"2024-09-12T01:38:18.032734+0000","last_active":"2024-09-12T01:38:18.032734+0000","last_peered":"2024-09-12T01:38:18.032734+0000","last_clean":"2024-09-12T01:38:18.032734+0000","last_became_active":"2024-09-12T00:28:33.213241+0000","last_became_peered":"2024-09-12T00:28:33.213241+0000","last_unstale":"2024-09-12T01:38:18.032734+0000","last_undegraded":"2024-09-12T01:38:18.032734+0000","last_fullsized":"2024-09-12T01:38:18.032734+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'101","last_scrub_stamp":"2024-09-12T01:38:18.032630+0000","last_deep_scrub":"263'101","last_deep_scrub_stamp":"2024-09-12T01:38:18.032630+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.032630+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:48.287686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":440,"num_read_kb":364,"num_write":181,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"263'335","reported_seq":959,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.220801+0000","last_change":"2024-09-12T01:38:10.220801+0000","last_active":"2024-09-12T01:38:10.220801+0000","last_peered":"2024-09-12T01:38:10.220801+0000","last_clean":"2024-09-12T01:38:10.220801+0000","last_became_active":"2024-09-12T00:28:31.209154+0000","last_became_peered":"2024-09-12T00:28:31.209154+0000","last_unstale":"2024-09-12T01:38:10.220801+0000","last_undegraded":"2024-09-12T01:38:10.220801+0000","last_fullsized":"2024-09-12T01:38:10.220801+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'335","last_scrub_stamp":"2024-09-12T01:38:10.220717+0000","last_deep_scrub":"263'335","last_deep_scrub_stamp":"2024-09-12T01:38:10.220717+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.220717+0000","objects_scrubbed":6,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:59.487021+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":854338,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":445,"num_read_kb":910,"num_write":1009,"num_write_kb":5944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":541,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.186088+0000","last_change":"2024-09-12T01:38:10.186088+0000","last_active":"2024-09-12T01:38:10.186088+0000","last_peered":"2024-09-12T01:38:10.186088+0000","last_clean":"2024-09-12T01:38:10.186088+0000","last_became_active":"2024-09-12T00:28:19.383394+0000","last_became_peered":"2024-09-12T00:28:19.383394+0000","last_unstale":"2024-09-12T01:38:10.186088+0000","last_undegraded":"2024-09-12T01:38:10.186088+0000","last_fullsized":"2024-09-12T01:38:10.186088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.186021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.186021+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.186021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:10.372021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046548800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.793286+0000","last_change":"2024-09-12T00:28:35.208415+0000","last_active":"2024-09-12T01:35:16.793286+0000","last_peered":"2024-09-12T01:35:16.793286+0000","last_clean":"2024-09-12T01:35:16.793286+0000","last_became_active":"2024-09-12T00:28:35.208094+0000","last_became_peered":"2024-09-12T00:28:35.208094+0000","last_unstale":"2024-09-12T01:35:16.793286+0000","last_undegraded":"2024-09-12T01:35:16.793286+0000","last_fullsized":"2024-09-12T01:35:16.793286+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:03.328037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"263'664","reported_seq":1365,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:24.148638+0000","last_change":"2024-09-12T01:38:24.148638+0000","last_active":"2024-09-12T01:38:24.148638+0000","last_peered":"2024-09-12T01:38:24.148638+0000","last_clean":"2024-09-12T01:38:24.148638+0000","last_became_active":"2024-09-12T00:28:37.220158+0000","last_became_peered":"2024-09-12T00:28:37.220158+0000","last_unstale":"2024-09-12T01:38:24.148638+0000","last_undegraded":"2024-09-12T01:38:24.148638+0000","last_fullsized":"2024-09-12T01:38:24.148638+0000","mapping_epoch":31,"log_start":"263'600","ondisk_log_start":"263'600","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'664","last_scrub_stamp":"2024-09-12T01:38:24.148534+0000","last_deep_scrub":"263'664","last_deep_scrub_stamp":"2024-09-12T01:38:24.148534+0000","last_clean_scrub_stamp":"2024-09-12T01:38:24.148534+0000","objects_scrubbed":11,"log_size":64,"log_dups_size":600,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:38.824218+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103952,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1701,"num_read_kb":3039,"num_write":2184,"num_write_kb":1992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":500702,"num_omap_keys":1132,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:21.546179+0000","last_change":"2024-09-12T00:28:39.220506+0000","last_active":"2024-09-12T01:35:21.546179+0000","last_peered":"2024-09-12T01:35:21.546179+0000","last_clean":"2024-09-12T01:35:21.546179+0000","last_became_active":"2024-09-12T00:28:39.220079+0000","last_became_peered":"2024-09-12T00:28:39.220079+0000","last_unstale":"2024-09-12T01:35:21.546179+0000","last_undegraded":"2024-09-12T01:35:21.546179+0000","last_fullsized":"2024-09-12T01:35:21.546179+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:23.654340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"263'134","reported_seq":654,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:39.113274+0000","last_change":"2024-09-12T00:28:41.258045+0000","last_active":"2024-09-12T01:36:39.113274+0000","last_peered":"2024-09-12T01:36:39.113274+0000","last_clean":"2024-09-12T01:36:39.113274+0000","last_became_active":"2024-09-12T00:28:41.257739+0000","last_became_peered":"2024-09-12T00:28:41.257739+0000","last_unstale":"2024-09-12T01:36:39.113274+0000","last_undegraded":"2024-09-12T01:36:39.113274+0000","last_fullsized":"2024-09-12T01:36:39.113274+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":203,"num_read_kb":182,"num_write":334,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"263'142","reported_seq":783,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.185063+0000","last_change":"2024-09-12T01:38:22.185063+0000","last_active":"2024-09-12T01:38:22.185063+0000","last_peered":"2024-09-12T01:38:22.185063+0000","last_clean":"2024-09-12T01:38:22.185063+0000","last_became_active":"2024-09-12T00:28:33.216065+0000","last_became_peered":"2024-09-12T00:28:33.216065+0000","last_unstale":"2024-09-12T01:38:22.185063+0000","last_undegraded":"2024-09-12T01:38:22.185063+0000","last_fullsized":"2024-09-12T01:38:22.185063+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'142","last_scrub_stamp":"2024-09-12T01:38:22.184985+0000","last_deep_scrub":"263'142","last_deep_scrub_stamp":"2024-09-12T01:38:22.184985+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.184985+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:25.280489+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":614,"num_read_kb":525,"num_write":208,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"263'345","reported_seq":1013,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:09.220565+0000","last_change":"2024-09-12T01:38:09.220565+0000","last_active":"2024-09-12T01:38:09.220565+0000","last_peered":"2024-09-12T01:38:09.220565+0000","last_clean":"2024-09-12T01:38:09.220565+0000","last_became_active":"2024-09-12T00:28:31.198681+0000","last_became_peered":"2024-09-12T00:28:31.198681+0000","last_unstale":"2024-09-12T01:38:09.220565+0000","last_undegraded":"2024-09-12T01:38:09.220565+0000","last_fullsized":"2024-09-12T01:38:09.220565+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'345","last_scrub_stamp":"2024-09-12T01:38:09.220489+0000","last_deep_scrub":"263'345","last_deep_scrub_stamp":"2024-09-12T01:38:09.220489+0000","last_clean_scrub_stamp":"2024-09-12T01:38:09.220489+0000","objects_scrubbed":5,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:20.626502+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550835,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":482,"num_read_kb":38182,"num_write":1051,"num_write_kb":26889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":530,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.230605+0000","last_change":"2024-09-12T01:38:10.230605+0000","last_active":"2024-09-12T01:38:10.230605+0000","last_peered":"2024-09-12T01:38:10.230605+0000","last_clean":"2024-09-12T01:38:10.230605+0000","last_became_active":"2024-09-12T00:28:19.384222+0000","last_became_peered":"2024-09-12T00:28:19.384222+0000","last_unstale":"2024-09-12T01:38:10.230605+0000","last_undegraded":"2024-09-12T01:38:10.230605+0000","last_fullsized":"2024-09-12T01:38:10.230605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.230512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.230512+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.230512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:30.488629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060999899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"263'6","reported_seq":991,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.212001+0000","last_change":"2024-09-12T01:38:21.212001+0000","last_active":"2024-09-12T01:38:21.212001+0000","last_peered":"2024-09-12T01:38:21.212001+0000","last_clean":"2024-09-12T01:38:21.212001+0000","last_became_active":"2024-09-12T00:28:35.207941+0000","last_became_peered":"2024-09-12T00:28:35.207941+0000","last_unstale":"2024-09-12T01:38:21.212001+0000","last_undegraded":"2024-09-12T01:38:21.212001+0000","last_fullsized":"2024-09-12T01:38:21.212001+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-12T01:38:21.211920+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-12T01:38:21.211920+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.211920+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:16.655918+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":1191,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"263'246","reported_seq":839,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:48.927414+0000","last_change":"2024-09-12T00:28:37.424197+0000","last_active":"2024-09-12T01:36:48.927414+0000","last_peered":"2024-09-12T01:36:48.927414+0000","last_clean":"2024-09-12T01:36:48.927414+0000","last_became_active":"2024-09-12T00:28:37.423835+0000","last_became_peered":"2024-09-12T00:28:37.423835+0000","last_unstale":"2024-09-12T01:36:48.927414+0000","last_undegraded":"2024-09-12T01:36:48.927414+0000","last_fullsized":"2024-09-12T01:36:48.927414+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:55.348547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":310,"num_read_kb":301,"num_write":288,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"263'781","reported_seq":2896,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.556589+0000","last_change":"2024-09-12T00:28:39.214336+0000","last_active":"2024-09-12T01:38:01.556589+0000","last_peered":"2024-09-12T01:38:01.556589+0000","last_clean":"2024-09-12T01:38:01.556589+0000","last_became_active":"2024-09-12T00:28:39.214050+0000","last_became_peered":"2024-09-12T00:28:39.214050+0000","last_unstale":"2024-09-12T01:38:01.556589+0000","last_undegraded":"2024-09-12T01:38:01.556589+0000","last_fullsized":"2024-09-12T01:38:01.556589+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:42.935841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"263'143","reported_seq":656,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:29.656020+0000","last_change":"2024-09-12T00:28:41.255145+0000","last_active":"2024-09-12T01:36:29.656020+0000","last_peered":"2024-09-12T01:36:29.656020+0000","last_clean":"2024-09-12T01:36:29.656020+0000","last_became_active":"2024-09-12T00:28:41.254826+0000","last_became_peered":"2024-09-12T00:28:41.254826+0000","last_unstale":"2024-09-12T01:36:29.656020+0000","last_undegraded":"2024-09-12T01:36:29.656020+0000","last_fullsized":"2024-09-12T01:36:29.656020+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:08.523605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1298,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":177,"num_read_kb":162,"num_write":341,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"263'307","reported_seq":918,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:26.300995+0000","last_change":"2024-09-12T01:38:26.300995+0000","last_active":"2024-09-12T01:38:26.300995+0000","last_peered":"2024-09-12T01:38:26.300995+0000","last_clean":"2024-09-12T01:38:26.300995+0000","last_became_active":"2024-09-12T00:28:33.217516+0000","last_became_peered":"2024-09-12T00:28:33.217516+0000","last_unstale":"2024-09-12T01:38:26.300995+0000","last_undegraded":"2024-09-12T01:38:26.300995+0000","last_fullsized":"2024-09-12T01:38:26.300995+0000","mapping_epoch":27,"log_start":"260'200","ondisk_log_start":"260'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'307","last_scrub_stamp":"2024-09-12T01:38:26.300887+0000","last_deep_scrub":"263'307","last_deep_scrub_stamp":"2024-09-12T01:38:26.300887+0000","last_clean_scrub_stamp":"2024-09-12T01:38:26.300887+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:46.021127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1312,"num_read_kb":1045,"num_write":501,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"263'312","reported_seq":914,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:08.232707+0000","last_change":"2024-09-12T01:38:08.232707+0000","last_active":"2024-09-12T01:38:08.232707+0000","last_peered":"2024-09-12T01:38:08.232707+0000","last_clean":"2024-09-12T01:38:08.232707+0000","last_became_active":"2024-09-12T00:28:31.202895+0000","last_became_peered":"2024-09-12T00:28:31.202895+0000","last_unstale":"2024-09-12T01:38:08.232707+0000","last_undegraded":"2024-09-12T01:38:08.232707+0000","last_fullsized":"2024-09-12T01:38:08.232707+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'312","last_scrub_stamp":"2024-09-12T01:38:08.232586+0000","last_deep_scrub":"263'312","last_deep_scrub_stamp":"2024-09-12T01:38:08.232586+0000","last_clean_scrub_stamp":"2024-09-12T01:38:08.232586+0000","objects_scrubbed":7,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:08.573915+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262178,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":365,"num_read_kb":358,"num_write":953,"num_write_kb":25812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":540,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:07.216544+0000","last_change":"2024-09-12T01:38:07.216544+0000","last_active":"2024-09-12T01:38:07.216544+0000","last_peered":"2024-09-12T01:38:07.216544+0000","last_clean":"2024-09-12T01:38:07.216544+0000","last_became_active":"2024-09-12T00:28:19.160344+0000","last_became_peered":"2024-09-12T00:28:19.160344+0000","last_unstale":"2024-09-12T01:38:07.216544+0000","last_undegraded":"2024-09-12T01:38:07.216544+0000","last_fullsized":"2024-09-12T01:38:07.216544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:07.216476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:07.216476+0000","last_clean_scrub_stamp":"2024-09-12T01:38:07.216476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:01.774688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000483707,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.545492+0000","last_change":"2024-09-12T00:28:35.215757+0000","last_active":"2024-09-12T01:35:16.545492+0000","last_peered":"2024-09-12T01:35:16.545492+0000","last_clean":"2024-09-12T01:35:16.545492+0000","last_became_active":"2024-09-12T00:28:35.215429+0000","last_became_peered":"2024-09-12T00:28:35.215429+0000","last_unstale":"2024-09-12T01:35:16.545492+0000","last_undegraded":"2024-09-12T01:35:16.545492+0000","last_fullsized":"2024-09-12T01:35:16.545492+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:04.938748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"263'130","reported_seq":687,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.545524+0000","last_change":"2024-09-12T00:28:37.220271+0000","last_active":"2024-09-12T01:35:16.545524+0000","last_peered":"2024-09-12T01:35:16.545524+0000","last_clean":"2024-09-12T01:35:16.545524+0000","last_became_active":"2024-09-12T00:28:37.219746+0000","last_became_peered":"2024-09-12T00:28:37.219746+0000","last_unstale":"2024-09-12T01:35:16.545524+0000","last_undegraded":"2024-09-12T01:35:16.545524+0000","last_fullsized":"2024-09-12T01:35:16.545524+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:18.690666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":158,"num_read_kb":152,"num_write":104,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"263'769","reported_seq":2684,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.452972+0000","last_change":"2024-09-12T00:28:39.218435+0000","last_active":"2024-09-12T01:38:01.452972+0000","last_peered":"2024-09-12T01:38:01.452972+0000","last_clean":"2024-09-12T01:38:01.452972+0000","last_became_active":"2024-09-12T00:28:39.218170+0000","last_became_peered":"2024-09-12T00:28:39.218170+0000","last_unstale":"2024-09-12T01:38:01.452972+0000","last_undegraded":"2024-09-12T01:38:01.452972+0000","last_fullsized":"2024-09-12T01:38:01.452972+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:17.381935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"263'181","reported_seq":681,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.799988+0000","last_change":"2024-09-12T00:28:41.225659+0000","last_active":"2024-09-12T01:36:11.799988+0000","last_peered":"2024-09-12T01:36:11.799988+0000","last_clean":"2024-09-12T01:36:11.799988+0000","last_became_active":"2024-09-12T00:28:41.225316+0000","last_became_peered":"2024-09-12T00:28:41.225316+0000","last_unstale":"2024-09-12T01:36:11.799988+0000","last_undegraded":"2024-09-12T01:36:11.799988+0000","last_fullsized":"2024-09-12T01:36:11.799988+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":127,"num_read_kb":125,"num_write":428,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"263'343","reported_seq":987,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.498869+0000","last_change":"2024-09-12T01:38:20.498869+0000","last_active":"2024-09-12T01:38:20.498869+0000","last_peered":"2024-09-12T01:38:20.498869+0000","last_clean":"2024-09-12T01:38:20.498869+0000","last_became_active":"2024-09-12T00:28:33.212624+0000","last_became_peered":"2024-09-12T00:28:33.212624+0000","last_unstale":"2024-09-12T01:38:20.498869+0000","last_undegraded":"2024-09-12T01:38:20.498869+0000","last_fullsized":"2024-09-12T01:38:20.498869+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'343","last_scrub_stamp":"2024-09-12T01:38:20.498766+0000","last_deep_scrub":"263'343","last_deep_scrub_stamp":"2024-09-12T01:38:20.498766+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.498766+0000","objects_scrubbed":1,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:22.317000+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1481,"num_read_kb":1196,"num_write":544,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8074,"num_omap_keys":32,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"263'460","reported_seq":1183,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:07.124158+0000","last_change":"2024-09-12T01:38:07.124158+0000","last_active":"2024-09-12T01:38:07.124158+0000","last_peered":"2024-09-12T01:38:07.124158+0000","last_clean":"2024-09-12T01:38:07.124158+0000","last_became_active":"2024-09-12T00:28:31.203087+0000","last_became_peered":"2024-09-12T00:28:31.203087+0000","last_unstale":"2024-09-12T01:38:07.124158+0000","last_undegraded":"2024-09-12T01:38:07.124158+0000","last_fullsized":"2024-09-12T01:38:07.124158+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'460","last_scrub_stamp":"2024-09-12T01:38:07.124064+0000","last_deep_scrub":"263'460","last_deep_scrub_stamp":"2024-09-12T01:38:07.124064+0000","last_clean_scrub_stamp":"2024-09-12T01:38:07.124064+0000","objects_scrubbed":11,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:46.650060+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":607243,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":857,"num_read_kb":36686,"num_write":1272,"num_write_kb":31229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":531,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:09.149142+0000","last_change":"2024-09-12T01:38:09.149142+0000","last_active":"2024-09-12T01:38:09.149142+0000","last_peered":"2024-09-12T01:38:09.149142+0000","last_clean":"2024-09-12T01:38:09.149142+0000","last_became_active":"2024-09-12T00:28:19.162886+0000","last_became_peered":"2024-09-12T00:28:19.162886+0000","last_unstale":"2024-09-12T01:38:09.149142+0000","last_undegraded":"2024-09-12T01:38:09.149142+0000","last_fullsized":"2024-09-12T01:38:09.149142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:09.149026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:09.149026+0000","last_clean_scrub_stamp":"2024-09-12T01:38:09.149026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:10.471474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044054899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:29.289000+0000","last_change":"2024-09-12T01:38:29.289000+0000","last_active":"2024-09-12T01:38:29.289000+0000","last_peered":"2024-09-12T01:38:29.289000+0000","last_clean":"2024-09-12T01:38:29.289000+0000","last_became_active":"2024-09-12T00:28:35.212916+0000","last_became_peered":"2024-09-12T00:28:35.212916+0000","last_unstale":"2024-09-12T01:38:29.289000+0000","last_undegraded":"2024-09-12T01:38:29.289000+0000","last_fullsized":"2024-09-12T01:38:29.289000+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:29.288919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:29.288919+0000","last_clean_scrub_stamp":"2024-09-12T01:38:29.288919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:34.426132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"263'763","reported_seq":1501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.569644+0000","last_change":"2024-09-12T00:28:37.424089+0000","last_active":"2024-09-12T01:38:01.569644+0000","last_peered":"2024-09-12T01:38:01.569644+0000","last_clean":"2024-09-12T01:38:01.569644+0000","last_became_active":"2024-09-12T00:28:37.423755+0000","last_became_peered":"2024-09-12T00:28:37.423755+0000","last_unstale":"2024-09-12T01:38:01.569644+0000","last_undegraded":"2024-09-12T01:38:01.569644+0000","last_fullsized":"2024-09-12T01:38:01.569644+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:34.013923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138292,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1365,"num_read_kb":3277,"num_write":1104,"num_write_kb":888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:19.647506+0000","last_change":"2024-09-12T00:28:39.216520+0000","last_active":"2024-09-12T01:35:19.647506+0000","last_peered":"2024-09-12T01:35:19.647506+0000","last_clean":"2024-09-12T01:35:19.647506+0000","last_became_active":"2024-09-12T00:28:39.216237+0000","last_became_peered":"2024-09-12T00:28:39.216237+0000","last_unstale":"2024-09-12T01:35:19.647506+0000","last_undegraded":"2024-09-12T01:35:19.647506+0000","last_fullsized":"2024-09-12T01:35:19.647506+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:00.630922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"263'83","reported_seq":576,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:12.800082+0000","last_change":"2024-09-12T00:28:41.234000+0000","last_active":"2024-09-12T01:36:12.800082+0000","last_peered":"2024-09-12T01:36:12.800082+0000","last_clean":"2024-09-12T01:36:12.800082+0000","last_became_active":"2024-09-12T00:28:41.233696+0000","last_became_peered":"2024-09-12T00:28:41.233696+0000","last_unstale":"2024-09-12T01:36:12.800082+0000","last_undegraded":"2024-09-12T01:36:12.800082+0000","last_fullsized":"2024-09-12T01:36:12.800082+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":84,"num_read_kb":82,"num_write":190,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"263'149","reported_seq":715,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:42.805442+0000","last_change":"2024-09-12T00:28:41.226966+0000","last_active":"2024-09-12T01:36:42.805442+0000","last_peered":"2024-09-12T01:36:42.805442+0000","last_clean":"2024-09-12T01:36:42.805442+0000","last_became_active":"2024-09-12T00:28:41.226143+0000","last_became_peered":"2024-09-12T00:28:41.226143+0000","last_unstale":"2024-09-12T01:36:42.805442+0000","last_undegraded":"2024-09-12T01:36:42.805442+0000","last_fullsized":"2024-09-12T01:36:42.805442+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:18.139245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":251,"num_read_kb":240,"num_write":350,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"263'64","reported_seq":628,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.544633+0000","last_change":"2024-09-12T01:38:14.544633+0000","last_active":"2024-09-12T01:38:14.544633+0000","last_peered":"2024-09-12T01:38:14.544633+0000","last_clean":"2024-09-12T01:38:14.544633+0000","last_became_active":"2024-09-12T00:28:33.209335+0000","last_became_peered":"2024-09-12T00:28:33.209335+0000","last_unstale":"2024-09-12T01:38:14.544633+0000","last_undegraded":"2024-09-12T01:38:14.544633+0000","last_fullsized":"2024-09-12T01:38:14.544633+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'64","last_scrub_stamp":"2024-09-12T01:38:14.544539+0000","last_deep_scrub":"263'64","last_deep_scrub_stamp":"2024-09-12T01:38:14.544539+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.544539+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:01.588201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":218,"num_write":93,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"263'395","reported_seq":1084,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.703424+0000","last_change":"2024-09-12T01:38:19.703424+0000","last_active":"2024-09-12T01:38:19.703424+0000","last_peered":"2024-09-12T01:38:19.703424+0000","last_clean":"2024-09-12T01:38:19.703424+0000","last_became_active":"2024-09-12T00:29:04.295676+0000","last_became_peered":"2024-09-12T00:29:04.295676+0000","last_unstale":"2024-09-12T01:38:19.703424+0000","last_undegraded":"2024-09-12T01:38:19.703424+0000","last_fullsized":"2024-09-12T01:38:19.703424+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'395","last_scrub_stamp":"2024-09-12T01:38:19.703172+0000","last_deep_scrub":"263'395","last_deep_scrub_stamp":"2024-09-12T01:38:19.703172+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.703172+0000","objects_scrubbed":8,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:41.744192+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2554787,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":757,"num_read_kb":17367,"num_write":1239,"num_write_kb":40068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.997345+0000","last_change":"2024-09-12T01:38:22.997345+0000","last_active":"2024-09-12T01:38:22.997345+0000","last_peered":"2024-09-12T01:38:22.997345+0000","last_clean":"2024-09-12T01:38:22.997345+0000","last_became_active":"2024-09-12T00:28:35.208165+0000","last_became_peered":"2024-09-12T00:28:35.208165+0000","last_unstale":"2024-09-12T01:38:22.997345+0000","last_undegraded":"2024-09-12T01:38:22.997345+0000","last_fullsized":"2024-09-12T01:38:22.997345+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:22.997265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:22.997265+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.997265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:37.750337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"263'297","reported_seq":889,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.187390+0000","last_change":"2024-09-12T00:28:37.217911+0000","last_active":"2024-09-12T01:38:00.187390+0000","last_peered":"2024-09-12T01:38:00.187390+0000","last_clean":"2024-09-12T01:38:00.187390+0000","last_became_active":"2024-09-12T00:28:37.217603+0000","last_became_peered":"2024-09-12T00:28:37.217603+0000","last_unstale":"2024-09-12T01:38:00.187390+0000","last_undegraded":"2024-09-12T01:38:00.187390+0000","last_fullsized":"2024-09-12T01:38:00.187390+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:00.439250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46508,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":487,"num_read_kb":1094,"num_write":390,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:59.638101+0000","last_change":"2024-09-12T00:28:39.216498+0000","last_active":"2024-09-12T01:33:59.638101+0000","last_peered":"2024-09-12T01:33:59.638101+0000","last_clean":"2024-09-12T01:33:59.638101+0000","last_became_active":"2024-09-12T00:28:39.216143+0000","last_became_peered":"2024-09-12T00:28:39.216143+0000","last_unstale":"2024-09-12T01:33:59.638101+0000","last_undegraded":"2024-09-12T01:33:59.638101+0000","last_fullsized":"2024-09-12T01:33:59.638101+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:29.237838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"263'119","reported_seq":632,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:42.721881+0000","last_change":"2024-09-12T00:28:41.232566+0000","last_active":"2024-09-12T01:36:42.721881+0000","last_peered":"2024-09-12T01:36:42.721881+0000","last_clean":"2024-09-12T01:36:42.721881+0000","last_became_active":"2024-09-12T00:28:41.232114+0000","last_became_peered":"2024-09-12T00:28:41.232114+0000","last_unstale":"2024-09-12T01:36:42.721881+0000","last_undegraded":"2024-09-12T01:36:42.721881+0000","last_fullsized":"2024-09-12T01:36:42.721881+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:39.890316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":141,"num_write":283,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"263'347","reported_seq":1054,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:25.427221+0000","last_change":"2024-09-12T01:38:25.427221+0000","last_active":"2024-09-12T01:38:25.427221+0000","last_peered":"2024-09-12T01:38:25.427221+0000","last_clean":"2024-09-12T01:38:25.427221+0000","last_became_active":"2024-09-12T00:29:04.292302+0000","last_became_peered":"2024-09-12T00:29:04.292302+0000","last_unstale":"2024-09-12T01:38:25.427221+0000","last_undegraded":"2024-09-12T01:38:25.427221+0000","last_fullsized":"2024-09-12T01:38:25.427221+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'347","last_scrub_stamp":"2024-09-12T01:38:25.427133+0000","last_deep_scrub":"263'347","last_deep_scrub_stamp":"2024-09-12T01:38:25.427133+0000","last_clean_scrub_stamp":"2024-09-12T01:38:25.427133+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:54.656816+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1719,"num_read_kb":1484,"num_write":537,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25751,"num_omap_keys":101,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"263'396","reported_seq":1181,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.265866+0000","last_change":"2024-09-12T01:38:18.265866+0000","last_active":"2024-09-12T01:38:18.265866+0000","last_peered":"2024-09-12T01:38:18.265866+0000","last_clean":"2024-09-12T01:38:18.265866+0000","last_became_active":"2024-09-12T00:28:31.207765+0000","last_became_peered":"2024-09-12T00:28:31.207765+0000","last_unstale":"2024-09-12T01:38:18.265866+0000","last_undegraded":"2024-09-12T01:38:18.265866+0000","last_fullsized":"2024-09-12T01:38:18.265866+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'396","last_scrub_stamp":"2024-09-12T01:38:18.265737+0000","last_deep_scrub":"263'396","last_deep_scrub_stamp":"2024-09-12T01:38:18.265737+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.265737+0000","objects_scrubbed":10,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:42.523716+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2529502,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":736,"num_read_kb":9284,"num_write":1355,"num_write_kb":41598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:27.266554+0000","last_change":"2024-09-12T01:38:27.266554+0000","last_active":"2024-09-12T01:38:27.266554+0000","last_peered":"2024-09-12T01:38:27.266554+0000","last_clean":"2024-09-12T01:38:27.266554+0000","last_became_active":"2024-09-12T00:28:35.212243+0000","last_became_peered":"2024-09-12T00:28:35.212243+0000","last_unstale":"2024-09-12T01:38:27.266554+0000","last_undegraded":"2024-09-12T01:38:27.266554+0000","last_fullsized":"2024-09-12T01:38:27.266554+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:27.266464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:27.266464+0000","last_clean_scrub_stamp":"2024-09-12T01:38:27.266464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:57.767929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"263'57","reported_seq":565,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.783705+0000","last_change":"2024-09-12T00:28:37.220699+0000","last_active":"2024-09-12T01:33:56.783705+0000","last_peered":"2024-09-12T01:33:56.783705+0000","last_clean":"2024-09-12T01:33:56.783705+0000","last_became_active":"2024-09-12T00:28:37.219799+0000","last_became_peered":"2024-09-12T00:28:37.219799+0000","last_unstale":"2024-09-12T01:33:56.783705+0000","last_undegraded":"2024-09-12T01:33:56.783705+0000","last_fullsized":"2024-09-12T01:33:56.783705+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:52.584996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":42,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:01.719361+0000","last_change":"2024-09-12T00:28:39.219540+0000","last_active":"2024-09-12T01:34:01.719361+0000","last_peered":"2024-09-12T01:34:01.719361+0000","last_clean":"2024-09-12T01:34:01.719361+0000","last_became_active":"2024-09-12T00:28:39.219209+0000","last_became_peered":"2024-09-12T00:28:39.219209+0000","last_unstale":"2024-09-12T01:34:01.719361+0000","last_undegraded":"2024-09-12T01:34:01.719361+0000","last_fullsized":"2024-09-12T01:34:01.719361+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:53.327778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"263'211","reported_seq":739,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:41.517803+0000","last_change":"2024-09-12T00:28:41.226184+0000","last_active":"2024-09-12T01:36:41.517803+0000","last_peered":"2024-09-12T01:36:41.517803+0000","last_clean":"2024-09-12T01:36:41.517803+0000","last_became_active":"2024-09-12T00:28:41.225673+0000","last_became_peered":"2024-09-12T00:28:41.225673+0000","last_unstale":"2024-09-12T01:36:41.517803+0000","last_undegraded":"2024-09-12T01:36:41.517803+0000","last_fullsized":"2024-09-12T01:36:41.517803+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:16.037270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":332,"num_read_kb":318,"num_write":482,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"263'71","reported_seq":701,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.187360+0000","last_change":"2024-09-12T01:38:15.187360+0000","last_active":"2024-09-12T01:38:15.187360+0000","last_peered":"2024-09-12T01:38:15.187360+0000","last_clean":"2024-09-12T01:38:15.187360+0000","last_became_active":"2024-09-12T00:28:33.213777+0000","last_became_peered":"2024-09-12T00:28:33.213777+0000","last_unstale":"2024-09-12T01:38:15.187360+0000","last_undegraded":"2024-09-12T01:38:15.187360+0000","last_fullsized":"2024-09-12T01:38:15.187360+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'71","last_scrub_stamp":"2024-09-12T01:38:15.187273+0000","last_deep_scrub":"263'71","last_deep_scrub_stamp":"2024-09-12T01:38:15.187273+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.187273+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:48.489235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":365,"num_read_kb":325,"num_write":89,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"263'346","reported_seq":981,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.342517+0000","last_change":"2024-09-12T01:38:13.342517+0000","last_active":"2024-09-12T01:38:13.342517+0000","last_peered":"2024-09-12T01:38:13.342517+0000","last_clean":"2024-09-12T01:38:13.342517+0000","last_became_active":"2024-09-12T00:28:31.213567+0000","last_became_peered":"2024-09-12T00:28:31.213567+0000","last_unstale":"2024-09-12T01:38:13.342517+0000","last_undegraded":"2024-09-12T01:38:13.342517+0000","last_fullsized":"2024-09-12T01:38:13.342517+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'346","last_scrub_stamp":"2024-09-12T01:38:13.342398+0000","last_deep_scrub":"263'346","last_deep_scrub_stamp":"2024-09-12T01:38:13.342398+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.342398+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:37.312677+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262191,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":463,"num_read_kb":31334,"num_write":999,"num_write_kb":46181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.718581+0000","last_change":"2024-09-12T00:28:35.210262+0000","last_active":"2024-09-12T01:33:56.718581+0000","last_peered":"2024-09-12T01:33:56.718581+0000","last_clean":"2024-09-12T01:33:56.718581+0000","last_became_active":"2024-09-12T00:28:35.210000+0000","last_became_peered":"2024-09-12T00:28:35.210000+0000","last_unstale":"2024-09-12T01:33:56.718581+0000","last_undegraded":"2024-09-12T01:33:56.718581+0000","last_fullsized":"2024-09-12T01:33:56.718581+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:21.147847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"263'335","reported_seq":937,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.318801+0000","last_change":"2024-09-12T00:28:37.222936+0000","last_active":"2024-09-12T01:38:01.318801+0000","last_peered":"2024-09-12T01:38:01.318801+0000","last_clean":"2024-09-12T01:38:01.318801+0000","last_became_active":"2024-09-12T00:28:37.222678+0000","last_became_peered":"2024-09-12T00:28:37.222678+0000","last_unstale":"2024-09-12T01:38:01.318801+0000","last_undegraded":"2024-09-12T01:38:01.318801+0000","last_fullsized":"2024-09-12T01:38:01.318801+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:29.474781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45149,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":551,"num_read_kb":1230,"num_write":438,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:01.534928+0000","last_change":"2024-09-12T00:28:39.216508+0000","last_active":"2024-09-12T01:34:01.534928+0000","last_peered":"2024-09-12T01:34:01.534928+0000","last_clean":"2024-09-12T01:34:01.534928+0000","last_became_active":"2024-09-12T00:28:39.216200+0000","last_became_peered":"2024-09-12T00:28:39.216200+0000","last_unstale":"2024-09-12T01:34:01.534928+0000","last_undegraded":"2024-09-12T01:34:01.534928+0000","last_fullsized":"2024-09-12T01:34:01.534928+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:22.629426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"263'112","reported_seq":626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:42.778426+0000","last_change":"2024-09-12T00:28:41.232852+0000","last_active":"2024-09-12T01:33:42.778426+0000","last_peered":"2024-09-12T01:33:42.778426+0000","last_clean":"2024-09-12T01:33:42.778426+0000","last_became_active":"2024-09-12T00:28:41.232381+0000","last_became_peered":"2024-09-12T00:28:41.232381+0000","last_unstale":"2024-09-12T01:33:42.778426+0000","last_undegraded":"2024-09-12T01:33:42.778426+0000","last_fullsized":"2024-09-12T01:33:42.778426+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:50.533536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":176,"num_read_kb":166,"num_write":281,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"263'153","reported_seq":753,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:28.299358+0000","last_change":"2024-09-12T01:38:28.299358+0000","last_active":"2024-09-12T01:38:28.299358+0000","last_peered":"2024-09-12T01:38:28.299358+0000","last_clean":"2024-09-12T01:38:28.299358+0000","last_became_active":"2024-09-12T00:28:33.211165+0000","last_became_peered":"2024-09-12T00:28:33.211165+0000","last_unstale":"2024-09-12T01:38:28.299358+0000","last_undegraded":"2024-09-12T01:38:28.299358+0000","last_fullsized":"2024-09-12T01:38:28.299358+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'153","last_scrub_stamp":"2024-09-12T01:38:28.299270+0000","last_deep_scrub":"263'153","last_deep_scrub_stamp":"2024-09-12T01:38:28.299270+0000","last_clean_scrub_stamp":"2024-09-12T01:38:28.299270+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:32.733250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":668,"num_read_kb":545,"num_write":223,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"263'340","reported_seq":977,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.047601+0000","last_change":"2024-09-12T01:38:10.047601+0000","last_active":"2024-09-12T01:38:10.047601+0000","last_peered":"2024-09-12T01:38:10.047601+0000","last_clean":"2024-09-12T01:38:10.047601+0000","last_became_active":"2024-09-12T00:28:31.213971+0000","last_became_peered":"2024-09-12T00:28:31.213971+0000","last_unstale":"2024-09-12T01:38:10.047601+0000","last_undegraded":"2024-09-12T01:38:10.047601+0000","last_fullsized":"2024-09-12T01:38:10.047601+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'340","last_scrub_stamp":"2024-09-12T01:38:10.047526+0000","last_deep_scrub":"263'340","last_deep_scrub_stamp":"2024-09-12T01:38:10.047526+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.047526+0000","objects_scrubbed":8,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:30.027467+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340133,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":428,"num_read_kb":61436,"num_write":986,"num_write_kb":69756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:23.136434+0000","last_change":"2024-09-12T01:38:23.136434+0000","last_active":"2024-09-12T01:38:23.136434+0000","last_peered":"2024-09-12T01:38:23.136434+0000","last_clean":"2024-09-12T01:38:23.136434+0000","last_became_active":"2024-09-12T00:28:35.210060+0000","last_became_peered":"2024-09-12T00:28:35.210060+0000","last_unstale":"2024-09-12T01:38:23.136434+0000","last_undegraded":"2024-09-12T01:38:23.136434+0000","last_fullsized":"2024-09-12T01:38:23.136434+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:23.136334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:23.136334+0000","last_clean_scrub_stamp":"2024-09-12T01:38:23.136334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:03.715995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"263'297","reported_seq":871,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.176723+0000","last_change":"2024-09-12T00:28:37.221776+0000","last_active":"2024-09-12T01:38:01.176723+0000","last_peered":"2024-09-12T01:38:01.176723+0000","last_clean":"2024-09-12T01:38:01.176723+0000","last_became_active":"2024-09-12T00:28:37.221491+0000","last_became_peered":"2024-09-12T00:28:37.221491+0000","last_unstale":"2024-09-12T01:38:01.176723+0000","last_undegraded":"2024-09-12T01:38:01.176723+0000","last_fullsized":"2024-09-12T01:38:01.176723+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:53.230082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49002,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":484,"num_read_kb":1163,"num_write":396,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:01.784353+0000","last_change":"2024-09-12T00:28:39.219270+0000","last_active":"2024-09-12T01:34:01.784353+0000","last_peered":"2024-09-12T01:34:01.784353+0000","last_clean":"2024-09-12T01:34:01.784353+0000","last_became_active":"2024-09-12T00:28:39.219004+0000","last_became_peered":"2024-09-12T00:28:39.219004+0000","last_unstale":"2024-09-12T01:34:01.784353+0000","last_undegraded":"2024-09-12T01:34:01.784353+0000","last_fullsized":"2024-09-12T01:34:01.784353+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:04.158965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"263'478","reported_seq":1270,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.216852+0000","last_change":"2024-09-12T01:38:19.216852+0000","last_active":"2024-09-12T01:38:19.216852+0000","last_peered":"2024-09-12T01:38:19.216852+0000","last_clean":"2024-09-12T01:38:19.216852+0000","last_became_active":"2024-09-12T00:28:33.216610+0000","last_became_peered":"2024-09-12T00:28:33.216610+0000","last_unstale":"2024-09-12T01:38:19.216852+0000","last_undegraded":"2024-09-12T01:38:19.216852+0000","last_fullsized":"2024-09-12T01:38:19.216852+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'478","last_scrub_stamp":"2024-09-12T01:38:19.216770+0000","last_deep_scrub":"263'478","last_deep_scrub_stamp":"2024-09-12T01:38:19.216770+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.216770+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:55.208285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2349,"num_read_kb":2016,"num_write":868,"num_write_kb":562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"263'340","reported_seq":979,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.239832+0000","last_change":"2024-09-12T01:38:13.239832+0000","last_active":"2024-09-12T01:38:13.239832+0000","last_peered":"2024-09-12T01:38:13.239832+0000","last_clean":"2024-09-12T01:38:13.239832+0000","last_became_active":"2024-09-12T00:28:31.207770+0000","last_became_peered":"2024-09-12T00:28:31.207770+0000","last_unstale":"2024-09-12T01:38:13.239832+0000","last_undegraded":"2024-09-12T01:38:13.239832+0000","last_fullsized":"2024-09-12T01:38:13.239832+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'340","last_scrub_stamp":"2024-09-12T01:38:13.239742+0000","last_deep_scrub":"263'340","last_deep_scrub_stamp":"2024-09-12T01:38:13.239742+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.239742+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:09.782387+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":467,"num_read_kb":17286,"num_write":965,"num_write_kb":20034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:23.159987+0000","last_change":"2024-09-12T01:38:23.159987+0000","last_active":"2024-09-12T01:38:23.159987+0000","last_peered":"2024-09-12T01:38:23.159987+0000","last_clean":"2024-09-12T01:38:23.159987+0000","last_became_active":"2024-09-12T00:28:35.208868+0000","last_became_peered":"2024-09-12T00:28:35.208868+0000","last_unstale":"2024-09-12T01:38:23.159987+0000","last_undegraded":"2024-09-12T01:38:23.159987+0000","last_fullsized":"2024-09-12T01:38:23.159987+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:23.159891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:23.159891+0000","last_clean_scrub_stamp":"2024-09-12T01:38:23.159891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:23.643595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"263'534","reported_seq":1194,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:26.001437+0000","last_change":"2024-09-12T01:38:26.001437+0000","last_active":"2024-09-12T01:38:26.001437+0000","last_peered":"2024-09-12T01:38:26.001437+0000","last_clean":"2024-09-12T01:38:26.001437+0000","last_became_active":"2024-09-12T00:28:37.210514+0000","last_became_peered":"2024-09-12T00:28:37.210514+0000","last_unstale":"2024-09-12T01:38:26.001437+0000","last_undegraded":"2024-09-12T01:38:26.001437+0000","last_fullsized":"2024-09-12T01:38:26.001437+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'534","last_scrub_stamp":"2024-09-12T01:38:26.001311+0000","last_deep_scrub":"263'534","last_deep_scrub_stamp":"2024-09-12T01:38:26.001311+0000","last_clean_scrub_stamp":"2024-09-12T01:38:26.001311+0000","objects_scrubbed":7,"log_size":34,"log_dups_size":500,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:10.115691+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94945,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":919,"num_read_kb":2214,"num_write":790,"num_write_kb":678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:42.778441+0000","last_change":"2024-09-12T00:28:39.220157+0000","last_active":"2024-09-12T01:33:42.778441+0000","last_peered":"2024-09-12T01:33:42.778441+0000","last_clean":"2024-09-12T01:33:42.778441+0000","last_became_active":"2024-09-12T00:28:39.219808+0000","last_became_peered":"2024-09-12T00:28:39.219808+0000","last_unstale":"2024-09-12T01:33:42.778441+0000","last_undegraded":"2024-09-12T01:33:42.778441+0000","last_fullsized":"2024-09-12T01:33:42.778441+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:25.859464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"263'226","reported_seq":794,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:42.584721+0000","last_change":"2024-09-12T00:28:41.257924+0000","last_active":"2024-09-12T01:36:42.584721+0000","last_peered":"2024-09-12T01:36:42.584721+0000","last_clean":"2024-09-12T01:36:42.584721+0000","last_became_active":"2024-09-12T00:28:41.257639+0000","last_became_peered":"2024-09-12T00:28:41.257639+0000","last_unstale":"2024-09-12T01:36:42.584721+0000","last_undegraded":"2024-09-12T01:36:42.584721+0000","last_fullsized":"2024-09-12T01:36:42.584721+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:36.066637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":674,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":491,"num_read_kb":439,"num_write":521,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"263'158","reported_seq":757,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.116170+0000","last_change":"2024-09-12T01:38:17.116170+0000","last_active":"2024-09-12T01:38:17.116170+0000","last_peered":"2024-09-12T01:38:17.116170+0000","last_clean":"2024-09-12T01:38:17.116170+0000","last_became_active":"2024-09-12T00:28:33.215105+0000","last_became_peered":"2024-09-12T00:28:33.215105+0000","last_unstale":"2024-09-12T01:38:17.116170+0000","last_undegraded":"2024-09-12T01:38:17.116170+0000","last_fullsized":"2024-09-12T01:38:17.116170+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'158","last_scrub_stamp":"2024-09-12T01:38:17.116093+0000","last_deep_scrub":"263'158","last_deep_scrub_stamp":"2024-09-12T01:38:17.116093+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.116093+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:18.349339+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":692,"num_read_kb":572,"num_write":247,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"263'397","reported_seq":1060,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.210181+0000","last_change":"2024-09-12T01:38:12.210181+0000","last_active":"2024-09-12T01:38:12.210181+0000","last_peered":"2024-09-12T01:38:12.210181+0000","last_clean":"2024-09-12T01:38:12.210181+0000","last_became_active":"2024-09-12T00:28:31.206562+0000","last_became_peered":"2024-09-12T00:28:31.206562+0000","last_unstale":"2024-09-12T01:38:12.210181+0000","last_undegraded":"2024-09-12T01:38:12.210181+0000","last_fullsized":"2024-09-12T01:38:12.210181+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'397","last_scrub_stamp":"2024-09-12T01:38:12.210028+0000","last_deep_scrub":"263'397","last_deep_scrub_stamp":"2024-09-12T01:38:12.210028+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.210028+0000","objects_scrubbed":8,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:00.125891+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395844,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":545,"num_read_kb":3743,"num_write":1252,"num_write_kb":48925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":509,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:24.152454+0000","last_change":"2024-09-12T01:38:24.152454+0000","last_active":"2024-09-12T01:38:24.152454+0000","last_peered":"2024-09-12T01:38:24.152454+0000","last_clean":"2024-09-12T01:38:24.152454+0000","last_became_active":"2024-09-12T00:28:35.210046+0000","last_became_peered":"2024-09-12T00:28:35.210046+0000","last_unstale":"2024-09-12T01:38:24.152454+0000","last_undegraded":"2024-09-12T01:38:24.152454+0000","last_fullsized":"2024-09-12T01:38:24.152454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:24.152344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:24.152344+0000","last_clean_scrub_stamp":"2024-09-12T01:38:24.152344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:00.292881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"263'330","reported_seq":923,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.210125+0000","last_change":"2024-09-12T00:28:37.212617+0000","last_active":"2024-09-12T01:38:01.210125+0000","last_peered":"2024-09-12T01:38:01.210125+0000","last_clean":"2024-09-12T01:38:01.210125+0000","last_became_active":"2024-09-12T00:28:37.212236+0000","last_became_peered":"2024-09-12T00:28:37.212236+0000","last_unstale":"2024-09-12T01:38:01.210125+0000","last_undegraded":"2024-09-12T01:38:01.210125+0000","last_fullsized":"2024-09-12T01:38:01.210125+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:16.662629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49414,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":546,"num_read_kb":1160,"num_write":454,"num_write_kb":329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:41.931728+0000","last_change":"2024-09-12T00:28:39.218198+0000","last_active":"2024-09-12T01:33:41.931728+0000","last_peered":"2024-09-12T01:33:41.931728+0000","last_clean":"2024-09-12T01:33:41.931728+0000","last_became_active":"2024-09-12T00:28:39.217947+0000","last_became_peered":"2024-09-12T00:28:39.217947+0000","last_unstale":"2024-09-12T01:33:41.931728+0000","last_undegraded":"2024-09-12T01:33:41.931728+0000","last_fullsized":"2024-09-12T01:33:41.931728+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:45.277309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"263'220","reported_seq":1091,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.567227+0000","last_change":"2024-09-12T00:28:41.233293+0000","last_active":"2024-09-12T01:36:38.567227+0000","last_peered":"2024-09-12T01:36:38.567227+0000","last_clean":"2024-09-12T01:36:38.567227+0000","last_became_active":"2024-09-12T00:28:41.232347+0000","last_became_peered":"2024-09-12T00:28:41.232347+0000","last_unstale":"2024-09-12T01:36:38.567227+0000","last_undegraded":"2024-09-12T01:36:38.567227+0000","last_fullsized":"2024-09-12T01:36:38.567227+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:07.441315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":645,"num_read_kb":635,"num_write":602,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"263'73","reported_seq":636,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.239336+0000","last_change":"2024-09-12T01:38:22.239336+0000","last_active":"2024-09-12T01:38:22.239336+0000","last_peered":"2024-09-12T01:38:22.239336+0000","last_clean":"2024-09-12T01:38:22.239336+0000","last_became_active":"2024-09-12T00:28:33.207968+0000","last_became_peered":"2024-09-12T00:28:33.207968+0000","last_unstale":"2024-09-12T01:38:22.239336+0000","last_undegraded":"2024-09-12T01:38:22.239336+0000","last_fullsized":"2024-09-12T01:38:22.239336+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'73","last_scrub_stamp":"2024-09-12T01:38:22.239257+0000","last_deep_scrub":"263'73","last_deep_scrub_stamp":"2024-09-12T01:38:22.239257+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.239257+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:04.297452+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":308,"num_read_kb":254,"num_write":109,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":719,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"263'300","reported_seq":934,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:09.492289+0000","last_change":"2024-09-12T01:38:09.492289+0000","last_active":"2024-09-12T01:38:09.492289+0000","last_peered":"2024-09-12T01:38:09.492289+0000","last_clean":"2024-09-12T01:38:09.492289+0000","last_became_active":"2024-09-12T00:28:31.195038+0000","last_became_peered":"2024-09-12T00:28:31.195038+0000","last_unstale":"2024-09-12T01:38:09.492289+0000","last_undegraded":"2024-09-12T01:38:09.492289+0000","last_fullsized":"2024-09-12T01:38:09.492289+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'300","last_scrub_stamp":"2024-09-12T01:38:09.492194+0000","last_deep_scrub":"263'300","last_deep_scrub_stamp":"2024-09-12T01:38:09.492194+0000","last_clean_scrub_stamp":"2024-09-12T01:38:09.492194+0000","objects_scrubbed":5,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:50.184186+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262176,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":426,"num_read_kb":13574,"num_write":965,"num_write_kb":34116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:36.531621+0000","last_change":"2024-09-12T00:28:35.215894+0000","last_active":"2024-09-12T01:33:36.531621+0000","last_peered":"2024-09-12T01:33:36.531621+0000","last_clean":"2024-09-12T01:33:36.531621+0000","last_became_active":"2024-09-12T00:28:35.215576+0000","last_became_peered":"2024-09-12T00:28:35.215576+0000","last_unstale":"2024-09-12T01:33:36.531621+0000","last_undegraded":"2024-09-12T01:33:36.531621+0000","last_fullsized":"2024-09-12T01:33:36.531621+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:24.130329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"263'288","reported_seq":884,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.395002+0000","last_change":"2024-09-12T00:28:37.424316+0000","last_active":"2024-09-12T01:38:00.395002+0000","last_peered":"2024-09-12T01:38:00.395002+0000","last_clean":"2024-09-12T01:38:00.395002+0000","last_became_active":"2024-09-12T00:28:37.423835+0000","last_became_peered":"2024-09-12T00:28:37.423835+0000","last_unstale":"2024-09-12T01:38:00.395002+0000","last_undegraded":"2024-09-12T01:38:00.395002+0000","last_fullsized":"2024-09-12T01:38:00.395002+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:16.822185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48887,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":486,"num_read_kb":1104,"num_write":386,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:46.941196+0000","last_change":"2024-09-12T00:28:39.219814+0000","last_active":"2024-09-12T01:34:46.941196+0000","last_peered":"2024-09-12T01:34:46.941196+0000","last_clean":"2024-09-12T01:34:46.941196+0000","last_became_active":"2024-09-12T00:28:39.219541+0000","last_became_peered":"2024-09-12T00:28:39.219541+0000","last_unstale":"2024-09-12T01:34:46.941196+0000","last_undegraded":"2024-09-12T01:34:46.941196+0000","last_fullsized":"2024-09-12T01:34:46.941196+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:16.760034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"263'114","reported_seq":599,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:47.141542+0000","last_change":"2024-09-12T00:28:41.232661+0000","last_active":"2024-09-12T01:37:47.141542+0000","last_peered":"2024-09-12T01:37:47.141542+0000","last_clean":"2024-09-12T01:37:47.141542+0000","last_became_active":"2024-09-12T00:28:41.232305+0000","last_became_peered":"2024-09-12T00:28:41.232305+0000","last_unstale":"2024-09-12T01:37:47.141542+0000","last_undegraded":"2024-09-12T01:37:47.141542+0000","last_fullsized":"2024-09-12T01:37:47.141542+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:16.813541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":90,"num_read_kb":88,"num_write":260,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"263'145","reported_seq":719,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.772678+0000","last_change":"2024-09-12T01:38:21.772678+0000","last_active":"2024-09-12T01:38:21.772678+0000","last_peered":"2024-09-12T01:38:21.772678+0000","last_clean":"2024-09-12T01:38:21.772678+0000","last_became_active":"2024-09-12T00:28:33.213905+0000","last_became_peered":"2024-09-12T00:28:33.213905+0000","last_unstale":"2024-09-12T01:38:21.772678+0000","last_undegraded":"2024-09-12T01:38:21.772678+0000","last_fullsized":"2024-09-12T01:38:21.772678+0000","mapping_epoch":27,"log_start":"260'100","ondisk_log_start":"260'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'145","last_scrub_stamp":"2024-09-12T01:38:21.772587+0000","last_deep_scrub":"263'145","last_deep_scrub_stamp":"2024-09-12T01:38:21.772587+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.772587+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:23.017228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":580,"num_read_kb":470,"num_write":232,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"263'313","reported_seq":1015,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.157817+0000","last_change":"2024-09-12T01:38:18.157817+0000","last_active":"2024-09-12T01:38:18.157817+0000","last_peered":"2024-09-12T01:38:18.157817+0000","last_clean":"2024-09-12T01:38:18.157817+0000","last_became_active":"2024-09-12T00:28:31.203417+0000","last_became_peered":"2024-09-12T00:28:31.203417+0000","last_unstale":"2024-09-12T01:38:18.157817+0000","last_undegraded":"2024-09-12T01:38:18.157817+0000","last_fullsized":"2024-09-12T01:38:18.157817+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'313","last_scrub_stamp":"2024-09-12T01:38:18.157702+0000","last_deep_scrub":"263'313","last_deep_scrub_stamp":"2024-09-12T01:38:18.157702+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.157702+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:59.863289+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262193,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":643,"num_read_kb":683,"num_write":1258,"num_write_kb":6456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":512,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:24.997695+0000","last_change":"2024-09-12T01:38:24.997695+0000","last_active":"2024-09-12T01:38:24.997695+0000","last_peered":"2024-09-12T01:38:24.997695+0000","last_clean":"2024-09-12T01:38:24.997695+0000","last_became_active":"2024-09-12T00:28:35.207992+0000","last_became_peered":"2024-09-12T00:28:35.207992+0000","last_unstale":"2024-09-12T01:38:24.997695+0000","last_undegraded":"2024-09-12T01:38:24.997695+0000","last_fullsized":"2024-09-12T01:38:24.997695+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:24.997615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:24.997615+0000","last_clean_scrub_stamp":"2024-09-12T01:38:24.997615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:15.702126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"263'105","reported_seq":647,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:51.541995+0000","last_change":"2024-09-12T00:28:37.424144+0000","last_active":"2024-09-12T01:34:51.541995+0000","last_peered":"2024-09-12T01:34:51.541995+0000","last_clean":"2024-09-12T01:34:51.541995+0000","last_became_active":"2024-09-12T00:28:37.423765+0000","last_became_peered":"2024-09-12T00:28:37.423765+0000","last_unstale":"2024-09-12T01:34:51.541995+0000","last_undegraded":"2024-09-12T01:34:51.541995+0000","last_fullsized":"2024-09-12T01:34:51.541995+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:37.831318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":155,"num_read_kb":148,"num_write":156,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"263'761","reported_seq":2428,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.051454+0000","last_change":"2024-09-12T00:28:39.217233+0000","last_active":"2024-09-12T01:38:00.051454+0000","last_peered":"2024-09-12T01:38:00.051454+0000","last_clean":"2024-09-12T01:38:00.051454+0000","last_became_active":"2024-09-12T00:28:39.216704+0000","last_became_peered":"2024-09-12T00:28:39.216704+0000","last_unstale":"2024-09-12T01:38:00.051454+0000","last_undegraded":"2024-09-12T01:38:00.051454+0000","last_fullsized":"2024-09-12T01:38:00.051454+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:06.941324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"263'157","reported_seq":655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:41.582118+0000","last_change":"2024-09-12T00:28:41.228417+0000","last_active":"2024-09-12T01:36:41.582118+0000","last_peered":"2024-09-12T01:36:41.582118+0000","last_clean":"2024-09-12T01:36:41.582118+0000","last_became_active":"2024-09-12T00:28:41.227892+0000","last_became_peered":"2024-09-12T00:28:41.227892+0000","last_unstale":"2024-09-12T01:36:41.582118+0000","last_undegraded":"2024-09-12T01:36:41.582118+0000","last_fullsized":"2024-09-12T01:36:41.582118+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:55.234284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":160,"num_read_kb":153,"num_write":389,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"263'138","reported_seq":725,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.484876+0000","last_change":"2024-09-12T01:38:19.484876+0000","last_active":"2024-09-12T01:38:19.484876+0000","last_peered":"2024-09-12T01:38:19.484876+0000","last_clean":"2024-09-12T01:38:19.484876+0000","last_became_active":"2024-09-12T00:28:33.204722+0000","last_became_peered":"2024-09-12T00:28:33.204722+0000","last_unstale":"2024-09-12T01:38:19.484876+0000","last_undegraded":"2024-09-12T01:38:19.484876+0000","last_fullsized":"2024-09-12T01:38:19.484876+0000","mapping_epoch":27,"log_start":"260'100","ondisk_log_start":"260'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'138","last_scrub_stamp":"2024-09-12T01:38:19.484796+0000","last_deep_scrub":"263'138","last_deep_scrub_stamp":"2024-09-12T01:38:19.484796+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.484796+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:49.740120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":575,"num_read_kb":467,"num_write":204,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"263'333","reported_seq":1059,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.360411+0000","last_change":"2024-09-12T01:38:15.360411+0000","last_active":"2024-09-12T01:38:15.360411+0000","last_peered":"2024-09-12T01:38:15.360411+0000","last_clean":"2024-09-12T01:38:15.360411+0000","last_became_active":"2024-09-12T00:28:31.212597+0000","last_became_peered":"2024-09-12T00:28:31.212597+0000","last_unstale":"2024-09-12T01:38:15.360411+0000","last_undegraded":"2024-09-12T01:38:15.360411+0000","last_fullsized":"2024-09-12T01:38:15.360411+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'333","last_scrub_stamp":"2024-09-12T01:38:15.360299+0000","last_deep_scrub":"263'333","last_deep_scrub_stamp":"2024-09-12T01:38:15.360299+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.360299+0000","objects_scrubbed":8,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:04.968900+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":273370,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":704,"num_read_kb":2179,"num_write":1113,"num_write_kb":612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:36.715250+0000","last_change":"2024-09-12T00:28:35.210989+0000","last_active":"2024-09-12T01:33:36.715250+0000","last_peered":"2024-09-12T01:33:36.715250+0000","last_clean":"2024-09-12T01:33:36.715250+0000","last_became_active":"2024-09-12T00:28:35.210710+0000","last_became_peered":"2024-09-12T00:28:35.210710+0000","last_unstale":"2024-09-12T01:33:36.715250+0000","last_undegraded":"2024-09-12T01:33:36.715250+0000","last_fullsized":"2024-09-12T01:33:36.715250+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:33.211433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"263'387","reported_seq":1004,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.742223+0000","last_change":"2024-09-12T00:28:37.210612+0000","last_active":"2024-09-12T01:38:00.742223+0000","last_peered":"2024-09-12T01:38:00.742223+0000","last_clean":"2024-09-12T01:38:00.742223+0000","last_became_active":"2024-09-12T00:28:37.210317+0000","last_became_peered":"2024-09-12T00:28:37.210317+0000","last_unstale":"2024-09-12T01:38:00.742223+0000","last_undegraded":"2024-09-12T01:38:00.742223+0000","last_fullsized":"2024-09-12T01:38:00.742223+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:31.821476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56512,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":649,"num_read_kb":1465,"num_write":528,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.783725+0000","last_change":"2024-09-12T00:28:39.218794+0000","last_active":"2024-09-12T01:33:56.783725+0000","last_peered":"2024-09-12T01:33:56.783725+0000","last_clean":"2024-09-12T01:33:56.783725+0000","last_became_active":"2024-09-12T00:28:39.218026+0000","last_became_peered":"2024-09-12T00:28:39.218026+0000","last_unstale":"2024-09-12T01:33:56.783725+0000","last_undegraded":"2024-09-12T01:33:56.783725+0000","last_fullsized":"2024-09-12T01:33:56.783725+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:18.115521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"263'133","reported_seq":629,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:21.741327+0000","last_change":"2024-09-12T00:28:41.231966+0000","last_active":"2024-09-12T01:36:21.741327+0000","last_peered":"2024-09-12T01:36:21.741327+0000","last_clean":"2024-09-12T01:36:21.741327+0000","last_became_active":"2024-09-12T00:28:41.231611+0000","last_became_peered":"2024-09-12T00:28:41.231611+0000","last_unstale":"2024-09-12T01:36:21.741327+0000","last_undegraded":"2024-09-12T01:36:21.741327+0000","last_fullsized":"2024-09-12T01:36:21.741327+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:05.050533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":625,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":135,"num_read_kb":130,"num_write":322,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"263'92","reported_seq":681,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.500153+0000","last_change":"2024-09-12T01:38:18.500153+0000","last_active":"2024-09-12T01:38:18.500153+0000","last_peered":"2024-09-12T01:38:18.500153+0000","last_clean":"2024-09-12T01:38:18.500153+0000","last_became_active":"2024-09-12T00:28:33.204653+0000","last_became_peered":"2024-09-12T00:28:33.204653+0000","last_unstale":"2024-09-12T01:38:18.500153+0000","last_undegraded":"2024-09-12T01:38:18.500153+0000","last_fullsized":"2024-09-12T01:38:18.500153+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'92","last_scrub_stamp":"2024-09-12T01:38:18.500029+0000","last_deep_scrub":"263'92","last_deep_scrub_stamp":"2024-09-12T01:38:18.500029+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.500029+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:53.561967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":393,"num_read_kb":329,"num_write":145,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"263'433","reported_seq":1133,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.354322+0000","last_change":"2024-09-12T01:38:14.354322+0000","last_active":"2024-09-12T01:38:14.354322+0000","last_peered":"2024-09-12T01:38:14.354322+0000","last_clean":"2024-09-12T01:38:14.354322+0000","last_became_active":"2024-09-12T00:28:31.212752+0000","last_became_peered":"2024-09-12T00:28:31.212752+0000","last_unstale":"2024-09-12T01:38:14.354322+0000","last_undegraded":"2024-09-12T01:38:14.354322+0000","last_fullsized":"2024-09-12T01:38:14.354322+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'433","last_scrub_stamp":"2024-09-12T01:38:14.354219+0000","last_deep_scrub":"263'433","last_deep_scrub_stamp":"2024-09-12T01:38:14.354219+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.354219+0000","objects_scrubbed":4,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:39.547985+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":804,"num_read_kb":13300,"num_write":1374,"num_write_kb":24353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:37.777506+0000","last_change":"2024-09-12T00:28:35.208702+0000","last_active":"2024-09-12T01:33:37.777506+0000","last_peered":"2024-09-12T01:33:37.777506+0000","last_clean":"2024-09-12T01:33:37.777506+0000","last_became_active":"2024-09-12T00:28:35.207869+0000","last_became_peered":"2024-09-12T00:28:35.207869+0000","last_unstale":"2024-09-12T01:33:37.777506+0000","last_undegraded":"2024-09-12T01:33:37.777506+0000","last_fullsized":"2024-09-12T01:33:37.777506+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:39.750226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"263'310","reported_seq":893,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.823008+0000","last_change":"2024-09-12T00:28:37.221622+0000","last_active":"2024-09-12T01:38:00.823008+0000","last_peered":"2024-09-12T01:38:00.823008+0000","last_clean":"2024-09-12T01:38:00.823008+0000","last_became_active":"2024-09-12T00:28:37.221289+0000","last_became_peered":"2024-09-12T00:28:37.221289+0000","last_unstale":"2024-09-12T01:38:00.823008+0000","last_undegraded":"2024-09-12T01:38:00.823008+0000","last_fullsized":"2024-09-12T01:38:00.823008+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:13.295191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57095,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":538,"num_read_kb":1320,"num_write":444,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:11.536147+0000","last_change":"2024-09-12T00:28:39.217261+0000","last_active":"2024-09-12T01:34:11.536147+0000","last_peered":"2024-09-12T01:34:11.536147+0000","last_clean":"2024-09-12T01:34:11.536147+0000","last_became_active":"2024-09-12T00:28:39.216943+0000","last_became_peered":"2024-09-12T00:28:39.216943+0000","last_unstale":"2024-09-12T01:34:11.536147+0000","last_undegraded":"2024-09-12T01:34:11.536147+0000","last_fullsized":"2024-09-12T01:34:11.536147+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:27.903826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"263'138","reported_seq":675,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:20.328319+0000","last_change":"2024-09-12T00:28:41.258056+0000","last_active":"2024-09-12T01:35:20.328319+0000","last_peered":"2024-09-12T01:35:20.328319+0000","last_clean":"2024-09-12T01:35:20.328319+0000","last_became_active":"2024-09-12T00:28:41.257796+0000","last_became_peered":"2024-09-12T00:28:41.257796+0000","last_unstale":"2024-09-12T01:35:20.328319+0000","last_undegraded":"2024-09-12T01:35:20.328319+0000","last_fullsized":"2024-09-12T01:35:20.328319+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:21.378439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":982,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":234,"num_read_kb":212,"num_write":368,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"263'74","reported_seq":637,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.198985+0000","last_change":"2024-09-12T01:38:20.198985+0000","last_active":"2024-09-12T01:38:20.198985+0000","last_peered":"2024-09-12T01:38:20.198985+0000","last_clean":"2024-09-12T01:38:20.198985+0000","last_became_active":"2024-09-12T00:28:33.205832+0000","last_became_peered":"2024-09-12T00:28:33.205832+0000","last_unstale":"2024-09-12T01:38:20.198985+0000","last_undegraded":"2024-09-12T01:38:20.198985+0000","last_fullsized":"2024-09-12T01:38:20.198985+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'74","last_scrub_stamp":"2024-09-12T01:38:20.198893+0000","last_deep_scrub":"263'74","last_deep_scrub_stamp":"2024-09-12T01:38:20.198893+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.198893+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:19.080369+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":322,"num_read_kb":264,"num_write":102,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"263'347","reported_seq":990,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.179612+0000","last_change":"2024-09-12T01:38:19.179612+0000","last_active":"2024-09-12T01:38:19.179612+0000","last_peered":"2024-09-12T01:38:19.179612+0000","last_clean":"2024-09-12T01:38:19.179612+0000","last_became_active":"2024-09-12T00:28:31.200234+0000","last_became_peered":"2024-09-12T00:28:31.200234+0000","last_unstale":"2024-09-12T01:38:19.179612+0000","last_undegraded":"2024-09-12T01:38:19.179612+0000","last_fullsized":"2024-09-12T01:38:19.179612+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'347","last_scrub_stamp":"2024-09-12T01:38:19.179470+0000","last_deep_scrub":"263'347","last_deep_scrub_stamp":"2024-09-12T01:38:19.179470+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.179470+0000","objects_scrubbed":10,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:23.079099+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262245,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":466,"num_read_kb":15822,"num_write":1094,"num_write_kb":25857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.533584+0000","last_change":"2024-09-12T00:28:35.206882+0000","last_active":"2024-09-12T01:33:51.533584+0000","last_peered":"2024-09-12T01:33:51.533584+0000","last_clean":"2024-09-12T01:33:51.533584+0000","last_became_active":"2024-09-12T00:28:35.206597+0000","last_became_peered":"2024-09-12T00:28:35.206597+0000","last_unstale":"2024-09-12T01:33:51.533584+0000","last_undegraded":"2024-09-12T01:33:51.533584+0000","last_fullsized":"2024-09-12T01:33:51.533584+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:34.191880+0000","last_clean_scrub_stamp":"2024-09-12T00:28:34.191880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:07.120698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"263'280","reported_seq":849,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.287558+0000","last_change":"2024-09-12T00:28:37.220535+0000","last_active":"2024-09-12T01:38:00.287558+0000","last_peered":"2024-09-12T01:38:00.287558+0000","last_clean":"2024-09-12T01:38:00.287558+0000","last_became_active":"2024-09-12T00:28:37.219652+0000","last_became_peered":"2024-09-12T00:28:37.219652+0000","last_unstale":"2024-09-12T01:38:00.287558+0000","last_undegraded":"2024-09-12T01:38:00.287558+0000","last_fullsized":"2024-09-12T01:38:00.287558+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:35.052492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49715,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":473,"num_read_kb":1234,"num_write":394,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:41.532251+0000","last_change":"2024-09-12T00:28:39.218146+0000","last_active":"2024-09-12T01:33:41.532251+0000","last_peered":"2024-09-12T01:33:41.532251+0000","last_clean":"2024-09-12T01:33:41.532251+0000","last_became_active":"2024-09-12T00:28:39.217869+0000","last_became_peered":"2024-09-12T00:28:39.217869+0000","last_unstale":"2024-09-12T01:33:41.532251+0000","last_undegraded":"2024-09-12T01:33:41.532251+0000","last_fullsized":"2024-09-12T01:33:41.532251+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:50.890111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"263'190","reported_seq":1287,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.478652+0000","last_change":"2024-09-12T00:28:41.232727+0000","last_active":"2024-09-12T01:36:38.478652+0000","last_peered":"2024-09-12T01:36:38.478652+0000","last_clean":"2024-09-12T01:36:38.478652+0000","last_became_active":"2024-09-12T00:28:41.232040+0000","last_became_peered":"2024-09-12T00:28:41.232040+0000","last_unstale":"2024-09-12T01:36:38.478652+0000","last_undegraded":"2024-09-12T01:36:38.478652+0000","last_fullsized":"2024-09-12T01:36:38.478652+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:12.584298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":841,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":800,"num_read_kb":795,"num_write":450,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"263'254","reported_seq":921,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.516670+0000","last_change":"2024-09-12T01:38:15.516670+0000","last_active":"2024-09-12T01:38:15.516670+0000","last_peered":"2024-09-12T01:38:15.516670+0000","last_clean":"2024-09-12T01:38:15.516670+0000","last_became_active":"2024-09-12T00:28:33.208787+0000","last_became_peered":"2024-09-12T00:28:33.208787+0000","last_unstale":"2024-09-12T01:38:15.516670+0000","last_undegraded":"2024-09-12T01:38:15.516670+0000","last_fullsized":"2024-09-12T01:38:15.516670+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'254","last_scrub_stamp":"2024-09-12T01:38:15.516591+0000","last_deep_scrub":"263'254","last_deep_scrub_stamp":"2024-09-12T01:38:15.516591+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.516591+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:22.435596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1164,"num_read_kb":956,"num_write":405,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"263'322","reported_seq":1078,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.049656+0000","last_change":"2024-09-12T01:38:12.049656+0000","last_active":"2024-09-12T01:38:12.049656+0000","last_peered":"2024-09-12T01:38:12.049656+0000","last_clean":"2024-09-12T01:38:12.049656+0000","last_became_active":"2024-09-12T00:29:04.274746+0000","last_became_peered":"2024-09-12T00:29:04.274746+0000","last_unstale":"2024-09-12T01:38:12.049656+0000","last_undegraded":"2024-09-12T01:38:12.049656+0000","last_fullsized":"2024-09-12T01:38:12.049656+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'322","last_scrub_stamp":"2024-09-12T01:38:12.049537+0000","last_deep_scrub":"263'322","last_deep_scrub_stamp":"2024-09-12T01:38:12.049537+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.049537+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:42.701831+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524334,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":565,"num_read_kb":52761,"num_write":1033,"num_write_kb":38285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"263'6","reported_seq":996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:24.038504+0000","last_change":"2024-09-12T01:38:24.038504+0000","last_active":"2024-09-12T01:38:24.038504+0000","last_peered":"2024-09-12T01:38:24.038504+0000","last_clean":"2024-09-12T01:38:24.038504+0000","last_became_active":"2024-09-12T00:28:35.207332+0000","last_became_peered":"2024-09-12T00:28:35.207332+0000","last_unstale":"2024-09-12T01:38:24.038504+0000","last_undegraded":"2024-09-12T01:38:24.038504+0000","last_fullsized":"2024-09-12T01:38:24.038504+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-12T01:38:24.038400+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-12T01:38:24.038400+0000","last_clean_scrub_stamp":"2024-09-12T01:38:24.038400+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:33.692701+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"263'325","reported_seq":930,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.451609+0000","last_change":"2024-09-12T00:28:37.207659+0000","last_active":"2024-09-12T01:38:00.451609+0000","last_peered":"2024-09-12T01:38:00.451609+0000","last_clean":"2024-09-12T01:38:00.451609+0000","last_became_active":"2024-09-12T00:28:37.207373+0000","last_became_peered":"2024-09-12T00:28:37.207373+0000","last_unstale":"2024-09-12T01:38:00.451609+0000","last_undegraded":"2024-09-12T01:38:00.451609+0000","last_fullsized":"2024-09-12T01:38:00.451609+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:36.194858+0000","last_clean_scrub_stamp":"2024-09-12T00:28:36.194858+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:14.729544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45135,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":515,"num_read_kb":1089,"num_write":408,"num_write_kb":271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:41.781852+0000","last_change":"2024-09-12T00:28:39.217215+0000","last_active":"2024-09-12T01:33:41.781852+0000","last_peered":"2024-09-12T01:33:41.781852+0000","last_clean":"2024-09-12T01:33:41.781852+0000","last_became_active":"2024-09-12T00:28:39.215651+0000","last_became_peered":"2024-09-12T00:28:39.215651+0000","last_unstale":"2024-09-12T01:33:41.781852+0000","last_undegraded":"2024-09-12T01:33:41.781852+0000","last_fullsized":"2024-09-12T01:33:41.781852+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:38.198304+0000","last_clean_scrub_stamp":"2024-09-12T00:28:38.198304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:18.517005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"263'132","reported_seq":629,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.017444+0000","last_change":"2024-09-12T00:28:41.227004+0000","last_active":"2024-09-12T01:37:46.017444+0000","last_peered":"2024-09-12T01:37:46.017444+0000","last_clean":"2024-09-12T01:37:46.017444+0000","last_became_active":"2024-09-12T00:28:41.226687+0000","last_became_peered":"2024-09-12T00:28:41.226687+0000","last_unstale":"2024-09-12T01:37:46.017444+0000","last_undegraded":"2024-09-12T01:37:46.017444+0000","last_fullsized":"2024-09-12T01:37:46.017444+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:17.799068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":132,"num_read_kb":117,"num_write":304,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"263'293","reported_seq":931,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.060156+0000","last_change":"2024-09-12T01:38:21.060156+0000","last_active":"2024-09-12T01:38:21.060156+0000","last_peered":"2024-09-12T01:38:21.060156+0000","last_clean":"2024-09-12T01:38:21.060156+0000","last_became_active":"2024-09-12T00:28:33.210635+0000","last_became_peered":"2024-09-12T00:28:33.210635+0000","last_unstale":"2024-09-12T01:38:21.060156+0000","last_undegraded":"2024-09-12T01:38:21.060156+0000","last_fullsized":"2024-09-12T01:38:21.060156+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'293","last_scrub_stamp":"2024-09-12T01:38:21.060078+0000","last_deep_scrub":"263'293","last_deep_scrub_stamp":"2024-09-12T01:38:21.060078+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.060078+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:54.397394+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1259,"num_read_kb":1011,"num_write":460,"num_write_kb":225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"263'338","reported_seq":966,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.121833+0000","last_change":"2024-09-12T01:38:12.121833+0000","last_active":"2024-09-12T01:38:12.121833+0000","last_peered":"2024-09-12T01:38:12.121833+0000","last_clean":"2024-09-12T01:38:12.121833+0000","last_became_active":"2024-09-12T00:28:31.206672+0000","last_became_peered":"2024-09-12T00:28:31.206672+0000","last_unstale":"2024-09-12T01:38:12.121833+0000","last_undegraded":"2024-09-12T01:38:12.121833+0000","last_fullsized":"2024-09-12T01:38:12.121833+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'338","last_scrub_stamp":"2024-09-12T01:38:12.121735+0000","last_deep_scrub":"263'338","last_deep_scrub_stamp":"2024-09-12T01:38:12.121735+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.121735+0000","objects_scrubbed":6,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:41.412623+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661307,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":464,"num_read_kb":11577,"num_write":1050,"num_write_kb":29091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"263'314","reported_seq":949,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.088957+0000","last_change":"2024-09-12T01:38:16.088957+0000","last_active":"2024-09-12T01:38:16.088957+0000","last_peered":"2024-09-12T01:38:16.088957+0000","last_clean":"2024-09-12T01:38:16.088957+0000","last_became_active":"2024-09-12T00:28:33.206512+0000","last_became_peered":"2024-09-12T00:28:33.206512+0000","last_unstale":"2024-09-12T01:38:16.088957+0000","last_undegraded":"2024-09-12T01:38:16.088957+0000","last_fullsized":"2024-09-12T01:38:16.088957+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'314","last_scrub_stamp":"2024-09-12T01:38:16.088862+0000","last_deep_scrub":"263'314","last_deep_scrub_stamp":"2024-09-12T01:38:16.088862+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.088862+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:00.843923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1325,"num_read_kb":1067,"num_write":489,"num_write_kb":251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"263'331","reported_seq":978,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:08.834993+0000","last_change":"2024-09-12T01:38:08.834993+0000","last_active":"2024-09-12T01:38:08.834993+0000","last_peered":"2024-09-12T01:38:08.834993+0000","last_clean":"2024-09-12T01:38:08.834993+0000","last_became_active":"2024-09-12T00:29:04.271753+0000","last_became_peered":"2024-09-12T00:29:04.271753+0000","last_unstale":"2024-09-12T01:38:08.834993+0000","last_undegraded":"2024-09-12T01:38:08.834993+0000","last_fullsized":"2024-09-12T01:38:08.834993+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'331","last_scrub_stamp":"2024-09-12T01:38:08.834925+0000","last_deep_scrub":"263'331","last_deep_scrub_stamp":"2024-09-12T01:38:08.834925+0000","last_clean_scrub_stamp":"2024-09-12T01:38:08.834925+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:41.298044+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":504,"num_read_kb":1624,"num_write":1034,"num_write_kb":30525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"263'350","reported_seq":969,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:26.390197+0000","last_change":"2024-09-12T01:38:26.390197+0000","last_active":"2024-09-12T01:38:26.390197+0000","last_peered":"2024-09-12T01:38:26.390197+0000","last_clean":"2024-09-12T01:38:26.390197+0000","last_became_active":"2024-09-12T00:28:33.214679+0000","last_became_peered":"2024-09-12T00:28:33.214679+0000","last_unstale":"2024-09-12T01:38:26.390197+0000","last_undegraded":"2024-09-12T01:38:26.390197+0000","last_fullsized":"2024-09-12T01:38:26.390197+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'350","last_scrub_stamp":"2024-09-12T01:38:26.390114+0000","last_deep_scrub":"263'350","last_deep_scrub_stamp":"2024-09-12T01:38:26.390114+0000","last_clean_scrub_stamp":"2024-09-12T01:38:26.390114+0000","objects_scrubbed":1,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:19.138258+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1495,"num_read_kb":1194,"num_write":562,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"263'379","reported_seq":1054,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.375518+0000","last_change":"2024-09-12T01:38:16.375518+0000","last_active":"2024-09-12T01:38:16.375518+0000","last_peered":"2024-09-12T01:38:16.375518+0000","last_clean":"2024-09-12T01:38:16.375518+0000","last_became_active":"2024-09-12T00:28:31.209266+0000","last_became_peered":"2024-09-12T00:28:31.209266+0000","last_unstale":"2024-09-12T01:38:16.375518+0000","last_undegraded":"2024-09-12T01:38:16.375518+0000","last_fullsized":"2024-09-12T01:38:16.375518+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'379","last_scrub_stamp":"2024-09-12T01:38:16.375401+0000","last_deep_scrub":"263'379","last_deep_scrub_stamp":"2024-09-12T01:38:16.375401+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.375401+0000","objects_scrubbed":15,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:39.836701+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2581681,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":574,"num_read_kb":38602,"num_write":1242,"num_write_kb":22367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"263'105","reported_seq":698,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.041650+0000","last_change":"2024-09-12T01:38:17.041650+0000","last_active":"2024-09-12T01:38:17.041650+0000","last_peered":"2024-09-12T01:38:17.041650+0000","last_clean":"2024-09-12T01:38:17.041650+0000","last_became_active":"2024-09-12T00:28:33.213020+0000","last_became_peered":"2024-09-12T00:28:33.213020+0000","last_unstale":"2024-09-12T01:38:17.041650+0000","last_undegraded":"2024-09-12T01:38:17.041650+0000","last_fullsized":"2024-09-12T01:38:17.041650+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'105","last_scrub_stamp":"2024-09-12T01:38:17.041548+0000","last_deep_scrub":"263'105","last_deep_scrub_stamp":"2024-09-12T01:38:17.041548+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.041548+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:31.379735+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":435,"num_read_kb":365,"num_write":138,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"263'312","reported_seq":1058,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.130935+0000","last_change":"2024-09-12T01:38:19.130935+0000","last_active":"2024-09-12T01:38:19.130935+0000","last_peered":"2024-09-12T01:38:19.130935+0000","last_clean":"2024-09-12T01:38:19.130935+0000","last_became_active":"2024-09-12T00:28:31.208548+0000","last_became_peered":"2024-09-12T00:28:31.208548+0000","last_unstale":"2024-09-12T01:38:19.130935+0000","last_undegraded":"2024-09-12T01:38:19.130935+0000","last_fullsized":"2024-09-12T01:38:19.130935+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'312","last_scrub_stamp":"2024-09-12T01:38:19.130834+0000","last_deep_scrub":"263'312","last_deep_scrub_stamp":"2024-09-12T01:38:19.130834+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.130834+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:32.788994+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49275,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":734,"num_read_kb":31441,"num_write":965,"num_write_kb":36605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"263'125","reported_seq":769,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:23.259183+0000","last_change":"2024-09-12T01:38:23.259183+0000","last_active":"2024-09-12T01:38:23.259183+0000","last_peered":"2024-09-12T01:38:23.259183+0000","last_clean":"2024-09-12T01:38:23.259183+0000","last_became_active":"2024-09-12T00:28:33.217573+0000","last_became_peered":"2024-09-12T00:28:33.217573+0000","last_unstale":"2024-09-12T01:38:23.259183+0000","last_undegraded":"2024-09-12T01:38:23.259183+0000","last_fullsized":"2024-09-12T01:38:23.259183+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'125","last_scrub_stamp":"2024-09-12T01:38:23.259101+0000","last_deep_scrub":"263'125","last_deep_scrub_stamp":"2024-09-12T01:38:23.259101+0000","last_clean_scrub_stamp":"2024-09-12T01:38:23.259101+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:11.077813+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":588,"num_read_kb":500,"num_write":193,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"263'360","reported_seq":1010,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:09.821543+0000","last_change":"2024-09-12T01:38:09.821485+0000","last_active":"2024-09-12T01:38:09.821543+0000","last_peered":"2024-09-12T01:38:09.821543+0000","last_clean":"2024-09-12T01:38:09.821543+0000","last_became_active":"2024-09-12T00:29:04.267546+0000","last_became_peered":"2024-09-12T00:29:04.267546+0000","last_unstale":"2024-09-12T01:38:09.821543+0000","last_undegraded":"2024-09-12T01:38:09.821543+0000","last_fullsized":"2024-09-12T01:38:09.821543+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'360","last_scrub_stamp":"2024-09-12T01:38:09.821400+0000","last_deep_scrub":"263'360","last_deep_scrub_stamp":"2024-09-12T01:38:09.821400+0000","last_clean_scrub_stamp":"2024-09-12T01:38:09.821400+0000","objects_scrubbed":8,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:41.679527+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2316165,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":596,"num_read_kb":3307,"num_write":1233,"num_write_kb":18821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"263'309","reported_seq":1011,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.491401+0000","last_change":"2024-09-12T01:38:21.491401+0000","last_active":"2024-09-12T01:38:21.491401+0000","last_peered":"2024-09-12T01:38:21.491401+0000","last_clean":"2024-09-12T01:38:21.491401+0000","last_became_active":"2024-09-12T00:28:33.208929+0000","last_became_peered":"2024-09-12T00:28:33.208929+0000","last_unstale":"2024-09-12T01:38:21.491401+0000","last_undegraded":"2024-09-12T01:38:21.491401+0000","last_fullsized":"2024-09-12T01:38:21.491401+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'309","last_scrub_stamp":"2024-09-12T01:38:21.491305+0000","last_deep_scrub":"263'309","last_deep_scrub_stamp":"2024-09-12T01:38:21.491305+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.491305+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:34.771827+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1423,"num_read_kb":1158,"num_write":481,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4001,"num_omap_keys":18,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"263'317","reported_seq":967,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.214608+0000","last_change":"2024-09-12T01:38:11.214608+0000","last_active":"2024-09-12T01:38:11.214608+0000","last_peered":"2024-09-12T01:38:11.214608+0000","last_clean":"2024-09-12T01:38:11.214608+0000","last_became_active":"2024-09-12T00:28:31.205829+0000","last_became_peered":"2024-09-12T00:28:31.205829+0000","last_unstale":"2024-09-12T01:38:11.214608+0000","last_undegraded":"2024-09-12T01:38:11.214608+0000","last_fullsized":"2024-09-12T01:38:11.214608+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'317","last_scrub_stamp":"2024-09-12T01:38:11.214498+0000","last_deep_scrub":"263'317","last_deep_scrub_stamp":"2024-09-12T01:38:11.214498+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.214498+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:14.918145+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262189,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":453,"num_read_kb":5277,"num_write":1032,"num_write_kb":26638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"263'110","reported_seq":707,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.225675+0000","last_change":"2024-09-12T01:38:21.225675+0000","last_active":"2024-09-12T01:38:21.225675+0000","last_peered":"2024-09-12T01:38:21.225675+0000","last_clean":"2024-09-12T01:38:21.225675+0000","last_became_active":"2024-09-12T00:28:33.208010+0000","last_became_peered":"2024-09-12T00:28:33.208010+0000","last_unstale":"2024-09-12T01:38:21.225675+0000","last_undegraded":"2024-09-12T01:38:21.225675+0000","last_fullsized":"2024-09-12T01:38:21.225675+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'110","last_scrub_stamp":"2024-09-12T01:38:21.225579+0000","last_deep_scrub":"263'110","last_deep_scrub_stamp":"2024-09-12T01:38:21.225579+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.225579+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:01.368932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":481,"num_read_kb":401,"num_write":165,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"263'372","reported_seq":1022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.127767+0000","last_change":"2024-09-12T01:38:15.127767+0000","last_active":"2024-09-12T01:38:15.127767+0000","last_peered":"2024-09-12T01:38:15.127767+0000","last_clean":"2024-09-12T01:38:15.127767+0000","last_became_active":"2024-09-12T00:28:31.205366+0000","last_became_peered":"2024-09-12T00:28:31.205366+0000","last_unstale":"2024-09-12T01:38:15.127767+0000","last_undegraded":"2024-09-12T01:38:15.127767+0000","last_fullsized":"2024-09-12T01:38:15.127767+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'372","last_scrub_stamp":"2024-09-12T01:38:15.127655+0000","last_deep_scrub":"263'372","last_deep_scrub_stamp":"2024-09-12T01:38:15.127655+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.127655+0000","objects_scrubbed":3,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:47.340053+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":592,"num_read_kb":12807,"num_write":1213,"num_write_kb":27426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"263'207","reported_seq":835,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.245276+0000","last_change":"2024-09-12T01:38:20.245276+0000","last_active":"2024-09-12T01:38:20.245276+0000","last_peered":"2024-09-12T01:38:20.245276+0000","last_clean":"2024-09-12T01:38:20.245276+0000","last_became_active":"2024-09-12T00:28:33.209028+0000","last_became_peered":"2024-09-12T00:28:33.209028+0000","last_unstale":"2024-09-12T01:38:20.245276+0000","last_undegraded":"2024-09-12T01:38:20.245276+0000","last_fullsized":"2024-09-12T01:38:20.245276+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'207","last_scrub_stamp":"2024-09-12T01:38:20.245188+0000","last_deep_scrub":"263'207","last_deep_scrub_stamp":"2024-09-12T01:38:20.245188+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.245188+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:22.561594+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":877,"num_read_kb":721,"num_write":304,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":758,"num_omap_keys":4,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"263'330","reported_seq":1007,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.216893+0000","last_change":"2024-09-12T01:38:12.216893+0000","last_active":"2024-09-12T01:38:12.216893+0000","last_peered":"2024-09-12T01:38:12.216893+0000","last_clean":"2024-09-12T01:38:12.216893+0000","last_became_active":"2024-09-12T00:28:31.203185+0000","last_became_peered":"2024-09-12T00:28:31.203185+0000","last_unstale":"2024-09-12T01:38:12.216893+0000","last_undegraded":"2024-09-12T01:38:12.216893+0000","last_fullsized":"2024-09-12T01:38:12.216893+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'330","last_scrub_stamp":"2024-09-12T01:38:12.216795+0000","last_deep_scrub":"263'330","last_deep_scrub_stamp":"2024-09-12T01:38:12.216795+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.216795+0000","objects_scrubbed":5,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:53.679636+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524364,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":503,"num_read_kb":88709,"num_write":1042,"num_write_kb":43642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"263'404","reported_seq":1089,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.068399+0000","last_change":"2024-09-12T01:38:16.068399+0000","last_active":"2024-09-12T01:38:16.068399+0000","last_peered":"2024-09-12T01:38:16.068399+0000","last_clean":"2024-09-12T01:38:16.068399+0000","last_became_active":"2024-09-12T00:29:04.275434+0000","last_became_peered":"2024-09-12T00:29:04.275434+0000","last_unstale":"2024-09-12T01:38:16.068399+0000","last_undegraded":"2024-09-12T01:38:16.068399+0000","last_fullsized":"2024-09-12T01:38:16.068399+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'404","last_scrub_stamp":"2024-09-12T01:38:16.068300+0000","last_deep_scrub":"263'404","last_deep_scrub_stamp":"2024-09-12T01:38:16.068300+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.068300+0000","objects_scrubbed":1,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:12.998225+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1782,"num_read_kb":1435,"num_write":639,"num_write_kb":352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"263'335","reported_seq":980,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.350385+0000","last_change":"2024-09-12T01:38:17.350385+0000","last_active":"2024-09-12T01:38:17.350385+0000","last_peered":"2024-09-12T01:38:17.350385+0000","last_clean":"2024-09-12T01:38:17.350385+0000","last_became_active":"2024-09-12T00:28:31.209468+0000","last_became_peered":"2024-09-12T00:28:31.209468+0000","last_unstale":"2024-09-12T01:38:17.350385+0000","last_undegraded":"2024-09-12T01:38:17.350385+0000","last_fullsized":"2024-09-12T01:38:17.350385+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'335","last_scrub_stamp":"2024-09-12T01:38:17.350292+0000","last_deep_scrub":"263'335","last_deep_scrub_stamp":"2024-09-12T01:38:17.350292+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.350292+0000","objects_scrubbed":7,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:50.033794+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6901132,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":496,"num_read_kb":2644,"num_write":1040,"num_write_kb":18676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"263'161","reported_seq":744,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:23.532779+0000","last_change":"2024-09-12T01:38:23.532779+0000","last_active":"2024-09-12T01:38:23.532779+0000","last_peered":"2024-09-12T01:38:23.532779+0000","last_clean":"2024-09-12T01:38:23.532779+0000","last_became_active":"2024-09-12T00:28:33.208285+0000","last_became_peered":"2024-09-12T00:28:33.208285+0000","last_unstale":"2024-09-12T01:38:23.532779+0000","last_undegraded":"2024-09-12T01:38:23.532779+0000","last_fullsized":"2024-09-12T01:38:23.532779+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'161","last_scrub_stamp":"2024-09-12T01:38:23.532688+0000","last_deep_scrub":"263'161","last_deep_scrub_stamp":"2024-09-12T01:38:23.532688+0000","last_clean_scrub_stamp":"2024-09-12T01:38:23.532688+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:07.016907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":689,"num_read_kb":558,"num_write":246,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"263'367","reported_seq":1006,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.197599+0000","last_change":"2024-09-12T01:38:11.197534+0000","last_active":"2024-09-12T01:38:11.197599+0000","last_peered":"2024-09-12T01:38:11.197599+0000","last_clean":"2024-09-12T01:38:11.197599+0000","last_became_active":"2024-09-12T00:28:31.199924+0000","last_became_peered":"2024-09-12T00:28:31.199924+0000","last_unstale":"2024-09-12T01:38:11.197599+0000","last_undegraded":"2024-09-12T01:38:11.197599+0000","last_fullsized":"2024-09-12T01:38:11.197599+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'367","last_scrub_stamp":"2024-09-12T01:38:11.197392+0000","last_deep_scrub":"263'367","last_deep_scrub_stamp":"2024-09-12T01:38:11.197392+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.197392+0000","objects_scrubbed":8,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:53.293586+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":490,"num_read_kb":12716,"num_write":1120,"num_write_kb":44871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"263'322","reported_seq":1007,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.731545+0000","last_change":"2024-09-12T01:38:11.731545+0000","last_active":"2024-09-12T01:38:11.731545+0000","last_peered":"2024-09-12T01:38:11.731545+0000","last_clean":"2024-09-12T01:38:11.731545+0000","last_became_active":"2024-09-12T00:28:33.208088+0000","last_became_peered":"2024-09-12T00:28:33.208088+0000","last_unstale":"2024-09-12T01:38:11.731545+0000","last_undegraded":"2024-09-12T01:38:11.731545+0000","last_fullsized":"2024-09-12T01:38:11.731545+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'322","last_scrub_stamp":"2024-09-12T01:38:11.731432+0000","last_deep_scrub":"263'322","last_deep_scrub_stamp":"2024-09-12T01:38:11.731432+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.731432+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:50.629920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1424,"num_read_kb":1183,"num_write":488,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"263'345","reported_seq":1022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.364820+0000","last_change":"2024-09-12T01:38:19.364820+0000","last_active":"2024-09-12T01:38:19.364820+0000","last_peered":"2024-09-12T01:38:19.364820+0000","last_clean":"2024-09-12T01:38:19.364820+0000","last_became_active":"2024-09-12T00:28:31.211083+0000","last_became_peered":"2024-09-12T00:28:31.211083+0000","last_unstale":"2024-09-12T01:38:19.364820+0000","last_undegraded":"2024-09-12T01:38:19.364820+0000","last_fullsized":"2024-09-12T01:38:19.364820+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'345","last_scrub_stamp":"2024-09-12T01:38:19.364715+0000","last_deep_scrub":"263'345","last_deep_scrub_stamp":"2024-09-12T01:38:19.364715+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.364715+0000","objects_scrubbed":4,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:27.035569+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262163,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":601,"num_read_kb":3403,"num_write":1227,"num_write_kb":8870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"263'153","reported_seq":777,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.523050+0000","last_change":"2024-09-12T01:38:22.523050+0000","last_active":"2024-09-12T01:38:22.523050+0000","last_peered":"2024-09-12T01:38:22.523050+0000","last_clean":"2024-09-12T01:38:22.523050+0000","last_became_active":"2024-09-12T00:28:33.209024+0000","last_became_peered":"2024-09-12T00:28:33.209024+0000","last_unstale":"2024-09-12T01:38:22.523050+0000","last_undegraded":"2024-09-12T01:38:22.523050+0000","last_fullsized":"2024-09-12T01:38:22.523050+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'153","last_scrub_stamp":"2024-09-12T01:38:22.522969+0000","last_deep_scrub":"263'153","last_deep_scrub_stamp":"2024-09-12T01:38:22.522969+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.522969+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:06.711391+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":684,"num_read_kb":599,"num_write":231,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2875,"num_omap_keys":12,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"263'317","reported_seq":944,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.145248+0000","last_change":"2024-09-12T01:38:21.145248+0000","last_active":"2024-09-12T01:38:21.145248+0000","last_peered":"2024-09-12T01:38:21.145248+0000","last_clean":"2024-09-12T01:38:21.145248+0000","last_became_active":"2024-09-12T00:28:31.207399+0000","last_became_peered":"2024-09-12T00:28:31.207399+0000","last_unstale":"2024-09-12T01:38:21.145248+0000","last_undegraded":"2024-09-12T01:38:21.145248+0000","last_fullsized":"2024-09-12T01:38:21.145248+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'317","last_scrub_stamp":"2024-09-12T01:38:21.145153+0000","last_deep_scrub":"263'317","last_deep_scrub_stamp":"2024-09-12T01:38:21.145153+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.145153+0000","objects_scrubbed":8,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:08.962443+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":660490,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":412,"num_read_kb":9232,"num_write":885,"num_write_kb":18206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"263'63","reported_seq":625,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.359615+0000","last_change":"2024-09-12T01:38:22.359615+0000","last_active":"2024-09-12T01:38:22.359615+0000","last_peered":"2024-09-12T01:38:22.359615+0000","last_clean":"2024-09-12T01:38:22.359615+0000","last_became_active":"2024-09-12T00:28:33.213110+0000","last_became_peered":"2024-09-12T00:28:33.213110+0000","last_unstale":"2024-09-12T01:38:22.359615+0000","last_undegraded":"2024-09-12T01:38:22.359615+0000","last_fullsized":"2024-09-12T01:38:22.359615+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'63","last_scrub_stamp":"2024-09-12T01:38:22.359523+0000","last_deep_scrub":"263'63","last_deep_scrub_stamp":"2024-09-12T01:38:22.359523+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.359523+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:22.071319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":226,"num_write":102,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"263'358","reported_seq":1040,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.132038+0000","last_change":"2024-09-12T01:38:11.131978+0000","last_active":"2024-09-12T01:38:11.132038+0000","last_peered":"2024-09-12T01:38:11.132038+0000","last_clean":"2024-09-12T01:38:11.132038+0000","last_became_active":"2024-09-12T00:28:31.203478+0000","last_became_peered":"2024-09-12T00:28:31.203478+0000","last_unstale":"2024-09-12T01:38:11.132038+0000","last_undegraded":"2024-09-12T01:38:11.132038+0000","last_fullsized":"2024-09-12T01:38:11.132038+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'358","last_scrub_stamp":"2024-09-12T01:38:11.131892+0000","last_deep_scrub":"263'358","last_deep_scrub_stamp":"2024-09-12T01:38:11.131892+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.131892+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:45.732319+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":633,"num_read_kb":38935,"num_write":1084,"num_write_kb":32997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"263'193","reported_seq":790,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:25.095313+0000","last_change":"2024-09-12T01:38:25.095313+0000","last_active":"2024-09-12T01:38:25.095313+0000","last_peered":"2024-09-12T01:38:25.095313+0000","last_clean":"2024-09-12T01:38:25.095313+0000","last_became_active":"2024-09-12T00:28:33.220013+0000","last_became_peered":"2024-09-12T00:28:33.220013+0000","last_unstale":"2024-09-12T01:38:25.095313+0000","last_undegraded":"2024-09-12T01:38:25.095313+0000","last_fullsized":"2024-09-12T01:38:25.095313+0000","mapping_epoch":27,"log_start":"260'100","ondisk_log_start":"260'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'193","last_scrub_stamp":"2024-09-12T01:38:25.095217+0000","last_deep_scrub":"263'193","last_deep_scrub_stamp":"2024-09-12T01:38:25.095217+0000","last_clean_scrub_stamp":"2024-09-12T01:38:25.095217+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:10.616066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":806,"num_read_kb":650,"num_write":294,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"263'317","reported_seq":942,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.258278+0000","last_change":"2024-09-12T01:38:19.258278+0000","last_active":"2024-09-12T01:38:19.258278+0000","last_peered":"2024-09-12T01:38:19.258278+0000","last_clean":"2024-09-12T01:38:19.258278+0000","last_became_active":"2024-09-12T00:28:31.204305+0000","last_became_peered":"2024-09-12T00:28:31.204305+0000","last_unstale":"2024-09-12T01:38:19.258278+0000","last_undegraded":"2024-09-12T01:38:19.258278+0000","last_fullsized":"2024-09-12T01:38:19.258278+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'317","last_scrub_stamp":"2024-09-12T01:38:19.258187+0000","last_deep_scrub":"263'317","last_deep_scrub_stamp":"2024-09-12T01:38:19.258187+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.258187+0000","objects_scrubbed":3,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:01.813877+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133653,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":11794,"num_write":1040,"num_write_kb":34532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"263'111","reported_seq":730,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:24.295044+0000","last_change":"2024-09-12T01:38:24.295044+0000","last_active":"2024-09-12T01:38:24.295044+0000","last_peered":"2024-09-12T01:38:24.295044+0000","last_clean":"2024-09-12T01:38:24.295044+0000","last_became_active":"2024-09-12T00:28:33.216814+0000","last_became_peered":"2024-09-12T00:28:33.216814+0000","last_unstale":"2024-09-12T01:38:24.295044+0000","last_undegraded":"2024-09-12T01:38:24.295044+0000","last_fullsized":"2024-09-12T01:38:24.295044+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'111","last_scrub_stamp":"2024-09-12T01:38:24.294958+0000","last_deep_scrub":"263'111","last_deep_scrub_stamp":"2024-09-12T01:38:24.294958+0000","last_clean_scrub_stamp":"2024-09-12T01:38:24.294958+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:08.641709+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":456,"num_read_kb":389,"num_write":151,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":506,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"263'365","reported_seq":1056,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.773147+0000","last_change":"2024-09-12T01:38:10.773147+0000","last_active":"2024-09-12T01:38:10.773147+0000","last_peered":"2024-09-12T01:38:10.773147+0000","last_clean":"2024-09-12T01:38:10.773147+0000","last_became_active":"2024-09-12T00:28:31.200421+0000","last_became_peered":"2024-09-12T00:28:31.200421+0000","last_unstale":"2024-09-12T01:38:10.773147+0000","last_undegraded":"2024-09-12T01:38:10.773147+0000","last_fullsized":"2024-09-12T01:38:10.773147+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'365","last_scrub_stamp":"2024-09-12T01:38:10.773072+0000","last_deep_scrub":"263'365","last_deep_scrub_stamp":"2024-09-12T01:38:10.773072+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.773072+0000","objects_scrubbed":8,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:26.211979+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1658143,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":544,"num_read_kb":83268,"num_write":1180,"num_write_kb":21609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"263'106","reported_seq":692,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:23.404525+0000","last_change":"2024-09-12T01:38:23.404525+0000","last_active":"2024-09-12T01:38:23.404525+0000","last_peered":"2024-09-12T01:38:23.404525+0000","last_clean":"2024-09-12T01:38:23.404525+0000","last_became_active":"2024-09-12T00:28:33.213100+0000","last_became_peered":"2024-09-12T00:28:33.213100+0000","last_unstale":"2024-09-12T01:38:23.404525+0000","last_undegraded":"2024-09-12T01:38:23.404525+0000","last_fullsized":"2024-09-12T01:38:23.404525+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'106","last_scrub_stamp":"2024-09-12T01:38:23.404436+0000","last_deep_scrub":"263'106","last_deep_scrub_stamp":"2024-09-12T01:38:23.404436+0000","last_clean_scrub_stamp":"2024-09-12T01:38:23.404436+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:21.969675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":481,"num_read_kb":399,"num_write":154,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"263'352","reported_seq":1048,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.334920+0000","last_change":"2024-09-12T01:38:20.334920+0000","last_active":"2024-09-12T01:38:20.334920+0000","last_peered":"2024-09-12T01:38:20.334920+0000","last_clean":"2024-09-12T01:38:20.334920+0000","last_became_active":"2024-09-12T00:28:31.215581+0000","last_became_peered":"2024-09-12T00:28:31.215581+0000","last_unstale":"2024-09-12T01:38:20.334920+0000","last_undegraded":"2024-09-12T01:38:20.334920+0000","last_fullsized":"2024-09-12T01:38:20.334920+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'352","last_scrub_stamp":"2024-09-12T01:38:20.334798+0000","last_deep_scrub":"263'352","last_deep_scrub_stamp":"2024-09-12T01:38:20.334798+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.334798+0000","objects_scrubbed":6,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:37:37.813524+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3558704,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":578,"num_read_kb":13304,"num_write":1188,"num_write_kb":31930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"263'311","reported_seq":959,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.358278+0000","last_change":"2024-09-12T01:38:18.358278+0000","last_active":"2024-09-12T01:38:18.358278+0000","last_peered":"2024-09-12T01:38:18.358278+0000","last_clean":"2024-09-12T01:38:18.358278+0000","last_became_active":"2024-09-12T00:28:31.214134+0000","last_became_peered":"2024-09-12T00:28:31.214134+0000","last_unstale":"2024-09-12T01:38:18.358278+0000","last_undegraded":"2024-09-12T01:38:18.358278+0000","last_fullsized":"2024-09-12T01:38:18.358278+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'311","last_scrub_stamp":"2024-09-12T01:38:18.358164+0000","last_deep_scrub":"263'311","last_deep_scrub_stamp":"2024-09-12T01:38:18.358164+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.358164+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:36.150651+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553650,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":469,"num_read_kb":31725,"num_write":1010,"num_write_kb":40420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"263'102","reported_seq":702,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.109012+0000","last_change":"2024-09-12T01:38:20.109012+0000","last_active":"2024-09-12T01:38:20.109012+0000","last_peered":"2024-09-12T01:38:20.109012+0000","last_clean":"2024-09-12T01:38:20.109012+0000","last_became_active":"2024-09-12T00:28:33.212886+0000","last_became_peered":"2024-09-12T00:28:33.212886+0000","last_unstale":"2024-09-12T01:38:20.109012+0000","last_undegraded":"2024-09-12T01:38:20.109012+0000","last_fullsized":"2024-09-12T01:38:20.109012+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'102","last_scrub_stamp":"2024-09-12T01:38:20.108923+0000","last_deep_scrub":"263'102","last_deep_scrub_stamp":"2024-09-12T01:38:20.108923+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.108923+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:02.824645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":476,"num_read_kb":407,"num_write":159,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"263'403","reported_seq":1158,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.146793+0000","last_change":"2024-09-12T01:38:15.146793+0000","last_active":"2024-09-12T01:38:15.146793+0000","last_peered":"2024-09-12T01:38:15.146793+0000","last_clean":"2024-09-12T01:38:15.146793+0000","last_became_active":"2024-09-12T00:28:31.196230+0000","last_became_peered":"2024-09-12T00:28:31.196230+0000","last_unstale":"2024-09-12T01:38:15.146793+0000","last_undegraded":"2024-09-12T01:38:15.146793+0000","last_fullsized":"2024-09-12T01:38:15.146793+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'403","last_scrub_stamp":"2024-09-12T01:38:15.146666+0000","last_deep_scrub":"263'403","last_deep_scrub_stamp":"2024-09-12T01:38:15.146666+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.146666+0000","objects_scrubbed":7,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:40.043210+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291522,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":735,"num_read_kb":35673,"num_write":1292,"num_write_kb":40181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"263'212","reported_seq":801,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:01.455973+0000","last_change":"2024-09-12T00:28:33.213479+0000","last_active":"2024-09-12T01:34:01.455973+0000","last_peered":"2024-09-12T01:34:01.455973+0000","last_clean":"2024-09-12T01:34:01.455973+0000","last_became_active":"2024-09-12T00:28:33.213187+0000","last_became_peered":"2024-09-12T00:28:33.213187+0000","last_unstale":"2024-09-12T01:34:01.455973+0000","last_undegraded":"2024-09-12T01:34:01.455973+0000","last_fullsized":"2024-09-12T01:34:01.455973+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:32.188604+0000","last_clean_scrub_stamp":"2024-09-12T00:28:32.188604+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:03.213237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":884,"num_read_kb":712,"num_write":323,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5759,"num_read_kb":4046,"num_write":1929,"num_write_kb":827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1000,"ondisk_log_size":1000,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15395,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":15045,"num_read_kb":14706,"num_write":16739,"num_write_kb":4892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1773,"ondisk_log_size":1773,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":520,"ondisk_log_size":520,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1497349,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":18870,"num_read_kb":39400,"num_write":15775,"num_write_kb":11890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":524896,"num_omap_keys":1176,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2078,"ondisk_log_size":2078,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2403,"num_read_kb":2865,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":103056,"num_read_kb":85959,"num_write":37323,"num_write_kb":18865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":43635,"num_omap_keys":176,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4315,"ondisk_log_size":4315,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":94285898,"num_objects":401,"num_object_clones":0,"num_object_copies":802,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":401,"num_whiteouts":0,"num_read":36137,"num_read_kb":1909956,"num_write":71332,"num_write_kb":2052201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":190078976,"data_stored":188571796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3522,"ondisk_log_size":3522,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":175308,"num_write":154,"num_write_kb":116383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":27197,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":178855,"num_write":154,"num_write_kb":116383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510288,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":253256,"kb_used_data":19384,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94118584,"statfs":{"total":96636764160,"available":96377430016,"internally_reserved":0,"allocated":19849216,"data_stored":18131665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":239466954},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510287,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":245476,"kb_used_data":15764,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94126364,"statfs":{"total":96636764160,"available":96385396736,"internally_reserved":0,"allocated":16142336,"data_stored":14537201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":235207110},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510290,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":143396,"kb_used_data":44244,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94228444,"statfs":{"total":96636764160,"available":96489926656,"internally_reserved":0,"allocated":45305856,"data_stored":43509539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510286,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":102520,"kb_used_data":31080,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94269320,"statfs":{"total":96636764160,"available":96531783680,"internally_reserved":0,"allocated":31825920,"data_stored":30189258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510289,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71272,"kb_used_data":17880,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94300568,"statfs":{"total":96636764160,"available":96563781632,"internally_reserved":0,"allocated":18309120,"data_stored":16732323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510292,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":134488,"kb_used_data":22856,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94237352,"statfs":{"total":96636764160,"available":96499048448,"internally_reserved":0,"allocated":23404544,"data_stored":21740424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510290,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":283028,"kb_used_data":35332,"kb_used_omap":1,"kb_used_meta":247678,"kb_avail":94088812,"statfs":{"total":96636764160,"available":96346943488,"internally_reserved":0,"allocated":36179968,"data_stored":34415974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":253622725},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575696,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":284764,"kb_used_data":28684,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":94087076,"statfs":{"total":96636764160,"available":96345165824,"internally_reserved":0,"allocated":29372416,"data_stored":27586086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":262207944},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":31928320,"data_stored":31687986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19750912,"data_stored":19603309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14700544,"data_stored":14596831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":25714688,"data_stored":25449825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28241920,"data_stored":28055424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":41611264,"data_stored":41372743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12529664,"data_stored":12400757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15601664,"data_stored":15404921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:38:30.259 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.259 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.259 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.259 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.260 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.260 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.260 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.260 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.260 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.260 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.260 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.260 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.260 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.261 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.261 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.261 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.261 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.261 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.261 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.261 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.261 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.261 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.262 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.262 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.262 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.262 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.262 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.262 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.262 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.262 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.262 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.263 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.263 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.263 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.263 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.263 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.263 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.263 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.264 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.264 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.264 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.264 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.264 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.264 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.264 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.264 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.264 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.265 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.265 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.265 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.265 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.265 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.265 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.265 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.265 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.265 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.266 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.266 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.266 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.266 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.266 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.266 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.266 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.266 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.266 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.266 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.267 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.267 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.267 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.267 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.267 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.267 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.267 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.267 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.267 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.268 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.268 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.268 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.268 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.268 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.268 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.268 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.268 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.268 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.269 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.269 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.269 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.269 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.269 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.269 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.269 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.269 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.269 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.270 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.270 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.270 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.270 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.270 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.270 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.270 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.270 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.270 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.270 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.271 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.271 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.271 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.271 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.271 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.271 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.271 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.271 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.271 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.272 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.272 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.272 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.272 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.272 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.272 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.272 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.272 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.272 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.273 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.273 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.273 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.273 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.273 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.273 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.273 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.273 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.273 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.274 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.274 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.274 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.274 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T00:28:34.191880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.274 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.274 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.275 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.275 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T00:28:34.191880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.275 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.275 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.275 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.275 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T00:28:34.191880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.276 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.276 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.276 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T00:28:34.191880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.276 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.276 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.276 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-12T00:28:34.191880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.276 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.276 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.276 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.277 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.277 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.277 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.277 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.277 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.278 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.278 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.278 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.278 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.278 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.278 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.278 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.278 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.279 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T00:28:34.191880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.279 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.279 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.279 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T00:28:34.191880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.279 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.279 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.279 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-12T00:28:34.191880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.279 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.280 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.280 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.280 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T00:28:34.191880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.280 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.280 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.280 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.280 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.280 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.281 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.281 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-12T00:28:34.191880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.281 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.281 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.281 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.281 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-12T00:28:34.191880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.282 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.282 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.282 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.282 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.282 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.282 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T00:28:34.191880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.282 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.283 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.283 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.283 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.283 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.283 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.283 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.283 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.283 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.284 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.284 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.284 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.284 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.284 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-12T00:28:34.191880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.284 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.284 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.284 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.284 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.285 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.285 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.285 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.285 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.285 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.285 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.285 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-12T00:28:34.191880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.285 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.286 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.286 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.286 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.286 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.286 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.286 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T00:28:34.191880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.286 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.286 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.287 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.287 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T00:28:34.191880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.287 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.287 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.287 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.287 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T00:28:34.191880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.287 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.287 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.287 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.288 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T00:28:36.194858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.288 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T00:28:38.198304+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.288 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.288 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-12T00:28:32.188604+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=32, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:30.288 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T01:38:50.290 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:38:50.623 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:38:50.635 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T01:38:50.637 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":2376,"stamp":"2024-09-12T01:38:49.958906+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":96390822,"num_objects":752,"num_object_clones":0,"num_object_copies":1504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":752,"num_whiteouts":0,"num_read":181613,"num_read_kb":2411162,"num_write":143549,"num_write_kb":2323097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":27197,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":735061,"num_omap_keys":1770,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13483,"ondisk_log_size":13483,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1518200,"kb_used_data":215224,"kb_used_omap":12,"kb_used_meta":1302835,"kb_avail":753456520,"statfs":{"total":773094113280,"available":771539476480,"internally_reserved":0,"allocated":220389376,"data_stored":206842470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1334103601},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7438,"num_omap_keys":26,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005649"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:17.783401+0000","last_change":"2024-09-12T01:04:15.393241+0000","last_active":"2024-09-12T01:34:17.783401+0000","last_peered":"2024-09-12T01:34:17.783401+0000","last_clean":"2024-09-12T01:34:17.783401+0000","last_became_active":"2024-09-12T01:04:15.392944+0000","last_became_peered":"2024-09-12T01:04:15.392944+0000","last_unstale":"2024-09-12T01:34:17.783401+0000","last_undegraded":"2024-09-12T01:34:17.783401+0000","last_fullsized":"2024-09-12T01:34:17.783401+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:32.532552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"263'8","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.458995+0000","last_change":"2024-09-12T00:46:26.362583+0000","last_active":"2024-09-12T01:38:00.458995+0000","last_peered":"2024-09-12T01:38:00.458995+0000","last_clean":"2024-09-12T01:38:00.458995+0000","last_became_active":"2024-09-12T00:46:26.362231+0000","last_became_peered":"2024-09-12T00:46:26.362231+0000","last_unstale":"2024-09-12T01:38:00.458995+0000","last_undegraded":"2024-09-12T01:38:00.458995+0000","last_fullsized":"2024-09-12T01:38:00.458995+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:47.340687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":19456,"num_write":13,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:54.637545+0000","last_change":"2024-09-12T00:46:22.353581+0000","last_active":"2024-09-12T01:33:54.637545+0000","last_peered":"2024-09-12T01:33:54.637545+0000","last_clean":"2024-09-12T01:33:54.637545+0000","last_became_active":"2024-09-12T00:46:22.353306+0000","last_became_peered":"2024-09-12T00:46:22.353306+0000","last_unstale":"2024-09-12T01:33:54.637545+0000","last_undegraded":"2024-09-12T01:33:54.637545+0000","last_fullsized":"2024-09-12T01:33:54.637545+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:42.123772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"263'59","reported_seq":219,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:41.789494+0000","last_change":"2024-09-12T00:42:36.818643+0000","last_active":"2024-09-12T01:34:41.789494+0000","last_peered":"2024-09-12T01:34:41.789494+0000","last_clean":"2024-09-12T01:34:41.789494+0000","last_became_active":"2024-09-12T00:42:36.818329+0000","last_became_peered":"2024-09-12T00:42:36.818329+0000","last_unstale":"2024-09-12T01:34:41.789494+0000","last_undegraded":"2024-09-12T01:34:41.789494+0000","last_fullsized":"2024-09-12T01:34:41.789494+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:59.176386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":293,"num_read_kb":205,"num_write":105,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.801693+0000","last_change":"2024-09-12T01:38:37.801693+0000","last_active":"2024-09-12T01:38:37.801693+0000","last_peered":"2024-09-12T01:38:37.801693+0000","last_clean":"2024-09-12T01:38:37.801693+0000","last_became_active":"2024-09-12T01:04:15.392747+0000","last_became_peered":"2024-09-12T01:04:15.392747+0000","last_unstale":"2024-09-12T01:38:37.801693+0000","last_undegraded":"2024-09-12T01:38:37.801693+0000","last_fullsized":"2024-09-12T01:38:37.801693+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:37.801602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:37.801602+0000","last_clean_scrub_stamp":"2024-09-12T01:38:37.801602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:43.793136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"263'3","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:26.555957+0000","last_change":"2024-09-12T00:46:26.370283+0000","last_active":"2024-09-12T01:36:26.555957+0000","last_peered":"2024-09-12T01:36:26.555957+0000","last_clean":"2024-09-12T01:36:26.555957+0000","last_became_active":"2024-09-12T00:46:26.369944+0000","last_became_peered":"2024-09-12T00:46:26.369944+0000","last_unstale":"2024-09-12T01:36:26.555957+0000","last_undegraded":"2024-09-12T01:36:26.555957+0000","last_fullsized":"2024-09-12T01:36:26.555957+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:14.648408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"260'8","reported_seq":78,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:40.826701+0000","last_change":"2024-09-12T01:38:40.826701+0000","last_active":"2024-09-12T01:38:40.826701+0000","last_peered":"2024-09-12T01:38:40.826701+0000","last_clean":"2024-09-12T01:38:40.826701+0000","last_became_active":"2024-09-12T00:46:22.352009+0000","last_became_peered":"2024-09-12T00:46:22.352009+0000","last_unstale":"2024-09-12T01:38:40.826701+0000","last_undegraded":"2024-09-12T01:38:40.826701+0000","last_fullsized":"2024-09-12T01:38:40.826701+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'8","last_scrub_stamp":"2024-09-12T01:38:40.826573+0000","last_deep_scrub":"260'8","last_deep_scrub_stamp":"2024-09-12T01:38:40.826573+0000","last_clean_scrub_stamp":"2024-09-12T01:38:40.826573+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:57.124717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":26626,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"263'20","reported_seq":124,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:29.677626+0000","last_change":"2024-09-12T01:38:29.677626+0000","last_active":"2024-09-12T01:38:29.677626+0000","last_peered":"2024-09-12T01:38:29.677626+0000","last_clean":"2024-09-12T01:38:29.677626+0000","last_became_active":"2024-09-12T00:42:36.809431+0000","last_became_peered":"2024-09-12T00:42:36.809431+0000","last_unstale":"2024-09-12T01:38:29.677626+0000","last_undegraded":"2024-09-12T01:38:29.677626+0000","last_fullsized":"2024-09-12T01:38:29.677626+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'20","last_scrub_stamp":"2024-09-12T01:38:29.677499+0000","last_deep_scrub":"263'20","last_deep_scrub_stamp":"2024-09-12T01:38:29.677499+0000","last_clean_scrub_stamp":"2024-09-12T01:38:29.677499+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:02.453791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":73,"num_write":40,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:45.987726+0000","last_change":"2024-09-12T01:38:45.987726+0000","last_active":"2024-09-12T01:38:45.987726+0000","last_peered":"2024-09-12T01:38:45.987726+0000","last_clean":"2024-09-12T01:38:45.987726+0000","last_became_active":"2024-09-12T01:04:15.384312+0000","last_became_peered":"2024-09-12T01:04:15.384312+0000","last_unstale":"2024-09-12T01:38:45.987726+0000","last_undegraded":"2024-09-12T01:38:45.987726+0000","last_fullsized":"2024-09-12T01:38:45.987726+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:45.987643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:45.987643+0000","last_clean_scrub_stamp":"2024-09-12T01:38:45.987643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:34.846840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:26.801749+0000","last_change":"2024-09-12T00:46:26.563569+0000","last_active":"2024-09-12T01:36:26.801749+0000","last_peered":"2024-09-12T01:36:26.801749+0000","last_clean":"2024-09-12T01:36:26.801749+0000","last_became_active":"2024-09-12T00:46:26.563267+0000","last_became_peered":"2024-09-12T00:46:26.563267+0000","last_unstale":"2024-09-12T01:36:26.801749+0000","last_undegraded":"2024-09-12T01:36:26.801749+0000","last_fullsized":"2024-09-12T01:36:26.801749+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"260'3","reported_seq":69,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:33.674271+0000","last_change":"2024-09-12T01:38:33.674201+0000","last_active":"2024-09-12T01:38:33.674271+0000","last_peered":"2024-09-12T01:38:33.674271+0000","last_clean":"2024-09-12T01:38:33.674271+0000","last_became_active":"2024-09-12T00:46:22.340655+0000","last_became_peered":"2024-09-12T00:46:22.340655+0000","last_unstale":"2024-09-12T01:38:33.674271+0000","last_undegraded":"2024-09-12T01:38:33.674271+0000","last_fullsized":"2024-09-12T01:38:33.674271+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-12T01:38:33.674114+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-12T01:38:33.674114+0000","last_clean_scrub_stamp":"2024-09-12T01:38:33.674114+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:11.561130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"263'63","reported_seq":226,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:06.792053+0000","last_change":"2024-09-12T00:42:36.814795+0000","last_active":"2024-09-12T01:35:06.792053+0000","last_peered":"2024-09-12T01:35:06.792053+0000","last_clean":"2024-09-12T01:35:06.792053+0000","last_became_active":"2024-09-12T00:42:36.814510+0000","last_became_peered":"2024-09-12T00:42:36.814510+0000","last_unstale":"2024-09-12T01:35:06.792053+0000","last_undegraded":"2024-09-12T01:35:06.792053+0000","last_fullsized":"2024-09-12T01:35:06.792053+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:42.130114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":321,"num_read_kb":228,"num_write":110,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:44.650367+0000","last_change":"2024-09-12T01:04:15.402204+0000","last_active":"2024-09-12T01:35:44.650367+0000","last_peered":"2024-09-12T01:35:44.650367+0000","last_clean":"2024-09-12T01:35:44.650367+0000","last_became_active":"2024-09-12T01:04:15.401897+0000","last_became_peered":"2024-09-12T01:04:15.401897+0000","last_unstale":"2024-09-12T01:35:44.650367+0000","last_undegraded":"2024-09-12T01:35:44.650367+0000","last_fullsized":"2024-09-12T01:35:44.650367+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:39.657251+0000","last_change":"2024-09-12T00:46:26.562165+0000","last_active":"2024-09-12T01:36:39.657251+0000","last_peered":"2024-09-12T01:36:39.657251+0000","last_clean":"2024-09-12T01:36:39.657251+0000","last_became_active":"2024-09-12T00:46:26.561870+0000","last_became_peered":"2024-09-12T00:46:26.561870+0000","last_unstale":"2024-09-12T01:36:39.657251+0000","last_undegraded":"2024-09-12T01:36:39.657251+0000","last_fullsized":"2024-09-12T01:36:39.657251+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"263'6","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.125693+0000","last_change":"2024-09-12T00:46:22.339498+0000","last_active":"2024-09-12T01:38:01.125693+0000","last_peered":"2024-09-12T01:38:01.125693+0000","last_clean":"2024-09-12T01:38:01.125693+0000","last_became_active":"2024-09-12T00:46:22.339141+0000","last_became_peered":"2024-09-12T00:46:22.339141+0000","last_unstale":"2024-09-12T01:38:01.125693+0000","last_undegraded":"2024-09-12T01:38:01.125693+0000","last_fullsized":"2024-09-12T01:38:01.125693+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"263'62","reported_seq":225,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:09.646373+0000","last_change":"2024-09-12T00:42:36.816859+0000","last_active":"2024-09-12T01:35:09.646373+0000","last_peered":"2024-09-12T01:35:09.646373+0000","last_clean":"2024-09-12T01:35:09.646373+0000","last_became_active":"2024-09-12T00:42:36.816570+0000","last_became_peered":"2024-09-12T00:42:36.816570+0000","last_unstale":"2024-09-12T01:35:09.646373+0000","last_undegraded":"2024-09-12T01:35:09.646373+0000","last_fullsized":"2024-09-12T01:35:09.646373+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:03.911054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":318,"num_read_kb":239,"num_write":100,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:19.654739+0000","last_change":"2024-09-12T01:04:15.400469+0000","last_active":"2024-09-12T01:36:19.654739+0000","last_peered":"2024-09-12T01:36:19.654739+0000","last_clean":"2024-09-12T01:36:19.654739+0000","last_became_active":"2024-09-12T01:04:15.400228+0000","last_became_peered":"2024-09-12T01:04:15.400228+0000","last_unstale":"2024-09-12T01:36:19.654739+0000","last_undegraded":"2024-09-12T01:36:19.654739+0000","last_fullsized":"2024-09-12T01:36:19.654739+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"263'9","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.748908+0000","last_change":"2024-09-12T00:46:26.368145+0000","last_active":"2024-09-12T01:38:00.748908+0000","last_peered":"2024-09-12T01:38:00.748908+0000","last_clean":"2024-09-12T01:38:00.748908+0000","last_became_active":"2024-09-12T00:46:26.367849+0000","last_became_peered":"2024-09-12T00:46:26.367849+0000","last_unstale":"2024-09-12T01:38:00.748908+0000","last_undegraded":"2024-09-12T01:38:00.748908+0000","last_fullsized":"2024-09-12T01:38:00.748908+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:35.175209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7168,"num_write":19,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"263'13","reported_seq":83,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:06.806586+0000","last_change":"2024-09-12T00:46:22.351181+0000","last_active":"2024-09-12T01:37:06.806586+0000","last_peered":"2024-09-12T01:37:06.806586+0000","last_clean":"2024-09-12T01:37:06.806586+0000","last_became_active":"2024-09-12T00:46:22.349597+0000","last_became_peered":"2024-09-12T00:46:22.349597+0000","last_unstale":"2024-09-12T01:37:06.806586+0000","last_undegraded":"2024-09-12T01:37:06.806586+0000","last_fullsized":"2024-09-12T01:37:06.806586+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:58.755945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":44034,"num_write":28,"num_write_kb":19456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"263'28","reported_seq":129,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:09.646341+0000","last_change":"2024-09-12T00:42:36.815076+0000","last_active":"2024-09-12T01:35:09.646341+0000","last_peered":"2024-09-12T01:35:09.646341+0000","last_clean":"2024-09-12T01:35:09.646341+0000","last_became_active":"2024-09-12T00:42:36.814799+0000","last_became_peered":"2024-09-12T00:42:36.814799+0000","last_unstale":"2024-09-12T01:35:09.646341+0000","last_undegraded":"2024-09-12T01:35:09.646341+0000","last_fullsized":"2024-09-12T01:35:09.646341+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:46.026762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":94,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:31.946433+0000","last_change":"2024-09-12T01:04:15.388981+0000","last_active":"2024-09-12T01:35:31.946433+0000","last_peered":"2024-09-12T01:35:31.946433+0000","last_clean":"2024-09-12T01:35:31.946433+0000","last_became_active":"2024-09-12T01:04:15.388593+0000","last_became_peered":"2024-09-12T01:04:15.388593+0000","last_unstale":"2024-09-12T01:35:31.946433+0000","last_undegraded":"2024-09-12T01:35:31.946433+0000","last_fullsized":"2024-09-12T01:35:31.946433+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:42.435298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"260'2","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:41.910495+0000","last_change":"2024-09-12T01:38:41.910495+0000","last_active":"2024-09-12T01:38:41.910495+0000","last_peered":"2024-09-12T01:38:41.910495+0000","last_clean":"2024-09-12T01:38:41.910495+0000","last_became_active":"2024-09-12T00:47:05.444004+0000","last_became_peered":"2024-09-12T00:47:05.444004+0000","last_unstale":"2024-09-12T01:38:41.910495+0000","last_undegraded":"2024-09-12T01:38:41.910495+0000","last_fullsized":"2024-09-12T01:38:41.910495+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-12T01:38:41.910399+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-12T01:38:41.910399+0000","last_clean_scrub_stamp":"2024-09-12T01:38:41.910399+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:13.148664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":27197,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"263'2","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:21.563798+0000","last_change":"2024-09-12T00:46:22.348331+0000","last_active":"2024-09-12T01:37:21.563798+0000","last_peered":"2024-09-12T01:37:21.563798+0000","last_clean":"2024-09-12T01:37:21.563798+0000","last_became_active":"2024-09-12T00:46:22.347338+0000","last_became_peered":"2024-09-12T00:46:22.347338+0000","last_unstale":"2024-09-12T01:37:21.563798+0000","last_undegraded":"2024-09-12T01:37:21.563798+0000","last_fullsized":"2024-09-12T01:37:21.563798+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:08.989061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"263'72","reported_seq":306,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.059290+0000","last_change":"2024-09-12T01:38:38.059290+0000","last_active":"2024-09-12T01:38:38.059290+0000","last_peered":"2024-09-12T01:38:38.059290+0000","last_clean":"2024-09-12T01:38:38.059290+0000","last_became_active":"2024-09-12T00:42:36.812454+0000","last_became_peered":"2024-09-12T00:42:36.812454+0000","last_unstale":"2024-09-12T01:38:38.059290+0000","last_undegraded":"2024-09-12T01:38:38.059290+0000","last_fullsized":"2024-09-12T01:38:38.059290+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'72","last_scrub_stamp":"2024-09-12T01:38:38.059208+0000","last_deep_scrub":"263'72","last_deep_scrub_stamp":"2024-09-12T01:38:38.059208+0000","last_clean_scrub_stamp":"2024-09-12T01:38:38.059208+0000","objects_scrubbed":1,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:13.691583+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":475,"num_read_kb":319,"num_write":83,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4980,"num_omap_keys":10,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"263'1","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:16.721868+0000","last_change":"2024-09-12T01:04:15.391988+0000","last_active":"2024-09-12T01:34:16.721868+0000","last_peered":"2024-09-12T01:34:16.721868+0000","last_clean":"2024-09-12T01:34:16.721868+0000","last_became_active":"2024-09-12T01:04:15.391532+0000","last_became_peered":"2024-09-12T01:04:15.391532+0000","last_unstale":"2024-09-12T01:34:16.721868+0000","last_undegraded":"2024-09-12T01:34:16.721868+0000","last_fullsized":"2024-09-12T01:34:16.721868+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:13.040622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"263'6","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:43.929220+0000","last_change":"2024-09-12T01:38:43.929220+0000","last_active":"2024-09-12T01:38:43.929220+0000","last_peered":"2024-09-12T01:38:43.929220+0000","last_clean":"2024-09-12T01:38:43.929220+0000","last_became_active":"2024-09-12T00:46:26.374660+0000","last_became_peered":"2024-09-12T00:46:26.374660+0000","last_unstale":"2024-09-12T01:38:43.929220+0000","last_undegraded":"2024-09-12T01:38:43.929220+0000","last_fullsized":"2024-09-12T01:38:43.929220+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-12T01:38:43.929107+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-12T01:38:43.929107+0000","last_clean_scrub_stamp":"2024-09-12T01:38:43.929107+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:45.373952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"263'7","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:21.555167+0000","last_change":"2024-09-12T00:46:22.340546+0000","last_active":"2024-09-12T01:36:21.555167+0000","last_peered":"2024-09-12T01:36:21.555167+0000","last_clean":"2024-09-12T01:36:21.555167+0000","last_became_active":"2024-09-12T00:46:22.340228+0000","last_became_peered":"2024-09-12T00:46:22.340228+0000","last_unstale":"2024-09-12T01:36:21.555167+0000","last_undegraded":"2024-09-12T01:36:21.555167+0000","last_fullsized":"2024-09-12T01:36:21.555167+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:22.609852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6219,"num_write":7,"num_write_kb":6219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"263'129","reported_seq":432,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:56.798118+0000","last_change":"2024-09-12T00:42:36.813186+0000","last_active":"2024-09-12T01:35:56.798118+0000","last_peered":"2024-09-12T01:35:56.798118+0000","last_clean":"2024-09-12T01:35:56.798118+0000","last_became_active":"2024-09-12T00:42:36.812882+0000","last_became_peered":"2024-09-12T00:42:36.812882+0000","last_unstale":"2024-09-12T01:35:56.798118+0000","last_undegraded":"2024-09-12T01:35:56.798118+0000","last_fullsized":"2024-09-12T01:35:56.798118+0000","mapping_epoch":250,"log_start":"260'100","ondisk_log_start":"260'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":723,"num_read_kb":503,"num_write":193,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:16.721896+0000","last_change":"2024-09-12T01:04:15.398861+0000","last_active":"2024-09-12T01:34:16.721896+0000","last_peered":"2024-09-12T01:34:16.721896+0000","last_clean":"2024-09-12T01:34:16.721896+0000","last_became_active":"2024-09-12T01:04:15.398533+0000","last_became_peered":"2024-09-12T01:04:15.398533+0000","last_unstale":"2024-09-12T01:34:16.721896+0000","last_undegraded":"2024-09-12T01:34:16.721896+0000","last_fullsized":"2024-09-12T01:34:16.721896+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:15.428730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"263'5","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.405774+0000","last_change":"2024-09-12T00:46:26.368036+0000","last_active":"2024-09-12T01:38:00.405774+0000","last_peered":"2024-09-12T01:38:00.405774+0000","last_clean":"2024-09-12T01:38:00.405774+0000","last_became_active":"2024-09-12T00:46:26.367766+0000","last_became_peered":"2024-09-12T00:46:26.367766+0000","last_unstale":"2024-09-12T01:38:00.405774+0000","last_undegraded":"2024-09-12T01:38:00.405774+0000","last_fullsized":"2024-09-12T01:38:00.405774+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:04.823775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4,"num_write":10,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:33:51.783149+0000","last_change":"2024-09-12T00:46:22.354118+0000","last_active":"2024-09-12T01:33:51.783149+0000","last_peered":"2024-09-12T01:33:51.783149+0000","last_clean":"2024-09-12T01:33:51.783149+0000","last_became_active":"2024-09-12T00:46:22.353833+0000","last_became_peered":"2024-09-12T00:46:22.353833+0000","last_unstale":"2024-09-12T01:33:51.783149+0000","last_undegraded":"2024-09-12T01:33:51.783149+0000","last_fullsized":"2024-09-12T01:33:51.783149+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:15.168253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'39","reported_seq":175,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:36.883196+0000","last_change":"2024-09-12T01:38:36.883196+0000","last_active":"2024-09-12T01:38:36.883196+0000","last_peered":"2024-09-12T01:38:36.883196+0000","last_clean":"2024-09-12T01:38:36.883196+0000","last_became_active":"2024-09-12T00:42:36.803692+0000","last_became_peered":"2024-09-12T00:42:36.803692+0000","last_unstale":"2024-09-12T01:38:36.883196+0000","last_undegraded":"2024-09-12T01:38:36.883196+0000","last_fullsized":"2024-09-12T01:38:36.883196+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'39","last_scrub_stamp":"2024-09-12T01:38:36.883106+0000","last_deep_scrub":"263'39","last_deep_scrub_stamp":"2024-09-12T01:38:36.883106+0000","last_clean_scrub_stamp":"2024-09-12T01:38:36.883106+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:35.390177+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":209,"num_read_kb":149,"num_write":77,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.938567+0000","last_change":"2024-09-12T01:04:15.385887+0000","last_active":"2024-09-12T01:34:36.938567+0000","last_peered":"2024-09-12T01:34:36.938567+0000","last_clean":"2024-09-12T01:34:36.938567+0000","last_became_active":"2024-09-12T01:04:15.385172+0000","last_became_peered":"2024-09-12T01:04:15.385172+0000","last_unstale":"2024-09-12T01:34:36.938567+0000","last_undegraded":"2024-09-12T01:34:36.938567+0000","last_fullsized":"2024-09-12T01:34:36.938567+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:15.451328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"263'5","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.880428+0000","last_change":"2024-09-12T00:46:26.565125+0000","last_active":"2024-09-12T01:38:00.880428+0000","last_peered":"2024-09-12T01:38:00.880428+0000","last_clean":"2024-09-12T01:38:00.880428+0000","last_became_active":"2024-09-12T00:46:26.561643+0000","last_became_peered":"2024-09-12T00:46:26.561643+0000","last_unstale":"2024-09-12T01:38:00.880428+0000","last_undegraded":"2024-09-12T01:38:00.880428+0000","last_fullsized":"2024-09-12T01:38:00.880428+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:50.221519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10250,"num_write":10,"num_write_kb":5125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:27.793407+0000","last_change":"2024-09-12T00:46:22.349290+0000","last_active":"2024-09-12T01:35:27.793407+0000","last_peered":"2024-09-12T01:35:27.793407+0000","last_clean":"2024-09-12T01:35:27.793407+0000","last_became_active":"2024-09-12T00:46:22.349007+0000","last_became_peered":"2024-09-12T00:46:22.349007+0000","last_unstale":"2024-09-12T01:35:27.793407+0000","last_undegraded":"2024-09-12T01:35:27.793407+0000","last_fullsized":"2024-09-12T01:35:27.793407+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:56.041981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"263'19","reported_seq":113,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.797074+0000","last_change":"2024-09-12T00:42:36.815233+0000","last_active":"2024-09-12T01:35:46.797074+0000","last_peered":"2024-09-12T01:35:46.797074+0000","last_clean":"2024-09-12T01:35:46.797074+0000","last_became_active":"2024-09-12T00:42:36.814846+0000","last_became_peered":"2024-09-12T00:42:36.814846+0000","last_unstale":"2024-09-12T01:35:46.797074+0000","last_undegraded":"2024-09-12T01:35:46.797074+0000","last_fullsized":"2024-09-12T01:35:46.797074+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":75,"num_write":34,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"263'2","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:36.758725+0000","last_change":"2024-09-12T01:38:36.758725+0000","last_active":"2024-09-12T01:38:36.758725+0000","last_peered":"2024-09-12T01:38:36.758725+0000","last_clean":"2024-09-12T01:38:36.758725+0000","last_became_active":"2024-09-12T01:04:15.395540+0000","last_became_peered":"2024-09-12T01:04:15.395540+0000","last_unstale":"2024-09-12T01:38:36.758725+0000","last_undegraded":"2024-09-12T01:38:36.758725+0000","last_fullsized":"2024-09-12T01:38:36.758725+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:38:36.758622+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:38:36.758622+0000","last_clean_scrub_stamp":"2024-09-12T01:38:36.758622+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:30.668812+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:39.649759+0000","last_change":"2024-09-12T00:46:26.562294+0000","last_active":"2024-09-12T01:35:39.649759+0000","last_peered":"2024-09-12T01:35:39.649759+0000","last_clean":"2024-09-12T01:35:39.649759+0000","last_became_active":"2024-09-12T00:46:26.561961+0000","last_became_peered":"2024-09-12T00:46:26.561961+0000","last_unstale":"2024-09-12T01:35:39.649759+0000","last_undegraded":"2024-09-12T01:35:39.649759+0000","last_fullsized":"2024-09-12T01:35:39.649759+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:55.068083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"260'5","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:41.725916+0000","last_change":"2024-09-12T00:46:22.351249+0000","last_active":"2024-09-12T01:34:41.725916+0000","last_peered":"2024-09-12T01:34:41.725916+0000","last_clean":"2024-09-12T01:34:41.725916+0000","last_became_active":"2024-09-12T00:46:22.350947+0000","last_became_peered":"2024-09-12T00:46:22.350947+0000","last_unstale":"2024-09-12T01:34:41.725916+0000","last_undegraded":"2024-09-12T01:34:41.725916+0000","last_fullsized":"2024-09-12T01:34:41.725916+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:16.221679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"263'28","reported_seq":136,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:49.651117+0000","last_change":"2024-09-12T00:42:36.815997+0000","last_active":"2024-09-12T01:35:49.651117+0000","last_peered":"2024-09-12T01:35:49.651117+0000","last_clean":"2024-09-12T01:35:49.651117+0000","last_became_active":"2024-09-12T00:42:36.815638+0000","last_became_peered":"2024-09-12T00:42:36.815638+0000","last_unstale":"2024-09-12T01:35:49.651117+0000","last_undegraded":"2024-09-12T01:35:49.651117+0000","last_fullsized":"2024-09-12T01:35:49.651117+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":103,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.724838+0000","last_change":"2024-09-12T01:04:15.391815+0000","last_active":"2024-09-12T01:34:36.724838+0000","last_peered":"2024-09-12T01:34:36.724838+0000","last_clean":"2024-09-12T01:34:36.724838+0000","last_became_active":"2024-09-12T01:04:15.391501+0000","last_became_peered":"2024-09-12T01:04:15.391501+0000","last_unstale":"2024-09-12T01:34:36.724838+0000","last_undegraded":"2024-09-12T01:34:36.724838+0000","last_fullsized":"2024-09-12T01:34:36.724838+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:28.795724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:49.644166+0000","last_change":"2024-09-12T00:46:26.563439+0000","last_active":"2024-09-12T01:34:49.644166+0000","last_peered":"2024-09-12T01:34:49.644166+0000","last_clean":"2024-09-12T01:34:49.644166+0000","last_became_active":"2024-09-12T00:46:26.563091+0000","last_became_peered":"2024-09-12T00:46:26.563091+0000","last_unstale":"2024-09-12T01:34:49.644166+0000","last_undegraded":"2024-09-12T01:34:49.644166+0000","last_fullsized":"2024-09-12T01:34:49.644166+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:05.796776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:31.658500+0000","last_change":"2024-09-12T01:38:31.658500+0000","last_active":"2024-09-12T01:38:31.658500+0000","last_peered":"2024-09-12T01:38:31.658500+0000","last_clean":"2024-09-12T01:38:31.658500+0000","last_became_active":"2024-09-12T00:46:22.354167+0000","last_became_peered":"2024-09-12T00:46:22.354167+0000","last_unstale":"2024-09-12T01:38:31.658500+0000","last_undegraded":"2024-09-12T01:38:31.658500+0000","last_fullsized":"2024-09-12T01:38:31.658500+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:31.658403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:31.658403+0000","last_clean_scrub_stamp":"2024-09-12T01:38:31.658403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:26.400177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"260'8","reported_seq":90,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:28.717227+0000","last_change":"2024-09-12T01:38:28.717227+0000","last_active":"2024-09-12T01:38:28.717227+0000","last_peered":"2024-09-12T01:38:28.717227+0000","last_clean":"2024-09-12T01:38:28.717227+0000","last_became_active":"2024-09-12T00:42:36.802737+0000","last_became_peered":"2024-09-12T00:42:36.802737+0000","last_unstale":"2024-09-12T01:38:28.717227+0000","last_undegraded":"2024-09-12T01:38:28.717227+0000","last_fullsized":"2024-09-12T01:38:28.717227+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'8","last_scrub_stamp":"2024-09-12T01:38:28.717114+0000","last_deep_scrub":"260'8","last_deep_scrub_stamp":"2024-09-12T01:38:28.717114+0000","last_clean_scrub_stamp":"2024-09-12T01:38:28.717114+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:10.385026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:37.786393+0000","last_change":"2024-09-12T01:04:15.393599+0000","last_active":"2024-09-12T01:34:37.786393+0000","last_peered":"2024-09-12T01:34:37.786393+0000","last_clean":"2024-09-12T01:34:37.786393+0000","last_became_active":"2024-09-12T01:04:15.393292+0000","last_became_peered":"2024-09-12T01:04:15.393292+0000","last_unstale":"2024-09-12T01:34:37.786393+0000","last_undegraded":"2024-09-12T01:34:37.786393+0000","last_fullsized":"2024-09-12T01:34:37.786393+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:04.044752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"263'3","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:37:11.562356+0000","last_change":"2024-09-12T00:46:26.371159+0000","last_active":"2024-09-12T01:37:11.562356+0000","last_peered":"2024-09-12T01:37:11.562356+0000","last_clean":"2024-09-12T01:37:11.562356+0000","last_became_active":"2024-09-12T00:46:26.370845+0000","last_became_peered":"2024-09-12T00:46:26.370845+0000","last_unstale":"2024-09-12T01:37:11.562356+0000","last_undegraded":"2024-09-12T01:37:11.562356+0000","last_fullsized":"2024-09-12T01:37:11.562356+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:36.995861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:41.789472+0000","last_change":"2024-09-12T00:46:22.349777+0000","last_active":"2024-09-12T01:34:41.789472+0000","last_peered":"2024-09-12T01:34:41.789472+0000","last_clean":"2024-09-12T01:34:41.789472+0000","last_became_active":"2024-09-12T00:46:22.348534+0000","last_became_peered":"2024-09-12T00:46:22.348534+0000","last_unstale":"2024-09-12T01:34:41.789472+0000","last_undegraded":"2024-09-12T01:34:41.789472+0000","last_fullsized":"2024-09-12T01:34:41.789472+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:19.642717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"263'16","reported_seq":98,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:11.721017+0000","last_change":"2024-09-12T00:42:36.812901+0000","last_active":"2024-09-12T01:34:11.721017+0000","last_peered":"2024-09-12T01:34:11.721017+0000","last_clean":"2024-09-12T01:34:11.721017+0000","last_became_active":"2024-09-12T00:42:36.812629+0000","last_became_peered":"2024-09-12T00:42:36.812629+0000","last_unstale":"2024-09-12T01:34:11.721017+0000","last_undegraded":"2024-09-12T01:34:11.721017+0000","last_fullsized":"2024-09-12T01:34:11.721017+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:44.152868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":48,"num_write":38,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:39.649821+0000","last_change":"2024-09-12T01:04:15.398685+0000","last_active":"2024-09-12T01:35:39.649821+0000","last_peered":"2024-09-12T01:35:39.649821+0000","last_clean":"2024-09-12T01:35:39.649821+0000","last_became_active":"2024-09-12T01:04:15.398407+0000","last_became_peered":"2024-09-12T01:04:15.398407+0000","last_unstale":"2024-09-12T01:35:39.649821+0000","last_undegraded":"2024-09-12T01:35:39.649821+0000","last_fullsized":"2024-09-12T01:35:39.649821+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:31.635332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"263'3","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:45.781269+0000","last_change":"2024-09-12T01:38:45.781269+0000","last_active":"2024-09-12T01:38:45.781269+0000","last_peered":"2024-09-12T01:38:45.781269+0000","last_clean":"2024-09-12T01:38:45.781269+0000","last_became_active":"2024-09-12T00:46:26.366602+0000","last_became_peered":"2024-09-12T00:46:26.366602+0000","last_unstale":"2024-09-12T01:38:45.781269+0000","last_undegraded":"2024-09-12T01:38:45.781269+0000","last_fullsized":"2024-09-12T01:38:45.781269+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-12T01:38:45.781144+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-12T01:38:45.781144+0000","last_clean_scrub_stamp":"2024-09-12T01:38:45.781144+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:44.387003+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"263'9","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.830640+0000","last_change":"2024-09-12T00:46:22.351729+0000","last_active":"2024-09-12T01:38:00.830640+0000","last_peered":"2024-09-12T01:38:00.830640+0000","last_clean":"2024-09-12T01:38:00.830640+0000","last_became_active":"2024-09-12T00:46:22.351432+0000","last_became_peered":"2024-09-12T00:46:22.351432+0000","last_unstale":"2024-09-12T01:38:00.830640+0000","last_undegraded":"2024-09-12T01:38:00.830640+0000","last_fullsized":"2024-09-12T01:38:00.830640+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:22.950636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":19,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"252'16","reported_seq":104,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:16.740526+0000","last_change":"2024-09-12T00:42:36.813580+0000","last_active":"2024-09-12T01:36:16.740526+0000","last_peered":"2024-09-12T01:36:16.740526+0000","last_clean":"2024-09-12T01:36:16.740526+0000","last_became_active":"2024-09-12T00:42:36.813324+0000","last_became_peered":"2024-09-12T00:42:36.813324+0000","last_unstale":"2024-09-12T01:36:16.740526+0000","last_undegraded":"2024-09-12T01:36:16.740526+0000","last_fullsized":"2024-09-12T01:36:16.740526+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":59,"num_write":21,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:41.796461+0000","last_change":"2024-09-12T01:04:15.394539+0000","last_active":"2024-09-12T01:35:41.796461+0000","last_peered":"2024-09-12T01:35:41.796461+0000","last_clean":"2024-09-12T01:35:41.796461+0000","last_became_active":"2024-09-12T01:04:15.393021+0000","last_became_peered":"2024-09-12T01:04:15.393021+0000","last_unstale":"2024-09-12T01:35:41.796461+0000","last_undegraded":"2024-09-12T01:35:41.796461+0000","last_fullsized":"2024-09-12T01:35:41.796461+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"260'8","reported_seq":74,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:44.771845+0000","last_change":"2024-09-12T01:38:44.771845+0000","last_active":"2024-09-12T01:38:44.771845+0000","last_peered":"2024-09-12T01:38:44.771845+0000","last_clean":"2024-09-12T01:38:44.771845+0000","last_became_active":"2024-09-12T00:46:26.371443+0000","last_became_peered":"2024-09-12T00:46:26.371443+0000","last_unstale":"2024-09-12T01:38:44.771845+0000","last_undegraded":"2024-09-12T01:38:44.771845+0000","last_fullsized":"2024-09-12T01:38:44.771845+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'8","last_scrub_stamp":"2024-09-12T01:38:44.771738+0000","last_deep_scrub":"260'8","last_deep_scrub_stamp":"2024-09-12T01:38:44.771738+0000","last_clean_scrub_stamp":"2024-09-12T01:38:44.771738+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:57.305608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":26626,"num_write":8,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:24.648070+0000","last_change":"2024-09-12T00:46:22.352325+0000","last_active":"2024-09-12T01:35:24.648070+0000","last_peered":"2024-09-12T01:35:24.648070+0000","last_clean":"2024-09-12T01:35:24.648070+0000","last_became_active":"2024-09-12T00:46:22.350714+0000","last_became_peered":"2024-09-12T00:46:22.350714+0000","last_unstale":"2024-09-12T01:35:24.648070+0000","last_undegraded":"2024-09-12T01:35:24.648070+0000","last_fullsized":"2024-09-12T01:35:24.648070+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:40.578771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"263'52","reported_seq":202,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:16.800548+0000","last_change":"2024-09-12T00:42:36.818076+0000","last_active":"2024-09-12T01:36:16.800548+0000","last_peered":"2024-09-12T01:36:16.800548+0000","last_clean":"2024-09-12T01:36:16.800548+0000","last_became_active":"2024-09-12T00:42:36.817763+0000","last_became_peered":"2024-09-12T00:42:36.817763+0000","last_unstale":"2024-09-12T01:36:16.800548+0000","last_undegraded":"2024-09-12T01:36:16.800548+0000","last_fullsized":"2024-09-12T01:36:16.800548+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":268,"num_read_kb":195,"num_write":87,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.788740+0000","last_change":"2024-09-12T01:04:15.397100+0000","last_active":"2024-09-12T01:34:36.788740+0000","last_peered":"2024-09-12T01:34:36.788740+0000","last_clean":"2024-09-12T01:34:36.788740+0000","last_became_active":"2024-09-12T01:04:15.396832+0000","last_became_peered":"2024-09-12T01:04:15.396832+0000","last_unstale":"2024-09-12T01:34:36.788740+0000","last_undegraded":"2024-09-12T01:34:36.788740+0000","last_fullsized":"2024-09-12T01:34:36.788740+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:22.398122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:29.648642+0000","last_change":"2024-09-12T00:46:26.373712+0000","last_active":"2024-09-12T01:35:29.648642+0000","last_peered":"2024-09-12T01:35:29.648642+0000","last_clean":"2024-09-12T01:35:29.648642+0000","last_became_active":"2024-09-12T00:46:26.373401+0000","last_became_peered":"2024-09-12T00:46:26.373401+0000","last_unstale":"2024-09-12T01:35:29.648642+0000","last_undegraded":"2024-09-12T01:35:29.648642+0000","last_fullsized":"2024-09-12T01:35:29.648642+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:11.356426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:39.020820+0000","last_change":"2024-09-12T01:38:39.020820+0000","last_active":"2024-09-12T01:38:39.020820+0000","last_peered":"2024-09-12T01:38:39.020820+0000","last_clean":"2024-09-12T01:38:39.020820+0000","last_became_active":"2024-09-12T00:46:22.347794+0000","last_became_peered":"2024-09-12T00:46:22.347794+0000","last_unstale":"2024-09-12T01:38:39.020820+0000","last_undegraded":"2024-09-12T01:38:39.020820+0000","last_fullsized":"2024-09-12T01:38:39.020820+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:39.020729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:39.020729+0000","last_clean_scrub_stamp":"2024-09-12T01:38:39.020729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:19.893388+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'10","reported_seq":92,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:44.476405+0000","last_change":"2024-09-12T01:38:44.476405+0000","last_active":"2024-09-12T01:38:44.476405+0000","last_peered":"2024-09-12T01:38:44.476405+0000","last_clean":"2024-09-12T01:38:44.476405+0000","last_became_active":"2024-09-12T00:42:36.802647+0000","last_became_peered":"2024-09-12T00:42:36.802647+0000","last_unstale":"2024-09-12T01:38:44.476405+0000","last_undegraded":"2024-09-12T01:38:44.476405+0000","last_fullsized":"2024-09-12T01:38:44.476405+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'10","last_scrub_stamp":"2024-09-12T01:38:44.476313+0000","last_deep_scrub":"263'10","last_deep_scrub_stamp":"2024-09-12T01:38:44.476313+0000","last_clean_scrub_stamp":"2024-09-12T01:38:44.476313+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:58.387217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":30,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:39.649795+0000","last_change":"2024-09-12T01:04:15.397994+0000","last_active":"2024-09-12T01:35:39.649795+0000","last_peered":"2024-09-12T01:35:39.649795+0000","last_clean":"2024-09-12T01:35:39.649795+0000","last_became_active":"2024-09-12T01:04:15.397646+0000","last_became_peered":"2024-09-12T01:04:15.397646+0000","last_unstale":"2024-09-12T01:35:39.649795+0000","last_undegraded":"2024-09-12T01:35:39.649795+0000","last_fullsized":"2024-09-12T01:35:39.649795+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:13.049264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"263'3","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:40.946648+0000","last_change":"2024-09-12T01:38:40.946648+0000","last_active":"2024-09-12T01:38:40.946648+0000","last_peered":"2024-09-12T01:38:40.946648+0000","last_clean":"2024-09-12T01:38:40.946648+0000","last_became_active":"2024-09-12T00:46:26.373354+0000","last_became_peered":"2024-09-12T00:46:26.373354+0000","last_unstale":"2024-09-12T01:38:40.946648+0000","last_undegraded":"2024-09-12T01:38:40.946648+0000","last_fullsized":"2024-09-12T01:38:40.946648+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-12T01:38:40.946561+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-12T01:38:40.946561+0000","last_clean_scrub_stamp":"2024-09-12T01:38:40.946561+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:54.214293+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:22.792606+0000","last_change":"2024-09-12T00:46:22.349188+0000","last_active":"2024-09-12T01:35:22.792606+0000","last_peered":"2024-09-12T01:35:22.792606+0000","last_clean":"2024-09-12T01:35:22.792606+0000","last_became_active":"2024-09-12T00:46:22.348875+0000","last_became_peered":"2024-09-12T00:46:22.348875+0000","last_unstale":"2024-09-12T01:35:22.792606+0000","last_undegraded":"2024-09-12T01:35:22.792606+0000","last_fullsized":"2024-09-12T01:35:22.792606+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:31.550301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"263'37","reported_seq":165,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:19.654607+0000","last_change":"2024-09-12T00:42:36.814630+0000","last_active":"2024-09-12T01:36:19.654607+0000","last_peered":"2024-09-12T01:36:19.654607+0000","last_clean":"2024-09-12T01:36:19.654607+0000","last_became_active":"2024-09-12T00:42:36.814235+0000","last_became_peered":"2024-09-12T00:42:36.814235+0000","last_unstale":"2024-09-12T01:36:19.654607+0000","last_undegraded":"2024-09-12T01:36:19.654607+0000","last_fullsized":"2024-09-12T01:36:19.654607+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":201,"num_read_kb":139,"num_write":71,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.746892+0000","last_change":"2024-09-12T01:38:35.746892+0000","last_active":"2024-09-12T01:38:35.746892+0000","last_peered":"2024-09-12T01:38:35.746892+0000","last_clean":"2024-09-12T01:38:35.746892+0000","last_became_active":"2024-09-12T01:04:15.395860+0000","last_became_peered":"2024-09-12T01:04:15.395860+0000","last_unstale":"2024-09-12T01:38:35.746892+0000","last_undegraded":"2024-09-12T01:38:35.746892+0000","last_fullsized":"2024-09-12T01:38:35.746892+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.746784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.746784+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.746784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:51.193748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:59.652257+0000","last_change":"2024-09-12T00:46:26.373083+0000","last_active":"2024-09-12T01:35:59.652257+0000","last_peered":"2024-09-12T01:35:59.652257+0000","last_clean":"2024-09-12T01:35:59.652257+0000","last_became_active":"2024-09-12T00:46:26.372803+0000","last_became_peered":"2024-09-12T00:46:26.372803+0000","last_unstale":"2024-09-12T01:35:59.652257+0000","last_undegraded":"2024-09-12T01:35:59.652257+0000","last_fullsized":"2024-09-12T01:35:59.652257+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"263'9","reported_seq":67,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.744735+0000","last_change":"2024-09-12T00:46:22.356200+0000","last_active":"2024-09-12T01:38:01.744735+0000","last_peered":"2024-09-12T01:38:01.744735+0000","last_clean":"2024-09-12T01:38:01.744735+0000","last_became_active":"2024-09-12T00:46:22.355962+0000","last_became_peered":"2024-09-12T00:46:22.355962+0000","last_unstale":"2024-09-12T01:38:01.744735+0000","last_undegraded":"2024-09-12T01:38:01.744735+0000","last_fullsized":"2024-09-12T01:38:01.744735+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:15:50.421437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5707,"num_write":14,"num_write_kb":4683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"263'12","reported_seq":90,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:39.642863+0000","last_change":"2024-09-12T00:42:36.817087+0000","last_active":"2024-09-12T01:34:39.642863+0000","last_peered":"2024-09-12T01:34:39.642863+0000","last_clean":"2024-09-12T01:34:39.642863+0000","last_became_active":"2024-09-12T00:42:36.816673+0000","last_became_peered":"2024-09-12T00:42:36.816673+0000","last_unstale":"2024-09-12T01:34:39.642863+0000","last_undegraded":"2024-09-12T01:34:39.642863+0000","last_fullsized":"2024-09-12T01:34:39.642863+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:44.855498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":40,"num_write":24,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.736023+0000","last_change":"2024-09-12T01:04:15.393891+0000","last_active":"2024-09-12T01:35:46.736023+0000","last_peered":"2024-09-12T01:35:46.736023+0000","last_clean":"2024-09-12T01:35:46.736023+0000","last_became_active":"2024-09-12T01:04:15.393597+0000","last_became_peered":"2024-09-12T01:04:15.393597+0000","last_unstale":"2024-09-12T01:35:46.736023+0000","last_undegraded":"2024-09-12T01:35:46.736023+0000","last_fullsized":"2024-09-12T01:35:46.736023+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:33.585796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:59.652227+0000","last_change":"2024-09-12T00:46:26.366156+0000","last_active":"2024-09-12T01:35:59.652227+0000","last_peered":"2024-09-12T01:35:59.652227+0000","last_clean":"2024-09-12T01:35:59.652227+0000","last_became_active":"2024-09-12T00:46:26.365848+0000","last_became_peered":"2024-09-12T00:46:26.365848+0000","last_unstale":"2024-09-12T01:35:59.652227+0000","last_undegraded":"2024-09-12T01:35:59.652227+0000","last_fullsized":"2024-09-12T01:35:59.652227+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"263'3","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:32.652611+0000","last_change":"2024-09-12T01:38:32.652611+0000","last_active":"2024-09-12T01:38:32.652611+0000","last_peered":"2024-09-12T01:38:32.652611+0000","last_clean":"2024-09-12T01:38:32.652611+0000","last_became_active":"2024-09-12T00:46:22.350815+0000","last_became_peered":"2024-09-12T00:46:22.350815+0000","last_unstale":"2024-09-12T01:38:32.652611+0000","last_undegraded":"2024-09-12T01:38:32.652611+0000","last_fullsized":"2024-09-12T01:38:32.652611+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-12T01:38:32.652500+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-12T01:38:32.652500+0000","last_clean_scrub_stamp":"2024-09-12T01:38:32.652500+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:56.268124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"263'49","reported_seq":188,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:22.784293+0000","last_change":"2024-09-12T00:42:36.811488+0000","last_active":"2024-09-12T01:34:22.784293+0000","last_peered":"2024-09-12T01:34:22.784293+0000","last_clean":"2024-09-12T01:34:22.784293+0000","last_became_active":"2024-09-12T00:42:36.810754+0000","last_became_peered":"2024-09-12T00:42:36.810754+0000","last_unstale":"2024-09-12T01:34:22.784293+0000","last_undegraded":"2024-09-12T01:34:22.784293+0000","last_fullsized":"2024-09-12T01:34:22.784293+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:12.064178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":240,"num_read_kb":165,"num_write":91,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:44.968832+0000","last_change":"2024-09-12T01:38:44.968832+0000","last_active":"2024-09-12T01:38:44.968832+0000","last_peered":"2024-09-12T01:38:44.968832+0000","last_clean":"2024-09-12T01:38:44.968832+0000","last_became_active":"2024-09-12T01:04:15.396999+0000","last_became_peered":"2024-09-12T01:04:15.396999+0000","last_unstale":"2024-09-12T01:38:44.968832+0000","last_undegraded":"2024-09-12T01:38:44.968832+0000","last_fullsized":"2024-09-12T01:38:44.968832+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:44.968746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:44.968746+0000","last_clean_scrub_stamp":"2024-09-12T01:38:44.968746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:31.808451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:43.782123+0000","last_change":"2024-09-12T01:38:43.782123+0000","last_active":"2024-09-12T01:38:43.782123+0000","last_peered":"2024-09-12T01:38:43.782123+0000","last_clean":"2024-09-12T01:38:43.782123+0000","last_became_active":"2024-09-12T00:46:26.563041+0000","last_became_peered":"2024-09-12T00:46:26.563041+0000","last_unstale":"2024-09-12T01:38:43.782123+0000","last_undegraded":"2024-09-12T01:38:43.782123+0000","last_fullsized":"2024-09-12T01:38:43.782123+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:43.782030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:43.782030+0000","last_clean_scrub_stamp":"2024-09-12T01:38:43.782030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:45.708647+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:51.797572+0000","last_change":"2024-09-12T00:46:22.353183+0000","last_active":"2024-09-12T01:35:51.797572+0000","last_peered":"2024-09-12T01:35:51.797572+0000","last_clean":"2024-09-12T01:35:51.797572+0000","last_became_active":"2024-09-12T00:46:22.352933+0000","last_became_peered":"2024-09-12T00:46:22.352933+0000","last_unstale":"2024-09-12T01:35:51.797572+0000","last_undegraded":"2024-09-12T01:35:51.797572+0000","last_fullsized":"2024-09-12T01:35:51.797572+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"263'30","reported_seq":151,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.083672+0000","last_change":"2024-09-12T01:38:37.083672+0000","last_active":"2024-09-12T01:38:37.083672+0000","last_peered":"2024-09-12T01:38:37.083672+0000","last_clean":"2024-09-12T01:38:37.083672+0000","last_became_active":"2024-09-12T00:42:36.816619+0000","last_became_peered":"2024-09-12T00:42:36.816619+0000","last_unstale":"2024-09-12T01:38:37.083672+0000","last_undegraded":"2024-09-12T01:38:37.083672+0000","last_fullsized":"2024-09-12T01:38:37.083672+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'30","last_scrub_stamp":"2024-09-12T01:38:37.083582+0000","last_deep_scrub":"263'30","last_deep_scrub_stamp":"2024-09-12T01:38:37.083582+0000","last_clean_scrub_stamp":"2024-09-12T01:38:37.083582+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:16.757422+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":113,"num_write":55,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.724886+0000","last_change":"2024-09-12T01:04:15.396475+0000","last_active":"2024-09-12T01:34:36.724886+0000","last_peered":"2024-09-12T01:34:36.724886+0000","last_clean":"2024-09-12T01:34:36.724886+0000","last_became_active":"2024-09-12T01:04:15.396125+0000","last_became_peered":"2024-09-12T01:04:15.396125+0000","last_unstale":"2024-09-12T01:34:36.724886+0000","last_undegraded":"2024-09-12T01:34:36.724886+0000","last_fullsized":"2024-09-12T01:34:36.724886+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:47.673931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:59.652267+0000","last_change":"2024-09-12T00:46:26.366690+0000","last_active":"2024-09-12T01:35:59.652267+0000","last_peered":"2024-09-12T01:35:59.652267+0000","last_clean":"2024-09-12T01:35:59.652267+0000","last_became_active":"2024-09-12T00:46:26.366293+0000","last_became_peered":"2024-09-12T00:46:26.366293+0000","last_unstale":"2024-09-12T01:35:59.652267+0000","last_undegraded":"2024-09-12T01:35:59.652267+0000","last_fullsized":"2024-09-12T01:35:59.652267+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"263'3","reported_seq":67,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:39.792087+0000","last_change":"2024-09-12T01:38:39.792087+0000","last_active":"2024-09-12T01:38:39.792087+0000","last_peered":"2024-09-12T01:38:39.792087+0000","last_clean":"2024-09-12T01:38:39.792087+0000","last_became_active":"2024-09-12T00:46:22.348546+0000","last_became_peered":"2024-09-12T00:46:22.348546+0000","last_unstale":"2024-09-12T01:38:39.792087+0000","last_undegraded":"2024-09-12T01:38:39.792087+0000","last_fullsized":"2024-09-12T01:38:39.792087+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-12T01:38:39.792001+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-12T01:38:39.792001+0000","last_clean_scrub_stamp":"2024-09-12T01:38:39.792001+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:53.468245+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"263'34","reported_seq":157,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:27.702719+0000","last_change":"2024-09-12T01:38:27.702719+0000","last_active":"2024-09-12T01:38:27.702719+0000","last_peered":"2024-09-12T01:38:27.702719+0000","last_clean":"2024-09-12T01:38:27.702719+0000","last_became_active":"2024-09-12T00:42:36.817530+0000","last_became_peered":"2024-09-12T00:42:36.817530+0000","last_unstale":"2024-09-12T01:38:27.702719+0000","last_undegraded":"2024-09-12T01:38:27.702719+0000","last_fullsized":"2024-09-12T01:38:27.702719+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'34","last_scrub_stamp":"2024-09-12T01:38:27.702618+0000","last_deep_scrub":"263'34","last_deep_scrub_stamp":"2024-09-12T01:38:27.702618+0000","last_clean_scrub_stamp":"2024-09-12T01:38:27.702618+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:09.546260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":117,"num_write":66,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:44.650432+0000","last_change":"2024-09-12T01:04:15.399818+0000","last_active":"2024-09-12T01:35:44.650432+0000","last_peered":"2024-09-12T01:35:44.650432+0000","last_clean":"2024-09-12T01:35:44.650432+0000","last_became_active":"2024-09-12T01:04:15.399564+0000","last_became_peered":"2024-09-12T01:04:15.399564+0000","last_unstale":"2024-09-12T01:35:44.650432+0000","last_undegraded":"2024-09-12T01:35:44.650432+0000","last_fullsized":"2024-09-12T01:35:44.650432+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:02.148148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"263'7","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.060005+0000","last_change":"2024-09-12T00:46:26.374247+0000","last_active":"2024-09-12T01:38:01.060005+0000","last_peered":"2024-09-12T01:38:01.060005+0000","last_clean":"2024-09-12T01:38:01.060005+0000","last_became_active":"2024-09-12T00:46:26.373942+0000","last_became_peered":"2024-09-12T00:46:26.373942+0000","last_unstale":"2024-09-12T01:38:01.060005+0000","last_undegraded":"2024-09-12T01:38:01.060005+0000","last_fullsized":"2024-09-12T01:38:01.060005+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8208,"num_write":12,"num_write_kb":8208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.799872+0000","last_change":"2024-09-12T00:46:22.352449+0000","last_active":"2024-09-12T01:36:11.799872+0000","last_peered":"2024-09-12T01:36:11.799872+0000","last_clean":"2024-09-12T01:36:11.799872+0000","last_became_active":"2024-09-12T00:46:22.352156+0000","last_became_peered":"2024-09-12T00:46:22.352156+0000","last_unstale":"2024-09-12T01:36:11.799872+0000","last_undegraded":"2024-09-12T01:36:11.799872+0000","last_fullsized":"2024-09-12T01:36:11.799872+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"263'10","reported_seq":91,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:46.239322+0000","last_change":"2024-09-12T01:38:46.239322+0000","last_active":"2024-09-12T01:38:46.239322+0000","last_peered":"2024-09-12T01:38:46.239322+0000","last_clean":"2024-09-12T01:38:46.239322+0000","last_became_active":"2024-09-12T00:42:36.817021+0000","last_became_peered":"2024-09-12T00:42:36.817021+0000","last_unstale":"2024-09-12T01:38:46.239322+0000","last_undegraded":"2024-09-12T01:38:46.239322+0000","last_fullsized":"2024-09-12T01:38:46.239322+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'10","last_scrub_stamp":"2024-09-12T01:38:46.239230+0000","last_deep_scrub":"263'10","last_deep_scrub_stamp":"2024-09-12T01:38:46.239230+0000","last_clean_scrub_stamp":"2024-09-12T01:38:46.239230+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:04.978959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:56.737510+0000","last_change":"2024-09-12T01:04:15.396406+0000","last_active":"2024-09-12T01:35:56.737510+0000","last_peered":"2024-09-12T01:35:56.737510+0000","last_clean":"2024-09-12T01:35:56.737510+0000","last_became_active":"2024-09-12T01:04:15.396096+0000","last_became_peered":"2024-09-12T01:04:15.396096+0000","last_unstale":"2024-09-12T01:35:56.737510+0000","last_undegraded":"2024-09-12T01:35:56.737510+0000","last_fullsized":"2024-09-12T01:35:56.737510+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"260'5","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:16.740421+0000","last_change":"2024-09-12T00:46:26.562285+0000","last_active":"2024-09-12T01:36:16.740421+0000","last_peered":"2024-09-12T01:36:16.740421+0000","last_clean":"2024-09-12T01:36:16.740421+0000","last_became_active":"2024-09-12T00:46:26.561924+0000","last_became_peered":"2024-09-12T00:46:26.561924+0000","last_unstale":"2024-09-12T01:36:16.740421+0000","last_undegraded":"2024-09-12T01:36:16.740421+0000","last_fullsized":"2024-09-12T01:36:16.740421+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.869978+0000","last_change":"2024-09-12T01:38:35.869978+0000","last_active":"2024-09-12T01:38:35.869978+0000","last_peered":"2024-09-12T01:38:35.869978+0000","last_clean":"2024-09-12T01:38:35.869978+0000","last_became_active":"2024-09-12T00:46:22.349376+0000","last_became_peered":"2024-09-12T00:46:22.349376+0000","last_unstale":"2024-09-12T01:38:35.869978+0000","last_undegraded":"2024-09-12T01:38:35.869978+0000","last_fullsized":"2024-09-12T01:38:35.869978+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.869862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.869862+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.869862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:32.067962+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"263'30","reported_seq":152,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:46.591451+0000","last_change":"2024-09-12T01:38:46.591451+0000","last_active":"2024-09-12T01:38:46.591451+0000","last_peered":"2024-09-12T01:38:46.591451+0000","last_clean":"2024-09-12T01:38:46.591451+0000","last_became_active":"2024-09-12T00:42:36.809602+0000","last_became_peered":"2024-09-12T00:42:36.809602+0000","last_unstale":"2024-09-12T01:38:46.591451+0000","last_undegraded":"2024-09-12T01:38:46.591451+0000","last_fullsized":"2024-09-12T01:38:46.591451+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'30","last_scrub_stamp":"2024-09-12T01:38:46.591367+0000","last_deep_scrub":"263'30","last_deep_scrub_stamp":"2024-09-12T01:38:46.591367+0000","last_clean_scrub_stamp":"2024-09-12T01:38:46.591367+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:17.110484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":112,"num_write":54,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"263'1","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.736044+0000","last_change":"2024-09-12T01:04:15.393241+0000","last_active":"2024-09-12T01:35:46.736044+0000","last_peered":"2024-09-12T01:35:46.736044+0000","last_clean":"2024-09-12T01:35:46.736044+0000","last_became_active":"2024-09-12T01:04:15.392789+0000","last_became_peered":"2024-09-12T01:04:15.392789+0000","last_unstale":"2024-09-12T01:35:46.736044+0000","last_undegraded":"2024-09-12T01:35:46.736044+0000","last_fullsized":"2024-09-12T01:35:46.736044+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:06.945446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"260'5","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:42.777587+0000","last_change":"2024-09-12T01:38:42.777587+0000","last_active":"2024-09-12T01:38:42.777587+0000","last_peered":"2024-09-12T01:38:42.777587+0000","last_clean":"2024-09-12T01:38:42.777587+0000","last_became_active":"2024-09-12T00:46:26.369883+0000","last_became_peered":"2024-09-12T00:46:26.369883+0000","last_unstale":"2024-09-12T01:38:42.777587+0000","last_undegraded":"2024-09-12T01:38:42.777587+0000","last_fullsized":"2024-09-12T01:38:42.777587+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-12T01:38:42.777465+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-12T01:38:42.777465+0000","last_clean_scrub_stamp":"2024-09-12T01:38:42.777465+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:57.944053+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:16.800540+0000","last_change":"2024-09-12T00:46:22.348999+0000","last_active":"2024-09-12T01:36:16.800540+0000","last_peered":"2024-09-12T01:36:16.800540+0000","last_clean":"2024-09-12T01:36:16.800540+0000","last_became_active":"2024-09-12T00:46:22.348568+0000","last_became_peered":"2024-09-12T00:46:22.348568+0000","last_unstale":"2024-09-12T01:36:16.800540+0000","last_undegraded":"2024-09-12T01:36:16.800540+0000","last_fullsized":"2024-09-12T01:36:16.800540+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"263'9","reported_seq":84,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:39.642740+0000","last_change":"2024-09-12T00:42:36.814268+0000","last_active":"2024-09-12T01:34:39.642740+0000","last_peered":"2024-09-12T01:34:39.642740+0000","last_clean":"2024-09-12T01:34:39.642740+0000","last_became_active":"2024-09-12T00:42:36.813997+0000","last_became_peered":"2024-09-12T00:42:36.813997+0000","last_unstale":"2024-09-12T01:34:39.642740+0000","last_undegraded":"2024-09-12T01:34:39.642740+0000","last_fullsized":"2024-09-12T01:34:39.642740+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:34.191233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.797023+0000","last_change":"2024-09-12T01:04:15.393511+0000","last_active":"2024-09-12T01:35:46.797023+0000","last_peered":"2024-09-12T01:35:46.797023+0000","last_clean":"2024-09-12T01:35:46.797023+0000","last_became_active":"2024-09-12T01:04:15.393220+0000","last_became_peered":"2024-09-12T01:04:15.393220+0000","last_unstale":"2024-09-12T01:35:46.797023+0000","last_undegraded":"2024-09-12T01:35:46.797023+0000","last_fullsized":"2024-09-12T01:35:46.797023+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:27.528771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"263'2","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.691020+0000","last_change":"2024-09-12T00:46:26.370629+0000","last_active":"2024-09-12T01:38:01.691020+0000","last_peered":"2024-09-12T01:38:01.691020+0000","last_clean":"2024-09-12T01:38:01.691020+0000","last_became_active":"2024-09-12T00:46:26.370349+0000","last_became_peered":"2024-09-12T00:46:26.370349+0000","last_unstale":"2024-09-12T01:38:01.691020+0000","last_undegraded":"2024-09-12T01:38:01.691020+0000","last_fullsized":"2024-09-12T01:38:01.691020+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"263'11","reported_seq":85,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:46.464733+0000","last_change":"2024-09-12T01:38:46.464733+0000","last_active":"2024-09-12T01:38:46.464733+0000","last_peered":"2024-09-12T01:38:46.464733+0000","last_clean":"2024-09-12T01:38:46.464733+0000","last_became_active":"2024-09-12T00:46:22.346024+0000","last_became_peered":"2024-09-12T00:46:22.346024+0000","last_unstale":"2024-09-12T01:38:46.464733+0000","last_undegraded":"2024-09-12T01:38:46.464733+0000","last_fullsized":"2024-09-12T01:38:46.464733+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'11","last_scrub_stamp":"2024-09-12T01:38:46.464647+0000","last_deep_scrub":"263'11","last_deep_scrub_stamp":"2024-09-12T01:38:46.464647+0000","last_clean_scrub_stamp":"2024-09-12T01:38:46.464647+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:44.904960+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":32770,"num_write":16,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"263'38","reported_seq":167,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.113493+0000","last_change":"2024-09-12T01:38:35.113493+0000","last_active":"2024-09-12T01:38:35.113493+0000","last_peered":"2024-09-12T01:38:35.113493+0000","last_clean":"2024-09-12T01:38:35.113493+0000","last_became_active":"2024-09-12T00:42:36.809350+0000","last_became_peered":"2024-09-12T00:42:36.809350+0000","last_unstale":"2024-09-12T01:38:35.113493+0000","last_undegraded":"2024-09-12T01:38:35.113493+0000","last_fullsized":"2024-09-12T01:38:35.113493+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'38","last_scrub_stamp":"2024-09-12T01:38:35.113390+0000","last_deep_scrub":"263'38","last_deep_scrub_stamp":"2024-09-12T01:38:35.113390+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.113390+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:20.270309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":127,"num_write":71,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:31.733691+0000","last_change":"2024-09-12T01:04:15.395069+0000","last_active":"2024-09-12T01:35:31.733691+0000","last_peered":"2024-09-12T01:35:31.733691+0000","last_clean":"2024-09-12T01:35:31.733691+0000","last_became_active":"2024-09-12T01:04:15.394795+0000","last_became_peered":"2024-09-12T01:04:15.394795+0000","last_unstale":"2024-09-12T01:35:31.733691+0000","last_undegraded":"2024-09-12T01:35:31.733691+0000","last_fullsized":"2024-09-12T01:35:31.733691+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:28.070748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"263'2","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.402868+0000","last_change":"2024-09-12T00:46:26.368134+0000","last_active":"2024-09-12T01:38:00.402868+0000","last_peered":"2024-09-12T01:38:00.402868+0000","last_clean":"2024-09-12T01:38:00.402868+0000","last_became_active":"2024-09-12T00:46:26.367852+0000","last_became_peered":"2024-09-12T00:46:26.367852+0000","last_unstale":"2024-09-12T01:38:00.402868+0000","last_undegraded":"2024-09-12T01:38:00.402868+0000","last_fullsized":"2024-09-12T01:38:00.402868+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1142,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"260'3","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:21.741257+0000","last_change":"2024-09-12T00:46:22.351593+0000","last_active":"2024-09-12T01:36:21.741257+0000","last_peered":"2024-09-12T01:36:21.741257+0000","last_clean":"2024-09-12T01:36:21.741257+0000","last_became_active":"2024-09-12T00:46:22.351237+0000","last_became_peered":"2024-09-12T00:46:22.351237+0000","last_unstale":"2024-09-12T01:36:21.741257+0000","last_undegraded":"2024-09-12T01:36:21.741257+0000","last_fullsized":"2024-09-12T01:36:21.741257+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'36","reported_seq":159,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.788869+0000","last_change":"2024-09-12T00:42:36.819102+0000","last_active":"2024-09-12T01:34:36.788869+0000","last_peered":"2024-09-12T01:34:36.788869+0000","last_clean":"2024-09-12T01:34:36.788869+0000","last_became_active":"2024-09-12T00:42:36.818852+0000","last_became_peered":"2024-09-12T00:42:36.818852+0000","last_unstale":"2024-09-12T01:34:36.788869+0000","last_undegraded":"2024-09-12T01:34:36.788869+0000","last_fullsized":"2024-09-12T01:34:36.788869+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:23.943088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":132,"num_write":65,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:32.794132+0000","last_change":"2024-09-12T01:04:15.393939+0000","last_active":"2024-09-12T01:35:32.794132+0000","last_peered":"2024-09-12T01:35:32.794132+0000","last_clean":"2024-09-12T01:35:32.794132+0000","last_became_active":"2024-09-12T01:04:15.393651+0000","last_became_peered":"2024-09-12T01:04:15.393651+0000","last_unstale":"2024-09-12T01:35:32.794132+0000","last_undegraded":"2024-09-12T01:35:32.794132+0000","last_fullsized":"2024-09-12T01:35:32.794132+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:16.671263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"263'5","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.692030+0000","last_change":"2024-09-12T00:46:26.563573+0000","last_active":"2024-09-12T01:38:01.692030+0000","last_peered":"2024-09-12T01:38:01.692030+0000","last_clean":"2024-09-12T01:38:01.692030+0000","last_became_active":"2024-09-12T00:46:26.563277+0000","last_became_peered":"2024-09-12T00:46:26.563277+0000","last_unstale":"2024-09-12T01:38:01.692030+0000","last_undegraded":"2024-09-12T01:38:01.692030+0000","last_fullsized":"2024-09-12T01:38:01.692030+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":7168,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:30.647210+0000","last_change":"2024-09-12T01:38:30.647133+0000","last_active":"2024-09-12T01:38:30.647210+0000","last_peered":"2024-09-12T01:38:30.647210+0000","last_clean":"2024-09-12T01:38:30.647210+0000","last_became_active":"2024-09-12T00:46:22.351162+0000","last_became_peered":"2024-09-12T00:46:22.351162+0000","last_unstale":"2024-09-12T01:38:30.647210+0000","last_undegraded":"2024-09-12T01:38:30.647210+0000","last_fullsized":"2024-09-12T01:38:30.647210+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:30.647028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:30.647028+0000","last_clean_scrub_stamp":"2024-09-12T01:38:30.647028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:30.990037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"263'20","reported_seq":121,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:34.086569+0000","last_change":"2024-09-12T01:38:34.086569+0000","last_active":"2024-09-12T01:38:34.086569+0000","last_peered":"2024-09-12T01:38:34.086569+0000","last_clean":"2024-09-12T01:38:34.086569+0000","last_became_active":"2024-09-12T00:42:36.814845+0000","last_became_peered":"2024-09-12T00:42:36.814845+0000","last_unstale":"2024-09-12T01:38:34.086569+0000","last_undegraded":"2024-09-12T01:38:34.086569+0000","last_fullsized":"2024-09-12T01:38:34.086569+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'20","last_scrub_stamp":"2024-09-12T01:38:34.086443+0000","last_deep_scrub":"263'20","last_deep_scrub_stamp":"2024-09-12T01:38:34.086443+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.086443+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:31.852383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":75,"num_write":35,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:46.776551+0000","last_change":"2024-09-12T01:38:46.776551+0000","last_active":"2024-09-12T01:38:46.776551+0000","last_peered":"2024-09-12T01:38:46.776551+0000","last_clean":"2024-09-12T01:38:46.776551+0000","last_became_active":"2024-09-12T01:04:15.388423+0000","last_became_peered":"2024-09-12T01:04:15.388423+0000","last_unstale":"2024-09-12T01:38:46.776551+0000","last_undegraded":"2024-09-12T01:38:46.776551+0000","last_fullsized":"2024-09-12T01:38:46.776551+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:46.776463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:46.776463+0000","last_clean_scrub_stamp":"2024-09-12T01:38:46.776463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:57.000283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:16.740599+0000","last_change":"2024-09-12T00:46:26.565006+0000","last_active":"2024-09-12T01:36:16.740599+0000","last_peered":"2024-09-12T01:36:16.740599+0000","last_clean":"2024-09-12T01:36:16.740599+0000","last_became_active":"2024-09-12T00:46:26.564771+0000","last_became_peered":"2024-09-12T00:46:26.564771+0000","last_unstale":"2024-09-12T01:36:16.740599+0000","last_undegraded":"2024-09-12T01:36:16.740599+0000","last_fullsized":"2024-09-12T01:36:16.740599+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"260'3","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:07.799372+0000","last_change":"2024-09-12T00:46:22.350365+0000","last_active":"2024-09-12T01:36:07.799372+0000","last_peered":"2024-09-12T01:36:07.799372+0000","last_clean":"2024-09-12T01:36:07.799372+0000","last_became_active":"2024-09-12T00:46:22.350045+0000","last_became_peered":"2024-09-12T00:46:22.350045+0000","last_unstale":"2024-09-12T01:36:07.799372+0000","last_undegraded":"2024-09-12T01:36:07.799372+0000","last_fullsized":"2024-09-12T01:36:07.799372+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"263'41","reported_seq":177,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:45.623306+0000","last_change":"2024-09-12T01:38:45.623306+0000","last_active":"2024-09-12T01:38:45.623306+0000","last_peered":"2024-09-12T01:38:45.623306+0000","last_clean":"2024-09-12T01:38:45.623306+0000","last_became_active":"2024-09-12T00:42:36.814228+0000","last_became_peered":"2024-09-12T00:42:36.814228+0000","last_unstale":"2024-09-12T01:38:45.623306+0000","last_undegraded":"2024-09-12T01:38:45.623306+0000","last_fullsized":"2024-09-12T01:38:45.623306+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'41","last_scrub_stamp":"2024-09-12T01:38:45.623214+0000","last_deep_scrub":"263'41","last_deep_scrub_stamp":"2024-09-12T01:38:45.623214+0000","last_clean_scrub_stamp":"2024-09-12T01:38:45.623214+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:02.595104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":139,"num_write":79,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:31.547532+0000","last_change":"2024-09-12T01:04:15.388771+0000","last_active":"2024-09-12T01:35:31.547532+0000","last_peered":"2024-09-12T01:35:31.547532+0000","last_clean":"2024-09-12T01:35:31.547532+0000","last_became_active":"2024-09-12T01:04:15.388492+0000","last_became_peered":"2024-09-12T01:04:15.388492+0000","last_unstale":"2024-09-12T01:35:31.547532+0000","last_undegraded":"2024-09-12T01:35:31.547532+0000","last_fullsized":"2024-09-12T01:35:31.547532+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:40.040155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:16.554539+0000","last_change":"2024-09-12T00:46:26.369312+0000","last_active":"2024-09-12T01:36:16.554539+0000","last_peered":"2024-09-12T01:36:16.554539+0000","last_clean":"2024-09-12T01:36:16.554539+0000","last_became_active":"2024-09-12T00:46:26.369004+0000","last_became_peered":"2024-09-12T00:46:26.369004+0000","last_unstale":"2024-09-12T01:36:16.554539+0000","last_undegraded":"2024-09-12T01:36:16.554539+0000","last_fullsized":"2024-09-12T01:36:16.554539+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.739916+0000","last_change":"2024-09-12T00:46:22.354042+0000","last_active":"2024-09-12T01:36:11.739916+0000","last_peered":"2024-09-12T01:36:11.739916+0000","last_clean":"2024-09-12T01:36:11.739916+0000","last_became_active":"2024-09-12T00:46:22.353747+0000","last_became_peered":"2024-09-12T00:46:22.353747+0000","last_unstale":"2024-09-12T01:36:11.739916+0000","last_undegraded":"2024-09-12T01:36:11.739916+0000","last_fullsized":"2024-09-12T01:36:11.739916+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"263'8","reported_seq":88,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.810686+0000","last_change":"2024-09-12T01:38:38.810686+0000","last_active":"2024-09-12T01:38:38.810686+0000","last_peered":"2024-09-12T01:38:38.810686+0000","last_clean":"2024-09-12T01:38:38.810686+0000","last_became_active":"2024-09-12T00:42:36.808945+0000","last_became_peered":"2024-09-12T00:42:36.808945+0000","last_unstale":"2024-09-12T01:38:38.810686+0000","last_undegraded":"2024-09-12T01:38:38.810686+0000","last_fullsized":"2024-09-12T01:38:38.810686+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-09-12T01:38:38.810584+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-09-12T01:38:38.810584+0000","last_clean_scrub_stamp":"2024-09-12T01:38:38.810584+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:00.252953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":23,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"263'2","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:34.710350+0000","last_change":"2024-09-12T01:38:34.710350+0000","last_active":"2024-09-12T01:38:34.710350+0000","last_peered":"2024-09-12T01:38:34.710350+0000","last_clean":"2024-09-12T01:38:34.710350+0000","last_became_active":"2024-09-12T01:04:15.395223+0000","last_became_peered":"2024-09-12T01:04:15.395223+0000","last_unstale":"2024-09-12T01:38:34.710350+0000","last_undegraded":"2024-09-12T01:38:34.710350+0000","last_fullsized":"2024-09-12T01:38:34.710350+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:38:34.710261+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:38:34.710261+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.710261+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:41.338981+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"260'2","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:41.788668+0000","last_change":"2024-09-12T01:38:41.788668+0000","last_active":"2024-09-12T01:38:41.788668+0000","last_peered":"2024-09-12T01:38:41.788668+0000","last_clean":"2024-09-12T01:38:41.788668+0000","last_became_active":"2024-09-12T00:46:26.367039+0000","last_became_peered":"2024-09-12T00:46:26.367039+0000","last_unstale":"2024-09-12T01:38:41.788668+0000","last_undegraded":"2024-09-12T01:38:41.788668+0000","last_fullsized":"2024-09-12T01:38:41.788668+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-12T01:38:41.788567+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-12T01:38:41.788567+0000","last_clean_scrub_stamp":"2024-09-12T01:38:41.788567+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:57.210450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"263'2","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.748754+0000","last_change":"2024-09-12T00:46:22.350076+0000","last_active":"2024-09-12T01:38:00.748754+0000","last_peered":"2024-09-12T01:38:00.748754+0000","last_clean":"2024-09-12T01:38:00.748754+0000","last_became_active":"2024-09-12T00:46:22.349779+0000","last_became_peered":"2024-09-12T00:46:22.349779+0000","last_unstale":"2024-09-12T01:38:00.748754+0000","last_undegraded":"2024-09-12T01:38:00.748754+0000","last_fullsized":"2024-09-12T01:38:00.748754+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":5,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"263'23","reported_seq":123,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:42.787235+0000","last_change":"2024-09-12T00:42:36.811265+0000","last_active":"2024-09-12T01:34:42.787235+0000","last_peered":"2024-09-12T01:34:42.787235+0000","last_clean":"2024-09-12T01:34:42.787235+0000","last_became_active":"2024-09-12T00:42:36.810979+0000","last_became_peered":"2024-09-12T00:42:36.810979+0000","last_unstale":"2024-09-12T01:34:42.787235+0000","last_undegraded":"2024-09-12T01:34:42.787235+0000","last_fullsized":"2024-09-12T01:34:42.787235+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:42:35.789463+0000","last_clean_scrub_stamp":"2024-09-12T00:42:35.789463+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:56.532046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":82,"num_write":51,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:34:36.788829+0000","last_change":"2024-09-12T01:04:15.388624+0000","last_active":"2024-09-12T01:34:36.788829+0000","last_peered":"2024-09-12T01:34:36.788829+0000","last_clean":"2024-09-12T01:34:36.788829+0000","last_became_active":"2024-09-12T01:04:15.388331+0000","last_became_peered":"2024-09-12T01:04:15.388331+0000","last_unstale":"2024-09-12T01:34:36.788829+0000","last_undegraded":"2024-09-12T01:34:36.788829+0000","last_fullsized":"2024-09-12T01:34:36.788829+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:07.975645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"260'5","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:32.803080+0000","last_change":"2024-09-12T00:46:26.370948+0000","last_active":"2024-09-12T01:36:32.803080+0000","last_peered":"2024-09-12T01:36:32.803080+0000","last_clean":"2024-09-12T01:36:32.803080+0000","last_became_active":"2024-09-12T00:46:26.370448+0000","last_became_peered":"2024-09-12T00:46:26.370448+0000","last_unstale":"2024-09-12T01:36:32.803080+0000","last_undegraded":"2024-09-12T01:36:32.803080+0000","last_fullsized":"2024-09-12T01:36:32.803080+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"263'2","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.934255+0000","last_change":"2024-09-12T00:46:22.354072+0000","last_active":"2024-09-12T01:38:00.934255+0000","last_peered":"2024-09-12T01:38:00.934255+0000","last_clean":"2024-09-12T01:38:00.934255+0000","last_became_active":"2024-09-12T00:46:22.353796+0000","last_became_peered":"2024-09-12T00:46:22.353796+0000","last_unstale":"2024-09-12T01:38:00.934255+0000","last_undegraded":"2024-09-12T01:38:00.934255+0000","last_fullsized":"2024-09-12T01:38:00.934255+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:21.323186+0000","last_clean_scrub_stamp":"2024-09-12T00:46:21.323186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"263'41","reported_seq":182,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:43.525109+0000","last_change":"2024-09-12T01:38:43.525109+0000","last_active":"2024-09-12T01:38:43.525109+0000","last_peered":"2024-09-12T01:38:43.525109+0000","last_clean":"2024-09-12T01:38:43.525109+0000","last_became_active":"2024-09-12T00:42:36.814700+0000","last_became_peered":"2024-09-12T00:42:36.814700+0000","last_unstale":"2024-09-12T01:38:43.525109+0000","last_undegraded":"2024-09-12T01:38:43.525109+0000","last_fullsized":"2024-09-12T01:38:43.525109+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'41","last_scrub_stamp":"2024-09-12T01:38:43.524993+0000","last_deep_scrub":"263'41","last_deep_scrub_stamp":"2024-09-12T01:38:43.524993+0000","last_clean_scrub_stamp":"2024-09-12T01:38:43.524993+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:49.722364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":150,"num_write":75,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:31.795233+0000","last_change":"2024-09-12T01:04:15.393354+0000","last_active":"2024-09-12T01:35:31.795233+0000","last_peered":"2024-09-12T01:35:31.795233+0000","last_clean":"2024-09-12T01:35:31.795233+0000","last_became_active":"2024-09-12T01:04:15.392129+0000","last_became_peered":"2024-09-12T01:04:15.392129+0000","last_unstale":"2024-09-12T01:35:31.795233+0000","last_undegraded":"2024-09-12T01:35:31.795233+0000","last_fullsized":"2024-09-12T01:35:31.795233+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:07.333078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:42.911406+0000","last_change":"2024-09-12T01:38:42.911406+0000","last_active":"2024-09-12T01:38:42.911406+0000","last_peered":"2024-09-12T01:38:42.911406+0000","last_clean":"2024-09-12T01:38:42.911406+0000","last_became_active":"2024-09-12T00:46:26.374630+0000","last_became_peered":"2024-09-12T00:46:26.374630+0000","last_unstale":"2024-09-12T01:38:42.911406+0000","last_undegraded":"2024-09-12T01:38:42.911406+0000","last_fullsized":"2024-09-12T01:38:42.911406+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:42.911317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:42.911317+0000","last_clean_scrub_stamp":"2024-09-12T01:38:42.911317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:58.726469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.857392+0000","last_change":"2024-09-12T01:38:37.857392+0000","last_active":"2024-09-12T01:38:37.857392+0000","last_peered":"2024-09-12T01:38:37.857392+0000","last_clean":"2024-09-12T01:38:37.857392+0000","last_became_active":"2024-09-12T00:46:22.345455+0000","last_became_peered":"2024-09-12T00:46:22.345455+0000","last_unstale":"2024-09-12T01:38:37.857392+0000","last_undegraded":"2024-09-12T01:38:37.857392+0000","last_fullsized":"2024-09-12T01:38:37.857392+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:37.857311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:37.857311+0000","last_clean_scrub_stamp":"2024-09-12T01:38:37.857311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:52.326364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"263'47","reported_seq":193,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:32.141105+0000","last_change":"2024-09-12T01:38:32.141105+0000","last_active":"2024-09-12T01:38:32.141105+0000","last_peered":"2024-09-12T01:38:32.141105+0000","last_clean":"2024-09-12T01:38:32.141105+0000","last_became_active":"2024-09-12T00:42:36.810179+0000","last_became_peered":"2024-09-12T00:42:36.810179+0000","last_unstale":"2024-09-12T01:38:32.141105+0000","last_undegraded":"2024-09-12T01:38:32.141105+0000","last_fullsized":"2024-09-12T01:38:32.141105+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'47","last_scrub_stamp":"2024-09-12T01:38:32.141020+0000","last_deep_scrub":"263'47","last_deep_scrub_stamp":"2024-09-12T01:38:32.141020+0000","last_clean_scrub_stamp":"2024-09-12T01:38:32.141020+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:59.367091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":235,"num_read_kb":167,"num_write":78,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:41.735210+0000","last_change":"2024-09-12T01:04:15.393713+0000","last_active":"2024-09-12T01:35:41.735210+0000","last_peered":"2024-09-12T01:35:41.735210+0000","last_clean":"2024-09-12T01:35:41.735210+0000","last_became_active":"2024-09-12T01:04:15.393424+0000","last_became_peered":"2024-09-12T01:04:15.393424+0000","last_unstale":"2024-09-12T01:35:41.735210+0000","last_undegraded":"2024-09-12T01:35:41.735210+0000","last_fullsized":"2024-09-12T01:35:41.735210+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:46.950196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"260'6","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:26.555897+0000","last_change":"2024-09-12T00:46:26.372459+0000","last_active":"2024-09-12T01:36:26.555897+0000","last_peered":"2024-09-12T01:36:26.555897+0000","last_clean":"2024-09-12T01:36:26.555897+0000","last_became_active":"2024-09-12T00:46:26.372169+0000","last_became_peered":"2024-09-12T00:46:26.372169+0000","last_unstale":"2024-09-12T01:36:26.555897+0000","last_undegraded":"2024-09-12T01:36:26.555897+0000","last_fullsized":"2024-09-12T01:36:26.555897+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:25.348498+0000","last_clean_scrub_stamp":"2024-09-12T00:46:25.348498+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"263'5","reported_seq":70,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:39.986423+0000","last_change":"2024-09-12T01:38:39.986423+0000","last_active":"2024-09-12T01:38:39.986423+0000","last_peered":"2024-09-12T01:38:39.986423+0000","last_clean":"2024-09-12T01:38:39.986423+0000","last_became_active":"2024-09-12T00:46:22.350210+0000","last_became_peered":"2024-09-12T00:46:22.350210+0000","last_unstale":"2024-09-12T01:38:39.986423+0000","last_undegraded":"2024-09-12T01:38:39.986423+0000","last_fullsized":"2024-09-12T01:38:39.986423+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-12T01:38:39.986327+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-12T01:38:39.986327+0000","last_clean_scrub_stamp":"2024-09-12T01:38:39.986327+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:49.996979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4096,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"260'15","reported_seq":110,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:44.655323+0000","last_change":"2024-09-12T01:38:44.655323+0000","last_active":"2024-09-12T01:38:44.655323+0000","last_peered":"2024-09-12T01:38:44.655323+0000","last_clean":"2024-09-12T01:38:44.655323+0000","last_became_active":"2024-09-12T00:42:36.810110+0000","last_became_peered":"2024-09-12T00:42:36.810110+0000","last_unstale":"2024-09-12T01:38:44.655323+0000","last_undegraded":"2024-09-12T01:38:44.655323+0000","last_fullsized":"2024-09-12T01:38:44.655323+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'15","last_scrub_stamp":"2024-09-12T01:38:44.655235+0000","last_deep_scrub":"260'15","last_deep_scrub_stamp":"2024-09-12T01:38:44.655235+0000","last_clean_scrub_stamp":"2024-09-12T01:38:44.655235+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:33.265203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":54,"num_write":27,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"263'304","reported_seq":921,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:24.416620+0000","last_change":"2024-09-12T01:38:24.416620+0000","last_active":"2024-09-12T01:38:24.416620+0000","last_peered":"2024-09-12T01:38:24.416620+0000","last_clean":"2024-09-12T01:38:24.416620+0000","last_became_active":"2024-09-12T00:28:31.201886+0000","last_became_peered":"2024-09-12T00:28:31.201886+0000","last_unstale":"2024-09-12T01:38:24.416620+0000","last_undegraded":"2024-09-12T01:38:24.416620+0000","last_fullsized":"2024-09-12T01:38:24.416620+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'304","last_scrub_stamp":"2024-09-12T01:38:24.416516+0000","last_deep_scrub":"263'304","last_deep_scrub_stamp":"2024-09-12T01:38:24.416516+0000","last_clean_scrub_stamp":"2024-09-12T01:38:24.416516+0000","objects_scrubbed":5,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:25.833677+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":380,"num_read_kb":9626,"num_write":915,"num_write_kb":19266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"263'157","reported_seq":731,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:29.446136+0000","last_change":"2024-09-12T01:38:29.446082+0000","last_active":"2024-09-12T01:38:29.446136+0000","last_peered":"2024-09-12T01:38:29.446136+0000","last_clean":"2024-09-12T01:38:29.446136+0000","last_became_active":"2024-09-12T00:28:33.211182+0000","last_became_peered":"2024-09-12T00:28:33.211182+0000","last_unstale":"2024-09-12T01:38:29.446136+0000","last_undegraded":"2024-09-12T01:38:29.446136+0000","last_fullsized":"2024-09-12T01:38:29.446136+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'157","last_scrub_stamp":"2024-09-12T01:38:29.445999+0000","last_deep_scrub":"263'157","last_deep_scrub_stamp":"2024-09-12T01:38:29.445999+0000","last_clean_scrub_stamp":"2024-09-12T01:38:29.445999+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:21.049018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":685,"num_read_kb":553,"num_write":251,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"263'303","reported_seq":1021,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.170633+0000","last_change":"2024-09-12T01:38:13.170633+0000","last_active":"2024-09-12T01:38:13.170633+0000","last_peered":"2024-09-12T01:38:13.170633+0000","last_clean":"2024-09-12T01:38:13.170633+0000","last_became_active":"2024-09-12T00:28:31.204561+0000","last_became_peered":"2024-09-12T00:28:31.204561+0000","last_unstale":"2024-09-12T01:38:13.170633+0000","last_undegraded":"2024-09-12T01:38:13.170633+0000","last_fullsized":"2024-09-12T01:38:13.170633+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'303","last_scrub_stamp":"2024-09-12T01:38:13.170492+0000","last_deep_scrub":"263'303","last_deep_scrub_stamp":"2024-09-12T01:38:13.170492+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.170492+0000","objects_scrubbed":7,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:13.390983+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243127,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":598,"num_read_kb":14276,"num_write":1032,"num_write_kb":31679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"263'59","reported_seq":628,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:26.393590+0000","last_change":"2024-09-12T01:38:26.393537+0000","last_active":"2024-09-12T01:38:26.393590+0000","last_peered":"2024-09-12T01:38:26.393590+0000","last_clean":"2024-09-12T01:38:26.393590+0000","last_became_active":"2024-09-12T00:28:33.217028+0000","last_became_peered":"2024-09-12T00:28:33.217028+0000","last_unstale":"2024-09-12T01:38:26.393590+0000","last_undegraded":"2024-09-12T01:38:26.393590+0000","last_fullsized":"2024-09-12T01:38:26.393590+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'59","last_scrub_stamp":"2024-09-12T01:38:26.393448+0000","last_deep_scrub":"263'59","last_deep_scrub_stamp":"2024-09-12T01:38:26.393448+0000","last_clean_scrub_stamp":"2024-09-12T01:38:26.393448+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:46.060664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":252,"num_read_kb":216,"num_write":87,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"263'337","reported_seq":1204,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.036839+0000","last_change":"2024-09-12T01:38:14.036839+0000","last_active":"2024-09-12T01:38:14.036839+0000","last_peered":"2024-09-12T01:38:14.036839+0000","last_clean":"2024-09-12T01:38:14.036839+0000","last_became_active":"2024-09-12T00:28:31.203351+0000","last_became_peered":"2024-09-12T00:28:31.203351+0000","last_unstale":"2024-09-12T01:38:14.036839+0000","last_undegraded":"2024-09-12T01:38:14.036839+0000","last_fullsized":"2024-09-12T01:38:14.036839+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'337","last_scrub_stamp":"2024-09-12T01:38:14.036713+0000","last_deep_scrub":"263'337","last_deep_scrub_stamp":"2024-09-12T01:38:14.036713+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.036713+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:13.619013+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306757,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":934,"num_read_kb":42793,"num_write":1132,"num_write_kb":18824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"263'429","reported_seq":1182,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:25.554886+0000","last_change":"2024-09-12T01:38:25.554814+0000","last_active":"2024-09-12T01:38:25.554886+0000","last_peered":"2024-09-12T01:38:25.554886+0000","last_clean":"2024-09-12T01:38:25.554886+0000","last_became_active":"2024-09-12T00:28:33.217215+0000","last_became_peered":"2024-09-12T00:28:33.217215+0000","last_unstale":"2024-09-12T01:38:25.554886+0000","last_undegraded":"2024-09-12T01:38:25.554886+0000","last_fullsized":"2024-09-12T01:38:25.554886+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'429","last_scrub_stamp":"2024-09-12T01:38:25.554727+0000","last_deep_scrub":"263'429","last_deep_scrub_stamp":"2024-09-12T01:38:25.554727+0000","last_clean_scrub_stamp":"2024-09-12T01:38:25.554727+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":400,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:43.252309+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2092,"num_read_kb":1758,"num_write":778,"num_write_kb":522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"263'382","reported_seq":1083,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.354051+0000","last_change":"2024-09-12T01:38:21.353995+0000","last_active":"2024-09-12T01:38:21.354051+0000","last_peered":"2024-09-12T01:38:21.354051+0000","last_clean":"2024-09-12T01:38:21.354051+0000","last_became_active":"2024-09-12T00:28:31.213595+0000","last_became_peered":"2024-09-12T00:28:31.213595+0000","last_unstale":"2024-09-12T01:38:21.354051+0000","last_undegraded":"2024-09-12T01:38:21.354051+0000","last_fullsized":"2024-09-12T01:38:21.354051+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'382","last_scrub_stamp":"2024-09-12T01:38:21.353886+0000","last_deep_scrub":"263'382","last_deep_scrub_stamp":"2024-09-12T01:38:21.353886+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.353886+0000","objects_scrubbed":6,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:32.927736+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1440418,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":629,"num_read_kb":11143,"num_write":1163,"num_write_kb":15238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"263'289","reported_seq":930,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:27.130848+0000","last_change":"2024-09-12T01:38:27.130737+0000","last_active":"2024-09-12T01:38:27.130848+0000","last_peered":"2024-09-12T01:38:27.130848+0000","last_clean":"2024-09-12T01:38:27.130848+0000","last_became_active":"2024-09-12T00:28:33.218393+0000","last_became_peered":"2024-09-12T00:28:33.218393+0000","last_unstale":"2024-09-12T01:38:27.130848+0000","last_undegraded":"2024-09-12T01:38:27.130848+0000","last_fullsized":"2024-09-12T01:38:27.130848+0000","mapping_epoch":27,"log_start":"260'200","ondisk_log_start":"260'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'289","last_scrub_stamp":"2024-09-12T01:38:27.130625+0000","last_deep_scrub":"263'289","last_deep_scrub_stamp":"2024-09-12T01:38:27.130625+0000","last_clean_scrub_stamp":"2024-09-12T01:38:27.130625+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:26.395209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1288,"num_read_kb":1088,"num_write":481,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"263'321","reported_seq":924,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.314203+0000","last_change":"2024-09-12T01:38:21.314117+0000","last_active":"2024-09-12T01:38:21.314203+0000","last_peered":"2024-09-12T01:38:21.314203+0000","last_clean":"2024-09-12T01:38:21.314203+0000","last_became_active":"2024-09-12T00:28:31.204962+0000","last_became_peered":"2024-09-12T00:28:31.204962+0000","last_unstale":"2024-09-12T01:38:21.314203+0000","last_undegraded":"2024-09-12T01:38:21.314203+0000","last_fullsized":"2024-09-12T01:38:21.314203+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'321","last_scrub_stamp":"2024-09-12T01:38:21.314001+0000","last_deep_scrub":"263'321","last_deep_scrub_stamp":"2024-09-12T01:38:21.314001+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.314001+0000","objects_scrubbed":5,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:15.820622+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170194,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":404,"num_read_kb":1209,"num_write":989,"num_write_kb":17836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"263'4176","reported_seq":4804,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.172692+0000","last_change":"2024-09-12T01:38:22.172692+0000","last_active":"2024-09-12T01:38:22.172692+0000","last_peered":"2024-09-12T01:38:22.172692+0000","last_clean":"2024-09-12T01:38:22.172692+0000","last_became_active":"2024-09-12T00:28:33.214515+0000","last_became_peered":"2024-09-12T00:28:33.214515+0000","last_unstale":"2024-09-12T01:38:22.172692+0000","last_undegraded":"2024-09-12T01:38:22.172692+0000","last_fullsized":"2024-09-12T01:38:22.172692+0000","mapping_epoch":27,"log_start":"263'4100","ondisk_log_start":"263'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4176","last_scrub_stamp":"2024-09-12T01:38:22.172610+0000","last_deep_scrub":"263'4176","last_deep_scrub_stamp":"2024-09-12T01:38:22.172610+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.172610+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":3000,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:13.652374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16813,"num_read_kb":14096,"num_write":6273,"num_write_kb":3125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"263'405","reported_seq":1061,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:23.354662+0000","last_change":"2024-09-12T01:38:23.354602+0000","last_active":"2024-09-12T01:38:23.354662+0000","last_peered":"2024-09-12T01:38:23.354662+0000","last_clean":"2024-09-12T01:38:23.354662+0000","last_became_active":"2024-09-12T00:28:31.212573+0000","last_became_peered":"2024-09-12T00:28:31.212573+0000","last_unstale":"2024-09-12T01:38:23.354662+0000","last_undegraded":"2024-09-12T01:38:23.354662+0000","last_fullsized":"2024-09-12T01:38:23.354662+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'405","last_scrub_stamp":"2024-09-12T01:38:23.354510+0000","last_deep_scrub":"263'405","last_deep_scrub_stamp":"2024-09-12T01:38:23.354510+0000","last_clean_scrub_stamp":"2024-09-12T01:38:23.354510+0000","objects_scrubbed":7,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:30.422460+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568635,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":601,"num_read_kb":12450,"num_write":1255,"num_write_kb":24719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"263'260","reported_seq":978,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:27.532758+0000","last_change":"2024-09-12T01:38:27.532758+0000","last_active":"2024-09-12T01:38:27.532758+0000","last_peered":"2024-09-12T01:38:27.532758+0000","last_clean":"2024-09-12T01:38:27.532758+0000","last_became_active":"2024-09-12T00:28:33.213014+0000","last_became_peered":"2024-09-12T00:28:33.213014+0000","last_unstale":"2024-09-12T01:38:27.532758+0000","last_undegraded":"2024-09-12T01:38:27.532758+0000","last_fullsized":"2024-09-12T01:38:27.532758+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'260","last_scrub_stamp":"2024-09-12T01:38:27.532674+0000","last_deep_scrub":"263'260","last_deep_scrub_stamp":"2024-09-12T01:38:27.532674+0000","last_clean_scrub_stamp":"2024-09-12T01:38:27.532674+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:43.720342+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1431,"num_read_kb":1278,"num_write":426,"num_write_kb":225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"263'323","reported_seq":967,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.283757+0000","last_change":"2024-09-12T01:38:20.283699+0000","last_active":"2024-09-12T01:38:20.283757+0000","last_peered":"2024-09-12T01:38:20.283757+0000","last_clean":"2024-09-12T01:38:20.283757+0000","last_became_active":"2024-09-12T00:28:31.210039+0000","last_became_peered":"2024-09-12T00:28:31.210039+0000","last_unstale":"2024-09-12T01:38:20.283757+0000","last_undegraded":"2024-09-12T01:38:20.283757+0000","last_fullsized":"2024-09-12T01:38:20.283757+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'323","last_scrub_stamp":"2024-09-12T01:38:20.283603+0000","last_deep_scrub":"263'323","last_deep_scrub_stamp":"2024-09-12T01:38:20.283603+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.283603+0000","objects_scrubbed":5,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:00.352419+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262189,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":473,"num_read_kb":7448,"num_write":1018,"num_write_kb":42696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"263'277","reported_seq":971,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:31.487376+0000","last_change":"2024-09-12T01:38:31.487376+0000","last_active":"2024-09-12T01:38:31.487376+0000","last_peered":"2024-09-12T01:38:31.487376+0000","last_clean":"2024-09-12T01:38:31.487376+0000","last_became_active":"2024-09-12T00:28:33.216856+0000","last_became_peered":"2024-09-12T00:28:33.216856+0000","last_unstale":"2024-09-12T01:38:31.487376+0000","last_undegraded":"2024-09-12T01:38:31.487376+0000","last_fullsized":"2024-09-12T01:38:31.487376+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'277","last_scrub_stamp":"2024-09-12T01:38:31.487279+0000","last_deep_scrub":"263'277","last_deep_scrub_stamp":"2024-09-12T01:38:31.487279+0000","last_clean_scrub_stamp":"2024-09-12T01:38:31.487279+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:27.388441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1252,"num_read_kb":1029,"num_write":416,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"263'323","reported_seq":943,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:25.274505+0000","last_change":"2024-09-12T01:38:25.274440+0000","last_active":"2024-09-12T01:38:25.274505+0000","last_peered":"2024-09-12T01:38:25.274505+0000","last_clean":"2024-09-12T01:38:25.274505+0000","last_became_active":"2024-09-12T00:28:31.213172+0000","last_became_peered":"2024-09-12T00:28:31.213172+0000","last_unstale":"2024-09-12T01:38:25.274505+0000","last_undegraded":"2024-09-12T01:38:25.274505+0000","last_fullsized":"2024-09-12T01:38:25.274505+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'323","last_scrub_stamp":"2024-09-12T01:38:25.274349+0000","last_deep_scrub":"263'323","last_deep_scrub_stamp":"2024-09-12T01:38:25.274349+0000","last_clean_scrub_stamp":"2024-09-12T01:38:25.274349+0000","objects_scrubbed":5,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:20.497013+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1657979,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":448,"num_read_kb":13792,"num_write":975,"num_write_kb":26598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"263'108","reported_seq":726,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.719896+0000","last_change":"2024-09-12T01:38:15.719896+0000","last_active":"2024-09-12T01:38:15.719896+0000","last_peered":"2024-09-12T01:38:15.719896+0000","last_clean":"2024-09-12T01:38:15.719896+0000","last_became_active":"2024-09-12T00:28:33.206296+0000","last_became_peered":"2024-09-12T00:28:33.206296+0000","last_unstale":"2024-09-12T01:38:15.719896+0000","last_undegraded":"2024-09-12T01:38:15.719896+0000","last_fullsized":"2024-09-12T01:38:15.719896+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'108","last_scrub_stamp":"2024-09-12T01:38:15.719809+0000","last_deep_scrub":"263'108","last_deep_scrub_stamp":"2024-09-12T01:38:15.719809+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.719809+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:07.737417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":463,"num_read_kb":402,"num_write":161,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"263'4150","reported_seq":4764,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:24.517906+0000","last_change":"2024-09-12T01:38:24.517843+0000","last_active":"2024-09-12T01:38:24.517906+0000","last_peered":"2024-09-12T01:38:24.517906+0000","last_clean":"2024-09-12T01:38:24.517906+0000","last_became_active":"2024-09-12T00:28:33.213777+0000","last_became_peered":"2024-09-12T00:28:33.213777+0000","last_unstale":"2024-09-12T01:38:24.517906+0000","last_undegraded":"2024-09-12T01:38:24.517906+0000","last_fullsized":"2024-09-12T01:38:24.517906+0000","mapping_epoch":27,"log_start":"263'4100","ondisk_log_start":"263'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4150","last_scrub_stamp":"2024-09-12T01:38:24.517726+0000","last_deep_scrub":"263'4150","last_deep_scrub_stamp":"2024-09-12T01:38:24.517726+0000","last_clean_scrub_stamp":"2024-09-12T01:38:24.517726+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":3000,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:14.431730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16687,"num_read_kb":13992,"num_write":6250,"num_write_kb":3125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"263'389","reported_seq":1025,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.696924+0000","last_change":"2024-09-12T01:38:12.696924+0000","last_active":"2024-09-12T01:38:12.696924+0000","last_peered":"2024-09-12T01:38:12.696924+0000","last_clean":"2024-09-12T01:38:12.696924+0000","last_became_active":"2024-09-12T00:29:04.274377+0000","last_became_peered":"2024-09-12T00:29:04.274377+0000","last_unstale":"2024-09-12T01:38:12.696924+0000","last_undegraded":"2024-09-12T01:38:12.696924+0000","last_fullsized":"2024-09-12T01:38:12.696924+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'389","last_scrub_stamp":"2024-09-12T01:38:12.696814+0000","last_deep_scrub":"263'389","last_deep_scrub_stamp":"2024-09-12T01:38:12.696814+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.696814+0000","objects_scrubbed":6,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:54.981263+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568865,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":569,"num_read_kb":2856,"num_write":1189,"num_write_kb":27657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"263'295","reported_seq":944,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:25.405722+0000","last_change":"2024-09-12T01:38:25.405638+0000","last_active":"2024-09-12T01:38:25.405722+0000","last_peered":"2024-09-12T01:38:25.405722+0000","last_clean":"2024-09-12T01:38:25.405722+0000","last_became_active":"2024-09-12T00:28:33.218660+0000","last_became_peered":"2024-09-12T00:28:33.218660+0000","last_unstale":"2024-09-12T01:38:25.405722+0000","last_undegraded":"2024-09-12T01:38:25.405722+0000","last_fullsized":"2024-09-12T01:38:25.405722+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'295","last_scrub_stamp":"2024-09-12T01:38:25.405555+0000","last_deep_scrub":"263'295","last_deep_scrub_stamp":"2024-09-12T01:38:25.405555+0000","last_clean_scrub_stamp":"2024-09-12T01:38:25.405555+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:09.677150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1306,"num_read_kb":1072,"num_write":479,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"263'371","reported_seq":1043,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.100624+0000","last_change":"2024-09-12T01:38:16.100566+0000","last_active":"2024-09-12T01:38:16.100624+0000","last_peered":"2024-09-12T01:38:16.100624+0000","last_clean":"2024-09-12T01:38:16.100624+0000","last_became_active":"2024-09-12T00:28:31.213388+0000","last_became_peered":"2024-09-12T00:28:31.213388+0000","last_unstale":"2024-09-12T01:38:16.100624+0000","last_undegraded":"2024-09-12T01:38:16.100624+0000","last_fullsized":"2024-09-12T01:38:16.100624+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'371","last_scrub_stamp":"2024-09-12T01:38:16.100452+0000","last_deep_scrub":"263'371","last_deep_scrub_stamp":"2024-09-12T01:38:16.100452+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.100452+0000","objects_scrubbed":7,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:47.142311+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133695,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":588,"num_read_kb":20058,"num_write":1150,"num_write_kb":40619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"263'90","reported_seq":682,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:27.422220+0000","last_change":"2024-09-12T01:38:27.422148+0000","last_active":"2024-09-12T01:38:27.422220+0000","last_peered":"2024-09-12T01:38:27.422220+0000","last_clean":"2024-09-12T01:38:27.422220+0000","last_became_active":"2024-09-12T00:28:33.213998+0000","last_became_peered":"2024-09-12T00:28:33.213998+0000","last_unstale":"2024-09-12T01:38:27.422220+0000","last_undegraded":"2024-09-12T01:38:27.422220+0000","last_fullsized":"2024-09-12T01:38:27.422220+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'90","last_scrub_stamp":"2024-09-12T01:38:27.422064+0000","last_deep_scrub":"263'90","last_deep_scrub_stamp":"2024-09-12T01:38:27.422064+0000","last_clean_scrub_stamp":"2024-09-12T01:38:27.422064+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:02.338451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":414,"num_read_kb":350,"num_write":126,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"263'353","reported_seq":1074,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.108312+0000","last_change":"2024-09-12T01:38:14.108241+0000","last_active":"2024-09-12T01:38:14.108312+0000","last_peered":"2024-09-12T01:38:14.108312+0000","last_clean":"2024-09-12T01:38:14.108312+0000","last_became_active":"2024-09-12T00:28:31.215230+0000","last_became_peered":"2024-09-12T00:28:31.215230+0000","last_unstale":"2024-09-12T01:38:14.108312+0000","last_undegraded":"2024-09-12T01:38:14.108312+0000","last_fullsized":"2024-09-12T01:38:14.108312+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'353","last_scrub_stamp":"2024-09-12T01:38:14.108148+0000","last_deep_scrub":"263'353","last_deep_scrub_stamp":"2024-09-12T01:38:14.108148+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.108148+0000","objects_scrubbed":4,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:21.237357+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254836,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":624,"num_read_kb":115792,"num_write":1091,"num_write_kb":22723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"263'230","reported_seq":861,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.728050+0000","last_change":"2024-09-12T01:38:14.727989+0000","last_active":"2024-09-12T01:38:14.728050+0000","last_peered":"2024-09-12T01:38:14.728050+0000","last_clean":"2024-09-12T01:38:14.728050+0000","last_became_active":"2024-09-12T00:28:33.206305+0000","last_became_peered":"2024-09-12T00:28:33.206305+0000","last_unstale":"2024-09-12T01:38:14.728050+0000","last_undegraded":"2024-09-12T01:38:14.728050+0000","last_fullsized":"2024-09-12T01:38:14.728050+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'230","last_scrub_stamp":"2024-09-12T01:38:14.727900+0000","last_deep_scrub":"263'230","last_deep_scrub_stamp":"2024-09-12T01:38:14.727900+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.727900+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:41.691362+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":971,"num_read_kb":790,"num_write":344,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"263'421","reported_seq":1159,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.506189+0000","last_change":"2024-09-12T01:38:10.506130+0000","last_active":"2024-09-12T01:38:10.506189+0000","last_peered":"2024-09-12T01:38:10.506189+0000","last_clean":"2024-09-12T01:38:10.506189+0000","last_became_active":"2024-09-12T00:28:31.199779+0000","last_became_peered":"2024-09-12T00:28:31.199779+0000","last_unstale":"2024-09-12T01:38:10.506189+0000","last_undegraded":"2024-09-12T01:38:10.506189+0000","last_fullsized":"2024-09-12T01:38:10.506189+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'421","last_scrub_stamp":"2024-09-12T01:38:10.506027+0000","last_deep_scrub":"263'421","last_deep_scrub_stamp":"2024-09-12T01:38:10.506027+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.506027+0000","objects_scrubbed":8,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:11.152787+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306267,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":669,"num_read_kb":69035,"num_write":1318,"num_write_kb":57878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"263'150","reported_seq":809,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:23.751685+0000","last_change":"2024-09-12T01:38:23.751611+0000","last_active":"2024-09-12T01:38:23.751685+0000","last_peered":"2024-09-12T01:38:23.751685+0000","last_clean":"2024-09-12T01:38:23.751685+0000","last_became_active":"2024-09-12T00:28:33.208831+0000","last_became_peered":"2024-09-12T00:28:33.208831+0000","last_unstale":"2024-09-12T01:38:23.751685+0000","last_undegraded":"2024-09-12T01:38:23.751685+0000","last_fullsized":"2024-09-12T01:38:23.751685+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'150","last_scrub_stamp":"2024-09-12T01:38:23.751512+0000","last_deep_scrub":"263'150","last_deep_scrub_stamp":"2024-09-12T01:38:23.751512+0000","last_clean_scrub_stamp":"2024-09-12T01:38:23.751512+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:11.911885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":710,"num_read_kb":600,"num_write":211,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"263'405","reported_seq":1060,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.205299+0000","last_change":"2024-09-12T01:38:14.205241+0000","last_active":"2024-09-12T01:38:14.205299+0000","last_peered":"2024-09-12T01:38:14.205299+0000","last_clean":"2024-09-12T01:38:14.205299+0000","last_became_active":"2024-09-12T00:28:31.202245+0000","last_became_peered":"2024-09-12T00:28:31.202245+0000","last_unstale":"2024-09-12T01:38:14.205299+0000","last_undegraded":"2024-09-12T01:38:14.205299+0000","last_fullsized":"2024-09-12T01:38:14.205299+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'405","last_scrub_stamp":"2024-09-12T01:38:14.205130+0000","last_deep_scrub":"263'405","last_deep_scrub_stamp":"2024-09-12T01:38:14.205130+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.205130+0000","objects_scrubbed":8,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:57.720032+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":558,"num_read_kb":23094,"num_write":1344,"num_write_kb":58944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"263'113","reported_seq":728,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:26.561584+0000","last_change":"2024-09-12T01:38:26.561527+0000","last_active":"2024-09-12T01:38:26.561584+0000","last_peered":"2024-09-12T01:38:26.561584+0000","last_clean":"2024-09-12T01:38:26.561584+0000","last_became_active":"2024-09-12T00:28:33.207527+0000","last_became_peered":"2024-09-12T00:28:33.207527+0000","last_unstale":"2024-09-12T01:38:26.561584+0000","last_undegraded":"2024-09-12T01:38:26.561584+0000","last_fullsized":"2024-09-12T01:38:26.561584+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'113","last_scrub_stamp":"2024-09-12T01:38:26.561433+0000","last_deep_scrub":"263'113","last_deep_scrub_stamp":"2024-09-12T01:38:26.561433+0000","last_clean_scrub_stamp":"2024-09-12T01:38:26.561433+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:15.140885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":515,"num_read_kb":438,"num_write":174,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"263'316","reported_seq":984,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.078959+0000","last_change":"2024-09-12T01:38:11.078901+0000","last_active":"2024-09-12T01:38:11.078959+0000","last_peered":"2024-09-12T01:38:11.078959+0000","last_clean":"2024-09-12T01:38:11.078959+0000","last_became_active":"2024-09-12T00:28:31.203048+0000","last_became_peered":"2024-09-12T00:28:31.203048+0000","last_unstale":"2024-09-12T01:38:11.078959+0000","last_undegraded":"2024-09-12T01:38:11.078959+0000","last_fullsized":"2024-09-12T01:38:11.078959+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'316","last_scrub_stamp":"2024-09-12T01:38:11.078811+0000","last_deep_scrub":"263'316","last_deep_scrub_stamp":"2024-09-12T01:38:11.078811+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.078811+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:13.632696+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524344,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":495,"num_read_kb":45596,"num_write":1045,"num_write_kb":35489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"263'107","reported_seq":627,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:42.551999+0000","last_change":"2024-09-12T01:38:42.551940+0000","last_active":"2024-09-12T01:38:42.551999+0000","last_peered":"2024-09-12T01:38:42.551999+0000","last_clean":"2024-09-12T01:38:42.551999+0000","last_became_active":"2024-09-12T00:28:41.226952+0000","last_became_peered":"2024-09-12T00:28:41.226952+0000","last_unstale":"2024-09-12T01:38:42.551999+0000","last_undegraded":"2024-09-12T01:38:42.551999+0000","last_fullsized":"2024-09-12T01:38:42.551999+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'107","last_scrub_stamp":"2024-09-12T01:38:42.551847+0000","last_deep_scrub":"263'107","last_deep_scrub_stamp":"2024-09-12T01:38:42.551847+0000","last_clean_scrub_stamp":"2024-09-12T01:38:42.551847+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:11.526139+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":155,"num_read_kb":144,"num_write":259,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"263'188","reported_seq":781,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.217150+0000","last_change":"2024-09-12T01:38:17.217081+0000","last_active":"2024-09-12T01:38:17.217150+0000","last_peered":"2024-09-12T01:38:17.217150+0000","last_clean":"2024-09-12T01:38:17.217150+0000","last_became_active":"2024-09-12T00:28:33.209521+0000","last_became_peered":"2024-09-12T00:28:33.209521+0000","last_unstale":"2024-09-12T01:38:17.217150+0000","last_undegraded":"2024-09-12T01:38:17.217150+0000","last_fullsized":"2024-09-12T01:38:17.217150+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'188","last_scrub_stamp":"2024-09-12T01:38:17.216936+0000","last_deep_scrub":"263'188","last_deep_scrub_stamp":"2024-09-12T01:38:17.216936+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.216936+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:48.308382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":834,"num_read_kb":672,"num_write":307,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"263'362","reported_seq":975,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.290301+0000","last_change":"2024-09-12T01:38:17.290235+0000","last_active":"2024-09-12T01:38:17.290301+0000","last_peered":"2024-09-12T01:38:17.290301+0000","last_clean":"2024-09-12T01:38:17.290301+0000","last_became_active":"2024-09-12T00:28:31.206010+0000","last_became_peered":"2024-09-12T00:28:31.206010+0000","last_unstale":"2024-09-12T01:38:17.290301+0000","last_undegraded":"2024-09-12T01:38:17.290301+0000","last_fullsized":"2024-09-12T01:38:17.290301+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'362","last_scrub_stamp":"2024-09-12T01:38:17.290125+0000","last_deep_scrub":"263'362","last_deep_scrub_stamp":"2024-09-12T01:38:17.290125+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.290125+0000","objects_scrubbed":9,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:31.994331+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":430,"num_read_kb":5592,"num_write":1103,"num_write_kb":25256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:33.423195+0000","last_change":"2024-09-12T01:38:33.423142+0000","last_active":"2024-09-12T01:38:33.423195+0000","last_peered":"2024-09-12T01:38:33.423195+0000","last_clean":"2024-09-12T01:38:33.423195+0000","last_became_active":"2024-09-12T00:28:35.211231+0000","last_became_peered":"2024-09-12T00:28:35.211231+0000","last_unstale":"2024-09-12T01:38:33.423195+0000","last_undegraded":"2024-09-12T01:38:33.423195+0000","last_fullsized":"2024-09-12T01:38:33.423195+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:33.423061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:33.423061+0000","last_clean_scrub_stamp":"2024-09-12T01:38:33.423061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:40.341124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"263'353","reported_seq":984,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:28.171439+0000","last_change":"2024-09-12T01:38:28.171380+0000","last_active":"2024-09-12T01:38:28.171439+0000","last_peered":"2024-09-12T01:38:28.171439+0000","last_clean":"2024-09-12T01:38:28.171439+0000","last_became_active":"2024-09-12T00:28:37.216169+0000","last_became_peered":"2024-09-12T00:28:37.216169+0000","last_unstale":"2024-09-12T01:38:28.171439+0000","last_undegraded":"2024-09-12T01:38:28.171439+0000","last_fullsized":"2024-09-12T01:38:28.171439+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'353","last_scrub_stamp":"2024-09-12T01:38:28.171291+0000","last_deep_scrub":"263'353","last_deep_scrub_stamp":"2024-09-12T01:38:28.171291+0000","last_clean_scrub_stamp":"2024-09-12T01:38:28.171291+0000","objects_scrubbed":6,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:51.037865+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44362,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":554,"num_read_kb":1122,"num_write":430,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:40.525916+0000","last_change":"2024-09-12T01:38:40.525854+0000","last_active":"2024-09-12T01:38:40.525916+0000","last_peered":"2024-09-12T01:38:40.525916+0000","last_clean":"2024-09-12T01:38:40.525916+0000","last_became_active":"2024-09-12T00:28:39.213942+0000","last_became_peered":"2024-09-12T00:28:39.213942+0000","last_unstale":"2024-09-12T01:38:40.525916+0000","last_undegraded":"2024-09-12T01:38:40.525916+0000","last_fullsized":"2024-09-12T01:38:40.525916+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:40.525765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:40.525765+0000","last_clean_scrub_stamp":"2024-09-12T01:38:40.525765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:08.844675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"263'184","reported_seq":743,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:46.481799+0000","last_change":"2024-09-12T01:38:46.481799+0000","last_active":"2024-09-12T01:38:46.481799+0000","last_peered":"2024-09-12T01:38:46.481799+0000","last_clean":"2024-09-12T01:38:46.481799+0000","last_became_active":"2024-09-12T00:28:41.229608+0000","last_became_peered":"2024-09-12T00:28:41.229608+0000","last_unstale":"2024-09-12T01:38:46.481799+0000","last_undegraded":"2024-09-12T01:38:46.481799+0000","last_fullsized":"2024-09-12T01:38:46.481799+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'184","last_scrub_stamp":"2024-09-12T01:38:46.481713+0000","last_deep_scrub":"263'184","last_deep_scrub_stamp":"2024-09-12T01:38:46.481713+0000","last_clean_scrub_stamp":"2024-09-12T01:38:46.481713+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:59.539341+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":231,"num_read_kb":225,"num_write":383,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"263'212","reported_seq":822,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:24.382447+0000","last_change":"2024-09-12T01:38:24.382381+0000","last_active":"2024-09-12T01:38:24.382447+0000","last_peered":"2024-09-12T01:38:24.382447+0000","last_clean":"2024-09-12T01:38:24.382447+0000","last_became_active":"2024-09-12T00:28:33.212334+0000","last_became_peered":"2024-09-12T00:28:33.212334+0000","last_unstale":"2024-09-12T01:38:24.382447+0000","last_undegraded":"2024-09-12T01:38:24.382447+0000","last_fullsized":"2024-09-12T01:38:24.382447+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'212","last_scrub_stamp":"2024-09-12T01:38:24.382297+0000","last_deep_scrub":"263'212","last_deep_scrub_stamp":"2024-09-12T01:38:24.382297+0000","last_clean_scrub_stamp":"2024-09-12T01:38:24.382297+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:06.630505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":883,"num_read_kb":721,"num_write":311,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"263'332","reported_seq":998,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:09.077293+0000","last_change":"2024-09-12T01:38:09.077241+0000","last_active":"2024-09-12T01:38:09.077293+0000","last_peered":"2024-09-12T01:38:09.077293+0000","last_clean":"2024-09-12T01:38:09.077293+0000","last_became_active":"2024-09-12T00:28:31.208141+0000","last_became_peered":"2024-09-12T00:28:31.208141+0000","last_unstale":"2024-09-12T01:38:09.077293+0000","last_undegraded":"2024-09-12T01:38:09.077293+0000","last_fullsized":"2024-09-12T01:38:09.077293+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'332","last_scrub_stamp":"2024-09-12T01:38:09.077147+0000","last_deep_scrub":"263'332","last_deep_scrub_stamp":"2024-09-12T01:38:09.077147+0000","last_clean_scrub_stamp":"2024-09-12T01:38:09.077147+0000","objects_scrubbed":8,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:39.882962+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395868,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":543,"num_read_kb":93032,"num_write":945,"num_write_kb":55506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":509,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:31.304948+0000","last_change":"2024-09-12T01:38:31.304849+0000","last_active":"2024-09-12T01:38:31.304948+0000","last_peered":"2024-09-12T01:38:31.304948+0000","last_clean":"2024-09-12T01:38:31.304948+0000","last_became_active":"2024-09-12T00:28:35.212745+0000","last_became_peered":"2024-09-12T00:28:35.212745+0000","last_unstale":"2024-09-12T01:38:31.304948+0000","last_undegraded":"2024-09-12T01:38:31.304948+0000","last_fullsized":"2024-09-12T01:38:31.304948+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:31.304746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:31.304746+0000","last_clean_scrub_stamp":"2024-09-12T01:38:31.304746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:59.053226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"263'96","reported_seq":643,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:34.520618+0000","last_change":"2024-09-12T01:38:34.520560+0000","last_active":"2024-09-12T01:38:34.520618+0000","last_peered":"2024-09-12T01:38:34.520618+0000","last_clean":"2024-09-12T01:38:34.520618+0000","last_became_active":"2024-09-12T00:28:37.220899+0000","last_became_peered":"2024-09-12T00:28:37.220899+0000","last_unstale":"2024-09-12T01:38:34.520618+0000","last_undegraded":"2024-09-12T01:38:34.520618+0000","last_fullsized":"2024-09-12T01:38:34.520618+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'96","last_scrub_stamp":"2024-09-12T01:38:34.520466+0000","last_deep_scrub":"263'96","last_deep_scrub_stamp":"2024-09-12T01:38:34.520466+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.520466+0000","objects_scrubbed":4,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:08.295444+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":118,"num_read_kb":113,"num_write":78,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.526744+0000","last_change":"2024-09-12T01:38:38.526649+0000","last_active":"2024-09-12T01:38:38.526744+0000","last_peered":"2024-09-12T01:38:38.526744+0000","last_clean":"2024-09-12T01:38:38.526744+0000","last_became_active":"2024-09-12T00:28:39.222553+0000","last_became_peered":"2024-09-12T00:28:39.222553+0000","last_unstale":"2024-09-12T01:38:38.526744+0000","last_undegraded":"2024-09-12T01:38:38.526744+0000","last_fullsized":"2024-09-12T01:38:38.526744+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:38.526556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:38.526556+0000","last_clean_scrub_stamp":"2024-09-12T01:38:38.526556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:49.766948+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"263'130","reported_seq":644,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:44.247475+0000","last_change":"2024-09-12T01:38:44.247475+0000","last_active":"2024-09-12T01:38:44.247475+0000","last_peered":"2024-09-12T01:38:44.247475+0000","last_clean":"2024-09-12T01:38:44.247475+0000","last_became_active":"2024-09-12T00:28:41.228305+0000","last_became_peered":"2024-09-12T00:28:41.228305+0000","last_unstale":"2024-09-12T01:38:44.247475+0000","last_undegraded":"2024-09-12T01:38:44.247475+0000","last_fullsized":"2024-09-12T01:38:44.247475+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'130","last_scrub_stamp":"2024-09-12T01:38:44.247352+0000","last_deep_scrub":"263'130","last_deep_scrub_stamp":"2024-09-12T01:38:44.247352+0000","last_clean_scrub_stamp":"2024-09-12T01:38:44.247352+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:24.952391+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":144,"num_read_kb":135,"num_write":299,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"263'197","reported_seq":851,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.026792+0000","last_change":"2024-09-12T01:38:15.026708+0000","last_active":"2024-09-12T01:38:15.026792+0000","last_peered":"2024-09-12T01:38:15.026792+0000","last_clean":"2024-09-12T01:38:15.026792+0000","last_became_active":"2024-09-12T00:28:33.219082+0000","last_became_peered":"2024-09-12T00:28:33.219082+0000","last_unstale":"2024-09-12T01:38:15.026792+0000","last_undegraded":"2024-09-12T01:38:15.026792+0000","last_fullsized":"2024-09-12T01:38:15.026792+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'197","last_scrub_stamp":"2024-09-12T01:38:15.026624+0000","last_deep_scrub":"263'197","last_deep_scrub_stamp":"2024-09-12T01:38:15.026624+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.026624+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:40.437735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":923,"num_read_kb":768,"num_write":333,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"263'386","reported_seq":1022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.293546+0000","last_change":"2024-09-12T01:38:14.293459+0000","last_active":"2024-09-12T01:38:14.293546+0000","last_peered":"2024-09-12T01:38:14.293546+0000","last_clean":"2024-09-12T01:38:14.293546+0000","last_became_active":"2024-09-12T00:28:31.204223+0000","last_became_peered":"2024-09-12T00:28:31.204223+0000","last_unstale":"2024-09-12T01:38:14.293546+0000","last_undegraded":"2024-09-12T01:38:14.293546+0000","last_fullsized":"2024-09-12T01:38:14.293546+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'386","last_scrub_stamp":"2024-09-12T01:38:14.293320+0000","last_deep_scrub":"263'386","last_deep_scrub_stamp":"2024-09-12T01:38:14.293320+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.293320+0000","objects_scrubbed":10,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:55.332433+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133695,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":536,"num_read_kb":1739,"num_write":1185,"num_write_kb":22527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:30.295363+0000","last_change":"2024-09-12T01:38:30.295310+0000","last_active":"2024-09-12T01:38:30.295363+0000","last_peered":"2024-09-12T01:38:30.295363+0000","last_clean":"2024-09-12T01:38:30.295363+0000","last_became_active":"2024-09-12T00:28:35.212197+0000","last_became_peered":"2024-09-12T00:28:35.212197+0000","last_unstale":"2024-09-12T01:38:30.295363+0000","last_undegraded":"2024-09-12T01:38:30.295363+0000","last_fullsized":"2024-09-12T01:38:30.295363+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:30.295237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:30.295237+0000","last_clean_scrub_stamp":"2024-09-12T01:38:30.295237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:18.032351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"263'140","reported_seq":708,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:25.699196+0000","last_change":"2024-09-12T01:38:25.699196+0000","last_active":"2024-09-12T01:38:25.699196+0000","last_peered":"2024-09-12T01:38:25.699196+0000","last_clean":"2024-09-12T01:38:25.699196+0000","last_became_active":"2024-09-12T00:28:37.220665+0000","last_became_peered":"2024-09-12T00:28:37.220665+0000","last_unstale":"2024-09-12T01:38:25.699196+0000","last_undegraded":"2024-09-12T01:38:25.699196+0000","last_fullsized":"2024-09-12T01:38:25.699196+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'140","last_scrub_stamp":"2024-09-12T01:38:25.699105+0000","last_deep_scrub":"263'140","last_deep_scrub_stamp":"2024-09-12T01:38:25.699105+0000","last_clean_scrub_stamp":"2024-09-12T01:38:25.699105+0000","objects_scrubbed":7,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:46.861174+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":170,"num_read_kb":162,"num_write":114,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"263'769","reported_seq":4817,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:39.521315+0000","last_change":"2024-09-12T01:38:39.521249+0000","last_active":"2024-09-12T01:38:39.521315+0000","last_peered":"2024-09-12T01:38:39.521315+0000","last_clean":"2024-09-12T01:38:39.521315+0000","last_became_active":"2024-09-12T00:28:39.218476+0000","last_became_peered":"2024-09-12T00:28:39.218476+0000","last_unstale":"2024-09-12T01:38:39.521315+0000","last_undegraded":"2024-09-12T01:38:39.521315+0000","last_fullsized":"2024-09-12T01:38:39.521315+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'769","last_scrub_stamp":"2024-09-12T01:38:39.521136+0000","last_deep_scrub":"263'769","last_deep_scrub_stamp":"2024-09-12T01:38:39.521136+0000","last_clean_scrub_stamp":"2024-09-12T01:38:39.521136+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:09.943675+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"263'194","reported_seq":1026,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:45.446140+0000","last_change":"2024-09-12T01:38:45.446140+0000","last_active":"2024-09-12T01:38:45.446140+0000","last_peered":"2024-09-12T01:38:45.446140+0000","last_clean":"2024-09-12T01:38:45.446140+0000","last_became_active":"2024-09-12T00:28:41.257679+0000","last_became_peered":"2024-09-12T00:28:41.257679+0000","last_unstale":"2024-09-12T01:38:45.446140+0000","last_undegraded":"2024-09-12T01:38:45.446140+0000","last_fullsized":"2024-09-12T01:38:45.446140+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'194","last_scrub_stamp":"2024-09-12T01:38:45.446034+0000","last_deep_scrub":"263'194","last_deep_scrub_stamp":"2024-09-12T01:38:45.446034+0000","last_clean_scrub_stamp":"2024-09-12T01:38:45.446034+0000","objects_scrubbed":3,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:06.294618+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":583,"num_read_kb":580,"num_write":423,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"263'82","reported_seq":636,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.209355+0000","last_change":"2024-09-12T01:38:16.209303+0000","last_active":"2024-09-12T01:38:16.209355+0000","last_peered":"2024-09-12T01:38:16.209355+0000","last_clean":"2024-09-12T01:38:16.209355+0000","last_became_active":"2024-09-12T00:28:33.212564+0000","last_became_peered":"2024-09-12T00:28:33.212564+0000","last_unstale":"2024-09-12T01:38:16.209355+0000","last_undegraded":"2024-09-12T01:38:16.209355+0000","last_fullsized":"2024-09-12T01:38:16.209355+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'82","last_scrub_stamp":"2024-09-12T01:38:16.209203+0000","last_deep_scrub":"263'82","last_deep_scrub_stamp":"2024-09-12T01:38:16.209203+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.209203+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:28.323813+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":372,"num_read_kb":309,"num_write":130,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"263'301","reported_seq":1012,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.134517+0000","last_change":"2024-09-12T01:38:13.134452+0000","last_active":"2024-09-12T01:38:13.134517+0000","last_peered":"2024-09-12T01:38:13.134517+0000","last_clean":"2024-09-12T01:38:13.134517+0000","last_became_active":"2024-09-12T00:28:31.207938+0000","last_became_peered":"2024-09-12T00:28:31.207938+0000","last_unstale":"2024-09-12T01:38:13.134517+0000","last_undegraded":"2024-09-12T01:38:13.134517+0000","last_fullsized":"2024-09-12T01:38:13.134517+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'301","last_scrub_stamp":"2024-09-12T01:38:13.134357+0000","last_deep_scrub":"263'301","last_deep_scrub_stamp":"2024-09-12T01:38:13.134357+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.134357+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:18.383579+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174663,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":518,"num_read_kb":179847,"num_write":976,"num_write_kb":39231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:34.460167+0000","last_change":"2024-09-12T01:38:34.460106+0000","last_active":"2024-09-12T01:38:34.460167+0000","last_peered":"2024-09-12T01:38:34.460167+0000","last_clean":"2024-09-12T01:38:34.460167+0000","last_became_active":"2024-09-12T00:28:35.213178+0000","last_became_peered":"2024-09-12T00:28:35.213178+0000","last_unstale":"2024-09-12T01:38:34.460167+0000","last_undegraded":"2024-09-12T01:38:34.460167+0000","last_fullsized":"2024-09-12T01:38:34.460167+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.460009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.460009+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.460009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:42.640293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"263'263","reported_seq":850,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:34.453726+0000","last_change":"2024-09-12T01:38:34.453626+0000","last_active":"2024-09-12T01:38:34.453726+0000","last_peered":"2024-09-12T01:38:34.453726+0000","last_clean":"2024-09-12T01:38:34.453726+0000","last_became_active":"2024-09-12T00:28:37.426357+0000","last_became_peered":"2024-09-12T00:28:37.426357+0000","last_unstale":"2024-09-12T01:38:34.453726+0000","last_undegraded":"2024-09-12T01:38:34.453726+0000","last_fullsized":"2024-09-12T01:38:34.453726+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'263","last_scrub_stamp":"2024-09-12T01:38:34.453509+0000","last_deep_scrub":"263'263","last_deep_scrub_stamp":"2024-09-12T01:38:34.453509+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.453509+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:46:46.289095+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15889,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":416,"num_read_kb":929,"num_write":326,"num_write_kb":245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"263'770","reported_seq":2657,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:43.361946+0000","last_change":"2024-09-12T01:38:43.361946+0000","last_active":"2024-09-12T01:38:43.361946+0000","last_peered":"2024-09-12T01:38:43.361946+0000","last_clean":"2024-09-12T01:38:43.361946+0000","last_became_active":"2024-09-12T00:28:39.218738+0000","last_became_peered":"2024-09-12T00:28:39.218738+0000","last_unstale":"2024-09-12T01:38:43.361946+0000","last_undegraded":"2024-09-12T01:38:43.361946+0000","last_fullsized":"2024-09-12T01:38:43.361946+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'770","last_scrub_stamp":"2024-09-12T01:38:43.361835+0000","last_deep_scrub":"263'770","last_deep_scrub_stamp":"2024-09-12T01:38:43.361835+0000","last_clean_scrub_stamp":"2024-09-12T01:38:43.361835+0000","objects_scrubbed":1,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:16.392588+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"263'110","reported_seq":686,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.383696+0000","last_change":"2024-09-12T01:38:22.383696+0000","last_active":"2024-09-12T01:38:22.383696+0000","last_peered":"2024-09-12T01:38:22.383696+0000","last_clean":"2024-09-12T01:38:22.383696+0000","last_became_active":"2024-09-12T00:28:33.213074+0000","last_became_peered":"2024-09-12T00:28:33.213074+0000","last_unstale":"2024-09-12T01:38:22.383696+0000","last_undegraded":"2024-09-12T01:38:22.383696+0000","last_fullsized":"2024-09-12T01:38:22.383696+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'110","last_scrub_stamp":"2024-09-12T01:38:22.383615+0000","last_deep_scrub":"263'110","last_deep_scrub_stamp":"2024-09-12T01:38:22.383615+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.383615+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:00.918063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":473,"num_read_kb":387,"num_write":177,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"263'310","reported_seq":928,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.315211+0000","last_change":"2024-09-12T01:38:15.315153+0000","last_active":"2024-09-12T01:38:15.315211+0000","last_peered":"2024-09-12T01:38:15.315211+0000","last_clean":"2024-09-12T01:38:15.315211+0000","last_became_active":"2024-09-12T00:28:31.207567+0000","last_became_peered":"2024-09-12T00:28:31.207567+0000","last_unstale":"2024-09-12T01:38:15.315211+0000","last_undegraded":"2024-09-12T01:38:15.315211+0000","last_fullsized":"2024-09-12T01:38:15.315211+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'310","last_scrub_stamp":"2024-09-12T01:38:15.315042+0000","last_deep_scrub":"263'310","last_deep_scrub_stamp":"2024-09-12T01:38:15.315042+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.315042+0000","objects_scrubbed":6,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:05.943857+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":384,"num_read_kb":9497,"num_write":972,"num_write_kb":19827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:28.461464+0000","last_change":"2024-09-12T01:38:28.461464+0000","last_active":"2024-09-12T01:38:28.461464+0000","last_peered":"2024-09-12T01:38:28.461464+0000","last_clean":"2024-09-12T01:38:28.461464+0000","last_became_active":"2024-09-12T00:28:35.209944+0000","last_became_peered":"2024-09-12T00:28:35.209944+0000","last_unstale":"2024-09-12T01:38:28.461464+0000","last_undegraded":"2024-09-12T01:38:28.461464+0000","last_fullsized":"2024-09-12T01:38:28.461464+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:28.461368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:28.461368+0000","last_clean_scrub_stamp":"2024-09-12T01:38:28.461368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:50.694283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"263'379","reported_seq":1020,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:39.410905+0000","last_change":"2024-09-12T01:38:39.410905+0000","last_active":"2024-09-12T01:38:39.410905+0000","last_peered":"2024-09-12T01:38:39.410905+0000","last_clean":"2024-09-12T01:38:39.410905+0000","last_became_active":"2024-09-12T00:28:37.424250+0000","last_became_peered":"2024-09-12T00:28:37.424250+0000","last_unstale":"2024-09-12T01:38:39.410905+0000","last_undegraded":"2024-09-12T01:38:39.410905+0000","last_fullsized":"2024-09-12T01:38:39.410905+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'379","last_scrub_stamp":"2024-09-12T01:38:39.410761+0000","last_deep_scrub":"263'379","last_deep_scrub_stamp":"2024-09-12T01:38:39.410761+0000","last_clean_scrub_stamp":"2024-09-12T01:38:39.410761+0000","objects_scrubbed":10,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:50.606596+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42905,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":588,"num_read_kb":1145,"num_write":446,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:28.034739+0000","last_change":"2024-09-12T01:38:28.034739+0000","last_active":"2024-09-12T01:38:28.034739+0000","last_peered":"2024-09-12T01:38:28.034739+0000","last_clean":"2024-09-12T01:38:28.034739+0000","last_became_active":"2024-09-12T00:28:39.213889+0000","last_became_peered":"2024-09-12T00:28:39.213889+0000","last_unstale":"2024-09-12T01:38:28.034739+0000","last_undegraded":"2024-09-12T01:38:28.034739+0000","last_fullsized":"2024-09-12T01:38:28.034739+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:28.034613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:28.034613+0000","last_clean_scrub_stamp":"2024-09-12T01:38:28.034613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:46.356624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"263'538","reported_seq":1356,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:42.442408+0000","last_change":"2024-09-12T01:38:42.442408+0000","last_active":"2024-09-12T01:38:42.442408+0000","last_peered":"2024-09-12T01:38:42.442408+0000","last_clean":"2024-09-12T01:38:42.442408+0000","last_became_active":"2024-09-12T00:28:41.229664+0000","last_became_peered":"2024-09-12T00:28:41.229664+0000","last_unstale":"2024-09-12T01:38:42.442408+0000","last_undegraded":"2024-09-12T01:38:42.442408+0000","last_fullsized":"2024-09-12T01:38:42.442408+0000","mapping_epoch":35,"log_start":"263'500","ondisk_log_start":"263'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'538","last_scrub_stamp":"2024-09-12T01:38:42.442328+0000","last_deep_scrub":"263'538","last_deep_scrub_stamp":"2024-09-12T01:38:42.442328+0000","last_clean_scrub_stamp":"2024-09-12T01:38:42.442328+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":500,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:09.752744+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":472,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1261,"num_read_kb":1256,"num_write":1100,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"263'151","reported_seq":774,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.524133+0000","last_change":"2024-09-12T01:38:16.524133+0000","last_active":"2024-09-12T01:38:16.524133+0000","last_peered":"2024-09-12T01:38:16.524133+0000","last_clean":"2024-09-12T01:38:16.524133+0000","last_became_active":"2024-09-12T00:28:33.201673+0000","last_became_peered":"2024-09-12T00:28:33.201673+0000","last_unstale":"2024-09-12T01:38:16.524133+0000","last_undegraded":"2024-09-12T01:38:16.524133+0000","last_fullsized":"2024-09-12T01:38:16.524133+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'151","last_scrub_stamp":"2024-09-12T01:38:16.524038+0000","last_deep_scrub":"263'151","last_deep_scrub_stamp":"2024-09-12T01:38:16.524038+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.524038+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:20.505594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":672,"num_read_kb":557,"num_write":251,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"263'425","reported_seq":1136,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.266274+0000","last_change":"2024-09-12T01:38:12.266183+0000","last_active":"2024-09-12T01:38:12.266274+0000","last_peered":"2024-09-12T01:38:12.266274+0000","last_clean":"2024-09-12T01:38:12.266274+0000","last_became_active":"2024-09-12T00:28:31.202279+0000","last_became_peered":"2024-09-12T00:28:31.202279+0000","last_unstale":"2024-09-12T01:38:12.266274+0000","last_undegraded":"2024-09-12T01:38:12.266274+0000","last_fullsized":"2024-09-12T01:38:12.266274+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'425","last_scrub_stamp":"2024-09-12T01:38:12.266071+0000","last_deep_scrub":"263'425","last_deep_scrub_stamp":"2024-09-12T01:38:12.266071+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.266071+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:43.456179+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262213,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":777,"num_read_kb":12137,"num_write":1235,"num_write_kb":44296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":512,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.741517+0000","last_change":"2024-09-12T01:38:16.741517+0000","last_active":"2024-09-12T01:38:16.741517+0000","last_peered":"2024-09-12T01:38:16.741517+0000","last_clean":"2024-09-12T01:38:16.741517+0000","last_became_active":"2024-09-12T00:28:35.210154+0000","last_became_peered":"2024-09-12T00:28:35.210154+0000","last_unstale":"2024-09-12T01:38:16.741517+0000","last_undegraded":"2024-09-12T01:38:16.741517+0000","last_fullsized":"2024-09-12T01:38:16.741517+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:16.741414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:16.741414+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.741414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:08.905624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"263'278","reported_seq":873,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.297668+0000","last_change":"2024-09-12T01:38:37.297668+0000","last_active":"2024-09-12T01:38:37.297668+0000","last_peered":"2024-09-12T01:38:37.297668+0000","last_clean":"2024-09-12T01:38:37.297668+0000","last_became_active":"2024-09-12T00:28:37.219967+0000","last_became_peered":"2024-09-12T00:28:37.219967+0000","last_unstale":"2024-09-12T01:38:37.297668+0000","last_undegraded":"2024-09-12T01:38:37.297668+0000","last_fullsized":"2024-09-12T01:38:37.297668+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'278","last_scrub_stamp":"2024-09-12T01:38:37.297574+0000","last_deep_scrub":"263'278","last_deep_scrub_stamp":"2024-09-12T01:38:37.297574+0000","last_clean_scrub_stamp":"2024-09-12T01:38:37.297574+0000","objects_scrubbed":5,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:37.194451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44545,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":449,"num_read_kb":1025,"num_write":360,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:41.315655+0000","last_change":"2024-09-12T01:38:41.315655+0000","last_active":"2024-09-12T01:38:41.315655+0000","last_peered":"2024-09-12T01:38:41.315655+0000","last_clean":"2024-09-12T01:38:41.315655+0000","last_became_active":"2024-09-12T00:28:39.216330+0000","last_became_peered":"2024-09-12T00:28:39.216330+0000","last_unstale":"2024-09-12T01:38:41.315655+0000","last_undegraded":"2024-09-12T01:38:41.315655+0000","last_fullsized":"2024-09-12T01:38:41.315655+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:41.315570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:41.315570+0000","last_clean_scrub_stamp":"2024-09-12T01:38:41.315570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:18.646822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"263'2409","reported_seq":4259,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:30.137997+0000","last_change":"2024-09-12T01:38:30.137997+0000","last_active":"2024-09-12T01:38:30.137997+0000","last_peered":"2024-09-12T01:38:30.137997+0000","last_clean":"2024-09-12T01:38:30.137997+0000","last_became_active":"2024-09-12T00:28:41.227877+0000","last_became_peered":"2024-09-12T00:28:41.227877+0000","last_unstale":"2024-09-12T01:38:30.137997+0000","last_undegraded":"2024-09-12T01:38:30.137997+0000","last_fullsized":"2024-09-12T01:38:30.137997+0000","mapping_epoch":35,"log_start":"263'2300","ondisk_log_start":"263'2300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2409","last_scrub_stamp":"2024-09-12T01:38:30.137912+0000","last_deep_scrub":"263'2409","last_deep_scrub_stamp":"2024-09-12T01:38:30.137912+0000","last_clean_scrub_stamp":"2024-09-12T01:38:30.137912+0000","objects_scrubbed":4,"log_size":109,"log_dups_size":2300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:28.037700+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1208,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6068,"num_read_kb":6055,"num_write":4875,"num_write_kb":1798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"263'303","reported_seq":981,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.167240+0000","last_change":"2024-09-12T01:38:18.167240+0000","last_active":"2024-09-12T01:38:18.167240+0000","last_peered":"2024-09-12T01:38:18.167240+0000","last_clean":"2024-09-12T01:38:18.167240+0000","last_became_active":"2024-09-12T00:28:33.217954+0000","last_became_peered":"2024-09-12T00:28:33.217954+0000","last_unstale":"2024-09-12T01:38:18.167240+0000","last_undegraded":"2024-09-12T01:38:18.167240+0000","last_fullsized":"2024-09-12T01:38:18.167240+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'303","last_scrub_stamp":"2024-09-12T01:38:18.167157+0000","last_deep_scrub":"263'303","last_deep_scrub_stamp":"2024-09-12T01:38:18.167157+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.167157+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:00.698674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1356,"num_read_kb":1133,"num_write":489,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"263'389","reported_seq":1084,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.277274+0000","last_change":"2024-09-12T01:38:16.277183+0000","last_active":"2024-09-12T01:38:16.277274+0000","last_peered":"2024-09-12T01:38:16.277274+0000","last_clean":"2024-09-12T01:38:16.277274+0000","last_became_active":"2024-09-12T00:28:31.215643+0000","last_became_peered":"2024-09-12T00:28:31.215643+0000","last_unstale":"2024-09-12T01:38:16.277274+0000","last_undegraded":"2024-09-12T01:38:16.277274+0000","last_fullsized":"2024-09-12T01:38:16.277274+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'389","last_scrub_stamp":"2024-09-12T01:38:16.277044+0000","last_deep_scrub":"263'389","last_deep_scrub_stamp":"2024-09-12T01:38:16.277044+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.277044+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:21.030278+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432537,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":556,"num_read_kb":94195,"num_write":1241,"num_write_kb":52818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.733004+0000","last_change":"2024-09-12T01:38:18.732898+0000","last_active":"2024-09-12T01:38:18.733004+0000","last_peered":"2024-09-12T01:38:18.733004+0000","last_clean":"2024-09-12T01:38:18.733004+0000","last_became_active":"2024-09-12T00:28:35.208169+0000","last_became_peered":"2024-09-12T00:28:35.208169+0000","last_unstale":"2024-09-12T01:38:18.733004+0000","last_undegraded":"2024-09-12T01:38:18.733004+0000","last_fullsized":"2024-09-12T01:38:18.733004+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:18.732796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:18.732796+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.732796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:48.698141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"263'339","reported_seq":957,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:33.414479+0000","last_change":"2024-09-12T01:38:33.414479+0000","last_active":"2024-09-12T01:38:33.414479+0000","last_peered":"2024-09-12T01:38:33.414479+0000","last_clean":"2024-09-12T01:38:33.414479+0000","last_became_active":"2024-09-12T00:28:37.220877+0000","last_became_peered":"2024-09-12T00:28:37.220877+0000","last_unstale":"2024-09-12T01:38:33.414479+0000","last_undegraded":"2024-09-12T01:38:33.414479+0000","last_fullsized":"2024-09-12T01:38:33.414479+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'339","last_scrub_stamp":"2024-09-12T01:38:33.414376+0000","last_deep_scrub":"263'339","last_deep_scrub_stamp":"2024-09-12T01:38:33.414376+0000","last_clean_scrub_stamp":"2024-09-12T01:38:33.414376+0000","objects_scrubbed":9,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:19.579577+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44229,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":532,"num_read_kb":1137,"num_write":418,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"263'774","reported_seq":2596,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:36.223850+0000","last_change":"2024-09-12T01:38:36.223850+0000","last_active":"2024-09-12T01:38:36.223850+0000","last_peered":"2024-09-12T01:38:36.223850+0000","last_clean":"2024-09-12T01:38:36.223850+0000","last_became_active":"2024-09-12T00:28:39.215746+0000","last_became_peered":"2024-09-12T00:28:39.215746+0000","last_unstale":"2024-09-12T01:38:36.223850+0000","last_undegraded":"2024-09-12T01:38:36.223850+0000","last_fullsized":"2024-09-12T01:38:36.223850+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'774","last_scrub_stamp":"2024-09-12T01:38:36.223759+0000","last_deep_scrub":"263'774","last_deep_scrub_stamp":"2024-09-12T01:38:36.223759+0000","last_clean_scrub_stamp":"2024-09-12T01:38:36.223759+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:40.732455+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"263'81","reported_seq":583,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:41.209242+0000","last_change":"2024-09-12T01:38:41.209242+0000","last_active":"2024-09-12T01:38:41.209242+0000","last_peered":"2024-09-12T01:38:41.209242+0000","last_clean":"2024-09-12T01:38:41.209242+0000","last_became_active":"2024-09-12T00:28:41.228361+0000","last_became_peered":"2024-09-12T00:28:41.228361+0000","last_unstale":"2024-09-12T01:38:41.209242+0000","last_undegraded":"2024-09-12T01:38:41.209242+0000","last_fullsized":"2024-09-12T01:38:41.209242+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'81","last_scrub_stamp":"2024-09-12T01:38:41.209159+0000","last_deep_scrub":"263'81","last_deep_scrub_stamp":"2024-09-12T01:38:41.209159+0000","last_clean_scrub_stamp":"2024-09-12T01:38:41.209159+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:37.651268+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":65,"num_write":188,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"263'302","reported_seq":917,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:26.124747+0000","last_change":"2024-09-12T01:38:26.124747+0000","last_active":"2024-09-12T01:38:26.124747+0000","last_peered":"2024-09-12T01:38:26.124747+0000","last_clean":"2024-09-12T01:38:26.124747+0000","last_became_active":"2024-09-12T00:28:33.219182+0000","last_became_peered":"2024-09-12T00:28:33.219182+0000","last_unstale":"2024-09-12T01:38:26.124747+0000","last_undegraded":"2024-09-12T01:38:26.124747+0000","last_fullsized":"2024-09-12T01:38:26.124747+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'302","last_scrub_stamp":"2024-09-12T01:38:26.124659+0000","last_deep_scrub":"263'302","last_deep_scrub_stamp":"2024-09-12T01:38:26.124659+0000","last_clean_scrub_stamp":"2024-09-12T01:38:26.124659+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:53.789811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1277,"num_read_kb":1021,"num_write":469,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"263'378","reported_seq":1054,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.303730+0000","last_change":"2024-09-12T01:38:12.303676+0000","last_active":"2024-09-12T01:38:12.303730+0000","last_peered":"2024-09-12T01:38:12.303730+0000","last_clean":"2024-09-12T01:38:12.303730+0000","last_became_active":"2024-09-12T00:28:31.214920+0000","last_became_peered":"2024-09-12T00:28:31.214920+0000","last_unstale":"2024-09-12T01:38:12.303730+0000","last_undegraded":"2024-09-12T01:38:12.303730+0000","last_fullsized":"2024-09-12T01:38:12.303730+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'378","last_scrub_stamp":"2024-09-12T01:38:12.303574+0000","last_deep_scrub":"263'378","last_deep_scrub_stamp":"2024-09-12T01:38:12.303574+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.303574+0000","objects_scrubbed":4,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:03.116923+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":584,"num_read_kb":15343,"num_write":1236,"num_write_kb":35661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":512,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.754507+0000","last_change":"2024-09-12T01:38:17.754507+0000","last_active":"2024-09-12T01:38:17.754507+0000","last_peered":"2024-09-12T01:38:17.754507+0000","last_clean":"2024-09-12T01:38:17.754507+0000","last_became_active":"2024-09-12T00:28:35.207881+0000","last_became_peered":"2024-09-12T00:28:35.207881+0000","last_unstale":"2024-09-12T01:38:17.754507+0000","last_undegraded":"2024-09-12T01:38:17.754507+0000","last_fullsized":"2024-09-12T01:38:17.754507+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:17.754418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:17.754418+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.754418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:59.001650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"263'473","reported_seq":1135,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.229161+0000","last_change":"2024-09-12T01:38:35.229161+0000","last_active":"2024-09-12T01:38:35.229161+0000","last_peered":"2024-09-12T01:38:35.229161+0000","last_clean":"2024-09-12T01:38:35.229161+0000","last_became_active":"2024-09-12T00:28:37.216189+0000","last_became_peered":"2024-09-12T00:28:37.216189+0000","last_unstale":"2024-09-12T01:38:35.229161+0000","last_undegraded":"2024-09-12T01:38:35.229161+0000","last_fullsized":"2024-09-12T01:38:35.229161+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'473","last_scrub_stamp":"2024-09-12T01:38:35.229071+0000","last_deep_scrub":"263'473","last_deep_scrub_stamp":"2024-09-12T01:38:35.229071+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.229071+0000","objects_scrubbed":7,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:58.363045+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90719,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":821,"num_read_kb":1951,"num_write":658,"num_write_kb":528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.791092+0000","last_change":"2024-09-12T01:38:22.791092+0000","last_active":"2024-09-12T01:38:22.791092+0000","last_peered":"2024-09-12T01:38:22.791092+0000","last_clean":"2024-09-12T01:38:22.791092+0000","last_became_active":"2024-09-12T00:28:39.212687+0000","last_became_peered":"2024-09-12T00:28:39.212687+0000","last_unstale":"2024-09-12T01:38:22.791092+0000","last_undegraded":"2024-09-12T01:38:22.791092+0000","last_fullsized":"2024-09-12T01:38:22.791092+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:22.790991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:22.790991+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.790991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:06.359775+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"263'135","reported_seq":672,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:34.884550+0000","last_change":"2024-09-12T01:38:34.884550+0000","last_active":"2024-09-12T01:38:34.884550+0000","last_peered":"2024-09-12T01:38:34.884550+0000","last_clean":"2024-09-12T01:38:34.884550+0000","last_became_active":"2024-09-12T00:28:41.225700+0000","last_became_peered":"2024-09-12T00:28:41.225700+0000","last_unstale":"2024-09-12T01:38:34.884550+0000","last_undegraded":"2024-09-12T01:38:34.884550+0000","last_fullsized":"2024-09-12T01:38:34.884550+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'135","last_scrub_stamp":"2024-09-12T01:38:34.884451+0000","last_deep_scrub":"263'135","last_deep_scrub_stamp":"2024-09-12T01:38:34.884451+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.884451+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:32.547527+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":521,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":185,"num_read_kb":167,"num_write":321,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"263'175","reported_seq":788,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.459440+0000","last_change":"2024-09-12T01:38:11.459368+0000","last_active":"2024-09-12T01:38:11.459440+0000","last_peered":"2024-09-12T01:38:11.459440+0000","last_clean":"2024-09-12T01:38:11.459440+0000","last_became_active":"2024-09-12T00:28:33.204532+0000","last_became_peered":"2024-09-12T00:28:33.204532+0000","last_unstale":"2024-09-12T01:38:11.459440+0000","last_undegraded":"2024-09-12T01:38:11.459440+0000","last_fullsized":"2024-09-12T01:38:11.459440+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'175","last_scrub_stamp":"2024-09-12T01:38:11.459272+0000","last_deep_scrub":"263'175","last_deep_scrub_stamp":"2024-09-12T01:38:11.459272+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.459272+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:41.431006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":765,"num_read_kb":622,"num_write":270,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"263'382","reported_seq":1027,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.215722+0000","last_change":"2024-09-12T01:38:18.215663+0000","last_active":"2024-09-12T01:38:18.215722+0000","last_peered":"2024-09-12T01:38:18.215722+0000","last_clean":"2024-09-12T01:38:18.215722+0000","last_became_active":"2024-09-12T00:28:31.207269+0000","last_became_peered":"2024-09-12T00:28:31.207269+0000","last_unstale":"2024-09-12T01:38:18.215722+0000","last_undegraded":"2024-09-12T01:38:18.215722+0000","last_fullsized":"2024-09-12T01:38:18.215722+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'382","last_scrub_stamp":"2024-09-12T01:38:18.215562+0000","last_deep_scrub":"263'382","last_deep_scrub_stamp":"2024-09-12T01:38:18.215562+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.215562+0000","objects_scrubbed":6,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:29.623240+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291522,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":535,"num_read_kb":24704,"num_write":1122,"num_write_kb":40904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.726168+0000","last_change":"2024-09-12T01:38:20.726071+0000","last_active":"2024-09-12T01:38:20.726168+0000","last_peered":"2024-09-12T01:38:20.726168+0000","last_clean":"2024-09-12T01:38:20.726168+0000","last_became_active":"2024-09-12T00:28:35.208829+0000","last_became_peered":"2024-09-12T00:28:35.208829+0000","last_unstale":"2024-09-12T01:38:20.726168+0000","last_undegraded":"2024-09-12T01:38:20.726168+0000","last_fullsized":"2024-09-12T01:38:20.726168+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:20.725958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:20.725958+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.725958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:14.695147+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"263'291","reported_seq":893,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:32.528856+0000","last_change":"2024-09-12T01:38:32.528856+0000","last_active":"2024-09-12T01:38:32.528856+0000","last_peered":"2024-09-12T01:38:32.528856+0000","last_clean":"2024-09-12T01:38:32.528856+0000","last_became_active":"2024-09-12T00:28:37.210162+0000","last_became_peered":"2024-09-12T00:28:37.210162+0000","last_unstale":"2024-09-12T01:38:32.528856+0000","last_undegraded":"2024-09-12T01:38:32.528856+0000","last_fullsized":"2024-09-12T01:38:32.528856+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'291","last_scrub_stamp":"2024-09-12T01:38:32.528735+0000","last_deep_scrub":"263'291","last_deep_scrub_stamp":"2024-09-12T01:38:32.528735+0000","last_clean_scrub_stamp":"2024-09-12T01:38:32.528735+0000","objects_scrubbed":7,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:46.245167+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46921,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":495,"num_read_kb":1053,"num_write":432,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.260178+0000","last_change":"2024-09-12T01:38:37.260178+0000","last_active":"2024-09-12T01:38:37.260178+0000","last_peered":"2024-09-12T01:38:37.260178+0000","last_clean":"2024-09-12T01:38:37.260178+0000","last_became_active":"2024-09-12T00:28:39.220468+0000","last_became_peered":"2024-09-12T00:28:39.220468+0000","last_unstale":"2024-09-12T01:38:37.260178+0000","last_undegraded":"2024-09-12T01:38:37.260178+0000","last_fullsized":"2024-09-12T01:38:37.260178+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:37.260087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:37.260087+0000","last_clean_scrub_stamp":"2024-09-12T01:38:37.260087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:17.911573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"263'86","reported_seq":588,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:44.396341+0000","last_change":"2024-09-12T01:38:44.396341+0000","last_active":"2024-09-12T01:38:44.396341+0000","last_peered":"2024-09-12T01:38:44.396341+0000","last_clean":"2024-09-12T01:38:44.396341+0000","last_became_active":"2024-09-12T00:28:41.228663+0000","last_became_peered":"2024-09-12T00:28:41.228663+0000","last_unstale":"2024-09-12T01:38:44.396341+0000","last_undegraded":"2024-09-12T01:38:44.396341+0000","last_fullsized":"2024-09-12T01:38:44.396341+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'86","last_scrub_stamp":"2024-09-12T01:38:44.396238+0000","last_deep_scrub":"263'86","last_deep_scrub_stamp":"2024-09-12T01:38:44.396238+0000","last_clean_scrub_stamp":"2024-09-12T01:38:44.396238+0000","objects_scrubbed":5,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:41.170773+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":503,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":60,"num_read_kb":59,"num_write":193,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"263'158","reported_seq":788,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.505568+0000","last_change":"2024-09-12T01:38:13.505491+0000","last_active":"2024-09-12T01:38:13.505568+0000","last_peered":"2024-09-12T01:38:13.505568+0000","last_clean":"2024-09-12T01:38:13.505568+0000","last_became_active":"2024-09-12T00:28:33.206883+0000","last_became_peered":"2024-09-12T00:28:33.206883+0000","last_unstale":"2024-09-12T01:38:13.505568+0000","last_undegraded":"2024-09-12T01:38:13.505568+0000","last_fullsized":"2024-09-12T01:38:13.505568+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'158","last_scrub_stamp":"2024-09-12T01:38:13.505388+0000","last_deep_scrub":"263'158","last_deep_scrub_stamp":"2024-09-12T01:38:13.505388+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.505388+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:21.434548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":717,"num_read_kb":595,"num_write":233,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"263'311","reported_seq":935,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.152253+0000","last_change":"2024-09-12T01:38:10.152253+0000","last_active":"2024-09-12T01:38:10.152253+0000","last_peered":"2024-09-12T01:38:10.152253+0000","last_clean":"2024-09-12T01:38:10.152253+0000","last_became_active":"2024-09-12T00:28:31.203369+0000","last_became_peered":"2024-09-12T00:28:31.203369+0000","last_unstale":"2024-09-12T01:38:10.152253+0000","last_undegraded":"2024-09-12T01:38:10.152253+0000","last_fullsized":"2024-09-12T01:38:10.152253+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'311","last_scrub_stamp":"2024-09-12T01:38:10.152154+0000","last_deep_scrub":"263'311","last_deep_scrub_stamp":"2024-09-12T01:38:10.152154+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.152154+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:08.174048+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7425128,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":375,"num_read_kb":56295,"num_write":849,"num_write_kb":46368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.025660+0000","last_change":"2024-09-12T01:38:22.025660+0000","last_active":"2024-09-12T01:38:22.025660+0000","last_peered":"2024-09-12T01:38:22.025660+0000","last_clean":"2024-09-12T01:38:22.025660+0000","last_became_active":"2024-09-12T00:28:35.207923+0000","last_became_peered":"2024-09-12T00:28:35.207923+0000","last_unstale":"2024-09-12T01:38:22.025660+0000","last_undegraded":"2024-09-12T01:38:22.025660+0000","last_fullsized":"2024-09-12T01:38:22.025660+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:22.025562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:22.025562+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.025562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:15.589299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"263'354","reported_seq":965,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:26.697355+0000","last_change":"2024-09-12T01:38:26.697286+0000","last_active":"2024-09-12T01:38:26.697355+0000","last_peered":"2024-09-12T01:38:26.697355+0000","last_clean":"2024-09-12T01:38:26.697355+0000","last_became_active":"2024-09-12T00:28:37.220674+0000","last_became_peered":"2024-09-12T00:28:37.220674+0000","last_unstale":"2024-09-12T01:38:26.697355+0000","last_undegraded":"2024-09-12T01:38:26.697355+0000","last_fullsized":"2024-09-12T01:38:26.697355+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'354","last_scrub_stamp":"2024-09-12T01:38:26.697194+0000","last_deep_scrub":"263'354","last_deep_scrub_stamp":"2024-09-12T01:38:26.697194+0000","last_clean_scrub_stamp":"2024-09-12T01:38:26.697194+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:04.175101+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48847,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":575,"num_read_kb":1313,"num_write":464,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"263'739","reported_seq":4576,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:24.709916+0000","last_change":"2024-09-12T01:38:24.709856+0000","last_active":"2024-09-12T01:38:24.709916+0000","last_peered":"2024-09-12T01:38:24.709916+0000","last_clean":"2024-09-12T01:38:24.709916+0000","last_became_active":"2024-09-12T00:28:39.213871+0000","last_became_peered":"2024-09-12T00:28:39.213871+0000","last_unstale":"2024-09-12T01:38:24.709916+0000","last_undegraded":"2024-09-12T01:38:24.709916+0000","last_fullsized":"2024-09-12T01:38:24.709916+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'739","last_scrub_stamp":"2024-09-12T01:38:24.709738+0000","last_deep_scrub":"263'739","last_deep_scrub_stamp":"2024-09-12T01:38:24.709738+0000","last_clean_scrub_stamp":"2024-09-12T01:38:24.709738+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":700,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:14.725207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"263'200","reported_seq":759,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:32.916353+0000","last_change":"2024-09-12T01:38:32.916353+0000","last_active":"2024-09-12T01:38:32.916353+0000","last_peered":"2024-09-12T01:38:32.916353+0000","last_clean":"2024-09-12T01:38:32.916353+0000","last_became_active":"2024-09-12T00:28:41.227310+0000","last_became_peered":"2024-09-12T00:28:41.227310+0000","last_unstale":"2024-09-12T01:38:32.916353+0000","last_undegraded":"2024-09-12T01:38:32.916353+0000","last_fullsized":"2024-09-12T01:38:32.916353+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'200","last_scrub_stamp":"2024-09-12T01:38:32.916236+0000","last_deep_scrub":"263'200","last_deep_scrub_stamp":"2024-09-12T01:38:32.916236+0000","last_clean_scrub_stamp":"2024-09-12T01:38:32.916236+0000","objects_scrubbed":6,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:11.385847+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1879,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":313,"num_read_kb":267,"num_write":467,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"263'134","reported_seq":767,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.496591+0000","last_change":"2024-09-12T01:38:17.496539+0000","last_active":"2024-09-12T01:38:17.496591+0000","last_peered":"2024-09-12T01:38:17.496591+0000","last_clean":"2024-09-12T01:38:17.496591+0000","last_became_active":"2024-09-12T00:28:33.211327+0000","last_became_peered":"2024-09-12T00:28:33.211327+0000","last_unstale":"2024-09-12T01:38:17.496591+0000","last_undegraded":"2024-09-12T01:38:17.496591+0000","last_fullsized":"2024-09-12T01:38:17.496591+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'134","last_scrub_stamp":"2024-09-12T01:38:17.496441+0000","last_deep_scrub":"263'134","last_deep_scrub_stamp":"2024-09-12T01:38:17.496441+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.496441+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:31.354433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":621,"num_read_kb":525,"num_write":194,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"263'378","reported_seq":1084,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.492901+0000","last_change":"2024-09-12T01:38:12.492901+0000","last_active":"2024-09-12T01:38:12.492901+0000","last_peered":"2024-09-12T01:38:12.492901+0000","last_clean":"2024-09-12T01:38:12.492901+0000","last_became_active":"2024-09-12T00:28:31.201275+0000","last_became_peered":"2024-09-12T00:28:31.201275+0000","last_unstale":"2024-09-12T01:38:12.492901+0000","last_undegraded":"2024-09-12T01:38:12.492901+0000","last_fullsized":"2024-09-12T01:38:12.492901+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'378","last_scrub_stamp":"2024-09-12T01:38:12.492779+0000","last_deep_scrub":"263'378","last_deep_scrub_stamp":"2024-09-12T01:38:12.492779+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.492779+0000","objects_scrubbed":8,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:39.803942+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395829,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":640,"num_read_kb":30113,"num_write":1190,"num_write_kb":53346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"263'4","reported_seq":1460,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:32.474262+0000","last_change":"2024-09-12T01:38:32.474262+0000","last_active":"2024-09-12T01:38:32.474262+0000","last_peered":"2024-09-12T01:38:32.474262+0000","last_clean":"2024-09-12T01:38:32.474262+0000","last_became_active":"2024-09-12T00:28:35.210173+0000","last_became_peered":"2024-09-12T00:28:35.210173+0000","last_unstale":"2024-09-12T01:38:32.474262+0000","last_undegraded":"2024-09-12T01:38:32.474262+0000","last_fullsized":"2024-09-12T01:38:32.474262+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-12T01:38:32.474172+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-12T01:38:32.474172+0000","last_clean_scrub_stamp":"2024-09-12T01:38:32.474172+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:26.611898+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":952,"num_read_kb":952,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"263'111","reported_seq":652,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:33.345052+0000","last_change":"2024-09-12T01:38:33.345052+0000","last_active":"2024-09-12T01:38:33.345052+0000","last_peered":"2024-09-12T01:38:33.345052+0000","last_clean":"2024-09-12T01:38:33.345052+0000","last_became_active":"2024-09-12T00:28:37.423847+0000","last_became_peered":"2024-09-12T00:28:37.423847+0000","last_unstale":"2024-09-12T01:38:33.345052+0000","last_undegraded":"2024-09-12T01:38:33.345052+0000","last_fullsized":"2024-09-12T01:38:33.345052+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'111","last_scrub_stamp":"2024-09-12T01:38:33.344967+0000","last_deep_scrub":"263'111","last_deep_scrub_stamp":"2024-09-12T01:38:33.344967+0000","last_clean_scrub_stamp":"2024-09-12T01:38:33.344967+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:23.427540+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":109,"num_read_kb":102,"num_write":74,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"263'760","reported_seq":2656,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:26.210045+0000","last_change":"2024-09-12T01:38:26.209968+0000","last_active":"2024-09-12T01:38:26.210045+0000","last_peered":"2024-09-12T01:38:26.210045+0000","last_clean":"2024-09-12T01:38:26.210045+0000","last_became_active":"2024-09-12T00:28:39.216244+0000","last_became_peered":"2024-09-12T00:28:39.216244+0000","last_unstale":"2024-09-12T01:38:26.210045+0000","last_undegraded":"2024-09-12T01:38:26.210045+0000","last_fullsized":"2024-09-12T01:38:26.210045+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'760","last_scrub_stamp":"2024-09-12T01:38:26.209888+0000","last_deep_scrub":"263'760","last_deep_scrub_stamp":"2024-09-12T01:38:26.209888+0000","last_clean_scrub_stamp":"2024-09-12T01:38:26.209888+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:02.637163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"263'177","reported_seq":696,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:40.528122+0000","last_change":"2024-09-12T01:38:40.528122+0000","last_active":"2024-09-12T01:38:40.528122+0000","last_peered":"2024-09-12T01:38:40.528122+0000","last_clean":"2024-09-12T01:38:40.528122+0000","last_became_active":"2024-09-12T00:28:41.225728+0000","last_became_peered":"2024-09-12T00:28:41.225728+0000","last_unstale":"2024-09-12T01:38:40.528122+0000","last_undegraded":"2024-09-12T01:38:40.528122+0000","last_fullsized":"2024-09-12T01:38:40.528122+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'177","last_scrub_stamp":"2024-09-12T01:38:40.528038+0000","last_deep_scrub":"263'177","last_deep_scrub_stamp":"2024-09-12T01:38:40.528038+0000","last_clean_scrub_stamp":"2024-09-12T01:38:40.528038+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:42.089224+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":145,"num_write":308,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"263'4256","reported_seq":4866,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.093864+0000","last_change":"2024-09-12T01:38:20.093799+0000","last_active":"2024-09-12T01:38:20.093864+0000","last_peered":"2024-09-12T01:38:20.093864+0000","last_clean":"2024-09-12T01:38:20.093864+0000","last_became_active":"2024-09-12T00:28:33.205792+0000","last_became_peered":"2024-09-12T00:28:33.205792+0000","last_unstale":"2024-09-12T01:38:20.093864+0000","last_undegraded":"2024-09-12T01:38:20.093864+0000","last_fullsized":"2024-09-12T01:38:20.093864+0000","mapping_epoch":27,"log_start":"263'4200","ondisk_log_start":"263'4200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4256","last_scrub_stamp":"2024-09-12T01:38:20.093696+0000","last_deep_scrub":"263'4256","last_deep_scrub_stamp":"2024-09-12T01:38:20.093696+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.093696+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":3000,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:49.819357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17142,"num_read_kb":14400,"num_write":6430,"num_write_kb":3228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"263'385","reported_seq":1112,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.241283+0000","last_change":"2024-09-12T01:38:10.241283+0000","last_active":"2024-09-12T01:38:10.241283+0000","last_peered":"2024-09-12T01:38:10.241283+0000","last_clean":"2024-09-12T01:38:10.241283+0000","last_became_active":"2024-09-12T00:28:31.202456+0000","last_became_peered":"2024-09-12T00:28:31.202456+0000","last_unstale":"2024-09-12T01:38:10.241283+0000","last_undegraded":"2024-09-12T01:38:10.241283+0000","last_fullsized":"2024-09-12T01:38:10.241283+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'385","last_scrub_stamp":"2024-09-12T01:38:10.241176+0000","last_deep_scrub":"263'385","last_deep_scrub_stamp":"2024-09-12T01:38:10.241176+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.241176+0000","objects_scrubbed":9,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:45.643799+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":651,"num_read_kb":78129,"num_write":1373,"num_write_kb":48684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:29.494509+0000","last_change":"2024-09-12T01:38:29.494509+0000","last_active":"2024-09-12T01:38:29.494509+0000","last_peered":"2024-09-12T01:38:29.494509+0000","last_clean":"2024-09-12T01:38:29.494509+0000","last_became_active":"2024-09-12T00:28:35.207343+0000","last_became_peered":"2024-09-12T00:28:35.207343+0000","last_unstale":"2024-09-12T01:38:29.494509+0000","last_undegraded":"2024-09-12T01:38:29.494509+0000","last_fullsized":"2024-09-12T01:38:29.494509+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:29.494405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:29.494405+0000","last_clean_scrub_stamp":"2024-09-12T01:38:29.494405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:46.288783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"263'377","reported_seq":1004,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.439219+0000","last_change":"2024-09-12T01:38:37.439219+0000","last_active":"2024-09-12T01:38:37.439219+0000","last_peered":"2024-09-12T01:38:37.439219+0000","last_clean":"2024-09-12T01:38:37.439219+0000","last_became_active":"2024-09-12T00:28:37.211090+0000","last_became_peered":"2024-09-12T00:28:37.211090+0000","last_unstale":"2024-09-12T01:38:37.439219+0000","last_undegraded":"2024-09-12T01:38:37.439219+0000","last_fullsized":"2024-09-12T01:38:37.439219+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'377","last_scrub_stamp":"2024-09-12T01:38:37.439113+0000","last_deep_scrub":"263'377","last_deep_scrub_stamp":"2024-09-12T01:38:37.439113+0000","last_clean_scrub_stamp":"2024-09-12T01:38:37.439113+0000","objects_scrubbed":8,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:34.040484+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46480,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":594,"num_read_kb":1224,"num_write":462,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:25.181529+0000","last_change":"2024-09-12T01:38:25.181468+0000","last_active":"2024-09-12T01:38:25.181529+0000","last_peered":"2024-09-12T01:38:25.181529+0000","last_clean":"2024-09-12T01:38:25.181529+0000","last_became_active":"2024-09-12T00:28:39.219687+0000","last_became_peered":"2024-09-12T00:28:39.219687+0000","last_unstale":"2024-09-12T01:38:25.181529+0000","last_undegraded":"2024-09-12T01:38:25.181529+0000","last_fullsized":"2024-09-12T01:38:25.181529+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:25.181379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:25.181379+0000","last_clean_scrub_stamp":"2024-09-12T01:38:25.181379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:32.900668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"263'119","reported_seq":632,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:31.957638+0000","last_change":"2024-09-12T01:38:31.957638+0000","last_active":"2024-09-12T01:38:31.957638+0000","last_peered":"2024-09-12T01:38:31.957638+0000","last_clean":"2024-09-12T01:38:31.957638+0000","last_became_active":"2024-09-12T00:28:41.226049+0000","last_became_peered":"2024-09-12T00:28:41.226049+0000","last_unstale":"2024-09-12T01:38:31.957638+0000","last_undegraded":"2024-09-12T01:38:31.957638+0000","last_fullsized":"2024-09-12T01:38:31.957638+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'119","last_scrub_stamp":"2024-09-12T01:38:31.957547+0000","last_deep_scrub":"263'119","last_deep_scrub_stamp":"2024-09-12T01:38:31.957547+0000","last_clean_scrub_stamp":"2024-09-12T01:38:31.957547+0000","objects_scrubbed":5,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:00.738039+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":871,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":118,"num_read_kb":115,"num_write":279,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"263'144","reported_seq":786,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.138001+0000","last_change":"2024-09-12T01:38:17.138001+0000","last_active":"2024-09-12T01:38:17.138001+0000","last_peered":"2024-09-12T01:38:17.138001+0000","last_clean":"2024-09-12T01:38:17.138001+0000","last_became_active":"2024-09-12T00:28:33.214018+0000","last_became_peered":"2024-09-12T00:28:33.214018+0000","last_unstale":"2024-09-12T01:38:17.138001+0000","last_undegraded":"2024-09-12T01:38:17.138001+0000","last_fullsized":"2024-09-12T01:38:17.138001+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'144","last_scrub_stamp":"2024-09-12T01:38:17.137901+0000","last_deep_scrub":"263'144","last_deep_scrub_stamp":"2024-09-12T01:38:17.137901+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.137901+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:44.770374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":636,"num_read_kb":544,"num_write":220,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"263'74","reported_seq":625,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.264571+0000","last_change":"2024-09-12T01:38:11.264507+0000","last_active":"2024-09-12T01:38:11.264571+0000","last_peered":"2024-09-12T01:38:11.264571+0000","last_clean":"2024-09-12T01:38:11.264571+0000","last_became_active":"2024-09-12T00:28:14.744766+0000","last_became_peered":"2024-09-12T00:28:14.744766+0000","last_unstale":"2024-09-12T01:38:11.264571+0000","last_undegraded":"2024-09-12T01:38:11.264571+0000","last_fullsized":"2024-09-12T01:38:11.264571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'74","last_scrub_stamp":"2024-09-12T01:38:11.264366+0000","last_deep_scrub":"263'74","last_deep_scrub_stamp":"2024-09-12T01:38:11.264366+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.264366+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:33.200544+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"263'2","reported_seq":531,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.265261+0000","last_change":"2024-09-12T01:38:11.265261+0000","last_active":"2024-09-12T01:38:11.265261+0000","last_peered":"2024-09-12T01:38:11.265261+0000","last_clean":"2024-09-12T01:38:11.265261+0000","last_became_active":"2024-09-12T00:28:19.162328+0000","last_became_peered":"2024-09-12T00:28:19.162328+0000","last_unstale":"2024-09-12T01:38:11.265261+0000","last_undegraded":"2024-09-12T01:38:11.265261+0000","last_fullsized":"2024-09-12T01:38:11.265261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:38:11.265179+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:38:11.265179+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.265179+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:49.396121+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00046717800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"263'321","reported_seq":970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:09.261369+0000","last_change":"2024-09-12T01:38:09.261369+0000","last_active":"2024-09-12T01:38:09.261369+0000","last_peered":"2024-09-12T01:38:09.261369+0000","last_clean":"2024-09-12T01:38:09.261369+0000","last_became_active":"2024-09-12T00:28:31.215485+0000","last_became_peered":"2024-09-12T00:28:31.215485+0000","last_unstale":"2024-09-12T01:38:09.261369+0000","last_undegraded":"2024-09-12T01:38:09.261369+0000","last_fullsized":"2024-09-12T01:38:09.261369+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'321","last_scrub_stamp":"2024-09-12T01:38:09.261297+0000","last_deep_scrub":"263'321","last_deep_scrub_stamp":"2024-09-12T01:38:09.261297+0000","last_clean_scrub_stamp":"2024-09-12T01:38:09.261297+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:38.767121+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436935,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":460,"num_read_kb":39194,"num_write":1093,"num_write_kb":25197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:27.434297+0000","last_change":"2024-09-12T01:38:27.434297+0000","last_active":"2024-09-12T01:38:27.434297+0000","last_peered":"2024-09-12T01:38:27.434297+0000","last_clean":"2024-09-12T01:38:27.434297+0000","last_became_active":"2024-09-12T00:28:35.208812+0000","last_became_peered":"2024-09-12T00:28:35.208812+0000","last_unstale":"2024-09-12T01:38:27.434297+0000","last_undegraded":"2024-09-12T01:38:27.434297+0000","last_fullsized":"2024-09-12T01:38:27.434297+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:27.434202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:27.434202+0000","last_clean_scrub_stamp":"2024-09-12T01:38:27.434202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:30.284359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"263'754","reported_seq":1477,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:36.442893+0000","last_change":"2024-09-12T01:38:36.442893+0000","last_active":"2024-09-12T01:38:36.442893+0000","last_peered":"2024-09-12T01:38:36.442893+0000","last_clean":"2024-09-12T01:38:36.442893+0000","last_became_active":"2024-09-12T00:28:37.221001+0000","last_became_peered":"2024-09-12T00:28:37.221001+0000","last_unstale":"2024-09-12T01:38:36.442893+0000","last_undegraded":"2024-09-12T01:38:36.442893+0000","last_fullsized":"2024-09-12T01:38:36.442893+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'754","last_scrub_stamp":"2024-09-12T01:38:36.442784+0000","last_deep_scrub":"263'754","last_deep_scrub_stamp":"2024-09-12T01:38:36.442784+0000","last_clean_scrub_stamp":"2024-09-12T01:38:36.442784+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":700,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:08.801372+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141781,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1456,"num_read_kb":3385,"num_write":1364,"num_write_kb":1192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":90586,"num_omap_keys":220,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:32.185200+0000","last_change":"2024-09-12T01:38:32.185200+0000","last_active":"2024-09-12T01:38:32.185200+0000","last_peered":"2024-09-12T01:38:32.185200+0000","last_clean":"2024-09-12T01:38:32.185200+0000","last_became_active":"2024-09-12T00:28:39.221007+0000","last_became_peered":"2024-09-12T00:28:39.221007+0000","last_unstale":"2024-09-12T01:38:32.185200+0000","last_undegraded":"2024-09-12T01:38:32.185200+0000","last_fullsized":"2024-09-12T01:38:32.185200+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:32.185094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:32.185094+0000","last_clean_scrub_stamp":"2024-09-12T01:38:32.185094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:27.219082+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"263'188","reported_seq":895,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:31.126430+0000","last_change":"2024-09-12T01:38:31.126430+0000","last_active":"2024-09-12T01:38:31.126430+0000","last_peered":"2024-09-12T01:38:31.126430+0000","last_clean":"2024-09-12T01:38:31.126430+0000","last_became_active":"2024-09-12T00:28:41.226077+0000","last_became_peered":"2024-09-12T00:28:41.226077+0000","last_unstale":"2024-09-12T01:38:31.126430+0000","last_undegraded":"2024-09-12T01:38:31.126430+0000","last_fullsized":"2024-09-12T01:38:31.126430+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'188","last_scrub_stamp":"2024-09-12T01:38:31.126335+0000","last_deep_scrub":"263'188","last_deep_scrub_stamp":"2024-09-12T01:38:31.126335+0000","last_clean_scrub_stamp":"2024-09-12T01:38:31.126335+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:42.617212+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":407,"num_read_kb":405,"num_write":366,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"263'200","reported_seq":817,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.045446+0000","last_change":"2024-09-12T01:38:13.045446+0000","last_active":"2024-09-12T01:38:13.045446+0000","last_peered":"2024-09-12T01:38:13.045446+0000","last_clean":"2024-09-12T01:38:13.045446+0000","last_became_active":"2024-09-12T00:28:33.214351+0000","last_became_peered":"2024-09-12T00:28:33.214351+0000","last_unstale":"2024-09-12T01:38:13.045446+0000","last_undegraded":"2024-09-12T01:38:13.045446+0000","last_fullsized":"2024-09-12T01:38:13.045446+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'200","last_scrub_stamp":"2024-09-12T01:38:13.045354+0000","last_deep_scrub":"263'200","last_deep_scrub_stamp":"2024-09-12T01:38:13.045354+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.045354+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:24.710351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":877,"num_read_kb":731,"num_write":291,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":532,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.289897+0000","last_change":"2024-09-12T01:38:13.289843+0000","last_active":"2024-09-12T01:38:13.289897+0000","last_peered":"2024-09-12T01:38:13.289897+0000","last_clean":"2024-09-12T01:38:13.289897+0000","last_became_active":"2024-09-12T00:28:19.164970+0000","last_became_peered":"2024-09-12T00:28:19.164970+0000","last_unstale":"2024-09-12T01:38:13.289897+0000","last_undegraded":"2024-09-12T01:38:13.289897+0000","last_fullsized":"2024-09-12T01:38:13.289897+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:13.289759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:13.289759+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.289759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:35.748664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055291100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"263'381","reported_seq":1121,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:08.100822+0000","last_change":"2024-09-12T01:38:08.100822+0000","last_active":"2024-09-12T01:38:08.100822+0000","last_peered":"2024-09-12T01:38:08.100822+0000","last_clean":"2024-09-12T01:38:08.100822+0000","last_became_active":"2024-09-12T00:28:31.204842+0000","last_became_peered":"2024-09-12T00:28:31.204842+0000","last_unstale":"2024-09-12T01:38:08.100822+0000","last_undegraded":"2024-09-12T01:38:08.100822+0000","last_fullsized":"2024-09-12T01:38:08.100822+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'381","last_scrub_stamp":"2024-09-12T01:38:08.100667+0000","last_deep_scrub":"263'381","last_deep_scrub_stamp":"2024-09-12T01:38:08.100667+0000","last_clean_scrub_stamp":"2024-09-12T01:38:08.100667+0000","objects_scrubbed":9,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:45.468456+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":699,"num_read_kb":44079,"num_write":1206,"num_write_kb":29123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:30.485847+0000","last_change":"2024-09-12T01:38:30.485847+0000","last_active":"2024-09-12T01:38:30.485847+0000","last_peered":"2024-09-12T01:38:30.485847+0000","last_clean":"2024-09-12T01:38:30.485847+0000","last_became_active":"2024-09-12T00:28:35.215063+0000","last_became_peered":"2024-09-12T00:28:35.215063+0000","last_unstale":"2024-09-12T01:38:30.485847+0000","last_undegraded":"2024-09-12T01:38:30.485847+0000","last_fullsized":"2024-09-12T01:38:30.485847+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:30.485747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:30.485747+0000","last_clean_scrub_stamp":"2024-09-12T01:38:30.485747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:05.406878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"263'1369","reported_seq":3172,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:27.034886+0000","last_change":"2024-09-12T01:38:27.034886+0000","last_active":"2024-09-12T01:38:27.034886+0000","last_peered":"2024-09-12T01:38:27.034886+0000","last_clean":"2024-09-12T01:38:27.034886+0000","last_became_active":"2024-09-12T00:28:37.211275+0000","last_became_peered":"2024-09-12T00:28:37.211275+0000","last_unstale":"2024-09-12T01:38:27.034886+0000","last_undegraded":"2024-09-12T01:38:27.034886+0000","last_fullsized":"2024-09-12T01:38:27.034886+0000","mapping_epoch":31,"log_start":"263'1300","ondisk_log_start":"263'1300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1369","last_scrub_stamp":"2024-09-12T01:38:27.034773+0000","last_deep_scrub":"263'1369","last_deep_scrub_stamp":"2024-09-12T01:38:27.034773+0000","last_clean_scrub_stamp":"2024-09-12T01:38:27.034773+0000","objects_scrubbed":12,"log_size":69,"log_dups_size":1300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:21.739062+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145911,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2184,"num_read_kb":4297,"num_write":1290,"num_write_kb":1091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.528471+0000","last_change":"2024-09-12T01:38:38.528471+0000","last_active":"2024-09-12T01:38:38.528471+0000","last_peered":"2024-09-12T01:38:38.528471+0000","last_clean":"2024-09-12T01:38:38.528471+0000","last_became_active":"2024-09-12T00:28:39.217623+0000","last_became_peered":"2024-09-12T00:28:39.217623+0000","last_unstale":"2024-09-12T01:38:38.528471+0000","last_undegraded":"2024-09-12T01:38:38.528471+0000","last_fullsized":"2024-09-12T01:38:38.528471+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:38.528383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:38.528383+0000","last_clean_scrub_stamp":"2024-09-12T01:38:38.528383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:06.478079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"263'263","reported_seq":816,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:33.895494+0000","last_change":"2024-09-12T01:38:33.895494+0000","last_active":"2024-09-12T01:38:33.895494+0000","last_peered":"2024-09-12T01:38:33.895494+0000","last_clean":"2024-09-12T01:38:33.895494+0000","last_became_active":"2024-09-12T00:28:41.254814+0000","last_became_peered":"2024-09-12T00:28:41.254814+0000","last_unstale":"2024-09-12T01:38:33.895494+0000","last_undegraded":"2024-09-12T01:38:33.895494+0000","last_fullsized":"2024-09-12T01:38:33.895494+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'263","last_scrub_stamp":"2024-09-12T01:38:33.895407+0000","last_deep_scrub":"263'263","last_deep_scrub_stamp":"2024-09-12T01:38:33.895407+0000","last_clean_scrub_stamp":"2024-09-12T01:38:33.895407+0000","objects_scrubbed":2,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:10.866925+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":416,"num_read_kb":400,"num_write":581,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"263'116","reported_seq":762,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.044813+0000","last_change":"2024-09-12T01:38:19.044813+0000","last_active":"2024-09-12T01:38:19.044813+0000","last_peered":"2024-09-12T01:38:19.044813+0000","last_clean":"2024-09-12T01:38:19.044813+0000","last_became_active":"2024-09-12T00:28:33.216335+0000","last_became_peered":"2024-09-12T00:28:33.216335+0000","last_unstale":"2024-09-12T01:38:19.044813+0000","last_undegraded":"2024-09-12T01:38:19.044813+0000","last_fullsized":"2024-09-12T01:38:19.044813+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'116","last_scrub_stamp":"2024-09-12T01:38:19.044713+0000","last_deep_scrub":"263'116","last_deep_scrub_stamp":"2024-09-12T01:38:19.044713+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.044713+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:33.501842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":537,"num_read_kb":460,"num_write":159,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":536,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:07.840574+0000","last_change":"2024-09-12T01:38:07.840574+0000","last_active":"2024-09-12T01:38:07.840574+0000","last_peered":"2024-09-12T01:38:07.840574+0000","last_clean":"2024-09-12T01:38:07.840574+0000","last_became_active":"2024-09-12T00:28:19.225901+0000","last_became_peered":"2024-09-12T00:28:19.225901+0000","last_unstale":"2024-09-12T01:38:07.840574+0000","last_undegraded":"2024-09-12T01:38:07.840574+0000","last_fullsized":"2024-09-12T01:38:07.840574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:07.840493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:07.840493+0000","last_clean_scrub_stamp":"2024-09-12T01:38:07.840493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:17.786493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032319500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"263'346","reported_seq":1154,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:08.229237+0000","last_change":"2024-09-12T01:38:08.229143+0000","last_active":"2024-09-12T01:38:08.229237+0000","last_peered":"2024-09-12T01:38:08.229237+0000","last_clean":"2024-09-12T01:38:08.229237+0000","last_became_active":"2024-09-12T00:28:31.198575+0000","last_became_peered":"2024-09-12T00:28:31.198575+0000","last_unstale":"2024-09-12T01:38:08.229237+0000","last_undegraded":"2024-09-12T01:38:08.229237+0000","last_fullsized":"2024-09-12T01:38:08.229237+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'346","last_scrub_stamp":"2024-09-12T01:38:08.229006+0000","last_deep_scrub":"263'346","last_deep_scrub_stamp":"2024-09-12T01:38:08.229006+0000","last_clean_scrub_stamp":"2024-09-12T01:38:08.229006+0000","objects_scrubbed":9,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:39.417199+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3941571,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":832,"num_read_kb":78199,"num_write":1073,"num_write_kb":40255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"263'2","reported_seq":514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.734864+0000","last_change":"2024-09-12T01:38:13.734864+0000","last_active":"2024-09-12T01:38:13.734864+0000","last_peered":"2024-09-12T01:38:13.734864+0000","last_clean":"2024-09-12T01:38:13.734864+0000","last_became_active":"2024-09-12T00:28:35.209218+0000","last_became_peered":"2024-09-12T00:28:35.209218+0000","last_unstale":"2024-09-12T01:38:13.734864+0000","last_undegraded":"2024-09-12T01:38:13.734864+0000","last_fullsized":"2024-09-12T01:38:13.734864+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:38:13.734781+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:38:13.734781+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.734781+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:29.932696+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"263'288","reported_seq":1675,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:32.372392+0000","last_change":"2024-09-12T01:38:32.372392+0000","last_active":"2024-09-12T01:38:32.372392+0000","last_peered":"2024-09-12T01:38:32.372392+0000","last_clean":"2024-09-12T01:38:32.372392+0000","last_became_active":"2024-09-12T00:28:37.423714+0000","last_became_peered":"2024-09-12T00:28:37.423714+0000","last_unstale":"2024-09-12T01:38:32.372392+0000","last_undegraded":"2024-09-12T01:38:32.372392+0000","last_fullsized":"2024-09-12T01:38:32.372392+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'288","last_scrub_stamp":"2024-09-12T01:38:32.372285+0000","last_deep_scrub":"263'288","last_deep_scrub_stamp":"2024-09-12T01:38:32.372285+0000","last_clean_scrub_stamp":"2024-09-12T01:38:32.372285+0000","objects_scrubbed":9,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:50.426218+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":244,"num_read_kb":234,"num_write":227,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5400,"num_omap_keys":12,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:31.155694+0000","last_change":"2024-09-12T01:38:31.155694+0000","last_active":"2024-09-12T01:38:31.155694+0000","last_peered":"2024-09-12T01:38:31.155694+0000","last_clean":"2024-09-12T01:38:31.155694+0000","last_became_active":"2024-09-12T00:28:39.218692+0000","last_became_peered":"2024-09-12T00:28:39.218692+0000","last_unstale":"2024-09-12T01:38:31.155694+0000","last_undegraded":"2024-09-12T01:38:31.155694+0000","last_fullsized":"2024-09-12T01:38:31.155694+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:31.155598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:31.155598+0000","last_clean_scrub_stamp":"2024-09-12T01:38:31.155598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:44.466356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"263'254","reported_seq":866,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:45.359267+0000","last_change":"2024-09-12T01:38:45.359267+0000","last_active":"2024-09-12T01:38:45.359267+0000","last_peered":"2024-09-12T01:38:45.359267+0000","last_clean":"2024-09-12T01:38:45.359267+0000","last_became_active":"2024-09-12T00:28:41.229441+0000","last_became_peered":"2024-09-12T00:28:41.229441+0000","last_unstale":"2024-09-12T01:38:45.359267+0000","last_undegraded":"2024-09-12T01:38:45.359267+0000","last_fullsized":"2024-09-12T01:38:45.359267+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'254","last_scrub_stamp":"2024-09-12T01:38:45.359172+0000","last_deep_scrub":"263'254","last_deep_scrub_stamp":"2024-09-12T01:38:45.359172+0000","last_clean_scrub_stamp":"2024-09-12T01:38:45.359172+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:18.672581+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":487,"num_read_kb":509,"num_write":546,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"263'224","reported_seq":905,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.182019+0000","last_change":"2024-09-12T01:38:14.182019+0000","last_active":"2024-09-12T01:38:14.182019+0000","last_peered":"2024-09-12T01:38:14.182019+0000","last_clean":"2024-09-12T01:38:14.182019+0000","last_became_active":"2024-09-12T00:28:33.205107+0000","last_became_peered":"2024-09-12T00:28:33.205107+0000","last_unstale":"2024-09-12T01:38:14.182019+0000","last_undegraded":"2024-09-12T01:38:14.182019+0000","last_fullsized":"2024-09-12T01:38:14.182019+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'224","last_scrub_stamp":"2024-09-12T01:38:14.181928+0000","last_deep_scrub":"263'224","last_deep_scrub_stamp":"2024-09-12T01:38:14.181928+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.181928+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:53.395317+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1021,"num_read_kb":847,"num_write":335,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":465,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"263'3","reported_seq":532,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:09.217929+0000","last_change":"2024-09-12T01:38:09.217929+0000","last_active":"2024-09-12T01:38:09.217929+0000","last_peered":"2024-09-12T01:38:09.217929+0000","last_clean":"2024-09-12T01:38:09.217929+0000","last_became_active":"2024-09-12T00:28:19.162307+0000","last_became_peered":"2024-09-12T00:28:19.162307+0000","last_unstale":"2024-09-12T01:38:09.217929+0000","last_undegraded":"2024-09-12T01:38:09.217929+0000","last_fullsized":"2024-09-12T01:38:09.217929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-12T01:38:09.217852+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-12T01:38:09.217852+0000","last_clean_scrub_stamp":"2024-09-12T01:38:09.217852+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:31.504965+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00089189499999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"263'359","reported_seq":1051,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:08.508023+0000","last_change":"2024-09-12T01:38:08.508023+0000","last_active":"2024-09-12T01:38:08.508023+0000","last_peered":"2024-09-12T01:38:08.508023+0000","last_clean":"2024-09-12T01:38:08.508023+0000","last_became_active":"2024-09-12T00:28:31.208584+0000","last_became_peered":"2024-09-12T00:28:31.208584+0000","last_unstale":"2024-09-12T01:38:08.508023+0000","last_undegraded":"2024-09-12T01:38:08.508023+0000","last_fullsized":"2024-09-12T01:38:08.508023+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'359","last_scrub_stamp":"2024-09-12T01:38:08.507897+0000","last_deep_scrub":"263'359","last_deep_scrub_stamp":"2024-09-12T01:38:08.507897+0000","last_clean_scrub_stamp":"2024-09-12T01:38:08.507897+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:25.206563+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262163,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":641,"num_read_kb":7750,"num_write":1122,"num_write_kb":19514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:33.223461+0000","last_change":"2024-09-12T01:38:33.223461+0000","last_active":"2024-09-12T01:38:33.223461+0000","last_peered":"2024-09-12T01:38:33.223461+0000","last_clean":"2024-09-12T01:38:33.223461+0000","last_became_active":"2024-09-12T00:28:35.207234+0000","last_became_peered":"2024-09-12T00:28:35.207234+0000","last_unstale":"2024-09-12T01:38:33.223461+0000","last_undegraded":"2024-09-12T01:38:33.223461+0000","last_fullsized":"2024-09-12T01:38:33.223461+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:33.223375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:33.223375+0000","last_clean_scrub_stamp":"2024-09-12T01:38:33.223375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:23.217201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"263'167","reported_seq":732,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:32.352500+0000","last_change":"2024-09-12T01:38:32.352500+0000","last_active":"2024-09-12T01:38:32.352500+0000","last_peered":"2024-09-12T01:38:32.352500+0000","last_clean":"2024-09-12T01:38:32.352500+0000","last_became_active":"2024-09-12T00:28:37.219599+0000","last_became_peered":"2024-09-12T00:28:37.219599+0000","last_unstale":"2024-09-12T01:38:32.352500+0000","last_undegraded":"2024-09-12T01:38:32.352500+0000","last_fullsized":"2024-09-12T01:38:32.352500+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'167","last_scrub_stamp":"2024-09-12T01:38:32.352382+0000","last_deep_scrub":"263'167","last_deep_scrub_stamp":"2024-09-12T01:38:32.352382+0000","last_clean_scrub_stamp":"2024-09-12T01:38:32.352382+0000","objects_scrubbed":7,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:57.832189+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":184,"num_read_kb":176,"num_write":136,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3358,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:36.068291+0000","last_change":"2024-09-12T01:38:36.068291+0000","last_active":"2024-09-12T01:38:36.068291+0000","last_peered":"2024-09-12T01:38:36.068291+0000","last_clean":"2024-09-12T01:38:36.068291+0000","last_became_active":"2024-09-12T00:28:39.216397+0000","last_became_peered":"2024-09-12T00:28:39.216397+0000","last_unstale":"2024-09-12T01:38:36.068291+0000","last_undegraded":"2024-09-12T01:38:36.068291+0000","last_fullsized":"2024-09-12T01:38:36.068291+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:36.068187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:36.068187+0000","last_clean_scrub_stamp":"2024-09-12T01:38:36.068187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:58.308228+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"263'110","reported_seq":663,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:43.482660+0000","last_change":"2024-09-12T01:38:43.482660+0000","last_active":"2024-09-12T01:38:43.482660+0000","last_peered":"2024-09-12T01:38:43.482660+0000","last_clean":"2024-09-12T01:38:43.482660+0000","last_became_active":"2024-09-12T00:28:41.230698+0000","last_became_peered":"2024-09-12T00:28:41.230698+0000","last_unstale":"2024-09-12T01:38:43.482660+0000","last_undegraded":"2024-09-12T01:38:43.482660+0000","last_fullsized":"2024-09-12T01:38:43.482660+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'110","last_scrub_stamp":"2024-09-12T01:38:43.482572+0000","last_deep_scrub":"263'110","last_deep_scrub_stamp":"2024-09-12T01:38:43.482572+0000","last_clean_scrub_stamp":"2024-09-12T01:38:43.482572+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:32.770121+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":194,"num_write":246,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"263'101","reported_seq":695,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.032734+0000","last_change":"2024-09-12T01:38:18.032734+0000","last_active":"2024-09-12T01:38:18.032734+0000","last_peered":"2024-09-12T01:38:18.032734+0000","last_clean":"2024-09-12T01:38:18.032734+0000","last_became_active":"2024-09-12T00:28:33.213241+0000","last_became_peered":"2024-09-12T00:28:33.213241+0000","last_unstale":"2024-09-12T01:38:18.032734+0000","last_undegraded":"2024-09-12T01:38:18.032734+0000","last_fullsized":"2024-09-12T01:38:18.032734+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'101","last_scrub_stamp":"2024-09-12T01:38:18.032630+0000","last_deep_scrub":"263'101","last_deep_scrub_stamp":"2024-09-12T01:38:18.032630+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.032630+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:48.287686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":440,"num_read_kb":364,"num_write":181,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"263'335","reported_seq":959,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.220801+0000","last_change":"2024-09-12T01:38:10.220801+0000","last_active":"2024-09-12T01:38:10.220801+0000","last_peered":"2024-09-12T01:38:10.220801+0000","last_clean":"2024-09-12T01:38:10.220801+0000","last_became_active":"2024-09-12T00:28:31.209154+0000","last_became_peered":"2024-09-12T00:28:31.209154+0000","last_unstale":"2024-09-12T01:38:10.220801+0000","last_undegraded":"2024-09-12T01:38:10.220801+0000","last_fullsized":"2024-09-12T01:38:10.220801+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'335","last_scrub_stamp":"2024-09-12T01:38:10.220717+0000","last_deep_scrub":"263'335","last_deep_scrub_stamp":"2024-09-12T01:38:10.220717+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.220717+0000","objects_scrubbed":6,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:59.487021+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":854338,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":445,"num_read_kb":910,"num_write":1009,"num_write_kb":5944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":541,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.186088+0000","last_change":"2024-09-12T01:38:10.186088+0000","last_active":"2024-09-12T01:38:10.186088+0000","last_peered":"2024-09-12T01:38:10.186088+0000","last_clean":"2024-09-12T01:38:10.186088+0000","last_became_active":"2024-09-12T00:28:19.383394+0000","last_became_peered":"2024-09-12T00:28:19.383394+0000","last_unstale":"2024-09-12T01:38:10.186088+0000","last_undegraded":"2024-09-12T01:38:10.186088+0000","last_fullsized":"2024-09-12T01:38:10.186088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.186021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.186021+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.186021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:10.372021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046548800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:30.136109+0000","last_change":"2024-09-12T01:38:30.136109+0000","last_active":"2024-09-12T01:38:30.136109+0000","last_peered":"2024-09-12T01:38:30.136109+0000","last_clean":"2024-09-12T01:38:30.136109+0000","last_became_active":"2024-09-12T00:28:35.208094+0000","last_became_peered":"2024-09-12T00:28:35.208094+0000","last_unstale":"2024-09-12T01:38:30.136109+0000","last_undegraded":"2024-09-12T01:38:30.136109+0000","last_fullsized":"2024-09-12T01:38:30.136109+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:30.136033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:30.136033+0000","last_clean_scrub_stamp":"2024-09-12T01:38:30.136033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:36.139933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"263'664","reported_seq":1366,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:24.148699+0000","last_change":"2024-09-12T01:38:24.148638+0000","last_active":"2024-09-12T01:38:24.148699+0000","last_peered":"2024-09-12T01:38:24.148699+0000","last_clean":"2024-09-12T01:38:24.148699+0000","last_became_active":"2024-09-12T00:28:37.220158+0000","last_became_peered":"2024-09-12T00:28:37.220158+0000","last_unstale":"2024-09-12T01:38:24.148699+0000","last_undegraded":"2024-09-12T01:38:24.148699+0000","last_fullsized":"2024-09-12T01:38:24.148699+0000","mapping_epoch":31,"log_start":"263'600","ondisk_log_start":"263'600","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'664","last_scrub_stamp":"2024-09-12T01:38:24.148534+0000","last_deep_scrub":"263'664","last_deep_scrub_stamp":"2024-09-12T01:38:24.148534+0000","last_clean_scrub_stamp":"2024-09-12T01:38:24.148534+0000","objects_scrubbed":11,"log_size":64,"log_dups_size":600,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:38.824218+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103952,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1701,"num_read_kb":3039,"num_write":2184,"num_write_kb":1992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":500702,"num_omap_keys":1132,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.513767+0000","last_change":"2024-09-12T01:38:37.513767+0000","last_active":"2024-09-12T01:38:37.513767+0000","last_peered":"2024-09-12T01:38:37.513767+0000","last_clean":"2024-09-12T01:38:37.513767+0000","last_became_active":"2024-09-12T00:28:39.220079+0000","last_became_peered":"2024-09-12T00:28:39.220079+0000","last_unstale":"2024-09-12T01:38:37.513767+0000","last_undegraded":"2024-09-12T01:38:37.513767+0000","last_fullsized":"2024-09-12T01:38:37.513767+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:37.513687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:37.513687+0000","last_clean_scrub_stamp":"2024-09-12T01:38:37.513687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:54.862533+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"263'137","reported_seq":665,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:43.197697+0000","last_change":"2024-09-12T01:38:43.197697+0000","last_active":"2024-09-12T01:38:43.197697+0000","last_peered":"2024-09-12T01:38:43.197697+0000","last_clean":"2024-09-12T01:38:43.197697+0000","last_became_active":"2024-09-12T00:28:41.257739+0000","last_became_peered":"2024-09-12T00:28:41.257739+0000","last_unstale":"2024-09-12T01:38:43.197697+0000","last_undegraded":"2024-09-12T01:38:43.197697+0000","last_fullsized":"2024-09-12T01:38:43.197697+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'137","last_scrub_stamp":"2024-09-12T01:38:43.197610+0000","last_deep_scrub":"263'137","last_deep_scrub_stamp":"2024-09-12T01:38:43.197610+0000","last_clean_scrub_stamp":"2024-09-12T01:38:43.197610+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:16.433171+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":203,"num_read_kb":182,"num_write":334,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"263'142","reported_seq":783,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.185063+0000","last_change":"2024-09-12T01:38:22.185063+0000","last_active":"2024-09-12T01:38:22.185063+0000","last_peered":"2024-09-12T01:38:22.185063+0000","last_clean":"2024-09-12T01:38:22.185063+0000","last_became_active":"2024-09-12T00:28:33.216065+0000","last_became_peered":"2024-09-12T00:28:33.216065+0000","last_unstale":"2024-09-12T01:38:22.185063+0000","last_undegraded":"2024-09-12T01:38:22.185063+0000","last_fullsized":"2024-09-12T01:38:22.185063+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'142","last_scrub_stamp":"2024-09-12T01:38:22.184985+0000","last_deep_scrub":"263'142","last_deep_scrub_stamp":"2024-09-12T01:38:22.184985+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.184985+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:25.280489+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":614,"num_read_kb":525,"num_write":208,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"263'345","reported_seq":1013,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:09.220565+0000","last_change":"2024-09-12T01:38:09.220565+0000","last_active":"2024-09-12T01:38:09.220565+0000","last_peered":"2024-09-12T01:38:09.220565+0000","last_clean":"2024-09-12T01:38:09.220565+0000","last_became_active":"2024-09-12T00:28:31.198681+0000","last_became_peered":"2024-09-12T00:28:31.198681+0000","last_unstale":"2024-09-12T01:38:09.220565+0000","last_undegraded":"2024-09-12T01:38:09.220565+0000","last_fullsized":"2024-09-12T01:38:09.220565+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'345","last_scrub_stamp":"2024-09-12T01:38:09.220489+0000","last_deep_scrub":"263'345","last_deep_scrub_stamp":"2024-09-12T01:38:09.220489+0000","last_clean_scrub_stamp":"2024-09-12T01:38:09.220489+0000","objects_scrubbed":5,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:20.626502+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550835,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":482,"num_read_kb":38182,"num_write":1051,"num_write_kb":26889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":530,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.230605+0000","last_change":"2024-09-12T01:38:10.230605+0000","last_active":"2024-09-12T01:38:10.230605+0000","last_peered":"2024-09-12T01:38:10.230605+0000","last_clean":"2024-09-12T01:38:10.230605+0000","last_became_active":"2024-09-12T00:28:19.384222+0000","last_became_peered":"2024-09-12T00:28:19.384222+0000","last_unstale":"2024-09-12T01:38:10.230605+0000","last_undegraded":"2024-09-12T01:38:10.230605+0000","last_fullsized":"2024-09-12T01:38:10.230605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.230512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.230512+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.230512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:30.488629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060999899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"263'6","reported_seq":991,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.212001+0000","last_change":"2024-09-12T01:38:21.212001+0000","last_active":"2024-09-12T01:38:21.212001+0000","last_peered":"2024-09-12T01:38:21.212001+0000","last_clean":"2024-09-12T01:38:21.212001+0000","last_became_active":"2024-09-12T00:28:35.207941+0000","last_became_peered":"2024-09-12T00:28:35.207941+0000","last_unstale":"2024-09-12T01:38:21.212001+0000","last_undegraded":"2024-09-12T01:38:21.212001+0000","last_fullsized":"2024-09-12T01:38:21.212001+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-12T01:38:21.211920+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-12T01:38:21.211920+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.211920+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:16.655918+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":1191,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"263'255","reported_seq":856,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:29.008482+0000","last_change":"2024-09-12T01:38:29.008482+0000","last_active":"2024-09-12T01:38:29.008482+0000","last_peered":"2024-09-12T01:38:29.008482+0000","last_clean":"2024-09-12T01:38:29.008482+0000","last_became_active":"2024-09-12T00:28:37.423835+0000","last_became_peered":"2024-09-12T00:28:37.423835+0000","last_unstale":"2024-09-12T01:38:29.008482+0000","last_undegraded":"2024-09-12T01:38:29.008482+0000","last_fullsized":"2024-09-12T01:38:29.008482+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'255","last_scrub_stamp":"2024-09-12T01:38:29.008384+0000","last_deep_scrub":"263'255","last_deep_scrub_stamp":"2024-09-12T01:38:29.008384+0000","last_clean_scrub_stamp":"2024-09-12T01:38:29.008384+0000","objects_scrubbed":9,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:41.255615+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":310,"num_read_kb":301,"num_write":288,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6272,"num_omap_keys":14,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"263'782","reported_seq":2906,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:41.412386+0000","last_change":"2024-09-12T01:38:41.412319+0000","last_active":"2024-09-12T01:38:41.412386+0000","last_peered":"2024-09-12T01:38:41.412386+0000","last_clean":"2024-09-12T01:38:41.412386+0000","last_became_active":"2024-09-12T00:28:39.214050+0000","last_became_peered":"2024-09-12T00:28:39.214050+0000","last_unstale":"2024-09-12T01:38:41.412386+0000","last_undegraded":"2024-09-12T01:38:41.412386+0000","last_fullsized":"2024-09-12T01:38:41.412386+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'782","last_scrub_stamp":"2024-09-12T01:38:41.412225+0000","last_deep_scrub":"263'782","last_deep_scrub_stamp":"2024-09-12T01:38:41.412225+0000","last_clean_scrub_stamp":"2024-09-12T01:38:41.412225+0000","objects_scrubbed":1,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:41.656900+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"263'149","reported_seq":671,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:46.340927+0000","last_change":"2024-09-12T01:38:46.340927+0000","last_active":"2024-09-12T01:38:46.340927+0000","last_peered":"2024-09-12T01:38:46.340927+0000","last_clean":"2024-09-12T01:38:46.340927+0000","last_became_active":"2024-09-12T00:28:41.254826+0000","last_became_peered":"2024-09-12T00:28:41.254826+0000","last_unstale":"2024-09-12T01:38:46.340927+0000","last_undegraded":"2024-09-12T01:38:46.340927+0000","last_fullsized":"2024-09-12T01:38:46.340927+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'149","last_scrub_stamp":"2024-09-12T01:38:46.340827+0000","last_deep_scrub":"263'149","last_deep_scrub_stamp":"2024-09-12T01:38:46.340827+0000","last_clean_scrub_stamp":"2024-09-12T01:38:46.340827+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:46.908185+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1298,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":177,"num_read_kb":162,"num_write":341,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"263'307","reported_seq":919,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:26.301083+0000","last_change":"2024-09-12T01:38:26.300995+0000","last_active":"2024-09-12T01:38:26.301083+0000","last_peered":"2024-09-12T01:38:26.301083+0000","last_clean":"2024-09-12T01:38:26.301083+0000","last_became_active":"2024-09-12T00:28:33.217516+0000","last_became_peered":"2024-09-12T00:28:33.217516+0000","last_unstale":"2024-09-12T01:38:26.301083+0000","last_undegraded":"2024-09-12T01:38:26.301083+0000","last_fullsized":"2024-09-12T01:38:26.301083+0000","mapping_epoch":27,"log_start":"260'200","ondisk_log_start":"260'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'307","last_scrub_stamp":"2024-09-12T01:38:26.300887+0000","last_deep_scrub":"263'307","last_deep_scrub_stamp":"2024-09-12T01:38:26.300887+0000","last_clean_scrub_stamp":"2024-09-12T01:38:26.300887+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:46.021127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1312,"num_read_kb":1045,"num_write":501,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"263'312","reported_seq":914,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:08.232707+0000","last_change":"2024-09-12T01:38:08.232707+0000","last_active":"2024-09-12T01:38:08.232707+0000","last_peered":"2024-09-12T01:38:08.232707+0000","last_clean":"2024-09-12T01:38:08.232707+0000","last_became_active":"2024-09-12T00:28:31.202895+0000","last_became_peered":"2024-09-12T00:28:31.202895+0000","last_unstale":"2024-09-12T01:38:08.232707+0000","last_undegraded":"2024-09-12T01:38:08.232707+0000","last_fullsized":"2024-09-12T01:38:08.232707+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'312","last_scrub_stamp":"2024-09-12T01:38:08.232586+0000","last_deep_scrub":"263'312","last_deep_scrub_stamp":"2024-09-12T01:38:08.232586+0000","last_clean_scrub_stamp":"2024-09-12T01:38:08.232586+0000","objects_scrubbed":7,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:08.573915+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262178,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":365,"num_read_kb":358,"num_write":953,"num_write_kb":25812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":540,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:07.216544+0000","last_change":"2024-09-12T01:38:07.216544+0000","last_active":"2024-09-12T01:38:07.216544+0000","last_peered":"2024-09-12T01:38:07.216544+0000","last_clean":"2024-09-12T01:38:07.216544+0000","last_became_active":"2024-09-12T00:28:19.160344+0000","last_became_peered":"2024-09-12T00:28:19.160344+0000","last_unstale":"2024-09-12T01:38:07.216544+0000","last_undegraded":"2024-09-12T01:38:07.216544+0000","last_fullsized":"2024-09-12T01:38:07.216544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:07.216476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:07.216476+0000","last_clean_scrub_stamp":"2024-09-12T01:38:07.216476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:01.774688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000483707,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":512,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:28.486392+0000","last_change":"2024-09-12T01:38:28.486392+0000","last_active":"2024-09-12T01:38:28.486392+0000","last_peered":"2024-09-12T01:38:28.486392+0000","last_clean":"2024-09-12T01:38:28.486392+0000","last_became_active":"2024-09-12T00:28:35.215429+0000","last_became_peered":"2024-09-12T00:28:35.215429+0000","last_unstale":"2024-09-12T01:38:28.486392+0000","last_undegraded":"2024-09-12T01:38:28.486392+0000","last_fullsized":"2024-09-12T01:38:28.486392+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:28.486306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:28.486306+0000","last_clean_scrub_stamp":"2024-09-12T01:38:28.486306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:36.724669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"263'136","reported_seq":701,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:31.537832+0000","last_change":"2024-09-12T01:38:31.537832+0000","last_active":"2024-09-12T01:38:31.537832+0000","last_peered":"2024-09-12T01:38:31.537832+0000","last_clean":"2024-09-12T01:38:31.537832+0000","last_became_active":"2024-09-12T00:28:37.219746+0000","last_became_peered":"2024-09-12T00:28:37.219746+0000","last_unstale":"2024-09-12T01:38:31.537832+0000","last_undegraded":"2024-09-12T01:38:31.537832+0000","last_fullsized":"2024-09-12T01:38:31.537832+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'136","last_scrub_stamp":"2024-09-12T01:38:31.537717+0000","last_deep_scrub":"263'136","last_deep_scrub_stamp":"2024-09-12T01:38:31.537717+0000","last_clean_scrub_stamp":"2024-09-12T01:38:31.537717+0000","objects_scrubbed":6,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:10.135264+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":158,"num_read_kb":152,"num_write":104,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"263'770","reported_seq":2693,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:42.330443+0000","last_change":"2024-09-12T01:38:42.330443+0000","last_active":"2024-09-12T01:38:42.330443+0000","last_peered":"2024-09-12T01:38:42.330443+0000","last_clean":"2024-09-12T01:38:42.330443+0000","last_became_active":"2024-09-12T00:28:39.218170+0000","last_became_peered":"2024-09-12T00:28:39.218170+0000","last_unstale":"2024-09-12T01:38:42.330443+0000","last_undegraded":"2024-09-12T01:38:42.330443+0000","last_fullsized":"2024-09-12T01:38:42.330443+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'770","last_scrub_stamp":"2024-09-12T01:38:42.330341+0000","last_deep_scrub":"263'770","last_deep_scrub_stamp":"2024-09-12T01:38:42.330341+0000","last_clean_scrub_stamp":"2024-09-12T01:38:42.330341+0000","objects_scrubbed":1,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:59.497009+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"263'184","reported_seq":692,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:42.205417+0000","last_change":"2024-09-12T01:38:42.205417+0000","last_active":"2024-09-12T01:38:42.205417+0000","last_peered":"2024-09-12T01:38:42.205417+0000","last_clean":"2024-09-12T01:38:42.205417+0000","last_became_active":"2024-09-12T00:28:41.225316+0000","last_became_peered":"2024-09-12T00:28:41.225316+0000","last_unstale":"2024-09-12T01:38:42.205417+0000","last_undegraded":"2024-09-12T01:38:42.205417+0000","last_fullsized":"2024-09-12T01:38:42.205417+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'184","last_scrub_stamp":"2024-09-12T01:38:42.205295+0000","last_deep_scrub":"263'184","last_deep_scrub_stamp":"2024-09-12T01:38:42.205295+0000","last_clean_scrub_stamp":"2024-09-12T01:38:42.205295+0000","objects_scrubbed":3,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:55:54.093132+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":127,"num_read_kb":125,"num_write":428,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"263'343","reported_seq":987,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.498869+0000","last_change":"2024-09-12T01:38:20.498869+0000","last_active":"2024-09-12T01:38:20.498869+0000","last_peered":"2024-09-12T01:38:20.498869+0000","last_clean":"2024-09-12T01:38:20.498869+0000","last_became_active":"2024-09-12T00:28:33.212624+0000","last_became_peered":"2024-09-12T00:28:33.212624+0000","last_unstale":"2024-09-12T01:38:20.498869+0000","last_undegraded":"2024-09-12T01:38:20.498869+0000","last_fullsized":"2024-09-12T01:38:20.498869+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'343","last_scrub_stamp":"2024-09-12T01:38:20.498766+0000","last_deep_scrub":"263'343","last_deep_scrub_stamp":"2024-09-12T01:38:20.498766+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.498766+0000","objects_scrubbed":1,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:22.317000+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1481,"num_read_kb":1196,"num_write":544,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8074,"num_omap_keys":32,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"263'460","reported_seq":1183,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:07.124158+0000","last_change":"2024-09-12T01:38:07.124158+0000","last_active":"2024-09-12T01:38:07.124158+0000","last_peered":"2024-09-12T01:38:07.124158+0000","last_clean":"2024-09-12T01:38:07.124158+0000","last_became_active":"2024-09-12T00:28:31.203087+0000","last_became_peered":"2024-09-12T00:28:31.203087+0000","last_unstale":"2024-09-12T01:38:07.124158+0000","last_undegraded":"2024-09-12T01:38:07.124158+0000","last_fullsized":"2024-09-12T01:38:07.124158+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'460","last_scrub_stamp":"2024-09-12T01:38:07.124064+0000","last_deep_scrub":"263'460","last_deep_scrub_stamp":"2024-09-12T01:38:07.124064+0000","last_clean_scrub_stamp":"2024-09-12T01:38:07.124064+0000","objects_scrubbed":11,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:46.650060+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":607243,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":857,"num_read_kb":36686,"num_write":1272,"num_write_kb":31229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":531,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:09.149142+0000","last_change":"2024-09-12T01:38:09.149142+0000","last_active":"2024-09-12T01:38:09.149142+0000","last_peered":"2024-09-12T01:38:09.149142+0000","last_clean":"2024-09-12T01:38:09.149142+0000","last_became_active":"2024-09-12T00:28:19.162886+0000","last_became_peered":"2024-09-12T00:28:19.162886+0000","last_unstale":"2024-09-12T01:38:09.149142+0000","last_undegraded":"2024-09-12T01:38:09.149142+0000","last_fullsized":"2024-09-12T01:38:09.149142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:09.149026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:09.149026+0000","last_clean_scrub_stamp":"2024-09-12T01:38:09.149026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:10.471474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044054899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:29.289058+0000","last_change":"2024-09-12T01:38:29.289000+0000","last_active":"2024-09-12T01:38:29.289058+0000","last_peered":"2024-09-12T01:38:29.289058+0000","last_clean":"2024-09-12T01:38:29.289058+0000","last_became_active":"2024-09-12T00:28:35.212916+0000","last_became_peered":"2024-09-12T00:28:35.212916+0000","last_unstale":"2024-09-12T01:38:29.289058+0000","last_undegraded":"2024-09-12T01:38:29.289058+0000","last_fullsized":"2024-09-12T01:38:29.289058+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:29.288919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:29.288919+0000","last_clean_scrub_stamp":"2024-09-12T01:38:29.288919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:34.426132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"263'769","reported_seq":1515,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:30.418704+0000","last_change":"2024-09-12T01:38:30.418704+0000","last_active":"2024-09-12T01:38:30.418704+0000","last_peered":"2024-09-12T01:38:30.418704+0000","last_clean":"2024-09-12T01:38:30.418704+0000","last_became_active":"2024-09-12T00:28:37.423755+0000","last_became_peered":"2024-09-12T00:28:37.423755+0000","last_unstale":"2024-09-12T01:38:30.418704+0000","last_undegraded":"2024-09-12T01:38:30.418704+0000","last_fullsized":"2024-09-12T01:38:30.418704+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'769","last_scrub_stamp":"2024-09-12T01:38:30.418598+0000","last_deep_scrub":"263'769","last_deep_scrub_stamp":"2024-09-12T01:38:30.418598+0000","last_clean_scrub_stamp":"2024-09-12T01:38:30.418598+0000","objects_scrubbed":9,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:21.805625+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138292,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1365,"num_read_kb":3277,"num_write":1104,"num_write_kb":888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.321038+0000","last_change":"2024-09-12T01:38:38.321038+0000","last_active":"2024-09-12T01:38:38.321038+0000","last_peered":"2024-09-12T01:38:38.321038+0000","last_clean":"2024-09-12T01:38:38.321038+0000","last_became_active":"2024-09-12T00:28:39.216237+0000","last_became_peered":"2024-09-12T00:28:39.216237+0000","last_unstale":"2024-09-12T01:38:38.321038+0000","last_undegraded":"2024-09-12T01:38:38.321038+0000","last_fullsized":"2024-09-12T01:38:38.321038+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:38.320945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:38.320945+0000","last_clean_scrub_stamp":"2024-09-12T01:38:38.320945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:09.757679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"263'85","reported_seq":586,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:45.510855+0000","last_change":"2024-09-12T01:38:45.510855+0000","last_active":"2024-09-12T01:38:45.510855+0000","last_peered":"2024-09-12T01:38:45.510855+0000","last_clean":"2024-09-12T01:38:45.510855+0000","last_became_active":"2024-09-12T00:28:41.233696+0000","last_became_peered":"2024-09-12T00:28:41.233696+0000","last_unstale":"2024-09-12T01:38:45.510855+0000","last_undegraded":"2024-09-12T01:38:45.510855+0000","last_fullsized":"2024-09-12T01:38:45.510855+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'85","last_scrub_stamp":"2024-09-12T01:38:45.510771+0000","last_deep_scrub":"263'85","last_deep_scrub_stamp":"2024-09-12T01:38:45.510771+0000","last_clean_scrub_stamp":"2024-09-12T01:38:45.510771+0000","objects_scrubbed":2,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:06.853210+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":84,"num_read_kb":82,"num_write":190,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"263'149","reported_seq":715,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:42.805442+0000","last_change":"2024-09-12T00:28:41.226966+0000","last_active":"2024-09-12T01:36:42.805442+0000","last_peered":"2024-09-12T01:36:42.805442+0000","last_clean":"2024-09-12T01:36:42.805442+0000","last_became_active":"2024-09-12T00:28:41.226143+0000","last_became_peered":"2024-09-12T00:28:41.226143+0000","last_unstale":"2024-09-12T01:36:42.805442+0000","last_undegraded":"2024-09-12T01:36:42.805442+0000","last_fullsized":"2024-09-12T01:36:42.805442+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:40.202127+0000","last_clean_scrub_stamp":"2024-09-12T00:28:40.202127+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:18.139245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":251,"num_read_kb":240,"num_write":350,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"263'64","reported_seq":629,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.544728+0000","last_change":"2024-09-12T01:38:14.544633+0000","last_active":"2024-09-12T01:38:14.544728+0000","last_peered":"2024-09-12T01:38:14.544728+0000","last_clean":"2024-09-12T01:38:14.544728+0000","last_became_active":"2024-09-12T00:28:33.209335+0000","last_became_peered":"2024-09-12T00:28:33.209335+0000","last_unstale":"2024-09-12T01:38:14.544728+0000","last_undegraded":"2024-09-12T01:38:14.544728+0000","last_fullsized":"2024-09-12T01:38:14.544728+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'64","last_scrub_stamp":"2024-09-12T01:38:14.544539+0000","last_deep_scrub":"263'64","last_deep_scrub_stamp":"2024-09-12T01:38:14.544539+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.544539+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:01.588201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":218,"num_write":93,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"263'395","reported_seq":1084,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.703424+0000","last_change":"2024-09-12T01:38:19.703424+0000","last_active":"2024-09-12T01:38:19.703424+0000","last_peered":"2024-09-12T01:38:19.703424+0000","last_clean":"2024-09-12T01:38:19.703424+0000","last_became_active":"2024-09-12T00:29:04.295676+0000","last_became_peered":"2024-09-12T00:29:04.295676+0000","last_unstale":"2024-09-12T01:38:19.703424+0000","last_undegraded":"2024-09-12T01:38:19.703424+0000","last_fullsized":"2024-09-12T01:38:19.703424+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'395","last_scrub_stamp":"2024-09-12T01:38:19.703172+0000","last_deep_scrub":"263'395","last_deep_scrub_stamp":"2024-09-12T01:38:19.703172+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.703172+0000","objects_scrubbed":8,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:41.744192+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2554787,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":757,"num_read_kb":17367,"num_write":1239,"num_write_kb":40068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":515,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.997410+0000","last_change":"2024-09-12T01:38:22.997345+0000","last_active":"2024-09-12T01:38:22.997410+0000","last_peered":"2024-09-12T01:38:22.997410+0000","last_clean":"2024-09-12T01:38:22.997410+0000","last_became_active":"2024-09-12T00:28:35.208165+0000","last_became_peered":"2024-09-12T00:28:35.208165+0000","last_unstale":"2024-09-12T01:38:22.997410+0000","last_undegraded":"2024-09-12T01:38:22.997410+0000","last_fullsized":"2024-09-12T01:38:22.997410+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:22.997265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:22.997265+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.997265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:37.750337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"263'303","reported_seq":904,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:34.305299+0000","last_change":"2024-09-12T01:38:34.305234+0000","last_active":"2024-09-12T01:38:34.305299+0000","last_peered":"2024-09-12T01:38:34.305299+0000","last_clean":"2024-09-12T01:38:34.305299+0000","last_became_active":"2024-09-12T00:28:37.217603+0000","last_became_peered":"2024-09-12T00:28:37.217603+0000","last_unstale":"2024-09-12T01:38:34.305299+0000","last_undegraded":"2024-09-12T01:38:34.305299+0000","last_fullsized":"2024-09-12T01:38:34.305299+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'303","last_scrub_stamp":"2024-09-12T01:38:34.305138+0000","last_deep_scrub":"263'303","last_deep_scrub_stamp":"2024-09-12T01:38:34.305138+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.305138+0000","objects_scrubbed":6,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:17.248810+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46508,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":487,"num_read_kb":1094,"num_write":390,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:40.294808+0000","last_change":"2024-09-12T01:38:40.294808+0000","last_active":"2024-09-12T01:38:40.294808+0000","last_peered":"2024-09-12T01:38:40.294808+0000","last_clean":"2024-09-12T01:38:40.294808+0000","last_became_active":"2024-09-12T00:28:39.216143+0000","last_became_peered":"2024-09-12T00:28:39.216143+0000","last_unstale":"2024-09-12T01:38:40.294808+0000","last_undegraded":"2024-09-12T01:38:40.294808+0000","last_fullsized":"2024-09-12T01:38:40.294808+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:40.294710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:40.294710+0000","last_clean_scrub_stamp":"2024-09-12T01:38:40.294710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:02.826767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"263'119","reported_seq":640,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:49.355949+0000","last_change":"2024-09-12T01:38:49.355949+0000","last_active":"2024-09-12T01:38:49.355949+0000","last_peered":"2024-09-12T01:38:49.355949+0000","last_clean":"2024-09-12T01:38:49.355949+0000","last_became_active":"2024-09-12T00:28:41.232114+0000","last_became_peered":"2024-09-12T00:28:41.232114+0000","last_unstale":"2024-09-12T01:38:49.355949+0000","last_undegraded":"2024-09-12T01:38:49.355949+0000","last_fullsized":"2024-09-12T01:38:49.355949+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'119","last_scrub_stamp":"2024-09-12T01:38:49.355848+0000","last_deep_scrub":"263'119","last_deep_scrub_stamp":"2024-09-12T01:38:49.355848+0000","last_clean_scrub_stamp":"2024-09-12T01:38:49.355848+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:40.862632+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":141,"num_write":283,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"263'347","reported_seq":1054,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:25.427221+0000","last_change":"2024-09-12T01:38:25.427221+0000","last_active":"2024-09-12T01:38:25.427221+0000","last_peered":"2024-09-12T01:38:25.427221+0000","last_clean":"2024-09-12T01:38:25.427221+0000","last_became_active":"2024-09-12T00:29:04.292302+0000","last_became_peered":"2024-09-12T00:29:04.292302+0000","last_unstale":"2024-09-12T01:38:25.427221+0000","last_undegraded":"2024-09-12T01:38:25.427221+0000","last_fullsized":"2024-09-12T01:38:25.427221+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'347","last_scrub_stamp":"2024-09-12T01:38:25.427133+0000","last_deep_scrub":"263'347","last_deep_scrub_stamp":"2024-09-12T01:38:25.427133+0000","last_clean_scrub_stamp":"2024-09-12T01:38:25.427133+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:54.656816+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1719,"num_read_kb":1484,"num_write":537,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25751,"num_omap_keys":101,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"263'396","reported_seq":1182,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.265923+0000","last_change":"2024-09-12T01:38:18.265866+0000","last_active":"2024-09-12T01:38:18.265923+0000","last_peered":"2024-09-12T01:38:18.265923+0000","last_clean":"2024-09-12T01:38:18.265923+0000","last_became_active":"2024-09-12T00:28:31.207765+0000","last_became_peered":"2024-09-12T00:28:31.207765+0000","last_unstale":"2024-09-12T01:38:18.265923+0000","last_undegraded":"2024-09-12T01:38:18.265923+0000","last_fullsized":"2024-09-12T01:38:18.265923+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'396","last_scrub_stamp":"2024-09-12T01:38:18.265737+0000","last_deep_scrub":"263'396","last_deep_scrub_stamp":"2024-09-12T01:38:18.265737+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.265737+0000","objects_scrubbed":10,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:42.523716+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2529502,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":736,"num_read_kb":9284,"num_write":1355,"num_write_kb":41598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":509,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:27.266641+0000","last_change":"2024-09-12T01:38:27.266554+0000","last_active":"2024-09-12T01:38:27.266641+0000","last_peered":"2024-09-12T01:38:27.266641+0000","last_clean":"2024-09-12T01:38:27.266641+0000","last_became_active":"2024-09-12T00:28:35.212243+0000","last_became_peered":"2024-09-12T00:28:35.212243+0000","last_unstale":"2024-09-12T01:38:27.266641+0000","last_undegraded":"2024-09-12T01:38:27.266641+0000","last_fullsized":"2024-09-12T01:38:27.266641+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:27.266464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:27.266464+0000","last_clean_scrub_stamp":"2024-09-12T01:38:27.266464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:57.767929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"263'60","reported_seq":577,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:29.129127+0000","last_change":"2024-09-12T01:38:29.129067+0000","last_active":"2024-09-12T01:38:29.129127+0000","last_peered":"2024-09-12T01:38:29.129127+0000","last_clean":"2024-09-12T01:38:29.129127+0000","last_became_active":"2024-09-12T00:28:37.219799+0000","last_became_peered":"2024-09-12T00:28:37.219799+0000","last_unstale":"2024-09-12T01:38:29.129127+0000","last_undegraded":"2024-09-12T01:38:29.129127+0000","last_fullsized":"2024-09-12T01:38:29.129127+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'60","last_scrub_stamp":"2024-09-12T01:38:29.128986+0000","last_deep_scrub":"263'60","last_deep_scrub_stamp":"2024-09-12T01:38:29.128986+0000","last_clean_scrub_stamp":"2024-09-12T01:38:29.128986+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:06.769387+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":42,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.506950+0000","last_change":"2024-09-12T01:38:37.506869+0000","last_active":"2024-09-12T01:38:37.506950+0000","last_peered":"2024-09-12T01:38:37.506950+0000","last_clean":"2024-09-12T01:38:37.506950+0000","last_became_active":"2024-09-12T00:28:39.219209+0000","last_became_peered":"2024-09-12T00:28:39.219209+0000","last_unstale":"2024-09-12T01:38:37.506950+0000","last_undegraded":"2024-09-12T01:38:37.506950+0000","last_fullsized":"2024-09-12T01:38:37.506950+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:37.506759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:37.506759+0000","last_clean_scrub_stamp":"2024-09-12T01:38:37.506759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:54.149913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"263'213","reported_seq":750,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:45.217297+0000","last_change":"2024-09-12T01:38:45.217297+0000","last_active":"2024-09-12T01:38:45.217297+0000","last_peered":"2024-09-12T01:38:45.217297+0000","last_clean":"2024-09-12T01:38:45.217297+0000","last_became_active":"2024-09-12T00:28:41.225673+0000","last_became_peered":"2024-09-12T00:28:41.225673+0000","last_unstale":"2024-09-12T01:38:45.217297+0000","last_undegraded":"2024-09-12T01:38:45.217297+0000","last_fullsized":"2024-09-12T01:38:45.217297+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'213","last_scrub_stamp":"2024-09-12T01:38:45.217201+0000","last_deep_scrub":"263'213","last_deep_scrub_stamp":"2024-09-12T01:38:45.217201+0000","last_clean_scrub_stamp":"2024-09-12T01:38:45.217201+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:59.307017+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":332,"num_read_kb":318,"num_write":482,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"263'71","reported_seq":702,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.187420+0000","last_change":"2024-09-12T01:38:15.187360+0000","last_active":"2024-09-12T01:38:15.187420+0000","last_peered":"2024-09-12T01:38:15.187420+0000","last_clean":"2024-09-12T01:38:15.187420+0000","last_became_active":"2024-09-12T00:28:33.213777+0000","last_became_peered":"2024-09-12T00:28:33.213777+0000","last_unstale":"2024-09-12T01:38:15.187420+0000","last_undegraded":"2024-09-12T01:38:15.187420+0000","last_fullsized":"2024-09-12T01:38:15.187420+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'71","last_scrub_stamp":"2024-09-12T01:38:15.187273+0000","last_deep_scrub":"263'71","last_deep_scrub_stamp":"2024-09-12T01:38:15.187273+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.187273+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:48.489235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":365,"num_read_kb":325,"num_write":89,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"263'346","reported_seq":982,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.342611+0000","last_change":"2024-09-12T01:38:13.342517+0000","last_active":"2024-09-12T01:38:13.342611+0000","last_peered":"2024-09-12T01:38:13.342611+0000","last_clean":"2024-09-12T01:38:13.342611+0000","last_became_active":"2024-09-12T00:28:31.213567+0000","last_became_peered":"2024-09-12T00:28:31.213567+0000","last_unstale":"2024-09-12T01:38:13.342611+0000","last_undegraded":"2024-09-12T01:38:13.342611+0000","last_fullsized":"2024-09-12T01:38:13.342611+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'346","last_scrub_stamp":"2024-09-12T01:38:13.342398+0000","last_deep_scrub":"263'346","last_deep_scrub_stamp":"2024-09-12T01:38:13.342398+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.342398+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:37.312677+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262191,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":463,"num_read_kb":31334,"num_write":999,"num_write_kb":46181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:29.444200+0000","last_change":"2024-09-12T01:38:29.444149+0000","last_active":"2024-09-12T01:38:29.444200+0000","last_peered":"2024-09-12T01:38:29.444200+0000","last_clean":"2024-09-12T01:38:29.444200+0000","last_became_active":"2024-09-12T00:28:35.210000+0000","last_became_peered":"2024-09-12T00:28:35.210000+0000","last_unstale":"2024-09-12T01:38:29.444200+0000","last_undegraded":"2024-09-12T01:38:29.444200+0000","last_fullsized":"2024-09-12T01:38:29.444200+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:29.444059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:29.444059+0000","last_clean_scrub_stamp":"2024-09-12T01:38:29.444059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:37.703935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"263'340","reported_seq":951,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.300458+0000","last_change":"2024-09-12T01:38:35.300395+0000","last_active":"2024-09-12T01:38:35.300458+0000","last_peered":"2024-09-12T01:38:35.300458+0000","last_clean":"2024-09-12T01:38:35.300458+0000","last_became_active":"2024-09-12T00:28:37.222678+0000","last_became_peered":"2024-09-12T00:28:37.222678+0000","last_unstale":"2024-09-12T01:38:35.300458+0000","last_undegraded":"2024-09-12T01:38:35.300458+0000","last_fullsized":"2024-09-12T01:38:35.300458+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'340","last_scrub_stamp":"2024-09-12T01:38:35.300287+0000","last_deep_scrub":"263'340","last_deep_scrub_stamp":"2024-09-12T01:38:35.300287+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.300287+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:15.500767+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45149,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":551,"num_read_kb":1230,"num_write":438,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:27.205149+0000","last_change":"2024-09-12T01:38:27.205089+0000","last_active":"2024-09-12T01:38:27.205149+0000","last_peered":"2024-09-12T01:38:27.205149+0000","last_clean":"2024-09-12T01:38:27.205149+0000","last_became_active":"2024-09-12T00:28:39.216200+0000","last_became_peered":"2024-09-12T00:28:39.216200+0000","last_unstale":"2024-09-12T01:38:27.205149+0000","last_undegraded":"2024-09-12T01:38:27.205149+0000","last_fullsized":"2024-09-12T01:38:27.205149+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:27.204991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:27.204991+0000","last_clean_scrub_stamp":"2024-09-12T01:38:27.204991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:51.772559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"263'114","reported_seq":637,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:47.459776+0000","last_change":"2024-09-12T01:38:47.459776+0000","last_active":"2024-09-12T01:38:47.459776+0000","last_peered":"2024-09-12T01:38:47.459776+0000","last_clean":"2024-09-12T01:38:47.459776+0000","last_became_active":"2024-09-12T00:28:41.232381+0000","last_became_peered":"2024-09-12T00:28:41.232381+0000","last_unstale":"2024-09-12T01:38:47.459776+0000","last_undegraded":"2024-09-12T01:38:47.459776+0000","last_fullsized":"2024-09-12T01:38:47.459776+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'114","last_scrub_stamp":"2024-09-12T01:38:47.459665+0000","last_deep_scrub":"263'114","last_deep_scrub_stamp":"2024-09-12T01:38:47.459665+0000","last_clean_scrub_stamp":"2024-09-12T01:38:47.459665+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:38.656502+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":176,"num_read_kb":166,"num_write":281,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"263'153","reported_seq":754,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:28.299416+0000","last_change":"2024-09-12T01:38:28.299358+0000","last_active":"2024-09-12T01:38:28.299416+0000","last_peered":"2024-09-12T01:38:28.299416+0000","last_clean":"2024-09-12T01:38:28.299416+0000","last_became_active":"2024-09-12T00:28:33.211165+0000","last_became_peered":"2024-09-12T00:28:33.211165+0000","last_unstale":"2024-09-12T01:38:28.299416+0000","last_undegraded":"2024-09-12T01:38:28.299416+0000","last_fullsized":"2024-09-12T01:38:28.299416+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'153","last_scrub_stamp":"2024-09-12T01:38:28.299270+0000","last_deep_scrub":"263'153","last_deep_scrub_stamp":"2024-09-12T01:38:28.299270+0000","last_clean_scrub_stamp":"2024-09-12T01:38:28.299270+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:32.733250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":668,"num_read_kb":545,"num_write":223,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"263'340","reported_seq":978,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.047653+0000","last_change":"2024-09-12T01:38:10.047601+0000","last_active":"2024-09-12T01:38:10.047653+0000","last_peered":"2024-09-12T01:38:10.047653+0000","last_clean":"2024-09-12T01:38:10.047653+0000","last_became_active":"2024-09-12T00:28:31.213971+0000","last_became_peered":"2024-09-12T00:28:31.213971+0000","last_unstale":"2024-09-12T01:38:10.047653+0000","last_undegraded":"2024-09-12T01:38:10.047653+0000","last_fullsized":"2024-09-12T01:38:10.047653+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'340","last_scrub_stamp":"2024-09-12T01:38:10.047526+0000","last_deep_scrub":"263'340","last_deep_scrub_stamp":"2024-09-12T01:38:10.047526+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.047526+0000","objects_scrubbed":8,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:30.027467+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340133,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":428,"num_read_kb":61436,"num_write":986,"num_write_kb":69756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:23.136547+0000","last_change":"2024-09-12T01:38:23.136434+0000","last_active":"2024-09-12T01:38:23.136547+0000","last_peered":"2024-09-12T01:38:23.136547+0000","last_clean":"2024-09-12T01:38:23.136547+0000","last_became_active":"2024-09-12T00:28:35.210060+0000","last_became_peered":"2024-09-12T00:28:35.210060+0000","last_unstale":"2024-09-12T01:38:23.136547+0000","last_undegraded":"2024-09-12T01:38:23.136547+0000","last_fullsized":"2024-09-12T01:38:23.136547+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:23.136334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:23.136334+0000","last_clean_scrub_stamp":"2024-09-12T01:38:23.136334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:03.715995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"263'301","reported_seq":884,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.448009+0000","last_change":"2024-09-12T01:38:35.447953+0000","last_active":"2024-09-12T01:38:35.448009+0000","last_peered":"2024-09-12T01:38:35.448009+0000","last_clean":"2024-09-12T01:38:35.448009+0000","last_became_active":"2024-09-12T00:28:37.221491+0000","last_became_peered":"2024-09-12T00:28:37.221491+0000","last_unstale":"2024-09-12T01:38:35.448009+0000","last_undegraded":"2024-09-12T01:38:35.448009+0000","last_fullsized":"2024-09-12T01:38:35.448009+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'301","last_scrub_stamp":"2024-09-12T01:38:35.447807+0000","last_deep_scrub":"263'301","last_deep_scrub_stamp":"2024-09-12T01:38:35.447807+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.447807+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:30.403825+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49002,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":484,"num_read_kb":1163,"num_write":396,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:39.202809+0000","last_change":"2024-09-12T01:38:39.202712+0000","last_active":"2024-09-12T01:38:39.202809+0000","last_peered":"2024-09-12T01:38:39.202809+0000","last_clean":"2024-09-12T01:38:39.202809+0000","last_became_active":"2024-09-12T00:28:39.219004+0000","last_became_peered":"2024-09-12T00:28:39.219004+0000","last_unstale":"2024-09-12T01:38:39.202809+0000","last_undegraded":"2024-09-12T01:38:39.202809+0000","last_fullsized":"2024-09-12T01:38:39.202809+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:39.202617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:39.202617+0000","last_clean_scrub_stamp":"2024-09-12T01:38:39.202617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:51.637674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"263'478","reported_seq":1270,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.216852+0000","last_change":"2024-09-12T01:38:19.216852+0000","last_active":"2024-09-12T01:38:19.216852+0000","last_peered":"2024-09-12T01:38:19.216852+0000","last_clean":"2024-09-12T01:38:19.216852+0000","last_became_active":"2024-09-12T00:28:33.216610+0000","last_became_peered":"2024-09-12T00:28:33.216610+0000","last_unstale":"2024-09-12T01:38:19.216852+0000","last_undegraded":"2024-09-12T01:38:19.216852+0000","last_fullsized":"2024-09-12T01:38:19.216852+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'478","last_scrub_stamp":"2024-09-12T01:38:19.216770+0000","last_deep_scrub":"263'478","last_deep_scrub_stamp":"2024-09-12T01:38:19.216770+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.216770+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:55.208285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2349,"num_read_kb":2016,"num_write":868,"num_write_kb":562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"263'340","reported_seq":980,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.239903+0000","last_change":"2024-09-12T01:38:13.239832+0000","last_active":"2024-09-12T01:38:13.239903+0000","last_peered":"2024-09-12T01:38:13.239903+0000","last_clean":"2024-09-12T01:38:13.239903+0000","last_became_active":"2024-09-12T00:28:31.207770+0000","last_became_peered":"2024-09-12T00:28:31.207770+0000","last_unstale":"2024-09-12T01:38:13.239903+0000","last_undegraded":"2024-09-12T01:38:13.239903+0000","last_fullsized":"2024-09-12T01:38:13.239903+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'340","last_scrub_stamp":"2024-09-12T01:38:13.239742+0000","last_deep_scrub":"263'340","last_deep_scrub_stamp":"2024-09-12T01:38:13.239742+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.239742+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:09.782387+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":467,"num_read_kb":17286,"num_write":965,"num_write_kb":20034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":512,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:23.160041+0000","last_change":"2024-09-12T01:38:23.159987+0000","last_active":"2024-09-12T01:38:23.160041+0000","last_peered":"2024-09-12T01:38:23.160041+0000","last_clean":"2024-09-12T01:38:23.160041+0000","last_became_active":"2024-09-12T00:28:35.208868+0000","last_became_peered":"2024-09-12T00:28:35.208868+0000","last_unstale":"2024-09-12T01:38:23.160041+0000","last_undegraded":"2024-09-12T01:38:23.160041+0000","last_fullsized":"2024-09-12T01:38:23.160041+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:23.159891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:23.159891+0000","last_clean_scrub_stamp":"2024-09-12T01:38:23.159891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:23.643595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"263'534","reported_seq":1195,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:26.001515+0000","last_change":"2024-09-12T01:38:26.001437+0000","last_active":"2024-09-12T01:38:26.001515+0000","last_peered":"2024-09-12T01:38:26.001515+0000","last_clean":"2024-09-12T01:38:26.001515+0000","last_became_active":"2024-09-12T00:28:37.210514+0000","last_became_peered":"2024-09-12T00:28:37.210514+0000","last_unstale":"2024-09-12T01:38:26.001515+0000","last_undegraded":"2024-09-12T01:38:26.001515+0000","last_fullsized":"2024-09-12T01:38:26.001515+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'534","last_scrub_stamp":"2024-09-12T01:38:26.001311+0000","last_deep_scrub":"263'534","last_deep_scrub_stamp":"2024-09-12T01:38:26.001311+0000","last_clean_scrub_stamp":"2024-09-12T01:38:26.001311+0000","objects_scrubbed":7,"log_size":34,"log_dups_size":500,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:10.115691+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94945,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":919,"num_read_kb":2214,"num_write":790,"num_write_kb":678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:40.437969+0000","last_change":"2024-09-12T01:38:40.437919+0000","last_active":"2024-09-12T01:38:40.437969+0000","last_peered":"2024-09-12T01:38:40.437969+0000","last_clean":"2024-09-12T01:38:40.437969+0000","last_became_active":"2024-09-12T00:28:39.219808+0000","last_became_peered":"2024-09-12T00:28:39.219808+0000","last_unstale":"2024-09-12T01:38:40.437969+0000","last_undegraded":"2024-09-12T01:38:40.437969+0000","last_fullsized":"2024-09-12T01:38:40.437969+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:40.437833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:40.437833+0000","last_clean_scrub_stamp":"2024-09-12T01:38:40.437833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:03.038216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"263'229","reported_seq":806,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:47.316643+0000","last_change":"2024-09-12T01:38:47.316643+0000","last_active":"2024-09-12T01:38:47.316643+0000","last_peered":"2024-09-12T01:38:47.316643+0000","last_clean":"2024-09-12T01:38:47.316643+0000","last_became_active":"2024-09-12T00:28:41.257639+0000","last_became_peered":"2024-09-12T00:28:41.257639+0000","last_unstale":"2024-09-12T01:38:47.316643+0000","last_undegraded":"2024-09-12T01:38:47.316643+0000","last_fullsized":"2024-09-12T01:38:47.316643+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'229","last_scrub_stamp":"2024-09-12T01:38:47.316555+0000","last_deep_scrub":"263'229","last_deep_scrub_stamp":"2024-09-12T01:38:47.316555+0000","last_clean_scrub_stamp":"2024-09-12T01:38:47.316555+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:30.257573+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":674,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":491,"num_read_kb":439,"num_write":521,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"263'158","reported_seq":758,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.116264+0000","last_change":"2024-09-12T01:38:17.116170+0000","last_active":"2024-09-12T01:38:17.116264+0000","last_peered":"2024-09-12T01:38:17.116264+0000","last_clean":"2024-09-12T01:38:17.116264+0000","last_became_active":"2024-09-12T00:28:33.215105+0000","last_became_peered":"2024-09-12T00:28:33.215105+0000","last_unstale":"2024-09-12T01:38:17.116264+0000","last_undegraded":"2024-09-12T01:38:17.116264+0000","last_fullsized":"2024-09-12T01:38:17.116264+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'158","last_scrub_stamp":"2024-09-12T01:38:17.116093+0000","last_deep_scrub":"263'158","last_deep_scrub_stamp":"2024-09-12T01:38:17.116093+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.116093+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:18.349339+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":692,"num_read_kb":572,"num_write":247,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"263'397","reported_seq":1061,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.210269+0000","last_change":"2024-09-12T01:38:12.210181+0000","last_active":"2024-09-12T01:38:12.210269+0000","last_peered":"2024-09-12T01:38:12.210269+0000","last_clean":"2024-09-12T01:38:12.210269+0000","last_became_active":"2024-09-12T00:28:31.206562+0000","last_became_peered":"2024-09-12T00:28:31.206562+0000","last_unstale":"2024-09-12T01:38:12.210269+0000","last_undegraded":"2024-09-12T01:38:12.210269+0000","last_fullsized":"2024-09-12T01:38:12.210269+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'397","last_scrub_stamp":"2024-09-12T01:38:12.210028+0000","last_deep_scrub":"263'397","last_deep_scrub_stamp":"2024-09-12T01:38:12.210028+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.210028+0000","objects_scrubbed":8,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:00.125891+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395844,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":545,"num_read_kb":3743,"num_write":1252,"num_write_kb":48925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":509,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:24.152454+0000","last_change":"2024-09-12T01:38:24.152454+0000","last_active":"2024-09-12T01:38:24.152454+0000","last_peered":"2024-09-12T01:38:24.152454+0000","last_clean":"2024-09-12T01:38:24.152454+0000","last_became_active":"2024-09-12T00:28:35.210046+0000","last_became_peered":"2024-09-12T00:28:35.210046+0000","last_unstale":"2024-09-12T01:38:24.152454+0000","last_undegraded":"2024-09-12T01:38:24.152454+0000","last_fullsized":"2024-09-12T01:38:24.152454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:24.152344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:24.152344+0000","last_clean_scrub_stamp":"2024-09-12T01:38:24.152344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:00.292881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"263'338","reported_seq":940,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:36.464792+0000","last_change":"2024-09-12T01:38:36.464730+0000","last_active":"2024-09-12T01:38:36.464792+0000","last_peered":"2024-09-12T01:38:36.464792+0000","last_clean":"2024-09-12T01:38:36.464792+0000","last_became_active":"2024-09-12T00:28:37.212236+0000","last_became_peered":"2024-09-12T00:28:37.212236+0000","last_unstale":"2024-09-12T01:38:36.464792+0000","last_undegraded":"2024-09-12T01:38:36.464792+0000","last_fullsized":"2024-09-12T01:38:36.464792+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'338","last_scrub_stamp":"2024-09-12T01:38:36.464628+0000","last_deep_scrub":"263'338","last_deep_scrub_stamp":"2024-09-12T01:38:36.464628+0000","last_clean_scrub_stamp":"2024-09-12T01:38:36.464628+0000","objects_scrubbed":8,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:26.375761+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49414,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":546,"num_read_kb":1160,"num_write":454,"num_write_kb":329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:31.002339+0000","last_change":"2024-09-12T01:38:31.002272+0000","last_active":"2024-09-12T01:38:31.002339+0000","last_peered":"2024-09-12T01:38:31.002339+0000","last_clean":"2024-09-12T01:38:31.002339+0000","last_became_active":"2024-09-12T00:28:39.217947+0000","last_became_peered":"2024-09-12T00:28:39.217947+0000","last_unstale":"2024-09-12T01:38:31.002339+0000","last_undegraded":"2024-09-12T01:38:31.002339+0000","last_fullsized":"2024-09-12T01:38:31.002339+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:31.002169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:31.002169+0000","last_clean_scrub_stamp":"2024-09-12T01:38:31.002169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:14.472899+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"263'225","reported_seq":1105,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:33.106320+0000","last_change":"2024-09-12T01:38:33.106231+0000","last_active":"2024-09-12T01:38:33.106320+0000","last_peered":"2024-09-12T01:38:33.106320+0000","last_clean":"2024-09-12T01:38:33.106320+0000","last_became_active":"2024-09-12T00:28:41.232347+0000","last_became_peered":"2024-09-12T00:28:41.232347+0000","last_unstale":"2024-09-12T01:38:33.106320+0000","last_undegraded":"2024-09-12T01:38:33.106320+0000","last_fullsized":"2024-09-12T01:38:33.106320+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'225","last_scrub_stamp":"2024-09-12T01:38:33.106123+0000","last_deep_scrub":"263'225","last_deep_scrub_stamp":"2024-09-12T01:38:33.106123+0000","last_clean_scrub_stamp":"2024-09-12T01:38:33.106123+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:04.636946+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":645,"num_read_kb":635,"num_write":602,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"263'73","reported_seq":637,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.239390+0000","last_change":"2024-09-12T01:38:22.239336+0000","last_active":"2024-09-12T01:38:22.239390+0000","last_peered":"2024-09-12T01:38:22.239390+0000","last_clean":"2024-09-12T01:38:22.239390+0000","last_became_active":"2024-09-12T00:28:33.207968+0000","last_became_peered":"2024-09-12T00:28:33.207968+0000","last_unstale":"2024-09-12T01:38:22.239390+0000","last_undegraded":"2024-09-12T01:38:22.239390+0000","last_fullsized":"2024-09-12T01:38:22.239390+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'73","last_scrub_stamp":"2024-09-12T01:38:22.239257+0000","last_deep_scrub":"263'73","last_deep_scrub_stamp":"2024-09-12T01:38:22.239257+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.239257+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:04.297452+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":308,"num_read_kb":254,"num_write":109,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":719,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"263'300","reported_seq":935,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:09.492350+0000","last_change":"2024-09-12T01:38:09.492289+0000","last_active":"2024-09-12T01:38:09.492350+0000","last_peered":"2024-09-12T01:38:09.492350+0000","last_clean":"2024-09-12T01:38:09.492350+0000","last_became_active":"2024-09-12T00:28:31.195038+0000","last_became_peered":"2024-09-12T00:28:31.195038+0000","last_unstale":"2024-09-12T01:38:09.492350+0000","last_undegraded":"2024-09-12T01:38:09.492350+0000","last_fullsized":"2024-09-12T01:38:09.492350+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'300","last_scrub_stamp":"2024-09-12T01:38:09.492194+0000","last_deep_scrub":"263'300","last_deep_scrub_stamp":"2024-09-12T01:38:09.492194+0000","last_clean_scrub_stamp":"2024-09-12T01:38:09.492194+0000","objects_scrubbed":5,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:50.184186+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262176,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":426,"num_read_kb":13574,"num_write":965,"num_write_kb":34116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:30.500766+0000","last_change":"2024-09-12T01:38:30.500642+0000","last_active":"2024-09-12T01:38:30.500766+0000","last_peered":"2024-09-12T01:38:30.500766+0000","last_clean":"2024-09-12T01:38:30.500766+0000","last_became_active":"2024-09-12T00:28:35.215576+0000","last_became_peered":"2024-09-12T00:28:35.215576+0000","last_unstale":"2024-09-12T01:38:30.500766+0000","last_undegraded":"2024-09-12T01:38:30.500766+0000","last_fullsized":"2024-09-12T01:38:30.500766+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:30.500549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:30.500549+0000","last_clean_scrub_stamp":"2024-09-12T01:38:30.500549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:03.116000+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"263'294","reported_seq":898,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:36.315532+0000","last_change":"2024-09-12T01:38:36.315532+0000","last_active":"2024-09-12T01:38:36.315532+0000","last_peered":"2024-09-12T01:38:36.315532+0000","last_clean":"2024-09-12T01:38:36.315532+0000","last_became_active":"2024-09-12T00:28:37.423835+0000","last_became_peered":"2024-09-12T00:28:37.423835+0000","last_unstale":"2024-09-12T01:38:36.315532+0000","last_undegraded":"2024-09-12T01:38:36.315532+0000","last_fullsized":"2024-09-12T01:38:36.315532+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'294","last_scrub_stamp":"2024-09-12T01:38:36.315428+0000","last_deep_scrub":"263'294","last_deep_scrub_stamp":"2024-09-12T01:38:36.315428+0000","last_clean_scrub_stamp":"2024-09-12T01:38:36.315428+0000","objects_scrubbed":6,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:06.591255+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48887,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":486,"num_read_kb":1104,"num_write":386,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":512,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:30.001456+0000","last_change":"2024-09-12T01:38:30.001403+0000","last_active":"2024-09-12T01:38:30.001456+0000","last_peered":"2024-09-12T01:38:30.001456+0000","last_clean":"2024-09-12T01:38:30.001456+0000","last_became_active":"2024-09-12T00:28:39.219541+0000","last_became_peered":"2024-09-12T00:28:39.219541+0000","last_unstale":"2024-09-12T01:38:30.001456+0000","last_undegraded":"2024-09-12T01:38:30.001456+0000","last_fullsized":"2024-09-12T01:38:30.001456+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:30.001320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:30.001320+0000","last_clean_scrub_stamp":"2024-09-12T01:38:30.001320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:08.445496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"263'117","reported_seq":611,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:44.504853+0000","last_change":"2024-09-12T01:38:44.504853+0000","last_active":"2024-09-12T01:38:44.504853+0000","last_peered":"2024-09-12T01:38:44.504853+0000","last_clean":"2024-09-12T01:38:44.504853+0000","last_became_active":"2024-09-12T00:28:41.232305+0000","last_became_peered":"2024-09-12T00:28:41.232305+0000","last_unstale":"2024-09-12T01:38:44.504853+0000","last_undegraded":"2024-09-12T01:38:44.504853+0000","last_fullsized":"2024-09-12T01:38:44.504853+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'117","last_scrub_stamp":"2024-09-12T01:38:44.504746+0000","last_deep_scrub":"263'117","last_deep_scrub_stamp":"2024-09-12T01:38:44.504746+0000","last_clean_scrub_stamp":"2024-09-12T01:38:44.504746+0000","objects_scrubbed":3,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:36.489816+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":90,"num_read_kb":88,"num_write":260,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"263'145","reported_seq":720,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.772748+0000","last_change":"2024-09-12T01:38:21.772678+0000","last_active":"2024-09-12T01:38:21.772748+0000","last_peered":"2024-09-12T01:38:21.772748+0000","last_clean":"2024-09-12T01:38:21.772748+0000","last_became_active":"2024-09-12T00:28:33.213905+0000","last_became_peered":"2024-09-12T00:28:33.213905+0000","last_unstale":"2024-09-12T01:38:21.772748+0000","last_undegraded":"2024-09-12T01:38:21.772748+0000","last_fullsized":"2024-09-12T01:38:21.772748+0000","mapping_epoch":27,"log_start":"260'100","ondisk_log_start":"260'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'145","last_scrub_stamp":"2024-09-12T01:38:21.772587+0000","last_deep_scrub":"263'145","last_deep_scrub_stamp":"2024-09-12T01:38:21.772587+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.772587+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:23.017228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":580,"num_read_kb":470,"num_write":232,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"263'313","reported_seq":1016,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.157918+0000","last_change":"2024-09-12T01:38:18.157817+0000","last_active":"2024-09-12T01:38:18.157918+0000","last_peered":"2024-09-12T01:38:18.157918+0000","last_clean":"2024-09-12T01:38:18.157918+0000","last_became_active":"2024-09-12T00:28:31.203417+0000","last_became_peered":"2024-09-12T00:28:31.203417+0000","last_unstale":"2024-09-12T01:38:18.157918+0000","last_undegraded":"2024-09-12T01:38:18.157918+0000","last_fullsized":"2024-09-12T01:38:18.157918+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'313","last_scrub_stamp":"2024-09-12T01:38:18.157702+0000","last_deep_scrub":"263'313","last_deep_scrub_stamp":"2024-09-12T01:38:18.157702+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.157702+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:59.863289+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262193,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":643,"num_read_kb":683,"num_write":1258,"num_write_kb":6456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:24.997799+0000","last_change":"2024-09-12T01:38:24.997695+0000","last_active":"2024-09-12T01:38:24.997799+0000","last_peered":"2024-09-12T01:38:24.997799+0000","last_clean":"2024-09-12T01:38:24.997799+0000","last_became_active":"2024-09-12T00:28:35.207992+0000","last_became_peered":"2024-09-12T00:28:35.207992+0000","last_unstale":"2024-09-12T01:38:24.997799+0000","last_undegraded":"2024-09-12T01:38:24.997799+0000","last_fullsized":"2024-09-12T01:38:24.997799+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:24.997615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:24.997615+0000","last_clean_scrub_stamp":"2024-09-12T01:38:24.997615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:15.702126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"263'113","reported_seq":663,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:36.568861+0000","last_change":"2024-09-12T01:38:36.568861+0000","last_active":"2024-09-12T01:38:36.568861+0000","last_peered":"2024-09-12T01:38:36.568861+0000","last_clean":"2024-09-12T01:38:36.568861+0000","last_became_active":"2024-09-12T00:28:37.423765+0000","last_became_peered":"2024-09-12T00:28:37.423765+0000","last_unstale":"2024-09-12T01:38:36.568861+0000","last_undegraded":"2024-09-12T01:38:36.568861+0000","last_fullsized":"2024-09-12T01:38:36.568861+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'113","last_scrub_stamp":"2024-09-12T01:38:36.568765+0000","last_deep_scrub":"263'113","last_deep_scrub_stamp":"2024-09-12T01:38:36.568765+0000","last_clean_scrub_stamp":"2024-09-12T01:38:36.568765+0000","objects_scrubbed":8,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:59.133727+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":155,"num_read_kb":148,"num_write":156,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"263'761","reported_seq":2436,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:29.172033+0000","last_change":"2024-09-12T01:38:29.172033+0000","last_active":"2024-09-12T01:38:29.172033+0000","last_peered":"2024-09-12T01:38:29.172033+0000","last_clean":"2024-09-12T01:38:29.172033+0000","last_became_active":"2024-09-12T00:28:39.216704+0000","last_became_peered":"2024-09-12T00:28:39.216704+0000","last_unstale":"2024-09-12T01:38:29.172033+0000","last_undegraded":"2024-09-12T01:38:29.172033+0000","last_fullsized":"2024-09-12T01:38:29.172033+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'761","last_scrub_stamp":"2024-09-12T01:38:29.171921+0000","last_deep_scrub":"263'761","last_deep_scrub_stamp":"2024-09-12T01:38:29.171921+0000","last_clean_scrub_stamp":"2024-09-12T01:38:29.171921+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:55.063995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"263'158","reported_seq":665,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:41.543232+0000","last_change":"2024-09-12T01:38:41.543158+0000","last_active":"2024-09-12T01:38:41.543232+0000","last_peered":"2024-09-12T01:38:41.543232+0000","last_clean":"2024-09-12T01:38:41.543232+0000","last_became_active":"2024-09-12T00:28:41.227892+0000","last_became_peered":"2024-09-12T00:28:41.227892+0000","last_unstale":"2024-09-12T01:38:41.543232+0000","last_undegraded":"2024-09-12T01:38:41.543232+0000","last_fullsized":"2024-09-12T01:38:41.543232+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'158","last_scrub_stamp":"2024-09-12T01:38:41.543080+0000","last_deep_scrub":"263'158","last_deep_scrub_stamp":"2024-09-12T01:38:41.543080+0000","last_clean_scrub_stamp":"2024-09-12T01:38:41.543080+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:33.584634+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":160,"num_read_kb":153,"num_write":389,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"263'138","reported_seq":726,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.484957+0000","last_change":"2024-09-12T01:38:19.484876+0000","last_active":"2024-09-12T01:38:19.484957+0000","last_peered":"2024-09-12T01:38:19.484957+0000","last_clean":"2024-09-12T01:38:19.484957+0000","last_became_active":"2024-09-12T00:28:33.204722+0000","last_became_peered":"2024-09-12T00:28:33.204722+0000","last_unstale":"2024-09-12T01:38:19.484957+0000","last_undegraded":"2024-09-12T01:38:19.484957+0000","last_fullsized":"2024-09-12T01:38:19.484957+0000","mapping_epoch":27,"log_start":"260'100","ondisk_log_start":"260'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'138","last_scrub_stamp":"2024-09-12T01:38:19.484796+0000","last_deep_scrub":"263'138","last_deep_scrub_stamp":"2024-09-12T01:38:19.484796+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.484796+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:49.740120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":575,"num_read_kb":467,"num_write":204,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"263'333","reported_seq":1060,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.360468+0000","last_change":"2024-09-12T01:38:15.360411+0000","last_active":"2024-09-12T01:38:15.360468+0000","last_peered":"2024-09-12T01:38:15.360468+0000","last_clean":"2024-09-12T01:38:15.360468+0000","last_became_active":"2024-09-12T00:28:31.212597+0000","last_became_peered":"2024-09-12T00:28:31.212597+0000","last_unstale":"2024-09-12T01:38:15.360468+0000","last_undegraded":"2024-09-12T01:38:15.360468+0000","last_fullsized":"2024-09-12T01:38:15.360468+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'333","last_scrub_stamp":"2024-09-12T01:38:15.360299+0000","last_deep_scrub":"263'333","last_deep_scrub_stamp":"2024-09-12T01:38:15.360299+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.360299+0000","objects_scrubbed":8,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:04.968900+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":273370,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":704,"num_read_kb":2179,"num_write":1113,"num_write_kb":612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:31.368857+0000","last_change":"2024-09-12T01:38:31.368762+0000","last_active":"2024-09-12T01:38:31.368857+0000","last_peered":"2024-09-12T01:38:31.368857+0000","last_clean":"2024-09-12T01:38:31.368857+0000","last_became_active":"2024-09-12T00:28:35.210710+0000","last_became_peered":"2024-09-12T00:28:35.210710+0000","last_unstale":"2024-09-12T01:38:31.368857+0000","last_undegraded":"2024-09-12T01:38:31.368857+0000","last_fullsized":"2024-09-12T01:38:31.368857+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:31.368656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:31.368656+0000","last_clean_scrub_stamp":"2024-09-12T01:38:31.368656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:16.021928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"263'398","reported_seq":1024,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.460744+0000","last_change":"2024-09-12T01:38:38.460680+0000","last_active":"2024-09-12T01:38:38.460744+0000","last_peered":"2024-09-12T01:38:38.460744+0000","last_clean":"2024-09-12T01:38:38.460744+0000","last_became_active":"2024-09-12T00:28:37.210317+0000","last_became_peered":"2024-09-12T00:28:37.210317+0000","last_unstale":"2024-09-12T01:38:38.460744+0000","last_undegraded":"2024-09-12T01:38:38.460744+0000","last_fullsized":"2024-09-12T01:38:38.460744+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'398","last_scrub_stamp":"2024-09-12T01:38:38.460579+0000","last_deep_scrub":"263'398","last_deep_scrub_stamp":"2024-09-12T01:38:38.460579+0000","last_clean_scrub_stamp":"2024-09-12T01:38:38.460579+0000","objects_scrubbed":11,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:30.726197+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56512,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":649,"num_read_kb":1465,"num_write":528,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.223854+0000","last_change":"2024-09-12T01:38:38.223786+0000","last_active":"2024-09-12T01:38:38.223854+0000","last_peered":"2024-09-12T01:38:38.223854+0000","last_clean":"2024-09-12T01:38:38.223854+0000","last_became_active":"2024-09-12T00:28:39.218026+0000","last_became_peered":"2024-09-12T00:28:39.218026+0000","last_unstale":"2024-09-12T01:38:38.223854+0000","last_undegraded":"2024-09-12T01:38:38.223854+0000","last_fullsized":"2024-09-12T01:38:38.223854+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:38.223690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:38.223690+0000","last_clean_scrub_stamp":"2024-09-12T01:38:38.223690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:28.393080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"263'136","reported_seq":641,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:42.583111+0000","last_change":"2024-09-12T01:38:42.583044+0000","last_active":"2024-09-12T01:38:42.583111+0000","last_peered":"2024-09-12T01:38:42.583111+0000","last_clean":"2024-09-12T01:38:42.583111+0000","last_became_active":"2024-09-12T00:28:41.231611+0000","last_became_peered":"2024-09-12T00:28:41.231611+0000","last_unstale":"2024-09-12T01:38:42.583111+0000","last_undegraded":"2024-09-12T01:38:42.583111+0000","last_fullsized":"2024-09-12T01:38:42.583111+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'136","last_scrub_stamp":"2024-09-12T01:38:42.582959+0000","last_deep_scrub":"263'136","last_deep_scrub_stamp":"2024-09-12T01:38:42.582959+0000","last_clean_scrub_stamp":"2024-09-12T01:38:42.582959+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:49.631045+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":625,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":135,"num_read_kb":130,"num_write":322,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"263'92","reported_seq":682,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.500242+0000","last_change":"2024-09-12T01:38:18.500153+0000","last_active":"2024-09-12T01:38:18.500242+0000","last_peered":"2024-09-12T01:38:18.500242+0000","last_clean":"2024-09-12T01:38:18.500242+0000","last_became_active":"2024-09-12T00:28:33.204653+0000","last_became_peered":"2024-09-12T00:28:33.204653+0000","last_unstale":"2024-09-12T01:38:18.500242+0000","last_undegraded":"2024-09-12T01:38:18.500242+0000","last_fullsized":"2024-09-12T01:38:18.500242+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'92","last_scrub_stamp":"2024-09-12T01:38:18.500029+0000","last_deep_scrub":"263'92","last_deep_scrub_stamp":"2024-09-12T01:38:18.500029+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.500029+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:53.561967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":393,"num_read_kb":329,"num_write":145,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"263'433","reported_seq":1134,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.354376+0000","last_change":"2024-09-12T01:38:14.354322+0000","last_active":"2024-09-12T01:38:14.354376+0000","last_peered":"2024-09-12T01:38:14.354376+0000","last_clean":"2024-09-12T01:38:14.354376+0000","last_became_active":"2024-09-12T00:28:31.212752+0000","last_became_peered":"2024-09-12T00:28:31.212752+0000","last_unstale":"2024-09-12T01:38:14.354376+0000","last_undegraded":"2024-09-12T01:38:14.354376+0000","last_fullsized":"2024-09-12T01:38:14.354376+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'433","last_scrub_stamp":"2024-09-12T01:38:14.354219+0000","last_deep_scrub":"263'433","last_deep_scrub_stamp":"2024-09-12T01:38:14.354219+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.354219+0000","objects_scrubbed":4,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:39.547985+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":804,"num_read_kb":13300,"num_write":1374,"num_write_kb":24353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.427926+0000","last_change":"2024-09-12T01:38:35.427842+0000","last_active":"2024-09-12T01:38:35.427926+0000","last_peered":"2024-09-12T01:38:35.427926+0000","last_clean":"2024-09-12T01:38:35.427926+0000","last_became_active":"2024-09-12T00:28:35.207869+0000","last_became_peered":"2024-09-12T00:28:35.207869+0000","last_unstale":"2024-09-12T01:38:35.427926+0000","last_undegraded":"2024-09-12T01:38:35.427926+0000","last_fullsized":"2024-09-12T01:38:35.427926+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.427738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.427738+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.427738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:41.370814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"263'315","reported_seq":907,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:34.185555+0000","last_change":"2024-09-12T01:38:34.185494+0000","last_active":"2024-09-12T01:38:34.185555+0000","last_peered":"2024-09-12T01:38:34.185555+0000","last_clean":"2024-09-12T01:38:34.185555+0000","last_became_active":"2024-09-12T00:28:37.221289+0000","last_became_peered":"2024-09-12T00:28:37.221289+0000","last_unstale":"2024-09-12T01:38:34.185555+0000","last_undegraded":"2024-09-12T01:38:34.185555+0000","last_fullsized":"2024-09-12T01:38:34.185555+0000","mapping_epoch":31,"log_start":"263'301","ondisk_log_start":"263'301","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'315","last_scrub_stamp":"2024-09-12T01:38:34.185391+0000","last_deep_scrub":"263'315","last_deep_scrub_stamp":"2024-09-12T01:38:34.185391+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.185391+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":301,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:47.522388+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57095,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":538,"num_read_kb":1320,"num_write":444,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:28.207406+0000","last_change":"2024-09-12T01:38:28.207406+0000","last_active":"2024-09-12T01:38:28.207406+0000","last_peered":"2024-09-12T01:38:28.207406+0000","last_clean":"2024-09-12T01:38:28.207406+0000","last_became_active":"2024-09-12T00:28:39.216943+0000","last_became_peered":"2024-09-12T00:28:39.216943+0000","last_unstale":"2024-09-12T01:38:28.207406+0000","last_undegraded":"2024-09-12T01:38:28.207406+0000","last_fullsized":"2024-09-12T01:38:28.207406+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:28.207315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:28.207315+0000","last_clean_scrub_stamp":"2024-09-12T01:38:28.207315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:05.089077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"263'141","reported_seq":687,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:48.359160+0000","last_change":"2024-09-12T01:38:48.359072+0000","last_active":"2024-09-12T01:38:48.359160+0000","last_peered":"2024-09-12T01:38:48.359160+0000","last_clean":"2024-09-12T01:38:48.359160+0000","last_became_active":"2024-09-12T00:28:41.257796+0000","last_became_peered":"2024-09-12T00:28:41.257796+0000","last_unstale":"2024-09-12T01:38:48.359160+0000","last_undegraded":"2024-09-12T01:38:48.359160+0000","last_fullsized":"2024-09-12T01:38:48.359160+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'141","last_scrub_stamp":"2024-09-12T01:38:48.358956+0000","last_deep_scrub":"263'141","last_deep_scrub_stamp":"2024-09-12T01:38:48.358956+0000","last_clean_scrub_stamp":"2024-09-12T01:38:48.358956+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:50.381734+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":982,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":234,"num_read_kb":212,"num_write":368,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"263'74","reported_seq":637,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.198985+0000","last_change":"2024-09-12T01:38:20.198985+0000","last_active":"2024-09-12T01:38:20.198985+0000","last_peered":"2024-09-12T01:38:20.198985+0000","last_clean":"2024-09-12T01:38:20.198985+0000","last_became_active":"2024-09-12T00:28:33.205832+0000","last_became_peered":"2024-09-12T00:28:33.205832+0000","last_unstale":"2024-09-12T01:38:20.198985+0000","last_undegraded":"2024-09-12T01:38:20.198985+0000","last_fullsized":"2024-09-12T01:38:20.198985+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'74","last_scrub_stamp":"2024-09-12T01:38:20.198893+0000","last_deep_scrub":"263'74","last_deep_scrub_stamp":"2024-09-12T01:38:20.198893+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.198893+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:19.080369+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":322,"num_read_kb":264,"num_write":102,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"263'347","reported_seq":991,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.179671+0000","last_change":"2024-09-12T01:38:19.179612+0000","last_active":"2024-09-12T01:38:19.179671+0000","last_peered":"2024-09-12T01:38:19.179671+0000","last_clean":"2024-09-12T01:38:19.179671+0000","last_became_active":"2024-09-12T00:28:31.200234+0000","last_became_peered":"2024-09-12T00:28:31.200234+0000","last_unstale":"2024-09-12T01:38:19.179671+0000","last_undegraded":"2024-09-12T01:38:19.179671+0000","last_fullsized":"2024-09-12T01:38:19.179671+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'347","last_scrub_stamp":"2024-09-12T01:38:19.179470+0000","last_deep_scrub":"263'347","last_deep_scrub_stamp":"2024-09-12T01:38:19.179470+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.179470+0000","objects_scrubbed":10,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:23.079099+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262245,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":466,"num_read_kb":15822,"num_write":1094,"num_write_kb":25857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:33.496440+0000","last_change":"2024-09-12T01:38:33.496358+0000","last_active":"2024-09-12T01:38:33.496440+0000","last_peered":"2024-09-12T01:38:33.496440+0000","last_clean":"2024-09-12T01:38:33.496440+0000","last_became_active":"2024-09-12T00:28:35.206597+0000","last_became_peered":"2024-09-12T00:28:35.206597+0000","last_unstale":"2024-09-12T01:38:33.496440+0000","last_undegraded":"2024-09-12T01:38:33.496440+0000","last_fullsized":"2024-09-12T01:38:33.496440+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:33.496234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:33.496234+0000","last_clean_scrub_stamp":"2024-09-12T01:38:33.496234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:18.065199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"263'283","reported_seq":861,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:39.323453+0000","last_change":"2024-09-12T01:38:39.323392+0000","last_active":"2024-09-12T01:38:39.323453+0000","last_peered":"2024-09-12T01:38:39.323453+0000","last_clean":"2024-09-12T01:38:39.323453+0000","last_became_active":"2024-09-12T00:28:37.219652+0000","last_became_peered":"2024-09-12T00:28:37.219652+0000","last_unstale":"2024-09-12T01:38:39.323453+0000","last_undegraded":"2024-09-12T01:38:39.323453+0000","last_fullsized":"2024-09-12T01:38:39.323453+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'283","last_scrub_stamp":"2024-09-12T01:38:39.323294+0000","last_deep_scrub":"263'283","last_deep_scrub_stamp":"2024-09-12T01:38:39.323294+0000","last_clean_scrub_stamp":"2024-09-12T01:38:39.323294+0000","objects_scrubbed":3,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:13.768409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49715,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":473,"num_read_kb":1234,"num_write":394,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:39.514683+0000","last_change":"2024-09-12T01:38:39.514598+0000","last_active":"2024-09-12T01:38:39.514683+0000","last_peered":"2024-09-12T01:38:39.514683+0000","last_clean":"2024-09-12T01:38:39.514683+0000","last_became_active":"2024-09-12T00:28:39.217869+0000","last_became_peered":"2024-09-12T00:28:39.217869+0000","last_unstale":"2024-09-12T01:38:39.514683+0000","last_undegraded":"2024-09-12T01:38:39.514683+0000","last_fullsized":"2024-09-12T01:38:39.514683+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:39.514499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:39.514499+0000","last_clean_scrub_stamp":"2024-09-12T01:38:39.514499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:15.359627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"263'195","reported_seq":1301,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:43.611117+0000","last_change":"2024-09-12T01:38:43.611045+0000","last_active":"2024-09-12T01:38:43.611117+0000","last_peered":"2024-09-12T01:38:43.611117+0000","last_clean":"2024-09-12T01:38:43.611117+0000","last_became_active":"2024-09-12T00:28:41.232040+0000","last_became_peered":"2024-09-12T00:28:41.232040+0000","last_unstale":"2024-09-12T01:38:43.611117+0000","last_undegraded":"2024-09-12T01:38:43.611117+0000","last_fullsized":"2024-09-12T01:38:43.611117+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'195","last_scrub_stamp":"2024-09-12T01:38:43.610955+0000","last_deep_scrub":"263'195","last_deep_scrub_stamp":"2024-09-12T01:38:43.610955+0000","last_clean_scrub_stamp":"2024-09-12T01:38:43.610955+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:32.696507+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":841,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":800,"num_read_kb":795,"num_write":450,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"263'254","reported_seq":922,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.516726+0000","last_change":"2024-09-12T01:38:15.516670+0000","last_active":"2024-09-12T01:38:15.516726+0000","last_peered":"2024-09-12T01:38:15.516726+0000","last_clean":"2024-09-12T01:38:15.516726+0000","last_became_active":"2024-09-12T00:28:33.208787+0000","last_became_peered":"2024-09-12T00:28:33.208787+0000","last_unstale":"2024-09-12T01:38:15.516726+0000","last_undegraded":"2024-09-12T01:38:15.516726+0000","last_fullsized":"2024-09-12T01:38:15.516726+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'254","last_scrub_stamp":"2024-09-12T01:38:15.516591+0000","last_deep_scrub":"263'254","last_deep_scrub_stamp":"2024-09-12T01:38:15.516591+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.516591+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:22.435596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1164,"num_read_kb":956,"num_write":405,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"263'322","reported_seq":1078,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.049656+0000","last_change":"2024-09-12T01:38:12.049656+0000","last_active":"2024-09-12T01:38:12.049656+0000","last_peered":"2024-09-12T01:38:12.049656+0000","last_clean":"2024-09-12T01:38:12.049656+0000","last_became_active":"2024-09-12T00:29:04.274746+0000","last_became_peered":"2024-09-12T00:29:04.274746+0000","last_unstale":"2024-09-12T01:38:12.049656+0000","last_undegraded":"2024-09-12T01:38:12.049656+0000","last_fullsized":"2024-09-12T01:38:12.049656+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'322","last_scrub_stamp":"2024-09-12T01:38:12.049537+0000","last_deep_scrub":"263'322","last_deep_scrub_stamp":"2024-09-12T01:38:12.049537+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.049537+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:42.701831+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524334,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":565,"num_read_kb":52761,"num_write":1033,"num_write_kb":38285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"263'6","reported_seq":997,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:24.038564+0000","last_change":"2024-09-12T01:38:24.038504+0000","last_active":"2024-09-12T01:38:24.038564+0000","last_peered":"2024-09-12T01:38:24.038564+0000","last_clean":"2024-09-12T01:38:24.038564+0000","last_became_active":"2024-09-12T00:28:35.207332+0000","last_became_peered":"2024-09-12T00:28:35.207332+0000","last_unstale":"2024-09-12T01:38:24.038564+0000","last_undegraded":"2024-09-12T01:38:24.038564+0000","last_fullsized":"2024-09-12T01:38:24.038564+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-12T01:38:24.038400+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-12T01:38:24.038400+0000","last_clean_scrub_stamp":"2024-09-12T01:38:24.038400+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:33.692701+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"263'331","reported_seq":945,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.563535+0000","last_change":"2024-09-12T01:38:35.563468+0000","last_active":"2024-09-12T01:38:35.563535+0000","last_peered":"2024-09-12T01:38:35.563535+0000","last_clean":"2024-09-12T01:38:35.563535+0000","last_became_active":"2024-09-12T00:28:37.207373+0000","last_became_peered":"2024-09-12T00:28:37.207373+0000","last_unstale":"2024-09-12T01:38:35.563535+0000","last_undegraded":"2024-09-12T01:38:35.563535+0000","last_fullsized":"2024-09-12T01:38:35.563535+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'331","last_scrub_stamp":"2024-09-12T01:38:35.563375+0000","last_deep_scrub":"263'331","last_deep_scrub_stamp":"2024-09-12T01:38:35.563375+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.563375+0000","objects_scrubbed":6,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:36.551810+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45135,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":515,"num_read_kb":1089,"num_write":408,"num_write_kb":271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:40.196233+0000","last_change":"2024-09-12T01:38:40.196160+0000","last_active":"2024-09-12T01:38:40.196233+0000","last_peered":"2024-09-12T01:38:40.196233+0000","last_clean":"2024-09-12T01:38:40.196233+0000","last_became_active":"2024-09-12T00:28:39.215651+0000","last_became_peered":"2024-09-12T00:28:39.215651+0000","last_unstale":"2024-09-12T01:38:40.196233+0000","last_undegraded":"2024-09-12T01:38:40.196233+0000","last_fullsized":"2024-09-12T01:38:40.196233+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:40.196075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:40.196075+0000","last_clean_scrub_stamp":"2024-09-12T01:38:40.196075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:01.668864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"263'135","reported_seq":640,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:41.532394+0000","last_change":"2024-09-12T01:38:41.532394+0000","last_active":"2024-09-12T01:38:41.532394+0000","last_peered":"2024-09-12T01:38:41.532394+0000","last_clean":"2024-09-12T01:38:41.532394+0000","last_became_active":"2024-09-12T00:28:41.226687+0000","last_became_peered":"2024-09-12T00:28:41.226687+0000","last_unstale":"2024-09-12T01:38:41.532394+0000","last_undegraded":"2024-09-12T01:38:41.532394+0000","last_fullsized":"2024-09-12T01:38:41.532394+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'135","last_scrub_stamp":"2024-09-12T01:38:41.532303+0000","last_deep_scrub":"263'135","last_deep_scrub_stamp":"2024-09-12T01:38:41.532303+0000","last_clean_scrub_stamp":"2024-09-12T01:38:41.532303+0000","objects_scrubbed":3,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:48.267743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":132,"num_read_kb":117,"num_write":304,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"263'293","reported_seq":931,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.060156+0000","last_change":"2024-09-12T01:38:21.060156+0000","last_active":"2024-09-12T01:38:21.060156+0000","last_peered":"2024-09-12T01:38:21.060156+0000","last_clean":"2024-09-12T01:38:21.060156+0000","last_became_active":"2024-09-12T00:28:33.210635+0000","last_became_peered":"2024-09-12T00:28:33.210635+0000","last_unstale":"2024-09-12T01:38:21.060156+0000","last_undegraded":"2024-09-12T01:38:21.060156+0000","last_fullsized":"2024-09-12T01:38:21.060156+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'293","last_scrub_stamp":"2024-09-12T01:38:21.060078+0000","last_deep_scrub":"263'293","last_deep_scrub_stamp":"2024-09-12T01:38:21.060078+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.060078+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:54.397394+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1259,"num_read_kb":1011,"num_write":460,"num_write_kb":225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"263'338","reported_seq":966,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.121833+0000","last_change":"2024-09-12T01:38:12.121833+0000","last_active":"2024-09-12T01:38:12.121833+0000","last_peered":"2024-09-12T01:38:12.121833+0000","last_clean":"2024-09-12T01:38:12.121833+0000","last_became_active":"2024-09-12T00:28:31.206672+0000","last_became_peered":"2024-09-12T00:28:31.206672+0000","last_unstale":"2024-09-12T01:38:12.121833+0000","last_undegraded":"2024-09-12T01:38:12.121833+0000","last_fullsized":"2024-09-12T01:38:12.121833+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'338","last_scrub_stamp":"2024-09-12T01:38:12.121735+0000","last_deep_scrub":"263'338","last_deep_scrub_stamp":"2024-09-12T01:38:12.121735+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.121735+0000","objects_scrubbed":6,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:41.412623+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661307,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":464,"num_read_kb":11577,"num_write":1050,"num_write_kb":29091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"263'314","reported_seq":949,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.088957+0000","last_change":"2024-09-12T01:38:16.088957+0000","last_active":"2024-09-12T01:38:16.088957+0000","last_peered":"2024-09-12T01:38:16.088957+0000","last_clean":"2024-09-12T01:38:16.088957+0000","last_became_active":"2024-09-12T00:28:33.206512+0000","last_became_peered":"2024-09-12T00:28:33.206512+0000","last_unstale":"2024-09-12T01:38:16.088957+0000","last_undegraded":"2024-09-12T01:38:16.088957+0000","last_fullsized":"2024-09-12T01:38:16.088957+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'314","last_scrub_stamp":"2024-09-12T01:38:16.088862+0000","last_deep_scrub":"263'314","last_deep_scrub_stamp":"2024-09-12T01:38:16.088862+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.088862+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:00.843923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1325,"num_read_kb":1067,"num_write":489,"num_write_kb":251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"263'331","reported_seq":978,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:08.834993+0000","last_change":"2024-09-12T01:38:08.834993+0000","last_active":"2024-09-12T01:38:08.834993+0000","last_peered":"2024-09-12T01:38:08.834993+0000","last_clean":"2024-09-12T01:38:08.834993+0000","last_became_active":"2024-09-12T00:29:04.271753+0000","last_became_peered":"2024-09-12T00:29:04.271753+0000","last_unstale":"2024-09-12T01:38:08.834993+0000","last_undegraded":"2024-09-12T01:38:08.834993+0000","last_fullsized":"2024-09-12T01:38:08.834993+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'331","last_scrub_stamp":"2024-09-12T01:38:08.834925+0000","last_deep_scrub":"263'331","last_deep_scrub_stamp":"2024-09-12T01:38:08.834925+0000","last_clean_scrub_stamp":"2024-09-12T01:38:08.834925+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:41.298044+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":504,"num_read_kb":1624,"num_write":1034,"num_write_kb":30525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"263'350","reported_seq":969,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:26.390197+0000","last_change":"2024-09-12T01:38:26.390197+0000","last_active":"2024-09-12T01:38:26.390197+0000","last_peered":"2024-09-12T01:38:26.390197+0000","last_clean":"2024-09-12T01:38:26.390197+0000","last_became_active":"2024-09-12T00:28:33.214679+0000","last_became_peered":"2024-09-12T00:28:33.214679+0000","last_unstale":"2024-09-12T01:38:26.390197+0000","last_undegraded":"2024-09-12T01:38:26.390197+0000","last_fullsized":"2024-09-12T01:38:26.390197+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'350","last_scrub_stamp":"2024-09-12T01:38:26.390114+0000","last_deep_scrub":"263'350","last_deep_scrub_stamp":"2024-09-12T01:38:26.390114+0000","last_clean_scrub_stamp":"2024-09-12T01:38:26.390114+0000","objects_scrubbed":1,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:19.138258+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1495,"num_read_kb":1194,"num_write":562,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"263'379","reported_seq":1054,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.375518+0000","last_change":"2024-09-12T01:38:16.375518+0000","last_active":"2024-09-12T01:38:16.375518+0000","last_peered":"2024-09-12T01:38:16.375518+0000","last_clean":"2024-09-12T01:38:16.375518+0000","last_became_active":"2024-09-12T00:28:31.209266+0000","last_became_peered":"2024-09-12T00:28:31.209266+0000","last_unstale":"2024-09-12T01:38:16.375518+0000","last_undegraded":"2024-09-12T01:38:16.375518+0000","last_fullsized":"2024-09-12T01:38:16.375518+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'379","last_scrub_stamp":"2024-09-12T01:38:16.375401+0000","last_deep_scrub":"263'379","last_deep_scrub_stamp":"2024-09-12T01:38:16.375401+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.375401+0000","objects_scrubbed":15,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:39.836701+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2581681,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":574,"num_read_kb":38602,"num_write":1242,"num_write_kb":22367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"263'105","reported_seq":698,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.041650+0000","last_change":"2024-09-12T01:38:17.041650+0000","last_active":"2024-09-12T01:38:17.041650+0000","last_peered":"2024-09-12T01:38:17.041650+0000","last_clean":"2024-09-12T01:38:17.041650+0000","last_became_active":"2024-09-12T00:28:33.213020+0000","last_became_peered":"2024-09-12T00:28:33.213020+0000","last_unstale":"2024-09-12T01:38:17.041650+0000","last_undegraded":"2024-09-12T01:38:17.041650+0000","last_fullsized":"2024-09-12T01:38:17.041650+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'105","last_scrub_stamp":"2024-09-12T01:38:17.041548+0000","last_deep_scrub":"263'105","last_deep_scrub_stamp":"2024-09-12T01:38:17.041548+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.041548+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:31.379735+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":435,"num_read_kb":365,"num_write":138,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"263'312","reported_seq":1058,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.130935+0000","last_change":"2024-09-12T01:38:19.130935+0000","last_active":"2024-09-12T01:38:19.130935+0000","last_peered":"2024-09-12T01:38:19.130935+0000","last_clean":"2024-09-12T01:38:19.130935+0000","last_became_active":"2024-09-12T00:28:31.208548+0000","last_became_peered":"2024-09-12T00:28:31.208548+0000","last_unstale":"2024-09-12T01:38:19.130935+0000","last_undegraded":"2024-09-12T01:38:19.130935+0000","last_fullsized":"2024-09-12T01:38:19.130935+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'312","last_scrub_stamp":"2024-09-12T01:38:19.130834+0000","last_deep_scrub":"263'312","last_deep_scrub_stamp":"2024-09-12T01:38:19.130834+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.130834+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:32.788994+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49275,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":734,"num_read_kb":31441,"num_write":965,"num_write_kb":36605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"263'125","reported_seq":769,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:23.259183+0000","last_change":"2024-09-12T01:38:23.259183+0000","last_active":"2024-09-12T01:38:23.259183+0000","last_peered":"2024-09-12T01:38:23.259183+0000","last_clean":"2024-09-12T01:38:23.259183+0000","last_became_active":"2024-09-12T00:28:33.217573+0000","last_became_peered":"2024-09-12T00:28:33.217573+0000","last_unstale":"2024-09-12T01:38:23.259183+0000","last_undegraded":"2024-09-12T01:38:23.259183+0000","last_fullsized":"2024-09-12T01:38:23.259183+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'125","last_scrub_stamp":"2024-09-12T01:38:23.259101+0000","last_deep_scrub":"263'125","last_deep_scrub_stamp":"2024-09-12T01:38:23.259101+0000","last_clean_scrub_stamp":"2024-09-12T01:38:23.259101+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:11.077813+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":588,"num_read_kb":500,"num_write":193,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"263'360","reported_seq":1010,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:09.821543+0000","last_change":"2024-09-12T01:38:09.821485+0000","last_active":"2024-09-12T01:38:09.821543+0000","last_peered":"2024-09-12T01:38:09.821543+0000","last_clean":"2024-09-12T01:38:09.821543+0000","last_became_active":"2024-09-12T00:29:04.267546+0000","last_became_peered":"2024-09-12T00:29:04.267546+0000","last_unstale":"2024-09-12T01:38:09.821543+0000","last_undegraded":"2024-09-12T01:38:09.821543+0000","last_fullsized":"2024-09-12T01:38:09.821543+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'360","last_scrub_stamp":"2024-09-12T01:38:09.821400+0000","last_deep_scrub":"263'360","last_deep_scrub_stamp":"2024-09-12T01:38:09.821400+0000","last_clean_scrub_stamp":"2024-09-12T01:38:09.821400+0000","objects_scrubbed":8,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:41.679527+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2316165,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":596,"num_read_kb":3307,"num_write":1233,"num_write_kb":18821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"263'309","reported_seq":1011,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.491401+0000","last_change":"2024-09-12T01:38:21.491401+0000","last_active":"2024-09-12T01:38:21.491401+0000","last_peered":"2024-09-12T01:38:21.491401+0000","last_clean":"2024-09-12T01:38:21.491401+0000","last_became_active":"2024-09-12T00:28:33.208929+0000","last_became_peered":"2024-09-12T00:28:33.208929+0000","last_unstale":"2024-09-12T01:38:21.491401+0000","last_undegraded":"2024-09-12T01:38:21.491401+0000","last_fullsized":"2024-09-12T01:38:21.491401+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'309","last_scrub_stamp":"2024-09-12T01:38:21.491305+0000","last_deep_scrub":"263'309","last_deep_scrub_stamp":"2024-09-12T01:38:21.491305+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.491305+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:34.771827+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1423,"num_read_kb":1158,"num_write":481,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4001,"num_omap_keys":18,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"263'317","reported_seq":967,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.214608+0000","last_change":"2024-09-12T01:38:11.214608+0000","last_active":"2024-09-12T01:38:11.214608+0000","last_peered":"2024-09-12T01:38:11.214608+0000","last_clean":"2024-09-12T01:38:11.214608+0000","last_became_active":"2024-09-12T00:28:31.205829+0000","last_became_peered":"2024-09-12T00:28:31.205829+0000","last_unstale":"2024-09-12T01:38:11.214608+0000","last_undegraded":"2024-09-12T01:38:11.214608+0000","last_fullsized":"2024-09-12T01:38:11.214608+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'317","last_scrub_stamp":"2024-09-12T01:38:11.214498+0000","last_deep_scrub":"263'317","last_deep_scrub_stamp":"2024-09-12T01:38:11.214498+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.214498+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:14.918145+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262189,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":453,"num_read_kb":5277,"num_write":1032,"num_write_kb":26638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"263'110","reported_seq":707,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.225675+0000","last_change":"2024-09-12T01:38:21.225675+0000","last_active":"2024-09-12T01:38:21.225675+0000","last_peered":"2024-09-12T01:38:21.225675+0000","last_clean":"2024-09-12T01:38:21.225675+0000","last_became_active":"2024-09-12T00:28:33.208010+0000","last_became_peered":"2024-09-12T00:28:33.208010+0000","last_unstale":"2024-09-12T01:38:21.225675+0000","last_undegraded":"2024-09-12T01:38:21.225675+0000","last_fullsized":"2024-09-12T01:38:21.225675+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'110","last_scrub_stamp":"2024-09-12T01:38:21.225579+0000","last_deep_scrub":"263'110","last_deep_scrub_stamp":"2024-09-12T01:38:21.225579+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.225579+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:01.368932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":481,"num_read_kb":401,"num_write":165,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"263'372","reported_seq":1022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.127767+0000","last_change":"2024-09-12T01:38:15.127767+0000","last_active":"2024-09-12T01:38:15.127767+0000","last_peered":"2024-09-12T01:38:15.127767+0000","last_clean":"2024-09-12T01:38:15.127767+0000","last_became_active":"2024-09-12T00:28:31.205366+0000","last_became_peered":"2024-09-12T00:28:31.205366+0000","last_unstale":"2024-09-12T01:38:15.127767+0000","last_undegraded":"2024-09-12T01:38:15.127767+0000","last_fullsized":"2024-09-12T01:38:15.127767+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'372","last_scrub_stamp":"2024-09-12T01:38:15.127655+0000","last_deep_scrub":"263'372","last_deep_scrub_stamp":"2024-09-12T01:38:15.127655+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.127655+0000","objects_scrubbed":3,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:47.340053+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":592,"num_read_kb":12807,"num_write":1213,"num_write_kb":27426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"263'207","reported_seq":835,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.245276+0000","last_change":"2024-09-12T01:38:20.245276+0000","last_active":"2024-09-12T01:38:20.245276+0000","last_peered":"2024-09-12T01:38:20.245276+0000","last_clean":"2024-09-12T01:38:20.245276+0000","last_became_active":"2024-09-12T00:28:33.209028+0000","last_became_peered":"2024-09-12T00:28:33.209028+0000","last_unstale":"2024-09-12T01:38:20.245276+0000","last_undegraded":"2024-09-12T01:38:20.245276+0000","last_fullsized":"2024-09-12T01:38:20.245276+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'207","last_scrub_stamp":"2024-09-12T01:38:20.245188+0000","last_deep_scrub":"263'207","last_deep_scrub_stamp":"2024-09-12T01:38:20.245188+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.245188+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:22.561594+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":877,"num_read_kb":721,"num_write":304,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":758,"num_omap_keys":4,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"263'330","reported_seq":1007,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.216893+0000","last_change":"2024-09-12T01:38:12.216893+0000","last_active":"2024-09-12T01:38:12.216893+0000","last_peered":"2024-09-12T01:38:12.216893+0000","last_clean":"2024-09-12T01:38:12.216893+0000","last_became_active":"2024-09-12T00:28:31.203185+0000","last_became_peered":"2024-09-12T00:28:31.203185+0000","last_unstale":"2024-09-12T01:38:12.216893+0000","last_undegraded":"2024-09-12T01:38:12.216893+0000","last_fullsized":"2024-09-12T01:38:12.216893+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'330","last_scrub_stamp":"2024-09-12T01:38:12.216795+0000","last_deep_scrub":"263'330","last_deep_scrub_stamp":"2024-09-12T01:38:12.216795+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.216795+0000","objects_scrubbed":5,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:53.679636+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524364,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":503,"num_read_kb":88709,"num_write":1042,"num_write_kb":43642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"263'404","reported_seq":1090,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.068469+0000","last_change":"2024-09-12T01:38:16.068399+0000","last_active":"2024-09-12T01:38:16.068469+0000","last_peered":"2024-09-12T01:38:16.068469+0000","last_clean":"2024-09-12T01:38:16.068469+0000","last_became_active":"2024-09-12T00:29:04.275434+0000","last_became_peered":"2024-09-12T00:29:04.275434+0000","last_unstale":"2024-09-12T01:38:16.068469+0000","last_undegraded":"2024-09-12T01:38:16.068469+0000","last_fullsized":"2024-09-12T01:38:16.068469+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'404","last_scrub_stamp":"2024-09-12T01:38:16.068300+0000","last_deep_scrub":"263'404","last_deep_scrub_stamp":"2024-09-12T01:38:16.068300+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.068300+0000","objects_scrubbed":1,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:12.998225+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1782,"num_read_kb":1435,"num_write":639,"num_write_kb":352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"263'335","reported_seq":980,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.350385+0000","last_change":"2024-09-12T01:38:17.350385+0000","last_active":"2024-09-12T01:38:17.350385+0000","last_peered":"2024-09-12T01:38:17.350385+0000","last_clean":"2024-09-12T01:38:17.350385+0000","last_became_active":"2024-09-12T00:28:31.209468+0000","last_became_peered":"2024-09-12T00:28:31.209468+0000","last_unstale":"2024-09-12T01:38:17.350385+0000","last_undegraded":"2024-09-12T01:38:17.350385+0000","last_fullsized":"2024-09-12T01:38:17.350385+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'335","last_scrub_stamp":"2024-09-12T01:38:17.350292+0000","last_deep_scrub":"263'335","last_deep_scrub_stamp":"2024-09-12T01:38:17.350292+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.350292+0000","objects_scrubbed":7,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:50.033794+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6901132,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":496,"num_read_kb":2644,"num_write":1040,"num_write_kb":18676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"263'161","reported_seq":745,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:23.532865+0000","last_change":"2024-09-12T01:38:23.532779+0000","last_active":"2024-09-12T01:38:23.532865+0000","last_peered":"2024-09-12T01:38:23.532865+0000","last_clean":"2024-09-12T01:38:23.532865+0000","last_became_active":"2024-09-12T00:28:33.208285+0000","last_became_peered":"2024-09-12T00:28:33.208285+0000","last_unstale":"2024-09-12T01:38:23.532865+0000","last_undegraded":"2024-09-12T01:38:23.532865+0000","last_fullsized":"2024-09-12T01:38:23.532865+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'161","last_scrub_stamp":"2024-09-12T01:38:23.532688+0000","last_deep_scrub":"263'161","last_deep_scrub_stamp":"2024-09-12T01:38:23.532688+0000","last_clean_scrub_stamp":"2024-09-12T01:38:23.532688+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:07.016907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":689,"num_read_kb":558,"num_write":246,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"263'367","reported_seq":1006,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.197599+0000","last_change":"2024-09-12T01:38:11.197534+0000","last_active":"2024-09-12T01:38:11.197599+0000","last_peered":"2024-09-12T01:38:11.197599+0000","last_clean":"2024-09-12T01:38:11.197599+0000","last_became_active":"2024-09-12T00:28:31.199924+0000","last_became_peered":"2024-09-12T00:28:31.199924+0000","last_unstale":"2024-09-12T01:38:11.197599+0000","last_undegraded":"2024-09-12T01:38:11.197599+0000","last_fullsized":"2024-09-12T01:38:11.197599+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'367","last_scrub_stamp":"2024-09-12T01:38:11.197392+0000","last_deep_scrub":"263'367","last_deep_scrub_stamp":"2024-09-12T01:38:11.197392+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.197392+0000","objects_scrubbed":8,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:53.293586+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":490,"num_read_kb":12716,"num_write":1120,"num_write_kb":44871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"263'322","reported_seq":1008,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.731603+0000","last_change":"2024-09-12T01:38:11.731545+0000","last_active":"2024-09-12T01:38:11.731603+0000","last_peered":"2024-09-12T01:38:11.731603+0000","last_clean":"2024-09-12T01:38:11.731603+0000","last_became_active":"2024-09-12T00:28:33.208088+0000","last_became_peered":"2024-09-12T00:28:33.208088+0000","last_unstale":"2024-09-12T01:38:11.731603+0000","last_undegraded":"2024-09-12T01:38:11.731603+0000","last_fullsized":"2024-09-12T01:38:11.731603+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'322","last_scrub_stamp":"2024-09-12T01:38:11.731432+0000","last_deep_scrub":"263'322","last_deep_scrub_stamp":"2024-09-12T01:38:11.731432+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.731432+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:50.629920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1424,"num_read_kb":1183,"num_write":488,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"263'345","reported_seq":1022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.364820+0000","last_change":"2024-09-12T01:38:19.364820+0000","last_active":"2024-09-12T01:38:19.364820+0000","last_peered":"2024-09-12T01:38:19.364820+0000","last_clean":"2024-09-12T01:38:19.364820+0000","last_became_active":"2024-09-12T00:28:31.211083+0000","last_became_peered":"2024-09-12T00:28:31.211083+0000","last_unstale":"2024-09-12T01:38:19.364820+0000","last_undegraded":"2024-09-12T01:38:19.364820+0000","last_fullsized":"2024-09-12T01:38:19.364820+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'345","last_scrub_stamp":"2024-09-12T01:38:19.364715+0000","last_deep_scrub":"263'345","last_deep_scrub_stamp":"2024-09-12T01:38:19.364715+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.364715+0000","objects_scrubbed":4,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:27.035569+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262163,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":601,"num_read_kb":3403,"num_write":1227,"num_write_kb":8870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"263'153","reported_seq":777,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.523050+0000","last_change":"2024-09-12T01:38:22.523050+0000","last_active":"2024-09-12T01:38:22.523050+0000","last_peered":"2024-09-12T01:38:22.523050+0000","last_clean":"2024-09-12T01:38:22.523050+0000","last_became_active":"2024-09-12T00:28:33.209024+0000","last_became_peered":"2024-09-12T00:28:33.209024+0000","last_unstale":"2024-09-12T01:38:22.523050+0000","last_undegraded":"2024-09-12T01:38:22.523050+0000","last_fullsized":"2024-09-12T01:38:22.523050+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'153","last_scrub_stamp":"2024-09-12T01:38:22.522969+0000","last_deep_scrub":"263'153","last_deep_scrub_stamp":"2024-09-12T01:38:22.522969+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.522969+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:06.711391+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":684,"num_read_kb":599,"num_write":231,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2875,"num_omap_keys":12,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"263'317","reported_seq":944,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.145248+0000","last_change":"2024-09-12T01:38:21.145248+0000","last_active":"2024-09-12T01:38:21.145248+0000","last_peered":"2024-09-12T01:38:21.145248+0000","last_clean":"2024-09-12T01:38:21.145248+0000","last_became_active":"2024-09-12T00:28:31.207399+0000","last_became_peered":"2024-09-12T00:28:31.207399+0000","last_unstale":"2024-09-12T01:38:21.145248+0000","last_undegraded":"2024-09-12T01:38:21.145248+0000","last_fullsized":"2024-09-12T01:38:21.145248+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'317","last_scrub_stamp":"2024-09-12T01:38:21.145153+0000","last_deep_scrub":"263'317","last_deep_scrub_stamp":"2024-09-12T01:38:21.145153+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.145153+0000","objects_scrubbed":8,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:08.962443+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":660490,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":412,"num_read_kb":9232,"num_write":885,"num_write_kb":18206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"263'63","reported_seq":625,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.359615+0000","last_change":"2024-09-12T01:38:22.359615+0000","last_active":"2024-09-12T01:38:22.359615+0000","last_peered":"2024-09-12T01:38:22.359615+0000","last_clean":"2024-09-12T01:38:22.359615+0000","last_became_active":"2024-09-12T00:28:33.213110+0000","last_became_peered":"2024-09-12T00:28:33.213110+0000","last_unstale":"2024-09-12T01:38:22.359615+0000","last_undegraded":"2024-09-12T01:38:22.359615+0000","last_fullsized":"2024-09-12T01:38:22.359615+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'63","last_scrub_stamp":"2024-09-12T01:38:22.359523+0000","last_deep_scrub":"263'63","last_deep_scrub_stamp":"2024-09-12T01:38:22.359523+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.359523+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:22.071319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":226,"num_write":102,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"263'358","reported_seq":1040,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.132038+0000","last_change":"2024-09-12T01:38:11.131978+0000","last_active":"2024-09-12T01:38:11.132038+0000","last_peered":"2024-09-12T01:38:11.132038+0000","last_clean":"2024-09-12T01:38:11.132038+0000","last_became_active":"2024-09-12T00:28:31.203478+0000","last_became_peered":"2024-09-12T00:28:31.203478+0000","last_unstale":"2024-09-12T01:38:11.132038+0000","last_undegraded":"2024-09-12T01:38:11.132038+0000","last_fullsized":"2024-09-12T01:38:11.132038+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'358","last_scrub_stamp":"2024-09-12T01:38:11.131892+0000","last_deep_scrub":"263'358","last_deep_scrub_stamp":"2024-09-12T01:38:11.131892+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.131892+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:45.732319+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":633,"num_read_kb":38935,"num_write":1084,"num_write_kb":32997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"263'193","reported_seq":790,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:25.095313+0000","last_change":"2024-09-12T01:38:25.095313+0000","last_active":"2024-09-12T01:38:25.095313+0000","last_peered":"2024-09-12T01:38:25.095313+0000","last_clean":"2024-09-12T01:38:25.095313+0000","last_became_active":"2024-09-12T00:28:33.220013+0000","last_became_peered":"2024-09-12T00:28:33.220013+0000","last_unstale":"2024-09-12T01:38:25.095313+0000","last_undegraded":"2024-09-12T01:38:25.095313+0000","last_fullsized":"2024-09-12T01:38:25.095313+0000","mapping_epoch":27,"log_start":"260'100","ondisk_log_start":"260'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'193","last_scrub_stamp":"2024-09-12T01:38:25.095217+0000","last_deep_scrub":"263'193","last_deep_scrub_stamp":"2024-09-12T01:38:25.095217+0000","last_clean_scrub_stamp":"2024-09-12T01:38:25.095217+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:10.616066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":806,"num_read_kb":650,"num_write":294,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"263'317","reported_seq":943,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.258336+0000","last_change":"2024-09-12T01:38:19.258278+0000","last_active":"2024-09-12T01:38:19.258336+0000","last_peered":"2024-09-12T01:38:19.258336+0000","last_clean":"2024-09-12T01:38:19.258336+0000","last_became_active":"2024-09-12T00:28:31.204305+0000","last_became_peered":"2024-09-12T00:28:31.204305+0000","last_unstale":"2024-09-12T01:38:19.258336+0000","last_undegraded":"2024-09-12T01:38:19.258336+0000","last_fullsized":"2024-09-12T01:38:19.258336+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'317","last_scrub_stamp":"2024-09-12T01:38:19.258187+0000","last_deep_scrub":"263'317","last_deep_scrub_stamp":"2024-09-12T01:38:19.258187+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.258187+0000","objects_scrubbed":3,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:01.813877+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133653,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":11794,"num_write":1040,"num_write_kb":34532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"263'111","reported_seq":730,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:24.295044+0000","last_change":"2024-09-12T01:38:24.295044+0000","last_active":"2024-09-12T01:38:24.295044+0000","last_peered":"2024-09-12T01:38:24.295044+0000","last_clean":"2024-09-12T01:38:24.295044+0000","last_became_active":"2024-09-12T00:28:33.216814+0000","last_became_peered":"2024-09-12T00:28:33.216814+0000","last_unstale":"2024-09-12T01:38:24.295044+0000","last_undegraded":"2024-09-12T01:38:24.295044+0000","last_fullsized":"2024-09-12T01:38:24.295044+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'111","last_scrub_stamp":"2024-09-12T01:38:24.294958+0000","last_deep_scrub":"263'111","last_deep_scrub_stamp":"2024-09-12T01:38:24.294958+0000","last_clean_scrub_stamp":"2024-09-12T01:38:24.294958+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:08.641709+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":456,"num_read_kb":389,"num_write":151,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":506,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"263'365","reported_seq":1057,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.773208+0000","last_change":"2024-09-12T01:38:10.773147+0000","last_active":"2024-09-12T01:38:10.773208+0000","last_peered":"2024-09-12T01:38:10.773208+0000","last_clean":"2024-09-12T01:38:10.773208+0000","last_became_active":"2024-09-12T00:28:31.200421+0000","last_became_peered":"2024-09-12T00:28:31.200421+0000","last_unstale":"2024-09-12T01:38:10.773208+0000","last_undegraded":"2024-09-12T01:38:10.773208+0000","last_fullsized":"2024-09-12T01:38:10.773208+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'365","last_scrub_stamp":"2024-09-12T01:38:10.773072+0000","last_deep_scrub":"263'365","last_deep_scrub_stamp":"2024-09-12T01:38:10.773072+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.773072+0000","objects_scrubbed":8,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:26.211979+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1658143,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":544,"num_read_kb":83268,"num_write":1180,"num_write_kb":21609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"263'106","reported_seq":692,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:23.404525+0000","last_change":"2024-09-12T01:38:23.404525+0000","last_active":"2024-09-12T01:38:23.404525+0000","last_peered":"2024-09-12T01:38:23.404525+0000","last_clean":"2024-09-12T01:38:23.404525+0000","last_became_active":"2024-09-12T00:28:33.213100+0000","last_became_peered":"2024-09-12T00:28:33.213100+0000","last_unstale":"2024-09-12T01:38:23.404525+0000","last_undegraded":"2024-09-12T01:38:23.404525+0000","last_fullsized":"2024-09-12T01:38:23.404525+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'106","last_scrub_stamp":"2024-09-12T01:38:23.404436+0000","last_deep_scrub":"263'106","last_deep_scrub_stamp":"2024-09-12T01:38:23.404436+0000","last_clean_scrub_stamp":"2024-09-12T01:38:23.404436+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:21.969675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":481,"num_read_kb":399,"num_write":154,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"263'352","reported_seq":1049,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.334977+0000","last_change":"2024-09-12T01:38:20.334920+0000","last_active":"2024-09-12T01:38:20.334977+0000","last_peered":"2024-09-12T01:38:20.334977+0000","last_clean":"2024-09-12T01:38:20.334977+0000","last_became_active":"2024-09-12T00:28:31.215581+0000","last_became_peered":"2024-09-12T00:28:31.215581+0000","last_unstale":"2024-09-12T01:38:20.334977+0000","last_undegraded":"2024-09-12T01:38:20.334977+0000","last_fullsized":"2024-09-12T01:38:20.334977+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'352","last_scrub_stamp":"2024-09-12T01:38:20.334798+0000","last_deep_scrub":"263'352","last_deep_scrub_stamp":"2024-09-12T01:38:20.334798+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.334798+0000","objects_scrubbed":6,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:37:37.813524+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3558704,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":578,"num_read_kb":13304,"num_write":1188,"num_write_kb":31930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"263'311","reported_seq":960,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.358337+0000","last_change":"2024-09-12T01:38:18.358278+0000","last_active":"2024-09-12T01:38:18.358337+0000","last_peered":"2024-09-12T01:38:18.358337+0000","last_clean":"2024-09-12T01:38:18.358337+0000","last_became_active":"2024-09-12T00:28:31.214134+0000","last_became_peered":"2024-09-12T00:28:31.214134+0000","last_unstale":"2024-09-12T01:38:18.358337+0000","last_undegraded":"2024-09-12T01:38:18.358337+0000","last_fullsized":"2024-09-12T01:38:18.358337+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'311","last_scrub_stamp":"2024-09-12T01:38:18.358164+0000","last_deep_scrub":"263'311","last_deep_scrub_stamp":"2024-09-12T01:38:18.358164+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.358164+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:36.150651+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553650,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":469,"num_read_kb":31725,"num_write":1010,"num_write_kb":40420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"263'102","reported_seq":702,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.109012+0000","last_change":"2024-09-12T01:38:20.109012+0000","last_active":"2024-09-12T01:38:20.109012+0000","last_peered":"2024-09-12T01:38:20.109012+0000","last_clean":"2024-09-12T01:38:20.109012+0000","last_became_active":"2024-09-12T00:28:33.212886+0000","last_became_peered":"2024-09-12T00:28:33.212886+0000","last_unstale":"2024-09-12T01:38:20.109012+0000","last_undegraded":"2024-09-12T01:38:20.109012+0000","last_fullsized":"2024-09-12T01:38:20.109012+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'102","last_scrub_stamp":"2024-09-12T01:38:20.108923+0000","last_deep_scrub":"263'102","last_deep_scrub_stamp":"2024-09-12T01:38:20.108923+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.108923+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:02.824645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":476,"num_read_kb":407,"num_write":159,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"263'403","reported_seq":1159,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.146849+0000","last_change":"2024-09-12T01:38:15.146793+0000","last_active":"2024-09-12T01:38:15.146849+0000","last_peered":"2024-09-12T01:38:15.146849+0000","last_clean":"2024-09-12T01:38:15.146849+0000","last_became_active":"2024-09-12T00:28:31.196230+0000","last_became_peered":"2024-09-12T00:28:31.196230+0000","last_unstale":"2024-09-12T01:38:15.146849+0000","last_undegraded":"2024-09-12T01:38:15.146849+0000","last_fullsized":"2024-09-12T01:38:15.146849+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'403","last_scrub_stamp":"2024-09-12T01:38:15.146666+0000","last_deep_scrub":"263'403","last_deep_scrub_stamp":"2024-09-12T01:38:15.146666+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.146666+0000","objects_scrubbed":7,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:40.043210+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291522,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":735,"num_read_kb":35673,"num_write":1292,"num_write_kb":40181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"263'213","reported_seq":811,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:28.420757+0000","last_change":"2024-09-12T01:38:28.420645+0000","last_active":"2024-09-12T01:38:28.420757+0000","last_peered":"2024-09-12T01:38:28.420757+0000","last_clean":"2024-09-12T01:38:28.420757+0000","last_became_active":"2024-09-12T00:28:33.213187+0000","last_became_peered":"2024-09-12T00:28:33.213187+0000","last_unstale":"2024-09-12T01:38:28.420757+0000","last_undegraded":"2024-09-12T01:38:28.420757+0000","last_fullsized":"2024-09-12T01:38:28.420757+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'213","last_scrub_stamp":"2024-09-12T01:38:28.420553+0000","last_deep_scrub":"263'213","last_deep_scrub_stamp":"2024-09-12T01:38:28.420553+0000","last_clean_scrub_stamp":"2024-09-12T01:38:28.420553+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:01.923649+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":884,"num_read_kb":712,"num_write":323,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":685,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5759,"num_read_kb":4046,"num_write":1929,"num_write_kb":827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4980,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1001,"ondisk_log_size":1001,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15395,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":15045,"num_read_kb":14706,"num_write":16739,"num_write_kb":4892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2683,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1861,"ondisk_log_size":1861,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":525,"ondisk_log_size":525,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1497349,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":18870,"num_read_kb":39400,"num_write":15775,"num_write_kb":11890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":682702,"num_omap_keys":1560,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1965,"ondisk_log_size":1965,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2403,"num_read_kb":2865,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":103056,"num_read_kb":85959,"num_write":37323,"num_write_kb":18865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":44320,"num_omap_keys":179,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4316,"ondisk_log_size":4316,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":376,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":94285898,"num_objects":401,"num_object_clones":0,"num_object_copies":802,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":401,"num_whiteouts":0,"num_read":36137,"num_read_kb":1909956,"num_write":71332,"num_write_kb":2052201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":190078976,"data_stored":188571796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3522,"ondisk_log_size":3522,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":175308,"num_write":154,"num_write_kb":116383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":27197,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":178855,"num_write":154,"num_write_kb":116383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510292,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":253256,"kb_used_data":19384,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94118584,"statfs":{"total":96636764160,"available":96377430016,"internally_reserved":0,"allocated":19849216,"data_stored":18131665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":239466954},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510291,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":245476,"kb_used_data":15764,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94126364,"statfs":{"total":96636764160,"available":96385396736,"internally_reserved":0,"allocated":16142336,"data_stored":14537201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":235207110},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510294,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":143396,"kb_used_data":44244,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94228444,"statfs":{"total":96636764160,"available":96489926656,"internally_reserved":0,"allocated":45305856,"data_stored":43509539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510290,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":102520,"kb_used_data":31080,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94269320,"statfs":{"total":96636764160,"available":96531783680,"internally_reserved":0,"allocated":31825920,"data_stored":30189258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510293,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71272,"kb_used_data":17880,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94300568,"statfs":{"total":96636764160,"available":96563781632,"internally_reserved":0,"allocated":18309120,"data_stored":16732323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510296,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":134488,"kb_used_data":22856,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94237352,"statfs":{"total":96636764160,"available":96499048448,"internally_reserved":0,"allocated":23404544,"data_stored":21740424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510294,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":283028,"kb_used_data":35332,"kb_used_omap":1,"kb_used_meta":247678,"kb_avail":94088812,"statfs":{"total":96636764160,"available":96346943488,"internally_reserved":0,"allocated":36179968,"data_stored":34415974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":253622725},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575700,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":284764,"kb_used_data":28684,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":94087076,"statfs":{"total":96636764160,"available":96345165824,"internally_reserved":0,"allocated":29372416,"data_stored":27586086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":262207944},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":31928320,"data_stored":31687986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19750912,"data_stored":19603309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14700544,"data_stored":14596831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":25714688,"data_stored":25449825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28241920,"data_stored":28055424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":41611264,"data_stored":41372743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12529664,"data_stored":12400757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15601664,"data_stored":15404921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:38:50.653 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.654 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.654 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.654 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.654 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.654 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.654 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.655 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.655 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.655 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.655 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.655 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.655 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.655 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.655 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.655 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.656 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.656 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.656 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.656 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.656 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.656 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.656 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.656 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.657 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.657 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.657 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.657 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.657 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.657 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.657 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.657 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.658 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.658 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.658 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.658 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.658 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.658 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.658 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.658 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.658 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.659 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.659 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.659 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.659 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.659 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.659 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.659 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.659 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.659 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.660 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.660 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.660 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.660 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.660 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.660 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.660 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.660 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.660 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.661 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.661 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.661 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.661 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.661 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.661 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.661 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.662 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.662 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.662 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.662 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.662 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.662 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.662 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.662 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.663 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.663 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.663 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.663 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.663 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-12T00:42:35.789463+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.663 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.663 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.663 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T00:46:21.323186+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.663 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.664 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.664 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T00:46:25.348498+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.666 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T00:28:40.202127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:50.667 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T01:39:10.668 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:39:11.005 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:39:11.018 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T01:39:11.020 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":2386,"stamp":"2024-09-12T01:39:09.968246+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":96390822,"num_objects":752,"num_object_clones":0,"num_object_copies":1504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":752,"num_whiteouts":0,"num_read":181613,"num_read_kb":2411162,"num_write":143549,"num_write_kb":2323097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":27197,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":740268,"num_omap_keys":1787,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13489,"ondisk_log_size":13489,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1518200,"kb_used_data":215224,"kb_used_omap":12,"kb_used_meta":1302835,"kb_avail":753456520,"statfs":{"total":773094113280,"available":771539476480,"internally_reserved":0,"allocated":220389376,"data_stored":206842470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1334103601},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":752,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005749"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:58.472230+0000","last_change":"2024-09-12T01:38:58.472230+0000","last_active":"2024-09-12T01:38:58.472230+0000","last_peered":"2024-09-12T01:38:58.472230+0000","last_clean":"2024-09-12T01:38:58.472230+0000","last_became_active":"2024-09-12T01:04:15.392944+0000","last_became_peered":"2024-09-12T01:04:15.392944+0000","last_unstale":"2024-09-12T01:38:58.472230+0000","last_undegraded":"2024-09-12T01:38:58.472230+0000","last_fullsized":"2024-09-12T01:38:58.472230+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:58.472142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:58.472142+0000","last_clean_scrub_stamp":"2024-09-12T01:38:58.472142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:16.890910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"263'8","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:54.427308+0000","last_change":"2024-09-12T01:38:54.427243+0000","last_active":"2024-09-12T01:38:54.427308+0000","last_peered":"2024-09-12T01:38:54.427308+0000","last_clean":"2024-09-12T01:38:54.427308+0000","last_became_active":"2024-09-12T00:46:26.362231+0000","last_became_peered":"2024-09-12T00:46:26.362231+0000","last_unstale":"2024-09-12T01:38:54.427308+0000","last_undegraded":"2024-09-12T01:38:54.427308+0000","last_fullsized":"2024-09-12T01:38:54.427308+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-09-12T01:38:54.427162+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-09-12T01:38:54.427162+0000","last_clean_scrub_stamp":"2024-09-12T01:38:54.427162+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:53.026538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":19456,"num_write":13,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:57.146847+0000","last_change":"2024-09-12T01:38:57.146847+0000","last_active":"2024-09-12T01:38:57.146847+0000","last_peered":"2024-09-12T01:38:57.146847+0000","last_clean":"2024-09-12T01:38:57.146847+0000","last_became_active":"2024-09-12T00:46:22.353306+0000","last_became_peered":"2024-09-12T00:46:22.353306+0000","last_unstale":"2024-09-12T01:38:57.146847+0000","last_undegraded":"2024-09-12T01:38:57.146847+0000","last_fullsized":"2024-09-12T01:38:57.146847+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:57.146742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:57.146742+0000","last_clean_scrub_stamp":"2024-09-12T01:38:57.146742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:21.110450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"263'59","reported_seq":228,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:53.275988+0000","last_change":"2024-09-12T01:38:53.275988+0000","last_active":"2024-09-12T01:38:53.275988+0000","last_peered":"2024-09-12T01:38:53.275988+0000","last_clean":"2024-09-12T01:38:53.275988+0000","last_became_active":"2024-09-12T00:42:36.818329+0000","last_became_peered":"2024-09-12T00:42:36.818329+0000","last_unstale":"2024-09-12T01:38:53.275988+0000","last_undegraded":"2024-09-12T01:38:53.275988+0000","last_fullsized":"2024-09-12T01:38:53.275988+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'59","last_scrub_stamp":"2024-09-12T01:38:53.275902+0000","last_deep_scrub":"263'59","last_deep_scrub_stamp":"2024-09-12T01:38:53.275902+0000","last_clean_scrub_stamp":"2024-09-12T01:38:53.275902+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:59.884408+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":293,"num_read_kb":205,"num_write":105,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.801693+0000","last_change":"2024-09-12T01:38:37.801693+0000","last_active":"2024-09-12T01:38:37.801693+0000","last_peered":"2024-09-12T01:38:37.801693+0000","last_clean":"2024-09-12T01:38:37.801693+0000","last_became_active":"2024-09-12T01:04:15.392747+0000","last_became_peered":"2024-09-12T01:04:15.392747+0000","last_unstale":"2024-09-12T01:38:37.801693+0000","last_undegraded":"2024-09-12T01:38:37.801693+0000","last_fullsized":"2024-09-12T01:38:37.801693+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:37.801602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:37.801602+0000","last_clean_scrub_stamp":"2024-09-12T01:38:37.801602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:43.793136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"263'3","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:56.642317+0000","last_change":"2024-09-12T01:38:56.642317+0000","last_active":"2024-09-12T01:38:56.642317+0000","last_peered":"2024-09-12T01:38:56.642317+0000","last_clean":"2024-09-12T01:38:56.642317+0000","last_became_active":"2024-09-12T00:46:26.369944+0000","last_became_peered":"2024-09-12T00:46:26.369944+0000","last_unstale":"2024-09-12T01:38:56.642317+0000","last_undegraded":"2024-09-12T01:38:56.642317+0000","last_fullsized":"2024-09-12T01:38:56.642317+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-12T01:38:56.642201+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-12T01:38:56.642201+0000","last_clean_scrub_stamp":"2024-09-12T01:38:56.642201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:46.819288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"260'8","reported_seq":79,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:40.826822+0000","last_change":"2024-09-12T01:38:40.826701+0000","last_active":"2024-09-12T01:38:40.826822+0000","last_peered":"2024-09-12T01:38:40.826822+0000","last_clean":"2024-09-12T01:38:40.826822+0000","last_became_active":"2024-09-12T00:46:22.352009+0000","last_became_peered":"2024-09-12T00:46:22.352009+0000","last_unstale":"2024-09-12T01:38:40.826822+0000","last_undegraded":"2024-09-12T01:38:40.826822+0000","last_fullsized":"2024-09-12T01:38:40.826822+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'8","last_scrub_stamp":"2024-09-12T01:38:40.826573+0000","last_deep_scrub":"260'8","last_deep_scrub_stamp":"2024-09-12T01:38:40.826573+0000","last_clean_scrub_stamp":"2024-09-12T01:38:40.826573+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:57.124717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":26626,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"263'20","reported_seq":125,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:29.677728+0000","last_change":"2024-09-12T01:38:29.677626+0000","last_active":"2024-09-12T01:38:29.677728+0000","last_peered":"2024-09-12T01:38:29.677728+0000","last_clean":"2024-09-12T01:38:29.677728+0000","last_became_active":"2024-09-12T00:42:36.809431+0000","last_became_peered":"2024-09-12T00:42:36.809431+0000","last_unstale":"2024-09-12T01:38:29.677728+0000","last_undegraded":"2024-09-12T01:38:29.677728+0000","last_fullsized":"2024-09-12T01:38:29.677728+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'20","last_scrub_stamp":"2024-09-12T01:38:29.677499+0000","last_deep_scrub":"263'20","last_deep_scrub_stamp":"2024-09-12T01:38:29.677499+0000","last_clean_scrub_stamp":"2024-09-12T01:38:29.677499+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:02.453791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":73,"num_write":40,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:45.987726+0000","last_change":"2024-09-12T01:38:45.987726+0000","last_active":"2024-09-12T01:38:45.987726+0000","last_peered":"2024-09-12T01:38:45.987726+0000","last_clean":"2024-09-12T01:38:45.987726+0000","last_became_active":"2024-09-12T01:04:15.384312+0000","last_became_peered":"2024-09-12T01:04:15.384312+0000","last_unstale":"2024-09-12T01:38:45.987726+0000","last_undegraded":"2024-09-12T01:38:45.987726+0000","last_fullsized":"2024-09-12T01:38:45.987726+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:45.987643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:45.987643+0000","last_clean_scrub_stamp":"2024-09-12T01:38:45.987643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:34.846840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:39:02.259298+0000","last_change":"2024-09-12T01:39:02.259298+0000","last_active":"2024-09-12T01:39:02.259298+0000","last_peered":"2024-09-12T01:39:02.259298+0000","last_clean":"2024-09-12T01:39:02.259298+0000","last_became_active":"2024-09-12T00:46:26.563267+0000","last_became_peered":"2024-09-12T00:46:26.563267+0000","last_unstale":"2024-09-12T01:39:02.259298+0000","last_undegraded":"2024-09-12T01:39:02.259298+0000","last_fullsized":"2024-09-12T01:39:02.259298+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:02.259214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:02.259214+0000","last_clean_scrub_stamp":"2024-09-12T01:39:02.259214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:32.013621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"260'3","reported_seq":69,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:33.674271+0000","last_change":"2024-09-12T01:38:33.674201+0000","last_active":"2024-09-12T01:38:33.674271+0000","last_peered":"2024-09-12T01:38:33.674271+0000","last_clean":"2024-09-12T01:38:33.674271+0000","last_became_active":"2024-09-12T00:46:22.340655+0000","last_became_peered":"2024-09-12T00:46:22.340655+0000","last_unstale":"2024-09-12T01:38:33.674271+0000","last_undegraded":"2024-09-12T01:38:33.674271+0000","last_fullsized":"2024-09-12T01:38:33.674271+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-12T01:38:33.674114+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-12T01:38:33.674114+0000","last_clean_scrub_stamp":"2024-09-12T01:38:33.674114+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:11.561130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"263'63","reported_seq":234,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:52.251257+0000","last_change":"2024-09-12T01:38:52.251257+0000","last_active":"2024-09-12T01:38:52.251257+0000","last_peered":"2024-09-12T01:38:52.251257+0000","last_clean":"2024-09-12T01:38:52.251257+0000","last_became_active":"2024-09-12T00:42:36.814510+0000","last_became_peered":"2024-09-12T00:42:36.814510+0000","last_unstale":"2024-09-12T01:38:52.251257+0000","last_undegraded":"2024-09-12T01:38:52.251257+0000","last_fullsized":"2024-09-12T01:38:52.251257+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'63","last_scrub_stamp":"2024-09-12T01:38:52.251172+0000","last_deep_scrub":"263'63","last_deep_scrub_stamp":"2024-09-12T01:38:52.251172+0000","last_clean_scrub_stamp":"2024-09-12T01:38:52.251172+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:42.733500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":321,"num_read_kb":228,"num_write":110,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:44.650367+0000","last_change":"2024-09-12T01:04:15.402204+0000","last_active":"2024-09-12T01:35:44.650367+0000","last_peered":"2024-09-12T01:35:44.650367+0000","last_clean":"2024-09-12T01:35:44.650367+0000","last_became_active":"2024-09-12T01:04:15.401897+0000","last_became_peered":"2024-09-12T01:04:15.401897+0000","last_unstale":"2024-09-12T01:35:44.650367+0000","last_undegraded":"2024-09-12T01:35:44.650367+0000","last_fullsized":"2024-09-12T01:35:44.650367+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:39:06.146520+0000","last_change":"2024-09-12T01:39:06.146520+0000","last_active":"2024-09-12T01:39:06.146520+0000","last_peered":"2024-09-12T01:39:06.146520+0000","last_clean":"2024-09-12T01:39:06.146520+0000","last_became_active":"2024-09-12T00:46:26.561870+0000","last_became_peered":"2024-09-12T00:46:26.561870+0000","last_unstale":"2024-09-12T01:39:06.146520+0000","last_undegraded":"2024-09-12T01:39:06.146520+0000","last_fullsized":"2024-09-12T01:39:06.146520+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:06.146429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:06.146429+0000","last_clean_scrub_stamp":"2024-09-12T01:39:06.146429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:29.546409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"263'6","reported_seq":72,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:52.581293+0000","last_change":"2024-09-12T01:38:52.581293+0000","last_active":"2024-09-12T01:38:52.581293+0000","last_peered":"2024-09-12T01:38:52.581293+0000","last_clean":"2024-09-12T01:38:52.581293+0000","last_became_active":"2024-09-12T00:46:22.339141+0000","last_became_peered":"2024-09-12T00:46:22.339141+0000","last_unstale":"2024-09-12T01:38:52.581293+0000","last_undegraded":"2024-09-12T01:38:52.581293+0000","last_fullsized":"2024-09-12T01:38:52.581293+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-12T01:38:52.581160+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-12T01:38:52.581160+0000","last_clean_scrub_stamp":"2024-09-12T01:38:52.581160+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:24.423605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"263'62","reported_seq":233,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:55.216580+0000","last_change":"2024-09-12T01:38:55.216580+0000","last_active":"2024-09-12T01:38:55.216580+0000","last_peered":"2024-09-12T01:38:55.216580+0000","last_clean":"2024-09-12T01:38:55.216580+0000","last_became_active":"2024-09-12T00:42:36.816570+0000","last_became_peered":"2024-09-12T00:42:36.816570+0000","last_unstale":"2024-09-12T01:38:55.216580+0000","last_undegraded":"2024-09-12T01:38:55.216580+0000","last_fullsized":"2024-09-12T01:38:55.216580+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'62","last_scrub_stamp":"2024-09-12T01:38:55.216490+0000","last_deep_scrub":"263'62","last_deep_scrub_stamp":"2024-09-12T01:38:55.216490+0000","last_clean_scrub_stamp":"2024-09-12T01:38:55.216490+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:42.094085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":318,"num_read_kb":239,"num_write":100,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:36:19.654739+0000","last_change":"2024-09-12T01:04:15.400469+0000","last_active":"2024-09-12T01:36:19.654739+0000","last_peered":"2024-09-12T01:36:19.654739+0000","last_clean":"2024-09-12T01:36:19.654739+0000","last_became_active":"2024-09-12T01:04:15.400228+0000","last_became_peered":"2024-09-12T01:04:15.400228+0000","last_unstale":"2024-09-12T01:36:19.654739+0000","last_undegraded":"2024-09-12T01:36:19.654739+0000","last_fullsized":"2024-09-12T01:36:19.654739+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"263'9","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:55.398042+0000","last_change":"2024-09-12T01:38:55.398042+0000","last_active":"2024-09-12T01:38:55.398042+0000","last_peered":"2024-09-12T01:38:55.398042+0000","last_clean":"2024-09-12T01:38:55.398042+0000","last_became_active":"2024-09-12T00:46:26.367849+0000","last_became_peered":"2024-09-12T00:46:26.367849+0000","last_unstale":"2024-09-12T01:38:55.398042+0000","last_undegraded":"2024-09-12T01:38:55.398042+0000","last_fullsized":"2024-09-12T01:38:55.398042+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'9","last_scrub_stamp":"2024-09-12T01:38:55.397912+0000","last_deep_scrub":"263'9","last_deep_scrub_stamp":"2024-09-12T01:38:55.397912+0000","last_clean_scrub_stamp":"2024-09-12T01:38:55.397912+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:30.563425+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7168,"num_write":19,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"263'13","reported_seq":91,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:58.304721+0000","last_change":"2024-09-12T01:38:58.304721+0000","last_active":"2024-09-12T01:38:58.304721+0000","last_peered":"2024-09-12T01:38:58.304721+0000","last_clean":"2024-09-12T01:38:58.304721+0000","last_became_active":"2024-09-12T00:46:22.349597+0000","last_became_peered":"2024-09-12T00:46:22.349597+0000","last_unstale":"2024-09-12T01:38:58.304721+0000","last_undegraded":"2024-09-12T01:38:58.304721+0000","last_fullsized":"2024-09-12T01:38:58.304721+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'13","last_scrub_stamp":"2024-09-12T01:38:58.304629+0000","last_deep_scrub":"263'13","last_deep_scrub_stamp":"2024-09-12T01:38:58.304629+0000","last_clean_scrub_stamp":"2024-09-12T01:38:58.304629+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:14.827128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":44034,"num_write":28,"num_write_kb":19456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"263'28","reported_seq":137,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:54.242963+0000","last_change":"2024-09-12T01:38:54.242963+0000","last_active":"2024-09-12T01:38:54.242963+0000","last_peered":"2024-09-12T01:38:54.242963+0000","last_clean":"2024-09-12T01:38:54.242963+0000","last_became_active":"2024-09-12T00:42:36.814799+0000","last_became_peered":"2024-09-12T00:42:36.814799+0000","last_unstale":"2024-09-12T01:38:54.242963+0000","last_undegraded":"2024-09-12T01:38:54.242963+0000","last_fullsized":"2024-09-12T01:38:54.242963+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'28","last_scrub_stamp":"2024-09-12T01:38:54.242863+0000","last_deep_scrub":"263'28","last_deep_scrub_stamp":"2024-09-12T01:38:54.242863+0000","last_clean_scrub_stamp":"2024-09-12T01:38:54.242863+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:53.634201+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":94,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:48.762868+0000","last_change":"2024-09-12T01:38:48.762868+0000","last_active":"2024-09-12T01:38:48.762868+0000","last_peered":"2024-09-12T01:38:48.762868+0000","last_clean":"2024-09-12T01:38:48.762868+0000","last_became_active":"2024-09-12T01:04:15.388593+0000","last_became_peered":"2024-09-12T01:04:15.388593+0000","last_unstale":"2024-09-12T01:38:48.762868+0000","last_undegraded":"2024-09-12T01:38:48.762868+0000","last_fullsized":"2024-09-12T01:38:48.762868+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:48.762771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:48.762771+0000","last_clean_scrub_stamp":"2024-09-12T01:38:48.762771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:05:22.004111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"260'2","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:41.910495+0000","last_change":"2024-09-12T01:38:41.910495+0000","last_active":"2024-09-12T01:38:41.910495+0000","last_peered":"2024-09-12T01:38:41.910495+0000","last_clean":"2024-09-12T01:38:41.910495+0000","last_became_active":"2024-09-12T00:47:05.444004+0000","last_became_peered":"2024-09-12T00:47:05.444004+0000","last_unstale":"2024-09-12T01:38:41.910495+0000","last_undegraded":"2024-09-12T01:38:41.910495+0000","last_fullsized":"2024-09-12T01:38:41.910495+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-12T01:38:41.910399+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-12T01:38:41.910399+0000","last_clean_scrub_stamp":"2024-09-12T01:38:41.910399+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:13.148664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":27197,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"263'2","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:49.444538+0000","last_change":"2024-09-12T01:38:49.444538+0000","last_active":"2024-09-12T01:38:49.444538+0000","last_peered":"2024-09-12T01:38:49.444538+0000","last_clean":"2024-09-12T01:38:49.444538+0000","last_became_active":"2024-09-12T00:46:22.347338+0000","last_became_peered":"2024-09-12T00:46:22.347338+0000","last_unstale":"2024-09-12T01:38:49.444538+0000","last_undegraded":"2024-09-12T01:38:49.444538+0000","last_fullsized":"2024-09-12T01:38:49.444538+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:38:49.444450+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:38:49.444450+0000","last_clean_scrub_stamp":"2024-09-12T01:38:49.444450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:58.499728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"263'72","reported_seq":306,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.059290+0000","last_change":"2024-09-12T01:38:38.059290+0000","last_active":"2024-09-12T01:38:38.059290+0000","last_peered":"2024-09-12T01:38:38.059290+0000","last_clean":"2024-09-12T01:38:38.059290+0000","last_became_active":"2024-09-12T00:42:36.812454+0000","last_became_peered":"2024-09-12T00:42:36.812454+0000","last_unstale":"2024-09-12T01:38:38.059290+0000","last_undegraded":"2024-09-12T01:38:38.059290+0000","last_fullsized":"2024-09-12T01:38:38.059290+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'72","last_scrub_stamp":"2024-09-12T01:38:38.059208+0000","last_deep_scrub":"263'72","last_deep_scrub_stamp":"2024-09-12T01:38:38.059208+0000","last_clean_scrub_stamp":"2024-09-12T01:38:38.059208+0000","objects_scrubbed":1,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:13.691583+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":475,"num_read_kb":319,"num_write":83,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4980,"num_omap_keys":10,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"263'2","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:39:06.631073+0000","last_change":"2024-09-12T01:39:06.631073+0000","last_active":"2024-09-12T01:39:06.631073+0000","last_peered":"2024-09-12T01:39:06.631073+0000","last_clean":"2024-09-12T01:39:06.631073+0000","last_became_active":"2024-09-12T01:04:15.391532+0000","last_became_peered":"2024-09-12T01:04:15.391532+0000","last_unstale":"2024-09-12T01:39:06.631073+0000","last_undegraded":"2024-09-12T01:39:06.631073+0000","last_fullsized":"2024-09-12T01:39:06.631073+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:39:06.630965+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:39:06.630965+0000","last_clean_scrub_stamp":"2024-09-12T01:39:06.630965+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:45.944722+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"263'6","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:43.929279+0000","last_change":"2024-09-12T01:38:43.929220+0000","last_active":"2024-09-12T01:38:43.929279+0000","last_peered":"2024-09-12T01:38:43.929279+0000","last_clean":"2024-09-12T01:38:43.929279+0000","last_became_active":"2024-09-12T00:46:26.374660+0000","last_became_peered":"2024-09-12T00:46:26.374660+0000","last_unstale":"2024-09-12T01:38:43.929279+0000","last_undegraded":"2024-09-12T01:38:43.929279+0000","last_fullsized":"2024-09-12T01:38:43.929279+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-12T01:38:43.929107+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-12T01:38:43.929107+0000","last_clean_scrub_stamp":"2024-09-12T01:38:43.929107+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:45.373952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"263'7","reported_seq":71,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:48.488892+0000","last_change":"2024-09-12T01:38:48.488793+0000","last_active":"2024-09-12T01:38:48.488892+0000","last_peered":"2024-09-12T01:38:48.488892+0000","last_clean":"2024-09-12T01:38:48.488892+0000","last_became_active":"2024-09-12T00:46:22.340228+0000","last_became_peered":"2024-09-12T00:46:22.340228+0000","last_unstale":"2024-09-12T01:38:48.488892+0000","last_undegraded":"2024-09-12T01:38:48.488892+0000","last_fullsized":"2024-09-12T01:38:48.488892+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'7","last_scrub_stamp":"2024-09-12T01:38:48.488701+0000","last_deep_scrub":"263'7","last_deep_scrub_stamp":"2024-09-12T01:38:48.488701+0000","last_clean_scrub_stamp":"2024-09-12T01:38:48.488701+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:56.357132+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6219,"num_write":7,"num_write_kb":6219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"263'130","reported_seq":441,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:50.241136+0000","last_change":"2024-09-12T01:38:50.241136+0000","last_active":"2024-09-12T01:38:50.241136+0000","last_peered":"2024-09-12T01:38:50.241136+0000","last_clean":"2024-09-12T01:38:50.241136+0000","last_became_active":"2024-09-12T00:42:36.812882+0000","last_became_peered":"2024-09-12T00:42:36.812882+0000","last_unstale":"2024-09-12T01:38:50.241136+0000","last_undegraded":"2024-09-12T01:38:50.241136+0000","last_fullsized":"2024-09-12T01:38:50.241136+0000","mapping_epoch":250,"log_start":"260'100","ondisk_log_start":"260'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'130","last_scrub_stamp":"2024-09-12T01:38:50.241023+0000","last_deep_scrub":"263'130","last_deep_scrub_stamp":"2024-09-12T01:38:50.241023+0000","last_clean_scrub_stamp":"2024-09-12T01:38:50.241023+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:41.436315+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":723,"num_read_kb":503,"num_write":193,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4455,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:39:05.610406+0000","last_change":"2024-09-12T01:39:05.610406+0000","last_active":"2024-09-12T01:39:05.610406+0000","last_peered":"2024-09-12T01:39:05.610406+0000","last_clean":"2024-09-12T01:39:05.610406+0000","last_became_active":"2024-09-12T01:04:15.398533+0000","last_became_peered":"2024-09-12T01:04:15.398533+0000","last_unstale":"2024-09-12T01:39:05.610406+0000","last_undegraded":"2024-09-12T01:39:05.610406+0000","last_fullsized":"2024-09-12T01:39:05.610406+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:05.610298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:05.610298+0000","last_clean_scrub_stamp":"2024-09-12T01:39:05.610298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:14.152758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"263'5","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:39:05.117390+0000","last_change":"2024-09-12T01:39:05.117390+0000","last_active":"2024-09-12T01:39:05.117390+0000","last_peered":"2024-09-12T01:39:05.117390+0000","last_clean":"2024-09-12T01:39:05.117390+0000","last_became_active":"2024-09-12T00:46:26.367766+0000","last_became_peered":"2024-09-12T00:46:26.367766+0000","last_unstale":"2024-09-12T01:39:05.117390+0000","last_undegraded":"2024-09-12T01:39:05.117390+0000","last_fullsized":"2024-09-12T01:39:05.117390+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-12T01:39:05.117301+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-12T01:39:05.117301+0000","last_clean_scrub_stamp":"2024-09-12T01:39:05.117301+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:54.959377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4,"num_write":10,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:57.348304+0000","last_change":"2024-09-12T01:38:57.348304+0000","last_active":"2024-09-12T01:38:57.348304+0000","last_peered":"2024-09-12T01:38:57.348304+0000","last_clean":"2024-09-12T01:38:57.348304+0000","last_became_active":"2024-09-12T00:46:22.353833+0000","last_became_peered":"2024-09-12T00:46:22.353833+0000","last_unstale":"2024-09-12T01:38:57.348304+0000","last_undegraded":"2024-09-12T01:38:57.348304+0000","last_fullsized":"2024-09-12T01:38:57.348304+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:57.348210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:57.348210+0000","last_clean_scrub_stamp":"2024-09-12T01:38:57.348210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:53.744706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'39","reported_seq":175,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:36.883196+0000","last_change":"2024-09-12T01:38:36.883196+0000","last_active":"2024-09-12T01:38:36.883196+0000","last_peered":"2024-09-12T01:38:36.883196+0000","last_clean":"2024-09-12T01:38:36.883196+0000","last_became_active":"2024-09-12T00:42:36.803692+0000","last_became_peered":"2024-09-12T00:42:36.803692+0000","last_unstale":"2024-09-12T01:38:36.883196+0000","last_undegraded":"2024-09-12T01:38:36.883196+0000","last_fullsized":"2024-09-12T01:38:36.883196+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'39","last_scrub_stamp":"2024-09-12T01:38:36.883106+0000","last_deep_scrub":"263'39","last_deep_scrub_stamp":"2024-09-12T01:38:36.883106+0000","last_clean_scrub_stamp":"2024-09-12T01:38:36.883106+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:35.390177+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":209,"num_read_kb":149,"num_write":77,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:47.755240+0000","last_change":"2024-09-12T01:38:47.755240+0000","last_active":"2024-09-12T01:38:47.755240+0000","last_peered":"2024-09-12T01:38:47.755240+0000","last_clean":"2024-09-12T01:38:47.755240+0000","last_became_active":"2024-09-12T01:04:15.385172+0000","last_became_peered":"2024-09-12T01:04:15.385172+0000","last_unstale":"2024-09-12T01:38:47.755240+0000","last_undegraded":"2024-09-12T01:38:47.755240+0000","last_fullsized":"2024-09-12T01:38:47.755240+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:47.755140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:47.755140+0000","last_clean_scrub_stamp":"2024-09-12T01:38:47.755140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:11.662497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"263'5","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:39:04.101841+0000","last_change":"2024-09-12T01:39:04.101841+0000","last_active":"2024-09-12T01:39:04.101841+0000","last_peered":"2024-09-12T01:39:04.101841+0000","last_clean":"2024-09-12T01:39:04.101841+0000","last_became_active":"2024-09-12T00:46:26.561643+0000","last_became_peered":"2024-09-12T00:46:26.561643+0000","last_unstale":"2024-09-12T01:39:04.101841+0000","last_undegraded":"2024-09-12T01:39:04.101841+0000","last_fullsized":"2024-09-12T01:39:04.101841+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-12T01:39:04.101729+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-12T01:39:04.101729+0000","last_clean_scrub_stamp":"2024-09-12T01:39:04.101729+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:57.273516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10250,"num_write":10,"num_write_kb":5125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:53.445407+0000","last_change":"2024-09-12T01:38:53.445407+0000","last_active":"2024-09-12T01:38:53.445407+0000","last_peered":"2024-09-12T01:38:53.445407+0000","last_clean":"2024-09-12T01:38:53.445407+0000","last_became_active":"2024-09-12T00:46:22.349007+0000","last_became_peered":"2024-09-12T00:46:22.349007+0000","last_unstale":"2024-09-12T01:38:53.445407+0000","last_undegraded":"2024-09-12T01:38:53.445407+0000","last_fullsized":"2024-09-12T01:38:53.445407+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:53.445320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:53.445320+0000","last_clean_scrub_stamp":"2024-09-12T01:38:53.445320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:49.616148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"263'19","reported_seq":121,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:51.284362+0000","last_change":"2024-09-12T01:38:51.284362+0000","last_active":"2024-09-12T01:38:51.284362+0000","last_peered":"2024-09-12T01:38:51.284362+0000","last_clean":"2024-09-12T01:38:51.284362+0000","last_became_active":"2024-09-12T00:42:36.814846+0000","last_became_peered":"2024-09-12T00:42:36.814846+0000","last_unstale":"2024-09-12T01:38:51.284362+0000","last_undegraded":"2024-09-12T01:38:51.284362+0000","last_fullsized":"2024-09-12T01:38:51.284362+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'19","last_scrub_stamp":"2024-09-12T01:38:51.284257+0000","last_deep_scrub":"263'19","last_deep_scrub_stamp":"2024-09-12T01:38:51.284257+0000","last_clean_scrub_stamp":"2024-09-12T01:38:51.284257+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:35.319535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":75,"num_write":34,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"263'2","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:36.758725+0000","last_change":"2024-09-12T01:38:36.758725+0000","last_active":"2024-09-12T01:38:36.758725+0000","last_peered":"2024-09-12T01:38:36.758725+0000","last_clean":"2024-09-12T01:38:36.758725+0000","last_became_active":"2024-09-12T01:04:15.395540+0000","last_became_peered":"2024-09-12T01:04:15.395540+0000","last_unstale":"2024-09-12T01:38:36.758725+0000","last_undegraded":"2024-09-12T01:38:36.758725+0000","last_fullsized":"2024-09-12T01:38:36.758725+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:38:36.758622+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:38:36.758622+0000","last_clean_scrub_stamp":"2024-09-12T01:38:36.758622+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:30.668812+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:39:02.157421+0000","last_change":"2024-09-12T01:39:02.157421+0000","last_active":"2024-09-12T01:39:02.157421+0000","last_peered":"2024-09-12T01:39:02.157421+0000","last_clean":"2024-09-12T01:39:02.157421+0000","last_became_active":"2024-09-12T00:46:26.561961+0000","last_became_peered":"2024-09-12T00:46:26.561961+0000","last_unstale":"2024-09-12T01:39:02.157421+0000","last_undegraded":"2024-09-12T01:39:02.157421+0000","last_fullsized":"2024-09-12T01:39:02.157421+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:02.157327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:02.157327+0000","last_clean_scrub_stamp":"2024-09-12T01:39:02.157327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:27.665045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"260'5","reported_seq":69,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:54.645827+0000","last_change":"2024-09-12T01:38:54.645827+0000","last_active":"2024-09-12T01:38:54.645827+0000","last_peered":"2024-09-12T01:38:54.645827+0000","last_clean":"2024-09-12T01:38:54.645827+0000","last_became_active":"2024-09-12T00:46:22.350947+0000","last_became_peered":"2024-09-12T00:46:22.350947+0000","last_unstale":"2024-09-12T01:38:54.645827+0000","last_undegraded":"2024-09-12T01:38:54.645827+0000","last_fullsized":"2024-09-12T01:38:54.645827+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-12T01:38:54.645735+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-12T01:38:54.645735+0000","last_clean_scrub_stamp":"2024-09-12T01:38:54.645735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:24.485009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"263'28","reported_seq":144,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:53.271179+0000","last_change":"2024-09-12T01:38:53.271179+0000","last_active":"2024-09-12T01:38:53.271179+0000","last_peered":"2024-09-12T01:38:53.271179+0000","last_clean":"2024-09-12T01:38:53.271179+0000","last_became_active":"2024-09-12T00:42:36.815638+0000","last_became_peered":"2024-09-12T00:42:36.815638+0000","last_unstale":"2024-09-12T01:38:53.271179+0000","last_undegraded":"2024-09-12T01:38:53.271179+0000","last_fullsized":"2024-09-12T01:38:53.271179+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'28","last_scrub_stamp":"2024-09-12T01:38:53.271074+0000","last_deep_scrub":"263'28","last_deep_scrub_stamp":"2024-09-12T01:38:53.271074+0000","last_clean_scrub_stamp":"2024-09-12T01:38:53.271074+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:40.481867+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":103,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:39:03.672960+0000","last_change":"2024-09-12T01:39:03.672960+0000","last_active":"2024-09-12T01:39:03.672960+0000","last_peered":"2024-09-12T01:39:03.672960+0000","last_clean":"2024-09-12T01:39:03.672960+0000","last_became_active":"2024-09-12T01:04:15.391501+0000","last_became_peered":"2024-09-12T01:04:15.391501+0000","last_unstale":"2024-09-12T01:39:03.672960+0000","last_undegraded":"2024-09-12T01:39:03.672960+0000","last_fullsized":"2024-09-12T01:39:03.672960+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:03.672858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:03.672858+0000","last_clean_scrub_stamp":"2024-09-12T01:39:03.672858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:13.446258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:39:03.142854+0000","last_change":"2024-09-12T01:39:03.142854+0000","last_active":"2024-09-12T01:39:03.142854+0000","last_peered":"2024-09-12T01:39:03.142854+0000","last_clean":"2024-09-12T01:39:03.142854+0000","last_became_active":"2024-09-12T00:46:26.563091+0000","last_became_peered":"2024-09-12T00:46:26.563091+0000","last_unstale":"2024-09-12T01:39:03.142854+0000","last_undegraded":"2024-09-12T01:39:03.142854+0000","last_fullsized":"2024-09-12T01:39:03.142854+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:03.142769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:03.142769+0000","last_clean_scrub_stamp":"2024-09-12T01:39:03.142769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:57.676749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:31.658500+0000","last_change":"2024-09-12T01:38:31.658500+0000","last_active":"2024-09-12T01:38:31.658500+0000","last_peered":"2024-09-12T01:38:31.658500+0000","last_clean":"2024-09-12T01:38:31.658500+0000","last_became_active":"2024-09-12T00:46:22.354167+0000","last_became_peered":"2024-09-12T00:46:22.354167+0000","last_unstale":"2024-09-12T01:38:31.658500+0000","last_undegraded":"2024-09-12T01:38:31.658500+0000","last_fullsized":"2024-09-12T01:38:31.658500+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:31.658403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:31.658403+0000","last_clean_scrub_stamp":"2024-09-12T01:38:31.658403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:26.400177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"260'8","reported_seq":90,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:28.717227+0000","last_change":"2024-09-12T01:38:28.717227+0000","last_active":"2024-09-12T01:38:28.717227+0000","last_peered":"2024-09-12T01:38:28.717227+0000","last_clean":"2024-09-12T01:38:28.717227+0000","last_became_active":"2024-09-12T00:42:36.802737+0000","last_became_peered":"2024-09-12T00:42:36.802737+0000","last_unstale":"2024-09-12T01:38:28.717227+0000","last_undegraded":"2024-09-12T01:38:28.717227+0000","last_fullsized":"2024-09-12T01:38:28.717227+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'8","last_scrub_stamp":"2024-09-12T01:38:28.717114+0000","last_deep_scrub":"260'8","last_deep_scrub_stamp":"2024-09-12T01:38:28.717114+0000","last_clean_scrub_stamp":"2024-09-12T01:38:28.717114+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:10.385026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:57.422149+0000","last_change":"2024-09-12T01:38:57.422149+0000","last_active":"2024-09-12T01:38:57.422149+0000","last_peered":"2024-09-12T01:38:57.422149+0000","last_clean":"2024-09-12T01:38:57.422149+0000","last_became_active":"2024-09-12T01:04:15.393292+0000","last_became_peered":"2024-09-12T01:04:15.393292+0000","last_unstale":"2024-09-12T01:38:57.422149+0000","last_undegraded":"2024-09-12T01:38:57.422149+0000","last_fullsized":"2024-09-12T01:38:57.422149+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:57.422061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:57.422061+0000","last_clean_scrub_stamp":"2024-09-12T01:38:57.422061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:14.401871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"263'3","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:54.628745+0000","last_change":"2024-09-12T01:38:54.628745+0000","last_active":"2024-09-12T01:38:54.628745+0000","last_peered":"2024-09-12T01:38:54.628745+0000","last_clean":"2024-09-12T01:38:54.628745+0000","last_became_active":"2024-09-12T00:46:26.370845+0000","last_became_peered":"2024-09-12T00:46:26.370845+0000","last_unstale":"2024-09-12T01:38:54.628745+0000","last_undegraded":"2024-09-12T01:38:54.628745+0000","last_fullsized":"2024-09-12T01:38:54.628745+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-12T01:38:54.628624+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-12T01:38:54.628624+0000","last_clean_scrub_stamp":"2024-09-12T01:38:54.628624+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:45.319268+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:39:01.286712+0000","last_change":"2024-09-12T01:39:01.286712+0000","last_active":"2024-09-12T01:39:01.286712+0000","last_peered":"2024-09-12T01:39:01.286712+0000","last_clean":"2024-09-12T01:39:01.286712+0000","last_became_active":"2024-09-12T00:46:22.348534+0000","last_became_peered":"2024-09-12T00:46:22.348534+0000","last_unstale":"2024-09-12T01:39:01.286712+0000","last_undegraded":"2024-09-12T01:39:01.286712+0000","last_fullsized":"2024-09-12T01:39:01.286712+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:01.286622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:01.286622+0000","last_clean_scrub_stamp":"2024-09-12T01:39:01.286622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:03.223998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"263'16","reported_seq":107,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:48.649268+0000","last_change":"2024-09-12T01:38:48.649212+0000","last_active":"2024-09-12T01:38:48.649268+0000","last_peered":"2024-09-12T01:38:48.649268+0000","last_clean":"2024-09-12T01:38:48.649268+0000","last_became_active":"2024-09-12T00:42:36.812629+0000","last_became_peered":"2024-09-12T00:42:36.812629+0000","last_unstale":"2024-09-12T01:38:48.649268+0000","last_undegraded":"2024-09-12T01:38:48.649268+0000","last_fullsized":"2024-09-12T01:38:48.649268+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'16","last_scrub_stamp":"2024-09-12T01:38:48.649125+0000","last_deep_scrub":"263'16","last_deep_scrub_stamp":"2024-09-12T01:38:48.649125+0000","last_clean_scrub_stamp":"2024-09-12T01:38:48.649125+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:46.974866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":48,"num_write":38,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:39:09.026929+0000","last_change":"2024-09-12T01:39:09.026929+0000","last_active":"2024-09-12T01:39:09.026929+0000","last_peered":"2024-09-12T01:39:09.026929+0000","last_clean":"2024-09-12T01:39:09.026929+0000","last_became_active":"2024-09-12T01:04:15.398407+0000","last_became_peered":"2024-09-12T01:04:15.398407+0000","last_unstale":"2024-09-12T01:39:09.026929+0000","last_undegraded":"2024-09-12T01:39:09.026929+0000","last_fullsized":"2024-09-12T01:39:09.026929+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:09.026844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:09.026844+0000","last_clean_scrub_stamp":"2024-09-12T01:39:09.026844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:45.095349+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"263'3","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:45.781269+0000","last_change":"2024-09-12T01:38:45.781269+0000","last_active":"2024-09-12T01:38:45.781269+0000","last_peered":"2024-09-12T01:38:45.781269+0000","last_clean":"2024-09-12T01:38:45.781269+0000","last_became_active":"2024-09-12T00:46:26.366602+0000","last_became_peered":"2024-09-12T00:46:26.366602+0000","last_unstale":"2024-09-12T01:38:45.781269+0000","last_undegraded":"2024-09-12T01:38:45.781269+0000","last_fullsized":"2024-09-12T01:38:45.781269+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-12T01:38:45.781144+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-12T01:38:45.781144+0000","last_clean_scrub_stamp":"2024-09-12T01:38:45.781144+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:44.387003+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"263'9","reported_seq":70,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:47.504069+0000","last_change":"2024-09-12T01:38:47.504069+0000","last_active":"2024-09-12T01:38:47.504069+0000","last_peered":"2024-09-12T01:38:47.504069+0000","last_clean":"2024-09-12T01:38:47.504069+0000","last_became_active":"2024-09-12T00:46:22.351432+0000","last_became_peered":"2024-09-12T00:46:22.351432+0000","last_unstale":"2024-09-12T01:38:47.504069+0000","last_undegraded":"2024-09-12T01:38:47.504069+0000","last_fullsized":"2024-09-12T01:38:47.504069+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'9","last_scrub_stamp":"2024-09-12T01:38:47.503964+0000","last_deep_scrub":"263'9","last_deep_scrub_stamp":"2024-09-12T01:38:47.503964+0000","last_clean_scrub_stamp":"2024-09-12T01:38:47.503964+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:50.062333+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":19,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"252'16","reported_seq":112,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:47.604258+0000","last_change":"2024-09-12T01:38:47.604258+0000","last_active":"2024-09-12T01:38:47.604258+0000","last_peered":"2024-09-12T01:38:47.604258+0000","last_clean":"2024-09-12T01:38:47.604258+0000","last_became_active":"2024-09-12T00:42:36.813324+0000","last_became_peered":"2024-09-12T00:42:36.813324+0000","last_unstale":"2024-09-12T01:38:47.604258+0000","last_undegraded":"2024-09-12T01:38:47.604258+0000","last_fullsized":"2024-09-12T01:38:47.604258+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"252'16","last_scrub_stamp":"2024-09-12T01:38:47.604175+0000","last_deep_scrub":"252'16","last_deep_scrub_stamp":"2024-09-12T01:38:47.604175+0000","last_clean_scrub_stamp":"2024-09-12T01:38:47.604175+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:51.309268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":59,"num_write":21,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:35:41.796461+0000","last_change":"2024-09-12T01:04:15.394539+0000","last_active":"2024-09-12T01:35:41.796461+0000","last_peered":"2024-09-12T01:35:41.796461+0000","last_clean":"2024-09-12T01:35:41.796461+0000","last_became_active":"2024-09-12T01:04:15.393021+0000","last_became_peered":"2024-09-12T01:04:15.393021+0000","last_unstale":"2024-09-12T01:35:41.796461+0000","last_undegraded":"2024-09-12T01:35:41.796461+0000","last_fullsized":"2024-09-12T01:35:41.796461+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:14.372126+0000","last_clean_scrub_stamp":"2024-09-12T01:04:14.372126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"260'8","reported_seq":74,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:44.771845+0000","last_change":"2024-09-12T01:38:44.771845+0000","last_active":"2024-09-12T01:38:44.771845+0000","last_peered":"2024-09-12T01:38:44.771845+0000","last_clean":"2024-09-12T01:38:44.771845+0000","last_became_active":"2024-09-12T00:46:26.371443+0000","last_became_peered":"2024-09-12T00:46:26.371443+0000","last_unstale":"2024-09-12T01:38:44.771845+0000","last_undegraded":"2024-09-12T01:38:44.771845+0000","last_fullsized":"2024-09-12T01:38:44.771845+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'8","last_scrub_stamp":"2024-09-12T01:38:44.771738+0000","last_deep_scrub":"260'8","last_deep_scrub_stamp":"2024-09-12T01:38:44.771738+0000","last_clean_scrub_stamp":"2024-09-12T01:38:44.771738+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:57.305608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":26626,"num_write":8,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:56.173818+0000","last_change":"2024-09-12T01:38:56.173818+0000","last_active":"2024-09-12T01:38:56.173818+0000","last_peered":"2024-09-12T01:38:56.173818+0000","last_clean":"2024-09-12T01:38:56.173818+0000","last_became_active":"2024-09-12T00:46:22.350714+0000","last_became_peered":"2024-09-12T00:46:22.350714+0000","last_unstale":"2024-09-12T01:38:56.173818+0000","last_undegraded":"2024-09-12T01:38:56.173818+0000","last_fullsized":"2024-09-12T01:38:56.173818+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:56.173705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:56.173705+0000","last_clean_scrub_stamp":"2024-09-12T01:38:56.173705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:45.514660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"263'52","reported_seq":210,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:47.224982+0000","last_change":"2024-09-12T01:38:47.224982+0000","last_active":"2024-09-12T01:38:47.224982+0000","last_peered":"2024-09-12T01:38:47.224982+0000","last_clean":"2024-09-12T01:38:47.224982+0000","last_became_active":"2024-09-12T00:42:36.817763+0000","last_became_peered":"2024-09-12T00:42:36.817763+0000","last_unstale":"2024-09-12T01:38:47.224982+0000","last_undegraded":"2024-09-12T01:38:47.224982+0000","last_fullsized":"2024-09-12T01:38:47.224982+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'52","last_scrub_stamp":"2024-09-12T01:38:47.224857+0000","last_deep_scrub":"263'52","last_deep_scrub_stamp":"2024-09-12T01:38:47.224857+0000","last_clean_scrub_stamp":"2024-09-12T01:38:47.224857+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:47.769940+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":268,"num_read_kb":195,"num_write":87,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"263'2","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:39:06.221703+0000","last_change":"2024-09-12T01:39:06.221703+0000","last_active":"2024-09-12T01:39:06.221703+0000","last_peered":"2024-09-12T01:39:06.221703+0000","last_clean":"2024-09-12T01:39:06.221703+0000","last_became_active":"2024-09-12T01:04:15.396832+0000","last_became_peered":"2024-09-12T01:04:15.396832+0000","last_unstale":"2024-09-12T01:39:06.221703+0000","last_undegraded":"2024-09-12T01:39:06.221703+0000","last_fullsized":"2024-09-12T01:39:06.221703+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:39:06.221620+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:39:06.221620+0000","last_clean_scrub_stamp":"2024-09-12T01:39:06.221620+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:28.889915+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:39:01.117705+0000","last_change":"2024-09-12T01:39:01.117705+0000","last_active":"2024-09-12T01:39:01.117705+0000","last_peered":"2024-09-12T01:39:01.117705+0000","last_clean":"2024-09-12T01:39:01.117705+0000","last_became_active":"2024-09-12T00:46:26.373401+0000","last_became_peered":"2024-09-12T00:46:26.373401+0000","last_unstale":"2024-09-12T01:39:01.117705+0000","last_undegraded":"2024-09-12T01:39:01.117705+0000","last_fullsized":"2024-09-12T01:39:01.117705+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:01.117609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:01.117609+0000","last_clean_scrub_stamp":"2024-09-12T01:39:01.117609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:36.433330+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:39.020820+0000","last_change":"2024-09-12T01:38:39.020820+0000","last_active":"2024-09-12T01:38:39.020820+0000","last_peered":"2024-09-12T01:38:39.020820+0000","last_clean":"2024-09-12T01:38:39.020820+0000","last_became_active":"2024-09-12T00:46:22.347794+0000","last_became_peered":"2024-09-12T00:46:22.347794+0000","last_unstale":"2024-09-12T01:38:39.020820+0000","last_undegraded":"2024-09-12T01:38:39.020820+0000","last_fullsized":"2024-09-12T01:38:39.020820+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:39.020729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:39.020729+0000","last_clean_scrub_stamp":"2024-09-12T01:38:39.020729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:19.893388+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'10","reported_seq":92,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:44.476405+0000","last_change":"2024-09-12T01:38:44.476405+0000","last_active":"2024-09-12T01:38:44.476405+0000","last_peered":"2024-09-12T01:38:44.476405+0000","last_clean":"2024-09-12T01:38:44.476405+0000","last_became_active":"2024-09-12T00:42:36.802647+0000","last_became_peered":"2024-09-12T00:42:36.802647+0000","last_unstale":"2024-09-12T01:38:44.476405+0000","last_undegraded":"2024-09-12T01:38:44.476405+0000","last_fullsized":"2024-09-12T01:38:44.476405+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'10","last_scrub_stamp":"2024-09-12T01:38:44.476313+0000","last_deep_scrub":"263'10","last_deep_scrub_stamp":"2024-09-12T01:38:44.476313+0000","last_clean_scrub_stamp":"2024-09-12T01:38:44.476313+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:58.387217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":30,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"263'2","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:39:08.066516+0000","last_change":"2024-09-12T01:39:08.066516+0000","last_active":"2024-09-12T01:39:08.066516+0000","last_peered":"2024-09-12T01:39:08.066516+0000","last_clean":"2024-09-12T01:39:08.066516+0000","last_became_active":"2024-09-12T01:04:15.397646+0000","last_became_peered":"2024-09-12T01:04:15.397646+0000","last_unstale":"2024-09-12T01:39:08.066516+0000","last_undegraded":"2024-09-12T01:39:08.066516+0000","last_fullsized":"2024-09-12T01:39:08.066516+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:39:08.066427+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:39:08.066427+0000","last_clean_scrub_stamp":"2024-09-12T01:39:08.066427+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:21.422423+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"263'3","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:40.946648+0000","last_change":"2024-09-12T01:38:40.946648+0000","last_active":"2024-09-12T01:38:40.946648+0000","last_peered":"2024-09-12T01:38:40.946648+0000","last_clean":"2024-09-12T01:38:40.946648+0000","last_became_active":"2024-09-12T00:46:26.373354+0000","last_became_peered":"2024-09-12T00:46:26.373354+0000","last_unstale":"2024-09-12T01:38:40.946648+0000","last_undegraded":"2024-09-12T01:38:40.946648+0000","last_fullsized":"2024-09-12T01:38:40.946648+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-12T01:38:40.946561+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-12T01:38:40.946561+0000","last_clean_scrub_stamp":"2024-09-12T01:38:40.946561+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:54.214293+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:51.435171+0000","last_change":"2024-09-12T01:38:51.435171+0000","last_active":"2024-09-12T01:38:51.435171+0000","last_peered":"2024-09-12T01:38:51.435171+0000","last_clean":"2024-09-12T01:38:51.435171+0000","last_became_active":"2024-09-12T00:46:22.348875+0000","last_became_peered":"2024-09-12T00:46:22.348875+0000","last_unstale":"2024-09-12T01:38:51.435171+0000","last_undegraded":"2024-09-12T01:38:51.435171+0000","last_fullsized":"2024-09-12T01:38:51.435171+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:51.435075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:51.435075+0000","last_clean_scrub_stamp":"2024-09-12T01:38:51.435075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:05.426083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"263'37","reported_seq":173,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:52.303375+0000","last_change":"2024-09-12T01:38:52.303375+0000","last_active":"2024-09-12T01:38:52.303375+0000","last_peered":"2024-09-12T01:38:52.303375+0000","last_clean":"2024-09-12T01:38:52.303375+0000","last_became_active":"2024-09-12T00:42:36.814235+0000","last_became_peered":"2024-09-12T00:42:36.814235+0000","last_unstale":"2024-09-12T01:38:52.303375+0000","last_undegraded":"2024-09-12T01:38:52.303375+0000","last_fullsized":"2024-09-12T01:38:52.303375+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'37","last_scrub_stamp":"2024-09-12T01:38:52.303290+0000","last_deep_scrub":"263'37","last_deep_scrub_stamp":"2024-09-12T01:38:52.303290+0000","last_clean_scrub_stamp":"2024-09-12T01:38:52.303290+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:43.226310+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":201,"num_read_kb":139,"num_write":71,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.746892+0000","last_change":"2024-09-12T01:38:35.746892+0000","last_active":"2024-09-12T01:38:35.746892+0000","last_peered":"2024-09-12T01:38:35.746892+0000","last_clean":"2024-09-12T01:38:35.746892+0000","last_became_active":"2024-09-12T01:04:15.395860+0000","last_became_peered":"2024-09-12T01:04:15.395860+0000","last_unstale":"2024-09-12T01:38:35.746892+0000","last_undegraded":"2024-09-12T01:38:35.746892+0000","last_fullsized":"2024-09-12T01:38:35.746892+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.746784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.746784+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.746784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:51.193748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:59.157638+0000","last_change":"2024-09-12T01:38:59.157638+0000","last_active":"2024-09-12T01:38:59.157638+0000","last_peered":"2024-09-12T01:38:59.157638+0000","last_clean":"2024-09-12T01:38:59.157638+0000","last_became_active":"2024-09-12T00:46:26.372803+0000","last_became_peered":"2024-09-12T00:46:26.372803+0000","last_unstale":"2024-09-12T01:38:59.157638+0000","last_undegraded":"2024-09-12T01:38:59.157638+0000","last_fullsized":"2024-09-12T01:38:59.157638+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:59.157507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:59.157507+0000","last_clean_scrub_stamp":"2024-09-12T01:38:59.157507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:06.197400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"263'9","reported_seq":75,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:52.694014+0000","last_change":"2024-09-12T01:38:52.694014+0000","last_active":"2024-09-12T01:38:52.694014+0000","last_peered":"2024-09-12T01:38:52.694014+0000","last_clean":"2024-09-12T01:38:52.694014+0000","last_became_active":"2024-09-12T00:46:22.355962+0000","last_became_peered":"2024-09-12T00:46:22.355962+0000","last_unstale":"2024-09-12T01:38:52.694014+0000","last_undegraded":"2024-09-12T01:38:52.694014+0000","last_fullsized":"2024-09-12T01:38:52.694014+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'9","last_scrub_stamp":"2024-09-12T01:38:52.693933+0000","last_deep_scrub":"263'9","last_deep_scrub_stamp":"2024-09-12T01:38:52.693933+0000","last_clean_scrub_stamp":"2024-09-12T01:38:52.693933+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:37.339302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5707,"num_write":14,"num_write_kb":4683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"263'12","reported_seq":99,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:51.306105+0000","last_change":"2024-09-12T01:38:51.306058+0000","last_active":"2024-09-12T01:38:51.306105+0000","last_peered":"2024-09-12T01:38:51.306105+0000","last_clean":"2024-09-12T01:38:51.306105+0000","last_became_active":"2024-09-12T00:42:36.816673+0000","last_became_peered":"2024-09-12T00:42:36.816673+0000","last_unstale":"2024-09-12T01:38:51.306105+0000","last_undegraded":"2024-09-12T01:38:51.306105+0000","last_fullsized":"2024-09-12T01:38:51.306105+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'12","last_scrub_stamp":"2024-09-12T01:38:51.305983+0000","last_deep_scrub":"263'12","last_deep_scrub_stamp":"2024-09-12T01:38:51.305983+0000","last_clean_scrub_stamp":"2024-09-12T01:38:51.305983+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:14.472688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":40,"num_write":24,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:39:01.633864+0000","last_change":"2024-09-12T01:39:01.633864+0000","last_active":"2024-09-12T01:39:01.633864+0000","last_peered":"2024-09-12T01:39:01.633864+0000","last_clean":"2024-09-12T01:39:01.633864+0000","last_became_active":"2024-09-12T01:04:15.393597+0000","last_became_peered":"2024-09-12T01:04:15.393597+0000","last_unstale":"2024-09-12T01:39:01.633864+0000","last_undegraded":"2024-09-12T01:39:01.633864+0000","last_fullsized":"2024-09-12T01:39:01.633864+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:01.633757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:01.633757+0000","last_clean_scrub_stamp":"2024-09-12T01:39:01.633757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:03.217948+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:58.185319+0000","last_change":"2024-09-12T01:38:58.185319+0000","last_active":"2024-09-12T01:38:58.185319+0000","last_peered":"2024-09-12T01:38:58.185319+0000","last_clean":"2024-09-12T01:38:58.185319+0000","last_became_active":"2024-09-12T00:46:26.365848+0000","last_became_peered":"2024-09-12T00:46:26.365848+0000","last_unstale":"2024-09-12T01:38:58.185319+0000","last_undegraded":"2024-09-12T01:38:58.185319+0000","last_fullsized":"2024-09-12T01:38:58.185319+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:58.185187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:58.185187+0000","last_clean_scrub_stamp":"2024-09-12T01:38:58.185187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:38.382530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"263'3","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:32.652611+0000","last_change":"2024-09-12T01:38:32.652611+0000","last_active":"2024-09-12T01:38:32.652611+0000","last_peered":"2024-09-12T01:38:32.652611+0000","last_clean":"2024-09-12T01:38:32.652611+0000","last_became_active":"2024-09-12T00:46:22.350815+0000","last_became_peered":"2024-09-12T00:46:22.350815+0000","last_unstale":"2024-09-12T01:38:32.652611+0000","last_undegraded":"2024-09-12T01:38:32.652611+0000","last_fullsized":"2024-09-12T01:38:32.652611+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-12T01:38:32.652500+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-12T01:38:32.652500+0000","last_clean_scrub_stamp":"2024-09-12T01:38:32.652500+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:56.268124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"263'49","reported_seq":197,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:49.440377+0000","last_change":"2024-09-12T01:38:49.440288+0000","last_active":"2024-09-12T01:38:49.440377+0000","last_peered":"2024-09-12T01:38:49.440377+0000","last_clean":"2024-09-12T01:38:49.440377+0000","last_became_active":"2024-09-12T00:42:36.810754+0000","last_became_peered":"2024-09-12T00:42:36.810754+0000","last_unstale":"2024-09-12T01:38:49.440377+0000","last_undegraded":"2024-09-12T01:38:49.440377+0000","last_fullsized":"2024-09-12T01:38:49.440377+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'49","last_scrub_stamp":"2024-09-12T01:38:49.440173+0000","last_deep_scrub":"263'49","last_deep_scrub_stamp":"2024-09-12T01:38:49.440173+0000","last_clean_scrub_stamp":"2024-09-12T01:38:49.440173+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:00.119904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":240,"num_read_kb":165,"num_write":91,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:44.968934+0000","last_change":"2024-09-12T01:38:44.968832+0000","last_active":"2024-09-12T01:38:44.968934+0000","last_peered":"2024-09-12T01:38:44.968934+0000","last_clean":"2024-09-12T01:38:44.968934+0000","last_became_active":"2024-09-12T01:04:15.396999+0000","last_became_peered":"2024-09-12T01:04:15.396999+0000","last_unstale":"2024-09-12T01:38:44.968934+0000","last_undegraded":"2024-09-12T01:38:44.968934+0000","last_fullsized":"2024-09-12T01:38:44.968934+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:44.968746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:44.968746+0000","last_clean_scrub_stamp":"2024-09-12T01:38:44.968746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:31.808451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:43.782123+0000","last_change":"2024-09-12T01:38:43.782123+0000","last_active":"2024-09-12T01:38:43.782123+0000","last_peered":"2024-09-12T01:38:43.782123+0000","last_clean":"2024-09-12T01:38:43.782123+0000","last_became_active":"2024-09-12T00:46:26.563041+0000","last_became_peered":"2024-09-12T00:46:26.563041+0000","last_unstale":"2024-09-12T01:38:43.782123+0000","last_undegraded":"2024-09-12T01:38:43.782123+0000","last_fullsized":"2024-09-12T01:38:43.782123+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:43.782030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:43.782030+0000","last_clean_scrub_stamp":"2024-09-12T01:38:43.782030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:45.708647+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:56.359477+0000","last_change":"2024-09-12T01:38:56.359477+0000","last_active":"2024-09-12T01:38:56.359477+0000","last_peered":"2024-09-12T01:38:56.359477+0000","last_clean":"2024-09-12T01:38:56.359477+0000","last_became_active":"2024-09-12T00:46:22.352933+0000","last_became_peered":"2024-09-12T00:46:22.352933+0000","last_unstale":"2024-09-12T01:38:56.359477+0000","last_undegraded":"2024-09-12T01:38:56.359477+0000","last_fullsized":"2024-09-12T01:38:56.359477+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:56.359393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:56.359393+0000","last_clean_scrub_stamp":"2024-09-12T01:38:56.359393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:35.089670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"263'30","reported_seq":152,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.083729+0000","last_change":"2024-09-12T01:38:37.083672+0000","last_active":"2024-09-12T01:38:37.083729+0000","last_peered":"2024-09-12T01:38:37.083729+0000","last_clean":"2024-09-12T01:38:37.083729+0000","last_became_active":"2024-09-12T00:42:36.816619+0000","last_became_peered":"2024-09-12T00:42:36.816619+0000","last_unstale":"2024-09-12T01:38:37.083729+0000","last_undegraded":"2024-09-12T01:38:37.083729+0000","last_fullsized":"2024-09-12T01:38:37.083729+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'30","last_scrub_stamp":"2024-09-12T01:38:37.083582+0000","last_deep_scrub":"263'30","last_deep_scrub_stamp":"2024-09-12T01:38:37.083582+0000","last_clean_scrub_stamp":"2024-09-12T01:38:37.083582+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:16.757422+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":113,"num_write":55,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:39:00.633276+0000","last_change":"2024-09-12T01:39:00.633276+0000","last_active":"2024-09-12T01:39:00.633276+0000","last_peered":"2024-09-12T01:39:00.633276+0000","last_clean":"2024-09-12T01:39:00.633276+0000","last_became_active":"2024-09-12T01:04:15.396125+0000","last_became_peered":"2024-09-12T01:04:15.396125+0000","last_unstale":"2024-09-12T01:39:00.633276+0000","last_undegraded":"2024-09-12T01:39:00.633276+0000","last_fullsized":"2024-09-12T01:39:00.633276+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:00.633172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:00.633172+0000","last_clean_scrub_stamp":"2024-09-12T01:39:00.633172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:44.860881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:39:00.118240+0000","last_change":"2024-09-12T01:39:00.118240+0000","last_active":"2024-09-12T01:39:00.118240+0000","last_peered":"2024-09-12T01:39:00.118240+0000","last_clean":"2024-09-12T01:39:00.118240+0000","last_became_active":"2024-09-12T00:46:26.366293+0000","last_became_peered":"2024-09-12T00:46:26.366293+0000","last_unstale":"2024-09-12T01:39:00.118240+0000","last_undegraded":"2024-09-12T01:39:00.118240+0000","last_fullsized":"2024-09-12T01:39:00.118240+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:00.118147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:00.118147+0000","last_clean_scrub_stamp":"2024-09-12T01:39:00.118147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:00.946035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"263'3","reported_seq":67,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:39.792087+0000","last_change":"2024-09-12T01:38:39.792087+0000","last_active":"2024-09-12T01:38:39.792087+0000","last_peered":"2024-09-12T01:38:39.792087+0000","last_clean":"2024-09-12T01:38:39.792087+0000","last_became_active":"2024-09-12T00:46:22.348546+0000","last_became_peered":"2024-09-12T00:46:22.348546+0000","last_unstale":"2024-09-12T01:38:39.792087+0000","last_undegraded":"2024-09-12T01:38:39.792087+0000","last_fullsized":"2024-09-12T01:38:39.792087+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-12T01:38:39.792001+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-12T01:38:39.792001+0000","last_clean_scrub_stamp":"2024-09-12T01:38:39.792001+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:53.468245+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"263'34","reported_seq":158,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:27.702824+0000","last_change":"2024-09-12T01:38:27.702719+0000","last_active":"2024-09-12T01:38:27.702824+0000","last_peered":"2024-09-12T01:38:27.702824+0000","last_clean":"2024-09-12T01:38:27.702824+0000","last_became_active":"2024-09-12T00:42:36.817530+0000","last_became_peered":"2024-09-12T00:42:36.817530+0000","last_unstale":"2024-09-12T01:38:27.702824+0000","last_undegraded":"2024-09-12T01:38:27.702824+0000","last_fullsized":"2024-09-12T01:38:27.702824+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'34","last_scrub_stamp":"2024-09-12T01:38:27.702618+0000","last_deep_scrub":"263'34","last_deep_scrub_stamp":"2024-09-12T01:38:27.702618+0000","last_clean_scrub_stamp":"2024-09-12T01:38:27.702618+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:09.546260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":117,"num_write":66,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:39:07.098628+0000","last_change":"2024-09-12T01:39:07.098628+0000","last_active":"2024-09-12T01:39:07.098628+0000","last_peered":"2024-09-12T01:39:07.098628+0000","last_clean":"2024-09-12T01:39:07.098628+0000","last_became_active":"2024-09-12T01:04:15.399564+0000","last_became_peered":"2024-09-12T01:04:15.399564+0000","last_unstale":"2024-09-12T01:39:07.098628+0000","last_undegraded":"2024-09-12T01:39:07.098628+0000","last_fullsized":"2024-09-12T01:39:07.098628+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:07.098534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:07.098534+0000","last_clean_scrub_stamp":"2024-09-12T01:39:07.098534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:05.107144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"263'7","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:53.616340+0000","last_change":"2024-09-12T01:38:53.616340+0000","last_active":"2024-09-12T01:38:53.616340+0000","last_peered":"2024-09-12T01:38:53.616340+0000","last_clean":"2024-09-12T01:38:53.616340+0000","last_became_active":"2024-09-12T00:46:26.373942+0000","last_became_peered":"2024-09-12T00:46:26.373942+0000","last_unstale":"2024-09-12T01:38:53.616340+0000","last_undegraded":"2024-09-12T01:38:53.616340+0000","last_fullsized":"2024-09-12T01:38:53.616340+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'7","last_scrub_stamp":"2024-09-12T01:38:53.616240+0000","last_deep_scrub":"263'7","last_deep_scrub_stamp":"2024-09-12T01:38:53.616240+0000","last_clean_scrub_stamp":"2024-09-12T01:38:53.616240+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:10.767002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8208,"num_write":12,"num_write_kb":8208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:54.325155+0000","last_change":"2024-09-12T01:38:54.325155+0000","last_active":"2024-09-12T01:38:54.325155+0000","last_peered":"2024-09-12T01:38:54.325155+0000","last_clean":"2024-09-12T01:38:54.325155+0000","last_became_active":"2024-09-12T00:46:22.352156+0000","last_became_peered":"2024-09-12T00:46:22.352156+0000","last_unstale":"2024-09-12T01:38:54.325155+0000","last_undegraded":"2024-09-12T01:38:54.325155+0000","last_fullsized":"2024-09-12T01:38:54.325155+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:54.325070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:54.325070+0000","last_clean_scrub_stamp":"2024-09-12T01:38:54.325070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:14.030801+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"263'10","reported_seq":92,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:46.239386+0000","last_change":"2024-09-12T01:38:46.239322+0000","last_active":"2024-09-12T01:38:46.239386+0000","last_peered":"2024-09-12T01:38:46.239386+0000","last_clean":"2024-09-12T01:38:46.239386+0000","last_became_active":"2024-09-12T00:42:36.817021+0000","last_became_peered":"2024-09-12T00:42:36.817021+0000","last_unstale":"2024-09-12T01:38:46.239386+0000","last_undegraded":"2024-09-12T01:38:46.239386+0000","last_fullsized":"2024-09-12T01:38:46.239386+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'10","last_scrub_stamp":"2024-09-12T01:38:46.239230+0000","last_deep_scrub":"263'10","last_deep_scrub_stamp":"2024-09-12T01:38:46.239230+0000","last_clean_scrub_stamp":"2024-09-12T01:38:46.239230+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:04.978959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:39:02.635175+0000","last_change":"2024-09-12T01:39:02.635175+0000","last_active":"2024-09-12T01:39:02.635175+0000","last_peered":"2024-09-12T01:39:02.635175+0000","last_clean":"2024-09-12T01:39:02.635175+0000","last_became_active":"2024-09-12T01:04:15.396096+0000","last_became_peered":"2024-09-12T01:04:15.396096+0000","last_unstale":"2024-09-12T01:39:02.635175+0000","last_undegraded":"2024-09-12T01:39:02.635175+0000","last_fullsized":"2024-09-12T01:39:02.635175+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:02.635085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:02.635085+0000","last_clean_scrub_stamp":"2024-09-12T01:39:02.635085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:43.013892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"260'5","reported_seq":70,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:56.658584+0000","last_change":"2024-09-12T01:38:56.658584+0000","last_active":"2024-09-12T01:38:56.658584+0000","last_peered":"2024-09-12T01:38:56.658584+0000","last_clean":"2024-09-12T01:38:56.658584+0000","last_became_active":"2024-09-12T00:46:26.561924+0000","last_became_peered":"2024-09-12T00:46:26.561924+0000","last_unstale":"2024-09-12T01:38:56.658584+0000","last_undegraded":"2024-09-12T01:38:56.658584+0000","last_fullsized":"2024-09-12T01:38:56.658584+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-12T01:38:56.658492+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-12T01:38:56.658492+0000","last_clean_scrub_stamp":"2024-09-12T01:38:56.658492+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:17.507596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.869978+0000","last_change":"2024-09-12T01:38:35.869978+0000","last_active":"2024-09-12T01:38:35.869978+0000","last_peered":"2024-09-12T01:38:35.869978+0000","last_clean":"2024-09-12T01:38:35.869978+0000","last_became_active":"2024-09-12T00:46:22.349376+0000","last_became_peered":"2024-09-12T00:46:22.349376+0000","last_unstale":"2024-09-12T01:38:35.869978+0000","last_undegraded":"2024-09-12T01:38:35.869978+0000","last_fullsized":"2024-09-12T01:38:35.869978+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.869862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.869862+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.869862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:32.067962+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"263'30","reported_seq":152,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:46.591451+0000","last_change":"2024-09-12T01:38:46.591451+0000","last_active":"2024-09-12T01:38:46.591451+0000","last_peered":"2024-09-12T01:38:46.591451+0000","last_clean":"2024-09-12T01:38:46.591451+0000","last_became_active":"2024-09-12T00:42:36.809602+0000","last_became_peered":"2024-09-12T00:42:36.809602+0000","last_unstale":"2024-09-12T01:38:46.591451+0000","last_undegraded":"2024-09-12T01:38:46.591451+0000","last_fullsized":"2024-09-12T01:38:46.591451+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'30","last_scrub_stamp":"2024-09-12T01:38:46.591367+0000","last_deep_scrub":"263'30","last_deep_scrub_stamp":"2024-09-12T01:38:46.591367+0000","last_clean_scrub_stamp":"2024-09-12T01:38:46.591367+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:17.110484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":112,"num_write":54,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"263'2","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:39:04.644433+0000","last_change":"2024-09-12T01:39:04.644433+0000","last_active":"2024-09-12T01:39:04.644433+0000","last_peered":"2024-09-12T01:39:04.644433+0000","last_clean":"2024-09-12T01:39:04.644433+0000","last_became_active":"2024-09-12T01:04:15.392789+0000","last_became_peered":"2024-09-12T01:04:15.392789+0000","last_unstale":"2024-09-12T01:39:04.644433+0000","last_undegraded":"2024-09-12T01:39:04.644433+0000","last_fullsized":"2024-09-12T01:39:04.644433+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:39:04.644336+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:39:04.644336+0000","last_clean_scrub_stamp":"2024-09-12T01:39:04.644336+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:54.416299+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"260'5","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:42.777587+0000","last_change":"2024-09-12T01:38:42.777587+0000","last_active":"2024-09-12T01:38:42.777587+0000","last_peered":"2024-09-12T01:38:42.777587+0000","last_clean":"2024-09-12T01:38:42.777587+0000","last_became_active":"2024-09-12T00:46:26.369883+0000","last_became_peered":"2024-09-12T00:46:26.369883+0000","last_unstale":"2024-09-12T01:38:42.777587+0000","last_undegraded":"2024-09-12T01:38:42.777587+0000","last_fullsized":"2024-09-12T01:38:42.777587+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-12T01:38:42.777465+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-12T01:38:42.777465+0000","last_clean_scrub_stamp":"2024-09-12T01:38:42.777465+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:57.944053+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:55.327971+0000","last_change":"2024-09-12T01:38:55.327971+0000","last_active":"2024-09-12T01:38:55.327971+0000","last_peered":"2024-09-12T01:38:55.327971+0000","last_clean":"2024-09-12T01:38:55.327971+0000","last_became_active":"2024-09-12T00:46:22.348568+0000","last_became_peered":"2024-09-12T00:46:22.348568+0000","last_unstale":"2024-09-12T01:38:55.327971+0000","last_undegraded":"2024-09-12T01:38:55.327971+0000","last_fullsized":"2024-09-12T01:38:55.327971+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:55.327891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:55.327891+0000","last_clean_scrub_stamp":"2024-09-12T01:38:55.327891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:09.634643+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"263'9","reported_seq":93,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:50.339950+0000","last_change":"2024-09-12T01:38:50.339885+0000","last_active":"2024-09-12T01:38:50.339950+0000","last_peered":"2024-09-12T01:38:50.339950+0000","last_clean":"2024-09-12T01:38:50.339950+0000","last_became_active":"2024-09-12T00:42:36.813997+0000","last_became_peered":"2024-09-12T00:42:36.813997+0000","last_unstale":"2024-09-12T01:38:50.339950+0000","last_undegraded":"2024-09-12T01:38:50.339950+0000","last_fullsized":"2024-09-12T01:38:50.339950+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'9","last_scrub_stamp":"2024-09-12T01:38:50.339791+0000","last_deep_scrub":"263'9","last_deep_scrub_stamp":"2024-09-12T01:38:50.339791+0000","last_clean_scrub_stamp":"2024-09-12T01:38:50.339791+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:59.134254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:39:05.201854+0000","last_change":"2024-09-12T01:39:05.201854+0000","last_active":"2024-09-12T01:39:05.201854+0000","last_peered":"2024-09-12T01:39:05.201854+0000","last_clean":"2024-09-12T01:39:05.201854+0000","last_became_active":"2024-09-12T01:04:15.393220+0000","last_became_peered":"2024-09-12T01:04:15.393220+0000","last_unstale":"2024-09-12T01:39:05.201854+0000","last_undegraded":"2024-09-12T01:39:05.201854+0000","last_fullsized":"2024-09-12T01:39:05.201854+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:05.201765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:05.201765+0000","last_clean_scrub_stamp":"2024-09-12T01:39:05.201765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:47.991089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"263'2","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:57.680391+0000","last_change":"2024-09-12T01:38:57.680391+0000","last_active":"2024-09-12T01:38:57.680391+0000","last_peered":"2024-09-12T01:38:57.680391+0000","last_clean":"2024-09-12T01:38:57.680391+0000","last_became_active":"2024-09-12T00:46:26.370349+0000","last_became_peered":"2024-09-12T00:46:26.370349+0000","last_unstale":"2024-09-12T01:38:57.680391+0000","last_undegraded":"2024-09-12T01:38:57.680391+0000","last_fullsized":"2024-09-12T01:38:57.680391+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:38:57.680305+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:38:57.680305+0000","last_clean_scrub_stamp":"2024-09-12T01:38:57.680305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:00.959503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"263'11","reported_seq":85,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:46.464733+0000","last_change":"2024-09-12T01:38:46.464733+0000","last_active":"2024-09-12T01:38:46.464733+0000","last_peered":"2024-09-12T01:38:46.464733+0000","last_clean":"2024-09-12T01:38:46.464733+0000","last_became_active":"2024-09-12T00:46:22.346024+0000","last_became_peered":"2024-09-12T00:46:22.346024+0000","last_unstale":"2024-09-12T01:38:46.464733+0000","last_undegraded":"2024-09-12T01:38:46.464733+0000","last_fullsized":"2024-09-12T01:38:46.464733+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'11","last_scrub_stamp":"2024-09-12T01:38:46.464647+0000","last_deep_scrub":"263'11","last_deep_scrub_stamp":"2024-09-12T01:38:46.464647+0000","last_clean_scrub_stamp":"2024-09-12T01:38:46.464647+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:44.904960+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":32770,"num_write":16,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"263'38","reported_seq":168,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.113574+0000","last_change":"2024-09-12T01:38:35.113493+0000","last_active":"2024-09-12T01:38:35.113574+0000","last_peered":"2024-09-12T01:38:35.113574+0000","last_clean":"2024-09-12T01:38:35.113574+0000","last_became_active":"2024-09-12T00:42:36.809350+0000","last_became_peered":"2024-09-12T00:42:36.809350+0000","last_unstale":"2024-09-12T01:38:35.113574+0000","last_undegraded":"2024-09-12T01:38:35.113574+0000","last_fullsized":"2024-09-12T01:38:35.113574+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'38","last_scrub_stamp":"2024-09-12T01:38:35.113390+0000","last_deep_scrub":"263'38","last_deep_scrub_stamp":"2024-09-12T01:38:35.113390+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.113390+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:20.270309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":127,"num_write":71,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:58.641441+0000","last_change":"2024-09-12T01:38:58.641441+0000","last_active":"2024-09-12T01:38:58.641441+0000","last_peered":"2024-09-12T01:38:58.641441+0000","last_clean":"2024-09-12T01:38:58.641441+0000","last_became_active":"2024-09-12T01:04:15.394795+0000","last_became_peered":"2024-09-12T01:04:15.394795+0000","last_unstale":"2024-09-12T01:38:58.641441+0000","last_undegraded":"2024-09-12T01:38:58.641441+0000","last_fullsized":"2024-09-12T01:38:58.641441+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:58.641356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:58.641356+0000","last_clean_scrub_stamp":"2024-09-12T01:38:58.641356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:06.959797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"263'2","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:59.346714+0000","last_change":"2024-09-12T01:38:59.346714+0000","last_active":"2024-09-12T01:38:59.346714+0000","last_peered":"2024-09-12T01:38:59.346714+0000","last_clean":"2024-09-12T01:38:59.346714+0000","last_became_active":"2024-09-12T00:46:26.367852+0000","last_became_peered":"2024-09-12T00:46:26.367852+0000","last_unstale":"2024-09-12T01:38:59.346714+0000","last_undegraded":"2024-09-12T01:38:59.346714+0000","last_fullsized":"2024-09-12T01:38:59.346714+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:38:59.346631+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:38:59.346631+0000","last_clean_scrub_stamp":"2024-09-12T01:38:59.346631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:26.860657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1142,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"260'3","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:51.743083+0000","last_change":"2024-09-12T01:38:51.743083+0000","last_active":"2024-09-12T01:38:51.743083+0000","last_peered":"2024-09-12T01:38:51.743083+0000","last_clean":"2024-09-12T01:38:51.743083+0000","last_became_active":"2024-09-12T00:46:22.351237+0000","last_became_peered":"2024-09-12T00:46:22.351237+0000","last_unstale":"2024-09-12T01:38:51.743083+0000","last_undegraded":"2024-09-12T01:38:51.743083+0000","last_fullsized":"2024-09-12T01:38:51.743083+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-12T01:38:51.742980+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-12T01:38:51.742980+0000","last_clean_scrub_stamp":"2024-09-12T01:38:51.742980+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:42.402975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'36","reported_seq":168,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:49.192718+0000","last_change":"2024-09-12T01:38:49.192613+0000","last_active":"2024-09-12T01:38:49.192718+0000","last_peered":"2024-09-12T01:38:49.192718+0000","last_clean":"2024-09-12T01:38:49.192718+0000","last_became_active":"2024-09-12T00:42:36.818852+0000","last_became_peered":"2024-09-12T00:42:36.818852+0000","last_unstale":"2024-09-12T01:38:49.192718+0000","last_undegraded":"2024-09-12T01:38:49.192718+0000","last_fullsized":"2024-09-12T01:38:49.192718+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'36","last_scrub_stamp":"2024-09-12T01:38:49.192495+0000","last_deep_scrub":"263'36","last_deep_scrub_stamp":"2024-09-12T01:38:49.192495+0000","last_clean_scrub_stamp":"2024-09-12T01:38:49.192495+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:14:48.285323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":132,"num_write":65,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:56.382813+0000","last_change":"2024-09-12T01:38:56.382813+0000","last_active":"2024-09-12T01:38:56.382813+0000","last_peered":"2024-09-12T01:38:56.382813+0000","last_clean":"2024-09-12T01:38:56.382813+0000","last_became_active":"2024-09-12T01:04:15.393651+0000","last_became_peered":"2024-09-12T01:04:15.393651+0000","last_unstale":"2024-09-12T01:38:56.382813+0000","last_undegraded":"2024-09-12T01:38:56.382813+0000","last_fullsized":"2024-09-12T01:38:56.382813+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:56.382713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:56.382713+0000","last_clean_scrub_stamp":"2024-09-12T01:38:56.382713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:07.966885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"263'5","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:39:00.322387+0000","last_change":"2024-09-12T01:39:00.322387+0000","last_active":"2024-09-12T01:39:00.322387+0000","last_peered":"2024-09-12T01:39:00.322387+0000","last_clean":"2024-09-12T01:39:00.322387+0000","last_became_active":"2024-09-12T00:46:26.563277+0000","last_became_peered":"2024-09-12T00:46:26.563277+0000","last_unstale":"2024-09-12T01:39:00.322387+0000","last_undegraded":"2024-09-12T01:39:00.322387+0000","last_fullsized":"2024-09-12T01:39:00.322387+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-12T01:39:00.322297+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-12T01:39:00.322297+0000","last_clean_scrub_stamp":"2024-09-12T01:39:00.322297+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:04.054229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":7168,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:30.647210+0000","last_change":"2024-09-12T01:38:30.647133+0000","last_active":"2024-09-12T01:38:30.647210+0000","last_peered":"2024-09-12T01:38:30.647210+0000","last_clean":"2024-09-12T01:38:30.647210+0000","last_became_active":"2024-09-12T00:46:22.351162+0000","last_became_peered":"2024-09-12T00:46:22.351162+0000","last_unstale":"2024-09-12T01:38:30.647210+0000","last_undegraded":"2024-09-12T01:38:30.647210+0000","last_fullsized":"2024-09-12T01:38:30.647210+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:30.647028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:30.647028+0000","last_clean_scrub_stamp":"2024-09-12T01:38:30.647028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:30.990037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"263'20","reported_seq":122,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:34.086627+0000","last_change":"2024-09-12T01:38:34.086569+0000","last_active":"2024-09-12T01:38:34.086627+0000","last_peered":"2024-09-12T01:38:34.086627+0000","last_clean":"2024-09-12T01:38:34.086627+0000","last_became_active":"2024-09-12T00:42:36.814845+0000","last_became_peered":"2024-09-12T00:42:36.814845+0000","last_unstale":"2024-09-12T01:38:34.086627+0000","last_undegraded":"2024-09-12T01:38:34.086627+0000","last_fullsized":"2024-09-12T01:38:34.086627+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'20","last_scrub_stamp":"2024-09-12T01:38:34.086443+0000","last_deep_scrub":"263'20","last_deep_scrub_stamp":"2024-09-12T01:38:34.086443+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.086443+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:31.852383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":75,"num_write":35,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:46.776551+0000","last_change":"2024-09-12T01:38:46.776551+0000","last_active":"2024-09-12T01:38:46.776551+0000","last_peered":"2024-09-12T01:38:46.776551+0000","last_clean":"2024-09-12T01:38:46.776551+0000","last_became_active":"2024-09-12T01:04:15.388423+0000","last_became_peered":"2024-09-12T01:04:15.388423+0000","last_unstale":"2024-09-12T01:38:46.776551+0000","last_undegraded":"2024-09-12T01:38:46.776551+0000","last_fullsized":"2024-09-12T01:38:46.776551+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:46.776463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:46.776463+0000","last_clean_scrub_stamp":"2024-09-12T01:38:46.776463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:57.000283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:55.609727+0000","last_change":"2024-09-12T01:38:55.609727+0000","last_active":"2024-09-12T01:38:55.609727+0000","last_peered":"2024-09-12T01:38:55.609727+0000","last_clean":"2024-09-12T01:38:55.609727+0000","last_became_active":"2024-09-12T00:46:26.564771+0000","last_became_peered":"2024-09-12T00:46:26.564771+0000","last_unstale":"2024-09-12T01:38:55.609727+0000","last_undegraded":"2024-09-12T01:38:55.609727+0000","last_fullsized":"2024-09-12T01:38:55.609727+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:55.609647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:55.609647+0000","last_clean_scrub_stamp":"2024-09-12T01:38:55.609647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:58.679599+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"260'3","reported_seq":67,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:50.462406+0000","last_change":"2024-09-12T01:38:50.462406+0000","last_active":"2024-09-12T01:38:50.462406+0000","last_peered":"2024-09-12T01:38:50.462406+0000","last_clean":"2024-09-12T01:38:50.462406+0000","last_became_active":"2024-09-12T00:46:22.350045+0000","last_became_peered":"2024-09-12T00:46:22.350045+0000","last_unstale":"2024-09-12T01:38:50.462406+0000","last_undegraded":"2024-09-12T01:38:50.462406+0000","last_fullsized":"2024-09-12T01:38:50.462406+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-12T01:38:50.462279+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-12T01:38:50.462279+0000","last_clean_scrub_stamp":"2024-09-12T01:38:50.462279+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:58.464172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"263'41","reported_seq":178,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:45.623357+0000","last_change":"2024-09-12T01:38:45.623306+0000","last_active":"2024-09-12T01:38:45.623357+0000","last_peered":"2024-09-12T01:38:45.623357+0000","last_clean":"2024-09-12T01:38:45.623357+0000","last_became_active":"2024-09-12T00:42:36.814228+0000","last_became_peered":"2024-09-12T00:42:36.814228+0000","last_unstale":"2024-09-12T01:38:45.623357+0000","last_undegraded":"2024-09-12T01:38:45.623357+0000","last_fullsized":"2024-09-12T01:38:45.623357+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'41","last_scrub_stamp":"2024-09-12T01:38:45.623214+0000","last_deep_scrub":"263'41","last_deep_scrub_stamp":"2024-09-12T01:38:45.623214+0000","last_clean_scrub_stamp":"2024-09-12T01:38:45.623214+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:02.595104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":139,"num_write":79,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:55.641043+0000","last_change":"2024-09-12T01:38:55.641043+0000","last_active":"2024-09-12T01:38:55.641043+0000","last_peered":"2024-09-12T01:38:55.641043+0000","last_clean":"2024-09-12T01:38:55.641043+0000","last_became_active":"2024-09-12T01:04:15.388492+0000","last_became_peered":"2024-09-12T01:04:15.388492+0000","last_unstale":"2024-09-12T01:38:55.641043+0000","last_undegraded":"2024-09-12T01:38:55.641043+0000","last_fullsized":"2024-09-12T01:38:55.641043+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:55.640914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:55.640914+0000","last_clean_scrub_stamp":"2024-09-12T01:38:55.640914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:36.265726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:50.494741+0000","last_change":"2024-09-12T01:38:50.494741+0000","last_active":"2024-09-12T01:38:50.494741+0000","last_peered":"2024-09-12T01:38:50.494741+0000","last_clean":"2024-09-12T01:38:50.494741+0000","last_became_active":"2024-09-12T00:46:26.369004+0000","last_became_peered":"2024-09-12T00:46:26.369004+0000","last_unstale":"2024-09-12T01:38:50.494741+0000","last_undegraded":"2024-09-12T01:38:50.494741+0000","last_fullsized":"2024-09-12T01:38:50.494741+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:50.494651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:50.494651+0000","last_clean_scrub_stamp":"2024-09-12T01:38:50.494651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:21.767757+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:53.668471+0000","last_change":"2024-09-12T01:38:53.668471+0000","last_active":"2024-09-12T01:38:53.668471+0000","last_peered":"2024-09-12T01:38:53.668471+0000","last_clean":"2024-09-12T01:38:53.668471+0000","last_became_active":"2024-09-12T00:46:22.353747+0000","last_became_peered":"2024-09-12T00:46:22.353747+0000","last_unstale":"2024-09-12T01:38:53.668471+0000","last_undegraded":"2024-09-12T01:38:53.668471+0000","last_fullsized":"2024-09-12T01:38:53.668471+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:53.668389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:53.668389+0000","last_clean_scrub_stamp":"2024-09-12T01:38:53.668389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:16.557449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"263'8","reported_seq":89,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.810774+0000","last_change":"2024-09-12T01:38:38.810686+0000","last_active":"2024-09-12T01:38:38.810774+0000","last_peered":"2024-09-12T01:38:38.810774+0000","last_clean":"2024-09-12T01:38:38.810774+0000","last_became_active":"2024-09-12T00:42:36.808945+0000","last_became_peered":"2024-09-12T00:42:36.808945+0000","last_unstale":"2024-09-12T01:38:38.810774+0000","last_undegraded":"2024-09-12T01:38:38.810774+0000","last_fullsized":"2024-09-12T01:38:38.810774+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-09-12T01:38:38.810584+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-09-12T01:38:38.810584+0000","last_clean_scrub_stamp":"2024-09-12T01:38:38.810584+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:00.252953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":23,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"263'2","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:34.710425+0000","last_change":"2024-09-12T01:38:34.710350+0000","last_active":"2024-09-12T01:38:34.710425+0000","last_peered":"2024-09-12T01:38:34.710425+0000","last_clean":"2024-09-12T01:38:34.710425+0000","last_became_active":"2024-09-12T01:04:15.395223+0000","last_became_peered":"2024-09-12T01:04:15.395223+0000","last_unstale":"2024-09-12T01:38:34.710425+0000","last_undegraded":"2024-09-12T01:38:34.710425+0000","last_fullsized":"2024-09-12T01:38:34.710425+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:38:34.710261+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:38:34.710261+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.710261+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:41.338981+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"260'2","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:41.788668+0000","last_change":"2024-09-12T01:38:41.788668+0000","last_active":"2024-09-12T01:38:41.788668+0000","last_peered":"2024-09-12T01:38:41.788668+0000","last_clean":"2024-09-12T01:38:41.788668+0000","last_became_active":"2024-09-12T00:46:26.367039+0000","last_became_peered":"2024-09-12T00:46:26.367039+0000","last_unstale":"2024-09-12T01:38:41.788668+0000","last_undegraded":"2024-09-12T01:38:41.788668+0000","last_fullsized":"2024-09-12T01:38:41.788668+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-12T01:38:41.788567+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-12T01:38:41.788567+0000","last_clean_scrub_stamp":"2024-09-12T01:38:41.788567+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:57.210450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"263'2","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:49.653221+0000","last_change":"2024-09-12T01:38:49.653221+0000","last_active":"2024-09-12T01:38:49.653221+0000","last_peered":"2024-09-12T01:38:49.653221+0000","last_clean":"2024-09-12T01:38:49.653221+0000","last_became_active":"2024-09-12T00:46:22.349779+0000","last_became_peered":"2024-09-12T00:46:22.349779+0000","last_unstale":"2024-09-12T01:38:49.653221+0000","last_undegraded":"2024-09-12T01:38:49.653221+0000","last_fullsized":"2024-09-12T01:38:49.653221+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:38:49.653134+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:38:49.653134+0000","last_clean_scrub_stamp":"2024-09-12T01:38:49.653134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:23.331145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":5,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"263'23","reported_seq":132,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:48.473843+0000","last_change":"2024-09-12T01:38:48.473777+0000","last_active":"2024-09-12T01:38:48.473843+0000","last_peered":"2024-09-12T01:38:48.473843+0000","last_clean":"2024-09-12T01:38:48.473843+0000","last_became_active":"2024-09-12T00:42:36.810979+0000","last_became_peered":"2024-09-12T00:42:36.810979+0000","last_unstale":"2024-09-12T01:38:48.473843+0000","last_undegraded":"2024-09-12T01:38:48.473843+0000","last_fullsized":"2024-09-12T01:38:48.473843+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'23","last_scrub_stamp":"2024-09-12T01:38:48.473674+0000","last_deep_scrub":"263'23","last_deep_scrub_stamp":"2024-09-12T01:38:48.473674+0000","last_clean_scrub_stamp":"2024-09-12T01:38:48.473674+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:30.010579+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":82,"num_write":51,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:39:04.241210+0000","last_change":"2024-09-12T01:39:04.241210+0000","last_active":"2024-09-12T01:39:04.241210+0000","last_peered":"2024-09-12T01:39:04.241210+0000","last_clean":"2024-09-12T01:39:04.241210+0000","last_became_active":"2024-09-12T01:04:15.388331+0000","last_became_peered":"2024-09-12T01:04:15.388331+0000","last_unstale":"2024-09-12T01:39:04.241210+0000","last_undegraded":"2024-09-12T01:39:04.241210+0000","last_fullsized":"2024-09-12T01:39:04.241210+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:04.241108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:04.241108+0000","last_clean_scrub_stamp":"2024-09-12T01:39:04.241108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:02.411223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"260'5","reported_seq":72,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:52.429396+0000","last_change":"2024-09-12T01:38:52.429396+0000","last_active":"2024-09-12T01:38:52.429396+0000","last_peered":"2024-09-12T01:38:52.429396+0000","last_clean":"2024-09-12T01:38:52.429396+0000","last_became_active":"2024-09-12T00:46:26.370448+0000","last_became_peered":"2024-09-12T00:46:26.370448+0000","last_unstale":"2024-09-12T01:38:52.429396+0000","last_undegraded":"2024-09-12T01:38:52.429396+0000","last_fullsized":"2024-09-12T01:38:52.429396+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-12T01:38:52.429306+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-12T01:38:52.429306+0000","last_clean_scrub_stamp":"2024-09-12T01:38:52.429306+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:46.417078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"263'2","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:50.694715+0000","last_change":"2024-09-12T01:38:50.694715+0000","last_active":"2024-09-12T01:38:50.694715+0000","last_peered":"2024-09-12T01:38:50.694715+0000","last_clean":"2024-09-12T01:38:50.694715+0000","last_became_active":"2024-09-12T00:46:22.353796+0000","last_became_peered":"2024-09-12T00:46:22.353796+0000","last_unstale":"2024-09-12T01:38:50.694715+0000","last_undegraded":"2024-09-12T01:38:50.694715+0000","last_fullsized":"2024-09-12T01:38:50.694715+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:38:50.694626+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:38:50.694626+0000","last_clean_scrub_stamp":"2024-09-12T01:38:50.694626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:23.591167+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"263'41","reported_seq":183,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:43.525201+0000","last_change":"2024-09-12T01:38:43.525109+0000","last_active":"2024-09-12T01:38:43.525201+0000","last_peered":"2024-09-12T01:38:43.525201+0000","last_clean":"2024-09-12T01:38:43.525201+0000","last_became_active":"2024-09-12T00:42:36.814700+0000","last_became_peered":"2024-09-12T00:42:36.814700+0000","last_unstale":"2024-09-12T01:38:43.525201+0000","last_undegraded":"2024-09-12T01:38:43.525201+0000","last_fullsized":"2024-09-12T01:38:43.525201+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'41","last_scrub_stamp":"2024-09-12T01:38:43.524993+0000","last_deep_scrub":"263'41","last_deep_scrub_stamp":"2024-09-12T01:38:43.524993+0000","last_clean_scrub_stamp":"2024-09-12T01:38:43.524993+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:49.722364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":150,"num_write":75,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:39:03.222292+0000","last_change":"2024-09-12T01:39:03.222292+0000","last_active":"2024-09-12T01:39:03.222292+0000","last_peered":"2024-09-12T01:39:03.222292+0000","last_clean":"2024-09-12T01:39:03.222292+0000","last_became_active":"2024-09-12T01:04:15.392129+0000","last_became_peered":"2024-09-12T01:04:15.392129+0000","last_unstale":"2024-09-12T01:39:03.222292+0000","last_undegraded":"2024-09-12T01:39:03.222292+0000","last_fullsized":"2024-09-12T01:39:03.222292+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:03.222200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:03.222200+0000","last_clean_scrub_stamp":"2024-09-12T01:39:03.222200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:51.728706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:42.911406+0000","last_change":"2024-09-12T01:38:42.911406+0000","last_active":"2024-09-12T01:38:42.911406+0000","last_peered":"2024-09-12T01:38:42.911406+0000","last_clean":"2024-09-12T01:38:42.911406+0000","last_became_active":"2024-09-12T00:46:26.374630+0000","last_became_peered":"2024-09-12T00:46:26.374630+0000","last_unstale":"2024-09-12T01:38:42.911406+0000","last_undegraded":"2024-09-12T01:38:42.911406+0000","last_fullsized":"2024-09-12T01:38:42.911406+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:42.911317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:42.911317+0000","last_clean_scrub_stamp":"2024-09-12T01:38:42.911317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:58.726469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.857392+0000","last_change":"2024-09-12T01:38:37.857392+0000","last_active":"2024-09-12T01:38:37.857392+0000","last_peered":"2024-09-12T01:38:37.857392+0000","last_clean":"2024-09-12T01:38:37.857392+0000","last_became_active":"2024-09-12T00:46:22.345455+0000","last_became_peered":"2024-09-12T00:46:22.345455+0000","last_unstale":"2024-09-12T01:38:37.857392+0000","last_undegraded":"2024-09-12T01:38:37.857392+0000","last_fullsized":"2024-09-12T01:38:37.857392+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:37.857311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:37.857311+0000","last_clean_scrub_stamp":"2024-09-12T01:38:37.857311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:52.326364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"263'47","reported_seq":194,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:32.141163+0000","last_change":"2024-09-12T01:38:32.141105+0000","last_active":"2024-09-12T01:38:32.141163+0000","last_peered":"2024-09-12T01:38:32.141163+0000","last_clean":"2024-09-12T01:38:32.141163+0000","last_became_active":"2024-09-12T00:42:36.810179+0000","last_became_peered":"2024-09-12T00:42:36.810179+0000","last_unstale":"2024-09-12T01:38:32.141163+0000","last_undegraded":"2024-09-12T01:38:32.141163+0000","last_fullsized":"2024-09-12T01:38:32.141163+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'47","last_scrub_stamp":"2024-09-12T01:38:32.141020+0000","last_deep_scrub":"263'47","last_deep_scrub_stamp":"2024-09-12T01:38:32.141020+0000","last_clean_scrub_stamp":"2024-09-12T01:38:32.141020+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:59.367091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":235,"num_read_kb":167,"num_write":78,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:59.663933+0000","last_change":"2024-09-12T01:38:59.663933+0000","last_active":"2024-09-12T01:38:59.663933+0000","last_peered":"2024-09-12T01:38:59.663933+0000","last_clean":"2024-09-12T01:38:59.663933+0000","last_became_active":"2024-09-12T01:04:15.393424+0000","last_became_peered":"2024-09-12T01:04:15.393424+0000","last_unstale":"2024-09-12T01:38:59.663933+0000","last_undegraded":"2024-09-12T01:38:59.663933+0000","last_fullsized":"2024-09-12T01:38:59.663933+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:59.663826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:59.663826+0000","last_clean_scrub_stamp":"2024-09-12T01:38:59.663826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:35:07.978038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"260'6","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:51.544350+0000","last_change":"2024-09-12T01:38:51.544350+0000","last_active":"2024-09-12T01:38:51.544350+0000","last_peered":"2024-09-12T01:38:51.544350+0000","last_clean":"2024-09-12T01:38:51.544350+0000","last_became_active":"2024-09-12T00:46:26.372169+0000","last_became_peered":"2024-09-12T00:46:26.372169+0000","last_unstale":"2024-09-12T01:38:51.544350+0000","last_undegraded":"2024-09-12T01:38:51.544350+0000","last_fullsized":"2024-09-12T01:38:51.544350+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-09-12T01:38:51.544260+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-09-12T01:38:51.544260+0000","last_clean_scrub_stamp":"2024-09-12T01:38:51.544260+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:19.122882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"263'5","reported_seq":70,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:39.986423+0000","last_change":"2024-09-12T01:38:39.986423+0000","last_active":"2024-09-12T01:38:39.986423+0000","last_peered":"2024-09-12T01:38:39.986423+0000","last_clean":"2024-09-12T01:38:39.986423+0000","last_became_active":"2024-09-12T00:46:22.350210+0000","last_became_peered":"2024-09-12T00:46:22.350210+0000","last_unstale":"2024-09-12T01:38:39.986423+0000","last_undegraded":"2024-09-12T01:38:39.986423+0000","last_fullsized":"2024-09-12T01:38:39.986423+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-12T01:38:39.986327+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-12T01:38:39.986327+0000","last_clean_scrub_stamp":"2024-09-12T01:38:39.986327+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:49.996979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4096,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"260'15","reported_seq":111,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:44.655392+0000","last_change":"2024-09-12T01:38:44.655323+0000","last_active":"2024-09-12T01:38:44.655392+0000","last_peered":"2024-09-12T01:38:44.655392+0000","last_clean":"2024-09-12T01:38:44.655392+0000","last_became_active":"2024-09-12T00:42:36.810110+0000","last_became_peered":"2024-09-12T00:42:36.810110+0000","last_unstale":"2024-09-12T01:38:44.655392+0000","last_undegraded":"2024-09-12T01:38:44.655392+0000","last_fullsized":"2024-09-12T01:38:44.655392+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'15","last_scrub_stamp":"2024-09-12T01:38:44.655235+0000","last_deep_scrub":"260'15","last_deep_scrub_stamp":"2024-09-12T01:38:44.655235+0000","last_clean_scrub_stamp":"2024-09-12T01:38:44.655235+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:33.265203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":54,"num_write":27,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"263'304","reported_seq":921,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:24.416620+0000","last_change":"2024-09-12T01:38:24.416620+0000","last_active":"2024-09-12T01:38:24.416620+0000","last_peered":"2024-09-12T01:38:24.416620+0000","last_clean":"2024-09-12T01:38:24.416620+0000","last_became_active":"2024-09-12T00:28:31.201886+0000","last_became_peered":"2024-09-12T00:28:31.201886+0000","last_unstale":"2024-09-12T01:38:24.416620+0000","last_undegraded":"2024-09-12T01:38:24.416620+0000","last_fullsized":"2024-09-12T01:38:24.416620+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'304","last_scrub_stamp":"2024-09-12T01:38:24.416516+0000","last_deep_scrub":"263'304","last_deep_scrub_stamp":"2024-09-12T01:38:24.416516+0000","last_clean_scrub_stamp":"2024-09-12T01:38:24.416516+0000","objects_scrubbed":5,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:25.833677+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":380,"num_read_kb":9626,"num_write":915,"num_write_kb":19266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"263'157","reported_seq":731,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:29.446136+0000","last_change":"2024-09-12T01:38:29.446082+0000","last_active":"2024-09-12T01:38:29.446136+0000","last_peered":"2024-09-12T01:38:29.446136+0000","last_clean":"2024-09-12T01:38:29.446136+0000","last_became_active":"2024-09-12T00:28:33.211182+0000","last_became_peered":"2024-09-12T00:28:33.211182+0000","last_unstale":"2024-09-12T01:38:29.446136+0000","last_undegraded":"2024-09-12T01:38:29.446136+0000","last_fullsized":"2024-09-12T01:38:29.446136+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'157","last_scrub_stamp":"2024-09-12T01:38:29.445999+0000","last_deep_scrub":"263'157","last_deep_scrub_stamp":"2024-09-12T01:38:29.445999+0000","last_clean_scrub_stamp":"2024-09-12T01:38:29.445999+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:21.049018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":685,"num_read_kb":553,"num_write":251,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"263'303","reported_seq":1021,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.170633+0000","last_change":"2024-09-12T01:38:13.170633+0000","last_active":"2024-09-12T01:38:13.170633+0000","last_peered":"2024-09-12T01:38:13.170633+0000","last_clean":"2024-09-12T01:38:13.170633+0000","last_became_active":"2024-09-12T00:28:31.204561+0000","last_became_peered":"2024-09-12T00:28:31.204561+0000","last_unstale":"2024-09-12T01:38:13.170633+0000","last_undegraded":"2024-09-12T01:38:13.170633+0000","last_fullsized":"2024-09-12T01:38:13.170633+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'303","last_scrub_stamp":"2024-09-12T01:38:13.170492+0000","last_deep_scrub":"263'303","last_deep_scrub_stamp":"2024-09-12T01:38:13.170492+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.170492+0000","objects_scrubbed":7,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:13.390983+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243127,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":598,"num_read_kb":14276,"num_write":1032,"num_write_kb":31679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"263'59","reported_seq":628,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:26.393590+0000","last_change":"2024-09-12T01:38:26.393537+0000","last_active":"2024-09-12T01:38:26.393590+0000","last_peered":"2024-09-12T01:38:26.393590+0000","last_clean":"2024-09-12T01:38:26.393590+0000","last_became_active":"2024-09-12T00:28:33.217028+0000","last_became_peered":"2024-09-12T00:28:33.217028+0000","last_unstale":"2024-09-12T01:38:26.393590+0000","last_undegraded":"2024-09-12T01:38:26.393590+0000","last_fullsized":"2024-09-12T01:38:26.393590+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'59","last_scrub_stamp":"2024-09-12T01:38:26.393448+0000","last_deep_scrub":"263'59","last_deep_scrub_stamp":"2024-09-12T01:38:26.393448+0000","last_clean_scrub_stamp":"2024-09-12T01:38:26.393448+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:46.060664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":252,"num_read_kb":216,"num_write":87,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"263'337","reported_seq":1204,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.036839+0000","last_change":"2024-09-12T01:38:14.036839+0000","last_active":"2024-09-12T01:38:14.036839+0000","last_peered":"2024-09-12T01:38:14.036839+0000","last_clean":"2024-09-12T01:38:14.036839+0000","last_became_active":"2024-09-12T00:28:31.203351+0000","last_became_peered":"2024-09-12T00:28:31.203351+0000","last_unstale":"2024-09-12T01:38:14.036839+0000","last_undegraded":"2024-09-12T01:38:14.036839+0000","last_fullsized":"2024-09-12T01:38:14.036839+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'337","last_scrub_stamp":"2024-09-12T01:38:14.036713+0000","last_deep_scrub":"263'337","last_deep_scrub_stamp":"2024-09-12T01:38:14.036713+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.036713+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:13.619013+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306757,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":934,"num_read_kb":42793,"num_write":1132,"num_write_kb":18824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"263'429","reported_seq":1182,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:25.554886+0000","last_change":"2024-09-12T01:38:25.554814+0000","last_active":"2024-09-12T01:38:25.554886+0000","last_peered":"2024-09-12T01:38:25.554886+0000","last_clean":"2024-09-12T01:38:25.554886+0000","last_became_active":"2024-09-12T00:28:33.217215+0000","last_became_peered":"2024-09-12T00:28:33.217215+0000","last_unstale":"2024-09-12T01:38:25.554886+0000","last_undegraded":"2024-09-12T01:38:25.554886+0000","last_fullsized":"2024-09-12T01:38:25.554886+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'429","last_scrub_stamp":"2024-09-12T01:38:25.554727+0000","last_deep_scrub":"263'429","last_deep_scrub_stamp":"2024-09-12T01:38:25.554727+0000","last_clean_scrub_stamp":"2024-09-12T01:38:25.554727+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":400,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:43.252309+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2092,"num_read_kb":1758,"num_write":778,"num_write_kb":522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"263'382","reported_seq":1083,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.354051+0000","last_change":"2024-09-12T01:38:21.353995+0000","last_active":"2024-09-12T01:38:21.354051+0000","last_peered":"2024-09-12T01:38:21.354051+0000","last_clean":"2024-09-12T01:38:21.354051+0000","last_became_active":"2024-09-12T00:28:31.213595+0000","last_became_peered":"2024-09-12T00:28:31.213595+0000","last_unstale":"2024-09-12T01:38:21.354051+0000","last_undegraded":"2024-09-12T01:38:21.354051+0000","last_fullsized":"2024-09-12T01:38:21.354051+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'382","last_scrub_stamp":"2024-09-12T01:38:21.353886+0000","last_deep_scrub":"263'382","last_deep_scrub_stamp":"2024-09-12T01:38:21.353886+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.353886+0000","objects_scrubbed":6,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:32.927736+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1440418,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":629,"num_read_kb":11143,"num_write":1163,"num_write_kb":15238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"263'289","reported_seq":930,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:27.130848+0000","last_change":"2024-09-12T01:38:27.130737+0000","last_active":"2024-09-12T01:38:27.130848+0000","last_peered":"2024-09-12T01:38:27.130848+0000","last_clean":"2024-09-12T01:38:27.130848+0000","last_became_active":"2024-09-12T00:28:33.218393+0000","last_became_peered":"2024-09-12T00:28:33.218393+0000","last_unstale":"2024-09-12T01:38:27.130848+0000","last_undegraded":"2024-09-12T01:38:27.130848+0000","last_fullsized":"2024-09-12T01:38:27.130848+0000","mapping_epoch":27,"log_start":"260'200","ondisk_log_start":"260'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'289","last_scrub_stamp":"2024-09-12T01:38:27.130625+0000","last_deep_scrub":"263'289","last_deep_scrub_stamp":"2024-09-12T01:38:27.130625+0000","last_clean_scrub_stamp":"2024-09-12T01:38:27.130625+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:26.395209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1288,"num_read_kb":1088,"num_write":481,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"263'321","reported_seq":924,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.314203+0000","last_change":"2024-09-12T01:38:21.314117+0000","last_active":"2024-09-12T01:38:21.314203+0000","last_peered":"2024-09-12T01:38:21.314203+0000","last_clean":"2024-09-12T01:38:21.314203+0000","last_became_active":"2024-09-12T00:28:31.204962+0000","last_became_peered":"2024-09-12T00:28:31.204962+0000","last_unstale":"2024-09-12T01:38:21.314203+0000","last_undegraded":"2024-09-12T01:38:21.314203+0000","last_fullsized":"2024-09-12T01:38:21.314203+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'321","last_scrub_stamp":"2024-09-12T01:38:21.314001+0000","last_deep_scrub":"263'321","last_deep_scrub_stamp":"2024-09-12T01:38:21.314001+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.314001+0000","objects_scrubbed":5,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:15.820622+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170194,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":404,"num_read_kb":1209,"num_write":989,"num_write_kb":17836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"263'4176","reported_seq":4805,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.172749+0000","last_change":"2024-09-12T01:38:22.172692+0000","last_active":"2024-09-12T01:38:22.172749+0000","last_peered":"2024-09-12T01:38:22.172749+0000","last_clean":"2024-09-12T01:38:22.172749+0000","last_became_active":"2024-09-12T00:28:33.214515+0000","last_became_peered":"2024-09-12T00:28:33.214515+0000","last_unstale":"2024-09-12T01:38:22.172749+0000","last_undegraded":"2024-09-12T01:38:22.172749+0000","last_fullsized":"2024-09-12T01:38:22.172749+0000","mapping_epoch":27,"log_start":"263'4100","ondisk_log_start":"263'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4176","last_scrub_stamp":"2024-09-12T01:38:22.172610+0000","last_deep_scrub":"263'4176","last_deep_scrub_stamp":"2024-09-12T01:38:22.172610+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.172610+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":3000,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:13.652374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16813,"num_read_kb":14096,"num_write":6273,"num_write_kb":3125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"263'405","reported_seq":1061,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:23.354662+0000","last_change":"2024-09-12T01:38:23.354602+0000","last_active":"2024-09-12T01:38:23.354662+0000","last_peered":"2024-09-12T01:38:23.354662+0000","last_clean":"2024-09-12T01:38:23.354662+0000","last_became_active":"2024-09-12T00:28:31.212573+0000","last_became_peered":"2024-09-12T00:28:31.212573+0000","last_unstale":"2024-09-12T01:38:23.354662+0000","last_undegraded":"2024-09-12T01:38:23.354662+0000","last_fullsized":"2024-09-12T01:38:23.354662+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'405","last_scrub_stamp":"2024-09-12T01:38:23.354510+0000","last_deep_scrub":"263'405","last_deep_scrub_stamp":"2024-09-12T01:38:23.354510+0000","last_clean_scrub_stamp":"2024-09-12T01:38:23.354510+0000","objects_scrubbed":7,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:30.422460+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568635,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":601,"num_read_kb":12450,"num_write":1255,"num_write_kb":24719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"263'260","reported_seq":978,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:27.532758+0000","last_change":"2024-09-12T01:38:27.532758+0000","last_active":"2024-09-12T01:38:27.532758+0000","last_peered":"2024-09-12T01:38:27.532758+0000","last_clean":"2024-09-12T01:38:27.532758+0000","last_became_active":"2024-09-12T00:28:33.213014+0000","last_became_peered":"2024-09-12T00:28:33.213014+0000","last_unstale":"2024-09-12T01:38:27.532758+0000","last_undegraded":"2024-09-12T01:38:27.532758+0000","last_fullsized":"2024-09-12T01:38:27.532758+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'260","last_scrub_stamp":"2024-09-12T01:38:27.532674+0000","last_deep_scrub":"263'260","last_deep_scrub_stamp":"2024-09-12T01:38:27.532674+0000","last_clean_scrub_stamp":"2024-09-12T01:38:27.532674+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:43.720342+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1431,"num_read_kb":1278,"num_write":426,"num_write_kb":225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"263'323","reported_seq":967,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.283757+0000","last_change":"2024-09-12T01:38:20.283699+0000","last_active":"2024-09-12T01:38:20.283757+0000","last_peered":"2024-09-12T01:38:20.283757+0000","last_clean":"2024-09-12T01:38:20.283757+0000","last_became_active":"2024-09-12T00:28:31.210039+0000","last_became_peered":"2024-09-12T00:28:31.210039+0000","last_unstale":"2024-09-12T01:38:20.283757+0000","last_undegraded":"2024-09-12T01:38:20.283757+0000","last_fullsized":"2024-09-12T01:38:20.283757+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'323","last_scrub_stamp":"2024-09-12T01:38:20.283603+0000","last_deep_scrub":"263'323","last_deep_scrub_stamp":"2024-09-12T01:38:20.283603+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.283603+0000","objects_scrubbed":5,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:00.352419+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262189,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":473,"num_read_kb":7448,"num_write":1018,"num_write_kb":42696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"263'277","reported_seq":971,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:31.487376+0000","last_change":"2024-09-12T01:38:31.487376+0000","last_active":"2024-09-12T01:38:31.487376+0000","last_peered":"2024-09-12T01:38:31.487376+0000","last_clean":"2024-09-12T01:38:31.487376+0000","last_became_active":"2024-09-12T00:28:33.216856+0000","last_became_peered":"2024-09-12T00:28:33.216856+0000","last_unstale":"2024-09-12T01:38:31.487376+0000","last_undegraded":"2024-09-12T01:38:31.487376+0000","last_fullsized":"2024-09-12T01:38:31.487376+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'277","last_scrub_stamp":"2024-09-12T01:38:31.487279+0000","last_deep_scrub":"263'277","last_deep_scrub_stamp":"2024-09-12T01:38:31.487279+0000","last_clean_scrub_stamp":"2024-09-12T01:38:31.487279+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:27.388441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1252,"num_read_kb":1029,"num_write":416,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"263'323","reported_seq":943,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:25.274505+0000","last_change":"2024-09-12T01:38:25.274440+0000","last_active":"2024-09-12T01:38:25.274505+0000","last_peered":"2024-09-12T01:38:25.274505+0000","last_clean":"2024-09-12T01:38:25.274505+0000","last_became_active":"2024-09-12T00:28:31.213172+0000","last_became_peered":"2024-09-12T00:28:31.213172+0000","last_unstale":"2024-09-12T01:38:25.274505+0000","last_undegraded":"2024-09-12T01:38:25.274505+0000","last_fullsized":"2024-09-12T01:38:25.274505+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'323","last_scrub_stamp":"2024-09-12T01:38:25.274349+0000","last_deep_scrub":"263'323","last_deep_scrub_stamp":"2024-09-12T01:38:25.274349+0000","last_clean_scrub_stamp":"2024-09-12T01:38:25.274349+0000","objects_scrubbed":5,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:20.497013+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1657979,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":448,"num_read_kb":13792,"num_write":975,"num_write_kb":26598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"263'108","reported_seq":726,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.719896+0000","last_change":"2024-09-12T01:38:15.719896+0000","last_active":"2024-09-12T01:38:15.719896+0000","last_peered":"2024-09-12T01:38:15.719896+0000","last_clean":"2024-09-12T01:38:15.719896+0000","last_became_active":"2024-09-12T00:28:33.206296+0000","last_became_peered":"2024-09-12T00:28:33.206296+0000","last_unstale":"2024-09-12T01:38:15.719896+0000","last_undegraded":"2024-09-12T01:38:15.719896+0000","last_fullsized":"2024-09-12T01:38:15.719896+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'108","last_scrub_stamp":"2024-09-12T01:38:15.719809+0000","last_deep_scrub":"263'108","last_deep_scrub_stamp":"2024-09-12T01:38:15.719809+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.719809+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:07.737417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":463,"num_read_kb":402,"num_write":161,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"263'4150","reported_seq":4764,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:24.517906+0000","last_change":"2024-09-12T01:38:24.517843+0000","last_active":"2024-09-12T01:38:24.517906+0000","last_peered":"2024-09-12T01:38:24.517906+0000","last_clean":"2024-09-12T01:38:24.517906+0000","last_became_active":"2024-09-12T00:28:33.213777+0000","last_became_peered":"2024-09-12T00:28:33.213777+0000","last_unstale":"2024-09-12T01:38:24.517906+0000","last_undegraded":"2024-09-12T01:38:24.517906+0000","last_fullsized":"2024-09-12T01:38:24.517906+0000","mapping_epoch":27,"log_start":"263'4100","ondisk_log_start":"263'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4150","last_scrub_stamp":"2024-09-12T01:38:24.517726+0000","last_deep_scrub":"263'4150","last_deep_scrub_stamp":"2024-09-12T01:38:24.517726+0000","last_clean_scrub_stamp":"2024-09-12T01:38:24.517726+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":3000,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:14.431730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16687,"num_read_kb":13992,"num_write":6250,"num_write_kb":3125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"263'389","reported_seq":1025,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.696924+0000","last_change":"2024-09-12T01:38:12.696924+0000","last_active":"2024-09-12T01:38:12.696924+0000","last_peered":"2024-09-12T01:38:12.696924+0000","last_clean":"2024-09-12T01:38:12.696924+0000","last_became_active":"2024-09-12T00:29:04.274377+0000","last_became_peered":"2024-09-12T00:29:04.274377+0000","last_unstale":"2024-09-12T01:38:12.696924+0000","last_undegraded":"2024-09-12T01:38:12.696924+0000","last_fullsized":"2024-09-12T01:38:12.696924+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'389","last_scrub_stamp":"2024-09-12T01:38:12.696814+0000","last_deep_scrub":"263'389","last_deep_scrub_stamp":"2024-09-12T01:38:12.696814+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.696814+0000","objects_scrubbed":6,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:54.981263+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568865,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":569,"num_read_kb":2856,"num_write":1189,"num_write_kb":27657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"263'295","reported_seq":944,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:25.405722+0000","last_change":"2024-09-12T01:38:25.405638+0000","last_active":"2024-09-12T01:38:25.405722+0000","last_peered":"2024-09-12T01:38:25.405722+0000","last_clean":"2024-09-12T01:38:25.405722+0000","last_became_active":"2024-09-12T00:28:33.218660+0000","last_became_peered":"2024-09-12T00:28:33.218660+0000","last_unstale":"2024-09-12T01:38:25.405722+0000","last_undegraded":"2024-09-12T01:38:25.405722+0000","last_fullsized":"2024-09-12T01:38:25.405722+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'295","last_scrub_stamp":"2024-09-12T01:38:25.405555+0000","last_deep_scrub":"263'295","last_deep_scrub_stamp":"2024-09-12T01:38:25.405555+0000","last_clean_scrub_stamp":"2024-09-12T01:38:25.405555+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:09.677150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1306,"num_read_kb":1072,"num_write":479,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"263'371","reported_seq":1043,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.100624+0000","last_change":"2024-09-12T01:38:16.100566+0000","last_active":"2024-09-12T01:38:16.100624+0000","last_peered":"2024-09-12T01:38:16.100624+0000","last_clean":"2024-09-12T01:38:16.100624+0000","last_became_active":"2024-09-12T00:28:31.213388+0000","last_became_peered":"2024-09-12T00:28:31.213388+0000","last_unstale":"2024-09-12T01:38:16.100624+0000","last_undegraded":"2024-09-12T01:38:16.100624+0000","last_fullsized":"2024-09-12T01:38:16.100624+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'371","last_scrub_stamp":"2024-09-12T01:38:16.100452+0000","last_deep_scrub":"263'371","last_deep_scrub_stamp":"2024-09-12T01:38:16.100452+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.100452+0000","objects_scrubbed":7,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:47.142311+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133695,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":588,"num_read_kb":20058,"num_write":1150,"num_write_kb":40619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"263'90","reported_seq":682,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:27.422220+0000","last_change":"2024-09-12T01:38:27.422148+0000","last_active":"2024-09-12T01:38:27.422220+0000","last_peered":"2024-09-12T01:38:27.422220+0000","last_clean":"2024-09-12T01:38:27.422220+0000","last_became_active":"2024-09-12T00:28:33.213998+0000","last_became_peered":"2024-09-12T00:28:33.213998+0000","last_unstale":"2024-09-12T01:38:27.422220+0000","last_undegraded":"2024-09-12T01:38:27.422220+0000","last_fullsized":"2024-09-12T01:38:27.422220+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'90","last_scrub_stamp":"2024-09-12T01:38:27.422064+0000","last_deep_scrub":"263'90","last_deep_scrub_stamp":"2024-09-12T01:38:27.422064+0000","last_clean_scrub_stamp":"2024-09-12T01:38:27.422064+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:02.338451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":414,"num_read_kb":350,"num_write":126,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"263'353","reported_seq":1074,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.108312+0000","last_change":"2024-09-12T01:38:14.108241+0000","last_active":"2024-09-12T01:38:14.108312+0000","last_peered":"2024-09-12T01:38:14.108312+0000","last_clean":"2024-09-12T01:38:14.108312+0000","last_became_active":"2024-09-12T00:28:31.215230+0000","last_became_peered":"2024-09-12T00:28:31.215230+0000","last_unstale":"2024-09-12T01:38:14.108312+0000","last_undegraded":"2024-09-12T01:38:14.108312+0000","last_fullsized":"2024-09-12T01:38:14.108312+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'353","last_scrub_stamp":"2024-09-12T01:38:14.108148+0000","last_deep_scrub":"263'353","last_deep_scrub_stamp":"2024-09-12T01:38:14.108148+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.108148+0000","objects_scrubbed":4,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:21.237357+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254836,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":624,"num_read_kb":115792,"num_write":1091,"num_write_kb":22723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"263'230","reported_seq":861,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.728050+0000","last_change":"2024-09-12T01:38:14.727989+0000","last_active":"2024-09-12T01:38:14.728050+0000","last_peered":"2024-09-12T01:38:14.728050+0000","last_clean":"2024-09-12T01:38:14.728050+0000","last_became_active":"2024-09-12T00:28:33.206305+0000","last_became_peered":"2024-09-12T00:28:33.206305+0000","last_unstale":"2024-09-12T01:38:14.728050+0000","last_undegraded":"2024-09-12T01:38:14.728050+0000","last_fullsized":"2024-09-12T01:38:14.728050+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'230","last_scrub_stamp":"2024-09-12T01:38:14.727900+0000","last_deep_scrub":"263'230","last_deep_scrub_stamp":"2024-09-12T01:38:14.727900+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.727900+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:41.691362+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":971,"num_read_kb":790,"num_write":344,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"263'421","reported_seq":1159,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.506189+0000","last_change":"2024-09-12T01:38:10.506130+0000","last_active":"2024-09-12T01:38:10.506189+0000","last_peered":"2024-09-12T01:38:10.506189+0000","last_clean":"2024-09-12T01:38:10.506189+0000","last_became_active":"2024-09-12T00:28:31.199779+0000","last_became_peered":"2024-09-12T00:28:31.199779+0000","last_unstale":"2024-09-12T01:38:10.506189+0000","last_undegraded":"2024-09-12T01:38:10.506189+0000","last_fullsized":"2024-09-12T01:38:10.506189+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'421","last_scrub_stamp":"2024-09-12T01:38:10.506027+0000","last_deep_scrub":"263'421","last_deep_scrub_stamp":"2024-09-12T01:38:10.506027+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.506027+0000","objects_scrubbed":8,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:11.152787+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306267,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":669,"num_read_kb":69035,"num_write":1318,"num_write_kb":57878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"263'150","reported_seq":809,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:23.751685+0000","last_change":"2024-09-12T01:38:23.751611+0000","last_active":"2024-09-12T01:38:23.751685+0000","last_peered":"2024-09-12T01:38:23.751685+0000","last_clean":"2024-09-12T01:38:23.751685+0000","last_became_active":"2024-09-12T00:28:33.208831+0000","last_became_peered":"2024-09-12T00:28:33.208831+0000","last_unstale":"2024-09-12T01:38:23.751685+0000","last_undegraded":"2024-09-12T01:38:23.751685+0000","last_fullsized":"2024-09-12T01:38:23.751685+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'150","last_scrub_stamp":"2024-09-12T01:38:23.751512+0000","last_deep_scrub":"263'150","last_deep_scrub_stamp":"2024-09-12T01:38:23.751512+0000","last_clean_scrub_stamp":"2024-09-12T01:38:23.751512+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:11.911885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":710,"num_read_kb":600,"num_write":211,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"263'405","reported_seq":1060,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.205299+0000","last_change":"2024-09-12T01:38:14.205241+0000","last_active":"2024-09-12T01:38:14.205299+0000","last_peered":"2024-09-12T01:38:14.205299+0000","last_clean":"2024-09-12T01:38:14.205299+0000","last_became_active":"2024-09-12T00:28:31.202245+0000","last_became_peered":"2024-09-12T00:28:31.202245+0000","last_unstale":"2024-09-12T01:38:14.205299+0000","last_undegraded":"2024-09-12T01:38:14.205299+0000","last_fullsized":"2024-09-12T01:38:14.205299+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'405","last_scrub_stamp":"2024-09-12T01:38:14.205130+0000","last_deep_scrub":"263'405","last_deep_scrub_stamp":"2024-09-12T01:38:14.205130+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.205130+0000","objects_scrubbed":8,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:57.720032+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":558,"num_read_kb":23094,"num_write":1344,"num_write_kb":58944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"263'113","reported_seq":728,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:26.561584+0000","last_change":"2024-09-12T01:38:26.561527+0000","last_active":"2024-09-12T01:38:26.561584+0000","last_peered":"2024-09-12T01:38:26.561584+0000","last_clean":"2024-09-12T01:38:26.561584+0000","last_became_active":"2024-09-12T00:28:33.207527+0000","last_became_peered":"2024-09-12T00:28:33.207527+0000","last_unstale":"2024-09-12T01:38:26.561584+0000","last_undegraded":"2024-09-12T01:38:26.561584+0000","last_fullsized":"2024-09-12T01:38:26.561584+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'113","last_scrub_stamp":"2024-09-12T01:38:26.561433+0000","last_deep_scrub":"263'113","last_deep_scrub_stamp":"2024-09-12T01:38:26.561433+0000","last_clean_scrub_stamp":"2024-09-12T01:38:26.561433+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:15.140885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":515,"num_read_kb":438,"num_write":174,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"263'316","reported_seq":984,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.078959+0000","last_change":"2024-09-12T01:38:11.078901+0000","last_active":"2024-09-12T01:38:11.078959+0000","last_peered":"2024-09-12T01:38:11.078959+0000","last_clean":"2024-09-12T01:38:11.078959+0000","last_became_active":"2024-09-12T00:28:31.203048+0000","last_became_peered":"2024-09-12T00:28:31.203048+0000","last_unstale":"2024-09-12T01:38:11.078959+0000","last_undegraded":"2024-09-12T01:38:11.078959+0000","last_fullsized":"2024-09-12T01:38:11.078959+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'316","last_scrub_stamp":"2024-09-12T01:38:11.078811+0000","last_deep_scrub":"263'316","last_deep_scrub_stamp":"2024-09-12T01:38:11.078811+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.078811+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:13.632696+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524344,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":495,"num_read_kb":45596,"num_write":1045,"num_write_kb":35489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"263'107","reported_seq":627,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:42.551999+0000","last_change":"2024-09-12T01:38:42.551940+0000","last_active":"2024-09-12T01:38:42.551999+0000","last_peered":"2024-09-12T01:38:42.551999+0000","last_clean":"2024-09-12T01:38:42.551999+0000","last_became_active":"2024-09-12T00:28:41.226952+0000","last_became_peered":"2024-09-12T00:28:41.226952+0000","last_unstale":"2024-09-12T01:38:42.551999+0000","last_undegraded":"2024-09-12T01:38:42.551999+0000","last_fullsized":"2024-09-12T01:38:42.551999+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'107","last_scrub_stamp":"2024-09-12T01:38:42.551847+0000","last_deep_scrub":"263'107","last_deep_scrub_stamp":"2024-09-12T01:38:42.551847+0000","last_clean_scrub_stamp":"2024-09-12T01:38:42.551847+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:11.526139+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":155,"num_read_kb":144,"num_write":259,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"263'188","reported_seq":781,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.217150+0000","last_change":"2024-09-12T01:38:17.217081+0000","last_active":"2024-09-12T01:38:17.217150+0000","last_peered":"2024-09-12T01:38:17.217150+0000","last_clean":"2024-09-12T01:38:17.217150+0000","last_became_active":"2024-09-12T00:28:33.209521+0000","last_became_peered":"2024-09-12T00:28:33.209521+0000","last_unstale":"2024-09-12T01:38:17.217150+0000","last_undegraded":"2024-09-12T01:38:17.217150+0000","last_fullsized":"2024-09-12T01:38:17.217150+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'188","last_scrub_stamp":"2024-09-12T01:38:17.216936+0000","last_deep_scrub":"263'188","last_deep_scrub_stamp":"2024-09-12T01:38:17.216936+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.216936+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:48.308382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":834,"num_read_kb":672,"num_write":307,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"263'362","reported_seq":975,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.290301+0000","last_change":"2024-09-12T01:38:17.290235+0000","last_active":"2024-09-12T01:38:17.290301+0000","last_peered":"2024-09-12T01:38:17.290301+0000","last_clean":"2024-09-12T01:38:17.290301+0000","last_became_active":"2024-09-12T00:28:31.206010+0000","last_became_peered":"2024-09-12T00:28:31.206010+0000","last_unstale":"2024-09-12T01:38:17.290301+0000","last_undegraded":"2024-09-12T01:38:17.290301+0000","last_fullsized":"2024-09-12T01:38:17.290301+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'362","last_scrub_stamp":"2024-09-12T01:38:17.290125+0000","last_deep_scrub":"263'362","last_deep_scrub_stamp":"2024-09-12T01:38:17.290125+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.290125+0000","objects_scrubbed":9,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:31.994331+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":430,"num_read_kb":5592,"num_write":1103,"num_write_kb":25256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:33.423195+0000","last_change":"2024-09-12T01:38:33.423142+0000","last_active":"2024-09-12T01:38:33.423195+0000","last_peered":"2024-09-12T01:38:33.423195+0000","last_clean":"2024-09-12T01:38:33.423195+0000","last_became_active":"2024-09-12T00:28:35.211231+0000","last_became_peered":"2024-09-12T00:28:35.211231+0000","last_unstale":"2024-09-12T01:38:33.423195+0000","last_undegraded":"2024-09-12T01:38:33.423195+0000","last_fullsized":"2024-09-12T01:38:33.423195+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:33.423061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:33.423061+0000","last_clean_scrub_stamp":"2024-09-12T01:38:33.423061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:40.341124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"263'353","reported_seq":984,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:28.171439+0000","last_change":"2024-09-12T01:38:28.171380+0000","last_active":"2024-09-12T01:38:28.171439+0000","last_peered":"2024-09-12T01:38:28.171439+0000","last_clean":"2024-09-12T01:38:28.171439+0000","last_became_active":"2024-09-12T00:28:37.216169+0000","last_became_peered":"2024-09-12T00:28:37.216169+0000","last_unstale":"2024-09-12T01:38:28.171439+0000","last_undegraded":"2024-09-12T01:38:28.171439+0000","last_fullsized":"2024-09-12T01:38:28.171439+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'353","last_scrub_stamp":"2024-09-12T01:38:28.171291+0000","last_deep_scrub":"263'353","last_deep_scrub_stamp":"2024-09-12T01:38:28.171291+0000","last_clean_scrub_stamp":"2024-09-12T01:38:28.171291+0000","objects_scrubbed":6,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:51.037865+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44362,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":554,"num_read_kb":1122,"num_write":430,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:40.525916+0000","last_change":"2024-09-12T01:38:40.525854+0000","last_active":"2024-09-12T01:38:40.525916+0000","last_peered":"2024-09-12T01:38:40.525916+0000","last_clean":"2024-09-12T01:38:40.525916+0000","last_became_active":"2024-09-12T00:28:39.213942+0000","last_became_peered":"2024-09-12T00:28:39.213942+0000","last_unstale":"2024-09-12T01:38:40.525916+0000","last_undegraded":"2024-09-12T01:38:40.525916+0000","last_fullsized":"2024-09-12T01:38:40.525916+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:40.525765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:40.525765+0000","last_clean_scrub_stamp":"2024-09-12T01:38:40.525765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:08.844675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"263'184","reported_seq":744,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:46.481857+0000","last_change":"2024-09-12T01:38:46.481799+0000","last_active":"2024-09-12T01:38:46.481857+0000","last_peered":"2024-09-12T01:38:46.481857+0000","last_clean":"2024-09-12T01:38:46.481857+0000","last_became_active":"2024-09-12T00:28:41.229608+0000","last_became_peered":"2024-09-12T00:28:41.229608+0000","last_unstale":"2024-09-12T01:38:46.481857+0000","last_undegraded":"2024-09-12T01:38:46.481857+0000","last_fullsized":"2024-09-12T01:38:46.481857+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'184","last_scrub_stamp":"2024-09-12T01:38:46.481713+0000","last_deep_scrub":"263'184","last_deep_scrub_stamp":"2024-09-12T01:38:46.481713+0000","last_clean_scrub_stamp":"2024-09-12T01:38:46.481713+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:59.539341+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":231,"num_read_kb":225,"num_write":383,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"263'212","reported_seq":822,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:24.382447+0000","last_change":"2024-09-12T01:38:24.382381+0000","last_active":"2024-09-12T01:38:24.382447+0000","last_peered":"2024-09-12T01:38:24.382447+0000","last_clean":"2024-09-12T01:38:24.382447+0000","last_became_active":"2024-09-12T00:28:33.212334+0000","last_became_peered":"2024-09-12T00:28:33.212334+0000","last_unstale":"2024-09-12T01:38:24.382447+0000","last_undegraded":"2024-09-12T01:38:24.382447+0000","last_fullsized":"2024-09-12T01:38:24.382447+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'212","last_scrub_stamp":"2024-09-12T01:38:24.382297+0000","last_deep_scrub":"263'212","last_deep_scrub_stamp":"2024-09-12T01:38:24.382297+0000","last_clean_scrub_stamp":"2024-09-12T01:38:24.382297+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:06.630505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":883,"num_read_kb":721,"num_write":311,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"263'332","reported_seq":998,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:09.077293+0000","last_change":"2024-09-12T01:38:09.077241+0000","last_active":"2024-09-12T01:38:09.077293+0000","last_peered":"2024-09-12T01:38:09.077293+0000","last_clean":"2024-09-12T01:38:09.077293+0000","last_became_active":"2024-09-12T00:28:31.208141+0000","last_became_peered":"2024-09-12T00:28:31.208141+0000","last_unstale":"2024-09-12T01:38:09.077293+0000","last_undegraded":"2024-09-12T01:38:09.077293+0000","last_fullsized":"2024-09-12T01:38:09.077293+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'332","last_scrub_stamp":"2024-09-12T01:38:09.077147+0000","last_deep_scrub":"263'332","last_deep_scrub_stamp":"2024-09-12T01:38:09.077147+0000","last_clean_scrub_stamp":"2024-09-12T01:38:09.077147+0000","objects_scrubbed":8,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:39.882962+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395868,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":543,"num_read_kb":93032,"num_write":945,"num_write_kb":55506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":509,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:31.304948+0000","last_change":"2024-09-12T01:38:31.304849+0000","last_active":"2024-09-12T01:38:31.304948+0000","last_peered":"2024-09-12T01:38:31.304948+0000","last_clean":"2024-09-12T01:38:31.304948+0000","last_became_active":"2024-09-12T00:28:35.212745+0000","last_became_peered":"2024-09-12T00:28:35.212745+0000","last_unstale":"2024-09-12T01:38:31.304948+0000","last_undegraded":"2024-09-12T01:38:31.304948+0000","last_fullsized":"2024-09-12T01:38:31.304948+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:31.304746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:31.304746+0000","last_clean_scrub_stamp":"2024-09-12T01:38:31.304746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:59.053226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"263'96","reported_seq":643,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:34.520618+0000","last_change":"2024-09-12T01:38:34.520560+0000","last_active":"2024-09-12T01:38:34.520618+0000","last_peered":"2024-09-12T01:38:34.520618+0000","last_clean":"2024-09-12T01:38:34.520618+0000","last_became_active":"2024-09-12T00:28:37.220899+0000","last_became_peered":"2024-09-12T00:28:37.220899+0000","last_unstale":"2024-09-12T01:38:34.520618+0000","last_undegraded":"2024-09-12T01:38:34.520618+0000","last_fullsized":"2024-09-12T01:38:34.520618+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'96","last_scrub_stamp":"2024-09-12T01:38:34.520466+0000","last_deep_scrub":"263'96","last_deep_scrub_stamp":"2024-09-12T01:38:34.520466+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.520466+0000","objects_scrubbed":4,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:08.295444+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":118,"num_read_kb":113,"num_write":78,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.526744+0000","last_change":"2024-09-12T01:38:38.526649+0000","last_active":"2024-09-12T01:38:38.526744+0000","last_peered":"2024-09-12T01:38:38.526744+0000","last_clean":"2024-09-12T01:38:38.526744+0000","last_became_active":"2024-09-12T00:28:39.222553+0000","last_became_peered":"2024-09-12T00:28:39.222553+0000","last_unstale":"2024-09-12T01:38:38.526744+0000","last_undegraded":"2024-09-12T01:38:38.526744+0000","last_fullsized":"2024-09-12T01:38:38.526744+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:38.526556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:38.526556+0000","last_clean_scrub_stamp":"2024-09-12T01:38:38.526556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:49.766948+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"263'130","reported_seq":644,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:44.247475+0000","last_change":"2024-09-12T01:38:44.247475+0000","last_active":"2024-09-12T01:38:44.247475+0000","last_peered":"2024-09-12T01:38:44.247475+0000","last_clean":"2024-09-12T01:38:44.247475+0000","last_became_active":"2024-09-12T00:28:41.228305+0000","last_became_peered":"2024-09-12T00:28:41.228305+0000","last_unstale":"2024-09-12T01:38:44.247475+0000","last_undegraded":"2024-09-12T01:38:44.247475+0000","last_fullsized":"2024-09-12T01:38:44.247475+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'130","last_scrub_stamp":"2024-09-12T01:38:44.247352+0000","last_deep_scrub":"263'130","last_deep_scrub_stamp":"2024-09-12T01:38:44.247352+0000","last_clean_scrub_stamp":"2024-09-12T01:38:44.247352+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:24.952391+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":144,"num_read_kb":135,"num_write":299,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"263'197","reported_seq":851,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.026792+0000","last_change":"2024-09-12T01:38:15.026708+0000","last_active":"2024-09-12T01:38:15.026792+0000","last_peered":"2024-09-12T01:38:15.026792+0000","last_clean":"2024-09-12T01:38:15.026792+0000","last_became_active":"2024-09-12T00:28:33.219082+0000","last_became_peered":"2024-09-12T00:28:33.219082+0000","last_unstale":"2024-09-12T01:38:15.026792+0000","last_undegraded":"2024-09-12T01:38:15.026792+0000","last_fullsized":"2024-09-12T01:38:15.026792+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'197","last_scrub_stamp":"2024-09-12T01:38:15.026624+0000","last_deep_scrub":"263'197","last_deep_scrub_stamp":"2024-09-12T01:38:15.026624+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.026624+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:40.437735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":923,"num_read_kb":768,"num_write":333,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"263'386","reported_seq":1022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.293546+0000","last_change":"2024-09-12T01:38:14.293459+0000","last_active":"2024-09-12T01:38:14.293546+0000","last_peered":"2024-09-12T01:38:14.293546+0000","last_clean":"2024-09-12T01:38:14.293546+0000","last_became_active":"2024-09-12T00:28:31.204223+0000","last_became_peered":"2024-09-12T00:28:31.204223+0000","last_unstale":"2024-09-12T01:38:14.293546+0000","last_undegraded":"2024-09-12T01:38:14.293546+0000","last_fullsized":"2024-09-12T01:38:14.293546+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'386","last_scrub_stamp":"2024-09-12T01:38:14.293320+0000","last_deep_scrub":"263'386","last_deep_scrub_stamp":"2024-09-12T01:38:14.293320+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.293320+0000","objects_scrubbed":10,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:55.332433+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133695,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":536,"num_read_kb":1739,"num_write":1185,"num_write_kb":22527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:30.295363+0000","last_change":"2024-09-12T01:38:30.295310+0000","last_active":"2024-09-12T01:38:30.295363+0000","last_peered":"2024-09-12T01:38:30.295363+0000","last_clean":"2024-09-12T01:38:30.295363+0000","last_became_active":"2024-09-12T00:28:35.212197+0000","last_became_peered":"2024-09-12T00:28:35.212197+0000","last_unstale":"2024-09-12T01:38:30.295363+0000","last_undegraded":"2024-09-12T01:38:30.295363+0000","last_fullsized":"2024-09-12T01:38:30.295363+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:30.295237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:30.295237+0000","last_clean_scrub_stamp":"2024-09-12T01:38:30.295237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:18.032351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"263'140","reported_seq":709,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:25.699275+0000","last_change":"2024-09-12T01:38:25.699196+0000","last_active":"2024-09-12T01:38:25.699275+0000","last_peered":"2024-09-12T01:38:25.699275+0000","last_clean":"2024-09-12T01:38:25.699275+0000","last_became_active":"2024-09-12T00:28:37.220665+0000","last_became_peered":"2024-09-12T00:28:37.220665+0000","last_unstale":"2024-09-12T01:38:25.699275+0000","last_undegraded":"2024-09-12T01:38:25.699275+0000","last_fullsized":"2024-09-12T01:38:25.699275+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'140","last_scrub_stamp":"2024-09-12T01:38:25.699105+0000","last_deep_scrub":"263'140","last_deep_scrub_stamp":"2024-09-12T01:38:25.699105+0000","last_clean_scrub_stamp":"2024-09-12T01:38:25.699105+0000","objects_scrubbed":7,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:46.861174+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":170,"num_read_kb":162,"num_write":114,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"263'769","reported_seq":4817,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:39.521315+0000","last_change":"2024-09-12T01:38:39.521249+0000","last_active":"2024-09-12T01:38:39.521315+0000","last_peered":"2024-09-12T01:38:39.521315+0000","last_clean":"2024-09-12T01:38:39.521315+0000","last_became_active":"2024-09-12T00:28:39.218476+0000","last_became_peered":"2024-09-12T00:28:39.218476+0000","last_unstale":"2024-09-12T01:38:39.521315+0000","last_undegraded":"2024-09-12T01:38:39.521315+0000","last_fullsized":"2024-09-12T01:38:39.521315+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'769","last_scrub_stamp":"2024-09-12T01:38:39.521136+0000","last_deep_scrub":"263'769","last_deep_scrub_stamp":"2024-09-12T01:38:39.521136+0000","last_clean_scrub_stamp":"2024-09-12T01:38:39.521136+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:09.943675+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"263'194","reported_seq":1026,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:45.446140+0000","last_change":"2024-09-12T01:38:45.446140+0000","last_active":"2024-09-12T01:38:45.446140+0000","last_peered":"2024-09-12T01:38:45.446140+0000","last_clean":"2024-09-12T01:38:45.446140+0000","last_became_active":"2024-09-12T00:28:41.257679+0000","last_became_peered":"2024-09-12T00:28:41.257679+0000","last_unstale":"2024-09-12T01:38:45.446140+0000","last_undegraded":"2024-09-12T01:38:45.446140+0000","last_fullsized":"2024-09-12T01:38:45.446140+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'194","last_scrub_stamp":"2024-09-12T01:38:45.446034+0000","last_deep_scrub":"263'194","last_deep_scrub_stamp":"2024-09-12T01:38:45.446034+0000","last_clean_scrub_stamp":"2024-09-12T01:38:45.446034+0000","objects_scrubbed":3,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:06.294618+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":583,"num_read_kb":580,"num_write":423,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"263'82","reported_seq":636,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.209355+0000","last_change":"2024-09-12T01:38:16.209303+0000","last_active":"2024-09-12T01:38:16.209355+0000","last_peered":"2024-09-12T01:38:16.209355+0000","last_clean":"2024-09-12T01:38:16.209355+0000","last_became_active":"2024-09-12T00:28:33.212564+0000","last_became_peered":"2024-09-12T00:28:33.212564+0000","last_unstale":"2024-09-12T01:38:16.209355+0000","last_undegraded":"2024-09-12T01:38:16.209355+0000","last_fullsized":"2024-09-12T01:38:16.209355+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'82","last_scrub_stamp":"2024-09-12T01:38:16.209203+0000","last_deep_scrub":"263'82","last_deep_scrub_stamp":"2024-09-12T01:38:16.209203+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.209203+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:28.323813+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":372,"num_read_kb":309,"num_write":130,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"263'301","reported_seq":1012,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.134517+0000","last_change":"2024-09-12T01:38:13.134452+0000","last_active":"2024-09-12T01:38:13.134517+0000","last_peered":"2024-09-12T01:38:13.134517+0000","last_clean":"2024-09-12T01:38:13.134517+0000","last_became_active":"2024-09-12T00:28:31.207938+0000","last_became_peered":"2024-09-12T00:28:31.207938+0000","last_unstale":"2024-09-12T01:38:13.134517+0000","last_undegraded":"2024-09-12T01:38:13.134517+0000","last_fullsized":"2024-09-12T01:38:13.134517+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'301","last_scrub_stamp":"2024-09-12T01:38:13.134357+0000","last_deep_scrub":"263'301","last_deep_scrub_stamp":"2024-09-12T01:38:13.134357+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.134357+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:18.383579+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174663,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":518,"num_read_kb":179847,"num_write":976,"num_write_kb":39231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:34.460167+0000","last_change":"2024-09-12T01:38:34.460106+0000","last_active":"2024-09-12T01:38:34.460167+0000","last_peered":"2024-09-12T01:38:34.460167+0000","last_clean":"2024-09-12T01:38:34.460167+0000","last_became_active":"2024-09-12T00:28:35.213178+0000","last_became_peered":"2024-09-12T00:28:35.213178+0000","last_unstale":"2024-09-12T01:38:34.460167+0000","last_undegraded":"2024-09-12T01:38:34.460167+0000","last_fullsized":"2024-09-12T01:38:34.460167+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.460009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.460009+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.460009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:42.640293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"263'263","reported_seq":850,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:34.453726+0000","last_change":"2024-09-12T01:38:34.453626+0000","last_active":"2024-09-12T01:38:34.453726+0000","last_peered":"2024-09-12T01:38:34.453726+0000","last_clean":"2024-09-12T01:38:34.453726+0000","last_became_active":"2024-09-12T00:28:37.426357+0000","last_became_peered":"2024-09-12T00:28:37.426357+0000","last_unstale":"2024-09-12T01:38:34.453726+0000","last_undegraded":"2024-09-12T01:38:34.453726+0000","last_fullsized":"2024-09-12T01:38:34.453726+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'263","last_scrub_stamp":"2024-09-12T01:38:34.453509+0000","last_deep_scrub":"263'263","last_deep_scrub_stamp":"2024-09-12T01:38:34.453509+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.453509+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:46:46.289095+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15889,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":416,"num_read_kb":929,"num_write":326,"num_write_kb":245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"263'770","reported_seq":2658,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:43.362035+0000","last_change":"2024-09-12T01:38:43.361946+0000","last_active":"2024-09-12T01:38:43.362035+0000","last_peered":"2024-09-12T01:38:43.362035+0000","last_clean":"2024-09-12T01:38:43.362035+0000","last_became_active":"2024-09-12T00:28:39.218738+0000","last_became_peered":"2024-09-12T00:28:39.218738+0000","last_unstale":"2024-09-12T01:38:43.362035+0000","last_undegraded":"2024-09-12T01:38:43.362035+0000","last_fullsized":"2024-09-12T01:38:43.362035+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'770","last_scrub_stamp":"2024-09-12T01:38:43.361835+0000","last_deep_scrub":"263'770","last_deep_scrub_stamp":"2024-09-12T01:38:43.361835+0000","last_clean_scrub_stamp":"2024-09-12T01:38:43.361835+0000","objects_scrubbed":1,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:16.392588+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"263'110","reported_seq":686,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.383696+0000","last_change":"2024-09-12T01:38:22.383696+0000","last_active":"2024-09-12T01:38:22.383696+0000","last_peered":"2024-09-12T01:38:22.383696+0000","last_clean":"2024-09-12T01:38:22.383696+0000","last_became_active":"2024-09-12T00:28:33.213074+0000","last_became_peered":"2024-09-12T00:28:33.213074+0000","last_unstale":"2024-09-12T01:38:22.383696+0000","last_undegraded":"2024-09-12T01:38:22.383696+0000","last_fullsized":"2024-09-12T01:38:22.383696+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'110","last_scrub_stamp":"2024-09-12T01:38:22.383615+0000","last_deep_scrub":"263'110","last_deep_scrub_stamp":"2024-09-12T01:38:22.383615+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.383615+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:00.918063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":473,"num_read_kb":387,"num_write":177,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"263'310","reported_seq":928,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.315211+0000","last_change":"2024-09-12T01:38:15.315153+0000","last_active":"2024-09-12T01:38:15.315211+0000","last_peered":"2024-09-12T01:38:15.315211+0000","last_clean":"2024-09-12T01:38:15.315211+0000","last_became_active":"2024-09-12T00:28:31.207567+0000","last_became_peered":"2024-09-12T00:28:31.207567+0000","last_unstale":"2024-09-12T01:38:15.315211+0000","last_undegraded":"2024-09-12T01:38:15.315211+0000","last_fullsized":"2024-09-12T01:38:15.315211+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'310","last_scrub_stamp":"2024-09-12T01:38:15.315042+0000","last_deep_scrub":"263'310","last_deep_scrub_stamp":"2024-09-12T01:38:15.315042+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.315042+0000","objects_scrubbed":6,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:05.943857+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":384,"num_read_kb":9497,"num_write":972,"num_write_kb":19827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:28.461464+0000","last_change":"2024-09-12T01:38:28.461464+0000","last_active":"2024-09-12T01:38:28.461464+0000","last_peered":"2024-09-12T01:38:28.461464+0000","last_clean":"2024-09-12T01:38:28.461464+0000","last_became_active":"2024-09-12T00:28:35.209944+0000","last_became_peered":"2024-09-12T00:28:35.209944+0000","last_unstale":"2024-09-12T01:38:28.461464+0000","last_undegraded":"2024-09-12T01:38:28.461464+0000","last_fullsized":"2024-09-12T01:38:28.461464+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:28.461368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:28.461368+0000","last_clean_scrub_stamp":"2024-09-12T01:38:28.461368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:50.694283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"263'379","reported_seq":1020,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:39.410905+0000","last_change":"2024-09-12T01:38:39.410905+0000","last_active":"2024-09-12T01:38:39.410905+0000","last_peered":"2024-09-12T01:38:39.410905+0000","last_clean":"2024-09-12T01:38:39.410905+0000","last_became_active":"2024-09-12T00:28:37.424250+0000","last_became_peered":"2024-09-12T00:28:37.424250+0000","last_unstale":"2024-09-12T01:38:39.410905+0000","last_undegraded":"2024-09-12T01:38:39.410905+0000","last_fullsized":"2024-09-12T01:38:39.410905+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'379","last_scrub_stamp":"2024-09-12T01:38:39.410761+0000","last_deep_scrub":"263'379","last_deep_scrub_stamp":"2024-09-12T01:38:39.410761+0000","last_clean_scrub_stamp":"2024-09-12T01:38:39.410761+0000","objects_scrubbed":10,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:50.606596+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42905,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":588,"num_read_kb":1145,"num_write":446,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:28.034739+0000","last_change":"2024-09-12T01:38:28.034739+0000","last_active":"2024-09-12T01:38:28.034739+0000","last_peered":"2024-09-12T01:38:28.034739+0000","last_clean":"2024-09-12T01:38:28.034739+0000","last_became_active":"2024-09-12T00:28:39.213889+0000","last_became_peered":"2024-09-12T00:28:39.213889+0000","last_unstale":"2024-09-12T01:38:28.034739+0000","last_undegraded":"2024-09-12T01:38:28.034739+0000","last_fullsized":"2024-09-12T01:38:28.034739+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:28.034613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:28.034613+0000","last_clean_scrub_stamp":"2024-09-12T01:38:28.034613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:46.356624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"263'538","reported_seq":1356,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:42.442408+0000","last_change":"2024-09-12T01:38:42.442408+0000","last_active":"2024-09-12T01:38:42.442408+0000","last_peered":"2024-09-12T01:38:42.442408+0000","last_clean":"2024-09-12T01:38:42.442408+0000","last_became_active":"2024-09-12T00:28:41.229664+0000","last_became_peered":"2024-09-12T00:28:41.229664+0000","last_unstale":"2024-09-12T01:38:42.442408+0000","last_undegraded":"2024-09-12T01:38:42.442408+0000","last_fullsized":"2024-09-12T01:38:42.442408+0000","mapping_epoch":35,"log_start":"263'500","ondisk_log_start":"263'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'538","last_scrub_stamp":"2024-09-12T01:38:42.442328+0000","last_deep_scrub":"263'538","last_deep_scrub_stamp":"2024-09-12T01:38:42.442328+0000","last_clean_scrub_stamp":"2024-09-12T01:38:42.442328+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":500,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:09.752744+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":472,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1261,"num_read_kb":1256,"num_write":1100,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"263'151","reported_seq":774,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.524133+0000","last_change":"2024-09-12T01:38:16.524133+0000","last_active":"2024-09-12T01:38:16.524133+0000","last_peered":"2024-09-12T01:38:16.524133+0000","last_clean":"2024-09-12T01:38:16.524133+0000","last_became_active":"2024-09-12T00:28:33.201673+0000","last_became_peered":"2024-09-12T00:28:33.201673+0000","last_unstale":"2024-09-12T01:38:16.524133+0000","last_undegraded":"2024-09-12T01:38:16.524133+0000","last_fullsized":"2024-09-12T01:38:16.524133+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'151","last_scrub_stamp":"2024-09-12T01:38:16.524038+0000","last_deep_scrub":"263'151","last_deep_scrub_stamp":"2024-09-12T01:38:16.524038+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.524038+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:20.505594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":672,"num_read_kb":557,"num_write":251,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"263'425","reported_seq":1136,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.266274+0000","last_change":"2024-09-12T01:38:12.266183+0000","last_active":"2024-09-12T01:38:12.266274+0000","last_peered":"2024-09-12T01:38:12.266274+0000","last_clean":"2024-09-12T01:38:12.266274+0000","last_became_active":"2024-09-12T00:28:31.202279+0000","last_became_peered":"2024-09-12T00:28:31.202279+0000","last_unstale":"2024-09-12T01:38:12.266274+0000","last_undegraded":"2024-09-12T01:38:12.266274+0000","last_fullsized":"2024-09-12T01:38:12.266274+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'425","last_scrub_stamp":"2024-09-12T01:38:12.266071+0000","last_deep_scrub":"263'425","last_deep_scrub_stamp":"2024-09-12T01:38:12.266071+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.266071+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:43.456179+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262213,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":777,"num_read_kb":12137,"num_write":1235,"num_write_kb":44296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":512,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.741517+0000","last_change":"2024-09-12T01:38:16.741517+0000","last_active":"2024-09-12T01:38:16.741517+0000","last_peered":"2024-09-12T01:38:16.741517+0000","last_clean":"2024-09-12T01:38:16.741517+0000","last_became_active":"2024-09-12T00:28:35.210154+0000","last_became_peered":"2024-09-12T00:28:35.210154+0000","last_unstale":"2024-09-12T01:38:16.741517+0000","last_undegraded":"2024-09-12T01:38:16.741517+0000","last_fullsized":"2024-09-12T01:38:16.741517+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:16.741414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:16.741414+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.741414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:08.905624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"263'278","reported_seq":873,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.297668+0000","last_change":"2024-09-12T01:38:37.297668+0000","last_active":"2024-09-12T01:38:37.297668+0000","last_peered":"2024-09-12T01:38:37.297668+0000","last_clean":"2024-09-12T01:38:37.297668+0000","last_became_active":"2024-09-12T00:28:37.219967+0000","last_became_peered":"2024-09-12T00:28:37.219967+0000","last_unstale":"2024-09-12T01:38:37.297668+0000","last_undegraded":"2024-09-12T01:38:37.297668+0000","last_fullsized":"2024-09-12T01:38:37.297668+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'278","last_scrub_stamp":"2024-09-12T01:38:37.297574+0000","last_deep_scrub":"263'278","last_deep_scrub_stamp":"2024-09-12T01:38:37.297574+0000","last_clean_scrub_stamp":"2024-09-12T01:38:37.297574+0000","objects_scrubbed":5,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:37.194451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44545,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":449,"num_read_kb":1025,"num_write":360,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:41.315655+0000","last_change":"2024-09-12T01:38:41.315655+0000","last_active":"2024-09-12T01:38:41.315655+0000","last_peered":"2024-09-12T01:38:41.315655+0000","last_clean":"2024-09-12T01:38:41.315655+0000","last_became_active":"2024-09-12T00:28:39.216330+0000","last_became_peered":"2024-09-12T00:28:39.216330+0000","last_unstale":"2024-09-12T01:38:41.315655+0000","last_undegraded":"2024-09-12T01:38:41.315655+0000","last_fullsized":"2024-09-12T01:38:41.315655+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:41.315570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:41.315570+0000","last_clean_scrub_stamp":"2024-09-12T01:38:41.315570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:18.646822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"263'2409","reported_seq":4259,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:30.137997+0000","last_change":"2024-09-12T01:38:30.137997+0000","last_active":"2024-09-12T01:38:30.137997+0000","last_peered":"2024-09-12T01:38:30.137997+0000","last_clean":"2024-09-12T01:38:30.137997+0000","last_became_active":"2024-09-12T00:28:41.227877+0000","last_became_peered":"2024-09-12T00:28:41.227877+0000","last_unstale":"2024-09-12T01:38:30.137997+0000","last_undegraded":"2024-09-12T01:38:30.137997+0000","last_fullsized":"2024-09-12T01:38:30.137997+0000","mapping_epoch":35,"log_start":"263'2300","ondisk_log_start":"263'2300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2409","last_scrub_stamp":"2024-09-12T01:38:30.137912+0000","last_deep_scrub":"263'2409","last_deep_scrub_stamp":"2024-09-12T01:38:30.137912+0000","last_clean_scrub_stamp":"2024-09-12T01:38:30.137912+0000","objects_scrubbed":4,"log_size":109,"log_dups_size":2300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:28.037700+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1208,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6068,"num_read_kb":6055,"num_write":4875,"num_write_kb":1798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"263'303","reported_seq":981,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.167240+0000","last_change":"2024-09-12T01:38:18.167240+0000","last_active":"2024-09-12T01:38:18.167240+0000","last_peered":"2024-09-12T01:38:18.167240+0000","last_clean":"2024-09-12T01:38:18.167240+0000","last_became_active":"2024-09-12T00:28:33.217954+0000","last_became_peered":"2024-09-12T00:28:33.217954+0000","last_unstale":"2024-09-12T01:38:18.167240+0000","last_undegraded":"2024-09-12T01:38:18.167240+0000","last_fullsized":"2024-09-12T01:38:18.167240+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'303","last_scrub_stamp":"2024-09-12T01:38:18.167157+0000","last_deep_scrub":"263'303","last_deep_scrub_stamp":"2024-09-12T01:38:18.167157+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.167157+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:00.698674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1356,"num_read_kb":1133,"num_write":489,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"263'389","reported_seq":1084,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.277274+0000","last_change":"2024-09-12T01:38:16.277183+0000","last_active":"2024-09-12T01:38:16.277274+0000","last_peered":"2024-09-12T01:38:16.277274+0000","last_clean":"2024-09-12T01:38:16.277274+0000","last_became_active":"2024-09-12T00:28:31.215643+0000","last_became_peered":"2024-09-12T00:28:31.215643+0000","last_unstale":"2024-09-12T01:38:16.277274+0000","last_undegraded":"2024-09-12T01:38:16.277274+0000","last_fullsized":"2024-09-12T01:38:16.277274+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'389","last_scrub_stamp":"2024-09-12T01:38:16.277044+0000","last_deep_scrub":"263'389","last_deep_scrub_stamp":"2024-09-12T01:38:16.277044+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.277044+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:21.030278+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432537,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":556,"num_read_kb":94195,"num_write":1241,"num_write_kb":52818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.733004+0000","last_change":"2024-09-12T01:38:18.732898+0000","last_active":"2024-09-12T01:38:18.733004+0000","last_peered":"2024-09-12T01:38:18.733004+0000","last_clean":"2024-09-12T01:38:18.733004+0000","last_became_active":"2024-09-12T00:28:35.208169+0000","last_became_peered":"2024-09-12T00:28:35.208169+0000","last_unstale":"2024-09-12T01:38:18.733004+0000","last_undegraded":"2024-09-12T01:38:18.733004+0000","last_fullsized":"2024-09-12T01:38:18.733004+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:18.732796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:18.732796+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.732796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:48.698141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"263'339","reported_seq":957,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:33.414479+0000","last_change":"2024-09-12T01:38:33.414479+0000","last_active":"2024-09-12T01:38:33.414479+0000","last_peered":"2024-09-12T01:38:33.414479+0000","last_clean":"2024-09-12T01:38:33.414479+0000","last_became_active":"2024-09-12T00:28:37.220877+0000","last_became_peered":"2024-09-12T00:28:37.220877+0000","last_unstale":"2024-09-12T01:38:33.414479+0000","last_undegraded":"2024-09-12T01:38:33.414479+0000","last_fullsized":"2024-09-12T01:38:33.414479+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'339","last_scrub_stamp":"2024-09-12T01:38:33.414376+0000","last_deep_scrub":"263'339","last_deep_scrub_stamp":"2024-09-12T01:38:33.414376+0000","last_clean_scrub_stamp":"2024-09-12T01:38:33.414376+0000","objects_scrubbed":9,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:19.579577+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44229,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":532,"num_read_kb":1137,"num_write":418,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"263'774","reported_seq":2596,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:36.223850+0000","last_change":"2024-09-12T01:38:36.223850+0000","last_active":"2024-09-12T01:38:36.223850+0000","last_peered":"2024-09-12T01:38:36.223850+0000","last_clean":"2024-09-12T01:38:36.223850+0000","last_became_active":"2024-09-12T00:28:39.215746+0000","last_became_peered":"2024-09-12T00:28:39.215746+0000","last_unstale":"2024-09-12T01:38:36.223850+0000","last_undegraded":"2024-09-12T01:38:36.223850+0000","last_fullsized":"2024-09-12T01:38:36.223850+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'774","last_scrub_stamp":"2024-09-12T01:38:36.223759+0000","last_deep_scrub":"263'774","last_deep_scrub_stamp":"2024-09-12T01:38:36.223759+0000","last_clean_scrub_stamp":"2024-09-12T01:38:36.223759+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:40.732455+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"263'81","reported_seq":583,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:41.209242+0000","last_change":"2024-09-12T01:38:41.209242+0000","last_active":"2024-09-12T01:38:41.209242+0000","last_peered":"2024-09-12T01:38:41.209242+0000","last_clean":"2024-09-12T01:38:41.209242+0000","last_became_active":"2024-09-12T00:28:41.228361+0000","last_became_peered":"2024-09-12T00:28:41.228361+0000","last_unstale":"2024-09-12T01:38:41.209242+0000","last_undegraded":"2024-09-12T01:38:41.209242+0000","last_fullsized":"2024-09-12T01:38:41.209242+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'81","last_scrub_stamp":"2024-09-12T01:38:41.209159+0000","last_deep_scrub":"263'81","last_deep_scrub_stamp":"2024-09-12T01:38:41.209159+0000","last_clean_scrub_stamp":"2024-09-12T01:38:41.209159+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:37.651268+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":65,"num_write":188,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"263'302","reported_seq":917,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:26.124747+0000","last_change":"2024-09-12T01:38:26.124747+0000","last_active":"2024-09-12T01:38:26.124747+0000","last_peered":"2024-09-12T01:38:26.124747+0000","last_clean":"2024-09-12T01:38:26.124747+0000","last_became_active":"2024-09-12T00:28:33.219182+0000","last_became_peered":"2024-09-12T00:28:33.219182+0000","last_unstale":"2024-09-12T01:38:26.124747+0000","last_undegraded":"2024-09-12T01:38:26.124747+0000","last_fullsized":"2024-09-12T01:38:26.124747+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'302","last_scrub_stamp":"2024-09-12T01:38:26.124659+0000","last_deep_scrub":"263'302","last_deep_scrub_stamp":"2024-09-12T01:38:26.124659+0000","last_clean_scrub_stamp":"2024-09-12T01:38:26.124659+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:53.789811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1277,"num_read_kb":1021,"num_write":469,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"263'378","reported_seq":1054,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.303730+0000","last_change":"2024-09-12T01:38:12.303676+0000","last_active":"2024-09-12T01:38:12.303730+0000","last_peered":"2024-09-12T01:38:12.303730+0000","last_clean":"2024-09-12T01:38:12.303730+0000","last_became_active":"2024-09-12T00:28:31.214920+0000","last_became_peered":"2024-09-12T00:28:31.214920+0000","last_unstale":"2024-09-12T01:38:12.303730+0000","last_undegraded":"2024-09-12T01:38:12.303730+0000","last_fullsized":"2024-09-12T01:38:12.303730+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'378","last_scrub_stamp":"2024-09-12T01:38:12.303574+0000","last_deep_scrub":"263'378","last_deep_scrub_stamp":"2024-09-12T01:38:12.303574+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.303574+0000","objects_scrubbed":4,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:03.116923+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":584,"num_read_kb":15343,"num_write":1236,"num_write_kb":35661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":512,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.754507+0000","last_change":"2024-09-12T01:38:17.754507+0000","last_active":"2024-09-12T01:38:17.754507+0000","last_peered":"2024-09-12T01:38:17.754507+0000","last_clean":"2024-09-12T01:38:17.754507+0000","last_became_active":"2024-09-12T00:28:35.207881+0000","last_became_peered":"2024-09-12T00:28:35.207881+0000","last_unstale":"2024-09-12T01:38:17.754507+0000","last_undegraded":"2024-09-12T01:38:17.754507+0000","last_fullsized":"2024-09-12T01:38:17.754507+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:17.754418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:17.754418+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.754418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:59.001650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"263'473","reported_seq":1135,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.229161+0000","last_change":"2024-09-12T01:38:35.229161+0000","last_active":"2024-09-12T01:38:35.229161+0000","last_peered":"2024-09-12T01:38:35.229161+0000","last_clean":"2024-09-12T01:38:35.229161+0000","last_became_active":"2024-09-12T00:28:37.216189+0000","last_became_peered":"2024-09-12T00:28:37.216189+0000","last_unstale":"2024-09-12T01:38:35.229161+0000","last_undegraded":"2024-09-12T01:38:35.229161+0000","last_fullsized":"2024-09-12T01:38:35.229161+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'473","last_scrub_stamp":"2024-09-12T01:38:35.229071+0000","last_deep_scrub":"263'473","last_deep_scrub_stamp":"2024-09-12T01:38:35.229071+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.229071+0000","objects_scrubbed":7,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:58.363045+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90719,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":821,"num_read_kb":1951,"num_write":658,"num_write_kb":528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.791092+0000","last_change":"2024-09-12T01:38:22.791092+0000","last_active":"2024-09-12T01:38:22.791092+0000","last_peered":"2024-09-12T01:38:22.791092+0000","last_clean":"2024-09-12T01:38:22.791092+0000","last_became_active":"2024-09-12T00:28:39.212687+0000","last_became_peered":"2024-09-12T00:28:39.212687+0000","last_unstale":"2024-09-12T01:38:22.791092+0000","last_undegraded":"2024-09-12T01:38:22.791092+0000","last_fullsized":"2024-09-12T01:38:22.791092+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:22.790991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:22.790991+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.790991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:06.359775+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"263'135","reported_seq":672,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:34.884550+0000","last_change":"2024-09-12T01:38:34.884550+0000","last_active":"2024-09-12T01:38:34.884550+0000","last_peered":"2024-09-12T01:38:34.884550+0000","last_clean":"2024-09-12T01:38:34.884550+0000","last_became_active":"2024-09-12T00:28:41.225700+0000","last_became_peered":"2024-09-12T00:28:41.225700+0000","last_unstale":"2024-09-12T01:38:34.884550+0000","last_undegraded":"2024-09-12T01:38:34.884550+0000","last_fullsized":"2024-09-12T01:38:34.884550+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'135","last_scrub_stamp":"2024-09-12T01:38:34.884451+0000","last_deep_scrub":"263'135","last_deep_scrub_stamp":"2024-09-12T01:38:34.884451+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.884451+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:32.547527+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":521,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":185,"num_read_kb":167,"num_write":321,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"263'175","reported_seq":788,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.459440+0000","last_change":"2024-09-12T01:38:11.459368+0000","last_active":"2024-09-12T01:38:11.459440+0000","last_peered":"2024-09-12T01:38:11.459440+0000","last_clean":"2024-09-12T01:38:11.459440+0000","last_became_active":"2024-09-12T00:28:33.204532+0000","last_became_peered":"2024-09-12T00:28:33.204532+0000","last_unstale":"2024-09-12T01:38:11.459440+0000","last_undegraded":"2024-09-12T01:38:11.459440+0000","last_fullsized":"2024-09-12T01:38:11.459440+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'175","last_scrub_stamp":"2024-09-12T01:38:11.459272+0000","last_deep_scrub":"263'175","last_deep_scrub_stamp":"2024-09-12T01:38:11.459272+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.459272+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:41.431006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":765,"num_read_kb":622,"num_write":270,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"263'382","reported_seq":1027,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.215722+0000","last_change":"2024-09-12T01:38:18.215663+0000","last_active":"2024-09-12T01:38:18.215722+0000","last_peered":"2024-09-12T01:38:18.215722+0000","last_clean":"2024-09-12T01:38:18.215722+0000","last_became_active":"2024-09-12T00:28:31.207269+0000","last_became_peered":"2024-09-12T00:28:31.207269+0000","last_unstale":"2024-09-12T01:38:18.215722+0000","last_undegraded":"2024-09-12T01:38:18.215722+0000","last_fullsized":"2024-09-12T01:38:18.215722+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'382","last_scrub_stamp":"2024-09-12T01:38:18.215562+0000","last_deep_scrub":"263'382","last_deep_scrub_stamp":"2024-09-12T01:38:18.215562+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.215562+0000","objects_scrubbed":6,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:29.623240+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291522,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":535,"num_read_kb":24704,"num_write":1122,"num_write_kb":40904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.726168+0000","last_change":"2024-09-12T01:38:20.726071+0000","last_active":"2024-09-12T01:38:20.726168+0000","last_peered":"2024-09-12T01:38:20.726168+0000","last_clean":"2024-09-12T01:38:20.726168+0000","last_became_active":"2024-09-12T00:28:35.208829+0000","last_became_peered":"2024-09-12T00:28:35.208829+0000","last_unstale":"2024-09-12T01:38:20.726168+0000","last_undegraded":"2024-09-12T01:38:20.726168+0000","last_fullsized":"2024-09-12T01:38:20.726168+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:20.725958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:20.725958+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.725958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:14.695147+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"263'291","reported_seq":893,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:32.528856+0000","last_change":"2024-09-12T01:38:32.528856+0000","last_active":"2024-09-12T01:38:32.528856+0000","last_peered":"2024-09-12T01:38:32.528856+0000","last_clean":"2024-09-12T01:38:32.528856+0000","last_became_active":"2024-09-12T00:28:37.210162+0000","last_became_peered":"2024-09-12T00:28:37.210162+0000","last_unstale":"2024-09-12T01:38:32.528856+0000","last_undegraded":"2024-09-12T01:38:32.528856+0000","last_fullsized":"2024-09-12T01:38:32.528856+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'291","last_scrub_stamp":"2024-09-12T01:38:32.528735+0000","last_deep_scrub":"263'291","last_deep_scrub_stamp":"2024-09-12T01:38:32.528735+0000","last_clean_scrub_stamp":"2024-09-12T01:38:32.528735+0000","objects_scrubbed":7,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:46.245167+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46921,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":495,"num_read_kb":1053,"num_write":432,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.260178+0000","last_change":"2024-09-12T01:38:37.260178+0000","last_active":"2024-09-12T01:38:37.260178+0000","last_peered":"2024-09-12T01:38:37.260178+0000","last_clean":"2024-09-12T01:38:37.260178+0000","last_became_active":"2024-09-12T00:28:39.220468+0000","last_became_peered":"2024-09-12T00:28:39.220468+0000","last_unstale":"2024-09-12T01:38:37.260178+0000","last_undegraded":"2024-09-12T01:38:37.260178+0000","last_fullsized":"2024-09-12T01:38:37.260178+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:37.260087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:37.260087+0000","last_clean_scrub_stamp":"2024-09-12T01:38:37.260087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:17.911573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"263'86","reported_seq":589,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:44.396417+0000","last_change":"2024-09-12T01:38:44.396341+0000","last_active":"2024-09-12T01:38:44.396417+0000","last_peered":"2024-09-12T01:38:44.396417+0000","last_clean":"2024-09-12T01:38:44.396417+0000","last_became_active":"2024-09-12T00:28:41.228663+0000","last_became_peered":"2024-09-12T00:28:41.228663+0000","last_unstale":"2024-09-12T01:38:44.396417+0000","last_undegraded":"2024-09-12T01:38:44.396417+0000","last_fullsized":"2024-09-12T01:38:44.396417+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'86","last_scrub_stamp":"2024-09-12T01:38:44.396238+0000","last_deep_scrub":"263'86","last_deep_scrub_stamp":"2024-09-12T01:38:44.396238+0000","last_clean_scrub_stamp":"2024-09-12T01:38:44.396238+0000","objects_scrubbed":5,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:41.170773+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":503,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":60,"num_read_kb":59,"num_write":193,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"263'158","reported_seq":788,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.505568+0000","last_change":"2024-09-12T01:38:13.505491+0000","last_active":"2024-09-12T01:38:13.505568+0000","last_peered":"2024-09-12T01:38:13.505568+0000","last_clean":"2024-09-12T01:38:13.505568+0000","last_became_active":"2024-09-12T00:28:33.206883+0000","last_became_peered":"2024-09-12T00:28:33.206883+0000","last_unstale":"2024-09-12T01:38:13.505568+0000","last_undegraded":"2024-09-12T01:38:13.505568+0000","last_fullsized":"2024-09-12T01:38:13.505568+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'158","last_scrub_stamp":"2024-09-12T01:38:13.505388+0000","last_deep_scrub":"263'158","last_deep_scrub_stamp":"2024-09-12T01:38:13.505388+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.505388+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:21.434548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":717,"num_read_kb":595,"num_write":233,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"263'311","reported_seq":935,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.152253+0000","last_change":"2024-09-12T01:38:10.152253+0000","last_active":"2024-09-12T01:38:10.152253+0000","last_peered":"2024-09-12T01:38:10.152253+0000","last_clean":"2024-09-12T01:38:10.152253+0000","last_became_active":"2024-09-12T00:28:31.203369+0000","last_became_peered":"2024-09-12T00:28:31.203369+0000","last_unstale":"2024-09-12T01:38:10.152253+0000","last_undegraded":"2024-09-12T01:38:10.152253+0000","last_fullsized":"2024-09-12T01:38:10.152253+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'311","last_scrub_stamp":"2024-09-12T01:38:10.152154+0000","last_deep_scrub":"263'311","last_deep_scrub_stamp":"2024-09-12T01:38:10.152154+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.152154+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:08.174048+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7425128,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":375,"num_read_kb":56295,"num_write":849,"num_write_kb":46368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.025660+0000","last_change":"2024-09-12T01:38:22.025660+0000","last_active":"2024-09-12T01:38:22.025660+0000","last_peered":"2024-09-12T01:38:22.025660+0000","last_clean":"2024-09-12T01:38:22.025660+0000","last_became_active":"2024-09-12T00:28:35.207923+0000","last_became_peered":"2024-09-12T00:28:35.207923+0000","last_unstale":"2024-09-12T01:38:22.025660+0000","last_undegraded":"2024-09-12T01:38:22.025660+0000","last_fullsized":"2024-09-12T01:38:22.025660+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:22.025562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:22.025562+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.025562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:15.589299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"263'354","reported_seq":965,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:26.697355+0000","last_change":"2024-09-12T01:38:26.697286+0000","last_active":"2024-09-12T01:38:26.697355+0000","last_peered":"2024-09-12T01:38:26.697355+0000","last_clean":"2024-09-12T01:38:26.697355+0000","last_became_active":"2024-09-12T00:28:37.220674+0000","last_became_peered":"2024-09-12T00:28:37.220674+0000","last_unstale":"2024-09-12T01:38:26.697355+0000","last_undegraded":"2024-09-12T01:38:26.697355+0000","last_fullsized":"2024-09-12T01:38:26.697355+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'354","last_scrub_stamp":"2024-09-12T01:38:26.697194+0000","last_deep_scrub":"263'354","last_deep_scrub_stamp":"2024-09-12T01:38:26.697194+0000","last_clean_scrub_stamp":"2024-09-12T01:38:26.697194+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:04.175101+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48847,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":575,"num_read_kb":1313,"num_write":464,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"263'739","reported_seq":4576,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:24.709916+0000","last_change":"2024-09-12T01:38:24.709856+0000","last_active":"2024-09-12T01:38:24.709916+0000","last_peered":"2024-09-12T01:38:24.709916+0000","last_clean":"2024-09-12T01:38:24.709916+0000","last_became_active":"2024-09-12T00:28:39.213871+0000","last_became_peered":"2024-09-12T00:28:39.213871+0000","last_unstale":"2024-09-12T01:38:24.709916+0000","last_undegraded":"2024-09-12T01:38:24.709916+0000","last_fullsized":"2024-09-12T01:38:24.709916+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'739","last_scrub_stamp":"2024-09-12T01:38:24.709738+0000","last_deep_scrub":"263'739","last_deep_scrub_stamp":"2024-09-12T01:38:24.709738+0000","last_clean_scrub_stamp":"2024-09-12T01:38:24.709738+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":700,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:14.725207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"263'200","reported_seq":759,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:32.916353+0000","last_change":"2024-09-12T01:38:32.916353+0000","last_active":"2024-09-12T01:38:32.916353+0000","last_peered":"2024-09-12T01:38:32.916353+0000","last_clean":"2024-09-12T01:38:32.916353+0000","last_became_active":"2024-09-12T00:28:41.227310+0000","last_became_peered":"2024-09-12T00:28:41.227310+0000","last_unstale":"2024-09-12T01:38:32.916353+0000","last_undegraded":"2024-09-12T01:38:32.916353+0000","last_fullsized":"2024-09-12T01:38:32.916353+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'200","last_scrub_stamp":"2024-09-12T01:38:32.916236+0000","last_deep_scrub":"263'200","last_deep_scrub_stamp":"2024-09-12T01:38:32.916236+0000","last_clean_scrub_stamp":"2024-09-12T01:38:32.916236+0000","objects_scrubbed":6,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:11.385847+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1879,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":313,"num_read_kb":267,"num_write":467,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"263'134","reported_seq":767,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.496591+0000","last_change":"2024-09-12T01:38:17.496539+0000","last_active":"2024-09-12T01:38:17.496591+0000","last_peered":"2024-09-12T01:38:17.496591+0000","last_clean":"2024-09-12T01:38:17.496591+0000","last_became_active":"2024-09-12T00:28:33.211327+0000","last_became_peered":"2024-09-12T00:28:33.211327+0000","last_unstale":"2024-09-12T01:38:17.496591+0000","last_undegraded":"2024-09-12T01:38:17.496591+0000","last_fullsized":"2024-09-12T01:38:17.496591+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'134","last_scrub_stamp":"2024-09-12T01:38:17.496441+0000","last_deep_scrub":"263'134","last_deep_scrub_stamp":"2024-09-12T01:38:17.496441+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.496441+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:31.354433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":621,"num_read_kb":525,"num_write":194,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"263'378","reported_seq":1084,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.492901+0000","last_change":"2024-09-12T01:38:12.492901+0000","last_active":"2024-09-12T01:38:12.492901+0000","last_peered":"2024-09-12T01:38:12.492901+0000","last_clean":"2024-09-12T01:38:12.492901+0000","last_became_active":"2024-09-12T00:28:31.201275+0000","last_became_peered":"2024-09-12T00:28:31.201275+0000","last_unstale":"2024-09-12T01:38:12.492901+0000","last_undegraded":"2024-09-12T01:38:12.492901+0000","last_fullsized":"2024-09-12T01:38:12.492901+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'378","last_scrub_stamp":"2024-09-12T01:38:12.492779+0000","last_deep_scrub":"263'378","last_deep_scrub_stamp":"2024-09-12T01:38:12.492779+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.492779+0000","objects_scrubbed":8,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:39.803942+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395829,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":640,"num_read_kb":30113,"num_write":1190,"num_write_kb":53346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"263'4","reported_seq":1460,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:32.474262+0000","last_change":"2024-09-12T01:38:32.474262+0000","last_active":"2024-09-12T01:38:32.474262+0000","last_peered":"2024-09-12T01:38:32.474262+0000","last_clean":"2024-09-12T01:38:32.474262+0000","last_became_active":"2024-09-12T00:28:35.210173+0000","last_became_peered":"2024-09-12T00:28:35.210173+0000","last_unstale":"2024-09-12T01:38:32.474262+0000","last_undegraded":"2024-09-12T01:38:32.474262+0000","last_fullsized":"2024-09-12T01:38:32.474262+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-12T01:38:32.474172+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-12T01:38:32.474172+0000","last_clean_scrub_stamp":"2024-09-12T01:38:32.474172+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:26.611898+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":952,"num_read_kb":952,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"263'111","reported_seq":652,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:33.345052+0000","last_change":"2024-09-12T01:38:33.345052+0000","last_active":"2024-09-12T01:38:33.345052+0000","last_peered":"2024-09-12T01:38:33.345052+0000","last_clean":"2024-09-12T01:38:33.345052+0000","last_became_active":"2024-09-12T00:28:37.423847+0000","last_became_peered":"2024-09-12T00:28:37.423847+0000","last_unstale":"2024-09-12T01:38:33.345052+0000","last_undegraded":"2024-09-12T01:38:33.345052+0000","last_fullsized":"2024-09-12T01:38:33.345052+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'111","last_scrub_stamp":"2024-09-12T01:38:33.344967+0000","last_deep_scrub":"263'111","last_deep_scrub_stamp":"2024-09-12T01:38:33.344967+0000","last_clean_scrub_stamp":"2024-09-12T01:38:33.344967+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:23.427540+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":109,"num_read_kb":102,"num_write":74,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"263'760","reported_seq":2656,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:26.210045+0000","last_change":"2024-09-12T01:38:26.209968+0000","last_active":"2024-09-12T01:38:26.210045+0000","last_peered":"2024-09-12T01:38:26.210045+0000","last_clean":"2024-09-12T01:38:26.210045+0000","last_became_active":"2024-09-12T00:28:39.216244+0000","last_became_peered":"2024-09-12T00:28:39.216244+0000","last_unstale":"2024-09-12T01:38:26.210045+0000","last_undegraded":"2024-09-12T01:38:26.210045+0000","last_fullsized":"2024-09-12T01:38:26.210045+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'760","last_scrub_stamp":"2024-09-12T01:38:26.209888+0000","last_deep_scrub":"263'760","last_deep_scrub_stamp":"2024-09-12T01:38:26.209888+0000","last_clean_scrub_stamp":"2024-09-12T01:38:26.209888+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:02.637163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"263'177","reported_seq":696,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:40.528122+0000","last_change":"2024-09-12T01:38:40.528122+0000","last_active":"2024-09-12T01:38:40.528122+0000","last_peered":"2024-09-12T01:38:40.528122+0000","last_clean":"2024-09-12T01:38:40.528122+0000","last_became_active":"2024-09-12T00:28:41.225728+0000","last_became_peered":"2024-09-12T00:28:41.225728+0000","last_unstale":"2024-09-12T01:38:40.528122+0000","last_undegraded":"2024-09-12T01:38:40.528122+0000","last_fullsized":"2024-09-12T01:38:40.528122+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'177","last_scrub_stamp":"2024-09-12T01:38:40.528038+0000","last_deep_scrub":"263'177","last_deep_scrub_stamp":"2024-09-12T01:38:40.528038+0000","last_clean_scrub_stamp":"2024-09-12T01:38:40.528038+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:42.089224+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":145,"num_write":308,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"263'4256","reported_seq":4866,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.093864+0000","last_change":"2024-09-12T01:38:20.093799+0000","last_active":"2024-09-12T01:38:20.093864+0000","last_peered":"2024-09-12T01:38:20.093864+0000","last_clean":"2024-09-12T01:38:20.093864+0000","last_became_active":"2024-09-12T00:28:33.205792+0000","last_became_peered":"2024-09-12T00:28:33.205792+0000","last_unstale":"2024-09-12T01:38:20.093864+0000","last_undegraded":"2024-09-12T01:38:20.093864+0000","last_fullsized":"2024-09-12T01:38:20.093864+0000","mapping_epoch":27,"log_start":"263'4200","ondisk_log_start":"263'4200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4256","last_scrub_stamp":"2024-09-12T01:38:20.093696+0000","last_deep_scrub":"263'4256","last_deep_scrub_stamp":"2024-09-12T01:38:20.093696+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.093696+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":3000,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:49.819357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17142,"num_read_kb":14400,"num_write":6430,"num_write_kb":3228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"263'385","reported_seq":1112,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.241283+0000","last_change":"2024-09-12T01:38:10.241283+0000","last_active":"2024-09-12T01:38:10.241283+0000","last_peered":"2024-09-12T01:38:10.241283+0000","last_clean":"2024-09-12T01:38:10.241283+0000","last_became_active":"2024-09-12T00:28:31.202456+0000","last_became_peered":"2024-09-12T00:28:31.202456+0000","last_unstale":"2024-09-12T01:38:10.241283+0000","last_undegraded":"2024-09-12T01:38:10.241283+0000","last_fullsized":"2024-09-12T01:38:10.241283+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'385","last_scrub_stamp":"2024-09-12T01:38:10.241176+0000","last_deep_scrub":"263'385","last_deep_scrub_stamp":"2024-09-12T01:38:10.241176+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.241176+0000","objects_scrubbed":9,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:45.643799+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":651,"num_read_kb":78129,"num_write":1373,"num_write_kb":48684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:29.494509+0000","last_change":"2024-09-12T01:38:29.494509+0000","last_active":"2024-09-12T01:38:29.494509+0000","last_peered":"2024-09-12T01:38:29.494509+0000","last_clean":"2024-09-12T01:38:29.494509+0000","last_became_active":"2024-09-12T00:28:35.207343+0000","last_became_peered":"2024-09-12T00:28:35.207343+0000","last_unstale":"2024-09-12T01:38:29.494509+0000","last_undegraded":"2024-09-12T01:38:29.494509+0000","last_fullsized":"2024-09-12T01:38:29.494509+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:29.494405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:29.494405+0000","last_clean_scrub_stamp":"2024-09-12T01:38:29.494405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:46.288783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"263'377","reported_seq":1004,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.439219+0000","last_change":"2024-09-12T01:38:37.439219+0000","last_active":"2024-09-12T01:38:37.439219+0000","last_peered":"2024-09-12T01:38:37.439219+0000","last_clean":"2024-09-12T01:38:37.439219+0000","last_became_active":"2024-09-12T00:28:37.211090+0000","last_became_peered":"2024-09-12T00:28:37.211090+0000","last_unstale":"2024-09-12T01:38:37.439219+0000","last_undegraded":"2024-09-12T01:38:37.439219+0000","last_fullsized":"2024-09-12T01:38:37.439219+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'377","last_scrub_stamp":"2024-09-12T01:38:37.439113+0000","last_deep_scrub":"263'377","last_deep_scrub_stamp":"2024-09-12T01:38:37.439113+0000","last_clean_scrub_stamp":"2024-09-12T01:38:37.439113+0000","objects_scrubbed":8,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:34.040484+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46480,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":594,"num_read_kb":1224,"num_write":462,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:25.181529+0000","last_change":"2024-09-12T01:38:25.181468+0000","last_active":"2024-09-12T01:38:25.181529+0000","last_peered":"2024-09-12T01:38:25.181529+0000","last_clean":"2024-09-12T01:38:25.181529+0000","last_became_active":"2024-09-12T00:28:39.219687+0000","last_became_peered":"2024-09-12T00:28:39.219687+0000","last_unstale":"2024-09-12T01:38:25.181529+0000","last_undegraded":"2024-09-12T01:38:25.181529+0000","last_fullsized":"2024-09-12T01:38:25.181529+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:25.181379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:25.181379+0000","last_clean_scrub_stamp":"2024-09-12T01:38:25.181379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:32.900668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"263'119","reported_seq":632,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:31.957638+0000","last_change":"2024-09-12T01:38:31.957638+0000","last_active":"2024-09-12T01:38:31.957638+0000","last_peered":"2024-09-12T01:38:31.957638+0000","last_clean":"2024-09-12T01:38:31.957638+0000","last_became_active":"2024-09-12T00:28:41.226049+0000","last_became_peered":"2024-09-12T00:28:41.226049+0000","last_unstale":"2024-09-12T01:38:31.957638+0000","last_undegraded":"2024-09-12T01:38:31.957638+0000","last_fullsized":"2024-09-12T01:38:31.957638+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'119","last_scrub_stamp":"2024-09-12T01:38:31.957547+0000","last_deep_scrub":"263'119","last_deep_scrub_stamp":"2024-09-12T01:38:31.957547+0000","last_clean_scrub_stamp":"2024-09-12T01:38:31.957547+0000","objects_scrubbed":5,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:00.738039+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":871,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":118,"num_read_kb":115,"num_write":279,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"263'144","reported_seq":786,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.138001+0000","last_change":"2024-09-12T01:38:17.138001+0000","last_active":"2024-09-12T01:38:17.138001+0000","last_peered":"2024-09-12T01:38:17.138001+0000","last_clean":"2024-09-12T01:38:17.138001+0000","last_became_active":"2024-09-12T00:28:33.214018+0000","last_became_peered":"2024-09-12T00:28:33.214018+0000","last_unstale":"2024-09-12T01:38:17.138001+0000","last_undegraded":"2024-09-12T01:38:17.138001+0000","last_fullsized":"2024-09-12T01:38:17.138001+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'144","last_scrub_stamp":"2024-09-12T01:38:17.137901+0000","last_deep_scrub":"263'144","last_deep_scrub_stamp":"2024-09-12T01:38:17.137901+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.137901+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:44.770374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":636,"num_read_kb":544,"num_write":220,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"263'74","reported_seq":625,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.264571+0000","last_change":"2024-09-12T01:38:11.264507+0000","last_active":"2024-09-12T01:38:11.264571+0000","last_peered":"2024-09-12T01:38:11.264571+0000","last_clean":"2024-09-12T01:38:11.264571+0000","last_became_active":"2024-09-12T00:28:14.744766+0000","last_became_peered":"2024-09-12T00:28:14.744766+0000","last_unstale":"2024-09-12T01:38:11.264571+0000","last_undegraded":"2024-09-12T01:38:11.264571+0000","last_fullsized":"2024-09-12T01:38:11.264571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'74","last_scrub_stamp":"2024-09-12T01:38:11.264366+0000","last_deep_scrub":"263'74","last_deep_scrub_stamp":"2024-09-12T01:38:11.264366+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.264366+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:33.200544+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"263'2","reported_seq":531,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.265261+0000","last_change":"2024-09-12T01:38:11.265261+0000","last_active":"2024-09-12T01:38:11.265261+0000","last_peered":"2024-09-12T01:38:11.265261+0000","last_clean":"2024-09-12T01:38:11.265261+0000","last_became_active":"2024-09-12T00:28:19.162328+0000","last_became_peered":"2024-09-12T00:28:19.162328+0000","last_unstale":"2024-09-12T01:38:11.265261+0000","last_undegraded":"2024-09-12T01:38:11.265261+0000","last_fullsized":"2024-09-12T01:38:11.265261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:38:11.265179+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:38:11.265179+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.265179+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:49.396121+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00046717800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"263'321","reported_seq":970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:09.261369+0000","last_change":"2024-09-12T01:38:09.261369+0000","last_active":"2024-09-12T01:38:09.261369+0000","last_peered":"2024-09-12T01:38:09.261369+0000","last_clean":"2024-09-12T01:38:09.261369+0000","last_became_active":"2024-09-12T00:28:31.215485+0000","last_became_peered":"2024-09-12T00:28:31.215485+0000","last_unstale":"2024-09-12T01:38:09.261369+0000","last_undegraded":"2024-09-12T01:38:09.261369+0000","last_fullsized":"2024-09-12T01:38:09.261369+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'321","last_scrub_stamp":"2024-09-12T01:38:09.261297+0000","last_deep_scrub":"263'321","last_deep_scrub_stamp":"2024-09-12T01:38:09.261297+0000","last_clean_scrub_stamp":"2024-09-12T01:38:09.261297+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:38.767121+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436935,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":460,"num_read_kb":39194,"num_write":1093,"num_write_kb":25197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:27.434297+0000","last_change":"2024-09-12T01:38:27.434297+0000","last_active":"2024-09-12T01:38:27.434297+0000","last_peered":"2024-09-12T01:38:27.434297+0000","last_clean":"2024-09-12T01:38:27.434297+0000","last_became_active":"2024-09-12T00:28:35.208812+0000","last_became_peered":"2024-09-12T00:28:35.208812+0000","last_unstale":"2024-09-12T01:38:27.434297+0000","last_undegraded":"2024-09-12T01:38:27.434297+0000","last_fullsized":"2024-09-12T01:38:27.434297+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:27.434202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:27.434202+0000","last_clean_scrub_stamp":"2024-09-12T01:38:27.434202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:30.284359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"263'754","reported_seq":1477,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:36.442893+0000","last_change":"2024-09-12T01:38:36.442893+0000","last_active":"2024-09-12T01:38:36.442893+0000","last_peered":"2024-09-12T01:38:36.442893+0000","last_clean":"2024-09-12T01:38:36.442893+0000","last_became_active":"2024-09-12T00:28:37.221001+0000","last_became_peered":"2024-09-12T00:28:37.221001+0000","last_unstale":"2024-09-12T01:38:36.442893+0000","last_undegraded":"2024-09-12T01:38:36.442893+0000","last_fullsized":"2024-09-12T01:38:36.442893+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'754","last_scrub_stamp":"2024-09-12T01:38:36.442784+0000","last_deep_scrub":"263'754","last_deep_scrub_stamp":"2024-09-12T01:38:36.442784+0000","last_clean_scrub_stamp":"2024-09-12T01:38:36.442784+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":700,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:08.801372+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141781,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1456,"num_read_kb":3385,"num_write":1364,"num_write_kb":1192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":90586,"num_omap_keys":220,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:32.185200+0000","last_change":"2024-09-12T01:38:32.185200+0000","last_active":"2024-09-12T01:38:32.185200+0000","last_peered":"2024-09-12T01:38:32.185200+0000","last_clean":"2024-09-12T01:38:32.185200+0000","last_became_active":"2024-09-12T00:28:39.221007+0000","last_became_peered":"2024-09-12T00:28:39.221007+0000","last_unstale":"2024-09-12T01:38:32.185200+0000","last_undegraded":"2024-09-12T01:38:32.185200+0000","last_fullsized":"2024-09-12T01:38:32.185200+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:32.185094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:32.185094+0000","last_clean_scrub_stamp":"2024-09-12T01:38:32.185094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:27.219082+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"263'188","reported_seq":895,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:31.126430+0000","last_change":"2024-09-12T01:38:31.126430+0000","last_active":"2024-09-12T01:38:31.126430+0000","last_peered":"2024-09-12T01:38:31.126430+0000","last_clean":"2024-09-12T01:38:31.126430+0000","last_became_active":"2024-09-12T00:28:41.226077+0000","last_became_peered":"2024-09-12T00:28:41.226077+0000","last_unstale":"2024-09-12T01:38:31.126430+0000","last_undegraded":"2024-09-12T01:38:31.126430+0000","last_fullsized":"2024-09-12T01:38:31.126430+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'188","last_scrub_stamp":"2024-09-12T01:38:31.126335+0000","last_deep_scrub":"263'188","last_deep_scrub_stamp":"2024-09-12T01:38:31.126335+0000","last_clean_scrub_stamp":"2024-09-12T01:38:31.126335+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:42.617212+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":407,"num_read_kb":405,"num_write":366,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"263'200","reported_seq":817,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.045446+0000","last_change":"2024-09-12T01:38:13.045446+0000","last_active":"2024-09-12T01:38:13.045446+0000","last_peered":"2024-09-12T01:38:13.045446+0000","last_clean":"2024-09-12T01:38:13.045446+0000","last_became_active":"2024-09-12T00:28:33.214351+0000","last_became_peered":"2024-09-12T00:28:33.214351+0000","last_unstale":"2024-09-12T01:38:13.045446+0000","last_undegraded":"2024-09-12T01:38:13.045446+0000","last_fullsized":"2024-09-12T01:38:13.045446+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'200","last_scrub_stamp":"2024-09-12T01:38:13.045354+0000","last_deep_scrub":"263'200","last_deep_scrub_stamp":"2024-09-12T01:38:13.045354+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.045354+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:24.710351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":877,"num_read_kb":731,"num_write":291,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":532,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.289897+0000","last_change":"2024-09-12T01:38:13.289843+0000","last_active":"2024-09-12T01:38:13.289897+0000","last_peered":"2024-09-12T01:38:13.289897+0000","last_clean":"2024-09-12T01:38:13.289897+0000","last_became_active":"2024-09-12T00:28:19.164970+0000","last_became_peered":"2024-09-12T00:28:19.164970+0000","last_unstale":"2024-09-12T01:38:13.289897+0000","last_undegraded":"2024-09-12T01:38:13.289897+0000","last_fullsized":"2024-09-12T01:38:13.289897+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:13.289759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:13.289759+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.289759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:35.748664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055291100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"263'381","reported_seq":1121,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:08.100822+0000","last_change":"2024-09-12T01:38:08.100822+0000","last_active":"2024-09-12T01:38:08.100822+0000","last_peered":"2024-09-12T01:38:08.100822+0000","last_clean":"2024-09-12T01:38:08.100822+0000","last_became_active":"2024-09-12T00:28:31.204842+0000","last_became_peered":"2024-09-12T00:28:31.204842+0000","last_unstale":"2024-09-12T01:38:08.100822+0000","last_undegraded":"2024-09-12T01:38:08.100822+0000","last_fullsized":"2024-09-12T01:38:08.100822+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'381","last_scrub_stamp":"2024-09-12T01:38:08.100667+0000","last_deep_scrub":"263'381","last_deep_scrub_stamp":"2024-09-12T01:38:08.100667+0000","last_clean_scrub_stamp":"2024-09-12T01:38:08.100667+0000","objects_scrubbed":9,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:45.468456+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":699,"num_read_kb":44079,"num_write":1206,"num_write_kb":29123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:30.485847+0000","last_change":"2024-09-12T01:38:30.485847+0000","last_active":"2024-09-12T01:38:30.485847+0000","last_peered":"2024-09-12T01:38:30.485847+0000","last_clean":"2024-09-12T01:38:30.485847+0000","last_became_active":"2024-09-12T00:28:35.215063+0000","last_became_peered":"2024-09-12T00:28:35.215063+0000","last_unstale":"2024-09-12T01:38:30.485847+0000","last_undegraded":"2024-09-12T01:38:30.485847+0000","last_fullsized":"2024-09-12T01:38:30.485847+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:30.485747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:30.485747+0000","last_clean_scrub_stamp":"2024-09-12T01:38:30.485747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:05.406878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"263'1369","reported_seq":3172,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:27.034886+0000","last_change":"2024-09-12T01:38:27.034886+0000","last_active":"2024-09-12T01:38:27.034886+0000","last_peered":"2024-09-12T01:38:27.034886+0000","last_clean":"2024-09-12T01:38:27.034886+0000","last_became_active":"2024-09-12T00:28:37.211275+0000","last_became_peered":"2024-09-12T00:28:37.211275+0000","last_unstale":"2024-09-12T01:38:27.034886+0000","last_undegraded":"2024-09-12T01:38:27.034886+0000","last_fullsized":"2024-09-12T01:38:27.034886+0000","mapping_epoch":31,"log_start":"263'1300","ondisk_log_start":"263'1300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1369","last_scrub_stamp":"2024-09-12T01:38:27.034773+0000","last_deep_scrub":"263'1369","last_deep_scrub_stamp":"2024-09-12T01:38:27.034773+0000","last_clean_scrub_stamp":"2024-09-12T01:38:27.034773+0000","objects_scrubbed":12,"log_size":69,"log_dups_size":1300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:21.739062+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145911,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2184,"num_read_kb":4297,"num_write":1290,"num_write_kb":1091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.528471+0000","last_change":"2024-09-12T01:38:38.528471+0000","last_active":"2024-09-12T01:38:38.528471+0000","last_peered":"2024-09-12T01:38:38.528471+0000","last_clean":"2024-09-12T01:38:38.528471+0000","last_became_active":"2024-09-12T00:28:39.217623+0000","last_became_peered":"2024-09-12T00:28:39.217623+0000","last_unstale":"2024-09-12T01:38:38.528471+0000","last_undegraded":"2024-09-12T01:38:38.528471+0000","last_fullsized":"2024-09-12T01:38:38.528471+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:38.528383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:38.528383+0000","last_clean_scrub_stamp":"2024-09-12T01:38:38.528383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:06.478079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"263'263","reported_seq":816,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:33.895494+0000","last_change":"2024-09-12T01:38:33.895494+0000","last_active":"2024-09-12T01:38:33.895494+0000","last_peered":"2024-09-12T01:38:33.895494+0000","last_clean":"2024-09-12T01:38:33.895494+0000","last_became_active":"2024-09-12T00:28:41.254814+0000","last_became_peered":"2024-09-12T00:28:41.254814+0000","last_unstale":"2024-09-12T01:38:33.895494+0000","last_undegraded":"2024-09-12T01:38:33.895494+0000","last_fullsized":"2024-09-12T01:38:33.895494+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'263","last_scrub_stamp":"2024-09-12T01:38:33.895407+0000","last_deep_scrub":"263'263","last_deep_scrub_stamp":"2024-09-12T01:38:33.895407+0000","last_clean_scrub_stamp":"2024-09-12T01:38:33.895407+0000","objects_scrubbed":2,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:10.866925+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":416,"num_read_kb":400,"num_write":581,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"263'116","reported_seq":762,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.044813+0000","last_change":"2024-09-12T01:38:19.044813+0000","last_active":"2024-09-12T01:38:19.044813+0000","last_peered":"2024-09-12T01:38:19.044813+0000","last_clean":"2024-09-12T01:38:19.044813+0000","last_became_active":"2024-09-12T00:28:33.216335+0000","last_became_peered":"2024-09-12T00:28:33.216335+0000","last_unstale":"2024-09-12T01:38:19.044813+0000","last_undegraded":"2024-09-12T01:38:19.044813+0000","last_fullsized":"2024-09-12T01:38:19.044813+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'116","last_scrub_stamp":"2024-09-12T01:38:19.044713+0000","last_deep_scrub":"263'116","last_deep_scrub_stamp":"2024-09-12T01:38:19.044713+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.044713+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:33.501842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":537,"num_read_kb":460,"num_write":159,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":536,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:07.840574+0000","last_change":"2024-09-12T01:38:07.840574+0000","last_active":"2024-09-12T01:38:07.840574+0000","last_peered":"2024-09-12T01:38:07.840574+0000","last_clean":"2024-09-12T01:38:07.840574+0000","last_became_active":"2024-09-12T00:28:19.225901+0000","last_became_peered":"2024-09-12T00:28:19.225901+0000","last_unstale":"2024-09-12T01:38:07.840574+0000","last_undegraded":"2024-09-12T01:38:07.840574+0000","last_fullsized":"2024-09-12T01:38:07.840574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:07.840493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:07.840493+0000","last_clean_scrub_stamp":"2024-09-12T01:38:07.840493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:17.786493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032319500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"263'346","reported_seq":1154,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:08.229237+0000","last_change":"2024-09-12T01:38:08.229143+0000","last_active":"2024-09-12T01:38:08.229237+0000","last_peered":"2024-09-12T01:38:08.229237+0000","last_clean":"2024-09-12T01:38:08.229237+0000","last_became_active":"2024-09-12T00:28:31.198575+0000","last_became_peered":"2024-09-12T00:28:31.198575+0000","last_unstale":"2024-09-12T01:38:08.229237+0000","last_undegraded":"2024-09-12T01:38:08.229237+0000","last_fullsized":"2024-09-12T01:38:08.229237+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'346","last_scrub_stamp":"2024-09-12T01:38:08.229006+0000","last_deep_scrub":"263'346","last_deep_scrub_stamp":"2024-09-12T01:38:08.229006+0000","last_clean_scrub_stamp":"2024-09-12T01:38:08.229006+0000","objects_scrubbed":9,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:39.417199+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3941571,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":832,"num_read_kb":78199,"num_write":1073,"num_write_kb":40255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"263'2","reported_seq":514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.734864+0000","last_change":"2024-09-12T01:38:13.734864+0000","last_active":"2024-09-12T01:38:13.734864+0000","last_peered":"2024-09-12T01:38:13.734864+0000","last_clean":"2024-09-12T01:38:13.734864+0000","last_became_active":"2024-09-12T00:28:35.209218+0000","last_became_peered":"2024-09-12T00:28:35.209218+0000","last_unstale":"2024-09-12T01:38:13.734864+0000","last_undegraded":"2024-09-12T01:38:13.734864+0000","last_fullsized":"2024-09-12T01:38:13.734864+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:38:13.734781+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:38:13.734781+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.734781+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:29.932696+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"263'288","reported_seq":1675,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:32.372392+0000","last_change":"2024-09-12T01:38:32.372392+0000","last_active":"2024-09-12T01:38:32.372392+0000","last_peered":"2024-09-12T01:38:32.372392+0000","last_clean":"2024-09-12T01:38:32.372392+0000","last_became_active":"2024-09-12T00:28:37.423714+0000","last_became_peered":"2024-09-12T00:28:37.423714+0000","last_unstale":"2024-09-12T01:38:32.372392+0000","last_undegraded":"2024-09-12T01:38:32.372392+0000","last_fullsized":"2024-09-12T01:38:32.372392+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'288","last_scrub_stamp":"2024-09-12T01:38:32.372285+0000","last_deep_scrub":"263'288","last_deep_scrub_stamp":"2024-09-12T01:38:32.372285+0000","last_clean_scrub_stamp":"2024-09-12T01:38:32.372285+0000","objects_scrubbed":9,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:50.426218+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":244,"num_read_kb":234,"num_write":227,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5400,"num_omap_keys":12,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:31.155694+0000","last_change":"2024-09-12T01:38:31.155694+0000","last_active":"2024-09-12T01:38:31.155694+0000","last_peered":"2024-09-12T01:38:31.155694+0000","last_clean":"2024-09-12T01:38:31.155694+0000","last_became_active":"2024-09-12T00:28:39.218692+0000","last_became_peered":"2024-09-12T00:28:39.218692+0000","last_unstale":"2024-09-12T01:38:31.155694+0000","last_undegraded":"2024-09-12T01:38:31.155694+0000","last_fullsized":"2024-09-12T01:38:31.155694+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:31.155598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:31.155598+0000","last_clean_scrub_stamp":"2024-09-12T01:38:31.155598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:44.466356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"263'254","reported_seq":866,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:45.359267+0000","last_change":"2024-09-12T01:38:45.359267+0000","last_active":"2024-09-12T01:38:45.359267+0000","last_peered":"2024-09-12T01:38:45.359267+0000","last_clean":"2024-09-12T01:38:45.359267+0000","last_became_active":"2024-09-12T00:28:41.229441+0000","last_became_peered":"2024-09-12T00:28:41.229441+0000","last_unstale":"2024-09-12T01:38:45.359267+0000","last_undegraded":"2024-09-12T01:38:45.359267+0000","last_fullsized":"2024-09-12T01:38:45.359267+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'254","last_scrub_stamp":"2024-09-12T01:38:45.359172+0000","last_deep_scrub":"263'254","last_deep_scrub_stamp":"2024-09-12T01:38:45.359172+0000","last_clean_scrub_stamp":"2024-09-12T01:38:45.359172+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:18.672581+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":487,"num_read_kb":509,"num_write":546,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"263'224","reported_seq":905,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.182019+0000","last_change":"2024-09-12T01:38:14.182019+0000","last_active":"2024-09-12T01:38:14.182019+0000","last_peered":"2024-09-12T01:38:14.182019+0000","last_clean":"2024-09-12T01:38:14.182019+0000","last_became_active":"2024-09-12T00:28:33.205107+0000","last_became_peered":"2024-09-12T00:28:33.205107+0000","last_unstale":"2024-09-12T01:38:14.182019+0000","last_undegraded":"2024-09-12T01:38:14.182019+0000","last_fullsized":"2024-09-12T01:38:14.182019+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'224","last_scrub_stamp":"2024-09-12T01:38:14.181928+0000","last_deep_scrub":"263'224","last_deep_scrub_stamp":"2024-09-12T01:38:14.181928+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.181928+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:53.395317+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1021,"num_read_kb":847,"num_write":335,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":465,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"263'3","reported_seq":532,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:09.217929+0000","last_change":"2024-09-12T01:38:09.217929+0000","last_active":"2024-09-12T01:38:09.217929+0000","last_peered":"2024-09-12T01:38:09.217929+0000","last_clean":"2024-09-12T01:38:09.217929+0000","last_became_active":"2024-09-12T00:28:19.162307+0000","last_became_peered":"2024-09-12T00:28:19.162307+0000","last_unstale":"2024-09-12T01:38:09.217929+0000","last_undegraded":"2024-09-12T01:38:09.217929+0000","last_fullsized":"2024-09-12T01:38:09.217929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-12T01:38:09.217852+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-12T01:38:09.217852+0000","last_clean_scrub_stamp":"2024-09-12T01:38:09.217852+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:31.504965+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00089189499999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"263'359","reported_seq":1051,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:08.508023+0000","last_change":"2024-09-12T01:38:08.508023+0000","last_active":"2024-09-12T01:38:08.508023+0000","last_peered":"2024-09-12T01:38:08.508023+0000","last_clean":"2024-09-12T01:38:08.508023+0000","last_became_active":"2024-09-12T00:28:31.208584+0000","last_became_peered":"2024-09-12T00:28:31.208584+0000","last_unstale":"2024-09-12T01:38:08.508023+0000","last_undegraded":"2024-09-12T01:38:08.508023+0000","last_fullsized":"2024-09-12T01:38:08.508023+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'359","last_scrub_stamp":"2024-09-12T01:38:08.507897+0000","last_deep_scrub":"263'359","last_deep_scrub_stamp":"2024-09-12T01:38:08.507897+0000","last_clean_scrub_stamp":"2024-09-12T01:38:08.507897+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:25.206563+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262163,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":641,"num_read_kb":7750,"num_write":1122,"num_write_kb":19514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:33.223461+0000","last_change":"2024-09-12T01:38:33.223461+0000","last_active":"2024-09-12T01:38:33.223461+0000","last_peered":"2024-09-12T01:38:33.223461+0000","last_clean":"2024-09-12T01:38:33.223461+0000","last_became_active":"2024-09-12T00:28:35.207234+0000","last_became_peered":"2024-09-12T00:28:35.207234+0000","last_unstale":"2024-09-12T01:38:33.223461+0000","last_undegraded":"2024-09-12T01:38:33.223461+0000","last_fullsized":"2024-09-12T01:38:33.223461+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:33.223375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:33.223375+0000","last_clean_scrub_stamp":"2024-09-12T01:38:33.223375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:23.217201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"263'167","reported_seq":732,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:32.352500+0000","last_change":"2024-09-12T01:38:32.352500+0000","last_active":"2024-09-12T01:38:32.352500+0000","last_peered":"2024-09-12T01:38:32.352500+0000","last_clean":"2024-09-12T01:38:32.352500+0000","last_became_active":"2024-09-12T00:28:37.219599+0000","last_became_peered":"2024-09-12T00:28:37.219599+0000","last_unstale":"2024-09-12T01:38:32.352500+0000","last_undegraded":"2024-09-12T01:38:32.352500+0000","last_fullsized":"2024-09-12T01:38:32.352500+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'167","last_scrub_stamp":"2024-09-12T01:38:32.352382+0000","last_deep_scrub":"263'167","last_deep_scrub_stamp":"2024-09-12T01:38:32.352382+0000","last_clean_scrub_stamp":"2024-09-12T01:38:32.352382+0000","objects_scrubbed":7,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:57.832189+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":184,"num_read_kb":176,"num_write":136,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3358,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:36.068291+0000","last_change":"2024-09-12T01:38:36.068291+0000","last_active":"2024-09-12T01:38:36.068291+0000","last_peered":"2024-09-12T01:38:36.068291+0000","last_clean":"2024-09-12T01:38:36.068291+0000","last_became_active":"2024-09-12T00:28:39.216397+0000","last_became_peered":"2024-09-12T00:28:39.216397+0000","last_unstale":"2024-09-12T01:38:36.068291+0000","last_undegraded":"2024-09-12T01:38:36.068291+0000","last_fullsized":"2024-09-12T01:38:36.068291+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:36.068187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:36.068187+0000","last_clean_scrub_stamp":"2024-09-12T01:38:36.068187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:58.308228+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"263'110","reported_seq":663,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:43.482660+0000","last_change":"2024-09-12T01:38:43.482660+0000","last_active":"2024-09-12T01:38:43.482660+0000","last_peered":"2024-09-12T01:38:43.482660+0000","last_clean":"2024-09-12T01:38:43.482660+0000","last_became_active":"2024-09-12T00:28:41.230698+0000","last_became_peered":"2024-09-12T00:28:41.230698+0000","last_unstale":"2024-09-12T01:38:43.482660+0000","last_undegraded":"2024-09-12T01:38:43.482660+0000","last_fullsized":"2024-09-12T01:38:43.482660+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'110","last_scrub_stamp":"2024-09-12T01:38:43.482572+0000","last_deep_scrub":"263'110","last_deep_scrub_stamp":"2024-09-12T01:38:43.482572+0000","last_clean_scrub_stamp":"2024-09-12T01:38:43.482572+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:32.770121+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":194,"num_write":246,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"263'101","reported_seq":695,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.032734+0000","last_change":"2024-09-12T01:38:18.032734+0000","last_active":"2024-09-12T01:38:18.032734+0000","last_peered":"2024-09-12T01:38:18.032734+0000","last_clean":"2024-09-12T01:38:18.032734+0000","last_became_active":"2024-09-12T00:28:33.213241+0000","last_became_peered":"2024-09-12T00:28:33.213241+0000","last_unstale":"2024-09-12T01:38:18.032734+0000","last_undegraded":"2024-09-12T01:38:18.032734+0000","last_fullsized":"2024-09-12T01:38:18.032734+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'101","last_scrub_stamp":"2024-09-12T01:38:18.032630+0000","last_deep_scrub":"263'101","last_deep_scrub_stamp":"2024-09-12T01:38:18.032630+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.032630+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:48.287686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":440,"num_read_kb":364,"num_write":181,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"263'335","reported_seq":959,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.220801+0000","last_change":"2024-09-12T01:38:10.220801+0000","last_active":"2024-09-12T01:38:10.220801+0000","last_peered":"2024-09-12T01:38:10.220801+0000","last_clean":"2024-09-12T01:38:10.220801+0000","last_became_active":"2024-09-12T00:28:31.209154+0000","last_became_peered":"2024-09-12T00:28:31.209154+0000","last_unstale":"2024-09-12T01:38:10.220801+0000","last_undegraded":"2024-09-12T01:38:10.220801+0000","last_fullsized":"2024-09-12T01:38:10.220801+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'335","last_scrub_stamp":"2024-09-12T01:38:10.220717+0000","last_deep_scrub":"263'335","last_deep_scrub_stamp":"2024-09-12T01:38:10.220717+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.220717+0000","objects_scrubbed":6,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:59.487021+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":854338,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":445,"num_read_kb":910,"num_write":1009,"num_write_kb":5944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":541,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.186088+0000","last_change":"2024-09-12T01:38:10.186088+0000","last_active":"2024-09-12T01:38:10.186088+0000","last_peered":"2024-09-12T01:38:10.186088+0000","last_clean":"2024-09-12T01:38:10.186088+0000","last_became_active":"2024-09-12T00:28:19.383394+0000","last_became_peered":"2024-09-12T00:28:19.383394+0000","last_unstale":"2024-09-12T01:38:10.186088+0000","last_undegraded":"2024-09-12T01:38:10.186088+0000","last_fullsized":"2024-09-12T01:38:10.186088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.186021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.186021+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.186021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:10.372021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046548800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:30.136109+0000","last_change":"2024-09-12T01:38:30.136109+0000","last_active":"2024-09-12T01:38:30.136109+0000","last_peered":"2024-09-12T01:38:30.136109+0000","last_clean":"2024-09-12T01:38:30.136109+0000","last_became_active":"2024-09-12T00:28:35.208094+0000","last_became_peered":"2024-09-12T00:28:35.208094+0000","last_unstale":"2024-09-12T01:38:30.136109+0000","last_undegraded":"2024-09-12T01:38:30.136109+0000","last_fullsized":"2024-09-12T01:38:30.136109+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:30.136033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:30.136033+0000","last_clean_scrub_stamp":"2024-09-12T01:38:30.136033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:36.139933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"263'664","reported_seq":1366,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:24.148699+0000","last_change":"2024-09-12T01:38:24.148638+0000","last_active":"2024-09-12T01:38:24.148699+0000","last_peered":"2024-09-12T01:38:24.148699+0000","last_clean":"2024-09-12T01:38:24.148699+0000","last_became_active":"2024-09-12T00:28:37.220158+0000","last_became_peered":"2024-09-12T00:28:37.220158+0000","last_unstale":"2024-09-12T01:38:24.148699+0000","last_undegraded":"2024-09-12T01:38:24.148699+0000","last_fullsized":"2024-09-12T01:38:24.148699+0000","mapping_epoch":31,"log_start":"263'600","ondisk_log_start":"263'600","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'664","last_scrub_stamp":"2024-09-12T01:38:24.148534+0000","last_deep_scrub":"263'664","last_deep_scrub_stamp":"2024-09-12T01:38:24.148534+0000","last_clean_scrub_stamp":"2024-09-12T01:38:24.148534+0000","objects_scrubbed":11,"log_size":64,"log_dups_size":600,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:38.824218+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103952,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1701,"num_read_kb":3039,"num_write":2184,"num_write_kb":1992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":500702,"num_omap_keys":1132,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.513767+0000","last_change":"2024-09-12T01:38:37.513767+0000","last_active":"2024-09-12T01:38:37.513767+0000","last_peered":"2024-09-12T01:38:37.513767+0000","last_clean":"2024-09-12T01:38:37.513767+0000","last_became_active":"2024-09-12T00:28:39.220079+0000","last_became_peered":"2024-09-12T00:28:39.220079+0000","last_unstale":"2024-09-12T01:38:37.513767+0000","last_undegraded":"2024-09-12T01:38:37.513767+0000","last_fullsized":"2024-09-12T01:38:37.513767+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:37.513687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:37.513687+0000","last_clean_scrub_stamp":"2024-09-12T01:38:37.513687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:54.862533+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"263'137","reported_seq":665,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:43.197697+0000","last_change":"2024-09-12T01:38:43.197697+0000","last_active":"2024-09-12T01:38:43.197697+0000","last_peered":"2024-09-12T01:38:43.197697+0000","last_clean":"2024-09-12T01:38:43.197697+0000","last_became_active":"2024-09-12T00:28:41.257739+0000","last_became_peered":"2024-09-12T00:28:41.257739+0000","last_unstale":"2024-09-12T01:38:43.197697+0000","last_undegraded":"2024-09-12T01:38:43.197697+0000","last_fullsized":"2024-09-12T01:38:43.197697+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'137","last_scrub_stamp":"2024-09-12T01:38:43.197610+0000","last_deep_scrub":"263'137","last_deep_scrub_stamp":"2024-09-12T01:38:43.197610+0000","last_clean_scrub_stamp":"2024-09-12T01:38:43.197610+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:16.433171+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":203,"num_read_kb":182,"num_write":334,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"263'142","reported_seq":783,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.185063+0000","last_change":"2024-09-12T01:38:22.185063+0000","last_active":"2024-09-12T01:38:22.185063+0000","last_peered":"2024-09-12T01:38:22.185063+0000","last_clean":"2024-09-12T01:38:22.185063+0000","last_became_active":"2024-09-12T00:28:33.216065+0000","last_became_peered":"2024-09-12T00:28:33.216065+0000","last_unstale":"2024-09-12T01:38:22.185063+0000","last_undegraded":"2024-09-12T01:38:22.185063+0000","last_fullsized":"2024-09-12T01:38:22.185063+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'142","last_scrub_stamp":"2024-09-12T01:38:22.184985+0000","last_deep_scrub":"263'142","last_deep_scrub_stamp":"2024-09-12T01:38:22.184985+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.184985+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:25.280489+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":614,"num_read_kb":525,"num_write":208,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"263'345","reported_seq":1013,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:09.220565+0000","last_change":"2024-09-12T01:38:09.220565+0000","last_active":"2024-09-12T01:38:09.220565+0000","last_peered":"2024-09-12T01:38:09.220565+0000","last_clean":"2024-09-12T01:38:09.220565+0000","last_became_active":"2024-09-12T00:28:31.198681+0000","last_became_peered":"2024-09-12T00:28:31.198681+0000","last_unstale":"2024-09-12T01:38:09.220565+0000","last_undegraded":"2024-09-12T01:38:09.220565+0000","last_fullsized":"2024-09-12T01:38:09.220565+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'345","last_scrub_stamp":"2024-09-12T01:38:09.220489+0000","last_deep_scrub":"263'345","last_deep_scrub_stamp":"2024-09-12T01:38:09.220489+0000","last_clean_scrub_stamp":"2024-09-12T01:38:09.220489+0000","objects_scrubbed":5,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:20.626502+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550835,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":482,"num_read_kb":38182,"num_write":1051,"num_write_kb":26889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":530,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.230605+0000","last_change":"2024-09-12T01:38:10.230605+0000","last_active":"2024-09-12T01:38:10.230605+0000","last_peered":"2024-09-12T01:38:10.230605+0000","last_clean":"2024-09-12T01:38:10.230605+0000","last_became_active":"2024-09-12T00:28:19.384222+0000","last_became_peered":"2024-09-12T00:28:19.384222+0000","last_unstale":"2024-09-12T01:38:10.230605+0000","last_undegraded":"2024-09-12T01:38:10.230605+0000","last_fullsized":"2024-09-12T01:38:10.230605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.230512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.230512+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.230512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:30.488629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060999899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"263'6","reported_seq":991,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.212001+0000","last_change":"2024-09-12T01:38:21.212001+0000","last_active":"2024-09-12T01:38:21.212001+0000","last_peered":"2024-09-12T01:38:21.212001+0000","last_clean":"2024-09-12T01:38:21.212001+0000","last_became_active":"2024-09-12T00:28:35.207941+0000","last_became_peered":"2024-09-12T00:28:35.207941+0000","last_unstale":"2024-09-12T01:38:21.212001+0000","last_undegraded":"2024-09-12T01:38:21.212001+0000","last_fullsized":"2024-09-12T01:38:21.212001+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-12T01:38:21.211920+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-12T01:38:21.211920+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.211920+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:16.655918+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":1191,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"263'255","reported_seq":856,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:29.008482+0000","last_change":"2024-09-12T01:38:29.008482+0000","last_active":"2024-09-12T01:38:29.008482+0000","last_peered":"2024-09-12T01:38:29.008482+0000","last_clean":"2024-09-12T01:38:29.008482+0000","last_became_active":"2024-09-12T00:28:37.423835+0000","last_became_peered":"2024-09-12T00:28:37.423835+0000","last_unstale":"2024-09-12T01:38:29.008482+0000","last_undegraded":"2024-09-12T01:38:29.008482+0000","last_fullsized":"2024-09-12T01:38:29.008482+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'255","last_scrub_stamp":"2024-09-12T01:38:29.008384+0000","last_deep_scrub":"263'255","last_deep_scrub_stamp":"2024-09-12T01:38:29.008384+0000","last_clean_scrub_stamp":"2024-09-12T01:38:29.008384+0000","objects_scrubbed":9,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:41.255615+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":310,"num_read_kb":301,"num_write":288,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6272,"num_omap_keys":14,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"263'782","reported_seq":2906,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:41.412386+0000","last_change":"2024-09-12T01:38:41.412319+0000","last_active":"2024-09-12T01:38:41.412386+0000","last_peered":"2024-09-12T01:38:41.412386+0000","last_clean":"2024-09-12T01:38:41.412386+0000","last_became_active":"2024-09-12T00:28:39.214050+0000","last_became_peered":"2024-09-12T00:28:39.214050+0000","last_unstale":"2024-09-12T01:38:41.412386+0000","last_undegraded":"2024-09-12T01:38:41.412386+0000","last_fullsized":"2024-09-12T01:38:41.412386+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'782","last_scrub_stamp":"2024-09-12T01:38:41.412225+0000","last_deep_scrub":"263'782","last_deep_scrub_stamp":"2024-09-12T01:38:41.412225+0000","last_clean_scrub_stamp":"2024-09-12T01:38:41.412225+0000","objects_scrubbed":1,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:41.656900+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"263'149","reported_seq":671,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:46.340927+0000","last_change":"2024-09-12T01:38:46.340927+0000","last_active":"2024-09-12T01:38:46.340927+0000","last_peered":"2024-09-12T01:38:46.340927+0000","last_clean":"2024-09-12T01:38:46.340927+0000","last_became_active":"2024-09-12T00:28:41.254826+0000","last_became_peered":"2024-09-12T00:28:41.254826+0000","last_unstale":"2024-09-12T01:38:46.340927+0000","last_undegraded":"2024-09-12T01:38:46.340927+0000","last_fullsized":"2024-09-12T01:38:46.340927+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'149","last_scrub_stamp":"2024-09-12T01:38:46.340827+0000","last_deep_scrub":"263'149","last_deep_scrub_stamp":"2024-09-12T01:38:46.340827+0000","last_clean_scrub_stamp":"2024-09-12T01:38:46.340827+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:46.908185+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1298,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":177,"num_read_kb":162,"num_write":341,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"263'307","reported_seq":919,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:26.301083+0000","last_change":"2024-09-12T01:38:26.300995+0000","last_active":"2024-09-12T01:38:26.301083+0000","last_peered":"2024-09-12T01:38:26.301083+0000","last_clean":"2024-09-12T01:38:26.301083+0000","last_became_active":"2024-09-12T00:28:33.217516+0000","last_became_peered":"2024-09-12T00:28:33.217516+0000","last_unstale":"2024-09-12T01:38:26.301083+0000","last_undegraded":"2024-09-12T01:38:26.301083+0000","last_fullsized":"2024-09-12T01:38:26.301083+0000","mapping_epoch":27,"log_start":"260'200","ondisk_log_start":"260'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'307","last_scrub_stamp":"2024-09-12T01:38:26.300887+0000","last_deep_scrub":"263'307","last_deep_scrub_stamp":"2024-09-12T01:38:26.300887+0000","last_clean_scrub_stamp":"2024-09-12T01:38:26.300887+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:46.021127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1312,"num_read_kb":1045,"num_write":501,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"263'312","reported_seq":914,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:08.232707+0000","last_change":"2024-09-12T01:38:08.232707+0000","last_active":"2024-09-12T01:38:08.232707+0000","last_peered":"2024-09-12T01:38:08.232707+0000","last_clean":"2024-09-12T01:38:08.232707+0000","last_became_active":"2024-09-12T00:28:31.202895+0000","last_became_peered":"2024-09-12T00:28:31.202895+0000","last_unstale":"2024-09-12T01:38:08.232707+0000","last_undegraded":"2024-09-12T01:38:08.232707+0000","last_fullsized":"2024-09-12T01:38:08.232707+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'312","last_scrub_stamp":"2024-09-12T01:38:08.232586+0000","last_deep_scrub":"263'312","last_deep_scrub_stamp":"2024-09-12T01:38:08.232586+0000","last_clean_scrub_stamp":"2024-09-12T01:38:08.232586+0000","objects_scrubbed":7,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:08.573915+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262178,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":365,"num_read_kb":358,"num_write":953,"num_write_kb":25812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":540,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:07.216544+0000","last_change":"2024-09-12T01:38:07.216544+0000","last_active":"2024-09-12T01:38:07.216544+0000","last_peered":"2024-09-12T01:38:07.216544+0000","last_clean":"2024-09-12T01:38:07.216544+0000","last_became_active":"2024-09-12T00:28:19.160344+0000","last_became_peered":"2024-09-12T00:28:19.160344+0000","last_unstale":"2024-09-12T01:38:07.216544+0000","last_undegraded":"2024-09-12T01:38:07.216544+0000","last_fullsized":"2024-09-12T01:38:07.216544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:07.216476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:07.216476+0000","last_clean_scrub_stamp":"2024-09-12T01:38:07.216476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:01.774688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000483707,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":512,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:28.486392+0000","last_change":"2024-09-12T01:38:28.486392+0000","last_active":"2024-09-12T01:38:28.486392+0000","last_peered":"2024-09-12T01:38:28.486392+0000","last_clean":"2024-09-12T01:38:28.486392+0000","last_became_active":"2024-09-12T00:28:35.215429+0000","last_became_peered":"2024-09-12T00:28:35.215429+0000","last_unstale":"2024-09-12T01:38:28.486392+0000","last_undegraded":"2024-09-12T01:38:28.486392+0000","last_fullsized":"2024-09-12T01:38:28.486392+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:28.486306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:28.486306+0000","last_clean_scrub_stamp":"2024-09-12T01:38:28.486306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:36.724669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"263'136","reported_seq":701,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:31.537832+0000","last_change":"2024-09-12T01:38:31.537832+0000","last_active":"2024-09-12T01:38:31.537832+0000","last_peered":"2024-09-12T01:38:31.537832+0000","last_clean":"2024-09-12T01:38:31.537832+0000","last_became_active":"2024-09-12T00:28:37.219746+0000","last_became_peered":"2024-09-12T00:28:37.219746+0000","last_unstale":"2024-09-12T01:38:31.537832+0000","last_undegraded":"2024-09-12T01:38:31.537832+0000","last_fullsized":"2024-09-12T01:38:31.537832+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'136","last_scrub_stamp":"2024-09-12T01:38:31.537717+0000","last_deep_scrub":"263'136","last_deep_scrub_stamp":"2024-09-12T01:38:31.537717+0000","last_clean_scrub_stamp":"2024-09-12T01:38:31.537717+0000","objects_scrubbed":6,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:10.135264+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":158,"num_read_kb":152,"num_write":104,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"263'770","reported_seq":2693,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:42.330443+0000","last_change":"2024-09-12T01:38:42.330443+0000","last_active":"2024-09-12T01:38:42.330443+0000","last_peered":"2024-09-12T01:38:42.330443+0000","last_clean":"2024-09-12T01:38:42.330443+0000","last_became_active":"2024-09-12T00:28:39.218170+0000","last_became_peered":"2024-09-12T00:28:39.218170+0000","last_unstale":"2024-09-12T01:38:42.330443+0000","last_undegraded":"2024-09-12T01:38:42.330443+0000","last_fullsized":"2024-09-12T01:38:42.330443+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'770","last_scrub_stamp":"2024-09-12T01:38:42.330341+0000","last_deep_scrub":"263'770","last_deep_scrub_stamp":"2024-09-12T01:38:42.330341+0000","last_clean_scrub_stamp":"2024-09-12T01:38:42.330341+0000","objects_scrubbed":1,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:59.497009+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"263'184","reported_seq":692,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:42.205417+0000","last_change":"2024-09-12T01:38:42.205417+0000","last_active":"2024-09-12T01:38:42.205417+0000","last_peered":"2024-09-12T01:38:42.205417+0000","last_clean":"2024-09-12T01:38:42.205417+0000","last_became_active":"2024-09-12T00:28:41.225316+0000","last_became_peered":"2024-09-12T00:28:41.225316+0000","last_unstale":"2024-09-12T01:38:42.205417+0000","last_undegraded":"2024-09-12T01:38:42.205417+0000","last_fullsized":"2024-09-12T01:38:42.205417+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'184","last_scrub_stamp":"2024-09-12T01:38:42.205295+0000","last_deep_scrub":"263'184","last_deep_scrub_stamp":"2024-09-12T01:38:42.205295+0000","last_clean_scrub_stamp":"2024-09-12T01:38:42.205295+0000","objects_scrubbed":3,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:55:54.093132+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":127,"num_read_kb":125,"num_write":428,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"263'343","reported_seq":987,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.498869+0000","last_change":"2024-09-12T01:38:20.498869+0000","last_active":"2024-09-12T01:38:20.498869+0000","last_peered":"2024-09-12T01:38:20.498869+0000","last_clean":"2024-09-12T01:38:20.498869+0000","last_became_active":"2024-09-12T00:28:33.212624+0000","last_became_peered":"2024-09-12T00:28:33.212624+0000","last_unstale":"2024-09-12T01:38:20.498869+0000","last_undegraded":"2024-09-12T01:38:20.498869+0000","last_fullsized":"2024-09-12T01:38:20.498869+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'343","last_scrub_stamp":"2024-09-12T01:38:20.498766+0000","last_deep_scrub":"263'343","last_deep_scrub_stamp":"2024-09-12T01:38:20.498766+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.498766+0000","objects_scrubbed":1,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:22.317000+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1481,"num_read_kb":1196,"num_write":544,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8074,"num_omap_keys":32,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"263'460","reported_seq":1183,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:07.124158+0000","last_change":"2024-09-12T01:38:07.124158+0000","last_active":"2024-09-12T01:38:07.124158+0000","last_peered":"2024-09-12T01:38:07.124158+0000","last_clean":"2024-09-12T01:38:07.124158+0000","last_became_active":"2024-09-12T00:28:31.203087+0000","last_became_peered":"2024-09-12T00:28:31.203087+0000","last_unstale":"2024-09-12T01:38:07.124158+0000","last_undegraded":"2024-09-12T01:38:07.124158+0000","last_fullsized":"2024-09-12T01:38:07.124158+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'460","last_scrub_stamp":"2024-09-12T01:38:07.124064+0000","last_deep_scrub":"263'460","last_deep_scrub_stamp":"2024-09-12T01:38:07.124064+0000","last_clean_scrub_stamp":"2024-09-12T01:38:07.124064+0000","objects_scrubbed":11,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:46.650060+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":607243,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":857,"num_read_kb":36686,"num_write":1272,"num_write_kb":31229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":531,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:09.149142+0000","last_change":"2024-09-12T01:38:09.149142+0000","last_active":"2024-09-12T01:38:09.149142+0000","last_peered":"2024-09-12T01:38:09.149142+0000","last_clean":"2024-09-12T01:38:09.149142+0000","last_became_active":"2024-09-12T00:28:19.162886+0000","last_became_peered":"2024-09-12T00:28:19.162886+0000","last_unstale":"2024-09-12T01:38:09.149142+0000","last_undegraded":"2024-09-12T01:38:09.149142+0000","last_fullsized":"2024-09-12T01:38:09.149142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:09.149026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:09.149026+0000","last_clean_scrub_stamp":"2024-09-12T01:38:09.149026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:10.471474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044054899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:29.289058+0000","last_change":"2024-09-12T01:38:29.289000+0000","last_active":"2024-09-12T01:38:29.289058+0000","last_peered":"2024-09-12T01:38:29.289058+0000","last_clean":"2024-09-12T01:38:29.289058+0000","last_became_active":"2024-09-12T00:28:35.212916+0000","last_became_peered":"2024-09-12T00:28:35.212916+0000","last_unstale":"2024-09-12T01:38:29.289058+0000","last_undegraded":"2024-09-12T01:38:29.289058+0000","last_fullsized":"2024-09-12T01:38:29.289058+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:29.288919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:29.288919+0000","last_clean_scrub_stamp":"2024-09-12T01:38:29.288919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:34.426132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"263'769","reported_seq":1515,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:30.418704+0000","last_change":"2024-09-12T01:38:30.418704+0000","last_active":"2024-09-12T01:38:30.418704+0000","last_peered":"2024-09-12T01:38:30.418704+0000","last_clean":"2024-09-12T01:38:30.418704+0000","last_became_active":"2024-09-12T00:28:37.423755+0000","last_became_peered":"2024-09-12T00:28:37.423755+0000","last_unstale":"2024-09-12T01:38:30.418704+0000","last_undegraded":"2024-09-12T01:38:30.418704+0000","last_fullsized":"2024-09-12T01:38:30.418704+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'769","last_scrub_stamp":"2024-09-12T01:38:30.418598+0000","last_deep_scrub":"263'769","last_deep_scrub_stamp":"2024-09-12T01:38:30.418598+0000","last_clean_scrub_stamp":"2024-09-12T01:38:30.418598+0000","objects_scrubbed":9,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:21.805625+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138292,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1365,"num_read_kb":3277,"num_write":1104,"num_write_kb":888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.321038+0000","last_change":"2024-09-12T01:38:38.321038+0000","last_active":"2024-09-12T01:38:38.321038+0000","last_peered":"2024-09-12T01:38:38.321038+0000","last_clean":"2024-09-12T01:38:38.321038+0000","last_became_active":"2024-09-12T00:28:39.216237+0000","last_became_peered":"2024-09-12T00:28:39.216237+0000","last_unstale":"2024-09-12T01:38:38.321038+0000","last_undegraded":"2024-09-12T01:38:38.321038+0000","last_fullsized":"2024-09-12T01:38:38.321038+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:38.320945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:38.320945+0000","last_clean_scrub_stamp":"2024-09-12T01:38:38.320945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:09.757679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"263'85","reported_seq":586,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:45.510855+0000","last_change":"2024-09-12T01:38:45.510855+0000","last_active":"2024-09-12T01:38:45.510855+0000","last_peered":"2024-09-12T01:38:45.510855+0000","last_clean":"2024-09-12T01:38:45.510855+0000","last_became_active":"2024-09-12T00:28:41.233696+0000","last_became_peered":"2024-09-12T00:28:41.233696+0000","last_unstale":"2024-09-12T01:38:45.510855+0000","last_undegraded":"2024-09-12T01:38:45.510855+0000","last_fullsized":"2024-09-12T01:38:45.510855+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'85","last_scrub_stamp":"2024-09-12T01:38:45.510771+0000","last_deep_scrub":"263'85","last_deep_scrub_stamp":"2024-09-12T01:38:45.510771+0000","last_clean_scrub_stamp":"2024-09-12T01:38:45.510771+0000","objects_scrubbed":2,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:06.853210+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":84,"num_read_kb":82,"num_write":190,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"263'150","reported_seq":724,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:48.204992+0000","last_change":"2024-09-12T01:38:48.204992+0000","last_active":"2024-09-12T01:38:48.204992+0000","last_peered":"2024-09-12T01:38:48.204992+0000","last_clean":"2024-09-12T01:38:48.204992+0000","last_became_active":"2024-09-12T00:28:41.226143+0000","last_became_peered":"2024-09-12T00:28:41.226143+0000","last_unstale":"2024-09-12T01:38:48.204992+0000","last_undegraded":"2024-09-12T01:38:48.204992+0000","last_fullsized":"2024-09-12T01:38:48.204992+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'150","last_scrub_stamp":"2024-09-12T01:38:48.204910+0000","last_deep_scrub":"263'150","last_deep_scrub_stamp":"2024-09-12T01:38:48.204910+0000","last_clean_scrub_stamp":"2024-09-12T01:38:48.204910+0000","objects_scrubbed":1,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:50.979586+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":251,"num_read_kb":240,"num_write":350,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"263'64","reported_seq":629,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.544728+0000","last_change":"2024-09-12T01:38:14.544633+0000","last_active":"2024-09-12T01:38:14.544728+0000","last_peered":"2024-09-12T01:38:14.544728+0000","last_clean":"2024-09-12T01:38:14.544728+0000","last_became_active":"2024-09-12T00:28:33.209335+0000","last_became_peered":"2024-09-12T00:28:33.209335+0000","last_unstale":"2024-09-12T01:38:14.544728+0000","last_undegraded":"2024-09-12T01:38:14.544728+0000","last_fullsized":"2024-09-12T01:38:14.544728+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'64","last_scrub_stamp":"2024-09-12T01:38:14.544539+0000","last_deep_scrub":"263'64","last_deep_scrub_stamp":"2024-09-12T01:38:14.544539+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.544539+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:01.588201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":218,"num_write":93,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"263'395","reported_seq":1084,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.703424+0000","last_change":"2024-09-12T01:38:19.703424+0000","last_active":"2024-09-12T01:38:19.703424+0000","last_peered":"2024-09-12T01:38:19.703424+0000","last_clean":"2024-09-12T01:38:19.703424+0000","last_became_active":"2024-09-12T00:29:04.295676+0000","last_became_peered":"2024-09-12T00:29:04.295676+0000","last_unstale":"2024-09-12T01:38:19.703424+0000","last_undegraded":"2024-09-12T01:38:19.703424+0000","last_fullsized":"2024-09-12T01:38:19.703424+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'395","last_scrub_stamp":"2024-09-12T01:38:19.703172+0000","last_deep_scrub":"263'395","last_deep_scrub_stamp":"2024-09-12T01:38:19.703172+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.703172+0000","objects_scrubbed":8,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:41.744192+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2554787,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":757,"num_read_kb":17367,"num_write":1239,"num_write_kb":40068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":515,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.997410+0000","last_change":"2024-09-12T01:38:22.997345+0000","last_active":"2024-09-12T01:38:22.997410+0000","last_peered":"2024-09-12T01:38:22.997410+0000","last_clean":"2024-09-12T01:38:22.997410+0000","last_became_active":"2024-09-12T00:28:35.208165+0000","last_became_peered":"2024-09-12T00:28:35.208165+0000","last_unstale":"2024-09-12T01:38:22.997410+0000","last_undegraded":"2024-09-12T01:38:22.997410+0000","last_fullsized":"2024-09-12T01:38:22.997410+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:22.997265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:22.997265+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.997265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:37.750337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"263'303","reported_seq":904,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:34.305299+0000","last_change":"2024-09-12T01:38:34.305234+0000","last_active":"2024-09-12T01:38:34.305299+0000","last_peered":"2024-09-12T01:38:34.305299+0000","last_clean":"2024-09-12T01:38:34.305299+0000","last_became_active":"2024-09-12T00:28:37.217603+0000","last_became_peered":"2024-09-12T00:28:37.217603+0000","last_unstale":"2024-09-12T01:38:34.305299+0000","last_undegraded":"2024-09-12T01:38:34.305299+0000","last_fullsized":"2024-09-12T01:38:34.305299+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'303","last_scrub_stamp":"2024-09-12T01:38:34.305138+0000","last_deep_scrub":"263'303","last_deep_scrub_stamp":"2024-09-12T01:38:34.305138+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.305138+0000","objects_scrubbed":6,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:17.248810+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46508,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":487,"num_read_kb":1094,"num_write":390,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:40.294808+0000","last_change":"2024-09-12T01:38:40.294808+0000","last_active":"2024-09-12T01:38:40.294808+0000","last_peered":"2024-09-12T01:38:40.294808+0000","last_clean":"2024-09-12T01:38:40.294808+0000","last_became_active":"2024-09-12T00:28:39.216143+0000","last_became_peered":"2024-09-12T00:28:39.216143+0000","last_unstale":"2024-09-12T01:38:40.294808+0000","last_undegraded":"2024-09-12T01:38:40.294808+0000","last_fullsized":"2024-09-12T01:38:40.294808+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:40.294710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:40.294710+0000","last_clean_scrub_stamp":"2024-09-12T01:38:40.294710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:02.826767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"263'119","reported_seq":641,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:49.356012+0000","last_change":"2024-09-12T01:38:49.355949+0000","last_active":"2024-09-12T01:38:49.356012+0000","last_peered":"2024-09-12T01:38:49.356012+0000","last_clean":"2024-09-12T01:38:49.356012+0000","last_became_active":"2024-09-12T00:28:41.232114+0000","last_became_peered":"2024-09-12T00:28:41.232114+0000","last_unstale":"2024-09-12T01:38:49.356012+0000","last_undegraded":"2024-09-12T01:38:49.356012+0000","last_fullsized":"2024-09-12T01:38:49.356012+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'119","last_scrub_stamp":"2024-09-12T01:38:49.355848+0000","last_deep_scrub":"263'119","last_deep_scrub_stamp":"2024-09-12T01:38:49.355848+0000","last_clean_scrub_stamp":"2024-09-12T01:38:49.355848+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:40.862632+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":141,"num_write":283,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"263'347","reported_seq":1055,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:25.427281+0000","last_change":"2024-09-12T01:38:25.427221+0000","last_active":"2024-09-12T01:38:25.427281+0000","last_peered":"2024-09-12T01:38:25.427281+0000","last_clean":"2024-09-12T01:38:25.427281+0000","last_became_active":"2024-09-12T00:29:04.292302+0000","last_became_peered":"2024-09-12T00:29:04.292302+0000","last_unstale":"2024-09-12T01:38:25.427281+0000","last_undegraded":"2024-09-12T01:38:25.427281+0000","last_fullsized":"2024-09-12T01:38:25.427281+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'347","last_scrub_stamp":"2024-09-12T01:38:25.427133+0000","last_deep_scrub":"263'347","last_deep_scrub_stamp":"2024-09-12T01:38:25.427133+0000","last_clean_scrub_stamp":"2024-09-12T01:38:25.427133+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:54.656816+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1719,"num_read_kb":1484,"num_write":537,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25751,"num_omap_keys":101,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"263'396","reported_seq":1182,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.265923+0000","last_change":"2024-09-12T01:38:18.265866+0000","last_active":"2024-09-12T01:38:18.265923+0000","last_peered":"2024-09-12T01:38:18.265923+0000","last_clean":"2024-09-12T01:38:18.265923+0000","last_became_active":"2024-09-12T00:28:31.207765+0000","last_became_peered":"2024-09-12T00:28:31.207765+0000","last_unstale":"2024-09-12T01:38:18.265923+0000","last_undegraded":"2024-09-12T01:38:18.265923+0000","last_fullsized":"2024-09-12T01:38:18.265923+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'396","last_scrub_stamp":"2024-09-12T01:38:18.265737+0000","last_deep_scrub":"263'396","last_deep_scrub_stamp":"2024-09-12T01:38:18.265737+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.265737+0000","objects_scrubbed":10,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:42.523716+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2529502,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":736,"num_read_kb":9284,"num_write":1355,"num_write_kb":41598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":509,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:27.266641+0000","last_change":"2024-09-12T01:38:27.266554+0000","last_active":"2024-09-12T01:38:27.266641+0000","last_peered":"2024-09-12T01:38:27.266641+0000","last_clean":"2024-09-12T01:38:27.266641+0000","last_became_active":"2024-09-12T00:28:35.212243+0000","last_became_peered":"2024-09-12T00:28:35.212243+0000","last_unstale":"2024-09-12T01:38:27.266641+0000","last_undegraded":"2024-09-12T01:38:27.266641+0000","last_fullsized":"2024-09-12T01:38:27.266641+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:27.266464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:27.266464+0000","last_clean_scrub_stamp":"2024-09-12T01:38:27.266464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:57.767929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"263'60","reported_seq":577,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:29.129127+0000","last_change":"2024-09-12T01:38:29.129067+0000","last_active":"2024-09-12T01:38:29.129127+0000","last_peered":"2024-09-12T01:38:29.129127+0000","last_clean":"2024-09-12T01:38:29.129127+0000","last_became_active":"2024-09-12T00:28:37.219799+0000","last_became_peered":"2024-09-12T00:28:37.219799+0000","last_unstale":"2024-09-12T01:38:29.129127+0000","last_undegraded":"2024-09-12T01:38:29.129127+0000","last_fullsized":"2024-09-12T01:38:29.129127+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'60","last_scrub_stamp":"2024-09-12T01:38:29.128986+0000","last_deep_scrub":"263'60","last_deep_scrub_stamp":"2024-09-12T01:38:29.128986+0000","last_clean_scrub_stamp":"2024-09-12T01:38:29.128986+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:06.769387+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":42,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.506950+0000","last_change":"2024-09-12T01:38:37.506869+0000","last_active":"2024-09-12T01:38:37.506950+0000","last_peered":"2024-09-12T01:38:37.506950+0000","last_clean":"2024-09-12T01:38:37.506950+0000","last_became_active":"2024-09-12T00:28:39.219209+0000","last_became_peered":"2024-09-12T00:28:39.219209+0000","last_unstale":"2024-09-12T01:38:37.506950+0000","last_undegraded":"2024-09-12T01:38:37.506950+0000","last_fullsized":"2024-09-12T01:38:37.506950+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:37.506759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:37.506759+0000","last_clean_scrub_stamp":"2024-09-12T01:38:37.506759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:54.149913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"263'213","reported_seq":750,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:45.217297+0000","last_change":"2024-09-12T01:38:45.217297+0000","last_active":"2024-09-12T01:38:45.217297+0000","last_peered":"2024-09-12T01:38:45.217297+0000","last_clean":"2024-09-12T01:38:45.217297+0000","last_became_active":"2024-09-12T00:28:41.225673+0000","last_became_peered":"2024-09-12T00:28:41.225673+0000","last_unstale":"2024-09-12T01:38:45.217297+0000","last_undegraded":"2024-09-12T01:38:45.217297+0000","last_fullsized":"2024-09-12T01:38:45.217297+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'213","last_scrub_stamp":"2024-09-12T01:38:45.217201+0000","last_deep_scrub":"263'213","last_deep_scrub_stamp":"2024-09-12T01:38:45.217201+0000","last_clean_scrub_stamp":"2024-09-12T01:38:45.217201+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:59.307017+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":332,"num_read_kb":318,"num_write":482,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"263'71","reported_seq":702,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.187420+0000","last_change":"2024-09-12T01:38:15.187360+0000","last_active":"2024-09-12T01:38:15.187420+0000","last_peered":"2024-09-12T01:38:15.187420+0000","last_clean":"2024-09-12T01:38:15.187420+0000","last_became_active":"2024-09-12T00:28:33.213777+0000","last_became_peered":"2024-09-12T00:28:33.213777+0000","last_unstale":"2024-09-12T01:38:15.187420+0000","last_undegraded":"2024-09-12T01:38:15.187420+0000","last_fullsized":"2024-09-12T01:38:15.187420+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'71","last_scrub_stamp":"2024-09-12T01:38:15.187273+0000","last_deep_scrub":"263'71","last_deep_scrub_stamp":"2024-09-12T01:38:15.187273+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.187273+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:48.489235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":365,"num_read_kb":325,"num_write":89,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"263'346","reported_seq":982,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.342611+0000","last_change":"2024-09-12T01:38:13.342517+0000","last_active":"2024-09-12T01:38:13.342611+0000","last_peered":"2024-09-12T01:38:13.342611+0000","last_clean":"2024-09-12T01:38:13.342611+0000","last_became_active":"2024-09-12T00:28:31.213567+0000","last_became_peered":"2024-09-12T00:28:31.213567+0000","last_unstale":"2024-09-12T01:38:13.342611+0000","last_undegraded":"2024-09-12T01:38:13.342611+0000","last_fullsized":"2024-09-12T01:38:13.342611+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'346","last_scrub_stamp":"2024-09-12T01:38:13.342398+0000","last_deep_scrub":"263'346","last_deep_scrub_stamp":"2024-09-12T01:38:13.342398+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.342398+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:37.312677+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262191,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":463,"num_read_kb":31334,"num_write":999,"num_write_kb":46181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:29.444200+0000","last_change":"2024-09-12T01:38:29.444149+0000","last_active":"2024-09-12T01:38:29.444200+0000","last_peered":"2024-09-12T01:38:29.444200+0000","last_clean":"2024-09-12T01:38:29.444200+0000","last_became_active":"2024-09-12T00:28:35.210000+0000","last_became_peered":"2024-09-12T00:28:35.210000+0000","last_unstale":"2024-09-12T01:38:29.444200+0000","last_undegraded":"2024-09-12T01:38:29.444200+0000","last_fullsized":"2024-09-12T01:38:29.444200+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:29.444059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:29.444059+0000","last_clean_scrub_stamp":"2024-09-12T01:38:29.444059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:37.703935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"263'340","reported_seq":951,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.300458+0000","last_change":"2024-09-12T01:38:35.300395+0000","last_active":"2024-09-12T01:38:35.300458+0000","last_peered":"2024-09-12T01:38:35.300458+0000","last_clean":"2024-09-12T01:38:35.300458+0000","last_became_active":"2024-09-12T00:28:37.222678+0000","last_became_peered":"2024-09-12T00:28:37.222678+0000","last_unstale":"2024-09-12T01:38:35.300458+0000","last_undegraded":"2024-09-12T01:38:35.300458+0000","last_fullsized":"2024-09-12T01:38:35.300458+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'340","last_scrub_stamp":"2024-09-12T01:38:35.300287+0000","last_deep_scrub":"263'340","last_deep_scrub_stamp":"2024-09-12T01:38:35.300287+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.300287+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:15.500767+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45149,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":551,"num_read_kb":1230,"num_write":438,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:27.205149+0000","last_change":"2024-09-12T01:38:27.205089+0000","last_active":"2024-09-12T01:38:27.205149+0000","last_peered":"2024-09-12T01:38:27.205149+0000","last_clean":"2024-09-12T01:38:27.205149+0000","last_became_active":"2024-09-12T00:28:39.216200+0000","last_became_peered":"2024-09-12T00:28:39.216200+0000","last_unstale":"2024-09-12T01:38:27.205149+0000","last_undegraded":"2024-09-12T01:38:27.205149+0000","last_fullsized":"2024-09-12T01:38:27.205149+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:27.204991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:27.204991+0000","last_clean_scrub_stamp":"2024-09-12T01:38:27.204991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:51.772559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"263'114","reported_seq":637,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:47.459776+0000","last_change":"2024-09-12T01:38:47.459776+0000","last_active":"2024-09-12T01:38:47.459776+0000","last_peered":"2024-09-12T01:38:47.459776+0000","last_clean":"2024-09-12T01:38:47.459776+0000","last_became_active":"2024-09-12T00:28:41.232381+0000","last_became_peered":"2024-09-12T00:28:41.232381+0000","last_unstale":"2024-09-12T01:38:47.459776+0000","last_undegraded":"2024-09-12T01:38:47.459776+0000","last_fullsized":"2024-09-12T01:38:47.459776+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'114","last_scrub_stamp":"2024-09-12T01:38:47.459665+0000","last_deep_scrub":"263'114","last_deep_scrub_stamp":"2024-09-12T01:38:47.459665+0000","last_clean_scrub_stamp":"2024-09-12T01:38:47.459665+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:38.656502+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":176,"num_read_kb":166,"num_write":281,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"263'153","reported_seq":754,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:28.299416+0000","last_change":"2024-09-12T01:38:28.299358+0000","last_active":"2024-09-12T01:38:28.299416+0000","last_peered":"2024-09-12T01:38:28.299416+0000","last_clean":"2024-09-12T01:38:28.299416+0000","last_became_active":"2024-09-12T00:28:33.211165+0000","last_became_peered":"2024-09-12T00:28:33.211165+0000","last_unstale":"2024-09-12T01:38:28.299416+0000","last_undegraded":"2024-09-12T01:38:28.299416+0000","last_fullsized":"2024-09-12T01:38:28.299416+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'153","last_scrub_stamp":"2024-09-12T01:38:28.299270+0000","last_deep_scrub":"263'153","last_deep_scrub_stamp":"2024-09-12T01:38:28.299270+0000","last_clean_scrub_stamp":"2024-09-12T01:38:28.299270+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:32.733250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":668,"num_read_kb":545,"num_write":223,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"263'340","reported_seq":978,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.047653+0000","last_change":"2024-09-12T01:38:10.047601+0000","last_active":"2024-09-12T01:38:10.047653+0000","last_peered":"2024-09-12T01:38:10.047653+0000","last_clean":"2024-09-12T01:38:10.047653+0000","last_became_active":"2024-09-12T00:28:31.213971+0000","last_became_peered":"2024-09-12T00:28:31.213971+0000","last_unstale":"2024-09-12T01:38:10.047653+0000","last_undegraded":"2024-09-12T01:38:10.047653+0000","last_fullsized":"2024-09-12T01:38:10.047653+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'340","last_scrub_stamp":"2024-09-12T01:38:10.047526+0000","last_deep_scrub":"263'340","last_deep_scrub_stamp":"2024-09-12T01:38:10.047526+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.047526+0000","objects_scrubbed":8,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:30.027467+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340133,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":428,"num_read_kb":61436,"num_write":986,"num_write_kb":69756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:23.136547+0000","last_change":"2024-09-12T01:38:23.136434+0000","last_active":"2024-09-12T01:38:23.136547+0000","last_peered":"2024-09-12T01:38:23.136547+0000","last_clean":"2024-09-12T01:38:23.136547+0000","last_became_active":"2024-09-12T00:28:35.210060+0000","last_became_peered":"2024-09-12T00:28:35.210060+0000","last_unstale":"2024-09-12T01:38:23.136547+0000","last_undegraded":"2024-09-12T01:38:23.136547+0000","last_fullsized":"2024-09-12T01:38:23.136547+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:23.136334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:23.136334+0000","last_clean_scrub_stamp":"2024-09-12T01:38:23.136334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:03.715995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"263'301","reported_seq":884,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.448009+0000","last_change":"2024-09-12T01:38:35.447953+0000","last_active":"2024-09-12T01:38:35.448009+0000","last_peered":"2024-09-12T01:38:35.448009+0000","last_clean":"2024-09-12T01:38:35.448009+0000","last_became_active":"2024-09-12T00:28:37.221491+0000","last_became_peered":"2024-09-12T00:28:37.221491+0000","last_unstale":"2024-09-12T01:38:35.448009+0000","last_undegraded":"2024-09-12T01:38:35.448009+0000","last_fullsized":"2024-09-12T01:38:35.448009+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'301","last_scrub_stamp":"2024-09-12T01:38:35.447807+0000","last_deep_scrub":"263'301","last_deep_scrub_stamp":"2024-09-12T01:38:35.447807+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.447807+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:30.403825+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49002,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":484,"num_read_kb":1163,"num_write":396,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:39.202809+0000","last_change":"2024-09-12T01:38:39.202712+0000","last_active":"2024-09-12T01:38:39.202809+0000","last_peered":"2024-09-12T01:38:39.202809+0000","last_clean":"2024-09-12T01:38:39.202809+0000","last_became_active":"2024-09-12T00:28:39.219004+0000","last_became_peered":"2024-09-12T00:28:39.219004+0000","last_unstale":"2024-09-12T01:38:39.202809+0000","last_undegraded":"2024-09-12T01:38:39.202809+0000","last_fullsized":"2024-09-12T01:38:39.202809+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:39.202617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:39.202617+0000","last_clean_scrub_stamp":"2024-09-12T01:38:39.202617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:51.637674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"263'478","reported_seq":1270,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.216852+0000","last_change":"2024-09-12T01:38:19.216852+0000","last_active":"2024-09-12T01:38:19.216852+0000","last_peered":"2024-09-12T01:38:19.216852+0000","last_clean":"2024-09-12T01:38:19.216852+0000","last_became_active":"2024-09-12T00:28:33.216610+0000","last_became_peered":"2024-09-12T00:28:33.216610+0000","last_unstale":"2024-09-12T01:38:19.216852+0000","last_undegraded":"2024-09-12T01:38:19.216852+0000","last_fullsized":"2024-09-12T01:38:19.216852+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'478","last_scrub_stamp":"2024-09-12T01:38:19.216770+0000","last_deep_scrub":"263'478","last_deep_scrub_stamp":"2024-09-12T01:38:19.216770+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.216770+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:55.208285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2349,"num_read_kb":2016,"num_write":868,"num_write_kb":562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"263'340","reported_seq":980,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.239903+0000","last_change":"2024-09-12T01:38:13.239832+0000","last_active":"2024-09-12T01:38:13.239903+0000","last_peered":"2024-09-12T01:38:13.239903+0000","last_clean":"2024-09-12T01:38:13.239903+0000","last_became_active":"2024-09-12T00:28:31.207770+0000","last_became_peered":"2024-09-12T00:28:31.207770+0000","last_unstale":"2024-09-12T01:38:13.239903+0000","last_undegraded":"2024-09-12T01:38:13.239903+0000","last_fullsized":"2024-09-12T01:38:13.239903+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'340","last_scrub_stamp":"2024-09-12T01:38:13.239742+0000","last_deep_scrub":"263'340","last_deep_scrub_stamp":"2024-09-12T01:38:13.239742+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.239742+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:09.782387+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":467,"num_read_kb":17286,"num_write":965,"num_write_kb":20034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":512,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:23.160041+0000","last_change":"2024-09-12T01:38:23.159987+0000","last_active":"2024-09-12T01:38:23.160041+0000","last_peered":"2024-09-12T01:38:23.160041+0000","last_clean":"2024-09-12T01:38:23.160041+0000","last_became_active":"2024-09-12T00:28:35.208868+0000","last_became_peered":"2024-09-12T00:28:35.208868+0000","last_unstale":"2024-09-12T01:38:23.160041+0000","last_undegraded":"2024-09-12T01:38:23.160041+0000","last_fullsized":"2024-09-12T01:38:23.160041+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:23.159891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:23.159891+0000","last_clean_scrub_stamp":"2024-09-12T01:38:23.159891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:23.643595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"263'534","reported_seq":1195,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:26.001515+0000","last_change":"2024-09-12T01:38:26.001437+0000","last_active":"2024-09-12T01:38:26.001515+0000","last_peered":"2024-09-12T01:38:26.001515+0000","last_clean":"2024-09-12T01:38:26.001515+0000","last_became_active":"2024-09-12T00:28:37.210514+0000","last_became_peered":"2024-09-12T00:28:37.210514+0000","last_unstale":"2024-09-12T01:38:26.001515+0000","last_undegraded":"2024-09-12T01:38:26.001515+0000","last_fullsized":"2024-09-12T01:38:26.001515+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'534","last_scrub_stamp":"2024-09-12T01:38:26.001311+0000","last_deep_scrub":"263'534","last_deep_scrub_stamp":"2024-09-12T01:38:26.001311+0000","last_clean_scrub_stamp":"2024-09-12T01:38:26.001311+0000","objects_scrubbed":7,"log_size":34,"log_dups_size":500,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:10.115691+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94945,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":919,"num_read_kb":2214,"num_write":790,"num_write_kb":678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:40.437969+0000","last_change":"2024-09-12T01:38:40.437919+0000","last_active":"2024-09-12T01:38:40.437969+0000","last_peered":"2024-09-12T01:38:40.437969+0000","last_clean":"2024-09-12T01:38:40.437969+0000","last_became_active":"2024-09-12T00:28:39.219808+0000","last_became_peered":"2024-09-12T00:28:39.219808+0000","last_unstale":"2024-09-12T01:38:40.437969+0000","last_undegraded":"2024-09-12T01:38:40.437969+0000","last_fullsized":"2024-09-12T01:38:40.437969+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:40.437833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:40.437833+0000","last_clean_scrub_stamp":"2024-09-12T01:38:40.437833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:03.038216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"263'229","reported_seq":806,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:47.316643+0000","last_change":"2024-09-12T01:38:47.316643+0000","last_active":"2024-09-12T01:38:47.316643+0000","last_peered":"2024-09-12T01:38:47.316643+0000","last_clean":"2024-09-12T01:38:47.316643+0000","last_became_active":"2024-09-12T00:28:41.257639+0000","last_became_peered":"2024-09-12T00:28:41.257639+0000","last_unstale":"2024-09-12T01:38:47.316643+0000","last_undegraded":"2024-09-12T01:38:47.316643+0000","last_fullsized":"2024-09-12T01:38:47.316643+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'229","last_scrub_stamp":"2024-09-12T01:38:47.316555+0000","last_deep_scrub":"263'229","last_deep_scrub_stamp":"2024-09-12T01:38:47.316555+0000","last_clean_scrub_stamp":"2024-09-12T01:38:47.316555+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:30.257573+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":674,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":491,"num_read_kb":439,"num_write":521,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"263'158","reported_seq":758,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.116264+0000","last_change":"2024-09-12T01:38:17.116170+0000","last_active":"2024-09-12T01:38:17.116264+0000","last_peered":"2024-09-12T01:38:17.116264+0000","last_clean":"2024-09-12T01:38:17.116264+0000","last_became_active":"2024-09-12T00:28:33.215105+0000","last_became_peered":"2024-09-12T00:28:33.215105+0000","last_unstale":"2024-09-12T01:38:17.116264+0000","last_undegraded":"2024-09-12T01:38:17.116264+0000","last_fullsized":"2024-09-12T01:38:17.116264+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'158","last_scrub_stamp":"2024-09-12T01:38:17.116093+0000","last_deep_scrub":"263'158","last_deep_scrub_stamp":"2024-09-12T01:38:17.116093+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.116093+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:18.349339+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":692,"num_read_kb":572,"num_write":247,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"263'397","reported_seq":1061,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.210269+0000","last_change":"2024-09-12T01:38:12.210181+0000","last_active":"2024-09-12T01:38:12.210269+0000","last_peered":"2024-09-12T01:38:12.210269+0000","last_clean":"2024-09-12T01:38:12.210269+0000","last_became_active":"2024-09-12T00:28:31.206562+0000","last_became_peered":"2024-09-12T00:28:31.206562+0000","last_unstale":"2024-09-12T01:38:12.210269+0000","last_undegraded":"2024-09-12T01:38:12.210269+0000","last_fullsized":"2024-09-12T01:38:12.210269+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'397","last_scrub_stamp":"2024-09-12T01:38:12.210028+0000","last_deep_scrub":"263'397","last_deep_scrub_stamp":"2024-09-12T01:38:12.210028+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.210028+0000","objects_scrubbed":8,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:00.125891+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395844,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":545,"num_read_kb":3743,"num_write":1252,"num_write_kb":48925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":509,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:24.152454+0000","last_change":"2024-09-12T01:38:24.152454+0000","last_active":"2024-09-12T01:38:24.152454+0000","last_peered":"2024-09-12T01:38:24.152454+0000","last_clean":"2024-09-12T01:38:24.152454+0000","last_became_active":"2024-09-12T00:28:35.210046+0000","last_became_peered":"2024-09-12T00:28:35.210046+0000","last_unstale":"2024-09-12T01:38:24.152454+0000","last_undegraded":"2024-09-12T01:38:24.152454+0000","last_fullsized":"2024-09-12T01:38:24.152454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:24.152344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:24.152344+0000","last_clean_scrub_stamp":"2024-09-12T01:38:24.152344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:00.292881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"263'338","reported_seq":940,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:36.464792+0000","last_change":"2024-09-12T01:38:36.464730+0000","last_active":"2024-09-12T01:38:36.464792+0000","last_peered":"2024-09-12T01:38:36.464792+0000","last_clean":"2024-09-12T01:38:36.464792+0000","last_became_active":"2024-09-12T00:28:37.212236+0000","last_became_peered":"2024-09-12T00:28:37.212236+0000","last_unstale":"2024-09-12T01:38:36.464792+0000","last_undegraded":"2024-09-12T01:38:36.464792+0000","last_fullsized":"2024-09-12T01:38:36.464792+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'338","last_scrub_stamp":"2024-09-12T01:38:36.464628+0000","last_deep_scrub":"263'338","last_deep_scrub_stamp":"2024-09-12T01:38:36.464628+0000","last_clean_scrub_stamp":"2024-09-12T01:38:36.464628+0000","objects_scrubbed":8,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:26.375761+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49414,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":546,"num_read_kb":1160,"num_write":454,"num_write_kb":329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:31.002339+0000","last_change":"2024-09-12T01:38:31.002272+0000","last_active":"2024-09-12T01:38:31.002339+0000","last_peered":"2024-09-12T01:38:31.002339+0000","last_clean":"2024-09-12T01:38:31.002339+0000","last_became_active":"2024-09-12T00:28:39.217947+0000","last_became_peered":"2024-09-12T00:28:39.217947+0000","last_unstale":"2024-09-12T01:38:31.002339+0000","last_undegraded":"2024-09-12T01:38:31.002339+0000","last_fullsized":"2024-09-12T01:38:31.002339+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:31.002169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:31.002169+0000","last_clean_scrub_stamp":"2024-09-12T01:38:31.002169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:14.472899+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"263'225","reported_seq":1105,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:33.106320+0000","last_change":"2024-09-12T01:38:33.106231+0000","last_active":"2024-09-12T01:38:33.106320+0000","last_peered":"2024-09-12T01:38:33.106320+0000","last_clean":"2024-09-12T01:38:33.106320+0000","last_became_active":"2024-09-12T00:28:41.232347+0000","last_became_peered":"2024-09-12T00:28:41.232347+0000","last_unstale":"2024-09-12T01:38:33.106320+0000","last_undegraded":"2024-09-12T01:38:33.106320+0000","last_fullsized":"2024-09-12T01:38:33.106320+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'225","last_scrub_stamp":"2024-09-12T01:38:33.106123+0000","last_deep_scrub":"263'225","last_deep_scrub_stamp":"2024-09-12T01:38:33.106123+0000","last_clean_scrub_stamp":"2024-09-12T01:38:33.106123+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:04.636946+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":645,"num_read_kb":635,"num_write":602,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"263'73","reported_seq":637,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.239390+0000","last_change":"2024-09-12T01:38:22.239336+0000","last_active":"2024-09-12T01:38:22.239390+0000","last_peered":"2024-09-12T01:38:22.239390+0000","last_clean":"2024-09-12T01:38:22.239390+0000","last_became_active":"2024-09-12T00:28:33.207968+0000","last_became_peered":"2024-09-12T00:28:33.207968+0000","last_unstale":"2024-09-12T01:38:22.239390+0000","last_undegraded":"2024-09-12T01:38:22.239390+0000","last_fullsized":"2024-09-12T01:38:22.239390+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'73","last_scrub_stamp":"2024-09-12T01:38:22.239257+0000","last_deep_scrub":"263'73","last_deep_scrub_stamp":"2024-09-12T01:38:22.239257+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.239257+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:04.297452+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":308,"num_read_kb":254,"num_write":109,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":719,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"263'300","reported_seq":935,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:09.492350+0000","last_change":"2024-09-12T01:38:09.492289+0000","last_active":"2024-09-12T01:38:09.492350+0000","last_peered":"2024-09-12T01:38:09.492350+0000","last_clean":"2024-09-12T01:38:09.492350+0000","last_became_active":"2024-09-12T00:28:31.195038+0000","last_became_peered":"2024-09-12T00:28:31.195038+0000","last_unstale":"2024-09-12T01:38:09.492350+0000","last_undegraded":"2024-09-12T01:38:09.492350+0000","last_fullsized":"2024-09-12T01:38:09.492350+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'300","last_scrub_stamp":"2024-09-12T01:38:09.492194+0000","last_deep_scrub":"263'300","last_deep_scrub_stamp":"2024-09-12T01:38:09.492194+0000","last_clean_scrub_stamp":"2024-09-12T01:38:09.492194+0000","objects_scrubbed":5,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:50.184186+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262176,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":426,"num_read_kb":13574,"num_write":965,"num_write_kb":34116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:30.500766+0000","last_change":"2024-09-12T01:38:30.500642+0000","last_active":"2024-09-12T01:38:30.500766+0000","last_peered":"2024-09-12T01:38:30.500766+0000","last_clean":"2024-09-12T01:38:30.500766+0000","last_became_active":"2024-09-12T00:28:35.215576+0000","last_became_peered":"2024-09-12T00:28:35.215576+0000","last_unstale":"2024-09-12T01:38:30.500766+0000","last_undegraded":"2024-09-12T01:38:30.500766+0000","last_fullsized":"2024-09-12T01:38:30.500766+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:30.500549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:30.500549+0000","last_clean_scrub_stamp":"2024-09-12T01:38:30.500549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:03.116000+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"263'294","reported_seq":898,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:36.315532+0000","last_change":"2024-09-12T01:38:36.315532+0000","last_active":"2024-09-12T01:38:36.315532+0000","last_peered":"2024-09-12T01:38:36.315532+0000","last_clean":"2024-09-12T01:38:36.315532+0000","last_became_active":"2024-09-12T00:28:37.423835+0000","last_became_peered":"2024-09-12T00:28:37.423835+0000","last_unstale":"2024-09-12T01:38:36.315532+0000","last_undegraded":"2024-09-12T01:38:36.315532+0000","last_fullsized":"2024-09-12T01:38:36.315532+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'294","last_scrub_stamp":"2024-09-12T01:38:36.315428+0000","last_deep_scrub":"263'294","last_deep_scrub_stamp":"2024-09-12T01:38:36.315428+0000","last_clean_scrub_stamp":"2024-09-12T01:38:36.315428+0000","objects_scrubbed":6,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:06.591255+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48887,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":486,"num_read_kb":1104,"num_write":386,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":512,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:30.001456+0000","last_change":"2024-09-12T01:38:30.001403+0000","last_active":"2024-09-12T01:38:30.001456+0000","last_peered":"2024-09-12T01:38:30.001456+0000","last_clean":"2024-09-12T01:38:30.001456+0000","last_became_active":"2024-09-12T00:28:39.219541+0000","last_became_peered":"2024-09-12T00:28:39.219541+0000","last_unstale":"2024-09-12T01:38:30.001456+0000","last_undegraded":"2024-09-12T01:38:30.001456+0000","last_fullsized":"2024-09-12T01:38:30.001456+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:30.001320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:30.001320+0000","last_clean_scrub_stamp":"2024-09-12T01:38:30.001320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:08.445496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"263'117","reported_seq":611,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:44.504853+0000","last_change":"2024-09-12T01:38:44.504853+0000","last_active":"2024-09-12T01:38:44.504853+0000","last_peered":"2024-09-12T01:38:44.504853+0000","last_clean":"2024-09-12T01:38:44.504853+0000","last_became_active":"2024-09-12T00:28:41.232305+0000","last_became_peered":"2024-09-12T00:28:41.232305+0000","last_unstale":"2024-09-12T01:38:44.504853+0000","last_undegraded":"2024-09-12T01:38:44.504853+0000","last_fullsized":"2024-09-12T01:38:44.504853+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'117","last_scrub_stamp":"2024-09-12T01:38:44.504746+0000","last_deep_scrub":"263'117","last_deep_scrub_stamp":"2024-09-12T01:38:44.504746+0000","last_clean_scrub_stamp":"2024-09-12T01:38:44.504746+0000","objects_scrubbed":3,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:36.489816+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":90,"num_read_kb":88,"num_write":260,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"263'145","reported_seq":720,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.772748+0000","last_change":"2024-09-12T01:38:21.772678+0000","last_active":"2024-09-12T01:38:21.772748+0000","last_peered":"2024-09-12T01:38:21.772748+0000","last_clean":"2024-09-12T01:38:21.772748+0000","last_became_active":"2024-09-12T00:28:33.213905+0000","last_became_peered":"2024-09-12T00:28:33.213905+0000","last_unstale":"2024-09-12T01:38:21.772748+0000","last_undegraded":"2024-09-12T01:38:21.772748+0000","last_fullsized":"2024-09-12T01:38:21.772748+0000","mapping_epoch":27,"log_start":"260'100","ondisk_log_start":"260'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'145","last_scrub_stamp":"2024-09-12T01:38:21.772587+0000","last_deep_scrub":"263'145","last_deep_scrub_stamp":"2024-09-12T01:38:21.772587+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.772587+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:23.017228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":580,"num_read_kb":470,"num_write":232,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"263'313","reported_seq":1016,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.157918+0000","last_change":"2024-09-12T01:38:18.157817+0000","last_active":"2024-09-12T01:38:18.157918+0000","last_peered":"2024-09-12T01:38:18.157918+0000","last_clean":"2024-09-12T01:38:18.157918+0000","last_became_active":"2024-09-12T00:28:31.203417+0000","last_became_peered":"2024-09-12T00:28:31.203417+0000","last_unstale":"2024-09-12T01:38:18.157918+0000","last_undegraded":"2024-09-12T01:38:18.157918+0000","last_fullsized":"2024-09-12T01:38:18.157918+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'313","last_scrub_stamp":"2024-09-12T01:38:18.157702+0000","last_deep_scrub":"263'313","last_deep_scrub_stamp":"2024-09-12T01:38:18.157702+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.157702+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:59.863289+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262193,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":643,"num_read_kb":683,"num_write":1258,"num_write_kb":6456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:24.997799+0000","last_change":"2024-09-12T01:38:24.997695+0000","last_active":"2024-09-12T01:38:24.997799+0000","last_peered":"2024-09-12T01:38:24.997799+0000","last_clean":"2024-09-12T01:38:24.997799+0000","last_became_active":"2024-09-12T00:28:35.207992+0000","last_became_peered":"2024-09-12T00:28:35.207992+0000","last_unstale":"2024-09-12T01:38:24.997799+0000","last_undegraded":"2024-09-12T01:38:24.997799+0000","last_fullsized":"2024-09-12T01:38:24.997799+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:24.997615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:24.997615+0000","last_clean_scrub_stamp":"2024-09-12T01:38:24.997615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:15.702126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"263'113","reported_seq":664,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:36.568919+0000","last_change":"2024-09-12T01:38:36.568861+0000","last_active":"2024-09-12T01:38:36.568919+0000","last_peered":"2024-09-12T01:38:36.568919+0000","last_clean":"2024-09-12T01:38:36.568919+0000","last_became_active":"2024-09-12T00:28:37.423765+0000","last_became_peered":"2024-09-12T00:28:37.423765+0000","last_unstale":"2024-09-12T01:38:36.568919+0000","last_undegraded":"2024-09-12T01:38:36.568919+0000","last_fullsized":"2024-09-12T01:38:36.568919+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'113","last_scrub_stamp":"2024-09-12T01:38:36.568765+0000","last_deep_scrub":"263'113","last_deep_scrub_stamp":"2024-09-12T01:38:36.568765+0000","last_clean_scrub_stamp":"2024-09-12T01:38:36.568765+0000","objects_scrubbed":8,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:59.133727+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":155,"num_read_kb":148,"num_write":156,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"263'761","reported_seq":2436,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:29.172033+0000","last_change":"2024-09-12T01:38:29.172033+0000","last_active":"2024-09-12T01:38:29.172033+0000","last_peered":"2024-09-12T01:38:29.172033+0000","last_clean":"2024-09-12T01:38:29.172033+0000","last_became_active":"2024-09-12T00:28:39.216704+0000","last_became_peered":"2024-09-12T00:28:39.216704+0000","last_unstale":"2024-09-12T01:38:29.172033+0000","last_undegraded":"2024-09-12T01:38:29.172033+0000","last_fullsized":"2024-09-12T01:38:29.172033+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'761","last_scrub_stamp":"2024-09-12T01:38:29.171921+0000","last_deep_scrub":"263'761","last_deep_scrub_stamp":"2024-09-12T01:38:29.171921+0000","last_clean_scrub_stamp":"2024-09-12T01:38:29.171921+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:55.063995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"263'158","reported_seq":665,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:41.543232+0000","last_change":"2024-09-12T01:38:41.543158+0000","last_active":"2024-09-12T01:38:41.543232+0000","last_peered":"2024-09-12T01:38:41.543232+0000","last_clean":"2024-09-12T01:38:41.543232+0000","last_became_active":"2024-09-12T00:28:41.227892+0000","last_became_peered":"2024-09-12T00:28:41.227892+0000","last_unstale":"2024-09-12T01:38:41.543232+0000","last_undegraded":"2024-09-12T01:38:41.543232+0000","last_fullsized":"2024-09-12T01:38:41.543232+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'158","last_scrub_stamp":"2024-09-12T01:38:41.543080+0000","last_deep_scrub":"263'158","last_deep_scrub_stamp":"2024-09-12T01:38:41.543080+0000","last_clean_scrub_stamp":"2024-09-12T01:38:41.543080+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:33.584634+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":160,"num_read_kb":153,"num_write":389,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"263'138","reported_seq":726,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.484957+0000","last_change":"2024-09-12T01:38:19.484876+0000","last_active":"2024-09-12T01:38:19.484957+0000","last_peered":"2024-09-12T01:38:19.484957+0000","last_clean":"2024-09-12T01:38:19.484957+0000","last_became_active":"2024-09-12T00:28:33.204722+0000","last_became_peered":"2024-09-12T00:28:33.204722+0000","last_unstale":"2024-09-12T01:38:19.484957+0000","last_undegraded":"2024-09-12T01:38:19.484957+0000","last_fullsized":"2024-09-12T01:38:19.484957+0000","mapping_epoch":27,"log_start":"260'100","ondisk_log_start":"260'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'138","last_scrub_stamp":"2024-09-12T01:38:19.484796+0000","last_deep_scrub":"263'138","last_deep_scrub_stamp":"2024-09-12T01:38:19.484796+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.484796+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:49.740120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":575,"num_read_kb":467,"num_write":204,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"263'333","reported_seq":1060,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.360468+0000","last_change":"2024-09-12T01:38:15.360411+0000","last_active":"2024-09-12T01:38:15.360468+0000","last_peered":"2024-09-12T01:38:15.360468+0000","last_clean":"2024-09-12T01:38:15.360468+0000","last_became_active":"2024-09-12T00:28:31.212597+0000","last_became_peered":"2024-09-12T00:28:31.212597+0000","last_unstale":"2024-09-12T01:38:15.360468+0000","last_undegraded":"2024-09-12T01:38:15.360468+0000","last_fullsized":"2024-09-12T01:38:15.360468+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'333","last_scrub_stamp":"2024-09-12T01:38:15.360299+0000","last_deep_scrub":"263'333","last_deep_scrub_stamp":"2024-09-12T01:38:15.360299+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.360299+0000","objects_scrubbed":8,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:04.968900+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":273370,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":704,"num_read_kb":2179,"num_write":1113,"num_write_kb":612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:31.368857+0000","last_change":"2024-09-12T01:38:31.368762+0000","last_active":"2024-09-12T01:38:31.368857+0000","last_peered":"2024-09-12T01:38:31.368857+0000","last_clean":"2024-09-12T01:38:31.368857+0000","last_became_active":"2024-09-12T00:28:35.210710+0000","last_became_peered":"2024-09-12T00:28:35.210710+0000","last_unstale":"2024-09-12T01:38:31.368857+0000","last_undegraded":"2024-09-12T01:38:31.368857+0000","last_fullsized":"2024-09-12T01:38:31.368857+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:31.368656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:31.368656+0000","last_clean_scrub_stamp":"2024-09-12T01:38:31.368656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:16.021928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"263'398","reported_seq":1024,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.460744+0000","last_change":"2024-09-12T01:38:38.460680+0000","last_active":"2024-09-12T01:38:38.460744+0000","last_peered":"2024-09-12T01:38:38.460744+0000","last_clean":"2024-09-12T01:38:38.460744+0000","last_became_active":"2024-09-12T00:28:37.210317+0000","last_became_peered":"2024-09-12T00:28:37.210317+0000","last_unstale":"2024-09-12T01:38:38.460744+0000","last_undegraded":"2024-09-12T01:38:38.460744+0000","last_fullsized":"2024-09-12T01:38:38.460744+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'398","last_scrub_stamp":"2024-09-12T01:38:38.460579+0000","last_deep_scrub":"263'398","last_deep_scrub_stamp":"2024-09-12T01:38:38.460579+0000","last_clean_scrub_stamp":"2024-09-12T01:38:38.460579+0000","objects_scrubbed":11,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:30.726197+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56512,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":649,"num_read_kb":1465,"num_write":528,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.223854+0000","last_change":"2024-09-12T01:38:38.223786+0000","last_active":"2024-09-12T01:38:38.223854+0000","last_peered":"2024-09-12T01:38:38.223854+0000","last_clean":"2024-09-12T01:38:38.223854+0000","last_became_active":"2024-09-12T00:28:39.218026+0000","last_became_peered":"2024-09-12T00:28:39.218026+0000","last_unstale":"2024-09-12T01:38:38.223854+0000","last_undegraded":"2024-09-12T01:38:38.223854+0000","last_fullsized":"2024-09-12T01:38:38.223854+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:38.223690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:38.223690+0000","last_clean_scrub_stamp":"2024-09-12T01:38:38.223690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:28.393080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"263'136","reported_seq":641,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:42.583111+0000","last_change":"2024-09-12T01:38:42.583044+0000","last_active":"2024-09-12T01:38:42.583111+0000","last_peered":"2024-09-12T01:38:42.583111+0000","last_clean":"2024-09-12T01:38:42.583111+0000","last_became_active":"2024-09-12T00:28:41.231611+0000","last_became_peered":"2024-09-12T00:28:41.231611+0000","last_unstale":"2024-09-12T01:38:42.583111+0000","last_undegraded":"2024-09-12T01:38:42.583111+0000","last_fullsized":"2024-09-12T01:38:42.583111+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'136","last_scrub_stamp":"2024-09-12T01:38:42.582959+0000","last_deep_scrub":"263'136","last_deep_scrub_stamp":"2024-09-12T01:38:42.582959+0000","last_clean_scrub_stamp":"2024-09-12T01:38:42.582959+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:49.631045+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":625,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":135,"num_read_kb":130,"num_write":322,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"263'92","reported_seq":682,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.500242+0000","last_change":"2024-09-12T01:38:18.500153+0000","last_active":"2024-09-12T01:38:18.500242+0000","last_peered":"2024-09-12T01:38:18.500242+0000","last_clean":"2024-09-12T01:38:18.500242+0000","last_became_active":"2024-09-12T00:28:33.204653+0000","last_became_peered":"2024-09-12T00:28:33.204653+0000","last_unstale":"2024-09-12T01:38:18.500242+0000","last_undegraded":"2024-09-12T01:38:18.500242+0000","last_fullsized":"2024-09-12T01:38:18.500242+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'92","last_scrub_stamp":"2024-09-12T01:38:18.500029+0000","last_deep_scrub":"263'92","last_deep_scrub_stamp":"2024-09-12T01:38:18.500029+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.500029+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:53.561967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":393,"num_read_kb":329,"num_write":145,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"263'433","reported_seq":1134,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.354376+0000","last_change":"2024-09-12T01:38:14.354322+0000","last_active":"2024-09-12T01:38:14.354376+0000","last_peered":"2024-09-12T01:38:14.354376+0000","last_clean":"2024-09-12T01:38:14.354376+0000","last_became_active":"2024-09-12T00:28:31.212752+0000","last_became_peered":"2024-09-12T00:28:31.212752+0000","last_unstale":"2024-09-12T01:38:14.354376+0000","last_undegraded":"2024-09-12T01:38:14.354376+0000","last_fullsized":"2024-09-12T01:38:14.354376+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'433","last_scrub_stamp":"2024-09-12T01:38:14.354219+0000","last_deep_scrub":"263'433","last_deep_scrub_stamp":"2024-09-12T01:38:14.354219+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.354219+0000","objects_scrubbed":4,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:39.547985+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":804,"num_read_kb":13300,"num_write":1374,"num_write_kb":24353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.427926+0000","last_change":"2024-09-12T01:38:35.427842+0000","last_active":"2024-09-12T01:38:35.427926+0000","last_peered":"2024-09-12T01:38:35.427926+0000","last_clean":"2024-09-12T01:38:35.427926+0000","last_became_active":"2024-09-12T00:28:35.207869+0000","last_became_peered":"2024-09-12T00:28:35.207869+0000","last_unstale":"2024-09-12T01:38:35.427926+0000","last_undegraded":"2024-09-12T01:38:35.427926+0000","last_fullsized":"2024-09-12T01:38:35.427926+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.427738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.427738+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.427738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:41.370814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"263'315","reported_seq":907,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:34.185555+0000","last_change":"2024-09-12T01:38:34.185494+0000","last_active":"2024-09-12T01:38:34.185555+0000","last_peered":"2024-09-12T01:38:34.185555+0000","last_clean":"2024-09-12T01:38:34.185555+0000","last_became_active":"2024-09-12T00:28:37.221289+0000","last_became_peered":"2024-09-12T00:28:37.221289+0000","last_unstale":"2024-09-12T01:38:34.185555+0000","last_undegraded":"2024-09-12T01:38:34.185555+0000","last_fullsized":"2024-09-12T01:38:34.185555+0000","mapping_epoch":31,"log_start":"263'301","ondisk_log_start":"263'301","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'315","last_scrub_stamp":"2024-09-12T01:38:34.185391+0000","last_deep_scrub":"263'315","last_deep_scrub_stamp":"2024-09-12T01:38:34.185391+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.185391+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":301,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:47.522388+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57095,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":538,"num_read_kb":1320,"num_write":444,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:28.207523+0000","last_change":"2024-09-12T01:38:28.207406+0000","last_active":"2024-09-12T01:38:28.207523+0000","last_peered":"2024-09-12T01:38:28.207523+0000","last_clean":"2024-09-12T01:38:28.207523+0000","last_became_active":"2024-09-12T00:28:39.216943+0000","last_became_peered":"2024-09-12T00:28:39.216943+0000","last_unstale":"2024-09-12T01:38:28.207523+0000","last_undegraded":"2024-09-12T01:38:28.207523+0000","last_fullsized":"2024-09-12T01:38:28.207523+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:28.207315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:28.207315+0000","last_clean_scrub_stamp":"2024-09-12T01:38:28.207315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:05.089077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"263'141","reported_seq":687,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:48.359160+0000","last_change":"2024-09-12T01:38:48.359072+0000","last_active":"2024-09-12T01:38:48.359160+0000","last_peered":"2024-09-12T01:38:48.359160+0000","last_clean":"2024-09-12T01:38:48.359160+0000","last_became_active":"2024-09-12T00:28:41.257796+0000","last_became_peered":"2024-09-12T00:28:41.257796+0000","last_unstale":"2024-09-12T01:38:48.359160+0000","last_undegraded":"2024-09-12T01:38:48.359160+0000","last_fullsized":"2024-09-12T01:38:48.359160+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'141","last_scrub_stamp":"2024-09-12T01:38:48.358956+0000","last_deep_scrub":"263'141","last_deep_scrub_stamp":"2024-09-12T01:38:48.358956+0000","last_clean_scrub_stamp":"2024-09-12T01:38:48.358956+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:50.381734+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":982,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":234,"num_read_kb":212,"num_write":368,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"263'74","reported_seq":638,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.199043+0000","last_change":"2024-09-12T01:38:20.198985+0000","last_active":"2024-09-12T01:38:20.199043+0000","last_peered":"2024-09-12T01:38:20.199043+0000","last_clean":"2024-09-12T01:38:20.199043+0000","last_became_active":"2024-09-12T00:28:33.205832+0000","last_became_peered":"2024-09-12T00:28:33.205832+0000","last_unstale":"2024-09-12T01:38:20.199043+0000","last_undegraded":"2024-09-12T01:38:20.199043+0000","last_fullsized":"2024-09-12T01:38:20.199043+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'74","last_scrub_stamp":"2024-09-12T01:38:20.198893+0000","last_deep_scrub":"263'74","last_deep_scrub_stamp":"2024-09-12T01:38:20.198893+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.198893+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:19.080369+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":322,"num_read_kb":264,"num_write":102,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"263'347","reported_seq":991,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.179671+0000","last_change":"2024-09-12T01:38:19.179612+0000","last_active":"2024-09-12T01:38:19.179671+0000","last_peered":"2024-09-12T01:38:19.179671+0000","last_clean":"2024-09-12T01:38:19.179671+0000","last_became_active":"2024-09-12T00:28:31.200234+0000","last_became_peered":"2024-09-12T00:28:31.200234+0000","last_unstale":"2024-09-12T01:38:19.179671+0000","last_undegraded":"2024-09-12T01:38:19.179671+0000","last_fullsized":"2024-09-12T01:38:19.179671+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'347","last_scrub_stamp":"2024-09-12T01:38:19.179470+0000","last_deep_scrub":"263'347","last_deep_scrub_stamp":"2024-09-12T01:38:19.179470+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.179470+0000","objects_scrubbed":10,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:23.079099+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262245,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":466,"num_read_kb":15822,"num_write":1094,"num_write_kb":25857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:33.496440+0000","last_change":"2024-09-12T01:38:33.496358+0000","last_active":"2024-09-12T01:38:33.496440+0000","last_peered":"2024-09-12T01:38:33.496440+0000","last_clean":"2024-09-12T01:38:33.496440+0000","last_became_active":"2024-09-12T00:28:35.206597+0000","last_became_peered":"2024-09-12T00:28:35.206597+0000","last_unstale":"2024-09-12T01:38:33.496440+0000","last_undegraded":"2024-09-12T01:38:33.496440+0000","last_fullsized":"2024-09-12T01:38:33.496440+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:33.496234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:33.496234+0000","last_clean_scrub_stamp":"2024-09-12T01:38:33.496234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:18.065199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"263'283","reported_seq":861,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:39.323453+0000","last_change":"2024-09-12T01:38:39.323392+0000","last_active":"2024-09-12T01:38:39.323453+0000","last_peered":"2024-09-12T01:38:39.323453+0000","last_clean":"2024-09-12T01:38:39.323453+0000","last_became_active":"2024-09-12T00:28:37.219652+0000","last_became_peered":"2024-09-12T00:28:37.219652+0000","last_unstale":"2024-09-12T01:38:39.323453+0000","last_undegraded":"2024-09-12T01:38:39.323453+0000","last_fullsized":"2024-09-12T01:38:39.323453+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'283","last_scrub_stamp":"2024-09-12T01:38:39.323294+0000","last_deep_scrub":"263'283","last_deep_scrub_stamp":"2024-09-12T01:38:39.323294+0000","last_clean_scrub_stamp":"2024-09-12T01:38:39.323294+0000","objects_scrubbed":3,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:13.768409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49715,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":473,"num_read_kb":1234,"num_write":394,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:39.514683+0000","last_change":"2024-09-12T01:38:39.514598+0000","last_active":"2024-09-12T01:38:39.514683+0000","last_peered":"2024-09-12T01:38:39.514683+0000","last_clean":"2024-09-12T01:38:39.514683+0000","last_became_active":"2024-09-12T00:28:39.217869+0000","last_became_peered":"2024-09-12T00:28:39.217869+0000","last_unstale":"2024-09-12T01:38:39.514683+0000","last_undegraded":"2024-09-12T01:38:39.514683+0000","last_fullsized":"2024-09-12T01:38:39.514683+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:39.514499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:39.514499+0000","last_clean_scrub_stamp":"2024-09-12T01:38:39.514499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:15.359627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"263'195","reported_seq":1301,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:43.611117+0000","last_change":"2024-09-12T01:38:43.611045+0000","last_active":"2024-09-12T01:38:43.611117+0000","last_peered":"2024-09-12T01:38:43.611117+0000","last_clean":"2024-09-12T01:38:43.611117+0000","last_became_active":"2024-09-12T00:28:41.232040+0000","last_became_peered":"2024-09-12T00:28:41.232040+0000","last_unstale":"2024-09-12T01:38:43.611117+0000","last_undegraded":"2024-09-12T01:38:43.611117+0000","last_fullsized":"2024-09-12T01:38:43.611117+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'195","last_scrub_stamp":"2024-09-12T01:38:43.610955+0000","last_deep_scrub":"263'195","last_deep_scrub_stamp":"2024-09-12T01:38:43.610955+0000","last_clean_scrub_stamp":"2024-09-12T01:38:43.610955+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:32.696507+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":841,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":800,"num_read_kb":795,"num_write":450,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"263'254","reported_seq":922,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.516726+0000","last_change":"2024-09-12T01:38:15.516670+0000","last_active":"2024-09-12T01:38:15.516726+0000","last_peered":"2024-09-12T01:38:15.516726+0000","last_clean":"2024-09-12T01:38:15.516726+0000","last_became_active":"2024-09-12T00:28:33.208787+0000","last_became_peered":"2024-09-12T00:28:33.208787+0000","last_unstale":"2024-09-12T01:38:15.516726+0000","last_undegraded":"2024-09-12T01:38:15.516726+0000","last_fullsized":"2024-09-12T01:38:15.516726+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'254","last_scrub_stamp":"2024-09-12T01:38:15.516591+0000","last_deep_scrub":"263'254","last_deep_scrub_stamp":"2024-09-12T01:38:15.516591+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.516591+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:22.435596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1164,"num_read_kb":956,"num_write":405,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"263'322","reported_seq":1078,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.049656+0000","last_change":"2024-09-12T01:38:12.049656+0000","last_active":"2024-09-12T01:38:12.049656+0000","last_peered":"2024-09-12T01:38:12.049656+0000","last_clean":"2024-09-12T01:38:12.049656+0000","last_became_active":"2024-09-12T00:29:04.274746+0000","last_became_peered":"2024-09-12T00:29:04.274746+0000","last_unstale":"2024-09-12T01:38:12.049656+0000","last_undegraded":"2024-09-12T01:38:12.049656+0000","last_fullsized":"2024-09-12T01:38:12.049656+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'322","last_scrub_stamp":"2024-09-12T01:38:12.049537+0000","last_deep_scrub":"263'322","last_deep_scrub_stamp":"2024-09-12T01:38:12.049537+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.049537+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:42.701831+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524334,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":565,"num_read_kb":52761,"num_write":1033,"num_write_kb":38285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"263'6","reported_seq":997,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:24.038564+0000","last_change":"2024-09-12T01:38:24.038504+0000","last_active":"2024-09-12T01:38:24.038564+0000","last_peered":"2024-09-12T01:38:24.038564+0000","last_clean":"2024-09-12T01:38:24.038564+0000","last_became_active":"2024-09-12T00:28:35.207332+0000","last_became_peered":"2024-09-12T00:28:35.207332+0000","last_unstale":"2024-09-12T01:38:24.038564+0000","last_undegraded":"2024-09-12T01:38:24.038564+0000","last_fullsized":"2024-09-12T01:38:24.038564+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-12T01:38:24.038400+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-12T01:38:24.038400+0000","last_clean_scrub_stamp":"2024-09-12T01:38:24.038400+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:33.692701+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"263'331","reported_seq":945,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.563535+0000","last_change":"2024-09-12T01:38:35.563468+0000","last_active":"2024-09-12T01:38:35.563535+0000","last_peered":"2024-09-12T01:38:35.563535+0000","last_clean":"2024-09-12T01:38:35.563535+0000","last_became_active":"2024-09-12T00:28:37.207373+0000","last_became_peered":"2024-09-12T00:28:37.207373+0000","last_unstale":"2024-09-12T01:38:35.563535+0000","last_undegraded":"2024-09-12T01:38:35.563535+0000","last_fullsized":"2024-09-12T01:38:35.563535+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'331","last_scrub_stamp":"2024-09-12T01:38:35.563375+0000","last_deep_scrub":"263'331","last_deep_scrub_stamp":"2024-09-12T01:38:35.563375+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.563375+0000","objects_scrubbed":6,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:36.551810+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45135,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":515,"num_read_kb":1089,"num_write":408,"num_write_kb":271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:40.196233+0000","last_change":"2024-09-12T01:38:40.196160+0000","last_active":"2024-09-12T01:38:40.196233+0000","last_peered":"2024-09-12T01:38:40.196233+0000","last_clean":"2024-09-12T01:38:40.196233+0000","last_became_active":"2024-09-12T00:28:39.215651+0000","last_became_peered":"2024-09-12T00:28:39.215651+0000","last_unstale":"2024-09-12T01:38:40.196233+0000","last_undegraded":"2024-09-12T01:38:40.196233+0000","last_fullsized":"2024-09-12T01:38:40.196233+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:40.196075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:40.196075+0000","last_clean_scrub_stamp":"2024-09-12T01:38:40.196075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:01.668864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"263'135","reported_seq":641,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:41.532450+0000","last_change":"2024-09-12T01:38:41.532394+0000","last_active":"2024-09-12T01:38:41.532450+0000","last_peered":"2024-09-12T01:38:41.532450+0000","last_clean":"2024-09-12T01:38:41.532450+0000","last_became_active":"2024-09-12T00:28:41.226687+0000","last_became_peered":"2024-09-12T00:28:41.226687+0000","last_unstale":"2024-09-12T01:38:41.532450+0000","last_undegraded":"2024-09-12T01:38:41.532450+0000","last_fullsized":"2024-09-12T01:38:41.532450+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'135","last_scrub_stamp":"2024-09-12T01:38:41.532303+0000","last_deep_scrub":"263'135","last_deep_scrub_stamp":"2024-09-12T01:38:41.532303+0000","last_clean_scrub_stamp":"2024-09-12T01:38:41.532303+0000","objects_scrubbed":3,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:48.267743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":132,"num_read_kb":117,"num_write":304,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"263'293","reported_seq":931,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.060156+0000","last_change":"2024-09-12T01:38:21.060156+0000","last_active":"2024-09-12T01:38:21.060156+0000","last_peered":"2024-09-12T01:38:21.060156+0000","last_clean":"2024-09-12T01:38:21.060156+0000","last_became_active":"2024-09-12T00:28:33.210635+0000","last_became_peered":"2024-09-12T00:28:33.210635+0000","last_unstale":"2024-09-12T01:38:21.060156+0000","last_undegraded":"2024-09-12T01:38:21.060156+0000","last_fullsized":"2024-09-12T01:38:21.060156+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'293","last_scrub_stamp":"2024-09-12T01:38:21.060078+0000","last_deep_scrub":"263'293","last_deep_scrub_stamp":"2024-09-12T01:38:21.060078+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.060078+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:54.397394+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1259,"num_read_kb":1011,"num_write":460,"num_write_kb":225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"263'338","reported_seq":966,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.121833+0000","last_change":"2024-09-12T01:38:12.121833+0000","last_active":"2024-09-12T01:38:12.121833+0000","last_peered":"2024-09-12T01:38:12.121833+0000","last_clean":"2024-09-12T01:38:12.121833+0000","last_became_active":"2024-09-12T00:28:31.206672+0000","last_became_peered":"2024-09-12T00:28:31.206672+0000","last_unstale":"2024-09-12T01:38:12.121833+0000","last_undegraded":"2024-09-12T01:38:12.121833+0000","last_fullsized":"2024-09-12T01:38:12.121833+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'338","last_scrub_stamp":"2024-09-12T01:38:12.121735+0000","last_deep_scrub":"263'338","last_deep_scrub_stamp":"2024-09-12T01:38:12.121735+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.121735+0000","objects_scrubbed":6,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:41.412623+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661307,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":464,"num_read_kb":11577,"num_write":1050,"num_write_kb":29091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"263'314","reported_seq":949,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.088957+0000","last_change":"2024-09-12T01:38:16.088957+0000","last_active":"2024-09-12T01:38:16.088957+0000","last_peered":"2024-09-12T01:38:16.088957+0000","last_clean":"2024-09-12T01:38:16.088957+0000","last_became_active":"2024-09-12T00:28:33.206512+0000","last_became_peered":"2024-09-12T00:28:33.206512+0000","last_unstale":"2024-09-12T01:38:16.088957+0000","last_undegraded":"2024-09-12T01:38:16.088957+0000","last_fullsized":"2024-09-12T01:38:16.088957+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'314","last_scrub_stamp":"2024-09-12T01:38:16.088862+0000","last_deep_scrub":"263'314","last_deep_scrub_stamp":"2024-09-12T01:38:16.088862+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.088862+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:00.843923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1325,"num_read_kb":1067,"num_write":489,"num_write_kb":251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"263'331","reported_seq":978,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:08.834993+0000","last_change":"2024-09-12T01:38:08.834993+0000","last_active":"2024-09-12T01:38:08.834993+0000","last_peered":"2024-09-12T01:38:08.834993+0000","last_clean":"2024-09-12T01:38:08.834993+0000","last_became_active":"2024-09-12T00:29:04.271753+0000","last_became_peered":"2024-09-12T00:29:04.271753+0000","last_unstale":"2024-09-12T01:38:08.834993+0000","last_undegraded":"2024-09-12T01:38:08.834993+0000","last_fullsized":"2024-09-12T01:38:08.834993+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'331","last_scrub_stamp":"2024-09-12T01:38:08.834925+0000","last_deep_scrub":"263'331","last_deep_scrub_stamp":"2024-09-12T01:38:08.834925+0000","last_clean_scrub_stamp":"2024-09-12T01:38:08.834925+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:41.298044+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":504,"num_read_kb":1624,"num_write":1034,"num_write_kb":30525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"263'350","reported_seq":969,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:26.390197+0000","last_change":"2024-09-12T01:38:26.390197+0000","last_active":"2024-09-12T01:38:26.390197+0000","last_peered":"2024-09-12T01:38:26.390197+0000","last_clean":"2024-09-12T01:38:26.390197+0000","last_became_active":"2024-09-12T00:28:33.214679+0000","last_became_peered":"2024-09-12T00:28:33.214679+0000","last_unstale":"2024-09-12T01:38:26.390197+0000","last_undegraded":"2024-09-12T01:38:26.390197+0000","last_fullsized":"2024-09-12T01:38:26.390197+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'350","last_scrub_stamp":"2024-09-12T01:38:26.390114+0000","last_deep_scrub":"263'350","last_deep_scrub_stamp":"2024-09-12T01:38:26.390114+0000","last_clean_scrub_stamp":"2024-09-12T01:38:26.390114+0000","objects_scrubbed":1,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:19.138258+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1495,"num_read_kb":1194,"num_write":562,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"263'379","reported_seq":1054,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.375518+0000","last_change":"2024-09-12T01:38:16.375518+0000","last_active":"2024-09-12T01:38:16.375518+0000","last_peered":"2024-09-12T01:38:16.375518+0000","last_clean":"2024-09-12T01:38:16.375518+0000","last_became_active":"2024-09-12T00:28:31.209266+0000","last_became_peered":"2024-09-12T00:28:31.209266+0000","last_unstale":"2024-09-12T01:38:16.375518+0000","last_undegraded":"2024-09-12T01:38:16.375518+0000","last_fullsized":"2024-09-12T01:38:16.375518+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'379","last_scrub_stamp":"2024-09-12T01:38:16.375401+0000","last_deep_scrub":"263'379","last_deep_scrub_stamp":"2024-09-12T01:38:16.375401+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.375401+0000","objects_scrubbed":15,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:39.836701+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2581681,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":574,"num_read_kb":38602,"num_write":1242,"num_write_kb":22367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"263'105","reported_seq":698,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.041650+0000","last_change":"2024-09-12T01:38:17.041650+0000","last_active":"2024-09-12T01:38:17.041650+0000","last_peered":"2024-09-12T01:38:17.041650+0000","last_clean":"2024-09-12T01:38:17.041650+0000","last_became_active":"2024-09-12T00:28:33.213020+0000","last_became_peered":"2024-09-12T00:28:33.213020+0000","last_unstale":"2024-09-12T01:38:17.041650+0000","last_undegraded":"2024-09-12T01:38:17.041650+0000","last_fullsized":"2024-09-12T01:38:17.041650+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'105","last_scrub_stamp":"2024-09-12T01:38:17.041548+0000","last_deep_scrub":"263'105","last_deep_scrub_stamp":"2024-09-12T01:38:17.041548+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.041548+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:31.379735+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":435,"num_read_kb":365,"num_write":138,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"263'312","reported_seq":1058,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.130935+0000","last_change":"2024-09-12T01:38:19.130935+0000","last_active":"2024-09-12T01:38:19.130935+0000","last_peered":"2024-09-12T01:38:19.130935+0000","last_clean":"2024-09-12T01:38:19.130935+0000","last_became_active":"2024-09-12T00:28:31.208548+0000","last_became_peered":"2024-09-12T00:28:31.208548+0000","last_unstale":"2024-09-12T01:38:19.130935+0000","last_undegraded":"2024-09-12T01:38:19.130935+0000","last_fullsized":"2024-09-12T01:38:19.130935+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'312","last_scrub_stamp":"2024-09-12T01:38:19.130834+0000","last_deep_scrub":"263'312","last_deep_scrub_stamp":"2024-09-12T01:38:19.130834+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.130834+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:32.788994+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49275,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":734,"num_read_kb":31441,"num_write":965,"num_write_kb":36605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"263'125","reported_seq":769,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:23.259183+0000","last_change":"2024-09-12T01:38:23.259183+0000","last_active":"2024-09-12T01:38:23.259183+0000","last_peered":"2024-09-12T01:38:23.259183+0000","last_clean":"2024-09-12T01:38:23.259183+0000","last_became_active":"2024-09-12T00:28:33.217573+0000","last_became_peered":"2024-09-12T00:28:33.217573+0000","last_unstale":"2024-09-12T01:38:23.259183+0000","last_undegraded":"2024-09-12T01:38:23.259183+0000","last_fullsized":"2024-09-12T01:38:23.259183+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'125","last_scrub_stamp":"2024-09-12T01:38:23.259101+0000","last_deep_scrub":"263'125","last_deep_scrub_stamp":"2024-09-12T01:38:23.259101+0000","last_clean_scrub_stamp":"2024-09-12T01:38:23.259101+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:11.077813+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":588,"num_read_kb":500,"num_write":193,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"263'360","reported_seq":1010,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:09.821543+0000","last_change":"2024-09-12T01:38:09.821485+0000","last_active":"2024-09-12T01:38:09.821543+0000","last_peered":"2024-09-12T01:38:09.821543+0000","last_clean":"2024-09-12T01:38:09.821543+0000","last_became_active":"2024-09-12T00:29:04.267546+0000","last_became_peered":"2024-09-12T00:29:04.267546+0000","last_unstale":"2024-09-12T01:38:09.821543+0000","last_undegraded":"2024-09-12T01:38:09.821543+0000","last_fullsized":"2024-09-12T01:38:09.821543+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'360","last_scrub_stamp":"2024-09-12T01:38:09.821400+0000","last_deep_scrub":"263'360","last_deep_scrub_stamp":"2024-09-12T01:38:09.821400+0000","last_clean_scrub_stamp":"2024-09-12T01:38:09.821400+0000","objects_scrubbed":8,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:41.679527+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2316165,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":596,"num_read_kb":3307,"num_write":1233,"num_write_kb":18821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"263'309","reported_seq":1011,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.491401+0000","last_change":"2024-09-12T01:38:21.491401+0000","last_active":"2024-09-12T01:38:21.491401+0000","last_peered":"2024-09-12T01:38:21.491401+0000","last_clean":"2024-09-12T01:38:21.491401+0000","last_became_active":"2024-09-12T00:28:33.208929+0000","last_became_peered":"2024-09-12T00:28:33.208929+0000","last_unstale":"2024-09-12T01:38:21.491401+0000","last_undegraded":"2024-09-12T01:38:21.491401+0000","last_fullsized":"2024-09-12T01:38:21.491401+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'309","last_scrub_stamp":"2024-09-12T01:38:21.491305+0000","last_deep_scrub":"263'309","last_deep_scrub_stamp":"2024-09-12T01:38:21.491305+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.491305+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:34.771827+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1423,"num_read_kb":1158,"num_write":481,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4001,"num_omap_keys":18,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"263'317","reported_seq":967,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.214608+0000","last_change":"2024-09-12T01:38:11.214608+0000","last_active":"2024-09-12T01:38:11.214608+0000","last_peered":"2024-09-12T01:38:11.214608+0000","last_clean":"2024-09-12T01:38:11.214608+0000","last_became_active":"2024-09-12T00:28:31.205829+0000","last_became_peered":"2024-09-12T00:28:31.205829+0000","last_unstale":"2024-09-12T01:38:11.214608+0000","last_undegraded":"2024-09-12T01:38:11.214608+0000","last_fullsized":"2024-09-12T01:38:11.214608+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'317","last_scrub_stamp":"2024-09-12T01:38:11.214498+0000","last_deep_scrub":"263'317","last_deep_scrub_stamp":"2024-09-12T01:38:11.214498+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.214498+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:14.918145+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262189,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":453,"num_read_kb":5277,"num_write":1032,"num_write_kb":26638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"263'110","reported_seq":707,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.225675+0000","last_change":"2024-09-12T01:38:21.225675+0000","last_active":"2024-09-12T01:38:21.225675+0000","last_peered":"2024-09-12T01:38:21.225675+0000","last_clean":"2024-09-12T01:38:21.225675+0000","last_became_active":"2024-09-12T00:28:33.208010+0000","last_became_peered":"2024-09-12T00:28:33.208010+0000","last_unstale":"2024-09-12T01:38:21.225675+0000","last_undegraded":"2024-09-12T01:38:21.225675+0000","last_fullsized":"2024-09-12T01:38:21.225675+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'110","last_scrub_stamp":"2024-09-12T01:38:21.225579+0000","last_deep_scrub":"263'110","last_deep_scrub_stamp":"2024-09-12T01:38:21.225579+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.225579+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:01.368932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":481,"num_read_kb":401,"num_write":165,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"263'372","reported_seq":1022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.127767+0000","last_change":"2024-09-12T01:38:15.127767+0000","last_active":"2024-09-12T01:38:15.127767+0000","last_peered":"2024-09-12T01:38:15.127767+0000","last_clean":"2024-09-12T01:38:15.127767+0000","last_became_active":"2024-09-12T00:28:31.205366+0000","last_became_peered":"2024-09-12T00:28:31.205366+0000","last_unstale":"2024-09-12T01:38:15.127767+0000","last_undegraded":"2024-09-12T01:38:15.127767+0000","last_fullsized":"2024-09-12T01:38:15.127767+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'372","last_scrub_stamp":"2024-09-12T01:38:15.127655+0000","last_deep_scrub":"263'372","last_deep_scrub_stamp":"2024-09-12T01:38:15.127655+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.127655+0000","objects_scrubbed":3,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:47.340053+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":592,"num_read_kb":12807,"num_write":1213,"num_write_kb":27426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"263'207","reported_seq":835,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.245276+0000","last_change":"2024-09-12T01:38:20.245276+0000","last_active":"2024-09-12T01:38:20.245276+0000","last_peered":"2024-09-12T01:38:20.245276+0000","last_clean":"2024-09-12T01:38:20.245276+0000","last_became_active":"2024-09-12T00:28:33.209028+0000","last_became_peered":"2024-09-12T00:28:33.209028+0000","last_unstale":"2024-09-12T01:38:20.245276+0000","last_undegraded":"2024-09-12T01:38:20.245276+0000","last_fullsized":"2024-09-12T01:38:20.245276+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'207","last_scrub_stamp":"2024-09-12T01:38:20.245188+0000","last_deep_scrub":"263'207","last_deep_scrub_stamp":"2024-09-12T01:38:20.245188+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.245188+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:22.561594+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":877,"num_read_kb":721,"num_write":304,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":758,"num_omap_keys":4,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"263'330","reported_seq":1007,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.216893+0000","last_change":"2024-09-12T01:38:12.216893+0000","last_active":"2024-09-12T01:38:12.216893+0000","last_peered":"2024-09-12T01:38:12.216893+0000","last_clean":"2024-09-12T01:38:12.216893+0000","last_became_active":"2024-09-12T00:28:31.203185+0000","last_became_peered":"2024-09-12T00:28:31.203185+0000","last_unstale":"2024-09-12T01:38:12.216893+0000","last_undegraded":"2024-09-12T01:38:12.216893+0000","last_fullsized":"2024-09-12T01:38:12.216893+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'330","last_scrub_stamp":"2024-09-12T01:38:12.216795+0000","last_deep_scrub":"263'330","last_deep_scrub_stamp":"2024-09-12T01:38:12.216795+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.216795+0000","objects_scrubbed":5,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:53.679636+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524364,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":503,"num_read_kb":88709,"num_write":1042,"num_write_kb":43642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"263'404","reported_seq":1090,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.068469+0000","last_change":"2024-09-12T01:38:16.068399+0000","last_active":"2024-09-12T01:38:16.068469+0000","last_peered":"2024-09-12T01:38:16.068469+0000","last_clean":"2024-09-12T01:38:16.068469+0000","last_became_active":"2024-09-12T00:29:04.275434+0000","last_became_peered":"2024-09-12T00:29:04.275434+0000","last_unstale":"2024-09-12T01:38:16.068469+0000","last_undegraded":"2024-09-12T01:38:16.068469+0000","last_fullsized":"2024-09-12T01:38:16.068469+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'404","last_scrub_stamp":"2024-09-12T01:38:16.068300+0000","last_deep_scrub":"263'404","last_deep_scrub_stamp":"2024-09-12T01:38:16.068300+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.068300+0000","objects_scrubbed":1,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:12.998225+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1782,"num_read_kb":1435,"num_write":639,"num_write_kb":352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"263'335","reported_seq":980,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.350385+0000","last_change":"2024-09-12T01:38:17.350385+0000","last_active":"2024-09-12T01:38:17.350385+0000","last_peered":"2024-09-12T01:38:17.350385+0000","last_clean":"2024-09-12T01:38:17.350385+0000","last_became_active":"2024-09-12T00:28:31.209468+0000","last_became_peered":"2024-09-12T00:28:31.209468+0000","last_unstale":"2024-09-12T01:38:17.350385+0000","last_undegraded":"2024-09-12T01:38:17.350385+0000","last_fullsized":"2024-09-12T01:38:17.350385+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'335","last_scrub_stamp":"2024-09-12T01:38:17.350292+0000","last_deep_scrub":"263'335","last_deep_scrub_stamp":"2024-09-12T01:38:17.350292+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.350292+0000","objects_scrubbed":7,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:50.033794+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6901132,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":496,"num_read_kb":2644,"num_write":1040,"num_write_kb":18676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"263'161","reported_seq":745,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:23.532865+0000","last_change":"2024-09-12T01:38:23.532779+0000","last_active":"2024-09-12T01:38:23.532865+0000","last_peered":"2024-09-12T01:38:23.532865+0000","last_clean":"2024-09-12T01:38:23.532865+0000","last_became_active":"2024-09-12T00:28:33.208285+0000","last_became_peered":"2024-09-12T00:28:33.208285+0000","last_unstale":"2024-09-12T01:38:23.532865+0000","last_undegraded":"2024-09-12T01:38:23.532865+0000","last_fullsized":"2024-09-12T01:38:23.532865+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'161","last_scrub_stamp":"2024-09-12T01:38:23.532688+0000","last_deep_scrub":"263'161","last_deep_scrub_stamp":"2024-09-12T01:38:23.532688+0000","last_clean_scrub_stamp":"2024-09-12T01:38:23.532688+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:07.016907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":689,"num_read_kb":558,"num_write":246,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"263'367","reported_seq":1006,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.197599+0000","last_change":"2024-09-12T01:38:11.197534+0000","last_active":"2024-09-12T01:38:11.197599+0000","last_peered":"2024-09-12T01:38:11.197599+0000","last_clean":"2024-09-12T01:38:11.197599+0000","last_became_active":"2024-09-12T00:28:31.199924+0000","last_became_peered":"2024-09-12T00:28:31.199924+0000","last_unstale":"2024-09-12T01:38:11.197599+0000","last_undegraded":"2024-09-12T01:38:11.197599+0000","last_fullsized":"2024-09-12T01:38:11.197599+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'367","last_scrub_stamp":"2024-09-12T01:38:11.197392+0000","last_deep_scrub":"263'367","last_deep_scrub_stamp":"2024-09-12T01:38:11.197392+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.197392+0000","objects_scrubbed":8,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:53.293586+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":490,"num_read_kb":12716,"num_write":1120,"num_write_kb":44871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"263'322","reported_seq":1008,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.731603+0000","last_change":"2024-09-12T01:38:11.731545+0000","last_active":"2024-09-12T01:38:11.731603+0000","last_peered":"2024-09-12T01:38:11.731603+0000","last_clean":"2024-09-12T01:38:11.731603+0000","last_became_active":"2024-09-12T00:28:33.208088+0000","last_became_peered":"2024-09-12T00:28:33.208088+0000","last_unstale":"2024-09-12T01:38:11.731603+0000","last_undegraded":"2024-09-12T01:38:11.731603+0000","last_fullsized":"2024-09-12T01:38:11.731603+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'322","last_scrub_stamp":"2024-09-12T01:38:11.731432+0000","last_deep_scrub":"263'322","last_deep_scrub_stamp":"2024-09-12T01:38:11.731432+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.731432+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:50.629920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1424,"num_read_kb":1183,"num_write":488,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"263'345","reported_seq":1022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.364820+0000","last_change":"2024-09-12T01:38:19.364820+0000","last_active":"2024-09-12T01:38:19.364820+0000","last_peered":"2024-09-12T01:38:19.364820+0000","last_clean":"2024-09-12T01:38:19.364820+0000","last_became_active":"2024-09-12T00:28:31.211083+0000","last_became_peered":"2024-09-12T00:28:31.211083+0000","last_unstale":"2024-09-12T01:38:19.364820+0000","last_undegraded":"2024-09-12T01:38:19.364820+0000","last_fullsized":"2024-09-12T01:38:19.364820+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'345","last_scrub_stamp":"2024-09-12T01:38:19.364715+0000","last_deep_scrub":"263'345","last_deep_scrub_stamp":"2024-09-12T01:38:19.364715+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.364715+0000","objects_scrubbed":4,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:27.035569+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262163,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":601,"num_read_kb":3403,"num_write":1227,"num_write_kb":8870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"263'153","reported_seq":777,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.523050+0000","last_change":"2024-09-12T01:38:22.523050+0000","last_active":"2024-09-12T01:38:22.523050+0000","last_peered":"2024-09-12T01:38:22.523050+0000","last_clean":"2024-09-12T01:38:22.523050+0000","last_became_active":"2024-09-12T00:28:33.209024+0000","last_became_peered":"2024-09-12T00:28:33.209024+0000","last_unstale":"2024-09-12T01:38:22.523050+0000","last_undegraded":"2024-09-12T01:38:22.523050+0000","last_fullsized":"2024-09-12T01:38:22.523050+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'153","last_scrub_stamp":"2024-09-12T01:38:22.522969+0000","last_deep_scrub":"263'153","last_deep_scrub_stamp":"2024-09-12T01:38:22.522969+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.522969+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:06.711391+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":684,"num_read_kb":599,"num_write":231,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2875,"num_omap_keys":12,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"263'317","reported_seq":944,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.145248+0000","last_change":"2024-09-12T01:38:21.145248+0000","last_active":"2024-09-12T01:38:21.145248+0000","last_peered":"2024-09-12T01:38:21.145248+0000","last_clean":"2024-09-12T01:38:21.145248+0000","last_became_active":"2024-09-12T00:28:31.207399+0000","last_became_peered":"2024-09-12T00:28:31.207399+0000","last_unstale":"2024-09-12T01:38:21.145248+0000","last_undegraded":"2024-09-12T01:38:21.145248+0000","last_fullsized":"2024-09-12T01:38:21.145248+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'317","last_scrub_stamp":"2024-09-12T01:38:21.145153+0000","last_deep_scrub":"263'317","last_deep_scrub_stamp":"2024-09-12T01:38:21.145153+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.145153+0000","objects_scrubbed":8,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:08.962443+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":660490,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":412,"num_read_kb":9232,"num_write":885,"num_write_kb":18206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"263'63","reported_seq":625,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.359615+0000","last_change":"2024-09-12T01:38:22.359615+0000","last_active":"2024-09-12T01:38:22.359615+0000","last_peered":"2024-09-12T01:38:22.359615+0000","last_clean":"2024-09-12T01:38:22.359615+0000","last_became_active":"2024-09-12T00:28:33.213110+0000","last_became_peered":"2024-09-12T00:28:33.213110+0000","last_unstale":"2024-09-12T01:38:22.359615+0000","last_undegraded":"2024-09-12T01:38:22.359615+0000","last_fullsized":"2024-09-12T01:38:22.359615+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'63","last_scrub_stamp":"2024-09-12T01:38:22.359523+0000","last_deep_scrub":"263'63","last_deep_scrub_stamp":"2024-09-12T01:38:22.359523+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.359523+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:22.071319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":226,"num_write":102,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"263'358","reported_seq":1040,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.132038+0000","last_change":"2024-09-12T01:38:11.131978+0000","last_active":"2024-09-12T01:38:11.132038+0000","last_peered":"2024-09-12T01:38:11.132038+0000","last_clean":"2024-09-12T01:38:11.132038+0000","last_became_active":"2024-09-12T00:28:31.203478+0000","last_became_peered":"2024-09-12T00:28:31.203478+0000","last_unstale":"2024-09-12T01:38:11.132038+0000","last_undegraded":"2024-09-12T01:38:11.132038+0000","last_fullsized":"2024-09-12T01:38:11.132038+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'358","last_scrub_stamp":"2024-09-12T01:38:11.131892+0000","last_deep_scrub":"263'358","last_deep_scrub_stamp":"2024-09-12T01:38:11.131892+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.131892+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:45.732319+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":633,"num_read_kb":38935,"num_write":1084,"num_write_kb":32997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"263'193","reported_seq":790,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:25.095313+0000","last_change":"2024-09-12T01:38:25.095313+0000","last_active":"2024-09-12T01:38:25.095313+0000","last_peered":"2024-09-12T01:38:25.095313+0000","last_clean":"2024-09-12T01:38:25.095313+0000","last_became_active":"2024-09-12T00:28:33.220013+0000","last_became_peered":"2024-09-12T00:28:33.220013+0000","last_unstale":"2024-09-12T01:38:25.095313+0000","last_undegraded":"2024-09-12T01:38:25.095313+0000","last_fullsized":"2024-09-12T01:38:25.095313+0000","mapping_epoch":27,"log_start":"260'100","ondisk_log_start":"260'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'193","last_scrub_stamp":"2024-09-12T01:38:25.095217+0000","last_deep_scrub":"263'193","last_deep_scrub_stamp":"2024-09-12T01:38:25.095217+0000","last_clean_scrub_stamp":"2024-09-12T01:38:25.095217+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:10.616066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":806,"num_read_kb":650,"num_write":294,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"263'317","reported_seq":943,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.258336+0000","last_change":"2024-09-12T01:38:19.258278+0000","last_active":"2024-09-12T01:38:19.258336+0000","last_peered":"2024-09-12T01:38:19.258336+0000","last_clean":"2024-09-12T01:38:19.258336+0000","last_became_active":"2024-09-12T00:28:31.204305+0000","last_became_peered":"2024-09-12T00:28:31.204305+0000","last_unstale":"2024-09-12T01:38:19.258336+0000","last_undegraded":"2024-09-12T01:38:19.258336+0000","last_fullsized":"2024-09-12T01:38:19.258336+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'317","last_scrub_stamp":"2024-09-12T01:38:19.258187+0000","last_deep_scrub":"263'317","last_deep_scrub_stamp":"2024-09-12T01:38:19.258187+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.258187+0000","objects_scrubbed":3,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:01.813877+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133653,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":11794,"num_write":1040,"num_write_kb":34532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"263'111","reported_seq":730,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:24.295044+0000","last_change":"2024-09-12T01:38:24.295044+0000","last_active":"2024-09-12T01:38:24.295044+0000","last_peered":"2024-09-12T01:38:24.295044+0000","last_clean":"2024-09-12T01:38:24.295044+0000","last_became_active":"2024-09-12T00:28:33.216814+0000","last_became_peered":"2024-09-12T00:28:33.216814+0000","last_unstale":"2024-09-12T01:38:24.295044+0000","last_undegraded":"2024-09-12T01:38:24.295044+0000","last_fullsized":"2024-09-12T01:38:24.295044+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'111","last_scrub_stamp":"2024-09-12T01:38:24.294958+0000","last_deep_scrub":"263'111","last_deep_scrub_stamp":"2024-09-12T01:38:24.294958+0000","last_clean_scrub_stamp":"2024-09-12T01:38:24.294958+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:08.641709+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":456,"num_read_kb":389,"num_write":151,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":506,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"263'365","reported_seq":1057,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.773208+0000","last_change":"2024-09-12T01:38:10.773147+0000","last_active":"2024-09-12T01:38:10.773208+0000","last_peered":"2024-09-12T01:38:10.773208+0000","last_clean":"2024-09-12T01:38:10.773208+0000","last_became_active":"2024-09-12T00:28:31.200421+0000","last_became_peered":"2024-09-12T00:28:31.200421+0000","last_unstale":"2024-09-12T01:38:10.773208+0000","last_undegraded":"2024-09-12T01:38:10.773208+0000","last_fullsized":"2024-09-12T01:38:10.773208+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'365","last_scrub_stamp":"2024-09-12T01:38:10.773072+0000","last_deep_scrub":"263'365","last_deep_scrub_stamp":"2024-09-12T01:38:10.773072+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.773072+0000","objects_scrubbed":8,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:26.211979+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1658143,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":544,"num_read_kb":83268,"num_write":1180,"num_write_kb":21609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"263'106","reported_seq":692,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:23.404525+0000","last_change":"2024-09-12T01:38:23.404525+0000","last_active":"2024-09-12T01:38:23.404525+0000","last_peered":"2024-09-12T01:38:23.404525+0000","last_clean":"2024-09-12T01:38:23.404525+0000","last_became_active":"2024-09-12T00:28:33.213100+0000","last_became_peered":"2024-09-12T00:28:33.213100+0000","last_unstale":"2024-09-12T01:38:23.404525+0000","last_undegraded":"2024-09-12T01:38:23.404525+0000","last_fullsized":"2024-09-12T01:38:23.404525+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'106","last_scrub_stamp":"2024-09-12T01:38:23.404436+0000","last_deep_scrub":"263'106","last_deep_scrub_stamp":"2024-09-12T01:38:23.404436+0000","last_clean_scrub_stamp":"2024-09-12T01:38:23.404436+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:21.969675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":481,"num_read_kb":399,"num_write":154,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"263'352","reported_seq":1049,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.334977+0000","last_change":"2024-09-12T01:38:20.334920+0000","last_active":"2024-09-12T01:38:20.334977+0000","last_peered":"2024-09-12T01:38:20.334977+0000","last_clean":"2024-09-12T01:38:20.334977+0000","last_became_active":"2024-09-12T00:28:31.215581+0000","last_became_peered":"2024-09-12T00:28:31.215581+0000","last_unstale":"2024-09-12T01:38:20.334977+0000","last_undegraded":"2024-09-12T01:38:20.334977+0000","last_fullsized":"2024-09-12T01:38:20.334977+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'352","last_scrub_stamp":"2024-09-12T01:38:20.334798+0000","last_deep_scrub":"263'352","last_deep_scrub_stamp":"2024-09-12T01:38:20.334798+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.334798+0000","objects_scrubbed":6,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:37:37.813524+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3558704,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":578,"num_read_kb":13304,"num_write":1188,"num_write_kb":31930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"263'311","reported_seq":960,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.358337+0000","last_change":"2024-09-12T01:38:18.358278+0000","last_active":"2024-09-12T01:38:18.358337+0000","last_peered":"2024-09-12T01:38:18.358337+0000","last_clean":"2024-09-12T01:38:18.358337+0000","last_became_active":"2024-09-12T00:28:31.214134+0000","last_became_peered":"2024-09-12T00:28:31.214134+0000","last_unstale":"2024-09-12T01:38:18.358337+0000","last_undegraded":"2024-09-12T01:38:18.358337+0000","last_fullsized":"2024-09-12T01:38:18.358337+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'311","last_scrub_stamp":"2024-09-12T01:38:18.358164+0000","last_deep_scrub":"263'311","last_deep_scrub_stamp":"2024-09-12T01:38:18.358164+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.358164+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:36.150651+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553650,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":469,"num_read_kb":31725,"num_write":1010,"num_write_kb":40420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"263'102","reported_seq":703,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.109083+0000","last_change":"2024-09-12T01:38:20.109012+0000","last_active":"2024-09-12T01:38:20.109083+0000","last_peered":"2024-09-12T01:38:20.109083+0000","last_clean":"2024-09-12T01:38:20.109083+0000","last_became_active":"2024-09-12T00:28:33.212886+0000","last_became_peered":"2024-09-12T00:28:33.212886+0000","last_unstale":"2024-09-12T01:38:20.109083+0000","last_undegraded":"2024-09-12T01:38:20.109083+0000","last_fullsized":"2024-09-12T01:38:20.109083+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'102","last_scrub_stamp":"2024-09-12T01:38:20.108923+0000","last_deep_scrub":"263'102","last_deep_scrub_stamp":"2024-09-12T01:38:20.108923+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.108923+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:02.824645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":476,"num_read_kb":407,"num_write":159,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"263'403","reported_seq":1159,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.146849+0000","last_change":"2024-09-12T01:38:15.146793+0000","last_active":"2024-09-12T01:38:15.146849+0000","last_peered":"2024-09-12T01:38:15.146849+0000","last_clean":"2024-09-12T01:38:15.146849+0000","last_became_active":"2024-09-12T00:28:31.196230+0000","last_became_peered":"2024-09-12T00:28:31.196230+0000","last_unstale":"2024-09-12T01:38:15.146849+0000","last_undegraded":"2024-09-12T01:38:15.146849+0000","last_fullsized":"2024-09-12T01:38:15.146849+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'403","last_scrub_stamp":"2024-09-12T01:38:15.146666+0000","last_deep_scrub":"263'403","last_deep_scrub_stamp":"2024-09-12T01:38:15.146666+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.146666+0000","objects_scrubbed":7,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:40.043210+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291522,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":735,"num_read_kb":35673,"num_write":1292,"num_write_kb":40181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"263'213","reported_seq":811,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:28.420757+0000","last_change":"2024-09-12T01:38:28.420645+0000","last_active":"2024-09-12T01:38:28.420757+0000","last_peered":"2024-09-12T01:38:28.420757+0000","last_clean":"2024-09-12T01:38:28.420757+0000","last_became_active":"2024-09-12T00:28:33.213187+0000","last_became_peered":"2024-09-12T00:28:33.213187+0000","last_unstale":"2024-09-12T01:38:28.420757+0000","last_undegraded":"2024-09-12T01:38:28.420757+0000","last_fullsized":"2024-09-12T01:38:28.420757+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'213","last_scrub_stamp":"2024-09-12T01:38:28.420553+0000","last_deep_scrub":"263'213","last_deep_scrub_stamp":"2024-09-12T01:38:28.420553+0000","last_clean_scrub_stamp":"2024-09-12T01:38:28.420553+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:01.923649+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":884,"num_read_kb":712,"num_write":323,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":685,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5759,"num_read_kb":4046,"num_write":1929,"num_write_kb":827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9435,"num_omap_keys":19,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1002,"ondisk_log_size":1002,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15395,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":15045,"num_read_kb":14706,"num_write":16739,"num_write_kb":4892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2683,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1862,"ondisk_log_size":1862,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":525,"ondisk_log_size":525,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1497349,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":18870,"num_read_kb":39400,"num_write":15775,"num_write_kb":11890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":682702,"num_omap_keys":1560,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1965,"ondisk_log_size":1965,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2403,"num_read_kb":2865,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":103056,"num_read_kb":85959,"num_write":37323,"num_write_kb":18865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":44320,"num_omap_keys":179,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4316,"ondisk_log_size":4316,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":94285898,"num_objects":401,"num_object_clones":0,"num_object_copies":802,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":401,"num_whiteouts":0,"num_read":36137,"num_read_kb":1909956,"num_write":71332,"num_write_kb":2052201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":190078976,"data_stored":188571796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3522,"ondisk_log_size":3522,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":175308,"num_write":154,"num_write_kb":116383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":27197,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":178855,"num_write":154,"num_write_kb":116383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510296,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":253256,"kb_used_data":19384,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94118584,"statfs":{"total":96636764160,"available":96377430016,"internally_reserved":0,"allocated":19849216,"data_stored":18131665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":239466954},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510295,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":245476,"kb_used_data":15764,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94126364,"statfs":{"total":96636764160,"available":96385396736,"internally_reserved":0,"allocated":16142336,"data_stored":14537201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":235207110},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510298,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":143396,"kb_used_data":44244,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94228444,"statfs":{"total":96636764160,"available":96489926656,"internally_reserved":0,"allocated":45305856,"data_stored":43509539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510294,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":102520,"kb_used_data":31080,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94269320,"statfs":{"total":96636764160,"available":96531783680,"internally_reserved":0,"allocated":31825920,"data_stored":30189258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510297,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71272,"kb_used_data":17880,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94300568,"statfs":{"total":96636764160,"available":96563781632,"internally_reserved":0,"allocated":18309120,"data_stored":16732323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510300,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":134488,"kb_used_data":22856,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94237352,"statfs":{"total":96636764160,"available":96499048448,"internally_reserved":0,"allocated":23404544,"data_stored":21740424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510298,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":283028,"kb_used_data":35332,"kb_used_omap":1,"kb_used_meta":247678,"kb_avail":94088812,"statfs":{"total":96636764160,"available":96346943488,"internally_reserved":0,"allocated":36179968,"data_stored":34415974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":253622725},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575704,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":284764,"kb_used_data":28684,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":94087076,"statfs":{"total":96636764160,"available":96345165824,"internally_reserved":0,"allocated":29372416,"data_stored":27586086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":262207944},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":31928320,"data_stored":31687986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19750912,"data_stored":19603309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14700544,"data_stored":14596831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":25714688,"data_stored":25449825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28241920,"data_stored":28055424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":41611264,"data_stored":41372743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12529664,"data_stored":12400757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15601664,"data_stored":15404921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:39:11.036 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:39:11.037 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:39:11.037 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T01:04:14.372126+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=38, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:39:11.041 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T01:39:31.041 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:39:31.383 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T01:39:31.395 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T01:39:31.398 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":2396,"stamp":"2024-09-12T01:39:29.977210+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":96390822,"num_objects":752,"num_object_clones":0,"num_object_copies":1504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":752,"num_whiteouts":0,"num_read":181613,"num_read_kb":2411162,"num_write":143549,"num_write_kb":2323097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":27197,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":740268,"num_omap_keys":1787,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13489,"ondisk_log_size":13489,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1518200,"kb_used_data":215224,"kb_used_omap":12,"kb_used_meta":1302835,"kb_avail":753456520,"statfs":{"total":773094113280,"available":771539476480,"internally_reserved":0,"allocated":220389376,"data_stored":206842470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1334103601},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005624"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:58.472294+0000","last_change":"2024-09-12T01:38:58.472230+0000","last_active":"2024-09-12T01:38:58.472294+0000","last_peered":"2024-09-12T01:38:58.472294+0000","last_clean":"2024-09-12T01:38:58.472294+0000","last_became_active":"2024-09-12T01:04:15.392944+0000","last_became_peered":"2024-09-12T01:04:15.392944+0000","last_unstale":"2024-09-12T01:38:58.472294+0000","last_undegraded":"2024-09-12T01:38:58.472294+0000","last_fullsized":"2024-09-12T01:38:58.472294+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:58.472142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:58.472142+0000","last_clean_scrub_stamp":"2024-09-12T01:38:58.472142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:16.890910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"263'8","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:54.427308+0000","last_change":"2024-09-12T01:38:54.427243+0000","last_active":"2024-09-12T01:38:54.427308+0000","last_peered":"2024-09-12T01:38:54.427308+0000","last_clean":"2024-09-12T01:38:54.427308+0000","last_became_active":"2024-09-12T00:46:26.362231+0000","last_became_peered":"2024-09-12T00:46:26.362231+0000","last_unstale":"2024-09-12T01:38:54.427308+0000","last_undegraded":"2024-09-12T01:38:54.427308+0000","last_fullsized":"2024-09-12T01:38:54.427308+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-09-12T01:38:54.427162+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-09-12T01:38:54.427162+0000","last_clean_scrub_stamp":"2024-09-12T01:38:54.427162+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:53.026538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":19456,"num_write":13,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:57.146847+0000","last_change":"2024-09-12T01:38:57.146847+0000","last_active":"2024-09-12T01:38:57.146847+0000","last_peered":"2024-09-12T01:38:57.146847+0000","last_clean":"2024-09-12T01:38:57.146847+0000","last_became_active":"2024-09-12T00:46:22.353306+0000","last_became_peered":"2024-09-12T00:46:22.353306+0000","last_unstale":"2024-09-12T01:38:57.146847+0000","last_undegraded":"2024-09-12T01:38:57.146847+0000","last_fullsized":"2024-09-12T01:38:57.146847+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:57.146742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:57.146742+0000","last_clean_scrub_stamp":"2024-09-12T01:38:57.146742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:21.110450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"263'59","reported_seq":228,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:53.275988+0000","last_change":"2024-09-12T01:38:53.275988+0000","last_active":"2024-09-12T01:38:53.275988+0000","last_peered":"2024-09-12T01:38:53.275988+0000","last_clean":"2024-09-12T01:38:53.275988+0000","last_became_active":"2024-09-12T00:42:36.818329+0000","last_became_peered":"2024-09-12T00:42:36.818329+0000","last_unstale":"2024-09-12T01:38:53.275988+0000","last_undegraded":"2024-09-12T01:38:53.275988+0000","last_fullsized":"2024-09-12T01:38:53.275988+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'59","last_scrub_stamp":"2024-09-12T01:38:53.275902+0000","last_deep_scrub":"263'59","last_deep_scrub_stamp":"2024-09-12T01:38:53.275902+0000","last_clean_scrub_stamp":"2024-09-12T01:38:53.275902+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:59.884408+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":293,"num_read_kb":205,"num_write":105,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.801760+0000","last_change":"2024-09-12T01:38:37.801693+0000","last_active":"2024-09-12T01:38:37.801760+0000","last_peered":"2024-09-12T01:38:37.801760+0000","last_clean":"2024-09-12T01:38:37.801760+0000","last_became_active":"2024-09-12T01:04:15.392747+0000","last_became_peered":"2024-09-12T01:04:15.392747+0000","last_unstale":"2024-09-12T01:38:37.801760+0000","last_undegraded":"2024-09-12T01:38:37.801760+0000","last_fullsized":"2024-09-12T01:38:37.801760+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:37.801602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:37.801602+0000","last_clean_scrub_stamp":"2024-09-12T01:38:37.801602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:43.793136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"263'3","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:56.642317+0000","last_change":"2024-09-12T01:38:56.642317+0000","last_active":"2024-09-12T01:38:56.642317+0000","last_peered":"2024-09-12T01:38:56.642317+0000","last_clean":"2024-09-12T01:38:56.642317+0000","last_became_active":"2024-09-12T00:46:26.369944+0000","last_became_peered":"2024-09-12T00:46:26.369944+0000","last_unstale":"2024-09-12T01:38:56.642317+0000","last_undegraded":"2024-09-12T01:38:56.642317+0000","last_fullsized":"2024-09-12T01:38:56.642317+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-12T01:38:56.642201+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-12T01:38:56.642201+0000","last_clean_scrub_stamp":"2024-09-12T01:38:56.642201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:46.819288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"260'8","reported_seq":79,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:40.826822+0000","last_change":"2024-09-12T01:38:40.826701+0000","last_active":"2024-09-12T01:38:40.826822+0000","last_peered":"2024-09-12T01:38:40.826822+0000","last_clean":"2024-09-12T01:38:40.826822+0000","last_became_active":"2024-09-12T00:46:22.352009+0000","last_became_peered":"2024-09-12T00:46:22.352009+0000","last_unstale":"2024-09-12T01:38:40.826822+0000","last_undegraded":"2024-09-12T01:38:40.826822+0000","last_fullsized":"2024-09-12T01:38:40.826822+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'8","last_scrub_stamp":"2024-09-12T01:38:40.826573+0000","last_deep_scrub":"260'8","last_deep_scrub_stamp":"2024-09-12T01:38:40.826573+0000","last_clean_scrub_stamp":"2024-09-12T01:38:40.826573+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:57.124717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":26626,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"263'20","reported_seq":125,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:29.677728+0000","last_change":"2024-09-12T01:38:29.677626+0000","last_active":"2024-09-12T01:38:29.677728+0000","last_peered":"2024-09-12T01:38:29.677728+0000","last_clean":"2024-09-12T01:38:29.677728+0000","last_became_active":"2024-09-12T00:42:36.809431+0000","last_became_peered":"2024-09-12T00:42:36.809431+0000","last_unstale":"2024-09-12T01:38:29.677728+0000","last_undegraded":"2024-09-12T01:38:29.677728+0000","last_fullsized":"2024-09-12T01:38:29.677728+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'20","last_scrub_stamp":"2024-09-12T01:38:29.677499+0000","last_deep_scrub":"263'20","last_deep_scrub_stamp":"2024-09-12T01:38:29.677499+0000","last_clean_scrub_stamp":"2024-09-12T01:38:29.677499+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:02.453791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":73,"num_write":40,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:45.987726+0000","last_change":"2024-09-12T01:38:45.987726+0000","last_active":"2024-09-12T01:38:45.987726+0000","last_peered":"2024-09-12T01:38:45.987726+0000","last_clean":"2024-09-12T01:38:45.987726+0000","last_became_active":"2024-09-12T01:04:15.384312+0000","last_became_peered":"2024-09-12T01:04:15.384312+0000","last_unstale":"2024-09-12T01:38:45.987726+0000","last_undegraded":"2024-09-12T01:38:45.987726+0000","last_fullsized":"2024-09-12T01:38:45.987726+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:45.987643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:45.987643+0000","last_clean_scrub_stamp":"2024-09-12T01:38:45.987643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:34.846840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:39:02.259298+0000","last_change":"2024-09-12T01:39:02.259298+0000","last_active":"2024-09-12T01:39:02.259298+0000","last_peered":"2024-09-12T01:39:02.259298+0000","last_clean":"2024-09-12T01:39:02.259298+0000","last_became_active":"2024-09-12T00:46:26.563267+0000","last_became_peered":"2024-09-12T00:46:26.563267+0000","last_unstale":"2024-09-12T01:39:02.259298+0000","last_undegraded":"2024-09-12T01:39:02.259298+0000","last_fullsized":"2024-09-12T01:39:02.259298+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:02.259214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:02.259214+0000","last_clean_scrub_stamp":"2024-09-12T01:39:02.259214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:32.013621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"260'3","reported_seq":69,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:33.674271+0000","last_change":"2024-09-12T01:38:33.674201+0000","last_active":"2024-09-12T01:38:33.674271+0000","last_peered":"2024-09-12T01:38:33.674271+0000","last_clean":"2024-09-12T01:38:33.674271+0000","last_became_active":"2024-09-12T00:46:22.340655+0000","last_became_peered":"2024-09-12T00:46:22.340655+0000","last_unstale":"2024-09-12T01:38:33.674271+0000","last_undegraded":"2024-09-12T01:38:33.674271+0000","last_fullsized":"2024-09-12T01:38:33.674271+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-12T01:38:33.674114+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-12T01:38:33.674114+0000","last_clean_scrub_stamp":"2024-09-12T01:38:33.674114+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:11.561130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"263'63","reported_seq":234,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:52.251257+0000","last_change":"2024-09-12T01:38:52.251257+0000","last_active":"2024-09-12T01:38:52.251257+0000","last_peered":"2024-09-12T01:38:52.251257+0000","last_clean":"2024-09-12T01:38:52.251257+0000","last_became_active":"2024-09-12T00:42:36.814510+0000","last_became_peered":"2024-09-12T00:42:36.814510+0000","last_unstale":"2024-09-12T01:38:52.251257+0000","last_undegraded":"2024-09-12T01:38:52.251257+0000","last_fullsized":"2024-09-12T01:38:52.251257+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'63","last_scrub_stamp":"2024-09-12T01:38:52.251172+0000","last_deep_scrub":"263'63","last_deep_scrub_stamp":"2024-09-12T01:38:52.251172+0000","last_clean_scrub_stamp":"2024-09-12T01:38:52.251172+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:42.733500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":321,"num_read_kb":228,"num_write":110,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:39:10.044997+0000","last_change":"2024-09-12T01:39:10.044997+0000","last_active":"2024-09-12T01:39:10.044997+0000","last_peered":"2024-09-12T01:39:10.044997+0000","last_clean":"2024-09-12T01:39:10.044997+0000","last_became_active":"2024-09-12T01:04:15.401897+0000","last_became_peered":"2024-09-12T01:04:15.401897+0000","last_unstale":"2024-09-12T01:39:10.044997+0000","last_undegraded":"2024-09-12T01:39:10.044997+0000","last_fullsized":"2024-09-12T01:39:10.044997+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:10.044906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:10.044906+0000","last_clean_scrub_stamp":"2024-09-12T01:39:10.044906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:07.235985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:39:06.146520+0000","last_change":"2024-09-12T01:39:06.146520+0000","last_active":"2024-09-12T01:39:06.146520+0000","last_peered":"2024-09-12T01:39:06.146520+0000","last_clean":"2024-09-12T01:39:06.146520+0000","last_became_active":"2024-09-12T00:46:26.561870+0000","last_became_peered":"2024-09-12T00:46:26.561870+0000","last_unstale":"2024-09-12T01:39:06.146520+0000","last_undegraded":"2024-09-12T01:39:06.146520+0000","last_fullsized":"2024-09-12T01:39:06.146520+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:06.146429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:06.146429+0000","last_clean_scrub_stamp":"2024-09-12T01:39:06.146429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:29.546409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"263'6","reported_seq":72,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:52.581293+0000","last_change":"2024-09-12T01:38:52.581293+0000","last_active":"2024-09-12T01:38:52.581293+0000","last_peered":"2024-09-12T01:38:52.581293+0000","last_clean":"2024-09-12T01:38:52.581293+0000","last_became_active":"2024-09-12T00:46:22.339141+0000","last_became_peered":"2024-09-12T00:46:22.339141+0000","last_unstale":"2024-09-12T01:38:52.581293+0000","last_undegraded":"2024-09-12T01:38:52.581293+0000","last_fullsized":"2024-09-12T01:38:52.581293+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-12T01:38:52.581160+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-12T01:38:52.581160+0000","last_clean_scrub_stamp":"2024-09-12T01:38:52.581160+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:24.423605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"263'62","reported_seq":233,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:55.216580+0000","last_change":"2024-09-12T01:38:55.216580+0000","last_active":"2024-09-12T01:38:55.216580+0000","last_peered":"2024-09-12T01:38:55.216580+0000","last_clean":"2024-09-12T01:38:55.216580+0000","last_became_active":"2024-09-12T00:42:36.816570+0000","last_became_peered":"2024-09-12T00:42:36.816570+0000","last_unstale":"2024-09-12T01:38:55.216580+0000","last_undegraded":"2024-09-12T01:38:55.216580+0000","last_fullsized":"2024-09-12T01:38:55.216580+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'62","last_scrub_stamp":"2024-09-12T01:38:55.216490+0000","last_deep_scrub":"263'62","last_deep_scrub_stamp":"2024-09-12T01:38:55.216490+0000","last_clean_scrub_stamp":"2024-09-12T01:38:55.216490+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:42.094085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":318,"num_read_kb":239,"num_write":100,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:39:11.012784+0000","last_change":"2024-09-12T01:39:11.012784+0000","last_active":"2024-09-12T01:39:11.012784+0000","last_peered":"2024-09-12T01:39:11.012784+0000","last_clean":"2024-09-12T01:39:11.012784+0000","last_became_active":"2024-09-12T01:04:15.400228+0000","last_became_peered":"2024-09-12T01:04:15.400228+0000","last_unstale":"2024-09-12T01:39:11.012784+0000","last_undegraded":"2024-09-12T01:39:11.012784+0000","last_fullsized":"2024-09-12T01:39:11.012784+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.012672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.012672+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.012672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:00.350860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"263'9","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:55.398042+0000","last_change":"2024-09-12T01:38:55.398042+0000","last_active":"2024-09-12T01:38:55.398042+0000","last_peered":"2024-09-12T01:38:55.398042+0000","last_clean":"2024-09-12T01:38:55.398042+0000","last_became_active":"2024-09-12T00:46:26.367849+0000","last_became_peered":"2024-09-12T00:46:26.367849+0000","last_unstale":"2024-09-12T01:38:55.398042+0000","last_undegraded":"2024-09-12T01:38:55.398042+0000","last_fullsized":"2024-09-12T01:38:55.398042+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'9","last_scrub_stamp":"2024-09-12T01:38:55.397912+0000","last_deep_scrub":"263'9","last_deep_scrub_stamp":"2024-09-12T01:38:55.397912+0000","last_clean_scrub_stamp":"2024-09-12T01:38:55.397912+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:30.563425+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7168,"num_write":19,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"263'13","reported_seq":91,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:58.304721+0000","last_change":"2024-09-12T01:38:58.304721+0000","last_active":"2024-09-12T01:38:58.304721+0000","last_peered":"2024-09-12T01:38:58.304721+0000","last_clean":"2024-09-12T01:38:58.304721+0000","last_became_active":"2024-09-12T00:46:22.349597+0000","last_became_peered":"2024-09-12T00:46:22.349597+0000","last_unstale":"2024-09-12T01:38:58.304721+0000","last_undegraded":"2024-09-12T01:38:58.304721+0000","last_fullsized":"2024-09-12T01:38:58.304721+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'13","last_scrub_stamp":"2024-09-12T01:38:58.304629+0000","last_deep_scrub":"263'13","last_deep_scrub_stamp":"2024-09-12T01:38:58.304629+0000","last_clean_scrub_stamp":"2024-09-12T01:38:58.304629+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:14.827128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":44034,"num_write":28,"num_write_kb":19456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"263'28","reported_seq":137,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:54.242963+0000","last_change":"2024-09-12T01:38:54.242963+0000","last_active":"2024-09-12T01:38:54.242963+0000","last_peered":"2024-09-12T01:38:54.242963+0000","last_clean":"2024-09-12T01:38:54.242963+0000","last_became_active":"2024-09-12T00:42:36.814799+0000","last_became_peered":"2024-09-12T00:42:36.814799+0000","last_unstale":"2024-09-12T01:38:54.242963+0000","last_undegraded":"2024-09-12T01:38:54.242963+0000","last_fullsized":"2024-09-12T01:38:54.242963+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'28","last_scrub_stamp":"2024-09-12T01:38:54.242863+0000","last_deep_scrub":"263'28","last_deep_scrub_stamp":"2024-09-12T01:38:54.242863+0000","last_clean_scrub_stamp":"2024-09-12T01:38:54.242863+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:53.634201+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":94,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:48.762868+0000","last_change":"2024-09-12T01:38:48.762868+0000","last_active":"2024-09-12T01:38:48.762868+0000","last_peered":"2024-09-12T01:38:48.762868+0000","last_clean":"2024-09-12T01:38:48.762868+0000","last_became_active":"2024-09-12T01:04:15.388593+0000","last_became_peered":"2024-09-12T01:04:15.388593+0000","last_unstale":"2024-09-12T01:38:48.762868+0000","last_undegraded":"2024-09-12T01:38:48.762868+0000","last_fullsized":"2024-09-12T01:38:48.762868+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:48.762771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:48.762771+0000","last_clean_scrub_stamp":"2024-09-12T01:38:48.762771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:05:22.004111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"260'2","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:41.910495+0000","last_change":"2024-09-12T01:38:41.910495+0000","last_active":"2024-09-12T01:38:41.910495+0000","last_peered":"2024-09-12T01:38:41.910495+0000","last_clean":"2024-09-12T01:38:41.910495+0000","last_became_active":"2024-09-12T00:47:05.444004+0000","last_became_peered":"2024-09-12T00:47:05.444004+0000","last_unstale":"2024-09-12T01:38:41.910495+0000","last_undegraded":"2024-09-12T01:38:41.910495+0000","last_fullsized":"2024-09-12T01:38:41.910495+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-12T01:38:41.910399+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-12T01:38:41.910399+0000","last_clean_scrub_stamp":"2024-09-12T01:38:41.910399+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:13.148664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":27197,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"263'2","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:49.444538+0000","last_change":"2024-09-12T01:38:49.444538+0000","last_active":"2024-09-12T01:38:49.444538+0000","last_peered":"2024-09-12T01:38:49.444538+0000","last_clean":"2024-09-12T01:38:49.444538+0000","last_became_active":"2024-09-12T00:46:22.347338+0000","last_became_peered":"2024-09-12T00:46:22.347338+0000","last_unstale":"2024-09-12T01:38:49.444538+0000","last_undegraded":"2024-09-12T01:38:49.444538+0000","last_fullsized":"2024-09-12T01:38:49.444538+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:38:49.444450+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:38:49.444450+0000","last_clean_scrub_stamp":"2024-09-12T01:38:49.444450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:58.499728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"263'72","reported_seq":306,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.059290+0000","last_change":"2024-09-12T01:38:38.059290+0000","last_active":"2024-09-12T01:38:38.059290+0000","last_peered":"2024-09-12T01:38:38.059290+0000","last_clean":"2024-09-12T01:38:38.059290+0000","last_became_active":"2024-09-12T00:42:36.812454+0000","last_became_peered":"2024-09-12T00:42:36.812454+0000","last_unstale":"2024-09-12T01:38:38.059290+0000","last_undegraded":"2024-09-12T01:38:38.059290+0000","last_fullsized":"2024-09-12T01:38:38.059290+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'72","last_scrub_stamp":"2024-09-12T01:38:38.059208+0000","last_deep_scrub":"263'72","last_deep_scrub_stamp":"2024-09-12T01:38:38.059208+0000","last_clean_scrub_stamp":"2024-09-12T01:38:38.059208+0000","objects_scrubbed":1,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:13.691583+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":475,"num_read_kb":319,"num_write":83,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4980,"num_omap_keys":10,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"263'2","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:39:06.631161+0000","last_change":"2024-09-12T01:39:06.631073+0000","last_active":"2024-09-12T01:39:06.631161+0000","last_peered":"2024-09-12T01:39:06.631161+0000","last_clean":"2024-09-12T01:39:06.631161+0000","last_became_active":"2024-09-12T01:04:15.391532+0000","last_became_peered":"2024-09-12T01:04:15.391532+0000","last_unstale":"2024-09-12T01:39:06.631161+0000","last_undegraded":"2024-09-12T01:39:06.631161+0000","last_fullsized":"2024-09-12T01:39:06.631161+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:39:06.630965+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:39:06.630965+0000","last_clean_scrub_stamp":"2024-09-12T01:39:06.630965+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:45.944722+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"263'6","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:43.929279+0000","last_change":"2024-09-12T01:38:43.929220+0000","last_active":"2024-09-12T01:38:43.929279+0000","last_peered":"2024-09-12T01:38:43.929279+0000","last_clean":"2024-09-12T01:38:43.929279+0000","last_became_active":"2024-09-12T00:46:26.374660+0000","last_became_peered":"2024-09-12T00:46:26.374660+0000","last_unstale":"2024-09-12T01:38:43.929279+0000","last_undegraded":"2024-09-12T01:38:43.929279+0000","last_fullsized":"2024-09-12T01:38:43.929279+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-12T01:38:43.929107+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-12T01:38:43.929107+0000","last_clean_scrub_stamp":"2024-09-12T01:38:43.929107+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:45.373952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"263'7","reported_seq":71,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:48.488892+0000","last_change":"2024-09-12T01:38:48.488793+0000","last_active":"2024-09-12T01:38:48.488892+0000","last_peered":"2024-09-12T01:38:48.488892+0000","last_clean":"2024-09-12T01:38:48.488892+0000","last_became_active":"2024-09-12T00:46:22.340228+0000","last_became_peered":"2024-09-12T00:46:22.340228+0000","last_unstale":"2024-09-12T01:38:48.488892+0000","last_undegraded":"2024-09-12T01:38:48.488892+0000","last_fullsized":"2024-09-12T01:38:48.488892+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'7","last_scrub_stamp":"2024-09-12T01:38:48.488701+0000","last_deep_scrub":"263'7","last_deep_scrub_stamp":"2024-09-12T01:38:48.488701+0000","last_clean_scrub_stamp":"2024-09-12T01:38:48.488701+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:56.357132+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6219,"num_write":7,"num_write_kb":6219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"263'130","reported_seq":441,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:50.241136+0000","last_change":"2024-09-12T01:38:50.241136+0000","last_active":"2024-09-12T01:38:50.241136+0000","last_peered":"2024-09-12T01:38:50.241136+0000","last_clean":"2024-09-12T01:38:50.241136+0000","last_became_active":"2024-09-12T00:42:36.812882+0000","last_became_peered":"2024-09-12T00:42:36.812882+0000","last_unstale":"2024-09-12T01:38:50.241136+0000","last_undegraded":"2024-09-12T01:38:50.241136+0000","last_fullsized":"2024-09-12T01:38:50.241136+0000","mapping_epoch":250,"log_start":"260'100","ondisk_log_start":"260'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'130","last_scrub_stamp":"2024-09-12T01:38:50.241023+0000","last_deep_scrub":"263'130","last_deep_scrub_stamp":"2024-09-12T01:38:50.241023+0000","last_clean_scrub_stamp":"2024-09-12T01:38:50.241023+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:41.436315+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":723,"num_read_kb":503,"num_write":193,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4455,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:39:05.610490+0000","last_change":"2024-09-12T01:39:05.610406+0000","last_active":"2024-09-12T01:39:05.610490+0000","last_peered":"2024-09-12T01:39:05.610490+0000","last_clean":"2024-09-12T01:39:05.610490+0000","last_became_active":"2024-09-12T01:04:15.398533+0000","last_became_peered":"2024-09-12T01:04:15.398533+0000","last_unstale":"2024-09-12T01:39:05.610490+0000","last_undegraded":"2024-09-12T01:39:05.610490+0000","last_fullsized":"2024-09-12T01:39:05.610490+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:05.610298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:05.610298+0000","last_clean_scrub_stamp":"2024-09-12T01:39:05.610298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:14.152758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"263'5","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:39:05.117390+0000","last_change":"2024-09-12T01:39:05.117390+0000","last_active":"2024-09-12T01:39:05.117390+0000","last_peered":"2024-09-12T01:39:05.117390+0000","last_clean":"2024-09-12T01:39:05.117390+0000","last_became_active":"2024-09-12T00:46:26.367766+0000","last_became_peered":"2024-09-12T00:46:26.367766+0000","last_unstale":"2024-09-12T01:39:05.117390+0000","last_undegraded":"2024-09-12T01:39:05.117390+0000","last_fullsized":"2024-09-12T01:39:05.117390+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-12T01:39:05.117301+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-12T01:39:05.117301+0000","last_clean_scrub_stamp":"2024-09-12T01:39:05.117301+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:54.959377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4,"num_write":10,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:57.348304+0000","last_change":"2024-09-12T01:38:57.348304+0000","last_active":"2024-09-12T01:38:57.348304+0000","last_peered":"2024-09-12T01:38:57.348304+0000","last_clean":"2024-09-12T01:38:57.348304+0000","last_became_active":"2024-09-12T00:46:22.353833+0000","last_became_peered":"2024-09-12T00:46:22.353833+0000","last_unstale":"2024-09-12T01:38:57.348304+0000","last_undegraded":"2024-09-12T01:38:57.348304+0000","last_fullsized":"2024-09-12T01:38:57.348304+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:57.348210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:57.348210+0000","last_clean_scrub_stamp":"2024-09-12T01:38:57.348210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:53.744706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'39","reported_seq":175,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:36.883196+0000","last_change":"2024-09-12T01:38:36.883196+0000","last_active":"2024-09-12T01:38:36.883196+0000","last_peered":"2024-09-12T01:38:36.883196+0000","last_clean":"2024-09-12T01:38:36.883196+0000","last_became_active":"2024-09-12T00:42:36.803692+0000","last_became_peered":"2024-09-12T00:42:36.803692+0000","last_unstale":"2024-09-12T01:38:36.883196+0000","last_undegraded":"2024-09-12T01:38:36.883196+0000","last_fullsized":"2024-09-12T01:38:36.883196+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'39","last_scrub_stamp":"2024-09-12T01:38:36.883106+0000","last_deep_scrub":"263'39","last_deep_scrub_stamp":"2024-09-12T01:38:36.883106+0000","last_clean_scrub_stamp":"2024-09-12T01:38:36.883106+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:35.390177+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":209,"num_read_kb":149,"num_write":77,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:47.755301+0000","last_change":"2024-09-12T01:38:47.755240+0000","last_active":"2024-09-12T01:38:47.755301+0000","last_peered":"2024-09-12T01:38:47.755301+0000","last_clean":"2024-09-12T01:38:47.755301+0000","last_became_active":"2024-09-12T01:04:15.385172+0000","last_became_peered":"2024-09-12T01:04:15.385172+0000","last_unstale":"2024-09-12T01:38:47.755301+0000","last_undegraded":"2024-09-12T01:38:47.755301+0000","last_fullsized":"2024-09-12T01:38:47.755301+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:47.755140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:47.755140+0000","last_clean_scrub_stamp":"2024-09-12T01:38:47.755140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:11.662497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"263'5","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:39:04.101841+0000","last_change":"2024-09-12T01:39:04.101841+0000","last_active":"2024-09-12T01:39:04.101841+0000","last_peered":"2024-09-12T01:39:04.101841+0000","last_clean":"2024-09-12T01:39:04.101841+0000","last_became_active":"2024-09-12T00:46:26.561643+0000","last_became_peered":"2024-09-12T00:46:26.561643+0000","last_unstale":"2024-09-12T01:39:04.101841+0000","last_undegraded":"2024-09-12T01:39:04.101841+0000","last_fullsized":"2024-09-12T01:39:04.101841+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-12T01:39:04.101729+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-12T01:39:04.101729+0000","last_clean_scrub_stamp":"2024-09-12T01:39:04.101729+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:57.273516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10250,"num_write":10,"num_write_kb":5125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:53.445407+0000","last_change":"2024-09-12T01:38:53.445407+0000","last_active":"2024-09-12T01:38:53.445407+0000","last_peered":"2024-09-12T01:38:53.445407+0000","last_clean":"2024-09-12T01:38:53.445407+0000","last_became_active":"2024-09-12T00:46:22.349007+0000","last_became_peered":"2024-09-12T00:46:22.349007+0000","last_unstale":"2024-09-12T01:38:53.445407+0000","last_undegraded":"2024-09-12T01:38:53.445407+0000","last_fullsized":"2024-09-12T01:38:53.445407+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:53.445320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:53.445320+0000","last_clean_scrub_stamp":"2024-09-12T01:38:53.445320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:49.616148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"263'19","reported_seq":121,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:51.284362+0000","last_change":"2024-09-12T01:38:51.284362+0000","last_active":"2024-09-12T01:38:51.284362+0000","last_peered":"2024-09-12T01:38:51.284362+0000","last_clean":"2024-09-12T01:38:51.284362+0000","last_became_active":"2024-09-12T00:42:36.814846+0000","last_became_peered":"2024-09-12T00:42:36.814846+0000","last_unstale":"2024-09-12T01:38:51.284362+0000","last_undegraded":"2024-09-12T01:38:51.284362+0000","last_fullsized":"2024-09-12T01:38:51.284362+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'19","last_scrub_stamp":"2024-09-12T01:38:51.284257+0000","last_deep_scrub":"263'19","last_deep_scrub_stamp":"2024-09-12T01:38:51.284257+0000","last_clean_scrub_stamp":"2024-09-12T01:38:51.284257+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:35.319535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":75,"num_write":34,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"263'2","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:36.758801+0000","last_change":"2024-09-12T01:38:36.758725+0000","last_active":"2024-09-12T01:38:36.758801+0000","last_peered":"2024-09-12T01:38:36.758801+0000","last_clean":"2024-09-12T01:38:36.758801+0000","last_became_active":"2024-09-12T01:04:15.395540+0000","last_became_peered":"2024-09-12T01:04:15.395540+0000","last_unstale":"2024-09-12T01:38:36.758801+0000","last_undegraded":"2024-09-12T01:38:36.758801+0000","last_fullsized":"2024-09-12T01:38:36.758801+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:38:36.758622+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:38:36.758622+0000","last_clean_scrub_stamp":"2024-09-12T01:38:36.758622+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:30.668812+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:39:02.157421+0000","last_change":"2024-09-12T01:39:02.157421+0000","last_active":"2024-09-12T01:39:02.157421+0000","last_peered":"2024-09-12T01:39:02.157421+0000","last_clean":"2024-09-12T01:39:02.157421+0000","last_became_active":"2024-09-12T00:46:26.561961+0000","last_became_peered":"2024-09-12T00:46:26.561961+0000","last_unstale":"2024-09-12T01:39:02.157421+0000","last_undegraded":"2024-09-12T01:39:02.157421+0000","last_fullsized":"2024-09-12T01:39:02.157421+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:02.157327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:02.157327+0000","last_clean_scrub_stamp":"2024-09-12T01:39:02.157327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:27.665045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"260'5","reported_seq":69,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:54.645827+0000","last_change":"2024-09-12T01:38:54.645827+0000","last_active":"2024-09-12T01:38:54.645827+0000","last_peered":"2024-09-12T01:38:54.645827+0000","last_clean":"2024-09-12T01:38:54.645827+0000","last_became_active":"2024-09-12T00:46:22.350947+0000","last_became_peered":"2024-09-12T00:46:22.350947+0000","last_unstale":"2024-09-12T01:38:54.645827+0000","last_undegraded":"2024-09-12T01:38:54.645827+0000","last_fullsized":"2024-09-12T01:38:54.645827+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-12T01:38:54.645735+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-12T01:38:54.645735+0000","last_clean_scrub_stamp":"2024-09-12T01:38:54.645735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:24.485009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"263'28","reported_seq":144,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:53.271179+0000","last_change":"2024-09-12T01:38:53.271179+0000","last_active":"2024-09-12T01:38:53.271179+0000","last_peered":"2024-09-12T01:38:53.271179+0000","last_clean":"2024-09-12T01:38:53.271179+0000","last_became_active":"2024-09-12T00:42:36.815638+0000","last_became_peered":"2024-09-12T00:42:36.815638+0000","last_unstale":"2024-09-12T01:38:53.271179+0000","last_undegraded":"2024-09-12T01:38:53.271179+0000","last_fullsized":"2024-09-12T01:38:53.271179+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'28","last_scrub_stamp":"2024-09-12T01:38:53.271074+0000","last_deep_scrub":"263'28","last_deep_scrub_stamp":"2024-09-12T01:38:53.271074+0000","last_clean_scrub_stamp":"2024-09-12T01:38:53.271074+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:40.481867+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":103,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:39:03.673057+0000","last_change":"2024-09-12T01:39:03.672960+0000","last_active":"2024-09-12T01:39:03.673057+0000","last_peered":"2024-09-12T01:39:03.673057+0000","last_clean":"2024-09-12T01:39:03.673057+0000","last_became_active":"2024-09-12T01:04:15.391501+0000","last_became_peered":"2024-09-12T01:04:15.391501+0000","last_unstale":"2024-09-12T01:39:03.673057+0000","last_undegraded":"2024-09-12T01:39:03.673057+0000","last_fullsized":"2024-09-12T01:39:03.673057+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:03.672858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:03.672858+0000","last_clean_scrub_stamp":"2024-09-12T01:39:03.672858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:13.446258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:39:03.142854+0000","last_change":"2024-09-12T01:39:03.142854+0000","last_active":"2024-09-12T01:39:03.142854+0000","last_peered":"2024-09-12T01:39:03.142854+0000","last_clean":"2024-09-12T01:39:03.142854+0000","last_became_active":"2024-09-12T00:46:26.563091+0000","last_became_peered":"2024-09-12T00:46:26.563091+0000","last_unstale":"2024-09-12T01:39:03.142854+0000","last_undegraded":"2024-09-12T01:39:03.142854+0000","last_fullsized":"2024-09-12T01:39:03.142854+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:03.142769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:03.142769+0000","last_clean_scrub_stamp":"2024-09-12T01:39:03.142769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:57.676749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:31.658500+0000","last_change":"2024-09-12T01:38:31.658500+0000","last_active":"2024-09-12T01:38:31.658500+0000","last_peered":"2024-09-12T01:38:31.658500+0000","last_clean":"2024-09-12T01:38:31.658500+0000","last_became_active":"2024-09-12T00:46:22.354167+0000","last_became_peered":"2024-09-12T00:46:22.354167+0000","last_unstale":"2024-09-12T01:38:31.658500+0000","last_undegraded":"2024-09-12T01:38:31.658500+0000","last_fullsized":"2024-09-12T01:38:31.658500+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:31.658403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:31.658403+0000","last_clean_scrub_stamp":"2024-09-12T01:38:31.658403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:26.400177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"260'8","reported_seq":90,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:28.717227+0000","last_change":"2024-09-12T01:38:28.717227+0000","last_active":"2024-09-12T01:38:28.717227+0000","last_peered":"2024-09-12T01:38:28.717227+0000","last_clean":"2024-09-12T01:38:28.717227+0000","last_became_active":"2024-09-12T00:42:36.802737+0000","last_became_peered":"2024-09-12T00:42:36.802737+0000","last_unstale":"2024-09-12T01:38:28.717227+0000","last_undegraded":"2024-09-12T01:38:28.717227+0000","last_fullsized":"2024-09-12T01:38:28.717227+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'8","last_scrub_stamp":"2024-09-12T01:38:28.717114+0000","last_deep_scrub":"260'8","last_deep_scrub_stamp":"2024-09-12T01:38:28.717114+0000","last_clean_scrub_stamp":"2024-09-12T01:38:28.717114+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:10.385026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:57.422216+0000","last_change":"2024-09-12T01:38:57.422149+0000","last_active":"2024-09-12T01:38:57.422216+0000","last_peered":"2024-09-12T01:38:57.422216+0000","last_clean":"2024-09-12T01:38:57.422216+0000","last_became_active":"2024-09-12T01:04:15.393292+0000","last_became_peered":"2024-09-12T01:04:15.393292+0000","last_unstale":"2024-09-12T01:38:57.422216+0000","last_undegraded":"2024-09-12T01:38:57.422216+0000","last_fullsized":"2024-09-12T01:38:57.422216+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:57.422061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:57.422061+0000","last_clean_scrub_stamp":"2024-09-12T01:38:57.422061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:14.401871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"263'3","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:54.628745+0000","last_change":"2024-09-12T01:38:54.628745+0000","last_active":"2024-09-12T01:38:54.628745+0000","last_peered":"2024-09-12T01:38:54.628745+0000","last_clean":"2024-09-12T01:38:54.628745+0000","last_became_active":"2024-09-12T00:46:26.370845+0000","last_became_peered":"2024-09-12T00:46:26.370845+0000","last_unstale":"2024-09-12T01:38:54.628745+0000","last_undegraded":"2024-09-12T01:38:54.628745+0000","last_fullsized":"2024-09-12T01:38:54.628745+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-12T01:38:54.628624+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-12T01:38:54.628624+0000","last_clean_scrub_stamp":"2024-09-12T01:38:54.628624+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:45.319268+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:39:01.286712+0000","last_change":"2024-09-12T01:39:01.286712+0000","last_active":"2024-09-12T01:39:01.286712+0000","last_peered":"2024-09-12T01:39:01.286712+0000","last_clean":"2024-09-12T01:39:01.286712+0000","last_became_active":"2024-09-12T00:46:22.348534+0000","last_became_peered":"2024-09-12T00:46:22.348534+0000","last_unstale":"2024-09-12T01:39:01.286712+0000","last_undegraded":"2024-09-12T01:39:01.286712+0000","last_fullsized":"2024-09-12T01:39:01.286712+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:01.286622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:01.286622+0000","last_clean_scrub_stamp":"2024-09-12T01:39:01.286622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:03.223998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"263'16","reported_seq":107,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:48.649268+0000","last_change":"2024-09-12T01:38:48.649212+0000","last_active":"2024-09-12T01:38:48.649268+0000","last_peered":"2024-09-12T01:38:48.649268+0000","last_clean":"2024-09-12T01:38:48.649268+0000","last_became_active":"2024-09-12T00:42:36.812629+0000","last_became_peered":"2024-09-12T00:42:36.812629+0000","last_unstale":"2024-09-12T01:38:48.649268+0000","last_undegraded":"2024-09-12T01:38:48.649268+0000","last_fullsized":"2024-09-12T01:38:48.649268+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'16","last_scrub_stamp":"2024-09-12T01:38:48.649125+0000","last_deep_scrub":"263'16","last_deep_scrub_stamp":"2024-09-12T01:38:48.649125+0000","last_clean_scrub_stamp":"2024-09-12T01:38:48.649125+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:46.974866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":48,"num_write":38,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:39:09.026929+0000","last_change":"2024-09-12T01:39:09.026929+0000","last_active":"2024-09-12T01:39:09.026929+0000","last_peered":"2024-09-12T01:39:09.026929+0000","last_clean":"2024-09-12T01:39:09.026929+0000","last_became_active":"2024-09-12T01:04:15.398407+0000","last_became_peered":"2024-09-12T01:04:15.398407+0000","last_unstale":"2024-09-12T01:39:09.026929+0000","last_undegraded":"2024-09-12T01:39:09.026929+0000","last_fullsized":"2024-09-12T01:39:09.026929+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:09.026844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:09.026844+0000","last_clean_scrub_stamp":"2024-09-12T01:39:09.026844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:45.095349+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"263'3","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:45.781269+0000","last_change":"2024-09-12T01:38:45.781269+0000","last_active":"2024-09-12T01:38:45.781269+0000","last_peered":"2024-09-12T01:38:45.781269+0000","last_clean":"2024-09-12T01:38:45.781269+0000","last_became_active":"2024-09-12T00:46:26.366602+0000","last_became_peered":"2024-09-12T00:46:26.366602+0000","last_unstale":"2024-09-12T01:38:45.781269+0000","last_undegraded":"2024-09-12T01:38:45.781269+0000","last_fullsized":"2024-09-12T01:38:45.781269+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-12T01:38:45.781144+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-12T01:38:45.781144+0000","last_clean_scrub_stamp":"2024-09-12T01:38:45.781144+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:44.387003+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"263'9","reported_seq":70,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:47.504069+0000","last_change":"2024-09-12T01:38:47.504069+0000","last_active":"2024-09-12T01:38:47.504069+0000","last_peered":"2024-09-12T01:38:47.504069+0000","last_clean":"2024-09-12T01:38:47.504069+0000","last_became_active":"2024-09-12T00:46:22.351432+0000","last_became_peered":"2024-09-12T00:46:22.351432+0000","last_unstale":"2024-09-12T01:38:47.504069+0000","last_undegraded":"2024-09-12T01:38:47.504069+0000","last_fullsized":"2024-09-12T01:38:47.504069+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'9","last_scrub_stamp":"2024-09-12T01:38:47.503964+0000","last_deep_scrub":"263'9","last_deep_scrub_stamp":"2024-09-12T01:38:47.503964+0000","last_clean_scrub_stamp":"2024-09-12T01:38:47.503964+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:50.062333+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":19,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"252'16","reported_seq":112,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:47.604258+0000","last_change":"2024-09-12T01:38:47.604258+0000","last_active":"2024-09-12T01:38:47.604258+0000","last_peered":"2024-09-12T01:38:47.604258+0000","last_clean":"2024-09-12T01:38:47.604258+0000","last_became_active":"2024-09-12T00:42:36.813324+0000","last_became_peered":"2024-09-12T00:42:36.813324+0000","last_unstale":"2024-09-12T01:38:47.604258+0000","last_undegraded":"2024-09-12T01:38:47.604258+0000","last_fullsized":"2024-09-12T01:38:47.604258+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"252'16","last_scrub_stamp":"2024-09-12T01:38:47.604175+0000","last_deep_scrub":"252'16","last_deep_scrub_stamp":"2024-09-12T01:38:47.604175+0000","last_clean_scrub_stamp":"2024-09-12T01:38:47.604175+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:51.309268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":59,"num_write":21,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:39:07.254408+0000","last_change":"2024-09-12T01:39:07.254408+0000","last_active":"2024-09-12T01:39:07.254408+0000","last_peered":"2024-09-12T01:39:07.254408+0000","last_clean":"2024-09-12T01:39:07.254408+0000","last_became_active":"2024-09-12T01:04:15.393021+0000","last_became_peered":"2024-09-12T01:04:15.393021+0000","last_unstale":"2024-09-12T01:39:07.254408+0000","last_undegraded":"2024-09-12T01:39:07.254408+0000","last_fullsized":"2024-09-12T01:39:07.254408+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:07.254323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:07.254323+0000","last_clean_scrub_stamp":"2024-09-12T01:39:07.254323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:23.882068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"260'8","reported_seq":74,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:44.771845+0000","last_change":"2024-09-12T01:38:44.771845+0000","last_active":"2024-09-12T01:38:44.771845+0000","last_peered":"2024-09-12T01:38:44.771845+0000","last_clean":"2024-09-12T01:38:44.771845+0000","last_became_active":"2024-09-12T00:46:26.371443+0000","last_became_peered":"2024-09-12T00:46:26.371443+0000","last_unstale":"2024-09-12T01:38:44.771845+0000","last_undegraded":"2024-09-12T01:38:44.771845+0000","last_fullsized":"2024-09-12T01:38:44.771845+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'8","last_scrub_stamp":"2024-09-12T01:38:44.771738+0000","last_deep_scrub":"260'8","last_deep_scrub_stamp":"2024-09-12T01:38:44.771738+0000","last_clean_scrub_stamp":"2024-09-12T01:38:44.771738+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:57.305608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":26626,"num_write":8,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:56.173818+0000","last_change":"2024-09-12T01:38:56.173818+0000","last_active":"2024-09-12T01:38:56.173818+0000","last_peered":"2024-09-12T01:38:56.173818+0000","last_clean":"2024-09-12T01:38:56.173818+0000","last_became_active":"2024-09-12T00:46:22.350714+0000","last_became_peered":"2024-09-12T00:46:22.350714+0000","last_unstale":"2024-09-12T01:38:56.173818+0000","last_undegraded":"2024-09-12T01:38:56.173818+0000","last_fullsized":"2024-09-12T01:38:56.173818+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:56.173705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:56.173705+0000","last_clean_scrub_stamp":"2024-09-12T01:38:56.173705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:45.514660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"263'52","reported_seq":210,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:47.224982+0000","last_change":"2024-09-12T01:38:47.224982+0000","last_active":"2024-09-12T01:38:47.224982+0000","last_peered":"2024-09-12T01:38:47.224982+0000","last_clean":"2024-09-12T01:38:47.224982+0000","last_became_active":"2024-09-12T00:42:36.817763+0000","last_became_peered":"2024-09-12T00:42:36.817763+0000","last_unstale":"2024-09-12T01:38:47.224982+0000","last_undegraded":"2024-09-12T01:38:47.224982+0000","last_fullsized":"2024-09-12T01:38:47.224982+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'52","last_scrub_stamp":"2024-09-12T01:38:47.224857+0000","last_deep_scrub":"263'52","last_deep_scrub_stamp":"2024-09-12T01:38:47.224857+0000","last_clean_scrub_stamp":"2024-09-12T01:38:47.224857+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:47.769940+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":268,"num_read_kb":195,"num_write":87,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"263'2","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:39:06.221780+0000","last_change":"2024-09-12T01:39:06.221703+0000","last_active":"2024-09-12T01:39:06.221780+0000","last_peered":"2024-09-12T01:39:06.221780+0000","last_clean":"2024-09-12T01:39:06.221780+0000","last_became_active":"2024-09-12T01:04:15.396832+0000","last_became_peered":"2024-09-12T01:04:15.396832+0000","last_unstale":"2024-09-12T01:39:06.221780+0000","last_undegraded":"2024-09-12T01:39:06.221780+0000","last_fullsized":"2024-09-12T01:39:06.221780+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:39:06.221620+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:39:06.221620+0000","last_clean_scrub_stamp":"2024-09-12T01:39:06.221620+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:28.889915+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:39:01.117705+0000","last_change":"2024-09-12T01:39:01.117705+0000","last_active":"2024-09-12T01:39:01.117705+0000","last_peered":"2024-09-12T01:39:01.117705+0000","last_clean":"2024-09-12T01:39:01.117705+0000","last_became_active":"2024-09-12T00:46:26.373401+0000","last_became_peered":"2024-09-12T00:46:26.373401+0000","last_unstale":"2024-09-12T01:39:01.117705+0000","last_undegraded":"2024-09-12T01:39:01.117705+0000","last_fullsized":"2024-09-12T01:39:01.117705+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:01.117609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:01.117609+0000","last_clean_scrub_stamp":"2024-09-12T01:39:01.117609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:36.433330+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:39.020820+0000","last_change":"2024-09-12T01:38:39.020820+0000","last_active":"2024-09-12T01:38:39.020820+0000","last_peered":"2024-09-12T01:38:39.020820+0000","last_clean":"2024-09-12T01:38:39.020820+0000","last_became_active":"2024-09-12T00:46:22.347794+0000","last_became_peered":"2024-09-12T00:46:22.347794+0000","last_unstale":"2024-09-12T01:38:39.020820+0000","last_undegraded":"2024-09-12T01:38:39.020820+0000","last_fullsized":"2024-09-12T01:38:39.020820+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:39.020729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:39.020729+0000","last_clean_scrub_stamp":"2024-09-12T01:38:39.020729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:19.893388+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'10","reported_seq":92,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:44.476405+0000","last_change":"2024-09-12T01:38:44.476405+0000","last_active":"2024-09-12T01:38:44.476405+0000","last_peered":"2024-09-12T01:38:44.476405+0000","last_clean":"2024-09-12T01:38:44.476405+0000","last_became_active":"2024-09-12T00:42:36.802647+0000","last_became_peered":"2024-09-12T00:42:36.802647+0000","last_unstale":"2024-09-12T01:38:44.476405+0000","last_undegraded":"2024-09-12T01:38:44.476405+0000","last_fullsized":"2024-09-12T01:38:44.476405+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'10","last_scrub_stamp":"2024-09-12T01:38:44.476313+0000","last_deep_scrub":"263'10","last_deep_scrub_stamp":"2024-09-12T01:38:44.476313+0000","last_clean_scrub_stamp":"2024-09-12T01:38:44.476313+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:58.387217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":30,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"263'2","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:39:08.066516+0000","last_change":"2024-09-12T01:39:08.066516+0000","last_active":"2024-09-12T01:39:08.066516+0000","last_peered":"2024-09-12T01:39:08.066516+0000","last_clean":"2024-09-12T01:39:08.066516+0000","last_became_active":"2024-09-12T01:04:15.397646+0000","last_became_peered":"2024-09-12T01:04:15.397646+0000","last_unstale":"2024-09-12T01:39:08.066516+0000","last_undegraded":"2024-09-12T01:39:08.066516+0000","last_fullsized":"2024-09-12T01:39:08.066516+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:39:08.066427+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:39:08.066427+0000","last_clean_scrub_stamp":"2024-09-12T01:39:08.066427+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:21.422423+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"263'3","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:40.946648+0000","last_change":"2024-09-12T01:38:40.946648+0000","last_active":"2024-09-12T01:38:40.946648+0000","last_peered":"2024-09-12T01:38:40.946648+0000","last_clean":"2024-09-12T01:38:40.946648+0000","last_became_active":"2024-09-12T00:46:26.373354+0000","last_became_peered":"2024-09-12T00:46:26.373354+0000","last_unstale":"2024-09-12T01:38:40.946648+0000","last_undegraded":"2024-09-12T01:38:40.946648+0000","last_fullsized":"2024-09-12T01:38:40.946648+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-12T01:38:40.946561+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-12T01:38:40.946561+0000","last_clean_scrub_stamp":"2024-09-12T01:38:40.946561+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:54.214293+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:51.435171+0000","last_change":"2024-09-12T01:38:51.435171+0000","last_active":"2024-09-12T01:38:51.435171+0000","last_peered":"2024-09-12T01:38:51.435171+0000","last_clean":"2024-09-12T01:38:51.435171+0000","last_became_active":"2024-09-12T00:46:22.348875+0000","last_became_peered":"2024-09-12T00:46:22.348875+0000","last_unstale":"2024-09-12T01:38:51.435171+0000","last_undegraded":"2024-09-12T01:38:51.435171+0000","last_fullsized":"2024-09-12T01:38:51.435171+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:51.435075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:51.435075+0000","last_clean_scrub_stamp":"2024-09-12T01:38:51.435075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:05.426083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"263'37","reported_seq":173,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:52.303375+0000","last_change":"2024-09-12T01:38:52.303375+0000","last_active":"2024-09-12T01:38:52.303375+0000","last_peered":"2024-09-12T01:38:52.303375+0000","last_clean":"2024-09-12T01:38:52.303375+0000","last_became_active":"2024-09-12T00:42:36.814235+0000","last_became_peered":"2024-09-12T00:42:36.814235+0000","last_unstale":"2024-09-12T01:38:52.303375+0000","last_undegraded":"2024-09-12T01:38:52.303375+0000","last_fullsized":"2024-09-12T01:38:52.303375+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'37","last_scrub_stamp":"2024-09-12T01:38:52.303290+0000","last_deep_scrub":"263'37","last_deep_scrub_stamp":"2024-09-12T01:38:52.303290+0000","last_clean_scrub_stamp":"2024-09-12T01:38:52.303290+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:43.226310+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":201,"num_read_kb":139,"num_write":71,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.746966+0000","last_change":"2024-09-12T01:38:35.746892+0000","last_active":"2024-09-12T01:38:35.746966+0000","last_peered":"2024-09-12T01:38:35.746966+0000","last_clean":"2024-09-12T01:38:35.746966+0000","last_became_active":"2024-09-12T01:04:15.395860+0000","last_became_peered":"2024-09-12T01:04:15.395860+0000","last_unstale":"2024-09-12T01:38:35.746966+0000","last_undegraded":"2024-09-12T01:38:35.746966+0000","last_fullsized":"2024-09-12T01:38:35.746966+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.746784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.746784+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.746784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:51.193748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:59.157638+0000","last_change":"2024-09-12T01:38:59.157638+0000","last_active":"2024-09-12T01:38:59.157638+0000","last_peered":"2024-09-12T01:38:59.157638+0000","last_clean":"2024-09-12T01:38:59.157638+0000","last_became_active":"2024-09-12T00:46:26.372803+0000","last_became_peered":"2024-09-12T00:46:26.372803+0000","last_unstale":"2024-09-12T01:38:59.157638+0000","last_undegraded":"2024-09-12T01:38:59.157638+0000","last_fullsized":"2024-09-12T01:38:59.157638+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:59.157507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:59.157507+0000","last_clean_scrub_stamp":"2024-09-12T01:38:59.157507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:06.197400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"263'9","reported_seq":75,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:52.694014+0000","last_change":"2024-09-12T01:38:52.694014+0000","last_active":"2024-09-12T01:38:52.694014+0000","last_peered":"2024-09-12T01:38:52.694014+0000","last_clean":"2024-09-12T01:38:52.694014+0000","last_became_active":"2024-09-12T00:46:22.355962+0000","last_became_peered":"2024-09-12T00:46:22.355962+0000","last_unstale":"2024-09-12T01:38:52.694014+0000","last_undegraded":"2024-09-12T01:38:52.694014+0000","last_fullsized":"2024-09-12T01:38:52.694014+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'9","last_scrub_stamp":"2024-09-12T01:38:52.693933+0000","last_deep_scrub":"263'9","last_deep_scrub_stamp":"2024-09-12T01:38:52.693933+0000","last_clean_scrub_stamp":"2024-09-12T01:38:52.693933+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:37.339302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5707,"num_write":14,"num_write_kb":4683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"263'12","reported_seq":99,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:51.306105+0000","last_change":"2024-09-12T01:38:51.306058+0000","last_active":"2024-09-12T01:38:51.306105+0000","last_peered":"2024-09-12T01:38:51.306105+0000","last_clean":"2024-09-12T01:38:51.306105+0000","last_became_active":"2024-09-12T00:42:36.816673+0000","last_became_peered":"2024-09-12T00:42:36.816673+0000","last_unstale":"2024-09-12T01:38:51.306105+0000","last_undegraded":"2024-09-12T01:38:51.306105+0000","last_fullsized":"2024-09-12T01:38:51.306105+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'12","last_scrub_stamp":"2024-09-12T01:38:51.305983+0000","last_deep_scrub":"263'12","last_deep_scrub_stamp":"2024-09-12T01:38:51.305983+0000","last_clean_scrub_stamp":"2024-09-12T01:38:51.305983+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:14.472688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":40,"num_write":24,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:39:01.633864+0000","last_change":"2024-09-12T01:39:01.633864+0000","last_active":"2024-09-12T01:39:01.633864+0000","last_peered":"2024-09-12T01:39:01.633864+0000","last_clean":"2024-09-12T01:39:01.633864+0000","last_became_active":"2024-09-12T01:04:15.393597+0000","last_became_peered":"2024-09-12T01:04:15.393597+0000","last_unstale":"2024-09-12T01:39:01.633864+0000","last_undegraded":"2024-09-12T01:39:01.633864+0000","last_fullsized":"2024-09-12T01:39:01.633864+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:01.633757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:01.633757+0000","last_clean_scrub_stamp":"2024-09-12T01:39:01.633757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:03.217948+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:58.185319+0000","last_change":"2024-09-12T01:38:58.185319+0000","last_active":"2024-09-12T01:38:58.185319+0000","last_peered":"2024-09-12T01:38:58.185319+0000","last_clean":"2024-09-12T01:38:58.185319+0000","last_became_active":"2024-09-12T00:46:26.365848+0000","last_became_peered":"2024-09-12T00:46:26.365848+0000","last_unstale":"2024-09-12T01:38:58.185319+0000","last_undegraded":"2024-09-12T01:38:58.185319+0000","last_fullsized":"2024-09-12T01:38:58.185319+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:58.185187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:58.185187+0000","last_clean_scrub_stamp":"2024-09-12T01:38:58.185187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:38.382530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"263'3","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:32.652611+0000","last_change":"2024-09-12T01:38:32.652611+0000","last_active":"2024-09-12T01:38:32.652611+0000","last_peered":"2024-09-12T01:38:32.652611+0000","last_clean":"2024-09-12T01:38:32.652611+0000","last_became_active":"2024-09-12T00:46:22.350815+0000","last_became_peered":"2024-09-12T00:46:22.350815+0000","last_unstale":"2024-09-12T01:38:32.652611+0000","last_undegraded":"2024-09-12T01:38:32.652611+0000","last_fullsized":"2024-09-12T01:38:32.652611+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-12T01:38:32.652500+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-12T01:38:32.652500+0000","last_clean_scrub_stamp":"2024-09-12T01:38:32.652500+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:56.268124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"263'49","reported_seq":197,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:49.440377+0000","last_change":"2024-09-12T01:38:49.440288+0000","last_active":"2024-09-12T01:38:49.440377+0000","last_peered":"2024-09-12T01:38:49.440377+0000","last_clean":"2024-09-12T01:38:49.440377+0000","last_became_active":"2024-09-12T00:42:36.810754+0000","last_became_peered":"2024-09-12T00:42:36.810754+0000","last_unstale":"2024-09-12T01:38:49.440377+0000","last_undegraded":"2024-09-12T01:38:49.440377+0000","last_fullsized":"2024-09-12T01:38:49.440377+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'49","last_scrub_stamp":"2024-09-12T01:38:49.440173+0000","last_deep_scrub":"263'49","last_deep_scrub_stamp":"2024-09-12T01:38:49.440173+0000","last_clean_scrub_stamp":"2024-09-12T01:38:49.440173+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:00.119904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":240,"num_read_kb":165,"num_write":91,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:44.968934+0000","last_change":"2024-09-12T01:38:44.968832+0000","last_active":"2024-09-12T01:38:44.968934+0000","last_peered":"2024-09-12T01:38:44.968934+0000","last_clean":"2024-09-12T01:38:44.968934+0000","last_became_active":"2024-09-12T01:04:15.396999+0000","last_became_peered":"2024-09-12T01:04:15.396999+0000","last_unstale":"2024-09-12T01:38:44.968934+0000","last_undegraded":"2024-09-12T01:38:44.968934+0000","last_fullsized":"2024-09-12T01:38:44.968934+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:44.968746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:44.968746+0000","last_clean_scrub_stamp":"2024-09-12T01:38:44.968746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:31.808451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:43.782123+0000","last_change":"2024-09-12T01:38:43.782123+0000","last_active":"2024-09-12T01:38:43.782123+0000","last_peered":"2024-09-12T01:38:43.782123+0000","last_clean":"2024-09-12T01:38:43.782123+0000","last_became_active":"2024-09-12T00:46:26.563041+0000","last_became_peered":"2024-09-12T00:46:26.563041+0000","last_unstale":"2024-09-12T01:38:43.782123+0000","last_undegraded":"2024-09-12T01:38:43.782123+0000","last_fullsized":"2024-09-12T01:38:43.782123+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:43.782030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:43.782030+0000","last_clean_scrub_stamp":"2024-09-12T01:38:43.782030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:45.708647+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:56.359477+0000","last_change":"2024-09-12T01:38:56.359477+0000","last_active":"2024-09-12T01:38:56.359477+0000","last_peered":"2024-09-12T01:38:56.359477+0000","last_clean":"2024-09-12T01:38:56.359477+0000","last_became_active":"2024-09-12T00:46:22.352933+0000","last_became_peered":"2024-09-12T00:46:22.352933+0000","last_unstale":"2024-09-12T01:38:56.359477+0000","last_undegraded":"2024-09-12T01:38:56.359477+0000","last_fullsized":"2024-09-12T01:38:56.359477+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:56.359393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:56.359393+0000","last_clean_scrub_stamp":"2024-09-12T01:38:56.359393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:35.089670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"263'30","reported_seq":152,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.083729+0000","last_change":"2024-09-12T01:38:37.083672+0000","last_active":"2024-09-12T01:38:37.083729+0000","last_peered":"2024-09-12T01:38:37.083729+0000","last_clean":"2024-09-12T01:38:37.083729+0000","last_became_active":"2024-09-12T00:42:36.816619+0000","last_became_peered":"2024-09-12T00:42:36.816619+0000","last_unstale":"2024-09-12T01:38:37.083729+0000","last_undegraded":"2024-09-12T01:38:37.083729+0000","last_fullsized":"2024-09-12T01:38:37.083729+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'30","last_scrub_stamp":"2024-09-12T01:38:37.083582+0000","last_deep_scrub":"263'30","last_deep_scrub_stamp":"2024-09-12T01:38:37.083582+0000","last_clean_scrub_stamp":"2024-09-12T01:38:37.083582+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:16.757422+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":113,"num_write":55,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:39:00.633276+0000","last_change":"2024-09-12T01:39:00.633276+0000","last_active":"2024-09-12T01:39:00.633276+0000","last_peered":"2024-09-12T01:39:00.633276+0000","last_clean":"2024-09-12T01:39:00.633276+0000","last_became_active":"2024-09-12T01:04:15.396125+0000","last_became_peered":"2024-09-12T01:04:15.396125+0000","last_unstale":"2024-09-12T01:39:00.633276+0000","last_undegraded":"2024-09-12T01:39:00.633276+0000","last_fullsized":"2024-09-12T01:39:00.633276+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:00.633172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:00.633172+0000","last_clean_scrub_stamp":"2024-09-12T01:39:00.633172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:44.860881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:39:00.118240+0000","last_change":"2024-09-12T01:39:00.118240+0000","last_active":"2024-09-12T01:39:00.118240+0000","last_peered":"2024-09-12T01:39:00.118240+0000","last_clean":"2024-09-12T01:39:00.118240+0000","last_became_active":"2024-09-12T00:46:26.366293+0000","last_became_peered":"2024-09-12T00:46:26.366293+0000","last_unstale":"2024-09-12T01:39:00.118240+0000","last_undegraded":"2024-09-12T01:39:00.118240+0000","last_fullsized":"2024-09-12T01:39:00.118240+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:00.118147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:00.118147+0000","last_clean_scrub_stamp":"2024-09-12T01:39:00.118147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:00.946035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"263'3","reported_seq":67,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:39.792087+0000","last_change":"2024-09-12T01:38:39.792087+0000","last_active":"2024-09-12T01:38:39.792087+0000","last_peered":"2024-09-12T01:38:39.792087+0000","last_clean":"2024-09-12T01:38:39.792087+0000","last_became_active":"2024-09-12T00:46:22.348546+0000","last_became_peered":"2024-09-12T00:46:22.348546+0000","last_unstale":"2024-09-12T01:38:39.792087+0000","last_undegraded":"2024-09-12T01:38:39.792087+0000","last_fullsized":"2024-09-12T01:38:39.792087+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-12T01:38:39.792001+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-12T01:38:39.792001+0000","last_clean_scrub_stamp":"2024-09-12T01:38:39.792001+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:53.468245+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"263'34","reported_seq":158,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:27.702824+0000","last_change":"2024-09-12T01:38:27.702719+0000","last_active":"2024-09-12T01:38:27.702824+0000","last_peered":"2024-09-12T01:38:27.702824+0000","last_clean":"2024-09-12T01:38:27.702824+0000","last_became_active":"2024-09-12T00:42:36.817530+0000","last_became_peered":"2024-09-12T00:42:36.817530+0000","last_unstale":"2024-09-12T01:38:27.702824+0000","last_undegraded":"2024-09-12T01:38:27.702824+0000","last_fullsized":"2024-09-12T01:38:27.702824+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'34","last_scrub_stamp":"2024-09-12T01:38:27.702618+0000","last_deep_scrub":"263'34","last_deep_scrub_stamp":"2024-09-12T01:38:27.702618+0000","last_clean_scrub_stamp":"2024-09-12T01:38:27.702618+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:09.546260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":117,"num_write":66,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:39:07.098628+0000","last_change":"2024-09-12T01:39:07.098628+0000","last_active":"2024-09-12T01:39:07.098628+0000","last_peered":"2024-09-12T01:39:07.098628+0000","last_clean":"2024-09-12T01:39:07.098628+0000","last_became_active":"2024-09-12T01:04:15.399564+0000","last_became_peered":"2024-09-12T01:04:15.399564+0000","last_unstale":"2024-09-12T01:39:07.098628+0000","last_undegraded":"2024-09-12T01:39:07.098628+0000","last_fullsized":"2024-09-12T01:39:07.098628+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:07.098534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:07.098534+0000","last_clean_scrub_stamp":"2024-09-12T01:39:07.098534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:05.107144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"263'7","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:53.616340+0000","last_change":"2024-09-12T01:38:53.616340+0000","last_active":"2024-09-12T01:38:53.616340+0000","last_peered":"2024-09-12T01:38:53.616340+0000","last_clean":"2024-09-12T01:38:53.616340+0000","last_became_active":"2024-09-12T00:46:26.373942+0000","last_became_peered":"2024-09-12T00:46:26.373942+0000","last_unstale":"2024-09-12T01:38:53.616340+0000","last_undegraded":"2024-09-12T01:38:53.616340+0000","last_fullsized":"2024-09-12T01:38:53.616340+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'7","last_scrub_stamp":"2024-09-12T01:38:53.616240+0000","last_deep_scrub":"263'7","last_deep_scrub_stamp":"2024-09-12T01:38:53.616240+0000","last_clean_scrub_stamp":"2024-09-12T01:38:53.616240+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:10.767002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8208,"num_write":12,"num_write_kb":8208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:54.325155+0000","last_change":"2024-09-12T01:38:54.325155+0000","last_active":"2024-09-12T01:38:54.325155+0000","last_peered":"2024-09-12T01:38:54.325155+0000","last_clean":"2024-09-12T01:38:54.325155+0000","last_became_active":"2024-09-12T00:46:22.352156+0000","last_became_peered":"2024-09-12T00:46:22.352156+0000","last_unstale":"2024-09-12T01:38:54.325155+0000","last_undegraded":"2024-09-12T01:38:54.325155+0000","last_fullsized":"2024-09-12T01:38:54.325155+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:54.325070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:54.325070+0000","last_clean_scrub_stamp":"2024-09-12T01:38:54.325070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:14.030801+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"263'10","reported_seq":92,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:46.239386+0000","last_change":"2024-09-12T01:38:46.239322+0000","last_active":"2024-09-12T01:38:46.239386+0000","last_peered":"2024-09-12T01:38:46.239386+0000","last_clean":"2024-09-12T01:38:46.239386+0000","last_became_active":"2024-09-12T00:42:36.817021+0000","last_became_peered":"2024-09-12T00:42:36.817021+0000","last_unstale":"2024-09-12T01:38:46.239386+0000","last_undegraded":"2024-09-12T01:38:46.239386+0000","last_fullsized":"2024-09-12T01:38:46.239386+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'10","last_scrub_stamp":"2024-09-12T01:38:46.239230+0000","last_deep_scrub":"263'10","last_deep_scrub_stamp":"2024-09-12T01:38:46.239230+0000","last_clean_scrub_stamp":"2024-09-12T01:38:46.239230+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:04.978959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:39:02.635175+0000","last_change":"2024-09-12T01:39:02.635175+0000","last_active":"2024-09-12T01:39:02.635175+0000","last_peered":"2024-09-12T01:39:02.635175+0000","last_clean":"2024-09-12T01:39:02.635175+0000","last_became_active":"2024-09-12T01:04:15.396096+0000","last_became_peered":"2024-09-12T01:04:15.396096+0000","last_unstale":"2024-09-12T01:39:02.635175+0000","last_undegraded":"2024-09-12T01:39:02.635175+0000","last_fullsized":"2024-09-12T01:39:02.635175+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:02.635085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:02.635085+0000","last_clean_scrub_stamp":"2024-09-12T01:39:02.635085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:43.013892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"260'5","reported_seq":70,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:56.658584+0000","last_change":"2024-09-12T01:38:56.658584+0000","last_active":"2024-09-12T01:38:56.658584+0000","last_peered":"2024-09-12T01:38:56.658584+0000","last_clean":"2024-09-12T01:38:56.658584+0000","last_became_active":"2024-09-12T00:46:26.561924+0000","last_became_peered":"2024-09-12T00:46:26.561924+0000","last_unstale":"2024-09-12T01:38:56.658584+0000","last_undegraded":"2024-09-12T01:38:56.658584+0000","last_fullsized":"2024-09-12T01:38:56.658584+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-12T01:38:56.658492+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-12T01:38:56.658492+0000","last_clean_scrub_stamp":"2024-09-12T01:38:56.658492+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:17.507596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.869978+0000","last_change":"2024-09-12T01:38:35.869978+0000","last_active":"2024-09-12T01:38:35.869978+0000","last_peered":"2024-09-12T01:38:35.869978+0000","last_clean":"2024-09-12T01:38:35.869978+0000","last_became_active":"2024-09-12T00:46:22.349376+0000","last_became_peered":"2024-09-12T00:46:22.349376+0000","last_unstale":"2024-09-12T01:38:35.869978+0000","last_undegraded":"2024-09-12T01:38:35.869978+0000","last_fullsized":"2024-09-12T01:38:35.869978+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.869862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.869862+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.869862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:32.067962+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"263'30","reported_seq":153,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:46.591517+0000","last_change":"2024-09-12T01:38:46.591451+0000","last_active":"2024-09-12T01:38:46.591517+0000","last_peered":"2024-09-12T01:38:46.591517+0000","last_clean":"2024-09-12T01:38:46.591517+0000","last_became_active":"2024-09-12T00:42:36.809602+0000","last_became_peered":"2024-09-12T00:42:36.809602+0000","last_unstale":"2024-09-12T01:38:46.591517+0000","last_undegraded":"2024-09-12T01:38:46.591517+0000","last_fullsized":"2024-09-12T01:38:46.591517+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'30","last_scrub_stamp":"2024-09-12T01:38:46.591367+0000","last_deep_scrub":"263'30","last_deep_scrub_stamp":"2024-09-12T01:38:46.591367+0000","last_clean_scrub_stamp":"2024-09-12T01:38:46.591367+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:17.110484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":112,"num_write":54,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"263'2","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:39:04.644433+0000","last_change":"2024-09-12T01:39:04.644433+0000","last_active":"2024-09-12T01:39:04.644433+0000","last_peered":"2024-09-12T01:39:04.644433+0000","last_clean":"2024-09-12T01:39:04.644433+0000","last_became_active":"2024-09-12T01:04:15.392789+0000","last_became_peered":"2024-09-12T01:04:15.392789+0000","last_unstale":"2024-09-12T01:39:04.644433+0000","last_undegraded":"2024-09-12T01:39:04.644433+0000","last_fullsized":"2024-09-12T01:39:04.644433+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:39:04.644336+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:39:04.644336+0000","last_clean_scrub_stamp":"2024-09-12T01:39:04.644336+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:54.416299+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"260'5","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:42.777587+0000","last_change":"2024-09-12T01:38:42.777587+0000","last_active":"2024-09-12T01:38:42.777587+0000","last_peered":"2024-09-12T01:38:42.777587+0000","last_clean":"2024-09-12T01:38:42.777587+0000","last_became_active":"2024-09-12T00:46:26.369883+0000","last_became_peered":"2024-09-12T00:46:26.369883+0000","last_unstale":"2024-09-12T01:38:42.777587+0000","last_undegraded":"2024-09-12T01:38:42.777587+0000","last_fullsized":"2024-09-12T01:38:42.777587+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-12T01:38:42.777465+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-12T01:38:42.777465+0000","last_clean_scrub_stamp":"2024-09-12T01:38:42.777465+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:57.944053+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:55.327971+0000","last_change":"2024-09-12T01:38:55.327971+0000","last_active":"2024-09-12T01:38:55.327971+0000","last_peered":"2024-09-12T01:38:55.327971+0000","last_clean":"2024-09-12T01:38:55.327971+0000","last_became_active":"2024-09-12T00:46:22.348568+0000","last_became_peered":"2024-09-12T00:46:22.348568+0000","last_unstale":"2024-09-12T01:38:55.327971+0000","last_undegraded":"2024-09-12T01:38:55.327971+0000","last_fullsized":"2024-09-12T01:38:55.327971+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:55.327891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:55.327891+0000","last_clean_scrub_stamp":"2024-09-12T01:38:55.327891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:09.634643+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"263'9","reported_seq":93,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:50.339950+0000","last_change":"2024-09-12T01:38:50.339885+0000","last_active":"2024-09-12T01:38:50.339950+0000","last_peered":"2024-09-12T01:38:50.339950+0000","last_clean":"2024-09-12T01:38:50.339950+0000","last_became_active":"2024-09-12T00:42:36.813997+0000","last_became_peered":"2024-09-12T00:42:36.813997+0000","last_unstale":"2024-09-12T01:38:50.339950+0000","last_undegraded":"2024-09-12T01:38:50.339950+0000","last_fullsized":"2024-09-12T01:38:50.339950+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'9","last_scrub_stamp":"2024-09-12T01:38:50.339791+0000","last_deep_scrub":"263'9","last_deep_scrub_stamp":"2024-09-12T01:38:50.339791+0000","last_clean_scrub_stamp":"2024-09-12T01:38:50.339791+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:59.134254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:39:05.201854+0000","last_change":"2024-09-12T01:39:05.201854+0000","last_active":"2024-09-12T01:39:05.201854+0000","last_peered":"2024-09-12T01:39:05.201854+0000","last_clean":"2024-09-12T01:39:05.201854+0000","last_became_active":"2024-09-12T01:04:15.393220+0000","last_became_peered":"2024-09-12T01:04:15.393220+0000","last_unstale":"2024-09-12T01:39:05.201854+0000","last_undegraded":"2024-09-12T01:39:05.201854+0000","last_fullsized":"2024-09-12T01:39:05.201854+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:05.201765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:05.201765+0000","last_clean_scrub_stamp":"2024-09-12T01:39:05.201765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:47.991089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"263'2","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:57.680391+0000","last_change":"2024-09-12T01:38:57.680391+0000","last_active":"2024-09-12T01:38:57.680391+0000","last_peered":"2024-09-12T01:38:57.680391+0000","last_clean":"2024-09-12T01:38:57.680391+0000","last_became_active":"2024-09-12T00:46:26.370349+0000","last_became_peered":"2024-09-12T00:46:26.370349+0000","last_unstale":"2024-09-12T01:38:57.680391+0000","last_undegraded":"2024-09-12T01:38:57.680391+0000","last_fullsized":"2024-09-12T01:38:57.680391+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:38:57.680305+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:38:57.680305+0000","last_clean_scrub_stamp":"2024-09-12T01:38:57.680305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:00.959503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"263'11","reported_seq":85,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:46.464733+0000","last_change":"2024-09-12T01:38:46.464733+0000","last_active":"2024-09-12T01:38:46.464733+0000","last_peered":"2024-09-12T01:38:46.464733+0000","last_clean":"2024-09-12T01:38:46.464733+0000","last_became_active":"2024-09-12T00:46:22.346024+0000","last_became_peered":"2024-09-12T00:46:22.346024+0000","last_unstale":"2024-09-12T01:38:46.464733+0000","last_undegraded":"2024-09-12T01:38:46.464733+0000","last_fullsized":"2024-09-12T01:38:46.464733+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'11","last_scrub_stamp":"2024-09-12T01:38:46.464647+0000","last_deep_scrub":"263'11","last_deep_scrub_stamp":"2024-09-12T01:38:46.464647+0000","last_clean_scrub_stamp":"2024-09-12T01:38:46.464647+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:44.904960+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":32770,"num_write":16,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"263'38","reported_seq":168,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.113574+0000","last_change":"2024-09-12T01:38:35.113493+0000","last_active":"2024-09-12T01:38:35.113574+0000","last_peered":"2024-09-12T01:38:35.113574+0000","last_clean":"2024-09-12T01:38:35.113574+0000","last_became_active":"2024-09-12T00:42:36.809350+0000","last_became_peered":"2024-09-12T00:42:36.809350+0000","last_unstale":"2024-09-12T01:38:35.113574+0000","last_undegraded":"2024-09-12T01:38:35.113574+0000","last_fullsized":"2024-09-12T01:38:35.113574+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'38","last_scrub_stamp":"2024-09-12T01:38:35.113390+0000","last_deep_scrub":"263'38","last_deep_scrub_stamp":"2024-09-12T01:38:35.113390+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.113390+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:20.270309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":127,"num_write":71,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:58.641441+0000","last_change":"2024-09-12T01:38:58.641441+0000","last_active":"2024-09-12T01:38:58.641441+0000","last_peered":"2024-09-12T01:38:58.641441+0000","last_clean":"2024-09-12T01:38:58.641441+0000","last_became_active":"2024-09-12T01:04:15.394795+0000","last_became_peered":"2024-09-12T01:04:15.394795+0000","last_unstale":"2024-09-12T01:38:58.641441+0000","last_undegraded":"2024-09-12T01:38:58.641441+0000","last_fullsized":"2024-09-12T01:38:58.641441+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:58.641356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:58.641356+0000","last_clean_scrub_stamp":"2024-09-12T01:38:58.641356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:06.959797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"263'2","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:59.346714+0000","last_change":"2024-09-12T01:38:59.346714+0000","last_active":"2024-09-12T01:38:59.346714+0000","last_peered":"2024-09-12T01:38:59.346714+0000","last_clean":"2024-09-12T01:38:59.346714+0000","last_became_active":"2024-09-12T00:46:26.367852+0000","last_became_peered":"2024-09-12T00:46:26.367852+0000","last_unstale":"2024-09-12T01:38:59.346714+0000","last_undegraded":"2024-09-12T01:38:59.346714+0000","last_fullsized":"2024-09-12T01:38:59.346714+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:38:59.346631+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:38:59.346631+0000","last_clean_scrub_stamp":"2024-09-12T01:38:59.346631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:26.860657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1142,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"260'3","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:51.743083+0000","last_change":"2024-09-12T01:38:51.743083+0000","last_active":"2024-09-12T01:38:51.743083+0000","last_peered":"2024-09-12T01:38:51.743083+0000","last_clean":"2024-09-12T01:38:51.743083+0000","last_became_active":"2024-09-12T00:46:22.351237+0000","last_became_peered":"2024-09-12T00:46:22.351237+0000","last_unstale":"2024-09-12T01:38:51.743083+0000","last_undegraded":"2024-09-12T01:38:51.743083+0000","last_fullsized":"2024-09-12T01:38:51.743083+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-12T01:38:51.742980+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-12T01:38:51.742980+0000","last_clean_scrub_stamp":"2024-09-12T01:38:51.742980+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:42.402975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'36","reported_seq":168,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:49.192718+0000","last_change":"2024-09-12T01:38:49.192613+0000","last_active":"2024-09-12T01:38:49.192718+0000","last_peered":"2024-09-12T01:38:49.192718+0000","last_clean":"2024-09-12T01:38:49.192718+0000","last_became_active":"2024-09-12T00:42:36.818852+0000","last_became_peered":"2024-09-12T00:42:36.818852+0000","last_unstale":"2024-09-12T01:38:49.192718+0000","last_undegraded":"2024-09-12T01:38:49.192718+0000","last_fullsized":"2024-09-12T01:38:49.192718+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'36","last_scrub_stamp":"2024-09-12T01:38:49.192495+0000","last_deep_scrub":"263'36","last_deep_scrub_stamp":"2024-09-12T01:38:49.192495+0000","last_clean_scrub_stamp":"2024-09-12T01:38:49.192495+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:14:48.285323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":132,"num_write":65,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:56.382813+0000","last_change":"2024-09-12T01:38:56.382813+0000","last_active":"2024-09-12T01:38:56.382813+0000","last_peered":"2024-09-12T01:38:56.382813+0000","last_clean":"2024-09-12T01:38:56.382813+0000","last_became_active":"2024-09-12T01:04:15.393651+0000","last_became_peered":"2024-09-12T01:04:15.393651+0000","last_unstale":"2024-09-12T01:38:56.382813+0000","last_undegraded":"2024-09-12T01:38:56.382813+0000","last_fullsized":"2024-09-12T01:38:56.382813+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:56.382713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:56.382713+0000","last_clean_scrub_stamp":"2024-09-12T01:38:56.382713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:07.966885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"263'5","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:39:00.322387+0000","last_change":"2024-09-12T01:39:00.322387+0000","last_active":"2024-09-12T01:39:00.322387+0000","last_peered":"2024-09-12T01:39:00.322387+0000","last_clean":"2024-09-12T01:39:00.322387+0000","last_became_active":"2024-09-12T00:46:26.563277+0000","last_became_peered":"2024-09-12T00:46:26.563277+0000","last_unstale":"2024-09-12T01:39:00.322387+0000","last_undegraded":"2024-09-12T01:39:00.322387+0000","last_fullsized":"2024-09-12T01:39:00.322387+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-12T01:39:00.322297+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-12T01:39:00.322297+0000","last_clean_scrub_stamp":"2024-09-12T01:39:00.322297+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:04.054229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":7168,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:30.647210+0000","last_change":"2024-09-12T01:38:30.647133+0000","last_active":"2024-09-12T01:38:30.647210+0000","last_peered":"2024-09-12T01:38:30.647210+0000","last_clean":"2024-09-12T01:38:30.647210+0000","last_became_active":"2024-09-12T00:46:22.351162+0000","last_became_peered":"2024-09-12T00:46:22.351162+0000","last_unstale":"2024-09-12T01:38:30.647210+0000","last_undegraded":"2024-09-12T01:38:30.647210+0000","last_fullsized":"2024-09-12T01:38:30.647210+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:30.647028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:30.647028+0000","last_clean_scrub_stamp":"2024-09-12T01:38:30.647028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:30.990037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"263'20","reported_seq":122,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:34.086627+0000","last_change":"2024-09-12T01:38:34.086569+0000","last_active":"2024-09-12T01:38:34.086627+0000","last_peered":"2024-09-12T01:38:34.086627+0000","last_clean":"2024-09-12T01:38:34.086627+0000","last_became_active":"2024-09-12T00:42:36.814845+0000","last_became_peered":"2024-09-12T00:42:36.814845+0000","last_unstale":"2024-09-12T01:38:34.086627+0000","last_undegraded":"2024-09-12T01:38:34.086627+0000","last_fullsized":"2024-09-12T01:38:34.086627+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'20","last_scrub_stamp":"2024-09-12T01:38:34.086443+0000","last_deep_scrub":"263'20","last_deep_scrub_stamp":"2024-09-12T01:38:34.086443+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.086443+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:31.852383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":75,"num_write":35,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:46.776551+0000","last_change":"2024-09-12T01:38:46.776551+0000","last_active":"2024-09-12T01:38:46.776551+0000","last_peered":"2024-09-12T01:38:46.776551+0000","last_clean":"2024-09-12T01:38:46.776551+0000","last_became_active":"2024-09-12T01:04:15.388423+0000","last_became_peered":"2024-09-12T01:04:15.388423+0000","last_unstale":"2024-09-12T01:38:46.776551+0000","last_undegraded":"2024-09-12T01:38:46.776551+0000","last_fullsized":"2024-09-12T01:38:46.776551+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:46.776463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:46.776463+0000","last_clean_scrub_stamp":"2024-09-12T01:38:46.776463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:57.000283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:55.609727+0000","last_change":"2024-09-12T01:38:55.609727+0000","last_active":"2024-09-12T01:38:55.609727+0000","last_peered":"2024-09-12T01:38:55.609727+0000","last_clean":"2024-09-12T01:38:55.609727+0000","last_became_active":"2024-09-12T00:46:26.564771+0000","last_became_peered":"2024-09-12T00:46:26.564771+0000","last_unstale":"2024-09-12T01:38:55.609727+0000","last_undegraded":"2024-09-12T01:38:55.609727+0000","last_fullsized":"2024-09-12T01:38:55.609727+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:55.609647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:55.609647+0000","last_clean_scrub_stamp":"2024-09-12T01:38:55.609647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:58.679599+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"260'3","reported_seq":67,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:50.462406+0000","last_change":"2024-09-12T01:38:50.462406+0000","last_active":"2024-09-12T01:38:50.462406+0000","last_peered":"2024-09-12T01:38:50.462406+0000","last_clean":"2024-09-12T01:38:50.462406+0000","last_became_active":"2024-09-12T00:46:22.350045+0000","last_became_peered":"2024-09-12T00:46:22.350045+0000","last_unstale":"2024-09-12T01:38:50.462406+0000","last_undegraded":"2024-09-12T01:38:50.462406+0000","last_fullsized":"2024-09-12T01:38:50.462406+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-12T01:38:50.462279+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-12T01:38:50.462279+0000","last_clean_scrub_stamp":"2024-09-12T01:38:50.462279+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:58.464172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"263'41","reported_seq":178,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:45.623357+0000","last_change":"2024-09-12T01:38:45.623306+0000","last_active":"2024-09-12T01:38:45.623357+0000","last_peered":"2024-09-12T01:38:45.623357+0000","last_clean":"2024-09-12T01:38:45.623357+0000","last_became_active":"2024-09-12T00:42:36.814228+0000","last_became_peered":"2024-09-12T00:42:36.814228+0000","last_unstale":"2024-09-12T01:38:45.623357+0000","last_undegraded":"2024-09-12T01:38:45.623357+0000","last_fullsized":"2024-09-12T01:38:45.623357+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'41","last_scrub_stamp":"2024-09-12T01:38:45.623214+0000","last_deep_scrub":"263'41","last_deep_scrub_stamp":"2024-09-12T01:38:45.623214+0000","last_clean_scrub_stamp":"2024-09-12T01:38:45.623214+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:02.595104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":139,"num_write":79,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:55.641043+0000","last_change":"2024-09-12T01:38:55.641043+0000","last_active":"2024-09-12T01:38:55.641043+0000","last_peered":"2024-09-12T01:38:55.641043+0000","last_clean":"2024-09-12T01:38:55.641043+0000","last_became_active":"2024-09-12T01:04:15.388492+0000","last_became_peered":"2024-09-12T01:04:15.388492+0000","last_unstale":"2024-09-12T01:38:55.641043+0000","last_undegraded":"2024-09-12T01:38:55.641043+0000","last_fullsized":"2024-09-12T01:38:55.641043+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:55.640914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:55.640914+0000","last_clean_scrub_stamp":"2024-09-12T01:38:55.640914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:36.265726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:50.494741+0000","last_change":"2024-09-12T01:38:50.494741+0000","last_active":"2024-09-12T01:38:50.494741+0000","last_peered":"2024-09-12T01:38:50.494741+0000","last_clean":"2024-09-12T01:38:50.494741+0000","last_became_active":"2024-09-12T00:46:26.369004+0000","last_became_peered":"2024-09-12T00:46:26.369004+0000","last_unstale":"2024-09-12T01:38:50.494741+0000","last_undegraded":"2024-09-12T01:38:50.494741+0000","last_fullsized":"2024-09-12T01:38:50.494741+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:50.494651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:50.494651+0000","last_clean_scrub_stamp":"2024-09-12T01:38:50.494651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:21.767757+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:53.668471+0000","last_change":"2024-09-12T01:38:53.668471+0000","last_active":"2024-09-12T01:38:53.668471+0000","last_peered":"2024-09-12T01:38:53.668471+0000","last_clean":"2024-09-12T01:38:53.668471+0000","last_became_active":"2024-09-12T00:46:22.353747+0000","last_became_peered":"2024-09-12T00:46:22.353747+0000","last_unstale":"2024-09-12T01:38:53.668471+0000","last_undegraded":"2024-09-12T01:38:53.668471+0000","last_fullsized":"2024-09-12T01:38:53.668471+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:53.668389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:53.668389+0000","last_clean_scrub_stamp":"2024-09-12T01:38:53.668389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:16.557449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"263'8","reported_seq":89,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.810774+0000","last_change":"2024-09-12T01:38:38.810686+0000","last_active":"2024-09-12T01:38:38.810774+0000","last_peered":"2024-09-12T01:38:38.810774+0000","last_clean":"2024-09-12T01:38:38.810774+0000","last_became_active":"2024-09-12T00:42:36.808945+0000","last_became_peered":"2024-09-12T00:42:36.808945+0000","last_unstale":"2024-09-12T01:38:38.810774+0000","last_undegraded":"2024-09-12T01:38:38.810774+0000","last_fullsized":"2024-09-12T01:38:38.810774+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-09-12T01:38:38.810584+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-09-12T01:38:38.810584+0000","last_clean_scrub_stamp":"2024-09-12T01:38:38.810584+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:00.252953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":23,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"263'2","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:34.710425+0000","last_change":"2024-09-12T01:38:34.710350+0000","last_active":"2024-09-12T01:38:34.710425+0000","last_peered":"2024-09-12T01:38:34.710425+0000","last_clean":"2024-09-12T01:38:34.710425+0000","last_became_active":"2024-09-12T01:04:15.395223+0000","last_became_peered":"2024-09-12T01:04:15.395223+0000","last_unstale":"2024-09-12T01:38:34.710425+0000","last_undegraded":"2024-09-12T01:38:34.710425+0000","last_fullsized":"2024-09-12T01:38:34.710425+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:38:34.710261+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:38:34.710261+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.710261+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:41.338981+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"260'2","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:41.788668+0000","last_change":"2024-09-12T01:38:41.788668+0000","last_active":"2024-09-12T01:38:41.788668+0000","last_peered":"2024-09-12T01:38:41.788668+0000","last_clean":"2024-09-12T01:38:41.788668+0000","last_became_active":"2024-09-12T00:46:26.367039+0000","last_became_peered":"2024-09-12T00:46:26.367039+0000","last_unstale":"2024-09-12T01:38:41.788668+0000","last_undegraded":"2024-09-12T01:38:41.788668+0000","last_fullsized":"2024-09-12T01:38:41.788668+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-12T01:38:41.788567+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-12T01:38:41.788567+0000","last_clean_scrub_stamp":"2024-09-12T01:38:41.788567+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:57.210450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"263'2","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:49.653221+0000","last_change":"2024-09-12T01:38:49.653221+0000","last_active":"2024-09-12T01:38:49.653221+0000","last_peered":"2024-09-12T01:38:49.653221+0000","last_clean":"2024-09-12T01:38:49.653221+0000","last_became_active":"2024-09-12T00:46:22.349779+0000","last_became_peered":"2024-09-12T00:46:22.349779+0000","last_unstale":"2024-09-12T01:38:49.653221+0000","last_undegraded":"2024-09-12T01:38:49.653221+0000","last_fullsized":"2024-09-12T01:38:49.653221+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:38:49.653134+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:38:49.653134+0000","last_clean_scrub_stamp":"2024-09-12T01:38:49.653134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:23.331145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":5,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"263'23","reported_seq":132,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:48.473843+0000","last_change":"2024-09-12T01:38:48.473777+0000","last_active":"2024-09-12T01:38:48.473843+0000","last_peered":"2024-09-12T01:38:48.473843+0000","last_clean":"2024-09-12T01:38:48.473843+0000","last_became_active":"2024-09-12T00:42:36.810979+0000","last_became_peered":"2024-09-12T00:42:36.810979+0000","last_unstale":"2024-09-12T01:38:48.473843+0000","last_undegraded":"2024-09-12T01:38:48.473843+0000","last_fullsized":"2024-09-12T01:38:48.473843+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'23","last_scrub_stamp":"2024-09-12T01:38:48.473674+0000","last_deep_scrub":"263'23","last_deep_scrub_stamp":"2024-09-12T01:38:48.473674+0000","last_clean_scrub_stamp":"2024-09-12T01:38:48.473674+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:30.010579+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":82,"num_write":51,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:39:04.241210+0000","last_change":"2024-09-12T01:39:04.241210+0000","last_active":"2024-09-12T01:39:04.241210+0000","last_peered":"2024-09-12T01:39:04.241210+0000","last_clean":"2024-09-12T01:39:04.241210+0000","last_became_active":"2024-09-12T01:04:15.388331+0000","last_became_peered":"2024-09-12T01:04:15.388331+0000","last_unstale":"2024-09-12T01:39:04.241210+0000","last_undegraded":"2024-09-12T01:39:04.241210+0000","last_fullsized":"2024-09-12T01:39:04.241210+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:04.241108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:04.241108+0000","last_clean_scrub_stamp":"2024-09-12T01:39:04.241108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:02.411223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"260'5","reported_seq":72,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:52.429396+0000","last_change":"2024-09-12T01:38:52.429396+0000","last_active":"2024-09-12T01:38:52.429396+0000","last_peered":"2024-09-12T01:38:52.429396+0000","last_clean":"2024-09-12T01:38:52.429396+0000","last_became_active":"2024-09-12T00:46:26.370448+0000","last_became_peered":"2024-09-12T00:46:26.370448+0000","last_unstale":"2024-09-12T01:38:52.429396+0000","last_undegraded":"2024-09-12T01:38:52.429396+0000","last_fullsized":"2024-09-12T01:38:52.429396+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-12T01:38:52.429306+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-12T01:38:52.429306+0000","last_clean_scrub_stamp":"2024-09-12T01:38:52.429306+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:46.417078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"263'2","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:50.694715+0000","last_change":"2024-09-12T01:38:50.694715+0000","last_active":"2024-09-12T01:38:50.694715+0000","last_peered":"2024-09-12T01:38:50.694715+0000","last_clean":"2024-09-12T01:38:50.694715+0000","last_became_active":"2024-09-12T00:46:22.353796+0000","last_became_peered":"2024-09-12T00:46:22.353796+0000","last_unstale":"2024-09-12T01:38:50.694715+0000","last_undegraded":"2024-09-12T01:38:50.694715+0000","last_fullsized":"2024-09-12T01:38:50.694715+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:38:50.694626+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:38:50.694626+0000","last_clean_scrub_stamp":"2024-09-12T01:38:50.694626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:23.591167+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"263'41","reported_seq":183,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:43.525201+0000","last_change":"2024-09-12T01:38:43.525109+0000","last_active":"2024-09-12T01:38:43.525201+0000","last_peered":"2024-09-12T01:38:43.525201+0000","last_clean":"2024-09-12T01:38:43.525201+0000","last_became_active":"2024-09-12T00:42:36.814700+0000","last_became_peered":"2024-09-12T00:42:36.814700+0000","last_unstale":"2024-09-12T01:38:43.525201+0000","last_undegraded":"2024-09-12T01:38:43.525201+0000","last_fullsized":"2024-09-12T01:38:43.525201+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'41","last_scrub_stamp":"2024-09-12T01:38:43.524993+0000","last_deep_scrub":"263'41","last_deep_scrub_stamp":"2024-09-12T01:38:43.524993+0000","last_clean_scrub_stamp":"2024-09-12T01:38:43.524993+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:49.722364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":150,"num_write":75,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:39:03.222292+0000","last_change":"2024-09-12T01:39:03.222292+0000","last_active":"2024-09-12T01:39:03.222292+0000","last_peered":"2024-09-12T01:39:03.222292+0000","last_clean":"2024-09-12T01:39:03.222292+0000","last_became_active":"2024-09-12T01:04:15.392129+0000","last_became_peered":"2024-09-12T01:04:15.392129+0000","last_unstale":"2024-09-12T01:39:03.222292+0000","last_undegraded":"2024-09-12T01:39:03.222292+0000","last_fullsized":"2024-09-12T01:39:03.222292+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:03.222200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:03.222200+0000","last_clean_scrub_stamp":"2024-09-12T01:39:03.222200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:51.728706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:42.911406+0000","last_change":"2024-09-12T01:38:42.911406+0000","last_active":"2024-09-12T01:38:42.911406+0000","last_peered":"2024-09-12T01:38:42.911406+0000","last_clean":"2024-09-12T01:38:42.911406+0000","last_became_active":"2024-09-12T00:46:26.374630+0000","last_became_peered":"2024-09-12T00:46:26.374630+0000","last_unstale":"2024-09-12T01:38:42.911406+0000","last_undegraded":"2024-09-12T01:38:42.911406+0000","last_fullsized":"2024-09-12T01:38:42.911406+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:42.911317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:42.911317+0000","last_clean_scrub_stamp":"2024-09-12T01:38:42.911317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:58.726469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.857392+0000","last_change":"2024-09-12T01:38:37.857392+0000","last_active":"2024-09-12T01:38:37.857392+0000","last_peered":"2024-09-12T01:38:37.857392+0000","last_clean":"2024-09-12T01:38:37.857392+0000","last_became_active":"2024-09-12T00:46:22.345455+0000","last_became_peered":"2024-09-12T00:46:22.345455+0000","last_unstale":"2024-09-12T01:38:37.857392+0000","last_undegraded":"2024-09-12T01:38:37.857392+0000","last_fullsized":"2024-09-12T01:38:37.857392+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:37.857311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:37.857311+0000","last_clean_scrub_stamp":"2024-09-12T01:38:37.857311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:52.326364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"263'47","reported_seq":194,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:32.141163+0000","last_change":"2024-09-12T01:38:32.141105+0000","last_active":"2024-09-12T01:38:32.141163+0000","last_peered":"2024-09-12T01:38:32.141163+0000","last_clean":"2024-09-12T01:38:32.141163+0000","last_became_active":"2024-09-12T00:42:36.810179+0000","last_became_peered":"2024-09-12T00:42:36.810179+0000","last_unstale":"2024-09-12T01:38:32.141163+0000","last_undegraded":"2024-09-12T01:38:32.141163+0000","last_fullsized":"2024-09-12T01:38:32.141163+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'47","last_scrub_stamp":"2024-09-12T01:38:32.141020+0000","last_deep_scrub":"263'47","last_deep_scrub_stamp":"2024-09-12T01:38:32.141020+0000","last_clean_scrub_stamp":"2024-09-12T01:38:32.141020+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:59.367091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":235,"num_read_kb":167,"num_write":78,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:59.663933+0000","last_change":"2024-09-12T01:38:59.663933+0000","last_active":"2024-09-12T01:38:59.663933+0000","last_peered":"2024-09-12T01:38:59.663933+0000","last_clean":"2024-09-12T01:38:59.663933+0000","last_became_active":"2024-09-12T01:04:15.393424+0000","last_became_peered":"2024-09-12T01:04:15.393424+0000","last_unstale":"2024-09-12T01:38:59.663933+0000","last_undegraded":"2024-09-12T01:38:59.663933+0000","last_fullsized":"2024-09-12T01:38:59.663933+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:59.663826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:59.663826+0000","last_clean_scrub_stamp":"2024-09-12T01:38:59.663826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:35:07.978038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"260'6","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:51.544350+0000","last_change":"2024-09-12T01:38:51.544350+0000","last_active":"2024-09-12T01:38:51.544350+0000","last_peered":"2024-09-12T01:38:51.544350+0000","last_clean":"2024-09-12T01:38:51.544350+0000","last_became_active":"2024-09-12T00:46:26.372169+0000","last_became_peered":"2024-09-12T00:46:26.372169+0000","last_unstale":"2024-09-12T01:38:51.544350+0000","last_undegraded":"2024-09-12T01:38:51.544350+0000","last_fullsized":"2024-09-12T01:38:51.544350+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-09-12T01:38:51.544260+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-09-12T01:38:51.544260+0000","last_clean_scrub_stamp":"2024-09-12T01:38:51.544260+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:19.122882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"263'5","reported_seq":70,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:39.986423+0000","last_change":"2024-09-12T01:38:39.986423+0000","last_active":"2024-09-12T01:38:39.986423+0000","last_peered":"2024-09-12T01:38:39.986423+0000","last_clean":"2024-09-12T01:38:39.986423+0000","last_became_active":"2024-09-12T00:46:22.350210+0000","last_became_peered":"2024-09-12T00:46:22.350210+0000","last_unstale":"2024-09-12T01:38:39.986423+0000","last_undegraded":"2024-09-12T01:38:39.986423+0000","last_fullsized":"2024-09-12T01:38:39.986423+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-12T01:38:39.986327+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-12T01:38:39.986327+0000","last_clean_scrub_stamp":"2024-09-12T01:38:39.986327+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:49.996979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4096,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"260'15","reported_seq":111,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:44.655392+0000","last_change":"2024-09-12T01:38:44.655323+0000","last_active":"2024-09-12T01:38:44.655392+0000","last_peered":"2024-09-12T01:38:44.655392+0000","last_clean":"2024-09-12T01:38:44.655392+0000","last_became_active":"2024-09-12T00:42:36.810110+0000","last_became_peered":"2024-09-12T00:42:36.810110+0000","last_unstale":"2024-09-12T01:38:44.655392+0000","last_undegraded":"2024-09-12T01:38:44.655392+0000","last_fullsized":"2024-09-12T01:38:44.655392+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'15","last_scrub_stamp":"2024-09-12T01:38:44.655235+0000","last_deep_scrub":"260'15","last_deep_scrub_stamp":"2024-09-12T01:38:44.655235+0000","last_clean_scrub_stamp":"2024-09-12T01:38:44.655235+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:33.265203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":54,"num_write":27,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"263'304","reported_seq":922,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:24.416682+0000","last_change":"2024-09-12T01:38:24.416620+0000","last_active":"2024-09-12T01:38:24.416682+0000","last_peered":"2024-09-12T01:38:24.416682+0000","last_clean":"2024-09-12T01:38:24.416682+0000","last_became_active":"2024-09-12T00:28:31.201886+0000","last_became_peered":"2024-09-12T00:28:31.201886+0000","last_unstale":"2024-09-12T01:38:24.416682+0000","last_undegraded":"2024-09-12T01:38:24.416682+0000","last_fullsized":"2024-09-12T01:38:24.416682+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'304","last_scrub_stamp":"2024-09-12T01:38:24.416516+0000","last_deep_scrub":"263'304","last_deep_scrub_stamp":"2024-09-12T01:38:24.416516+0000","last_clean_scrub_stamp":"2024-09-12T01:38:24.416516+0000","objects_scrubbed":5,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:25.833677+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":380,"num_read_kb":9626,"num_write":915,"num_write_kb":19266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"263'157","reported_seq":731,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:29.446136+0000","last_change":"2024-09-12T01:38:29.446082+0000","last_active":"2024-09-12T01:38:29.446136+0000","last_peered":"2024-09-12T01:38:29.446136+0000","last_clean":"2024-09-12T01:38:29.446136+0000","last_became_active":"2024-09-12T00:28:33.211182+0000","last_became_peered":"2024-09-12T00:28:33.211182+0000","last_unstale":"2024-09-12T01:38:29.446136+0000","last_undegraded":"2024-09-12T01:38:29.446136+0000","last_fullsized":"2024-09-12T01:38:29.446136+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'157","last_scrub_stamp":"2024-09-12T01:38:29.445999+0000","last_deep_scrub":"263'157","last_deep_scrub_stamp":"2024-09-12T01:38:29.445999+0000","last_clean_scrub_stamp":"2024-09-12T01:38:29.445999+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:21.049018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":685,"num_read_kb":553,"num_write":251,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"263'303","reported_seq":1022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.170728+0000","last_change":"2024-09-12T01:38:13.170633+0000","last_active":"2024-09-12T01:38:13.170728+0000","last_peered":"2024-09-12T01:38:13.170728+0000","last_clean":"2024-09-12T01:38:13.170728+0000","last_became_active":"2024-09-12T00:28:31.204561+0000","last_became_peered":"2024-09-12T00:28:31.204561+0000","last_unstale":"2024-09-12T01:38:13.170728+0000","last_undegraded":"2024-09-12T01:38:13.170728+0000","last_fullsized":"2024-09-12T01:38:13.170728+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'303","last_scrub_stamp":"2024-09-12T01:38:13.170492+0000","last_deep_scrub":"263'303","last_deep_scrub_stamp":"2024-09-12T01:38:13.170492+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.170492+0000","objects_scrubbed":7,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:13.390983+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243127,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":598,"num_read_kb":14276,"num_write":1032,"num_write_kb":31679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"263'59","reported_seq":628,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:26.393590+0000","last_change":"2024-09-12T01:38:26.393537+0000","last_active":"2024-09-12T01:38:26.393590+0000","last_peered":"2024-09-12T01:38:26.393590+0000","last_clean":"2024-09-12T01:38:26.393590+0000","last_became_active":"2024-09-12T00:28:33.217028+0000","last_became_peered":"2024-09-12T00:28:33.217028+0000","last_unstale":"2024-09-12T01:38:26.393590+0000","last_undegraded":"2024-09-12T01:38:26.393590+0000","last_fullsized":"2024-09-12T01:38:26.393590+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'59","last_scrub_stamp":"2024-09-12T01:38:26.393448+0000","last_deep_scrub":"263'59","last_deep_scrub_stamp":"2024-09-12T01:38:26.393448+0000","last_clean_scrub_stamp":"2024-09-12T01:38:26.393448+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:46.060664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":252,"num_read_kb":216,"num_write":87,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"263'337","reported_seq":1205,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.036933+0000","last_change":"2024-09-12T01:38:14.036839+0000","last_active":"2024-09-12T01:38:14.036933+0000","last_peered":"2024-09-12T01:38:14.036933+0000","last_clean":"2024-09-12T01:38:14.036933+0000","last_became_active":"2024-09-12T00:28:31.203351+0000","last_became_peered":"2024-09-12T00:28:31.203351+0000","last_unstale":"2024-09-12T01:38:14.036933+0000","last_undegraded":"2024-09-12T01:38:14.036933+0000","last_fullsized":"2024-09-12T01:38:14.036933+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'337","last_scrub_stamp":"2024-09-12T01:38:14.036713+0000","last_deep_scrub":"263'337","last_deep_scrub_stamp":"2024-09-12T01:38:14.036713+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.036713+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:13.619013+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306757,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":934,"num_read_kb":42793,"num_write":1132,"num_write_kb":18824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"263'429","reported_seq":1182,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:25.554886+0000","last_change":"2024-09-12T01:38:25.554814+0000","last_active":"2024-09-12T01:38:25.554886+0000","last_peered":"2024-09-12T01:38:25.554886+0000","last_clean":"2024-09-12T01:38:25.554886+0000","last_became_active":"2024-09-12T00:28:33.217215+0000","last_became_peered":"2024-09-12T00:28:33.217215+0000","last_unstale":"2024-09-12T01:38:25.554886+0000","last_undegraded":"2024-09-12T01:38:25.554886+0000","last_fullsized":"2024-09-12T01:38:25.554886+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'429","last_scrub_stamp":"2024-09-12T01:38:25.554727+0000","last_deep_scrub":"263'429","last_deep_scrub_stamp":"2024-09-12T01:38:25.554727+0000","last_clean_scrub_stamp":"2024-09-12T01:38:25.554727+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":400,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:43.252309+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2092,"num_read_kb":1758,"num_write":778,"num_write_kb":522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"263'382","reported_seq":1083,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.354051+0000","last_change":"2024-09-12T01:38:21.353995+0000","last_active":"2024-09-12T01:38:21.354051+0000","last_peered":"2024-09-12T01:38:21.354051+0000","last_clean":"2024-09-12T01:38:21.354051+0000","last_became_active":"2024-09-12T00:28:31.213595+0000","last_became_peered":"2024-09-12T00:28:31.213595+0000","last_unstale":"2024-09-12T01:38:21.354051+0000","last_undegraded":"2024-09-12T01:38:21.354051+0000","last_fullsized":"2024-09-12T01:38:21.354051+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'382","last_scrub_stamp":"2024-09-12T01:38:21.353886+0000","last_deep_scrub":"263'382","last_deep_scrub_stamp":"2024-09-12T01:38:21.353886+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.353886+0000","objects_scrubbed":6,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:32.927736+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1440418,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":629,"num_read_kb":11143,"num_write":1163,"num_write_kb":15238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"263'289","reported_seq":930,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:27.130848+0000","last_change":"2024-09-12T01:38:27.130737+0000","last_active":"2024-09-12T01:38:27.130848+0000","last_peered":"2024-09-12T01:38:27.130848+0000","last_clean":"2024-09-12T01:38:27.130848+0000","last_became_active":"2024-09-12T00:28:33.218393+0000","last_became_peered":"2024-09-12T00:28:33.218393+0000","last_unstale":"2024-09-12T01:38:27.130848+0000","last_undegraded":"2024-09-12T01:38:27.130848+0000","last_fullsized":"2024-09-12T01:38:27.130848+0000","mapping_epoch":27,"log_start":"260'200","ondisk_log_start":"260'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'289","last_scrub_stamp":"2024-09-12T01:38:27.130625+0000","last_deep_scrub":"263'289","last_deep_scrub_stamp":"2024-09-12T01:38:27.130625+0000","last_clean_scrub_stamp":"2024-09-12T01:38:27.130625+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:26.395209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1288,"num_read_kb":1088,"num_write":481,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"263'321","reported_seq":924,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.314203+0000","last_change":"2024-09-12T01:38:21.314117+0000","last_active":"2024-09-12T01:38:21.314203+0000","last_peered":"2024-09-12T01:38:21.314203+0000","last_clean":"2024-09-12T01:38:21.314203+0000","last_became_active":"2024-09-12T00:28:31.204962+0000","last_became_peered":"2024-09-12T00:28:31.204962+0000","last_unstale":"2024-09-12T01:38:21.314203+0000","last_undegraded":"2024-09-12T01:38:21.314203+0000","last_fullsized":"2024-09-12T01:38:21.314203+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'321","last_scrub_stamp":"2024-09-12T01:38:21.314001+0000","last_deep_scrub":"263'321","last_deep_scrub_stamp":"2024-09-12T01:38:21.314001+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.314001+0000","objects_scrubbed":5,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:15.820622+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170194,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":404,"num_read_kb":1209,"num_write":989,"num_write_kb":17836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"263'4176","reported_seq":4805,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.172749+0000","last_change":"2024-09-12T01:38:22.172692+0000","last_active":"2024-09-12T01:38:22.172749+0000","last_peered":"2024-09-12T01:38:22.172749+0000","last_clean":"2024-09-12T01:38:22.172749+0000","last_became_active":"2024-09-12T00:28:33.214515+0000","last_became_peered":"2024-09-12T00:28:33.214515+0000","last_unstale":"2024-09-12T01:38:22.172749+0000","last_undegraded":"2024-09-12T01:38:22.172749+0000","last_fullsized":"2024-09-12T01:38:22.172749+0000","mapping_epoch":27,"log_start":"263'4100","ondisk_log_start":"263'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4176","last_scrub_stamp":"2024-09-12T01:38:22.172610+0000","last_deep_scrub":"263'4176","last_deep_scrub_stamp":"2024-09-12T01:38:22.172610+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.172610+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":3000,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:13.652374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16813,"num_read_kb":14096,"num_write":6273,"num_write_kb":3125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"263'405","reported_seq":1061,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:23.354662+0000","last_change":"2024-09-12T01:38:23.354602+0000","last_active":"2024-09-12T01:38:23.354662+0000","last_peered":"2024-09-12T01:38:23.354662+0000","last_clean":"2024-09-12T01:38:23.354662+0000","last_became_active":"2024-09-12T00:28:31.212573+0000","last_became_peered":"2024-09-12T00:28:31.212573+0000","last_unstale":"2024-09-12T01:38:23.354662+0000","last_undegraded":"2024-09-12T01:38:23.354662+0000","last_fullsized":"2024-09-12T01:38:23.354662+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'405","last_scrub_stamp":"2024-09-12T01:38:23.354510+0000","last_deep_scrub":"263'405","last_deep_scrub_stamp":"2024-09-12T01:38:23.354510+0000","last_clean_scrub_stamp":"2024-09-12T01:38:23.354510+0000","objects_scrubbed":7,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:30.422460+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568635,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":601,"num_read_kb":12450,"num_write":1255,"num_write_kb":24719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"263'260","reported_seq":979,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:27.532822+0000","last_change":"2024-09-12T01:38:27.532758+0000","last_active":"2024-09-12T01:38:27.532822+0000","last_peered":"2024-09-12T01:38:27.532822+0000","last_clean":"2024-09-12T01:38:27.532822+0000","last_became_active":"2024-09-12T00:28:33.213014+0000","last_became_peered":"2024-09-12T00:28:33.213014+0000","last_unstale":"2024-09-12T01:38:27.532822+0000","last_undegraded":"2024-09-12T01:38:27.532822+0000","last_fullsized":"2024-09-12T01:38:27.532822+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'260","last_scrub_stamp":"2024-09-12T01:38:27.532674+0000","last_deep_scrub":"263'260","last_deep_scrub_stamp":"2024-09-12T01:38:27.532674+0000","last_clean_scrub_stamp":"2024-09-12T01:38:27.532674+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:43.720342+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1431,"num_read_kb":1278,"num_write":426,"num_write_kb":225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"263'323","reported_seq":967,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.283757+0000","last_change":"2024-09-12T01:38:20.283699+0000","last_active":"2024-09-12T01:38:20.283757+0000","last_peered":"2024-09-12T01:38:20.283757+0000","last_clean":"2024-09-12T01:38:20.283757+0000","last_became_active":"2024-09-12T00:28:31.210039+0000","last_became_peered":"2024-09-12T00:28:31.210039+0000","last_unstale":"2024-09-12T01:38:20.283757+0000","last_undegraded":"2024-09-12T01:38:20.283757+0000","last_fullsized":"2024-09-12T01:38:20.283757+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'323","last_scrub_stamp":"2024-09-12T01:38:20.283603+0000","last_deep_scrub":"263'323","last_deep_scrub_stamp":"2024-09-12T01:38:20.283603+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.283603+0000","objects_scrubbed":5,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:00.352419+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262189,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":473,"num_read_kb":7448,"num_write":1018,"num_write_kb":42696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"263'277","reported_seq":972,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:31.487480+0000","last_change":"2024-09-12T01:38:31.487376+0000","last_active":"2024-09-12T01:38:31.487480+0000","last_peered":"2024-09-12T01:38:31.487480+0000","last_clean":"2024-09-12T01:38:31.487480+0000","last_became_active":"2024-09-12T00:28:33.216856+0000","last_became_peered":"2024-09-12T00:28:33.216856+0000","last_unstale":"2024-09-12T01:38:31.487480+0000","last_undegraded":"2024-09-12T01:38:31.487480+0000","last_fullsized":"2024-09-12T01:38:31.487480+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'277","last_scrub_stamp":"2024-09-12T01:38:31.487279+0000","last_deep_scrub":"263'277","last_deep_scrub_stamp":"2024-09-12T01:38:31.487279+0000","last_clean_scrub_stamp":"2024-09-12T01:38:31.487279+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:27.388441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1252,"num_read_kb":1029,"num_write":416,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"263'323","reported_seq":943,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:25.274505+0000","last_change":"2024-09-12T01:38:25.274440+0000","last_active":"2024-09-12T01:38:25.274505+0000","last_peered":"2024-09-12T01:38:25.274505+0000","last_clean":"2024-09-12T01:38:25.274505+0000","last_became_active":"2024-09-12T00:28:31.213172+0000","last_became_peered":"2024-09-12T00:28:31.213172+0000","last_unstale":"2024-09-12T01:38:25.274505+0000","last_undegraded":"2024-09-12T01:38:25.274505+0000","last_fullsized":"2024-09-12T01:38:25.274505+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'323","last_scrub_stamp":"2024-09-12T01:38:25.274349+0000","last_deep_scrub":"263'323","last_deep_scrub_stamp":"2024-09-12T01:38:25.274349+0000","last_clean_scrub_stamp":"2024-09-12T01:38:25.274349+0000","objects_scrubbed":5,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:20.497013+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1657979,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":448,"num_read_kb":13792,"num_write":975,"num_write_kb":26598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"263'108","reported_seq":727,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.719960+0000","last_change":"2024-09-12T01:38:15.719896+0000","last_active":"2024-09-12T01:38:15.719960+0000","last_peered":"2024-09-12T01:38:15.719960+0000","last_clean":"2024-09-12T01:38:15.719960+0000","last_became_active":"2024-09-12T00:28:33.206296+0000","last_became_peered":"2024-09-12T00:28:33.206296+0000","last_unstale":"2024-09-12T01:38:15.719960+0000","last_undegraded":"2024-09-12T01:38:15.719960+0000","last_fullsized":"2024-09-12T01:38:15.719960+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'108","last_scrub_stamp":"2024-09-12T01:38:15.719809+0000","last_deep_scrub":"263'108","last_deep_scrub_stamp":"2024-09-12T01:38:15.719809+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.719809+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:07.737417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":463,"num_read_kb":402,"num_write":161,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"263'4150","reported_seq":4764,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:24.517906+0000","last_change":"2024-09-12T01:38:24.517843+0000","last_active":"2024-09-12T01:38:24.517906+0000","last_peered":"2024-09-12T01:38:24.517906+0000","last_clean":"2024-09-12T01:38:24.517906+0000","last_became_active":"2024-09-12T00:28:33.213777+0000","last_became_peered":"2024-09-12T00:28:33.213777+0000","last_unstale":"2024-09-12T01:38:24.517906+0000","last_undegraded":"2024-09-12T01:38:24.517906+0000","last_fullsized":"2024-09-12T01:38:24.517906+0000","mapping_epoch":27,"log_start":"263'4100","ondisk_log_start":"263'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4150","last_scrub_stamp":"2024-09-12T01:38:24.517726+0000","last_deep_scrub":"263'4150","last_deep_scrub_stamp":"2024-09-12T01:38:24.517726+0000","last_clean_scrub_stamp":"2024-09-12T01:38:24.517726+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":3000,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:14.431730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16687,"num_read_kb":13992,"num_write":6250,"num_write_kb":3125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"263'389","reported_seq":1025,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.696924+0000","last_change":"2024-09-12T01:38:12.696924+0000","last_active":"2024-09-12T01:38:12.696924+0000","last_peered":"2024-09-12T01:38:12.696924+0000","last_clean":"2024-09-12T01:38:12.696924+0000","last_became_active":"2024-09-12T00:29:04.274377+0000","last_became_peered":"2024-09-12T00:29:04.274377+0000","last_unstale":"2024-09-12T01:38:12.696924+0000","last_undegraded":"2024-09-12T01:38:12.696924+0000","last_fullsized":"2024-09-12T01:38:12.696924+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'389","last_scrub_stamp":"2024-09-12T01:38:12.696814+0000","last_deep_scrub":"263'389","last_deep_scrub_stamp":"2024-09-12T01:38:12.696814+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.696814+0000","objects_scrubbed":6,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:54.981263+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568865,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":569,"num_read_kb":2856,"num_write":1189,"num_write_kb":27657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"263'295","reported_seq":944,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:25.405722+0000","last_change":"2024-09-12T01:38:25.405638+0000","last_active":"2024-09-12T01:38:25.405722+0000","last_peered":"2024-09-12T01:38:25.405722+0000","last_clean":"2024-09-12T01:38:25.405722+0000","last_became_active":"2024-09-12T00:28:33.218660+0000","last_became_peered":"2024-09-12T00:28:33.218660+0000","last_unstale":"2024-09-12T01:38:25.405722+0000","last_undegraded":"2024-09-12T01:38:25.405722+0000","last_fullsized":"2024-09-12T01:38:25.405722+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'295","last_scrub_stamp":"2024-09-12T01:38:25.405555+0000","last_deep_scrub":"263'295","last_deep_scrub_stamp":"2024-09-12T01:38:25.405555+0000","last_clean_scrub_stamp":"2024-09-12T01:38:25.405555+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:09.677150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1306,"num_read_kb":1072,"num_write":479,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"263'371","reported_seq":1043,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.100624+0000","last_change":"2024-09-12T01:38:16.100566+0000","last_active":"2024-09-12T01:38:16.100624+0000","last_peered":"2024-09-12T01:38:16.100624+0000","last_clean":"2024-09-12T01:38:16.100624+0000","last_became_active":"2024-09-12T00:28:31.213388+0000","last_became_peered":"2024-09-12T00:28:31.213388+0000","last_unstale":"2024-09-12T01:38:16.100624+0000","last_undegraded":"2024-09-12T01:38:16.100624+0000","last_fullsized":"2024-09-12T01:38:16.100624+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'371","last_scrub_stamp":"2024-09-12T01:38:16.100452+0000","last_deep_scrub":"263'371","last_deep_scrub_stamp":"2024-09-12T01:38:16.100452+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.100452+0000","objects_scrubbed":7,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:47.142311+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133695,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":588,"num_read_kb":20058,"num_write":1150,"num_write_kb":40619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"263'90","reported_seq":682,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:27.422220+0000","last_change":"2024-09-12T01:38:27.422148+0000","last_active":"2024-09-12T01:38:27.422220+0000","last_peered":"2024-09-12T01:38:27.422220+0000","last_clean":"2024-09-12T01:38:27.422220+0000","last_became_active":"2024-09-12T00:28:33.213998+0000","last_became_peered":"2024-09-12T00:28:33.213998+0000","last_unstale":"2024-09-12T01:38:27.422220+0000","last_undegraded":"2024-09-12T01:38:27.422220+0000","last_fullsized":"2024-09-12T01:38:27.422220+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'90","last_scrub_stamp":"2024-09-12T01:38:27.422064+0000","last_deep_scrub":"263'90","last_deep_scrub_stamp":"2024-09-12T01:38:27.422064+0000","last_clean_scrub_stamp":"2024-09-12T01:38:27.422064+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:02.338451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":414,"num_read_kb":350,"num_write":126,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"263'353","reported_seq":1074,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.108312+0000","last_change":"2024-09-12T01:38:14.108241+0000","last_active":"2024-09-12T01:38:14.108312+0000","last_peered":"2024-09-12T01:38:14.108312+0000","last_clean":"2024-09-12T01:38:14.108312+0000","last_became_active":"2024-09-12T00:28:31.215230+0000","last_became_peered":"2024-09-12T00:28:31.215230+0000","last_unstale":"2024-09-12T01:38:14.108312+0000","last_undegraded":"2024-09-12T01:38:14.108312+0000","last_fullsized":"2024-09-12T01:38:14.108312+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'353","last_scrub_stamp":"2024-09-12T01:38:14.108148+0000","last_deep_scrub":"263'353","last_deep_scrub_stamp":"2024-09-12T01:38:14.108148+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.108148+0000","objects_scrubbed":4,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:21.237357+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254836,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":624,"num_read_kb":115792,"num_write":1091,"num_write_kb":22723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"263'230","reported_seq":861,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.728050+0000","last_change":"2024-09-12T01:38:14.727989+0000","last_active":"2024-09-12T01:38:14.728050+0000","last_peered":"2024-09-12T01:38:14.728050+0000","last_clean":"2024-09-12T01:38:14.728050+0000","last_became_active":"2024-09-12T00:28:33.206305+0000","last_became_peered":"2024-09-12T00:28:33.206305+0000","last_unstale":"2024-09-12T01:38:14.728050+0000","last_undegraded":"2024-09-12T01:38:14.728050+0000","last_fullsized":"2024-09-12T01:38:14.728050+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'230","last_scrub_stamp":"2024-09-12T01:38:14.727900+0000","last_deep_scrub":"263'230","last_deep_scrub_stamp":"2024-09-12T01:38:14.727900+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.727900+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:41.691362+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":971,"num_read_kb":790,"num_write":344,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"263'421","reported_seq":1159,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.506189+0000","last_change":"2024-09-12T01:38:10.506130+0000","last_active":"2024-09-12T01:38:10.506189+0000","last_peered":"2024-09-12T01:38:10.506189+0000","last_clean":"2024-09-12T01:38:10.506189+0000","last_became_active":"2024-09-12T00:28:31.199779+0000","last_became_peered":"2024-09-12T00:28:31.199779+0000","last_unstale":"2024-09-12T01:38:10.506189+0000","last_undegraded":"2024-09-12T01:38:10.506189+0000","last_fullsized":"2024-09-12T01:38:10.506189+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'421","last_scrub_stamp":"2024-09-12T01:38:10.506027+0000","last_deep_scrub":"263'421","last_deep_scrub_stamp":"2024-09-12T01:38:10.506027+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.506027+0000","objects_scrubbed":8,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:11.152787+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306267,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":669,"num_read_kb":69035,"num_write":1318,"num_write_kb":57878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"263'150","reported_seq":809,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:23.751685+0000","last_change":"2024-09-12T01:38:23.751611+0000","last_active":"2024-09-12T01:38:23.751685+0000","last_peered":"2024-09-12T01:38:23.751685+0000","last_clean":"2024-09-12T01:38:23.751685+0000","last_became_active":"2024-09-12T00:28:33.208831+0000","last_became_peered":"2024-09-12T00:28:33.208831+0000","last_unstale":"2024-09-12T01:38:23.751685+0000","last_undegraded":"2024-09-12T01:38:23.751685+0000","last_fullsized":"2024-09-12T01:38:23.751685+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'150","last_scrub_stamp":"2024-09-12T01:38:23.751512+0000","last_deep_scrub":"263'150","last_deep_scrub_stamp":"2024-09-12T01:38:23.751512+0000","last_clean_scrub_stamp":"2024-09-12T01:38:23.751512+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:11.911885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":710,"num_read_kb":600,"num_write":211,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"263'405","reported_seq":1060,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.205299+0000","last_change":"2024-09-12T01:38:14.205241+0000","last_active":"2024-09-12T01:38:14.205299+0000","last_peered":"2024-09-12T01:38:14.205299+0000","last_clean":"2024-09-12T01:38:14.205299+0000","last_became_active":"2024-09-12T00:28:31.202245+0000","last_became_peered":"2024-09-12T00:28:31.202245+0000","last_unstale":"2024-09-12T01:38:14.205299+0000","last_undegraded":"2024-09-12T01:38:14.205299+0000","last_fullsized":"2024-09-12T01:38:14.205299+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'405","last_scrub_stamp":"2024-09-12T01:38:14.205130+0000","last_deep_scrub":"263'405","last_deep_scrub_stamp":"2024-09-12T01:38:14.205130+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.205130+0000","objects_scrubbed":8,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:57.720032+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":558,"num_read_kb":23094,"num_write":1344,"num_write_kb":58944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"263'113","reported_seq":728,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:26.561584+0000","last_change":"2024-09-12T01:38:26.561527+0000","last_active":"2024-09-12T01:38:26.561584+0000","last_peered":"2024-09-12T01:38:26.561584+0000","last_clean":"2024-09-12T01:38:26.561584+0000","last_became_active":"2024-09-12T00:28:33.207527+0000","last_became_peered":"2024-09-12T00:28:33.207527+0000","last_unstale":"2024-09-12T01:38:26.561584+0000","last_undegraded":"2024-09-12T01:38:26.561584+0000","last_fullsized":"2024-09-12T01:38:26.561584+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'113","last_scrub_stamp":"2024-09-12T01:38:26.561433+0000","last_deep_scrub":"263'113","last_deep_scrub_stamp":"2024-09-12T01:38:26.561433+0000","last_clean_scrub_stamp":"2024-09-12T01:38:26.561433+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:15.140885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":515,"num_read_kb":438,"num_write":174,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"263'316","reported_seq":984,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.078959+0000","last_change":"2024-09-12T01:38:11.078901+0000","last_active":"2024-09-12T01:38:11.078959+0000","last_peered":"2024-09-12T01:38:11.078959+0000","last_clean":"2024-09-12T01:38:11.078959+0000","last_became_active":"2024-09-12T00:28:31.203048+0000","last_became_peered":"2024-09-12T00:28:31.203048+0000","last_unstale":"2024-09-12T01:38:11.078959+0000","last_undegraded":"2024-09-12T01:38:11.078959+0000","last_fullsized":"2024-09-12T01:38:11.078959+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'316","last_scrub_stamp":"2024-09-12T01:38:11.078811+0000","last_deep_scrub":"263'316","last_deep_scrub_stamp":"2024-09-12T01:38:11.078811+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.078811+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:13.632696+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524344,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":495,"num_read_kb":45596,"num_write":1045,"num_write_kb":35489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"263'107","reported_seq":627,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:42.551999+0000","last_change":"2024-09-12T01:38:42.551940+0000","last_active":"2024-09-12T01:38:42.551999+0000","last_peered":"2024-09-12T01:38:42.551999+0000","last_clean":"2024-09-12T01:38:42.551999+0000","last_became_active":"2024-09-12T00:28:41.226952+0000","last_became_peered":"2024-09-12T00:28:41.226952+0000","last_unstale":"2024-09-12T01:38:42.551999+0000","last_undegraded":"2024-09-12T01:38:42.551999+0000","last_fullsized":"2024-09-12T01:38:42.551999+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'107","last_scrub_stamp":"2024-09-12T01:38:42.551847+0000","last_deep_scrub":"263'107","last_deep_scrub_stamp":"2024-09-12T01:38:42.551847+0000","last_clean_scrub_stamp":"2024-09-12T01:38:42.551847+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:11.526139+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":155,"num_read_kb":144,"num_write":259,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"263'188","reported_seq":781,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.217150+0000","last_change":"2024-09-12T01:38:17.217081+0000","last_active":"2024-09-12T01:38:17.217150+0000","last_peered":"2024-09-12T01:38:17.217150+0000","last_clean":"2024-09-12T01:38:17.217150+0000","last_became_active":"2024-09-12T00:28:33.209521+0000","last_became_peered":"2024-09-12T00:28:33.209521+0000","last_unstale":"2024-09-12T01:38:17.217150+0000","last_undegraded":"2024-09-12T01:38:17.217150+0000","last_fullsized":"2024-09-12T01:38:17.217150+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'188","last_scrub_stamp":"2024-09-12T01:38:17.216936+0000","last_deep_scrub":"263'188","last_deep_scrub_stamp":"2024-09-12T01:38:17.216936+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.216936+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:48.308382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":834,"num_read_kb":672,"num_write":307,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"263'362","reported_seq":975,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.290301+0000","last_change":"2024-09-12T01:38:17.290235+0000","last_active":"2024-09-12T01:38:17.290301+0000","last_peered":"2024-09-12T01:38:17.290301+0000","last_clean":"2024-09-12T01:38:17.290301+0000","last_became_active":"2024-09-12T00:28:31.206010+0000","last_became_peered":"2024-09-12T00:28:31.206010+0000","last_unstale":"2024-09-12T01:38:17.290301+0000","last_undegraded":"2024-09-12T01:38:17.290301+0000","last_fullsized":"2024-09-12T01:38:17.290301+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'362","last_scrub_stamp":"2024-09-12T01:38:17.290125+0000","last_deep_scrub":"263'362","last_deep_scrub_stamp":"2024-09-12T01:38:17.290125+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.290125+0000","objects_scrubbed":9,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:31.994331+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":430,"num_read_kb":5592,"num_write":1103,"num_write_kb":25256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:33.423195+0000","last_change":"2024-09-12T01:38:33.423142+0000","last_active":"2024-09-12T01:38:33.423195+0000","last_peered":"2024-09-12T01:38:33.423195+0000","last_clean":"2024-09-12T01:38:33.423195+0000","last_became_active":"2024-09-12T00:28:35.211231+0000","last_became_peered":"2024-09-12T00:28:35.211231+0000","last_unstale":"2024-09-12T01:38:33.423195+0000","last_undegraded":"2024-09-12T01:38:33.423195+0000","last_fullsized":"2024-09-12T01:38:33.423195+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:33.423061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:33.423061+0000","last_clean_scrub_stamp":"2024-09-12T01:38:33.423061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:40.341124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"263'353","reported_seq":984,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:28.171439+0000","last_change":"2024-09-12T01:38:28.171380+0000","last_active":"2024-09-12T01:38:28.171439+0000","last_peered":"2024-09-12T01:38:28.171439+0000","last_clean":"2024-09-12T01:38:28.171439+0000","last_became_active":"2024-09-12T00:28:37.216169+0000","last_became_peered":"2024-09-12T00:28:37.216169+0000","last_unstale":"2024-09-12T01:38:28.171439+0000","last_undegraded":"2024-09-12T01:38:28.171439+0000","last_fullsized":"2024-09-12T01:38:28.171439+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'353","last_scrub_stamp":"2024-09-12T01:38:28.171291+0000","last_deep_scrub":"263'353","last_deep_scrub_stamp":"2024-09-12T01:38:28.171291+0000","last_clean_scrub_stamp":"2024-09-12T01:38:28.171291+0000","objects_scrubbed":6,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:51.037865+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44362,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":554,"num_read_kb":1122,"num_write":430,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:40.525916+0000","last_change":"2024-09-12T01:38:40.525854+0000","last_active":"2024-09-12T01:38:40.525916+0000","last_peered":"2024-09-12T01:38:40.525916+0000","last_clean":"2024-09-12T01:38:40.525916+0000","last_became_active":"2024-09-12T00:28:39.213942+0000","last_became_peered":"2024-09-12T00:28:39.213942+0000","last_unstale":"2024-09-12T01:38:40.525916+0000","last_undegraded":"2024-09-12T01:38:40.525916+0000","last_fullsized":"2024-09-12T01:38:40.525916+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:40.525765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:40.525765+0000","last_clean_scrub_stamp":"2024-09-12T01:38:40.525765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:08.844675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"263'184","reported_seq":744,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:46.481857+0000","last_change":"2024-09-12T01:38:46.481799+0000","last_active":"2024-09-12T01:38:46.481857+0000","last_peered":"2024-09-12T01:38:46.481857+0000","last_clean":"2024-09-12T01:38:46.481857+0000","last_became_active":"2024-09-12T00:28:41.229608+0000","last_became_peered":"2024-09-12T00:28:41.229608+0000","last_unstale":"2024-09-12T01:38:46.481857+0000","last_undegraded":"2024-09-12T01:38:46.481857+0000","last_fullsized":"2024-09-12T01:38:46.481857+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'184","last_scrub_stamp":"2024-09-12T01:38:46.481713+0000","last_deep_scrub":"263'184","last_deep_scrub_stamp":"2024-09-12T01:38:46.481713+0000","last_clean_scrub_stamp":"2024-09-12T01:38:46.481713+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:59.539341+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":231,"num_read_kb":225,"num_write":383,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"263'212","reported_seq":822,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:24.382447+0000","last_change":"2024-09-12T01:38:24.382381+0000","last_active":"2024-09-12T01:38:24.382447+0000","last_peered":"2024-09-12T01:38:24.382447+0000","last_clean":"2024-09-12T01:38:24.382447+0000","last_became_active":"2024-09-12T00:28:33.212334+0000","last_became_peered":"2024-09-12T00:28:33.212334+0000","last_unstale":"2024-09-12T01:38:24.382447+0000","last_undegraded":"2024-09-12T01:38:24.382447+0000","last_fullsized":"2024-09-12T01:38:24.382447+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'212","last_scrub_stamp":"2024-09-12T01:38:24.382297+0000","last_deep_scrub":"263'212","last_deep_scrub_stamp":"2024-09-12T01:38:24.382297+0000","last_clean_scrub_stamp":"2024-09-12T01:38:24.382297+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:06.630505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":883,"num_read_kb":721,"num_write":311,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"263'332","reported_seq":998,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:09.077293+0000","last_change":"2024-09-12T01:38:09.077241+0000","last_active":"2024-09-12T01:38:09.077293+0000","last_peered":"2024-09-12T01:38:09.077293+0000","last_clean":"2024-09-12T01:38:09.077293+0000","last_became_active":"2024-09-12T00:28:31.208141+0000","last_became_peered":"2024-09-12T00:28:31.208141+0000","last_unstale":"2024-09-12T01:38:09.077293+0000","last_undegraded":"2024-09-12T01:38:09.077293+0000","last_fullsized":"2024-09-12T01:38:09.077293+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'332","last_scrub_stamp":"2024-09-12T01:38:09.077147+0000","last_deep_scrub":"263'332","last_deep_scrub_stamp":"2024-09-12T01:38:09.077147+0000","last_clean_scrub_stamp":"2024-09-12T01:38:09.077147+0000","objects_scrubbed":8,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:39.882962+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395868,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":543,"num_read_kb":93032,"num_write":945,"num_write_kb":55506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":509,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:31.304948+0000","last_change":"2024-09-12T01:38:31.304849+0000","last_active":"2024-09-12T01:38:31.304948+0000","last_peered":"2024-09-12T01:38:31.304948+0000","last_clean":"2024-09-12T01:38:31.304948+0000","last_became_active":"2024-09-12T00:28:35.212745+0000","last_became_peered":"2024-09-12T00:28:35.212745+0000","last_unstale":"2024-09-12T01:38:31.304948+0000","last_undegraded":"2024-09-12T01:38:31.304948+0000","last_fullsized":"2024-09-12T01:38:31.304948+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:31.304746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:31.304746+0000","last_clean_scrub_stamp":"2024-09-12T01:38:31.304746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:59.053226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"263'96","reported_seq":643,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:34.520618+0000","last_change":"2024-09-12T01:38:34.520560+0000","last_active":"2024-09-12T01:38:34.520618+0000","last_peered":"2024-09-12T01:38:34.520618+0000","last_clean":"2024-09-12T01:38:34.520618+0000","last_became_active":"2024-09-12T00:28:37.220899+0000","last_became_peered":"2024-09-12T00:28:37.220899+0000","last_unstale":"2024-09-12T01:38:34.520618+0000","last_undegraded":"2024-09-12T01:38:34.520618+0000","last_fullsized":"2024-09-12T01:38:34.520618+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'96","last_scrub_stamp":"2024-09-12T01:38:34.520466+0000","last_deep_scrub":"263'96","last_deep_scrub_stamp":"2024-09-12T01:38:34.520466+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.520466+0000","objects_scrubbed":4,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:08.295444+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":118,"num_read_kb":113,"num_write":78,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.526744+0000","last_change":"2024-09-12T01:38:38.526649+0000","last_active":"2024-09-12T01:38:38.526744+0000","last_peered":"2024-09-12T01:38:38.526744+0000","last_clean":"2024-09-12T01:38:38.526744+0000","last_became_active":"2024-09-12T00:28:39.222553+0000","last_became_peered":"2024-09-12T00:28:39.222553+0000","last_unstale":"2024-09-12T01:38:38.526744+0000","last_undegraded":"2024-09-12T01:38:38.526744+0000","last_fullsized":"2024-09-12T01:38:38.526744+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:38.526556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:38.526556+0000","last_clean_scrub_stamp":"2024-09-12T01:38:38.526556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:49.766948+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"263'130","reported_seq":644,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:44.247475+0000","last_change":"2024-09-12T01:38:44.247475+0000","last_active":"2024-09-12T01:38:44.247475+0000","last_peered":"2024-09-12T01:38:44.247475+0000","last_clean":"2024-09-12T01:38:44.247475+0000","last_became_active":"2024-09-12T00:28:41.228305+0000","last_became_peered":"2024-09-12T00:28:41.228305+0000","last_unstale":"2024-09-12T01:38:44.247475+0000","last_undegraded":"2024-09-12T01:38:44.247475+0000","last_fullsized":"2024-09-12T01:38:44.247475+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'130","last_scrub_stamp":"2024-09-12T01:38:44.247352+0000","last_deep_scrub":"263'130","last_deep_scrub_stamp":"2024-09-12T01:38:44.247352+0000","last_clean_scrub_stamp":"2024-09-12T01:38:44.247352+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:24.952391+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":144,"num_read_kb":135,"num_write":299,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"263'197","reported_seq":851,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.026792+0000","last_change":"2024-09-12T01:38:15.026708+0000","last_active":"2024-09-12T01:38:15.026792+0000","last_peered":"2024-09-12T01:38:15.026792+0000","last_clean":"2024-09-12T01:38:15.026792+0000","last_became_active":"2024-09-12T00:28:33.219082+0000","last_became_peered":"2024-09-12T00:28:33.219082+0000","last_unstale":"2024-09-12T01:38:15.026792+0000","last_undegraded":"2024-09-12T01:38:15.026792+0000","last_fullsized":"2024-09-12T01:38:15.026792+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'197","last_scrub_stamp":"2024-09-12T01:38:15.026624+0000","last_deep_scrub":"263'197","last_deep_scrub_stamp":"2024-09-12T01:38:15.026624+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.026624+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:40.437735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":923,"num_read_kb":768,"num_write":333,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"263'386","reported_seq":1022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.293546+0000","last_change":"2024-09-12T01:38:14.293459+0000","last_active":"2024-09-12T01:38:14.293546+0000","last_peered":"2024-09-12T01:38:14.293546+0000","last_clean":"2024-09-12T01:38:14.293546+0000","last_became_active":"2024-09-12T00:28:31.204223+0000","last_became_peered":"2024-09-12T00:28:31.204223+0000","last_unstale":"2024-09-12T01:38:14.293546+0000","last_undegraded":"2024-09-12T01:38:14.293546+0000","last_fullsized":"2024-09-12T01:38:14.293546+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'386","last_scrub_stamp":"2024-09-12T01:38:14.293320+0000","last_deep_scrub":"263'386","last_deep_scrub_stamp":"2024-09-12T01:38:14.293320+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.293320+0000","objects_scrubbed":10,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:55.332433+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133695,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":536,"num_read_kb":1739,"num_write":1185,"num_write_kb":22527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:30.295363+0000","last_change":"2024-09-12T01:38:30.295310+0000","last_active":"2024-09-12T01:38:30.295363+0000","last_peered":"2024-09-12T01:38:30.295363+0000","last_clean":"2024-09-12T01:38:30.295363+0000","last_became_active":"2024-09-12T00:28:35.212197+0000","last_became_peered":"2024-09-12T00:28:35.212197+0000","last_unstale":"2024-09-12T01:38:30.295363+0000","last_undegraded":"2024-09-12T01:38:30.295363+0000","last_fullsized":"2024-09-12T01:38:30.295363+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:30.295237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:30.295237+0000","last_clean_scrub_stamp":"2024-09-12T01:38:30.295237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:18.032351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"263'140","reported_seq":709,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:25.699275+0000","last_change":"2024-09-12T01:38:25.699196+0000","last_active":"2024-09-12T01:38:25.699275+0000","last_peered":"2024-09-12T01:38:25.699275+0000","last_clean":"2024-09-12T01:38:25.699275+0000","last_became_active":"2024-09-12T00:28:37.220665+0000","last_became_peered":"2024-09-12T00:28:37.220665+0000","last_unstale":"2024-09-12T01:38:25.699275+0000","last_undegraded":"2024-09-12T01:38:25.699275+0000","last_fullsized":"2024-09-12T01:38:25.699275+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'140","last_scrub_stamp":"2024-09-12T01:38:25.699105+0000","last_deep_scrub":"263'140","last_deep_scrub_stamp":"2024-09-12T01:38:25.699105+0000","last_clean_scrub_stamp":"2024-09-12T01:38:25.699105+0000","objects_scrubbed":7,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:46.861174+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":170,"num_read_kb":162,"num_write":114,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"263'769","reported_seq":4817,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:39.521315+0000","last_change":"2024-09-12T01:38:39.521249+0000","last_active":"2024-09-12T01:38:39.521315+0000","last_peered":"2024-09-12T01:38:39.521315+0000","last_clean":"2024-09-12T01:38:39.521315+0000","last_became_active":"2024-09-12T00:28:39.218476+0000","last_became_peered":"2024-09-12T00:28:39.218476+0000","last_unstale":"2024-09-12T01:38:39.521315+0000","last_undegraded":"2024-09-12T01:38:39.521315+0000","last_fullsized":"2024-09-12T01:38:39.521315+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'769","last_scrub_stamp":"2024-09-12T01:38:39.521136+0000","last_deep_scrub":"263'769","last_deep_scrub_stamp":"2024-09-12T01:38:39.521136+0000","last_clean_scrub_stamp":"2024-09-12T01:38:39.521136+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:09.943675+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"263'194","reported_seq":1026,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:45.446140+0000","last_change":"2024-09-12T01:38:45.446140+0000","last_active":"2024-09-12T01:38:45.446140+0000","last_peered":"2024-09-12T01:38:45.446140+0000","last_clean":"2024-09-12T01:38:45.446140+0000","last_became_active":"2024-09-12T00:28:41.257679+0000","last_became_peered":"2024-09-12T00:28:41.257679+0000","last_unstale":"2024-09-12T01:38:45.446140+0000","last_undegraded":"2024-09-12T01:38:45.446140+0000","last_fullsized":"2024-09-12T01:38:45.446140+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'194","last_scrub_stamp":"2024-09-12T01:38:45.446034+0000","last_deep_scrub":"263'194","last_deep_scrub_stamp":"2024-09-12T01:38:45.446034+0000","last_clean_scrub_stamp":"2024-09-12T01:38:45.446034+0000","objects_scrubbed":3,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:06.294618+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":583,"num_read_kb":580,"num_write":423,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"263'82","reported_seq":636,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.209355+0000","last_change":"2024-09-12T01:38:16.209303+0000","last_active":"2024-09-12T01:38:16.209355+0000","last_peered":"2024-09-12T01:38:16.209355+0000","last_clean":"2024-09-12T01:38:16.209355+0000","last_became_active":"2024-09-12T00:28:33.212564+0000","last_became_peered":"2024-09-12T00:28:33.212564+0000","last_unstale":"2024-09-12T01:38:16.209355+0000","last_undegraded":"2024-09-12T01:38:16.209355+0000","last_fullsized":"2024-09-12T01:38:16.209355+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'82","last_scrub_stamp":"2024-09-12T01:38:16.209203+0000","last_deep_scrub":"263'82","last_deep_scrub_stamp":"2024-09-12T01:38:16.209203+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.209203+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:28.323813+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":372,"num_read_kb":309,"num_write":130,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"263'301","reported_seq":1012,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.134517+0000","last_change":"2024-09-12T01:38:13.134452+0000","last_active":"2024-09-12T01:38:13.134517+0000","last_peered":"2024-09-12T01:38:13.134517+0000","last_clean":"2024-09-12T01:38:13.134517+0000","last_became_active":"2024-09-12T00:28:31.207938+0000","last_became_peered":"2024-09-12T00:28:31.207938+0000","last_unstale":"2024-09-12T01:38:13.134517+0000","last_undegraded":"2024-09-12T01:38:13.134517+0000","last_fullsized":"2024-09-12T01:38:13.134517+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'301","last_scrub_stamp":"2024-09-12T01:38:13.134357+0000","last_deep_scrub":"263'301","last_deep_scrub_stamp":"2024-09-12T01:38:13.134357+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.134357+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:18.383579+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174663,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":518,"num_read_kb":179847,"num_write":976,"num_write_kb":39231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:34.460167+0000","last_change":"2024-09-12T01:38:34.460106+0000","last_active":"2024-09-12T01:38:34.460167+0000","last_peered":"2024-09-12T01:38:34.460167+0000","last_clean":"2024-09-12T01:38:34.460167+0000","last_became_active":"2024-09-12T00:28:35.213178+0000","last_became_peered":"2024-09-12T00:28:35.213178+0000","last_unstale":"2024-09-12T01:38:34.460167+0000","last_undegraded":"2024-09-12T01:38:34.460167+0000","last_fullsized":"2024-09-12T01:38:34.460167+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.460009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.460009+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.460009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:42.640293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"263'263","reported_seq":850,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:34.453726+0000","last_change":"2024-09-12T01:38:34.453626+0000","last_active":"2024-09-12T01:38:34.453726+0000","last_peered":"2024-09-12T01:38:34.453726+0000","last_clean":"2024-09-12T01:38:34.453726+0000","last_became_active":"2024-09-12T00:28:37.426357+0000","last_became_peered":"2024-09-12T00:28:37.426357+0000","last_unstale":"2024-09-12T01:38:34.453726+0000","last_undegraded":"2024-09-12T01:38:34.453726+0000","last_fullsized":"2024-09-12T01:38:34.453726+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'263","last_scrub_stamp":"2024-09-12T01:38:34.453509+0000","last_deep_scrub":"263'263","last_deep_scrub_stamp":"2024-09-12T01:38:34.453509+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.453509+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:46:46.289095+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15889,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":416,"num_read_kb":929,"num_write":326,"num_write_kb":245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"263'770","reported_seq":2658,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:43.362035+0000","last_change":"2024-09-12T01:38:43.361946+0000","last_active":"2024-09-12T01:38:43.362035+0000","last_peered":"2024-09-12T01:38:43.362035+0000","last_clean":"2024-09-12T01:38:43.362035+0000","last_became_active":"2024-09-12T00:28:39.218738+0000","last_became_peered":"2024-09-12T00:28:39.218738+0000","last_unstale":"2024-09-12T01:38:43.362035+0000","last_undegraded":"2024-09-12T01:38:43.362035+0000","last_fullsized":"2024-09-12T01:38:43.362035+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'770","last_scrub_stamp":"2024-09-12T01:38:43.361835+0000","last_deep_scrub":"263'770","last_deep_scrub_stamp":"2024-09-12T01:38:43.361835+0000","last_clean_scrub_stamp":"2024-09-12T01:38:43.361835+0000","objects_scrubbed":1,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:16.392588+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"263'110","reported_seq":686,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.383696+0000","last_change":"2024-09-12T01:38:22.383696+0000","last_active":"2024-09-12T01:38:22.383696+0000","last_peered":"2024-09-12T01:38:22.383696+0000","last_clean":"2024-09-12T01:38:22.383696+0000","last_became_active":"2024-09-12T00:28:33.213074+0000","last_became_peered":"2024-09-12T00:28:33.213074+0000","last_unstale":"2024-09-12T01:38:22.383696+0000","last_undegraded":"2024-09-12T01:38:22.383696+0000","last_fullsized":"2024-09-12T01:38:22.383696+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'110","last_scrub_stamp":"2024-09-12T01:38:22.383615+0000","last_deep_scrub":"263'110","last_deep_scrub_stamp":"2024-09-12T01:38:22.383615+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.383615+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:00.918063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":473,"num_read_kb":387,"num_write":177,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"263'310","reported_seq":928,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.315211+0000","last_change":"2024-09-12T01:38:15.315153+0000","last_active":"2024-09-12T01:38:15.315211+0000","last_peered":"2024-09-12T01:38:15.315211+0000","last_clean":"2024-09-12T01:38:15.315211+0000","last_became_active":"2024-09-12T00:28:31.207567+0000","last_became_peered":"2024-09-12T00:28:31.207567+0000","last_unstale":"2024-09-12T01:38:15.315211+0000","last_undegraded":"2024-09-12T01:38:15.315211+0000","last_fullsized":"2024-09-12T01:38:15.315211+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'310","last_scrub_stamp":"2024-09-12T01:38:15.315042+0000","last_deep_scrub":"263'310","last_deep_scrub_stamp":"2024-09-12T01:38:15.315042+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.315042+0000","objects_scrubbed":6,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:05.943857+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":384,"num_read_kb":9497,"num_write":972,"num_write_kb":19827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:28.461464+0000","last_change":"2024-09-12T01:38:28.461464+0000","last_active":"2024-09-12T01:38:28.461464+0000","last_peered":"2024-09-12T01:38:28.461464+0000","last_clean":"2024-09-12T01:38:28.461464+0000","last_became_active":"2024-09-12T00:28:35.209944+0000","last_became_peered":"2024-09-12T00:28:35.209944+0000","last_unstale":"2024-09-12T01:38:28.461464+0000","last_undegraded":"2024-09-12T01:38:28.461464+0000","last_fullsized":"2024-09-12T01:38:28.461464+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:28.461368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:28.461368+0000","last_clean_scrub_stamp":"2024-09-12T01:38:28.461368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:50.694283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"263'379","reported_seq":1020,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:39.410905+0000","last_change":"2024-09-12T01:38:39.410905+0000","last_active":"2024-09-12T01:38:39.410905+0000","last_peered":"2024-09-12T01:38:39.410905+0000","last_clean":"2024-09-12T01:38:39.410905+0000","last_became_active":"2024-09-12T00:28:37.424250+0000","last_became_peered":"2024-09-12T00:28:37.424250+0000","last_unstale":"2024-09-12T01:38:39.410905+0000","last_undegraded":"2024-09-12T01:38:39.410905+0000","last_fullsized":"2024-09-12T01:38:39.410905+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'379","last_scrub_stamp":"2024-09-12T01:38:39.410761+0000","last_deep_scrub":"263'379","last_deep_scrub_stamp":"2024-09-12T01:38:39.410761+0000","last_clean_scrub_stamp":"2024-09-12T01:38:39.410761+0000","objects_scrubbed":10,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:50.606596+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42905,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":588,"num_read_kb":1145,"num_write":446,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:28.034739+0000","last_change":"2024-09-12T01:38:28.034739+0000","last_active":"2024-09-12T01:38:28.034739+0000","last_peered":"2024-09-12T01:38:28.034739+0000","last_clean":"2024-09-12T01:38:28.034739+0000","last_became_active":"2024-09-12T00:28:39.213889+0000","last_became_peered":"2024-09-12T00:28:39.213889+0000","last_unstale":"2024-09-12T01:38:28.034739+0000","last_undegraded":"2024-09-12T01:38:28.034739+0000","last_fullsized":"2024-09-12T01:38:28.034739+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:28.034613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:28.034613+0000","last_clean_scrub_stamp":"2024-09-12T01:38:28.034613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:46.356624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"263'538","reported_seq":1356,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:42.442408+0000","last_change":"2024-09-12T01:38:42.442408+0000","last_active":"2024-09-12T01:38:42.442408+0000","last_peered":"2024-09-12T01:38:42.442408+0000","last_clean":"2024-09-12T01:38:42.442408+0000","last_became_active":"2024-09-12T00:28:41.229664+0000","last_became_peered":"2024-09-12T00:28:41.229664+0000","last_unstale":"2024-09-12T01:38:42.442408+0000","last_undegraded":"2024-09-12T01:38:42.442408+0000","last_fullsized":"2024-09-12T01:38:42.442408+0000","mapping_epoch":35,"log_start":"263'500","ondisk_log_start":"263'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'538","last_scrub_stamp":"2024-09-12T01:38:42.442328+0000","last_deep_scrub":"263'538","last_deep_scrub_stamp":"2024-09-12T01:38:42.442328+0000","last_clean_scrub_stamp":"2024-09-12T01:38:42.442328+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":500,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:09.752744+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":472,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1261,"num_read_kb":1256,"num_write":1100,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"263'151","reported_seq":774,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.524133+0000","last_change":"2024-09-12T01:38:16.524133+0000","last_active":"2024-09-12T01:38:16.524133+0000","last_peered":"2024-09-12T01:38:16.524133+0000","last_clean":"2024-09-12T01:38:16.524133+0000","last_became_active":"2024-09-12T00:28:33.201673+0000","last_became_peered":"2024-09-12T00:28:33.201673+0000","last_unstale":"2024-09-12T01:38:16.524133+0000","last_undegraded":"2024-09-12T01:38:16.524133+0000","last_fullsized":"2024-09-12T01:38:16.524133+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'151","last_scrub_stamp":"2024-09-12T01:38:16.524038+0000","last_deep_scrub":"263'151","last_deep_scrub_stamp":"2024-09-12T01:38:16.524038+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.524038+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:20.505594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":672,"num_read_kb":557,"num_write":251,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"263'425","reported_seq":1136,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.266274+0000","last_change":"2024-09-12T01:38:12.266183+0000","last_active":"2024-09-12T01:38:12.266274+0000","last_peered":"2024-09-12T01:38:12.266274+0000","last_clean":"2024-09-12T01:38:12.266274+0000","last_became_active":"2024-09-12T00:28:31.202279+0000","last_became_peered":"2024-09-12T00:28:31.202279+0000","last_unstale":"2024-09-12T01:38:12.266274+0000","last_undegraded":"2024-09-12T01:38:12.266274+0000","last_fullsized":"2024-09-12T01:38:12.266274+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'425","last_scrub_stamp":"2024-09-12T01:38:12.266071+0000","last_deep_scrub":"263'425","last_deep_scrub_stamp":"2024-09-12T01:38:12.266071+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.266071+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:43.456179+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262213,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":777,"num_read_kb":12137,"num_write":1235,"num_write_kb":44296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":512,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.741517+0000","last_change":"2024-09-12T01:38:16.741517+0000","last_active":"2024-09-12T01:38:16.741517+0000","last_peered":"2024-09-12T01:38:16.741517+0000","last_clean":"2024-09-12T01:38:16.741517+0000","last_became_active":"2024-09-12T00:28:35.210154+0000","last_became_peered":"2024-09-12T00:28:35.210154+0000","last_unstale":"2024-09-12T01:38:16.741517+0000","last_undegraded":"2024-09-12T01:38:16.741517+0000","last_fullsized":"2024-09-12T01:38:16.741517+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:16.741414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:16.741414+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.741414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:08.905624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"263'278","reported_seq":873,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.297668+0000","last_change":"2024-09-12T01:38:37.297668+0000","last_active":"2024-09-12T01:38:37.297668+0000","last_peered":"2024-09-12T01:38:37.297668+0000","last_clean":"2024-09-12T01:38:37.297668+0000","last_became_active":"2024-09-12T00:28:37.219967+0000","last_became_peered":"2024-09-12T00:28:37.219967+0000","last_unstale":"2024-09-12T01:38:37.297668+0000","last_undegraded":"2024-09-12T01:38:37.297668+0000","last_fullsized":"2024-09-12T01:38:37.297668+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'278","last_scrub_stamp":"2024-09-12T01:38:37.297574+0000","last_deep_scrub":"263'278","last_deep_scrub_stamp":"2024-09-12T01:38:37.297574+0000","last_clean_scrub_stamp":"2024-09-12T01:38:37.297574+0000","objects_scrubbed":5,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:37.194451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44545,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":449,"num_read_kb":1025,"num_write":360,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:41.315655+0000","last_change":"2024-09-12T01:38:41.315655+0000","last_active":"2024-09-12T01:38:41.315655+0000","last_peered":"2024-09-12T01:38:41.315655+0000","last_clean":"2024-09-12T01:38:41.315655+0000","last_became_active":"2024-09-12T00:28:39.216330+0000","last_became_peered":"2024-09-12T00:28:39.216330+0000","last_unstale":"2024-09-12T01:38:41.315655+0000","last_undegraded":"2024-09-12T01:38:41.315655+0000","last_fullsized":"2024-09-12T01:38:41.315655+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:41.315570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:41.315570+0000","last_clean_scrub_stamp":"2024-09-12T01:38:41.315570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:18.646822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"263'2409","reported_seq":4259,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:30.137997+0000","last_change":"2024-09-12T01:38:30.137997+0000","last_active":"2024-09-12T01:38:30.137997+0000","last_peered":"2024-09-12T01:38:30.137997+0000","last_clean":"2024-09-12T01:38:30.137997+0000","last_became_active":"2024-09-12T00:28:41.227877+0000","last_became_peered":"2024-09-12T00:28:41.227877+0000","last_unstale":"2024-09-12T01:38:30.137997+0000","last_undegraded":"2024-09-12T01:38:30.137997+0000","last_fullsized":"2024-09-12T01:38:30.137997+0000","mapping_epoch":35,"log_start":"263'2300","ondisk_log_start":"263'2300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2409","last_scrub_stamp":"2024-09-12T01:38:30.137912+0000","last_deep_scrub":"263'2409","last_deep_scrub_stamp":"2024-09-12T01:38:30.137912+0000","last_clean_scrub_stamp":"2024-09-12T01:38:30.137912+0000","objects_scrubbed":4,"log_size":109,"log_dups_size":2300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:28.037700+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1208,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6068,"num_read_kb":6055,"num_write":4875,"num_write_kb":1798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"263'303","reported_seq":981,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.167240+0000","last_change":"2024-09-12T01:38:18.167240+0000","last_active":"2024-09-12T01:38:18.167240+0000","last_peered":"2024-09-12T01:38:18.167240+0000","last_clean":"2024-09-12T01:38:18.167240+0000","last_became_active":"2024-09-12T00:28:33.217954+0000","last_became_peered":"2024-09-12T00:28:33.217954+0000","last_unstale":"2024-09-12T01:38:18.167240+0000","last_undegraded":"2024-09-12T01:38:18.167240+0000","last_fullsized":"2024-09-12T01:38:18.167240+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'303","last_scrub_stamp":"2024-09-12T01:38:18.167157+0000","last_deep_scrub":"263'303","last_deep_scrub_stamp":"2024-09-12T01:38:18.167157+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.167157+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:00.698674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1356,"num_read_kb":1133,"num_write":489,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"263'389","reported_seq":1084,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.277274+0000","last_change":"2024-09-12T01:38:16.277183+0000","last_active":"2024-09-12T01:38:16.277274+0000","last_peered":"2024-09-12T01:38:16.277274+0000","last_clean":"2024-09-12T01:38:16.277274+0000","last_became_active":"2024-09-12T00:28:31.215643+0000","last_became_peered":"2024-09-12T00:28:31.215643+0000","last_unstale":"2024-09-12T01:38:16.277274+0000","last_undegraded":"2024-09-12T01:38:16.277274+0000","last_fullsized":"2024-09-12T01:38:16.277274+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'389","last_scrub_stamp":"2024-09-12T01:38:16.277044+0000","last_deep_scrub":"263'389","last_deep_scrub_stamp":"2024-09-12T01:38:16.277044+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.277044+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:21.030278+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432537,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":556,"num_read_kb":94195,"num_write":1241,"num_write_kb":52818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.733004+0000","last_change":"2024-09-12T01:38:18.732898+0000","last_active":"2024-09-12T01:38:18.733004+0000","last_peered":"2024-09-12T01:38:18.733004+0000","last_clean":"2024-09-12T01:38:18.733004+0000","last_became_active":"2024-09-12T00:28:35.208169+0000","last_became_peered":"2024-09-12T00:28:35.208169+0000","last_unstale":"2024-09-12T01:38:18.733004+0000","last_undegraded":"2024-09-12T01:38:18.733004+0000","last_fullsized":"2024-09-12T01:38:18.733004+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:18.732796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:18.732796+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.732796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:48.698141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"263'339","reported_seq":957,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:33.414479+0000","last_change":"2024-09-12T01:38:33.414479+0000","last_active":"2024-09-12T01:38:33.414479+0000","last_peered":"2024-09-12T01:38:33.414479+0000","last_clean":"2024-09-12T01:38:33.414479+0000","last_became_active":"2024-09-12T00:28:37.220877+0000","last_became_peered":"2024-09-12T00:28:37.220877+0000","last_unstale":"2024-09-12T01:38:33.414479+0000","last_undegraded":"2024-09-12T01:38:33.414479+0000","last_fullsized":"2024-09-12T01:38:33.414479+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'339","last_scrub_stamp":"2024-09-12T01:38:33.414376+0000","last_deep_scrub":"263'339","last_deep_scrub_stamp":"2024-09-12T01:38:33.414376+0000","last_clean_scrub_stamp":"2024-09-12T01:38:33.414376+0000","objects_scrubbed":9,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:19.579577+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44229,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":532,"num_read_kb":1137,"num_write":418,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"263'774","reported_seq":2596,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:36.223850+0000","last_change":"2024-09-12T01:38:36.223850+0000","last_active":"2024-09-12T01:38:36.223850+0000","last_peered":"2024-09-12T01:38:36.223850+0000","last_clean":"2024-09-12T01:38:36.223850+0000","last_became_active":"2024-09-12T00:28:39.215746+0000","last_became_peered":"2024-09-12T00:28:39.215746+0000","last_unstale":"2024-09-12T01:38:36.223850+0000","last_undegraded":"2024-09-12T01:38:36.223850+0000","last_fullsized":"2024-09-12T01:38:36.223850+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'774","last_scrub_stamp":"2024-09-12T01:38:36.223759+0000","last_deep_scrub":"263'774","last_deep_scrub_stamp":"2024-09-12T01:38:36.223759+0000","last_clean_scrub_stamp":"2024-09-12T01:38:36.223759+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:40.732455+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"263'81","reported_seq":583,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:41.209242+0000","last_change":"2024-09-12T01:38:41.209242+0000","last_active":"2024-09-12T01:38:41.209242+0000","last_peered":"2024-09-12T01:38:41.209242+0000","last_clean":"2024-09-12T01:38:41.209242+0000","last_became_active":"2024-09-12T00:28:41.228361+0000","last_became_peered":"2024-09-12T00:28:41.228361+0000","last_unstale":"2024-09-12T01:38:41.209242+0000","last_undegraded":"2024-09-12T01:38:41.209242+0000","last_fullsized":"2024-09-12T01:38:41.209242+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'81","last_scrub_stamp":"2024-09-12T01:38:41.209159+0000","last_deep_scrub":"263'81","last_deep_scrub_stamp":"2024-09-12T01:38:41.209159+0000","last_clean_scrub_stamp":"2024-09-12T01:38:41.209159+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:37.651268+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":65,"num_write":188,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"263'302","reported_seq":917,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:26.124747+0000","last_change":"2024-09-12T01:38:26.124747+0000","last_active":"2024-09-12T01:38:26.124747+0000","last_peered":"2024-09-12T01:38:26.124747+0000","last_clean":"2024-09-12T01:38:26.124747+0000","last_became_active":"2024-09-12T00:28:33.219182+0000","last_became_peered":"2024-09-12T00:28:33.219182+0000","last_unstale":"2024-09-12T01:38:26.124747+0000","last_undegraded":"2024-09-12T01:38:26.124747+0000","last_fullsized":"2024-09-12T01:38:26.124747+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'302","last_scrub_stamp":"2024-09-12T01:38:26.124659+0000","last_deep_scrub":"263'302","last_deep_scrub_stamp":"2024-09-12T01:38:26.124659+0000","last_clean_scrub_stamp":"2024-09-12T01:38:26.124659+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:53.789811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1277,"num_read_kb":1021,"num_write":469,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"263'378","reported_seq":1054,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.303730+0000","last_change":"2024-09-12T01:38:12.303676+0000","last_active":"2024-09-12T01:38:12.303730+0000","last_peered":"2024-09-12T01:38:12.303730+0000","last_clean":"2024-09-12T01:38:12.303730+0000","last_became_active":"2024-09-12T00:28:31.214920+0000","last_became_peered":"2024-09-12T00:28:31.214920+0000","last_unstale":"2024-09-12T01:38:12.303730+0000","last_undegraded":"2024-09-12T01:38:12.303730+0000","last_fullsized":"2024-09-12T01:38:12.303730+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'378","last_scrub_stamp":"2024-09-12T01:38:12.303574+0000","last_deep_scrub":"263'378","last_deep_scrub_stamp":"2024-09-12T01:38:12.303574+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.303574+0000","objects_scrubbed":4,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:03.116923+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":584,"num_read_kb":15343,"num_write":1236,"num_write_kb":35661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":512,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.754507+0000","last_change":"2024-09-12T01:38:17.754507+0000","last_active":"2024-09-12T01:38:17.754507+0000","last_peered":"2024-09-12T01:38:17.754507+0000","last_clean":"2024-09-12T01:38:17.754507+0000","last_became_active":"2024-09-12T00:28:35.207881+0000","last_became_peered":"2024-09-12T00:28:35.207881+0000","last_unstale":"2024-09-12T01:38:17.754507+0000","last_undegraded":"2024-09-12T01:38:17.754507+0000","last_fullsized":"2024-09-12T01:38:17.754507+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:17.754418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:17.754418+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.754418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:59.001650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"263'473","reported_seq":1135,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.229161+0000","last_change":"2024-09-12T01:38:35.229161+0000","last_active":"2024-09-12T01:38:35.229161+0000","last_peered":"2024-09-12T01:38:35.229161+0000","last_clean":"2024-09-12T01:38:35.229161+0000","last_became_active":"2024-09-12T00:28:37.216189+0000","last_became_peered":"2024-09-12T00:28:37.216189+0000","last_unstale":"2024-09-12T01:38:35.229161+0000","last_undegraded":"2024-09-12T01:38:35.229161+0000","last_fullsized":"2024-09-12T01:38:35.229161+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'473","last_scrub_stamp":"2024-09-12T01:38:35.229071+0000","last_deep_scrub":"263'473","last_deep_scrub_stamp":"2024-09-12T01:38:35.229071+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.229071+0000","objects_scrubbed":7,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:58.363045+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90719,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":821,"num_read_kb":1951,"num_write":658,"num_write_kb":528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.791092+0000","last_change":"2024-09-12T01:38:22.791092+0000","last_active":"2024-09-12T01:38:22.791092+0000","last_peered":"2024-09-12T01:38:22.791092+0000","last_clean":"2024-09-12T01:38:22.791092+0000","last_became_active":"2024-09-12T00:28:39.212687+0000","last_became_peered":"2024-09-12T00:28:39.212687+0000","last_unstale":"2024-09-12T01:38:22.791092+0000","last_undegraded":"2024-09-12T01:38:22.791092+0000","last_fullsized":"2024-09-12T01:38:22.791092+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:22.790991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:22.790991+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.790991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:06.359775+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"263'135","reported_seq":672,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:34.884550+0000","last_change":"2024-09-12T01:38:34.884550+0000","last_active":"2024-09-12T01:38:34.884550+0000","last_peered":"2024-09-12T01:38:34.884550+0000","last_clean":"2024-09-12T01:38:34.884550+0000","last_became_active":"2024-09-12T00:28:41.225700+0000","last_became_peered":"2024-09-12T00:28:41.225700+0000","last_unstale":"2024-09-12T01:38:34.884550+0000","last_undegraded":"2024-09-12T01:38:34.884550+0000","last_fullsized":"2024-09-12T01:38:34.884550+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'135","last_scrub_stamp":"2024-09-12T01:38:34.884451+0000","last_deep_scrub":"263'135","last_deep_scrub_stamp":"2024-09-12T01:38:34.884451+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.884451+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:32.547527+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":521,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":185,"num_read_kb":167,"num_write":321,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"263'175","reported_seq":788,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.459440+0000","last_change":"2024-09-12T01:38:11.459368+0000","last_active":"2024-09-12T01:38:11.459440+0000","last_peered":"2024-09-12T01:38:11.459440+0000","last_clean":"2024-09-12T01:38:11.459440+0000","last_became_active":"2024-09-12T00:28:33.204532+0000","last_became_peered":"2024-09-12T00:28:33.204532+0000","last_unstale":"2024-09-12T01:38:11.459440+0000","last_undegraded":"2024-09-12T01:38:11.459440+0000","last_fullsized":"2024-09-12T01:38:11.459440+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'175","last_scrub_stamp":"2024-09-12T01:38:11.459272+0000","last_deep_scrub":"263'175","last_deep_scrub_stamp":"2024-09-12T01:38:11.459272+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.459272+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:41.431006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":765,"num_read_kb":622,"num_write":270,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"263'382","reported_seq":1027,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.215722+0000","last_change":"2024-09-12T01:38:18.215663+0000","last_active":"2024-09-12T01:38:18.215722+0000","last_peered":"2024-09-12T01:38:18.215722+0000","last_clean":"2024-09-12T01:38:18.215722+0000","last_became_active":"2024-09-12T00:28:31.207269+0000","last_became_peered":"2024-09-12T00:28:31.207269+0000","last_unstale":"2024-09-12T01:38:18.215722+0000","last_undegraded":"2024-09-12T01:38:18.215722+0000","last_fullsized":"2024-09-12T01:38:18.215722+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'382","last_scrub_stamp":"2024-09-12T01:38:18.215562+0000","last_deep_scrub":"263'382","last_deep_scrub_stamp":"2024-09-12T01:38:18.215562+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.215562+0000","objects_scrubbed":6,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:29.623240+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291522,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":535,"num_read_kb":24704,"num_write":1122,"num_write_kb":40904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.726168+0000","last_change":"2024-09-12T01:38:20.726071+0000","last_active":"2024-09-12T01:38:20.726168+0000","last_peered":"2024-09-12T01:38:20.726168+0000","last_clean":"2024-09-12T01:38:20.726168+0000","last_became_active":"2024-09-12T00:28:35.208829+0000","last_became_peered":"2024-09-12T00:28:35.208829+0000","last_unstale":"2024-09-12T01:38:20.726168+0000","last_undegraded":"2024-09-12T01:38:20.726168+0000","last_fullsized":"2024-09-12T01:38:20.726168+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:20.725958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:20.725958+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.725958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:14.695147+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"263'291","reported_seq":893,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:32.528856+0000","last_change":"2024-09-12T01:38:32.528856+0000","last_active":"2024-09-12T01:38:32.528856+0000","last_peered":"2024-09-12T01:38:32.528856+0000","last_clean":"2024-09-12T01:38:32.528856+0000","last_became_active":"2024-09-12T00:28:37.210162+0000","last_became_peered":"2024-09-12T00:28:37.210162+0000","last_unstale":"2024-09-12T01:38:32.528856+0000","last_undegraded":"2024-09-12T01:38:32.528856+0000","last_fullsized":"2024-09-12T01:38:32.528856+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'291","last_scrub_stamp":"2024-09-12T01:38:32.528735+0000","last_deep_scrub":"263'291","last_deep_scrub_stamp":"2024-09-12T01:38:32.528735+0000","last_clean_scrub_stamp":"2024-09-12T01:38:32.528735+0000","objects_scrubbed":7,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:46.245167+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46921,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":495,"num_read_kb":1053,"num_write":432,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.260178+0000","last_change":"2024-09-12T01:38:37.260178+0000","last_active":"2024-09-12T01:38:37.260178+0000","last_peered":"2024-09-12T01:38:37.260178+0000","last_clean":"2024-09-12T01:38:37.260178+0000","last_became_active":"2024-09-12T00:28:39.220468+0000","last_became_peered":"2024-09-12T00:28:39.220468+0000","last_unstale":"2024-09-12T01:38:37.260178+0000","last_undegraded":"2024-09-12T01:38:37.260178+0000","last_fullsized":"2024-09-12T01:38:37.260178+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:37.260087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:37.260087+0000","last_clean_scrub_stamp":"2024-09-12T01:38:37.260087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:17.911573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"263'86","reported_seq":589,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:44.396417+0000","last_change":"2024-09-12T01:38:44.396341+0000","last_active":"2024-09-12T01:38:44.396417+0000","last_peered":"2024-09-12T01:38:44.396417+0000","last_clean":"2024-09-12T01:38:44.396417+0000","last_became_active":"2024-09-12T00:28:41.228663+0000","last_became_peered":"2024-09-12T00:28:41.228663+0000","last_unstale":"2024-09-12T01:38:44.396417+0000","last_undegraded":"2024-09-12T01:38:44.396417+0000","last_fullsized":"2024-09-12T01:38:44.396417+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'86","last_scrub_stamp":"2024-09-12T01:38:44.396238+0000","last_deep_scrub":"263'86","last_deep_scrub_stamp":"2024-09-12T01:38:44.396238+0000","last_clean_scrub_stamp":"2024-09-12T01:38:44.396238+0000","objects_scrubbed":5,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:41.170773+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":503,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":60,"num_read_kb":59,"num_write":193,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"263'158","reported_seq":788,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.505568+0000","last_change":"2024-09-12T01:38:13.505491+0000","last_active":"2024-09-12T01:38:13.505568+0000","last_peered":"2024-09-12T01:38:13.505568+0000","last_clean":"2024-09-12T01:38:13.505568+0000","last_became_active":"2024-09-12T00:28:33.206883+0000","last_became_peered":"2024-09-12T00:28:33.206883+0000","last_unstale":"2024-09-12T01:38:13.505568+0000","last_undegraded":"2024-09-12T01:38:13.505568+0000","last_fullsized":"2024-09-12T01:38:13.505568+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'158","last_scrub_stamp":"2024-09-12T01:38:13.505388+0000","last_deep_scrub":"263'158","last_deep_scrub_stamp":"2024-09-12T01:38:13.505388+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.505388+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:21.434548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":717,"num_read_kb":595,"num_write":233,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"263'311","reported_seq":935,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.152253+0000","last_change":"2024-09-12T01:38:10.152253+0000","last_active":"2024-09-12T01:38:10.152253+0000","last_peered":"2024-09-12T01:38:10.152253+0000","last_clean":"2024-09-12T01:38:10.152253+0000","last_became_active":"2024-09-12T00:28:31.203369+0000","last_became_peered":"2024-09-12T00:28:31.203369+0000","last_unstale":"2024-09-12T01:38:10.152253+0000","last_undegraded":"2024-09-12T01:38:10.152253+0000","last_fullsized":"2024-09-12T01:38:10.152253+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'311","last_scrub_stamp":"2024-09-12T01:38:10.152154+0000","last_deep_scrub":"263'311","last_deep_scrub_stamp":"2024-09-12T01:38:10.152154+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.152154+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:08.174048+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7425128,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":375,"num_read_kb":56295,"num_write":849,"num_write_kb":46368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.025660+0000","last_change":"2024-09-12T01:38:22.025660+0000","last_active":"2024-09-12T01:38:22.025660+0000","last_peered":"2024-09-12T01:38:22.025660+0000","last_clean":"2024-09-12T01:38:22.025660+0000","last_became_active":"2024-09-12T00:28:35.207923+0000","last_became_peered":"2024-09-12T00:28:35.207923+0000","last_unstale":"2024-09-12T01:38:22.025660+0000","last_undegraded":"2024-09-12T01:38:22.025660+0000","last_fullsized":"2024-09-12T01:38:22.025660+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:22.025562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:22.025562+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.025562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:15.589299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"263'354","reported_seq":965,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:26.697355+0000","last_change":"2024-09-12T01:38:26.697286+0000","last_active":"2024-09-12T01:38:26.697355+0000","last_peered":"2024-09-12T01:38:26.697355+0000","last_clean":"2024-09-12T01:38:26.697355+0000","last_became_active":"2024-09-12T00:28:37.220674+0000","last_became_peered":"2024-09-12T00:28:37.220674+0000","last_unstale":"2024-09-12T01:38:26.697355+0000","last_undegraded":"2024-09-12T01:38:26.697355+0000","last_fullsized":"2024-09-12T01:38:26.697355+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'354","last_scrub_stamp":"2024-09-12T01:38:26.697194+0000","last_deep_scrub":"263'354","last_deep_scrub_stamp":"2024-09-12T01:38:26.697194+0000","last_clean_scrub_stamp":"2024-09-12T01:38:26.697194+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:04.175101+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48847,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":575,"num_read_kb":1313,"num_write":464,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"263'739","reported_seq":4576,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:24.709916+0000","last_change":"2024-09-12T01:38:24.709856+0000","last_active":"2024-09-12T01:38:24.709916+0000","last_peered":"2024-09-12T01:38:24.709916+0000","last_clean":"2024-09-12T01:38:24.709916+0000","last_became_active":"2024-09-12T00:28:39.213871+0000","last_became_peered":"2024-09-12T00:28:39.213871+0000","last_unstale":"2024-09-12T01:38:24.709916+0000","last_undegraded":"2024-09-12T01:38:24.709916+0000","last_fullsized":"2024-09-12T01:38:24.709916+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'739","last_scrub_stamp":"2024-09-12T01:38:24.709738+0000","last_deep_scrub":"263'739","last_deep_scrub_stamp":"2024-09-12T01:38:24.709738+0000","last_clean_scrub_stamp":"2024-09-12T01:38:24.709738+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":700,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:14.725207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"263'200","reported_seq":759,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:32.916353+0000","last_change":"2024-09-12T01:38:32.916353+0000","last_active":"2024-09-12T01:38:32.916353+0000","last_peered":"2024-09-12T01:38:32.916353+0000","last_clean":"2024-09-12T01:38:32.916353+0000","last_became_active":"2024-09-12T00:28:41.227310+0000","last_became_peered":"2024-09-12T00:28:41.227310+0000","last_unstale":"2024-09-12T01:38:32.916353+0000","last_undegraded":"2024-09-12T01:38:32.916353+0000","last_fullsized":"2024-09-12T01:38:32.916353+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'200","last_scrub_stamp":"2024-09-12T01:38:32.916236+0000","last_deep_scrub":"263'200","last_deep_scrub_stamp":"2024-09-12T01:38:32.916236+0000","last_clean_scrub_stamp":"2024-09-12T01:38:32.916236+0000","objects_scrubbed":6,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:11.385847+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1879,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":313,"num_read_kb":267,"num_write":467,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"263'134","reported_seq":767,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.496591+0000","last_change":"2024-09-12T01:38:17.496539+0000","last_active":"2024-09-12T01:38:17.496591+0000","last_peered":"2024-09-12T01:38:17.496591+0000","last_clean":"2024-09-12T01:38:17.496591+0000","last_became_active":"2024-09-12T00:28:33.211327+0000","last_became_peered":"2024-09-12T00:28:33.211327+0000","last_unstale":"2024-09-12T01:38:17.496591+0000","last_undegraded":"2024-09-12T01:38:17.496591+0000","last_fullsized":"2024-09-12T01:38:17.496591+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'134","last_scrub_stamp":"2024-09-12T01:38:17.496441+0000","last_deep_scrub":"263'134","last_deep_scrub_stamp":"2024-09-12T01:38:17.496441+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.496441+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:31.354433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":621,"num_read_kb":525,"num_write":194,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"263'378","reported_seq":1084,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.492901+0000","last_change":"2024-09-12T01:38:12.492901+0000","last_active":"2024-09-12T01:38:12.492901+0000","last_peered":"2024-09-12T01:38:12.492901+0000","last_clean":"2024-09-12T01:38:12.492901+0000","last_became_active":"2024-09-12T00:28:31.201275+0000","last_became_peered":"2024-09-12T00:28:31.201275+0000","last_unstale":"2024-09-12T01:38:12.492901+0000","last_undegraded":"2024-09-12T01:38:12.492901+0000","last_fullsized":"2024-09-12T01:38:12.492901+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'378","last_scrub_stamp":"2024-09-12T01:38:12.492779+0000","last_deep_scrub":"263'378","last_deep_scrub_stamp":"2024-09-12T01:38:12.492779+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.492779+0000","objects_scrubbed":8,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:39.803942+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395829,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":640,"num_read_kb":30113,"num_write":1190,"num_write_kb":53346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"263'4","reported_seq":1460,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:32.474262+0000","last_change":"2024-09-12T01:38:32.474262+0000","last_active":"2024-09-12T01:38:32.474262+0000","last_peered":"2024-09-12T01:38:32.474262+0000","last_clean":"2024-09-12T01:38:32.474262+0000","last_became_active":"2024-09-12T00:28:35.210173+0000","last_became_peered":"2024-09-12T00:28:35.210173+0000","last_unstale":"2024-09-12T01:38:32.474262+0000","last_undegraded":"2024-09-12T01:38:32.474262+0000","last_fullsized":"2024-09-12T01:38:32.474262+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-12T01:38:32.474172+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-12T01:38:32.474172+0000","last_clean_scrub_stamp":"2024-09-12T01:38:32.474172+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:26.611898+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":952,"num_read_kb":952,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"263'111","reported_seq":652,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:33.345052+0000","last_change":"2024-09-12T01:38:33.345052+0000","last_active":"2024-09-12T01:38:33.345052+0000","last_peered":"2024-09-12T01:38:33.345052+0000","last_clean":"2024-09-12T01:38:33.345052+0000","last_became_active":"2024-09-12T00:28:37.423847+0000","last_became_peered":"2024-09-12T00:28:37.423847+0000","last_unstale":"2024-09-12T01:38:33.345052+0000","last_undegraded":"2024-09-12T01:38:33.345052+0000","last_fullsized":"2024-09-12T01:38:33.345052+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'111","last_scrub_stamp":"2024-09-12T01:38:33.344967+0000","last_deep_scrub":"263'111","last_deep_scrub_stamp":"2024-09-12T01:38:33.344967+0000","last_clean_scrub_stamp":"2024-09-12T01:38:33.344967+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:23.427540+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":109,"num_read_kb":102,"num_write":74,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"263'760","reported_seq":2656,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:26.210045+0000","last_change":"2024-09-12T01:38:26.209968+0000","last_active":"2024-09-12T01:38:26.210045+0000","last_peered":"2024-09-12T01:38:26.210045+0000","last_clean":"2024-09-12T01:38:26.210045+0000","last_became_active":"2024-09-12T00:28:39.216244+0000","last_became_peered":"2024-09-12T00:28:39.216244+0000","last_unstale":"2024-09-12T01:38:26.210045+0000","last_undegraded":"2024-09-12T01:38:26.210045+0000","last_fullsized":"2024-09-12T01:38:26.210045+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'760","last_scrub_stamp":"2024-09-12T01:38:26.209888+0000","last_deep_scrub":"263'760","last_deep_scrub_stamp":"2024-09-12T01:38:26.209888+0000","last_clean_scrub_stamp":"2024-09-12T01:38:26.209888+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:02.637163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"263'177","reported_seq":696,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:40.528122+0000","last_change":"2024-09-12T01:38:40.528122+0000","last_active":"2024-09-12T01:38:40.528122+0000","last_peered":"2024-09-12T01:38:40.528122+0000","last_clean":"2024-09-12T01:38:40.528122+0000","last_became_active":"2024-09-12T00:28:41.225728+0000","last_became_peered":"2024-09-12T00:28:41.225728+0000","last_unstale":"2024-09-12T01:38:40.528122+0000","last_undegraded":"2024-09-12T01:38:40.528122+0000","last_fullsized":"2024-09-12T01:38:40.528122+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'177","last_scrub_stamp":"2024-09-12T01:38:40.528038+0000","last_deep_scrub":"263'177","last_deep_scrub_stamp":"2024-09-12T01:38:40.528038+0000","last_clean_scrub_stamp":"2024-09-12T01:38:40.528038+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:42.089224+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":145,"num_write":308,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"263'4256","reported_seq":4866,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.093864+0000","last_change":"2024-09-12T01:38:20.093799+0000","last_active":"2024-09-12T01:38:20.093864+0000","last_peered":"2024-09-12T01:38:20.093864+0000","last_clean":"2024-09-12T01:38:20.093864+0000","last_became_active":"2024-09-12T00:28:33.205792+0000","last_became_peered":"2024-09-12T00:28:33.205792+0000","last_unstale":"2024-09-12T01:38:20.093864+0000","last_undegraded":"2024-09-12T01:38:20.093864+0000","last_fullsized":"2024-09-12T01:38:20.093864+0000","mapping_epoch":27,"log_start":"263'4200","ondisk_log_start":"263'4200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4256","last_scrub_stamp":"2024-09-12T01:38:20.093696+0000","last_deep_scrub":"263'4256","last_deep_scrub_stamp":"2024-09-12T01:38:20.093696+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.093696+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":3000,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:49.819357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17142,"num_read_kb":14400,"num_write":6430,"num_write_kb":3228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"263'385","reported_seq":1112,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.241283+0000","last_change":"2024-09-12T01:38:10.241283+0000","last_active":"2024-09-12T01:38:10.241283+0000","last_peered":"2024-09-12T01:38:10.241283+0000","last_clean":"2024-09-12T01:38:10.241283+0000","last_became_active":"2024-09-12T00:28:31.202456+0000","last_became_peered":"2024-09-12T00:28:31.202456+0000","last_unstale":"2024-09-12T01:38:10.241283+0000","last_undegraded":"2024-09-12T01:38:10.241283+0000","last_fullsized":"2024-09-12T01:38:10.241283+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'385","last_scrub_stamp":"2024-09-12T01:38:10.241176+0000","last_deep_scrub":"263'385","last_deep_scrub_stamp":"2024-09-12T01:38:10.241176+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.241176+0000","objects_scrubbed":9,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:45.643799+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":651,"num_read_kb":78129,"num_write":1373,"num_write_kb":48684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:29.494509+0000","last_change":"2024-09-12T01:38:29.494509+0000","last_active":"2024-09-12T01:38:29.494509+0000","last_peered":"2024-09-12T01:38:29.494509+0000","last_clean":"2024-09-12T01:38:29.494509+0000","last_became_active":"2024-09-12T00:28:35.207343+0000","last_became_peered":"2024-09-12T00:28:35.207343+0000","last_unstale":"2024-09-12T01:38:29.494509+0000","last_undegraded":"2024-09-12T01:38:29.494509+0000","last_fullsized":"2024-09-12T01:38:29.494509+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:29.494405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:29.494405+0000","last_clean_scrub_stamp":"2024-09-12T01:38:29.494405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:46.288783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"263'377","reported_seq":1004,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.439219+0000","last_change":"2024-09-12T01:38:37.439219+0000","last_active":"2024-09-12T01:38:37.439219+0000","last_peered":"2024-09-12T01:38:37.439219+0000","last_clean":"2024-09-12T01:38:37.439219+0000","last_became_active":"2024-09-12T00:28:37.211090+0000","last_became_peered":"2024-09-12T00:28:37.211090+0000","last_unstale":"2024-09-12T01:38:37.439219+0000","last_undegraded":"2024-09-12T01:38:37.439219+0000","last_fullsized":"2024-09-12T01:38:37.439219+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'377","last_scrub_stamp":"2024-09-12T01:38:37.439113+0000","last_deep_scrub":"263'377","last_deep_scrub_stamp":"2024-09-12T01:38:37.439113+0000","last_clean_scrub_stamp":"2024-09-12T01:38:37.439113+0000","objects_scrubbed":8,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:34.040484+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46480,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":594,"num_read_kb":1224,"num_write":462,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:25.181529+0000","last_change":"2024-09-12T01:38:25.181468+0000","last_active":"2024-09-12T01:38:25.181529+0000","last_peered":"2024-09-12T01:38:25.181529+0000","last_clean":"2024-09-12T01:38:25.181529+0000","last_became_active":"2024-09-12T00:28:39.219687+0000","last_became_peered":"2024-09-12T00:28:39.219687+0000","last_unstale":"2024-09-12T01:38:25.181529+0000","last_undegraded":"2024-09-12T01:38:25.181529+0000","last_fullsized":"2024-09-12T01:38:25.181529+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:25.181379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:25.181379+0000","last_clean_scrub_stamp":"2024-09-12T01:38:25.181379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:32.900668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"263'119","reported_seq":632,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:31.957638+0000","last_change":"2024-09-12T01:38:31.957638+0000","last_active":"2024-09-12T01:38:31.957638+0000","last_peered":"2024-09-12T01:38:31.957638+0000","last_clean":"2024-09-12T01:38:31.957638+0000","last_became_active":"2024-09-12T00:28:41.226049+0000","last_became_peered":"2024-09-12T00:28:41.226049+0000","last_unstale":"2024-09-12T01:38:31.957638+0000","last_undegraded":"2024-09-12T01:38:31.957638+0000","last_fullsized":"2024-09-12T01:38:31.957638+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'119","last_scrub_stamp":"2024-09-12T01:38:31.957547+0000","last_deep_scrub":"263'119","last_deep_scrub_stamp":"2024-09-12T01:38:31.957547+0000","last_clean_scrub_stamp":"2024-09-12T01:38:31.957547+0000","objects_scrubbed":5,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:00.738039+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":871,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":118,"num_read_kb":115,"num_write":279,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"263'144","reported_seq":786,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.138001+0000","last_change":"2024-09-12T01:38:17.138001+0000","last_active":"2024-09-12T01:38:17.138001+0000","last_peered":"2024-09-12T01:38:17.138001+0000","last_clean":"2024-09-12T01:38:17.138001+0000","last_became_active":"2024-09-12T00:28:33.214018+0000","last_became_peered":"2024-09-12T00:28:33.214018+0000","last_unstale":"2024-09-12T01:38:17.138001+0000","last_undegraded":"2024-09-12T01:38:17.138001+0000","last_fullsized":"2024-09-12T01:38:17.138001+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'144","last_scrub_stamp":"2024-09-12T01:38:17.137901+0000","last_deep_scrub":"263'144","last_deep_scrub_stamp":"2024-09-12T01:38:17.137901+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.137901+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:44.770374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":636,"num_read_kb":544,"num_write":220,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"263'74","reported_seq":625,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.264571+0000","last_change":"2024-09-12T01:38:11.264507+0000","last_active":"2024-09-12T01:38:11.264571+0000","last_peered":"2024-09-12T01:38:11.264571+0000","last_clean":"2024-09-12T01:38:11.264571+0000","last_became_active":"2024-09-12T00:28:14.744766+0000","last_became_peered":"2024-09-12T00:28:14.744766+0000","last_unstale":"2024-09-12T01:38:11.264571+0000","last_undegraded":"2024-09-12T01:38:11.264571+0000","last_fullsized":"2024-09-12T01:38:11.264571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'74","last_scrub_stamp":"2024-09-12T01:38:11.264366+0000","last_deep_scrub":"263'74","last_deep_scrub_stamp":"2024-09-12T01:38:11.264366+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.264366+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:33.200544+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"263'2","reported_seq":532,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.265322+0000","last_change":"2024-09-12T01:38:11.265261+0000","last_active":"2024-09-12T01:38:11.265322+0000","last_peered":"2024-09-12T01:38:11.265322+0000","last_clean":"2024-09-12T01:38:11.265322+0000","last_became_active":"2024-09-12T00:28:19.162328+0000","last_became_peered":"2024-09-12T00:28:19.162328+0000","last_unstale":"2024-09-12T01:38:11.265322+0000","last_undegraded":"2024-09-12T01:38:11.265322+0000","last_fullsized":"2024-09-12T01:38:11.265322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:38:11.265179+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:38:11.265179+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.265179+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:49.396121+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00046717800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"263'321","reported_seq":971,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:09.261421+0000","last_change":"2024-09-12T01:38:09.261369+0000","last_active":"2024-09-12T01:38:09.261421+0000","last_peered":"2024-09-12T01:38:09.261421+0000","last_clean":"2024-09-12T01:38:09.261421+0000","last_became_active":"2024-09-12T00:28:31.215485+0000","last_became_peered":"2024-09-12T00:28:31.215485+0000","last_unstale":"2024-09-12T01:38:09.261421+0000","last_undegraded":"2024-09-12T01:38:09.261421+0000","last_fullsized":"2024-09-12T01:38:09.261421+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'321","last_scrub_stamp":"2024-09-12T01:38:09.261297+0000","last_deep_scrub":"263'321","last_deep_scrub_stamp":"2024-09-12T01:38:09.261297+0000","last_clean_scrub_stamp":"2024-09-12T01:38:09.261297+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:38.767121+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436935,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":460,"num_read_kb":39194,"num_write":1093,"num_write_kb":25197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:27.434349+0000","last_change":"2024-09-12T01:38:27.434297+0000","last_active":"2024-09-12T01:38:27.434349+0000","last_peered":"2024-09-12T01:38:27.434349+0000","last_clean":"2024-09-12T01:38:27.434349+0000","last_became_active":"2024-09-12T00:28:35.208812+0000","last_became_peered":"2024-09-12T00:28:35.208812+0000","last_unstale":"2024-09-12T01:38:27.434349+0000","last_undegraded":"2024-09-12T01:38:27.434349+0000","last_fullsized":"2024-09-12T01:38:27.434349+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:27.434202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:27.434202+0000","last_clean_scrub_stamp":"2024-09-12T01:38:27.434202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:30.284359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"263'754","reported_seq":1477,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:36.442893+0000","last_change":"2024-09-12T01:38:36.442893+0000","last_active":"2024-09-12T01:38:36.442893+0000","last_peered":"2024-09-12T01:38:36.442893+0000","last_clean":"2024-09-12T01:38:36.442893+0000","last_became_active":"2024-09-12T00:28:37.221001+0000","last_became_peered":"2024-09-12T00:28:37.221001+0000","last_unstale":"2024-09-12T01:38:36.442893+0000","last_undegraded":"2024-09-12T01:38:36.442893+0000","last_fullsized":"2024-09-12T01:38:36.442893+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'754","last_scrub_stamp":"2024-09-12T01:38:36.442784+0000","last_deep_scrub":"263'754","last_deep_scrub_stamp":"2024-09-12T01:38:36.442784+0000","last_clean_scrub_stamp":"2024-09-12T01:38:36.442784+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":700,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:08.801372+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141781,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1456,"num_read_kb":3385,"num_write":1364,"num_write_kb":1192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":90586,"num_omap_keys":220,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:32.185200+0000","last_change":"2024-09-12T01:38:32.185200+0000","last_active":"2024-09-12T01:38:32.185200+0000","last_peered":"2024-09-12T01:38:32.185200+0000","last_clean":"2024-09-12T01:38:32.185200+0000","last_became_active":"2024-09-12T00:28:39.221007+0000","last_became_peered":"2024-09-12T00:28:39.221007+0000","last_unstale":"2024-09-12T01:38:32.185200+0000","last_undegraded":"2024-09-12T01:38:32.185200+0000","last_fullsized":"2024-09-12T01:38:32.185200+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:32.185094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:32.185094+0000","last_clean_scrub_stamp":"2024-09-12T01:38:32.185094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:27.219082+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"263'188","reported_seq":895,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:31.126430+0000","last_change":"2024-09-12T01:38:31.126430+0000","last_active":"2024-09-12T01:38:31.126430+0000","last_peered":"2024-09-12T01:38:31.126430+0000","last_clean":"2024-09-12T01:38:31.126430+0000","last_became_active":"2024-09-12T00:28:41.226077+0000","last_became_peered":"2024-09-12T00:28:41.226077+0000","last_unstale":"2024-09-12T01:38:31.126430+0000","last_undegraded":"2024-09-12T01:38:31.126430+0000","last_fullsized":"2024-09-12T01:38:31.126430+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'188","last_scrub_stamp":"2024-09-12T01:38:31.126335+0000","last_deep_scrub":"263'188","last_deep_scrub_stamp":"2024-09-12T01:38:31.126335+0000","last_clean_scrub_stamp":"2024-09-12T01:38:31.126335+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:42.617212+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":407,"num_read_kb":405,"num_write":366,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"263'200","reported_seq":817,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.045446+0000","last_change":"2024-09-12T01:38:13.045446+0000","last_active":"2024-09-12T01:38:13.045446+0000","last_peered":"2024-09-12T01:38:13.045446+0000","last_clean":"2024-09-12T01:38:13.045446+0000","last_became_active":"2024-09-12T00:28:33.214351+0000","last_became_peered":"2024-09-12T00:28:33.214351+0000","last_unstale":"2024-09-12T01:38:13.045446+0000","last_undegraded":"2024-09-12T01:38:13.045446+0000","last_fullsized":"2024-09-12T01:38:13.045446+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'200","last_scrub_stamp":"2024-09-12T01:38:13.045354+0000","last_deep_scrub":"263'200","last_deep_scrub_stamp":"2024-09-12T01:38:13.045354+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.045354+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:24.710351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":877,"num_read_kb":731,"num_write":291,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":532,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.289897+0000","last_change":"2024-09-12T01:38:13.289843+0000","last_active":"2024-09-12T01:38:13.289897+0000","last_peered":"2024-09-12T01:38:13.289897+0000","last_clean":"2024-09-12T01:38:13.289897+0000","last_became_active":"2024-09-12T00:28:19.164970+0000","last_became_peered":"2024-09-12T00:28:19.164970+0000","last_unstale":"2024-09-12T01:38:13.289897+0000","last_undegraded":"2024-09-12T01:38:13.289897+0000","last_fullsized":"2024-09-12T01:38:13.289897+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:13.289759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:13.289759+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.289759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:35.748664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055291100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"263'381","reported_seq":1122,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:08.100876+0000","last_change":"2024-09-12T01:38:08.100822+0000","last_active":"2024-09-12T01:38:08.100876+0000","last_peered":"2024-09-12T01:38:08.100876+0000","last_clean":"2024-09-12T01:38:08.100876+0000","last_became_active":"2024-09-12T00:28:31.204842+0000","last_became_peered":"2024-09-12T00:28:31.204842+0000","last_unstale":"2024-09-12T01:38:08.100876+0000","last_undegraded":"2024-09-12T01:38:08.100876+0000","last_fullsized":"2024-09-12T01:38:08.100876+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'381","last_scrub_stamp":"2024-09-12T01:38:08.100667+0000","last_deep_scrub":"263'381","last_deep_scrub_stamp":"2024-09-12T01:38:08.100667+0000","last_clean_scrub_stamp":"2024-09-12T01:38:08.100667+0000","objects_scrubbed":9,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:45.468456+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":699,"num_read_kb":44079,"num_write":1206,"num_write_kb":29123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:30.485847+0000","last_change":"2024-09-12T01:38:30.485847+0000","last_active":"2024-09-12T01:38:30.485847+0000","last_peered":"2024-09-12T01:38:30.485847+0000","last_clean":"2024-09-12T01:38:30.485847+0000","last_became_active":"2024-09-12T00:28:35.215063+0000","last_became_peered":"2024-09-12T00:28:35.215063+0000","last_unstale":"2024-09-12T01:38:30.485847+0000","last_undegraded":"2024-09-12T01:38:30.485847+0000","last_fullsized":"2024-09-12T01:38:30.485847+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:30.485747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:30.485747+0000","last_clean_scrub_stamp":"2024-09-12T01:38:30.485747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:05.406878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"263'1369","reported_seq":3173,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:27.034943+0000","last_change":"2024-09-12T01:38:27.034886+0000","last_active":"2024-09-12T01:38:27.034943+0000","last_peered":"2024-09-12T01:38:27.034943+0000","last_clean":"2024-09-12T01:38:27.034943+0000","last_became_active":"2024-09-12T00:28:37.211275+0000","last_became_peered":"2024-09-12T00:28:37.211275+0000","last_unstale":"2024-09-12T01:38:27.034943+0000","last_undegraded":"2024-09-12T01:38:27.034943+0000","last_fullsized":"2024-09-12T01:38:27.034943+0000","mapping_epoch":31,"log_start":"263'1300","ondisk_log_start":"263'1300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1369","last_scrub_stamp":"2024-09-12T01:38:27.034773+0000","last_deep_scrub":"263'1369","last_deep_scrub_stamp":"2024-09-12T01:38:27.034773+0000","last_clean_scrub_stamp":"2024-09-12T01:38:27.034773+0000","objects_scrubbed":12,"log_size":69,"log_dups_size":1300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:21.739062+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145911,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2184,"num_read_kb":4297,"num_write":1290,"num_write_kb":1091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.528471+0000","last_change":"2024-09-12T01:38:38.528471+0000","last_active":"2024-09-12T01:38:38.528471+0000","last_peered":"2024-09-12T01:38:38.528471+0000","last_clean":"2024-09-12T01:38:38.528471+0000","last_became_active":"2024-09-12T00:28:39.217623+0000","last_became_peered":"2024-09-12T00:28:39.217623+0000","last_unstale":"2024-09-12T01:38:38.528471+0000","last_undegraded":"2024-09-12T01:38:38.528471+0000","last_fullsized":"2024-09-12T01:38:38.528471+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:38.528383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:38.528383+0000","last_clean_scrub_stamp":"2024-09-12T01:38:38.528383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:06.478079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"263'263","reported_seq":816,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:33.895494+0000","last_change":"2024-09-12T01:38:33.895494+0000","last_active":"2024-09-12T01:38:33.895494+0000","last_peered":"2024-09-12T01:38:33.895494+0000","last_clean":"2024-09-12T01:38:33.895494+0000","last_became_active":"2024-09-12T00:28:41.254814+0000","last_became_peered":"2024-09-12T00:28:41.254814+0000","last_unstale":"2024-09-12T01:38:33.895494+0000","last_undegraded":"2024-09-12T01:38:33.895494+0000","last_fullsized":"2024-09-12T01:38:33.895494+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'263","last_scrub_stamp":"2024-09-12T01:38:33.895407+0000","last_deep_scrub":"263'263","last_deep_scrub_stamp":"2024-09-12T01:38:33.895407+0000","last_clean_scrub_stamp":"2024-09-12T01:38:33.895407+0000","objects_scrubbed":2,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:10.866925+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":416,"num_read_kb":400,"num_write":581,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"263'116","reported_seq":762,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.044813+0000","last_change":"2024-09-12T01:38:19.044813+0000","last_active":"2024-09-12T01:38:19.044813+0000","last_peered":"2024-09-12T01:38:19.044813+0000","last_clean":"2024-09-12T01:38:19.044813+0000","last_became_active":"2024-09-12T00:28:33.216335+0000","last_became_peered":"2024-09-12T00:28:33.216335+0000","last_unstale":"2024-09-12T01:38:19.044813+0000","last_undegraded":"2024-09-12T01:38:19.044813+0000","last_fullsized":"2024-09-12T01:38:19.044813+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'116","last_scrub_stamp":"2024-09-12T01:38:19.044713+0000","last_deep_scrub":"263'116","last_deep_scrub_stamp":"2024-09-12T01:38:19.044713+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.044713+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:33.501842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":537,"num_read_kb":460,"num_write":159,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":537,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:07.840648+0000","last_change":"2024-09-12T01:38:07.840574+0000","last_active":"2024-09-12T01:38:07.840648+0000","last_peered":"2024-09-12T01:38:07.840648+0000","last_clean":"2024-09-12T01:38:07.840648+0000","last_became_active":"2024-09-12T00:28:19.225901+0000","last_became_peered":"2024-09-12T00:28:19.225901+0000","last_unstale":"2024-09-12T01:38:07.840648+0000","last_undegraded":"2024-09-12T01:38:07.840648+0000","last_fullsized":"2024-09-12T01:38:07.840648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:07.840493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:07.840493+0000","last_clean_scrub_stamp":"2024-09-12T01:38:07.840493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:17.786493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032319500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"263'346","reported_seq":1154,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:08.229237+0000","last_change":"2024-09-12T01:38:08.229143+0000","last_active":"2024-09-12T01:38:08.229237+0000","last_peered":"2024-09-12T01:38:08.229237+0000","last_clean":"2024-09-12T01:38:08.229237+0000","last_became_active":"2024-09-12T00:28:31.198575+0000","last_became_peered":"2024-09-12T00:28:31.198575+0000","last_unstale":"2024-09-12T01:38:08.229237+0000","last_undegraded":"2024-09-12T01:38:08.229237+0000","last_fullsized":"2024-09-12T01:38:08.229237+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'346","last_scrub_stamp":"2024-09-12T01:38:08.229006+0000","last_deep_scrub":"263'346","last_deep_scrub_stamp":"2024-09-12T01:38:08.229006+0000","last_clean_scrub_stamp":"2024-09-12T01:38:08.229006+0000","objects_scrubbed":9,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:39.417199+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3941571,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":832,"num_read_kb":78199,"num_write":1073,"num_write_kb":40255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"263'2","reported_seq":514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.734864+0000","last_change":"2024-09-12T01:38:13.734864+0000","last_active":"2024-09-12T01:38:13.734864+0000","last_peered":"2024-09-12T01:38:13.734864+0000","last_clean":"2024-09-12T01:38:13.734864+0000","last_became_active":"2024-09-12T00:28:35.209218+0000","last_became_peered":"2024-09-12T00:28:35.209218+0000","last_unstale":"2024-09-12T01:38:13.734864+0000","last_undegraded":"2024-09-12T01:38:13.734864+0000","last_fullsized":"2024-09-12T01:38:13.734864+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:38:13.734781+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:38:13.734781+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.734781+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:29.932696+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"263'288","reported_seq":1675,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:32.372392+0000","last_change":"2024-09-12T01:38:32.372392+0000","last_active":"2024-09-12T01:38:32.372392+0000","last_peered":"2024-09-12T01:38:32.372392+0000","last_clean":"2024-09-12T01:38:32.372392+0000","last_became_active":"2024-09-12T00:28:37.423714+0000","last_became_peered":"2024-09-12T00:28:37.423714+0000","last_unstale":"2024-09-12T01:38:32.372392+0000","last_undegraded":"2024-09-12T01:38:32.372392+0000","last_fullsized":"2024-09-12T01:38:32.372392+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'288","last_scrub_stamp":"2024-09-12T01:38:32.372285+0000","last_deep_scrub":"263'288","last_deep_scrub_stamp":"2024-09-12T01:38:32.372285+0000","last_clean_scrub_stamp":"2024-09-12T01:38:32.372285+0000","objects_scrubbed":9,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:50.426218+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":244,"num_read_kb":234,"num_write":227,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5400,"num_omap_keys":12,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:31.155694+0000","last_change":"2024-09-12T01:38:31.155694+0000","last_active":"2024-09-12T01:38:31.155694+0000","last_peered":"2024-09-12T01:38:31.155694+0000","last_clean":"2024-09-12T01:38:31.155694+0000","last_became_active":"2024-09-12T00:28:39.218692+0000","last_became_peered":"2024-09-12T00:28:39.218692+0000","last_unstale":"2024-09-12T01:38:31.155694+0000","last_undegraded":"2024-09-12T01:38:31.155694+0000","last_fullsized":"2024-09-12T01:38:31.155694+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:31.155598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:31.155598+0000","last_clean_scrub_stamp":"2024-09-12T01:38:31.155598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:44.466356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"263'254","reported_seq":866,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:45.359267+0000","last_change":"2024-09-12T01:38:45.359267+0000","last_active":"2024-09-12T01:38:45.359267+0000","last_peered":"2024-09-12T01:38:45.359267+0000","last_clean":"2024-09-12T01:38:45.359267+0000","last_became_active":"2024-09-12T00:28:41.229441+0000","last_became_peered":"2024-09-12T00:28:41.229441+0000","last_unstale":"2024-09-12T01:38:45.359267+0000","last_undegraded":"2024-09-12T01:38:45.359267+0000","last_fullsized":"2024-09-12T01:38:45.359267+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'254","last_scrub_stamp":"2024-09-12T01:38:45.359172+0000","last_deep_scrub":"263'254","last_deep_scrub_stamp":"2024-09-12T01:38:45.359172+0000","last_clean_scrub_stamp":"2024-09-12T01:38:45.359172+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:18.672581+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":487,"num_read_kb":509,"num_write":546,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"263'224","reported_seq":906,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.182076+0000","last_change":"2024-09-12T01:38:14.182019+0000","last_active":"2024-09-12T01:38:14.182076+0000","last_peered":"2024-09-12T01:38:14.182076+0000","last_clean":"2024-09-12T01:38:14.182076+0000","last_became_active":"2024-09-12T00:28:33.205107+0000","last_became_peered":"2024-09-12T00:28:33.205107+0000","last_unstale":"2024-09-12T01:38:14.182076+0000","last_undegraded":"2024-09-12T01:38:14.182076+0000","last_fullsized":"2024-09-12T01:38:14.182076+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'224","last_scrub_stamp":"2024-09-12T01:38:14.181928+0000","last_deep_scrub":"263'224","last_deep_scrub_stamp":"2024-09-12T01:38:14.181928+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.181928+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:53.395317+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1021,"num_read_kb":847,"num_write":335,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":465,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"263'3","reported_seq":533,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:09.217997+0000","last_change":"2024-09-12T01:38:09.217929+0000","last_active":"2024-09-12T01:38:09.217997+0000","last_peered":"2024-09-12T01:38:09.217997+0000","last_clean":"2024-09-12T01:38:09.217997+0000","last_became_active":"2024-09-12T00:28:19.162307+0000","last_became_peered":"2024-09-12T00:28:19.162307+0000","last_unstale":"2024-09-12T01:38:09.217997+0000","last_undegraded":"2024-09-12T01:38:09.217997+0000","last_fullsized":"2024-09-12T01:38:09.217997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-12T01:38:09.217852+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-12T01:38:09.217852+0000","last_clean_scrub_stamp":"2024-09-12T01:38:09.217852+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:31.504965+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00089189499999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"263'359","reported_seq":1052,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:08.508087+0000","last_change":"2024-09-12T01:38:08.508023+0000","last_active":"2024-09-12T01:38:08.508087+0000","last_peered":"2024-09-12T01:38:08.508087+0000","last_clean":"2024-09-12T01:38:08.508087+0000","last_became_active":"2024-09-12T00:28:31.208584+0000","last_became_peered":"2024-09-12T00:28:31.208584+0000","last_unstale":"2024-09-12T01:38:08.508087+0000","last_undegraded":"2024-09-12T01:38:08.508087+0000","last_fullsized":"2024-09-12T01:38:08.508087+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'359","last_scrub_stamp":"2024-09-12T01:38:08.507897+0000","last_deep_scrub":"263'359","last_deep_scrub_stamp":"2024-09-12T01:38:08.507897+0000","last_clean_scrub_stamp":"2024-09-12T01:38:08.507897+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:25.206563+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262163,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":641,"num_read_kb":7750,"num_write":1122,"num_write_kb":19514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:33.223461+0000","last_change":"2024-09-12T01:38:33.223461+0000","last_active":"2024-09-12T01:38:33.223461+0000","last_peered":"2024-09-12T01:38:33.223461+0000","last_clean":"2024-09-12T01:38:33.223461+0000","last_became_active":"2024-09-12T00:28:35.207234+0000","last_became_peered":"2024-09-12T00:28:35.207234+0000","last_unstale":"2024-09-12T01:38:33.223461+0000","last_undegraded":"2024-09-12T01:38:33.223461+0000","last_fullsized":"2024-09-12T01:38:33.223461+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:33.223375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:33.223375+0000","last_clean_scrub_stamp":"2024-09-12T01:38:33.223375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:23.217201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"263'167","reported_seq":732,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:32.352500+0000","last_change":"2024-09-12T01:38:32.352500+0000","last_active":"2024-09-12T01:38:32.352500+0000","last_peered":"2024-09-12T01:38:32.352500+0000","last_clean":"2024-09-12T01:38:32.352500+0000","last_became_active":"2024-09-12T00:28:37.219599+0000","last_became_peered":"2024-09-12T00:28:37.219599+0000","last_unstale":"2024-09-12T01:38:32.352500+0000","last_undegraded":"2024-09-12T01:38:32.352500+0000","last_fullsized":"2024-09-12T01:38:32.352500+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'167","last_scrub_stamp":"2024-09-12T01:38:32.352382+0000","last_deep_scrub":"263'167","last_deep_scrub_stamp":"2024-09-12T01:38:32.352382+0000","last_clean_scrub_stamp":"2024-09-12T01:38:32.352382+0000","objects_scrubbed":7,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:57.832189+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":184,"num_read_kb":176,"num_write":136,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3358,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:36.068291+0000","last_change":"2024-09-12T01:38:36.068291+0000","last_active":"2024-09-12T01:38:36.068291+0000","last_peered":"2024-09-12T01:38:36.068291+0000","last_clean":"2024-09-12T01:38:36.068291+0000","last_became_active":"2024-09-12T00:28:39.216397+0000","last_became_peered":"2024-09-12T00:28:39.216397+0000","last_unstale":"2024-09-12T01:38:36.068291+0000","last_undegraded":"2024-09-12T01:38:36.068291+0000","last_fullsized":"2024-09-12T01:38:36.068291+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:36.068187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:36.068187+0000","last_clean_scrub_stamp":"2024-09-12T01:38:36.068187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:58.308228+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"263'110","reported_seq":663,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:43.482660+0000","last_change":"2024-09-12T01:38:43.482660+0000","last_active":"2024-09-12T01:38:43.482660+0000","last_peered":"2024-09-12T01:38:43.482660+0000","last_clean":"2024-09-12T01:38:43.482660+0000","last_became_active":"2024-09-12T00:28:41.230698+0000","last_became_peered":"2024-09-12T00:28:41.230698+0000","last_unstale":"2024-09-12T01:38:43.482660+0000","last_undegraded":"2024-09-12T01:38:43.482660+0000","last_fullsized":"2024-09-12T01:38:43.482660+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'110","last_scrub_stamp":"2024-09-12T01:38:43.482572+0000","last_deep_scrub":"263'110","last_deep_scrub_stamp":"2024-09-12T01:38:43.482572+0000","last_clean_scrub_stamp":"2024-09-12T01:38:43.482572+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:32.770121+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":194,"num_write":246,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"263'101","reported_seq":696,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.032800+0000","last_change":"2024-09-12T01:38:18.032734+0000","last_active":"2024-09-12T01:38:18.032800+0000","last_peered":"2024-09-12T01:38:18.032800+0000","last_clean":"2024-09-12T01:38:18.032800+0000","last_became_active":"2024-09-12T00:28:33.213241+0000","last_became_peered":"2024-09-12T00:28:33.213241+0000","last_unstale":"2024-09-12T01:38:18.032800+0000","last_undegraded":"2024-09-12T01:38:18.032800+0000","last_fullsized":"2024-09-12T01:38:18.032800+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'101","last_scrub_stamp":"2024-09-12T01:38:18.032630+0000","last_deep_scrub":"263'101","last_deep_scrub_stamp":"2024-09-12T01:38:18.032630+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.032630+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:48.287686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":440,"num_read_kb":364,"num_write":181,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"263'335","reported_seq":960,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.220853+0000","last_change":"2024-09-12T01:38:10.220801+0000","last_active":"2024-09-12T01:38:10.220853+0000","last_peered":"2024-09-12T01:38:10.220853+0000","last_clean":"2024-09-12T01:38:10.220853+0000","last_became_active":"2024-09-12T00:28:31.209154+0000","last_became_peered":"2024-09-12T00:28:31.209154+0000","last_unstale":"2024-09-12T01:38:10.220853+0000","last_undegraded":"2024-09-12T01:38:10.220853+0000","last_fullsized":"2024-09-12T01:38:10.220853+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'335","last_scrub_stamp":"2024-09-12T01:38:10.220717+0000","last_deep_scrub":"263'335","last_deep_scrub_stamp":"2024-09-12T01:38:10.220717+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.220717+0000","objects_scrubbed":6,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:59.487021+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":854338,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":445,"num_read_kb":910,"num_write":1009,"num_write_kb":5944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":542,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.186139+0000","last_change":"2024-09-12T01:38:10.186088+0000","last_active":"2024-09-12T01:38:10.186139+0000","last_peered":"2024-09-12T01:38:10.186139+0000","last_clean":"2024-09-12T01:38:10.186139+0000","last_became_active":"2024-09-12T00:28:19.383394+0000","last_became_peered":"2024-09-12T00:28:19.383394+0000","last_unstale":"2024-09-12T01:38:10.186139+0000","last_undegraded":"2024-09-12T01:38:10.186139+0000","last_fullsized":"2024-09-12T01:38:10.186139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.186021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.186021+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.186021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:10.372021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046548800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:30.136157+0000","last_change":"2024-09-12T01:38:30.136109+0000","last_active":"2024-09-12T01:38:30.136157+0000","last_peered":"2024-09-12T01:38:30.136157+0000","last_clean":"2024-09-12T01:38:30.136157+0000","last_became_active":"2024-09-12T00:28:35.208094+0000","last_became_peered":"2024-09-12T00:28:35.208094+0000","last_unstale":"2024-09-12T01:38:30.136157+0000","last_undegraded":"2024-09-12T01:38:30.136157+0000","last_fullsized":"2024-09-12T01:38:30.136157+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:30.136033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:30.136033+0000","last_clean_scrub_stamp":"2024-09-12T01:38:30.136033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:36.139933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"263'664","reported_seq":1366,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:24.148699+0000","last_change":"2024-09-12T01:38:24.148638+0000","last_active":"2024-09-12T01:38:24.148699+0000","last_peered":"2024-09-12T01:38:24.148699+0000","last_clean":"2024-09-12T01:38:24.148699+0000","last_became_active":"2024-09-12T00:28:37.220158+0000","last_became_peered":"2024-09-12T00:28:37.220158+0000","last_unstale":"2024-09-12T01:38:24.148699+0000","last_undegraded":"2024-09-12T01:38:24.148699+0000","last_fullsized":"2024-09-12T01:38:24.148699+0000","mapping_epoch":31,"log_start":"263'600","ondisk_log_start":"263'600","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'664","last_scrub_stamp":"2024-09-12T01:38:24.148534+0000","last_deep_scrub":"263'664","last_deep_scrub_stamp":"2024-09-12T01:38:24.148534+0000","last_clean_scrub_stamp":"2024-09-12T01:38:24.148534+0000","objects_scrubbed":11,"log_size":64,"log_dups_size":600,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:38.824218+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103952,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1701,"num_read_kb":3039,"num_write":2184,"num_write_kb":1992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":500702,"num_omap_keys":1132,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.513767+0000","last_change":"2024-09-12T01:38:37.513767+0000","last_active":"2024-09-12T01:38:37.513767+0000","last_peered":"2024-09-12T01:38:37.513767+0000","last_clean":"2024-09-12T01:38:37.513767+0000","last_became_active":"2024-09-12T00:28:39.220079+0000","last_became_peered":"2024-09-12T00:28:39.220079+0000","last_unstale":"2024-09-12T01:38:37.513767+0000","last_undegraded":"2024-09-12T01:38:37.513767+0000","last_fullsized":"2024-09-12T01:38:37.513767+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:37.513687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:37.513687+0000","last_clean_scrub_stamp":"2024-09-12T01:38:37.513687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:54.862533+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"263'137","reported_seq":665,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:43.197697+0000","last_change":"2024-09-12T01:38:43.197697+0000","last_active":"2024-09-12T01:38:43.197697+0000","last_peered":"2024-09-12T01:38:43.197697+0000","last_clean":"2024-09-12T01:38:43.197697+0000","last_became_active":"2024-09-12T00:28:41.257739+0000","last_became_peered":"2024-09-12T00:28:41.257739+0000","last_unstale":"2024-09-12T01:38:43.197697+0000","last_undegraded":"2024-09-12T01:38:43.197697+0000","last_fullsized":"2024-09-12T01:38:43.197697+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'137","last_scrub_stamp":"2024-09-12T01:38:43.197610+0000","last_deep_scrub":"263'137","last_deep_scrub_stamp":"2024-09-12T01:38:43.197610+0000","last_clean_scrub_stamp":"2024-09-12T01:38:43.197610+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:16.433171+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":203,"num_read_kb":182,"num_write":334,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"263'142","reported_seq":784,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.185141+0000","last_change":"2024-09-12T01:38:22.185063+0000","last_active":"2024-09-12T01:38:22.185141+0000","last_peered":"2024-09-12T01:38:22.185141+0000","last_clean":"2024-09-12T01:38:22.185141+0000","last_became_active":"2024-09-12T00:28:33.216065+0000","last_became_peered":"2024-09-12T00:28:33.216065+0000","last_unstale":"2024-09-12T01:38:22.185141+0000","last_undegraded":"2024-09-12T01:38:22.185141+0000","last_fullsized":"2024-09-12T01:38:22.185141+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'142","last_scrub_stamp":"2024-09-12T01:38:22.184985+0000","last_deep_scrub":"263'142","last_deep_scrub_stamp":"2024-09-12T01:38:22.184985+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.184985+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:25.280489+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":614,"num_read_kb":525,"num_write":208,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"263'345","reported_seq":1014,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:09.220622+0000","last_change":"2024-09-12T01:38:09.220565+0000","last_active":"2024-09-12T01:38:09.220622+0000","last_peered":"2024-09-12T01:38:09.220622+0000","last_clean":"2024-09-12T01:38:09.220622+0000","last_became_active":"2024-09-12T00:28:31.198681+0000","last_became_peered":"2024-09-12T00:28:31.198681+0000","last_unstale":"2024-09-12T01:38:09.220622+0000","last_undegraded":"2024-09-12T01:38:09.220622+0000","last_fullsized":"2024-09-12T01:38:09.220622+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'345","last_scrub_stamp":"2024-09-12T01:38:09.220489+0000","last_deep_scrub":"263'345","last_deep_scrub_stamp":"2024-09-12T01:38:09.220489+0000","last_clean_scrub_stamp":"2024-09-12T01:38:09.220489+0000","objects_scrubbed":5,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:20.626502+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550835,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":482,"num_read_kb":38182,"num_write":1051,"num_write_kb":26889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":531,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.230685+0000","last_change":"2024-09-12T01:38:10.230605+0000","last_active":"2024-09-12T01:38:10.230685+0000","last_peered":"2024-09-12T01:38:10.230685+0000","last_clean":"2024-09-12T01:38:10.230685+0000","last_became_active":"2024-09-12T00:28:19.384222+0000","last_became_peered":"2024-09-12T00:28:19.384222+0000","last_unstale":"2024-09-12T01:38:10.230685+0000","last_undegraded":"2024-09-12T01:38:10.230685+0000","last_fullsized":"2024-09-12T01:38:10.230685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.230512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.230512+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.230512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:30.488629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060999899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"263'6","reported_seq":992,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.212056+0000","last_change":"2024-09-12T01:38:21.212001+0000","last_active":"2024-09-12T01:38:21.212056+0000","last_peered":"2024-09-12T01:38:21.212056+0000","last_clean":"2024-09-12T01:38:21.212056+0000","last_became_active":"2024-09-12T00:28:35.207941+0000","last_became_peered":"2024-09-12T00:28:35.207941+0000","last_unstale":"2024-09-12T01:38:21.212056+0000","last_undegraded":"2024-09-12T01:38:21.212056+0000","last_fullsized":"2024-09-12T01:38:21.212056+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-12T01:38:21.211920+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-12T01:38:21.211920+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.211920+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:16.655918+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":1191,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"263'255","reported_seq":857,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:29.008538+0000","last_change":"2024-09-12T01:38:29.008482+0000","last_active":"2024-09-12T01:38:29.008538+0000","last_peered":"2024-09-12T01:38:29.008538+0000","last_clean":"2024-09-12T01:38:29.008538+0000","last_became_active":"2024-09-12T00:28:37.423835+0000","last_became_peered":"2024-09-12T00:28:37.423835+0000","last_unstale":"2024-09-12T01:38:29.008538+0000","last_undegraded":"2024-09-12T01:38:29.008538+0000","last_fullsized":"2024-09-12T01:38:29.008538+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'255","last_scrub_stamp":"2024-09-12T01:38:29.008384+0000","last_deep_scrub":"263'255","last_deep_scrub_stamp":"2024-09-12T01:38:29.008384+0000","last_clean_scrub_stamp":"2024-09-12T01:38:29.008384+0000","objects_scrubbed":9,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:41.255615+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":310,"num_read_kb":301,"num_write":288,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6272,"num_omap_keys":14,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"263'782","reported_seq":2906,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:41.412386+0000","last_change":"2024-09-12T01:38:41.412319+0000","last_active":"2024-09-12T01:38:41.412386+0000","last_peered":"2024-09-12T01:38:41.412386+0000","last_clean":"2024-09-12T01:38:41.412386+0000","last_became_active":"2024-09-12T00:28:39.214050+0000","last_became_peered":"2024-09-12T00:28:39.214050+0000","last_unstale":"2024-09-12T01:38:41.412386+0000","last_undegraded":"2024-09-12T01:38:41.412386+0000","last_fullsized":"2024-09-12T01:38:41.412386+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'782","last_scrub_stamp":"2024-09-12T01:38:41.412225+0000","last_deep_scrub":"263'782","last_deep_scrub_stamp":"2024-09-12T01:38:41.412225+0000","last_clean_scrub_stamp":"2024-09-12T01:38:41.412225+0000","objects_scrubbed":1,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:41.656900+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"263'149","reported_seq":671,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:46.340927+0000","last_change":"2024-09-12T01:38:46.340927+0000","last_active":"2024-09-12T01:38:46.340927+0000","last_peered":"2024-09-12T01:38:46.340927+0000","last_clean":"2024-09-12T01:38:46.340927+0000","last_became_active":"2024-09-12T00:28:41.254826+0000","last_became_peered":"2024-09-12T00:28:41.254826+0000","last_unstale":"2024-09-12T01:38:46.340927+0000","last_undegraded":"2024-09-12T01:38:46.340927+0000","last_fullsized":"2024-09-12T01:38:46.340927+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'149","last_scrub_stamp":"2024-09-12T01:38:46.340827+0000","last_deep_scrub":"263'149","last_deep_scrub_stamp":"2024-09-12T01:38:46.340827+0000","last_clean_scrub_stamp":"2024-09-12T01:38:46.340827+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:46.908185+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1298,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":177,"num_read_kb":162,"num_write":341,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"263'307","reported_seq":919,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:26.301083+0000","last_change":"2024-09-12T01:38:26.300995+0000","last_active":"2024-09-12T01:38:26.301083+0000","last_peered":"2024-09-12T01:38:26.301083+0000","last_clean":"2024-09-12T01:38:26.301083+0000","last_became_active":"2024-09-12T00:28:33.217516+0000","last_became_peered":"2024-09-12T00:28:33.217516+0000","last_unstale":"2024-09-12T01:38:26.301083+0000","last_undegraded":"2024-09-12T01:38:26.301083+0000","last_fullsized":"2024-09-12T01:38:26.301083+0000","mapping_epoch":27,"log_start":"260'200","ondisk_log_start":"260'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'307","last_scrub_stamp":"2024-09-12T01:38:26.300887+0000","last_deep_scrub":"263'307","last_deep_scrub_stamp":"2024-09-12T01:38:26.300887+0000","last_clean_scrub_stamp":"2024-09-12T01:38:26.300887+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:46.021127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1312,"num_read_kb":1045,"num_write":501,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"263'312","reported_seq":914,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:08.232707+0000","last_change":"2024-09-12T01:38:08.232707+0000","last_active":"2024-09-12T01:38:08.232707+0000","last_peered":"2024-09-12T01:38:08.232707+0000","last_clean":"2024-09-12T01:38:08.232707+0000","last_became_active":"2024-09-12T00:28:31.202895+0000","last_became_peered":"2024-09-12T00:28:31.202895+0000","last_unstale":"2024-09-12T01:38:08.232707+0000","last_undegraded":"2024-09-12T01:38:08.232707+0000","last_fullsized":"2024-09-12T01:38:08.232707+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'312","last_scrub_stamp":"2024-09-12T01:38:08.232586+0000","last_deep_scrub":"263'312","last_deep_scrub_stamp":"2024-09-12T01:38:08.232586+0000","last_clean_scrub_stamp":"2024-09-12T01:38:08.232586+0000","objects_scrubbed":7,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:08.573915+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262178,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":365,"num_read_kb":358,"num_write":953,"num_write_kb":25812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":540,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:07.216544+0000","last_change":"2024-09-12T01:38:07.216544+0000","last_active":"2024-09-12T01:38:07.216544+0000","last_peered":"2024-09-12T01:38:07.216544+0000","last_clean":"2024-09-12T01:38:07.216544+0000","last_became_active":"2024-09-12T00:28:19.160344+0000","last_became_peered":"2024-09-12T00:28:19.160344+0000","last_unstale":"2024-09-12T01:38:07.216544+0000","last_undegraded":"2024-09-12T01:38:07.216544+0000","last_fullsized":"2024-09-12T01:38:07.216544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:07.216476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:07.216476+0000","last_clean_scrub_stamp":"2024-09-12T01:38:07.216476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:01.774688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000483707,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:28.486461+0000","last_change":"2024-09-12T01:38:28.486392+0000","last_active":"2024-09-12T01:38:28.486461+0000","last_peered":"2024-09-12T01:38:28.486461+0000","last_clean":"2024-09-12T01:38:28.486461+0000","last_became_active":"2024-09-12T00:28:35.215429+0000","last_became_peered":"2024-09-12T00:28:35.215429+0000","last_unstale":"2024-09-12T01:38:28.486461+0000","last_undegraded":"2024-09-12T01:38:28.486461+0000","last_fullsized":"2024-09-12T01:38:28.486461+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:28.486306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:28.486306+0000","last_clean_scrub_stamp":"2024-09-12T01:38:28.486306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:36.724669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"263'136","reported_seq":702,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:31.537922+0000","last_change":"2024-09-12T01:38:31.537832+0000","last_active":"2024-09-12T01:38:31.537922+0000","last_peered":"2024-09-12T01:38:31.537922+0000","last_clean":"2024-09-12T01:38:31.537922+0000","last_became_active":"2024-09-12T00:28:37.219746+0000","last_became_peered":"2024-09-12T00:28:37.219746+0000","last_unstale":"2024-09-12T01:38:31.537922+0000","last_undegraded":"2024-09-12T01:38:31.537922+0000","last_fullsized":"2024-09-12T01:38:31.537922+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'136","last_scrub_stamp":"2024-09-12T01:38:31.537717+0000","last_deep_scrub":"263'136","last_deep_scrub_stamp":"2024-09-12T01:38:31.537717+0000","last_clean_scrub_stamp":"2024-09-12T01:38:31.537717+0000","objects_scrubbed":6,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:10.135264+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":158,"num_read_kb":152,"num_write":104,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"263'770","reported_seq":2694,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:42.330565+0000","last_change":"2024-09-12T01:38:42.330443+0000","last_active":"2024-09-12T01:38:42.330565+0000","last_peered":"2024-09-12T01:38:42.330565+0000","last_clean":"2024-09-12T01:38:42.330565+0000","last_became_active":"2024-09-12T00:28:39.218170+0000","last_became_peered":"2024-09-12T00:28:39.218170+0000","last_unstale":"2024-09-12T01:38:42.330565+0000","last_undegraded":"2024-09-12T01:38:42.330565+0000","last_fullsized":"2024-09-12T01:38:42.330565+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'770","last_scrub_stamp":"2024-09-12T01:38:42.330341+0000","last_deep_scrub":"263'770","last_deep_scrub_stamp":"2024-09-12T01:38:42.330341+0000","last_clean_scrub_stamp":"2024-09-12T01:38:42.330341+0000","objects_scrubbed":1,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:59.497009+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"263'184","reported_seq":692,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:42.205417+0000","last_change":"2024-09-12T01:38:42.205417+0000","last_active":"2024-09-12T01:38:42.205417+0000","last_peered":"2024-09-12T01:38:42.205417+0000","last_clean":"2024-09-12T01:38:42.205417+0000","last_became_active":"2024-09-12T00:28:41.225316+0000","last_became_peered":"2024-09-12T00:28:41.225316+0000","last_unstale":"2024-09-12T01:38:42.205417+0000","last_undegraded":"2024-09-12T01:38:42.205417+0000","last_fullsized":"2024-09-12T01:38:42.205417+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'184","last_scrub_stamp":"2024-09-12T01:38:42.205295+0000","last_deep_scrub":"263'184","last_deep_scrub_stamp":"2024-09-12T01:38:42.205295+0000","last_clean_scrub_stamp":"2024-09-12T01:38:42.205295+0000","objects_scrubbed":3,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:55:54.093132+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":127,"num_read_kb":125,"num_write":428,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"263'343","reported_seq":988,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.498974+0000","last_change":"2024-09-12T01:38:20.498869+0000","last_active":"2024-09-12T01:38:20.498974+0000","last_peered":"2024-09-12T01:38:20.498974+0000","last_clean":"2024-09-12T01:38:20.498974+0000","last_became_active":"2024-09-12T00:28:33.212624+0000","last_became_peered":"2024-09-12T00:28:33.212624+0000","last_unstale":"2024-09-12T01:38:20.498974+0000","last_undegraded":"2024-09-12T01:38:20.498974+0000","last_fullsized":"2024-09-12T01:38:20.498974+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'343","last_scrub_stamp":"2024-09-12T01:38:20.498766+0000","last_deep_scrub":"263'343","last_deep_scrub_stamp":"2024-09-12T01:38:20.498766+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.498766+0000","objects_scrubbed":1,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:22.317000+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1481,"num_read_kb":1196,"num_write":544,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8074,"num_omap_keys":32,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"263'460","reported_seq":1183,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:07.124158+0000","last_change":"2024-09-12T01:38:07.124158+0000","last_active":"2024-09-12T01:38:07.124158+0000","last_peered":"2024-09-12T01:38:07.124158+0000","last_clean":"2024-09-12T01:38:07.124158+0000","last_became_active":"2024-09-12T00:28:31.203087+0000","last_became_peered":"2024-09-12T00:28:31.203087+0000","last_unstale":"2024-09-12T01:38:07.124158+0000","last_undegraded":"2024-09-12T01:38:07.124158+0000","last_fullsized":"2024-09-12T01:38:07.124158+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'460","last_scrub_stamp":"2024-09-12T01:38:07.124064+0000","last_deep_scrub":"263'460","last_deep_scrub_stamp":"2024-09-12T01:38:07.124064+0000","last_clean_scrub_stamp":"2024-09-12T01:38:07.124064+0000","objects_scrubbed":11,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:46.650060+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":607243,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":857,"num_read_kb":36686,"num_write":1272,"num_write_kb":31229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":531,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:09.149142+0000","last_change":"2024-09-12T01:38:09.149142+0000","last_active":"2024-09-12T01:38:09.149142+0000","last_peered":"2024-09-12T01:38:09.149142+0000","last_clean":"2024-09-12T01:38:09.149142+0000","last_became_active":"2024-09-12T00:28:19.162886+0000","last_became_peered":"2024-09-12T00:28:19.162886+0000","last_unstale":"2024-09-12T01:38:09.149142+0000","last_undegraded":"2024-09-12T01:38:09.149142+0000","last_fullsized":"2024-09-12T01:38:09.149142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:09.149026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:09.149026+0000","last_clean_scrub_stamp":"2024-09-12T01:38:09.149026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:10.471474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044054899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:29.289058+0000","last_change":"2024-09-12T01:38:29.289000+0000","last_active":"2024-09-12T01:38:29.289058+0000","last_peered":"2024-09-12T01:38:29.289058+0000","last_clean":"2024-09-12T01:38:29.289058+0000","last_became_active":"2024-09-12T00:28:35.212916+0000","last_became_peered":"2024-09-12T00:28:35.212916+0000","last_unstale":"2024-09-12T01:38:29.289058+0000","last_undegraded":"2024-09-12T01:38:29.289058+0000","last_fullsized":"2024-09-12T01:38:29.289058+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:29.288919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:29.288919+0000","last_clean_scrub_stamp":"2024-09-12T01:38:29.288919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:34.426132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"263'769","reported_seq":1516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:30.418763+0000","last_change":"2024-09-12T01:38:30.418704+0000","last_active":"2024-09-12T01:38:30.418763+0000","last_peered":"2024-09-12T01:38:30.418763+0000","last_clean":"2024-09-12T01:38:30.418763+0000","last_became_active":"2024-09-12T00:28:37.423755+0000","last_became_peered":"2024-09-12T00:28:37.423755+0000","last_unstale":"2024-09-12T01:38:30.418763+0000","last_undegraded":"2024-09-12T01:38:30.418763+0000","last_fullsized":"2024-09-12T01:38:30.418763+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'769","last_scrub_stamp":"2024-09-12T01:38:30.418598+0000","last_deep_scrub":"263'769","last_deep_scrub_stamp":"2024-09-12T01:38:30.418598+0000","last_clean_scrub_stamp":"2024-09-12T01:38:30.418598+0000","objects_scrubbed":9,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:21.805625+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138292,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1365,"num_read_kb":3277,"num_write":1104,"num_write_kb":888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.321099+0000","last_change":"2024-09-12T01:38:38.321038+0000","last_active":"2024-09-12T01:38:38.321099+0000","last_peered":"2024-09-12T01:38:38.321099+0000","last_clean":"2024-09-12T01:38:38.321099+0000","last_became_active":"2024-09-12T00:28:39.216237+0000","last_became_peered":"2024-09-12T00:28:39.216237+0000","last_unstale":"2024-09-12T01:38:38.321099+0000","last_undegraded":"2024-09-12T01:38:38.321099+0000","last_fullsized":"2024-09-12T01:38:38.321099+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:38.320945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:38.320945+0000","last_clean_scrub_stamp":"2024-09-12T01:38:38.320945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:09.757679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"263'85","reported_seq":586,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:45.510855+0000","last_change":"2024-09-12T01:38:45.510855+0000","last_active":"2024-09-12T01:38:45.510855+0000","last_peered":"2024-09-12T01:38:45.510855+0000","last_clean":"2024-09-12T01:38:45.510855+0000","last_became_active":"2024-09-12T00:28:41.233696+0000","last_became_peered":"2024-09-12T00:28:41.233696+0000","last_unstale":"2024-09-12T01:38:45.510855+0000","last_undegraded":"2024-09-12T01:38:45.510855+0000","last_fullsized":"2024-09-12T01:38:45.510855+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'85","last_scrub_stamp":"2024-09-12T01:38:45.510771+0000","last_deep_scrub":"263'85","last_deep_scrub_stamp":"2024-09-12T01:38:45.510771+0000","last_clean_scrub_stamp":"2024-09-12T01:38:45.510771+0000","objects_scrubbed":2,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:06.853210+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":84,"num_read_kb":82,"num_write":190,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"263'150","reported_seq":724,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:48.204992+0000","last_change":"2024-09-12T01:38:48.204992+0000","last_active":"2024-09-12T01:38:48.204992+0000","last_peered":"2024-09-12T01:38:48.204992+0000","last_clean":"2024-09-12T01:38:48.204992+0000","last_became_active":"2024-09-12T00:28:41.226143+0000","last_became_peered":"2024-09-12T00:28:41.226143+0000","last_unstale":"2024-09-12T01:38:48.204992+0000","last_undegraded":"2024-09-12T01:38:48.204992+0000","last_fullsized":"2024-09-12T01:38:48.204992+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'150","last_scrub_stamp":"2024-09-12T01:38:48.204910+0000","last_deep_scrub":"263'150","last_deep_scrub_stamp":"2024-09-12T01:38:48.204910+0000","last_clean_scrub_stamp":"2024-09-12T01:38:48.204910+0000","objects_scrubbed":1,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:50.979586+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":251,"num_read_kb":240,"num_write":350,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"263'64","reported_seq":629,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.544728+0000","last_change":"2024-09-12T01:38:14.544633+0000","last_active":"2024-09-12T01:38:14.544728+0000","last_peered":"2024-09-12T01:38:14.544728+0000","last_clean":"2024-09-12T01:38:14.544728+0000","last_became_active":"2024-09-12T00:28:33.209335+0000","last_became_peered":"2024-09-12T00:28:33.209335+0000","last_unstale":"2024-09-12T01:38:14.544728+0000","last_undegraded":"2024-09-12T01:38:14.544728+0000","last_fullsized":"2024-09-12T01:38:14.544728+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'64","last_scrub_stamp":"2024-09-12T01:38:14.544539+0000","last_deep_scrub":"263'64","last_deep_scrub_stamp":"2024-09-12T01:38:14.544539+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.544539+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:01.588201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":218,"num_write":93,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"263'395","reported_seq":1085,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.703531+0000","last_change":"2024-09-12T01:38:19.703424+0000","last_active":"2024-09-12T01:38:19.703531+0000","last_peered":"2024-09-12T01:38:19.703531+0000","last_clean":"2024-09-12T01:38:19.703531+0000","last_became_active":"2024-09-12T00:29:04.295676+0000","last_became_peered":"2024-09-12T00:29:04.295676+0000","last_unstale":"2024-09-12T01:38:19.703531+0000","last_undegraded":"2024-09-12T01:38:19.703531+0000","last_fullsized":"2024-09-12T01:38:19.703531+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'395","last_scrub_stamp":"2024-09-12T01:38:19.703172+0000","last_deep_scrub":"263'395","last_deep_scrub_stamp":"2024-09-12T01:38:19.703172+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.703172+0000","objects_scrubbed":8,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:41.744192+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2554787,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":757,"num_read_kb":17367,"num_write":1239,"num_write_kb":40068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":515,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.997410+0000","last_change":"2024-09-12T01:38:22.997345+0000","last_active":"2024-09-12T01:38:22.997410+0000","last_peered":"2024-09-12T01:38:22.997410+0000","last_clean":"2024-09-12T01:38:22.997410+0000","last_became_active":"2024-09-12T00:28:35.208165+0000","last_became_peered":"2024-09-12T00:28:35.208165+0000","last_unstale":"2024-09-12T01:38:22.997410+0000","last_undegraded":"2024-09-12T01:38:22.997410+0000","last_fullsized":"2024-09-12T01:38:22.997410+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:22.997265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:22.997265+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.997265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:37.750337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"263'303","reported_seq":904,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:34.305299+0000","last_change":"2024-09-12T01:38:34.305234+0000","last_active":"2024-09-12T01:38:34.305299+0000","last_peered":"2024-09-12T01:38:34.305299+0000","last_clean":"2024-09-12T01:38:34.305299+0000","last_became_active":"2024-09-12T00:28:37.217603+0000","last_became_peered":"2024-09-12T00:28:37.217603+0000","last_unstale":"2024-09-12T01:38:34.305299+0000","last_undegraded":"2024-09-12T01:38:34.305299+0000","last_fullsized":"2024-09-12T01:38:34.305299+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'303","last_scrub_stamp":"2024-09-12T01:38:34.305138+0000","last_deep_scrub":"263'303","last_deep_scrub_stamp":"2024-09-12T01:38:34.305138+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.305138+0000","objects_scrubbed":6,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:17.248810+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46508,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":487,"num_read_kb":1094,"num_write":390,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:40.294808+0000","last_change":"2024-09-12T01:38:40.294808+0000","last_active":"2024-09-12T01:38:40.294808+0000","last_peered":"2024-09-12T01:38:40.294808+0000","last_clean":"2024-09-12T01:38:40.294808+0000","last_became_active":"2024-09-12T00:28:39.216143+0000","last_became_peered":"2024-09-12T00:28:39.216143+0000","last_unstale":"2024-09-12T01:38:40.294808+0000","last_undegraded":"2024-09-12T01:38:40.294808+0000","last_fullsized":"2024-09-12T01:38:40.294808+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:40.294710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:40.294710+0000","last_clean_scrub_stamp":"2024-09-12T01:38:40.294710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:02.826767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"263'119","reported_seq":641,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:49.356012+0000","last_change":"2024-09-12T01:38:49.355949+0000","last_active":"2024-09-12T01:38:49.356012+0000","last_peered":"2024-09-12T01:38:49.356012+0000","last_clean":"2024-09-12T01:38:49.356012+0000","last_became_active":"2024-09-12T00:28:41.232114+0000","last_became_peered":"2024-09-12T00:28:41.232114+0000","last_unstale":"2024-09-12T01:38:49.356012+0000","last_undegraded":"2024-09-12T01:38:49.356012+0000","last_fullsized":"2024-09-12T01:38:49.356012+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'119","last_scrub_stamp":"2024-09-12T01:38:49.355848+0000","last_deep_scrub":"263'119","last_deep_scrub_stamp":"2024-09-12T01:38:49.355848+0000","last_clean_scrub_stamp":"2024-09-12T01:38:49.355848+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:40.862632+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":141,"num_write":283,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"263'347","reported_seq":1055,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:25.427281+0000","last_change":"2024-09-12T01:38:25.427221+0000","last_active":"2024-09-12T01:38:25.427281+0000","last_peered":"2024-09-12T01:38:25.427281+0000","last_clean":"2024-09-12T01:38:25.427281+0000","last_became_active":"2024-09-12T00:29:04.292302+0000","last_became_peered":"2024-09-12T00:29:04.292302+0000","last_unstale":"2024-09-12T01:38:25.427281+0000","last_undegraded":"2024-09-12T01:38:25.427281+0000","last_fullsized":"2024-09-12T01:38:25.427281+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'347","last_scrub_stamp":"2024-09-12T01:38:25.427133+0000","last_deep_scrub":"263'347","last_deep_scrub_stamp":"2024-09-12T01:38:25.427133+0000","last_clean_scrub_stamp":"2024-09-12T01:38:25.427133+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:54.656816+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1719,"num_read_kb":1484,"num_write":537,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25751,"num_omap_keys":101,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"263'396","reported_seq":1182,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.265923+0000","last_change":"2024-09-12T01:38:18.265866+0000","last_active":"2024-09-12T01:38:18.265923+0000","last_peered":"2024-09-12T01:38:18.265923+0000","last_clean":"2024-09-12T01:38:18.265923+0000","last_became_active":"2024-09-12T00:28:31.207765+0000","last_became_peered":"2024-09-12T00:28:31.207765+0000","last_unstale":"2024-09-12T01:38:18.265923+0000","last_undegraded":"2024-09-12T01:38:18.265923+0000","last_fullsized":"2024-09-12T01:38:18.265923+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'396","last_scrub_stamp":"2024-09-12T01:38:18.265737+0000","last_deep_scrub":"263'396","last_deep_scrub_stamp":"2024-09-12T01:38:18.265737+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.265737+0000","objects_scrubbed":10,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:42.523716+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2529502,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":736,"num_read_kb":9284,"num_write":1355,"num_write_kb":41598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":509,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:27.266641+0000","last_change":"2024-09-12T01:38:27.266554+0000","last_active":"2024-09-12T01:38:27.266641+0000","last_peered":"2024-09-12T01:38:27.266641+0000","last_clean":"2024-09-12T01:38:27.266641+0000","last_became_active":"2024-09-12T00:28:35.212243+0000","last_became_peered":"2024-09-12T00:28:35.212243+0000","last_unstale":"2024-09-12T01:38:27.266641+0000","last_undegraded":"2024-09-12T01:38:27.266641+0000","last_fullsized":"2024-09-12T01:38:27.266641+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:27.266464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:27.266464+0000","last_clean_scrub_stamp":"2024-09-12T01:38:27.266464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:57.767929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"263'60","reported_seq":577,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:29.129127+0000","last_change":"2024-09-12T01:38:29.129067+0000","last_active":"2024-09-12T01:38:29.129127+0000","last_peered":"2024-09-12T01:38:29.129127+0000","last_clean":"2024-09-12T01:38:29.129127+0000","last_became_active":"2024-09-12T00:28:37.219799+0000","last_became_peered":"2024-09-12T00:28:37.219799+0000","last_unstale":"2024-09-12T01:38:29.129127+0000","last_undegraded":"2024-09-12T01:38:29.129127+0000","last_fullsized":"2024-09-12T01:38:29.129127+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'60","last_scrub_stamp":"2024-09-12T01:38:29.128986+0000","last_deep_scrub":"263'60","last_deep_scrub_stamp":"2024-09-12T01:38:29.128986+0000","last_clean_scrub_stamp":"2024-09-12T01:38:29.128986+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:06.769387+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":42,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.506950+0000","last_change":"2024-09-12T01:38:37.506869+0000","last_active":"2024-09-12T01:38:37.506950+0000","last_peered":"2024-09-12T01:38:37.506950+0000","last_clean":"2024-09-12T01:38:37.506950+0000","last_became_active":"2024-09-12T00:28:39.219209+0000","last_became_peered":"2024-09-12T00:28:39.219209+0000","last_unstale":"2024-09-12T01:38:37.506950+0000","last_undegraded":"2024-09-12T01:38:37.506950+0000","last_fullsized":"2024-09-12T01:38:37.506950+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:37.506759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:37.506759+0000","last_clean_scrub_stamp":"2024-09-12T01:38:37.506759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:54.149913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"263'213","reported_seq":750,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:45.217297+0000","last_change":"2024-09-12T01:38:45.217297+0000","last_active":"2024-09-12T01:38:45.217297+0000","last_peered":"2024-09-12T01:38:45.217297+0000","last_clean":"2024-09-12T01:38:45.217297+0000","last_became_active":"2024-09-12T00:28:41.225673+0000","last_became_peered":"2024-09-12T00:28:41.225673+0000","last_unstale":"2024-09-12T01:38:45.217297+0000","last_undegraded":"2024-09-12T01:38:45.217297+0000","last_fullsized":"2024-09-12T01:38:45.217297+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'213","last_scrub_stamp":"2024-09-12T01:38:45.217201+0000","last_deep_scrub":"263'213","last_deep_scrub_stamp":"2024-09-12T01:38:45.217201+0000","last_clean_scrub_stamp":"2024-09-12T01:38:45.217201+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:59.307017+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":332,"num_read_kb":318,"num_write":482,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"263'71","reported_seq":702,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.187420+0000","last_change":"2024-09-12T01:38:15.187360+0000","last_active":"2024-09-12T01:38:15.187420+0000","last_peered":"2024-09-12T01:38:15.187420+0000","last_clean":"2024-09-12T01:38:15.187420+0000","last_became_active":"2024-09-12T00:28:33.213777+0000","last_became_peered":"2024-09-12T00:28:33.213777+0000","last_unstale":"2024-09-12T01:38:15.187420+0000","last_undegraded":"2024-09-12T01:38:15.187420+0000","last_fullsized":"2024-09-12T01:38:15.187420+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'71","last_scrub_stamp":"2024-09-12T01:38:15.187273+0000","last_deep_scrub":"263'71","last_deep_scrub_stamp":"2024-09-12T01:38:15.187273+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.187273+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:48.489235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":365,"num_read_kb":325,"num_write":89,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"263'346","reported_seq":982,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.342611+0000","last_change":"2024-09-12T01:38:13.342517+0000","last_active":"2024-09-12T01:38:13.342611+0000","last_peered":"2024-09-12T01:38:13.342611+0000","last_clean":"2024-09-12T01:38:13.342611+0000","last_became_active":"2024-09-12T00:28:31.213567+0000","last_became_peered":"2024-09-12T00:28:31.213567+0000","last_unstale":"2024-09-12T01:38:13.342611+0000","last_undegraded":"2024-09-12T01:38:13.342611+0000","last_fullsized":"2024-09-12T01:38:13.342611+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'346","last_scrub_stamp":"2024-09-12T01:38:13.342398+0000","last_deep_scrub":"263'346","last_deep_scrub_stamp":"2024-09-12T01:38:13.342398+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.342398+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:37.312677+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262191,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":463,"num_read_kb":31334,"num_write":999,"num_write_kb":46181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:29.444200+0000","last_change":"2024-09-12T01:38:29.444149+0000","last_active":"2024-09-12T01:38:29.444200+0000","last_peered":"2024-09-12T01:38:29.444200+0000","last_clean":"2024-09-12T01:38:29.444200+0000","last_became_active":"2024-09-12T00:28:35.210000+0000","last_became_peered":"2024-09-12T00:28:35.210000+0000","last_unstale":"2024-09-12T01:38:29.444200+0000","last_undegraded":"2024-09-12T01:38:29.444200+0000","last_fullsized":"2024-09-12T01:38:29.444200+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:29.444059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:29.444059+0000","last_clean_scrub_stamp":"2024-09-12T01:38:29.444059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:37.703935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"263'340","reported_seq":951,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.300458+0000","last_change":"2024-09-12T01:38:35.300395+0000","last_active":"2024-09-12T01:38:35.300458+0000","last_peered":"2024-09-12T01:38:35.300458+0000","last_clean":"2024-09-12T01:38:35.300458+0000","last_became_active":"2024-09-12T00:28:37.222678+0000","last_became_peered":"2024-09-12T00:28:37.222678+0000","last_unstale":"2024-09-12T01:38:35.300458+0000","last_undegraded":"2024-09-12T01:38:35.300458+0000","last_fullsized":"2024-09-12T01:38:35.300458+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'340","last_scrub_stamp":"2024-09-12T01:38:35.300287+0000","last_deep_scrub":"263'340","last_deep_scrub_stamp":"2024-09-12T01:38:35.300287+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.300287+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:15.500767+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45149,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":551,"num_read_kb":1230,"num_write":438,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:27.205149+0000","last_change":"2024-09-12T01:38:27.205089+0000","last_active":"2024-09-12T01:38:27.205149+0000","last_peered":"2024-09-12T01:38:27.205149+0000","last_clean":"2024-09-12T01:38:27.205149+0000","last_became_active":"2024-09-12T00:28:39.216200+0000","last_became_peered":"2024-09-12T00:28:39.216200+0000","last_unstale":"2024-09-12T01:38:27.205149+0000","last_undegraded":"2024-09-12T01:38:27.205149+0000","last_fullsized":"2024-09-12T01:38:27.205149+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:27.204991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:27.204991+0000","last_clean_scrub_stamp":"2024-09-12T01:38:27.204991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:51.772559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"263'114","reported_seq":637,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:47.459776+0000","last_change":"2024-09-12T01:38:47.459776+0000","last_active":"2024-09-12T01:38:47.459776+0000","last_peered":"2024-09-12T01:38:47.459776+0000","last_clean":"2024-09-12T01:38:47.459776+0000","last_became_active":"2024-09-12T00:28:41.232381+0000","last_became_peered":"2024-09-12T00:28:41.232381+0000","last_unstale":"2024-09-12T01:38:47.459776+0000","last_undegraded":"2024-09-12T01:38:47.459776+0000","last_fullsized":"2024-09-12T01:38:47.459776+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'114","last_scrub_stamp":"2024-09-12T01:38:47.459665+0000","last_deep_scrub":"263'114","last_deep_scrub_stamp":"2024-09-12T01:38:47.459665+0000","last_clean_scrub_stamp":"2024-09-12T01:38:47.459665+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:38.656502+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":176,"num_read_kb":166,"num_write":281,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"263'153","reported_seq":754,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:28.299416+0000","last_change":"2024-09-12T01:38:28.299358+0000","last_active":"2024-09-12T01:38:28.299416+0000","last_peered":"2024-09-12T01:38:28.299416+0000","last_clean":"2024-09-12T01:38:28.299416+0000","last_became_active":"2024-09-12T00:28:33.211165+0000","last_became_peered":"2024-09-12T00:28:33.211165+0000","last_unstale":"2024-09-12T01:38:28.299416+0000","last_undegraded":"2024-09-12T01:38:28.299416+0000","last_fullsized":"2024-09-12T01:38:28.299416+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'153","last_scrub_stamp":"2024-09-12T01:38:28.299270+0000","last_deep_scrub":"263'153","last_deep_scrub_stamp":"2024-09-12T01:38:28.299270+0000","last_clean_scrub_stamp":"2024-09-12T01:38:28.299270+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:32.733250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":668,"num_read_kb":545,"num_write":223,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"263'340","reported_seq":978,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.047653+0000","last_change":"2024-09-12T01:38:10.047601+0000","last_active":"2024-09-12T01:38:10.047653+0000","last_peered":"2024-09-12T01:38:10.047653+0000","last_clean":"2024-09-12T01:38:10.047653+0000","last_became_active":"2024-09-12T00:28:31.213971+0000","last_became_peered":"2024-09-12T00:28:31.213971+0000","last_unstale":"2024-09-12T01:38:10.047653+0000","last_undegraded":"2024-09-12T01:38:10.047653+0000","last_fullsized":"2024-09-12T01:38:10.047653+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'340","last_scrub_stamp":"2024-09-12T01:38:10.047526+0000","last_deep_scrub":"263'340","last_deep_scrub_stamp":"2024-09-12T01:38:10.047526+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.047526+0000","objects_scrubbed":8,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:30.027467+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340133,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":428,"num_read_kb":61436,"num_write":986,"num_write_kb":69756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:23.136547+0000","last_change":"2024-09-12T01:38:23.136434+0000","last_active":"2024-09-12T01:38:23.136547+0000","last_peered":"2024-09-12T01:38:23.136547+0000","last_clean":"2024-09-12T01:38:23.136547+0000","last_became_active":"2024-09-12T00:28:35.210060+0000","last_became_peered":"2024-09-12T00:28:35.210060+0000","last_unstale":"2024-09-12T01:38:23.136547+0000","last_undegraded":"2024-09-12T01:38:23.136547+0000","last_fullsized":"2024-09-12T01:38:23.136547+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:23.136334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:23.136334+0000","last_clean_scrub_stamp":"2024-09-12T01:38:23.136334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:03.715995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"263'301","reported_seq":884,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.448009+0000","last_change":"2024-09-12T01:38:35.447953+0000","last_active":"2024-09-12T01:38:35.448009+0000","last_peered":"2024-09-12T01:38:35.448009+0000","last_clean":"2024-09-12T01:38:35.448009+0000","last_became_active":"2024-09-12T00:28:37.221491+0000","last_became_peered":"2024-09-12T00:28:37.221491+0000","last_unstale":"2024-09-12T01:38:35.448009+0000","last_undegraded":"2024-09-12T01:38:35.448009+0000","last_fullsized":"2024-09-12T01:38:35.448009+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'301","last_scrub_stamp":"2024-09-12T01:38:35.447807+0000","last_deep_scrub":"263'301","last_deep_scrub_stamp":"2024-09-12T01:38:35.447807+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.447807+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:30.403825+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49002,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":484,"num_read_kb":1163,"num_write":396,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:39.202809+0000","last_change":"2024-09-12T01:38:39.202712+0000","last_active":"2024-09-12T01:38:39.202809+0000","last_peered":"2024-09-12T01:38:39.202809+0000","last_clean":"2024-09-12T01:38:39.202809+0000","last_became_active":"2024-09-12T00:28:39.219004+0000","last_became_peered":"2024-09-12T00:28:39.219004+0000","last_unstale":"2024-09-12T01:38:39.202809+0000","last_undegraded":"2024-09-12T01:38:39.202809+0000","last_fullsized":"2024-09-12T01:38:39.202809+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:39.202617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:39.202617+0000","last_clean_scrub_stamp":"2024-09-12T01:38:39.202617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:51.637674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"263'478","reported_seq":1271,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.216910+0000","last_change":"2024-09-12T01:38:19.216852+0000","last_active":"2024-09-12T01:38:19.216910+0000","last_peered":"2024-09-12T01:38:19.216910+0000","last_clean":"2024-09-12T01:38:19.216910+0000","last_became_active":"2024-09-12T00:28:33.216610+0000","last_became_peered":"2024-09-12T00:28:33.216610+0000","last_unstale":"2024-09-12T01:38:19.216910+0000","last_undegraded":"2024-09-12T01:38:19.216910+0000","last_fullsized":"2024-09-12T01:38:19.216910+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'478","last_scrub_stamp":"2024-09-12T01:38:19.216770+0000","last_deep_scrub":"263'478","last_deep_scrub_stamp":"2024-09-12T01:38:19.216770+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.216770+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:55.208285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2349,"num_read_kb":2016,"num_write":868,"num_write_kb":562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"263'340","reported_seq":980,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.239903+0000","last_change":"2024-09-12T01:38:13.239832+0000","last_active":"2024-09-12T01:38:13.239903+0000","last_peered":"2024-09-12T01:38:13.239903+0000","last_clean":"2024-09-12T01:38:13.239903+0000","last_became_active":"2024-09-12T00:28:31.207770+0000","last_became_peered":"2024-09-12T00:28:31.207770+0000","last_unstale":"2024-09-12T01:38:13.239903+0000","last_undegraded":"2024-09-12T01:38:13.239903+0000","last_fullsized":"2024-09-12T01:38:13.239903+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'340","last_scrub_stamp":"2024-09-12T01:38:13.239742+0000","last_deep_scrub":"263'340","last_deep_scrub_stamp":"2024-09-12T01:38:13.239742+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.239742+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:09.782387+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":467,"num_read_kb":17286,"num_write":965,"num_write_kb":20034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":512,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:23.160041+0000","last_change":"2024-09-12T01:38:23.159987+0000","last_active":"2024-09-12T01:38:23.160041+0000","last_peered":"2024-09-12T01:38:23.160041+0000","last_clean":"2024-09-12T01:38:23.160041+0000","last_became_active":"2024-09-12T00:28:35.208868+0000","last_became_peered":"2024-09-12T00:28:35.208868+0000","last_unstale":"2024-09-12T01:38:23.160041+0000","last_undegraded":"2024-09-12T01:38:23.160041+0000","last_fullsized":"2024-09-12T01:38:23.160041+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:23.159891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:23.159891+0000","last_clean_scrub_stamp":"2024-09-12T01:38:23.159891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:23.643595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"263'534","reported_seq":1195,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:26.001515+0000","last_change":"2024-09-12T01:38:26.001437+0000","last_active":"2024-09-12T01:38:26.001515+0000","last_peered":"2024-09-12T01:38:26.001515+0000","last_clean":"2024-09-12T01:38:26.001515+0000","last_became_active":"2024-09-12T00:28:37.210514+0000","last_became_peered":"2024-09-12T00:28:37.210514+0000","last_unstale":"2024-09-12T01:38:26.001515+0000","last_undegraded":"2024-09-12T01:38:26.001515+0000","last_fullsized":"2024-09-12T01:38:26.001515+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'534","last_scrub_stamp":"2024-09-12T01:38:26.001311+0000","last_deep_scrub":"263'534","last_deep_scrub_stamp":"2024-09-12T01:38:26.001311+0000","last_clean_scrub_stamp":"2024-09-12T01:38:26.001311+0000","objects_scrubbed":7,"log_size":34,"log_dups_size":500,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:10.115691+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94945,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":919,"num_read_kb":2214,"num_write":790,"num_write_kb":678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:40.437969+0000","last_change":"2024-09-12T01:38:40.437919+0000","last_active":"2024-09-12T01:38:40.437969+0000","last_peered":"2024-09-12T01:38:40.437969+0000","last_clean":"2024-09-12T01:38:40.437969+0000","last_became_active":"2024-09-12T00:28:39.219808+0000","last_became_peered":"2024-09-12T00:28:39.219808+0000","last_unstale":"2024-09-12T01:38:40.437969+0000","last_undegraded":"2024-09-12T01:38:40.437969+0000","last_fullsized":"2024-09-12T01:38:40.437969+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:40.437833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:40.437833+0000","last_clean_scrub_stamp":"2024-09-12T01:38:40.437833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:03.038216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"263'229","reported_seq":806,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:47.316643+0000","last_change":"2024-09-12T01:38:47.316643+0000","last_active":"2024-09-12T01:38:47.316643+0000","last_peered":"2024-09-12T01:38:47.316643+0000","last_clean":"2024-09-12T01:38:47.316643+0000","last_became_active":"2024-09-12T00:28:41.257639+0000","last_became_peered":"2024-09-12T00:28:41.257639+0000","last_unstale":"2024-09-12T01:38:47.316643+0000","last_undegraded":"2024-09-12T01:38:47.316643+0000","last_fullsized":"2024-09-12T01:38:47.316643+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'229","last_scrub_stamp":"2024-09-12T01:38:47.316555+0000","last_deep_scrub":"263'229","last_deep_scrub_stamp":"2024-09-12T01:38:47.316555+0000","last_clean_scrub_stamp":"2024-09-12T01:38:47.316555+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:30.257573+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":674,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":491,"num_read_kb":439,"num_write":521,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"263'158","reported_seq":758,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.116264+0000","last_change":"2024-09-12T01:38:17.116170+0000","last_active":"2024-09-12T01:38:17.116264+0000","last_peered":"2024-09-12T01:38:17.116264+0000","last_clean":"2024-09-12T01:38:17.116264+0000","last_became_active":"2024-09-12T00:28:33.215105+0000","last_became_peered":"2024-09-12T00:28:33.215105+0000","last_unstale":"2024-09-12T01:38:17.116264+0000","last_undegraded":"2024-09-12T01:38:17.116264+0000","last_fullsized":"2024-09-12T01:38:17.116264+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'158","last_scrub_stamp":"2024-09-12T01:38:17.116093+0000","last_deep_scrub":"263'158","last_deep_scrub_stamp":"2024-09-12T01:38:17.116093+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.116093+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:18.349339+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":692,"num_read_kb":572,"num_write":247,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"263'397","reported_seq":1061,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.210269+0000","last_change":"2024-09-12T01:38:12.210181+0000","last_active":"2024-09-12T01:38:12.210269+0000","last_peered":"2024-09-12T01:38:12.210269+0000","last_clean":"2024-09-12T01:38:12.210269+0000","last_became_active":"2024-09-12T00:28:31.206562+0000","last_became_peered":"2024-09-12T00:28:31.206562+0000","last_unstale":"2024-09-12T01:38:12.210269+0000","last_undegraded":"2024-09-12T01:38:12.210269+0000","last_fullsized":"2024-09-12T01:38:12.210269+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'397","last_scrub_stamp":"2024-09-12T01:38:12.210028+0000","last_deep_scrub":"263'397","last_deep_scrub_stamp":"2024-09-12T01:38:12.210028+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.210028+0000","objects_scrubbed":8,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:00.125891+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395844,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":545,"num_read_kb":3743,"num_write":1252,"num_write_kb":48925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:24.152550+0000","last_change":"2024-09-12T01:38:24.152454+0000","last_active":"2024-09-12T01:38:24.152550+0000","last_peered":"2024-09-12T01:38:24.152550+0000","last_clean":"2024-09-12T01:38:24.152550+0000","last_became_active":"2024-09-12T00:28:35.210046+0000","last_became_peered":"2024-09-12T00:28:35.210046+0000","last_unstale":"2024-09-12T01:38:24.152550+0000","last_undegraded":"2024-09-12T01:38:24.152550+0000","last_fullsized":"2024-09-12T01:38:24.152550+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:24.152344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:24.152344+0000","last_clean_scrub_stamp":"2024-09-12T01:38:24.152344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:00.292881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"263'338","reported_seq":940,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:36.464792+0000","last_change":"2024-09-12T01:38:36.464730+0000","last_active":"2024-09-12T01:38:36.464792+0000","last_peered":"2024-09-12T01:38:36.464792+0000","last_clean":"2024-09-12T01:38:36.464792+0000","last_became_active":"2024-09-12T00:28:37.212236+0000","last_became_peered":"2024-09-12T00:28:37.212236+0000","last_unstale":"2024-09-12T01:38:36.464792+0000","last_undegraded":"2024-09-12T01:38:36.464792+0000","last_fullsized":"2024-09-12T01:38:36.464792+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'338","last_scrub_stamp":"2024-09-12T01:38:36.464628+0000","last_deep_scrub":"263'338","last_deep_scrub_stamp":"2024-09-12T01:38:36.464628+0000","last_clean_scrub_stamp":"2024-09-12T01:38:36.464628+0000","objects_scrubbed":8,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:26.375761+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49414,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":546,"num_read_kb":1160,"num_write":454,"num_write_kb":329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:31.002339+0000","last_change":"2024-09-12T01:38:31.002272+0000","last_active":"2024-09-12T01:38:31.002339+0000","last_peered":"2024-09-12T01:38:31.002339+0000","last_clean":"2024-09-12T01:38:31.002339+0000","last_became_active":"2024-09-12T00:28:39.217947+0000","last_became_peered":"2024-09-12T00:28:39.217947+0000","last_unstale":"2024-09-12T01:38:31.002339+0000","last_undegraded":"2024-09-12T01:38:31.002339+0000","last_fullsized":"2024-09-12T01:38:31.002339+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:31.002169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:31.002169+0000","last_clean_scrub_stamp":"2024-09-12T01:38:31.002169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:14.472899+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"263'225","reported_seq":1105,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:33.106320+0000","last_change":"2024-09-12T01:38:33.106231+0000","last_active":"2024-09-12T01:38:33.106320+0000","last_peered":"2024-09-12T01:38:33.106320+0000","last_clean":"2024-09-12T01:38:33.106320+0000","last_became_active":"2024-09-12T00:28:41.232347+0000","last_became_peered":"2024-09-12T00:28:41.232347+0000","last_unstale":"2024-09-12T01:38:33.106320+0000","last_undegraded":"2024-09-12T01:38:33.106320+0000","last_fullsized":"2024-09-12T01:38:33.106320+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'225","last_scrub_stamp":"2024-09-12T01:38:33.106123+0000","last_deep_scrub":"263'225","last_deep_scrub_stamp":"2024-09-12T01:38:33.106123+0000","last_clean_scrub_stamp":"2024-09-12T01:38:33.106123+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:04.636946+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":645,"num_read_kb":635,"num_write":602,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"263'73","reported_seq":637,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.239390+0000","last_change":"2024-09-12T01:38:22.239336+0000","last_active":"2024-09-12T01:38:22.239390+0000","last_peered":"2024-09-12T01:38:22.239390+0000","last_clean":"2024-09-12T01:38:22.239390+0000","last_became_active":"2024-09-12T00:28:33.207968+0000","last_became_peered":"2024-09-12T00:28:33.207968+0000","last_unstale":"2024-09-12T01:38:22.239390+0000","last_undegraded":"2024-09-12T01:38:22.239390+0000","last_fullsized":"2024-09-12T01:38:22.239390+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'73","last_scrub_stamp":"2024-09-12T01:38:22.239257+0000","last_deep_scrub":"263'73","last_deep_scrub_stamp":"2024-09-12T01:38:22.239257+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.239257+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:04.297452+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":308,"num_read_kb":254,"num_write":109,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":719,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"263'300","reported_seq":935,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:09.492350+0000","last_change":"2024-09-12T01:38:09.492289+0000","last_active":"2024-09-12T01:38:09.492350+0000","last_peered":"2024-09-12T01:38:09.492350+0000","last_clean":"2024-09-12T01:38:09.492350+0000","last_became_active":"2024-09-12T00:28:31.195038+0000","last_became_peered":"2024-09-12T00:28:31.195038+0000","last_unstale":"2024-09-12T01:38:09.492350+0000","last_undegraded":"2024-09-12T01:38:09.492350+0000","last_fullsized":"2024-09-12T01:38:09.492350+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'300","last_scrub_stamp":"2024-09-12T01:38:09.492194+0000","last_deep_scrub":"263'300","last_deep_scrub_stamp":"2024-09-12T01:38:09.492194+0000","last_clean_scrub_stamp":"2024-09-12T01:38:09.492194+0000","objects_scrubbed":5,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:50.184186+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262176,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":426,"num_read_kb":13574,"num_write":965,"num_write_kb":34116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:30.500766+0000","last_change":"2024-09-12T01:38:30.500642+0000","last_active":"2024-09-12T01:38:30.500766+0000","last_peered":"2024-09-12T01:38:30.500766+0000","last_clean":"2024-09-12T01:38:30.500766+0000","last_became_active":"2024-09-12T00:28:35.215576+0000","last_became_peered":"2024-09-12T00:28:35.215576+0000","last_unstale":"2024-09-12T01:38:30.500766+0000","last_undegraded":"2024-09-12T01:38:30.500766+0000","last_fullsized":"2024-09-12T01:38:30.500766+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:30.500549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:30.500549+0000","last_clean_scrub_stamp":"2024-09-12T01:38:30.500549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:03.116000+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"263'294","reported_seq":899,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:36.315592+0000","last_change":"2024-09-12T01:38:36.315532+0000","last_active":"2024-09-12T01:38:36.315592+0000","last_peered":"2024-09-12T01:38:36.315592+0000","last_clean":"2024-09-12T01:38:36.315592+0000","last_became_active":"2024-09-12T00:28:37.423835+0000","last_became_peered":"2024-09-12T00:28:37.423835+0000","last_unstale":"2024-09-12T01:38:36.315592+0000","last_undegraded":"2024-09-12T01:38:36.315592+0000","last_fullsized":"2024-09-12T01:38:36.315592+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'294","last_scrub_stamp":"2024-09-12T01:38:36.315428+0000","last_deep_scrub":"263'294","last_deep_scrub_stamp":"2024-09-12T01:38:36.315428+0000","last_clean_scrub_stamp":"2024-09-12T01:38:36.315428+0000","objects_scrubbed":6,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:06.591255+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48887,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":486,"num_read_kb":1104,"num_write":386,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":512,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:30.001456+0000","last_change":"2024-09-12T01:38:30.001403+0000","last_active":"2024-09-12T01:38:30.001456+0000","last_peered":"2024-09-12T01:38:30.001456+0000","last_clean":"2024-09-12T01:38:30.001456+0000","last_became_active":"2024-09-12T00:28:39.219541+0000","last_became_peered":"2024-09-12T00:28:39.219541+0000","last_unstale":"2024-09-12T01:38:30.001456+0000","last_undegraded":"2024-09-12T01:38:30.001456+0000","last_fullsized":"2024-09-12T01:38:30.001456+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:30.001320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:30.001320+0000","last_clean_scrub_stamp":"2024-09-12T01:38:30.001320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:08.445496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"263'117","reported_seq":611,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:44.504853+0000","last_change":"2024-09-12T01:38:44.504853+0000","last_active":"2024-09-12T01:38:44.504853+0000","last_peered":"2024-09-12T01:38:44.504853+0000","last_clean":"2024-09-12T01:38:44.504853+0000","last_became_active":"2024-09-12T00:28:41.232305+0000","last_became_peered":"2024-09-12T00:28:41.232305+0000","last_unstale":"2024-09-12T01:38:44.504853+0000","last_undegraded":"2024-09-12T01:38:44.504853+0000","last_fullsized":"2024-09-12T01:38:44.504853+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'117","last_scrub_stamp":"2024-09-12T01:38:44.504746+0000","last_deep_scrub":"263'117","last_deep_scrub_stamp":"2024-09-12T01:38:44.504746+0000","last_clean_scrub_stamp":"2024-09-12T01:38:44.504746+0000","objects_scrubbed":3,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:36.489816+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":90,"num_read_kb":88,"num_write":260,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"263'145","reported_seq":720,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.772748+0000","last_change":"2024-09-12T01:38:21.772678+0000","last_active":"2024-09-12T01:38:21.772748+0000","last_peered":"2024-09-12T01:38:21.772748+0000","last_clean":"2024-09-12T01:38:21.772748+0000","last_became_active":"2024-09-12T00:28:33.213905+0000","last_became_peered":"2024-09-12T00:28:33.213905+0000","last_unstale":"2024-09-12T01:38:21.772748+0000","last_undegraded":"2024-09-12T01:38:21.772748+0000","last_fullsized":"2024-09-12T01:38:21.772748+0000","mapping_epoch":27,"log_start":"260'100","ondisk_log_start":"260'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'145","last_scrub_stamp":"2024-09-12T01:38:21.772587+0000","last_deep_scrub":"263'145","last_deep_scrub_stamp":"2024-09-12T01:38:21.772587+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.772587+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:23.017228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":580,"num_read_kb":470,"num_write":232,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"263'313","reported_seq":1016,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.157918+0000","last_change":"2024-09-12T01:38:18.157817+0000","last_active":"2024-09-12T01:38:18.157918+0000","last_peered":"2024-09-12T01:38:18.157918+0000","last_clean":"2024-09-12T01:38:18.157918+0000","last_became_active":"2024-09-12T00:28:31.203417+0000","last_became_peered":"2024-09-12T00:28:31.203417+0000","last_unstale":"2024-09-12T01:38:18.157918+0000","last_undegraded":"2024-09-12T01:38:18.157918+0000","last_fullsized":"2024-09-12T01:38:18.157918+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'313","last_scrub_stamp":"2024-09-12T01:38:18.157702+0000","last_deep_scrub":"263'313","last_deep_scrub_stamp":"2024-09-12T01:38:18.157702+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.157702+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:59.863289+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262193,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":643,"num_read_kb":683,"num_write":1258,"num_write_kb":6456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:24.997799+0000","last_change":"2024-09-12T01:38:24.997695+0000","last_active":"2024-09-12T01:38:24.997799+0000","last_peered":"2024-09-12T01:38:24.997799+0000","last_clean":"2024-09-12T01:38:24.997799+0000","last_became_active":"2024-09-12T00:28:35.207992+0000","last_became_peered":"2024-09-12T00:28:35.207992+0000","last_unstale":"2024-09-12T01:38:24.997799+0000","last_undegraded":"2024-09-12T01:38:24.997799+0000","last_fullsized":"2024-09-12T01:38:24.997799+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:24.997615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:24.997615+0000","last_clean_scrub_stamp":"2024-09-12T01:38:24.997615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:15.702126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"263'113","reported_seq":664,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:36.568919+0000","last_change":"2024-09-12T01:38:36.568861+0000","last_active":"2024-09-12T01:38:36.568919+0000","last_peered":"2024-09-12T01:38:36.568919+0000","last_clean":"2024-09-12T01:38:36.568919+0000","last_became_active":"2024-09-12T00:28:37.423765+0000","last_became_peered":"2024-09-12T00:28:37.423765+0000","last_unstale":"2024-09-12T01:38:36.568919+0000","last_undegraded":"2024-09-12T01:38:36.568919+0000","last_fullsized":"2024-09-12T01:38:36.568919+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'113","last_scrub_stamp":"2024-09-12T01:38:36.568765+0000","last_deep_scrub":"263'113","last_deep_scrub_stamp":"2024-09-12T01:38:36.568765+0000","last_clean_scrub_stamp":"2024-09-12T01:38:36.568765+0000","objects_scrubbed":8,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:59.133727+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":155,"num_read_kb":148,"num_write":156,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"263'761","reported_seq":2436,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:29.172033+0000","last_change":"2024-09-12T01:38:29.172033+0000","last_active":"2024-09-12T01:38:29.172033+0000","last_peered":"2024-09-12T01:38:29.172033+0000","last_clean":"2024-09-12T01:38:29.172033+0000","last_became_active":"2024-09-12T00:28:39.216704+0000","last_became_peered":"2024-09-12T00:28:39.216704+0000","last_unstale":"2024-09-12T01:38:29.172033+0000","last_undegraded":"2024-09-12T01:38:29.172033+0000","last_fullsized":"2024-09-12T01:38:29.172033+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'761","last_scrub_stamp":"2024-09-12T01:38:29.171921+0000","last_deep_scrub":"263'761","last_deep_scrub_stamp":"2024-09-12T01:38:29.171921+0000","last_clean_scrub_stamp":"2024-09-12T01:38:29.171921+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:55.063995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"263'158","reported_seq":665,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:41.543232+0000","last_change":"2024-09-12T01:38:41.543158+0000","last_active":"2024-09-12T01:38:41.543232+0000","last_peered":"2024-09-12T01:38:41.543232+0000","last_clean":"2024-09-12T01:38:41.543232+0000","last_became_active":"2024-09-12T00:28:41.227892+0000","last_became_peered":"2024-09-12T00:28:41.227892+0000","last_unstale":"2024-09-12T01:38:41.543232+0000","last_undegraded":"2024-09-12T01:38:41.543232+0000","last_fullsized":"2024-09-12T01:38:41.543232+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'158","last_scrub_stamp":"2024-09-12T01:38:41.543080+0000","last_deep_scrub":"263'158","last_deep_scrub_stamp":"2024-09-12T01:38:41.543080+0000","last_clean_scrub_stamp":"2024-09-12T01:38:41.543080+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:33.584634+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":160,"num_read_kb":153,"num_write":389,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"263'138","reported_seq":726,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.484957+0000","last_change":"2024-09-12T01:38:19.484876+0000","last_active":"2024-09-12T01:38:19.484957+0000","last_peered":"2024-09-12T01:38:19.484957+0000","last_clean":"2024-09-12T01:38:19.484957+0000","last_became_active":"2024-09-12T00:28:33.204722+0000","last_became_peered":"2024-09-12T00:28:33.204722+0000","last_unstale":"2024-09-12T01:38:19.484957+0000","last_undegraded":"2024-09-12T01:38:19.484957+0000","last_fullsized":"2024-09-12T01:38:19.484957+0000","mapping_epoch":27,"log_start":"260'100","ondisk_log_start":"260'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'138","last_scrub_stamp":"2024-09-12T01:38:19.484796+0000","last_deep_scrub":"263'138","last_deep_scrub_stamp":"2024-09-12T01:38:19.484796+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.484796+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:49.740120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":575,"num_read_kb":467,"num_write":204,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"263'333","reported_seq":1060,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.360468+0000","last_change":"2024-09-12T01:38:15.360411+0000","last_active":"2024-09-12T01:38:15.360468+0000","last_peered":"2024-09-12T01:38:15.360468+0000","last_clean":"2024-09-12T01:38:15.360468+0000","last_became_active":"2024-09-12T00:28:31.212597+0000","last_became_peered":"2024-09-12T00:28:31.212597+0000","last_unstale":"2024-09-12T01:38:15.360468+0000","last_undegraded":"2024-09-12T01:38:15.360468+0000","last_fullsized":"2024-09-12T01:38:15.360468+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'333","last_scrub_stamp":"2024-09-12T01:38:15.360299+0000","last_deep_scrub":"263'333","last_deep_scrub_stamp":"2024-09-12T01:38:15.360299+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.360299+0000","objects_scrubbed":8,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:04.968900+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":273370,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":704,"num_read_kb":2179,"num_write":1113,"num_write_kb":612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:31.368857+0000","last_change":"2024-09-12T01:38:31.368762+0000","last_active":"2024-09-12T01:38:31.368857+0000","last_peered":"2024-09-12T01:38:31.368857+0000","last_clean":"2024-09-12T01:38:31.368857+0000","last_became_active":"2024-09-12T00:28:35.210710+0000","last_became_peered":"2024-09-12T00:28:35.210710+0000","last_unstale":"2024-09-12T01:38:31.368857+0000","last_undegraded":"2024-09-12T01:38:31.368857+0000","last_fullsized":"2024-09-12T01:38:31.368857+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:31.368656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:31.368656+0000","last_clean_scrub_stamp":"2024-09-12T01:38:31.368656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:16.021928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"263'398","reported_seq":1024,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.460744+0000","last_change":"2024-09-12T01:38:38.460680+0000","last_active":"2024-09-12T01:38:38.460744+0000","last_peered":"2024-09-12T01:38:38.460744+0000","last_clean":"2024-09-12T01:38:38.460744+0000","last_became_active":"2024-09-12T00:28:37.210317+0000","last_became_peered":"2024-09-12T00:28:37.210317+0000","last_unstale":"2024-09-12T01:38:38.460744+0000","last_undegraded":"2024-09-12T01:38:38.460744+0000","last_fullsized":"2024-09-12T01:38:38.460744+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'398","last_scrub_stamp":"2024-09-12T01:38:38.460579+0000","last_deep_scrub":"263'398","last_deep_scrub_stamp":"2024-09-12T01:38:38.460579+0000","last_clean_scrub_stamp":"2024-09-12T01:38:38.460579+0000","objects_scrubbed":11,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:30.726197+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56512,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":649,"num_read_kb":1465,"num_write":528,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.223854+0000","last_change":"2024-09-12T01:38:38.223786+0000","last_active":"2024-09-12T01:38:38.223854+0000","last_peered":"2024-09-12T01:38:38.223854+0000","last_clean":"2024-09-12T01:38:38.223854+0000","last_became_active":"2024-09-12T00:28:39.218026+0000","last_became_peered":"2024-09-12T00:28:39.218026+0000","last_unstale":"2024-09-12T01:38:38.223854+0000","last_undegraded":"2024-09-12T01:38:38.223854+0000","last_fullsized":"2024-09-12T01:38:38.223854+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:38.223690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:38.223690+0000","last_clean_scrub_stamp":"2024-09-12T01:38:38.223690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:28.393080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"263'136","reported_seq":641,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:42.583111+0000","last_change":"2024-09-12T01:38:42.583044+0000","last_active":"2024-09-12T01:38:42.583111+0000","last_peered":"2024-09-12T01:38:42.583111+0000","last_clean":"2024-09-12T01:38:42.583111+0000","last_became_active":"2024-09-12T00:28:41.231611+0000","last_became_peered":"2024-09-12T00:28:41.231611+0000","last_unstale":"2024-09-12T01:38:42.583111+0000","last_undegraded":"2024-09-12T01:38:42.583111+0000","last_fullsized":"2024-09-12T01:38:42.583111+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'136","last_scrub_stamp":"2024-09-12T01:38:42.582959+0000","last_deep_scrub":"263'136","last_deep_scrub_stamp":"2024-09-12T01:38:42.582959+0000","last_clean_scrub_stamp":"2024-09-12T01:38:42.582959+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:49.631045+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":625,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":135,"num_read_kb":130,"num_write":322,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"263'92","reported_seq":682,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.500242+0000","last_change":"2024-09-12T01:38:18.500153+0000","last_active":"2024-09-12T01:38:18.500242+0000","last_peered":"2024-09-12T01:38:18.500242+0000","last_clean":"2024-09-12T01:38:18.500242+0000","last_became_active":"2024-09-12T00:28:33.204653+0000","last_became_peered":"2024-09-12T00:28:33.204653+0000","last_unstale":"2024-09-12T01:38:18.500242+0000","last_undegraded":"2024-09-12T01:38:18.500242+0000","last_fullsized":"2024-09-12T01:38:18.500242+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'92","last_scrub_stamp":"2024-09-12T01:38:18.500029+0000","last_deep_scrub":"263'92","last_deep_scrub_stamp":"2024-09-12T01:38:18.500029+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.500029+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:53.561967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":393,"num_read_kb":329,"num_write":145,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"263'433","reported_seq":1134,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.354376+0000","last_change":"2024-09-12T01:38:14.354322+0000","last_active":"2024-09-12T01:38:14.354376+0000","last_peered":"2024-09-12T01:38:14.354376+0000","last_clean":"2024-09-12T01:38:14.354376+0000","last_became_active":"2024-09-12T00:28:31.212752+0000","last_became_peered":"2024-09-12T00:28:31.212752+0000","last_unstale":"2024-09-12T01:38:14.354376+0000","last_undegraded":"2024-09-12T01:38:14.354376+0000","last_fullsized":"2024-09-12T01:38:14.354376+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'433","last_scrub_stamp":"2024-09-12T01:38:14.354219+0000","last_deep_scrub":"263'433","last_deep_scrub_stamp":"2024-09-12T01:38:14.354219+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.354219+0000","objects_scrubbed":4,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:39.547985+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":804,"num_read_kb":13300,"num_write":1374,"num_write_kb":24353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.427926+0000","last_change":"2024-09-12T01:38:35.427842+0000","last_active":"2024-09-12T01:38:35.427926+0000","last_peered":"2024-09-12T01:38:35.427926+0000","last_clean":"2024-09-12T01:38:35.427926+0000","last_became_active":"2024-09-12T00:28:35.207869+0000","last_became_peered":"2024-09-12T00:28:35.207869+0000","last_unstale":"2024-09-12T01:38:35.427926+0000","last_undegraded":"2024-09-12T01:38:35.427926+0000","last_fullsized":"2024-09-12T01:38:35.427926+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.427738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.427738+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.427738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:41.370814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"263'315","reported_seq":907,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:34.185555+0000","last_change":"2024-09-12T01:38:34.185494+0000","last_active":"2024-09-12T01:38:34.185555+0000","last_peered":"2024-09-12T01:38:34.185555+0000","last_clean":"2024-09-12T01:38:34.185555+0000","last_became_active":"2024-09-12T00:28:37.221289+0000","last_became_peered":"2024-09-12T00:28:37.221289+0000","last_unstale":"2024-09-12T01:38:34.185555+0000","last_undegraded":"2024-09-12T01:38:34.185555+0000","last_fullsized":"2024-09-12T01:38:34.185555+0000","mapping_epoch":31,"log_start":"263'301","ondisk_log_start":"263'301","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'315","last_scrub_stamp":"2024-09-12T01:38:34.185391+0000","last_deep_scrub":"263'315","last_deep_scrub_stamp":"2024-09-12T01:38:34.185391+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.185391+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":301,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:47.522388+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57095,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":538,"num_read_kb":1320,"num_write":444,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:28.207523+0000","last_change":"2024-09-12T01:38:28.207406+0000","last_active":"2024-09-12T01:38:28.207523+0000","last_peered":"2024-09-12T01:38:28.207523+0000","last_clean":"2024-09-12T01:38:28.207523+0000","last_became_active":"2024-09-12T00:28:39.216943+0000","last_became_peered":"2024-09-12T00:28:39.216943+0000","last_unstale":"2024-09-12T01:38:28.207523+0000","last_undegraded":"2024-09-12T01:38:28.207523+0000","last_fullsized":"2024-09-12T01:38:28.207523+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:28.207315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:28.207315+0000","last_clean_scrub_stamp":"2024-09-12T01:38:28.207315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:05.089077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"263'141","reported_seq":687,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:48.359160+0000","last_change":"2024-09-12T01:38:48.359072+0000","last_active":"2024-09-12T01:38:48.359160+0000","last_peered":"2024-09-12T01:38:48.359160+0000","last_clean":"2024-09-12T01:38:48.359160+0000","last_became_active":"2024-09-12T00:28:41.257796+0000","last_became_peered":"2024-09-12T00:28:41.257796+0000","last_unstale":"2024-09-12T01:38:48.359160+0000","last_undegraded":"2024-09-12T01:38:48.359160+0000","last_fullsized":"2024-09-12T01:38:48.359160+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'141","last_scrub_stamp":"2024-09-12T01:38:48.358956+0000","last_deep_scrub":"263'141","last_deep_scrub_stamp":"2024-09-12T01:38:48.358956+0000","last_clean_scrub_stamp":"2024-09-12T01:38:48.358956+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:50.381734+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":982,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":234,"num_read_kb":212,"num_write":368,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"263'74","reported_seq":638,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.199043+0000","last_change":"2024-09-12T01:38:20.198985+0000","last_active":"2024-09-12T01:38:20.199043+0000","last_peered":"2024-09-12T01:38:20.199043+0000","last_clean":"2024-09-12T01:38:20.199043+0000","last_became_active":"2024-09-12T00:28:33.205832+0000","last_became_peered":"2024-09-12T00:28:33.205832+0000","last_unstale":"2024-09-12T01:38:20.199043+0000","last_undegraded":"2024-09-12T01:38:20.199043+0000","last_fullsized":"2024-09-12T01:38:20.199043+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'74","last_scrub_stamp":"2024-09-12T01:38:20.198893+0000","last_deep_scrub":"263'74","last_deep_scrub_stamp":"2024-09-12T01:38:20.198893+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.198893+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:19.080369+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":322,"num_read_kb":264,"num_write":102,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"263'347","reported_seq":991,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.179671+0000","last_change":"2024-09-12T01:38:19.179612+0000","last_active":"2024-09-12T01:38:19.179671+0000","last_peered":"2024-09-12T01:38:19.179671+0000","last_clean":"2024-09-12T01:38:19.179671+0000","last_became_active":"2024-09-12T00:28:31.200234+0000","last_became_peered":"2024-09-12T00:28:31.200234+0000","last_unstale":"2024-09-12T01:38:19.179671+0000","last_undegraded":"2024-09-12T01:38:19.179671+0000","last_fullsized":"2024-09-12T01:38:19.179671+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'347","last_scrub_stamp":"2024-09-12T01:38:19.179470+0000","last_deep_scrub":"263'347","last_deep_scrub_stamp":"2024-09-12T01:38:19.179470+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.179470+0000","objects_scrubbed":10,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:23.079099+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262245,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":466,"num_read_kb":15822,"num_write":1094,"num_write_kb":25857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:33.496440+0000","last_change":"2024-09-12T01:38:33.496358+0000","last_active":"2024-09-12T01:38:33.496440+0000","last_peered":"2024-09-12T01:38:33.496440+0000","last_clean":"2024-09-12T01:38:33.496440+0000","last_became_active":"2024-09-12T00:28:35.206597+0000","last_became_peered":"2024-09-12T00:28:35.206597+0000","last_unstale":"2024-09-12T01:38:33.496440+0000","last_undegraded":"2024-09-12T01:38:33.496440+0000","last_fullsized":"2024-09-12T01:38:33.496440+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:33.496234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:33.496234+0000","last_clean_scrub_stamp":"2024-09-12T01:38:33.496234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:18.065199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"263'283","reported_seq":861,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:39.323453+0000","last_change":"2024-09-12T01:38:39.323392+0000","last_active":"2024-09-12T01:38:39.323453+0000","last_peered":"2024-09-12T01:38:39.323453+0000","last_clean":"2024-09-12T01:38:39.323453+0000","last_became_active":"2024-09-12T00:28:37.219652+0000","last_became_peered":"2024-09-12T00:28:37.219652+0000","last_unstale":"2024-09-12T01:38:39.323453+0000","last_undegraded":"2024-09-12T01:38:39.323453+0000","last_fullsized":"2024-09-12T01:38:39.323453+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'283","last_scrub_stamp":"2024-09-12T01:38:39.323294+0000","last_deep_scrub":"263'283","last_deep_scrub_stamp":"2024-09-12T01:38:39.323294+0000","last_clean_scrub_stamp":"2024-09-12T01:38:39.323294+0000","objects_scrubbed":3,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:13.768409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49715,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":473,"num_read_kb":1234,"num_write":394,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:39.514683+0000","last_change":"2024-09-12T01:38:39.514598+0000","last_active":"2024-09-12T01:38:39.514683+0000","last_peered":"2024-09-12T01:38:39.514683+0000","last_clean":"2024-09-12T01:38:39.514683+0000","last_became_active":"2024-09-12T00:28:39.217869+0000","last_became_peered":"2024-09-12T00:28:39.217869+0000","last_unstale":"2024-09-12T01:38:39.514683+0000","last_undegraded":"2024-09-12T01:38:39.514683+0000","last_fullsized":"2024-09-12T01:38:39.514683+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:39.514499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:39.514499+0000","last_clean_scrub_stamp":"2024-09-12T01:38:39.514499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:15.359627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"263'195","reported_seq":1301,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:43.611117+0000","last_change":"2024-09-12T01:38:43.611045+0000","last_active":"2024-09-12T01:38:43.611117+0000","last_peered":"2024-09-12T01:38:43.611117+0000","last_clean":"2024-09-12T01:38:43.611117+0000","last_became_active":"2024-09-12T00:28:41.232040+0000","last_became_peered":"2024-09-12T00:28:41.232040+0000","last_unstale":"2024-09-12T01:38:43.611117+0000","last_undegraded":"2024-09-12T01:38:43.611117+0000","last_fullsized":"2024-09-12T01:38:43.611117+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'195","last_scrub_stamp":"2024-09-12T01:38:43.610955+0000","last_deep_scrub":"263'195","last_deep_scrub_stamp":"2024-09-12T01:38:43.610955+0000","last_clean_scrub_stamp":"2024-09-12T01:38:43.610955+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:32.696507+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":841,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":800,"num_read_kb":795,"num_write":450,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"263'254","reported_seq":922,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.516726+0000","last_change":"2024-09-12T01:38:15.516670+0000","last_active":"2024-09-12T01:38:15.516726+0000","last_peered":"2024-09-12T01:38:15.516726+0000","last_clean":"2024-09-12T01:38:15.516726+0000","last_became_active":"2024-09-12T00:28:33.208787+0000","last_became_peered":"2024-09-12T00:28:33.208787+0000","last_unstale":"2024-09-12T01:38:15.516726+0000","last_undegraded":"2024-09-12T01:38:15.516726+0000","last_fullsized":"2024-09-12T01:38:15.516726+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'254","last_scrub_stamp":"2024-09-12T01:38:15.516591+0000","last_deep_scrub":"263'254","last_deep_scrub_stamp":"2024-09-12T01:38:15.516591+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.516591+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:22.435596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1164,"num_read_kb":956,"num_write":405,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"263'322","reported_seq":1079,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.049718+0000","last_change":"2024-09-12T01:38:12.049656+0000","last_active":"2024-09-12T01:38:12.049718+0000","last_peered":"2024-09-12T01:38:12.049718+0000","last_clean":"2024-09-12T01:38:12.049718+0000","last_became_active":"2024-09-12T00:29:04.274746+0000","last_became_peered":"2024-09-12T00:29:04.274746+0000","last_unstale":"2024-09-12T01:38:12.049718+0000","last_undegraded":"2024-09-12T01:38:12.049718+0000","last_fullsized":"2024-09-12T01:38:12.049718+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'322","last_scrub_stamp":"2024-09-12T01:38:12.049537+0000","last_deep_scrub":"263'322","last_deep_scrub_stamp":"2024-09-12T01:38:12.049537+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.049537+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:42.701831+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524334,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":565,"num_read_kb":52761,"num_write":1033,"num_write_kb":38285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"263'6","reported_seq":997,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:24.038564+0000","last_change":"2024-09-12T01:38:24.038504+0000","last_active":"2024-09-12T01:38:24.038564+0000","last_peered":"2024-09-12T01:38:24.038564+0000","last_clean":"2024-09-12T01:38:24.038564+0000","last_became_active":"2024-09-12T00:28:35.207332+0000","last_became_peered":"2024-09-12T00:28:35.207332+0000","last_unstale":"2024-09-12T01:38:24.038564+0000","last_undegraded":"2024-09-12T01:38:24.038564+0000","last_fullsized":"2024-09-12T01:38:24.038564+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-12T01:38:24.038400+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-12T01:38:24.038400+0000","last_clean_scrub_stamp":"2024-09-12T01:38:24.038400+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:33.692701+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"263'331","reported_seq":945,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.563535+0000","last_change":"2024-09-12T01:38:35.563468+0000","last_active":"2024-09-12T01:38:35.563535+0000","last_peered":"2024-09-12T01:38:35.563535+0000","last_clean":"2024-09-12T01:38:35.563535+0000","last_became_active":"2024-09-12T00:28:37.207373+0000","last_became_peered":"2024-09-12T00:28:37.207373+0000","last_unstale":"2024-09-12T01:38:35.563535+0000","last_undegraded":"2024-09-12T01:38:35.563535+0000","last_fullsized":"2024-09-12T01:38:35.563535+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'331","last_scrub_stamp":"2024-09-12T01:38:35.563375+0000","last_deep_scrub":"263'331","last_deep_scrub_stamp":"2024-09-12T01:38:35.563375+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.563375+0000","objects_scrubbed":6,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:36.551810+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45135,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":515,"num_read_kb":1089,"num_write":408,"num_write_kb":271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:40.196233+0000","last_change":"2024-09-12T01:38:40.196160+0000","last_active":"2024-09-12T01:38:40.196233+0000","last_peered":"2024-09-12T01:38:40.196233+0000","last_clean":"2024-09-12T01:38:40.196233+0000","last_became_active":"2024-09-12T00:28:39.215651+0000","last_became_peered":"2024-09-12T00:28:39.215651+0000","last_unstale":"2024-09-12T01:38:40.196233+0000","last_undegraded":"2024-09-12T01:38:40.196233+0000","last_fullsized":"2024-09-12T01:38:40.196233+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:40.196075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:40.196075+0000","last_clean_scrub_stamp":"2024-09-12T01:38:40.196075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:01.668864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"263'135","reported_seq":641,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:41.532450+0000","last_change":"2024-09-12T01:38:41.532394+0000","last_active":"2024-09-12T01:38:41.532450+0000","last_peered":"2024-09-12T01:38:41.532450+0000","last_clean":"2024-09-12T01:38:41.532450+0000","last_became_active":"2024-09-12T00:28:41.226687+0000","last_became_peered":"2024-09-12T00:28:41.226687+0000","last_unstale":"2024-09-12T01:38:41.532450+0000","last_undegraded":"2024-09-12T01:38:41.532450+0000","last_fullsized":"2024-09-12T01:38:41.532450+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'135","last_scrub_stamp":"2024-09-12T01:38:41.532303+0000","last_deep_scrub":"263'135","last_deep_scrub_stamp":"2024-09-12T01:38:41.532303+0000","last_clean_scrub_stamp":"2024-09-12T01:38:41.532303+0000","objects_scrubbed":3,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:48.267743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":132,"num_read_kb":117,"num_write":304,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"263'293","reported_seq":931,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.060156+0000","last_change":"2024-09-12T01:38:21.060156+0000","last_active":"2024-09-12T01:38:21.060156+0000","last_peered":"2024-09-12T01:38:21.060156+0000","last_clean":"2024-09-12T01:38:21.060156+0000","last_became_active":"2024-09-12T00:28:33.210635+0000","last_became_peered":"2024-09-12T00:28:33.210635+0000","last_unstale":"2024-09-12T01:38:21.060156+0000","last_undegraded":"2024-09-12T01:38:21.060156+0000","last_fullsized":"2024-09-12T01:38:21.060156+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'293","last_scrub_stamp":"2024-09-12T01:38:21.060078+0000","last_deep_scrub":"263'293","last_deep_scrub_stamp":"2024-09-12T01:38:21.060078+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.060078+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:54.397394+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1259,"num_read_kb":1011,"num_write":460,"num_write_kb":225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"263'338","reported_seq":967,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.121894+0000","last_change":"2024-09-12T01:38:12.121833+0000","last_active":"2024-09-12T01:38:12.121894+0000","last_peered":"2024-09-12T01:38:12.121894+0000","last_clean":"2024-09-12T01:38:12.121894+0000","last_became_active":"2024-09-12T00:28:31.206672+0000","last_became_peered":"2024-09-12T00:28:31.206672+0000","last_unstale":"2024-09-12T01:38:12.121894+0000","last_undegraded":"2024-09-12T01:38:12.121894+0000","last_fullsized":"2024-09-12T01:38:12.121894+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'338","last_scrub_stamp":"2024-09-12T01:38:12.121735+0000","last_deep_scrub":"263'338","last_deep_scrub_stamp":"2024-09-12T01:38:12.121735+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.121735+0000","objects_scrubbed":6,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:41.412623+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661307,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":464,"num_read_kb":11577,"num_write":1050,"num_write_kb":29091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"263'314","reported_seq":949,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.088957+0000","last_change":"2024-09-12T01:38:16.088957+0000","last_active":"2024-09-12T01:38:16.088957+0000","last_peered":"2024-09-12T01:38:16.088957+0000","last_clean":"2024-09-12T01:38:16.088957+0000","last_became_active":"2024-09-12T00:28:33.206512+0000","last_became_peered":"2024-09-12T00:28:33.206512+0000","last_unstale":"2024-09-12T01:38:16.088957+0000","last_undegraded":"2024-09-12T01:38:16.088957+0000","last_fullsized":"2024-09-12T01:38:16.088957+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'314","last_scrub_stamp":"2024-09-12T01:38:16.088862+0000","last_deep_scrub":"263'314","last_deep_scrub_stamp":"2024-09-12T01:38:16.088862+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.088862+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:00.843923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1325,"num_read_kb":1067,"num_write":489,"num_write_kb":251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"263'331","reported_seq":979,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:08.835044+0000","last_change":"2024-09-12T01:38:08.834993+0000","last_active":"2024-09-12T01:38:08.835044+0000","last_peered":"2024-09-12T01:38:08.835044+0000","last_clean":"2024-09-12T01:38:08.835044+0000","last_became_active":"2024-09-12T00:29:04.271753+0000","last_became_peered":"2024-09-12T00:29:04.271753+0000","last_unstale":"2024-09-12T01:38:08.835044+0000","last_undegraded":"2024-09-12T01:38:08.835044+0000","last_fullsized":"2024-09-12T01:38:08.835044+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'331","last_scrub_stamp":"2024-09-12T01:38:08.834925+0000","last_deep_scrub":"263'331","last_deep_scrub_stamp":"2024-09-12T01:38:08.834925+0000","last_clean_scrub_stamp":"2024-09-12T01:38:08.834925+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:41.298044+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":504,"num_read_kb":1624,"num_write":1034,"num_write_kb":30525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"263'350","reported_seq":969,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:26.390197+0000","last_change":"2024-09-12T01:38:26.390197+0000","last_active":"2024-09-12T01:38:26.390197+0000","last_peered":"2024-09-12T01:38:26.390197+0000","last_clean":"2024-09-12T01:38:26.390197+0000","last_became_active":"2024-09-12T00:28:33.214679+0000","last_became_peered":"2024-09-12T00:28:33.214679+0000","last_unstale":"2024-09-12T01:38:26.390197+0000","last_undegraded":"2024-09-12T01:38:26.390197+0000","last_fullsized":"2024-09-12T01:38:26.390197+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'350","last_scrub_stamp":"2024-09-12T01:38:26.390114+0000","last_deep_scrub":"263'350","last_deep_scrub_stamp":"2024-09-12T01:38:26.390114+0000","last_clean_scrub_stamp":"2024-09-12T01:38:26.390114+0000","objects_scrubbed":1,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:19.138258+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1495,"num_read_kb":1194,"num_write":562,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"263'379","reported_seq":1055,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.375580+0000","last_change":"2024-09-12T01:38:16.375518+0000","last_active":"2024-09-12T01:38:16.375580+0000","last_peered":"2024-09-12T01:38:16.375580+0000","last_clean":"2024-09-12T01:38:16.375580+0000","last_became_active":"2024-09-12T00:28:31.209266+0000","last_became_peered":"2024-09-12T00:28:31.209266+0000","last_unstale":"2024-09-12T01:38:16.375580+0000","last_undegraded":"2024-09-12T01:38:16.375580+0000","last_fullsized":"2024-09-12T01:38:16.375580+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'379","last_scrub_stamp":"2024-09-12T01:38:16.375401+0000","last_deep_scrub":"263'379","last_deep_scrub_stamp":"2024-09-12T01:38:16.375401+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.375401+0000","objects_scrubbed":15,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:39.836701+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2581681,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":574,"num_read_kb":38602,"num_write":1242,"num_write_kb":22367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"263'105","reported_seq":698,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.041650+0000","last_change":"2024-09-12T01:38:17.041650+0000","last_active":"2024-09-12T01:38:17.041650+0000","last_peered":"2024-09-12T01:38:17.041650+0000","last_clean":"2024-09-12T01:38:17.041650+0000","last_became_active":"2024-09-12T00:28:33.213020+0000","last_became_peered":"2024-09-12T00:28:33.213020+0000","last_unstale":"2024-09-12T01:38:17.041650+0000","last_undegraded":"2024-09-12T01:38:17.041650+0000","last_fullsized":"2024-09-12T01:38:17.041650+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'105","last_scrub_stamp":"2024-09-12T01:38:17.041548+0000","last_deep_scrub":"263'105","last_deep_scrub_stamp":"2024-09-12T01:38:17.041548+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.041548+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:31.379735+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":435,"num_read_kb":365,"num_write":138,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"263'312","reported_seq":1058,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.130935+0000","last_change":"2024-09-12T01:38:19.130935+0000","last_active":"2024-09-12T01:38:19.130935+0000","last_peered":"2024-09-12T01:38:19.130935+0000","last_clean":"2024-09-12T01:38:19.130935+0000","last_became_active":"2024-09-12T00:28:31.208548+0000","last_became_peered":"2024-09-12T00:28:31.208548+0000","last_unstale":"2024-09-12T01:38:19.130935+0000","last_undegraded":"2024-09-12T01:38:19.130935+0000","last_fullsized":"2024-09-12T01:38:19.130935+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'312","last_scrub_stamp":"2024-09-12T01:38:19.130834+0000","last_deep_scrub":"263'312","last_deep_scrub_stamp":"2024-09-12T01:38:19.130834+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.130834+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:32.788994+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49275,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":734,"num_read_kb":31441,"num_write":965,"num_write_kb":36605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"263'125","reported_seq":769,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:23.259183+0000","last_change":"2024-09-12T01:38:23.259183+0000","last_active":"2024-09-12T01:38:23.259183+0000","last_peered":"2024-09-12T01:38:23.259183+0000","last_clean":"2024-09-12T01:38:23.259183+0000","last_became_active":"2024-09-12T00:28:33.217573+0000","last_became_peered":"2024-09-12T00:28:33.217573+0000","last_unstale":"2024-09-12T01:38:23.259183+0000","last_undegraded":"2024-09-12T01:38:23.259183+0000","last_fullsized":"2024-09-12T01:38:23.259183+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'125","last_scrub_stamp":"2024-09-12T01:38:23.259101+0000","last_deep_scrub":"263'125","last_deep_scrub_stamp":"2024-09-12T01:38:23.259101+0000","last_clean_scrub_stamp":"2024-09-12T01:38:23.259101+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:11.077813+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":588,"num_read_kb":500,"num_write":193,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"263'360","reported_seq":1010,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:09.821543+0000","last_change":"2024-09-12T01:38:09.821485+0000","last_active":"2024-09-12T01:38:09.821543+0000","last_peered":"2024-09-12T01:38:09.821543+0000","last_clean":"2024-09-12T01:38:09.821543+0000","last_became_active":"2024-09-12T00:29:04.267546+0000","last_became_peered":"2024-09-12T00:29:04.267546+0000","last_unstale":"2024-09-12T01:38:09.821543+0000","last_undegraded":"2024-09-12T01:38:09.821543+0000","last_fullsized":"2024-09-12T01:38:09.821543+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'360","last_scrub_stamp":"2024-09-12T01:38:09.821400+0000","last_deep_scrub":"263'360","last_deep_scrub_stamp":"2024-09-12T01:38:09.821400+0000","last_clean_scrub_stamp":"2024-09-12T01:38:09.821400+0000","objects_scrubbed":8,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:41.679527+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2316165,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":596,"num_read_kb":3307,"num_write":1233,"num_write_kb":18821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"263'309","reported_seq":1012,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.491503+0000","last_change":"2024-09-12T01:38:21.491401+0000","last_active":"2024-09-12T01:38:21.491503+0000","last_peered":"2024-09-12T01:38:21.491503+0000","last_clean":"2024-09-12T01:38:21.491503+0000","last_became_active":"2024-09-12T00:28:33.208929+0000","last_became_peered":"2024-09-12T00:28:33.208929+0000","last_unstale":"2024-09-12T01:38:21.491503+0000","last_undegraded":"2024-09-12T01:38:21.491503+0000","last_fullsized":"2024-09-12T01:38:21.491503+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'309","last_scrub_stamp":"2024-09-12T01:38:21.491305+0000","last_deep_scrub":"263'309","last_deep_scrub_stamp":"2024-09-12T01:38:21.491305+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.491305+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:34.771827+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1423,"num_read_kb":1158,"num_write":481,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4001,"num_omap_keys":18,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"263'317","reported_seq":967,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.214608+0000","last_change":"2024-09-12T01:38:11.214608+0000","last_active":"2024-09-12T01:38:11.214608+0000","last_peered":"2024-09-12T01:38:11.214608+0000","last_clean":"2024-09-12T01:38:11.214608+0000","last_became_active":"2024-09-12T00:28:31.205829+0000","last_became_peered":"2024-09-12T00:28:31.205829+0000","last_unstale":"2024-09-12T01:38:11.214608+0000","last_undegraded":"2024-09-12T01:38:11.214608+0000","last_fullsized":"2024-09-12T01:38:11.214608+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'317","last_scrub_stamp":"2024-09-12T01:38:11.214498+0000","last_deep_scrub":"263'317","last_deep_scrub_stamp":"2024-09-12T01:38:11.214498+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.214498+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:14.918145+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262189,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":453,"num_read_kb":5277,"num_write":1032,"num_write_kb":26638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"263'110","reported_seq":708,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.225809+0000","last_change":"2024-09-12T01:38:21.225675+0000","last_active":"2024-09-12T01:38:21.225809+0000","last_peered":"2024-09-12T01:38:21.225809+0000","last_clean":"2024-09-12T01:38:21.225809+0000","last_became_active":"2024-09-12T00:28:33.208010+0000","last_became_peered":"2024-09-12T00:28:33.208010+0000","last_unstale":"2024-09-12T01:38:21.225809+0000","last_undegraded":"2024-09-12T01:38:21.225809+0000","last_fullsized":"2024-09-12T01:38:21.225809+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'110","last_scrub_stamp":"2024-09-12T01:38:21.225579+0000","last_deep_scrub":"263'110","last_deep_scrub_stamp":"2024-09-12T01:38:21.225579+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.225579+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:01.368932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":481,"num_read_kb":401,"num_write":165,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"263'372","reported_seq":1022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.127767+0000","last_change":"2024-09-12T01:38:15.127767+0000","last_active":"2024-09-12T01:38:15.127767+0000","last_peered":"2024-09-12T01:38:15.127767+0000","last_clean":"2024-09-12T01:38:15.127767+0000","last_became_active":"2024-09-12T00:28:31.205366+0000","last_became_peered":"2024-09-12T00:28:31.205366+0000","last_unstale":"2024-09-12T01:38:15.127767+0000","last_undegraded":"2024-09-12T01:38:15.127767+0000","last_fullsized":"2024-09-12T01:38:15.127767+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'372","last_scrub_stamp":"2024-09-12T01:38:15.127655+0000","last_deep_scrub":"263'372","last_deep_scrub_stamp":"2024-09-12T01:38:15.127655+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.127655+0000","objects_scrubbed":3,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:47.340053+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":592,"num_read_kb":12807,"num_write":1213,"num_write_kb":27426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"263'207","reported_seq":836,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.245356+0000","last_change":"2024-09-12T01:38:20.245276+0000","last_active":"2024-09-12T01:38:20.245356+0000","last_peered":"2024-09-12T01:38:20.245356+0000","last_clean":"2024-09-12T01:38:20.245356+0000","last_became_active":"2024-09-12T00:28:33.209028+0000","last_became_peered":"2024-09-12T00:28:33.209028+0000","last_unstale":"2024-09-12T01:38:20.245356+0000","last_undegraded":"2024-09-12T01:38:20.245356+0000","last_fullsized":"2024-09-12T01:38:20.245356+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'207","last_scrub_stamp":"2024-09-12T01:38:20.245188+0000","last_deep_scrub":"263'207","last_deep_scrub_stamp":"2024-09-12T01:38:20.245188+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.245188+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:22.561594+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":877,"num_read_kb":721,"num_write":304,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":758,"num_omap_keys":4,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"263'330","reported_seq":1007,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.216893+0000","last_change":"2024-09-12T01:38:12.216893+0000","last_active":"2024-09-12T01:38:12.216893+0000","last_peered":"2024-09-12T01:38:12.216893+0000","last_clean":"2024-09-12T01:38:12.216893+0000","last_became_active":"2024-09-12T00:28:31.203185+0000","last_became_peered":"2024-09-12T00:28:31.203185+0000","last_unstale":"2024-09-12T01:38:12.216893+0000","last_undegraded":"2024-09-12T01:38:12.216893+0000","last_fullsized":"2024-09-12T01:38:12.216893+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'330","last_scrub_stamp":"2024-09-12T01:38:12.216795+0000","last_deep_scrub":"263'330","last_deep_scrub_stamp":"2024-09-12T01:38:12.216795+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.216795+0000","objects_scrubbed":5,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:53.679636+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524364,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":503,"num_read_kb":88709,"num_write":1042,"num_write_kb":43642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"263'404","reported_seq":1090,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.068469+0000","last_change":"2024-09-12T01:38:16.068399+0000","last_active":"2024-09-12T01:38:16.068469+0000","last_peered":"2024-09-12T01:38:16.068469+0000","last_clean":"2024-09-12T01:38:16.068469+0000","last_became_active":"2024-09-12T00:29:04.275434+0000","last_became_peered":"2024-09-12T00:29:04.275434+0000","last_unstale":"2024-09-12T01:38:16.068469+0000","last_undegraded":"2024-09-12T01:38:16.068469+0000","last_fullsized":"2024-09-12T01:38:16.068469+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'404","last_scrub_stamp":"2024-09-12T01:38:16.068300+0000","last_deep_scrub":"263'404","last_deep_scrub_stamp":"2024-09-12T01:38:16.068300+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.068300+0000","objects_scrubbed":1,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:12.998225+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1782,"num_read_kb":1435,"num_write":639,"num_write_kb":352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"263'335","reported_seq":980,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.350385+0000","last_change":"2024-09-12T01:38:17.350385+0000","last_active":"2024-09-12T01:38:17.350385+0000","last_peered":"2024-09-12T01:38:17.350385+0000","last_clean":"2024-09-12T01:38:17.350385+0000","last_became_active":"2024-09-12T00:28:31.209468+0000","last_became_peered":"2024-09-12T00:28:31.209468+0000","last_unstale":"2024-09-12T01:38:17.350385+0000","last_undegraded":"2024-09-12T01:38:17.350385+0000","last_fullsized":"2024-09-12T01:38:17.350385+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'335","last_scrub_stamp":"2024-09-12T01:38:17.350292+0000","last_deep_scrub":"263'335","last_deep_scrub_stamp":"2024-09-12T01:38:17.350292+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.350292+0000","objects_scrubbed":7,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:50.033794+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6901132,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":496,"num_read_kb":2644,"num_write":1040,"num_write_kb":18676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"263'161","reported_seq":745,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:23.532865+0000","last_change":"2024-09-12T01:38:23.532779+0000","last_active":"2024-09-12T01:38:23.532865+0000","last_peered":"2024-09-12T01:38:23.532865+0000","last_clean":"2024-09-12T01:38:23.532865+0000","last_became_active":"2024-09-12T00:28:33.208285+0000","last_became_peered":"2024-09-12T00:28:33.208285+0000","last_unstale":"2024-09-12T01:38:23.532865+0000","last_undegraded":"2024-09-12T01:38:23.532865+0000","last_fullsized":"2024-09-12T01:38:23.532865+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'161","last_scrub_stamp":"2024-09-12T01:38:23.532688+0000","last_deep_scrub":"263'161","last_deep_scrub_stamp":"2024-09-12T01:38:23.532688+0000","last_clean_scrub_stamp":"2024-09-12T01:38:23.532688+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:07.016907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":689,"num_read_kb":558,"num_write":246,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"263'367","reported_seq":1006,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.197599+0000","last_change":"2024-09-12T01:38:11.197534+0000","last_active":"2024-09-12T01:38:11.197599+0000","last_peered":"2024-09-12T01:38:11.197599+0000","last_clean":"2024-09-12T01:38:11.197599+0000","last_became_active":"2024-09-12T00:28:31.199924+0000","last_became_peered":"2024-09-12T00:28:31.199924+0000","last_unstale":"2024-09-12T01:38:11.197599+0000","last_undegraded":"2024-09-12T01:38:11.197599+0000","last_fullsized":"2024-09-12T01:38:11.197599+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'367","last_scrub_stamp":"2024-09-12T01:38:11.197392+0000","last_deep_scrub":"263'367","last_deep_scrub_stamp":"2024-09-12T01:38:11.197392+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.197392+0000","objects_scrubbed":8,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:53.293586+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":490,"num_read_kb":12716,"num_write":1120,"num_write_kb":44871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"263'322","reported_seq":1008,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.731603+0000","last_change":"2024-09-12T01:38:11.731545+0000","last_active":"2024-09-12T01:38:11.731603+0000","last_peered":"2024-09-12T01:38:11.731603+0000","last_clean":"2024-09-12T01:38:11.731603+0000","last_became_active":"2024-09-12T00:28:33.208088+0000","last_became_peered":"2024-09-12T00:28:33.208088+0000","last_unstale":"2024-09-12T01:38:11.731603+0000","last_undegraded":"2024-09-12T01:38:11.731603+0000","last_fullsized":"2024-09-12T01:38:11.731603+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'322","last_scrub_stamp":"2024-09-12T01:38:11.731432+0000","last_deep_scrub":"263'322","last_deep_scrub_stamp":"2024-09-12T01:38:11.731432+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.731432+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:50.629920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1424,"num_read_kb":1183,"num_write":488,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"263'345","reported_seq":1022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.364820+0000","last_change":"2024-09-12T01:38:19.364820+0000","last_active":"2024-09-12T01:38:19.364820+0000","last_peered":"2024-09-12T01:38:19.364820+0000","last_clean":"2024-09-12T01:38:19.364820+0000","last_became_active":"2024-09-12T00:28:31.211083+0000","last_became_peered":"2024-09-12T00:28:31.211083+0000","last_unstale":"2024-09-12T01:38:19.364820+0000","last_undegraded":"2024-09-12T01:38:19.364820+0000","last_fullsized":"2024-09-12T01:38:19.364820+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'345","last_scrub_stamp":"2024-09-12T01:38:19.364715+0000","last_deep_scrub":"263'345","last_deep_scrub_stamp":"2024-09-12T01:38:19.364715+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.364715+0000","objects_scrubbed":4,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:27.035569+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262163,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":601,"num_read_kb":3403,"num_write":1227,"num_write_kb":8870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"263'153","reported_seq":777,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.523050+0000","last_change":"2024-09-12T01:38:22.523050+0000","last_active":"2024-09-12T01:38:22.523050+0000","last_peered":"2024-09-12T01:38:22.523050+0000","last_clean":"2024-09-12T01:38:22.523050+0000","last_became_active":"2024-09-12T00:28:33.209024+0000","last_became_peered":"2024-09-12T00:28:33.209024+0000","last_unstale":"2024-09-12T01:38:22.523050+0000","last_undegraded":"2024-09-12T01:38:22.523050+0000","last_fullsized":"2024-09-12T01:38:22.523050+0000","mapping_epoch":27,"log_start":"263'100","ondisk_log_start":"263'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'153","last_scrub_stamp":"2024-09-12T01:38:22.522969+0000","last_deep_scrub":"263'153","last_deep_scrub_stamp":"2024-09-12T01:38:22.522969+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.522969+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:06.711391+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":684,"num_read_kb":599,"num_write":231,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2875,"num_omap_keys":12,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"263'317","reported_seq":944,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.145248+0000","last_change":"2024-09-12T01:38:21.145248+0000","last_active":"2024-09-12T01:38:21.145248+0000","last_peered":"2024-09-12T01:38:21.145248+0000","last_clean":"2024-09-12T01:38:21.145248+0000","last_became_active":"2024-09-12T00:28:31.207399+0000","last_became_peered":"2024-09-12T00:28:31.207399+0000","last_unstale":"2024-09-12T01:38:21.145248+0000","last_undegraded":"2024-09-12T01:38:21.145248+0000","last_fullsized":"2024-09-12T01:38:21.145248+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'317","last_scrub_stamp":"2024-09-12T01:38:21.145153+0000","last_deep_scrub":"263'317","last_deep_scrub_stamp":"2024-09-12T01:38:21.145153+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.145153+0000","objects_scrubbed":8,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:08.962443+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":660490,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":412,"num_read_kb":9232,"num_write":885,"num_write_kb":18206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"263'63","reported_seq":625,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.359615+0000","last_change":"2024-09-12T01:38:22.359615+0000","last_active":"2024-09-12T01:38:22.359615+0000","last_peered":"2024-09-12T01:38:22.359615+0000","last_clean":"2024-09-12T01:38:22.359615+0000","last_became_active":"2024-09-12T00:28:33.213110+0000","last_became_peered":"2024-09-12T00:28:33.213110+0000","last_unstale":"2024-09-12T01:38:22.359615+0000","last_undegraded":"2024-09-12T01:38:22.359615+0000","last_fullsized":"2024-09-12T01:38:22.359615+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'63","last_scrub_stamp":"2024-09-12T01:38:22.359523+0000","last_deep_scrub":"263'63","last_deep_scrub_stamp":"2024-09-12T01:38:22.359523+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.359523+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:22.071319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":226,"num_write":102,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"263'358","reported_seq":1040,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.132038+0000","last_change":"2024-09-12T01:38:11.131978+0000","last_active":"2024-09-12T01:38:11.132038+0000","last_peered":"2024-09-12T01:38:11.132038+0000","last_clean":"2024-09-12T01:38:11.132038+0000","last_became_active":"2024-09-12T00:28:31.203478+0000","last_became_peered":"2024-09-12T00:28:31.203478+0000","last_unstale":"2024-09-12T01:38:11.132038+0000","last_undegraded":"2024-09-12T01:38:11.132038+0000","last_fullsized":"2024-09-12T01:38:11.132038+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'358","last_scrub_stamp":"2024-09-12T01:38:11.131892+0000","last_deep_scrub":"263'358","last_deep_scrub_stamp":"2024-09-12T01:38:11.131892+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.131892+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:45.732319+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":633,"num_read_kb":38935,"num_write":1084,"num_write_kb":32997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"263'193","reported_seq":790,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:25.095313+0000","last_change":"2024-09-12T01:38:25.095313+0000","last_active":"2024-09-12T01:38:25.095313+0000","last_peered":"2024-09-12T01:38:25.095313+0000","last_clean":"2024-09-12T01:38:25.095313+0000","last_became_active":"2024-09-12T00:28:33.220013+0000","last_became_peered":"2024-09-12T00:28:33.220013+0000","last_unstale":"2024-09-12T01:38:25.095313+0000","last_undegraded":"2024-09-12T01:38:25.095313+0000","last_fullsized":"2024-09-12T01:38:25.095313+0000","mapping_epoch":27,"log_start":"260'100","ondisk_log_start":"260'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'193","last_scrub_stamp":"2024-09-12T01:38:25.095217+0000","last_deep_scrub":"263'193","last_deep_scrub_stamp":"2024-09-12T01:38:25.095217+0000","last_clean_scrub_stamp":"2024-09-12T01:38:25.095217+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:10.616066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":806,"num_read_kb":650,"num_write":294,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"263'317","reported_seq":943,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.258336+0000","last_change":"2024-09-12T01:38:19.258278+0000","last_active":"2024-09-12T01:38:19.258336+0000","last_peered":"2024-09-12T01:38:19.258336+0000","last_clean":"2024-09-12T01:38:19.258336+0000","last_became_active":"2024-09-12T00:28:31.204305+0000","last_became_peered":"2024-09-12T00:28:31.204305+0000","last_unstale":"2024-09-12T01:38:19.258336+0000","last_undegraded":"2024-09-12T01:38:19.258336+0000","last_fullsized":"2024-09-12T01:38:19.258336+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'317","last_scrub_stamp":"2024-09-12T01:38:19.258187+0000","last_deep_scrub":"263'317","last_deep_scrub_stamp":"2024-09-12T01:38:19.258187+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.258187+0000","objects_scrubbed":3,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:01.813877+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133653,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":11794,"num_write":1040,"num_write_kb":34532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"263'111","reported_seq":730,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:24.295044+0000","last_change":"2024-09-12T01:38:24.295044+0000","last_active":"2024-09-12T01:38:24.295044+0000","last_peered":"2024-09-12T01:38:24.295044+0000","last_clean":"2024-09-12T01:38:24.295044+0000","last_became_active":"2024-09-12T00:28:33.216814+0000","last_became_peered":"2024-09-12T00:28:33.216814+0000","last_unstale":"2024-09-12T01:38:24.295044+0000","last_undegraded":"2024-09-12T01:38:24.295044+0000","last_fullsized":"2024-09-12T01:38:24.295044+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'111","last_scrub_stamp":"2024-09-12T01:38:24.294958+0000","last_deep_scrub":"263'111","last_deep_scrub_stamp":"2024-09-12T01:38:24.294958+0000","last_clean_scrub_stamp":"2024-09-12T01:38:24.294958+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:08.641709+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":456,"num_read_kb":389,"num_write":151,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":506,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"263'365","reported_seq":1057,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.773208+0000","last_change":"2024-09-12T01:38:10.773147+0000","last_active":"2024-09-12T01:38:10.773208+0000","last_peered":"2024-09-12T01:38:10.773208+0000","last_clean":"2024-09-12T01:38:10.773208+0000","last_became_active":"2024-09-12T00:28:31.200421+0000","last_became_peered":"2024-09-12T00:28:31.200421+0000","last_unstale":"2024-09-12T01:38:10.773208+0000","last_undegraded":"2024-09-12T01:38:10.773208+0000","last_fullsized":"2024-09-12T01:38:10.773208+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'365","last_scrub_stamp":"2024-09-12T01:38:10.773072+0000","last_deep_scrub":"263'365","last_deep_scrub_stamp":"2024-09-12T01:38:10.773072+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.773072+0000","objects_scrubbed":8,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:26.211979+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1658143,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":544,"num_read_kb":83268,"num_write":1180,"num_write_kb":21609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"263'106","reported_seq":692,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:23.404525+0000","last_change":"2024-09-12T01:38:23.404525+0000","last_active":"2024-09-12T01:38:23.404525+0000","last_peered":"2024-09-12T01:38:23.404525+0000","last_clean":"2024-09-12T01:38:23.404525+0000","last_became_active":"2024-09-12T00:28:33.213100+0000","last_became_peered":"2024-09-12T00:28:33.213100+0000","last_unstale":"2024-09-12T01:38:23.404525+0000","last_undegraded":"2024-09-12T01:38:23.404525+0000","last_fullsized":"2024-09-12T01:38:23.404525+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'106","last_scrub_stamp":"2024-09-12T01:38:23.404436+0000","last_deep_scrub":"263'106","last_deep_scrub_stamp":"2024-09-12T01:38:23.404436+0000","last_clean_scrub_stamp":"2024-09-12T01:38:23.404436+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:21.969675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":481,"num_read_kb":399,"num_write":154,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"263'352","reported_seq":1049,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.334977+0000","last_change":"2024-09-12T01:38:20.334920+0000","last_active":"2024-09-12T01:38:20.334977+0000","last_peered":"2024-09-12T01:38:20.334977+0000","last_clean":"2024-09-12T01:38:20.334977+0000","last_became_active":"2024-09-12T00:28:31.215581+0000","last_became_peered":"2024-09-12T00:28:31.215581+0000","last_unstale":"2024-09-12T01:38:20.334977+0000","last_undegraded":"2024-09-12T01:38:20.334977+0000","last_fullsized":"2024-09-12T01:38:20.334977+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'352","last_scrub_stamp":"2024-09-12T01:38:20.334798+0000","last_deep_scrub":"263'352","last_deep_scrub_stamp":"2024-09-12T01:38:20.334798+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.334798+0000","objects_scrubbed":6,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:37:37.813524+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3558704,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":578,"num_read_kb":13304,"num_write":1188,"num_write_kb":31930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"263'311","reported_seq":960,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.358337+0000","last_change":"2024-09-12T01:38:18.358278+0000","last_active":"2024-09-12T01:38:18.358337+0000","last_peered":"2024-09-12T01:38:18.358337+0000","last_clean":"2024-09-12T01:38:18.358337+0000","last_became_active":"2024-09-12T00:28:31.214134+0000","last_became_peered":"2024-09-12T00:28:31.214134+0000","last_unstale":"2024-09-12T01:38:18.358337+0000","last_undegraded":"2024-09-12T01:38:18.358337+0000","last_fullsized":"2024-09-12T01:38:18.358337+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'311","last_scrub_stamp":"2024-09-12T01:38:18.358164+0000","last_deep_scrub":"263'311","last_deep_scrub_stamp":"2024-09-12T01:38:18.358164+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.358164+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:36.150651+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553650,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":469,"num_read_kb":31725,"num_write":1010,"num_write_kb":40420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"263'102","reported_seq":703,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.109083+0000","last_change":"2024-09-12T01:38:20.109012+0000","last_active":"2024-09-12T01:38:20.109083+0000","last_peered":"2024-09-12T01:38:20.109083+0000","last_clean":"2024-09-12T01:38:20.109083+0000","last_became_active":"2024-09-12T00:28:33.212886+0000","last_became_peered":"2024-09-12T00:28:33.212886+0000","last_unstale":"2024-09-12T01:38:20.109083+0000","last_undegraded":"2024-09-12T01:38:20.109083+0000","last_fullsized":"2024-09-12T01:38:20.109083+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'102","last_scrub_stamp":"2024-09-12T01:38:20.108923+0000","last_deep_scrub":"263'102","last_deep_scrub_stamp":"2024-09-12T01:38:20.108923+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.108923+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:02.824645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":476,"num_read_kb":407,"num_write":159,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"263'403","reported_seq":1159,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.146849+0000","last_change":"2024-09-12T01:38:15.146793+0000","last_active":"2024-09-12T01:38:15.146849+0000","last_peered":"2024-09-12T01:38:15.146849+0000","last_clean":"2024-09-12T01:38:15.146849+0000","last_became_active":"2024-09-12T00:28:31.196230+0000","last_became_peered":"2024-09-12T00:28:31.196230+0000","last_unstale":"2024-09-12T01:38:15.146849+0000","last_undegraded":"2024-09-12T01:38:15.146849+0000","last_fullsized":"2024-09-12T01:38:15.146849+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'403","last_scrub_stamp":"2024-09-12T01:38:15.146666+0000","last_deep_scrub":"263'403","last_deep_scrub_stamp":"2024-09-12T01:38:15.146666+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.146666+0000","objects_scrubbed":7,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:40.043210+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291522,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":735,"num_read_kb":35673,"num_write":1292,"num_write_kb":40181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"263'213","reported_seq":811,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:38:28.420757+0000","last_change":"2024-09-12T01:38:28.420645+0000","last_active":"2024-09-12T01:38:28.420757+0000","last_peered":"2024-09-12T01:38:28.420757+0000","last_clean":"2024-09-12T01:38:28.420757+0000","last_became_active":"2024-09-12T00:28:33.213187+0000","last_became_peered":"2024-09-12T00:28:33.213187+0000","last_unstale":"2024-09-12T01:38:28.420757+0000","last_undegraded":"2024-09-12T01:38:28.420757+0000","last_fullsized":"2024-09-12T01:38:28.420757+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'213","last_scrub_stamp":"2024-09-12T01:38:28.420553+0000","last_deep_scrub":"263'213","last_deep_scrub_stamp":"2024-09-12T01:38:28.420553+0000","last_clean_scrub_stamp":"2024-09-12T01:38:28.420553+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:01.923649+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":884,"num_read_kb":712,"num_write":323,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":685,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5759,"num_read_kb":4046,"num_write":1929,"num_write_kb":827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9435,"num_omap_keys":19,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1002,"ondisk_log_size":1002,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15395,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":15045,"num_read_kb":14706,"num_write":16739,"num_write_kb":4892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2683,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1862,"ondisk_log_size":1862,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":525,"ondisk_log_size":525,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1497349,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":18870,"num_read_kb":39400,"num_write":15775,"num_write_kb":11890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":682702,"num_omap_keys":1560,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1965,"ondisk_log_size":1965,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2403,"num_read_kb":2865,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":103056,"num_read_kb":85959,"num_write":37323,"num_write_kb":18865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":44320,"num_omap_keys":179,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4316,"ondisk_log_size":4316,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":94285898,"num_objects":401,"num_object_clones":0,"num_object_copies":802,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":401,"num_whiteouts":0,"num_read":36137,"num_read_kb":1909956,"num_write":71332,"num_write_kb":2052201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":190078976,"data_stored":188571796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3522,"ondisk_log_size":3522,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":175308,"num_write":154,"num_write_kb":116383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":27197,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":178855,"num_write":154,"num_write_kb":116383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510301,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":253256,"kb_used_data":19384,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94118584,"statfs":{"total":96636764160,"available":96377430016,"internally_reserved":0,"allocated":19849216,"data_stored":18131665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":239466954},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510299,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":245476,"kb_used_data":15764,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94126364,"statfs":{"total":96636764160,"available":96385396736,"internally_reserved":0,"allocated":16142336,"data_stored":14537201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":235207110},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510302,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":143396,"kb_used_data":44244,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94228444,"statfs":{"total":96636764160,"available":96489926656,"internally_reserved":0,"allocated":45305856,"data_stored":43509539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510298,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":102520,"kb_used_data":31080,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94269320,"statfs":{"total":96636764160,"available":96531783680,"internally_reserved":0,"allocated":31825920,"data_stored":30189258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510301,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71272,"kb_used_data":17880,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94300568,"statfs":{"total":96636764160,"available":96563781632,"internally_reserved":0,"allocated":18309120,"data_stored":16732323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510304,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":134488,"kb_used_data":22856,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94237352,"statfs":{"total":96636764160,"available":96499048448,"internally_reserved":0,"allocated":23404544,"data_stored":21740424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510302,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":283028,"kb_used_data":35332,"kb_used_omap":1,"kb_used_meta":247678,"kb_avail":94088812,"statfs":{"total":96636764160,"available":96346943488,"internally_reserved":0,"allocated":36179968,"data_stored":34415974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":253622725},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575708,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":284764,"kb_used_data":28684,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":94087076,"statfs":{"total":96636764160,"available":96345165824,"internally_reserved":0,"allocated":29372416,"data_stored":27586086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":262207944},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":31928320,"data_stored":31687986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19750912,"data_stored":19603309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14700544,"data_stored":14596831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":25714688,"data_stored":25449825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28241920,"data_stored":28055424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":41611264,"data_stored":41372743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12529664,"data_stored":12400757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15601664,"data_stored":15404921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:39:31.420 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-12T01:39:31.737 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-12T01:39:31.737 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-12T01:39:31.737 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-12T01:39:31.737 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:39:31.789 INFO:tasks.ceph.osd.0:Stopped 2024-09-12T01:39:31.789 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-12T01:39:31.789 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:39:31.835 INFO:tasks.ceph.osd.1:Stopped 2024-09-12T01:39:31.835 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-12T01:39:31.835 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:39:31.874 INFO:tasks.ceph.osd.2:Stopped 2024-09-12T01:39:31.874 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-12T01:39:31.874 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:39:31.952 INFO:tasks.ceph.osd.3:Stopped 2024-09-12T01:39:31.952 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-12T01:39:31.952 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:39:31.989 INFO:tasks.ceph.osd.4:Stopped 2024-09-12T01:39:31.989 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-12T01:39:31.990 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:39:32.067 INFO:tasks.ceph.osd.5:Stopped 2024-09-12T01:39:32.067 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-12T01:39:32.068 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:39:32.150 INFO:tasks.ceph.osd.6:Stopped 2024-09-12T01:39:32.151 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-12T01:39:32.151 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:39:32.199 INFO:tasks.ceph.osd.7:Stopped 2024-09-12T01:39:32.199 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-12T01:39:32.199 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-12T01:39:32.199 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:39:32.227 INFO:tasks.ceph.mgr.y:Stopped 2024-09-12T01:39:32.227 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-12T01:39:32.227 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:39:32.255 INFO:tasks.ceph.mgr.x:Stopped 2024-09-12T01:39:32.256 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-12T01:39:32.256 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T01:39:32.256 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:39:32.285 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T01:39:32.285 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-12T01:39:32.285 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:39:32.338 INFO:tasks.ceph.mon.c:Stopped 2024-09-12T01:39:32.339 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-12T01:39:32.339 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:39:32.352 INFO:tasks.ceph.mon.b:Stopped 2024-09-12T01:39:32.352 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-12T01:39:32.352 DEBUG:teuthology.orchestra.run.smithi073:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-09-12T01:39:32.421 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi073.front.sepia.ceph.com 2024-09-12T01:39:32.421 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-12T01:39:32.673 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi073.front.sepia.ceph.com 2024-09-12T01:39:32.674 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-12T01:39:32.815 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi073.front.sepia.ceph.com 2024-09-12T01:39:32.815 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-12T01:39:32.883 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi073.front.sepia.ceph.com 2024-09-12T01:39:32.883 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-12T01:39:32.960 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi117.front.sepia.ceph.com 2024-09-12T01:39:32.961 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-12T01:39:33.068 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi117.front.sepia.ceph.com 2024-09-12T01:39:33.068 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-12T01:39:33.163 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi117.front.sepia.ceph.com 2024-09-12T01:39:33.163 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-12T01:39:33.249 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi117.front.sepia.ceph.com 2024-09-12T01:39:33.249 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-12T01:39:33.319 INFO:tasks.ceph:Archiving mon data... 2024-09-12T01:39:33.321 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901864/data/mon.a.tgz 2024-09-12T01:39:33.321 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2024-09-12T01:39:33.351 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.E0IRGHdCWP 2024-09-12T01:39:33.351 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.E0IRGHdCWP 2024-09-12T01:39:33.574 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.E0IRGHdCWP 2024-09-12T01:39:33.683 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.E0IRGHdCWP is 536KB 2024-09-12T01:39:33.780 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.E0IRGHdCWP 2024-09-12T01:39:33.808 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901864/data/mon.c.tgz 2024-09-12T01:39:33.808 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2024-09-12T01:39:33.877 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.S85iqEYov0 2024-09-12T01:39:33.877 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.S85iqEYov0 2024-09-12T01:39:34.074 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.S85iqEYov0 2024-09-12T01:39:34.184 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.S85iqEYov0 is 555KB 2024-09-12T01:39:34.267 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.S85iqEYov0 2024-09-12T01:39:34.295 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901864/data/mon.b.tgz 2024-09-12T01:39:34.295 DEBUG:teuthology.orchestra.run.smithi117:> mktemp 2024-09-12T01:39:34.324 INFO:teuthology.orchestra.run.smithi117.stdout:/tmp/tmp.i3PJhzj2BA 2024-09-12T01:39:34.324 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.i3PJhzj2BA 2024-09-12T01:39:34.801 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0666 /tmp/tmp.i3PJhzj2BA 2024-09-12T01:39:34.912 DEBUG:teuthology.orchestra.remote:smithi117:/tmp/tmp.i3PJhzj2BA is 555KB 2024-09-12T01:39:35.011 DEBUG:teuthology.orchestra.run.smithi117:> rm -fr /tmp/tmp.i3PJhzj2BA 2024-09-12T01:39:35.041 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-12T01:39:35.041 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T01:39:35.044 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T01:39:35.228 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T01:39:35.257 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T01:39:35.257 INFO:tasks.ceph:Archiving crash dumps... 2024-09-12T01:39:35.261 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901864/remote/smithi073/crash 2024-09-12T01:39:35.262 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T01:39:35.301 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901864/remote/smithi117/crash 2024-09-12T01:39:35.302 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T01:39:35.340 INFO:tasks.ceph:Compressing logs... 2024-09-12T01:39:35.340 DEBUG:teuthology.orchestra.run.smithi073:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T01:39:35.345 DEBUG:teuthology.orchestra.run.smithi117:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T01:39:35.382 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-12T01:39:35.382 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160233.log 2024-09-12T01:39:35.383 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163202.log 2024-09-12T01:39:35.383 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.160233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.182897.log 2024-09-12T01:39:35.383 INFO:teuthology.orchestra.run.smithi073.stderr: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.160233.log.gz 2024-09-12T01:39:35.383 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.163202.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.163202.log.gz -5 2024-09-12T01:39:35.383 INFO:teuthology.orchestra.run.smithi073.stderr: --verbose -- /var/log/ceph/ceph-client.admin.63758.log 2024-09-12T01:39:35.428 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-12T01:39:35.428 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32708.log 2024-09-12T01:39:35.428 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-12T01:39:35.428 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-osd.7.log: /var/log/ceph/ceph-client.admin.32708.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T01:39:35.428 INFO:teuthology.orchestra.run.smithi117.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32708.log.gz 2024-09-12T01:39:35.428 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32884.log 2024-09-12T01:39:35.428 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32840.log 2024-09-12T01:39:35.429 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.32884.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32884.log.gz 2024-09-12T01:39:35.429 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-12T01:39:35.429 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-12T01:39:35.429 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.32840.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32840.log.gz 2024-09-12T01:39:35.429 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T01:39:35.429 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32928.log 2024-09-12T01:39:35.429 INFO:teuthology.orchestra.run.smithi117.stderr: 90.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T01:39:35.429 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-12T01:39:35.429 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.32928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32796.log 2024-09-12T01:39:35.429 INFO:teuthology.orchestra.run.smithi117.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32928.log.gz 2024-09-12T01:39:35.429 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32752.log 2024-09-12T01:39:35.429 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-12T01:39:35.429 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.32796.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32796.log.gz 2024-09-12T01:39:35.429 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.32752.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32752.log.gz 2024-09-12T01:39:35.430 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32664.log 2024-09-12T01:39:35.430 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32620.log 2024-09-12T01:39:35.430 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.32664.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32664.log.gz 2024-09-12T01:39:35.430 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.32620.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32620.log.gz 2024-09-12T01:39:35.435 INFO:teuthology.orchestra.run.smithi117.stderr: 87.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T01:39:35.473 INFO:teuthology.orchestra.run.smithi117.stderr: 95.1% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-12T01:39:35.512 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.184724.log 2024-09-12T01:39:35.512 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.0.182897.log: /var/log/ceph/ceph-client.admin.63758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118389.log 2024-09-12T01:39:35.512 INFO:teuthology.orchestra.run.smithi073.stderr: 21.6% -- replaced with /var/log/ceph/ceph-client.admin.63758.log.gz 2024-09-12T01:39:35.512 INFO:teuthology.orchestra.run.smithi073.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.0.182897.log.gz 2024-09-12T01:39:35.512 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.0.184724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187682.log 2024-09-12T01:39:35.512 INFO:teuthology.orchestra.run.smithi073.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.0.184724.log.gz 2024-09-12T01:39:35.512 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.118389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40390.log 2024-09-12T01:39:35.512 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.187682.log: 87.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.118389.log.gz -5 2024-09-12T01:39:35.513 INFO:teuthology.orchestra.run.smithi073.stderr: --verbose -- /var/log/ceph/ceph-client.admin.39449.log 2024-09-12T01:39:35.513 INFO:teuthology.orchestra.run.smithi073.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.187682.log.gz 2024-09-12T01:39:35.513 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38715.log 2024-09-12T01:39:35.513 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40390.log.gz 2024-09-12T01:39:35.513 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119567.log 2024-09-12T01:39:35.513 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39449.log.gz 2024-09-12T01:39:35.513 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38715.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38715.log.gz 2024-09-12T01:39:35.513 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63030.log 2024-09-12T01:39:35.513 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.119567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106592.log 2024-09-12T01:39:35.513 INFO:teuthology.orchestra.run.smithi073.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.119567.log.gz 2024-09-12T01:39:35.513 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.63030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.189746.log 2024-09-12T01:39:35.513 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.106592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98934.log 2024-09-12T01:39:35.514 INFO:teuthology.orchestra.run.smithi073.stderr: 82.3%/var/log/ceph/ceph-client.0.189746.log: -- replaced with /var/log/ceph/ceph-client.admin.106592.log.gz 2024-09-12T01:39:35.514 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.167611.log 2024-09-12T01:39:35.514 INFO:teuthology.orchestra.run.smithi073.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.0.189746.log.gz 2024-09-12T01:39:35.514 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138415.log 2024-09-12T01:39:35.514 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.98934.log: /var/log/ceph/ceph-client.0.167611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38502.log 2024-09-12T01:39:35.514 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.138415.log: 84.4% -- replaced with /var/log/ceph/ceph-client.0.167611.log.gz 2024-09-12T01:39:35.514 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114838.log 2024-09-12T01:39:35.514 INFO:teuthology.orchestra.run.smithi073.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.138415.log.gz 2024-09-12T01:39:35.514 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104825.log 2024-09-12T01:39:35.514 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38502.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38502.log.gz 2024-09-12T01:39:35.515 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.114838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148429.log 2024-09-12T01:39:35.515 INFO:teuthology.orchestra.run.smithi073.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.114838.log.gz 2024-09-12T01:39:35.515 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.104825.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.98934.log.gz 2024-09-12T01:39:35.515 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39822.log 2024-09-12T01:39:35.515 INFO:teuthology.orchestra.run.smithi073.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.104825.log.gz 2024-09-12T01:39:35.515 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40066.log 2024-09-12T01:39:35.515 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.148429.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.148429.log.gz 2024-09-12T01:39:35.515 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39822.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39822.log.gz 2024-09-12T01:39:35.515 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53099.log 2024-09-12T01:39:35.515 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51897.log 2024-09-12T01:39:35.516 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40066.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40066.log.gz 2024-09-12T01:39:35.516 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.53099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38218.log 2024-09-12T01:39:35.516 INFO:teuthology.orchestra.run.smithi073.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.53099.log.gz 2024-09-12T01:39:35.516 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.51897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124279.log 2024-09-12T01:39:35.516 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51897.log.gz 2024-09-12T01:39:35.516 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60228.log 2024-09-12T01:39:35.516 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38218.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38218.log.gz 2024-09-12T01:39:35.516 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.124279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80674.log 2024-09-12T01:39:35.516 INFO:teuthology.orchestra.run.smithi073.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.124279.log.gz 2024-09-12T01:39:35.516 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.60228.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60228.log.gz 2024-09-12T01:39:35.517 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39653.log 2024-09-12T01:39:35.517 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97756.log 2024-09-12T01:39:35.517 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.80674.log: /var/log/ceph/ceph-client.admin.39653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192309.log 2024-09-12T01:39:35.517 INFO:teuthology.orchestra.run.smithi073.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.80674.log.gz 0.0% 2024-09-12T01:39:35.517 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39653.log.gz 2024-09-12T01:39:35.517 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.97756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145483.log 2024-09-12T01:39:35.517 INFO:teuthology.orchestra.run.smithi073.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.97756.log.gz 2024-09-12T01:39:35.517 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.192309.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192309.log.gz 2024-09-12T01:39:35.517 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90098.log 2024-09-12T01:39:35.517 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.145483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149018.log 2024-09-12T01:39:35.517 INFO:teuthology.orchestra.run.smithi073.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.145483.log.gz 2024-09-12T01:39:35.518 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.90098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156677.log 2024-09-12T01:39:35.518 INFO:teuthology.orchestra.run.smithi073.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.90098.log.gz 2024-09-12T01:39:35.518 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62891.log 2024-09-12T01:39:35.518 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.149018.log: /var/log/ceph/ceph-client.admin.156677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140771.log 2024-09-12T01:39:35.518 INFO:teuthology.orchestra.run.smithi073.stderr: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.149018.log.gz 2024-09-12T01:39:35.518 INFO:teuthology.orchestra.run.smithi073.stderr: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.156677.log.gz 2024-09-12T01:39:35.518 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.62891.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.62891.log.gz 2024-09-12T01:39:35.518 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123690.log 2024-09-12T01:39:35.518 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.140771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162589.log 2024-09-12T01:39:35.519 INFO:teuthology.orchestra.run.smithi073.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.140771.log.gz 2024-09-12T01:39:35.519 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.123690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171270.log 2024-09-12T01:39:35.519 INFO:teuthology.orchestra.run.smithi073.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.123690.log.gz 2024-09-12T01:39:35.519 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103058.log 2024-09-12T01:39:35.519 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.162589.log: /var/log/ceph/ceph-client.admin.171270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84797.log 2024-09-12T01:39:35.519 INFO:teuthology.orchestra.run.smithi073.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.162589.log.gz 2024-09-12T01:39:35.519 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.103058.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.171270.log.gz 2024-09-12T01:39:35.519 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39821.log 2024-09-12T01:39:35.519 INFO:teuthology.orchestra.run.smithi073.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.103058.log.gz 2024-09-12T01:39:35.519 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.84797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128991.log 2024-09-12T01:39:35.519 INFO:teuthology.orchestra.run.smithi073.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.84797.log.gz 2024-09-12T01:39:35.519 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120745.log 0.0% 2024-09-12T01:39:35.520 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39821.log.gz 2024-09-12T01:39:35.520 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.128991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74764.log 2024-09-12T01:39:35.520 INFO:teuthology.orchestra.run.smithi073.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.128991.log.gz 2024-09-12T01:39:35.520 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.120745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143127.log 2024-09-12T01:39:35.520 INFO:teuthology.orchestra.run.smithi073.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.120745.log.gz 2024-09-12T01:39:35.520 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.74764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83619.log 2024-09-12T01:39:35.520 INFO:teuthology.orchestra.run.smithi073.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.74764.log.gz 2024-09-12T01:39:35.520 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.143127.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-12T01:39:35.520 INFO:teuthology.orchestra.run.smithi073.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.143127.log.gz 2024-09-12T01:39:35.520 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.83619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38711.log 2024-09-12T01:39:35.520 INFO:teuthology.orchestra.run.smithi073.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.83619.log.gz 2024-09-12T01:39:35.520 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120156.log 2024-09-12T01:39:35.520 INFO:teuthology.orchestra.run.smithi073.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.63030.log.gz 2024-09-12T01:39:35.521 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.38711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163226.log 2024-09-12T01:39:35.521 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38711.log.gz 2024-09-12T01:39:35.521 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.120156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188932.log 2024-09-12T01:39:35.521 INFO:teuthology.orchestra.run.smithi073.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.120156.log.gz 2024-09-12T01:39:35.521 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.163226.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-12T01:39:35.521 INFO:teuthology.orchestra.run.smithi073.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.163226.log.gz 2024-09-12T01:39:35.521 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.188932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93633.log 2024-09-12T01:39:35.521 INFO:teuthology.orchestra.run.smithi073.stderr: 24.6% -- replaced with /var/log/ceph/ceph-client.admin.188932.log.gz 2024-09-12T01:39:35.521 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38709.log 2024-09-12T01:39:35.521 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.93633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57823.log 2024-09-12T01:39:35.521 INFO:teuthology.orchestra.run.smithi073.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.93633.log.gz 2024-09-12T01:39:35.521 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38709.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38709.log.gz -5 2024-09-12T01:39:35.521 INFO:teuthology.orchestra.run.smithi073.stderr: --verbose -- /var/log/ceph/ceph-client.admin.173864.log 2024-09-12T01:39:35.522 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.57823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137237.log 2024-09-12T01:39:35.522 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57823.log.gz 2024-09-12T01:39:35.522 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38704.log 2024-09-12T01:39:35.522 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.173864.log: /var/log/ceph/ceph-client.admin.137237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67554.log 2024-09-12T01:39:35.522 INFO:teuthology.orchestra.run.smithi073.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.173864.log.gz 2024-09-12T01:39:35.522 INFO:teuthology.orchestra.run.smithi073.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.137237.log.gz 2024-09-12T01:39:35.522 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.176807.log 2024-09-12T01:39:35.522 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38704.log.gz 2024-09-12T01:39:35.522 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.67554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39061.log 2024-09-12T01:39:35.522 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.0.176807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123101.log 2024-09-12T01:39:35.523 INFO:teuthology.orchestra.run.smithi073.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.0.176807.log.gz 2024-09-12T01:39:35.523 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39084.log 2024-09-12T01:39:35.523 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39061.log.gz 2024-09-12T01:39:35.523 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.123101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74174.log 2024-09-12T01:39:35.523 INFO:teuthology.orchestra.run.smithi073.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.123101.log.gz 2024-09-12T01:39:35.523 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39084.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.39084.log.gz -- 2024-09-12T01:39:35.523 INFO:teuthology.orchestra.run.smithi073.stderr: /var/log/ceph/ceph-client.admin.60276.log 2024-09-12T01:39:35.523 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.74174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117800.log 2024-09-12T01:39:35.523 INFO:teuthology.orchestra.run.smithi073.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.67554.log.gz 2024-09-12T01:39:35.523 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.60276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39444.log 2024-09-12T01:39:35.523 INFO:teuthology.orchestra.run.smithi073.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.60276.log.gz 2024-09-12T01:39:35.524 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.117800.log: gzip 89.1% -- replaced with /var/log/ceph/ceph-client.admin.74174.log.gz 2024-09-12T01:39:35.524 INFO:teuthology.orchestra.run.smithi073.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.130758.log 2024-09-12T01:39:35.524 INFO:teuthology.orchestra.run.smithi073.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.117800.log.gz 2024-09-12T01:39:35.524 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133703.log 2024-09-12T01:39:35.524 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39444.log.gz 2024-09-12T01:39:35.524 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.130758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52510.log 2024-09-12T01:39:35.524 INFO:teuthology.orchestra.run.smithi073.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.130758.log.gz 2024-09-12T01:39:35.524 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.133703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156088.log 2024-09-12T01:39:35.524 INFO:teuthology.orchestra.run.smithi073.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.133703.log.gz 2024-09-12T01:39:35.524 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5/var/log/ceph/ceph-client.admin.52510.log: --verbose -- /var/log/ceph/ceph-client.admin.107770.log 2024-09-12T01:39:35.524 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.156088.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.52510.log.gz 2024-09-12T01:39:35.524 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178025.log 2024-09-12T01:39:35.524 INFO:teuthology.orchestra.run.smithi073.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.156088.log.gz 2024-09-12T01:39:35.525 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.107770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101291.log 2024-09-12T01:39:35.525 INFO:teuthology.orchestra.run.smithi073.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.107770.log.gz 2024-09-12T01:39:35.525 INFO:teuthology.orchestra.run.smithi073.stderr:gzip/var/log/ceph/ceph-client.0.178025.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.159033.log 2024-09-12T01:39:35.525 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.101291.log: 80.2% -- replaced with /var/log/ceph/ceph-client.0.178025.log.gz 2024-09-12T01:39:35.525 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191481.log 2024-09-12T01:39:35.525 INFO:teuthology.orchestra.run.smithi073.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.101291.log.gz 2024-09-12T01:39:35.525 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.159033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40020.log 2024-09-12T01:39:35.525 INFO:teuthology.orchestra.run.smithi073.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.159033.log.gz 2024-09-12T01:39:35.525 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.191481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172648.log 2024-09-12T01:39:35.525 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191481.log.gz 2024-09-12T01:39:35.525 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40020.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40020.log.gz 2024-09-12T01:39:35.525 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33195.log 2024-09-12T01:39:35.525 INFO:teuthology.orchestra.run.smithi073.stderr:gzip/var/log/ceph/ceph-client.admin.172648.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.56044.log 2024-09-12T01:39:35.526 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.33195.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33195.log.gz 2024-09-12T01:39:35.526 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43578.log 2024-09-12T01:39:35.526 INFO:teuthology.orchestra.run.smithi073.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.172648.log.gz 2024-09-12T01:39:35.526 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147839.log 2024-09-12T01:39:35.526 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.56044.log: /var/log/ceph/ceph-client.0.43578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48880.log 2024-09-12T01:39:35.526 INFO:teuthology.orchestra.run.smithi073.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.56044.log.gz 2024-09-12T01:39:35.526 INFO:teuthology.orchestra.run.smithi073.stderr: 43.9% -- replaced with /var/log/ceph/ceph-client.0.43578.log.gz 2024-09-12T01:39:35.526 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.147839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56633.log 2024-09-12T01:39:35.526 INFO:teuthology.orchestra.run.smithi073.stderr: 83.1% -- replaced with /var/log/ceph/ceph-client.admin.147839.log.gz 2024-09-12T01:39:35.526 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.48880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144305.log 2024-09-12T01:39:35.526 INFO:teuthology.orchestra.run.smithi073.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.48880.log.gz 2024-09-12T01:39:35.526 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77411.log 2024-09-12T01:39:35.526 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.56633.log: /var/log/ceph/ceph-client.admin.144305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102469.log 2024-09-12T01:39:35.526 INFO:teuthology.orchestra.run.smithi073.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.56633.log.gz 2024-09-12T01:39:35.527 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.77411.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.144305.log.gz 2024-09-12T01:39:35.527 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63095.log 2024-09-12T01:39:35.527 INFO:teuthology.orchestra.run.smithi073.stderr: 48.5% -- replaced with /var/log/ceph/ceph-client.admin.77411.log.gz 2024-09-12T01:39:35.527 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.102469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57848.log 2024-09-12T01:39:35.527 INFO:teuthology.orchestra.run.smithi073.stderr: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.102469.log.gz 2024-09-12T01:39:35.527 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.63095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191527.log 2024-09-12T01:39:35.527 INFO:teuthology.orchestra.run.smithi073.stderr: 55.0% -- replaced with /var/log/ceph/ceph-client.admin.63095.log.gz 2024-09-12T01:39:35.527 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.57848.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57848.log.gz 2024-09-12T01:39:35.527 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160822.log 2024-09-12T01:39:35.527 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.191527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39820.log 2024-09-12T01:39:35.527 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191527.log.gz 2024-09-12T01:39:35.527 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.160822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188342.log 2024-09-12T01:39:35.527 INFO:teuthology.orchestra.run.smithi073.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.160822.log.gz 2024-09-12T01:39:35.528 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39820.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39820.log.gz 2024-09-12T01:39:35.528 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136648.log 2024-09-12T01:39:35.528 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.188342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70033.log 2024-09-12T01:39:35.528 INFO:teuthology.orchestra.run.smithi073.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.188342.log.gz 2024-09-12T01:39:35.528 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.136648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122512.log 2024-09-12T01:39:35.528 INFO:teuthology.orchestra.run.smithi073.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.136648.log.gz 2024-09-12T01:39:35.528 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39447.log 2024-09-12T01:39:35.528 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.70033.log: /var/log/ceph/ceph-client.admin.122512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.179243.log 2024-09-12T01:39:35.528 INFO:teuthology.orchestra.run.smithi073.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.122512.log.gz 2024-09-12T01:39:35.528 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39447.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39447.log.gz -5 2024-09-12T01:39:35.528 INFO:teuthology.orchestra.run.smithi073.stderr: --verbose -- /var/log/ceph/ceph-client.admin.140182.log 2024-09-12T01:39:35.528 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.0.179243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158444.log 2024-09-12T01:39:35.528 INFO:teuthology.orchestra.run.smithi073.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.0.179243.log.gz 2024-09-12T01:39:35.529 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.140182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85386.log 2024-09-12T01:39:35.529 INFO:teuthology.orchestra.run.smithi073.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.140182.log.gz 2024-09-12T01:39:35.529 INFO:teuthology.orchestra.run.smithi073.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.70033.log.gz 2024-09-12T01:39:35.529 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.158444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191619.log 2024-09-12T01:39:35.529 INFO:teuthology.orchestra.run.smithi073.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.158444.log.gz 2024-09-12T01:39:35.529 INFO:teuthology.orchestra.run.smithi073.stderr:gzip/var/log/ceph/ceph-client.admin.85386.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.62573.log 2024-09-12T01:39:35.529 INFO:teuthology.orchestra.run.smithi073.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.85386.log.gz 2024-09-12T01:39:35.529 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.191619.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191619.log.gz 2024-09-12T01:39:35.529 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191297.log 2024-09-12T01:39:35.529 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.62573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41154.log 2024-09-12T01:39:35.529 INFO:teuthology.orchestra.run.smithi073.stderr: 57.0% -- replaced with /var/log/ceph/ceph-client.admin.62573.log.gz 2024-09-12T01:39:35.529 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.191297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126046.log 2024-09-12T01:39:35.529 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191297.log.gz 2024-09-12T01:39:35.529 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.0.41154.log: gzip -5 --verbose 44.2% -- -- replaced with /var/log/ceph/ceph-client.0.41154.log.gz /var/log/ceph/ceph-client.admin.51284.log 2024-09-12T01:39:35.530 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-12T01:39:35.530 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.126046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32757.log 2024-09-12T01:39:35.530 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.51284.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.126046.log.gz 2024-09-12T01:39:35.530 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191803.log 2024-09-12T01:39:35.530 INFO:teuthology.orchestra.run.smithi073.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.51284.log.gz 2024-09-12T01:39:35.530 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100112.log 2024-09-12T01:39:35.530 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.32757.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32757.log.gz 2024-09-12T01:39:35.530 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.191803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111893.log 2024-09-12T01:39:35.530 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191803.log.gz 2024-09-12T01:39:35.530 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.100112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191987.log 2024-09-12T01:39:35.530 INFO:teuthology.orchestra.run.smithi073.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.100112.log.gz 2024-09-12T01:39:35.530 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.111893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39452.log 2024-09-12T01:39:35.530 INFO:teuthology.orchestra.run.smithi073.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.111893.log.gz 2024-09-12T01:39:35.530 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38075.log 2024-09-12T01:39:35.531 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.191987.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191987.log.gz 2024-09-12T01:39:35.531 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39452.log: gzip -5 --verbose 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39452.log.gz 2024-09-12T01:39:35.531 INFO:teuthology.orchestra.run.smithi073.stderr: -- /var/log/ceph/ceph-client.admin.62321.log 2024-09-12T01:39:35.531 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38075.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38075.log.gz 2024-09-12T01:39:35.531 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150196.log 2024-09-12T01:39:35.531 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.62321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153141.log 2024-09-12T01:39:35.531 INFO:teuthology.orchestra.run.smithi073.stderr: 59.0% -- replaced with /var/log/ceph/ceph-client.admin.62321.log.gz 2024-09-12T01:39:35.531 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.150196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188272.log 2024-09-12T01:39:35.531 INFO:teuthology.orchestra.run.smithi073.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.150196.log.gz 2024-09-12T01:39:35.531 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.153141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137826.log 2024-09-12T01:39:35.531 INFO:teuthology.orchestra.run.smithi073.stderr: 83.0% -- replaced with /var/log/ceph/ceph-client.admin.153141.log.gz 2024-09-12T01:39:35.531 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.188272.log: 25.0% -- replaced with /var/log/ceph/ceph-client.admin.188272.log.gz 2024-09-12T01:39:35.531 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T01:39:35.532 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.185942.log 2024-09-12T01:39:35.532 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.137826.log: /var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39083.log 2024-09-12T01:39:35.532 INFO:teuthology.orchestra.run.smithi073.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.137826.log.gz 2024-09-12T01:39:35.532 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.0.185942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41757.log 2024-09-12T01:39:35.532 INFO:teuthology.orchestra.run.smithi073.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.0.185942.log.gz 2024-09-12T01:39:35.532 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39083.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39083.log.gz 2024-09-12T01:39:35.532 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77464.log 2024-09-12T01:39:35.532 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5/var/log/ceph/ceph-client.0.41757.log: --verbose -- /var/log/ceph/ceph-client.admin.80085.log 2024-09-12T01:39:35.532 INFO:teuthology.orchestra.run.smithi073.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.0.41757.log.gz 2024-09-12T01:39:35.532 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.0.77464.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.26665.log 2024-09-12T01:39:35.532 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.80085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54277.log 2024-09-12T01:39:35.532 INFO:teuthology.orchestra.run.smithi073.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.80085.log.gz 2024-09-12T01:39:35.532 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph.tmp-client.admin.26665.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.26665.log.gz 2024-09-12T01:39:35.532 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157266.log 2024-09-12T01:39:35.533 INFO:teuthology.orchestra.run.smithi073.stderr: 94.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T01:39:35.533 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124868.log 2024-09-12T01:39:35.533 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.54277.log: /var/log/ceph/ceph-client.admin.157266.log: gzip 80.2% -5 --verbose -- /var/log/ceph/ceph-client.admin.38713.log 2024-09-12T01:39:35.533 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54277.log.gz 2024-09-12T01:39:35.533 INFO:teuthology.orchestra.run.smithi073.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.157266.log.gz 2024-09-12T01:39:35.533 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.124868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64459.log 2024-09-12T01:39:35.533 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38713.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.124868.log.gz 2024-09-12T01:39:35.533 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82441.log 2024-09-12T01:39:35.533 INFO:teuthology.orchestra.run.smithi073.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.0.77464.log.gz 2024-09-12T01:39:35.533 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38713.log.gz 2024-09-12T01:39:35.533 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.64459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39080.log 2024-09-12T01:39:35.533 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.82441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113660.log 2024-09-12T01:39:35.534 INFO:teuthology.orchestra.run.smithi073.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.82441.log.gz 2024-09-12T01:39:35.534 INFO:teuthology.orchestra.run.smithi073.stderr:gzip/var/log/ceph/ceph-client.admin.39080.log: -5 --verbose -- 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39080.log.gz 2024-09-12T01:39:35.534 INFO:teuthology.orchestra.run.smithi073.stderr: /var/log/ceph/ceph-client.admin.39082.log 2024-09-12T01:39:35.534 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.113660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191711.log 2024-09-12T01:39:35.534 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39082.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39082.log.gz 2024-09-12T01:39:35.534 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187093.log 2024-09-12T01:39:35.534 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.191711.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191711.log.gz 2024-09-12T01:39:35.534 INFO:teuthology.orchestra.run.smithi073.stderr: --verbose -- /var/log/ceph/ceph-client.admin.191435.log 2024-09-12T01:39:35.534 INFO:teuthology.orchestra.run.smithi073.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.113660.log.gz 2024-09-12T01:39:35.534 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.187093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84208.log 2024-09-12T01:39:35.534 INFO:teuthology.orchestra.run.smithi073.stderr: 83.1% -- replaced with /var/log/ceph/ceph-client.admin.187093.log.gz 2024-09-12T01:39:35.534 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.191435.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191435.log.gz 2024-09-12T01:39:35.534 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134292.log 2024-09-12T01:39:35.535 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96578.log 2024-09-12T01:39:35.535 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.84208.log: /var/log/ceph/ceph-client.admin.134292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63157.log 2024-09-12T01:39:35.535 INFO:teuthology.orchestra.run.smithi073.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.84208.log.gz 2024-09-12T01:39:35.535 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.96578.log: gzip -5 --verbose 82.2% -- replaced with /var/log/ceph/ceph-client.admin.96578.log.gz 2024-09-12T01:39:35.535 INFO:teuthology.orchestra.run.smithi073.stderr: -- /var/log/ceph/ceph-client.admin.65697.log 2024-09-12T01:39:35.535 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.63157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170662.log 90.9% -- replaced with /var/log/ceph/ceph-client.admin.63157.log.gz 2024-09-12T01:39:35.535 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-12T01:39:35.535 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.65697.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.134292.log.gz 2024-09-12T01:39:35.535 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75946.log 2024-09-12T01:39:35.535 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.170662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161411.log 2024-09-12T01:39:35.535 INFO:teuthology.orchestra.run.smithi073.stderr: 92.3%/var/log/ceph/ceph-client.admin.75946.log: -- replaced with /var/log/ceph/ceph-client.admin.170662.log.gz 2024-09-12T01:39:35.535 INFO:teuthology.orchestra.run.smithi073.stderr: 24.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76701.log 2024-09-12T01:39:35.535 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.75946.log.gz 2024-09-12T01:39:35.536 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131936.log 2024-09-12T01:39:35.536 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.161411.log: /var/log/ceph/ceph-client.0.76701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.179852.log 2024-09-12T01:39:35.536 INFO:teuthology.orchestra.run.smithi073.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.161411.log.gz 2024-09-12T01:39:35.536 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.131936.log: 84.4% -- replaced with /var/log/ceph/ceph-client.0.76701.log.gz 2024-09-12T01:39:35.536 INFO:teuthology.orchestra.run.smithi073.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.131936.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.185333.log 2024-09-12T01:39:35.536 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-12T01:39:35.536 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.0.179852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133114.log 2024-09-12T01:39:35.536 INFO:teuthology.orchestra.run.smithi073.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.0.179852.log.gz 2024-09-12T01:39:35.536 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191343.log 2024-09-12T01:39:35.536 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.0.185333.log: /var/log/ceph/ceph-client.admin.133114.log: 84.4% -- replaced with /var/log/ceph/ceph-client.0.185333.log.gz 2024-09-12T01:39:35.536 INFO:teuthology.orchestra.run.smithi073.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.133114.log.gz 2024-09-12T01:39:35.536 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.190440.log 2024-09-12T01:39:35.536 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.191343.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191343.log.gz 2024-09-12T01:39:35.537 INFO:teuthology.orchestra.run.smithi073.stderr: --verbose -- /var/log/ceph/ceph-client.admin.51873.log 2024-09-12T01:39:35.537 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.0.190440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175560.log 2024-09-12T01:39:35.537 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.51873.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51873.log.gz 2024-09-12T01:39:35.537 INFO:teuthology.orchestra.run.smithi073.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49469.log 2024-09-12T01:39:35.537 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151374.log 2024-09-12T01:39:35.537 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.49469.log: /var/log/ceph/ceph-client.admin.175560.log: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.65697.log.gz 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49469.log.gz 2024-09-12T01:39:35.537 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-12T01:39:35.537 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127813.log 2024-09-12T01:39:35.537 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.151374.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.admin.log 2024-09-12T01:39:35.537 INFO:teuthology.orchestra.run.smithi073.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.151374.log.gz 2024-09-12T01:39:35.537 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.127813.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.175560.log.gz 2024-09-12T01:39:35.537 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192125.log 2024-09-12T01:39:35.537 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ops-log-ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60865.log 2024-09-12T01:39:35.538 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.192125.log: 86.1% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192125.log.gz 2024-09-12T01:39:35.538 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.127813.log.gz 2024-09-12T01:39:35.538 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191941.log 2024-09-12T01:39:35.538 INFO:teuthology.orchestra.run.smithi073.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.64459.log.gz 2024-09-12T01:39:35.538 INFO:teuthology.orchestra.run.smithi073.stderr:gzip/var/log/ceph/ceph-client.admin.60865.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.166219.log 2024-09-12T01:39:35.538 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.191941.log: 0.0% 85.4% -- replaced with /var/log/ceph/ceph-client.admin.60865.log.gz 2024-09-12T01:39:35.538 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -- replaced with /var/log/ceph/ceph-client.admin.191941.log.gz 2024-09-12T01:39:35.538 INFO:teuthology.orchestra.run.smithi073.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.157855.log 2024-09-12T01:39:35.538 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66935.log 2024-09-12T01:39:35.538 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.157855.log: /var/log/ceph/ceph-client.admin.166219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49493.log 2024-09-12T01:39:35.538 INFO:teuthology.orchestra.run.smithi073.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.157855.log.gz/var/log/ceph/ceph-client.admin.66935.log: 2024-09-12T01:39:35.538 INFO:teuthology.orchestra.run.smithi073.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.166219.log.gz 2024-09-12T01:39:35.538 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101880.log 2024-09-12T01:39:35.539 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189002.log 2024-09-12T01:39:35.539 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.49493.log: 94.3% -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz/var/log/ceph/ceph-client.admin.101880.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49493.log.gz 2024-09-12T01:39:35.539 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-12T01:39:35.539 INFO:teuthology.orchestra.run.smithi073.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.101880.log.gz 2024-09-12T01:39:35.539 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40545.log 2024-09-12T01:39:35.539 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5/var/log/ceph/ceph-client.admin.189002.log: --verbose -- /var/log/ceph/ceph-client.admin.39819.log 2024-09-12T01:39:35.539 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189002.log.gz 2024-09-12T01:39:35.539 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.0.40545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38305.log 2024-09-12T01:39:35.539 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39819.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68792.log 2024-09-12T01:39:35.539 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39819.log.gz 2024-09-12T01:39:35.539 INFO:teuthology.orchestra.run.smithi073.stderr: 95.9% -- replaced with /var/log/ceph/ceph-client.0.40545.log.gz 2024-09-12T01:39:35.539 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38305.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38305.log.gz 2024-09-12T01:39:35.539 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47702.log 2024-09-12T01:39:35.539 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.68792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65078.log 2024-09-12T01:39:35.539 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.47702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58461.log 2024-09-12T01:39:35.540 INFO:teuthology.orchestra.run.smithi073.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.47702.log.gz 2024-09-12T01:39:35.540 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.65078.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.65078.log.gz 2024-09-12T01:39:35.540 INFO:teuthology.orchestra.run.smithi073.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.66935.log.gz 2024-09-12T01:39:35.540 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-12T01:39:35.540 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146072.log 2024-09-12T01:39:35.540 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.58461.log: /var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39815.log 2024-09-12T01:39:35.540 INFO:teuthology.orchestra.run.smithi073.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.58461.log.gz 2024-09-12T01:39:35.540 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.146072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110126.log 2024-09-12T01:39:35.540 INFO:teuthology.orchestra.run.smithi073.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.146072.log.gz 2024-09-12T01:39:35.540 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39815.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39815.log.gz 2024-09-12T01:39:35.540 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106003.log 2024-09-12T01:39:35.540 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49517.log 2024-09-12T01:39:35.540 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.110126.log: /var/log/ceph/ceph-client.admin.106003.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.110126.log.gz 2024-09-12T01:39:35.541 INFO:teuthology.orchestra.run.smithi073.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.106003.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143716.log 2024-09-12T01:39:35.541 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-12T01:39:35.541 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.49517.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.49517.log.gz 2024-09-12T01:39:35.541 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134881.log 2024-09-12T01:39:35.541 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59050.log 2024-09-12T01:39:35.541 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.143716.log: /var/log/ceph/ceph-client.admin.134881.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.143716.log.gz 2024-09-12T01:39:35.541 INFO:teuthology.orchestra.run.smithi073.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.134881.log.gz 2024-09-12T01:39:35.541 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95989.log 2024-09-12T01:39:35.541 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.59050.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.59050.log.gz 2024-09-12T01:39:35.541 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59639.log 2024-09-12T01:39:35.541 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78907.log 2024-09-12T01:39:35.541 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.95989.log: /var/log/ceph/ceph-client.admin.59639.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.95989.log.gz 2024-09-12T01:39:35.541 INFO:teuthology.orchestra.run.smithi073.stderr: 80.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71935.log 2024-09-12T01:39:35.542 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59639.log.gz 2024-09-12T01:39:35.542 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.78907.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.78907.log.gz 2024-09-12T01:39:35.542 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90687.log 2024-09-12T01:39:35.542 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188954.log 2024-09-12T01:39:35.542 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.71935.log: /var/log/ceph/ceph-client.admin.90687.log: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.71935.log.gz 2024-09-12T01:39:35.542 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191205.log 2024-09-12T01:39:35.542 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.188954.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188954.log.gz 2024-09-12T01:39:35.542 INFO:teuthology.orchestra.run.smithi073.stderr: 86.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.184115.log 2024-09-12T01:39:35.542 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.90687.log.gz 2024-09-12T01:39:35.542 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.191205.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191205.log.gz 2024-09-12T01:39:35.542 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117211.log 2024-09-12T01:39:35.542 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141949.log 2024-09-12T01:39:35.542 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.0.184115.log: /var/log/ceph/ceph-client.admin.117211.log: 80.7% -- replaced with /var/log/ceph/ceph-client.0.184115.log.gz 2024-09-12T01:39:35.543 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60252.log 2024-09-12T01:39:35.543 INFO:teuthology.orchestra.run.smithi073.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.117211.log.gz 2024-09-12T01:39:35.543 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.141949.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.141949.log.gz 2024-09-12T01:39:35.543 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142538.log 2024-09-12T01:39:35.543 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191895.log 2024-09-12T01:39:35.543 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.60252.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60252.log.gz 2024-09-12T01:39:35.543 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.142538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87153.log 2024-09-12T01:39:35.543 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.191895.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191895.log.gz 2024-09-12T01:39:35.543 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42969.log 2024-09-12T01:39:35.543 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.87153.log: 86.8% -- replaced with /var/log/ceph/ceph-client.0.190440.log.gz 2024-09-12T01:39:35.543 INFO:teuthology.orchestra.run.smithi073.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.142538.log.gz 2024-09-12T01:39:35.543 INFO:teuthology.orchestra.run.smithi073.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.87153.log.gz 2024-09-12T01:39:35.543 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92455.log 2024-09-12T01:39:35.544 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.0.42969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191665.log 2024-09-12T01:39:35.544 INFO:teuthology.orchestra.run.smithi073.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.0.42969.log.gz 2024-09-12T01:39:35.544 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.92455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174472.log 2024-09-12T01:39:35.544 INFO:teuthology.orchestra.run.smithi073.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.92455.log.gz 2024-09-12T01:39:35.544 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81263.log 2024-09-12T01:39:35.544 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.191665.log: /var/log/ceph/ceph-client.admin.174472.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-12T01:39:35.544 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191665.log.gz 2024-09-12T01:39:35.544 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.81263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188318.log 2024-09-12T01:39:35.544 INFO:teuthology.orchestra.run.smithi073.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.174472.log.gz 2024-09-12T01:39:35.544 INFO:teuthology.orchestra.run.smithi073.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.81263.log.gz 2024-09-12T01:39:35.544 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69411.log 2024-09-12T01:39:35.544 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.188318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154910.log 2024-09-12T01:39:35.544 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188318.log.gz 2024-09-12T01:39:35.545 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.69411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164404.log 2024-09-12T01:39:35.545 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.154910.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.154910.log.gz 2024-09-12T01:39:35.545 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38716.log 2024-09-12T01:39:35.545 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.164404.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.164404.log.gz 2024-09-12T01:39:35.545 INFO:teuthology.orchestra.run.smithi073.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.69411.log.gz 2024-09-12T01:39:35.545 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75355.log 2024-09-12T01:39:35.545 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40434.log 2024-09-12T01:39:35.545 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38716.log.gz 2024-09-12T01:39:35.545 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.75355.log: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.68792.log.gz 2024-09-12T01:39:35.546 INFO:teuthology.orchestra.run.smithi073.stderr:gzip 82.7% -5 --verbose -- /var/log/ceph/ceph-client.admin.81852.log 2024-09-12T01:39:35.546 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.75355.log.gz 2024-09-12T01:39:35.546 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40434.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40434.log.gz 2024-09-12T01:39:35.546 INFO:teuthology.orchestra.run.smithi073.stderr: --verbose -- /var/log/ceph/ceph-client.admin.72993.log 2024-09-12T01:39:35.546 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.81852.log: gzip -5 --verbose -- 81.5% -- replaced with /var/log/ceph/ceph-client.admin.81852.log.gz 2024-09-12T01:39:35.546 INFO:teuthology.orchestra.run.smithi073.stderr: /var/log/ceph/ceph-client.admin.114249.log 2024-09-12T01:39:35.546 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.72993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151963.log 81.0% -- replaced with /var/log/ceph/ceph-client.admin.72993.log.gz 2024-09-12T01:39:35.546 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-12T01:39:35.546 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.114249.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.114249.log.gz 2024-09-12T01:39:35.546 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57222.log 2024-09-12T01:39:35.546 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.151963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57872.log 2024-09-12T01:39:35.546 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.57222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171878.log 82.4% 2024-09-12T01:39:35.546 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.151963.log.gz 2024-09-12T01:39:35.547 INFO:teuthology.orchestra.run.smithi073.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.57222.log.gz 2024-09-12T01:39:35.547 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.57872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173256.log 2024-09-12T01:39:35.547 INFO:teuthology.orchestra.run.smithi073.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.57872.log.gz 2024-09-12T01:39:35.547 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.171878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86564.log 2024-09-12T01:39:35.547 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.173256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39081.log 2024-09-12T01:39:35.547 INFO:teuthology.orchestra.run.smithi073.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.171878.log.gz 2024-09-12T01:39:35.547 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.86564.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.173256.log.gz 2024-09-12T01:39:35.547 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83030.log 2024-09-12T01:39:35.547 INFO:teuthology.orchestra.run.smithi073.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.86564.log.gz 2024-09-12T01:39:35.547 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39081.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39081.log.gz 2024-09-12T01:39:35.547 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.183506.log 2024-09-12T01:39:35.548 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.83030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94811.log 2024-09-12T01:39:35.548 INFO:teuthology.orchestra.run.smithi073.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.83030.log.gz 2024-09-12T01:39:35.548 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.0.183506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91865.log 2024-09-12T01:39:35.548 INFO:teuthology.orchestra.run.smithi073.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.0.183506.log.gz 2024-09-12T01:39:35.548 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.94811.log: gzip -5 --verbose -- 81.9% -- replaced with /var/log/ceph/ceph-client.admin.94811.log.gz 2024-09-12T01:39:35.548 INFO:teuthology.orchestra.run.smithi073.stderr: /var/log/ceph/ceph-client.admin.192171.log 2024-09-12T01:39:35.548 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.91865.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.91865.log.gz 2024-09-12T01:39:35.548 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-12T01:39:35.548 INFO:teuthology.orchestra.run.smithi073.stderr:gzip/var/log/ceph/ceph-client.admin.192171.log: -5 --verbose 0.0% -- /var/log/ceph/ceph-client.admin.66316.log 2024-09-12T01:39:35.548 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.192171.log.gz 2024-09-12T01:39:35.549 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93044.log 2024-09-12T01:39:35.549 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.66316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61454.log 2024-09-12T01:39:35.549 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.93044.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.93044.log.gz 2024-09-12T01:39:35.549 INFO:teuthology.orchestra.run.smithi073.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.66316.log.gz 2024-09-12T01:39:35.549 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116622.log 2024-09-12T01:39:35.549 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.61454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116033.log 2024-09-12T01:39:35.549 INFO:teuthology.orchestra.run.smithi073.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.61454.log.gz 2024-09-12T01:39:35.549 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.116622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100702.log 2024-09-12T01:39:35.549 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.116033.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.116622.log.gz 2024-09-12T01:39:35.549 INFO:teuthology.orchestra.run.smithi073.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.116033.log.gz 2024-09-12T01:39:35.549 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103647.log 2024-09-12T01:39:35.549 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.100702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54866.log 2024-09-12T01:39:35.550 INFO:teuthology.orchestra.run.smithi073.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.100702.log.gz 2024-09-12T01:39:35.550 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.103647.log: gzip -5 --verbose -- /var/log/ceph/valgrind/ceph.client.0.log 2024-09-12T01:39:35.550 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.54866.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.103647.log.gz 2024-09-12T01:39:35.550 INFO:teuthology.orchestra.run.smithi073.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.54866.log.gz 2024-09-12T01:39:35.550 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129580.log 2024-09-12T01:39:35.550 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/valgrind/ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163815.log 2024-09-12T01:39:35.550 INFO:teuthology.orchestra.run.smithi073.stderr: 62.7% -- replaced with /var/log/ceph/valgrind/ceph.client.0.log.gz 2024-09-12T01:39:35.550 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.129580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99523.log 2024-09-12T01:39:35.550 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.163815.log: 87.1% 82.6% -- replaced with /var/log/ceph/ceph-client.admin.163815.log.gz 2024-09-12T01:39:35.550 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.129580.log.gz 2024-09-12T01:39:35.551 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111304.log 2024-09-12T01:39:35.551 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.99523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113071.log 2024-09-12T01:39:35.551 INFO:teuthology.orchestra.run.smithi073.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.99523.log.gz 2024-09-12T01:39:35.551 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.111304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55455.log 2024-09-12T01:39:35.551 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.113071.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.111304.log.gz 2024-09-12T01:39:35.551 INFO:teuthology.orchestra.run.smithi073.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.113071.log.gz 2024-09-12T01:39:35.551 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.180461.log 2024-09-12T01:39:35.551 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.55455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168260.log 2024-09-12T01:39:35.551 INFO:teuthology.orchestra.run.smithi073.stderr: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.55455.log.gz 2024-09-12T01:39:35.551 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.0.180461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191251.log 2024-09-12T01:39:35.552 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.168260.log: 80.9% -- replaced with /var/log/ceph/ceph-client.0.180461.log.gz 2024-09-12T01:39:35.552 INFO:teuthology.orchestra.run.smithi073.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.168260.log.gz 2024-09-12T01:39:35.552 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38708.log 2024-09-12T01:39:35.552 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.191251.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191251.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-12T01:39:35.552 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-12T01:39:35.552 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39063.log 2024-09-12T01:39:35.552 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-mgr.y.log: /var/log/ceph/ceph-client.admin.38708.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38708.log.gz 2024-09-12T01:39:35.552 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110715.log 2024-09-12T01:39:35.552 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39063.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39063.log.gz 2024-09-12T01:39:35.552 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139004.log 2024-09-12T01:39:35.552 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.110715.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.110715.log.gz 2024-09-12T01:39:35.553 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112482.log 2024-09-12T01:39:35.553 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.139004.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.139004.log.gz 2024-09-12T01:39:35.553 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48291.log 2024-09-12T01:39:35.553 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.112482.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.112482.log.gz 2024-09-12T01:39:35.553 INFO:teuthology.orchestra.run.smithi073.stderr: 94.3% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-12T01:39:35.553 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39443.log 2024-09-12T01:39:35.553 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.48291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38282.log 2024-09-12T01:39:35.553 INFO:teuthology.orchestra.run.smithi073.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.48291.log.gz 2024-09-12T01:39:35.553 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39443.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71271.log 2024-09-12T01:39:35.553 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39443.log.gz 2024-09-12T01:39:35.554 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38282.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38282.log.gz 2024-09-12T01:39:35.554 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87742.log 2024-09-12T01:39:35.554 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.71271.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T01:39:35.554 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.87742.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.87742.log.gz 2024-09-12T01:39:35.554 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38364.log 2024-09-12T01:39:35.626 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph.log: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.71271.log.gz 2024-09-12T01:39:35.626 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136059.log 2024-09-12T01:39:35.627 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38364.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38364.log.gz 2024-09-12T01:39:35.627 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191573.log 2024-09-12T01:39:35.627 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.136059.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.136059.log.gz 2024-09-12T01:39:35.627 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191757.log 2024-09-12T01:39:35.627 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.191573.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191573.log.gz 2024-09-12T01:39:35.627 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162000.log 2024-09-12T01:39:35.627 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.191757.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191757.log.gz 2024-09-12T01:39:35.627 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38456.log 2024-09-12T01:39:35.627 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.162000.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.162000.log.gz 2024-09-12T01:39:35.628 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115444.log 2024-09-12T01:39:35.628 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38456.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38456.log.gz 2024-09-12T01:39:35.628 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63870.log 2024-09-12T01:39:35.628 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.115444.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.115444.log.gz 2024-09-12T01:39:35.628 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89509.log 2024-09-12T01:39:35.628 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.63870.log: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.63870.log.gz 2024-09-12T01:39:35.628 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62968.log 2024-09-12T01:39:35.628 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.89509.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.89509.log.gz 2024-09-12T01:39:35.628 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104236.log 2024-09-12T01:39:35.629 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.62968.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62968.log.gz 2024-09-12T01:39:35.629 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192217.log 2024-09-12T01:39:35.629 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.104236.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.104236.log.gz 2024-09-12T01:39:35.629 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94222.log 2024-09-12T01:39:35.629 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.192217.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192217.log.gz 2024-09-12T01:39:35.629 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139593.log 2024-09-12T01:39:35.629 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.94222.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.94222.log.gz 2024-09-12T01:39:35.629 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189027.log 2024-09-12T01:39:35.629 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.139593.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.139593.log.gz 2024-09-12T01:39:35.629 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42366.log 2024-09-12T01:39:35.630 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.189027.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189027.log.gz 2024-09-12T01:39:35.630 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.182288.log 2024-09-12T01:39:35.630 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.0.42366.log: 43.5% -- replaced with /var/log/ceph/ceph-client.0.42366.log.gz 2024-09-12T01:39:35.630 INFO:teuthology.orchestra.run.smithi073.stderr: 93.5% -- replaced with /var/log/ceph/ceph.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170054.log 2024-09-12T01:39:35.630 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-12T01:39:35.630 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51921.log 2024-09-12T01:39:35.630 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.0.182288.log: /var/log/ceph/ceph-client.admin.170054.log: 80.6% -- replaced with /var/log/ceph/ceph-client.0.182288.log.gz 2024-09-12T01:39:35.630 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155499.log 2024-09-12T01:39:35.630 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.51921.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.170054.log.gz 82.0% -- replaced with /var/log/ceph/ceph-client.admin.51921.log.gz 2024-09-12T01:39:35.630 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-12T01:39:35.630 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68173.log 2024-09-12T01:39:35.630 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.155499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128402.log 2024-09-12T01:39:35.630 INFO:teuthology.orchestra.run.smithi073.stderr: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.155499.log.gz 2024-09-12T01:39:35.631 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.68173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118978.log 2024-09-12T01:39:35.631 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.128402.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.128402.log.gz 2024-09-12T01:39:35.631 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95400.log 2024-09-12T01:39:35.631 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.118978.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.118978.log.gz 2024-09-12T01:39:35.631 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40478.log 2024-09-12T01:39:35.631 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.95400.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.68173.log.gz 2024-09-12T01:39:35.631 INFO:teuthology.orchestra.run.smithi073.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.95400.log.gzgzip 2024-09-12T01:39:35.631 INFO:teuthology.orchestra.run.smithi073.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.176168.log 2024-09-12T01:39:35.631 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39676.log 2024-09-12T01:39:35.631 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.176168.log: /var/log/ceph/ceph-client.admin.40478.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40478.log.gz 2024-09-12T01:39:35.631 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189051.log 2024-09-12T01:39:35.631 INFO:teuthology.orchestra.run.smithi073.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.176168.log.gz 2024-09-12T01:39:35.631 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44181.log 2024-09-12T01:39:35.632 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.189051.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39676.log.gz 2024-09-12T01:39:35.632 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38410.log 2024-09-12T01:39:35.632 INFO:teuthology.orchestra.run.smithi073.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.189051.log.gz 2024-09-12T01:39:35.632 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.0.44181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40522.log 2024-09-12T01:39:35.632 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38410.log: 44.2% -- replaced with /var/log/ceph/ceph-client.0.44181.log.gz 2024-09-12T01:39:35.632 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38410.log.gz 2024-09-12T01:39:35.632 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152552.log 2024-09-12T01:39:35.632 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40522.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192079.log 2024-09-12T01:39:35.632 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40522.log.gz 2024-09-12T01:39:35.632 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.181679.log 2024-09-12T01:39:35.632 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.152552.log: /var/log/ceph/ceph-client.admin.192079.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192079.log.gz 2024-09-12T01:39:35.632 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39285.log 2024-09-12T01:39:35.632 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.0.181679.log: 80.6% -- replaced with /var/log/ceph/ceph-client.0.181679.log.gz 2024-09-12T01:39:35.633 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40112.log 2024-09-12T01:39:35.633 INFO:teuthology.orchestra.run.smithi073.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.152552.log.gz/var/log/ceph/ceph-client.admin.39285.log: 2024-09-12T01:39:35.633 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39285.log.gz 2024-09-12T01:39:35.633 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188978.log 2024-09-12T01:39:35.633 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40112.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147250.log 2024-09-12T01:39:35.633 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40112.log.gz 2024-09-12T01:39:35.633 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73582.log 2024-09-12T01:39:35.633 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.188978.log: /var/log/ceph/ceph-client.admin.147250.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188978.log.gz 2024-09-12T01:39:35.633 INFO:teuthology.orchestra.run.smithi073.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.147250.log.gz 2024-09-12T01:39:35.633 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159622.log 2024-09-12T01:39:35.633 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160212.log 2024-09-12T01:39:35.633 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.159622.log: /var/log/ceph/ceph-client.admin.73582.log: 81.4% 84.3% -- replaced with /var/log/ceph/ceph-client.admin.73582.log.gz 2024-09-12T01:39:35.633 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.159622.log.gz 2024-09-12T01:39:35.634 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63692.log 2024-09-12T01:39:35.634 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.160212.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154321.log 2024-09-12T01:39:35.634 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.160212.log.gz 2024-09-12T01:39:35.634 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91276.log 2024-09-12T01:39:35.634 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.63692.log: 19.9% -- replaced with /var/log/ceph/ceph-client.admin.63692.log.gz 2024-09-12T01:39:35.634 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.154321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50106.log 2024-09-12T01:39:35.634 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.91276.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.91276.log.gz 2024-09-12T01:39:35.634 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47113.log 2024-09-12T01:39:35.634 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.50106.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.154321.log.gz 2024-09-12T01:39:35.634 INFO:teuthology.orchestra.run.smithi073.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.50106.log.gz 2024-09-12T01:39:35.634 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39446.log 2024-09-12T01:39:35.634 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.47113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53688.log 2024-09-12T01:39:35.634 INFO:teuthology.orchestra.run.smithi073.stderr: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.47113.log.gz 2024-09-12T01:39:35.635 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39446.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44784.log 2024-09-12T01:39:35.635 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39446.log.gz 2024-09-12T01:39:35.635 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.53688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146661.log 2024-09-12T01:39:35.635 INFO:teuthology.orchestra.run.smithi073.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.53688.log.gz 2024-09-12T01:39:35.635 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.0.44784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76092.log 2024-09-12T01:39:35.635 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.146661.log: 43.5% -- replaced with /var/log/ceph/ceph-client.0.44784.log.gz 2024-09-12T01:39:35.635 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168868.log 2024-09-12T01:39:35.635 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.0.76092.log: 84.2% -- replaced with /var/log/ceph/ceph-client.0.76092.log.gz 2024-09-12T01:39:35.635 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131347.log 2024-09-12T01:39:35.635 INFO:teuthology.orchestra.run.smithi073.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.146661.log.gz 2024-09-12T01:39:35.635 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.168868.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T01:39:35.635 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.131347.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.168868.log.gz 2024-09-12T01:39:35.635 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39445.log 2024-09-12T01:39:35.636 INFO:teuthology.orchestra.run.smithi073.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.131347.log.gz 2024-09-12T01:39:35.636 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141360.log 2024-09-12T01:39:35.636 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39445.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39445.log.gz 2024-09-12T01:39:35.636 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98345.log 2024-09-12T01:39:35.636 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.141360.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.141360.log.gz 2024-09-12T01:39:35.636 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62683.log 2024-09-12T01:39:35.636 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.98345.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.98345.log.gz 2024-09-12T01:39:35.636 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121923.log 2024-09-12T01:39:35.636 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.62683.log: 51.3% -- replaced with /var/log/ceph/ceph-client.admin.62683.log.gz 2024-09-12T01:39:35.636 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33095.log 2024-09-12T01:39:35.636 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.121923.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.121923.log.gz 2024-09-12T01:39:35.636 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191389.log 2024-09-12T01:39:35.636 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.33095.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33095.log.gz 2024-09-12T01:39:35.637 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164993.log 2024-09-12T01:39:35.637 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.191389.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191389.log.gz 2024-09-12T01:39:35.637 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50695.log 2024-09-12T01:39:35.637 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.164993.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164993.log.gz 2024-09-12T01:39:35.637 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97167.log 2024-09-12T01:39:35.637 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.50695.log: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.50695.log.gz 2024-09-12T01:39:35.637 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149607.log 2024-09-12T01:39:35.637 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.97167.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.97167.log.gz 2024-09-12T01:39:35.637 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192353.log 2024-09-12T01:39:35.637 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.149607.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.149607.log.gz 2024-09-12T01:39:35.637 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107181.log 2024-09-12T01:39:35.637 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.192353.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192353.log.gz 2024-09-12T01:39:35.637 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109537.log 2024-09-12T01:39:35.638 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.107181.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.107181.log.gz 2024-09-12T01:39:35.638 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165041.log 2024-09-12T01:39:35.638 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.109537.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.109537.log.gz 2024-09-12T01:39:35.638 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108948.log 2024-09-12T01:39:35.638 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.165041.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.165041.log.gz 2024-09-12T01:39:35.638 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191849.log 2024-09-12T01:39:35.638 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.108948.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.108948.log.gz 2024-09-12T01:39:35.638 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150785.log 2024-09-12T01:39:35.638 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.191849.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191849.log.gz 2024-09-12T01:39:35.638 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126635.log 2024-09-12T01:39:35.638 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.150785.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.150785.log.gz 2024-09-12T01:39:35.638 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78073.log 2024-09-12T01:39:35.639 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.126635.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.126635.log.gz 2024-09-12T01:39:35.639 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127224.log 2024-09-12T01:39:35.639 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.0.78073.log: 80.4% -- replaced with /var/log/ceph/ceph-client.0.78073.log.gz 2024-09-12T01:39:35.639 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70652.log 2024-09-12T01:39:35.639 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.127224.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.127224.log.gz 2024-09-12T01:39:35.639 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.177416.log 2024-09-12T01:39:35.639 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.70652.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.70652.log.gz 2024-09-12T01:39:35.639 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125457.log 2024-09-12T01:39:35.639 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.0.177416.log: 84.3% -- replaced with /var/log/ceph/ceph-client.0.177416.log.gz 2024-09-12T01:39:35.639 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79496.log 2024-09-12T01:39:35.639 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.125457.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.125457.log.gz 2024-09-12T01:39:35.639 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.181070.log 2024-09-12T01:39:35.639 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.79496.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.79496.log.gz 2024-09-12T01:39:35.639 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121334.log 2024-09-12T01:39:35.640 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.0.181070.log: 83.9% -- replaced with /var/log/ceph/ceph-client.0.181070.log.gz 2024-09-12T01:39:35.640 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135470.log 2024-09-12T01:39:35.640 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.121334.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.121334.log.gz 2024-09-12T01:39:35.640 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165630.log 2024-09-12T01:39:35.640 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.135470.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.135470.log.gz 2024-09-12T01:39:35.640 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38710.log 2024-09-12T01:39:35.640 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.165630.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.165630.log.gz 2024-09-12T01:39:35.640 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163178.log 2024-09-12T01:39:35.640 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38710.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38710.log.gz 2024-09-12T01:39:35.640 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192263.log 2024-09-12T01:39:35.640 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.163178.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163178.log.gz 2024-09-12T01:39:35.640 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45387.log 2024-09-12T01:39:35.641 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.192263.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192263.log.gz 2024-09-12T01:39:35.641 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178634.log 2024-09-12T01:39:35.641 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.0.45387.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.45387.log.gz 2024-09-12T01:39:35.641 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-12T01:39:35.641 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.0.178634.log: 84.1% -- replaced with /var/log/ceph/ceph-client.0.178634.log.gz 2024-09-12T01:39:35.641 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85975.log 2024-09-12T01:39:35.641 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192033.log 2024-09-12T01:39:35.641 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.85975.log: 81.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105414.log 2024-09-12T01:39:35.641 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.85975.log.gz 2024-09-12T01:39:35.641 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.192033.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192033.log.gz 2024-09-12T01:39:35.642 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130169.log 2024-09-12T01:39:35.642 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.105414.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.105414.log.gz 2024-09-12T01:39:35.649 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188294.log 2024-09-12T01:39:35.650 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.130169.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.130169.log.gz 2024-09-12T01:39:35.657 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88331.log 2024-09-12T01:39:35.666 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.188294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39817.log 2024-09-12T01:39:35.666 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.88331.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.88331.log.gz 2024-09-12T01:39:35.669 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188294.log.gz 2024-09-12T01:39:35.675 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132525.log 2024-09-12T01:39:35.675 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39817.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39817.log.gz 2024-09-12T01:39:35.691 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88920.log 2024-09-12T01:39:35.691 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.132525.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.132525.log.gz 2024-09-12T01:39:35.704 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153732.log 2024-09-12T01:39:35.705 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.88920.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.88920.log.gz 2024-09-12T01:39:35.713 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39066.log 2024-09-12T01:39:35.723 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.153732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165017.log 2024-09-12T01:39:35.723 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39066.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39066.log.gz 2024-09-12T01:39:35.726 INFO:teuthology.orchestra.run.smithi073.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.153732.log.gz 2024-09-12T01:39:35.740 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108359.log 2024-09-12T01:39:35.741 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.165017.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165017.log.gz 2024-09-12T01:39:35.749 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144894.log 2024-09-12T01:39:35.762 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.108359.log: /var/log/ceph/ceph-client.admin.144894.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.108359.log.gz 2024-09-12T01:39:35.771 INFO:teuthology.orchestra.run.smithi073.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.144894.log.gz 2024-09-12T01:39:36.164 INFO:teuthology.orchestra.run.smithi073.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-12T01:39:36.636 INFO:teuthology.orchestra.run.smithi117.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-12T01:39:36.750 INFO:teuthology.orchestra.run.smithi073.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-12T01:39:38.125 INFO:teuthology.orchestra.run.smithi073.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-12T01:39:39.790 INFO:teuthology.orchestra.run.smithi073.stderr: 92.4% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-12T01:39:40.649 INFO:teuthology.orchestra.run.smithi073.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-12T01:39:42.718 INFO:teuthology.orchestra.run.smithi117.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-12T01:39:43.064 INFO:teuthology.orchestra.run.smithi117.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-12T01:39:43.384 INFO:teuthology.orchestra.run.smithi117.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-12T01:39:44.188 INFO:teuthology.orchestra.run.smithi073.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-12T01:39:47.843 INFO:teuthology.orchestra.run.smithi073.stderr: 94.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-12T01:39:52.728 INFO:teuthology.orchestra.run.smithi117.stderr: 95.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-12T01:39:52.730 INFO:teuthology.orchestra.run.smithi117.stderr: 2024-09-12T01:39:52.731 INFO:teuthology.orchestra.run.smithi117.stderr:real 0m17.319s 2024-09-12T01:39:52.731 INFO:teuthology.orchestra.run.smithi117.stderr:user 0m39.968s 2024-09-12T01:39:52.731 INFO:teuthology.orchestra.run.smithi117.stderr:sys 0m1.458s 2024-09-12T01:39:55.123 INFO:teuthology.orchestra.run.smithi073.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-12T01:39:55.125 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-12T01:39:55.125 INFO:teuthology.orchestra.run.smithi073.stderr:real 0m19.753s 2024-09-12T01:39:55.125 INFO:teuthology.orchestra.run.smithi073.stderr:user 0m53.240s 2024-09-12T01:39:55.125 INFO:teuthology.orchestra.run.smithi073.stderr:sys 0m2.057s 2024-09-12T01:39:55.125 INFO:tasks.ceph:Archiving logs... 2024-09-12T01:39:55.125 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901864/remote/smithi073/log 2024-09-12T01:39:55.126 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T01:40:02.380 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901864/remote/smithi117/log 2024-09-12T01:40:02.381 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T01:40:08.330 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T01:40:08.341 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T01:40:08.341 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T01:40:08.344 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T01:40:08.473 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T01:40:08.512 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T01:40:08.512 DEBUG:teuthology.orchestra.run.smithi073:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T01:40:08.515 DEBUG:teuthology.orchestra.run.smithi117:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T01:40:08.545 INFO:teuthology.orchestra.run.smithi073.stderr:bash: line 1: ntpq: command not found 2024-09-12T01:40:08.549 INFO:teuthology.orchestra.run.smithi117.stderr:bash: line 1: ntpq: command not found 2024-09-12T01:40:08.550 INFO:teuthology.orchestra.run.smithi073.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T01:40:08.550 INFO:teuthology.orchestra.run.smithi073.stdout:=============================================================================== 2024-09-12T01:40:08.550 INFO:teuthology.orchestra.run.smithi073.stdout:^* hv01.front.sepia.ceph.com 3 6 377 48 -2113us[-2111us] +/- 60ms 2024-09-12T01:40:08.550 INFO:teuthology.orchestra.run.smithi073.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 43 -248us[ -248us] +/- 58ms 2024-09-12T01:40:08.550 INFO:teuthology.orchestra.run.smithi073.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 110 +2517us[+2516us] +/- 68ms 2024-09-12T01:40:08.550 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:40:08.553 INFO:teuthology.orchestra.run.smithi117.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T01:40:08.553 INFO:teuthology.orchestra.run.smithi117.stdout:=============================================================================== 2024-09-12T01:40:08.553 INFO:teuthology.orchestra.run.smithi117.stdout:^* hv01.front.sepia.ceph.com 3 6 377 42 -2047us[-2014us] +/- 60ms 2024-09-12T01:40:08.553 INFO:teuthology.orchestra.run.smithi117.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 41 -164us[ -164us] +/- 58ms 2024-09-12T01:40:08.553 INFO:teuthology.orchestra.run.smithi117.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 40 +2579us[+2579us] +/- 70ms 2024-09-12T01:40:08.553 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:40:08.554 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T01:40:08.565 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T01:40:08.565 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T01:40:08.650 DEBUG:teuthology.orchestra.run.smithi073:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T01:40:08.736 DEBUG:teuthology.orchestra.run.smithi117:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T01:40:08.821 DEBUG:teuthology.orchestra.run.smithi073:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T01:40:08.864 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:40:08.865 DEBUG:teuthology.orchestra.run.smithi117:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T01:40:08.908 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:40:08.909 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T01:40:08.919 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T01:40:08.959 INFO:teuthology.task.internal:Duration was 4738.783124 seconds 2024-09-12T01:40:08.960 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T01:40:09.010 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T01:40:09.011 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T01:40:09.013 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T01:40:09.064 INFO:teuthology.orchestra.run.smithi073.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T01:40:09.069 INFO:teuthology.orchestra.run.smithi117.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T01:40:09.528 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T01:40:09.528 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi073.front.sepia.ceph.com 2024-09-12T01:40:09.528 DEBUG:teuthology.orchestra.run.smithi073:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T01:40:09.562 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi117.front.sepia.ceph.com 2024-09-12T01:40:09.563 DEBUG:teuthology.orchestra.run.smithi117:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T01:40:09.608 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T01:40:09.608 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T01:40:09.610 DEBUG:teuthology.orchestra.run.smithi117:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T01:40:09.691 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T01:40:09.691 DEBUG:teuthology.orchestra.run.smithi073:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T01:40:09.693 DEBUG:teuthology.orchestra.run.smithi117:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T01:40:09.848 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T01:40:09.860 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T01:40:09.860 DEBUG:teuthology.orchestra.run.smithi073:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T01:40:09.899 DEBUG:teuthology.orchestra.run.smithi117:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T01:40:09.938 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T01:40:09.949 DEBUG:teuthology.orchestra.run.smithi073:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:40:09.952 DEBUG:teuthology.orchestra.run.smithi117:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:40:09.986 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = core 2024-09-12T01:40:10.014 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern = core 2024-09-12T01:40:10.037 DEBUG:teuthology.orchestra.run.smithi073:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:40:10.071 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:40:10.072 DEBUG:teuthology.orchestra.run.smithi117:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:40:10.106 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:40:10.107 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T01:40:10.120 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T01:40:10.121 DEBUG:teuthology.misc:Transferring archived files from smithi073:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901864/remote/smithi073 2024-09-12T01:40:10.121 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T01:40:10.172 DEBUG:teuthology.misc:Transferring archived files from smithi117:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901864/remote/smithi117 2024-09-12T01:40:10.172 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T01:40:10.218 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T01:40:10.218 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T01:40:10.221 DEBUG:teuthology.orchestra.run.smithi117:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T01:40:10.285 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T01:40:10.298 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T01:40:10.298 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T01:40:10.326 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T01:40:10.326 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T01:40:10.328 DEBUG:teuthology.orchestra.run.smithi117:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T01:40:10.355 INFO:teuthology.orchestra.run.smithi073.stdout: 266063 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 01:40 /home/ubuntu/cephtest 2024-09-12T01:40:10.356 INFO:teuthology.orchestra.run.smithi117.stdout: 266063 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 01:40 /home/ubuntu/cephtest 2024-09-12T01:40:10.358 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T01:40:10.376 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T01:40:10.479 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install accounts$/{main} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} duration: 4738.783124446869 flavor: default owner: scheduled_cbodley@teuthology success: true 2024-09-12T01:40:10.479 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T01:40:10.562 INFO:teuthology.run:pass